2024-09-12T02:31:28.825 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T02:31:28.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T02:31:28.932 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901635 branch: squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/mds-full} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901635' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - disabled conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 client.0: debug client: 20 debug objectcacher: 20 debug objecter: 20 client.1: debug client: 20 debug objectcacher: 20 debug objecter: 20 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon osd backfillfull ratio: 0.6 mon osd full ratio: 0.7 mon osd nearfull ratio: 0.6 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 memstore device bytes: 200000000 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 1.0 osd mon report interval: 5 osd objectstore: memstore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL - PG_RECOVERY_FULL - PG_DEGRADED sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi112.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJXHScXln1VmHjNYlRdhTSOtsNkTO5CU9821bQ9uef9u3tix9zkQLrmAGryPpZA4Ss03aL784xSRTIJ6PKfgRdA= smithi137.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFNvksFVKkFvpVXVDUsqeoyhacP5bLbbZaOvAJzEIjAx7fbq2rUfnijnBskmQoApM8KlSqj0aI69nJOZqvTq9Uo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_full teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T02:31:28.932 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-12T02:31:28.933 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-12T02:31:28.933 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T02:31:28.935 INFO:teuthology.task.internal:Checking packages... 2024-09-12T02:31:28.959 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-12T02:31:28.959 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T02:31:28.959 INFO:teuthology.packaging:ref: None 2024-09-12T02:31:28.959 INFO:teuthology.packaging:tag: None 2024-09-12T02:31:28.959 INFO:teuthology.packaging:branch: squid 2024-09-12T02:31:28.959 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:31:28.960 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-12T02:31:29.193 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-12T02:31:29.195 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T02:31:29.201 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T02:31:29.201 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T02:31:29.218 INFO:teuthology.task.internal:Saving configuration 2024-09-12T02:31:29.235 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T02:31:29.242 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T02:31:29.267 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901635', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 02:26:25.426297', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJXHScXln1VmHjNYlRdhTSOtsNkTO5CU9821bQ9uef9u3tix9zkQLrmAGryPpZA4Ss03aL784xSRTIJ6PKfgRdA='} 2024-09-12T02:31:29.292 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901635', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 02:26:25.424859', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFNvksFVKkFvpVXVDUsqeoyhacP5bLbbZaOvAJzEIjAx7fbq2rUfnijnBskmQoApM8KlSqj0aI69nJOZqvTq9Uo='} 2024-09-12T02:31:29.292 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T02:31:29.298 INFO:teuthology.task.internal:roles: ubuntu@smithi112.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-12T02:31:29.298 INFO:teuthology.task.internal:roles: ubuntu@smithi137.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-12T02:31:29.298 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T02:31:29.354 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f664d107490>, signals=[15]) 2024-09-12T02:31:29.355 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T02:31:29.360 INFO:teuthology.task.internal:Opening connections... 2024-09-12T02:31:29.360 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi112.front.sepia.ceph.com 2024-09-12T02:31:29.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:31:29.436 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T02:31:29.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:31:29.513 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T02:31:29.521 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2024-09-12T02:31:29.539 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2024-09-12T02:31:29.540 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-09-12T02:31:29.597 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2024-09-12T02:31:29.597 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2024-09-12T02:31:29.597 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2024-09-12T02:31:29.597 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2024-09-12T02:31:29.597 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2024-09-12T02:31:29.597 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2024-09-12T02:31:29.597 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T02:31:29.597 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2024-09-12T02:31:29.597 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2024-09-12T02:31:29.597 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T02:31:29.598 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2024-09-12T02:31:29.598 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T02:31:29.598 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T02:31:29.598 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T02:31:29.598 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-09-12T02:31:29.621 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2024-09-12T02:31:29.639 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2024-09-12T02:31:29.640 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2024-09-12T02:31:29.697 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Stream" 2024-09-12T02:31:29.697 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="9" 2024-09-12T02:31:29.697 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos" 2024-09-12T02:31:29.697 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora" 2024-09-12T02:31:29.697 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="9" 2024-09-12T02:31:29.697 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el9" 2024-09-12T02:31:29.698 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T02:31:29.698 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2024-09-12T02:31:29.698 INFO:teuthology.orchestra.run.smithi137.stdout:LOGO="fedora-logo-icon" 2024-09-12T02:31:29.698 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T02:31:29.698 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/" 2024-09-12T02:31:29.698 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T02:31:29.698 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T02:31:29.698 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T02:31:29.698 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2024-09-12T02:31:29.721 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T02:31:29.730 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T02:31:29.736 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T02:31:29.736 DEBUG:teuthology.orchestra.run.smithi112:> test '!' -e /home/ubuntu/cephtest 2024-09-12T02:31:29.738 DEBUG:teuthology.orchestra.run.smithi137:> test '!' -e /home/ubuntu/cephtest 2024-09-12T02:31:29.755 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T02:31:29.760 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T02:31:29.760 DEBUG:teuthology.orchestra.run.smithi112:> test -z $(ls -A /var/lib/ceph) 2024-09-12T02:31:29.796 DEBUG:teuthology.orchestra.run.smithi137:> test -z $(ls -A /var/lib/ceph) 2024-09-12T02:31:29.900 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T02:31:29.957 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T02:31:29.971 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-12T02:31:29.972 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-09-12T02:31:29.972 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-09-12T02:31:29.972 DEBUG:teuthology.orchestra.run.smithi112:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T02:31:29.973 DEBUG:teuthology.orchestra.run.smithi137:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T02:31:29.989 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:31:29.990 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-12T02:31:29.993 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:31:29.993 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-12T02:31:30.170 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-12T02:31:30.171 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-12T02:31:30.171 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-09-12T02:31:30.172 DEBUG:teuthology.task.kernel:sha1 for client.1 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-12T02:31:30.172 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-12T02:31:30.172 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2024-09-12T02:31:30.190 INFO:teuthology.orchestra.run.smithi112.stdout:5.14.0-503.el9.x86_64 2024-09-12T02:31:30.190 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-12T02:31:30.191 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-12T02:31:30.191 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum upgrade -y linux-firmware 2024-09-12T02:31:30.192 INFO:teuthology.orchestra.run.smithi137.stdout:5.14.0-503.el9.x86_64 2024-09-12T02:31:30.192 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-12T02:31:30.192 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-12T02:31:30.193 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum upgrade -y linux-firmware 2024-09-12T02:31:33.736 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.2 MB 00:01 2024-09-12T02:31:34.242 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - BaseOS 3.5 MB/s | 8.2 MB 00:02 2024-09-12T02:31:35.902 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - AppStream 38 MB/s | 20 MB 00:00 2024-09-12T02:31:36.923 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - AppStream 9.8 MB/s | 20 MB 00:02 2024-09-12T02:31:40.173 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-12T02:31:41.490 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - CRB 8.5 MB/s | 6.5 MB 00:00 2024-09-12T02:31:41.620 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 19 kB 00:00 2024-09-12T02:31:42.532 INFO:teuthology.orchestra.run.smithi137.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-12T02:31:42.908 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - Extras packages 101 kB/s | 19 kB 00:00 2024-09-12T02:31:43.770 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-12T02:31:48.188 INFO:teuthology.orchestra.run.smithi137.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-12T02:31:49.176 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 44 kB/s | 1.7 kB 00:00 2024-09-12T02:31:50.293 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-09-12T02:31:50.294 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-09-12T02:31:50.294 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-09-12T02:31:50.410 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-12T02:31:50.411 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-12T02:31:50.558 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-12T02:31:50.559 DEBUG:teuthology.orchestra.run.smithi137:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-12T02:31:50.561 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi137.front.sepia.ceph.com to complete... 2024-09-12T02:31:51.268 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-12T02:31:51.269 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-09-12T02:31:51.269 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-12T02:31:51.369 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-12T02:31:51.370 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-12T02:31:51.515 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-12T02:31:51.515 DEBUG:teuthology.orchestra.run.smithi112:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-12T02:31:51.517 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi112.front.sepia.ceph.com to complete... 2024-09-12T02:32:00.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12 02:32:00 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-12T02:32:00.592 INFO:teuthology.orchestra.run.smithi137.stderr:FINISHED --2024-09-12 02:32:00-- 2024-09-12T02:32:00.592 INFO:teuthology.orchestra.run.smithi137.stderr:Total wall clock time: 10s 2024-09-12T02:32:00.592 INFO:teuthology.orchestra.run.smithi137.stderr:Downloaded: 1 files, 343M in 9.7s (35.3 MB/s) 2024-09-12T02:32:00.594 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-12T02:32:00.595 DEBUG:teuthology.orchestra.run.smithi137:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-12T02:32:02.704 INFO:teuthology.orchestra.run.smithi137.stdout:Verifying... ######################################## 2024-09-12T02:32:02.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12 02:32:02 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-12T02:32:02.777 INFO:teuthology.orchestra.run.smithi112.stderr:FINISHED --2024-09-12 02:32:02-- 2024-09-12T02:32:02.778 INFO:teuthology.orchestra.run.smithi112.stderr:Total wall clock time: 11s 2024-09-12T02:32:02.778 INFO:teuthology.orchestra.run.smithi112.stderr:Downloaded: 1 files, 343M in 11s (31.7 MB/s) 2024-09-12T02:32:02.780 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-12T02:32:02.781 DEBUG:teuthology.orchestra.run.smithi112:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-12T02:32:02.851 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing... ######################################## 2024-09-12T02:32:02.959 INFO:teuthology.orchestra.run.smithi137.stdout:Updating / installing... 2024-09-12T02:32:04.890 INFO:teuthology.orchestra.run.smithi112.stdout:Verifying... ######################################## 2024-09-12T02:32:05.100 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing... ######################################## 2024-09-12T02:32:05.212 INFO:teuthology.orchestra.run.smithi112.stdout:Updating / installing... 2024-09-12T02:32:10.951 INFO:teuthology.orchestra.run.smithi137.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-12T02:32:13.175 INFO:teuthology.orchestra.run.smithi112.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-12T02:32:50.735 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi137.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-12T02:32:50.736 DEBUG:teuthology.orchestra.run.smithi137:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-12T02:32:50.820 INFO:teuthology.orchestra.run.smithi137.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:32:50.820 INFO:teuthology.orchestra.run.smithi137.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:32:50.820 INFO:teuthology.orchestra.run.smithi137.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:32:50.820 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:32:50.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-12T02:32:50.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-12T02:32:50.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-12T02:32:50.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-12T02:32:50.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-12T02:32:50.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-12T02:32:50.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-12T02:32:50.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-12T02:32:50.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-12T02:32:50.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-12T02:32:50.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-12T02:32:50.821 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-12T02:32:50.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-12T02:32:50.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-12T02:32:50.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-12T02:32:50.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-12T02:32:50.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-12T02:32:50.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-12T02:32:50.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-12T02:32:50.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-12T02:32:50.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-12T02:32:50.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-12T02:32:50.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-12T02:32:50.822 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-12T02:32:50.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-12T02:32:50.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-12T02:32:50.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-12T02:32:50.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-12T02:32:50.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-12T02:32:50.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-12T02:32:50.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-12T02:32:50.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-12T02:32:50.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-12T02:32:50.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-12T02:32:50.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-12T02:32:50.823 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-12T02:32:50.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-12T02:32:50.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-12T02:32:50.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-12T02:32:50.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-12T02:32:50.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-12T02:32:50.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-12T02:32:50.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-12T02:32:50.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-12T02:32:50.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-12T02:32:50.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-12T02:32:50.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-12T02:32:50.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-12T02:32:50.824 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-12T02:32:50.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-12T02:32:50.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-12T02:32:50.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-12T02:32:50.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-12T02:32:50.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-12T02:32:50.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-12T02:32:50.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-12T02:32:50.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-12T02:32:50.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-12T02:32:50.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-12T02:32:50.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-12T02:32:50.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-12T02:32:50.825 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-12T02:32:50.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-12T02:32:50.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-12T02:32:50.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-12T02:32:50.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-12T02:32:50.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-12T02:32:50.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-12T02:32:50.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-12T02:32:50.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-12T02:32:50.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-12T02:32:50.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-12T02:32:50.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-12T02:32:50.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-12T02:32:50.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-12T02:32:50.826 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-12T02:32:50.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-12T02:32:50.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-12T02:32:50.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-12T02:32:50.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-12T02:32:50.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-12T02:32:50.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-12T02:32:50.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-12T02:32:50.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-12T02:32:50.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-12T02:32:50.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-12T02:32:50.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-12T02:32:50.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-12T02:32:50.827 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-12T02:32:50.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-12T02:32:50.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-12T02:32:50.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-12T02:32:50.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-12T02:32:50.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-12T02:32:50.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-12T02:32:50.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-12T02:32:50.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-12T02:32:50.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-12T02:32:50.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-12T02:32:50.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-12T02:32:50.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-12T02:32:50.828 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-12T02:32:50.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-12T02:32:50.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-12T02:32:50.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-12T02:32:50.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-12T02:32:50.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-12T02:32:50.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-12T02:32:50.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-12T02:32:50.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-12T02:32:50.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-12T02:32:50.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-12T02:32:50.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-12T02:32:50.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-12T02:32:50.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-12T02:32:50.829 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-12T02:32:50.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-12T02:32:50.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-12T02:32:50.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-12T02:32:50.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-12T02:32:50.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-12T02:32:50.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-12T02:32:50.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-12T02:32:50.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-12T02:32:50.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-12T02:32:50.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-12T02:32:50.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-12T02:32:50.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-12T02:32:50.830 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-12T02:32:50.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-12T02:32:50.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-12T02:32:50.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-12T02:32:50.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-12T02:32:50.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-12T02:32:50.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-12T02:32:50.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-12T02:32:50.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-12T02:32:50.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-12T02:32:50.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-12T02:32:50.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-12T02:32:50.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-12T02:32:50.831 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-12T02:32:50.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-12T02:32:50.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-12T02:32:50.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-12T02:32:50.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-12T02:32:50.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-12T02:32:50.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-12T02:32:50.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-12T02:32:50.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-12T02:32:50.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-12T02:32:50.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-12T02:32:50.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-12T02:32:50.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-12T02:32:50.832 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-12T02:32:50.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-12T02:32:50.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-12T02:32:50.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-12T02:32:50.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-12T02:32:50.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-12T02:32:50.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-12T02:32:50.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-12T02:32:50.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-12T02:32:50.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-12T02:32:50.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-12T02:32:50.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-12T02:32:50.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-12T02:32:50.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-12T02:32:50.833 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-12T02:32:50.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-12T02:32:50.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-12T02:32:50.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-12T02:32:50.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-12T02:32:50.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-12T02:32:50.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-12T02:32:50.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-12T02:32:50.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-12T02:32:50.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-12T02:32:50.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-12T02:32:50.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-12T02:32:50.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-12T02:32:50.834 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-12T02:32:50.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-12T02:32:50.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-12T02:32:50.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-12T02:32:50.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-12T02:32:50.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-12T02:32:50.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-12T02:32:50.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-12T02:32:50.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-12T02:32:50.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-12T02:32:50.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-12T02:32:50.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-12T02:32:50.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-12T02:32:50.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-12T02:32:50.835 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-12T02:32:50.836 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-12T02:32:50.836 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-12T02:32:50.836 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-12T02:32:50.836 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-12T02:32:50.836 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-12T02:32:50.836 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-12T02:32:50.836 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-12T02:32:50.836 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-12T02:32:50.836 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-12T02:32:50.836 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-12T02:32:50.836 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-12T02:32:50.836 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-12T02:32:50.836 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-12T02:32:50.837 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-12T02:32:50.837 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-12T02:32:50.837 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-12T02:32:50.837 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-12T02:32:50.837 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-12T02:32:50.837 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-12T02:32:50.837 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-12T02:32:50.837 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-12T02:32:50.837 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-12T02:32:50.837 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-12T02:32:50.837 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-12T02:32:50.837 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-12T02:32:50.837 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-12T02:32:50.838 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-12T02:32:50.838 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-12T02:32:50.838 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-12T02:32:50.838 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-12T02:32:50.838 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-12T02:32:50.838 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-12T02:32:50.838 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-12T02:32:50.838 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-12T02:32:50.838 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-12T02:32:50.838 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-12T02:32:50.838 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-12T02:32:50.838 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-12T02:32:50.838 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-12T02:32:50.839 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-12T02:32:50.839 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-12T02:32:50.839 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-12T02:32:50.839 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-12T02:32:50.839 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-12T02:32:50.839 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-12T02:32:50.839 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-12T02:32:50.839 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-12T02:32:50.839 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-12T02:32:50.839 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-12T02:32:50.839 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-12T02:32:50.839 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-12T02:32:50.839 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-12T02:32:50.840 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-12T02:32:50.840 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-12T02:32:50.840 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-12T02:32:50.840 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-12T02:32:50.840 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-12T02:32:50.840 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-12T02:32:50.840 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-12T02:32:50.840 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-12T02:32:50.840 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-12T02:32:50.840 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-12T02:32:50.840 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-12T02:32:50.840 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-12T02:32:50.840 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-12T02:32:50.841 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-12T02:32:50.841 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-12T02:32:50.841 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-12T02:32:50.841 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-12T02:32:50.841 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-12T02:32:50.841 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-12T02:32:50.841 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-12T02:32:50.841 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-12T02:32:50.841 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-12T02:32:50.841 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-12T02:32:50.841 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-12T02:32:50.841 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-12T02:32:50.842 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-12T02:32:50.842 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-12T02:32:50.842 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-12T02:32:50.842 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-12T02:32:50.842 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-12T02:32:50.842 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-12T02:32:50.842 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-12T02:32:50.842 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-12T02:32:50.842 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-12T02:32:50.842 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-12T02:32:50.842 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-12T02:32:50.842 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-12T02:32:50.842 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-12T02:32:50.843 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-12T02:32:50.843 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-12T02:32:50.843 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-12T02:32:50.843 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-12T02:32:50.843 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-12T02:32:50.843 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-12T02:32:50.843 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-12T02:32:50.843 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-12T02:32:50.843 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-12T02:32:50.843 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-12T02:32:50.843 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-12T02:32:50.843 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-12T02:32:50.843 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-12T02:32:50.844 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-12T02:32:50.844 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-12T02:32:50.844 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-12T02:32:50.844 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-12T02:32:50.844 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-12T02:32:50.844 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-12T02:32:50.844 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-12T02:32:50.844 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-12T02:32:50.844 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-12T02:32:50.844 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-12T02:32:50.844 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-12T02:32:50.844 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-12T02:32:50.844 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-12T02:32:50.845 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-12T02:32:50.845 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-12T02:32:50.845 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-12T02:32:50.845 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-12T02:32:50.845 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-12T02:32:50.845 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-12T02:32:50.845 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-12T02:32:50.845 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-12T02:32:50.845 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-12T02:32:50.845 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-12T02:32:50.845 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-12T02:32:50.845 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-12T02:32:50.845 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-12T02:32:50.846 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-12T02:32:50.846 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-12T02:32:50.846 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-12T02:32:50.846 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-12T02:32:50.846 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-12T02:32:50.846 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-12T02:32:50.846 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-12T02:32:50.846 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-12T02:32:50.846 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-12T02:32:50.846 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-12T02:32:50.846 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-12T02:32:50.846 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-12T02:32:50.846 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-12T02:32:50.847 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-12T02:32:50.847 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-12T02:32:50.847 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-12T02:32:50.847 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-12T02:32:50.847 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-12T02:32:50.847 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-12T02:32:50.847 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-12T02:32:50.847 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-12T02:32:50.847 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-12T02:32:50.847 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-12T02:32:50.847 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-12T02:32:50.847 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-12T02:32:50.847 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-12T02:32:50.848 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-12T02:32:50.848 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-12T02:32:50.848 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-12T02:32:50.848 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-12T02:32:50.848 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-12T02:32:50.848 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-12T02:32:50.848 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-12T02:32:50.848 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-12T02:32:50.848 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-12T02:32:50.848 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-12T02:32:50.848 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-12T02:32:50.848 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-12T02:32:50.849 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-12T02:32:50.849 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-12T02:32:50.849 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-12T02:32:50.849 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-12T02:32:50.849 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-12T02:32:50.849 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-12T02:32:50.849 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-12T02:32:50.849 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-12T02:32:50.849 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-12T02:32:50.849 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-12T02:32:50.849 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-12T02:32:50.849 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-12T02:32:50.849 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-12T02:32:50.850 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-12T02:32:50.850 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-12T02:32:50.850 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-12T02:32:50.850 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-12T02:32:50.850 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-12T02:32:50.850 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-12T02:32:50.850 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-12T02:32:50.850 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-12T02:32:50.850 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-12T02:32:50.850 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-12T02:32:50.850 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-12T02:32:50.850 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-12T02:32:50.850 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-12T02:32:50.850 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-12T02:32:50.851 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-12T02:32:50.851 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-12T02:32:50.851 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-12T02:32:50.851 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-12T02:32:50.851 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-12T02:32:50.851 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-12T02:32:50.851 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-12T02:32:50.851 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-12T02:32:50.851 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-12T02:32:50.851 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-12T02:32:50.851 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-12T02:32:50.851 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-12T02:32:50.851 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-12T02:32:50.852 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-12T02:32:50.852 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-12T02:32:50.852 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-12T02:32:50.852 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-12T02:32:50.852 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-12T02:32:50.852 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-12T02:32:50.852 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-12T02:32:50.852 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-12T02:32:50.852 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-12T02:32:50.852 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-12T02:32:50.852 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-12T02:32:50.852 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-12T02:32:50.852 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-12T02:32:50.853 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-12T02:32:50.853 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-12T02:32:50.853 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-12T02:32:50.853 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-12T02:32:50.853 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-12T02:32:50.853 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-12T02:32:50.853 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-12T02:32:50.853 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-12T02:32:50.853 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-12T02:32:50.853 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-12T02:32:50.853 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-12T02:32:50.853 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-12T02:32:50.853 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-12T02:32:50.853 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-12T02:32:50.854 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-12T02:32:50.854 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-12T02:32:50.854 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-12T02:32:50.854 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-12T02:32:50.854 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-12T02:32:50.854 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-12T02:32:50.854 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-12T02:32:50.854 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-12T02:32:50.854 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-12T02:32:50.854 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-12T02:32:50.854 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-12T02:32:50.854 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-12T02:32:50.855 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-12T02:32:50.855 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-12T02:32:50.855 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-12T02:32:50.855 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-12T02:32:50.855 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-12T02:32:50.855 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-12T02:32:50.855 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-12T02:32:50.855 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-12T02:32:50.855 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-12T02:32:50.855 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-12T02:32:50.855 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-12T02:32:50.855 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-12T02:32:50.855 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-12T02:32:50.856 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-12T02:32:50.856 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-12T02:32:50.856 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-12T02:32:50.856 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-12T02:32:50.856 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-12T02:32:50.856 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-12T02:32:50.856 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-12T02:32:50.856 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-12T02:32:50.856 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-12T02:32:50.856 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-12T02:32:50.856 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-12T02:32:50.856 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-12T02:32:50.856 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-12T02:32:50.857 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-12T02:32:50.857 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-12T02:32:50.857 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-12T02:32:50.857 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-12T02:32:50.857 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-12T02:32:50.857 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-12T02:32:50.857 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-12T02:32:50.857 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-12T02:32:50.857 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-12T02:32:50.857 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-12T02:32:50.858 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-12T02:32:50.858 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-12T02:32:50.858 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-12T02:32:50.858 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-12T02:32:50.858 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-12T02:32:50.858 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-12T02:32:50.858 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-12T02:32:50.858 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-12T02:32:50.858 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-12T02:32:50.858 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-12T02:32:50.858 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-12T02:32:50.858 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-12T02:32:50.858 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-12T02:32:50.859 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-12T02:32:50.859 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-12T02:32:50.859 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-12T02:32:50.859 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-12T02:32:50.859 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-12T02:32:50.859 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-12T02:32:50.859 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-12T02:32:50.859 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-12T02:32:50.859 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-12T02:32:50.859 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-12T02:32:50.859 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-12T02:32:50.859 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-12T02:32:50.859 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-12T02:32:50.860 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-12T02:32:50.860 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-12T02:32:50.860 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-12T02:32:50.860 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-12T02:32:50.860 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-12T02:32:50.860 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-12T02:32:50.860 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-12T02:32:50.860 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-12T02:32:50.860 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-12T02:32:50.860 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-12T02:32:50.860 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-12T02:32:50.860 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-12T02:32:50.860 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-12T02:32:50.861 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-12T02:32:50.861 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-12T02:32:50.861 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-12T02:32:50.861 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-12T02:32:50.861 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-12T02:32:50.861 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-12T02:32:50.861 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-12T02:32:50.861 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-12T02:32:50.861 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-12T02:32:50.861 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-12T02:32:50.861 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-12T02:32:50.861 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-12T02:32:50.861 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-12T02:32:50.861 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-12T02:32:50.862 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-12T02:32:50.862 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-12T02:32:50.862 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-12T02:32:50.862 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-12T02:32:50.862 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-12T02:32:50.862 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-12T02:32:50.862 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-12T02:32:50.862 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-12T02:32:50.862 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-12T02:32:50.862 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-12T02:32:50.863 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-12T02:32:50.863 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-12T02:32:50.863 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-12T02:32:50.863 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-12T02:32:50.863 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-12T02:32:50.863 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-12T02:32:50.863 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-12T02:32:50.863 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-12T02:32:50.863 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-12T02:32:50.863 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-12T02:32:50.863 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-12T02:32:50.863 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-12T02:32:50.863 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-12T02:32:50.863 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-12T02:32:50.864 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-12T02:32:50.864 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-12T02:32:50.864 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-12T02:32:50.864 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-12T02:32:50.864 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-12T02:32:50.864 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-12T02:32:50.864 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-12T02:32:50.864 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-12T02:32:50.864 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-12T02:32:50.864 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-12T02:32:50.864 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-12T02:32:50.864 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-12T02:32:50.864 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-12T02:32:50.865 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-12T02:32:50.865 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-12T02:32:50.865 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-12T02:32:50.865 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-12T02:32:50.865 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-12T02:32:50.865 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-12T02:32:50.865 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-12T02:32:50.865 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-12T02:32:50.865 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-12T02:32:50.865 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-12T02:32:50.865 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-12T02:32:50.865 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-12T02:32:50.866 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-12T02:32:50.866 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-12T02:32:50.866 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-12T02:32:50.866 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-12T02:32:50.866 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-12T02:32:50.866 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-12T02:32:50.866 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-12T02:32:50.866 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-12T02:32:50.866 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-12T02:32:50.866 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-12T02:32:50.866 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-12T02:32:50.866 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-12T02:32:50.866 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-12T02:32:50.867 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-12T02:32:50.867 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-12T02:32:50.867 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-12T02:32:50.867 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-12T02:32:50.867 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-12T02:32:50.867 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-12T02:32:50.867 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-12T02:32:50.867 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-12T02:32:50.867 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-12T02:32:50.867 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-12T02:32:50.867 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-12T02:32:50.867 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-12T02:32:50.867 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-12T02:32:50.868 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-12T02:32:50.868 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-12T02:32:50.868 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-12T02:32:50.868 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-12T02:32:50.868 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-12T02:32:50.868 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-12T02:32:50.868 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-12T02:32:50.868 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-12T02:32:50.868 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-12T02:32:50.868 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-12T02:32:50.868 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-12T02:32:50.868 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-12T02:32:50.868 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-12T02:32:50.869 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-12T02:32:50.869 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-12T02:32:50.869 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-12T02:32:50.869 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-12T02:32:50.869 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-12T02:32:50.869 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-12T02:32:50.869 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-12T02:32:50.869 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-12T02:32:50.869 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-12T02:32:50.869 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-12T02:32:50.869 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-12T02:32:50.869 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-12T02:32:50.870 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-12T02:32:50.870 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-12T02:32:50.870 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-12T02:32:50.870 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-12T02:32:50.870 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-12T02:32:50.870 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-12T02:32:50.870 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-12T02:32:50.870 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-12T02:32:50.870 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-12T02:32:50.870 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-12T02:32:50.870 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-12T02:32:50.870 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-12T02:32:50.870 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-12T02:32:50.870 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-12T02:32:50.871 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-12T02:32:50.871 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-12T02:32:50.871 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-12T02:32:50.871 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-12T02:32:50.871 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-12T02:32:50.871 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-12T02:32:50.871 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-12T02:32:50.871 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-12T02:32:50.871 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-12T02:32:50.871 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-12T02:32:50.871 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-12T02:32:50.871 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-12T02:32:50.872 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-12T02:32:50.872 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-12T02:32:50.872 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-12T02:32:50.872 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-12T02:32:50.872 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-12T02:32:50.872 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-12T02:32:50.872 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-12T02:32:50.872 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-12T02:32:50.872 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-12T02:32:50.872 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-12T02:32:50.872 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-12T02:32:50.872 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-12T02:32:50.873 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-12T02:32:50.873 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-12T02:32:50.873 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-12T02:32:50.873 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-12T02:32:50.873 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-12T02:32:50.873 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-12T02:32:50.873 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-12T02:32:50.873 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-12T02:32:50.873 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-12T02:32:50.873 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-12T02:32:50.873 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-12T02:32:50.873 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-12T02:32:50.873 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-12T02:32:50.874 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-12T02:32:50.874 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-12T02:32:50.874 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-12T02:32:50.874 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-12T02:32:50.874 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-12T02:32:50.874 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-12T02:32:50.874 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-12T02:32:50.874 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-12T02:32:50.874 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-12T02:32:50.874 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-12T02:32:50.874 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-12T02:32:50.874 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-12T02:32:50.875 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-12T02:32:50.875 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-12T02:32:50.875 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-12T02:32:50.875 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-12T02:32:50.875 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-12T02:32:50.875 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-12T02:32:50.875 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-12T02:32:50.875 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-12T02:32:50.875 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-12T02:32:50.875 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-12T02:32:50.875 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-12T02:32:50.875 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-12T02:32:50.875 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-12T02:32:50.876 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-12T02:32:50.876 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-12T02:32:50.876 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-12T02:32:50.876 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-12T02:32:50.876 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-12T02:32:50.876 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-12T02:32:50.876 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-12T02:32:50.876 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-12T02:32:50.876 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-12T02:32:50.877 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-12T02:32:50.877 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-12T02:32:50.877 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-12T02:32:50.877 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-12T02:32:50.877 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-12T02:32:50.877 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-12T02:32:50.877 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-12T02:32:50.877 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-12T02:32:50.877 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-12T02:32:50.877 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-12T02:32:50.877 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-12T02:32:50.877 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-12T02:32:50.877 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-12T02:32:50.878 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-12T02:32:50.878 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-12T02:32:50.878 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-12T02:32:50.878 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-12T02:32:50.878 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-12T02:32:50.878 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-12T02:32:50.878 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-12T02:32:50.878 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-12T02:32:50.878 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-12T02:32:50.878 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-12T02:32:50.878 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-12T02:32:50.878 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-12T02:32:50.878 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-12T02:32:50.878 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-12T02:32:50.879 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-12T02:32:50.879 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-12T02:32:50.879 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-12T02:32:50.879 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-12T02:32:50.879 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-12T02:32:50.879 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-12T02:32:50.879 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-12T02:32:50.879 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-12T02:32:50.879 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-12T02:32:50.879 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-12T02:32:50.879 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-12T02:32:50.879 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-12T02:32:50.879 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-12T02:32:50.880 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-12T02:32:50.880 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-12T02:32:50.880 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-12T02:32:50.880 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-12T02:32:50.880 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-12T02:32:50.880 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-12T02:32:50.880 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-12T02:32:50.880 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-12T02:32:50.880 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-12T02:32:50.880 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-12T02:32:50.880 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-12T02:32:50.880 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-12T02:32:50.880 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-12T02:32:50.881 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-12T02:32:50.881 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-12T02:32:50.881 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-12T02:32:50.881 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-12T02:32:50.881 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-12T02:32:50.881 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-12T02:32:50.881 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-12T02:32:50.881 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-12T02:32:50.881 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-12T02:32:50.881 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-12T02:32:50.881 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-12T02:32:50.881 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-12T02:32:50.881 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-12T02:32:50.882 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-12T02:32:50.882 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-12T02:32:50.882 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-12T02:32:50.882 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-12T02:32:50.882 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-12T02:32:50.882 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-12T02:32:50.882 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-12T02:32:50.882 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-12T02:32:50.882 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-12T02:32:50.882 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-12T02:32:50.882 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-12T02:32:50.882 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-12T02:32:50.882 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-12T02:32:50.883 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-12T02:32:50.883 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-12T02:32:50.883 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-12T02:32:50.883 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-12T02:32:50.883 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-12T02:32:50.883 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-12T02:32:50.883 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-12T02:32:50.883 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-12T02:32:50.883 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-12T02:32:50.883 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-12T02:32:50.883 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-12T02:32:50.883 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-12T02:32:50.883 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-12T02:32:50.883 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-12T02:32:50.884 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-12T02:32:50.884 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-12T02:32:50.884 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-12T02:32:50.884 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-12T02:32:50.884 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-12T02:32:50.884 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-12T02:32:50.884 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-12T02:32:50.884 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-12T02:32:50.884 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-12T02:32:50.884 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-12T02:32:50.884 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-12T02:32:50.884 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-12T02:32:50.884 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-12T02:32:50.885 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-12T02:32:50.885 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-12T02:32:50.885 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-12T02:32:50.885 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-12T02:32:50.885 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-12T02:32:50.885 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-12T02:32:50.885 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-12T02:32:50.885 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-12T02:32:50.885 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-12T02:32:50.885 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-12T02:32:50.885 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-12T02:32:50.885 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-12T02:32:50.885 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-12T02:32:50.886 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-12T02:32:50.886 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-12T02:32:50.886 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-12T02:32:50.886 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-12T02:32:50.886 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-12T02:32:50.886 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-12T02:32:50.886 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-12T02:32:50.886 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-12T02:32:50.886 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-12T02:32:50.886 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-12T02:32:50.886 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-12T02:32:50.886 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-12T02:32:50.886 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-12T02:32:50.886 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-12T02:32:50.887 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-12T02:32:50.887 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-12T02:32:50.887 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-12T02:32:50.887 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-12T02:32:50.887 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-12T02:32:50.887 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-12T02:32:50.887 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-12T02:32:50.887 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-12T02:32:50.887 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-12T02:32:50.887 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-12T02:32:50.887 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-12T02:32:50.887 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-12T02:32:50.887 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-12T02:32:50.888 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-12T02:32:50.888 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-12T02:32:50.888 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-12T02:32:50.888 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-12T02:32:50.888 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-12T02:32:50.888 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-12T02:32:50.888 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-12T02:32:50.888 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-12T02:32:50.888 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-12T02:32:50.888 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-12T02:32:50.888 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-12T02:32:50.888 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-12T02:32:50.888 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-12T02:32:50.889 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-12T02:32:50.889 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-12T02:32:50.889 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-12T02:32:50.889 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-12T02:32:50.889 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-12T02:32:50.889 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-12T02:32:50.889 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-12T02:32:50.889 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-12T02:32:50.889 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-12T02:32:50.889 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-12T02:32:50.889 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-12T02:32:50.889 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-12T02:32:50.889 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-12T02:32:50.890 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-12T02:32:50.890 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-12T02:32:50.890 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-12T02:32:50.890 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-12T02:32:50.890 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-12T02:32:50.890 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-12T02:32:50.890 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-12T02:32:50.890 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-12T02:32:50.890 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-12T02:32:50.890 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-12T02:32:50.890 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-12T02:32:50.890 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-12T02:32:50.890 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-12T02:32:50.891 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-12T02:32:50.891 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-12T02:32:50.891 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-12T02:32:50.891 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-12T02:32:50.891 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-12T02:32:50.891 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-12T02:32:50.891 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-12T02:32:50.891 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-12T02:32:50.891 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-12T02:32:50.891 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-12T02:32:50.891 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-12T02:32:50.891 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-12T02:32:50.891 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-12T02:32:50.891 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-12T02:32:50.892 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-12T02:32:50.892 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-12T02:32:50.892 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-12T02:32:50.892 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-12T02:32:50.892 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-12T02:32:50.892 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-12T02:32:50.892 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-12T02:32:50.892 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-12T02:32:50.892 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-12T02:32:50.892 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-12T02:32:50.892 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-12T02:32:50.892 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-12T02:32:50.892 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-12T02:32:50.893 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-12T02:32:50.893 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-12T02:32:50.893 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-12T02:32:50.893 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-12T02:32:50.893 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-12T02:32:50.893 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-12T02:32:50.893 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-12T02:32:50.893 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-12T02:32:50.893 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-12T02:32:50.893 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-12T02:32:50.893 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-12T02:32:50.893 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-12T02:32:50.893 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-12T02:32:50.893 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-12T02:32:50.894 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-12T02:32:50.894 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-12T02:32:50.894 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-12T02:32:50.894 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-12T02:32:50.894 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-12T02:32:50.894 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-12T02:32:50.894 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-12T02:32:50.894 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-12T02:32:50.894 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-12T02:32:50.894 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-12T02:32:50.894 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-12T02:32:50.894 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-12T02:32:50.894 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-12T02:32:50.895 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-12T02:32:50.895 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-12T02:32:50.895 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-12T02:32:50.895 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-12T02:32:50.895 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-12T02:32:50.895 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-12T02:32:50.895 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-12T02:32:50.895 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-12T02:32:50.895 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-12T02:32:50.895 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-12T02:32:50.895 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-12T02:32:50.895 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-12T02:32:50.895 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-12T02:32:50.896 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-12T02:32:50.896 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-12T02:32:50.896 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-12T02:32:50.896 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-12T02:32:50.896 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-12T02:32:50.896 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-12T02:32:50.896 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-12T02:32:50.896 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-12T02:32:50.896 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-12T02:32:50.896 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-12T02:32:50.896 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-12T02:32:50.896 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-12T02:32:50.896 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-12T02:32:50.897 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-12T02:32:50.897 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-12T02:32:50.897 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-12T02:32:50.897 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-12T02:32:50.897 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-12T02:32:50.897 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-12T02:32:50.897 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-12T02:32:50.897 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-12T02:32:50.897 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-12T02:32:50.897 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-12T02:32:50.897 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-12T02:32:50.897 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-12T02:32:50.897 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-12T02:32:50.897 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-12T02:32:50.898 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-12T02:32:50.898 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-12T02:32:50.898 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-12T02:32:50.898 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-12T02:32:50.898 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-12T02:32:50.898 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-12T02:32:50.898 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-12T02:32:50.898 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-12T02:32:50.898 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-12T02:32:50.898 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-12T02:32:50.898 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-12T02:32:50.898 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-12T02:32:50.898 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-12T02:32:50.899 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-12T02:32:50.899 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-12T02:32:50.899 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-12T02:32:50.899 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-12T02:32:50.899 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-12T02:32:50.899 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-12T02:32:50.899 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-12T02:32:50.899 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-12T02:32:50.899 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-12T02:32:50.899 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-12T02:32:50.899 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-12T02:32:50.899 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-12T02:32:50.899 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-12T02:32:50.899 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-12T02:32:50.900 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-12T02:32:50.900 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-12T02:32:50.900 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-12T02:32:50.900 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-12T02:32:50.900 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-12T02:32:50.900 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-12T02:32:50.900 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-12T02:32:50.900 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-12T02:32:50.900 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-12T02:32:50.900 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-12T02:32:50.900 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-12T02:32:50.900 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-12T02:32:50.901 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-12T02:32:50.901 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-12T02:32:50.901 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-12T02:32:50.901 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-12T02:32:50.901 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-12T02:32:50.901 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-12T02:32:50.901 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-12T02:32:50.901 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-12T02:32:50.901 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-12T02:32:50.901 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-12T02:32:50.901 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-12T02:32:50.901 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-12T02:32:50.901 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-12T02:32:50.902 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-12T02:32:50.902 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-12T02:32:50.902 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-12T02:32:50.902 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-12T02:32:50.902 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-12T02:32:50.902 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-12T02:32:50.902 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-12T02:32:50.902 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-12T02:32:50.902 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-12T02:32:50.902 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-12T02:32:50.902 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-12T02:32:50.902 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-12T02:32:50.902 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-12T02:32:50.903 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-12T02:32:50.903 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-12T02:32:50.903 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-12T02:32:50.903 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-12T02:32:50.903 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-12T02:32:50.903 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-12T02:32:50.903 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-12T02:32:50.903 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-12T02:32:50.903 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-12T02:32:50.903 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-12T02:32:50.903 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-12T02:32:50.903 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-12T02:32:50.903 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-12T02:32:50.903 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-12T02:32:50.904 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-12T02:32:50.904 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-12T02:32:50.904 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-12T02:32:50.904 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-12T02:32:50.904 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-12T02:32:50.904 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-12T02:32:50.904 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-12T02:32:50.904 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-12T02:32:50.904 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-12T02:32:50.904 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-12T02:32:50.904 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-12T02:32:50.904 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-12T02:32:50.904 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-12T02:32:50.904 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-12T02:32:50.905 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-12T02:32:50.905 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-12T02:32:50.905 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-12T02:32:50.905 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-12T02:32:50.905 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-12T02:32:50.905 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-12T02:32:50.905 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-12T02:32:50.905 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-12T02:32:50.905 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-12T02:32:50.905 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-12T02:32:50.905 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-12T02:32:50.905 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-12T02:32:50.905 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-12T02:32:50.905 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-12T02:32:50.906 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-12T02:32:50.906 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-12T02:32:50.906 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-12T02:32:50.906 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-12T02:32:50.906 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-12T02:32:50.906 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-12T02:32:50.906 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-12T02:32:50.906 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-12T02:32:50.906 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-12T02:32:50.906 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-12T02:32:50.906 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-12T02:32:50.906 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-12T02:32:50.906 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-12T02:32:50.907 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-12T02:32:50.907 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-12T02:32:50.907 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-12T02:32:50.907 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-12T02:32:50.907 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-12T02:32:50.907 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-12T02:32:50.907 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-12T02:32:50.907 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-12T02:32:50.907 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-12T02:32:50.907 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-12T02:32:50.907 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-12T02:32:50.907 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-12T02:32:50.908 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-12T02:32:50.908 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-12T02:32:50.908 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-12T02:32:50.908 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-12T02:32:50.908 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-12T02:32:50.908 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-12T02:32:50.908 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-12T02:32:50.908 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-12T02:32:50.908 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-12T02:32:50.908 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-12T02:32:50.908 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-12T02:32:50.908 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-12T02:32:50.908 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-12T02:32:50.908 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-12T02:32:50.909 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-12T02:32:50.909 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-12T02:32:50.909 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-12T02:32:50.909 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-12T02:32:50.909 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-12T02:32:50.909 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-12T02:32:50.909 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-12T02:32:50.909 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-12T02:32:50.912 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-12T02:32:50.913 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-12T02:32:50.913 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-12T02:32:50.913 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-12T02:32:50.913 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-12T02:32:50.913 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-12T02:32:50.913 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-12T02:32:50.913 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-12T02:32:50.913 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-12T02:32:50.913 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-12T02:32:50.913 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-12T02:32:50.913 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-12T02:32:50.913 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-12T02:32:50.913 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-12T02:32:50.914 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-12T02:32:50.914 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-12T02:32:50.914 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-12T02:32:50.914 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-12T02:32:50.914 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-12T02:32:50.914 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-12T02:32:50.914 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-12T02:32:50.914 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-12T02:32:50.914 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-12T02:32:50.914 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-12T02:32:50.914 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-12T02:32:50.914 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-12T02:32:50.914 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-12T02:32:50.914 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-12T02:32:50.915 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-12T02:32:50.915 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-12T02:32:50.915 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-12T02:32:50.915 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-12T02:32:50.915 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-12T02:32:50.915 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-12T02:32:50.915 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-12T02:32:50.915 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-12T02:32:50.915 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-12T02:32:50.915 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-12T02:32:50.915 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-12T02:32:50.915 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-12T02:32:50.915 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-12T02:32:50.915 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-12T02:32:50.916 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-12T02:32:50.916 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-12T02:32:50.916 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-12T02:32:50.916 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-12T02:32:50.916 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-12T02:32:50.916 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-12T02:32:50.916 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-12T02:32:50.916 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-12T02:32:50.916 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-12T02:32:50.916 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-12T02:32:50.916 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-12T02:32:50.916 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-12T02:32:50.916 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-12T02:32:50.917 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-12T02:32:50.917 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-12T02:32:50.917 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-12T02:32:50.917 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-12T02:32:50.917 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-12T02:32:50.917 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-12T02:32:50.917 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-12T02:32:50.917 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-12T02:32:50.917 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-12T02:32:50.917 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-12T02:32:50.917 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-12T02:32:50.917 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-12T02:32:50.917 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-12T02:32:50.918 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-12T02:32:50.918 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-12T02:32:50.918 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-12T02:32:50.918 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-12T02:32:50.918 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-12T02:32:50.918 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-12T02:32:50.918 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-12T02:32:50.918 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-12T02:32:50.918 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-12T02:32:50.918 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-12T02:32:50.918 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-12T02:32:50.918 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-12T02:32:50.918 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-12T02:32:50.919 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-12T02:32:50.919 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-12T02:32:50.919 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-12T02:32:50.919 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-12T02:32:50.919 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-12T02:32:50.919 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-12T02:32:50.919 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-12T02:32:50.919 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-12T02:32:50.919 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-12T02:32:50.919 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-12T02:32:50.919 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-12T02:32:50.919 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-12T02:32:50.919 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-12T02:32:50.919 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-12T02:32:50.919 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-12T02:32:50.920 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-12T02:32:50.920 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-12T02:32:50.920 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-12T02:32:50.920 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-12T02:32:50.920 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-12T02:32:50.920 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-12T02:32:50.920 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-12T02:32:50.920 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-12T02:32:50.920 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-12T02:32:50.920 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-12T02:32:50.920 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-12T02:32:50.920 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-12T02:32:50.920 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-12T02:32:50.921 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-12T02:32:50.921 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-12T02:32:50.921 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-12T02:32:50.921 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-12T02:32:50.921 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-12T02:32:50.921 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-12T02:32:50.921 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-12T02:32:50.921 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-12T02:32:50.921 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-12T02:32:50.921 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-12T02:32:50.921 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-12T02:32:50.921 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-12T02:32:50.921 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-12T02:32:50.921 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-12T02:32:50.922 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-12T02:32:50.922 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-12T02:32:50.922 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-12T02:32:50.922 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-12T02:32:50.922 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-12T02:32:50.922 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-12T02:32:50.922 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-12T02:32:50.922 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-12T02:32:50.922 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-12T02:32:50.922 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-12T02:32:50.922 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-12T02:32:50.922 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-12T02:32:50.922 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-12T02:32:50.922 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-12T02:32:50.923 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-12T02:32:50.923 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-12T02:32:50.923 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-12T02:32:50.923 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-12T02:32:50.923 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-12T02:32:50.923 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-12T02:32:50.923 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-12T02:32:50.923 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-12T02:32:50.923 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-12T02:32:50.923 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-12T02:32:50.923 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-12T02:32:50.923 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-12T02:32:50.923 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-12T02:32:50.923 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-12T02:32:50.924 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-12T02:32:50.924 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-12T02:32:50.924 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-12T02:32:50.924 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-12T02:32:50.924 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-12T02:32:50.924 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-12T02:32:50.924 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-12T02:32:50.924 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-12T02:32:50.924 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-12T02:32:50.924 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-12T02:32:50.924 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-12T02:32:50.924 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-12T02:32:50.925 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-12T02:32:50.925 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-12T02:32:50.925 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-12T02:32:50.925 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-12T02:32:50.925 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-12T02:32:50.925 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-12T02:32:50.925 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-12T02:32:50.925 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-12T02:32:50.925 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-12T02:32:50.925 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-12T02:32:50.925 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-12T02:32:50.925 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-12T02:32:50.925 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-12T02:32:50.925 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-12T02:32:50.925 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-12T02:32:50.926 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-12T02:32:50.926 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-12T02:32:50.926 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-12T02:32:50.926 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-12T02:32:50.926 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-12T02:32:50.926 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-12T02:32:50.926 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-12T02:32:50.926 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-12T02:32:50.926 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-12T02:32:50.926 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-12T02:32:50.926 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-12T02:32:50.926 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-12T02:32:50.927 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-12T02:32:50.927 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-12T02:32:50.927 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-12T02:32:50.927 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-12T02:32:50.927 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-12T02:32:50.927 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-12T02:32:50.927 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-12T02:32:50.927 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-12T02:32:50.927 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-12T02:32:50.927 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-12T02:32:50.927 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-12T02:32:50.927 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-12T02:32:50.927 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-12T02:32:50.928 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-12T02:32:50.928 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-12T02:32:50.928 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-12T02:32:50.928 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-12T02:32:50.928 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-12T02:32:50.928 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-12T02:32:50.928 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-12T02:32:50.928 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-12T02:32:50.928 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-12T02:32:50.928 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-12T02:32:50.928 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-12T02:32:50.928 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-12T02:32:50.928 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-12T02:32:50.929 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-12T02:32:50.929 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-12T02:32:50.929 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-12T02:32:50.929 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-12T02:32:50.929 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-12T02:32:50.929 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-12T02:32:50.929 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-12T02:32:50.929 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-12T02:32:50.929 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-12T02:32:50.929 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-12T02:32:50.929 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-12T02:32:50.929 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-12T02:32:50.930 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-12T02:32:50.930 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-12T02:32:50.930 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-12T02:32:50.930 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-12T02:32:50.930 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-12T02:32:50.930 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-12T02:32:50.930 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-12T02:32:50.930 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-12T02:32:50.930 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-12T02:32:50.930 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-12T02:32:50.930 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-12T02:32:50.930 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-12T02:32:50.930 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-12T02:32:50.931 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-12T02:32:50.931 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-12T02:32:50.931 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-12T02:32:50.931 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-12T02:32:50.931 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-12T02:32:50.931 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-12T02:32:50.931 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-12T02:32:50.931 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-12T02:32:50.931 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-12T02:32:50.931 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-12T02:32:50.931 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-12T02:32:50.931 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-12T02:32:50.931 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-12T02:32:50.931 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-12T02:32:50.932 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-12T02:32:50.932 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-12T02:32:50.932 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-12T02:32:50.932 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-12T02:32:50.932 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-12T02:32:50.932 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-12T02:32:50.932 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-12T02:32:50.932 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-12T02:32:50.932 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-12T02:32:50.932 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-12T02:32:50.932 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-12T02:32:50.932 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-12T02:32:50.933 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-12T02:32:50.933 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-12T02:32:50.933 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-12T02:32:50.933 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-12T02:32:50.933 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-12T02:32:50.933 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-12T02:32:50.933 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-12T02:32:50.933 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-12T02:32:50.933 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-12T02:32:50.933 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-12T02:32:50.933 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-12T02:32:50.933 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-12T02:32:50.933 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-12T02:32:50.933 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-12T02:32:50.934 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-12T02:32:50.934 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-12T02:32:50.934 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-12T02:32:50.934 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-12T02:32:50.934 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-12T02:32:50.934 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-12T02:32:50.934 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-12T02:32:50.934 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-12T02:32:50.934 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-12T02:32:50.934 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-12T02:32:50.934 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-12T02:32:50.934 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-12T02:32:50.934 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-12T02:32:50.935 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-12T02:32:50.935 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-12T02:32:50.935 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-12T02:32:50.935 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-12T02:32:50.935 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-12T02:32:50.935 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-12T02:32:50.935 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-12T02:32:50.935 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-12T02:32:50.935 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-12T02:32:50.935 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-12T02:32:50.935 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-12T02:32:50.935 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-12T02:32:50.936 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-12T02:32:50.936 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-12T02:32:50.936 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-12T02:32:50.936 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-12T02:32:50.936 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-12T02:32:50.936 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-12T02:32:50.936 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-12T02:32:50.936 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-12T02:32:50.936 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-12T02:32:50.936 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-12T02:32:50.936 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-12T02:32:50.936 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-12T02:32:50.936 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-12T02:32:50.937 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-12T02:32:50.937 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-12T02:32:50.937 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-12T02:32:50.937 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-12T02:32:50.937 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-12T02:32:50.937 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-12T02:32:50.937 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-12T02:32:50.937 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-12T02:32:50.937 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-12T02:32:50.937 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-12T02:32:50.937 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-12T02:32:50.937 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-12T02:32:50.937 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-12T02:32:50.938 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-12T02:32:50.938 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-12T02:32:50.938 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-12T02:32:50.938 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-12T02:32:50.938 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-12T02:32:50.938 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-12T02:32:50.938 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-12T02:32:50.938 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-12T02:32:50.938 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-12T02:32:50.938 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-12T02:32:50.938 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-12T02:32:50.938 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-12T02:32:50.938 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-12T02:32:50.939 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-12T02:32:50.939 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-12T02:32:50.939 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-12T02:32:50.939 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-12T02:32:50.939 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-12T02:32:50.939 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-12T02:32:50.939 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-12T02:32:50.939 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-12T02:32:50.939 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-12T02:32:50.939 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-12T02:32:50.939 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-12T02:32:50.939 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-12T02:32:50.940 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-12T02:32:50.940 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-12T02:32:50.940 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-12T02:32:50.940 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-12T02:32:50.940 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-12T02:32:50.940 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-12T02:32:50.940 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-12T02:32:50.940 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-12T02:32:50.940 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-12T02:32:50.940 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-12T02:32:50.940 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-12T02:32:50.940 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-12T02:32:50.940 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-12T02:32:50.941 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-12T02:32:50.941 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-12T02:32:50.941 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-12T02:32:50.941 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-12T02:32:50.941 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-12T02:32:50.941 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-12T02:32:50.941 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-12T02:32:50.941 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-12T02:32:50.941 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-12T02:32:50.941 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-12T02:32:50.941 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-12T02:32:50.941 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-12T02:32:50.941 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-12T02:32:50.941 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-12T02:32:50.942 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-12T02:32:50.942 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-12T02:32:50.942 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-12T02:32:50.942 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-12T02:32:50.942 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-12T02:32:50.942 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-12T02:32:50.942 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-12T02:32:50.942 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-12T02:32:50.942 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-12T02:32:50.942 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-12T02:32:50.942 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-12T02:32:50.942 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-12T02:32:50.943 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-12T02:32:50.943 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-12T02:32:50.943 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-12T02:32:50.943 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-12T02:32:50.943 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-12T02:32:50.943 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-12T02:32:50.943 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-12T02:32:50.943 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-12T02:32:50.943 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-12T02:32:50.943 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-12T02:32:50.943 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-12T02:32:50.943 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-12T02:32:50.944 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-12T02:32:50.944 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-12T02:32:50.944 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-12T02:32:50.944 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-12T02:32:50.944 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-12T02:32:50.944 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-12T02:32:50.944 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-12T02:32:50.944 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-12T02:32:50.944 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-12T02:32:50.944 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-12T02:32:50.944 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-12T02:32:50.944 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-12T02:32:50.944 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-12T02:32:50.945 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-12T02:32:50.945 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-12T02:32:50.945 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-12T02:32:50.945 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-12T02:32:50.945 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-12T02:32:50.945 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-12T02:32:50.945 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-12T02:32:50.945 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-12T02:32:50.945 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-12T02:32:50.945 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-12T02:32:50.945 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-12T02:32:50.945 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-12T02:32:50.946 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-12T02:32:50.946 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-12T02:32:50.946 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-12T02:32:50.946 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-12T02:32:50.946 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-12T02:32:50.946 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-12T02:32:50.946 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-12T02:32:50.946 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-12T02:32:50.946 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-12T02:32:50.946 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-12T02:32:50.946 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-12T02:32:50.946 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-12T02:32:50.946 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-12T02:32:50.947 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-12T02:32:50.947 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-12T02:32:50.947 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-12T02:32:50.947 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-12T02:32:50.947 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-12T02:32:50.947 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-12T02:32:50.947 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-12T02:32:50.947 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-12T02:32:50.947 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-12T02:32:50.947 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-12T02:32:50.947 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-12T02:32:50.947 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-12T02:32:50.947 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-12T02:32:50.948 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-12T02:32:50.948 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-12T02:32:50.948 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-12T02:32:50.948 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-12T02:32:50.948 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-12T02:32:50.948 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-12T02:32:50.948 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-12T02:32:50.948 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-12T02:32:50.948 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-12T02:32:50.948 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-12T02:32:50.948 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-12T02:32:50.948 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-12T02:32:50.948 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-12T02:32:50.948 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-12T02:32:50.949 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-12T02:32:50.949 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-12T02:32:50.949 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-12T02:32:50.949 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-12T02:32:50.949 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-12T02:32:50.949 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-12T02:32:50.949 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-12T02:32:50.949 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-12T02:32:50.949 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-12T02:32:50.949 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-12T02:32:50.949 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-12T02:32:50.949 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-12T02:32:50.949 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-12T02:32:50.950 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-12T02:32:50.950 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-12T02:32:50.950 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-12T02:32:50.950 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-12T02:32:50.950 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-12T02:32:50.950 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-12T02:32:50.950 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-12T02:32:50.950 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-12T02:32:50.950 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-12T02:32:50.950 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-12T02:32:50.950 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-12T02:32:50.950 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-12T02:32:50.950 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-12T02:32:50.951 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-12T02:32:50.951 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-12T02:32:50.951 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-12T02:32:50.951 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-12T02:32:50.951 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-12T02:32:50.951 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-12T02:32:50.951 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-12T02:32:50.951 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-12T02:32:50.951 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-12T02:32:50.951 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-12T02:32:50.951 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-12T02:32:50.951 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-12T02:32:50.951 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-12T02:32:50.951 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-12T02:32:50.952 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-12T02:32:50.952 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-12T02:32:50.952 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-12T02:32:50.952 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-12T02:32:50.952 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-12T02:32:50.952 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-12T02:32:50.952 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-12T02:32:50.952 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-12T02:32:50.952 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-12T02:32:50.952 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-12T02:32:50.952 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-12T02:32:50.952 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-12T02:32:50.952 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-12T02:32:50.953 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-12T02:32:50.953 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-12T02:32:50.953 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-12T02:32:50.953 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-12T02:32:50.953 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-12T02:32:50.953 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-12T02:32:50.953 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-12T02:32:50.953 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-12T02:32:50.953 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-12T02:32:50.953 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-12T02:32:50.953 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-12T02:32:50.953 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-12T02:32:50.953 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-12T02:32:50.953 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-12T02:32:50.954 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-12T02:32:50.954 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-12T02:32:50.954 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-12T02:32:50.954 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-12T02:32:50.954 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-12T02:32:50.954 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-12T02:32:50.954 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-12T02:32:50.954 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-12T02:32:50.954 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-12T02:32:50.954 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-12T02:32:50.954 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-12T02:32:50.954 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-12T02:32:50.955 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-12T02:32:50.955 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-12T02:32:50.955 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-12T02:32:50.955 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-12T02:32:50.955 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-12T02:32:50.955 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-12T02:32:50.955 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-12T02:32:50.955 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-12T02:32:50.955 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-12T02:32:50.955 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-12T02:32:50.955 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-12T02:32:50.955 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-12T02:32:50.955 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-12T02:32:50.956 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-12T02:32:50.956 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-12T02:32:50.956 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-12T02:32:50.956 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-12T02:32:50.956 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-12T02:32:50.956 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-12T02:32:50.956 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-12T02:32:50.956 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-12T02:32:50.956 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-12T02:32:50.956 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-12T02:32:50.956 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-12T02:32:50.956 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-12T02:32:50.956 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-12T02:32:50.956 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-12T02:32:50.957 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-12T02:32:50.957 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-12T02:32:50.957 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-12T02:32:50.957 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-12T02:32:50.957 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-12T02:32:50.957 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-12T02:32:50.957 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-12T02:32:50.957 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-12T02:32:50.957 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-12T02:32:50.957 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-12T02:32:50.957 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-12T02:32:50.957 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-12T02:32:50.957 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-12T02:32:50.958 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-12T02:32:50.958 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-12T02:32:50.958 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-12T02:32:50.958 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-12T02:32:50.958 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-12T02:32:50.958 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-12T02:32:50.958 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-12T02:32:50.958 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-12T02:32:50.958 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-12T02:32:50.958 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-12T02:32:50.958 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-12T02:32:50.958 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-12T02:32:50.958 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-12T02:32:50.959 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-12T02:32:50.959 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-12T02:32:50.959 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-12T02:32:50.959 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-12T02:32:50.959 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-12T02:32:50.959 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-12T02:32:50.959 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-12T02:32:50.959 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-12T02:32:50.959 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-12T02:32:50.959 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-12T02:32:50.959 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-12T02:32:50.959 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-12T02:32:50.959 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-12T02:32:50.959 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-12T02:32:50.960 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-12T02:32:50.960 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-12T02:32:50.960 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-12T02:32:50.960 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-12T02:32:50.960 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-12T02:32:50.960 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-12T02:32:50.960 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-12T02:32:50.960 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-12T02:32:50.960 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-12T02:32:50.960 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-12T02:32:50.960 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-12T02:32:50.960 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-12T02:32:50.961 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-12T02:32:50.961 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-12T02:32:50.961 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-12T02:32:50.961 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-12T02:32:50.961 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-12T02:32:50.961 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-12T02:32:50.961 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-12T02:32:50.961 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-12T02:32:50.961 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-12T02:32:50.961 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-12T02:32:50.961 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-12T02:32:50.961 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-12T02:32:50.961 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-12T02:32:50.961 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-12T02:32:50.962 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-12T02:32:50.962 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-12T02:32:50.962 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-12T02:32:50.962 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-12T02:32:50.962 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-12T02:32:50.962 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-12T02:32:50.962 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-12T02:32:50.962 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-12T02:32:50.962 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-12T02:32:50.962 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-12T02:32:50.962 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-12T02:32:50.962 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-12T02:32:50.962 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-12T02:32:50.963 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-12T02:32:50.963 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-12T02:32:50.963 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-12T02:32:50.963 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-12T02:32:50.963 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-12T02:32:50.963 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-12T02:32:50.963 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-12T02:32:50.963 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-12T02:32:50.963 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-12T02:32:50.963 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-12T02:32:50.963 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-12T02:32:50.963 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-12T02:32:50.963 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-12T02:32:50.963 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-12T02:32:50.964 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-12T02:32:50.964 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-12T02:32:50.964 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-12T02:32:50.964 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-12T02:32:50.964 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-12T02:32:50.964 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-12T02:32:50.964 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-12T02:32:50.964 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-12T02:32:50.964 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-12T02:32:50.964 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-12T02:32:50.964 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-12T02:32:50.964 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-12T02:32:50.965 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-12T02:32:50.965 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-12T02:32:50.965 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-12T02:32:50.965 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-12T02:32:50.965 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-12T02:32:50.965 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-12T02:32:50.965 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-12T02:32:50.965 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-12T02:32:50.965 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-12T02:32:50.965 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-12T02:32:50.965 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-12T02:32:50.965 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-12T02:32:50.966 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-12T02:32:50.966 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-12T02:32:50.966 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-12T02:32:50.966 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-12T02:32:50.966 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-12T02:32:50.966 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-12T02:32:50.966 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-12T02:32:50.966 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-12T02:32:50.966 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-12T02:32:50.966 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-12T02:32:50.966 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-12T02:32:50.966 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-12T02:32:50.966 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-12T02:32:50.967 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-12T02:32:50.967 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-12T02:32:50.967 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-12T02:32:50.967 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-12T02:32:50.967 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-12T02:32:50.967 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-12T02:32:50.967 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-12T02:32:50.967 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-12T02:32:50.967 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-12T02:32:50.967 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-12T02:32:50.967 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-12T02:32:50.967 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-12T02:32:50.967 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-12T02:32:50.967 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-12T02:32:50.968 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-12T02:32:50.968 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-12T02:32:50.968 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-12T02:32:50.968 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-12T02:32:50.968 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-12T02:32:50.968 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-12T02:32:50.968 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-12T02:32:50.968 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-12T02:32:50.968 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-12T02:32:50.968 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-12T02:32:50.968 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-12T02:32:50.968 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-12T02:32:50.968 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-12T02:32:50.969 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-12T02:32:50.969 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-12T02:32:50.969 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-12T02:32:50.969 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-12T02:32:50.969 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-12T02:32:50.969 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-12T02:32:50.969 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-12T02:32:50.969 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-12T02:32:50.969 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-12T02:32:50.969 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-12T02:32:50.969 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-12T02:32:50.969 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-12T02:32:50.969 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-12T02:32:50.970 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-12T02:32:50.970 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-12T02:32:50.970 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-12T02:32:50.970 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-12T02:32:50.970 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-12T02:32:50.970 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-12T02:32:50.970 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-12T02:32:50.970 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-12T02:32:50.970 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-12T02:32:50.970 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-12T02:32:50.970 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-12T02:32:50.970 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-12T02:32:50.970 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-12T02:32:50.971 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-12T02:32:50.971 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-12T02:32:50.971 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-12T02:32:50.971 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-12T02:32:50.971 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-12T02:32:50.971 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-12T02:32:50.971 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-12T02:32:50.971 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-12T02:32:50.971 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-12T02:32:50.971 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-12T02:32:50.971 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-12T02:32:50.971 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-12T02:32:50.971 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-12T02:32:50.971 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-12T02:32:50.972 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-12T02:32:50.972 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-12T02:32:50.972 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-12T02:32:50.972 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-12T02:32:50.972 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-12T02:32:50.972 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-12T02:32:50.972 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-12T02:32:50.972 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-12T02:32:50.972 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-12T02:32:50.972 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-12T02:32:50.972 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-12T02:32:50.972 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-12T02:32:50.973 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-12T02:32:50.973 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-12T02:32:50.973 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-12T02:32:50.973 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-12T02:32:50.973 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-12T02:32:50.973 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-12T02:32:50.973 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-12T02:32:50.973 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-12T02:32:50.973 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-12T02:32:50.973 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-12T02:32:50.973 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-12T02:32:50.973 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-12T02:32:50.973 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-12T02:32:50.974 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-12T02:32:50.978 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:32:50.978 DEBUG:teuthology.orchestra.run.smithi137:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-12T02:32:51.003 INFO:teuthology.orchestra.run.smithi137.stdout:postinstall scriptlet (using /bin/sh): 2024-09-12T02:32:51.003 INFO:teuthology.orchestra.run.smithi137.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-12T02:32:51.003 INFO:teuthology.orchestra.run.smithi137.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-12T02:32:51.003 INFO:teuthology.orchestra.run.smithi137.stdout:fi 2024-09-12T02:32:51.003 INFO:teuthology.orchestra.run.smithi137.stdout:for file in vmlinuz System.map config; do 2024-09-12T02:32:51.003 INFO:teuthology.orchestra.run.smithi137.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-12T02:32:51.004 INFO:teuthology.orchestra.run.smithi137.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-12T02:32:51.004 INFO:teuthology.orchestra.run.smithi137.stdout: fi 2024-09-12T02:32:51.004 INFO:teuthology.orchestra.run.smithi137.stdout:done 2024-09-12T02:32:51.004 INFO:teuthology.orchestra.run.smithi137.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-12T02:32:51.004 INFO:teuthology.orchestra.run.smithi137.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-12T02:32:51.004 INFO:teuthology.orchestra.run.smithi137.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-12T02:32:51.004 INFO:teuthology.orchestra.run.smithi137.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-12T02:32:51.004 INFO:teuthology.orchestra.run.smithi137.stdout:fi 2024-09-12T02:32:51.004 INFO:teuthology.orchestra.run.smithi137.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-12T02:32:51.004 INFO:teuthology.orchestra.run.smithi137.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:32:51.004 INFO:teuthology.orchestra.run.smithi137.stdout:fi 2024-09-12T02:32:51.004 INFO:teuthology.orchestra.run.smithi137.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-12T02:32:51.004 INFO:teuthology.orchestra.run.smithi137.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-12T02:32:51.005 INFO:teuthology.orchestra.run.smithi137.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:32:51.005 INFO:teuthology.orchestra.run.smithi137.stdout:fi 2024-09-12T02:32:51.006 DEBUG:teuthology.orchestra.run.smithi137:> sudo rpm -qi grub2-tools 2024-09-12T02:32:51.091 INFO:teuthology.orchestra.run.smithi137.stdout:Name : grub2-tools 2024-09-12T02:32:51.091 INFO:teuthology.orchestra.run.smithi137.stdout:Epoch : 1 2024-09-12T02:32:51.091 INFO:teuthology.orchestra.run.smithi137.stdout:Version : 2.06 2024-09-12T02:32:51.091 INFO:teuthology.orchestra.run.smithi137.stdout:Release : 82.el9 2024-09-12T02:32:51.091 INFO:teuthology.orchestra.run.smithi137.stdout:Architecture: x86_64 2024-09-12T02:32:51.091 INFO:teuthology.orchestra.run.smithi137.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T02:32:51.091 INFO:teuthology.orchestra.run.smithi137.stdout:Group : Unspecified 2024-09-12T02:32:51.091 INFO:teuthology.orchestra.run.smithi137.stdout:Size : 8274670 2024-09-12T02:32:51.091 INFO:teuthology.orchestra.run.smithi137.stdout:License : GPLv3+ 2024-09-12T02:32:51.091 INFO:teuthology.orchestra.run.smithi137.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T02:32:51.092 INFO:teuthology.orchestra.run.smithi137.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T02:32:51.092 INFO:teuthology.orchestra.run.smithi137.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T02:32:51.092 INFO:teuthology.orchestra.run.smithi137.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T02:32:51.092 INFO:teuthology.orchestra.run.smithi137.stdout:Packager : builder@centos.org 2024-09-12T02:32:51.092 INFO:teuthology.orchestra.run.smithi137.stdout:Vendor : CentOS 2024-09-12T02:32:51.092 INFO:teuthology.orchestra.run.smithi137.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T02:32:51.092 INFO:teuthology.orchestra.run.smithi137.stdout:Summary : Support tools for GRUB. 2024-09-12T02:32:51.092 INFO:teuthology.orchestra.run.smithi137.stdout:Description : 2024-09-12T02:32:51.092 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:32:51.092 INFO:teuthology.orchestra.run.smithi137.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T02:32:51.092 INFO:teuthology.orchestra.run.smithi137.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T02:32:51.092 INFO:teuthology.orchestra.run.smithi137.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T02:32:51.093 INFO:teuthology.orchestra.run.smithi137.stdout:hardware devices. 2024-09-12T02:32:51.093 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:32:51.093 INFO:teuthology.orchestra.run.smithi137.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T02:32:51.094 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T02:32:51.094 INFO:teuthology.task.kernel:Updating grub on smithi137 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:32:51.094 DEBUG:teuthology.orchestra.run.smithi137:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T02:32:51.689 INFO:teuthology.orchestra.run.smithi137.stderr:Generating grub configuration file ... 2024-09-12T02:32:53.060 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi112.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-12T02:32:53.060 DEBUG:teuthology.orchestra.run.smithi112:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-12T02:32:53.065 INFO:teuthology.orchestra.run.smithi137.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T02:32:53.111 INFO:teuthology.orchestra.run.smithi137.stderr:done 2024-09-12T02:32:53.119 DEBUG:teuthology.orchestra.run.smithi137:> mktemp 2024-09-12T02:32:53.145 INFO:teuthology.orchestra.run.smithi137.stdout:/tmp/tmp.w2UVSee8jr 2024-09-12T02:32:53.146 DEBUG:teuthology.orchestra.run.smithi137:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.w2UVSee8jr 2024-09-12T02:32:53.150 INFO:teuthology.orchestra.run.smithi112.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:32:53.151 INFO:teuthology.orchestra.run.smithi112.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:32:53.151 INFO:teuthology.orchestra.run.smithi112.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:32:53.151 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:32:53.151 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-12T02:32:53.151 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-12T02:32:53.151 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-12T02:32:53.151 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-12T02:32:53.151 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-12T02:32:53.151 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-12T02:32:53.151 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-12T02:32:53.151 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-12T02:32:53.151 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-12T02:32:53.151 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-12T02:32:53.152 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-12T02:32:53.152 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-12T02:32:53.152 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-12T02:32:53.152 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-12T02:32:53.152 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-12T02:32:53.152 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-12T02:32:53.152 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-12T02:32:53.152 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-12T02:32:53.152 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-12T02:32:53.152 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-12T02:32:53.152 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-12T02:32:53.152 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-12T02:32:53.152 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-12T02:32:53.153 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-12T02:32:53.153 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-12T02:32:53.153 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-12T02:32:53.153 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-12T02:32:53.153 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-12T02:32:53.153 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-12T02:32:53.153 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-12T02:32:53.153 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-12T02:32:53.153 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-12T02:32:53.153 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-12T02:32:53.153 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-12T02:32:53.153 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-12T02:32:53.153 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-12T02:32:53.154 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-12T02:32:53.154 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-12T02:32:53.154 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-12T02:32:53.154 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-12T02:32:53.154 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-12T02:32:53.154 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-12T02:32:53.154 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-12T02:32:53.154 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-12T02:32:53.154 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-12T02:32:53.154 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-12T02:32:53.154 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-12T02:32:53.154 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-12T02:32:53.154 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-12T02:32:53.154 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-12T02:32:53.155 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-12T02:32:53.155 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-12T02:32:53.155 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-12T02:32:53.155 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-12T02:32:53.155 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-12T02:32:53.155 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-12T02:32:53.155 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-12T02:32:53.155 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-12T02:32:53.155 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-12T02:32:53.155 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-12T02:32:53.155 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-12T02:32:53.155 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-12T02:32:53.155 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-12T02:32:53.155 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-12T02:32:53.156 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-12T02:32:53.156 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-12T02:32:53.156 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-12T02:32:53.156 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-12T02:32:53.156 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-12T02:32:53.156 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-12T02:32:53.156 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-12T02:32:53.156 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-12T02:32:53.156 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-12T02:32:53.156 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-12T02:32:53.156 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-12T02:32:53.156 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-12T02:32:53.156 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-12T02:32:53.157 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-12T02:32:53.157 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-12T02:32:53.157 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-12T02:32:53.157 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-12T02:32:53.157 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-12T02:32:53.157 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-12T02:32:53.157 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-12T02:32:53.157 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-12T02:32:53.157 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-12T02:32:53.157 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-12T02:32:53.157 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-12T02:32:53.157 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-12T02:32:53.157 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-12T02:32:53.158 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-12T02:32:53.158 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-12T02:32:53.158 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-12T02:32:53.158 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-12T02:32:53.158 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-12T02:32:53.158 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-12T02:32:53.158 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-12T02:32:53.158 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-12T02:32:53.158 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-12T02:32:53.158 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-12T02:32:53.158 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-12T02:32:53.158 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-12T02:32:53.158 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-12T02:32:53.158 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-12T02:32:53.159 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-12T02:32:53.159 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-12T02:32:53.159 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-12T02:32:53.159 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-12T02:32:53.159 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-12T02:32:53.159 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-12T02:32:53.159 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-12T02:32:53.159 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-12T02:32:53.159 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-12T02:32:53.159 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-12T02:32:53.159 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-12T02:32:53.159 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-12T02:32:53.159 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-12T02:32:53.159 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-12T02:32:53.160 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-12T02:32:53.160 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-12T02:32:53.160 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-12T02:32:53.160 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-12T02:32:53.160 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-12T02:32:53.160 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-12T02:32:53.160 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-12T02:32:53.160 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-12T02:32:53.160 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-12T02:32:53.160 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-12T02:32:53.160 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-12T02:32:53.160 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-12T02:32:53.160 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-12T02:32:53.161 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-12T02:32:53.161 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-12T02:32:53.161 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-12T02:32:53.161 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-12T02:32:53.161 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-12T02:32:53.161 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-12T02:32:53.161 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-12T02:32:53.161 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-12T02:32:53.161 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-12T02:32:53.161 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-12T02:32:53.161 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-12T02:32:53.161 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-12T02:32:53.161 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-12T02:32:53.161 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-12T02:32:53.161 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-12T02:32:53.162 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-12T02:32:53.162 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-12T02:32:53.162 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-12T02:32:53.162 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-12T02:32:53.162 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-12T02:32:53.162 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-12T02:32:53.162 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-12T02:32:53.162 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-12T02:32:53.162 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-12T02:32:53.162 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-12T02:32:53.162 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-12T02:32:53.162 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-12T02:32:53.162 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-12T02:32:53.162 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-12T02:32:53.163 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-12T02:32:53.163 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-12T02:32:53.163 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-12T02:32:53.163 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-12T02:32:53.163 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-12T02:32:53.163 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-12T02:32:53.163 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-12T02:32:53.163 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-12T02:32:53.163 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-12T02:32:53.163 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-12T02:32:53.163 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-12T02:32:53.163 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-12T02:32:53.163 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-12T02:32:53.163 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-12T02:32:53.164 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-12T02:32:53.164 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-12T02:32:53.164 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-12T02:32:53.164 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-12T02:32:53.164 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-12T02:32:53.164 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-12T02:32:53.164 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-12T02:32:53.164 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-12T02:32:53.164 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-12T02:32:53.164 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-12T02:32:53.164 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-12T02:32:53.164 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-12T02:32:53.164 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-12T02:32:53.164 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-12T02:32:53.165 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-12T02:32:53.165 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-12T02:32:53.165 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-12T02:32:53.165 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-12T02:32:53.165 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-12T02:32:53.165 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-12T02:32:53.165 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-12T02:32:53.165 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-12T02:32:53.165 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-12T02:32:53.165 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-12T02:32:53.165 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-12T02:32:53.165 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-12T02:32:53.165 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-12T02:32:53.166 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-12T02:32:53.166 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-12T02:32:53.166 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-12T02:32:53.166 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-12T02:32:53.166 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-12T02:32:53.166 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-12T02:32:53.166 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-12T02:32:53.166 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-12T02:32:53.166 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-12T02:32:53.166 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-12T02:32:53.166 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-12T02:32:53.166 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-12T02:32:53.166 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-12T02:32:53.166 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-12T02:32:53.167 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-12T02:32:53.167 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-12T02:32:53.167 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-12T02:32:53.167 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-12T02:32:53.167 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-12T02:32:53.167 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-12T02:32:53.167 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-12T02:32:53.167 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-12T02:32:53.167 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-12T02:32:53.167 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-12T02:32:53.167 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-12T02:32:53.167 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-12T02:32:53.167 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-12T02:32:53.167 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-12T02:32:53.168 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-12T02:32:53.168 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-12T02:32:53.168 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-12T02:32:53.168 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-12T02:32:53.168 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-12T02:32:53.168 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-12T02:32:53.168 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-12T02:32:53.168 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-12T02:32:53.168 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-12T02:32:53.168 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-12T02:32:53.168 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-12T02:32:53.168 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-12T02:32:53.168 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-12T02:32:53.169 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-12T02:32:53.169 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-12T02:32:53.169 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-12T02:32:53.169 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-12T02:32:53.169 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-12T02:32:53.169 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-12T02:32:53.169 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-12T02:32:53.169 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-12T02:32:53.169 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-12T02:32:53.169 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-12T02:32:53.169 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-12T02:32:53.169 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-12T02:32:53.169 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-12T02:32:53.169 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-12T02:32:53.170 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-12T02:32:53.170 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-12T02:32:53.170 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-12T02:32:53.170 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-12T02:32:53.170 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-12T02:32:53.170 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-12T02:32:53.170 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-12T02:32:53.170 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-12T02:32:53.170 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-12T02:32:53.170 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-12T02:32:53.170 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-12T02:32:53.170 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-12T02:32:53.170 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-12T02:32:53.170 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-12T02:32:53.171 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-12T02:32:53.171 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-12T02:32:53.171 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-12T02:32:53.171 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-12T02:32:53.171 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-12T02:32:53.171 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-12T02:32:53.171 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-12T02:32:53.171 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-12T02:32:53.171 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-12T02:32:53.171 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-12T02:32:53.171 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-12T02:32:53.171 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-12T02:32:53.171 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-12T02:32:53.171 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-12T02:32:53.172 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-12T02:32:53.172 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-12T02:32:53.172 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-12T02:32:53.172 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-12T02:32:53.172 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-12T02:32:53.172 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-12T02:32:53.172 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-12T02:32:53.172 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-12T02:32:53.172 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-12T02:32:53.172 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-12T02:32:53.172 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-12T02:32:53.172 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-12T02:32:53.172 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-12T02:32:53.172 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-12T02:32:53.173 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-12T02:32:53.173 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-12T02:32:53.173 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-12T02:32:53.173 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-12T02:32:53.173 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-12T02:32:53.173 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-12T02:32:53.173 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-12T02:32:53.173 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-12T02:32:53.173 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-12T02:32:53.173 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-12T02:32:53.173 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-12T02:32:53.173 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-12T02:32:53.173 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-12T02:32:53.173 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-12T02:32:53.174 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-12T02:32:53.174 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-12T02:32:53.174 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-12T02:32:53.174 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-12T02:32:53.174 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-12T02:32:53.174 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-12T02:32:53.174 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-12T02:32:53.174 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-12T02:32:53.174 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-12T02:32:53.174 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-12T02:32:53.174 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-12T02:32:53.174 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-12T02:32:53.174 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-12T02:32:53.174 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-12T02:32:53.175 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-12T02:32:53.175 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-12T02:32:53.175 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-12T02:32:53.175 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-12T02:32:53.175 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-12T02:32:53.175 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-12T02:32:53.175 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-12T02:32:53.175 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-12T02:32:53.175 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-12T02:32:53.175 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-12T02:32:53.175 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-12T02:32:53.175 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-12T02:32:53.175 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-12T02:32:53.175 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-12T02:32:53.176 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-12T02:32:53.176 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-12T02:32:53.176 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-12T02:32:53.176 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-12T02:32:53.176 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-12T02:32:53.176 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-12T02:32:53.176 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-12T02:32:53.176 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-12T02:32:53.176 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-12T02:32:53.176 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-12T02:32:53.176 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-12T02:32:53.176 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-12T02:32:53.176 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-12T02:32:53.176 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-12T02:32:53.177 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-12T02:32:53.177 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-12T02:32:53.177 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-12T02:32:53.177 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-12T02:32:53.177 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-12T02:32:53.177 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-12T02:32:53.177 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-12T02:32:53.177 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-12T02:32:53.177 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-12T02:32:53.177 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-12T02:32:53.177 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-12T02:32:53.177 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-12T02:32:53.177 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-12T02:32:53.178 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-12T02:32:53.178 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-12T02:32:53.178 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-12T02:32:53.178 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-12T02:32:53.178 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-12T02:32:53.178 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-12T02:32:53.178 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-12T02:32:53.178 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-12T02:32:53.178 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-12T02:32:53.178 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-12T02:32:53.178 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-12T02:32:53.178 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-12T02:32:53.178 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-12T02:32:53.178 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-12T02:32:53.179 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-12T02:32:53.179 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-12T02:32:53.179 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-12T02:32:53.179 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-12T02:32:53.179 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-12T02:32:53.179 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-12T02:32:53.179 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-12T02:32:53.179 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-12T02:32:53.179 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-12T02:32:53.179 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-12T02:32:53.179 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-12T02:32:53.179 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-12T02:32:53.179 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-12T02:32:53.179 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-12T02:32:53.180 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-12T02:32:53.180 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-12T02:32:53.180 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-12T02:32:53.180 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-12T02:32:53.180 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-12T02:32:53.180 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-12T02:32:53.180 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-12T02:32:53.180 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-12T02:32:53.180 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-12T02:32:53.180 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-12T02:32:53.180 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-12T02:32:53.180 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-12T02:32:53.180 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-12T02:32:53.181 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-12T02:32:53.181 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-12T02:32:53.181 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-12T02:32:53.181 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-12T02:32:53.181 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-12T02:32:53.181 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-12T02:32:53.181 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-12T02:32:53.181 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-12T02:32:53.181 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-12T02:32:53.181 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-12T02:32:53.181 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-12T02:32:53.181 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-12T02:32:53.181 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-12T02:32:53.181 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-12T02:32:53.182 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-12T02:32:53.182 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-12T02:32:53.182 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-12T02:32:53.182 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-12T02:32:53.182 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-12T02:32:53.182 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-12T02:32:53.182 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-12T02:32:53.182 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-12T02:32:53.182 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-12T02:32:53.182 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-12T02:32:53.182 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-12T02:32:53.182 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-12T02:32:53.182 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-12T02:32:53.182 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-12T02:32:53.183 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-12T02:32:53.183 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-12T02:32:53.183 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-12T02:32:53.183 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-12T02:32:53.183 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-12T02:32:53.183 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-12T02:32:53.183 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-12T02:32:53.183 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-12T02:32:53.183 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-12T02:32:53.183 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-12T02:32:53.183 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-12T02:32:53.183 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-12T02:32:53.183 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-12T02:32:53.184 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-12T02:32:53.184 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-12T02:32:53.184 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-12T02:32:53.184 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-12T02:32:53.184 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-12T02:32:53.184 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-12T02:32:53.184 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-12T02:32:53.184 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-12T02:32:53.184 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-12T02:32:53.184 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-12T02:32:53.185 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-12T02:32:53.185 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-12T02:32:53.185 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-12T02:32:53.185 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-12T02:32:53.185 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-12T02:32:53.185 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-12T02:32:53.185 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-12T02:32:53.185 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-12T02:32:53.185 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-12T02:32:53.185 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-12T02:32:53.185 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-12T02:32:53.185 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-12T02:32:53.185 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-12T02:32:53.185 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-12T02:32:53.186 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-12T02:32:53.186 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-12T02:32:53.186 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-12T02:32:53.186 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-12T02:32:53.186 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-12T02:32:53.186 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-12T02:32:53.186 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-12T02:32:53.186 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-12T02:32:53.186 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-12T02:32:53.186 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-12T02:32:53.186 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-12T02:32:53.186 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-12T02:32:53.186 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-12T02:32:53.187 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-12T02:32:53.187 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-12T02:32:53.187 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-12T02:32:53.187 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-12T02:32:53.187 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-12T02:32:53.187 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-12T02:32:53.187 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-12T02:32:53.187 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-12T02:32:53.187 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-12T02:32:53.187 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-12T02:32:53.187 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-12T02:32:53.187 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-12T02:32:53.187 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-12T02:32:53.187 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-12T02:32:53.188 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-12T02:32:53.188 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-12T02:32:53.188 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-12T02:32:53.188 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-12T02:32:53.188 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-12T02:32:53.188 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-12T02:32:53.188 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-12T02:32:53.188 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-12T02:32:53.188 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-12T02:32:53.188 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-12T02:32:53.188 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-12T02:32:53.188 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-12T02:32:53.188 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-12T02:32:53.188 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-12T02:32:53.189 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-12T02:32:53.189 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-12T02:32:53.189 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-12T02:32:53.189 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-12T02:32:53.189 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-12T02:32:53.189 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-12T02:32:53.189 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-12T02:32:53.189 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-12T02:32:53.189 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-12T02:32:53.189 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-12T02:32:53.189 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-12T02:32:53.189 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-12T02:32:53.189 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-12T02:32:53.189 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-12T02:32:53.190 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-12T02:32:53.190 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-12T02:32:53.190 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-12T02:32:53.190 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-12T02:32:53.190 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-12T02:32:53.190 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-12T02:32:53.190 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-12T02:32:53.190 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-12T02:32:53.190 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-12T02:32:53.190 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-12T02:32:53.190 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-12T02:32:53.190 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-12T02:32:53.190 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-12T02:32:53.190 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-12T02:32:53.191 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-12T02:32:53.191 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-12T02:32:53.191 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-12T02:32:53.191 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-12T02:32:53.191 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-12T02:32:53.191 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-12T02:32:53.191 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-12T02:32:53.191 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-12T02:32:53.191 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-12T02:32:53.191 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-12T02:32:53.191 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-12T02:32:53.191 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-12T02:32:53.191 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-12T02:32:53.191 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-12T02:32:53.192 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-12T02:32:53.192 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-12T02:32:53.192 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-12T02:32:53.192 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-12T02:32:53.192 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-12T02:32:53.192 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-12T02:32:53.192 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-12T02:32:53.192 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-12T02:32:53.192 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-12T02:32:53.192 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-12T02:32:53.192 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-12T02:32:53.192 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-12T02:32:53.192 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-12T02:32:53.193 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-12T02:32:53.193 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-12T02:32:53.193 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-12T02:32:53.193 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-12T02:32:53.193 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-12T02:32:53.193 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-12T02:32:53.193 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-12T02:32:53.193 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-12T02:32:53.193 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-12T02:32:53.193 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-12T02:32:53.193 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-12T02:32:53.193 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-12T02:32:53.193 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-12T02:32:53.194 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-12T02:32:53.194 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-12T02:32:53.194 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-12T02:32:53.194 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-12T02:32:53.194 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-12T02:32:53.194 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-12T02:32:53.194 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-12T02:32:53.194 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-12T02:32:53.194 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-12T02:32:53.194 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-12T02:32:53.194 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-12T02:32:53.194 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-12T02:32:53.194 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-12T02:32:53.194 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-12T02:32:53.195 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-12T02:32:53.195 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-12T02:32:53.195 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-12T02:32:53.195 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-12T02:32:53.195 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-12T02:32:53.195 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-12T02:32:53.195 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-12T02:32:53.195 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-12T02:32:53.195 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-12T02:32:53.195 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-12T02:32:53.195 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-12T02:32:53.195 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-12T02:32:53.195 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-12T02:32:53.196 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-12T02:32:53.196 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-12T02:32:53.196 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-12T02:32:53.196 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-12T02:32:53.196 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-12T02:32:53.196 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-12T02:32:53.196 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-12T02:32:53.196 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-12T02:32:53.196 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-12T02:32:53.196 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-12T02:32:53.196 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-12T02:32:53.196 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-12T02:32:53.196 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-12T02:32:53.196 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-12T02:32:53.197 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-12T02:32:53.197 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-12T02:32:53.197 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-12T02:32:53.197 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-12T02:32:53.197 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-12T02:32:53.197 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-12T02:32:53.197 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-12T02:32:53.197 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-12T02:32:53.197 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-12T02:32:53.197 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-12T02:32:53.197 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-12T02:32:53.197 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-12T02:32:53.197 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-12T02:32:53.198 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-12T02:32:53.198 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-12T02:32:53.198 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-12T02:32:53.198 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-12T02:32:53.198 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-12T02:32:53.198 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-12T02:32:53.198 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-12T02:32:53.198 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-12T02:32:53.198 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-12T02:32:53.198 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-12T02:32:53.198 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-12T02:32:53.198 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-12T02:32:53.198 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-12T02:32:53.198 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-12T02:32:53.199 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-12T02:32:53.199 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-12T02:32:53.199 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-12T02:32:53.199 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-12T02:32:53.199 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-12T02:32:53.199 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-12T02:32:53.199 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-12T02:32:53.199 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-12T02:32:53.199 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-12T02:32:53.199 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-12T02:32:53.199 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-12T02:32:53.199 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-12T02:32:53.199 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-12T02:32:53.199 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-12T02:32:53.200 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-12T02:32:53.200 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-12T02:32:53.200 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-12T02:32:53.200 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-12T02:32:53.200 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-12T02:32:53.200 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-12T02:32:53.200 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-12T02:32:53.200 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-12T02:32:53.200 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-12T02:32:53.200 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-12T02:32:53.200 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-12T02:32:53.200 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-12T02:32:53.200 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-12T02:32:53.200 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-12T02:32:53.201 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-12T02:32:53.201 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-12T02:32:53.201 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-12T02:32:53.201 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-12T02:32:53.201 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-12T02:32:53.201 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-12T02:32:53.201 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-12T02:32:53.201 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-12T02:32:53.201 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-12T02:32:53.201 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-12T02:32:53.201 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-12T02:32:53.201 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-12T02:32:53.201 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-12T02:32:53.201 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-12T02:32:53.202 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-12T02:32:53.202 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-12T02:32:53.202 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-12T02:32:53.202 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-12T02:32:53.202 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-12T02:32:53.202 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-12T02:32:53.202 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-12T02:32:53.202 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-12T02:32:53.202 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-12T02:32:53.202 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-12T02:32:53.202 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-12T02:32:53.202 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-12T02:32:53.202 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-12T02:32:53.202 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-12T02:32:53.202 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-12T02:32:53.203 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-12T02:32:53.203 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-12T02:32:53.203 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-12T02:32:53.203 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-12T02:32:53.203 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-12T02:32:53.203 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-12T02:32:53.203 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-12T02:32:53.203 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-12T02:32:53.203 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-12T02:32:53.203 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-12T02:32:53.203 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-12T02:32:53.203 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-12T02:32:53.203 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-12T02:32:53.203 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-12T02:32:53.204 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-12T02:32:53.204 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-12T02:32:53.204 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-12T02:32:53.204 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-12T02:32:53.204 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-12T02:32:53.204 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-12T02:32:53.204 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-12T02:32:53.204 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-12T02:32:53.204 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-12T02:32:53.204 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-12T02:32:53.204 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-12T02:32:53.204 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-12T02:32:53.204 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-12T02:32:53.204 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-12T02:32:53.205 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-12T02:32:53.205 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-12T02:32:53.205 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-12T02:32:53.205 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-12T02:32:53.205 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-12T02:32:53.205 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-12T02:32:53.205 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-12T02:32:53.205 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-12T02:32:53.205 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-12T02:32:53.205 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-12T02:32:53.205 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-12T02:32:53.205 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-12T02:32:53.205 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-12T02:32:53.205 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-12T02:32:53.206 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-12T02:32:53.206 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-12T02:32:53.206 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-12T02:32:53.206 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-12T02:32:53.206 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-12T02:32:53.206 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-12T02:32:53.206 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-12T02:32:53.206 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-12T02:32:53.206 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-12T02:32:53.206 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-12T02:32:53.206 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-12T02:32:53.206 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-12T02:32:53.206 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-12T02:32:53.206 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-12T02:32:53.207 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-12T02:32:53.207 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-12T02:32:53.207 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-12T02:32:53.207 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-12T02:32:53.207 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-12T02:32:53.207 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-12T02:32:53.207 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-12T02:32:53.207 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-12T02:32:53.207 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-12T02:32:53.207 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-12T02:32:53.207 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-12T02:32:53.207 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-12T02:32:53.207 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-12T02:32:53.207 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-12T02:32:53.207 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-12T02:32:53.208 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-12T02:32:53.208 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-12T02:32:53.208 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-12T02:32:53.208 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-12T02:32:53.208 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-12T02:32:53.208 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-12T02:32:53.208 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-12T02:32:53.208 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-12T02:32:53.208 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-12T02:32:53.208 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-12T02:32:53.208 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-12T02:32:53.208 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-12T02:32:53.208 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-12T02:32:53.209 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-12T02:32:53.209 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-12T02:32:53.209 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-12T02:32:53.209 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-12T02:32:53.209 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-12T02:32:53.209 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-12T02:32:53.209 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-12T02:32:53.209 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-12T02:32:53.209 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-12T02:32:53.209 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-12T02:32:53.209 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-12T02:32:53.209 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-12T02:32:53.209 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-12T02:32:53.209 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-12T02:32:53.210 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-12T02:32:53.210 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-12T02:32:53.210 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-12T02:32:53.210 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-12T02:32:53.210 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-12T02:32:53.210 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-12T02:32:53.210 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-12T02:32:53.210 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-12T02:32:53.210 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-12T02:32:53.210 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-12T02:32:53.210 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-12T02:32:53.210 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-12T02:32:53.210 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-12T02:32:53.210 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-12T02:32:53.210 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-12T02:32:53.211 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-12T02:32:53.211 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-12T02:32:53.211 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-12T02:32:53.211 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-12T02:32:53.211 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-12T02:32:53.211 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-12T02:32:53.211 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-12T02:32:53.211 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-12T02:32:53.211 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-12T02:32:53.211 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-12T02:32:53.211 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-12T02:32:53.211 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-12T02:32:53.211 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-12T02:32:53.211 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-12T02:32:53.212 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-12T02:32:53.212 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-12T02:32:53.212 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-12T02:32:53.212 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-12T02:32:53.212 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-12T02:32:53.212 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-12T02:32:53.212 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-12T02:32:53.212 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-12T02:32:53.212 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-12T02:32:53.212 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-12T02:32:53.212 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-12T02:32:53.212 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-12T02:32:53.212 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-12T02:32:53.212 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-12T02:32:53.213 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-12T02:32:53.213 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-12T02:32:53.213 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-12T02:32:53.213 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-12T02:32:53.213 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-12T02:32:53.213 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-12T02:32:53.213 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-12T02:32:53.213 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-12T02:32:53.213 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-12T02:32:53.213 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-12T02:32:53.213 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-12T02:32:53.213 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-12T02:32:53.213 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-12T02:32:53.213 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-12T02:32:53.214 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-12T02:32:53.214 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-12T02:32:53.214 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-12T02:32:53.214 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-12T02:32:53.214 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-12T02:32:53.214 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-12T02:32:53.214 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-12T02:32:53.214 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-12T02:32:53.214 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-12T02:32:53.214 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-12T02:32:53.214 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-12T02:32:53.214 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-12T02:32:53.214 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-12T02:32:53.214 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-12T02:32:53.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-12T02:32:53.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-12T02:32:53.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-12T02:32:53.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-12T02:32:53.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-12T02:32:53.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-12T02:32:53.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-12T02:32:53.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-12T02:32:53.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-12T02:32:53.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-12T02:32:53.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-12T02:32:53.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-12T02:32:53.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-12T02:32:53.215 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-12T02:32:53.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-12T02:32:53.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-12T02:32:53.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-12T02:32:53.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-12T02:32:53.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-12T02:32:53.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-12T02:32:53.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-12T02:32:53.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-12T02:32:53.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-12T02:32:53.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-12T02:32:53.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-12T02:32:53.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-12T02:32:53.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-12T02:32:53.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-12T02:32:53.216 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-12T02:32:53.217 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-12T02:32:53.217 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-12T02:32:53.217 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-12T02:32:53.217 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-12T02:32:53.217 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-12T02:32:53.217 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-12T02:32:53.217 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-12T02:32:53.217 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-12T02:32:53.217 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-12T02:32:53.217 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-12T02:32:53.217 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-12T02:32:53.217 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-12T02:32:53.217 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-12T02:32:53.217 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-12T02:32:53.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-12T02:32:53.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-12T02:32:53.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-12T02:32:53.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-12T02:32:53.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-12T02:32:53.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-12T02:32:53.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-12T02:32:53.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-12T02:32:53.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-12T02:32:53.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-12T02:32:53.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-12T02:32:53.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-12T02:32:53.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-12T02:32:53.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-12T02:32:53.218 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-12T02:32:53.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-12T02:32:53.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-12T02:32:53.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-12T02:32:53.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-12T02:32:53.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-12T02:32:53.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-12T02:32:53.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-12T02:32:53.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-12T02:32:53.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-12T02:32:53.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-12T02:32:53.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-12T02:32:53.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-12T02:32:53.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-12T02:32:53.219 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-12T02:32:53.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-12T02:32:53.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-12T02:32:53.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-12T02:32:53.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-12T02:32:53.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-12T02:32:53.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-12T02:32:53.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-12T02:32:53.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-12T02:32:53.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-12T02:32:53.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-12T02:32:53.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-12T02:32:53.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-12T02:32:53.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-12T02:32:53.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-12T02:32:53.220 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-12T02:32:53.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-12T02:32:53.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-12T02:32:53.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-12T02:32:53.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-12T02:32:53.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-12T02:32:53.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-12T02:32:53.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-12T02:32:53.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-12T02:32:53.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-12T02:32:53.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-12T02:32:53.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-12T02:32:53.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-12T02:32:53.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-12T02:32:53.221 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-12T02:32:53.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-12T02:32:53.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-12T02:32:53.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-12T02:32:53.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-12T02:32:53.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-12T02:32:53.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-12T02:32:53.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-12T02:32:53.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-12T02:32:53.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-12T02:32:53.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-12T02:32:53.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-12T02:32:53.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-12T02:32:53.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-12T02:32:53.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-12T02:32:53.222 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-12T02:32:53.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-12T02:32:53.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-12T02:32:53.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-12T02:32:53.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-12T02:32:53.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-12T02:32:53.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-12T02:32:53.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-12T02:32:53.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-12T02:32:53.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-12T02:32:53.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-12T02:32:53.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-12T02:32:53.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-12T02:32:53.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-12T02:32:53.223 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-12T02:32:53.224 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-12T02:32:53.224 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-12T02:32:53.224 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-12T02:32:53.224 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-12T02:32:53.224 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-12T02:32:53.224 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-12T02:32:53.224 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-12T02:32:53.224 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-12T02:32:53.224 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-12T02:32:53.224 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-12T02:32:53.224 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-12T02:32:53.224 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-12T02:32:53.224 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-12T02:32:53.224 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-12T02:32:53.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-12T02:32:53.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-12T02:32:53.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-12T02:32:53.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-12T02:32:53.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-12T02:32:53.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-12T02:32:53.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-12T02:32:53.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-12T02:32:53.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-12T02:32:53.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-12T02:32:53.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-12T02:32:53.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-12T02:32:53.225 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-12T02:32:53.226 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-12T02:32:53.226 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-12T02:32:53.226 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-12T02:32:53.226 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-12T02:32:53.226 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-12T02:32:53.226 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-12T02:32:53.226 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-12T02:32:53.226 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-12T02:32:53.226 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-12T02:32:53.226 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-12T02:32:53.226 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-12T02:32:53.226 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-12T02:32:53.226 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-12T02:32:53.226 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-12T02:32:53.227 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-12T02:32:53.227 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-12T02:32:53.227 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-12T02:32:53.227 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-12T02:32:53.227 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-12T02:32:53.227 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-12T02:32:53.227 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-12T02:32:53.227 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-12T02:32:53.227 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-12T02:32:53.227 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-12T02:32:53.227 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-12T02:32:53.227 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-12T02:32:53.227 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-12T02:32:53.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-12T02:32:53.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-12T02:32:53.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-12T02:32:53.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-12T02:32:53.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-12T02:32:53.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-12T02:32:53.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-12T02:32:53.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-12T02:32:53.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-12T02:32:53.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-12T02:32:53.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-12T02:32:53.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-12T02:32:53.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-12T02:32:53.228 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-12T02:32:53.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-12T02:32:53.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-12T02:32:53.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-12T02:32:53.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-12T02:32:53.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-12T02:32:53.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-12T02:32:53.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-12T02:32:53.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-12T02:32:53.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-12T02:32:53.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-12T02:32:53.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-12T02:32:53.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-12T02:32:53.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-12T02:32:53.229 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-12T02:32:53.230 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-12T02:32:53.230 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-12T02:32:53.230 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-12T02:32:53.230 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-12T02:32:53.230 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-12T02:32:53.230 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-12T02:32:53.230 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-12T02:32:53.230 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-12T02:32:53.230 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-12T02:32:53.230 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-12T02:32:53.230 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-12T02:32:53.230 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-12T02:32:53.230 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-12T02:32:53.230 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-12T02:32:53.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-12T02:32:53.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-12T02:32:53.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-12T02:32:53.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-12T02:32:53.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-12T02:32:53.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-12T02:32:53.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-12T02:32:53.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-12T02:32:53.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-12T02:32:53.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-12T02:32:53.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-12T02:32:53.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-12T02:32:53.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-12T02:32:53.231 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-12T02:32:53.232 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-12T02:32:53.232 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-12T02:32:53.232 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-12T02:32:53.232 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-12T02:32:53.232 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-12T02:32:53.232 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-12T02:32:53.232 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-12T02:32:53.232 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-12T02:32:53.232 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-12T02:32:53.232 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-12T02:32:53.232 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-12T02:32:53.232 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-12T02:32:53.232 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-12T02:32:53.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-12T02:32:53.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-12T02:32:53.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-12T02:32:53.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-12T02:32:53.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-12T02:32:53.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-12T02:32:53.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-12T02:32:53.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-12T02:32:53.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-12T02:32:53.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-12T02:32:53.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-12T02:32:53.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-12T02:32:53.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-12T02:32:53.233 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-12T02:32:53.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-12T02:32:53.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-12T02:32:53.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-12T02:32:53.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-12T02:32:53.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-12T02:32:53.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-12T02:32:53.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-12T02:32:53.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-12T02:32:53.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-12T02:32:53.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-12T02:32:53.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-12T02:32:53.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-12T02:32:53.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-12T02:32:53.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-12T02:32:53.234 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-12T02:32:53.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-12T02:32:53.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-12T02:32:53.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-12T02:32:53.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-12T02:32:53.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-12T02:32:53.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-12T02:32:53.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-12T02:32:53.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-12T02:32:53.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-12T02:32:53.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-12T02:32:53.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-12T02:32:53.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-12T02:32:53.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-12T02:32:53.235 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-12T02:32:53.236 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-12T02:32:53.236 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-12T02:32:53.236 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-12T02:32:53.236 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-12T02:32:53.236 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-12T02:32:53.236 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-12T02:32:53.236 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-12T02:32:53.236 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-12T02:32:53.236 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-12T02:32:53.236 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-12T02:32:53.236 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-12T02:32:53.236 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-12T02:32:53.236 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-12T02:32:53.236 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-12T02:32:53.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-12T02:32:53.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-12T02:32:53.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-12T02:32:53.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-12T02:32:53.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-12T02:32:53.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-12T02:32:53.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-12T02:32:53.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-12T02:32:53.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-12T02:32:53.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-12T02:32:53.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-12T02:32:53.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-12T02:32:53.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-12T02:32:53.237 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-12T02:32:53.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-12T02:32:53.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-12T02:32:53.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-12T02:32:53.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-12T02:32:53.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-12T02:32:53.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-12T02:32:53.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-12T02:32:53.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-12T02:32:53.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-12T02:32:53.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-12T02:32:53.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-12T02:32:53.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-12T02:32:53.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-12T02:32:53.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-12T02:32:53.238 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-12T02:32:53.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-12T02:32:53.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-12T02:32:53.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-12T02:32:53.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-12T02:32:53.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-12T02:32:53.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-12T02:32:53.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-12T02:32:53.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-12T02:32:53.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-12T02:32:53.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-12T02:32:53.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-12T02:32:53.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-12T02:32:53.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-12T02:32:53.239 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-12T02:32:53.240 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-12T02:32:53.240 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-12T02:32:53.240 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-12T02:32:53.240 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-12T02:32:53.240 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-12T02:32:53.240 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-12T02:32:53.240 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-12T02:32:53.240 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-12T02:32:53.240 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-12T02:32:53.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-12T02:32:53.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-12T02:32:53.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-12T02:32:53.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-12T02:32:53.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-12T02:32:53.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-12T02:32:53.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-12T02:32:53.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-12T02:32:53.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-12T02:32:53.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-12T02:32:53.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-12T02:32:53.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-12T02:32:53.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-12T02:32:53.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-12T02:32:53.241 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-12T02:32:53.242 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-12T02:32:53.242 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-12T02:32:53.242 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-12T02:32:53.242 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-12T02:32:53.242 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-12T02:32:53.242 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-12T02:32:53.242 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-12T02:32:53.242 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-12T02:32:53.242 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-12T02:32:53.242 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-12T02:32:53.242 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-12T02:32:53.242 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-12T02:32:53.242 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-12T02:32:53.242 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-12T02:32:53.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-12T02:32:53.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-12T02:32:53.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-12T02:32:53.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-12T02:32:53.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-12T02:32:53.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-12T02:32:53.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-12T02:32:53.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-12T02:32:53.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-12T02:32:53.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-12T02:32:53.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-12T02:32:53.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-12T02:32:53.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-12T02:32:53.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-12T02:32:53.243 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-12T02:32:53.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-12T02:32:53.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-12T02:32:53.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-12T02:32:53.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-12T02:32:53.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-12T02:32:53.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-12T02:32:53.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-12T02:32:53.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-12T02:32:53.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-12T02:32:53.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-12T02:32:53.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-12T02:32:53.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-12T02:32:53.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-12T02:32:53.244 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-12T02:32:53.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-12T02:32:53.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-12T02:32:53.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-12T02:32:53.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-12T02:32:53.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-12T02:32:53.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-12T02:32:53.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-12T02:32:53.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-12T02:32:53.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-12T02:32:53.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-12T02:32:53.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-12T02:32:53.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-12T02:32:53.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-12T02:32:53.245 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-12T02:32:53.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-12T02:32:53.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-12T02:32:53.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-12T02:32:53.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-12T02:32:53.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-12T02:32:53.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-12T02:32:53.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-12T02:32:53.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-12T02:32:53.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-12T02:32:53.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-12T02:32:53.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-12T02:32:53.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-12T02:32:53.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-12T02:32:53.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-12T02:32:53.246 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-12T02:32:53.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-12T02:32:53.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-12T02:32:53.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-12T02:32:53.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-12T02:32:53.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-12T02:32:53.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-12T02:32:53.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-12T02:32:53.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-12T02:32:53.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-12T02:32:53.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-12T02:32:53.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-12T02:32:53.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-12T02:32:53.247 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-12T02:32:53.248 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-12T02:32:53.248 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-12T02:32:53.248 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-12T02:32:53.248 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-12T02:32:53.248 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-12T02:32:53.248 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-12T02:32:53.248 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-12T02:32:53.248 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-12T02:32:53.248 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-12T02:32:53.248 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-12T02:32:53.248 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-12T02:32:53.248 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-12T02:32:53.248 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-12T02:32:53.248 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-12T02:32:53.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-12T02:32:53.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-12T02:32:53.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-12T02:32:53.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-12T02:32:53.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-12T02:32:53.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-12T02:32:53.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-12T02:32:53.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-12T02:32:53.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-12T02:32:53.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-12T02:32:53.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-12T02:32:53.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-12T02:32:53.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-12T02:32:53.249 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-12T02:32:53.250 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-12T02:32:53.250 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-12T02:32:53.250 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-12T02:32:53.250 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-12T02:32:53.250 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-12T02:32:53.250 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-12T02:32:53.250 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-12T02:32:53.250 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-12T02:32:53.250 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-12T02:32:53.250 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-12T02:32:53.250 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-12T02:32:53.250 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-12T02:32:53.250 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-12T02:32:53.250 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-12T02:32:53.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-12T02:32:53.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-12T02:32:53.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-12T02:32:53.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-12T02:32:53.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-12T02:32:53.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-12T02:32:53.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-12T02:32:53.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-12T02:32:53.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-12T02:32:53.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-12T02:32:53.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-12T02:32:53.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-12T02:32:53.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-12T02:32:53.251 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-12T02:32:53.252 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-12T02:32:53.252 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-12T02:32:53.252 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-12T02:32:53.252 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-12T02:32:53.252 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-12T02:32:53.252 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-12T02:32:53.252 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-12T02:32:53.252 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-12T02:32:53.252 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-12T02:32:53.252 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-12T02:32:53.252 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-12T02:32:53.252 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-12T02:32:53.252 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-12T02:32:53.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-12T02:32:53.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-12T02:32:53.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-12T02:32:53.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-12T02:32:53.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-12T02:32:53.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-12T02:32:53.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-12T02:32:53.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-12T02:32:53.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-12T02:32:53.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-12T02:32:53.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-12T02:32:53.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-12T02:32:53.253 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-12T02:32:53.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-12T02:32:53.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-12T02:32:53.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-12T02:32:53.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-12T02:32:53.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-12T02:32:53.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-12T02:32:53.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-12T02:32:53.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-12T02:32:53.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-12T02:32:53.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-12T02:32:53.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-12T02:32:53.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-12T02:32:53.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-12T02:32:53.254 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-12T02:32:53.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-12T02:32:53.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-12T02:32:53.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-12T02:32:53.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-12T02:32:53.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-12T02:32:53.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-12T02:32:53.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-12T02:32:53.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-12T02:32:53.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-12T02:32:53.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-12T02:32:53.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-12T02:32:53.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-12T02:32:53.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-12T02:32:53.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-12T02:32:53.255 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-12T02:32:53.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-12T02:32:53.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-12T02:32:53.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-12T02:32:53.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-12T02:32:53.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-12T02:32:53.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-12T02:32:53.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-12T02:32:53.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-12T02:32:53.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-12T02:32:53.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-12T02:32:53.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-12T02:32:53.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-12T02:32:53.256 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-12T02:32:53.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-12T02:32:53.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-12T02:32:53.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-12T02:32:53.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-12T02:32:53.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-12T02:32:53.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-12T02:32:53.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-12T02:32:53.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-12T02:32:53.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-12T02:32:53.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-12T02:32:53.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-12T02:32:53.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-12T02:32:53.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-12T02:32:53.257 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-12T02:32:53.258 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-12T02:32:53.258 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-12T02:32:53.258 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-12T02:32:53.258 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-12T02:32:53.258 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-12T02:32:53.258 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-12T02:32:53.258 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-12T02:32:53.258 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-12T02:32:53.258 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-12T02:32:53.258 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-12T02:32:53.258 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-12T02:32:53.258 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-12T02:32:53.258 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-12T02:32:53.259 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-12T02:32:53.259 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-12T02:32:53.259 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-12T02:32:53.259 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-12T02:32:53.259 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-12T02:32:53.259 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-12T02:32:53.259 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-12T02:32:53.259 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-12T02:32:53.259 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-12T02:32:53.259 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-12T02:32:53.259 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-12T02:32:53.259 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-12T02:32:53.259 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-12T02:32:53.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-12T02:32:53.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-12T02:32:53.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-12T02:32:53.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-12T02:32:53.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-12T02:32:53.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-12T02:32:53.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-12T02:32:53.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-12T02:32:53.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-12T02:32:53.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-12T02:32:53.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-12T02:32:53.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-12T02:32:53.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-12T02:32:53.260 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-12T02:32:53.261 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-12T02:32:53.261 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-12T02:32:53.261 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-12T02:32:53.261 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-12T02:32:53.261 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-12T02:32:53.261 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-12T02:32:53.261 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-12T02:32:53.261 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-12T02:32:53.261 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-12T02:32:53.261 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-12T02:32:53.261 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-12T02:32:53.261 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-12T02:32:53.261 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-12T02:32:53.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-12T02:32:53.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-12T02:32:53.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-12T02:32:53.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-12T02:32:53.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-12T02:32:53.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-12T02:32:53.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-12T02:32:53.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-12T02:32:53.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-12T02:32:53.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-12T02:32:53.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-12T02:32:53.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-12T02:32:53.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-12T02:32:53.262 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-12T02:32:53.263 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-12T02:32:53.263 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-12T02:32:53.263 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-12T02:32:53.263 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-12T02:32:53.263 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-12T02:32:53.263 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-12T02:32:53.263 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-12T02:32:53.263 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-12T02:32:53.263 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-12T02:32:53.263 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-12T02:32:53.263 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-12T02:32:53.263 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-12T02:32:53.263 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-12T02:32:53.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-12T02:32:53.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-12T02:32:53.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-12T02:32:53.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-12T02:32:53.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-12T02:32:53.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-12T02:32:53.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-12T02:32:53.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-12T02:32:53.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-12T02:32:53.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-12T02:32:53.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-12T02:32:53.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-12T02:32:53.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-12T02:32:53.264 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-12T02:32:53.265 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-12T02:32:53.265 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-12T02:32:53.265 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-12T02:32:53.265 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-12T02:32:53.265 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-12T02:32:53.265 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-12T02:32:53.265 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-12T02:32:53.265 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-12T02:32:53.265 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-12T02:32:53.265 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-12T02:32:53.265 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-12T02:32:53.265 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-12T02:32:53.265 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-12T02:32:53.265 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-12T02:32:53.266 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-12T02:32:53.266 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-12T02:32:53.266 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-12T02:32:53.266 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-12T02:32:53.266 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-12T02:32:53.266 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-12T02:32:53.266 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-12T02:32:53.266 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-12T02:32:53.266 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-12T02:32:53.266 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-12T02:32:53.266 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-12T02:32:53.266 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-12T02:32:53.266 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-12T02:32:53.266 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-12T02:32:53.267 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-12T02:32:53.267 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-12T02:32:53.267 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-12T02:32:53.267 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-12T02:32:53.267 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-12T02:32:53.267 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-12T02:32:53.267 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-12T02:32:53.267 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-12T02:32:53.267 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-12T02:32:53.267 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-12T02:32:53.267 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-12T02:32:53.267 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-12T02:32:53.267 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-12T02:32:53.268 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-12T02:32:53.268 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-12T02:32:53.268 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-12T02:32:53.268 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-12T02:32:53.268 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-12T02:32:53.268 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-12T02:32:53.268 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-12T02:32:53.268 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-12T02:32:53.268 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-12T02:32:53.268 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-12T02:32:53.268 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-12T02:32:53.268 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-12T02:32:53.268 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-12T02:32:53.268 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-12T02:32:53.268 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-12T02:32:53.269 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-12T02:32:53.269 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-12T02:32:53.269 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-12T02:32:53.269 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-12T02:32:53.269 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-12T02:32:53.269 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-12T02:32:53.269 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-12T02:32:53.269 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-12T02:32:53.269 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-12T02:32:53.269 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-12T02:32:53.269 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-12T02:32:53.269 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-12T02:32:53.269 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-12T02:32:53.269 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-12T02:32:53.270 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-12T02:32:53.270 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-12T02:32:53.270 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-12T02:32:53.270 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-12T02:32:53.270 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-12T02:32:53.270 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-12T02:32:53.270 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-12T02:32:53.270 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-12T02:32:53.270 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-12T02:32:53.270 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-12T02:32:53.270 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-12T02:32:53.270 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-12T02:32:53.270 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-12T02:32:53.270 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-12T02:32:53.271 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-12T02:32:53.271 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-12T02:32:53.271 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-12T02:32:53.271 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-12T02:32:53.271 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-12T02:32:53.271 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-12T02:32:53.271 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-12T02:32:53.271 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-12T02:32:53.271 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-12T02:32:53.271 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-12T02:32:53.271 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-12T02:32:53.271 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-12T02:32:53.271 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-12T02:32:53.271 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-12T02:32:53.272 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-12T02:32:53.272 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-12T02:32:53.272 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-12T02:32:53.272 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-12T02:32:53.272 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-12T02:32:53.272 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-12T02:32:53.272 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-12T02:32:53.272 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-12T02:32:53.272 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-12T02:32:53.272 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-12T02:32:53.272 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-12T02:32:53.272 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-12T02:32:53.272 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-12T02:32:53.272 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-12T02:32:53.272 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-12T02:32:53.273 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-12T02:32:53.273 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-12T02:32:53.273 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-12T02:32:53.273 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-12T02:32:53.273 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-12T02:32:53.273 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-12T02:32:53.273 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-12T02:32:53.273 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-12T02:32:53.273 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-12T02:32:53.273 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-12T02:32:53.273 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-12T02:32:53.273 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-12T02:32:53.273 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-12T02:32:53.273 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-12T02:32:53.274 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-12T02:32:53.274 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-12T02:32:53.274 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-12T02:32:53.274 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-12T02:32:53.274 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-12T02:32:53.274 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-12T02:32:53.274 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-12T02:32:53.274 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-12T02:32:53.274 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-12T02:32:53.274 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-12T02:32:53.274 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-12T02:32:53.274 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-12T02:32:53.274 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-12T02:32:53.274 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-12T02:32:53.274 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-12T02:32:53.275 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-12T02:32:53.275 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-12T02:32:53.275 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-12T02:32:53.275 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-12T02:32:53.275 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-12T02:32:53.275 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-12T02:32:53.275 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-12T02:32:53.275 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-12T02:32:53.275 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-12T02:32:53.275 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-12T02:32:53.275 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-12T02:32:53.275 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-12T02:32:53.275 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-12T02:32:53.275 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-12T02:32:53.276 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-12T02:32:53.276 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-12T02:32:53.276 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-12T02:32:53.276 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-12T02:32:53.276 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-12T02:32:53.276 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-12T02:32:53.276 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-12T02:32:53.276 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-12T02:32:53.276 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-12T02:32:53.276 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-12T02:32:53.276 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-12T02:32:53.276 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-12T02:32:53.276 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-12T02:32:53.276 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-12T02:32:53.277 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-12T02:32:53.277 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-12T02:32:53.277 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-12T02:32:53.277 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-12T02:32:53.277 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-12T02:32:53.277 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-12T02:32:53.277 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-12T02:32:53.277 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-12T02:32:53.277 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-12T02:32:53.277 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-12T02:32:53.277 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-12T02:32:53.277 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-12T02:32:53.277 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-12T02:32:53.277 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-12T02:32:53.277 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-12T02:32:53.278 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-12T02:32:53.278 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-12T02:32:53.278 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-12T02:32:53.278 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-12T02:32:53.278 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-12T02:32:53.278 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-12T02:32:53.278 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-12T02:32:53.278 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-12T02:32:53.278 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-12T02:32:53.278 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-12T02:32:53.278 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-12T02:32:53.278 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-12T02:32:53.278 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-12T02:32:53.278 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-12T02:32:53.279 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-12T02:32:53.279 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-12T02:32:53.279 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-12T02:32:53.279 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-12T02:32:53.279 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-12T02:32:53.279 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-12T02:32:53.279 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-12T02:32:53.279 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-12T02:32:53.279 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-12T02:32:53.279 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-12T02:32:53.279 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-12T02:32:53.279 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-12T02:32:53.279 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-12T02:32:53.279 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-12T02:32:53.279 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-12T02:32:53.280 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-12T02:32:53.280 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-12T02:32:53.280 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-12T02:32:53.280 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-12T02:32:53.280 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-12T02:32:53.280 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-12T02:32:53.280 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-12T02:32:53.280 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-12T02:32:53.280 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-12T02:32:53.280 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-12T02:32:53.280 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-12T02:32:53.280 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-12T02:32:53.280 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-12T02:32:53.280 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-12T02:32:53.281 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-12T02:32:53.281 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-12T02:32:53.281 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-12T02:32:53.281 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-12T02:32:53.281 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-12T02:32:53.281 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-12T02:32:53.281 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-12T02:32:53.281 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-12T02:32:53.281 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-12T02:32:53.281 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-12T02:32:53.281 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-12T02:32:53.281 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-12T02:32:53.281 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-12T02:32:53.281 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-12T02:32:53.282 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-12T02:32:53.282 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-12T02:32:53.282 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-12T02:32:53.282 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-12T02:32:53.282 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-12T02:32:53.282 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-12T02:32:53.282 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-12T02:32:53.282 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-12T02:32:53.282 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-12T02:32:53.282 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-12T02:32:53.282 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-12T02:32:53.282 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-12T02:32:53.282 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-12T02:32:53.282 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-12T02:32:53.282 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-12T02:32:53.283 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-12T02:32:53.283 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-12T02:32:53.283 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-12T02:32:53.283 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-12T02:32:53.283 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-12T02:32:53.283 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-12T02:32:53.283 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-12T02:32:53.283 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-12T02:32:53.283 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-12T02:32:53.283 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-12T02:32:53.283 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-12T02:32:53.283 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-12T02:32:53.283 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-12T02:32:53.283 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-12T02:32:53.284 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-12T02:32:53.284 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-12T02:32:53.284 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-12T02:32:53.284 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-12T02:32:53.284 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-12T02:32:53.284 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-12T02:32:53.284 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-12T02:32:53.284 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-12T02:32:53.284 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-12T02:32:53.284 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-12T02:32:53.284 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-12T02:32:53.284 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-12T02:32:53.284 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-12T02:32:53.285 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-12T02:32:53.285 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-12T02:32:53.285 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-12T02:32:53.285 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-12T02:32:53.285 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-12T02:32:53.285 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-12T02:32:53.285 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-12T02:32:53.285 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-12T02:32:53.285 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-12T02:32:53.285 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-12T02:32:53.285 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-12T02:32:53.285 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-12T02:32:53.285 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-12T02:32:53.285 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-12T02:32:53.286 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-12T02:32:53.286 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-12T02:32:53.286 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-12T02:32:53.286 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-12T02:32:53.286 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-12T02:32:53.286 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-12T02:32:53.286 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-12T02:32:53.286 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-12T02:32:53.286 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-12T02:32:53.286 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-12T02:32:53.286 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-12T02:32:53.286 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-12T02:32:53.286 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-12T02:32:53.286 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-12T02:32:53.286 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-12T02:32:53.287 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-12T02:32:53.287 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-12T02:32:53.287 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-12T02:32:53.287 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-12T02:32:53.287 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-12T02:32:53.287 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-12T02:32:53.287 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-12T02:32:53.287 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-12T02:32:53.287 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-12T02:32:53.287 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-12T02:32:53.287 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-12T02:32:53.287 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-12T02:32:53.287 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-12T02:32:53.287 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-12T02:32:53.287 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-12T02:32:53.288 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-12T02:32:53.288 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-12T02:32:53.288 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-12T02:32:53.288 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-12T02:32:53.288 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-12T02:32:53.288 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-12T02:32:53.288 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-12T02:32:53.288 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-12T02:32:53.288 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-12T02:32:53.288 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-12T02:32:53.288 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-12T02:32:53.288 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-12T02:32:53.288 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-12T02:32:53.288 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-12T02:32:53.288 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-12T02:32:53.289 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-12T02:32:53.289 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-12T02:32:53.289 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-12T02:32:53.289 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-12T02:32:53.289 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-12T02:32:53.289 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-12T02:32:53.289 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-12T02:32:53.289 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-12T02:32:53.289 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-12T02:32:53.289 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-12T02:32:53.289 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-12T02:32:53.289 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-12T02:32:53.289 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-12T02:32:53.289 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-12T02:32:53.290 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-12T02:32:53.290 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-12T02:32:53.290 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-12T02:32:53.290 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-12T02:32:53.290 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-12T02:32:53.290 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-12T02:32:53.290 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-12T02:32:53.290 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-12T02:32:53.290 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-12T02:32:53.290 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-12T02:32:53.290 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-12T02:32:53.290 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-12T02:32:53.290 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-12T02:32:53.290 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-12T02:32:53.290 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-12T02:32:53.291 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-12T02:32:53.291 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-12T02:32:53.291 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-12T02:32:53.291 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-12T02:32:53.291 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-12T02:32:53.291 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-12T02:32:53.291 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-12T02:32:53.291 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-12T02:32:53.291 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-12T02:32:53.294 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:32:53.295 DEBUG:teuthology.orchestra.run.smithi112:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-12T02:32:53.317 INFO:teuthology.orchestra.run.smithi112.stdout:postinstall scriptlet (using /bin/sh): 2024-09-12T02:32:53.318 INFO:teuthology.orchestra.run.smithi112.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-12T02:32:53.318 INFO:teuthology.orchestra.run.smithi112.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-12T02:32:53.318 INFO:teuthology.orchestra.run.smithi112.stdout:fi 2024-09-12T02:32:53.318 INFO:teuthology.orchestra.run.smithi112.stdout:for file in vmlinuz System.map config; do 2024-09-12T02:32:53.318 INFO:teuthology.orchestra.run.smithi112.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-12T02:32:53.318 INFO:teuthology.orchestra.run.smithi112.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-12T02:32:53.318 INFO:teuthology.orchestra.run.smithi112.stdout: fi 2024-09-12T02:32:53.318 INFO:teuthology.orchestra.run.smithi112.stdout:done 2024-09-12T02:32:53.318 INFO:teuthology.orchestra.run.smithi112.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-12T02:32:53.318 INFO:teuthology.orchestra.run.smithi112.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-12T02:32:53.318 INFO:teuthology.orchestra.run.smithi112.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-12T02:32:53.318 INFO:teuthology.orchestra.run.smithi112.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-12T02:32:53.319 INFO:teuthology.orchestra.run.smithi112.stdout:fi 2024-09-12T02:32:53.319 INFO:teuthology.orchestra.run.smithi112.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-12T02:32:53.319 INFO:teuthology.orchestra.run.smithi112.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:32:53.319 INFO:teuthology.orchestra.run.smithi112.stdout:fi 2024-09-12T02:32:53.319 INFO:teuthology.orchestra.run.smithi112.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-12T02:32:53.319 INFO:teuthology.orchestra.run.smithi112.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-12T02:32:53.319 INFO:teuthology.orchestra.run.smithi112.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:32:53.319 INFO:teuthology.orchestra.run.smithi112.stdout:fi 2024-09-12T02:32:53.320 DEBUG:teuthology.orchestra.run.smithi112:> sudo rpm -qi grub2-tools 2024-09-12T02:32:53.330 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0666 /tmp/tmp.w2UVSee8jr 2024-09-12T02:32:53.391 INFO:teuthology.orchestra.run.smithi112.stdout:Name : grub2-tools 2024-09-12T02:32:53.392 INFO:teuthology.orchestra.run.smithi112.stdout:Epoch : 1 2024-09-12T02:32:53.392 INFO:teuthology.orchestra.run.smithi112.stdout:Version : 2.06 2024-09-12T02:32:53.392 INFO:teuthology.orchestra.run.smithi112.stdout:Release : 82.el9 2024-09-12T02:32:53.392 INFO:teuthology.orchestra.run.smithi112.stdout:Architecture: x86_64 2024-09-12T02:32:53.392 INFO:teuthology.orchestra.run.smithi112.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T02:32:53.392 INFO:teuthology.orchestra.run.smithi112.stdout:Group : Unspecified 2024-09-12T02:32:53.392 INFO:teuthology.orchestra.run.smithi112.stdout:Size : 8274670 2024-09-12T02:32:53.392 INFO:teuthology.orchestra.run.smithi112.stdout:License : GPLv3+ 2024-09-12T02:32:53.392 INFO:teuthology.orchestra.run.smithi112.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T02:32:53.392 INFO:teuthology.orchestra.run.smithi112.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T02:32:53.392 INFO:teuthology.orchestra.run.smithi112.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T02:32:53.392 INFO:teuthology.orchestra.run.smithi112.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T02:32:53.392 INFO:teuthology.orchestra.run.smithi112.stdout:Packager : builder@centos.org 2024-09-12T02:32:53.393 INFO:teuthology.orchestra.run.smithi112.stdout:Vendor : CentOS 2024-09-12T02:32:53.393 INFO:teuthology.orchestra.run.smithi112.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T02:32:53.393 INFO:teuthology.orchestra.run.smithi112.stdout:Summary : Support tools for GRUB. 2024-09-12T02:32:53.393 INFO:teuthology.orchestra.run.smithi112.stdout:Description : 2024-09-12T02:32:53.393 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:32:53.393 INFO:teuthology.orchestra.run.smithi112.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T02:32:53.393 INFO:teuthology.orchestra.run.smithi112.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T02:32:53.393 INFO:teuthology.orchestra.run.smithi112.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T02:32:53.393 INFO:teuthology.orchestra.run.smithi112.stdout:hardware devices. 2024-09-12T02:32:53.393 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:32:53.393 INFO:teuthology.orchestra.run.smithi112.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T02:32:53.394 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T02:32:53.394 INFO:teuthology.task.kernel:Updating grub on smithi112 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:32:53.394 DEBUG:teuthology.orchestra.run.smithi112:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T02:32:53.479 DEBUG:teuthology.orchestra.remote:smithi137:/tmp/tmp.w2UVSee8jr is 6KB 2024-09-12T02:32:53.527 DEBUG:teuthology.orchestra.run.smithi137:> rm -fr /tmp/tmp.w2UVSee8jr 2024-09-12T02:32:53.542 DEBUG:teuthology.orchestra.run.smithi137:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T02:32:53.605 INFO:teuthology.orchestra.run.smithi137.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T02:32:53.605 INFO:teuthology.orchestra.run.smithi137.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T02:32:53.605 INFO:teuthology.orchestra.run.smithi137.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T02:32:53.605 INFO:teuthology.orchestra.run.smithi137.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-12T02:32:53.606 DEBUG:teuthology.orchestra.run.smithi137:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:32:53.759 DEBUG:teuthology.orchestra.run.smithi137:> sudo shutdown -r now 2024-09-12T02:32:54.051 INFO:teuthology.orchestra.run.smithi112.stderr:Generating grub configuration file ... 2024-09-12T02:32:55.451 INFO:teuthology.orchestra.run.smithi112.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T02:32:55.485 INFO:teuthology.orchestra.run.smithi112.stderr:done 2024-09-12T02:32:55.487 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-09-12T02:32:55.502 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.8f47xgvBBB 2024-09-12T02:32:55.503 DEBUG:teuthology.orchestra.run.smithi112:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.8f47xgvBBB 2024-09-12T02:32:55.581 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.8f47xgvBBB 2024-09-12T02:32:55.725 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.8f47xgvBBB is 6KB 2024-09-12T02:32:55.745 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.8f47xgvBBB 2024-09-12T02:32:55.759 DEBUG:teuthology.orchestra.run.smithi112:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T02:32:55.829 INFO:teuthology.orchestra.run.smithi112.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T02:32:55.830 INFO:teuthology.orchestra.run.smithi112.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T02:32:55.830 INFO:teuthology.orchestra.run.smithi112.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T02:32:55.830 INFO:teuthology.orchestra.run.smithi112.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-12T02:32:55.831 DEBUG:teuthology.orchestra.run.smithi112:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:32:55.985 DEBUG:teuthology.orchestra.run.smithi112:> sudo shutdown -r now 2024-09-12T02:33:23.789 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-12T02:33:23.789 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-12T02:33:23.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:33:25.989 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-12T02:33:25.989 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-12T02:33:25.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:33:44.513 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-12T02:33:53.521 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-12T02:33:53.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:33:56.605 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-12T02:33:58.333 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-09-12T02:34:07.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-12T02:34:07.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:34:08.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-12T02:34:08.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:34:25.725 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-09-12T02:34:27.005 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-12T02:34:37.737 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-12T02:34:37.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:34:38.905 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-09-12T02:34:39.479 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-12T02:34:39.480 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-12T02:34:39.480 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2024-09-12T02:34:39.514 INFO:teuthology.orchestra.run.smithi137.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:34:39.515 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:34:39.515 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T02:34:39.515 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T02:34:40.516 DEBUG:teuthology.parallel:result is None 2024-09-12T02:34:42.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-12T02:34:42.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:34:42.359 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-09-12T02:34:42.875 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-12T02:34:42.875 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-12T02:34:42.876 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-09-12T02:34:42.909 INFO:teuthology.orchestra.run.smithi112.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:34:42.910 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:34:42.910 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T02:34:42.910 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T02:34:43.912 DEBUG:teuthology.parallel:result is None 2024-09-12T02:34:43.913 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T02:34:43.920 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T02:34:43.920 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T02:34:43.924 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T02:34:43.961 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T02:34:43.969 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T02:34:43.978 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T02:34:43.978 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T02:34:44.000 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T02:34:44.042 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T02:34:44.049 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T02:34:44.049 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T02:34:44.081 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T02:34:44.189 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:34:44.190 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:34:44.234 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:34:44.258 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:34:44.261 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T02:34:44.275 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T02:34:44.275 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T02:34:44.279 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T02:34:44.335 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T02:34:44.344 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T02:34:44.344 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T02:34:44.348 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T02:34:44.391 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:34:44.486 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:34:44.555 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:34:44.620 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:34:44.688 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:34:44.688 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T02:34:44.771 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:34:44.834 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:34:44.906 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:34:44.969 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:34:45.040 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:34:45.040 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T02:34:45.213 DEBUG:teuthology.orchestra.run.smithi112:> sudo service rsyslog restart 2024-09-12T02:34:45.217 DEBUG:teuthology.orchestra.run.smithi137:> sudo service rsyslog restart 2024-09-12T02:34:45.293 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:34:45.308 INFO:teuthology.orchestra.run.smithi137.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:34:45.705 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T02:34:45.713 INFO:teuthology.task.internal:Starting timer... 2024-09-12T02:34:45.713 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T02:34:45.725 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T02:34:45.733 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-12T02:34:45.733 DEBUG:teuthology.orchestra.run.smithi112:> sudo service auditd rotate 2024-09-12T02:34:45.825 INFO:teuthology.orchestra.run.smithi112.stdout:Rotating logs: 2024-09-12T02:34:45.828 DEBUG:teuthology.orchestra.run.smithi137:> sudo service auditd rotate 2024-09-12T02:34:45.923 INFO:teuthology.orchestra.run.smithi137.stdout:Rotating logs: 2024-09-12T02:34:45.926 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T02:34:45.927 DEBUG:teuthology.orchestra.run.smithi112:> /usr/sbin/getenforce 2024-09-12T02:34:45.977 INFO:teuthology.orchestra.run.smithi112.stdout:Permissive 2024-09-12T02:34:45.978 DEBUG:teuthology.orchestra.run.smithi137:> /usr/sbin/getenforce 2024-09-12T02:34:46.021 INFO:teuthology.orchestra.run.smithi137.stdout:Permissive 2024-09-12T02:34:46.022 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi112.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi137.front.sepia.ceph.com': 'permissive'} 2024-09-12T02:34:46.022 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:34:46.079 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:34:46.080 DEBUG:teuthology.orchestra.run.smithi137:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:34:46.140 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:34:46.141 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T02:34:46.141 DEBUG:teuthology.orchestra.run.smithi112:> sudo /usr/sbin/setenforce permissive 2024-09-12T02:34:46.240 DEBUG:teuthology.orchestra.run.smithi137:> sudo /usr/sbin/setenforce permissive 2024-09-12T02:34:46.304 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T02:34:46.313 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T02:34:46.315 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T02:34:46.434 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T02:34:46.444 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T02:34:46.445 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi112.front.sepia.ceph.com,smithi137.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T02:39:28.236 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi112.front.sepia.ceph.com'), Remote(name='ubuntu@smithi137.front.sepia.ceph.com')] 2024-09-12T02:39:28.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-12T02:39:28.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:39:28.325 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-09-12T02:39:28.438 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-12T02:39:28.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-12T02:39:28.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:39:28.526 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-09-12T02:39:28.625 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-12T02:39:28.626 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T02:39:28.638 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T02:39:28.638 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T02:39:28.638 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:39:28.642 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T02:39:28.643 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:39:28.699 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T02:39:28.725 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T02:39:28.729 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T02:39:28.755 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T02:39:28.779 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: ntpd: command not found 2024-09-12T02:39:28.803 INFO:teuthology.orchestra.run.smithi112.stdout:506 Cannot talk to daemon 2024-09-12T02:39:28.805 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: ntpd: command not found 2024-09-12T02:39:28.832 INFO:teuthology.orchestra.run.smithi137.stdout:506 Cannot talk to daemon 2024-09-12T02:39:28.832 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T02:39:28.858 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T02:39:28.861 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T02:39:28.888 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T02:39:28.953 INFO:teuthology.orchestra.run.smithi112.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:39:28.959 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:39:28.959 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2024-09-12T02:39:28.960 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:39:28.960 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:39:28.960 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:39:28.960 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:39:28.985 INFO:teuthology.orchestra.run.smithi137.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:39:28.992 INFO:teuthology.orchestra.run.smithi137.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:39:28.992 INFO:teuthology.orchestra.run.smithi137.stdout:=============================================================================== 2024-09-12T02:39:28.992 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:39:28.992 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:39:28.992 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:39:28.992 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:39:28.994 INFO:teuthology.run_tasks:Running task install... 2024-09-12T02:39:29.005 DEBUG:teuthology.task.install:project ceph 2024-09-12T02:39:29.006 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-12T02:39:29.006 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-12T02:39:29.006 INFO:teuthology.task.install:Using flavor: default 2024-09-12T02:39:29.012 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T02:39:29.012 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-12T02:39:29.012 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T02:39:29.013 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:39:29.015 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T02:39:29.015 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:39:29.156 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T02:39:29.156 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T02:39:29.163 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T02:39:29.163 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T02:39:29.269 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T02:39:29.269 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:39:29.269 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T02:39:29.277 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T02:39:29.277 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:39:29.277 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T02:39:29.325 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T02:39:29.325 DEBUG:teuthology.orchestra.run.smithi112:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T02:39:29.334 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T02:39:29.334 DEBUG:teuthology.orchestra.run.smithi137:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T02:39:29.422 DEBUG:teuthology.orchestra.run.smithi112:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T02:39:29.432 DEBUG:teuthology.orchestra.run.smithi137:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T02:39:29.500 DEBUG:teuthology.orchestra.run.smithi112:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T02:39:29.510 DEBUG:teuthology.orchestra.run.smithi137:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T02:39:29.555 INFO:teuthology.orchestra.run.smithi112.stdout:check_obsoletes = 1 2024-09-12T02:39:29.558 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum clean all 2024-09-12T02:39:29.565 INFO:teuthology.orchestra.run.smithi137.stdout:check_obsoletes = 1 2024-09-12T02:39:29.568 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum clean all 2024-09-12T02:39:29.828 INFO:teuthology.orchestra.run.smithi112.stdout:45 files removed 2024-09-12T02:39:29.842 INFO:teuthology.orchestra.run.smithi137.stdout:45 files removed 2024-09-12T02:39:29.861 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T02:39:29.877 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T02:39:30.547 INFO:teuthology.orchestra.run.smithi112.stdout:ceph packages for x86_64 284 kB/s | 84 kB 00:00 2024-09-12T02:39:30.569 INFO:teuthology.orchestra.run.smithi137.stdout:ceph packages for x86_64 281 kB/s | 84 kB 00:00 2024-09-12T02:39:30.855 INFO:teuthology.orchestra.run.smithi112.stdout:ceph noarch packages 45 kB/s | 12 kB 00:00 2024-09-12T02:39:30.864 INFO:teuthology.orchestra.run.smithi137.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-12T02:39:31.148 INFO:teuthology.orchestra.run.smithi137.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-12T02:39:31.173 INFO:teuthology.orchestra.run.smithi112.stdout:ceph source packages 6.8 kB/s | 1.9 kB 00:00 2024-09-12T02:39:31.706 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.2 MB 00:00 2024-09-12T02:39:32.673 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - BaseOS 5.6 MB/s | 8.2 MB 00:01 2024-09-12T02:39:34.849 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - AppStream 20 MB/s | 20 MB 00:01 2024-09-12T02:39:35.118 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - AppStream 9.0 MB/s | 20 MB 00:02 2024-09-12T02:39:39.899 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - CRB 9.7 MB/s | 6.5 MB 00:00 2024-09-12T02:39:40.776 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.5 MB 00:01 2024-09-12T02:39:41.411 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - Extras packages 88 kB/s | 19 kB 00:00 2024-09-12T02:39:42.271 INFO:teuthology.orchestra.run.smithi137.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-12T02:39:42.309 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - Extras packages 81 kB/s | 19 kB 00:00 2024-09-12T02:39:43.113 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-12T02:39:48.610 INFO:teuthology.orchestra.run.smithi137.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-12T02:39:49.494 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-12T02:39:51.139 INFO:teuthology.orchestra.run.smithi137.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:39:51.139 INFO:teuthology.orchestra.run.smithi137.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:39:51.151 INFO:teuthology.orchestra.run.smithi137.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T02:39:51.152 INFO:teuthology.orchestra.run.smithi137.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T02:39:51.153 INFO:teuthology.orchestra.run.smithi137.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T02:39:51.153 INFO:teuthology.orchestra.run.smithi137.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T02:39:51.155 INFO:teuthology.orchestra.run.smithi137.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T02:39:51.157 INFO:teuthology.orchestra.run.smithi137.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T02:39:51.158 INFO:teuthology.orchestra.run.smithi137.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T02:39:51.225 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-09-12T02:39:51.245 INFO:teuthology.orchestra.run.smithi137.stdout:====================================================================================== 2024-09-12T02:39:51.245 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-09-12T02:39:51.245 INFO:teuthology.orchestra.run.smithi137.stdout:====================================================================================== 2024-09-12T02:39:51.245 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-09-12T02:39:51.245 INFO:teuthology.orchestra.run.smithi137.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T02:39:51.245 INFO:teuthology.orchestra.run.smithi137.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T02:39:51.245 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T02:39:51.246 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T02:39:51.246 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T02:39:51.246 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T02:39:51.246 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T02:39:51.246 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T02:39:51.246 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T02:39:51.246 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T02:39:51.246 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T02:39:51.246 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T02:39:51.246 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T02:39:51.246 INFO:teuthology.orchestra.run.smithi137.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T02:39:51.246 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T02:39:51.247 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T02:39:51.247 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T02:39:51.247 INFO:teuthology.orchestra.run.smithi137.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T02:39:51.247 INFO:teuthology.orchestra.run.smithi137.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T02:39:51.247 INFO:teuthology.orchestra.run.smithi137.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T02:39:51.247 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T02:39:51.247 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T02:39:51.247 INFO:teuthology.orchestra.run.smithi137.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T02:39:51.247 INFO:teuthology.orchestra.run.smithi137.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T02:39:51.247 INFO:teuthology.orchestra.run.smithi137.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T02:39:51.247 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T02:39:51.247 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T02:39:51.247 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T02:39:51.248 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T02:39:51.248 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T02:39:51.248 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T02:39:51.248 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T02:39:51.248 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T02:39:51.248 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T02:39:51.248 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T02:39:51.248 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T02:39:51.248 INFO:teuthology.orchestra.run.smithi137.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T02:39:51.248 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrading: 2024-09-12T02:39:51.248 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T02:39:51.248 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T02:39:51.248 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T02:39:51.249 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T02:39:51.249 INFO:teuthology.orchestra.run.smithi137.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T02:39:51.249 INFO:teuthology.orchestra.run.smithi137.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T02:39:51.249 INFO:teuthology.orchestra.run.smithi137.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T02:39:51.249 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T02:39:51.249 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-09-12T02:39:51.249 INFO:teuthology.orchestra.run.smithi137.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T02:39:51.249 INFO:teuthology.orchestra.run.smithi137.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T02:39:51.249 INFO:teuthology.orchestra.run.smithi137.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T02:39:51.249 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T02:39:51.249 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T02:39:51.249 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T02:39:51.249 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T02:39:51.250 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T02:39:51.250 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T02:39:51.250 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T02:39:51.250 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T02:39:51.250 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T02:39:51.250 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T02:39:51.250 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T02:39:51.250 INFO:teuthology.orchestra.run.smithi137.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T02:39:51.250 INFO:teuthology.orchestra.run.smithi137.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T02:39:51.250 INFO:teuthology.orchestra.run.smithi137.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T02:39:51.250 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T02:39:51.250 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T02:39:51.251 INFO:teuthology.orchestra.run.smithi137.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T02:39:51.251 INFO:teuthology.orchestra.run.smithi137.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T02:39:51.251 INFO:teuthology.orchestra.run.smithi137.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T02:39:51.251 INFO:teuthology.orchestra.run.smithi137.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T02:39:51.251 INFO:teuthology.orchestra.run.smithi137.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T02:39:51.251 INFO:teuthology.orchestra.run.smithi137.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T02:39:51.251 INFO:teuthology.orchestra.run.smithi137.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T02:39:51.251 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T02:39:51.251 INFO:teuthology.orchestra.run.smithi137.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T02:39:51.251 INFO:teuthology.orchestra.run.smithi137.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T02:39:51.251 INFO:teuthology.orchestra.run.smithi137.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T02:39:51.251 INFO:teuthology.orchestra.run.smithi137.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T02:39:51.252 INFO:teuthology.orchestra.run.smithi137.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T02:39:51.252 INFO:teuthology.orchestra.run.smithi137.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T02:39:51.252 INFO:teuthology.orchestra.run.smithi137.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T02:39:51.252 INFO:teuthology.orchestra.run.smithi137.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T02:39:51.252 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T02:39:51.252 INFO:teuthology.orchestra.run.smithi137.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T02:39:51.252 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T02:39:51.252 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T02:39:51.252 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T02:39:51.252 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T02:39:51.252 INFO:teuthology.orchestra.run.smithi137.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T02:39:51.252 INFO:teuthology.orchestra.run.smithi137.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T02:39:51.252 INFO:teuthology.orchestra.run.smithi137.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T02:39:51.253 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T02:39:51.253 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T02:39:51.253 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T02:39:51.253 INFO:teuthology.orchestra.run.smithi137.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T02:39:51.253 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T02:39:51.253 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T02:39:51.253 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T02:39:51.253 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T02:39:51.253 INFO:teuthology.orchestra.run.smithi137.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T02:39:51.253 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T02:39:51.253 INFO:teuthology.orchestra.run.smithi137.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T02:39:51.253 INFO:teuthology.orchestra.run.smithi137.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T02:39:51.253 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T02:39:51.253 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T02:39:51.254 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T02:39:51.254 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T02:39:51.254 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T02:39:51.254 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T02:39:51.254 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T02:39:51.254 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T02:39:51.254 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T02:39:51.254 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T02:39:51.254 INFO:teuthology.orchestra.run.smithi137.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T02:39:51.254 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T02:39:51.254 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T02:39:51.254 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T02:39:51.255 INFO:teuthology.orchestra.run.smithi137.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T02:39:51.255 INFO:teuthology.orchestra.run.smithi137.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T02:39:51.255 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T02:39:51.255 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T02:39:51.255 INFO:teuthology.orchestra.run.smithi137.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T02:39:51.255 INFO:teuthology.orchestra.run.smithi137.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T02:39:51.255 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T02:39:51.255 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T02:39:51.255 INFO:teuthology.orchestra.run.smithi137.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T02:39:51.255 INFO:teuthology.orchestra.run.smithi137.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T02:39:51.255 INFO:teuthology.orchestra.run.smithi137.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T02:39:51.255 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T02:39:51.255 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T02:39:51.256 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T02:39:51.256 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T02:39:51.256 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T02:39:51.256 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T02:39:51.256 INFO:teuthology.orchestra.run.smithi137.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T02:39:51.256 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T02:39:51.256 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T02:39:51.256 INFO:teuthology.orchestra.run.smithi137.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T02:39:51.256 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T02:39:51.256 INFO:teuthology.orchestra.run.smithi137.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T02:39:51.256 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T02:39:51.256 INFO:teuthology.orchestra.run.smithi137.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T02:39:51.256 INFO:teuthology.orchestra.run.smithi137.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T02:39:51.257 INFO:teuthology.orchestra.run.smithi137.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T02:39:51.257 INFO:teuthology.orchestra.run.smithi137.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T02:39:51.257 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T02:39:51.257 INFO:teuthology.orchestra.run.smithi137.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T02:39:51.257 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T02:39:51.257 INFO:teuthology.orchestra.run.smithi137.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T02:39:51.257 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T02:39:51.257 INFO:teuthology.orchestra.run.smithi137.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T02:39:51.257 INFO:teuthology.orchestra.run.smithi137.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T02:39:51.257 INFO:teuthology.orchestra.run.smithi137.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T02:39:51.257 INFO:teuthology.orchestra.run.smithi137.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T02:39:51.257 INFO:teuthology.orchestra.run.smithi137.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T02:39:51.257 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T02:39:51.258 INFO:teuthology.orchestra.run.smithi137.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T02:39:51.258 INFO:teuthology.orchestra.run.smithi137.stdout:Installing weak dependencies: 2024-09-12T02:39:51.258 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T02:39:51.258 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:39:51.258 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-09-12T02:39:51.258 INFO:teuthology.orchestra.run.smithi137.stdout:====================================================================================== 2024-09-12T02:39:51.258 INFO:teuthology.orchestra.run.smithi137.stdout:Install 148 Packages 2024-09-12T02:39:51.258 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrade 8 Packages 2024-09-12T02:39:51.258 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:39:51.258 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 226 M 2024-09-12T02:39:51.259 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-09-12T02:39:51.820 INFO:teuthology.orchestra.run.smithi137.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 45 kB/s | 6.5 kB 00:00 2024-09-12T02:39:51.995 INFO:teuthology.orchestra.run.smithi137.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 5.0 MB/s | 897 kB 00:00 2024-09-12T02:39:52.057 INFO:teuthology.orchestra.run.smithi112.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:39:52.058 INFO:teuthology.orchestra.run.smithi112.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:39:52.062 INFO:teuthology.orchestra.run.smithi137.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 2.1 MB/s | 145 kB 00:00 2024-09-12T02:39:52.069 INFO:teuthology.orchestra.run.smithi112.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T02:39:52.070 INFO:teuthology.orchestra.run.smithi112.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T02:39:52.071 INFO:teuthology.orchestra.run.smithi112.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T02:39:52.072 INFO:teuthology.orchestra.run.smithi112.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T02:39:52.074 INFO:teuthology.orchestra.run.smithi112.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T02:39:52.076 INFO:teuthology.orchestra.run.smithi112.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T02:39:52.077 INFO:teuthology.orchestra.run.smithi112.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T02:39:52.142 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-12T02:39:52.168 INFO:teuthology.orchestra.run.smithi112.stdout:====================================================================================== 2024-09-12T02:39:52.168 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-12T02:39:52.168 INFO:teuthology.orchestra.run.smithi112.stdout:====================================================================================== 2024-09-12T02:39:52.168 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-12T02:39:52.168 INFO:teuthology.orchestra.run.smithi112.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T02:39:52.168 INFO:teuthology.orchestra.run.smithi112.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T02:39:52.168 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T02:39:52.168 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T02:39:52.168 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T02:39:52.169 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T02:39:52.169 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T02:39:52.169 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T02:39:52.169 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T02:39:52.169 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T02:39:52.169 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T02:39:52.169 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T02:39:52.169 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T02:39:52.169 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T02:39:52.169 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T02:39:52.169 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T02:39:52.169 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T02:39:52.170 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T02:39:52.170 INFO:teuthology.orchestra.run.smithi112.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T02:39:52.170 INFO:teuthology.orchestra.run.smithi112.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T02:39:52.170 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T02:39:52.170 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T02:39:52.170 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T02:39:52.170 INFO:teuthology.orchestra.run.smithi112.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T02:39:52.170 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T02:39:52.170 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T02:39:52.170 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T02:39:52.170 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T02:39:52.170 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T02:39:52.170 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T02:39:52.171 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T02:39:52.171 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T02:39:52.171 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T02:39:52.171 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T02:39:52.171 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T02:39:52.171 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T02:39:52.171 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T02:39:52.171 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrading: 2024-09-12T02:39:52.171 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T02:39:52.171 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T02:39:52.171 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T02:39:52.171 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T02:39:52.171 INFO:teuthology.orchestra.run.smithi112.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T02:39:52.172 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T02:39:52.172 INFO:teuthology.orchestra.run.smithi112.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T02:39:52.172 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T02:39:52.172 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-12T02:39:52.172 INFO:teuthology.orchestra.run.smithi112.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T02:39:52.172 INFO:teuthology.orchestra.run.smithi112.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T02:39:52.172 INFO:teuthology.orchestra.run.smithi112.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T02:39:52.172 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T02:39:52.172 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T02:39:52.172 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T02:39:52.172 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T02:39:52.172 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T02:39:52.173 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T02:39:52.173 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T02:39:52.173 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T02:39:52.173 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T02:39:52.173 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T02:39:52.173 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T02:39:52.173 INFO:teuthology.orchestra.run.smithi112.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T02:39:52.173 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T02:39:52.173 INFO:teuthology.orchestra.run.smithi112.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T02:39:52.173 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T02:39:52.173 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T02:39:52.173 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T02:39:52.173 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T02:39:52.174 INFO:teuthology.orchestra.run.smithi112.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T02:39:52.174 INFO:teuthology.orchestra.run.smithi112.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T02:39:52.174 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T02:39:52.174 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T02:39:52.174 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T02:39:52.174 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T02:39:52.174 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T02:39:52.174 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T02:39:52.174 INFO:teuthology.orchestra.run.smithi112.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T02:39:52.174 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T02:39:52.174 INFO:teuthology.orchestra.run.smithi112.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T02:39:52.174 INFO:teuthology.orchestra.run.smithi112.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T02:39:52.174 INFO:teuthology.orchestra.run.smithi112.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T02:39:52.174 INFO:teuthology.orchestra.run.smithi112.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T02:39:52.175 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T02:39:52.175 INFO:teuthology.orchestra.run.smithi112.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T02:39:52.175 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T02:39:52.175 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T02:39:52.175 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T02:39:52.175 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T02:39:52.175 INFO:teuthology.orchestra.run.smithi112.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T02:39:52.175 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T02:39:52.175 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T02:39:52.175 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T02:39:52.175 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T02:39:52.175 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T02:39:52.175 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T02:39:52.176 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T02:39:52.176 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T02:39:52.176 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T02:39:52.176 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T02:39:52.176 INFO:teuthology.orchestra.run.smithi112.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T02:39:52.176 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T02:39:52.176 INFO:teuthology.orchestra.run.smithi112.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T02:39:52.176 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T02:39:52.176 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T02:39:52.176 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T02:39:52.176 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T02:39:52.176 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T02:39:52.176 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T02:39:52.177 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T02:39:52.177 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T02:39:52.177 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T02:39:52.177 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T02:39:52.177 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T02:39:52.177 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T02:39:52.177 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T02:39:52.177 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T02:39:52.177 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T02:39:52.177 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T02:39:52.177 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T02:39:52.177 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T02:39:52.177 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T02:39:52.178 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T02:39:52.178 INFO:teuthology.orchestra.run.smithi112.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T02:39:52.178 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T02:39:52.178 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T02:39:52.178 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T02:39:52.178 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T02:39:52.178 INFO:teuthology.orchestra.run.smithi112.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T02:39:52.178 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T02:39:52.178 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T02:39:52.178 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T02:39:52.178 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T02:39:52.178 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T02:39:52.178 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T02:39:52.178 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T02:39:52.179 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T02:39:52.179 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T02:39:52.179 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T02:39:52.179 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T02:39:52.179 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T02:39:52.179 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T02:39:52.179 INFO:teuthology.orchestra.run.smithi112.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T02:39:52.179 INFO:teuthology.orchestra.run.smithi112.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T02:39:52.179 INFO:teuthology.orchestra.run.smithi112.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T02:39:52.179 INFO:teuthology.orchestra.run.smithi112.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T02:39:52.179 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T02:39:52.179 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T02:39:52.179 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T02:39:52.179 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T02:39:52.180 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T02:39:52.180 INFO:teuthology.orchestra.run.smithi112.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T02:39:52.180 INFO:teuthology.orchestra.run.smithi112.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T02:39:52.180 INFO:teuthology.orchestra.run.smithi112.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T02:39:52.180 INFO:teuthology.orchestra.run.smithi112.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T02:39:52.180 INFO:teuthology.orchestra.run.smithi112.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T02:39:52.180 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T02:39:52.180 INFO:teuthology.orchestra.run.smithi112.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T02:39:52.180 INFO:teuthology.orchestra.run.smithi112.stdout:Installing weak dependencies: 2024-09-12T02:39:52.180 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T02:39:52.180 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:39:52.180 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-12T02:39:52.180 INFO:teuthology.orchestra.run.smithi112.stdout:====================================================================================== 2024-09-12T02:39:52.181 INFO:teuthology.orchestra.run.smithi112.stdout:Install 148 Packages 2024-09-12T02:39:52.181 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrade 8 Packages 2024-09-12T02:39:52.181 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:39:52.184 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 226 M 2024-09-12T02:39:52.184 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-12T02:39:52.196 INFO:teuthology.orchestra.run.smithi137.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 10 MB/s | 5.4 MB 00:00 2024-09-12T02:39:52.321 INFO:teuthology.orchestra.run.smithi137.stdout:(5/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 12 MB/s | 1.5 MB 00:00 2024-09-12T02:39:52.388 INFO:teuthology.orchestra.run.smithi137.stdout:(6/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 7.3 MB/s | 2.4 MB 00:00 2024-09-12T02:39:52.638 INFO:teuthology.orchestra.run.smithi137.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 15 MB/s | 4.7 MB 00:00 2024-09-12T02:39:52.696 INFO:teuthology.orchestra.run.smithi112.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 35 kB/s | 6.5 kB 00:00 2024-09-12T02:39:52.904 INFO:teuthology.orchestra.run.smithi112.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 4.2 MB/s | 897 kB 00:00 2024-09-12T02:39:52.947 INFO:teuthology.orchestra.run.smithi137.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 17 MB/s | 21 MB 00:01 2024-09-12T02:39:52.979 INFO:teuthology.orchestra.run.smithi112.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.9 MB/s | 145 kB 00:00 2024-09-12T02:39:53.013 INFO:teuthology.orchestra.run.smithi137.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 380 kB/s | 25 kB 00:00 2024-09-12T02:39:53.338 INFO:teuthology.orchestra.run.smithi112.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 6.5 MB/s | 5.4 MB 00:00 2024-09-12T02:39:53.380 INFO:teuthology.orchestra.run.smithi137.stdout:(10/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 14 MB/s | 11 MB 00:00 2024-09-12T02:39:53.397 INFO:teuthology.orchestra.run.smithi112.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 5.7 MB/s | 2.4 MB 00:00 2024-09-12T02:39:53.439 INFO:teuthology.orchestra.run.smithi137.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.8 MB/s | 228 kB 00:00 2024-09-12T02:39:53.523 INFO:teuthology.orchestra.run.smithi137.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 324 kB/s | 27 kB 00:00 2024-09-12T02:39:53.564 INFO:teuthology.orchestra.run.smithi112.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 6.8 MB/s | 1.5 MB 00:00 2024-09-12T02:39:53.598 INFO:teuthology.orchestra.run.smithi137.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 424 kB/s | 32 kB 00:00 2024-09-12T02:39:53.757 INFO:teuthology.orchestra.run.smithi137.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 4.6 MB/s | 752 kB 00:00 2024-09-12T02:39:53.840 INFO:teuthology.orchestra.run.smithi137.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 1.9 MB/s | 163 kB 00:00 2024-09-12T02:39:53.964 INFO:teuthology.orchestra.run.smithi112.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 8.3 MB/s | 4.7 MB 00:00 2024-09-12T02:39:54.057 INFO:teuthology.orchestra.run.smithi137.stdout:(16/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 10 MB/s | 17 MB 00:01 2024-09-12T02:39:54.107 INFO:teuthology.orchestra.run.smithi137.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 474 kB/s | 127 kB 00:00 2024-09-12T02:39:54.166 INFO:teuthology.orchestra.run.smithi137.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 4.6 MB/s | 506 kB 00:00 2024-09-12T02:39:54.241 INFO:teuthology.orchestra.run.smithi137.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 603 kB/s | 45 kB 00:00 2024-09-12T02:39:54.317 INFO:teuthology.orchestra.run.smithi137.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.8 MB/s | 136 kB 00:00 2024-09-12T02:39:54.400 INFO:teuthology.orchestra.run.smithi137.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.9 MB/s | 162 kB 00:00 2024-09-12T02:39:54.467 INFO:teuthology.orchestra.run.smithi137.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 4.7 MB/s | 321 kB 00:00 2024-09-12T02:39:54.543 INFO:teuthology.orchestra.run.smithi137.stdout:(23/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 3.9 MB/s | 301 kB 00:00 2024-09-12T02:39:54.601 INFO:teuthology.orchestra.run.smithi137.stdout:(24/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.7 MB/s | 100 kB 00:00 2024-09-12T02:39:54.631 INFO:teuthology.orchestra.run.smithi112.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 10 MB/s | 21 MB 00:02 2024-09-12T02:39:54.689 INFO:teuthology.orchestra.run.smithi112.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 435 kB/s | 25 kB 00:00 2024-09-12T02:39:54.702 INFO:teuthology.orchestra.run.smithi137.stdout:(25/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 9.0 MB/s | 5.3 MB 00:00 2024-09-12T02:39:54.727 INFO:teuthology.orchestra.run.smithi137.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 680 kB/s | 85 kB 00:00 2024-09-12T02:39:54.802 INFO:teuthology.orchestra.run.smithi137.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.2 MB/s | 171 kB 00:00 2024-09-12T02:39:54.886 INFO:teuthology.orchestra.run.smithi137.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 383 kB/s | 32 kB 00:00 2024-09-12T02:39:54.953 INFO:teuthology.orchestra.run.smithi137.stdout:(29/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.1 MB/s | 146 kB 00:00 2024-09-12T02:39:55.015 INFO:teuthology.orchestra.run.smithi112.stdout:(10/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 10 MB/s | 11 MB 00:01 2024-09-12T02:39:55.036 INFO:teuthology.orchestra.run.smithi137.stdout:(30/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 9.3 MB/s | 3.1 MB 00:00 2024-09-12T02:39:55.082 INFO:teuthology.orchestra.run.smithi112.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.3 MB/s | 228 kB 00:00 2024-09-12T02:39:55.324 INFO:teuthology.orchestra.run.smithi112.stdout:(12/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 9.6 MB/s | 17 MB 00:01 2024-09-12T02:39:55.328 INFO:teuthology.orchestra.run.smithi137.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 9.5 MB/s | 3.6 MB 00:00 2024-09-12T02:39:55.348 INFO:teuthology.orchestra.run.smithi112.stdout:(13/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 101 kB/s | 27 kB 00:00 2024-09-12T02:39:55.382 INFO:teuthology.orchestra.run.smithi112.stdout:(14/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 548 kB/s | 32 kB 00:00 2024-09-12T02:39:55.404 INFO:teuthology.orchestra.run.smithi137.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 3.2 MB/s | 249 kB 00:00 2024-09-12T02:39:55.449 INFO:teuthology.orchestra.run.smithi112.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.4 MB/s | 163 kB 00:00 2024-09-12T02:39:55.470 INFO:teuthology.orchestra.run.smithi137.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 743 kB/s | 49 kB 00:00 2024-09-12T02:39:55.491 INFO:teuthology.orchestra.run.smithi112.stdout:(16/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 5.2 MB/s | 752 kB 00:00 2024-09-12T02:39:55.516 INFO:teuthology.orchestra.run.smithi112.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.8 MB/s | 127 kB 00:00 2024-09-12T02:39:55.529 INFO:teuthology.orchestra.run.smithi137.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 282 kB/s | 16 kB 00:00 2024-09-12T02:39:55.575 INFO:teuthology.orchestra.run.smithi112.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 5.9 MB/s | 506 kB 00:00 2024-09-12T02:39:55.660 INFO:teuthology.orchestra.run.smithi112.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 543 kB/s | 45 kB 00:00 2024-09-12T02:39:55.671 INFO:teuthology.orchestra.run.smithi137.stdout:(35/156): ceph-mgr-diskprediction-local-19.1.1- 12 MB/s | 7.4 MB 00:00 2024-09-12T02:39:55.696 INFO:teuthology.orchestra.run.smithi137.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 1.7 MB/s | 285 kB 00:00 2024-09-12T02:39:55.717 INFO:teuthology.orchestra.run.smithi112.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 2.3 MB/s | 136 kB 00:00 2024-09-12T02:39:55.755 INFO:teuthology.orchestra.run.smithi137.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 8.9 MB/s | 765 kB 00:00 2024-09-12T02:39:55.772 INFO:teuthology.orchestra.run.smithi137.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 242 kB/s | 18 kB 00:00 2024-09-12T02:39:55.784 INFO:teuthology.orchestra.run.smithi112.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 2.4 MB/s | 162 kB 00:00 2024-09-12T02:39:55.859 INFO:teuthology.orchestra.run.smithi112.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 4.2 MB/s | 321 kB 00:00 2024-09-12T02:39:55.935 INFO:teuthology.orchestra.run.smithi112.stdout:(23/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 3.9 MB/s | 301 kB 00:00 2024-09-12T02:39:56.035 INFO:teuthology.orchestra.run.smithi112.stdout:(24/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 10 MB/s | 5.3 MB 00:00 2024-09-12T02:39:56.060 INFO:teuthology.orchestra.run.smithi112.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 795 kB/s | 100 kB 00:00 2024-09-12T02:39:56.086 INFO:teuthology.orchestra.run.smithi112.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-12T02:39:56.153 INFO:teuthology.orchestra.run.smithi112.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.5 MB/s | 171 kB 00:00 2024-09-12T02:39:56.203 INFO:teuthology.orchestra.run.smithi112.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 639 kB/s | 32 kB 00:00 2024-09-12T02:39:56.286 INFO:teuthology.orchestra.run.smithi112.stdout:(29/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 14 MB/s | 3.1 MB 00:00 2024-09-12T02:39:56.332 INFO:teuthology.orchestra.run.smithi112.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 1.1 MB/s | 146 kB 00:00 2024-09-12T02:39:56.481 INFO:teuthology.orchestra.run.smithi137.stdout:(39/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 14 MB/s | 49 MB 00:03 2024-09-12T02:39:56.506 INFO:teuthology.orchestra.run.smithi137.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 106 kB/s | 80 kB 00:00 2024-09-12T02:39:56.554 INFO:teuthology.orchestra.run.smithi112.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 13 MB/s | 3.6 MB 00:00 2024-09-12T02:39:56.604 INFO:teuthology.orchestra.run.smithi112.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 4.9 MB/s | 249 kB 00:00 2024-09-12T02:39:56.694 INFO:teuthology.orchestra.run.smithi112.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 553 kB/s | 49 kB 00:00 2024-09-12T02:39:56.747 INFO:teuthology.orchestra.run.smithi112.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 314 kB/s | 16 kB 00:00 2024-09-12T02:39:56.881 INFO:teuthology.orchestra.run.smithi137.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 675 kB/s | 253 kB 00:00 2024-09-12T02:39:56.888 INFO:teuthology.orchestra.run.smithi112.stdout:(35/156): ceph-mgr-diskprediction-local-19.1.1- 13 MB/s | 7.4 MB 00:00 2024-09-12T02:39:56.914 INFO:teuthology.orchestra.run.smithi112.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 1.7 MB/s | 285 kB 00:00 2024-09-12T02:39:56.972 INFO:teuthology.orchestra.run.smithi112.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 9.0 MB/s | 765 kB 00:00 2024-09-12T02:39:57.039 INFO:teuthology.orchestra.run.smithi112.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 146 kB/s | 18 kB 00:00 2024-09-12T02:39:57.073 INFO:teuthology.orchestra.run.smithi137.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 323 kB/s | 191 kB 00:00 2024-09-12T02:39:57.123 INFO:teuthology.orchestra.run.smithi137.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 593 kB/s | 801 kB 00:01 2024-09-12T02:39:57.182 INFO:teuthology.orchestra.run.smithi137.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 980 kB/s | 106 kB 00:00 2024-09-12T02:39:57.233 INFO:teuthology.orchestra.run.smithi137.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-09-12T02:39:57.266 INFO:teuthology.orchestra.run.smithi137.stdout:(46/156): python3-cryptography-36.0.1-4.el9.x86 3.2 MB/s | 1.2 MB 00:00 2024-09-12T02:39:57.291 INFO:teuthology.orchestra.run.smithi137.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-09-12T02:39:57.350 INFO:teuthology.orchestra.run.smithi137.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-12T02:39:57.401 INFO:teuthology.orchestra.run.smithi137.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 5.0 MB/s | 689 kB 00:00 2024-09-12T02:39:57.434 INFO:teuthology.orchestra.run.smithi137.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 6.5 MB/s | 943 kB 00:00 2024-09-12T02:39:57.459 INFO:teuthology.orchestra.run.smithi137.stdout:(51/156): boost-program-options-1.75.0-8.el9.x8 983 kB/s | 107 kB 00:00 2024-09-12T02:39:57.485 INFO:teuthology.orchestra.run.smithi137.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 259 kB/s | 22 kB 00:00 2024-09-12T02:39:57.527 INFO:teuthology.orchestra.run.smithi137.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 491 kB/s | 33 kB 00:00 2024-09-12T02:39:57.552 INFO:teuthology.orchestra.run.smithi137.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-12T02:39:57.619 INFO:teuthology.orchestra.run.smithi137.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 198 kB/s | 18 kB 00:00 2024-09-12T02:39:57.644 INFO:teuthology.orchestra.run.smithi137.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 121 kB/s | 11 kB 00:00 2024-09-12T02:39:57.711 INFO:teuthology.orchestra.run.smithi137.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-09-12T02:39:57.736 INFO:teuthology.orchestra.run.smithi137.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 493 kB/s | 45 kB 00:00 2024-09-12T02:39:57.756 INFO:teuthology.orchestra.run.smithi112.stdout:(39/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 16 MB/s | 49 MB 00:03 2024-09-12T02:39:57.761 INFO:teuthology.orchestra.run.smithi137.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2024-09-12T02:39:57.820 INFO:teuthology.orchestra.run.smithi137.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 662 kB 00:00 2024-09-12T02:39:57.846 INFO:teuthology.orchestra.run.smithi137.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 293 kB/s | 24 kB 00:00 2024-09-12T02:39:57.904 INFO:teuthology.orchestra.run.smithi137.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 3.4 MB/s | 581 kB 00:00 2024-09-12T02:39:57.929 INFO:teuthology.orchestra.run.smithi137.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-09-12T02:39:57.971 INFO:teuthology.orchestra.run.smithi137.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-12T02:39:57.996 INFO:teuthology.orchestra.run.smithi137.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 578 kB/s | 38 kB 00:00 2024-09-12T02:39:58.022 INFO:teuthology.orchestra.run.smithi137.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-12T02:39:58.107 INFO:teuthology.orchestra.run.smithi112.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 70 kB/s | 80 kB 00:01 2024-09-12T02:39:58.139 INFO:teuthology.orchestra.run.smithi137.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-12T02:39:58.256 INFO:teuthology.orchestra.run.smithi137.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 7.6 MB/s | 910 kB 00:00 2024-09-12T02:39:58.339 INFO:teuthology.orchestra.run.smithi137.stdout:(69/156): openblas-openmp-0.3.26-2.el9.x86_64.r 13 MB/s | 4.9 MB 00:00 2024-09-12T02:39:58.340 INFO:teuthology.orchestra.run.smithi112.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 616 kB/s | 801 kB 00:01 2024-09-12T02:39:58.406 INFO:teuthology.orchestra.run.smithi137.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-12T02:39:58.431 INFO:teuthology.orchestra.run.smithi137.stdout:(71/156): postgresql-private-libs-13.16-1.el9.x 785 kB/s | 137 kB 00:00 2024-09-12T02:39:58.474 INFO:teuthology.orchestra.run.smithi112.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 267 kB/s | 191 kB 00:00 2024-09-12T02:39:58.498 INFO:teuthology.orchestra.run.smithi137.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-12T02:39:58.540 INFO:teuthology.orchestra.run.smithi137.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 7.5 MB/s | 1.0 MB 00:00 2024-09-12T02:39:58.607 INFO:teuthology.orchestra.run.smithi137.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 921 kB/s | 61 kB 00:00 2024-09-12T02:39:58.816 INFO:teuthology.orchestra.run.smithi137.stdout:(75/156): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2024-09-12T02:39:58.882 INFO:teuthology.orchestra.run.smithi112.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 327 kB/s | 253 kB 00:00 2024-09-12T02:39:58.933 INFO:teuthology.orchestra.run.smithi137.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-09-12T02:39:58.983 INFO:teuthology.orchestra.run.smithi137.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 652 kB/s | 245 kB 00:00 2024-09-12T02:39:59.008 INFO:teuthology.orchestra.run.smithi137.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 341 kB/s | 26 kB 00:00 2024-09-12T02:39:59.050 INFO:teuthology.orchestra.run.smithi137.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 286 kB/s | 19 kB 00:00 2024-09-12T02:39:59.101 INFO:teuthology.orchestra.run.smithi137.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-09-12T02:39:59.126 INFO:teuthology.orchestra.run.smithi137.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 462 kB/s | 35 kB 00:00 2024-09-12T02:39:59.199 INFO:teuthology.orchestra.run.smithi112.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 147 kB/s | 106 kB 00:00 2024-09-12T02:39:59.283 INFO:teuthology.orchestra.run.smithi112.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 1.3 MB/s | 1.2 MB 00:00 2024-09-12T02:39:59.301 INFO:teuthology.orchestra.run.smithi137.stdout:(82/156): postgresql-server-13.16-1.el9.x86_64. 6.0 MB/s | 5.8 MB 00:00 2024-09-12T02:39:59.360 INFO:teuthology.orchestra.run.smithi137.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.0 MB/s | 250 kB 00:00 2024-09-12T02:39:59.427 INFO:teuthology.orchestra.run.smithi137.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.7 MB/s | 222 kB 00:00 2024-09-12T02:39:59.452 INFO:teuthology.orchestra.run.smithi137.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 842 kB/s | 77 kB 00:00 2024-09-12T02:39:59.502 INFO:teuthology.orchestra.run.smithi137.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 564 kB/s | 42 kB 00:00 2024-09-12T02:39:59.553 INFO:teuthology.orchestra.run.smithi137.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-09-12T02:39:59.608 INFO:teuthology.orchestra.run.smithi112.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 186 kB/s | 135 kB 00:00 2024-09-12T02:39:59.720 INFO:teuthology.orchestra.run.smithi137.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 733 kB/s | 159 kB 00:00 2024-09-12T02:39:59.795 INFO:teuthology.orchestra.run.smithi137.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.1 MB/s | 279 kB 00:00 2024-09-12T02:39:59.820 INFO:teuthology.orchestra.run.smithi137.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 510 kB/s | 51 kB 00:00 2024-09-12T02:39:59.833 INFO:teuthology.orchestra.run.smithi112.stdout:(47/156): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 689 kB 00:00 2024-09-12T02:39:59.870 INFO:teuthology.orchestra.run.smithi137.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 718 kB/s | 54 kB 00:00 2024-09-12T02:39:59.933 INFO:teuthology.orchestra.run.smithi112.stdout:(48/156): python3-requests-2.25.1-8.el9.noarch. 170 kB/s | 125 kB 00:00 2024-09-12T02:39:59.938 INFO:teuthology.orchestra.run.smithi137.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 625 kB/s | 42 kB 00:00 2024-09-12T02:40:00.025 INFO:teuthology.orchestra.run.smithi112.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 4.8 MB/s | 943 kB 00:00 2024-09-12T02:40:00.051 INFO:teuthology.orchestra.run.smithi112.stdout:(50/156): python3-urllib3-1.26.5-6.el9.noarch.r 280 kB/s | 215 kB 00:00 2024-09-12T02:40:00.054 INFO:teuthology.orchestra.run.smithi137.stdout:(93/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.3 MB/s | 5.1 MB 00:00 2024-09-12T02:40:00.076 INFO:teuthology.orchestra.run.smithi112.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 434 kB/s | 22 kB 00:00 2024-09-12T02:40:00.080 INFO:teuthology.orchestra.run.smithi137.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 312 kB/s | 44 kB 00:00 2024-09-12T02:40:00.143 INFO:teuthology.orchestra.run.smithi112.stdout:(52/156): boost-program-options-1.75.0-8.el9.x8 512 kB/s | 107 kB 00:00 2024-09-12T02:40:00.155 INFO:teuthology.orchestra.run.smithi137.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.2 MB/s | 221 kB 00:00 2024-09-12T02:40:00.168 INFO:teuthology.orchestra.run.smithi112.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 357 kB/s | 33 kB 00:00 2024-09-12T02:40:00.210 INFO:teuthology.orchestra.run.smithi112.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 440 kB/s | 18 kB 00:00 2024-09-12T02:40:00.222 INFO:teuthology.orchestra.run.smithi137.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 717 kB/s | 47 kB 00:00 2024-09-12T02:40:00.236 INFO:teuthology.orchestra.run.smithi112.stdout:(55/156): flex-2.6.4-9.el9.x86_64.rpm 1.7 MB/s | 313 kB 00:00 2024-09-12T02:40:00.261 INFO:teuthology.orchestra.run.smithi112.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-09-12T02:40:00.294 INFO:teuthology.orchestra.run.smithi112.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-09-12T02:40:00.320 INFO:teuthology.orchestra.run.smithi112.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-09-12T02:40:00.330 INFO:teuthology.orchestra.run.smithi137.stdout:(97/156): qatlib-service-24.02.0-1.el9.x86_64.r 143 kB/s | 36 kB 00:00 2024-09-12T02:40:00.356 INFO:teuthology.orchestra.run.smithi137.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.2 MB/s | 304 kB 00:00 2024-09-12T02:40:00.370 INFO:teuthology.orchestra.run.smithi112.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-09-12T02:40:00.404 INFO:teuthology.orchestra.run.smithi112.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 741 kB/s | 24 kB 00:00 2024-09-12T02:40:00.414 INFO:teuthology.orchestra.run.smithi137.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 694 kB/s | 58 kB 00:00 2024-09-12T02:40:00.437 INFO:teuthology.orchestra.run.smithi112.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-12T02:40:00.439 INFO:teuthology.orchestra.run.smithi137.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-09-12T02:40:00.506 INFO:teuthology.orchestra.run.smithi137.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 694 kB/s | 64 kB 00:00 2024-09-12T02:40:00.532 INFO:teuthology.orchestra.run.smithi137.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 488 kB/s | 45 kB 00:00 2024-09-12T02:40:00.537 INFO:teuthology.orchestra.run.smithi112.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 2.6 MB/s | 581 kB 00:00 2024-09-12T02:40:00.563 INFO:teuthology.orchestra.run.smithi112.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-12T02:40:00.596 INFO:teuthology.orchestra.run.smithi112.stdout:(64/156): openblas-0.3.26-2.el9.x86_64.rpm 1.1 MB/s | 38 kB 00:00 2024-09-12T02:40:00.622 INFO:teuthology.orchestra.run.smithi112.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-12T02:40:00.632 INFO:teuthology.orchestra.run.smithi137.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 178 kB/s | 22 kB 00:00 2024-09-12T02:40:00.691 INFO:teuthology.orchestra.run.smithi137.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-12T02:40:00.733 INFO:teuthology.orchestra.run.smithi137.stdout:(105/156): protobuf-compiler-3.14.0-13.el9.x86_ 4.2 MB/s | 863 kB 00:00 2024-09-12T02:40:00.767 INFO:teuthology.orchestra.run.smithi137.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 4.0 MB/s | 309 kB 00:00 2024-09-12T02:40:00.817 INFO:teuthology.orchestra.run.smithi137.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 231 kB/s | 19 kB 00:00 2024-09-12T02:40:00.843 INFO:teuthology.orchestra.run.smithi137.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T02:40:00.868 INFO:teuthology.orchestra.run.smithi137.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T02:40:00.880 INFO:teuthology.orchestra.run.smithi112.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.1 MB/s | 3.0 MB 00:00 2024-09-12T02:40:00.893 INFO:teuthology.orchestra.run.smithi137.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T02:40:00.919 INFO:teuthology.orchestra.run.smithi137.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-12T02:40:00.969 INFO:teuthology.orchestra.run.smithi137.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-12T02:40:01.020 INFO:teuthology.orchestra.run.smithi137.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-12T02:40:01.068 INFO:teuthology.orchestra.run.smithi137.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 910 kB/s | 43 kB 00:00 2024-09-12T02:40:01.096 INFO:teuthology.orchestra.run.smithi137.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.2 MB/s | 32 kB 00:00 2024-09-12T02:40:01.160 INFO:teuthology.orchestra.run.smithi137.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 859 kB/s | 14 kB 00:00 2024-09-12T02:40:01.160 INFO:teuthology.orchestra.run.smithi137.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 5.0 MB/s | 172 kB 00:00 2024-09-12T02:40:01.338 INFO:teuthology.orchestra.run.smithi137.stdout:(118/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-12T02:40:01.372 INFO:teuthology.orchestra.run.smithi112.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 3.2 MB/s | 1.6 MB 00:00 2024-09-12T02:40:01.380 INFO:teuthology.orchestra.run.smithi137.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 1.5 MB/s | 358 kB 00:00 2024-09-12T02:40:01.464 INFO:teuthology.orchestra.run.smithi137.stdout:(120/156): libarrow-9.0.0-11.el9.x86_64.rpm 6.4 MB/s | 4.4 MB 00:00 2024-09-12T02:40:01.488 INFO:teuthology.orchestra.run.smithi137.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 2.0 MB/s | 220 kB 00:00 2024-09-12T02:40:01.514 INFO:teuthology.orchestra.run.smithi137.stdout:(122/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.7 MB/s | 303 kB 00:00 2024-09-12T02:40:01.531 INFO:teuthology.orchestra.run.smithi112.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 5.6 MB/s | 910 kB 00:00 2024-09-12T02:40:01.547 INFO:teuthology.orchestra.run.smithi137.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-09-12T02:40:01.572 INFO:teuthology.orchestra.run.smithi137.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 183 kB/s | 11 kB 00:00 2024-09-12T02:40:01.598 INFO:teuthology.orchestra.run.smithi137.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-12T02:40:01.631 INFO:teuthology.orchestra.run.smithi112.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.3 MB/s | 137 kB 00:00 2024-09-12T02:40:01.653 INFO:teuthology.orchestra.run.smithi137.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 287 kB/s | 23 kB 00:00 2024-09-12T02:40:01.698 INFO:teuthology.orchestra.run.smithi137.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 194 kB/s | 19 kB 00:00 2024-09-12T02:40:01.732 INFO:teuthology.orchestra.run.smithi137.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 251 kB/s | 20 kB 00:00 2024-09-12T02:40:01.757 INFO:teuthology.orchestra.run.smithi137.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T02:40:01.783 INFO:teuthology.orchestra.run.smithi137.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T02:40:01.808 INFO:teuthology.orchestra.run.smithi137.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T02:40:01.842 INFO:teuthology.orchestra.run.smithi137.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.1 MB/s | 272 kB 00:00 2024-09-12T02:40:01.867 INFO:teuthology.orchestra.run.smithi137.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-12T02:40:01.892 INFO:teuthology.orchestra.run.smithi137.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-12T02:40:01.926 INFO:teuthology.orchestra.run.smithi137.stdout:(135/156): python3-kubernetes-26.1.0-2.el9.noar 4.5 MB/s | 1.0 MB 00:00 2024-09-12T02:40:01.940 INFO:teuthology.orchestra.run.smithi112.stdout:(70/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.7 MB/s | 4.9 MB 00:01 2024-09-12T02:40:01.951 INFO:teuthology.orchestra.run.smithi137.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 482 kB/s | 28 kB 00:00 2024-09-12T02:40:01.976 INFO:teuthology.orchestra.run.smithi137.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-12T02:40:02.002 INFO:teuthology.orchestra.run.smithi137.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T02:40:02.027 INFO:teuthology.orchestra.run.smithi137.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-12T02:40:02.052 INFO:teuthology.orchestra.run.smithi137.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-12T02:40:02.078 INFO:teuthology.orchestra.run.smithi137.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-12T02:40:02.095 INFO:teuthology.orchestra.run.smithi137.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 5.3 MB/s | 90 kB 00:00 2024-09-12T02:40:02.120 INFO:teuthology.orchestra.run.smithi137.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.3 MB/s | 230 kB 00:00 2024-09-12T02:40:02.148 INFO:teuthology.orchestra.run.smithi112.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.9 MB/s | 4.4 MB 00:01 2024-09-12T02:40:02.170 INFO:teuthology.orchestra.run.smithi137.stdout:(144/156): python3-grpcio-1.46.7-10.el9.x86_64. 2.9 MB/s | 2.0 MB 00:00 2024-09-12T02:40:02.215 INFO:teuthology.orchestra.run.smithi137.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 212 kB/s | 20 kB 00:00 2024-09-12T02:40:02.223 INFO:teuthology.orchestra.run.smithi112.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-09-12T02:40:02.246 INFO:teuthology.orchestra.run.smithi137.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-12T02:40:02.279 INFO:teuthology.orchestra.run.smithi137.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.3 MB/s | 427 kB 00:00 2024-09-12T02:40:02.330 INFO:teuthology.orchestra.run.smithi137.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-12T02:40:02.332 INFO:teuthology.orchestra.run.smithi112.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 2.6 MB/s | 1.0 MB 00:00 2024-09-12T02:40:02.374 INFO:teuthology.orchestra.run.smithi112.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-12T02:40:02.458 INFO:teuthology.orchestra.run.smithi112.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-12T02:40:02.522 INFO:teuthology.orchestra.run.smithi137.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-12T02:40:02.566 INFO:teuthology.orchestra.run.smithi112.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.2 MB/s | 248 kB 00:00 2024-09-12T02:40:02.589 INFO:teuthology.orchestra.run.smithi137.stdout:(150/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 10 MB/s | 3.2 MB 00:00 2024-09-12T02:40:02.608 INFO:teuthology.orchestra.run.smithi112.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 617 kB/s | 26 kB 00:00 2024-09-12T02:40:02.642 INFO:teuthology.orchestra.run.smithi112.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 579 kB/s | 19 kB 00:00 2024-09-12T02:40:02.717 INFO:teuthology.orchestra.run.smithi112.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.3 MB/s | 172 kB 00:00 2024-09-12T02:40:02.751 INFO:teuthology.orchestra.run.smithi112.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 1.0 MB/s | 35 kB 00:00 2024-09-12T02:40:02.881 INFO:teuthology.orchestra.run.smithi137.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 140 kB/s | 41 kB 00:00 2024-09-12T02:40:02.943 INFO:teuthology.orchestra.run.smithi112.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 4.4 MB/s | 5.8 MB 00:01 2024-09-12T02:40:02.985 INFO:teuthology.orchestra.run.smithi112.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-09-12T02:40:03.026 INFO:teuthology.orchestra.run.smithi112.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 5.2 MB/s | 222 kB 00:00 2024-09-12T02:40:03.069 INFO:teuthology.orchestra.run.smithi112.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-09-12T02:40:03.110 INFO:teuthology.orchestra.run.smithi112.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-12T02:40:03.160 INFO:teuthology.orchestra.run.smithi112.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-12T02:40:03.235 INFO:teuthology.orchestra.run.smithi112.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-12T02:40:03.264 INFO:teuthology.orchestra.run.smithi137.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 649 kB/s | 249 kB 00:00 2024-09-12T02:40:03.277 INFO:teuthology.orchestra.run.smithi112.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 6.6 MB/s | 279 kB 00:00 2024-09-12T02:40:03.310 INFO:teuthology.orchestra.run.smithi112.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.5 MB/s | 51 kB 00:00 2024-09-12T02:40:03.344 INFO:teuthology.orchestra.run.smithi112.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-09-12T02:40:03.378 INFO:teuthology.orchestra.run.smithi137.stdout:(153/156): NetworkManager-1.49.90-1.el9.x86_64. 2.2 MB/s | 2.3 MB 00:01 2024-09-12T02:40:03.565 INFO:teuthology.orchestra.run.smithi137.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 1.7 MB/s | 1.8 MB 00:01 2024-09-12T02:40:03.703 INFO:teuthology.orchestra.run.smithi112.stdout:(91/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 45 MB/s | 16 MB 00:00 2024-09-12T02:40:03.745 INFO:teuthology.orchestra.run.smithi112.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-12T02:40:03.779 INFO:teuthology.orchestra.run.smithi112.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-09-12T02:40:03.829 INFO:teuthology.orchestra.run.smithi112.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-12T02:40:03.849 INFO:teuthology.orchestra.run.smithi137.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 2.3 MB/s | 1.4 MB 00:00 2024-09-12T02:40:03.863 INFO:teuthology.orchestra.run.smithi112.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 1.1 MB/s | 36 kB 00:00 2024-09-12T02:40:03.925 INFO:teuthology.orchestra.run.smithi112.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 771 kB/s | 47 kB 00:00 2024-09-12T02:40:03.980 INFO:teuthology.orchestra.run.smithi112.stdout:(97/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.4 MB/s | 304 kB 00:00 2024-09-12T02:40:04.013 INFO:teuthology.orchestra.run.smithi112.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.7 MB/s | 58 kB 00:00 2024-09-12T02:40:04.055 INFO:teuthology.orchestra.run.smithi112.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 2.3 MB/s | 96 kB 00:00 2024-09-12T02:40:04.089 INFO:teuthology.orchestra.run.smithi112.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 64 kB 00:00 2024-09-12T02:40:04.122 INFO:teuthology.orchestra.run.smithi112.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-09-12T02:40:04.206 INFO:teuthology.orchestra.run.smithi112.stdout:(102/156): python3-babel-2.9.1-2.el9.noarch.rpm 3.0 MB/s | 6.0 MB 00:01 2024-09-12T02:40:04.323 INFO:teuthology.orchestra.run.smithi112.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 111 kB/s | 22 kB 00:00 2024-09-12T02:40:04.382 INFO:teuthology.orchestra.run.smithi112.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-12T02:40:04.415 INFO:teuthology.orchestra.run.smithi112.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-12T02:40:04.432 INFO:teuthology.orchestra.run.smithi137.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.3 MB/s | 2.4 MB 00:01 2024-09-12T02:40:04.439 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:40:04.439 INFO:teuthology.orchestra.run.smithi137.stdout:Total 17 MB/s | 226 MB 00:13 2024-09-12T02:40:04.441 INFO:teuthology.orchestra.run.smithi112.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 784 kB/s | 19 kB 00:00 2024-09-12T02:40:04.558 INFO:teuthology.orchestra.run.smithi112.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-12T02:40:04.625 INFO:teuthology.orchestra.run.smithi112.stdout:(108/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.0 MB/s | 863 kB 00:00 2024-09-12T02:40:04.650 INFO:teuthology.orchestra.run.smithi112.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 283 kB/s | 26 kB 00:00 2024-09-12T02:40:04.684 INFO:teuthology.orchestra.run.smithi112.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.9 MB/s | 67 kB 00:00 2024-09-12T02:40:04.717 INFO:teuthology.orchestra.run.smithi112.stdout:(111/156): liboath-2.6.7-2.el9.x86_64.rpm 528 kB/s | 49 kB 00:00 2024-09-12T02:40:04.743 INFO:teuthology.orchestra.run.smithi112.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.6 MB/s | 151 kB 00:00 2024-09-12T02:40:04.793 INFO:teuthology.orchestra.run.smithi112.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-12T02:40:04.818 INFO:teuthology.orchestra.run.smithi112.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 7.2 MB/s | 548 kB 00:00 2024-09-12T02:40:04.843 INFO:teuthology.orchestra.run.smithi112.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 870 kB/s | 43 kB 00:00 2024-09-12T02:40:04.868 INFO:teuthology.orchestra.run.smithi112.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-09-12T02:40:04.885 INFO:teuthology.orchestra.run.smithi112.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 338 kB/s | 14 kB 00:00 2024-09-12T02:40:04.976 INFO:teuthology.orchestra.run.smithi112.stdout:(118/156): python3-numpy-1.20.1-5.el9.x86_64.rp 2.3 MB/s | 5.1 MB 00:02 2024-09-12T02:40:05.003 INFO:teuthology.orchestra.run.smithi112.stdout:(119/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2024-09-12T02:40:05.053 INFO:teuthology.orchestra.run.smithi112.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 2.1 MB/s | 358 kB 00:00 2024-09-12T02:40:05.087 INFO:teuthology.orchestra.run.smithi112.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 2.9 MB/s | 220 kB 00:00 2024-09-12T02:40:05.120 INFO:teuthology.orchestra.run.smithi112.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-12T02:40:05.154 INFO:teuthology.orchestra.run.smithi112.stdout:(123/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.7 MB/s | 303 kB 00:00 2024-09-12T02:40:05.171 INFO:teuthology.orchestra.run.smithi112.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-12T02:40:05.188 INFO:teuthology.orchestra.run.smithi112.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 531 kB/s | 18 kB 00:00 2024-09-12T02:40:05.205 INFO:teuthology.orchestra.run.smithi112.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 699 kB/s | 23 kB 00:00 2024-09-12T02:40:05.221 INFO:teuthology.orchestra.run.smithi112.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 586 kB/s | 19 kB 00:00 2024-09-12T02:40:05.337 INFO:teuthology.orchestra.run.smithi112.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 149 kB/s | 20 kB 00:00 2024-09-12T02:40:05.364 INFO:teuthology.orchestra.run.smithi112.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.7 MB/s | 46 kB 00:00 2024-09-12T02:40:05.389 INFO:teuthology.orchestra.run.smithi112.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T02:40:05.415 INFO:teuthology.orchestra.run.smithi112.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T02:40:05.448 INFO:teuthology.orchestra.run.smithi112.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-12T02:40:05.473 INFO:teuthology.orchestra.run.smithi112.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 666 kB/s | 16 kB 00:00 2024-09-12T02:40:05.499 INFO:teuthology.orchestra.run.smithi112.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-12T02:40:05.524 INFO:teuthology.orchestra.run.smithi112.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-12T02:40:05.549 INFO:teuthology.orchestra.run.smithi112.stdout:(136/156): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-12T02:40:05.583 INFO:teuthology.orchestra.run.smithi112.stdout:(137/156): python3-kubernetes-26.1.0-2.el9.noar 2.8 MB/s | 1.0 MB 00:00 2024-09-12T02:40:05.608 INFO:teuthology.orchestra.run.smithi112.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T02:40:05.633 INFO:teuthology.orchestra.run.smithi112.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-09-12T02:40:05.690 INFO:teuthology.orchestra.run.smithi112.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 441 kB/s | 36 kB 00:00 2024-09-12T02:40:05.718 INFO:teuthology.orchestra.run.smithi112.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 891 kB/s | 74 kB 00:00 2024-09-12T02:40:05.742 INFO:teuthology.orchestra.run.smithi112.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.6 MB/s | 90 kB 00:00 2024-09-12T02:40:05.793 INFO:teuthology.orchestra.run.smithi112.stdout:(143/156): python3-grpcio-1.46.7-10.el9.x86_64. 2.8 MB/s | 2.0 MB 00:00 2024-09-12T02:40:05.826 INFO:teuthology.orchestra.run.smithi112.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-09-12T02:40:05.852 INFO:teuthology.orchestra.run.smithi112.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 342 kB/s | 20 kB 00:00 2024-09-12T02:40:05.894 INFO:teuthology.orchestra.run.smithi112.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-12T02:40:05.927 INFO:teuthology.orchestra.run.smithi112.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.3 MB/s | 427 kB 00:00 2024-09-12T02:40:05.986 INFO:teuthology.orchestra.run.smithi112.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-12T02:40:06.186 INFO:teuthology.orchestra.run.smithi112.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-12T02:40:06.237 INFO:teuthology.orchestra.run.smithi112.stdout:(150/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 10 MB/s | 3.2 MB 00:00 2024-09-12T02:40:06.501 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-09-12T02:40:06.684 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-09-12T02:40:06.684 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-09-12T02:40:06.840 INFO:teuthology.orchestra.run.smithi112.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 68 kB/s | 41 kB 00:00 2024-09-12T02:40:07.088 INFO:teuthology.orchestra.run.smithi112.stdout:(152/156): NetworkManager-1.49.90-1.el9.x86_64. 2.1 MB/s | 2.3 MB 00:01 2024-09-12T02:40:07.163 INFO:teuthology.orchestra.run.smithi112.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 1.8 MB/s | 1.8 MB 00:00 2024-09-12T02:40:07.655 INFO:teuthology.orchestra.run.smithi112.stdout:(154/156): NetworkManager-tui-1.49.90-1.el9.x86 306 kB/s | 249 kB 00:00 2024-09-12T02:40:08.124 INFO:teuthology.orchestra.run.smithi112.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 1.3 MB/s | 1.4 MB 00:01 2024-09-12T02:40:08.197 INFO:teuthology.orchestra.run.smithi112.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.3 MB/s | 2.4 MB 00:01 2024-09-12T02:40:08.202 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:40:08.203 INFO:teuthology.orchestra.run.smithi112.stdout:Total 14 MB/s | 226 MB 00:16 2024-09-12T02:40:09.109 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-09-12T02:40:09.109 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-09-12T02:40:10.306 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-12T02:40:10.490 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-12T02:40:10.490 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-12T02:40:12.824 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-12T02:40:12.824 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-12T02:40:16.049 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-09-12T02:40:16.195 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T02:40:16.466 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T02:40:16.562 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T02:40:16.627 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T02:40:16.663 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T02:40:16.720 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T02:40:17.087 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T02:40:17.208 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:40:17.359 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:40:17.389 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:40:17.535 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:40:17.569 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:40:17.775 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T02:40:17.849 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T02:40:17.877 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:40:18.004 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:40:18.036 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:40:18.110 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:40:18.137 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:40:18.181 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:40:18.406 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:40:18.627 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:40:18.799 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T02:40:18.942 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:40:19.053 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:40:19.326 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:40:19.458 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T02:40:19.595 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T02:40:19.643 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T02:40:19.687 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T02:40:19.709 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-12T02:40:19.769 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T02:40:19.823 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T02:40:19.862 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T02:40:19.869 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T02:40:19.917 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T02:40:19.921 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T02:40:19.964 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T02:40:19.985 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T02:40:19.997 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T02:40:20.029 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T02:40:20.069 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T02:40:20.084 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T02:40:20.133 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T02:40:20.149 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T02:40:20.193 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T02:40:20.239 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T02:40:20.320 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T02:40:20.355 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T02:40:20.399 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T02:40:20.426 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T02:40:20.507 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T02:40:20.517 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T02:40:20.571 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T02:40:20.628 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:40:20.662 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T02:40:20.757 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:40:20.787 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:40:20.832 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T02:40:20.899 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T02:40:20.900 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:40:20.943 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:40:21.151 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T02:40:21.214 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T02:40:21.266 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:40:21.426 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:40:21.451 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:40:21.517 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:40:21.534 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T02:40:21.543 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:40:21.583 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:40:21.641 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T02:40:21.850 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T02:40:21.896 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T02:40:21.935 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T02:40:21.971 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:40:21.988 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T02:40:22.170 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:40:22.185 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T02:40:22.266 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T02:40:22.334 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T02:40:22.358 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T02:40:22.444 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T02:40:22.483 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T02:40:22.492 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:40:22.520 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T02:40:22.578 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T02:40:22.619 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T02:40:22.634 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:40:22.664 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T02:40:22.714 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T02:40:22.885 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T02:40:22.916 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:40:22.956 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T02:40:23.007 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T02:40:23.065 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T02:40:23.124 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T02:40:23.165 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T02:40:23.177 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T02:40:23.206 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T02:40:23.231 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T02:40:23.237 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T02:40:23.270 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T02:40:23.277 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T02:40:23.359 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T02:40:23.404 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T02:40:23.430 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T02:40:23.468 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T02:40:23.522 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T02:40:23.561 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T02:40:23.562 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T02:40:23.595 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T02:40:23.611 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T02:40:23.657 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T02:40:23.683 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T02:40:23.693 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T02:40:23.739 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T02:40:23.771 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T02:40:23.779 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T02:40:23.807 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T02:40:23.816 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T02:40:23.851 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T02:40:23.853 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T02:40:23.893 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T02:40:23.934 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T02:40:23.935 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T02:40:23.968 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T02:40:23.969 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T02:40:24.013 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T02:40:24.067 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T02:40:24.070 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T02:40:24.135 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T02:40:24.157 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T02:40:24.172 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T02:40:24.251 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T02:40:24.293 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T02:40:24.342 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T02:40:24.359 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T02:40:24.539 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T02:40:24.604 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T02:40:25.245 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T02:40:25.248 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T02:40:25.304 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T02:40:25.337 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T02:40:25.451 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T02:40:25.496 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T02:40:25.511 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T02:40:25.544 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T02:40:25.565 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T02:40:25.587 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T02:40:25.626 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T02:40:25.662 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T02:40:25.679 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T02:40:25.706 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T02:40:25.870 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T02:40:25.941 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T02:40:25.962 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T02:40:25.969 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T02:40:26.039 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T02:40:26.064 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T02:40:26.124 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T02:40:26.171 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T02:40:26.208 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T02:40:26.266 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T02:40:26.307 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T02:40:26.353 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T02:40:26.403 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T02:40:26.573 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T02:40:26.619 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T02:40:26.662 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T02:40:26.779 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T02:40:26.853 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T02:40:26.865 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T02:40:26.895 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T02:40:26.932 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T02:40:26.957 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T02:40:27.016 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T02:40:27.080 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T02:40:27.265 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T02:40:27.306 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T02:40:27.343 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T02:40:27.386 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T02:40:27.435 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T02:40:27.507 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T02:40:27.545 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T02:40:27.579 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T02:40:27.612 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T02:40:27.656 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T02:40:27.688 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T02:40:27.787 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T02:40:27.869 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T02:40:27.909 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T02:40:28.030 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T02:40:28.088 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T02:40:28.571 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T02:40:28.666 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T02:40:28.721 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T02:40:28.760 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T02:40:28.969 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T02:40:29.032 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T02:40:29.074 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T02:40:29.104 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T02:40:29.147 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:40:29.194 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T02:40:29.258 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:40:29.272 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T02:40:29.312 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T02:40:29.326 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T02:40:29.360 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T02:40:29.422 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T02:40:29.459 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T02:40:29.693 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T02:40:29.722 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T02:40:29.817 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T02:40:29.909 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T02:40:29.943 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:40:30.025 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:40:30.053 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T02:40:30.631 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T02:40:30.778 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T02:40:32.328 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T02:40:32.437 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T02:40:32.473 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T02:40:32.506 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T02:40:32.617 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:40:32.658 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:40:32.840 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T02:40:32.884 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:40:33.037 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:40:33.073 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T02:40:33.128 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T02:40:33.287 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:40:33.348 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:40:33.505 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:40:33.505 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T02:40:33.505 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T02:40:33.506 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:40:33.556 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:40:33.650 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T02:40:33.837 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:40:33.953 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:40:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T02:40:36.711 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:40:36.784 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:40:37.415 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:40:37.490 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:40:37.632 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:40:37.632 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T02:40:37.632 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T02:40:37.633 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:40:37.681 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:40:46.386 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:40:46.387 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /sys 2024-09-12T02:40:46.387 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /proc 2024-09-12T02:40:46.387 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /mnt 2024-09-12T02:40:46.387 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /var/tmp 2024-09-12T02:40:46.387 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /home 2024-09-12T02:40:46.387 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /root 2024-09-12T02:40:46.387 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /tmp 2024-09-12T02:40:46.387 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:40:46.583 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:40:46.618 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:40:46.619 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:40:46.619 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T02:40:46.619 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:40:48.262 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:40:48.320 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:40:48.320 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:40:48.320 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T02:40:48.320 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:40:48.320 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:40:48.320 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:40:48.578 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:40:48.629 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:40:48.629 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:40:48.629 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T02:40:48.629 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:40:48.629 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:40:48.629 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:40:49.104 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:40:49.155 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:40:49.155 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:40:49.155 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T02:40:49.155 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:40:49.155 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:40:49.155 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:40:49.288 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T02:40:49.348 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T02:40:49.412 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T02:40:49.639 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T02:40:49.691 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T02:40:49.777 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T02:40:49.895 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T02:40:50.060 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T02:40:50.122 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T02:40:50.181 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T02:40:50.207 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T02:40:50.447 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:40:50.447 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /sys 2024-09-12T02:40:50.447 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /proc 2024-09-12T02:40:50.447 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /mnt 2024-09-12T02:40:50.447 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /var/tmp 2024-09-12T02:40:50.447 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /home 2024-09-12T02:40:50.447 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /root 2024-09-12T02:40:50.447 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /tmp 2024-09-12T02:40:50.447 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:40:50.671 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:40:50.706 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:40:50.707 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:40:50.707 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T02:40:50.707 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:40:51.043 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:40:51.073 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:40:51.114 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T02:40:51.182 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T02:40:51.220 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:40:52.287 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:40:52.345 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:40:52.345 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:40:52.345 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T02:40:52.345 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:40:52.345 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:40:52.345 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:40:52.446 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:40:52.489 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:40:52.596 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:40:52.646 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:40:52.646 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:40:52.646 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T02:40:52.646 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:40:52.646 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:40:52.646 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:40:53.130 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:40:53.180 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:40:53.180 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:40:53.181 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T02:40:53.181 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:40:53.181 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:40:53.181 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:40:53.330 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T02:40:53.398 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T02:40:53.478 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T02:40:53.585 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:40:53.622 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:40:53.704 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T02:40:53.761 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:40:53.798 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T02:40:53.895 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T02:40:53.929 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T02:40:53.958 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:40:54.003 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T02:40:54.009 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:40:54.010 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:40:54.010 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T02:40:54.010 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:40:54.010 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:40:54.010 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:40:54.066 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:40:54.093 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:40:54.170 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T02:40:54.201 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T02:40:54.225 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T02:40:54.281 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T02:40:54.281 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T02:40:54.307 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T02:40:55.078 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:40:55.107 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:40:55.181 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T02:40:55.265 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T02:40:55.281 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T02:40:55.304 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:40:55.342 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:40:55.393 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:40:55.393 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:40:55.393 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T02:40:55.393 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:40:55.393 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:40:55.393 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:40:55.436 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:40:55.486 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:40:55.486 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:40:55.487 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T02:40:55.487 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:40:55.554 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:40:55.605 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:40:55.605 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:40:55.605 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T02:40:55.605 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:40:55.605 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:40:55.605 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:40:55.938 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:40:55.989 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:40:55.989 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:40:55.989 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T02:40:55.989 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:40:55.989 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:40:55.990 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:40:56.516 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:40:56.564 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:40:57.653 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:40:57.698 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:40:57.836 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:40:58.011 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T02:40:58.041 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:40:58.092 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:40:58.093 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:40:58.093 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T02:40:58.093 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:40:58.093 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:40:58.093 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:40:58.159 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:40:58.185 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:40:58.299 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T02:40:58.372 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T02:40:59.372 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T02:40:59.411 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:40:59.461 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:40:59.462 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:40:59.462 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T02:40:59.462 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:40:59.462 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:40:59.462 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:40:59.516 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:40:59.566 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:40:59.566 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:40:59.566 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T02:40:59.566 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:40:59.645 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:40:59.696 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:40:59.696 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:40:59.696 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T02:40:59.696 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:40:59.696 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:40:59.696 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:00.054 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:41:00.105 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:41:00.105 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:41:00.106 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T02:41:00.106 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:41:00.106 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:41:00.106 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:00.976 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T02:41:01.026 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T02:41:01.069 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T02:41:01.124 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T02:41:01.159 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T02:41:01.411 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T02:41:01.455 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T02:41:01.485 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T02:41:01.517 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T02:41:01.561 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T02:41:02.467 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:41:02.517 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:41:02.559 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:41:03.834 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T02:41:03.939 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T02:41:04.028 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T02:41:04.150 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T02:41:04.183 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T02:41:04.219 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T02:41:04.262 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T02:41:04.262 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:41:04.361 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:41:04.361 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:41:04.470 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:41:04.494 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T02:41:04.511 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:41:04.511 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:41:04.747 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:41:04.747 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:41:04.857 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:41:04.929 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:41:05.042 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T02:41:05.093 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T02:41:05.135 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:41:05.135 INFO:teuthology.orchestra.run.smithi137.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-12T02:41:05.135 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:05.161 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T02:41:05.190 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T02:41:05.225 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T02:41:05.457 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T02:41:05.514 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T02:41:05.543 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T02:41:05.575 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T02:41:05.619 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T02:41:06.512 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:41:06.558 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:41:06.600 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:41:07.870 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T02:41:07.980 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T02:41:08.033 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T02:41:08.149 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T02:41:08.182 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T02:41:08.241 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T02:41:08.278 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T02:41:08.278 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:41:08.385 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:41:08.385 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:41:08.494 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:41:08.518 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T02:41:08.535 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:41:08.535 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:41:08.771 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:41:08.771 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:41:08.863 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:41:08.963 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:41:09.173 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:41:09.174 INFO:teuthology.orchestra.run.smithi112.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-12T02:41:09.174 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:10.764 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T02:41:10.764 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T02:41:10.764 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T02:41:10.764 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T02:41:10.764 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T02:41:10.764 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T02:41:10.764 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T02:41:10.765 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:41:10.765 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:41:10.765 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:41:10.765 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T02:41:10.765 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T02:41:10.765 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:41:10.765 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T02:41:10.765 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T02:41:10.765 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T02:41:10.765 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T02:41:10.765 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T02:41:10.765 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T02:41:10.766 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T02:41:10.766 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T02:41:10.766 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T02:41:10.766 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T02:41:10.766 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T02:41:10.766 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T02:41:10.766 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T02:41:10.767 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T02:41:10.767 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T02:41:10.767 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T02:41:10.767 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T02:41:10.767 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T02:41:10.767 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T02:41:10.767 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T02:41:10.768 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T02:41:10.768 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T02:41:10.768 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T02:41:10.768 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T02:41:10.768 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T02:41:10.768 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T02:41:10.768 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T02:41:10.768 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T02:41:10.768 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T02:41:10.769 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T02:41:10.769 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T02:41:10.769 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T02:41:10.769 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T02:41:10.769 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T02:41:10.769 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T02:41:10.769 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T02:41:10.769 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T02:41:10.770 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T02:41:10.770 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T02:41:10.770 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T02:41:10.770 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T02:41:10.770 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T02:41:10.770 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T02:41:10.770 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T02:41:10.770 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T02:41:10.770 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T02:41:10.771 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T02:41:10.771 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T02:41:10.771 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T02:41:10.771 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T02:41:10.771 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T02:41:10.771 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T02:41:10.771 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T02:41:10.771 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T02:41:10.771 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T02:41:10.771 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T02:41:10.771 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T02:41:10.772 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T02:41:10.772 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T02:41:10.772 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T02:41:10.772 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T02:41:10.772 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T02:41:10.772 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T02:41:10.772 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T02:41:10.772 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T02:41:10.772 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T02:41:10.773 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T02:41:10.773 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T02:41:10.773 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T02:41:10.773 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T02:41:10.773 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T02:41:10.773 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T02:41:10.773 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T02:41:10.773 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T02:41:10.773 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T02:41:10.773 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T02:41:10.773 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T02:41:10.774 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T02:41:10.774 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T02:41:10.774 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T02:41:10.774 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T02:41:10.774 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T02:41:10.774 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T02:41:10.774 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T02:41:10.774 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T02:41:10.774 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T02:41:10.774 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T02:41:10.774 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T02:41:10.775 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T02:41:10.775 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T02:41:10.775 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T02:41:10.775 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T02:41:10.775 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T02:41:10.775 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T02:41:10.775 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T02:41:10.775 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T02:41:10.775 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T02:41:10.775 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T02:41:10.776 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T02:41:10.776 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T02:41:10.776 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T02:41:10.776 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T02:41:10.776 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T02:41:10.776 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T02:41:10.776 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T02:41:10.776 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T02:41:10.776 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T02:41:10.777 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T02:41:10.777 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T02:41:10.777 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T02:41:10.777 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T02:41:10.777 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T02:41:10.777 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T02:41:10.777 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T02:41:10.777 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T02:41:10.777 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T02:41:10.777 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T02:41:10.778 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T02:41:10.778 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T02:41:10.778 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T02:41:10.778 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T02:41:10.778 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T02:41:10.778 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T02:41:10.778 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T02:41:10.778 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T02:41:10.778 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T02:41:10.778 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T02:41:10.779 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T02:41:10.779 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T02:41:10.779 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T02:41:10.779 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T02:41:10.779 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T02:41:10.779 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T02:41:10.779 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T02:41:10.779 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T02:41:10.779 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T02:41:10.779 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T02:41:10.779 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T02:41:10.779 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T02:41:10.779 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T02:41:10.780 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T02:41:10.780 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T02:41:10.780 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T02:41:10.780 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T02:41:10.780 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T02:41:10.780 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T02:41:10.780 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T02:41:10.780 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T02:41:10.780 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T02:41:10.780 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T02:41:12.976 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:41:12.976 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:12.977 INFO:teuthology.orchestra.run.smithi137.stdout:Upgraded: 2024-09-12T02:41:12.977 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T02:41:12.977 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T02:41:12.977 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T02:41:12.977 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T02:41:12.977 INFO:teuthology.orchestra.run.smithi137.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.977 INFO:teuthology.orchestra.run.smithi137.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.977 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T02:41:12.977 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T02:41:12.977 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-09-12T02:41:12.977 INFO:teuthology.orchestra.run.smithi137.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T02:41:12.977 INFO:teuthology.orchestra.run.smithi137.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T02:41:12.978 INFO:teuthology.orchestra.run.smithi137.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T02:41:12.978 INFO:teuthology.orchestra.run.smithi137.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T02:41:12.978 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.978 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.978 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.978 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.978 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:41:12.978 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.978 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.978 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.978 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:41:12.978 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:41:12.978 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:41:12.979 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:41:12.979 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:41:12.979 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.979 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.979 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:41:12.979 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.979 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.979 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.979 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:41:12.979 INFO:teuthology.orchestra.run.smithi137.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:41:12.979 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.979 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.979 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:41:12.979 INFO:teuthology.orchestra.run.smithi137.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T02:41:12.980 INFO:teuthology.orchestra.run.smithi137.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T02:41:12.980 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T02:41:12.980 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T02:41:12.980 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T02:41:12.980 INFO:teuthology.orchestra.run.smithi137.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T02:41:12.980 INFO:teuthology.orchestra.run.smithi137.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T02:41:12.980 INFO:teuthology.orchestra.run.smithi137.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T02:41:12.980 INFO:teuthology.orchestra.run.smithi137.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T02:41:12.980 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T02:41:12.980 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T02:41:12.980 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.980 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.980 INFO:teuthology.orchestra.run.smithi137.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.981 INFO:teuthology.orchestra.run.smithi137.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T02:41:12.981 INFO:teuthology.orchestra.run.smithi137.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T02:41:12.981 INFO:teuthology.orchestra.run.smithi137.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T02:41:12.981 INFO:teuthology.orchestra.run.smithi137.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T02:41:12.981 INFO:teuthology.orchestra.run.smithi137.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T02:41:12.981 INFO:teuthology.orchestra.run.smithi137.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.981 INFO:teuthology.orchestra.run.smithi137.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.981 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T02:41:12.981 INFO:teuthology.orchestra.run.smithi137.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.981 INFO:teuthology.orchestra.run.smithi137.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T02:41:12.981 INFO:teuthology.orchestra.run.smithi137.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T02:41:12.981 INFO:teuthology.orchestra.run.smithi137.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T02:41:12.981 INFO:teuthology.orchestra.run.smithi137.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T02:41:12.982 INFO:teuthology.orchestra.run.smithi137.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T02:41:12.982 INFO:teuthology.orchestra.run.smithi137.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T02:41:12.982 INFO:teuthology.orchestra.run.smithi137.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T02:41:12.982 INFO:teuthology.orchestra.run.smithi137.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T02:41:12.982 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T02:41:12.982 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T02:41:12.982 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T02:41:12.982 INFO:teuthology.orchestra.run.smithi137.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T02:41:12.982 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T02:41:12.982 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T02:41:12.982 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T02:41:12.982 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T02:41:12.982 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T02:41:12.982 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T02:41:12.983 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T02:41:12.983 INFO:teuthology.orchestra.run.smithi137.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T02:41:12.983 INFO:teuthology.orchestra.run.smithi137.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T02:41:12.983 INFO:teuthology.orchestra.run.smithi137.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T02:41:12.983 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T02:41:12.983 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.983 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.983 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.983 INFO:teuthology.orchestra.run.smithi137.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T02:41:12.983 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T02:41:12.983 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T02:41:12.983 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T02:41:12.983 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T02:41:12.984 INFO:teuthology.orchestra.run.smithi137.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T02:41:12.984 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T02:41:12.984 INFO:teuthology.orchestra.run.smithi137.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T02:41:12.984 INFO:teuthology.orchestra.run.smithi137.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T02:41:12.984 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T02:41:12.984 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T02:41:12.984 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T02:41:12.984 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T02:41:12.984 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T02:41:12.984 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T02:41:12.984 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T02:41:12.984 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T02:41:12.985 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T02:41:12.985 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T02:41:12.985 INFO:teuthology.orchestra.run.smithi137.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T02:41:12.985 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T02:41:12.985 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T02:41:12.985 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T02:41:12.985 INFO:teuthology.orchestra.run.smithi137.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T02:41:12.985 INFO:teuthology.orchestra.run.smithi137.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T02:41:12.985 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T02:41:12.985 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T02:41:12.985 INFO:teuthology.orchestra.run.smithi137.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T02:41:12.985 INFO:teuthology.orchestra.run.smithi137.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T02:41:12.985 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T02:41:12.986 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T02:41:12.986 INFO:teuthology.orchestra.run.smithi137.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T02:41:12.986 INFO:teuthology.orchestra.run.smithi137.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T02:41:12.986 INFO:teuthology.orchestra.run.smithi137.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T02:41:12.986 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T02:41:12.986 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T02:41:12.986 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T02:41:12.986 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T02:41:12.986 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T02:41:12.986 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T02:41:12.986 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.986 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.986 INFO:teuthology.orchestra.run.smithi137.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T02:41:12.986 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T02:41:12.987 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T02:41:12.987 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.987 INFO:teuthology.orchestra.run.smithi137.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T02:41:12.987 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T02:41:12.987 INFO:teuthology.orchestra.run.smithi137.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T02:41:12.987 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T02:41:12.987 INFO:teuthology.orchestra.run.smithi137.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T02:41:12.987 INFO:teuthology.orchestra.run.smithi137.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T02:41:12.987 INFO:teuthology.orchestra.run.smithi137.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T02:41:12.987 INFO:teuthology.orchestra.run.smithi137.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T02:41:12.987 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T02:41:12.987 INFO:teuthology.orchestra.run.smithi137.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T02:41:12.987 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T02:41:12.987 INFO:teuthology.orchestra.run.smithi137.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T02:41:12.988 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T02:41:12.988 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T02:41:12.988 INFO:teuthology.orchestra.run.smithi137.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T02:41:12.988 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.988 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.988 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:12.988 INFO:teuthology.orchestra.run.smithi137.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T02:41:12.988 INFO:teuthology.orchestra.run.smithi137.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T02:41:12.988 INFO:teuthology.orchestra.run.smithi137.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T02:41:12.988 INFO:teuthology.orchestra.run.smithi137.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T02:41:12.988 INFO:teuthology.orchestra.run.smithi137.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T02:41:12.988 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T02:41:12.989 INFO:teuthology.orchestra.run.smithi137.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T02:41:12.989 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:12.989 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-09-12T02:41:13.628 DEBUG:teuthology.parallel:result is None 2024-09-12T02:41:15.054 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T02:41:15.054 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T02:41:15.054 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T02:41:15.054 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T02:41:15.054 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T02:41:15.054 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T02:41:15.054 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T02:41:15.054 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:41:15.054 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:41:15.054 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:41:15.054 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T02:41:15.055 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T02:41:15.055 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:41:15.055 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T02:41:15.055 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T02:41:15.055 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T02:41:15.055 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T02:41:15.055 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T02:41:15.055 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T02:41:15.055 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T02:41:15.055 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T02:41:15.055 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T02:41:15.055 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T02:41:15.055 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T02:41:15.056 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T02:41:15.067 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T02:41:15.067 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T02:41:15.068 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T02:41:15.068 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T02:41:15.068 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T02:41:15.068 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T02:41:15.068 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T02:41:15.068 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T02:41:15.068 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T02:41:15.068 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T02:41:15.068 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T02:41:15.068 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T02:41:15.068 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T02:41:15.068 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T02:41:15.069 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T02:41:15.069 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T02:41:15.069 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T02:41:15.069 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T02:41:15.069 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T02:41:15.069 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T02:41:15.069 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T02:41:15.069 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T02:41:15.069 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T02:41:15.069 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T02:41:15.069 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T02:41:15.070 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T02:41:15.070 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T02:41:15.070 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T02:41:15.070 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T02:41:15.070 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T02:41:15.070 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T02:41:15.070 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T02:41:15.070 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T02:41:15.070 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T02:41:15.070 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T02:41:15.070 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T02:41:15.071 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T02:41:15.071 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T02:41:15.071 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T02:41:15.071 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T02:41:15.071 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T02:41:15.071 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T02:41:15.071 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T02:41:15.071 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T02:41:15.071 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T02:41:15.071 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T02:41:15.071 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T02:41:15.071 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T02:41:15.071 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T02:41:15.072 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T02:41:15.072 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T02:41:15.072 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T02:41:15.072 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T02:41:15.072 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T02:41:15.072 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T02:41:15.072 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T02:41:15.072 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T02:41:15.072 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T02:41:15.072 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T02:41:15.072 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T02:41:15.072 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T02:41:15.072 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T02:41:15.072 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T02:41:15.073 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T02:41:15.073 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T02:41:15.073 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T02:41:15.073 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T02:41:15.073 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T02:41:15.073 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T02:41:15.073 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T02:41:15.073 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T02:41:15.073 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T02:41:15.073 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T02:41:15.073 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T02:41:15.073 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T02:41:15.073 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T02:41:15.074 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T02:41:15.074 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T02:41:15.074 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T02:41:15.074 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T02:41:15.074 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T02:41:15.074 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T02:41:15.074 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T02:41:15.074 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T02:41:15.074 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T02:41:15.074 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T02:41:15.074 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T02:41:15.074 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T02:41:15.074 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T02:41:15.074 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T02:41:15.075 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T02:41:15.075 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T02:41:15.075 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T02:41:15.075 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T02:41:15.075 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T02:41:15.075 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T02:41:15.075 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T02:41:15.075 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T02:41:15.075 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T02:41:15.075 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T02:41:15.075 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T02:41:15.075 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T02:41:15.075 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T02:41:15.075 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T02:41:15.076 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T02:41:15.076 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T02:41:15.076 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T02:41:15.076 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T02:41:15.076 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T02:41:15.076 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T02:41:15.076 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T02:41:15.076 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T02:41:15.076 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T02:41:15.076 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T02:41:15.076 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T02:41:15.076 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T02:41:15.076 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T02:41:15.077 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T02:41:15.077 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T02:41:15.077 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T02:41:15.077 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T02:41:15.077 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T02:41:15.077 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T02:41:15.077 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T02:41:15.077 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T02:41:15.077 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T02:41:15.077 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T02:41:15.077 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T02:41:15.077 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T02:41:15.077 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T02:41:15.078 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T02:41:15.078 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T02:41:15.078 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T02:41:15.078 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T02:41:15.078 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T02:41:15.078 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T02:41:15.078 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T02:41:15.078 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T02:41:17.395 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:41:17.395 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:17.395 INFO:teuthology.orchestra.run.smithi112.stdout:Upgraded: 2024-09-12T02:41:17.395 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T02:41:17.395 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T02:41:17.395 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T02:41:17.395 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T02:41:17.395 INFO:teuthology.orchestra.run.smithi112.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.396 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.396 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T02:41:17.396 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T02:41:17.396 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-12T02:41:17.396 INFO:teuthology.orchestra.run.smithi112.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T02:41:17.396 INFO:teuthology.orchestra.run.smithi112.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T02:41:17.396 INFO:teuthology.orchestra.run.smithi112.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T02:41:17.396 INFO:teuthology.orchestra.run.smithi112.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T02:41:17.396 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.396 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.396 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.396 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.397 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:41:17.397 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.397 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.397 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.397 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:41:17.397 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:41:17.397 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:41:17.397 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:41:17.397 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:41:17.397 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.398 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.398 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:41:17.398 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.398 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.398 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.398 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:41:17.398 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:41:17.398 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.398 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.398 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:41:17.398 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T02:41:17.398 INFO:teuthology.orchestra.run.smithi112.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T02:41:17.399 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T02:41:17.399 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T02:41:17.399 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T02:41:17.399 INFO:teuthology.orchestra.run.smithi112.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T02:41:17.399 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T02:41:17.399 INFO:teuthology.orchestra.run.smithi112.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T02:41:17.399 INFO:teuthology.orchestra.run.smithi112.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T02:41:17.399 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T02:41:17.399 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T02:41:17.399 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.399 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.399 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.400 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T02:41:17.400 INFO:teuthology.orchestra.run.smithi112.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T02:41:17.400 INFO:teuthology.orchestra.run.smithi112.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T02:41:17.400 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T02:41:17.400 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T02:41:17.400 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.400 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.400 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T02:41:17.400 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.400 INFO:teuthology.orchestra.run.smithi112.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T02:41:17.400 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T02:41:17.400 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T02:41:17.401 INFO:teuthology.orchestra.run.smithi112.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T02:41:17.401 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T02:41:17.401 INFO:teuthology.orchestra.run.smithi112.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T02:41:17.401 INFO:teuthology.orchestra.run.smithi112.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T02:41:17.401 INFO:teuthology.orchestra.run.smithi112.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T02:41:17.401 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T02:41:17.401 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T02:41:17.401 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T02:41:17.401 INFO:teuthology.orchestra.run.smithi112.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T02:41:17.401 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T02:41:17.401 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T02:41:17.401 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T02:41:17.402 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T02:41:17.402 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T02:41:17.402 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T02:41:17.402 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T02:41:17.402 INFO:teuthology.orchestra.run.smithi112.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T02:41:17.402 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T02:41:17.402 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T02:41:17.402 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T02:41:17.402 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.402 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.402 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.402 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T02:41:17.402 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T02:41:17.402 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T02:41:17.403 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T02:41:17.403 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T02:41:17.403 INFO:teuthology.orchestra.run.smithi112.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T02:41:17.403 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T02:41:17.403 INFO:teuthology.orchestra.run.smithi112.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T02:41:17.403 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T02:41:17.403 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T02:41:17.403 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T02:41:17.403 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T02:41:17.403 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T02:41:17.403 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T02:41:17.403 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T02:41:17.403 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T02:41:17.403 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T02:41:17.404 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T02:41:17.404 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T02:41:17.404 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T02:41:17.404 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T02:41:17.404 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T02:41:17.404 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T02:41:17.404 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T02:41:17.404 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T02:41:17.404 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T02:41:17.404 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T02:41:17.404 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T02:41:17.404 INFO:teuthology.orchestra.run.smithi112.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T02:41:17.404 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T02:41:17.405 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T02:41:17.405 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T02:41:17.405 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T02:41:17.405 INFO:teuthology.orchestra.run.smithi112.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T02:41:17.405 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T02:41:17.405 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T02:41:17.405 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T02:41:17.405 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T02:41:17.405 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T02:41:17.405 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T02:41:17.405 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.405 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.405 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T02:41:17.405 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T02:41:17.406 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T02:41:17.406 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.406 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T02:41:17.408 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T02:41:17.408 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T02:41:17.408 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T02:41:17.408 INFO:teuthology.orchestra.run.smithi112.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T02:41:17.408 INFO:teuthology.orchestra.run.smithi112.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T02:41:17.408 INFO:teuthology.orchestra.run.smithi112.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T02:41:17.409 INFO:teuthology.orchestra.run.smithi112.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T02:41:17.409 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T02:41:17.409 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T02:41:17.409 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T02:41:17.409 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T02:41:17.409 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T02:41:17.409 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T02:41:17.409 INFO:teuthology.orchestra.run.smithi112.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T02:41:17.409 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.409 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.409 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:41:17.409 INFO:teuthology.orchestra.run.smithi112.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T02:41:17.409 INFO:teuthology.orchestra.run.smithi112.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T02:41:17.410 INFO:teuthology.orchestra.run.smithi112.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T02:41:17.410 INFO:teuthology.orchestra.run.smithi112.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T02:41:17.410 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T02:41:17.410 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T02:41:17.410 INFO:teuthology.orchestra.run.smithi112.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T02:41:17.410 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:17.410 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-12T02:41:18.071 DEBUG:teuthology.parallel:result is None 2024-09-12T02:41:18.072 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:41:18.214 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T02:41:18.260 INFO:teuthology.orchestra.run.smithi112.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T02:41:18.261 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T02:41:18.261 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T02:41:18.264 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:41:18.409 DEBUG:teuthology.orchestra.run.smithi137:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T02:41:18.459 INFO:teuthology.orchestra.run.smithi137.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T02:41:18.459 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T02:41:18.459 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T02:41:18.461 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T02:41:18.461 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:41:18.461 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T02:41:18.521 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:41:18.521 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T02:41:18.582 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T02:41:18.583 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:41:18.583 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T02:41:18.639 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T02:41:18.736 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:41:18.736 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T02:41:18.793 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T02:41:18.892 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T02:41:18.893 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:41:18.893 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T02:41:18.949 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T02:41:19.048 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:41:19.048 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T02:41:19.103 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T02:41:19.198 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T02:41:19.198 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:41:19.198 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T02:41:19.255 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T02:41:19.350 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:41:19.350 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T02:41:19.405 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T02:41:19.503 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T02:41:19.589 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T02:41:19.589 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 777 /var/log/ceph 2024-09-12T02:41:19.594 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 777 /var/log/ceph 2024-09-12T02:41:19.648 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T02:41:19.648 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T02:41:19.656 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T02:41:19.711 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T02:41:19.711 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T02:41:19.715 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T02:41:19.776 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-12T02:41:19.776 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-12T02:41:19.776 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-12T02:41:19.777 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:41:19.777 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-12T02:41:19.811 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-12T02:41:19.981 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-12T02:41:20.037 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:41:20.037 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-12T02:41:20.072 DEBUG:teuthology.orchestra.run.smithi137:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-12T02:41:20.241 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-12T02:41:20.303 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T02:41:20.303 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T02:41:20.304 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901635', 'branch': 'squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/mds-full}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7901635', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 481, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'sleep_before_teardown': 0, 'subset': '57/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi112.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJXHScXln1VmHjNYlRdhTSOtsNkTO5CU9821bQ9uef9u3tix9zkQLrmAGryPpZA4Ss03aL784xSRTIJ6PKfgRdA=', 'smithi137.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFNvksFVKkFvpVXVDUsqeoyhacP5bLbbZaOvAJzEIjAx7fbq2rUfnijnBskmQoApM8KlSqj0aI69nJOZqvTq9Uo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_full']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_21:24:17', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T02:41:20.305 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T02:41:20.308 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T02:41:20.343 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T02:41:20.384 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T02:41:20.439 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:41:20.439 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T02:41:20.474 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T02:41:20.475 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_1 2024-09-12T02:41:20.549 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T02:41:20.549 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:41:20.549 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 639 Links: 1 2024-09-12T02:41:20.550 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:41:20.550 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:41:20.550 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-12 02:41:09.529081069 +0000 2024-09-12T02:41:20.550 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-12 02:39:04.370714543 +0000 2024-09-12T02:41:20.550 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-12 02:39:04.370714543 +0000 2024-09-12T02:41:20.550 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-12 02:39:04.370714543 +0000 2024-09-12T02:41:20.550 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T02:41:20.642 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-12T02:41:20.642 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-12T02:41:20.642 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.00050385 s, 1.0 MB/s 2024-09-12T02:41:20.644 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T02:41:20.681 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_2 2024-09-12T02:41:20.756 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T02:41:20.756 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:41:20.756 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 658 Links: 1 2024-09-12T02:41:20.756 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:41:20.756 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:41:20.756 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-12 02:41:09.530081043 +0000 2024-09-12T02:41:20.756 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-12 02:39:04.844701722 +0000 2024-09-12T02:41:20.756 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-12 02:39:04.844701722 +0000 2024-09-12T02:41:20.756 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-12 02:39:04.844701722 +0000 2024-09-12T02:41:20.757 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T02:41:20.849 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-12T02:41:20.849 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-12T02:41:20.849 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000263998 s, 1.9 MB/s 2024-09-12T02:41:20.851 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T02:41:20.888 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_3 2024-09-12T02:41:20.963 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T02:41:20.963 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:41:20.963 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 678 Links: 1 2024-09-12T02:41:20.964 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:41:20.964 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:41:20.964 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-12 02:41:09.530081043 +0000 2024-09-12T02:41:20.964 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-12 02:39:05.330688599 +0000 2024-09-12T02:41:20.964 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-12 02:39:05.330688599 +0000 2024-09-12T02:41:20.964 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-12 02:39:05.330688599 +0000 2024-09-12T02:41:20.964 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T02:41:21.055 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-12T02:41:21.056 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-12T02:41:21.056 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000243128 s, 2.1 MB/s 2024-09-12T02:41:21.058 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T02:41:21.095 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_4 2024-09-12T02:41:21.170 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T02:41:21.170 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:41:21.170 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 694 Links: 1 2024-09-12T02:41:21.171 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:41:21.171 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:41:21.171 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-12 02:41:09.531081017 +0000 2024-09-12T02:41:21.171 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-12 02:39:05.823675286 +0000 2024-09-12T02:41:21.171 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-12 02:39:05.823675286 +0000 2024-09-12T02:41:21.171 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-12 02:39:05.823675286 +0000 2024-09-12T02:41:21.171 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T02:41:21.262 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-12T02:41:21.263 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-12T02:41:21.263 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000272059 s, 1.9 MB/s 2024-09-12T02:41:21.265 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T02:41:21.302 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T02:41:21.302 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:41:21.302 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T02:41:21.339 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T02:41:21.339 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_1 2024-09-12T02:41:21.414 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T02:41:21.414 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:41:21.414 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 639 Links: 1 2024-09-12T02:41:21.415 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:41:21.415 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:41:21.415 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-09-12 02:41:05.485588143 +0000 2024-09-12T02:41:21.415 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-09-12 02:39:01.975265360 +0000 2024-09-12T02:41:21.415 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-09-12 02:39:01.975265360 +0000 2024-09-12T02:41:21.415 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-09-12 02:39:01.975265360 +0000 2024-09-12T02:41:21.415 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T02:41:21.507 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-09-12T02:41:21.507 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-09-12T02:41:21.508 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000275873 s, 1.9 MB/s 2024-09-12T02:41:21.510 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T02:41:21.546 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_2 2024-09-12T02:41:21.621 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T02:41:21.622 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:41:21.622 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 657 Links: 1 2024-09-12T02:41:21.622 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:41:21.622 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:41:21.622 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-09-12 02:41:05.486588125 +0000 2024-09-12T02:41:21.622 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-09-12 02:39:02.438257067 +0000 2024-09-12T02:41:21.622 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-09-12 02:39:02.438257067 +0000 2024-09-12T02:41:21.622 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-09-12 02:39:02.438257067 +0000 2024-09-12T02:41:21.623 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T02:41:21.713 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-09-12T02:41:21.713 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-09-12T02:41:21.713 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000271329 s, 1.9 MB/s 2024-09-12T02:41:21.716 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T02:41:21.752 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_3 2024-09-12T02:41:21.828 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T02:41:21.829 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:41:21.829 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 676 Links: 1 2024-09-12T02:41:21.829 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:41:21.829 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:41:21.829 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-09-12 02:41:05.486588125 +0000 2024-09-12T02:41:21.829 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-09-12 02:39:02.918248470 +0000 2024-09-12T02:41:21.829 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-09-12 02:39:02.918248470 +0000 2024-09-12T02:41:21.829 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-09-12 02:39:02.918248470 +0000 2024-09-12T02:41:21.830 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T02:41:21.921 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-09-12T02:41:21.921 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-09-12T02:41:21.921 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000258412 s, 2.0 MB/s 2024-09-12T02:41:21.923 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T02:41:21.960 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_4 2024-09-12T02:41:22.035 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T02:41:22.035 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:41:22.035 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 695 Links: 1 2024-09-12T02:41:22.035 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:41:22.035 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:41:22.035 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-09-12 02:41:05.487588107 +0000 2024-09-12T02:41:22.035 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-09-12 02:39:03.362240517 +0000 2024-09-12T02:41:22.035 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-09-12 02:39:03.362240517 +0000 2024-09-12T02:41:22.036 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-09-12 02:39:03.362240517 +0000 2024-09-12T02:41:22.036 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T02:41:22.128 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-09-12T02:41:22.128 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-09-12T02:41:22.128 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000272704 s, 1.9 MB/s 2024-09-12T02:41:22.130 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T02:41:22.166 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T02:41:22.166 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi137.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T02:41:22.166 INFO:tasks.ceph:Generating config... 2024-09-12T02:41:22.168 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-12T02:41:22.168 INFO:tasks.ceph:[client] debug client = 20 2024-09-12T02:41:22.168 INFO:tasks.ceph:[client] debug ms = 1 2024-09-12T02:41:22.168 INFO:tasks.ceph:[client] pid file = 2024-09-12T02:41:22.168 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-12T02:41:22.168 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-12T02:41:22.168 INFO:tasks.ceph:[client.0] debug client = 20 2024-09-12T02:41:22.168 INFO:tasks.ceph:[client.0] debug objectcacher = 20 2024-09-12T02:41:22.168 INFO:tasks.ceph:[client.0] debug objecter = 20 2024-09-12T02:41:22.168 INFO:tasks.ceph:[client.1] debug client = 20 2024-09-12T02:41:22.168 INFO:tasks.ceph:[client.1] debug objectcacher = 20 2024-09-12T02:41:22.168 INFO:tasks.ceph:[client.1] debug objecter = 20 2024-09-12T02:41:22.169 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-12T02:41:22.169 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-12T02:41:22.169 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-12T02:41:22.169 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-12T02:41:22.169 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-12T02:41:22.169 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-12T02:41:22.169 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-12T02:41:22.169 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-12T02:41:22.169 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-12T02:41:22.169 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-12T02:41:22.169 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-12T02:41:22.169 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-12T02:41:22.169 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T02:41:22.169 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T02:41:22.170 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T02:41:22.170 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T02:41:22.170 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T02:41:22.170 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-12T02:41:22.170 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-12T02:41:22.170 INFO:tasks.ceph:[mon] mon osd backfillfull ratio = 0.6 2024-09-12T02:41:22.170 INFO:tasks.ceph:[mon] mon osd full ratio = 0.7 2024-09-12T02:41:22.170 INFO:tasks.ceph:[mon] mon osd nearfull ratio = 0.6 2024-09-12T02:41:22.170 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-12T02:41:22.170 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T02:41:22.170 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T02:41:22.170 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T02:41:22.170 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T02:41:22.170 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T02:41:22.170 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T02:41:22.171 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T02:41:22.171 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T02:41:22.171 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T02:41:22.171 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T02:41:22.171 INFO:tasks.ceph:[osd] memstore device bytes = 200000000 2024-09-12T02:41:22.171 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T02:41:22.171 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T02:41:22.171 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T02:41:22.171 INFO:tasks.ceph:[osd] osd failsafe full ratio = 1.0 2024-09-12T02:41:22.171 INFO:tasks.ceph:[osd] osd mon report interval = 5 2024-09-12T02:41:22.171 INFO:tasks.ceph:[osd] osd objectstore = memstore 2024-09-12T02:41:22.171 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-12T02:41:22.172 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T02:41:22.172 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T02:41:22.286 INFO:teuthology.orchestra.run.smithi112.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T02:41:22.291 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T02:41:22.376 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T02:41:22.430 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.112'), ('mon.b', '172.21.15.137'), ('mon.c', '[v2:172.21.15.137:3301,v1:172.21.15.137:6790]')] 2024-09-12T02:41:22.431 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.112,172.21.15.137,[v2:172.21.15.137:3301,v1:172.21.15.137:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-12T02:41:22.431 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:41:22.432 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T02:41:22.466 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.112 --add b 172.21.15.137 --addv c '[v2:172.21.15.137:3301,v1:172.21.15.137:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:41:22.581 INFO:teuthology.orchestra.run.smithi112.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:41:22.582 INFO:teuthology.orchestra.run.smithi112.stdout:monmaptool: generated fsid 7c01f3b3-dec2-4449-a33f-f960d7527ea6 2024-09-12T02:41:22.582 INFO:teuthology.orchestra.run.smithi112.stdout:setting min_mon_release = quincy 2024-09-12T02:41:22.582 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 0 2024-09-12T02:41:22.582 INFO:teuthology.orchestra.run.smithi112.stdout:fsid 7c01f3b3-dec2-4449-a33f-f960d7527ea6 2024-09-12T02:41:22.582 INFO:teuthology.orchestra.run.smithi112.stdout:last_changed 2024-09-12T02:41:22.582035+0000 2024-09-12T02:41:22.582 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-12T02:41:22.582035+0000 2024-09-12T02:41:22.582 INFO:teuthology.orchestra.run.smithi112.stdout:min_mon_release 17 (quincy) 2024-09-12T02:41:22.582 INFO:teuthology.orchestra.run.smithi112.stdout:election_strategy: 1 2024-09-12T02:41:22.582 INFO:teuthology.orchestra.run.smithi112.stdout:0: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.a 2024-09-12T02:41:22.582 INFO:teuthology.orchestra.run.smithi112.stdout:1: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.b 2024-09-12T02:41:22.582 INFO:teuthology.orchestra.run.smithi112.stdout:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-09-12T02:41:22.582 INFO:teuthology.orchestra.run.smithi112.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T02:41:22.584 DEBUG:teuthology.orchestra.run.smithi112:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T02:41:22.618 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7c01f3b3-dec2-4449-a33f-f960d7527ea6... 2024-09-12T02:41:22.619 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T02:41:22.663 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T02:41:22.757 INFO:teuthology.orchestra.run.smithi112.stdout:[global] 2024-09-12T02:41:22.757 INFO:teuthology.orchestra.run.smithi112.stdout: chdir = "" 2024-09-12T02:41:22.758 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T02:41:22.758 INFO:teuthology.orchestra.run.smithi112.stdout: auth supported = cephx 2024-09-12T02:41:22.758 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:22.758 INFO:teuthology.orchestra.run.smithi112.stdout: filestore xattr use omap = true 2024-09-12T02:41:22.758 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:22.758 INFO:teuthology.orchestra.run.smithi112.stdout: mon clock drift allowed = 1.000 2024-09-12T02:41:22.758 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:22.758 INFO:teuthology.orchestra.run.smithi112.stdout: osd crush chooseleaf type = 0 2024-09-12T02:41:22.758 INFO:teuthology.orchestra.run.smithi112.stdout: auth debug = true 2024-09-12T02:41:22.758 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:22.758 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on old message = true 2024-09-12T02:41:22.758 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on bug = true 2024-09-12T02:41:22.758 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:22.759 INFO:teuthology.orchestra.run.smithi112.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T02:41:22.759 INFO:teuthology.orchestra.run.smithi112.stdout: mon pg warn max object skew = 0 2024-09-12T02:41:22.759 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:22.759 INFO:teuthology.orchestra.run.smithi112.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T02:41:22.759 INFO:teuthology.orchestra.run.smithi112.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T02:41:22.759 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:22.759 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default size = 2 2024-09-12T02:41:22.759 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:22.759 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow primary affinity = true 2024-09-12T02:41:22.759 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow pg remap = true 2024-09-12T02:41:22.759 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on legacy crush tunables = false 2024-09-12T02:41:22.759 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on crush straw calc version zero = false 2024-09-12T02:41:22.759 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on no sortbitwise = false 2024-09-12T02:41:22.760 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on osd down out interval zero = false 2024-09-12T02:41:22.760 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on too few osds = false 2024-09-12T02:41:22.760 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T02:41:22.760 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T02:41:22.760 INFO:teuthology.orchestra.run.smithi112.stdout: mon_allow_pool_size_one = true 2024-09-12T02:41:22.760 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:22.760 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T02:41:22.760 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:22.760 INFO:teuthology.orchestra.run.smithi112.stdout: osd default data pool replay window = 5 2024-09-12T02:41:22.760 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:22.760 INFO:teuthology.orchestra.run.smithi112.stdout: mon allow pool delete = true 2024-09-12T02:41:22.761 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:22.761 INFO:teuthology.orchestra.run.smithi112.stdout: mon cluster log file level = debug 2024-09-12T02:41:22.761 INFO:teuthology.orchestra.run.smithi112.stdout: debug asserts on shutdown = true 2024-09-12T02:41:22.761 INFO:teuthology.orchestra.run.smithi112.stdout: mon health detail to clog = false 2024-09-12T02:41:22.761 INFO:teuthology.orchestra.run.smithi112.stdout: mon host = "172.21.15.112,172.21.15.137,[v2:172.21.15.137:3301,v1:172.21.15.137:6790]" 2024-09-12T02:41:22.761 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on skipped message = False 2024-09-12T02:41:22.761 INFO:teuthology.orchestra.run.smithi112.stdout: fsid = 7c01f3b3-dec2-4449-a33f-f960d7527ea6 2024-09-12T02:41:22.761 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:22.761 INFO:teuthology.orchestra.run.smithi112.stdout:[osd] 2024-09-12T02:41:22.761 INFO:teuthology.orchestra.run.smithi112.stdout: osd journal size = 100 2024-09-12T02:41:22.761 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:22.761 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub load threshold = 5.0 2024-09-12T02:41:22.762 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub max interval = 600 2024-09-12T02:41:22.762 INFO:teuthology.orchestra.run.smithi112.stdout: osd mclock profile = high_recovery_ops 2024-09-12T02:41:22.762 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:22.762 INFO:teuthology.orchestra.run.smithi112.stdout: osd recover clone overlap = true 2024-09-12T02:41:22.762 INFO:teuthology.orchestra.run.smithi112.stdout: osd recovery max chunk = 1048576 2024-09-12T02:41:22.762 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:22.762 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug shutdown = true 2024-09-12T02:41:22.762 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug op order = true 2024-09-12T02:41:22.762 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug verify stray on activate = true 2024-09-12T02:41:22.762 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug trim objects = true 2024-09-12T02:41:22.762 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:22.762 INFO:teuthology.orchestra.run.smithi112.stdout: osd open classes on start = true 2024-09-12T02:41:22.762 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug pg log writeout = true 2024-09-12T02:41:22.762 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:22.763 INFO:teuthology.orchestra.run.smithi112.stdout: osd deep scrub update digest min age = 30 2024-09-12T02:41:22.763 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:22.763 INFO:teuthology.orchestra.run.smithi112.stdout: osd map max advance = 10 2024-09-12T02:41:22.763 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:22.763 INFO:teuthology.orchestra.run.smithi112.stdout: journal zero on create = true 2024-09-12T02:41:22.763 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:22.763 INFO:teuthology.orchestra.run.smithi112.stdout: filestore ondisk finisher threads = 3 2024-09-12T02:41:22.763 INFO:teuthology.orchestra.run.smithi112.stdout: filestore apply finisher threads = 3 2024-09-12T02:41:22.763 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:22.763 INFO:teuthology.orchestra.run.smithi112.stdout: bdev debug aio = true 2024-09-12T02:41:22.763 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug misdirected ops = true 2024-09-12T02:41:22.763 INFO:teuthology.orchestra.run.smithi112.stdout: bdev async discard = True 2024-09-12T02:41:22.763 INFO:teuthology.orchestra.run.smithi112.stdout: bdev enable discard = True 2024-09-12T02:41:22.763 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore allocator = bitmap 2024-09-12T02:41:22.763 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore block size = 96636764160 2024-09-12T02:41:22.764 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore fsck on mount = True 2024-09-12T02:41:22.764 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluefs = 1/20 2024-09-12T02:41:22.764 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluestore = 1/20 2024-09-12T02:41:22.764 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-12T02:41:22.764 INFO:teuthology.orchestra.run.smithi112.stdout: debug osd = 20 2024-09-12T02:41:22.764 INFO:teuthology.orchestra.run.smithi112.stdout: debug rocksdb = 4/10 2024-09-12T02:41:22.764 INFO:teuthology.orchestra.run.smithi112.stdout: memstore device bytes = 200000000 2024-09-12T02:41:22.764 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T02:41:22.764 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd full ratio = 0.9 2024-09-12T02:41:22.764 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd nearfull ratio = 0.8 2024-09-12T02:41:22.764 INFO:teuthology.orchestra.run.smithi112.stdout: osd failsafe full ratio = 1.0 2024-09-12T02:41:22.764 INFO:teuthology.orchestra.run.smithi112.stdout: osd mon report interval = 5 2024-09-12T02:41:22.764 INFO:teuthology.orchestra.run.smithi112.stdout: osd objectstore = memstore 2024-09-12T02:41:22.765 INFO:teuthology.orchestra.run.smithi112.stdout: osd op complaint time = 180 2024-09-12T02:41:22.765 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:22.765 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr] 2024-09-12T02:41:22.765 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-12T02:41:22.765 INFO:teuthology.orchestra.run.smithi112.stdout: debug mgr = 20 2024-09-12T02:41:22.765 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-09-12T02:41:22.765 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-09-12T02:41:22.765 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-09-12T02:41:22.765 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-09-12T02:41:22.765 INFO:teuthology.orchestra.run.smithi112.stdout: mgr/telemetry/nag = false 2024-09-12T02:41:22.765 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2024-09-12T02:41:22.765 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:22.765 INFO:teuthology.orchestra.run.smithi112.stdout:[mon] 2024-09-12T02:41:22.765 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-12T02:41:22.766 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-09-12T02:41:22.766 INFO:teuthology.orchestra.run.smithi112.stdout: debug paxos = 20 2024-09-12T02:41:22.766 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-09-12T02:41:22.766 INFO:teuthology.orchestra.run.smithi112.stdout: mon data avail warn = 5 2024-09-12T02:41:22.766 INFO:teuthology.orchestra.run.smithi112.stdout: mon mgr mkfs grace = 240 2024-09-12T02:41:22.766 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-09-12T02:41:22.766 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd reporter subtree level = osd 2024-09-12T02:41:22.766 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd prime pg temp = true 2024-09-12T02:41:22.766 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-09-12T02:41:22.766 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:22.766 INFO:teuthology.orchestra.run.smithi112.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T02:41:22.766 INFO:teuthology.orchestra.run.smithi112.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T02:41:22.766 INFO:teuthology.orchestra.run.smithi112.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T02:41:22.766 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:22.767 INFO:teuthology.orchestra.run.smithi112.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T02:41:22.767 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T02:41:22.767 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T02:41:22.767 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:22.767 INFO:teuthology.orchestra.run.smithi112.stdout: # 1m isn't quite enough 2024-09-12T02:41:22.767 INFO:teuthology.orchestra.run.smithi112.stdout: mon_down_mkfs_grace = 2m 2024-09-12T02:41:22.767 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:22.767 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_filestore_osds = false 2024-09-12T02:41:22.767 INFO:teuthology.orchestra.run.smithi112.stdout: mon down mkfs grace = 300 2024-09-12T02:41:22.767 INFO:teuthology.orchestra.run.smithi112.stdout: mon op complaint time = 120 2024-09-12T02:41:22.767 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd backfillfull ratio = 0.6 2024-09-12T02:41:22.767 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd full ratio = 0.7 2024-09-12T02:41:22.767 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd nearfull ratio = 0.6 2024-09-12T02:41:22.767 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on pool no app = False 2024-09-12T02:41:22.768 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:22.768 INFO:teuthology.orchestra.run.smithi112.stdout:[client] 2024-09-12T02:41:22.768 INFO:teuthology.orchestra.run.smithi112.stdout: rgw cache enabled = true 2024-09-12T02:41:22.768 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable ops log = true 2024-09-12T02:41:22.768 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable usage log = true 2024-09-12T02:41:22.768 INFO:teuthology.orchestra.run.smithi112.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T02:41:22.768 INFO:teuthology.orchestra.run.smithi112.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T02:41:22.768 INFO:teuthology.orchestra.run.smithi112.stdout: client mount timeout = 600 2024-09-12T02:41:22.768 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2024-09-12T02:41:22.768 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-12T02:41:22.768 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = "" 2024-09-12T02:41:22.768 INFO:teuthology.orchestra.run.smithi112.stdout: rados mon op timeout = 900 2024-09-12T02:41:22.768 INFO:teuthology.orchestra.run.smithi112.stdout: rados osd op timeout = 900 2024-09-12T02:41:22.769 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.a] 2024-09-12T02:41:22.769 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.b] 2024-09-12T02:41:22.769 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.c] 2024-09-12T02:41:22.769 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2024-09-12T02:41:22.769 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.c] 2024-09-12T02:41:22.769 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.b] 2024-09-12T02:41:22.769 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.d] 2024-09-12T02:41:22.769 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-09-12T02:41:22.769 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2024-09-12T02:41:22.769 INFO:teuthology.orchestra.run.smithi112.stdout: debug objectcacher = 20 2024-09-12T02:41:22.769 INFO:teuthology.orchestra.run.smithi112.stdout: debug objecter = 20 2024-09-12T02:41:22.769 INFO:teuthology.orchestra.run.smithi112.stdout:[client.1] 2024-09-12T02:41:22.769 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2024-09-12T02:41:22.769 INFO:teuthology.orchestra.run.smithi112.stdout: debug objectcacher = 20 2024-09-12T02:41:22.770 INFO:teuthology.orchestra.run.smithi112.stdout: debug objecter = 20 2024-09-12T02:41:22.770 INFO:teuthology.orchestra.run.smithi112.stdout:[mds] 2024-09-12T02:41:22.770 INFO:teuthology.orchestra.run.smithi112.stdout: debug mds = 20 2024-09-12T02:41:22.770 INFO:teuthology.orchestra.run.smithi112.stdout: debug mds balancer = 20 2024-09-12T02:41:22.770 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-12T02:41:22.770 INFO:teuthology.orchestra.run.smithi112.stdout: mds debug frag = True 2024-09-12T02:41:22.770 INFO:teuthology.orchestra.run.smithi112.stdout: mds debug scatterstat = True 2024-09-12T02:41:22.770 INFO:teuthology.orchestra.run.smithi112.stdout: mds op complaint time = 180 2024-09-12T02:41:22.770 INFO:teuthology.orchestra.run.smithi112.stdout: mds verify scatter = True 2024-09-12T02:41:22.770 INFO:teuthology.orchestra.run.smithi112.stdout: osd op complaint time = 180 2024-09-12T02:41:22.770 INFO:teuthology.orchestra.run.smithi112.stdout: rados mon op timeout = 900 2024-09-12T02:41:22.770 INFO:teuthology.orchestra.run.smithi112.stdout: rados osd op timeout = 900 2024-09-12T02:41:22.771 INFO:teuthology.orchestra.run.smithi137.stdout:[global] 2024-09-12T02:41:22.771 INFO:teuthology.orchestra.run.smithi137.stdout: chdir = "" 2024-09-12T02:41:22.771 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T02:41:22.771 INFO:teuthology.orchestra.run.smithi137.stdout: auth supported = cephx 2024-09-12T02:41:22.771 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:22.771 INFO:teuthology.orchestra.run.smithi137.stdout: filestore xattr use omap = true 2024-09-12T02:41:22.771 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:22.771 INFO:teuthology.orchestra.run.smithi137.stdout: mon clock drift allowed = 1.000 2024-09-12T02:41:22.771 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:22.771 INFO:teuthology.orchestra.run.smithi137.stdout: osd crush chooseleaf type = 0 2024-09-12T02:41:22.771 INFO:teuthology.orchestra.run.smithi137.stdout: auth debug = true 2024-09-12T02:41:22.772 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:22.772 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on old message = true 2024-09-12T02:41:22.772 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on bug = true 2024-09-12T02:41:22.772 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:22.772 INFO:teuthology.orchestra.run.smithi137.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T02:41:22.772 INFO:teuthology.orchestra.run.smithi137.stdout: mon pg warn max object skew = 0 2024-09-12T02:41:22.772 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:22.772 INFO:teuthology.orchestra.run.smithi137.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T02:41:22.772 INFO:teuthology.orchestra.run.smithi137.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T02:41:22.772 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:22.772 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default size = 2 2024-09-12T02:41:22.772 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:22.772 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow primary affinity = true 2024-09-12T02:41:22.772 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow pg remap = true 2024-09-12T02:41:22.773 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on legacy crush tunables = false 2024-09-12T02:41:22.773 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on crush straw calc version zero = false 2024-09-12T02:41:22.773 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on no sortbitwise = false 2024-09-12T02:41:22.773 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on osd down out interval zero = false 2024-09-12T02:41:22.773 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on too few osds = false 2024-09-12T02:41:22.773 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T02:41:22.773 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T02:41:22.773 INFO:teuthology.orchestra.run.smithi137.stdout: mon_allow_pool_size_one = true 2024-09-12T02:41:22.773 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:22.773 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T02:41:22.773 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:22.773 INFO:teuthology.orchestra.run.smithi137.stdout: osd default data pool replay window = 5 2024-09-12T02:41:22.773 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:22.774 INFO:teuthology.orchestra.run.smithi137.stdout: mon allow pool delete = true 2024-09-12T02:41:22.774 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:22.774 INFO:teuthology.orchestra.run.smithi137.stdout: mon cluster log file level = debug 2024-09-12T02:41:22.774 INFO:teuthology.orchestra.run.smithi137.stdout: debug asserts on shutdown = true 2024-09-12T02:41:22.774 INFO:teuthology.orchestra.run.smithi137.stdout: mon health detail to clog = false 2024-09-12T02:41:22.774 INFO:teuthology.orchestra.run.smithi137.stdout: mon host = "172.21.15.112,172.21.15.137,[v2:172.21.15.137:3301,v1:172.21.15.137:6790]" 2024-09-12T02:41:22.774 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on skipped message = False 2024-09-12T02:41:22.774 INFO:teuthology.orchestra.run.smithi137.stdout: fsid = 7c01f3b3-dec2-4449-a33f-f960d7527ea6 2024-09-12T02:41:22.774 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:22.774 INFO:teuthology.orchestra.run.smithi137.stdout:[osd] 2024-09-12T02:41:22.774 INFO:teuthology.orchestra.run.smithi137.stdout: osd journal size = 100 2024-09-12T02:41:22.774 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:22.774 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub load threshold = 5.0 2024-09-12T02:41:22.774 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub max interval = 600 2024-09-12T02:41:22.775 INFO:teuthology.orchestra.run.smithi137.stdout: osd mclock profile = high_recovery_ops 2024-09-12T02:41:22.775 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:22.775 INFO:teuthology.orchestra.run.smithi137.stdout: osd recover clone overlap = true 2024-09-12T02:41:22.775 INFO:teuthology.orchestra.run.smithi137.stdout: osd recovery max chunk = 1048576 2024-09-12T02:41:22.775 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:22.775 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug shutdown = true 2024-09-12T02:41:22.775 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug op order = true 2024-09-12T02:41:22.775 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug verify stray on activate = true 2024-09-12T02:41:22.775 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug trim objects = true 2024-09-12T02:41:22.775 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:22.775 INFO:teuthology.orchestra.run.smithi137.stdout: osd open classes on start = true 2024-09-12T02:41:22.775 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug pg log writeout = true 2024-09-12T02:41:22.775 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:22.775 INFO:teuthology.orchestra.run.smithi137.stdout: osd deep scrub update digest min age = 30 2024-09-12T02:41:22.775 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:22.776 INFO:teuthology.orchestra.run.smithi137.stdout: osd map max advance = 10 2024-09-12T02:41:22.776 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:22.776 INFO:teuthology.orchestra.run.smithi137.stdout: journal zero on create = true 2024-09-12T02:41:22.776 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:22.776 INFO:teuthology.orchestra.run.smithi137.stdout: filestore ondisk finisher threads = 3 2024-09-12T02:41:22.776 INFO:teuthology.orchestra.run.smithi137.stdout: filestore apply finisher threads = 3 2024-09-12T02:41:22.776 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:22.776 INFO:teuthology.orchestra.run.smithi137.stdout: bdev debug aio = true 2024-09-12T02:41:22.776 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug misdirected ops = true 2024-09-12T02:41:22.776 INFO:teuthology.orchestra.run.smithi137.stdout: bdev async discard = True 2024-09-12T02:41:22.776 INFO:teuthology.orchestra.run.smithi137.stdout: bdev enable discard = True 2024-09-12T02:41:22.776 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore allocator = bitmap 2024-09-12T02:41:22.776 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore block size = 96636764160 2024-09-12T02:41:22.777 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore fsck on mount = True 2024-09-12T02:41:22.777 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluefs = 1/20 2024-09-12T02:41:22.777 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluestore = 1/20 2024-09-12T02:41:22.777 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-09-12T02:41:22.777 INFO:teuthology.orchestra.run.smithi137.stdout: debug osd = 20 2024-09-12T02:41:22.777 INFO:teuthology.orchestra.run.smithi137.stdout: debug rocksdb = 4/10 2024-09-12T02:41:22.777 INFO:teuthology.orchestra.run.smithi137.stdout: memstore device bytes = 200000000 2024-09-12T02:41:22.777 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T02:41:22.777 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd full ratio = 0.9 2024-09-12T02:41:22.777 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd nearfull ratio = 0.8 2024-09-12T02:41:22.777 INFO:teuthology.orchestra.run.smithi137.stdout: osd failsafe full ratio = 1.0 2024-09-12T02:41:22.777 INFO:teuthology.orchestra.run.smithi137.stdout: osd mon report interval = 5 2024-09-12T02:41:22.777 INFO:teuthology.orchestra.run.smithi137.stdout: osd objectstore = memstore 2024-09-12T02:41:22.777 INFO:teuthology.orchestra.run.smithi137.stdout: osd op complaint time = 180 2024-09-12T02:41:22.778 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:22.778 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr] 2024-09-12T02:41:22.778 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-09-12T02:41:22.778 INFO:teuthology.orchestra.run.smithi137.stdout: debug mgr = 20 2024-09-12T02:41:22.778 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-09-12T02:41:22.778 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-09-12T02:41:22.778 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-09-12T02:41:22.778 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-09-12T02:41:22.778 INFO:teuthology.orchestra.run.smithi137.stdout: mgr/telemetry/nag = false 2024-09-12T02:41:22.778 INFO:teuthology.orchestra.run.smithi137.stdout: debug client = 20 2024-09-12T02:41:22.778 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:22.778 INFO:teuthology.orchestra.run.smithi137.stdout:[mon] 2024-09-12T02:41:22.778 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-09-12T02:41:22.779 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-09-12T02:41:22.779 INFO:teuthology.orchestra.run.smithi137.stdout: debug paxos = 20 2024-09-12T02:41:22.779 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-09-12T02:41:22.779 INFO:teuthology.orchestra.run.smithi137.stdout: mon data avail warn = 5 2024-09-12T02:41:22.779 INFO:teuthology.orchestra.run.smithi137.stdout: mon mgr mkfs grace = 240 2024-09-12T02:41:22.779 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-09-12T02:41:22.779 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd reporter subtree level = osd 2024-09-12T02:41:22.779 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd prime pg temp = true 2024-09-12T02:41:22.779 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-09-12T02:41:22.779 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:22.779 INFO:teuthology.orchestra.run.smithi137.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T02:41:22.779 INFO:teuthology.orchestra.run.smithi137.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T02:41:22.779 INFO:teuthology.orchestra.run.smithi137.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T02:41:22.779 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:22.780 INFO:teuthology.orchestra.run.smithi137.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T02:41:22.780 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T02:41:22.780 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T02:41:22.780 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:22.780 INFO:teuthology.orchestra.run.smithi137.stdout: # 1m isn't quite enough 2024-09-12T02:41:22.780 INFO:teuthology.orchestra.run.smithi137.stdout: mon_down_mkfs_grace = 2m 2024-09-12T02:41:22.780 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:22.780 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_filestore_osds = false 2024-09-12T02:41:22.780 INFO:teuthology.orchestra.run.smithi137.stdout: mon down mkfs grace = 300 2024-09-12T02:41:22.780 INFO:teuthology.orchestra.run.smithi137.stdout: mon op complaint time = 120 2024-09-12T02:41:22.780 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd backfillfull ratio = 0.6 2024-09-12T02:41:22.780 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd full ratio = 0.7 2024-09-12T02:41:22.780 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd nearfull ratio = 0.6 2024-09-12T02:41:22.781 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on pool no app = False 2024-09-12T02:41:22.781 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-12T02:41:22.781 INFO:teuthology.orchestra.run.smithi137.stdout:[client] 2024-09-12T02:41:22.781 INFO:teuthology.orchestra.run.smithi137.stdout: rgw cache enabled = true 2024-09-12T02:41:22.781 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable ops log = true 2024-09-12T02:41:22.781 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable usage log = true 2024-09-12T02:41:22.781 INFO:teuthology.orchestra.run.smithi137.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T02:41:22.781 INFO:teuthology.orchestra.run.smithi137.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T02:41:22.781 INFO:teuthology.orchestra.run.smithi137.stdout: client mount timeout = 600 2024-09-12T02:41:22.781 INFO:teuthology.orchestra.run.smithi137.stdout: debug client = 20 2024-09-12T02:41:22.781 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-09-12T02:41:22.781 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = "" 2024-09-12T02:41:22.781 INFO:teuthology.orchestra.run.smithi137.stdout: rados mon op timeout = 900 2024-09-12T02:41:22.781 INFO:teuthology.orchestra.run.smithi137.stdout: rados osd op timeout = 900 2024-09-12T02:41:22.782 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.a] 2024-09-12T02:41:22.782 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.b] 2024-09-12T02:41:22.782 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.c] 2024-09-12T02:41:22.782 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.a] 2024-09-12T02:41:22.782 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.c] 2024-09-12T02:41:22.782 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.b] 2024-09-12T02:41:22.782 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.d] 2024-09-12T02:41:22.782 INFO:teuthology.orchestra.run.smithi137.stdout:[client.0] 2024-09-12T02:41:22.782 INFO:teuthology.orchestra.run.smithi137.stdout: debug client = 20 2024-09-12T02:41:22.782 INFO:teuthology.orchestra.run.smithi137.stdout: debug objectcacher = 20 2024-09-12T02:41:22.782 INFO:teuthology.orchestra.run.smithi137.stdout: debug objecter = 20 2024-09-12T02:41:22.782 INFO:teuthology.orchestra.run.smithi137.stdout:[client.1] 2024-09-12T02:41:22.782 INFO:teuthology.orchestra.run.smithi137.stdout: debug client = 20 2024-09-12T02:41:22.782 INFO:teuthology.orchestra.run.smithi137.stdout: debug objectcacher = 20 2024-09-12T02:41:22.782 INFO:teuthology.orchestra.run.smithi137.stdout: debug objecter = 20 2024-09-12T02:41:22.782 INFO:teuthology.orchestra.run.smithi137.stdout:[mds] 2024-09-12T02:41:22.783 INFO:teuthology.orchestra.run.smithi137.stdout: debug mds = 20 2024-09-12T02:41:22.783 INFO:teuthology.orchestra.run.smithi137.stdout: debug mds balancer = 20 2024-09-12T02:41:22.783 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-09-12T02:41:22.783 INFO:teuthology.orchestra.run.smithi137.stdout: mds debug frag = True 2024-09-12T02:41:22.783 INFO:teuthology.orchestra.run.smithi137.stdout: mds debug scatterstat = True 2024-09-12T02:41:22.783 INFO:teuthology.orchestra.run.smithi137.stdout: mds op complaint time = 180 2024-09-12T02:41:22.783 INFO:teuthology.orchestra.run.smithi137.stdout: mds verify scatter = True 2024-09-12T02:41:22.783 INFO:teuthology.orchestra.run.smithi137.stdout: osd op complaint time = 180 2024-09-12T02:41:22.783 INFO:teuthology.orchestra.run.smithi137.stdout: rados mon op timeout = 900 2024-09-12T02:41:22.783 INFO:teuthology.orchestra.run.smithi137.stdout: rados osd op timeout = 900 2024-09-12T02:41:22.785 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T02:41:22.785 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T02:41:22.881 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T02:41:22.882 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:41:22.882 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T02:41:22.916 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:41:22.916 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T02:41:22.991 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi112.front.sepia.ceph.com 2024-09-12T02:41:22.991 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:41:22.991 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T02:41:22.991 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T02:41:23.109 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:41:23.109 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:41:23.183 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T02:41:23.183 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:41:23.183 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T02:41:23.183 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T02:41:23.261 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:41:23.261 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:41:23.336 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T02:41:23.336 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T02:41:23.336 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T02:41:23.440 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T02:41:23.446 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T02:41:23.581 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T02:41:23.588 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T02:41:23.589 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T02:41:23.691 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T02:41:23.696 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-12T02:41:23.751 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-12T02:41:23.854 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-12T02:41:23.859 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-12T02:41:23.914 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-12T02:41:24.017 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-12T02:41:24.022 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-12T02:41:24.078 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-12T02:41:24.180 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-12T02:41:24.185 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-12T02:41:24.241 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T02:41:24.241 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T02:41:24.322 INFO:teuthology.orchestra.run.smithi112.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T02:41:24.349 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-12T02:41:24.430 INFO:teuthology.orchestra.run.smithi112.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-12T02:41:24.457 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T02:41:24.538 INFO:teuthology.orchestra.run.smithi137.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T02:41:24.565 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-12T02:41:24.645 INFO:teuthology.orchestra.run.smithi137.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-12T02:41:24.672 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T02:41:24.672 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi137.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T02:41:24.673 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T02:41:24.727 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T02:41:24.728 INFO:tasks.ceph:role: osd.0 2024-09-12T02:41:24.728 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-12T02:41:24.728 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T02:41:24.790 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:41:24.790 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:41:24.790 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:41:24.790 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:41:24.790 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:41:24.790 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:41:24.790 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:41:24.790 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:41:24.790 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:41:24.790 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:41:25.199 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-09-12T02:41:25.203 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-09-12T02:41:25.203 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T02:41:25.351 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T02:41:25.417 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T02:41:25.472 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T02:41:25.472 INFO:tasks.ceph:role: osd.1 2024-09-12T02:41:25.472 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-12T02:41:25.472 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T02:41:25.537 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:41:25.537 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:41:25.537 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:41:25.537 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:41:25.537 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:41:25.537 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:41:25.537 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:41:25.537 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:41:25.538 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:41:25.538 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:41:25.889 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-09-12T02:41:25.893 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-09-12T02:41:25.893 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T02:41:25.979 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T02:41:26.042 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T02:41:26.107 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T02:41:26.107 INFO:tasks.ceph:role: osd.2 2024-09-12T02:41:26.107 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-12T02:41:26.107 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T02:41:26.170 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:41:26.170 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:41:26.170 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:41:26.170 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:41:26.170 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:41:26.170 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:41:26.170 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:41:26.170 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:41:26.170 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:41:26.170 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:41:26.558 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-09-12T02:41:26.562 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-09-12T02:41:26.562 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T02:41:26.657 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T02:41:26.721 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T02:41:26.779 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T02:41:26.779 INFO:tasks.ceph:role: osd.3 2024-09-12T02:41:26.779 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-12T02:41:26.779 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T02:41:26.846 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:41:26.846 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:41:26.846 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:41:26.846 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:41:26.846 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:41:26.846 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:41:26.846 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:41:26.846 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:41:26.846 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:41:26.847 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:41:27.261 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-09-12T02:41:27.265 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-09-12T02:41:27.265 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T02:41:27.397 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T02:41:27.460 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:41:27.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:27.567+0000 7f799fbdd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T02:41:27.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:27.570+0000 7f799fbdd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T02:41:27.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:27.579+0000 7f799fbdd640 -1 memstore(/var/lib/ceph/osd/ceph-0) /var/lib/ceph/osd/ceph-0 2024-09-12T02:41:27.608 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T02:41:27.663 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:41:27.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:27.752+0000 7f4da12e4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T02:41:27.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:27.753+0000 7f4da12e4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T02:41:27.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:27.755+0000 7f4da12e4640 -1 memstore(/var/lib/ceph/osd/ceph-1) /var/lib/ceph/osd/ceph-1 2024-09-12T02:41:27.770 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T02:41:27.825 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:41:27.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:27.914+0000 7f2c3c431640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T02:41:27.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:27.915+0000 7f2c3c431640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T02:41:27.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:27.917+0000 7f2c3c431640 -1 memstore(/var/lib/ceph/osd/ceph-2) /var/lib/ceph/osd/ceph-2 2024-09-12T02:41:27.933 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T02:41:27.989 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:41:28.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:28.078+0000 7ff6bd20e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T02:41:28.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:28.078+0000 7ff6bd20e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T02:41:28.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:28.080+0000 7ff6bd20e640 -1 memstore(/var/lib/ceph/osd/ceph-3) /var/lib/ceph/osd/ceph-3 2024-09-12T02:41:28.094 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T02:41:28.150 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T02:41:28.214 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T02:41:28.215 INFO:tasks.ceph:role: osd.4 2024-09-12T02:41:28.215 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T02:41:28.215 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T02:41:28.300 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:41:28.300 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:41:28.300 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:41:28.300 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:41:28.300 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:41:28.300 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:41:28.300 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:41:28.300 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:41:28.300 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:41:28.300 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:41:28.692 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-09-12T02:41:28.696 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-09-12T02:41:28.696 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T02:41:28.828 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T02:41:28.895 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T02:41:28.952 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T02:41:28.952 INFO:tasks.ceph:role: osd.5 2024-09-12T02:41:28.952 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T02:41:28.952 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T02:41:29.015 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:41:29.015 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:41:29.015 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:41:29.015 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:41:29.015 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:41:29.015 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:41:29.015 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:41:29.015 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:41:29.015 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:41:29.015 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:41:29.371 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-09-12T02:41:29.376 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-09-12T02:41:29.377 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T02:41:29.462 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T02:41:29.524 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T02:41:29.579 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T02:41:29.580 INFO:tasks.ceph:role: osd.6 2024-09-12T02:41:29.580 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T02:41:29.580 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T02:41:29.642 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:41:29.642 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:41:29.642 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:41:29.643 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:41:29.643 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:41:29.643 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:41:29.643 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:41:29.643 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:41:29.643 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:41:29.643 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:41:30.031 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-09-12T02:41:30.034 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-09-12T02:41:30.035 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T02:41:30.135 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T02:41:30.198 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T02:41:30.253 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T02:41:30.253 INFO:tasks.ceph:role: osd.7 2024-09-12T02:41:30.253 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T02:41:30.253 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T02:41:30.315 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:41:30.316 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:41:30.316 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:41:30.316 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:41:30.316 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:41:30.316 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:41:30.316 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:41:30.316 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:41:30.316 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:41:30.316 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:41:30.739 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-09-12T02:41:30.744 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-09-12T02:41:30.744 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T02:41:30.886 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T02:41:30.952 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:41:31.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:31.050+0000 7fa4308a5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T02:41:31.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:31.053+0000 7fa4308a5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T02:41:31.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:31.062+0000 7fa4308a5640 -1 memstore(/var/lib/ceph/osd/ceph-4) /var/lib/ceph/osd/ceph-4 2024-09-12T02:41:31.097 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T02:41:31.152 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:41:31.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:31.243+0000 7f8a276da640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T02:41:31.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:31.246+0000 7f8a276da640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T02:41:31.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:31.252+0000 7f8a276da640 -1 memstore(/var/lib/ceph/osd/ceph-5) /var/lib/ceph/osd/ceph-5 2024-09-12T02:41:31.275 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T02:41:31.331 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:41:31.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:31.420+0000 7f7f613cc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T02:41:31.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:31.420+0000 7f7f613cc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T02:41:31.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:31.422+0000 7f7f613cc640 -1 memstore(/var/lib/ceph/osd/ceph-6) /var/lib/ceph/osd/ceph-6 2024-09-12T02:41:31.439 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T02:41:31.494 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:41:31.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:31.583+0000 7fa9b8a2e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T02:41:31.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:31.584+0000 7fa9b8a2e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T02:41:31.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:31.586+0000 7fa9b8a2e640 -1 memstore(/var/lib/ceph/osd/ceph-7) /var/lib/ceph/osd/ceph-7 2024-09-12T02:41:31.599 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T02:41:31.655 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T02:41:31.655 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:41:31.655 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T02:41:31.718 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:41:31.718 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-12T02:41:31.817 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:41:31.817 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-12T02:41:31.913 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:41:31.913 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T02:41:32.010 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:41:32.010 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T02:41:32.104 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:41:32.105 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T02:41:32.200 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:41:32.200 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T02:41:32.295 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:41:32.296 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T02:41:32.354 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:41:32.354 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-12T02:41:32.450 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:41:32.451 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-12T02:41:32.545 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:41:32.546 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T02:41:32.640 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:41:32.641 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T02:41:32.737 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:41:32.737 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T02:41:32.833 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:41:32.833 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T02:41:32.929 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:41:32.929 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T02:41:32.965 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:41:32.965 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-12T02:41:33.040 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:41:33.040 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T02:41:33.074 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:41:33.075 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-12T02:41:33.149 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T02:41:33.149 DEBUG:teuthology.orchestra.run.smithi112:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T02:41:33.154 DEBUG:teuthology.orchestra.run.smithi137:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T02:41:33.203 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.y] 2024-09-12T02:41:33.203 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDTVOJmcxtNGhAAAXWh1fMrVeFSy2hh3p2Rkw== 2024-09-12T02:41:33.203 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2024-09-12T02:41:33.203 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDTVOJmKE09KRAAtNq70LeeB9ENNxX91m10Fg== 2024-09-12T02:41:33.203 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.c] 2024-09-12T02:41:33.203 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDTVOJmLQXzMhAAhk28JuqKhfbZtvRu9SSVrw== 2024-09-12T02:41:33.204 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.0] 2024-09-12T02:41:33.204 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDXVOJmFXfdIRAA+VpZNU0tEN6vAzR2C7nuLg== 2024-09-12T02:41:33.204 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.1] 2024-09-12T02:41:33.204 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDXVOJmcgHyLBAA/OxfdQ1D+uFzbCnm1dJLxw== 2024-09-12T02:41:33.204 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.2] 2024-09-12T02:41:33.204 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDXVOJm0baUNhAAuInNwHut2Xn0kBmjnJhdqw== 2024-09-12T02:41:33.204 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.3] 2024-09-12T02:41:33.204 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDYVOJmL/O3BBAAZhQ4/70wj/2zEbMcfD4hQA== 2024-09-12T02:41:33.204 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.x] 2024-09-12T02:41:33.204 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDTVOJmftawIhAAAKmfx8khERROoZ8BCLukAw== 2024-09-12T02:41:33.204 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.b] 2024-09-12T02:41:33.205 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDUVOJmMjYTARAAuIrofOOp9Dbrhkt314mhuw== 2024-09-12T02:41:33.205 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.d] 2024-09-12T02:41:33.205 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDUVOJmaE7JChAAKlyynYJnHLs87BXyMC0xgA== 2024-09-12T02:41:33.205 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.4] 2024-09-12T02:41:33.205 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDbVOJmC+sJAxAAUQofpG3g8DlGLQ8wUqtuSg== 2024-09-12T02:41:33.205 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.5] 2024-09-12T02:41:33.205 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDbVOJmY2OSDhAA2rg1HGjWx7G6IzFi6yQ/jQ== 2024-09-12T02:41:33.205 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.6] 2024-09-12T02:41:33.205 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDbVOJmydoaGRAAh/ozKewnY+RxiZ4EcOFA7A== 2024-09-12T02:41:33.205 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.7] 2024-09-12T02:41:33.205 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDbVOJmmB7cIhAAVhtz7OuxYBQgEKGvHdY33g== 2024-09-12T02:41:33.206 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-09-12T02:41:33.206 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDUVOJmaG86ExAAD0SOlJOsLpoQZlgPJIPaxA== 2024-09-12T02:41:33.206 INFO:teuthology.orchestra.run.smithi112.stdout:[client.2] 2024-09-12T02:41:33.206 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDUVOJmcUWtGRAAlV/gS/CDZKHb5bjbmDzjlg== 2024-09-12T02:41:33.206 INFO:teuthology.orchestra.run.smithi112.stdout:[client.1] 2024-09-12T02:41:33.206 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDUVOJmt7AeIBAAGRSEejG29OpANZqtia7KEw== 2024-09-12T02:41:33.206 INFO:teuthology.orchestra.run.smithi112.stdout:[client.3] 2024-09-12T02:41:33.206 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDUVOJm2M97JhAAHKJoPBf6TN6Nu8muK6wzaw== 2024-09-12T02:41:33.241 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr.y] 2024-09-12T02:41:33.241 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDTVOJmcxtNGhAAAXWh1fMrVeFSy2hh3p2Rkw== 2024-09-12T02:41:33.241 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.a] 2024-09-12T02:41:33.241 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDTVOJmKE09KRAAtNq70LeeB9ENNxX91m10Fg== 2024-09-12T02:41:33.242 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.c] 2024-09-12T02:41:33.242 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDTVOJmLQXzMhAAhk28JuqKhfbZtvRu9SSVrw== 2024-09-12T02:41:33.242 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.0] 2024-09-12T02:41:33.242 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDXVOJmFXfdIRAA+VpZNU0tEN6vAzR2C7nuLg== 2024-09-12T02:41:33.242 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.1] 2024-09-12T02:41:33.242 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDXVOJmcgHyLBAA/OxfdQ1D+uFzbCnm1dJLxw== 2024-09-12T02:41:33.242 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.2] 2024-09-12T02:41:33.242 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDXVOJm0baUNhAAuInNwHut2Xn0kBmjnJhdqw== 2024-09-12T02:41:33.242 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.3] 2024-09-12T02:41:33.242 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDYVOJmL/O3BBAAZhQ4/70wj/2zEbMcfD4hQA== 2024-09-12T02:41:33.242 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr.x] 2024-09-12T02:41:33.242 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDTVOJmftawIhAAAKmfx8khERROoZ8BCLukAw== 2024-09-12T02:41:33.243 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.b] 2024-09-12T02:41:33.243 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDUVOJmMjYTARAAuIrofOOp9Dbrhkt314mhuw== 2024-09-12T02:41:33.243 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.d] 2024-09-12T02:41:33.243 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDUVOJmaE7JChAAKlyynYJnHLs87BXyMC0xgA== 2024-09-12T02:41:33.243 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.4] 2024-09-12T02:41:33.243 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDbVOJmC+sJAxAAUQofpG3g8DlGLQ8wUqtuSg== 2024-09-12T02:41:33.243 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.5] 2024-09-12T02:41:33.243 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDbVOJmY2OSDhAA2rg1HGjWx7G6IzFi6yQ/jQ== 2024-09-12T02:41:33.243 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.6] 2024-09-12T02:41:33.243 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDbVOJmydoaGRAAh/ozKewnY+RxiZ4EcOFA7A== 2024-09-12T02:41:33.243 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.7] 2024-09-12T02:41:33.244 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDbVOJmmB7cIhAAVhtz7OuxYBQgEKGvHdY33g== 2024-09-12T02:41:33.244 INFO:teuthology.orchestra.run.smithi137.stdout:[client.0] 2024-09-12T02:41:33.244 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDUVOJmaG86ExAAD0SOlJOsLpoQZlgPJIPaxA== 2024-09-12T02:41:33.244 INFO:teuthology.orchestra.run.smithi137.stdout:[client.2] 2024-09-12T02:41:33.244 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDUVOJmcUWtGRAAlV/gS/CDZKHb5bjbmDzjlg== 2024-09-12T02:41:33.244 INFO:teuthology.orchestra.run.smithi137.stdout:[client.1] 2024-09-12T02:41:33.244 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDUVOJmt7AeIBAAGRSEejG29OpANZqtia7KEw== 2024-09-12T02:41:33.244 INFO:teuthology.orchestra.run.smithi137.stdout:[client.3] 2024-09-12T02:41:33.244 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDUVOJm2M97JhAAHKJoPBf6TN6Nu8muK6wzaw== 2024-09-12T02:41:33.246 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T02:41:33.252 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T02:41:33.379 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:41:33.383 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:41:33.480 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:41:33.484 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:41:33.581 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:41:33.585 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:41:33.679 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:41:33.683 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:41:33.777 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:41:33.781 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:41:33.873 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:41:33.877 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:41:33.970 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T02:41:33.974 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T02:41:34.067 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:41:34.071 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:41:34.167 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:41:34.171 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:41:34.269 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:41:34.273 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:41:34.366 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:41:34.370 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:41:34.462 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:41:34.466 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:41:34.559 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:41:34.563 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:41:34.655 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T02:41:34.659 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T02:41:34.757 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T02:41:34.761 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T02:41:34.857 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T02:41:34.861 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T02:41:34.958 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T02:41:34.961 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T02:41:35.058 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T02:41:35.058 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T02:41:35.114 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T02:41:35.222 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T02:41:35.278 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T02:41:35.333 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T02:41:35.441 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T02:41:35.497 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T02:41:35.552 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T02:41:35.658 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T02:41:35.714 DEBUG:teuthology.orchestra.run.smithi112:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:41:35.718 DEBUG:teuthology.orchestra.run.smithi137:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:41:35.752 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T02:41:35.753 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T02:41:35.753 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T02:41:35.793 INFO:tasks.ceph.mon.a:Started 2024-09-12T02:41:35.793 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T02:41:35.794 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T02:41:35.798 INFO:tasks.ceph.mon.b:Started 2024-09-12T02:41:35.798 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T02:41:35.798 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T02:41:35.802 INFO:tasks.ceph.mon.c:Started 2024-09-12T02:41:35.802 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T02:41:35.802 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T02:41:35.803 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T02:41:35.807 INFO:tasks.ceph.mgr.y:Started 2024-09-12T02:41:35.807 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T02:41:35.807 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T02:41:35.811 INFO:tasks.ceph.mgr.x:Started 2024-09-12T02:41:35.811 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T02:41:35.811 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T02:41:35.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:35.962+0000 7fe0b0000640 1 Processor -- start 2024-09-12T02:41:35.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:35.963+0000 7fe0b0000640 1 -- start start 2024-09-12T02:41:35.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:35.964+0000 7fe0b0000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe0a81626d0 0x7fe0a80b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:35.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:35.964+0000 7fe0b0000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe0a80d2cb0 0x7fe0a80d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:35.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:35.964+0000 7fe0b0000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0a80d3ac0 con 0x7fe0a80b1a40 2024-09-12T02:41:35.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:35.964+0000 7fe0b0000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe0a80d1d00 con 0x7fe0a81626d0 2024-09-12T02:41:35.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:35.964+0000 7fe0b0000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe0a80d1fe0 con 0x7fe0a80d2cb0 2024-09-12T02:41:35.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:35.964+0000 7fe0ae000640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe0a80b1a40 0x7fe0a80b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:56724/0 (socket says 172.21.15.112:56724) 2024-09-12T02:41:35.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:35.964+0000 7fe0ae000640 1 -- 172.21.15.112:0/394508500 learned_addr learned my addr 172.21.15.112:0/394508500 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:41:35.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:35.965+0000 7fe0acc00640 1 --2- 172.21.15.112:0/394508500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe0a80d2cb0 0x7fe0a80d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:35.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:35.965+0000 7fe0ad600640 1 --2- 172.21.15.112:0/394508500 >> v2:172.21.15.137:3300/0 conn(0x7fe0a81626d0 0x7fe0a80b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:35.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:35.965+0000 7fe0acc00640 1 -- 172.21.15.112:0/394508500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe0a80d2cb0 msgr2=0x7fe0a80d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:41:35.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:35.965+0000 7fe0acc00640 1 -- 172.21.15.112:0/394508500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe0a80d2cb0 msgr2=0x7fe0a80d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:41:35.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:35.965+0000 7fe0acc00640 1 --2- 172.21.15.112:0/394508500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe0a80d2cb0 0x7fe0a80d3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:41:35.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:35.965+0000 7fe0acc00640 1 --2- 172.21.15.112:0/394508500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe0a80d2cb0 0x7fe0a80d3110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:41:35.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:35.965+0000 7fe0ad600640 1 -- 172.21.15.112:0/394508500 >> v2:172.21.15.137:3300/0 conn(0x7fe0a81626d0 msgr2=0x7fe0a80b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:41:35.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:35.965+0000 7fe0ad600640 1 -- 172.21.15.112:0/394508500 >> v2:172.21.15.137:3300/0 conn(0x7fe0a81626d0 msgr2=0x7fe0a80b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:41:35.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:35.965+0000 7fe0ad600640 1 --2- 172.21.15.112:0/394508500 >> v2:172.21.15.137:3300/0 conn(0x7fe0a81626d0 0x7fe0a80b3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:41:35.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:35.965+0000 7fe0ad600640 1 --2- 172.21.15.112:0/394508500 >> v2:172.21.15.137:3300/0 conn(0x7fe0a81626d0 0x7fe0a80b3bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:41:36.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.166+0000 7fe0ad600640 1 --2- 172.21.15.112:0/394508500 >> v2:172.21.15.137:3300/0 conn(0x7fe0a81626d0 0x7fe0a80b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:36.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.166+0000 7fe0acc00640 1 --2- 172.21.15.112:0/394508500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe0a80d2cb0 0x7fe0a80d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:36.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.166+0000 7fe0acc00640 1 -- 172.21.15.112:0/394508500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe0a80d2cb0 msgr2=0x7fe0a80d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:41:36.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.166+0000 7fe0acc00640 1 -- 172.21.15.112:0/394508500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe0a80d2cb0 msgr2=0x7fe0a80d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:41:36.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.166+0000 7fe0ad600640 1 -- 172.21.15.112:0/394508500 >> v2:172.21.15.137:3300/0 conn(0x7fe0a81626d0 msgr2=0x7fe0a80b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:41:36.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.166+0000 7fe0acc00640 1 --2- 172.21.15.112:0/394508500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe0a80d2cb0 0x7fe0a80d3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:41:36.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.166+0000 7fe0ad600640 1 -- 172.21.15.112:0/394508500 >> v2:172.21.15.137:3300/0 conn(0x7fe0a81626d0 msgr2=0x7fe0a80b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:41:36.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.166+0000 7fe0ad600640 1 --2- 172.21.15.112:0/394508500 >> v2:172.21.15.137:3300/0 conn(0x7fe0a81626d0 0x7fe0a80b3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:41:36.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.166+0000 7fe0ad600640 1 --2- 172.21.15.112:0/394508500 >> v2:172.21.15.137:3300/0 conn(0x7fe0a81626d0 0x7fe0a80b3bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:41:36.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.166+0000 7fe0acc00640 1 --2- 172.21.15.112:0/394508500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe0a80d2cb0 0x7fe0a80d3110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:41:36.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.179+0000 7fe0a7e00640 1 -- 172.21.15.112:0/394508500 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 867222799 0 0) 0x7fe0a80d3ac0 con 0x7fe0a80b1a40 2024-09-12T02:41:36.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.179+0000 7fe0a7e00640 1 -- 172.21.15.112:0/394508500 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe090003520 con 0x7fe0a80b1a40 2024-09-12T02:41:36.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.180+0000 7fe0a7e00640 1 -- 172.21.15.112:0/394508500 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1907108975 0 0) 0x7fe090003520 con 0x7fe0a80b1a40 2024-09-12T02:41:36.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.180+0000 7fe0a7e00640 1 -- 172.21.15.112:0/394508500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe0a80d2cb0 msgr2=0x7fe0a80d3110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:41:36.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.180+0000 7fe0a7e00640 1 --2- 172.21.15.112:0/394508500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe0a80d2cb0 0x7fe0a80d3110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.180+0000 7fe0a7e00640 1 -- 172.21.15.112:0/394508500 >> v2:172.21.15.137:3300/0 conn(0x7fe0a81626d0 msgr2=0x7fe0a80b3bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:41:36.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.180+0000 7fe0a7e00640 1 --2- 172.21.15.112:0/394508500 >> v2:172.21.15.137:3300/0 conn(0x7fe0a81626d0 0x7fe0a80b3bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.180+0000 7fe0a7e00640 1 -- 172.21.15.112:0/394508500 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a80d22c0 con 0x7fe0a80b1a40 2024-09-12T02:41:36.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.180+0000 7fe0a7e00640 1 -- 172.21.15.112:0/394508500 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7fe0a00019f0 con 0x7fe0a80b1a40 2024-09-12T02:41:36.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.180+0000 7fe0a7e00640 1 -- 172.21.15.112:0/394508500 >> v1:172.21.15.112:6789/0 conn(0x7fe0a80b1a40 legacy=0x7fe0a80b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:36.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.180+0000 7fe0a7e00640 1 --2- 172.21.15.112:0/394508500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0900039b0 0x7fe090003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:36.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.180+0000 7fe0a7e00640 1 --2- 172.21.15.112:0/394508500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe0a80d2cb0 0x7fe090004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:36.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.180+0000 7fe0a7e00640 1 --2- 172.21.15.112:0/394508500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe090004d40 0x7fe0900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:36.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.180+0000 7fe0a7e00640 1 -- 172.21.15.112:0/394508500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a80d1d00 con 0x7fe0900039b0 2024-09-12T02:41:36.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.180+0000 7fe0a7e00640 1 -- 172.21.15.112:0/394508500 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a80d1fe0 con 0x7fe090004d40 2024-09-12T02:41:36.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.180+0000 7fe0a7e00640 1 -- 172.21.15.112:0/394508500 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe09000baf0 con 0x7fe0a80d2cb0 2024-09-12T02:41:36.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.180+0000 7fe0ae000640 1 --2- 172.21.15.112:0/394508500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe090004d40 0x7fe0900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:36.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.180+0000 7fe0acc00640 1 --2- 172.21.15.112:0/394508500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe0a80d2cb0 0x7fe090004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:36.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.181+0000 7fe0ad600640 1 --2- 172.21.15.112:0/394508500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0900039b0 0x7fe090003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:36.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.181+0000 7fe0acc00640 1 -- 172.21.15.112:0/394508500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe090004d40 msgr2=0x7fe0900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:36.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.181+0000 7fe0acc00640 1 --2- 172.21.15.112:0/394508500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe090004d40 0x7fe0900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.181+0000 7fe0acc00640 1 -- 172.21.15.112:0/394508500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0900039b0 msgr2=0x7fe090003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:36.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.181+0000 7fe0acc00640 1 --2- 172.21.15.112:0/394508500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0900039b0 0x7fe090003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.181+0000 7fe0acc00640 1 -- 172.21.15.112:0/394508500 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe090003520 con 0x7fe0a80d2cb0 2024-09-12T02:41:36.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.182+0000 7fe0acc00640 1 --2- 172.21.15.112:0/394508500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe0a80d2cb0 0x7fe090004800 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe09400da90 tx=0x7fe090005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c62cfd6a4eb25dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:36.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.186+0000 7fe0a7e00640 1 -- 172.21.15.112:0/394508500 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe094038070 con 0x7fe0a80d2cb0 2024-09-12T02:41:36.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.186+0000 7fe0a7e00640 1 -- 172.21.15.112:0/394508500 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe094033410 con 0x7fe0a80d2cb0 2024-09-12T02:41:36.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.186+0000 7fe0a7e00640 1 -- 172.21.15.112:0/394508500 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09400d690 con 0x7fe0a80d2cb0 2024-09-12T02:41:36.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.187+0000 7fe0b0000640 1 -- 172.21.15.112:0/394508500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe0a80d2cb0 msgr2=0x7fe090004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:36.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.187+0000 7fe0b0000640 1 --2- 172.21.15.112:0/394508500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe0a80d2cb0 0x7fe090004800 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe09400da90 tx=0x7fe090005830 comp rx=0 tx=0).stop 2024-09-12T02:41:36.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.187+0000 7fe0ae000640 1 -- 172.21.15.112:0/394508500 reap_dead start 2024-09-12T02:41:36.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.187+0000 7fe0b0000640 1 -- 172.21.15.112:0/394508500 shutdown_connections 2024-09-12T02:41:36.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.187+0000 7fe0b0000640 1 -- 172.21.15.112:0/394508500 >> 172.21.15.112:0/394508500 conn(0x7fe0a80d4db0 msgr2=0x7fe0a80d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:36.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.187+0000 7fe0b0000640 1 -- 172.21.15.112:0/394508500 shutdown_connections 2024-09-12T02:41:36.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.187+0000 7fe0b0000640 1 -- 172.21.15.112:0/394508500 wait complete. 2024-09-12T02:41:36.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.189+0000 7fe0b0000640 1 Processor -- start 2024-09-12T02:41:36.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.190+0000 7fe0b0000640 1 -- start start 2024-09-12T02:41:36.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.191+0000 7fe0b0000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0a80d2cb0 0x7fe0a81f41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:36.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.191+0000 7fe0b0000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0a81590d0 0x7fe0a80ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:36.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.191+0000 7fe0b0000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe0a80b6d30 0x7fe0a80cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:36.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.191+0000 7fe0b0000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a80d3f20 con 0x7fe0a80d2cb0 2024-09-12T02:41:36.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.191+0000 7fe0b0000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a80d3da0 con 0x7fe0a81590d0 2024-09-12T02:41:36.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.191+0000 7fe0b0000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe0a80d0a80 con 0x7fe0a80b6d30 2024-09-12T02:41:36.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.191+0000 7fe0ad600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0a80d2cb0 0x7fe0a81f41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:36.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.191+0000 7fe0ad600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0a80d2cb0 0x7fe0a81f41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45832/0 (socket says 172.21.15.112:45832) 2024-09-12T02:41:36.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.191+0000 7fe0ad600640 1 -- 172.21.15.112:0/1589070521 learned_addr learned my addr 172.21.15.112:0/1589070521 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:36.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.191+0000 7fe0acc00640 1 --2- 172.21.15.112:0/1589070521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0a81590d0 0x7fe0a80ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:36.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.191+0000 7fe0ae000640 1 --2- 172.21.15.112:0/1589070521 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe0a80b6d30 0x7fe0a80cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:36.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.192+0000 7fe0ad600640 1 -- 172.21.15.112:0/1589070521 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe0a80b6d30 msgr2=0x7fe0a80cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:36.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.192+0000 7fe0ad600640 1 --2- 172.21.15.112:0/1589070521 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe0a80b6d30 0x7fe0a80cd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.192+0000 7fe0ad600640 1 -- 172.21.15.112:0/1589070521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0a81590d0 msgr2=0x7fe0a80ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:36.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.192+0000 7fe0ad600640 1 --2- 172.21.15.112:0/1589070521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0a81590d0 0x7fe0a80ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.192+0000 7fe0ad600640 1 -- 172.21.15.112:0/1589070521 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a80b6850 con 0x7fe0a80d2cb0 2024-09-12T02:41:36.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.192+0000 7fe0ad600640 1 --2- 172.21.15.112:0/1589070521 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0a80d2cb0 0x7fe0a81f41e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe09c003fa0 tx=0x7fe09c00d9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:36.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.192+0000 7fe0a5600640 1 -- 172.21.15.112:0/1589070521 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09c019030 con 0x7fe0a80d2cb0 2024-09-12T02:41:36.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.192+0000 7fe0a5600640 1 -- 172.21.15.112:0/1589070521 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe09c014680 con 0x7fe0a80d2cb0 2024-09-12T02:41:36.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.192+0000 7fe0b0000640 1 -- 172.21.15.112:0/1589070521 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0a80b8720 con 0x7fe0a80d2cb0 2024-09-12T02:41:36.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.192+0000 7fe0a5600640 1 -- 172.21.15.112:0/1589070521 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09c014850 con 0x7fe0a80d2cb0 2024-09-12T02:41:36.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.193+0000 7fe0b0000640 1 -- 172.21.15.112:0/1589070521 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0a80cb950 con 0x7fe0a80d2cb0 2024-09-12T02:41:36.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.193+0000 7fe0a5600640 1 -- 172.21.15.112:0/1589070521 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe09c01c030 con 0x7fe0a80d2cb0 2024-09-12T02:41:36.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.193+0000 7fe0a5600640 1 -- 172.21.15.112:0/1589070521 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe09c015450 con 0x7fe0a80d2cb0 2024-09-12T02:41:36.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.194+0000 7fe0b0000640 1 -- 172.21.15.112:0/1589070521 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0a80b3bb0 con 0x7fe0a80d2cb0 2024-09-12T02:41:36.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.197+0000 7fe0a5600640 1 -- 172.21.15.112:0/1589070521 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fe09c023030 con 0x7fe0a80d2cb0 2024-09-12T02:41:36.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.264+0000 7fe0b0000640 1 -- 172.21.15.112:0/1589070521 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fe0a80d54a0 con 0x7fe0a80d2cb0 2024-09-12T02:41:36.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.266+0000 7fe0a5600640 1 -- 172.21.15.112:0/1589070521 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fe09c015650 con 0x7fe0a80d2cb0 2024-09-12T02:41:36.267 INFO:teuthology.orchestra.run.smithi112.stderr:adjusted tunables profile to default 2024-09-12T02:41:36.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.267+0000 7fe0b0000640 1 -- 172.21.15.112:0/1589070521 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0a80d2cb0 msgr2=0x7fe0a81f41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:36.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.267+0000 7fe0b0000640 1 --2- 172.21.15.112:0/1589070521 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0a80d2cb0 0x7fe0a81f41e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe09c003fa0 tx=0x7fe09c00d9e0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.267+0000 7fe0b0000640 1 -- 172.21.15.112:0/1589070521 shutdown_connections 2024-09-12T02:41:36.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.267+0000 7fe0b0000640 1 --2- 172.21.15.112:0/1589070521 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe0a80b6d30 0x7fe0a80cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.267+0000 7fe0b0000640 1 --2- 172.21.15.112:0/1589070521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0a81590d0 0x7fe0a80ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.267+0000 7fe0b0000640 1 --2- 172.21.15.112:0/1589070521 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0a80d2cb0 0x7fe0a81f41e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:36.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.267+0000 7fe0b0000640 1 -- 172.21.15.112:0/1589070521 >> 172.21.15.112:0/1589070521 conn(0x7fe0a80d4db0 msgr2=0x7fe0a81601b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:36.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.267+0000 7fe0b0000640 1 -- 172.21.15.112:0/1589070521 shutdown_connections 2024-09-12T02:41:36.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:36.267+0000 7fe0b0000640 1 -- 172.21.15.112:0/1589070521 wait complete. 2024-09-12T02:41:36.283 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T02:41:36.284 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T02:41:36.284 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:41:36.284 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T02:41:36.311 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-12T02:41:36.310+0000 7f7be2730040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:41:36.321 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-12T02:41:36.320+0000 7f0a2ab20040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:41:36.339 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:41:36.340 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T02:41:36.358 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-12T02:41:36.357+0000 7f7be2730040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:41:36.371 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-12T02:41:36.370+0000 7f0a2ab20040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:41:36.429 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:41:36.429 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T02:41:36.527 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:41:36.527 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T02:41:36.537 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-12T02:41:36.536+0000 7f7be2730040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:41:36.566 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-12T02:41:36.565+0000 7f0a2ab20040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:41:36.596 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-12T02:41:36.595+0000 7f7be2730040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:41:36.622 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:41:36.622 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T02:41:36.629 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-12T02:41:36.628+0000 7f0a2ab20040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:41:36.677 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:41:36.678 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T02:41:36.773 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:41:36.773 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T02:41:36.802 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-12T02:41:36.801+0000 7f7be2730040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:41:36.807 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-12T02:41:36.806+0000 7f0a2ab20040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:41:36.857 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:41:36.857 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T02:41:36.933 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-12T02:41:36.933+0000 7f0a2ab20040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:41:36.935 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-12T02:41:36.934+0000 7f7be2730040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:41:36.953 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 0 2024-09-12T02:41:37.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.140+0000 7f6136800640 1 Processor -- start 2024-09-12T02:41:37.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.141+0000 7f6136800640 1 -- start start 2024-09-12T02:41:37.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.142+0000 7f6136800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61301624e0 0x7f61300d58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:37.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.142+0000 7f6136800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f61300d0510 0x7f61300d0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:37.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.142+0000 7f6136800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61300cfa70 con 0x7f6130162100 2024-09-12T02:41:37.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.142+0000 7f6136800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f61300b4e20 con 0x7f61300d0510 2024-09-12T02:41:37.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.142+0000 7f6136800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f61300d21d0 con 0x7f61301624e0 2024-09-12T02:41:37.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.142+0000 7f612ea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61301624e0 0x7f61300d58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:37.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.142+0000 7f612ea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61301624e0 0x7f61300d58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:40616/0 (socket says 172.21.15.137:40616) 2024-09-12T02:41:37.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.142+0000 7f612ea00640 1 -- 172.21.15.137:0/1267415897 learned_addr learned my addr 172.21.15.137:0/1267415897 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-09-12T02:41:37.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.142+0000 7f612fe00640 1 --2- 172.21.15.137:0/1267415897 >> v2:172.21.15.112:3300/0 conn(0x7f61300d0510 0x7f61300d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:37.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.142+0000 7f612ea00640 1 -- 172.21.15.137:0/1267415897 >> v2:172.21.15.112:3300/0 conn(0x7f61300d0510 msgr2=0x7f61300d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:37.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.142+0000 7f612ea00640 1 --2- 172.21.15.137:0/1267415897 >> v2:172.21.15.112:3300/0 conn(0x7f61300d0510 0x7f61300d0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.142+0000 7f612ea00640 1 -- 172.21.15.137:0/1267415897 >> v1:172.21.15.112:6789/0 conn(0x7f6130162100 legacy=0x7f61300b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:37.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.142+0000 7f612ea00640 1 -- 172.21.15.137:0/1267415897 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61300d24b0 con 0x7f61301624e0 2024-09-12T02:41:37.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.143+0000 7f612ea00640 1 --2- 172.21.15.137:0/1267415897 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61301624e0 0x7f61300d58d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f611c009870 tx=0x7f611c02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31d75e981da9d65c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:37.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.144+0000 7f612e000640 1 -- 172.21.15.137:0/1267415897 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611c037070 con 0x7f61301624e0 2024-09-12T02:41:37.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.144+0000 7f612e000640 1 -- 172.21.15.137:0/1267415897 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f611c032440 con 0x7f61301624e0 2024-09-12T02:41:37.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.144+0000 7f612e000640 1 -- 172.21.15.137:0/1267415897 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611c032810 con 0x7f61301624e0 2024-09-12T02:41:37.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.144+0000 7f6136800640 1 -- 172.21.15.137:0/1267415897 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61301624e0 msgr2=0x7f61300d58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:37.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.144+0000 7f6136800640 1 --2- 172.21.15.137:0/1267415897 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61301624e0 0x7f61300d58d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f611c009870 tx=0x7f611c02a1c0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.144+0000 7f6136800640 1 -- 172.21.15.137:0/1267415897 shutdown_connections 2024-09-12T02:41:37.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.144+0000 7f6136800640 1 --2- 172.21.15.137:0/1267415897 >> v2:172.21.15.112:3300/0 conn(0x7f61300d0510 0x7f61300d0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.144+0000 7f6136800640 1 --2- 172.21.15.137:0/1267415897 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61301624e0 0x7f61300d58d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.144+0000 7f6136800640 1 -- 172.21.15.137:0/1267415897 >> 172.21.15.137:0/1267415897 conn(0x7f61300d4db0 msgr2=0x7f61300d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:37.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.144+0000 7f6136800640 1 -- 172.21.15.137:0/1267415897 shutdown_connections 2024-09-12T02:41:37.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.144+0000 7f6136800640 1 -- 172.21.15.137:0/1267415897 wait complete. 2024-09-12T02:41:37.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.146+0000 7f6136800640 1 Processor -- start 2024-09-12T02:41:37.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.146+0000 7f6136800640 1 -- start start 2024-09-12T02:41:37.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.147+0000 7f6136800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61300d0510 0x7f6130153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:37.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.147+0000 7f6136800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6130162100 0x7f61300ba2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:37.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.147+0000 7f6136800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61301624e0 0x7f61300b8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:37.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.147+0000 7f6136800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f61300d0ea0 con 0x7f6130162100 2024-09-12T02:41:37.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.147+0000 7f6136800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f61300cfff0 con 0x7f61300d0510 2024-09-12T02:41:37.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.147+0000 7f6136800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f61300d1df0 con 0x7f61301624e0 2024-09-12T02:41:37.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.147+0000 7f612fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61301624e0 0x7f61300b8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:37.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.147+0000 7f612f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61300d0510 0x7f6130153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:37.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.147+0000 7f612fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61301624e0 0x7f61300b8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:40628/0 (socket says 172.21.15.137:40628) 2024-09-12T02:41:37.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.147+0000 7f612fe00640 1 -- 172.21.15.137:0/971063599 learned_addr learned my addr 172.21.15.137:0/971063599 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-09-12T02:41:37.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.147+0000 7f612ea00640 1 --2- 172.21.15.137:0/971063599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6130162100 0x7f61300ba2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:37.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.148+0000 7f612fe00640 1 -- 172.21.15.137:0/971063599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61300d0510 msgr2=0x7f6130153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:37.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.148+0000 7f612fe00640 1 --2- 172.21.15.137:0/971063599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61300d0510 0x7f6130153100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.148+0000 7f612fe00640 1 -- 172.21.15.137:0/971063599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6130162100 msgr2=0x7f61300ba2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:37.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.148+0000 7f612fe00640 1 --2- 172.21.15.137:0/971063599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6130162100 0x7f61300ba2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.148+0000 7f612fe00640 1 -- 172.21.15.137:0/971063599 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613006deb0 con 0x7f61301624e0 2024-09-12T02:41:37.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.148+0000 7f612fe00640 1 --2- 172.21.15.137:0/971063599 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61301624e0 0x7f61300b8280 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f612800efc0 tx=0x7f612800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:37.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.148+0000 7f6127400640 1 -- 172.21.15.137:0/971063599 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6128018020 con 0x7f61301624e0 2024-09-12T02:41:37.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.148+0000 7f6127400640 1 -- 172.21.15.137:0/971063599 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6128014480 con 0x7f61301624e0 2024-09-12T02:41:37.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.148+0000 7f6136800640 1 -- 172.21.15.137:0/971063599 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f613006d390 con 0x7f61301624e0 2024-09-12T02:41:37.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.148+0000 7f6127400640 1 -- 172.21.15.137:0/971063599 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6128014870 con 0x7f61301624e0 2024-09-12T02:41:37.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.148+0000 7f6136800640 1 -- 172.21.15.137:0/971063599 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f613006dbd0 con 0x7f61301624e0 2024-09-12T02:41:37.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.149+0000 7f6127400640 1 -- 172.21.15.137:0/971063599 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6128005d10 con 0x7f61301624e0 2024-09-12T02:41:37.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.149+0000 7f6127400640 1 -- 172.21.15.137:0/971063599 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f61280133e0 con 0x7f61301624e0 2024-09-12T02:41:37.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.149+0000 7f6136800640 1 -- 172.21.15.137:0/971063599 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6130162b80 con 0x7f61301624e0 2024-09-12T02:41:37.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.155+0000 7f6127400640 1 -- 172.21.15.137:0/971063599 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6128022070 con 0x7f61301624e0 2024-09-12T02:41:37.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.228+0000 7f6136800640 1 -- 172.21.15.137:0/971063599 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0} v 0) -- 0x7f61300c9780 con 0x7f61301624e0 2024-09-12T02:41:37.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.234+0000 7f6127400640 1 -- 172.21.15.137:0/971063599 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f613006d390 con 0x7f61301624e0 2024-09-12T02:41:37.235 INFO:teuthology.orchestra.run.smithi137.stdout:0 2024-09-12T02:41:37.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.235+0000 7f6136800640 1 -- 172.21.15.137:0/971063599 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61301624e0 msgr2=0x7f61300b8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:37.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.235+0000 7f6136800640 1 --2- 172.21.15.137:0/971063599 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61301624e0 0x7f61300b8280 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f612800efc0 tx=0x7f612800c490 comp rx=0 tx=0).stop 2024-09-12T02:41:37.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.235+0000 7f6136800640 1 -- 172.21.15.137:0/971063599 shutdown_connections 2024-09-12T02:41:37.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.235+0000 7f6136800640 1 --2- 172.21.15.137:0/971063599 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61301624e0 0x7f61300b8280 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.235+0000 7f6136800640 1 --2- 172.21.15.137:0/971063599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6130162100 0x7f61300ba2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.235+0000 7f6136800640 1 --2- 172.21.15.137:0/971063599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61300d0510 0x7f6130153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.235+0000 7f6136800640 1 -- 172.21.15.137:0/971063599 >> 172.21.15.137:0/971063599 conn(0x7f61300d4db0 msgr2=0x7f61300b6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:37.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.235+0000 7f6136800640 1 -- 172.21.15.137:0/971063599 shutdown_connections 2024-09-12T02:41:37.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.235+0000 7f6136800640 1 -- 172.21.15.137:0/971063599 wait complete. 2024-09-12T02:41:37.250 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 1 2024-09-12T02:41:37.324 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-12T02:41:37.323+0000 7f0a2ab20040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:41:37.341 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-12T02:41:37.340+0000 7f7be2730040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:41:37.385 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-12T02:41:37.384+0000 7f0a2ab20040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:41:37.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.399+0000 7fc4d8a00640 1 Processor -- start 2024-09-12T02:41:37.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.399+0000 7fc4d8a00640 1 -- start start 2024-09-12T02:41:37.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.401+0000 7fc4d8a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc4d41624e0 0x7fc4d40d58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:37.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.401+0000 7fc4d8a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc4d40d0510 0x7fc4d40d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:37.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.401+0000 7fc4d8a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4d40cfa70 con 0x7fc4d4162100 2024-09-12T02:41:37.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.401+0000 7fc4d8a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc4d40b4e20 con 0x7fc4d40d0510 2024-09-12T02:41:37.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.401+0000 7fc4d8a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc4d40d21d0 con 0x7fc4d41624e0 2024-09-12T02:41:37.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.401+0000 7fc4cbe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc4d41624e0 0x7fc4d40d58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:37.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.401+0000 7fc4cbe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc4d41624e0 0x7fc4d40d58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:51238/0 (socket says 172.21.15.137:51238) 2024-09-12T02:41:37.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.401+0000 7fc4d2800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc4d40d0510 0x7fc4d40d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:37.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.401+0000 7fc4cbe00640 1 -- 172.21.15.137:0/4060554361 learned_addr learned my addr 172.21.15.137:0/4060554361 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-09-12T02:41:37.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.401+0000 7fc4cbe00640 1 -- 172.21.15.137:0/4060554361 >> v2:172.21.15.112:3300/0 conn(0x7fc4d40d0510 msgr2=0x7fc4d40d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:37.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.401+0000 7fc4cbe00640 1 --2- 172.21.15.137:0/4060554361 >> v2:172.21.15.112:3300/0 conn(0x7fc4d40d0510 0x7fc4d40d0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.401+0000 7fc4cbe00640 1 -- 172.21.15.137:0/4060554361 >> v1:172.21.15.112:6789/0 conn(0x7fc4d4162100 legacy=0x7fc4d40b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:37.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.401+0000 7fc4cbe00640 1 -- 172.21.15.137:0/4060554361 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d40d24b0 con 0x7fc4d41624e0 2024-09-12T02:41:37.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.401+0000 7fc4d2800640 1 --2- 172.21.15.137:0/4060554361 >> v2:172.21.15.112:3300/0 conn(0x7fc4d40d0510 0x7fc4d40d0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:41:37.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.402+0000 7fc4cbe00640 1 --2- 172.21.15.137:0/4060554361 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4d41624e0 0x7fc4d40d58d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc4d408f060 tx=0x7fc4bc02a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5254707b0230b70 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:37.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.403+0000 7fc4d1400640 1 -- 172.21.15.137:0/4060554361 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc037070 con 0x7fc4d41624e0 2024-09-12T02:41:37.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.403+0000 7fc4d1400640 1 -- 172.21.15.137:0/4060554361 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4bc032440 con 0x7fc4d41624e0 2024-09-12T02:41:37.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.403+0000 7fc4d1400640 1 -- 172.21.15.137:0/4060554361 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc032810 con 0x7fc4d41624e0 2024-09-12T02:41:37.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.403+0000 7fc4d8a00640 1 -- 172.21.15.137:0/4060554361 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4d41624e0 msgr2=0x7fc4d40d58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:37.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.403+0000 7fc4d8a00640 1 --2- 172.21.15.137:0/4060554361 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4d41624e0 0x7fc4d40d58d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc4d408f060 tx=0x7fc4bc02a1e0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.403+0000 7fc4d8a00640 1 -- 172.21.15.137:0/4060554361 shutdown_connections 2024-09-12T02:41:37.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.403+0000 7fc4d8a00640 1 --2- 172.21.15.137:0/4060554361 >> v2:172.21.15.112:3300/0 conn(0x7fc4d40d0510 0x7fc4d40d0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.403+0000 7fc4d8a00640 1 --2- 172.21.15.137:0/4060554361 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4d41624e0 0x7fc4d40d58d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.403+0000 7fc4d8a00640 1 -- 172.21.15.137:0/4060554361 >> 172.21.15.137:0/4060554361 conn(0x7fc4d40d4db0 msgr2=0x7fc4d40d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:37.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.403+0000 7fc4d8a00640 1 -- 172.21.15.137:0/4060554361 shutdown_connections 2024-09-12T02:41:37.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.403+0000 7fc4d8a00640 1 -- 172.21.15.137:0/4060554361 wait complete. 2024-09-12T02:41:37.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.405+0000 7fc4d8a00640 1 Processor -- start 2024-09-12T02:41:37.406 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-12T02:41:37.405+0000 7f7be2730040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:41:37.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.405+0000 7fc4d8a00640 1 -- start start 2024-09-12T02:41:37.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.406+0000 7fc4d8a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4d40d0510 0x7fc4d40caf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:37.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.406+0000 7fc4d8a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4d4162100 0x7fc4d40ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:37.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.406+0000 7fc4d8a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc4d41624e0 0x7fc4d40ba490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:37.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.406+0000 7fc4d8a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d40d0e60 con 0x7fc4d4162100 2024-09-12T02:41:37.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.406+0000 7fc4d8a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d40cfff0 con 0x7fc4d40d0510 2024-09-12T02:41:37.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.406+0000 7fc4d8a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc4d40d1df0 con 0x7fc4d41624e0 2024-09-12T02:41:37.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.406+0000 7fc4d1e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4d40d0510 0x7fc4d40caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:37.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.406+0000 7fc4d2800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc4d41624e0 0x7fc4d40ba490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:37.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.406+0000 7fc4d1e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4d40d0510 0x7fc4d40caf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:51254/0 (socket says 172.21.15.137:51254) 2024-09-12T02:41:37.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.406+0000 7fc4d1e00640 1 -- 172.21.15.137:0/309596513 learned_addr learned my addr 172.21.15.137:0/309596513 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-09-12T02:41:37.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.406+0000 7fc4cbe00640 1 --2- 172.21.15.137:0/309596513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4d4162100 0x7fc4d40ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:37.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.407+0000 7fc4d1e00640 1 -- 172.21.15.137:0/309596513 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc4d41624e0 msgr2=0x7fc4d40ba490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:37.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.407+0000 7fc4d1e00640 1 --2- 172.21.15.137:0/309596513 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc4d41624e0 0x7fc4d40ba490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.407+0000 7fc4d1e00640 1 -- 172.21.15.137:0/309596513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4d4162100 msgr2=0x7fc4d40ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:37.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.407+0000 7fc4d1e00640 1 --2- 172.21.15.137:0/309596513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4d4162100 0x7fc4d40ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.407+0000 7fc4d1e00640 1 -- 172.21.15.137:0/309596513 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d40cd930 con 0x7fc4d40d0510 2024-09-12T02:41:37.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.407+0000 7fc4d1e00640 1 --2- 172.21.15.137:0/309596513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4d40d0510 0x7fc4d40caf30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc4c400c340 tx=0x7fc4c400c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:37.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.407+0000 7fc4ca000640 1 -- 172.21.15.137:0/309596513 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4017070 con 0x7fc4d40d0510 2024-09-12T02:41:37.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.407+0000 7fc4ca000640 1 -- 172.21.15.137:0/309596513 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4c40052d0 con 0x7fc4d40d0510 2024-09-12T02:41:37.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.407+0000 7fc4d8a00640 1 -- 172.21.15.137:0/309596513 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4d40cdc10 con 0x7fc4d40d0510 2024-09-12T02:41:37.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.407+0000 7fc4ca000640 1 -- 172.21.15.137:0/309596513 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4003850 con 0x7fc4d40d0510 2024-09-12T02:41:37.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.407+0000 7fc4d8a00640 1 -- 172.21.15.137:0/309596513 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4d40ce1d0 con 0x7fc4d40d0510 2024-09-12T02:41:37.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.408+0000 7fc4ca000640 1 -- 172.21.15.137:0/309596513 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc4c401a070 con 0x7fc4d40d0510 2024-09-12T02:41:37.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.408+0000 7fc4ca000640 1 -- 172.21.15.137:0/309596513 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fc4c4011bc0 con 0x7fc4d40d0510 2024-09-12T02:41:37.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.408+0000 7fc4d8a00640 1 -- 172.21.15.137:0/309596513 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4d4162b80 con 0x7fc4d40d0510 2024-09-12T02:41:37.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.411+0000 7fc4ca000640 1 -- 172.21.15.137:0/309596513 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc4c4021070 con 0x7fc4d40d0510 2024-09-12T02:41:37.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.484+0000 7fc4d8a00640 1 -- 172.21.15.137:0/309596513 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1} v 0) -- 0x7fc4d406e020 con 0x7fc4d40d0510 2024-09-12T02:41:37.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.490+0000 7fc4ca000640 1 -- 172.21.15.137:0/309596513 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fc4c4011dc0 con 0x7fc4d40d0510 2024-09-12T02:41:37.491 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-09-12T02:41:37.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.491+0000 7fc4d8a00640 1 -- 172.21.15.137:0/309596513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4d40d0510 msgr2=0x7fc4d40caf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:37.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.491+0000 7fc4d8a00640 1 --2- 172.21.15.137:0/309596513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4d40d0510 0x7fc4d40caf30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc4c400c340 tx=0x7fc4c400c740 comp rx=0 tx=0).stop 2024-09-12T02:41:37.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.491+0000 7fc4d8a00640 1 -- 172.21.15.137:0/309596513 shutdown_connections 2024-09-12T02:41:37.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.491+0000 7fc4d8a00640 1 --2- 172.21.15.137:0/309596513 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc4d41624e0 0x7fc4d40ba490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.491+0000 7fc4d8a00640 1 --2- 172.21.15.137:0/309596513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4d4162100 0x7fc4d40ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.491+0000 7fc4d8a00640 1 --2- 172.21.15.137:0/309596513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4d40d0510 0x7fc4d40caf30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.491+0000 7fc4d8a00640 1 -- 172.21.15.137:0/309596513 >> 172.21.15.137:0/309596513 conn(0x7fc4d40d4db0 msgr2=0x7fc4d40b22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:37.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.491+0000 7fc4d8a00640 1 -- 172.21.15.137:0/309596513 shutdown_connections 2024-09-12T02:41:37.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.492+0000 7fc4d8a00640 1 -- 172.21.15.137:0/309596513 wait complete. 2024-09-12T02:41:37.507 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 2 2024-09-12T02:41:37.556 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-12T02:41:37.555+0000 7f0a2ab20040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:41:37.586 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-12T02:41:37.586+0000 7f7be2730040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:41:37.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.657+0000 7fc8fec00640 1 Processor -- start 2024-09-12T02:41:37.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.657+0000 7fc8fec00640 1 -- start start 2024-09-12T02:41:37.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.658+0000 7fc8fec00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc8f8162100 0x7fc8f80d58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:37.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.658+0000 7fc8fec00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc8f81624e0 0x7fc8f80b4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:37.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.658+0000 7fc8fec00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8f80cfa70 con 0x7fc8f80d0510 2024-09-12T02:41:37.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.658+0000 7fc8fec00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc8f80d21d0 con 0x7fc8f8162100 2024-09-12T02:41:37.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.658+0000 7fc8fec00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc8f80d24b0 con 0x7fc8f81624e0 2024-09-12T02:41:37.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.658+0000 7fc8f7400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc8f81624e0 0x7fc8f80b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:37.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.658+0000 7fc8f7400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc8f81624e0 0x7fc8f80b4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:40648/0 (socket says 172.21.15.137:40648) 2024-09-12T02:41:37.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.658+0000 7fc8f7400640 1 -- 172.21.15.137:0/3967035025 learned_addr learned my addr 172.21.15.137:0/3967035025 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-09-12T02:41:37.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.658+0000 7fc8f7e00640 1 --2- 172.21.15.137:0/3967035025 >> v2:172.21.15.112:3300/0 conn(0x7fc8f8162100 0x7fc8f80d58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:37.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.659+0000 7fc8f7400640 1 -- 172.21.15.137:0/3967035025 >> v2:172.21.15.112:3300/0 conn(0x7fc8f8162100 msgr2=0x7fc8f80d58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:37.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.659+0000 7fc8f7400640 1 --2- 172.21.15.137:0/3967035025 >> v2:172.21.15.112:3300/0 conn(0x7fc8f8162100 0x7fc8f80d58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.659+0000 7fc8f7400640 1 -- 172.21.15.137:0/3967035025 >> v1:172.21.15.112:6789/0 conn(0x7fc8f80d0510 legacy=0x7fc8f80d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:37.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.659+0000 7fc8f7400640 1 -- 172.21.15.137:0/3967035025 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f80cfd10 con 0x7fc8f81624e0 2024-09-12T02:41:37.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.660+0000 7fc8f7400640 1 --2- 172.21.15.137:0/3967035025 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc8f81624e0 0x7fc8f80b4710 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4009870 tx=0x7fc8e402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2226991b9f81fac7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:37.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.660+0000 7fc8f6a00640 1 -- 172.21.15.137:0/3967035025 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4037070 con 0x7fc8f81624e0 2024-09-12T02:41:37.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.660+0000 7fc8f6a00640 1 -- 172.21.15.137:0/3967035025 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8e4032440 con 0x7fc8f81624e0 2024-09-12T02:41:37.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.660+0000 7fc8f6a00640 1 -- 172.21.15.137:0/3967035025 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4032810 con 0x7fc8f81624e0 2024-09-12T02:41:37.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.661+0000 7fc8fec00640 1 -- 172.21.15.137:0/3967035025 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc8f81624e0 msgr2=0x7fc8f80b4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:37.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.661+0000 7fc8fec00640 1 --2- 172.21.15.137:0/3967035025 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc8f81624e0 0x7fc8f80b4710 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4009870 tx=0x7fc8e402a1c0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.661+0000 7fc8fec00640 1 -- 172.21.15.137:0/3967035025 shutdown_connections 2024-09-12T02:41:37.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.661+0000 7fc8fec00640 1 --2- 172.21.15.137:0/3967035025 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc8f81624e0 0x7fc8f80b4710 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.661+0000 7fc8fec00640 1 --2- 172.21.15.137:0/3967035025 >> v2:172.21.15.112:3300/0 conn(0x7fc8f8162100 0x7fc8f80d58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.661+0000 7fc8fec00640 1 -- 172.21.15.137:0/3967035025 >> 172.21.15.137:0/3967035025 conn(0x7fc8f80d4db0 msgr2=0x7fc8f80d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:37.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.661+0000 7fc8fec00640 1 -- 172.21.15.137:0/3967035025 shutdown_connections 2024-09-12T02:41:37.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.661+0000 7fc8fec00640 1 -- 172.21.15.137:0/3967035025 wait complete. 2024-09-12T02:41:37.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.662+0000 7fc8fec00640 1 Processor -- start 2024-09-12T02:41:37.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.663+0000 7fc8fec00640 1 -- start start 2024-09-12T02:41:37.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.663+0000 7fc8fec00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8f80d0510 0x7fc8f81521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:37.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.663+0000 7fc8fec00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc8f8162100 0x7fc8f80b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:37.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.663+0000 7fc8fec00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f81624e0 0x7fc8f80b94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:37.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.663+0000 7fc8fec00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f80d1f70 con 0x7fc8f81624e0 2024-09-12T02:41:37.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.663+0000 7fc8fec00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f80d1df0 con 0x7fc8f80d0510 2024-09-12T02:41:37.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.663+0000 7fc8fec00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc8f8162b80 con 0x7fc8f8162100 2024-09-12T02:41:37.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.664+0000 7fc8f7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8f80d0510 0x7fc8f81521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:37.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.664+0000 7fc8f7400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc8f8162100 0x7fc8f80b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:37.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.664+0000 7fc8f7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8f80d0510 0x7fc8f81521b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:51260/0 (socket says 172.21.15.137:51260) 2024-09-12T02:41:37.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.664+0000 7fc8f7e00640 1 -- 172.21.15.137:0/4155100492 learned_addr learned my addr 172.21.15.137:0/4155100492 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-09-12T02:41:37.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.664+0000 7fc8fcc00640 1 --2- 172.21.15.137:0/4155100492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f81624e0 0x7fc8f80b94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:37.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.664+0000 7fc8f7400640 1 -- 172.21.15.137:0/4155100492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8f80d0510 msgr2=0x7fc8f81521b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:37.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.664+0000 7fc8f7400640 1 --2- 172.21.15.137:0/4155100492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8f80d0510 0x7fc8f81521b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.664+0000 7fc8f7400640 1 -- 172.21.15.137:0/4155100492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f81624e0 msgr2=0x7fc8f80b94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:37.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.664+0000 7fc8f7400640 1 --2- 172.21.15.137:0/4155100492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f81624e0 0x7fc8f80b94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.664+0000 7fc8f7400640 1 -- 172.21.15.137:0/4155100492 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f80cc1a0 con 0x7fc8f8162100 2024-09-12T02:41:37.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.664+0000 7fc8f7e00640 1 --2- 172.21.15.137:0/4155100492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8f80d0510 0x7fc8f81521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:41:37.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.664+0000 7fc8fcc00640 1 --2- 172.21.15.137:0/4155100492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f81624e0 0x7fc8f80b94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:41:37.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.665+0000 7fc8f7400640 1 --2- 172.21.15.137:0/4155100492 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc8f8162100 0x7fc8f80b7030 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4031000 tx=0x7fc8e40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:37.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.665+0000 7fc8efe00640 1 -- 172.21.15.137:0/4155100492 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4037040 con 0x7fc8f8162100 2024-09-12T02:41:37.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.665+0000 7fc8efe00640 1 -- 172.21.15.137:0/4155100492 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8e4042070 con 0x7fc8f8162100 2024-09-12T02:41:37.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.665+0000 7fc8fec00640 1 -- 172.21.15.137:0/4155100492 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8f80ce880 con 0x7fc8f8162100 2024-09-12T02:41:37.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.665+0000 7fc8efe00640 1 -- 172.21.15.137:0/4155100492 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4030920 con 0x7fc8f8162100 2024-09-12T02:41:37.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.665+0000 7fc8fec00640 1 -- 172.21.15.137:0/4155100492 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8f80b4a40 con 0x7fc8f8162100 2024-09-12T02:41:37.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.665+0000 7fc8efe00640 1 -- 172.21.15.137:0/4155100492 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc8e402ad10 con 0x7fc8f8162100 2024-09-12T02:41:37.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.665+0000 7fc8efe00640 1 -- 172.21.15.137:0/4155100492 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fc8e4047460 con 0x7fc8f8162100 2024-09-12T02:41:37.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.666+0000 7fc8fec00640 1 -- 172.21.15.137:0/4155100492 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8f80ceda0 con 0x7fc8f8162100 2024-09-12T02:41:37.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.669+0000 7fc8efe00640 1 -- 172.21.15.137:0/4155100492 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc8f80ceda0 con 0x7fc8f8162100 2024-09-12T02:41:37.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.741+0000 7fc8fec00640 1 -- 172.21.15.137:0/4155100492 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2} v 0) -- 0x7fc8f80d58d0 con 0x7fc8f8162100 2024-09-12T02:41:37.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.747+0000 7fc8efe00640 1 -- 172.21.15.137:0/4155100492 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fc8e4030ac0 con 0x7fc8f8162100 2024-09-12T02:41:37.747 INFO:teuthology.orchestra.run.smithi137.stdout:2 2024-09-12T02:41:37.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.747+0000 7fc8fec00640 1 -- 172.21.15.137:0/4155100492 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc8f8162100 msgr2=0x7fc8f80b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:37.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.747+0000 7fc8fec00640 1 --2- 172.21.15.137:0/4155100492 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc8f8162100 0x7fc8f80b7030 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4031000 tx=0x7fc8e40046c0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.748+0000 7fc8fec00640 1 -- 172.21.15.137:0/4155100492 shutdown_connections 2024-09-12T02:41:37.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.748+0000 7fc8fec00640 1 --2- 172.21.15.137:0/4155100492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f81624e0 0x7fc8f80b94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.748+0000 7fc8fec00640 1 --2- 172.21.15.137:0/4155100492 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc8f8162100 0x7fc8f80b7030 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.748+0000 7fc8fec00640 1 --2- 172.21.15.137:0/4155100492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8f80d0510 0x7fc8f81521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.748+0000 7fc8fec00640 1 -- 172.21.15.137:0/4155100492 >> 172.21.15.137:0/4155100492 conn(0x7fc8f80d4db0 msgr2=0x7fc8f80d3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:37.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.748+0000 7fc8fec00640 1 -- 172.21.15.137:0/4155100492 shutdown_connections 2024-09-12T02:41:37.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.748+0000 7fc8fec00640 1 -- 172.21.15.137:0/4155100492 wait complete. 2024-09-12T02:41:37.763 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 3 2024-09-12T02:41:37.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.911+0000 7fc2ad600640 1 Processor -- start 2024-09-12T02:41:37.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.911+0000 7fc2ad600640 1 -- start start 2024-09-12T02:41:37.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.912+0000 7fc2ad600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc2a80d1630 0x7fc2a80d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:37.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.912+0000 7fc2ad600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2a80b5c30 con 0x7fc2a80d5840 2024-09-12T02:41:37.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.912+0000 7fc2ad600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2a80b5f10 con 0x7fc2a8161f70 2024-09-12T02:41:37.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.912+0000 7fc2ad600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc2a80b61f0 con 0x7fc2a80d1630 2024-09-12T02:41:37.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.912+0000 7fc2acc00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc2a8161f70 0x7fc2a81623a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39142/0 (socket says 172.21.15.137:39142) 2024-09-12T02:41:37.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.912+0000 7fc2acc00640 1 -- 172.21.15.137:0/1228540173 learned_addr learned my addr 172.21.15.137:0/1228540173 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-09-12T02:41:37.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.913+0000 7fc2a7e00640 1 --2- 172.21.15.137:0/1228540173 >> v2:172.21.15.112:3300/0 conn(0x7fc2a80d1630 0x7fc2a80d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:37.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.913+0000 7fc2a6a00640 1 -- 172.21.15.137:0/1228540173 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 16638515 0 0) 0x7fc2a80b5f10 con 0x7fc2a8161f70 2024-09-12T02:41:37.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.913+0000 7fc2a6a00640 1 -- 172.21.15.137:0/1228540173 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc28c003520 con 0x7fc2a8161f70 2024-09-12T02:41:37.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.913+0000 7fc2a7e00640 1 -- 172.21.15.137:0/1228540173 >> v1:172.21.15.137:6789/0 conn(0x7fc2a8161f70 legacy=0x7fc2a81623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:37.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.913+0000 7fc2a7e00640 1 -- 172.21.15.137:0/1228540173 >> v1:172.21.15.112:6789/0 conn(0x7fc2a80d5840 legacy=0x7fc2a80d28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:37.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.913+0000 7fc2a7e00640 1 -- 172.21.15.137:0/1228540173 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a80d2090 con 0x7fc2a80d1630 2024-09-12T02:41:37.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.914+0000 7fc2a7e00640 1 --2- 172.21.15.137:0/1228540173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2a80d1630 0x7fc2a80d1a10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc2980097a0 tx=0x7fc29802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492b0fd62f8e679 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:37.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.914+0000 7fc2a6a00640 1 -- 172.21.15.137:0/1228540173 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc298037070 con 0x7fc2a80d1630 2024-09-12T02:41:37.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.914+0000 7fc2a6a00640 1 -- 172.21.15.137:0/1228540173 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc298032440 con 0x7fc2a80d1630 2024-09-12T02:41:37.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.914+0000 7fc2a6a00640 1 -- 172.21.15.137:0/1228540173 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2980327f0 con 0x7fc2a80d1630 2024-09-12T02:41:37.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.915+0000 7fc2ad600640 1 -- 172.21.15.137:0/1228540173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2a80d1630 msgr2=0x7fc2a80d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:37.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.915+0000 7fc2ad600640 1 --2- 172.21.15.137:0/1228540173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2a80d1630 0x7fc2a80d1a10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc2980097a0 tx=0x7fc29802a230 comp rx=0 tx=0).stop 2024-09-12T02:41:37.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.915+0000 7fc2ad600640 1 -- 172.21.15.137:0/1228540173 shutdown_connections 2024-09-12T02:41:37.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.915+0000 7fc2ad600640 1 --2- 172.21.15.137:0/1228540173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2a80d1630 0x7fc2a80d1a10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.915+0000 7fc2ad600640 1 -- 172.21.15.137:0/1228540173 >> 172.21.15.137:0/1228540173 conn(0x7fc2a80d4d20 msgr2=0x7fc2a80d5130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:37.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.915+0000 7fc2ad600640 1 -- 172.21.15.137:0/1228540173 shutdown_connections 2024-09-12T02:41:37.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.915+0000 7fc2ad600640 1 -- 172.21.15.137:0/1228540173 wait complete. 2024-09-12T02:41:37.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.917+0000 7fc2ad600640 1 Processor -- start 2024-09-12T02:41:37.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.917+0000 7fc2ad600640 1 -- start start 2024-09-12T02:41:37.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.918+0000 7fc2ad600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2a80d1630 0x7fc2a8160600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:37.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.918+0000 7fc2ad600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2a80d5840 0x7fc2a80c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:37.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.918+0000 7fc2ad600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2a8161f70 0x7fc2a80c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:37.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.918+0000 7fc2ad600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a8169b60 con 0x7fc2a8161f70 2024-09-12T02:41:37.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.918+0000 7fc2ad600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a80d25b0 con 0x7fc2a80d1630 2024-09-12T02:41:37.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.918+0000 7fc2ad600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc2a8169ce0 con 0x7fc2a80d5840 2024-09-12T02:41:37.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.918+0000 7fc2a7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2a80d1630 0x7fc2a8160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:37.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.918+0000 7fc2a7400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2a80d5840 0x7fc2a80c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:37.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.918+0000 7fc2a7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2a80d1630 0x7fc2a8160600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:51272/0 (socket says 172.21.15.137:51272) 2024-09-12T02:41:37.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.918+0000 7fc2a7e00640 1 -- 172.21.15.137:0/3636019758 learned_addr learned my addr 172.21.15.137:0/3636019758 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-09-12T02:41:37.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.918+0000 7fc2acc00640 1 --2- 172.21.15.137:0/3636019758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2a8161f70 0x7fc2a80c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:37.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.918+0000 7fc2a7e00640 1 -- 172.21.15.137:0/3636019758 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2a80d5840 msgr2=0x7fc2a80c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:37.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.918+0000 7fc2a7e00640 1 --2- 172.21.15.137:0/3636019758 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2a80d5840 0x7fc2a80c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.918+0000 7fc2a7e00640 1 -- 172.21.15.137:0/3636019758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2a8161f70 msgr2=0x7fc2a80c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:37.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.918+0000 7fc2a7e00640 1 --2- 172.21.15.137:0/3636019758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2a8161f70 0x7fc2a80c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:37.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.918+0000 7fc2a7e00640 1 -- 172.21.15.137:0/3636019758 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a80ceca0 con 0x7fc2a80d1630 2024-09-12T02:41:37.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.919+0000 7fc2a7e00640 1 --2- 172.21.15.137:0/3636019758 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2a80d1630 0x7fc2a8160600 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc2980097a0 tx=0x7fc2980046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:37.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.919+0000 7fc29fe00640 1 -- 172.21.15.137:0/3636019758 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc298037050 con 0x7fc2a80d1630 2024-09-12T02:41:37.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.919+0000 7fc29fe00640 1 -- 172.21.15.137:0/3636019758 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc298038040 con 0x7fc2a80d1630 2024-09-12T02:41:37.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.919+0000 7fc29fe00640 1 -- 172.21.15.137:0/3636019758 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc298004470 con 0x7fc2a80d1630 2024-09-12T02:41:37.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.919+0000 7fc2ad600640 1 -- 172.21.15.137:0/3636019758 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2a80cca50 con 0x7fc2a80d1630 2024-09-12T02:41:37.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.919+0000 7fc2ad600640 1 -- 172.21.15.137:0/3636019758 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2a8160b40 con 0x7fc2a80d1630 2024-09-12T02:41:37.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.919+0000 7fc29fe00640 1 -- 172.21.15.137:0/3636019758 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc29803c6d0 con 0x7fc2a80d1630 2024-09-12T02:41:37.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.919+0000 7fc29fe00640 1 -- 172.21.15.137:0/3636019758 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fc298003980 con 0x7fc2a80d1630 2024-09-12T02:41:37.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.920+0000 7fc2ad600640 1 -- 172.21.15.137:0/3636019758 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2a80d1a10 con 0x7fc2a80d1630 2024-09-12T02:41:37.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.922+0000 7fc29fe00640 1 -- 172.21.15.137:0/3636019758 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc298003c20 con 0x7fc2a80d1630 2024-09-12T02:41:37.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:37.995+0000 7fc2ad600640 1 -- 172.21.15.137:0/3636019758 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3} v 0) -- 0x7fc2a80d29e0 con 0x7fc2a80d1630 2024-09-12T02:41:38.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.001+0000 7fc29fe00640 1 -- 172.21.15.137:0/3636019758 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fc29803c9c0 con 0x7fc2a80d1630 2024-09-12T02:41:38.002 INFO:teuthology.orchestra.run.smithi137.stdout:3 2024-09-12T02:41:38.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.002+0000 7fc2ad600640 1 -- 172.21.15.137:0/3636019758 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2a80d1630 msgr2=0x7fc2a8160600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:38.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.002+0000 7fc2ad600640 1 --2- 172.21.15.137:0/3636019758 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2a80d1630 0x7fc2a8160600 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc2980097a0 tx=0x7fc2980046c0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.002+0000 7fc2ad600640 1 -- 172.21.15.137:0/3636019758 shutdown_connections 2024-09-12T02:41:38.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.002+0000 7fc2ad600640 1 --2- 172.21.15.137:0/3636019758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2a8161f70 0x7fc2a80c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.002+0000 7fc2ad600640 1 --2- 172.21.15.137:0/3636019758 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2a80d5840 0x7fc2a80c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.002+0000 7fc2ad600640 1 --2- 172.21.15.137:0/3636019758 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2a80d1630 0x7fc2a8160600 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.002+0000 7fc2ad600640 1 -- 172.21.15.137:0/3636019758 >> 172.21.15.137:0/3636019758 conn(0x7fc2a80d4d20 msgr2=0x7fc2a80b7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:38.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.002+0000 7fc2ad600640 1 -- 172.21.15.137:0/3636019758 shutdown_connections 2024-09-12T02:41:38.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.002+0000 7fc2ad600640 1 -- 172.21.15.137:0/3636019758 wait complete. 2024-09-12T02:41:38.017 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 4 2024-09-12T02:41:38.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.167+0000 7f71d7e00640 1 Processor -- start 2024-09-12T02:41:38.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.167+0000 7f71d7e00640 1 -- start start 2024-09-12T02:41:38.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.168+0000 7f71d7e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f71d80b3e00 0x7f71d80d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:38.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.168+0000 7f71d7e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71d80b1d70 0x7f71d80b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:38.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.168+0000 7f71d7e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71d80d2fb0 con 0x7f71d80d1710 2024-09-12T02:41:38.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.168+0000 7f71d7e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f71d80d3cb0 con 0x7f71d80b3e00 2024-09-12T02:41:38.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.168+0000 7f71d7e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f71d80d0b60 con 0x7f71d80b1d70 2024-09-12T02:41:38.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.169+0000 7f71d7400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71d80b1d70 0x7f71d80b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:38.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.169+0000 7f71d7400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71d80b1d70 0x7f71d80b2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:40682/0 (socket says 172.21.15.137:40682) 2024-09-12T02:41:38.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.169+0000 7f71d7400640 1 -- 172.21.15.137:0/1565234885 learned_addr learned my addr 172.21.15.137:0/1565234885 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-09-12T02:41:38.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.169+0000 7f71cfe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f71d80b3e00 0x7f71d80d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:38.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.169+0000 7f71d7400640 1 -- 172.21.15.137:0/1565234885 >> v2:172.21.15.112:3300/0 conn(0x7f71d80b3e00 msgr2=0x7f71d80d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:38.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.169+0000 7f71d7400640 1 --2- 172.21.15.137:0/1565234885 >> v2:172.21.15.112:3300/0 conn(0x7f71d80b3e00 0x7f71d80d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.169+0000 7f71d7400640 1 -- 172.21.15.137:0/1565234885 >> v1:172.21.15.112:6789/0 conn(0x7f71d80d1710 legacy=0x7f71d80d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:38.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.169+0000 7f71d7400640 1 -- 172.21.15.137:0/1565234885 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d80d3410 con 0x7f71d80b1d70 2024-09-12T02:41:38.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.170+0000 7f71d7400640 1 --2- 172.21.15.137:0/1565234885 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71d80b1d70 0x7f71d80b2200 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f71d0009e50 tx=0x7f71d002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36b13d418194f4d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:38.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.170+0000 7f71d6000640 1 -- 172.21.15.137:0/1565234885 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d0036070 con 0x7f71d80b1d70 2024-09-12T02:41:38.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.170+0000 7f71d6000640 1 -- 172.21.15.137:0/1565234885 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71d0031600 con 0x7f71d80b1d70 2024-09-12T02:41:38.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.170+0000 7f71d6000640 1 -- 172.21.15.137:0/1565234885 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d00319d0 con 0x7f71d80b1d70 2024-09-12T02:41:38.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.171+0000 7f71d7e00640 1 -- 172.21.15.137:0/1565234885 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71d80b1d70 msgr2=0x7f71d80b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:38.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.171+0000 7f71d7e00640 1 --2- 172.21.15.137:0/1565234885 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71d80b1d70 0x7f71d80b2200 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f71d0009e50 tx=0x7f71d002a710 comp rx=0 tx=0).stop 2024-09-12T02:41:38.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.171+0000 7f71d7e00640 1 -- 172.21.15.137:0/1565234885 shutdown_connections 2024-09-12T02:41:38.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.171+0000 7f71d7e00640 1 --2- 172.21.15.137:0/1565234885 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71d80b1d70 0x7f71d80b2200 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.171+0000 7f71d7e00640 1 --2- 172.21.15.137:0/1565234885 >> v2:172.21.15.112:3300/0 conn(0x7f71d80b3e00 0x7f71d80d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.171+0000 7f71d7e00640 1 -- 172.21.15.137:0/1565234885 >> 172.21.15.137:0/1565234885 conn(0x7f71d809e030 msgr2=0x7f71d80d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:38.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.171+0000 7f71d7e00640 1 -- 172.21.15.137:0/1565234885 shutdown_connections 2024-09-12T02:41:38.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.171+0000 7f71d7e00640 1 -- 172.21.15.137:0/1565234885 wait complete. 2024-09-12T02:41:38.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.173+0000 7f71d7e00640 1 Processor -- start 2024-09-12T02:41:38.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.173+0000 7f71d7e00640 1 -- start start 2024-09-12T02:41:38.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.174+0000 7f71d7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71d80b1d70 0x7f71d80b6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:38.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.174+0000 7f71d7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71d80b3e00 0x7f71d80c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:38.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.174+0000 7f71d7e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71d80d1710 0x7f71d8156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:38.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.174+0000 7f71d7e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f71d815f110 con 0x7f71d80b3e00 2024-09-12T02:41:38.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.174+0000 7f71d7e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f71d80d39d0 con 0x7f71d80b1d70 2024-09-12T02:41:38.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.174+0000 7f71d7e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f71d815f290 con 0x7f71d80d1710 2024-09-12T02:41:38.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.174+0000 7f71d6a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71d80b1d70 0x7f71d80b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:38.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.174+0000 7f71d7400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71d80d1710 0x7f71d8156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:38.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.174+0000 7f71d7400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71d80d1710 0x7f71d8156220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:40684/0 (socket says 172.21.15.137:40684) 2024-09-12T02:41:38.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.174+0000 7f71d6a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71d80b1d70 0x7f71d80b6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:51284/0 (socket says 172.21.15.137:51284) 2024-09-12T02:41:38.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.174+0000 7f71d7400640 1 -- 172.21.15.137:0/2748075212 learned_addr learned my addr 172.21.15.137:0/2748075212 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-09-12T02:41:38.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.174+0000 7f71cfe00640 1 --2- 172.21.15.137:0/2748075212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71d80b3e00 0x7f71d80c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:38.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.174+0000 7f71d7400640 1 -- 172.21.15.137:0/2748075212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71d80b1d70 msgr2=0x7f71d80b6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:38.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.174+0000 7f71d7400640 1 --2- 172.21.15.137:0/2748075212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71d80b1d70 0x7f71d80b6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.174+0000 7f71d7400640 1 -- 172.21.15.137:0/2748075212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71d80b3e00 msgr2=0x7f71d80c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:38.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.174+0000 7f71d7400640 1 --2- 172.21.15.137:0/2748075212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71d80b3e00 0x7f71d80c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.174+0000 7f71d7400640 1 -- 172.21.15.137:0/2748075212 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d8156760 con 0x7f71d80d1710 2024-09-12T02:41:38.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.174+0000 7f71cfe00640 1 --2- 172.21.15.137:0/2748075212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71d80b3e00 0x7f71d80c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:41:38.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.175+0000 7f71d7400640 1 --2- 172.21.15.137:0/2748075212 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71d80d1710 0x7f71d8156220 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f71d0009f70 tx=0x7f71d0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:38.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.175+0000 7f71cea00640 1 -- 172.21.15.137:0/2748075212 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d003f020 con 0x7f71d80d1710 2024-09-12T02:41:38.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.175+0000 7f71cea00640 1 -- 172.21.15.137:0/2748075212 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71d0037040 con 0x7f71d80d1710 2024-09-12T02:41:38.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.175+0000 7f71cea00640 1 -- 172.21.15.137:0/2748075212 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d0036070 con 0x7f71d80d1710 2024-09-12T02:41:38.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.175+0000 7f71d7e00640 1 -- 172.21.15.137:0/2748075212 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71d80c8a80 con 0x7f71d80d1710 2024-09-12T02:41:38.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.175+0000 7f71d7e00640 1 -- 172.21.15.137:0/2748075212 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f71d80c9040 con 0x7f71d80d1710 2024-09-12T02:41:38.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.176+0000 7f71cea00640 1 -- 172.21.15.137:0/2748075212 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f71d0042020 con 0x7f71d80d1710 2024-09-12T02:41:38.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.176+0000 7f71cea00640 1 -- 172.21.15.137:0/2748075212 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f71d0044af0 con 0x7f71d80d1710 2024-09-12T02:41:38.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.176+0000 7f71d7e00640 1 -- 172.21.15.137:0/2748075212 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71d80d28d0 con 0x7f71d80d1710 2024-09-12T02:41:38.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.181+0000 7f71cea00640 1 -- 172.21.15.137:0/2748075212 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f71d0049030 con 0x7f71d80d1710 2024-09-12T02:41:38.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.254+0000 7f71d7e00640 1 -- 172.21.15.137:0/2748075212 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4} v 0) -- 0x7f71d806d4f0 con 0x7f71d80d1710 2024-09-12T02:41:38.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.258+0000 7f71cea00640 1 -- 172.21.15.137:0/2748075212 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f71d8156760 con 0x7f71d80d1710 2024-09-12T02:41:38.258 INFO:teuthology.orchestra.run.smithi137.stdout:4 2024-09-12T02:41:38.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.259+0000 7f71d7e00640 1 -- 172.21.15.137:0/2748075212 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71d80d1710 msgr2=0x7f71d8156220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:38.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.259+0000 7f71d7e00640 1 --2- 172.21.15.137:0/2748075212 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71d80d1710 0x7f71d8156220 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f71d0009f70 tx=0x7f71d0004a40 comp rx=0 tx=0).stop 2024-09-12T02:41:38.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.259+0000 7f71d7e00640 1 -- 172.21.15.137:0/2748075212 shutdown_connections 2024-09-12T02:41:38.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.259+0000 7f71d7e00640 1 --2- 172.21.15.137:0/2748075212 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71d80d1710 0x7f71d8156220 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.259+0000 7f71d7e00640 1 --2- 172.21.15.137:0/2748075212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71d80b3e00 0x7f71d80c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.259+0000 7f71d7e00640 1 --2- 172.21.15.137:0/2748075212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71d80b1d70 0x7f71d80b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.259+0000 7f71d7e00640 1 -- 172.21.15.137:0/2748075212 >> 172.21.15.137:0/2748075212 conn(0x7f71d809e030 msgr2=0x7f71d80b7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:38.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.259+0000 7f71d7e00640 1 -- 172.21.15.137:0/2748075212 shutdown_connections 2024-09-12T02:41:38.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.259+0000 7f71d7e00640 1 -- 172.21.15.137:0/2748075212 wait complete. 2024-09-12T02:41:38.274 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 5 2024-09-12T02:41:38.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.425+0000 7fcde8000640 1 Processor -- start 2024-09-12T02:41:38.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.425+0000 7fcde8000640 1 -- start start 2024-09-12T02:41:38.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.426+0000 7fcde8000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcde0162100 0x7fcde00d58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:38.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.426+0000 7fcde8000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcde00cfa70 con 0x7fcde00d0510 2024-09-12T02:41:38.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.426+0000 7fcde8000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcde00d21d0 con 0x7fcde01624e0 2024-09-12T02:41:38.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.426+0000 7fcde8000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fcde00b4e20 con 0x7fcde0162100 2024-09-12T02:41:38.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.426+0000 7fcde4c00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fcde01624e0 0x7fcde00b4710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39156/0 (socket says 172.21.15.137:39156) 2024-09-12T02:41:38.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.426+0000 7fcde4c00640 1 -- 172.21.15.137:0/1427308557 learned_addr learned my addr 172.21.15.137:0/1427308557 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-09-12T02:41:38.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.426+0000 7fcde5600640 1 --2- 172.21.15.137:0/1427308557 >> v2:172.21.15.112:3300/0 conn(0x7fcde0162100 0x7fcde00d58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:38.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.427+0000 7fcddfe00640 1 -- 172.21.15.137:0/1427308557 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 338407987 0 0) 0x7fcde00d21d0 con 0x7fcde01624e0 2024-09-12T02:41:38.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.427+0000 7fcddfe00640 1 -- 172.21.15.137:0/1427308557 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdc8003520 con 0x7fcde01624e0 2024-09-12T02:41:38.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.427+0000 7fcde5600640 1 -- 172.21.15.137:0/1427308557 >> v1:172.21.15.137:6789/0 conn(0x7fcde01624e0 legacy=0x7fcde00b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:38.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.427+0000 7fcde5600640 1 -- 172.21.15.137:0/1427308557 >> v1:172.21.15.112:6789/0 conn(0x7fcde00d0510 legacy=0x7fcde00d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:38.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.427+0000 7fcde5600640 1 -- 172.21.15.137:0/1427308557 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde00d24b0 con 0x7fcde0162100 2024-09-12T02:41:38.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.428+0000 7fcde5600640 1 --2- 172.21.15.137:0/1427308557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcde0162100 0x7fcde00d58d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcdd40097a0 tx=0x7fcdd402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28838ad70612d41 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:38.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.428+0000 7fcddfe00640 1 -- 172.21.15.137:0/1427308557 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4037070 con 0x7fcde0162100 2024-09-12T02:41:38.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.428+0000 7fcddfe00640 1 -- 172.21.15.137:0/1427308557 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdd4032440 con 0x7fcde0162100 2024-09-12T02:41:38.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.428+0000 7fcddfe00640 1 -- 172.21.15.137:0/1427308557 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4032810 con 0x7fcde0162100 2024-09-12T02:41:38.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.429+0000 7fcde8000640 1 -- 172.21.15.137:0/1427308557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcde0162100 msgr2=0x7fcde00d58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:38.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.429+0000 7fcde8000640 1 --2- 172.21.15.137:0/1427308557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcde0162100 0x7fcde00d58d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcdd40097a0 tx=0x7fcdd402a1a0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.429+0000 7fcde8000640 1 -- 172.21.15.137:0/1427308557 shutdown_connections 2024-09-12T02:41:38.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.429+0000 7fcde8000640 1 --2- 172.21.15.137:0/1427308557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcde0162100 0x7fcde00d58d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.429+0000 7fcde8000640 1 -- 172.21.15.137:0/1427308557 >> 172.21.15.137:0/1427308557 conn(0x7fcde00d4db0 msgr2=0x7fcde00d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:38.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.429+0000 7fcde8000640 1 -- 172.21.15.137:0/1427308557 shutdown_connections 2024-09-12T02:41:38.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.429+0000 7fcde8000640 1 -- 172.21.15.137:0/1427308557 wait complete. 2024-09-12T02:41:38.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.430+0000 7fcde8000640 1 Processor -- start 2024-09-12T02:41:38.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.431+0000 7fcde8000640 1 -- start start 2024-09-12T02:41:38.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.431+0000 7fcde8000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcde00d0510 0x7fcde00ba360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:38.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.431+0000 7fcde8000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcde0162100 0x7fcde0157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:38.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.431+0000 7fcde8000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcde01624e0 0x7fcde00c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:38.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.431+0000 7fcde8000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcde00d1df0 con 0x7fcde01624e0 2024-09-12T02:41:38.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.431+0000 7fcde8000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcde00cfff0 con 0x7fcde0162100 2024-09-12T02:41:38.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.431+0000 7fcde8000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fcde00d1f70 con 0x7fcde00d0510 2024-09-12T02:41:38.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.432+0000 7fcde4c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcde0162100 0x7fcde0157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:38.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.432+0000 7fcde5600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcde00d0510 0x7fcde00ba360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:38.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.432+0000 7fcde4c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcde0162100 0x7fcde0157250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:51298/0 (socket says 172.21.15.137:51298) 2024-09-12T02:41:38.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.432+0000 7fcde4c00640 1 -- 172.21.15.137:0/3762503205 learned_addr learned my addr 172.21.15.137:0/3762503205 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-09-12T02:41:38.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.432+0000 7fcde6000640 1 --2- 172.21.15.137:0/3762503205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcde01624e0 0x7fcde00c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:38.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.432+0000 7fcde5600640 1 -- 172.21.15.137:0/3762503205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcde0162100 msgr2=0x7fcde0157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:38.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.432+0000 7fcde5600640 1 --2- 172.21.15.137:0/3762503205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcde0162100 0x7fcde0157250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.432+0000 7fcde5600640 1 -- 172.21.15.137:0/3762503205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcde01624e0 msgr2=0x7fcde00c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:38.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.432+0000 7fcde5600640 1 --2- 172.21.15.137:0/3762503205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcde01624e0 0x7fcde00c9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.432+0000 7fcde5600640 1 -- 172.21.15.137:0/3762503205 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde00bab90 con 0x7fcde00d0510 2024-09-12T02:41:38.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.432+0000 7fcde4c00640 1 --2- 172.21.15.137:0/3762503205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcde0162100 0x7fcde0157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:41:38.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.432+0000 7fcde5600640 1 --2- 172.21.15.137:0/3762503205 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcde00d0510 0x7fcde00ba360 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4031000 tx=0x7fcdd40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:38.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.433+0000 7fcddd600640 1 -- 172.21.15.137:0/3762503205 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4041030 con 0x7fcde00d0510 2024-09-12T02:41:38.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.433+0000 7fcddd600640 1 -- 172.21.15.137:0/3762503205 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdd4030500 con 0x7fcde00d0510 2024-09-12T02:41:38.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.433+0000 7fcddd600640 1 -- 172.21.15.137:0/3762503205 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4037040 con 0x7fcde00d0510 2024-09-12T02:41:38.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.433+0000 7fcde8000640 1 -- 172.21.15.137:0/3762503205 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcde00b7ca0 con 0x7fcde00d0510 2024-09-12T02:41:38.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.433+0000 7fcde8000640 1 -- 172.21.15.137:0/3762503205 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcde00b8260 con 0x7fcde00d0510 2024-09-12T02:41:38.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.433+0000 7fcddd600640 1 -- 172.21.15.137:0/3762503205 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcdd4044070 con 0x7fcde00d0510 2024-09-12T02:41:38.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.433+0000 7fcddd600640 1 -- 172.21.15.137:0/3762503205 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fcdd403d600 con 0x7fcde00d0510 2024-09-12T02:41:38.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.434+0000 7fcde8000640 1 -- 172.21.15.137:0/3762503205 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcde0162b80 con 0x7fcde00d0510 2024-09-12T02:41:38.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.438+0000 7fcddd600640 1 -- 172.21.15.137:0/3762503205 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fcdd40308d0 con 0x7fcde00d0510 2024-09-12T02:41:38.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.510+0000 7fcde8000640 1 -- 172.21.15.137:0/3762503205 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5} v 0) -- 0x7fcde006d710 con 0x7fcde00d0510 2024-09-12T02:41:38.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.515+0000 7fcddd600640 1 -- 172.21.15.137:0/3762503205 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fcdd4030ab0 con 0x7fcde00d0510 2024-09-12T02:41:38.516 INFO:teuthology.orchestra.run.smithi137.stdout:5 2024-09-12T02:41:38.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.516+0000 7fcde8000640 1 -- 172.21.15.137:0/3762503205 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcde00d0510 msgr2=0x7fcde00ba360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:38.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.516+0000 7fcde8000640 1 --2- 172.21.15.137:0/3762503205 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcde00d0510 0x7fcde00ba360 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4031000 tx=0x7fcdd40046c0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.516+0000 7fcde8000640 1 -- 172.21.15.137:0/3762503205 shutdown_connections 2024-09-12T02:41:38.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.516+0000 7fcde8000640 1 --2- 172.21.15.137:0/3762503205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcde01624e0 0x7fcde00c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.516+0000 7fcde8000640 1 --2- 172.21.15.137:0/3762503205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcde0162100 0x7fcde0157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.516+0000 7fcde8000640 1 --2- 172.21.15.137:0/3762503205 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcde00d0510 0x7fcde00ba360 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.516+0000 7fcde8000640 1 -- 172.21.15.137:0/3762503205 >> 172.21.15.137:0/3762503205 conn(0x7fcde00d4db0 msgr2=0x7fcde00b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:38.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.516+0000 7fcde8000640 1 -- 172.21.15.137:0/3762503205 shutdown_connections 2024-09-12T02:41:38.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.516+0000 7fcde8000640 1 -- 172.21.15.137:0/3762503205 wait complete. 2024-09-12T02:41:38.532 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 6 2024-09-12T02:41:38.676 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-12T02:41:38.675+0000 7f0a2ab20040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:41:38.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.682+0000 7fcd2fe00640 1 Processor -- start 2024-09-12T02:41:38.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.683+0000 7fcd2fe00640 1 -- start start 2024-09-12T02:41:38.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.684+0000 7fcd2fe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcd300b3e00 0x7fcd300d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:38.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.684+0000 7fcd2fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd300b1d70 0x7fcd300b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:38.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.684+0000 7fcd2fe00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd300d2fb0 con 0x7fcd300d1710 2024-09-12T02:41:38.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.684+0000 7fcd2fe00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fcd300d3cb0 con 0x7fcd300b3e00 2024-09-12T02:41:38.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.684+0000 7fcd2fe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fcd300d0b60 con 0x7fcd300b1d70 2024-09-12T02:41:38.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.684+0000 7fcd27e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcd300b3e00 0x7fcd300d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:38.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.684+0000 7fcd27e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcd300b3e00 0x7fcd300d28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:51308/0 (socket says 172.21.15.137:51308) 2024-09-12T02:41:38.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.684+0000 7fcd27e00640 1 -- 172.21.15.137:0/2021727704 learned_addr learned my addr 172.21.15.137:0/2021727704 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-09-12T02:41:38.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.684+0000 7fcd2f400640 1 --2- 172.21.15.137:0/2021727704 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd300b1d70 0x7fcd300b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:38.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.684+0000 7fcd27e00640 1 -- 172.21.15.137:0/2021727704 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd300b1d70 msgr2=0x7fcd300b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:38.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.684+0000 7fcd27e00640 1 --2- 172.21.15.137:0/2021727704 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd300b1d70 0x7fcd300b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.684+0000 7fcd27e00640 1 -- 172.21.15.137:0/2021727704 >> v1:172.21.15.112:6789/0 conn(0x7fcd300d1710 legacy=0x7fcd300d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:38.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.684+0000 7fcd27e00640 1 -- 172.21.15.137:0/2021727704 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd300d3410 con 0x7fcd300b3e00 2024-09-12T02:41:38.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.685+0000 7fcd27e00640 1 --2- 172.21.15.137:0/2021727704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd300b3e00 0x7fcd300d28d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcd18009870 tx=0x7fcd1802a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5400cc5bb0cf835c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:38.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.686+0000 7fcd2e000640 1 -- 172.21.15.137:0/2021727704 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd18037070 con 0x7fcd300b3e00 2024-09-12T02:41:38.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.686+0000 7fcd2e000640 1 -- 172.21.15.137:0/2021727704 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd18032440 con 0x7fcd300b3e00 2024-09-12T02:41:38.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.686+0000 7fcd2e000640 1 -- 172.21.15.137:0/2021727704 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd18032810 con 0x7fcd300b3e00 2024-09-12T02:41:38.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.686+0000 7fcd2fe00640 1 -- 172.21.15.137:0/2021727704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd300b3e00 msgr2=0x7fcd300d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:38.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.686+0000 7fcd2fe00640 1 --2- 172.21.15.137:0/2021727704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd300b3e00 0x7fcd300d28d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcd18009870 tx=0x7fcd1802a250 comp rx=0 tx=0).stop 2024-09-12T02:41:38.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.686+0000 7fcd2fe00640 1 -- 172.21.15.137:0/2021727704 shutdown_connections 2024-09-12T02:41:38.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.686+0000 7fcd2fe00640 1 --2- 172.21.15.137:0/2021727704 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd300b1d70 0x7fcd300b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.687+0000 7fcd2fe00640 1 --2- 172.21.15.137:0/2021727704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd300b3e00 0x7fcd300d28d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.687+0000 7fcd2fe00640 1 -- 172.21.15.137:0/2021727704 >> 172.21.15.137:0/2021727704 conn(0x7fcd3009e030 msgr2=0x7fcd300d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:38.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.687+0000 7fcd2fe00640 1 -- 172.21.15.137:0/2021727704 shutdown_connections 2024-09-12T02:41:38.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.687+0000 7fcd2fe00640 1 -- 172.21.15.137:0/2021727704 wait complete. 2024-09-12T02:41:38.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.688+0000 7fcd2fe00640 1 Processor -- start 2024-09-12T02:41:38.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.688+0000 7fcd2fe00640 1 -- start start 2024-09-12T02:41:38.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.689+0000 7fcd2fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd300b1d70 0x7fcd301558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:38.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.689+0000 7fcd2fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd300b3e00 0x7fcd300ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:38.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.689+0000 7fcd2fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd300d1710 0x7fcd301608e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:38.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.689+0000 7fcd2fe00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3015f110 con 0x7fcd300d1710 2024-09-12T02:41:38.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.689+0000 7fcd2fe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcd300d39d0 con 0x7fcd300b3e00 2024-09-12T02:41:38.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.689+0000 7fcd2fe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fcd3015f290 con 0x7fcd300b1d70 2024-09-12T02:41:38.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.689+0000 7fcd2ea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd300b1d70 0x7fcd301558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:38.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.689+0000 7fcd27e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd300b3e00 0x7fcd300ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:38.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.689+0000 7fcd2ea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd300b1d70 0x7fcd301558c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:40698/0 (socket says 172.21.15.137:40698) 2024-09-12T02:41:38.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.689+0000 7fcd27e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd300b3e00 0x7fcd300ce5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:51314/0 (socket says 172.21.15.137:51314) 2024-09-12T02:41:38.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.689+0000 7fcd2ea00640 1 -- 172.21.15.137:0/3565540387 learned_addr learned my addr 172.21.15.137:0/3565540387 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-09-12T02:41:38.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.689+0000 7fcd2f400640 1 --2- 172.21.15.137:0/3565540387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd300d1710 0x7fcd301608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:38.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.690+0000 7fcd2ea00640 1 -- 172.21.15.137:0/3565540387 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd300b3e00 msgr2=0x7fcd300ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:38.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.690+0000 7fcd2ea00640 1 --2- 172.21.15.137:0/3565540387 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd300b3e00 0x7fcd300ce5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.690+0000 7fcd2ea00640 1 -- 172.21.15.137:0/3565540387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd300d1710 msgr2=0x7fcd301608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:38.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.690+0000 7fcd2ea00640 1 --2- 172.21.15.137:0/3565540387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd300d1710 0x7fcd301608e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.690+0000 7fcd2ea00640 1 -- 172.21.15.137:0/3565540387 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd3015f840 con 0x7fcd300b1d70 2024-09-12T02:41:38.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.690+0000 7fcd27e00640 1 --2- 172.21.15.137:0/3565540387 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd300b3e00 0x7fcd300ce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:41:38.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.690+0000 7fcd2f400640 1 --2- 172.21.15.137:0/3565540387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd300d1710 0x7fcd301608e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:41:38.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.690+0000 7fcd2ea00640 1 --2- 172.21.15.137:0/3565540387 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd300b1d70 0x7fcd301558c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcd2000c3c0 tx=0x7fcd2000c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:38.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.691+0000 7fcd26a00640 1 -- 172.21.15.137:0/3565540387 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd200052d0 con 0x7fcd300b1d70 2024-09-12T02:41:38.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.691+0000 7fcd26a00640 1 -- 172.21.15.137:0/3565540387 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd20005490 con 0x7fcd300b1d70 2024-09-12T02:41:38.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.691+0000 7fcd26a00640 1 -- 172.21.15.137:0/3565540387 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd20007260 con 0x7fcd300b1d70 2024-09-12T02:41:38.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.691+0000 7fcd2fe00640 1 -- 172.21.15.137:0/3565540387 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd3015fb20 con 0x7fcd300b1d70 2024-09-12T02:41:38.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.691+0000 7fcd2fe00640 1 -- 172.21.15.137:0/3565540387 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd301600e0 con 0x7fcd300b1d70 2024-09-12T02:41:38.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.691+0000 7fcd26a00640 1 -- 172.21.15.137:0/3565540387 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcd20007400 con 0x7fcd300b1d70 2024-09-12T02:41:38.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.691+0000 7fcd26a00640 1 -- 172.21.15.137:0/3565540387 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fcd200067d0 con 0x7fcd300b1d70 2024-09-12T02:41:38.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.692+0000 7fcd2fe00640 1 -- 172.21.15.137:0/3565540387 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd300d28d0 con 0x7fcd300b1d70 2024-09-12T02:41:38.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.696+0000 7fcd26a00640 1 -- 172.21.15.137:0/3565540387 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fcd20006af0 con 0x7fcd300b1d70 2024-09-12T02:41:38.738 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-12T02:41:38.736+0000 7f0a2ab20040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:41:38.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.768+0000 7fcd2fe00640 1 -- 172.21.15.137:0/3565540387 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6} v 0) -- 0x7fcd3006c620 con 0x7fcd300b1d70 2024-09-12T02:41:38.772 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-12T02:41:38.770+0000 7f7be2730040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:41:38.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.773+0000 7fcd26a00640 1 -- 172.21.15.137:0/3565540387 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fcd20006cd0 con 0x7fcd300b1d70 2024-09-12T02:41:38.775 INFO:teuthology.orchestra.run.smithi137.stdout:6 2024-09-12T02:41:38.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.774+0000 7fcd2fe00640 1 -- 172.21.15.137:0/3565540387 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd300b1d70 msgr2=0x7fcd301558c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:38.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.774+0000 7fcd2fe00640 1 --2- 172.21.15.137:0/3565540387 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd300b1d70 0x7fcd301558c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcd2000c3c0 tx=0x7fcd2000c880 comp rx=0 tx=0).stop 2024-09-12T02:41:38.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.774+0000 7fcd2fe00640 1 -- 172.21.15.137:0/3565540387 shutdown_connections 2024-09-12T02:41:38.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.774+0000 7fcd2fe00640 1 --2- 172.21.15.137:0/3565540387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd300d1710 0x7fcd301608e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.774+0000 7fcd2fe00640 1 --2- 172.21.15.137:0/3565540387 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd300b3e00 0x7fcd300ce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.774+0000 7fcd2fe00640 1 --2- 172.21.15.137:0/3565540387 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd300b1d70 0x7fcd301558c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.774+0000 7fcd2fe00640 1 -- 172.21.15.137:0/3565540387 >> 172.21.15.137:0/3565540387 conn(0x7fcd3009e030 msgr2=0x7fcd300d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:38.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.774+0000 7fcd2fe00640 1 -- 172.21.15.137:0/3565540387 shutdown_connections 2024-09-12T02:41:38.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.774+0000 7fcd2fe00640 1 -- 172.21.15.137:0/3565540387 wait complete. 2024-09-12T02:41:38.791 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 7 2024-09-12T02:41:38.838 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-12T02:41:38.837+0000 7f7be2730040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:41:38.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.949+0000 7f9277000640 1 Processor -- start 2024-09-12T02:41:38.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.949+0000 7f9277000640 1 -- start start 2024-09-12T02:41:38.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.950+0000 7f9277000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f92700b3e00 0x7f92700d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:38.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.950+0000 7f9277000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f92700b1d70 0x7f92700b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:38.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.950+0000 7f9277000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92700d2fb0 con 0x7f92700d1710 2024-09-12T02:41:38.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.950+0000 7f9277000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f92700d3cb0 con 0x7f92700b1d70 2024-09-12T02:41:38.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.950+0000 7f9277000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f92700d0b60 con 0x7f92700b3e00 2024-09-12T02:41:38.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.950+0000 7f9275200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f92700b3e00 0x7f92700d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:38.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.951+0000 7f9275200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f92700b3e00 0x7f92700d28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:51326/0 (socket says 172.21.15.137:51326) 2024-09-12T02:41:38.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.951+0000 7f9275200640 1 -- 172.21.15.137:0/888876500 learned_addr learned my addr 172.21.15.137:0/888876500 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-09-12T02:41:38.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.951+0000 7f9275c00640 1 --1- 172.21.15.137:0/888876500 >> v1:172.21.15.137:6789/0 conn(0x7f92700d1710 0x7f92700d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39158/0 (socket says 172.21.15.137:39158) 2024-09-12T02:41:38.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.951+0000 7f9276600640 1 --2- 172.21.15.137:0/888876500 >> v2:172.21.15.112:3300/0 conn(0x7f92700b1d70 0x7f92700b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:38.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.951+0000 7f9275200640 1 -- 172.21.15.137:0/888876500 >> v2:172.21.15.112:3300/0 conn(0x7f92700b1d70 msgr2=0x7f92700b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:38.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.951+0000 7f9275200640 1 --2- 172.21.15.137:0/888876500 >> v2:172.21.15.112:3300/0 conn(0x7f92700b1d70 0x7f92700b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.951+0000 7f9275200640 1 -- 172.21.15.137:0/888876500 >> v1:172.21.15.137:6789/0 conn(0x7f92700d1710 legacy=0x7f92700d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:38.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.951+0000 7f9275200640 1 -- 172.21.15.137:0/888876500 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92700d3410 con 0x7f92700b3e00 2024-09-12T02:41:38.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.952+0000 7f9275200640 1 --2- 172.21.15.137:0/888876500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92700b3e00 0x7f92700d28d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f92700d1190 tx=0x7f925c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=361a72f52c799643 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:38.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.952+0000 7f926fe00640 1 -- 172.21.15.137:0/888876500 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c037070 con 0x7f92700b3e00 2024-09-12T02:41:38.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.952+0000 7f926fe00640 1 -- 172.21.15.137:0/888876500 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f925c032440 con 0x7f92700b3e00 2024-09-12T02:41:38.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.952+0000 7f926fe00640 1 -- 172.21.15.137:0/888876500 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c032810 con 0x7f92700b3e00 2024-09-12T02:41:38.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.953+0000 7f9277000640 1 -- 172.21.15.137:0/888876500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92700b3e00 msgr2=0x7f92700d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:38.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.953+0000 7f9277000640 1 --2- 172.21.15.137:0/888876500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92700b3e00 0x7f92700d28d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f92700d1190 tx=0x7f925c02a270 comp rx=0 tx=0).stop 2024-09-12T02:41:38.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.953+0000 7f9277000640 1 -- 172.21.15.137:0/888876500 shutdown_connections 2024-09-12T02:41:38.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.953+0000 7f9277000640 1 --2- 172.21.15.137:0/888876500 >> v2:172.21.15.112:3300/0 conn(0x7f92700b1d70 0x7f92700b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.953+0000 7f9277000640 1 --2- 172.21.15.137:0/888876500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92700b3e00 0x7f92700d28d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.953+0000 7f9277000640 1 -- 172.21.15.137:0/888876500 >> 172.21.15.137:0/888876500 conn(0x7f927009e030 msgr2=0x7f92700d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:38.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.953+0000 7f9277000640 1 -- 172.21.15.137:0/888876500 shutdown_connections 2024-09-12T02:41:38.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.953+0000 7f9277000640 1 -- 172.21.15.137:0/888876500 wait complete. 2024-09-12T02:41:38.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.955+0000 7f9277000640 1 Processor -- start 2024-09-12T02:41:38.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.955+0000 7f9277000640 1 -- start start 2024-09-12T02:41:38.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.956+0000 7f9277000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92700b1d70 0x7f9270157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:38.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.956+0000 7f9277000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92700b3e00 0x7f927015f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:38.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.956+0000 7f9277000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92700d1710 0x7f927015f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:38.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.956+0000 7f9277000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f927015f110 con 0x7f92700d1710 2024-09-12T02:41:38.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.956+0000 7f9277000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f92700d39d0 con 0x7f92700b3e00 2024-09-12T02:41:38.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.956+0000 7f9277000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f927015f290 con 0x7f92700b1d70 2024-09-12T02:41:38.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.956+0000 7f9275200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92700b3e00 0x7f927015f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:38.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.956+0000 7f9275c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92700b1d70 0x7f9270157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:38.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.956+0000 7f9275200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92700b3e00 0x7f927015f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:51338/0 (socket says 172.21.15.137:51338) 2024-09-12T02:41:38.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.956+0000 7f9275200640 1 -- 172.21.15.137:0/3571013648 learned_addr learned my addr 172.21.15.137:0/3571013648 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-09-12T02:41:38.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.956+0000 7f9276600640 1 --2- 172.21.15.137:0/3571013648 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92700d1710 0x7f927015f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:38.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.956+0000 7f9275200640 1 -- 172.21.15.137:0/3571013648 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92700b1d70 msgr2=0x7f9270157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:38.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.956+0000 7f9275200640 1 --2- 172.21.15.137:0/3571013648 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92700b1d70 0x7f9270157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.956+0000 7f9275200640 1 -- 172.21.15.137:0/3571013648 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92700d1710 msgr2=0x7f927015f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:38.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.956+0000 7f9275200640 1 --2- 172.21.15.137:0/3571013648 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92700d1710 0x7f927015f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:38.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.956+0000 7f9275200640 1 -- 172.21.15.137:0/3571013648 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9270158080 con 0x7f92700b3e00 2024-09-12T02:41:38.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.957+0000 7f9275200640 1 --2- 172.21.15.137:0/3571013648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92700b3e00 0x7f927015f410 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f925c000c00 tx=0x7f925c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:38.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.957+0000 7f926d600640 1 -- 172.21.15.137:0/3571013648 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c041020 con 0x7f92700b3e00 2024-09-12T02:41:38.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.957+0000 7f926d600640 1 -- 172.21.15.137:0/3571013648 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f925c0306c0 con 0x7f92700b3e00 2024-09-12T02:41:38.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.957+0000 7f9277000640 1 -- 172.21.15.137:0/3571013648 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9270161dc0 con 0x7f92700b3e00 2024-09-12T02:41:38.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.957+0000 7f926d600640 1 -- 172.21.15.137:0/3571013648 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c037040 con 0x7f92700b3e00 2024-09-12T02:41:38.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.957+0000 7f9277000640 1 -- 172.21.15.137:0/3571013648 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9270162380 con 0x7f92700b3e00 2024-09-12T02:41:38.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.957+0000 7f926d600640 1 -- 172.21.15.137:0/3571013648 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f925c044020 con 0x7f92700b3e00 2024-09-12T02:41:38.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.958+0000 7f926d600640 1 -- 172.21.15.137:0/3571013648 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f925c03dc40 con 0x7f92700b3e00 2024-09-12T02:41:38.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.958+0000 7f9277000640 1 -- 172.21.15.137:0/3571013648 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92700d28d0 con 0x7f92700b3e00 2024-09-12T02:41:38.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:38.960+0000 7f926d600640 1 -- 172.21.15.137:0/3571013648 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f925c04b030 con 0x7f92700b3e00 2024-09-12T02:41:39.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:39.033+0000 7f9277000640 1 -- 172.21.15.137:0/3571013648 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7} v 0) -- 0x7f9270069020 con 0x7f92700b3e00 2024-09-12T02:41:39.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:39.038+0000 7f926d600640 1 -- 172.21.15.137:0/3571013648 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f9270158080 con 0x7f92700b3e00 2024-09-12T02:41:39.040 INFO:teuthology.orchestra.run.smithi137.stdout:7 2024-09-12T02:41:39.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:39.039+0000 7f9277000640 1 -- 172.21.15.137:0/3571013648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92700b3e00 msgr2=0x7f927015f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:39.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:39.039+0000 7f9277000640 1 --2- 172.21.15.137:0/3571013648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92700b3e00 0x7f927015f410 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f925c000c00 tx=0x7f925c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:39.039+0000 7f9277000640 1 -- 172.21.15.137:0/3571013648 shutdown_connections 2024-09-12T02:41:39.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:39.039+0000 7f9277000640 1 --2- 172.21.15.137:0/3571013648 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92700d1710 0x7f927015f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:39.039+0000 7f9277000640 1 --2- 172.21.15.137:0/3571013648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92700b3e00 0x7f927015f410 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:39.039+0000 7f9277000640 1 --2- 172.21.15.137:0/3571013648 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92700b1d70 0x7f9270157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:39.039+0000 7f9277000640 1 -- 172.21.15.137:0/3571013648 >> 172.21.15.137:0/3571013648 conn(0x7f927009e030 msgr2=0x7f92700cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:39.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:39.039+0000 7f9277000640 1 -- 172.21.15.137:0/3571013648 shutdown_connections 2024-09-12T02:41:39.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:41:39.039+0000 7f9277000640 1 -- 172.21.15.137:0/3571013648 wait complete. 2024-09-12T02:41:39.055 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T02:41:39.055 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T02:41:39.059 INFO:tasks.ceph.osd.0:Started 2024-09-12T02:41:39.059 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T02:41:39.060 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T02:41:39.065 INFO:tasks.ceph.osd.1:Started 2024-09-12T02:41:39.065 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T02:41:39.065 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T02:41:39.070 INFO:tasks.ceph.osd.2:Started 2024-09-12T02:41:39.071 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T02:41:39.071 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T02:41:39.078 INFO:tasks.ceph.osd.3:Started 2024-09-12T02:41:39.078 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T02:41:39.079 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T02:41:39.101 INFO:tasks.ceph.osd.4:Started 2024-09-12T02:41:39.101 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T02:41:39.101 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T02:41:39.108 INFO:tasks.ceph.osd.5:Started 2024-09-12T02:41:39.108 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T02:41:39.108 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T02:41:39.114 INFO:tasks.ceph.osd.6:Started 2024-09-12T02:41:39.115 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T02:41:39.115 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T02:41:39.120 INFO:tasks.ceph.osd.7:Started 2024-09-12T02:41:39.121 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:41:39.220 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-12T02:41:39.219+0000 7f552c3a2640 -1 Falling back to public interface 2024-09-12T02:41:39.227 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-12T02:41:39.226+0000 7f0a2ab20040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:41:39.237 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-12T02:41:39.236+0000 7f552c3a2640 -1 osd.0 0 log_to_monitors true 2024-09-12T02:41:39.239 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-12T02:41:39.238+0000 7f4d23a15640 -1 Falling back to public interface 2024-09-12T02:41:39.249 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-12T02:41:39.248+0000 7f4f3e789640 -1 Falling back to public interface 2024-09-12T02:41:39.249 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-12T02:41:39.248+0000 7f49a5cb6640 -1 Falling back to public interface 2024-09-12T02:41:39.257 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-12T02:41:39.255+0000 7f68ec2d4640 -1 Falling back to public interface 2024-09-12T02:41:39.261 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-12T02:41:39.259+0000 7f3dee9dd640 -1 Falling back to public interface 2024-09-12T02:41:39.267 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-12T02:41:39.267+0000 7f4d23a15640 -1 osd.1 0 log_to_monitors true 2024-09-12T02:41:39.270 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-12T02:41:39.268+0000 7f49a5cb6640 -1 osd.4 0 log_to_monitors true 2024-09-12T02:41:39.274 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-12T02:41:39.273+0000 7f3f7b019640 -1 Falling back to public interface 2024-09-12T02:41:39.279 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-12T02:41:39.279+0000 7f4f3e789640 -1 osd.2 0 log_to_monitors true 2024-09-12T02:41:39.283 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-12T02:41:39.282+0000 7f3dee9dd640 -1 osd.6 0 log_to_monitors true 2024-09-12T02:41:39.284 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-12T02:41:39.282+0000 7f68ec2d4640 -1 osd.5 0 log_to_monitors true 2024-09-12T02:41:39.302 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-12T02:41:39.301+0000 7f3f7b019640 -1 osd.3 0 log_to_monitors true 2024-09-12T02:41:39.308 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-12T02:41:39.306+0000 7fe7f8816640 -1 Falling back to public interface 2024-09-12T02:41:39.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.326+0000 7ff5d0e00640 1 Processor -- start 2024-09-12T02:41:39.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.326+0000 7ff5d0e00640 1 -- start start 2024-09-12T02:41:39.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.327+0000 7ff5d0e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5cc0d1710 0x7ff5cc0d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:39.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.327+0000 7ff5d0e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff5cc0b3e00 0x7ff5cc0d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:39.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.327+0000 7ff5d0e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff5cc0cf7a0 0x7ff5cc0cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:39.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.327+0000 7ff5d0e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff5cc0d3cb0 con 0x7ff5cc0cf7a0 2024-09-12T02:41:39.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.327+0000 7ff5d0e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff5cc0d2fb0 con 0x7ff5cc0b3e00 2024-09-12T02:41:39.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.327+0000 7ff5d0e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff5cc0d0b60 con 0x7ff5cc0d1710 2024-09-12T02:41:39.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.327+0000 7ff5cbe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff5cc0cf7a0 0x7ff5cc0cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:39.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.327+0000 7ff5cbe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff5cc0cf7a0 0x7ff5cc0cfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45896/0 (socket says 172.21.15.112:45896) 2024-09-12T02:41:39.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.327+0000 7ff5cbe00640 1 -- 172.21.15.112:0/3400688447 learned_addr learned my addr 172.21.15.112:0/3400688447 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:39.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.327+0000 7ff5caa00640 1 --2- 172.21.15.112:0/3400688447 >> v2:172.21.15.137:3300/0 conn(0x7ff5cc0b3e00 0x7ff5cc0d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:39.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.327+0000 7ff5cb400640 1 --2- 172.21.15.112:0/3400688447 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5cc0d1710 0x7ff5cc0d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:39.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.328+0000 7ff5cbe00640 1 -- 172.21.15.112:0/3400688447 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5cc0d1710 msgr2=0x7ff5cc0d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:39.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.328+0000 7ff5cbe00640 1 --2- 172.21.15.112:0/3400688447 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5cc0d1710 0x7ff5cc0d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.328+0000 7ff5cbe00640 1 -- 172.21.15.112:0/3400688447 >> v2:172.21.15.137:3300/0 conn(0x7ff5cc0b3e00 msgr2=0x7ff5cc0d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:39.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.328+0000 7ff5cbe00640 1 --2- 172.21.15.112:0/3400688447 >> v2:172.21.15.137:3300/0 conn(0x7ff5cc0b3e00 0x7ff5cc0d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.328+0000 7ff5cbe00640 1 -- 172.21.15.112:0/3400688447 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5cc0d2030 con 0x7ff5cc0cf7a0 2024-09-12T02:41:39.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.328+0000 7ff5cb400640 1 --2- 172.21.15.112:0/3400688447 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5cc0d1710 0x7ff5cc0d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:41:39.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.329+0000 7ff5cbe00640 1 --2- 172.21.15.112:0/3400688447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5cc0cf7a0 0x7ff5cc0cfc50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc06ee50 tx=0x7ff5c402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9746cf3476822964 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:39.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.329+0000 7ff5ca000640 1 -- 172.21.15.112:0/3400688447 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4036070 con 0x7ff5cc0cf7a0 2024-09-12T02:41:39.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.329+0000 7ff5ca000640 1 -- 172.21.15.112:0/3400688447 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5c4031600 con 0x7ff5cc0cf7a0 2024-09-12T02:41:39.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.329+0000 7ff5ca000640 1 -- 172.21.15.112:0/3400688447 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c40319d0 con 0x7ff5cc0cf7a0 2024-09-12T02:41:39.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.329+0000 7ff5d0e00640 1 -- 172.21.15.112:0/3400688447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5cc0cf7a0 msgr2=0x7ff5cc0cfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:39.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.329+0000 7ff5d0e00640 1 --2- 172.21.15.112:0/3400688447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5cc0cf7a0 0x7ff5cc0cfc50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc06ee50 tx=0x7ff5c402a6a0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.330+0000 7ff5d0e00640 1 -- 172.21.15.112:0/3400688447 shutdown_connections 2024-09-12T02:41:39.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.330+0000 7ff5d0e00640 1 --2- 172.21.15.112:0/3400688447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5cc0cf7a0 0x7ff5cc0cfc50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.330+0000 7ff5d0e00640 1 --2- 172.21.15.112:0/3400688447 >> v2:172.21.15.137:3300/0 conn(0x7ff5cc0b3e00 0x7ff5cc0d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.330+0000 7ff5d0e00640 1 --2- 172.21.15.112:0/3400688447 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5cc0d1710 0x7ff5cc0d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.330+0000 7ff5d0e00640 1 -- 172.21.15.112:0/3400688447 >> 172.21.15.112:0/3400688447 conn(0x7ff5cc09e030 msgr2=0x7ff5cc0d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:39.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.330+0000 7ff5d0e00640 1 -- 172.21.15.112:0/3400688447 shutdown_connections 2024-09-12T02:41:39.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.330+0000 7ff5d0e00640 1 -- 172.21.15.112:0/3400688447 wait complete. 2024-09-12T02:41:39.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.331+0000 7ff5d0e00640 1 Processor -- start 2024-09-12T02:41:39.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.331+0000 7ff5d0e00640 1 -- start start 2024-09-12T02:41:39.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.332+0000 7ff5d0e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5cc0b3e00 0x7ff5cc1f9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:39.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.332+0000 7ff5d0e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5cc0cf7a0 0x7ff5cc0ce420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:39.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.332+0000 7ff5d0e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5cc0d1710 0x7ff5cc15f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:39.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.332+0000 7ff5d0e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff5cc0d39d0 con 0x7ff5cc0d1710 2024-09-12T02:41:39.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.332+0000 7ff5d0e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff5cc0d36f0 con 0x7ff5cc0cf7a0 2024-09-12T02:41:39.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.332+0000 7ff5d0e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff5cc15f110 con 0x7ff5cc0b3e00 2024-09-12T02:41:39.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.333+0000 7ff5cbe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5cc0d1710 0x7ff5cc15f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:39.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.333+0000 7ff5cbe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5cc0d1710 0x7ff5cc15f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45900/0 (socket says 172.21.15.112:45900) 2024-09-12T02:41:39.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.333+0000 7ff5cbe00640 1 -- 172.21.15.112:0/743635675 learned_addr learned my addr 172.21.15.112:0/743635675 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:39.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.333+0000 7ff5caa00640 1 --2- 172.21.15.112:0/743635675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5cc0cf7a0 0x7ff5cc0ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:39.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.333+0000 7ff5cb400640 1 --2- 172.21.15.112:0/743635675 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5cc0b3e00 0x7ff5cc1f9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:39.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.333+0000 7ff5cbe00640 1 -- 172.21.15.112:0/743635675 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5cc0b3e00 msgr2=0x7ff5cc1f9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:39.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.333+0000 7ff5cbe00640 1 --2- 172.21.15.112:0/743635675 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5cc0b3e00 0x7ff5cc1f9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.333+0000 7ff5cbe00640 1 -- 172.21.15.112:0/743635675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5cc0cf7a0 msgr2=0x7ff5cc0ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:39.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.333+0000 7ff5cbe00640 1 --2- 172.21.15.112:0/743635675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5cc0cf7a0 0x7ff5cc0ce420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.333+0000 7ff5cbe00640 1 -- 172.21.15.112:0/743635675 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5cc15bab0 con 0x7ff5cc0d1710 2024-09-12T02:41:39.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.333+0000 7ff5cbe00640 1 --2- 172.21.15.112:0/743635675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5cc0d1710 0x7ff5cc15f680 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4034040 tx=0x7ff5c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:39.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.334+0000 7ff5c3400640 1 -- 172.21.15.112:0/743635675 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4041020 con 0x7ff5cc0d1710 2024-09-12T02:41:39.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.334+0000 7ff5c3400640 1 -- 172.21.15.112:0/743635675 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5c40077a0 con 0x7ff5cc0d1710 2024-09-12T02:41:39.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.334+0000 7ff5c3400640 1 -- 172.21.15.112:0/743635675 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4036040 con 0x7ff5cc0d1710 2024-09-12T02:41:39.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.334+0000 7ff5d0e00640 1 -- 172.21.15.112:0/743635675 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5cc1619a0 con 0x7ff5cc0d1710 2024-09-12T02:41:39.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.334+0000 7ff5d0e00640 1 -- 172.21.15.112:0/743635675 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5cc161f60 con 0x7ff5cc0d1710 2024-09-12T02:41:39.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.334+0000 7ff5c3400640 1 -- 172.21.15.112:0/743635675 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff5c4044020 con 0x7ff5cc0d1710 2024-09-12T02:41:39.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.334+0000 7ff5c3400640 1 -- 172.21.15.112:0/743635675 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7ff5c403ccd0 con 0x7ff5cc0d1710 2024-09-12T02:41:39.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.335+0000 7ff5d0e00640 1 -- 172.21.15.112:0/743635675 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5cc0d1af0 con 0x7ff5cc0d1710 2024-09-12T02:41:39.338 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-12T02:41:39.337+0000 7fe7f8816640 -1 osd.7 0 log_to_monitors true 2024-09-12T02:41:39.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.338+0000 7ff5c3400640 1 -- 172.21.15.112:0/743635675 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ff5c404b030 con 0x7ff5cc0d1710 2024-09-12T02:41:39.352 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-12T02:41:39.352+0000 7f0a2ab20040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:41:39.375 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-12T02:41:39.373+0000 7f7be2730040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:41:39.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.400+0000 7ff5d0e00640 1 -- 172.21.15.112:0/743635675 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5cc0b7470 con 0x7ff5cc0d1710 2024-09-12T02:41:39.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.400+0000 7ff5c3400640 1 -- 172.21.15.112:0/743635675 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7ff5c4007b70 con 0x7ff5cc0d1710 2024-09-12T02:41:39.401 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:39.401 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":10,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:41:39.036600+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:41:39.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.401+0000 7ff5d0e00640 1 -- 172.21.15.112:0/743635675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5cc0d1710 msgr2=0x7ff5cc15f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:39.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.401+0000 7ff5d0e00640 1 --2- 172.21.15.112:0/743635675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5cc0d1710 0x7ff5cc15f680 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4034040 tx=0x7ff5c4004a40 comp rx=0 tx=0).stop 2024-09-12T02:41:39.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.402+0000 7ff5d0e00640 1 -- 172.21.15.112:0/743635675 shutdown_connections 2024-09-12T02:41:39.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.402+0000 7ff5d0e00640 1 --2- 172.21.15.112:0/743635675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5cc0d1710 0x7ff5cc15f680 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.402+0000 7ff5d0e00640 1 --2- 172.21.15.112:0/743635675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5cc0cf7a0 0x7ff5cc0ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.402+0000 7ff5d0e00640 1 --2- 172.21.15.112:0/743635675 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5cc0b3e00 0x7ff5cc1f9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:39.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.402+0000 7ff5d0e00640 1 -- 172.21.15.112:0/743635675 >> 172.21.15.112:0/743635675 conn(0x7ff5cc09e030 msgr2=0x7ff5cc0b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:39.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.402+0000 7ff5d0e00640 1 -- 172.21.15.112:0/743635675 shutdown_connections 2024-09-12T02:41:39.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:39.402+0000 7ff5d0e00640 1 -- 172.21.15.112:0/743635675 wait complete. 2024-09-12T02:41:39.418 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T02:41:39.418 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T02:41:39.476 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-12T02:41:39.474+0000 7f7be2730040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:41:39.477 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-12T02:41:39.476+0000 7f0a2ab20040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:41:39.530 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-12T02:41:39.529+0000 7f0a2ab20040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:41:39.599 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-12T02:41:39.597+0000 7f7be2730040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:41:39.652 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-12T02:41:39.651+0000 7f7be2730040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:41:39.655 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-12T02:41:39.655+0000 7f0a2ab20040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:41:39.716 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-12T02:41:39.715+0000 7f0a2ab20040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:41:39.768 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-12T02:41:39.767+0000 7f0a2ab20040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:41:39.778 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-12T02:41:39.776+0000 7f7be2730040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:41:39.840 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-12T02:41:39.839+0000 7f7be2730040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:41:39.892 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-12T02:41:39.890+0000 7f7be2730040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:41:39.893 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-12T02:41:39.892+0000 7f0a2ab20040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:41:39.951 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-12T02:41:39.950+0000 7f0a2ab20040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:41:40.011 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-12T02:41:40.010+0000 7f0a2ab20040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:41:40.018 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-12T02:41:40.016+0000 7f7be2730040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:41:40.082 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-12T02:41:40.080+0000 7f7be2730040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:41:40.088 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-12T02:41:40.087+0000 7f0a2ab20040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:41:40.139 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-12T02:41:40.138+0000 7f0a2ab20040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:41:40.144 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-12T02:41:40.143+0000 7f7be2730040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:41:40.192 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-12T02:41:40.191+0000 7f0a2ab20040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:41:40.223 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T02:41:40.225 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-12T02:41:40.223+0000 7f7be2730040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:41:40.277 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-12T02:41:40.275+0000 7f7be2730040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:41:40.328 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-12T02:41:40.327+0000 7f7be2730040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:41:40.359 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.358+0000 7f6390400640 1 Processor -- start 2024-09-12T02:41:40.359 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.358+0000 7f6390400640 1 -- start start 2024-09-12T02:41:40.361 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.359+0000 7f6390400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f638815f050 0x7f63880b6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:40.361 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.359+0000 7f6390400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f63880b7020 0x7f63880d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:40.361 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.359+0000 7f6390400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f63880d39c0 0x7f63880d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:40.361 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.359+0000 7f6390400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f63880b7460 con 0x7f63880d39c0 2024-09-12T02:41:40.361 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.359+0000 7f6390400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f638815f430 con 0x7f63880b7020 2024-09-12T02:41:40.361 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.359+0000 7f6390400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f63880d4140 con 0x7f638815f050 2024-09-12T02:41:40.361 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.359+0000 7f638e400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f63880d39c0 0x7f63880d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:40.361 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.359+0000 7f638e400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f63880d39c0 0x7f63880d1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45914/0 (socket says 172.21.15.112:45914) 2024-09-12T02:41:40.361 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.359+0000 7f638e400640 1 -- 172.21.15.112:0/3483058353 learned_addr learned my addr 172.21.15.112:0/3483058353 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:40.362 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.359+0000 7f638da00640 1 --2- 172.21.15.112:0/3483058353 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f638815f050 0x7f63880b6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:40.362 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.359+0000 7f638d000640 1 --2- 172.21.15.112:0/3483058353 >> v2:172.21.15.137:3300/0 conn(0x7f63880b7020 0x7f63880d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:40.362 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.360+0000 7f638e400640 1 -- 172.21.15.112:0/3483058353 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f638815f050 msgr2=0x7f63880b6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:40.362 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.360+0000 7f638e400640 1 --2- 172.21.15.112:0/3483058353 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f638815f050 0x7f63880b6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:40.362 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.360+0000 7f638e400640 1 -- 172.21.15.112:0/3483058353 >> v2:172.21.15.137:3300/0 conn(0x7f63880b7020 msgr2=0x7f63880d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:40.362 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.360+0000 7f638e400640 1 --2- 172.21.15.112:0/3483058353 >> v2:172.21.15.137:3300/0 conn(0x7f63880b7020 0x7f63880d3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:40.362 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.360+0000 7f638e400640 1 -- 172.21.15.112:0/3483058353 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63880d4420 con 0x7f63880d39c0 2024-09-12T02:41:40.363 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.361+0000 7f638e400640 1 --2- 172.21.15.112:0/3483058353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63880d39c0 0x7f63880d1990 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f638808d440 tx=0x7f638002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d693fde1c1d1ab4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:40.363 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.361+0000 7f6387e00640 1 -- 172.21.15.112:0/3483058353 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6380036070 con 0x7f63880d39c0 2024-09-12T02:41:40.363 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.361+0000 7f6387e00640 1 -- 172.21.15.112:0/3483058353 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6380031600 con 0x7f63880d39c0 2024-09-12T02:41:40.363 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.361+0000 7f6387e00640 1 -- 172.21.15.112:0/3483058353 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63800319d0 con 0x7f63880d39c0 2024-09-12T02:41:40.363 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.362+0000 7f6390400640 1 -- 172.21.15.112:0/3483058353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63880d39c0 msgr2=0x7f63880d1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:40.364 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.362+0000 7f6390400640 1 --2- 172.21.15.112:0/3483058353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63880d39c0 0x7f63880d1990 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f638808d440 tx=0x7f638002a6a0 comp rx=0 tx=0).stop 2024-09-12T02:41:40.364 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.362+0000 7f6390400640 1 -- 172.21.15.112:0/3483058353 shutdown_connections 2024-09-12T02:41:40.364 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.362+0000 7f6390400640 1 --2- 172.21.15.112:0/3483058353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63880d39c0 0x7f63880d1990 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:40.364 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.362+0000 7f6390400640 1 --2- 172.21.15.112:0/3483058353 >> v2:172.21.15.137:3300/0 conn(0x7f63880b7020 0x7f63880d3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:40.364 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.362+0000 7f6390400640 1 --2- 172.21.15.112:0/3483058353 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f638815f050 0x7f63880b6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:40.364 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.362+0000 7f6390400640 1 -- 172.21.15.112:0/3483058353 >> 172.21.15.112:0/3483058353 conn(0x7f638806bbe0 msgr2=0x7f638806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:40.364 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.362+0000 7f6390400640 1 -- 172.21.15.112:0/3483058353 shutdown_connections 2024-09-12T02:41:40.364 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.362+0000 7f6390400640 1 -- 172.21.15.112:0/3483058353 wait complete. 2024-09-12T02:41:40.365 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.364+0000 7f6390400640 1 Processor -- start 2024-09-12T02:41:40.365 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.364+0000 7f6390400640 1 -- start start 2024-09-12T02:41:40.367 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.365+0000 7f6390400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63880b7020 0x7f6388155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:40.367 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.365+0000 7f6390400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63880d39c0 0x7f63881f41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:40.368 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.365+0000 7f6390400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f638815f050 0x7f63880ce420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:40.368 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.365+0000 7f6390400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f63880d3e50 con 0x7f638815f050 2024-09-12T02:41:40.368 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.365+0000 7f6390400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f63880d49e0 con 0x7f63880d39c0 2024-09-12T02:41:40.368 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.365+0000 7f6390400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f63880d1ed0 con 0x7f63880b7020 2024-09-12T02:41:40.368 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.365+0000 7f638e400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f638815f050 0x7f63880ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:40.368 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.365+0000 7f638d000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63880d39c0 0x7f63881f41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:40.368 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.365+0000 7f638da00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63880b7020 0x7f6388155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:40.368 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.365+0000 7f638d000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63880d39c0 0x7f63881f41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:40230/0 (socket says 172.21.15.112:40230) 2024-09-12T02:41:40.368 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.365+0000 7f638d000640 1 -- 172.21.15.112:0/1044994666 learned_addr learned my addr 172.21.15.112:0/1044994666 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:40.368 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.365+0000 7f638e400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f638815f050 0x7f63880ce420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45918/0 (socket says 172.21.15.112:45918) 2024-09-12T02:41:40.368 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.366+0000 7f638e400640 1 -- 172.21.15.112:0/1044994666 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63880b7020 msgr2=0x7f6388155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:40.369 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.366+0000 7f638e400640 1 --2- 172.21.15.112:0/1044994666 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63880b7020 0x7f6388155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:40.369 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.366+0000 7f638e400640 1 -- 172.21.15.112:0/1044994666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63880d39c0 msgr2=0x7f63881f41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:40.369 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.366+0000 7f638e400640 1 --2- 172.21.15.112:0/1044994666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63880d39c0 0x7f63881f41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:40.369 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.366+0000 7f638e400640 1 -- 172.21.15.112:0/1044994666 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6388155680 con 0x7f638815f050 2024-09-12T02:41:40.369 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.366+0000 7f638da00640 1 --2- 172.21.15.112:0/1044994666 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63880b7020 0x7f6388155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:41:40.369 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.366+0000 7f638d000640 1 --2- 172.21.15.112:0/1044994666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63880d39c0 0x7f63881f41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:41:40.369 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.366+0000 7f638e400640 1 --2- 172.21.15.112:0/1044994666 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f638815f050 0x7f63880ce420 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6380030000 tx=0x7f6380004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:40.369 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.366+0000 7f6385600640 1 -- 172.21.15.112:0/1044994666 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6380041020 con 0x7f638815f050 2024-09-12T02:41:40.369 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.366+0000 7f6385600640 1 -- 172.21.15.112:0/1044994666 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63800077a0 con 0x7f638815f050 2024-09-12T02:41:40.369 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.366+0000 7f6385600640 1 -- 172.21.15.112:0/1044994666 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6380036040 con 0x7f638815f050 2024-09-12T02:41:40.369 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.366+0000 7f6390400640 1 -- 172.21.15.112:0/1044994666 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63881540a0 con 0x7f638815f050 2024-09-12T02:41:40.369 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.366+0000 7f6390400640 1 -- 172.21.15.112:0/1044994666 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6388154940 con 0x7f638815f050 2024-09-12T02:41:40.370 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.367+0000 7f6385600640 1 -- 172.21.15.112:0/1044994666 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6380044020 con 0x7f638815f050 2024-09-12T02:41:40.370 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.367+0000 7f6385600640 1 -- 172.21.15.112:0/1044994666 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1883+0+0 (secure 0 0 0) 0x7f638003cdc0 con 0x7f638815f050 2024-09-12T02:41:40.370 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.367+0000 7f6390400640 1 -- 172.21.15.112:0/1044994666 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63880b8d50 con 0x7f638815f050 2024-09-12T02:41:40.371 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.370+0000 7f6385600640 1 -- 172.21.15.112:0/1044994666 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f638004b030 con 0x7f638815f050 2024-09-12T02:41:40.432 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.431+0000 7f6390400640 1 -- 172.21.15.112:0/1044994666 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63880b8a70 con 0x7f638815f050 2024-09-12T02:41:40.432 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.432+0000 7f6385600640 1 -- 172.21.15.112:0/1044994666 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) ==== 74+0+7058 (secure 0 0 0) 0x7f6380007b90 con 0x7f638815f050 2024-09-12T02:41:40.433 INFO:teuthology.misc.health.smithi112.stdout: 2024-09-12T02:41:40.433 INFO:teuthology.misc.health.smithi112.stdout:{"epoch":11,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:41:40.180661+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:41:40.434 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.433+0000 7f6390400640 1 -- 172.21.15.112:0/1044994666 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f638815f050 msgr2=0x7f63880ce420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:40.434 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.433+0000 7f6390400640 1 --2- 172.21.15.112:0/1044994666 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f638815f050 0x7f63880ce420 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6380030000 tx=0x7f6380004a40 comp rx=0 tx=0).stop 2024-09-12T02:41:40.434 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.433+0000 7f6390400640 1 -- 172.21.15.112:0/1044994666 shutdown_connections 2024-09-12T02:41:40.434 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.433+0000 7f6390400640 1 --2- 172.21.15.112:0/1044994666 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f638815f050 0x7f63880ce420 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:40.434 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.433+0000 7f6390400640 1 --2- 172.21.15.112:0/1044994666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63880d39c0 0x7f63881f41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:40.434 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.433+0000 7f6390400640 1 --2- 172.21.15.112:0/1044994666 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63880b7020 0x7f6388155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:40.434 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.433+0000 7f6390400640 1 -- 172.21.15.112:0/1044994666 >> 172.21.15.112:0/1044994666 conn(0x7f638806bbe0 msgr2=0x7f63880cc050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:40.434 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.433+0000 7f6390400640 1 -- 172.21.15.112:0/1044994666 shutdown_connections 2024-09-12T02:41:40.434 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:40.433+0000 7f6390400640 1 -- 172.21.15.112:0/1044994666 wait complete. 2024-09-12T02:41:40.446 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T02:41:40.942 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-12T02:41:40.941+0000 7f0a2ab20040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:41:41.071 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-12T02:41:41.070+0000 7f7be2730040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:41:41.190 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-12T02:41:41.188+0000 7fe7f3000640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T02:41:41.191 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-12T02:41:41.190+0000 7f3f75800640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T02:41:41.192 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-12T02:41:41.191+0000 7fe7eae00640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:41:41.194 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-12T02:41:41.193+0000 7f3de9800640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T02:41:41.195 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-12T02:41:41.194+0000 7f49a0c00640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T02:41:41.195 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-12T02:41:41.194+0000 7f5527200640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T02:41:41.196 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-12T02:41:41.195+0000 7f4f39600640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T02:41:41.196 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-12T02:41:41.194+0000 7f4d1e200640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T02:41:41.197 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-12T02:41:41.194+0000 7f68e7200640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T02:41:41.197 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-12T02:41:41.196+0000 7f3f6d600640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:41:41.197 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-12T02:41:41.195+0000 7f3de1600640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:41:41.198 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-12T02:41:41.196+0000 7f4998a00640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:41:41.198 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-12T02:41:41.196+0000 7f68df000640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:41:41.199 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-12T02:41:41.198+0000 7f551f000640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:41:41.199 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-12T02:41:41.198+0000 7f4d16000640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:41:41.199 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-12T02:41:41.198+0000 7f4f31400640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:41:41.969 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-12T02:41:41.968+0000 7f09ca400640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T02:41:41.969 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-12T02:41:41.968+0000 7f09ca400640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T02:41:47.252 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T02:41:47.393 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.392+0000 7f46fc200640 1 Processor -- start 2024-09-12T02:41:47.394 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.393+0000 7f46fc200640 1 -- start start 2024-09-12T02:41:47.395 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.394+0000 7f46fc200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f46f40d2ef0 0x7f46f40b8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:47.395 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.394+0000 7f46fc200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46f40b43e0 con 0x7f46f40d16f0 2024-09-12T02:41:47.395 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.394+0000 7f46fc200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46f40d3660 con 0x7f46f40d2a80 2024-09-12T02:41:47.395 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.394+0000 7f46fc200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f46f415f4f0 con 0x7f46f40d2ef0 2024-09-12T02:41:47.395 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.394+0000 7f46f9800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f46f40d16f0 0x7f46f40d1ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60442/0 (socket says 172.21.15.112:60442) 2024-09-12T02:41:47.395 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.394+0000 7f46f9800640 1 -- 172.21.15.112:0/667297735 learned_addr learned my addr 172.21.15.112:0/667297735 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:41:47.395 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.394+0000 7f46fa200640 1 --2- 172.21.15.112:0/667297735 >> v2:172.21.15.112:3300/0 conn(0x7f46f40d2ef0 0x7f46f40b8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:47.397 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.395+0000 7f46f3e00640 1 -- 172.21.15.112:0/667297735 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 767261647 0 0) 0x7f46e8001110 con 0x7f46f40d16f0 2024-09-12T02:41:47.397 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.395+0000 7f46f3e00640 1 -- 172.21.15.112:0/667297735 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46dc003520 con 0x7f46f40d16f0 2024-09-12T02:41:47.397 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.395+0000 7f46f3e00640 1 -- 172.21.15.112:0/667297735 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3033123043 0 0) 0x7f46f40d3660 con 0x7f46f40d2a80 2024-09-12T02:41:47.397 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.395+0000 7f46fa200640 1 -- 172.21.15.112:0/667297735 >> v1:172.21.15.137:6789/0 conn(0x7f46f40d2a80 legacy=0x7f46f40b8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:47.397 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.395+0000 7f46fa200640 1 -- 172.21.15.112:0/667297735 >> v1:172.21.15.112:6789/0 conn(0x7f46f40d16f0 legacy=0x7f46f40d1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:47.397 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.395+0000 7f46fa200640 1 -- 172.21.15.112:0/667297735 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f40d3940 con 0x7f46f40d2ef0 2024-09-12T02:41:47.397 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.396+0000 7f46fa200640 1 --2- 172.21.15.112:0/667297735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46f40d2ef0 0x7f46f40b8a30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f46ec009d90 tx=0x7f46ec02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=356663ba54a1fd7c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:47.397 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.396+0000 7f46f3e00640 1 -- 172.21.15.112:0/667297735 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ec007740 con 0x7f46f40d2ef0 2024-09-12T02:41:47.397 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.396+0000 7f46f3e00640 1 -- 172.21.15.112:0/667297735 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46ec0078e0 con 0x7f46f40d2ef0 2024-09-12T02:41:47.397 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.396+0000 7f46f3e00640 1 -- 172.21.15.112:0/667297735 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ec007c90 con 0x7f46f40d2ef0 2024-09-12T02:41:47.398 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.396+0000 7f46fc200640 1 -- 172.21.15.112:0/667297735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46f40d2ef0 msgr2=0x7f46f40b8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:47.398 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.396+0000 7f46fc200640 1 --2- 172.21.15.112:0/667297735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46f40d2ef0 0x7f46f40b8a30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f46ec009d90 tx=0x7f46ec02a6f0 comp rx=0 tx=0).stop 2024-09-12T02:41:47.398 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.397+0000 7f46fc200640 1 -- 172.21.15.112:0/667297735 shutdown_connections 2024-09-12T02:41:47.398 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.397+0000 7f46fc200640 1 --2- 172.21.15.112:0/667297735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46f40d2ef0 0x7f46f40b8a30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:47.399 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.397+0000 7f46fc200640 1 -- 172.21.15.112:0/667297735 >> 172.21.15.112:0/667297735 conn(0x7f46f4072830 msgr2=0x7f46f406bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:47.399 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.397+0000 7f46fc200640 1 -- 172.21.15.112:0/667297735 shutdown_connections 2024-09-12T02:41:47.399 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.397+0000 7f46fc200640 1 -- 172.21.15.112:0/667297735 wait complete. 2024-09-12T02:41:47.399 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.398+0000 7f46fc200640 1 Processor -- start 2024-09-12T02:41:47.399 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.398+0000 7f46fc200640 1 -- start start 2024-09-12T02:41:47.401 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.399+0000 7f46fc200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46f40d16f0 0x7f46f40cac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:47.401 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.399+0000 7f46fc200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46f40d2a80 0x7f46f40b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:47.401 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.399+0000 7f46fc200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46f40d2ef0 0x7f46f41599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:47.402 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.399+0000 7f46fc200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f46f40d41e0 con 0x7f46f40d16f0 2024-09-12T02:41:47.402 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.399+0000 7f46fc200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f46f40d3f00 con 0x7f46f40d2ef0 2024-09-12T02:41:47.402 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.399+0000 7f46fc200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f46f40d32f0 con 0x7f46f40d2a80 2024-09-12T02:41:47.402 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.400+0000 7f46f9800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46f40d16f0 0x7f46f40cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:47.402 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.400+0000 7f46f9800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46f40d16f0 0x7f46f40cac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55948/0 (socket says 172.21.15.112:55948) 2024-09-12T02:41:47.402 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.400+0000 7f46f9800640 1 -- 172.21.15.112:0/3791282849 learned_addr learned my addr 172.21.15.112:0/3791282849 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:47.402 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.400+0000 7f46fa200640 1 --2- 172.21.15.112:0/3791282849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46f40d2ef0 0x7f46f41599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:47.402 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.400+0000 7f46f8e00640 1 --2- 172.21.15.112:0/3791282849 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46f40d2a80 0x7f46f40b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:47.402 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.400+0000 7f46f9800640 1 -- 172.21.15.112:0/3791282849 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46f40d2a80 msgr2=0x7f46f40b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:47.402 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.400+0000 7f46f9800640 1 --2- 172.21.15.112:0/3791282849 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46f40d2a80 0x7f46f40b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:47.402 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.400+0000 7f46f9800640 1 -- 172.21.15.112:0/3791282849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46f40d2ef0 msgr2=0x7f46f41599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:47.402 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.400+0000 7f46f9800640 1 --2- 172.21.15.112:0/3791282849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46f40d2ef0 0x7f46f41599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:47.402 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.400+0000 7f46f9800640 1 -- 172.21.15.112:0/3791282849 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f41581c0 con 0x7f46f40d16f0 2024-09-12T02:41:47.403 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.400+0000 7f46f8e00640 1 --2- 172.21.15.112:0/3791282849 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46f40d2a80 0x7f46f40b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:41:47.403 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.400+0000 7f46f9800640 1 --2- 172.21.15.112:0/3791282849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46f40d16f0 0x7f46f40cac40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f46e800c730 tx=0x7f46e800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:47.403 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.400+0000 7f46f1600640 1 -- 172.21.15.112:0/3791282849 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e8017070 con 0x7f46f40d16f0 2024-09-12T02:41:47.403 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.400+0000 7f46f1600640 1 -- 172.21.15.112:0/3791282849 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46e8005ad0 con 0x7f46f40d16f0 2024-09-12T02:41:47.403 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.400+0000 7f46f1600640 1 -- 172.21.15.112:0/3791282849 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e8007e20 con 0x7f46f40d16f0 2024-09-12T02:41:47.403 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.401+0000 7f46fc200640 1 -- 172.21.15.112:0/3791282849 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46f415a700 con 0x7f46f40d16f0 2024-09-12T02:41:47.403 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.401+0000 7f46fc200640 1 -- 172.21.15.112:0/3791282849 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46f40b50b0 con 0x7f46f40d16f0 2024-09-12T02:41:47.403 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.402+0000 7f46fc200640 1 -- 172.21.15.112:0/3791282849 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46f40d3660 con 0x7f46f40d16f0 2024-09-12T02:41:47.404 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.402+0000 7f46f1600640 1 -- 172.21.15.112:0/3791282849 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f46e801a070 con 0x7f46f40d16f0 2024-09-12T02:41:47.404 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.404+0000 7f46f1600640 1 --2- 172.21.15.112:0/3791282849 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f46d406be30 0x7f46d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:47.405 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.404+0000 7f46f1600640 1 -- 172.21.15.112:0/3791282849 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f46e8089fc0 con 0x7f46f40d16f0 2024-09-12T02:41:47.405 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.404+0000 7f46f8e00640 1 --2- 172.21.15.112:0/3791282849 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f46d406be30 0x7f46d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:47.405 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.405+0000 7f46f8e00640 1 --2- 172.21.15.112:0/3791282849 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f46d406be30 0x7f46d406e2f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f46f40b53c0 tx=0x7f46e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:47.410 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.409+0000 7f46f1600640 1 -- 172.21.15.112:0/3791282849 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f46f40d3660 con 0x7f46f40d16f0 2024-09-12T02:41:47.584 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.583+0000 7f46fc200640 1 -- 172.21.15.112:0/3791282849 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f46f40d1ad0 con 0x7f46f40d16f0 2024-09-12T02:41:47.585 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.584+0000 7f46f1600640 1 -- 172.21.15.112:0/3791282849 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12944 (secure 0 0 0) 0x7f46f40b43e0 con 0x7f46f40d16f0 2024-09-12T02:41:47.585 INFO:teuthology.misc.health.smithi112.stdout: 2024-09-12T02:41:47.585 INFO:teuthology.misc.health.smithi112.stdout:{"epoch":16,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:41:45.228523+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:41:47.588 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.586+0000 7f46fc200640 1 -- 172.21.15.112:0/3791282849 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f46d406be30 msgr2=0x7f46d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:47.588 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.586+0000 7f46fc200640 1 --2- 172.21.15.112:0/3791282849 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f46d406be30 0x7f46d406e2f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f46f40b53c0 tx=0x7f46e0009040 comp rx=0 tx=0).stop 2024-09-12T02:41:47.588 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.586+0000 7f46fc200640 1 -- 172.21.15.112:0/3791282849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46f40d16f0 msgr2=0x7f46f40cac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:47.588 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.586+0000 7f46fc200640 1 --2- 172.21.15.112:0/3791282849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46f40d16f0 0x7f46f40cac40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f46e800c730 tx=0x7f46e800cbf0 comp rx=0 tx=0).stop 2024-09-12T02:41:47.588 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.586+0000 7f46fc200640 1 -- 172.21.15.112:0/3791282849 shutdown_connections 2024-09-12T02:41:47.589 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.586+0000 7f46fc200640 1 --2- 172.21.15.112:0/3791282849 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f46d406be30 0x7f46d406e2f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:47.589 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.586+0000 7f46fc200640 1 --2- 172.21.15.112:0/3791282849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46f40d2ef0 0x7f46f41599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:47.589 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.586+0000 7f46fc200640 1 --2- 172.21.15.112:0/3791282849 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46f40d2a80 0x7f46f40b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:47.589 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.586+0000 7f46fc200640 1 --2- 172.21.15.112:0/3791282849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46f40d16f0 0x7f46f40cac40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:47.589 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.586+0000 7f46fc200640 1 -- 172.21.15.112:0/3791282849 >> 172.21.15.112:0/3791282849 conn(0x7f46f4072830 msgr2=0x7f46f4067aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:47.590 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.586+0000 7f46fc200640 1 -- 172.21.15.112:0/3791282849 shutdown_connections 2024-09-12T02:41:47.590 INFO:teuthology.misc.health.smithi112.stderr:2024-09-12T02:41:47.586+0000 7f46fc200640 1 -- 172.21.15.112:0/3791282849 wait complete. 2024-09-12T02:41:47.600 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T02:41:47.600 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T02:41:47.600 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T02:41:47.600 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T02:41:47.604 INFO:tasks.ceph.mds.a:Started 2024-09-12T02:41:47.604 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T02:41:47.604 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T02:41:47.609 INFO:tasks.ceph.mds.c:Started 2024-09-12T02:41:47.609 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T02:41:47.609 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T02:41:47.613 INFO:tasks.ceph.mds.b:Started 2024-09-12T02:41:47.613 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T02:41:47.614 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T02:41:47.617 INFO:tasks.ceph.mds.d:Started 2024-09-12T02:41:47.618 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-12T02:41:47.618 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:41:47.734 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2024-09-12T02:41:47.736 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-12T02:41:47.753 INFO:tasks.ceph.mds.d.smithi137.stdout:starting mds.d at 2024-09-12T02:41:47.753 INFO:tasks.ceph.mds.b.smithi137.stdout:starting mds.b at 2024-09-12T02:41:47.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.779+0000 7f263e200640 1 Processor -- start 2024-09-12T02:41:47.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.779+0000 7f263e200640 1 -- start start 2024-09-12T02:41:47.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.779+0000 7f263e200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26380d28d0 0x7f26380b2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:47.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.779+0000 7f263e200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26380d2fb0 con 0x7f26380b3e00 2024-09-12T02:41:47.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.779+0000 7f263e200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26380d0b60 con 0x7f26380d1710 2024-09-12T02:41:47.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.779+0000 7f263e200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f26380d3cb0 con 0x7f26380d28d0 2024-09-12T02:41:47.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.779+0000 7f2637e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f26380b3e00 0x7f26380b1d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60456/0 (socket says 172.21.15.112:60456) 2024-09-12T02:41:47.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.779+0000 7f2637e00640 1 -- 172.21.15.112:0/2768389381 learned_addr learned my addr 172.21.15.112:0/2768389381 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:41:47.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.780+0000 7f263d800640 1 --2- 172.21.15.112:0/2768389381 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26380d28d0 0x7f26380b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:47.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.780+0000 7f2637400640 1 -- 172.21.15.112:0/2768389381 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3963724704 0 0) 0x7f26380d2fb0 con 0x7f26380b3e00 2024-09-12T02:41:47.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.780+0000 7f2637400640 1 -- 172.21.15.112:0/2768389381 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2620003520 con 0x7f26380b3e00 2024-09-12T02:41:47.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.780+0000 7f263d800640 1 -- 172.21.15.112:0/2768389381 >> v1:172.21.15.137:6789/0 conn(0x7f26380d1710 legacy=0x7f26380d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:47.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.780+0000 7f263d800640 1 -- 172.21.15.112:0/2768389381 >> v1:172.21.15.112:6789/0 conn(0x7f26380b3e00 legacy=0x7f26380b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:47.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.780+0000 7f2637400640 1 -- 172.21.15.112:0/2768389381 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1279955159 0 0) 0x7f26380d0b60 con 0x7f26380d1710 2024-09-12T02:41:47.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.780+0000 7f263d800640 1 -- 172.21.15.112:0/2768389381 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26380d3410 con 0x7f26380d28d0 2024-09-12T02:41:47.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.781+0000 7f263d800640 1 --2- 172.21.15.112:0/2768389381 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26380d28d0 0x7f26380b2480 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2630009dc0 tx=0x7f263002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8833527a220c9c84 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:47.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.781+0000 7f2637400640 1 -- 172.21.15.112:0/2768389381 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2630007740 con 0x7f26380d28d0 2024-09-12T02:41:47.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.781+0000 7f2637400640 1 -- 172.21.15.112:0/2768389381 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26300078e0 con 0x7f26380d28d0 2024-09-12T02:41:47.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.781+0000 7f2637400640 1 -- 172.21.15.112:0/2768389381 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2630007cb0 con 0x7f26380d28d0 2024-09-12T02:41:47.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.782+0000 7f263e200640 1 -- 172.21.15.112:0/2768389381 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26380d28d0 msgr2=0x7f26380b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:47.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.782+0000 7f263e200640 1 --2- 172.21.15.112:0/2768389381 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26380d28d0 0x7f26380b2480 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2630009dc0 tx=0x7f263002a6d0 comp rx=0 tx=0).stop 2024-09-12T02:41:47.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.782+0000 7f263e200640 1 -- 172.21.15.112:0/2768389381 shutdown_connections 2024-09-12T02:41:47.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.782+0000 7f263e200640 1 --2- 172.21.15.112:0/2768389381 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26380d28d0 0x7f26380b2480 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:47.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.782+0000 7f263e200640 1 -- 172.21.15.112:0/2768389381 >> 172.21.15.112:0/2768389381 conn(0x7f263809e030 msgr2=0x7f26380d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:47.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.782+0000 7f263e200640 1 -- 172.21.15.112:0/2768389381 shutdown_connections 2024-09-12T02:41:47.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.782+0000 7f263e200640 1 -- 172.21.15.112:0/2768389381 wait complete. 2024-09-12T02:41:47.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.784+0000 7f263e200640 1 Processor -- start 2024-09-12T02:41:47.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.784+0000 7f263e200640 1 -- start start 2024-09-12T02:41:47.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.785+0000 7f263e200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26380b3e00 0x7f2638152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:47.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.785+0000 7f263e200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26380d1710 0x7f26380b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:47.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.785+0000 7f263e200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26380d28d0 0x7f26380b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:47.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.785+0000 7f263e200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f26380d39d0 con 0x7f26380d1710 2024-09-12T02:41:47.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.785+0000 7f263e200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f26380d2d60 con 0x7f26380d28d0 2024-09-12T02:41:47.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.785+0000 7f263e200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f263815f110 con 0x7f26380b3e00 2024-09-12T02:41:47.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.785+0000 7f2637e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26380d1710 0x7f26380b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:47.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.785+0000 7f2637e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26380d1710 0x7f26380b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55996/0 (socket says 172.21.15.112:55996) 2024-09-12T02:41:47.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.785+0000 7f2637e00640 1 -- 172.21.15.112:0/1461583716 learned_addr learned my addr 172.21.15.112:0/1461583716 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:47.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.785+0000 7f263ce00640 1 --2- 172.21.15.112:0/1461583716 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26380b3e00 0x7f2638152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:47.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.785+0000 7f263d800640 1 --2- 172.21.15.112:0/1461583716 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26380d28d0 0x7f26380b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:47.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.785+0000 7f2637e00640 1 -- 172.21.15.112:0/1461583716 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26380b3e00 msgr2=0x7f2638152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:47.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.785+0000 7f2637e00640 1 --2- 172.21.15.112:0/1461583716 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26380b3e00 0x7f2638152200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:47.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.785+0000 7f2637e00640 1 -- 172.21.15.112:0/1461583716 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26380d28d0 msgr2=0x7f26380b49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:47.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.785+0000 7f2637e00640 1 --2- 172.21.15.112:0/1461583716 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26380d28d0 0x7f26380b49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:47.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.785+0000 7f2637e00640 1 -- 172.21.15.112:0/1461583716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2638152740 con 0x7f26380d1710 2024-09-12T02:41:47.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.786+0000 7f2637e00640 1 --2- 172.21.15.112:0/1461583716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26380d1710 0x7f26380b4480 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f262400c430 tx=0x7f262400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:47.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.786+0000 7f2634c00640 1 -- 172.21.15.112:0/1461583716 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2624017070 con 0x7f26380d1710 2024-09-12T02:41:47.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.786+0000 7f2634c00640 1 -- 172.21.15.112:0/1461583716 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2624005ce0 con 0x7f26380d1710 2024-09-12T02:41:47.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.786+0000 7f263e200640 1 -- 172.21.15.112:0/1461583716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2638162140 con 0x7f26380d1710 2024-09-12T02:41:47.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.786+0000 7f2634c00640 1 -- 172.21.15.112:0/1461583716 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26240072f0 con 0x7f26380d1710 2024-09-12T02:41:47.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.786+0000 7f263e200640 1 -- 172.21.15.112:0/1461583716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26380ccd90 con 0x7f26380d1710 2024-09-12T02:41:47.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.787+0000 7f263e200640 1 -- 172.21.15.112:0/1461583716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26380d1af0 con 0x7f26380d1710 2024-09-12T02:41:47.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.788+0000 7f2634c00640 1 -- 172.21.15.112:0/1461583716 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f262401a070 con 0x7f26380d1710 2024-09-12T02:41:47.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.789+0000 7f2634c00640 1 --2- 172.21.15.112:0/1461583716 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f261806be30 0x7f261806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:47.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.789+0000 7f2634c00640 1 -- 172.21.15.112:0/1461583716 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f2624089fe0 con 0x7f26380d1710 2024-09-12T02:41:47.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.789+0000 7f263ce00640 1 --2- 172.21.15.112:0/1461583716 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f261806be30 0x7f261806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:47.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.789+0000 7f263ce00640 1 --2- 172.21.15.112:0/1461583716 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f261806be30 0x7f261806e2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f262c000f60 tx=0x7f262c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:47.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:47.794+0000 7f2634c00640 1 -- 172.21.15.112:0/1461583716 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2624058610 con 0x7f26380d1710 2024-09-12T02:41:48.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:48.004+0000 7f263e200640 1 -- 172.21.15.112:0/1461583716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f263815e8c0 con 0x7f26380d1710 2024-09-12T02:41:48.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:48.004+0000 7f2634c00640 1 -- 172.21.15.112:0/1461583716 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1437 (secure 0 0 0) 0x7f262405c910 con 0x7f26380d1710 2024-09-12T02:41:48.004 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:48.004 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":2,"btime":"2024-09-12T02:41:47:741055+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3005649719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3005649719},{"type":"v1","addr":"172.21.15.112:6835","nonce":3005649719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T02:41:48.005 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 2 2024-09-12T02:41:48.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:48.006+0000 7f263e200640 1 -- 172.21.15.112:0/1461583716 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f261806be30 msgr2=0x7f261806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:48.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:48.006+0000 7f263e200640 1 --2- 172.21.15.112:0/1461583716 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f261806be30 0x7f261806e2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f262c000f60 tx=0x7f262c009040 comp rx=0 tx=0).stop 2024-09-12T02:41:48.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:48.006+0000 7f263e200640 1 -- 172.21.15.112:0/1461583716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26380d1710 msgr2=0x7f26380b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:48.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:48.006+0000 7f263e200640 1 --2- 172.21.15.112:0/1461583716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26380d1710 0x7f26380b4480 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f262400c430 tx=0x7f262400c8f0 comp rx=0 tx=0).stop 2024-09-12T02:41:48.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:48.006+0000 7f263e200640 1 -- 172.21.15.112:0/1461583716 shutdown_connections 2024-09-12T02:41:48.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:48.006+0000 7f263e200640 1 --2- 172.21.15.112:0/1461583716 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f261806be30 0x7f261806e2f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:48.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:48.006+0000 7f263e200640 1 --2- 172.21.15.112:0/1461583716 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26380d28d0 0x7f26380b49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:48.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:48.006+0000 7f263e200640 1 --2- 172.21.15.112:0/1461583716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26380d1710 0x7f26380b4480 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:48.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:48.006+0000 7f263e200640 1 --2- 172.21.15.112:0/1461583716 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26380b3e00 0x7f2638152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:48.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:48.006+0000 7f263e200640 1 -- 172.21.15.112:0/1461583716 >> 172.21.15.112:0/1461583716 conn(0x7f263809e030 msgr2=0x7f26380b8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:48.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:48.006+0000 7f263e200640 1 -- 172.21.15.112:0/1461583716 shutdown_connections 2024-09-12T02:41:48.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:48.006+0000 7f263e200640 1 -- 172.21.15.112:0/1461583716 wait complete. 2024-09-12T02:41:50.023 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:41:50.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.187+0000 7f0122400640 1 Processor -- start 2024-09-12T02:41:50.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.187+0000 7f0122400640 1 -- start start 2024-09-12T02:41:50.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.188+0000 7f0122400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f011c0b3e00 0x7f011c0d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:50.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.188+0000 7f0122400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f011c0d2fb0 con 0x7f011c0d1710 2024-09-12T02:41:50.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.188+0000 7f0122400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f011c0d0b60 con 0x7f011c0b1d70 2024-09-12T02:41:50.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.188+0000 7f0122400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f011c0d3cb0 con 0x7f011c0b3e00 2024-09-12T02:41:50.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.188+0000 7f0121000640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f011c0d1710 0x7f011c0d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60460/0 (socket says 172.21.15.112:60460) 2024-09-12T02:41:50.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.188+0000 7f0121000640 1 -- 172.21.15.112:0/3150275649 learned_addr learned my addr 172.21.15.112:0/3150275649 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:41:50.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.189+0000 7f011be00640 1 --2- 172.21.15.112:0/3150275649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f011c0b3e00 0x7f011c0d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:50.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.189+0000 7f011b400640 1 -- 172.21.15.112:0/3150275649 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4033994287 0 0) 0x7f011c0d2fb0 con 0x7f011c0d1710 2024-09-12T02:41:50.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.189+0000 7f011b400640 1 -- 172.21.15.112:0/3150275649 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0104003520 con 0x7f011c0d1710 2024-09-12T02:41:50.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.189+0000 7f011b400640 1 -- 172.21.15.112:0/3150275649 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1944732364 0 0) 0x7f0104003520 con 0x7f011c0d1710 2024-09-12T02:41:50.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.189+0000 7f011b400640 1 -- 172.21.15.112:0/3150275649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f011c0b3e00 msgr2=0x7f011c0d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:50.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.189+0000 7f011b400640 1 --2- 172.21.15.112:0/3150275649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f011c0b3e00 0x7f011c0d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:50.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.189+0000 7f011b400640 1 -- 172.21.15.112:0/3150275649 >> v1:172.21.15.137:6789/0 conn(0x7f011c0b1d70 legacy=0x7f011c0b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:50.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.189+0000 7f011b400640 1 -- 172.21.15.112:0/3150275649 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f011c0d3410 con 0x7f011c0d1710 2024-09-12T02:41:50.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.189+0000 7f011b400640 1 -- 172.21.15.112:0/3150275649 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f0110001670 con 0x7f011c0d1710 2024-09-12T02:41:50.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.189+0000 7f011b400640 1 -- 172.21.15.112:0/3150275649 >> v1:172.21.15.112:6789/0 conn(0x7f011c0d1710 legacy=0x7f011c0d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:50.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.189+0000 7f011b400640 1 --2- 172.21.15.112:0/3150275649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f011c0b3e00 0x7f01040039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:50.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.189+0000 7f011b400640 1 --2- 172.21.15.112:0/3150275649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0104003f20 0x7f0104004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:50.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.189+0000 7f011b400640 1 --2- 172.21.15.112:0/3150275649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0104004d40 0x7f01040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:50.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.189+0000 7f011b400640 1 -- 172.21.15.112:0/3150275649 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f011c0d3cb0 con 0x7f0104003f20 2024-09-12T02:41:50.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.189+0000 7f011b400640 1 -- 172.21.15.112:0/3150275649 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f010400ba20 con 0x7f0104004d40 2024-09-12T02:41:50.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.189+0000 7f011b400640 1 -- 172.21.15.112:0/3150275649 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f010400bc20 con 0x7f011c0b3e00 2024-09-12T02:41:50.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.189+0000 7f011be00640 1 --2- 172.21.15.112:0/3150275649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0104003f20 0x7f0104004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:50.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.189+0000 7f0121a00640 1 --2- 172.21.15.112:0/3150275649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0104004d40 0x7f01040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:50.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.190+0000 7f0121000640 1 --2- 172.21.15.112:0/3150275649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f011c0b3e00 0x7f01040039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:50.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.190+0000 7f011be00640 1 -- 172.21.15.112:0/3150275649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f011c0b3e00 msgr2=0x7f01040039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:50.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.190+0000 7f011be00640 1 --2- 172.21.15.112:0/3150275649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f011c0b3e00 0x7f01040039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:50.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.190+0000 7f011be00640 1 -- 172.21.15.112:0/3150275649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0104004d40 msgr2=0x7f01040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:50.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.190+0000 7f011be00640 1 --2- 172.21.15.112:0/3150275649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0104004d40 0x7f01040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:50.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.190+0000 7f011be00640 1 -- 172.21.15.112:0/3150275649 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0104003520 con 0x7f0104003f20 2024-09-12T02:41:50.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.190+0000 7f0121000640 1 --2- 172.21.15.112:0/3150275649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f011c0b3e00 0x7f01040039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:41:50.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.191+0000 7f011be00640 1 --2- 172.21.15.112:0/3150275649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0104003f20 0x7f0104004800 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0108009ac0 tx=0x7f0104005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d7b3b66d506a9bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:50.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.191+0000 7f011b400640 1 -- 172.21.15.112:0/3150275649 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0108036070 con 0x7f0104003f20 2024-09-12T02:41:50.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.191+0000 7f011b400640 1 -- 172.21.15.112:0/3150275649 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0108031400 con 0x7f0104003f20 2024-09-12T02:41:50.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.191+0000 7f011b400640 1 -- 172.21.15.112:0/3150275649 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0108009690 con 0x7f0104003f20 2024-09-12T02:41:50.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.191+0000 7f0122400640 1 -- 172.21.15.112:0/3150275649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0104003f20 msgr2=0x7f0104004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:50.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.191+0000 7f0122400640 1 --2- 172.21.15.112:0/3150275649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0104003f20 0x7f0104004800 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0108009ac0 tx=0x7f0104005830 comp rx=0 tx=0).stop 2024-09-12T02:41:50.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.191+0000 7f0121a00640 1 -- 172.21.15.112:0/3150275649 reap_dead start 2024-09-12T02:41:50.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.192+0000 7f0122400640 1 -- 172.21.15.112:0/3150275649 shutdown_connections 2024-09-12T02:41:50.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.192+0000 7f0122400640 1 -- 172.21.15.112:0/3150275649 >> 172.21.15.112:0/3150275649 conn(0x7f011c09e030 msgr2=0x7f011c0d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:50.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.192+0000 7f0122400640 1 -- 172.21.15.112:0/3150275649 shutdown_connections 2024-09-12T02:41:50.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.192+0000 7f0122400640 1 -- 172.21.15.112:0/3150275649 wait complete. 2024-09-12T02:41:50.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.193+0000 7f0122400640 1 Processor -- start 2024-09-12T02:41:50.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.193+0000 7f0122400640 1 -- start start 2024-09-12T02:41:50.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.194+0000 7f0122400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0104003f20 0x7f011c158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:50.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.194+0000 7f0122400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f011c14be40 0x7f011c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:50.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.194+0000 7f0122400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f011c0c8440 0x7f011c0c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:50.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.194+0000 7f0122400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f011c15f110 con 0x7f011c14be40 2024-09-12T02:41:50.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.194+0000 7f0122400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f011c0d39d0 con 0x7f0104003f20 2024-09-12T02:41:50.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.194+0000 7f0122400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f011c15f290 con 0x7f011c0c8440 2024-09-12T02:41:50.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.195+0000 7f011be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f011c14be40 0x7f011c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:50.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.195+0000 7f011be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f011c14be40 0x7f011c0b8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56006/0 (socket says 172.21.15.112:56006) 2024-09-12T02:41:50.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.195+0000 7f011be00640 1 -- 172.21.15.112:0/1071586692 learned_addr learned my addr 172.21.15.112:0/1071586692 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:50.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.195+0000 7f0121000640 1 --2- 172.21.15.112:0/1071586692 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0104003f20 0x7f011c158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:50.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.195+0000 7f0121a00640 1 --2- 172.21.15.112:0/1071586692 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f011c0c8440 0x7f011c0c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:50.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.195+0000 7f011be00640 1 -- 172.21.15.112:0/1071586692 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f011c0c8440 msgr2=0x7f011c0c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:50.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.195+0000 7f011be00640 1 --2- 172.21.15.112:0/1071586692 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f011c0c8440 0x7f011c0c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:50.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.195+0000 7f011be00640 1 -- 172.21.15.112:0/1071586692 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0104003f20 msgr2=0x7f011c158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:50.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.195+0000 7f011be00640 1 --2- 172.21.15.112:0/1071586692 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0104003f20 0x7f011c158070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:50.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.195+0000 7f011be00640 1 -- 172.21.15.112:0/1071586692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f011c1f48f0 con 0x7f011c14be40 2024-09-12T02:41:50.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.195+0000 7f011be00640 1 --2- 172.21.15.112:0/1071586692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f011c14be40 0x7f011c0b8b80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f01080099e0 tx=0x7f0108004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:50.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.196+0000 7f0118c00640 1 -- 172.21.15.112:0/1071586692 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0108040020 con 0x7f011c14be40 2024-09-12T02:41:50.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.196+0000 7f0118c00640 1 -- 172.21.15.112:0/1071586692 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0108003c40 con 0x7f011c14be40 2024-09-12T02:41:50.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.196+0000 7f0118c00640 1 -- 172.21.15.112:0/1071586692 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0108036040 con 0x7f011c14be40 2024-09-12T02:41:50.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.196+0000 7f0122400640 1 -- 172.21.15.112:0/1071586692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f011c0b9480 con 0x7f011c14be40 2024-09-12T02:41:50.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.196+0000 7f0122400640 1 -- 172.21.15.112:0/1071586692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f011c0b9a40 con 0x7f011c14be40 2024-09-12T02:41:50.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.197+0000 7f0122400640 1 -- 172.21.15.112:0/1071586692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f011c0d0b60 con 0x7f011c14be40 2024-09-12T02:41:50.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.199+0000 7f0118c00640 1 -- 172.21.15.112:0/1071586692 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0108043020 con 0x7f011c14be40 2024-09-12T02:41:50.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.200+0000 7f0118c00640 1 --2- 172.21.15.112:0/1071586692 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f00fc06be60 0x7f00fc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:50.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.200+0000 7f0118c00640 1 -- 172.21.15.112:0/1071586692 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f01080aabf0 con 0x7f011c14be40 2024-09-12T02:41:50.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.200+0000 7f0121000640 1 --2- 172.21.15.112:0/1071586692 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f00fc06be60 0x7f00fc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:50.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.200+0000 7f0121000640 1 --2- 172.21.15.112:0/1071586692 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f00fc06be60 0x7f00fc06e320 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0110005b10 tx=0x7f0110007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:50.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.204+0000 7f0118c00640 1 -- 172.21.15.112:0/1071586692 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f010804a070 con 0x7f011c14be40 2024-09-12T02:41:50.306 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:41:50.313 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:41:50.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.416+0000 7f0122400640 1 -- 172.21.15.112:0/1071586692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f011c0bab60 con 0x7f011c14be40 2024-09-12T02:41:50.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.416+0000 7f0118c00640 1 -- 172.21.15.112:0/1071586692 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3918 (secure 0 0 0) 0x7f01080044e0 con 0x7f011c14be40 2024-09-12T02:41:50.416 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:50.417 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":3,"btime":"2024-09-12T02:41:48:742702+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3622416380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3622416380},{"type":"v1","addr":"172.21.15.112:6837","nonce":3622416380}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/2779317773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2779317773},{"type":"v1","addr":"172.21.15.137:6834","nonce":2779317773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3005649719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3005649719},{"type":"v1","addr":"172.21.15.112:6835","nonce":3005649719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4308,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1785309492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1785309492},{"type":"v1","addr":"172.21.15.137:6835","nonce":1785309492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-12T02:41:50.417 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 3 2024-09-12T02:41:50.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.418+0000 7f0122400640 1 -- 172.21.15.112:0/1071586692 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f00fc06be60 msgr2=0x7f00fc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:50.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.418+0000 7f0122400640 1 --2- 172.21.15.112:0/1071586692 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f00fc06be60 0x7f00fc06e320 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0110005b10 tx=0x7f0110007040 comp rx=0 tx=0).stop 2024-09-12T02:41:50.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.418+0000 7f0122400640 1 -- 172.21.15.112:0/1071586692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f011c14be40 msgr2=0x7f011c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:50.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.418+0000 7f0122400640 1 --2- 172.21.15.112:0/1071586692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f011c14be40 0x7f011c0b8b80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f01080099e0 tx=0x7f0108004730 comp rx=0 tx=0).stop 2024-09-12T02:41:50.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.418+0000 7f0122400640 1 -- 172.21.15.112:0/1071586692 shutdown_connections 2024-09-12T02:41:50.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.418+0000 7f0122400640 1 --2- 172.21.15.112:0/1071586692 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f011c0c8440 0x7f011c0c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:50.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.418+0000 7f0122400640 1 --2- 172.21.15.112:0/1071586692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f011c14be40 0x7f011c0b8b80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:50.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.418+0000 7f0122400640 1 --2- 172.21.15.112:0/1071586692 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f00fc06be60 0x7f00fc06e320 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:50.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.418+0000 7f0122400640 1 --2- 172.21.15.112:0/1071586692 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0104003f20 0x7f011c158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:50.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.418+0000 7f0122400640 1 -- 172.21.15.112:0/1071586692 >> 172.21.15.112:0/1071586692 conn(0x7f011c09e030 msgr2=0x7f011c06ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:50.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.418+0000 7f0122400640 1 -- 172.21.15.112:0/1071586692 shutdown_connections 2024-09-12T02:41:50.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.419+0000 7f0122400640 1 -- 172.21.15.112:0/1071586692 wait complete. 2024-09-12T02:41:50.434 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T02:41:50.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.625+0000 7f4eb3200640 1 Processor -- start 2024-09-12T02:41:50.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.625+0000 7f4eb3200640 1 -- start start 2024-09-12T02:41:50.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.626+0000 7f4eb3200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4eb41624b0 0x7f4eb40d2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:50.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.626+0000 7f4eb3200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4eb40b3ad0 0x7f4eb40d31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:50.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.626+0000 7f4eb3200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4eb40b1a40 0x7f4eb40b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:50.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.626+0000 7f4eb3200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4eb40d3ed0 con 0x7f4eb41624b0 2024-09-12T02:41:50.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.626+0000 7f4eb3200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4eb40d3910 con 0x7f4eb40b1a40 2024-09-12T02:41:50.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.626+0000 7f4eb3200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4eb40d3bf0 con 0x7f4eb40b3ad0 2024-09-12T02:41:50.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.626+0000 7f4eb1e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4eb41624b0 0x7f4eb40d2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:50.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.626+0000 7f4eb1e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4eb41624b0 0x7f4eb40d2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56020/0 (socket says 172.21.15.112:56020) 2024-09-12T02:41:50.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.626+0000 7f4eb1e00640 1 -- 172.21.15.112:0/3134104807 learned_addr learned my addr 172.21.15.112:0/3134104807 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:50.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.627+0000 7f4eb1400640 1 --2- 172.21.15.112:0/3134104807 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4eb40b3ad0 0x7f4eb40d31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:50.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.627+0000 7f4eb2800640 1 --2- 172.21.15.112:0/3134104807 >> v2:172.21.15.137:3300/0 conn(0x7f4eb40b1a40 0x7f4eb40b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:50.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.627+0000 7f4eb1e00640 1 -- 172.21.15.112:0/3134104807 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4eb40b3ad0 msgr2=0x7f4eb40d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:50.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.627+0000 7f4eb1e00640 1 --2- 172.21.15.112:0/3134104807 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4eb40b3ad0 0x7f4eb40d31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:50.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.627+0000 7f4eb1e00640 1 -- 172.21.15.112:0/3134104807 >> v2:172.21.15.137:3300/0 conn(0x7f4eb40b1a40 msgr2=0x7f4eb40b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:50.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.627+0000 7f4eb1e00640 1 --2- 172.21.15.112:0/3134104807 >> v2:172.21.15.137:3300/0 conn(0x7f4eb40b1a40 0x7f4eb40b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:50.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.627+0000 7f4eb1e00640 1 -- 172.21.15.112:0/3134104807 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb40d1d50 con 0x7f4eb41624b0 2024-09-12T02:41:50.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.628+0000 7f4eb1e00640 1 --2- 172.21.15.112:0/3134104807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eb41624b0 0x7f4eb40d2cb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4eb40b4620 tx=0x7f4ea402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c5af66f5e7b3dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:50.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.628+0000 7f4eb0a00640 1 -- 172.21.15.112:0/3134104807 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4037070 con 0x7f4eb41624b0 2024-09-12T02:41:50.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.628+0000 7f4eb0a00640 1 -- 172.21.15.112:0/3134104807 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea4032440 con 0x7f4eb41624b0 2024-09-12T02:41:50.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.628+0000 7f4eb0a00640 1 -- 172.21.15.112:0/3134104807 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4032810 con 0x7f4eb41624b0 2024-09-12T02:41:50.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.628+0000 7f4eb3200640 1 -- 172.21.15.112:0/3134104807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eb41624b0 msgr2=0x7f4eb40d2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:50.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.628+0000 7f4eb3200640 1 --2- 172.21.15.112:0/3134104807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eb41624b0 0x7f4eb40d2cb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4eb40b4620 tx=0x7f4ea402a1e0 comp rx=0 tx=0).stop 2024-09-12T02:41:50.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.629+0000 7f4eb3200640 1 -- 172.21.15.112:0/3134104807 shutdown_connections 2024-09-12T02:41:50.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.629+0000 7f4eb3200640 1 --2- 172.21.15.112:0/3134104807 >> v2:172.21.15.137:3300/0 conn(0x7f4eb40b1a40 0x7f4eb40b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:50.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.629+0000 7f4eb3200640 1 --2- 172.21.15.112:0/3134104807 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4eb40b3ad0 0x7f4eb40d31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:50.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.629+0000 7f4eb3200640 1 --2- 172.21.15.112:0/3134104807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eb41624b0 0x7f4eb40d2cb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:50.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.629+0000 7f4eb3200640 1 -- 172.21.15.112:0/3134104807 >> 172.21.15.112:0/3134104807 conn(0x7f4eb40d4db0 msgr2=0x7f4eb40d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:50.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.629+0000 7f4eb3200640 1 -- 172.21.15.112:0/3134104807 shutdown_connections 2024-09-12T02:41:50.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.629+0000 7f4eb3200640 1 -- 172.21.15.112:0/3134104807 wait complete. 2024-09-12T02:41:50.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.630+0000 7f4eb3200640 1 Processor -- start 2024-09-12T02:41:50.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.630+0000 7f4eb3200640 1 -- start start 2024-09-12T02:41:50.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.631+0000 7f4eb3200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eb40b1a40 0x7f4eb40cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:50.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.631+0000 7f4eb3200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4eb40b3ad0 0x7f4eb40b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:50.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.631+0000 7f4eb3200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4eb41624b0 0x7f4eb414b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:50.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.631+0000 7f4eb3200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb40d2550 con 0x7f4eb40b1a40 2024-09-12T02:41:50.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.631+0000 7f4eb3200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb40b4120 con 0x7f4eb41624b0 2024-09-12T02:41:50.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.631+0000 7f4eb3200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4eb40b96f0 con 0x7f4eb40b3ad0 2024-09-12T02:41:50.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.631+0000 7f4eb1e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eb40b1a40 0x7f4eb40cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:50.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.631+0000 7f4eb1e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eb40b1a40 0x7f4eb40cc0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56030/0 (socket says 172.21.15.112:56030) 2024-09-12T02:41:50.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.631+0000 7f4eb1e00640 1 -- 172.21.15.112:0/471204015 learned_addr learned my addr 172.21.15.112:0/471204015 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:50.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.631+0000 7f4eb1400640 1 --2- 172.21.15.112:0/471204015 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4eb40b3ad0 0x7f4eb40b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:50.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.632+0000 7f4eb2800640 1 --2- 172.21.15.112:0/471204015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4eb41624b0 0x7f4eb414b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:50.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.632+0000 7f4eb1e00640 1 -- 172.21.15.112:0/471204015 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4eb40b3ad0 msgr2=0x7f4eb40b8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:50.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.632+0000 7f4eb1e00640 1 --2- 172.21.15.112:0/471204015 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4eb40b3ad0 0x7f4eb40b8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:50.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.632+0000 7f4eb1e00640 1 -- 172.21.15.112:0/471204015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4eb41624b0 msgr2=0x7f4eb414b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:50.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.632+0000 7f4eb1e00640 1 --2- 172.21.15.112:0/471204015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4eb41624b0 0x7f4eb414b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:50.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.632+0000 7f4eb1e00640 1 -- 172.21.15.112:0/471204015 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb40b99d0 con 0x7f4eb40b1a40 2024-09-12T02:41:50.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.632+0000 7f4eb1e00640 1 --2- 172.21.15.112:0/471204015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eb40b1a40 0x7f4eb40cc0f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4000c00 tx=0x7f4ea40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:50.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.632+0000 7f4eaa000640 1 -- 172.21.15.112:0/471204015 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4041070 con 0x7f4eb40b1a40 2024-09-12T02:41:50.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.632+0000 7f4eaa000640 1 -- 172.21.15.112:0/471204015 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea403c870 con 0x7f4eb40b1a40 2024-09-12T02:41:50.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.632+0000 7f4eb3200640 1 -- 172.21.15.112:0/471204015 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eb40b9cb0 con 0x7f4eb40b1a40 2024-09-12T02:41:50.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.632+0000 7f4eaa000640 1 -- 172.21.15.112:0/471204015 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4037040 con 0x7f4eb40b1a40 2024-09-12T02:41:50.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.633+0000 7f4eb3200640 1 -- 172.21.15.112:0/471204015 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eb40ba270 con 0x7f4eb40b1a40 2024-09-12T02:41:50.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.634+0000 7f4eb3200640 1 -- 172.21.15.112:0/471204015 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eb4162890 con 0x7f4eb40b1a40 2024-09-12T02:41:50.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.634+0000 7f4eaa000640 1 -- 172.21.15.112:0/471204015 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ea4044070 con 0x7f4eb40b1a40 2024-09-12T02:41:50.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.635+0000 7f4eaa000640 1 --2- 172.21.15.112:0/471204015 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4e9406be30 0x7f4e9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:50.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.635+0000 7f4eaa000640 1 -- 172.21.15.112:0/471204015 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f4ea40ab630 con 0x7f4eb40b1a40 2024-09-12T02:41:50.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.635+0000 7f4eb1400640 1 --2- 172.21.15.112:0/471204015 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4e9406be30 0x7f4e9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:50.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.636+0000 7f4eb1400640 1 --2- 172.21.15.112:0/471204015 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4e9406be30 0x7f4e9406e2f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4eb40ba980 tx=0x7f4ea0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:50.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.640+0000 7f4eaa000640 1 -- 172.21.15.112:0/471204015 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ea4079df0 con 0x7f4eb40b1a40 2024-09-12T02:41:50.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.816+0000 7f4eb3200640 1 -- 172.21.15.112:0/471204015 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f4eb40c8680 con 0x7f4eb40b1a40 2024-09-12T02:41:50.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.817+0000 7f4eaa000640 1 -- 172.21.15.112:0/471204015 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f4ea407e0f0 con 0x7f4eb40b1a40 2024-09-12T02:41:50.818 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:50.818 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2024-09-12T02:41:50.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:41:50.818 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 1, 2024-09-12T02:41:50.818 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": ".mgr" 2024-09-12T02:41:50.818 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:41:50.818 INFO:teuthology.orchestra.run.smithi112.stdout:] 2024-09-12T02:41:50.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.819+0000 7f4eb3200640 1 -- 172.21.15.112:0/471204015 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4e9406be30 msgr2=0x7f4e9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:50.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.819+0000 7f4eb3200640 1 --2- 172.21.15.112:0/471204015 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4e9406be30 0x7f4e9406e2f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4eb40ba980 tx=0x7f4ea0008040 comp rx=0 tx=0).stop 2024-09-12T02:41:50.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.819+0000 7f4eb3200640 1 -- 172.21.15.112:0/471204015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eb40b1a40 msgr2=0x7f4eb40cc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:50.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.819+0000 7f4eb3200640 1 --2- 172.21.15.112:0/471204015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eb40b1a40 0x7f4eb40cc0f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4000c00 tx=0x7f4ea40046c0 comp rx=0 tx=0).stop 2024-09-12T02:41:50.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.819+0000 7f4eb3200640 1 -- 172.21.15.112:0/471204015 shutdown_connections 2024-09-12T02:41:50.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.819+0000 7f4eb3200640 1 --2- 172.21.15.112:0/471204015 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4e9406be30 0x7f4e9406e2f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:50.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.819+0000 7f4eb3200640 1 --2- 172.21.15.112:0/471204015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4eb41624b0 0x7f4eb414b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:50.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.819+0000 7f4eb3200640 1 --2- 172.21.15.112:0/471204015 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4eb40b3ad0 0x7f4eb40b8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:50.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.819+0000 7f4eb3200640 1 --2- 172.21.15.112:0/471204015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eb40b1a40 0x7f4eb40cc0f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:50.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.819+0000 7f4eb3200640 1 -- 172.21.15.112:0/471204015 >> 172.21.15.112:0/471204015 conn(0x7f4eb40d4db0 msgr2=0x7f4eb40b4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:50.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.819+0000 7f4eb3200640 1 -- 172.21.15.112:0/471204015 shutdown_connections 2024-09-12T02:41:50.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.819+0000 7f4eb3200640 1 -- 172.21.15.112:0/471204015 wait complete. 2024-09-12T02:41:50.835 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T02:41:50.835 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T02:41:50.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.992+0000 7fd093600640 1 Processor -- start 2024-09-12T02:41:50.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.992+0000 7fd093600640 1 -- start start 2024-09-12T02:41:50.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.993+0000 7fd093600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd08c15f020 0x7fd08c0cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:50.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.993+0000 7fd093600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd08c0d2b60 0x7fd08c0d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:50.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.993+0000 7fd093600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd08c15f400 con 0x7fd08c0d02f0 2024-09-12T02:41:50.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.993+0000 7fd093600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd08c06d460 con 0x7fd08c0d2b60 2024-09-12T02:41:50.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.993+0000 7fd093600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd08c0d0cd0 con 0x7fd08c15f020 2024-09-12T02:41:50.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.993+0000 7fd083e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd08c0d02f0 0x7fd08c06cd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60474/0 (socket says 172.21.15.112:60474) 2024-09-12T02:41:50.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.993+0000 7fd083e00640 1 -- 172.21.15.112:0/4198494417 learned_addr learned my addr 172.21.15.112:0/4198494417 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:41:50.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.993+0000 7fd091600640 1 --2- 172.21.15.112:0/4198494417 >> v2:172.21.15.112:3300/0 conn(0x7fd08c0d2b60 0x7fd08c0d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:50.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.994+0000 7fd090c00640 1 --2- 172.21.15.112:0/4198494417 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd08c15f020 0x7fd08c0cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:50.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.994+0000 7fd08be00640 1 -- 172.21.15.112:0/4198494417 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 862566904 0 0) 0x7fd08c15f400 con 0x7fd08c0d02f0 2024-09-12T02:41:50.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.994+0000 7fd08be00640 1 -- 172.21.15.112:0/4198494417 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd070003520 con 0x7fd08c0d02f0 2024-09-12T02:41:50.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.994+0000 7fd091600640 1 -- 172.21.15.112:0/4198494417 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd08c15f020 msgr2=0x7fd08c0cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:50.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.994+0000 7fd091600640 1 --2- 172.21.15.112:0/4198494417 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd08c15f020 0x7fd08c0cd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:50.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.994+0000 7fd091600640 1 -- 172.21.15.112:0/4198494417 >> v1:172.21.15.112:6789/0 conn(0x7fd08c0d02f0 legacy=0x7fd08c06cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:50.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.994+0000 7fd091600640 1 -- 172.21.15.112:0/4198494417 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd08c06d680 con 0x7fd08c0d2b60 2024-09-12T02:41:50.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.994+0000 7fd090c00640 1 --2- 172.21.15.112:0/4198494417 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd08c15f020 0x7fd08c0cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:41:50.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.995+0000 7fd091600640 1 --2- 172.21.15.112:0/4198494417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd08c0d2b60 0x7fd08c0d3010 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd0840097a0 tx=0x7fd08402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43fa26e8a8398508 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:50.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.995+0000 7fd08be00640 1 -- 172.21.15.112:0/4198494417 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd084037070 con 0x7fd08c0d2b60 2024-09-12T02:41:50.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.995+0000 7fd08be00640 1 -- 172.21.15.112:0/4198494417 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd08402ae50 con 0x7fd08c0d2b60 2024-09-12T02:41:50.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.995+0000 7fd08be00640 1 -- 172.21.15.112:0/4198494417 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd084032660 con 0x7fd08c0d2b60 2024-09-12T02:41:50.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.995+0000 7fd093600640 1 -- 172.21.15.112:0/4198494417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd08c0d2b60 msgr2=0x7fd08c0d3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:50.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.995+0000 7fd093600640 1 --2- 172.21.15.112:0/4198494417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd08c0d2b60 0x7fd08c0d3010 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd0840097a0 tx=0x7fd08402a100 comp rx=0 tx=0).stop 2024-09-12T02:41:50.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.996+0000 7fd093600640 1 -- 172.21.15.112:0/4198494417 shutdown_connections 2024-09-12T02:41:50.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.996+0000 7fd093600640 1 --2- 172.21.15.112:0/4198494417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd08c0d2b60 0x7fd08c0d3010 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:50.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.996+0000 7fd093600640 1 --2- 172.21.15.112:0/4198494417 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd08c15f020 0x7fd08c0cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:50.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.996+0000 7fd093600640 1 -- 172.21.15.112:0/4198494417 >> 172.21.15.112:0/4198494417 conn(0x7fd08c09ba60 msgr2=0x7fd08c09be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:50.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.996+0000 7fd093600640 1 -- 172.21.15.112:0/4198494417 shutdown_connections 2024-09-12T02:41:50.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.996+0000 7fd093600640 1 -- 172.21.15.112:0/4198494417 wait complete. 2024-09-12T02:41:50.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.997+0000 7fd093600640 1 Processor -- start 2024-09-12T02:41:50.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.997+0000 7fd093600640 1 -- start start 2024-09-12T02:41:50.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.998+0000 7fd093600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd08c0d02f0 0x7fd08c0b80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:50.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.998+0000 7fd093600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd08c0d2b60 0x7fd08c1f87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:50.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.998+0000 7fd093600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd08c15f020 0x7fd08c1f8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:50.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.998+0000 7fd093600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd08c06df20 con 0x7fd08c0d02f0 2024-09-12T02:41:50.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.998+0000 7fd093600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd08c06dc40 con 0x7fd08c15f020 2024-09-12T02:41:50.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.998+0000 7fd093600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd08c0d1420 con 0x7fd08c0d2b60 2024-09-12T02:41:51.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.999+0000 7fd090c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd08c0d02f0 0x7fd08c0b80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:51.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.999+0000 7fd083e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd08c0d2b60 0x7fd08c1f87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:51.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.999+0000 7fd090c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd08c0d02f0 0x7fd08c0b80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56044/0 (socket says 172.21.15.112:56044) 2024-09-12T02:41:51.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.999+0000 7fd090c00640 1 -- 172.21.15.112:0/3059127455 learned_addr learned my addr 172.21.15.112:0/3059127455 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:51.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.999+0000 7fd091600640 1 --2- 172.21.15.112:0/3059127455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd08c15f020 0x7fd08c1f8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:51.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.999+0000 7fd090c00640 1 -- 172.21.15.112:0/3059127455 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd08c0d2b60 msgr2=0x7fd08c1f87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:51.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.999+0000 7fd090c00640 1 --2- 172.21.15.112:0/3059127455 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd08c0d2b60 0x7fd08c1f87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:51.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.999+0000 7fd090c00640 1 -- 172.21.15.112:0/3059127455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd08c15f020 msgr2=0x7fd08c1f8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:51.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.999+0000 7fd090c00640 1 --2- 172.21.15.112:0/3059127455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd08c15f020 0x7fd08c1f8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:51.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.999+0000 7fd090c00640 1 -- 172.21.15.112:0/3059127455 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd08c0cac20 con 0x7fd08c0d02f0 2024-09-12T02:41:51.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.999+0000 7fd090c00640 1 --2- 172.21.15.112:0/3059127455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd08c0d02f0 0x7fd08c0b80b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd07c00ce00 tx=0x7fd07c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:51.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.999+0000 7fd089600640 1 -- 172.21.15.112:0/3059127455 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c00f890 con 0x7fd08c0d02f0 2024-09-12T02:41:51.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.999+0000 7fd089600640 1 -- 172.21.15.112:0/3059127455 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd07c00fa30 con 0x7fd08c0d02f0 2024-09-12T02:41:51.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.999+0000 7fd089600640 1 -- 172.21.15.112:0/3059127455 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c00fe40 con 0x7fd08c0d02f0 2024-09-12T02:41:51.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:50.999+0000 7fd093600640 1 -- 172.21.15.112:0/3059127455 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd08c0c9e60 con 0x7fd08c0d02f0 2024-09-12T02:41:51.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.000+0000 7fd093600640 1 -- 172.21.15.112:0/3059127455 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd08c0ca420 con 0x7fd08c0d02f0 2024-09-12T02:41:51.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.001+0000 7fd093600640 1 -- 172.21.15.112:0/3059127455 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd08c0d3a10 con 0x7fd08c0d02f0 2024-09-12T02:41:51.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.001+0000 7fd089600640 1 -- 172.21.15.112:0/3059127455 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd07c018400 con 0x7fd08c0d02f0 2024-09-12T02:41:51.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.003+0000 7fd089600640 1 --2- 172.21.15.112:0/3059127455 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd06806be30 0x7fd06806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:51.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.003+0000 7fd089600640 1 -- 172.21.15.112:0/3059127455 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fd07c08b6b0 con 0x7fd08c0d02f0 2024-09-12T02:41:51.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.003+0000 7fd083e00640 1 --2- 172.21.15.112:0/3059127455 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd06806be30 0x7fd06806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:51.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.004+0000 7fd083e00640 1 --2- 172.21.15.112:0/3059127455 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd06806be30 0x7fd06806e2f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd08c0c93f0 tx=0x7fd074009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:51.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.008+0000 7fd089600640 1 -- 172.21.15.112:0/3059127455 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd08c0d3a10 con 0x7fd08c0d02f0 2024-09-12T02:41:51.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.181+0000 7fd093600640 1 -- 172.21.15.112:0/3059127455 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd08c0cd240 con 0x7fd08c0d02f0 2024-09-12T02:41:51.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.756+0000 7fd089600640 1 -- 172.21.15.112:0/3059127455 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7fd07c014030 con 0x7fd08c0d02f0 2024-09-12T02:41:51.757 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' created 2024-09-12T02:41:51.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.759+0000 7fd093600640 1 -- 172.21.15.112:0/3059127455 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd06806be30 msgr2=0x7fd06806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:51.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.759+0000 7fd093600640 1 --2- 172.21.15.112:0/3059127455 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd06806be30 0x7fd06806e2f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd08c0c93f0 tx=0x7fd074009040 comp rx=0 tx=0).stop 2024-09-12T02:41:51.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.759+0000 7fd093600640 1 -- 172.21.15.112:0/3059127455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd08c0d02f0 msgr2=0x7fd08c0b80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:51.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.759+0000 7fd093600640 1 --2- 172.21.15.112:0/3059127455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd08c0d02f0 0x7fd08c0b80b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd07c00ce00 tx=0x7fd07c00a650 comp rx=0 tx=0).stop 2024-09-12T02:41:51.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.759+0000 7fd093600640 1 -- 172.21.15.112:0/3059127455 shutdown_connections 2024-09-12T02:41:51.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.759+0000 7fd093600640 1 --2- 172.21.15.112:0/3059127455 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd06806be30 0x7fd06806e2f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:51.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.759+0000 7fd093600640 1 --2- 172.21.15.112:0/3059127455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd08c15f020 0x7fd08c1f8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:51.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.759+0000 7fd093600640 1 --2- 172.21.15.112:0/3059127455 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd08c0d2b60 0x7fd08c1f87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:51.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.759+0000 7fd093600640 1 --2- 172.21.15.112:0/3059127455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd08c0d02f0 0x7fd08c0b80b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:51.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.759+0000 7fd093600640 1 -- 172.21.15.112:0/3059127455 >> 172.21.15.112:0/3059127455 conn(0x7fd08c09ba60 msgr2=0x7fd08c0ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:51.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.759+0000 7fd093600640 1 -- 172.21.15.112:0/3059127455 shutdown_connections 2024-09-12T02:41:51.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.759+0000 7fd093600640 1 -- 172.21.15.112:0/3059127455 wait complete. 2024-09-12T02:41:51.778 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:41:51.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.937+0000 7fcb54600640 1 Processor -- start 2024-09-12T02:41:51.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.937+0000 7fcb54600640 1 -- start start 2024-09-12T02:41:51.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.939+0000 7fcb54600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcb4c1466f0 0x7fcb4c0b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:51.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.939+0000 7fcb54600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcb4c1605e0 0x7fcb4c160a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:51.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.939+0000 7fcb54600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb4c160f40 con 0x7fcb4c071840 2024-09-12T02:41:51.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.939+0000 7fcb54600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fcb4c0b3af0 con 0x7fcb4c1605e0 2024-09-12T02:41:51.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.939+0000 7fcb54600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fcb4c0b3dd0 con 0x7fcb4c1466f0 2024-09-12T02:41:51.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.939+0000 7fcb51200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcb4c1605e0 0x7fcb4c160a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:51.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.939+0000 7fcb51200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcb4c1605e0 0x7fcb4c160a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38708/0 (socket says 172.21.15.112:38708) 2024-09-12T02:41:51.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.939+0000 7fcb51200640 1 -- 172.21.15.112:0/2868376704 learned_addr learned my addr 172.21.15.112:0/2868376704 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:51.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.939+0000 7fcb51c00640 1 --2- 172.21.15.112:0/2868376704 >> v2:172.21.15.137:3300/0 conn(0x7fcb4c1466f0 0x7fcb4c0b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:51.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.939+0000 7fcb51200640 1 -- 172.21.15.112:0/2868376704 >> v2:172.21.15.137:3300/0 conn(0x7fcb4c1466f0 msgr2=0x7fcb4c0b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:51.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.939+0000 7fcb51200640 1 --2- 172.21.15.112:0/2868376704 >> v2:172.21.15.137:3300/0 conn(0x7fcb4c1466f0 0x7fcb4c0b48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:51.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.939+0000 7fcb51200640 1 -- 172.21.15.112:0/2868376704 >> v1:172.21.15.137:6789/0 conn(0x7fcb4c071840 legacy=0x7fcb4c071cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:51.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.939+0000 7fcb51200640 1 -- 172.21.15.112:0/2868376704 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4c0b40b0 con 0x7fcb4c1605e0 2024-09-12T02:41:51.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.940+0000 7fcb51200640 1 --2- 172.21.15.112:0/2868376704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb4c1605e0 0x7fcb4c160a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c072d80 tx=0x7fcb3802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12376d6f2105c36c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:51.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.941+0000 7fcb4be00640 1 -- 172.21.15.112:0/2868376704 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb38037070 con 0x7fcb4c1605e0 2024-09-12T02:41:51.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.941+0000 7fcb4be00640 1 -- 172.21.15.112:0/2868376704 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb38032440 con 0x7fcb4c1605e0 2024-09-12T02:41:51.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.941+0000 7fcb4be00640 1 -- 172.21.15.112:0/2868376704 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb38032810 con 0x7fcb4c1605e0 2024-09-12T02:41:51.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.941+0000 7fcb54600640 1 -- 172.21.15.112:0/2868376704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb4c1605e0 msgr2=0x7fcb4c160a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:51.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.941+0000 7fcb54600640 1 --2- 172.21.15.112:0/2868376704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb4c1605e0 0x7fcb4c160a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c072d80 tx=0x7fcb3802a1e0 comp rx=0 tx=0).stop 2024-09-12T02:41:51.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.941+0000 7fcb54600640 1 -- 172.21.15.112:0/2868376704 shutdown_connections 2024-09-12T02:41:51.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.941+0000 7fcb54600640 1 --2- 172.21.15.112:0/2868376704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb4c1605e0 0x7fcb4c160a00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:51.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.941+0000 7fcb54600640 1 --2- 172.21.15.112:0/2868376704 >> v2:172.21.15.137:3300/0 conn(0x7fcb4c1466f0 0x7fcb4c0b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:51.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.941+0000 7fcb54600640 1 -- 172.21.15.112:0/2868376704 >> 172.21.15.112:0/2868376704 conn(0x7fcb4c0b28a0 msgr2=0x7fcb4c0b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:51.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.941+0000 7fcb54600640 1 -- 172.21.15.112:0/2868376704 shutdown_connections 2024-09-12T02:41:51.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.941+0000 7fcb54600640 1 -- 172.21.15.112:0/2868376704 wait complete. 2024-09-12T02:41:51.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.943+0000 7fcb54600640 1 Processor -- start 2024-09-12T02:41:51.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.943+0000 7fcb54600640 1 -- start start 2024-09-12T02:41:51.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.944+0000 7fcb54600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcb4c071840 0x7fcb4c15d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:51.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.944+0000 7fcb54600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb4c1466f0 0x7fcb4c157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:51.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.944+0000 7fcb54600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb4c1605e0 0x7fcb4c06e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:51.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.944+0000 7fcb54600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c15e1b0 con 0x7fcb4c1466f0 2024-09-12T02:41:51.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.944+0000 7fcb54600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c0b4df0 con 0x7fcb4c1605e0 2024-09-12T02:41:51.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.944+0000 7fcb54600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fcb4c15e330 con 0x7fcb4c071840 2024-09-12T02:41:51.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.944+0000 7fcb51200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb4c1466f0 0x7fcb4c157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:51.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.944+0000 7fcb51200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb4c1466f0 0x7fcb4c157870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38710/0 (socket says 172.21.15.112:38710) 2024-09-12T02:41:51.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.944+0000 7fcb51200640 1 -- 172.21.15.112:0/1101578161 learned_addr learned my addr 172.21.15.112:0/1101578161 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:51.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.944+0000 7fcb51c00640 1 --2- 172.21.15.112:0/1101578161 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcb4c071840 0x7fcb4c15d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:51.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.944+0000 7fcb52600640 1 --2- 172.21.15.112:0/1101578161 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb4c1605e0 0x7fcb4c06e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:51.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.945+0000 7fcb51200640 1 -- 172.21.15.112:0/1101578161 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcb4c071840 msgr2=0x7fcb4c15d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:51.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.945+0000 7fcb51200640 1 --2- 172.21.15.112:0/1101578161 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcb4c071840 0x7fcb4c15d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:51.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.945+0000 7fcb51200640 1 -- 172.21.15.112:0/1101578161 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb4c1605e0 msgr2=0x7fcb4c06e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:51.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.945+0000 7fcb51200640 1 --2- 172.21.15.112:0/1101578161 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb4c1605e0 0x7fcb4c06e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:51.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.945+0000 7fcb51200640 1 -- 172.21.15.112:0/1101578161 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4c15a410 con 0x7fcb4c1466f0 2024-09-12T02:41:51.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.945+0000 7fcb51200640 1 --2- 172.21.15.112:0/1101578161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb4c1466f0 0x7fcb4c157870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcb3802a220 tx=0x7fcb380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:51.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.945+0000 7fcb49600640 1 -- 172.21.15.112:0/1101578161 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb38041070 con 0x7fcb4c1466f0 2024-09-12T02:41:51.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.945+0000 7fcb49600640 1 -- 172.21.15.112:0/1101578161 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3803c870 con 0x7fcb4c1466f0 2024-09-12T02:41:51.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.945+0000 7fcb54600640 1 -- 172.21.15.112:0/1101578161 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb4c15a6f0 con 0x7fcb4c1466f0 2024-09-12T02:41:51.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.945+0000 7fcb49600640 1 -- 172.21.15.112:0/1101578161 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb38037040 con 0x7fcb4c1466f0 2024-09-12T02:41:51.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.945+0000 7fcb54600640 1 -- 172.21.15.112:0/1101578161 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb4c15da90 con 0x7fcb4c1466f0 2024-09-12T02:41:51.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.946+0000 7fcb54600640 1 -- 172.21.15.112:0/1101578161 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb4c15a8c0 con 0x7fcb4c1466f0 2024-09-12T02:41:51.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.947+0000 7fcb49600640 1 -- 172.21.15.112:0/1101578161 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb38044070 con 0x7fcb4c1466f0 2024-09-12T02:41:51.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.948+0000 7fcb49600640 1 --2- 172.21.15.112:0/1101578161 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcb2c06be30 0x7fcb2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:51.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.948+0000 7fcb49600640 1 -- 172.21.15.112:0/1101578161 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7fcb380abb30 con 0x7fcb4c1466f0 2024-09-12T02:41:51.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.948+0000 7fcb51c00640 1 --2- 172.21.15.112:0/1101578161 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcb2c06be30 0x7fcb2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:51.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.949+0000 7fcb51c00640 1 --2- 172.21.15.112:0/1101578161 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcb2c06be30 0x7fcb2c06e2f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcb40009b40 tx=0x7fcb40009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:51.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:51.952+0000 7fcb49600640 1 -- 172.21.15.112:0/1101578161 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcb3807a0e0 con 0x7fcb4c1466f0 2024-09-12T02:41:52.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.127+0000 7fcb54600640 1 -- 172.21.15.112:0/1101578161 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fcb4c1573d0 con 0x7fcb4c1466f0 2024-09-12T02:41:52.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.760+0000 7fcb49600640 1 -- 172.21.15.112:0/1101578161 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7fcb3807e3e0 con 0x7fcb4c1466f0 2024-09-12T02:41:52.761 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' created 2024-09-12T02:41:52.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.763+0000 7fcb54600640 1 -- 172.21.15.112:0/1101578161 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcb2c06be30 msgr2=0x7fcb2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:52.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.763+0000 7fcb54600640 1 --2- 172.21.15.112:0/1101578161 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcb2c06be30 0x7fcb2c06e2f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcb40009b40 tx=0x7fcb40009190 comp rx=0 tx=0).stop 2024-09-12T02:41:52.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.763+0000 7fcb54600640 1 -- 172.21.15.112:0/1101578161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb4c1466f0 msgr2=0x7fcb4c157870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:52.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.763+0000 7fcb54600640 1 --2- 172.21.15.112:0/1101578161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb4c1466f0 0x7fcb4c157870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcb3802a220 tx=0x7fcb380046c0 comp rx=0 tx=0).stop 2024-09-12T02:41:52.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.763+0000 7fcb54600640 1 -- 172.21.15.112:0/1101578161 shutdown_connections 2024-09-12T02:41:52.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.763+0000 7fcb54600640 1 --2- 172.21.15.112:0/1101578161 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcb2c06be30 0x7fcb2c06e2f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:52.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.763+0000 7fcb54600640 1 --2- 172.21.15.112:0/1101578161 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb4c1605e0 0x7fcb4c06e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:52.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.763+0000 7fcb54600640 1 --2- 172.21.15.112:0/1101578161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb4c1466f0 0x7fcb4c157870 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:52.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.763+0000 7fcb54600640 1 --2- 172.21.15.112:0/1101578161 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcb4c071840 0x7fcb4c15d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:52.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.763+0000 7fcb54600640 1 -- 172.21.15.112:0/1101578161 >> 172.21.15.112:0/1101578161 conn(0x7fcb4c0b28a0 msgr2=0x7fcb4c141300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:52.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.763+0000 7fcb54600640 1 -- 172.21.15.112:0/1101578161 shutdown_connections 2024-09-12T02:41:52.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.769+0000 7fcb54600640 1 -- 172.21.15.112:0/1101578161 wait complete. 2024-09-12T02:41:52.794 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T02:41:52.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.949+0000 7f07fe200640 1 Processor -- start 2024-09-12T02:41:52.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.949+0000 7f07fe200640 1 -- start start 2024-09-12T02:41:52.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.950+0000 7f07fe200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f07f806d590 0x7f07f806f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:52.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.950+0000 7f07fe200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f07f80d0820 0x7f07f80d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:52.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.950+0000 7f07fe200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07f80b42c0 con 0x7f07f815b9a0 2024-09-12T02:41:52.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.950+0000 7f07fe200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f07f806de70 con 0x7f07f806d590 2024-09-12T02:41:52.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.950+0000 7f07fe200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f07f815bd80 con 0x7f07f80d0820 2024-09-12T02:41:52.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.951+0000 7f07f7e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f07f806d590 0x7f07f806f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:52.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.951+0000 7f07f7e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f07f806d590 0x7f07f806f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:37880/0 (socket says 172.21.15.112:37880) 2024-09-12T02:41:52.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.951+0000 7f07fce00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f07f815b9a0 0x7f07f80b5020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.112:54346/0 (socket says 172.21.15.112:54346) 2024-09-12T02:41:52.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.951+0000 7f07f7e00640 1 -- 172.21.15.112:0/527857728 learned_addr learned my addr 172.21.15.112:0/527857728 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:52.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.951+0000 7f07fd800640 1 --2- 172.21.15.112:0/527857728 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f07f80d0820 0x7f07f80d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:52.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.951+0000 7f07f7400640 1 -- 172.21.15.112:0/527857728 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2044820358 0 0) 0x7f07ec001110 con 0x7f07f815b9a0 2024-09-12T02:41:52.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.951+0000 7f07f7400640 1 -- 172.21.15.112:0/527857728 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07e0003520 con 0x7f07f815b9a0 2024-09-12T02:41:52.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.951+0000 7f07fd800640 1 -- 172.21.15.112:0/527857728 >> v2:172.21.15.137:3300/0 conn(0x7f07f806d590 msgr2=0x7f07f806f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:52.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.951+0000 7f07fd800640 1 --2- 172.21.15.112:0/527857728 >> v2:172.21.15.137:3300/0 conn(0x7f07f806d590 0x7f07f806f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:52.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.951+0000 7f07fd800640 1 -- 172.21.15.112:0/527857728 >> v1:172.21.15.137:6789/0 conn(0x7f07f815b9a0 legacy=0x7f07f80b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:52.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.951+0000 7f07fd800640 1 -- 172.21.15.112:0/527857728 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07f80b5730 con 0x7f07f80d0820 2024-09-12T02:41:52.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.951+0000 7f07f7e00640 1 --2- 172.21.15.112:0/527857728 >> v2:172.21.15.137:3300/0 conn(0x7f07f806d590 0x7f07f806f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:41:52.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.952+0000 7f07fd800640 1 --2- 172.21.15.112:0/527857728 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f07f80d0820 0x7f07f80d0cb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f07f0009d90 tx=0x7f07f002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61fe435a6ff832c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:52.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.952+0000 7f07f7400640 1 -- 172.21.15.112:0/527857728 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f0007740 con 0x7f07f80d0820 2024-09-12T02:41:52.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.953+0000 7f07f7400640 1 -- 172.21.15.112:0/527857728 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f00078e0 con 0x7f07f80d0820 2024-09-12T02:41:52.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.953+0000 7f07f7400640 1 -- 172.21.15.112:0/527857728 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f0007cb0 con 0x7f07f80d0820 2024-09-12T02:41:52.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.953+0000 7f07fe200640 1 -- 172.21.15.112:0/527857728 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f07f80d0820 msgr2=0x7f07f80d0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:52.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.953+0000 7f07fe200640 1 --2- 172.21.15.112:0/527857728 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f07f80d0820 0x7f07f80d0cb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f07f0009d90 tx=0x7f07f002a660 comp rx=0 tx=0).stop 2024-09-12T02:41:52.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.953+0000 7f07fe200640 1 -- 172.21.15.112:0/527857728 shutdown_connections 2024-09-12T02:41:52.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.953+0000 7f07fe200640 1 --2- 172.21.15.112:0/527857728 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f07f80d0820 0x7f07f80d0cb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:52.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.953+0000 7f07fe200640 1 --2- 172.21.15.112:0/527857728 >> v2:172.21.15.137:3300/0 conn(0x7f07f806d590 0x7f07f806f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:52.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.953+0000 7f07fe200640 1 -- 172.21.15.112:0/527857728 >> 172.21.15.112:0/527857728 conn(0x7f07f806bbd0 msgr2=0x7f07f806bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:52.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.953+0000 7f07fe200640 1 -- 172.21.15.112:0/527857728 shutdown_connections 2024-09-12T02:41:52.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.953+0000 7f07fe200640 1 -- 172.21.15.112:0/527857728 wait complete. 2024-09-12T02:41:52.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.955+0000 7f07fe200640 1 Processor -- start 2024-09-12T02:41:52.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.955+0000 7f07fe200640 1 -- start start 2024-09-12T02:41:52.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.956+0000 7f07fe200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07f806d590 0x7f07f815e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:52.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.956+0000 7f07fe200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f07f80d0820 0x7f07f8157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:52.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.956+0000 7f07fe200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07f815b9a0 0x7f07f80ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:52.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.956+0000 7f07fe200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f07f80b4820 con 0x7f07f815b9a0 2024-09-12T02:41:52.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.956+0000 7f07fe200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f07f80b4540 con 0x7f07f806d590 2024-09-12T02:41:52.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.956+0000 7f07fe200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f07f80b4b00 con 0x7f07f80d0820 2024-09-12T02:41:52.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.956+0000 7f07fd800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07f815b9a0 0x7f07f80ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:52.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.956+0000 7f07fd800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07f815b9a0 0x7f07f80ae8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38718/0 (socket says 172.21.15.112:38718) 2024-09-12T02:41:52.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.956+0000 7f07fd800640 1 -- 172.21.15.112:0/1848020493 learned_addr learned my addr 172.21.15.112:0/1848020493 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:52.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.956+0000 7f07fce00640 1 --2- 172.21.15.112:0/1848020493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07f806d590 0x7f07f815e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:52.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.956+0000 7f07f7e00640 1 --2- 172.21.15.112:0/1848020493 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f07f80d0820 0x7f07f8157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:52.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.957+0000 7f07fd800640 1 -- 172.21.15.112:0/1848020493 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f07f80d0820 msgr2=0x7f07f8157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:52.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.957+0000 7f07fd800640 1 --2- 172.21.15.112:0/1848020493 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f07f80d0820 0x7f07f8157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:52.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.957+0000 7f07fd800640 1 -- 172.21.15.112:0/1848020493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07f806d590 msgr2=0x7f07f815e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:52.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.957+0000 7f07fd800640 1 --2- 172.21.15.112:0/1848020493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07f806d590 0x7f07f815e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:52.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.957+0000 7f07fd800640 1 -- 172.21.15.112:0/1848020493 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07f815ef00 con 0x7f07f815b9a0 2024-09-12T02:41:52.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.957+0000 7f07fd800640 1 --2- 172.21.15.112:0/1848020493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07f815b9a0 0x7f07f80ae8d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f07f0009eb0 tx=0x7f07f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:52.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.957+0000 7f07f4c00640 1 -- 172.21.15.112:0/1848020493 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f0040070 con 0x7f07f815b9a0 2024-09-12T02:41:52.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.957+0000 7f07f4c00640 1 -- 172.21.15.112:0/1848020493 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f0031c60 con 0x7f07f815b9a0 2024-09-12T02:41:52.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.957+0000 7f07f4c00640 1 -- 172.21.15.112:0/1848020493 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f0009450 con 0x7f07f815b9a0 2024-09-12T02:41:52.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.957+0000 7f07fe200640 1 -- 172.21.15.112:0/1848020493 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07f8148fc0 con 0x7f07f815b9a0 2024-09-12T02:41:52.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.958+0000 7f07fe200640 1 -- 172.21.15.112:0/1848020493 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07f8149580 con 0x7f07f815b9a0 2024-09-12T02:41:52.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.959+0000 7f07fe200640 1 -- 172.21.15.112:0/1848020493 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07f80b5b50 con 0x7f07f815b9a0 2024-09-12T02:41:52.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.960+0000 7f07f4c00640 1 -- 172.21.15.112:0/1848020493 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f07f0039040 con 0x7f07f815b9a0 2024-09-12T02:41:52.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.961+0000 7f07f4c00640 1 --2- 172.21.15.112:0/1848020493 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f07d806be80 0x7f07d806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:52.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.961+0000 7f07f4c00640 1 -- 172.21.15.112:0/1848020493 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f07f00ac100 con 0x7f07f815b9a0 2024-09-12T02:41:52.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.961+0000 7f07fce00640 1 --2- 172.21.15.112:0/1848020493 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f07d806be80 0x7f07d806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:52.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.962+0000 7f07fce00640 1 --2- 172.21.15.112:0/1848020493 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f07d806be80 0x7f07d806e340 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0013b0 tx=0x7f07ec000ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:52.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:52.966+0000 7f07f4c00640 1 -- 172.21.15.112:0/1848020493 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f07f007a4a0 con 0x7f07f815b9a0 2024-09-12T02:41:53.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.172+0000 7f07fe200640 1 -- 172.21.15.112:0/1848020493 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f07f80ce740 con 0x7f07f815b9a0 2024-09-12T02:41:53.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.785+0000 7f07f4c00640 1 -- 172.21.15.112:0/1848020493 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f07f007e7a0 con 0x7f07f815b9a0 2024-09-12T02:41:53.794 INFO:teuthology.orchestra.run.smithi112.stderr:new fs with metadata pool 2 and data pool 3 2024-09-12T02:41:53.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.791+0000 7f07fe200640 1 -- 172.21.15.112:0/1848020493 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f07d806be80 msgr2=0x7f07d806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:53.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.791+0000 7f07fe200640 1 --2- 172.21.15.112:0/1848020493 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f07d806be80 0x7f07d806e340 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0013b0 tx=0x7f07ec000ed0 comp rx=0 tx=0).stop 2024-09-12T02:41:53.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.791+0000 7f07fe200640 1 -- 172.21.15.112:0/1848020493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07f815b9a0 msgr2=0x7f07f80ae8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:53.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.791+0000 7f07fe200640 1 --2- 172.21.15.112:0/1848020493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07f815b9a0 0x7f07f80ae8d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f07f0009eb0 tx=0x7f07f0004a40 comp rx=0 tx=0).stop 2024-09-12T02:41:53.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.792+0000 7f07fe200640 1 -- 172.21.15.112:0/1848020493 shutdown_connections 2024-09-12T02:41:53.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.792+0000 7f07fe200640 1 --2- 172.21.15.112:0/1848020493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07f815b9a0 0x7f07f80ae8d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:53.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.792+0000 7f07fe200640 1 --2- 172.21.15.112:0/1848020493 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f07f80d0820 0x7f07f8157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:53.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.792+0000 7f07fe200640 1 --2- 172.21.15.112:0/1848020493 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f07d806be80 0x7f07d806e340 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:53.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.792+0000 7f07fe200640 1 --2- 172.21.15.112:0/1848020493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07f806d590 0x7f07f815e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:53.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.792+0000 7f07fe200640 1 -- 172.21.15.112:0/1848020493 >> 172.21.15.112:0/1848020493 conn(0x7f07f806bbd0 msgr2=0x7f07f80b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:53.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.793+0000 7f07fe200640 1 -- 172.21.15.112:0/1848020493 shutdown_connections 2024-09-12T02:41:53.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.793+0000 7f07fe200640 1 -- 172.21.15.112:0/1848020493 wait complete. 2024-09-12T02:41:53.816 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:41:53.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.967+0000 7f95ae400640 1 Processor -- start 2024-09-12T02:41:53.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.967+0000 7f95ae400640 1 -- start start 2024-09-12T02:41:53.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.968+0000 7f95ae400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f95a806f600 0x7f95a80b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:53.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.968+0000 7f95ae400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95a80b4a20 con 0x7f95a80b45d0 2024-09-12T02:41:53.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.968+0000 7f95ae400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95a80b54a0 con 0x7f95a815b9d0 2024-09-12T02:41:53.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.968+0000 7f95ae400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f95a80b3af0 con 0x7f95a806f600 2024-09-12T02:41:53.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.969+0000 7f95a6a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f95a806f600 0x7f95a80b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:53.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.969+0000 7f95a6a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f95a806f600 0x7f95a80b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38722/0 (socket says 172.21.15.112:38722) 2024-09-12T02:41:53.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.969+0000 7f95a6a00640 1 -- 172.21.15.112:0/3319295814 learned_addr learned my addr 172.21.15.112:0/3319295814 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:53.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.969+0000 7f95a6a00640 1 -- 172.21.15.112:0/3319295814 >> v1:172.21.15.137:6789/0 conn(0x7f95a815b9d0 legacy=0x7f95a806eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:53.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.969+0000 7f95a6a00640 1 -- 172.21.15.112:0/3319295814 >> v1:172.21.15.112:6789/0 conn(0x7f95a80b45d0 legacy=0x7f95a80cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:53.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.969+0000 7f95a6a00640 1 -- 172.21.15.112:0/3319295814 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a80b3dd0 con 0x7f95a806f600 2024-09-12T02:41:53.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.970+0000 7f95a6a00640 1 --2- 172.21.15.112:0/3319295814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95a806f600 0x7f95a80b4ec0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9594009850 tx=0x7f959402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b58474533fee10 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:53.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.970+0000 7f95a6000640 1 -- 172.21.15.112:0/3319295814 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9594004030 con 0x7f95a806f600 2024-09-12T02:41:53.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.970+0000 7f95a6000640 1 -- 172.21.15.112:0/3319295814 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95940041d0 con 0x7f95a806f600 2024-09-12T02:41:53.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.970+0000 7f95a6000640 1 -- 172.21.15.112:0/3319295814 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9594003610 con 0x7f95a806f600 2024-09-12T02:41:53.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.971+0000 7f95ae400640 1 -- 172.21.15.112:0/3319295814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95a806f600 msgr2=0x7f95a80b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:53.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.971+0000 7f95ae400640 1 --2- 172.21.15.112:0/3319295814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95a806f600 0x7f95a80b4ec0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9594009850 tx=0x7f959402a250 comp rx=0 tx=0).stop 2024-09-12T02:41:53.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.971+0000 7f95ae400640 1 -- 172.21.15.112:0/3319295814 shutdown_connections 2024-09-12T02:41:53.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.971+0000 7f95ae400640 1 --2- 172.21.15.112:0/3319295814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95a806f600 0x7f95a80b4ec0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:53.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.971+0000 7f95ae400640 1 -- 172.21.15.112:0/3319295814 >> 172.21.15.112:0/3319295814 conn(0x7f95a806bbd0 msgr2=0x7f95a806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:53.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.971+0000 7f95ae400640 1 -- 172.21.15.112:0/3319295814 shutdown_connections 2024-09-12T02:41:53.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.971+0000 7f95ae400640 1 -- 172.21.15.112:0/3319295814 wait complete. 2024-09-12T02:41:53.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.972+0000 7f95ae400640 1 Processor -- start 2024-09-12T02:41:53.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.972+0000 7f95ae400640 1 -- start start 2024-09-12T02:41:53.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.973+0000 7f95ae400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f95a806f600 0x7f95a815ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:53.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.973+0000 7f95ae400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95a80b45d0 0x7f95a80b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:53.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.973+0000 7f95ae400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95a815b9d0 0x7f95a80b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:53.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.973+0000 7f95ae400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f95a815bf30 con 0x7f95a815b9d0 2024-09-12T02:41:53.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.973+0000 7f95ae400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f95a815bdb0 con 0x7f95a80b45d0 2024-09-12T02:41:53.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.973+0000 7f95ae400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f95a80728c0 con 0x7f95a806f600 2024-09-12T02:41:53.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.974+0000 7f95a7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95a815b9d0 0x7f95a80b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:53.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.974+0000 7f95a7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95a815b9d0 0x7f95a80b10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38734/0 (socket says 172.21.15.112:38734) 2024-09-12T02:41:53.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.974+0000 7f95a7e00640 1 -- 172.21.15.112:0/3717893605 learned_addr learned my addr 172.21.15.112:0/3717893605 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:53.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.974+0000 7f95a6a00640 1 --2- 172.21.15.112:0/3717893605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95a80b45d0 0x7f95a80b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:53.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.974+0000 7f95a7400640 1 --2- 172.21.15.112:0/3717893605 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f95a806f600 0x7f95a815ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:53.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.974+0000 7f95a7e00640 1 -- 172.21.15.112:0/3717893605 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f95a806f600 msgr2=0x7f95a815ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:53.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.974+0000 7f95a7e00640 1 --2- 172.21.15.112:0/3717893605 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f95a806f600 0x7f95a815ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:53.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.974+0000 7f95a7e00640 1 -- 172.21.15.112:0/3717893605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95a80b45d0 msgr2=0x7f95a80b0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:53.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.974+0000 7f95a7e00640 1 --2- 172.21.15.112:0/3717893605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95a80b45d0 0x7f95a80b0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:53.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.974+0000 7f95a7e00640 1 -- 172.21.15.112:0/3717893605 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a81f6b30 con 0x7f95a815b9d0 2024-09-12T02:41:53.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.974+0000 7f95a6a00640 1 --2- 172.21.15.112:0/3717893605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95a80b45d0 0x7f95a80b0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:41:53.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.974+0000 7f95a7400640 1 --2- 172.21.15.112:0/3717893605 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f95a806f600 0x7f95a815ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:41:53.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.974+0000 7f95a7e00640 1 --2- 172.21.15.112:0/3717893605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95a815b9d0 0x7f95a80b10c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f95a000c7a0 tx=0x7f95a000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:53.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.974+0000 7f959f400640 1 -- 172.21.15.112:0/3717893605 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a0003b70 con 0x7f95a815b9d0 2024-09-12T02:41:53.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.975+0000 7f959f400640 1 -- 172.21.15.112:0/3717893605 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95a0003d30 con 0x7f95a815b9d0 2024-09-12T02:41:53.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.975+0000 7f959f400640 1 -- 172.21.15.112:0/3717893605 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a000aa90 con 0x7f95a815b9d0 2024-09-12T02:41:53.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.975+0000 7f95ae400640 1 -- 172.21.15.112:0/3717893605 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a81f6e10 con 0x7f95a815b9d0 2024-09-12T02:41:53.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.975+0000 7f95ae400640 1 -- 172.21.15.112:0/3717893605 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a81f73d0 con 0x7f95a815b9d0 2024-09-12T02:41:53.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.976+0000 7f95ae400640 1 -- 172.21.15.112:0/3717893605 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95a8068a30 con 0x7f95a815b9d0 2024-09-12T02:41:53.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.977+0000 7f959f400640 1 -- 172.21.15.112:0/3717893605 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f95a000ac30 con 0x7f95a815b9d0 2024-09-12T02:41:53.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.977+0000 7f959f400640 1 --2- 172.21.15.112:0/3717893605 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f958806be30 0x7f958806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:53.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.978+0000 7f959f400640 1 -- 172.21.15.112:0/3717893605 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f95a008ae10 con 0x7f95a815b9d0 2024-09-12T02:41:53.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.978+0000 7f95a7400640 1 --2- 172.21.15.112:0/3717893605 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f958806be30 0x7f958806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:53.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.978+0000 7f95a7400640 1 --2- 172.21.15.112:0/3717893605 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f958806be30 0x7f958806e2f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f95980015e0 tx=0x7f9598009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:53.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:53.982+0000 7f959f400640 1 -- 172.21.15.112:0/3717893605 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f95a00597c0 con 0x7f95a815b9d0 2024-09-12T02:41:54.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.156+0000 7f95ae400640 1 -- 172.21.15.112:0/3717893605 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f95a8072c50 con 0x7f95a815b9d0 2024-09-12T02:41:54.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.157+0000 7f959f400640 1 -- 172.21.15.112:0/3717893605 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16726 (secure 0 0 0) 0x7f95a00590c0 con 0x7f95a815b9d0 2024-09-12T02:41:54.159 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:54.159 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":19,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:41:53.174272+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:41:51.222228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:41:52.167920+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:41:54.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.159+0000 7f95ae400640 1 -- 172.21.15.112:0/3717893605 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f958806be30 msgr2=0x7f958806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:54.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.159+0000 7f95ae400640 1 --2- 172.21.15.112:0/3717893605 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f958806be30 0x7f958806e2f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f95980015e0 tx=0x7f9598009040 comp rx=0 tx=0).stop 2024-09-12T02:41:54.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.159+0000 7f95ae400640 1 -- 172.21.15.112:0/3717893605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95a815b9d0 msgr2=0x7f95a80b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:54.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.159+0000 7f95ae400640 1 --2- 172.21.15.112:0/3717893605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95a815b9d0 0x7f95a80b10c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f95a000c7a0 tx=0x7f95a000cc60 comp rx=0 tx=0).stop 2024-09-12T02:41:54.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.159+0000 7f95ae400640 1 -- 172.21.15.112:0/3717893605 shutdown_connections 2024-09-12T02:41:54.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.159+0000 7f95ae400640 1 --2- 172.21.15.112:0/3717893605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95a815b9d0 0x7f95a80b10c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:54.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.159+0000 7f95ae400640 1 --2- 172.21.15.112:0/3717893605 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f958806be30 0x7f958806e2f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:54.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.159+0000 7f95ae400640 1 --2- 172.21.15.112:0/3717893605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95a80b45d0 0x7f95a80b0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:54.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.159+0000 7f95ae400640 1 --2- 172.21.15.112:0/3717893605 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f95a806f600 0x7f95a815ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:54.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.159+0000 7f95ae400640 1 -- 172.21.15.112:0/3717893605 >> 172.21.15.112:0/3717893605 conn(0x7f95a806bbd0 msgr2=0x7f95a80cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:54.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.160+0000 7f95ae400640 1 -- 172.21.15.112:0/3717893605 shutdown_connections 2024-09-12T02:41:54.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.160+0000 7f95ae400640 1 -- 172.21.15.112:0/3717893605 wait complete. 2024-09-12T02:41:54.176 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:41:54.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.327+0000 7f1343200640 1 Processor -- start 2024-09-12T02:41:54.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.327+0000 7f1343200640 1 -- start start 2024-09-12T02:41:54.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.328+0000 7f1343200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f133c15b9d0 0x7f133c0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:54.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.329+0000 7f1343200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f133c0b54a0 con 0x7f133c06f600 2024-09-12T02:41:54.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.329+0000 7f1343200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f133c0b3af0 con 0x7f133c0b45d0 2024-09-12T02:41:54.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.329+0000 7f1343200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f133c0b4a60 con 0x7f133c15b9d0 2024-09-12T02:41:54.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.329+0000 7f133be00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f133c15b9d0 0x7f133c0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:54.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.329+0000 7f133be00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f133c15b9d0 0x7f133c0b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38738/0 (socket says 172.21.15.112:38738) 2024-09-12T02:41:54.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.329+0000 7f1341200640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f133c06f600 0x7f133c0cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:57798/0 (socket says 172.21.15.112:57798) 2024-09-12T02:41:54.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.329+0000 7f133be00640 1 -- 172.21.15.112:0/4018737132 learned_addr learned my addr 172.21.15.112:0/4018737132 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:54.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.329+0000 7f133be00640 1 -- 172.21.15.112:0/4018737132 >> v1:172.21.15.137:6789/0 conn(0x7f133c0b45d0 legacy=0x7f133c06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:54.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.329+0000 7f133be00640 1 -- 172.21.15.112:0/4018737132 >> v1:172.21.15.112:6789/0 conn(0x7f133c06f600 legacy=0x7f133c0cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:54.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.329+0000 7f133be00640 1 -- 172.21.15.112:0/4018737132 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f133c0b3dd0 con 0x7f133c15b9d0 2024-09-12T02:41:54.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.330+0000 7f133be00640 1 --2- 172.21.15.112:0/4018737132 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f133c15b9d0 0x7f133c0b4ec0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f132c009870 tx=0x7f132c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59727323ec0216c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:54.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.330+0000 7f133b400640 1 -- 172.21.15.112:0/4018737132 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f132c037070 con 0x7f133c15b9d0 2024-09-12T02:41:54.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.330+0000 7f133b400640 1 -- 172.21.15.112:0/4018737132 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f132c032440 con 0x7f133c15b9d0 2024-09-12T02:41:54.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.330+0000 7f133b400640 1 -- 172.21.15.112:0/4018737132 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f132c032810 con 0x7f133c15b9d0 2024-09-12T02:41:54.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.331+0000 7f1343200640 1 -- 172.21.15.112:0/4018737132 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f133c15b9d0 msgr2=0x7f133c0b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:54.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.331+0000 7f1343200640 1 --2- 172.21.15.112:0/4018737132 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f133c15b9d0 0x7f133c0b4ec0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f132c009870 tx=0x7f132c02a270 comp rx=0 tx=0).stop 2024-09-12T02:41:54.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.331+0000 7f1343200640 1 -- 172.21.15.112:0/4018737132 shutdown_connections 2024-09-12T02:41:54.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.331+0000 7f1343200640 1 --2- 172.21.15.112:0/4018737132 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f133c15b9d0 0x7f133c0b4ec0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:54.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.331+0000 7f1343200640 1 -- 172.21.15.112:0/4018737132 >> 172.21.15.112:0/4018737132 conn(0x7f133c06bbd0 msgr2=0x7f133c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:54.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.331+0000 7f1343200640 1 -- 172.21.15.112:0/4018737132 shutdown_connections 2024-09-12T02:41:54.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.331+0000 7f1343200640 1 -- 172.21.15.112:0/4018737132 wait complete. 2024-09-12T02:41:54.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.333+0000 7f1343200640 1 Processor -- start 2024-09-12T02:41:54.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.333+0000 7f1343200640 1 -- start start 2024-09-12T02:41:54.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.334+0000 7f1343200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f133c06f600 0x7f133c145520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:54.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.334+0000 7f1343200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f133c0b45d0 0x7f133c15a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:54.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.334+0000 7f1343200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f133c15b9d0 0x7f133c15a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:54.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.334+0000 7f1343200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f133c15bf30 con 0x7f133c0b45d0 2024-09-12T02:41:54.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.334+0000 7f1343200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f133c15bdb0 con 0x7f133c06f600 2024-09-12T02:41:54.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.334+0000 7f1343200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f133c0728c0 con 0x7f133c15b9d0 2024-09-12T02:41:54.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.334+0000 7f1333400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f133c0b45d0 0x7f133c15a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:54.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.334+0000 7f1333400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f133c0b45d0 0x7f133c15a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38754/0 (socket says 172.21.15.112:38754) 2024-09-12T02:41:54.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.334+0000 7f1333400640 1 -- 172.21.15.112:0/279914255 learned_addr learned my addr 172.21.15.112:0/279914255 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:54.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.334+0000 7f133be00640 1 --2- 172.21.15.112:0/279914255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f133c06f600 0x7f133c145520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:54.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.334+0000 7f1341200640 1 --2- 172.21.15.112:0/279914255 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f133c15b9d0 0x7f133c15a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:54.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.335+0000 7f1333400640 1 -- 172.21.15.112:0/279914255 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f133c15b9d0 msgr2=0x7f133c15a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:54.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.335+0000 7f1333400640 1 --2- 172.21.15.112:0/279914255 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f133c15b9d0 0x7f133c15a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:54.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.335+0000 7f1333400640 1 -- 172.21.15.112:0/279914255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f133c06f600 msgr2=0x7f133c145520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:54.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.335+0000 7f1333400640 1 --2- 172.21.15.112:0/279914255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f133c06f600 0x7f133c145520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:54.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.335+0000 7f1333400640 1 -- 172.21.15.112:0/279914255 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f133c155850 con 0x7f133c0b45d0 2024-09-12T02:41:54.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.335+0000 7f1341200640 1 --2- 172.21.15.112:0/279914255 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f133c15b9d0 0x7f133c15a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:41:54.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.335+0000 7f1333400640 1 --2- 172.21.15.112:0/279914255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f133c0b45d0 0x7f133c15a4b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f132400c430 tx=0x7f132400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:54.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.335+0000 7f1338c00640 1 -- 172.21.15.112:0/279914255 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13240052d0 con 0x7f133c0b45d0 2024-09-12T02:41:54.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.335+0000 7f1338c00640 1 -- 172.21.15.112:0/279914255 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13240054b0 con 0x7f133c0b45d0 2024-09-12T02:41:54.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.335+0000 7f1338c00640 1 -- 172.21.15.112:0/279914255 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1324006a60 con 0x7f133c0b45d0 2024-09-12T02:41:54.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.335+0000 7f1343200640 1 -- 172.21.15.112:0/279914255 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f133c155b30 con 0x7f133c0b45d0 2024-09-12T02:41:54.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.335+0000 7f1343200640 1 -- 172.21.15.112:0/279914255 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f133c1560f0 con 0x7f133c0b45d0 2024-09-12T02:41:54.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.336+0000 7f1343200640 1 -- 172.21.15.112:0/279914255 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f133c072c50 con 0x7f133c0b45d0 2024-09-12T02:41:54.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.337+0000 7f1338c00640 1 -- 172.21.15.112:0/279914255 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1324006c00 con 0x7f133c0b45d0 2024-09-12T02:41:54.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.338+0000 7f1338c00640 1 --2- 172.21.15.112:0/279914255 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f131806be30 0x7f131806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:54.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.338+0000 7f1338c00640 1 -- 172.21.15.112:0/279914255 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f132408a300 con 0x7f133c0b45d0 2024-09-12T02:41:54.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.338+0000 7f133be00640 1 --2- 172.21.15.112:0/279914255 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f131806be30 0x7f131806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:54.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.339+0000 7f133be00640 1 --2- 172.21.15.112:0/279914255 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f131806be30 0x7f131806e2f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f132c034000 tx=0x7f132c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:54.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.342+0000 7f1338c00640 1 -- 172.21.15.112:0/279914255 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f13240585c0 con 0x7f133c0b45d0 2024-09-12T02:41:54.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.520+0000 7f1343200640 1 -- 172.21.15.112:0/279914255 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f133c06f040 con 0x7f133c0b45d0 2024-09-12T02:41:54.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.522+0000 7f1338c00640 1 -- 172.21.15.112:0/279914255 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16726 (secure 0 0 0) 0x7f132405c8c0 con 0x7f133c0b45d0 2024-09-12T02:41:54.523 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:54.523 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":19,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:41:53.174272+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:41:51.222228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:41:52.167920+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:41:54.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.524+0000 7f1343200640 1 -- 172.21.15.112:0/279914255 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f131806be30 msgr2=0x7f131806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:54.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.524+0000 7f1343200640 1 --2- 172.21.15.112:0/279914255 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f131806be30 0x7f131806e2f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f132c034000 tx=0x7f132c02e000 comp rx=0 tx=0).stop 2024-09-12T02:41:54.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.524+0000 7f1343200640 1 -- 172.21.15.112:0/279914255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f133c0b45d0 msgr2=0x7f133c15a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:54.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.524+0000 7f1343200640 1 --2- 172.21.15.112:0/279914255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f133c0b45d0 0x7f133c15a4b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f132400c430 tx=0x7f132400c8f0 comp rx=0 tx=0).stop 2024-09-12T02:41:54.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.524+0000 7f1343200640 1 -- 172.21.15.112:0/279914255 shutdown_connections 2024-09-12T02:41:54.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.524+0000 7f1343200640 1 --2- 172.21.15.112:0/279914255 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f133c15b9d0 0x7f133c15a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:54.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.524+0000 7f1343200640 1 --2- 172.21.15.112:0/279914255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f133c0b45d0 0x7f133c15a4b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:54.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.524+0000 7f1343200640 1 --2- 172.21.15.112:0/279914255 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f131806be30 0x7f131806e2f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:54.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.524+0000 7f1343200640 1 --2- 172.21.15.112:0/279914255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f133c06f600 0x7f133c145520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:54.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.524+0000 7f1343200640 1 -- 172.21.15.112:0/279914255 >> 172.21.15.112:0/279914255 conn(0x7f133c06bbd0 msgr2=0x7f133c0b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:54.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.524+0000 7f1343200640 1 -- 172.21.15.112:0/279914255 shutdown_connections 2024-09-12T02:41:54.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.524+0000 7f1343200640 1 -- 172.21.15.112:0/279914255 wait complete. 2024-09-12T02:41:54.540 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T02:41:54.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.695+0000 7fb69da00640 1 Processor -- start 2024-09-12T02:41:54.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.695+0000 7fb69da00640 1 -- start start 2024-09-12T02:41:54.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.696+0000 7fb69da00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb6980d1710 0x7fb6980d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:54.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.696+0000 7fb69da00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb6980b1d70 0x7fb6980b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:54.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.696+0000 7fb69da00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6980d2fb0 con 0x7fb6980b3e00 2024-09-12T02:41:54.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.696+0000 7fb69da00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb6980d3cb0 con 0x7fb6980d1710 2024-09-12T02:41:54.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.696+0000 7fb69da00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb6980d0b60 con 0x7fb6980b1d70 2024-09-12T02:41:54.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.696+0000 7fb697e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb6980d1710 0x7fb6980d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:54.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.697+0000 7fb697e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb6980d1710 0x7fb6980d28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38764/0 (socket says 172.21.15.112:38764) 2024-09-12T02:41:54.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.697+0000 7fb697e00640 1 -- 172.21.15.112:0/899841892 learned_addr learned my addr 172.21.15.112:0/899841892 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:54.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.697+0000 7fb697400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb6980b3e00 0x7fb6980d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:57814/0 (socket says 172.21.15.112:57814) 2024-09-12T02:41:54.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.697+0000 7fb69d000640 1 --2- 172.21.15.112:0/899841892 >> v2:172.21.15.137:3300/0 conn(0x7fb6980b1d70 0x7fb6980b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:54.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.697+0000 7fb697e00640 1 -- 172.21.15.112:0/899841892 >> v2:172.21.15.137:3300/0 conn(0x7fb6980b1d70 msgr2=0x7fb6980b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:54.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.697+0000 7fb697e00640 1 --2- 172.21.15.112:0/899841892 >> v2:172.21.15.137:3300/0 conn(0x7fb6980b1d70 0x7fb6980b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:54.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.697+0000 7fb697e00640 1 -- 172.21.15.112:0/899841892 >> v1:172.21.15.112:6789/0 conn(0x7fb6980b3e00 legacy=0x7fb6980d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:54.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.697+0000 7fb697e00640 1 -- 172.21.15.112:0/899841892 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6980d3410 con 0x7fb6980d1710 2024-09-12T02:41:54.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.697+0000 7fb69d000640 1 --2- 172.21.15.112:0/899841892 >> v2:172.21.15.137:3300/0 conn(0x7fb6980b1d70 0x7fb6980b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:41:54.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.698+0000 7fb697e00640 1 --2- 172.21.15.112:0/899841892 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6980d1710 0x7fb6980d28d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb69808ef20 tx=0x7fb68802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be68e4863745b2e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:54.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.698+0000 7fb696a00640 1 -- 172.21.15.112:0/899841892 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb688037070 con 0x7fb6980d1710 2024-09-12T02:41:54.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.698+0000 7fb696a00640 1 -- 172.21.15.112:0/899841892 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb688032440 con 0x7fb6980d1710 2024-09-12T02:41:54.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.698+0000 7fb696a00640 1 -- 172.21.15.112:0/899841892 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb688032810 con 0x7fb6980d1710 2024-09-12T02:41:54.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.699+0000 7fb69da00640 1 -- 172.21.15.112:0/899841892 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6980d1710 msgr2=0x7fb6980d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:54.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.699+0000 7fb69da00640 1 --2- 172.21.15.112:0/899841892 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6980d1710 0x7fb6980d28d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb69808ef20 tx=0x7fb68802a270 comp rx=0 tx=0).stop 2024-09-12T02:41:54.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.699+0000 7fb69da00640 1 -- 172.21.15.112:0/899841892 shutdown_connections 2024-09-12T02:41:54.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.699+0000 7fb69da00640 1 --2- 172.21.15.112:0/899841892 >> v2:172.21.15.137:3300/0 conn(0x7fb6980b1d70 0x7fb6980b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:54.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.699+0000 7fb69da00640 1 --2- 172.21.15.112:0/899841892 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6980d1710 0x7fb6980d28d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:54.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.699+0000 7fb69da00640 1 -- 172.21.15.112:0/899841892 >> 172.21.15.112:0/899841892 conn(0x7fb69809e030 msgr2=0x7fb6980d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:54.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.699+0000 7fb69da00640 1 -- 172.21.15.112:0/899841892 shutdown_connections 2024-09-12T02:41:54.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.699+0000 7fb69da00640 1 -- 172.21.15.112:0/899841892 wait complete. 2024-09-12T02:41:54.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.701+0000 7fb69da00640 1 Processor -- start 2024-09-12T02:41:54.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.701+0000 7fb69da00640 1 -- start start 2024-09-12T02:41:54.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.702+0000 7fb69da00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6980b1d70 0x7fb6980ced60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:54.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.702+0000 7fb69da00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6980b3e00 0x7fb6980cde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:54.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.702+0000 7fb69da00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6980d1710 0x7fb6980cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:54.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.702+0000 7fb69da00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb69815f110 con 0x7fb6980b1d70 2024-09-12T02:41:54.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.702+0000 7fb69da00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb6980d39d0 con 0x7fb6980b3e00 2024-09-12T02:41:54.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.702+0000 7fb69da00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb69815f290 con 0x7fb6980d1710 2024-09-12T02:41:54.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.702+0000 7fb697e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6980b1d70 0x7fb6980ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:54.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.702+0000 7fb697e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6980b1d70 0x7fb6980ced60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38768/0 (socket says 172.21.15.112:38768) 2024-09-12T02:41:54.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.702+0000 7fb697e00640 1 -- 172.21.15.112:0/4190216660 learned_addr learned my addr 172.21.15.112:0/4190216660 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:54.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.702+0000 7fb697400640 1 --2- 172.21.15.112:0/4190216660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6980b3e00 0x7fb6980cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:54.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.702+0000 7fb69d000640 1 --2- 172.21.15.112:0/4190216660 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6980d1710 0x7fb6980cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:54.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.702+0000 7fb697e00640 1 -- 172.21.15.112:0/4190216660 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6980d1710 msgr2=0x7fb6980cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:54.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.702+0000 7fb697e00640 1 --2- 172.21.15.112:0/4190216660 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6980d1710 0x7fb6980cbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:54.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.702+0000 7fb697e00640 1 -- 172.21.15.112:0/4190216660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6980b3e00 msgr2=0x7fb6980cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:54.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.702+0000 7fb697e00640 1 --2- 172.21.15.112:0/4190216660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6980b3e00 0x7fb6980cde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:54.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.702+0000 7fb697e00640 1 -- 172.21.15.112:0/4190216660 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6981f48f0 con 0x7fb6980b1d70 2024-09-12T02:41:54.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.702+0000 7fb69d000640 1 --2- 172.21.15.112:0/4190216660 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6980d1710 0x7fb6980cbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:41:54.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.703+0000 7fb697e00640 1 --2- 172.21.15.112:0/4190216660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6980b1d70 0x7fb6980ced60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb68802a2b0 tx=0x7fb6880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:54.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.703+0000 7fb68fe00640 1 -- 172.21.15.112:0/4190216660 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb688041020 con 0x7fb6980b1d70 2024-09-12T02:41:54.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.703+0000 7fb68fe00640 1 -- 172.21.15.112:0/4190216660 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6880306c0 con 0x7fb6980b1d70 2024-09-12T02:41:54.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.703+0000 7fb68fe00640 1 -- 172.21.15.112:0/4190216660 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb688037040 con 0x7fb6980b1d70 2024-09-12T02:41:54.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.703+0000 7fb69da00640 1 -- 172.21.15.112:0/4190216660 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb698160a20 con 0x7fb6980b1d70 2024-09-12T02:41:54.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.703+0000 7fb69da00640 1 -- 172.21.15.112:0/4190216660 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb698160fe0 con 0x7fb6980b1d70 2024-09-12T02:41:54.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.704+0000 7fb69da00640 1 -- 172.21.15.112:0/4190216660 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6980d28d0 con 0x7fb6980b1d70 2024-09-12T02:41:54.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.705+0000 7fb68fe00640 1 -- 172.21.15.112:0/4190216660 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb688044020 con 0x7fb6980b1d70 2024-09-12T02:41:54.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.706+0000 7fb68fe00640 1 --2- 172.21.15.112:0/4190216660 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb67806be30 0x7fb67806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:54.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.706+0000 7fb68fe00640 1 -- 172.21.15.112:0/4190216660 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fb6880ab6f0 con 0x7fb6980b1d70 2024-09-12T02:41:54.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.706+0000 7fb697400640 1 --2- 172.21.15.112:0/4190216660 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb67806be30 0x7fb67806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:54.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.707+0000 7fb697400640 1 --2- 172.21.15.112:0/4190216660 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb67806be30 0x7fb67806e2f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb69806c6a0 tx=0x7fb684007c80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:54.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.710+0000 7fb68fe00640 1 -- 172.21.15.112:0/4190216660 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb68804b030 con 0x7fb6980b1d70 2024-09-12T02:41:54.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:54.922+0000 7fb69da00640 1 -- 172.21.15.112:0/4190216660 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb6980d1c00 con 0x7fb6980b1d70 2024-09-12T02:41:55.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.805+0000 7fb68fe00640 1 -- 172.21.15.112:0/4190216660 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fb68807a010 con 0x7fb6980b1d70 2024-09-12T02:41:55.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.807+0000 7fb69da00640 1 -- 172.21.15.112:0/4190216660 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb67806be30 msgr2=0x7fb67806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:55.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.807+0000 7fb69da00640 1 --2- 172.21.15.112:0/4190216660 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb67806be30 0x7fb67806e2f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb69806c6a0 tx=0x7fb684007c80 comp rx=0 tx=0).stop 2024-09-12T02:41:55.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.807+0000 7fb69da00640 1 -- 172.21.15.112:0/4190216660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6980b1d70 msgr2=0x7fb6980ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:55.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.807+0000 7fb69da00640 1 --2- 172.21.15.112:0/4190216660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6980b1d70 0x7fb6980ced60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb68802a2b0 tx=0x7fb6880046c0 comp rx=0 tx=0).stop 2024-09-12T02:41:55.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.807+0000 7fb69da00640 1 -- 172.21.15.112:0/4190216660 shutdown_connections 2024-09-12T02:41:55.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.807+0000 7fb69da00640 1 --2- 172.21.15.112:0/4190216660 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6980d1710 0x7fb6980cbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:55.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.807+0000 7fb69da00640 1 --2- 172.21.15.112:0/4190216660 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb67806be30 0x7fb67806e2f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:55.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.807+0000 7fb69da00640 1 --2- 172.21.15.112:0/4190216660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6980b3e00 0x7fb6980cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:55.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.807+0000 7fb69da00640 1 --2- 172.21.15.112:0/4190216660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6980b1d70 0x7fb6980ced60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:55.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.807+0000 7fb69da00640 1 -- 172.21.15.112:0/4190216660 >> 172.21.15.112:0/4190216660 conn(0x7fb69809e030 msgr2=0x7fb6980b7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:55.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.808+0000 7fb69da00640 1 -- 172.21.15.112:0/4190216660 shutdown_connections 2024-09-12T02:41:55.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.808+0000 7fb69da00640 1 -- 172.21.15.112:0/4190216660 wait complete. 2024-09-12T02:41:55.826 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['disabled']} 2024-09-12T02:41:55.826 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T02:41:55.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.984+0000 7f9485600640 1 Processor -- start 2024-09-12T02:41:55.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.984+0000 7f9485600640 1 -- start start 2024-09-12T02:41:55.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.985+0000 7f9485600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f94800b0770 0x7f94800708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:55.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.986+0000 7f9485600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94800b4ce0 0x7f94800b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:55.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.986+0000 7f9485600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94800b0c70 con 0x7f948015c800 2024-09-12T02:41:55.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.986+0000 7f9485600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f94800b0f50 con 0x7f94800b0770 2024-09-12T02:41:55.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.986+0000 7f9485600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f94800b1230 con 0x7f94800b4ce0 2024-09-12T02:41:55.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.986+0000 7f9477400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f94800b0770 0x7f94800708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:55.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.986+0000 7f9477400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f94800b0770 0x7f94800708c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38776/0 (socket says 172.21.15.112:38776) 2024-09-12T02:41:55.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.986+0000 7f9477400640 1 -- 172.21.15.112:0/4187311247 learned_addr learned my addr 172.21.15.112:0/4187311247 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:55.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.986+0000 7f9484c00640 1 --2- 172.21.15.112:0/4187311247 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94800b4ce0 0x7f94800b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:55.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.986+0000 7f9477400640 1 -- 172.21.15.112:0/4187311247 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94800b4ce0 msgr2=0x7f94800b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:55.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.986+0000 7f9477400640 1 --2- 172.21.15.112:0/4187311247 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94800b4ce0 0x7f94800b50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:55.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.986+0000 7f9477400640 1 -- 172.21.15.112:0/4187311247 >> v1:172.21.15.137:6789/0 conn(0x7f948015c800 legacy=0x7f948015f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:55.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.986+0000 7f9477400640 1 -- 172.21.15.112:0/4187311247 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f948015f2a0 con 0x7f94800b0770 2024-09-12T02:41:55.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.987+0000 7f9477400640 1 --2- 172.21.15.112:0/4187311247 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94800b0770 0x7f94800708c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9468009870 tx=0x7f946802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c9a36b6ee953df4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:55.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.987+0000 7f947f400640 1 -- 172.21.15.112:0/4187311247 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9468037070 con 0x7f94800b0770 2024-09-12T02:41:55.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.987+0000 7f947f400640 1 -- 172.21.15.112:0/4187311247 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9468032440 con 0x7f94800b0770 2024-09-12T02:41:55.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.987+0000 7f947f400640 1 -- 172.21.15.112:0/4187311247 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9468032810 con 0x7f94800b0770 2024-09-12T02:41:55.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.988+0000 7f9485600640 1 -- 172.21.15.112:0/4187311247 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94800b0770 msgr2=0x7f94800708c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:55.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.988+0000 7f9485600640 1 --2- 172.21.15.112:0/4187311247 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94800b0770 0x7f94800708c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9468009870 tx=0x7f946802a250 comp rx=0 tx=0).stop 2024-09-12T02:41:55.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.988+0000 7f9485600640 1 -- 172.21.15.112:0/4187311247 shutdown_connections 2024-09-12T02:41:55.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.988+0000 7f9485600640 1 --2- 172.21.15.112:0/4187311247 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94800b4ce0 0x7f94800b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:55.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.988+0000 7f9485600640 1 --2- 172.21.15.112:0/4187311247 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94800b0770 0x7f94800708c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:55.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.988+0000 7f9485600640 1 -- 172.21.15.112:0/4187311247 >> 172.21.15.112:0/4187311247 conn(0x7f948006cce0 msgr2=0x7f948006d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:55.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.988+0000 7f9485600640 1 -- 172.21.15.112:0/4187311247 shutdown_connections 2024-09-12T02:41:55.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.988+0000 7f9485600640 1 -- 172.21.15.112:0/4187311247 wait complete. 2024-09-12T02:41:55.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.990+0000 7f9485600640 1 Processor -- start 2024-09-12T02:41:55.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.990+0000 7f9485600640 1 -- start start 2024-09-12T02:41:55.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.991+0000 7f9485600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94800b0770 0x7f94801540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:55.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.991+0000 7f9485600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94800b4ce0 0x7f9480147490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:55.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.991+0000 7f9485600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f948015c800 0x7f9480156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:55.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.991+0000 7f9485600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f948006f360 con 0x7f948015c800 2024-09-12T02:41:55.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.991+0000 7f9485600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f948006f1e0 con 0x7f94800b4ce0 2024-09-12T02:41:55.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.991+0000 7f9485600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f948006bbd0 con 0x7f94800b0770 2024-09-12T02:41:55.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.991+0000 7f9484c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f948015c800 0x7f9480156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:55.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.991+0000 7f9484c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f948015c800 0x7f9480156f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38778/0 (socket says 172.21.15.112:38778) 2024-09-12T02:41:55.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.991+0000 7f9484c00640 1 -- 172.21.15.112:0/2119475005 learned_addr learned my addr 172.21.15.112:0/2119475005 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:55.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.991+0000 7f947fe00640 1 --2- 172.21.15.112:0/2119475005 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94800b0770 0x7f94801540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:55.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.991+0000 7f9477400640 1 --2- 172.21.15.112:0/2119475005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94800b4ce0 0x7f9480147490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:55.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.991+0000 7f9484c00640 1 -- 172.21.15.112:0/2119475005 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94800b0770 msgr2=0x7f94801540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:55.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.991+0000 7f9484c00640 1 --2- 172.21.15.112:0/2119475005 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94800b0770 0x7f94801540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:55.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.991+0000 7f9484c00640 1 -- 172.21.15.112:0/2119475005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94800b4ce0 msgr2=0x7f9480147490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:55.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.991+0000 7f9484c00640 1 --2- 172.21.15.112:0/2119475005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94800b4ce0 0x7f9480147490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:55.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.991+0000 7f9484c00640 1 -- 172.21.15.112:0/2119475005 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9480154af0 con 0x7f948015c800 2024-09-12T02:41:55.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.992+0000 7f9484c00640 1 --2- 172.21.15.112:0/2119475005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f948015c800 0x7f9480156f60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f947800efc0 tx=0x7f947800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:55.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.992+0000 7f947cc00640 1 -- 172.21.15.112:0/2119475005 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9478018020 con 0x7f948015c800 2024-09-12T02:41:55.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.992+0000 7f947cc00640 1 -- 172.21.15.112:0/2119475005 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9478014480 con 0x7f948015c800 2024-09-12T02:41:55.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.992+0000 7f947cc00640 1 -- 172.21.15.112:0/2119475005 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9478014870 con 0x7f948015c800 2024-09-12T02:41:55.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.992+0000 7f9485600640 1 -- 172.21.15.112:0/2119475005 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9480154dd0 con 0x7f948015c800 2024-09-12T02:41:55.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.992+0000 7f9485600640 1 -- 172.21.15.112:0/2119475005 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94801f84f0 con 0x7f948015c800 2024-09-12T02:41:55.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.993+0000 7f9485600640 1 -- 172.21.15.112:0/2119475005 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94801f8000 con 0x7f948015c800 2024-09-12T02:41:55.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.994+0000 7f947cc00640 1 -- 172.21.15.112:0/2119475005 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9478005d10 con 0x7f948015c800 2024-09-12T02:41:55.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.995+0000 7f947cc00640 1 --2- 172.21.15.112:0/2119475005 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f945c06be30 0x7f945c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:55.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.995+0000 7f947cc00640 1 -- 172.21.15.112:0/2119475005 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f947808b8e0 con 0x7f948015c800 2024-09-12T02:41:55.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.995+0000 7f947fe00640 1 --2- 172.21.15.112:0/2119475005 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f945c06be30 0x7f945c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:55.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.995+0000 7f947fe00640 1 --2- 172.21.15.112:0/2119475005 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f945c06be30 0x7f945c06e2f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f94700016e0 tx=0x7f9470009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:56.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:55.999+0000 7f947cc00640 1 -- 172.21.15.112:0/2119475005 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9478022070 con 0x7f948015c800 2024-09-12T02:41:56.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.209+0000 7f9485600640 1 -- 172.21.15.112:0/2119475005 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f94800708c0 con 0x7f948015c800 2024-09-12T02:41:56.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.808+0000 7f947cc00640 1 -- 172.21.15.112:0/2119475005 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f9478010040 con 0x7f948015c800 2024-09-12T02:41:56.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.811+0000 7f9485600640 1 -- 172.21.15.112:0/2119475005 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f945c06be30 msgr2=0x7f945c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:56.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.811+0000 7f9485600640 1 --2- 172.21.15.112:0/2119475005 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f945c06be30 0x7f945c06e2f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f94700016e0 tx=0x7f9470009040 comp rx=0 tx=0).stop 2024-09-12T02:41:56.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.811+0000 7f9485600640 1 -- 172.21.15.112:0/2119475005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f948015c800 msgr2=0x7f9480156f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:56.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.811+0000 7f9485600640 1 --2- 172.21.15.112:0/2119475005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f948015c800 0x7f9480156f60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f947800efc0 tx=0x7f947800c490 comp rx=0 tx=0).stop 2024-09-12T02:41:56.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.811+0000 7f9485600640 1 -- 172.21.15.112:0/2119475005 shutdown_connections 2024-09-12T02:41:56.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.811+0000 7f9485600640 1 --2- 172.21.15.112:0/2119475005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f948015c800 0x7f9480156f60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:56.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.811+0000 7f9485600640 1 --2- 172.21.15.112:0/2119475005 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f945c06be30 0x7f945c06e2f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:56.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.811+0000 7f9485600640 1 --2- 172.21.15.112:0/2119475005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94800b4ce0 0x7f9480147490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:56.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.811+0000 7f9485600640 1 --2- 172.21.15.112:0/2119475005 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94800b0770 0x7f94801540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:56.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.811+0000 7f9485600640 1 -- 172.21.15.112:0/2119475005 >> 172.21.15.112:0/2119475005 conn(0x7f948006cce0 msgr2=0x7f948006bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:56.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.811+0000 7f9485600640 1 -- 172.21.15.112:0/2119475005 shutdown_connections 2024-09-12T02:41:56.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.811+0000 7f9485600640 1 -- 172.21.15.112:0/2119475005 wait complete. 2024-09-12T02:41:56.830 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T02:41:56.830 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:41:56.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.985+0000 7efe52000640 1 Processor -- start 2024-09-12T02:41:56.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.985+0000 7efe52000640 1 -- start start 2024-09-12T02:41:56.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.986+0000 7efe52000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe4c0afe30 0x7efe4c0cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:56.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.986+0000 7efe52000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe4c0ceeb0 con 0x7efe4c15cc50 2024-09-12T02:41:56.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.986+0000 7efe52000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe4c06e300 con 0x7efe4c071530 2024-09-12T02:41:56.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.986+0000 7efe52000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7efe4c15d030 con 0x7efe4c0afe30 2024-09-12T02:41:56.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.986+0000 7efe4b400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7efe4c15cc50 0x7efe4c0732f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:57828/0 (socket says 172.21.15.112:57828) 2024-09-12T02:41:56.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.986+0000 7efe4b400640 1 -- 172.21.15.112:0/3273622117 learned_addr learned my addr 172.21.15.112:0/3273622117 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:41:56.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.987+0000 7efe4be00640 1 --2- 172.21.15.112:0/3273622117 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe4c0afe30 0x7efe4c0cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:56.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.987+0000 7efe4a000640 1 -- 172.21.15.112:0/3273622117 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3296381047 0 0) 0x7efe4c0ceeb0 con 0x7efe4c15cc50 2024-09-12T02:41:56.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.987+0000 7efe4a000640 1 -- 172.21.15.112:0/3273622117 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe30003520 con 0x7efe4c15cc50 2024-09-12T02:41:56.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.987+0000 7efe4a000640 1 -- 172.21.15.112:0/3273622117 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 101405390 0 0) 0x7efe30003520 con 0x7efe4c15cc50 2024-09-12T02:41:56.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.987+0000 7efe4a000640 1 -- 172.21.15.112:0/3273622117 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe4c0afe30 msgr2=0x7efe4c0cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:56.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.987+0000 7efe4a000640 1 --2- 172.21.15.112:0/3273622117 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe4c0afe30 0x7efe4c0cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:56.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.987+0000 7efe4a000640 1 -- 172.21.15.112:0/3273622117 >> v1:172.21.15.137:6789/0 conn(0x7efe4c071530 legacy=0x7efe4c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:56.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.987+0000 7efe4a000640 1 -- 172.21.15.112:0/3273622117 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe4c06e5e0 con 0x7efe4c15cc50 2024-09-12T02:41:56.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.987+0000 7efe4a000640 1 -- 172.21.15.112:0/3273622117 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7efe3c001670 con 0x7efe4c15cc50 2024-09-12T02:41:56.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.987+0000 7efe4a000640 1 -- 172.21.15.112:0/3273622117 >> v1:172.21.15.112:6789/0 conn(0x7efe4c15cc50 legacy=0x7efe4c0732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:56.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.987+0000 7efe4a000640 1 --2- 172.21.15.112:0/3273622117 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe300039e0 0x7efe30003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:56.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.987+0000 7efe4a000640 1 --2- 172.21.15.112:0/3273622117 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe4c0afe30 0x7efe30004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:56.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.987+0000 7efe4a000640 1 --2- 172.21.15.112:0/3273622117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe30004d40 0x7efe300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:56.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.987+0000 7efe4a000640 1 -- 172.21.15.112:0/3273622117 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efe3000ba70 con 0x7efe30004d40 2024-09-12T02:41:56.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.987+0000 7efe4a000640 1 -- 172.21.15.112:0/3273622117 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efe3000bc20 con 0x7efe300039e0 2024-09-12T02:41:56.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.987+0000 7efe4a000640 1 -- 172.21.15.112:0/3273622117 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7efe3000be20 con 0x7efe4c0afe30 2024-09-12T02:41:56.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.988+0000 7efe4be00640 1 --2- 172.21.15.112:0/3273622117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe30004d40 0x7efe300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:56.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.988+0000 7efe4b400640 1 --2- 172.21.15.112:0/3273622117 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe300039e0 0x7efe30003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:56.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.988+0000 7efe4aa00640 1 --2- 172.21.15.112:0/3273622117 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe4c0afe30 0x7efe30004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:56.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.988+0000 7efe4be00640 1 -- 172.21.15.112:0/3273622117 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe4c0afe30 msgr2=0x7efe30004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:56.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.988+0000 7efe4be00640 1 --2- 172.21.15.112:0/3273622117 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe4c0afe30 0x7efe30004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:56.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.988+0000 7efe4be00640 1 -- 172.21.15.112:0/3273622117 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe300039e0 msgr2=0x7efe30003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:56.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.988+0000 7efe4be00640 1 --2- 172.21.15.112:0/3273622117 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe300039e0 0x7efe30003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:56.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.988+0000 7efe4be00640 1 -- 172.21.15.112:0/3273622117 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe30003520 con 0x7efe30004d40 2024-09-12T02:41:56.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.989+0000 7efe4be00640 1 --2- 172.21.15.112:0/3273622117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe30004d40 0x7efe300051c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0710c0 tx=0x7efe30005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a5dad060e9f7906 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:56.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.989+0000 7efe4a000640 1 -- 172.21.15.112:0/3273622117 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe44037070 con 0x7efe30004d40 2024-09-12T02:41:56.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.989+0000 7efe4a000640 1 -- 172.21.15.112:0/3273622117 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe4402e050 con 0x7efe30004d40 2024-09-12T02:41:56.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.989+0000 7efe4a000640 1 -- 172.21.15.112:0/3273622117 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe44009c10 con 0x7efe30004d40 2024-09-12T02:41:56.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.990+0000 7efe52000640 1 -- 172.21.15.112:0/3273622117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe30004d40 msgr2=0x7efe300051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:56.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.990+0000 7efe52000640 1 --2- 172.21.15.112:0/3273622117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe30004d40 0x7efe300051c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0710c0 tx=0x7efe30005830 comp rx=0 tx=0).stop 2024-09-12T02:41:56.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.990+0000 7efe4be00640 1 -- 172.21.15.112:0/3273622117 reap_dead start 2024-09-12T02:41:56.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.990+0000 7efe52000640 1 -- 172.21.15.112:0/3273622117 shutdown_connections 2024-09-12T02:41:56.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.990+0000 7efe52000640 1 -- 172.21.15.112:0/3273622117 >> 172.21.15.112:0/3273622117 conn(0x7efe4c06bbd0 msgr2=0x7efe4c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:56.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.990+0000 7efe52000640 1 -- 172.21.15.112:0/3273622117 shutdown_connections 2024-09-12T02:41:56.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.990+0000 7efe52000640 1 -- 172.21.15.112:0/3273622117 wait complete. 2024-09-12T02:41:56.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.991+0000 7efe52000640 1 Processor -- start 2024-09-12T02:41:56.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.992+0000 7efe52000640 1 -- start start 2024-09-12T02:41:56.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.992+0000 7efe52000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe30004d40 0x7efe4c140360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:56.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.992+0000 7efe52000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe4c154420 0x7efe4c14e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:56.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.992+0000 7efe52000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe4c14e6c0 0x7efe4c140e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:56.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.992+0000 7efe52000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efe4c06f510 con 0x7efe4c154420 2024-09-12T02:41:56.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.992+0000 7efe52000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efe4c0cf4c0 con 0x7efe30004d40 2024-09-12T02:41:56.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.992+0000 7efe52000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7efe4c06f690 con 0x7efe4c14e6c0 2024-09-12T02:41:56.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.993+0000 7efe4aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe4c154420 0x7efe4c14e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:56.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.993+0000 7efe4b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe30004d40 0x7efe4c140360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:56.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.993+0000 7efe4aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe4c154420 0x7efe4c14e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38804/0 (socket says 172.21.15.112:38804) 2024-09-12T02:41:56.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.993+0000 7efe4b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe30004d40 0x7efe4c140360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:37946/0 (socket says 172.21.15.112:37946) 2024-09-12T02:41:56.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.993+0000 7efe4aa00640 1 -- 172.21.15.112:0/892771623 learned_addr learned my addr 172.21.15.112:0/892771623 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:56.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.993+0000 7efe4be00640 1 --2- 172.21.15.112:0/892771623 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe4c14e6c0 0x7efe4c140e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:56.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.993+0000 7efe4aa00640 1 -- 172.21.15.112:0/892771623 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe4c14e6c0 msgr2=0x7efe4c140e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:56.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.993+0000 7efe4aa00640 1 --2- 172.21.15.112:0/892771623 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe4c14e6c0 0x7efe4c140e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:56.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.993+0000 7efe4aa00640 1 -- 172.21.15.112:0/892771623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe30004d40 msgr2=0x7efe4c140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:56.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.993+0000 7efe4aa00640 1 --2- 172.21.15.112:0/892771623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe30004d40 0x7efe4c140360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:56.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.993+0000 7efe4aa00640 1 -- 172.21.15.112:0/892771623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe4c153380 con 0x7efe4c154420 2024-09-12T02:41:56.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.993+0000 7efe4b400640 1 --2- 172.21.15.112:0/892771623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe30004d40 0x7efe4c140360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:41:56.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.993+0000 7efe4aa00640 1 --2- 172.21.15.112:0/892771623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe4c154420 0x7efe4c14e180 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7efe3800e830 tx=0x7efe3800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:56.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.994+0000 7efe43400640 1 -- 172.21.15.112:0/892771623 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe380050d0 con 0x7efe4c154420 2024-09-12T02:41:56.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.994+0000 7efe43400640 1 -- 172.21.15.112:0/892771623 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe38018070 con 0x7efe4c154420 2024-09-12T02:41:56.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.994+0000 7efe43400640 1 -- 172.21.15.112:0/892771623 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe380054b0 con 0x7efe4c154420 2024-09-12T02:41:56.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.994+0000 7efe52000640 1 -- 172.21.15.112:0/892771623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe4c153660 con 0x7efe4c154420 2024-09-12T02:41:56.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.994+0000 7efe52000640 1 -- 172.21.15.112:0/892771623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe4c153c20 con 0x7efe4c154420 2024-09-12T02:41:56.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.995+0000 7efe52000640 1 -- 172.21.15.112:0/892771623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe4c14eac0 con 0x7efe4c154420 2024-09-12T02:41:56.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.996+0000 7efe43400640 1 -- 172.21.15.112:0/892771623 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efe3800c8d0 con 0x7efe4c154420 2024-09-12T02:41:56.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.996+0000 7efe43400640 1 --2- 172.21.15.112:0/892771623 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efe2c06bfd0 0x7efe2c06e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:56.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.997+0000 7efe43400640 1 -- 172.21.15.112:0/892771623 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efe3808ada0 con 0x7efe4c154420 2024-09-12T02:41:56.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.997+0000 7efe4b400640 1 --2- 172.21.15.112:0/892771623 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efe2c06bfd0 0x7efe2c06e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:56.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:56.997+0000 7efe4b400640 1 --2- 172.21.15.112:0/892771623 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efe2c06bfd0 0x7efe2c06e490 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efe3c0010e0 tx=0x7efe3c0078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:57.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.001+0000 7efe43400640 1 -- 172.21.15.112:0/892771623 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efe380590f0 con 0x7efe4c154420 2024-09-12T02:41:57.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.209+0000 7efe52000640 1 -- 172.21.15.112:0/892771623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe4c0730d0 con 0x7efe4c154420 2024-09-12T02:41:57.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.209+0000 7efe43400640 1 -- 172.21.15.112:0/892771623 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7efe3805d3f0 con 0x7efe4c154420 2024-09-12T02:41:57.210 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:57.210 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":8,"btime":"2024-09-12T02:41:56:806041+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3622416380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3622416380},{"type":"v1","addr":"172.21.15.112:6837","nonce":3622416380}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/2779317773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2779317773},{"type":"v1","addr":"172.21.15.137:6834","nonce":2779317773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3005649719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3005649719},{"type":"v1","addr":"172.21.15.112:6835","nonce":3005649719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:41:53.174744+0000","modified":"2024-09-12T02:41:56.211357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/1785309492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1785309492},{"type":"v1","addr":"172.21.15.137:6835","nonce":1785309492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4308]},"id":1}]} 2024-09-12T02:41:57.211 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 8 2024-09-12T02:41:57.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.212+0000 7efe52000640 1 -- 172.21.15.112:0/892771623 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efe2c06bfd0 msgr2=0x7efe2c06e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:57.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.212+0000 7efe52000640 1 --2- 172.21.15.112:0/892771623 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efe2c06bfd0 0x7efe2c06e490 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efe3c0010e0 tx=0x7efe3c0078f0 comp rx=0 tx=0).stop 2024-09-12T02:41:57.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.212+0000 7efe52000640 1 -- 172.21.15.112:0/892771623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe4c154420 msgr2=0x7efe4c14e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:57.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.212+0000 7efe52000640 1 --2- 172.21.15.112:0/892771623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe4c154420 0x7efe4c14e180 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7efe3800e830 tx=0x7efe3800ecf0 comp rx=0 tx=0).stop 2024-09-12T02:41:57.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.212+0000 7efe52000640 1 -- 172.21.15.112:0/892771623 shutdown_connections 2024-09-12T02:41:57.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.212+0000 7efe52000640 1 --2- 172.21.15.112:0/892771623 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe4c14e6c0 0x7efe4c140e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:57.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.212+0000 7efe52000640 1 --2- 172.21.15.112:0/892771623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe4c154420 0x7efe4c14e180 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:57.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.212+0000 7efe52000640 1 --2- 172.21.15.112:0/892771623 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efe2c06bfd0 0x7efe2c06e490 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:57.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.212+0000 7efe52000640 1 --2- 172.21.15.112:0/892771623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe30004d40 0x7efe4c140360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:57.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.212+0000 7efe52000640 1 -- 172.21.15.112:0/892771623 >> 172.21.15.112:0/892771623 conn(0x7efe4c06bbd0 msgr2=0x7efe4c159110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:57.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.212+0000 7efe52000640 1 -- 172.21.15.112:0/892771623 shutdown_connections 2024-09-12T02:41:57.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.212+0000 7efe52000640 1 -- 172.21.15.112:0/892771623 wait complete. 2024-09-12T02:41:57.229 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:41:57.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.382+0000 7f7abce00640 1 Processor -- start 2024-09-12T02:41:57.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.382+0000 7f7abce00640 1 -- start start 2024-09-12T02:41:57.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.383+0000 7f7abce00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7ab815b9d0 0x7f7ab80b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:57.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.383+0000 7f7abce00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7ab806f600 0x7f7ab80728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:57.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.383+0000 7f7abce00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ab80b54a0 con 0x7f7ab80b45d0 2024-09-12T02:41:57.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.383+0000 7f7abce00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f7ab80b4a60 con 0x7f7ab815b9d0 2024-09-12T02:41:57.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.383+0000 7f7abce00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7ab80b3af0 con 0x7f7ab806f600 2024-09-12T02:41:57.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.383+0000 7f7ab5e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7ab815b9d0 0x7f7ab80b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:57.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.383+0000 7f7ab5e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7ab815b9d0 0x7f7ab80b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38814/0 (socket says 172.21.15.112:38814) 2024-09-12T02:41:57.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.383+0000 7f7ab5e00640 1 -- 172.21.15.112:0/637431509 learned_addr learned my addr 172.21.15.112:0/637431509 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:57.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.383+0000 7f7ab6800640 1 --2- 172.21.15.112:0/637431509 >> v2:172.21.15.137:3300/0 conn(0x7f7ab806f600 0x7f7ab80728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:57.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.384+0000 7f7ab5e00640 1 -- 172.21.15.112:0/637431509 >> v2:172.21.15.137:3300/0 conn(0x7f7ab806f600 msgr2=0x7f7ab80728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:57.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.384+0000 7f7ab5e00640 1 --2- 172.21.15.112:0/637431509 >> v2:172.21.15.137:3300/0 conn(0x7f7ab806f600 0x7f7ab80728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:57.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.384+0000 7f7ab5e00640 1 -- 172.21.15.112:0/637431509 >> v1:172.21.15.137:6789/0 conn(0x7f7ab80b45d0 legacy=0x7f7ab806eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:57.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.384+0000 7f7ab5e00640 1 -- 172.21.15.112:0/637431509 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ab80b3dd0 con 0x7f7ab815b9d0 2024-09-12T02:41:57.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.385+0000 7f7ab5e00640 1 --2- 172.21.15.112:0/637431509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ab815b9d0 0x7f7ab80b4ec0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8072f80 tx=0x7f7aa802c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4b1d7113cb6b36 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:57.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.385+0000 7f7ab5400640 1 -- 172.21.15.112:0/637431509 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa800b2d0 con 0x7f7ab815b9d0 2024-09-12T02:41:57.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.385+0000 7f7ab5400640 1 -- 172.21.15.112:0/637431509 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aa800b470 con 0x7f7ab815b9d0 2024-09-12T02:41:57.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.385+0000 7f7ab5400640 1 -- 172.21.15.112:0/637431509 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8009820 con 0x7f7ab815b9d0 2024-09-12T02:41:57.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.385+0000 7f7abce00640 1 -- 172.21.15.112:0/637431509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ab815b9d0 msgr2=0x7f7ab80b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:57.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.385+0000 7f7abce00640 1 --2- 172.21.15.112:0/637431509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ab815b9d0 0x7f7ab80b4ec0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8072f80 tx=0x7f7aa802c8b0 comp rx=0 tx=0).stop 2024-09-12T02:41:57.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.385+0000 7f7abce00640 1 -- 172.21.15.112:0/637431509 shutdown_connections 2024-09-12T02:41:57.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.386+0000 7f7abce00640 1 --2- 172.21.15.112:0/637431509 >> v2:172.21.15.137:3300/0 conn(0x7f7ab806f600 0x7f7ab80728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:57.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.386+0000 7f7abce00640 1 --2- 172.21.15.112:0/637431509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ab815b9d0 0x7f7ab80b4ec0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:57.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.386+0000 7f7abce00640 1 -- 172.21.15.112:0/637431509 >> 172.21.15.112:0/637431509 conn(0x7f7ab806bbd0 msgr2=0x7f7ab806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:57.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.386+0000 7f7abce00640 1 -- 172.21.15.112:0/637431509 shutdown_connections 2024-09-12T02:41:57.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.386+0000 7f7abce00640 1 -- 172.21.15.112:0/637431509 wait complete. 2024-09-12T02:41:57.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.387+0000 7f7abce00640 1 Processor -- start 2024-09-12T02:41:57.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.387+0000 7f7abce00640 1 -- start start 2024-09-12T02:41:57.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.388+0000 7f7abce00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ab806f600 0x7f7ab815c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:57.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.388+0000 7f7abce00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ab80b45d0 0x7f7ab80cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:57.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.388+0000 7f7abce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ab815b9d0 0x7f7ab80ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:57.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.388+0000 7f7abce00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab815bf30 con 0x7f7ab806f600 2024-09-12T02:41:57.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.388+0000 7f7abce00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab815bdb0 con 0x7f7ab815b9d0 2024-09-12T02:41:57.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.388+0000 7f7abce00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7ab80cdcd0 con 0x7f7ab80b45d0 2024-09-12T02:41:57.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.388+0000 7f7ab5e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ab806f600 0x7f7ab815c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:57.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.388+0000 7f7ab5e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ab806f600 0x7f7ab815c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38828/0 (socket says 172.21.15.112:38828) 2024-09-12T02:41:57.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.388+0000 7f7ab5e00640 1 -- 172.21.15.112:0/2648877278 learned_addr learned my addr 172.21.15.112:0/2648877278 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:57.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.388+0000 7f7aad400640 1 --2- 172.21.15.112:0/2648877278 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ab80b45d0 0x7f7ab80cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:57.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.388+0000 7f7ab6800640 1 --2- 172.21.15.112:0/2648877278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ab815b9d0 0x7f7ab80ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:57.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.389+0000 7f7ab5e00640 1 -- 172.21.15.112:0/2648877278 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ab80b45d0 msgr2=0x7f7ab80cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:57.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.389+0000 7f7ab5e00640 1 --2- 172.21.15.112:0/2648877278 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ab80b45d0 0x7f7ab80cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:57.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.389+0000 7f7ab5e00640 1 -- 172.21.15.112:0/2648877278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ab815b9d0 msgr2=0x7f7ab80ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:57.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.389+0000 7f7ab5e00640 1 --2- 172.21.15.112:0/2648877278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ab815b9d0 0x7f7ab80ccf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:57.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.389+0000 7f7ab5e00640 1 -- 172.21.15.112:0/2648877278 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ab8153760 con 0x7f7ab806f600 2024-09-12T02:41:57.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.389+0000 7f7ab6800640 1 --2- 172.21.15.112:0/2648877278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ab815b9d0 0x7f7ab80ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:41:57.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.389+0000 7f7ab5e00640 1 --2- 172.21.15.112:0/2648877278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ab806f600 0x7f7ab815c240 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7aa802cea0 tx=0x7f7aa8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:57.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.389+0000 7f7aaea00640 1 -- 172.21.15.112:0/2648877278 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8041030 con 0x7f7ab806f600 2024-09-12T02:41:57.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.389+0000 7f7aaea00640 1 -- 172.21.15.112:0/2648877278 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aa803d650 con 0x7f7ab806f600 2024-09-12T02:41:57.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.389+0000 7f7aaea00640 1 -- 172.21.15.112:0/2648877278 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa800b720 con 0x7f7ab806f600 2024-09-12T02:41:57.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.389+0000 7f7abce00640 1 -- 172.21.15.112:0/2648877278 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ab8153a40 con 0x7f7ab806f600 2024-09-12T02:41:57.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.389+0000 7f7abce00640 1 -- 172.21.15.112:0/2648877278 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ab8154000 con 0x7f7ab806f600 2024-09-12T02:41:57.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.390+0000 7f7abce00640 1 -- 172.21.15.112:0/2648877278 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ab8068a30 con 0x7f7ab806f600 2024-09-12T02:41:57.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.391+0000 7f7aaea00640 1 -- 172.21.15.112:0/2648877278 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7aa8044030 con 0x7f7ab806f600 2024-09-12T02:41:57.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.392+0000 7f7aaea00640 1 --2- 172.21.15.112:0/2648877278 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7a9406be30 0x7f7a9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:57.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.393+0000 7f7aaea00640 1 -- 172.21.15.112:0/2648877278 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7aa80ad930 con 0x7f7ab806f600 2024-09-12T02:41:57.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.393+0000 7f7aad400640 1 --2- 172.21.15.112:0/2648877278 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7a9406be30 0x7f7a9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:57.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.393+0000 7f7aad400640 1 --2- 172.21.15.112:0/2648877278 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7a9406be30 0x7f7a9406e2f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7ab814fc20 tx=0x7f7aa0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:57.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.397+0000 7f7aaea00640 1 -- 172.21.15.112:0/2648877278 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7aa807c240 con 0x7f7ab806f600 2024-09-12T02:41:57.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.571+0000 7f7abce00640 1 -- 172.21.15.112:0/2648877278 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ab806dbc0 con 0x7f7ab806f600 2024-09-12T02:41:57.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.572+0000 7f7aaea00640 1 -- 172.21.15.112:0/2648877278 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16713 (secure 0 0 0) 0x7f7aa807bb40 con 0x7f7ab806f600 2024-09-12T02:41:57.573 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:57.573 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":20,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:41:54.774268+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:41:51.222228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:41:52.167920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:41:57.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.574+0000 7f7abce00640 1 -- 172.21.15.112:0/2648877278 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7a9406be30 msgr2=0x7f7a9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:57.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.574+0000 7f7abce00640 1 --2- 172.21.15.112:0/2648877278 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7a9406be30 0x7f7a9406e2f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7ab814fc20 tx=0x7f7aa0009040 comp rx=0 tx=0).stop 2024-09-12T02:41:57.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.574+0000 7f7abce00640 1 -- 172.21.15.112:0/2648877278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ab806f600 msgr2=0x7f7ab815c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:57.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.574+0000 7f7abce00640 1 --2- 172.21.15.112:0/2648877278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ab806f600 0x7f7ab815c240 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7aa802cea0 tx=0x7f7aa8004a40 comp rx=0 tx=0).stop 2024-09-12T02:41:57.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.574+0000 7f7abce00640 1 -- 172.21.15.112:0/2648877278 shutdown_connections 2024-09-12T02:41:57.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.574+0000 7f7abce00640 1 --2- 172.21.15.112:0/2648877278 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7a9406be30 0x7f7a9406e2f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:57.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.574+0000 7f7abce00640 1 --2- 172.21.15.112:0/2648877278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ab815b9d0 0x7f7ab80ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:57.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.574+0000 7f7abce00640 1 --2- 172.21.15.112:0/2648877278 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ab80b45d0 0x7f7ab80cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:57.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.574+0000 7f7abce00640 1 --2- 172.21.15.112:0/2648877278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ab806f600 0x7f7ab815c240 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:57.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.574+0000 7f7abce00640 1 -- 172.21.15.112:0/2648877278 >> 172.21.15.112:0/2648877278 conn(0x7f7ab806bbd0 msgr2=0x7f7ab80d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:57.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.574+0000 7f7abce00640 1 -- 172.21.15.112:0/2648877278 shutdown_connections 2024-09-12T02:41:57.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.574+0000 7f7abce00640 1 -- 172.21.15.112:0/2648877278 wait complete. 2024-09-12T02:41:57.590 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:41:57.591 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:41:57.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.742+0000 7f76d7200640 1 Processor -- start 2024-09-12T02:41:57.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.743+0000 7f76d7200640 1 -- start start 2024-09-12T02:41:57.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.744+0000 7f76d7200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f76d80b0770 0x7f76d80708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:57.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.744+0000 7f76d7200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76d80b0c70 con 0x7f76d80b4ce0 2024-09-12T02:41:57.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.744+0000 7f76d7200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76d80b0f50 con 0x7f76d815c800 2024-09-12T02:41:57.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.744+0000 7f76d7200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f76d80b1230 con 0x7f76d80b0770 2024-09-12T02:41:57.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.744+0000 7f76d6800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f76d80b4ce0 0x7f76d806bbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:57838/0 (socket says 172.21.15.112:57838) 2024-09-12T02:41:57.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.744+0000 7f76d6800640 1 -- 172.21.15.112:0/902973968 learned_addr learned my addr 172.21.15.112:0/902973968 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:41:57.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.744+0000 7f76cd400640 1 --2- 172.21.15.112:0/902973968 >> v2:172.21.15.137:3300/0 conn(0x7f76d80b0770 0x7f76d80708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:57.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.744+0000 7f76d5400640 1 -- 172.21.15.112:0/902973968 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1309015894 0 0) 0x7f76d80b0c70 con 0x7f76d80b4ce0 2024-09-12T02:41:57.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.745+0000 7f76d5400640 1 -- 172.21.15.112:0/902973968 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76bc003520 con 0x7f76d80b4ce0 2024-09-12T02:41:57.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.745+0000 7f76cd400640 1 -- 172.21.15.112:0/902973968 >> v1:172.21.15.137:6789/0 conn(0x7f76d815c800 legacy=0x7f76d815f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:57.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.745+0000 7f76cd400640 1 -- 172.21.15.112:0/902973968 >> v1:172.21.15.112:6789/0 conn(0x7f76d80b4ce0 legacy=0x7f76d806bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:57.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.745+0000 7f76cd400640 1 -- 172.21.15.112:0/902973968 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d815f2a0 con 0x7f76d80b0770 2024-09-12T02:41:57.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.746+0000 7f76cd400640 1 --2- 172.21.15.112:0/902973968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76d80b0770 0x7f76d80708c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f76c00097a0 tx=0x7f76c002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=623c83c5dcedd499 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:57.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.746+0000 7f76d5400640 1 -- 172.21.15.112:0/902973968 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c0037070 con 0x7f76d80b0770 2024-09-12T02:41:57.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.746+0000 7f76d5400640 1 -- 172.21.15.112:0/902973968 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76c0032440 con 0x7f76d80b0770 2024-09-12T02:41:57.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.746+0000 7f76d5400640 1 -- 172.21.15.112:0/902973968 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c00327f0 con 0x7f76d80b0770 2024-09-12T02:41:57.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.747+0000 7f76d7200640 1 -- 172.21.15.112:0/902973968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76d80b0770 msgr2=0x7f76d80708c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:57.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.747+0000 7f76d7200640 1 --2- 172.21.15.112:0/902973968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76d80b0770 0x7f76d80708c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f76c00097a0 tx=0x7f76c002a230 comp rx=0 tx=0).stop 2024-09-12T02:41:57.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.747+0000 7f76d7200640 1 -- 172.21.15.112:0/902973968 shutdown_connections 2024-09-12T02:41:57.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.747+0000 7f76d7200640 1 --2- 172.21.15.112:0/902973968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76d80b0770 0x7f76d80708c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:57.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.747+0000 7f76d7200640 1 -- 172.21.15.112:0/902973968 >> 172.21.15.112:0/902973968 conn(0x7f76d806cce0 msgr2=0x7f76d806d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:57.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.747+0000 7f76d7200640 1 -- 172.21.15.112:0/902973968 shutdown_connections 2024-09-12T02:41:57.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.747+0000 7f76d7200640 1 -- 172.21.15.112:0/902973968 wait complete. 2024-09-12T02:41:57.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.748+0000 7f76d7200640 1 Processor -- start 2024-09-12T02:41:57.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.748+0000 7f76d7200640 1 -- start start 2024-09-12T02:41:57.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.749+0000 7f76d7200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f76d80b0770 0x7f76d814a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:57.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.749+0000 7f76d7200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76d80b4ce0 0x7f76d80b1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:57.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.749+0000 7f76d7200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76d815c800 0x7f76d815dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:57.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.749+0000 7f76d7200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f76d806f360 con 0x7f76d815c800 2024-09-12T02:41:57.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.749+0000 7f76d7200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f76d806f1e0 con 0x7f76d80b4ce0 2024-09-12T02:41:57.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.749+0000 7f76d7200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f76d806c2e0 con 0x7f76d80b0770 2024-09-12T02:41:57.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.749+0000 7f76d6800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76d815c800 0x7f76d815dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:57.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.750+0000 7f76d6800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76d815c800 0x7f76d815dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38830/0 (socket says 172.21.15.112:38830) 2024-09-12T02:41:57.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.750+0000 7f76d6800640 1 -- 172.21.15.112:0/3153181168 learned_addr learned my addr 172.21.15.112:0/3153181168 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:57.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.750+0000 7f76cd400640 1 --2- 172.21.15.112:0/3153181168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76d80b4ce0 0x7f76d80b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:57.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.750+0000 7f76d5e00640 1 --2- 172.21.15.112:0/3153181168 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f76d80b0770 0x7f76d814a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:57.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.750+0000 7f76d6800640 1 -- 172.21.15.112:0/3153181168 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f76d80b0770 msgr2=0x7f76d814a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:57.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.750+0000 7f76d6800640 1 --2- 172.21.15.112:0/3153181168 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f76d80b0770 0x7f76d814a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:57.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.750+0000 7f76d6800640 1 -- 172.21.15.112:0/3153181168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76d80b4ce0 msgr2=0x7f76d80b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:57.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.750+0000 7f76d6800640 1 --2- 172.21.15.112:0/3153181168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76d80b4ce0 0x7f76d80b1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:57.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.750+0000 7f76d6800640 1 -- 172.21.15.112:0/3153181168 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d80b1e50 con 0x7f76d815c800 2024-09-12T02:41:57.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.750+0000 7f76cd400640 1 --2- 172.21.15.112:0/3153181168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76d80b4ce0 0x7f76d80b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:41:57.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.750+0000 7f76d5e00640 1 --2- 172.21.15.112:0/3153181168 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f76d80b0770 0x7f76d814a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:41:57.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.750+0000 7f76d6800640 1 --2- 172.21.15.112:0/3153181168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76d815c800 0x7f76d815dc30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f76d000c460 tx=0x7f76d000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:57.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.750+0000 7f76cea00640 1 -- 172.21.15.112:0/3153181168 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d0017070 con 0x7f76d815c800 2024-09-12T02:41:57.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.750+0000 7f76cea00640 1 -- 172.21.15.112:0/3153181168 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76d0005ce0 con 0x7f76d815c800 2024-09-12T02:41:57.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.750+0000 7f76cea00640 1 -- 172.21.15.112:0/3153181168 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d00072b0 con 0x7f76d815c800 2024-09-12T02:41:57.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.750+0000 7f76d7200640 1 -- 172.21.15.112:0/3153181168 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76d80b2130 con 0x7f76d815c800 2024-09-12T02:41:57.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.751+0000 7f76d7200640 1 -- 172.21.15.112:0/3153181168 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76d80b26f0 con 0x7f76d815c800 2024-09-12T02:41:57.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.752+0000 7f76d7200640 1 -- 172.21.15.112:0/3153181168 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76d80708c0 con 0x7f76d815c800 2024-09-12T02:41:57.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.752+0000 7f76cea00640 1 -- 172.21.15.112:0/3153181168 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f76d001a070 con 0x7f76d815c800 2024-09-12T02:41:57.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.753+0000 7f76cea00640 1 --2- 172.21.15.112:0/3153181168 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f76b406be30 0x7f76b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:57.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.753+0000 7f76cea00640 1 -- 172.21.15.112:0/3153181168 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f76d008a150 con 0x7f76d815c800 2024-09-12T02:41:57.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.754+0000 7f76d5e00640 1 --2- 172.21.15.112:0/3153181168 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f76b406be30 0x7f76b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:57.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.754+0000 7f76d5e00640 1 --2- 172.21.15.112:0/3153181168 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f76b406be30 0x7f76b406e2f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f76d80b3450 tx=0x7f76c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:57.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.757+0000 7f76cea00640 1 -- 172.21.15.112:0/3153181168 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f76d0058b70 con 0x7f76d815c800 2024-09-12T02:41:57.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.931+0000 7f76d7200640 1 -- 172.21.15.112:0/3153181168 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f76d806be20 con 0x7f76b406be30 2024-09-12T02:41:57.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.938+0000 7f76cea00640 1 -- 172.21.15.112:0/3153181168 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242210 (secure 0 0 0) 0x7f76d806be20 con 0x7f76b406be30 2024-09-12T02:41:57.942 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:57.943 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:41:57.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.942+0000 7f76d7200640 1 -- 172.21.15.112:0/3153181168 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f76b406be30 msgr2=0x7f76b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:57.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.942+0000 7f76d7200640 1 --2- 172.21.15.112:0/3153181168 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f76b406be30 0x7f76b406e2f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f76d80b3450 tx=0x7f76c8009040 comp rx=0 tx=0).stop 2024-09-12T02:41:57.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.942+0000 7f76d7200640 1 -- 172.21.15.112:0/3153181168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76d815c800 msgr2=0x7f76d815dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:57.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.942+0000 7f76d7200640 1 --2- 172.21.15.112:0/3153181168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76d815c800 0x7f76d815dc30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f76d000c460 tx=0x7f76d000c920 comp rx=0 tx=0).stop 2024-09-12T02:41:57.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.942+0000 7f76d7200640 1 -- 172.21.15.112:0/3153181168 shutdown_connections 2024-09-12T02:41:57.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.942+0000 7f76d7200640 1 --2- 172.21.15.112:0/3153181168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76d815c800 0x7f76d815dc30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:57.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.942+0000 7f76d7200640 1 --2- 172.21.15.112:0/3153181168 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f76b406be30 0x7f76b406e2f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:57.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.942+0000 7f76d7200640 1 --2- 172.21.15.112:0/3153181168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76d80b4ce0 0x7f76d80b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:57.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.942+0000 7f76d7200640 1 --2- 172.21.15.112:0/3153181168 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f76d80b0770 0x7f76d814a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:57.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.942+0000 7f76d7200640 1 -- 172.21.15.112:0/3153181168 >> 172.21.15.112:0/3153181168 conn(0x7f76d806cce0 msgr2=0x7f76d8072640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:57.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.942+0000 7f76d7200640 1 -- 172.21.15.112:0/3153181168 shutdown_connections 2024-09-12T02:41:57.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:57.942+0000 7f76d7200640 1 -- 172.21.15.112:0/3153181168 wait complete. 2024-09-12T02:41:57.958 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-12T02:41:56.959331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1554,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560945,"statfs":{"total":1600000000,"available":1598407872,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.201111"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.772872+0000","last_change":"2024-09-12T02:41:52.772872+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.772872+0000","last_undegraded":"2024-09-12T02:41:52.772872+0000","last_fullsized":"2024-09-12T02:41:52.772872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.771785+0000","last_change":"2024-09-12T02:41:52.771785+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.771785+0000","last_undegraded":"2024-09-12T02:41:52.771785+0000","last_fullsized":"2024-09-12T02:41:52.771785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.772082+0000","last_change":"2024-09-12T02:41:52.772082+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.772082+0000","last_undegraded":"2024-09-12T02:41:52.772082+0000","last_fullsized":"2024-09-12T02:41:52.772082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.778628+0000","last_change":"2024-09-12T02:41:52.778628+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.778628+0000","last_undegraded":"2024-09-12T02:41:52.778628+0000","last_fullsized":"2024-09-12T02:41:52.778628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.779745+0000","last_change":"2024-09-12T02:41:52.779745+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.779745+0000","last_undegraded":"2024-09-12T02:41:52.779745+0000","last_fullsized":"2024-09-12T02:41:52.779745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.774860+0000","last_change":"2024-09-12T02:41:52.774860+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.774860+0000","last_undegraded":"2024-09-12T02:41:52.774860+0000","last_fullsized":"2024-09-12T02:41:52.774860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.780128+0000","last_change":"2024-09-12T02:41:52.780128+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.780128+0000","last_undegraded":"2024-09-12T02:41:52.780128+0000","last_fullsized":"2024-09-12T02:41:52.780128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.773665+0000","last_change":"2024-09-12T02:41:52.773665+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.773665+0000","last_undegraded":"2024-09-12T02:41:52.773665+0000","last_fullsized":"2024-09-12T02:41:52.773665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.769397+0000","last_change":"2024-09-12T02:41:52.769397+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.769397+0000","last_undegraded":"2024-09-12T02:41:52.769397+0000","last_fullsized":"2024-09-12T02:41:52.769397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.770167+0000","last_change":"2024-09-12T02:41:52.770167+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.770167+0000","last_undegraded":"2024-09-12T02:41:52.770167+0000","last_fullsized":"2024-09-12T02:41:52.770167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.765916+0000","last_change":"2024-09-12T02:41:52.765916+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.765916+0000","last_undegraded":"2024-09-12T02:41:52.765916+0000","last_fullsized":"2024-09-12T02:41:52.765916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.771228+0000","last_change":"2024-09-12T02:41:52.771228+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.771228+0000","last_undegraded":"2024-09-12T02:41:52.771228+0000","last_fullsized":"2024-09-12T02:41:52.771228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.773234+0000","last_change":"2024-09-12T02:41:52.773234+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.773234+0000","last_undegraded":"2024-09-12T02:41:52.773234+0000","last_fullsized":"2024-09-12T02:41:52.773234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.770779+0000","last_change":"2024-09-12T02:41:52.770779+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.770779+0000","last_undegraded":"2024-09-12T02:41:52.770779+0000","last_fullsized":"2024-09-12T02:41:52.770779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.770731+0000","last_change":"2024-09-12T02:41:52.770731+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.770731+0000","last_undegraded":"2024-09-12T02:41:52.770731+0000","last_fullsized":"2024-09-12T02:41:52.770731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.773809+0000","last_change":"2024-09-12T02:41:52.773809+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.773809+0000","last_undegraded":"2024-09-12T02:41:52.773809+0000","last_fullsized":"2024-09-12T02:41:52.773809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.778121+0000","last_change":"2024-09-12T02:41:52.778121+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.778121+0000","last_undegraded":"2024-09-12T02:41:52.778121+0000","last_fullsized":"2024-09-12T02:41:52.778121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.770518+0000","last_change":"2024-09-12T02:41:52.770518+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.770518+0000","last_undegraded":"2024-09-12T02:41:52.770518+0000","last_fullsized":"2024-09-12T02:41:52.770518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.768585+0000","last_change":"2024-09-12T02:41:52.768585+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.768585+0000","last_undegraded":"2024-09-12T02:41:52.768585+0000","last_fullsized":"2024-09-12T02:41:52.768585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.769698+0000","last_change":"2024-09-12T02:41:52.769698+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.769698+0000","last_undegraded":"2024-09-12T02:41:52.769698+0000","last_fullsized":"2024-09-12T02:41:52.769698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.770765+0000","last_change":"2024-09-12T02:41:52.770765+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.770765+0000","last_undegraded":"2024-09-12T02:41:52.770765+0000","last_fullsized":"2024-09-12T02:41:52.770765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.776284+0000","last_change":"2024-09-12T02:41:52.776284+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.776284+0000","last_undegraded":"2024-09-12T02:41:52.776284+0000","last_fullsized":"2024-09-12T02:41:52.776284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.769249+0000","last_change":"2024-09-12T02:41:52.769249+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.769249+0000","last_undegraded":"2024-09-12T02:41:52.769249+0000","last_fullsized":"2024-09-12T02:41:52.769249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.774508+0000","last_change":"2024-09-12T02:41:52.774508+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.774508+0000","last_undegraded":"2024-09-12T02:41:52.774508+0000","last_fullsized":"2024-09-12T02:41:52.774508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.767032+0000","last_change":"2024-09-12T02:41:52.767032+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.767032+0000","last_undegraded":"2024-09-12T02:41:52.767032+0000","last_fullsized":"2024-09-12T02:41:52.767032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.765221+0000","last_change":"2024-09-12T02:41:52.765221+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.765221+0000","last_undegraded":"2024-09-12T02:41:52.765221+0000","last_fullsized":"2024-09-12T02:41:52.765221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.770451+0000","last_change":"2024-09-12T02:41:52.770451+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.770451+0000","last_undegraded":"2024-09-12T02:41:52.770451+0000","last_fullsized":"2024-09-12T02:41:52.770451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.767650+0000","last_change":"2024-09-12T02:41:52.767650+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.767650+0000","last_undegraded":"2024-09-12T02:41:52.767650+0000","last_fullsized":"2024-09-12T02:41:52.767650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.767919+0000","last_change":"2024-09-12T02:41:52.767919+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.767919+0000","last_undegraded":"2024-09-12T02:41:52.767919+0000","last_fullsized":"2024-09-12T02:41:52.767919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.773554+0000","last_change":"2024-09-12T02:41:52.773554+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.773554+0000","last_undegraded":"2024-09-12T02:41:52.773554+0000","last_fullsized":"2024-09-12T02:41:52.773554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.770154+0000","last_change":"2024-09-12T02:41:52.770154+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.770154+0000","last_undegraded":"2024-09-12T02:41:52.770154+0000","last_fullsized":"2024-09-12T02:41:52.770154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.765492+0000","last_change":"2024-09-12T02:41:52.765492+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.765492+0000","last_undegraded":"2024-09-12T02:41:52.765492+0000","last_fullsized":"2024-09-12T02:41:52.765492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.772768+0000","last_change":"2024-09-12T02:41:52.772768+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.772768+0000","last_undegraded":"2024-09-12T02:41:52.772768+0000","last_fullsized":"2024-09-12T02:41:52.772768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.782851+0000","last_change":"2024-09-12T02:41:52.782761+0000","last_active":"2024-09-12T02:41:52.782851+0000","last_peered":"2024-09-12T02:41:52.782851+0000","last_clean":"2024-09-12T02:41:52.782851+0000","last_became_active":"2024-09-12T02:41:52.782565+0000","last_became_peered":"2024-09-12T02:41:52.782565+0000","last_unstale":"2024-09-12T02:41:52.782851+0000","last_undegraded":"2024-09-12T02:41:52.782851+0000","last_fullsized":"2024-09-12T02:41:52.782851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:21.343297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.771460+0000","last_change":"2024-09-12T02:41:52.771460+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.771460+0000","last_undegraded":"2024-09-12T02:41:52.771460+0000","last_fullsized":"2024-09-12T02:41:52.771460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.775855+0000","last_change":"2024-09-12T02:41:52.775582+0000","last_active":"2024-09-12T02:41:52.775855+0000","last_peered":"2024-09-12T02:41:52.775855+0000","last_clean":"2024-09-12T02:41:52.775855+0000","last_became_active":"2024-09-12T02:41:52.774577+0000","last_became_peered":"2024-09-12T02:41:52.774577+0000","last_unstale":"2024-09-12T02:41:52.775855+0000","last_undegraded":"2024-09-12T02:41:52.775855+0000","last_fullsized":"2024-09-12T02:41:52.775855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:53:29.920367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.777816+0000","last_change":"2024-09-12T02:41:52.777181+0000","last_active":"2024-09-12T02:41:52.777816+0000","last_peered":"2024-09-12T02:41:52.777816+0000","last_clean":"2024-09-12T02:41:52.777816+0000","last_became_active":"2024-09-12T02:41:52.773406+0000","last_became_peered":"2024-09-12T02:41:52.773406+0000","last_unstale":"2024-09-12T02:41:52.777816+0000","last_undegraded":"2024-09-12T02:41:52.777816+0000","last_fullsized":"2024-09-12T02:41:52.777816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:44.840934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.764493+0000","last_change":"2024-09-12T02:41:52.764493+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.764493+0000","last_undegraded":"2024-09-12T02:41:52.764493+0000","last_fullsized":"2024-09-12T02:41:52.764493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.783685+0000","last_change":"2024-09-12T02:41:52.783587+0000","last_active":"2024-09-12T02:41:52.783685+0000","last_peered":"2024-09-12T02:41:52.783685+0000","last_clean":"2024-09-12T02:41:52.783685+0000","last_became_active":"2024-09-12T02:41:52.783418+0000","last_became_peered":"2024-09-12T02:41:52.783418+0000","last_unstale":"2024-09-12T02:41:52.783685+0000","last_undegraded":"2024-09-12T02:41:52.783685+0000","last_fullsized":"2024-09-12T02:41:52.783685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:38.105451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.769795+0000","last_change":"2024-09-12T02:41:52.769795+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.769795+0000","last_undegraded":"2024-09-12T02:41:52.769795+0000","last_fullsized":"2024-09-12T02:41:52.769795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.771682+0000","last_change":"2024-09-12T02:41:52.771541+0000","last_active":"2024-09-12T02:41:52.771682+0000","last_peered":"2024-09-12T02:41:52.771682+0000","last_clean":"2024-09-12T02:41:52.771682+0000","last_became_active":"2024-09-12T02:41:52.770232+0000","last_became_peered":"2024-09-12T02:41:52.770232+0000","last_unstale":"2024-09-12T02:41:52.771682+0000","last_undegraded":"2024-09-12T02:41:52.771682+0000","last_fullsized":"2024-09-12T02:41:52.771682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:23.596130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.774780+0000","last_change":"2024-09-12T02:41:52.774780+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.774780+0000","last_undegraded":"2024-09-12T02:41:52.774780+0000","last_fullsized":"2024-09-12T02:41:52.774780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.781131+0000","last_change":"2024-09-12T02:41:52.780065+0000","last_active":"2024-09-12T02:41:52.781131+0000","last_peered":"2024-09-12T02:41:52.781131+0000","last_clean":"2024-09-12T02:41:52.781131+0000","last_became_active":"2024-09-12T02:41:52.778398+0000","last_became_peered":"2024-09-12T02:41:52.778398+0000","last_unstale":"2024-09-12T02:41:52.781131+0000","last_undegraded":"2024-09-12T02:41:52.781131+0000","last_fullsized":"2024-09-12T02:41:52.781131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:08.121527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.769057+0000","last_change":"2024-09-12T02:41:52.769057+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.769057+0000","last_undegraded":"2024-09-12T02:41:52.769057+0000","last_fullsized":"2024-09-12T02:41:52.769057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.781803+0000","last_change":"2024-09-12T02:41:52.781616+0000","last_active":"2024-09-12T02:41:52.781803+0000","last_peered":"2024-09-12T02:41:52.781803+0000","last_clean":"2024-09-12T02:41:52.781803+0000","last_became_active":"2024-09-12T02:41:52.781376+0000","last_became_peered":"2024-09-12T02:41:52.781376+0000","last_unstale":"2024-09-12T02:41:52.781803+0000","last_undegraded":"2024-09-12T02:41:52.781803+0000","last_fullsized":"2024-09-12T02:41:52.781803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:00.469462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.768691+0000","last_change":"2024-09-12T02:41:52.768691+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.768691+0000","last_undegraded":"2024-09-12T02:41:52.768691+0000","last_fullsized":"2024-09-12T02:41:52.768691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.777153+0000","last_change":"2024-09-12T02:41:52.776998+0000","last_active":"2024-09-12T02:41:52.777153+0000","last_peered":"2024-09-12T02:41:52.777153+0000","last_clean":"2024-09-12T02:41:52.777153+0000","last_became_active":"2024-09-12T02:41:52.776765+0000","last_became_peered":"2024-09-12T02:41:52.776765+0000","last_unstale":"2024-09-12T02:41:52.777153+0000","last_undegraded":"2024-09-12T02:41:52.777153+0000","last_fullsized":"2024-09-12T02:41:52.777153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:01.069788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.768818+0000","last_change":"2024-09-12T02:41:52.768818+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.768818+0000","last_undegraded":"2024-09-12T02:41:52.768818+0000","last_fullsized":"2024-09-12T02:41:52.768818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.770388+0000","last_change":"2024-09-12T02:41:52.770092+0000","last_active":"2024-09-12T02:41:52.770388+0000","last_peered":"2024-09-12T02:41:52.770388+0000","last_clean":"2024-09-12T02:41:52.770388+0000","last_became_active":"2024-09-12T02:41:52.769364+0000","last_became_peered":"2024-09-12T02:41:52.769364+0000","last_unstale":"2024-09-12T02:41:52.770388+0000","last_undegraded":"2024-09-12T02:41:52.770388+0000","last_fullsized":"2024-09-12T02:41:52.770388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:44.479987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.768113+0000","last_change":"2024-09-12T02:41:52.768113+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.768113+0000","last_undegraded":"2024-09-12T02:41:52.768113+0000","last_fullsized":"2024-09-12T02:41:52.768113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.781177+0000","last_change":"2024-09-12T02:41:52.780555+0000","last_active":"2024-09-12T02:41:52.781177+0000","last_peered":"2024-09-12T02:41:52.781177+0000","last_clean":"2024-09-12T02:41:52.781177+0000","last_became_active":"2024-09-12T02:41:52.775956+0000","last_became_peered":"2024-09-12T02:41:52.775956+0000","last_unstale":"2024-09-12T02:41:52.781177+0000","last_undegraded":"2024-09-12T02:41:52.781177+0000","last_fullsized":"2024-09-12T02:41:52.781177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:04.013565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.778885+0000","last_change":"2024-09-12T02:41:52.778885+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.778885+0000","last_undegraded":"2024-09-12T02:41:52.778885+0000","last_fullsized":"2024-09-12T02:41:52.778885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.768287+0000","last_change":"2024-09-12T02:41:52.766630+0000","last_active":"2024-09-12T02:41:52.768287+0000","last_peered":"2024-09-12T02:41:52.768287+0000","last_clean":"2024-09-12T02:41:52.768287+0000","last_became_active":"2024-09-12T02:41:52.766146+0000","last_became_peered":"2024-09-12T02:41:52.766146+0000","last_unstale":"2024-09-12T02:41:52.768287+0000","last_undegraded":"2024-09-12T02:41:52.768287+0000","last_fullsized":"2024-09-12T02:41:52.768287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:31.911620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.765006+0000","last_change":"2024-09-12T02:41:52.765006+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.765006+0000","last_undegraded":"2024-09-12T02:41:52.765006+0000","last_fullsized":"2024-09-12T02:41:52.765006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.775264+0000","last_change":"2024-09-12T02:41:52.775019+0000","last_active":"2024-09-12T02:41:52.775264+0000","last_peered":"2024-09-12T02:41:52.775264+0000","last_clean":"2024-09-12T02:41:52.775264+0000","last_became_active":"2024-09-12T02:41:52.774766+0000","last_became_peered":"2024-09-12T02:41:52.774766+0000","last_unstale":"2024-09-12T02:41:52.775264+0000","last_undegraded":"2024-09-12T02:41:52.775264+0000","last_fullsized":"2024-09-12T02:41:52.775264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:56.619672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.779664+0000","last_change":"2024-09-12T02:41:52.779664+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.779664+0000","last_undegraded":"2024-09-12T02:41:52.779664+0000","last_fullsized":"2024-09-12T02:41:52.779664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.770732+0000","last_change":"2024-09-12T02:41:52.767949+0000","last_active":"2024-09-12T02:41:52.770732+0000","last_peered":"2024-09-12T02:41:52.770732+0000","last_clean":"2024-09-12T02:41:52.770732+0000","last_became_active":"2024-09-12T02:41:52.767666+0000","last_became_peered":"2024-09-12T02:41:52.767666+0000","last_unstale":"2024-09-12T02:41:52.770732+0000","last_undegraded":"2024-09-12T02:41:52.770732+0000","last_fullsized":"2024-09-12T02:41:52.770732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:42.857208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.772623+0000","last_change":"2024-09-12T02:41:52.772623+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.772623+0000","last_undegraded":"2024-09-12T02:41:52.772623+0000","last_fullsized":"2024-09-12T02:41:52.772623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.776859+0000","last_change":"2024-09-12T02:41:52.776749+0000","last_active":"2024-09-12T02:41:52.776859+0000","last_peered":"2024-09-12T02:41:52.776859+0000","last_clean":"2024-09-12T02:41:52.776859+0000","last_became_active":"2024-09-12T02:41:52.776495+0000","last_became_peered":"2024-09-12T02:41:52.776495+0000","last_unstale":"2024-09-12T02:41:52.776859+0000","last_undegraded":"2024-09-12T02:41:52.776859+0000","last_fullsized":"2024-09-12T02:41:52.776859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:35.846538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.769033+0000","last_change":"2024-09-12T02:41:52.769033+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.769033+0000","last_undegraded":"2024-09-12T02:41:52.769033+0000","last_fullsized":"2024-09-12T02:41:52.769033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.775386+0000","last_change":"2024-09-12T02:41:52.775195+0000","last_active":"2024-09-12T02:41:52.775386+0000","last_peered":"2024-09-12T02:41:52.775386+0000","last_clean":"2024-09-12T02:41:52.775386+0000","last_became_active":"2024-09-12T02:41:52.774945+0000","last_became_peered":"2024-09-12T02:41:52.774945+0000","last_unstale":"2024-09-12T02:41:52.775386+0000","last_undegraded":"2024-09-12T02:41:52.775386+0000","last_fullsized":"2024-09-12T02:41:52.775386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:28.277557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.774385+0000","last_change":"2024-09-12T02:41:52.774385+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.774385+0000","last_undegraded":"2024-09-12T02:41:52.774385+0000","last_fullsized":"2024-09-12T02:41:52.774385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.782026+0000","last_change":"2024-09-12T02:41:52.781866+0000","last_active":"2024-09-12T02:41:52.782026+0000","last_peered":"2024-09-12T02:41:52.782026+0000","last_clean":"2024-09-12T02:41:52.782026+0000","last_became_active":"2024-09-12T02:41:52.781637+0000","last_became_peered":"2024-09-12T02:41:52.781637+0000","last_unstale":"2024-09-12T02:41:52.782026+0000","last_undegraded":"2024-09-12T02:41:52.782026+0000","last_fullsized":"2024-09-12T02:41:52.782026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:24:19.602570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.770812+0000","last_change":"2024-09-12T02:41:52.770812+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.770812+0000","last_undegraded":"2024-09-12T02:41:52.770812+0000","last_fullsized":"2024-09-12T02:41:52.770812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":166,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.774715+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:41:52.774715+0000","last_peered":"2024-09-12T02:41:52.774715+0000","last_clean":"2024-09-12T02:41:52.774715+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:41:52.774715+0000","last_undegraded":"2024-09-12T02:41:52.774715+0000","last_fullsized":"2024-09-12T02:41:52.774715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:45.426902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.783229+0000","last_change":"2024-09-12T02:41:52.783100+0000","last_active":"2024-09-12T02:41:52.783229+0000","last_peered":"2024-09-12T02:41:52.783229+0000","last_clean":"2024-09-12T02:41:52.783229+0000","last_became_active":"2024-09-12T02:41:52.782739+0000","last_became_peered":"2024-09-12T02:41:52.782739+0000","last_unstale":"2024-09-12T02:41:52.783229+0000","last_undegraded":"2024-09-12T02:41:52.783229+0000","last_fullsized":"2024-09-12T02:41:52.783229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:08.678911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.764047+0000","last_change":"2024-09-12T02:41:52.764047+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.764047+0000","last_undegraded":"2024-09-12T02:41:52.764047+0000","last_fullsized":"2024-09-12T02:41:52.764047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.783259+0000","last_change":"2024-09-12T02:41:52.781604+0000","last_active":"2024-09-12T02:41:52.783259+0000","last_peered":"2024-09-12T02:41:52.783259+0000","last_clean":"2024-09-12T02:41:52.783259+0000","last_became_active":"2024-09-12T02:41:52.780183+0000","last_became_peered":"2024-09-12T02:41:52.780183+0000","last_unstale":"2024-09-12T02:41:52.783259+0000","last_undegraded":"2024-09-12T02:41:52.783259+0000","last_fullsized":"2024-09-12T02:41:52.783259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:17.051664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.768094+0000","last_change":"2024-09-12T02:41:52.768094+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.768094+0000","last_undegraded":"2024-09-12T02:41:52.768094+0000","last_fullsized":"2024-09-12T02:41:52.768094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.779495+0000","last_change":"2024-09-12T02:41:52.779295+0000","last_active":"2024-09-12T02:41:52.779495+0000","last_peered":"2024-09-12T02:41:52.779495+0000","last_clean":"2024-09-12T02:41:52.779495+0000","last_became_active":"2024-09-12T02:41:52.778794+0000","last_became_peered":"2024-09-12T02:41:52.778794+0000","last_unstale":"2024-09-12T02:41:52.779495+0000","last_undegraded":"2024-09-12T02:41:52.779495+0000","last_fullsized":"2024-09-12T02:41:52.779495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:38.532085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.769499+0000","last_change":"2024-09-12T02:41:52.769499+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.769499+0000","last_undegraded":"2024-09-12T02:41:52.769499+0000","last_fullsized":"2024-09-12T02:41:52.769499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.785685+0000","last_change":"2024-09-12T02:41:52.785347+0000","last_active":"2024-09-12T02:41:52.785685+0000","last_peered":"2024-09-12T02:41:52.785685+0000","last_clean":"2024-09-12T02:41:52.785685+0000","last_became_active":"2024-09-12T02:41:52.784154+0000","last_became_peered":"2024-09-12T02:41:52.784154+0000","last_unstale":"2024-09-12T02:41:52.785685+0000","last_undegraded":"2024-09-12T02:41:52.785685+0000","last_fullsized":"2024-09-12T02:41:52.785685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:25.057313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.770604+0000","last_change":"2024-09-12T02:41:52.770604+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.770604+0000","last_undegraded":"2024-09-12T02:41:52.770604+0000","last_fullsized":"2024-09-12T02:41:52.770604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.773633+0000","last_change":"2024-09-12T02:41:52.773305+0000","last_active":"2024-09-12T02:41:52.773633+0000","last_peered":"2024-09-12T02:41:52.773633+0000","last_clean":"2024-09-12T02:41:52.773633+0000","last_became_active":"2024-09-12T02:41:52.773009+0000","last_became_peered":"2024-09-12T02:41:52.773009+0000","last_unstale":"2024-09-12T02:41:52.773633+0000","last_undegraded":"2024-09-12T02:41:52.773633+0000","last_fullsized":"2024-09-12T02:41:52.773633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:54.044389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.774193+0000","last_change":"2024-09-12T02:41:52.774193+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.774193+0000","last_undegraded":"2024-09-12T02:41:52.774193+0000","last_fullsized":"2024-09-12T02:41:52.774193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.784168+0000","last_change":"2024-09-12T02:41:52.783557+0000","last_active":"2024-09-12T02:41:52.784168+0000","last_peered":"2024-09-12T02:41:52.784168+0000","last_clean":"2024-09-12T02:41:52.784168+0000","last_became_active":"2024-09-12T02:41:52.782015+0000","last_became_peered":"2024-09-12T02:41:52.782015+0000","last_unstale":"2024-09-12T02:41:52.784168+0000","last_undegraded":"2024-09-12T02:41:52.784168+0000","last_fullsized":"2024-09-12T02:41:52.784168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:25.040932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.768231+0000","last_change":"2024-09-12T02:41:52.768231+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.768231+0000","last_undegraded":"2024-09-12T02:41:52.768231+0000","last_fullsized":"2024-09-12T02:41:52.768231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.773349+0000","last_change":"2024-09-12T02:41:52.773054+0000","last_active":"2024-09-12T02:41:52.773349+0000","last_peered":"2024-09-12T02:41:52.773349+0000","last_clean":"2024-09-12T02:41:52.773349+0000","last_became_active":"2024-09-12T02:41:52.772715+0000","last_became_peered":"2024-09-12T02:41:52.772715+0000","last_unstale":"2024-09-12T02:41:52.773349+0000","last_undegraded":"2024-09-12T02:41:52.773349+0000","last_fullsized":"2024-09-12T02:41:52.773349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:58.092297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.766216+0000","last_change":"2024-09-12T02:41:52.766216+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.766216+0000","last_undegraded":"2024-09-12T02:41:52.766216+0000","last_fullsized":"2024-09-12T02:41:52.766216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.783080+0000","last_change":"2024-09-12T02:41:52.782851+0000","last_active":"2024-09-12T02:41:52.783080+0000","last_peered":"2024-09-12T02:41:52.783080+0000","last_clean":"2024-09-12T02:41:52.783080+0000","last_became_active":"2024-09-12T02:41:52.782365+0000","last_became_peered":"2024-09-12T02:41:52.782365+0000","last_unstale":"2024-09-12T02:41:52.783080+0000","last_undegraded":"2024-09-12T02:41:52.783080+0000","last_fullsized":"2024-09-12T02:41:52.783080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:47.756953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.768519+0000","last_change":"2024-09-12T02:41:52.768519+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.768519+0000","last_undegraded":"2024-09-12T02:41:52.768519+0000","last_fullsized":"2024-09-12T02:41:52.768519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.783655+0000","last_change":"2024-09-12T02:41:52.783151+0000","last_active":"2024-09-12T02:41:52.783655+0000","last_peered":"2024-09-12T02:41:52.783655+0000","last_clean":"2024-09-12T02:41:52.783655+0000","last_became_active":"2024-09-12T02:41:52.781789+0000","last_became_peered":"2024-09-12T02:41:52.781789+0000","last_unstale":"2024-09-12T02:41:52.783655+0000","last_undegraded":"2024-09-12T02:41:52.783655+0000","last_fullsized":"2024-09-12T02:41:52.783655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:48.615034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.768633+0000","last_change":"2024-09-12T02:41:52.768633+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.768633+0000","last_undegraded":"2024-09-12T02:41:52.768633+0000","last_fullsized":"2024-09-12T02:41:52.768633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.784830+0000","last_change":"2024-09-12T02:41:52.784747+0000","last_active":"2024-09-12T02:41:52.784830+0000","last_peered":"2024-09-12T02:41:52.784830+0000","last_clean":"2024-09-12T02:41:52.784830+0000","last_became_active":"2024-09-12T02:41:52.784558+0000","last_became_peered":"2024-09-12T02:41:52.784558+0000","last_unstale":"2024-09-12T02:41:52.784830+0000","last_undegraded":"2024-09-12T02:41:52.784830+0000","last_fullsized":"2024-09-12T02:41:52.784830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:20.657348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.764433+0000","last_change":"2024-09-12T02:41:52.764433+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.764433+0000","last_undegraded":"2024-09-12T02:41:52.764433+0000","last_fullsized":"2024-09-12T02:41:52.764433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.780756+0000","last_change":"2024-09-12T02:41:52.780636+0000","last_active":"2024-09-12T02:41:52.780756+0000","last_peered":"2024-09-12T02:41:52.780756+0000","last_clean":"2024-09-12T02:41:52.780756+0000","last_became_active":"2024-09-12T02:41:52.780347+0000","last_became_peered":"2024-09-12T02:41:52.780347+0000","last_unstale":"2024-09-12T02:41:52.780756+0000","last_undegraded":"2024-09-12T02:41:52.780756+0000","last_fullsized":"2024-09-12T02:41:52.780756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:27.321782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.764050+0000","last_change":"2024-09-12T02:41:52.764050+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.764050+0000","last_undegraded":"2024-09-12T02:41:52.764050+0000","last_fullsized":"2024-09-12T02:41:52.764050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.784083+0000","last_change":"2024-09-12T02:41:52.783869+0000","last_active":"2024-09-12T02:41:52.784083+0000","last_peered":"2024-09-12T02:41:52.784083+0000","last_clean":"2024-09-12T02:41:52.784083+0000","last_became_active":"2024-09-12T02:41:52.781705+0000","last_became_peered":"2024-09-12T02:41:52.781705+0000","last_unstale":"2024-09-12T02:41:52.784083+0000","last_undegraded":"2024-09-12T02:41:52.784083+0000","last_fullsized":"2024-09-12T02:41:52.784083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:30.106407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.766541+0000","last_change":"2024-09-12T02:41:52.766541+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.766541+0000","last_undegraded":"2024-09-12T02:41:52.766541+0000","last_fullsized":"2024-09-12T02:41:52.766541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.773244+0000","last_change":"2024-09-12T02:41:52.773244+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.773244+0000","last_undegraded":"2024-09-12T02:41:52.773244+0000","last_fullsized":"2024-09-12T02:41:52.773244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.785874+0000","last_change":"2024-09-12T02:41:52.785769+0000","last_active":"2024-09-12T02:41:52.785874+0000","last_peered":"2024-09-12T02:41:52.785874+0000","last_clean":"2024-09-12T02:41:52.785874+0000","last_became_active":"2024-09-12T02:41:52.785498+0000","last_became_peered":"2024-09-12T02:41:52.785498+0000","last_unstale":"2024-09-12T02:41:52.785874+0000","last_undegraded":"2024-09-12T02:41:52.785874+0000","last_fullsized":"2024-09-12T02:41:52.785874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:19.772196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.771241+0000","last_change":"2024-09-12T02:41:52.771241+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.771241+0000","last_undegraded":"2024-09-12T02:41:52.771241+0000","last_fullsized":"2024-09-12T02:41:52.771241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.784636+0000","last_change":"2024-09-12T02:41:52.784485+0000","last_active":"2024-09-12T02:41:52.784636+0000","last_peered":"2024-09-12T02:41:52.784636+0000","last_clean":"2024-09-12T02:41:52.784636+0000","last_became_active":"2024-09-12T02:41:52.784183+0000","last_became_peered":"2024-09-12T02:41:52.784183+0000","last_unstale":"2024-09-12T02:41:52.784636+0000","last_undegraded":"2024-09-12T02:41:52.784636+0000","last_fullsized":"2024-09-12T02:41:52.784636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:00.534944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.768907+0000","last_change":"2024-09-12T02:41:52.768907+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.768907+0000","last_undegraded":"2024-09-12T02:41:52.768907+0000","last_fullsized":"2024-09-12T02:41:52.768907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.779130+0000","last_change":"2024-09-12T02:41:52.778974+0000","last_active":"2024-09-12T02:41:52.779130+0000","last_peered":"2024-09-12T02:41:52.779130+0000","last_clean":"2024-09-12T02:41:52.779130+0000","last_became_active":"2024-09-12T02:41:52.775107+0000","last_became_peered":"2024-09-12T02:41:52.775107+0000","last_unstale":"2024-09-12T02:41:52.779130+0000","last_undegraded":"2024-09-12T02:41:52.779130+0000","last_fullsized":"2024-09-12T02:41:52.779130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:22.172662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.765250+0000","last_change":"2024-09-12T02:41:52.765250+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.765250+0000","last_undegraded":"2024-09-12T02:41:52.765250+0000","last_fullsized":"2024-09-12T02:41:52.765250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.778312+0000","last_change":"2024-09-12T02:41:52.778197+0000","last_active":"2024-09-12T02:41:52.778312+0000","last_peered":"2024-09-12T02:41:52.778312+0000","last_clean":"2024-09-12T02:41:52.778312+0000","last_became_active":"2024-09-12T02:41:52.777887+0000","last_became_peered":"2024-09-12T02:41:52.777887+0000","last_unstale":"2024-09-12T02:41:52.778312+0000","last_undegraded":"2024-09-12T02:41:52.778312+0000","last_fullsized":"2024-09-12T02:41:52.778312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:29.372288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358208,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358208,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:41:57.962 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:41:58.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.150+0000 7fcfd5c00640 1 Processor -- start 2024-09-12T02:41:58.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.150+0000 7fcfd5c00640 1 -- start start 2024-09-12T02:41:58.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.151+0000 7fcfd5c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcfd0162100 0x7fcfd00d58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:58.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.151+0000 7fcfd5c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcfd00d0510 0x7fcfd00d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:58.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.151+0000 7fcfd5c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfd00cfa70 con 0x7fcfd01624e0 2024-09-12T02:41:58.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.151+0000 7fcfd5c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fcfd00b4e20 con 0x7fcfd0162100 2024-09-12T02:41:58.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.151+0000 7fcfd5c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fcfd00d21d0 con 0x7fcfd00d0510 2024-09-12T02:41:58.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.151+0000 7fcfcea00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcfd0162100 0x7fcfd00d58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:58.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.151+0000 7fcfcea00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcfd0162100 0x7fcfd00d58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38840/0 (socket says 172.21.15.112:38840) 2024-09-12T02:41:58.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.151+0000 7fcfcea00640 1 -- 172.21.15.112:0/397247522 learned_addr learned my addr 172.21.15.112:0/397247522 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:58.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.152+0000 7fcfcf400640 1 --2- 172.21.15.112:0/397247522 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcfd00d0510 0x7fcfd00d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:58.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.152+0000 7fcfcea00640 1 -- 172.21.15.112:0/397247522 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcfd00d0510 msgr2=0x7fcfd00d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:58.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.152+0000 7fcfcea00640 1 --2- 172.21.15.112:0/397247522 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcfd00d0510 0x7fcfd00d0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:58.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.152+0000 7fcfcea00640 1 -- 172.21.15.112:0/397247522 >> v1:172.21.15.137:6789/0 conn(0x7fcfd01624e0 legacy=0x7fcfd00b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:58.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.152+0000 7fcfcea00640 1 -- 172.21.15.112:0/397247522 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfd00d24b0 con 0x7fcfd0162100 2024-09-12T02:41:58.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.152+0000 7fcfcf400640 1 --2- 172.21.15.112:0/397247522 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcfd00d0510 0x7fcfd00d0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:41:58.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.153+0000 7fcfcea00640 1 --2- 172.21.15.112:0/397247522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfd0162100 0x7fcfd00d58d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00b7970 tx=0x7fcfc002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee8fac12fa993d55 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:58.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.153+0000 7fcfcd600640 1 -- 172.21.15.112:0/397247522 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0037070 con 0x7fcfd0162100 2024-09-12T02:41:58.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.153+0000 7fcfcd600640 1 -- 172.21.15.112:0/397247522 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfc002ae50 con 0x7fcfd0162100 2024-09-12T02:41:58.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.153+0000 7fcfcd600640 1 -- 172.21.15.112:0/397247522 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0032660 con 0x7fcfd0162100 2024-09-12T02:41:58.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.153+0000 7fcfd5c00640 1 -- 172.21.15.112:0/397247522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfd0162100 msgr2=0x7fcfd00d58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:58.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.153+0000 7fcfd5c00640 1 --2- 172.21.15.112:0/397247522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfd0162100 0x7fcfd00d58d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00b7970 tx=0x7fcfc002a140 comp rx=0 tx=0).stop 2024-09-12T02:41:58.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.154+0000 7fcfd5c00640 1 -- 172.21.15.112:0/397247522 shutdown_connections 2024-09-12T02:41:58.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.154+0000 7fcfd5c00640 1 --2- 172.21.15.112:0/397247522 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcfd00d0510 0x7fcfd00d0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:58.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.154+0000 7fcfd5c00640 1 --2- 172.21.15.112:0/397247522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfd0162100 0x7fcfd00d58d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:58.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.154+0000 7fcfd5c00640 1 -- 172.21.15.112:0/397247522 >> 172.21.15.112:0/397247522 conn(0x7fcfd00d4db0 msgr2=0x7fcfd00d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:58.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.154+0000 7fcfd5c00640 1 -- 172.21.15.112:0/397247522 shutdown_connections 2024-09-12T02:41:58.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.154+0000 7fcfd5c00640 1 -- 172.21.15.112:0/397247522 wait complete. 2024-09-12T02:41:58.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.155+0000 7fcfd5c00640 1 Processor -- start 2024-09-12T02:41:58.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.155+0000 7fcfd5c00640 1 -- start start 2024-09-12T02:41:58.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.156+0000 7fcfd5c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcfd00d0510 0x7fcfd0156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:58.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.156+0000 7fcfd5c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfd0162100 0x7fcfd0157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:58.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.156+0000 7fcfd5c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfd01624e0 0x7fcfd00b9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:58.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.156+0000 7fcfd5c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd00d0e60 con 0x7fcfd0162100 2024-09-12T02:41:58.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.156+0000 7fcfd5c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd00cfff0 con 0x7fcfd01624e0 2024-09-12T02:41:58.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.156+0000 7fcfd5c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fcfd00d1df0 con 0x7fcfd00d0510 2024-09-12T02:41:58.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.157+0000 7fcfce000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfd0162100 0x7fcfd0157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:58.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.157+0000 7fcfce000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfd0162100 0x7fcfd0157280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38850/0 (socket says 172.21.15.112:38850) 2024-09-12T02:41:58.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.157+0000 7fcfce000640 1 -- 172.21.15.112:0/2210017003 learned_addr learned my addr 172.21.15.112:0/2210017003 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:58.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.157+0000 7fcfcea00640 1 --2- 172.21.15.112:0/2210017003 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcfd00d0510 0x7fcfd0156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:58.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.157+0000 7fcfcf400640 1 --2- 172.21.15.112:0/2210017003 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfd01624e0 0x7fcfd00b9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:58.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.157+0000 7fcfce000640 1 -- 172.21.15.112:0/2210017003 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcfd00d0510 msgr2=0x7fcfd0156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:58.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.157+0000 7fcfce000640 1 --2- 172.21.15.112:0/2210017003 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcfd00d0510 0x7fcfd0156d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:58.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.157+0000 7fcfce000640 1 -- 172.21.15.112:0/2210017003 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfd01624e0 msgr2=0x7fcfd00b9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:58.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.157+0000 7fcfce000640 1 --2- 172.21.15.112:0/2210017003 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfd01624e0 0x7fcfd00b9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:58.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.157+0000 7fcfce000640 1 -- 172.21.15.112:0/2210017003 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfd00b8960 con 0x7fcfd0162100 2024-09-12T02:41:58.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.157+0000 7fcfcea00640 1 --2- 172.21.15.112:0/2210017003 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcfd00d0510 0x7fcfd0156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:41:58.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.157+0000 7fcfce000640 1 --2- 172.21.15.112:0/2210017003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfd0162100 0x7fcfd0157280 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc00b3f0 tx=0x7fcfbc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:58.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.157+0000 7fcfc6a00640 1 -- 172.21.15.112:0/2210017003 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc015020 con 0x7fcfd0162100 2024-09-12T02:41:58.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.157+0000 7fcfc6a00640 1 -- 172.21.15.112:0/2210017003 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfbc011830 con 0x7fcfd0162100 2024-09-12T02:41:58.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.158+0000 7fcfc6a00640 1 -- 172.21.15.112:0/2210017003 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc011c20 con 0x7fcfd0162100 2024-09-12T02:41:58.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.158+0000 7fcfd5c00640 1 -- 172.21.15.112:0/2210017003 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfd00b8c40 con 0x7fcfd0162100 2024-09-12T02:41:58.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.158+0000 7fcfd5c00640 1 -- 172.21.15.112:0/2210017003 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfd00b9200 con 0x7fcfd0162100 2024-09-12T02:41:58.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.159+0000 7fcfd5c00640 1 -- 172.21.15.112:0/2210017003 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfd0162b80 con 0x7fcfd0162100 2024-09-12T02:41:58.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.160+0000 7fcfc6a00640 1 -- 172.21.15.112:0/2210017003 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcfbc018020 con 0x7fcfd0162100 2024-09-12T02:41:58.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.161+0000 7fcfc6a00640 1 --2- 172.21.15.112:0/2210017003 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcfb006be30 0x7fcfb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:58.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.161+0000 7fcfc6a00640 1 -- 172.21.15.112:0/2210017003 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcfbc08aa70 con 0x7fcfd0162100 2024-09-12T02:41:58.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.161+0000 7fcfcea00640 1 --2- 172.21.15.112:0/2210017003 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcfb006be30 0x7fcfb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:58.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.161+0000 7fcfcea00640 1 --2- 172.21.15.112:0/2210017003 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcfb006be30 0x7fcfb006e2f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0034000 tx=0x7fcfc002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:58.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.165+0000 7fcfc6a00640 1 -- 172.21.15.112:0/2210017003 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcfbc01f030 con 0x7fcfd0162100 2024-09-12T02:41:58.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.335+0000 7fcfd5c00640 1 -- 172.21.15.112:0/2210017003 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcfd00d1990 con 0x7fcfb006be30 2024-09-12T02:41:58.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.342+0000 7fcfc6a00640 1 -- 172.21.15.112:0/2210017003 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242210 (secure 0 0 0) 0x7fcfd00d1990 con 0x7fcfb006be30 2024-09-12T02:41:58.345 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:58.346 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:41:58.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.346+0000 7fcfd5c00640 1 -- 172.21.15.112:0/2210017003 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcfb006be30 msgr2=0x7fcfb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:58.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.346+0000 7fcfd5c00640 1 --2- 172.21.15.112:0/2210017003 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcfb006be30 0x7fcfb006e2f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0034000 tx=0x7fcfc002e000 comp rx=0 tx=0).stop 2024-09-12T02:41:58.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.346+0000 7fcfd5c00640 1 -- 172.21.15.112:0/2210017003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfd0162100 msgr2=0x7fcfd0157280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:58.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.346+0000 7fcfd5c00640 1 --2- 172.21.15.112:0/2210017003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfd0162100 0x7fcfd0157280 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc00b3f0 tx=0x7fcfbc00b8b0 comp rx=0 tx=0).stop 2024-09-12T02:41:58.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.346+0000 7fcfd5c00640 1 -- 172.21.15.112:0/2210017003 shutdown_connections 2024-09-12T02:41:58.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.346+0000 7fcfd5c00640 1 --2- 172.21.15.112:0/2210017003 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcfb006be30 0x7fcfb006e2f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:58.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.346+0000 7fcfd5c00640 1 --2- 172.21.15.112:0/2210017003 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfd01624e0 0x7fcfd00b9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:58.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.346+0000 7fcfd5c00640 1 --2- 172.21.15.112:0/2210017003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfd0162100 0x7fcfd0157280 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:58.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.346+0000 7fcfd5c00640 1 --2- 172.21.15.112:0/2210017003 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcfd00d0510 0x7fcfd0156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:58.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.346+0000 7fcfd5c00640 1 -- 172.21.15.112:0/2210017003 >> 172.21.15.112:0/2210017003 conn(0x7fcfd00d4db0 msgr2=0x7fcfd00d5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:58.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.346+0000 7fcfd5c00640 1 -- 172.21.15.112:0/2210017003 shutdown_connections 2024-09-12T02:41:58.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.346+0000 7fcfd5c00640 1 -- 172.21.15.112:0/2210017003 wait complete. 2024-09-12T02:41:58.362 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-12T02:41:56.959331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1554,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560945,"statfs":{"total":1600000000,"available":1598407872,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.201111"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.772872+0000","last_change":"2024-09-12T02:41:52.772872+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.772872+0000","last_undegraded":"2024-09-12T02:41:52.772872+0000","last_fullsized":"2024-09-12T02:41:52.772872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.771785+0000","last_change":"2024-09-12T02:41:52.771785+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.771785+0000","last_undegraded":"2024-09-12T02:41:52.771785+0000","last_fullsized":"2024-09-12T02:41:52.771785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.772082+0000","last_change":"2024-09-12T02:41:52.772082+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.772082+0000","last_undegraded":"2024-09-12T02:41:52.772082+0000","last_fullsized":"2024-09-12T02:41:52.772082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.778628+0000","last_change":"2024-09-12T02:41:52.778628+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.778628+0000","last_undegraded":"2024-09-12T02:41:52.778628+0000","last_fullsized":"2024-09-12T02:41:52.778628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.779745+0000","last_change":"2024-09-12T02:41:52.779745+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.779745+0000","last_undegraded":"2024-09-12T02:41:52.779745+0000","last_fullsized":"2024-09-12T02:41:52.779745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.774860+0000","last_change":"2024-09-12T02:41:52.774860+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.774860+0000","last_undegraded":"2024-09-12T02:41:52.774860+0000","last_fullsized":"2024-09-12T02:41:52.774860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.780128+0000","last_change":"2024-09-12T02:41:52.780128+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.780128+0000","last_undegraded":"2024-09-12T02:41:52.780128+0000","last_fullsized":"2024-09-12T02:41:52.780128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.773665+0000","last_change":"2024-09-12T02:41:52.773665+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.773665+0000","last_undegraded":"2024-09-12T02:41:52.773665+0000","last_fullsized":"2024-09-12T02:41:52.773665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.769397+0000","last_change":"2024-09-12T02:41:52.769397+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.769397+0000","last_undegraded":"2024-09-12T02:41:52.769397+0000","last_fullsized":"2024-09-12T02:41:52.769397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.770167+0000","last_change":"2024-09-12T02:41:52.770167+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.770167+0000","last_undegraded":"2024-09-12T02:41:52.770167+0000","last_fullsized":"2024-09-12T02:41:52.770167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.765916+0000","last_change":"2024-09-12T02:41:52.765916+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.765916+0000","last_undegraded":"2024-09-12T02:41:52.765916+0000","last_fullsized":"2024-09-12T02:41:52.765916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.771228+0000","last_change":"2024-09-12T02:41:52.771228+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.771228+0000","last_undegraded":"2024-09-12T02:41:52.771228+0000","last_fullsized":"2024-09-12T02:41:52.771228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.773234+0000","last_change":"2024-09-12T02:41:52.773234+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.773234+0000","last_undegraded":"2024-09-12T02:41:52.773234+0000","last_fullsized":"2024-09-12T02:41:52.773234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.770779+0000","last_change":"2024-09-12T02:41:52.770779+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.770779+0000","last_undegraded":"2024-09-12T02:41:52.770779+0000","last_fullsized":"2024-09-12T02:41:52.770779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.770731+0000","last_change":"2024-09-12T02:41:52.770731+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.770731+0000","last_undegraded":"2024-09-12T02:41:52.770731+0000","last_fullsized":"2024-09-12T02:41:52.770731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.773809+0000","last_change":"2024-09-12T02:41:52.773809+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.773809+0000","last_undegraded":"2024-09-12T02:41:52.773809+0000","last_fullsized":"2024-09-12T02:41:52.773809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.778121+0000","last_change":"2024-09-12T02:41:52.778121+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.778121+0000","last_undegraded":"2024-09-12T02:41:52.778121+0000","last_fullsized":"2024-09-12T02:41:52.778121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.770518+0000","last_change":"2024-09-12T02:41:52.770518+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.770518+0000","last_undegraded":"2024-09-12T02:41:52.770518+0000","last_fullsized":"2024-09-12T02:41:52.770518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.768585+0000","last_change":"2024-09-12T02:41:52.768585+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.768585+0000","last_undegraded":"2024-09-12T02:41:52.768585+0000","last_fullsized":"2024-09-12T02:41:52.768585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.769698+0000","last_change":"2024-09-12T02:41:52.769698+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.769698+0000","last_undegraded":"2024-09-12T02:41:52.769698+0000","last_fullsized":"2024-09-12T02:41:52.769698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.770765+0000","last_change":"2024-09-12T02:41:52.770765+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.770765+0000","last_undegraded":"2024-09-12T02:41:52.770765+0000","last_fullsized":"2024-09-12T02:41:52.770765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.776284+0000","last_change":"2024-09-12T02:41:52.776284+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.776284+0000","last_undegraded":"2024-09-12T02:41:52.776284+0000","last_fullsized":"2024-09-12T02:41:52.776284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.769249+0000","last_change":"2024-09-12T02:41:52.769249+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.769249+0000","last_undegraded":"2024-09-12T02:41:52.769249+0000","last_fullsized":"2024-09-12T02:41:52.769249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.774508+0000","last_change":"2024-09-12T02:41:52.774508+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.774508+0000","last_undegraded":"2024-09-12T02:41:52.774508+0000","last_fullsized":"2024-09-12T02:41:52.774508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.767032+0000","last_change":"2024-09-12T02:41:52.767032+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.767032+0000","last_undegraded":"2024-09-12T02:41:52.767032+0000","last_fullsized":"2024-09-12T02:41:52.767032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.765221+0000","last_change":"2024-09-12T02:41:52.765221+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.765221+0000","last_undegraded":"2024-09-12T02:41:52.765221+0000","last_fullsized":"2024-09-12T02:41:52.765221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.770451+0000","last_change":"2024-09-12T02:41:52.770451+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.770451+0000","last_undegraded":"2024-09-12T02:41:52.770451+0000","last_fullsized":"2024-09-12T02:41:52.770451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.767650+0000","last_change":"2024-09-12T02:41:52.767650+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.767650+0000","last_undegraded":"2024-09-12T02:41:52.767650+0000","last_fullsized":"2024-09-12T02:41:52.767650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.767919+0000","last_change":"2024-09-12T02:41:52.767919+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.767919+0000","last_undegraded":"2024-09-12T02:41:52.767919+0000","last_fullsized":"2024-09-12T02:41:52.767919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.773554+0000","last_change":"2024-09-12T02:41:52.773554+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.773554+0000","last_undegraded":"2024-09-12T02:41:52.773554+0000","last_fullsized":"2024-09-12T02:41:52.773554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.770154+0000","last_change":"2024-09-12T02:41:52.770154+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.770154+0000","last_undegraded":"2024-09-12T02:41:52.770154+0000","last_fullsized":"2024-09-12T02:41:52.770154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.765492+0000","last_change":"2024-09-12T02:41:52.765492+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.765492+0000","last_undegraded":"2024-09-12T02:41:52.765492+0000","last_fullsized":"2024-09-12T02:41:52.765492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.772768+0000","last_change":"2024-09-12T02:41:52.772768+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.772768+0000","last_undegraded":"2024-09-12T02:41:52.772768+0000","last_fullsized":"2024-09-12T02:41:52.772768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.782851+0000","last_change":"2024-09-12T02:41:52.782761+0000","last_active":"2024-09-12T02:41:52.782851+0000","last_peered":"2024-09-12T02:41:52.782851+0000","last_clean":"2024-09-12T02:41:52.782851+0000","last_became_active":"2024-09-12T02:41:52.782565+0000","last_became_peered":"2024-09-12T02:41:52.782565+0000","last_unstale":"2024-09-12T02:41:52.782851+0000","last_undegraded":"2024-09-12T02:41:52.782851+0000","last_fullsized":"2024-09-12T02:41:52.782851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:21.343297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.771460+0000","last_change":"2024-09-12T02:41:52.771460+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.771460+0000","last_undegraded":"2024-09-12T02:41:52.771460+0000","last_fullsized":"2024-09-12T02:41:52.771460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.775855+0000","last_change":"2024-09-12T02:41:52.775582+0000","last_active":"2024-09-12T02:41:52.775855+0000","last_peered":"2024-09-12T02:41:52.775855+0000","last_clean":"2024-09-12T02:41:52.775855+0000","last_became_active":"2024-09-12T02:41:52.774577+0000","last_became_peered":"2024-09-12T02:41:52.774577+0000","last_unstale":"2024-09-12T02:41:52.775855+0000","last_undegraded":"2024-09-12T02:41:52.775855+0000","last_fullsized":"2024-09-12T02:41:52.775855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:53:29.920367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.777816+0000","last_change":"2024-09-12T02:41:52.777181+0000","last_active":"2024-09-12T02:41:52.777816+0000","last_peered":"2024-09-12T02:41:52.777816+0000","last_clean":"2024-09-12T02:41:52.777816+0000","last_became_active":"2024-09-12T02:41:52.773406+0000","last_became_peered":"2024-09-12T02:41:52.773406+0000","last_unstale":"2024-09-12T02:41:52.777816+0000","last_undegraded":"2024-09-12T02:41:52.777816+0000","last_fullsized":"2024-09-12T02:41:52.777816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:44.840934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.764493+0000","last_change":"2024-09-12T02:41:52.764493+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.764493+0000","last_undegraded":"2024-09-12T02:41:52.764493+0000","last_fullsized":"2024-09-12T02:41:52.764493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.783685+0000","last_change":"2024-09-12T02:41:52.783587+0000","last_active":"2024-09-12T02:41:52.783685+0000","last_peered":"2024-09-12T02:41:52.783685+0000","last_clean":"2024-09-12T02:41:52.783685+0000","last_became_active":"2024-09-12T02:41:52.783418+0000","last_became_peered":"2024-09-12T02:41:52.783418+0000","last_unstale":"2024-09-12T02:41:52.783685+0000","last_undegraded":"2024-09-12T02:41:52.783685+0000","last_fullsized":"2024-09-12T02:41:52.783685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:38.105451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.769795+0000","last_change":"2024-09-12T02:41:52.769795+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.769795+0000","last_undegraded":"2024-09-12T02:41:52.769795+0000","last_fullsized":"2024-09-12T02:41:52.769795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.771682+0000","last_change":"2024-09-12T02:41:52.771541+0000","last_active":"2024-09-12T02:41:52.771682+0000","last_peered":"2024-09-12T02:41:52.771682+0000","last_clean":"2024-09-12T02:41:52.771682+0000","last_became_active":"2024-09-12T02:41:52.770232+0000","last_became_peered":"2024-09-12T02:41:52.770232+0000","last_unstale":"2024-09-12T02:41:52.771682+0000","last_undegraded":"2024-09-12T02:41:52.771682+0000","last_fullsized":"2024-09-12T02:41:52.771682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:23.596130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.774780+0000","last_change":"2024-09-12T02:41:52.774780+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.774780+0000","last_undegraded":"2024-09-12T02:41:52.774780+0000","last_fullsized":"2024-09-12T02:41:52.774780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.781131+0000","last_change":"2024-09-12T02:41:52.780065+0000","last_active":"2024-09-12T02:41:52.781131+0000","last_peered":"2024-09-12T02:41:52.781131+0000","last_clean":"2024-09-12T02:41:52.781131+0000","last_became_active":"2024-09-12T02:41:52.778398+0000","last_became_peered":"2024-09-12T02:41:52.778398+0000","last_unstale":"2024-09-12T02:41:52.781131+0000","last_undegraded":"2024-09-12T02:41:52.781131+0000","last_fullsized":"2024-09-12T02:41:52.781131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:08.121527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.769057+0000","last_change":"2024-09-12T02:41:52.769057+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.769057+0000","last_undegraded":"2024-09-12T02:41:52.769057+0000","last_fullsized":"2024-09-12T02:41:52.769057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.781803+0000","last_change":"2024-09-12T02:41:52.781616+0000","last_active":"2024-09-12T02:41:52.781803+0000","last_peered":"2024-09-12T02:41:52.781803+0000","last_clean":"2024-09-12T02:41:52.781803+0000","last_became_active":"2024-09-12T02:41:52.781376+0000","last_became_peered":"2024-09-12T02:41:52.781376+0000","last_unstale":"2024-09-12T02:41:52.781803+0000","last_undegraded":"2024-09-12T02:41:52.781803+0000","last_fullsized":"2024-09-12T02:41:52.781803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:00.469462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.768691+0000","last_change":"2024-09-12T02:41:52.768691+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.768691+0000","last_undegraded":"2024-09-12T02:41:52.768691+0000","last_fullsized":"2024-09-12T02:41:52.768691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.777153+0000","last_change":"2024-09-12T02:41:52.776998+0000","last_active":"2024-09-12T02:41:52.777153+0000","last_peered":"2024-09-12T02:41:52.777153+0000","last_clean":"2024-09-12T02:41:52.777153+0000","last_became_active":"2024-09-12T02:41:52.776765+0000","last_became_peered":"2024-09-12T02:41:52.776765+0000","last_unstale":"2024-09-12T02:41:52.777153+0000","last_undegraded":"2024-09-12T02:41:52.777153+0000","last_fullsized":"2024-09-12T02:41:52.777153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:01.069788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.768818+0000","last_change":"2024-09-12T02:41:52.768818+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.768818+0000","last_undegraded":"2024-09-12T02:41:52.768818+0000","last_fullsized":"2024-09-12T02:41:52.768818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.770388+0000","last_change":"2024-09-12T02:41:52.770092+0000","last_active":"2024-09-12T02:41:52.770388+0000","last_peered":"2024-09-12T02:41:52.770388+0000","last_clean":"2024-09-12T02:41:52.770388+0000","last_became_active":"2024-09-12T02:41:52.769364+0000","last_became_peered":"2024-09-12T02:41:52.769364+0000","last_unstale":"2024-09-12T02:41:52.770388+0000","last_undegraded":"2024-09-12T02:41:52.770388+0000","last_fullsized":"2024-09-12T02:41:52.770388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:44.479987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.768113+0000","last_change":"2024-09-12T02:41:52.768113+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.768113+0000","last_undegraded":"2024-09-12T02:41:52.768113+0000","last_fullsized":"2024-09-12T02:41:52.768113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.781177+0000","last_change":"2024-09-12T02:41:52.780555+0000","last_active":"2024-09-12T02:41:52.781177+0000","last_peered":"2024-09-12T02:41:52.781177+0000","last_clean":"2024-09-12T02:41:52.781177+0000","last_became_active":"2024-09-12T02:41:52.775956+0000","last_became_peered":"2024-09-12T02:41:52.775956+0000","last_unstale":"2024-09-12T02:41:52.781177+0000","last_undegraded":"2024-09-12T02:41:52.781177+0000","last_fullsized":"2024-09-12T02:41:52.781177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:04.013565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.778885+0000","last_change":"2024-09-12T02:41:52.778885+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.778885+0000","last_undegraded":"2024-09-12T02:41:52.778885+0000","last_fullsized":"2024-09-12T02:41:52.778885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.768287+0000","last_change":"2024-09-12T02:41:52.766630+0000","last_active":"2024-09-12T02:41:52.768287+0000","last_peered":"2024-09-12T02:41:52.768287+0000","last_clean":"2024-09-12T02:41:52.768287+0000","last_became_active":"2024-09-12T02:41:52.766146+0000","last_became_peered":"2024-09-12T02:41:52.766146+0000","last_unstale":"2024-09-12T02:41:52.768287+0000","last_undegraded":"2024-09-12T02:41:52.768287+0000","last_fullsized":"2024-09-12T02:41:52.768287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:31.911620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.765006+0000","last_change":"2024-09-12T02:41:52.765006+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.765006+0000","last_undegraded":"2024-09-12T02:41:52.765006+0000","last_fullsized":"2024-09-12T02:41:52.765006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.775264+0000","last_change":"2024-09-12T02:41:52.775019+0000","last_active":"2024-09-12T02:41:52.775264+0000","last_peered":"2024-09-12T02:41:52.775264+0000","last_clean":"2024-09-12T02:41:52.775264+0000","last_became_active":"2024-09-12T02:41:52.774766+0000","last_became_peered":"2024-09-12T02:41:52.774766+0000","last_unstale":"2024-09-12T02:41:52.775264+0000","last_undegraded":"2024-09-12T02:41:52.775264+0000","last_fullsized":"2024-09-12T02:41:52.775264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:56.619672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.779664+0000","last_change":"2024-09-12T02:41:52.779664+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.779664+0000","last_undegraded":"2024-09-12T02:41:52.779664+0000","last_fullsized":"2024-09-12T02:41:52.779664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.770732+0000","last_change":"2024-09-12T02:41:52.767949+0000","last_active":"2024-09-12T02:41:52.770732+0000","last_peered":"2024-09-12T02:41:52.770732+0000","last_clean":"2024-09-12T02:41:52.770732+0000","last_became_active":"2024-09-12T02:41:52.767666+0000","last_became_peered":"2024-09-12T02:41:52.767666+0000","last_unstale":"2024-09-12T02:41:52.770732+0000","last_undegraded":"2024-09-12T02:41:52.770732+0000","last_fullsized":"2024-09-12T02:41:52.770732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:42.857208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.772623+0000","last_change":"2024-09-12T02:41:52.772623+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.772623+0000","last_undegraded":"2024-09-12T02:41:52.772623+0000","last_fullsized":"2024-09-12T02:41:52.772623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.776859+0000","last_change":"2024-09-12T02:41:52.776749+0000","last_active":"2024-09-12T02:41:52.776859+0000","last_peered":"2024-09-12T02:41:52.776859+0000","last_clean":"2024-09-12T02:41:52.776859+0000","last_became_active":"2024-09-12T02:41:52.776495+0000","last_became_peered":"2024-09-12T02:41:52.776495+0000","last_unstale":"2024-09-12T02:41:52.776859+0000","last_undegraded":"2024-09-12T02:41:52.776859+0000","last_fullsized":"2024-09-12T02:41:52.776859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:35.846538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.769033+0000","last_change":"2024-09-12T02:41:52.769033+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.769033+0000","last_undegraded":"2024-09-12T02:41:52.769033+0000","last_fullsized":"2024-09-12T02:41:52.769033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.775386+0000","last_change":"2024-09-12T02:41:52.775195+0000","last_active":"2024-09-12T02:41:52.775386+0000","last_peered":"2024-09-12T02:41:52.775386+0000","last_clean":"2024-09-12T02:41:52.775386+0000","last_became_active":"2024-09-12T02:41:52.774945+0000","last_became_peered":"2024-09-12T02:41:52.774945+0000","last_unstale":"2024-09-12T02:41:52.775386+0000","last_undegraded":"2024-09-12T02:41:52.775386+0000","last_fullsized":"2024-09-12T02:41:52.775386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:28.277557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.774385+0000","last_change":"2024-09-12T02:41:52.774385+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.774385+0000","last_undegraded":"2024-09-12T02:41:52.774385+0000","last_fullsized":"2024-09-12T02:41:52.774385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.782026+0000","last_change":"2024-09-12T02:41:52.781866+0000","last_active":"2024-09-12T02:41:52.782026+0000","last_peered":"2024-09-12T02:41:52.782026+0000","last_clean":"2024-09-12T02:41:52.782026+0000","last_became_active":"2024-09-12T02:41:52.781637+0000","last_became_peered":"2024-09-12T02:41:52.781637+0000","last_unstale":"2024-09-12T02:41:52.782026+0000","last_undegraded":"2024-09-12T02:41:52.782026+0000","last_fullsized":"2024-09-12T02:41:52.782026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:24:19.602570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.770812+0000","last_change":"2024-09-12T02:41:52.770812+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.770812+0000","last_undegraded":"2024-09-12T02:41:52.770812+0000","last_fullsized":"2024-09-12T02:41:52.770812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":166,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.774715+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:41:52.774715+0000","last_peered":"2024-09-12T02:41:52.774715+0000","last_clean":"2024-09-12T02:41:52.774715+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:41:52.774715+0000","last_undegraded":"2024-09-12T02:41:52.774715+0000","last_fullsized":"2024-09-12T02:41:52.774715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:45.426902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.783229+0000","last_change":"2024-09-12T02:41:52.783100+0000","last_active":"2024-09-12T02:41:52.783229+0000","last_peered":"2024-09-12T02:41:52.783229+0000","last_clean":"2024-09-12T02:41:52.783229+0000","last_became_active":"2024-09-12T02:41:52.782739+0000","last_became_peered":"2024-09-12T02:41:52.782739+0000","last_unstale":"2024-09-12T02:41:52.783229+0000","last_undegraded":"2024-09-12T02:41:52.783229+0000","last_fullsized":"2024-09-12T02:41:52.783229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:08.678911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.764047+0000","last_change":"2024-09-12T02:41:52.764047+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.764047+0000","last_undegraded":"2024-09-12T02:41:52.764047+0000","last_fullsized":"2024-09-12T02:41:52.764047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.783259+0000","last_change":"2024-09-12T02:41:52.781604+0000","last_active":"2024-09-12T02:41:52.783259+0000","last_peered":"2024-09-12T02:41:52.783259+0000","last_clean":"2024-09-12T02:41:52.783259+0000","last_became_active":"2024-09-12T02:41:52.780183+0000","last_became_peered":"2024-09-12T02:41:52.780183+0000","last_unstale":"2024-09-12T02:41:52.783259+0000","last_undegraded":"2024-09-12T02:41:52.783259+0000","last_fullsized":"2024-09-12T02:41:52.783259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:17.051664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.768094+0000","last_change":"2024-09-12T02:41:52.768094+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.768094+0000","last_undegraded":"2024-09-12T02:41:52.768094+0000","last_fullsized":"2024-09-12T02:41:52.768094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.779495+0000","last_change":"2024-09-12T02:41:52.779295+0000","last_active":"2024-09-12T02:41:52.779495+0000","last_peered":"2024-09-12T02:41:52.779495+0000","last_clean":"2024-09-12T02:41:52.779495+0000","last_became_active":"2024-09-12T02:41:52.778794+0000","last_became_peered":"2024-09-12T02:41:52.778794+0000","last_unstale":"2024-09-12T02:41:52.779495+0000","last_undegraded":"2024-09-12T02:41:52.779495+0000","last_fullsized":"2024-09-12T02:41:52.779495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:38.532085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.769499+0000","last_change":"2024-09-12T02:41:52.769499+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.769499+0000","last_undegraded":"2024-09-12T02:41:52.769499+0000","last_fullsized":"2024-09-12T02:41:52.769499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.785685+0000","last_change":"2024-09-12T02:41:52.785347+0000","last_active":"2024-09-12T02:41:52.785685+0000","last_peered":"2024-09-12T02:41:52.785685+0000","last_clean":"2024-09-12T02:41:52.785685+0000","last_became_active":"2024-09-12T02:41:52.784154+0000","last_became_peered":"2024-09-12T02:41:52.784154+0000","last_unstale":"2024-09-12T02:41:52.785685+0000","last_undegraded":"2024-09-12T02:41:52.785685+0000","last_fullsized":"2024-09-12T02:41:52.785685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:25.057313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.770604+0000","last_change":"2024-09-12T02:41:52.770604+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.770604+0000","last_undegraded":"2024-09-12T02:41:52.770604+0000","last_fullsized":"2024-09-12T02:41:52.770604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.773633+0000","last_change":"2024-09-12T02:41:52.773305+0000","last_active":"2024-09-12T02:41:52.773633+0000","last_peered":"2024-09-12T02:41:52.773633+0000","last_clean":"2024-09-12T02:41:52.773633+0000","last_became_active":"2024-09-12T02:41:52.773009+0000","last_became_peered":"2024-09-12T02:41:52.773009+0000","last_unstale":"2024-09-12T02:41:52.773633+0000","last_undegraded":"2024-09-12T02:41:52.773633+0000","last_fullsized":"2024-09-12T02:41:52.773633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:54.044389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.774193+0000","last_change":"2024-09-12T02:41:52.774193+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.774193+0000","last_undegraded":"2024-09-12T02:41:52.774193+0000","last_fullsized":"2024-09-12T02:41:52.774193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.784168+0000","last_change":"2024-09-12T02:41:52.783557+0000","last_active":"2024-09-12T02:41:52.784168+0000","last_peered":"2024-09-12T02:41:52.784168+0000","last_clean":"2024-09-12T02:41:52.784168+0000","last_became_active":"2024-09-12T02:41:52.782015+0000","last_became_peered":"2024-09-12T02:41:52.782015+0000","last_unstale":"2024-09-12T02:41:52.784168+0000","last_undegraded":"2024-09-12T02:41:52.784168+0000","last_fullsized":"2024-09-12T02:41:52.784168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:25.040932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.768231+0000","last_change":"2024-09-12T02:41:52.768231+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.768231+0000","last_undegraded":"2024-09-12T02:41:52.768231+0000","last_fullsized":"2024-09-12T02:41:52.768231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.773349+0000","last_change":"2024-09-12T02:41:52.773054+0000","last_active":"2024-09-12T02:41:52.773349+0000","last_peered":"2024-09-12T02:41:52.773349+0000","last_clean":"2024-09-12T02:41:52.773349+0000","last_became_active":"2024-09-12T02:41:52.772715+0000","last_became_peered":"2024-09-12T02:41:52.772715+0000","last_unstale":"2024-09-12T02:41:52.773349+0000","last_undegraded":"2024-09-12T02:41:52.773349+0000","last_fullsized":"2024-09-12T02:41:52.773349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:58.092297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.766216+0000","last_change":"2024-09-12T02:41:52.766216+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.766216+0000","last_undegraded":"2024-09-12T02:41:52.766216+0000","last_fullsized":"2024-09-12T02:41:52.766216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.783080+0000","last_change":"2024-09-12T02:41:52.782851+0000","last_active":"2024-09-12T02:41:52.783080+0000","last_peered":"2024-09-12T02:41:52.783080+0000","last_clean":"2024-09-12T02:41:52.783080+0000","last_became_active":"2024-09-12T02:41:52.782365+0000","last_became_peered":"2024-09-12T02:41:52.782365+0000","last_unstale":"2024-09-12T02:41:52.783080+0000","last_undegraded":"2024-09-12T02:41:52.783080+0000","last_fullsized":"2024-09-12T02:41:52.783080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:47.756953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.768519+0000","last_change":"2024-09-12T02:41:52.768519+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.768519+0000","last_undegraded":"2024-09-12T02:41:52.768519+0000","last_fullsized":"2024-09-12T02:41:52.768519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.783655+0000","last_change":"2024-09-12T02:41:52.783151+0000","last_active":"2024-09-12T02:41:52.783655+0000","last_peered":"2024-09-12T02:41:52.783655+0000","last_clean":"2024-09-12T02:41:52.783655+0000","last_became_active":"2024-09-12T02:41:52.781789+0000","last_became_peered":"2024-09-12T02:41:52.781789+0000","last_unstale":"2024-09-12T02:41:52.783655+0000","last_undegraded":"2024-09-12T02:41:52.783655+0000","last_fullsized":"2024-09-12T02:41:52.783655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:48.615034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.768633+0000","last_change":"2024-09-12T02:41:52.768633+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.768633+0000","last_undegraded":"2024-09-12T02:41:52.768633+0000","last_fullsized":"2024-09-12T02:41:52.768633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.784830+0000","last_change":"2024-09-12T02:41:52.784747+0000","last_active":"2024-09-12T02:41:52.784830+0000","last_peered":"2024-09-12T02:41:52.784830+0000","last_clean":"2024-09-12T02:41:52.784830+0000","last_became_active":"2024-09-12T02:41:52.784558+0000","last_became_peered":"2024-09-12T02:41:52.784558+0000","last_unstale":"2024-09-12T02:41:52.784830+0000","last_undegraded":"2024-09-12T02:41:52.784830+0000","last_fullsized":"2024-09-12T02:41:52.784830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:20.657348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.764433+0000","last_change":"2024-09-12T02:41:52.764433+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.764433+0000","last_undegraded":"2024-09-12T02:41:52.764433+0000","last_fullsized":"2024-09-12T02:41:52.764433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.780756+0000","last_change":"2024-09-12T02:41:52.780636+0000","last_active":"2024-09-12T02:41:52.780756+0000","last_peered":"2024-09-12T02:41:52.780756+0000","last_clean":"2024-09-12T02:41:52.780756+0000","last_became_active":"2024-09-12T02:41:52.780347+0000","last_became_peered":"2024-09-12T02:41:52.780347+0000","last_unstale":"2024-09-12T02:41:52.780756+0000","last_undegraded":"2024-09-12T02:41:52.780756+0000","last_fullsized":"2024-09-12T02:41:52.780756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:27.321782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.764050+0000","last_change":"2024-09-12T02:41:52.764050+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.764050+0000","last_undegraded":"2024-09-12T02:41:52.764050+0000","last_fullsized":"2024-09-12T02:41:52.764050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.784083+0000","last_change":"2024-09-12T02:41:52.783869+0000","last_active":"2024-09-12T02:41:52.784083+0000","last_peered":"2024-09-12T02:41:52.784083+0000","last_clean":"2024-09-12T02:41:52.784083+0000","last_became_active":"2024-09-12T02:41:52.781705+0000","last_became_peered":"2024-09-12T02:41:52.781705+0000","last_unstale":"2024-09-12T02:41:52.784083+0000","last_undegraded":"2024-09-12T02:41:52.784083+0000","last_fullsized":"2024-09-12T02:41:52.784083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:30.106407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.766541+0000","last_change":"2024-09-12T02:41:52.766541+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.766541+0000","last_undegraded":"2024-09-12T02:41:52.766541+0000","last_fullsized":"2024-09-12T02:41:52.766541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.773244+0000","last_change":"2024-09-12T02:41:52.773244+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.773244+0000","last_undegraded":"2024-09-12T02:41:52.773244+0000","last_fullsized":"2024-09-12T02:41:52.773244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.785874+0000","last_change":"2024-09-12T02:41:52.785769+0000","last_active":"2024-09-12T02:41:52.785874+0000","last_peered":"2024-09-12T02:41:52.785874+0000","last_clean":"2024-09-12T02:41:52.785874+0000","last_became_active":"2024-09-12T02:41:52.785498+0000","last_became_peered":"2024-09-12T02:41:52.785498+0000","last_unstale":"2024-09-12T02:41:52.785874+0000","last_undegraded":"2024-09-12T02:41:52.785874+0000","last_fullsized":"2024-09-12T02:41:52.785874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:19.772196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.771241+0000","last_change":"2024-09-12T02:41:52.771241+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.771241+0000","last_undegraded":"2024-09-12T02:41:52.771241+0000","last_fullsized":"2024-09-12T02:41:52.771241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.784636+0000","last_change":"2024-09-12T02:41:52.784485+0000","last_active":"2024-09-12T02:41:52.784636+0000","last_peered":"2024-09-12T02:41:52.784636+0000","last_clean":"2024-09-12T02:41:52.784636+0000","last_became_active":"2024-09-12T02:41:52.784183+0000","last_became_peered":"2024-09-12T02:41:52.784183+0000","last_unstale":"2024-09-12T02:41:52.784636+0000","last_undegraded":"2024-09-12T02:41:52.784636+0000","last_fullsized":"2024-09-12T02:41:52.784636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:00.534944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.768907+0000","last_change":"2024-09-12T02:41:52.768907+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.768907+0000","last_undegraded":"2024-09-12T02:41:52.768907+0000","last_fullsized":"2024-09-12T02:41:52.768907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.779130+0000","last_change":"2024-09-12T02:41:52.778974+0000","last_active":"2024-09-12T02:41:52.779130+0000","last_peered":"2024-09-12T02:41:52.779130+0000","last_clean":"2024-09-12T02:41:52.779130+0000","last_became_active":"2024-09-12T02:41:52.775107+0000","last_became_peered":"2024-09-12T02:41:52.775107+0000","last_unstale":"2024-09-12T02:41:52.779130+0000","last_undegraded":"2024-09-12T02:41:52.779130+0000","last_fullsized":"2024-09-12T02:41:52.779130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:22.172662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.765250+0000","last_change":"2024-09-12T02:41:52.765250+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.765250+0000","last_undegraded":"2024-09-12T02:41:52.765250+0000","last_fullsized":"2024-09-12T02:41:52.765250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.778312+0000","last_change":"2024-09-12T02:41:52.778197+0000","last_active":"2024-09-12T02:41:52.778312+0000","last_peered":"2024-09-12T02:41:52.778312+0000","last_clean":"2024-09-12T02:41:52.778312+0000","last_became_active":"2024-09-12T02:41:52.777887+0000","last_became_peered":"2024-09-12T02:41:52.777887+0000","last_unstale":"2024-09-12T02:41:52.778312+0000","last_undegraded":"2024-09-12T02:41:52.778312+0000","last_fullsized":"2024-09-12T02:41:52.778312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:29.372288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358208,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358208,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:41:58.366 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:41:58.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.554+0000 7fba5b600640 1 Processor -- start 2024-09-12T02:41:58.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.554+0000 7fba5b600640 1 -- start start 2024-09-12T02:41:58.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.555+0000 7fba5b600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fba540b0db0 0x7fba5406bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:58.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.555+0000 7fba5b600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba54162900 con 0x7fba5415ec70 2024-09-12T02:41:58.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.555+0000 7fba5b600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba54162be0 con 0x7fba5406c110 2024-09-12T02:41:58.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.555+0000 7fba5b600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fba54162ec0 con 0x7fba540b0db0 2024-09-12T02:41:58.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.556+0000 7fba58c00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fba5415ec70 0x7fba54070a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:57844/0 (socket says 172.21.15.112:57844) 2024-09-12T02:41:58.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.556+0000 7fba58c00640 1 -- 172.21.15.112:0/1470754568 learned_addr learned my addr 172.21.15.112:0/1470754568 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:41:58.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.556+0000 7fba53e00640 1 -- 172.21.15.112:0/1470754568 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3499019393 0 0) 0x7fba54162900 con 0x7fba5415ec70 2024-09-12T02:41:58.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.556+0000 7fba53e00640 1 -- 172.21.15.112:0/1470754568 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba38003520 con 0x7fba5415ec70 2024-09-12T02:41:58.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.556+0000 7fba53e00640 1 -- 172.21.15.112:0/1470754568 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2119609569 0 0) 0x7fba54162be0 con 0x7fba5406c110 2024-09-12T02:41:58.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.556+0000 7fba53e00640 1 -- 172.21.15.112:0/1470754568 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba54162900 con 0x7fba5406c110 2024-09-12T02:41:58.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.556+0000 7fba4be00640 1 --2- 172.21.15.112:0/1470754568 >> v2:172.21.15.137:3300/0 conn(0x7fba540b0db0 0x7fba5406bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:58.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.556+0000 7fba53e00640 1 -- 172.21.15.112:0/1470754568 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2936290090 0 0) 0x7fba38003520 con 0x7fba5415ec70 2024-09-12T02:41:58.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.556+0000 7fba53e00640 1 -- 172.21.15.112:0/1470754568 >> v2:172.21.15.137:3300/0 conn(0x7fba540b0db0 msgr2=0x7fba5406bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:58.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.556+0000 7fba53e00640 1 --2- 172.21.15.112:0/1470754568 >> v2:172.21.15.137:3300/0 conn(0x7fba540b0db0 0x7fba5406bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:58.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.556+0000 7fba53e00640 1 -- 172.21.15.112:0/1470754568 >> v1:172.21.15.137:6789/0 conn(0x7fba5406c110 legacy=0x7fba540b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:58.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.556+0000 7fba53e00640 1 -- 172.21.15.112:0/1470754568 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba541631a0 con 0x7fba5415ec70 2024-09-12T02:41:58.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.556+0000 7fba53e00640 1 -- 172.21.15.112:0/1470754568 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7fba44001670 con 0x7fba5415ec70 2024-09-12T02:41:58.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.556+0000 7fba53e00640 1 -- 172.21.15.112:0/1470754568 >> v1:172.21.15.112:6789/0 conn(0x7fba5415ec70 legacy=0x7fba54070a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:58.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.557+0000 7fba53e00640 1 --2- 172.21.15.112:0/1470754568 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba38003b40 0x7fba38003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:58.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.557+0000 7fba53e00640 1 --2- 172.21.15.112:0/1470754568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba38004800 0x7fba38004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:58.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.557+0000 7fba53e00640 1 --2- 172.21.15.112:0/1470754568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba380052e0 0x7fba3800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:58.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.557+0000 7fba53e00640 1 -- 172.21.15.112:0/1470754568 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fba54162ec0 con 0x7fba38004800 2024-09-12T02:41:58.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.557+0000 7fba53e00640 1 -- 172.21.15.112:0/1470754568 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fba3800c1e0 con 0x7fba380052e0 2024-09-12T02:41:58.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.557+0000 7fba53e00640 1 -- 172.21.15.112:0/1470754568 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fba3800c3e0 con 0x7fba38003b40 2024-09-12T02:41:58.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.557+0000 7fba4be00640 1 --2- 172.21.15.112:0/1470754568 >> v2:172.21.15.137:3300/0 conn(0x7fba540b0db0 0x7fba5406bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:41:58.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.557+0000 7fba4be00640 1 --2- 172.21.15.112:0/1470754568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba38004800 0x7fba38004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:58.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.557+0000 7fba58c00640 1 --2- 172.21.15.112:0/1470754568 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba38003b40 0x7fba38003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:58.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.557+0000 7fba4be00640 1 -- 172.21.15.112:0/1470754568 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba38003b40 msgr2=0x7fba38003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:58.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.557+0000 7fba4be00640 1 --2- 172.21.15.112:0/1470754568 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba38003b40 0x7fba38003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:58.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.557+0000 7fba4be00640 1 -- 172.21.15.112:0/1470754568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba380052e0 msgr2=0x7fba3800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:58.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.557+0000 7fba4be00640 1 --2- 172.21.15.112:0/1470754568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba380052e0 0x7fba3800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:58.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.557+0000 7fba4be00640 1 -- 172.21.15.112:0/1470754568 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba38003520 con 0x7fba38004800 2024-09-12T02:41:58.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.557+0000 7fba59600640 1 -- 172.21.15.112:0/1470754568 reap_dead start 2024-09-12T02:41:58.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.558+0000 7fba4be00640 1 --2- 172.21.15.112:0/1470754568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba38004800 0x7fba38004c80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fba3c00aa40 tx=0x7fba38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd01346d806be02 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:58.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.558+0000 7fba53e00640 1 -- 172.21.15.112:0/1470754568 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c00a640 con 0x7fba38004800 2024-09-12T02:41:58.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.558+0000 7fba53e00640 1 -- 172.21.15.112:0/1470754568 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba3c02abf0 con 0x7fba38004800 2024-09-12T02:41:58.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.558+0000 7fba53e00640 1 -- 172.21.15.112:0/1470754568 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c004240 con 0x7fba38004800 2024-09-12T02:41:58.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.559+0000 7fba5b600640 1 -- 172.21.15.112:0/1470754568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba38004800 msgr2=0x7fba38004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:58.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.559+0000 7fba5b600640 1 --2- 172.21.15.112:0/1470754568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba38004800 0x7fba38004c80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fba3c00aa40 tx=0x7fba38005830 comp rx=0 tx=0).stop 2024-09-12T02:41:58.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.559+0000 7fba5b600640 1 -- 172.21.15.112:0/1470754568 shutdown_connections 2024-09-12T02:41:58.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.559+0000 7fba5b600640 1 --2- 172.21.15.112:0/1470754568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba38004800 0x7fba38004c80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:58.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.559+0000 7fba5b600640 1 -- 172.21.15.112:0/1470754568 >> 172.21.15.112:0/1470754568 conn(0x7fba5406cce0 msgr2=0x7fba5406d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:58.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.559+0000 7fba5b600640 1 -- 172.21.15.112:0/1470754568 shutdown_connections 2024-09-12T02:41:58.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.559+0000 7fba5b600640 1 -- 172.21.15.112:0/1470754568 wait complete. 2024-09-12T02:41:58.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.561+0000 7fba5b600640 1 Processor -- start 2024-09-12T02:41:58.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.561+0000 7fba5b600640 1 -- start start 2024-09-12T02:41:58.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.562+0000 7fba5b600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba38004800 0x7fba54160570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:58.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.562+0000 7fba5b600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba541505c0 0x7fba5415c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:58.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.562+0000 7fba5b600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba5414f750 0x7fba540b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:58.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.562+0000 7fba5b600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fba5415f050 con 0x7fba541505c0 2024-09-12T02:41:58.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.562+0000 7fba5b600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fba5406f530 con 0x7fba38004800 2024-09-12T02:41:58.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.562+0000 7fba5b600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fba5415f1d0 con 0x7fba5414f750 2024-09-12T02:41:58.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.562+0000 7fba4be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba541505c0 0x7fba5415c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:58.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.562+0000 7fba4be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba541505c0 0x7fba5415c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38880/0 (socket says 172.21.15.112:38880) 2024-09-12T02:41:58.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.562+0000 7fba4be00640 1 -- 172.21.15.112:0/3677020857 learned_addr learned my addr 172.21.15.112:0/3677020857 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:58.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.562+0000 7fba4be00640 1 -- 172.21.15.112:0/3677020857 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba5414f750 msgr2=0x7fba540b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:58.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.562+0000 7fba4be00640 1 --2- 172.21.15.112:0/3677020857 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba5414f750 0x7fba540b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:58.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.562+0000 7fba4be00640 1 -- 172.21.15.112:0/3677020857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba38004800 msgr2=0x7fba54160570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:58.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.562+0000 7fba4be00640 1 --2- 172.21.15.112:0/3677020857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba38004800 0x7fba54160570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:58.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.562+0000 7fba4be00640 1 -- 172.21.15.112:0/3677020857 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba540cf3e0 con 0x7fba541505c0 2024-09-12T02:41:58.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.562+0000 7fba4be00640 1 --2- 172.21.15.112:0/3677020857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba541505c0 0x7fba5415c260 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fba3c00a120 tx=0x7fba3c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:58.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.563+0000 7fba51600640 1 -- 172.21.15.112:0/3677020857 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c041070 con 0x7fba541505c0 2024-09-12T02:41:58.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.563+0000 7fba51600640 1 -- 172.21.15.112:0/3677020857 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba3c03d650 con 0x7fba541505c0 2024-09-12T02:41:58.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.563+0000 7fba51600640 1 -- 172.21.15.112:0/3677020857 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c00a640 con 0x7fba541505c0 2024-09-12T02:41:58.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.563+0000 7fba5b600640 1 -- 172.21.15.112:0/3677020857 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba5415cb90 con 0x7fba541505c0 2024-09-12T02:41:58.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.563+0000 7fba5b600640 1 -- 172.21.15.112:0/3677020857 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba540cf680 con 0x7fba541505c0 2024-09-12T02:41:58.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.564+0000 7fba5b600640 1 -- 172.21.15.112:0/3677020857 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba54068a30 con 0x7fba541505c0 2024-09-12T02:41:58.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.565+0000 7fba51600640 1 -- 172.21.15.112:0/3677020857 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba3c044070 con 0x7fba541505c0 2024-09-12T02:41:58.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.565+0000 7fba51600640 1 --2- 172.21.15.112:0/3677020857 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fba3006be30 0x7fba3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:58.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.566+0000 7fba51600640 1 -- 172.21.15.112:0/3677020857 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fba3c0ab900 con 0x7fba541505c0 2024-09-12T02:41:58.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.566+0000 7fba58c00640 1 --2- 172.21.15.112:0/3677020857 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fba3006be30 0x7fba3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:58.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.566+0000 7fba58c00640 1 --2- 172.21.15.112:0/3677020857 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fba3006be30 0x7fba3006e2f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fba44001eb0 tx=0x7fba44001470 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:58.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.570+0000 7fba51600640 1 -- 172.21.15.112:0/3677020857 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fba3c07a220 con 0x7fba541505c0 2024-09-12T02:41:58.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.740+0000 7fba5b600640 1 -- 172.21.15.112:0/3677020857 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fba5406bbd0 con 0x7fba3006be30 2024-09-12T02:41:58.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.746+0000 7fba51600640 1 -- 172.21.15.112:0/3677020857 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242210 (secure 0 0 0) 0x7fba5406bbd0 con 0x7fba3006be30 2024-09-12T02:41:58.749 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:58.750 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:41:58.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.749+0000 7fba5b600640 1 -- 172.21.15.112:0/3677020857 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fba3006be30 msgr2=0x7fba3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:58.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.749+0000 7fba5b600640 1 --2- 172.21.15.112:0/3677020857 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fba3006be30 0x7fba3006e2f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fba44001eb0 tx=0x7fba44001470 comp rx=0 tx=0).stop 2024-09-12T02:41:58.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.749+0000 7fba5b600640 1 -- 172.21.15.112:0/3677020857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba541505c0 msgr2=0x7fba5415c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:58.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.749+0000 7fba5b600640 1 --2- 172.21.15.112:0/3677020857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba541505c0 0x7fba5415c260 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fba3c00a120 tx=0x7fba3c004730 comp rx=0 tx=0).stop 2024-09-12T02:41:58.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.750+0000 7fba5b600640 1 -- 172.21.15.112:0/3677020857 shutdown_connections 2024-09-12T02:41:58.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.750+0000 7fba5b600640 1 --2- 172.21.15.112:0/3677020857 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba5414f750 0x7fba540b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:58.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.750+0000 7fba5b600640 1 --2- 172.21.15.112:0/3677020857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba541505c0 0x7fba5415c260 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:58.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.750+0000 7fba5b600640 1 --2- 172.21.15.112:0/3677020857 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fba3006be30 0x7fba3006e2f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:58.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.750+0000 7fba5b600640 1 --2- 172.21.15.112:0/3677020857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba38004800 0x7fba54160570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:58.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.750+0000 7fba5b600640 1 -- 172.21.15.112:0/3677020857 >> 172.21.15.112:0/3677020857 conn(0x7fba5406cce0 msgr2=0x7fba540af8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:58.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.750+0000 7fba5b600640 1 -- 172.21.15.112:0/3677020857 shutdown_connections 2024-09-12T02:41:58.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.750+0000 7fba5b600640 1 -- 172.21.15.112:0/3677020857 wait complete. 2024-09-12T02:41:58.754 INFO:tasks.ceph.mds.b.smithi137.stderr:2024-09-12T02:41:58.751+0000 7fc99fc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:41:58.766 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-12T02:41:56.959331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1554,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560945,"statfs":{"total":1600000000,"available":1598407872,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.201111"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.772872+0000","last_change":"2024-09-12T02:41:52.772872+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.772872+0000","last_undegraded":"2024-09-12T02:41:52.772872+0000","last_fullsized":"2024-09-12T02:41:52.772872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.771785+0000","last_change":"2024-09-12T02:41:52.771785+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.771785+0000","last_undegraded":"2024-09-12T02:41:52.771785+0000","last_fullsized":"2024-09-12T02:41:52.771785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.772082+0000","last_change":"2024-09-12T02:41:52.772082+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.772082+0000","last_undegraded":"2024-09-12T02:41:52.772082+0000","last_fullsized":"2024-09-12T02:41:52.772082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.778628+0000","last_change":"2024-09-12T02:41:52.778628+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.778628+0000","last_undegraded":"2024-09-12T02:41:52.778628+0000","last_fullsized":"2024-09-12T02:41:52.778628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.779745+0000","last_change":"2024-09-12T02:41:52.779745+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.779745+0000","last_undegraded":"2024-09-12T02:41:52.779745+0000","last_fullsized":"2024-09-12T02:41:52.779745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.774860+0000","last_change":"2024-09-12T02:41:52.774860+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.774860+0000","last_undegraded":"2024-09-12T02:41:52.774860+0000","last_fullsized":"2024-09-12T02:41:52.774860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.780128+0000","last_change":"2024-09-12T02:41:52.780128+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.780128+0000","last_undegraded":"2024-09-12T02:41:52.780128+0000","last_fullsized":"2024-09-12T02:41:52.780128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.773665+0000","last_change":"2024-09-12T02:41:52.773665+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.773665+0000","last_undegraded":"2024-09-12T02:41:52.773665+0000","last_fullsized":"2024-09-12T02:41:52.773665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.769397+0000","last_change":"2024-09-12T02:41:52.769397+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.769397+0000","last_undegraded":"2024-09-12T02:41:52.769397+0000","last_fullsized":"2024-09-12T02:41:52.769397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.770167+0000","last_change":"2024-09-12T02:41:52.770167+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.770167+0000","last_undegraded":"2024-09-12T02:41:52.770167+0000","last_fullsized":"2024-09-12T02:41:52.770167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.765916+0000","last_change":"2024-09-12T02:41:52.765916+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.765916+0000","last_undegraded":"2024-09-12T02:41:52.765916+0000","last_fullsized":"2024-09-12T02:41:52.765916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.771228+0000","last_change":"2024-09-12T02:41:52.771228+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.771228+0000","last_undegraded":"2024-09-12T02:41:52.771228+0000","last_fullsized":"2024-09-12T02:41:52.771228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.773234+0000","last_change":"2024-09-12T02:41:52.773234+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.773234+0000","last_undegraded":"2024-09-12T02:41:52.773234+0000","last_fullsized":"2024-09-12T02:41:52.773234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.770779+0000","last_change":"2024-09-12T02:41:52.770779+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.770779+0000","last_undegraded":"2024-09-12T02:41:52.770779+0000","last_fullsized":"2024-09-12T02:41:52.770779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.770731+0000","last_change":"2024-09-12T02:41:52.770731+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.770731+0000","last_undegraded":"2024-09-12T02:41:52.770731+0000","last_fullsized":"2024-09-12T02:41:52.770731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.773809+0000","last_change":"2024-09-12T02:41:52.773809+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.773809+0000","last_undegraded":"2024-09-12T02:41:52.773809+0000","last_fullsized":"2024-09-12T02:41:52.773809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.778121+0000","last_change":"2024-09-12T02:41:52.778121+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.778121+0000","last_undegraded":"2024-09-12T02:41:52.778121+0000","last_fullsized":"2024-09-12T02:41:52.778121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.770518+0000","last_change":"2024-09-12T02:41:52.770518+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.770518+0000","last_undegraded":"2024-09-12T02:41:52.770518+0000","last_fullsized":"2024-09-12T02:41:52.770518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.768585+0000","last_change":"2024-09-12T02:41:52.768585+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.768585+0000","last_undegraded":"2024-09-12T02:41:52.768585+0000","last_fullsized":"2024-09-12T02:41:52.768585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.769698+0000","last_change":"2024-09-12T02:41:52.769698+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.769698+0000","last_undegraded":"2024-09-12T02:41:52.769698+0000","last_fullsized":"2024-09-12T02:41:52.769698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.770765+0000","last_change":"2024-09-12T02:41:52.770765+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.770765+0000","last_undegraded":"2024-09-12T02:41:52.770765+0000","last_fullsized":"2024-09-12T02:41:52.770765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.776284+0000","last_change":"2024-09-12T02:41:52.776284+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.776284+0000","last_undegraded":"2024-09-12T02:41:52.776284+0000","last_fullsized":"2024-09-12T02:41:52.776284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.769249+0000","last_change":"2024-09-12T02:41:52.769249+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.769249+0000","last_undegraded":"2024-09-12T02:41:52.769249+0000","last_fullsized":"2024-09-12T02:41:52.769249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.774508+0000","last_change":"2024-09-12T02:41:52.774508+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.774508+0000","last_undegraded":"2024-09-12T02:41:52.774508+0000","last_fullsized":"2024-09-12T02:41:52.774508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.767032+0000","last_change":"2024-09-12T02:41:52.767032+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.767032+0000","last_undegraded":"2024-09-12T02:41:52.767032+0000","last_fullsized":"2024-09-12T02:41:52.767032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.765221+0000","last_change":"2024-09-12T02:41:52.765221+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.765221+0000","last_undegraded":"2024-09-12T02:41:52.765221+0000","last_fullsized":"2024-09-12T02:41:52.765221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.770451+0000","last_change":"2024-09-12T02:41:52.770451+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.770451+0000","last_undegraded":"2024-09-12T02:41:52.770451+0000","last_fullsized":"2024-09-12T02:41:52.770451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.767650+0000","last_change":"2024-09-12T02:41:52.767650+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.767650+0000","last_undegraded":"2024-09-12T02:41:52.767650+0000","last_fullsized":"2024-09-12T02:41:52.767650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.767919+0000","last_change":"2024-09-12T02:41:52.767919+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.767919+0000","last_undegraded":"2024-09-12T02:41:52.767919+0000","last_fullsized":"2024-09-12T02:41:52.767919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.773554+0000","last_change":"2024-09-12T02:41:52.773554+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.773554+0000","last_undegraded":"2024-09-12T02:41:52.773554+0000","last_fullsized":"2024-09-12T02:41:52.773554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.770154+0000","last_change":"2024-09-12T02:41:52.770154+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.770154+0000","last_undegraded":"2024-09-12T02:41:52.770154+0000","last_fullsized":"2024-09-12T02:41:52.770154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.765492+0000","last_change":"2024-09-12T02:41:52.765492+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.765492+0000","last_undegraded":"2024-09-12T02:41:52.765492+0000","last_fullsized":"2024-09-12T02:41:52.765492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.772768+0000","last_change":"2024-09-12T02:41:52.772768+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.772768+0000","last_undegraded":"2024-09-12T02:41:52.772768+0000","last_fullsized":"2024-09-12T02:41:52.772768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.782851+0000","last_change":"2024-09-12T02:41:52.782761+0000","last_active":"2024-09-12T02:41:52.782851+0000","last_peered":"2024-09-12T02:41:52.782851+0000","last_clean":"2024-09-12T02:41:52.782851+0000","last_became_active":"2024-09-12T02:41:52.782565+0000","last_became_peered":"2024-09-12T02:41:52.782565+0000","last_unstale":"2024-09-12T02:41:52.782851+0000","last_undegraded":"2024-09-12T02:41:52.782851+0000","last_fullsized":"2024-09-12T02:41:52.782851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:21.343297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.771460+0000","last_change":"2024-09-12T02:41:52.771460+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.771460+0000","last_undegraded":"2024-09-12T02:41:52.771460+0000","last_fullsized":"2024-09-12T02:41:52.771460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.775855+0000","last_change":"2024-09-12T02:41:52.775582+0000","last_active":"2024-09-12T02:41:52.775855+0000","last_peered":"2024-09-12T02:41:52.775855+0000","last_clean":"2024-09-12T02:41:52.775855+0000","last_became_active":"2024-09-12T02:41:52.774577+0000","last_became_peered":"2024-09-12T02:41:52.774577+0000","last_unstale":"2024-09-12T02:41:52.775855+0000","last_undegraded":"2024-09-12T02:41:52.775855+0000","last_fullsized":"2024-09-12T02:41:52.775855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:53:29.920367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.777816+0000","last_change":"2024-09-12T02:41:52.777181+0000","last_active":"2024-09-12T02:41:52.777816+0000","last_peered":"2024-09-12T02:41:52.777816+0000","last_clean":"2024-09-12T02:41:52.777816+0000","last_became_active":"2024-09-12T02:41:52.773406+0000","last_became_peered":"2024-09-12T02:41:52.773406+0000","last_unstale":"2024-09-12T02:41:52.777816+0000","last_undegraded":"2024-09-12T02:41:52.777816+0000","last_fullsized":"2024-09-12T02:41:52.777816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:44.840934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.764493+0000","last_change":"2024-09-12T02:41:52.764493+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.764493+0000","last_undegraded":"2024-09-12T02:41:52.764493+0000","last_fullsized":"2024-09-12T02:41:52.764493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.783685+0000","last_change":"2024-09-12T02:41:52.783587+0000","last_active":"2024-09-12T02:41:52.783685+0000","last_peered":"2024-09-12T02:41:52.783685+0000","last_clean":"2024-09-12T02:41:52.783685+0000","last_became_active":"2024-09-12T02:41:52.783418+0000","last_became_peered":"2024-09-12T02:41:52.783418+0000","last_unstale":"2024-09-12T02:41:52.783685+0000","last_undegraded":"2024-09-12T02:41:52.783685+0000","last_fullsized":"2024-09-12T02:41:52.783685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:38.105451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.769795+0000","last_change":"2024-09-12T02:41:52.769795+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.769795+0000","last_undegraded":"2024-09-12T02:41:52.769795+0000","last_fullsized":"2024-09-12T02:41:52.769795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.771682+0000","last_change":"2024-09-12T02:41:52.771541+0000","last_active":"2024-09-12T02:41:52.771682+0000","last_peered":"2024-09-12T02:41:52.771682+0000","last_clean":"2024-09-12T02:41:52.771682+0000","last_became_active":"2024-09-12T02:41:52.770232+0000","last_became_peered":"2024-09-12T02:41:52.770232+0000","last_unstale":"2024-09-12T02:41:52.771682+0000","last_undegraded":"2024-09-12T02:41:52.771682+0000","last_fullsized":"2024-09-12T02:41:52.771682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:23.596130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.774780+0000","last_change":"2024-09-12T02:41:52.774780+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.774780+0000","last_undegraded":"2024-09-12T02:41:52.774780+0000","last_fullsized":"2024-09-12T02:41:52.774780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.781131+0000","last_change":"2024-09-12T02:41:52.780065+0000","last_active":"2024-09-12T02:41:52.781131+0000","last_peered":"2024-09-12T02:41:52.781131+0000","last_clean":"2024-09-12T02:41:52.781131+0000","last_became_active":"2024-09-12T02:41:52.778398+0000","last_became_peered":"2024-09-12T02:41:52.778398+0000","last_unstale":"2024-09-12T02:41:52.781131+0000","last_undegraded":"2024-09-12T02:41:52.781131+0000","last_fullsized":"2024-09-12T02:41:52.781131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:08.121527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.769057+0000","last_change":"2024-09-12T02:41:52.769057+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.769057+0000","last_undegraded":"2024-09-12T02:41:52.769057+0000","last_fullsized":"2024-09-12T02:41:52.769057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.781803+0000","last_change":"2024-09-12T02:41:52.781616+0000","last_active":"2024-09-12T02:41:52.781803+0000","last_peered":"2024-09-12T02:41:52.781803+0000","last_clean":"2024-09-12T02:41:52.781803+0000","last_became_active":"2024-09-12T02:41:52.781376+0000","last_became_peered":"2024-09-12T02:41:52.781376+0000","last_unstale":"2024-09-12T02:41:52.781803+0000","last_undegraded":"2024-09-12T02:41:52.781803+0000","last_fullsized":"2024-09-12T02:41:52.781803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:00.469462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.768691+0000","last_change":"2024-09-12T02:41:52.768691+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.768691+0000","last_undegraded":"2024-09-12T02:41:52.768691+0000","last_fullsized":"2024-09-12T02:41:52.768691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.777153+0000","last_change":"2024-09-12T02:41:52.776998+0000","last_active":"2024-09-12T02:41:52.777153+0000","last_peered":"2024-09-12T02:41:52.777153+0000","last_clean":"2024-09-12T02:41:52.777153+0000","last_became_active":"2024-09-12T02:41:52.776765+0000","last_became_peered":"2024-09-12T02:41:52.776765+0000","last_unstale":"2024-09-12T02:41:52.777153+0000","last_undegraded":"2024-09-12T02:41:52.777153+0000","last_fullsized":"2024-09-12T02:41:52.777153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:01.069788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.768818+0000","last_change":"2024-09-12T02:41:52.768818+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.768818+0000","last_undegraded":"2024-09-12T02:41:52.768818+0000","last_fullsized":"2024-09-12T02:41:52.768818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.770388+0000","last_change":"2024-09-12T02:41:52.770092+0000","last_active":"2024-09-12T02:41:52.770388+0000","last_peered":"2024-09-12T02:41:52.770388+0000","last_clean":"2024-09-12T02:41:52.770388+0000","last_became_active":"2024-09-12T02:41:52.769364+0000","last_became_peered":"2024-09-12T02:41:52.769364+0000","last_unstale":"2024-09-12T02:41:52.770388+0000","last_undegraded":"2024-09-12T02:41:52.770388+0000","last_fullsized":"2024-09-12T02:41:52.770388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:44.479987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.768113+0000","last_change":"2024-09-12T02:41:52.768113+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.768113+0000","last_undegraded":"2024-09-12T02:41:52.768113+0000","last_fullsized":"2024-09-12T02:41:52.768113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.781177+0000","last_change":"2024-09-12T02:41:52.780555+0000","last_active":"2024-09-12T02:41:52.781177+0000","last_peered":"2024-09-12T02:41:52.781177+0000","last_clean":"2024-09-12T02:41:52.781177+0000","last_became_active":"2024-09-12T02:41:52.775956+0000","last_became_peered":"2024-09-12T02:41:52.775956+0000","last_unstale":"2024-09-12T02:41:52.781177+0000","last_undegraded":"2024-09-12T02:41:52.781177+0000","last_fullsized":"2024-09-12T02:41:52.781177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:04.013565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.778885+0000","last_change":"2024-09-12T02:41:52.778885+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.778885+0000","last_undegraded":"2024-09-12T02:41:52.778885+0000","last_fullsized":"2024-09-12T02:41:52.778885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.768287+0000","last_change":"2024-09-12T02:41:52.766630+0000","last_active":"2024-09-12T02:41:52.768287+0000","last_peered":"2024-09-12T02:41:52.768287+0000","last_clean":"2024-09-12T02:41:52.768287+0000","last_became_active":"2024-09-12T02:41:52.766146+0000","last_became_peered":"2024-09-12T02:41:52.766146+0000","last_unstale":"2024-09-12T02:41:52.768287+0000","last_undegraded":"2024-09-12T02:41:52.768287+0000","last_fullsized":"2024-09-12T02:41:52.768287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:31.911620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.765006+0000","last_change":"2024-09-12T02:41:52.765006+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.765006+0000","last_undegraded":"2024-09-12T02:41:52.765006+0000","last_fullsized":"2024-09-12T02:41:52.765006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.775264+0000","last_change":"2024-09-12T02:41:52.775019+0000","last_active":"2024-09-12T02:41:52.775264+0000","last_peered":"2024-09-12T02:41:52.775264+0000","last_clean":"2024-09-12T02:41:52.775264+0000","last_became_active":"2024-09-12T02:41:52.774766+0000","last_became_peered":"2024-09-12T02:41:52.774766+0000","last_unstale":"2024-09-12T02:41:52.775264+0000","last_undegraded":"2024-09-12T02:41:52.775264+0000","last_fullsized":"2024-09-12T02:41:52.775264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:56.619672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.779664+0000","last_change":"2024-09-12T02:41:52.779664+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.779664+0000","last_undegraded":"2024-09-12T02:41:52.779664+0000","last_fullsized":"2024-09-12T02:41:52.779664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.770732+0000","last_change":"2024-09-12T02:41:52.767949+0000","last_active":"2024-09-12T02:41:52.770732+0000","last_peered":"2024-09-12T02:41:52.770732+0000","last_clean":"2024-09-12T02:41:52.770732+0000","last_became_active":"2024-09-12T02:41:52.767666+0000","last_became_peered":"2024-09-12T02:41:52.767666+0000","last_unstale":"2024-09-12T02:41:52.770732+0000","last_undegraded":"2024-09-12T02:41:52.770732+0000","last_fullsized":"2024-09-12T02:41:52.770732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:42.857208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.772623+0000","last_change":"2024-09-12T02:41:52.772623+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.772623+0000","last_undegraded":"2024-09-12T02:41:52.772623+0000","last_fullsized":"2024-09-12T02:41:52.772623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.776859+0000","last_change":"2024-09-12T02:41:52.776749+0000","last_active":"2024-09-12T02:41:52.776859+0000","last_peered":"2024-09-12T02:41:52.776859+0000","last_clean":"2024-09-12T02:41:52.776859+0000","last_became_active":"2024-09-12T02:41:52.776495+0000","last_became_peered":"2024-09-12T02:41:52.776495+0000","last_unstale":"2024-09-12T02:41:52.776859+0000","last_undegraded":"2024-09-12T02:41:52.776859+0000","last_fullsized":"2024-09-12T02:41:52.776859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:35.846538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.769033+0000","last_change":"2024-09-12T02:41:52.769033+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.769033+0000","last_undegraded":"2024-09-12T02:41:52.769033+0000","last_fullsized":"2024-09-12T02:41:52.769033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.775386+0000","last_change":"2024-09-12T02:41:52.775195+0000","last_active":"2024-09-12T02:41:52.775386+0000","last_peered":"2024-09-12T02:41:52.775386+0000","last_clean":"2024-09-12T02:41:52.775386+0000","last_became_active":"2024-09-12T02:41:52.774945+0000","last_became_peered":"2024-09-12T02:41:52.774945+0000","last_unstale":"2024-09-12T02:41:52.775386+0000","last_undegraded":"2024-09-12T02:41:52.775386+0000","last_fullsized":"2024-09-12T02:41:52.775386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:28.277557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.774385+0000","last_change":"2024-09-12T02:41:52.774385+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.774385+0000","last_undegraded":"2024-09-12T02:41:52.774385+0000","last_fullsized":"2024-09-12T02:41:52.774385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.782026+0000","last_change":"2024-09-12T02:41:52.781866+0000","last_active":"2024-09-12T02:41:52.782026+0000","last_peered":"2024-09-12T02:41:52.782026+0000","last_clean":"2024-09-12T02:41:52.782026+0000","last_became_active":"2024-09-12T02:41:52.781637+0000","last_became_peered":"2024-09-12T02:41:52.781637+0000","last_unstale":"2024-09-12T02:41:52.782026+0000","last_undegraded":"2024-09-12T02:41:52.782026+0000","last_fullsized":"2024-09-12T02:41:52.782026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:24:19.602570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.770812+0000","last_change":"2024-09-12T02:41:52.770812+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.770812+0000","last_undegraded":"2024-09-12T02:41:52.770812+0000","last_fullsized":"2024-09-12T02:41:52.770812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":166,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.774715+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:41:52.774715+0000","last_peered":"2024-09-12T02:41:52.774715+0000","last_clean":"2024-09-12T02:41:52.774715+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:41:52.774715+0000","last_undegraded":"2024-09-12T02:41:52.774715+0000","last_fullsized":"2024-09-12T02:41:52.774715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:45.426902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.783229+0000","last_change":"2024-09-12T02:41:52.783100+0000","last_active":"2024-09-12T02:41:52.783229+0000","last_peered":"2024-09-12T02:41:52.783229+0000","last_clean":"2024-09-12T02:41:52.783229+0000","last_became_active":"2024-09-12T02:41:52.782739+0000","last_became_peered":"2024-09-12T02:41:52.782739+0000","last_unstale":"2024-09-12T02:41:52.783229+0000","last_undegraded":"2024-09-12T02:41:52.783229+0000","last_fullsized":"2024-09-12T02:41:52.783229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:08.678911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.764047+0000","last_change":"2024-09-12T02:41:52.764047+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.764047+0000","last_undegraded":"2024-09-12T02:41:52.764047+0000","last_fullsized":"2024-09-12T02:41:52.764047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.783259+0000","last_change":"2024-09-12T02:41:52.781604+0000","last_active":"2024-09-12T02:41:52.783259+0000","last_peered":"2024-09-12T02:41:52.783259+0000","last_clean":"2024-09-12T02:41:52.783259+0000","last_became_active":"2024-09-12T02:41:52.780183+0000","last_became_peered":"2024-09-12T02:41:52.780183+0000","last_unstale":"2024-09-12T02:41:52.783259+0000","last_undegraded":"2024-09-12T02:41:52.783259+0000","last_fullsized":"2024-09-12T02:41:52.783259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:17.051664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.768094+0000","last_change":"2024-09-12T02:41:52.768094+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.768094+0000","last_undegraded":"2024-09-12T02:41:52.768094+0000","last_fullsized":"2024-09-12T02:41:52.768094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.779495+0000","last_change":"2024-09-12T02:41:52.779295+0000","last_active":"2024-09-12T02:41:52.779495+0000","last_peered":"2024-09-12T02:41:52.779495+0000","last_clean":"2024-09-12T02:41:52.779495+0000","last_became_active":"2024-09-12T02:41:52.778794+0000","last_became_peered":"2024-09-12T02:41:52.778794+0000","last_unstale":"2024-09-12T02:41:52.779495+0000","last_undegraded":"2024-09-12T02:41:52.779495+0000","last_fullsized":"2024-09-12T02:41:52.779495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:38.532085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.769499+0000","last_change":"2024-09-12T02:41:52.769499+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.769499+0000","last_undegraded":"2024-09-12T02:41:52.769499+0000","last_fullsized":"2024-09-12T02:41:52.769499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.785685+0000","last_change":"2024-09-12T02:41:52.785347+0000","last_active":"2024-09-12T02:41:52.785685+0000","last_peered":"2024-09-12T02:41:52.785685+0000","last_clean":"2024-09-12T02:41:52.785685+0000","last_became_active":"2024-09-12T02:41:52.784154+0000","last_became_peered":"2024-09-12T02:41:52.784154+0000","last_unstale":"2024-09-12T02:41:52.785685+0000","last_undegraded":"2024-09-12T02:41:52.785685+0000","last_fullsized":"2024-09-12T02:41:52.785685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:25.057313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.770604+0000","last_change":"2024-09-12T02:41:52.770604+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.770604+0000","last_undegraded":"2024-09-12T02:41:52.770604+0000","last_fullsized":"2024-09-12T02:41:52.770604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.773633+0000","last_change":"2024-09-12T02:41:52.773305+0000","last_active":"2024-09-12T02:41:52.773633+0000","last_peered":"2024-09-12T02:41:52.773633+0000","last_clean":"2024-09-12T02:41:52.773633+0000","last_became_active":"2024-09-12T02:41:52.773009+0000","last_became_peered":"2024-09-12T02:41:52.773009+0000","last_unstale":"2024-09-12T02:41:52.773633+0000","last_undegraded":"2024-09-12T02:41:52.773633+0000","last_fullsized":"2024-09-12T02:41:52.773633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:54.044389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.774193+0000","last_change":"2024-09-12T02:41:52.774193+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.774193+0000","last_undegraded":"2024-09-12T02:41:52.774193+0000","last_fullsized":"2024-09-12T02:41:52.774193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.784168+0000","last_change":"2024-09-12T02:41:52.783557+0000","last_active":"2024-09-12T02:41:52.784168+0000","last_peered":"2024-09-12T02:41:52.784168+0000","last_clean":"2024-09-12T02:41:52.784168+0000","last_became_active":"2024-09-12T02:41:52.782015+0000","last_became_peered":"2024-09-12T02:41:52.782015+0000","last_unstale":"2024-09-12T02:41:52.784168+0000","last_undegraded":"2024-09-12T02:41:52.784168+0000","last_fullsized":"2024-09-12T02:41:52.784168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:25.040932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.768231+0000","last_change":"2024-09-12T02:41:52.768231+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.768231+0000","last_undegraded":"2024-09-12T02:41:52.768231+0000","last_fullsized":"2024-09-12T02:41:52.768231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.773349+0000","last_change":"2024-09-12T02:41:52.773054+0000","last_active":"2024-09-12T02:41:52.773349+0000","last_peered":"2024-09-12T02:41:52.773349+0000","last_clean":"2024-09-12T02:41:52.773349+0000","last_became_active":"2024-09-12T02:41:52.772715+0000","last_became_peered":"2024-09-12T02:41:52.772715+0000","last_unstale":"2024-09-12T02:41:52.773349+0000","last_undegraded":"2024-09-12T02:41:52.773349+0000","last_fullsized":"2024-09-12T02:41:52.773349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:58.092297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.766216+0000","last_change":"2024-09-12T02:41:52.766216+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.766216+0000","last_undegraded":"2024-09-12T02:41:52.766216+0000","last_fullsized":"2024-09-12T02:41:52.766216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.783080+0000","last_change":"2024-09-12T02:41:52.782851+0000","last_active":"2024-09-12T02:41:52.783080+0000","last_peered":"2024-09-12T02:41:52.783080+0000","last_clean":"2024-09-12T02:41:52.783080+0000","last_became_active":"2024-09-12T02:41:52.782365+0000","last_became_peered":"2024-09-12T02:41:52.782365+0000","last_unstale":"2024-09-12T02:41:52.783080+0000","last_undegraded":"2024-09-12T02:41:52.783080+0000","last_fullsized":"2024-09-12T02:41:52.783080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:47.756953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.768519+0000","last_change":"2024-09-12T02:41:52.768519+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.768519+0000","last_undegraded":"2024-09-12T02:41:52.768519+0000","last_fullsized":"2024-09-12T02:41:52.768519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.783655+0000","last_change":"2024-09-12T02:41:52.783151+0000","last_active":"2024-09-12T02:41:52.783655+0000","last_peered":"2024-09-12T02:41:52.783655+0000","last_clean":"2024-09-12T02:41:52.783655+0000","last_became_active":"2024-09-12T02:41:52.781789+0000","last_became_peered":"2024-09-12T02:41:52.781789+0000","last_unstale":"2024-09-12T02:41:52.783655+0000","last_undegraded":"2024-09-12T02:41:52.783655+0000","last_fullsized":"2024-09-12T02:41:52.783655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:48.615034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.768633+0000","last_change":"2024-09-12T02:41:52.768633+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.768633+0000","last_undegraded":"2024-09-12T02:41:52.768633+0000","last_fullsized":"2024-09-12T02:41:52.768633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.784830+0000","last_change":"2024-09-12T02:41:52.784747+0000","last_active":"2024-09-12T02:41:52.784830+0000","last_peered":"2024-09-12T02:41:52.784830+0000","last_clean":"2024-09-12T02:41:52.784830+0000","last_became_active":"2024-09-12T02:41:52.784558+0000","last_became_peered":"2024-09-12T02:41:52.784558+0000","last_unstale":"2024-09-12T02:41:52.784830+0000","last_undegraded":"2024-09-12T02:41:52.784830+0000","last_fullsized":"2024-09-12T02:41:52.784830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:20.657348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.764433+0000","last_change":"2024-09-12T02:41:52.764433+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.764433+0000","last_undegraded":"2024-09-12T02:41:52.764433+0000","last_fullsized":"2024-09-12T02:41:52.764433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.780756+0000","last_change":"2024-09-12T02:41:52.780636+0000","last_active":"2024-09-12T02:41:52.780756+0000","last_peered":"2024-09-12T02:41:52.780756+0000","last_clean":"2024-09-12T02:41:52.780756+0000","last_became_active":"2024-09-12T02:41:52.780347+0000","last_became_peered":"2024-09-12T02:41:52.780347+0000","last_unstale":"2024-09-12T02:41:52.780756+0000","last_undegraded":"2024-09-12T02:41:52.780756+0000","last_fullsized":"2024-09-12T02:41:52.780756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:27.321782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.764050+0000","last_change":"2024-09-12T02:41:52.764050+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.764050+0000","last_undegraded":"2024-09-12T02:41:52.764050+0000","last_fullsized":"2024-09-12T02:41:52.764050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.784083+0000","last_change":"2024-09-12T02:41:52.783869+0000","last_active":"2024-09-12T02:41:52.784083+0000","last_peered":"2024-09-12T02:41:52.784083+0000","last_clean":"2024-09-12T02:41:52.784083+0000","last_became_active":"2024-09-12T02:41:52.781705+0000","last_became_peered":"2024-09-12T02:41:52.781705+0000","last_unstale":"2024-09-12T02:41:52.784083+0000","last_undegraded":"2024-09-12T02:41:52.784083+0000","last_fullsized":"2024-09-12T02:41:52.784083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:30.106407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.766541+0000","last_change":"2024-09-12T02:41:52.766541+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.766541+0000","last_undegraded":"2024-09-12T02:41:52.766541+0000","last_fullsized":"2024-09-12T02:41:52.766541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.773244+0000","last_change":"2024-09-12T02:41:52.773244+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.773244+0000","last_undegraded":"2024-09-12T02:41:52.773244+0000","last_fullsized":"2024-09-12T02:41:52.773244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.785874+0000","last_change":"2024-09-12T02:41:52.785769+0000","last_active":"2024-09-12T02:41:52.785874+0000","last_peered":"2024-09-12T02:41:52.785874+0000","last_clean":"2024-09-12T02:41:52.785874+0000","last_became_active":"2024-09-12T02:41:52.785498+0000","last_became_peered":"2024-09-12T02:41:52.785498+0000","last_unstale":"2024-09-12T02:41:52.785874+0000","last_undegraded":"2024-09-12T02:41:52.785874+0000","last_fullsized":"2024-09-12T02:41:52.785874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:19.772196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.771241+0000","last_change":"2024-09-12T02:41:52.771241+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.771241+0000","last_undegraded":"2024-09-12T02:41:52.771241+0000","last_fullsized":"2024-09-12T02:41:52.771241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.784636+0000","last_change":"2024-09-12T02:41:52.784485+0000","last_active":"2024-09-12T02:41:52.784636+0000","last_peered":"2024-09-12T02:41:52.784636+0000","last_clean":"2024-09-12T02:41:52.784636+0000","last_became_active":"2024-09-12T02:41:52.784183+0000","last_became_peered":"2024-09-12T02:41:52.784183+0000","last_unstale":"2024-09-12T02:41:52.784636+0000","last_undegraded":"2024-09-12T02:41:52.784636+0000","last_fullsized":"2024-09-12T02:41:52.784636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:00.534944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.768907+0000","last_change":"2024-09-12T02:41:52.768907+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.768907+0000","last_undegraded":"2024-09-12T02:41:52.768907+0000","last_fullsized":"2024-09-12T02:41:52.768907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.779130+0000","last_change":"2024-09-12T02:41:52.778974+0000","last_active":"2024-09-12T02:41:52.779130+0000","last_peered":"2024-09-12T02:41:52.779130+0000","last_clean":"2024-09-12T02:41:52.779130+0000","last_became_active":"2024-09-12T02:41:52.775107+0000","last_became_peered":"2024-09-12T02:41:52.775107+0000","last_unstale":"2024-09-12T02:41:52.779130+0000","last_undegraded":"2024-09-12T02:41:52.779130+0000","last_fullsized":"2024-09-12T02:41:52.779130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:22.172662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-12T02:41:52.765250+0000","last_change":"2024-09-12T02:41:52.765250+0000","last_active":"2024-09-12T02:41:52.757318+0000","last_peered":"2024-09-12T02:41:52.757318+0000","last_clean":"2024-09-12T02:41:52.757318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:41:52.765250+0000","last_undegraded":"2024-09-12T02:41:52.765250+0000","last_fullsized":"2024-09-12T02:41:52.765250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T02:41:52.778312+0000","last_change":"2024-09-12T02:41:52.778197+0000","last_active":"2024-09-12T02:41:52.778312+0000","last_peered":"2024-09-12T02:41:52.778312+0000","last_clean":"2024-09-12T02:41:52.778312+0000","last_became_active":"2024-09-12T02:41:52.777887+0000","last_became_peered":"2024-09-12T02:41:52.777887+0000","last_unstale":"2024-09-12T02:41:52.778312+0000","last_undegraded":"2024-09-12T02:41:52.778312+0000","last_fullsized":"2024-09-12T02:41:52.778312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:29.372288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358208,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358208,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:41:58.769 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3f is not active+clean 2024-09-12T02:41:58.769 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.772872+0000', 'last_change': '2024-09-12T02:41:52.772872+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.772872+0000', 'last_undegraded': '2024-09-12T02:41:52.772872+0000', 'last_fullsized': '2024-09-12T02:41:52.772872+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T02:41:58.770 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3e is not active+clean 2024-09-12T02:41:58.770 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.771785+0000', 'last_change': '2024-09-12T02:41:52.771785+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.771785+0000', 'last_undegraded': '2024-09-12T02:41:52.771785+0000', 'last_fullsized': '2024-09-12T02:41:52.771785+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T02:41:58.770 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3d is not active+clean 2024-09-12T02:41:58.770 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.772082+0000', 'last_change': '2024-09-12T02:41:52.772082+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.772082+0000', 'last_undegraded': '2024-09-12T02:41:52.772082+0000', 'last_fullsized': '2024-09-12T02:41:52.772082+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T02:41:58.770 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3c is not active+clean 2024-09-12T02:41:58.770 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.778628+0000', 'last_change': '2024-09-12T02:41:52.778628+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.778628+0000', 'last_undegraded': '2024-09-12T02:41:52.778628+0000', 'last_fullsized': '2024-09-12T02:41:52.778628+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T02:41:58.770 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3b is not active+clean 2024-09-12T02:41:58.770 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.779745+0000', 'last_change': '2024-09-12T02:41:52.779745+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.779745+0000', 'last_undegraded': '2024-09-12T02:41:52.779745+0000', 'last_fullsized': '2024-09-12T02:41:52.779745+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T02:41:58.770 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3a is not active+clean 2024-09-12T02:41:58.770 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.774860+0000', 'last_change': '2024-09-12T02:41:52.774860+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.774860+0000', 'last_undegraded': '2024-09-12T02:41:52.774860+0000', 'last_fullsized': '2024-09-12T02:41:52.774860+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T02:41:58.771 INFO:tasks.ceph.ceph_manager.ceph:PG 3.39 is not active+clean 2024-09-12T02:41:58.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.780128+0000', 'last_change': '2024-09-12T02:41:52.780128+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.780128+0000', 'last_undegraded': '2024-09-12T02:41:52.780128+0000', 'last_fullsized': '2024-09-12T02:41:52.780128+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T02:41:58.771 INFO:tasks.ceph.ceph_manager.ceph:PG 3.38 is not active+clean 2024-09-12T02:41:58.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.773665+0000', 'last_change': '2024-09-12T02:41:52.773665+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.773665+0000', 'last_undegraded': '2024-09-12T02:41:52.773665+0000', 'last_fullsized': '2024-09-12T02:41:52.773665+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:41:58.771 INFO:tasks.ceph.ceph_manager.ceph:PG 3.37 is not active+clean 2024-09-12T02:41:58.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.769397+0000', 'last_change': '2024-09-12T02:41:52.769397+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.769397+0000', 'last_undegraded': '2024-09-12T02:41:52.769397+0000', 'last_fullsized': '2024-09-12T02:41:52.769397+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T02:41:58.771 INFO:tasks.ceph.ceph_manager.ceph:PG 3.36 is not active+clean 2024-09-12T02:41:58.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.770167+0000', 'last_change': '2024-09-12T02:41:52.770167+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.770167+0000', 'last_undegraded': '2024-09-12T02:41:52.770167+0000', 'last_fullsized': '2024-09-12T02:41:52.770167+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T02:41:58.771 INFO:tasks.ceph.ceph_manager.ceph:PG 3.35 is not active+clean 2024-09-12T02:41:58.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.765916+0000', 'last_change': '2024-09-12T02:41:52.765916+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.765916+0000', 'last_undegraded': '2024-09-12T02:41:52.765916+0000', 'last_fullsized': '2024-09-12T02:41:52.765916+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T02:41:58.771 INFO:tasks.ceph.ceph_manager.ceph:PG 3.34 is not active+clean 2024-09-12T02:41:58.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.771228+0000', 'last_change': '2024-09-12T02:41:52.771228+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.771228+0000', 'last_undegraded': '2024-09-12T02:41:52.771228+0000', 'last_fullsized': '2024-09-12T02:41:52.771228+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T02:41:58.772 INFO:tasks.ceph.ceph_manager.ceph:PG 3.33 is not active+clean 2024-09-12T02:41:58.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.773234+0000', 'last_change': '2024-09-12T02:41:52.773234+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.773234+0000', 'last_undegraded': '2024-09-12T02:41:52.773234+0000', 'last_fullsized': '2024-09-12T02:41:52.773234+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:41:58.772 INFO:tasks.ceph.ceph_manager.ceph:PG 3.32 is not active+clean 2024-09-12T02:41:58.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.770779+0000', 'last_change': '2024-09-12T02:41:52.770779+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.770779+0000', 'last_undegraded': '2024-09-12T02:41:52.770779+0000', 'last_fullsized': '2024-09-12T02:41:52.770779+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T02:41:58.772 INFO:tasks.ceph.ceph_manager.ceph:PG 3.31 is not active+clean 2024-09-12T02:41:58.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.770731+0000', 'last_change': '2024-09-12T02:41:52.770731+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.770731+0000', 'last_undegraded': '2024-09-12T02:41:52.770731+0000', 'last_fullsized': '2024-09-12T02:41:52.770731+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T02:41:58.772 INFO:tasks.ceph.ceph_manager.ceph:PG 3.30 is not active+clean 2024-09-12T02:41:58.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.773809+0000', 'last_change': '2024-09-12T02:41:52.773809+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.773809+0000', 'last_undegraded': '2024-09-12T02:41:52.773809+0000', 'last_fullsized': '2024-09-12T02:41:52.773809+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T02:41:58.772 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2f is not active+clean 2024-09-12T02:41:58.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.778121+0000', 'last_change': '2024-09-12T02:41:52.778121+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.778121+0000', 'last_undegraded': '2024-09-12T02:41:52.778121+0000', 'last_fullsized': '2024-09-12T02:41:52.778121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T02:41:58.773 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2e is not active+clean 2024-09-12T02:41:58.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.770518+0000', 'last_change': '2024-09-12T02:41:52.770518+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.770518+0000', 'last_undegraded': '2024-09-12T02:41:52.770518+0000', 'last_fullsized': '2024-09-12T02:41:52.770518+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:41:58.773 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2d is not active+clean 2024-09-12T02:41:58.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.768585+0000', 'last_change': '2024-09-12T02:41:52.768585+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.768585+0000', 'last_undegraded': '2024-09-12T02:41:52.768585+0000', 'last_fullsized': '2024-09-12T02:41:52.768585+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T02:41:58.773 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2c is not active+clean 2024-09-12T02:41:58.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.769698+0000', 'last_change': '2024-09-12T02:41:52.769698+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.769698+0000', 'last_undegraded': '2024-09-12T02:41:52.769698+0000', 'last_fullsized': '2024-09-12T02:41:52.769698+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T02:41:58.773 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2b is not active+clean 2024-09-12T02:41:58.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.770765+0000', 'last_change': '2024-09-12T02:41:52.770765+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.770765+0000', 'last_undegraded': '2024-09-12T02:41:52.770765+0000', 'last_fullsized': '2024-09-12T02:41:52.770765+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T02:41:58.773 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2a is not active+clean 2024-09-12T02:41:58.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.776284+0000', 'last_change': '2024-09-12T02:41:52.776284+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.776284+0000', 'last_undegraded': '2024-09-12T02:41:52.776284+0000', 'last_fullsized': '2024-09-12T02:41:52.776284+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T02:41:58.774 INFO:tasks.ceph.ceph_manager.ceph:PG 3.29 is not active+clean 2024-09-12T02:41:58.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.769249+0000', 'last_change': '2024-09-12T02:41:52.769249+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.769249+0000', 'last_undegraded': '2024-09-12T02:41:52.769249+0000', 'last_fullsized': '2024-09-12T02:41:52.769249+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:41:58.774 INFO:tasks.ceph.ceph_manager.ceph:PG 3.28 is not active+clean 2024-09-12T02:41:58.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.774508+0000', 'last_change': '2024-09-12T02:41:52.774508+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.774508+0000', 'last_undegraded': '2024-09-12T02:41:52.774508+0000', 'last_fullsized': '2024-09-12T02:41:52.774508+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T02:41:58.774 INFO:tasks.ceph.ceph_manager.ceph:PG 3.27 is not active+clean 2024-09-12T02:41:58.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.767032+0000', 'last_change': '2024-09-12T02:41:52.767032+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.767032+0000', 'last_undegraded': '2024-09-12T02:41:52.767032+0000', 'last_fullsized': '2024-09-12T02:41:52.767032+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:41:58.774 INFO:tasks.ceph.ceph_manager.ceph:PG 3.26 is not active+clean 2024-09-12T02:41:58.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.765221+0000', 'last_change': '2024-09-12T02:41:52.765221+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.765221+0000', 'last_undegraded': '2024-09-12T02:41:52.765221+0000', 'last_fullsized': '2024-09-12T02:41:52.765221+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T02:41:58.774 INFO:tasks.ceph.ceph_manager.ceph:PG 3.25 is not active+clean 2024-09-12T02:41:58.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.770451+0000', 'last_change': '2024-09-12T02:41:52.770451+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.770451+0000', 'last_undegraded': '2024-09-12T02:41:52.770451+0000', 'last_fullsized': '2024-09-12T02:41:52.770451+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T02:41:58.774 INFO:tasks.ceph.ceph_manager.ceph:PG 3.24 is not active+clean 2024-09-12T02:41:58.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.767650+0000', 'last_change': '2024-09-12T02:41:52.767650+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.767650+0000', 'last_undegraded': '2024-09-12T02:41:52.767650+0000', 'last_fullsized': '2024-09-12T02:41:52.767650+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:41:58.775 INFO:tasks.ceph.ceph_manager.ceph:PG 3.23 is not active+clean 2024-09-12T02:41:58.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.767919+0000', 'last_change': '2024-09-12T02:41:52.767919+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.767919+0000', 'last_undegraded': '2024-09-12T02:41:52.767919+0000', 'last_fullsized': '2024-09-12T02:41:52.767919+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T02:41:58.775 INFO:tasks.ceph.ceph_manager.ceph:PG 3.22 is not active+clean 2024-09-12T02:41:58.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.773554+0000', 'last_change': '2024-09-12T02:41:52.773554+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.773554+0000', 'last_undegraded': '2024-09-12T02:41:52.773554+0000', 'last_fullsized': '2024-09-12T02:41:52.773554+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T02:41:58.775 INFO:tasks.ceph.ceph_manager.ceph:PG 3.21 is not active+clean 2024-09-12T02:41:58.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.770154+0000', 'last_change': '2024-09-12T02:41:52.770154+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.770154+0000', 'last_undegraded': '2024-09-12T02:41:52.770154+0000', 'last_fullsized': '2024-09-12T02:41:52.770154+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:41:58.775 INFO:tasks.ceph.ceph_manager.ceph:PG 3.20 is not active+clean 2024-09-12T02:41:58.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.765492+0000', 'last_change': '2024-09-12T02:41:52.765492+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.765492+0000', 'last_undegraded': '2024-09-12T02:41:52.765492+0000', 'last_fullsized': '2024-09-12T02:41:52.765492+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T02:41:58.775 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-09-12T02:41:58.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.772768+0000', 'last_change': '2024-09-12T02:41:52.772768+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.772768+0000', 'last_undegraded': '2024-09-12T02:41:52.772768+0000', 'last_fullsized': '2024-09-12T02:41:52.772768+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T02:41:58.776 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-09-12T02:41:58.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.771460+0000', 'last_change': '2024-09-12T02:41:52.771460+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.771460+0000', 'last_undegraded': '2024-09-12T02:41:52.771460+0000', 'last_fullsized': '2024-09-12T02:41:52.771460+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T02:41:58.776 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-09-12T02:41:58.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.764493+0000', 'last_change': '2024-09-12T02:41:52.764493+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.764493+0000', 'last_undegraded': '2024-09-12T02:41:52.764493+0000', 'last_fullsized': '2024-09-12T02:41:52.764493+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:41:58.776 INFO:tasks.ceph.ceph_manager.ceph:PG 3.19 is not active+clean 2024-09-12T02:41:58.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.769795+0000', 'last_change': '2024-09-12T02:41:52.769795+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.769795+0000', 'last_undegraded': '2024-09-12T02:41:52.769795+0000', 'last_fullsized': '2024-09-12T02:41:52.769795+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T02:41:58.776 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-09-12T02:41:58.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.774780+0000', 'last_change': '2024-09-12T02:41:52.774780+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.774780+0000', 'last_undegraded': '2024-09-12T02:41:52.774780+0000', 'last_fullsized': '2024-09-12T02:41:52.774780+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T02:41:58.776 INFO:tasks.ceph.ceph_manager.ceph:PG 3.17 is not active+clean 2024-09-12T02:41:58.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.769057+0000', 'last_change': '2024-09-12T02:41:52.769057+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.769057+0000', 'last_undegraded': '2024-09-12T02:41:52.769057+0000', 'last_fullsized': '2024-09-12T02:41:52.769057+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T02:41:58.776 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-09-12T02:41:58.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.768691+0000', 'last_change': '2024-09-12T02:41:52.768691+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.768691+0000', 'last_undegraded': '2024-09-12T02:41:52.768691+0000', 'last_fullsized': '2024-09-12T02:41:52.768691+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T02:41:58.776 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-09-12T02:41:58.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.768818+0000', 'last_change': '2024-09-12T02:41:52.768818+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.768818+0000', 'last_undegraded': '2024-09-12T02:41:52.768818+0000', 'last_fullsized': '2024-09-12T02:41:52.768818+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T02:41:58.777 INFO:tasks.ceph.ceph_manager.ceph:PG 3.12 is not active+clean 2024-09-12T02:41:58.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.768113+0000', 'last_change': '2024-09-12T02:41:52.768113+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.768113+0000', 'last_undegraded': '2024-09-12T02:41:52.768113+0000', 'last_fullsized': '2024-09-12T02:41:52.768113+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T02:41:58.777 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-09-12T02:41:58.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.778885+0000', 'last_change': '2024-09-12T02:41:52.778885+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.778885+0000', 'last_undegraded': '2024-09-12T02:41:52.778885+0000', 'last_fullsized': '2024-09-12T02:41:52.778885+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T02:41:58.777 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-09-12T02:41:58.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.765006+0000', 'last_change': '2024-09-12T02:41:52.765006+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.765006+0000', 'last_undegraded': '2024-09-12T02:41:52.765006+0000', 'last_fullsized': '2024-09-12T02:41:52.765006+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T02:41:58.777 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-09-12T02:41:58.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.779664+0000', 'last_change': '2024-09-12T02:41:52.779664+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.779664+0000', 'last_undegraded': '2024-09-12T02:41:52.779664+0000', 'last_fullsized': '2024-09-12T02:41:52.779664+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T02:41:58.777 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-12T02:41:58.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.772623+0000', 'last_change': '2024-09-12T02:41:52.772623+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.772623+0000', 'last_undegraded': '2024-09-12T02:41:52.772623+0000', 'last_fullsized': '2024-09-12T02:41:52.772623+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T02:41:58.777 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-09-12T02:41:58.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.769033+0000', 'last_change': '2024-09-12T02:41:52.769033+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.769033+0000', 'last_undegraded': '2024-09-12T02:41:52.769033+0000', 'last_fullsized': '2024-09-12T02:41:52.769033+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T02:41:58.778 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-09-12T02:41:58.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.774385+0000', 'last_change': '2024-09-12T02:41:52.774385+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.774385+0000', 'last_undegraded': '2024-09-12T02:41:52.774385+0000', 'last_fullsized': '2024-09-12T02:41:52.774385+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T02:41:58.778 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-09-12T02:41:58.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.770812+0000', 'last_change': '2024-09-12T02:41:52.770812+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.770812+0000', 'last_undegraded': '2024-09-12T02:41:52.770812+0000', 'last_fullsized': '2024-09-12T02:41:52.770812+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T02:41:58.778 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-09-12T02:41:58.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.764047+0000', 'last_change': '2024-09-12T02:41:52.764047+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.764047+0000', 'last_undegraded': '2024-09-12T02:41:52.764047+0000', 'last_fullsized': '2024-09-12T02:41:52.764047+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:41:58.778 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1 is not active+clean 2024-09-12T02:41:58.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.768094+0000', 'last_change': '2024-09-12T02:41:52.768094+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.768094+0000', 'last_undegraded': '2024-09-12T02:41:52.768094+0000', 'last_fullsized': '2024-09-12T02:41:52.768094+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T02:41:58.778 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-09-12T02:41:58.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.769499+0000', 'last_change': '2024-09-12T02:41:52.769499+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.769499+0000', 'last_undegraded': '2024-09-12T02:41:52.769499+0000', 'last_fullsized': '2024-09-12T02:41:52.769499+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T02:41:58.778 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-09-12T02:41:58.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.770604+0000', 'last_change': '2024-09-12T02:41:52.770604+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.770604+0000', 'last_undegraded': '2024-09-12T02:41:52.770604+0000', 'last_fullsized': '2024-09-12T02:41:52.770604+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T02:41:58.779 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-09-12T02:41:58.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.774193+0000', 'last_change': '2024-09-12T02:41:52.774193+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.774193+0000', 'last_undegraded': '2024-09-12T02:41:52.774193+0000', 'last_fullsized': '2024-09-12T02:41:52.774193+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T02:41:58.779 INFO:tasks.ceph.ceph_manager.ceph:PG 3.4 is not active+clean 2024-09-12T02:41:58.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.768231+0000', 'last_change': '2024-09-12T02:41:52.768231+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.768231+0000', 'last_undegraded': '2024-09-12T02:41:52.768231+0000', 'last_fullsized': '2024-09-12T02:41:52.768231+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T02:41:58.779 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-09-12T02:41:58.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.766216+0000', 'last_change': '2024-09-12T02:41:52.766216+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.766216+0000', 'last_undegraded': '2024-09-12T02:41:52.766216+0000', 'last_fullsized': '2024-09-12T02:41:52.766216+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:41:58.779 INFO:tasks.ceph.ceph_manager.ceph:PG 3.6 is not active+clean 2024-09-12T02:41:58.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.768519+0000', 'last_change': '2024-09-12T02:41:52.768519+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.768519+0000', 'last_undegraded': '2024-09-12T02:41:52.768519+0000', 'last_fullsized': '2024-09-12T02:41:52.768519+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T02:41:58.779 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-09-12T02:41:58.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.768633+0000', 'last_change': '2024-09-12T02:41:52.768633+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.768633+0000', 'last_undegraded': '2024-09-12T02:41:52.768633+0000', 'last_fullsized': '2024-09-12T02:41:52.768633+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T02:41:58.780 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-09-12T02:41:58.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.764433+0000', 'last_change': '2024-09-12T02:41:52.764433+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.764433+0000', 'last_undegraded': '2024-09-12T02:41:52.764433+0000', 'last_fullsized': '2024-09-12T02:41:52.764433+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:41:58.780 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-09-12T02:41:58.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.764050+0000', 'last_change': '2024-09-12T02:41:52.764050+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.764050+0000', 'last_undegraded': '2024-09-12T02:41:52.764050+0000', 'last_fullsized': '2024-09-12T02:41:52.764050+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:41:58.780 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-09-12T02:41:58.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.766541+0000', 'last_change': '2024-09-12T02:41:52.766541+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.766541+0000', 'last_undegraded': '2024-09-12T02:41:52.766541+0000', 'last_fullsized': '2024-09-12T02:41:52.766541+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T02:41:58.780 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-09-12T02:41:58.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.773244+0000', 'last_change': '2024-09-12T02:41:52.773244+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.773244+0000', 'last_undegraded': '2024-09-12T02:41:52.773244+0000', 'last_fullsized': '2024-09-12T02:41:52.773244+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T02:41:58.780 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-09-12T02:41:58.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.771241+0000', 'last_change': '2024-09-12T02:41:52.771241+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.771241+0000', 'last_undegraded': '2024-09-12T02:41:52.771241+0000', 'last_fullsized': '2024-09-12T02:41:52.771241+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T02:41:58.780 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1f is not active+clean 2024-09-12T02:41:58.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.768907+0000', 'last_change': '2024-09-12T02:41:52.768907+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.768907+0000', 'last_undegraded': '2024-09-12T02:41:52.768907+0000', 'last_fullsized': '2024-09-12T02:41:52.768907+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T02:41:58.781 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-09-12T02:41:58.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:41:52.765250+0000', 'last_change': '2024-09-12T02:41:52.765250+0000', 'last_active': '2024-09-12T02:41:52.757318+0000', 'last_peered': '2024-09-12T02:41:52.757318+0000', 'last_clean': '2024-09-12T02:41:52.757318+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:41:52.765250+0000', 'last_undegraded': '2024-09-12T02:41:52.765250+0000', 'last_fullsized': '2024-09-12T02:41:52.765250+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'last_clean_scrub_stamp': '2024-09-12T02:41:52.757318+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T02:41:58.781 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T02:41:58.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.958+0000 7f6fddc00640 1 Processor -- start 2024-09-12T02:41:58.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.958+0000 7f6fddc00640 1 -- start start 2024-09-12T02:41:58.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.959+0000 7f6fddc00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6fd8162a60 0x7f6fd8162e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:58.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.959+0000 7f6fddc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6fd8075680 0x7f6fd8147d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:58.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.959+0000 7f6fddc00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fd815f390 con 0x7f6fd81482c0 2024-09-12T02:41:58.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.959+0000 7f6fddc00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6fd80b46d0 con 0x7f6fd8162a60 2024-09-12T02:41:58.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.959+0000 7f6fddc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6fd80cd300 con 0x7f6fd8075680 2024-09-12T02:41:58.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.959+0000 7f6fce000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6fd8075680 0x7f6fd8147d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:58.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.959+0000 7f6fd6a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6fd8162a60 0x7f6fd8162e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:58.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.959+0000 7f6fce000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6fd8075680 0x7f6fd8147d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:49666/0 (socket says 172.21.15.112:49666) 2024-09-12T02:41:58.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.959+0000 7f6fce000640 1 -- 172.21.15.112:0/3762025359 learned_addr learned my addr 172.21.15.112:0/3762025359 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:58.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.960+0000 7f6fce000640 1 -- 172.21.15.112:0/3762025359 >> v2:172.21.15.137:3300/0 conn(0x7f6fd8162a60 msgr2=0x7f6fd8162e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:58.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.960+0000 7f6fce000640 1 --2- 172.21.15.112:0/3762025359 >> v2:172.21.15.137:3300/0 conn(0x7f6fd8162a60 0x7f6fd8162e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:58.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.960+0000 7f6fce000640 1 -- 172.21.15.112:0/3762025359 >> v1:172.21.15.137:6789/0 conn(0x7f6fd81482c0 legacy=0x7f6fd8073240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:58.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.960+0000 7f6fce000640 1 -- 172.21.15.112:0/3762025359 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd8163380 con 0x7f6fd8075680 2024-09-12T02:41:58.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.960+0000 7f6fd6a00640 1 --2- 172.21.15.112:0/3762025359 >> v2:172.21.15.137:3300/0 conn(0x7f6fd8162a60 0x7f6fd8162e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:41:58.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.961+0000 7f6fce000640 1 --2- 172.21.15.112:0/3762025359 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6fd8075680 0x7f6fd8147d80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0009870 tx=0x7f6fc002a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d35f727ef143f5c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:58.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.961+0000 7f6fd6000640 1 -- 172.21.15.112:0/3762025359 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0037070 con 0x7f6fd8075680 2024-09-12T02:41:58.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.961+0000 7f6fd6000640 1 -- 172.21.15.112:0/3762025359 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fc0032440 con 0x7f6fd8075680 2024-09-12T02:41:58.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.961+0000 7f6fd6000640 1 -- 172.21.15.112:0/3762025359 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0032810 con 0x7f6fd8075680 2024-09-12T02:41:58.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.962+0000 7f6fddc00640 1 -- 172.21.15.112:0/3762025359 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6fd8075680 msgr2=0x7f6fd8147d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:58.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.962+0000 7f6fddc00640 1 --2- 172.21.15.112:0/3762025359 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6fd8075680 0x7f6fd8147d80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0009870 tx=0x7f6fc002a1e0 comp rx=0 tx=0).stop 2024-09-12T02:41:58.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.962+0000 7f6fddc00640 1 -- 172.21.15.112:0/3762025359 shutdown_connections 2024-09-12T02:41:58.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.962+0000 7f6fddc00640 1 --2- 172.21.15.112:0/3762025359 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6fd8075680 0x7f6fd8147d80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:58.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.962+0000 7f6fddc00640 1 --2- 172.21.15.112:0/3762025359 >> v2:172.21.15.137:3300/0 conn(0x7f6fd8162a60 0x7f6fd8162e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:58.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.962+0000 7f6fddc00640 1 -- 172.21.15.112:0/3762025359 >> 172.21.15.112:0/3762025359 conn(0x7f6fd80b2e10 msgr2=0x7f6fd80b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:58.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.962+0000 7f6fddc00640 1 -- 172.21.15.112:0/3762025359 shutdown_connections 2024-09-12T02:41:58.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.962+0000 7f6fddc00640 1 -- 172.21.15.112:0/3762025359 wait complete. 2024-09-12T02:41:58.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.963+0000 7f6fddc00640 1 Processor -- start 2024-09-12T02:41:58.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.963+0000 7f6fddc00640 1 -- start start 2024-09-12T02:41:58.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.964+0000 7f6fddc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6fd8075680 0x7f6fd8147cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:58.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.964+0000 7f6fddc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6fd81482c0 0x7f6fd809ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:58.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.964+0000 7f6fddc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fd8162a60 0x7f6fd8160d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:58.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.964+0000 7f6fddc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd80ca630 con 0x7f6fd8162a60 2024-09-12T02:41:58.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.964+0000 7f6fddc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd80b43f0 con 0x7f6fd81482c0 2024-09-12T02:41:58.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.964+0000 7f6fddc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6fd80ca910 con 0x7f6fd8075680 2024-09-12T02:41:58.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.964+0000 7f6fd7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fd8162a60 0x7f6fd8160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:58.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.965+0000 7f6fd7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fd8162a60 0x7f6fd8160d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38896/0 (socket says 172.21.15.112:38896) 2024-09-12T02:41:58.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.965+0000 7f6fd7400640 1 -- 172.21.15.112:0/2281026092 learned_addr learned my addr 172.21.15.112:0/2281026092 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:58.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.965+0000 7f6fce000640 1 --2- 172.21.15.112:0/2281026092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6fd81482c0 0x7f6fd809ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:58.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.965+0000 7f6fd6a00640 1 --2- 172.21.15.112:0/2281026092 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6fd8075680 0x7f6fd8147cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:58.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.965+0000 7f6fd7400640 1 -- 172.21.15.112:0/2281026092 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6fd8075680 msgr2=0x7f6fd8147cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:58.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.965+0000 7f6fd7400640 1 --2- 172.21.15.112:0/2281026092 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6fd8075680 0x7f6fd8147cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:58.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.965+0000 7f6fd7400640 1 -- 172.21.15.112:0/2281026092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6fd81482c0 msgr2=0x7f6fd809ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:58.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.965+0000 7f6fd7400640 1 --2- 172.21.15.112:0/2281026092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6fd81482c0 0x7f6fd809ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:58.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.965+0000 7f6fd7400640 1 -- 172.21.15.112:0/2281026092 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd80af570 con 0x7f6fd8162a60 2024-09-12T02:41:58.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.965+0000 7f6fce000640 1 --2- 172.21.15.112:0/2281026092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6fd81482c0 0x7f6fd809ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:41:58.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.965+0000 7f6fd7400640 1 --2- 172.21.15.112:0/2281026092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fd8162a60 0x7f6fd8160d20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6fd000c7a0 tx=0x7f6fd000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:58.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.965+0000 7f6fcf400640 1 -- 172.21.15.112:0/2281026092 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0003b70 con 0x7f6fd8162a60 2024-09-12T02:41:58.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.966+0000 7f6fcf400640 1 -- 172.21.15.112:0/2281026092 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fd0003d30 con 0x7f6fd8162a60 2024-09-12T02:41:58.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.966+0000 7f6fcf400640 1 -- 172.21.15.112:0/2281026092 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd000aa90 con 0x7f6fd8162a60 2024-09-12T02:41:58.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.966+0000 7f6fddc00640 1 -- 172.21.15.112:0/2281026092 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fd80ae4d0 con 0x7f6fd8162a60 2024-09-12T02:41:58.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.966+0000 7f6fddc00640 1 -- 172.21.15.112:0/2281026092 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fd80aea90 con 0x7f6fd8162a60 2024-09-12T02:41:58.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.967+0000 7f6fddc00640 1 -- 172.21.15.112:0/2281026092 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fd8072080 con 0x7f6fd8162a60 2024-09-12T02:41:58.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.968+0000 7f6fcf400640 1 -- 172.21.15.112:0/2281026092 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6fd000ac30 con 0x7f6fd8162a60 2024-09-12T02:41:58.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.969+0000 7f6fcf400640 1 --2- 172.21.15.112:0/2281026092 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6fb406be30 0x7f6fb406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:58.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.969+0000 7f6fcf400640 1 -- 172.21.15.112:0/2281026092 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6fd008ad10 con 0x7f6fd8162a60 2024-09-12T02:41:58.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.969+0000 7f6fd6a00640 1 --2- 172.21.15.112:0/2281026092 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6fb406be30 0x7f6fb406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:58.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.970+0000 7f6fd6a00640 1 --2- 172.21.15.112:0/2281026092 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6fb406be30 0x7f6fb406e2f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8009560 tx=0x7f6fc8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:58.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:58.973+0000 7f6fcf400640 1 -- 172.21.15.112:0/2281026092 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6fd0090020 con 0x7f6fd8162a60 2024-09-12T02:41:59.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.209+0000 7f6fddc00640 1 -- 172.21.15.112:0/2281026092 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f6fd8162ee0 con 0x7f6fd8162a60 2024-09-12T02:41:59.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.210+0000 7f6fcf400640 1 -- 172.21.15.112:0/2281026092 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1068 (secure 0 0 0) 0x7f6fd0058fd0 con 0x7f6fd8162a60 2024-09-12T02:41:59.211 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:59.211 INFO:teuthology.orchestra.run.smithi112.stdout:{"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":23,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1726108902,"num_in_osds":8,"osd_in_since":1726108899,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":1592128,"bytes_avail":1598407872,"bytes_total":1600000000,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":8,"btime":"2024-09-12T02:41:56:806041+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4308}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-12T02:41:36.163286+0000","services":{}},"progress_events":{}} 2024-09-12T02:41:59.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.212+0000 7f6fddc00640 1 -- 172.21.15.112:0/2281026092 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6fb406be30 msgr2=0x7f6fb406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:59.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.212+0000 7f6fddc00640 1 --2- 172.21.15.112:0/2281026092 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6fb406be30 0x7f6fb406e2f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8009560 tx=0x7f6fc8009190 comp rx=0 tx=0).stop 2024-09-12T02:41:59.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.212+0000 7f6fddc00640 1 -- 172.21.15.112:0/2281026092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fd8162a60 msgr2=0x7f6fd8160d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:59.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.212+0000 7f6fddc00640 1 --2- 172.21.15.112:0/2281026092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fd8162a60 0x7f6fd8160d20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6fd000c7a0 tx=0x7f6fd000cc60 comp rx=0 tx=0).stop 2024-09-12T02:41:59.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.212+0000 7f6fddc00640 1 -- 172.21.15.112:0/2281026092 shutdown_connections 2024-09-12T02:41:59.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.212+0000 7f6fddc00640 1 --2- 172.21.15.112:0/2281026092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fd8162a60 0x7f6fd8160d20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:59.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.212+0000 7f6fddc00640 1 --2- 172.21.15.112:0/2281026092 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6fb406be30 0x7f6fb406e2f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:59.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.212+0000 7f6fddc00640 1 --2- 172.21.15.112:0/2281026092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6fd81482c0 0x7f6fd809ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:59.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.212+0000 7f6fddc00640 1 --2- 172.21.15.112:0/2281026092 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6fd8075680 0x7f6fd8147cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:59.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.212+0000 7f6fddc00640 1 -- 172.21.15.112:0/2281026092 >> 172.21.15.112:0/2281026092 conn(0x7f6fd80b2e10 msgr2=0x7f6fd80cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:59.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.212+0000 7f6fddc00640 1 -- 172.21.15.112:0/2281026092 shutdown_connections 2024-09-12T02:41:59.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.212+0000 7f6fddc00640 1 -- 172.21.15.112:0/2281026092 wait complete. 2024-09-12T02:41:59.228 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T02:41:59.228 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:41:59.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.379+0000 7f45ebc00640 1 Processor -- start 2024-09-12T02:41:59.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.379+0000 7f45ebc00640 1 -- start start 2024-09-12T02:41:59.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.381+0000 7f45ebc00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f45e415cc50 0x7f45e40732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:59.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.381+0000 7f45ebc00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f45e4071530 0x7f45e40af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:59.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.381+0000 7f45ebc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45e40719a0 0x7f45e40afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:59.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.381+0000 7f45ebc00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f45e415d030 con 0x7f45e415cc50 2024-09-12T02:41:59.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.381+0000 7f45ebc00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f45e40cf4c0 con 0x7f45e4071530 2024-09-12T02:41:59.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.381+0000 7f45ebc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f45e4073830 con 0x7f45e40719a0 2024-09-12T02:41:59.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.381+0000 7f45e9200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f45e415cc50 0x7f45e40732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:59.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.381+0000 7f45e9200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f45e415cc50 0x7f45e40732f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38900/0 (socket says 172.21.15.112:38900) 2024-09-12T02:41:59.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.381+0000 7f45e9200640 1 -- 172.21.15.112:0/3092216878 learned_addr learned my addr 172.21.15.112:0/3092216878 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:59.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.381+0000 7f45dbe00640 1 --2- 172.21.15.112:0/3092216878 >> v2:172.21.15.137:3300/0 conn(0x7f45e4071530 0x7f45e40af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:59.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.381+0000 7f45e9c00640 1 --2- 172.21.15.112:0/3092216878 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45e40719a0 0x7f45e40afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:59.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.381+0000 7f45e9200640 1 -- 172.21.15.112:0/3092216878 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45e40719a0 msgr2=0x7f45e40afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:59.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.381+0000 7f45e9200640 1 --2- 172.21.15.112:0/3092216878 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45e40719a0 0x7f45e40afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:59.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.381+0000 7f45e9200640 1 -- 172.21.15.112:0/3092216878 >> v2:172.21.15.137:3300/0 conn(0x7f45e4071530 msgr2=0x7f45e40af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:59.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.381+0000 7f45e9200640 1 --2- 172.21.15.112:0/3092216878 >> v2:172.21.15.137:3300/0 conn(0x7f45e4071530 0x7f45e40af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:59.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.381+0000 7f45e9200640 1 -- 172.21.15.112:0/3092216878 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e40ceeb0 con 0x7f45e415cc50 2024-09-12T02:41:59.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.382+0000 7f45e9200640 1 --2- 172.21.15.112:0/3092216878 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45e415cc50 0x7f45e40732f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f45e406fa40 tx=0x7f45d402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=851ea763aa86a15a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:59.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.383+0000 7f45e3e00640 1 -- 172.21.15.112:0/3092216878 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d4037070 con 0x7f45e415cc50 2024-09-12T02:41:59.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.383+0000 7f45e3e00640 1 -- 172.21.15.112:0/3092216878 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45d4032440 con 0x7f45e415cc50 2024-09-12T02:41:59.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.383+0000 7f45e3e00640 1 -- 172.21.15.112:0/3092216878 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d4032810 con 0x7f45e415cc50 2024-09-12T02:41:59.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.383+0000 7f45ebc00640 1 -- 172.21.15.112:0/3092216878 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45e415cc50 msgr2=0x7f45e40732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:59.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.383+0000 7f45ebc00640 1 --2- 172.21.15.112:0/3092216878 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45e415cc50 0x7f45e40732f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f45e406fa40 tx=0x7f45d402a140 comp rx=0 tx=0).stop 2024-09-12T02:41:59.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.383+0000 7f45ebc00640 1 -- 172.21.15.112:0/3092216878 shutdown_connections 2024-09-12T02:41:59.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.383+0000 7f45ebc00640 1 --2- 172.21.15.112:0/3092216878 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45e40719a0 0x7f45e40afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:59.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.383+0000 7f45ebc00640 1 --2- 172.21.15.112:0/3092216878 >> v2:172.21.15.137:3300/0 conn(0x7f45e4071530 0x7f45e40af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:59.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.383+0000 7f45ebc00640 1 --2- 172.21.15.112:0/3092216878 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45e415cc50 0x7f45e40732f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:59.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.383+0000 7f45ebc00640 1 -- 172.21.15.112:0/3092216878 >> 172.21.15.112:0/3092216878 conn(0x7f45e406bbd0 msgr2=0x7f45e406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:59.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.383+0000 7f45ebc00640 1 -- 172.21.15.112:0/3092216878 shutdown_connections 2024-09-12T02:41:59.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.383+0000 7f45ebc00640 1 -- 172.21.15.112:0/3092216878 wait complete. 2024-09-12T02:41:59.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.385+0000 7f45ebc00640 1 Processor -- start 2024-09-12T02:41:59.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.385+0000 7f45ebc00640 1 -- start start 2024-09-12T02:41:59.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.386+0000 7f45ebc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45e4071530 0x7f45e414cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:59.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.386+0000 7f45ebc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45e40719a0 0x7f45e414ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:59.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.386+0000 7f45ebc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45e415cc50 0x7f45e415f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:59.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.386+0000 7f45ebc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f45e40cf150 con 0x7f45e40719a0 2024-09-12T02:41:59.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.386+0000 7f45ebc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f45e406e5e0 con 0x7f45e4071530 2024-09-12T02:41:59.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.386+0000 7f45ebc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f45e406f510 con 0x7f45e415cc50 2024-09-12T02:41:59.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.386+0000 7f45dbe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45e40719a0 0x7f45e414ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:59.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.386+0000 7f45dbe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45e40719a0 0x7f45e414ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38906/0 (socket says 172.21.15.112:38906) 2024-09-12T02:41:59.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.386+0000 7f45dbe00640 1 -- 172.21.15.112:0/2429434913 learned_addr learned my addr 172.21.15.112:0/2429434913 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:41:59.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.386+0000 7f45e9200640 1 --2- 172.21.15.112:0/2429434913 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45e4071530 0x7f45e414cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:59.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.386+0000 7f45e9c00640 1 --2- 172.21.15.112:0/2429434913 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45e415cc50 0x7f45e415f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:59.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.386+0000 7f45dbe00640 1 -- 172.21.15.112:0/2429434913 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45e415cc50 msgr2=0x7f45e415f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:59.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.386+0000 7f45dbe00640 1 --2- 172.21.15.112:0/2429434913 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45e415cc50 0x7f45e415f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:59.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.386+0000 7f45dbe00640 1 -- 172.21.15.112:0/2429434913 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45e4071530 msgr2=0x7f45e414cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:59.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.386+0000 7f45dbe00640 1 --2- 172.21.15.112:0/2429434913 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45e4071530 0x7f45e414cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:59.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.386+0000 7f45dbe00640 1 -- 172.21.15.112:0/2429434913 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e41494f0 con 0x7f45e40719a0 2024-09-12T02:41:59.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.386+0000 7f45e9c00640 1 --2- 172.21.15.112:0/2429434913 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45e415cc50 0x7f45e415f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:41:59.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.387+0000 7f45dbe00640 1 --2- 172.21.15.112:0/2429434913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45e40719a0 0x7f45e414ad10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f45cc00e8a0 tx=0x7f45cc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:59.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.387+0000 7f45e1600640 1 -- 172.21.15.112:0/2429434913 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45cc005990 con 0x7f45e40719a0 2024-09-12T02:41:59.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.387+0000 7f45e1600640 1 -- 172.21.15.112:0/2429434913 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45cc005b30 con 0x7f45e40719a0 2024-09-12T02:41:59.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.387+0000 7f45ebc00640 1 -- 172.21.15.112:0/2429434913 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45e4160270 con 0x7f45e40719a0 2024-09-12T02:41:59.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.387+0000 7f45e1600640 1 -- 172.21.15.112:0/2429434913 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45cc00c940 con 0x7f45e40719a0 2024-09-12T02:41:59.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.387+0000 7f45ebc00640 1 -- 172.21.15.112:0/2429434913 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45e4160830 con 0x7f45e40719a0 2024-09-12T02:41:59.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.388+0000 7f45ebc00640 1 -- 172.21.15.112:0/2429434913 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45e4068a30 con 0x7f45e40719a0 2024-09-12T02:41:59.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.389+0000 7f45e1600640 1 -- 172.21.15.112:0/2429434913 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f45cc00cae0 con 0x7f45e40719a0 2024-09-12T02:41:59.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.390+0000 7f45e1600640 1 --2- 172.21.15.112:0/2429434913 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f45c006be30 0x7f45c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:59.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.390+0000 7f45e1600640 1 -- 172.21.15.112:0/2429434913 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f45cc08b630 con 0x7f45e40719a0 2024-09-12T02:41:59.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.391+0000 7f45e9200640 1 --2- 172.21.15.112:0/2429434913 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f45c006be30 0x7f45c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:59.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.391+0000 7f45e9200640 1 --2- 172.21.15.112:0/2429434913 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f45c006be30 0x7f45c006e2f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f45d4034000 tx=0x7f45d402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:59.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.395+0000 7f45e1600640 1 -- 172.21.15.112:0/2429434913 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f45e41494f0 con 0x7f45e40719a0 2024-09-12T02:41:59.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.565+0000 7f45ebc00640 1 -- 172.21.15.112:0/2429434913 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f45e406df60 con 0x7f45c006be30 2024-09-12T02:41:59.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.572+0000 7f45e1600640 1 -- 172.21.15.112:0/2429434913 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247484 (secure 0 0 0) 0x7f45d407e6d0 con 0x7f45c006be30 2024-09-12T02:41:59.575 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:41:59.577 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:41:59.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.576+0000 7f45ebc00640 1 -- 172.21.15.112:0/2429434913 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f45c006be30 msgr2=0x7f45c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:59.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.576+0000 7f45ebc00640 1 --2- 172.21.15.112:0/2429434913 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f45c006be30 0x7f45c006e2f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f45d4034000 tx=0x7f45d402e000 comp rx=0 tx=0).stop 2024-09-12T02:41:59.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.576+0000 7f45ebc00640 1 -- 172.21.15.112:0/2429434913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45e40719a0 msgr2=0x7f45e414ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:59.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.576+0000 7f45ebc00640 1 --2- 172.21.15.112:0/2429434913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45e40719a0 0x7f45e414ad10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f45cc00e8a0 tx=0x7f45cc00ed60 comp rx=0 tx=0).stop 2024-09-12T02:41:59.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.576+0000 7f45ebc00640 1 -- 172.21.15.112:0/2429434913 shutdown_connections 2024-09-12T02:41:59.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.576+0000 7f45ebc00640 1 --2- 172.21.15.112:0/2429434913 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45e415cc50 0x7f45e415f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:59.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.576+0000 7f45ebc00640 1 --2- 172.21.15.112:0/2429434913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45e40719a0 0x7f45e414ad10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:59.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.576+0000 7f45ebc00640 1 --2- 172.21.15.112:0/2429434913 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f45c006be30 0x7f45c006e2f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:59.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.576+0000 7f45ebc00640 1 --2- 172.21.15.112:0/2429434913 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45e4071530 0x7f45e414cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:59.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.576+0000 7f45ebc00640 1 -- 172.21.15.112:0/2429434913 >> 172.21.15.112:0/2429434913 conn(0x7f45e406bbd0 msgr2=0x7f45e406d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:59.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.576+0000 7f45ebc00640 1 -- 172.21.15.112:0/2429434913 shutdown_connections 2024-09-12T02:41:59.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:41:59.576+0000 7f45ebc00640 1 -- 172.21.15.112:0/2429434913 wait complete. 2024-09-12T02:41:59.592 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-12T02:41:58.959639+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560789,"statfs":{"total":1600000000,"available":1598248252,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.197883"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078585+0000","last_change":"2024-09-12T02:41:53.797392+0000","last_active":"2024-09-12T02:41:55.078585+0000","last_peered":"2024-09-12T02:41:55.078585+0000","last_clean":"2024-09-12T02:41:55.078585+0000","last_became_active":"2024-09-12T02:41:53.797125+0000","last_became_peered":"2024-09-12T02:41:53.797125+0000","last_unstale":"2024-09-12T02:41:55.078585+0000","last_undegraded":"2024-09-12T02:41:55.078585+0000","last_fullsized":"2024-09-12T02:41:55.078585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:13.937351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807042+0000","last_change":"2024-09-12T02:41:53.788184+0000","last_active":"2024-09-12T02:41:54.807042+0000","last_peered":"2024-09-12T02:41:54.807042+0000","last_clean":"2024-09-12T02:41:54.807042+0000","last_became_active":"2024-09-12T02:41:53.787657+0000","last_became_peered":"2024-09-12T02:41:53.787657+0000","last_unstale":"2024-09-12T02:41:54.807042+0000","last_undegraded":"2024-09-12T02:41:54.807042+0000","last_fullsized":"2024-09-12T02:41:54.807042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:00.508038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077174+0000","last_change":"2024-09-12T02:41:53.784382+0000","last_active":"2024-09-12T02:41:55.077174+0000","last_peered":"2024-09-12T02:41:55.077174+0000","last_clean":"2024-09-12T02:41:55.077174+0000","last_became_active":"2024-09-12T02:41:53.783794+0000","last_became_peered":"2024-09-12T02:41:53.783794+0000","last_unstale":"2024-09-12T02:41:55.077174+0000","last_undegraded":"2024-09-12T02:41:55.077174+0000","last_fullsized":"2024-09-12T02:41:55.077174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:39.931644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077555+0000","last_change":"2024-09-12T02:41:53.802556+0000","last_active":"2024-09-12T02:41:55.077555+0000","last_peered":"2024-09-12T02:41:55.077555+0000","last_clean":"2024-09-12T02:41:55.077555+0000","last_became_active":"2024-09-12T02:41:53.800988+0000","last_became_peered":"2024-09-12T02:41:53.800988+0000","last_unstale":"2024-09-12T02:41:55.077555+0000","last_undegraded":"2024-09-12T02:41:55.077555+0000","last_fullsized":"2024-09-12T02:41:55.077555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:30.535176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078189+0000","last_change":"2024-09-12T02:41:53.797970+0000","last_active":"2024-09-12T02:41:55.078189+0000","last_peered":"2024-09-12T02:41:55.078189+0000","last_clean":"2024-09-12T02:41:55.078189+0000","last_became_active":"2024-09-12T02:41:53.797733+0000","last_became_peered":"2024-09-12T02:41:53.797733+0000","last_unstale":"2024-09-12T02:41:55.078189+0000","last_undegraded":"2024-09-12T02:41:55.078189+0000","last_fullsized":"2024-09-12T02:41:55.078189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:17.074361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077537+0000","last_change":"2024-09-12T02:41:53.791772+0000","last_active":"2024-09-12T02:41:55.077537+0000","last_peered":"2024-09-12T02:41:55.077537+0000","last_clean":"2024-09-12T02:41:55.077537+0000","last_became_active":"2024-09-12T02:41:53.791424+0000","last_became_peered":"2024-09-12T02:41:53.791424+0000","last_unstale":"2024-09-12T02:41:55.077537+0000","last_undegraded":"2024-09-12T02:41:55.077537+0000","last_fullsized":"2024-09-12T02:41:55.077537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:25.569705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077547+0000","last_change":"2024-09-12T02:41:53.793680+0000","last_active":"2024-09-12T02:41:55.077547+0000","last_peered":"2024-09-12T02:41:55.077547+0000","last_clean":"2024-09-12T02:41:55.077547+0000","last_became_active":"2024-09-12T02:41:53.793368+0000","last_became_peered":"2024-09-12T02:41:53.793368+0000","last_unstale":"2024-09-12T02:41:55.077547+0000","last_undegraded":"2024-09-12T02:41:55.077547+0000","last_fullsized":"2024-09-12T02:41:55.077547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:22.379829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778606+0000","last_change":"2024-09-12T02:41:53.792905+0000","last_active":"2024-09-12T02:41:54.778606+0000","last_peered":"2024-09-12T02:41:54.778606+0000","last_clean":"2024-09-12T02:41:54.778606+0000","last_became_active":"2024-09-12T02:41:53.792671+0000","last_became_peered":"2024-09-12T02:41:53.792671+0000","last_unstale":"2024-09-12T02:41:54.778606+0000","last_undegraded":"2024-09-12T02:41:54.778606+0000","last_fullsized":"2024-09-12T02:41:54.778606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:00:54.016660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077148+0000","last_change":"2024-09-12T02:41:53.796393+0000","last_active":"2024-09-12T02:41:55.077148+0000","last_peered":"2024-09-12T02:41:55.077148+0000","last_clean":"2024-09-12T02:41:55.077148+0000","last_became_active":"2024-09-12T02:41:53.793674+0000","last_became_peered":"2024-09-12T02:41:53.793674+0000","last_unstale":"2024-09-12T02:41:55.077148+0000","last_undegraded":"2024-09-12T02:41:55.077148+0000","last_fullsized":"2024-09-12T02:41:55.077148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:54.885587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778956+0000","last_change":"2024-09-12T02:41:53.790533+0000","last_active":"2024-09-12T02:41:54.778956+0000","last_peered":"2024-09-12T02:41:54.778956+0000","last_clean":"2024-09-12T02:41:54.778956+0000","last_became_active":"2024-09-12T02:41:53.790257+0000","last_became_peered":"2024-09-12T02:41:53.790257+0000","last_unstale":"2024-09-12T02:41:54.778956+0000","last_undegraded":"2024-09-12T02:41:54.778956+0000","last_fullsized":"2024-09-12T02:41:54.778956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:36.766374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778448+0000","last_change":"2024-09-12T02:41:53.791181+0000","last_active":"2024-09-12T02:41:54.778448+0000","last_peered":"2024-09-12T02:41:54.778448+0000","last_clean":"2024-09-12T02:41:54.778448+0000","last_became_active":"2024-09-12T02:41:53.790949+0000","last_became_peered":"2024-09-12T02:41:53.790949+0000","last_unstale":"2024-09-12T02:41:54.778448+0000","last_undegraded":"2024-09-12T02:41:54.778448+0000","last_fullsized":"2024-09-12T02:41:54.778448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:00.547705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.777369+0000","last_change":"2024-09-12T02:41:53.798287+0000","last_active":"2024-09-12T02:41:54.777369+0000","last_peered":"2024-09-12T02:41:54.777369+0000","last_clean":"2024-09-12T02:41:54.777369+0000","last_became_active":"2024-09-12T02:41:53.793517+0000","last_became_peered":"2024-09-12T02:41:53.793517+0000","last_unstale":"2024-09-12T02:41:54.777369+0000","last_undegraded":"2024-09-12T02:41:54.777369+0000","last_fullsized":"2024-09-12T02:41:54.777369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:38.907340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778829+0000","last_change":"2024-09-12T02:41:53.789083+0000","last_active":"2024-09-12T02:41:54.778829+0000","last_peered":"2024-09-12T02:41:54.778829+0000","last_clean":"2024-09-12T02:41:54.778829+0000","last_became_active":"2024-09-12T02:41:53.788859+0000","last_became_peered":"2024-09-12T02:41:53.788859+0000","last_unstale":"2024-09-12T02:41:54.778829+0000","last_undegraded":"2024-09-12T02:41:54.778829+0000","last_fullsized":"2024-09-12T02:41:54.778829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:11.768330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.076853+0000","last_change":"2024-09-12T02:41:53.786959+0000","last_active":"2024-09-12T02:41:55.076853+0000","last_peered":"2024-09-12T02:41:55.076853+0000","last_clean":"2024-09-12T02:41:55.076853+0000","last_became_active":"2024-09-12T02:41:53.786741+0000","last_became_peered":"2024-09-12T02:41:53.786741+0000","last_unstale":"2024-09-12T02:41:55.076853+0000","last_undegraded":"2024-09-12T02:41:55.076853+0000","last_fullsized":"2024-09-12T02:41:55.076853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:01.095924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807133+0000","last_change":"2024-09-12T02:41:53.790655+0000","last_active":"2024-09-12T02:41:54.807133+0000","last_peered":"2024-09-12T02:41:54.807133+0000","last_clean":"2024-09-12T02:41:54.807133+0000","last_became_active":"2024-09-12T02:41:53.789451+0000","last_became_peered":"2024-09-12T02:41:53.789451+0000","last_unstale":"2024-09-12T02:41:54.807133+0000","last_undegraded":"2024-09-12T02:41:54.807133+0000","last_fullsized":"2024-09-12T02:41:54.807133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:46.250242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077369+0000","last_change":"2024-09-12T02:41:53.787343+0000","last_active":"2024-09-12T02:41:55.077369+0000","last_peered":"2024-09-12T02:41:55.077369+0000","last_clean":"2024-09-12T02:41:55.077369+0000","last_became_active":"2024-09-12T02:41:53.787093+0000","last_became_peered":"2024-09-12T02:41:53.787093+0000","last_unstale":"2024-09-12T02:41:55.077369+0000","last_undegraded":"2024-09-12T02:41:55.077369+0000","last_fullsized":"2024-09-12T02:41:55.077369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:22.694954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077436+0000","last_change":"2024-09-12T02:41:53.799488+0000","last_active":"2024-09-12T02:41:55.077436+0000","last_peered":"2024-09-12T02:41:55.077436+0000","last_clean":"2024-09-12T02:41:55.077436+0000","last_became_active":"2024-09-12T02:41:53.798618+0000","last_became_peered":"2024-09-12T02:41:53.798618+0000","last_unstale":"2024-09-12T02:41:55.077436+0000","last_undegraded":"2024-09-12T02:41:55.077436+0000","last_fullsized":"2024-09-12T02:41:55.077436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:32.649809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.076898+0000","last_change":"2024-09-12T02:41:53.786850+0000","last_active":"2024-09-12T02:41:55.076898+0000","last_peered":"2024-09-12T02:41:55.076898+0000","last_clean":"2024-09-12T02:41:55.076898+0000","last_became_active":"2024-09-12T02:41:53.786615+0000","last_became_peered":"2024-09-12T02:41:53.786615+0000","last_unstale":"2024-09-12T02:41:55.076898+0000","last_undegraded":"2024-09-12T02:41:55.076898+0000","last_fullsized":"2024-09-12T02:41:55.076898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:21.015757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077473+0000","last_change":"2024-09-12T02:41:53.794425+0000","last_active":"2024-09-12T02:41:55.077473+0000","last_peered":"2024-09-12T02:41:55.077473+0000","last_clean":"2024-09-12T02:41:55.077473+0000","last_became_active":"2024-09-12T02:41:53.793319+0000","last_became_peered":"2024-09-12T02:41:53.793319+0000","last_unstale":"2024-09-12T02:41:55.077473+0000","last_undegraded":"2024-09-12T02:41:55.077473+0000","last_fullsized":"2024-09-12T02:41:55.077473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:04.162670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779169+0000","last_change":"2024-09-12T02:41:53.795094+0000","last_active":"2024-09-12T02:41:54.779169+0000","last_peered":"2024-09-12T02:41:54.779169+0000","last_clean":"2024-09-12T02:41:54.779169+0000","last_became_active":"2024-09-12T02:41:53.794841+0000","last_became_peered":"2024-09-12T02:41:53.794841+0000","last_unstale":"2024-09-12T02:41:54.779169+0000","last_undegraded":"2024-09-12T02:41:54.779169+0000","last_fullsized":"2024-09-12T02:41:54.779169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:58.970487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077484+0000","last_change":"2024-09-12T02:41:53.794039+0000","last_active":"2024-09-12T02:41:55.077484+0000","last_peered":"2024-09-12T02:41:55.077484+0000","last_clean":"2024-09-12T02:41:55.077484+0000","last_became_active":"2024-09-12T02:41:53.793709+0000","last_became_peered":"2024-09-12T02:41:53.793709+0000","last_unstale":"2024-09-12T02:41:55.077484+0000","last_undegraded":"2024-09-12T02:41:55.077484+0000","last_fullsized":"2024-09-12T02:41:55.077484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:53:04.907858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077745+0000","last_change":"2024-09-12T02:41:53.799240+0000","last_active":"2024-09-12T02:41:55.077745+0000","last_peered":"2024-09-12T02:41:55.077745+0000","last_clean":"2024-09-12T02:41:55.077745+0000","last_became_active":"2024-09-12T02:41:53.798310+0000","last_became_peered":"2024-09-12T02:41:53.798310+0000","last_unstale":"2024-09-12T02:41:55.077745+0000","last_undegraded":"2024-09-12T02:41:55.077745+0000","last_fullsized":"2024-09-12T02:41:55.077745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:28.511208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779010+0000","last_change":"2024-09-12T02:41:53.797034+0000","last_active":"2024-09-12T02:41:54.779010+0000","last_peered":"2024-09-12T02:41:54.779010+0000","last_clean":"2024-09-12T02:41:54.779010+0000","last_became_active":"2024-09-12T02:41:53.796810+0000","last_became_peered":"2024-09-12T02:41:53.796810+0000","last_unstale":"2024-09-12T02:41:54.779010+0000","last_undegraded":"2024-09-12T02:41:54.779010+0000","last_fullsized":"2024-09-12T02:41:54.779010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:33.181523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077704+0000","last_change":"2024-09-12T02:41:53.801270+0000","last_active":"2024-09-12T02:41:55.077704+0000","last_peered":"2024-09-12T02:41:55.077704+0000","last_clean":"2024-09-12T02:41:55.077704+0000","last_became_active":"2024-09-12T02:41:53.798339+0000","last_became_peered":"2024-09-12T02:41:53.798339+0000","last_unstale":"2024-09-12T02:41:55.077704+0000","last_undegraded":"2024-09-12T02:41:55.077704+0000","last_fullsized":"2024-09-12T02:41:55.077704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:09.271851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778820+0000","last_change":"2024-09-12T02:41:53.794645+0000","last_active":"2024-09-12T02:41:54.778820+0000","last_peered":"2024-09-12T02:41:54.778820+0000","last_clean":"2024-09-12T02:41:54.778820+0000","last_became_active":"2024-09-12T02:41:53.794420+0000","last_became_peered":"2024-09-12T02:41:53.794420+0000","last_unstale":"2024-09-12T02:41:54.778820+0000","last_undegraded":"2024-09-12T02:41:54.778820+0000","last_fullsized":"2024-09-12T02:41:54.778820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:02.170329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778605+0000","last_change":"2024-09-12T02:41:53.795644+0000","last_active":"2024-09-12T02:41:54.778605+0000","last_peered":"2024-09-12T02:41:54.778605+0000","last_clean":"2024-09-12T02:41:54.778605+0000","last_became_active":"2024-09-12T02:41:53.795305+0000","last_became_peered":"2024-09-12T02:41:53.795305+0000","last_unstale":"2024-09-12T02:41:54.778605+0000","last_undegraded":"2024-09-12T02:41:54.778605+0000","last_fullsized":"2024-09-12T02:41:54.778605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:38.620097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807201+0000","last_change":"2024-09-12T02:41:53.784403+0000","last_active":"2024-09-12T02:41:54.807201+0000","last_peered":"2024-09-12T02:41:54.807201+0000","last_clean":"2024-09-12T02:41:54.807201+0000","last_became_active":"2024-09-12T02:41:53.784173+0000","last_became_peered":"2024-09-12T02:41:53.784173+0000","last_unstale":"2024-09-12T02:41:54.807201+0000","last_undegraded":"2024-09-12T02:41:54.807201+0000","last_fullsized":"2024-09-12T02:41:54.807201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:03.404034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779149+0000","last_change":"2024-09-12T02:41:53.796925+0000","last_active":"2024-09-12T02:41:54.779149+0000","last_peered":"2024-09-12T02:41:54.779149+0000","last_clean":"2024-09-12T02:41:54.779149+0000","last_became_active":"2024-09-12T02:41:53.796640+0000","last_became_peered":"2024-09-12T02:41:53.796640+0000","last_unstale":"2024-09-12T02:41:54.779149+0000","last_undegraded":"2024-09-12T02:41:54.779149+0000","last_fullsized":"2024-09-12T02:41:54.779149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:05.118176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.076988+0000","last_change":"2024-09-12T02:41:53.784042+0000","last_active":"2024-09-12T02:41:55.076988+0000","last_peered":"2024-09-12T02:41:55.076988+0000","last_clean":"2024-09-12T02:41:55.076988+0000","last_became_active":"2024-09-12T02:41:53.783817+0000","last_became_peered":"2024-09-12T02:41:53.783817+0000","last_unstale":"2024-09-12T02:41:55.076988+0000","last_undegraded":"2024-09-12T02:41:55.076988+0000","last_fullsized":"2024-09-12T02:41:55.076988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:31.997189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077165+0000","last_change":"2024-09-12T02:41:53.796678+0000","last_active":"2024-09-12T02:41:55.077165+0000","last_peered":"2024-09-12T02:41:55.077165+0000","last_clean":"2024-09-12T02:41:55.077165+0000","last_became_active":"2024-09-12T02:41:53.796473+0000","last_became_peered":"2024-09-12T02:41:53.796473+0000","last_unstale":"2024-09-12T02:41:55.077165+0000","last_undegraded":"2024-09-12T02:41:55.077165+0000","last_fullsized":"2024-09-12T02:41:55.077165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:14.697130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.076930+0000","last_change":"2024-09-12T02:41:53.787664+0000","last_active":"2024-09-12T02:41:55.076930+0000","last_peered":"2024-09-12T02:41:55.076930+0000","last_clean":"2024-09-12T02:41:55.076930+0000","last_became_active":"2024-09-12T02:41:53.786817+0000","last_became_peered":"2024-09-12T02:41:53.786817+0000","last_unstale":"2024-09-12T02:41:55.076930+0000","last_undegraded":"2024-09-12T02:41:55.076930+0000","last_fullsized":"2024-09-12T02:41:55.076930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:02.531079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778460+0000","last_change":"2024-09-12T02:41:53.785375+0000","last_active":"2024-09-12T02:41:54.778460+0000","last_peered":"2024-09-12T02:41:54.778460+0000","last_clean":"2024-09-12T02:41:54.778460+0000","last_became_active":"2024-09-12T02:41:53.785070+0000","last_became_peered":"2024-09-12T02:41:53.785070+0000","last_unstale":"2024-09-12T02:41:54.778460+0000","last_undegraded":"2024-09-12T02:41:54.778460+0000","last_fullsized":"2024-09-12T02:41:54.778460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:49.213437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.777581+0000","last_change":"2024-09-12T02:41:53.795446+0000","last_active":"2024-09-12T02:41:54.777581+0000","last_peered":"2024-09-12T02:41:54.777581+0000","last_clean":"2024-09-12T02:41:54.777581+0000","last_became_active":"2024-09-12T02:41:53.795189+0000","last_became_peered":"2024-09-12T02:41:53.795189+0000","last_unstale":"2024-09-12T02:41:54.777581+0000","last_undegraded":"2024-09-12T02:41:54.777581+0000","last_fullsized":"2024-09-12T02:41:54.777581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:31.783821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779103+0000","last_change":"2024-09-12T02:41:52.782761+0000","last_active":"2024-09-12T02:41:54.779103+0000","last_peered":"2024-09-12T02:41:54.779103+0000","last_clean":"2024-09-12T02:41:54.779103+0000","last_became_active":"2024-09-12T02:41:52.782565+0000","last_became_peered":"2024-09-12T02:41:52.782565+0000","last_unstale":"2024-09-12T02:41:54.779103+0000","last_undegraded":"2024-09-12T02:41:54.779103+0000","last_fullsized":"2024-09-12T02:41:54.779103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:21.927114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077231+0000","last_change":"2024-09-12T02:41:53.791180+0000","last_active":"2024-09-12T02:41:55.077231+0000","last_peered":"2024-09-12T02:41:55.077231+0000","last_clean":"2024-09-12T02:41:55.077231+0000","last_became_active":"2024-09-12T02:41:53.790843+0000","last_became_peered":"2024-09-12T02:41:53.790843+0000","last_unstale":"2024-09-12T02:41:55.077231+0000","last_undegraded":"2024-09-12T02:41:55.077231+0000","last_fullsized":"2024-09-12T02:41:55.077231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:58.801201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778651+0000","last_change":"2024-09-12T02:41:52.775582+0000","last_active":"2024-09-12T02:41:54.778651+0000","last_peered":"2024-09-12T02:41:54.778651+0000","last_clean":"2024-09-12T02:41:54.778651+0000","last_became_active":"2024-09-12T02:41:52.774577+0000","last_became_peered":"2024-09-12T02:41:52.774577+0000","last_unstale":"2024-09-12T02:41:54.778651+0000","last_undegraded":"2024-09-12T02:41:54.778651+0000","last_fullsized":"2024-09-12T02:41:54.778651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:36.018405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779210+0000","last_change":"2024-09-12T02:41:52.777181+0000","last_active":"2024-09-12T02:41:54.779210+0000","last_peered":"2024-09-12T02:41:54.779210+0000","last_clean":"2024-09-12T02:41:54.779210+0000","last_became_active":"2024-09-12T02:41:52.773406+0000","last_became_peered":"2024-09-12T02:41:52.773406+0000","last_unstale":"2024-09-12T02:41:54.779210+0000","last_undegraded":"2024-09-12T02:41:54.779210+0000","last_fullsized":"2024-09-12T02:41:54.779210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:20.740967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778971+0000","last_change":"2024-09-12T02:41:53.784557+0000","last_active":"2024-09-12T02:41:54.778971+0000","last_peered":"2024-09-12T02:41:54.778971+0000","last_clean":"2024-09-12T02:41:54.778971+0000","last_became_active":"2024-09-12T02:41:53.784163+0000","last_became_peered":"2024-09-12T02:41:53.784163+0000","last_unstale":"2024-09-12T02:41:54.778971+0000","last_undegraded":"2024-09-12T02:41:54.778971+0000","last_fullsized":"2024-09-12T02:41:54.778971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:37.011519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077434+0000","last_change":"2024-09-12T02:41:52.783587+0000","last_active":"2024-09-12T02:41:55.077434+0000","last_peered":"2024-09-12T02:41:55.077434+0000","last_clean":"2024-09-12T02:41:55.077434+0000","last_became_active":"2024-09-12T02:41:52.783418+0000","last_became_peered":"2024-09-12T02:41:52.783418+0000","last_unstale":"2024-09-12T02:41:55.077434+0000","last_undegraded":"2024-09-12T02:41:55.077434+0000","last_fullsized":"2024-09-12T02:41:55.077434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:39:33.808133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807122+0000","last_change":"2024-09-12T02:41:53.792483+0000","last_active":"2024-09-12T02:41:54.807122+0000","last_peered":"2024-09-12T02:41:54.807122+0000","last_clean":"2024-09-12T02:41:54.807122+0000","last_became_active":"2024-09-12T02:41:53.791556+0000","last_became_peered":"2024-09-12T02:41:53.791556+0000","last_unstale":"2024-09-12T02:41:54.807122+0000","last_undegraded":"2024-09-12T02:41:54.807122+0000","last_fullsized":"2024-09-12T02:41:54.807122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:27.695745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778786+0000","last_change":"2024-09-12T02:41:52.771541+0000","last_active":"2024-09-12T02:41:54.778786+0000","last_peered":"2024-09-12T02:41:54.778786+0000","last_clean":"2024-09-12T02:41:54.778786+0000","last_became_active":"2024-09-12T02:41:52.770232+0000","last_became_peered":"2024-09-12T02:41:52.770232+0000","last_unstale":"2024-09-12T02:41:54.778786+0000","last_undegraded":"2024-09-12T02:41:54.778786+0000","last_fullsized":"2024-09-12T02:41:54.778786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:13.405791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077589+0000","last_change":"2024-09-12T02:41:53.799033+0000","last_active":"2024-09-12T02:41:55.077589+0000","last_peered":"2024-09-12T02:41:55.077589+0000","last_clean":"2024-09-12T02:41:55.077589+0000","last_became_active":"2024-09-12T02:41:53.797973+0000","last_became_peered":"2024-09-12T02:41:53.797973+0000","last_unstale":"2024-09-12T02:41:55.077589+0000","last_undegraded":"2024-09-12T02:41:55.077589+0000","last_fullsized":"2024-09-12T02:41:55.077589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:12.141704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078072+0000","last_change":"2024-09-12T02:41:52.780065+0000","last_active":"2024-09-12T02:41:55.078072+0000","last_peered":"2024-09-12T02:41:55.078072+0000","last_clean":"2024-09-12T02:41:55.078072+0000","last_became_active":"2024-09-12T02:41:52.778398+0000","last_became_peered":"2024-09-12T02:41:52.778398+0000","last_unstale":"2024-09-12T02:41:55.078072+0000","last_undegraded":"2024-09-12T02:41:55.078072+0000","last_fullsized":"2024-09-12T02:41:55.078072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:58.549424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077632+0000","last_change":"2024-09-12T02:41:53.788794+0000","last_active":"2024-09-12T02:41:55.077632+0000","last_peered":"2024-09-12T02:41:55.077632+0000","last_clean":"2024-09-12T02:41:55.077632+0000","last_became_active":"2024-09-12T02:41:53.788300+0000","last_became_peered":"2024-09-12T02:41:53.788300+0000","last_unstale":"2024-09-12T02:41:55.077632+0000","last_undegraded":"2024-09-12T02:41:55.077632+0000","last_fullsized":"2024-09-12T02:41:55.077632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:45.111485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807225+0000","last_change":"2024-09-12T02:41:52.781616+0000","last_active":"2024-09-12T02:41:54.807225+0000","last_peered":"2024-09-12T02:41:54.807225+0000","last_clean":"2024-09-12T02:41:54.807225+0000","last_became_active":"2024-09-12T02:41:52.781376+0000","last_became_peered":"2024-09-12T02:41:52.781376+0000","last_unstale":"2024-09-12T02:41:54.807225+0000","last_undegraded":"2024-09-12T02:41:54.807225+0000","last_fullsized":"2024-09-12T02:41:54.807225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:29.040560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.777378+0000","last_change":"2024-09-12T02:41:53.801788+0000","last_active":"2024-09-12T02:41:54.777378+0000","last_peered":"2024-09-12T02:41:54.777378+0000","last_clean":"2024-09-12T02:41:54.777378+0000","last_became_active":"2024-09-12T02:41:53.801572+0000","last_became_peered":"2024-09-12T02:41:53.801572+0000","last_unstale":"2024-09-12T02:41:54.777378+0000","last_undegraded":"2024-09-12T02:41:54.777378+0000","last_fullsized":"2024-09-12T02:41:54.777378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:44.395638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778605+0000","last_change":"2024-09-12T02:41:52.776998+0000","last_active":"2024-09-12T02:41:54.778605+0000","last_peered":"2024-09-12T02:41:54.778605+0000","last_clean":"2024-09-12T02:41:54.778605+0000","last_became_active":"2024-09-12T02:41:52.776765+0000","last_became_peered":"2024-09-12T02:41:52.776765+0000","last_unstale":"2024-09-12T02:41:54.778605+0000","last_undegraded":"2024-09-12T02:41:54.778605+0000","last_fullsized":"2024-09-12T02:41:54.778605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:34.024741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077170+0000","last_change":"2024-09-12T02:41:53.795517+0000","last_active":"2024-09-12T02:41:55.077170+0000","last_peered":"2024-09-12T02:41:55.077170+0000","last_clean":"2024-09-12T02:41:55.077170+0000","last_became_active":"2024-09-12T02:41:53.795260+0000","last_became_peered":"2024-09-12T02:41:53.795260+0000","last_unstale":"2024-09-12T02:41:55.077170+0000","last_undegraded":"2024-09-12T02:41:55.077170+0000","last_fullsized":"2024-09-12T02:41:55.077170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:41.612631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077159+0000","last_change":"2024-09-12T02:41:52.770092+0000","last_active":"2024-09-12T02:41:55.077159+0000","last_peered":"2024-09-12T02:41:55.077159+0000","last_clean":"2024-09-12T02:41:55.077159+0000","last_became_active":"2024-09-12T02:41:52.769364+0000","last_became_peered":"2024-09-12T02:41:52.769364+0000","last_unstale":"2024-09-12T02:41:55.077159+0000","last_undegraded":"2024-09-12T02:41:55.077159+0000","last_fullsized":"2024-09-12T02:41:55.077159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:59.882002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077762+0000","last_change":"2024-09-12T02:41:53.793864+0000","last_active":"2024-09-12T02:41:55.077762+0000","last_peered":"2024-09-12T02:41:55.077762+0000","last_clean":"2024-09-12T02:41:55.077762+0000","last_became_active":"2024-09-12T02:41:53.793422+0000","last_became_peered":"2024-09-12T02:41:53.793422+0000","last_unstale":"2024-09-12T02:41:55.077762+0000","last_undegraded":"2024-09-12T02:41:55.077762+0000","last_fullsized":"2024-09-12T02:41:55.077762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:46.256453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078076+0000","last_change":"2024-09-12T02:41:52.780555+0000","last_active":"2024-09-12T02:41:55.078076+0000","last_peered":"2024-09-12T02:41:55.078076+0000","last_clean":"2024-09-12T02:41:55.078076+0000","last_became_active":"2024-09-12T02:41:52.775956+0000","last_became_peered":"2024-09-12T02:41:52.775956+0000","last_unstale":"2024-09-12T02:41:55.078076+0000","last_undegraded":"2024-09-12T02:41:55.078076+0000","last_fullsized":"2024-09-12T02:41:55.078076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:07.893393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078331+0000","last_change":"2024-09-12T02:41:53.803353+0000","last_active":"2024-09-12T02:41:55.078331+0000","last_peered":"2024-09-12T02:41:55.078331+0000","last_clean":"2024-09-12T02:41:55.078331+0000","last_became_active":"2024-09-12T02:41:53.802739+0000","last_became_peered":"2024-09-12T02:41:53.802739+0000","last_unstale":"2024-09-12T02:41:55.078331+0000","last_undegraded":"2024-09-12T02:41:55.078331+0000","last_fullsized":"2024-09-12T02:41:55.078331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:54.124099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778844+0000","last_change":"2024-09-12T02:41:52.766630+0000","last_active":"2024-09-12T02:41:54.778844+0000","last_peered":"2024-09-12T02:41:54.778844+0000","last_clean":"2024-09-12T02:41:54.778844+0000","last_became_active":"2024-09-12T02:41:52.766146+0000","last_became_peered":"2024-09-12T02:41:52.766146+0000","last_unstale":"2024-09-12T02:41:54.778844+0000","last_undegraded":"2024-09-12T02:41:54.778844+0000","last_fullsized":"2024-09-12T02:41:54.778844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:54.001676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778544+0000","last_change":"2024-09-12T02:41:53.786241+0000","last_active":"2024-09-12T02:41:54.778544+0000","last_peered":"2024-09-12T02:41:54.778544+0000","last_clean":"2024-09-12T02:41:54.778544+0000","last_became_active":"2024-09-12T02:41:53.785997+0000","last_became_peered":"2024-09-12T02:41:53.785997+0000","last_unstale":"2024-09-12T02:41:54.778544+0000","last_undegraded":"2024-09-12T02:41:54.778544+0000","last_fullsized":"2024-09-12T02:41:54.778544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:54.645416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.076987+0000","last_change":"2024-09-12T02:41:52.775019+0000","last_active":"2024-09-12T02:41:55.076987+0000","last_peered":"2024-09-12T02:41:55.076987+0000","last_clean":"2024-09-12T02:41:55.076987+0000","last_became_active":"2024-09-12T02:41:52.774766+0000","last_became_peered":"2024-09-12T02:41:52.774766+0000","last_unstale":"2024-09-12T02:41:55.076987+0000","last_undegraded":"2024-09-12T02:41:55.076987+0000","last_fullsized":"2024-09-12T02:41:55.076987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:28.082972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077793+0000","last_change":"2024-09-12T02:41:53.803073+0000","last_active":"2024-09-12T02:41:55.077793+0000","last_peered":"2024-09-12T02:41:55.077793+0000","last_clean":"2024-09-12T02:41:55.077793+0000","last_became_active":"2024-09-12T02:41:53.802791+0000","last_became_peered":"2024-09-12T02:41:53.802791+0000","last_unstale":"2024-09-12T02:41:55.077793+0000","last_undegraded":"2024-09-12T02:41:55.077793+0000","last_fullsized":"2024-09-12T02:41:55.077793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:14.115868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.777508+0000","last_change":"2024-09-12T02:41:52.767949+0000","last_active":"2024-09-12T02:41:54.777508+0000","last_peered":"2024-09-12T02:41:54.777508+0000","last_clean":"2024-09-12T02:41:54.777508+0000","last_became_active":"2024-09-12T02:41:52.767666+0000","last_became_peered":"2024-09-12T02:41:52.767666+0000","last_unstale":"2024-09-12T02:41:54.777508+0000","last_undegraded":"2024-09-12T02:41:54.777508+0000","last_fullsized":"2024-09-12T02:41:54.777508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:17.680737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078475+0000","last_change":"2024-09-12T02:41:53.803540+0000","last_active":"2024-09-12T02:41:55.078475+0000","last_peered":"2024-09-12T02:41:55.078475+0000","last_clean":"2024-09-12T02:41:55.078475+0000","last_became_active":"2024-09-12T02:41:53.803074+0000","last_became_peered":"2024-09-12T02:41:53.803074+0000","last_unstale":"2024-09-12T02:41:55.078475+0000","last_undegraded":"2024-09-12T02:41:55.078475+0000","last_fullsized":"2024-09-12T02:41:55.078475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:39.415488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077285+0000","last_change":"2024-09-12T02:41:52.776749+0000","last_active":"2024-09-12T02:41:55.077285+0000","last_peered":"2024-09-12T02:41:55.077285+0000","last_clean":"2024-09-12T02:41:55.077285+0000","last_became_active":"2024-09-12T02:41:52.776495+0000","last_became_peered":"2024-09-12T02:41:52.776495+0000","last_unstale":"2024-09-12T02:41:55.077285+0000","last_undegraded":"2024-09-12T02:41:55.077285+0000","last_fullsized":"2024-09-12T02:41:55.077285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:58.485267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077321+0000","last_change":"2024-09-12T02:41:53.803271+0000","last_active":"2024-09-12T02:41:55.077321+0000","last_peered":"2024-09-12T02:41:55.077321+0000","last_clean":"2024-09-12T02:41:55.077321+0000","last_became_active":"2024-09-12T02:41:53.802960+0000","last_became_peered":"2024-09-12T02:41:53.802960+0000","last_unstale":"2024-09-12T02:41:55.077321+0000","last_undegraded":"2024-09-12T02:41:55.077321+0000","last_fullsized":"2024-09-12T02:41:55.077321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:11.896253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807044+0000","last_change":"2024-09-12T02:41:52.775195+0000","last_active":"2024-09-12T02:41:54.807044+0000","last_peered":"2024-09-12T02:41:54.807044+0000","last_clean":"2024-09-12T02:41:54.807044+0000","last_became_active":"2024-09-12T02:41:52.774945+0000","last_became_peered":"2024-09-12T02:41:52.774945+0000","last_unstale":"2024-09-12T02:41:54.807044+0000","last_undegraded":"2024-09-12T02:41:54.807044+0000","last_fullsized":"2024-09-12T02:41:54.807044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:35.355898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077903+0000","last_change":"2024-09-12T02:41:53.787875+0000","last_active":"2024-09-12T02:41:55.077903+0000","last_peered":"2024-09-12T02:41:55.077903+0000","last_clean":"2024-09-12T02:41:55.077903+0000","last_became_active":"2024-09-12T02:41:53.787636+0000","last_became_peered":"2024-09-12T02:41:53.787636+0000","last_unstale":"2024-09-12T02:41:55.077903+0000","last_undegraded":"2024-09-12T02:41:55.077903+0000","last_fullsized":"2024-09-12T02:41:55.077903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:18.244809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.076853+0000","last_change":"2024-09-12T02:41:52.781866+0000","last_active":"2024-09-12T02:41:55.076853+0000","last_peered":"2024-09-12T02:41:55.076853+0000","last_clean":"2024-09-12T02:41:55.076853+0000","last_became_active":"2024-09-12T02:41:52.781637+0000","last_became_peered":"2024-09-12T02:41:52.781637+0000","last_unstale":"2024-09-12T02:41:55.076853+0000","last_undegraded":"2024-09-12T02:41:55.076853+0000","last_fullsized":"2024-09-12T02:41:55.076853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:44.675773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078815+0000","last_change":"2024-09-12T02:41:53.802186+0000","last_active":"2024-09-12T02:41:55.078815+0000","last_peered":"2024-09-12T02:41:55.078815+0000","last_clean":"2024-09-12T02:41:55.078815+0000","last_became_active":"2024-09-12T02:41:53.801944+0000","last_became_peered":"2024-09-12T02:41:53.801944+0000","last_unstale":"2024-09-12T02:41:55.078815+0000","last_undegraded":"2024-09-12T02:41:55.078815+0000","last_fullsized":"2024-09-12T02:41:55.078815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:27.413007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077804+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:41:55.077804+0000","last_peered":"2024-09-12T02:41:55.077804+0000","last_clean":"2024-09-12T02:41:55.077804+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:41:55.077804+0000","last_undegraded":"2024-09-12T02:41:55.077804+0000","last_fullsized":"2024-09-12T02:41:55.077804+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:45.426902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078266+0000","last_change":"2024-09-12T02:41:52.783100+0000","last_active":"2024-09-12T02:41:55.078266+0000","last_peered":"2024-09-12T02:41:55.078266+0000","last_clean":"2024-09-12T02:41:55.078266+0000","last_became_active":"2024-09-12T02:41:52.782739+0000","last_became_peered":"2024-09-12T02:41:52.782739+0000","last_unstale":"2024-09-12T02:41:55.078266+0000","last_undegraded":"2024-09-12T02:41:55.078266+0000","last_fullsized":"2024-09-12T02:41:55.078266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:12.279581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778908+0000","last_change":"2024-09-12T02:41:53.793492+0000","last_active":"2024-09-12T02:41:54.778908+0000","last_peered":"2024-09-12T02:41:54.778908+0000","last_clean":"2024-09-12T02:41:54.778908+0000","last_became_active":"2024-09-12T02:41:53.791680+0000","last_became_peered":"2024-09-12T02:41:53.791680+0000","last_unstale":"2024-09-12T02:41:54.778908+0000","last_undegraded":"2024-09-12T02:41:54.778908+0000","last_fullsized":"2024-09-12T02:41:54.778908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:00.054064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077698+0000","last_change":"2024-09-12T02:41:52.781604+0000","last_active":"2024-09-12T02:41:55.077698+0000","last_peered":"2024-09-12T02:41:55.077698+0000","last_clean":"2024-09-12T02:41:55.077698+0000","last_became_active":"2024-09-12T02:41:52.780183+0000","last_became_peered":"2024-09-12T02:41:52.780183+0000","last_unstale":"2024-09-12T02:41:55.077698+0000","last_undegraded":"2024-09-12T02:41:55.077698+0000","last_fullsized":"2024-09-12T02:41:55.077698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:00.663730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077610+0000","last_change":"2024-09-12T02:41:53.795877+0000","last_active":"2024-09-12T02:41:55.077610+0000","last_peered":"2024-09-12T02:41:55.077610+0000","last_clean":"2024-09-12T02:41:55.077610+0000","last_became_active":"2024-09-12T02:41:53.795603+0000","last_became_peered":"2024-09-12T02:41:53.795603+0000","last_unstale":"2024-09-12T02:41:55.077610+0000","last_undegraded":"2024-09-12T02:41:55.077610+0000","last_fullsized":"2024-09-12T02:41:55.077610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:16.241955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077097+0000","last_change":"2024-09-12T02:41:52.779295+0000","last_active":"2024-09-12T02:41:55.077097+0000","last_peered":"2024-09-12T02:41:55.077097+0000","last_clean":"2024-09-12T02:41:55.077097+0000","last_became_active":"2024-09-12T02:41:52.778794+0000","last_became_peered":"2024-09-12T02:41:52.778794+0000","last_unstale":"2024-09-12T02:41:55.077097+0000","last_undegraded":"2024-09-12T02:41:55.077097+0000","last_fullsized":"2024-09-12T02:41:55.077097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:37.479001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807228+0000","last_change":"2024-09-12T02:41:53.787507+0000","last_active":"2024-09-12T02:41:54.807228+0000","last_peered":"2024-09-12T02:41:54.807228+0000","last_clean":"2024-09-12T02:41:54.807228+0000","last_became_active":"2024-09-12T02:41:53.787303+0000","last_became_peered":"2024-09-12T02:41:53.787303+0000","last_unstale":"2024-09-12T02:41:54.807228+0000","last_undegraded":"2024-09-12T02:41:54.807228+0000","last_fullsized":"2024-09-12T02:41:54.807228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:19.802083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078131+0000","last_change":"2024-09-12T02:41:52.785347+0000","last_active":"2024-09-12T02:41:55.078131+0000","last_peered":"2024-09-12T02:41:55.078131+0000","last_clean":"2024-09-12T02:41:55.078131+0000","last_became_active":"2024-09-12T02:41:52.784154+0000","last_became_peered":"2024-09-12T02:41:52.784154+0000","last_unstale":"2024-09-12T02:41:55.078131+0000","last_undegraded":"2024-09-12T02:41:55.078131+0000","last_fullsized":"2024-09-12T02:41:55.078131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:21:04.142656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.777403+0000","last_change":"2024-09-12T02:41:53.796131+0000","last_active":"2024-09-12T02:41:54.777403+0000","last_peered":"2024-09-12T02:41:54.777403+0000","last_clean":"2024-09-12T02:41:54.777403+0000","last_became_active":"2024-09-12T02:41:53.795889+0000","last_became_peered":"2024-09-12T02:41:53.795889+0000","last_unstale":"2024-09-12T02:41:54.777403+0000","last_undegraded":"2024-09-12T02:41:54.777403+0000","last_fullsized":"2024-09-12T02:41:54.777403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:58:40.501110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807255+0000","last_change":"2024-09-12T02:41:52.773305+0000","last_active":"2024-09-12T02:41:54.807255+0000","last_peered":"2024-09-12T02:41:54.807255+0000","last_clean":"2024-09-12T02:41:54.807255+0000","last_became_active":"2024-09-12T02:41:52.773009+0000","last_became_peered":"2024-09-12T02:41:52.773009+0000","last_unstale":"2024-09-12T02:41:54.807255+0000","last_undegraded":"2024-09-12T02:41:54.807255+0000","last_fullsized":"2024-09-12T02:41:54.807255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:41:48.173306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077855+0000","last_change":"2024-09-12T02:41:53.789700+0000","last_active":"2024-09-12T02:41:55.077855+0000","last_peered":"2024-09-12T02:41:55.077855+0000","last_clean":"2024-09-12T02:41:55.077855+0000","last_became_active":"2024-09-12T02:41:53.789445+0000","last_became_peered":"2024-09-12T02:41:53.789445+0000","last_unstale":"2024-09-12T02:41:55.077855+0000","last_undegraded":"2024-09-12T02:41:55.077855+0000","last_fullsized":"2024-09-12T02:41:55.077855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:21.533372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077584+0000","last_change":"2024-09-12T02:41:52.783557+0000","last_active":"2024-09-12T02:41:55.077584+0000","last_peered":"2024-09-12T02:41:55.077584+0000","last_clean":"2024-09-12T02:41:55.077584+0000","last_became_active":"2024-09-12T02:41:52.782015+0000","last_became_peered":"2024-09-12T02:41:52.782015+0000","last_unstale":"2024-09-12T02:41:55.077584+0000","last_undegraded":"2024-09-12T02:41:55.077584+0000","last_fullsized":"2024-09-12T02:41:55.077584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:07.909958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807020+0000","last_change":"2024-09-12T02:41:53.791158+0000","last_active":"2024-09-12T02:41:54.807020+0000","last_peered":"2024-09-12T02:41:54.807020+0000","last_clean":"2024-09-12T02:41:54.807020+0000","last_became_active":"2024-09-12T02:41:53.789727+0000","last_became_peered":"2024-09-12T02:41:53.789727+0000","last_unstale":"2024-09-12T02:41:54.807020+0000","last_undegraded":"2024-09-12T02:41:54.807020+0000","last_fullsized":"2024-09-12T02:41:54.807020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:21.893126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807346+0000","last_change":"2024-09-12T02:41:52.773054+0000","last_active":"2024-09-12T02:41:54.807346+0000","last_peered":"2024-09-12T02:41:54.807346+0000","last_clean":"2024-09-12T02:41:54.807346+0000","last_became_active":"2024-09-12T02:41:52.772715+0000","last_became_peered":"2024-09-12T02:41:52.772715+0000","last_unstale":"2024-09-12T02:41:54.807346+0000","last_undegraded":"2024-09-12T02:41:54.807346+0000","last_fullsized":"2024-09-12T02:41:54.807346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:27.523535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778750+0000","last_change":"2024-09-12T02:41:53.794838+0000","last_active":"2024-09-12T02:41:54.778750+0000","last_peered":"2024-09-12T02:41:54.778750+0000","last_clean":"2024-09-12T02:41:54.778750+0000","last_became_active":"2024-09-12T02:41:53.794622+0000","last_became_peered":"2024-09-12T02:41:53.794622+0000","last_unstale":"2024-09-12T02:41:54.778750+0000","last_undegraded":"2024-09-12T02:41:54.778750+0000","last_fullsized":"2024-09-12T02:41:54.778750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:07.720321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778964+0000","last_change":"2024-09-12T02:41:52.782851+0000","last_active":"2024-09-12T02:41:54.778964+0000","last_peered":"2024-09-12T02:41:54.778964+0000","last_clean":"2024-09-12T02:41:54.778964+0000","last_became_active":"2024-09-12T02:41:52.782365+0000","last_became_peered":"2024-09-12T02:41:52.782365+0000","last_unstale":"2024-09-12T02:41:54.778964+0000","last_undegraded":"2024-09-12T02:41:54.778964+0000","last_fullsized":"2024-09-12T02:41:54.778964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:02.356143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077330+0000","last_change":"2024-09-12T02:41:53.782924+0000","last_active":"2024-09-12T02:41:55.077330+0000","last_peered":"2024-09-12T02:41:55.077330+0000","last_clean":"2024-09-12T02:41:55.077330+0000","last_became_active":"2024-09-12T02:41:53.782612+0000","last_became_peered":"2024-09-12T02:41:53.782612+0000","last_unstale":"2024-09-12T02:41:55.077330+0000","last_undegraded":"2024-09-12T02:41:55.077330+0000","last_fullsized":"2024-09-12T02:41:55.077330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:09.015161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.079091+0000","last_change":"2024-09-12T02:41:52.783151+0000","last_active":"2024-09-12T02:41:55.079091+0000","last_peered":"2024-09-12T02:41:55.079091+0000","last_clean":"2024-09-12T02:41:55.079091+0000","last_became_active":"2024-09-12T02:41:52.781789+0000","last_became_peered":"2024-09-12T02:41:52.781789+0000","last_unstale":"2024-09-12T02:41:55.079091+0000","last_undegraded":"2024-09-12T02:41:55.079091+0000","last_fullsized":"2024-09-12T02:41:55.079091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:30.446920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778208+0000","last_change":"2024-09-12T02:41:53.792907+0000","last_active":"2024-09-12T02:41:54.778208+0000","last_peered":"2024-09-12T02:41:54.778208+0000","last_clean":"2024-09-12T02:41:54.778208+0000","last_became_active":"2024-09-12T02:41:53.789159+0000","last_became_peered":"2024-09-12T02:41:53.789159+0000","last_unstale":"2024-09-12T02:41:54.778208+0000","last_undegraded":"2024-09-12T02:41:54.778208+0000","last_fullsized":"2024-09-12T02:41:54.778208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:40.658393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807185+0000","last_change":"2024-09-12T02:41:52.784747+0000","last_active":"2024-09-12T02:41:54.807185+0000","last_peered":"2024-09-12T02:41:54.807185+0000","last_clean":"2024-09-12T02:41:54.807185+0000","last_became_active":"2024-09-12T02:41:52.784558+0000","last_became_peered":"2024-09-12T02:41:52.784558+0000","last_unstale":"2024-09-12T02:41:54.807185+0000","last_undegraded":"2024-09-12T02:41:54.807185+0000","last_fullsized":"2024-09-12T02:41:54.807185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:25.686682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778690+0000","last_change":"2024-09-12T02:41:53.793644+0000","last_active":"2024-09-12T02:41:54.778690+0000","last_peered":"2024-09-12T02:41:54.778690+0000","last_clean":"2024-09-12T02:41:54.778690+0000","last_became_active":"2024-09-12T02:41:53.793439+0000","last_became_peered":"2024-09-12T02:41:53.793439+0000","last_unstale":"2024-09-12T02:41:54.778690+0000","last_undegraded":"2024-09-12T02:41:54.778690+0000","last_fullsized":"2024-09-12T02:41:54.778690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:25:59.472325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807287+0000","last_change":"2024-09-12T02:41:52.780636+0000","last_active":"2024-09-12T02:41:54.807287+0000","last_peered":"2024-09-12T02:41:54.807287+0000","last_clean":"2024-09-12T02:41:54.807287+0000","last_became_active":"2024-09-12T02:41:52.780347+0000","last_became_peered":"2024-09-12T02:41:52.780347+0000","last_unstale":"2024-09-12T02:41:54.807287+0000","last_undegraded":"2024-09-12T02:41:54.807287+0000","last_fullsized":"2024-09-12T02:41:54.807287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:46.086664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779261+0000","last_change":"2024-09-12T02:41:53.784952+0000","last_active":"2024-09-12T02:41:54.779261+0000","last_peered":"2024-09-12T02:41:54.779261+0000","last_clean":"2024-09-12T02:41:54.779261+0000","last_became_active":"2024-09-12T02:41:53.784276+0000","last_became_peered":"2024-09-12T02:41:53.784276+0000","last_unstale":"2024-09-12T02:41:54.779261+0000","last_undegraded":"2024-09-12T02:41:54.779261+0000","last_fullsized":"2024-09-12T02:41:54.779261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:53.702199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077279+0000","last_change":"2024-09-12T02:41:52.783869+0000","last_active":"2024-09-12T02:41:55.077279+0000","last_peered":"2024-09-12T02:41:55.077279+0000","last_clean":"2024-09-12T02:41:55.077279+0000","last_became_active":"2024-09-12T02:41:52.781705+0000","last_became_peered":"2024-09-12T02:41:52.781705+0000","last_unstale":"2024-09-12T02:41:55.077279+0000","last_undegraded":"2024-09-12T02:41:55.077279+0000","last_fullsized":"2024-09-12T02:41:55.077279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:28.710814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778514+0000","last_change":"2024-09-12T02:41:53.802125+0000","last_active":"2024-09-12T02:41:54.778514+0000","last_peered":"2024-09-12T02:41:54.778514+0000","last_clean":"2024-09-12T02:41:54.778514+0000","last_became_active":"2024-09-12T02:41:53.801855+0000","last_became_peered":"2024-09-12T02:41:53.801855+0000","last_unstale":"2024-09-12T02:41:54.778514+0000","last_undegraded":"2024-09-12T02:41:54.778514+0000","last_fullsized":"2024-09-12T02:41:54.778514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:56.017190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077335+0000","last_change":"2024-09-12T02:41:53.796199+0000","last_active":"2024-09-12T02:41:55.077335+0000","last_peered":"2024-09-12T02:41:55.077335+0000","last_clean":"2024-09-12T02:41:55.077335+0000","last_became_active":"2024-09-12T02:41:53.793833+0000","last_became_peered":"2024-09-12T02:41:53.793833+0000","last_unstale":"2024-09-12T02:41:55.077335+0000","last_undegraded":"2024-09-12T02:41:55.077335+0000","last_fullsized":"2024-09-12T02:41:55.077335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:06.451667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078990+0000","last_change":"2024-09-12T02:41:52.785769+0000","last_active":"2024-09-12T02:41:55.078990+0000","last_peered":"2024-09-12T02:41:55.078990+0000","last_clean":"2024-09-12T02:41:55.078990+0000","last_became_active":"2024-09-12T02:41:52.785498+0000","last_became_peered":"2024-09-12T02:41:52.785498+0000","last_unstale":"2024-09-12T02:41:55.078990+0000","last_undegraded":"2024-09-12T02:41:55.078990+0000","last_fullsized":"2024-09-12T02:41:55.078990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:06.766309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077706+0000","last_change":"2024-09-12T02:41:53.797692+0000","last_active":"2024-09-12T02:41:55.077706+0000","last_peered":"2024-09-12T02:41:55.077706+0000","last_clean":"2024-09-12T02:41:55.077706+0000","last_became_active":"2024-09-12T02:41:53.797478+0000","last_became_peered":"2024-09-12T02:41:53.797478+0000","last_unstale":"2024-09-12T02:41:55.077706+0000","last_undegraded":"2024-09-12T02:41:55.077706+0000","last_fullsized":"2024-09-12T02:41:55.077706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:01.317942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078580+0000","last_change":"2024-09-12T02:41:52.784485+0000","last_active":"2024-09-12T02:41:55.078580+0000","last_peered":"2024-09-12T02:41:55.078580+0000","last_clean":"2024-09-12T02:41:55.078580+0000","last_became_active":"2024-09-12T02:41:52.784183+0000","last_became_peered":"2024-09-12T02:41:52.784183+0000","last_unstale":"2024-09-12T02:41:55.078580+0000","last_undegraded":"2024-09-12T02:41:55.078580+0000","last_fullsized":"2024-09-12T02:41:55.078580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:32:59.235781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077471+0000","last_change":"2024-09-12T02:41:53.784634+0000","last_active":"2024-09-12T02:41:55.077471+0000","last_peered":"2024-09-12T02:41:55.077471+0000","last_clean":"2024-09-12T02:41:55.077471+0000","last_became_active":"2024-09-12T02:41:53.784120+0000","last_became_peered":"2024-09-12T02:41:53.784120+0000","last_unstale":"2024-09-12T02:41:55.077471+0000","last_undegraded":"2024-09-12T02:41:55.077471+0000","last_fullsized":"2024-09-12T02:41:55.077471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:13.615226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779120+0000","last_change":"2024-09-12T02:41:52.778974+0000","last_active":"2024-09-12T02:41:54.779120+0000","last_peered":"2024-09-12T02:41:54.779120+0000","last_clean":"2024-09-12T02:41:54.779120+0000","last_became_active":"2024-09-12T02:41:52.775107+0000","last_became_peered":"2024-09-12T02:41:52.775107+0000","last_unstale":"2024-09-12T02:41:54.779120+0000","last_undegraded":"2024-09-12T02:41:54.779120+0000","last_fullsized":"2024-09-12T02:41:54.779120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:37.256469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779025+0000","last_change":"2024-09-12T02:41:53.789090+0000","last_active":"2024-09-12T02:41:54.779025+0000","last_peered":"2024-09-12T02:41:54.779025+0000","last_clean":"2024-09-12T02:41:54.779025+0000","last_became_active":"2024-09-12T02:41:53.787863+0000","last_became_peered":"2024-09-12T02:41:53.787863+0000","last_unstale":"2024-09-12T02:41:54.779025+0000","last_undegraded":"2024-09-12T02:41:54.779025+0000","last_fullsized":"2024-09-12T02:41:54.779025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:09.744576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077689+0000","last_change":"2024-09-12T02:41:52.778197+0000","last_active":"2024-09-12T02:41:55.077689+0000","last_peered":"2024-09-12T02:41:55.077689+0000","last_clean":"2024-09-12T02:41:55.077689+0000","last_became_active":"2024-09-12T02:41:52.777887+0000","last_became_peered":"2024-09-12T02:41:52.777887+0000","last_unstale":"2024-09-12T02:41:55.077689+0000","last_undegraded":"2024-09-12T02:41:55.077689+0000","last_fullsized":"2024-09-12T02:41:55.077689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:30:08.364549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338276,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927614,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929136,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929100,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927614,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929226,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929066,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338220,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:42:02.597 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:42:02.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.759+0000 7f39c6400640 1 Processor -- start 2024-09-12T02:42:02.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.759+0000 7f39c6400640 1 -- start start 2024-09-12T02:42:02.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.760+0000 7f39c6400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39c015b9d0 0x7f39c00b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:02.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.760+0000 7f39c6400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f39c00b45d0 0x7f39c00728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:02.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.760+0000 7f39c6400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f39c006eef0 0x7f39c006f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:02.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.760+0000 7f39c6400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f39c00b4a30 con 0x7f39c00b45d0 2024-09-12T02:42:02.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.760+0000 7f39c6400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f39c006f840 con 0x7f39c006eef0 2024-09-12T02:42:02.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.760+0000 7f39c6400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f39c00b54a0 con 0x7f39c015b9d0 2024-09-12T02:42:02.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.760+0000 7f39b6a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f39c00b45d0 0x7f39c00728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:02.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.760+0000 7f39b6a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f39c00b45d0 0x7f39c00728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57544/0 (socket says 172.21.15.112:57544) 2024-09-12T02:42:02.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.760+0000 7f39b6a00640 1 -- 172.21.15.112:0/3590494467 learned_addr learned my addr 172.21.15.112:0/3590494467 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:02.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.761+0000 7f39bfe00640 1 --2- 172.21.15.112:0/3590494467 >> v2:172.21.15.137:3300/0 conn(0x7f39c006eef0 0x7f39c006f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:02.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.761+0000 7f39b6a00640 1 -- 172.21.15.112:0/3590494467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39c015b9d0 msgr2=0x7f39c00b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:02.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.761+0000 7f39bf400640 1 --2- 172.21.15.112:0/3590494467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39c015b9d0 0x7f39c00b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:02.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.761+0000 7f39b6a00640 1 --2- 172.21.15.112:0/3590494467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39c015b9d0 0x7f39c00b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:02.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.761+0000 7f39b6a00640 1 -- 172.21.15.112:0/3590494467 >> v2:172.21.15.137:3300/0 conn(0x7f39c006eef0 msgr2=0x7f39c006f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:02.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.761+0000 7f39b6a00640 1 --2- 172.21.15.112:0/3590494467 >> v2:172.21.15.137:3300/0 conn(0x7f39c006eef0 0x7f39c006f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:02.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.761+0000 7f39b6a00640 1 -- 172.21.15.112:0/3590494467 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c00b3af0 con 0x7f39c00b45d0 2024-09-12T02:42:02.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.761+0000 7f39bfe00640 1 --2- 172.21.15.112:0/3590494467 >> v2:172.21.15.137:3300/0 conn(0x7f39c006eef0 0x7f39c006f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:42:02.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.761+0000 7f39bf400640 1 --2- 172.21.15.112:0/3590494467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39c015b9d0 0x7f39c00b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:42:02.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.762+0000 7f39b6a00640 1 --2- 172.21.15.112:0/3590494467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c00b45d0 0x7f39c00728c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f39c0068670 tx=0x7f39a802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3418a169a9ed730 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:02.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.762+0000 7f39bea00640 1 -- 172.21.15.112:0/3590494467 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a8004030 con 0x7f39c00b45d0 2024-09-12T02:42:02.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.762+0000 7f39bea00640 1 -- 172.21.15.112:0/3590494467 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39a80041d0 con 0x7f39c00b45d0 2024-09-12T02:42:02.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.762+0000 7f39bea00640 1 -- 172.21.15.112:0/3590494467 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a8003610 con 0x7f39c00b45d0 2024-09-12T02:42:02.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.762+0000 7f39c6400640 1 -- 172.21.15.112:0/3590494467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c00b45d0 msgr2=0x7f39c00728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:02.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.762+0000 7f39c6400640 1 --2- 172.21.15.112:0/3590494467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c00b45d0 0x7f39c00728c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f39c0068670 tx=0x7f39a802a1c0 comp rx=0 tx=0).stop 2024-09-12T02:42:02.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.763+0000 7f39c6400640 1 -- 172.21.15.112:0/3590494467 shutdown_connections 2024-09-12T02:42:02.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.763+0000 7f39c6400640 1 --2- 172.21.15.112:0/3590494467 >> v2:172.21.15.137:3300/0 conn(0x7f39c006eef0 0x7f39c006f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:02.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.763+0000 7f39c6400640 1 --2- 172.21.15.112:0/3590494467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c00b45d0 0x7f39c00728c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:02.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.763+0000 7f39c6400640 1 --2- 172.21.15.112:0/3590494467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39c015b9d0 0x7f39c00b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:02.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.763+0000 7f39c6400640 1 -- 172.21.15.112:0/3590494467 >> 172.21.15.112:0/3590494467 conn(0x7f39c006bbd0 msgr2=0x7f39c006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:02.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.763+0000 7f39c6400640 1 -- 172.21.15.112:0/3590494467 shutdown_connections 2024-09-12T02:42:02.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.763+0000 7f39c6400640 1 -- 172.21.15.112:0/3590494467 wait complete. 2024-09-12T02:42:02.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.764+0000 7f39c6400640 1 Processor -- start 2024-09-12T02:42:02.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.764+0000 7f39c6400640 1 -- start start 2024-09-12T02:42:02.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.765+0000 7f39c6400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39c006eef0 0x7f39c0142340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:02.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.765+0000 7f39c6400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39c00b45d0 0x7f39c00cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:02.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.765+0000 7f39c6400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c015b9d0 0x7f39c00ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:02.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.765+0000 7f39c6400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f39c015bdb0 con 0x7f39c015b9d0 2024-09-12T02:42:02.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.765+0000 7f39c6400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f39c00b40b0 con 0x7f39c00b45d0 2024-09-12T02:42:02.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.765+0000 7f39c6400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f39c015bf30 con 0x7f39c006eef0 2024-09-12T02:42:02.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.765+0000 7f39bfe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c015b9d0 0x7f39c00ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:02.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.765+0000 7f39bfe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c015b9d0 0x7f39c00ce1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57554/0 (socket says 172.21.15.112:57554) 2024-09-12T02:42:02.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.765+0000 7f39bfe00640 1 -- 172.21.15.112:0/1046541685 learned_addr learned my addr 172.21.15.112:0/1046541685 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:02.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.766+0000 7f39b6a00640 1 --2- 172.21.15.112:0/1046541685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39c00b45d0 0x7f39c00cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:02.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.766+0000 7f39bf400640 1 --2- 172.21.15.112:0/1046541685 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39c006eef0 0x7f39c0142340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:02.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.766+0000 7f39bfe00640 1 -- 172.21.15.112:0/1046541685 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39c006eef0 msgr2=0x7f39c0142340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:02.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.766+0000 7f39bfe00640 1 --2- 172.21.15.112:0/1046541685 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39c006eef0 0x7f39c0142340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:02.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.766+0000 7f39bfe00640 1 -- 172.21.15.112:0/1046541685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39c00b45d0 msgr2=0x7f39c00cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:02.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.766+0000 7f39bfe00640 1 --2- 172.21.15.112:0/1046541685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39c00b45d0 0x7f39c00cdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:02.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.766+0000 7f39bfe00640 1 -- 172.21.15.112:0/1046541685 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c01540c0 con 0x7f39c015b9d0 2024-09-12T02:42:02.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.766+0000 7f39bfe00640 1 --2- 172.21.15.112:0/1046541685 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c015b9d0 0x7f39c00ce1d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f39b800cf20 tx=0x7f39b800a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:02.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.766+0000 7f39b7e00640 1 -- 172.21.15.112:0/1046541685 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b801a070 con 0x7f39c015b9d0 2024-09-12T02:42:02.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.766+0000 7f39b7e00640 1 -- 172.21.15.112:0/1046541685 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b800d840 con 0x7f39c015b9d0 2024-09-12T02:42:02.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.766+0000 7f39c6400640 1 -- 172.21.15.112:0/1046541685 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c0151540 con 0x7f39c015b9d0 2024-09-12T02:42:02.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.766+0000 7f39b7e00640 1 -- 172.21.15.112:0/1046541685 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b800dc30 con 0x7f39c015b9d0 2024-09-12T02:42:02.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.767+0000 7f39c6400640 1 -- 172.21.15.112:0/1046541685 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c0142880 con 0x7f39c015b9d0 2024-09-12T02:42:02.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.768+0000 7f39c6400640 1 -- 172.21.15.112:0/1046541685 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39c0068a30 con 0x7f39c015b9d0 2024-09-12T02:42:02.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.768+0000 7f39b7e00640 1 -- 172.21.15.112:0/1046541685 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f39b801d070 con 0x7f39c015b9d0 2024-09-12T02:42:02.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.769+0000 7f39b7e00640 1 --2- 172.21.15.112:0/1046541685 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f399c06be60 0x7f399c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:02.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.769+0000 7f39b7e00640 1 -- 172.21.15.112:0/1046541685 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f39b808b690 con 0x7f39c015b9d0 2024-09-12T02:42:02.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.769+0000 7f39bf400640 1 --2- 172.21.15.112:0/1046541685 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f399c06be60 0x7f399c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:02.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.770+0000 7f39bf400640 1 --2- 172.21.15.112:0/1046541685 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f399c06be60 0x7f399c06e320 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f39b000aa40 tx=0x7f39b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:02.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.774+0000 7f39b7e00640 1 -- 172.21.15.112:0/1046541685 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f39b80599e0 con 0x7f39c015b9d0 2024-09-12T02:42:02.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.943+0000 7f39c6400640 1 -- 172.21.15.112:0/1046541685 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f39c00b2170 con 0x7f399c06be60 2024-09-12T02:42:02.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.949+0000 7f39b7e00640 1 -- 172.21.15.112:0/1046541685 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247484 (secure 0 0 0) 0x7f39c00b2170 con 0x7f399c06be60 2024-09-12T02:42:02.953 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:42:02.954 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:42:02.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.953+0000 7f39c6400640 1 -- 172.21.15.112:0/1046541685 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f399c06be60 msgr2=0x7f399c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:02.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.953+0000 7f39c6400640 1 --2- 172.21.15.112:0/1046541685 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f399c06be60 0x7f399c06e320 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f39b000aa40 tx=0x7f39b0008040 comp rx=0 tx=0).stop 2024-09-12T02:42:02.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.953+0000 7f39c6400640 1 -- 172.21.15.112:0/1046541685 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c015b9d0 msgr2=0x7f39c00ce1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:02.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.953+0000 7f39c6400640 1 --2- 172.21.15.112:0/1046541685 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c015b9d0 0x7f39c00ce1d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f39b800cf20 tx=0x7f39b800a7d0 comp rx=0 tx=0).stop 2024-09-12T02:42:02.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.953+0000 7f39c6400640 1 -- 172.21.15.112:0/1046541685 shutdown_connections 2024-09-12T02:42:02.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.953+0000 7f39c6400640 1 --2- 172.21.15.112:0/1046541685 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c015b9d0 0x7f39c00ce1d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:02.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.953+0000 7f39c6400640 1 --2- 172.21.15.112:0/1046541685 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f399c06be60 0x7f399c06e320 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:02.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.953+0000 7f39c6400640 1 --2- 172.21.15.112:0/1046541685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39c00b45d0 0x7f39c00cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:02.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.953+0000 7f39c6400640 1 --2- 172.21.15.112:0/1046541685 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39c006eef0 0x7f39c0142340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:02.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.953+0000 7f39c6400640 1 -- 172.21.15.112:0/1046541685 >> 172.21.15.112:0/1046541685 conn(0x7f39c006bbd0 msgr2=0x7f39c00b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:02.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.953+0000 7f39c6400640 1 -- 172.21.15.112:0/1046541685 shutdown_connections 2024-09-12T02:42:02.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:02.953+0000 7f39c6400640 1 -- 172.21.15.112:0/1046541685 wait complete. 2024-09-12T02:42:02.970 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-12T02:42:00.960112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560789,"statfs":{"total":1600000000,"available":1598248252,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001649"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078585+0000","last_change":"2024-09-12T02:41:53.797392+0000","last_active":"2024-09-12T02:41:55.078585+0000","last_peered":"2024-09-12T02:41:55.078585+0000","last_clean":"2024-09-12T02:41:55.078585+0000","last_became_active":"2024-09-12T02:41:53.797125+0000","last_became_peered":"2024-09-12T02:41:53.797125+0000","last_unstale":"2024-09-12T02:41:55.078585+0000","last_undegraded":"2024-09-12T02:41:55.078585+0000","last_fullsized":"2024-09-12T02:41:55.078585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:13.937351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807042+0000","last_change":"2024-09-12T02:41:53.788184+0000","last_active":"2024-09-12T02:41:54.807042+0000","last_peered":"2024-09-12T02:41:54.807042+0000","last_clean":"2024-09-12T02:41:54.807042+0000","last_became_active":"2024-09-12T02:41:53.787657+0000","last_became_peered":"2024-09-12T02:41:53.787657+0000","last_unstale":"2024-09-12T02:41:54.807042+0000","last_undegraded":"2024-09-12T02:41:54.807042+0000","last_fullsized":"2024-09-12T02:41:54.807042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:00.508038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077174+0000","last_change":"2024-09-12T02:41:53.784382+0000","last_active":"2024-09-12T02:41:55.077174+0000","last_peered":"2024-09-12T02:41:55.077174+0000","last_clean":"2024-09-12T02:41:55.077174+0000","last_became_active":"2024-09-12T02:41:53.783794+0000","last_became_peered":"2024-09-12T02:41:53.783794+0000","last_unstale":"2024-09-12T02:41:55.077174+0000","last_undegraded":"2024-09-12T02:41:55.077174+0000","last_fullsized":"2024-09-12T02:41:55.077174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:39.931644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077555+0000","last_change":"2024-09-12T02:41:53.802556+0000","last_active":"2024-09-12T02:41:55.077555+0000","last_peered":"2024-09-12T02:41:55.077555+0000","last_clean":"2024-09-12T02:41:55.077555+0000","last_became_active":"2024-09-12T02:41:53.800988+0000","last_became_peered":"2024-09-12T02:41:53.800988+0000","last_unstale":"2024-09-12T02:41:55.077555+0000","last_undegraded":"2024-09-12T02:41:55.077555+0000","last_fullsized":"2024-09-12T02:41:55.077555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:30.535176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078189+0000","last_change":"2024-09-12T02:41:53.797970+0000","last_active":"2024-09-12T02:41:55.078189+0000","last_peered":"2024-09-12T02:41:55.078189+0000","last_clean":"2024-09-12T02:41:55.078189+0000","last_became_active":"2024-09-12T02:41:53.797733+0000","last_became_peered":"2024-09-12T02:41:53.797733+0000","last_unstale":"2024-09-12T02:41:55.078189+0000","last_undegraded":"2024-09-12T02:41:55.078189+0000","last_fullsized":"2024-09-12T02:41:55.078189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:17.074361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077537+0000","last_change":"2024-09-12T02:41:53.791772+0000","last_active":"2024-09-12T02:41:55.077537+0000","last_peered":"2024-09-12T02:41:55.077537+0000","last_clean":"2024-09-12T02:41:55.077537+0000","last_became_active":"2024-09-12T02:41:53.791424+0000","last_became_peered":"2024-09-12T02:41:53.791424+0000","last_unstale":"2024-09-12T02:41:55.077537+0000","last_undegraded":"2024-09-12T02:41:55.077537+0000","last_fullsized":"2024-09-12T02:41:55.077537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:25.569705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077547+0000","last_change":"2024-09-12T02:41:53.793680+0000","last_active":"2024-09-12T02:41:55.077547+0000","last_peered":"2024-09-12T02:41:55.077547+0000","last_clean":"2024-09-12T02:41:55.077547+0000","last_became_active":"2024-09-12T02:41:53.793368+0000","last_became_peered":"2024-09-12T02:41:53.793368+0000","last_unstale":"2024-09-12T02:41:55.077547+0000","last_undegraded":"2024-09-12T02:41:55.077547+0000","last_fullsized":"2024-09-12T02:41:55.077547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:22.379829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778606+0000","last_change":"2024-09-12T02:41:53.792905+0000","last_active":"2024-09-12T02:41:54.778606+0000","last_peered":"2024-09-12T02:41:54.778606+0000","last_clean":"2024-09-12T02:41:54.778606+0000","last_became_active":"2024-09-12T02:41:53.792671+0000","last_became_peered":"2024-09-12T02:41:53.792671+0000","last_unstale":"2024-09-12T02:41:54.778606+0000","last_undegraded":"2024-09-12T02:41:54.778606+0000","last_fullsized":"2024-09-12T02:41:54.778606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:00:54.016660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077148+0000","last_change":"2024-09-12T02:41:53.796393+0000","last_active":"2024-09-12T02:41:55.077148+0000","last_peered":"2024-09-12T02:41:55.077148+0000","last_clean":"2024-09-12T02:41:55.077148+0000","last_became_active":"2024-09-12T02:41:53.793674+0000","last_became_peered":"2024-09-12T02:41:53.793674+0000","last_unstale":"2024-09-12T02:41:55.077148+0000","last_undegraded":"2024-09-12T02:41:55.077148+0000","last_fullsized":"2024-09-12T02:41:55.077148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:54.885587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778956+0000","last_change":"2024-09-12T02:41:53.790533+0000","last_active":"2024-09-12T02:41:54.778956+0000","last_peered":"2024-09-12T02:41:54.778956+0000","last_clean":"2024-09-12T02:41:54.778956+0000","last_became_active":"2024-09-12T02:41:53.790257+0000","last_became_peered":"2024-09-12T02:41:53.790257+0000","last_unstale":"2024-09-12T02:41:54.778956+0000","last_undegraded":"2024-09-12T02:41:54.778956+0000","last_fullsized":"2024-09-12T02:41:54.778956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:36.766374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778448+0000","last_change":"2024-09-12T02:41:53.791181+0000","last_active":"2024-09-12T02:41:54.778448+0000","last_peered":"2024-09-12T02:41:54.778448+0000","last_clean":"2024-09-12T02:41:54.778448+0000","last_became_active":"2024-09-12T02:41:53.790949+0000","last_became_peered":"2024-09-12T02:41:53.790949+0000","last_unstale":"2024-09-12T02:41:54.778448+0000","last_undegraded":"2024-09-12T02:41:54.778448+0000","last_fullsized":"2024-09-12T02:41:54.778448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:00.547705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.777369+0000","last_change":"2024-09-12T02:41:53.798287+0000","last_active":"2024-09-12T02:41:54.777369+0000","last_peered":"2024-09-12T02:41:54.777369+0000","last_clean":"2024-09-12T02:41:54.777369+0000","last_became_active":"2024-09-12T02:41:53.793517+0000","last_became_peered":"2024-09-12T02:41:53.793517+0000","last_unstale":"2024-09-12T02:41:54.777369+0000","last_undegraded":"2024-09-12T02:41:54.777369+0000","last_fullsized":"2024-09-12T02:41:54.777369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:38.907340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778829+0000","last_change":"2024-09-12T02:41:53.789083+0000","last_active":"2024-09-12T02:41:54.778829+0000","last_peered":"2024-09-12T02:41:54.778829+0000","last_clean":"2024-09-12T02:41:54.778829+0000","last_became_active":"2024-09-12T02:41:53.788859+0000","last_became_peered":"2024-09-12T02:41:53.788859+0000","last_unstale":"2024-09-12T02:41:54.778829+0000","last_undegraded":"2024-09-12T02:41:54.778829+0000","last_fullsized":"2024-09-12T02:41:54.778829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:11.768330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.076853+0000","last_change":"2024-09-12T02:41:53.786959+0000","last_active":"2024-09-12T02:41:55.076853+0000","last_peered":"2024-09-12T02:41:55.076853+0000","last_clean":"2024-09-12T02:41:55.076853+0000","last_became_active":"2024-09-12T02:41:53.786741+0000","last_became_peered":"2024-09-12T02:41:53.786741+0000","last_unstale":"2024-09-12T02:41:55.076853+0000","last_undegraded":"2024-09-12T02:41:55.076853+0000","last_fullsized":"2024-09-12T02:41:55.076853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:01.095924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807133+0000","last_change":"2024-09-12T02:41:53.790655+0000","last_active":"2024-09-12T02:41:54.807133+0000","last_peered":"2024-09-12T02:41:54.807133+0000","last_clean":"2024-09-12T02:41:54.807133+0000","last_became_active":"2024-09-12T02:41:53.789451+0000","last_became_peered":"2024-09-12T02:41:53.789451+0000","last_unstale":"2024-09-12T02:41:54.807133+0000","last_undegraded":"2024-09-12T02:41:54.807133+0000","last_fullsized":"2024-09-12T02:41:54.807133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:46.250242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077369+0000","last_change":"2024-09-12T02:41:53.787343+0000","last_active":"2024-09-12T02:41:55.077369+0000","last_peered":"2024-09-12T02:41:55.077369+0000","last_clean":"2024-09-12T02:41:55.077369+0000","last_became_active":"2024-09-12T02:41:53.787093+0000","last_became_peered":"2024-09-12T02:41:53.787093+0000","last_unstale":"2024-09-12T02:41:55.077369+0000","last_undegraded":"2024-09-12T02:41:55.077369+0000","last_fullsized":"2024-09-12T02:41:55.077369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:22.694954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077436+0000","last_change":"2024-09-12T02:41:53.799488+0000","last_active":"2024-09-12T02:41:55.077436+0000","last_peered":"2024-09-12T02:41:55.077436+0000","last_clean":"2024-09-12T02:41:55.077436+0000","last_became_active":"2024-09-12T02:41:53.798618+0000","last_became_peered":"2024-09-12T02:41:53.798618+0000","last_unstale":"2024-09-12T02:41:55.077436+0000","last_undegraded":"2024-09-12T02:41:55.077436+0000","last_fullsized":"2024-09-12T02:41:55.077436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:32.649809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.076898+0000","last_change":"2024-09-12T02:41:53.786850+0000","last_active":"2024-09-12T02:41:55.076898+0000","last_peered":"2024-09-12T02:41:55.076898+0000","last_clean":"2024-09-12T02:41:55.076898+0000","last_became_active":"2024-09-12T02:41:53.786615+0000","last_became_peered":"2024-09-12T02:41:53.786615+0000","last_unstale":"2024-09-12T02:41:55.076898+0000","last_undegraded":"2024-09-12T02:41:55.076898+0000","last_fullsized":"2024-09-12T02:41:55.076898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:21.015757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077473+0000","last_change":"2024-09-12T02:41:53.794425+0000","last_active":"2024-09-12T02:41:55.077473+0000","last_peered":"2024-09-12T02:41:55.077473+0000","last_clean":"2024-09-12T02:41:55.077473+0000","last_became_active":"2024-09-12T02:41:53.793319+0000","last_became_peered":"2024-09-12T02:41:53.793319+0000","last_unstale":"2024-09-12T02:41:55.077473+0000","last_undegraded":"2024-09-12T02:41:55.077473+0000","last_fullsized":"2024-09-12T02:41:55.077473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:04.162670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779169+0000","last_change":"2024-09-12T02:41:53.795094+0000","last_active":"2024-09-12T02:41:54.779169+0000","last_peered":"2024-09-12T02:41:54.779169+0000","last_clean":"2024-09-12T02:41:54.779169+0000","last_became_active":"2024-09-12T02:41:53.794841+0000","last_became_peered":"2024-09-12T02:41:53.794841+0000","last_unstale":"2024-09-12T02:41:54.779169+0000","last_undegraded":"2024-09-12T02:41:54.779169+0000","last_fullsized":"2024-09-12T02:41:54.779169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:58.970487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077484+0000","last_change":"2024-09-12T02:41:53.794039+0000","last_active":"2024-09-12T02:41:55.077484+0000","last_peered":"2024-09-12T02:41:55.077484+0000","last_clean":"2024-09-12T02:41:55.077484+0000","last_became_active":"2024-09-12T02:41:53.793709+0000","last_became_peered":"2024-09-12T02:41:53.793709+0000","last_unstale":"2024-09-12T02:41:55.077484+0000","last_undegraded":"2024-09-12T02:41:55.077484+0000","last_fullsized":"2024-09-12T02:41:55.077484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:53:04.907858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077745+0000","last_change":"2024-09-12T02:41:53.799240+0000","last_active":"2024-09-12T02:41:55.077745+0000","last_peered":"2024-09-12T02:41:55.077745+0000","last_clean":"2024-09-12T02:41:55.077745+0000","last_became_active":"2024-09-12T02:41:53.798310+0000","last_became_peered":"2024-09-12T02:41:53.798310+0000","last_unstale":"2024-09-12T02:41:55.077745+0000","last_undegraded":"2024-09-12T02:41:55.077745+0000","last_fullsized":"2024-09-12T02:41:55.077745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:28.511208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779010+0000","last_change":"2024-09-12T02:41:53.797034+0000","last_active":"2024-09-12T02:41:54.779010+0000","last_peered":"2024-09-12T02:41:54.779010+0000","last_clean":"2024-09-12T02:41:54.779010+0000","last_became_active":"2024-09-12T02:41:53.796810+0000","last_became_peered":"2024-09-12T02:41:53.796810+0000","last_unstale":"2024-09-12T02:41:54.779010+0000","last_undegraded":"2024-09-12T02:41:54.779010+0000","last_fullsized":"2024-09-12T02:41:54.779010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:33.181523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077704+0000","last_change":"2024-09-12T02:41:53.801270+0000","last_active":"2024-09-12T02:41:55.077704+0000","last_peered":"2024-09-12T02:41:55.077704+0000","last_clean":"2024-09-12T02:41:55.077704+0000","last_became_active":"2024-09-12T02:41:53.798339+0000","last_became_peered":"2024-09-12T02:41:53.798339+0000","last_unstale":"2024-09-12T02:41:55.077704+0000","last_undegraded":"2024-09-12T02:41:55.077704+0000","last_fullsized":"2024-09-12T02:41:55.077704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:09.271851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778820+0000","last_change":"2024-09-12T02:41:53.794645+0000","last_active":"2024-09-12T02:41:54.778820+0000","last_peered":"2024-09-12T02:41:54.778820+0000","last_clean":"2024-09-12T02:41:54.778820+0000","last_became_active":"2024-09-12T02:41:53.794420+0000","last_became_peered":"2024-09-12T02:41:53.794420+0000","last_unstale":"2024-09-12T02:41:54.778820+0000","last_undegraded":"2024-09-12T02:41:54.778820+0000","last_fullsized":"2024-09-12T02:41:54.778820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:02.170329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778605+0000","last_change":"2024-09-12T02:41:53.795644+0000","last_active":"2024-09-12T02:41:54.778605+0000","last_peered":"2024-09-12T02:41:54.778605+0000","last_clean":"2024-09-12T02:41:54.778605+0000","last_became_active":"2024-09-12T02:41:53.795305+0000","last_became_peered":"2024-09-12T02:41:53.795305+0000","last_unstale":"2024-09-12T02:41:54.778605+0000","last_undegraded":"2024-09-12T02:41:54.778605+0000","last_fullsized":"2024-09-12T02:41:54.778605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:38.620097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807201+0000","last_change":"2024-09-12T02:41:53.784403+0000","last_active":"2024-09-12T02:41:54.807201+0000","last_peered":"2024-09-12T02:41:54.807201+0000","last_clean":"2024-09-12T02:41:54.807201+0000","last_became_active":"2024-09-12T02:41:53.784173+0000","last_became_peered":"2024-09-12T02:41:53.784173+0000","last_unstale":"2024-09-12T02:41:54.807201+0000","last_undegraded":"2024-09-12T02:41:54.807201+0000","last_fullsized":"2024-09-12T02:41:54.807201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:03.404034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779149+0000","last_change":"2024-09-12T02:41:53.796925+0000","last_active":"2024-09-12T02:41:54.779149+0000","last_peered":"2024-09-12T02:41:54.779149+0000","last_clean":"2024-09-12T02:41:54.779149+0000","last_became_active":"2024-09-12T02:41:53.796640+0000","last_became_peered":"2024-09-12T02:41:53.796640+0000","last_unstale":"2024-09-12T02:41:54.779149+0000","last_undegraded":"2024-09-12T02:41:54.779149+0000","last_fullsized":"2024-09-12T02:41:54.779149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:05.118176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.076988+0000","last_change":"2024-09-12T02:41:53.784042+0000","last_active":"2024-09-12T02:41:55.076988+0000","last_peered":"2024-09-12T02:41:55.076988+0000","last_clean":"2024-09-12T02:41:55.076988+0000","last_became_active":"2024-09-12T02:41:53.783817+0000","last_became_peered":"2024-09-12T02:41:53.783817+0000","last_unstale":"2024-09-12T02:41:55.076988+0000","last_undegraded":"2024-09-12T02:41:55.076988+0000","last_fullsized":"2024-09-12T02:41:55.076988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:31.997189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077165+0000","last_change":"2024-09-12T02:41:53.796678+0000","last_active":"2024-09-12T02:41:55.077165+0000","last_peered":"2024-09-12T02:41:55.077165+0000","last_clean":"2024-09-12T02:41:55.077165+0000","last_became_active":"2024-09-12T02:41:53.796473+0000","last_became_peered":"2024-09-12T02:41:53.796473+0000","last_unstale":"2024-09-12T02:41:55.077165+0000","last_undegraded":"2024-09-12T02:41:55.077165+0000","last_fullsized":"2024-09-12T02:41:55.077165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:14.697130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.076930+0000","last_change":"2024-09-12T02:41:53.787664+0000","last_active":"2024-09-12T02:41:55.076930+0000","last_peered":"2024-09-12T02:41:55.076930+0000","last_clean":"2024-09-12T02:41:55.076930+0000","last_became_active":"2024-09-12T02:41:53.786817+0000","last_became_peered":"2024-09-12T02:41:53.786817+0000","last_unstale":"2024-09-12T02:41:55.076930+0000","last_undegraded":"2024-09-12T02:41:55.076930+0000","last_fullsized":"2024-09-12T02:41:55.076930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:02.531079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778460+0000","last_change":"2024-09-12T02:41:53.785375+0000","last_active":"2024-09-12T02:41:54.778460+0000","last_peered":"2024-09-12T02:41:54.778460+0000","last_clean":"2024-09-12T02:41:54.778460+0000","last_became_active":"2024-09-12T02:41:53.785070+0000","last_became_peered":"2024-09-12T02:41:53.785070+0000","last_unstale":"2024-09-12T02:41:54.778460+0000","last_undegraded":"2024-09-12T02:41:54.778460+0000","last_fullsized":"2024-09-12T02:41:54.778460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:49.213437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.777581+0000","last_change":"2024-09-12T02:41:53.795446+0000","last_active":"2024-09-12T02:41:54.777581+0000","last_peered":"2024-09-12T02:41:54.777581+0000","last_clean":"2024-09-12T02:41:54.777581+0000","last_became_active":"2024-09-12T02:41:53.795189+0000","last_became_peered":"2024-09-12T02:41:53.795189+0000","last_unstale":"2024-09-12T02:41:54.777581+0000","last_undegraded":"2024-09-12T02:41:54.777581+0000","last_fullsized":"2024-09-12T02:41:54.777581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:31.783821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779103+0000","last_change":"2024-09-12T02:41:52.782761+0000","last_active":"2024-09-12T02:41:54.779103+0000","last_peered":"2024-09-12T02:41:54.779103+0000","last_clean":"2024-09-12T02:41:54.779103+0000","last_became_active":"2024-09-12T02:41:52.782565+0000","last_became_peered":"2024-09-12T02:41:52.782565+0000","last_unstale":"2024-09-12T02:41:54.779103+0000","last_undegraded":"2024-09-12T02:41:54.779103+0000","last_fullsized":"2024-09-12T02:41:54.779103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:21.927114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077231+0000","last_change":"2024-09-12T02:41:53.791180+0000","last_active":"2024-09-12T02:41:55.077231+0000","last_peered":"2024-09-12T02:41:55.077231+0000","last_clean":"2024-09-12T02:41:55.077231+0000","last_became_active":"2024-09-12T02:41:53.790843+0000","last_became_peered":"2024-09-12T02:41:53.790843+0000","last_unstale":"2024-09-12T02:41:55.077231+0000","last_undegraded":"2024-09-12T02:41:55.077231+0000","last_fullsized":"2024-09-12T02:41:55.077231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:58.801201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778651+0000","last_change":"2024-09-12T02:41:52.775582+0000","last_active":"2024-09-12T02:41:54.778651+0000","last_peered":"2024-09-12T02:41:54.778651+0000","last_clean":"2024-09-12T02:41:54.778651+0000","last_became_active":"2024-09-12T02:41:52.774577+0000","last_became_peered":"2024-09-12T02:41:52.774577+0000","last_unstale":"2024-09-12T02:41:54.778651+0000","last_undegraded":"2024-09-12T02:41:54.778651+0000","last_fullsized":"2024-09-12T02:41:54.778651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:36.018405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779210+0000","last_change":"2024-09-12T02:41:52.777181+0000","last_active":"2024-09-12T02:41:54.779210+0000","last_peered":"2024-09-12T02:41:54.779210+0000","last_clean":"2024-09-12T02:41:54.779210+0000","last_became_active":"2024-09-12T02:41:52.773406+0000","last_became_peered":"2024-09-12T02:41:52.773406+0000","last_unstale":"2024-09-12T02:41:54.779210+0000","last_undegraded":"2024-09-12T02:41:54.779210+0000","last_fullsized":"2024-09-12T02:41:54.779210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:20.740967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778971+0000","last_change":"2024-09-12T02:41:53.784557+0000","last_active":"2024-09-12T02:41:54.778971+0000","last_peered":"2024-09-12T02:41:54.778971+0000","last_clean":"2024-09-12T02:41:54.778971+0000","last_became_active":"2024-09-12T02:41:53.784163+0000","last_became_peered":"2024-09-12T02:41:53.784163+0000","last_unstale":"2024-09-12T02:41:54.778971+0000","last_undegraded":"2024-09-12T02:41:54.778971+0000","last_fullsized":"2024-09-12T02:41:54.778971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:37.011519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077434+0000","last_change":"2024-09-12T02:41:52.783587+0000","last_active":"2024-09-12T02:41:55.077434+0000","last_peered":"2024-09-12T02:41:55.077434+0000","last_clean":"2024-09-12T02:41:55.077434+0000","last_became_active":"2024-09-12T02:41:52.783418+0000","last_became_peered":"2024-09-12T02:41:52.783418+0000","last_unstale":"2024-09-12T02:41:55.077434+0000","last_undegraded":"2024-09-12T02:41:55.077434+0000","last_fullsized":"2024-09-12T02:41:55.077434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:39:33.808133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807122+0000","last_change":"2024-09-12T02:41:53.792483+0000","last_active":"2024-09-12T02:41:54.807122+0000","last_peered":"2024-09-12T02:41:54.807122+0000","last_clean":"2024-09-12T02:41:54.807122+0000","last_became_active":"2024-09-12T02:41:53.791556+0000","last_became_peered":"2024-09-12T02:41:53.791556+0000","last_unstale":"2024-09-12T02:41:54.807122+0000","last_undegraded":"2024-09-12T02:41:54.807122+0000","last_fullsized":"2024-09-12T02:41:54.807122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:27.695745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778786+0000","last_change":"2024-09-12T02:41:52.771541+0000","last_active":"2024-09-12T02:41:54.778786+0000","last_peered":"2024-09-12T02:41:54.778786+0000","last_clean":"2024-09-12T02:41:54.778786+0000","last_became_active":"2024-09-12T02:41:52.770232+0000","last_became_peered":"2024-09-12T02:41:52.770232+0000","last_unstale":"2024-09-12T02:41:54.778786+0000","last_undegraded":"2024-09-12T02:41:54.778786+0000","last_fullsized":"2024-09-12T02:41:54.778786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:13.405791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077589+0000","last_change":"2024-09-12T02:41:53.799033+0000","last_active":"2024-09-12T02:41:55.077589+0000","last_peered":"2024-09-12T02:41:55.077589+0000","last_clean":"2024-09-12T02:41:55.077589+0000","last_became_active":"2024-09-12T02:41:53.797973+0000","last_became_peered":"2024-09-12T02:41:53.797973+0000","last_unstale":"2024-09-12T02:41:55.077589+0000","last_undegraded":"2024-09-12T02:41:55.077589+0000","last_fullsized":"2024-09-12T02:41:55.077589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:12.141704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078072+0000","last_change":"2024-09-12T02:41:52.780065+0000","last_active":"2024-09-12T02:41:55.078072+0000","last_peered":"2024-09-12T02:41:55.078072+0000","last_clean":"2024-09-12T02:41:55.078072+0000","last_became_active":"2024-09-12T02:41:52.778398+0000","last_became_peered":"2024-09-12T02:41:52.778398+0000","last_unstale":"2024-09-12T02:41:55.078072+0000","last_undegraded":"2024-09-12T02:41:55.078072+0000","last_fullsized":"2024-09-12T02:41:55.078072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:58.549424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077632+0000","last_change":"2024-09-12T02:41:53.788794+0000","last_active":"2024-09-12T02:41:55.077632+0000","last_peered":"2024-09-12T02:41:55.077632+0000","last_clean":"2024-09-12T02:41:55.077632+0000","last_became_active":"2024-09-12T02:41:53.788300+0000","last_became_peered":"2024-09-12T02:41:53.788300+0000","last_unstale":"2024-09-12T02:41:55.077632+0000","last_undegraded":"2024-09-12T02:41:55.077632+0000","last_fullsized":"2024-09-12T02:41:55.077632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:45.111485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807225+0000","last_change":"2024-09-12T02:41:52.781616+0000","last_active":"2024-09-12T02:41:54.807225+0000","last_peered":"2024-09-12T02:41:54.807225+0000","last_clean":"2024-09-12T02:41:54.807225+0000","last_became_active":"2024-09-12T02:41:52.781376+0000","last_became_peered":"2024-09-12T02:41:52.781376+0000","last_unstale":"2024-09-12T02:41:54.807225+0000","last_undegraded":"2024-09-12T02:41:54.807225+0000","last_fullsized":"2024-09-12T02:41:54.807225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:29.040560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.777378+0000","last_change":"2024-09-12T02:41:53.801788+0000","last_active":"2024-09-12T02:41:54.777378+0000","last_peered":"2024-09-12T02:41:54.777378+0000","last_clean":"2024-09-12T02:41:54.777378+0000","last_became_active":"2024-09-12T02:41:53.801572+0000","last_became_peered":"2024-09-12T02:41:53.801572+0000","last_unstale":"2024-09-12T02:41:54.777378+0000","last_undegraded":"2024-09-12T02:41:54.777378+0000","last_fullsized":"2024-09-12T02:41:54.777378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:44.395638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778605+0000","last_change":"2024-09-12T02:41:52.776998+0000","last_active":"2024-09-12T02:41:54.778605+0000","last_peered":"2024-09-12T02:41:54.778605+0000","last_clean":"2024-09-12T02:41:54.778605+0000","last_became_active":"2024-09-12T02:41:52.776765+0000","last_became_peered":"2024-09-12T02:41:52.776765+0000","last_unstale":"2024-09-12T02:41:54.778605+0000","last_undegraded":"2024-09-12T02:41:54.778605+0000","last_fullsized":"2024-09-12T02:41:54.778605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:34.024741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077170+0000","last_change":"2024-09-12T02:41:53.795517+0000","last_active":"2024-09-12T02:41:55.077170+0000","last_peered":"2024-09-12T02:41:55.077170+0000","last_clean":"2024-09-12T02:41:55.077170+0000","last_became_active":"2024-09-12T02:41:53.795260+0000","last_became_peered":"2024-09-12T02:41:53.795260+0000","last_unstale":"2024-09-12T02:41:55.077170+0000","last_undegraded":"2024-09-12T02:41:55.077170+0000","last_fullsized":"2024-09-12T02:41:55.077170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:41.612631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077159+0000","last_change":"2024-09-12T02:41:52.770092+0000","last_active":"2024-09-12T02:41:55.077159+0000","last_peered":"2024-09-12T02:41:55.077159+0000","last_clean":"2024-09-12T02:41:55.077159+0000","last_became_active":"2024-09-12T02:41:52.769364+0000","last_became_peered":"2024-09-12T02:41:52.769364+0000","last_unstale":"2024-09-12T02:41:55.077159+0000","last_undegraded":"2024-09-12T02:41:55.077159+0000","last_fullsized":"2024-09-12T02:41:55.077159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:59.882002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077762+0000","last_change":"2024-09-12T02:41:53.793864+0000","last_active":"2024-09-12T02:41:55.077762+0000","last_peered":"2024-09-12T02:41:55.077762+0000","last_clean":"2024-09-12T02:41:55.077762+0000","last_became_active":"2024-09-12T02:41:53.793422+0000","last_became_peered":"2024-09-12T02:41:53.793422+0000","last_unstale":"2024-09-12T02:41:55.077762+0000","last_undegraded":"2024-09-12T02:41:55.077762+0000","last_fullsized":"2024-09-12T02:41:55.077762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:46.256453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078076+0000","last_change":"2024-09-12T02:41:52.780555+0000","last_active":"2024-09-12T02:41:55.078076+0000","last_peered":"2024-09-12T02:41:55.078076+0000","last_clean":"2024-09-12T02:41:55.078076+0000","last_became_active":"2024-09-12T02:41:52.775956+0000","last_became_peered":"2024-09-12T02:41:52.775956+0000","last_unstale":"2024-09-12T02:41:55.078076+0000","last_undegraded":"2024-09-12T02:41:55.078076+0000","last_fullsized":"2024-09-12T02:41:55.078076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:07.893393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078331+0000","last_change":"2024-09-12T02:41:53.803353+0000","last_active":"2024-09-12T02:41:55.078331+0000","last_peered":"2024-09-12T02:41:55.078331+0000","last_clean":"2024-09-12T02:41:55.078331+0000","last_became_active":"2024-09-12T02:41:53.802739+0000","last_became_peered":"2024-09-12T02:41:53.802739+0000","last_unstale":"2024-09-12T02:41:55.078331+0000","last_undegraded":"2024-09-12T02:41:55.078331+0000","last_fullsized":"2024-09-12T02:41:55.078331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:54.124099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778844+0000","last_change":"2024-09-12T02:41:52.766630+0000","last_active":"2024-09-12T02:41:54.778844+0000","last_peered":"2024-09-12T02:41:54.778844+0000","last_clean":"2024-09-12T02:41:54.778844+0000","last_became_active":"2024-09-12T02:41:52.766146+0000","last_became_peered":"2024-09-12T02:41:52.766146+0000","last_unstale":"2024-09-12T02:41:54.778844+0000","last_undegraded":"2024-09-12T02:41:54.778844+0000","last_fullsized":"2024-09-12T02:41:54.778844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:54.001676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778544+0000","last_change":"2024-09-12T02:41:53.786241+0000","last_active":"2024-09-12T02:41:54.778544+0000","last_peered":"2024-09-12T02:41:54.778544+0000","last_clean":"2024-09-12T02:41:54.778544+0000","last_became_active":"2024-09-12T02:41:53.785997+0000","last_became_peered":"2024-09-12T02:41:53.785997+0000","last_unstale":"2024-09-12T02:41:54.778544+0000","last_undegraded":"2024-09-12T02:41:54.778544+0000","last_fullsized":"2024-09-12T02:41:54.778544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:54.645416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.076987+0000","last_change":"2024-09-12T02:41:52.775019+0000","last_active":"2024-09-12T02:41:55.076987+0000","last_peered":"2024-09-12T02:41:55.076987+0000","last_clean":"2024-09-12T02:41:55.076987+0000","last_became_active":"2024-09-12T02:41:52.774766+0000","last_became_peered":"2024-09-12T02:41:52.774766+0000","last_unstale":"2024-09-12T02:41:55.076987+0000","last_undegraded":"2024-09-12T02:41:55.076987+0000","last_fullsized":"2024-09-12T02:41:55.076987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:28.082972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077793+0000","last_change":"2024-09-12T02:41:53.803073+0000","last_active":"2024-09-12T02:41:55.077793+0000","last_peered":"2024-09-12T02:41:55.077793+0000","last_clean":"2024-09-12T02:41:55.077793+0000","last_became_active":"2024-09-12T02:41:53.802791+0000","last_became_peered":"2024-09-12T02:41:53.802791+0000","last_unstale":"2024-09-12T02:41:55.077793+0000","last_undegraded":"2024-09-12T02:41:55.077793+0000","last_fullsized":"2024-09-12T02:41:55.077793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:14.115868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.777508+0000","last_change":"2024-09-12T02:41:52.767949+0000","last_active":"2024-09-12T02:41:54.777508+0000","last_peered":"2024-09-12T02:41:54.777508+0000","last_clean":"2024-09-12T02:41:54.777508+0000","last_became_active":"2024-09-12T02:41:52.767666+0000","last_became_peered":"2024-09-12T02:41:52.767666+0000","last_unstale":"2024-09-12T02:41:54.777508+0000","last_undegraded":"2024-09-12T02:41:54.777508+0000","last_fullsized":"2024-09-12T02:41:54.777508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:17.680737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078475+0000","last_change":"2024-09-12T02:41:53.803540+0000","last_active":"2024-09-12T02:41:55.078475+0000","last_peered":"2024-09-12T02:41:55.078475+0000","last_clean":"2024-09-12T02:41:55.078475+0000","last_became_active":"2024-09-12T02:41:53.803074+0000","last_became_peered":"2024-09-12T02:41:53.803074+0000","last_unstale":"2024-09-12T02:41:55.078475+0000","last_undegraded":"2024-09-12T02:41:55.078475+0000","last_fullsized":"2024-09-12T02:41:55.078475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:39.415488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077285+0000","last_change":"2024-09-12T02:41:52.776749+0000","last_active":"2024-09-12T02:41:55.077285+0000","last_peered":"2024-09-12T02:41:55.077285+0000","last_clean":"2024-09-12T02:41:55.077285+0000","last_became_active":"2024-09-12T02:41:52.776495+0000","last_became_peered":"2024-09-12T02:41:52.776495+0000","last_unstale":"2024-09-12T02:41:55.077285+0000","last_undegraded":"2024-09-12T02:41:55.077285+0000","last_fullsized":"2024-09-12T02:41:55.077285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:58.485267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077321+0000","last_change":"2024-09-12T02:41:53.803271+0000","last_active":"2024-09-12T02:41:55.077321+0000","last_peered":"2024-09-12T02:41:55.077321+0000","last_clean":"2024-09-12T02:41:55.077321+0000","last_became_active":"2024-09-12T02:41:53.802960+0000","last_became_peered":"2024-09-12T02:41:53.802960+0000","last_unstale":"2024-09-12T02:41:55.077321+0000","last_undegraded":"2024-09-12T02:41:55.077321+0000","last_fullsized":"2024-09-12T02:41:55.077321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:11.896253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807044+0000","last_change":"2024-09-12T02:41:52.775195+0000","last_active":"2024-09-12T02:41:54.807044+0000","last_peered":"2024-09-12T02:41:54.807044+0000","last_clean":"2024-09-12T02:41:54.807044+0000","last_became_active":"2024-09-12T02:41:52.774945+0000","last_became_peered":"2024-09-12T02:41:52.774945+0000","last_unstale":"2024-09-12T02:41:54.807044+0000","last_undegraded":"2024-09-12T02:41:54.807044+0000","last_fullsized":"2024-09-12T02:41:54.807044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:35.355898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077903+0000","last_change":"2024-09-12T02:41:53.787875+0000","last_active":"2024-09-12T02:41:55.077903+0000","last_peered":"2024-09-12T02:41:55.077903+0000","last_clean":"2024-09-12T02:41:55.077903+0000","last_became_active":"2024-09-12T02:41:53.787636+0000","last_became_peered":"2024-09-12T02:41:53.787636+0000","last_unstale":"2024-09-12T02:41:55.077903+0000","last_undegraded":"2024-09-12T02:41:55.077903+0000","last_fullsized":"2024-09-12T02:41:55.077903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:18.244809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.076853+0000","last_change":"2024-09-12T02:41:52.781866+0000","last_active":"2024-09-12T02:41:55.076853+0000","last_peered":"2024-09-12T02:41:55.076853+0000","last_clean":"2024-09-12T02:41:55.076853+0000","last_became_active":"2024-09-12T02:41:52.781637+0000","last_became_peered":"2024-09-12T02:41:52.781637+0000","last_unstale":"2024-09-12T02:41:55.076853+0000","last_undegraded":"2024-09-12T02:41:55.076853+0000","last_fullsized":"2024-09-12T02:41:55.076853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:44.675773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078815+0000","last_change":"2024-09-12T02:41:53.802186+0000","last_active":"2024-09-12T02:41:55.078815+0000","last_peered":"2024-09-12T02:41:55.078815+0000","last_clean":"2024-09-12T02:41:55.078815+0000","last_became_active":"2024-09-12T02:41:53.801944+0000","last_became_peered":"2024-09-12T02:41:53.801944+0000","last_unstale":"2024-09-12T02:41:55.078815+0000","last_undegraded":"2024-09-12T02:41:55.078815+0000","last_fullsized":"2024-09-12T02:41:55.078815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:27.413007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077804+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:41:55.077804+0000","last_peered":"2024-09-12T02:41:55.077804+0000","last_clean":"2024-09-12T02:41:55.077804+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:41:55.077804+0000","last_undegraded":"2024-09-12T02:41:55.077804+0000","last_fullsized":"2024-09-12T02:41:55.077804+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:45.426902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078266+0000","last_change":"2024-09-12T02:41:52.783100+0000","last_active":"2024-09-12T02:41:55.078266+0000","last_peered":"2024-09-12T02:41:55.078266+0000","last_clean":"2024-09-12T02:41:55.078266+0000","last_became_active":"2024-09-12T02:41:52.782739+0000","last_became_peered":"2024-09-12T02:41:52.782739+0000","last_unstale":"2024-09-12T02:41:55.078266+0000","last_undegraded":"2024-09-12T02:41:55.078266+0000","last_fullsized":"2024-09-12T02:41:55.078266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:12.279581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778908+0000","last_change":"2024-09-12T02:41:53.793492+0000","last_active":"2024-09-12T02:41:54.778908+0000","last_peered":"2024-09-12T02:41:54.778908+0000","last_clean":"2024-09-12T02:41:54.778908+0000","last_became_active":"2024-09-12T02:41:53.791680+0000","last_became_peered":"2024-09-12T02:41:53.791680+0000","last_unstale":"2024-09-12T02:41:54.778908+0000","last_undegraded":"2024-09-12T02:41:54.778908+0000","last_fullsized":"2024-09-12T02:41:54.778908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:00.054064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077698+0000","last_change":"2024-09-12T02:41:52.781604+0000","last_active":"2024-09-12T02:41:55.077698+0000","last_peered":"2024-09-12T02:41:55.077698+0000","last_clean":"2024-09-12T02:41:55.077698+0000","last_became_active":"2024-09-12T02:41:52.780183+0000","last_became_peered":"2024-09-12T02:41:52.780183+0000","last_unstale":"2024-09-12T02:41:55.077698+0000","last_undegraded":"2024-09-12T02:41:55.077698+0000","last_fullsized":"2024-09-12T02:41:55.077698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:00.663730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077610+0000","last_change":"2024-09-12T02:41:53.795877+0000","last_active":"2024-09-12T02:41:55.077610+0000","last_peered":"2024-09-12T02:41:55.077610+0000","last_clean":"2024-09-12T02:41:55.077610+0000","last_became_active":"2024-09-12T02:41:53.795603+0000","last_became_peered":"2024-09-12T02:41:53.795603+0000","last_unstale":"2024-09-12T02:41:55.077610+0000","last_undegraded":"2024-09-12T02:41:55.077610+0000","last_fullsized":"2024-09-12T02:41:55.077610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:16.241955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077097+0000","last_change":"2024-09-12T02:41:52.779295+0000","last_active":"2024-09-12T02:41:55.077097+0000","last_peered":"2024-09-12T02:41:55.077097+0000","last_clean":"2024-09-12T02:41:55.077097+0000","last_became_active":"2024-09-12T02:41:52.778794+0000","last_became_peered":"2024-09-12T02:41:52.778794+0000","last_unstale":"2024-09-12T02:41:55.077097+0000","last_undegraded":"2024-09-12T02:41:55.077097+0000","last_fullsized":"2024-09-12T02:41:55.077097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:37.479001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807228+0000","last_change":"2024-09-12T02:41:53.787507+0000","last_active":"2024-09-12T02:41:54.807228+0000","last_peered":"2024-09-12T02:41:54.807228+0000","last_clean":"2024-09-12T02:41:54.807228+0000","last_became_active":"2024-09-12T02:41:53.787303+0000","last_became_peered":"2024-09-12T02:41:53.787303+0000","last_unstale":"2024-09-12T02:41:54.807228+0000","last_undegraded":"2024-09-12T02:41:54.807228+0000","last_fullsized":"2024-09-12T02:41:54.807228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:19.802083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078131+0000","last_change":"2024-09-12T02:41:52.785347+0000","last_active":"2024-09-12T02:41:55.078131+0000","last_peered":"2024-09-12T02:41:55.078131+0000","last_clean":"2024-09-12T02:41:55.078131+0000","last_became_active":"2024-09-12T02:41:52.784154+0000","last_became_peered":"2024-09-12T02:41:52.784154+0000","last_unstale":"2024-09-12T02:41:55.078131+0000","last_undegraded":"2024-09-12T02:41:55.078131+0000","last_fullsized":"2024-09-12T02:41:55.078131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:21:04.142656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.777403+0000","last_change":"2024-09-12T02:41:53.796131+0000","last_active":"2024-09-12T02:41:54.777403+0000","last_peered":"2024-09-12T02:41:54.777403+0000","last_clean":"2024-09-12T02:41:54.777403+0000","last_became_active":"2024-09-12T02:41:53.795889+0000","last_became_peered":"2024-09-12T02:41:53.795889+0000","last_unstale":"2024-09-12T02:41:54.777403+0000","last_undegraded":"2024-09-12T02:41:54.777403+0000","last_fullsized":"2024-09-12T02:41:54.777403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:58:40.501110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807255+0000","last_change":"2024-09-12T02:41:52.773305+0000","last_active":"2024-09-12T02:41:54.807255+0000","last_peered":"2024-09-12T02:41:54.807255+0000","last_clean":"2024-09-12T02:41:54.807255+0000","last_became_active":"2024-09-12T02:41:52.773009+0000","last_became_peered":"2024-09-12T02:41:52.773009+0000","last_unstale":"2024-09-12T02:41:54.807255+0000","last_undegraded":"2024-09-12T02:41:54.807255+0000","last_fullsized":"2024-09-12T02:41:54.807255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:41:48.173306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077855+0000","last_change":"2024-09-12T02:41:53.789700+0000","last_active":"2024-09-12T02:41:55.077855+0000","last_peered":"2024-09-12T02:41:55.077855+0000","last_clean":"2024-09-12T02:41:55.077855+0000","last_became_active":"2024-09-12T02:41:53.789445+0000","last_became_peered":"2024-09-12T02:41:53.789445+0000","last_unstale":"2024-09-12T02:41:55.077855+0000","last_undegraded":"2024-09-12T02:41:55.077855+0000","last_fullsized":"2024-09-12T02:41:55.077855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:21.533372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077584+0000","last_change":"2024-09-12T02:41:52.783557+0000","last_active":"2024-09-12T02:41:55.077584+0000","last_peered":"2024-09-12T02:41:55.077584+0000","last_clean":"2024-09-12T02:41:55.077584+0000","last_became_active":"2024-09-12T02:41:52.782015+0000","last_became_peered":"2024-09-12T02:41:52.782015+0000","last_unstale":"2024-09-12T02:41:55.077584+0000","last_undegraded":"2024-09-12T02:41:55.077584+0000","last_fullsized":"2024-09-12T02:41:55.077584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:07.909958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807020+0000","last_change":"2024-09-12T02:41:53.791158+0000","last_active":"2024-09-12T02:41:54.807020+0000","last_peered":"2024-09-12T02:41:54.807020+0000","last_clean":"2024-09-12T02:41:54.807020+0000","last_became_active":"2024-09-12T02:41:53.789727+0000","last_became_peered":"2024-09-12T02:41:53.789727+0000","last_unstale":"2024-09-12T02:41:54.807020+0000","last_undegraded":"2024-09-12T02:41:54.807020+0000","last_fullsized":"2024-09-12T02:41:54.807020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:21.893126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807346+0000","last_change":"2024-09-12T02:41:52.773054+0000","last_active":"2024-09-12T02:41:54.807346+0000","last_peered":"2024-09-12T02:41:54.807346+0000","last_clean":"2024-09-12T02:41:54.807346+0000","last_became_active":"2024-09-12T02:41:52.772715+0000","last_became_peered":"2024-09-12T02:41:52.772715+0000","last_unstale":"2024-09-12T02:41:54.807346+0000","last_undegraded":"2024-09-12T02:41:54.807346+0000","last_fullsized":"2024-09-12T02:41:54.807346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:27.523535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778750+0000","last_change":"2024-09-12T02:41:53.794838+0000","last_active":"2024-09-12T02:41:54.778750+0000","last_peered":"2024-09-12T02:41:54.778750+0000","last_clean":"2024-09-12T02:41:54.778750+0000","last_became_active":"2024-09-12T02:41:53.794622+0000","last_became_peered":"2024-09-12T02:41:53.794622+0000","last_unstale":"2024-09-12T02:41:54.778750+0000","last_undegraded":"2024-09-12T02:41:54.778750+0000","last_fullsized":"2024-09-12T02:41:54.778750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:07.720321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778964+0000","last_change":"2024-09-12T02:41:52.782851+0000","last_active":"2024-09-12T02:41:54.778964+0000","last_peered":"2024-09-12T02:41:54.778964+0000","last_clean":"2024-09-12T02:41:54.778964+0000","last_became_active":"2024-09-12T02:41:52.782365+0000","last_became_peered":"2024-09-12T02:41:52.782365+0000","last_unstale":"2024-09-12T02:41:54.778964+0000","last_undegraded":"2024-09-12T02:41:54.778964+0000","last_fullsized":"2024-09-12T02:41:54.778964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:02.356143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077330+0000","last_change":"2024-09-12T02:41:53.782924+0000","last_active":"2024-09-12T02:41:55.077330+0000","last_peered":"2024-09-12T02:41:55.077330+0000","last_clean":"2024-09-12T02:41:55.077330+0000","last_became_active":"2024-09-12T02:41:53.782612+0000","last_became_peered":"2024-09-12T02:41:53.782612+0000","last_unstale":"2024-09-12T02:41:55.077330+0000","last_undegraded":"2024-09-12T02:41:55.077330+0000","last_fullsized":"2024-09-12T02:41:55.077330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:09.015161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.079091+0000","last_change":"2024-09-12T02:41:52.783151+0000","last_active":"2024-09-12T02:41:55.079091+0000","last_peered":"2024-09-12T02:41:55.079091+0000","last_clean":"2024-09-12T02:41:55.079091+0000","last_became_active":"2024-09-12T02:41:52.781789+0000","last_became_peered":"2024-09-12T02:41:52.781789+0000","last_unstale":"2024-09-12T02:41:55.079091+0000","last_undegraded":"2024-09-12T02:41:55.079091+0000","last_fullsized":"2024-09-12T02:41:55.079091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:30.446920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778208+0000","last_change":"2024-09-12T02:41:53.792907+0000","last_active":"2024-09-12T02:41:54.778208+0000","last_peered":"2024-09-12T02:41:54.778208+0000","last_clean":"2024-09-12T02:41:54.778208+0000","last_became_active":"2024-09-12T02:41:53.789159+0000","last_became_peered":"2024-09-12T02:41:53.789159+0000","last_unstale":"2024-09-12T02:41:54.778208+0000","last_undegraded":"2024-09-12T02:41:54.778208+0000","last_fullsized":"2024-09-12T02:41:54.778208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:40.658393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807185+0000","last_change":"2024-09-12T02:41:52.784747+0000","last_active":"2024-09-12T02:41:54.807185+0000","last_peered":"2024-09-12T02:41:54.807185+0000","last_clean":"2024-09-12T02:41:54.807185+0000","last_became_active":"2024-09-12T02:41:52.784558+0000","last_became_peered":"2024-09-12T02:41:52.784558+0000","last_unstale":"2024-09-12T02:41:54.807185+0000","last_undegraded":"2024-09-12T02:41:54.807185+0000","last_fullsized":"2024-09-12T02:41:54.807185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:25.686682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778690+0000","last_change":"2024-09-12T02:41:53.793644+0000","last_active":"2024-09-12T02:41:54.778690+0000","last_peered":"2024-09-12T02:41:54.778690+0000","last_clean":"2024-09-12T02:41:54.778690+0000","last_became_active":"2024-09-12T02:41:53.793439+0000","last_became_peered":"2024-09-12T02:41:53.793439+0000","last_unstale":"2024-09-12T02:41:54.778690+0000","last_undegraded":"2024-09-12T02:41:54.778690+0000","last_fullsized":"2024-09-12T02:41:54.778690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:25:59.472325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807287+0000","last_change":"2024-09-12T02:41:52.780636+0000","last_active":"2024-09-12T02:41:54.807287+0000","last_peered":"2024-09-12T02:41:54.807287+0000","last_clean":"2024-09-12T02:41:54.807287+0000","last_became_active":"2024-09-12T02:41:52.780347+0000","last_became_peered":"2024-09-12T02:41:52.780347+0000","last_unstale":"2024-09-12T02:41:54.807287+0000","last_undegraded":"2024-09-12T02:41:54.807287+0000","last_fullsized":"2024-09-12T02:41:54.807287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:46.086664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779261+0000","last_change":"2024-09-12T02:41:53.784952+0000","last_active":"2024-09-12T02:41:54.779261+0000","last_peered":"2024-09-12T02:41:54.779261+0000","last_clean":"2024-09-12T02:41:54.779261+0000","last_became_active":"2024-09-12T02:41:53.784276+0000","last_became_peered":"2024-09-12T02:41:53.784276+0000","last_unstale":"2024-09-12T02:41:54.779261+0000","last_undegraded":"2024-09-12T02:41:54.779261+0000","last_fullsized":"2024-09-12T02:41:54.779261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:53.702199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077279+0000","last_change":"2024-09-12T02:41:52.783869+0000","last_active":"2024-09-12T02:41:55.077279+0000","last_peered":"2024-09-12T02:41:55.077279+0000","last_clean":"2024-09-12T02:41:55.077279+0000","last_became_active":"2024-09-12T02:41:52.781705+0000","last_became_peered":"2024-09-12T02:41:52.781705+0000","last_unstale":"2024-09-12T02:41:55.077279+0000","last_undegraded":"2024-09-12T02:41:55.077279+0000","last_fullsized":"2024-09-12T02:41:55.077279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:28.710814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778514+0000","last_change":"2024-09-12T02:41:53.802125+0000","last_active":"2024-09-12T02:41:54.778514+0000","last_peered":"2024-09-12T02:41:54.778514+0000","last_clean":"2024-09-12T02:41:54.778514+0000","last_became_active":"2024-09-12T02:41:53.801855+0000","last_became_peered":"2024-09-12T02:41:53.801855+0000","last_unstale":"2024-09-12T02:41:54.778514+0000","last_undegraded":"2024-09-12T02:41:54.778514+0000","last_fullsized":"2024-09-12T02:41:54.778514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:56.017190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077335+0000","last_change":"2024-09-12T02:41:53.796199+0000","last_active":"2024-09-12T02:41:55.077335+0000","last_peered":"2024-09-12T02:41:55.077335+0000","last_clean":"2024-09-12T02:41:55.077335+0000","last_became_active":"2024-09-12T02:41:53.793833+0000","last_became_peered":"2024-09-12T02:41:53.793833+0000","last_unstale":"2024-09-12T02:41:55.077335+0000","last_undegraded":"2024-09-12T02:41:55.077335+0000","last_fullsized":"2024-09-12T02:41:55.077335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:06.451667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078990+0000","last_change":"2024-09-12T02:41:52.785769+0000","last_active":"2024-09-12T02:41:55.078990+0000","last_peered":"2024-09-12T02:41:55.078990+0000","last_clean":"2024-09-12T02:41:55.078990+0000","last_became_active":"2024-09-12T02:41:52.785498+0000","last_became_peered":"2024-09-12T02:41:52.785498+0000","last_unstale":"2024-09-12T02:41:55.078990+0000","last_undegraded":"2024-09-12T02:41:55.078990+0000","last_fullsized":"2024-09-12T02:41:55.078990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:06.766309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077706+0000","last_change":"2024-09-12T02:41:53.797692+0000","last_active":"2024-09-12T02:41:55.077706+0000","last_peered":"2024-09-12T02:41:55.077706+0000","last_clean":"2024-09-12T02:41:55.077706+0000","last_became_active":"2024-09-12T02:41:53.797478+0000","last_became_peered":"2024-09-12T02:41:53.797478+0000","last_unstale":"2024-09-12T02:41:55.077706+0000","last_undegraded":"2024-09-12T02:41:55.077706+0000","last_fullsized":"2024-09-12T02:41:55.077706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:01.317942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078580+0000","last_change":"2024-09-12T02:41:52.784485+0000","last_active":"2024-09-12T02:41:55.078580+0000","last_peered":"2024-09-12T02:41:55.078580+0000","last_clean":"2024-09-12T02:41:55.078580+0000","last_became_active":"2024-09-12T02:41:52.784183+0000","last_became_peered":"2024-09-12T02:41:52.784183+0000","last_unstale":"2024-09-12T02:41:55.078580+0000","last_undegraded":"2024-09-12T02:41:55.078580+0000","last_fullsized":"2024-09-12T02:41:55.078580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:32:59.235781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077471+0000","last_change":"2024-09-12T02:41:53.784634+0000","last_active":"2024-09-12T02:41:55.077471+0000","last_peered":"2024-09-12T02:41:55.077471+0000","last_clean":"2024-09-12T02:41:55.077471+0000","last_became_active":"2024-09-12T02:41:53.784120+0000","last_became_peered":"2024-09-12T02:41:53.784120+0000","last_unstale":"2024-09-12T02:41:55.077471+0000","last_undegraded":"2024-09-12T02:41:55.077471+0000","last_fullsized":"2024-09-12T02:41:55.077471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:13.615226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779120+0000","last_change":"2024-09-12T02:41:52.778974+0000","last_active":"2024-09-12T02:41:54.779120+0000","last_peered":"2024-09-12T02:41:54.779120+0000","last_clean":"2024-09-12T02:41:54.779120+0000","last_became_active":"2024-09-12T02:41:52.775107+0000","last_became_peered":"2024-09-12T02:41:52.775107+0000","last_unstale":"2024-09-12T02:41:54.779120+0000","last_undegraded":"2024-09-12T02:41:54.779120+0000","last_fullsized":"2024-09-12T02:41:54.779120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:37.256469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779025+0000","last_change":"2024-09-12T02:41:53.789090+0000","last_active":"2024-09-12T02:41:54.779025+0000","last_peered":"2024-09-12T02:41:54.779025+0000","last_clean":"2024-09-12T02:41:54.779025+0000","last_became_active":"2024-09-12T02:41:53.787863+0000","last_became_peered":"2024-09-12T02:41:53.787863+0000","last_unstale":"2024-09-12T02:41:54.779025+0000","last_undegraded":"2024-09-12T02:41:54.779025+0000","last_fullsized":"2024-09-12T02:41:54.779025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:09.744576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077689+0000","last_change":"2024-09-12T02:41:52.778197+0000","last_active":"2024-09-12T02:41:55.077689+0000","last_peered":"2024-09-12T02:41:55.077689+0000","last_clean":"2024-09-12T02:41:55.077689+0000","last_became_active":"2024-09-12T02:41:52.777887+0000","last_became_peered":"2024-09-12T02:41:52.777887+0000","last_unstale":"2024-09-12T02:41:55.077689+0000","last_undegraded":"2024-09-12T02:41:55.077689+0000","last_fullsized":"2024-09-12T02:41:55.077689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:30:08.364549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338276,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927614,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929136,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929100,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927614,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929226,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929066,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338220,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:42:02.975 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:42:02.976 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T02:42:02.976 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T02:42:02.976 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T02:42:02.976 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T02:42:03.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.161+0000 7fc69c800640 1 Processor -- start 2024-09-12T02:42:03.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.161+0000 7fc69c800640 1 -- start start 2024-09-12T02:42:03.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.162+0000 7fc69c800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc6940cfd30 0x7fc6940ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:03.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.162+0000 7fc69c800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc69406f880 con 0x7fc694070bc0 2024-09-12T02:42:03.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.162+0000 7fc69c800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc69406fb20 con 0x7fc69415eeb0 2024-09-12T02:42:03.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.162+0000 7fc69c800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc694070730 con 0x7fc6940cfd30 2024-09-12T02:42:03.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.162+0000 7fc699400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc6940cfd30 0x7fc6940ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:03.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.162+0000 7fc699400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc6940cfd30 0x7fc6940ce9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57560/0 (socket says 172.21.15.112:57560) 2024-09-12T02:42:03.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.162+0000 7fc699400640 1 -- 172.21.15.112:0/2424886856 learned_addr learned my addr 172.21.15.112:0/2424886856 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:03.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.162+0000 7fc69a800640 1 --1- 172.21.15.112:0/2424886856 >> v1:172.21.15.112:6789/0 conn(0x7fc694070bc0 0x7fc694168f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33884/0 (socket says 172.21.15.112:33884) 2024-09-12T02:42:03.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.163+0000 7fc699400640 1 -- 172.21.15.112:0/2424886856 >> v1:172.21.15.137:6789/0 conn(0x7fc69415eeb0 legacy=0x7fc6940cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:03.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.163+0000 7fc699400640 1 -- 172.21.15.112:0/2424886856 >> v1:172.21.15.112:6789/0 conn(0x7fc694070bc0 legacy=0x7fc694168f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:03.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.163+0000 7fc699400640 1 -- 172.21.15.112:0/2424886856 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69406fe00 con 0x7fc6940cfd30 2024-09-12T02:42:03.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.163+0000 7fc698a00640 1 -- 172.21.15.112:0/2424886856 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2530526575 0 0) 0x7fc69406f880 con 0x7fc694070bc0 2024-09-12T02:42:03.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.164+0000 7fc699400640 1 --2- 172.21.15.112:0/2424886856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6940cfd30 0x7fc6940ce9b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc684009870 tx=0x7fc68402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4cbeb3d9c553eeb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:03.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.164+0000 7fc698a00640 1 -- 172.21.15.112:0/2424886856 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc684037070 con 0x7fc6940cfd30 2024-09-12T02:42:03.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.164+0000 7fc698a00640 1 -- 172.21.15.112:0/2424886856 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc68402ae50 con 0x7fc6940cfd30 2024-09-12T02:42:03.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.164+0000 7fc698a00640 1 -- 172.21.15.112:0/2424886856 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc684032860 con 0x7fc6940cfd30 2024-09-12T02:42:03.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.164+0000 7fc69c800640 1 -- 172.21.15.112:0/2424886856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6940cfd30 msgr2=0x7fc6940ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:03.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.164+0000 7fc69c800640 1 --2- 172.21.15.112:0/2424886856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6940cfd30 0x7fc6940ce9b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc684009870 tx=0x7fc68402a300 comp rx=0 tx=0).stop 2024-09-12T02:42:03.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.164+0000 7fc69c800640 1 -- 172.21.15.112:0/2424886856 shutdown_connections 2024-09-12T02:42:03.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.164+0000 7fc69c800640 1 --2- 172.21.15.112:0/2424886856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6940cfd30 0x7fc6940ce9b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:03.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.164+0000 7fc69c800640 1 -- 172.21.15.112:0/2424886856 >> 172.21.15.112:0/2424886856 conn(0x7fc6940b4720 msgr2=0x7fc6940b4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:03.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.165+0000 7fc69c800640 1 -- 172.21.15.112:0/2424886856 shutdown_connections 2024-09-12T02:42:03.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.165+0000 7fc69c800640 1 -- 172.21.15.112:0/2424886856 wait complete. 2024-09-12T02:42:03.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.166+0000 7fc69c800640 1 Processor -- start 2024-09-12T02:42:03.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.166+0000 7fc69c800640 1 -- start start 2024-09-12T02:42:03.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.167+0000 7fc69c800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc694070bc0 0x7fc6940cc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:03.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.167+0000 7fc69c800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6940cfd30 0x7fc6940d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:03.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.167+0000 7fc69c800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc69415eeb0 0x7fc6940b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:03.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.167+0000 7fc69c800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc69415f290 con 0x7fc69415eeb0 2024-09-12T02:42:03.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.167+0000 7fc69c800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc6940703c0 con 0x7fc6940cfd30 2024-09-12T02:42:03.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.167+0000 7fc69c800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc69415f410 con 0x7fc694070bc0 2024-09-12T02:42:03.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.167+0000 7fc69a800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc69415eeb0 0x7fc6940b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:03.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.167+0000 7fc69a800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc69415eeb0 0x7fc6940b2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57570/0 (socket says 172.21.15.112:57570) 2024-09-12T02:42:03.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.167+0000 7fc69a800640 1 -- 172.21.15.112:0/3919466654 learned_addr learned my addr 172.21.15.112:0/3919466654 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:03.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.168+0000 7fc699400640 1 --2- 172.21.15.112:0/3919466654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6940cfd30 0x7fc6940d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:03.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.168+0000 7fc69a800640 1 -- 172.21.15.112:0/3919466654 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc694070bc0 msgr2=0x7fc6940cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:03.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.168+0000 7fc699e00640 1 --2- 172.21.15.112:0/3919466654 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc694070bc0 0x7fc6940cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:03.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.168+0000 7fc69a800640 1 --2- 172.21.15.112:0/3919466654 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc694070bc0 0x7fc6940cc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:03.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.168+0000 7fc69a800640 1 -- 172.21.15.112:0/3919466654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6940cfd30 msgr2=0x7fc6940d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:03.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.168+0000 7fc69a800640 1 --2- 172.21.15.112:0/3919466654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6940cfd30 0x7fc6940d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:03.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.168+0000 7fc69a800640 1 -- 172.21.15.112:0/3919466654 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6940d15b0 con 0x7fc69415eeb0 2024-09-12T02:42:03.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.168+0000 7fc699400640 1 --2- 172.21.15.112:0/3919466654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6940cfd30 0x7fc6940d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:42:03.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.168+0000 7fc699e00640 1 --2- 172.21.15.112:0/3919466654 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc694070bc0 0x7fc6940cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:42:03.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.168+0000 7fc69a800640 1 --2- 172.21.15.112:0/3919466654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc69415eeb0 0x7fc6940b2ba0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc69000c780 tx=0x7fc69000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:03.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.168+0000 7fc68e000640 1 -- 172.21.15.112:0/3919466654 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc690018070 con 0x7fc69415eeb0 2024-09-12T02:42:03.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.168+0000 7fc68e000640 1 -- 172.21.15.112:0/3919466654 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc69000ce30 con 0x7fc69415eeb0 2024-09-12T02:42:03.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.168+0000 7fc68e000640 1 -- 172.21.15.112:0/3919466654 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69000a860 con 0x7fc69415eeb0 2024-09-12T02:42:03.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.168+0000 7fc69c800640 1 -- 172.21.15.112:0/3919466654 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6940d1890 con 0x7fc69415eeb0 2024-09-12T02:42:03.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.169+0000 7fc69c800640 1 -- 172.21.15.112:0/3919466654 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6940d1e50 con 0x7fc69415eeb0 2024-09-12T02:42:03.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.170+0000 7fc69c800640 1 -- 172.21.15.112:0/3919466654 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6940763a0 con 0x7fc69415eeb0 2024-09-12T02:42:03.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.170+0000 7fc68e000640 1 -- 172.21.15.112:0/3919466654 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc69000aa00 con 0x7fc69415eeb0 2024-09-12T02:42:03.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.171+0000 7fc68e000640 1 --2- 172.21.15.112:0/3919466654 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc67806be30 0x7fc67806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:03.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.171+0000 7fc68e000640 1 -- 172.21.15.112:0/3919466654 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc69008a430 con 0x7fc69415eeb0 2024-09-12T02:42:03.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.171+0000 7fc699e00640 1 --2- 172.21.15.112:0/3919466654 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc67806be30 0x7fc67806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:03.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.172+0000 7fc699e00640 1 --2- 172.21.15.112:0/3919466654 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc67806be30 0x7fc67806e2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc688000f60 tx=0x7fc688009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:03.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.176+0000 7fc68e000640 1 -- 172.21.15.112:0/3919466654 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc690058dd0 con 0x7fc69415eeb0 2024-09-12T02:42:03.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.391+0000 7fc69c800640 1 -- 172.21.15.112:0/3919466654 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc6940b8b90 con 0x7fc69415eeb0 2024-09-12T02:42:03.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.394+0000 7fc68e000640 1 -- 172.21.15.112:0/3919466654 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172945 (secure 0 0 0) 0x7fc6900586d0 con 0x7fc69415eeb0 2024-09-12T02:42:03.398 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:42:03.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.397+0000 7fc69c800640 1 -- 172.21.15.112:0/3919466654 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc67806be30 msgr2=0x7fc67806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:03.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.397+0000 7fc69c800640 1 --2- 172.21.15.112:0/3919466654 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc67806be30 0x7fc67806e2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc688000f60 tx=0x7fc688009040 comp rx=0 tx=0).stop 2024-09-12T02:42:03.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.397+0000 7fc69c800640 1 -- 172.21.15.112:0/3919466654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc69415eeb0 msgr2=0x7fc6940b2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:03.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.397+0000 7fc69c800640 1 --2- 172.21.15.112:0/3919466654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc69415eeb0 0x7fc6940b2ba0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc69000c780 tx=0x7fc69000cc40 comp rx=0 tx=0).stop 2024-09-12T02:42:03.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.397+0000 7fc69c800640 1 -- 172.21.15.112:0/3919466654 shutdown_connections 2024-09-12T02:42:03.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.397+0000 7fc69c800640 1 --2- 172.21.15.112:0/3919466654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc69415eeb0 0x7fc6940b2ba0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:03.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.397+0000 7fc69c800640 1 --2- 172.21.15.112:0/3919466654 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc67806be30 0x7fc67806e2f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:03.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.397+0000 7fc69c800640 1 --2- 172.21.15.112:0/3919466654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6940cfd30 0x7fc6940d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:03.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.397+0000 7fc69c800640 1 --2- 172.21.15.112:0/3919466654 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc694070bc0 0x7fc6940cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:03.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.397+0000 7fc69c800640 1 -- 172.21.15.112:0/3919466654 >> 172.21.15.112:0/3919466654 conn(0x7fc6940b4720 msgr2=0x7fc6940b4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:03.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.397+0000 7fc69c800640 1 -- 172.21.15.112:0/3919466654 shutdown_connections 2024-09-12T02:42:03.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.398+0000 7fc69c800640 1 -- 172.21.15.112:0/3919466654 wait complete. 2024-09-12T02:42:03.414 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":3439199466},{"type":"v1","addr":"172.21.15.112:6833","nonce":3439199466}]},"active_addr":"172.21.15.112:6833/3439199466","active_change":"2024-09-12T02:41:40.945633+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":873089612}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":3907402514}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":2942269859}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":4028151193}]}]} 2024-09-12T02:42:03.417 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T02:42:03.417 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T02:42:03.417 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:42:03.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.568+0000 7f55c2e00640 1 Processor -- start 2024-09-12T02:42:03.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.569+0000 7f55c2e00640 1 -- start start 2024-09-12T02:42:03.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.570+0000 7f55c2e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55bc15b9d0 0x7f55bc0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:03.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.570+0000 7f55c2e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55bc0b54a0 con 0x7f55bc06f600 2024-09-12T02:42:03.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.570+0000 7f55c2e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55bc0b3af0 con 0x7f55bc0b45d0 2024-09-12T02:42:03.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.570+0000 7f55c2e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f55bc0b4a30 con 0x7f55bc15b9d0 2024-09-12T02:42:03.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.570+0000 7f55c0e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f55bc06f600 0x7f55bc0cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33894/0 (socket says 172.21.15.112:33894) 2024-09-12T02:42:03.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.570+0000 7f55c0e00640 1 -- 172.21.15.112:0/3458641676 learned_addr learned my addr 172.21.15.112:0/3458641676 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:03.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.570+0000 7f55bbe00640 1 --2- 172.21.15.112:0/3458641676 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55bc15b9d0 0x7f55bc0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:03.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.570+0000 7f55bb400640 1 -- 172.21.15.112:0/3458641676 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3234778133 0 0) 0x7f55bc0b54a0 con 0x7f55bc06f600 2024-09-12T02:42:03.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.571+0000 7f55bb400640 1 -- 172.21.15.112:0/3458641676 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55a0003520 con 0x7f55bc06f600 2024-09-12T02:42:03.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.571+0000 7f55bb400640 1 -- 172.21.15.112:0/3458641676 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 526278462 0 0) 0x7f55bc0b3af0 con 0x7f55bc0b45d0 2024-09-12T02:42:03.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.571+0000 7f55bb400640 1 -- 172.21.15.112:0/3458641676 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55bc0b54a0 con 0x7f55bc0b45d0 2024-09-12T02:42:03.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.571+0000 7f55bbe00640 1 -- 172.21.15.112:0/3458641676 >> v1:172.21.15.137:6789/0 conn(0x7f55bc0b45d0 legacy=0x7f55bc06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:03.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.571+0000 7f55bbe00640 1 -- 172.21.15.112:0/3458641676 >> v1:172.21.15.112:6789/0 conn(0x7f55bc06f600 legacy=0x7f55bc0cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:03.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.571+0000 7f55bbe00640 1 -- 172.21.15.112:0/3458641676 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55bc0b3dd0 con 0x7f55bc15b9d0 2024-09-12T02:42:03.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.572+0000 7f55bbe00640 1 --2- 172.21.15.112:0/3458641676 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55bc15b9d0 0x7f55bc0b4ec0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f55ac0097d0 tx=0x7f55ac02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89e129ed938d0020 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:03.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.572+0000 7f55bb400640 1 -- 172.21.15.112:0/3458641676 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ac037070 con 0x7f55bc15b9d0 2024-09-12T02:42:03.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.572+0000 7f55bb400640 1 -- 172.21.15.112:0/3458641676 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55ac032440 con 0x7f55bc15b9d0 2024-09-12T02:42:03.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.572+0000 7f55bb400640 1 -- 172.21.15.112:0/3458641676 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ac0327f0 con 0x7f55bc15b9d0 2024-09-12T02:42:03.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.573+0000 7f55c2e00640 1 -- 172.21.15.112:0/3458641676 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55bc15b9d0 msgr2=0x7f55bc0b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:03.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.573+0000 7f55c2e00640 1 --2- 172.21.15.112:0/3458641676 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55bc15b9d0 0x7f55bc0b4ec0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f55ac0097d0 tx=0x7f55ac02a210 comp rx=0 tx=0).stop 2024-09-12T02:42:03.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.573+0000 7f55c2e00640 1 -- 172.21.15.112:0/3458641676 shutdown_connections 2024-09-12T02:42:03.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.573+0000 7f55c2e00640 1 --2- 172.21.15.112:0/3458641676 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55bc15b9d0 0x7f55bc0b4ec0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:03.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.573+0000 7f55c2e00640 1 -- 172.21.15.112:0/3458641676 >> 172.21.15.112:0/3458641676 conn(0x7f55bc06bbd0 msgr2=0x7f55bc06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:03.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.573+0000 7f55c2e00640 1 -- 172.21.15.112:0/3458641676 shutdown_connections 2024-09-12T02:42:03.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.573+0000 7f55c2e00640 1 -- 172.21.15.112:0/3458641676 wait complete. 2024-09-12T02:42:03.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.574+0000 7f55c2e00640 1 Processor -- start 2024-09-12T02:42:03.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.574+0000 7f55c2e00640 1 -- start start 2024-09-12T02:42:03.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.575+0000 7f55c2e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55bc06f600 0x7f55bc155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:03.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.575+0000 7f55c2e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55bc0b45d0 0x7f55bc154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:03.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.575+0000 7f55c2e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55bc15b9d0 0x7f55bc14ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:03.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.575+0000 7f55c2e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f55bc15bf30 con 0x7f55bc0b45d0 2024-09-12T02:42:03.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.575+0000 7f55c2e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f55bc15bdb0 con 0x7f55bc06f600 2024-09-12T02:42:03.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.575+0000 7f55c2e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f55bc0728c0 con 0x7f55bc15b9d0 2024-09-12T02:42:03.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.575+0000 7f55b3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55bc0b45d0 0x7f55bc154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:03.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.576+0000 7f55b3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55bc0b45d0 0x7f55bc154600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57572/0 (socket says 172.21.15.112:57572) 2024-09-12T02:42:03.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.576+0000 7f55b3400640 1 -- 172.21.15.112:0/1696610678 learned_addr learned my addr 172.21.15.112:0/1696610678 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:03.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.576+0000 7f55bbe00640 1 --2- 172.21.15.112:0/1696610678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55bc06f600 0x7f55bc155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:03.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.576+0000 7f55c0e00640 1 --2- 172.21.15.112:0/1696610678 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55bc15b9d0 0x7f55bc14ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:03.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.576+0000 7f55b3400640 1 -- 172.21.15.112:0/1696610678 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55bc15b9d0 msgr2=0x7f55bc14ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:03.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.576+0000 7f55b3400640 1 --2- 172.21.15.112:0/1696610678 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55bc15b9d0 0x7f55bc14ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:03.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.576+0000 7f55b3400640 1 -- 172.21.15.112:0/1696610678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55bc06f600 msgr2=0x7f55bc155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:03.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.576+0000 7f55b3400640 1 --2- 172.21.15.112:0/1696610678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55bc06f600 0x7f55bc155fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:03.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.576+0000 7f55b3400640 1 -- 172.21.15.112:0/1696610678 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55bc1564f0 con 0x7f55bc0b45d0 2024-09-12T02:42:03.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.576+0000 7f55b3400640 1 --2- 172.21.15.112:0/1696610678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55bc0b45d0 0x7f55bc154600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f55a400c430 tx=0x7f55a400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:03.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.576+0000 7f55b8c00640 1 -- 172.21.15.112:0/1696610678 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a4017070 con 0x7f55bc0b45d0 2024-09-12T02:42:03.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.576+0000 7f55b8c00640 1 -- 172.21.15.112:0/1696610678 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a40052d0 con 0x7f55bc0b45d0 2024-09-12T02:42:03.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.576+0000 7f55b8c00640 1 -- 172.21.15.112:0/1696610678 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a4003660 con 0x7f55bc0b45d0 2024-09-12T02:42:03.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.576+0000 7f55c2e00640 1 -- 172.21.15.112:0/1696610678 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55bc154e90 con 0x7f55bc0b45d0 2024-09-12T02:42:03.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.576+0000 7f55c2e00640 1 -- 172.21.15.112:0/1696610678 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55bc1554d0 con 0x7f55bc0b45d0 2024-09-12T02:42:03.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.577+0000 7f55c2e00640 1 -- 172.21.15.112:0/1696610678 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55bc072c50 con 0x7f55bc0b45d0 2024-09-12T02:42:03.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.578+0000 7f55b8c00640 1 -- 172.21.15.112:0/1696610678 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f55a401a070 con 0x7f55bc0b45d0 2024-09-12T02:42:03.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.579+0000 7f55b8c00640 1 --2- 172.21.15.112:0/1696610678 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f559806be30 0x7f559806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:03.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.579+0000 7f55b8c00640 1 -- 172.21.15.112:0/1696610678 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f55a408a440 con 0x7f55bc0b45d0 2024-09-12T02:42:03.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.579+0000 7f55bbe00640 1 --2- 172.21.15.112:0/1696610678 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f559806be30 0x7f559806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:03.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.580+0000 7f55bbe00640 1 --2- 172.21.15.112:0/1696610678 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f559806be30 0x7f559806e2f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f55ac034000 tx=0x7f55ac02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:03.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.583+0000 7f55b8c00640 1 -- 172.21.15.112:0/1696610678 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f55a4058d90 con 0x7f55bc0b45d0 2024-09-12T02:42:03.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.759+0000 7f55c2e00640 1 -- 172.21.15.112:0/1696610678 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55bc0763b0 con 0x7f55bc0b45d0 2024-09-12T02:42:03.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.760+0000 7f55b8c00640 1 -- 172.21.15.112:0/1696610678 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16713 (secure 0 0 0) 0x7f55a4058690 con 0x7f55bc0b45d0 2024-09-12T02:42:03.762 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:42:03.762 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":20,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:41:54.774268+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:41:51.222228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:41:52.167920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:42:03.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.763+0000 7f55c2e00640 1 -- 172.21.15.112:0/1696610678 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f559806be30 msgr2=0x7f559806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:03.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.763+0000 7f55c2e00640 1 --2- 172.21.15.112:0/1696610678 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f559806be30 0x7f559806e2f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f55ac034000 tx=0x7f55ac02e000 comp rx=0 tx=0).stop 2024-09-12T02:42:03.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.763+0000 7f55c2e00640 1 -- 172.21.15.112:0/1696610678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55bc0b45d0 msgr2=0x7f55bc154600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:03.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.763+0000 7f55c2e00640 1 --2- 172.21.15.112:0/1696610678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55bc0b45d0 0x7f55bc154600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f55a400c430 tx=0x7f55a400c8f0 comp rx=0 tx=0).stop 2024-09-12T02:42:03.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.763+0000 7f55c2e00640 1 -- 172.21.15.112:0/1696610678 shutdown_connections 2024-09-12T02:42:03.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.763+0000 7f55c2e00640 1 --2- 172.21.15.112:0/1696610678 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55bc15b9d0 0x7f55bc14ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:03.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.763+0000 7f55c2e00640 1 --2- 172.21.15.112:0/1696610678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55bc0b45d0 0x7f55bc154600 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:03.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.763+0000 7f55c2e00640 1 --2- 172.21.15.112:0/1696610678 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f559806be30 0x7f559806e2f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:03.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.763+0000 7f55c2e00640 1 --2- 172.21.15.112:0/1696610678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55bc06f600 0x7f55bc155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:03.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.763+0000 7f55c2e00640 1 -- 172.21.15.112:0/1696610678 >> 172.21.15.112:0/1696610678 conn(0x7f55bc06bbd0 msgr2=0x7f55bc071750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:03.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.763+0000 7f55c2e00640 1 -- 172.21.15.112:0/1696610678 shutdown_connections 2024-09-12T02:42:03.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.763+0000 7f55c2e00640 1 -- 172.21.15.112:0/1696610678 wait complete. 2024-09-12T02:42:03.780 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T02:42:03.780 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:42:03.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.932+0000 7fb530800640 1 Processor -- start 2024-09-12T02:42:03.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.933+0000 7fb530800640 1 -- start start 2024-09-12T02:42:03.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.934+0000 7fb530800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5280ae8d0 0x7fb5280afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:03.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.934+0000 7fb530800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb52806dca0 0x7fb52806e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:03.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.934+0000 7fb530800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5280aedd0 con 0x7fb52806d8c0 2024-09-12T02:42:03.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.934+0000 7fb530800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb5280af0b0 con 0x7fb52806dca0 2024-09-12T02:42:03.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.934+0000 7fb530800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb5280af390 con 0x7fb5280ae8d0 2024-09-12T02:42:03.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.934+0000 7fb52e800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb52806dca0 0x7fb52806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:03.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.934+0000 7fb52e800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb52806dca0 0x7fb52806e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57582/0 (socket says 172.21.15.112:57582) 2024-09-12T02:42:03.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.934+0000 7fb52e800640 1 -- 172.21.15.112:0/191077018 learned_addr learned my addr 172.21.15.112:0/191077018 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:03.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.934+0000 7fb52d400640 1 --2- 172.21.15.112:0/191077018 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5280ae8d0 0x7fb5280afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:03.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.934+0000 7fb52e800640 1 -- 172.21.15.112:0/191077018 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5280ae8d0 msgr2=0x7fb5280afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:03.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.934+0000 7fb52e800640 1 --2- 172.21.15.112:0/191077018 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5280ae8d0 0x7fb5280afe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:03.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.934+0000 7fb52e800640 1 -- 172.21.15.112:0/191077018 >> v1:172.21.15.137:6789/0 conn(0x7fb52806d8c0 legacy=0x7fb5280715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:03.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.934+0000 7fb52e800640 1 -- 172.21.15.112:0/191077018 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5280af670 con 0x7fb52806dca0 2024-09-12T02:42:03.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.935+0000 7fb52e800640 1 --2- 172.21.15.112:0/191077018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb52806dca0 0x7fb52806e150 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb524009e50 tx=0x7fb52402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2113cfc2b5a848 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:03.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.936+0000 7fb52ca00640 1 -- 172.21.15.112:0/191077018 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb524036070 con 0x7fb52806dca0 2024-09-12T02:42:03.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.936+0000 7fb52ca00640 1 -- 172.21.15.112:0/191077018 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb524031600 con 0x7fb52806dca0 2024-09-12T02:42:03.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.936+0000 7fb52ca00640 1 -- 172.21.15.112:0/191077018 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5240319d0 con 0x7fb52806dca0 2024-09-12T02:42:03.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.936+0000 7fb530800640 1 -- 172.21.15.112:0/191077018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb52806dca0 msgr2=0x7fb52806e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:03.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.936+0000 7fb530800640 1 --2- 172.21.15.112:0/191077018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb52806dca0 0x7fb52806e150 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb524009e50 tx=0x7fb52402a730 comp rx=0 tx=0).stop 2024-09-12T02:42:03.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.936+0000 7fb530800640 1 -- 172.21.15.112:0/191077018 shutdown_connections 2024-09-12T02:42:03.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.936+0000 7fb530800640 1 --2- 172.21.15.112:0/191077018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb52806dca0 0x7fb52806e150 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:03.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.936+0000 7fb530800640 1 --2- 172.21.15.112:0/191077018 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5280ae8d0 0x7fb5280afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:03.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.936+0000 7fb530800640 1 -- 172.21.15.112:0/191077018 >> 172.21.15.112:0/191077018 conn(0x7fb52806bbd0 msgr2=0x7fb52806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:03.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.936+0000 7fb530800640 1 -- 172.21.15.112:0/191077018 shutdown_connections 2024-09-12T02:42:03.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.936+0000 7fb530800640 1 -- 172.21.15.112:0/191077018 wait complete. 2024-09-12T02:42:03.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.938+0000 7fb530800640 1 Processor -- start 2024-09-12T02:42:03.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.938+0000 7fb530800640 1 -- start start 2024-09-12T02:42:03.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.939+0000 7fb530800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb52806d8c0 0x7fb528152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:03.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.939+0000 7fb530800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb52806dca0 0x7fb5281463a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:03.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.939+0000 7fb530800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5280ae8d0 0x7fb5280cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:03.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.939+0000 7fb530800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb5280b38e0 con 0x7fb5280ae8d0 2024-09-12T02:42:03.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.939+0000 7fb530800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb52806e690 con 0x7fb52806d8c0 2024-09-12T02:42:03.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.939+0000 7fb530800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb5280b3a60 con 0x7fb52806dca0 2024-09-12T02:42:03.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.939+0000 7fb52e800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5280ae8d0 0x7fb5280cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:03.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.939+0000 7fb52e800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5280ae8d0 0x7fb5280cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57598/0 (socket says 172.21.15.112:57598) 2024-09-12T02:42:03.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.939+0000 7fb52e800640 1 -- 172.21.15.112:0/464552757 learned_addr learned my addr 172.21.15.112:0/464552757 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:03.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.939+0000 7fb52d400640 1 --2- 172.21.15.112:0/464552757 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb52806dca0 0x7fb5281463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:03.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.939+0000 7fb52de00640 1 --2- 172.21.15.112:0/464552757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb52806d8c0 0x7fb528152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:03.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.940+0000 7fb52e800640 1 -- 172.21.15.112:0/464552757 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb52806dca0 msgr2=0x7fb5281463a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:03.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.940+0000 7fb52e800640 1 --2- 172.21.15.112:0/464552757 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb52806dca0 0x7fb5281463a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:03.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.940+0000 7fb52e800640 1 -- 172.21.15.112:0/464552757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb52806d8c0 msgr2=0x7fb528152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:03.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.940+0000 7fb52e800640 1 --2- 172.21.15.112:0/464552757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb52806d8c0 0x7fb528152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:03.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.940+0000 7fb52e800640 1 -- 172.21.15.112:0/464552757 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb528156260 con 0x7fb5280ae8d0 2024-09-12T02:42:03.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.940+0000 7fb52e800640 1 --2- 172.21.15.112:0/464552757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5280ae8d0 0x7fb5280cdcf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb524034040 tx=0x7fb524004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:03.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.940+0000 7fb522000640 1 -- 172.21.15.112:0/464552757 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb524036050 con 0x7fb5280ae8d0 2024-09-12T02:42:03.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.940+0000 7fb522000640 1 -- 172.21.15.112:0/464552757 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb524042070 con 0x7fb5280ae8d0 2024-09-12T02:42:03.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.940+0000 7fb522000640 1 -- 172.21.15.112:0/464552757 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb524009510 con 0x7fb5280ae8d0 2024-09-12T02:42:03.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.940+0000 7fb530800640 1 -- 172.21.15.112:0/464552757 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5281566a0 con 0x7fb5280ae8d0 2024-09-12T02:42:03.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.941+0000 7fb530800640 1 -- 172.21.15.112:0/464552757 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb528156c60 con 0x7fb5280ae8d0 2024-09-12T02:42:03.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.941+0000 7fb530800640 1 -- 172.21.15.112:0/464552757 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb528068a30 con 0x7fb5280ae8d0 2024-09-12T02:42:03.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.942+0000 7fb522000640 1 -- 172.21.15.112:0/464552757 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb524007bf0 con 0x7fb5280ae8d0 2024-09-12T02:42:03.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.943+0000 7fb522000640 1 --2- 172.21.15.112:0/464552757 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb50c06be30 0x7fb50c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:03.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.943+0000 7fb522000640 1 -- 172.21.15.112:0/464552757 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb5240abbf0 con 0x7fb5280ae8d0 2024-09-12T02:42:03.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.943+0000 7fb52de00640 1 --2- 172.21.15.112:0/464552757 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb50c06be30 0x7fb50c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:03.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.944+0000 7fb52de00640 1 --2- 172.21.15.112:0/464552757 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb50c06be30 0x7fb50c06e2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb528160d10 tx=0x7fb51c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:03.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:03.947+0000 7fb522000640 1 -- 172.21.15.112:0/464552757 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb524079eb0 con 0x7fb5280ae8d0 2024-09-12T02:42:04.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.124+0000 7fb530800640 1 -- 172.21.15.112:0/464552757 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb528072120 con 0x7fb5280ae8d0 2024-09-12T02:42:04.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.125+0000 7fb522000640 1 -- 172.21.15.112:0/464552757 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16713 (secure 0 0 0) 0x7fb52407e1b0 con 0x7fb5280ae8d0 2024-09-12T02:42:04.127 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:42:04.127 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":20,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:41:54.774268+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:41:51.222228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:41:52.167920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:42:04.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.127+0000 7fb530800640 1 -- 172.21.15.112:0/464552757 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb50c06be30 msgr2=0x7fb50c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.127+0000 7fb530800640 1 --2- 172.21.15.112:0/464552757 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb50c06be30 0x7fb50c06e2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb528160d10 tx=0x7fb51c009040 comp rx=0 tx=0).stop 2024-09-12T02:42:04.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.127+0000 7fb530800640 1 -- 172.21.15.112:0/464552757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5280ae8d0 msgr2=0x7fb5280cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.127+0000 7fb530800640 1 --2- 172.21.15.112:0/464552757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5280ae8d0 0x7fb5280cdcf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb524034040 tx=0x7fb524004a40 comp rx=0 tx=0).stop 2024-09-12T02:42:04.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.128+0000 7fb530800640 1 -- 172.21.15.112:0/464552757 shutdown_connections 2024-09-12T02:42:04.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.128+0000 7fb530800640 1 --2- 172.21.15.112:0/464552757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5280ae8d0 0x7fb5280cdcf0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.128+0000 7fb530800640 1 --2- 172.21.15.112:0/464552757 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb52806dca0 0x7fb5281463a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.128+0000 7fb530800640 1 --2- 172.21.15.112:0/464552757 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb50c06be30 0x7fb50c06e2f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.128+0000 7fb530800640 1 --2- 172.21.15.112:0/464552757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb52806d8c0 0x7fb528152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.128+0000 7fb530800640 1 -- 172.21.15.112:0/464552757 >> 172.21.15.112:0/464552757 conn(0x7fb52806bbd0 msgr2=0x7fb528071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:04.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.128+0000 7fb530800640 1 -- 172.21.15.112:0/464552757 shutdown_connections 2024-09-12T02:42:04.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.128+0000 7fb530800640 1 -- 172.21.15.112:0/464552757 wait complete. 2024-09-12T02:42:04.146 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T02:42:04.146 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T02:42:04.147 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T02:42:04.147 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T02:42:04.148 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T02:42:04.148 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T02:42:04.149 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T02:42:04.149 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T02:42:04.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.416+0000 7f2097600640 1 Processor -- start 2024-09-12T02:42:04.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.416+0000 7f2097600640 1 -- start start 2024-09-12T02:42:04.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.416+0000 7fb8a5200640 1 Processor -- start 2024-09-12T02:42:04.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.416+0000 7fb8a5200640 1 -- start start 2024-09-12T02:42:04.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.417+0000 7f7443e00640 1 Processor -- start 2024-09-12T02:42:04.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.418+0000 7f7443e00640 1 -- start start 2024-09-12T02:42:04.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.418+0000 7fb8a5200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb8a00ce110 0x7fb8a00d19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.418+0000 7fb8a5200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb8a00d1f10 0x7fb8a015f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.418+0000 7f2097600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2090162100 0x7f20900d58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.418+0000 7f2097600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f20900d0510 0x7f20900d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.418+0000 7f2097600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20900cfa70 con 0x7f20901624e0 2024-09-12T02:42:04.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.418+0000 7f2097600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f20900b4e20 con 0x7f2090162100 2024-09-12T02:42:04.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.418+0000 7f2097600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f20900d21d0 con 0x7f20900d0510 2024-09-12T02:42:04.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.419+0000 7f2094c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2090162100 0x7f20900d58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.418+0000 7fb8a5200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8a015fa90 0x7fb8a0072570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.419+0000 7fb89de00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb8a00ce110 0x7fb8a00d19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.419+0000 7fb8a5200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb8a00d2380 con 0x7fb8a00ce110 2024-09-12T02:42:04.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.419+0000 7fb8a5200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb8a0152e20 con 0x7fb8a00d1f10 2024-09-12T02:42:04.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.419+0000 7fb8a5200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb8a015bf60 con 0x7fb8a015fa90 2024-09-12T02:42:04.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.419+0000 7fb89de00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb8a00ce110 0x7fb8a00d19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57608/0 (socket says 172.21.15.112:57608) 2024-09-12T02:42:04.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.419+0000 7fb89de00640 1 -- 172.21.15.112:0/649470730 learned_addr learned my addr 172.21.15.112:0/649470730 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:04.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.419+0000 7f2094c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2090162100 0x7f20900d58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:47594/0 (socket says 172.21.15.112:47594) 2024-09-12T02:42:04.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.419+0000 7f2094c00640 1 -- 172.21.15.112:0/1005909119 learned_addr learned my addr 172.21.15.112:0/1005909119 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:04.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.419+0000 7f208fe00640 1 --1- 172.21.15.112:0/1005909119 >> v1:172.21.15.137:6789/0 conn(0x7f20901624e0 0x7f20900b4710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.112:40484/0 (socket says 172.21.15.112:40484) 2024-09-12T02:42:04.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.419+0000 7f2095600640 1 --2- 172.21.15.112:0/1005909119 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f20900d0510 0x7f20900d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.419+0000 7fb89d400640 1 --2- 172.21.15.112:0/649470730 >> v2:172.21.15.137:3300/0 conn(0x7fb8a00d1f10 0x7fb8a015f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.419+0000 7fb89e800640 1 --2- 172.21.15.112:0/649470730 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8a015fa90 0x7fb8a0072570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.420+0000 7fb89d400640 1 -- 172.21.15.112:0/649470730 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8a015fa90 msgr2=0x7fb8a0072570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:04.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.420+0000 7fb89d400640 1 --2- 172.21.15.112:0/649470730 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8a015fa90 0x7fb8a0072570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.420+0000 7fb89d400640 1 -- 172.21.15.112:0/649470730 >> v2:172.21.15.112:3300/0 conn(0x7fb8a00ce110 msgr2=0x7fb8a00d19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:04.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.420+0000 7fb89d400640 1 --2- 172.21.15.112:0/649470730 >> v2:172.21.15.112:3300/0 conn(0x7fb8a00ce110 0x7fb8a00d19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.420+0000 7fb89d400640 1 -- 172.21.15.112:0/649470730 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a0160240 con 0x7fb8a00d1f10 2024-09-12T02:42:04.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.420+0000 7f7443e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f743c005a60 0x7f743c053f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.420+0000 7f7443e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f743c0e7120 0x7f743c005e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.420+0000 7f7443e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f743c006380 con 0x7f743c04eb60 2024-09-12T02:42:04.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.420+0000 7f7443e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f743c0520e0 con 0x7f743c005a60 2024-09-12T02:42:04.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.420+0000 7f7443e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f743c052330 con 0x7f743c0e7120 2024-09-12T02:42:04.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.421+0000 7f7442000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f743c0e7120 0x7f743c005e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.420+0000 7f2095600640 1 -- 172.21.15.112:0/1005909119 >> v2:172.21.15.137:3300/0 conn(0x7f2090162100 msgr2=0x7f20900d58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:04.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.420+0000 7f2095600640 1 --2- 172.21.15.112:0/1005909119 >> v2:172.21.15.137:3300/0 conn(0x7f2090162100 0x7f20900d58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.421+0000 7f2095600640 1 -- 172.21.15.112:0/1005909119 >> v1:172.21.15.137:6789/0 conn(0x7f20901624e0 legacy=0x7f20900b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.421+0000 7f2095600640 1 -- 172.21.15.112:0/1005909119 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20900d24b0 con 0x7f20900d0510 2024-09-12T02:42:04.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.421+0000 7f7443400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f743c04eb60 0x7f743c01c520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33896/0 (socket says 172.21.15.112:33896) 2024-09-12T02:42:04.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.421+0000 7f7443400640 1 -- 172.21.15.112:0/500210407 learned_addr learned my addr 172.21.15.112:0/500210407 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:04.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.421+0000 7f7442a00640 1 --2- 172.21.15.112:0/500210407 >> v2:172.21.15.112:3300/0 conn(0x7f743c005a60 0x7f743c053f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.421+0000 7fb89d400640 1 --2- 172.21.15.112:0/649470730 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8a00d1f10 0x7fb8a015f550 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00ce8d0 tx=0x7fb89002c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f265912b8aa903d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.422+0000 7f7442000640 1 -- 172.21.15.112:0/500210407 >> v2:172.21.15.112:3300/0 conn(0x7f743c005a60 msgr2=0x7f743c053f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:04.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.422+0000 7f2095600640 1 --2- 172.21.15.112:0/1005909119 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f20900d0510 0x7f20900d0920 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f20800097a0 tx=0x7f208002a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaf426cdda715e18 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.422+0000 7f7442000640 1 --2- 172.21.15.112:0/500210407 >> v2:172.21.15.112:3300/0 conn(0x7f743c005a60 0x7f743c053f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.422+0000 7f7441600640 1 -- 172.21.15.112:0/500210407 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 768350741 0 0) 0x7f743c006380 con 0x7f743c04eb60 2024-09-12T02:42:04.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.422+0000 7f7442000640 1 -- 172.21.15.112:0/500210407 >> v1:172.21.15.112:6789/0 conn(0x7f743c04eb60 legacy=0x7f743c01c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.422+0000 7f208f400640 1 -- 172.21.15.112:0/1005909119 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2080037070 con 0x7f20900d0510 2024-09-12T02:42:04.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.423+0000 7f208f400640 1 -- 172.21.15.112:0/1005909119 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2080032440 con 0x7f20900d0510 2024-09-12T02:42:04.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.423+0000 7f208f400640 1 -- 172.21.15.112:0/1005909119 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208002ae60 con 0x7f20900d0510 2024-09-12T02:42:04.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.423+0000 7fb89ca00640 1 -- 172.21.15.112:0/649470730 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb890038070 con 0x7fb8a00d1f10 2024-09-12T02:42:04.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.423+0000 7fb89ca00640 1 -- 172.21.15.112:0/649470730 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb890031710 con 0x7fb8a00d1f10 2024-09-12T02:42:04.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.423+0000 7fb89ca00640 1 -- 172.21.15.112:0/649470730 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb890031b20 con 0x7fb8a00d1f10 2024-09-12T02:42:04.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.422+0000 7f7442000640 1 -- 172.21.15.112:0/500210407 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f743c006c80 con 0x7f743c0e7120 2024-09-12T02:42:04.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.423+0000 7f7442a00640 1 --2- 172.21.15.112:0/500210407 >> v2:172.21.15.112:3300/0 conn(0x7f743c005a60 0x7f743c053f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:04.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.424+0000 7f2097600640 1 -- 172.21.15.112:0/1005909119 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f20900d0510 msgr2=0x7f20900d0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.424+0000 7f2097600640 1 --2- 172.21.15.112:0/1005909119 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f20900d0510 0x7f20900d0920 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f20800097a0 tx=0x7f208002a110 comp rx=0 tx=0).stop 2024-09-12T02:42:04.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.424+0000 7fb8a5200640 1 -- 172.21.15.112:0/649470730 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8a00d1f10 msgr2=0x7fb8a015f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.424+0000 7fb8a5200640 1 --2- 172.21.15.112:0/649470730 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8a00d1f10 0x7fb8a015f550 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00ce8d0 tx=0x7fb89002c770 comp rx=0 tx=0).stop 2024-09-12T02:42:04.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.424+0000 7f2097600640 1 -- 172.21.15.112:0/1005909119 shutdown_connections 2024-09-12T02:42:04.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.424+0000 7f2097600640 1 --2- 172.21.15.112:0/1005909119 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f20900d0510 0x7f20900d0920 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.424+0000 7f2097600640 1 --2- 172.21.15.112:0/1005909119 >> v2:172.21.15.137:3300/0 conn(0x7f2090162100 0x7f20900d58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.424+0000 7f2097600640 1 -- 172.21.15.112:0/1005909119 >> 172.21.15.112:0/1005909119 conn(0x7f20900d4db0 msgr2=0x7f20900d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:04.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.424+0000 7fb8a5200640 1 -- 172.21.15.112:0/649470730 shutdown_connections 2024-09-12T02:42:04.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.424+0000 7fb8a5200640 1 --2- 172.21.15.112:0/649470730 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8a015fa90 0x7fb8a0072570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.424+0000 7fb8a5200640 1 --2- 172.21.15.112:0/649470730 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8a00d1f10 0x7fb8a015f550 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.424+0000 7fb8a5200640 1 --2- 172.21.15.112:0/649470730 >> v2:172.21.15.112:3300/0 conn(0x7fb8a00ce110 0x7fb8a00d19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.424+0000 7fb8a5200640 1 -- 172.21.15.112:0/649470730 >> 172.21.15.112:0/649470730 conn(0x7fb8a006cce0 msgr2=0x7fb8a006d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:04.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.424+0000 7f2097600640 1 -- 172.21.15.112:0/1005909119 shutdown_connections 2024-09-12T02:42:04.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.424+0000 7fb8a5200640 1 -- 172.21.15.112:0/649470730 shutdown_connections 2024-09-12T02:42:04.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.424+0000 7efd0ac00640 1 Processor -- start 2024-09-12T02:42:04.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.425+0000 7efd0ac00640 1 -- start start 2024-09-12T02:42:04.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.425+0000 7fb8a5200640 1 -- 172.21.15.112:0/649470730 wait complete. 2024-09-12T02:42:04.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.425+0000 7f7442000640 1 --2- 172.21.15.112:0/500210407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f743c0e7120 0x7f743c005e40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f743c00d7c0 tx=0x7f743002a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17507d166d470592 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.425+0000 7f2097600640 1 -- 172.21.15.112:0/1005909119 wait complete. 2024-09-12T02:42:04.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.426+0000 7f7441600640 1 -- 172.21.15.112:0/500210407 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7430037070 con 0x7f743c0e7120 2024-09-12T02:42:04.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.426+0000 7f7441600640 1 -- 172.21.15.112:0/500210407 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7430032440 con 0x7f743c0e7120 2024-09-12T02:42:04.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.426+0000 7f7441600640 1 -- 172.21.15.112:0/500210407 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7430032810 con 0x7f743c0e7120 2024-09-12T02:42:04.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.426+0000 7efd0ac00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efcfc009fe0 0x7efcfc007070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.426+0000 7efd0ac00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efcfc0075b0 0x7efcfc033600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.426+0000 7efd0ac00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcfc00bff0 con 0x7efcfc0e2b20 2024-09-12T02:42:04.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.426+0000 7efd0ac00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7efcfc055890 con 0x7efcfc009fe0 2024-09-12T02:42:04.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.426+0000 7efd0ac00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7efcfc00bb60 con 0x7efcfc0075b0 2024-09-12T02:42:04.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.427+0000 7f7443e00640 1 -- 172.21.15.112:0/500210407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f743c0e7120 msgr2=0x7f743c005e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.427+0000 7f7443e00640 1 --2- 172.21.15.112:0/500210407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f743c0e7120 0x7f743c005e40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f743c00d7c0 tx=0x7f743002a250 comp rx=0 tx=0).stop 2024-09-12T02:42:04.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.427+0000 7f2097600640 1 Processor -- start 2024-09-12T02:42:04.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.427+0000 7f2097600640 1 -- start start 2024-09-12T02:42:04.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.427+0000 7f7443e00640 1 -- 172.21.15.112:0/500210407 shutdown_connections 2024-09-12T02:42:04.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.427+0000 7f7443e00640 1 --2- 172.21.15.112:0/500210407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f743c0e7120 0x7f743c005e40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.427+0000 7f7443e00640 1 --2- 172.21.15.112:0/500210407 >> v2:172.21.15.112:3300/0 conn(0x7f743c005a60 0x7f743c053f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.427+0000 7f7443e00640 1 -- 172.21.15.112:0/500210407 >> 172.21.15.112:0/500210407 conn(0x7f743c036090 msgr2=0x7f743c0364a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:04.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.427+0000 7efd08e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efcfc009fe0 0x7efcfc007070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.427+0000 7efd08e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efcfc009fe0 0x7efcfc007070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:47624/0 (socket says 172.21.15.112:47624) 2024-09-12T02:42:04.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.427+0000 7efd08e00640 1 -- 172.21.15.112:0/382987088 learned_addr learned my addr 172.21.15.112:0/382987088 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:04.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.427+0000 7efd0a200640 1 --2- 172.21.15.112:0/382987088 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efcfc0075b0 0x7efcfc033600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.428+0000 7efd08e00640 1 -- 172.21.15.112:0/382987088 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efcfc0075b0 msgr2=0x7efcfc033600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:04.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.428+0000 7efd08e00640 1 --2- 172.21.15.112:0/382987088 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efcfc0075b0 0x7efcfc033600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.428+0000 7efd08e00640 1 -- 172.21.15.112:0/382987088 >> v1:172.21.15.112:6789/0 conn(0x7efcfc0e2b20 legacy=0x7efcfc0396a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.428+0000 7efd08e00640 1 -- 172.21.15.112:0/382987088 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcfc036fb0 con 0x7efcfc009fe0 2024-09-12T02:42:04.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.428+0000 7f7443e00640 1 -- 172.21.15.112:0/500210407 shutdown_connections 2024-09-12T02:42:04.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.429+0000 7fb8a5200640 1 Processor -- start 2024-09-12T02:42:04.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.428+0000 7f7443e00640 1 -- 172.21.15.112:0/500210407 wait complete. 2024-09-12T02:42:04.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.429+0000 7fb8a5200640 1 -- start start 2024-09-12T02:42:04.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.429+0000 7fed7c800640 1 Processor -- start 2024-09-12T02:42:04.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.430+0000 7f2097600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f20900d0510 0x7f20900b6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.430+0000 7fed7c800640 1 -- start start 2024-09-12T02:42:04.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.430+0000 7efd08e00640 1 --2- 172.21.15.112:0/382987088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcfc009fe0 0x7efcfc007070 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009870 tx=0x7efcf002a070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57281db138cbc9cf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.430+0000 7f2097600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2090162100 0x7f20900c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.430+0000 7f2094c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f20900d0510 0x7f20900b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.430+0000 7f54ba800640 1 Processor -- start 2024-09-12T02:42:04.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.430+0000 7f2094c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f20900d0510 0x7f20900b6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:47640/0 (socket says 172.21.15.112:47640) 2024-09-12T02:42:04.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.430+0000 7f2094c00640 1 -- 172.21.15.112:0/3589904959 learned_addr learned my addr 172.21.15.112:0/3589904959 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:04.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.430+0000 7efd03e00640 1 -- 172.21.15.112:0/382987088 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf0037070 con 0x7efcfc009fe0 2024-09-12T02:42:04.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.430+0000 7f23ccc00640 1 Processor -- start 2024-09-12T02:42:04.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.430+0000 7efd03e00640 1 -- 172.21.15.112:0/382987088 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf002adc0 con 0x7efcfc009fe0 2024-09-12T02:42:04.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.431+0000 7efd03e00640 1 -- 172.21.15.112:0/382987088 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf0037070 con 0x7efcfc009fe0 2024-09-12T02:42:04.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.431+0000 7f7443e00640 1 Processor -- start 2024-09-12T02:42:04.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.431+0000 7f7443e00640 1 -- start start 2024-09-12T02:42:04.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.431+0000 7fb8a5200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8a00d1f10 0x7fb8a015b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.431+0000 7fed7c800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fed741624e0 0x7fed740d58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.431+0000 7fed7c800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fed740d0510 0x7fed740d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.431+0000 7fed7c800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed740cfa70 con 0x7fed74162100 2024-09-12T02:42:04.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.431+0000 7fed7c800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fed740b4e20 con 0x7fed741624e0 2024-09-12T02:42:04.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.431+0000 7fed7c800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fed740d21d0 con 0x7fed740d0510 2024-09-12T02:42:04.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.432+0000 7efd0ac00640 1 -- 172.21.15.112:0/382987088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcfc009fe0 msgr2=0x7efcfc007070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.432+0000 7efd0ac00640 1 --2- 172.21.15.112:0/382987088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcfc009fe0 0x7efcfc007070 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009870 tx=0x7efcf002a070 comp rx=0 tx=0).stop 2024-09-12T02:42:04.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.432+0000 7fed7a800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fed740d0510 0x7fed740d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.432+0000 7fed7a800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fed740d0510 0x7fed740d0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:47650/0 (socket says 172.21.15.112:47650) 2024-09-12T02:42:04.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.432+0000 7fed7a800640 1 -- 172.21.15.112:0/2150709102 learned_addr learned my addr 172.21.15.112:0/2150709102 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:04.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.432+0000 7efd0ac00640 1 -- 172.21.15.112:0/382987088 shutdown_connections 2024-09-12T02:42:04.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.432+0000 7efd0ac00640 1 --2- 172.21.15.112:0/382987088 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efcfc0075b0 0x7efcfc033600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.432+0000 7efd0ac00640 1 --2- 172.21.15.112:0/382987088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcfc009fe0 0x7efcfc007070 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.432+0000 7efd0ac00640 1 -- 172.21.15.112:0/382987088 >> 172.21.15.112:0/382987088 conn(0x7efcfc01dd80 msgr2=0x7efcfc0549f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:04.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.431+0000 7fb8a5200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8a015fa90 0x7fb8a01558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.431+0000 7fb8a5200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8a0154330 0x7fb8a0155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.430+0000 7f2097600640 1 --2- 172.21.15.112:0/3589904959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20901624e0 0x7f2090154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.430+0000 7f54ba800640 1 -- start start 2024-09-12T02:42:04.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.432+0000 7f54ba800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f54b40d1520 0x7f54b40d1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.432+0000 7f54ba800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54b40b8410 0x7f54b40b88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.432+0000 7f54ba800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54b40b7c80 con 0x7f54b41625b0 2024-09-12T02:42:04.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.432+0000 7fed7a800640 1 -- 172.21.15.112:0/2150709102 >> v2:172.21.15.112:3300/0 conn(0x7fed741624e0 msgr2=0x7fed740d58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:04.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.432+0000 7fed7a800640 1 --2- 172.21.15.112:0/2150709102 >> v2:172.21.15.112:3300/0 conn(0x7fed741624e0 0x7fed740d58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.432+0000 7fed7a800640 1 -- 172.21.15.112:0/2150709102 >> v1:172.21.15.112:6789/0 conn(0x7fed74162100 legacy=0x7fed740b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:04.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.432+0000 7fed7a800640 1 -- 172.21.15.112:0/2150709102 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed740d24b0 con 0x7fed740d0510 2024-09-12T02:42:04.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.432+0000 7f54ba800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f54b40d0370 con 0x7f54b40d1520 2024-09-12T02:42:04.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.432+0000 7f54ba800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f54b40d1ea0 con 0x7f54b40b8410 2024-09-12T02:42:04.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.432+0000 7f2097600640 1 -- 172.21.15.112:0/3589904959 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f20900d0e60 con 0x7f20901624e0 2024-09-12T02:42:04.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.432+0000 7f2097600640 1 -- 172.21.15.112:0/3589904959 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f20900cfff0 con 0x7f2090162100 2024-09-12T02:42:04.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.432+0000 7f2097600640 1 -- 172.21.15.112:0/3589904959 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f20900d1df0 con 0x7f20900d0510 2024-09-12T02:42:04.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.433+0000 7efd0ac00640 1 -- 172.21.15.112:0/382987088 shutdown_connections 2024-09-12T02:42:04.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.433+0000 7f54b2a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f54b40d1520 0x7f54b40d1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.433+0000 7f54b2a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f54b40d1520 0x7f54b40d1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:47680/0 (socket says 172.21.15.112:47680) 2024-09-12T02:42:04.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.433+0000 7f54b2a00640 1 -- 172.21.15.112:0/1793742747 learned_addr learned my addr 172.21.15.112:0/1793742747 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:04.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.433+0000 7f208fe00640 1 --2- 172.21.15.112:0/3589904959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2090162100 0x7f20900c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.433+0000 7efd0ac00640 1 -- 172.21.15.112:0/382987088 wait complete. 2024-09-12T02:42:04.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.431+0000 7fb8a5200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a015c7a0 con 0x7fb8a015fa90 2024-09-12T02:42:04.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.433+0000 7f2095600640 1 --2- 172.21.15.112:0/3589904959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20901624e0 0x7f2090154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.433+0000 7f54b3e00640 1 --2- 172.21.15.112:0/1793742747 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54b40b8410 0x7f54b40b88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.433+0000 7f2094c00640 1 -- 172.21.15.112:0/3589904959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2090162100 msgr2=0x7f20900c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.433+0000 7f2094c00640 1 --2- 172.21.15.112:0/3589904959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2090162100 0x7f20900c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.433+0000 7f2094c00640 1 -- 172.21.15.112:0/3589904959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20901624e0 msgr2=0x7f2090154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.433+0000 7f2094c00640 1 --2- 172.21.15.112:0/3589904959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20901624e0 0x7f2090154670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.434+0000 7f2094c00640 1 -- 172.21.15.112:0/3589904959 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20900b6ca0 con 0x7f20900d0510 2024-09-12T02:42:04.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.431+0000 7fb8a5200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a015c4c0 con 0x7fb8a00d1f10 2024-09-12T02:42:04.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.434+0000 7fed7a800640 1 --2- 172.21.15.112:0/2150709102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed740d0510 0x7fed740d0920 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fed7408f060 tx=0x7fed7002a640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f89bb6888b6e6e1a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.434+0000 7f54b2a00640 1 -- 172.21.15.112:0/1793742747 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54b40b8410 msgr2=0x7f54b40b88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:04.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.431+0000 7f23ccc00640 1 -- start start 2024-09-12T02:42:04.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.433+0000 7f23ccc00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f23c81624e0 0x7f23c80d58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.433+0000 7f23ccc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f23c80d0510 0x7f23c80d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.433+0000 7f23ccc00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23c80cfa70 con 0x7f23c8162100 2024-09-12T02:42:04.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.433+0000 7f23ccc00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f23c80b4e20 con 0x7f23c81624e0 2024-09-12T02:42:04.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.433+0000 7f23ccc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f23c80d21d0 con 0x7f23c80d0510 2024-09-12T02:42:04.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.434+0000 7f54b2a00640 1 --2- 172.21.15.112:0/1793742747 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54b40b8410 0x7f54b40b88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.434+0000 7f2094c00640 1 --2- 172.21.15.112:0/3589904959 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f20900d0510 0x7f20900b6680 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f207c00e870 tx=0x7f207c00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.434+0000 7f208cc00640 1 -- 172.21.15.112:0/3589904959 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c017070 con 0x7f20900d0510 2024-09-12T02:42:04.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.434+0000 7f208cc00640 1 -- 172.21.15.112:0/3589904959 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f207c00c8e0 con 0x7f20900d0510 2024-09-12T02:42:04.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.434+0000 7f7443e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f743c005a60 0x7f743c0e1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.431+0000 7fb8a5200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb8a015fee0 con 0x7fb8a0154330 2024-09-12T02:42:04.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.433+0000 7fb89de00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8a00d1f10 0x7fb8a015b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.433+0000 7fb89e800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8a0154330 0x7fb8a0155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.433+0000 7fb89de00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8a00d1f10 0x7fb8a015b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:47666/0 (socket says 172.21.15.112:47666) 2024-09-12T02:42:04.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.433+0000 7fb89de00640 1 -- 172.21.15.112:0/1951324284 learned_addr learned my addr 172.21.15.112:0/1951324284 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:04.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.434+0000 7fb89de00640 1 -- 172.21.15.112:0/1951324284 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8a0154330 msgr2=0x7fb8a0155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.434+0000 7fb89de00640 1 --2- 172.21.15.112:0/1951324284 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8a0154330 0x7fb8a0155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.434+0000 7fb89de00640 1 -- 172.21.15.112:0/1951324284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8a015fa90 msgr2=0x7fb8a01558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.434+0000 7fb89de00640 1 --2- 172.21.15.112:0/1951324284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8a015fa90 0x7fb8a01558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.434+0000 7fb89de00640 1 -- 172.21.15.112:0/1951324284 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a0152ff0 con 0x7fb8a00d1f10 2024-09-12T02:42:04.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.434+0000 7f54b2a00640 1 -- 172.21.15.112:0/1793742747 >> v1:172.21.15.112:6789/0 conn(0x7f54b41625b0 legacy=0x7f54b40d5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:04.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.434+0000 7fed78a00640 1 -- 172.21.15.112:0/2150709102 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed70036070 con 0x7fed740d0510 2024-09-12T02:42:04.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.434+0000 7fed78a00640 1 -- 172.21.15.112:0/2150709102 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed70031600 con 0x7fed740d0510 2024-09-12T02:42:04.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.434+0000 7fed78a00640 1 -- 172.21.15.112:0/2150709102 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed700319d0 con 0x7fed740d0510 2024-09-12T02:42:04.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.434+0000 7f208cc00640 1 -- 172.21.15.112:0/3589904959 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c00ccd0 con 0x7f20900d0510 2024-09-12T02:42:04.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.434+0000 7f2097600640 1 -- 172.21.15.112:0/3589904959 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20900b6f80 con 0x7f20900d0510 2024-09-12T02:42:04.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.434+0000 7f54b2a00640 1 -- 172.21.15.112:0/1793742747 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54b4162990 con 0x7f54b40d1520 2024-09-12T02:42:04.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.435+0000 7f2097600640 1 -- 172.21.15.112:0/3589904959 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f20900b7540 con 0x7f20900d0510 2024-09-12T02:42:04.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.435+0000 7fb89de00640 1 --2- 172.21.15.112:0/1951324284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8a00d1f10 0x7fb8a015b040 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb898007bd0 tx=0x7fb89800d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.435+0000 7f23c5e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f23c8162100 0x7f23c80b4710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33940/0 (socket says 172.21.15.112:33940) 2024-09-12T02:42:04.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.435+0000 7f23c5e00640 1 -- 172.21.15.112:0/584182847 learned_addr learned my addr 172.21.15.112:0/584182847 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:04.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.436+0000 7fb896000640 1 -- 172.21.15.112:0/1951324284 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89801a070 con 0x7fb8a00d1f10 2024-09-12T02:42:04.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.436+0000 7fb896000640 1 -- 172.21.15.112:0/1951324284 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb89800dd50 con 0x7fb8a00d1f10 2024-09-12T02:42:04.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.436+0000 7fb896000640 1 -- 172.21.15.112:0/1951324284 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb898015620 con 0x7fb8a00d1f10 2024-09-12T02:42:04.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.435+0000 7f7443e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f743c04eb60 0x7f743c0dd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.435+0000 7f7443e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f743c0e7120 0x7f743c04b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.436+0000 7f23c5400640 1 --2- 172.21.15.112:0/584182847 >> v2:172.21.15.112:3300/0 conn(0x7f23c81624e0 0x7f23c80d58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.436+0000 7fb8a5200640 1 -- 172.21.15.112:0/1951324284 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8a0153290 con 0x7fb8a00d1f10 2024-09-12T02:42:04.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.435+0000 7fed7c800640 1 -- 172.21.15.112:0/2150709102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed740d0510 msgr2=0x7fed740d0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.435+0000 7fed7c800640 1 --2- 172.21.15.112:0/2150709102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed740d0510 0x7fed740d0920 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fed7408f060 tx=0x7fed7002a640 comp rx=0 tx=0).stop 2024-09-12T02:42:04.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.436+0000 7f23c6800640 1 --2- 172.21.15.112:0/584182847 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f23c80d0510 0x7f23c80d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.436+0000 7f2097600640 1 -- 172.21.15.112:0/3589904959 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2090162b80 con 0x7f20900d0510 2024-09-12T02:42:04.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.436+0000 7fed7c800640 1 -- 172.21.15.112:0/2150709102 shutdown_connections 2024-09-12T02:42:04.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.436+0000 7fed7c800640 1 --2- 172.21.15.112:0/2150709102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed740d0510 0x7fed740d0920 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.436+0000 7f7442000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f743c04eb60 0x7f743c0dd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.436+0000 7f7442000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f743c04eb60 0x7f743c0dd1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:47694/0 (socket says 172.21.15.112:47694) 2024-09-12T02:42:04.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.436+0000 7f7442000640 1 -- 172.21.15.112:0/4227358281 learned_addr learned my addr 172.21.15.112:0/4227358281 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:04.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.437+0000 7fed7c800640 1 --2- 172.21.15.112:0/2150709102 >> v2:172.21.15.112:3300/0 conn(0x7fed741624e0 0x7fed740d58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.436+0000 7f7442a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f743c005a60 0x7f743c0e1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.437+0000 7fed7c800640 1 -- 172.21.15.112:0/2150709102 >> 172.21.15.112:0/2150709102 conn(0x7fed740d4db0 msgr2=0x7fed740d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:04.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.437+0000 7f7443e00640 1 -- 172.21.15.112:0/4227358281 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f743c053a10 con 0x7f743c0e7120 2024-09-12T02:42:04.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.437+0000 7fed7c800640 1 -- 172.21.15.112:0/2150709102 shutdown_connections 2024-09-12T02:42:04.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.437+0000 7f7443400640 1 --2- 172.21.15.112:0/4227358281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f743c0e7120 0x7f743c04b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.437+0000 7fed7c800640 1 -- 172.21.15.112:0/2150709102 wait complete. 2024-09-12T02:42:04.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.437+0000 7f7443e00640 1 -- 172.21.15.112:0/4227358281 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f743c007240 con 0x7f743c04eb60 2024-09-12T02:42:04.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.437+0000 7f7443e00640 1 -- 172.21.15.112:0/4227358281 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f743c01dc40 con 0x7f743c005a60 2024-09-12T02:42:04.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.437+0000 7f23c4a00640 1 -- 172.21.15.112:0/584182847 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4263371779 0 0) 0x7f23c80cfa70 con 0x7f23c8162100 2024-09-12T02:42:04.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.438+0000 7f208cc00640 1 -- 172.21.15.112:0/3589904959 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f207c01a070 con 0x7f20900d0510 2024-09-12T02:42:04.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.438+0000 7f7443400640 1 -- 172.21.15.112:0/4227358281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f743c005a60 msgr2=0x7f743c0e1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.438+0000 7f7443400640 1 --2- 172.21.15.112:0/4227358281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f743c005a60 0x7f743c0e1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.438+0000 7f7443400640 1 -- 172.21.15.112:0/4227358281 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f743c04eb60 msgr2=0x7f743c0dd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.438+0000 7f7443400640 1 --2- 172.21.15.112:0/4227358281 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f743c04eb60 0x7f743c0dd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.438+0000 7f7443400640 1 -- 172.21.15.112:0/4227358281 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f743c0e2210 con 0x7f743c0e7120 2024-09-12T02:42:04.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.437+0000 7fb8a5200640 1 -- 172.21.15.112:0/1951324284 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8a0153850 con 0x7fb8a00d1f10 2024-09-12T02:42:04.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.438+0000 7fb8a5200640 1 -- 172.21.15.112:0/1951324284 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb8a015ccc0 con 0x7fb8a00d1f10 2024-09-12T02:42:04.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.437+0000 7efd0ac00640 1 Processor -- start 2024-09-12T02:42:04.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.438+0000 7efd0ac00640 1 -- start start 2024-09-12T02:42:04.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.437+0000 7f23c4a00640 1 -- 172.21.15.112:0/584182847 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23ac003520 con 0x7f23c8162100 2024-09-12T02:42:04.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.437+0000 7f23c5400640 1 -- 172.21.15.112:0/584182847 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f23c80d0510 msgr2=0x7f23c80d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:04.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.437+0000 7f23c5400640 1 --2- 172.21.15.112:0/584182847 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f23c80d0510 0x7f23c80d0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.438+0000 7f23c5400640 1 -- 172.21.15.112:0/584182847 >> v1:172.21.15.112:6789/0 conn(0x7f23c8162100 legacy=0x7f23c80b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.438+0000 7f23c5400640 1 -- 172.21.15.112:0/584182847 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c80d24b0 con 0x7f23c81624e0 2024-09-12T02:42:04.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.439+0000 7f7442a00640 1 --2- 172.21.15.112:0/4227358281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f743c005a60 0x7f743c0e1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:42:04.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.439+0000 7f7443400640 1 --2- 172.21.15.112:0/4227358281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f743c0e7120 0x7f743c04b7a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7444050d60 tx=0x7f74440698c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.439+0000 7f54b2a00640 1 --2- 172.21.15.112:0/1793742747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54b40d1520 0x7f54b40d1960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f549c009870 tx=0x7f549c02a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e704e3e6c80c933b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.439+0000 7f208cc00640 1 --2- 172.21.15.112:0/3589904959 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f207006bf00 0x7f207006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.439+0000 7f743aa00640 1 -- 172.21.15.112:0/4227358281 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74440691c0 con 0x7f743c0e7120 2024-09-12T02:42:04.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.439+0000 7f743aa00640 1 -- 172.21.15.112:0/4227358281 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f744406bbd0 con 0x7f743c0e7120 2024-09-12T02:42:04.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.439+0000 7f743aa00640 1 -- 172.21.15.112:0/4227358281 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7444072890 con 0x7f743c0e7120 2024-09-12T02:42:04.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.440+0000 7f23c5400640 1 --2- 172.21.15.112:0/584182847 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c81624e0 0x7f23c80d58d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f23b40097a0 tx=0x7f23b402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c1a292ca2d317 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.440+0000 7f7443e00640 1 -- 172.21.15.112:0/4227358281 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f743c0e24f0 con 0x7f743c0e7120 2024-09-12T02:42:04.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.439+0000 7f208cc00640 1 -- 172.21.15.112:0/3589904959 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f207c08b030 con 0x7f20900d0510 2024-09-12T02:42:04.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.440+0000 7f208fe00640 1 --2- 172.21.15.112:0/3589904959 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f207006bf00 0x7f207006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.440+0000 7f208cc00640 1 --2- 172.21.15.112:0/3589904959 >> [v2:172.21.15.112:6800/821571304,v1:172.21.15.112:6801/821571304] conn(0x7f2070074180 0x7f20700765a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.440+0000 7f7443e00640 1 -- 172.21.15.112:0/4227358281 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f743c0e2ab0 con 0x7f743c0e7120 2024-09-12T02:42:04.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.440+0000 7f208cc00640 1 -- 172.21.15.112:0/3589904959 --> [v2:172.21.15.112:6800/821571304,v1:172.21.15.112:6801/821571304] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f207c016ec0 con 0x7f2070074180 2024-09-12T02:42:04.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.440+0000 7f208cc00640 1 -- 172.21.15.112:0/3589904959 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f207c092050 con 0x7f20900d0510 2024-09-12T02:42:04.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.440+0000 7f54b2000640 1 -- 172.21.15.112:0/1793742747 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c037070 con 0x7f54b40d1520 2024-09-12T02:42:04.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.440+0000 7f54b2000640 1 -- 172.21.15.112:0/1793742747 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f549c02ae50 con 0x7f54b40d1520 2024-09-12T02:42:04.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.440+0000 7f54b2000640 1 -- 172.21.15.112:0/1793742747 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c032860 con 0x7f54b40d1520 2024-09-12T02:42:04.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.440+0000 7fed7c800640 1 Processor -- start 2024-09-12T02:42:04.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.440+0000 7fed7c800640 1 -- start start 2024-09-12T02:42:04.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.441+0000 7f2095600640 1 --2- 172.21.15.112:0/3589904959 >> [v2:172.21.15.112:6800/821571304,v1:172.21.15.112:6801/821571304] conn(0x7f2070074180 0x7f20700765a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.441+0000 7f23c4a00640 1 -- 172.21.15.112:0/584182847 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4037070 con 0x7f23c81624e0 2024-09-12T02:42:04.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.441+0000 7f23c4a00640 1 -- 172.21.15.112:0/584182847 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b402adc0 con 0x7f23c81624e0 2024-09-12T02:42:04.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.441+0000 7f23c4a00640 1 -- 172.21.15.112:0/584182847 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4032660 con 0x7f23c81624e0 2024-09-12T02:42:04.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.442+0000 7fed7c800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed740d0510 0x7fed740ba600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.442+0000 7f208fe00640 1 --2- 172.21.15.112:0/3589904959 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f207006bf00 0x7f207006e3c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f20900c8b50 tx=0x7f2088001680 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.442+0000 7fb896000640 1 -- 172.21.15.112:0/1951324284 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb89801d070 con 0x7fb8a00d1f10 2024-09-12T02:42:04.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.442+0000 7fed7c800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed74162100 0x7fed740c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.442+0000 7fed7c800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fed741624e0 0x7fed740c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.442+0000 7fed7c800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fed740d0e60 con 0x7fed740d0510 2024-09-12T02:42:04.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.442+0000 7fed7c800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fed740cfff0 con 0x7fed74162100 2024-09-12T02:42:04.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.442+0000 7fed7c800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fed740d1df0 con 0x7fed741624e0 2024-09-12T02:42:04.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.442+0000 7f54ba800640 1 -- 172.21.15.112:0/1793742747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54b40d1520 msgr2=0x7f54b40d1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.442+0000 7f54ba800640 1 --2- 172.21.15.112:0/1793742747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54b40d1520 0x7f54b40d1960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f549c009870 tx=0x7f549c02a300 comp rx=0 tx=0).stop 2024-09-12T02:42:04.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.442+0000 7f23ccc00640 1 -- 172.21.15.112:0/584182847 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c81624e0 msgr2=0x7f23c80d58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.442+0000 7f23ccc00640 1 --2- 172.21.15.112:0/584182847 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c81624e0 0x7f23c80d58d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f23b40097a0 tx=0x7f23b402a0b0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.442+0000 7f742fe00640 1 -- 172.21.15.112:0/4227358281 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7418001030 con 0x7f743c0e7120 2024-09-12T02:42:04.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.443+0000 7f54ba800640 1 -- 172.21.15.112:0/1793742747 shutdown_connections 2024-09-12T02:42:04.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.443+0000 7f54ba800640 1 --2- 172.21.15.112:0/1793742747 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54b40b8410 0x7f54b40b88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.443+0000 7f54ba800640 1 --2- 172.21.15.112:0/1793742747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54b40d1520 0x7f54b40d1960 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.443+0000 7f54ba800640 1 -- 172.21.15.112:0/1793742747 >> 172.21.15.112:0/1793742747 conn(0x7f54b409e0d0 msgr2=0x7f54b40d4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:04.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.443+0000 7fed79400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed74162100 0x7fed740c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.443+0000 7f54ba800640 1 -- 172.21.15.112:0/1793742747 shutdown_connections 2024-09-12T02:42:04.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.443+0000 7fed79400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed74162100 0x7fed740c9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:47710/0 (socket says 172.21.15.112:47710) 2024-09-12T02:42:04.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.443+0000 7f54ba800640 1 -- 172.21.15.112:0/1793742747 wait complete. 2024-09-12T02:42:04.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.443+0000 7f2095600640 1 --2- 172.21.15.112:0/3589904959 >> [v2:172.21.15.112:6800/821571304,v1:172.21.15.112:6801/821571304] conn(0x7f2070074180 0x7f20700765a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.443+0000 7fed79400640 1 -- 172.21.15.112:0/3501301897 learned_addr learned my addr 172.21.15.112:0/3501301897 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:04.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.443+0000 7fb896000640 1 --2- 172.21.15.112:0/1951324284 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb88006be30 0x7fb88006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.443+0000 7fb896000640 1 -- 172.21.15.112:0/1951324284 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb89808ba50 con 0x7fb8a00d1f10 2024-09-12T02:42:04.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.443+0000 7fb896000640 1 --2- 172.21.15.112:0/1951324284 >> [v2:172.21.15.112:6816/3365688807,v1:172.21.15.112:6817/3365688807] conn(0x7fb880073fd0 0x7fb8800763f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.443+0000 7fb896000640 1 -- 172.21.15.112:0/1951324284 --> [v2:172.21.15.112:6816/3365688807,v1:172.21.15.112:6817/3365688807] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb880076aa0 con 0x7fb880073fd0 2024-09-12T02:42:04.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.443+0000 7fb896000640 1 -- 172.21.15.112:0/1951324284 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb89808bee0 con 0x7fb8a00d1f10 2024-09-12T02:42:04.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.443+0000 7fed79e00640 1 --2- 172.21.15.112:0/3501301897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed740d0510 0x7fed740ba600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.443+0000 7f23ccc00640 1 -- 172.21.15.112:0/584182847 shutdown_connections 2024-09-12T02:42:04.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.444+0000 7f23ccc00640 1 --2- 172.21.15.112:0/584182847 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f23c80d0510 0x7f23c80d0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.444+0000 7f23ccc00640 1 --2- 172.21.15.112:0/584182847 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c81624e0 0x7f23c80d58d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.444+0000 7efd0ac00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcfc0075b0 0x7efcfc022080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.444+0000 7fed79400640 1 -- 172.21.15.112:0/3501301897 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fed741624e0 msgr2=0x7fed740c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.444+0000 7fed79400640 1 --2- 172.21.15.112:0/3501301897 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fed741624e0 0x7fed740c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.444+0000 7fed79400640 1 -- 172.21.15.112:0/3501301897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed740d0510 msgr2=0x7fed740ba600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.444+0000 7fed79400640 1 --2- 172.21.15.112:0/3501301897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed740d0510 0x7fed740ba600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.444+0000 7fed79400640 1 -- 172.21.15.112:0/3501301897 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed740bab40 con 0x7fed74162100 2024-09-12T02:42:04.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.444+0000 7f743aa00640 1 -- 172.21.15.112:0/4227358281 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7444072a30 con 0x7f743c0e7120 2024-09-12T02:42:04.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.444+0000 7fb89e800640 1 --2- 172.21.15.112:0/1951324284 >> [v2:172.21.15.112:6816/3365688807,v1:172.21.15.112:6817/3365688807] conn(0x7fb880073fd0 0x7fb8800763f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.444+0000 7efd0ac00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcfc009fe0 0x7efcfc04e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.444+0000 7fed79400640 1 --2- 172.21.15.112:0/3501301897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed74162100 0x7fed740c9930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fed6400b410 tx=0x7fed6400b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.445+0000 7efd0ac00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efcfc0e2b20 0x7efcfc0e1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.445+0000 7efd08e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcfc009fe0 0x7efcfc04e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.445+0000 7efd08e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcfc009fe0 0x7efcfc04e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:47726/0 (socket says 172.21.15.112:47726) 2024-09-12T02:42:04.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.445+0000 7efd0ac00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efcfc0e2f00 con 0x7efcfc0075b0 2024-09-12T02:42:04.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.445+0000 7efd09800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcfc0075b0 0x7efcfc022080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.445+0000 7efd0a200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efcfc0e2b20 0x7efcfc0e1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.445+0000 7efd0a200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efcfc0e2b20 0x7efcfc0e1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:47712/0 (socket says 172.21.15.112:47712) 2024-09-12T02:42:04.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.445+0000 7efd0a200640 1 -- 172.21.15.112:0/1096545894 learned_addr learned my addr 172.21.15.112:0/1096545894 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:04.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.445+0000 7efd0ac00640 1 -- 172.21.15.112:0/1096545894 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efcfc039db0 con 0x7efcfc009fe0 2024-09-12T02:42:04.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.445+0000 7efd0ac00640 1 -- 172.21.15.112:0/1096545894 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7efcfc00b780 con 0x7efcfc0e2b20 2024-09-12T02:42:04.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.445+0000 7fed6e000640 1 -- 172.21.15.112:0/3501301897 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed64015020 con 0x7fed74162100 2024-09-12T02:42:04.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.445+0000 7fed6e000640 1 -- 172.21.15.112:0/3501301897 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed64011830 con 0x7fed74162100 2024-09-12T02:42:04.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.445+0000 7fed6e000640 1 -- 172.21.15.112:0/3501301897 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed64011c20 con 0x7fed74162100 2024-09-12T02:42:04.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.445+0000 7f208cc00640 1 -- 172.21.15.112:0/3589904959 <== osd.0 v2:172.21.15.112:6800/821571304 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f207c016ec0 con 0x7f2070074180 2024-09-12T02:42:04.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.445+0000 7f743aa00640 1 --2- 172.21.15.112:0/4227358281 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f742406bf00 0x7f742406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.446+0000 7f743aa00640 1 -- 172.21.15.112:0/4227358281 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7444106a20 con 0x7f743c0e7120 2024-09-12T02:42:04.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.446+0000 7f743aa00640 1 --2- 172.21.15.112:0/4227358281 >> [v2:172.21.15.112:6808/2642068641,v1:172.21.15.112:6809/2642068641] conn(0x7f74240740a0 0x7f74240764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.446+0000 7f743aa00640 1 -- 172.21.15.112:0/4227358281 --> [v2:172.21.15.112:6808/2642068641,v1:172.21.15.112:6809/2642068641] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7424076b70 con 0x7f74240740a0 2024-09-12T02:42:04.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.444+0000 7f23ccc00640 1 -- 172.21.15.112:0/584182847 >> 172.21.15.112:0/584182847 conn(0x7f23c80d4db0 msgr2=0x7f23c80d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:04.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.445+0000 7fb89d400640 1 --2- 172.21.15.112:0/1951324284 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb88006be30 0x7fb88006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.446+0000 7fed7c800640 1 -- 172.21.15.112:0/3501301897 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed740ca4d0 con 0x7fed74162100 2024-09-12T02:42:04.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.446+0000 7fb89d400640 1 --2- 172.21.15.112:0/1951324284 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb88006be30 0x7fb88006e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb890035000 tx=0x7fb89002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.446+0000 7efd08e00640 1 -- 172.21.15.112:0/1096545894 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efcfc0e2b20 msgr2=0x7efcfc0e1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.446+0000 7efd08e00640 1 --2- 172.21.15.112:0/1096545894 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efcfc0e2b20 0x7efcfc0e1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.446+0000 7efd08e00640 1 -- 172.21.15.112:0/1096545894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcfc0075b0 msgr2=0x7efcfc022080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.446+0000 7fed7c800640 1 -- 172.21.15.112:0/3501301897 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed740caa90 con 0x7fed74162100 2024-09-12T02:42:04.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.446+0000 7f23ccc00640 1 -- 172.21.15.112:0/584182847 shutdown_connections 2024-09-12T02:42:04.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.446+0000 7f23ccc00640 1 -- 172.21.15.112:0/584182847 wait complete. 2024-09-12T02:42:04.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.447+0000 7f7442000640 1 --2- 172.21.15.112:0/4227358281 >> [v2:172.21.15.112:6808/2642068641,v1:172.21.15.112:6809/2642068641] conn(0x7f74240740a0 0x7f74240764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.446+0000 7efd08e00640 1 --2- 172.21.15.112:0/1096545894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcfc0075b0 0x7efcfc022080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.447+0000 7efd08e00640 1 -- 172.21.15.112:0/1096545894 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcfc04f050 con 0x7efcfc009fe0 2024-09-12T02:42:04.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.447+0000 7efd09800640 1 --2- 172.21.15.112:0/1096545894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcfc0075b0 0x7efcfc022080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:04.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.447+0000 7f7442a00640 1 --2- 172.21.15.112:0/4227358281 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f742406bf00 0x7f742406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.448+0000 7fed7c800640 1 -- 172.21.15.112:0/3501301897 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fed74074010 con 0x7fed74162100 2024-09-12T02:42:04.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.447+0000 7fb89e800640 1 --2- 172.21.15.112:0/1951324284 >> [v2:172.21.15.112:6816/3365688807,v1:172.21.15.112:6817/3365688807] conn(0x7fb880073fd0 0x7fb8800763f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.448+0000 7f54ba800640 1 Processor -- start 2024-09-12T02:42:04.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.448+0000 7f743aa00640 1 -- 172.21.15.112:0/4227358281 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f74440d0fe0 con 0x7f743c0e7120 2024-09-12T02:42:04.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.448+0000 7f54ba800640 1 -- start start 2024-09-12T02:42:04.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.448+0000 7f7442000640 1 --2- 172.21.15.112:0/4227358281 >> [v2:172.21.15.112:6808/2642068641,v1:172.21.15.112:6809/2642068641] conn(0x7f74240740a0 0x7f74240764c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.448+0000 7efd08e00640 1 --2- 172.21.15.112:0/1096545894 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcfc009fe0 0x7efcfc04e1d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efcf0031000 tx=0x7efcf00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.449+0000 7fb896000640 1 -- 172.21.15.112:0/1951324284 <== osd.2 v2:172.21.15.112:6816/3365688807 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7fb880076aa0 con 0x7fb880073fd0 2024-09-12T02:42:04.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.449+0000 7efd01600640 1 -- 172.21.15.112:0/1096545894 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf0037040 con 0x7efcfc009fe0 2024-09-12T02:42:04.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.449+0000 7f23ccc00640 1 Processor -- start 2024-09-12T02:42:04.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.450+0000 7f743aa00640 1 -- 172.21.15.112:0/4227358281 <== osd.1 v2:172.21.15.112:6808/2642068641 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f7424076b70 con 0x7f74240740a0 2024-09-12T02:42:04.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.449+0000 7efd0ac00640 1 -- 172.21.15.112:0/1096545894 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcfc04f330 con 0x7efcfc009fe0 2024-09-12T02:42:04.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.449+0000 7efd0ac00640 1 -- 172.21.15.112:0/1096545894 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcfc04f8f0 con 0x7efcfc009fe0 2024-09-12T02:42:04.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.450+0000 7efd01600640 1 -- 172.21.15.112:0/1096545894 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf0003c40 con 0x7efcfc009fe0 2024-09-12T02:42:04.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.450+0000 7efd01600640 1 -- 172.21.15.112:0/1096545894 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf0032440 con 0x7efcfc009fe0 2024-09-12T02:42:04.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.450+0000 7f23ccc00640 1 -- start start 2024-09-12T02:42:04.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.450+0000 7f068f800640 1 Processor -- start 2024-09-12T02:42:04.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.450+0000 7efd0ac00640 1 -- 172.21.15.112:0/1096545894 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efcfc04ee00 con 0x7efcfc009fe0 2024-09-12T02:42:04.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.450+0000 7f54ba800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54b40b8410 0x7f54b41559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.450+0000 7f54ba800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54b40d1520 0x7f54b4158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.450+0000 7f54ba800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54b41625b0 0x7f54b40b93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.450+0000 7f54ba800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f54b40b7ef0 con 0x7f54b40b8410 2024-09-12T02:42:04.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.450+0000 7f54ba800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f54b40d08a0 con 0x7f54b40d1520 2024-09-12T02:42:04.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.450+0000 7f54ba800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f54b40d0b80 con 0x7f54b41625b0 2024-09-12T02:42:04.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.450+0000 7f54b3e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54b41625b0 0x7f54b40b93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.450+0000 7f54b3e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54b41625b0 0x7f54b40b93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:47716/0 (socket says 172.21.15.112:47716) 2024-09-12T02:42:04.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.450+0000 7f54b3e00640 1 -- 172.21.15.112:0/3658162082 learned_addr learned my addr 172.21.15.112:0/3658162082 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:04.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.450+0000 7f068f800640 1 -- start start 2024-09-12T02:42:04.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.451+0000 7fed6e000640 1 -- 172.21.15.112:0/3501301897 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fed64018020 con 0x7fed74162100 2024-09-12T02:42:04.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.451+0000 7f7442a00640 1 --2- 172.21.15.112:0/4227358281 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f742406bf00 0x7f742406e3c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7434009bc0 tx=0x7f7434008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.453+0000 7efd01600640 1 -- 172.21.15.112:0/1096545894 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efcf0050430 con 0x7efcfc009fe0 2024-09-12T02:42:04.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.451+0000 7f54b2a00640 1 --2- 172.21.15.112:0/3658162082 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54b40d1520 0x7f54b4158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.451+0000 7f54b3400640 1 --2- 172.21.15.112:0/3658162082 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54b40b8410 0x7f54b41559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.451+0000 7f54b3e00640 1 -- 172.21.15.112:0/3658162082 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54b40d1520 msgr2=0x7f54b4158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.451+0000 7f54b3e00640 1 --2- 172.21.15.112:0/3658162082 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54b40d1520 0x7f54b4158ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.451+0000 7f54b3e00640 1 -- 172.21.15.112:0/3658162082 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54b40b8410 msgr2=0x7f54b41559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.451+0000 7f54b3e00640 1 --2- 172.21.15.112:0/3658162082 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54b40b8410 0x7f54b41559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.451+0000 7f54b3e00640 1 -- 172.21.15.112:0/3658162082 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54b41565b0 con 0x7f54b41625b0 2024-09-12T02:42:04.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.452+0000 7f54b3e00640 1 --2- 172.21.15.112:0/3658162082 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54b41625b0 0x7f54b40b93f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f54a400efc0 tx=0x7f54a400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.453+0000 7f54ab400640 1 -- 172.21.15.112:0/3658162082 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a4018020 con 0x7f54b41625b0 2024-09-12T02:42:04.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.453+0000 7f54ab400640 1 -- 172.21.15.112:0/3658162082 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54a4014480 con 0x7f54b41625b0 2024-09-12T02:42:04.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.453+0000 7f54ab400640 1 -- 172.21.15.112:0/3658162082 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a4014870 con 0x7f54b41625b0 2024-09-12T02:42:04.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.453+0000 7f54ba800640 1 -- 172.21.15.112:0/3658162082 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54b4156890 con 0x7f54b41625b0 2024-09-12T02:42:04.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.453+0000 7f54ba800640 1 -- 172.21.15.112:0/3658162082 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f54b4156e50 con 0x7f54b41625b0 2024-09-12T02:42:04.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.452+0000 7fed6e000640 1 --2- 172.21.15.112:0/3501301897 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fed5806be30 0x7fed5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.452+0000 7fed6e000640 1 -- 172.21.15.112:0/3501301897 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fed6408af20 con 0x7fed74162100 2024-09-12T02:42:04.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.453+0000 7fed6e000640 1 --2- 172.21.15.112:0/3501301897 >> [v2:172.21.15.137:6808/3193706134,v1:172.21.15.137:6809/3193706134] conn(0x7fed580740b0 0x7fed580764d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.453+0000 7fed6e000640 1 -- 172.21.15.112:0/3501301897 --> [v2:172.21.15.137:6808/3193706134,v1:172.21.15.137:6809/3193706134] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fed6400af30 con 0x7fed580740b0 2024-09-12T02:42:04.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.453+0000 7fed6e000640 1 -- 172.21.15.112:0/3501301897 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fed6408b310 con 0x7fed74162100 2024-09-12T02:42:04.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.453+0000 7fed79e00640 1 --2- 172.21.15.112:0/3501301897 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fed5806be30 0x7fed5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.453+0000 7f23ccc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f23c80d0510 0x7f23c80c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.453+0000 7f23ccc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23c8162100 0x7f23c815c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.453+0000 7f23ccc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c81624e0 0x7f23c815c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.453+0000 7f23ccc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f23c80d0e60 con 0x7f23c81624e0 2024-09-12T02:42:04.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.453+0000 7f23ccc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f23c80cfff0 con 0x7f23c8162100 2024-09-12T02:42:04.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.453+0000 7f23ccc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f23c80d1df0 con 0x7f23c80d0510 2024-09-12T02:42:04.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.454+0000 7f23c6800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c81624e0 0x7f23c815c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.454+0000 7f23c6800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c81624e0 0x7f23c815c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57706/0 (socket says 172.21.15.112:57706) 2024-09-12T02:42:04.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.454+0000 7f23c6800640 1 -- 172.21.15.112:0/1694700159 learned_addr learned my addr 172.21.15.112:0/1694700159 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:04.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.454+0000 7f54ba800640 1 -- 172.21.15.112:0/3658162082 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f54b40d2210 con 0x7f54b41625b0 2024-09-12T02:42:04.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.454+0000 7efd01600640 1 --2- 172.21.15.112:0/1096545894 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efce406bf00 0x7efce406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.454+0000 7efd01600640 1 -- 172.21.15.112:0/1096545894 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efcf00ab8d0 con 0x7efcfc009fe0 2024-09-12T02:42:04.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.455+0000 7f23c6800640 1 -- 172.21.15.112:0/1694700159 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f23c80d0510 msgr2=0x7f23c80c88e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:42:04.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.455+0000 7f23c6800640 1 --2- 172.21.15.112:0/1694700159 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f23c80d0510 0x7f23c80c88e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.455+0000 7f23c6800640 1 -- 172.21.15.112:0/1694700159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23c8162100 msgr2=0x7f23c815c0e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:42:04.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.455+0000 7efd01600640 1 --2- 172.21.15.112:0/1096545894 >> [v2:172.21.15.112:6824/231774278,v1:172.21.15.112:6825/231774278] conn(0x7efce4074120 0x7efce4076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.455+0000 7efd01600640 1 -- 172.21.15.112:0/1096545894 --> [v2:172.21.15.112:6824/231774278,v1:172.21.15.112:6825/231774278] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efcf002be50 con 0x7efce4074120 2024-09-12T02:42:04.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.455+0000 7efd01600640 1 -- 172.21.15.112:0/1096545894 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7efcf00abcc0 con 0x7efcfc009fe0 2024-09-12T02:42:04.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.453+0000 7f068f800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f06880d3270 0x7f06880c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.455+0000 7f068ce00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f06880d3270 0x7f06880c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.455+0000 7fed7a800640 1 --2- 172.21.15.112:0/3501301897 >> [v2:172.21.15.137:6808/3193706134,v1:172.21.15.137:6809/3193706134] conn(0x7fed580740b0 0x7fed580764d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.455+0000 7f23c6800640 1 --2- 172.21.15.112:0/1694700159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23c8162100 0x7f23c815c0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.455+0000 7f23c6800640 1 -- 172.21.15.112:0/1694700159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c80c8e20 con 0x7f23c81624e0 2024-09-12T02:42:04.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.455+0000 7f068f800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f06880b5920 0x7f06880b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.456+0000 7f54ab400640 1 -- 172.21.15.112:0/3658162082 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f54a4005d10 con 0x7f54b41625b0 2024-09-12T02:42:04.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.456+0000 7f068f800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06880d3650 0x7f06880d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.456+0000 7f068f800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f06880d2cb0 con 0x7f06880b5920 2024-09-12T02:42:04.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.456+0000 7f068f800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f06880cfd10 con 0x7f06880d3270 2024-09-12T02:42:04.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.456+0000 7f068f800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f06880d3f60 con 0x7f06880d3650 2024-09-12T02:42:04.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.456+0000 7f068ce00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f06880d3270 0x7f06880c7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:47738/0 (socket says 172.21.15.112:47738) 2024-09-12T02:42:04.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.456+0000 7f068ce00640 1 -- 172.21.15.112:0/1527099721 learned_addr learned my addr 172.21.15.112:0/1527099721 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:04.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.456+0000 7f068ce00640 1 -- 172.21.15.112:0/1527099721 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06880d3650 msgr2=0x7f06880d01a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:42:04.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.456+0000 7f068ce00640 1 --2- 172.21.15.112:0/1527099721 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06880d3650 0x7f06880d01a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.456+0000 7f068ce00640 1 -- 172.21.15.112:0/1527099721 >> v2:172.21.15.112:3300/0 conn(0x7f06880b5920 msgr2=0x7f06880b7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:04.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.456+0000 7f068ce00640 1 --2- 172.21.15.112:0/1527099721 >> v2:172.21.15.112:3300/0 conn(0x7f06880b5920 0x7f06880b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.456+0000 7f068ce00640 1 -- 172.21.15.112:0/1527099721 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06880c8710 con 0x7f06880d3270 2024-09-12T02:42:04.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.457+0000 7fed79e00640 1 --2- 172.21.15.112:0/3501301897 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fed5806be30 0x7fed5806e2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fed68006fd0 tx=0x7fed68009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.457+0000 7f54ab400640 1 --2- 172.21.15.112:0/3658162082 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f549006be80 0x7f549006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.457+0000 7f54ab400640 1 -- 172.21.15.112:0/3658162082 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f54a408b740 con 0x7f54b41625b0 2024-09-12T02:42:04.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.455+0000 7efd0a200640 1 --2- 172.21.15.112:0/1096545894 >> [v2:172.21.15.112:6824/231774278,v1:172.21.15.112:6825/231774278] conn(0x7efce4074120 0x7efce4076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.456+0000 7efd09800640 1 --2- 172.21.15.112:0/1096545894 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efce406bf00 0x7efce406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.456+0000 7efd0a200640 1 --2- 172.21.15.112:0/1096545894 >> [v2:172.21.15.112:6824/231774278,v1:172.21.15.112:6825/231774278] conn(0x7efce4074120 0x7efce4076540 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.457+0000 7efd09800640 1 --2- 172.21.15.112:0/1096545894 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efce406bf00 0x7efce406e3c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efcf8001ac0 tx=0x7efcf8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.458+0000 7f54ab400640 1 --2- 172.21.15.112:0/3658162082 >> [v2:172.21.15.137:6800/3671178153,v1:172.21.15.137:6801/3671178153] conn(0x7f5490074020 0x7f5490076440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.458+0000 7f54ab400640 1 -- 172.21.15.112:0/3658162082 --> [v2:172.21.15.137:6800/3671178153,v1:172.21.15.137:6801/3671178153] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f54a400fe50 con 0x7f5490074020 2024-09-12T02:42:04.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.458+0000 7f54ab400640 1 -- 172.21.15.112:0/3658162082 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f54a4055d70 con 0x7f54b41625b0 2024-09-12T02:42:04.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.458+0000 7efd01600640 1 -- 172.21.15.112:0/1096545894 <== osd.3 v2:172.21.15.112:6824/231774278 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7efcf002be50 con 0x7efce4074120 2024-09-12T02:42:04.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.458+0000 7f23c6800640 1 --2- 172.21.15.112:0/1694700159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c81624e0 0x7f23c815c620 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009d30 tx=0x7f23c000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.458+0000 7fed7a800640 1 --2- 172.21.15.112:0/3501301897 >> [v2:172.21.15.137:6808/3193706134,v1:172.21.15.137:6809/3193706134] conn(0x7fed580740b0 0x7fed580764d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.458+0000 7f068ce00640 1 --2- 172.21.15.112:0/1527099721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06880d3270 0x7f06880c7af0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f068808d900 tx=0x7f067c02a160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43dbb1cc097e152c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.458+0000 7f54b2a00640 1 --2- 172.21.15.112:0/3658162082 >> [v2:172.21.15.137:6800/3671178153,v1:172.21.15.137:6801/3671178153] conn(0x7f5490074020 0x7f5490076440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.458+0000 7f23be000640 1 -- 172.21.15.112:0/1694700159 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c0018020 con 0x7f23c81624e0 2024-09-12T02:42:04.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.459+0000 7f23be000640 1 -- 172.21.15.112:0/1694700159 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23c0014480 con 0x7f23c81624e0 2024-09-12T02:42:04.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.459+0000 7f23be000640 1 -- 172.21.15.112:0/1694700159 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c0014870 con 0x7f23c81624e0 2024-09-12T02:42:04.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.459+0000 7f23ccc00640 1 -- 172.21.15.112:0/1694700159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23c80b9870 con 0x7f23c81624e0 2024-09-12T02:42:04.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.459+0000 7f0687400640 1 -- 172.21.15.112:0/1527099721 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067c037070 con 0x7f06880d3270 2024-09-12T02:42:04.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.459+0000 7f0687400640 1 -- 172.21.15.112:0/1527099721 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f067c032440 con 0x7f06880d3270 2024-09-12T02:42:04.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.459+0000 7f0687400640 1 -- 172.21.15.112:0/1527099721 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067c032810 con 0x7f06880d3270 2024-09-12T02:42:04.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.460+0000 7fed6e000640 1 -- 172.21.15.112:0/3501301897 <== osd.5 v2:172.21.15.137:6808/3193706134 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7fed6400af30 con 0x7fed580740b0 2024-09-12T02:42:04.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.459+0000 7f23ccc00640 1 -- 172.21.15.112:0/1694700159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23c80b9e30 con 0x7f23c81624e0 2024-09-12T02:42:04.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.460+0000 7f068f800640 1 -- 172.21.15.112:0/1527099721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06880d3270 msgr2=0x7f06880c7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.460+0000 7f068f800640 1 --2- 172.21.15.112:0/1527099721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06880d3270 0x7f06880c7af0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f068808d900 tx=0x7f067c02a160 comp rx=0 tx=0).stop 2024-09-12T02:42:04.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.460+0000 7f068f800640 1 -- 172.21.15.112:0/1527099721 shutdown_connections 2024-09-12T02:42:04.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.460+0000 7f068f800640 1 --2- 172.21.15.112:0/1527099721 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06880d3650 0x7f06880d01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.460+0000 7f068f800640 1 --2- 172.21.15.112:0/1527099721 >> v2:172.21.15.112:3300/0 conn(0x7f06880b5920 0x7f06880b7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.460+0000 7f068f800640 1 --2- 172.21.15.112:0/1527099721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06880d3270 0x7f06880c7af0 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f068808d900 tx=0x7f067c02a160 comp rx=0 tx=0).stop 2024-09-12T02:42:04.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.460+0000 7f068f800640 1 -- 172.21.15.112:0/1527099721 >> 172.21.15.112:0/1527099721 conn(0x7f06880d4db0 msgr2=0x7f06880d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:04.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.460+0000 7f23ccc00640 1 -- 172.21.15.112:0/1694700159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f23c82017d0 con 0x7f23c81624e0 2024-09-12T02:42:04.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.460+0000 7f068f800640 1 -- 172.21.15.112:0/1527099721 shutdown_connections 2024-09-12T02:42:04.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.461+0000 7f068f800640 1 -- 172.21.15.112:0/1527099721 wait complete. 2024-09-12T02:42:04.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.461+0000 7f54b3400640 1 --2- 172.21.15.112:0/3658162082 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f549006be80 0x7f549006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.462+0000 7f54b3400640 1 --2- 172.21.15.112:0/3658162082 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f549006be80 0x7f549006e340 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f54b40b5c90 tx=0x7f54ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.462+0000 7f54b2a00640 1 --2- 172.21.15.112:0/3658162082 >> [v2:172.21.15.137:6800/3671178153,v1:172.21.15.137:6801/3671178153] conn(0x7f5490074020 0x7f5490076440 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.463+0000 7f54ab400640 1 -- 172.21.15.112:0/3658162082 <== osd.4 v2:172.21.15.137:6800/3671178153 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f54a400fe50 con 0x7f5490074020 2024-09-12T02:42:04.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.463+0000 7f068f800640 1 Processor -- start 2024-09-12T02:42:04.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.463+0000 7f23be000640 1 -- 172.21.15.112:0/1694700159 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f23c001b020 con 0x7f23c81624e0 2024-09-12T02:42:04.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.464+0000 7f068f800640 1 -- start start 2024-09-12T02:42:04.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.465+0000 7f068f800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06880b5920 0x7f06880b2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.465+0000 7f068f800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06880d3650 0x7f06881de0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.465+0000 7f068f800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06880cb760 0x7f06880cc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.465+0000 7f068f800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f06880d3ae0 con 0x7f06880d3650 2024-09-12T02:42:04.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.465+0000 7f068f800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f06880c8430 con 0x7f06880b5920 2024-09-12T02:42:04.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.465+0000 7f068f800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f06880d06e0 con 0x7f06880cb760 2024-09-12T02:42:04.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.466+0000 7f068ce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06880b5920 0x7f06880b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.467+0000 7f0687e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06880d3650 0x7f06881de0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.467+0000 7f068d800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06880cb760 0x7f06880cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.467+0000 7f0687e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06880d3650 0x7f06881de0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57720/0 (socket says 172.21.15.112:57720) 2024-09-12T02:42:04.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.467+0000 7f0687e00640 1 -- 172.21.15.112:0/606432218 learned_addr learned my addr 172.21.15.112:0/606432218 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:04.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.465+0000 7f23be000640 1 --2- 172.21.15.112:0/1694700159 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f23a806be80 0x7f23a806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.465+0000 7f23be000640 1 -- 172.21.15.112:0/1694700159 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f23c008ae90 con 0x7f23c81624e0 2024-09-12T02:42:04.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.465+0000 7f23be000640 1 --2- 172.21.15.112:0/1694700159 >> [v2:172.21.15.137:6813/3738813293,v1:172.21.15.137:6814/3738813293] conn(0x7f23a80740a0 0x7f23a80764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.465+0000 7f23be000640 1 -- 172.21.15.112:0/1694700159 --> [v2:172.21.15.137:6813/3738813293,v1:172.21.15.137:6814/3738813293] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f23a8076b70 con 0x7f23a80740a0 2024-09-12T02:42:04.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.465+0000 7f23be000640 1 -- 172.21.15.112:0/1694700159 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f23c0090060 con 0x7f23c81624e0 2024-09-12T02:42:04.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.468+0000 7f0687e00640 1 -- 172.21.15.112:0/606432218 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06880cb760 msgr2=0x7f06880cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.466+0000 7f23c5e00640 1 --2- 172.21.15.112:0/1694700159 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f23a806be80 0x7f23a806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.467+0000 7f23c5400640 1 --2- 172.21.15.112:0/1694700159 >> [v2:172.21.15.137:6813/3738813293,v1:172.21.15.137:6814/3738813293] conn(0x7f23a80740a0 0x7f23a80764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.468+0000 7f0687e00640 1 --2- 172.21.15.112:0/606432218 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06880cb760 0x7f06880cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.468+0000 7f0687e00640 1 -- 172.21.15.112:0/606432218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06880b5920 msgr2=0x7f06880b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.468+0000 7f0687e00640 1 --2- 172.21.15.112:0/606432218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06880b5920 0x7f06880b2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.468+0000 7f0687e00640 1 -- 172.21.15.112:0/606432218 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06880cd270 con 0x7f06880d3650 2024-09-12T02:42:04.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.468+0000 7f068ce00640 1 --2- 172.21.15.112:0/606432218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06880b5920 0x7f06880b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:04.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.468+0000 7f068d800640 1 --2- 172.21.15.112:0/606432218 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06880cb760 0x7f06880cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:04.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.468+0000 7f23c5e00640 1 --2- 172.21.15.112:0/1694700159 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f23a806be80 0x7f23a806e340 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f23b8000f60 tx=0x7f23b80079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.469+0000 7f0687e00640 1 --2- 172.21.15.112:0/606432218 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06880d3650 0x7f06881de0a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f067400b4a0 tx=0x7f067400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.469+0000 7f0684c00640 1 -- 172.21.15.112:0/606432218 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0674014070 con 0x7f06880d3650 2024-09-12T02:42:04.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.469+0000 7f23c5400640 1 --2- 172.21.15.112:0/1694700159 >> [v2:172.21.15.137:6813/3738813293,v1:172.21.15.137:6814/3738813293] conn(0x7f23a80740a0 0x7f23a80764c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.469+0000 7f0684c00640 1 -- 172.21.15.112:0/606432218 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0674010610 con 0x7f06880d3650 2024-09-12T02:42:04.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.469+0000 7f0684c00640 1 -- 172.21.15.112:0/606432218 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0674010a00 con 0x7f06880d3650 2024-09-12T02:42:04.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.469+0000 7f068f800640 1 -- 172.21.15.112:0/606432218 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06880cd550 con 0x7f06880d3650 2024-09-12T02:42:04.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.470+0000 7f23be000640 1 -- 172.21.15.112:0/1694700159 <== osd.6 v2:172.21.15.137:6813/3738813293 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f23a8076b70 con 0x7f23a80740a0 2024-09-12T02:42:04.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.469+0000 7f2097600640 1 -- 172.21.15.112:0/3589904959 --> [v2:172.21.15.112:6800/821571304,v1:172.21.15.112:6801/821571304] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f20900b5100 con 0x7f2070074180 2024-09-12T02:42:04.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.469+0000 7f208cc00640 1 -- 172.21.15.112:0/3589904959 <== osd.0 v2:172.21.15.112:6800/821571304 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f20900b5100 con 0x7f2070074180 2024-09-12T02:42:04.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.470+0000 7f2097600640 1 -- 172.21.15.112:0/3589904959 >> [v2:172.21.15.112:6800/821571304,v1:172.21.15.112:6801/821571304] conn(0x7f2070074180 msgr2=0x7f20700765a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.470+0000 7f2097600640 1 --2- 172.21.15.112:0/3589904959 >> [v2:172.21.15.112:6800/821571304,v1:172.21.15.112:6801/821571304] conn(0x7f2070074180 0x7f20700765a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.472+0000 7f2097600640 1 -- 172.21.15.112:0/3589904959 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f207006bf00 msgr2=0x7f207006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.472+0000 7f2097600640 1 --2- 172.21.15.112:0/3589904959 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f207006bf00 0x7f207006e3c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f20900c8b50 tx=0x7f2088001680 comp rx=0 tx=0).stop 2024-09-12T02:42:04.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.472+0000 7f2097600640 1 -- 172.21.15.112:0/3589904959 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f20900d0510 msgr2=0x7f20900b6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.472+0000 7f2097600640 1 --2- 172.21.15.112:0/3589904959 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f20900d0510 0x7f20900b6680 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f207c00e870 tx=0x7f207c00ed30 comp rx=0 tx=0).stop 2024-09-12T02:42:04.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.473+0000 7f068f800640 1 -- 172.21.15.112:0/606432218 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06880c8c60 con 0x7f06880d3650 2024-09-12T02:42:04.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.475+0000 7f2095600640 1 -- 172.21.15.112:0/3589904959 reap_dead start 2024-09-12T02:42:04.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.475+0000 7f2097600640 1 -- 172.21.15.112:0/3589904959 shutdown_connections 2024-09-12T02:42:04.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.475+0000 7f2097600640 1 -- 172.21.15.112:0/3589904959 >> 172.21.15.112:0/3589904959 conn(0x7f20900d4db0 msgr2=0x7f20900d5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:04.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.475+0000 7f2097600640 1 -- 172.21.15.112:0/3589904959 shutdown_connections 2024-09-12T02:42:04.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.475+0000 7f2097600640 1 -- 172.21.15.112:0/3589904959 wait complete. 2024-09-12T02:42:04.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.475+0000 7f068f800640 1 -- 172.21.15.112:0/606432218 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f06880c7af0 con 0x7f06880d3650 2024-09-12T02:42:04.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.475+0000 7f0684c00640 1 -- 172.21.15.112:0/606432218 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0674017070 con 0x7f06880d3650 2024-09-12T02:42:04.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.477+0000 7f0684c00640 1 --2- 172.21.15.112:0/606432218 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f066806be30 0x7f066806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.477+0000 7f0684c00640 1 -- 172.21.15.112:0/606432218 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f067408e170 con 0x7f06880d3650 2024-09-12T02:42:04.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.477+0000 7f0684c00640 1 --2- 172.21.15.112:0/606432218 >> [v2:172.21.15.137:6824/1421932609,v1:172.21.15.137:6825/1421932609] conn(0x7f06680740b0 0x7f06680764d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:04.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.477+0000 7f0684c00640 1 -- 172.21.15.112:0/606432218 --> [v2:172.21.15.137:6824/1421932609,v1:172.21.15.137:6825/1421932609] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0668076b80 con 0x7f06680740b0 2024-09-12T02:42:04.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.477+0000 7f0684c00640 1 -- 172.21.15.112:0/606432218 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f067408f060 con 0x7f06880d3650 2024-09-12T02:42:04.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.478+0000 7fb8a5200640 1 -- 172.21.15.112:0/1951324284 --> [v2:172.21.15.112:6816/3365688807,v1:172.21.15.112:6817/3365688807] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb8a00d17b0 con 0x7fb880073fd0 2024-09-12T02:42:04.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.478+0000 7efd0ac00640 1 -- 172.21.15.112:0/1096545894 --> [v2:172.21.15.112:6824/231774278,v1:172.21.15.112:6825/231774278] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efcfc055520 con 0x7efce4074120 2024-09-12T02:42:04.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.478+0000 7f068ce00640 1 --2- 172.21.15.112:0/606432218 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f066806be30 0x7f066806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.478+0000 7f068d800640 1 --2- 172.21.15.112:0/606432218 >> [v2:172.21.15.137:6824/1421932609,v1:172.21.15.137:6825/1421932609] conn(0x7f06680740b0 0x7f06680764d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:04.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.479+0000 7fb896000640 1 -- 172.21.15.112:0/1951324284 <== osd.2 v2:172.21.15.112:6816/3365688807 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb8a00d17b0 con 0x7fb880073fd0 2024-09-12T02:42:04.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.479+0000 7f068d800640 1 --2- 172.21.15.112:0/606432218 >> [v2:172.21.15.137:6824/1421932609,v1:172.21.15.137:6825/1421932609] conn(0x7f06680740b0 0x7f06680764d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.480+0000 7fb88b400640 1 -- 172.21.15.112:0/1951324284 >> [v2:172.21.15.112:6816/3365688807,v1:172.21.15.112:6817/3365688807] conn(0x7fb880073fd0 msgr2=0x7fb8800763f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.480+0000 7fb88b400640 1 --2- 172.21.15.112:0/1951324284 >> [v2:172.21.15.112:6816/3365688807,v1:172.21.15.112:6817/3365688807] conn(0x7fb880073fd0 0x7fb8800763f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.480+0000 7f068ce00640 1 --2- 172.21.15.112:0/606432218 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f066806be30 0x7f066806e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f067c034000 tx=0x7f067c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:04.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.480+0000 7fb88b400640 1 -- 172.21.15.112:0/1951324284 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb88006be30 msgr2=0x7fb88006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.480+0000 7fb88b400640 1 --2- 172.21.15.112:0/1951324284 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb88006be30 0x7fb88006e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb890035000 tx=0x7fb89002e000 comp rx=0 tx=0).stop 2024-09-12T02:42:04.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.480+0000 7fb88b400640 1 -- 172.21.15.112:0/1951324284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8a00d1f10 msgr2=0x7fb8a015b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.480+0000 7fb88b400640 1 --2- 172.21.15.112:0/1951324284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8a00d1f10 0x7fb8a015b040 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb898007bd0 tx=0x7fb89800d4a0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.480+0000 7efd01600640 1 -- 172.21.15.112:0/1096545894 <== osd.3 v2:172.21.15.112:6824/231774278 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efcfc055520 con 0x7efce4074120 2024-09-12T02:42:04.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.480+0000 7f0684c00640 1 -- 172.21.15.112:0/606432218 <== osd.7 v2:172.21.15.137:6824/1421932609 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f0668076b80 con 0x7f06680740b0 2024-09-12T02:42:04.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.481+0000 7efd0ac00640 1 -- 172.21.15.112:0/1096545894 >> [v2:172.21.15.112:6824/231774278,v1:172.21.15.112:6825/231774278] conn(0x7efce4074120 msgr2=0x7efce4076540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.481+0000 7fb89e800640 1 -- 172.21.15.112:0/1951324284 reap_dead start 2024-09-12T02:42:04.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.481+0000 7efd0ac00640 1 --2- 172.21.15.112:0/1096545894 >> [v2:172.21.15.112:6824/231774278,v1:172.21.15.112:6825/231774278] conn(0x7efce4074120 0x7efce4076540 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.482+0000 7efd0ac00640 1 -- 172.21.15.112:0/1096545894 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efce406bf00 msgr2=0x7efce406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.482+0000 7efd0ac00640 1 --2- 172.21.15.112:0/1096545894 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efce406bf00 0x7efce406e3c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efcf8001ac0 tx=0x7efcf8009040 comp rx=0 tx=0).stop 2024-09-12T02:42:04.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.482+0000 7efd0ac00640 1 -- 172.21.15.112:0/1096545894 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcfc009fe0 msgr2=0x7efcfc04e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.482+0000 7efd0ac00640 1 --2- 172.21.15.112:0/1096545894 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcfc009fe0 0x7efcfc04e1d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efcf0031000 tx=0x7efcf00046c0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.482+0000 7efd0a200640 1 -- 172.21.15.112:0/1096545894 reap_dead start 2024-09-12T02:42:04.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.482+0000 7fb88b400640 1 -- 172.21.15.112:0/1951324284 shutdown_connections 2024-09-12T02:42:04.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.482+0000 7fb88b400640 1 -- 172.21.15.112:0/1951324284 >> 172.21.15.112:0/1951324284 conn(0x7fb8a006cce0 msgr2=0x7fb8a006d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:04.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.483+0000 7efd0ac00640 1 -- 172.21.15.112:0/1096545894 shutdown_connections 2024-09-12T02:42:04.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.483+0000 7efd0ac00640 1 -- 172.21.15.112:0/1096545894 >> 172.21.15.112:0/1096545894 conn(0x7efcfc01dd80 msgr2=0x7efcfc0396a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:04.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.483+0000 7fb88b400640 1 -- 172.21.15.112:0/1951324284 shutdown_connections 2024-09-12T02:42:04.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.483+0000 7fb88b400640 1 -- 172.21.15.112:0/1951324284 wait complete. 2024-09-12T02:42:04.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.484+0000 7efd0ac00640 1 -- 172.21.15.112:0/1096545894 shutdown_connections 2024-09-12T02:42:04.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.484+0000 7efd0ac00640 1 -- 172.21.15.112:0/1096545894 wait complete. 2024-09-12T02:42:04.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.485+0000 7f742fe00640 1 -- 172.21.15.112:0/4227358281 --> [v2:172.21.15.112:6808/2642068641,v1:172.21.15.112:6809/2642068641] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7418002dd0 con 0x7f74240740a0 2024-09-12T02:42:04.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.485+0000 7f743aa00640 1 -- 172.21.15.112:0/4227358281 <== osd.1 v2:172.21.15.112:6808/2642068641 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7418002dd0 con 0x7f74240740a0 2024-09-12T02:42:04.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.487+0000 7f742fe00640 1 -- 172.21.15.112:0/4227358281 >> [v2:172.21.15.112:6808/2642068641,v1:172.21.15.112:6809/2642068641] conn(0x7f74240740a0 msgr2=0x7f74240764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.487+0000 7f742fe00640 1 --2- 172.21.15.112:0/4227358281 >> [v2:172.21.15.112:6808/2642068641,v1:172.21.15.112:6809/2642068641] conn(0x7f74240740a0 0x7f74240764c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.487+0000 7f742fe00640 1 -- 172.21.15.112:0/4227358281 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f742406bf00 msgr2=0x7f742406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.487+0000 7f742fe00640 1 --2- 172.21.15.112:0/4227358281 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f742406bf00 0x7f742406e3c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7434009bc0 tx=0x7f7434008040 comp rx=0 tx=0).stop 2024-09-12T02:42:04.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.487+0000 7f742fe00640 1 -- 172.21.15.112:0/4227358281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f743c0e7120 msgr2=0x7f743c04b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.488+0000 7f742fe00640 1 --2- 172.21.15.112:0/4227358281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f743c0e7120 0x7f743c04b7a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7444050d60 tx=0x7f74440698c0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.488+0000 7f7443400640 1 -- 172.21.15.112:0/4227358281 reap_dead start 2024-09-12T02:42:04.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.488+0000 7f742fe00640 1 -- 172.21.15.112:0/4227358281 shutdown_connections 2024-09-12T02:42:04.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.488+0000 7f742fe00640 1 -- 172.21.15.112:0/4227358281 >> 172.21.15.112:0/4227358281 conn(0x7f743c036090 msgr2=0x7f743c005e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:04.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.488+0000 7f742fe00640 1 -- 172.21.15.112:0/4227358281 shutdown_connections 2024-09-12T02:42:04.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.488+0000 7f742fe00640 1 -- 172.21.15.112:0/4227358281 wait complete. 2024-09-12T02:42:04.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.490+0000 7fed7c800640 1 -- 172.21.15.112:0/3501301897 --> [v2:172.21.15.137:6808/3193706134,v1:172.21.15.137:6809/3193706134] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fed740b2630 con 0x7fed580740b0 2024-09-12T02:42:04.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.491+0000 7f54ba800640 1 -- 172.21.15.112:0/3658162082 --> [v2:172.21.15.137:6800/3671178153,v1:172.21.15.137:6801/3671178153] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f54b40cf150 con 0x7f5490074020 2024-09-12T02:42:04.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.491+0000 7f54ab400640 1 -- 172.21.15.112:0/3658162082 <== osd.4 v2:172.21.15.137:6800/3671178153 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f54b40cf150 con 0x7f5490074020 2024-09-12T02:42:04.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.491+0000 7fed6e000640 1 -- 172.21.15.112:0/3501301897 <== osd.5 v2:172.21.15.137:6808/3193706134 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fed740b2630 con 0x7fed580740b0 2024-09-12T02:42:04.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.492+0000 7fed7c800640 1 -- 172.21.15.112:0/3501301897 >> [v2:172.21.15.137:6808/3193706134,v1:172.21.15.137:6809/3193706134] conn(0x7fed580740b0 msgr2=0x7fed580764d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.492+0000 7fed7c800640 1 --2- 172.21.15.112:0/3501301897 >> [v2:172.21.15.137:6808/3193706134,v1:172.21.15.137:6809/3193706134] conn(0x7fed580740b0 0x7fed580764d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.492+0000 7fed7c800640 1 -- 172.21.15.112:0/3501301897 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fed5806be30 msgr2=0x7fed5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.492+0000 7fed7c800640 1 --2- 172.21.15.112:0/3501301897 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fed5806be30 0x7fed5806e2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fed68006fd0 tx=0x7fed68009060 comp rx=0 tx=0).stop 2024-09-12T02:42:04.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.492+0000 7fed7c800640 1 -- 172.21.15.112:0/3501301897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed74162100 msgr2=0x7fed740c9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.492+0000 7fed7c800640 1 --2- 172.21.15.112:0/3501301897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed74162100 0x7fed740c9930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fed6400b410 tx=0x7fed6400b8d0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.492+0000 7f54a8c00640 1 -- 172.21.15.112:0/3658162082 >> [v2:172.21.15.137:6800/3671178153,v1:172.21.15.137:6801/3671178153] conn(0x7f5490074020 msgr2=0x7f5490076440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.492+0000 7f54a8c00640 1 --2- 172.21.15.112:0/3658162082 >> [v2:172.21.15.137:6800/3671178153,v1:172.21.15.137:6801/3671178153] conn(0x7f5490074020 0x7f5490076440 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.492+0000 7f54a8c00640 1 -- 172.21.15.112:0/3658162082 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f549006be80 msgr2=0x7f549006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.492+0000 7f54a8c00640 1 --2- 172.21.15.112:0/3658162082 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f549006be80 0x7f549006e340 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f54b40b5c90 tx=0x7f54ac009040 comp rx=0 tx=0).stop 2024-09-12T02:42:04.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.493+0000 7fed7a800640 1 -- 172.21.15.112:0/3501301897 reap_dead start 2024-09-12T02:42:04.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.493+0000 7fed7c800640 1 -- 172.21.15.112:0/3501301897 shutdown_connections 2024-09-12T02:42:04.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.492+0000 7f54a8c00640 1 -- 172.21.15.112:0/3658162082 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54b41625b0 msgr2=0x7f54b40b93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.492+0000 7f54a8c00640 1 --2- 172.21.15.112:0/3658162082 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54b41625b0 0x7f54b40b93f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f54a400efc0 tx=0x7f54a400c490 comp rx=0 tx=0).stop 2024-09-12T02:42:04.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.492+0000 7f54b3e00640 1 -- 172.21.15.112:0/3658162082 reap_dead start 2024-09-12T02:42:04.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.492+0000 7f54a8c00640 1 -- 172.21.15.112:0/3658162082 shutdown_connections 2024-09-12T02:42:04.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.492+0000 7f54a8c00640 1 -- 172.21.15.112:0/3658162082 >> 172.21.15.112:0/3658162082 conn(0x7f54b409e0d0 msgr2=0x7f54b415feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:04.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.493+0000 7f54a8c00640 1 -- 172.21.15.112:0/3658162082 shutdown_connections 2024-09-12T02:42:04.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.493+0000 7f54a8c00640 1 -- 172.21.15.112:0/3658162082 wait complete. 2024-09-12T02:42:04.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.493+0000 7fed7c800640 1 -- 172.21.15.112:0/3501301897 >> 172.21.15.112:0/3501301897 conn(0x7fed740d4db0 msgr2=0x7fed740d5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:04.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.493+0000 7fed7c800640 1 -- 172.21.15.112:0/3501301897 shutdown_connections 2024-09-12T02:42:04.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.494+0000 7fed7c800640 1 -- 172.21.15.112:0/3501301897 wait complete. 2024-09-12T02:42:04.705 INFO:teuthology.orchestra.run.smithi112.stdout:55834574854 2024-09-12T02:42:04.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.499+0000 7f23ccc00640 1 -- 172.21.15.112:0/1694700159 --> [v2:172.21.15.137:6813/3738813293,v1:172.21.15.137:6814/3738813293] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f23c8162b80 con 0x7f23a80740a0 2024-09-12T02:42:04.706 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T02:42:04.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.499+0000 7f23be000640 1 -- 172.21.15.112:0/1694700159 <== osd.6 v2:172.21.15.137:6813/3738813293 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f23c8162b80 con 0x7f23a80740a0 2024-09-12T02:42:04.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.500+0000 7f23ccc00640 1 -- 172.21.15.112:0/1694700159 >> [v2:172.21.15.137:6813/3738813293,v1:172.21.15.137:6814/3738813293] conn(0x7f23a80740a0 msgr2=0x7f23a80764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.500+0000 7f23ccc00640 1 --2- 172.21.15.112:0/1694700159 >> [v2:172.21.15.137:6813/3738813293,v1:172.21.15.137:6814/3738813293] conn(0x7f23a80740a0 0x7f23a80764c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.501+0000 7f23ccc00640 1 -- 172.21.15.112:0/1694700159 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f23a806be80 msgr2=0x7f23a806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.501+0000 7f23ccc00640 1 --2- 172.21.15.112:0/1694700159 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f23a806be80 0x7f23a806e340 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f23b8000f60 tx=0x7f23b80079c0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.501+0000 7f23ccc00640 1 -- 172.21.15.112:0/1694700159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c81624e0 msgr2=0x7f23c815c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.501+0000 7f23ccc00640 1 --2- 172.21.15.112:0/1694700159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c81624e0 0x7f23c815c620 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009d30 tx=0x7f23c000c490 comp rx=0 tx=0).stop 2024-09-12T02:42:04.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.501+0000 7f23c6800640 1 -- 172.21.15.112:0/1694700159 reap_dead start 2024-09-12T02:42:04.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.501+0000 7f23ccc00640 1 -- 172.21.15.112:0/1694700159 shutdown_connections 2024-09-12T02:42:04.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.501+0000 7f23ccc00640 1 -- 172.21.15.112:0/1694700159 >> 172.21.15.112:0/1694700159 conn(0x7f23c80d4db0 msgr2=0x7f23c80b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:04.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.501+0000 7f23ccc00640 1 -- 172.21.15.112:0/1694700159 shutdown_connections 2024-09-12T02:42:04.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.501+0000 7f23ccc00640 1 -- 172.21.15.112:0/1694700159 wait complete. 2024-09-12T02:42:04.709 INFO:teuthology.orchestra.run.smithi112.stdout:55834574854 2024-09-12T02:42:04.710 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T02:42:04.710 INFO:teuthology.orchestra.run.smithi112.stdout:55834574854 2024-09-12T02:42:04.711 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T02:42:04.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.513+0000 7f068f800640 1 -- 172.21.15.112:0/606432218 --> [v2:172.21.15.137:6824/1421932609,v1:172.21.15.137:6825/1421932609] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f068806d7f0 con 0x7f06680740b0 2024-09-12T02:42:04.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.514+0000 7f0684c00640 1 -- 172.21.15.112:0/606432218 <== osd.7 v2:172.21.15.137:6824/1421932609 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f068806d7f0 con 0x7f06680740b0 2024-09-12T02:42:04.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.514+0000 7f068f800640 1 -- 172.21.15.112:0/606432218 >> [v2:172.21.15.137:6824/1421932609,v1:172.21.15.137:6825/1421932609] conn(0x7f06680740b0 msgr2=0x7f06680764d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.514+0000 7f068f800640 1 --2- 172.21.15.112:0/606432218 >> [v2:172.21.15.137:6824/1421932609,v1:172.21.15.137:6825/1421932609] conn(0x7f06680740b0 0x7f06680764d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:04.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.514+0000 7f068f800640 1 -- 172.21.15.112:0/606432218 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f066806be30 msgr2=0x7f066806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.514+0000 7f068f800640 1 --2- 172.21.15.112:0/606432218 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f066806be30 0x7f066806e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f067c034000 tx=0x7f067c02e000 comp rx=0 tx=0).stop 2024-09-12T02:42:04.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.514+0000 7f068f800640 1 -- 172.21.15.112:0/606432218 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06880d3650 msgr2=0x7f06881de0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:04.714 INFO:teuthology.orchestra.run.smithi112.stdout:55834574854 2024-09-12T02:42:04.714 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T02:42:04.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.514+0000 7f068f800640 1 --2- 172.21.15.112:0/606432218 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06880d3650 0x7f06881de0a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f067400b4a0 tx=0x7f067400b960 comp rx=0 tx=0).stop 2024-09-12T02:42:04.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.514+0000 7f068d800640 1 -- 172.21.15.112:0/606432218 reap_dead start 2024-09-12T02:42:04.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.515+0000 7f068f800640 1 -- 172.21.15.112:0/606432218 shutdown_connections 2024-09-12T02:42:04.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.515+0000 7f068f800640 1 -- 172.21.15.112:0/606432218 >> 172.21.15.112:0/606432218 conn(0x7f06880d4db0 msgr2=0x7f068806dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:04.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.515+0000 7f068f800640 1 -- 172.21.15.112:0/606432218 shutdown_connections 2024-09-12T02:42:04.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:04.515+0000 7f068f800640 1 -- 172.21.15.112:0/606432218 wait complete. 2024-09-12T02:42:04.717 INFO:teuthology.orchestra.run.smithi112.stdout:55834574854 2024-09-12T02:42:04.717 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T02:42:04.718 INFO:teuthology.orchestra.run.smithi112.stdout:55834574854 2024-09-12T02:42:04.719 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T02:42:04.720 INFO:teuthology.orchestra.run.smithi112.stdout:55834574854 2024-09-12T02:42:04.721 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T02:42:04.722 INFO:teuthology.orchestra.run.smithi112.stdout:55834574854 2024-09-12T02:42:04.722 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T02:42:05.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.012+0000 7f3826800640 1 Processor -- start 2024-09-12T02:42:05.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.012+0000 7f3826800640 1 -- start start 2024-09-12T02:42:05.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.014+0000 7f3826800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38200d57a0 0x7f38200d0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.014+0000 7f3826800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f38200d1640 0x7f38200d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.014+0000 7f3826800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38200d3cd0 con 0x7f382015edb0 2024-09-12T02:42:05.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.014+0000 7f3826800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f38200d09d0 con 0x7f38200d1640 2024-09-12T02:42:05.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.014+0000 7f3826800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f38200d2890 con 0x7f38200d57a0 2024-09-12T02:42:05.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.015+0000 7f381ea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38200d57a0 0x7f38200d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.015+0000 7f381ea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38200d57a0 0x7f38200d0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:47756/0 (socket says 172.21.15.112:47756) 2024-09-12T02:42:05.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.015+0000 7f381ea00640 1 -- 172.21.15.112:0/4157206491 learned_addr learned my addr 172.21.15.112:0/4157206491 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:05.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.016+0000 7f381ea00640 1 -- 172.21.15.112:0/4157206491 >> v2:172.21.15.112:3300/0 conn(0x7f38200d1640 msgr2=0x7f38200d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:05.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.016+0000 7f381ea00640 1 --2- 172.21.15.112:0/4157206491 >> v2:172.21.15.112:3300/0 conn(0x7f38200d1640 0x7f38200d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.017+0000 7f381ea00640 1 -- 172.21.15.112:0/4157206491 >> v1:172.21.15.137:6789/0 conn(0x7f382015edb0 legacy=0x7f38200d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.017+0000 7f381ea00640 1 -- 172.21.15.112:0/4157206491 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38200d0c00 con 0x7f38200d57a0 2024-09-12T02:42:05.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.018+0000 7f381ea00640 1 --2- 172.21.15.112:0/4157206491 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38200d57a0 0x7f38200d0490 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3818009e80 tx=0x7f381802a760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c92a13c0ae510c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:05.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.019+0000 7f381e000640 1 -- 172.21.15.112:0/4157206491 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3818036070 con 0x7f38200d57a0 2024-09-12T02:42:05.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.019+0000 7f381e000640 1 -- 172.21.15.112:0/4157206491 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3818031600 con 0x7f38200d57a0 2024-09-12T02:42:05.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.019+0000 7f381e000640 1 -- 172.21.15.112:0/4157206491 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3818031a10 con 0x7f38200d57a0 2024-09-12T02:42:05.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.020+0000 7f3826800640 1 -- 172.21.15.112:0/4157206491 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38200d57a0 msgr2=0x7f38200d0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.020+0000 7f3826800640 1 --2- 172.21.15.112:0/4157206491 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38200d57a0 0x7f38200d0490 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3818009e80 tx=0x7f381802a760 comp rx=0 tx=0).stop 2024-09-12T02:42:05.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.022+0000 7fc99d600640 1 Processor -- start 2024-09-12T02:42:05.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.022+0000 7fc99d600640 1 -- start start 2024-09-12T02:42:05.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.023+0000 7f3826800640 1 -- 172.21.15.112:0/4157206491 shutdown_connections 2024-09-12T02:42:05.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.023+0000 7f3826800640 1 --2- 172.21.15.112:0/4157206491 >> v2:172.21.15.112:3300/0 conn(0x7f38200d1640 0x7f38200d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.023+0000 7f3826800640 1 --2- 172.21.15.112:0/4157206491 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38200d57a0 0x7f38200d0490 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.023+0000 7f3826800640 1 -- 172.21.15.112:0/4157206491 >> 172.21.15.112:0/4157206491 conn(0x7f382009df50 msgr2=0x7f38200d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:05.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.024+0000 7f3826800640 1 -- 172.21.15.112:0/4157206491 shutdown_connections 2024-09-12T02:42:05.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.024+0000 7fc99d600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc99806df00 0x7fc99806f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.024+0000 7fc99d600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9980b0360 con 0x7fc99816d710 2024-09-12T02:42:05.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.024+0000 7fc99d600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9980b52f0 con 0x7fc9980b38e0 2024-09-12T02:42:05.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.024+0000 7fc99d600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc9980b4800 con 0x7fc99806df00 2024-09-12T02:42:05.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.024+0000 7f3826800640 1 -- 172.21.15.112:0/4157206491 wait complete. 2024-09-12T02:42:05.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.027+0000 7fc996a00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc9980b38e0 0x7fc99806d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.112:40510/0 (socket says 172.21.15.112:40510) 2024-09-12T02:42:05.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.027+0000 7fc996a00640 1 -- 172.21.15.112:0/1834187135 learned_addr learned my addr 172.21.15.112:0/1834187135 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:05.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.027+0000 7fc995600640 1 -- 172.21.15.112:0/1834187135 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2199842530 0 0) 0x7fc9980b52f0 con 0x7fc9980b38e0 2024-09-12T02:42:05.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.027+0000 7fc995600640 1 -- 172.21.15.112:0/1834187135 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc97c003520 con 0x7fc9980b38e0 2024-09-12T02:42:05.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.028+0000 7f3826800640 1 Processor -- start 2024-09-12T02:42:05.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.028+0000 7fc996000640 1 --2- 172.21.15.112:0/1834187135 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc99806df00 0x7fc99806f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.028+0000 7fc995600640 1 -- 172.21.15.112:0/1834187135 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 716415717 0 0) 0x7fc9980b0360 con 0x7fc99816d710 2024-09-12T02:42:05.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.028+0000 7fc995600640 1 -- 172.21.15.112:0/1834187135 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc97c003880 con 0x7fc99816d710 2024-09-12T02:42:05.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.028+0000 7fc996000640 1 -- 172.21.15.112:0/1834187135 >> v1:172.21.15.137:6789/0 conn(0x7fc9980b38e0 legacy=0x7fc99806d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.028+0000 7fc996000640 1 -- 172.21.15.112:0/1834187135 >> v1:172.21.15.112:6789/0 conn(0x7fc99816d710 legacy=0x7fc99808c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.028+0000 7fc996000640 1 -- 172.21.15.112:0/1834187135 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9980b4a50 con 0x7fc99806df00 2024-09-12T02:42:05.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.028+0000 7fc995600640 1 -- 172.21.15.112:0/1834187135 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3903801753 0 0) 0x7fc97c003880 con 0x7fc99816d710 2024-09-12T02:42:05.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.028+0000 7f3826800640 1 -- start start 2024-09-12T02:42:05.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.031+0000 7fc996000640 1 --2- 172.21.15.112:0/1834187135 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc99806df00 0x7fc99806f920 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc984009750 tx=0x7fc98402a140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57e6581447a95430 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:05.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.031+0000 7fc995600640 1 -- 172.21.15.112:0/1834187135 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc984037070 con 0x7fc99806df00 2024-09-12T02:42:05.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.032+0000 7f3826800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38200d1640 0x7f38200b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.032+0000 7fc995600640 1 -- 172.21.15.112:0/1834187135 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc98402abd0 con 0x7fc99806df00 2024-09-12T02:42:05.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.032+0000 7fc995600640 1 -- 172.21.15.112:0/1834187135 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc988001970 con 0x7fc99806df00 2024-09-12T02:42:05.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.032+0000 7f3826800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38200d57a0 0x7f38201e9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.032+0000 7f3826800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f382015edb0 0x7f382015cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.032+0000 7f3826800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f38200d5be0 con 0x7f38200d1640 2024-09-12T02:42:05.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.032+0000 7f3826800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f38200d3130 con 0x7f38200d57a0 2024-09-12T02:42:05.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.032+0000 7f3826800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f38200d2dc0 con 0x7f382015edb0 2024-09-12T02:42:05.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.033+0000 7f381fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f382015edb0 0x7f382015cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.033+0000 7f381fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f382015edb0 0x7f382015cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:47768/0 (socket says 172.21.15.112:47768) 2024-09-12T02:42:05.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.033+0000 7f381fe00640 1 -- 172.21.15.112:0/39719693 learned_addr learned my addr 172.21.15.112:0/39719693 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:05.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.033+0000 7f381ea00640 1 --2- 172.21.15.112:0/39719693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38200d57a0 0x7f38201e9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.033+0000 7f381f400640 1 --2- 172.21.15.112:0/39719693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38200d1640 0x7f38200b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.034+0000 7fc99d600640 1 -- 172.21.15.112:0/1834187135 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc99806df00 msgr2=0x7fc99806f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.034+0000 7f381fe00640 1 -- 172.21.15.112:0/39719693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38200d57a0 msgr2=0x7f38201e9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.034+0000 7f381fe00640 1 --2- 172.21.15.112:0/39719693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38200d57a0 0x7f38201e9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.034+0000 7f381fe00640 1 -- 172.21.15.112:0/39719693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38200d1640 msgr2=0x7f38200b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.034+0000 7f381fe00640 1 --2- 172.21.15.112:0/39719693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38200d1640 0x7f38200b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.034+0000 7f381fe00640 1 -- 172.21.15.112:0/39719693 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38201e7900 con 0x7f382015edb0 2024-09-12T02:42:05.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.034+0000 7f381ea00640 1 --2- 172.21.15.112:0/39719693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38200d57a0 0x7f38201e9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:05.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.034+0000 7f381f400640 1 --2- 172.21.15.112:0/39719693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38200d1640 0x7f38200b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:05.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.035+0000 7f381fe00640 1 --2- 172.21.15.112:0/39719693 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f382015edb0 0x7f382015cfd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f380c009fd0 tx=0x7f380c00b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:05.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.034+0000 7fc99d600640 1 --2- 172.21.15.112:0/1834187135 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc99806df00 0x7fc99806f920 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc984009750 tx=0x7fc98402a140 comp rx=0 tx=0).stop 2024-09-12T02:42:05.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.034+0000 7fc99d600640 1 -- 172.21.15.112:0/1834187135 shutdown_connections 2024-09-12T02:42:05.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.034+0000 7fc99d600640 1 --2- 172.21.15.112:0/1834187135 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc99806df00 0x7fc99806f920 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc984009750 tx=0x7fc98402a140 comp rx=0 tx=0).stop 2024-09-12T02:42:05.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.034+0000 7fc99d600640 1 -- 172.21.15.112:0/1834187135 >> 172.21.15.112:0/1834187135 conn(0x7fc99806bbd0 msgr2=0x7fc99806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:05.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.035+0000 7fc99d600640 1 -- 172.21.15.112:0/1834187135 shutdown_connections 2024-09-12T02:42:05.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.035+0000 7fc99d600640 1 -- 172.21.15.112:0/1834187135 wait complete. 2024-09-12T02:42:05.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.036+0000 7f3813400640 1 -- 172.21.15.112:0/39719693 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380c011830 con 0x7f382015edb0 2024-09-12T02:42:05.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.036+0000 7f3813400640 1 -- 172.21.15.112:0/39719693 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f380c016070 con 0x7f382015edb0 2024-09-12T02:42:05.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.036+0000 7f3813400640 1 -- 172.21.15.112:0/39719693 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380c011bf0 con 0x7f382015edb0 2024-09-12T02:42:05.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.036+0000 7f3826800640 1 -- 172.21.15.112:0/39719693 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38201e7be0 con 0x7f382015edb0 2024-09-12T02:42:05.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.036+0000 7f3826800640 1 -- 172.21.15.112:0/39719693 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f38201e81a0 con 0x7f382015edb0 2024-09-12T02:42:05.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.036+0000 7ff70aa00640 1 Processor -- start 2024-09-12T02:42:05.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.037+0000 7ff70aa00640 1 -- start start 2024-09-12T02:42:05.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.037+0000 7fb5a7800640 1 Processor -- start 2024-09-12T02:42:05.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.037+0000 7fb5a7800640 1 -- start start 2024-09-12T02:42:05.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.038+0000 7fcce8200640 1 Processor -- start 2024-09-12T02:42:05.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.038+0000 7f3826800640 1 -- 172.21.15.112:0/39719693 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f382015f190 con 0x7f382015edb0 2024-09-12T02:42:05.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.038+0000 7fcce8200640 1 -- start start 2024-09-12T02:42:05.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.038+0000 7fc99d600640 1 Processor -- start 2024-09-12T02:42:05.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.038+0000 7fc99d600640 1 -- start start 2024-09-12T02:42:05.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.039+0000 7ff70aa00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff6fc0e28f0 0x7ff6fc053080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.039+0000 7ff70aa00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff6fc057830 0x7ff6fc0066b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.039+0000 7ff70aa00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6fc057d80 con 0x7ff6fc03bc60 2024-09-12T02:42:05.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.039+0000 7ff70aa00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff6fc058060 con 0x7ff6fc057830 2024-09-12T02:42:05.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.039+0000 7ff70aa00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff6fc005eb0 con 0x7ff6fc0e28f0 2024-09-12T02:42:05.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.039+0000 7ff709600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff6fc0e28f0 0x7ff6fc053080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.039+0000 7ff709600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff6fc0e28f0 0x7ff6fc053080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:47788/0 (socket says 172.21.15.112:47788) 2024-09-12T02:42:05.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.039+0000 7ff70a000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff6fc057830 0x7ff6fc0066b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.039+0000 7fc99d600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9980b38e0 0x7fc99814b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.039+0000 7fc99d600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc99816d710 0x7fc998163cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.040+0000 7fc99d600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc998164200 0x7fc9980ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.040+0000 7fc99d600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc99816c1e0 con 0x7fc998164200 2024-09-12T02:42:05.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.040+0000 7fc99d600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc9980b5010 con 0x7fc9980b38e0 2024-09-12T02:42:05.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.040+0000 7fc99d600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc9980afe70 con 0x7fc99816d710 2024-09-12T02:42:05.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.039+0000 7ff709600640 1 -- 172.21.15.112:0/3845293038 learned_addr learned my addr 172.21.15.112:0/3845293038 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:05.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.040+0000 7fc996a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9980b38e0 0x7fc99814b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.040+0000 7fcce8200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcce01624e0 0x7fcce00d58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.040+0000 7fcce8200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcce00d0510 0x7fcce00d0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.040+0000 7fcce8200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcce00cfa70 con 0x7fcce0162100 2024-09-12T02:42:05.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.040+0000 7fcce8200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fcce00b4e20 con 0x7fcce00d0510 2024-09-12T02:42:05.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.040+0000 7fcce8200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fcce00d21d0 con 0x7fcce01624e0 2024-09-12T02:42:05.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.040+0000 7fc996a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9980b38e0 0x7fc99814b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:47796/0 (socket says 172.21.15.112:47796) 2024-09-12T02:42:05.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.040+0000 7ff709600640 1 -- 172.21.15.112:0/3845293038 >> v2:172.21.15.112:3300/0 conn(0x7ff6fc057830 msgr2=0x7ff6fc0066b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:05.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.040+0000 7fc996a00640 1 -- 172.21.15.112:0/1709399915 learned_addr learned my addr 172.21.15.112:0/1709399915 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:05.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.040+0000 7f45c8800640 1 Processor -- start 2024-09-12T02:42:05.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.041+0000 7f3813400640 1 -- 172.21.15.112:0/39719693 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f380c038480 con 0x7f382015edb0 2024-09-12T02:42:05.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.040+0000 7fc997400640 1 --2- 172.21.15.112:0/1709399915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc998164200 0x7fc9980ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.040+0000 7fc996000640 1 --2- 172.21.15.112:0/1709399915 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc99816d710 0x7fc998163cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.041+0000 7f45c8800640 1 -- start start 2024-09-12T02:42:05.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.041+0000 7fcce6200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcce00d0510 0x7fcce00d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.041+0000 7fb5a7800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb5a015c9d0 0x7fb5a015e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.041+0000 7fcce6200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcce00d0510 0x7fcce00d0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:47804/0 (socket says 172.21.15.112:47804) 2024-09-12T02:42:05.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.041+0000 7fcce6200640 1 -- 172.21.15.112:0/4285955196 learned_addr learned my addr 172.21.15.112:0/4285955196 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:05.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.041+0000 7fcce4e00640 1 --2- 172.21.15.112:0/4285955196 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcce01624e0 0x7fcce00d58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.042+0000 7f3813400640 1 --2- 172.21.15.112:0/39719693 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f380006bf00 0x7f380006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.042+0000 7f3813400640 1 -- 172.21.15.112:0/39719693 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f380c08ace0 con 0x7f382015edb0 2024-09-12T02:42:05.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.041+0000 7fc996a00640 1 -- 172.21.15.112:0/1709399915 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc99816d710 msgr2=0x7fc998163cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.041+0000 7fc996a00640 1 --2- 172.21.15.112:0/1709399915 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc99816d710 0x7fc998163cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.041+0000 7fc996a00640 1 -- 172.21.15.112:0/1709399915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc998164200 msgr2=0x7fc9980ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.041+0000 7fc996a00640 1 --2- 172.21.15.112:0/1709399915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc998164200 0x7fc9980ad9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.041+0000 7fc996a00640 1 -- 172.21.15.112:0/1709399915 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc99814bed0 con 0x7fc9980b38e0 2024-09-12T02:42:05.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.041+0000 7fc997400640 1 --2- 172.21.15.112:0/1709399915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc998164200 0x7fc9980ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:05.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.042+0000 7fc996a00640 1 --2- 172.21.15.112:0/1709399915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9980b38e0 0x7fc99814b990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc99000cac0 tx=0x7fc99000cf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:05.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.041+0000 7fb5a7800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5a015cfb0 con 0x7fb5a0072c30 2024-09-12T02:42:05.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.041+0000 7fb5a7800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5a015d290 con 0x7fb5a015be40 2024-09-12T02:42:05.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.041+0000 7fb5a7800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb5a015d570 con 0x7fb5a015c9d0 2024-09-12T02:42:05.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.041+0000 7fb5a4e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fb5a015be40 0x7fb5a0072520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.112:40542/0 (socket says 172.21.15.112:40542) 2024-09-12T02:42:05.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.041+0000 7fb59fe00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb5a0072c30 0x7fb5a015c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33970/0 (socket says 172.21.15.112:33970) 2024-09-12T02:42:05.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.042+0000 7fb59fe00640 1 -- 172.21.15.112:0/2115843844 learned_addr learned my addr 172.21.15.112:0/2115843844 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:05.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.042+0000 7fb5a5800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb5a015c9d0 0x7fb5a015e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.042+0000 7fb59f400640 1 -- 172.21.15.112:0/2115843844 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2215528674 0 0) 0x7fb5a015d290 con 0x7fb5a015be40 2024-09-12T02:42:05.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.041+0000 7ff709600640 1 --2- 172.21.15.112:0/3845293038 >> v2:172.21.15.112:3300/0 conn(0x7ff6fc057830 0x7ff6fc0066b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.041+0000 7ff709600640 1 -- 172.21.15.112:0/3845293038 >> v1:172.21.15.137:6789/0 conn(0x7ff6fc03bc60 legacy=0x7ff6fc0535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.041+0000 7ff709600640 1 -- 172.21.15.112:0/3845293038 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6fc006190 con 0x7ff6fc0e28f0 2024-09-12T02:42:05.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.042+0000 7ff70a000640 1 --2- 172.21.15.112:0/3845293038 >> v2:172.21.15.112:3300/0 conn(0x7ff6fc057830 0x7ff6fc0066b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:05.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.043+0000 7ff709600640 1 --2- 172.21.15.112:0/3845293038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6fc0e28f0 0x7ff6fc053080 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc011b20 tx=0x7ff6f802a0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd2b2acfe5663311 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:05.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.042+0000 7fcce6200640 1 -- 172.21.15.112:0/4285955196 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcce01624e0 msgr2=0x7fcce00d58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:05.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.042+0000 7fcce6200640 1 --2- 172.21.15.112:0/4285955196 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcce01624e0 0x7fcce00d58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.042+0000 7fcce6200640 1 -- 172.21.15.112:0/4285955196 >> v1:172.21.15.112:6789/0 conn(0x7fcce0162100 legacy=0x7fcce00b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:05.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.042+0000 7fcce6200640 1 -- 172.21.15.112:0/4285955196 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce00d24b0 con 0x7fcce00d0510 2024-09-12T02:42:05.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.043+0000 7fc98ea00640 1 -- 172.21.15.112:0/1709399915 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc990018070 con 0x7fc9980b38e0 2024-09-12T02:42:05.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.043+0000 7fc98ea00640 1 -- 172.21.15.112:0/1709399915 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc990004bf0 con 0x7fc9980b38e0 2024-09-12T02:42:05.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.043+0000 7fc98ea00640 1 -- 172.21.15.112:0/1709399915 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9900070d0 con 0x7fc9980b38e0 2024-09-12T02:42:05.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.043+0000 7fc99d600640 1 -- 172.21.15.112:0/1709399915 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9980aee00 con 0x7fc9980b38e0 2024-09-12T02:42:05.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.043+0000 7f381f400640 1 --2- 172.21.15.112:0/39719693 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f380006bf00 0x7f380006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.043+0000 7fc99d600640 1 -- 172.21.15.112:0/1709399915 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9980ad1a0 con 0x7fc9980b38e0 2024-09-12T02:42:05.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.043+0000 7fb59f400640 1 -- 172.21.15.112:0/2115843844 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb584003520 con 0x7fb5a015be40 2024-09-12T02:42:05.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.043+0000 7fb59f400640 1 -- 172.21.15.112:0/2115843844 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1592280269 0 0) 0x7fb5a015cfb0 con 0x7fb5a0072c30 2024-09-12T02:42:05.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.043+0000 7fb59f400640 1 -- 172.21.15.112:0/2115843844 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5a015d290 con 0x7fb5a0072c30 2024-09-12T02:42:05.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.043+0000 7ff703e00640 1 -- 172.21.15.112:0/3845293038 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8037070 con 0x7ff6fc0e28f0 2024-09-12T02:42:05.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.043+0000 7ff703e00640 1 -- 172.21.15.112:0/3845293038 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6f802ad60 con 0x7ff6fc0e28f0 2024-09-12T02:42:05.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.043+0000 7ff703e00640 1 -- 172.21.15.112:0/3845293038 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8032660 con 0x7ff6fc0e28f0 2024-09-12T02:42:05.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.043+0000 7f1565e00640 1 Processor -- start 2024-09-12T02:42:05.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.043+0000 7f1565e00640 1 -- start start 2024-09-12T02:42:05.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.043+0000 7fb5a5800640 1 -- 172.21.15.112:0/2115843844 >> v1:172.21.15.137:6789/0 conn(0x7fb5a015be40 legacy=0x7fb5a0072520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.043+0000 7fb5a5800640 1 -- 172.21.15.112:0/2115843844 >> v1:172.21.15.112:6789/0 conn(0x7fb5a0072c30 legacy=0x7fb5a015c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.043+0000 7fb5a5800640 1 -- 172.21.15.112:0/2115843844 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a015d850 con 0x7fb5a015c9d0 2024-09-12T02:42:05.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.044+0000 7f45c8800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f45c00d1520 0x7f45c00d1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.044+0000 7f45c8800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45c00b7c80 con 0x7f45c01625b0 2024-09-12T02:42:05.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.044+0000 7f45c8800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45c0162990 con 0x7f45c00b8410 2024-09-12T02:42:05.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.044+0000 7f45c8800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f45c00d0370 con 0x7f45c00d1520 2024-09-12T02:42:05.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.044+0000 7f381f400640 1 --2- 172.21.15.112:0/39719693 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f380006bf00 0x7f380006e3c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3814000f60 tx=0x7f3814009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:05.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.044+0000 7fcce6200640 1 --2- 172.21.15.112:0/4285955196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcce00d0510 0x7fcce00d0960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcccc009870 tx=0x7fcccc02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4a90f2c9ba8f8e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:05.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.045+0000 7fccdfe00640 1 -- 172.21.15.112:0/4285955196 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc037070 con 0x7fcce00d0510 2024-09-12T02:42:05.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.045+0000 7fccdfe00640 1 -- 172.21.15.112:0/4285955196 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcccc032440 con 0x7fcce00d0510 2024-09-12T02:42:05.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.045+0000 7fccdfe00640 1 -- 172.21.15.112:0/4285955196 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc032810 con 0x7fcce00d0510 2024-09-12T02:42:05.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.045+0000 7ff70aa00640 1 -- 172.21.15.112:0/3845293038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6fc0e28f0 msgr2=0x7ff6fc053080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.045+0000 7ff70aa00640 1 --2- 172.21.15.112:0/3845293038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6fc0e28f0 0x7ff6fc053080 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc011b20 tx=0x7ff6f802a0d0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.045+0000 7f45c5e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f45c01625b0 0x7f45c00d5660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33980/0 (socket says 172.21.15.112:33980) 2024-09-12T02:42:05.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.045+0000 7f45c5e00640 1 -- 172.21.15.112:0/1538506192 learned_addr learned my addr 172.21.15.112:0/1538506192 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:05.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.045+0000 7fb5a5800640 1 --2- 172.21.15.112:0/2115843844 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5a015c9d0 0x7fb5a015e050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb59000c2e0 tx=0x7fb59002bbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f98a655df3e43946 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:05.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.045+0000 7fc99d600640 1 -- 172.21.15.112:0/1709399915 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc998068a30 con 0x7fc9980b38e0 2024-09-12T02:42:05.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.045+0000 7ff70aa00640 1 -- 172.21.15.112:0/3845293038 shutdown_connections 2024-09-12T02:42:05.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.045+0000 7ff70aa00640 1 --2- 172.21.15.112:0/3845293038 >> v2:172.21.15.112:3300/0 conn(0x7ff6fc057830 0x7ff6fc0066b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.045+0000 7ff70aa00640 1 --2- 172.21.15.112:0/3845293038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6fc0e28f0 0x7ff6fc053080 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.045+0000 7ff70aa00640 1 -- 172.21.15.112:0/3845293038 >> 172.21.15.112:0/3845293038 conn(0x7ff6fc03a520 msgr2=0x7ff6fc03a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:05.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.045+0000 7fb59f400640 1 -- 172.21.15.112:0/2115843844 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59000a4e0 con 0x7fb5a015c9d0 2024-09-12T02:42:05.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.046+0000 7fb59f400640 1 -- 172.21.15.112:0/2115843844 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb59000a680 con 0x7fb5a015c9d0 2024-09-12T02:42:05.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.046+0000 7fb59f400640 1 -- 172.21.15.112:0/2115843844 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59000aa50 con 0x7fb5a015c9d0 2024-09-12T02:42:05.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.045+0000 7f1565e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15600d3270 0x7f15600c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.046+0000 7f1565e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f15600b5920 0x7f15600b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.046+0000 7f1565e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15600c8710 con 0x7f15600d3650 2024-09-12T02:42:05.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.046+0000 7f1565e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f15600d2cb0 con 0x7f15600b5920 2024-09-12T02:42:05.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.046+0000 7f1565e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f15600cfd10 con 0x7f15600d3270 2024-09-12T02:42:05.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.046+0000 7fcce8200640 1 -- 172.21.15.112:0/4285955196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcce00d0510 msgr2=0x7fcce00d0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.046+0000 7fcce8200640 1 --2- 172.21.15.112:0/4285955196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcce00d0510 0x7fcce00d0960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcccc009870 tx=0x7fcccc02a1c0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.046+0000 7fcce8200640 1 -- 172.21.15.112:0/4285955196 shutdown_connections 2024-09-12T02:42:05.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.046+0000 7fcce8200640 1 --2- 172.21.15.112:0/4285955196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcce00d0510 0x7fcce00d0960 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.046+0000 7fcce8200640 1 --2- 172.21.15.112:0/4285955196 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcce01624e0 0x7fcce00d58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.046+0000 7fcce8200640 1 -- 172.21.15.112:0/4285955196 >> 172.21.15.112:0/4285955196 conn(0x7fcce00d4db0 msgr2=0x7fcce00d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:05.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.046+0000 7f155ea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15600d3270 0x7f15600c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.046+0000 7fcce8200640 1 -- 172.21.15.112:0/4285955196 shutdown_connections 2024-09-12T02:42:05.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.046+0000 7f45c5400640 1 --2- 172.21.15.112:0/1538506192 >> v2:172.21.15.137:3300/0 conn(0x7f45c00d1520 0x7f45c00d1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.046+0000 7f45c4a00640 1 -- 172.21.15.112:0/1538506192 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1133706405 0 0) 0x7f45c00b7c80 con 0x7f45c01625b0 2024-09-12T02:42:05.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.046+0000 7f45c4a00640 1 -- 172.21.15.112:0/1538506192 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45a8003520 con 0x7f45c01625b0 2024-09-12T02:42:05.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.046+0000 7f155ea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15600d3270 0x7f15600c7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:47798/0 (socket says 172.21.15.112:47798) 2024-09-12T02:42:05.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.046+0000 7f155ea00640 1 -- 172.21.15.112:0/172142740 learned_addr learned my addr 172.21.15.112:0/172142740 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:05.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.046+0000 7f45c5400640 1 -- 172.21.15.112:0/1538506192 >> v1:172.21.15.137:6789/0 conn(0x7f45c00b8410 legacy=0x7f45c00b8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.046+0000 7f45c5400640 1 -- 172.21.15.112:0/1538506192 >> v1:172.21.15.112:6789/0 conn(0x7f45c01625b0 legacy=0x7f45c00d5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.046+0000 7f45c5400640 1 -- 172.21.15.112:0/1538506192 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c00d05c0 con 0x7f45c00d1520 2024-09-12T02:42:05.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.046+0000 7f155e000640 1 --2- 172.21.15.112:0/172142740 >> v2:172.21.15.137:3300/0 conn(0x7f15600b5920 0x7f15600b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.046+0000 7f9015c00640 1 Processor -- start 2024-09-12T02:42:05.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.047+0000 7f3813400640 1 -- 172.21.15.112:0/39719693 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f380c0590b0 con 0x7f382015edb0 2024-09-12T02:42:05.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.046+0000 7fcce8200640 1 -- 172.21.15.112:0/4285955196 wait complete. 2024-09-12T02:42:05.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.047+0000 7f155ea00640 1 -- 172.21.15.112:0/172142740 >> v2:172.21.15.137:3300/0 conn(0x7f15600b5920 msgr2=0x7f15600b7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:05.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.047+0000 7f155ea00640 1 --2- 172.21.15.112:0/172142740 >> v2:172.21.15.137:3300/0 conn(0x7f15600b5920 0x7f15600b7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.047+0000 7f155ea00640 1 -- 172.21.15.112:0/172142740 >> v1:172.21.15.137:6789/0 conn(0x7f15600d3650 legacy=0x7f15600d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.047+0000 7f155d600640 1 -- 172.21.15.112:0/172142740 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3073025981 0 0) 0x7f15600c8710 con 0x7f15600d3650 2024-09-12T02:42:05.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.047+0000 7fc98ea00640 1 -- 172.21.15.112:0/1709399915 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc99001b070 con 0x7fc9980b38e0 2024-09-12T02:42:05.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.047+0000 7f155ea00640 1 -- 172.21.15.112:0/172142740 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15600d2f00 con 0x7f15600d3270 2024-09-12T02:42:05.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.047+0000 7fb5a7800640 1 -- 172.21.15.112:0/2115843844 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5a015c9d0 msgr2=0x7fb5a015e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.047+0000 7f9015c00640 1 -- start start 2024-09-12T02:42:05.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.048+0000 7ff70aa00640 1 -- 172.21.15.112:0/3845293038 shutdown_connections 2024-09-12T02:42:05.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.047+0000 7fb5a7800640 1 --2- 172.21.15.112:0/2115843844 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5a015c9d0 0x7fb5a015e050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb59000c2e0 tx=0x7fb59002bbb0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.048+0000 7fc98ea00640 1 --2- 172.21.15.112:0/1709399915 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc97806be80 0x7fc97806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.048+0000 7fc98ea00640 1 -- 172.21.15.112:0/1709399915 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc99008a460 con 0x7fc9980b38e0 2024-09-12T02:42:05.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.048+0000 7fb5a7800640 1 -- 172.21.15.112:0/2115843844 shutdown_connections 2024-09-12T02:42:05.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.048+0000 7fb5a7800640 1 --2- 172.21.15.112:0/2115843844 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5a015c9d0 0x7fb5a015e050 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.048+0000 7fb5a7800640 1 -- 172.21.15.112:0/2115843844 >> 172.21.15.112:0/2115843844 conn(0x7fb5a00b3000 msgr2=0x7fb5a006bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:05.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.049+0000 7fc996000640 1 --2- 172.21.15.112:0/1709399915 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc97806be80 0x7fc97806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.049+0000 7fb5a7800640 1 -- 172.21.15.112:0/2115843844 shutdown_connections 2024-09-12T02:42:05.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.049+0000 7fcce8200640 1 Processor -- start 2024-09-12T02:42:05.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.049+0000 7f155ea00640 1 --2- 172.21.15.112:0/172142740 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15600d3270 0x7f15600c7af0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1550009870 tx=0x7f155002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de38edcf5e2960ea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:05.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.049+0000 7f9015c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90100d5840 0x7f90100d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.049+0000 7fcce8200640 1 -- start start 2024-09-12T02:42:05.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.049+0000 7f9015c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90100b5c30 con 0x7f9010161f70 2024-09-12T02:42:05.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.049+0000 7f155d600640 1 -- 172.21.15.112:0/172142740 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1550037070 con 0x7f15600d3270 2024-09-12T02:42:05.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.049+0000 7f155d600640 1 -- 172.21.15.112:0/172142740 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1550032440 con 0x7f15600d3270 2024-09-12T02:42:05.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.049+0000 7f9015c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90100b5f10 con 0x7f90100d1630 2024-09-12T02:42:05.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.049+0000 7f9015c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f90100b61f0 con 0x7f90100d5840 2024-09-12T02:42:05.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.049+0000 7f155d600640 1 -- 172.21.15.112:0/172142740 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1550037070 con 0x7f15600d3270 2024-09-12T02:42:05.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.050+0000 7f9015200640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f9010161f70 0x7f90100b7b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33982/0 (socket says 172.21.15.112:33982) 2024-09-12T02:42:05.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.050+0000 7f9015200640 1 -- 172.21.15.112:0/2666944126 learned_addr learned my addr 172.21.15.112:0/2666944126 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:05.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.050+0000 7f9007400640 1 --2- 172.21.15.112:0/2666944126 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90100d5840 0x7f90100d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.048+0000 7ff70aa00640 1 -- 172.21.15.112:0/3845293038 wait complete. 2024-09-12T02:42:05.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.050+0000 7ff70aa00640 1 Processor -- start 2024-09-12T02:42:05.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.050+0000 7fcce8200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcce00d0510 0x7fcce00cb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.050+0000 7fcce8200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcce0162100 0x7fcce00b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.050+0000 7f1565e00640 1 -- 172.21.15.112:0/172142740 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15600d3270 msgr2=0x7f15600c7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.051+0000 7f1565e00640 1 --2- 172.21.15.112:0/172142740 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15600d3270 0x7f15600c7af0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1550009870 tx=0x7f155002a1c0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.050+0000 7f900f400640 1 -- 172.21.15.112:0/2666944126 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3827810455 0 0) 0x7f90100b5c30 con 0x7f9010161f70 2024-09-12T02:42:05.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.050+0000 7f900f400640 1 -- 172.21.15.112:0/2666944126 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ff4003520 con 0x7f9010161f70 2024-09-12T02:42:05.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.051+0000 7f1565e00640 1 -- 172.21.15.112:0/172142740 shutdown_connections 2024-09-12T02:42:05.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.051+0000 7f1565e00640 1 --2- 172.21.15.112:0/172142740 >> v2:172.21.15.137:3300/0 conn(0x7f15600b5920 0x7f15600b7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.051+0000 7f1565e00640 1 --2- 172.21.15.112:0/172142740 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15600d3270 0x7f15600c7af0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.051+0000 7f1565e00640 1 -- 172.21.15.112:0/172142740 >> 172.21.15.112:0/172142740 conn(0x7f15600d4db0 msgr2=0x7f15600d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:05.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.051+0000 7fc996000640 1 --2- 172.21.15.112:0/1709399915 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc97806be80 0x7fc97806e340 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc984034000 tx=0x7fc98402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:05.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.051+0000 7fcce5800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcce00d0510 0x7fcce00cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.051+0000 7fcce5800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcce00d0510 0x7fcce00cb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:47836/0 (socket says 172.21.15.112:47836) 2024-09-12T02:42:05.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.051+0000 7fcce4e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcce0162100 0x7fcce00b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.051+0000 7ff70aa00640 1 -- start start 2024-09-12T02:42:05.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.049+0000 7fb5a7800640 1 -- 172.21.15.112:0/2115843844 wait complete. 2024-09-12T02:42:05.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.051+0000 7fb5a7800640 1 Processor -- start 2024-09-12T02:42:05.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.051+0000 7f1565e00640 1 -- 172.21.15.112:0/172142740 shutdown_connections 2024-09-12T02:42:05.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.051+0000 7fcce4e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcce0162100 0x7fcce00b7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57746/0 (socket says 172.21.15.112:57746) 2024-09-12T02:42:05.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.051+0000 7fcce8200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcce01624e0 0x7fcce00b8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.051+0000 7fcce8200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcce00d0ea0 con 0x7fcce0162100 2024-09-12T02:42:05.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.051+0000 7f45c5400640 1 --2- 172.21.15.112:0/1538506192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45c00d1520 0x7f45c00d1960 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f45b00097a0 tx=0x7f45b002a2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f3fea431d5c5ed9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:05.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.051+0000 7fcce8200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcce00cfff0 con 0x7fcce00d0510 2024-09-12T02:42:05.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.051+0000 7fcce8200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fcce00d1df0 con 0x7fcce01624e0 2024-09-12T02:42:05.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.051+0000 7f9007400640 1 -- 172.21.15.112:0/2666944126 >> v1:172.21.15.137:6789/0 conn(0x7f90100d1630 legacy=0x7f90100d28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.051+0000 7f9007400640 1 -- 172.21.15.112:0/2666944126 >> v1:172.21.15.112:6789/0 conn(0x7f9010161f70 legacy=0x7f90100b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.051+0000 7f9007400640 1 -- 172.21.15.112:0/2666944126 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90100d2090 con 0x7f90100d5840 2024-09-12T02:42:05.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.052+0000 7fb5a7800640 1 -- start start 2024-09-12T02:42:05.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.051+0000 7fcce5800640 1 -- 172.21.15.112:0/3168393611 learned_addr learned my addr 172.21.15.112:0/3168393611 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:05.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.051+0000 7f1565e00640 1 -- 172.21.15.112:0/172142740 wait complete. 2024-09-12T02:42:05.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.052+0000 7fcce6200640 1 --2- 172.21.15.112:0/3168393611 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcce01624e0 0x7fcce00b8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.052+0000 7fcce4e00640 1 -- 172.21.15.112:0/3168393611 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcce01624e0 msgr2=0x7fcce00b8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.052+0000 7fcce4e00640 1 --2- 172.21.15.112:0/3168393611 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcce01624e0 0x7fcce00b8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.052+0000 7fcce4e00640 1 -- 172.21.15.112:0/3168393611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcce00d0510 msgr2=0x7fcce00cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.052+0000 7fcce4e00640 1 --2- 172.21.15.112:0/3168393611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcce00d0510 0x7fcce00cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.052+0000 7fcce4e00640 1 -- 172.21.15.112:0/3168393611 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce00baa50 con 0x7fcce0162100 2024-09-12T02:42:05.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.052+0000 7fcce5800640 1 --2- 172.21.15.112:0/3168393611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcce00d0510 0x7fcce00cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:05.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.053+0000 7fcce4e00640 1 --2- 172.21.15.112:0/3168393611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcce0162100 0x7fcce00b7be0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fccd400e850 tx=0x7fccd400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:05.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.053+0000 7f9007400640 1 --2- 172.21.15.112:0/2666944126 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90100d5840 0x7f90100d1a10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80097d0 tx=0x7f8ff802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4949cfe6f4ba9f8c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:05.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.053+0000 7fccdd600640 1 -- 172.21.15.112:0/3168393611 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd4017070 con 0x7fcce0162100 2024-09-12T02:42:05.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.053+0000 7fccdd600640 1 -- 172.21.15.112:0/3168393611 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccd400c940 con 0x7fcce0162100 2024-09-12T02:42:05.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.053+0000 7fccdd600640 1 -- 172.21.15.112:0/3168393611 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd400cd10 con 0x7fcce0162100 2024-09-12T02:42:05.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.053+0000 7fcce8200640 1 -- 172.21.15.112:0/3168393611 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcce00ca590 con 0x7fcce0162100 2024-09-12T02:42:05.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.053+0000 7f900f400640 1 -- 172.21.15.112:0/2666944126 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8037070 con 0x7f90100d5840 2024-09-12T02:42:05.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.053+0000 7f900f400640 1 -- 172.21.15.112:0/2666944126 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff8032440 con 0x7f90100d5840 2024-09-12T02:42:05.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.053+0000 7f900f400640 1 -- 172.21.15.112:0/2666944126 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8032810 con 0x7f90100d5840 2024-09-12T02:42:05.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.053+0000 7fb5a7800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5a0072c30 0x7fb5a0151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.054+0000 7fb5a7800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a015be40 0x7fb5a014a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.054+0000 7fb5a7800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5a015c9d0 0x7fb5a01f4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.053+0000 7ff70aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6fc03bc60 0x7ff6fc0e5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.054+0000 7ff70aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6fc057830 0x7ff6fc050b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.054+0000 7ff70aa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6fc0e28f0 0x7ff6fc051090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.053+0000 7fcce8200640 1 -- 172.21.15.112:0/3168393611 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcce00cab50 con 0x7fcce0162100 2024-09-12T02:42:05.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.054+0000 7f9015c00640 1 -- 172.21.15.112:0/2666944126 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90100d5840 msgr2=0x7f90100d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.054+0000 7f9015c00640 1 --2- 172.21.15.112:0/2666944126 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90100d5840 0x7f90100d1a10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80097d0 tx=0x7f8ff802a210 comp rx=0 tx=0).stop 2024-09-12T02:42:05.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.054+0000 7fb5a7800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a006c460 con 0x7fb5a015be40 2024-09-12T02:42:05.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.054+0000 7fb5a7800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a006c2e0 con 0x7fb5a015c9d0 2024-09-12T02:42:05.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.054+0000 7f1565e00640 1 Processor -- start 2024-09-12T02:42:05.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.054+0000 7fb5a7800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb5a0158d40 con 0x7fb5a0072c30 2024-09-12T02:42:05.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.054+0000 7ff708c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6fc057830 0x7ff6fc050b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.054+0000 7ff708c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6fc057830 0x7ff6fc050b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:47844/0 (socket says 172.21.15.112:47844) 2024-09-12T02:42:05.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.054+0000 7ff70a000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6fc0e28f0 0x7ff6fc051090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.054+0000 7ff70a000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6fc0e28f0 0x7ff6fc051090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:47816/0 (socket says 172.21.15.112:47816) 2024-09-12T02:42:05.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.054+0000 7ff70a000640 1 -- 172.21.15.112:0/4058501126 learned_addr learned my addr 172.21.15.112:0/4058501126 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:05.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.055+0000 7fb5a5800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5a015c9d0 0x7fb5a01f4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.055+0000 7ff709600640 1 --2- 172.21.15.112:0/4058501126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6fc03bc60 0x7ff6fc0e5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.055+0000 7fb5a5800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5a015c9d0 0x7fb5a01f4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:47854/0 (socket says 172.21.15.112:47854) 2024-09-12T02:42:05.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.055+0000 7fb59fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a015be40 0x7fb5a014a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.055+0000 7ff70aa00640 1 -- 172.21.15.112:0/4058501126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc053e50 con 0x7ff6fc03bc60 2024-09-12T02:42:05.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.055+0000 7f45c4a00640 1 -- 172.21.15.112:0/1538506192 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b0037070 con 0x7f45c00d1520 2024-09-12T02:42:05.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.055+0000 7ff70aa00640 1 -- 172.21.15.112:0/4058501126 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc053cd0 con 0x7ff6fc057830 2024-09-12T02:42:05.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.055+0000 7f45c4a00640 1 -- 172.21.15.112:0/1538506192 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45b0032640 con 0x7f45c00d1520 2024-09-12T02:42:05.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.055+0000 7f45c4a00640 1 -- 172.21.15.112:0/1538506192 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b0032a50 con 0x7f45c00d1520 2024-09-12T02:42:05.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.054+0000 7f9015c00640 1 -- 172.21.15.112:0/2666944126 shutdown_connections 2024-09-12T02:42:05.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.054+0000 7f9015c00640 1 --2- 172.21.15.112:0/2666944126 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90100d5840 0x7f90100d1a10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.054+0000 7f9015c00640 1 -- 172.21.15.112:0/2666944126 >> 172.21.15.112:0/2666944126 conn(0x7f90100d4d20 msgr2=0x7f90100d5130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:05.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.055+0000 7fb59fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a015be40 0x7fb5a014a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57762/0 (socket says 172.21.15.112:57762) 2024-09-12T02:42:05.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.055+0000 7ff70aa00640 1 -- 172.21.15.112:0/4058501126 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff6fc0e2cd0 con 0x7ff6fc0e28f0 2024-09-12T02:42:05.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.055+0000 7fb59fe00640 1 -- 172.21.15.112:0/4136838821 learned_addr learned my addr 172.21.15.112:0/4136838821 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:05.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.055+0000 7f9015c00640 1 -- 172.21.15.112:0/2666944126 shutdown_connections 2024-09-12T02:42:05.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.054+0000 7fb5a4e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5a0072c30 0x7fb5a0151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.055+0000 7f1565e00640 1 -- start start 2024-09-12T02:42:05.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.055+0000 7fcce8200640 1 -- 172.21.15.112:0/3168393611 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcce0162b80 con 0x7fcce0162100 2024-09-12T02:42:05.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.055+0000 7fc98ea00640 1 -- 172.21.15.112:0/1709399915 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc990058930 con 0x7fc9980b38e0 2024-09-12T02:42:05.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.056+0000 7ff708c00640 1 -- 172.21.15.112:0/4058501126 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6fc0e28f0 msgr2=0x7ff6fc051090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.056+0000 7ff708c00640 1 --2- 172.21.15.112:0/4058501126 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6fc0e28f0 0x7ff6fc051090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.056+0000 7ff708c00640 1 -- 172.21.15.112:0/4058501126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6fc03bc60 msgr2=0x7ff6fc0e5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.056+0000 7f45c8800640 1 -- 172.21.15.112:0/1538506192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45c00d1520 msgr2=0x7f45c00d1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.056+0000 7f45c8800640 1 --2- 172.21.15.112:0/1538506192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45c00d1520 0x7f45c00d1960 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f45b00097a0 tx=0x7f45b002a2e0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.056+0000 7fb5a4e00640 1 -- 172.21.15.112:0/4136838821 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5a015c9d0 msgr2=0x7fb5a01f4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.056+0000 7fb5a4e00640 1 --2- 172.21.15.112:0/4136838821 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5a015c9d0 0x7fb5a01f4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.056+0000 7fb5a4e00640 1 -- 172.21.15.112:0/4136838821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a015be40 msgr2=0x7fb5a014a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.056+0000 7fb5a4e00640 1 --2- 172.21.15.112:0/4136838821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a015be40 0x7fb5a014a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.056+0000 7ff708c00640 1 --2- 172.21.15.112:0/4058501126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6fc03bc60 0x7ff6fc0e5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.056+0000 7ff708c00640 1 -- 172.21.15.112:0/4058501126 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6fc04f620 con 0x7ff6fc057830 2024-09-12T02:42:05.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.056+0000 7fccdd600640 1 -- 172.21.15.112:0/3168393611 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fccd401a070 con 0x7fcce0162100 2024-09-12T02:42:05.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.055+0000 7f9015c00640 1 -- 172.21.15.112:0/2666944126 wait complete. 2024-09-12T02:42:05.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.057+0000 7f45c8800640 1 -- 172.21.15.112:0/1538506192 shutdown_connections 2024-09-12T02:42:05.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.057+0000 7ff709600640 1 --2- 172.21.15.112:0/4058501126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6fc03bc60 0x7ff6fc0e5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:05.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.057+0000 7ff70a000640 1 --2- 172.21.15.112:0/4058501126 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6fc0e28f0 0x7ff6fc051090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:42:05.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.057+0000 7f1565e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15600b5920 0x7f15601e8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.057+0000 7ff708c00640 1 --2- 172.21.15.112:0/4058501126 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6fc057830 0x7ff6fc050b50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0565b0 tx=0x7ff6f000cbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:05.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.057+0000 7fb5a4e00640 1 -- 172.21.15.112:0/4136838821 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a01524a0 con 0x7fb5a0072c30 2024-09-12T02:42:05.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.057+0000 7fb5a5800640 1 --2- 172.21.15.112:0/4136838821 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5a015c9d0 0x7fb5a01f4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:05.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.057+0000 7fb59fe00640 1 --2- 172.21.15.112:0/4136838821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a015be40 0x7fb5a014a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:05.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.058+0000 7f9015c00640 1 Processor -- start 2024-09-12T02:42:05.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.057+0000 7f45c8800640 1 --2- 172.21.15.112:0/1538506192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45c00d1520 0x7f45c00d1960 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.057+0000 7f45c8800640 1 -- 172.21.15.112:0/1538506192 >> 172.21.15.112:0/1538506192 conn(0x7f45c009e0d0 msgr2=0x7f45c00d4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:05.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.057+0000 7f45c8800640 1 -- 172.21.15.112:0/1538506192 shutdown_connections 2024-09-12T02:42:05.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.057+0000 7f45c8800640 1 -- 172.21.15.112:0/1538506192 wait complete. 2024-09-12T02:42:05.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.058+0000 7ff701600640 1 -- 172.21.15.112:0/4058501126 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0017070 con 0x7ff6fc057830 2024-09-12T02:42:05.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.058+0000 7ff701600640 1 -- 172.21.15.112:0/4058501126 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6f0005290 con 0x7ff6fc057830 2024-09-12T02:42:05.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.058+0000 7f9015c00640 1 -- start start 2024-09-12T02:42:05.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.058+0000 7ff70aa00640 1 -- 172.21.15.112:0/4058501126 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6fc0e3860 con 0x7ff6fc057830 2024-09-12T02:42:05.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.058+0000 7ff70aa00640 1 -- 172.21.15.112:0/4058501126 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6fc0e3e20 con 0x7ff6fc057830 2024-09-12T02:42:05.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.058+0000 7fccdd600640 1 --2- 172.21.15.112:0/3168393611 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fccc006be80 0x7fccc006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.058+0000 7fccdd600640 1 -- 172.21.15.112:0/3168393611 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fccd408b130 con 0x7fcce0162100 2024-09-12T02:42:05.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.059+0000 7fcce5800640 1 --2- 172.21.15.112:0/3168393611 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fccc006be80 0x7fccc006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.059+0000 7f9015c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90100d1630 0x7f90101f7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.059+0000 7f9015c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90100d5840 0x7f90101f5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.060+0000 7f9015c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9010161f70 0x7f90101f8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.060+0000 7f9015c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9010162560 con 0x7f90100d5840 2024-09-12T02:42:05.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.060+0000 7f9015c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f90101623e0 con 0x7f90100d1630 2024-09-12T02:42:05.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.060+0000 7f9015c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f90101626e0 con 0x7f9010161f70 2024-09-12T02:42:05.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.059+0000 7f1565e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15600d3270 0x7f15600cec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.058+0000 7fb5a4e00640 1 --2- 172.21.15.112:0/4136838821 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5a0072c30 0x7fb5a0151ec0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb58c00c3a0 tx=0x7fb58c00c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:05.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.059+0000 7f1565e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15600d3650 0x7f15600b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.059+0000 7f1565e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f15600d3b00 con 0x7f15600b5920 2024-09-12T02:42:05.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.059+0000 7f1565e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f15600d3f60 con 0x7f15600d3650 2024-09-12T02:42:05.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.059+0000 7f1565e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f15600d08b0 con 0x7f15600d3270 2024-09-12T02:42:05.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.059+0000 7f155ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15600b5920 0x7f15601e8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.059+0000 7f155ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15600b5920 0x7f15601e8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57778/0 (socket says 172.21.15.112:57778) 2024-09-12T02:42:05.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.059+0000 7f155ea00640 1 -- 172.21.15.112:0/21528932 learned_addr learned my addr 172.21.15.112:0/21528932 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:05.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.059+0000 7f155e000640 1 --2- 172.21.15.112:0/21528932 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15600d3270 0x7f15600cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.060+0000 7fcce5800640 1 --2- 172.21.15.112:0/3168393611 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fccc006be80 0x7fccc006e340 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fccd8007fd0 tx=0x7fccd8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:05.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.060+0000 7f155f400640 1 --2- 172.21.15.112:0/21528932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15600d3650 0x7f15600b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.060+0000 7f155ea00640 1 -- 172.21.15.112:0/21528932 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15600d3270 msgr2=0x7f15600cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.060+0000 7f155ea00640 1 --2- 172.21.15.112:0/21528932 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15600d3270 0x7f15600cec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.060+0000 7f155ea00640 1 -- 172.21.15.112:0/21528932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15600d3650 msgr2=0x7f15600b36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.060+0000 7f155ea00640 1 --2- 172.21.15.112:0/21528932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15600d3650 0x7f15600b36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.060+0000 7f155ea00640 1 -- 172.21.15.112:0/21528932 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15600b3c10 con 0x7f15600b5920 2024-09-12T02:42:05.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.061+0000 7fb59cc00640 1 -- 172.21.15.112:0/4136838821 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb58c0074e0 con 0x7fb5a0072c30 2024-09-12T02:42:05.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.061+0000 7fb59cc00640 1 -- 172.21.15.112:0/4136838821 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb58c007680 con 0x7fb5a0072c30 2024-09-12T02:42:05.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.061+0000 7fb59cc00640 1 -- 172.21.15.112:0/4136838821 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb58c004a00 con 0x7fb5a0072c30 2024-09-12T02:42:05.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.061+0000 7fb5a7800640 1 -- 172.21.15.112:0/4136838821 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a014bd10 con 0x7fb5a0072c30 2024-09-12T02:42:05.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.061+0000 7f9007400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90100d5840 0x7f90101f5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.061+0000 7f9007400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90100d5840 0x7f90101f5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57788/0 (socket says 172.21.15.112:57788) 2024-09-12T02:42:05.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.061+0000 7f9007400640 1 -- 172.21.15.112:0/2295121785 learned_addr learned my addr 172.21.15.112:0/2295121785 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:05.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.061+0000 7fb5a7800640 1 -- 172.21.15.112:0/4136838821 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a014c2d0 con 0x7fb5a0072c30 2024-09-12T02:42:05.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.061+0000 7f155ea00640 1 --2- 172.21.15.112:0/21528932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15600b5920 0x7f15601e8520 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f15500090b0 tx=0x7f15500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:05.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.062+0000 7f9007400640 1 -- 172.21.15.112:0/2295121785 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9010161f70 msgr2=0x7f90101f8190 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:42:05.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.062+0000 7f9007400640 1 --2- 172.21.15.112:0/2295121785 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9010161f70 0x7f90101f8190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.062+0000 7f9007400640 1 -- 172.21.15.112:0/2295121785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90100d1630 msgr2=0x7f90101f7a00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:42:05.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.062+0000 7f9007400640 1 --2- 172.21.15.112:0/2295121785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90100d1630 0x7f90101f7a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.062+0000 7f9007400640 1 -- 172.21.15.112:0/2295121785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90101f7f40 con 0x7f90100d5840 2024-09-12T02:42:05.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.061+0000 7ff70aa00640 1 -- 172.21.15.112:0/4058501126 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6e0005290 con 0x7ff6fc057830 2024-09-12T02:42:05.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.062+0000 7ff701600640 1 -- 172.21.15.112:0/4058501126 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0003830 con 0x7ff6fc057830 2024-09-12T02:42:05.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.063+0000 7fb5a7800640 1 -- 172.21.15.112:0/4136838821 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb578005290 con 0x7fb5a0072c30 2024-09-12T02:42:05.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.063+0000 7f9007400640 1 --2- 172.21.15.112:0/2295121785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90100d5840 0x7f90101f5cb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80098f0 tx=0x7f8ff80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:05.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.063+0000 7f45c8800640 1 Processor -- start 2024-09-12T02:42:05.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.063+0000 7f45c8800640 1 -- start start 2024-09-12T02:42:05.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.063+0000 7ff701600640 1 -- 172.21.15.112:0/4058501126 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff6f001a070 con 0x7ff6fc057830 2024-09-12T02:42:05.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.064+0000 7f900cc00640 1 -- 172.21.15.112:0/2295121785 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8037050 con 0x7f90100d5840 2024-09-12T02:42:05.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.064+0000 7fb59cc00640 1 -- 172.21.15.112:0/4136838821 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb58c01a020 con 0x7fb5a0072c30 2024-09-12T02:42:05.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.064+0000 7fccdd600640 1 -- 172.21.15.112:0/3168393611 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fccd4059b50 con 0x7fcce0162100 2024-09-12T02:42:05.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.064+0000 7f900cc00640 1 -- 172.21.15.112:0/2295121785 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff8043070 con 0x7f90100d5840 2024-09-12T02:42:05.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.064+0000 7f900cc00640 1 -- 172.21.15.112:0/2295121785 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff803cb30 con 0x7f90100d5840 2024-09-12T02:42:05.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.064+0000 7f9015c00640 1 -- 172.21.15.112:0/2295121785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90101f8c30 con 0x7f90100d5840 2024-09-12T02:42:05.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.065+0000 7f45c8800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45c00b8410 0x7f45c00cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.065+0000 7f45c8800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45c00d1520 0x7f45c00a1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.065+0000 7f45c8800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45c01625b0 0x7f45c00b98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.065+0000 7f45c8800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f45c00b7ef0 con 0x7f45c00b8410 2024-09-12T02:42:05.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.065+0000 7f45c8800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f45c00d1ea0 con 0x7f45c01625b0 2024-09-12T02:42:05.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.065+0000 7f45c8800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f45c00d0b80 con 0x7f45c00d1520 2024-09-12T02:42:05.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.065+0000 7ff701600640 1 --2- 172.21.15.112:0/4058501126 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff6e406be30 0x7ff6e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.066+0000 7ff709600640 1 --2- 172.21.15.112:0/4058501126 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff6e406be30 0x7ff6e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.066+0000 7f45c6800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45c01625b0 0x7f45c00b98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.066+0000 7f45c6800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45c01625b0 0x7f45c00b98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:47878/0 (socket says 172.21.15.112:47878) 2024-09-12T02:42:05.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.066+0000 7f45c6800640 1 -- 172.21.15.112:0/3470282891 learned_addr learned my addr 172.21.15.112:0/3470282891 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:05.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.066+0000 7f45c5e00640 1 --2- 172.21.15.112:0/3470282891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45c00b8410 0x7f45c00cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.066+0000 7fb59cc00640 1 --2- 172.21.15.112:0/4136838821 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb58006bf30 0x7fb58006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.066+0000 7f45c6800640 1 -- 172.21.15.112:0/3470282891 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45c00d1520 msgr2=0x7f45c00a1450 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:42:05.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.066+0000 7f45c6800640 1 --2- 172.21.15.112:0/3470282891 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45c00d1520 0x7f45c00a1450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.066+0000 7f45c6800640 1 -- 172.21.15.112:0/3470282891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45c00b8410 msgr2=0x7f45c00cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.066+0000 7f45c6800640 1 --2- 172.21.15.112:0/3470282891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45c00b8410 0x7f45c00cb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.066+0000 7f45c6800640 1 -- 172.21.15.112:0/3470282891 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c00a1ed0 con 0x7f45c01625b0 2024-09-12T02:42:05.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.066+0000 7f9015c00640 1 -- 172.21.15.112:0/2295121785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90101553d0 con 0x7f90100d5840 2024-09-12T02:42:05.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.066+0000 7fb59cc00640 1 -- 172.21.15.112:0/4136838821 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb58c08a5f0 con 0x7fb5a0072c30 2024-09-12T02:42:05.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.067+0000 7f45c6800640 1 --2- 172.21.15.112:0/3470282891 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45c01625b0 0x7f45c00b98b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f45bc00c7a0 tx=0x7f45bc00cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:05.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.067+0000 7ff709600640 1 --2- 172.21.15.112:0/4058501126 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff6e406be30 0x7ff6e406e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8034000 tx=0x7ff6f802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:05.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.067+0000 7ff701600640 1 -- 172.21.15.112:0/4058501126 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff6f00567b0 con 0x7ff6fc057830 2024-09-12T02:42:05.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.066+0000 7fb59fe00640 1 --2- 172.21.15.112:0/4136838821 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb58006bf30 0x7fb58006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.067+0000 7f1557400640 1 -- 172.21.15.112:0/21528932 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1550042070 con 0x7f15600b5920 2024-09-12T02:42:05.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.067+0000 7f1557400640 1 -- 172.21.15.112:0/21528932 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1550030980 con 0x7f15600b5920 2024-09-12T02:42:05.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.067+0000 7f1557400640 1 -- 172.21.15.112:0/21528932 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1550037070 con 0x7f15600b5920 2024-09-12T02:42:05.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.068+0000 7f1565e00640 1 -- 172.21.15.112:0/21528932 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15600b3ec0 con 0x7f15600b5920 2024-09-12T02:42:05.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.068+0000 7f1565e00640 1 -- 172.21.15.112:0/21528932 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15600b4480 con 0x7f15600b5920 2024-09-12T02:42:05.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.068+0000 7fb59fe00640 1 --2- 172.21.15.112:0/4136838821 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb58006bf30 0x7fb58006e3f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb598007b50 tx=0x7fb598007aa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:05.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.069+0000 7f9015c00640 1 -- 172.21.15.112:0/2295121785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90100d1a10 con 0x7f90100d5840 2024-09-12T02:42:05.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.069+0000 7f1565e00640 1 -- 172.21.15.112:0/21528932 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f156006c030 con 0x7f15600b5920 2024-09-12T02:42:05.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.069+0000 7f900cc00640 1 -- 172.21.15.112:0/2295121785 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ff803ccd0 con 0x7f90100d5840 2024-09-12T02:42:05.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.070+0000 7fb59cc00640 1 -- 172.21.15.112:0/4136838821 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb58c058ef0 con 0x7fb5a0072c30 2024-09-12T02:42:05.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.070+0000 7f1557400640 1 -- 172.21.15.112:0/21528932 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1550045070 con 0x7f15600b5920 2024-09-12T02:42:05.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.071+0000 7f45ba000640 1 -- 172.21.15.112:0/3470282891 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc003b70 con 0x7f45c01625b0 2024-09-12T02:42:05.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.071+0000 7f45ba000640 1 -- 172.21.15.112:0/3470282891 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45bc003d10 con 0x7f45c01625b0 2024-09-12T02:42:05.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.071+0000 7f45ba000640 1 -- 172.21.15.112:0/3470282891 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc00aa70 con 0x7f45c01625b0 2024-09-12T02:42:05.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.072+0000 7f45c8800640 1 -- 172.21.15.112:0/3470282891 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45c00a21b0 con 0x7f45c01625b0 2024-09-12T02:42:05.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.072+0000 7f45c8800640 1 -- 172.21.15.112:0/3470282891 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45c00c8fa0 con 0x7f45c01625b0 2024-09-12T02:42:05.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.072+0000 7f1557400640 1 --2- 172.21.15.112:0/21528932 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f154006bf00 0x7f154006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.072+0000 7f1557400640 1 -- 172.21.15.112:0/21528932 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f15500ab320 con 0x7f15600b5920 2024-09-12T02:42:05.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.072+0000 7f155e000640 1 --2- 172.21.15.112:0/21528932 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f154006bf00 0x7f154006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.072+0000 7f900cc00640 1 --2- 172.21.15.112:0/2295121785 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8fec06be80 0x7f8fec06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.074+0000 7f155e000640 1 --2- 172.21.15.112:0/21528932 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f154006bf00 0x7f154006e3c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f15601fc370 tx=0x7f154c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:05.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.073+0000 7f45c8800640 1 -- 172.21.15.112:0/3470282891 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45c00d2210 con 0x7f45c01625b0 2024-09-12T02:42:05.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.073+0000 7f900fe00640 1 --2- 172.21.15.112:0/2295121785 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8fec06be80 0x7f8fec06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.073+0000 7f900cc00640 1 -- 172.21.15.112:0/2295121785 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8ff80ab170 con 0x7f90100d5840 2024-09-12T02:42:05.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.074+0000 7ff701600640 1 -- 172.21.15.112:0/4058501126 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff6f0058710 con 0x7ff6fc057830 2024-09-12T02:42:05.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.075+0000 7f900fe00640 1 --2- 172.21.15.112:0/2295121785 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8fec06be80 0x7f8fec06e340 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9000001be0 tx=0x7f9000007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:05.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.075+0000 7f45ba000640 1 -- 172.21.15.112:0/3470282891 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f45bc00ac10 con 0x7f45c01625b0 2024-09-12T02:42:05.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.077+0000 7f45ba000640 1 --2- 172.21.15.112:0/3470282891 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f45a406bf00 0x7f45a406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.077+0000 7f45ba000640 1 -- 172.21.15.112:0/3470282891 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f45bc08ae30 con 0x7f45c01625b0 2024-09-12T02:42:05.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.077+0000 7f45c5e00640 1 --2- 172.21.15.112:0/3470282891 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f45a406bf00 0x7f45a406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.078+0000 7f45c5e00640 1 --2- 172.21.15.112:0/3470282891 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f45a406bf00 0x7f45a406e3c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f45b40011e0 tx=0x7f45b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:05.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.081+0000 7f45ba000640 1 -- 172.21.15.112:0/3470282891 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f45bc0597c0 con 0x7f45c01625b0 2024-09-12T02:42:05.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.081+0000 7f900cc00640 1 -- 172.21.15.112:0/2295121785 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f90101f7f40 con 0x7f90100d5840 2024-09-12T02:42:05.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.090+0000 7f1557400640 1 -- 172.21.15.112:0/21528932 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1550079d40 con 0x7f15600b5920 2024-09-12T02:42:05.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.456+0000 7f3826800640 1 -- 172.21.15.112:0/39719693 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f382006d8c0 con 0x7f382015edb0 2024-09-12T02:42:05.461 INFO:teuthology.orchestra.run.smithi112.stdout:55834574854 2024-09-12T02:42:05.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.457+0000 7f3813400640 1 -- 172.21.15.112:0/39719693 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f380c05d3b0 con 0x7f382015edb0 2024-09-12T02:42:05.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.461+0000 7f3810c00640 1 -- 172.21.15.112:0/39719693 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f380006bf00 msgr2=0x7f380006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.461+0000 7f3810c00640 1 --2- 172.21.15.112:0/39719693 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f380006bf00 0x7f380006e3c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3814000f60 tx=0x7f3814009040 comp rx=0 tx=0).stop 2024-09-12T02:42:05.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.461+0000 7f3810c00640 1 -- 172.21.15.112:0/39719693 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f382015edb0 msgr2=0x7f382015cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.461+0000 7f3810c00640 1 --2- 172.21.15.112:0/39719693 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f382015edb0 0x7f382015cfd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f380c009fd0 tx=0x7f380c00b8e0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.462+0000 7f3810c00640 1 -- 172.21.15.112:0/39719693 shutdown_connections 2024-09-12T02:42:05.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.462+0000 7f3810c00640 1 --2- 172.21.15.112:0/39719693 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f382015edb0 0x7f382015cfd0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.462+0000 7f3810c00640 1 --2- 172.21.15.112:0/39719693 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f380006bf00 0x7f380006e3c0 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3814000f60 tx=0x7f3814009040 comp rx=0 tx=0).stop 2024-09-12T02:42:05.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.462+0000 7f3810c00640 1 --2- 172.21.15.112:0/39719693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38200d57a0 0x7f38201e9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.462+0000 7f3810c00640 1 --2- 172.21.15.112:0/39719693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38200d1640 0x7f38200b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.462+0000 7f3810c00640 1 -- 172.21.15.112:0/39719693 >> 172.21.15.112:0/39719693 conn(0x7f382009df50 msgr2=0x7f38200b9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:05.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.463+0000 7f3810c00640 1 -- 172.21.15.112:0/39719693 shutdown_connections 2024-09-12T02:42:05.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.463+0000 7f3810c00640 1 -- 172.21.15.112:0/39719693 wait complete. 2024-09-12T02:42:05.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.467+0000 7fc99d600640 1 -- 172.21.15.112:0/1709399915 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc9980b3d60 con 0x7fc9980b38e0 2024-09-12T02:42:05.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.467+0000 7fc98ea00640 1 -- 172.21.15.112:0/1709399915 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc99005cc30 con 0x7fc9980b38e0 2024-09-12T02:42:05.468 INFO:teuthology.orchestra.run.smithi112.stdout:55834574854 2024-09-12T02:42:05.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.471+0000 7fc99d600640 1 -- 172.21.15.112:0/1709399915 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc97806be80 msgr2=0x7fc97806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.472+0000 7fc99d600640 1 --2- 172.21.15.112:0/1709399915 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc97806be80 0x7fc97806e340 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc984034000 tx=0x7fc98402e000 comp rx=0 tx=0).stop 2024-09-12T02:42:05.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.472+0000 7fc99d600640 1 -- 172.21.15.112:0/1709399915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9980b38e0 msgr2=0x7fc99814b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.472+0000 7fc99d600640 1 --2- 172.21.15.112:0/1709399915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9980b38e0 0x7fc99814b990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc99000cac0 tx=0x7fc99000cf80 comp rx=0 tx=0).stop 2024-09-12T02:42:05.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.471+0000 7fcce8200640 1 -- 172.21.15.112:0/3168393611 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fcce00b7640 con 0x7fcce0162100 2024-09-12T02:42:05.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.472+0000 7fccdd600640 1 -- 172.21.15.112:0/3168393611 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fccd4059450 con 0x7fcce0162100 2024-09-12T02:42:05.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.472+0000 7fc99d600640 1 -- 172.21.15.112:0/1709399915 shutdown_connections 2024-09-12T02:42:05.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.472+0000 7fc99d600640 1 --2- 172.21.15.112:0/1709399915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc998164200 0x7fc9980ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.472+0000 7fc99d600640 1 --2- 172.21.15.112:0/1709399915 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc99816d710 0x7fc998163cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.472+0000 7fc99d600640 1 --2- 172.21.15.112:0/1709399915 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc97806be80 0x7fc97806e340 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.472+0000 7fc99d600640 1 --2- 172.21.15.112:0/1709399915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9980b38e0 0x7fc99814b990 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.472+0000 7fc99d600640 1 -- 172.21.15.112:0/1709399915 >> 172.21.15.112:0/1709399915 conn(0x7fc99806bbd0 msgr2=0x7fc998072280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:05.474 INFO:teuthology.orchestra.run.smithi112.stdout:55834574854 2024-09-12T02:42:05.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.473+0000 7fc99d600640 1 -- 172.21.15.112:0/1709399915 shutdown_connections 2024-09-12T02:42:05.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.473+0000 7fc99d600640 1 -- 172.21.15.112:0/1709399915 wait complete. 2024-09-12T02:42:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.476+0000 7fcce8200640 1 -- 172.21.15.112:0/3168393611 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fccc006be80 msgr2=0x7fccc006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.476+0000 7fcce8200640 1 --2- 172.21.15.112:0/3168393611 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fccc006be80 0x7fccc006e340 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fccd8007fd0 tx=0x7fccd8009040 comp rx=0 tx=0).stop 2024-09-12T02:42:05.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.476+0000 7fcce8200640 1 -- 172.21.15.112:0/3168393611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcce0162100 msgr2=0x7fcce00b7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.476+0000 7fcce8200640 1 --2- 172.21.15.112:0/3168393611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcce0162100 0x7fcce00b7be0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fccd400e850 tx=0x7fccd400ed10 comp rx=0 tx=0).stop 2024-09-12T02:42:05.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.477+0000 7fb5a7800640 1 -- 172.21.15.112:0/4136838821 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb578005580 con 0x7fb5a0072c30 2024-09-12T02:42:05.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.477+0000 7fcce8200640 1 -- 172.21.15.112:0/3168393611 shutdown_connections 2024-09-12T02:42:05.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.477+0000 7fcce8200640 1 --2- 172.21.15.112:0/3168393611 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcce01624e0 0x7fcce00b8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.477+0000 7fcce8200640 1 --2- 172.21.15.112:0/3168393611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcce0162100 0x7fcce00b7be0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.477+0000 7fcce8200640 1 --2- 172.21.15.112:0/3168393611 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fccc006be80 0x7fccc006e340 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.477+0000 7fcce8200640 1 --2- 172.21.15.112:0/3168393611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcce00d0510 0x7fcce00cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.477+0000 7fcce8200640 1 -- 172.21.15.112:0/3168393611 >> 172.21.15.112:0/3168393611 conn(0x7fcce00d4db0 msgr2=0x7fcce00d1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:05.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.477+0000 7fcce8200640 1 -- 172.21.15.112:0/3168393611 shutdown_connections 2024-09-12T02:42:05.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.477+0000 7fcce8200640 1 -- 172.21.15.112:0/3168393611 wait complete. 2024-09-12T02:42:05.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.479+0000 7fb59cc00640 1 -- 172.21.15.112:0/4136838821 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb58c0587f0 con 0x7fb5a0072c30 2024-09-12T02:42:05.480 INFO:teuthology.orchestra.run.smithi112.stdout:55834574854 2024-09-12T02:42:05.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.485+0000 7fb5a7800640 1 -- 172.21.15.112:0/4136838821 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb58006bf30 msgr2=0x7fb58006e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.485+0000 7fb5a7800640 1 --2- 172.21.15.112:0/4136838821 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb58006bf30 0x7fb58006e3f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb598007b50 tx=0x7fb598007aa0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.485+0000 7fb5a7800640 1 -- 172.21.15.112:0/4136838821 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5a0072c30 msgr2=0x7fb5a0151ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.485+0000 7fb5a7800640 1 --2- 172.21.15.112:0/4136838821 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5a0072c30 0x7fb5a0151ec0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb58c00c3a0 tx=0x7fb58c00c860 comp rx=0 tx=0).stop 2024-09-12T02:42:05.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.485+0000 7fb5a7800640 1 -- 172.21.15.112:0/4136838821 shutdown_connections 2024-09-12T02:42:05.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.485+0000 7fb5a7800640 1 --2- 172.21.15.112:0/4136838821 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb58006bf30 0x7fb58006e3f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.485+0000 7fb5a7800640 1 --2- 172.21.15.112:0/4136838821 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5a015c9d0 0x7fb5a01f4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.485+0000 7fb5a7800640 1 --2- 172.21.15.112:0/4136838821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a015be40 0x7fb5a014a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.485+0000 7fb5a7800640 1 --2- 172.21.15.112:0/4136838821 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5a0072c30 0x7fb5a0151ec0 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb58c00c3a0 tx=0x7fb58c00c860 comp rx=0 tx=0).stop 2024-09-12T02:42:05.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.485+0000 7fb5a7800640 1 -- 172.21.15.112:0/4136838821 >> 172.21.15.112:0/4136838821 conn(0x7fb5a00b3000 msgr2=0x7fb5a00b4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:05.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.486+0000 7fb5a7800640 1 -- 172.21.15.112:0/4136838821 shutdown_connections 2024-09-12T02:42:05.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.486+0000 7fb5a7800640 1 -- 172.21.15.112:0/4136838821 wait complete. 2024-09-12T02:42:05.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2024-09-12T02:42:05.489 DEBUG:teuthology.parallel:result is None 2024-09-12T02:42:05.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.490+0000 7f45c8800640 1 -- 172.21.15.112:0/3470282891 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f45c006d4c0 con 0x7f45c01625b0 2024-09-12T02:42:05.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.491+0000 7f45ba000640 1 -- 172.21.15.112:0/3470282891 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f45bc0590c0 con 0x7f45c01625b0 2024-09-12T02:42:05.492 INFO:teuthology.orchestra.run.smithi112.stdout:55834574854 2024-09-12T02:42:05.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.493+0000 7ff70aa00640 1 -- 172.21.15.112:0/4058501126 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff6e0005850 con 0x7ff6fc057830 2024-09-12T02:42:05.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.494+0000 7ff701600640 1 -- 172.21.15.112:0/4058501126 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff6f005ca10 con 0x7ff6fc057830 2024-09-12T02:42:05.495 INFO:teuthology.orchestra.run.smithi112.stdout:55834574854 2024-09-12T02:42:05.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.494+0000 7f45c8800640 1 -- 172.21.15.112:0/3470282891 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f45a406bf00 msgr2=0x7f45a406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.494+0000 7f45c8800640 1 --2- 172.21.15.112:0/3470282891 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f45a406bf00 0x7f45a406e3c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f45b40011e0 tx=0x7f45b4009040 comp rx=0 tx=0).stop 2024-09-12T02:42:05.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.494+0000 7f45c8800640 1 -- 172.21.15.112:0/3470282891 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45c01625b0 msgr2=0x7f45c00b98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.494+0000 7f45c8800640 1 --2- 172.21.15.112:0/3470282891 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45c01625b0 0x7f45c00b98b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f45bc00c7a0 tx=0x7f45bc00cc60 comp rx=0 tx=0).stop 2024-09-12T02:42:05.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.495+0000 7f45c8800640 1 -- 172.21.15.112:0/3470282891 shutdown_connections 2024-09-12T02:42:05.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.495+0000 7f45c8800640 1 --2- 172.21.15.112:0/3470282891 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f45a406bf00 0x7f45a406e3c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.495+0000 7f45c8800640 1 --2- 172.21.15.112:0/3470282891 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45c01625b0 0x7f45c00b98b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.495+0000 7f45c8800640 1 --2- 172.21.15.112:0/3470282891 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45c00d1520 0x7f45c00a1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.495+0000 7f45c8800640 1 --2- 172.21.15.112:0/3470282891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45c00b8410 0x7f45c00cb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.495+0000 7f45c8800640 1 -- 172.21.15.112:0/3470282891 >> 172.21.15.112:0/3470282891 conn(0x7f45c009e0d0 msgr2=0x7f45c00d4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:05.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.495+0000 7f45c8800640 1 -- 172.21.15.112:0/3470282891 shutdown_connections 2024-09-12T02:42:05.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.495+0000 7f45c8800640 1 -- 172.21.15.112:0/3470282891 wait complete. 2024-09-12T02:42:05.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.498+0000 7ff70aa00640 1 -- 172.21.15.112:0/4058501126 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff6e406be30 msgr2=0x7ff6e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.498+0000 7ff70aa00640 1 --2- 172.21.15.112:0/4058501126 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff6e406be30 0x7ff6e406e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8034000 tx=0x7ff6f802e000 comp rx=0 tx=0).stop 2024-09-12T02:42:05.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.498+0000 7ff70aa00640 1 -- 172.21.15.112:0/4058501126 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6fc057830 msgr2=0x7ff6fc050b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.498+0000 7ff70aa00640 1 --2- 172.21.15.112:0/4058501126 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6fc057830 0x7ff6fc050b50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0565b0 tx=0x7ff6f000cbe0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.499+0000 7ff70aa00640 1 -- 172.21.15.112:0/4058501126 shutdown_connections 2024-09-12T02:42:05.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.499+0000 7ff70aa00640 1 --2- 172.21.15.112:0/4058501126 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6fc0e28f0 0x7ff6fc051090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.499+0000 7ff70aa00640 1 --2- 172.21.15.112:0/4058501126 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff6e406be30 0x7ff6e406e2f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.499+0000 7ff70aa00640 1 --2- 172.21.15.112:0/4058501126 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6fc057830 0x7ff6fc050b50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.499+0000 7ff70aa00640 1 --2- 172.21.15.112:0/4058501126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6fc03bc60 0x7ff6fc0e5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.499+0000 7ff70aa00640 1 -- 172.21.15.112:0/4058501126 >> 172.21.15.112:0/4058501126 conn(0x7ff6fc03a520 msgr2=0x7ff6fc03dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:05.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.499+0000 7ff70aa00640 1 -- 172.21.15.112:0/4058501126 shutdown_connections 2024-09-12T02:42:05.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.499+0000 7ff70aa00640 1 -- 172.21.15.112:0/4058501126 wait complete. 2024-09-12T02:42:05.503 INFO:teuthology.orchestra.run.smithi112.stdout:55834574854 2024-09-12T02:42:05.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.497+0000 7f9015c00640 1 -- 172.21.15.112:0/2295121785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f90100d51a0 con 0x7f90100d5840 2024-09-12T02:42:05.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.498+0000 7f900cc00640 1 -- 172.21.15.112:0/2295121785 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8ff8046360 con 0x7f90100d5840 2024-09-12T02:42:05.505 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2024-09-12T02:42:05.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.501+0000 7f9015c00640 1 -- 172.21.15.112:0/2295121785 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8fec06be80 msgr2=0x7f8fec06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.505 DEBUG:teuthology.parallel:result is None 2024-09-12T02:42:05.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.501+0000 7f1565e00640 1 -- 172.21.15.112:0/21528932 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f15600d2380 con 0x7f15600b5920 2024-09-12T02:42:05.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.501+0000 7f9015c00640 1 --2- 172.21.15.112:0/2295121785 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8fec06be80 0x7f8fec06e340 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9000001be0 tx=0x7f9000007d50 comp rx=0 tx=0).stop 2024-09-12T02:42:05.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.501+0000 7f9015c00640 1 -- 172.21.15.112:0/2295121785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90100d5840 msgr2=0x7f90101f5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.501+0000 7f9015c00640 1 --2- 172.21.15.112:0/2295121785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90100d5840 0x7f90101f5cb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80098f0 tx=0x7f8ff80046c0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.502+0000 7f9015c00640 1 -- 172.21.15.112:0/2295121785 shutdown_connections 2024-09-12T02:42:05.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.502+0000 7f1557400640 1 -- 172.21.15.112:0/21528932 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1550079640 con 0x7f15600b5920 2024-09-12T02:42:05.507 INFO:teuthology.orchestra.run.smithi112.stdout:55834574854 2024-09-12T02:42:05.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.502+0000 7f9015c00640 1 --2- 172.21.15.112:0/2295121785 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9010161f70 0x7f90101f8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.502+0000 7f9015c00640 1 --2- 172.21.15.112:0/2295121785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90100d5840 0x7f90101f5cb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.502+0000 7f9015c00640 1 --2- 172.21.15.112:0/2295121785 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8fec06be80 0x7f8fec06e340 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.502+0000 7f9015c00640 1 --2- 172.21.15.112:0/2295121785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90100d1630 0x7f90101f7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.502+0000 7f9015c00640 1 -- 172.21.15.112:0/2295121785 >> 172.21.15.112:0/2295121785 conn(0x7f90100d4d20 msgr2=0x7f90100d3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:05.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.502+0000 7f9015c00640 1 -- 172.21.15.112:0/2295121785 shutdown_connections 2024-09-12T02:42:05.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.502+0000 7f9015c00640 1 -- 172.21.15.112:0/2295121785 wait complete. 2024-09-12T02:42:05.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-09-12T02:42:05.510 DEBUG:teuthology.parallel:result is None 2024-09-12T02:42:05.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.505+0000 7f1565e00640 1 -- 172.21.15.112:0/21528932 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f154006bf00 msgr2=0x7f154006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.505+0000 7f1565e00640 1 --2- 172.21.15.112:0/21528932 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f154006bf00 0x7f154006e3c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f15601fc370 tx=0x7f154c008040 comp rx=0 tx=0).stop 2024-09-12T02:42:05.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.506+0000 7f1565e00640 1 -- 172.21.15.112:0/21528932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15600b5920 msgr2=0x7f15601e8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.506+0000 7f1565e00640 1 --2- 172.21.15.112:0/21528932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15600b5920 0x7f15601e8520 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f15500090b0 tx=0x7f15500046c0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.506+0000 7f1565e00640 1 -- 172.21.15.112:0/21528932 shutdown_connections 2024-09-12T02:42:05.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.506+0000 7f1565e00640 1 --2- 172.21.15.112:0/21528932 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f154006bf00 0x7f154006e3c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.506+0000 7f1565e00640 1 --2- 172.21.15.112:0/21528932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15600d3650 0x7f15600b36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.506+0000 7f1565e00640 1 --2- 172.21.15.112:0/21528932 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15600d3270 0x7f15600cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.506+0000 7f1565e00640 1 --2- 172.21.15.112:0/21528932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15600b5920 0x7f15601e8520 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.506+0000 7f1565e00640 1 -- 172.21.15.112:0/21528932 >> 172.21.15.112:0/21528932 conn(0x7f15600d4db0 msgr2=0x7f15600b7be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:05.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.506+0000 7f1565e00640 1 -- 172.21.15.112:0/21528932 shutdown_connections 2024-09-12T02:42:05.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.506+0000 7f1565e00640 1 -- 172.21.15.112:0/21528932 wait complete. 2024-09-12T02:42:05.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-09-12T02:42:05.515 DEBUG:teuthology.parallel:result is None 2024-09-12T02:42:05.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-09-12T02:42:05.519 DEBUG:teuthology.parallel:result is None 2024-09-12T02:42:05.522 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2024-09-12T02:42:05.522 DEBUG:teuthology.parallel:result is None 2024-09-12T02:42:05.523 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2024-09-12T02:42:05.523 DEBUG:teuthology.parallel:result is None 2024-09-12T02:42:05.525 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2024-09-12T02:42:05.525 DEBUG:teuthology.parallel:result is None 2024-09-12T02:42:05.525 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:42:05.525 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:42:05.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.716+0000 7ff2b1e00640 1 Processor -- start 2024-09-12T02:42:05.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.717+0000 7ff2b1e00640 1 -- start start 2024-09-12T02:42:05.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.718+0000 7ff2b1e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff2ac06f600 0x7ff2ac0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.718+0000 7ff2b1e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff2ac0b45d0 0x7ff2ac0728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.718+0000 7ff2b1e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2ac0b4a20 con 0x7ff2ac15b9d0 2024-09-12T02:42:05.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.718+0000 7ff2b1e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff2ac0b54a0 con 0x7ff2ac0b45d0 2024-09-12T02:42:05.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.718+0000 7ff2b1e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff2ac0b3af0 con 0x7ff2ac06f600 2024-09-12T02:42:05.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.718+0000 7ff2ab400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff2ac0b45d0 0x7ff2ac0728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.718+0000 7ff2ab400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff2ac0b45d0 0x7ff2ac0728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57804/0 (socket says 172.21.15.112:57804) 2024-09-12T02:42:05.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.718+0000 7ff2ab400640 1 -- 172.21.15.112:0/2762286141 learned_addr learned my addr 172.21.15.112:0/2762286141 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:05.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.718+0000 7ff2aa000640 1 --2- 172.21.15.112:0/2762286141 >> v2:172.21.15.137:3300/0 conn(0x7ff2ac06f600 0x7ff2ac0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.718+0000 7ff2ab400640 1 -- 172.21.15.112:0/2762286141 >> v2:172.21.15.137:3300/0 conn(0x7ff2ac06f600 msgr2=0x7ff2ac0b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:05.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.718+0000 7ff2ab400640 1 --2- 172.21.15.112:0/2762286141 >> v2:172.21.15.137:3300/0 conn(0x7ff2ac06f600 0x7ff2ac0b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.719+0000 7ff2ab400640 1 -- 172.21.15.112:0/2762286141 >> v1:172.21.15.137:6789/0 conn(0x7ff2ac15b9d0 legacy=0x7ff2ac06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.719+0000 7ff2ab400640 1 -- 172.21.15.112:0/2762286141 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2ac0b3dd0 con 0x7ff2ac0b45d0 2024-09-12T02:42:05.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.719+0000 7ff2ab400640 1 --2- 172.21.15.112:0/2762286141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2ac0b45d0 0x7ff2ac0728c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac071200 tx=0x7ff2a402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=999ef6b0403209a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:05.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.720+0000 7ff2a9600640 1 -- 172.21.15.112:0/2762286141 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a4036070 con 0x7ff2ac0b45d0 2024-09-12T02:42:05.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.720+0000 7ff2a9600640 1 -- 172.21.15.112:0/2762286141 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2a4031600 con 0x7ff2ac0b45d0 2024-09-12T02:42:05.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.720+0000 7ff2a9600640 1 -- 172.21.15.112:0/2762286141 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a40319d0 con 0x7ff2ac0b45d0 2024-09-12T02:42:05.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.720+0000 7ff2b1e00640 1 -- 172.21.15.112:0/2762286141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2ac0b45d0 msgr2=0x7ff2ac0728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.720+0000 7ff2b1e00640 1 --2- 172.21.15.112:0/2762286141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2ac0b45d0 0x7ff2ac0728c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac071200 tx=0x7ff2a402a6a0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.720+0000 7ff2b1e00640 1 -- 172.21.15.112:0/2762286141 shutdown_connections 2024-09-12T02:42:05.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.720+0000 7ff2b1e00640 1 --2- 172.21.15.112:0/2762286141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2ac0b45d0 0x7ff2ac0728c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.720+0000 7ff2b1e00640 1 --2- 172.21.15.112:0/2762286141 >> v2:172.21.15.137:3300/0 conn(0x7ff2ac06f600 0x7ff2ac0b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.720+0000 7ff2b1e00640 1 -- 172.21.15.112:0/2762286141 >> 172.21.15.112:0/2762286141 conn(0x7ff2ac06bbd0 msgr2=0x7ff2ac06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:05.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.720+0000 7ff2b1e00640 1 -- 172.21.15.112:0/2762286141 shutdown_connections 2024-09-12T02:42:05.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.720+0000 7ff2b1e00640 1 -- 172.21.15.112:0/2762286141 wait complete. 2024-09-12T02:42:05.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.722+0000 7ff2b1e00640 1 Processor -- start 2024-09-12T02:42:05.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.722+0000 7ff2b1e00640 1 -- start start 2024-09-12T02:42:05.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.723+0000 7ff2b1e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2ac06f600 0x7ff2ac1f97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.723+0000 7ff2b1e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2ac0b45d0 0x7ff2ac1f50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.723+0000 7ff2b1e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2ac15b9d0 0x7ff2ac150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.723+0000 7ff2b1e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ac15bf30 con 0x7ff2ac15b9d0 2024-09-12T02:42:05.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.723+0000 7ff2b1e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ac15bdb0 con 0x7ff2ac0b45d0 2024-09-12T02:42:05.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.723+0000 7ff2b1e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff2ac0cdcd0 con 0x7ff2ac06f600 2024-09-12T02:42:05.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.723+0000 7ff2ab400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2ac15b9d0 0x7ff2ac150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.723+0000 7ff2aa000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2ac0b45d0 0x7ff2ac1f50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.723+0000 7ff2ab400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2ac15b9d0 0x7ff2ac150080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57820/0 (socket says 172.21.15.112:57820) 2024-09-12T02:42:05.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.723+0000 7ff2ab400640 1 -- 172.21.15.112:0/2740066152 learned_addr learned my addr 172.21.15.112:0/2740066152 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:05.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.723+0000 7ff2aaa00640 1 --2- 172.21.15.112:0/2740066152 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2ac06f600 0x7ff2ac1f97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.724+0000 7ff2ab400640 1 -- 172.21.15.112:0/2740066152 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2ac06f600 msgr2=0x7ff2ac1f97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.724+0000 7ff2ab400640 1 --2- 172.21.15.112:0/2740066152 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2ac06f600 0x7ff2ac1f97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.724+0000 7ff2ab400640 1 -- 172.21.15.112:0/2740066152 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2ac0b45d0 msgr2=0x7ff2ac1f50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.724+0000 7ff2ab400640 1 --2- 172.21.15.112:0/2740066152 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2ac0b45d0 0x7ff2ac1f50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.724+0000 7ff2ab400640 1 -- 172.21.15.112:0/2740066152 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2ac1f8d40 con 0x7ff2ac15b9d0 2024-09-12T02:42:05.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.724+0000 7ff2aa000640 1 --2- 172.21.15.112:0/2740066152 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2ac0b45d0 0x7ff2ac1f50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:05.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.724+0000 7ff2ab400640 1 --2- 172.21.15.112:0/2740066152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2ac15b9d0 0x7ff2ac150080 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4009f40 tx=0x7ff2a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:05.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.724+0000 7ff2a3400640 1 -- 172.21.15.112:0/2740066152 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a4036050 con 0x7ff2ac15b9d0 2024-09-12T02:42:05.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.724+0000 7ff2a3400640 1 -- 172.21.15.112:0/2740066152 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2a4042070 con 0x7ff2ac15b9d0 2024-09-12T02:42:05.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.724+0000 7ff2b1e00640 1 -- 172.21.15.112:0/2740066152 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2ac0affb0 con 0x7ff2ac15b9d0 2024-09-12T02:42:05.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.724+0000 7ff2a3400640 1 -- 172.21.15.112:0/2740066152 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a4009510 con 0x7ff2ac15b9d0 2024-09-12T02:42:05.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.725+0000 7ff2b1e00640 1 -- 172.21.15.112:0/2740066152 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2ac0b0290 con 0x7ff2ac15b9d0 2024-09-12T02:42:05.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.726+0000 7ff2b1e00640 1 -- 172.21.15.112:0/2740066152 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2ac068a30 con 0x7ff2ac15b9d0 2024-09-12T02:42:05.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.726+0000 7ff2a3400640 1 -- 172.21.15.112:0/2740066152 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff2a4007bd0 con 0x7ff2ac15b9d0 2024-09-12T02:42:05.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.727+0000 7ff2a3400640 1 --2- 172.21.15.112:0/2740066152 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff28c06be60 0x7ff28c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:05.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.727+0000 7ff2a3400640 1 -- 172.21.15.112:0/2740066152 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff2a40abbd0 con 0x7ff2ac15b9d0 2024-09-12T02:42:05.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.728+0000 7ff2aaa00640 1 --2- 172.21.15.112:0/2740066152 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff28c06be60 0x7ff28c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:05.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.728+0000 7ff2aaa00640 1 --2- 172.21.15.112:0/2740066152 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff28c06be60 0x7ff28c06e320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac150810 tx=0x7ff29c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:05.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.732+0000 7ff2a3400640 1 -- 172.21.15.112:0/2740066152 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff2a4079e90 con 0x7ff2ac15b9d0 2024-09-12T02:42:05.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.902+0000 7ff2b1e00640 1 -- 172.21.15.112:0/2740066152 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff2ac1505c0 con 0x7ff28c06be60 2024-09-12T02:42:05.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.907+0000 7ff2a3400640 1 -- 172.21.15.112:0/2740066152 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247486 (secure 0 0 0) 0x7ff2ac1505c0 con 0x7ff28c06be60 2024-09-12T02:42:05.910 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:42:05.913 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:42:05.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.913+0000 7ff2b1e00640 1 -- 172.21.15.112:0/2740066152 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff28c06be60 msgr2=0x7ff28c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.913+0000 7ff2b1e00640 1 --2- 172.21.15.112:0/2740066152 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff28c06be60 0x7ff28c06e320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac150810 tx=0x7ff29c009040 comp rx=0 tx=0).stop 2024-09-12T02:42:05.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.913+0000 7ff2b1e00640 1 -- 172.21.15.112:0/2740066152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2ac15b9d0 msgr2=0x7ff2ac150080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:05.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.913+0000 7ff2b1e00640 1 --2- 172.21.15.112:0/2740066152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2ac15b9d0 0x7ff2ac150080 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4009f40 tx=0x7ff2a4004a40 comp rx=0 tx=0).stop 2024-09-12T02:42:05.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.913+0000 7ff2b1e00640 1 -- 172.21.15.112:0/2740066152 shutdown_connections 2024-09-12T02:42:05.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.913+0000 7ff2b1e00640 1 --2- 172.21.15.112:0/2740066152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2ac15b9d0 0x7ff2ac150080 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.913+0000 7ff2b1e00640 1 --2- 172.21.15.112:0/2740066152 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff28c06be60 0x7ff28c06e320 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.913+0000 7ff2b1e00640 1 --2- 172.21.15.112:0/2740066152 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2ac0b45d0 0x7ff2ac1f50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.913+0000 7ff2b1e00640 1 --2- 172.21.15.112:0/2740066152 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2ac06f600 0x7ff2ac1f97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:05.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.913+0000 7ff2b1e00640 1 -- 172.21.15.112:0/2740066152 >> 172.21.15.112:0/2740066152 conn(0x7ff2ac06bbd0 msgr2=0x7ff2ac0b56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:05.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.913+0000 7ff2b1e00640 1 -- 172.21.15.112:0/2740066152 shutdown_connections 2024-09-12T02:42:05.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:05.913+0000 7ff2b1e00640 1 -- 172.21.15.112:0/2740066152 wait complete. 2024-09-12T02:42:05.929 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-12T02:42:04.963606+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560789,"statfs":{"total":1600000000,"available":1598248252,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.186991"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078585+0000","last_change":"2024-09-12T02:41:53.797392+0000","last_active":"2024-09-12T02:41:55.078585+0000","last_peered":"2024-09-12T02:41:55.078585+0000","last_clean":"2024-09-12T02:41:55.078585+0000","last_became_active":"2024-09-12T02:41:53.797125+0000","last_became_peered":"2024-09-12T02:41:53.797125+0000","last_unstale":"2024-09-12T02:41:55.078585+0000","last_undegraded":"2024-09-12T02:41:55.078585+0000","last_fullsized":"2024-09-12T02:41:55.078585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:13.937351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807042+0000","last_change":"2024-09-12T02:41:53.788184+0000","last_active":"2024-09-12T02:41:54.807042+0000","last_peered":"2024-09-12T02:41:54.807042+0000","last_clean":"2024-09-12T02:41:54.807042+0000","last_became_active":"2024-09-12T02:41:53.787657+0000","last_became_peered":"2024-09-12T02:41:53.787657+0000","last_unstale":"2024-09-12T02:41:54.807042+0000","last_undegraded":"2024-09-12T02:41:54.807042+0000","last_fullsized":"2024-09-12T02:41:54.807042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:00.508038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077174+0000","last_change":"2024-09-12T02:41:53.784382+0000","last_active":"2024-09-12T02:41:55.077174+0000","last_peered":"2024-09-12T02:41:55.077174+0000","last_clean":"2024-09-12T02:41:55.077174+0000","last_became_active":"2024-09-12T02:41:53.783794+0000","last_became_peered":"2024-09-12T02:41:53.783794+0000","last_unstale":"2024-09-12T02:41:55.077174+0000","last_undegraded":"2024-09-12T02:41:55.077174+0000","last_fullsized":"2024-09-12T02:41:55.077174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:39.931644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077555+0000","last_change":"2024-09-12T02:41:53.802556+0000","last_active":"2024-09-12T02:41:55.077555+0000","last_peered":"2024-09-12T02:41:55.077555+0000","last_clean":"2024-09-12T02:41:55.077555+0000","last_became_active":"2024-09-12T02:41:53.800988+0000","last_became_peered":"2024-09-12T02:41:53.800988+0000","last_unstale":"2024-09-12T02:41:55.077555+0000","last_undegraded":"2024-09-12T02:41:55.077555+0000","last_fullsized":"2024-09-12T02:41:55.077555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:30.535176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078189+0000","last_change":"2024-09-12T02:41:53.797970+0000","last_active":"2024-09-12T02:41:55.078189+0000","last_peered":"2024-09-12T02:41:55.078189+0000","last_clean":"2024-09-12T02:41:55.078189+0000","last_became_active":"2024-09-12T02:41:53.797733+0000","last_became_peered":"2024-09-12T02:41:53.797733+0000","last_unstale":"2024-09-12T02:41:55.078189+0000","last_undegraded":"2024-09-12T02:41:55.078189+0000","last_fullsized":"2024-09-12T02:41:55.078189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:17.074361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077537+0000","last_change":"2024-09-12T02:41:53.791772+0000","last_active":"2024-09-12T02:41:55.077537+0000","last_peered":"2024-09-12T02:41:55.077537+0000","last_clean":"2024-09-12T02:41:55.077537+0000","last_became_active":"2024-09-12T02:41:53.791424+0000","last_became_peered":"2024-09-12T02:41:53.791424+0000","last_unstale":"2024-09-12T02:41:55.077537+0000","last_undegraded":"2024-09-12T02:41:55.077537+0000","last_fullsized":"2024-09-12T02:41:55.077537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:25.569705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077547+0000","last_change":"2024-09-12T02:41:53.793680+0000","last_active":"2024-09-12T02:41:55.077547+0000","last_peered":"2024-09-12T02:41:55.077547+0000","last_clean":"2024-09-12T02:41:55.077547+0000","last_became_active":"2024-09-12T02:41:53.793368+0000","last_became_peered":"2024-09-12T02:41:53.793368+0000","last_unstale":"2024-09-12T02:41:55.077547+0000","last_undegraded":"2024-09-12T02:41:55.077547+0000","last_fullsized":"2024-09-12T02:41:55.077547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:22.379829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778606+0000","last_change":"2024-09-12T02:41:53.792905+0000","last_active":"2024-09-12T02:41:54.778606+0000","last_peered":"2024-09-12T02:41:54.778606+0000","last_clean":"2024-09-12T02:41:54.778606+0000","last_became_active":"2024-09-12T02:41:53.792671+0000","last_became_peered":"2024-09-12T02:41:53.792671+0000","last_unstale":"2024-09-12T02:41:54.778606+0000","last_undegraded":"2024-09-12T02:41:54.778606+0000","last_fullsized":"2024-09-12T02:41:54.778606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:00:54.016660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077148+0000","last_change":"2024-09-12T02:41:53.796393+0000","last_active":"2024-09-12T02:41:55.077148+0000","last_peered":"2024-09-12T02:41:55.077148+0000","last_clean":"2024-09-12T02:41:55.077148+0000","last_became_active":"2024-09-12T02:41:53.793674+0000","last_became_peered":"2024-09-12T02:41:53.793674+0000","last_unstale":"2024-09-12T02:41:55.077148+0000","last_undegraded":"2024-09-12T02:41:55.077148+0000","last_fullsized":"2024-09-12T02:41:55.077148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:54.885587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778956+0000","last_change":"2024-09-12T02:41:53.790533+0000","last_active":"2024-09-12T02:41:54.778956+0000","last_peered":"2024-09-12T02:41:54.778956+0000","last_clean":"2024-09-12T02:41:54.778956+0000","last_became_active":"2024-09-12T02:41:53.790257+0000","last_became_peered":"2024-09-12T02:41:53.790257+0000","last_unstale":"2024-09-12T02:41:54.778956+0000","last_undegraded":"2024-09-12T02:41:54.778956+0000","last_fullsized":"2024-09-12T02:41:54.778956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:36.766374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778448+0000","last_change":"2024-09-12T02:41:53.791181+0000","last_active":"2024-09-12T02:41:54.778448+0000","last_peered":"2024-09-12T02:41:54.778448+0000","last_clean":"2024-09-12T02:41:54.778448+0000","last_became_active":"2024-09-12T02:41:53.790949+0000","last_became_peered":"2024-09-12T02:41:53.790949+0000","last_unstale":"2024-09-12T02:41:54.778448+0000","last_undegraded":"2024-09-12T02:41:54.778448+0000","last_fullsized":"2024-09-12T02:41:54.778448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:00.547705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.777369+0000","last_change":"2024-09-12T02:41:53.798287+0000","last_active":"2024-09-12T02:41:54.777369+0000","last_peered":"2024-09-12T02:41:54.777369+0000","last_clean":"2024-09-12T02:41:54.777369+0000","last_became_active":"2024-09-12T02:41:53.793517+0000","last_became_peered":"2024-09-12T02:41:53.793517+0000","last_unstale":"2024-09-12T02:41:54.777369+0000","last_undegraded":"2024-09-12T02:41:54.777369+0000","last_fullsized":"2024-09-12T02:41:54.777369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:38.907340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778829+0000","last_change":"2024-09-12T02:41:53.789083+0000","last_active":"2024-09-12T02:41:54.778829+0000","last_peered":"2024-09-12T02:41:54.778829+0000","last_clean":"2024-09-12T02:41:54.778829+0000","last_became_active":"2024-09-12T02:41:53.788859+0000","last_became_peered":"2024-09-12T02:41:53.788859+0000","last_unstale":"2024-09-12T02:41:54.778829+0000","last_undegraded":"2024-09-12T02:41:54.778829+0000","last_fullsized":"2024-09-12T02:41:54.778829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:11.768330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.076853+0000","last_change":"2024-09-12T02:41:53.786959+0000","last_active":"2024-09-12T02:41:55.076853+0000","last_peered":"2024-09-12T02:41:55.076853+0000","last_clean":"2024-09-12T02:41:55.076853+0000","last_became_active":"2024-09-12T02:41:53.786741+0000","last_became_peered":"2024-09-12T02:41:53.786741+0000","last_unstale":"2024-09-12T02:41:55.076853+0000","last_undegraded":"2024-09-12T02:41:55.076853+0000","last_fullsized":"2024-09-12T02:41:55.076853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:01.095924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807133+0000","last_change":"2024-09-12T02:41:53.790655+0000","last_active":"2024-09-12T02:41:54.807133+0000","last_peered":"2024-09-12T02:41:54.807133+0000","last_clean":"2024-09-12T02:41:54.807133+0000","last_became_active":"2024-09-12T02:41:53.789451+0000","last_became_peered":"2024-09-12T02:41:53.789451+0000","last_unstale":"2024-09-12T02:41:54.807133+0000","last_undegraded":"2024-09-12T02:41:54.807133+0000","last_fullsized":"2024-09-12T02:41:54.807133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:46.250242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077369+0000","last_change":"2024-09-12T02:41:53.787343+0000","last_active":"2024-09-12T02:41:55.077369+0000","last_peered":"2024-09-12T02:41:55.077369+0000","last_clean":"2024-09-12T02:41:55.077369+0000","last_became_active":"2024-09-12T02:41:53.787093+0000","last_became_peered":"2024-09-12T02:41:53.787093+0000","last_unstale":"2024-09-12T02:41:55.077369+0000","last_undegraded":"2024-09-12T02:41:55.077369+0000","last_fullsized":"2024-09-12T02:41:55.077369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:22.694954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077436+0000","last_change":"2024-09-12T02:41:53.799488+0000","last_active":"2024-09-12T02:41:55.077436+0000","last_peered":"2024-09-12T02:41:55.077436+0000","last_clean":"2024-09-12T02:41:55.077436+0000","last_became_active":"2024-09-12T02:41:53.798618+0000","last_became_peered":"2024-09-12T02:41:53.798618+0000","last_unstale":"2024-09-12T02:41:55.077436+0000","last_undegraded":"2024-09-12T02:41:55.077436+0000","last_fullsized":"2024-09-12T02:41:55.077436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:32.649809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.076898+0000","last_change":"2024-09-12T02:41:53.786850+0000","last_active":"2024-09-12T02:41:55.076898+0000","last_peered":"2024-09-12T02:41:55.076898+0000","last_clean":"2024-09-12T02:41:55.076898+0000","last_became_active":"2024-09-12T02:41:53.786615+0000","last_became_peered":"2024-09-12T02:41:53.786615+0000","last_unstale":"2024-09-12T02:41:55.076898+0000","last_undegraded":"2024-09-12T02:41:55.076898+0000","last_fullsized":"2024-09-12T02:41:55.076898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:21.015757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077473+0000","last_change":"2024-09-12T02:41:53.794425+0000","last_active":"2024-09-12T02:41:55.077473+0000","last_peered":"2024-09-12T02:41:55.077473+0000","last_clean":"2024-09-12T02:41:55.077473+0000","last_became_active":"2024-09-12T02:41:53.793319+0000","last_became_peered":"2024-09-12T02:41:53.793319+0000","last_unstale":"2024-09-12T02:41:55.077473+0000","last_undegraded":"2024-09-12T02:41:55.077473+0000","last_fullsized":"2024-09-12T02:41:55.077473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:04.162670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779169+0000","last_change":"2024-09-12T02:41:53.795094+0000","last_active":"2024-09-12T02:41:54.779169+0000","last_peered":"2024-09-12T02:41:54.779169+0000","last_clean":"2024-09-12T02:41:54.779169+0000","last_became_active":"2024-09-12T02:41:53.794841+0000","last_became_peered":"2024-09-12T02:41:53.794841+0000","last_unstale":"2024-09-12T02:41:54.779169+0000","last_undegraded":"2024-09-12T02:41:54.779169+0000","last_fullsized":"2024-09-12T02:41:54.779169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:58.970487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077484+0000","last_change":"2024-09-12T02:41:53.794039+0000","last_active":"2024-09-12T02:41:55.077484+0000","last_peered":"2024-09-12T02:41:55.077484+0000","last_clean":"2024-09-12T02:41:55.077484+0000","last_became_active":"2024-09-12T02:41:53.793709+0000","last_became_peered":"2024-09-12T02:41:53.793709+0000","last_unstale":"2024-09-12T02:41:55.077484+0000","last_undegraded":"2024-09-12T02:41:55.077484+0000","last_fullsized":"2024-09-12T02:41:55.077484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:53:04.907858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077745+0000","last_change":"2024-09-12T02:41:53.799240+0000","last_active":"2024-09-12T02:41:55.077745+0000","last_peered":"2024-09-12T02:41:55.077745+0000","last_clean":"2024-09-12T02:41:55.077745+0000","last_became_active":"2024-09-12T02:41:53.798310+0000","last_became_peered":"2024-09-12T02:41:53.798310+0000","last_unstale":"2024-09-12T02:41:55.077745+0000","last_undegraded":"2024-09-12T02:41:55.077745+0000","last_fullsized":"2024-09-12T02:41:55.077745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:28.511208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779010+0000","last_change":"2024-09-12T02:41:53.797034+0000","last_active":"2024-09-12T02:41:54.779010+0000","last_peered":"2024-09-12T02:41:54.779010+0000","last_clean":"2024-09-12T02:41:54.779010+0000","last_became_active":"2024-09-12T02:41:53.796810+0000","last_became_peered":"2024-09-12T02:41:53.796810+0000","last_unstale":"2024-09-12T02:41:54.779010+0000","last_undegraded":"2024-09-12T02:41:54.779010+0000","last_fullsized":"2024-09-12T02:41:54.779010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:33.181523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077704+0000","last_change":"2024-09-12T02:41:53.801270+0000","last_active":"2024-09-12T02:41:55.077704+0000","last_peered":"2024-09-12T02:41:55.077704+0000","last_clean":"2024-09-12T02:41:55.077704+0000","last_became_active":"2024-09-12T02:41:53.798339+0000","last_became_peered":"2024-09-12T02:41:53.798339+0000","last_unstale":"2024-09-12T02:41:55.077704+0000","last_undegraded":"2024-09-12T02:41:55.077704+0000","last_fullsized":"2024-09-12T02:41:55.077704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:09.271851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778820+0000","last_change":"2024-09-12T02:41:53.794645+0000","last_active":"2024-09-12T02:41:54.778820+0000","last_peered":"2024-09-12T02:41:54.778820+0000","last_clean":"2024-09-12T02:41:54.778820+0000","last_became_active":"2024-09-12T02:41:53.794420+0000","last_became_peered":"2024-09-12T02:41:53.794420+0000","last_unstale":"2024-09-12T02:41:54.778820+0000","last_undegraded":"2024-09-12T02:41:54.778820+0000","last_fullsized":"2024-09-12T02:41:54.778820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:02.170329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778605+0000","last_change":"2024-09-12T02:41:53.795644+0000","last_active":"2024-09-12T02:41:54.778605+0000","last_peered":"2024-09-12T02:41:54.778605+0000","last_clean":"2024-09-12T02:41:54.778605+0000","last_became_active":"2024-09-12T02:41:53.795305+0000","last_became_peered":"2024-09-12T02:41:53.795305+0000","last_unstale":"2024-09-12T02:41:54.778605+0000","last_undegraded":"2024-09-12T02:41:54.778605+0000","last_fullsized":"2024-09-12T02:41:54.778605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:38.620097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807201+0000","last_change":"2024-09-12T02:41:53.784403+0000","last_active":"2024-09-12T02:41:54.807201+0000","last_peered":"2024-09-12T02:41:54.807201+0000","last_clean":"2024-09-12T02:41:54.807201+0000","last_became_active":"2024-09-12T02:41:53.784173+0000","last_became_peered":"2024-09-12T02:41:53.784173+0000","last_unstale":"2024-09-12T02:41:54.807201+0000","last_undegraded":"2024-09-12T02:41:54.807201+0000","last_fullsized":"2024-09-12T02:41:54.807201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:03.404034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779149+0000","last_change":"2024-09-12T02:41:53.796925+0000","last_active":"2024-09-12T02:41:54.779149+0000","last_peered":"2024-09-12T02:41:54.779149+0000","last_clean":"2024-09-12T02:41:54.779149+0000","last_became_active":"2024-09-12T02:41:53.796640+0000","last_became_peered":"2024-09-12T02:41:53.796640+0000","last_unstale":"2024-09-12T02:41:54.779149+0000","last_undegraded":"2024-09-12T02:41:54.779149+0000","last_fullsized":"2024-09-12T02:41:54.779149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:05.118176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.076988+0000","last_change":"2024-09-12T02:41:53.784042+0000","last_active":"2024-09-12T02:41:55.076988+0000","last_peered":"2024-09-12T02:41:55.076988+0000","last_clean":"2024-09-12T02:41:55.076988+0000","last_became_active":"2024-09-12T02:41:53.783817+0000","last_became_peered":"2024-09-12T02:41:53.783817+0000","last_unstale":"2024-09-12T02:41:55.076988+0000","last_undegraded":"2024-09-12T02:41:55.076988+0000","last_fullsized":"2024-09-12T02:41:55.076988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:31.997189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077165+0000","last_change":"2024-09-12T02:41:53.796678+0000","last_active":"2024-09-12T02:41:55.077165+0000","last_peered":"2024-09-12T02:41:55.077165+0000","last_clean":"2024-09-12T02:41:55.077165+0000","last_became_active":"2024-09-12T02:41:53.796473+0000","last_became_peered":"2024-09-12T02:41:53.796473+0000","last_unstale":"2024-09-12T02:41:55.077165+0000","last_undegraded":"2024-09-12T02:41:55.077165+0000","last_fullsized":"2024-09-12T02:41:55.077165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:14.697130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.076930+0000","last_change":"2024-09-12T02:41:53.787664+0000","last_active":"2024-09-12T02:41:55.076930+0000","last_peered":"2024-09-12T02:41:55.076930+0000","last_clean":"2024-09-12T02:41:55.076930+0000","last_became_active":"2024-09-12T02:41:53.786817+0000","last_became_peered":"2024-09-12T02:41:53.786817+0000","last_unstale":"2024-09-12T02:41:55.076930+0000","last_undegraded":"2024-09-12T02:41:55.076930+0000","last_fullsized":"2024-09-12T02:41:55.076930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:02.531079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778460+0000","last_change":"2024-09-12T02:41:53.785375+0000","last_active":"2024-09-12T02:41:54.778460+0000","last_peered":"2024-09-12T02:41:54.778460+0000","last_clean":"2024-09-12T02:41:54.778460+0000","last_became_active":"2024-09-12T02:41:53.785070+0000","last_became_peered":"2024-09-12T02:41:53.785070+0000","last_unstale":"2024-09-12T02:41:54.778460+0000","last_undegraded":"2024-09-12T02:41:54.778460+0000","last_fullsized":"2024-09-12T02:41:54.778460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:49.213437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.777581+0000","last_change":"2024-09-12T02:41:53.795446+0000","last_active":"2024-09-12T02:41:54.777581+0000","last_peered":"2024-09-12T02:41:54.777581+0000","last_clean":"2024-09-12T02:41:54.777581+0000","last_became_active":"2024-09-12T02:41:53.795189+0000","last_became_peered":"2024-09-12T02:41:53.795189+0000","last_unstale":"2024-09-12T02:41:54.777581+0000","last_undegraded":"2024-09-12T02:41:54.777581+0000","last_fullsized":"2024-09-12T02:41:54.777581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:31.783821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779103+0000","last_change":"2024-09-12T02:41:52.782761+0000","last_active":"2024-09-12T02:41:54.779103+0000","last_peered":"2024-09-12T02:41:54.779103+0000","last_clean":"2024-09-12T02:41:54.779103+0000","last_became_active":"2024-09-12T02:41:52.782565+0000","last_became_peered":"2024-09-12T02:41:52.782565+0000","last_unstale":"2024-09-12T02:41:54.779103+0000","last_undegraded":"2024-09-12T02:41:54.779103+0000","last_fullsized":"2024-09-12T02:41:54.779103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:21.927114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077231+0000","last_change":"2024-09-12T02:41:53.791180+0000","last_active":"2024-09-12T02:41:55.077231+0000","last_peered":"2024-09-12T02:41:55.077231+0000","last_clean":"2024-09-12T02:41:55.077231+0000","last_became_active":"2024-09-12T02:41:53.790843+0000","last_became_peered":"2024-09-12T02:41:53.790843+0000","last_unstale":"2024-09-12T02:41:55.077231+0000","last_undegraded":"2024-09-12T02:41:55.077231+0000","last_fullsized":"2024-09-12T02:41:55.077231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:58.801201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778651+0000","last_change":"2024-09-12T02:41:52.775582+0000","last_active":"2024-09-12T02:41:54.778651+0000","last_peered":"2024-09-12T02:41:54.778651+0000","last_clean":"2024-09-12T02:41:54.778651+0000","last_became_active":"2024-09-12T02:41:52.774577+0000","last_became_peered":"2024-09-12T02:41:52.774577+0000","last_unstale":"2024-09-12T02:41:54.778651+0000","last_undegraded":"2024-09-12T02:41:54.778651+0000","last_fullsized":"2024-09-12T02:41:54.778651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:36.018405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779210+0000","last_change":"2024-09-12T02:41:52.777181+0000","last_active":"2024-09-12T02:41:54.779210+0000","last_peered":"2024-09-12T02:41:54.779210+0000","last_clean":"2024-09-12T02:41:54.779210+0000","last_became_active":"2024-09-12T02:41:52.773406+0000","last_became_peered":"2024-09-12T02:41:52.773406+0000","last_unstale":"2024-09-12T02:41:54.779210+0000","last_undegraded":"2024-09-12T02:41:54.779210+0000","last_fullsized":"2024-09-12T02:41:54.779210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:20.740967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778971+0000","last_change":"2024-09-12T02:41:53.784557+0000","last_active":"2024-09-12T02:41:54.778971+0000","last_peered":"2024-09-12T02:41:54.778971+0000","last_clean":"2024-09-12T02:41:54.778971+0000","last_became_active":"2024-09-12T02:41:53.784163+0000","last_became_peered":"2024-09-12T02:41:53.784163+0000","last_unstale":"2024-09-12T02:41:54.778971+0000","last_undegraded":"2024-09-12T02:41:54.778971+0000","last_fullsized":"2024-09-12T02:41:54.778971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:37.011519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077434+0000","last_change":"2024-09-12T02:41:52.783587+0000","last_active":"2024-09-12T02:41:55.077434+0000","last_peered":"2024-09-12T02:41:55.077434+0000","last_clean":"2024-09-12T02:41:55.077434+0000","last_became_active":"2024-09-12T02:41:52.783418+0000","last_became_peered":"2024-09-12T02:41:52.783418+0000","last_unstale":"2024-09-12T02:41:55.077434+0000","last_undegraded":"2024-09-12T02:41:55.077434+0000","last_fullsized":"2024-09-12T02:41:55.077434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:39:33.808133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807122+0000","last_change":"2024-09-12T02:41:53.792483+0000","last_active":"2024-09-12T02:41:54.807122+0000","last_peered":"2024-09-12T02:41:54.807122+0000","last_clean":"2024-09-12T02:41:54.807122+0000","last_became_active":"2024-09-12T02:41:53.791556+0000","last_became_peered":"2024-09-12T02:41:53.791556+0000","last_unstale":"2024-09-12T02:41:54.807122+0000","last_undegraded":"2024-09-12T02:41:54.807122+0000","last_fullsized":"2024-09-12T02:41:54.807122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:27.695745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778786+0000","last_change":"2024-09-12T02:41:52.771541+0000","last_active":"2024-09-12T02:41:54.778786+0000","last_peered":"2024-09-12T02:41:54.778786+0000","last_clean":"2024-09-12T02:41:54.778786+0000","last_became_active":"2024-09-12T02:41:52.770232+0000","last_became_peered":"2024-09-12T02:41:52.770232+0000","last_unstale":"2024-09-12T02:41:54.778786+0000","last_undegraded":"2024-09-12T02:41:54.778786+0000","last_fullsized":"2024-09-12T02:41:54.778786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:13.405791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077589+0000","last_change":"2024-09-12T02:41:53.799033+0000","last_active":"2024-09-12T02:41:55.077589+0000","last_peered":"2024-09-12T02:41:55.077589+0000","last_clean":"2024-09-12T02:41:55.077589+0000","last_became_active":"2024-09-12T02:41:53.797973+0000","last_became_peered":"2024-09-12T02:41:53.797973+0000","last_unstale":"2024-09-12T02:41:55.077589+0000","last_undegraded":"2024-09-12T02:41:55.077589+0000","last_fullsized":"2024-09-12T02:41:55.077589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:12.141704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078072+0000","last_change":"2024-09-12T02:41:52.780065+0000","last_active":"2024-09-12T02:41:55.078072+0000","last_peered":"2024-09-12T02:41:55.078072+0000","last_clean":"2024-09-12T02:41:55.078072+0000","last_became_active":"2024-09-12T02:41:52.778398+0000","last_became_peered":"2024-09-12T02:41:52.778398+0000","last_unstale":"2024-09-12T02:41:55.078072+0000","last_undegraded":"2024-09-12T02:41:55.078072+0000","last_fullsized":"2024-09-12T02:41:55.078072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:58.549424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077632+0000","last_change":"2024-09-12T02:41:53.788794+0000","last_active":"2024-09-12T02:41:55.077632+0000","last_peered":"2024-09-12T02:41:55.077632+0000","last_clean":"2024-09-12T02:41:55.077632+0000","last_became_active":"2024-09-12T02:41:53.788300+0000","last_became_peered":"2024-09-12T02:41:53.788300+0000","last_unstale":"2024-09-12T02:41:55.077632+0000","last_undegraded":"2024-09-12T02:41:55.077632+0000","last_fullsized":"2024-09-12T02:41:55.077632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:45.111485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807225+0000","last_change":"2024-09-12T02:41:52.781616+0000","last_active":"2024-09-12T02:41:54.807225+0000","last_peered":"2024-09-12T02:41:54.807225+0000","last_clean":"2024-09-12T02:41:54.807225+0000","last_became_active":"2024-09-12T02:41:52.781376+0000","last_became_peered":"2024-09-12T02:41:52.781376+0000","last_unstale":"2024-09-12T02:41:54.807225+0000","last_undegraded":"2024-09-12T02:41:54.807225+0000","last_fullsized":"2024-09-12T02:41:54.807225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:29.040560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.777378+0000","last_change":"2024-09-12T02:41:53.801788+0000","last_active":"2024-09-12T02:41:54.777378+0000","last_peered":"2024-09-12T02:41:54.777378+0000","last_clean":"2024-09-12T02:41:54.777378+0000","last_became_active":"2024-09-12T02:41:53.801572+0000","last_became_peered":"2024-09-12T02:41:53.801572+0000","last_unstale":"2024-09-12T02:41:54.777378+0000","last_undegraded":"2024-09-12T02:41:54.777378+0000","last_fullsized":"2024-09-12T02:41:54.777378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:44.395638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778605+0000","last_change":"2024-09-12T02:41:52.776998+0000","last_active":"2024-09-12T02:41:54.778605+0000","last_peered":"2024-09-12T02:41:54.778605+0000","last_clean":"2024-09-12T02:41:54.778605+0000","last_became_active":"2024-09-12T02:41:52.776765+0000","last_became_peered":"2024-09-12T02:41:52.776765+0000","last_unstale":"2024-09-12T02:41:54.778605+0000","last_undegraded":"2024-09-12T02:41:54.778605+0000","last_fullsized":"2024-09-12T02:41:54.778605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:34.024741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077170+0000","last_change":"2024-09-12T02:41:53.795517+0000","last_active":"2024-09-12T02:41:55.077170+0000","last_peered":"2024-09-12T02:41:55.077170+0000","last_clean":"2024-09-12T02:41:55.077170+0000","last_became_active":"2024-09-12T02:41:53.795260+0000","last_became_peered":"2024-09-12T02:41:53.795260+0000","last_unstale":"2024-09-12T02:41:55.077170+0000","last_undegraded":"2024-09-12T02:41:55.077170+0000","last_fullsized":"2024-09-12T02:41:55.077170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:41.612631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077159+0000","last_change":"2024-09-12T02:41:52.770092+0000","last_active":"2024-09-12T02:41:55.077159+0000","last_peered":"2024-09-12T02:41:55.077159+0000","last_clean":"2024-09-12T02:41:55.077159+0000","last_became_active":"2024-09-12T02:41:52.769364+0000","last_became_peered":"2024-09-12T02:41:52.769364+0000","last_unstale":"2024-09-12T02:41:55.077159+0000","last_undegraded":"2024-09-12T02:41:55.077159+0000","last_fullsized":"2024-09-12T02:41:55.077159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:59.882002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077762+0000","last_change":"2024-09-12T02:41:53.793864+0000","last_active":"2024-09-12T02:41:55.077762+0000","last_peered":"2024-09-12T02:41:55.077762+0000","last_clean":"2024-09-12T02:41:55.077762+0000","last_became_active":"2024-09-12T02:41:53.793422+0000","last_became_peered":"2024-09-12T02:41:53.793422+0000","last_unstale":"2024-09-12T02:41:55.077762+0000","last_undegraded":"2024-09-12T02:41:55.077762+0000","last_fullsized":"2024-09-12T02:41:55.077762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:46.256453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078076+0000","last_change":"2024-09-12T02:41:52.780555+0000","last_active":"2024-09-12T02:41:55.078076+0000","last_peered":"2024-09-12T02:41:55.078076+0000","last_clean":"2024-09-12T02:41:55.078076+0000","last_became_active":"2024-09-12T02:41:52.775956+0000","last_became_peered":"2024-09-12T02:41:52.775956+0000","last_unstale":"2024-09-12T02:41:55.078076+0000","last_undegraded":"2024-09-12T02:41:55.078076+0000","last_fullsized":"2024-09-12T02:41:55.078076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:07.893393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078331+0000","last_change":"2024-09-12T02:41:53.803353+0000","last_active":"2024-09-12T02:41:55.078331+0000","last_peered":"2024-09-12T02:41:55.078331+0000","last_clean":"2024-09-12T02:41:55.078331+0000","last_became_active":"2024-09-12T02:41:53.802739+0000","last_became_peered":"2024-09-12T02:41:53.802739+0000","last_unstale":"2024-09-12T02:41:55.078331+0000","last_undegraded":"2024-09-12T02:41:55.078331+0000","last_fullsized":"2024-09-12T02:41:55.078331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:54.124099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778844+0000","last_change":"2024-09-12T02:41:52.766630+0000","last_active":"2024-09-12T02:41:54.778844+0000","last_peered":"2024-09-12T02:41:54.778844+0000","last_clean":"2024-09-12T02:41:54.778844+0000","last_became_active":"2024-09-12T02:41:52.766146+0000","last_became_peered":"2024-09-12T02:41:52.766146+0000","last_unstale":"2024-09-12T02:41:54.778844+0000","last_undegraded":"2024-09-12T02:41:54.778844+0000","last_fullsized":"2024-09-12T02:41:54.778844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:54.001676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778544+0000","last_change":"2024-09-12T02:41:53.786241+0000","last_active":"2024-09-12T02:41:54.778544+0000","last_peered":"2024-09-12T02:41:54.778544+0000","last_clean":"2024-09-12T02:41:54.778544+0000","last_became_active":"2024-09-12T02:41:53.785997+0000","last_became_peered":"2024-09-12T02:41:53.785997+0000","last_unstale":"2024-09-12T02:41:54.778544+0000","last_undegraded":"2024-09-12T02:41:54.778544+0000","last_fullsized":"2024-09-12T02:41:54.778544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:54.645416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.076987+0000","last_change":"2024-09-12T02:41:52.775019+0000","last_active":"2024-09-12T02:41:55.076987+0000","last_peered":"2024-09-12T02:41:55.076987+0000","last_clean":"2024-09-12T02:41:55.076987+0000","last_became_active":"2024-09-12T02:41:52.774766+0000","last_became_peered":"2024-09-12T02:41:52.774766+0000","last_unstale":"2024-09-12T02:41:55.076987+0000","last_undegraded":"2024-09-12T02:41:55.076987+0000","last_fullsized":"2024-09-12T02:41:55.076987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:28.082972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077793+0000","last_change":"2024-09-12T02:41:53.803073+0000","last_active":"2024-09-12T02:41:55.077793+0000","last_peered":"2024-09-12T02:41:55.077793+0000","last_clean":"2024-09-12T02:41:55.077793+0000","last_became_active":"2024-09-12T02:41:53.802791+0000","last_became_peered":"2024-09-12T02:41:53.802791+0000","last_unstale":"2024-09-12T02:41:55.077793+0000","last_undegraded":"2024-09-12T02:41:55.077793+0000","last_fullsized":"2024-09-12T02:41:55.077793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:14.115868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.777508+0000","last_change":"2024-09-12T02:41:52.767949+0000","last_active":"2024-09-12T02:41:54.777508+0000","last_peered":"2024-09-12T02:41:54.777508+0000","last_clean":"2024-09-12T02:41:54.777508+0000","last_became_active":"2024-09-12T02:41:52.767666+0000","last_became_peered":"2024-09-12T02:41:52.767666+0000","last_unstale":"2024-09-12T02:41:54.777508+0000","last_undegraded":"2024-09-12T02:41:54.777508+0000","last_fullsized":"2024-09-12T02:41:54.777508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:17.680737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078475+0000","last_change":"2024-09-12T02:41:53.803540+0000","last_active":"2024-09-12T02:41:55.078475+0000","last_peered":"2024-09-12T02:41:55.078475+0000","last_clean":"2024-09-12T02:41:55.078475+0000","last_became_active":"2024-09-12T02:41:53.803074+0000","last_became_peered":"2024-09-12T02:41:53.803074+0000","last_unstale":"2024-09-12T02:41:55.078475+0000","last_undegraded":"2024-09-12T02:41:55.078475+0000","last_fullsized":"2024-09-12T02:41:55.078475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:39.415488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077285+0000","last_change":"2024-09-12T02:41:52.776749+0000","last_active":"2024-09-12T02:41:55.077285+0000","last_peered":"2024-09-12T02:41:55.077285+0000","last_clean":"2024-09-12T02:41:55.077285+0000","last_became_active":"2024-09-12T02:41:52.776495+0000","last_became_peered":"2024-09-12T02:41:52.776495+0000","last_unstale":"2024-09-12T02:41:55.077285+0000","last_undegraded":"2024-09-12T02:41:55.077285+0000","last_fullsized":"2024-09-12T02:41:55.077285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:58.485267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077321+0000","last_change":"2024-09-12T02:41:53.803271+0000","last_active":"2024-09-12T02:41:55.077321+0000","last_peered":"2024-09-12T02:41:55.077321+0000","last_clean":"2024-09-12T02:41:55.077321+0000","last_became_active":"2024-09-12T02:41:53.802960+0000","last_became_peered":"2024-09-12T02:41:53.802960+0000","last_unstale":"2024-09-12T02:41:55.077321+0000","last_undegraded":"2024-09-12T02:41:55.077321+0000","last_fullsized":"2024-09-12T02:41:55.077321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:11.896253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807044+0000","last_change":"2024-09-12T02:41:52.775195+0000","last_active":"2024-09-12T02:41:54.807044+0000","last_peered":"2024-09-12T02:41:54.807044+0000","last_clean":"2024-09-12T02:41:54.807044+0000","last_became_active":"2024-09-12T02:41:52.774945+0000","last_became_peered":"2024-09-12T02:41:52.774945+0000","last_unstale":"2024-09-12T02:41:54.807044+0000","last_undegraded":"2024-09-12T02:41:54.807044+0000","last_fullsized":"2024-09-12T02:41:54.807044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:35.355898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077903+0000","last_change":"2024-09-12T02:41:53.787875+0000","last_active":"2024-09-12T02:41:55.077903+0000","last_peered":"2024-09-12T02:41:55.077903+0000","last_clean":"2024-09-12T02:41:55.077903+0000","last_became_active":"2024-09-12T02:41:53.787636+0000","last_became_peered":"2024-09-12T02:41:53.787636+0000","last_unstale":"2024-09-12T02:41:55.077903+0000","last_undegraded":"2024-09-12T02:41:55.077903+0000","last_fullsized":"2024-09-12T02:41:55.077903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:18.244809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.076853+0000","last_change":"2024-09-12T02:41:52.781866+0000","last_active":"2024-09-12T02:41:55.076853+0000","last_peered":"2024-09-12T02:41:55.076853+0000","last_clean":"2024-09-12T02:41:55.076853+0000","last_became_active":"2024-09-12T02:41:52.781637+0000","last_became_peered":"2024-09-12T02:41:52.781637+0000","last_unstale":"2024-09-12T02:41:55.076853+0000","last_undegraded":"2024-09-12T02:41:55.076853+0000","last_fullsized":"2024-09-12T02:41:55.076853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:44.675773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078815+0000","last_change":"2024-09-12T02:41:53.802186+0000","last_active":"2024-09-12T02:41:55.078815+0000","last_peered":"2024-09-12T02:41:55.078815+0000","last_clean":"2024-09-12T02:41:55.078815+0000","last_became_active":"2024-09-12T02:41:53.801944+0000","last_became_peered":"2024-09-12T02:41:53.801944+0000","last_unstale":"2024-09-12T02:41:55.078815+0000","last_undegraded":"2024-09-12T02:41:55.078815+0000","last_fullsized":"2024-09-12T02:41:55.078815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:27.413007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077804+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:41:55.077804+0000","last_peered":"2024-09-12T02:41:55.077804+0000","last_clean":"2024-09-12T02:41:55.077804+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:41:55.077804+0000","last_undegraded":"2024-09-12T02:41:55.077804+0000","last_fullsized":"2024-09-12T02:41:55.077804+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:45.426902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078266+0000","last_change":"2024-09-12T02:41:52.783100+0000","last_active":"2024-09-12T02:41:55.078266+0000","last_peered":"2024-09-12T02:41:55.078266+0000","last_clean":"2024-09-12T02:41:55.078266+0000","last_became_active":"2024-09-12T02:41:52.782739+0000","last_became_peered":"2024-09-12T02:41:52.782739+0000","last_unstale":"2024-09-12T02:41:55.078266+0000","last_undegraded":"2024-09-12T02:41:55.078266+0000","last_fullsized":"2024-09-12T02:41:55.078266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:12.279581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778908+0000","last_change":"2024-09-12T02:41:53.793492+0000","last_active":"2024-09-12T02:41:54.778908+0000","last_peered":"2024-09-12T02:41:54.778908+0000","last_clean":"2024-09-12T02:41:54.778908+0000","last_became_active":"2024-09-12T02:41:53.791680+0000","last_became_peered":"2024-09-12T02:41:53.791680+0000","last_unstale":"2024-09-12T02:41:54.778908+0000","last_undegraded":"2024-09-12T02:41:54.778908+0000","last_fullsized":"2024-09-12T02:41:54.778908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:00.054064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077698+0000","last_change":"2024-09-12T02:41:52.781604+0000","last_active":"2024-09-12T02:41:55.077698+0000","last_peered":"2024-09-12T02:41:55.077698+0000","last_clean":"2024-09-12T02:41:55.077698+0000","last_became_active":"2024-09-12T02:41:52.780183+0000","last_became_peered":"2024-09-12T02:41:52.780183+0000","last_unstale":"2024-09-12T02:41:55.077698+0000","last_undegraded":"2024-09-12T02:41:55.077698+0000","last_fullsized":"2024-09-12T02:41:55.077698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:00.663730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077610+0000","last_change":"2024-09-12T02:41:53.795877+0000","last_active":"2024-09-12T02:41:55.077610+0000","last_peered":"2024-09-12T02:41:55.077610+0000","last_clean":"2024-09-12T02:41:55.077610+0000","last_became_active":"2024-09-12T02:41:53.795603+0000","last_became_peered":"2024-09-12T02:41:53.795603+0000","last_unstale":"2024-09-12T02:41:55.077610+0000","last_undegraded":"2024-09-12T02:41:55.077610+0000","last_fullsized":"2024-09-12T02:41:55.077610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:16.241955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077097+0000","last_change":"2024-09-12T02:41:52.779295+0000","last_active":"2024-09-12T02:41:55.077097+0000","last_peered":"2024-09-12T02:41:55.077097+0000","last_clean":"2024-09-12T02:41:55.077097+0000","last_became_active":"2024-09-12T02:41:52.778794+0000","last_became_peered":"2024-09-12T02:41:52.778794+0000","last_unstale":"2024-09-12T02:41:55.077097+0000","last_undegraded":"2024-09-12T02:41:55.077097+0000","last_fullsized":"2024-09-12T02:41:55.077097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:37.479001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807228+0000","last_change":"2024-09-12T02:41:53.787507+0000","last_active":"2024-09-12T02:41:54.807228+0000","last_peered":"2024-09-12T02:41:54.807228+0000","last_clean":"2024-09-12T02:41:54.807228+0000","last_became_active":"2024-09-12T02:41:53.787303+0000","last_became_peered":"2024-09-12T02:41:53.787303+0000","last_unstale":"2024-09-12T02:41:54.807228+0000","last_undegraded":"2024-09-12T02:41:54.807228+0000","last_fullsized":"2024-09-12T02:41:54.807228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:19.802083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078131+0000","last_change":"2024-09-12T02:41:52.785347+0000","last_active":"2024-09-12T02:41:55.078131+0000","last_peered":"2024-09-12T02:41:55.078131+0000","last_clean":"2024-09-12T02:41:55.078131+0000","last_became_active":"2024-09-12T02:41:52.784154+0000","last_became_peered":"2024-09-12T02:41:52.784154+0000","last_unstale":"2024-09-12T02:41:55.078131+0000","last_undegraded":"2024-09-12T02:41:55.078131+0000","last_fullsized":"2024-09-12T02:41:55.078131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:21:04.142656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.777403+0000","last_change":"2024-09-12T02:41:53.796131+0000","last_active":"2024-09-12T02:41:54.777403+0000","last_peered":"2024-09-12T02:41:54.777403+0000","last_clean":"2024-09-12T02:41:54.777403+0000","last_became_active":"2024-09-12T02:41:53.795889+0000","last_became_peered":"2024-09-12T02:41:53.795889+0000","last_unstale":"2024-09-12T02:41:54.777403+0000","last_undegraded":"2024-09-12T02:41:54.777403+0000","last_fullsized":"2024-09-12T02:41:54.777403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:58:40.501110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807255+0000","last_change":"2024-09-12T02:41:52.773305+0000","last_active":"2024-09-12T02:41:54.807255+0000","last_peered":"2024-09-12T02:41:54.807255+0000","last_clean":"2024-09-12T02:41:54.807255+0000","last_became_active":"2024-09-12T02:41:52.773009+0000","last_became_peered":"2024-09-12T02:41:52.773009+0000","last_unstale":"2024-09-12T02:41:54.807255+0000","last_undegraded":"2024-09-12T02:41:54.807255+0000","last_fullsized":"2024-09-12T02:41:54.807255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:41:48.173306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077855+0000","last_change":"2024-09-12T02:41:53.789700+0000","last_active":"2024-09-12T02:41:55.077855+0000","last_peered":"2024-09-12T02:41:55.077855+0000","last_clean":"2024-09-12T02:41:55.077855+0000","last_became_active":"2024-09-12T02:41:53.789445+0000","last_became_peered":"2024-09-12T02:41:53.789445+0000","last_unstale":"2024-09-12T02:41:55.077855+0000","last_undegraded":"2024-09-12T02:41:55.077855+0000","last_fullsized":"2024-09-12T02:41:55.077855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:21.533372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077584+0000","last_change":"2024-09-12T02:41:52.783557+0000","last_active":"2024-09-12T02:41:55.077584+0000","last_peered":"2024-09-12T02:41:55.077584+0000","last_clean":"2024-09-12T02:41:55.077584+0000","last_became_active":"2024-09-12T02:41:52.782015+0000","last_became_peered":"2024-09-12T02:41:52.782015+0000","last_unstale":"2024-09-12T02:41:55.077584+0000","last_undegraded":"2024-09-12T02:41:55.077584+0000","last_fullsized":"2024-09-12T02:41:55.077584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:07.909958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807020+0000","last_change":"2024-09-12T02:41:53.791158+0000","last_active":"2024-09-12T02:41:54.807020+0000","last_peered":"2024-09-12T02:41:54.807020+0000","last_clean":"2024-09-12T02:41:54.807020+0000","last_became_active":"2024-09-12T02:41:53.789727+0000","last_became_peered":"2024-09-12T02:41:53.789727+0000","last_unstale":"2024-09-12T02:41:54.807020+0000","last_undegraded":"2024-09-12T02:41:54.807020+0000","last_fullsized":"2024-09-12T02:41:54.807020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:21.893126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807346+0000","last_change":"2024-09-12T02:41:52.773054+0000","last_active":"2024-09-12T02:41:54.807346+0000","last_peered":"2024-09-12T02:41:54.807346+0000","last_clean":"2024-09-12T02:41:54.807346+0000","last_became_active":"2024-09-12T02:41:52.772715+0000","last_became_peered":"2024-09-12T02:41:52.772715+0000","last_unstale":"2024-09-12T02:41:54.807346+0000","last_undegraded":"2024-09-12T02:41:54.807346+0000","last_fullsized":"2024-09-12T02:41:54.807346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:27.523535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778750+0000","last_change":"2024-09-12T02:41:53.794838+0000","last_active":"2024-09-12T02:41:54.778750+0000","last_peered":"2024-09-12T02:41:54.778750+0000","last_clean":"2024-09-12T02:41:54.778750+0000","last_became_active":"2024-09-12T02:41:53.794622+0000","last_became_peered":"2024-09-12T02:41:53.794622+0000","last_unstale":"2024-09-12T02:41:54.778750+0000","last_undegraded":"2024-09-12T02:41:54.778750+0000","last_fullsized":"2024-09-12T02:41:54.778750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:07.720321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778964+0000","last_change":"2024-09-12T02:41:52.782851+0000","last_active":"2024-09-12T02:41:54.778964+0000","last_peered":"2024-09-12T02:41:54.778964+0000","last_clean":"2024-09-12T02:41:54.778964+0000","last_became_active":"2024-09-12T02:41:52.782365+0000","last_became_peered":"2024-09-12T02:41:52.782365+0000","last_unstale":"2024-09-12T02:41:54.778964+0000","last_undegraded":"2024-09-12T02:41:54.778964+0000","last_fullsized":"2024-09-12T02:41:54.778964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:02.356143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077330+0000","last_change":"2024-09-12T02:41:53.782924+0000","last_active":"2024-09-12T02:41:55.077330+0000","last_peered":"2024-09-12T02:41:55.077330+0000","last_clean":"2024-09-12T02:41:55.077330+0000","last_became_active":"2024-09-12T02:41:53.782612+0000","last_became_peered":"2024-09-12T02:41:53.782612+0000","last_unstale":"2024-09-12T02:41:55.077330+0000","last_undegraded":"2024-09-12T02:41:55.077330+0000","last_fullsized":"2024-09-12T02:41:55.077330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:09.015161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.079091+0000","last_change":"2024-09-12T02:41:52.783151+0000","last_active":"2024-09-12T02:41:55.079091+0000","last_peered":"2024-09-12T02:41:55.079091+0000","last_clean":"2024-09-12T02:41:55.079091+0000","last_became_active":"2024-09-12T02:41:52.781789+0000","last_became_peered":"2024-09-12T02:41:52.781789+0000","last_unstale":"2024-09-12T02:41:55.079091+0000","last_undegraded":"2024-09-12T02:41:55.079091+0000","last_fullsized":"2024-09-12T02:41:55.079091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:30.446920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778208+0000","last_change":"2024-09-12T02:41:53.792907+0000","last_active":"2024-09-12T02:41:54.778208+0000","last_peered":"2024-09-12T02:41:54.778208+0000","last_clean":"2024-09-12T02:41:54.778208+0000","last_became_active":"2024-09-12T02:41:53.789159+0000","last_became_peered":"2024-09-12T02:41:53.789159+0000","last_unstale":"2024-09-12T02:41:54.778208+0000","last_undegraded":"2024-09-12T02:41:54.778208+0000","last_fullsized":"2024-09-12T02:41:54.778208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:40.658393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807185+0000","last_change":"2024-09-12T02:41:52.784747+0000","last_active":"2024-09-12T02:41:54.807185+0000","last_peered":"2024-09-12T02:41:54.807185+0000","last_clean":"2024-09-12T02:41:54.807185+0000","last_became_active":"2024-09-12T02:41:52.784558+0000","last_became_peered":"2024-09-12T02:41:52.784558+0000","last_unstale":"2024-09-12T02:41:54.807185+0000","last_undegraded":"2024-09-12T02:41:54.807185+0000","last_fullsized":"2024-09-12T02:41:54.807185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:25.686682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778690+0000","last_change":"2024-09-12T02:41:53.793644+0000","last_active":"2024-09-12T02:41:54.778690+0000","last_peered":"2024-09-12T02:41:54.778690+0000","last_clean":"2024-09-12T02:41:54.778690+0000","last_became_active":"2024-09-12T02:41:53.793439+0000","last_became_peered":"2024-09-12T02:41:53.793439+0000","last_unstale":"2024-09-12T02:41:54.778690+0000","last_undegraded":"2024-09-12T02:41:54.778690+0000","last_fullsized":"2024-09-12T02:41:54.778690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:25:59.472325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807287+0000","last_change":"2024-09-12T02:41:52.780636+0000","last_active":"2024-09-12T02:41:54.807287+0000","last_peered":"2024-09-12T02:41:54.807287+0000","last_clean":"2024-09-12T02:41:54.807287+0000","last_became_active":"2024-09-12T02:41:52.780347+0000","last_became_peered":"2024-09-12T02:41:52.780347+0000","last_unstale":"2024-09-12T02:41:54.807287+0000","last_undegraded":"2024-09-12T02:41:54.807287+0000","last_fullsized":"2024-09-12T02:41:54.807287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:46.086664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779261+0000","last_change":"2024-09-12T02:41:53.784952+0000","last_active":"2024-09-12T02:41:54.779261+0000","last_peered":"2024-09-12T02:41:54.779261+0000","last_clean":"2024-09-12T02:41:54.779261+0000","last_became_active":"2024-09-12T02:41:53.784276+0000","last_became_peered":"2024-09-12T02:41:53.784276+0000","last_unstale":"2024-09-12T02:41:54.779261+0000","last_undegraded":"2024-09-12T02:41:54.779261+0000","last_fullsized":"2024-09-12T02:41:54.779261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:53.702199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077279+0000","last_change":"2024-09-12T02:41:52.783869+0000","last_active":"2024-09-12T02:41:55.077279+0000","last_peered":"2024-09-12T02:41:55.077279+0000","last_clean":"2024-09-12T02:41:55.077279+0000","last_became_active":"2024-09-12T02:41:52.781705+0000","last_became_peered":"2024-09-12T02:41:52.781705+0000","last_unstale":"2024-09-12T02:41:55.077279+0000","last_undegraded":"2024-09-12T02:41:55.077279+0000","last_fullsized":"2024-09-12T02:41:55.077279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:28.710814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778514+0000","last_change":"2024-09-12T02:41:53.802125+0000","last_active":"2024-09-12T02:41:54.778514+0000","last_peered":"2024-09-12T02:41:54.778514+0000","last_clean":"2024-09-12T02:41:54.778514+0000","last_became_active":"2024-09-12T02:41:53.801855+0000","last_became_peered":"2024-09-12T02:41:53.801855+0000","last_unstale":"2024-09-12T02:41:54.778514+0000","last_undegraded":"2024-09-12T02:41:54.778514+0000","last_fullsized":"2024-09-12T02:41:54.778514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:56.017190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077335+0000","last_change":"2024-09-12T02:41:53.796199+0000","last_active":"2024-09-12T02:41:55.077335+0000","last_peered":"2024-09-12T02:41:55.077335+0000","last_clean":"2024-09-12T02:41:55.077335+0000","last_became_active":"2024-09-12T02:41:53.793833+0000","last_became_peered":"2024-09-12T02:41:53.793833+0000","last_unstale":"2024-09-12T02:41:55.077335+0000","last_undegraded":"2024-09-12T02:41:55.077335+0000","last_fullsized":"2024-09-12T02:41:55.077335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:06.451667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078990+0000","last_change":"2024-09-12T02:41:52.785769+0000","last_active":"2024-09-12T02:41:55.078990+0000","last_peered":"2024-09-12T02:41:55.078990+0000","last_clean":"2024-09-12T02:41:55.078990+0000","last_became_active":"2024-09-12T02:41:52.785498+0000","last_became_peered":"2024-09-12T02:41:52.785498+0000","last_unstale":"2024-09-12T02:41:55.078990+0000","last_undegraded":"2024-09-12T02:41:55.078990+0000","last_fullsized":"2024-09-12T02:41:55.078990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:06.766309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077706+0000","last_change":"2024-09-12T02:41:53.797692+0000","last_active":"2024-09-12T02:41:55.077706+0000","last_peered":"2024-09-12T02:41:55.077706+0000","last_clean":"2024-09-12T02:41:55.077706+0000","last_became_active":"2024-09-12T02:41:53.797478+0000","last_became_peered":"2024-09-12T02:41:53.797478+0000","last_unstale":"2024-09-12T02:41:55.077706+0000","last_undegraded":"2024-09-12T02:41:55.077706+0000","last_fullsized":"2024-09-12T02:41:55.077706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:01.317942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078580+0000","last_change":"2024-09-12T02:41:52.784485+0000","last_active":"2024-09-12T02:41:55.078580+0000","last_peered":"2024-09-12T02:41:55.078580+0000","last_clean":"2024-09-12T02:41:55.078580+0000","last_became_active":"2024-09-12T02:41:52.784183+0000","last_became_peered":"2024-09-12T02:41:52.784183+0000","last_unstale":"2024-09-12T02:41:55.078580+0000","last_undegraded":"2024-09-12T02:41:55.078580+0000","last_fullsized":"2024-09-12T02:41:55.078580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:32:59.235781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077471+0000","last_change":"2024-09-12T02:41:53.784634+0000","last_active":"2024-09-12T02:41:55.077471+0000","last_peered":"2024-09-12T02:41:55.077471+0000","last_clean":"2024-09-12T02:41:55.077471+0000","last_became_active":"2024-09-12T02:41:53.784120+0000","last_became_peered":"2024-09-12T02:41:53.784120+0000","last_unstale":"2024-09-12T02:41:55.077471+0000","last_undegraded":"2024-09-12T02:41:55.077471+0000","last_fullsized":"2024-09-12T02:41:55.077471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:13.615226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779120+0000","last_change":"2024-09-12T02:41:52.778974+0000","last_active":"2024-09-12T02:41:54.779120+0000","last_peered":"2024-09-12T02:41:54.779120+0000","last_clean":"2024-09-12T02:41:54.779120+0000","last_became_active":"2024-09-12T02:41:52.775107+0000","last_became_peered":"2024-09-12T02:41:52.775107+0000","last_unstale":"2024-09-12T02:41:54.779120+0000","last_undegraded":"2024-09-12T02:41:54.779120+0000","last_fullsized":"2024-09-12T02:41:54.779120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:37.256469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779025+0000","last_change":"2024-09-12T02:41:53.789090+0000","last_active":"2024-09-12T02:41:54.779025+0000","last_peered":"2024-09-12T02:41:54.779025+0000","last_clean":"2024-09-12T02:41:54.779025+0000","last_became_active":"2024-09-12T02:41:53.787863+0000","last_became_peered":"2024-09-12T02:41:53.787863+0000","last_unstale":"2024-09-12T02:41:54.779025+0000","last_undegraded":"2024-09-12T02:41:54.779025+0000","last_fullsized":"2024-09-12T02:41:54.779025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:09.744576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077689+0000","last_change":"2024-09-12T02:41:52.778197+0000","last_active":"2024-09-12T02:41:55.077689+0000","last_peered":"2024-09-12T02:41:55.077689+0000","last_clean":"2024-09-12T02:41:55.077689+0000","last_became_active":"2024-09-12T02:41:52.777887+0000","last_became_peered":"2024-09-12T02:41:52.777887+0000","last_unstale":"2024-09-12T02:41:55.077689+0000","last_undegraded":"2024-09-12T02:41:55.077689+0000","last_fullsized":"2024-09-12T02:41:55.077689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:30:08.364549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338276,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927614,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929136,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929100,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927614,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929226,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929066,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338220,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:42:05.934 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:42:06.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.123+0000 7f476be00640 1 Processor -- start 2024-09-12T02:42:06.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.123+0000 7f476be00640 1 -- start start 2024-09-12T02:42:06.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.124+0000 7f476be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f476406d8c0 0x7f47640afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:06.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.125+0000 7f476be00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47640aedd0 con 0x7f47640ae8d0 2024-09-12T02:42:06.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.125+0000 7f476be00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47640af0b0 con 0x7f476406dca0 2024-09-12T02:42:06.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.125+0000 7f476be00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f47640af390 con 0x7f476406d8c0 2024-09-12T02:42:06.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.125+0000 7f4768a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f47640ae8d0 0x7f47640715a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33998/0 (socket says 172.21.15.112:33998) 2024-09-12T02:42:06.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.125+0000 7f4768a00640 1 -- 172.21.15.112:0/1130002302 learned_addr learned my addr 172.21.15.112:0/1130002302 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:06.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.125+0000 7f4769400640 1 --2- 172.21.15.112:0/1130002302 >> v2:172.21.15.137:3300/0 conn(0x7f476406d8c0 0x7f47640afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:06.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.125+0000 7f4763e00640 1 -- 172.21.15.112:0/1130002302 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 505443894 0 0) 0x7f47640aedd0 con 0x7f47640ae8d0 2024-09-12T02:42:06.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.125+0000 7f4763e00640 1 -- 172.21.15.112:0/1130002302 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f474c003520 con 0x7f47640ae8d0 2024-09-12T02:42:06.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.125+0000 7f4763e00640 1 -- 172.21.15.112:0/1130002302 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 714901292 0 0) 0x7f474c003520 con 0x7f47640ae8d0 2024-09-12T02:42:06.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.125+0000 7f4769400640 1 -- 172.21.15.112:0/1130002302 >> v1:172.21.15.137:6789/0 conn(0x7f476406dca0 legacy=0x7f476406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:06.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.125+0000 7f4769400640 1 -- 172.21.15.112:0/1130002302 >> v1:172.21.15.112:6789/0 conn(0x7f47640ae8d0 legacy=0x7f47640715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:06.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.126+0000 7f4769400640 1 -- 172.21.15.112:0/1130002302 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47640af670 con 0x7f476406d8c0 2024-09-12T02:42:06.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.127+0000 7f4769400640 1 --2- 172.21.15.112:0/1130002302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f476406d8c0 0x7f47640afe70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f47580097a0 tx=0x7f475802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d56aa9a945b6406 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:06.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.127+0000 7f4763e00640 1 -- 172.21.15.112:0/1130002302 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4758037070 con 0x7f476406d8c0 2024-09-12T02:42:06.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.127+0000 7f4763e00640 1 -- 172.21.15.112:0/1130002302 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f475802ac50 con 0x7f476406d8c0 2024-09-12T02:42:06.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.127+0000 7f4763e00640 1 -- 172.21.15.112:0/1130002302 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47500017f0 con 0x7f476406d8c0 2024-09-12T02:42:06.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.127+0000 7f476be00640 1 -- 172.21.15.112:0/1130002302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f476406d8c0 msgr2=0x7f47640afe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:06.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.127+0000 7f476be00640 1 --2- 172.21.15.112:0/1130002302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f476406d8c0 0x7f47640afe70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f47580097a0 tx=0x7f475802a1c0 comp rx=0 tx=0).stop 2024-09-12T02:42:06.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.127+0000 7f476be00640 1 -- 172.21.15.112:0/1130002302 shutdown_connections 2024-09-12T02:42:06.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.127+0000 7f476be00640 1 --2- 172.21.15.112:0/1130002302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f476406d8c0 0x7f47640afe70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:06.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.127+0000 7f476be00640 1 -- 172.21.15.112:0/1130002302 >> 172.21.15.112:0/1130002302 conn(0x7f476406bbd0 msgr2=0x7f476406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:06.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.127+0000 7f476be00640 1 -- 172.21.15.112:0/1130002302 shutdown_connections 2024-09-12T02:42:06.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.128+0000 7f476be00640 1 -- 172.21.15.112:0/1130002302 wait complete. 2024-09-12T02:42:06.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.129+0000 7f476be00640 1 Processor -- start 2024-09-12T02:42:06.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.129+0000 7f476be00640 1 -- start start 2024-09-12T02:42:06.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.130+0000 7f476be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f476406d8c0 0x7f476414fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:06.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.130+0000 7f476be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f476406dca0 0x7f4764160750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:06.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.130+0000 7f476be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47640ae8d0 0x7f4764160c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:06.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.130+0000 7f476be00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f47640b3a60 con 0x7f476406dca0 2024-09-12T02:42:06.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.130+0000 7f476be00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f47640b38e0 con 0x7f47640ae8d0 2024-09-12T02:42:06.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.130+0000 7f476be00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f47640b3be0 con 0x7f476406d8c0 2024-09-12T02:42:06.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.130+0000 7f4768a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f476406dca0 0x7f4764160750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:06.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.130+0000 7f4768a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f476406dca0 0x7f4764160750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57834/0 (socket says 172.21.15.112:57834) 2024-09-12T02:42:06.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.130+0000 7f4768a00640 1 -- 172.21.15.112:0/369755229 learned_addr learned my addr 172.21.15.112:0/369755229 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:06.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.131+0000 7f4769400640 1 --2- 172.21.15.112:0/369755229 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f476406d8c0 0x7f476414fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:06.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.131+0000 7f4769e00640 1 --2- 172.21.15.112:0/369755229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47640ae8d0 0x7f4764160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:06.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.131+0000 7f4768a00640 1 -- 172.21.15.112:0/369755229 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f476406d8c0 msgr2=0x7f476414fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:06.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.131+0000 7f4768a00640 1 --2- 172.21.15.112:0/369755229 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f476406d8c0 0x7f476414fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:06.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.131+0000 7f4768a00640 1 -- 172.21.15.112:0/369755229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47640ae8d0 msgr2=0x7f4764160c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:06.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.131+0000 7f4768a00640 1 --2- 172.21.15.112:0/369755229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47640ae8d0 0x7f4764160c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:06.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.131+0000 7f4768a00640 1 -- 172.21.15.112:0/369755229 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47640cdc50 con 0x7f476406dca0 2024-09-12T02:42:06.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.131+0000 7f4769e00640 1 --2- 172.21.15.112:0/369755229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47640ae8d0 0x7f4764160c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:06.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.131+0000 7f4768a00640 1 --2- 172.21.15.112:0/369755229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f476406dca0 0x7f4764160750 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f475000c780 tx=0x7f475000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:06.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.131+0000 7f4761600640 1 -- 172.21.15.112:0/369755229 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4750017070 con 0x7f476406dca0 2024-09-12T02:42:06.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.131+0000 7f4761600640 1 -- 172.21.15.112:0/369755229 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4750007270 con 0x7f476406dca0 2024-09-12T02:42:06.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.131+0000 7f476be00640 1 -- 172.21.15.112:0/369755229 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47640cd970 con 0x7f476406dca0 2024-09-12T02:42:06.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.131+0000 7f4761600640 1 -- 172.21.15.112:0/369755229 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47500057a0 con 0x7f476406dca0 2024-09-12T02:42:06.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.131+0000 7f476be00640 1 -- 172.21.15.112:0/369755229 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4764152260 con 0x7f476406dca0 2024-09-12T02:42:06.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.132+0000 7f476be00640 1 -- 172.21.15.112:0/369755229 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4764068a30 con 0x7f476406dca0 2024-09-12T02:42:06.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.133+0000 7f4761600640 1 -- 172.21.15.112:0/369755229 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f475001a070 con 0x7f476406dca0 2024-09-12T02:42:06.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.135+0000 7f4761600640 1 --2- 172.21.15.112:0/369755229 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f474406be30 0x7f474406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:06.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.135+0000 7f4761600640 1 -- 172.21.15.112:0/369755229 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f475008a2d0 con 0x7f476406dca0 2024-09-12T02:42:06.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.135+0000 7f4769400640 1 --2- 172.21.15.112:0/369755229 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f474406be30 0x7f474406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:06.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.136+0000 7f4769400640 1 --2- 172.21.15.112:0/369755229 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f474406be30 0x7f474406e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4758034000 tx=0x7f475802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:06.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.139+0000 7f4761600640 1 -- 172.21.15.112:0/369755229 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4750058590 con 0x7f476406dca0 2024-09-12T02:42:06.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.309+0000 7f476be00640 1 -- 172.21.15.112:0/369755229 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f476415b510 con 0x7f474406be30 2024-09-12T02:42:06.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.315+0000 7f4761600640 1 -- 172.21.15.112:0/369755229 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247486 (secure 0 0 0) 0x7f476415b510 con 0x7f474406be30 2024-09-12T02:42:06.318 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:42:06.320 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:42:06.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.319+0000 7f476be00640 1 -- 172.21.15.112:0/369755229 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f474406be30 msgr2=0x7f474406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:06.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.319+0000 7f476be00640 1 --2- 172.21.15.112:0/369755229 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f474406be30 0x7f474406e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4758034000 tx=0x7f475802e000 comp rx=0 tx=0).stop 2024-09-12T02:42:06.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.319+0000 7f476be00640 1 -- 172.21.15.112:0/369755229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f476406dca0 msgr2=0x7f4764160750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:06.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.319+0000 7f476be00640 1 --2- 172.21.15.112:0/369755229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f476406dca0 0x7f4764160750 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f475000c780 tx=0x7f475000cc40 comp rx=0 tx=0).stop 2024-09-12T02:42:06.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.319+0000 7f476be00640 1 -- 172.21.15.112:0/369755229 shutdown_connections 2024-09-12T02:42:06.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.319+0000 7f476be00640 1 --2- 172.21.15.112:0/369755229 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f474406be30 0x7f474406e2f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:06.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.319+0000 7f476be00640 1 --2- 172.21.15.112:0/369755229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47640ae8d0 0x7f4764160c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:06.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.319+0000 7f476be00640 1 --2- 172.21.15.112:0/369755229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f476406dca0 0x7f4764160750 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:06.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.319+0000 7f476be00640 1 --2- 172.21.15.112:0/369755229 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f476406d8c0 0x7f476414fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:06.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.319+0000 7f476be00640 1 -- 172.21.15.112:0/369755229 >> 172.21.15.112:0/369755229 conn(0x7f476406bbd0 msgr2=0x7f476415b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:06.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.319+0000 7f476be00640 1 -- 172.21.15.112:0/369755229 shutdown_connections 2024-09-12T02:42:06.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.319+0000 7f476be00640 1 -- 172.21.15.112:0/369755229 wait complete. 2024-09-12T02:42:06.336 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-12T02:42:04.963606+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560789,"statfs":{"total":1600000000,"available":1598248252,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.186991"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078585+0000","last_change":"2024-09-12T02:41:53.797392+0000","last_active":"2024-09-12T02:41:55.078585+0000","last_peered":"2024-09-12T02:41:55.078585+0000","last_clean":"2024-09-12T02:41:55.078585+0000","last_became_active":"2024-09-12T02:41:53.797125+0000","last_became_peered":"2024-09-12T02:41:53.797125+0000","last_unstale":"2024-09-12T02:41:55.078585+0000","last_undegraded":"2024-09-12T02:41:55.078585+0000","last_fullsized":"2024-09-12T02:41:55.078585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:13.937351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807042+0000","last_change":"2024-09-12T02:41:53.788184+0000","last_active":"2024-09-12T02:41:54.807042+0000","last_peered":"2024-09-12T02:41:54.807042+0000","last_clean":"2024-09-12T02:41:54.807042+0000","last_became_active":"2024-09-12T02:41:53.787657+0000","last_became_peered":"2024-09-12T02:41:53.787657+0000","last_unstale":"2024-09-12T02:41:54.807042+0000","last_undegraded":"2024-09-12T02:41:54.807042+0000","last_fullsized":"2024-09-12T02:41:54.807042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:00.508038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077174+0000","last_change":"2024-09-12T02:41:53.784382+0000","last_active":"2024-09-12T02:41:55.077174+0000","last_peered":"2024-09-12T02:41:55.077174+0000","last_clean":"2024-09-12T02:41:55.077174+0000","last_became_active":"2024-09-12T02:41:53.783794+0000","last_became_peered":"2024-09-12T02:41:53.783794+0000","last_unstale":"2024-09-12T02:41:55.077174+0000","last_undegraded":"2024-09-12T02:41:55.077174+0000","last_fullsized":"2024-09-12T02:41:55.077174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:39.931644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077555+0000","last_change":"2024-09-12T02:41:53.802556+0000","last_active":"2024-09-12T02:41:55.077555+0000","last_peered":"2024-09-12T02:41:55.077555+0000","last_clean":"2024-09-12T02:41:55.077555+0000","last_became_active":"2024-09-12T02:41:53.800988+0000","last_became_peered":"2024-09-12T02:41:53.800988+0000","last_unstale":"2024-09-12T02:41:55.077555+0000","last_undegraded":"2024-09-12T02:41:55.077555+0000","last_fullsized":"2024-09-12T02:41:55.077555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:30.535176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078189+0000","last_change":"2024-09-12T02:41:53.797970+0000","last_active":"2024-09-12T02:41:55.078189+0000","last_peered":"2024-09-12T02:41:55.078189+0000","last_clean":"2024-09-12T02:41:55.078189+0000","last_became_active":"2024-09-12T02:41:53.797733+0000","last_became_peered":"2024-09-12T02:41:53.797733+0000","last_unstale":"2024-09-12T02:41:55.078189+0000","last_undegraded":"2024-09-12T02:41:55.078189+0000","last_fullsized":"2024-09-12T02:41:55.078189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:17.074361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077537+0000","last_change":"2024-09-12T02:41:53.791772+0000","last_active":"2024-09-12T02:41:55.077537+0000","last_peered":"2024-09-12T02:41:55.077537+0000","last_clean":"2024-09-12T02:41:55.077537+0000","last_became_active":"2024-09-12T02:41:53.791424+0000","last_became_peered":"2024-09-12T02:41:53.791424+0000","last_unstale":"2024-09-12T02:41:55.077537+0000","last_undegraded":"2024-09-12T02:41:55.077537+0000","last_fullsized":"2024-09-12T02:41:55.077537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:25.569705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077547+0000","last_change":"2024-09-12T02:41:53.793680+0000","last_active":"2024-09-12T02:41:55.077547+0000","last_peered":"2024-09-12T02:41:55.077547+0000","last_clean":"2024-09-12T02:41:55.077547+0000","last_became_active":"2024-09-12T02:41:53.793368+0000","last_became_peered":"2024-09-12T02:41:53.793368+0000","last_unstale":"2024-09-12T02:41:55.077547+0000","last_undegraded":"2024-09-12T02:41:55.077547+0000","last_fullsized":"2024-09-12T02:41:55.077547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:22.379829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778606+0000","last_change":"2024-09-12T02:41:53.792905+0000","last_active":"2024-09-12T02:41:54.778606+0000","last_peered":"2024-09-12T02:41:54.778606+0000","last_clean":"2024-09-12T02:41:54.778606+0000","last_became_active":"2024-09-12T02:41:53.792671+0000","last_became_peered":"2024-09-12T02:41:53.792671+0000","last_unstale":"2024-09-12T02:41:54.778606+0000","last_undegraded":"2024-09-12T02:41:54.778606+0000","last_fullsized":"2024-09-12T02:41:54.778606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:00:54.016660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077148+0000","last_change":"2024-09-12T02:41:53.796393+0000","last_active":"2024-09-12T02:41:55.077148+0000","last_peered":"2024-09-12T02:41:55.077148+0000","last_clean":"2024-09-12T02:41:55.077148+0000","last_became_active":"2024-09-12T02:41:53.793674+0000","last_became_peered":"2024-09-12T02:41:53.793674+0000","last_unstale":"2024-09-12T02:41:55.077148+0000","last_undegraded":"2024-09-12T02:41:55.077148+0000","last_fullsized":"2024-09-12T02:41:55.077148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:54.885587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778956+0000","last_change":"2024-09-12T02:41:53.790533+0000","last_active":"2024-09-12T02:41:54.778956+0000","last_peered":"2024-09-12T02:41:54.778956+0000","last_clean":"2024-09-12T02:41:54.778956+0000","last_became_active":"2024-09-12T02:41:53.790257+0000","last_became_peered":"2024-09-12T02:41:53.790257+0000","last_unstale":"2024-09-12T02:41:54.778956+0000","last_undegraded":"2024-09-12T02:41:54.778956+0000","last_fullsized":"2024-09-12T02:41:54.778956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:36.766374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778448+0000","last_change":"2024-09-12T02:41:53.791181+0000","last_active":"2024-09-12T02:41:54.778448+0000","last_peered":"2024-09-12T02:41:54.778448+0000","last_clean":"2024-09-12T02:41:54.778448+0000","last_became_active":"2024-09-12T02:41:53.790949+0000","last_became_peered":"2024-09-12T02:41:53.790949+0000","last_unstale":"2024-09-12T02:41:54.778448+0000","last_undegraded":"2024-09-12T02:41:54.778448+0000","last_fullsized":"2024-09-12T02:41:54.778448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:00.547705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.777369+0000","last_change":"2024-09-12T02:41:53.798287+0000","last_active":"2024-09-12T02:41:54.777369+0000","last_peered":"2024-09-12T02:41:54.777369+0000","last_clean":"2024-09-12T02:41:54.777369+0000","last_became_active":"2024-09-12T02:41:53.793517+0000","last_became_peered":"2024-09-12T02:41:53.793517+0000","last_unstale":"2024-09-12T02:41:54.777369+0000","last_undegraded":"2024-09-12T02:41:54.777369+0000","last_fullsized":"2024-09-12T02:41:54.777369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:38.907340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778829+0000","last_change":"2024-09-12T02:41:53.789083+0000","last_active":"2024-09-12T02:41:54.778829+0000","last_peered":"2024-09-12T02:41:54.778829+0000","last_clean":"2024-09-12T02:41:54.778829+0000","last_became_active":"2024-09-12T02:41:53.788859+0000","last_became_peered":"2024-09-12T02:41:53.788859+0000","last_unstale":"2024-09-12T02:41:54.778829+0000","last_undegraded":"2024-09-12T02:41:54.778829+0000","last_fullsized":"2024-09-12T02:41:54.778829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:11.768330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.076853+0000","last_change":"2024-09-12T02:41:53.786959+0000","last_active":"2024-09-12T02:41:55.076853+0000","last_peered":"2024-09-12T02:41:55.076853+0000","last_clean":"2024-09-12T02:41:55.076853+0000","last_became_active":"2024-09-12T02:41:53.786741+0000","last_became_peered":"2024-09-12T02:41:53.786741+0000","last_unstale":"2024-09-12T02:41:55.076853+0000","last_undegraded":"2024-09-12T02:41:55.076853+0000","last_fullsized":"2024-09-12T02:41:55.076853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:01.095924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807133+0000","last_change":"2024-09-12T02:41:53.790655+0000","last_active":"2024-09-12T02:41:54.807133+0000","last_peered":"2024-09-12T02:41:54.807133+0000","last_clean":"2024-09-12T02:41:54.807133+0000","last_became_active":"2024-09-12T02:41:53.789451+0000","last_became_peered":"2024-09-12T02:41:53.789451+0000","last_unstale":"2024-09-12T02:41:54.807133+0000","last_undegraded":"2024-09-12T02:41:54.807133+0000","last_fullsized":"2024-09-12T02:41:54.807133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:46.250242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077369+0000","last_change":"2024-09-12T02:41:53.787343+0000","last_active":"2024-09-12T02:41:55.077369+0000","last_peered":"2024-09-12T02:41:55.077369+0000","last_clean":"2024-09-12T02:41:55.077369+0000","last_became_active":"2024-09-12T02:41:53.787093+0000","last_became_peered":"2024-09-12T02:41:53.787093+0000","last_unstale":"2024-09-12T02:41:55.077369+0000","last_undegraded":"2024-09-12T02:41:55.077369+0000","last_fullsized":"2024-09-12T02:41:55.077369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:22.694954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077436+0000","last_change":"2024-09-12T02:41:53.799488+0000","last_active":"2024-09-12T02:41:55.077436+0000","last_peered":"2024-09-12T02:41:55.077436+0000","last_clean":"2024-09-12T02:41:55.077436+0000","last_became_active":"2024-09-12T02:41:53.798618+0000","last_became_peered":"2024-09-12T02:41:53.798618+0000","last_unstale":"2024-09-12T02:41:55.077436+0000","last_undegraded":"2024-09-12T02:41:55.077436+0000","last_fullsized":"2024-09-12T02:41:55.077436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:32.649809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.076898+0000","last_change":"2024-09-12T02:41:53.786850+0000","last_active":"2024-09-12T02:41:55.076898+0000","last_peered":"2024-09-12T02:41:55.076898+0000","last_clean":"2024-09-12T02:41:55.076898+0000","last_became_active":"2024-09-12T02:41:53.786615+0000","last_became_peered":"2024-09-12T02:41:53.786615+0000","last_unstale":"2024-09-12T02:41:55.076898+0000","last_undegraded":"2024-09-12T02:41:55.076898+0000","last_fullsized":"2024-09-12T02:41:55.076898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:21.015757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077473+0000","last_change":"2024-09-12T02:41:53.794425+0000","last_active":"2024-09-12T02:41:55.077473+0000","last_peered":"2024-09-12T02:41:55.077473+0000","last_clean":"2024-09-12T02:41:55.077473+0000","last_became_active":"2024-09-12T02:41:53.793319+0000","last_became_peered":"2024-09-12T02:41:53.793319+0000","last_unstale":"2024-09-12T02:41:55.077473+0000","last_undegraded":"2024-09-12T02:41:55.077473+0000","last_fullsized":"2024-09-12T02:41:55.077473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:04.162670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779169+0000","last_change":"2024-09-12T02:41:53.795094+0000","last_active":"2024-09-12T02:41:54.779169+0000","last_peered":"2024-09-12T02:41:54.779169+0000","last_clean":"2024-09-12T02:41:54.779169+0000","last_became_active":"2024-09-12T02:41:53.794841+0000","last_became_peered":"2024-09-12T02:41:53.794841+0000","last_unstale":"2024-09-12T02:41:54.779169+0000","last_undegraded":"2024-09-12T02:41:54.779169+0000","last_fullsized":"2024-09-12T02:41:54.779169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:58.970487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077484+0000","last_change":"2024-09-12T02:41:53.794039+0000","last_active":"2024-09-12T02:41:55.077484+0000","last_peered":"2024-09-12T02:41:55.077484+0000","last_clean":"2024-09-12T02:41:55.077484+0000","last_became_active":"2024-09-12T02:41:53.793709+0000","last_became_peered":"2024-09-12T02:41:53.793709+0000","last_unstale":"2024-09-12T02:41:55.077484+0000","last_undegraded":"2024-09-12T02:41:55.077484+0000","last_fullsized":"2024-09-12T02:41:55.077484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:53:04.907858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077745+0000","last_change":"2024-09-12T02:41:53.799240+0000","last_active":"2024-09-12T02:41:55.077745+0000","last_peered":"2024-09-12T02:41:55.077745+0000","last_clean":"2024-09-12T02:41:55.077745+0000","last_became_active":"2024-09-12T02:41:53.798310+0000","last_became_peered":"2024-09-12T02:41:53.798310+0000","last_unstale":"2024-09-12T02:41:55.077745+0000","last_undegraded":"2024-09-12T02:41:55.077745+0000","last_fullsized":"2024-09-12T02:41:55.077745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:28.511208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779010+0000","last_change":"2024-09-12T02:41:53.797034+0000","last_active":"2024-09-12T02:41:54.779010+0000","last_peered":"2024-09-12T02:41:54.779010+0000","last_clean":"2024-09-12T02:41:54.779010+0000","last_became_active":"2024-09-12T02:41:53.796810+0000","last_became_peered":"2024-09-12T02:41:53.796810+0000","last_unstale":"2024-09-12T02:41:54.779010+0000","last_undegraded":"2024-09-12T02:41:54.779010+0000","last_fullsized":"2024-09-12T02:41:54.779010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:33.181523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077704+0000","last_change":"2024-09-12T02:41:53.801270+0000","last_active":"2024-09-12T02:41:55.077704+0000","last_peered":"2024-09-12T02:41:55.077704+0000","last_clean":"2024-09-12T02:41:55.077704+0000","last_became_active":"2024-09-12T02:41:53.798339+0000","last_became_peered":"2024-09-12T02:41:53.798339+0000","last_unstale":"2024-09-12T02:41:55.077704+0000","last_undegraded":"2024-09-12T02:41:55.077704+0000","last_fullsized":"2024-09-12T02:41:55.077704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:09.271851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778820+0000","last_change":"2024-09-12T02:41:53.794645+0000","last_active":"2024-09-12T02:41:54.778820+0000","last_peered":"2024-09-12T02:41:54.778820+0000","last_clean":"2024-09-12T02:41:54.778820+0000","last_became_active":"2024-09-12T02:41:53.794420+0000","last_became_peered":"2024-09-12T02:41:53.794420+0000","last_unstale":"2024-09-12T02:41:54.778820+0000","last_undegraded":"2024-09-12T02:41:54.778820+0000","last_fullsized":"2024-09-12T02:41:54.778820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:02.170329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778605+0000","last_change":"2024-09-12T02:41:53.795644+0000","last_active":"2024-09-12T02:41:54.778605+0000","last_peered":"2024-09-12T02:41:54.778605+0000","last_clean":"2024-09-12T02:41:54.778605+0000","last_became_active":"2024-09-12T02:41:53.795305+0000","last_became_peered":"2024-09-12T02:41:53.795305+0000","last_unstale":"2024-09-12T02:41:54.778605+0000","last_undegraded":"2024-09-12T02:41:54.778605+0000","last_fullsized":"2024-09-12T02:41:54.778605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:38.620097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807201+0000","last_change":"2024-09-12T02:41:53.784403+0000","last_active":"2024-09-12T02:41:54.807201+0000","last_peered":"2024-09-12T02:41:54.807201+0000","last_clean":"2024-09-12T02:41:54.807201+0000","last_became_active":"2024-09-12T02:41:53.784173+0000","last_became_peered":"2024-09-12T02:41:53.784173+0000","last_unstale":"2024-09-12T02:41:54.807201+0000","last_undegraded":"2024-09-12T02:41:54.807201+0000","last_fullsized":"2024-09-12T02:41:54.807201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:03.404034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779149+0000","last_change":"2024-09-12T02:41:53.796925+0000","last_active":"2024-09-12T02:41:54.779149+0000","last_peered":"2024-09-12T02:41:54.779149+0000","last_clean":"2024-09-12T02:41:54.779149+0000","last_became_active":"2024-09-12T02:41:53.796640+0000","last_became_peered":"2024-09-12T02:41:53.796640+0000","last_unstale":"2024-09-12T02:41:54.779149+0000","last_undegraded":"2024-09-12T02:41:54.779149+0000","last_fullsized":"2024-09-12T02:41:54.779149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:05.118176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.076988+0000","last_change":"2024-09-12T02:41:53.784042+0000","last_active":"2024-09-12T02:41:55.076988+0000","last_peered":"2024-09-12T02:41:55.076988+0000","last_clean":"2024-09-12T02:41:55.076988+0000","last_became_active":"2024-09-12T02:41:53.783817+0000","last_became_peered":"2024-09-12T02:41:53.783817+0000","last_unstale":"2024-09-12T02:41:55.076988+0000","last_undegraded":"2024-09-12T02:41:55.076988+0000","last_fullsized":"2024-09-12T02:41:55.076988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:31.997189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077165+0000","last_change":"2024-09-12T02:41:53.796678+0000","last_active":"2024-09-12T02:41:55.077165+0000","last_peered":"2024-09-12T02:41:55.077165+0000","last_clean":"2024-09-12T02:41:55.077165+0000","last_became_active":"2024-09-12T02:41:53.796473+0000","last_became_peered":"2024-09-12T02:41:53.796473+0000","last_unstale":"2024-09-12T02:41:55.077165+0000","last_undegraded":"2024-09-12T02:41:55.077165+0000","last_fullsized":"2024-09-12T02:41:55.077165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:14.697130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.076930+0000","last_change":"2024-09-12T02:41:53.787664+0000","last_active":"2024-09-12T02:41:55.076930+0000","last_peered":"2024-09-12T02:41:55.076930+0000","last_clean":"2024-09-12T02:41:55.076930+0000","last_became_active":"2024-09-12T02:41:53.786817+0000","last_became_peered":"2024-09-12T02:41:53.786817+0000","last_unstale":"2024-09-12T02:41:55.076930+0000","last_undegraded":"2024-09-12T02:41:55.076930+0000","last_fullsized":"2024-09-12T02:41:55.076930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:02.531079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778460+0000","last_change":"2024-09-12T02:41:53.785375+0000","last_active":"2024-09-12T02:41:54.778460+0000","last_peered":"2024-09-12T02:41:54.778460+0000","last_clean":"2024-09-12T02:41:54.778460+0000","last_became_active":"2024-09-12T02:41:53.785070+0000","last_became_peered":"2024-09-12T02:41:53.785070+0000","last_unstale":"2024-09-12T02:41:54.778460+0000","last_undegraded":"2024-09-12T02:41:54.778460+0000","last_fullsized":"2024-09-12T02:41:54.778460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:49.213437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.777581+0000","last_change":"2024-09-12T02:41:53.795446+0000","last_active":"2024-09-12T02:41:54.777581+0000","last_peered":"2024-09-12T02:41:54.777581+0000","last_clean":"2024-09-12T02:41:54.777581+0000","last_became_active":"2024-09-12T02:41:53.795189+0000","last_became_peered":"2024-09-12T02:41:53.795189+0000","last_unstale":"2024-09-12T02:41:54.777581+0000","last_undegraded":"2024-09-12T02:41:54.777581+0000","last_fullsized":"2024-09-12T02:41:54.777581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:31.783821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779103+0000","last_change":"2024-09-12T02:41:52.782761+0000","last_active":"2024-09-12T02:41:54.779103+0000","last_peered":"2024-09-12T02:41:54.779103+0000","last_clean":"2024-09-12T02:41:54.779103+0000","last_became_active":"2024-09-12T02:41:52.782565+0000","last_became_peered":"2024-09-12T02:41:52.782565+0000","last_unstale":"2024-09-12T02:41:54.779103+0000","last_undegraded":"2024-09-12T02:41:54.779103+0000","last_fullsized":"2024-09-12T02:41:54.779103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:21.927114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077231+0000","last_change":"2024-09-12T02:41:53.791180+0000","last_active":"2024-09-12T02:41:55.077231+0000","last_peered":"2024-09-12T02:41:55.077231+0000","last_clean":"2024-09-12T02:41:55.077231+0000","last_became_active":"2024-09-12T02:41:53.790843+0000","last_became_peered":"2024-09-12T02:41:53.790843+0000","last_unstale":"2024-09-12T02:41:55.077231+0000","last_undegraded":"2024-09-12T02:41:55.077231+0000","last_fullsized":"2024-09-12T02:41:55.077231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:58.801201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778651+0000","last_change":"2024-09-12T02:41:52.775582+0000","last_active":"2024-09-12T02:41:54.778651+0000","last_peered":"2024-09-12T02:41:54.778651+0000","last_clean":"2024-09-12T02:41:54.778651+0000","last_became_active":"2024-09-12T02:41:52.774577+0000","last_became_peered":"2024-09-12T02:41:52.774577+0000","last_unstale":"2024-09-12T02:41:54.778651+0000","last_undegraded":"2024-09-12T02:41:54.778651+0000","last_fullsized":"2024-09-12T02:41:54.778651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:36.018405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779210+0000","last_change":"2024-09-12T02:41:52.777181+0000","last_active":"2024-09-12T02:41:54.779210+0000","last_peered":"2024-09-12T02:41:54.779210+0000","last_clean":"2024-09-12T02:41:54.779210+0000","last_became_active":"2024-09-12T02:41:52.773406+0000","last_became_peered":"2024-09-12T02:41:52.773406+0000","last_unstale":"2024-09-12T02:41:54.779210+0000","last_undegraded":"2024-09-12T02:41:54.779210+0000","last_fullsized":"2024-09-12T02:41:54.779210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:20.740967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778971+0000","last_change":"2024-09-12T02:41:53.784557+0000","last_active":"2024-09-12T02:41:54.778971+0000","last_peered":"2024-09-12T02:41:54.778971+0000","last_clean":"2024-09-12T02:41:54.778971+0000","last_became_active":"2024-09-12T02:41:53.784163+0000","last_became_peered":"2024-09-12T02:41:53.784163+0000","last_unstale":"2024-09-12T02:41:54.778971+0000","last_undegraded":"2024-09-12T02:41:54.778971+0000","last_fullsized":"2024-09-12T02:41:54.778971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:37.011519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077434+0000","last_change":"2024-09-12T02:41:52.783587+0000","last_active":"2024-09-12T02:41:55.077434+0000","last_peered":"2024-09-12T02:41:55.077434+0000","last_clean":"2024-09-12T02:41:55.077434+0000","last_became_active":"2024-09-12T02:41:52.783418+0000","last_became_peered":"2024-09-12T02:41:52.783418+0000","last_unstale":"2024-09-12T02:41:55.077434+0000","last_undegraded":"2024-09-12T02:41:55.077434+0000","last_fullsized":"2024-09-12T02:41:55.077434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:39:33.808133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807122+0000","last_change":"2024-09-12T02:41:53.792483+0000","last_active":"2024-09-12T02:41:54.807122+0000","last_peered":"2024-09-12T02:41:54.807122+0000","last_clean":"2024-09-12T02:41:54.807122+0000","last_became_active":"2024-09-12T02:41:53.791556+0000","last_became_peered":"2024-09-12T02:41:53.791556+0000","last_unstale":"2024-09-12T02:41:54.807122+0000","last_undegraded":"2024-09-12T02:41:54.807122+0000","last_fullsized":"2024-09-12T02:41:54.807122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:27.695745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778786+0000","last_change":"2024-09-12T02:41:52.771541+0000","last_active":"2024-09-12T02:41:54.778786+0000","last_peered":"2024-09-12T02:41:54.778786+0000","last_clean":"2024-09-12T02:41:54.778786+0000","last_became_active":"2024-09-12T02:41:52.770232+0000","last_became_peered":"2024-09-12T02:41:52.770232+0000","last_unstale":"2024-09-12T02:41:54.778786+0000","last_undegraded":"2024-09-12T02:41:54.778786+0000","last_fullsized":"2024-09-12T02:41:54.778786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:13.405791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077589+0000","last_change":"2024-09-12T02:41:53.799033+0000","last_active":"2024-09-12T02:41:55.077589+0000","last_peered":"2024-09-12T02:41:55.077589+0000","last_clean":"2024-09-12T02:41:55.077589+0000","last_became_active":"2024-09-12T02:41:53.797973+0000","last_became_peered":"2024-09-12T02:41:53.797973+0000","last_unstale":"2024-09-12T02:41:55.077589+0000","last_undegraded":"2024-09-12T02:41:55.077589+0000","last_fullsized":"2024-09-12T02:41:55.077589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:12.141704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078072+0000","last_change":"2024-09-12T02:41:52.780065+0000","last_active":"2024-09-12T02:41:55.078072+0000","last_peered":"2024-09-12T02:41:55.078072+0000","last_clean":"2024-09-12T02:41:55.078072+0000","last_became_active":"2024-09-12T02:41:52.778398+0000","last_became_peered":"2024-09-12T02:41:52.778398+0000","last_unstale":"2024-09-12T02:41:55.078072+0000","last_undegraded":"2024-09-12T02:41:55.078072+0000","last_fullsized":"2024-09-12T02:41:55.078072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:58.549424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077632+0000","last_change":"2024-09-12T02:41:53.788794+0000","last_active":"2024-09-12T02:41:55.077632+0000","last_peered":"2024-09-12T02:41:55.077632+0000","last_clean":"2024-09-12T02:41:55.077632+0000","last_became_active":"2024-09-12T02:41:53.788300+0000","last_became_peered":"2024-09-12T02:41:53.788300+0000","last_unstale":"2024-09-12T02:41:55.077632+0000","last_undegraded":"2024-09-12T02:41:55.077632+0000","last_fullsized":"2024-09-12T02:41:55.077632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:45.111485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807225+0000","last_change":"2024-09-12T02:41:52.781616+0000","last_active":"2024-09-12T02:41:54.807225+0000","last_peered":"2024-09-12T02:41:54.807225+0000","last_clean":"2024-09-12T02:41:54.807225+0000","last_became_active":"2024-09-12T02:41:52.781376+0000","last_became_peered":"2024-09-12T02:41:52.781376+0000","last_unstale":"2024-09-12T02:41:54.807225+0000","last_undegraded":"2024-09-12T02:41:54.807225+0000","last_fullsized":"2024-09-12T02:41:54.807225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:29.040560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.777378+0000","last_change":"2024-09-12T02:41:53.801788+0000","last_active":"2024-09-12T02:41:54.777378+0000","last_peered":"2024-09-12T02:41:54.777378+0000","last_clean":"2024-09-12T02:41:54.777378+0000","last_became_active":"2024-09-12T02:41:53.801572+0000","last_became_peered":"2024-09-12T02:41:53.801572+0000","last_unstale":"2024-09-12T02:41:54.777378+0000","last_undegraded":"2024-09-12T02:41:54.777378+0000","last_fullsized":"2024-09-12T02:41:54.777378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:44.395638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778605+0000","last_change":"2024-09-12T02:41:52.776998+0000","last_active":"2024-09-12T02:41:54.778605+0000","last_peered":"2024-09-12T02:41:54.778605+0000","last_clean":"2024-09-12T02:41:54.778605+0000","last_became_active":"2024-09-12T02:41:52.776765+0000","last_became_peered":"2024-09-12T02:41:52.776765+0000","last_unstale":"2024-09-12T02:41:54.778605+0000","last_undegraded":"2024-09-12T02:41:54.778605+0000","last_fullsized":"2024-09-12T02:41:54.778605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:34.024741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077170+0000","last_change":"2024-09-12T02:41:53.795517+0000","last_active":"2024-09-12T02:41:55.077170+0000","last_peered":"2024-09-12T02:41:55.077170+0000","last_clean":"2024-09-12T02:41:55.077170+0000","last_became_active":"2024-09-12T02:41:53.795260+0000","last_became_peered":"2024-09-12T02:41:53.795260+0000","last_unstale":"2024-09-12T02:41:55.077170+0000","last_undegraded":"2024-09-12T02:41:55.077170+0000","last_fullsized":"2024-09-12T02:41:55.077170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:41.612631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077159+0000","last_change":"2024-09-12T02:41:52.770092+0000","last_active":"2024-09-12T02:41:55.077159+0000","last_peered":"2024-09-12T02:41:55.077159+0000","last_clean":"2024-09-12T02:41:55.077159+0000","last_became_active":"2024-09-12T02:41:52.769364+0000","last_became_peered":"2024-09-12T02:41:52.769364+0000","last_unstale":"2024-09-12T02:41:55.077159+0000","last_undegraded":"2024-09-12T02:41:55.077159+0000","last_fullsized":"2024-09-12T02:41:55.077159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:59.882002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077762+0000","last_change":"2024-09-12T02:41:53.793864+0000","last_active":"2024-09-12T02:41:55.077762+0000","last_peered":"2024-09-12T02:41:55.077762+0000","last_clean":"2024-09-12T02:41:55.077762+0000","last_became_active":"2024-09-12T02:41:53.793422+0000","last_became_peered":"2024-09-12T02:41:53.793422+0000","last_unstale":"2024-09-12T02:41:55.077762+0000","last_undegraded":"2024-09-12T02:41:55.077762+0000","last_fullsized":"2024-09-12T02:41:55.077762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:46.256453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078076+0000","last_change":"2024-09-12T02:41:52.780555+0000","last_active":"2024-09-12T02:41:55.078076+0000","last_peered":"2024-09-12T02:41:55.078076+0000","last_clean":"2024-09-12T02:41:55.078076+0000","last_became_active":"2024-09-12T02:41:52.775956+0000","last_became_peered":"2024-09-12T02:41:52.775956+0000","last_unstale":"2024-09-12T02:41:55.078076+0000","last_undegraded":"2024-09-12T02:41:55.078076+0000","last_fullsized":"2024-09-12T02:41:55.078076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:07.893393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078331+0000","last_change":"2024-09-12T02:41:53.803353+0000","last_active":"2024-09-12T02:41:55.078331+0000","last_peered":"2024-09-12T02:41:55.078331+0000","last_clean":"2024-09-12T02:41:55.078331+0000","last_became_active":"2024-09-12T02:41:53.802739+0000","last_became_peered":"2024-09-12T02:41:53.802739+0000","last_unstale":"2024-09-12T02:41:55.078331+0000","last_undegraded":"2024-09-12T02:41:55.078331+0000","last_fullsized":"2024-09-12T02:41:55.078331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:54.124099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778844+0000","last_change":"2024-09-12T02:41:52.766630+0000","last_active":"2024-09-12T02:41:54.778844+0000","last_peered":"2024-09-12T02:41:54.778844+0000","last_clean":"2024-09-12T02:41:54.778844+0000","last_became_active":"2024-09-12T02:41:52.766146+0000","last_became_peered":"2024-09-12T02:41:52.766146+0000","last_unstale":"2024-09-12T02:41:54.778844+0000","last_undegraded":"2024-09-12T02:41:54.778844+0000","last_fullsized":"2024-09-12T02:41:54.778844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:54.001676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778544+0000","last_change":"2024-09-12T02:41:53.786241+0000","last_active":"2024-09-12T02:41:54.778544+0000","last_peered":"2024-09-12T02:41:54.778544+0000","last_clean":"2024-09-12T02:41:54.778544+0000","last_became_active":"2024-09-12T02:41:53.785997+0000","last_became_peered":"2024-09-12T02:41:53.785997+0000","last_unstale":"2024-09-12T02:41:54.778544+0000","last_undegraded":"2024-09-12T02:41:54.778544+0000","last_fullsized":"2024-09-12T02:41:54.778544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:54.645416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.076987+0000","last_change":"2024-09-12T02:41:52.775019+0000","last_active":"2024-09-12T02:41:55.076987+0000","last_peered":"2024-09-12T02:41:55.076987+0000","last_clean":"2024-09-12T02:41:55.076987+0000","last_became_active":"2024-09-12T02:41:52.774766+0000","last_became_peered":"2024-09-12T02:41:52.774766+0000","last_unstale":"2024-09-12T02:41:55.076987+0000","last_undegraded":"2024-09-12T02:41:55.076987+0000","last_fullsized":"2024-09-12T02:41:55.076987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:28.082972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077793+0000","last_change":"2024-09-12T02:41:53.803073+0000","last_active":"2024-09-12T02:41:55.077793+0000","last_peered":"2024-09-12T02:41:55.077793+0000","last_clean":"2024-09-12T02:41:55.077793+0000","last_became_active":"2024-09-12T02:41:53.802791+0000","last_became_peered":"2024-09-12T02:41:53.802791+0000","last_unstale":"2024-09-12T02:41:55.077793+0000","last_undegraded":"2024-09-12T02:41:55.077793+0000","last_fullsized":"2024-09-12T02:41:55.077793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:14.115868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.777508+0000","last_change":"2024-09-12T02:41:52.767949+0000","last_active":"2024-09-12T02:41:54.777508+0000","last_peered":"2024-09-12T02:41:54.777508+0000","last_clean":"2024-09-12T02:41:54.777508+0000","last_became_active":"2024-09-12T02:41:52.767666+0000","last_became_peered":"2024-09-12T02:41:52.767666+0000","last_unstale":"2024-09-12T02:41:54.777508+0000","last_undegraded":"2024-09-12T02:41:54.777508+0000","last_fullsized":"2024-09-12T02:41:54.777508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:17.680737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078475+0000","last_change":"2024-09-12T02:41:53.803540+0000","last_active":"2024-09-12T02:41:55.078475+0000","last_peered":"2024-09-12T02:41:55.078475+0000","last_clean":"2024-09-12T02:41:55.078475+0000","last_became_active":"2024-09-12T02:41:53.803074+0000","last_became_peered":"2024-09-12T02:41:53.803074+0000","last_unstale":"2024-09-12T02:41:55.078475+0000","last_undegraded":"2024-09-12T02:41:55.078475+0000","last_fullsized":"2024-09-12T02:41:55.078475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:39.415488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077285+0000","last_change":"2024-09-12T02:41:52.776749+0000","last_active":"2024-09-12T02:41:55.077285+0000","last_peered":"2024-09-12T02:41:55.077285+0000","last_clean":"2024-09-12T02:41:55.077285+0000","last_became_active":"2024-09-12T02:41:52.776495+0000","last_became_peered":"2024-09-12T02:41:52.776495+0000","last_unstale":"2024-09-12T02:41:55.077285+0000","last_undegraded":"2024-09-12T02:41:55.077285+0000","last_fullsized":"2024-09-12T02:41:55.077285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:58.485267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077321+0000","last_change":"2024-09-12T02:41:53.803271+0000","last_active":"2024-09-12T02:41:55.077321+0000","last_peered":"2024-09-12T02:41:55.077321+0000","last_clean":"2024-09-12T02:41:55.077321+0000","last_became_active":"2024-09-12T02:41:53.802960+0000","last_became_peered":"2024-09-12T02:41:53.802960+0000","last_unstale":"2024-09-12T02:41:55.077321+0000","last_undegraded":"2024-09-12T02:41:55.077321+0000","last_fullsized":"2024-09-12T02:41:55.077321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:11.896253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807044+0000","last_change":"2024-09-12T02:41:52.775195+0000","last_active":"2024-09-12T02:41:54.807044+0000","last_peered":"2024-09-12T02:41:54.807044+0000","last_clean":"2024-09-12T02:41:54.807044+0000","last_became_active":"2024-09-12T02:41:52.774945+0000","last_became_peered":"2024-09-12T02:41:52.774945+0000","last_unstale":"2024-09-12T02:41:54.807044+0000","last_undegraded":"2024-09-12T02:41:54.807044+0000","last_fullsized":"2024-09-12T02:41:54.807044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:35.355898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077903+0000","last_change":"2024-09-12T02:41:53.787875+0000","last_active":"2024-09-12T02:41:55.077903+0000","last_peered":"2024-09-12T02:41:55.077903+0000","last_clean":"2024-09-12T02:41:55.077903+0000","last_became_active":"2024-09-12T02:41:53.787636+0000","last_became_peered":"2024-09-12T02:41:53.787636+0000","last_unstale":"2024-09-12T02:41:55.077903+0000","last_undegraded":"2024-09-12T02:41:55.077903+0000","last_fullsized":"2024-09-12T02:41:55.077903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:18.244809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.076853+0000","last_change":"2024-09-12T02:41:52.781866+0000","last_active":"2024-09-12T02:41:55.076853+0000","last_peered":"2024-09-12T02:41:55.076853+0000","last_clean":"2024-09-12T02:41:55.076853+0000","last_became_active":"2024-09-12T02:41:52.781637+0000","last_became_peered":"2024-09-12T02:41:52.781637+0000","last_unstale":"2024-09-12T02:41:55.076853+0000","last_undegraded":"2024-09-12T02:41:55.076853+0000","last_fullsized":"2024-09-12T02:41:55.076853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:44.675773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078815+0000","last_change":"2024-09-12T02:41:53.802186+0000","last_active":"2024-09-12T02:41:55.078815+0000","last_peered":"2024-09-12T02:41:55.078815+0000","last_clean":"2024-09-12T02:41:55.078815+0000","last_became_active":"2024-09-12T02:41:53.801944+0000","last_became_peered":"2024-09-12T02:41:53.801944+0000","last_unstale":"2024-09-12T02:41:55.078815+0000","last_undegraded":"2024-09-12T02:41:55.078815+0000","last_fullsized":"2024-09-12T02:41:55.078815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:27.413007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077804+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:41:55.077804+0000","last_peered":"2024-09-12T02:41:55.077804+0000","last_clean":"2024-09-12T02:41:55.077804+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:41:55.077804+0000","last_undegraded":"2024-09-12T02:41:55.077804+0000","last_fullsized":"2024-09-12T02:41:55.077804+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:45.426902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078266+0000","last_change":"2024-09-12T02:41:52.783100+0000","last_active":"2024-09-12T02:41:55.078266+0000","last_peered":"2024-09-12T02:41:55.078266+0000","last_clean":"2024-09-12T02:41:55.078266+0000","last_became_active":"2024-09-12T02:41:52.782739+0000","last_became_peered":"2024-09-12T02:41:52.782739+0000","last_unstale":"2024-09-12T02:41:55.078266+0000","last_undegraded":"2024-09-12T02:41:55.078266+0000","last_fullsized":"2024-09-12T02:41:55.078266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:12.279581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778908+0000","last_change":"2024-09-12T02:41:53.793492+0000","last_active":"2024-09-12T02:41:54.778908+0000","last_peered":"2024-09-12T02:41:54.778908+0000","last_clean":"2024-09-12T02:41:54.778908+0000","last_became_active":"2024-09-12T02:41:53.791680+0000","last_became_peered":"2024-09-12T02:41:53.791680+0000","last_unstale":"2024-09-12T02:41:54.778908+0000","last_undegraded":"2024-09-12T02:41:54.778908+0000","last_fullsized":"2024-09-12T02:41:54.778908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:00.054064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077698+0000","last_change":"2024-09-12T02:41:52.781604+0000","last_active":"2024-09-12T02:41:55.077698+0000","last_peered":"2024-09-12T02:41:55.077698+0000","last_clean":"2024-09-12T02:41:55.077698+0000","last_became_active":"2024-09-12T02:41:52.780183+0000","last_became_peered":"2024-09-12T02:41:52.780183+0000","last_unstale":"2024-09-12T02:41:55.077698+0000","last_undegraded":"2024-09-12T02:41:55.077698+0000","last_fullsized":"2024-09-12T02:41:55.077698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:00.663730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077610+0000","last_change":"2024-09-12T02:41:53.795877+0000","last_active":"2024-09-12T02:41:55.077610+0000","last_peered":"2024-09-12T02:41:55.077610+0000","last_clean":"2024-09-12T02:41:55.077610+0000","last_became_active":"2024-09-12T02:41:53.795603+0000","last_became_peered":"2024-09-12T02:41:53.795603+0000","last_unstale":"2024-09-12T02:41:55.077610+0000","last_undegraded":"2024-09-12T02:41:55.077610+0000","last_fullsized":"2024-09-12T02:41:55.077610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:16.241955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077097+0000","last_change":"2024-09-12T02:41:52.779295+0000","last_active":"2024-09-12T02:41:55.077097+0000","last_peered":"2024-09-12T02:41:55.077097+0000","last_clean":"2024-09-12T02:41:55.077097+0000","last_became_active":"2024-09-12T02:41:52.778794+0000","last_became_peered":"2024-09-12T02:41:52.778794+0000","last_unstale":"2024-09-12T02:41:55.077097+0000","last_undegraded":"2024-09-12T02:41:55.077097+0000","last_fullsized":"2024-09-12T02:41:55.077097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:37.479001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807228+0000","last_change":"2024-09-12T02:41:53.787507+0000","last_active":"2024-09-12T02:41:54.807228+0000","last_peered":"2024-09-12T02:41:54.807228+0000","last_clean":"2024-09-12T02:41:54.807228+0000","last_became_active":"2024-09-12T02:41:53.787303+0000","last_became_peered":"2024-09-12T02:41:53.787303+0000","last_unstale":"2024-09-12T02:41:54.807228+0000","last_undegraded":"2024-09-12T02:41:54.807228+0000","last_fullsized":"2024-09-12T02:41:54.807228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:19.802083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078131+0000","last_change":"2024-09-12T02:41:52.785347+0000","last_active":"2024-09-12T02:41:55.078131+0000","last_peered":"2024-09-12T02:41:55.078131+0000","last_clean":"2024-09-12T02:41:55.078131+0000","last_became_active":"2024-09-12T02:41:52.784154+0000","last_became_peered":"2024-09-12T02:41:52.784154+0000","last_unstale":"2024-09-12T02:41:55.078131+0000","last_undegraded":"2024-09-12T02:41:55.078131+0000","last_fullsized":"2024-09-12T02:41:55.078131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:21:04.142656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.777403+0000","last_change":"2024-09-12T02:41:53.796131+0000","last_active":"2024-09-12T02:41:54.777403+0000","last_peered":"2024-09-12T02:41:54.777403+0000","last_clean":"2024-09-12T02:41:54.777403+0000","last_became_active":"2024-09-12T02:41:53.795889+0000","last_became_peered":"2024-09-12T02:41:53.795889+0000","last_unstale":"2024-09-12T02:41:54.777403+0000","last_undegraded":"2024-09-12T02:41:54.777403+0000","last_fullsized":"2024-09-12T02:41:54.777403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:58:40.501110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807255+0000","last_change":"2024-09-12T02:41:52.773305+0000","last_active":"2024-09-12T02:41:54.807255+0000","last_peered":"2024-09-12T02:41:54.807255+0000","last_clean":"2024-09-12T02:41:54.807255+0000","last_became_active":"2024-09-12T02:41:52.773009+0000","last_became_peered":"2024-09-12T02:41:52.773009+0000","last_unstale":"2024-09-12T02:41:54.807255+0000","last_undegraded":"2024-09-12T02:41:54.807255+0000","last_fullsized":"2024-09-12T02:41:54.807255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:41:48.173306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077855+0000","last_change":"2024-09-12T02:41:53.789700+0000","last_active":"2024-09-12T02:41:55.077855+0000","last_peered":"2024-09-12T02:41:55.077855+0000","last_clean":"2024-09-12T02:41:55.077855+0000","last_became_active":"2024-09-12T02:41:53.789445+0000","last_became_peered":"2024-09-12T02:41:53.789445+0000","last_unstale":"2024-09-12T02:41:55.077855+0000","last_undegraded":"2024-09-12T02:41:55.077855+0000","last_fullsized":"2024-09-12T02:41:55.077855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:21.533372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077584+0000","last_change":"2024-09-12T02:41:52.783557+0000","last_active":"2024-09-12T02:41:55.077584+0000","last_peered":"2024-09-12T02:41:55.077584+0000","last_clean":"2024-09-12T02:41:55.077584+0000","last_became_active":"2024-09-12T02:41:52.782015+0000","last_became_peered":"2024-09-12T02:41:52.782015+0000","last_unstale":"2024-09-12T02:41:55.077584+0000","last_undegraded":"2024-09-12T02:41:55.077584+0000","last_fullsized":"2024-09-12T02:41:55.077584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:07.909958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807020+0000","last_change":"2024-09-12T02:41:53.791158+0000","last_active":"2024-09-12T02:41:54.807020+0000","last_peered":"2024-09-12T02:41:54.807020+0000","last_clean":"2024-09-12T02:41:54.807020+0000","last_became_active":"2024-09-12T02:41:53.789727+0000","last_became_peered":"2024-09-12T02:41:53.789727+0000","last_unstale":"2024-09-12T02:41:54.807020+0000","last_undegraded":"2024-09-12T02:41:54.807020+0000","last_fullsized":"2024-09-12T02:41:54.807020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:21.893126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807346+0000","last_change":"2024-09-12T02:41:52.773054+0000","last_active":"2024-09-12T02:41:54.807346+0000","last_peered":"2024-09-12T02:41:54.807346+0000","last_clean":"2024-09-12T02:41:54.807346+0000","last_became_active":"2024-09-12T02:41:52.772715+0000","last_became_peered":"2024-09-12T02:41:52.772715+0000","last_unstale":"2024-09-12T02:41:54.807346+0000","last_undegraded":"2024-09-12T02:41:54.807346+0000","last_fullsized":"2024-09-12T02:41:54.807346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:27.523535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778750+0000","last_change":"2024-09-12T02:41:53.794838+0000","last_active":"2024-09-12T02:41:54.778750+0000","last_peered":"2024-09-12T02:41:54.778750+0000","last_clean":"2024-09-12T02:41:54.778750+0000","last_became_active":"2024-09-12T02:41:53.794622+0000","last_became_peered":"2024-09-12T02:41:53.794622+0000","last_unstale":"2024-09-12T02:41:54.778750+0000","last_undegraded":"2024-09-12T02:41:54.778750+0000","last_fullsized":"2024-09-12T02:41:54.778750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:07.720321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778964+0000","last_change":"2024-09-12T02:41:52.782851+0000","last_active":"2024-09-12T02:41:54.778964+0000","last_peered":"2024-09-12T02:41:54.778964+0000","last_clean":"2024-09-12T02:41:54.778964+0000","last_became_active":"2024-09-12T02:41:52.782365+0000","last_became_peered":"2024-09-12T02:41:52.782365+0000","last_unstale":"2024-09-12T02:41:54.778964+0000","last_undegraded":"2024-09-12T02:41:54.778964+0000","last_fullsized":"2024-09-12T02:41:54.778964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:02.356143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077330+0000","last_change":"2024-09-12T02:41:53.782924+0000","last_active":"2024-09-12T02:41:55.077330+0000","last_peered":"2024-09-12T02:41:55.077330+0000","last_clean":"2024-09-12T02:41:55.077330+0000","last_became_active":"2024-09-12T02:41:53.782612+0000","last_became_peered":"2024-09-12T02:41:53.782612+0000","last_unstale":"2024-09-12T02:41:55.077330+0000","last_undegraded":"2024-09-12T02:41:55.077330+0000","last_fullsized":"2024-09-12T02:41:55.077330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:09.015161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.079091+0000","last_change":"2024-09-12T02:41:52.783151+0000","last_active":"2024-09-12T02:41:55.079091+0000","last_peered":"2024-09-12T02:41:55.079091+0000","last_clean":"2024-09-12T02:41:55.079091+0000","last_became_active":"2024-09-12T02:41:52.781789+0000","last_became_peered":"2024-09-12T02:41:52.781789+0000","last_unstale":"2024-09-12T02:41:55.079091+0000","last_undegraded":"2024-09-12T02:41:55.079091+0000","last_fullsized":"2024-09-12T02:41:55.079091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:30.446920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778208+0000","last_change":"2024-09-12T02:41:53.792907+0000","last_active":"2024-09-12T02:41:54.778208+0000","last_peered":"2024-09-12T02:41:54.778208+0000","last_clean":"2024-09-12T02:41:54.778208+0000","last_became_active":"2024-09-12T02:41:53.789159+0000","last_became_peered":"2024-09-12T02:41:53.789159+0000","last_unstale":"2024-09-12T02:41:54.778208+0000","last_undegraded":"2024-09-12T02:41:54.778208+0000","last_fullsized":"2024-09-12T02:41:54.778208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:40.658393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807185+0000","last_change":"2024-09-12T02:41:52.784747+0000","last_active":"2024-09-12T02:41:54.807185+0000","last_peered":"2024-09-12T02:41:54.807185+0000","last_clean":"2024-09-12T02:41:54.807185+0000","last_became_active":"2024-09-12T02:41:52.784558+0000","last_became_peered":"2024-09-12T02:41:52.784558+0000","last_unstale":"2024-09-12T02:41:54.807185+0000","last_undegraded":"2024-09-12T02:41:54.807185+0000","last_fullsized":"2024-09-12T02:41:54.807185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:25.686682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778690+0000","last_change":"2024-09-12T02:41:53.793644+0000","last_active":"2024-09-12T02:41:54.778690+0000","last_peered":"2024-09-12T02:41:54.778690+0000","last_clean":"2024-09-12T02:41:54.778690+0000","last_became_active":"2024-09-12T02:41:53.793439+0000","last_became_peered":"2024-09-12T02:41:53.793439+0000","last_unstale":"2024-09-12T02:41:54.778690+0000","last_undegraded":"2024-09-12T02:41:54.778690+0000","last_fullsized":"2024-09-12T02:41:54.778690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:25:59.472325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.807287+0000","last_change":"2024-09-12T02:41:52.780636+0000","last_active":"2024-09-12T02:41:54.807287+0000","last_peered":"2024-09-12T02:41:54.807287+0000","last_clean":"2024-09-12T02:41:54.807287+0000","last_became_active":"2024-09-12T02:41:52.780347+0000","last_became_peered":"2024-09-12T02:41:52.780347+0000","last_unstale":"2024-09-12T02:41:54.807287+0000","last_undegraded":"2024-09-12T02:41:54.807287+0000","last_fullsized":"2024-09-12T02:41:54.807287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:46.086664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779261+0000","last_change":"2024-09-12T02:41:53.784952+0000","last_active":"2024-09-12T02:41:54.779261+0000","last_peered":"2024-09-12T02:41:54.779261+0000","last_clean":"2024-09-12T02:41:54.779261+0000","last_became_active":"2024-09-12T02:41:53.784276+0000","last_became_peered":"2024-09-12T02:41:53.784276+0000","last_unstale":"2024-09-12T02:41:54.779261+0000","last_undegraded":"2024-09-12T02:41:54.779261+0000","last_fullsized":"2024-09-12T02:41:54.779261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:53.702199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077279+0000","last_change":"2024-09-12T02:41:52.783869+0000","last_active":"2024-09-12T02:41:55.077279+0000","last_peered":"2024-09-12T02:41:55.077279+0000","last_clean":"2024-09-12T02:41:55.077279+0000","last_became_active":"2024-09-12T02:41:52.781705+0000","last_became_peered":"2024-09-12T02:41:52.781705+0000","last_unstale":"2024-09-12T02:41:55.077279+0000","last_undegraded":"2024-09-12T02:41:55.077279+0000","last_fullsized":"2024-09-12T02:41:55.077279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:28.710814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.778514+0000","last_change":"2024-09-12T02:41:53.802125+0000","last_active":"2024-09-12T02:41:54.778514+0000","last_peered":"2024-09-12T02:41:54.778514+0000","last_clean":"2024-09-12T02:41:54.778514+0000","last_became_active":"2024-09-12T02:41:53.801855+0000","last_became_peered":"2024-09-12T02:41:53.801855+0000","last_unstale":"2024-09-12T02:41:54.778514+0000","last_undegraded":"2024-09-12T02:41:54.778514+0000","last_fullsized":"2024-09-12T02:41:54.778514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:56.017190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077335+0000","last_change":"2024-09-12T02:41:53.796199+0000","last_active":"2024-09-12T02:41:55.077335+0000","last_peered":"2024-09-12T02:41:55.077335+0000","last_clean":"2024-09-12T02:41:55.077335+0000","last_became_active":"2024-09-12T02:41:53.793833+0000","last_became_peered":"2024-09-12T02:41:53.793833+0000","last_unstale":"2024-09-12T02:41:55.077335+0000","last_undegraded":"2024-09-12T02:41:55.077335+0000","last_fullsized":"2024-09-12T02:41:55.077335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:06.451667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078990+0000","last_change":"2024-09-12T02:41:52.785769+0000","last_active":"2024-09-12T02:41:55.078990+0000","last_peered":"2024-09-12T02:41:55.078990+0000","last_clean":"2024-09-12T02:41:55.078990+0000","last_became_active":"2024-09-12T02:41:52.785498+0000","last_became_peered":"2024-09-12T02:41:52.785498+0000","last_unstale":"2024-09-12T02:41:55.078990+0000","last_undegraded":"2024-09-12T02:41:55.078990+0000","last_fullsized":"2024-09-12T02:41:55.078990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:06.766309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077706+0000","last_change":"2024-09-12T02:41:53.797692+0000","last_active":"2024-09-12T02:41:55.077706+0000","last_peered":"2024-09-12T02:41:55.077706+0000","last_clean":"2024-09-12T02:41:55.077706+0000","last_became_active":"2024-09-12T02:41:53.797478+0000","last_became_peered":"2024-09-12T02:41:53.797478+0000","last_unstale":"2024-09-12T02:41:55.077706+0000","last_undegraded":"2024-09-12T02:41:55.077706+0000","last_fullsized":"2024-09-12T02:41:55.077706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:01.317942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.078580+0000","last_change":"2024-09-12T02:41:52.784485+0000","last_active":"2024-09-12T02:41:55.078580+0000","last_peered":"2024-09-12T02:41:55.078580+0000","last_clean":"2024-09-12T02:41:55.078580+0000","last_became_active":"2024-09-12T02:41:52.784183+0000","last_became_peered":"2024-09-12T02:41:52.784183+0000","last_unstale":"2024-09-12T02:41:55.078580+0000","last_undegraded":"2024-09-12T02:41:55.078580+0000","last_fullsized":"2024-09-12T02:41:55.078580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:32:59.235781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077471+0000","last_change":"2024-09-12T02:41:53.784634+0000","last_active":"2024-09-12T02:41:55.077471+0000","last_peered":"2024-09-12T02:41:55.077471+0000","last_clean":"2024-09-12T02:41:55.077471+0000","last_became_active":"2024-09-12T02:41:53.784120+0000","last_became_peered":"2024-09-12T02:41:53.784120+0000","last_unstale":"2024-09-12T02:41:55.077471+0000","last_undegraded":"2024-09-12T02:41:55.077471+0000","last_fullsized":"2024-09-12T02:41:55.077471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:13.615226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779120+0000","last_change":"2024-09-12T02:41:52.778974+0000","last_active":"2024-09-12T02:41:54.779120+0000","last_peered":"2024-09-12T02:41:54.779120+0000","last_clean":"2024-09-12T02:41:54.779120+0000","last_became_active":"2024-09-12T02:41:52.775107+0000","last_became_peered":"2024-09-12T02:41:52.775107+0000","last_unstale":"2024-09-12T02:41:54.779120+0000","last_undegraded":"2024-09-12T02:41:54.779120+0000","last_fullsized":"2024-09-12T02:41:54.779120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:37.256469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:54.779025+0000","last_change":"2024-09-12T02:41:53.789090+0000","last_active":"2024-09-12T02:41:54.779025+0000","last_peered":"2024-09-12T02:41:54.779025+0000","last_clean":"2024-09-12T02:41:54.779025+0000","last_became_active":"2024-09-12T02:41:53.787863+0000","last_became_peered":"2024-09-12T02:41:53.787863+0000","last_unstale":"2024-09-12T02:41:54.779025+0000","last_undegraded":"2024-09-12T02:41:54.779025+0000","last_fullsized":"2024-09-12T02:41:54.779025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:52.757318+0000","last_clean_scrub_stamp":"2024-09-12T02:41:52.757318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:09.744576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:41:55.077689+0000","last_change":"2024-09-12T02:41:52.778197+0000","last_active":"2024-09-12T02:41:55.077689+0000","last_peered":"2024-09-12T02:41:55.077689+0000","last_clean":"2024-09-12T02:41:55.077689+0000","last_became_active":"2024-09-12T02:41:52.777887+0000","last_became_peered":"2024-09-12T02:41:52.777887+0000","last_unstale":"2024-09-12T02:41:55.077689+0000","last_undegraded":"2024-09-12T02:41:55.077689+0000","last_fullsized":"2024-09-12T02:41:55.077689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:51.752024+0000","last_clean_scrub_stamp":"2024-09-12T02:41:51.752024+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:30:08.364549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338276,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927614,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929136,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929100,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927614,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929226,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929066,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338220,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:42:06.340 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:42:06.340 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T02:42:06.340 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T02:42:06.340 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T02:42:06.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.529+0000 7f9ffb200640 1 Processor -- start 2024-09-12T02:42:06.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.529+0000 7f9ffb200640 1 -- start start 2024-09-12T02:42:06.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.530+0000 7f9ffb200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ffc162510 0x7f9ffc0d58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:06.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.530+0000 7f9ffb200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9ffc0b5250 0x7f9ffc0b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:06.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.530+0000 7f9ffb200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ffc0b1c30 con 0x7f9ffc0b46e0 2024-09-12T02:42:06.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.530+0000 7f9ffb200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f9ffc0b1f10 con 0x7f9ffc0b5250 2024-09-12T02:42:06.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.530+0000 7f9ffb200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9ffc0b21f0 con 0x7f9ffc162510 2024-09-12T02:42:06.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.530+0000 7f9ffa800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9ffc0b5250 0x7f9ffc0b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:06.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.530+0000 7f9ffa800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9ffc0b5250 0x7f9ffc0b2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57850/0 (socket says 172.21.15.112:57850) 2024-09-12T02:42:06.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.530+0000 7f9ffa800640 1 -- 172.21.15.112:0/378503156 learned_addr learned my addr 172.21.15.112:0/378503156 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:06.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.530+0000 7f9ff9e00640 1 --2- 172.21.15.112:0/378503156 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ffc162510 0x7f9ffc0d58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:06.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.531+0000 7f9ffa800640 1 -- 172.21.15.112:0/378503156 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ffc162510 msgr2=0x7f9ffc0d58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:06.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.531+0000 7f9ffa800640 1 --2- 172.21.15.112:0/378503156 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ffc162510 0x7f9ffc0d58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:06.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.531+0000 7f9ffa800640 1 -- 172.21.15.112:0/378503156 >> v1:172.21.15.137:6789/0 conn(0x7f9ffc0b46e0 legacy=0x7f9ffc0b4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:06.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.531+0000 7f9ffa800640 1 -- 172.21.15.112:0/378503156 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ffc0b24d0 con 0x7f9ffc0b5250 2024-09-12T02:42:06.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.532+0000 7f9ffa800640 1 --2- 172.21.15.112:0/378503156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ffc0b5250 0x7f9ffc0b2cd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4009e50 tx=0x7f9ff402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ffdbd4f773ac6b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:06.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.532+0000 7f9ff8a00640 1 -- 172.21.15.112:0/378503156 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4036070 con 0x7f9ffc0b5250 2024-09-12T02:42:06.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.532+0000 7f9ff8a00640 1 -- 172.21.15.112:0/378503156 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff4031600 con 0x7f9ffc0b5250 2024-09-12T02:42:06.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.532+0000 7f9ff8a00640 1 -- 172.21.15.112:0/378503156 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff40319d0 con 0x7f9ffc0b5250 2024-09-12T02:42:06.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.532+0000 7f9ffb200640 1 -- 172.21.15.112:0/378503156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ffc0b5250 msgr2=0x7f9ffc0b2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:06.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.532+0000 7f9ffb200640 1 --2- 172.21.15.112:0/378503156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ffc0b5250 0x7f9ffc0b2cd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4009e50 tx=0x7f9ff402a730 comp rx=0 tx=0).stop 2024-09-12T02:42:06.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.532+0000 7f9ffb200640 1 -- 172.21.15.112:0/378503156 shutdown_connections 2024-09-12T02:42:06.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.532+0000 7f9ffb200640 1 --2- 172.21.15.112:0/378503156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ffc0b5250 0x7f9ffc0b2cd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:06.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.532+0000 7f9ffb200640 1 --2- 172.21.15.112:0/378503156 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ffc162510 0x7f9ffc0d58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:06.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.533+0000 7f9ffb200640 1 -- 172.21.15.112:0/378503156 >> 172.21.15.112:0/378503156 conn(0x7f9ffc0d4d80 msgr2=0x7f9ffc0d5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:06.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.533+0000 7f9ffb200640 1 -- 172.21.15.112:0/378503156 shutdown_connections 2024-09-12T02:42:06.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.533+0000 7f9ffb200640 1 -- 172.21.15.112:0/378503156 wait complete. 2024-09-12T02:42:06.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.534+0000 7f9ffb200640 1 Processor -- start 2024-09-12T02:42:06.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.534+0000 7f9ffb200640 1 -- start start 2024-09-12T02:42:06.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.535+0000 7f9ffb200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ffc0b46e0 0x7f9ffc0caf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:06.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.535+0000 7f9ffb200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ffc0b5250 0x7f9ffc0cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:06.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.535+0000 7f9ffb200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ffc162510 0x7f9ffc15fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:06.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.535+0000 7f9ffb200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc0b3210 con 0x7f9ffc0b46e0 2024-09-12T02:42:06.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.535+0000 7f9ffb200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc1628f0 con 0x7f9ffc0b5250 2024-09-12T02:42:06.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.535+0000 7f9ffb200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9ffc0b3390 con 0x7f9ffc162510 2024-09-12T02:42:06.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.535+0000 7f9ff9e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ffc0b46e0 0x7f9ffc0caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:06.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.535+0000 7f9ff9e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ffc0b46e0 0x7f9ffc0caf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57852/0 (socket says 172.21.15.112:57852) 2024-09-12T02:42:06.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.535+0000 7f9ff9e00640 1 -- 172.21.15.112:0/3470124285 learned_addr learned my addr 172.21.15.112:0/3470124285 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:06.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.536+0000 7f9ff9e00640 1 -- 172.21.15.112:0/3470124285 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ffc162510 msgr2=0x7f9ffc15fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:06.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.536+0000 7f9ff9e00640 1 --2- 172.21.15.112:0/3470124285 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ffc162510 0x7f9ffc15fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:06.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.536+0000 7f9ff9e00640 1 -- 172.21.15.112:0/3470124285 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ffc0b5250 msgr2=0x7f9ffc0cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:06.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.536+0000 7f9ff9400640 1 --2- 172.21.15.112:0/3470124285 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ffc0b5250 0x7f9ffc0cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:06.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.536+0000 7f9ff9e00640 1 --2- 172.21.15.112:0/3470124285 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ffc0b5250 0x7f9ffc0cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:06.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.536+0000 7f9ff9e00640 1 -- 172.21.15.112:0/3470124285 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ffc0ce150 con 0x7f9ffc0b46e0 2024-09-12T02:42:06.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.536+0000 7f9ff9400640 1 --2- 172.21.15.112:0/3470124285 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ffc0b5250 0x7f9ffc0cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:42:06.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.536+0000 7f9ff9e00640 1 --2- 172.21.15.112:0/3470124285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ffc0b46e0 0x7f9ffc0caf80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9fec00e870 tx=0x7f9fec00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:06.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.536+0000 7f9ff2000640 1 -- 172.21.15.112:0/3470124285 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec017070 con 0x7f9ffc0b46e0 2024-09-12T02:42:06.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.536+0000 7f9ff2000640 1 -- 172.21.15.112:0/3470124285 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fec00c940 con 0x7f9ffc0b46e0 2024-09-12T02:42:06.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.536+0000 7f9ff2000640 1 -- 172.21.15.112:0/3470124285 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec00cd30 con 0x7f9ffc0b46e0 2024-09-12T02:42:06.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.536+0000 7f9ffb200640 1 -- 172.21.15.112:0/3470124285 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ffc0cd0b0 con 0x7f9ffc0b46e0 2024-09-12T02:42:06.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.536+0000 7f9ffb200640 1 -- 172.21.15.112:0/3470124285 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ffc0cd670 con 0x7f9ffc0b46e0 2024-09-12T02:42:06.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.537+0000 7f9ffb200640 1 -- 172.21.15.112:0/3470124285 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ffc0b2cd0 con 0x7f9ffc0b46e0 2024-09-12T02:42:06.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.538+0000 7f9ff2000640 1 -- 172.21.15.112:0/3470124285 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9fec01a070 con 0x7f9ffc0b46e0 2024-09-12T02:42:06.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.539+0000 7f9ff2000640 1 --2- 172.21.15.112:0/3470124285 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9fdc06be30 0x7f9fdc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:06.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.540+0000 7f9ff2000640 1 -- 172.21.15.112:0/3470124285 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9fec08adb0 con 0x7f9ffc0b46e0 2024-09-12T02:42:06.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.540+0000 7f9ff9400640 1 --2- 172.21.15.112:0/3470124285 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9fdc06be30 0x7f9fdc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:06.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.540+0000 7f9ff9400640 1 --2- 172.21.15.112:0/3470124285 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9fdc06be30 0x7f9fdc06e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc0cb4c0 tx=0x7f9fe8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:06.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.544+0000 7f9ff2000640 1 -- 172.21.15.112:0/3470124285 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9fec08f070 con 0x7f9ffc0b46e0 2024-09-12T02:42:06.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.752+0000 7f9ffb200640 1 -- 172.21.15.112:0/3470124285 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9ffc0d2370 con 0x7f9ffc0b46e0 2024-09-12T02:42:06.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.752+0000 7f9ff2000640 1 -- 172.21.15.112:0/3470124285 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f9ffc0ce150 con 0x7f9ffc0b46e0 2024-09-12T02:42:06.754 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:42:06.754 INFO:teuthology.orchestra.run.smithi112.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T02:42:06.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.754+0000 7f9ffb200640 1 -- 172.21.15.112:0/3470124285 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9fdc06be30 msgr2=0x7f9fdc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:06.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.754+0000 7f9ffb200640 1 --2- 172.21.15.112:0/3470124285 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9fdc06be30 0x7f9fdc06e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc0cb4c0 tx=0x7f9fe8009040 comp rx=0 tx=0).stop 2024-09-12T02:42:06.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.754+0000 7f9ffb200640 1 -- 172.21.15.112:0/3470124285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ffc0b46e0 msgr2=0x7f9ffc0caf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:06.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.754+0000 7f9ffb200640 1 --2- 172.21.15.112:0/3470124285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ffc0b46e0 0x7f9ffc0caf80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9fec00e870 tx=0x7f9fec00ed30 comp rx=0 tx=0).stop 2024-09-12T02:42:06.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.754+0000 7f9ffb200640 1 -- 172.21.15.112:0/3470124285 shutdown_connections 2024-09-12T02:42:06.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.754+0000 7f9ffb200640 1 --2- 172.21.15.112:0/3470124285 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ffc162510 0x7f9ffc15fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:06.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.754+0000 7f9ffb200640 1 --2- 172.21.15.112:0/3470124285 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9fdc06be30 0x7f9fdc06e2f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:06.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.754+0000 7f9ffb200640 1 --2- 172.21.15.112:0/3470124285 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ffc0b5250 0x7f9ffc0cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:06.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.754+0000 7f9ffb200640 1 --2- 172.21.15.112:0/3470124285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ffc0b46e0 0x7f9ffc0caf80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:06.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.754+0000 7f9ffb200640 1 -- 172.21.15.112:0/3470124285 >> 172.21.15.112:0/3470124285 conn(0x7f9ffc0d4d80 msgr2=0x7f9ffc06c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:06.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.755+0000 7f9ffb200640 1 -- 172.21.15.112:0/3470124285 shutdown_connections 2024-09-12T02:42:06.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.755+0000 7f9ffb200640 1 -- 172.21.15.112:0/3470124285 wait complete. 2024-09-12T02:42:06.771 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T02:42:06.771 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:42:06.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.922+0000 7fc052800640 1 Processor -- start 2024-09-12T02:42:06.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.922+0000 7fc052800640 1 -- start start 2024-09-12T02:42:06.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.923+0000 7fc052800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc04c15b9d0 0x7fc04c0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:06.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.923+0000 7fc052800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc04c06f600 0x7fc04c0728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:06.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.923+0000 7fc052800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc04c0b54a0 con 0x7fc04c0b45d0 2024-09-12T02:42:06.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.923+0000 7fc052800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc04c0b4a60 con 0x7fc04c06f600 2024-09-12T02:42:06.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.923+0000 7fc052800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc04c0b3af0 con 0x7fc04c15b9d0 2024-09-12T02:42:06.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.924+0000 7fc04be00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc04c06f600 0x7fc04c0728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:06.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.924+0000 7fc04b400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc04c15b9d0 0x7fc04c0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:06.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.924+0000 7fc04be00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc04c06f600 0x7fc04c0728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57864/0 (socket says 172.21.15.112:57864) 2024-09-12T02:42:06.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.924+0000 7fc04be00640 1 -- 172.21.15.112:0/291771601 learned_addr learned my addr 172.21.15.112:0/291771601 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:06.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.924+0000 7fc04aa00640 1 --1- 172.21.15.112:0/291771601 >> v1:172.21.15.137:6789/0 conn(0x7fc04c0b45d0 0x7fc04c06eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.112:40602/0 (socket says 172.21.15.112:40602) 2024-09-12T02:42:06.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.924+0000 7fc04be00640 1 -- 172.21.15.112:0/291771601 >> v2:172.21.15.137:3300/0 conn(0x7fc04c15b9d0 msgr2=0x7fc04c0b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:06.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.924+0000 7fc04be00640 1 --2- 172.21.15.112:0/291771601 >> v2:172.21.15.137:3300/0 conn(0x7fc04c15b9d0 0x7fc04c0b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:06.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.924+0000 7fc04be00640 1 -- 172.21.15.112:0/291771601 >> v1:172.21.15.137:6789/0 conn(0x7fc04c0b45d0 legacy=0x7fc04c06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:06.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.924+0000 7fc04be00640 1 -- 172.21.15.112:0/291771601 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc04c0b3dd0 con 0x7fc04c06f600 2024-09-12T02:42:06.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.924+0000 7fc04b400640 1 --2- 172.21.15.112:0/291771601 >> v2:172.21.15.137:3300/0 conn(0x7fc04c15b9d0 0x7fc04c0b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:06.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.924+0000 7fc04a000640 1 -- 172.21.15.112:0/291771601 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2537971000 0 0) 0x7fc04c0b54a0 con 0x7fc04c0b45d0 2024-09-12T02:42:06.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.925+0000 7fc04be00640 1 --2- 172.21.15.112:0/291771601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc04c06f600 0x7fc04c0728c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc04c06d230 tx=0x7fc04402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57189887c32b0f40 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:06.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.925+0000 7fc04a000640 1 -- 172.21.15.112:0/291771601 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc044036070 con 0x7fc04c06f600 2024-09-12T02:42:06.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.925+0000 7fc04a000640 1 -- 172.21.15.112:0/291771601 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc044031600 con 0x7fc04c06f600 2024-09-12T02:42:06.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.925+0000 7fc04a000640 1 -- 172.21.15.112:0/291771601 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0440319d0 con 0x7fc04c06f600 2024-09-12T02:42:06.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.926+0000 7fc052800640 1 -- 172.21.15.112:0/291771601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc04c06f600 msgr2=0x7fc04c0728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:06.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.926+0000 7fc052800640 1 --2- 172.21.15.112:0/291771601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc04c06f600 0x7fc04c0728c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc04c06d230 tx=0x7fc04402a6a0 comp rx=0 tx=0).stop 2024-09-12T02:42:06.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.926+0000 7fc052800640 1 -- 172.21.15.112:0/291771601 shutdown_connections 2024-09-12T02:42:06.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.926+0000 7fc052800640 1 --2- 172.21.15.112:0/291771601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc04c06f600 0x7fc04c0728c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:06.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.926+0000 7fc052800640 1 --2- 172.21.15.112:0/291771601 >> v2:172.21.15.137:3300/0 conn(0x7fc04c15b9d0 0x7fc04c0b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:06.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.926+0000 7fc052800640 1 -- 172.21.15.112:0/291771601 >> 172.21.15.112:0/291771601 conn(0x7fc04c06bbd0 msgr2=0x7fc04c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:06.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.926+0000 7fc052800640 1 -- 172.21.15.112:0/291771601 shutdown_connections 2024-09-12T02:42:06.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.926+0000 7fc052800640 1 -- 172.21.15.112:0/291771601 wait complete. 2024-09-12T02:42:06.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.927+0000 7fc052800640 1 Processor -- start 2024-09-12T02:42:06.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.928+0000 7fc052800640 1 -- start start 2024-09-12T02:42:06.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.928+0000 7fc052800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc04c06f600 0x7fc04c15fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:06.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.928+0000 7fc052800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc04c0b45d0 0x7fc04c14ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:06.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.929+0000 7fc052800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc04c15b9d0 0x7fc04c15a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:06.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.929+0000 7fc052800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c15bf30 con 0x7fc04c0b45d0 2024-09-12T02:42:06.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.929+0000 7fc052800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c15bdb0 con 0x7fc04c06f600 2024-09-12T02:42:06.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.929+0000 7fc052800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc04c0cdcd0 con 0x7fc04c15b9d0 2024-09-12T02:42:06.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.929+0000 7fc04aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc04c0b45d0 0x7fc04c14ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:06.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.929+0000 7fc04aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc04c0b45d0 0x7fc04c14ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57870/0 (socket says 172.21.15.112:57870) 2024-09-12T02:42:06.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.929+0000 7fc04aa00640 1 -- 172.21.15.112:0/149797806 learned_addr learned my addr 172.21.15.112:0/149797806 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:06.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.929+0000 7fc04b400640 1 --2- 172.21.15.112:0/149797806 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc04c06f600 0x7fc04c15fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:06.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.929+0000 7fc04be00640 1 --2- 172.21.15.112:0/149797806 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc04c15b9d0 0x7fc04c15a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:06.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.929+0000 7fc04aa00640 1 -- 172.21.15.112:0/149797806 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc04c15b9d0 msgr2=0x7fc04c15a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:06.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.929+0000 7fc04aa00640 1 --2- 172.21.15.112:0/149797806 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc04c15b9d0 0x7fc04c15a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:06.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.929+0000 7fc04aa00640 1 -- 172.21.15.112:0/149797806 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc04c06f600 msgr2=0x7fc04c15fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:06.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.929+0000 7fc04aa00640 1 --2- 172.21.15.112:0/149797806 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc04c06f600 0x7fc04c15fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:06.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.929+0000 7fc04aa00640 1 -- 172.21.15.112:0/149797806 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc04c154a00 con 0x7fc04c0b45d0 2024-09-12T02:42:06.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.929+0000 7fc04aa00640 1 --2- 172.21.15.112:0/149797806 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc04c0b45d0 0x7fc04c14ab90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc03800c4b0 tx=0x7fc03800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:06.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.930+0000 7fc043400640 1 -- 172.21.15.112:0/149797806 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc038018070 con 0x7fc04c0b45d0 2024-09-12T02:42:06.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.930+0000 7fc043400640 1 -- 172.21.15.112:0/149797806 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0380074e0 con 0x7fc04c0b45d0 2024-09-12T02:42:06.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.930+0000 7fc043400640 1 -- 172.21.15.112:0/149797806 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc038004a70 con 0x7fc04c0b45d0 2024-09-12T02:42:06.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.930+0000 7fc052800640 1 -- 172.21.15.112:0/149797806 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc04c154720 con 0x7fc04c0b45d0 2024-09-12T02:42:06.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.930+0000 7fc052800640 1 -- 172.21.15.112:0/149797806 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc04c157f40 con 0x7fc04c0b45d0 2024-09-12T02:42:06.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.931+0000 7fc052800640 1 -- 172.21.15.112:0/149797806 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc04c068a30 con 0x7fc04c0b45d0 2024-09-12T02:42:06.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.932+0000 7fc043400640 1 -- 172.21.15.112:0/149797806 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc03801b070 con 0x7fc04c0b45d0 2024-09-12T02:42:06.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.932+0000 7fc043400640 1 --2- 172.21.15.112:0/149797806 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc02c06be60 0x7fc02c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:06.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.933+0000 7fc043400640 1 -- 172.21.15.112:0/149797806 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc03808a120 con 0x7fc04c0b45d0 2024-09-12T02:42:06.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.933+0000 7fc04b400640 1 --2- 172.21.15.112:0/149797806 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc02c06be60 0x7fc02c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:06.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.933+0000 7fc04b400640 1 --2- 172.21.15.112:0/149797806 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc02c06be60 0x7fc02c06e320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009560 tx=0x7fc03c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:06.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:06.937+0000 7fc043400640 1 -- 172.21.15.112:0/149797806 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc0380584a0 con 0x7fc04c0b45d0 2024-09-12T02:42:07.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.145+0000 7fc052800640 1 -- 172.21.15.112:0/149797806 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc04c06dbc0 con 0x7fc04c0b45d0 2024-09-12T02:42:07.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.145+0000 7fc043400640 1 -- 172.21.15.112:0/149797806 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7fc03805c7a0 con 0x7fc04c0b45d0 2024-09-12T02:42:07.146 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:42:07.147 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":8,"btime":"2024-09-12T02:41:56:806041+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3622416380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3622416380},{"type":"v1","addr":"172.21.15.112:6837","nonce":3622416380}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/2779317773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2779317773},{"type":"v1","addr":"172.21.15.137:6834","nonce":2779317773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3005649719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3005649719},{"type":"v1","addr":"172.21.15.112:6835","nonce":3005649719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:41:53.174744+0000","modified":"2024-09-12T02:41:56.211357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/1785309492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1785309492},{"type":"v1","addr":"172.21.15.137:6835","nonce":1785309492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4308]},"id":1}]} 2024-09-12T02:42:07.147 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 8 2024-09-12T02:42:07.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.147+0000 7fc052800640 1 -- 172.21.15.112:0/149797806 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc02c06be60 msgr2=0x7fc02c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:07.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.148+0000 7fc052800640 1 --2- 172.21.15.112:0/149797806 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc02c06be60 0x7fc02c06e320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009560 tx=0x7fc03c009190 comp rx=0 tx=0).stop 2024-09-12T02:42:07.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.148+0000 7fc052800640 1 -- 172.21.15.112:0/149797806 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc04c0b45d0 msgr2=0x7fc04c14ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:07.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.148+0000 7fc052800640 1 --2- 172.21.15.112:0/149797806 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc04c0b45d0 0x7fc04c14ab90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc03800c4b0 tx=0x7fc03800c970 comp rx=0 tx=0).stop 2024-09-12T02:42:07.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.148+0000 7fc052800640 1 -- 172.21.15.112:0/149797806 shutdown_connections 2024-09-12T02:42:07.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.148+0000 7fc052800640 1 --2- 172.21.15.112:0/149797806 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc04c15b9d0 0x7fc04c15a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:07.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.148+0000 7fc052800640 1 --2- 172.21.15.112:0/149797806 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc04c0b45d0 0x7fc04c14ab90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:07.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.148+0000 7fc052800640 1 --2- 172.21.15.112:0/149797806 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc02c06be60 0x7fc02c06e320 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:07.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.148+0000 7fc052800640 1 --2- 172.21.15.112:0/149797806 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc04c06f600 0x7fc04c15fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:07.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.148+0000 7fc052800640 1 -- 172.21.15.112:0/149797806 >> 172.21.15.112:0/149797806 conn(0x7fc04c06bbd0 msgr2=0x7fc04c1557e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:07.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.148+0000 7fc052800640 1 -- 172.21.15.112:0/149797806 shutdown_connections 2024-09-12T02:42:07.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.148+0000 7fc052800640 1 -- 172.21.15.112:0/149797806 wait complete. 2024-09-12T02:42:07.165 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:42:07.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.317+0000 7f500ae00640 1 Processor -- start 2024-09-12T02:42:07.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.317+0000 7f500ae00640 1 -- start start 2024-09-12T02:42:07.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.318+0000 7f500ae00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f500415ed60 0x7f500406d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:07.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.318+0000 7f500ae00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f500406da10 0x7f50040af900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:07.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.318+0000 7f500ae00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f50040afe40 0x7f50040b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:07.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.318+0000 7f500ae00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f50040b3c10 con 0x7f500415ed60 2024-09-12T02:42:07.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.318+0000 7f500ae00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f500406de30 con 0x7f50040afe40 2024-09-12T02:42:07.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.318+0000 7f500ae00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f50040b3000 con 0x7f500406da10 2024-09-12T02:42:07.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.318+0000 7f5009a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f500415ed60 0x7f500406d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:07.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.318+0000 7f5009a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f500415ed60 0x7f500406d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57880/0 (socket says 172.21.15.112:57880) 2024-09-12T02:42:07.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.318+0000 7f5009a00640 1 -- 172.21.15.112:0/3981193589 learned_addr learned my addr 172.21.15.112:0/3981193589 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:07.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.319+0000 7f5009000640 1 --2- 172.21.15.112:0/3981193589 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f500406da10 0x7f50040af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:07.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.319+0000 7f500a400640 1 --2- 172.21.15.112:0/3981193589 >> v2:172.21.15.137:3300/0 conn(0x7f50040afe40 0x7f50040b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:07.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.319+0000 7f5009a00640 1 -- 172.21.15.112:0/3981193589 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f500406da10 msgr2=0x7f50040af900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:07.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.319+0000 7f5009a00640 1 --2- 172.21.15.112:0/3981193589 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f500406da10 0x7f50040af900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:07.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.319+0000 7f5009a00640 1 -- 172.21.15.112:0/3981193589 >> v2:172.21.15.137:3300/0 conn(0x7f50040afe40 msgr2=0x7f50040b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:07.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.319+0000 7f5009a00640 1 --2- 172.21.15.112:0/3981193589 >> v2:172.21.15.137:3300/0 conn(0x7f50040afe40 0x7f50040b02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:07.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.319+0000 7f5009a00640 1 -- 172.21.15.112:0/3981193589 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50040b32e0 con 0x7f500415ed60 2024-09-12T02:42:07.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.320+0000 7f5009a00640 1 --2- 172.21.15.112:0/3981193589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f500415ed60 0x7f500406d4d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5004072af0 tx=0x7f4ff802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e0bb0388a93094 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:07.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.320+0000 7f5003e00640 1 -- 172.21.15.112:0/3981193589 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8037070 con 0x7f500415ed60 2024-09-12T02:42:07.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.320+0000 7f5003e00640 1 -- 172.21.15.112:0/3981193589 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff8032440 con 0x7f500415ed60 2024-09-12T02:42:07.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.320+0000 7f5003e00640 1 -- 172.21.15.112:0/3981193589 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8032810 con 0x7f500415ed60 2024-09-12T02:42:07.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.320+0000 7f500ae00640 1 -- 172.21.15.112:0/3981193589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f500415ed60 msgr2=0x7f500406d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:07.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.320+0000 7f500ae00640 1 --2- 172.21.15.112:0/3981193589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f500415ed60 0x7f500406d4d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5004072af0 tx=0x7f4ff802a1e0 comp rx=0 tx=0).stop 2024-09-12T02:42:07.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.321+0000 7f500ae00640 1 -- 172.21.15.112:0/3981193589 shutdown_connections 2024-09-12T02:42:07.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.321+0000 7f500ae00640 1 --2- 172.21.15.112:0/3981193589 >> v2:172.21.15.137:3300/0 conn(0x7f50040afe40 0x7f50040b02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:07.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.321+0000 7f500ae00640 1 --2- 172.21.15.112:0/3981193589 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f500406da10 0x7f50040af900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:07.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.321+0000 7f500ae00640 1 --2- 172.21.15.112:0/3981193589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f500415ed60 0x7f500406d4d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:07.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.321+0000 7f500ae00640 1 -- 172.21.15.112:0/3981193589 >> 172.21.15.112:0/3981193589 conn(0x7f50040b7e80 msgr2=0x7f50040b8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:07.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.321+0000 7f500ae00640 1 -- 172.21.15.112:0/3981193589 shutdown_connections 2024-09-12T02:42:07.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.321+0000 7f500ae00640 1 -- 172.21.15.112:0/3981193589 wait complete. 2024-09-12T02:42:07.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.322+0000 7f500ae00640 1 Processor -- start 2024-09-12T02:42:07.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.322+0000 7f500ae00640 1 -- start start 2024-09-12T02:42:07.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.323+0000 7f500ae00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f500406da10 0x7f5004152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:07.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.323+0000 7f500ae00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50040afe40 0x7f50041544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:07.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.323+0000 7f500ae00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f500415ed60 0x7f50040b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:07.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.323+0000 7f500ae00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f500406e270 con 0x7f500415ed60 2024-09-12T02:42:07.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.323+0000 7f500ae00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f50040b38a0 con 0x7f500406da10 2024-09-12T02:42:07.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.323+0000 7f500ae00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f50040b40a0 con 0x7f50040afe40 2024-09-12T02:42:07.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.323+0000 7f500a400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f500415ed60 0x7f50040b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:07.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.324+0000 7f500a400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f500415ed60 0x7f50040b21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57882/0 (socket says 172.21.15.112:57882) 2024-09-12T02:42:07.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.324+0000 7f500a400640 1 -- 172.21.15.112:0/3688010581 learned_addr learned my addr 172.21.15.112:0/3688010581 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:07.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.324+0000 7f5009a00640 1 --2- 172.21.15.112:0/3688010581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f500406da10 0x7f5004152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:07.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.324+0000 7f5009000640 1 --2- 172.21.15.112:0/3688010581 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50040afe40 0x7f50041544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:07.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.324+0000 7f500a400640 1 -- 172.21.15.112:0/3688010581 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50040afe40 msgr2=0x7f50041544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:07.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.324+0000 7f500a400640 1 --2- 172.21.15.112:0/3688010581 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50040afe40 0x7f50041544e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:07.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.324+0000 7f500a400640 1 -- 172.21.15.112:0/3688010581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f500406da10 msgr2=0x7f5004152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:07.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.324+0000 7f500a400640 1 --2- 172.21.15.112:0/3688010581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f500406da10 0x7f5004152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:07.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.324+0000 7f500a400640 1 -- 172.21.15.112:0/3688010581 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5004154e10 con 0x7f500415ed60 2024-09-12T02:42:07.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.324+0000 7f5009a00640 1 --2- 172.21.15.112:0/3688010581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f500406da10 0x7f5004152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:07.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.324+0000 7f500a400640 1 --2- 172.21.15.112:0/3688010581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f500415ed60 0x7f50040b21e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc007e40 tx=0x7f4ffc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:07.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.324+0000 7f5001600640 1 -- 172.21.15.112:0/3688010581 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc014620 con 0x7f500415ed60 2024-09-12T02:42:07.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.325+0000 7f5001600640 1 -- 172.21.15.112:0/3688010581 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ffc019070 con 0x7f500415ed60 2024-09-12T02:42:07.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.325+0000 7f500ae00640 1 -- 172.21.15.112:0/3688010581 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50041550f0 con 0x7f500415ed60 2024-09-12T02:42:07.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.325+0000 7f5001600640 1 -- 172.21.15.112:0/3688010581 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc014a20 con 0x7f500415ed60 2024-09-12T02:42:07.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.325+0000 7f500ae00640 1 -- 172.21.15.112:0/3688010581 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5004161a60 con 0x7f500415ed60 2024-09-12T02:42:07.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.326+0000 7f500ae00640 1 -- 172.21.15.112:0/3688010581 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f500415f140 con 0x7f500415ed60 2024-09-12T02:42:07.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.326+0000 7f5001600640 1 -- 172.21.15.112:0/3688010581 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ffc014bc0 con 0x7f500415ed60 2024-09-12T02:42:07.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.327+0000 7f5001600640 1 --2- 172.21.15.112:0/3688010581 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4fe406be30 0x7f4fe406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:07.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.327+0000 7f5001600640 1 -- 172.21.15.112:0/3688010581 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4ffc08b6c0 con 0x7f500415ed60 2024-09-12T02:42:07.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.328+0000 7f5009a00640 1 --2- 172.21.15.112:0/3688010581 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4fe406be30 0x7f4fe406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:07.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.328+0000 7f5009a00640 1 --2- 172.21.15.112:0/3688010581 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4fe406be30 0x7f4fe406e2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8034000 tx=0x7f4ff802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:07.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.332+0000 7f5001600640 1 -- 172.21.15.112:0/3688010581 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ffc059980 con 0x7f500415ed60 2024-09-12T02:42:07.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.540+0000 7f500ae00640 1 -- 172.21.15.112:0/3688010581 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5004068440 con 0x7f500415ed60 2024-09-12T02:42:07.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.541+0000 7f5001600640 1 -- 172.21.15.112:0/3688010581 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7f4ffc05dc80 con 0x7f500415ed60 2024-09-12T02:42:07.543 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:42:07.543 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":8,"btime":"2024-09-12T02:41:56:806041+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3622416380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3622416380},{"type":"v1","addr":"172.21.15.112:6837","nonce":3622416380}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/2779317773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2779317773},{"type":"v1","addr":"172.21.15.137:6834","nonce":2779317773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3005649719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3005649719},{"type":"v1","addr":"172.21.15.112:6835","nonce":3005649719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:41:53.174744+0000","modified":"2024-09-12T02:41:56.211357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/1785309492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1785309492},{"type":"v1","addr":"172.21.15.137:6835","nonce":1785309492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4308]},"id":1}]} 2024-09-12T02:42:07.543 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 8 2024-09-12T02:42:07.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.543+0000 7f500ae00640 1 -- 172.21.15.112:0/3688010581 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4fe406be30 msgr2=0x7f4fe406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:07.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.543+0000 7f500ae00640 1 --2- 172.21.15.112:0/3688010581 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4fe406be30 0x7f4fe406e2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8034000 tx=0x7f4ff802e000 comp rx=0 tx=0).stop 2024-09-12T02:42:07.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.543+0000 7f500ae00640 1 -- 172.21.15.112:0/3688010581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f500415ed60 msgr2=0x7f50040b21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:07.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.543+0000 7f500ae00640 1 --2- 172.21.15.112:0/3688010581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f500415ed60 0x7f50040b21e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc007e40 tx=0x7f4ffc00e4b0 comp rx=0 tx=0).stop 2024-09-12T02:42:07.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.543+0000 7f500ae00640 1 -- 172.21.15.112:0/3688010581 shutdown_connections 2024-09-12T02:42:07.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.543+0000 7f500ae00640 1 --2- 172.21.15.112:0/3688010581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f500415ed60 0x7f50040b21e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:07.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.543+0000 7f500ae00640 1 --2- 172.21.15.112:0/3688010581 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50040afe40 0x7f50041544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:07.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.543+0000 7f500ae00640 1 --2- 172.21.15.112:0/3688010581 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4fe406be30 0x7f4fe406e2f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:07.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.543+0000 7f500ae00640 1 --2- 172.21.15.112:0/3688010581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f500406da10 0x7f5004152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:07.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.543+0000 7f500ae00640 1 -- 172.21.15.112:0/3688010581 >> 172.21.15.112:0/3688010581 conn(0x7f50040b7e80 msgr2=0x7f500406cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:07.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.543+0000 7f500ae00640 1 -- 172.21.15.112:0/3688010581 shutdown_connections 2024-09-12T02:42:07.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.543+0000 7f500ae00640 1 -- 172.21.15.112:0/3688010581 wait complete. 2024-09-12T02:42:07.560 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:42:07.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.712+0000 7fb424400640 1 Processor -- start 2024-09-12T02:42:07.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.712+0000 7fb424400640 1 -- start start 2024-09-12T02:42:07.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.713+0000 7fb424400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb41c15ec70 0x7fb41c070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:07.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.713+0000 7fb424400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb41c06c2e0 0x7fb41c0b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:07.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.713+0000 7fb424400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb41c070f70 con 0x7fb41c0b0db0 2024-09-12T02:42:07.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.713+0000 7fb424400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb41c162900 con 0x7fb41c06c2e0 2024-09-12T02:42:07.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.713+0000 7fb424400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb41c162be0 con 0x7fb41c15ec70 2024-09-12T02:42:07.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.714+0000 7fb422400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb41c06c2e0 0x7fb41c0b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:07.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.714+0000 7fb422400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb41c06c2e0 0x7fb41c0b49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57896/0 (socket says 172.21.15.112:57896) 2024-09-12T02:42:07.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.714+0000 7fb422400640 1 -- 172.21.15.112:0/313517803 learned_addr learned my addr 172.21.15.112:0/313517803 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:07.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.714+0000 7fb421a00640 1 --2- 172.21.15.112:0/313517803 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb41c15ec70 0x7fb41c070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:07.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.714+0000 7fb422400640 1 -- 172.21.15.112:0/313517803 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb41c15ec70 msgr2=0x7fb41c070a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:07.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.714+0000 7fb422400640 1 --2- 172.21.15.112:0/313517803 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb41c15ec70 0x7fb41c070a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:07.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.714+0000 7fb422400640 1 -- 172.21.15.112:0/313517803 >> v1:172.21.15.112:6789/0 conn(0x7fb41c0b0db0 legacy=0x7fb41c06bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:07.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.714+0000 7fb422400640 1 -- 172.21.15.112:0/313517803 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb41c162ec0 con 0x7fb41c06c2e0 2024-09-12T02:42:07.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.714+0000 7fb41be00640 1 -- 172.21.15.112:0/313517803 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 989701497 0 0) 0x7fb41c070f70 con 0x7fb41c0b0db0 2024-09-12T02:42:07.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.715+0000 7fb422400640 1 --2- 172.21.15.112:0/313517803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb41c06c2e0 0x7fb41c0b49d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb414009e50 tx=0x7fb41402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce43f95a68482a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:07.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.715+0000 7fb41be00640 1 -- 172.21.15.112:0/313517803 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb414036070 con 0x7fb41c06c2e0 2024-09-12T02:42:07.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.715+0000 7fb41be00640 1 -- 172.21.15.112:0/313517803 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb414031600 con 0x7fb41c06c2e0 2024-09-12T02:42:07.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.715+0000 7fb41be00640 1 -- 172.21.15.112:0/313517803 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4140319d0 con 0x7fb41c06c2e0 2024-09-12T02:42:07.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.716+0000 7fb424400640 1 -- 172.21.15.112:0/313517803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb41c06c2e0 msgr2=0x7fb41c0b49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:07.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.716+0000 7fb424400640 1 --2- 172.21.15.112:0/313517803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb41c06c2e0 0x7fb41c0b49d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb414009e50 tx=0x7fb41402a710 comp rx=0 tx=0).stop 2024-09-12T02:42:07.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.716+0000 7fb424400640 1 -- 172.21.15.112:0/313517803 shutdown_connections 2024-09-12T02:42:07.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.716+0000 7fb424400640 1 --2- 172.21.15.112:0/313517803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb41c06c2e0 0x7fb41c0b49d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:07.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.716+0000 7fb424400640 1 --2- 172.21.15.112:0/313517803 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb41c15ec70 0x7fb41c070a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:07.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.716+0000 7fb424400640 1 -- 172.21.15.112:0/313517803 >> 172.21.15.112:0/313517803 conn(0x7fb41c06cce0 msgr2=0x7fb41c06d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:07.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.716+0000 7fb424400640 1 -- 172.21.15.112:0/313517803 shutdown_connections 2024-09-12T02:42:07.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.716+0000 7fb424400640 1 -- 172.21.15.112:0/313517803 wait complete. 2024-09-12T02:42:07.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.718+0000 7fb424400640 1 Processor -- start 2024-09-12T02:42:07.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.718+0000 7fb424400640 1 -- start start 2024-09-12T02:42:07.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.719+0000 7fb424400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb41c06c2e0 0x7fb41c1f4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:07.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.719+0000 7fb424400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb41c0b0db0 0x7fb41c0b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:07.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.719+0000 7fb424400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb41c15ec70 0x7fb41c1f5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:07.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.719+0000 7fb424400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb41c06f530 con 0x7fb41c15ec70 2024-09-12T02:42:07.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.719+0000 7fb424400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb41c163480 con 0x7fb41c06c2e0 2024-09-12T02:42:07.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.719+0000 7fb424400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb41c15f050 con 0x7fb41c0b0db0 2024-09-12T02:42:07.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.719+0000 7fb422400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb41c15ec70 0x7fb41c1f5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:07.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.719+0000 7fb422400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb41c15ec70 0x7fb41c1f5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57912/0 (socket says 172.21.15.112:57912) 2024-09-12T02:42:07.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.719+0000 7fb422400640 1 -- 172.21.15.112:0/1608993665 learned_addr learned my addr 172.21.15.112:0/1608993665 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:07.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.719+0000 7fb421000640 1 --2- 172.21.15.112:0/1608993665 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb41c0b0db0 0x7fb41c0b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:07.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.719+0000 7fb421a00640 1 --2- 172.21.15.112:0/1608993665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb41c06c2e0 0x7fb41c1f4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:07.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.719+0000 7fb422400640 1 -- 172.21.15.112:0/1608993665 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb41c0b0db0 msgr2=0x7fb41c0b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:07.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.719+0000 7fb422400640 1 --2- 172.21.15.112:0/1608993665 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb41c0b0db0 0x7fb41c0b2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:07.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.719+0000 7fb422400640 1 -- 172.21.15.112:0/1608993665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb41c06c2e0 msgr2=0x7fb41c1f4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:07.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.719+0000 7fb422400640 1 --2- 172.21.15.112:0/1608993665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb41c06c2e0 0x7fb41c1f4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:07.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.719+0000 7fb422400640 1 -- 172.21.15.112:0/1608993665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb41c0b2a80 con 0x7fb41c15ec70 2024-09-12T02:42:07.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.720+0000 7fb422400640 1 --2- 172.21.15.112:0/1608993665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb41c15ec70 0x7fb41c1f5a30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb414034040 tx=0x7fb414004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:07.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.720+0000 7fb419600640 1 -- 172.21.15.112:0/1608993665 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb414041020 con 0x7fb41c15ec70 2024-09-12T02:42:07.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.720+0000 7fb419600640 1 -- 172.21.15.112:0/1608993665 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb414037040 con 0x7fb41c15ec70 2024-09-12T02:42:07.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.720+0000 7fb419600640 1 -- 172.21.15.112:0/1608993665 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb414036050 con 0x7fb41c15ec70 2024-09-12T02:42:07.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.720+0000 7fb424400640 1 -- 172.21.15.112:0/1608993665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb41c0b12e0 con 0x7fb41c15ec70 2024-09-12T02:42:07.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.720+0000 7fb424400640 1 -- 172.21.15.112:0/1608993665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb41c1f5410 con 0x7fb41c15ec70 2024-09-12T02:42:07.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.721+0000 7fb424400640 1 -- 172.21.15.112:0/1608993665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb41c0b14b0 con 0x7fb41c15ec70 2024-09-12T02:42:07.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.722+0000 7fb419600640 1 -- 172.21.15.112:0/1608993665 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb414007c50 con 0x7fb41c15ec70 2024-09-12T02:42:07.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.723+0000 7fb419600640 1 --2- 172.21.15.112:0/1608993665 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb3fc06be30 0x7fb3fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:07.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.723+0000 7fb419600640 1 -- 172.21.15.112:0/1608993665 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb4140ab450 con 0x7fb41c15ec70 2024-09-12T02:42:07.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.723+0000 7fb421a00640 1 --2- 172.21.15.112:0/1608993665 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb3fc06be30 0x7fb3fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:07.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.724+0000 7fb421a00640 1 --2- 172.21.15.112:0/1608993665 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb3fc06be30 0x7fb3fc06e2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb410009aa0 tx=0x7fb410009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:07.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.727+0000 7fb419600640 1 -- 172.21.15.112:0/1608993665 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb41404b060 con 0x7fb41c15ec70 2024-09-12T02:42:07.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.902+0000 7fb424400640 1 -- 172.21.15.112:0/1608993665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb41c1f5f70 con 0x7fb41c15ec70 2024-09-12T02:42:07.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.904+0000 7fb419600640 1 -- 172.21.15.112:0/1608993665 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16713 (secure 0 0 0) 0x7fb41c0b2a80 con 0x7fb41c15ec70 2024-09-12T02:42:07.905 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:42:07.909 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":20,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:41:54.774268+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:41:51.222228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:41:52.167920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:42:07.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.906+0000 7fb424400640 1 -- 172.21.15.112:0/1608993665 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb3fc06be30 msgr2=0x7fb3fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:07.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.906+0000 7fb424400640 1 --2- 172.21.15.112:0/1608993665 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb3fc06be30 0x7fb3fc06e2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb410009aa0 tx=0x7fb410009190 comp rx=0 tx=0).stop 2024-09-12T02:42:07.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.906+0000 7fb424400640 1 -- 172.21.15.112:0/1608993665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb41c15ec70 msgr2=0x7fb41c1f5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:07.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.906+0000 7fb424400640 1 --2- 172.21.15.112:0/1608993665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb41c15ec70 0x7fb41c1f5a30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb414034040 tx=0x7fb414004a40 comp rx=0 tx=0).stop 2024-09-12T02:42:07.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.906+0000 7fb424400640 1 -- 172.21.15.112:0/1608993665 shutdown_connections 2024-09-12T02:42:07.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.906+0000 7fb424400640 1 --2- 172.21.15.112:0/1608993665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb41c15ec70 0x7fb41c1f5a30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:07.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.906+0000 7fb424400640 1 --2- 172.21.15.112:0/1608993665 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb41c0b0db0 0x7fb41c0b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:07.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.906+0000 7fb424400640 1 --2- 172.21.15.112:0/1608993665 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb3fc06be30 0x7fb3fc06e2f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:07.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.906+0000 7fb424400640 1 --2- 172.21.15.112:0/1608993665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb41c06c2e0 0x7fb41c1f4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:07.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.906+0000 7fb424400640 1 -- 172.21.15.112:0/1608993665 >> 172.21.15.112:0/1608993665 conn(0x7fb41c06cce0 msgr2=0x7fb41c0b5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:07.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.906+0000 7fb424400640 1 -- 172.21.15.112:0/1608993665 shutdown_connections 2024-09-12T02:42:07.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:07.906+0000 7fb424400640 1 -- 172.21.15.112:0/1608993665 wait complete. 2024-09-12T02:42:07.924 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:42:08.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.078+0000 7f133e200640 1 Processor -- start 2024-09-12T02:42:08.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.078+0000 7f133e200640 1 -- start start 2024-09-12T02:42:08.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.079+0000 7f133e200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f13380d1710 0x7f13380d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:08.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.079+0000 7f133e200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f13380b3e00 0x7f13380d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:08.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.079+0000 7f133e200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13380d2fb0 con 0x7f13380cf7a0 2024-09-12T02:42:08.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.079+0000 7f133e200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f13380d3cb0 con 0x7f13380d1710 2024-09-12T02:42:08.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.079+0000 7f133e200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f13380d0b60 con 0x7f13380b3e00 2024-09-12T02:42:08.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.079+0000 7f133ce00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f13380d1710 0x7f13380d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:08.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.079+0000 7f133ce00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f13380d1710 0x7f13380d28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57924/0 (socket says 172.21.15.112:57924) 2024-09-12T02:42:08.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.079+0000 7f133ce00640 1 -- 172.21.15.112:0/2406886076 learned_addr learned my addr 172.21.15.112:0/2406886076 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:08.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.080+0000 7f133ce00640 1 -- 172.21.15.112:0/2406886076 >> v2:172.21.15.137:3300/0 conn(0x7f13380b3e00 msgr2=0x7f13380d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:08.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.080+0000 7f133ce00640 1 --2- 172.21.15.112:0/2406886076 >> v2:172.21.15.137:3300/0 conn(0x7f13380b3e00 0x7f13380d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.080+0000 7f133ce00640 1 -- 172.21.15.112:0/2406886076 >> v1:172.21.15.112:6789/0 conn(0x7f13380cf7a0 legacy=0x7f13380cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:08.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.080+0000 7f133ce00640 1 -- 172.21.15.112:0/2406886076 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13380d2030 con 0x7f13380d1710 2024-09-12T02:42:08.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.081+0000 7f133ce00640 1 --2- 172.21.15.112:0/2406886076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13380d1710 0x7f13380d28d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f13380d1190 tx=0x7f132802a280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41af70fac38821e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:08.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.081+0000 7f1337e00640 1 -- 172.21.15.112:0/2406886076 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1328037070 con 0x7f13380d1710 2024-09-12T02:42:08.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.081+0000 7f1337e00640 1 -- 172.21.15.112:0/2406886076 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1328032440 con 0x7f13380d1710 2024-09-12T02:42:08.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.081+0000 7f1337e00640 1 -- 172.21.15.112:0/2406886076 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1328032810 con 0x7f13380d1710 2024-09-12T02:42:08.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.081+0000 7f133e200640 1 -- 172.21.15.112:0/2406886076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13380d1710 msgr2=0x7f13380d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:08.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.081+0000 7f133e200640 1 --2- 172.21.15.112:0/2406886076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13380d1710 0x7f13380d28d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f13380d1190 tx=0x7f132802a280 comp rx=0 tx=0).stop 2024-09-12T02:42:08.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.082+0000 7f133e200640 1 -- 172.21.15.112:0/2406886076 shutdown_connections 2024-09-12T02:42:08.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.082+0000 7f133e200640 1 --2- 172.21.15.112:0/2406886076 >> v2:172.21.15.137:3300/0 conn(0x7f13380b3e00 0x7f13380d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.082+0000 7f133e200640 1 --2- 172.21.15.112:0/2406886076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13380d1710 0x7f13380d28d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.082+0000 7f133e200640 1 -- 172.21.15.112:0/2406886076 >> 172.21.15.112:0/2406886076 conn(0x7f133809e030 msgr2=0x7f13380d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:08.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.082+0000 7f133e200640 1 -- 172.21.15.112:0/2406886076 shutdown_connections 2024-09-12T02:42:08.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.082+0000 7f133e200640 1 -- 172.21.15.112:0/2406886076 wait complete. 2024-09-12T02:42:08.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.083+0000 7f133e200640 1 Processor -- start 2024-09-12T02:42:08.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.083+0000 7f133e200640 1 -- start start 2024-09-12T02:42:08.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.084+0000 7f133e200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13380b3e00 0x7f13381f8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:08.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.084+0000 7f133e200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f13380cf7a0 0x7f13381f5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:08.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.084+0000 7f133e200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13380d1710 0x7f1338160830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:08.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.084+0000 7f133e200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f13380d39d0 con 0x7f13380b3e00 2024-09-12T02:42:08.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.084+0000 7f133e200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f13380d36f0 con 0x7f13380d1710 2024-09-12T02:42:08.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.084+0000 7f133e200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f133815f110 con 0x7f13380cf7a0 2024-09-12T02:42:08.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.084+0000 7f133ce00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13380b3e00 0x7f13381f8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:08.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.084+0000 7f133ce00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13380b3e00 0x7f13381f8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57932/0 (socket says 172.21.15.112:57932) 2024-09-12T02:42:08.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.084+0000 7f133ce00640 1 -- 172.21.15.112:0/1307043160 learned_addr learned my addr 172.21.15.112:0/1307043160 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:08.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.085+0000 7f133d800640 1 --2- 172.21.15.112:0/1307043160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13380d1710 0x7f1338160830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:08.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.085+0000 7f132fe00640 1 --2- 172.21.15.112:0/1307043160 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f13380cf7a0 0x7f13381f5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:08.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.085+0000 7f133ce00640 1 -- 172.21.15.112:0/1307043160 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f13380cf7a0 msgr2=0x7f13381f5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:08.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.085+0000 7f133ce00640 1 --2- 172.21.15.112:0/1307043160 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f13380cf7a0 0x7f13381f5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.085+0000 7f133ce00640 1 -- 172.21.15.112:0/1307043160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13380d1710 msgr2=0x7f1338160830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:08.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.085+0000 7f133ce00640 1 --2- 172.21.15.112:0/1307043160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13380d1710 0x7f1338160830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.085+0000 7f133ce00640 1 -- 172.21.15.112:0/1307043160 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1338160d70 con 0x7f13380b3e00 2024-09-12T02:42:08.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.085+0000 7f133d800640 1 --2- 172.21.15.112:0/1307043160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13380d1710 0x7f1338160830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:42:08.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.085+0000 7f132fe00640 1 --2- 172.21.15.112:0/1307043160 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f13380cf7a0 0x7f13381f5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:42:08.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.085+0000 7f133ce00640 1 --2- 172.21.15.112:0/1307043160 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13380b3e00 0x7f13381f8850 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1328000c00 tx=0x7f13280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:08.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.085+0000 7f1335600640 1 -- 172.21.15.112:0/1307043160 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1328041020 con 0x7f13380b3e00 2024-09-12T02:42:08.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.085+0000 7f1335600640 1 -- 172.21.15.112:0/1307043160 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1328030970 con 0x7f13380b3e00 2024-09-12T02:42:08.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.085+0000 7f133e200640 1 -- 172.21.15.112:0/1307043160 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13381f8f10 con 0x7f13380b3e00 2024-09-12T02:42:08.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.085+0000 7f1335600640 1 -- 172.21.15.112:0/1307043160 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1328037040 con 0x7f13380b3e00 2024-09-12T02:42:08.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.085+0000 7f133e200640 1 -- 172.21.15.112:0/1307043160 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13381f94d0 con 0x7f13380b3e00 2024-09-12T02:42:08.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.086+0000 7f133e200640 1 -- 172.21.15.112:0/1307043160 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13380d1af0 con 0x7f13380b3e00 2024-09-12T02:42:08.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.087+0000 7f1335600640 1 -- 172.21.15.112:0/1307043160 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1328044020 con 0x7f13380b3e00 2024-09-12T02:42:08.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.088+0000 7f1335600640 1 --2- 172.21.15.112:0/1307043160 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f131406be30 0x7f131406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:08.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.088+0000 7f1335600640 1 -- 172.21.15.112:0/1307043160 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f13280ab940 con 0x7f13380b3e00 2024-09-12T02:42:08.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.088+0000 7f132fe00640 1 --2- 172.21.15.112:0/1307043160 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f131406be30 0x7f131406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:08.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.089+0000 7f132fe00640 1 --2- 172.21.15.112:0/1307043160 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f131406be30 0x7f131406e2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f13380b7540 tx=0x7f1320008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:08.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.092+0000 7f1335600640 1 -- 172.21.15.112:0/1307043160 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f132804b030 con 0x7f13380b3e00 2024-09-12T02:42:08.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.299+0000 7f133e200640 1 -- 172.21.15.112:0/1307043160 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13380b9050 con 0x7f13380b3e00 2024-09-12T02:42:08.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.299+0000 7f1335600640 1 -- 172.21.15.112:0/1307043160 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7f132807a250 con 0x7f13380b3e00 2024-09-12T02:42:08.301 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:42:08.301 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":8,"btime":"2024-09-12T02:41:56:806041+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3622416380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3622416380},{"type":"v1","addr":"172.21.15.112:6837","nonce":3622416380}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/2779317773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2779317773},{"type":"v1","addr":"172.21.15.137:6834","nonce":2779317773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3005649719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3005649719},{"type":"v1","addr":"172.21.15.112:6835","nonce":3005649719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:41:53.174744+0000","modified":"2024-09-12T02:41:56.211357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/1785309492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1785309492},{"type":"v1","addr":"172.21.15.137:6835","nonce":1785309492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4308]},"id":1}]} 2024-09-12T02:42:08.301 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 8 2024-09-12T02:42:08.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.301+0000 7f133e200640 1 -- 172.21.15.112:0/1307043160 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f131406be30 msgr2=0x7f131406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:08.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.301+0000 7f133e200640 1 --2- 172.21.15.112:0/1307043160 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f131406be30 0x7f131406e2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f13380b7540 tx=0x7f1320008040 comp rx=0 tx=0).stop 2024-09-12T02:42:08.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.302+0000 7f133e200640 1 -- 172.21.15.112:0/1307043160 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13380b3e00 msgr2=0x7f13381f8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:08.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.302+0000 7f133e200640 1 --2- 172.21.15.112:0/1307043160 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13380b3e00 0x7f13381f8850 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1328000c00 tx=0x7f13280046c0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.302+0000 7f133e200640 1 -- 172.21.15.112:0/1307043160 shutdown_connections 2024-09-12T02:42:08.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.302+0000 7f133e200640 1 --2- 172.21.15.112:0/1307043160 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f131406be30 0x7f131406e2f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.302+0000 7f133e200640 1 --2- 172.21.15.112:0/1307043160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13380d1710 0x7f1338160830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.302+0000 7f133e200640 1 --2- 172.21.15.112:0/1307043160 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f13380cf7a0 0x7f13381f5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.302+0000 7f133e200640 1 --2- 172.21.15.112:0/1307043160 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13380b3e00 0x7f13381f8850 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.302+0000 7f133e200640 1 -- 172.21.15.112:0/1307043160 >> 172.21.15.112:0/1307043160 conn(0x7f133809e030 msgr2=0x7f13380b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:08.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.302+0000 7f133e200640 1 -- 172.21.15.112:0/1307043160 shutdown_connections 2024-09-12T02:42:08.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.302+0000 7f133e200640 1 -- 172.21.15.112:0/1307043160 wait complete. 2024-09-12T02:42:08.721 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:41:53.174744+0000', 'modified': '2024-09-12T02:41:56.211357+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4308}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4308': {'gid': 4308, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.137:6835/1785309492', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6833', 'nonce': 1785309492}, {'type': 'v1', 'addr': '172.21.15.137:6835', 'nonce': 1785309492}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4308, 'qdb_cluster': [4308]} 2024-09-12T02:42:08.721 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:42:08.721 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-12T02:42:08.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.874+0000 7f72cbe00640 1 Processor -- start 2024-09-12T02:42:08.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.875+0000 7f72cbe00640 1 -- start start 2024-09-12T02:42:08.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.876+0000 7f72cbe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72cc15c800 0x7f72cc0708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:08.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.876+0000 7f72cbe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f72cc0b0770 0x7f72cc15f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:08.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.876+0000 7f72cbe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f72cc15fd00 0x7f72cc0b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:08.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.876+0000 7f72cbe00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f72cc0b0c70 con 0x7f72cc15fd00 2024-09-12T02:42:08.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.876+0000 7f72cbe00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f72cc0b0f50 con 0x7f72cc0b0770 2024-09-12T02:42:08.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.876+0000 7f72cbe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f72cc0b1230 con 0x7f72cc15c800 2024-09-12T02:42:08.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.876+0000 7f72cb400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f72cc15fd00 0x7f72cc0b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:08.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.876+0000 7f72cb400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f72cc15fd00 0x7f72cc0b4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57942/0 (socket says 172.21.15.112:57942) 2024-09-12T02:42:08.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.876+0000 7f72cb400640 1 -- 172.21.15.112:0/4133134266 learned_addr learned my addr 172.21.15.112:0/4133134266 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:08.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.876+0000 7f72c2000640 1 --2- 172.21.15.112:0/4133134266 >> v2:172.21.15.137:3300/0 conn(0x7f72cc0b0770 0x7f72cc15f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:08.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.876+0000 7f72caa00640 1 --2- 172.21.15.112:0/4133134266 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72cc15c800 0x7f72cc0708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:08.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.877+0000 7f72cb400640 1 -- 172.21.15.112:0/4133134266 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72cc15c800 msgr2=0x7f72cc0708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:08.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.877+0000 7f72cb400640 1 --2- 172.21.15.112:0/4133134266 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72cc15c800 0x7f72cc0708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.877+0000 7f72cb400640 1 -- 172.21.15.112:0/4133134266 >> v2:172.21.15.137:3300/0 conn(0x7f72cc0b0770 msgr2=0x7f72cc15f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:08.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.877+0000 7f72cb400640 1 --2- 172.21.15.112:0/4133134266 >> v2:172.21.15.137:3300/0 conn(0x7f72cc0b0770 0x7f72cc15f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.877+0000 7f72cb400640 1 -- 172.21.15.112:0/4133134266 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72cc15f2a0 con 0x7f72cc15fd00 2024-09-12T02:42:08.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.877+0000 7f72caa00640 1 --2- 172.21.15.112:0/4133134266 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72cc15c800 0x7f72cc0708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:08.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.877+0000 7f72c2000640 1 --2- 172.21.15.112:0/4133134266 >> v2:172.21.15.137:3300/0 conn(0x7f72cc0b0770 0x7f72cc15f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:08.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.878+0000 7f72cb400640 1 --2- 172.21.15.112:0/4133134266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72cc15fd00 0x7f72cc0b4ce0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0736f0 tx=0x7f72c402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb56e91580a734 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:08.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.878+0000 7f72ca000640 1 -- 172.21.15.112:0/4133134266 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c4036070 con 0x7f72cc15fd00 2024-09-12T02:42:08.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.878+0000 7f72ca000640 1 -- 172.21.15.112:0/4133134266 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c4031600 con 0x7f72cc15fd00 2024-09-12T02:42:08.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.878+0000 7f72ca000640 1 -- 172.21.15.112:0/4133134266 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c40319d0 con 0x7f72cc15fd00 2024-09-12T02:42:08.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.878+0000 7f72cbe00640 1 -- 172.21.15.112:0/4133134266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72cc15fd00 msgr2=0x7f72cc0b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:08.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.878+0000 7f72cbe00640 1 --2- 172.21.15.112:0/4133134266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72cc15fd00 0x7f72cc0b4ce0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0736f0 tx=0x7f72c402a610 comp rx=0 tx=0).stop 2024-09-12T02:42:08.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.878+0000 7f72cbe00640 1 -- 172.21.15.112:0/4133134266 shutdown_connections 2024-09-12T02:42:08.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.878+0000 7f72cbe00640 1 --2- 172.21.15.112:0/4133134266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72cc15fd00 0x7f72cc0b4ce0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.878+0000 7f72cbe00640 1 --2- 172.21.15.112:0/4133134266 >> v2:172.21.15.137:3300/0 conn(0x7f72cc0b0770 0x7f72cc15f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.878+0000 7f72cbe00640 1 --2- 172.21.15.112:0/4133134266 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72cc15c800 0x7f72cc0708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.878+0000 7f72cbe00640 1 -- 172.21.15.112:0/4133134266 >> 172.21.15.112:0/4133134266 conn(0x7f72cc06cce0 msgr2=0x7f72cc06d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:08.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.879+0000 7f72cbe00640 1 -- 172.21.15.112:0/4133134266 shutdown_connections 2024-09-12T02:42:08.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.879+0000 7f72cbe00640 1 -- 172.21.15.112:0/4133134266 wait complete. 2024-09-12T02:42:08.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.880+0000 7f72cbe00640 1 Processor -- start 2024-09-12T02:42:08.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.880+0000 7f72cbe00640 1 -- start start 2024-09-12T02:42:08.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.881+0000 7f72cbe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72cc0b0770 0x7f72cc0b3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:08.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.881+0000 7f72cbe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72cc15c800 0x7f72cc153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:08.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.881+0000 7f72cbe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72cc15fd00 0x7f72cc14d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:08.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.881+0000 7f72cbe00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f72cc0b5220 con 0x7f72cc15c800 2024-09-12T02:42:08.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.881+0000 7f72cbe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f72cc06f3f0 con 0x7f72cc15fd00 2024-09-12T02:42:08.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.881+0000 7f72cbe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f72cc0b53a0 con 0x7f72cc0b0770 2024-09-12T02:42:08.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.881+0000 7f72c2000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72cc15c800 0x7f72cc153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:08.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.881+0000 7f72c2000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72cc15c800 0x7f72cc153490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57952/0 (socket says 172.21.15.112:57952) 2024-09-12T02:42:08.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.881+0000 7f72c2000640 1 -- 172.21.15.112:0/1436662915 learned_addr learned my addr 172.21.15.112:0/1436662915 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:08.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.882+0000 7f72cb400640 1 --2- 172.21.15.112:0/1436662915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72cc15fd00 0x7f72cc14d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:08.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.882+0000 7f72caa00640 1 --2- 172.21.15.112:0/1436662915 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72cc0b0770 0x7f72cc0b3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:08.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.882+0000 7f72c2000640 1 -- 172.21.15.112:0/1436662915 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72cc0b0770 msgr2=0x7f72cc0b3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:08.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.882+0000 7f72c2000640 1 --2- 172.21.15.112:0/1436662915 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72cc0b0770 0x7f72cc0b3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.882+0000 7f72c2000640 1 -- 172.21.15.112:0/1436662915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72cc15fd00 msgr2=0x7f72cc14d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:08.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.882+0000 7f72c2000640 1 --2- 172.21.15.112:0/1436662915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72cc15fd00 0x7f72cc14d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.882+0000 7f72c2000640 1 -- 172.21.15.112:0/1436662915 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72cc161540 con 0x7f72cc15c800 2024-09-12T02:42:08.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.882+0000 7f72c2000640 1 --2- 172.21.15.112:0/1436662915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72cc15c800 0x7f72cc153490 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f72b400e730 tx=0x7f72b400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:08.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.882+0000 7f72c3400640 1 -- 172.21.15.112:0/1436662915 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b400f040 con 0x7f72cc15c800 2024-09-12T02:42:08.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.882+0000 7f72c3400640 1 -- 172.21.15.112:0/1436662915 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72b4004230 con 0x7f72cc15c800 2024-09-12T02:42:08.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.882+0000 7f72c3400640 1 -- 172.21.15.112:0/1436662915 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b400ee40 con 0x7f72cc15c800 2024-09-12T02:42:08.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.882+0000 7f72cbe00640 1 -- 172.21.15.112:0/1436662915 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72cc161820 con 0x7f72cc15c800 2024-09-12T02:42:08.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.882+0000 7f72cbe00640 1 -- 172.21.15.112:0/1436662915 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72cc1507f0 con 0x7f72cc15c800 2024-09-12T02:42:08.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.884+0000 7f72c3400640 1 -- 172.21.15.112:0/1436662915 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f72b400c6d0 con 0x7f72cc15c800 2024-09-12T02:42:08.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.885+0000 7f72c3400640 1 --2- 172.21.15.112:0/1436662915 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f72a806be30 0x7f72a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:08.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.885+0000 7f72c3400640 1 -- 172.21.15.112:0/1436662915 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f72b408abc0 con 0x7f72cc15c800 2024-09-12T02:42:08.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.885+0000 7f72caa00640 1 --2- 172.21.15.112:0/1436662915 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f72a806be30 0x7f72a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:08.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.886+0000 7f72d4a7d740 1 Processor -- start 2024-09-12T02:42:08.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.886+0000 7f72d4a7d740 1 -- start start 2024-09-12T02:42:08.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.886+0000 7f72caa00640 1 --2- 172.21.15.112:0/1436662915 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f72a806be30 0x7f72a806e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f72bc006fd0 tx=0x7f72bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:08.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.887+0000 7f72d4a7d740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602dc9a9ea0 0x5602dc9ef640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:08.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.887+0000 7f72d4a7d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602dc9a7660 0x5602dc9aa280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:08.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.887+0000 7f72d4a7d740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5602dc9ab630 0x5602dc9a4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:08.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.887+0000 7f72d4a7d740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5602dc9083b0 con 0x5602dc9a9ea0 2024-09-12T02:42:08.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.887+0000 7f72d4a7d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5602dc90d410 con 0x5602dc9a7660 2024-09-12T02:42:08.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.887+0000 7f72d4a7d740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x5602dc8b5620 con 0x5602dc9ab630 2024-09-12T02:42:08.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.887+0000 7f72caa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602dc9a9ea0 0x5602dc9ef640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:08.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.887+0000 7f72caa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602dc9a9ea0 0x5602dc9ef640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57960/0 (socket says 172.21.15.112:57960) 2024-09-12T02:42:08.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.887+0000 7f72caa00640 1 -- 172.21.15.112:0/1784493219 learned_addr learned my addr 172.21.15.112:0/1784493219 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:08.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.887+0000 7f72c2000640 1 --2- 172.21.15.112:0/1784493219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602dc9a7660 0x5602dc9aa280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:08.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.887+0000 7f72cb400640 1 --2- 172.21.15.112:0/1784493219 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5602dc9ab630 0x5602dc9a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:08.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.887+0000 7f72caa00640 1 -- 172.21.15.112:0/1784493219 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5602dc9ab630 msgr2=0x5602dc9a4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:08.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.887+0000 7f72caa00640 1 --2- 172.21.15.112:0/1784493219 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5602dc9ab630 0x5602dc9a4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.887+0000 7f72caa00640 1 -- 172.21.15.112:0/1784493219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602dc9a7660 msgr2=0x5602dc9aa280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:08.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.887+0000 7f72caa00640 1 --2- 172.21.15.112:0/1784493219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602dc9a7660 0x5602dc9aa280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.887+0000 7f72caa00640 1 -- 172.21.15.112:0/1784493219 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602dc6202d0 con 0x5602dc9a9ea0 2024-09-12T02:42:08.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.888+0000 7f72caa00640 1 --2- 172.21.15.112:0/1784493219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602dc9a9ea0 0x5602dc9ef640 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f72bc010920 tx=0x7f72bc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e281370a98880302 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:08.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.888+0000 7f72bb400640 1 -- 172.21.15.112:0/1784493219 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72bc01c050 con 0x5602dc9a9ea0 2024-09-12T02:42:08.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.888+0000 7f72bb400640 1 -- 172.21.15.112:0/1784493219 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72bc026070 con 0x5602dc9a9ea0 2024-09-12T02:42:08.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.888+0000 7f72bb400640 1 -- 172.21.15.112:0/1784493219 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72bc00f040 con 0x5602dc9a9ea0 2024-09-12T02:42:08.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.888+0000 7f72d4a7d740 1 -- 172.21.15.112:0/1784493219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602dc9a9ea0 msgr2=0x5602dc9ef640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:08.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.888+0000 7f72d4a7d740 1 --2- 172.21.15.112:0/1784493219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602dc9a9ea0 0x5602dc9ef640 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f72bc010920 tx=0x7f72bc013000 comp rx=0 tx=0).stop 2024-09-12T02:42:08.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.889+0000 7f72d4a7d740 1 -- 172.21.15.112:0/1784493219 shutdown_connections 2024-09-12T02:42:08.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.889+0000 7f72d4a7d740 1 --2- 172.21.15.112:0/1784493219 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5602dc9ab630 0x5602dc9a4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.889+0000 7f72d4a7d740 1 --2- 172.21.15.112:0/1784493219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602dc9a7660 0x5602dc9aa280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.889+0000 7f72d4a7d740 1 --2- 172.21.15.112:0/1784493219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602dc9a9ea0 0x5602dc9ef640 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.889+0000 7f72d4a7d740 1 -- 172.21.15.112:0/1784493219 >> 172.21.15.112:0/1784493219 conn(0x5602dc9a68f0 msgr2=0x5602dc9eeb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:08.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.889+0000 7f72d4a7d740 1 -- 172.21.15.112:0/1784493219 shutdown_connections 2024-09-12T02:42:08.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.889+0000 7f72d4a7d740 1 -- 172.21.15.112:0/1784493219 wait complete. 2024-09-12T02:42:08.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.889+0000 7f72d4a7d740 1 -- start start 2024-09-12T02:42:08.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.890+0000 7f72d4a7d740 1 Processor -- start 2024-09-12T02:42:08.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.890+0000 7f72d4a7d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602dc9a9ea0 0x5602dc9a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:08.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.890+0000 7f72d4a7d740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5602dc9ab630 0x5602dc9c50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:08.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.890+0000 7f72d4a7d740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602dc9a8840 0x5602dc9d3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:08.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.890+0000 7f72d4a7d740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5602dc8c8780 con 0x5602dc9a8840 2024-09-12T02:42:08.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.890+0000 7f72d4a7d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5602dc9093d0 con 0x5602dc9a9ea0 2024-09-12T02:42:08.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.890+0000 7f72d4a7d740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x5602dc9a5d90 con 0x5602dc9ab630 2024-09-12T02:42:08.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.891+0000 7f72d4a7d740 10 client.0 _ll_register_callbacks cb 0x5602dc9065d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:42:08.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.891+0000 7f72cb400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602dc9a8840 0x5602dc9d3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:08.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.891+0000 7f72caa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602dc9a9ea0 0x5602dc9a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:08.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.891+0000 7f72c2000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5602dc9ab630 0x5602dc9c50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:08.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.891+0000 7f72caa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602dc9a9ea0 0x5602dc9a43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:48012/0 (socket says 172.21.15.112:48012) 2024-09-12T02:42:08.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.891+0000 7f72caa00640 1 -- 172.21.15.112:0/303426060 learned_addr learned my addr 172.21.15.112:0/303426060 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:08.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.891+0000 7f72cb400640 1 -- 172.21.15.112:0/303426060 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5602dc9ab630 msgr2=0x5602dc9c50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:08.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.891+0000 7f72cb400640 1 --2- 172.21.15.112:0/303426060 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5602dc9ab630 0x5602dc9c50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.891+0000 7f72cb400640 1 -- 172.21.15.112:0/303426060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602dc9a9ea0 msgr2=0x5602dc9a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:08.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.891+0000 7f72cb400640 1 --2- 172.21.15.112:0/303426060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602dc9a9ea0 0x5602dc9a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.891+0000 7f72cb400640 1 -- 172.21.15.112:0/303426060 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602dc6ea6b0 con 0x5602dc9a8840 2024-09-12T02:42:08.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.892+0000 7f72cb400640 1 --2- 172.21.15.112:0/303426060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602dc9a8840 0x5602dc9d3350 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f72c4030000 tx=0x7f72c4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb64738d125206f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:08.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.892+0000 7f72afe00640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-12T02:42:08.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.892+0000 7f72afe00640 1 -- 172.21.15.112:0/303426060 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c4043070 con 0x5602dc9a8840 2024-09-12T02:42:08.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.892+0000 7f72d4a7d740 1 -- 172.21.15.112:0/303426060 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72bc026070 con 0x5602dc9a8840 2024-09-12T02:42:08.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.892+0000 7f72afe00640 1 -- 172.21.15.112:0/303426060 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f72c403d870 con 0x5602dc9a8840 2024-09-12T02:42:08.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.892+0000 7f72afe00640 1 -- 172.21.15.112:0/303426060 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f72c404d050 con 0x5602dc9a8840 2024-09-12T02:42:08.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.892+0000 7f72d4a7d740 10 client.4581 fetch_fsmap learned FSMap version 8 2024-09-12T02:42:08.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.892+0000 7f72d4a7d740 1 -- 172.21.15.112:0/303426060 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5602dc9d3e90 con 0x5602dc9a8840 2024-09-12T02:42:08.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.892+0000 7f72afe00640 1 -- 172.21.15.112:0/303426060 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72bc026070 con 0x5602dc9a8840 2024-09-12T02:42:08.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.892+0000 7f72afe00640 1 -- 172.21.15.112:0/303426060 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7f72c4050020 con 0x5602dc9a8840 2024-09-12T02:42:08.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.892+0000 7f72d4a7d740 10 client.4581 fetch_fsmap finished waiting for FSMap version 8 2024-09-12T02:42:08.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.892+0000 7f72d4a7d740 10 client.4581 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:42:08.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.892+0000 7f72d4a7d740 20 client.4581 populate_metadata read hostname 'smithi112' 2024-09-12T02:42:08.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.893+0000 7f72d4a7d740 1 --2- 172.21.15.112:0/303426060 >> [v2:172.21.15.137:6833/1785309492,v1:172.21.15.137:6835/1785309492] conn(0x5602dc9cac30 0x5602dc9c9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:08.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.893+0000 7f72d4a7d740 4 client.4581 mds_command: new command op to 4308 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:42:08.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.893+0000 7f72d4a7d740 1 -- 172.21.15.112:0/303426060 --> [v2:172.21.15.137:6833/1785309492,v1:172.21.15.137:6835/1785309492] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602dc91ab40 con 0x5602dc9cac30 2024-09-12T02:42:08.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.893+0000 7f72caa00640 1 --2- 172.21.15.112:0/303426060 >> [v2:172.21.15.137:6833/1785309492,v1:172.21.15.137:6835/1785309492] conn(0x5602dc9cac30 0x5602dc9c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:08.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.893+0000 7f72caa00640 1 --2- 172.21.15.112:0/303426060 >> [v2:172.21.15.137:6833/1785309492,v1:172.21.15.137:6835/1785309492] conn(0x5602dc9cac30 0x5602dc9c9960 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9cf09b8a7d64cdb server_cookie=ff5d5efe989f966 in_seq=0 out_seq=0 2024-09-12T02:42:08.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.893+0000 7f72afe00640 10 client.4581 ms_handle_connect on v2:172.21.15.137:6833/1785309492 2024-09-12T02:42:08.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.895+0000 7f72afe00640 1 -- 172.21.15.112:0/303426060 <== mds.0 v2:172.21.15.137:6833/1785309492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5602dc91ab40 con 0x5602dc9cac30 2024-09-12T02:42:08.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.895+0000 7f72afe00640 10 client.4581 handle_command_reply: tid=0 2024-09-12T02:42:08.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.895+0000 7f72d4a7d740 1 client.4581 shutdown 2024-09-12T02:42:08.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.895+0000 7f72d4a7d740 1 -- 172.21.15.112:0/303426060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602dc9a8840 msgr2=0x5602dc9d3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:08.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.895+0000 7f72d4a7d740 1 --2- 172.21.15.112:0/303426060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602dc9a8840 0x5602dc9d3350 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f72c4030000 tx=0x7f72c4004ab0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.895+0000 7f72d4a7d740 1 -- 172.21.15.112:0/303426060 shutdown_connections 2024-09-12T02:42:08.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.895+0000 7f72d4a7d740 1 --2- 172.21.15.112:0/303426060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602dc9a8840 0x5602dc9d3350 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.895+0000 7f72d4a7d740 1 --2- 172.21.15.112:0/303426060 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5602dc9ab630 0x5602dc9c50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.895+0000 7f72d4a7d740 1 --2- 172.21.15.112:0/303426060 >> [v2:172.21.15.137:6833/1785309492,v1:172.21.15.137:6835/1785309492] conn(0x5602dc9cac30 0x5602dc9c9960 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.895+0000 7f72d4a7d740 1 --2- 172.21.15.112:0/303426060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602dc9a9ea0 0x5602dc9a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.895+0000 7f72d4a7d740 1 -- 172.21.15.112:0/303426060 >> 172.21.15.112:0/303426060 conn(0x5602dc9a7660 msgr2=0x5602dc9ee070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:08.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.895+0000 7f72afe00640 0 client.4581 ms_handle_reset on v2:172.21.15.137:6833/1785309492 2024-09-12T02:42:08.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.895+0000 7f72d4a7d740 1 -- 172.21.15.112:0/303426060 shutdown_connections 2024-09-12T02:42:08.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.895+0000 7f72d4a7d740 1 -- 172.21.15.112:0/303426060 wait complete. 2024-09-12T02:42:08.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.895+0000 7f72d4a7d740 20 client.4581 trim_cache size 0 max 16384 2024-09-12T02:42:08.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.913+0000 7f72d4a7d740 1 Processor -- start 2024-09-12T02:42:08.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.913+0000 7f72d4a7d740 1 -- start start 2024-09-12T02:42:08.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.914+0000 7f72d4a7d740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602dc9a8840 0x5602dc9cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:08.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.914+0000 7f72d4a7d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602dc9a9ea0 0x5602dc9f0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:08.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.914+0000 7f72d4a7d740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5602dc9ab630 0x5602dc9f0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:08.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.914+0000 7f72d4a7d740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f72cc200040 con 0x5602dc9a8840 2024-09-12T02:42:08.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.914+0000 7f72d4a7d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f72cc1ff3a0 con 0x5602dc9a9ea0 2024-09-12T02:42:08.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.914+0000 7f72d4a7d740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f72cc1ff9f0 con 0x5602dc9ab630 2024-09-12T02:42:08.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.914+0000 7f72caa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602dc9a8840 0x5602dc9cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:08.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.915+0000 7f72caa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602dc9a8840 0x5602dc9cfe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57986/0 (socket says 172.21.15.112:57986) 2024-09-12T02:42:08.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.915+0000 7f72caa00640 1 -- 172.21.15.112:0/2256238402 learned_addr learned my addr 172.21.15.112:0/2256238402 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:08.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.915+0000 7f72c2000640 1 --2- 172.21.15.112:0/2256238402 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602dc9a9ea0 0x5602dc9f0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:08.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.915+0000 7f72cb400640 1 --2- 172.21.15.112:0/2256238402 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5602dc9ab630 0x5602dc9f0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:08.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.915+0000 7f72caa00640 1 -- 172.21.15.112:0/2256238402 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5602dc9ab630 msgr2=0x5602dc9f0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:08.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.915+0000 7f72caa00640 1 --2- 172.21.15.112:0/2256238402 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5602dc9ab630 0x5602dc9f0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.915+0000 7f72caa00640 1 -- 172.21.15.112:0/2256238402 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602dc9a9ea0 msgr2=0x5602dc9f0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:08.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.915+0000 7f72caa00640 1 --2- 172.21.15.112:0/2256238402 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602dc9a9ea0 0x5602dc9f0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.915+0000 7f72caa00640 1 -- 172.21.15.112:0/2256238402 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602dc9d36c0 con 0x5602dc9a8840 2024-09-12T02:42:08.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.915+0000 7f72cb400640 1 --2- 172.21.15.112:0/2256238402 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5602dc9ab630 0x5602dc9f0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:42:08.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.915+0000 7f72caa00640 1 --2- 172.21.15.112:0/2256238402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602dc9a8840 0x5602dc9cfe40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f72bc015840 tx=0x7f72bc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f3580a1a64bdf8f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:08.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.915+0000 7f72baa00640 1 -- 172.21.15.112:0/2256238402 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72bc01c040 con 0x5602dc9a8840 2024-09-12T02:42:08.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.915+0000 7f72baa00640 1 -- 172.21.15.112:0/2256238402 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72bc026040 con 0x5602dc9a8840 2024-09-12T02:42:08.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.915+0000 7f72baa00640 1 -- 172.21.15.112:0/2256238402 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72bc021660 con 0x5602dc9a8840 2024-09-12T02:42:08.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.916+0000 7f72d4a7d740 1 -- 172.21.15.112:0/2256238402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602dc9a8840 msgr2=0x5602dc9cfe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:08.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.916+0000 7f72d4a7d740 1 --2- 172.21.15.112:0/2256238402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602dc9a8840 0x5602dc9cfe40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f72bc015840 tx=0x7f72bc015000 comp rx=0 tx=0).stop 2024-09-12T02:42:08.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.916+0000 7f72d4a7d740 1 -- 172.21.15.112:0/2256238402 shutdown_connections 2024-09-12T02:42:08.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.916+0000 7f72d4a7d740 1 --2- 172.21.15.112:0/2256238402 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5602dc9ab630 0x5602dc9f0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.916+0000 7f72d4a7d740 1 --2- 172.21.15.112:0/2256238402 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602dc9a9ea0 0x5602dc9f0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.916+0000 7f72d4a7d740 1 --2- 172.21.15.112:0/2256238402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602dc9a8840 0x5602dc9cfe40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.916+0000 7f72d4a7d740 1 -- 172.21.15.112:0/2256238402 >> 172.21.15.112:0/2256238402 conn(0x5602dc9a7660 msgr2=0x5602dc9d4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:08.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.916+0000 7f72d4a7d740 1 -- 172.21.15.112:0/2256238402 shutdown_connections 2024-09-12T02:42:08.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.916+0000 7f72d4a7d740 1 -- 172.21.15.112:0/2256238402 wait complete. 2024-09-12T02:42:08.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.916+0000 7f72d4a7d740 1 -- start start 2024-09-12T02:42:08.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.917+0000 7f72d4a7d740 1 Processor -- start 2024-09-12T02:42:08.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.917+0000 7f72d4a7d740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5602dc9a8840 0x5602dc9c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:08.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.918+0000 7f72d4a7d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602dc9a9ea0 0x5602dc9eb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:08.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.918+0000 7f72d4a7d740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602dc9ab630 0x5602dca75150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:08.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.918+0000 7f72d4a7d740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5602dc9caab0 con 0x5602dc9ab630 2024-09-12T02:42:08.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.918+0000 7f72d4a7d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5602dc9a9200 con 0x5602dc9a9ea0 2024-09-12T02:42:08.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.918+0000 7f72d4a7d740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x5602dc9cb0d0 con 0x5602dc9a8840 2024-09-12T02:42:08.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.918+0000 7f72d4a7d740 10 client.0 _ll_register_callbacks cb 0x7f72c4009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:42:08.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.918+0000 7f72cb400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602dc9ab630 0x5602dca75150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:08.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.918+0000 7f72cb400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602dc9ab630 0x5602dca75150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57990/0 (socket says 172.21.15.112:57990) 2024-09-12T02:42:08.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.918+0000 7f72cb400640 1 -- 172.21.15.112:0/1971488731 learned_addr learned my addr 172.21.15.112:0/1971488731 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:08.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.918+0000 7f72cb400640 1 -- 172.21.15.112:0/1971488731 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5602dc9a8840 msgr2=0x5602dc9c96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:08.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.918+0000 7f72cb400640 1 --2- 172.21.15.112:0/1971488731 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5602dc9a8840 0x5602dc9c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.918+0000 7f72cb400640 1 -- 172.21.15.112:0/1971488731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602dc9a9ea0 msgr2=0x5602dc9eb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:08.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.918+0000 7f72cb400640 1 --2- 172.21.15.112:0/1971488731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602dc9a9ea0 0x5602dc9eb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.918+0000 7f72cb400640 1 -- 172.21.15.112:0/1971488731 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602dc9a6690 con 0x5602dc9ab630 2024-09-12T02:42:08.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.918+0000 7f72cb400640 1 --2- 172.21.15.112:0/1971488731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602dc9ab630 0x5602dca75150 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f72c402a650 tx=0x7f72c4009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db85fbc68494cc8b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:08.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.918+0000 7f72afe00640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-12T02:42:08.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.918+0000 7f72afe00640 1 -- 172.21.15.112:0/1971488731 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c4043070 con 0x5602dc9ab630 2024-09-12T02:42:08.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.919+0000 7f72afe00640 1 -- 172.21.15.112:0/1971488731 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f72c4003ba0 con 0x5602dc9ab630 2024-09-12T02:42:08.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.919+0000 7f72d4a7d740 1 -- 172.21.15.112:0/1971488731 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72bc026040 con 0x5602dc9ab630 2024-09-12T02:42:08.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.919+0000 7f72afe00640 1 -- 172.21.15.112:0/1971488731 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f72c403de60 con 0x5602dc9ab630 2024-09-12T02:42:08.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.919+0000 7f72d4a7d740 10 client.4587 fetch_fsmap learned FSMap version 8 2024-09-12T02:42:08.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.919+0000 7f72d4a7d740 1 -- 172.21.15.112:0/1971488731 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5602dc9cf660 con 0x5602dc9ab630 2024-09-12T02:42:08.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.919+0000 7f72afe00640 1 -- 172.21.15.112:0/1971488731 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72bc026040 con 0x5602dc9ab630 2024-09-12T02:42:08.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.919+0000 7f72afe00640 1 -- 172.21.15.112:0/1971488731 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7f72c4059050 con 0x5602dc9ab630 2024-09-12T02:42:08.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.919+0000 7f72d4a7d740 10 client.4587 fetch_fsmap finished waiting for FSMap version 8 2024-09-12T02:42:08.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.919+0000 7f72d4a7d740 10 client.4587 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:42:08.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.919+0000 7f72d4a7d740 20 client.4587 populate_metadata read hostname 'smithi112' 2024-09-12T02:42:08.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.919+0000 7f72d4a7d740 1 --2- 172.21.15.112:0/1971488731 >> [v2:172.21.15.137:6833/1785309492,v1:172.21.15.137:6835/1785309492] conn(0x5602dca11a30 0x5602dca11e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:08.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.919+0000 7f72d4a7d740 4 client.4587 mds_command: new command op to 4308 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:42:08.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.919+0000 7f72d4a7d740 1 -- 172.21.15.112:0/1971488731 --> [v2:172.21.15.137:6833/1785309492,v1:172.21.15.137:6835/1785309492] -- command(tid 0: {"prefix": "status"}) -- 0x5602dc914e90 con 0x5602dca11a30 2024-09-12T02:42:08.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.920+0000 7f72caa00640 1 --2- 172.21.15.112:0/1971488731 >> [v2:172.21.15.137:6833/1785309492,v1:172.21.15.137:6835/1785309492] conn(0x5602dca11a30 0x5602dca11e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:08.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.920+0000 7f72caa00640 1 --2- 172.21.15.112:0/1971488731 >> [v2:172.21.15.137:6833/1785309492,v1:172.21.15.137:6835/1785309492] conn(0x5602dca11a30 0x5602dca11e10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7ebc3176f00947 server_cookie=9e1ab6515f06d5c7 in_seq=0 out_seq=0 2024-09-12T02:42:08.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.920+0000 7f72afe00640 10 client.4587 ms_handle_connect on v2:172.21.15.137:6833/1785309492 2024-09-12T02:42:08.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.920+0000 7f72afe00640 1 -- 172.21.15.112:0/1971488731 <== mds.0 v2:172.21.15.137:6833/1785309492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x5602dc914e90 con 0x5602dca11a30 2024-09-12T02:42:08.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.920+0000 7f72afe00640 10 client.4587 handle_command_reply: tid=0 2024-09-12T02:42:08.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.920+0000 7f72d4a7d740 1 client.4587 shutdown 2024-09-12T02:42:08.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.921+0000 7f72d4a7d740 1 -- 172.21.15.112:0/1971488731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602dc9ab630 msgr2=0x5602dca75150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:08.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.921+0000 7f72d4a7d740 1 --2- 172.21.15.112:0/1971488731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602dc9ab630 0x5602dca75150 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f72c402a650 tx=0x7f72c4009810 comp rx=0 tx=0).stop 2024-09-12T02:42:08.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.921+0000 7f72d4a7d740 1 -- 172.21.15.112:0/1971488731 shutdown_connections 2024-09-12T02:42:08.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.921+0000 7f72d4a7d740 1 --2- 172.21.15.112:0/1971488731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602dc9ab630 0x5602dca75150 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.921+0000 7f72d4a7d740 1 --2- 172.21.15.112:0/1971488731 >> [v2:172.21.15.137:6833/1785309492,v1:172.21.15.137:6835/1785309492] conn(0x5602dca11a30 0x5602dca11e10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.921+0000 7f72d4a7d740 1 --2- 172.21.15.112:0/1971488731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602dc9a9ea0 0x5602dc9eb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.921+0000 7f72d4a7d740 1 --2- 172.21.15.112:0/1971488731 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5602dc9a8840 0x5602dc9c96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.921+0000 7f72d4a7d740 1 -- 172.21.15.112:0/1971488731 >> 172.21.15.112:0/1971488731 conn(0x5602dc9a7660 msgr2=0x5602dc9d4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:08.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.921+0000 7f72afe00640 0 client.4587 ms_handle_reset on v2:172.21.15.137:6833/1785309492 2024-09-12T02:42:08.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.921+0000 7f72d4a7d740 1 -- 172.21.15.112:0/1971488731 shutdown_connections 2024-09-12T02:42:08.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.921+0000 7f72d4a7d740 1 -- 172.21.15.112:0/1971488731 wait complete. 2024-09-12T02:42:08.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.921+0000 7f72d4a7d740 20 client.4587 trim_cache size 0 max 16384 2024-09-12T02:42:08.928 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:42:08.928 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:42:08.928 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2024-09-12T02:42:08.928 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 4308, 2024-09-12T02:42:08.928 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2024-09-12T02:42:08.928 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2024-09-12T02:42:08.928 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2024-09-12T02:42:08.928 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 15.134406293, 2024-09-12T02:42:08.928 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 8, 2024-09-12T02:42:08.928 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 20, 2024-09-12T02:42:08.928 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 20, 2024-09-12T02:42:08.929 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 21.164683137000001 2024-09-12T02:42:08.929 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:42:08.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.921+0000 7f72cbe00640 1 -- 172.21.15.112:0/1436662915 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f72a806be30 msgr2=0x7f72a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:08.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.921+0000 7f72cbe00640 1 --2- 172.21.15.112:0/1436662915 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f72a806be30 0x7f72a806e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f72bc006fd0 tx=0x7f72bc008040 comp rx=0 tx=0).stop 2024-09-12T02:42:08.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.922+0000 7f72cbe00640 1 -- 172.21.15.112:0/1436662915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72cc15c800 msgr2=0x7f72cc153490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:08.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.922+0000 7f72cbe00640 1 --2- 172.21.15.112:0/1436662915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72cc15c800 0x7f72cc153490 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f72b400e730 tx=0x7f72b400ebf0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.922+0000 7f72cbe00640 1 -- 172.21.15.112:0/1436662915 shutdown_connections 2024-09-12T02:42:08.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.922+0000 7f72cbe00640 1 --2- 172.21.15.112:0/1436662915 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f72a806be30 0x7f72a806e2f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.922+0000 7f72cbe00640 1 --2- 172.21.15.112:0/1436662915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72cc15fd00 0x7f72cc14d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.922+0000 7f72cbe00640 1 --2- 172.21.15.112:0/1436662915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72cc15c800 0x7f72cc153490 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.922+0000 7f72cbe00640 1 --2- 172.21.15.112:0/1436662915 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72cc0b0770 0x7f72cc0b3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:08.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.922+0000 7f72cbe00640 1 -- 172.21.15.112:0/1436662915 >> 172.21.15.112:0/1436662915 conn(0x7f72cc06cce0 msgr2=0x7f72cc159860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:08.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.922+0000 7f72cbe00640 1 -- 172.21.15.112:0/1436662915 shutdown_connections 2024-09-12T02:42:08.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:08.922+0000 7f72cbe00640 1 -- 172.21.15.112:0/1436662915 wait complete. 2024-09-12T02:42:08.938 INFO:teuthology.run_tasks:Running task sequential... 2024-09-12T02:42:08.947 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-12T02:42:08.948 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-12T02:42:08.948 INFO:teuthology.task.print:Enabling mgr modules 2024-09-12T02:42:08.948 INFO:teuthology.run_tasks:Running task kclient... 2024-09-12T02:42:08.974 INFO:tasks.kclient:Mounting kernel clients... 2024-09-12T02:42:08.974 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-12T02:42:08.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:08.975 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-12T02:42:09.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:09.011 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2024-09-12T02:42:09.109 INFO:teuthology.orchestra.run.smithi112.stderr:Cannot find device "ceph-brx" 2024-09-12T02:42:09.111 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:42:09.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:09.112 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-12T02:42:09.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:09.149 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2024-09-12T02:42:09.246 INFO:teuthology.orchestra.run.smithi112.stderr:Cannot find device "ceph-brx" 2024-09-12T02:42:09.248 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:42:09.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:09.249 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-09-12T02:42:09.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:09.290 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link delete ceph-brx 2024-09-12T02:42:09.397 INFO:teuthology.orchestra.run.smithi137.stderr:Cannot find device "ceph-brx" 2024-09-12T02:42:09.400 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:42:09.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:09.401 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-09-12T02:42:09.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:09.439 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link delete ceph-brx 2024-09-12T02:42:09.537 INFO:teuthology.orchestra.run.smithi137.stderr:Cannot find device "ceph-brx" 2024-09-12T02:42:09.539 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:42:09.540 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-09-12T02:42:09.540 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T02:42:09.540 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:42:09.541 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:42:09.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.692+0000 7f43e1800640 1 Processor -- start 2024-09-12T02:42:09.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.693+0000 7f43e1800640 1 -- start start 2024-09-12T02:42:09.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.694+0000 7f43e1800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f43dc06d590 0x7f43dc06f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:09.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.694+0000 7f43e1800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f43dc0d0820 0x7f43dc0d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:09.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.694+0000 7f43e1800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43dc0b42c0 con 0x7f43dc15b9a0 2024-09-12T02:42:09.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.694+0000 7f43e1800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f43dc06de70 con 0x7f43dc06d590 2024-09-12T02:42:09.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.694+0000 7f43e1800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f43dc15bd80 con 0x7f43dc0d0820 2024-09-12T02:42:09.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.694+0000 7f43dbe00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f43dc15b9a0 0x7f43dc0b5020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34026/0 (socket says 172.21.15.112:34026) 2024-09-12T02:42:09.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.694+0000 7f43dbe00640 1 -- 172.21.15.112:0/434788843 learned_addr learned my addr 172.21.15.112:0/434788843 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:09.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.695+0000 7f43db400640 1 --2- 172.21.15.112:0/434788843 >> v2:172.21.15.112:3300/0 conn(0x7f43dc06d590 0x7f43dc06f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:09.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.695+0000 7f43e0e00640 1 --2- 172.21.15.112:0/434788843 >> v2:172.21.15.137:3300/0 conn(0x7f43dc0d0820 0x7f43dc0d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:09.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.695+0000 7f43daa00640 1 -- 172.21.15.112:0/434788843 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2636711472 0 0) 0x7f43cc001490 con 0x7f43dc15b9a0 2024-09-12T02:42:09.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.695+0000 7f43daa00640 1 -- 172.21.15.112:0/434788843 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43c0005730 con 0x7f43dc15b9a0 2024-09-12T02:42:09.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.695+0000 7f43db400640 1 -- 172.21.15.112:0/434788843 >> v2:172.21.15.137:3300/0 conn(0x7f43dc0d0820 msgr2=0x7f43dc0d0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:09.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.695+0000 7f43db400640 1 --2- 172.21.15.112:0/434788843 >> v2:172.21.15.137:3300/0 conn(0x7f43dc0d0820 0x7f43dc0d0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:09.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.695+0000 7f43db400640 1 -- 172.21.15.112:0/434788843 >> v1:172.21.15.112:6789/0 conn(0x7f43dc15b9a0 legacy=0x7f43dc0b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:09.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.695+0000 7f43db400640 1 -- 172.21.15.112:0/434788843 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43dc0b5730 con 0x7f43dc06d590 2024-09-12T02:42:09.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.696+0000 7f43db400640 1 --2- 172.21.15.112:0/434788843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43dc06d590 0x7f43dc06f270 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f43dc06f7b0 tx=0x7f43c802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a4e5712f15dab6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:09.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.696+0000 7f43daa00640 1 -- 172.21.15.112:0/434788843 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c8037070 con 0x7f43dc06d590 2024-09-12T02:42:09.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.696+0000 7f43daa00640 1 -- 172.21.15.112:0/434788843 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43c8032440 con 0x7f43dc06d590 2024-09-12T02:42:09.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.696+0000 7f43daa00640 1 -- 172.21.15.112:0/434788843 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c8032810 con 0x7f43dc06d590 2024-09-12T02:42:09.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.697+0000 7f43e1800640 1 -- 172.21.15.112:0/434788843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43dc06d590 msgr2=0x7f43dc06f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:09.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.697+0000 7f43e1800640 1 --2- 172.21.15.112:0/434788843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43dc06d590 0x7f43dc06f270 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f43dc06f7b0 tx=0x7f43c802a1a0 comp rx=0 tx=0).stop 2024-09-12T02:42:09.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.697+0000 7f43e1800640 1 -- 172.21.15.112:0/434788843 shutdown_connections 2024-09-12T02:42:09.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.697+0000 7f43e1800640 1 --2- 172.21.15.112:0/434788843 >> v2:172.21.15.137:3300/0 conn(0x7f43dc0d0820 0x7f43dc0d0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:09.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.697+0000 7f43e1800640 1 --2- 172.21.15.112:0/434788843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43dc06d590 0x7f43dc06f270 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:09.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.697+0000 7f43e1800640 1 -- 172.21.15.112:0/434788843 >> 172.21.15.112:0/434788843 conn(0x7f43dc06bbd0 msgr2=0x7f43dc06bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:09.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.697+0000 7f43e1800640 1 -- 172.21.15.112:0/434788843 shutdown_connections 2024-09-12T02:42:09.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.697+0000 7f43e1800640 1 -- 172.21.15.112:0/434788843 wait complete. 2024-09-12T02:42:09.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.699+0000 7f43e1800640 1 Processor -- start 2024-09-12T02:42:09.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.699+0000 7f43e1800640 1 -- start start 2024-09-12T02:42:09.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.700+0000 7f43e1800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43dc06d590 0x7f43dc14a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:09.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.700+0000 7f43e1800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43dc0d0820 0x7f43dc0ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:09.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.700+0000 7f43e1800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43dc15b9a0 0x7f43dc0ad600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:09.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.700+0000 7f43e1800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc0b4820 con 0x7f43dc0d0820 2024-09-12T02:42:09.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.700+0000 7f43e1800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc0b4540 con 0x7f43dc15b9a0 2024-09-12T02:42:09.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.700+0000 7f43e1800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f43dc0b4b00 con 0x7f43dc06d590 2024-09-12T02:42:09.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.700+0000 7f43db400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43dc0d0820 0x7f43dc0ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:09.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.700+0000 7f43db400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43dc0d0820 0x7f43dc0ad0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58022/0 (socket says 172.21.15.112:58022) 2024-09-12T02:42:09.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.700+0000 7f43db400640 1 -- 172.21.15.112:0/2771564042 learned_addr learned my addr 172.21.15.112:0/2771564042 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:09.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.700+0000 7f43db400640 1 -- 172.21.15.112:0/2771564042 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43dc06d590 msgr2=0x7f43dc14a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:09.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.700+0000 7f43db400640 1 --2- 172.21.15.112:0/2771564042 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43dc06d590 0x7f43dc14a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:09.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.700+0000 7f43db400640 1 -- 172.21.15.112:0/2771564042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43dc15b9a0 msgr2=0x7f43dc0ad600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:09.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.700+0000 7f43db400640 1 --2- 172.21.15.112:0/2771564042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43dc15b9a0 0x7f43dc0ad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:09.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.700+0000 7f43db400640 1 -- 172.21.15.112:0/2771564042 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43dc15def0 con 0x7f43dc0d0820 2024-09-12T02:42:09.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.700+0000 7f43db400640 1 --2- 172.21.15.112:0/2771564042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43dc0d0820 0x7f43dc0ad0c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f43c8000c00 tx=0x7f43c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:09.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.701+0000 7f43d3e00640 1 -- 172.21.15.112:0/2771564042 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c8041020 con 0x7f43dc0d0820 2024-09-12T02:42:09.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.701+0000 7f43d3e00640 1 -- 172.21.15.112:0/2771564042 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43c803d700 con 0x7f43dc0d0820 2024-09-12T02:42:09.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.701+0000 7f43e1800640 1 -- 172.21.15.112:0/2771564042 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43dc15e1d0 con 0x7f43dc0d0820 2024-09-12T02:42:09.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.701+0000 7f43d3e00640 1 -- 172.21.15.112:0/2771564042 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c8037040 con 0x7f43dc0d0820 2024-09-12T02:42:09.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.701+0000 7f43e1800640 1 -- 172.21.15.112:0/2771564042 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43dc15e790 con 0x7f43dc0d0820 2024-09-12T02:42:09.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.702+0000 7f43e1800640 1 -- 172.21.15.112:0/2771564042 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43dc0b5b50 con 0x7f43dc0d0820 2024-09-12T02:42:09.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.703+0000 7f43d3e00640 1 -- 172.21.15.112:0/2771564042 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f43c8044020 con 0x7f43dc0d0820 2024-09-12T02:42:09.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.704+0000 7f43d3e00640 1 --2- 172.21.15.112:0/2771564042 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f43bc06be30 0x7f43bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:09.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.704+0000 7f43d3e00640 1 -- 172.21.15.112:0/2771564042 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f43c80ab690 con 0x7f43dc0d0820 2024-09-12T02:42:09.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.704+0000 7f43dbe00640 1 --2- 172.21.15.112:0/2771564042 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f43bc06be30 0x7f43bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:09.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.705+0000 7f43dbe00640 1 --2- 172.21.15.112:0/2771564042 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f43bc06be30 0x7f43bc06e2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f43cc0012e0 tx=0x7f43cc001490 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:09.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.708+0000 7f43d3e00640 1 -- 172.21.15.112:0/2771564042 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f43c804b030 con 0x7f43dc0d0820 2024-09-12T02:42:09.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.918+0000 7f43e1800640 1 -- 172.21.15.112:0/2771564042 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f43dc14a800 con 0x7f43dc0d0820 2024-09-12T02:42:09.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.919+0000 7f43d3e00640 1 -- 172.21.15.112:0/2771564042 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f43c8079fb0 con 0x7f43dc0d0820 2024-09-12T02:42:09.920 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:42:09.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.921+0000 7f43e1800640 1 -- 172.21.15.112:0/2771564042 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f43bc06be30 msgr2=0x7f43bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:09.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.921+0000 7f43e1800640 1 --2- 172.21.15.112:0/2771564042 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f43bc06be30 0x7f43bc06e2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f43cc0012e0 tx=0x7f43cc001490 comp rx=0 tx=0).stop 2024-09-12T02:42:09.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.921+0000 7f43e1800640 1 -- 172.21.15.112:0/2771564042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43dc0d0820 msgr2=0x7f43dc0ad0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:09.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.921+0000 7f43e1800640 1 --2- 172.21.15.112:0/2771564042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43dc0d0820 0x7f43dc0ad0c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f43c8000c00 tx=0x7f43c80046c0 comp rx=0 tx=0).stop 2024-09-12T02:42:09.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.921+0000 7f43e1800640 1 -- 172.21.15.112:0/2771564042 shutdown_connections 2024-09-12T02:42:09.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.921+0000 7f43e1800640 1 --2- 172.21.15.112:0/2771564042 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f43bc06be30 0x7f43bc06e2f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:09.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.921+0000 7f43e1800640 1 --2- 172.21.15.112:0/2771564042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43dc15b9a0 0x7f43dc0ad600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:09.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.921+0000 7f43e1800640 1 --2- 172.21.15.112:0/2771564042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43dc0d0820 0x7f43dc0ad0c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:09.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.921+0000 7f43e1800640 1 --2- 172.21.15.112:0/2771564042 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43dc06d590 0x7f43dc14a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:09.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.921+0000 7f43e1800640 1 -- 172.21.15.112:0/2771564042 >> 172.21.15.112:0/2771564042 conn(0x7f43dc06bbd0 msgr2=0x7f43dc0b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:09.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.921+0000 7f43e1800640 1 -- 172.21.15.112:0/2771564042 shutdown_connections 2024-09-12T02:42:09.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:09.921+0000 7f43e1800640 1 -- 172.21.15.112:0/2771564042 wait complete. 2024-09-12T02:42:09.937 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T02:42:09.937 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:42:09.937 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-09-12T02:42:09.937 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:42:09.937 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:42:09.937 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T02:42:09.937 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:42:09.937 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:42:09.938 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:42:09.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:09.938 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-09-12T02:42:09.973 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:42:09.973 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:42:09.974 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:42:09.974 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:09.974 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-12T02:42:09.974 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:09.974 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:42:09.974 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-09-12T02:42:09.974 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-09-12T02:42:09.974 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:42:09.974 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-09-12T02:42:09.975 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-09-12T02:42:09.975 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:42:09.975 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:42:09.975 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:42:09.975 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:42:09.975 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:42:09.975 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42748sec preferred_lft 42748sec 2024-09-12T02:42:09.975 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link noprefixroute 2024-09-12T02:42:09.976 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:09.977 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T02:42:09.978 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:42:09.978 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-12T02:42:09.978 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add name ceph-brx type bridge 2024-09-12T02:42:09.978 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip addr flush dev ceph-brx 2024-09-12T02:42:09.978 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set ceph-brx up 2024-09-12T02:42:09.978 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T02:42:09.978 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-12T02:42:10.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:42:10.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:10.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:10.394 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:42:10.450 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-12T02:42:10.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:10.453 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-09-12T02:42:10.506 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-09-12T02:42:10.506 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:42:10.506 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:42:10.506 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:42:10.506 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:42:10.507 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:42:10.507 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-12T02:42:10.507 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:42:10.507 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:42:10.508 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:42:10.508 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-12T02:42:10.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:42:11.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:11.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:11.141 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-12T02:42:11.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:11.179 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list-id 2024-09-12T02:42:11.254 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:42:11.254 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-12T02:42:11.254 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:42:11.254 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-12T02:42:11.254 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-12T02:42:11.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:42:11.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:11.430 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-12T02:42:11.430 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:42:11.430 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-12T02:42:11.430 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-12T02:42:11.431 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T02:42:11.431 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-12T02:42:11.431 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-12T02:42:11.431 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-12T02:42:11.431 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-12T02:42:11.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:42:11.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:11.677 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:42:11.677 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-12T02:42:11.677 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2024-09-12T02:42:11.677 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T02:42:11.677 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-12T02:42:11.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:42:11.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:11.842 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:42:11.842 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:42:11.877 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:42:11.877 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:42:11.877 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:42:11.951 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T02:42:11.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:11.952 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:42:12.122 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:42:12.122 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:42:12.727 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:42:12.727 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:42:12.727 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-09-12T02:42:12.727 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 0@7c01f3b3-dec2-4449-a33f-f960d7527ea6.cephfs=/ 2024-09-12T02:42:12.728 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.112:3300/172.21.15.137:3300/172.21.15.137:3301" will pass to kernel 2024-09-12T02:42:12.729 INFO:teuthology.orchestra.run.smithi112.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:42:12.729 INFO:teuthology.orchestra.run.smithi112.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:42:12.729 INFO:teuthology.orchestra.run.smithi112.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:42:12.729 INFO:teuthology.orchestra.run.smithi112.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:42:12.729 INFO:teuthology.orchestra.run.smithi112.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:42:12.732 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:42:12.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:12.732 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:42:12.789 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:42:12.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:42:12.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:12.887 INFO:teuthology.orchestra.run.smithi112.stdout:client4394 2024-09-12T02:42:12.887 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:42:12.887 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:42:12.923 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:42:13.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:42:13.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:13.062 INFO:teuthology.orchestra.run.smithi112.stdout:client4394 2024-09-12T02:42:13.062 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:42:13.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:42:13.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:13.162 INFO:teuthology.orchestra.run.smithi112.stdout:client4394 2024-09-12T02:42:13.162 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/7c01f3b3-dec2-4449-a33f-f960d7527ea6.client4394/status') 2024-09-12T02:42:13.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:42:13.266 INFO:teuthology.orchestra.run.smithi112.stdout:instance: client.4394 (3)172.21.15.112:0/341560046 2024-09-12T02:42:13.266 INFO:teuthology.orchestra.run.smithi112.stdout:blocklisted: false 2024-09-12T02:42:13.266 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2024-09-12T02:42:13.267 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2024-09-12T02:42:13.267 INFO:teuthology.orchestra.run.smithi112.stderr:70 bytes copied, 7.0633e-05 s, 991 kB/s 2024-09-12T02:42:13.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:13.277 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-09-12T02:42:13.277 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T02:42:13.277 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-12T02:42:13.277 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:42:13.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.431+0000 7f9037e00640 1 Processor -- start 2024-09-12T02:42:13.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.431+0000 7f9037e00640 1 -- start start 2024-09-12T02:42:13.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.432+0000 7f9037e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9038162510 0x7f90380d58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:13.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.432+0000 7f9037e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f90380b5280 0x7f90380b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:13.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.432+0000 7f9037e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90380b1c30 con 0x7f90380b46e0 2024-09-12T02:42:13.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.432+0000 7f9037e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f90380b1f10 con 0x7f90380b5280 2024-09-12T02:42:13.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.432+0000 7f9037e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f90380b21f0 con 0x7f9038162510 2024-09-12T02:42:13.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.432+0000 7f9037400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f90380b5280 0x7f90380b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:13.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.432+0000 7f9037400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f90380b5280 0x7f90380b2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51346/0 (socket says 172.21.15.112:51346) 2024-09-12T02:42:13.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.432+0000 7f9037400640 1 -- 172.21.15.112:0/2367625574 learned_addr learned my addr 172.21.15.112:0/2367625574 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:13.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.432+0000 7f9036a00640 1 --2- 172.21.15.112:0/2367625574 >> v2:172.21.15.137:3300/0 conn(0x7f9038162510 0x7f90380d58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:13.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.433+0000 7f9037400640 1 -- 172.21.15.112:0/2367625574 >> v2:172.21.15.137:3300/0 conn(0x7f9038162510 msgr2=0x7f90380d58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:13.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.433+0000 7f9037400640 1 --2- 172.21.15.112:0/2367625574 >> v2:172.21.15.137:3300/0 conn(0x7f9038162510 0x7f90380d58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.433+0000 7f9037400640 1 -- 172.21.15.112:0/2367625574 >> v1:172.21.15.137:6789/0 conn(0x7f90380b46e0 legacy=0x7f90380b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:13.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.433+0000 7f9037400640 1 -- 172.21.15.112:0/2367625574 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90380b24d0 con 0x7f90380b5280 2024-09-12T02:42:13.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.434+0000 7f9037400640 1 --2- 172.21.15.112:0/2367625574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90380b5280 0x7f90380b2cd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f903808d6f0 tx=0x7f903002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3685992c200085f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:13.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.434+0000 7f9036000640 1 -- 172.21.15.112:0/2367625574 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9030036070 con 0x7f90380b5280 2024-09-12T02:42:13.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.434+0000 7f9036000640 1 -- 172.21.15.112:0/2367625574 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9030031600 con 0x7f90380b5280 2024-09-12T02:42:13.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.434+0000 7f9036000640 1 -- 172.21.15.112:0/2367625574 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90300319d0 con 0x7f90380b5280 2024-09-12T02:42:13.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.435+0000 7f9037e00640 1 -- 172.21.15.112:0/2367625574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90380b5280 msgr2=0x7f90380b2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:13.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.435+0000 7f9037e00640 1 --2- 172.21.15.112:0/2367625574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90380b5280 0x7f90380b2cd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f903808d6f0 tx=0x7f903002a730 comp rx=0 tx=0).stop 2024-09-12T02:42:13.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.435+0000 7f9037e00640 1 -- 172.21.15.112:0/2367625574 shutdown_connections 2024-09-12T02:42:13.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.435+0000 7f9037e00640 1 --2- 172.21.15.112:0/2367625574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90380b5280 0x7f90380b2cd0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.435+0000 7f9037e00640 1 --2- 172.21.15.112:0/2367625574 >> v2:172.21.15.137:3300/0 conn(0x7f9038162510 0x7f90380d58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.435+0000 7f9037e00640 1 -- 172.21.15.112:0/2367625574 >> 172.21.15.112:0/2367625574 conn(0x7f90380d4d80 msgr2=0x7f90380d5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:13.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.435+0000 7f9037e00640 1 -- 172.21.15.112:0/2367625574 shutdown_connections 2024-09-12T02:42:13.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.435+0000 7f9037e00640 1 -- 172.21.15.112:0/2367625574 wait complete. 2024-09-12T02:42:13.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.436+0000 7f9037e00640 1 Processor -- start 2024-09-12T02:42:13.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.436+0000 7f9037e00640 1 -- start start 2024-09-12T02:42:13.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.437+0000 7f9037e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90380b46e0 0x7f90380c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:13.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.437+0000 7f9037e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90380b5280 0x7f90380cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:13.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.437+0000 7f9037e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9038162510 0x7f90380cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:13.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.437+0000 7f9037e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f90380b3210 con 0x7f90380b46e0 2024-09-12T02:42:13.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.437+0000 7f9037e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f90381628f0 con 0x7f90380b5280 2024-09-12T02:42:13.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.437+0000 7f9037e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f90380b3390 con 0x7f9038162510 2024-09-12T02:42:13.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.438+0000 7f9036a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90380b46e0 0x7f90380c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:13.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.438+0000 7f9036a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90380b46e0 0x7f90380c8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51348/0 (socket says 172.21.15.112:51348) 2024-09-12T02:42:13.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.438+0000 7f9036a00640 1 -- 172.21.15.112:0/2937353778 learned_addr learned my addr 172.21.15.112:0/2937353778 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:13.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.438+0000 7f902fe00640 1 --2- 172.21.15.112:0/2937353778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90380b5280 0x7f90380cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:13.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.438+0000 7f9037400640 1 --2- 172.21.15.112:0/2937353778 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9038162510 0x7f90380cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:13.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.438+0000 7f9036a00640 1 -- 172.21.15.112:0/2937353778 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9038162510 msgr2=0x7f90380cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:13.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.438+0000 7f9036a00640 1 --2- 172.21.15.112:0/2937353778 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9038162510 0x7f90380cfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.438+0000 7f9036a00640 1 -- 172.21.15.112:0/2937353778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90380b5280 msgr2=0x7f90380cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:13.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.438+0000 7f9036a00640 1 --2- 172.21.15.112:0/2937353778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90380b5280 0x7f90380cf6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.438+0000 7f9036a00640 1 -- 172.21.15.112:0/2937353778 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90380c9220 con 0x7f90380b46e0 2024-09-12T02:42:13.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.438+0000 7f9036a00640 1 --2- 172.21.15.112:0/2937353778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90380b46e0 0x7f90380c8760 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f902800e870 tx=0x7f902800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:13.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.439+0000 7f902ea00640 1 -- 172.21.15.112:0/2937353778 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9028017070 con 0x7f90380b46e0 2024-09-12T02:42:13.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.439+0000 7f902ea00640 1 -- 172.21.15.112:0/2937353778 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f902800c940 con 0x7f90380b46e0 2024-09-12T02:42:13.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.439+0000 7f902ea00640 1 -- 172.21.15.112:0/2937353778 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902800cd30 con 0x7f90380b46e0 2024-09-12T02:42:13.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.439+0000 7f9037e00640 1 -- 172.21.15.112:0/2937353778 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90380ca930 con 0x7f90380b46e0 2024-09-12T02:42:13.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.439+0000 7f9037e00640 1 -- 172.21.15.112:0/2937353778 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90380caef0 con 0x7f90380b46e0 2024-09-12T02:42:13.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.440+0000 7f9037e00640 1 -- 172.21.15.112:0/2937353778 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90380b6540 con 0x7f90380b46e0 2024-09-12T02:42:13.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.441+0000 7f902ea00640 1 -- 172.21.15.112:0/2937353778 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f902801a070 con 0x7f90380b46e0 2024-09-12T02:42:13.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.441+0000 7f902ea00640 1 --2- 172.21.15.112:0/2937353778 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f901406be30 0x7f901406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:13.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.442+0000 7f902ea00640 1 -- 172.21.15.112:0/2937353778 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f902808ad00 con 0x7f90380b46e0 2024-09-12T02:42:13.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.442+0000 7f902fe00640 1 --2- 172.21.15.112:0/2937353778 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f901406be30 0x7f901406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:13.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.442+0000 7f902fe00640 1 --2- 172.21.15.112:0/2937353778 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f901406be30 0x7f901406e2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f90380d5c60 tx=0x7f9020009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:13.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.446+0000 7f902ea00640 1 -- 172.21.15.112:0/2937353778 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f90380b6540 con 0x7f90380b46e0 2024-09-12T02:42:13.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.653+0000 7f9037e00640 1 -- 172.21.15.112:0/2937353778 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f90380b2cd0 con 0x7f90380b46e0 2024-09-12T02:42:13.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.654+0000 7f902ea00640 1 -- 172.21.15.112:0/2937353778 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f9028058fc0 con 0x7f90380b46e0 2024-09-12T02:42:13.655 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:42:13.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.656+0000 7f9037e00640 1 -- 172.21.15.112:0/2937353778 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f901406be30 msgr2=0x7f901406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:13.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.656+0000 7f9037e00640 1 --2- 172.21.15.112:0/2937353778 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f901406be30 0x7f901406e2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f90380d5c60 tx=0x7f9020009040 comp rx=0 tx=0).stop 2024-09-12T02:42:13.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.656+0000 7f9037e00640 1 -- 172.21.15.112:0/2937353778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90380b46e0 msgr2=0x7f90380c8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:13.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.656+0000 7f9037e00640 1 --2- 172.21.15.112:0/2937353778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90380b46e0 0x7f90380c8760 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f902800e870 tx=0x7f902800ed30 comp rx=0 tx=0).stop 2024-09-12T02:42:13.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.656+0000 7f9037e00640 1 -- 172.21.15.112:0/2937353778 shutdown_connections 2024-09-12T02:42:13.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.656+0000 7f9037e00640 1 --2- 172.21.15.112:0/2937353778 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9038162510 0x7f90380cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.656+0000 7f9037e00640 1 --2- 172.21.15.112:0/2937353778 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f901406be30 0x7f901406e2f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.656+0000 7f9037e00640 1 --2- 172.21.15.112:0/2937353778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90380b5280 0x7f90380cf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.656+0000 7f9037e00640 1 --2- 172.21.15.112:0/2937353778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90380b46e0 0x7f90380c8760 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:13.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.656+0000 7f9037e00640 1 -- 172.21.15.112:0/2937353778 >> 172.21.15.112:0/2937353778 conn(0x7f90380d4d80 msgr2=0x7f903806d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:13.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.656+0000 7f9037e00640 1 -- 172.21.15.112:0/2937353778 shutdown_connections 2024-09-12T02:42:13.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13.656+0000 7f9037e00640 1 -- 172.21.15.112:0/2937353778 wait complete. 2024-09-12T02:42:13.672 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T02:42:13.672 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:42:13.673 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-09-12T02:42:13.673 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-12T02:42:13.673 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-12T02:42:13.673 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T02:42:13.673 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:42:13.673 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:42:13.673 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-12T02:42:13.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:13.673 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-09-12T02:42:13.709 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:42:13.709 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:42:13.709 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:42:13.709 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:13.709 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-12T02:42:13.709 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:13.709 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:42:13.709 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-09-12T02:42:13.709 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-09-12T02:42:13.709 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:42:13.709 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-09-12T02:42:13.710 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-09-12T02:42:13.710 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:42:13.710 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:42:13.710 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:42:13.710 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:42:13.710 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:42:13.710 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42745sec preferred_lft 42745sec 2024-09-12T02:42:13.710 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link noprefixroute 2024-09-12T02:42:13.710 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:13.710 INFO:teuthology.orchestra.run.smithi112.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:42:13.710 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 4e:56:d4:fc:33:ba brd ff:ff:ff:ff:ff:ff 2024-09-12T02:42:13.710 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:42:13.710 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:13.711 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::787f:67ff:fe10:c915/64 scope link 2024-09-12T02:42:13.711 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:13.711 INFO:teuthology.orchestra.run.smithi112.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:42:13.711 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 4e:56:d4:fc:33:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:42:13.711 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::4c56:d4ff:fefc:33ba/64 scope link tentative 2024-09-12T02:42:13.711 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:13.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:13.711 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:42:13.802 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-12T02:42:13.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:13.805 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-09-12T02:42:13.841 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-09-12T02:42:13.841 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:42:13.841 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:42:13.842 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:42:13.842 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:42:13.842 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:42:13.842 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-12T02:42:13.842 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:42:13.842 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:42:13.842 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:42:13.842 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-12T02:42:13.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:42:14.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:14.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:14.037 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-12T02:42:14.072 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:42:14.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:14.073 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list-id 2024-09-12T02:42:14.148 INFO:teuthology.orchestra.run.smithi112.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-12T02:42:14.149 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:42:14.149 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-12T02:42:14.149 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:42:14.149 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-12T02:42:14.149 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-12T02:42:14.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:42:14.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:14.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:14.323 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-12T02:42:14.379 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:42:14.379 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:42:14.379 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:42:14.379 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:14.379 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-12T02:42:14.379 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:14.379 INFO:teuthology.orchestra.run.smithi112.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:42:14.379 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 02:9c:09:36:12:51 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-12T02:42:14.379 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-12T02:42:14.379 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:14.380 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::9c:9ff:fe36:1251/64 scope link 2024-09-12T02:42:14.380 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:14.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:14.382 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-12T02:42:14.437 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:42:14.437 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:42:14.437 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:42:14.437 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:14.437 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-12T02:42:14.437 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:14.437 INFO:teuthology.orchestra.run.smithi112.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:42:14.437 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 02:9c:09:36:12:51 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-12T02:42:14.438 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-12T02:42:14.438 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:14.438 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::9c:9ff:fe36:1251/64 scope link 2024-09-12T02:42:14.438 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:14.440 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-12T02:42:14.440 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:42:14.440 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-12T02:42:14.440 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-12T02:42:14.440 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-12T02:42:14.440 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-12T02:42:14.440 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-12T02:42:14.440 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-12T02:42:14.440 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-12T02:42:14.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:42:14.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:14.655 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:42:14.655 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-12T02:42:14.655 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.1 up 2024-09-12T02:42:14.656 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set dev brx.1 master ceph-brx 2024-09-12T02:42:14.656 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-12T02:42:14.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:42:14.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:14.820 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:42:14.820 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-12T02:42:14.855 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-12T02:42:14.855 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:42:14.856 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-12T02:42:14.931 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-09-12T02:42:14.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:14.931 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:42:15.061 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:42:15.061 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:42:15.085 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:42:15.086 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:42:15.086 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-09-12T02:42:15.086 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 2@7c01f3b3-dec2-4449-a33f-f960d7527ea6.cephfs=/ 2024-09-12T02:42:15.086 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.112:3300/172.21.15.137:3300/172.21.15.137:3301" will pass to kernel 2024-09-12T02:42:15.087 INFO:teuthology.orchestra.run.smithi112.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-12T02:42:15.087 INFO:teuthology.orchestra.run.smithi112.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:42:15.087 INFO:teuthology.orchestra.run.smithi112.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:42:15.087 INFO:teuthology.orchestra.run.smithi112.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:42:15.088 INFO:teuthology.orchestra.run.smithi112.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:42:15.090 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:42:15.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:15.091 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-12T02:42:15.146 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:42:15.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:42:15.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:15.236 INFO:teuthology.orchestra.run.smithi112.stdout:client4605 2024-09-12T02:42:15.236 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:42:15.236 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:42:15.271 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:42:15.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:42:15.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:15.400 INFO:teuthology.orchestra.run.smithi112.stdout:client4605 2024-09-12T02:42:15.400 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:42:15.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:42:15.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:15.491 INFO:teuthology.orchestra.run.smithi112.stdout:client4605 2024-09-12T02:42:15.491 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/7c01f3b3-dec2-4449-a33f-f960d7527ea6.client4605/status') 2024-09-12T02:42:15.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:42:15.589 INFO:teuthology.orchestra.run.smithi112.stdout:instance: client.4605 (3)192.168.0.2:0/1395046098 2024-09-12T02:42:15.589 INFO:teuthology.orchestra.run.smithi112.stdout:blocklisted: false 2024-09-12T02:42:15.590 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2024-09-12T02:42:15.590 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2024-09-12T02:42:15.590 INFO:teuthology.orchestra.run.smithi112.stderr:69 bytes copied, 5.1756e-05 s, 1.3 MB/s 2024-09-12T02:42:15.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:15.600 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-09-12T02:42:15.600 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T02:42:15.600 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T02:42:15.600 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:42:15.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.752+0000 7f6341c00640 1 Processor -- start 2024-09-12T02:42:15.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.752+0000 7f6341c00640 1 -- start start 2024-09-12T02:42:15.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.753+0000 7f6341c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f633c15cc50 0x7f633c0732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:15.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.753+0000 7f6341c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f633c071530 0x7f633c0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:15.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.753+0000 7f6341c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f633c0719a0 0x7f633c0afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:15.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.753+0000 7f6341c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f633c15d030 con 0x7f633c15cc50 2024-09-12T02:42:15.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.753+0000 7f6341c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f633c0cf4c0 con 0x7f633c071530 2024-09-12T02:42:15.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.753+0000 7f6341c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f633c073830 con 0x7f633c0719a0 2024-09-12T02:42:15.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.754+0000 7f633aa00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f633c15cc50 0x7f633c0732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:15.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.754+0000 7f633aa00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f633c15cc50 0x7f633c0732f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51362/0 (socket says 172.21.15.112:51362) 2024-09-12T02:42:15.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.754+0000 7f633aa00640 1 -- 172.21.15.112:0/3386887097 learned_addr learned my addr 172.21.15.112:0/3386887097 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:15.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.754+0000 7f633a000640 1 --2- 172.21.15.112:0/3386887097 >> v2:172.21.15.137:3300/0 conn(0x7f633c071530 0x7f633c0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:15.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.754+0000 7f633b400640 1 --2- 172.21.15.112:0/3386887097 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f633c0719a0 0x7f633c0afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:15.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.754+0000 7f633aa00640 1 -- 172.21.15.112:0/3386887097 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f633c0719a0 msgr2=0x7f633c0afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:15.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.754+0000 7f633aa00640 1 --2- 172.21.15.112:0/3386887097 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f633c0719a0 0x7f633c0afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:15.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.754+0000 7f633aa00640 1 -- 172.21.15.112:0/3386887097 >> v2:172.21.15.137:3300/0 conn(0x7f633c071530 msgr2=0x7f633c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:15.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.754+0000 7f633aa00640 1 --2- 172.21.15.112:0/3386887097 >> v2:172.21.15.137:3300/0 conn(0x7f633c071530 0x7f633c0af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:15.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.754+0000 7f633aa00640 1 -- 172.21.15.112:0/3386887097 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f633c0ceeb0 con 0x7f633c15cc50 2024-09-12T02:42:15.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.755+0000 7f633aa00640 1 --2- 172.21.15.112:0/3386887097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f633c15cc50 0x7f633c0732f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f633c06fa40 tx=0x7f632c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc0e035607fa5f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:15.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.755+0000 7f6339600640 1 -- 172.21.15.112:0/3386887097 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c037070 con 0x7f633c15cc50 2024-09-12T02:42:15.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.755+0000 7f6339600640 1 -- 172.21.15.112:0/3386887097 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f632c032440 con 0x7f633c15cc50 2024-09-12T02:42:15.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.755+0000 7f6339600640 1 -- 172.21.15.112:0/3386887097 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c032810 con 0x7f633c15cc50 2024-09-12T02:42:15.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.756+0000 7f6341c00640 1 -- 172.21.15.112:0/3386887097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f633c15cc50 msgr2=0x7f633c0732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:15.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.756+0000 7f6341c00640 1 --2- 172.21.15.112:0/3386887097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f633c15cc50 0x7f633c0732f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f633c06fa40 tx=0x7f632c02a140 comp rx=0 tx=0).stop 2024-09-12T02:42:15.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.756+0000 7f6341c00640 1 -- 172.21.15.112:0/3386887097 shutdown_connections 2024-09-12T02:42:15.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.756+0000 7f6341c00640 1 --2- 172.21.15.112:0/3386887097 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f633c0719a0 0x7f633c0afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:15.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.756+0000 7f6341c00640 1 --2- 172.21.15.112:0/3386887097 >> v2:172.21.15.137:3300/0 conn(0x7f633c071530 0x7f633c0af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:15.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.756+0000 7f6341c00640 1 --2- 172.21.15.112:0/3386887097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f633c15cc50 0x7f633c0732f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:15.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.756+0000 7f6341c00640 1 -- 172.21.15.112:0/3386887097 >> 172.21.15.112:0/3386887097 conn(0x7f633c06bbd0 msgr2=0x7f633c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:15.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.756+0000 7f6341c00640 1 -- 172.21.15.112:0/3386887097 shutdown_connections 2024-09-12T02:42:15.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.756+0000 7f6341c00640 1 -- 172.21.15.112:0/3386887097 wait complete. 2024-09-12T02:42:15.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.758+0000 7f6341c00640 1 Processor -- start 2024-09-12T02:42:15.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.758+0000 7f6341c00640 1 -- start start 2024-09-12T02:42:15.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.758+0000 7f6341c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f633c071530 0x7f633c157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:15.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.758+0000 7f6341c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f633c0719a0 0x7f633c15a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:15.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.758+0000 7f6341c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f633c15cc50 0x7f633c14f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:15.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.758+0000 7f6341c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f633c0cf150 con 0x7f633c15cc50 2024-09-12T02:42:15.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.758+0000 7f6341c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f633c06e5e0 con 0x7f633c071530 2024-09-12T02:42:15.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.758+0000 7f6341c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f633c06f510 con 0x7f633c0719a0 2024-09-12T02:42:15.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.759+0000 7f633b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f633c15cc50 0x7f633c14f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:15.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.759+0000 7f633b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f633c15cc50 0x7f633c14f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51368/0 (socket says 172.21.15.112:51368) 2024-09-12T02:42:15.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.759+0000 7f633a000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f633c0719a0 0x7f633c15a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:15.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.759+0000 7f633b400640 1 -- 172.21.15.112:0/3984070104 learned_addr learned my addr 172.21.15.112:0/3984070104 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:15.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.759+0000 7f633aa00640 1 --2- 172.21.15.112:0/3984070104 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f633c071530 0x7f633c157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:15.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.759+0000 7f633b400640 1 -- 172.21.15.112:0/3984070104 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f633c0719a0 msgr2=0x7f633c15a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:15.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.759+0000 7f633b400640 1 --2- 172.21.15.112:0/3984070104 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f633c0719a0 0x7f633c15a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:15.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.759+0000 7f633b400640 1 -- 172.21.15.112:0/3984070104 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f633c071530 msgr2=0x7f633c157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:15.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.759+0000 7f633b400640 1 --2- 172.21.15.112:0/3984070104 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f633c071530 0x7f633c157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:15.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.759+0000 7f633b400640 1 -- 172.21.15.112:0/3984070104 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f633c159290 con 0x7f633c15cc50 2024-09-12T02:42:15.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.759+0000 7f633b400640 1 --2- 172.21.15.112:0/3984070104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f633c15cc50 0x7f633c14f020 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6334007e10 tx=0x7f633400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:15.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.760+0000 7f6332a00640 1 -- 172.21.15.112:0/3984070104 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6334014620 con 0x7f633c15cc50 2024-09-12T02:42:15.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.760+0000 7f6332a00640 1 -- 172.21.15.112:0/3984070104 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6334019070 con 0x7f633c15cc50 2024-09-12T02:42:15.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.760+0000 7f6341c00640 1 -- 172.21.15.112:0/3984070104 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f633c159570 con 0x7f633c15cc50 2024-09-12T02:42:15.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.760+0000 7f6332a00640 1 -- 172.21.15.112:0/3984070104 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6334014a20 con 0x7f633c15cc50 2024-09-12T02:42:15.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.760+0000 7f6341c00640 1 -- 172.21.15.112:0/3984070104 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f633c159b30 con 0x7f633c15cc50 2024-09-12T02:42:15.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.761+0000 7f6341c00640 1 -- 172.21.15.112:0/3984070104 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f633c068a30 con 0x7f633c15cc50 2024-09-12T02:42:15.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.762+0000 7f6332a00640 1 -- 172.21.15.112:0/3984070104 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6334014bc0 con 0x7f633c15cc50 2024-09-12T02:42:15.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.763+0000 7f6332a00640 1 --2- 172.21.15.112:0/3984070104 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f631c06be30 0x7f631c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:15.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.763+0000 7f6332a00640 1 -- 172.21.15.112:0/3984070104 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f633408b790 con 0x7f633c15cc50 2024-09-12T02:42:15.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.763+0000 7f633aa00640 1 --2- 172.21.15.112:0/3984070104 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f631c06be30 0x7f631c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:15.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.763+0000 7f633aa00640 1 --2- 172.21.15.112:0/3984070104 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f631c06be30 0x7f631c06e2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f632c034000 tx=0x7f632c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:15.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.767+0000 7f6332a00640 1 -- 172.21.15.112:0/3984070104 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6334059940 con 0x7f633c15cc50 2024-09-12T02:42:15.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.975+0000 7f6341c00640 1 -- 172.21.15.112:0/3984070104 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f633c06df60 con 0x7f633c15cc50 2024-09-12T02:42:15.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.975+0000 7f6332a00640 1 -- 172.21.15.112:0/3984070104 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f633405dc40 con 0x7f633c15cc50 2024-09-12T02:42:15.977 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:42:15.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.977+0000 7f6341c00640 1 -- 172.21.15.112:0/3984070104 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f631c06be30 msgr2=0x7f631c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:15.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.977+0000 7f6341c00640 1 --2- 172.21.15.112:0/3984070104 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f631c06be30 0x7f631c06e2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f632c034000 tx=0x7f632c02e000 comp rx=0 tx=0).stop 2024-09-12T02:42:15.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.977+0000 7f6341c00640 1 -- 172.21.15.112:0/3984070104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f633c15cc50 msgr2=0x7f633c14f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:15.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.977+0000 7f6341c00640 1 --2- 172.21.15.112:0/3984070104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f633c15cc50 0x7f633c14f020 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6334007e10 tx=0x7f633400e4b0 comp rx=0 tx=0).stop 2024-09-12T02:42:15.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.978+0000 7f6341c00640 1 -- 172.21.15.112:0/3984070104 shutdown_connections 2024-09-12T02:42:15.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.978+0000 7f6341c00640 1 --2- 172.21.15.112:0/3984070104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f633c15cc50 0x7f633c14f020 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:15.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.978+0000 7f6341c00640 1 --2- 172.21.15.112:0/3984070104 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f633c0719a0 0x7f633c15a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:15.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.978+0000 7f6341c00640 1 --2- 172.21.15.112:0/3984070104 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f631c06be30 0x7f631c06e2f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:15.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.978+0000 7f6341c00640 1 --2- 172.21.15.112:0/3984070104 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f633c071530 0x7f633c157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:15.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.978+0000 7f6341c00640 1 -- 172.21.15.112:0/3984070104 >> 172.21.15.112:0/3984070104 conn(0x7f633c06bbd0 msgr2=0x7f633c1578a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:15.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.978+0000 7f6341c00640 1 -- 172.21.15.112:0/3984070104 shutdown_connections 2024-09-12T02:42:15.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:15.978+0000 7f6341c00640 1 -- 172.21.15.112:0/3984070104 wait complete. 2024-09-12T02:42:15.995 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T02:42:15.995 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:42:15.995 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-09-12T02:42:15.995 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T02:42:15.995 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T02:42:15.995 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T02:42:15.995 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:42:15.995 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:42:15.995 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:42:15.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:15.996 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-09-12T02:42:16.035 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:42:16.035 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:42:16.035 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:42:16.035 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:16.035 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-09-12T02:42:16.035 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:16.035 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:42:16.036 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-09-12T02:42:16.036 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-09-12T02:42:16.036 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:42:16.036 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-09-12T02:42:16.036 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-09-12T02:42:16.036 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:42:16.036 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:42:16.036 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:42:16.036 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:42:16.036 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:42:16.036 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42743sec preferred_lft 42743sec 2024-09-12T02:42:16.036 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::ec4:7aff:fe88:8137/64 scope link noprefixroute 2024-09-12T02:42:16.036 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:16.037 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T02:42:16.038 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:42:16.038 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-09-12T02:42:16.038 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link add name ceph-brx type bridge 2024-09-12T02:42:16.038 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip addr flush dev ceph-brx 2024-09-12T02:42:16.038 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set ceph-brx up 2024-09-12T02:42:16.038 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T02:42:16.038 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-09-12T02:42:16.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:42:16.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:16.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:16.458 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:42:16.515 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-09-12T02:42:16.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:16.518 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-09-12T02:42:16.568 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-09-12T02:42:16.568 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:42:16.569 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:42:16.569 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:42:16.569 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:42:16.569 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:42:16.569 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-09-12T02:42:16.569 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:42:16.569 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:42:16.569 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:42:16.569 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-09-12T02:42:16.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:42:17.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:17.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:17.152 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-09-12T02:42:17.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:17.188 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list-id 2024-09-12T02:42:17.265 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:42:17.265 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-09-12T02:42:17.265 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:42:17.265 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-12T02:42:17.265 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-09-12T02:42:17.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:42:17.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:17.445 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-12T02:42:17.445 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:42:17.445 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-09-12T02:42:17.446 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-12T02:42:17.446 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T02:42:17.446 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-12T02:42:17.446 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-12T02:42:17.446 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-12T02:42:17.446 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-09-12T02:42:17.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:42:17.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:17.688 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:42:17.688 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-09-12T02:42:17.688 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-09-12T02:42:17.688 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T02:42:17.688 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-09-12T02:42:17.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:42:17.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:17.859 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:42:17.859 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T02:42:17.895 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:42:17.895 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:42:17.895 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T02:42:17.972 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-12T02:42:17.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:17.972 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:42:18.118 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:42:18.119 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:42:18.764 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:42:18.764 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:42:18.765 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-09-12T02:42:18.765 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with new device syntax: 1@7c01f3b3-dec2-4449-a33f-f960d7527ea6.cephfs=/ 2024-09-12T02:42:18.765 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.112:3300/172.21.15.137:3300/172.21.15.137:3301" will pass to kernel 2024-09-12T02:42:18.766 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-12T02:42:18.766 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:42:18.766 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:42:18.766 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:42:18.767 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:42:18.770 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:42:18.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:18.770 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T02:42:18.826 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:42:18.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:42:18.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:18.916 INFO:teuthology.orchestra.run.smithi137.stdout:client4534 2024-09-12T02:42:18.916 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:42:18.916 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:42:18.952 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:42:19.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:42:19.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:19.080 INFO:teuthology.orchestra.run.smithi137.stdout:client4534 2024-09-12T02:42:19.080 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:42:19.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:42:19.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:19.170 INFO:teuthology.orchestra.run.smithi137.stdout:client4534 2024-09-12T02:42:19.171 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/7c01f3b3-dec2-4449-a33f-f960d7527ea6.client4534/status') 2024-09-12T02:42:19.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:42:19.270 INFO:teuthology.orchestra.run.smithi137.stdout:instance: client.4534 (3)192.168.0.1:0/198975738 2024-09-12T02:42:19.270 INFO:teuthology.orchestra.run.smithi137.stdout:blocklisted: false 2024-09-12T02:42:19.270 INFO:teuthology.orchestra.run.smithi137.stderr:0+1 records in 2024-09-12T02:42:19.270 INFO:teuthology.orchestra.run.smithi137.stderr:0+1 records out 2024-09-12T02:42:19.270 INFO:teuthology.orchestra.run.smithi137.stderr:68 bytes copied, 5.5356e-05 s, 1.2 MB/s 2024-09-12T02:42:19.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:19.281 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-09-12T02:42:19.281 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T02:42:19.281 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-12T02:42:19.281 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:42:19.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.443+0000 7f85cba00640 1 Processor -- start 2024-09-12T02:42:19.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.443+0000 7f85cba00640 1 -- start start 2024-09-12T02:42:19.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.444+0000 7f85cba00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f85c415b9d0 0x7f85c40b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:19.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.444+0000 7f85cba00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f85c406f600 0x7f85c40728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:19.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.444+0000 7f85cba00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85c40b54a0 con 0x7f85c40b45d0 2024-09-12T02:42:19.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.444+0000 7f85cba00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f85c40b4a60 con 0x7f85c406f600 2024-09-12T02:42:19.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.444+0000 7f85cba00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f85c40b3af0 con 0x7f85c415b9d0 2024-09-12T02:42:19.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.445+0000 7f85c9a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f85c406f600 0x7f85c40728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:19.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.445+0000 7f85c9a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f85c406f600 0x7f85c40728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51378/0 (socket says 172.21.15.112:51378) 2024-09-12T02:42:19.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.445+0000 7f85c9a00640 1 -- 172.21.15.112:0/2047753664 learned_addr learned my addr 172.21.15.112:0/2047753664 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:19.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.445+0000 7f85c9000640 1 --2- 172.21.15.112:0/2047753664 >> v2:172.21.15.137:3300/0 conn(0x7f85c415b9d0 0x7f85c40b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:19.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.445+0000 7f85c9a00640 1 -- 172.21.15.112:0/2047753664 >> v2:172.21.15.137:3300/0 conn(0x7f85c415b9d0 msgr2=0x7f85c40b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:19.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.445+0000 7f85c9a00640 1 --2- 172.21.15.112:0/2047753664 >> v2:172.21.15.137:3300/0 conn(0x7f85c415b9d0 0x7f85c40b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.445+0000 7f85c9a00640 1 -- 172.21.15.112:0/2047753664 >> v1:172.21.15.137:6789/0 conn(0x7f85c40b45d0 legacy=0x7f85c406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:19.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.445+0000 7f85c9a00640 1 -- 172.21.15.112:0/2047753664 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85c40b3dd0 con 0x7f85c406f600 2024-09-12T02:42:19.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.446+0000 7f85c9a00640 1 --2- 172.21.15.112:0/2047753664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85c406f600 0x7f85c40728c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f85c406d230 tx=0x7f85bc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a839cfc6393a96 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:19.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.446+0000 7f85c3400640 1 -- 172.21.15.112:0/2047753664 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc036070 con 0x7f85c406f600 2024-09-12T02:42:19.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.446+0000 7f85c3400640 1 -- 172.21.15.112:0/2047753664 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85bc031600 con 0x7f85c406f600 2024-09-12T02:42:19.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.446+0000 7f85c3400640 1 -- 172.21.15.112:0/2047753664 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc0319d0 con 0x7f85c406f600 2024-09-12T02:42:19.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.447+0000 7f85cba00640 1 -- 172.21.15.112:0/2047753664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85c406f600 msgr2=0x7f85c40728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:19.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.447+0000 7f85cba00640 1 --2- 172.21.15.112:0/2047753664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85c406f600 0x7f85c40728c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f85c406d230 tx=0x7f85bc02a6a0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.447+0000 7f85cba00640 1 -- 172.21.15.112:0/2047753664 shutdown_connections 2024-09-12T02:42:19.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.447+0000 7f85cba00640 1 --2- 172.21.15.112:0/2047753664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85c406f600 0x7f85c40728c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.447+0000 7f85cba00640 1 --2- 172.21.15.112:0/2047753664 >> v2:172.21.15.137:3300/0 conn(0x7f85c415b9d0 0x7f85c40b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.447+0000 7f85cba00640 1 -- 172.21.15.112:0/2047753664 >> 172.21.15.112:0/2047753664 conn(0x7f85c406bbd0 msgr2=0x7f85c406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:19.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.447+0000 7f85cba00640 1 -- 172.21.15.112:0/2047753664 shutdown_connections 2024-09-12T02:42:19.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.447+0000 7f85cba00640 1 -- 172.21.15.112:0/2047753664 wait complete. 2024-09-12T02:42:19.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.449+0000 7f85cba00640 1 Processor -- start 2024-09-12T02:42:19.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.449+0000 7f85cba00640 1 -- start start 2024-09-12T02:42:19.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.450+0000 7f85cba00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85c406f600 0x7f85c4153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:19.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.450+0000 7f85cba00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85c40b45d0 0x7f85c41670a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:19.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.450+0000 7f85cba00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85c415b9d0 0x7f85c40ab040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:19.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.450+0000 7f85cba00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f85c415bf30 con 0x7f85c40b45d0 2024-09-12T02:42:19.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.450+0000 7f85cba00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f85c415bdb0 con 0x7f85c406f600 2024-09-12T02:42:19.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.450+0000 7f85cba00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f85c40cdcd0 con 0x7f85c415b9d0 2024-09-12T02:42:19.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.450+0000 7f85c3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85c40b45d0 0x7f85c41670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:19.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.450+0000 7f85c9000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85c406f600 0x7f85c4153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:19.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.450+0000 7f85c3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85c40b45d0 0x7f85c41670a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51392/0 (socket says 172.21.15.112:51392) 2024-09-12T02:42:19.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.450+0000 7f85c3e00640 1 -- 172.21.15.112:0/3760504300 learned_addr learned my addr 172.21.15.112:0/3760504300 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:19.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.450+0000 7f85c9a00640 1 --2- 172.21.15.112:0/3760504300 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85c415b9d0 0x7f85c40ab040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:19.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.450+0000 7f85c3e00640 1 -- 172.21.15.112:0/3760504300 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85c415b9d0 msgr2=0x7f85c40ab040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:19.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.450+0000 7f85c3e00640 1 --2- 172.21.15.112:0/3760504300 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85c415b9d0 0x7f85c40ab040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.450+0000 7f85c3e00640 1 -- 172.21.15.112:0/3760504300 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85c406f600 msgr2=0x7f85c4153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:19.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.450+0000 7f85c3e00640 1 --2- 172.21.15.112:0/3760504300 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85c406f600 0x7f85c4153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.450+0000 7f85c3e00640 1 -- 172.21.15.112:0/3760504300 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85c40aa4c0 con 0x7f85c40b45d0 2024-09-12T02:42:19.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.451+0000 7f85c3e00640 1 --2- 172.21.15.112:0/3760504300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85c40b45d0 0x7f85c41670a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f85b000c430 tx=0x7f85b000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:19.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.451+0000 7f85c0c00640 1 -- 172.21.15.112:0/3760504300 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b00052d0 con 0x7f85c40b45d0 2024-09-12T02:42:19.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.451+0000 7f85c0c00640 1 -- 172.21.15.112:0/3760504300 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85b00054b0 con 0x7f85c40b45d0 2024-09-12T02:42:19.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.451+0000 7f85cba00640 1 -- 172.21.15.112:0/3760504300 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85c40aaa40 con 0x7f85c40b45d0 2024-09-12T02:42:19.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.451+0000 7f85c0c00640 1 -- 172.21.15.112:0/3760504300 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b0006a60 con 0x7f85c40b45d0 2024-09-12T02:42:19.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.451+0000 7f85cba00640 1 -- 172.21.15.112:0/3760504300 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85c4152b00 con 0x7f85c40b45d0 2024-09-12T02:42:19.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.452+0000 7f85cba00640 1 -- 172.21.15.112:0/3760504300 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85c4068a30 con 0x7f85c40b45d0 2024-09-12T02:42:19.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.453+0000 7f85c0c00640 1 -- 172.21.15.112:0/3760504300 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f85b0006c00 con 0x7f85c40b45d0 2024-09-12T02:42:19.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.454+0000 7f85c0c00640 1 --2- 172.21.15.112:0/3760504300 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f85a406be30 0x7f85a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:19.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.454+0000 7f85c0c00640 1 -- 172.21.15.112:0/3760504300 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f85b008a320 con 0x7f85c40b45d0 2024-09-12T02:42:19.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.455+0000 7f85c9000640 1 --2- 172.21.15.112:0/3760504300 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f85a406be30 0x7f85a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:19.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.455+0000 7f85c9000640 1 --2- 172.21.15.112:0/3760504300 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f85a406be30 0x7f85a406e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f85c4152750 tx=0x7f85b8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:19.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.459+0000 7f85c0c00640 1 -- 172.21.15.112:0/3760504300 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f85b00585e0 con 0x7f85c40b45d0 2024-09-12T02:42:19.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.664+0000 7f85cba00640 1 -- 172.21.15.112:0/3760504300 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f85c4072d90 con 0x7f85c40b45d0 2024-09-12T02:42:19.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.665+0000 7f85c0c00640 1 -- 172.21.15.112:0/3760504300 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f85b005c8e0 con 0x7f85c40b45d0 2024-09-12T02:42:19.666 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:42:19.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.667+0000 7f85cba00640 1 -- 172.21.15.112:0/3760504300 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f85a406be30 msgr2=0x7f85a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:19.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.667+0000 7f85cba00640 1 --2- 172.21.15.112:0/3760504300 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f85a406be30 0x7f85a406e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f85c4152750 tx=0x7f85b8009190 comp rx=0 tx=0).stop 2024-09-12T02:42:19.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.667+0000 7f85cba00640 1 -- 172.21.15.112:0/3760504300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85c40b45d0 msgr2=0x7f85c41670a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:19.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.667+0000 7f85cba00640 1 --2- 172.21.15.112:0/3760504300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85c40b45d0 0x7f85c41670a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f85b000c430 tx=0x7f85b000c8f0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.667+0000 7f85cba00640 1 -- 172.21.15.112:0/3760504300 shutdown_connections 2024-09-12T02:42:19.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.667+0000 7f85cba00640 1 --2- 172.21.15.112:0/3760504300 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85c415b9d0 0x7f85c40ab040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.667+0000 7f85cba00640 1 --2- 172.21.15.112:0/3760504300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85c40b45d0 0x7f85c41670a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.667+0000 7f85cba00640 1 --2- 172.21.15.112:0/3760504300 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f85a406be30 0x7f85a406e2f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.667+0000 7f85cba00640 1 --2- 172.21.15.112:0/3760504300 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85c406f600 0x7f85c4153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:19.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.667+0000 7f85cba00640 1 -- 172.21.15.112:0/3760504300 >> 172.21.15.112:0/3760504300 conn(0x7f85c406bbd0 msgr2=0x7f85c40ccdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:19.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.667+0000 7f85cba00640 1 -- 172.21.15.112:0/3760504300 shutdown_connections 2024-09-12T02:42:19.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:19.667+0000 7f85cba00640 1 -- 172.21.15.112:0/3760504300 wait complete. 2024-09-12T02:42:19.683 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T02:42:19.684 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:42:19.684 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-09-12T02:42:19.684 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-12T02:42:19.684 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-12T02:42:19.684 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T02:42:19.684 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:42:19.684 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:42:19.684 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-12T02:42:19.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:19.684 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-09-12T02:42:19.721 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:42:19.721 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:42:19.721 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:42:19.721 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:19.721 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-09-12T02:42:19.721 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:19.721 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:42:19.722 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-09-12T02:42:19.722 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-09-12T02:42:19.722 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:42:19.722 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-09-12T02:42:19.722 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-09-12T02:42:19.722 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:42:19.722 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:42:19.722 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:42:19.722 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:42:19.722 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:42:19.722 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42739sec preferred_lft 42739sec 2024-09-12T02:42:19.722 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::ec4:7aff:fe88:8137/64 scope link noprefixroute 2024-09-12T02:42:19.723 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:19.723 INFO:teuthology.orchestra.run.smithi137.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:42:19.723 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 62:9a:8e:f1:56:55 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:42:19.723 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:42:19.723 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:19.723 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::30c8:13ff:fe15:f79d/64 scope link 2024-09-12T02:42:19.723 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:19.723 INFO:teuthology.orchestra.run.smithi137.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:42:19.723 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 62:9a:8e:f1:56:55 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:42:19.723 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::609a:8eff:fef1:5655/64 scope link 2024-09-12T02:42:19.723 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:19.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:19.724 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:42:19.816 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-09-12T02:42:19.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:19.819 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-09-12T02:42:19.856 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-09-12T02:42:19.856 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:42:19.856 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:42:19.856 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:42:19.856 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:42:19.856 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:42:19.857 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-09-12T02:42:19.857 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:42:19.857 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:42:19.857 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:42:19.857 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-09-12T02:42:19.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:42:20.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:20.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:20.055 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-09-12T02:42:20.090 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T02:42:20.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:20.091 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list-id 2024-09-12T02:42:20.170 INFO:teuthology.orchestra.run.smithi137.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-12T02:42:20.171 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:42:20.171 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-09-12T02:42:20.171 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T02:42:20.171 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-12T02:42:20.171 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-09-12T02:42:20.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:42:20.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:20.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:20.346 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-12T02:42:20.402 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:42:20.402 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:42:20.403 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:42:20.403 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:20.403 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-09-12T02:42:20.403 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:20.403 INFO:teuthology.orchestra.run.smithi137.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:42:20.403 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether e6:b9:d6:13:d6:2a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-12T02:42:20.403 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-12T02:42:20.403 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:20.403 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::e4b9:d6ff:fe13:d62a/64 scope link 2024-09-12T02:42:20.403 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:20.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:20.405 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-12T02:42:20.426 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:42:20.430 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:42:20.460 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:42:20.461 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:42:20.461 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:42:20.461 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:20.461 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-09-12T02:42:20.461 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:20.461 INFO:teuthology.orchestra.run.smithi137.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:42:20.461 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether e6:b9:d6:13:d6:2a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-12T02:42:20.461 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-12T02:42:20.461 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:20.461 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::e4b9:d6ff:fe13:d62a/64 scope link 2024-09-12T02:42:20.461 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:20.463 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-12T02:42:20.463 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:42:20.464 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-09-12T02:42:20.464 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-12T02:42:20.464 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-12T02:42:20.464 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-12T02:42:20.464 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-12T02:42:20.464 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-12T02:42:20.464 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-09-12T02:42:20.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:42:20.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:20.720 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:42:20.721 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-09-12T02:42:20.721 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.1 up 2024-09-12T02:42:20.721 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set dev brx.1 master ceph-brx 2024-09-12T02:42:20.721 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-09-12T02:42:20.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:42:20.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:20.886 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:42:20.886 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-12T02:42:20.921 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-12T02:42:20.921 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:42:20.922 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-12T02:42:20.995 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-09-12T02:42:20.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:20.996 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:42:21.123 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:42:21.124 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:42:21.150 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:42:21.150 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:42:21.150 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-09-12T02:42:21.150 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with new device syntax: 3@7c01f3b3-dec2-4449-a33f-f960d7527ea6.cephfs=/ 2024-09-12T02:42:21.150 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.112:3300/172.21.15.137:3300/172.21.15.137:3301" will pass to kernel 2024-09-12T02:42:21.151 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-12T02:42:21.151 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:42:21.151 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:42:21.152 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:42:21.152 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:42:21.155 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:42:21.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:21.155 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-12T02:42:21.211 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:42:21.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:42:21.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:21.299 INFO:teuthology.orchestra.run.smithi137.stdout:client4409 2024-09-12T02:42:21.299 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:42:21.299 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:42:21.335 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:42:21.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:42:21.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:21.462 INFO:teuthology.orchestra.run.smithi137.stdout:client4409 2024-09-12T02:42:21.463 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:42:21.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:42:21.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:21.551 INFO:teuthology.orchestra.run.smithi137.stdout:client4409 2024-09-12T02:42:21.551 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/7c01f3b3-dec2-4449-a33f-f960d7527ea6.client4409/status') 2024-09-12T02:42:21.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:42:21.650 INFO:teuthology.orchestra.run.smithi137.stdout:instance: client.4409 (3)192.168.0.2:0/1437035171 2024-09-12T02:42:21.650 INFO:teuthology.orchestra.run.smithi137.stdout:blocklisted: false 2024-09-12T02:42:21.650 INFO:teuthology.orchestra.run.smithi137.stderr:0+1 records in 2024-09-12T02:42:21.650 INFO:teuthology.orchestra.run.smithi137.stderr:0+1 records out 2024-09-12T02:42:21.650 INFO:teuthology.orchestra.run.smithi137.stderr:69 bytes copied, 7.0062e-05 s, 985 kB/s 2024-09-12T02:42:21.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:21.660 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-12T02:42:21.698 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestClusterFull) That when an OSD epoch barrier is set on an MDS, subsequently 2024-09-12T02:42:21.698 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestClusterFull) 2024-09-12T02:42:21.699 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:42:21.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.861+0000 7fb780c00640 1 Processor -- start 2024-09-12T02:42:21.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.861+0000 7fb780c00640 1 -- start start 2024-09-12T02:42:21.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.862+0000 7fb780c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb77c0afe30 0x7fb77c0cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:21.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.862+0000 7fb780c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb77c0ceeb0 con 0x7fb77c071530 2024-09-12T02:42:21.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.862+0000 7fb780c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb77c06e300 con 0x7fb77c15cc50 2024-09-12T02:42:21.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.862+0000 7fb780c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb77c15d030 con 0x7fb77c0afe30 2024-09-12T02:42:21.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.863+0000 7fb779400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb77c071530 0x7fb77c0af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34972/0 (socket says 172.21.15.112:34972) 2024-09-12T02:42:21.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.863+0000 7fb779400640 1 -- 172.21.15.112:0/2010805065 learned_addr learned my addr 172.21.15.112:0/2010805065 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:21.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.863+0000 7fb77a800640 1 --2- 172.21.15.112:0/2010805065 >> v2:172.21.15.137:3300/0 conn(0x7fb77c0afe30 0x7fb77c0cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:21.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.863+0000 7fb778a00640 1 -- 172.21.15.112:0/2010805065 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1027084369 0 0) 0x7fb77c0ceeb0 con 0x7fb77c071530 2024-09-12T02:42:21.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.863+0000 7fb778a00640 1 -- 172.21.15.112:0/2010805065 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb760003520 con 0x7fb77c071530 2024-09-12T02:42:21.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.863+0000 7fb778a00640 1 -- 172.21.15.112:0/2010805065 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3959924404 0 0) 0x7fb77c06e300 con 0x7fb77c15cc50 2024-09-12T02:42:21.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.863+0000 7fb778a00640 1 -- 172.21.15.112:0/2010805065 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb77c0ceeb0 con 0x7fb77c15cc50 2024-09-12T02:42:21.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.863+0000 7fb77a800640 1 -- 172.21.15.112:0/2010805065 >> v1:172.21.15.137:6789/0 conn(0x7fb77c15cc50 legacy=0x7fb77c0732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:21.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.863+0000 7fb77a800640 1 -- 172.21.15.112:0/2010805065 >> v1:172.21.15.112:6789/0 conn(0x7fb77c071530 legacy=0x7fb77c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:21.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.863+0000 7fb77a800640 1 -- 172.21.15.112:0/2010805065 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb77c06e5e0 con 0x7fb77c0afe30 2024-09-12T02:42:21.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.864+0000 7fb77a800640 1 --2- 172.21.15.112:0/2010805065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb77c0afe30 0x7fb77c0cf950 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb774009d90 tx=0x7fb77402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63e0c198e20d3ed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:21.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.865+0000 7fb778a00640 1 -- 172.21.15.112:0/2010805065 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb774007740 con 0x7fb77c0afe30 2024-09-12T02:42:21.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.865+0000 7fb778a00640 1 -- 172.21.15.112:0/2010805065 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7740078e0 con 0x7fb77c0afe30 2024-09-12T02:42:21.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.865+0000 7fb778a00640 1 -- 172.21.15.112:0/2010805065 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb774007cb0 con 0x7fb77c0afe30 2024-09-12T02:42:21.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.865+0000 7fb780c00640 1 -- 172.21.15.112:0/2010805065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb77c0afe30 msgr2=0x7fb77c0cf950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:21.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.865+0000 7fb780c00640 1 --2- 172.21.15.112:0/2010805065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb77c0afe30 0x7fb77c0cf950 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb774009d90 tx=0x7fb77402a660 comp rx=0 tx=0).stop 2024-09-12T02:42:21.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.865+0000 7fb780c00640 1 -- 172.21.15.112:0/2010805065 shutdown_connections 2024-09-12T02:42:21.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.865+0000 7fb780c00640 1 --2- 172.21.15.112:0/2010805065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb77c0afe30 0x7fb77c0cf950 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.865+0000 7fb780c00640 1 -- 172.21.15.112:0/2010805065 >> 172.21.15.112:0/2010805065 conn(0x7fb77c06bbd0 msgr2=0x7fb77c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:21.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.865+0000 7fb780c00640 1 -- 172.21.15.112:0/2010805065 shutdown_connections 2024-09-12T02:42:21.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.865+0000 7fb780c00640 1 -- 172.21.15.112:0/2010805065 wait complete. 2024-09-12T02:42:21.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.867+0000 7fb780c00640 1 Processor -- start 2024-09-12T02:42:21.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.867+0000 7fb780c00640 1 -- start start 2024-09-12T02:42:21.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.868+0000 7fb780c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb77c071530 0x7fb77c1414e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:21.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.868+0000 7fb780c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb77c0afe30 0x7fb77c153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:21.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.868+0000 7fb780c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb77c15cc50 0x7fb77c154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:21.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.868+0000 7fb780c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c06f510 con 0x7fb77c15cc50 2024-09-12T02:42:21.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.868+0000 7fb780c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c0cf4c0 con 0x7fb77c071530 2024-09-12T02:42:21.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.868+0000 7fb780c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb77c06f690 con 0x7fb77c0afe30 2024-09-12T02:42:21.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.868+0000 7fb77a800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb77c15cc50 0x7fb77c154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:21.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.868+0000 7fb77a800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb77c15cc50 0x7fb77c154240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52534/0 (socket says 172.21.15.112:52534) 2024-09-12T02:42:21.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.868+0000 7fb77a800640 1 -- 172.21.15.112:0/994153513 learned_addr learned my addr 172.21.15.112:0/994153513 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:21.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.868+0000 7fb779e00640 1 --2- 172.21.15.112:0/994153513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb77c071530 0x7fb77c1414e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:21.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.868+0000 7fb779400640 1 --2- 172.21.15.112:0/994153513 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb77c0afe30 0x7fb77c153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:21.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.868+0000 7fb77a800640 1 -- 172.21.15.112:0/994153513 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb77c0afe30 msgr2=0x7fb77c153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:21.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.868+0000 7fb77a800640 1 --2- 172.21.15.112:0/994153513 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb77c0afe30 0x7fb77c153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.868+0000 7fb77a800640 1 -- 172.21.15.112:0/994153513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb77c071530 msgr2=0x7fb77c1414e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:21.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.868+0000 7fb77a800640 1 --2- 172.21.15.112:0/994153513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb77c071530 0x7fb77c1414e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.868+0000 7fb77a800640 1 -- 172.21.15.112:0/994153513 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb77c153640 con 0x7fb77c15cc50 2024-09-12T02:42:21.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.868+0000 7fb779400640 1 --2- 172.21.15.112:0/994153513 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb77c0afe30 0x7fb77c153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:21.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.869+0000 7fb77a800640 1 --2- 172.21.15.112:0/994153513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb77c15cc50 0x7fb77c154240 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb774009eb0 tx=0x7fb774004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:21.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.869+0000 7fb772000640 1 -- 172.21.15.112:0/994153513 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb774040070 con 0x7fb77c15cc50 2024-09-12T02:42:21.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.869+0000 7fb772000640 1 -- 172.21.15.112:0/994153513 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb774031bc0 con 0x7fb77c15cc50 2024-09-12T02:42:21.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.869+0000 7fb780c00640 1 -- 172.21.15.112:0/994153513 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb77c153920 con 0x7fb77c15cc50 2024-09-12T02:42:21.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.869+0000 7fb772000640 1 -- 172.21.15.112:0/994153513 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb774009450 con 0x7fb77c15cc50 2024-09-12T02:42:21.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.869+0000 7fb780c00640 1 -- 172.21.15.112:0/994153513 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb77c1e68c0 con 0x7fb77c15cc50 2024-09-12T02:42:21.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.870+0000 7fb780c00640 1 -- 172.21.15.112:0/994153513 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb77c068a30 con 0x7fb77c15cc50 2024-09-12T02:42:21.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.871+0000 7fb772000640 1 -- 172.21.15.112:0/994153513 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb774039040 con 0x7fb77c15cc50 2024-09-12T02:42:21.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.872+0000 7fb772000640 1 --2- 172.21.15.112:0/994153513 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb75c06be30 0x7fb75c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:21.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.872+0000 7fb772000640 1 -- 172.21.15.112:0/994153513 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb7740ac630 con 0x7fb77c15cc50 2024-09-12T02:42:21.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.872+0000 7fb779e00640 1 --2- 172.21.15.112:0/994153513 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb75c06be30 0x7fb75c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:21.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.873+0000 7fb779e00640 1 --2- 172.21.15.112:0/994153513 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb75c06be30 0x7fb75c06e2f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb76c007fd0 tx=0x7fb76c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:21.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:21.876+0000 7fb772000640 1 -- 172.21.15.112:0/994153513 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb77407b060 con 0x7fb77c15cc50 2024-09-12T02:42:22.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.051+0000 7fb780c00640 1 -- 172.21.15.112:0/994153513 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb77c06df60 con 0x7fb77c15cc50 2024-09-12T02:42:22.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.052+0000 7fb772000640 1 -- 172.21.15.112:0/994153513 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16713 (secure 0 0 0) 0x7fb77407a960 con 0x7fb77c15cc50 2024-09-12T02:42:22.053 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:42:22.053 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":20,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:41:54.774268+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:41:51.222228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:41:52.167920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:42:22.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.054+0000 7fb780c00640 1 -- 172.21.15.112:0/994153513 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb75c06be30 msgr2=0x7fb75c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:22.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.054+0000 7fb780c00640 1 --2- 172.21.15.112:0/994153513 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb75c06be30 0x7fb75c06e2f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb76c007fd0 tx=0x7fb76c009040 comp rx=0 tx=0).stop 2024-09-12T02:42:22.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.054+0000 7fb780c00640 1 -- 172.21.15.112:0/994153513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb77c15cc50 msgr2=0x7fb77c154240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:22.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.054+0000 7fb780c00640 1 --2- 172.21.15.112:0/994153513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb77c15cc50 0x7fb77c154240 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb774009eb0 tx=0x7fb774004a40 comp rx=0 tx=0).stop 2024-09-12T02:42:22.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.054+0000 7fb780c00640 1 -- 172.21.15.112:0/994153513 shutdown_connections 2024-09-12T02:42:22.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.054+0000 7fb780c00640 1 --2- 172.21.15.112:0/994153513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb77c15cc50 0x7fb77c154240 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:22.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.054+0000 7fb780c00640 1 --2- 172.21.15.112:0/994153513 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb77c0afe30 0x7fb77c153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:22.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.054+0000 7fb780c00640 1 --2- 172.21.15.112:0/994153513 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb75c06be30 0x7fb75c06e2f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:22.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.054+0000 7fb780c00640 1 --2- 172.21.15.112:0/994153513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb77c071530 0x7fb77c1414e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:22.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.054+0000 7fb780c00640 1 -- 172.21.15.112:0/994153513 >> 172.21.15.112:0/994153513 conn(0x7fb77c06bbd0 msgr2=0x7fb77c0732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:22.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.054+0000 7fb780c00640 1 -- 172.21.15.112:0/994153513 shutdown_connections 2024-09-12T02:42:22.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.054+0000 7fb780c00640 1 -- 172.21.15.112:0/994153513 wait complete. 2024-09-12T02:42:22.072 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:41:43.011599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T02:41:51.222228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T02:41:52.167920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:42:22.073 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T02:42:22.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.229+0000 7fc262000640 1 Processor -- start 2024-09-12T02:42:22.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.229+0000 7fc262000640 1 -- start start 2024-09-12T02:42:22.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.230+0000 7fc262000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc25c0d1710 0x7fc25c0d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:22.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.230+0000 7fc262000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc25c0b1d70 0x7fc25c0b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:22.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.230+0000 7fc262000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc25c0d2fb0 con 0x7fc25c0b3e00 2024-09-12T02:42:22.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.230+0000 7fc262000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc25c0d3cb0 con 0x7fc25c0d1710 2024-09-12T02:42:22.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.230+0000 7fc262000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc25c0d0b60 con 0x7fc25c0b1d70 2024-09-12T02:42:22.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.230+0000 7fc25be00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc25c0b3e00 0x7fc25c0d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34986/0 (socket says 172.21.15.112:34986) 2024-09-12T02:42:22.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.230+0000 7fc25be00640 1 -- 172.21.15.112:0/2591864153 learned_addr learned my addr 172.21.15.112:0/2591864153 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:22.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.231+0000 7fc260c00640 1 --2- 172.21.15.112:0/2591864153 >> v2:172.21.15.137:3300/0 conn(0x7fc25c0d1710 0x7fc25c0d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:22.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.231+0000 7fc261600640 1 --2- 172.21.15.112:0/2591864153 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc25c0b1d70 0x7fc25c0b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:22.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.231+0000 7fc25b400640 1 -- 172.21.15.112:0/2591864153 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3610622899 0 0) 0x7fc25c0d2fb0 con 0x7fc25c0b3e00 2024-09-12T02:42:22.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.231+0000 7fc25b400640 1 -- 172.21.15.112:0/2591864153 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc244003520 con 0x7fc25c0b3e00 2024-09-12T02:42:22.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.231+0000 7fc260c00640 1 -- 172.21.15.112:0/2591864153 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc25c0b1d70 msgr2=0x7fc25c0b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:22.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.231+0000 7fc260c00640 1 --2- 172.21.15.112:0/2591864153 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc25c0b1d70 0x7fc25c0b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:22.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.231+0000 7fc260c00640 1 -- 172.21.15.112:0/2591864153 >> v1:172.21.15.112:6789/0 conn(0x7fc25c0b3e00 legacy=0x7fc25c0d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:22.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.231+0000 7fc260c00640 1 -- 172.21.15.112:0/2591864153 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc25c0d3410 con 0x7fc25c0d1710 2024-09-12T02:42:22.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.232+0000 7fc260c00640 1 --2- 172.21.15.112:0/2591864153 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc25c0d1710 0x7fc25c0d28d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc2500097a0 tx=0x7fc25002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6259d03c63bebb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:22.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.232+0000 7fc25b400640 1 -- 172.21.15.112:0/2591864153 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc250037070 con 0x7fc25c0d1710 2024-09-12T02:42:22.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.232+0000 7fc25b400640 1 -- 172.21.15.112:0/2591864153 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc250032440 con 0x7fc25c0d1710 2024-09-12T02:42:22.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.232+0000 7fc25b400640 1 -- 172.21.15.112:0/2591864153 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc250032810 con 0x7fc25c0d1710 2024-09-12T02:42:22.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.233+0000 7fc262000640 1 -- 172.21.15.112:0/2591864153 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc25c0d1710 msgr2=0x7fc25c0d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:22.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.233+0000 7fc262000640 1 --2- 172.21.15.112:0/2591864153 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc25c0d1710 0x7fc25c0d28d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc2500097a0 tx=0x7fc25002a180 comp rx=0 tx=0).stop 2024-09-12T02:42:22.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.233+0000 7fc262000640 1 -- 172.21.15.112:0/2591864153 shutdown_connections 2024-09-12T02:42:22.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.233+0000 7fc262000640 1 --2- 172.21.15.112:0/2591864153 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc25c0b1d70 0x7fc25c0b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:22.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.233+0000 7fc262000640 1 --2- 172.21.15.112:0/2591864153 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc25c0d1710 0x7fc25c0d28d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:22.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.233+0000 7fc262000640 1 -- 172.21.15.112:0/2591864153 >> 172.21.15.112:0/2591864153 conn(0x7fc25c09e030 msgr2=0x7fc25c0d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:22.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.233+0000 7fc262000640 1 -- 172.21.15.112:0/2591864153 shutdown_connections 2024-09-12T02:42:22.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.233+0000 7fc262000640 1 -- 172.21.15.112:0/2591864153 wait complete. 2024-09-12T02:42:22.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.235+0000 7fc262000640 1 Processor -- start 2024-09-12T02:42:22.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.235+0000 7fc262000640 1 -- start start 2024-09-12T02:42:22.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.236+0000 7fc262000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc25c0b1d70 0x7fc25c1581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:22.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.236+0000 7fc262000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc25c0b3e00 0x7fc25c1611f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:22.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.236+0000 7fc262000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc25c0d1710 0x7fc25c161730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:22.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.236+0000 7fc262000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c15f110 con 0x7fc25c0d1710 2024-09-12T02:42:22.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.236+0000 7fc262000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c0d39d0 con 0x7fc25c0b3e00 2024-09-12T02:42:22.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.236+0000 7fc262000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc25c15f290 con 0x7fc25c0b1d70 2024-09-12T02:42:22.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.236+0000 7fc261600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc25c0d1710 0x7fc25c161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:22.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.236+0000 7fc261600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc25c0d1710 0x7fc25c161730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52544/0 (socket says 172.21.15.112:52544) 2024-09-12T02:42:22.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.236+0000 7fc261600640 1 -- 172.21.15.112:0/1840970469 learned_addr learned my addr 172.21.15.112:0/1840970469 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:22.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.236+0000 7fc260c00640 1 --2- 172.21.15.112:0/1840970469 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc25c0b1d70 0x7fc25c1581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:22.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.236+0000 7fc25be00640 1 --2- 172.21.15.112:0/1840970469 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc25c0b3e00 0x7fc25c1611f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:22.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.236+0000 7fc261600640 1 -- 172.21.15.112:0/1840970469 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc25c0b1d70 msgr2=0x7fc25c1581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:22.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.236+0000 7fc261600640 1 --2- 172.21.15.112:0/1840970469 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc25c0b1d70 0x7fc25c1581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:22.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.236+0000 7fc261600640 1 -- 172.21.15.112:0/1840970469 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc25c0b3e00 msgr2=0x7fc25c1611f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:22.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.236+0000 7fc261600640 1 --2- 172.21.15.112:0/1840970469 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc25c0b3e00 0x7fc25c1611f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:22.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.236+0000 7fc261600640 1 -- 172.21.15.112:0/1840970469 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc25c161d40 con 0x7fc25c0d1710 2024-09-12T02:42:22.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.236+0000 7fc260c00640 1 --2- 172.21.15.112:0/1840970469 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc25c0b1d70 0x7fc25c1581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:22.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.237+0000 7fc261600640 1 --2- 172.21.15.112:0/1840970469 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc25c0d1710 0x7fc25c161730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc25400efc0 tx=0x7fc25400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:22.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.237+0000 7fc258c00640 1 -- 172.21.15.112:0/1840970469 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc254018020 con 0x7fc25c0d1710 2024-09-12T02:42:22.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.237+0000 7fc258c00640 1 -- 172.21.15.112:0/1840970469 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc254014480 con 0x7fc25c0d1710 2024-09-12T02:42:22.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.237+0000 7fc258c00640 1 -- 172.21.15.112:0/1840970469 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc254014870 con 0x7fc25c0d1710 2024-09-12T02:42:22.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.237+0000 7fc262000640 1 -- 172.21.15.112:0/1840970469 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc25c162020 con 0x7fc25c0d1710 2024-09-12T02:42:22.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.237+0000 7fc262000640 1 -- 172.21.15.112:0/1840970469 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc25c1f5a80 con 0x7fc25c0d1710 2024-09-12T02:42:22.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.238+0000 7fc262000640 1 -- 172.21.15.112:0/1840970469 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc25c162410 con 0x7fc25c0d1710 2024-09-12T02:42:22.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.239+0000 7fc258c00640 1 -- 172.21.15.112:0/1840970469 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc254005d10 con 0x7fc25c0d1710 2024-09-12T02:42:22.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.240+0000 7fc258c00640 1 --2- 172.21.15.112:0/1840970469 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc23c06be30 0x7fc23c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:22.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.240+0000 7fc258c00640 1 -- 172.21.15.112:0/1840970469 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc25408b890 con 0x7fc25c0d1710 2024-09-12T02:42:22.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.240+0000 7fc260c00640 1 --2- 172.21.15.112:0/1840970469 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc23c06be30 0x7fc23c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:22.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.241+0000 7fc260c00640 1 --2- 172.21.15.112:0/1840970469 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc23c06be30 0x7fc23c06e2f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc250034000 tx=0x7fc25002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:22.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.244+0000 7fc258c00640 1 -- 172.21.15.112:0/1840970469 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc254022070 con 0x7fc25c0d1710 2024-09-12T02:42:22.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.418+0000 7fc262000640 1 -- 172.21.15.112:0/1840970469 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc25c0d28d0 con 0x7fc25c0d1710 2024-09-12T02:42:22.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.418+0000 7fc258c00640 1 -- 172.21.15.112:0/1840970469 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fc254010040 con 0x7fc25c0d1710 2024-09-12T02:42:22.420 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2024-09-12T02:42:22.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.421+0000 7fc262000640 1 -- 172.21.15.112:0/1840970469 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc23c06be30 msgr2=0x7fc23c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:22.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.421+0000 7fc262000640 1 --2- 172.21.15.112:0/1840970469 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc23c06be30 0x7fc23c06e2f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc250034000 tx=0x7fc25002e000 comp rx=0 tx=0).stop 2024-09-12T02:42:22.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.421+0000 7fc262000640 1 -- 172.21.15.112:0/1840970469 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc25c0d1710 msgr2=0x7fc25c161730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:22.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.421+0000 7fc262000640 1 --2- 172.21.15.112:0/1840970469 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc25c0d1710 0x7fc25c161730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc25400efc0 tx=0x7fc25400c490 comp rx=0 tx=0).stop 2024-09-12T02:42:22.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.421+0000 7fc262000640 1 -- 172.21.15.112:0/1840970469 shutdown_connections 2024-09-12T02:42:22.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.421+0000 7fc262000640 1 --2- 172.21.15.112:0/1840970469 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc25c0d1710 0x7fc25c161730 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:22.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.421+0000 7fc262000640 1 --2- 172.21.15.112:0/1840970469 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc23c06be30 0x7fc23c06e2f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:22.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.421+0000 7fc262000640 1 --2- 172.21.15.112:0/1840970469 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc25c0b3e00 0x7fc25c1611f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:22.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.421+0000 7fc262000640 1 --2- 172.21.15.112:0/1840970469 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc25c0b1d70 0x7fc25c1581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:22.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.421+0000 7fc262000640 1 -- 172.21.15.112:0/1840970469 >> 172.21.15.112:0/1840970469 conn(0x7fc25c09e030 msgr2=0x7fc25c0b7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:22.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.421+0000 7fc262000640 1 -- 172.21.15.112:0/1840970469 shutdown_connections 2024-09-12T02:42:22.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.421+0000 7fc262000640 1 -- 172.21.15.112:0/1840970469 wait complete. 2024-09-12T02:42:22.438 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T02:42:22.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.593+0000 7f437f800640 1 Processor -- start 2024-09-12T02:42:22.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.593+0000 7f437f800640 1 -- start start 2024-09-12T02:42:22.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.594+0000 7f437f800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f437815b9d0 0x7f43780b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:22.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.594+0000 7f437f800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f43780b45d0 0x7f43780728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:22.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.594+0000 7f437f800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43780b54a0 con 0x7f437806eef0 2024-09-12T02:42:22.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.594+0000 7f437f800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f43780b4a30 con 0x7f43780b45d0 2024-09-12T02:42:22.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.594+0000 7f437f800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f43780b3af0 con 0x7f437815b9d0 2024-09-12T02:42:22.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.594+0000 7f437d800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f437806eef0 0x7f437806f300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34992/0 (socket says 172.21.15.112:34992) 2024-09-12T02:42:22.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.594+0000 7f437d800640 1 -- 172.21.15.112:0/802961511 learned_addr learned my addr 172.21.15.112:0/802961511 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:22.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.595+0000 7f4377e00640 1 --2- 172.21.15.112:0/802961511 >> v2:172.21.15.137:3300/0 conn(0x7f43780b45d0 0x7f43780728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:22.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.595+0000 7f437ce00640 1 --2- 172.21.15.112:0/802961511 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f437815b9d0 0x7f43780b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:22.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.595+0000 7f4377400640 1 -- 172.21.15.112:0/802961511 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1565714814 0 0) 0x7f43780b54a0 con 0x7f437806eef0 2024-09-12T02:42:22.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.595+0000 7f4377400640 1 -- 172.21.15.112:0/802961511 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4360003520 con 0x7f437806eef0 2024-09-12T02:42:22.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.595+0000 7f4377e00640 1 -- 172.21.15.112:0/802961511 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f437815b9d0 msgr2=0x7f43780b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:22.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.595+0000 7f4377e00640 1 --2- 172.21.15.112:0/802961511 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f437815b9d0 0x7f43780b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:22.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.595+0000 7f4377e00640 1 -- 172.21.15.112:0/802961511 >> v1:172.21.15.112:6789/0 conn(0x7f437806eef0 legacy=0x7f437806f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:22.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.595+0000 7f4377e00640 1 -- 172.21.15.112:0/802961511 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43780b3dd0 con 0x7f43780b45d0 2024-09-12T02:42:22.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.596+0000 7f4377e00640 1 --2- 172.21.15.112:0/802961511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43780b45d0 0x7f43780728c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4364009790 tx=0x7f436402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e892ad3ac90ec31b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:22.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.596+0000 7f4377400640 1 -- 172.21.15.112:0/802961511 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4364037070 con 0x7f43780b45d0 2024-09-12T02:42:22.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.596+0000 7f4377400640 1 -- 172.21.15.112:0/802961511 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4364032440 con 0x7f43780b45d0 2024-09-12T02:42:22.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.596+0000 7f4377400640 1 -- 172.21.15.112:0/802961511 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4364032810 con 0x7f43780b45d0 2024-09-12T02:42:22.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.597+0000 7f437f800640 1 -- 172.21.15.112:0/802961511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43780b45d0 msgr2=0x7f43780728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:22.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.597+0000 7f437f800640 1 --2- 172.21.15.112:0/802961511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43780b45d0 0x7f43780728c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4364009790 tx=0x7f436402a180 comp rx=0 tx=0).stop 2024-09-12T02:42:22.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.597+0000 7f437f800640 1 -- 172.21.15.112:0/802961511 shutdown_connections 2024-09-12T02:42:22.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.597+0000 7f437f800640 1 --2- 172.21.15.112:0/802961511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43780b45d0 0x7f43780728c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:22.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.597+0000 7f437f800640 1 --2- 172.21.15.112:0/802961511 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f437815b9d0 0x7f43780b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:22.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.597+0000 7f437f800640 1 -- 172.21.15.112:0/802961511 >> 172.21.15.112:0/802961511 conn(0x7f437806bbd0 msgr2=0x7f437806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:22.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.597+0000 7f437f800640 1 -- 172.21.15.112:0/802961511 shutdown_connections 2024-09-12T02:42:22.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.597+0000 7f437f800640 1 -- 172.21.15.112:0/802961511 wait complete. 2024-09-12T02:42:22.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.599+0000 7f437f800640 1 Processor -- start 2024-09-12T02:42:22.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.599+0000 7f437f800640 1 -- start start 2024-09-12T02:42:22.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.600+0000 7f437f800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f437806eef0 0x7f4378144170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:22.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.600+0000 7f437f800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43780b45d0 0x7f4378152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:22.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.600+0000 7f437f800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f437815b9d0 0x7f43780cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:22.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.600+0000 7f437f800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f437815bf30 con 0x7f43780b45d0 2024-09-12T02:42:22.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.600+0000 7f437f800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f437815bdb0 con 0x7f437815b9d0 2024-09-12T02:42:22.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.600+0000 7f437f800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f43780cdcd0 con 0x7f437806eef0 2024-09-12T02:42:22.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.600+0000 7f4377e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43780b45d0 0x7f4378152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:22.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.600+0000 7f4377e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43780b45d0 0x7f4378152ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52552/0 (socket says 172.21.15.112:52552) 2024-09-12T02:42:22.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.600+0000 7f4377e00640 1 -- 172.21.15.112:0/1647480102 learned_addr learned my addr 172.21.15.112:0/1647480102 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:22.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.600+0000 7f437ce00640 1 --2- 172.21.15.112:0/1647480102 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f437806eef0 0x7f4378144170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:22.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.600+0000 7f437d800640 1 --2- 172.21.15.112:0/1647480102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f437815b9d0 0x7f43780cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:22.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.601+0000 7f4377e00640 1 -- 172.21.15.112:0/1647480102 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f437806eef0 msgr2=0x7f4378144170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:22.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.601+0000 7f4377e00640 1 --2- 172.21.15.112:0/1647480102 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f437806eef0 0x7f4378144170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:22.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.601+0000 7f4377e00640 1 -- 172.21.15.112:0/1647480102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f437815b9d0 msgr2=0x7f43780cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:22.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.601+0000 7f4377e00640 1 --2- 172.21.15.112:0/1647480102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f437815b9d0 0x7f43780cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:22.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.601+0000 7f4377e00640 1 -- 172.21.15.112:0/1647480102 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4378153d60 con 0x7f43780b45d0 2024-09-12T02:42:22.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.601+0000 7f4377e00640 1 --2- 172.21.15.112:0/1647480102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43780b45d0 0x7f4378152ce0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4364035040 tx=0x7f43640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:22.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.601+0000 7f4374c00640 1 -- 172.21.15.112:0/1647480102 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4364037040 con 0x7f43780b45d0 2024-09-12T02:42:22.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.601+0000 7f4374c00640 1 -- 172.21.15.112:0/1647480102 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4364042070 con 0x7f43780b45d0 2024-09-12T02:42:22.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.601+0000 7f4374c00640 1 -- 172.21.15.112:0/1647480102 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4364006030 con 0x7f43780b45d0 2024-09-12T02:42:22.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.601+0000 7f437f800640 1 -- 172.21.15.112:0/1647480102 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43781537a0 con 0x7f43780b45d0 2024-09-12T02:42:22.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.601+0000 7f437f800640 1 -- 172.21.15.112:0/1647480102 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4378144920 con 0x7f43780b45d0 2024-09-12T02:42:22.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.602+0000 7f437f800640 1 -- 172.21.15.112:0/1647480102 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f437806e380 con 0x7f43780b45d0 2024-09-12T02:42:22.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.603+0000 7f4374c00640 1 -- 172.21.15.112:0/1647480102 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f43640061d0 con 0x7f43780b45d0 2024-09-12T02:42:22.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.604+0000 7f4374c00640 1 --2- 172.21.15.112:0/1647480102 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f435806be30 0x7f435806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:22.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.604+0000 7f4374c00640 1 -- 172.21.15.112:0/1647480102 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f43640ab640 con 0x7f43780b45d0 2024-09-12T02:42:22.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.604+0000 7f437ce00640 1 --2- 172.21.15.112:0/1647480102 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f435806be30 0x7f435806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:22.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.605+0000 7f437ce00640 1 --2- 172.21.15.112:0/1647480102 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f435806be30 0x7f435806e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f436c009aa0 tx=0x7f436c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:22.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.608+0000 7f4374c00640 1 -- 172.21.15.112:0/1647480102 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4364079910 con 0x7f43780b45d0 2024-09-12T02:42:22.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.781+0000 7f437f800640 1 -- 172.21.15.112:0/1647480102 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f43780b1aa0 con 0x7f43780b45d0 2024-09-12T02:42:22.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.782+0000 7f4374c00640 1 -- 172.21.15.112:0/1647480102 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f436407dc10 con 0x7f43780b45d0 2024-09-12T02:42:22.783 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2024-09-12T02:42:22.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.784+0000 7f437f800640 1 -- 172.21.15.112:0/1647480102 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f435806be30 msgr2=0x7f435806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:22.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.784+0000 7f437f800640 1 --2- 172.21.15.112:0/1647480102 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f435806be30 0x7f435806e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f436c009aa0 tx=0x7f436c009190 comp rx=0 tx=0).stop 2024-09-12T02:42:22.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.784+0000 7f437f800640 1 -- 172.21.15.112:0/1647480102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43780b45d0 msgr2=0x7f4378152ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:22.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.784+0000 7f437f800640 1 --2- 172.21.15.112:0/1647480102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43780b45d0 0x7f4378152ce0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4364035040 tx=0x7f43640046c0 comp rx=0 tx=0).stop 2024-09-12T02:42:22.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.784+0000 7f437f800640 1 -- 172.21.15.112:0/1647480102 shutdown_connections 2024-09-12T02:42:22.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.784+0000 7f437f800640 1 --2- 172.21.15.112:0/1647480102 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f435806be30 0x7f435806e2f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:22.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.784+0000 7f437f800640 1 --2- 172.21.15.112:0/1647480102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f437815b9d0 0x7f43780cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:22.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.784+0000 7f437f800640 1 --2- 172.21.15.112:0/1647480102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43780b45d0 0x7f4378152ce0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:22.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.784+0000 7f437f800640 1 --2- 172.21.15.112:0/1647480102 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f437806eef0 0x7f4378144170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:22.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.784+0000 7f437f800640 1 -- 172.21.15.112:0/1647480102 >> 172.21.15.112:0/1647480102 conn(0x7f437806bbd0 msgr2=0x7f43780b54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:22.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.784+0000 7f437f800640 1 -- 172.21.15.112:0/1647480102 shutdown_connections 2024-09-12T02:42:22.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.785+0000 7f437f800640 1 -- 172.21.15.112:0/1647480102 wait complete. 2024-09-12T02:42:22.801 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T02:42:22.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.955+0000 7fbf17e00640 1 Processor -- start 2024-09-12T02:42:22.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.955+0000 7fbf17e00640 1 -- start start 2024-09-12T02:42:22.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.956+0000 7fbf17e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbf1815a450 0x7fbf1806e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:22.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.956+0000 7fbf17e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbf180ce460 0x7fbf180d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:22.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.956+0000 7fbf17e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf1806e990 con 0x7fbf1815db60 2024-09-12T02:42:22.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.956+0000 7fbf17e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fbf18071eb0 con 0x7fbf180ce460 2024-09-12T02:42:22.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.956+0000 7fbf17e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fbf1806ec70 con 0x7fbf1815a450 2024-09-12T02:42:22.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.956+0000 7fbf0fe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbf180ce460 0x7fbf180d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:22.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.956+0000 7fbf0fe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbf180ce460 0x7fbf180d0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52556/0 (socket says 172.21.15.112:52556) 2024-09-12T02:42:22.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.956+0000 7fbf0fe00640 1 -- 172.21.15.112:0/3866804451 learned_addr learned my addr 172.21.15.112:0/3866804451 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:22.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.957+0000 7fbf16a00640 1 --2- 172.21.15.112:0/3866804451 >> v2:172.21.15.137:3300/0 conn(0x7fbf1815a450 0x7fbf1806e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:22.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.957+0000 7fbf0fe00640 1 -- 172.21.15.112:0/3866804451 >> v2:172.21.15.137:3300/0 conn(0x7fbf1815a450 msgr2=0x7fbf1806e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:22.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.957+0000 7fbf0fe00640 1 --2- 172.21.15.112:0/3866804451 >> v2:172.21.15.137:3300/0 conn(0x7fbf1815a450 0x7fbf1806e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:22.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.957+0000 7fbf0fe00640 1 -- 172.21.15.112:0/3866804451 >> v1:172.21.15.137:6789/0 conn(0x7fbf1815db60 legacy=0x7fbf18160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:22.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.957+0000 7fbf0fe00640 1 -- 172.21.15.112:0/3866804451 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf18072100 con 0x7fbf180ce460 2024-09-12T02:42:22.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.957+0000 7fbf16a00640 1 --2- 172.21.15.112:0/3866804451 >> v2:172.21.15.137:3300/0 conn(0x7fbf1815a450 0x7fbf1806e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:42:22.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.958+0000 7fbf0fe00640 1 --2- 172.21.15.112:0/3866804451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf180ce460 0x7fbf180d0820 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbf18068760 tx=0x7fbf0002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33efec94496b1900 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:22.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.958+0000 7fbf16000640 1 -- 172.21.15.112:0/3866804451 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf00037070 con 0x7fbf180ce460 2024-09-12T02:42:22.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.958+0000 7fbf16000640 1 -- 172.21.15.112:0/3866804451 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf00032440 con 0x7fbf180ce460 2024-09-12T02:42:22.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.958+0000 7fbf16000640 1 -- 172.21.15.112:0/3866804451 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf00032810 con 0x7fbf180ce460 2024-09-12T02:42:22.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.959+0000 7fbf17e00640 1 -- 172.21.15.112:0/3866804451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf180ce460 msgr2=0x7fbf180d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:22.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.959+0000 7fbf17e00640 1 --2- 172.21.15.112:0/3866804451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf180ce460 0x7fbf180d0820 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbf18068760 tx=0x7fbf0002a2c0 comp rx=0 tx=0).stop 2024-09-12T02:42:22.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.959+0000 7fbf17e00640 1 -- 172.21.15.112:0/3866804451 shutdown_connections 2024-09-12T02:42:22.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.959+0000 7fbf17e00640 1 --2- 172.21.15.112:0/3866804451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf180ce460 0x7fbf180d0820 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:22.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.959+0000 7fbf17e00640 1 --2- 172.21.15.112:0/3866804451 >> v2:172.21.15.137:3300/0 conn(0x7fbf1815a450 0x7fbf1806e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:22.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.959+0000 7fbf17e00640 1 -- 172.21.15.112:0/3866804451 >> 172.21.15.112:0/3866804451 conn(0x7fbf1806bbd0 msgr2=0x7fbf1806bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:22.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.959+0000 7fbf17e00640 1 -- 172.21.15.112:0/3866804451 shutdown_connections 2024-09-12T02:42:22.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.959+0000 7fbf17e00640 1 -- 172.21.15.112:0/3866804451 wait complete. 2024-09-12T02:42:22.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.960+0000 7fbf17e00640 1 Processor -- start 2024-09-12T02:42:22.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.960+0000 7fbf17e00640 1 -- start start 2024-09-12T02:42:22.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.961+0000 7fbf17e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf180ce460 0x7fbf18156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:22.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.961+0000 7fbf17e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf1815a450 0x7fbf181e6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:22.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.961+0000 7fbf17e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf1815db60 0x7fbf181585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:22.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.961+0000 7fbf17e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1815a830 con 0x7fbf180ce460 2024-09-12T02:42:22.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.961+0000 7fbf17e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1806e680 con 0x7fbf1815db60 2024-09-12T02:42:22.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.961+0000 7fbf17e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbf180d0d60 con 0x7fbf1815a450 2024-09-12T02:42:22.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.962+0000 7fbf16a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf180ce460 0x7fbf18156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:22.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.962+0000 7fbf16a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf180ce460 0x7fbf18156f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52564/0 (socket says 172.21.15.112:52564) 2024-09-12T02:42:22.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.962+0000 7fbf16a00640 1 -- 172.21.15.112:0/3809220075 learned_addr learned my addr 172.21.15.112:0/3809220075 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:22.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.962+0000 7fbf0fe00640 1 --2- 172.21.15.112:0/3809220075 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf1815a450 0x7fbf181e6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:22.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.962+0000 7fbf17400640 1 --2- 172.21.15.112:0/3809220075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf1815db60 0x7fbf181585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:22.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.962+0000 7fbf16a00640 1 -- 172.21.15.112:0/3809220075 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf1815a450 msgr2=0x7fbf181e6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:22.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.962+0000 7fbf16a00640 1 --2- 172.21.15.112:0/3809220075 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf1815a450 0x7fbf181e6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:22.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.962+0000 7fbf16a00640 1 -- 172.21.15.112:0/3809220075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf1815db60 msgr2=0x7fbf181585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:22.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.962+0000 7fbf16a00640 1 --2- 172.21.15.112:0/3809220075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf1815db60 0x7fbf181585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:22.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.962+0000 7fbf16a00640 1 -- 172.21.15.112:0/3809220075 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf1815f4e0 con 0x7fbf180ce460 2024-09-12T02:42:22.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.962+0000 7fbf16a00640 1 --2- 172.21.15.112:0/3809220075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf180ce460 0x7fbf18156f40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800c7f0 tx=0x7fbf0800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:22.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.963+0000 7fbf0ea00640 1 -- 172.21.15.112:0/3809220075 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf08015070 con 0x7fbf180ce460 2024-09-12T02:42:22.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.963+0000 7fbf0ea00640 1 -- 172.21.15.112:0/3809220075 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf08007a30 con 0x7fbf180ce460 2024-09-12T02:42:22.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.963+0000 7fbf17e00640 1 -- 172.21.15.112:0/3809220075 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf1815f7c0 con 0x7fbf180ce460 2024-09-12T02:42:22.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.963+0000 7fbf0ea00640 1 -- 172.21.15.112:0/3809220075 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf08007e00 con 0x7fbf180ce460 2024-09-12T02:42:22.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.963+0000 7fbf17e00640 1 -- 172.21.15.112:0/3809220075 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf1815fd80 con 0x7fbf180ce460 2024-09-12T02:42:22.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.964+0000 7fbf17e00640 1 -- 172.21.15.112:0/3809220075 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf180d10f0 con 0x7fbf180ce460 2024-09-12T02:42:22.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.965+0000 7fbf0ea00640 1 -- 172.21.15.112:0/3809220075 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbf08018070 con 0x7fbf180ce460 2024-09-12T02:42:22.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.966+0000 7fbf0ea00640 1 --2- 172.21.15.112:0/3809220075 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbef406be30 0x7fbef406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:22.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.966+0000 7fbf0ea00640 1 -- 172.21.15.112:0/3809220075 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbf0808ada0 con 0x7fbf180ce460 2024-09-12T02:42:22.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.966+0000 7fbf0fe00640 1 --2- 172.21.15.112:0/3809220075 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbef406be30 0x7fbef406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:22.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.967+0000 7fbf0fe00640 1 --2- 172.21.15.112:0/3809220075 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbef406be30 0x7fbef406e2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbf00034000 tx=0x7fbf0002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:22.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:22.971+0000 7fbf0ea00640 1 -- 172.21.15.112:0/3809220075 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbf08059100 con 0x7fbf180ce460 2024-09-12T02:42:23.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.143+0000 7fbf17e00640 1 -- 172.21.15.112:0/3809220075 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbf180763b0 con 0x7fbf180ce460 2024-09-12T02:42:23.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.144+0000 7fbf0ea00640 1 -- 172.21.15.112:0/3809220075 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fbf0805d400 con 0x7fbf180ce460 2024-09-12T02:42:23.145 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2024-09-12T02:42:23.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.146+0000 7fbf17e00640 1 -- 172.21.15.112:0/3809220075 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbef406be30 msgr2=0x7fbef406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:23.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.146+0000 7fbf17e00640 1 --2- 172.21.15.112:0/3809220075 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbef406be30 0x7fbef406e2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbf00034000 tx=0x7fbf0002e000 comp rx=0 tx=0).stop 2024-09-12T02:42:23.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.146+0000 7fbf17e00640 1 -- 172.21.15.112:0/3809220075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf180ce460 msgr2=0x7fbf18156f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:23.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.146+0000 7fbf17e00640 1 --2- 172.21.15.112:0/3809220075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf180ce460 0x7fbf18156f40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800c7f0 tx=0x7fbf0800cbf0 comp rx=0 tx=0).stop 2024-09-12T02:42:23.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.146+0000 7fbf17e00640 1 -- 172.21.15.112:0/3809220075 shutdown_connections 2024-09-12T02:42:23.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.146+0000 7fbf17e00640 1 --2- 172.21.15.112:0/3809220075 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbef406be30 0x7fbef406e2f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:23.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.146+0000 7fbf17e00640 1 --2- 172.21.15.112:0/3809220075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf1815db60 0x7fbf181585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:23.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.146+0000 7fbf17e00640 1 --2- 172.21.15.112:0/3809220075 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf1815a450 0x7fbf181e6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:23.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.146+0000 7fbf17e00640 1 --2- 172.21.15.112:0/3809220075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf180ce460 0x7fbf18156f40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:23.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.146+0000 7fbf17e00640 1 -- 172.21.15.112:0/3809220075 >> 172.21.15.112:0/3809220075 conn(0x7fbf1806bbd0 msgr2=0x7fbf180cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:23.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.146+0000 7fbf17e00640 1 -- 172.21.15.112:0/3809220075 shutdown_connections 2024-09-12T02:42:23.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.146+0000 7fbf17e00640 1 -- 172.21.15.112:0/3809220075 wait complete. 2024-09-12T02:42:23.162 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2024-09-12T02:42:23.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.315+0000 7f2243200640 1 Processor -- start 2024-09-12T02:42:23.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.315+0000 7f2243200640 1 -- start start 2024-09-12T02:42:23.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.316+0000 7f2243200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f22440d1710 0x7f22440d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:23.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.316+0000 7f2243200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22440b1d70 0x7f22440b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:23.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.316+0000 7f2243200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22440d2fb0 con 0x7f22440b3e00 2024-09-12T02:42:23.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.316+0000 7f2243200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f22440d3cb0 con 0x7f22440d1710 2024-09-12T02:42:23.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.316+0000 7f2243200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f22440d0b60 con 0x7f22440b1d70 2024-09-12T02:42:23.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.316+0000 7f2241e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f22440d1710 0x7f22440d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:23.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.316+0000 7f2241e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f22440d1710 0x7f22440d28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52578/0 (socket says 172.21.15.112:52578) 2024-09-12T02:42:23.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.316+0000 7f2241e00640 1 -- 172.21.15.112:0/2054916683 learned_addr learned my addr 172.21.15.112:0/2054916683 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:23.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.317+0000 7f2242800640 1 --2- 172.21.15.112:0/2054916683 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22440b1d70 0x7f22440b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:23.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.317+0000 7f2241e00640 1 -- 172.21.15.112:0/2054916683 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22440b1d70 msgr2=0x7f22440b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:23.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.317+0000 7f2241e00640 1 --2- 172.21.15.112:0/2054916683 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22440b1d70 0x7f22440b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:23.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.317+0000 7f2241e00640 1 -- 172.21.15.112:0/2054916683 >> v1:172.21.15.137:6789/0 conn(0x7f22440b3e00 legacy=0x7f22440d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:23.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.317+0000 7f2241e00640 1 -- 172.21.15.112:0/2054916683 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22440d3410 con 0x7f22440d1710 2024-09-12T02:42:23.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.318+0000 7f2241e00640 1 --2- 172.21.15.112:0/2054916683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22440d1710 0x7f22440d28d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2234009870 tx=0x7f223402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ba9c7bfe05f9dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:23.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.318+0000 7f2240a00640 1 -- 172.21.15.112:0/2054916683 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2234037070 con 0x7f22440d1710 2024-09-12T02:42:23.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.318+0000 7f2240a00640 1 -- 172.21.15.112:0/2054916683 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2234032440 con 0x7f22440d1710 2024-09-12T02:42:23.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.318+0000 7f2240a00640 1 -- 172.21.15.112:0/2054916683 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2234032810 con 0x7f22440d1710 2024-09-12T02:42:23.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.319+0000 7f2243200640 1 -- 172.21.15.112:0/2054916683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22440d1710 msgr2=0x7f22440d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:23.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.319+0000 7f2243200640 1 --2- 172.21.15.112:0/2054916683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22440d1710 0x7f22440d28d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2234009870 tx=0x7f223402a270 comp rx=0 tx=0).stop 2024-09-12T02:42:23.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.319+0000 7f2243200640 1 -- 172.21.15.112:0/2054916683 shutdown_connections 2024-09-12T02:42:23.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.319+0000 7f2243200640 1 --2- 172.21.15.112:0/2054916683 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22440b1d70 0x7f22440b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:23.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.319+0000 7f2243200640 1 --2- 172.21.15.112:0/2054916683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22440d1710 0x7f22440d28d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:23.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.319+0000 7f2243200640 1 -- 172.21.15.112:0/2054916683 >> 172.21.15.112:0/2054916683 conn(0x7f224409e030 msgr2=0x7f22440d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:23.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.319+0000 7f2243200640 1 -- 172.21.15.112:0/2054916683 shutdown_connections 2024-09-12T02:42:23.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.319+0000 7f2243200640 1 -- 172.21.15.112:0/2054916683 wait complete. 2024-09-12T02:42:23.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.320+0000 7f2243200640 1 Processor -- start 2024-09-12T02:42:23.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.321+0000 7f2243200640 1 -- start start 2024-09-12T02:42:23.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.321+0000 7f2243200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22440b1d70 0x7f2244161950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:23.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.321+0000 7f2243200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22440b3e00 0x7f2244158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:23.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.321+0000 7f2243200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22440d1710 0x7f22440cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:23.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.321+0000 7f2243200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f224415f110 con 0x7f22440b3e00 2024-09-12T02:42:23.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.321+0000 7f2243200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f22440d39d0 con 0x7f22440d1710 2024-09-12T02:42:23.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.321+0000 7f2243200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f224415f290 con 0x7f22440b1d70 2024-09-12T02:42:23.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.322+0000 7f2241400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22440b3e00 0x7f2244158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:23.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.322+0000 7f2241400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22440b3e00 0x7f2244158360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52590/0 (socket says 172.21.15.112:52590) 2024-09-12T02:42:23.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.322+0000 7f2241400640 1 -- 172.21.15.112:0/2261142891 learned_addr learned my addr 172.21.15.112:0/2261142891 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:23.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.322+0000 7f2242800640 1 --2- 172.21.15.112:0/2261142891 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22440d1710 0x7f22440cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:23.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.322+0000 7f2241e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22440b1d70 0x7f2244161950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:23.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.322+0000 7f2241400640 1 -- 172.21.15.112:0/2261142891 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22440b1d70 msgr2=0x7f2244161950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:23.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.322+0000 7f2241400640 1 --2- 172.21.15.112:0/2261142891 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22440b1d70 0x7f2244161950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:23.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.322+0000 7f2241400640 1 -- 172.21.15.112:0/2261142891 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22440d1710 msgr2=0x7f22440cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:23.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.322+0000 7f2241400640 1 --2- 172.21.15.112:0/2261142891 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22440d1710 0x7f22440cc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:23.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.322+0000 7f2241400640 1 -- 172.21.15.112:0/2261142891 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22441608b0 con 0x7f22440b3e00 2024-09-12T02:42:23.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.322+0000 7f2241400640 1 --2- 172.21.15.112:0/2261142891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22440b3e00 0x7f2244158360 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f223000c400 tx=0x7f223000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:23.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.323+0000 7f223a000640 1 -- 172.21.15.112:0/2261142891 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22300052d0 con 0x7f22440b3e00 2024-09-12T02:42:23.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.323+0000 7f223a000640 1 -- 172.21.15.112:0/2261142891 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2230005490 con 0x7f22440b3e00 2024-09-12T02:42:23.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.323+0000 7f223a000640 1 -- 172.21.15.112:0/2261142891 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2230007260 con 0x7f22440b3e00 2024-09-12T02:42:23.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.323+0000 7f2243200640 1 -- 172.21.15.112:0/2261142891 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2244160b90 con 0x7f22440b3e00 2024-09-12T02:42:23.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.323+0000 7f2243200640 1 -- 172.21.15.112:0/2261142891 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2244161150 con 0x7f22440b3e00 2024-09-12T02:42:23.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.324+0000 7f2243200640 1 -- 172.21.15.112:0/2261142891 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22440d49e0 con 0x7f22440b3e00 2024-09-12T02:42:23.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.325+0000 7f223a000640 1 -- 172.21.15.112:0/2261142891 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2230007400 con 0x7f22440b3e00 2024-09-12T02:42:23.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.326+0000 7f223a000640 1 --2- 172.21.15.112:0/2261142891 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f222406be30 0x7f222406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:23.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.326+0000 7f223a000640 1 -- 172.21.15.112:0/2261142891 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f223008a390 con 0x7f22440b3e00 2024-09-12T02:42:23.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.326+0000 7f2241e00640 1 --2- 172.21.15.112:0/2261142891 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f222406be30 0x7f222406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:23.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.327+0000 7f2241e00640 1 --2- 172.21.15.112:0/2261142891 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f222406be30 0x7f222406e2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2234034000 tx=0x7f223402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:23.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.330+0000 7f223a000640 1 -- 172.21.15.112:0/2261142891 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f22440d49e0 con 0x7f22440b3e00 2024-09-12T02:42:23.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:23.567+0000 7f2243200640 1 -- 172.21.15.112:0/2261142891 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) -- 0x7f22440d28d0 con 0x7f22440b3e00 2024-09-12T02:42:24.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.074+0000 7f223a000640 1 -- 172.21.15.112:0/2261142891 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v42) ==== 133+0+0 (secure 0 0 0) 0x7f2230058650 con 0x7f22440b3e00 2024-09-12T02:42:24.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.077+0000 7f2243200640 1 -- 172.21.15.112:0/2261142891 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f222406be30 msgr2=0x7f222406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:24.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.077+0000 7f2243200640 1 --2- 172.21.15.112:0/2261142891 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f222406be30 0x7f222406e2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2234034000 tx=0x7f223402e000 comp rx=0 tx=0).stop 2024-09-12T02:42:24.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.077+0000 7f2243200640 1 -- 172.21.15.112:0/2261142891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22440b3e00 msgr2=0x7f2244158360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:24.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.077+0000 7f2243200640 1 --2- 172.21.15.112:0/2261142891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22440b3e00 0x7f2244158360 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f223000c400 tx=0x7f223000c8c0 comp rx=0 tx=0).stop 2024-09-12T02:42:24.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.077+0000 7f2243200640 1 -- 172.21.15.112:0/2261142891 shutdown_connections 2024-09-12T02:42:24.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.077+0000 7f2243200640 1 --2- 172.21.15.112:0/2261142891 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f222406be30 0x7f222406e2f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:24.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.077+0000 7f2243200640 1 --2- 172.21.15.112:0/2261142891 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22440d1710 0x7f22440cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:24.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.077+0000 7f2243200640 1 --2- 172.21.15.112:0/2261142891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22440b3e00 0x7f2244158360 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:24.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.077+0000 7f2243200640 1 --2- 172.21.15.112:0/2261142891 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22440b1d70 0x7f2244161950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:24.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.077+0000 7f2243200640 1 -- 172.21.15.112:0/2261142891 >> 172.21.15.112:0/2261142891 conn(0x7f224409e030 msgr2=0x7f22440b8280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:24.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.077+0000 7f2243200640 1 -- 172.21.15.112:0/2261142891 shutdown_connections 2024-09-12T02:42:24.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.077+0000 7f2243200640 1 -- 172.21.15.112:0/2261142891 wait complete. 2024-09-12T02:42:24.095 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2024-09-12T02:42:24.263 INFO:teuthology.orchestra.run.smithi112.stdout:{"osd_objectstore":"memstore"} 2024-09-12T02:42:24.264 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2024-09-12T02:42:24.264 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T02:42:24.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.419+0000 7fd9e4e00640 1 Processor -- start 2024-09-12T02:42:24.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.419+0000 7fd9e4e00640 1 -- start start 2024-09-12T02:42:24.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.420+0000 7fd9e4e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9e0162100 0x7fd9e00d58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:24.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.420+0000 7fd9e4e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd9e01624e0 0x7fd9e00b4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:24.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.420+0000 7fd9e4e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9e00cfa70 con 0x7fd9e00d0510 2024-09-12T02:42:24.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.420+0000 7fd9e4e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd9e00d21d0 con 0x7fd9e01624e0 2024-09-12T02:42:24.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.420+0000 7fd9e4e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd9e00d24b0 con 0x7fd9e0162100 2024-09-12T02:42:24.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.420+0000 7fd9de800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd9e00d0510 0x7fd9e00d0940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35000/0 (socket says 172.21.15.112:35000) 2024-09-12T02:42:24.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.420+0000 7fd9de800640 1 -- 172.21.15.112:0/2404351146 learned_addr learned my addr 172.21.15.112:0/2404351146 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:24.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.421+0000 7fd9dde00640 1 --2- 172.21.15.112:0/2404351146 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9e0162100 0x7fd9e00d58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:24.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.421+0000 7fd9dd400640 1 --2- 172.21.15.112:0/2404351146 >> v2:172.21.15.137:3300/0 conn(0x7fd9e01624e0 0x7fd9e00b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:24.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.421+0000 7fd9dca00640 1 -- 172.21.15.112:0/2404351146 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1906224518 0 0) 0x7fd9e00cfa70 con 0x7fd9e00d0510 2024-09-12T02:42:24.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.421+0000 7fd9dca00640 1 -- 172.21.15.112:0/2404351146 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9c4003520 con 0x7fd9e00d0510 2024-09-12T02:42:24.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.421+0000 7fd9dde00640 1 -- 172.21.15.112:0/2404351146 >> v2:172.21.15.137:3300/0 conn(0x7fd9e01624e0 msgr2=0x7fd9e00b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:24.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.421+0000 7fd9dde00640 1 --2- 172.21.15.112:0/2404351146 >> v2:172.21.15.137:3300/0 conn(0x7fd9e01624e0 0x7fd9e00b4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:24.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.421+0000 7fd9dde00640 1 -- 172.21.15.112:0/2404351146 >> v1:172.21.15.112:6789/0 conn(0x7fd9e00d0510 legacy=0x7fd9e00d0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:24.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.421+0000 7fd9dde00640 1 -- 172.21.15.112:0/2404351146 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e00cfd10 con 0x7fd9e0162100 2024-09-12T02:42:24.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.422+0000 7fd9dde00640 1 --2- 172.21.15.112:0/2404351146 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9e0162100 0x7fd9e00d58d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd9e00cfc40 tx=0x7fd9d002a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e14ffc6a8f4d2f89 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:24.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.422+0000 7fd9dca00640 1 -- 172.21.15.112:0/2404351146 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d0037070 con 0x7fd9e0162100 2024-09-12T02:42:24.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.422+0000 7fd9dca00640 1 -- 172.21.15.112:0/2404351146 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9d002ae40 con 0x7fd9e0162100 2024-09-12T02:42:24.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.423+0000 7fd9dca00640 1 -- 172.21.15.112:0/2404351146 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d0032640 con 0x7fd9e0162100 2024-09-12T02:42:24.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.423+0000 7fd9e4e00640 1 -- 172.21.15.112:0/2404351146 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9e0162100 msgr2=0x7fd9e00d58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:24.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.423+0000 7fd9e4e00640 1 --2- 172.21.15.112:0/2404351146 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9e0162100 0x7fd9e00d58d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd9e00cfc40 tx=0x7fd9d002a0f0 comp rx=0 tx=0).stop 2024-09-12T02:42:24.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.423+0000 7fd9e4e00640 1 -- 172.21.15.112:0/2404351146 shutdown_connections 2024-09-12T02:42:24.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.423+0000 7fd9e4e00640 1 --2- 172.21.15.112:0/2404351146 >> v2:172.21.15.137:3300/0 conn(0x7fd9e01624e0 0x7fd9e00b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:24.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.423+0000 7fd9e4e00640 1 --2- 172.21.15.112:0/2404351146 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9e0162100 0x7fd9e00d58d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:24.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.423+0000 7fd9e4e00640 1 -- 172.21.15.112:0/2404351146 >> 172.21.15.112:0/2404351146 conn(0x7fd9e00d4db0 msgr2=0x7fd9e00d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:24.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.423+0000 7fd9e4e00640 1 -- 172.21.15.112:0/2404351146 shutdown_connections 2024-09-12T02:42:24.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.423+0000 7fd9e4e00640 1 -- 172.21.15.112:0/2404351146 wait complete. 2024-09-12T02:42:24.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.425+0000 7fd9e4e00640 1 Processor -- start 2024-09-12T02:42:24.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.425+0000 7fd9e4e00640 1 -- start start 2024-09-12T02:42:24.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.425+0000 7fd9e4e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9e00d0510 0x7fd9e01f42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:24.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.426+0000 7fd9e4e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9e0162100 0x7fd9e00cb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:24.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.426+0000 7fd9e4e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9e01624e0 0x7fd9e00cd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:24.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.426+0000 7fd9e4e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e00d1f70 con 0x7fd9e01624e0 2024-09-12T02:42:24.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.426+0000 7fd9e4e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e00d1df0 con 0x7fd9e00d0510 2024-09-12T02:42:24.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.426+0000 7fd9e4e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd9e0162b80 con 0x7fd9e0162100 2024-09-12T02:42:24.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.426+0000 7fd9de800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9e01624e0 0x7fd9e00cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:24.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.426+0000 7fd9de800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9e01624e0 0x7fd9e00cd890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52594/0 (socket says 172.21.15.112:52594) 2024-09-12T02:42:24.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.426+0000 7fd9de800640 1 -- 172.21.15.112:0/3934440735 learned_addr learned my addr 172.21.15.112:0/3934440735 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:24.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.426+0000 7fd9dde00640 1 --2- 172.21.15.112:0/3934440735 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9e00d0510 0x7fd9e01f42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:24.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.426+0000 7fd9dd400640 1 --2- 172.21.15.112:0/3934440735 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9e0162100 0x7fd9e00cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:24.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.426+0000 7fd9de800640 1 -- 172.21.15.112:0/3934440735 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9e0162100 msgr2=0x7fd9e00cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:24.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.426+0000 7fd9de800640 1 --2- 172.21.15.112:0/3934440735 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9e0162100 0x7fd9e00cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:24.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.426+0000 7fd9de800640 1 -- 172.21.15.112:0/3934440735 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9e00d0510 msgr2=0x7fd9e01f42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:24.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.426+0000 7fd9de800640 1 --2- 172.21.15.112:0/3934440735 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9e00d0510 0x7fd9e01f42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:24.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.426+0000 7fd9de800640 1 -- 172.21.15.112:0/3934440735 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e00c88e0 con 0x7fd9e01624e0 2024-09-12T02:42:24.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.427+0000 7fd9de800640 1 --2- 172.21.15.112:0/3934440735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9e01624e0 0x7fd9e00cd890 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd9d800ca20 tx=0x7fd9d800cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:24.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.427+0000 7fd9d6000640 1 -- 172.21.15.112:0/3934440735 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d8017070 con 0x7fd9e01624e0 2024-09-12T02:42:24.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.427+0000 7fd9d6000640 1 -- 172.21.15.112:0/3934440735 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9d800ab70 con 0x7fd9e01624e0 2024-09-12T02:42:24.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.427+0000 7fd9e4e00640 1 -- 172.21.15.112:0/3934440735 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9e01f4800 con 0x7fd9e01624e0 2024-09-12T02:42:24.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.427+0000 7fd9d6000640 1 -- 172.21.15.112:0/3934440735 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d8012400 con 0x7fd9e01624e0 2024-09-12T02:42:24.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.427+0000 7fd9e4e00640 1 -- 172.21.15.112:0/3934440735 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9e00cecd0 con 0x7fd9e01624e0 2024-09-12T02:42:24.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.428+0000 7fd9e4e00640 1 -- 172.21.15.112:0/3934440735 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9e00d58d0 con 0x7fd9e01624e0 2024-09-12T02:42:24.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.429+0000 7fd9d6000640 1 -- 172.21.15.112:0/3934440735 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd9d801a070 con 0x7fd9e01624e0 2024-09-12T02:42:24.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.430+0000 7fd9d6000640 1 --2- 172.21.15.112:0/3934440735 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd9c006be30 0x7fd9c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:24.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.430+0000 7fd9d6000640 1 -- 172.21.15.112:0/3934440735 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd9d808ab50 con 0x7fd9e01624e0 2024-09-12T02:42:24.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.430+0000 7fd9dde00640 1 --2- 172.21.15.112:0/3934440735 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd9c006be30 0x7fd9c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:24.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.431+0000 7fd9dde00640 1 --2- 172.21.15.112:0/3934440735 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd9c006be30 0x7fd9c006e2f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0034000 tx=0x7fd9d002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:24.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.434+0000 7fd9d6000640 1 -- 172.21.15.112:0/3934440735 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd9d80594f0 con 0x7fd9e01624e0 2024-09-12T02:42:24.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.606+0000 7fd9e4e00640 1 -- 172.21.15.112:0/3934440735 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd9e00c8ab0 con 0x7fd9e01624e0 2024-09-12T02:42:24.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.610+0000 7fd9d6000640 1 -- 172.21.15.112:0/3934440735 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) ==== 122+0+0 (secure 0 0 0) 0x7fd9d8058df0 con 0x7fd9e01624e0 2024-09-12T02:42:24.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.612+0000 7fd9e4e00640 1 -- 172.21.15.112:0/3934440735 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd9c006be30 msgr2=0x7fd9c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:24.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.612+0000 7fd9e4e00640 1 --2- 172.21.15.112:0/3934440735 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd9c006be30 0x7fd9c006e2f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0034000 tx=0x7fd9d002e000 comp rx=0 tx=0).stop 2024-09-12T02:42:24.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.612+0000 7fd9e4e00640 1 -- 172.21.15.112:0/3934440735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9e01624e0 msgr2=0x7fd9e00cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:24.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.612+0000 7fd9e4e00640 1 --2- 172.21.15.112:0/3934440735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9e01624e0 0x7fd9e00cd890 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd9d800ca20 tx=0x7fd9d800cee0 comp rx=0 tx=0).stop 2024-09-12T02:42:24.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.612+0000 7fd9e4e00640 1 -- 172.21.15.112:0/3934440735 shutdown_connections 2024-09-12T02:42:24.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.612+0000 7fd9e4e00640 1 --2- 172.21.15.112:0/3934440735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9e01624e0 0x7fd9e00cd890 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:24.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.612+0000 7fd9e4e00640 1 --2- 172.21.15.112:0/3934440735 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9e0162100 0x7fd9e00cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:24.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.612+0000 7fd9e4e00640 1 --2- 172.21.15.112:0/3934440735 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd9c006be30 0x7fd9c006e2f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:24.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.612+0000 7fd9e4e00640 1 --2- 172.21.15.112:0/3934440735 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9e00d0510 0x7fd9e01f42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:24.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.612+0000 7fd9e4e00640 1 -- 172.21.15.112:0/3934440735 >> 172.21.15.112:0/3934440735 conn(0x7fd9e00d4db0 msgr2=0x7fd9e00b9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:24.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.613+0000 7fd9e4e00640 1 -- 172.21.15.112:0/3934440735 shutdown_connections 2024-09-12T02:42:24.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:24.613+0000 7fd9e4e00640 1 -- 172.21.15.112:0/3934440735 wait complete. 2024-09-12T02:42:24.629 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:42:24.629 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:42:24.717 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:42:24.804 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:42:24.804 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:42:24.804 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:42:24.840 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:42:24.840 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:42:24.915 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:42:24.915 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:42:24.991 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:42:25.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.184+0000 7fa24b200640 1 Processor -- start 2024-09-12T02:42:25.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.184+0000 7fa24b200640 1 -- start start 2024-09-12T02:42:25.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.187+0000 7fa24b200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa24415b9d0 0x7fa2440b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.187+0000 7fa24b200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa24406f600 0x7fa2440728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.187+0000 7fa24b200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2440b54a0 con 0x7fa2440b45d0 2024-09-12T02:42:25.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.187+0000 7fa24b200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa2440b4a60 con 0x7fa24415b9d0 2024-09-12T02:42:25.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.187+0000 7fa24b200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa2440b3af0 con 0x7fa24406f600 2024-09-12T02:42:25.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.187+0000 7fa23b400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa2440b45d0 0x7fa24406eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35004/0 (socket says 172.21.15.112:35004) 2024-09-12T02:42:25.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.187+0000 7fa23b400640 1 -- 172.21.15.112:0/1359015725 learned_addr learned my addr 172.21.15.112:0/1359015725 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:25.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.187+0000 7fa243e00640 1 --2- 172.21.15.112:0/1359015725 >> v2:172.21.15.137:3300/0 conn(0x7fa24415b9d0 0x7fa2440b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.187+0000 7fa243400640 1 -- 172.21.15.112:0/1359015725 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1997191707 0 0) 0x7fa2440b54a0 con 0x7fa2440b45d0 2024-09-12T02:42:25.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.187+0000 7fa249200640 1 --2- 172.21.15.112:0/1359015725 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa24406f600 0x7fa2440728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.187+0000 7fa243400640 1 -- 172.21.15.112:0/1359015725 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa228005730 con 0x7fa2440b45d0 2024-09-12T02:42:25.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.187+0000 7fa243400640 1 -- 172.21.15.112:0/1359015725 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1700695273 0 0) 0x7fa228005730 con 0x7fa2440b45d0 2024-09-12T02:42:25.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.187+0000 7fa243400640 1 -- 172.21.15.112:0/1359015725 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa24406f600 msgr2=0x7fa2440728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:25.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.187+0000 7fa243400640 1 --2- 172.21.15.112:0/1359015725 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa24406f600 0x7fa2440728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.187+0000 7fa243400640 1 -- 172.21.15.112:0/1359015725 >> v2:172.21.15.137:3300/0 conn(0x7fa24415b9d0 msgr2=0x7fa2440b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:25.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.187+0000 7fa243400640 1 --2- 172.21.15.112:0/1359015725 >> v2:172.21.15.137:3300/0 conn(0x7fa24415b9d0 0x7fa2440b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.187+0000 7fa243400640 1 -- 172.21.15.112:0/1359015725 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2440b3dd0 con 0x7fa2440b45d0 2024-09-12T02:42:25.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.187+0000 7fa243400640 1 -- 172.21.15.112:0/1359015725 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7fa22c0017f0 con 0x7fa2440b45d0 2024-09-12T02:42:25.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.187+0000 7fa243400640 1 -- 172.21.15.112:0/1359015725 >> v1:172.21.15.112:6789/0 conn(0x7fa2440b45d0 legacy=0x7fa24406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:25.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.187+0000 7fa243400640 1 --2- 172.21.15.112:0/1359015725 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa24406f600 0x7fa228005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.187+0000 7fa243400640 1 --2- 172.21.15.112:0/1359015725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa228006140 0x7fa228006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.187+0000 7fa243400640 1 --2- 172.21.15.112:0/1359015725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa228006f50 0x7fa2280073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.187+0000 7fa243400640 1 -- 172.21.15.112:0/1359015725 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa2440b3af0 con 0x7fa228006f50 2024-09-12T02:42:25.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.187+0000 7fa243400640 1 -- 172.21.15.112:0/1359015725 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa228003520 con 0x7fa228006140 2024-09-12T02:42:25.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.187+0000 7fa243400640 1 -- 172.21.15.112:0/1359015725 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa228003720 con 0x7fa24406f600 2024-09-12T02:42:25.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.187+0000 7fa249200640 1 --2- 172.21.15.112:0/1359015725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa228006f50 0x7fa2280073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.187+0000 7fa243e00640 1 --2- 172.21.15.112:0/1359015725 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa24406f600 0x7fa228005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.188+0000 7fa249200640 1 -- 172.21.15.112:0/1359015725 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa24406f600 msgr2=0x7fa228005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:25.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.188+0000 7fa249200640 1 --2- 172.21.15.112:0/1359015725 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa24406f600 0x7fa228005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.188+0000 7fa23b400640 1 --2- 172.21.15.112:0/1359015725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa228006140 0x7fa228006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.188+0000 7fa249200640 1 -- 172.21.15.112:0/1359015725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa228006140 msgr2=0x7fa228006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:25.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.188+0000 7fa249200640 1 --2- 172.21.15.112:0/1359015725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa228006140 0x7fa228006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.188+0000 7fa249200640 1 -- 172.21.15.112:0/1359015725 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa228005730 con 0x7fa228006f50 2024-09-12T02:42:25.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.188+0000 7fa23b400640 1 --2- 172.21.15.112:0/1359015725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa228006140 0x7fa228006a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:42:25.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.189+0000 7fa249200640 1 --2- 172.21.15.112:0/1359015725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa228006f50 0x7fa2280073d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa23c009f90 tx=0x7fa228007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a17ce7c39beca0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:25.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.189+0000 7fa243400640 1 -- 172.21.15.112:0/1359015725 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23c009c10 con 0x7fa228006f50 2024-09-12T02:42:25.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.189+0000 7fa243400640 1 -- 172.21.15.112:0/1359015725 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa23c036070 con 0x7fa228006f50 2024-09-12T02:42:25.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.189+0000 7fa243400640 1 -- 172.21.15.112:0/1359015725 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23c031810 con 0x7fa228006f50 2024-09-12T02:42:25.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.189+0000 7fa24b200640 1 -- 172.21.15.112:0/1359015725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa228006f50 msgr2=0x7fa2280073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:25.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.189+0000 7fa24b200640 1 --2- 172.21.15.112:0/1359015725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa228006f50 0x7fa2280073d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa23c009f90 tx=0x7fa228007a40 comp rx=0 tx=0).stop 2024-09-12T02:42:25.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.189+0000 7fa249200640 1 -- 172.21.15.112:0/1359015725 reap_dead start 2024-09-12T02:42:25.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.189+0000 7fa24b200640 1 -- 172.21.15.112:0/1359015725 shutdown_connections 2024-09-12T02:42:25.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.189+0000 7fa24b200640 1 -- 172.21.15.112:0/1359015725 >> 172.21.15.112:0/1359015725 conn(0x7fa24406bbd0 msgr2=0x7fa24406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:25.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.189+0000 7fa24b200640 1 -- 172.21.15.112:0/1359015725 shutdown_connections 2024-09-12T02:42:25.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.190+0000 7fa24b200640 1 -- 172.21.15.112:0/1359015725 wait complete. 2024-09-12T02:42:25.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.191+0000 7fa24b200640 1 Processor -- start 2024-09-12T02:42:25.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.191+0000 7fa24b200640 1 -- start start 2024-09-12T02:42:25.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.192+0000 7fa24b200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa228006f50 0x7fa24415d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.192+0000 7fa24b200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2441473b0 0x7fa24415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.192+0000 7fa24b200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2440b0550 0x7fa2440b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.192+0000 7fa24b200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa24415bf30 con 0x7fa228006f50 2024-09-12T02:42:25.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.192+0000 7fa24b200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa24415bdb0 con 0x7fa2441473b0 2024-09-12T02:42:25.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.192+0000 7fa24b200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa2440728c0 con 0x7fa2440b0550 2024-09-12T02:42:25.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.192+0000 7fa243e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa228006f50 0x7fa24415d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.192+0000 7fa243e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa228006f50 0x7fa24415d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52602/0 (socket says 172.21.15.112:52602) 2024-09-12T02:42:25.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.192+0000 7fa243e00640 1 -- 172.21.15.112:0/1738698465 learned_addr learned my addr 172.21.15.112:0/1738698465 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:25.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.193+0000 7fa23b400640 1 --2- 172.21.15.112:0/1738698465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2441473b0 0x7fa24415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.193+0000 7fa249200640 1 --2- 172.21.15.112:0/1738698465 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2440b0550 0x7fa2440b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.193+0000 7fa243e00640 1 -- 172.21.15.112:0/1738698465 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2440b0550 msgr2=0x7fa2440b09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:25.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.193+0000 7fa243e00640 1 --2- 172.21.15.112:0/1738698465 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2440b0550 0x7fa2440b09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.193+0000 7fa243e00640 1 -- 172.21.15.112:0/1738698465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2441473b0 msgr2=0x7fa24415eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:25.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.193+0000 7fa243e00640 1 --2- 172.21.15.112:0/1738698465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2441473b0 0x7fa24415eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.193+0000 7fa243e00640 1 -- 172.21.15.112:0/1738698465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2441f4200 con 0x7fa228006f50 2024-09-12T02:42:25.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.193+0000 7fa23b400640 1 --2- 172.21.15.112:0/1738698465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2441473b0 0x7fa24415eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:25.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.193+0000 7fa243e00640 1 --2- 172.21.15.112:0/1738698465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa228006f50 0x7fa24415d270 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa234011aa0 tx=0x7fa234011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:25.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.193+0000 7fa240c00640 1 -- 172.21.15.112:0/1738698465 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23400fb80 con 0x7fa228006f50 2024-09-12T02:42:25.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.193+0000 7fa240c00640 1 -- 172.21.15.112:0/1738698465 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa23400fd20 con 0x7fa228006f50 2024-09-12T02:42:25.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.193+0000 7fa240c00640 1 -- 172.21.15.112:0/1738698465 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa234014660 con 0x7fa228006f50 2024-09-12T02:42:25.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.193+0000 7fa24b200640 1 -- 172.21.15.112:0/1738698465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2441f44e0 con 0x7fa228006f50 2024-09-12T02:42:25.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.193+0000 7fa24b200640 1 -- 172.21.15.112:0/1738698465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2441f4aa0 con 0x7fa228006f50 2024-09-12T02:42:25.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.194+0000 7fa24b200640 1 -- 172.21.15.112:0/1738698465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa244068a30 con 0x7fa228006f50 2024-09-12T02:42:25.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.195+0000 7fa240c00640 1 -- 172.21.15.112:0/1738698465 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa234012040 con 0x7fa228006f50 2024-09-12T02:42:25.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.196+0000 7fa240c00640 1 --2- 172.21.15.112:0/1738698465 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa22006be30 0x7fa22006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.196+0000 7fa240c00640 1 -- 172.21.15.112:0/1738698465 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa23408b630 con 0x7fa228006f50 2024-09-12T02:42:25.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.196+0000 7fa23b400640 1 --2- 172.21.15.112:0/1738698465 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa22006be30 0x7fa22006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.197+0000 7fa23b400640 1 --2- 172.21.15.112:0/1738698465 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa22006be30 0x7fa22006e2f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa22c0011d0 tx=0x7fa22c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:25.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.202+0000 7fa240c00640 1 -- 172.21.15.112:0/1738698465 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa234019030 con 0x7fa228006f50 2024-09-12T02:42:25.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.384+0000 7fa24b200640 1 -- 172.21.15.112:0/1738698465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa24406dbc0 con 0x7fa228006f50 2024-09-12T02:42:25.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.385+0000 7fa240c00640 1 -- 172.21.15.112:0/1738698465 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fa234059fd0 con 0x7fa228006f50 2024-09-12T02:42:25.386 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-12T02:42:25.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.387+0000 7fa24b200640 1 -- 172.21.15.112:0/1738698465 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa22006be30 msgr2=0x7fa22006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:25.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.387+0000 7fa24b200640 1 --2- 172.21.15.112:0/1738698465 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa22006be30 0x7fa22006e2f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa22c0011d0 tx=0x7fa22c009040 comp rx=0 tx=0).stop 2024-09-12T02:42:25.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.387+0000 7fa24b200640 1 -- 172.21.15.112:0/1738698465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa228006f50 msgr2=0x7fa24415d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:25.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.387+0000 7fa24b200640 1 --2- 172.21.15.112:0/1738698465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa228006f50 0x7fa24415d270 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa234011aa0 tx=0x7fa234011f60 comp rx=0 tx=0).stop 2024-09-12T02:42:25.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.387+0000 7fa24b200640 1 -- 172.21.15.112:0/1738698465 shutdown_connections 2024-09-12T02:42:25.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.387+0000 7fa24b200640 1 --2- 172.21.15.112:0/1738698465 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2440b0550 0x7fa2440b09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.387+0000 7fa24b200640 1 --2- 172.21.15.112:0/1738698465 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa22006be30 0x7fa22006e2f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.387+0000 7fa24b200640 1 --2- 172.21.15.112:0/1738698465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2441473b0 0x7fa24415eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.387+0000 7fa24b200640 1 --2- 172.21.15.112:0/1738698465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa228006f50 0x7fa24415d270 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.387+0000 7fa24b200640 1 -- 172.21.15.112:0/1738698465 >> 172.21.15.112:0/1738698465 conn(0x7fa24406bbd0 msgr2=0x7fa2440b56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:25.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.387+0000 7fa24b200640 1 -- 172.21.15.112:0/1738698465 shutdown_connections 2024-09-12T02:42:25.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.387+0000 7fa24b200640 1 -- 172.21.15.112:0/1738698465 wait complete. 2024-09-12T02:42:25.404 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:42:25.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:25.404 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-12T02:42:25.466 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-12T02:42:25.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:25.466 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:42:25.509 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:42:25.510 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:42:25.549 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:42:25.549 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:42:25.628 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:42:25.628 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:42:25.706 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:42:25.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.862+0000 7f4b5e800640 1 Processor -- start 2024-09-12T02:42:25.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.862+0000 7f4b5e800640 1 -- start start 2024-09-12T02:42:25.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.864+0000 7f4b5e800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4b580b4ec0 0x7f4b580b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.864+0000 7f4b5e800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b580b54a0 con 0x7f4b5815b9d0 2024-09-12T02:42:25.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.864+0000 7f4b5e800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b580b3af0 con 0x7f4b5806f600 2024-09-12T02:42:25.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.864+0000 7f4b5e800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4b580b3dd0 con 0x7f4b580b4ec0 2024-09-12T02:42:25.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.864+0000 7f4b57400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f4b5815b9d0 0x7f4b5806eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35012/0 (socket says 172.21.15.112:35012) 2024-09-12T02:42:25.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.864+0000 7f4b57400640 1 -- 172.21.15.112:0/2453358452 learned_addr learned my addr 172.21.15.112:0/2453358452 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:25.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.864+0000 7f4b57e00640 1 --2- 172.21.15.112:0/2453358452 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4b580b4ec0 0x7f4b580b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.864+0000 7f4b56a00640 1 -- 172.21.15.112:0/2453358452 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1761302177 0 0) 0x7f4b580b54a0 con 0x7f4b5815b9d0 2024-09-12T02:42:25.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.864+0000 7f4b56a00640 1 -- 172.21.15.112:0/2453358452 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b3c005730 con 0x7f4b5815b9d0 2024-09-12T02:42:25.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.865+0000 7f4b56a00640 1 -- 172.21.15.112:0/2453358452 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 655814416 0 0) 0x7f4b580b3af0 con 0x7f4b5806f600 2024-09-12T02:42:25.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.865+0000 7f4b56a00640 1 -- 172.21.15.112:0/2453358452 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b580b54a0 con 0x7f4b5806f600 2024-09-12T02:42:25.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.865+0000 7f4b56a00640 1 -- 172.21.15.112:0/2453358452 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4134575293 0 0) 0x7f4b3c005730 con 0x7f4b5815b9d0 2024-09-12T02:42:25.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.865+0000 7f4b56a00640 1 -- 172.21.15.112:0/2453358452 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4b580b4ec0 msgr2=0x7f4b580b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:25.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.865+0000 7f4b56a00640 1 --2- 172.21.15.112:0/2453358452 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4b580b4ec0 0x7f4b580b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.865+0000 7f4b56a00640 1 -- 172.21.15.112:0/2453358452 >> v1:172.21.15.137:6789/0 conn(0x7f4b5806f600 legacy=0x7f4b580cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:25.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.865+0000 7f4b56a00640 1 -- 172.21.15.112:0/2453358452 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b580b40b0 con 0x7f4b5815b9d0 2024-09-12T02:42:25.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.865+0000 7f4b56a00640 1 -- 172.21.15.112:0/2453358452 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f4b48001670 con 0x7f4b5815b9d0 2024-09-12T02:42:25.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.865+0000 7f4b56a00640 1 -- 172.21.15.112:0/2453358452 >> v1:172.21.15.112:6789/0 conn(0x7f4b5815b9d0 legacy=0x7f4b5806eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:25.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.865+0000 7f4b56a00640 1 --2- 172.21.15.112:0/2453358452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b3c005d80 0x7f4b3c006180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.865+0000 7f4b56a00640 1 --2- 172.21.15.112:0/2453358452 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4b580b4ec0 0x7f4b3c006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.865+0000 7f4b56a00640 1 --2- 172.21.15.112:0/2453358452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b3c006f50 0x7f4b3c0073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.865+0000 7f4b56a00640 1 -- 172.21.15.112:0/2453358452 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4b580b3dd0 con 0x7f4b3c005d80 2024-09-12T02:42:25.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.865+0000 7f4b56a00640 1 -- 172.21.15.112:0/2453358452 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c00dc80 con 0x7f4b3c006f50 2024-09-12T02:42:25.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.865+0000 7f4b56a00640 1 -- 172.21.15.112:0/2453358452 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4b3c00de80 con 0x7f4b580b4ec0 2024-09-12T02:42:25.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.865+0000 7f4b57400640 1 --2- 172.21.15.112:0/2453358452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b3c005d80 0x7f4b3c006180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.865+0000 7f4b4ea00640 1 --2- 172.21.15.112:0/2453358452 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4b580b4ec0 0x7f4b3c006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.865+0000 7f4b57e00640 1 --2- 172.21.15.112:0/2453358452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b3c006f50 0x7f4b3c0073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.866+0000 7f4b57400640 1 -- 172.21.15.112:0/2453358452 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4b580b4ec0 msgr2=0x7f4b3c006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:25.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.866+0000 7f4b57400640 1 --2- 172.21.15.112:0/2453358452 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4b580b4ec0 0x7f4b3c006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.866+0000 7f4b57400640 1 -- 172.21.15.112:0/2453358452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b3c006f50 msgr2=0x7f4b3c0073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:25.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.866+0000 7f4b57400640 1 --2- 172.21.15.112:0/2453358452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b3c006f50 0x7f4b3c0073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.866+0000 7f4b57400640 1 -- 172.21.15.112:0/2453358452 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b3c005730 con 0x7f4b3c005d80 2024-09-12T02:42:25.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.866+0000 7f4b57400640 1 --2- 172.21.15.112:0/2453358452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b3c005d80 0x7f4b3c006180 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4b48007fc0 tx=0x7f4b3c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fcb81c7b43ef935 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:25.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.867+0000 7f4b56a00640 1 -- 172.21.15.112:0/2453358452 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b48007be0 con 0x7f4b3c005d80 2024-09-12T02:42:25.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.867+0000 7f4b56a00640 1 -- 172.21.15.112:0/2453358452 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b48005ad0 con 0x7f4b3c005d80 2024-09-12T02:42:25.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.867+0000 7f4b56a00640 1 -- 172.21.15.112:0/2453358452 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b48007070 con 0x7f4b3c005d80 2024-09-12T02:42:25.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.867+0000 7f4b5e800640 1 -- 172.21.15.112:0/2453358452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b3c005d80 msgr2=0x7f4b3c006180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:25.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.867+0000 7f4b5e800640 1 --2- 172.21.15.112:0/2453358452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b3c005d80 0x7f4b3c006180 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4b48007fc0 tx=0x7f4b3c007a40 comp rx=0 tx=0).stop 2024-09-12T02:42:25.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.867+0000 7f4b57e00640 1 -- 172.21.15.112:0/2453358452 reap_dead start 2024-09-12T02:42:25.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.867+0000 7f4b5e800640 1 -- 172.21.15.112:0/2453358452 shutdown_connections 2024-09-12T02:42:25.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.867+0000 7f4b5e800640 1 -- 172.21.15.112:0/2453358452 >> 172.21.15.112:0/2453358452 conn(0x7f4b5806bbd0 msgr2=0x7f4b5806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:25.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.867+0000 7f4b5e800640 1 -- 172.21.15.112:0/2453358452 shutdown_connections 2024-09-12T02:42:25.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.867+0000 7f4b5e800640 1 -- 172.21.15.112:0/2453358452 wait complete. 2024-09-12T02:42:25.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.869+0000 7f4b5e800640 1 Processor -- start 2024-09-12T02:42:25.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.869+0000 7f4b5e800640 1 -- start start 2024-09-12T02:42:25.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.870+0000 7f4b5e800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b3c005d80 0x7f4b5815dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.870+0000 7f4b5e800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b580cc400 0x7f4b580c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.870+0000 7f4b5e800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4b58150ca0 0x7f4b58151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.870+0000 7f4b5e800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4b580b4750 con 0x7f4b580cc400 2024-09-12T02:42:25.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.870+0000 7f4b5e800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4b580b45d0 con 0x7f4b3c005d80 2024-09-12T02:42:25.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.870+0000 7f4b5e800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4b580b48d0 con 0x7f4b58150ca0 2024-09-12T02:42:25.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.870+0000 7f4b4ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b580cc400 0x7f4b580c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.870+0000 7f4b4ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b580cc400 0x7f4b580c6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52618/0 (socket says 172.21.15.112:52618) 2024-09-12T02:42:25.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.870+0000 7f4b4ea00640 1 -- 172.21.15.112:0/583491538 learned_addr learned my addr 172.21.15.112:0/583491538 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:25.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.870+0000 7f4b57400640 1 --2- 172.21.15.112:0/583491538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b3c005d80 0x7f4b5815dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.870+0000 7f4b57e00640 1 --2- 172.21.15.112:0/583491538 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4b58150ca0 0x7f4b58151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.871+0000 7f4b4ea00640 1 -- 172.21.15.112:0/583491538 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4b58150ca0 msgr2=0x7f4b58151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:25.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.871+0000 7f4b4ea00640 1 --2- 172.21.15.112:0/583491538 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4b58150ca0 0x7f4b58151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.871+0000 7f4b4ea00640 1 -- 172.21.15.112:0/583491538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b3c005d80 msgr2=0x7f4b5815dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:25.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.871+0000 7f4b4ea00640 1 --2- 172.21.15.112:0/583491538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b3c005d80 0x7f4b5815dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:25.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.871+0000 7f4b4ea00640 1 -- 172.21.15.112:0/583491538 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b580cc860 con 0x7f4b580cc400 2024-09-12T02:42:25.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.871+0000 7f4b4ea00640 1 --2- 172.21.15.112:0/583491538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b580cc400 0x7f4b580c6f60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4b4000f730 tx=0x7f4b4000fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:25.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.871+0000 7f4b4fe00640 1 -- 172.21.15.112:0/583491538 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4000fe40 con 0x7f4b580cc400 2024-09-12T02:42:25.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.871+0000 7f4b4fe00640 1 -- 172.21.15.112:0/583491538 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b40018070 con 0x7f4b580cc400 2024-09-12T02:42:25.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.871+0000 7f4b5e800640 1 -- 172.21.15.112:0/583491538 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b5814d3f0 con 0x7f4b580cc400 2024-09-12T02:42:25.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.871+0000 7f4b4fe00640 1 -- 172.21.15.112:0/583491538 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4000d6d0 con 0x7f4b580cc400 2024-09-12T02:42:25.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.871+0000 7f4b5e800640 1 -- 172.21.15.112:0/583491538 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b5814d9b0 con 0x7f4b580cc400 2024-09-12T02:42:25.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.872+0000 7f4b5e800640 1 -- 172.21.15.112:0/583491538 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b58068a30 con 0x7f4b580cc400 2024-09-12T02:42:25.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.873+0000 7f4b4fe00640 1 -- 172.21.15.112:0/583491538 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4b4000d870 con 0x7f4b580cc400 2024-09-12T02:42:25.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.874+0000 7f4b4fe00640 1 --2- 172.21.15.112:0/583491538 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4b3406be30 0x7f4b3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:25.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.874+0000 7f4b4fe00640 1 -- 172.21.15.112:0/583491538 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4b4008ad00 con 0x7f4b580cc400 2024-09-12T02:42:25.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.874+0000 7f4b57400640 1 --2- 172.21.15.112:0/583491538 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4b3406be30 0x7f4b3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:25.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.875+0000 7f4b57400640 1 --2- 172.21.15.112:0/583491538 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4b3406be30 0x7f4b3406e2f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4b48032000 tx=0x7f4b48034040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:25.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:25.878+0000 7f4b4fe00640 1 -- 172.21.15.112:0/583491538 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4b40058fc0 con 0x7f4b580cc400 2024-09-12T02:42:26.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.063+0000 7f4b5e800640 1 -- 172.21.15.112:0/583491538 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4b580728c0 con 0x7f4b580cc400 2024-09-12T02:42:26.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.064+0000 7f4b4fe00640 1 -- 172.21.15.112:0/583491538 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f4b4005d2c0 con 0x7f4b580cc400 2024-09-12T02:42:26.064 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-12T02:42:26.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.066+0000 7f4b5e800640 1 -- 172.21.15.112:0/583491538 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4b3406be30 msgr2=0x7f4b3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:26.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.066+0000 7f4b5e800640 1 --2- 172.21.15.112:0/583491538 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4b3406be30 0x7f4b3406e2f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4b48032000 tx=0x7f4b48034040 comp rx=0 tx=0).stop 2024-09-12T02:42:26.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.066+0000 7f4b5e800640 1 -- 172.21.15.112:0/583491538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b580cc400 msgr2=0x7f4b580c6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:26.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.066+0000 7f4b5e800640 1 --2- 172.21.15.112:0/583491538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b580cc400 0x7f4b580c6f60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4b4000f730 tx=0x7f4b4000fbf0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.066+0000 7f4b5e800640 1 -- 172.21.15.112:0/583491538 shutdown_connections 2024-09-12T02:42:26.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.066+0000 7f4b5e800640 1 --2- 172.21.15.112:0/583491538 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4b58150ca0 0x7f4b58151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.066+0000 7f4b5e800640 1 --2- 172.21.15.112:0/583491538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b580cc400 0x7f4b580c6f60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.066+0000 7f4b5e800640 1 --2- 172.21.15.112:0/583491538 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4b3406be30 0x7f4b3406e2f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.066+0000 7f4b5e800640 1 --2- 172.21.15.112:0/583491538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b3c005d80 0x7f4b5815dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.066+0000 7f4b5e800640 1 -- 172.21.15.112:0/583491538 >> 172.21.15.112:0/583491538 conn(0x7f4b5806bbd0 msgr2=0x7f4b580b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:26.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.066+0000 7f4b5e800640 1 -- 172.21.15.112:0/583491538 shutdown_connections 2024-09-12T02:42:26.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.066+0000 7f4b5e800640 1 -- 172.21.15.112:0/583491538 wait complete. 2024-09-12T02:42:26.083 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-12T02:42:26.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:26.083 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-12T02:42:26.146 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T02:42:26.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:26.147 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T02:42:26.188 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:42:26.188 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:42:26.224 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:42:26.224 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:42:26.300 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:42:26.300 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:42:26.375 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:42:26.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.569+0000 7fb7fc800640 1 Processor -- start 2024-09-12T02:42:26.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.569+0000 7fb7fc800640 1 -- start start 2024-09-12T02:42:26.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.571+0000 7fb7fc800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb7f406d8c0 0x7fb7f40afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:26.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.571+0000 7fb7fc800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7f40aedd0 con 0x7fb7f406dca0 2024-09-12T02:42:26.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.571+0000 7fb7fc800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7f40af0b0 con 0x7fb7f40ae8d0 2024-09-12T02:42:26.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.571+0000 7fb7fc800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb7f40af390 con 0x7fb7f406d8c0 2024-09-12T02:42:26.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.571+0000 7fb7f9e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb7f406d8c0 0x7fb7f40afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:26.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.571+0000 7fb7fa800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb7f406dca0 0x7fb7f406e150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35014/0 (socket says 172.21.15.112:35014) 2024-09-12T02:42:26.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.571+0000 7fb7fa800640 1 -- 172.21.15.112:0/2813522441 learned_addr learned my addr 172.21.15.112:0/2813522441 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:26.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.571+0000 7fb7f9e00640 1 -- 172.21.15.112:0/2813522441 >> v1:172.21.15.137:6789/0 conn(0x7fb7f40ae8d0 legacy=0x7fb7f40715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:26.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.571+0000 7fb7f9e00640 1 -- 172.21.15.112:0/2813522441 >> v1:172.21.15.112:6789/0 conn(0x7fb7f406dca0 legacy=0x7fb7f406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:26.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.571+0000 7fb7f9e00640 1 -- 172.21.15.112:0/2813522441 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7f40af670 con 0x7fb7f406d8c0 2024-09-12T02:42:26.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.572+0000 7fb7f9e00640 1 --2- 172.21.15.112:0/2813522441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7f406d8c0 0x7fb7f40afe70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80097a0 tx=0x7fb7e802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85df8dbb98283f90 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:26.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.573+0000 7fb7f8a00640 1 -- 172.21.15.112:0/2813522441 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8037070 con 0x7fb7f406d8c0 2024-09-12T02:42:26.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.573+0000 7fb7f8a00640 1 -- 172.21.15.112:0/2813522441 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e8032440 con 0x7fb7f406d8c0 2024-09-12T02:42:26.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.573+0000 7fb7f8a00640 1 -- 172.21.15.112:0/2813522441 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8032810 con 0x7fb7f406d8c0 2024-09-12T02:42:26.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.573+0000 7fb7fc800640 1 -- 172.21.15.112:0/2813522441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7f406d8c0 msgr2=0x7fb7f40afe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:26.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.573+0000 7fb7fc800640 1 --2- 172.21.15.112:0/2813522441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7f406d8c0 0x7fb7f40afe70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80097a0 tx=0x7fb7e802a230 comp rx=0 tx=0).stop 2024-09-12T02:42:26.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.573+0000 7fb7fc800640 1 -- 172.21.15.112:0/2813522441 shutdown_connections 2024-09-12T02:42:26.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.573+0000 7fb7fc800640 1 --2- 172.21.15.112:0/2813522441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7f406d8c0 0x7fb7f40afe70 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.573+0000 7fb7fc800640 1 -- 172.21.15.112:0/2813522441 >> 172.21.15.112:0/2813522441 conn(0x7fb7f406bbd0 msgr2=0x7fb7f406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:26.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.573+0000 7fb7fc800640 1 -- 172.21.15.112:0/2813522441 shutdown_connections 2024-09-12T02:42:26.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.573+0000 7fb7fc800640 1 -- 172.21.15.112:0/2813522441 wait complete. 2024-09-12T02:42:26.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.575+0000 7fb7fc800640 1 Processor -- start 2024-09-12T02:42:26.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.575+0000 7fb7fc800640 1 -- start start 2024-09-12T02:42:26.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.576+0000 7fb7fc800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7f406d8c0 0x7fb7f41471f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:26.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.576+0000 7fb7fc800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7f406dca0 0x7fb7f40b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:26.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.576+0000 7fb7fc800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb7f40ae8d0 0x7fb7f4143b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:26.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.576+0000 7fb7fc800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f40b3a60 con 0x7fb7f406dca0 2024-09-12T02:42:26.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.576+0000 7fb7fc800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f40b38e0 con 0x7fb7f406d8c0 2024-09-12T02:42:26.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.576+0000 7fb7fc800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb7f40b3be0 con 0x7fb7f40ae8d0 2024-09-12T02:42:26.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.576+0000 7fb7f9400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7f406dca0 0x7fb7f40b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:26.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.576+0000 7fb7f9400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7f406dca0 0x7fb7f40b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52642/0 (socket says 172.21.15.112:52642) 2024-09-12T02:42:26.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.576+0000 7fb7f9400640 1 -- 172.21.15.112:0/2722892016 learned_addr learned my addr 172.21.15.112:0/2722892016 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:26.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.577+0000 7fb7f9e00640 1 --2- 172.21.15.112:0/2722892016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7f406d8c0 0x7fb7f41471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:26.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.577+0000 7fb7fa800640 1 --2- 172.21.15.112:0/2722892016 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb7f40ae8d0 0x7fb7f4143b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:26.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.577+0000 7fb7f9400640 1 -- 172.21.15.112:0/2722892016 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb7f40ae8d0 msgr2=0x7fb7f4143b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:26.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.577+0000 7fb7f9400640 1 --2- 172.21.15.112:0/2722892016 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb7f40ae8d0 0x7fb7f4143b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.577+0000 7fb7f9400640 1 -- 172.21.15.112:0/2722892016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7f406d8c0 msgr2=0x7fb7f41471f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:26.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.577+0000 7fb7f9400640 1 --2- 172.21.15.112:0/2722892016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7f406d8c0 0x7fb7f41471f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.577+0000 7fb7f9400640 1 -- 172.21.15.112:0/2722892016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7f4147730 con 0x7fb7f406dca0 2024-09-12T02:42:26.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.577+0000 7fb7f9e00640 1 --2- 172.21.15.112:0/2722892016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7f406d8c0 0x7fb7f41471f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:42:26.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.577+0000 7fb7fa800640 1 --2- 172.21.15.112:0/2722892016 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb7f40ae8d0 0x7fb7f4143b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:42:26.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.577+0000 7fb7f9400640 1 --2- 172.21.15.112:0/2722892016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7f406dca0 0x7fb7f40b1640 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400c3f0 tx=0x7fb7e400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:26.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.577+0000 7fb7ee000640 1 -- 172.21.15.112:0/2722892016 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e40052d0 con 0x7fb7f406dca0 2024-09-12T02:42:26.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.577+0000 7fb7ee000640 1 -- 172.21.15.112:0/2722892016 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e40054b0 con 0x7fb7f406dca0 2024-09-12T02:42:26.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.577+0000 7fb7ee000640 1 -- 172.21.15.112:0/2722892016 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4006a60 con 0x7fb7f406dca0 2024-09-12T02:42:26.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.577+0000 7fb7fc800640 1 -- 172.21.15.112:0/2722892016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7f41f8750 con 0x7fb7f406dca0 2024-09-12T02:42:26.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.577+0000 7fb7fc800640 1 -- 172.21.15.112:0/2722892016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7f41f8d10 con 0x7fb7f406dca0 2024-09-12T02:42:26.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.578+0000 7fb7fc800640 1 -- 172.21.15.112:0/2722892016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7f4068a30 con 0x7fb7f406dca0 2024-09-12T02:42:26.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.579+0000 7fb7ee000640 1 -- 172.21.15.112:0/2722892016 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb7e4006c00 con 0x7fb7f406dca0 2024-09-12T02:42:26.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.580+0000 7fb7ee000640 1 --2- 172.21.15.112:0/2722892016 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb7d806be30 0x7fb7d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:26.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.580+0000 7fb7ee000640 1 -- 172.21.15.112:0/2722892016 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb7e408a310 con 0x7fb7f406dca0 2024-09-12T02:42:26.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.580+0000 7fb7f9e00640 1 --2- 172.21.15.112:0/2722892016 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb7d806be30 0x7fb7d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:26.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.581+0000 7fb7f9e00640 1 --2- 172.21.15.112:0/2722892016 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb7d806be30 0x7fb7d806e2f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8034000 tx=0x7fb7e802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:26.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.585+0000 7fb7ee000640 1 -- 172.21.15.112:0/2722892016 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb7f4147730 con 0x7fb7f406dca0 2024-09-12T02:42:26.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.769+0000 7fb7fc800640 1 -- 172.21.15.112:0/2722892016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb7f40afe70 con 0x7fb7f406dca0 2024-09-12T02:42:26.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.769+0000 7fb7ee000640 1 -- 172.21.15.112:0/2722892016 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fb7e4058c20 con 0x7fb7f406dca0 2024-09-12T02:42:26.769 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-12T02:42:26.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.771+0000 7fb7fc800640 1 -- 172.21.15.112:0/2722892016 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb7d806be30 msgr2=0x7fb7d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:26.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.771+0000 7fb7fc800640 1 --2- 172.21.15.112:0/2722892016 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb7d806be30 0x7fb7d806e2f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8034000 tx=0x7fb7e802e000 comp rx=0 tx=0).stop 2024-09-12T02:42:26.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.771+0000 7fb7fc800640 1 -- 172.21.15.112:0/2722892016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7f406dca0 msgr2=0x7fb7f40b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:26.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.772+0000 7fb7fc800640 1 --2- 172.21.15.112:0/2722892016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7f406dca0 0x7fb7f40b1640 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400c3f0 tx=0x7fb7e400c8b0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.772+0000 7fb7fc800640 1 -- 172.21.15.112:0/2722892016 shutdown_connections 2024-09-12T02:42:26.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.772+0000 7fb7fc800640 1 --2- 172.21.15.112:0/2722892016 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb7f40ae8d0 0x7fb7f4143b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.772+0000 7fb7fc800640 1 --2- 172.21.15.112:0/2722892016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7f406dca0 0x7fb7f40b1640 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.772+0000 7fb7fc800640 1 --2- 172.21.15.112:0/2722892016 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb7d806be30 0x7fb7d806e2f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.772+0000 7fb7fc800640 1 --2- 172.21.15.112:0/2722892016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7f406d8c0 0x7fb7f41471f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.772+0000 7fb7fc800640 1 -- 172.21.15.112:0/2722892016 >> 172.21.15.112:0/2722892016 conn(0x7fb7f406bbd0 msgr2=0x7fb7f415e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:26.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.772+0000 7fb7fc800640 1 -- 172.21.15.112:0/2722892016 shutdown_connections 2024-09-12T02:42:26.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:26.772+0000 7fb7fc800640 1 -- 172.21.15.112:0/2722892016 wait complete. 2024-09-12T02:42:26.787 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-12T02:42:26.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:26.787 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-12T02:42:26.846 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-12T02:42:26.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:26.846 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-12T02:42:26.882 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:42:26.882 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:42:26.920 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:42:26.920 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:42:26.996 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:42:26.996 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:42:27.072 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:42:27.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.226+0000 7f71c3600640 1 Processor -- start 2024-09-12T02:42:27.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.226+0000 7f71c3600640 1 -- start start 2024-09-12T02:42:27.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.227+0000 7f71c3600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71bc15cc50 0x7f71bc0732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:27.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.227+0000 7f71c3600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f71bc0afe30 0x7f71bc0cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:27.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.227+0000 7f71c3600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71bc073830 con 0x7f71bc071530 2024-09-12T02:42:27.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.227+0000 7f71c3600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f71bc15d030 con 0x7f71bc0afe30 2024-09-12T02:42:27.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.227+0000 7f71c3600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f71bc0cf4c0 con 0x7f71bc15cc50 2024-09-12T02:42:27.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.228+0000 7f71c1600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f71bc0afe30 0x7f71bc0cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:27.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.228+0000 7f71c1600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f71bc0afe30 0x7f71bc0cf950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52650/0 (socket says 172.21.15.112:52650) 2024-09-12T02:42:27.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.228+0000 7f71c1600640 1 -- 172.21.15.112:0/2285043473 learned_addr learned my addr 172.21.15.112:0/2285043473 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:27.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.228+0000 7f71c0c00640 1 --2- 172.21.15.112:0/2285043473 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71bc15cc50 0x7f71bc0732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:27.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.228+0000 7f71c1600640 1 -- 172.21.15.112:0/2285043473 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71bc15cc50 msgr2=0x7f71bc0732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:27.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.228+0000 7f71c1600640 1 --2- 172.21.15.112:0/2285043473 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71bc15cc50 0x7f71bc0732f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:27.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.228+0000 7f71c1600640 1 -- 172.21.15.112:0/2285043473 >> v1:172.21.15.137:6789/0 conn(0x7f71bc071530 legacy=0x7f71bc0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:27.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.228+0000 7f71c1600640 1 -- 172.21.15.112:0/2285043473 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71bc0ceeb0 con 0x7f71bc0afe30 2024-09-12T02:42:27.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.229+0000 7f71c1600640 1 --2- 172.21.15.112:0/2285043473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71bc0afe30 0x7f71bc0cf950 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f71b4009e80 tx=0x7f71b402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe4e8e20b573cf88 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:27.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.229+0000 7f71bbe00640 1 -- 172.21.15.112:0/2285043473 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b4036070 con 0x7f71bc0afe30 2024-09-12T02:42:27.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.229+0000 7f71bbe00640 1 -- 172.21.15.112:0/2285043473 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b4031600 con 0x7f71bc0afe30 2024-09-12T02:42:27.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.229+0000 7f71bbe00640 1 -- 172.21.15.112:0/2285043473 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b40319d0 con 0x7f71bc0afe30 2024-09-12T02:42:27.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.230+0000 7f71c3600640 1 -- 172.21.15.112:0/2285043473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71bc0afe30 msgr2=0x7f71bc0cf950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:27.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.230+0000 7f71c3600640 1 --2- 172.21.15.112:0/2285043473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71bc0afe30 0x7f71bc0cf950 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f71b4009e80 tx=0x7f71b402a660 comp rx=0 tx=0).stop 2024-09-12T02:42:27.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.230+0000 7f71c3600640 1 -- 172.21.15.112:0/2285043473 shutdown_connections 2024-09-12T02:42:27.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.230+0000 7f71c3600640 1 --2- 172.21.15.112:0/2285043473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71bc0afe30 0x7f71bc0cf950 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:27.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.230+0000 7f71c3600640 1 --2- 172.21.15.112:0/2285043473 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71bc15cc50 0x7f71bc0732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:27.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.230+0000 7f71c3600640 1 -- 172.21.15.112:0/2285043473 >> 172.21.15.112:0/2285043473 conn(0x7f71bc06bbd0 msgr2=0x7f71bc06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:27.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.230+0000 7f71c3600640 1 -- 172.21.15.112:0/2285043473 shutdown_connections 2024-09-12T02:42:27.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.230+0000 7f71c3600640 1 -- 172.21.15.112:0/2285043473 wait complete. 2024-09-12T02:42:27.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.232+0000 7f71c3600640 1 Processor -- start 2024-09-12T02:42:27.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.232+0000 7f71c3600640 1 -- start start 2024-09-12T02:42:27.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.233+0000 7f71c3600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71bc071530 0x7f71bc1f4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:27.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.233+0000 7f71c3600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71bc0afe30 0x7f71bc140050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:27.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.233+0000 7f71c3600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71bc15cc50 0x7f71bc1519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:27.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.233+0000 7f71c3600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc0cf150 con 0x7f71bc0afe30 2024-09-12T02:42:27.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.233+0000 7f71c3600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc06e5e0 con 0x7f71bc15cc50 2024-09-12T02:42:27.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.233+0000 7f71c3600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f71bc06f510 con 0x7f71bc071530 2024-09-12T02:42:27.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.233+0000 7f71c0c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71bc071530 0x7f71bc1f4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:27.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.233+0000 7f71b3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71bc0afe30 0x7f71bc140050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:27.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.233+0000 7f71c0c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71bc071530 0x7f71bc1f4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:46432/0 (socket says 172.21.15.112:46432) 2024-09-12T02:42:27.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.233+0000 7f71c0c00640 1 -- 172.21.15.112:0/144629164 learned_addr learned my addr 172.21.15.112:0/144629164 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:27.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.233+0000 7f71c1600640 1 --2- 172.21.15.112:0/144629164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71bc15cc50 0x7f71bc1519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:27.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.233+0000 7f71c0c00640 1 -- 172.21.15.112:0/144629164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71bc15cc50 msgr2=0x7f71bc1519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:27.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.233+0000 7f71c0c00640 1 --2- 172.21.15.112:0/144629164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71bc15cc50 0x7f71bc1519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:27.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.233+0000 7f71c0c00640 1 -- 172.21.15.112:0/144629164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71bc0afe30 msgr2=0x7f71bc140050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:27.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.233+0000 7f71c0c00640 1 --2- 172.21.15.112:0/144629164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71bc0afe30 0x7f71bc140050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:27.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.233+0000 7f71c0c00640 1 -- 172.21.15.112:0/144629164 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71bc1f53b0 con 0x7f71bc071530 2024-09-12T02:42:27.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.233+0000 7f71b3e00640 1 --2- 172.21.15.112:0/144629164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71bc0afe30 0x7f71bc140050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:27.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.234+0000 7f71c0c00640 1 --2- 172.21.15.112:0/144629164 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71bc071530 0x7f71bc1f4e70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f71ac00d620 tx=0x7f71ac00dae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:27.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.234+0000 7f71b9600640 1 -- 172.21.15.112:0/144629164 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ac00b620 con 0x7f71bc071530 2024-09-12T02:42:27.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.234+0000 7f71b9600640 1 -- 172.21.15.112:0/144629164 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71ac019070 con 0x7f71bc071530 2024-09-12T02:42:27.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.234+0000 7f71b9600640 1 -- 172.21.15.112:0/144629164 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ac00ba00 con 0x7f71bc071530 2024-09-12T02:42:27.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.234+0000 7f71c3600640 1 -- 172.21.15.112:0/144629164 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71bc0b3a80 con 0x7f71bc071530 2024-09-12T02:42:27.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.234+0000 7f71c3600640 1 -- 172.21.15.112:0/144629164 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f71bc0b4000 con 0x7f71bc071530 2024-09-12T02:42:27.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.235+0000 7f71c3600640 1 -- 172.21.15.112:0/144629164 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71bc068a30 con 0x7f71bc071530 2024-09-12T02:42:27.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.236+0000 7f71b9600640 1 -- 172.21.15.112:0/144629164 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f71ac00bba0 con 0x7f71bc071530 2024-09-12T02:42:27.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.237+0000 7f71b9600640 1 --2- 172.21.15.112:0/144629164 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f719806be30 0x7f719806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:27.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.237+0000 7f71b9600640 1 -- 172.21.15.112:0/144629164 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f71ac08b190 con 0x7f71bc071530 2024-09-12T02:42:27.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.237+0000 7f71b3e00640 1 --2- 172.21.15.112:0/144629164 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f719806be30 0x7f719806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:27.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.238+0000 7f71b3e00640 1 --2- 172.21.15.112:0/144629164 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f719806be30 0x7f719806e2f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f71bc155830 tx=0x7f71a4007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:27.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.242+0000 7f71b9600640 1 -- 172.21.15.112:0/144629164 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f71bc1f53b0 con 0x7f71bc071530 2024-09-12T02:42:27.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.427+0000 7f71c3600640 1 -- 172.21.15.112:0/144629164 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f71bc072760 con 0x7f71bc071530 2024-09-12T02:42:27.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.428+0000 7f71b9600640 1 -- 172.21.15.112:0/144629164 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f71ac059450 con 0x7f71bc071530 2024-09-12T02:42:27.428 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-12T02:42:27.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.430+0000 7f71c3600640 1 -- 172.21.15.112:0/144629164 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f719806be30 msgr2=0x7f719806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:27.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.430+0000 7f71c3600640 1 --2- 172.21.15.112:0/144629164 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f719806be30 0x7f719806e2f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f71bc155830 tx=0x7f71a4007e80 comp rx=0 tx=0).stop 2024-09-12T02:42:27.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.430+0000 7f71c3600640 1 -- 172.21.15.112:0/144629164 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71bc071530 msgr2=0x7f71bc1f4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:27.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.430+0000 7f71c3600640 1 --2- 172.21.15.112:0/144629164 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71bc071530 0x7f71bc1f4e70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f71ac00d620 tx=0x7f71ac00dae0 comp rx=0 tx=0).stop 2024-09-12T02:42:27.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.430+0000 7f71c3600640 1 -- 172.21.15.112:0/144629164 shutdown_connections 2024-09-12T02:42:27.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.430+0000 7f71c3600640 1 --2- 172.21.15.112:0/144629164 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f719806be30 0x7f719806e2f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:27.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.430+0000 7f71c3600640 1 --2- 172.21.15.112:0/144629164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71bc15cc50 0x7f71bc1519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:27.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.430+0000 7f71c3600640 1 --2- 172.21.15.112:0/144629164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71bc0afe30 0x7f71bc140050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:27.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.430+0000 7f71c3600640 1 --2- 172.21.15.112:0/144629164 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71bc071530 0x7f71bc1f4e70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:27.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.430+0000 7f71c3600640 1 -- 172.21.15.112:0/144629164 >> 172.21.15.112:0/144629164 conn(0x7f71bc06bbd0 msgr2=0x7f71bc0b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:27.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.431+0000 7f71c3600640 1 -- 172.21.15.112:0/144629164 shutdown_connections 2024-09-12T02:42:27.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.431+0000 7f71c3600640 1 -- 172.21.15.112:0/144629164 wait complete. 2024-09-12T02:42:27.446 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-12T02:42:27.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:27.447 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-12T02:42:27.507 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T02:42:27.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:27.507 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-12T02:42:27.544 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T02:42:27.544 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:42:27.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.696+0000 7fa088600640 1 Processor -- start 2024-09-12T02:42:27.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.696+0000 7fa088600640 1 -- start start 2024-09-12T02:42:27.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.697+0000 7fa088600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa08015b9d0 0x7fa0800b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:27.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.697+0000 7fa088600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa0800b45d0 0x7fa0800728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:27.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.697+0000 7fa088600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa08006eef0 0x7fa08006f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:27.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.697+0000 7fa088600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa0800b4a60 con 0x7fa08015b9d0 2024-09-12T02:42:27.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.697+0000 7fa088600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa08006f860 con 0x7fa0800b45d0 2024-09-12T02:42:27.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.697+0000 7fa088600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa0800b54a0 con 0x7fa08006eef0 2024-09-12T02:42:27.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.698+0000 7fa085c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa08015b9d0 0x7fa0800b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:27.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.698+0000 7fa085c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa08015b9d0 0x7fa0800b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52654/0 (socket says 172.21.15.112:52654) 2024-09-12T02:42:27.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.698+0000 7fa085c00640 1 -- 172.21.15.112:0/229875967 learned_addr learned my addr 172.21.15.112:0/229875967 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:27.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.698+0000 7fa086600640 1 --2- 172.21.15.112:0/229875967 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa08006eef0 0x7fa08006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:27.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.698+0000 7fa085200640 1 --2- 172.21.15.112:0/229875967 >> v2:172.21.15.137:3300/0 conn(0x7fa0800b45d0 0x7fa0800728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:27.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.698+0000 7fa085c00640 1 -- 172.21.15.112:0/229875967 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa08006eef0 msgr2=0x7fa08006f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:27.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.698+0000 7fa085c00640 1 --2- 172.21.15.112:0/229875967 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa08006eef0 0x7fa08006f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:27.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.698+0000 7fa085c00640 1 -- 172.21.15.112:0/229875967 >> v2:172.21.15.137:3300/0 conn(0x7fa0800b45d0 msgr2=0x7fa0800728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:27.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.698+0000 7fa085c00640 1 --2- 172.21.15.112:0/229875967 >> v2:172.21.15.137:3300/0 conn(0x7fa0800b45d0 0x7fa0800728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:27.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.698+0000 7fa085c00640 1 -- 172.21.15.112:0/229875967 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0800b3af0 con 0x7fa08015b9d0 2024-09-12T02:42:27.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.699+0000 7fa085c00640 1 --2- 172.21.15.112:0/229875967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08015b9d0 0x7fa0800b4ec0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa080068670 tx=0x7fa07402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6e056b1893f471 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:27.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.699+0000 7fa07fe00640 1 -- 172.21.15.112:0/229875967 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa074037070 con 0x7fa08015b9d0 2024-09-12T02:42:27.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.699+0000 7fa07fe00640 1 -- 172.21.15.112:0/229875967 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa074032440 con 0x7fa08015b9d0 2024-09-12T02:42:27.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.700+0000 7fa07fe00640 1 -- 172.21.15.112:0/229875967 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa074032810 con 0x7fa08015b9d0 2024-09-12T02:42:27.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.700+0000 7fa088600640 1 -- 172.21.15.112:0/229875967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08015b9d0 msgr2=0x7fa0800b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:27.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.700+0000 7fa088600640 1 --2- 172.21.15.112:0/229875967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08015b9d0 0x7fa0800b4ec0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa080068670 tx=0x7fa07402a210 comp rx=0 tx=0).stop 2024-09-12T02:42:27.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.700+0000 7fa088600640 1 -- 172.21.15.112:0/229875967 shutdown_connections 2024-09-12T02:42:27.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.700+0000 7fa088600640 1 --2- 172.21.15.112:0/229875967 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa08006eef0 0x7fa08006f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:27.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.700+0000 7fa088600640 1 --2- 172.21.15.112:0/229875967 >> v2:172.21.15.137:3300/0 conn(0x7fa0800b45d0 0x7fa0800728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:27.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.700+0000 7fa088600640 1 --2- 172.21.15.112:0/229875967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08015b9d0 0x7fa0800b4ec0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:27.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.700+0000 7fa088600640 1 -- 172.21.15.112:0/229875967 >> 172.21.15.112:0/229875967 conn(0x7fa08006bbd0 msgr2=0x7fa08006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:27.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.700+0000 7fa088600640 1 -- 172.21.15.112:0/229875967 shutdown_connections 2024-09-12T02:42:27.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.700+0000 7fa088600640 1 -- 172.21.15.112:0/229875967 wait complete. 2024-09-12T02:42:27.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.702+0000 7fa088600640 1 Processor -- start 2024-09-12T02:42:27.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.702+0000 7fa088600640 1 -- start start 2024-09-12T02:42:27.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.703+0000 7fa088600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa08006eef0 0x7fa080152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:27.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.703+0000 7fa088600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0800b45d0 0x7fa080144510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:27.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.703+0000 7fa088600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08015b9d0 0x7fa080151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:27.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.703+0000 7fa088600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa08015bdb0 con 0x7fa08015b9d0 2024-09-12T02:42:27.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.703+0000 7fa088600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa0800b40b0 con 0x7fa0800b45d0 2024-09-12T02:42:27.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.703+0000 7fa088600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa08015bf30 con 0x7fa08006eef0 2024-09-12T02:42:27.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.703+0000 7fa086600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08015b9d0 0x7fa080151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:27.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.703+0000 7fa086600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08015b9d0 0x7fa080151570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52664/0 (socket says 172.21.15.112:52664) 2024-09-12T02:42:27.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.703+0000 7fa086600640 1 -- 172.21.15.112:0/2908389739 learned_addr learned my addr 172.21.15.112:0/2908389739 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:27.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.703+0000 7fa085200640 1 --2- 172.21.15.112:0/2908389739 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0800b45d0 0x7fa080144510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:27.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.703+0000 7fa085c00640 1 --2- 172.21.15.112:0/2908389739 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa08006eef0 0x7fa080152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:27.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.703+0000 7fa086600640 1 -- 172.21.15.112:0/2908389739 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa08006eef0 msgr2=0x7fa080152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:27.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.703+0000 7fa086600640 1 --2- 172.21.15.112:0/2908389739 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa08006eef0 0x7fa080152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:27.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.703+0000 7fa086600640 1 -- 172.21.15.112:0/2908389739 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0800b45d0 msgr2=0x7fa080144510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:27.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.703+0000 7fa086600640 1 --2- 172.21.15.112:0/2908389739 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0800b45d0 0x7fa080144510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:27.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.703+0000 7fa086600640 1 -- 172.21.15.112:0/2908389739 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa080151ab0 con 0x7fa08015b9d0 2024-09-12T02:42:27.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.704+0000 7fa086600640 1 --2- 172.21.15.112:0/2908389739 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08015b9d0 0x7fa080151570 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa07800efc0 tx=0x7fa07800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:27.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.704+0000 7fa07d600640 1 -- 172.21.15.112:0/2908389739 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa078018020 con 0x7fa08015b9d0 2024-09-12T02:42:27.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.704+0000 7fa07d600640 1 -- 172.21.15.112:0/2908389739 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa078014480 con 0x7fa08015b9d0 2024-09-12T02:42:27.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.704+0000 7fa07d600640 1 -- 172.21.15.112:0/2908389739 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa078014870 con 0x7fa08015b9d0 2024-09-12T02:42:27.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.704+0000 7fa088600640 1 -- 172.21.15.112:0/2908389739 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa08015d9f0 con 0x7fa08015b9d0 2024-09-12T02:42:27.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.704+0000 7fa088600640 1 -- 172.21.15.112:0/2908389739 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa08015e3a0 con 0x7fa08015b9d0 2024-09-12T02:42:27.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.705+0000 7fa088600640 1 -- 172.21.15.112:0/2908389739 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa08006f320 con 0x7fa08015b9d0 2024-09-12T02:42:27.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.706+0000 7fa07d600640 1 -- 172.21.15.112:0/2908389739 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa078005d10 con 0x7fa08015b9d0 2024-09-12T02:42:27.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.707+0000 7fa07d600640 1 --2- 172.21.15.112:0/2908389739 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa06006be30 0x7fa06006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:27.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.707+0000 7fa07d600640 1 -- 172.21.15.112:0/2908389739 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa07808b820 con 0x7fa08015b9d0 2024-09-12T02:42:27.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.707+0000 7fa085c00640 1 --2- 172.21.15.112:0/2908389739 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa06006be30 0x7fa06006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:27.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.708+0000 7fa085c00640 1 --2- 172.21.15.112:0/2908389739 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa06006be30 0x7fa06006e2f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa074034000 tx=0x7fa07402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:27.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.712+0000 7fa07d600640 1 -- 172.21.15.112:0/2908389739 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa078022070 con 0x7fa08015b9d0 2024-09-12T02:42:27.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.919+0000 7fa088600640 1 -- 172.21.15.112:0/2908389739 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0800d0370 con 0x7fa08015b9d0 2024-09-12T02:42:27.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.919+0000 7fa07d600640 1 -- 172.21.15.112:0/2908389739 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7fa078010040 con 0x7fa08015b9d0 2024-09-12T02:42:27.919 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:42:27.919 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":8,"btime":"2024-09-12T02:41:56:806041+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3622416380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3622416380},{"type":"v1","addr":"172.21.15.112:6837","nonce":3622416380}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/2779317773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2779317773},{"type":"v1","addr":"172.21.15.137:6834","nonce":2779317773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3005649719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3005649719},{"type":"v1","addr":"172.21.15.112:6835","nonce":3005649719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:41:53.174744+0000","modified":"2024-09-12T02:41:56.211357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/1785309492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1785309492},{"type":"v1","addr":"172.21.15.137:6835","nonce":1785309492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4308]},"id":1}]} 2024-09-12T02:42:27.920 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 8 2024-09-12T02:42:27.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.921+0000 7fa088600640 1 -- 172.21.15.112:0/2908389739 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa06006be30 msgr2=0x7fa06006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:27.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.921+0000 7fa088600640 1 --2- 172.21.15.112:0/2908389739 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa06006be30 0x7fa06006e2f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa074034000 tx=0x7fa07402e000 comp rx=0 tx=0).stop 2024-09-12T02:42:27.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.921+0000 7fa088600640 1 -- 172.21.15.112:0/2908389739 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08015b9d0 msgr2=0x7fa080151570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:27.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.921+0000 7fa088600640 1 --2- 172.21.15.112:0/2908389739 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08015b9d0 0x7fa080151570 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa07800efc0 tx=0x7fa07800c490 comp rx=0 tx=0).stop 2024-09-12T02:42:27.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.921+0000 7fa088600640 1 -- 172.21.15.112:0/2908389739 shutdown_connections 2024-09-12T02:42:27.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.921+0000 7fa088600640 1 --2- 172.21.15.112:0/2908389739 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08015b9d0 0x7fa080151570 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:27.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.921+0000 7fa088600640 1 --2- 172.21.15.112:0/2908389739 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa06006be30 0x7fa06006e2f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:27.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.921+0000 7fa088600640 1 --2- 172.21.15.112:0/2908389739 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0800b45d0 0x7fa080144510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:27.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.921+0000 7fa088600640 1 --2- 172.21.15.112:0/2908389739 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa08006eef0 0x7fa080152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:27.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.921+0000 7fa088600640 1 -- 172.21.15.112:0/2908389739 >> 172.21.15.112:0/2908389739 conn(0x7fa08006bbd0 msgr2=0x7fa080159a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:27.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.922+0000 7fa088600640 1 -- 172.21.15.112:0/2908389739 shutdown_connections 2024-09-12T02:42:27.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:27.922+0000 7fa088600640 1 -- 172.21.15.112:0/2908389739 wait complete. 2024-09-12T02:42:27.938 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:42:28.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.091+0000 7fa738600640 1 Processor -- start 2024-09-12T02:42:28.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.091+0000 7fa738600640 1 -- start start 2024-09-12T02:42:28.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.092+0000 7fa738600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa73015b9d0 0x7fa7300b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:28.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.092+0000 7fa738600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7300b45d0 0x7fa7300728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:28.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.092+0000 7fa738600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7300b54a0 con 0x7fa73006eef0 2024-09-12T02:42:28.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.092+0000 7fa738600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa7300b4a60 con 0x7fa73015b9d0 2024-09-12T02:42:28.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.092+0000 7fa738600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa7300b3af0 con 0x7fa7300b45d0 2024-09-12T02:42:28.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.093+0000 7fa735c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa73015b9d0 0x7fa7300b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:28.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.093+0000 7fa735200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7300b45d0 0x7fa7300728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:28.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.093+0000 7fa735c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa73015b9d0 0x7fa7300b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:51622/0 (socket says 172.21.15.112:51622) 2024-09-12T02:42:28.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.093+0000 7fa736600640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fa73006eef0 0x7fa7300cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.112:37376/0 (socket says 172.21.15.112:37376) 2024-09-12T02:42:28.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.093+0000 7fa735c00640 1 -- 172.21.15.112:0/848895510 learned_addr learned my addr 172.21.15.112:0/848895510 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:28.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.093+0000 7fa735c00640 1 -- 172.21.15.112:0/848895510 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7300b45d0 msgr2=0x7fa7300728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:28.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.093+0000 7fa735c00640 1 --2- 172.21.15.112:0/848895510 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7300b45d0 0x7fa7300728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:28.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.093+0000 7fa735c00640 1 -- 172.21.15.112:0/848895510 >> v1:172.21.15.137:6789/0 conn(0x7fa73006eef0 legacy=0x7fa7300cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:28.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.093+0000 7fa735c00640 1 -- 172.21.15.112:0/848895510 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7300b3dd0 con 0x7fa73015b9d0 2024-09-12T02:42:28.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.094+0000 7fa735c00640 1 --2- 172.21.15.112:0/848895510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa73015b9d0 0x7fa7300b4ec0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa724009870 tx=0x7fa72402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=166f87710e8c5254 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:28.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.095+0000 7fa72fe00640 1 -- 172.21.15.112:0/848895510 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa724037070 con 0x7fa73015b9d0 2024-09-12T02:42:28.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.095+0000 7fa72fe00640 1 -- 172.21.15.112:0/848895510 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa724032440 con 0x7fa73015b9d0 2024-09-12T02:42:28.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.095+0000 7fa72fe00640 1 -- 172.21.15.112:0/848895510 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa724032810 con 0x7fa73015b9d0 2024-09-12T02:42:28.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.095+0000 7fa738600640 1 -- 172.21.15.112:0/848895510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa73015b9d0 msgr2=0x7fa7300b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:28.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.095+0000 7fa738600640 1 --2- 172.21.15.112:0/848895510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa73015b9d0 0x7fa7300b4ec0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa724009870 tx=0x7fa72402a270 comp rx=0 tx=0).stop 2024-09-12T02:42:28.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.095+0000 7fa738600640 1 -- 172.21.15.112:0/848895510 shutdown_connections 2024-09-12T02:42:28.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.095+0000 7fa738600640 1 --2- 172.21.15.112:0/848895510 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7300b45d0 0x7fa7300728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:28.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.095+0000 7fa738600640 1 --2- 172.21.15.112:0/848895510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa73015b9d0 0x7fa7300b4ec0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:28.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.095+0000 7fa738600640 1 -- 172.21.15.112:0/848895510 >> 172.21.15.112:0/848895510 conn(0x7fa73006bbd0 msgr2=0x7fa73006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:28.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.095+0000 7fa738600640 1 -- 172.21.15.112:0/848895510 shutdown_connections 2024-09-12T02:42:28.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.095+0000 7fa738600640 1 -- 172.21.15.112:0/848895510 wait complete. 2024-09-12T02:42:28.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.097+0000 7fa738600640 1 Processor -- start 2024-09-12T02:42:28.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.097+0000 7fa738600640 1 -- start start 2024-09-12T02:42:28.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.098+0000 7fa738600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa73006eef0 0x7fa7301518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:28.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.098+0000 7fa738600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7300b45d0 0x7fa730151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:28.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.098+0000 7fa738600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa73015b9d0 0x7fa73015a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:28.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.098+0000 7fa738600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa73015bf30 con 0x7fa7300b45d0 2024-09-12T02:42:28.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.098+0000 7fa738600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa73015bdb0 con 0x7fa73015b9d0 2024-09-12T02:42:28.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.098+0000 7fa738600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa73006f320 con 0x7fa73006eef0 2024-09-12T02:42:28.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.098+0000 7fa735200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7300b45d0 0x7fa730151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:28.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.098+0000 7fa735200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7300b45d0 0x7fa730151fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52674/0 (socket says 172.21.15.112:52674) 2024-09-12T02:42:28.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.098+0000 7fa735200640 1 -- 172.21.15.112:0/3409907110 learned_addr learned my addr 172.21.15.112:0/3409907110 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:28.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.099+0000 7fa735c00640 1 --2- 172.21.15.112:0/3409907110 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa73006eef0 0x7fa7301518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:28.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.099+0000 7fa736600640 1 --2- 172.21.15.112:0/3409907110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa73015b9d0 0x7fa73015a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:28.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.099+0000 7fa735200640 1 -- 172.21.15.112:0/3409907110 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa73006eef0 msgr2=0x7fa7301518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:28.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.099+0000 7fa735200640 1 --2- 172.21.15.112:0/3409907110 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa73006eef0 0x7fa7301518e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:28.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.099+0000 7fa735200640 1 -- 172.21.15.112:0/3409907110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa73015b9d0 msgr2=0x7fa73015a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:28.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.099+0000 7fa735200640 1 --2- 172.21.15.112:0/3409907110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa73015b9d0 0x7fa73015a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:28.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.099+0000 7fa735200640 1 -- 172.21.15.112:0/3409907110 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa73006eb10 con 0x7fa7300b45d0 2024-09-12T02:42:28.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.099+0000 7fa736600640 1 --2- 172.21.15.112:0/3409907110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa73015b9d0 0x7fa73015a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:28.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.099+0000 7fa735200640 1 --2- 172.21.15.112:0/3409907110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7300b45d0 0x7fa730151fc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa71c00e930 tx=0x7fa71c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:28.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.099+0000 7fa72d600640 1 -- 172.21.15.112:0/3409907110 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa71c017070 con 0x7fa7300b45d0 2024-09-12T02:42:28.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.100+0000 7fa72d600640 1 -- 172.21.15.112:0/3409907110 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa71c00c9a0 con 0x7fa7300b45d0 2024-09-12T02:42:28.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.100+0000 7fa738600640 1 -- 172.21.15.112:0/3409907110 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa73015c230 con 0x7fa7300b45d0 2024-09-12T02:42:28.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.100+0000 7fa72d600640 1 -- 172.21.15.112:0/3409907110 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa71c00cd50 con 0x7fa7300b45d0 2024-09-12T02:42:28.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.100+0000 7fa738600640 1 -- 172.21.15.112:0/3409907110 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa73006e830 con 0x7fa7300b45d0 2024-09-12T02:42:28.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.101+0000 7fa738600640 1 -- 172.21.15.112:0/3409907110 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa730068a30 con 0x7fa7300b45d0 2024-09-12T02:42:28.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.101+0000 7fa72d600640 1 -- 172.21.15.112:0/3409907110 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa71c01a070 con 0x7fa7300b45d0 2024-09-12T02:42:28.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.102+0000 7fa72d600640 1 --2- 172.21.15.112:0/3409907110 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa71006be30 0x7fa71006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:28.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.102+0000 7fa72d600640 1 -- 172.21.15.112:0/3409907110 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa71c08b100 con 0x7fa7300b45d0 2024-09-12T02:42:28.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.102+0000 7fa735c00640 1 --2- 172.21.15.112:0/3409907110 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa71006be30 0x7fa71006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:28.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.103+0000 7fa735c00640 1 --2- 172.21.15.112:0/3409907110 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa71006be30 0x7fa71006e2f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa724034000 tx=0x7fa72402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:28.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.107+0000 7fa72d600640 1 -- 172.21.15.112:0/3409907110 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa71c059510 con 0x7fa7300b45d0 2024-09-12T02:42:28.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.313+0000 7fa738600640 1 -- 172.21.15.112:0/3409907110 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa730152a60 con 0x7fa7300b45d0 2024-09-12T02:42:28.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.314+0000 7fa72d600640 1 -- 172.21.15.112:0/3409907110 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7fa71c05d810 con 0x7fa7300b45d0 2024-09-12T02:42:28.314 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:42:28.314 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":8,"btime":"2024-09-12T02:41:56:806041+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3622416380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3622416380},{"type":"v1","addr":"172.21.15.112:6837","nonce":3622416380}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/2779317773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2779317773},{"type":"v1","addr":"172.21.15.137:6834","nonce":2779317773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3005649719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3005649719},{"type":"v1","addr":"172.21.15.112:6835","nonce":3005649719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:41:53.174744+0000","modified":"2024-09-12T02:41:56.211357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/1785309492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1785309492},{"type":"v1","addr":"172.21.15.137:6835","nonce":1785309492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4308]},"id":1}]} 2024-09-12T02:42:28.315 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 8 2024-09-12T02:42:28.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.316+0000 7fa738600640 1 -- 172.21.15.112:0/3409907110 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa71006be30 msgr2=0x7fa71006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:28.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.316+0000 7fa738600640 1 --2- 172.21.15.112:0/3409907110 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa71006be30 0x7fa71006e2f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa724034000 tx=0x7fa72402e000 comp rx=0 tx=0).stop 2024-09-12T02:42:28.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.316+0000 7fa738600640 1 -- 172.21.15.112:0/3409907110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7300b45d0 msgr2=0x7fa730151fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:28.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.316+0000 7fa738600640 1 --2- 172.21.15.112:0/3409907110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7300b45d0 0x7fa730151fc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa71c00e930 tx=0x7fa71c00edf0 comp rx=0 tx=0).stop 2024-09-12T02:42:28.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.316+0000 7fa738600640 1 -- 172.21.15.112:0/3409907110 shutdown_connections 2024-09-12T02:42:28.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.316+0000 7fa738600640 1 --2- 172.21.15.112:0/3409907110 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa71006be30 0x7fa71006e2f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:28.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.316+0000 7fa738600640 1 --2- 172.21.15.112:0/3409907110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa73015b9d0 0x7fa73015a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:28.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.316+0000 7fa738600640 1 --2- 172.21.15.112:0/3409907110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7300b45d0 0x7fa730151fc0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:28.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.316+0000 7fa738600640 1 --2- 172.21.15.112:0/3409907110 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa73006eef0 0x7fa7301518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:28.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.316+0000 7fa738600640 1 -- 172.21.15.112:0/3409907110 >> 172.21.15.112:0/3409907110 conn(0x7fa73006bbd0 msgr2=0x7fa7300b1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:28.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.317+0000 7fa738600640 1 -- 172.21.15.112:0/3409907110 shutdown_connections 2024-09-12T02:42:28.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.317+0000 7fa738600640 1 -- 172.21.15.112:0/3409907110 wait complete. 2024-09-12T02:42:28.332 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:42:28.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.483+0000 7f2c02400640 1 Processor -- start 2024-09-12T02:42:28.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.483+0000 7f2c02400640 1 -- start start 2024-09-12T02:42:28.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.485+0000 7f2c02400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2bfc070bc0 0x7f2bfc0ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:28.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.485+0000 7f2c02400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bfc06f880 con 0x7f2bfc0cfd30 2024-09-12T02:42:28.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.485+0000 7f2c02400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bfc06fb20 con 0x7f2bfc15eeb0 2024-09-12T02:42:28.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.485+0000 7f2c02400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2bfc070730 con 0x7f2bfc070bc0 2024-09-12T02:42:28.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.485+0000 7f2bf2a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2bfc0cfd30 0x7f2bfc166f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35024/0 (socket says 172.21.15.112:35024) 2024-09-12T02:42:28.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.485+0000 7f2bf2a00640 1 -- 172.21.15.112:0/158783419 learned_addr learned my addr 172.21.15.112:0/158783419 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:28.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.485+0000 7f2bfbe00640 1 --2- 172.21.15.112:0/158783419 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2bfc070bc0 0x7f2bfc0ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:28.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.485+0000 7f2bfaa00640 1 -- 172.21.15.112:0/158783419 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 10203584 0 0) 0x7f2bfc06f880 con 0x7f2bfc0cfd30 2024-09-12T02:42:28.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.485+0000 7f2bfaa00640 1 -- 172.21.15.112:0/158783419 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2be0003520 con 0x7f2bfc0cfd30 2024-09-12T02:42:28.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.485+0000 7f2bfaa00640 1 -- 172.21.15.112:0/158783419 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 634461198 0 0) 0x7f2bfc06fb20 con 0x7f2bfc15eeb0 2024-09-12T02:42:28.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.485+0000 7f2bfbe00640 1 -- 172.21.15.112:0/158783419 >> v1:172.21.15.137:6789/0 conn(0x7f2bfc15eeb0 legacy=0x7f2bfc0cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:28.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.485+0000 7f2bfbe00640 1 -- 172.21.15.112:0/158783419 >> v1:172.21.15.112:6789/0 conn(0x7f2bfc0cfd30 legacy=0x7f2bfc166f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:28.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.485+0000 7f2bfbe00640 1 -- 172.21.15.112:0/158783419 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bfc06fe00 con 0x7f2bfc070bc0 2024-09-12T02:42:28.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.487+0000 7f2bfbe00640 1 --2- 172.21.15.112:0/158783419 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2bfc070bc0 0x7f2bfc0ce9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009dc0 tx=0x7f2bf402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c91db330554abaa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:28.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.487+0000 7f2bfaa00640 1 -- 172.21.15.112:0/158783419 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4007740 con 0x7f2bfc070bc0 2024-09-12T02:42:28.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.487+0000 7f2bfaa00640 1 -- 172.21.15.112:0/158783419 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bf40078e0 con 0x7f2bfc070bc0 2024-09-12T02:42:28.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.487+0000 7f2bfaa00640 1 -- 172.21.15.112:0/158783419 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4007cb0 con 0x7f2bfc070bc0 2024-09-12T02:42:28.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.487+0000 7f2c02400640 1 -- 172.21.15.112:0/158783419 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2bfc070bc0 msgr2=0x7f2bfc0ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:28.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.487+0000 7f2c02400640 1 --2- 172.21.15.112:0/158783419 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2bfc070bc0 0x7f2bfc0ce9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009dc0 tx=0x7f2bf402a6d0 comp rx=0 tx=0).stop 2024-09-12T02:42:28.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.487+0000 7f2c02400640 1 -- 172.21.15.112:0/158783419 shutdown_connections 2024-09-12T02:42:28.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.487+0000 7f2c02400640 1 --2- 172.21.15.112:0/158783419 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2bfc070bc0 0x7f2bfc0ce9b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:28.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.488+0000 7f2c02400640 1 -- 172.21.15.112:0/158783419 >> 172.21.15.112:0/158783419 conn(0x7f2bfc0b4720 msgr2=0x7f2bfc0b4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:28.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.488+0000 7f2c02400640 1 -- 172.21.15.112:0/158783419 shutdown_connections 2024-09-12T02:42:28.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.488+0000 7f2c02400640 1 -- 172.21.15.112:0/158783419 wait complete. 2024-09-12T02:42:28.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.489+0000 7f2c02400640 1 Processor -- start 2024-09-12T02:42:28.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.489+0000 7f2c02400640 1 -- start start 2024-09-12T02:42:28.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.490+0000 7f2c02400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bfc070bc0 0x7f2bfc157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:28.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.490+0000 7f2c02400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2bfc0cfd30 0x7f2bfc0c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:28.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.490+0000 7f2c02400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bfc15eeb0 0x7f2bfc0c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:28.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.490+0000 7f2c02400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2bfc15f290 con 0x7f2bfc15eeb0 2024-09-12T02:42:28.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.490+0000 7f2c02400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2bfc0703c0 con 0x7f2bfc070bc0 2024-09-12T02:42:28.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.490+0000 7f2c02400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2bfc15f410 con 0x7f2bfc0cfd30 2024-09-12T02:42:28.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.490+0000 7f2bfbe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bfc15eeb0 0x7f2bfc0c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:28.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.490+0000 7f2bfbe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bfc15eeb0 0x7f2bfc0c67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52680/0 (socket says 172.21.15.112:52680) 2024-09-12T02:42:28.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.490+0000 7f2bfbe00640 1 -- 172.21.15.112:0/2064834125 learned_addr learned my addr 172.21.15.112:0/2064834125 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:28.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.491+0000 7f2bf2a00640 1 --2- 172.21.15.112:0/2064834125 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2bfc0cfd30 0x7f2bfc0c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:28.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.491+0000 7f2bfb400640 1 --2- 172.21.15.112:0/2064834125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bfc070bc0 0x7f2bfc157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:28.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.491+0000 7f2bfbe00640 1 -- 172.21.15.112:0/2064834125 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2bfc0cfd30 msgr2=0x7f2bfc0c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:28.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.491+0000 7f2bfbe00640 1 --2- 172.21.15.112:0/2064834125 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2bfc0cfd30 0x7f2bfc0c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:28.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.491+0000 7f2bfbe00640 1 -- 172.21.15.112:0/2064834125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bfc070bc0 msgr2=0x7f2bfc157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:28.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.491+0000 7f2bfbe00640 1 --2- 172.21.15.112:0/2064834125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bfc070bc0 0x7f2bfc157dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:28.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.491+0000 7f2bfbe00640 1 -- 172.21.15.112:0/2064834125 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bfc158310 con 0x7f2bfc15eeb0 2024-09-12T02:42:28.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.491+0000 7f2bfbe00640 1 --2- 172.21.15.112:0/2064834125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bfc15eeb0 0x7f2bfc0c67f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009ee0 tx=0x7f2bf4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:28.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.491+0000 7f2bf3e00640 1 -- 172.21.15.112:0/2064834125 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf403f070 con 0x7f2bfc15eeb0 2024-09-12T02:42:28.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.491+0000 7f2bf3e00640 1 -- 172.21.15.112:0/2064834125 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bf4031bc0 con 0x7f2bfc15eeb0 2024-09-12T02:42:28.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.492+0000 7f2c02400640 1 -- 172.21.15.112:0/2064834125 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bfc0ca250 con 0x7f2bfc15eeb0 2024-09-12T02:42:28.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.492+0000 7f2bf3e00640 1 -- 172.21.15.112:0/2064834125 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4009450 con 0x7f2bfc15eeb0 2024-09-12T02:42:28.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.492+0000 7f2c02400640 1 -- 172.21.15.112:0/2064834125 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bfc0caaf0 con 0x7f2bfc15eeb0 2024-09-12T02:42:28.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.493+0000 7f2c02400640 1 -- 172.21.15.112:0/2064834125 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bfc0ca640 con 0x7f2bfc15eeb0 2024-09-12T02:42:28.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.494+0000 7f2bf3e00640 1 -- 172.21.15.112:0/2064834125 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2bf403b410 con 0x7f2bfc15eeb0 2024-09-12T02:42:28.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.494+0000 7f2bf3e00640 1 --2- 172.21.15.112:0/2064834125 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2bd806be30 0x7f2bd806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:28.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.495+0000 7f2bf3e00640 1 -- 172.21.15.112:0/2064834125 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2bf40ac5f0 con 0x7f2bfc15eeb0 2024-09-12T02:42:28.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.495+0000 7f2bfb400640 1 --2- 172.21.15.112:0/2064834125 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2bd806be30 0x7f2bd806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:28.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.495+0000 7f2bfb400640 1 --2- 172.21.15.112:0/2064834125 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2bd806be30 0x7f2bd806e2f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2bec000f60 tx=0x7f2bec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:28.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.499+0000 7f2bf3e00640 1 -- 172.21.15.112:0/2064834125 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2bf404b020 con 0x7f2bfc15eeb0 2024-09-12T02:42:28.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.676+0000 7f2c02400640 1 -- 172.21.15.112:0/2064834125 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2bfc0763a0 con 0x7f2bfc15eeb0 2024-09-12T02:42:28.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.677+0000 7f2bf3e00640 1 -- 172.21.15.112:0/2064834125 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16713 (secure 0 0 0) 0x7f2bf407a7a0 con 0x7f2bfc15eeb0 2024-09-12T02:42:28.679 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:42:28.679 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":20,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:41:54.774268+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:41:51.222228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:41:52.167920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:42:28.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.680+0000 7f2c02400640 1 -- 172.21.15.112:0/2064834125 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2bd806be30 msgr2=0x7f2bd806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:28.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.680+0000 7f2c02400640 1 --2- 172.21.15.112:0/2064834125 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2bd806be30 0x7f2bd806e2f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2bec000f60 tx=0x7f2bec009040 comp rx=0 tx=0).stop 2024-09-12T02:42:28.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.680+0000 7f2c02400640 1 -- 172.21.15.112:0/2064834125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bfc15eeb0 msgr2=0x7f2bfc0c67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:28.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.680+0000 7f2c02400640 1 --2- 172.21.15.112:0/2064834125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bfc15eeb0 0x7f2bfc0c67f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009ee0 tx=0x7f2bf4004a40 comp rx=0 tx=0).stop 2024-09-12T02:42:28.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.680+0000 7f2c02400640 1 -- 172.21.15.112:0/2064834125 shutdown_connections 2024-09-12T02:42:28.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.680+0000 7f2c02400640 1 --2- 172.21.15.112:0/2064834125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bfc15eeb0 0x7f2bfc0c67f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:28.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.680+0000 7f2c02400640 1 --2- 172.21.15.112:0/2064834125 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2bfc0cfd30 0x7f2bfc0c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:28.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.680+0000 7f2c02400640 1 --2- 172.21.15.112:0/2064834125 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2bd806be30 0x7f2bd806e2f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:28.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.680+0000 7f2c02400640 1 --2- 172.21.15.112:0/2064834125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bfc070bc0 0x7f2bfc157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:28.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.680+0000 7f2c02400640 1 -- 172.21.15.112:0/2064834125 >> 172.21.15.112:0/2064834125 conn(0x7f2bfc0b4720 msgr2=0x7f2bfc0b37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:28.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.680+0000 7f2c02400640 1 -- 172.21.15.112:0/2064834125 shutdown_connections 2024-09-12T02:42:28.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.680+0000 7f2c02400640 1 -- 172.21.15.112:0/2064834125 wait complete. 2024-09-12T02:42:28.697 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:42:28.698 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:42:28.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.850+0000 7fa343200640 1 Processor -- start 2024-09-12T02:42:28.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.850+0000 7fa343200640 1 -- start start 2024-09-12T02:42:28.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.851+0000 7fa343200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa34415b9a0 0x7fa34406d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:28.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.851+0000 7fa343200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa34406f270 0x7fa3440b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:28.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.851+0000 7fa343200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa3440b5560 0x7fa3440d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:28.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.851+0000 7fa343200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa34406de70 con 0x7fa3440b5560 2024-09-12T02:42:28.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.851+0000 7fa343200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa34406f690 con 0x7fa34406f270 2024-09-12T02:42:28.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.851+0000 7fa343200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa3440b42c0 con 0x7fa34415b9a0 2024-09-12T02:42:28.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.852+0000 7fa342800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa3440b5560 0x7fa3440d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:28.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.852+0000 7fa342800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa3440b5560 0x7fa3440d0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52688/0 (socket says 172.21.15.112:52688) 2024-09-12T02:42:28.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.852+0000 7fa342800640 1 -- 172.21.15.112:0/3188615600 learned_addr learned my addr 172.21.15.112:0/3188615600 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:28.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.852+0000 7fa341e00640 1 --2- 172.21.15.112:0/3188615600 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa34415b9a0 0x7fa34406d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:28.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.852+0000 7fa341400640 1 --2- 172.21.15.112:0/3188615600 >> v2:172.21.15.137:3300/0 conn(0x7fa34406f270 0x7fa3440b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:28.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.852+0000 7fa342800640 1 -- 172.21.15.112:0/3188615600 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa34415b9a0 msgr2=0x7fa34406d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:28.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.852+0000 7fa342800640 1 --2- 172.21.15.112:0/3188615600 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa34415b9a0 0x7fa34406d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:28.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.852+0000 7fa342800640 1 -- 172.21.15.112:0/3188615600 >> v2:172.21.15.137:3300/0 conn(0x7fa34406f270 msgr2=0x7fa3440b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:28.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.852+0000 7fa342800640 1 --2- 172.21.15.112:0/3188615600 >> v2:172.21.15.137:3300/0 conn(0x7fa34406f270 0x7fa3440b5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:28.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.852+0000 7fa342800640 1 -- 172.21.15.112:0/3188615600 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa34415bd80 con 0x7fa3440b5560 2024-09-12T02:42:28.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.852+0000 7fa341e00640 1 --2- 172.21.15.112:0/3188615600 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa34415b9a0 0x7fa34406d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:28.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.852+0000 7fa341400640 1 --2- 172.21.15.112:0/3188615600 >> v2:172.21.15.137:3300/0 conn(0x7fa34406f270 0x7fa3440b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:28.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.853+0000 7fa342800640 1 --2- 172.21.15.112:0/3188615600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3440b5560 0x7fa3440d0820 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa33c009e50 tx=0x7fa33c02a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ed3c3bb266d6ef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:28.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.853+0000 7fa340a00640 1 -- 172.21.15.112:0/3188615600 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa33c036070 con 0x7fa3440b5560 2024-09-12T02:42:28.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.853+0000 7fa340a00640 1 -- 172.21.15.112:0/3188615600 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa33c031600 con 0x7fa3440b5560 2024-09-12T02:42:28.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.853+0000 7fa340a00640 1 -- 172.21.15.112:0/3188615600 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa33c0319d0 con 0x7fa3440b5560 2024-09-12T02:42:28.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.854+0000 7fa343200640 1 -- 172.21.15.112:0/3188615600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3440b5560 msgr2=0x7fa3440d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:28.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.854+0000 7fa343200640 1 --2- 172.21.15.112:0/3188615600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3440b5560 0x7fa3440d0820 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa33c009e50 tx=0x7fa33c02a6d0 comp rx=0 tx=0).stop 2024-09-12T02:42:28.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.854+0000 7fa343200640 1 -- 172.21.15.112:0/3188615600 shutdown_connections 2024-09-12T02:42:28.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.854+0000 7fa343200640 1 --2- 172.21.15.112:0/3188615600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3440b5560 0x7fa3440d0820 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:28.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.854+0000 7fa343200640 1 --2- 172.21.15.112:0/3188615600 >> v2:172.21.15.137:3300/0 conn(0x7fa34406f270 0x7fa3440b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:28.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.854+0000 7fa343200640 1 --2- 172.21.15.112:0/3188615600 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa34415b9a0 0x7fa34406d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:28.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.854+0000 7fa343200640 1 -- 172.21.15.112:0/3188615600 >> 172.21.15.112:0/3188615600 conn(0x7fa34406bbd0 msgr2=0x7fa34406bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:28.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.854+0000 7fa343200640 1 -- 172.21.15.112:0/3188615600 shutdown_connections 2024-09-12T02:42:28.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.854+0000 7fa343200640 1 -- 172.21.15.112:0/3188615600 wait complete. 2024-09-12T02:42:28.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.856+0000 7fa343200640 1 Processor -- start 2024-09-12T02:42:28.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.856+0000 7fa343200640 1 -- start start 2024-09-12T02:42:28.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.856+0000 7fa343200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa34406f270 0x7fa344150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:28.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.856+0000 7fa343200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa34415b9a0 0x7fa344151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:28.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.856+0000 7fa343200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa344152890 0x7fa344152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:28.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.856+0000 7fa343200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa3440b4b00 con 0x7fa34415b9a0 2024-09-12T02:42:28.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.857+0000 7fa343200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa3440b4820 con 0x7fa34406f270 2024-09-12T02:42:28.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.857+0000 7fa343200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa3440b5b50 con 0x7fa344152890 2024-09-12T02:42:28.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.857+0000 7fa341400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa34415b9a0 0x7fa344151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:28.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.857+0000 7fa341400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa34415b9a0 0x7fa344151f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52696/0 (socket says 172.21.15.112:52696) 2024-09-12T02:42:28.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.857+0000 7fa341400640 1 -- 172.21.15.112:0/511221306 learned_addr learned my addr 172.21.15.112:0/511221306 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:28.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.857+0000 7fa341e00640 1 --2- 172.21.15.112:0/511221306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa34406f270 0x7fa344150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:28.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.857+0000 7fa342800640 1 --2- 172.21.15.112:0/511221306 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa344152890 0x7fa344152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:28.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.857+0000 7fa341400640 1 -- 172.21.15.112:0/511221306 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa344152890 msgr2=0x7fa344152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:28.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.857+0000 7fa341400640 1 --2- 172.21.15.112:0/511221306 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa344152890 0x7fa344152d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:28.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.857+0000 7fa341400640 1 -- 172.21.15.112:0/511221306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa34406f270 msgr2=0x7fa344150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:28.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.857+0000 7fa341400640 1 --2- 172.21.15.112:0/511221306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa34406f270 0x7fa344150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:28.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.857+0000 7fa341400640 1 -- 172.21.15.112:0/511221306 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa344073000 con 0x7fa34415b9a0 2024-09-12T02:42:28.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.857+0000 7fa341400640 1 --2- 172.21.15.112:0/511221306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa34415b9a0 0x7fa344151f30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa33000e810 tx=0x7fa33000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:28.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.858+0000 7fa33a000640 1 -- 172.21.15.112:0/511221306 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa330017070 con 0x7fa34415b9a0 2024-09-12T02:42:28.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.858+0000 7fa33a000640 1 -- 172.21.15.112:0/511221306 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa33000c670 con 0x7fa34415b9a0 2024-09-12T02:42:28.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.858+0000 7fa33a000640 1 -- 172.21.15.112:0/511221306 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa33000f040 con 0x7fa34415b9a0 2024-09-12T02:42:28.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.858+0000 7fa343200640 1 -- 172.21.15.112:0/511221306 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa344072480 con 0x7fa34415b9a0 2024-09-12T02:42:28.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.858+0000 7fa343200640 1 -- 172.21.15.112:0/511221306 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa344072a40 con 0x7fa34415b9a0 2024-09-12T02:42:28.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.859+0000 7fa343200640 1 -- 172.21.15.112:0/511221306 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3440b5020 con 0x7fa34415b9a0 2024-09-12T02:42:28.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.860+0000 7fa33a000640 1 -- 172.21.15.112:0/511221306 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa33001a070 con 0x7fa34415b9a0 2024-09-12T02:42:28.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.861+0000 7fa33a000640 1 --2- 172.21.15.112:0/511221306 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa32406be60 0x7fa32406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:28.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.861+0000 7fa33a000640 1 -- 172.21.15.112:0/511221306 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa33008a7b0 con 0x7fa34415b9a0 2024-09-12T02:42:28.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.861+0000 7fa341e00640 1 --2- 172.21.15.112:0/511221306 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa32406be60 0x7fa32406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:28.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.862+0000 7fa341e00640 1 --2- 172.21.15.112:0/511221306 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa32406be60 0x7fa32406e320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa334006fd0 tx=0x7fa334008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:28.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:28.865+0000 7fa33a000640 1 -- 172.21.15.112:0/511221306 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa330058ba0 con 0x7fa34415b9a0 2024-09-12T02:42:29.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.071+0000 7fa343200640 1 -- 172.21.15.112:0/511221306 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3441574c0 con 0x7fa34415b9a0 2024-09-12T02:42:29.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.071+0000 7fa33a000640 1 -- 172.21.15.112:0/511221306 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7fa33005cea0 con 0x7fa34415b9a0 2024-09-12T02:42:29.073 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:42:29.073 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":8,"btime":"2024-09-12T02:41:56:806041+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3622416380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3622416380},{"type":"v1","addr":"172.21.15.112:6837","nonce":3622416380}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/2779317773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2779317773},{"type":"v1","addr":"172.21.15.137:6834","nonce":2779317773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3005649719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3005649719},{"type":"v1","addr":"172.21.15.112:6835","nonce":3005649719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:41:53.174744+0000","modified":"2024-09-12T02:41:56.211357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/1785309492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1785309492},{"type":"v1","addr":"172.21.15.137:6835","nonce":1785309492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4308]},"id":1}]} 2024-09-12T02:42:29.073 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 8 2024-09-12T02:42:29.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.073+0000 7fa343200640 1 -- 172.21.15.112:0/511221306 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa32406be60 msgr2=0x7fa32406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:29.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.073+0000 7fa343200640 1 --2- 172.21.15.112:0/511221306 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa32406be60 0x7fa32406e320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa334006fd0 tx=0x7fa334008040 comp rx=0 tx=0).stop 2024-09-12T02:42:29.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.073+0000 7fa343200640 1 -- 172.21.15.112:0/511221306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa34415b9a0 msgr2=0x7fa344151f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:29.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.073+0000 7fa343200640 1 --2- 172.21.15.112:0/511221306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa34415b9a0 0x7fa344151f30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa33000e810 tx=0x7fa33000ecd0 comp rx=0 tx=0).stop 2024-09-12T02:42:29.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.074+0000 7fa343200640 1 -- 172.21.15.112:0/511221306 shutdown_connections 2024-09-12T02:42:29.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.074+0000 7fa343200640 1 --2- 172.21.15.112:0/511221306 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa344152890 0x7fa344152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:29.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.074+0000 7fa343200640 1 --2- 172.21.15.112:0/511221306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa34415b9a0 0x7fa344151f30 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:29.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.074+0000 7fa343200640 1 --2- 172.21.15.112:0/511221306 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa32406be60 0x7fa32406e320 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:29.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.074+0000 7fa343200640 1 --2- 172.21.15.112:0/511221306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa34406f270 0x7fa344150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:29.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.074+0000 7fa343200640 1 -- 172.21.15.112:0/511221306 >> 172.21.15.112:0/511221306 conn(0x7fa34406bbd0 msgr2=0x7fa3440d0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:29.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.074+0000 7fa343200640 1 -- 172.21.15.112:0/511221306 shutdown_connections 2024-09-12T02:42:29.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.074+0000 7fa343200640 1 -- 172.21.15.112:0/511221306 wait complete. 2024-09-12T02:42:29.090 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:42:29.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.241+0000 7f4c52e00640 1 Processor -- start 2024-09-12T02:42:29.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.241+0000 7f4c52e00640 1 -- start start 2024-09-12T02:42:29.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.243+0000 7f4c52e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4c4c0afe30 0x7f4c4c0cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:29.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.243+0000 7f4c52e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c4c0ceeb0 con 0x7f4c4c15cc50 2024-09-12T02:42:29.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.243+0000 7f4c52e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c4c06e300 con 0x7f4c4c071530 2024-09-12T02:42:29.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.243+0000 7f4c52e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4c4c15d030 con 0x7f4c4c0afe30 2024-09-12T02:42:29.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.243+0000 7f4c50e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4c4c0afe30 0x7f4c4c0cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:29.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.243+0000 7f4c50e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4c4c0afe30 0x7f4c4c0cf950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52702/0 (socket says 172.21.15.112:52702) 2024-09-12T02:42:29.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.243+0000 7f4c4be00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f4c4c15cc50 0x7f4c4c0732f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35038/0 (socket says 172.21.15.112:35038) 2024-09-12T02:42:29.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.243+0000 7f4c50e00640 1 -- 172.21.15.112:0/395747004 learned_addr learned my addr 172.21.15.112:0/395747004 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:29.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.243+0000 7f4c50e00640 1 -- 172.21.15.112:0/395747004 >> v1:172.21.15.137:6789/0 conn(0x7f4c4c071530 legacy=0x7f4c4c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:29.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.243+0000 7f4c50e00640 1 -- 172.21.15.112:0/395747004 >> v1:172.21.15.112:6789/0 conn(0x7f4c4c15cc50 legacy=0x7f4c4c0732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:29.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.243+0000 7f4c50e00640 1 -- 172.21.15.112:0/395747004 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c4c06e5e0 con 0x7f4c4c0afe30 2024-09-12T02:42:29.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.243+0000 7f4c4b400640 1 -- 172.21.15.112:0/395747004 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4013338323 0 0) 0x7f4c4c0ceeb0 con 0x7f4c4c15cc50 2024-09-12T02:42:29.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.244+0000 7f4c50e00640 1 --2- 172.21.15.112:0/395747004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c4c0afe30 0x7f4c4c0cf950 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4c44009e50 tx=0x7f4c4402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38916911c2cd5287 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:29.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.245+0000 7f4c4b400640 1 -- 172.21.15.112:0/395747004 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c44036070 con 0x7f4c4c0afe30 2024-09-12T02:42:29.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.245+0000 7f4c4b400640 1 -- 172.21.15.112:0/395747004 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c44031600 con 0x7f4c4c0afe30 2024-09-12T02:42:29.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.245+0000 7f4c4b400640 1 -- 172.21.15.112:0/395747004 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c440319d0 con 0x7f4c4c0afe30 2024-09-12T02:42:29.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.245+0000 7f4c52e00640 1 -- 172.21.15.112:0/395747004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c4c0afe30 msgr2=0x7f4c4c0cf950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:29.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.245+0000 7f4c52e00640 1 --2- 172.21.15.112:0/395747004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c4c0afe30 0x7f4c4c0cf950 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4c44009e50 tx=0x7f4c4402a730 comp rx=0 tx=0).stop 2024-09-12T02:42:29.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.245+0000 7f4c52e00640 1 -- 172.21.15.112:0/395747004 shutdown_connections 2024-09-12T02:42:29.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.245+0000 7f4c52e00640 1 --2- 172.21.15.112:0/395747004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c4c0afe30 0x7f4c4c0cf950 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:29.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.245+0000 7f4c52e00640 1 -- 172.21.15.112:0/395747004 >> 172.21.15.112:0/395747004 conn(0x7f4c4c06bbd0 msgr2=0x7f4c4c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:29.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.245+0000 7f4c52e00640 1 -- 172.21.15.112:0/395747004 shutdown_connections 2024-09-12T02:42:29.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.245+0000 7f4c52e00640 1 -- 172.21.15.112:0/395747004 wait complete. 2024-09-12T02:42:29.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.247+0000 7f4c52e00640 1 Processor -- start 2024-09-12T02:42:29.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.247+0000 7f4c52e00640 1 -- start start 2024-09-12T02:42:29.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.248+0000 7f4c52e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c4c071530 0x7f4c4c154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:29.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.248+0000 7f4c52e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c4c0afe30 0x7f4c4c0b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:29.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.248+0000 7f4c52e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c4c15cc50 0x7f4c4c0ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:29.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.248+0000 7f4c52e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4c06f510 con 0x7f4c4c15cc50 2024-09-12T02:42:29.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.248+0000 7f4c52e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4c0cf4c0 con 0x7f4c4c071530 2024-09-12T02:42:29.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.248+0000 7f4c52e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4c4c06f690 con 0x7f4c4c0afe30 2024-09-12T02:42:29.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.248+0000 7f4c50e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c4c15cc50 0x7f4c4c0ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:29.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.248+0000 7f4c50e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c4c15cc50 0x7f4c4c0ae8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52710/0 (socket says 172.21.15.112:52710) 2024-09-12T02:42:29.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.248+0000 7f4c50e00640 1 -- 172.21.15.112:0/377746352 learned_addr learned my addr 172.21.15.112:0/377746352 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:29.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.249+0000 7f4c4be00640 1 --2- 172.21.15.112:0/377746352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c4c071530 0x7f4c4c154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:29.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.249+0000 7f4c50e00640 1 -- 172.21.15.112:0/377746352 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c4c0afe30 msgr2=0x7f4c4c0b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:29.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.249+0000 7f4c43400640 1 --2- 172.21.15.112:0/377746352 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c4c0afe30 0x7f4c4c0b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:29.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.249+0000 7f4c50e00640 1 --2- 172.21.15.112:0/377746352 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c4c0afe30 0x7f4c4c0b50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:29.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.249+0000 7f4c50e00640 1 -- 172.21.15.112:0/377746352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c4c071530 msgr2=0x7f4c4c154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:29.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.249+0000 7f4c50e00640 1 --2- 172.21.15.112:0/377746352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c4c071530 0x7f4c4c154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:29.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.249+0000 7f4c50e00640 1 -- 172.21.15.112:0/377746352 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c4c0b3bf0 con 0x7f4c4c15cc50 2024-09-12T02:42:29.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.249+0000 7f4c4be00640 1 --2- 172.21.15.112:0/377746352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c4c071530 0x7f4c4c154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:42:29.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.249+0000 7f4c50e00640 1 --2- 172.21.15.112:0/377746352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c4c15cc50 0x7f4c4c0ae8d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4c44034040 tx=0x7f4c44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:29.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.249+0000 7f4c48c00640 1 -- 172.21.15.112:0/377746352 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c44041020 con 0x7f4c4c15cc50 2024-09-12T02:42:29.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.249+0000 7f4c48c00640 1 -- 172.21.15.112:0/377746352 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c44037040 con 0x7f4c4c15cc50 2024-09-12T02:42:29.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.249+0000 7f4c48c00640 1 -- 172.21.15.112:0/377746352 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c44036050 con 0x7f4c4c15cc50 2024-09-12T02:42:29.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.249+0000 7f4c52e00640 1 -- 172.21.15.112:0/377746352 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c4c0b3ed0 con 0x7f4c4c15cc50 2024-09-12T02:42:29.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.250+0000 7f4c52e00640 1 -- 172.21.15.112:0/377746352 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c4c0b4490 con 0x7f4c4c15cc50 2024-09-12T02:42:29.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.251+0000 7f4c52e00640 1 -- 172.21.15.112:0/377746352 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c4c068a30 con 0x7f4c4c15cc50 2024-09-12T02:42:29.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.251+0000 7f4c48c00640 1 -- 172.21.15.112:0/377746352 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4c44007bd0 con 0x7f4c4c15cc50 2024-09-12T02:42:29.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.252+0000 7f4c48c00640 1 --2- 172.21.15.112:0/377746352 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4c2806be30 0x7f4c2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:29.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.252+0000 7f4c48c00640 1 -- 172.21.15.112:0/377746352 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4c440ab790 con 0x7f4c4c15cc50 2024-09-12T02:42:29.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.252+0000 7f4c4be00640 1 --2- 172.21.15.112:0/377746352 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4c2806be30 0x7f4c2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:29.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.253+0000 7f4c4be00640 1 --2- 172.21.15.112:0/377746352 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4c2806be30 0x7f4c2806e2f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c000f60 tx=0x7f4c3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:29.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.257+0000 7f4c48c00640 1 -- 172.21.15.112:0/377746352 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4c4404b060 con 0x7f4c4c15cc50 2024-09-12T02:42:29.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.461+0000 7f4c52e00640 1 -- 172.21.15.112:0/377746352 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c4c15b970 con 0x7f4c4c15cc50 2024-09-12T02:42:29.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.462+0000 7f4c48c00640 1 -- 172.21.15.112:0/377746352 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7f4c4407ae20 con 0x7f4c4c15cc50 2024-09-12T02:42:29.463 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:42:29.463 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":8,"btime":"2024-09-12T02:41:56:806041+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3622416380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3622416380},{"type":"v1","addr":"172.21.15.112:6837","nonce":3622416380}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/2779317773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2779317773},{"type":"v1","addr":"172.21.15.137:6834","nonce":2779317773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3005649719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3005649719},{"type":"v1","addr":"172.21.15.112:6835","nonce":3005649719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:41:53.174744+0000","modified":"2024-09-12T02:41:56.211357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/1785309492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1785309492},{"type":"v1","addr":"172.21.15.137:6835","nonce":1785309492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4308]},"id":1}]} 2024-09-12T02:42:29.463 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 8 2024-09-12T02:42:29.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.464+0000 7f4c52e00640 1 -- 172.21.15.112:0/377746352 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4c2806be30 msgr2=0x7f4c2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:29.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.464+0000 7f4c52e00640 1 --2- 172.21.15.112:0/377746352 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4c2806be30 0x7f4c2806e2f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c000f60 tx=0x7f4c3c009040 comp rx=0 tx=0).stop 2024-09-12T02:42:29.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.464+0000 7f4c52e00640 1 -- 172.21.15.112:0/377746352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c4c15cc50 msgr2=0x7f4c4c0ae8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:29.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.464+0000 7f4c52e00640 1 --2- 172.21.15.112:0/377746352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c4c15cc50 0x7f4c4c0ae8d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4c44034040 tx=0x7f4c44004a40 comp rx=0 tx=0).stop 2024-09-12T02:42:29.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.464+0000 7f4c52e00640 1 -- 172.21.15.112:0/377746352 shutdown_connections 2024-09-12T02:42:29.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.464+0000 7f4c52e00640 1 --2- 172.21.15.112:0/377746352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c4c15cc50 0x7f4c4c0ae8d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:29.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.464+0000 7f4c52e00640 1 --2- 172.21.15.112:0/377746352 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c4c0afe30 0x7f4c4c0b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:29.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.464+0000 7f4c52e00640 1 --2- 172.21.15.112:0/377746352 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4c2806be30 0x7f4c2806e2f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:29.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.464+0000 7f4c52e00640 1 --2- 172.21.15.112:0/377746352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c4c071530 0x7f4c4c154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:29.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.464+0000 7f4c52e00640 1 -- 172.21.15.112:0/377746352 >> 172.21.15.112:0/377746352 conn(0x7f4c4c06bbd0 msgr2=0x7f4c4c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:29.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.464+0000 7f4c52e00640 1 -- 172.21.15.112:0/377746352 shutdown_connections 2024-09-12T02:42:29.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.464+0000 7f4c52e00640 1 -- 172.21.15.112:0/377746352 wait complete. 2024-09-12T02:42:29.482 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:42:29.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.634+0000 7ff841c00640 1 Processor -- start 2024-09-12T02:42:29.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.634+0000 7ff841c00640 1 -- start start 2024-09-12T02:42:29.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.636+0000 7ff841c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff83c0afe30 0x7ff83c0cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:29.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.636+0000 7ff841c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff83c0ceeb0 con 0x7ff83c15cc50 2024-09-12T02:42:29.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.636+0000 7ff841c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff83c06e300 con 0x7ff83c071530 2024-09-12T02:42:29.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.636+0000 7ff841c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff83c15d030 con 0x7ff83c0afe30 2024-09-12T02:42:29.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.636+0000 7ff83aa00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff83c15cc50 0x7ff83c0732f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35042/0 (socket says 172.21.15.112:35042) 2024-09-12T02:42:29.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.636+0000 7ff83aa00640 1 -- 172.21.15.112:0/3975955348 learned_addr learned my addr 172.21.15.112:0/3975955348 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:29.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.636+0000 7ff83b400640 1 --2- 172.21.15.112:0/3975955348 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff83c0afe30 0x7ff83c0cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:29.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.636+0000 7ff83a000640 1 -- 172.21.15.112:0/3975955348 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2145716242 0 0) 0x7ff83c0ceeb0 con 0x7ff83c15cc50 2024-09-12T02:42:29.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.636+0000 7ff83a000640 1 -- 172.21.15.112:0/3975955348 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff820003520 con 0x7ff83c15cc50 2024-09-12T02:42:29.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.637+0000 7ff83a000640 1 -- 172.21.15.112:0/3975955348 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3077878750 0 0) 0x7ff820003520 con 0x7ff83c15cc50 2024-09-12T02:42:29.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.637+0000 7ff83a000640 1 -- 172.21.15.112:0/3975955348 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff83c0afe30 msgr2=0x7ff83c0cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:29.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.637+0000 7ff83a000640 1 --2- 172.21.15.112:0/3975955348 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff83c0afe30 0x7ff83c0cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:29.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.637+0000 7ff83a000640 1 -- 172.21.15.112:0/3975955348 >> v1:172.21.15.137:6789/0 conn(0x7ff83c071530 legacy=0x7ff83c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:29.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.637+0000 7ff83a000640 1 -- 172.21.15.112:0/3975955348 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff83c06e5e0 con 0x7ff83c15cc50 2024-09-12T02:42:29.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.637+0000 7ff83a000640 1 -- 172.21.15.112:0/3975955348 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7ff82c001670 con 0x7ff83c15cc50 2024-09-12T02:42:29.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.637+0000 7ff83a000640 1 -- 172.21.15.112:0/3975955348 >> v1:172.21.15.112:6789/0 conn(0x7ff83c15cc50 legacy=0x7ff83c0732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:29.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.637+0000 7ff83a000640 1 --2- 172.21.15.112:0/3975955348 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff8200039e0 0x7ff820003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:29.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.637+0000 7ff83a000640 1 --2- 172.21.15.112:0/3975955348 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff83c0afe30 0x7ff820004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:29.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.637+0000 7ff83a000640 1 --2- 172.21.15.112:0/3975955348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff820004d40 0x7ff8200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:29.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.637+0000 7ff83a000640 1 -- 172.21.15.112:0/3975955348 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff82000ba70 con 0x7ff820004d40 2024-09-12T02:42:29.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.637+0000 7ff83a000640 1 -- 172.21.15.112:0/3975955348 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff82000bc20 con 0x7ff8200039e0 2024-09-12T02:42:29.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.637+0000 7ff83a000640 1 -- 172.21.15.112:0/3975955348 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff82000be20 con 0x7ff83c0afe30 2024-09-12T02:42:29.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.637+0000 7ff83b400640 1 --2- 172.21.15.112:0/3975955348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff820004d40 0x7ff8200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:29.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.637+0000 7ff83aa00640 1 --2- 172.21.15.112:0/3975955348 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff8200039e0 0x7ff820003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:29.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.637+0000 7ff832000640 1 --2- 172.21.15.112:0/3975955348 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff83c0afe30 0x7ff820004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:29.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.638+0000 7ff83b400640 1 -- 172.21.15.112:0/3975955348 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff83c0afe30 msgr2=0x7ff820004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:29.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.638+0000 7ff83b400640 1 --2- 172.21.15.112:0/3975955348 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff83c0afe30 0x7ff820004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:29.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.638+0000 7ff83b400640 1 -- 172.21.15.112:0/3975955348 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff8200039e0 msgr2=0x7ff820003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:29.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.638+0000 7ff83b400640 1 --2- 172.21.15.112:0/3975955348 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff8200039e0 0x7ff820003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:29.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.638+0000 7ff83b400640 1 -- 172.21.15.112:0/3975955348 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff820003520 con 0x7ff820004d40 2024-09-12T02:42:29.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.639+0000 7ff83b400640 1 --2- 172.21.15.112:0/3975955348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff820004d40 0x7ff8200051c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff83c0710c0 tx=0x7ff820005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1028cabf0b8aaa70 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:29.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.639+0000 7ff83a000640 1 -- 172.21.15.112:0/3975955348 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff834037070 con 0x7ff820004d40 2024-09-12T02:42:29.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.639+0000 7ff83a000640 1 -- 172.21.15.112:0/3975955348 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff83402e050 con 0x7ff820004d40 2024-09-12T02:42:29.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.639+0000 7ff83a000640 1 -- 172.21.15.112:0/3975955348 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff834009c10 con 0x7ff820004d40 2024-09-12T02:42:29.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.639+0000 7ff841c00640 1 -- 172.21.15.112:0/3975955348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff820004d40 msgr2=0x7ff8200051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:29.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.639+0000 7ff841c00640 1 --2- 172.21.15.112:0/3975955348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff820004d40 0x7ff8200051c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff83c0710c0 tx=0x7ff820005830 comp rx=0 tx=0).stop 2024-09-12T02:42:29.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.639+0000 7ff83b400640 1 -- 172.21.15.112:0/3975955348 reap_dead start 2024-09-12T02:42:29.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.639+0000 7ff841c00640 1 -- 172.21.15.112:0/3975955348 shutdown_connections 2024-09-12T02:42:29.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.639+0000 7ff841c00640 1 -- 172.21.15.112:0/3975955348 >> 172.21.15.112:0/3975955348 conn(0x7ff83c06bbd0 msgr2=0x7ff83c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:29.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.639+0000 7ff841c00640 1 -- 172.21.15.112:0/3975955348 shutdown_connections 2024-09-12T02:42:29.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.639+0000 7ff841c00640 1 -- 172.21.15.112:0/3975955348 wait complete. 2024-09-12T02:42:29.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.641+0000 7ff841c00640 1 Processor -- start 2024-09-12T02:42:29.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.642+0000 7ff841c00640 1 -- start start 2024-09-12T02:42:29.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.642+0000 7ff841c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff820004d40 0x7ff83c1503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:29.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.642+0000 7ff841c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff83c158580 0x7ff83c0abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:29.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.642+0000 7ff841c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff83c0ae100 0x7ff83c0ae580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:29.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.642+0000 7ff841c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff83c06f510 con 0x7ff83c0ae100 2024-09-12T02:42:29.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.642+0000 7ff841c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff83c0cf4c0 con 0x7ff83c158580 2024-09-12T02:42:29.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.643+0000 7ff841c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff83c06f690 con 0x7ff820004d40 2024-09-12T02:42:29.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.643+0000 7ff83b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff83c0ae100 0x7ff83c0ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:29.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.643+0000 7ff83b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff83c0ae100 0x7ff83c0ae580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52722/0 (socket says 172.21.15.112:52722) 2024-09-12T02:42:29.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.643+0000 7ff83b400640 1 -- 172.21.15.112:0/1580943476 learned_addr learned my addr 172.21.15.112:0/1580943476 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:29.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.643+0000 7ff83aa00640 1 --2- 172.21.15.112:0/1580943476 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff820004d40 0x7ff83c1503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:29.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.643+0000 7ff832000640 1 --2- 172.21.15.112:0/1580943476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff83c158580 0x7ff83c0abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:29.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.643+0000 7ff83b400640 1 -- 172.21.15.112:0/1580943476 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff820004d40 msgr2=0x7ff83c1503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:29.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.643+0000 7ff83b400640 1 --2- 172.21.15.112:0/1580943476 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff820004d40 0x7ff83c1503a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:29.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.643+0000 7ff83b400640 1 -- 172.21.15.112:0/1580943476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff83c158580 msgr2=0x7ff83c0abcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:29.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.643+0000 7ff83b400640 1 --2- 172.21.15.112:0/1580943476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff83c158580 0x7ff83c0abcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:29.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.643+0000 7ff83b400640 1 -- 172.21.15.112:0/1580943476 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff83c0ac550 con 0x7ff83c0ae100 2024-09-12T02:42:29.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.644+0000 7ff83b400640 1 --2- 172.21.15.112:0/1580943476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff83c0ae100 0x7ff83c0ae580 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff83400e230 tx=0x7ff834009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:29.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.644+0000 7ff833400640 1 -- 172.21.15.112:0/1580943476 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff834043020 con 0x7ff83c0ae100 2024-09-12T02:42:29.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.644+0000 7ff833400640 1 -- 172.21.15.112:0/1580943476 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff834003990 con 0x7ff83c0ae100 2024-09-12T02:42:29.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.644+0000 7ff833400640 1 -- 172.21.15.112:0/1580943476 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff834037040 con 0x7ff83c0ae100 2024-09-12T02:42:29.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.644+0000 7ff841c00640 1 -- 172.21.15.112:0/1580943476 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff83c0ac830 con 0x7ff83c0ae100 2024-09-12T02:42:29.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.644+0000 7ff841c00640 1 -- 172.21.15.112:0/1580943476 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff83c1508e0 con 0x7ff83c0ae100 2024-09-12T02:42:29.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.645+0000 7ff841c00640 1 -- 172.21.15.112:0/1580943476 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff83c068a30 con 0x7ff83c0ae100 2024-09-12T02:42:29.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.646+0000 7ff833400640 1 -- 172.21.15.112:0/1580943476 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff834005d10 con 0x7ff83c0ae100 2024-09-12T02:42:29.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.647+0000 7ff833400640 1 --2- 172.21.15.112:0/1580943476 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff81806be30 0x7ff81806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:29.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.647+0000 7ff833400640 1 -- 172.21.15.112:0/1580943476 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff8340ab760 con 0x7ff83c0ae100 2024-09-12T02:42:29.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.647+0000 7ff83aa00640 1 --2- 172.21.15.112:0/1580943476 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff81806be30 0x7ff81806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:29.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.647+0000 7ff83aa00640 1 --2- 172.21.15.112:0/1580943476 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff81806be30 0x7ff81806e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff82c000c00 tx=0x7ff82c001e20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:29.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.651+0000 7ff833400640 1 -- 172.21.15.112:0/1580943476 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff83404d020 con 0x7ff83c0ae100 2024-09-12T02:42:29.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.825+0000 7ff841c00640 1 -- 172.21.15.112:0/1580943476 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff83c06df60 con 0x7ff83c0ae100 2024-09-12T02:42:29.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.826+0000 7ff833400640 1 -- 172.21.15.112:0/1580943476 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16713 (secure 0 0 0) 0x7ff834079bd0 con 0x7ff83c0ae100 2024-09-12T02:42:29.828 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:42:29.828 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":20,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:41:54.774268+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:41:51.222228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:41:52.167920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:42:29.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.828+0000 7ff841c00640 1 -- 172.21.15.112:0/1580943476 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff81806be30 msgr2=0x7ff81806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:29.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.828+0000 7ff841c00640 1 --2- 172.21.15.112:0/1580943476 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff81806be30 0x7ff81806e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff82c000c00 tx=0x7ff82c001e20 comp rx=0 tx=0).stop 2024-09-12T02:42:29.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.828+0000 7ff841c00640 1 -- 172.21.15.112:0/1580943476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff83c0ae100 msgr2=0x7ff83c0ae580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:29.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.828+0000 7ff841c00640 1 --2- 172.21.15.112:0/1580943476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff83c0ae100 0x7ff83c0ae580 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff83400e230 tx=0x7ff834009750 comp rx=0 tx=0).stop 2024-09-12T02:42:29.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.828+0000 7ff841c00640 1 -- 172.21.15.112:0/1580943476 shutdown_connections 2024-09-12T02:42:29.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.828+0000 7ff841c00640 1 --2- 172.21.15.112:0/1580943476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff83c0ae100 0x7ff83c0ae580 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:29.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.828+0000 7ff841c00640 1 --2- 172.21.15.112:0/1580943476 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff81806be30 0x7ff81806e2f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:29.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.828+0000 7ff841c00640 1 --2- 172.21.15.112:0/1580943476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff83c158580 0x7ff83c0abcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:29.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.828+0000 7ff841c00640 1 --2- 172.21.15.112:0/1580943476 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff820004d40 0x7ff83c1503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:29.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.828+0000 7ff841c00640 1 -- 172.21.15.112:0/1580943476 >> 172.21.15.112:0/1580943476 conn(0x7ff83c06bbd0 msgr2=0x7ff83c0b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:29.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.828+0000 7ff841c00640 1 -- 172.21.15.112:0/1580943476 shutdown_connections 2024-09-12T02:42:29.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.829+0000 7ff841c00640 1 -- 172.21.15.112:0/1580943476 wait complete. 2024-09-12T02:42:29.846 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:42:30.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.999+0000 7f2513000640 1 Processor -- start 2024-09-12T02:42:30.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:29.999+0000 7f2513000640 1 -- start start 2024-09-12T02:42:30.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.000+0000 7f2513000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f250c0b3e00 0x7f250c0d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:30.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.000+0000 7f2513000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f250c0d2fb0 con 0x7f250c0d1710 2024-09-12T02:42:30.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.000+0000 7f2513000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f250c0d0b60 con 0x7f250c0b1d70 2024-09-12T02:42:30.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.000+0000 7f2513000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f250c0d3cb0 con 0x7f250c0b3e00 2024-09-12T02:42:30.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.000+0000 7f2511c00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f250c0d1710 0x7f250c0d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35050/0 (socket says 172.21.15.112:35050) 2024-09-12T02:42:30.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.000+0000 7f2511c00640 1 -- 172.21.15.112:0/2029361524 learned_addr learned my addr 172.21.15.112:0/2029361524 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:30.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.001+0000 7f2511200640 1 --2- 172.21.15.112:0/2029361524 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f250c0b3e00 0x7f250c0d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:30.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.001+0000 7f250be00640 1 -- 172.21.15.112:0/2029361524 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3515430135 0 0) 0x7f250c0d2fb0 con 0x7f250c0d1710 2024-09-12T02:42:30.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.001+0000 7f250be00640 1 -- 172.21.15.112:0/2029361524 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24f4003520 con 0x7f250c0d1710 2024-09-12T02:42:30.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.001+0000 7f250be00640 1 -- 172.21.15.112:0/2029361524 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2088166000 0 0) 0x7f250c0d0b60 con 0x7f250c0b1d70 2024-09-12T02:42:30.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.001+0000 7f250be00640 1 -- 172.21.15.112:0/2029361524 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f250c0d2fb0 con 0x7f250c0b1d70 2024-09-12T02:42:30.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.001+0000 7f250be00640 1 -- 172.21.15.112:0/2029361524 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2504533805 0 0) 0x7f24f4003520 con 0x7f250c0d1710 2024-09-12T02:42:30.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.001+0000 7f250be00640 1 -- 172.21.15.112:0/2029361524 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f250c0b3e00 msgr2=0x7f250c0d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:30.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.001+0000 7f250be00640 1 --2- 172.21.15.112:0/2029361524 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f250c0b3e00 0x7f250c0d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:30.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.001+0000 7f250be00640 1 -- 172.21.15.112:0/2029361524 >> v1:172.21.15.137:6789/0 conn(0x7f250c0b1d70 legacy=0x7f250c0b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:30.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.001+0000 7f250be00640 1 -- 172.21.15.112:0/2029361524 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f250c0d3410 con 0x7f250c0d1710 2024-09-12T02:42:30.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.001+0000 7f250be00640 1 -- 172.21.15.112:0/2029361524 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f2500001670 con 0x7f250c0d1710 2024-09-12T02:42:30.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.001+0000 7f250be00640 1 -- 172.21.15.112:0/2029361524 >> v1:172.21.15.112:6789/0 conn(0x7f250c0d1710 legacy=0x7f250c0d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:30.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.001+0000 7f250be00640 1 --2- 172.21.15.112:0/2029361524 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24f4003b70 0x7f24f4003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:30.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.001+0000 7f250be00640 1 --2- 172.21.15.112:0/2029361524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24f4004800 0x7f24f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:30.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.001+0000 7f250be00640 1 --2- 172.21.15.112:0/2029361524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24f40051c0 0x7f24f400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:30.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.001+0000 7f250be00640 1 -- 172.21.15.112:0/2029361524 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f250c0d3cb0 con 0x7f24f40051c0 2024-09-12T02:42:30.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.001+0000 7f250be00640 1 -- 172.21.15.112:0/2029361524 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f24f400bfe0 con 0x7f24f4004800 2024-09-12T02:42:30.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.001+0000 7f250be00640 1 -- 172.21.15.112:0/2029361524 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f24f400c1e0 con 0x7f24f4003b70 2024-09-12T02:42:30.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.001+0000 7f2511200640 1 --2- 172.21.15.112:0/2029361524 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f250c0b3e00 0x7f250c0d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:30.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.001+0000 7f2512600640 1 --2- 172.21.15.112:0/2029361524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24f40051c0 0x7f24f400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:30.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.002+0000 7f2511c00640 1 --2- 172.21.15.112:0/2029361524 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24f4003b70 0x7f24f4003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:30.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.002+0000 7f2511200640 1 --2- 172.21.15.112:0/2029361524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24f4004800 0x7f24f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:30.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.002+0000 7f2512600640 1 -- 172.21.15.112:0/2029361524 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24f4003b70 msgr2=0x7f24f4003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:30.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.002+0000 7f2512600640 1 --2- 172.21.15.112:0/2029361524 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24f4003b70 0x7f24f4003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:30.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.002+0000 7f2512600640 1 -- 172.21.15.112:0/2029361524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24f4004800 msgr2=0x7f24f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:30.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.002+0000 7f2512600640 1 --2- 172.21.15.112:0/2029361524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24f4004800 0x7f24f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:30.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.002+0000 7f2512600640 1 -- 172.21.15.112:0/2029361524 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f4003520 con 0x7f24f40051c0 2024-09-12T02:42:30.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.003+0000 7f2512600640 1 --2- 172.21.15.112:0/2029361524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24f40051c0 0x7f24f400b9c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2504001fc0 tx=0x7f24f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f240729b049214 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:30.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.003+0000 7f250be00640 1 -- 172.21.15.112:0/2029361524 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2504001be0 con 0x7f24f40051c0 2024-09-12T02:42:30.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.003+0000 7f250be00640 1 -- 172.21.15.112:0/2029361524 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2504003b90 con 0x7f24f40051c0 2024-09-12T02:42:30.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.003+0000 7f250be00640 1 -- 172.21.15.112:0/2029361524 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25040050d0 con 0x7f24f40051c0 2024-09-12T02:42:30.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.004+0000 7f2513000640 1 -- 172.21.15.112:0/2029361524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24f40051c0 msgr2=0x7f24f400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:30.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.004+0000 7f2513000640 1 --2- 172.21.15.112:0/2029361524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24f40051c0 0x7f24f400b9c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2504001fc0 tx=0x7f24f4005830 comp rx=0 tx=0).stop 2024-09-12T02:42:30.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.004+0000 7f2512600640 1 -- 172.21.15.112:0/2029361524 reap_dead start 2024-09-12T02:42:30.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.004+0000 7f2513000640 1 -- 172.21.15.112:0/2029361524 shutdown_connections 2024-09-12T02:42:30.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.004+0000 7f2513000640 1 -- 172.21.15.112:0/2029361524 >> 172.21.15.112:0/2029361524 conn(0x7f250c09e030 msgr2=0x7f250c0d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:30.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.004+0000 7f2513000640 1 -- 172.21.15.112:0/2029361524 shutdown_connections 2024-09-12T02:42:30.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.004+0000 7f2513000640 1 -- 172.21.15.112:0/2029361524 wait complete. 2024-09-12T02:42:30.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.005+0000 7f2513000640 1 Processor -- start 2024-09-12T02:42:30.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.006+0000 7f2513000640 1 -- start start 2024-09-12T02:42:30.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.006+0000 7f2513000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24f40051c0 0x7f250c0ba210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:30.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.006+0000 7f2513000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f250c15b890 0x7f250c15bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:30.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.006+0000 7f2513000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f250c0b7f70 0x7f250c0b83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:30.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.006+0000 7f2513000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f250c15f110 con 0x7f250c15b890 2024-09-12T02:42:30.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.006+0000 7f2513000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f250c0d39d0 con 0x7f250c0b7f70 2024-09-12T02:42:30.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.006+0000 7f2513000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f250c15f290 con 0x7f24f40051c0 2024-09-12T02:42:30.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.007+0000 7f2511200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f250c15b890 0x7f250c15bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:30.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.007+0000 7f2511200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f250c15b890 0x7f250c15bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52740/0 (socket says 172.21.15.112:52740) 2024-09-12T02:42:30.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.007+0000 7f2511200640 1 -- 172.21.15.112:0/1562750412 learned_addr learned my addr 172.21.15.112:0/1562750412 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:30.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.007+0000 7f2511c00640 1 --2- 172.21.15.112:0/1562750412 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24f40051c0 0x7f250c0ba210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:30.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.007+0000 7f2512600640 1 --2- 172.21.15.112:0/1562750412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f250c0b7f70 0x7f250c0b83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:30.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.007+0000 7f2511200640 1 -- 172.21.15.112:0/1562750412 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24f40051c0 msgr2=0x7f250c0ba210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:30.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.007+0000 7f2511200640 1 --2- 172.21.15.112:0/1562750412 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24f40051c0 0x7f250c0ba210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:30.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.007+0000 7f2511200640 1 -- 172.21.15.112:0/1562750412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f250c0b7f70 msgr2=0x7f250c0b83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:30.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.007+0000 7f2511200640 1 --2- 172.21.15.112:0/1562750412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f250c0b7f70 0x7f250c0b83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:30.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.007+0000 7f2511200640 1 -- 172.21.15.112:0/1562750412 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f250c1e5d20 con 0x7f250c15b890 2024-09-12T02:42:30.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.007+0000 7f2511c00640 1 --2- 172.21.15.112:0/1562750412 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24f40051c0 0x7f250c0ba210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:42:30.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.007+0000 7f2512600640 1 --2- 172.21.15.112:0/1562750412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f250c0b7f70 0x7f250c0b83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:42:30.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.007+0000 7f2511200640 1 --2- 172.21.15.112:0/1562750412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f250c15b890 0x7f250c15bd10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f24f8011830 tx=0x7f24f8011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:30.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.008+0000 7f2509600640 1 -- 172.21.15.112:0/1562750412 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f800f960 con 0x7f250c15b890 2024-09-12T02:42:30.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.008+0000 7f2509600640 1 -- 172.21.15.112:0/1562750412 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f800fb00 con 0x7f250c15b890 2024-09-12T02:42:30.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.008+0000 7f2513000640 1 -- 172.21.15.112:0/1562750412 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f250c1e5fc0 con 0x7f250c15b890 2024-09-12T02:42:30.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.008+0000 7f2509600640 1 -- 172.21.15.112:0/1562750412 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f8015460 con 0x7f250c15b890 2024-09-12T02:42:30.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.008+0000 7f2513000640 1 -- 172.21.15.112:0/1562750412 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f250c1e6580 con 0x7f250c15b890 2024-09-12T02:42:30.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.009+0000 7f2513000640 1 -- 172.21.15.112:0/1562750412 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f250c0d28d0 con 0x7f250c15b890 2024-09-12T02:42:30.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.010+0000 7f2509600640 1 -- 172.21.15.112:0/1562750412 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f24f8015810 con 0x7f250c15b890 2024-09-12T02:42:30.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.011+0000 7f2509600640 1 --2- 172.21.15.112:0/1562750412 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f24ec06be30 0x7f24ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:30.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.011+0000 7f2509600640 1 -- 172.21.15.112:0/1562750412 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f24f808bb90 con 0x7f250c15b890 2024-09-12T02:42:30.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.011+0000 7f2511c00640 1 --2- 172.21.15.112:0/1562750412 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f24ec06be30 0x7f24ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:30.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.011+0000 7f2511c00640 1 --2- 172.21.15.112:0/1562750412 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f24ec06be30 0x7f24ec06e2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2500001050 tx=0x7f2500009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:30.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.015+0000 7f2509600640 1 -- 172.21.15.112:0/1562750412 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f24f8019030 con 0x7f250c15b890 2024-09-12T02:42:30.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.223+0000 7f2513000640 1 -- 172.21.15.112:0/1562750412 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f250c0b3160 con 0x7f250c15b890 2024-09-12T02:42:30.225 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-12T02:42:30.224+0000 7f0216c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:42:30.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.227+0000 7f2509600640 1 -- 172.21.15.112:0/1562750412 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f24f805a4a0 con 0x7f250c15b890 2024-09-12T02:42:30.228 INFO:teuthology.orchestra.run.smithi112.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:42:30.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.229+0000 7f2513000640 1 -- 172.21.15.112:0/1562750412 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f24ec06be30 msgr2=0x7f24ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:30.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.229+0000 7f2513000640 1 --2- 172.21.15.112:0/1562750412 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f24ec06be30 0x7f24ec06e2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2500001050 tx=0x7f2500009040 comp rx=0 tx=0).stop 2024-09-12T02:42:30.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.229+0000 7f2513000640 1 -- 172.21.15.112:0/1562750412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f250c15b890 msgr2=0x7f250c15bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:30.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.229+0000 7f2513000640 1 --2- 172.21.15.112:0/1562750412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f250c15b890 0x7f250c15bd10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f24f8011830 tx=0x7f24f8011cf0 comp rx=0 tx=0).stop 2024-09-12T02:42:30.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.230+0000 7f2513000640 1 -- 172.21.15.112:0/1562750412 shutdown_connections 2024-09-12T02:42:30.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.230+0000 7f2513000640 1 --2- 172.21.15.112:0/1562750412 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f24ec06be30 0x7f24ec06e2f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:30.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.230+0000 7f2513000640 1 --2- 172.21.15.112:0/1562750412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f250c0b7f70 0x7f250c0b83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:30.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.230+0000 7f2513000640 1 --2- 172.21.15.112:0/1562750412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f250c15b890 0x7f250c15bd10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:30.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.230+0000 7f2513000640 1 --2- 172.21.15.112:0/1562750412 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24f40051c0 0x7f250c0ba210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:30.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.230+0000 7f2513000640 1 -- 172.21.15.112:0/1562750412 >> 172.21.15.112:0/1562750412 conn(0x7f250c09e030 msgr2=0x7f250c0d54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:30.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.230+0000 7f2513000640 1 -- 172.21.15.112:0/1562750412 shutdown_connections 2024-09-12T02:42:30.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.230+0000 7f2513000640 1 -- 172.21.15.112:0/1562750412 wait complete. 2024-09-12T02:42:30.242 INFO:tasks.ceph.mds.b.smithi137.stderr: -6974> 2024-09-12T02:41:58.751+0000 7fc99fc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:42:30.249 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T02:42:30.297 INFO:tasks.ceph.mds.b.smithi137.stdout:starting mds.b at 2024-09-12T02:42:30.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.403+0000 7feac1800640 1 Processor -- start 2024-09-12T02:42:30.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.404+0000 7feac1800640 1 -- start start 2024-09-12T02:42:30.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.405+0000 7feac1800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feabc15cc50 0x7feabc0732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:30.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.405+0000 7feac1800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7feabc071530 0x7feabc0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:30.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.405+0000 7feac1800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feabc073830 con 0x7feabc0719a0 2024-09-12T02:42:30.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.405+0000 7feac1800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7feabc15d030 con 0x7feabc15cc50 2024-09-12T02:42:30.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.405+0000 7feac1800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7feabc0cf4c0 con 0x7feabc071530 2024-09-12T02:42:30.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.405+0000 7feabaa00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feabc15cc50 0x7feabc0732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:30.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.405+0000 7feabaa00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feabc15cc50 0x7feabc0732f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52746/0 (socket says 172.21.15.112:52746) 2024-09-12T02:42:30.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.405+0000 7feabaa00640 1 -- 172.21.15.112:0/1239138474 learned_addr learned my addr 172.21.15.112:0/1239138474 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:30.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.405+0000 7feaba000640 1 --2- 172.21.15.112:0/1239138474 >> v2:172.21.15.137:3300/0 conn(0x7feabc071530 0x7feabc0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:30.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.405+0000 7feabaa00640 1 -- 172.21.15.112:0/1239138474 >> v2:172.21.15.137:3300/0 conn(0x7feabc071530 msgr2=0x7feabc0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:30.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.405+0000 7feabaa00640 1 --2- 172.21.15.112:0/1239138474 >> v2:172.21.15.137:3300/0 conn(0x7feabc071530 0x7feabc0af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:30.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.405+0000 7feabaa00640 1 -- 172.21.15.112:0/1239138474 >> v1:172.21.15.137:6789/0 conn(0x7feabc0719a0 legacy=0x7feabc0cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:30.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.405+0000 7feabaa00640 1 -- 172.21.15.112:0/1239138474 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feabc0ceeb0 con 0x7feabc15cc50 2024-09-12T02:42:30.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.406+0000 7feabaa00640 1 --2- 172.21.15.112:0/1239138474 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feabc15cc50 0x7feabc0732f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feabc06fa40 tx=0x7feaac02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b75e0d0425a90a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:30.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.407+0000 7feab9600640 1 -- 172.21.15.112:0/1239138474 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaac037070 con 0x7feabc15cc50 2024-09-12T02:42:30.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.407+0000 7feab9600640 1 -- 172.21.15.112:0/1239138474 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaac032440 con 0x7feabc15cc50 2024-09-12T02:42:30.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.407+0000 7feab9600640 1 -- 172.21.15.112:0/1239138474 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaac032810 con 0x7feabc15cc50 2024-09-12T02:42:30.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.407+0000 7feac1800640 1 -- 172.21.15.112:0/1239138474 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feabc15cc50 msgr2=0x7feabc0732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:30.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.407+0000 7feac1800640 1 --2- 172.21.15.112:0/1239138474 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feabc15cc50 0x7feabc0732f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feabc06fa40 tx=0x7feaac02a1a0 comp rx=0 tx=0).stop 2024-09-12T02:42:30.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.407+0000 7feac1800640 1 -- 172.21.15.112:0/1239138474 shutdown_connections 2024-09-12T02:42:30.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.407+0000 7feac1800640 1 --2- 172.21.15.112:0/1239138474 >> v2:172.21.15.137:3300/0 conn(0x7feabc071530 0x7feabc0af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:30.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.407+0000 7feac1800640 1 --2- 172.21.15.112:0/1239138474 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feabc15cc50 0x7feabc0732f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:30.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.407+0000 7feac1800640 1 -- 172.21.15.112:0/1239138474 >> 172.21.15.112:0/1239138474 conn(0x7feabc06bbd0 msgr2=0x7feabc06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:30.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.407+0000 7feac1800640 1 -- 172.21.15.112:0/1239138474 shutdown_connections 2024-09-12T02:42:30.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.407+0000 7feac1800640 1 -- 172.21.15.112:0/1239138474 wait complete. 2024-09-12T02:42:30.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.409+0000 7feac1800640 1 Processor -- start 2024-09-12T02:42:30.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.409+0000 7feac1800640 1 -- start start 2024-09-12T02:42:30.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.410+0000 7feac1800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feabc071530 0x7feabc14fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:30.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.410+0000 7feac1800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feabc0719a0 0x7feabc15d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:30.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.410+0000 7feac1800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feabc15cc50 0x7feabc15d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:30.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.410+0000 7feac1800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7feabc0cf150 con 0x7feabc071530 2024-09-12T02:42:30.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.410+0000 7feac1800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7feabc06e5e0 con 0x7feabc15cc50 2024-09-12T02:42:30.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.410+0000 7feac1800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7feabc06f510 con 0x7feabc0719a0 2024-09-12T02:42:30.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.410+0000 7feabaa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feabc071530 0x7feabc14fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:30.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.410+0000 7feabaa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feabc071530 0x7feabc14fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52762/0 (socket says 172.21.15.112:52762) 2024-09-12T02:42:30.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.410+0000 7feabaa00640 1 -- 172.21.15.112:0/815659738 learned_addr learned my addr 172.21.15.112:0/815659738 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:30.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.410+0000 7feaba000640 1 --2- 172.21.15.112:0/815659738 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feabc0719a0 0x7feabc15d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:30.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.410+0000 7feabb400640 1 --2- 172.21.15.112:0/815659738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feabc15cc50 0x7feabc15d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:30.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.411+0000 7feabaa00640 1 -- 172.21.15.112:0/815659738 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feabc0719a0 msgr2=0x7feabc15d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:30.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.411+0000 7feabaa00640 1 --2- 172.21.15.112:0/815659738 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feabc0719a0 0x7feabc15d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:30.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.411+0000 7feabaa00640 1 -- 172.21.15.112:0/815659738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feabc15cc50 msgr2=0x7feabc15d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:30.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.411+0000 7feabaa00640 1 --2- 172.21.15.112:0/815659738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feabc15cc50 0x7feabc15d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:30.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.411+0000 7feabaa00640 1 -- 172.21.15.112:0/815659738 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feabc1500a0 con 0x7feabc071530 2024-09-12T02:42:30.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.411+0000 7feabaa00640 1 --2- 172.21.15.112:0/815659738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feabc071530 0x7feabc14fb60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feaac000c00 tx=0x7feaac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:30.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.411+0000 7feab2a00640 1 -- 172.21.15.112:0/815659738 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaac041020 con 0x7feabc071530 2024-09-12T02:42:30.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.411+0000 7feab2a00640 1 -- 172.21.15.112:0/815659738 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaac0306c0 con 0x7feabc071530 2024-09-12T02:42:30.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.411+0000 7feac1800640 1 -- 172.21.15.112:0/815659738 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feabc150370 con 0x7feabc071530 2024-09-12T02:42:30.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.411+0000 7feab2a00640 1 -- 172.21.15.112:0/815659738 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaac037040 con 0x7feabc071530 2024-09-12T02:42:30.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.412+0000 7feac1800640 1 -- 172.21.15.112:0/815659738 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feabc150930 con 0x7feabc071530 2024-09-12T02:42:30.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.413+0000 7feac1800640 1 -- 172.21.15.112:0/815659738 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feabc068a30 con 0x7feabc071530 2024-09-12T02:42:30.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.413+0000 7feab2a00640 1 -- 172.21.15.112:0/815659738 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feaac044020 con 0x7feabc071530 2024-09-12T02:42:30.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.414+0000 7feab2a00640 1 --2- 172.21.15.112:0/815659738 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fea9c06be30 0x7fea9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:30.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.414+0000 7feab2a00640 1 -- 172.21.15.112:0/815659738 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5795+0+0 (secure 0 0 0) 0x7feaac0ab6b0 con 0x7feabc071530 2024-09-12T02:42:30.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.414+0000 7feaba000640 1 --2- 172.21.15.112:0/815659738 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fea9c06be30 0x7fea9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:30.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.415+0000 7feaba000640 1 --2- 172.21.15.112:0/815659738 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fea9c06be30 0x7fea9c06e2f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7feabc152c80 tx=0x7feaa8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:30.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.419+0000 7feab2a00640 1 -- 172.21.15.112:0/815659738 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feaac04b030 con 0x7feabc071530 2024-09-12T02:42:30.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:30.626+0000 7feac1800640 1 -- 172.21.15.112:0/815659738 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7feabc0730d0 con 0x7feabc071530 2024-09-12T02:42:31.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.232+0000 7feab2a00640 1 -- 172.21.15.112:0/815659738 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7feabc073830 con 0x7feabc071530 2024-09-12T02:42:31.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.235+0000 7feac1800640 1 -- 172.21.15.112:0/815659738 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fea9c06be30 msgr2=0x7fea9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:31.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.235+0000 7feac1800640 1 --2- 172.21.15.112:0/815659738 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fea9c06be30 0x7fea9c06e2f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7feabc152c80 tx=0x7feaa8008040 comp rx=0 tx=0).stop 2024-09-12T02:42:31.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.235+0000 7feac1800640 1 -- 172.21.15.112:0/815659738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feabc071530 msgr2=0x7feabc14fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:31.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.235+0000 7feac1800640 1 --2- 172.21.15.112:0/815659738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feabc071530 0x7feabc14fb60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feaac000c00 tx=0x7feaac0046c0 comp rx=0 tx=0).stop 2024-09-12T02:42:31.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.235+0000 7feac1800640 1 -- 172.21.15.112:0/815659738 shutdown_connections 2024-09-12T02:42:31.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.235+0000 7feac1800640 1 --2- 172.21.15.112:0/815659738 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fea9c06be30 0x7fea9c06e2f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:31.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.235+0000 7feac1800640 1 --2- 172.21.15.112:0/815659738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feabc15cc50 0x7feabc15d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:31.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.235+0000 7feac1800640 1 --2- 172.21.15.112:0/815659738 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feabc0719a0 0x7feabc15d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:31.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.235+0000 7feac1800640 1 --2- 172.21.15.112:0/815659738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feabc071530 0x7feabc14fb60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:31.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.235+0000 7feac1800640 1 -- 172.21.15.112:0/815659738 >> 172.21.15.112:0/815659738 conn(0x7feabc06bbd0 msgr2=0x7feabc06d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:31.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.235+0000 7feac1800640 1 -- 172.21.15.112:0/815659738 shutdown_connections 2024-09-12T02:42:31.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.235+0000 7feac1800640 1 -- 172.21.15.112:0/815659738 wait complete. 2024-09-12T02:42:31.255 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T02:42:31.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.411+0000 7f54b3e00640 1 Processor -- start 2024-09-12T02:42:31.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.411+0000 7f54b3e00640 1 -- start start 2024-09-12T02:42:31.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.412+0000 7f54b3e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f54b41624a0 0x7f54b40d1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:31.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.412+0000 7f54b3e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f54b40d57c0 0x7f54b40d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:31.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.412+0000 7f54b3e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54b40d3250 con 0x7f54b40b4c50 2024-09-12T02:42:31.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.412+0000 7f54b3e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f54b40d2620 con 0x7f54b40d57c0 2024-09-12T02:42:31.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.412+0000 7f54b3e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f54b40b47c0 con 0x7f54b41624a0 2024-09-12T02:42:31.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.412+0000 7f54b2000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f54b40d57c0 0x7f54b40d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:31.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.412+0000 7f54b2000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f54b40d57c0 0x7f54b40d1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52778/0 (socket says 172.21.15.112:52778) 2024-09-12T02:42:31.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.412+0000 7f54b3400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f54b40b4c50 0x7f54b40b50e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35066/0 (socket says 172.21.15.112:35066) 2024-09-12T02:42:31.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.412+0000 7f54b2000640 1 -- 172.21.15.112:0/3801767012 learned_addr learned my addr 172.21.15.112:0/3801767012 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:31.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.413+0000 7f54b2a00640 1 --2- 172.21.15.112:0/3801767012 >> v2:172.21.15.137:3300/0 conn(0x7f54b41624a0 0x7f54b40d1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:31.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.413+0000 7f54b2000640 1 -- 172.21.15.112:0/3801767012 >> v2:172.21.15.137:3300/0 conn(0x7f54b41624a0 msgr2=0x7f54b40d1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:31.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.413+0000 7f54b2000640 1 --2- 172.21.15.112:0/3801767012 >> v2:172.21.15.137:3300/0 conn(0x7f54b41624a0 0x7f54b40d1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:31.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.413+0000 7f54b2000640 1 -- 172.21.15.112:0/3801767012 >> v1:172.21.15.112:6789/0 conn(0x7f54b40b4c50 legacy=0x7f54b40b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:31.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.413+0000 7f54b2000640 1 -- 172.21.15.112:0/3801767012 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54b40d34d0 con 0x7f54b40d57c0 2024-09-12T02:42:31.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.413+0000 7f54b1600640 1 -- 172.21.15.112:0/3801767012 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 627191210 0 0) 0x7f54ac001490 con 0x7f54b40b4c50 2024-09-12T02:42:31.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.414+0000 7f54b2000640 1 --2- 172.21.15.112:0/3801767012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54b40d57c0 0x7f54b40d1b60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f54b408da20 tx=0x7f54a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e0845e70a2a1c4a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:31.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.414+0000 7f54b1600640 1 -- 172.21.15.112:0/3801767012 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a0037070 con 0x7f54b40d57c0 2024-09-12T02:42:31.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.414+0000 7f54b1600640 1 -- 172.21.15.112:0/3801767012 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54a0032440 con 0x7f54b40d57c0 2024-09-12T02:42:31.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.414+0000 7f54b1600640 1 -- 172.21.15.112:0/3801767012 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a0032810 con 0x7f54b40d57c0 2024-09-12T02:42:31.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.415+0000 7f54b3e00640 1 -- 172.21.15.112:0/3801767012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54b40d57c0 msgr2=0x7f54b40d1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:31.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.415+0000 7f54b3e00640 1 --2- 172.21.15.112:0/3801767012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54b40d57c0 0x7f54b40d1b60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f54b408da20 tx=0x7f54a002a270 comp rx=0 tx=0).stop 2024-09-12T02:42:31.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.415+0000 7f54b3e00640 1 -- 172.21.15.112:0/3801767012 shutdown_connections 2024-09-12T02:42:31.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.415+0000 7f54b3e00640 1 --2- 172.21.15.112:0/3801767012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54b40d57c0 0x7f54b40d1b60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:31.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.415+0000 7f54b3e00640 1 --2- 172.21.15.112:0/3801767012 >> v2:172.21.15.137:3300/0 conn(0x7f54b41624a0 0x7f54b40d1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:31.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.415+0000 7f54b3e00640 1 -- 172.21.15.112:0/3801767012 >> 172.21.15.112:0/3801767012 conn(0x7f54b40d4ca0 msgr2=0x7f54b40d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:31.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.415+0000 7f54b3e00640 1 -- 172.21.15.112:0/3801767012 shutdown_connections 2024-09-12T02:42:31.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.415+0000 7f54b3e00640 1 -- 172.21.15.112:0/3801767012 wait complete. 2024-09-12T02:42:31.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.416+0000 7f54b3e00640 1 Processor -- start 2024-09-12T02:42:31.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.417+0000 7f54b3e00640 1 -- start start 2024-09-12T02:42:31.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.417+0000 7f54b3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54b40b4c50 0x7f54b40ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:31.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.417+0000 7f54b3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54b40d57c0 0x7f54b40ba2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:31.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.417+0000 7f54b3e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54b41624a0 0x7f54b41f4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:31.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.417+0000 7f54b3e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f54b40d3d70 con 0x7f54b40d57c0 2024-09-12T02:42:31.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.417+0000 7f54b3e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f54b40d3a90 con 0x7f54b40b4c50 2024-09-12T02:42:31.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.417+0000 7f54b3e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f54b4162880 con 0x7f54b41624a0 2024-09-12T02:42:31.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.418+0000 7f54b2000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54b40d57c0 0x7f54b40ba2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:31.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.418+0000 7f54b2000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54b40d57c0 0x7f54b40ba2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52784/0 (socket says 172.21.15.112:52784) 2024-09-12T02:42:31.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.418+0000 7f54b2000640 1 -- 172.21.15.112:0/3604828163 learned_addr learned my addr 172.21.15.112:0/3604828163 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:31.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.418+0000 7f54b2a00640 1 --2- 172.21.15.112:0/3604828163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54b40b4c50 0x7f54b40ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:31.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.418+0000 7f54b3400640 1 --2- 172.21.15.112:0/3604828163 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54b41624a0 0x7f54b41f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:31.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.418+0000 7f54b2000640 1 -- 172.21.15.112:0/3604828163 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54b41624a0 msgr2=0x7f54b41f4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:31.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.418+0000 7f54b2000640 1 --2- 172.21.15.112:0/3604828163 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54b41624a0 0x7f54b41f4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:31.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.418+0000 7f54b2000640 1 -- 172.21.15.112:0/3604828163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54b40b4c50 msgr2=0x7f54b40ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:31.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.418+0000 7f54b2000640 1 --2- 172.21.15.112:0/3604828163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54b40b4c50 0x7f54b40ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:31.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.418+0000 7f54b2000640 1 -- 172.21.15.112:0/3604828163 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54b40c8700 con 0x7f54b40d57c0 2024-09-12T02:42:31.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.418+0000 7f54b2000640 1 --2- 172.21.15.112:0/3604828163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54b40d57c0 0x7f54b40ba2c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f54a0000c00 tx=0x7f54a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:31.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.419+0000 7f54aaa00640 1 -- 172.21.15.112:0/3604828163 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a0037040 con 0x7f54b40d57c0 2024-09-12T02:42:31.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.419+0000 7f54aaa00640 1 -- 172.21.15.112:0/3604828163 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54a0042070 con 0x7f54b40d57c0 2024-09-12T02:42:31.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.419+0000 7f54aaa00640 1 -- 172.21.15.112:0/3604828163 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a0030880 con 0x7f54b40d57c0 2024-09-12T02:42:31.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.419+0000 7f54b3e00640 1 -- 172.21.15.112:0/3604828163 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54b40c89a0 con 0x7f54b40d57c0 2024-09-12T02:42:31.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.419+0000 7f54b3e00640 1 -- 172.21.15.112:0/3604828163 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54b40c8f60 con 0x7f54b40d57c0 2024-09-12T02:42:31.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.420+0000 7f54b3e00640 1 -- 172.21.15.112:0/3604828163 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54b40d1620 con 0x7f54b40d57c0 2024-09-12T02:42:31.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.421+0000 7f54aaa00640 1 -- 172.21.15.112:0/3604828163 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f54a0030a20 con 0x7f54b40d57c0 2024-09-12T02:42:31.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.421+0000 7f54aaa00640 1 --2- 172.21.15.112:0/3604828163 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f549406be30 0x7f549406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:31.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.422+0000 7f54aaa00640 1 -- 172.21.15.112:0/3604828163 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5795+0+0 (secure 0 0 0) 0x7f54a00ab780 con 0x7f54b40d57c0 2024-09-12T02:42:31.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.422+0000 7f54b2a00640 1 --2- 172.21.15.112:0/3604828163 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f549406be30 0x7f549406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:31.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.422+0000 7f54b2a00640 1 --2- 172.21.15.112:0/3604828163 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f549406be30 0x7f549406e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f54a4009aa0 tx=0x7f54a4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:31.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.426+0000 7f54aaa00640 1 -- 172.21.15.112:0/3604828163 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f54a007a030 con 0x7f54b40d57c0 2024-09-12T02:42:31.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:31.599+0000 7f54b3e00640 1 -- 172.21.15.112:0/3604828163 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f54b40d5490 con 0x7f54b40d57c0 2024-09-12T02:42:32.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.234+0000 7f54aaa00640 1 -- 172.21.15.112:0/3604828163 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) ==== 181+0+0 (secure 0 0 0) 0x7f54a0079930 con 0x7f54b40d57c0 2024-09-12T02:42:32.235 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' removed 2024-09-12T02:42:32.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.238+0000 7f54b3e00640 1 -- 172.21.15.112:0/3604828163 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f549406be30 msgr2=0x7f549406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:32.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.238+0000 7f54b3e00640 1 --2- 172.21.15.112:0/3604828163 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f549406be30 0x7f549406e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f54a4009aa0 tx=0x7f54a4009190 comp rx=0 tx=0).stop 2024-09-12T02:42:32.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.238+0000 7f54b3e00640 1 -- 172.21.15.112:0/3604828163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54b40d57c0 msgr2=0x7f54b40ba2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:32.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.238+0000 7f54b3e00640 1 --2- 172.21.15.112:0/3604828163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54b40d57c0 0x7f54b40ba2c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f54a0000c00 tx=0x7f54a00046c0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.238+0000 7f54b3e00640 1 -- 172.21.15.112:0/3604828163 shutdown_connections 2024-09-12T02:42:32.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.238+0000 7f54b3e00640 1 --2- 172.21.15.112:0/3604828163 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54b41624a0 0x7f54b41f4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.238+0000 7f54b3e00640 1 --2- 172.21.15.112:0/3604828163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54b40d57c0 0x7f54b40ba2c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.238+0000 7f54b3e00640 1 --2- 172.21.15.112:0/3604828163 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f549406be30 0x7f549406e2f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.238+0000 7f54b3e00640 1 --2- 172.21.15.112:0/3604828163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54b40b4c50 0x7f54b40ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.238+0000 7f54b3e00640 1 -- 172.21.15.112:0/3604828163 >> 172.21.15.112:0/3604828163 conn(0x7f54b40d4ca0 msgr2=0x7f54b40b6790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:32.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.238+0000 7f54b3e00640 1 -- 172.21.15.112:0/3604828163 shutdown_connections 2024-09-12T02:42:32.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.238+0000 7f54b3e00640 1 -- 172.21.15.112:0/3604828163 wait complete. 2024-09-12T02:42:32.256 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T02:42:32.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.412+0000 7fcecd000640 1 Processor -- start 2024-09-12T02:42:32.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.412+0000 7fcecd000640 1 -- start start 2024-09-12T02:42:32.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.413+0000 7fcecd000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcec80d10b0 0x7fcec80b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:32.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.413+0000 7fcecd000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcec80b5820 0x7fcec80b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:32.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.414+0000 7fcecd000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcec80af530 con 0x7fcec80b3f70 2024-09-12T02:42:32.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.414+0000 7fcecd000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fcec80af2e0 con 0x7fcec80b5820 2024-09-12T02:42:32.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.414+0000 7fcecd000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fcec80af810 con 0x7fcec80d10b0 2024-09-12T02:42:32.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.414+0000 7fcec6800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fcec80b3f70 0x7fcec806dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46686/0 (socket says 172.21.15.112:46686) 2024-09-12T02:42:32.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.414+0000 7fcec6800640 1 -- 172.21.15.112:0/1064237397 learned_addr learned my addr 172.21.15.112:0/1064237397 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:32.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.414+0000 7fcebd400640 1 --2- 172.21.15.112:0/1064237397 >> v2:172.21.15.137:3300/0 conn(0x7fcec80b5820 0x7fcec80b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:32.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.414+0000 7fcec5e00640 1 --2- 172.21.15.112:0/1064237397 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcec80d10b0 0x7fcec80b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:32.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.414+0000 7fcec5400640 1 -- 172.21.15.112:0/1064237397 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3256947911 0 0) 0x7fcec80af530 con 0x7fcec80b3f70 2024-09-12T02:42:32.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.414+0000 7fcec5400640 1 -- 172.21.15.112:0/1064237397 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fceac003520 con 0x7fcec80b3f70 2024-09-12T02:42:32.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.415+0000 7fcec5e00640 1 -- 172.21.15.112:0/1064237397 >> v2:172.21.15.137:3300/0 conn(0x7fcec80b5820 msgr2=0x7fcec80b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:32.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.415+0000 7fcec5e00640 1 --2- 172.21.15.112:0/1064237397 >> v2:172.21.15.137:3300/0 conn(0x7fcec80b5820 0x7fcec80b3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.415+0000 7fcec5400640 1 -- 172.21.15.112:0/1064237397 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2003963172 0 0) 0x7fceac003520 con 0x7fcec80b3f70 2024-09-12T02:42:32.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.415+0000 7fcec5e00640 1 -- 172.21.15.112:0/1064237397 >> v1:172.21.15.112:6789/0 conn(0x7fcec80b3f70 legacy=0x7fcec806dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:32.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.415+0000 7fcec5e00640 1 -- 172.21.15.112:0/1064237397 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec806d550 con 0x7fcec80d10b0 2024-09-12T02:42:32.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.416+0000 7fcec5e00640 1 --2- 172.21.15.112:0/1064237397 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcec80d10b0 0x7fcec80b3220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fceb80097a0 tx=0x7fceb802a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0f6155b14128003 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:32.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.416+0000 7fcec5400640 1 -- 172.21.15.112:0/1064237397 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb8037070 con 0x7fcec80d10b0 2024-09-12T02:42:32.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.416+0000 7fcec5400640 1 -- 172.21.15.112:0/1064237397 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceb802aba0 con 0x7fcec80d10b0 2024-09-12T02:42:32.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.416+0000 7fcec5400640 1 -- 172.21.15.112:0/1064237397 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec00019f0 con 0x7fcec80d10b0 2024-09-12T02:42:32.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.416+0000 7fcecd000640 1 -- 172.21.15.112:0/1064237397 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcec80d10b0 msgr2=0x7fcec80b3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:32.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.416+0000 7fcecd000640 1 --2- 172.21.15.112:0/1064237397 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcec80d10b0 0x7fcec80b3220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fceb80097a0 tx=0x7fceb802a110 comp rx=0 tx=0).stop 2024-09-12T02:42:32.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.417+0000 7fcecd000640 1 -- 172.21.15.112:0/1064237397 shutdown_connections 2024-09-12T02:42:32.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.417+0000 7fcecd000640 1 --2- 172.21.15.112:0/1064237397 >> v2:172.21.15.137:3300/0 conn(0x7fcec80b5820 0x7fcec80b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.417+0000 7fcecd000640 1 --2- 172.21.15.112:0/1064237397 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcec80d10b0 0x7fcec80b3220 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.417+0000 7fcecd000640 1 -- 172.21.15.112:0/1064237397 >> 172.21.15.112:0/1064237397 conn(0x7fcec80b2730 msgr2=0x7fcec80b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:32.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.417+0000 7fcecd000640 1 -- 172.21.15.112:0/1064237397 shutdown_connections 2024-09-12T02:42:32.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.417+0000 7fcecd000640 1 -- 172.21.15.112:0/1064237397 wait complete. 2024-09-12T02:42:32.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.418+0000 7fcecd000640 1 Processor -- start 2024-09-12T02:42:32.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.418+0000 7fcecd000640 1 -- start start 2024-09-12T02:42:32.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.419+0000 7fcecd000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcec80b3f70 0x7fcec81579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:32.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.419+0000 7fcecd000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcec80b5820 0x7fcec81f7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:32.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.419+0000 7fcecd000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcec80d10b0 0x7fcec81f84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:32.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.419+0000 7fcecd000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcec806e440 con 0x7fcec80d10b0 2024-09-12T02:42:32.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.419+0000 7fcecd000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcec80d1490 con 0x7fcec80b3f70 2024-09-12T02:42:32.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.419+0000 7fcecd000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fcec806e5c0 con 0x7fcec80b5820 2024-09-12T02:42:32.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.420+0000 7fcec6800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcec80d10b0 0x7fcec81f84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:32.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.420+0000 7fcec6800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcec80d10b0 0x7fcec81f84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53200/0 (socket says 172.21.15.112:53200) 2024-09-12T02:42:32.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.420+0000 7fcec6800640 1 -- 172.21.15.112:0/2067922027 learned_addr learned my addr 172.21.15.112:0/2067922027 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:32.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.420+0000 7fcebd400640 1 --2- 172.21.15.112:0/2067922027 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcec80b5820 0x7fcec81f7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:32.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.420+0000 7fcec5e00640 1 --2- 172.21.15.112:0/2067922027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcec80b3f70 0x7fcec81579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:32.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.420+0000 7fcec6800640 1 -- 172.21.15.112:0/2067922027 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcec80b5820 msgr2=0x7fcec81f7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:32.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.420+0000 7fcec6800640 1 --2- 172.21.15.112:0/2067922027 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcec80b5820 0x7fcec81f7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.420+0000 7fcec6800640 1 -- 172.21.15.112:0/2067922027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcec80b3f70 msgr2=0x7fcec81579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:32.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.420+0000 7fcec6800640 1 --2- 172.21.15.112:0/2067922027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcec80b3f70 0x7fcec81579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:32.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.420+0000 7fcec6800640 1 -- 172.21.15.112:0/2067922027 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec81e7630 con 0x7fcec80d10b0 2024-09-12T02:42:32.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.420+0000 7fcec6800640 1 --2- 172.21.15.112:0/2067922027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcec80d10b0 0x7fcec81f84b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcec0002230 tx=0x7fcec000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:32.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.421+0000 7fcebea00640 1 -- 172.21.15.112:0/2067922027 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec000ad40 con 0x7fcec80d10b0 2024-09-12T02:42:32.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.421+0000 7fcebea00640 1 -- 172.21.15.112:0/2067922027 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcec0012400 con 0x7fcec80d10b0 2024-09-12T02:42:32.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.421+0000 7fcebea00640 1 -- 172.21.15.112:0/2067922027 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec0012830 con 0x7fcec80d10b0 2024-09-12T02:42:32.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.421+0000 7fcecd000640 1 -- 172.21.15.112:0/2067922027 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcec81e7910 con 0x7fcec80d10b0 2024-09-12T02:42:32.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.421+0000 7fcecd000640 1 -- 172.21.15.112:0/2067922027 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcec8157f00 con 0x7fcec80d10b0 2024-09-12T02:42:32.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.422+0000 7fcecd000640 1 -- 172.21.15.112:0/2067922027 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcec80b3a30 con 0x7fcec80d10b0 2024-09-12T02:42:32.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.423+0000 7fcebea00640 1 -- 172.21.15.112:0/2067922027 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcec0012be0 con 0x7fcec80d10b0 2024-09-12T02:42:32.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.423+0000 7fcebea00640 1 --2- 172.21.15.112:0/2067922027 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcea406be30 0x7fcea406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:32.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.424+0000 7fcebea00640 1 -- 172.21.15.112:0/2067922027 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5357+0+0 (secure 0 0 0) 0x7fcec008b610 con 0x7fcec80d10b0 2024-09-12T02:42:32.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.424+0000 7fcec5e00640 1 --2- 172.21.15.112:0/2067922027 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcea406be30 0x7fcea406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:32.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.424+0000 7fcec5e00640 1 --2- 172.21.15.112:0/2067922027 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcea406be30 0x7fcea406e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fceb8034000 tx=0x7fceb802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:32.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.428+0000 7fcebea00640 1 -- 172.21.15.112:0/2067922027 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcec0059ad0 con 0x7fcec80d10b0 2024-09-12T02:42:32.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:32.599+0000 7fcecd000640 1 -- 172.21.15.112:0/2067922027 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcec806f3e0 con 0x7fcec80d10b0 2024-09-12T02:42:33.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:33.241+0000 7fcebea00640 1 -- 172.21.15.112:0/2067922027 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) ==== 169+0+0 (secure 0 0 0) 0x7fcec005ddd0 con 0x7fcec80d10b0 2024-09-12T02:42:33.242 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' removed 2024-09-12T02:42:33.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:33.244+0000 7fcecd000640 1 -- 172.21.15.112:0/2067922027 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcea406be30 msgr2=0x7fcea406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:33.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:33.244+0000 7fcecd000640 1 --2- 172.21.15.112:0/2067922027 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcea406be30 0x7fcea406e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fceb8034000 tx=0x7fceb802e000 comp rx=0 tx=0).stop 2024-09-12T02:42:33.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:33.244+0000 7fcecd000640 1 -- 172.21.15.112:0/2067922027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcec80d10b0 msgr2=0x7fcec81f84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:33.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:33.244+0000 7fcecd000640 1 --2- 172.21.15.112:0/2067922027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcec80d10b0 0x7fcec81f84b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcec0002230 tx=0x7fcec000a430 comp rx=0 tx=0).stop 2024-09-12T02:42:33.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:33.245+0000 7fcecd000640 1 -- 172.21.15.112:0/2067922027 shutdown_connections 2024-09-12T02:42:33.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:33.245+0000 7fcecd000640 1 --2- 172.21.15.112:0/2067922027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcec80d10b0 0x7fcec81f84b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:33.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:33.245+0000 7fcecd000640 1 --2- 172.21.15.112:0/2067922027 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcec80b5820 0x7fcec81f7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:33.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:33.245+0000 7fcecd000640 1 --2- 172.21.15.112:0/2067922027 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcea406be30 0x7fcea406e2f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:33.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:33.245+0000 7fcecd000640 1 --2- 172.21.15.112:0/2067922027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcec80b3f70 0x7fcec81579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:33.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:33.245+0000 7fcecd000640 1 -- 172.21.15.112:0/2067922027 >> 172.21.15.112:0/2067922027 conn(0x7fcec80b2730 msgr2=0x7fcec80aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:33.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:33.245+0000 7fcecd000640 1 -- 172.21.15.112:0/2067922027 shutdown_connections 2024-09-12T02:42:33.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:33.246+0000 7fcecd000640 1 -- 172.21.15.112:0/2067922027 wait complete. 2024-09-12T02:42:33.265 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T02:42:33.265 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T02:42:33.265 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T02:42:33.265 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:42:33.266 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T02:42:33.266 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T02:42:33.266 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T02:42:33.266 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:42:33.266 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T02:42:33.266 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T02:42:33.266 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T02:42:33.267 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:42:33.267 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T02:42:33.267 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T02:42:33.267 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T02:42:33.267 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:42:33.284 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T02:42:33.284 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T02:42:33.285 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T02:42:33.286 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T02:42:33.287 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T02:42:33.287 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T02:42:33.330 INFO:tasks.ceph.mds.c:Started 2024-09-12T02:42:33.330 DEBUG:teuthology.parallel:result is None 2024-09-12T02:42:33.332 INFO:tasks.ceph.mds.a:Started 2024-09-12T02:42:33.332 DEBUG:teuthology.parallel:result is None 2024-09-12T02:42:33.333 INFO:tasks.ceph.mds.d:Started 2024-09-12T02:42:33.333 DEBUG:teuthology.parallel:result is None 2024-09-12T02:42:33.459 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2024-09-12T02:42:33.460 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-12T02:42:33.462 INFO:tasks.ceph.mds.c.smithi112.stderr:2024-09-12T02:42:33.461+0000 7f7e6cc00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-12T02:42:33.463 INFO:tasks.ceph.mds.d.smithi137.stdout:starting mds.d at 2024-09-12T02:42:38.330 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-12T02:42:39.287 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T02:42:39.288 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T02:42:39.293 INFO:tasks.ceph.mds.b:Started 2024-09-12T02:42:39.293 DEBUG:teuthology.parallel:result is None 2024-09-12T02:42:39.293 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T02:42:39.430 INFO:tasks.ceph.mds.b.smithi137.stdout:starting mds.b at 2024-09-12T02:42:39.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.457+0000 7fec3be00640 1 Processor -- start 2024-09-12T02:42:39.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.457+0000 7fec3be00640 1 -- start start 2024-09-12T02:42:39.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.458+0000 7fec3be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fec3c0b3e00 0x7fec3c0d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:39.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.458+0000 7fec3be00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec3c0d2fb0 con 0x7fec3c0b1d70 2024-09-12T02:42:39.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.458+0000 7fec3be00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec3c0d0b60 con 0x7fec3c0d1710 2024-09-12T02:42:39.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.458+0000 7fec3be00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fec3c0d3cb0 con 0x7fec3c0b3e00 2024-09-12T02:42:39.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.458+0000 7fec3b400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fec3c0b1d70 0x7fec3c0b2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46710/0 (socket says 172.21.15.112:46710) 2024-09-12T02:42:39.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.458+0000 7fec3b400640 1 -- 172.21.15.112:0/1621896085 learned_addr learned my addr 172.21.15.112:0/1621896085 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:39.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.459+0000 7fec3a000640 1 --2- 172.21.15.112:0/1621896085 >> v2:172.21.15.137:3300/0 conn(0x7fec3c0b3e00 0x7fec3c0d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:39.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.459+0000 7fec39600640 1 -- 172.21.15.112:0/1621896085 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3897809838 0 0) 0x7fec3c0d2fb0 con 0x7fec3c0b1d70 2024-09-12T02:42:39.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.459+0000 7fec39600640 1 -- 172.21.15.112:0/1621896085 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec20003520 con 0x7fec3c0b1d70 2024-09-12T02:42:39.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.459+0000 7fec3a000640 1 -- 172.21.15.112:0/1621896085 >> v1:172.21.15.137:6789/0 conn(0x7fec3c0d1710 legacy=0x7fec3c0d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:39.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.459+0000 7fec3a000640 1 -- 172.21.15.112:0/1621896085 >> v1:172.21.15.112:6789/0 conn(0x7fec3c0b1d70 legacy=0x7fec3c0b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:39.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.459+0000 7fec3a000640 1 -- 172.21.15.112:0/1621896085 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec3c0d3410 con 0x7fec3c0b3e00 2024-09-12T02:42:39.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.460+0000 7fec3a000640 1 --2- 172.21.15.112:0/1621896085 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec3c0b3e00 0x7fec3c0d28d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fec280097a0 tx=0x7fec2802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14594b039332d009 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:39.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.460+0000 7fec39600640 1 -- 172.21.15.112:0/1621896085 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec28037070 con 0x7fec3c0b3e00 2024-09-12T02:42:39.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.461+0000 7fec39600640 1 -- 172.21.15.112:0/1621896085 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec28032440 con 0x7fec3c0b3e00 2024-09-12T02:42:39.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.461+0000 7fec39600640 1 -- 172.21.15.112:0/1621896085 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec280327f0 con 0x7fec3c0b3e00 2024-09-12T02:42:39.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.461+0000 7fec3be00640 1 -- 172.21.15.112:0/1621896085 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec3c0b3e00 msgr2=0x7fec3c0d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:39.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.461+0000 7fec3be00640 1 --2- 172.21.15.112:0/1621896085 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec3c0b3e00 0x7fec3c0d28d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fec280097a0 tx=0x7fec2802a230 comp rx=0 tx=0).stop 2024-09-12T02:42:39.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.461+0000 7fec3be00640 1 -- 172.21.15.112:0/1621896085 shutdown_connections 2024-09-12T02:42:39.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.461+0000 7fec3be00640 1 --2- 172.21.15.112:0/1621896085 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec3c0b3e00 0x7fec3c0d28d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:39.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.461+0000 7fec3be00640 1 -- 172.21.15.112:0/1621896085 >> 172.21.15.112:0/1621896085 conn(0x7fec3c09e030 msgr2=0x7fec3c0d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:39.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.461+0000 7fec3be00640 1 -- 172.21.15.112:0/1621896085 shutdown_connections 2024-09-12T02:42:39.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.461+0000 7fec3be00640 1 -- 172.21.15.112:0/1621896085 wait complete. 2024-09-12T02:42:39.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.463+0000 7fec3be00640 1 Processor -- start 2024-09-12T02:42:39.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.463+0000 7fec3be00640 1 -- start start 2024-09-12T02:42:39.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.464+0000 7fec3be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fec3c0b1d70 0x7fec3c0cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:39.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.464+0000 7fec3be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec3c0b3e00 0x7fec3c0cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:39.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.464+0000 7fec3be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec3c0d1710 0x7fec3c1f7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:39.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.464+0000 7fec3be00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fec3c15f110 con 0x7fec3c0d1710 2024-09-12T02:42:39.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.464+0000 7fec3be00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fec3c0d39d0 con 0x7fec3c0b3e00 2024-09-12T02:42:39.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.464+0000 7fec3be00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fec3c15f290 con 0x7fec3c0b1d70 2024-09-12T02:42:39.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.464+0000 7fec3b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec3c0d1710 0x7fec3c1f7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:39.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.464+0000 7fec3b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec3c0d1710 0x7fec3c1f7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53234/0 (socket says 172.21.15.112:53234) 2024-09-12T02:42:39.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.464+0000 7fec3b400640 1 -- 172.21.15.112:0/2925038853 learned_addr learned my addr 172.21.15.112:0/2925038853 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:39.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.464+0000 7fec3a000640 1 --2- 172.21.15.112:0/2925038853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec3c0b3e00 0x7fec3c0cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:39.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.464+0000 7fec3aa00640 1 --2- 172.21.15.112:0/2925038853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fec3c0b1d70 0x7fec3c0cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:39.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.464+0000 7fec3b400640 1 -- 172.21.15.112:0/2925038853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fec3c0b1d70 msgr2=0x7fec3c0cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:39.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.464+0000 7fec3b400640 1 --2- 172.21.15.112:0/2925038853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fec3c0b1d70 0x7fec3c0cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:39.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.464+0000 7fec3b400640 1 -- 172.21.15.112:0/2925038853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec3c0b3e00 msgr2=0x7fec3c0cbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:39.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.464+0000 7fec3b400640 1 --2- 172.21.15.112:0/2925038853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec3c0b3e00 0x7fec3c0cbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:39.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.465+0000 7fec3b400640 1 -- 172.21.15.112:0/2925038853 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec3c0cf080 con 0x7fec3c0d1710 2024-09-12T02:42:39.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.465+0000 7fec3b400640 1 --2- 172.21.15.112:0/2925038853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec3c0d1710 0x7fec3c1f7a40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fec3400cb70 tx=0x7fec3400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:39.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.465+0000 7fec32a00640 1 -- 172.21.15.112:0/2925038853 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec34017070 con 0x7fec3c0d1710 2024-09-12T02:42:39.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.465+0000 7fec32a00640 1 -- 172.21.15.112:0/2925038853 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec3400ad40 con 0x7fec3c0d1710 2024-09-12T02:42:39.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.465+0000 7fec32a00640 1 -- 172.21.15.112:0/2925038853 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec34012620 con 0x7fec3c0d1710 2024-09-12T02:42:39.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.465+0000 7fec3be00640 1 -- 172.21.15.112:0/2925038853 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec3c0cdfe0 con 0x7fec3c0d1710 2024-09-12T02:42:39.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.465+0000 7fec3be00640 1 -- 172.21.15.112:0/2925038853 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec3c0ce880 con 0x7fec3c0d1710 2024-09-12T02:42:39.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.466+0000 7fec3be00640 1 -- 172.21.15.112:0/2925038853 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec3c0d28d0 con 0x7fec3c0d1710 2024-09-12T02:42:39.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.467+0000 7fec32a00640 1 -- 172.21.15.112:0/2925038853 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fec3401a070 con 0x7fec3c0d1710 2024-09-12T02:42:39.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.468+0000 7fec32a00640 1 --2- 172.21.15.112:0/2925038853 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fec1c06be30 0x7fec1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:39.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.468+0000 7fec32a00640 1 -- 172.21.15.112:0/2925038853 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 4943+0+0 (secure 0 0 0) 0x7fec3408a9c0 con 0x7fec3c0d1710 2024-09-12T02:42:39.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.468+0000 7fec3aa00640 1 --2- 172.21.15.112:0/2925038853 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fec1c06be30 0x7fec1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:39.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.469+0000 7fec3aa00640 1 --2- 172.21.15.112:0/2925038853 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fec1c06be30 0x7fec1c06e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fec2c0016e0 tx=0x7fec2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:39.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.473+0000 7fec32a00640 1 -- 172.21.15.112:0/2925038853 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fec34058f80 con 0x7fec3c0d1710 2024-09-12T02:42:39.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:39.656+0000 7fec3be00640 1 -- 172.21.15.112:0/2925038853 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fec3c068440 con 0x7fec3c0d1710 2024-09-12T02:42:41.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.030+0000 7fec32a00640 1 -- 172.21.15.112:0/2925038853 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) ==== 97+0+0 (secure 0 0 0) 0x7fec3405d280 con 0x7fec3c0d1710 2024-09-12T02:42:41.032 INFO:teuthology.orchestra.run.smithi112.stderr: removed all blocklist entries 2024-09-12T02:42:41.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.032+0000 7fec3be00640 1 -- 172.21.15.112:0/2925038853 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fec1c06be30 msgr2=0x7fec1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:41.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.032+0000 7fec3be00640 1 --2- 172.21.15.112:0/2925038853 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fec1c06be30 0x7fec1c06e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fec2c0016e0 tx=0x7fec2c009040 comp rx=0 tx=0).stop 2024-09-12T02:42:41.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.032+0000 7fec3be00640 1 -- 172.21.15.112:0/2925038853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec3c0d1710 msgr2=0x7fec3c1f7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:41.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.033+0000 7fec3be00640 1 --2- 172.21.15.112:0/2925038853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec3c0d1710 0x7fec3c1f7a40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fec3400cb70 tx=0x7fec3400a430 comp rx=0 tx=0).stop 2024-09-12T02:42:41.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.033+0000 7fec3be00640 1 -- 172.21.15.112:0/2925038853 shutdown_connections 2024-09-12T02:42:41.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.033+0000 7fec3be00640 1 --2- 172.21.15.112:0/2925038853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec3c0d1710 0x7fec3c1f7a40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:41.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.033+0000 7fec3be00640 1 --2- 172.21.15.112:0/2925038853 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fec1c06be30 0x7fec1c06e2f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:41.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.033+0000 7fec3be00640 1 --2- 172.21.15.112:0/2925038853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec3c0b3e00 0x7fec3c0cbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:41.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.033+0000 7fec3be00640 1 --2- 172.21.15.112:0/2925038853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fec3c0b1d70 0x7fec3c0cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:41.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.033+0000 7fec3be00640 1 -- 172.21.15.112:0/2925038853 >> 172.21.15.112:0/2925038853 conn(0x7fec3c09e030 msgr2=0x7fec3c0b8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:41.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.033+0000 7fec3be00640 1 -- 172.21.15.112:0/2925038853 shutdown_connections 2024-09-12T02:42:41.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.033+0000 7fec3be00640 1 -- 172.21.15.112:0/2925038853 wait complete. 2024-09-12T02:42:41.051 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T02:42:41.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.212+0000 7fdefe200640 1 Processor -- start 2024-09-12T02:42:41.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.212+0000 7fdefe200640 1 -- start start 2024-09-12T02:42:41.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.214+0000 7fdefe200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdef815b9a0 0x7fdef806d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:41.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.214+0000 7fdefe200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdef806f270 0x7fdef80b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:41.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.214+0000 7fdefe200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdef80b42c0 con 0x7fdef80b5560 2024-09-12T02:42:41.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.214+0000 7fdefe200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fdef806de70 con 0x7fdef806f270 2024-09-12T02:42:41.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.214+0000 7fdefe200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdef806f690 con 0x7fdef815b9a0 2024-09-12T02:42:41.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.214+0000 7fdefd800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fdef80b5560 0x7fdef80d0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46720/0 (socket says 172.21.15.112:46720) 2024-09-12T02:42:41.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.214+0000 7fdefd800640 1 -- 172.21.15.112:0/4137547455 learned_addr learned my addr 172.21.15.112:0/4137547455 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:41.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.214+0000 7fdef7e00640 1 --2- 172.21.15.112:0/4137547455 >> v2:172.21.15.137:3300/0 conn(0x7fdef806f270 0x7fdef80b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:41.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.214+0000 7fdefce00640 1 --2- 172.21.15.112:0/4137547455 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdef815b9a0 0x7fdef806d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:41.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.214+0000 7fdef7400640 1 -- 172.21.15.112:0/4137547455 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3085920748 0 0) 0x7fdef0001490 con 0x7fdef80b5560 2024-09-12T02:42:41.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.214+0000 7fdef7400640 1 -- 172.21.15.112:0/4137547455 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdee0005730 con 0x7fdef80b5560 2024-09-12T02:42:41.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.215+0000 7fdef7400640 1 -- 172.21.15.112:0/4137547455 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 846127232 0 0) 0x7fdee0005730 con 0x7fdef80b5560 2024-09-12T02:42:41.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.215+0000 7fdef7400640 1 -- 172.21.15.112:0/4137547455 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdef815b9a0 msgr2=0x7fdef806d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:41.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.215+0000 7fdef7400640 1 --2- 172.21.15.112:0/4137547455 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdef815b9a0 0x7fdef806d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:41.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.215+0000 7fdef7400640 1 -- 172.21.15.112:0/4137547455 >> v2:172.21.15.137:3300/0 conn(0x7fdef806f270 msgr2=0x7fdef80b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:41.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.215+0000 7fdef7400640 1 --2- 172.21.15.112:0/4137547455 >> v2:172.21.15.137:3300/0 conn(0x7fdef806f270 0x7fdef80b5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:41.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.215+0000 7fdef7400640 1 -- 172.21.15.112:0/4137547455 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef815bd80 con 0x7fdef80b5560 2024-09-12T02:42:41.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.215+0000 7fdef7400640 1 -- 172.21.15.112:0/4137547455 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7fdef0001bc0 con 0x7fdef80b5560 2024-09-12T02:42:41.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.215+0000 7fdef7e00640 1 --2- 172.21.15.112:0/4137547455 >> v2:172.21.15.137:3300/0 conn(0x7fdef806f270 0x7fdef80b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:41.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.215+0000 7fdefce00640 1 --2- 172.21.15.112:0/4137547455 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdef815b9a0 0x7fdef806d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:41.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.215+0000 7fdef7400640 1 -- 172.21.15.112:0/4137547455 >> v1:172.21.15.112:6789/0 conn(0x7fdef80b5560 legacy=0x7fdef80d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:41.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.215+0000 7fdef7400640 1 --2- 172.21.15.112:0/4137547455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdee0005bc0 0x7fdee0005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:41.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.215+0000 7fdef7400640 1 --2- 172.21.15.112:0/4137547455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdee0006a10 0x7fdee0006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:41.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.215+0000 7fdef7400640 1 --2- 172.21.15.112:0/4137547455 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdef815b9a0 0x7fdee00073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:41.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.215+0000 7fdef7400640 1 -- 172.21.15.112:0/4137547455 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdef806de70 con 0x7fdee0005bc0 2024-09-12T02:42:41.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.215+0000 7fdef7400640 1 -- 172.21.15.112:0/4137547455 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdef806f690 con 0x7fdee0006a10 2024-09-12T02:42:41.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.215+0000 7fdef7400640 1 -- 172.21.15.112:0/4137547455 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdee000dbd0 con 0x7fdef815b9a0 2024-09-12T02:42:41.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.215+0000 7fdefce00640 1 --2- 172.21.15.112:0/4137547455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdee0005bc0 0x7fdee0005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:41.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.215+0000 7fdef7e00640 1 --2- 172.21.15.112:0/4137547455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdee0006a10 0x7fdee0006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:41.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.215+0000 7fdefd800640 1 --2- 172.21.15.112:0/4137547455 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdef815b9a0 0x7fdee00073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:41.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.216+0000 7fdefce00640 1 -- 172.21.15.112:0/4137547455 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdef815b9a0 msgr2=0x7fdee00073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:41.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.216+0000 7fdefce00640 1 --2- 172.21.15.112:0/4137547455 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdef815b9a0 0x7fdee00073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:41.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.216+0000 7fdefce00640 1 -- 172.21.15.112:0/4137547455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdee0006a10 msgr2=0x7fdee0006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:41.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.216+0000 7fdefce00640 1 --2- 172.21.15.112:0/4137547455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdee0006a10 0x7fdee0006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:41.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.216+0000 7fdefce00640 1 -- 172.21.15.112:0/4137547455 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee0005730 con 0x7fdee0005bc0 2024-09-12T02:42:41.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.217+0000 7fdefce00640 1 --2- 172.21.15.112:0/4137547455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdee0005bc0 0x7fdee0005fe0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009c90 tx=0x7fdee0007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b991eb464f95e16b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:41.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.217+0000 7fdef7400640 1 -- 172.21.15.112:0/4137547455 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec036070 con 0x7fdee0005bc0 2024-09-12T02:42:41.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.217+0000 7fdef7400640 1 -- 172.21.15.112:0/4137547455 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeec031400 con 0x7fdee0005bc0 2024-09-12T02:42:41.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.217+0000 7fdef7400640 1 -- 172.21.15.112:0/4137547455 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec009860 con 0x7fdee0005bc0 2024-09-12T02:42:41.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.218+0000 7fdefe200640 1 -- 172.21.15.112:0/4137547455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdee0005bc0 msgr2=0x7fdee0005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:41.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.218+0000 7fdefe200640 1 --2- 172.21.15.112:0/4137547455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdee0005bc0 0x7fdee0005fe0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009c90 tx=0x7fdee0007a40 comp rx=0 tx=0).stop 2024-09-12T02:42:41.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.218+0000 7fdefd800640 1 -- 172.21.15.112:0/4137547455 reap_dead start 2024-09-12T02:42:41.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.218+0000 7fdefe200640 1 -- 172.21.15.112:0/4137547455 shutdown_connections 2024-09-12T02:42:41.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.218+0000 7fdefe200640 1 -- 172.21.15.112:0/4137547455 >> 172.21.15.112:0/4137547455 conn(0x7fdef806bbd0 msgr2=0x7fdef806bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:41.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.218+0000 7fdefe200640 1 -- 172.21.15.112:0/4137547455 shutdown_connections 2024-09-12T02:42:41.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.218+0000 7fdefe200640 1 -- 172.21.15.112:0/4137547455 wait complete. 2024-09-12T02:42:41.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.220+0000 7fdefe200640 1 Processor -- start 2024-09-12T02:42:41.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.220+0000 7fdefe200640 1 -- start start 2024-09-12T02:42:41.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.220+0000 7fdefe200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdee0005bc0 0x7fdef8152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:41.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.221+0000 7fdefe200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdef815ea70 0x7fdef8145490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:41.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.221+0000 7fdefe200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdef80725b0 0x7fdef8072a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:41.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.221+0000 7fdefe200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdef80b4b00 con 0x7fdee0005bc0 2024-09-12T02:42:41.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.221+0000 7fdefe200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdef80b4820 con 0x7fdef815ea70 2024-09-12T02:42:41.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.221+0000 7fdefe200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdef80b5b50 con 0x7fdef80725b0 2024-09-12T02:42:41.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.221+0000 7fdefce00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdee0005bc0 0x7fdef8152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:41.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.221+0000 7fdefce00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdee0005bc0 0x7fdef8152df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53244/0 (socket says 172.21.15.112:53244) 2024-09-12T02:42:41.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.221+0000 7fdefce00640 1 -- 172.21.15.112:0/1070380833 learned_addr learned my addr 172.21.15.112:0/1070380833 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:41.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.221+0000 7fdefd800640 1 --2- 172.21.15.112:0/1070380833 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdef80725b0 0x7fdef8072a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:41.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.221+0000 7fdef7e00640 1 --2- 172.21.15.112:0/1070380833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdef815ea70 0x7fdef8145490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:41.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.221+0000 7fdefce00640 1 -- 172.21.15.112:0/1070380833 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdef80725b0 msgr2=0x7fdef8072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:41.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.221+0000 7fdefce00640 1 --2- 172.21.15.112:0/1070380833 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdef80725b0 0x7fdef8072a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:41.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.221+0000 7fdefce00640 1 -- 172.21.15.112:0/1070380833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdef815ea70 msgr2=0x7fdef8145490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:41.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.221+0000 7fdefce00640 1 --2- 172.21.15.112:0/1070380833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdef815ea70 0x7fdef8145490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:41.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.221+0000 7fdefce00640 1 -- 172.21.15.112:0/1070380833 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef815a700 con 0x7fdee0005bc0 2024-09-12T02:42:41.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.221+0000 7fdefd800640 1 --2- 172.21.15.112:0/1070380833 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdef80725b0 0x7fdef8072a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:41.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.222+0000 7fdefce00640 1 --2- 172.21.15.112:0/1070380833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdee0005bc0 0x7fdef8152df0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009db0 tx=0x7fdeec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:41.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.222+0000 7fdef4c00640 1 -- 172.21.15.112:0/1070380833 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec041020 con 0x7fdee0005bc0 2024-09-12T02:42:41.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.222+0000 7fdef4c00640 1 -- 172.21.15.112:0/1070380833 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeec0093e0 con 0x7fdee0005bc0 2024-09-12T02:42:41.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.222+0000 7fdef4c00640 1 -- 172.21.15.112:0/1070380833 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec036040 con 0x7fdee0005bc0 2024-09-12T02:42:41.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.222+0000 7fdefe200640 1 -- 172.21.15.112:0/1070380833 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdef815a9e0 con 0x7fdee0005bc0 2024-09-12T02:42:41.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.222+0000 7fdefe200640 1 -- 172.21.15.112:0/1070380833 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdef815e550 con 0x7fdee0005bc0 2024-09-12T02:42:41.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.223+0000 7fdefe200640 1 -- 172.21.15.112:0/1070380833 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdef8072f70 con 0x7fdee0005bc0 2024-09-12T02:42:41.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.224+0000 7fdef4c00640 1 -- 172.21.15.112:0/1070380833 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdeec044020 con 0x7fdee0005bc0 2024-09-12T02:42:41.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.225+0000 7fdef4c00640 1 --2- 172.21.15.112:0/1070380833 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fded806be30 0x7fded806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:41.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.225+0000 7fdef4c00640 1 -- 172.21.15.112:0/1070380833 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fdeec0aaff0 con 0x7fdee0005bc0 2024-09-12T02:42:41.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.225+0000 7fdef7e00640 1 --2- 172.21.15.112:0/1070380833 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fded806be30 0x7fded806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:41.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.226+0000 7fdef7e00640 1 --2- 172.21.15.112:0/1070380833 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fded806be30 0x7fded806e2f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdef8151bb0 tx=0x7fdee4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:41.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.229+0000 7fdef4c00640 1 -- 172.21.15.112:0/1070380833 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdeec04b070 con 0x7fdee0005bc0 2024-09-12T02:42:41.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.468+0000 7fdefe200640 1 -- 172.21.15.112:0/1070380833 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fdef80b5020 con 0x7fdee0005bc0 2024-09-12T02:42:41.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.468+0000 7fdef4c00640 1 -- 172.21.15.112:0/1070380833 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7fdeec079cb0 con 0x7fdee0005bc0 2024-09-12T02:42:41.469 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:42:41.469 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:42:41.470 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_dump": [ 2024-09-12T02:42:41.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:42:41.470 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.a", 2024-09-12T02:42:41.470 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmKE09KRAAtNq70LeeB9ENNxX91m10Fg==", 2024-09-12T02:42:41.470 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:42:41.470 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:42:41.470 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:42:41.470 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:42:41.470 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:42:41.471 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:41.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:42:41.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:42:41.471 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.b", 2024-09-12T02:42:41.471 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmMjYTARAAuIrofOOp9Dbrhkt314mhuw==", 2024-09-12T02:42:41.471 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:42:41.471 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:42:41.471 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:42:41.471 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:42:41.471 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:42:41.471 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:41.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:42:41.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:42:41.472 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.c", 2024-09-12T02:42:41.472 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmLQXzMhAAhk28JuqKhfbZtvRu9SSVrw==", 2024-09-12T02:42:41.472 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:42:41.472 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:42:41.472 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:42:41.472 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:42:41.472 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:42:41.472 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:41.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:42:41.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:42:41.473 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.d", 2024-09-12T02:42:41.473 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmaE7JChAAKlyynYJnHLs87BXyMC0xgA==", 2024-09-12T02:42:41.473 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:42:41.473 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:42:41.473 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:42:41.473 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:42:41.473 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:42:41.473 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:41.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:42:41.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:42:41.474 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.0", 2024-09-12T02:42:41.474 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDXVOJmFXfdIRAA+VpZNU0tEN6vAzR2C7nuLg==", 2024-09-12T02:42:41.474 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:42:41.474 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:42:41.474 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:42:41.474 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:42:41.474 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:41.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:42:41.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:42:41.474 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.1", 2024-09-12T02:42:41.475 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDXVOJmcgHyLBAA/OxfdQ1D+uFzbCnm1dJLxw==", 2024-09-12T02:42:41.475 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:42:41.475 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:42:41.475 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:42:41.475 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:42:41.475 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:41.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:42:41.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:42:41.475 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.2", 2024-09-12T02:42:41.475 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDXVOJm0baUNhAAuInNwHut2Xn0kBmjnJhdqw==", 2024-09-12T02:42:41.475 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:42:41.475 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:42:41.475 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:42:41.476 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:42:41.476 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:41.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:42:41.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:42:41.476 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.3", 2024-09-12T02:42:41.476 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDYVOJmL/O3BBAAZhQ4/70wj/2zEbMcfD4hQA==", 2024-09-12T02:42:41.476 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:42:41.476 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:42:41.476 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:42:41.476 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:42:41.476 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:41.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:42:41.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:42:41.476 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.4", 2024-09-12T02:42:41.477 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmC+sJAxAAUQofpG3g8DlGLQ8wUqtuSg==", 2024-09-12T02:42:41.477 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:42:41.477 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:42:41.477 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:42:41.477 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:42:41.477 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:41.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:42:41.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:42:41.477 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.5", 2024-09-12T02:42:41.477 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmY2OSDhAA2rg1HGjWx7G6IzFi6yQ/jQ==", 2024-09-12T02:42:41.477 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:42:41.477 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:42:41.477 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:42:41.478 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:42:41.478 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:41.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:42:41.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:42:41.478 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.6", 2024-09-12T02:42:41.478 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmydoaGRAAh/ozKewnY+RxiZ4EcOFA7A==", 2024-09-12T02:42:41.478 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:42:41.478 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:42:41.478 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:42:41.478 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:42:41.478 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:41.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:42:41.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:42:41.478 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.7", 2024-09-12T02:42:41.479 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmmB7cIhAAVhtz7OuxYBQgEKGvHdY33g==", 2024-09-12T02:42:41.479 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:42:41.479 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:42:41.479 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:42:41.479 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:42:41.479 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:41.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:42:41.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:42:41.479 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.0", 2024-09-12T02:42:41.479 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmaG86ExAAD0SOlJOsLpoQZlgPJIPaxA==", 2024-09-12T02:42:41.479 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:42:41.479 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:42:41.479 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:42:41.479 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:42:41.480 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:42:41.480 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:41.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:42:41.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:42:41.480 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.1", 2024-09-12T02:42:41.480 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmt7AeIBAAGRSEejG29OpANZqtia7KEw==", 2024-09-12T02:42:41.480 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:42:41.480 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:42:41.480 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:42:41.480 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:42:41.480 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:42:41.480 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:41.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:42:41.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:42:41.481 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.2", 2024-09-12T02:42:41.481 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmcUWtGRAAlV/gS/CDZKHb5bjbmDzjlg==", 2024-09-12T02:42:41.481 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:42:41.481 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:42:41.481 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:42:41.481 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:42:41.481 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:42:41.481 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:41.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:42:41.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:42:41.481 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.3", 2024-09-12T02:42:41.481 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJm2M97JhAAHKJoPBf6TN6Nu8muK6wzaw==", 2024-09-12T02:42:41.481 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:42:41.481 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:42:41.482 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:42:41.482 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:42:41.482 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:42:41.482 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:41.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:42:41.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:42:41.482 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.admin", 2024-09-12T02:42:41.482 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDSVOJmhl82NBAAvkcxnsY5u9lYO12FaRbP1A==", 2024-09-12T02:42:41.482 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:42:41.482 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-12T02:42:41.482 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:42:41.482 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:42:41.482 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:42:41.482 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:41.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:42:41.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:42:41.483 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.bootstrap-mds", 2024-09-12T02:42:41.483 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDgVOJm+/KwCRAAF3vCfCEl2C3B8Eq5GUCtqw==", 2024-09-12T02:42:41.483 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:42:41.483 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile bootstrap-mds" 2024-09-12T02:42:41.483 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:41.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:42:41.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:42:41.483 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.bootstrap-mgr", 2024-09-12T02:42:41.483 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDgVOJmmvywCRAAxBB/cFogIjvoGOTYvEJzPQ==", 2024-09-12T02:42:41.483 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:42:41.483 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-12T02:42:41.483 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:41.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:42:41.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:42:41.484 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.bootstrap-osd", 2024-09-12T02:42:41.484 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDgVOJmrgWxCRAAEQrPjQo60zrCmPmp5FaZNA==", 2024-09-12T02:42:41.484 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:42:41.484 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile bootstrap-osd" 2024-09-12T02:42:41.484 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:41.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:42:41.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:42:41.484 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.bootstrap-rbd", 2024-09-12T02:42:41.484 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDgVOJm+w2xCRAAAWXVDRjeHFrXMOwlD/hlbA==", 2024-09-12T02:42:41.484 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:42:41.484 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-12T02:42:41.484 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:41.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:42:41.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:42:41.485 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-12T02:42:41.485 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDgVOJmMBaxCRAAO8HyLIkETphIVAV5SaMehw==", 2024-09-12T02:42:41.485 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:42:41.485 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-12T02:42:41.485 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:41.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:42:41.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:42:41.485 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.bootstrap-rgw", 2024-09-12T02:42:41.485 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDgVOJmzB6xCRAArI1WNuCiPLxbnJ4fgaSDpw==", 2024-09-12T02:42:41.485 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:42:41.485 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-12T02:42:41.485 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:41.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:42:41.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:42:41.486 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.x", 2024-09-12T02:42:41.486 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmftawIhAAAKmfx8khERROoZ8BCLukAw==", 2024-09-12T02:42:41.486 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:42:41.486 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-12T02:42:41.486 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-12T02:42:41.486 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:42:41.486 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:41.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:42:41.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:42:41.486 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.y", 2024-09-12T02:42:41.486 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmcxtNGhAAAXWh1fMrVeFSy2hh3p2Rkw==", 2024-09-12T02:42:41.486 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:42:41.486 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-12T02:42:41.486 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-12T02:42:41.486 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:42:41.487 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:41.487 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:41.487 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:42:41.487 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:42:41.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.470+0000 7fdefe200640 1 -- 172.21.15.112:0/1070380833 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fded806be30 msgr2=0x7fded806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:41.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.470+0000 7fdefe200640 1 --2- 172.21.15.112:0/1070380833 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fded806be30 0x7fded806e2f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdef8151bb0 tx=0x7fdee4008040 comp rx=0 tx=0).stop 2024-09-12T02:42:41.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.470+0000 7fdefe200640 1 -- 172.21.15.112:0/1070380833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdee0005bc0 msgr2=0x7fdef8152df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:41.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.470+0000 7fdefe200640 1 --2- 172.21.15.112:0/1070380833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdee0005bc0 0x7fdef8152df0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009db0 tx=0x7fdeec004730 comp rx=0 tx=0).stop 2024-09-12T02:42:41.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.471+0000 7fdefe200640 1 -- 172.21.15.112:0/1070380833 shutdown_connections 2024-09-12T02:42:41.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.471+0000 7fdefe200640 1 --2- 172.21.15.112:0/1070380833 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdef80725b0 0x7fdef8072a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:41.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.471+0000 7fdefe200640 1 --2- 172.21.15.112:0/1070380833 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fded806be30 0x7fded806e2f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:41.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.471+0000 7fdefe200640 1 --2- 172.21.15.112:0/1070380833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdef815ea70 0x7fdef8145490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:41.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.471+0000 7fdefe200640 1 --2- 172.21.15.112:0/1070380833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdee0005bc0 0x7fdef8152df0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:41.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.471+0000 7fdefe200640 1 -- 172.21.15.112:0/1070380833 >> 172.21.15.112:0/1070380833 conn(0x7fdef806bbd0 msgr2=0x7fdef80b38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:41.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.471+0000 7fdefe200640 1 -- 172.21.15.112:0/1070380833 shutdown_connections 2024-09-12T02:42:41.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.471+0000 7fdefe200640 1 -- 172.21.15.112:0/1070380833 wait complete. 2024-09-12T02:42:41.489 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-12T02:42:41.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.644+0000 7f30a1e00640 1 Processor -- start 2024-09-12T02:42:41.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.645+0000 7f30a1e00640 1 -- start start 2024-09-12T02:42:41.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.646+0000 7f30a1e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f309c06f600 0x7f309c0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:41.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.646+0000 7f30a1e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f309c0b45d0 0x7f309c0728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:41.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.646+0000 7f30a1e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f309c0b4a20 con 0x7f309c15b9d0 2024-09-12T02:42:41.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.646+0000 7f30a1e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f309c0b54a0 con 0x7f309c0b45d0 2024-09-12T02:42:41.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.646+0000 7f30a1e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f309c0b3af0 con 0x7f309c06f600 2024-09-12T02:42:41.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.646+0000 7f309aa00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f309c15b9d0 0x7f309c06eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46726/0 (socket says 172.21.15.112:46726) 2024-09-12T02:42:41.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.646+0000 7f309aa00640 1 -- 172.21.15.112:0/2650482707 learned_addr learned my addr 172.21.15.112:0/2650482707 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:41.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.646+0000 7f3092000640 1 --2- 172.21.15.112:0/2650482707 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f309c06f600 0x7f309c0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:41.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.646+0000 7f309b400640 1 --2- 172.21.15.112:0/2650482707 >> v2:172.21.15.137:3300/0 conn(0x7f309c0b45d0 0x7f309c0728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:41.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.647+0000 7f309a000640 1 -- 172.21.15.112:0/2650482707 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 632078544 0 0) 0x7f309c0b4a20 con 0x7f309c15b9d0 2024-09-12T02:42:41.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.647+0000 7f309a000640 1 -- 172.21.15.112:0/2650482707 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3080003520 con 0x7f309c15b9d0 2024-09-12T02:42:41.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.647+0000 7f309a000640 1 -- 172.21.15.112:0/2650482707 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 608188099 0 0) 0x7f3080003520 con 0x7f309c15b9d0 2024-09-12T02:42:41.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.647+0000 7f309a000640 1 -- 172.21.15.112:0/2650482707 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f309c06f600 msgr2=0x7f309c0b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:41.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.647+0000 7f309a000640 1 --2- 172.21.15.112:0/2650482707 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f309c06f600 0x7f309c0b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:41.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.647+0000 7f309a000640 1 -- 172.21.15.112:0/2650482707 >> v2:172.21.15.137:3300/0 conn(0x7f309c0b45d0 msgr2=0x7f309c0728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:41.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.647+0000 7f309a000640 1 --2- 172.21.15.112:0/2650482707 >> v2:172.21.15.137:3300/0 conn(0x7f309c0b45d0 0x7f309c0728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:41.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.647+0000 7f309a000640 1 -- 172.21.15.112:0/2650482707 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f309c0b3dd0 con 0x7f309c15b9d0 2024-09-12T02:42:41.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.647+0000 7f309a000640 1 -- 172.21.15.112:0/2650482707 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f308c001670 con 0x7f309c15b9d0 2024-09-12T02:42:41.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.647+0000 7f309a000640 1 -- 172.21.15.112:0/2650482707 >> v1:172.21.15.112:6789/0 conn(0x7f309c15b9d0 legacy=0x7f309c06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:41.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.647+0000 7f309a000640 1 --2- 172.21.15.112:0/2650482707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30800039b0 0x7f3080003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:41.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.647+0000 7f309a000640 1 --2- 172.21.15.112:0/2650482707 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3080004800 0x7f3080004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:41.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.647+0000 7f309a000640 1 --2- 172.21.15.112:0/2650482707 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f309c06f600 0x7f30800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:41.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.647+0000 7f309a000640 1 -- 172.21.15.112:0/2650482707 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f309c0b54a0 con 0x7f30800039b0 2024-09-12T02:42:41.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.647+0000 7f309a000640 1 -- 172.21.15.112:0/2650482707 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f309c0b3af0 con 0x7f3080004800 2024-09-12T02:42:41.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.647+0000 7f309a000640 1 -- 172.21.15.112:0/2650482707 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f308000b9c0 con 0x7f309c06f600 2024-09-12T02:42:41.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.647+0000 7f309aa00640 1 --2- 172.21.15.112:0/2650482707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30800039b0 0x7f3080003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:41.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.647+0000 7f3092000640 1 --2- 172.21.15.112:0/2650482707 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3080004800 0x7f3080004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:41.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.647+0000 7f309b400640 1 --2- 172.21.15.112:0/2650482707 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f309c06f600 0x7f30800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:41.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.648+0000 7f309aa00640 1 -- 172.21.15.112:0/2650482707 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f309c06f600 msgr2=0x7f30800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:41.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.648+0000 7f309aa00640 1 --2- 172.21.15.112:0/2650482707 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f309c06f600 0x7f30800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:41.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.648+0000 7f309aa00640 1 -- 172.21.15.112:0/2650482707 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3080004800 msgr2=0x7f3080004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:41.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.648+0000 7f309aa00640 1 --2- 172.21.15.112:0/2650482707 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3080004800 0x7f3080004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:41.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.648+0000 7f309aa00640 1 -- 172.21.15.112:0/2650482707 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3080003520 con 0x7f30800039b0 2024-09-12T02:42:41.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.649+0000 7f309aa00640 1 --2- 172.21.15.112:0/2650482707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30800039b0 0x7f3080003dd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f308c00c290 tx=0x7f3080005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d178f0a772b1fd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:41.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.649+0000 7f309a000640 1 -- 172.21.15.112:0/2650482707 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308c007d50 con 0x7f30800039b0 2024-09-12T02:42:41.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.649+0000 7f309a000640 1 -- 172.21.15.112:0/2650482707 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f308c005af0 con 0x7f30800039b0 2024-09-12T02:42:41.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.649+0000 7f309a000640 1 -- 172.21.15.112:0/2650482707 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308c007070 con 0x7f30800039b0 2024-09-12T02:42:41.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.649+0000 7f30a1e00640 1 -- 172.21.15.112:0/2650482707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30800039b0 msgr2=0x7f3080003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:41.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.649+0000 7f30a1e00640 1 --2- 172.21.15.112:0/2650482707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30800039b0 0x7f3080003dd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f308c00c290 tx=0x7f3080005830 comp rx=0 tx=0).stop 2024-09-12T02:42:41.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.649+0000 7f309b400640 1 -- 172.21.15.112:0/2650482707 reap_dead start 2024-09-12T02:42:41.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.649+0000 7f30a1e00640 1 -- 172.21.15.112:0/2650482707 shutdown_connections 2024-09-12T02:42:41.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.649+0000 7f30a1e00640 1 -- 172.21.15.112:0/2650482707 >> 172.21.15.112:0/2650482707 conn(0x7f309c06bbd0 msgr2=0x7f309c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:41.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.650+0000 7f30a1e00640 1 -- 172.21.15.112:0/2650482707 shutdown_connections 2024-09-12T02:42:41.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.650+0000 7f30a1e00640 1 -- 172.21.15.112:0/2650482707 wait complete. 2024-09-12T02:42:41.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.651+0000 7f30a1e00640 1 Processor -- start 2024-09-12T02:42:41.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.651+0000 7f30a1e00640 1 -- start start 2024-09-12T02:42:41.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.652+0000 7f30a1e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30800039b0 0x7f309c14b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:41.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.652+0000 7f30a1e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f309c1510d0 0x7f309c15e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:41.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.652+0000 7f30a1e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f309c151d30 0x7f309c1521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:41.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.652+0000 7f30a1e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f309c15bf30 con 0x7f30800039b0 2024-09-12T02:42:41.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.652+0000 7f30a1e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f309c15bdb0 con 0x7f309c1510d0 2024-09-12T02:42:41.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.652+0000 7f30a1e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f309c0b4ec0 con 0x7f309c151d30 2024-09-12T02:42:41.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.652+0000 7f309aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30800039b0 0x7f309c14b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:41.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.652+0000 7f309aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30800039b0 0x7f309c14b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53264/0 (socket says 172.21.15.112:53264) 2024-09-12T02:42:41.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.652+0000 7f309aa00640 1 -- 172.21.15.112:0/2612680875 learned_addr learned my addr 172.21.15.112:0/2612680875 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:41.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.653+0000 7f3092000640 1 --2- 172.21.15.112:0/2612680875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f309c1510d0 0x7f309c15e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:41.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.653+0000 7f309b400640 1 --2- 172.21.15.112:0/2612680875 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f309c151d30 0x7f309c1521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:41.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.653+0000 7f309aa00640 1 -- 172.21.15.112:0/2612680875 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f309c151d30 msgr2=0x7f309c1521b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:41.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.653+0000 7f309aa00640 1 --2- 172.21.15.112:0/2612680875 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f309c151d30 0x7f309c1521b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:41.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.653+0000 7f309aa00640 1 -- 172.21.15.112:0/2612680875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f309c1510d0 msgr2=0x7f309c15e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:41.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.653+0000 7f309aa00640 1 --2- 172.21.15.112:0/2612680875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f309c1510d0 0x7f309c15e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:41.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.653+0000 7f309aa00640 1 -- 172.21.15.112:0/2612680875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f309c14f670 con 0x7f30800039b0 2024-09-12T02:42:41.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.653+0000 7f3092000640 1 --2- 172.21.15.112:0/2612680875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f309c1510d0 0x7f309c15e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:41.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.653+0000 7f309aa00640 1 --2- 172.21.15.112:0/2612680875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30800039b0 0x7f309c14b810 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f308c034040 tx=0x7f309c0b3fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:41.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.653+0000 7f3093e00640 1 -- 172.21.15.112:0/2612680875 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308c042070 con 0x7f30800039b0 2024-09-12T02:42:41.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.653+0000 7f3093e00640 1 -- 172.21.15.112:0/2612680875 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f308c007480 con 0x7f30800039b0 2024-09-12T02:42:41.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.653+0000 7f3093e00640 1 -- 172.21.15.112:0/2612680875 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308c001c80 con 0x7f30800039b0 2024-09-12T02:42:41.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.654+0000 7f30a1e00640 1 -- 172.21.15.112:0/2612680875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f309c150630 con 0x7f30800039b0 2024-09-12T02:42:41.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.654+0000 7f30a1e00640 1 -- 172.21.15.112:0/2612680875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f309c0cd0d0 con 0x7f30800039b0 2024-09-12T02:42:41.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.655+0000 7f30a1e00640 1 -- 172.21.15.112:0/2612680875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f309c068a30 con 0x7f30800039b0 2024-09-12T02:42:41.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.656+0000 7f3093e00640 1 -- 172.21.15.112:0/2612680875 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f308c045070 con 0x7f30800039b0 2024-09-12T02:42:41.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.656+0000 7f3093e00640 1 --2- 172.21.15.112:0/2612680875 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f307806be30 0x7f307806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:41.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.656+0000 7f3093e00640 1 -- 172.21.15.112:0/2612680875 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f308c0ab7c0 con 0x7f30800039b0 2024-09-12T02:42:41.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.657+0000 7f3092000640 1 --2- 172.21.15.112:0/2612680875 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f307806be30 0x7f307806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:41.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.657+0000 7f3092000640 1 --2- 172.21.15.112:0/2612680875 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f307806be30 0x7f307806e2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f309c159760 tx=0x7f308400b320 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:41.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.661+0000 7f3093e00640 1 -- 172.21.15.112:0/2612680875 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f309c14f670 con 0x7f30800039b0 2024-09-12T02:42:41.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.894+0000 7f30a1e00640 1 -- 172.21.15.112:0/2612680875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f309c151b10 con 0x7f30800039b0 2024-09-12T02:42:41.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.896+0000 7f3093e00640 1 -- 172.21.15.112:0/2612680875 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f308c005ac0 con 0x7f30800039b0 2024-09-12T02:42:41.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.898+0000 7f30a1e00640 1 -- 172.21.15.112:0/2612680875 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f307806be30 msgr2=0x7f307806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:41.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.898+0000 7f30a1e00640 1 --2- 172.21.15.112:0/2612680875 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f307806be30 0x7f307806e2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f309c159760 tx=0x7f308400b320 comp rx=0 tx=0).stop 2024-09-12T02:42:41.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.898+0000 7f30a1e00640 1 -- 172.21.15.112:0/2612680875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30800039b0 msgr2=0x7f309c14b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:41.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.898+0000 7f30a1e00640 1 --2- 172.21.15.112:0/2612680875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30800039b0 0x7f309c14b810 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f308c034040 tx=0x7f309c0b3fa0 comp rx=0 tx=0).stop 2024-09-12T02:42:41.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.898+0000 7f30a1e00640 1 -- 172.21.15.112:0/2612680875 shutdown_connections 2024-09-12T02:42:41.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.898+0000 7f30a1e00640 1 --2- 172.21.15.112:0/2612680875 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f309c151d30 0x7f309c1521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:41.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.898+0000 7f30a1e00640 1 --2- 172.21.15.112:0/2612680875 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f307806be30 0x7f307806e2f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:41.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.898+0000 7f30a1e00640 1 --2- 172.21.15.112:0/2612680875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f309c1510d0 0x7f309c15e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:41.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.898+0000 7f30a1e00640 1 --2- 172.21.15.112:0/2612680875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30800039b0 0x7f309c14b810 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:41.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.898+0000 7f30a1e00640 1 -- 172.21.15.112:0/2612680875 >> 172.21.15.112:0/2612680875 conn(0x7f309c06bbd0 msgr2=0x7f309c071710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:41.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.898+0000 7f30a1e00640 1 -- 172.21.15.112:0/2612680875 shutdown_connections 2024-09-12T02:42:41.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:41.898+0000 7f30a1e00640 1 -- 172.21.15.112:0/2612680875 wait complete. 2024-09-12T02:42:41.915 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-12T02:42:42.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.069+0000 7fd27f200640 1 Processor -- start 2024-09-12T02:42:42.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.069+0000 7fd27f200640 1 -- start start 2024-09-12T02:42:42.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.070+0000 7fd27f200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd28015f3b0 0x7fd2800732d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:42.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.070+0000 7fd27f200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd2800b4180 0x7fd28015f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:42.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.070+0000 7fd27f200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd28015fcd0 0x7fd280160c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:42.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.070+0000 7fd27f200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd2801607a0 con 0x7fd28015f3b0 2024-09-12T02:42:42.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.070+0000 7fd27f200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd280073810 con 0x7fd2800b4180 2024-09-12T02:42:42.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.070+0000 7fd27f200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd280073ab0 con 0x7fd28015fcd0 2024-09-12T02:42:42.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.070+0000 7fd27de00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd28015f3b0 0x7fd2800732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:42.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.070+0000 7fd27de00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd28015f3b0 0x7fd2800732d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49860/0 (socket says 172.21.15.112:49860) 2024-09-12T02:42:42.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.070+0000 7fd27de00640 1 -- 172.21.15.112:0/57648267 learned_addr learned my addr 172.21.15.112:0/57648267 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:42.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.071+0000 7fd27de00640 1 -- 172.21.15.112:0/57648267 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd28015fcd0 msgr2=0x7fd280160c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:42.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.071+0000 7fd27de00640 1 --2- 172.21.15.112:0/57648267 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd28015fcd0 0x7fd280160c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:42.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.071+0000 7fd27de00640 1 -- 172.21.15.112:0/57648267 >> v2:172.21.15.137:3300/0 conn(0x7fd2800b4180 msgr2=0x7fd28015f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:42.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.071+0000 7fd27de00640 1 --2- 172.21.15.112:0/57648267 >> v2:172.21.15.137:3300/0 conn(0x7fd2800b4180 0x7fd28015f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:42.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.071+0000 7fd27de00640 1 -- 172.21.15.112:0/57648267 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd280073d90 con 0x7fd28015f3b0 2024-09-12T02:42:42.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.071+0000 7fd27de00640 1 --2- 172.21.15.112:0/57648267 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd28015f3b0 0x7fd2800732d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd280071260 tx=0x7fd27002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4511836fefc44c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:42.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.072+0000 7fd27ca00640 1 -- 172.21.15.112:0/57648267 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd270037070 con 0x7fd28015f3b0 2024-09-12T02:42:42.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.072+0000 7fd27ca00640 1 -- 172.21.15.112:0/57648267 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd270032440 con 0x7fd28015f3b0 2024-09-12T02:42:42.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.072+0000 7fd27ca00640 1 -- 172.21.15.112:0/57648267 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd270032810 con 0x7fd28015f3b0 2024-09-12T02:42:42.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.072+0000 7fd27f200640 1 -- 172.21.15.112:0/57648267 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd28015f3b0 msgr2=0x7fd2800732d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:42.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.072+0000 7fd27f200640 1 --2- 172.21.15.112:0/57648267 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd28015f3b0 0x7fd2800732d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd280071260 tx=0x7fd27002a140 comp rx=0 tx=0).stop 2024-09-12T02:42:42.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.072+0000 7fd27f200640 1 -- 172.21.15.112:0/57648267 shutdown_connections 2024-09-12T02:42:42.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.072+0000 7fd27f200640 1 --2- 172.21.15.112:0/57648267 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd28015fcd0 0x7fd280160c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:42.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.072+0000 7fd27f200640 1 --2- 172.21.15.112:0/57648267 >> v2:172.21.15.137:3300/0 conn(0x7fd2800b4180 0x7fd28015f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:42.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.072+0000 7fd27f200640 1 --2- 172.21.15.112:0/57648267 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd28015f3b0 0x7fd2800732d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:42.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.072+0000 7fd27f200640 1 -- 172.21.15.112:0/57648267 >> 172.21.15.112:0/57648267 conn(0x7fd280072420 msgr2=0x7fd2800b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:42.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.073+0000 7fd27f200640 1 -- 172.21.15.112:0/57648267 shutdown_connections 2024-09-12T02:42:42.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.073+0000 7fd27f200640 1 -- 172.21.15.112:0/57648267 wait complete. 2024-09-12T02:42:42.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.074+0000 7fd27f200640 1 Processor -- start 2024-09-12T02:42:42.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.074+0000 7fd27f200640 1 -- start start 2024-09-12T02:42:42.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.075+0000 7fd27f200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2800b4180 0x7fd2800ae160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:42.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.075+0000 7fd27f200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd28015f3b0 0x7fd2801597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:42.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.075+0000 7fd27f200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd28015fcd0 0x7fd2800af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:42.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.075+0000 7fd27f200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd280161170 con 0x7fd2800b4180 2024-09-12T02:42:42.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.075+0000 7fd27f200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd280160120 con 0x7fd28015fcd0 2024-09-12T02:42:42.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.075+0000 7fd27f200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd2801612f0 con 0x7fd28015f3b0 2024-09-12T02:42:42.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.075+0000 7fd27de00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2800b4180 0x7fd2800ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:42.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.075+0000 7fd27de00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2800b4180 0x7fd2800ae160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49872/0 (socket says 172.21.15.112:49872) 2024-09-12T02:42:42.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.075+0000 7fd27de00640 1 -- 172.21.15.112:0/3826914201 learned_addr learned my addr 172.21.15.112:0/3826914201 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:42.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.076+0000 7fd27d400640 1 --2- 172.21.15.112:0/3826914201 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd28015f3b0 0x7fd2801597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:42.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.076+0000 7fd27e800640 1 --2- 172.21.15.112:0/3826914201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd28015fcd0 0x7fd2800af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:42.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.076+0000 7fd27de00640 1 -- 172.21.15.112:0/3826914201 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd28015f3b0 msgr2=0x7fd2801597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:42.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.076+0000 7fd27de00640 1 --2- 172.21.15.112:0/3826914201 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd28015f3b0 0x7fd2801597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:42.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.076+0000 7fd27de00640 1 -- 172.21.15.112:0/3826914201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd28015fcd0 msgr2=0x7fd2800af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:42.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.076+0000 7fd27de00640 1 --2- 172.21.15.112:0/3826914201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd28015fcd0 0x7fd2800af860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:42.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.076+0000 7fd27de00640 1 -- 172.21.15.112:0/3826914201 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2800ae990 con 0x7fd2800b4180 2024-09-12T02:42:42.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.076+0000 7fd27d400640 1 --2- 172.21.15.112:0/3826914201 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd28015f3b0 0x7fd2801597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:42.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.076+0000 7fd27e800640 1 --2- 172.21.15.112:0/3826914201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd28015fcd0 0x7fd2800af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:42.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.076+0000 7fd27de00640 1 --2- 172.21.15.112:0/3826914201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2800b4180 0x7fd2800ae160 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd27002a180 tx=0x7fd2700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:42.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.076+0000 7fd276000640 1 -- 172.21.15.112:0/3826914201 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd270041070 con 0x7fd2800b4180 2024-09-12T02:42:42.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.076+0000 7fd276000640 1 -- 172.21.15.112:0/3826914201 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd27003c870 con 0x7fd2800b4180 2024-09-12T02:42:42.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.076+0000 7fd27f200640 1 -- 172.21.15.112:0/3826914201 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2800aec70 con 0x7fd2800b4180 2024-09-12T02:42:42.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.076+0000 7fd276000640 1 -- 172.21.15.112:0/3826914201 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd270037040 con 0x7fd2800b4180 2024-09-12T02:42:42.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.077+0000 7fd27f200640 1 -- 172.21.15.112:0/3826914201 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2800ae6a0 con 0x7fd2800b4180 2024-09-12T02:42:42.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.078+0000 7fd27f200640 1 -- 172.21.15.112:0/3826914201 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2800732d0 con 0x7fd2800b4180 2024-09-12T02:42:42.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.078+0000 7fd276000640 1 -- 172.21.15.112:0/3826914201 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd270044070 con 0x7fd2800b4180 2024-09-12T02:42:42.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.079+0000 7fd276000640 1 --2- 172.21.15.112:0/3826914201 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd26006be30 0x7fd26006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:42.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.079+0000 7fd276000640 1 -- 172.21.15.112:0/3826914201 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fd2700ab770 con 0x7fd2800b4180 2024-09-12T02:42:42.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.079+0000 7fd27d400640 1 --2- 172.21.15.112:0/3826914201 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd26006be30 0x7fd26006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:42.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.080+0000 7fd27d400640 1 --2- 172.21.15.112:0/3826914201 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd26006be30 0x7fd26006e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd2800d0490 tx=0x7fd26c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:42.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.084+0000 7fd276000640 1 -- 172.21.15.112:0/3826914201 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd27007a3d0 con 0x7fd2800b4180 2024-09-12T02:42:42.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.318+0000 7fd27f200640 1 -- 172.21.15.112:0/3826914201 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fd28015dba0 con 0x7fd2800b4180 2024-09-12T02:42:42.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.320+0000 7fd276000640 1 -- 172.21.15.112:0/3826914201 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7fd270079cd0 con 0x7fd2800b4180 2024-09-12T02:42:42.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.322+0000 7fd27f200640 1 -- 172.21.15.112:0/3826914201 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd26006be30 msgr2=0x7fd26006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:42.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.322+0000 7fd27f200640 1 --2- 172.21.15.112:0/3826914201 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd26006be30 0x7fd26006e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd2800d0490 tx=0x7fd26c008040 comp rx=0 tx=0).stop 2024-09-12T02:42:42.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.322+0000 7fd27f200640 1 -- 172.21.15.112:0/3826914201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2800b4180 msgr2=0x7fd2800ae160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:42.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.322+0000 7fd27f200640 1 --2- 172.21.15.112:0/3826914201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2800b4180 0x7fd2800ae160 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd27002a180 tx=0x7fd2700046c0 comp rx=0 tx=0).stop 2024-09-12T02:42:42.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.322+0000 7fd27f200640 1 -- 172.21.15.112:0/3826914201 shutdown_connections 2024-09-12T02:42:42.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.322+0000 7fd27f200640 1 --2- 172.21.15.112:0/3826914201 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd26006be30 0x7fd26006e2f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:42.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.322+0000 7fd27f200640 1 --2- 172.21.15.112:0/3826914201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd28015fcd0 0x7fd2800af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:42.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.322+0000 7fd27f200640 1 --2- 172.21.15.112:0/3826914201 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd28015f3b0 0x7fd2801597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:42.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.322+0000 7fd27f200640 1 --2- 172.21.15.112:0/3826914201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2800b4180 0x7fd2800ae160 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:42.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.322+0000 7fd27f200640 1 -- 172.21.15.112:0/3826914201 >> 172.21.15.112:0/3826914201 conn(0x7fd280072420 msgr2=0x7fd28015e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:42.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.322+0000 7fd27f200640 1 -- 172.21.15.112:0/3826914201 shutdown_connections 2024-09-12T02:42:42.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.323+0000 7fd27f200640 1 -- 172.21.15.112:0/3826914201 wait complete. 2024-09-12T02:42:42.338 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-12T02:42:42.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.490+0000 7fd838000640 1 Processor -- start 2024-09-12T02:42:42.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.490+0000 7fd838000640 1 -- start start 2024-09-12T02:42:42.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.491+0000 7fd838000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd83006d8c0 0x7fd8300afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:42.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.491+0000 7fd838000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd8300ae8d0 0x7fd8300715a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:42.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.492+0000 7fd838000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8300aedd0 con 0x7fd83006dca0 2024-09-12T02:42:42.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.492+0000 7fd838000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd8300af0b0 con 0x7fd8300ae8d0 2024-09-12T02:42:42.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.492+0000 7fd838000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd8300af390 con 0x7fd83006d8c0 2024-09-12T02:42:42.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.492+0000 7fd834c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd8300ae8d0 0x7fd8300715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:42.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.492+0000 7fd834c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd8300ae8d0 0x7fd8300715a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49874/0 (socket says 172.21.15.112:49874) 2024-09-12T02:42:42.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.492+0000 7fd834c00640 1 -- 172.21.15.112:0/2891358236 learned_addr learned my addr 172.21.15.112:0/2891358236 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:42.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.492+0000 7fd835600640 1 --2- 172.21.15.112:0/2891358236 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd83006d8c0 0x7fd8300afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:42.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.492+0000 7fd834c00640 1 -- 172.21.15.112:0/2891358236 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd83006d8c0 msgr2=0x7fd8300afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:42.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.492+0000 7fd834c00640 1 --2- 172.21.15.112:0/2891358236 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd83006d8c0 0x7fd8300afe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:42.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.492+0000 7fd834c00640 1 -- 172.21.15.112:0/2891358236 >> v1:172.21.15.137:6789/0 conn(0x7fd83006dca0 legacy=0x7fd83006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:42.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.492+0000 7fd834c00640 1 -- 172.21.15.112:0/2891358236 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8300af670 con 0x7fd8300ae8d0 2024-09-12T02:42:42.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.493+0000 7fd834c00640 1 --2- 172.21.15.112:0/2891358236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8300ae8d0 0x7fd8300715a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd81c009850 tx=0x7fd81c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334b5c4f64061565 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:42.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.494+0000 7fd82fe00640 1 -- 172.21.15.112:0/2891358236 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81c004030 con 0x7fd8300ae8d0 2024-09-12T02:42:42.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.494+0000 7fd82fe00640 1 -- 172.21.15.112:0/2891358236 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd81c0041d0 con 0x7fd8300ae8d0 2024-09-12T02:42:42.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.494+0000 7fd82fe00640 1 -- 172.21.15.112:0/2891358236 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81c003610 con 0x7fd8300ae8d0 2024-09-12T02:42:42.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.494+0000 7fd838000640 1 -- 172.21.15.112:0/2891358236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8300ae8d0 msgr2=0x7fd8300715a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:42.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.494+0000 7fd838000640 1 --2- 172.21.15.112:0/2891358236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8300ae8d0 0x7fd8300715a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd81c009850 tx=0x7fd81c02a230 comp rx=0 tx=0).stop 2024-09-12T02:42:42.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.494+0000 7fd838000640 1 -- 172.21.15.112:0/2891358236 shutdown_connections 2024-09-12T02:42:42.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.494+0000 7fd838000640 1 --2- 172.21.15.112:0/2891358236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8300ae8d0 0x7fd8300715a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:42.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.494+0000 7fd838000640 1 --2- 172.21.15.112:0/2891358236 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd83006d8c0 0x7fd8300afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:42.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.494+0000 7fd838000640 1 -- 172.21.15.112:0/2891358236 >> 172.21.15.112:0/2891358236 conn(0x7fd83006bbd0 msgr2=0x7fd83006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:42.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.494+0000 7fd838000640 1 -- 172.21.15.112:0/2891358236 shutdown_connections 2024-09-12T02:42:42.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.494+0000 7fd838000640 1 -- 172.21.15.112:0/2891358236 wait complete. 2024-09-12T02:42:42.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.496+0000 7fd838000640 1 Processor -- start 2024-09-12T02:42:42.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.496+0000 7fd838000640 1 -- start start 2024-09-12T02:42:42.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.497+0000 7fd838000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd83006d8c0 0x7fd83014b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:42.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.497+0000 7fd838000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd83006dca0 0x7fd830159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:42.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.497+0000 7fd838000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd8300ae8d0 0x7fd8300cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:42.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.497+0000 7fd838000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd8300b38e0 con 0x7fd83006d8c0 2024-09-12T02:42:42.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.497+0000 7fd838000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd830071ae0 con 0x7fd83006dca0 2024-09-12T02:42:42.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.497+0000 7fd838000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd8300b3a60 con 0x7fd8300ae8d0 2024-09-12T02:42:42.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.497+0000 7fd835600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd83006d8c0 0x7fd83014b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:42.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.497+0000 7fd835600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd83006d8c0 0x7fd83014b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49882/0 (socket says 172.21.15.112:49882) 2024-09-12T02:42:42.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.497+0000 7fd835600640 1 -- 172.21.15.112:0/1966168193 learned_addr learned my addr 172.21.15.112:0/1966168193 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:42.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.497+0000 7fd836000640 1 --2- 172.21.15.112:0/1966168193 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd8300ae8d0 0x7fd8300cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:42.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.497+0000 7fd834c00640 1 --2- 172.21.15.112:0/1966168193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd83006dca0 0x7fd830159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:42.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.497+0000 7fd835600640 1 -- 172.21.15.112:0/1966168193 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd8300ae8d0 msgr2=0x7fd8300cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:42.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.497+0000 7fd835600640 1 --2- 172.21.15.112:0/1966168193 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd8300ae8d0 0x7fd8300cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:42.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.497+0000 7fd835600640 1 -- 172.21.15.112:0/1966168193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd83006dca0 msgr2=0x7fd830159d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:42.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.497+0000 7fd835600640 1 --2- 172.21.15.112:0/1966168193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd83006dca0 0x7fd830159d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:42.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.497+0000 7fd835600640 1 -- 172.21.15.112:0/1966168193 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd83015a860 con 0x7fd83006d8c0 2024-09-12T02:42:42.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.498+0000 7fd835600640 1 --2- 172.21.15.112:0/1966168193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd83006d8c0 0x7fd83014b5f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd82400e9b0 tx=0x7fd82400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:42.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.498+0000 7fd82d600640 1 -- 172.21.15.112:0/1966168193 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824017070 con 0x7fd83006d8c0 2024-09-12T02:42:42.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.498+0000 7fd82d600640 1 -- 172.21.15.112:0/1966168193 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd82400c9a0 con 0x7fd83006d8c0 2024-09-12T02:42:42.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.498+0000 7fd82d600640 1 -- 172.21.15.112:0/1966168193 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82400cd90 con 0x7fd83006d8c0 2024-09-12T02:42:42.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.498+0000 7fd838000640 1 -- 172.21.15.112:0/1966168193 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd83015ab40 con 0x7fd83006d8c0 2024-09-12T02:42:42.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.498+0000 7fd838000640 1 -- 172.21.15.112:0/1966168193 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8301f5850 con 0x7fd83006d8c0 2024-09-12T02:42:42.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.499+0000 7fd838000640 1 -- 172.21.15.112:0/1966168193 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd830068a30 con 0x7fd83006d8c0 2024-09-12T02:42:42.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.500+0000 7fd82d600640 1 -- 172.21.15.112:0/1966168193 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd82401a070 con 0x7fd83006d8c0 2024-09-12T02:42:42.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.501+0000 7fd82d600640 1 --2- 172.21.15.112:0/1966168193 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd81006be30 0x7fd81006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:42.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.501+0000 7fd82d600640 1 -- 172.21.15.112:0/1966168193 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fd82408af20 con 0x7fd83006d8c0 2024-09-12T02:42:42.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.501+0000 7fd834c00640 1 --2- 172.21.15.112:0/1966168193 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd81006be30 0x7fd81006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:42.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.502+0000 7fd834c00640 1 --2- 172.21.15.112:0/1966168193 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd81006be30 0x7fd81006e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd81c033000 tx=0x7fd81c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:42.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.505+0000 7fd82d600640 1 -- 172.21.15.112:0/1966168193 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd824059c10 con 0x7fd83006d8c0 2024-09-12T02:42:42.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.739+0000 7fd838000640 1 -- 172.21.15.112:0/1966168193 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fd8300ccc80 con 0x7fd83006d8c0 2024-09-12T02:42:42.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.742+0000 7fd82d600640 1 -- 172.21.15.112:0/1966168193 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7fd824059510 con 0x7fd83006d8c0 2024-09-12T02:42:42.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.744+0000 7fd838000640 1 -- 172.21.15.112:0/1966168193 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd81006be30 msgr2=0x7fd81006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:42.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.744+0000 7fd838000640 1 --2- 172.21.15.112:0/1966168193 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd81006be30 0x7fd81006e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd81c033000 tx=0x7fd81c02e000 comp rx=0 tx=0).stop 2024-09-12T02:42:42.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.744+0000 7fd838000640 1 -- 172.21.15.112:0/1966168193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd83006d8c0 msgr2=0x7fd83014b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:42.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.744+0000 7fd838000640 1 --2- 172.21.15.112:0/1966168193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd83006d8c0 0x7fd83014b5f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd82400e9b0 tx=0x7fd82400ee70 comp rx=0 tx=0).stop 2024-09-12T02:42:42.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.744+0000 7fd838000640 1 -- 172.21.15.112:0/1966168193 shutdown_connections 2024-09-12T02:42:42.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.744+0000 7fd838000640 1 --2- 172.21.15.112:0/1966168193 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd8300ae8d0 0x7fd8300cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:42.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.744+0000 7fd838000640 1 --2- 172.21.15.112:0/1966168193 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd81006be30 0x7fd81006e2f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:42.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.744+0000 7fd838000640 1 --2- 172.21.15.112:0/1966168193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd83006dca0 0x7fd830159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:42.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.744+0000 7fd838000640 1 --2- 172.21.15.112:0/1966168193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd83006d8c0 0x7fd83014b5f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:42.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.744+0000 7fd838000640 1 -- 172.21.15.112:0/1966168193 >> 172.21.15.112:0/1966168193 conn(0x7fd83006bbd0 msgr2=0x7fd8300b5410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:42.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.744+0000 7fd838000640 1 -- 172.21.15.112:0/1966168193 shutdown_connections 2024-09-12T02:42:42.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.744+0000 7fd838000640 1 -- 172.21.15.112:0/1966168193 wait complete. 2024-09-12T02:42:42.759 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-12T02:42:42.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.912+0000 7fd222800640 1 Processor -- start 2024-09-12T02:42:42.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.912+0000 7fd222800640 1 -- start start 2024-09-12T02:42:42.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.913+0000 7fd222800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd21c06d590 0x7fd21c06f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:42.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.913+0000 7fd222800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd21c0d0820 0x7fd21c0d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:42.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.913+0000 7fd222800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd21c0b42c0 con 0x7fd21c15b9a0 2024-09-12T02:42:42.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.913+0000 7fd222800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd21c06de70 con 0x7fd21c0d0820 2024-09-12T02:42:42.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.913+0000 7fd222800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd21c15bd80 con 0x7fd21c06d590 2024-09-12T02:42:42.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.913+0000 7fd221400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd21c15b9a0 0x7fd21c0b5020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36354/0 (socket says 172.21.15.112:36354) 2024-09-12T02:42:42.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.913+0000 7fd221400640 1 -- 172.21.15.112:0/3070551995 learned_addr learned my addr 172.21.15.112:0/3070551995 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:42.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.914+0000 7fd221e00640 1 --2- 172.21.15.112:0/3070551995 >> v2:172.21.15.137:3300/0 conn(0x7fd21c0d0820 0x7fd21c0d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:42.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.914+0000 7fd220a00640 1 --2- 172.21.15.112:0/3070551995 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd21c06d590 0x7fd21c06f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:42.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.914+0000 7fd21be00640 1 -- 172.21.15.112:0/3070551995 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1837085617 0 0) 0x7fd210001110 con 0x7fd21c15b9a0 2024-09-12T02:42:42.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.914+0000 7fd21be00640 1 -- 172.21.15.112:0/3070551995 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd204003520 con 0x7fd21c15b9a0 2024-09-12T02:42:42.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.914+0000 7fd21be00640 1 -- 172.21.15.112:0/3070551995 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3553008357 0 0) 0x7fd204003520 con 0x7fd21c15b9a0 2024-09-12T02:42:42.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.914+0000 7fd21be00640 1 -- 172.21.15.112:0/3070551995 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd21c06d590 msgr2=0x7fd21c06f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:42.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.914+0000 7fd21be00640 1 --2- 172.21.15.112:0/3070551995 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd21c06d590 0x7fd21c06f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:42.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.914+0000 7fd21be00640 1 -- 172.21.15.112:0/3070551995 >> v2:172.21.15.137:3300/0 conn(0x7fd21c0d0820 msgr2=0x7fd21c0d0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:42.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.914+0000 7fd21be00640 1 --2- 172.21.15.112:0/3070551995 >> v2:172.21.15.137:3300/0 conn(0x7fd21c0d0820 0x7fd21c0d0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:42.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.914+0000 7fd21be00640 1 -- 172.21.15.112:0/3070551995 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21c0b5730 con 0x7fd21c15b9a0 2024-09-12T02:42:42.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.914+0000 7fd21be00640 1 -- 172.21.15.112:0/3070551995 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7fd210001840 con 0x7fd21c15b9a0 2024-09-12T02:42:42.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.914+0000 7fd21be00640 1 -- 172.21.15.112:0/3070551995 >> v1:172.21.15.112:6789/0 conn(0x7fd21c15b9a0 legacy=0x7fd21c0b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:42.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.914+0000 7fd21be00640 1 --2- 172.21.15.112:0/3070551995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2040039b0 0x7fd204003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:42.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.914+0000 7fd21be00640 1 --2- 172.21.15.112:0/3070551995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd204004800 0x7fd204004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:42.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.914+0000 7fd21be00640 1 --2- 172.21.15.112:0/3070551995 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd21c06d590 0x7fd2040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:42.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.914+0000 7fd21be00640 1 -- 172.21.15.112:0/3070551995 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c06de70 con 0x7fd204004800 2024-09-12T02:42:42.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.914+0000 7fd21be00640 1 -- 172.21.15.112:0/3070551995 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c15bd80 con 0x7fd2040039b0 2024-09-12T02:42:42.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.914+0000 7fd21be00640 1 -- 172.21.15.112:0/3070551995 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd20400dbd0 con 0x7fd21c06d590 2024-09-12T02:42:42.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.914+0000 7fd220a00640 1 --2- 172.21.15.112:0/3070551995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd204004800 0x7fd204004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:42.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.915+0000 7fd221400640 1 --2- 172.21.15.112:0/3070551995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2040039b0 0x7fd204003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:42.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.915+0000 7fd221e00640 1 --2- 172.21.15.112:0/3070551995 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd21c06d590 0x7fd2040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:42.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.915+0000 7fd220a00640 1 -- 172.21.15.112:0/3070551995 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd21c06d590 msgr2=0x7fd2040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:42.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.915+0000 7fd220a00640 1 --2- 172.21.15.112:0/3070551995 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd21c06d590 0x7fd2040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:42.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.915+0000 7fd220a00640 1 -- 172.21.15.112:0/3070551995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2040039b0 msgr2=0x7fd204003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:42.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.915+0000 7fd220a00640 1 --2- 172.21.15.112:0/3070551995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2040039b0 0x7fd204003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:42.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.915+0000 7fd220a00640 1 -- 172.21.15.112:0/3070551995 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd204003520 con 0x7fd204004800 2024-09-12T02:42:42.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.916+0000 7fd220a00640 1 --2- 172.21.15.112:0/3070551995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd204004800 0x7fd204004c80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd208009ac0 tx=0x7fd204005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0d53bd8bb74016 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:42.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.916+0000 7fd21be00640 1 -- 172.21.15.112:0/3070551995 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd208036070 con 0x7fd204004800 2024-09-12T02:42:42.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.916+0000 7fd21be00640 1 -- 172.21.15.112:0/3070551995 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd208031400 con 0x7fd204004800 2024-09-12T02:42:42.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.916+0000 7fd21be00640 1 -- 172.21.15.112:0/3070551995 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd208009690 con 0x7fd204004800 2024-09-12T02:42:42.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.917+0000 7fd222800640 1 -- 172.21.15.112:0/3070551995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd204004800 msgr2=0x7fd204004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:42.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.917+0000 7fd222800640 1 --2- 172.21.15.112:0/3070551995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd204004800 0x7fd204004c80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd208009ac0 tx=0x7fd204005830 comp rx=0 tx=0).stop 2024-09-12T02:42:42.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.917+0000 7fd221e00640 1 -- 172.21.15.112:0/3070551995 reap_dead start 2024-09-12T02:42:42.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.917+0000 7fd222800640 1 -- 172.21.15.112:0/3070551995 shutdown_connections 2024-09-12T02:42:42.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.917+0000 7fd222800640 1 -- 172.21.15.112:0/3070551995 >> 172.21.15.112:0/3070551995 conn(0x7fd21c06bbd0 msgr2=0x7fd21c06bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:42.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.917+0000 7fd222800640 1 -- 172.21.15.112:0/3070551995 shutdown_connections 2024-09-12T02:42:42.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.917+0000 7fd222800640 1 -- 172.21.15.112:0/3070551995 wait complete. 2024-09-12T02:42:42.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.918+0000 7fd222800640 1 Processor -- start 2024-09-12T02:42:42.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.919+0000 7fd222800640 1 -- start start 2024-09-12T02:42:42.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.919+0000 7fd222800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd204004800 0x7fd21c0ad960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:42.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.919+0000 7fd222800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd21c149e40 0x7fd21c14a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:42.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.919+0000 7fd222800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd21c15ceb0 0x7fd21c15d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:42.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.919+0000 7fd222800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c0b4820 con 0x7fd21c149e40 2024-09-12T02:42:42.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.919+0000 7fd222800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c0b4540 con 0x7fd21c15ceb0 2024-09-12T02:42:42.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.919+0000 7fd222800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd21c0b4b00 con 0x7fd204004800 2024-09-12T02:42:42.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.920+0000 7fd220a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd21c149e40 0x7fd21c14a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:42.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.920+0000 7fd220a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd21c149e40 0x7fd21c14a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49900/0 (socket says 172.21.15.112:49900) 2024-09-12T02:42:42.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.920+0000 7fd220a00640 1 -- 172.21.15.112:0/2024054524 learned_addr learned my addr 172.21.15.112:0/2024054524 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:42.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.920+0000 7fd221400640 1 --2- 172.21.15.112:0/2024054524 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd204004800 0x7fd21c0ad960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:42.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.920+0000 7fd221e00640 1 --2- 172.21.15.112:0/2024054524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd21c15ceb0 0x7fd21c15d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:42.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.920+0000 7fd220a00640 1 -- 172.21.15.112:0/2024054524 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd204004800 msgr2=0x7fd21c0ad960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:42.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.920+0000 7fd220a00640 1 --2- 172.21.15.112:0/2024054524 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd204004800 0x7fd21c0ad960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:42.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.920+0000 7fd220a00640 1 -- 172.21.15.112:0/2024054524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd21c15ceb0 msgr2=0x7fd21c15d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:42.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.920+0000 7fd220a00640 1 --2- 172.21.15.112:0/2024054524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd21c15ceb0 0x7fd21c15d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:42.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.920+0000 7fd220a00640 1 -- 172.21.15.112:0/2024054524 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21c15dc50 con 0x7fd21c149e40 2024-09-12T02:42:42.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.920+0000 7fd221e00640 1 --2- 172.21.15.112:0/2024054524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd21c15ceb0 0x7fd21c15d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:42.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.920+0000 7fd221400640 1 --2- 172.21.15.112:0/2024054524 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd204004800 0x7fd21c0ad960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:42.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.920+0000 7fd220a00640 1 --2- 172.21.15.112:0/2024054524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd21c149e40 0x7fd21c14a2a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd208009ac0 tx=0x7fd208004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:42.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.921+0000 7fd219600640 1 -- 172.21.15.112:0/2024054524 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd208040020 con 0x7fd21c149e40 2024-09-12T02:42:42.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.921+0000 7fd219600640 1 -- 172.21.15.112:0/2024054524 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd208003bc0 con 0x7fd21c149e40 2024-09-12T02:42:42.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.921+0000 7fd219600640 1 -- 172.21.15.112:0/2024054524 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd208036040 con 0x7fd21c149e40 2024-09-12T02:42:42.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.921+0000 7fd222800640 1 -- 172.21.15.112:0/2024054524 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd21c15df30 con 0x7fd21c149e40 2024-09-12T02:42:42.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.921+0000 7fd222800640 1 -- 172.21.15.112:0/2024054524 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd21c15e4f0 con 0x7fd21c149e40 2024-09-12T02:42:42.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.922+0000 7fd222800640 1 -- 172.21.15.112:0/2024054524 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd21c0b5b50 con 0x7fd21c149e40 2024-09-12T02:42:42.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.923+0000 7fd219600640 1 -- 172.21.15.112:0/2024054524 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd208043020 con 0x7fd21c149e40 2024-09-12T02:42:42.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.923+0000 7fd219600640 1 --2- 172.21.15.112:0/2024054524 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd1fc06be30 0x7fd1fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:42.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.923+0000 7fd219600640 1 -- 172.21.15.112:0/2024054524 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fd2080aacd0 con 0x7fd21c149e40 2024-09-12T02:42:42.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.924+0000 7fd221400640 1 --2- 172.21.15.112:0/2024054524 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd1fc06be30 0x7fd1fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:42.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.924+0000 7fd221400640 1 --2- 172.21.15.112:0/2024054524 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd1fc06be30 0x7fd1fc06e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd2100012f0 tx=0x7fd210009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:42.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:42.928+0000 7fd219600640 1 -- 172.21.15.112:0/2024054524 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd20804a070 con 0x7fd21c149e40 2024-09-12T02:42:43.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.166+0000 7fd222800640 1 -- 172.21.15.112:0/2024054524 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fd21c0731f0 con 0x7fd21c149e40 2024-09-12T02:42:43.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.168+0000 7fd219600640 1 -- 172.21.15.112:0/2024054524 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7fd2080044e0 con 0x7fd21c149e40 2024-09-12T02:42:43.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.171+0000 7fd222800640 1 -- 172.21.15.112:0/2024054524 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd1fc06be30 msgr2=0x7fd1fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:43.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.171+0000 7fd222800640 1 --2- 172.21.15.112:0/2024054524 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd1fc06be30 0x7fd1fc06e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd2100012f0 tx=0x7fd210009040 comp rx=0 tx=0).stop 2024-09-12T02:42:43.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.171+0000 7fd222800640 1 -- 172.21.15.112:0/2024054524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd21c149e40 msgr2=0x7fd21c14a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:43.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.171+0000 7fd222800640 1 --2- 172.21.15.112:0/2024054524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd21c149e40 0x7fd21c14a2a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd208009ac0 tx=0x7fd208004730 comp rx=0 tx=0).stop 2024-09-12T02:42:43.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.171+0000 7fd222800640 1 -- 172.21.15.112:0/2024054524 shutdown_connections 2024-09-12T02:42:43.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.171+0000 7fd222800640 1 --2- 172.21.15.112:0/2024054524 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd1fc06be30 0x7fd1fc06e2f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:43.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.171+0000 7fd222800640 1 --2- 172.21.15.112:0/2024054524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd21c15ceb0 0x7fd21c15d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:43.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.171+0000 7fd222800640 1 --2- 172.21.15.112:0/2024054524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd21c149e40 0x7fd21c14a2a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:43.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.171+0000 7fd222800640 1 --2- 172.21.15.112:0/2024054524 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd204004800 0x7fd21c0ad960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:43.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.171+0000 7fd222800640 1 -- 172.21.15.112:0/2024054524 >> 172.21.15.112:0/2024054524 conn(0x7fd21c06bbd0 msgr2=0x7fd21c0b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:43.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.171+0000 7fd222800640 1 -- 172.21.15.112:0/2024054524 shutdown_connections 2024-09-12T02:42:43.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.171+0000 7fd222800640 1 -- 172.21.15.112:0/2024054524 wait complete. 2024-09-12T02:42:43.187 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-12T02:42:43.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.338+0000 7f6c1e400640 1 Processor -- start 2024-09-12T02:42:43.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.338+0000 7f6c1e400640 1 -- start start 2024-09-12T02:42:43.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.339+0000 7f6c1e400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c180d1710 0x7f6c180d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:43.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.339+0000 7f6c1e400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6c180b3e00 0x7f6c180d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:43.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.339+0000 7f6c1e400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c180d2fb0 con 0x7f6c180cf7a0 2024-09-12T02:42:43.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.339+0000 7f6c1e400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6c180d3cb0 con 0x7f6c180b3e00 2024-09-12T02:42:43.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.339+0000 7f6c1e400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6c180d0b60 con 0x7f6c180d1710 2024-09-12T02:42:43.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.339+0000 7f6c1da00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f6c180cf7a0 0x7f6c180cfc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36360/0 (socket says 172.21.15.112:36360) 2024-09-12T02:42:43.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.339+0000 7f6c1da00640 1 -- 172.21.15.112:0/185715205 learned_addr learned my addr 172.21.15.112:0/185715205 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:43.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.339+0000 7f6c17e00640 1 --2- 172.21.15.112:0/185715205 >> v2:172.21.15.137:3300/0 conn(0x7f6c180b3e00 0x7f6c180d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:43.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.339+0000 7f6c1d000640 1 --2- 172.21.15.112:0/185715205 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c180d1710 0x7f6c180d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:43.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.340+0000 7f6c17400640 1 -- 172.21.15.112:0/185715205 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 649435523 0 0) 0x7f6c180d2fb0 con 0x7f6c180cf7a0 2024-09-12T02:42:43.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.340+0000 7f6c17400640 1 -- 172.21.15.112:0/185715205 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c00003520 con 0x7f6c180cf7a0 2024-09-12T02:42:43.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.340+0000 7f6c1d000640 1 -- 172.21.15.112:0/185715205 >> v2:172.21.15.137:3300/0 conn(0x7f6c180b3e00 msgr2=0x7f6c180d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:43.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.340+0000 7f6c1d000640 1 --2- 172.21.15.112:0/185715205 >> v2:172.21.15.137:3300/0 conn(0x7f6c180b3e00 0x7f6c180d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:43.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.340+0000 7f6c1d000640 1 -- 172.21.15.112:0/185715205 >> v1:172.21.15.112:6789/0 conn(0x7f6c180cf7a0 legacy=0x7f6c180cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:43.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.340+0000 7f6c1d000640 1 -- 172.21.15.112:0/185715205 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c180d2030 con 0x7f6c180d1710 2024-09-12T02:42:43.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.340+0000 7f6c17e00640 1 --2- 172.21.15.112:0/185715205 >> v2:172.21.15.137:3300/0 conn(0x7f6c180b3e00 0x7f6c180d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:43.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.341+0000 7f6c1d000640 1 --2- 172.21.15.112:0/185715205 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c180d1710 0x7f6c180d28d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c0097a0 tx=0x7f6c0c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54eb56ecf983c536 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:43.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.342+0000 7f6c17400640 1 -- 172.21.15.112:0/185715205 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c037070 con 0x7f6c180d1710 2024-09-12T02:42:43.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.342+0000 7f6c17400640 1 -- 172.21.15.112:0/185715205 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c0c032440 con 0x7f6c180d1710 2024-09-12T02:42:43.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.342+0000 7f6c17400640 1 -- 172.21.15.112:0/185715205 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c0327f0 con 0x7f6c180d1710 2024-09-12T02:42:43.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.342+0000 7f6c1e400640 1 -- 172.21.15.112:0/185715205 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c180d1710 msgr2=0x7f6c180d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:43.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.342+0000 7f6c1e400640 1 --2- 172.21.15.112:0/185715205 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c180d1710 0x7f6c180d28d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c0097a0 tx=0x7f6c0c02a180 comp rx=0 tx=0).stop 2024-09-12T02:42:43.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.342+0000 7f6c1e400640 1 -- 172.21.15.112:0/185715205 shutdown_connections 2024-09-12T02:42:43.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.342+0000 7f6c1e400640 1 --2- 172.21.15.112:0/185715205 >> v2:172.21.15.137:3300/0 conn(0x7f6c180b3e00 0x7f6c180d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:43.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.342+0000 7f6c1e400640 1 --2- 172.21.15.112:0/185715205 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c180d1710 0x7f6c180d28d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:43.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.342+0000 7f6c1e400640 1 -- 172.21.15.112:0/185715205 >> 172.21.15.112:0/185715205 conn(0x7f6c1809e030 msgr2=0x7f6c180d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:43.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.342+0000 7f6c1e400640 1 -- 172.21.15.112:0/185715205 shutdown_connections 2024-09-12T02:42:43.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.342+0000 7f6c1e400640 1 -- 172.21.15.112:0/185715205 wait complete. 2024-09-12T02:42:43.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.344+0000 7f6c1e400640 1 Processor -- start 2024-09-12T02:42:43.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.344+0000 7f6c1e400640 1 -- start start 2024-09-12T02:42:43.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.345+0000 7f6c1e400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c180b3e00 0x7f6c180ba630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:43.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.345+0000 7f6c1e400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c180cf7a0 0x7f6c180b3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:43.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.345+0000 7f6c1e400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c180d1710 0x7f6c181f49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:43.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.345+0000 7f6c1e400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6c180d39d0 con 0x7f6c180b3e00 2024-09-12T02:42:43.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.345+0000 7f6c1e400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6c180d36f0 con 0x7f6c180d1710 2024-09-12T02:42:43.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.345+0000 7f6c1e400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6c1815f110 con 0x7f6c180cf7a0 2024-09-12T02:42:43.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.346+0000 7f6c1d000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c180b3e00 0x7f6c180ba630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:43.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.346+0000 7f6c1d000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c180b3e00 0x7f6c180ba630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49910/0 (socket says 172.21.15.112:49910) 2024-09-12T02:42:43.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.346+0000 7f6c1d000640 1 -- 172.21.15.112:0/1143567340 learned_addr learned my addr 172.21.15.112:0/1143567340 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:43.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.346+0000 7f6c17e00640 1 --2- 172.21.15.112:0/1143567340 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c180cf7a0 0x7f6c180b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:43.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.346+0000 7f6c1da00640 1 --2- 172.21.15.112:0/1143567340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c180d1710 0x7f6c181f49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:43.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.346+0000 7f6c1d000640 1 -- 172.21.15.112:0/1143567340 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c180cf7a0 msgr2=0x7f6c180b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:43.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.346+0000 7f6c1d000640 1 --2- 172.21.15.112:0/1143567340 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c180cf7a0 0x7f6c180b3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:43.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.346+0000 7f6c1d000640 1 -- 172.21.15.112:0/1143567340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c180d1710 msgr2=0x7f6c181f49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:43.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.346+0000 7f6c1d000640 1 --2- 172.21.15.112:0/1143567340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c180d1710 0x7f6c181f49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:43.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.346+0000 7f6c1d000640 1 -- 172.21.15.112:0/1143567340 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c180bab70 con 0x7f6c180b3e00 2024-09-12T02:42:43.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.346+0000 7f6c1d000640 1 --2- 172.21.15.112:0/1143567340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c180b3e00 0x7f6c180ba630 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c02a1c0 tx=0x7f6c0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:43.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.347+0000 7f6c14c00640 1 -- 172.21.15.112:0/1143567340 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c037050 con 0x7f6c180b3e00 2024-09-12T02:42:43.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.347+0000 7f6c14c00640 1 -- 172.21.15.112:0/1143567340 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c0c043070 con 0x7f6c180b3e00 2024-09-12T02:42:43.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.347+0000 7f6c14c00640 1 -- 172.21.15.112:0/1143567340 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c032a10 con 0x7f6c180b3e00 2024-09-12T02:42:43.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.347+0000 7f6c1e400640 1 -- 172.21.15.112:0/1143567340 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c181f55d0 con 0x7f6c180b3e00 2024-09-12T02:42:43.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.347+0000 7f6c1e400640 1 -- 172.21.15.112:0/1143567340 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c180b9b50 con 0x7f6c180b3e00 2024-09-12T02:42:43.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.348+0000 7f6c1e400640 1 -- 172.21.15.112:0/1143567340 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c180d1af0 con 0x7f6c180b3e00 2024-09-12T02:42:43.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.349+0000 7f6c14c00640 1 -- 172.21.15.112:0/1143567340 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c0c032bb0 con 0x7f6c180b3e00 2024-09-12T02:42:43.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.350+0000 7f6c14c00640 1 --2- 172.21.15.112:0/1143567340 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6bf806be30 0x7f6bf806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:43.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.350+0000 7f6c14c00640 1 -- 172.21.15.112:0/1143567340 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f6c0c0ab6e0 con 0x7f6c180b3e00 2024-09-12T02:42:43.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.350+0000 7f6c17e00640 1 --2- 172.21.15.112:0/1143567340 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6bf806be30 0x7f6bf806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:43.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.351+0000 7f6c17e00640 1 --2- 172.21.15.112:0/1143567340 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6bf806be30 0x7f6bf806e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6c04009560 tx=0x7f6c04009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:43.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.355+0000 7f6c14c00640 1 -- 172.21.15.112:0/1143567340 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6c0c003e20 con 0x7f6c180b3e00 2024-09-12T02:42:43.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.591+0000 7f6c1e400640 1 -- 172.21.15.112:0/1143567340 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f6c1806e180 con 0x7f6c180b3e00 2024-09-12T02:42:43.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.593+0000 7f6c14c00640 1 -- 172.21.15.112:0/1143567340 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7f6c0c079d90 con 0x7f6c180b3e00 2024-09-12T02:42:43.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.596+0000 7f6c1e400640 1 -- 172.21.15.112:0/1143567340 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6bf806be30 msgr2=0x7f6bf806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:43.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.596+0000 7f6c1e400640 1 --2- 172.21.15.112:0/1143567340 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6bf806be30 0x7f6bf806e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6c04009560 tx=0x7f6c04009190 comp rx=0 tx=0).stop 2024-09-12T02:42:43.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.596+0000 7f6c1e400640 1 -- 172.21.15.112:0/1143567340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c180b3e00 msgr2=0x7f6c180ba630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:43.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.596+0000 7f6c1e400640 1 --2- 172.21.15.112:0/1143567340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c180b3e00 0x7f6c180ba630 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c02a1c0 tx=0x7f6c0c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:42:43.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.596+0000 7f6c1e400640 1 -- 172.21.15.112:0/1143567340 shutdown_connections 2024-09-12T02:42:43.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.596+0000 7f6c1e400640 1 --2- 172.21.15.112:0/1143567340 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6bf806be30 0x7f6bf806e2f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:43.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.596+0000 7f6c1e400640 1 --2- 172.21.15.112:0/1143567340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c180d1710 0x7f6c181f49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:43.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.596+0000 7f6c1e400640 1 --2- 172.21.15.112:0/1143567340 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c180cf7a0 0x7f6c180b3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:43.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.596+0000 7f6c1e400640 1 --2- 172.21.15.112:0/1143567340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c180b3e00 0x7f6c180ba630 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:43.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.596+0000 7f6c1e400640 1 -- 172.21.15.112:0/1143567340 >> 172.21.15.112:0/1143567340 conn(0x7f6c1809e030 msgr2=0x7f6c180b5940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:43.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.596+0000 7f6c1e400640 1 -- 172.21.15.112:0/1143567340 shutdown_connections 2024-09-12T02:42:43.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.596+0000 7f6c1e400640 1 -- 172.21.15.112:0/1143567340 wait complete. 2024-09-12T02:42:43.612 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-12T02:42:43.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.766+0000 7f2f90600640 1 Processor -- start 2024-09-12T02:42:43.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.767+0000 7f2f90600640 1 -- start start 2024-09-12T02:42:43.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.768+0000 7f2f90600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f88071530 0x7f2f880af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:43.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.768+0000 7f2f90600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2f88071970 0x7f2f880afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:43.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.768+0000 7f2f90600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f880ceeb0 con 0x7f2f8815cc50 2024-09-12T02:42:43.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.768+0000 7f2f90600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2f8815d030 con 0x7f2f88071970 2024-09-12T02:42:43.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.768+0000 7f2f90600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2f880cf4c0 con 0x7f2f88071530 2024-09-12T02:42:43.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.768+0000 7f2f8e600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2f88071970 0x7f2f880afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:43.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.768+0000 7f2f8e600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2f88071970 0x7f2f880afc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49916/0 (socket says 172.21.15.112:49916) 2024-09-12T02:42:43.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.768+0000 7f2f8e600640 1 -- 172.21.15.112:0/3153041877 learned_addr learned my addr 172.21.15.112:0/3153041877 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:43.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.768+0000 7f2f8d200640 1 --2- 172.21.15.112:0/3153041877 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f88071530 0x7f2f880af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:43.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.768+0000 7f2f8e600640 1 -- 172.21.15.112:0/3153041877 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f88071530 msgr2=0x7f2f880af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:43.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.768+0000 7f2f8e600640 1 --2- 172.21.15.112:0/3153041877 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f88071530 0x7f2f880af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:43.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.768+0000 7f2f8e600640 1 -- 172.21.15.112:0/3153041877 >> v1:172.21.15.137:6789/0 conn(0x7f2f8815cc50 legacy=0x7f2f880732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:43.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.769+0000 7f2f8e600640 1 -- 172.21.15.112:0/3153041877 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f8806e300 con 0x7f2f88071970 2024-09-12T02:42:43.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.769+0000 7f2f8e600640 1 --2- 172.21.15.112:0/3153041877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f88071970 0x7f2f880afc60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009870 tx=0x7f2f8002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4624886f7861cd47 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:43.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.770+0000 7f2f87e00640 1 -- 172.21.15.112:0/3153041877 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f80037070 con 0x7f2f88071970 2024-09-12T02:42:43.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.770+0000 7f2f87e00640 1 -- 172.21.15.112:0/3153041877 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f80032440 con 0x7f2f88071970 2024-09-12T02:42:43.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.770+0000 7f2f87e00640 1 -- 172.21.15.112:0/3153041877 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f80032810 con 0x7f2f88071970 2024-09-12T02:42:43.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.770+0000 7f2f90600640 1 -- 172.21.15.112:0/3153041877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f88071970 msgr2=0x7f2f880afc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:43.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.770+0000 7f2f90600640 1 --2- 172.21.15.112:0/3153041877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f88071970 0x7f2f880afc60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009870 tx=0x7f2f8002a180 comp rx=0 tx=0).stop 2024-09-12T02:42:43.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.770+0000 7f2f90600640 1 -- 172.21.15.112:0/3153041877 shutdown_connections 2024-09-12T02:42:43.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.770+0000 7f2f90600640 1 --2- 172.21.15.112:0/3153041877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f88071970 0x7f2f880afc60 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:43.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.770+0000 7f2f90600640 1 --2- 172.21.15.112:0/3153041877 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f88071530 0x7f2f880af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:43.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.770+0000 7f2f90600640 1 -- 172.21.15.112:0/3153041877 >> 172.21.15.112:0/3153041877 conn(0x7f2f8806bbd0 msgr2=0x7f2f8806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:43.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.771+0000 7f2f90600640 1 -- 172.21.15.112:0/3153041877 shutdown_connections 2024-09-12T02:42:43.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.771+0000 7f2f90600640 1 -- 172.21.15.112:0/3153041877 wait complete. 2024-09-12T02:42:43.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.772+0000 7f2f90600640 1 Processor -- start 2024-09-12T02:42:43.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.772+0000 7f2f90600640 1 -- start start 2024-09-12T02:42:43.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.773+0000 7f2f90600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f88071530 0x7f2f8813f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:43.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.773+0000 7f2f90600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f88071970 0x7f2f880b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:43.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.773+0000 7f2f90600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f8815cc50 0x7f2f88159090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:43.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.773+0000 7f2f90600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2f8806f510 con 0x7f2f88071530 2024-09-12T02:42:43.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.773+0000 7f2f90600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2f880cf150 con 0x7f2f8815cc50 2024-09-12T02:42:43.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.773+0000 7f2f90600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2f8806f690 con 0x7f2f88071970 2024-09-12T02:42:43.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.773+0000 7f2f8dc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f88071530 0x7f2f8813f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:43.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.773+0000 7f2f8dc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f88071530 0x7f2f8813f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49920/0 (socket says 172.21.15.112:49920) 2024-09-12T02:42:43.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.773+0000 7f2f8dc00640 1 -- 172.21.15.112:0/3884720841 learned_addr learned my addr 172.21.15.112:0/3884720841 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:43.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.774+0000 7f2f8dc00640 1 -- 172.21.15.112:0/3884720841 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f88071970 msgr2=0x7f2f880b16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:43.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.774+0000 7f2f8dc00640 1 --2- 172.21.15.112:0/3884720841 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f88071970 0x7f2f880b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:43.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.774+0000 7f2f8dc00640 1 -- 172.21.15.112:0/3884720841 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f8815cc50 msgr2=0x7f2f88159090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:43.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.774+0000 7f2f8dc00640 1 --2- 172.21.15.112:0/3884720841 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f8815cc50 0x7f2f88159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:43.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.774+0000 7f2f8dc00640 1 -- 172.21.15.112:0/3884720841 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f880b1f20 con 0x7f2f88071530 2024-09-12T02:42:43.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.774+0000 7f2f8dc00640 1 --2- 172.21.15.112:0/3884720841 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f88071530 0x7f2f8813f550 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00ba50 tx=0x7f2f7c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:43.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.774+0000 7f2f85600640 1 -- 172.21.15.112:0/3884720841 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c019070 con 0x7f2f88071530 2024-09-12T02:42:43.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.774+0000 7f2f90600640 1 -- 172.21.15.112:0/3884720841 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f881554d0 con 0x7f2f88071530 2024-09-12T02:42:43.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.774+0000 7f2f85600640 1 -- 172.21.15.112:0/3884720841 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f7c00cc20 con 0x7f2f88071530 2024-09-12T02:42:43.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.774+0000 7f2f85600640 1 -- 172.21.15.112:0/3884720841 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c014680 con 0x7f2f88071530 2024-09-12T02:42:43.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.774+0000 7f2f90600640 1 -- 172.21.15.112:0/3884720841 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f88155a90 con 0x7f2f88071530 2024-09-12T02:42:43.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.776+0000 7f2f90600640 1 -- 172.21.15.112:0/3884720841 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f88068a30 con 0x7f2f88071530 2024-09-12T02:42:43.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.776+0000 7f2f85600640 1 -- 172.21.15.112:0/3884720841 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2f7c01c070 con 0x7f2f88071530 2024-09-12T02:42:43.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.777+0000 7f2f85600640 1 --2- 172.21.15.112:0/3884720841 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2f6806be60 0x7f2f6806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:43.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.777+0000 7f2f85600640 1 -- 172.21.15.112:0/3884720841 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f2f7c08a7f0 con 0x7f2f88071530 2024-09-12T02:42:43.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.778+0000 7f2f8d200640 1 --2- 172.21.15.112:0/3884720841 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2f6806be60 0x7f2f6806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:43.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.778+0000 7f2f8d200640 1 --2- 172.21.15.112:0/3884720841 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2f6806be60 0x7f2f6806e320 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2f74006e20 tx=0x7f2f74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:43.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:43.782+0000 7f2f85600640 1 -- 172.21.15.112:0/3884720841 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2f7c058eb0 con 0x7f2f88071530 2024-09-12T02:42:44.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.016+0000 7f2f90600640 1 -- 172.21.15.112:0/3884720841 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f2f8806df60 con 0x7f2f88071530 2024-09-12T02:42:44.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.018+0000 7f2f85600640 1 -- 172.21.15.112:0/3884720841 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7f2f7c05d1b0 con 0x7f2f88071530 2024-09-12T02:42:44.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.021+0000 7f2f90600640 1 -- 172.21.15.112:0/3884720841 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2f6806be60 msgr2=0x7f2f6806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:44.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.021+0000 7f2f90600640 1 --2- 172.21.15.112:0/3884720841 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2f6806be60 0x7f2f6806e320 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2f74006e20 tx=0x7f2f74008040 comp rx=0 tx=0).stop 2024-09-12T02:42:44.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.021+0000 7f2f90600640 1 -- 172.21.15.112:0/3884720841 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f88071530 msgr2=0x7f2f8813f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:44.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.021+0000 7f2f90600640 1 --2- 172.21.15.112:0/3884720841 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f88071530 0x7f2f8813f550 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00ba50 tx=0x7f2f7c00bf10 comp rx=0 tx=0).stop 2024-09-12T02:42:44.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.021+0000 7f2f90600640 1 -- 172.21.15.112:0/3884720841 shutdown_connections 2024-09-12T02:42:44.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.021+0000 7f2f90600640 1 --2- 172.21.15.112:0/3884720841 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2f6806be60 0x7f2f6806e320 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:44.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.021+0000 7f2f90600640 1 --2- 172.21.15.112:0/3884720841 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f8815cc50 0x7f2f88159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:44.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.021+0000 7f2f90600640 1 --2- 172.21.15.112:0/3884720841 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f88071970 0x7f2f880b16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:44.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.021+0000 7f2f90600640 1 --2- 172.21.15.112:0/3884720841 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f88071530 0x7f2f8813f550 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:44.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.021+0000 7f2f90600640 1 -- 172.21.15.112:0/3884720841 >> 172.21.15.112:0/3884720841 conn(0x7f2f8806bbd0 msgr2=0x7f2f880b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:44.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.021+0000 7f2f90600640 1 -- 172.21.15.112:0/3884720841 shutdown_connections 2024-09-12T02:42:44.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.021+0000 7f2f90600640 1 -- 172.21.15.112:0/3884720841 wait complete. 2024-09-12T02:42:44.039 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T02:42:44.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.191+0000 7f43d3c00640 1 Processor -- start 2024-09-12T02:42:44.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.191+0000 7f43d3c00640 1 -- start start 2024-09-12T02:42:44.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.193+0000 7f43d3c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43cc15bb60 0x7f43cc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:44.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.193+0000 7f43d3c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f43cc0cfda0 0x7f43cc06f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:44.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.193+0000 7f43d3c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43cc15bf40 con 0x7f43cc072c80 2024-09-12T02:42:44.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.193+0000 7f43d3c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f43cc06da70 con 0x7f43cc0cfda0 2024-09-12T02:42:44.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.193+0000 7f43d3c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f43cc0cdfd0 con 0x7f43cc15bb60 2024-09-12T02:42:44.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.193+0000 7f43d1c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f43cc0cfda0 0x7f43cc06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:44.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.193+0000 7f43d1c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f43cc0cfda0 0x7f43cc06f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49928/0 (socket says 172.21.15.112:49928) 2024-09-12T02:42:44.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.193+0000 7f43d1c00640 1 -- 172.21.15.112:0/798931563 learned_addr learned my addr 172.21.15.112:0/798931563 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:44.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.193+0000 7f43d1200640 1 --2- 172.21.15.112:0/798931563 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43cc15bb60 0x7f43cc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:44.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.193+0000 7f43d1c00640 1 -- 172.21.15.112:0/798931563 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43cc15bb60 msgr2=0x7f43cc06ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:44.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.193+0000 7f43d1c00640 1 --2- 172.21.15.112:0/798931563 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43cc15bb60 0x7f43cc06ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:44.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.193+0000 7f43d1c00640 1 -- 172.21.15.112:0/798931563 >> v1:172.21.15.137:6789/0 conn(0x7f43cc072c80 legacy=0x7f43cc0b39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:44.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.193+0000 7f43d1c00640 1 -- 172.21.15.112:0/798931563 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43cc0ce2b0 con 0x7f43cc0cfda0 2024-09-12T02:42:44.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.194+0000 7f43d1c00640 1 --2- 172.21.15.112:0/798931563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43cc0cfda0 0x7f43cc06f320 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009e50 tx=0x7f43c402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad281c5f941fd0e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:44.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.195+0000 7f43cbe00640 1 -- 172.21.15.112:0/798931563 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c4036070 con 0x7f43cc0cfda0 2024-09-12T02:42:44.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.195+0000 7f43cbe00640 1 -- 172.21.15.112:0/798931563 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43c4031600 con 0x7f43cc0cfda0 2024-09-12T02:42:44.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.195+0000 7f43cbe00640 1 -- 172.21.15.112:0/798931563 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c40319d0 con 0x7f43cc0cfda0 2024-09-12T02:42:44.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.195+0000 7f43d3c00640 1 -- 172.21.15.112:0/798931563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43cc0cfda0 msgr2=0x7f43cc06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:44.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.195+0000 7f43d3c00640 1 --2- 172.21.15.112:0/798931563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43cc0cfda0 0x7f43cc06f320 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009e50 tx=0x7f43c402a710 comp rx=0 tx=0).stop 2024-09-12T02:42:44.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.195+0000 7f43d3c00640 1 -- 172.21.15.112:0/798931563 shutdown_connections 2024-09-12T02:42:44.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.195+0000 7f43d3c00640 1 --2- 172.21.15.112:0/798931563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43cc0cfda0 0x7f43cc06f320 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:44.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.195+0000 7f43d3c00640 1 --2- 172.21.15.112:0/798931563 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43cc15bb60 0x7f43cc06ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:44.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.195+0000 7f43d3c00640 1 -- 172.21.15.112:0/798931563 >> 172.21.15.112:0/798931563 conn(0x7f43cc0b26c0 msgr2=0x7f43cc0b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:44.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.195+0000 7f43d3c00640 1 -- 172.21.15.112:0/798931563 shutdown_connections 2024-09-12T02:42:44.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.195+0000 7f43d3c00640 1 -- 172.21.15.112:0/798931563 wait complete. 2024-09-12T02:42:44.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.197+0000 7f43d3c00640 1 Processor -- start 2024-09-12T02:42:44.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.197+0000 7f43d3c00640 1 -- start start 2024-09-12T02:42:44.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.198+0000 7f43d3c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43cc072c80 0x7f43cc158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:44.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.198+0000 7f43d3c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43cc0cfda0 0x7f43cc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:44.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.198+0000 7f43d3c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43cc15bb60 0x7f43cc06e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:44.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.198+0000 7f43d3c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f43cc06d600 con 0x7f43cc15bb60 2024-09-12T02:42:44.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.198+0000 7f43d3c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f43cc0ce870 con 0x7f43cc072c80 2024-09-12T02:42:44.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.198+0000 7f43d3c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f43cc06d780 con 0x7f43cc0cfda0 2024-09-12T02:42:44.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.198+0000 7f43d1c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43cc15bb60 0x7f43cc06e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:44.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.198+0000 7f43d1c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43cc15bb60 0x7f43cc06e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49936/0 (socket says 172.21.15.112:49936) 2024-09-12T02:42:44.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.198+0000 7f43d1c00640 1 -- 172.21.15.112:0/535855807 learned_addr learned my addr 172.21.15.112:0/535855807 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:44.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.198+0000 7f43d1200640 1 --2- 172.21.15.112:0/535855807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43cc072c80 0x7f43cc158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:44.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.198+0000 7f43c3e00640 1 --2- 172.21.15.112:0/535855807 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43cc0cfda0 0x7f43cc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:44.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.199+0000 7f43d1c00640 1 -- 172.21.15.112:0/535855807 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43cc0cfda0 msgr2=0x7f43cc06dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:44.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.199+0000 7f43d1c00640 1 --2- 172.21.15.112:0/535855807 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43cc0cfda0 0x7f43cc06dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:44.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.199+0000 7f43d1c00640 1 -- 172.21.15.112:0/535855807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43cc072c80 msgr2=0x7f43cc158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:44.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.199+0000 7f43d1c00640 1 --2- 172.21.15.112:0/535855807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43cc072c80 0x7f43cc158020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:44.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.199+0000 7f43d1c00640 1 -- 172.21.15.112:0/535855807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43cc15c270 con 0x7f43cc15bb60 2024-09-12T02:42:44.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.199+0000 7f43d1c00640 1 --2- 172.21.15.112:0/535855807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43cc15bb60 0x7f43cc06e210 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009e50 tx=0x7f43c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:44.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.199+0000 7f43c9600640 1 -- 172.21.15.112:0/535855807 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c4036050 con 0x7f43cc15bb60 2024-09-12T02:42:44.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.199+0000 7f43c9600640 1 -- 172.21.15.112:0/535855807 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43c4042070 con 0x7f43cc15bb60 2024-09-12T02:42:44.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.199+0000 7f43c9600640 1 -- 172.21.15.112:0/535855807 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c4009510 con 0x7f43cc15bb60 2024-09-12T02:42:44.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.199+0000 7f43d3c00640 1 -- 172.21.15.112:0/535855807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43cc15c550 con 0x7f43cc15bb60 2024-09-12T02:42:44.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.200+0000 7f43d3c00640 1 -- 172.21.15.112:0/535855807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43cc15cb10 con 0x7f43cc15bb60 2024-09-12T02:42:44.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.201+0000 7f43d3c00640 1 -- 172.21.15.112:0/535855807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43cc068a30 con 0x7f43cc15bb60 2024-09-12T02:42:44.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.201+0000 7f43c9600640 1 -- 172.21.15.112:0/535855807 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f43c4007bd0 con 0x7f43cc15bb60 2024-09-12T02:42:44.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.202+0000 7f43c9600640 1 --2- 172.21.15.112:0/535855807 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f43a806be30 0x7f43a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:44.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.202+0000 7f43c9600640 1 -- 172.21.15.112:0/535855807 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f43c40ab810 con 0x7f43cc15bb60 2024-09-12T02:42:44.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.202+0000 7f43d1200640 1 --2- 172.21.15.112:0/535855807 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f43a806be30 0x7f43a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:44.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.203+0000 7f43d1200640 1 --2- 172.21.15.112:0/535855807 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f43a806be30 0x7f43a806e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f43bc0079a0 tx=0x7f43bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:44.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.206+0000 7f43c9600640 1 -- 172.21.15.112:0/535855807 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f43c4079eb0 con 0x7f43cc15bb60 2024-09-12T02:42:44.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.380+0000 7f43d3c00640 1 -- 172.21.15.112:0/535855807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f43cc0b56a0 con 0x7f43cc15bb60 2024-09-12T02:42:44.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.380+0000 7f43c9600640 1 -- 172.21.15.112:0/535855807 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) ==== 84+0+65 (secure 0 0 0) 0x7f43c407e1b0 con 0x7f43cc15bb60 2024-09-12T02:42:44.381 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:42:44.381 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2024-09-12T02:42:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:42:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 1, 2024-09-12T02:42:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": ".mgr" 2024-09-12T02:42:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:44.385 INFO:teuthology.orchestra.run.smithi112.stdout:] 2024-09-12T02:42:44.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.382+0000 7f43d3c00640 1 -- 172.21.15.112:0/535855807 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f43a806be30 msgr2=0x7f43a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:44.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.382+0000 7f43d3c00640 1 --2- 172.21.15.112:0/535855807 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f43a806be30 0x7f43a806e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f43bc0079a0 tx=0x7f43bc008040 comp rx=0 tx=0).stop 2024-09-12T02:42:44.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.382+0000 7f43d3c00640 1 -- 172.21.15.112:0/535855807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43cc15bb60 msgr2=0x7f43cc06e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:44.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.382+0000 7f43d3c00640 1 --2- 172.21.15.112:0/535855807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43cc15bb60 0x7f43cc06e210 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009e50 tx=0x7f43c4004a40 comp rx=0 tx=0).stop 2024-09-12T02:42:44.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.382+0000 7f43d3c00640 1 -- 172.21.15.112:0/535855807 shutdown_connections 2024-09-12T02:42:44.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.382+0000 7f43d3c00640 1 --2- 172.21.15.112:0/535855807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43cc15bb60 0x7f43cc06e210 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:44.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.382+0000 7f43d3c00640 1 --2- 172.21.15.112:0/535855807 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43cc0cfda0 0x7f43cc06dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:44.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.382+0000 7f43d3c00640 1 --2- 172.21.15.112:0/535855807 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f43a806be30 0x7f43a806e2f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:44.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.382+0000 7f43d3c00640 1 --2- 172.21.15.112:0/535855807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43cc072c80 0x7f43cc158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:44.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.382+0000 7f43d3c00640 1 -- 172.21.15.112:0/535855807 >> 172.21.15.112:0/535855807 conn(0x7f43cc0b26c0 msgr2=0x7f43cc0d13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:44.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.382+0000 7f43d3c00640 1 -- 172.21.15.112:0/535855807 shutdown_connections 2024-09-12T02:42:44.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.382+0000 7f43d3c00640 1 -- 172.21.15.112:0/535855807 wait complete. 2024-09-12T02:42:44.399 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T02:42:44.399 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T02:42:44.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.555+0000 7f3575800640 1 Processor -- start 2024-09-12T02:42:44.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.555+0000 7f3575800640 1 -- start start 2024-09-12T02:42:44.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.556+0000 7f3575800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f357006ec90 0x7f3570072470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:44.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.556+0000 7f3575800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3570073820 con 0x7f357015b880 2024-09-12T02:42:44.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.556+0000 7f3575800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35700716b0 con 0x7f357015fdc0 2024-09-12T02:42:44.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.556+0000 7f3575800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3570160330 con 0x7f357006ec90 2024-09-12T02:42:44.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.557+0000 7f356fe00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f357015b880 0x7f35700cd340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36376/0 (socket says 172.21.15.112:36376) 2024-09-12T02:42:44.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.557+0000 7f356fe00640 1 -- 172.21.15.112:0/3681088547 learned_addr learned my addr 172.21.15.112:0/3681088547 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:44.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.557+0000 7f356f400640 1 -- 172.21.15.112:0/3681088547 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4154058768 0 0) 0x7f3570073820 con 0x7f357015b880 2024-09-12T02:42:44.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.557+0000 7f3574e00640 1 --2- 172.21.15.112:0/3681088547 >> v2:172.21.15.137:3300/0 conn(0x7f357006ec90 0x7f3570072470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:44.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.557+0000 7f356f400640 1 -- 172.21.15.112:0/3681088547 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3554003520 con 0x7f357015b880 2024-09-12T02:42:44.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.557+0000 7f356f400640 1 -- 172.21.15.112:0/3681088547 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2350347822 0 0) 0x7f3554003520 con 0x7f357015b880 2024-09-12T02:42:44.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.557+0000 7f356f400640 1 -- 172.21.15.112:0/3681088547 >> v2:172.21.15.137:3300/0 conn(0x7f357006ec90 msgr2=0x7f3570072470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:44.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.557+0000 7f356f400640 1 --2- 172.21.15.112:0/3681088547 >> v2:172.21.15.137:3300/0 conn(0x7f357006ec90 0x7f3570072470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:44.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.557+0000 7f356f400640 1 -- 172.21.15.112:0/3681088547 >> v1:172.21.15.137:6789/0 conn(0x7f357015fdc0 legacy=0x7f357006e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:44.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.557+0000 7f356f400640 1 -- 172.21.15.112:0/3681088547 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3570071990 con 0x7f357015b880 2024-09-12T02:42:44.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.557+0000 7f356f400640 1 -- 172.21.15.112:0/3681088547 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f35600019f0 con 0x7f357015b880 2024-09-12T02:42:44.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.557+0000 7f356f400640 1 -- 172.21.15.112:0/3681088547 >> v1:172.21.15.112:6789/0 conn(0x7f357015b880 legacy=0x7f35700cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:44.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.558+0000 7f356f400640 1 --2- 172.21.15.112:0/3681088547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3554003a00 0x7f3554003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:44.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.558+0000 7f356f400640 1 --2- 172.21.15.112:0/3681088547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3554004800 0x7f3554004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:44.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.558+0000 7f356f400640 1 --2- 172.21.15.112:0/3681088547 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3554005210 0x7f355400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:44.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.558+0000 7f356f400640 1 -- 172.21.15.112:0/3681088547 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f355400c130 con 0x7f3554004800 2024-09-12T02:42:44.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.558+0000 7f356f400640 1 -- 172.21.15.112:0/3681088547 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f355400c2e0 con 0x7f3554003a00 2024-09-12T02:42:44.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.558+0000 7f356f400640 1 -- 172.21.15.112:0/3681088547 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f355400c4e0 con 0x7f3554005210 2024-09-12T02:42:44.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.558+0000 7f3567400640 1 --2- 172.21.15.112:0/3681088547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3554004800 0x7f3554004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:44.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.558+0000 7f356fe00640 1 --2- 172.21.15.112:0/3681088547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3554003a00 0x7f3554003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:44.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.558+0000 7f3574e00640 1 --2- 172.21.15.112:0/3681088547 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3554005210 0x7f355400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:44.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.558+0000 7f3567400640 1 -- 172.21.15.112:0/3681088547 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3554005210 msgr2=0x7f355400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:44.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.558+0000 7f3567400640 1 --2- 172.21.15.112:0/3681088547 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3554005210 0x7f355400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:44.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.558+0000 7f3567400640 1 -- 172.21.15.112:0/3681088547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3554003a00 msgr2=0x7f3554003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:44.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.558+0000 7f3567400640 1 --2- 172.21.15.112:0/3681088547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3554003a00 0x7f3554003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:44.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.558+0000 7f3567400640 1 -- 172.21.15.112:0/3681088547 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3554003520 con 0x7f3554004800 2024-09-12T02:42:44.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.558+0000 7f3574e00640 1 --2- 172.21.15.112:0/3681088547 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3554005210 0x7f355400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:44.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.558+0000 7f3574e00640 1 -- 172.21.15.112:0/3681088547 reap_dead start 2024-09-12T02:42:44.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.559+0000 7f3567400640 1 --2- 172.21.15.112:0/3681088547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3554004800 0x7f3554004c80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3558001720 tx=0x7f3554005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc4c0fd1fa3fe8a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:44.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.560+0000 7f356f400640 1 -- 172.21.15.112:0/3681088547 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3558001370 con 0x7f3554004800 2024-09-12T02:42:44.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.560+0000 7f356f400640 1 -- 172.21.15.112:0/3681088547 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35580052d0 con 0x7f3554004800 2024-09-12T02:42:44.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.560+0000 7f356f400640 1 -- 172.21.15.112:0/3681088547 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355802ab90 con 0x7f3554004800 2024-09-12T02:42:44.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.560+0000 7f3575800640 1 -- 172.21.15.112:0/3681088547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3554004800 msgr2=0x7f3554004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:44.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.560+0000 7f3575800640 1 --2- 172.21.15.112:0/3681088547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3554004800 0x7f3554004c80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3558001720 tx=0x7f3554005830 comp rx=0 tx=0).stop 2024-09-12T02:42:44.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.560+0000 7f3575800640 1 -- 172.21.15.112:0/3681088547 shutdown_connections 2024-09-12T02:42:44.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.560+0000 7f3575800640 1 --2- 172.21.15.112:0/3681088547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3554004800 0x7f3554004c80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:44.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.560+0000 7f3575800640 1 -- 172.21.15.112:0/3681088547 >> 172.21.15.112:0/3681088547 conn(0x7f35700b26c0 msgr2=0x7f35700b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:44.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.560+0000 7f3575800640 1 -- 172.21.15.112:0/3681088547 shutdown_connections 2024-09-12T02:42:44.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.560+0000 7f3575800640 1 -- 172.21.15.112:0/3681088547 wait complete. 2024-09-12T02:42:44.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.562+0000 7f3575800640 1 Processor -- start 2024-09-12T02:42:44.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.562+0000 7f3575800640 1 -- start start 2024-09-12T02:42:44.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.563+0000 7f3575800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3554004800 0x7f35700b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:44.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.563+0000 7f3575800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35701404a0 0x7f357015dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:44.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.563+0000 7f3575800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3570149bd0 0x7f357015e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:44.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.563+0000 7f3575800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f357015bc60 con 0x7f3554004800 2024-09-12T02:42:44.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.563+0000 7f3575800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3570071fe0 con 0x7f35701404a0 2024-09-12T02:42:44.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.563+0000 7f3575800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3570072470 con 0x7f3570149bd0 2024-09-12T02:42:44.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.563+0000 7f356fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3554004800 0x7f35700b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:44.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.563+0000 7f356fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3554004800 0x7f35700b53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49960/0 (socket says 172.21.15.112:49960) 2024-09-12T02:42:44.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.563+0000 7f356fe00640 1 -- 172.21.15.112:0/2781301554 learned_addr learned my addr 172.21.15.112:0/2781301554 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:44.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.563+0000 7f3574e00640 1 --2- 172.21.15.112:0/2781301554 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3570149bd0 0x7f357015e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:44.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.563+0000 7f3567400640 1 --2- 172.21.15.112:0/2781301554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35701404a0 0x7f357015dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:44.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.564+0000 7f356fe00640 1 -- 172.21.15.112:0/2781301554 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3570149bd0 msgr2=0x7f357015e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:44.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.564+0000 7f356fe00640 1 --2- 172.21.15.112:0/2781301554 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3570149bd0 0x7f357015e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:44.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.564+0000 7f356fe00640 1 -- 172.21.15.112:0/2781301554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35701404a0 msgr2=0x7f357015dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:44.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.564+0000 7f356fe00640 1 --2- 172.21.15.112:0/2781301554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35701404a0 0x7f357015dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:44.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.564+0000 7f356fe00640 1 -- 172.21.15.112:0/2781301554 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35701464c0 con 0x7f3554004800 2024-09-12T02:42:44.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.564+0000 7f356fe00640 1 --2- 172.21.15.112:0/2781301554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3554004800 0x7f35700b53c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f35600079d0 tx=0x7f356000a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:44.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.564+0000 7f356cc00640 1 -- 172.21.15.112:0/2781301554 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3560017020 con 0x7f3554004800 2024-09-12T02:42:44.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.564+0000 7f356cc00640 1 -- 172.21.15.112:0/2781301554 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35600019a0 con 0x7f3554004800 2024-09-12T02:42:44.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.564+0000 7f3575800640 1 -- 172.21.15.112:0/2781301554 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3570146760 con 0x7f3554004800 2024-09-12T02:42:44.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.564+0000 7f356cc00640 1 -- 172.21.15.112:0/2781301554 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3560013610 con 0x7f3554004800 2024-09-12T02:42:44.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.564+0000 7f3575800640 1 -- 172.21.15.112:0/2781301554 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3570146e80 con 0x7f3554004800 2024-09-12T02:42:44.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.565+0000 7f3575800640 1 -- 172.21.15.112:0/2781301554 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3570072800 con 0x7f3554004800 2024-09-12T02:42:44.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.566+0000 7f356cc00640 1 -- 172.21.15.112:0/2781301554 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f356001a020 con 0x7f3554004800 2024-09-12T02:42:44.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.567+0000 7f356cc00640 1 --2- 172.21.15.112:0/2781301554 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f354c06be30 0x7f354c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:44.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.567+0000 7f356cc00640 1 -- 172.21.15.112:0/2781301554 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f356008b410 con 0x7f3554004800 2024-09-12T02:42:44.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.567+0000 7f3567400640 1 --2- 172.21.15.112:0/2781301554 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f354c06be30 0x7f354c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:44.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.568+0000 7f3567400640 1 --2- 172.21.15.112:0/2781301554 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f354c06be30 0x7f354c06e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3558032000 tx=0x7f355802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:44.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.571+0000 7f356cc00640 1 -- 172.21.15.112:0/2781301554 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3560021020 con 0x7f3554004800 2024-09-12T02:42:44.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:44.745+0000 7f3575800640 1 -- 172.21.15.112:0/2781301554 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f35700b4c30 con 0x7f3554004800 2024-09-12T02:42:45.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-12T02:42:45.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.042+0000 7f356cc00640 1 -- 172.21.15.112:0/2781301554 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) ==== 138+0+0 (secure 0 0 0) 0x7f356005a100 con 0x7f3554004800 2024-09-12T02:42:45.044 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' created 2024-09-12T02:42:45.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.045+0000 7f3575800640 1 -- 172.21.15.112:0/2781301554 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f354c06be30 msgr2=0x7f354c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:45.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.045+0000 7f3575800640 1 --2- 172.21.15.112:0/2781301554 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f354c06be30 0x7f354c06e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3558032000 tx=0x7f355802e000 comp rx=0 tx=0).stop 2024-09-12T02:42:45.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.045+0000 7f3575800640 1 -- 172.21.15.112:0/2781301554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3554004800 msgr2=0x7f35700b53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:45.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.045+0000 7f3575800640 1 --2- 172.21.15.112:0/2781301554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3554004800 0x7f35700b53c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f35600079d0 tx=0x7f356000a640 comp rx=0 tx=0).stop 2024-09-12T02:42:45.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.045+0000 7f3575800640 1 -- 172.21.15.112:0/2781301554 shutdown_connections 2024-09-12T02:42:45.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.045+0000 7f3575800640 1 --2- 172.21.15.112:0/2781301554 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3570149bd0 0x7f357015e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:45.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.045+0000 7f3575800640 1 --2- 172.21.15.112:0/2781301554 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f354c06be30 0x7f354c06e2f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:45.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.045+0000 7f3575800640 1 --2- 172.21.15.112:0/2781301554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35701404a0 0x7f357015dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:45.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.045+0000 7f3575800640 1 --2- 172.21.15.112:0/2781301554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3554004800 0x7f35700b53c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:45.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.045+0000 7f3575800640 1 -- 172.21.15.112:0/2781301554 >> 172.21.15.112:0/2781301554 conn(0x7f35700b26c0 msgr2=0x7f357014cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:45.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.045+0000 7f3575800640 1 -- 172.21.15.112:0/2781301554 shutdown_connections 2024-09-12T02:42:45.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.045+0000 7f3575800640 1 -- 172.21.15.112:0/2781301554 wait complete. 2024-09-12T02:42:45.064 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:42:45.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.223+0000 7f3c8b000640 1 Processor -- start 2024-09-12T02:42:45.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.223+0000 7f3c8b000640 1 -- start start 2024-09-12T02:42:45.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.224+0000 7f3c8b000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3c840d59e0 0x7f3c840d2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:45.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.224+0000 7f3c8b000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c840cf810 con 0x7f3c840d32c0 2024-09-12T02:42:45.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.224+0000 7f3c8b000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c840cfa90 con 0x7f3c8415f080 2024-09-12T02:42:45.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.224+0000 7f3c8b000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f3c840d3730 con 0x7f3c840d59e0 2024-09-12T02:42:45.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.224+0000 7f3c89200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3c840d59e0 0x7f3c840d2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:45.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.224+0000 7f3c8a600640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f3c840d32c0 0x7f3c840b7b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36386/0 (socket says 172.21.15.112:36386) 2024-09-12T02:42:45.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.224+0000 7f3c8a600640 1 -- 172.21.15.112:0/1294809519 learned_addr learned my addr 172.21.15.112:0/1294809519 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:45.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.225+0000 7f3c89200640 1 -- 172.21.15.112:0/1294809519 >> v1:172.21.15.137:6789/0 conn(0x7f3c8415f080 legacy=0x7f3c840d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:45.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.225+0000 7f3c89200640 1 -- 172.21.15.112:0/1294809519 >> v1:172.21.15.112:6789/0 conn(0x7f3c840d32c0 legacy=0x7f3c840b7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:45.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.225+0000 7f3c89200640 1 -- 172.21.15.112:0/1294809519 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c840cfd70 con 0x7f3c840d59e0 2024-09-12T02:42:45.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.226+0000 7f3c89200640 1 --2- 172.21.15.112:0/1294809519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c840d59e0 0x7f3c840d2d80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3c700097a0 tx=0x7f3c7002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19ee075a4cbc5d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:45.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.226+0000 7f3c83e00640 1 -- 172.21.15.112:0/1294809519 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c70037070 con 0x7f3c840d59e0 2024-09-12T02:42:45.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.226+0000 7f3c83e00640 1 -- 172.21.15.112:0/1294809519 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c70032640 con 0x7f3c840d59e0 2024-09-12T02:42:45.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.226+0000 7f3c83e00640 1 -- 172.21.15.112:0/1294809519 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c70032a10 con 0x7f3c840d59e0 2024-09-12T02:42:45.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.227+0000 7f3c8b000640 1 -- 172.21.15.112:0/1294809519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c840d59e0 msgr2=0x7f3c840d2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:45.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.227+0000 7f3c8b000640 1 --2- 172.21.15.112:0/1294809519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c840d59e0 0x7f3c840d2d80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3c700097a0 tx=0x7f3c7002a2c0 comp rx=0 tx=0).stop 2024-09-12T02:42:45.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.227+0000 7f3c8b000640 1 -- 172.21.15.112:0/1294809519 shutdown_connections 2024-09-12T02:42:45.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.227+0000 7f3c8b000640 1 --2- 172.21.15.112:0/1294809519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c840d59e0 0x7f3c840d2d80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:45.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.227+0000 7f3c8b000640 1 -- 172.21.15.112:0/1294809519 >> 172.21.15.112:0/1294809519 conn(0x7f3c840d4d00 msgr2=0x7f3c840d5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:45.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.227+0000 7f3c8b000640 1 -- 172.21.15.112:0/1294809519 shutdown_connections 2024-09-12T02:42:45.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.227+0000 7f3c8b000640 1 -- 172.21.15.112:0/1294809519 wait complete. 2024-09-12T02:42:45.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.228+0000 7f3c8b000640 1 Processor -- start 2024-09-12T02:42:45.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.229+0000 7f3c8b000640 1 -- start start 2024-09-12T02:42:45.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.229+0000 7f3c8b000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3c840d32c0 0x7f3c84150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:45.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.229+0000 7f3c8b000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c840d59e0 0x7f3c8415c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:45.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.229+0000 7f3c8b000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3c8415f080 0x7f3c840ca440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:45.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.229+0000 7f3c8b000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3c840d0610 con 0x7f3c840d59e0 2024-09-12T02:42:45.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.229+0000 7f3c8b000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3c840d0330 con 0x7f3c8415f080 2024-09-12T02:42:45.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.229+0000 7f3c8b000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3c840d0b30 con 0x7f3c840d32c0 2024-09-12T02:42:45.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.230+0000 7f3c89200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c840d59e0 0x7f3c8415c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:45.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.230+0000 7f3c89200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c840d59e0 0x7f3c8415c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49980/0 (socket says 172.21.15.112:49980) 2024-09-12T02:42:45.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.230+0000 7f3c89200640 1 -- 172.21.15.112:0/1113201904 learned_addr learned my addr 172.21.15.112:0/1113201904 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:45.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.230+0000 7f3c89c00640 1 --2- 172.21.15.112:0/1113201904 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3c840d32c0 0x7f3c84150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:45.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.230+0000 7f3c8a600640 1 --2- 172.21.15.112:0/1113201904 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3c8415f080 0x7f3c840ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:45.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.230+0000 7f3c89200640 1 -- 172.21.15.112:0/1113201904 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3c840d32c0 msgr2=0x7f3c84150970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:45.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.230+0000 7f3c89200640 1 --2- 172.21.15.112:0/1113201904 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3c840d32c0 0x7f3c84150970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:45.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.230+0000 7f3c89200640 1 -- 172.21.15.112:0/1113201904 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3c8415f080 msgr2=0x7f3c840ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:45.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.230+0000 7f3c89200640 1 --2- 172.21.15.112:0/1113201904 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3c8415f080 0x7f3c840ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:45.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.230+0000 7f3c89200640 1 -- 172.21.15.112:0/1113201904 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c840b8cb0 con 0x7f3c840d59e0 2024-09-12T02:42:45.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.230+0000 7f3c89200640 1 --2- 172.21.15.112:0/1113201904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c840d59e0 0x7f3c8415c2f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3c70035040 tx=0x7f3c700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:45.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.231+0000 7f3c81600640 1 -- 172.21.15.112:0/1113201904 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c70041030 con 0x7f3c840d59e0 2024-09-12T02:42:45.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.231+0000 7f3c81600640 1 -- 172.21.15.112:0/1113201904 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c70030750 con 0x7f3c840d59e0 2024-09-12T02:42:45.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.231+0000 7f3c8b000640 1 -- 172.21.15.112:0/1113201904 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c840b8f90 con 0x7f3c840d59e0 2024-09-12T02:42:45.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.231+0000 7f3c81600640 1 -- 172.21.15.112:0/1113201904 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c70037040 con 0x7f3c840d59e0 2024-09-12T02:42:45.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.231+0000 7f3c8b000640 1 -- 172.21.15.112:0/1113201904 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c840b9550 con 0x7f3c840d59e0 2024-09-12T02:42:45.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.232+0000 7f3c8b000640 1 -- 172.21.15.112:0/1113201904 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c840d2d80 con 0x7f3c840d59e0 2024-09-12T02:42:45.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.233+0000 7f3c81600640 1 -- 172.21.15.112:0/1113201904 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3c70044070 con 0x7f3c840d59e0 2024-09-12T02:42:45.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.234+0000 7f3c81600640 1 --2- 172.21.15.112:0/1113201904 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3c6406be30 0x7f3c6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:45.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.234+0000 7f3c81600640 1 -- 172.21.15.112:0/1113201904 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5227+0+0 (secure 0 0 0) 0x7f3c700ab3f0 con 0x7f3c840d59e0 2024-09-12T02:42:45.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.234+0000 7f3c89c00640 1 --2- 172.21.15.112:0/1113201904 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3c6406be30 0x7f3c6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:45.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.235+0000 7f3c89c00640 1 --2- 172.21.15.112:0/1113201904 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3c6406be30 0x7f3c6406e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3c780016e0 tx=0x7f3c78009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:45.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.238+0000 7f3c81600640 1 -- 172.21.15.112:0/1113201904 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3c70079920 con 0x7f3c840d59e0 2024-09-12T02:42:45.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:45.410+0000 7f3c8b000640 1 -- 172.21.15.112:0/1113201904 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f3c8406e2e0 con 0x7f3c840d59e0 2024-09-12T02:42:46.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.045+0000 7f3c81600640 1 -- 172.21.15.112:0/1113201904 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) ==== 170+0+0 (secure 0 0 0) 0x7f3c7007dc20 con 0x7f3c840d59e0 2024-09-12T02:42:46.046 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' created 2024-09-12T02:42:46.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.049+0000 7f3c8b000640 1 -- 172.21.15.112:0/1113201904 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3c6406be30 msgr2=0x7f3c6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:46.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.049+0000 7f3c8b000640 1 --2- 172.21.15.112:0/1113201904 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3c6406be30 0x7f3c6406e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3c780016e0 tx=0x7f3c78009040 comp rx=0 tx=0).stop 2024-09-12T02:42:46.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.049+0000 7f3c8b000640 1 -- 172.21.15.112:0/1113201904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c840d59e0 msgr2=0x7f3c8415c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:46.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.049+0000 7f3c8b000640 1 --2- 172.21.15.112:0/1113201904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c840d59e0 0x7f3c8415c2f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3c70035040 tx=0x7f3c700046c0 comp rx=0 tx=0).stop 2024-09-12T02:42:46.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.049+0000 7f3c8b000640 1 -- 172.21.15.112:0/1113201904 shutdown_connections 2024-09-12T02:42:46.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.049+0000 7f3c8b000640 1 --2- 172.21.15.112:0/1113201904 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3c6406be30 0x7f3c6406e2f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:46.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.049+0000 7f3c8b000640 1 --2- 172.21.15.112:0/1113201904 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3c8415f080 0x7f3c840ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:46.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.049+0000 7f3c8b000640 1 --2- 172.21.15.112:0/1113201904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c840d59e0 0x7f3c8415c2f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:46.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.049+0000 7f3c8b000640 1 --2- 172.21.15.112:0/1113201904 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3c840d32c0 0x7f3c84150970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:46.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.050+0000 7f3c8b000640 1 -- 172.21.15.112:0/1113201904 >> 172.21.15.112:0/1113201904 conn(0x7f3c840d4d00 msgr2=0x7f3c84161fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:46.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.051+0000 7f3c8b000640 1 -- 172.21.15.112:0/1113201904 shutdown_connections 2024-09-12T02:42:46.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.052+0000 7f3c8b000640 1 -- 172.21.15.112:0/1113201904 wait complete. 2024-09-12T02:42:46.079 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T02:42:46.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.234+0000 7fa9a8200640 1 Processor -- start 2024-09-12T02:42:46.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.234+0000 7fa9a8200640 1 -- start start 2024-09-12T02:42:46.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.236+0000 7fa9a8200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa9a006d8c0 0x7fa9a00afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:46.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.236+0000 7fa9a8200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9a00aedd0 con 0x7fa9a00ae8d0 2024-09-12T02:42:46.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.236+0000 7fa9a8200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9a00af0b0 con 0x7fa9a006dca0 2024-09-12T02:42:46.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.236+0000 7fa9a8200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa9a00af390 con 0x7fa9a006d8c0 2024-09-12T02:42:46.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.236+0000 7fa9a4e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa9a00ae8d0 0x7fa9a00715a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36402/0 (socket says 172.21.15.112:36402) 2024-09-12T02:42:46.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.236+0000 7fa9a4e00640 1 -- 172.21.15.112:0/393430845 learned_addr learned my addr 172.21.15.112:0/393430845 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:46.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.236+0000 7fa9a5800640 1 --2- 172.21.15.112:0/393430845 >> v2:172.21.15.137:3300/0 conn(0x7fa9a006d8c0 0x7fa9a00afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:46.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.236+0000 7fa99fe00640 1 -- 172.21.15.112:0/393430845 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4198495612 0 0) 0x7fa9a00aedd0 con 0x7fa9a00ae8d0 2024-09-12T02:42:46.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.236+0000 7fa99fe00640 1 -- 172.21.15.112:0/393430845 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa988003520 con 0x7fa9a00ae8d0 2024-09-12T02:42:46.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.237+0000 7fa99fe00640 1 -- 172.21.15.112:0/393430845 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1430336155 0 0) 0x7fa988003520 con 0x7fa9a00ae8d0 2024-09-12T02:42:46.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.237+0000 7fa9a5800640 1 -- 172.21.15.112:0/393430845 >> v1:172.21.15.137:6789/0 conn(0x7fa9a006dca0 legacy=0x7fa9a006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:46.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.237+0000 7fa9a5800640 1 -- 172.21.15.112:0/393430845 >> v1:172.21.15.112:6789/0 conn(0x7fa9a00ae8d0 legacy=0x7fa9a00715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:46.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.237+0000 7fa9a5800640 1 -- 172.21.15.112:0/393430845 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a00af670 con 0x7fa9a006d8c0 2024-09-12T02:42:46.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.238+0000 7fa9a5800640 1 --2- 172.21.15.112:0/393430845 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9a006d8c0 0x7fa9a00afe70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa9940097a0 tx=0x7fa99402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=294c96dfa158a8c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:46.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.238+0000 7fa99fe00640 1 -- 172.21.15.112:0/393430845 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa994037070 con 0x7fa9a006d8c0 2024-09-12T02:42:46.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.238+0000 7fa99fe00640 1 -- 172.21.15.112:0/393430845 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa99402ac50 con 0x7fa9a006d8c0 2024-09-12T02:42:46.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.238+0000 7fa99fe00640 1 -- 172.21.15.112:0/393430845 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98c0017f0 con 0x7fa9a006d8c0 2024-09-12T02:42:46.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.239+0000 7fa9a8200640 1 -- 172.21.15.112:0/393430845 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9a006d8c0 msgr2=0x7fa9a00afe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:46.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.239+0000 7fa9a8200640 1 --2- 172.21.15.112:0/393430845 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9a006d8c0 0x7fa9a00afe70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa9940097a0 tx=0x7fa99402a1c0 comp rx=0 tx=0).stop 2024-09-12T02:42:46.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.239+0000 7fa9a8200640 1 -- 172.21.15.112:0/393430845 shutdown_connections 2024-09-12T02:42:46.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.239+0000 7fa9a8200640 1 --2- 172.21.15.112:0/393430845 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9a006d8c0 0x7fa9a00afe70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:46.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.239+0000 7fa9a8200640 1 -- 172.21.15.112:0/393430845 >> 172.21.15.112:0/393430845 conn(0x7fa9a006bbd0 msgr2=0x7fa9a006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:46.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.239+0000 7fa9a8200640 1 -- 172.21.15.112:0/393430845 shutdown_connections 2024-09-12T02:42:46.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.239+0000 7fa9a8200640 1 -- 172.21.15.112:0/393430845 wait complete. 2024-09-12T02:42:46.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.240+0000 7fa9a8200640 1 Processor -- start 2024-09-12T02:42:46.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.240+0000 7fa9a8200640 1 -- start start 2024-09-12T02:42:46.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.241+0000 7fa9a8200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9a006d8c0 0x7fa9a014fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:46.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.241+0000 7fa9a8200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9a006dca0 0x7fa9a0160750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:46.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.241+0000 7fa9a8200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9a00ae8d0 0x7fa9a0160c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:46.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.241+0000 7fa9a8200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a00b3a60 con 0x7fa9a00ae8d0 2024-09-12T02:42:46.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.241+0000 7fa9a8200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a00b38e0 con 0x7fa9a006dca0 2024-09-12T02:42:46.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.241+0000 7fa9a8200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa9a00b3be0 con 0x7fa9a006d8c0 2024-09-12T02:42:46.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.242+0000 7fa9a6200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9a00ae8d0 0x7fa9a0160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:46.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.242+0000 7fa9a6200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9a00ae8d0 0x7fa9a0160c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49992/0 (socket says 172.21.15.112:49992) 2024-09-12T02:42:46.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.242+0000 7fa9a6200640 1 -- 172.21.15.112:0/1855548809 learned_addr learned my addr 172.21.15.112:0/1855548809 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:46.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.242+0000 7fa9a4e00640 1 --2- 172.21.15.112:0/1855548809 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9a006dca0 0x7fa9a0160750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:46.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.242+0000 7fa9a5800640 1 --2- 172.21.15.112:0/1855548809 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9a006d8c0 0x7fa9a014fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:46.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.242+0000 7fa9a6200640 1 -- 172.21.15.112:0/1855548809 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9a006d8c0 msgr2=0x7fa9a014fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:46.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.242+0000 7fa9a6200640 1 --2- 172.21.15.112:0/1855548809 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9a006d8c0 0x7fa9a014fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:46.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.242+0000 7fa9a6200640 1 -- 172.21.15.112:0/1855548809 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9a006dca0 msgr2=0x7fa9a0160750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:46.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.242+0000 7fa9a6200640 1 --2- 172.21.15.112:0/1855548809 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9a006dca0 0x7fa9a0160750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:46.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.242+0000 7fa9a6200640 1 -- 172.21.15.112:0/1855548809 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a00cdc50 con 0x7fa9a00ae8d0 2024-09-12T02:42:46.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.242+0000 7fa9a6200640 1 --2- 172.21.15.112:0/1855548809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9a00ae8d0 0x7fa9a0160c90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa99800c7d0 tx=0x7fa99800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:46.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.243+0000 7fa99d600640 1 -- 172.21.15.112:0/1855548809 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa998003b70 con 0x7fa9a00ae8d0 2024-09-12T02:42:46.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.243+0000 7fa99d600640 1 -- 172.21.15.112:0/1855548809 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa998003d30 con 0x7fa9a00ae8d0 2024-09-12T02:42:46.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.243+0000 7fa9a8200640 1 -- 172.21.15.112:0/1855548809 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9a00cd970 con 0x7fa9a00ae8d0 2024-09-12T02:42:46.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.243+0000 7fa99d600640 1 -- 172.21.15.112:0/1855548809 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99800aa90 con 0x7fa9a00ae8d0 2024-09-12T02:42:46.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.243+0000 7fa9a8200640 1 -- 172.21.15.112:0/1855548809 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9a0152260 con 0x7fa9a00ae8d0 2024-09-12T02:42:46.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.244+0000 7fa9a8200640 1 -- 172.21.15.112:0/1855548809 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9a0068a30 con 0x7fa9a00ae8d0 2024-09-12T02:42:46.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.245+0000 7fa99d600640 1 -- 172.21.15.112:0/1855548809 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa99800ac30 con 0x7fa9a00ae8d0 2024-09-12T02:42:46.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.246+0000 7fa99d600640 1 --2- 172.21.15.112:0/1855548809 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa98006be30 0x7fa98006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:46.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.246+0000 7fa99d600640 1 -- 172.21.15.112:0/1855548809 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5609+0+0 (secure 0 0 0) 0x7fa99808ac30 con 0x7fa9a00ae8d0 2024-09-12T02:42:46.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.246+0000 7fa9a5800640 1 --2- 172.21.15.112:0/1855548809 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa98006be30 0x7fa98006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:46.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.247+0000 7fa9a5800640 1 --2- 172.21.15.112:0/1855548809 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa98006be30 0x7fa98006e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa994034000 tx=0x7fa99402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:46.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.251+0000 7fa99d600640 1 -- 172.21.15.112:0/1855548809 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa998058f70 con 0x7fa9a00ae8d0 2024-09-12T02:42:46.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:46.461+0000 7fa9a8200640 1 -- 172.21.15.112:0/1855548809 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa9a015b510 con 0x7fa9a00ae8d0 2024-09-12T02:42:47.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.062+0000 7fa99d600640 1 -- 172.21.15.112:0/1855548809 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v14) ==== 172+0+0 (secure 0 0 0) 0x7fa99805d270 con 0x7fa9a00ae8d0 2024-09-12T02:42:47.064 INFO:teuthology.orchestra.run.smithi112.stderr:new fs with metadata pool 4 and data pool 5 2024-09-12T02:42:47.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.067+0000 7fa9a8200640 1 -- 172.21.15.112:0/1855548809 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa98006be30 msgr2=0x7fa98006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:47.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.067+0000 7fa9a8200640 1 --2- 172.21.15.112:0/1855548809 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa98006be30 0x7fa98006e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa994034000 tx=0x7fa99402e000 comp rx=0 tx=0).stop 2024-09-12T02:42:47.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.067+0000 7fa9a8200640 1 -- 172.21.15.112:0/1855548809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9a00ae8d0 msgr2=0x7fa9a0160c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:47.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.067+0000 7fa9a8200640 1 --2- 172.21.15.112:0/1855548809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9a00ae8d0 0x7fa9a0160c90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa99800c7d0 tx=0x7fa99800cc90 comp rx=0 tx=0).stop 2024-09-12T02:42:47.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.070+0000 7fa9a8200640 1 -- 172.21.15.112:0/1855548809 shutdown_connections 2024-09-12T02:42:47.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.070+0000 7fa9a8200640 1 --2- 172.21.15.112:0/1855548809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9a00ae8d0 0x7fa9a0160c90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.070+0000 7fa9a8200640 1 --2- 172.21.15.112:0/1855548809 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa98006be30 0x7fa98006e2f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.070+0000 7fa9a8200640 1 --2- 172.21.15.112:0/1855548809 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9a006dca0 0x7fa9a0160750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.070+0000 7fa9a8200640 1 --2- 172.21.15.112:0/1855548809 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9a006d8c0 0x7fa9a014fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.070+0000 7fa9a8200640 1 -- 172.21.15.112:0/1855548809 >> 172.21.15.112:0/1855548809 conn(0x7fa9a006bbd0 msgr2=0x7fa9a015b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:47.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.072+0000 7fa9a8200640 1 -- 172.21.15.112:0/1855548809 shutdown_connections 2024-09-12T02:42:47.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.072+0000 7fa9a8200640 1 -- 172.21.15.112:0/1855548809 wait complete. 2024-09-12T02:42:47.103 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:42:47.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.254+0000 7f00bb000640 1 Processor -- start 2024-09-12T02:42:47.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.255+0000 7f00bb000640 1 -- start start 2024-09-12T02:42:47.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.256+0000 7f00bb000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f00b406d8c0 0x7f00b40afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:47.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.256+0000 7f00bb000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f00b40ae8d0 0x7f00b40715a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:47.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.256+0000 7f00bb000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00b40aedd0 con 0x7f00b406dca0 2024-09-12T02:42:47.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.256+0000 7f00bb000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f00b40af0b0 con 0x7f00b406d8c0 2024-09-12T02:42:47.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.256+0000 7f00bb000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f00b40af390 con 0x7f00b40ae8d0 2024-09-12T02:42:47.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.256+0000 7f00b3e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f00b406d8c0 0x7f00b40afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:47.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.256+0000 7f00b3e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f00b406d8c0 0x7f00b40afe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50006/0 (socket says 172.21.15.112:50006) 2024-09-12T02:42:47.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.256+0000 7f00b3e00640 1 -- 172.21.15.112:0/347067149 learned_addr learned my addr 172.21.15.112:0/347067149 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:47.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.256+0000 7f00ab400640 1 --2- 172.21.15.112:0/347067149 >> v2:172.21.15.137:3300/0 conn(0x7f00b40ae8d0 0x7f00b40715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:47.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.256+0000 7f00b3e00640 1 -- 172.21.15.112:0/347067149 >> v2:172.21.15.137:3300/0 conn(0x7f00b40ae8d0 msgr2=0x7f00b40715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:47.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.256+0000 7f00b3e00640 1 --2- 172.21.15.112:0/347067149 >> v2:172.21.15.137:3300/0 conn(0x7f00b40ae8d0 0x7f00b40715a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.256+0000 7f00b3e00640 1 -- 172.21.15.112:0/347067149 >> v1:172.21.15.137:6789/0 conn(0x7f00b406dca0 legacy=0x7f00b406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:47.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.257+0000 7f00b3e00640 1 -- 172.21.15.112:0/347067149 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b40af670 con 0x7f00b406d8c0 2024-09-12T02:42:47.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.257+0000 7f00b3e00640 1 --2- 172.21.15.112:0/347067149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00b406d8c0 0x7f00b40afe70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f00b406fa40 tx=0x7f00a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4321f5f1c8acf7c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:47.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.258+0000 7f00b3400640 1 -- 172.21.15.112:0/347067149 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a4037070 con 0x7f00b406d8c0 2024-09-12T02:42:47.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.258+0000 7f00b3400640 1 -- 172.21.15.112:0/347067149 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00a4032440 con 0x7f00b406d8c0 2024-09-12T02:42:47.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.258+0000 7f00b3400640 1 -- 172.21.15.112:0/347067149 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a4032810 con 0x7f00b406d8c0 2024-09-12T02:42:47.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.258+0000 7f00bb000640 1 -- 172.21.15.112:0/347067149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00b406d8c0 msgr2=0x7f00b40afe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:47.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.258+0000 7f00bb000640 1 --2- 172.21.15.112:0/347067149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00b406d8c0 0x7f00b40afe70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f00b406fa40 tx=0x7f00a402a270 comp rx=0 tx=0).stop 2024-09-12T02:42:47.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.258+0000 7f00bb000640 1 -- 172.21.15.112:0/347067149 shutdown_connections 2024-09-12T02:42:47.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.258+0000 7f00bb000640 1 --2- 172.21.15.112:0/347067149 >> v2:172.21.15.137:3300/0 conn(0x7f00b40ae8d0 0x7f00b40715a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.258+0000 7f00bb000640 1 --2- 172.21.15.112:0/347067149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00b406d8c0 0x7f00b40afe70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.258+0000 7f00bb000640 1 -- 172.21.15.112:0/347067149 >> 172.21.15.112:0/347067149 conn(0x7f00b406bbd0 msgr2=0x7f00b406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:47.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.259+0000 7f00bb000640 1 -- 172.21.15.112:0/347067149 shutdown_connections 2024-09-12T02:42:47.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.259+0000 7f00bb000640 1 -- 172.21.15.112:0/347067149 wait complete. 2024-09-12T02:42:47.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.260+0000 7f00bb000640 1 Processor -- start 2024-09-12T02:42:47.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.260+0000 7f00bb000640 1 -- start start 2024-09-12T02:42:47.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.261+0000 7f00bb000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00b406d8c0 0x7f00b4155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:47.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.261+0000 7f00bb000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00b406dca0 0x7f00b41467e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:47.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.261+0000 7f00bb000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00b40ae8d0 0x7f00b4146d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:47.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.261+0000 7f00bb000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f00b40b38e0 con 0x7f00b40ae8d0 2024-09-12T02:42:47.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.261+0000 7f00bb000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f00b4071ae0 con 0x7f00b406dca0 2024-09-12T02:42:47.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.261+0000 7f00bb000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f00b40b3a60 con 0x7f00b406d8c0 2024-09-12T02:42:47.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.261+0000 7f00b9000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00b40ae8d0 0x7f00b4146d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:47.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.261+0000 7f00b9000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00b40ae8d0 0x7f00b4146d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50010/0 (socket says 172.21.15.112:50010) 2024-09-12T02:42:47.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.261+0000 7f00b9000640 1 -- 172.21.15.112:0/2550891210 learned_addr learned my addr 172.21.15.112:0/2550891210 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:47.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.262+0000 7f00ab400640 1 --2- 172.21.15.112:0/2550891210 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00b406dca0 0x7f00b41467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:47.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.262+0000 7f00b3e00640 1 --2- 172.21.15.112:0/2550891210 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00b406d8c0 0x7f00b4155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:47.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.262+0000 7f00b9000640 1 -- 172.21.15.112:0/2550891210 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00b406d8c0 msgr2=0x7f00b4155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:47.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.262+0000 7f00b9000640 1 --2- 172.21.15.112:0/2550891210 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00b406d8c0 0x7f00b4155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.262+0000 7f00b9000640 1 -- 172.21.15.112:0/2550891210 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00b406dca0 msgr2=0x7f00b41467e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:47.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.262+0000 7f00b9000640 1 --2- 172.21.15.112:0/2550891210 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00b406dca0 0x7f00b41467e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.262+0000 7f00b9000640 1 -- 172.21.15.112:0/2550891210 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b41610b0 con 0x7f00b40ae8d0 2024-09-12T02:42:47.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.262+0000 7f00b9000640 1 --2- 172.21.15.112:0/2550891210 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00b40ae8d0 0x7f00b4146d20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00c7a0 tx=0x7f00ac00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:47.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.262+0000 7f00b0c00640 1 -- 172.21.15.112:0/2550891210 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ac003b70 con 0x7f00b40ae8d0 2024-09-12T02:42:47.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.262+0000 7f00b0c00640 1 -- 172.21.15.112:0/2550891210 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00ac003d30 con 0x7f00b40ae8d0 2024-09-12T02:42:47.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.262+0000 7f00b0c00640 1 -- 172.21.15.112:0/2550891210 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ac00aa90 con 0x7f00b40ae8d0 2024-09-12T02:42:47.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.262+0000 7f00bb000640 1 -- 172.21.15.112:0/2550891210 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b4161390 con 0x7f00b40ae8d0 2024-09-12T02:42:47.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.263+0000 7f00bb000640 1 -- 172.21.15.112:0/2550891210 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b4161950 con 0x7f00b40ae8d0 2024-09-12T02:42:47.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.263+0000 7f00bb000640 1 -- 172.21.15.112:0/2550891210 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00b4068a30 con 0x7f00b40ae8d0 2024-09-12T02:42:47.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.264+0000 7f00b0c00640 1 -- 172.21.15.112:0/2550891210 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f00ac00ac30 con 0x7f00b40ae8d0 2024-09-12T02:42:47.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.265+0000 7f00b0c00640 1 --2- 172.21.15.112:0/2550891210 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f009006be30 0x7f009006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:47.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.265+0000 7f00b0c00640 1 -- 172.21.15.112:0/2550891210 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f00ac08acc0 con 0x7f00b40ae8d0 2024-09-12T02:42:47.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.265+0000 7f00b3e00640 1 --2- 172.21.15.112:0/2550891210 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f009006be30 0x7f009006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:47.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.266+0000 7f00b3e00640 1 --2- 172.21.15.112:0/2550891210 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f009006be30 0x7f009006e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f00a4034000 tx=0x7f00a402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:47.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.270+0000 7f00b0c00640 1 -- 172.21.15.112:0/2550891210 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f00ac091080 con 0x7f00b40ae8d0 2024-09-12T02:42:47.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.445+0000 7f00bb000640 1 -- 172.21.15.112:0/2550891210 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f00b4067f00 con 0x7f00b40ae8d0 2024-09-12T02:42:47.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.446+0000 7f00b0c00640 1 -- 172.21.15.112:0/2550891210 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16790 (secure 0 0 0) 0x7f00ac059010 con 0x7f00b40ae8d0 2024-09-12T02:42:47.447 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:42:47.448 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":31,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:42:46.462890+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:42:44.784846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-12T02:42:45.450666+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:42:47.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.448+0000 7f00bb000640 1 -- 172.21.15.112:0/2550891210 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f009006be30 msgr2=0x7f009006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:47.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.448+0000 7f00bb000640 1 --2- 172.21.15.112:0/2550891210 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f009006be30 0x7f009006e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f00a4034000 tx=0x7f00a402e000 comp rx=0 tx=0).stop 2024-09-12T02:42:47.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.448+0000 7f00bb000640 1 -- 172.21.15.112:0/2550891210 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00b40ae8d0 msgr2=0x7f00b4146d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:47.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.448+0000 7f00bb000640 1 --2- 172.21.15.112:0/2550891210 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00b40ae8d0 0x7f00b4146d20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00c7a0 tx=0x7f00ac00cc60 comp rx=0 tx=0).stop 2024-09-12T02:42:47.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.448+0000 7f00bb000640 1 -- 172.21.15.112:0/2550891210 shutdown_connections 2024-09-12T02:42:47.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.448+0000 7f00bb000640 1 --2- 172.21.15.112:0/2550891210 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00b40ae8d0 0x7f00b4146d20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.448+0000 7f00bb000640 1 --2- 172.21.15.112:0/2550891210 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f009006be30 0x7f009006e2f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.448+0000 7f00bb000640 1 --2- 172.21.15.112:0/2550891210 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00b406dca0 0x7f00b41467e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.448+0000 7f00bb000640 1 --2- 172.21.15.112:0/2550891210 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00b406d8c0 0x7f00b4155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.448+0000 7f00bb000640 1 -- 172.21.15.112:0/2550891210 >> 172.21.15.112:0/2550891210 conn(0x7f00b406bbd0 msgr2=0x7f00b40b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:47.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.449+0000 7f00bb000640 1 -- 172.21.15.112:0/2550891210 shutdown_connections 2024-09-12T02:42:47.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.449+0000 7f00bb000640 1 -- 172.21.15.112:0/2550891210 wait complete. 2024-09-12T02:42:47.466 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:42:47.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.617+0000 7fbb4e400640 1 Processor -- start 2024-09-12T02:42:47.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.617+0000 7fbb4e400640 1 -- start start 2024-09-12T02:42:47.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.618+0000 7fbb4e400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbb4815b9d0 0x7fbb480b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:47.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.618+0000 7fbb4e400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbb480b45d0 0x7fbb480728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:47.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.618+0000 7fbb4e400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb480b54a0 con 0x7fbb4806eef0 2024-09-12T02:42:47.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.618+0000 7fbb4e400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fbb480b4a60 con 0x7fbb4815b9d0 2024-09-12T02:42:47.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.618+0000 7fbb4e400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fbb480b3af0 con 0x7fbb480b45d0 2024-09-12T02:42:47.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.619+0000 7fbb47400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbb4815b9d0 0x7fbb480b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:47.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.619+0000 7fbb47400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbb4815b9d0 0x7fbb480b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50016/0 (socket says 172.21.15.112:50016) 2024-09-12T02:42:47.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.619+0000 7fbb47400640 1 -- 172.21.15.112:0/1522153429 learned_addr learned my addr 172.21.15.112:0/1522153429 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:47.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.619+0000 7fbb46a00640 1 --2- 172.21.15.112:0/1522153429 >> v2:172.21.15.137:3300/0 conn(0x7fbb480b45d0 0x7fbb480728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:47.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.619+0000 7fbb47400640 1 -- 172.21.15.112:0/1522153429 >> v2:172.21.15.137:3300/0 conn(0x7fbb480b45d0 msgr2=0x7fbb480728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:47.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.619+0000 7fbb47400640 1 --2- 172.21.15.112:0/1522153429 >> v2:172.21.15.137:3300/0 conn(0x7fbb480b45d0 0x7fbb480728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.619+0000 7fbb47400640 1 -- 172.21.15.112:0/1522153429 >> v1:172.21.15.137:6789/0 conn(0x7fbb4806eef0 legacy=0x7fbb4806f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:47.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.619+0000 7fbb47400640 1 -- 172.21.15.112:0/1522153429 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb480b3dd0 con 0x7fbb4815b9d0 2024-09-12T02:42:47.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.620+0000 7fbb47400640 1 --2- 172.21.15.112:0/1522153429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb4815b9d0 0x7fbb480b4ec0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbb48068670 tx=0x7fbb3802a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f2f2291225b997 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:47.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.620+0000 7fbb46000640 1 -- 172.21.15.112:0/1522153429 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb38037070 con 0x7fbb4815b9d0 2024-09-12T02:42:47.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.620+0000 7fbb46000640 1 -- 172.21.15.112:0/1522153429 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb38032440 con 0x7fbb4815b9d0 2024-09-12T02:42:47.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.620+0000 7fbb46000640 1 -- 172.21.15.112:0/1522153429 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb38032810 con 0x7fbb4815b9d0 2024-09-12T02:42:47.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.621+0000 7fbb4e400640 1 -- 172.21.15.112:0/1522153429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb4815b9d0 msgr2=0x7fbb480b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:47.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.621+0000 7fbb4e400640 1 --2- 172.21.15.112:0/1522153429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb4815b9d0 0x7fbb480b4ec0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbb48068670 tx=0x7fbb3802a1f0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.621+0000 7fbb4e400640 1 -- 172.21.15.112:0/1522153429 shutdown_connections 2024-09-12T02:42:47.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.621+0000 7fbb4e400640 1 --2- 172.21.15.112:0/1522153429 >> v2:172.21.15.137:3300/0 conn(0x7fbb480b45d0 0x7fbb480728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.621+0000 7fbb4e400640 1 --2- 172.21.15.112:0/1522153429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb4815b9d0 0x7fbb480b4ec0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.621+0000 7fbb4e400640 1 -- 172.21.15.112:0/1522153429 >> 172.21.15.112:0/1522153429 conn(0x7fbb4806bbd0 msgr2=0x7fbb4806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:47.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.621+0000 7fbb4e400640 1 -- 172.21.15.112:0/1522153429 shutdown_connections 2024-09-12T02:42:47.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.621+0000 7fbb4e400640 1 -- 172.21.15.112:0/1522153429 wait complete. 2024-09-12T02:42:47.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.623+0000 7fbb4e400640 1 Processor -- start 2024-09-12T02:42:47.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.623+0000 7fbb4e400640 1 -- start start 2024-09-12T02:42:47.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.623+0000 7fbb4e400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb4806eef0 0x7fbb4815dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:47.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.624+0000 7fbb4e400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb480b45d0 0x7fbb48151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:47.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.624+0000 7fbb4e400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb4815b9d0 0x7fbb48153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:47.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.624+0000 7fbb4e400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4815bf30 con 0x7fbb4806eef0 2024-09-12T02:42:47.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.624+0000 7fbb4e400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4815bdb0 con 0x7fbb480b45d0 2024-09-12T02:42:47.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.624+0000 7fbb4e400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbb480cdcd0 con 0x7fbb4815b9d0 2024-09-12T02:42:47.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.624+0000 7fbb47400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb4806eef0 0x7fbb4815dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:47.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.624+0000 7fbb47400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb4806eef0 0x7fbb4815dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50022/0 (socket says 172.21.15.112:50022) 2024-09-12T02:42:47.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.624+0000 7fbb47400640 1 -- 172.21.15.112:0/3374437963 learned_addr learned my addr 172.21.15.112:0/3374437963 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:47.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.624+0000 7fbb46a00640 1 --2- 172.21.15.112:0/3374437963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb480b45d0 0x7fbb48151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:47.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.624+0000 7fbb47e00640 1 --2- 172.21.15.112:0/3374437963 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb4815b9d0 0x7fbb48153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:47.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.624+0000 7fbb47400640 1 -- 172.21.15.112:0/3374437963 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb4815b9d0 msgr2=0x7fbb48153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:47.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.624+0000 7fbb47400640 1 --2- 172.21.15.112:0/3374437963 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb4815b9d0 0x7fbb48153010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.624+0000 7fbb47400640 1 -- 172.21.15.112:0/3374437963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb480b45d0 msgr2=0x7fbb48151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:47.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.624+0000 7fbb47400640 1 --2- 172.21.15.112:0/3374437963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb480b45d0 0x7fbb48151870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.624+0000 7fbb47400640 1 -- 172.21.15.112:0/3374437963 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb48151db0 con 0x7fbb4806eef0 2024-09-12T02:42:47.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.625+0000 7fbb47400640 1 --2- 172.21.15.112:0/3374437963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb4806eef0 0x7fbb4815dbf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbb38000c00 tx=0x7fbb380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:47.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.625+0000 7fbb3f400640 1 -- 172.21.15.112:0/3374437963 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb38037040 con 0x7fbb4806eef0 2024-09-12T02:42:47.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.625+0000 7fbb3f400640 1 -- 172.21.15.112:0/3374437963 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb38042070 con 0x7fbb4806eef0 2024-09-12T02:42:47.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.625+0000 7fbb3f400640 1 -- 172.21.15.112:0/3374437963 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb38030880 con 0x7fbb4806eef0 2024-09-12T02:42:47.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.625+0000 7fbb4e400640 1 -- 172.21.15.112:0/3374437963 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb4815cb90 con 0x7fbb4806eef0 2024-09-12T02:42:47.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.625+0000 7fbb4e400640 1 -- 172.21.15.112:0/3374437963 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb4815d110 con 0x7fbb4806eef0 2024-09-12T02:42:47.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.626+0000 7fbb4e400640 1 -- 172.21.15.112:0/3374437963 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb48068a30 con 0x7fbb4806eef0 2024-09-12T02:42:47.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.627+0000 7fbb3f400640 1 -- 172.21.15.112:0/3374437963 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb38030a20 con 0x7fbb4806eef0 2024-09-12T02:42:47.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.628+0000 7fbb3f400640 1 --2- 172.21.15.112:0/3374437963 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbb2806be30 0x7fbb2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:47.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.628+0000 7fbb3f400640 1 -- 172.21.15.112:0/3374437963 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fbb380ab610 con 0x7fbb4806eef0 2024-09-12T02:42:47.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.628+0000 7fbb46a00640 1 --2- 172.21.15.112:0/3374437963 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbb2806be30 0x7fbb2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:47.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.629+0000 7fbb46a00640 1 --2- 172.21.15.112:0/3374437963 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbb2806be30 0x7fbb2806e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbb4815ffa0 tx=0x7fbb34009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:47.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.633+0000 7fbb3f400640 1 -- 172.21.15.112:0/3374437963 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbb38079960 con 0x7fbb4806eef0 2024-09-12T02:42:47.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.807+0000 7fbb4e400640 1 -- 172.21.15.112:0/3374437963 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbb4815fcf0 con 0x7fbb4806eef0 2024-09-12T02:42:47.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.808+0000 7fbb3f400640 1 -- 172.21.15.112:0/3374437963 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16790 (secure 0 0 0) 0x7fbb3807dc60 con 0x7fbb4806eef0 2024-09-12T02:42:47.809 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:42:47.809 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":31,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:42:46.462890+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:42:44.784846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-12T02:42:45.450666+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:42:47.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.811+0000 7fbb4e400640 1 -- 172.21.15.112:0/3374437963 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbb2806be30 msgr2=0x7fbb2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:47.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.811+0000 7fbb4e400640 1 --2- 172.21.15.112:0/3374437963 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbb2806be30 0x7fbb2806e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbb4815ffa0 tx=0x7fbb34009110 comp rx=0 tx=0).stop 2024-09-12T02:42:47.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.811+0000 7fbb4e400640 1 -- 172.21.15.112:0/3374437963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb4806eef0 msgr2=0x7fbb4815dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:47.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.811+0000 7fbb4e400640 1 --2- 172.21.15.112:0/3374437963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb4806eef0 0x7fbb4815dbf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbb38000c00 tx=0x7fbb380046c0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.811+0000 7fbb4e400640 1 -- 172.21.15.112:0/3374437963 shutdown_connections 2024-09-12T02:42:47.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.811+0000 7fbb4e400640 1 --2- 172.21.15.112:0/3374437963 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb4815b9d0 0x7fbb48153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.811+0000 7fbb4e400640 1 --2- 172.21.15.112:0/3374437963 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbb2806be30 0x7fbb2806e2f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.811+0000 7fbb4e400640 1 --2- 172.21.15.112:0/3374437963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb480b45d0 0x7fbb48151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.811+0000 7fbb4e400640 1 --2- 172.21.15.112:0/3374437963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb4806eef0 0x7fbb4815dbf0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.811+0000 7fbb4e400640 1 -- 172.21.15.112:0/3374437963 >> 172.21.15.112:0/3374437963 conn(0x7fbb4806bbd0 msgr2=0x7fbb480b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:47.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.811+0000 7fbb4e400640 1 -- 172.21.15.112:0/3374437963 shutdown_connections 2024-09-12T02:42:47.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.811+0000 7fbb4e400640 1 -- 172.21.15.112:0/3374437963 wait complete. 2024-09-12T02:42:47.827 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T02:42:47.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.981+0000 7fa67f200640 1 Processor -- start 2024-09-12T02:42:47.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.982+0000 7fa67f200640 1 -- start start 2024-09-12T02:42:47.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.983+0000 7fa67f200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa6800d0b50 0x7fa6800b4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:47.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.983+0000 7fa67f200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6800d3b20 con 0x7fa6800b3c70 2024-09-12T02:42:47.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.983+0000 7fa67f200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6800b6100 con 0x7fa6801626a0 2024-09-12T02:42:47.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.983+0000 7fa67f200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa6800b63e0 con 0x7fa6800d0b50 2024-09-12T02:42:47.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.983+0000 7fa675400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa6800d0b50 0x7fa6800b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:47.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.983+0000 7fa67e800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa6800b3c70 0x7fa6800d2d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36410/0 (socket says 172.21.15.112:36410) 2024-09-12T02:42:47.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.983+0000 7fa67e800640 1 -- 172.21.15.112:0/739386594 learned_addr learned my addr 172.21.15.112:0/739386594 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:47.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.983+0000 7fa675400640 1 -- 172.21.15.112:0/739386594 >> v1:172.21.15.137:6789/0 conn(0x7fa6801626a0 legacy=0x7fa6800d1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:47.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.983+0000 7fa675400640 1 -- 172.21.15.112:0/739386594 >> v1:172.21.15.112:6789/0 conn(0x7fa6800b3c70 legacy=0x7fa6800d2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:47.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.983+0000 7fa675400640 1 -- 172.21.15.112:0/739386594 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6800b66c0 con 0x7fa6800d0b50 2024-09-12T02:42:47.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.984+0000 7fa675400640 1 --2- 172.21.15.112:0/739386594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6800d0b50 0x7fa6800b4710 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa6680097a0 tx=0x7fa66802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=875b5b82e03e919b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:47.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.985+0000 7fa67d400640 1 -- 172.21.15.112:0/739386594 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa668037070 con 0x7fa6800d0b50 2024-09-12T02:42:47.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.985+0000 7fa67d400640 1 -- 172.21.15.112:0/739386594 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa668032440 con 0x7fa6800d0b50 2024-09-12T02:42:47.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.985+0000 7fa67d400640 1 -- 172.21.15.112:0/739386594 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa668032810 con 0x7fa6800d0b50 2024-09-12T02:42:47.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.985+0000 7fa67f200640 1 -- 172.21.15.112:0/739386594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6800d0b50 msgr2=0x7fa6800b4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:47.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.985+0000 7fa67f200640 1 --2- 172.21.15.112:0/739386594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6800d0b50 0x7fa6800b4710 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa6680097a0 tx=0x7fa66802a1a0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.985+0000 7fa67f200640 1 -- 172.21.15.112:0/739386594 shutdown_connections 2024-09-12T02:42:47.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.985+0000 7fa67f200640 1 --2- 172.21.15.112:0/739386594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6800d0b50 0x7fa6800b4710 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.985+0000 7fa67f200640 1 -- 172.21.15.112:0/739386594 >> 172.21.15.112:0/739386594 conn(0x7fa6800d4e10 msgr2=0x7fa6800d5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:47.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.985+0000 7fa67f200640 1 -- 172.21.15.112:0/739386594 shutdown_connections 2024-09-12T02:42:47.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.985+0000 7fa67f200640 1 -- 172.21.15.112:0/739386594 wait complete. 2024-09-12T02:42:47.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.987+0000 7fa67f200640 1 Processor -- start 2024-09-12T02:42:47.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.987+0000 7fa67f200640 1 -- start start 2024-09-12T02:42:47.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.988+0000 7fa67f200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6800b3c70 0x7fa6801f5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:47.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.988+0000 7fa67f200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6800d0b50 0x7fa68015df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:47.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.988+0000 7fa67f200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa6801626a0 0x7fa68015e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:47.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.988+0000 7fa67f200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa6800d3f80 con 0x7fa6800b3c70 2024-09-12T02:42:47.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.988+0000 7fa67f200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa6800d3e00 con 0x7fa6800d0b50 2024-09-12T02:42:47.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.988+0000 7fa67f200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa680162a80 con 0x7fa6801626a0 2024-09-12T02:42:47.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.988+0000 7fa67de00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6800b3c70 0x7fa6801f5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:47.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.988+0000 7fa67de00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6800b3c70 0x7fa6801f5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50040/0 (socket says 172.21.15.112:50040) 2024-09-12T02:42:47.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.988+0000 7fa67de00640 1 -- 172.21.15.112:0/16285909 learned_addr learned my addr 172.21.15.112:0/16285909 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:47.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.989+0000 7fa675400640 1 --2- 172.21.15.112:0/16285909 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6800d0b50 0x7fa68015df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:47.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.989+0000 7fa67de00640 1 -- 172.21.15.112:0/16285909 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa6801626a0 msgr2=0x7fa68015e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:47.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.989+0000 7fa67e800640 1 --2- 172.21.15.112:0/16285909 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa6801626a0 0x7fa68015e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:47.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.989+0000 7fa67de00640 1 --2- 172.21.15.112:0/16285909 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa6801626a0 0x7fa68015e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.989+0000 7fa67de00640 1 -- 172.21.15.112:0/16285909 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6800d0b50 msgr2=0x7fa68015df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:47.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.989+0000 7fa67de00640 1 --2- 172.21.15.112:0/16285909 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6800d0b50 0x7fa68015df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.989+0000 7fa67de00640 1 -- 172.21.15.112:0/16285909 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa680155600 con 0x7fa6800b3c70 2024-09-12T02:42:47.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.989+0000 7fa675400640 1 --2- 172.21.15.112:0/16285909 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6800d0b50 0x7fa68015df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:42:47.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.989+0000 7fa67e800640 1 --2- 172.21.15.112:0/16285909 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa6801626a0 0x7fa68015e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:42:47.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.989+0000 7fa67de00640 1 --2- 172.21.15.112:0/16285909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6800b3c70 0x7fa6801f5c90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa67000c3f0 tx=0x7fa67000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:47.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.989+0000 7fa676a00640 1 -- 172.21.15.112:0/16285909 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa670017070 con 0x7fa6800b3c70 2024-09-12T02:42:47.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.989+0000 7fa676a00640 1 -- 172.21.15.112:0/16285909 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6700052f0 con 0x7fa6800b3c70 2024-09-12T02:42:47.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.989+0000 7fa67f200640 1 -- 172.21.15.112:0/16285909 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6801f61d0 con 0x7fa6800b3c70 2024-09-12T02:42:47.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.989+0000 7fa676a00640 1 -- 172.21.15.112:0/16285909 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa670003830 con 0x7fa6800b3c70 2024-09-12T02:42:47.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.990+0000 7fa67f200640 1 -- 172.21.15.112:0/16285909 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6800b8400 con 0x7fa6800b3c70 2024-09-12T02:42:47.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.991+0000 7fa67f200640 1 -- 172.21.15.112:0/16285909 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6800d1fa0 con 0x7fa6800b3c70 2024-09-12T02:42:47.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.991+0000 7fa676a00640 1 -- 172.21.15.112:0/16285909 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa67001a070 con 0x7fa6800b3c70 2024-09-12T02:42:47.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.993+0000 7fa676a00640 1 --2- 172.21.15.112:0/16285909 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa65c06be60 0x7fa65c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:47.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.993+0000 7fa676a00640 1 -- 172.21.15.112:0/16285909 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fa67008a240 con 0x7fa6800b3c70 2024-09-12T02:42:47.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.993+0000 7fa675400640 1 --2- 172.21.15.112:0/16285909 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa65c06be60 0x7fa65c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:47.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.993+0000 7fa675400640 1 --2- 172.21.15.112:0/16285909 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa65c06be60 0x7fa65c06e320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa668034000 tx=0x7fa66802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:47.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:47.997+0000 7fa676a00640 1 -- 172.21.15.112:0/16285909 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa6801f61d0 con 0x7fa6800b3c70 2024-09-12T02:42:48.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:48.209+0000 7fa67f200640 1 -- 172.21.15.112:0/16285909 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa680155820 con 0x7fa6800b3c70 2024-09-12T02:42:49.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.088+0000 7fa676a00640 1 -- 172.21.15.112:0/16285909 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fa680155600 con 0x7fa6800b3c70 2024-09-12T02:42:49.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.092+0000 7fa67f200640 1 -- 172.21.15.112:0/16285909 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa65c06be60 msgr2=0x7fa65c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:49.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.092+0000 7fa67f200640 1 --2- 172.21.15.112:0/16285909 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa65c06be60 0x7fa65c06e320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa668034000 tx=0x7fa66802e000 comp rx=0 tx=0).stop 2024-09-12T02:42:49.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.092+0000 7fa67f200640 1 -- 172.21.15.112:0/16285909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6800b3c70 msgr2=0x7fa6801f5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:49.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.092+0000 7fa67f200640 1 --2- 172.21.15.112:0/16285909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6800b3c70 0x7fa6801f5c90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa67000c3f0 tx=0x7fa67000c8b0 comp rx=0 tx=0).stop 2024-09-12T02:42:49.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.092+0000 7fa67f200640 1 -- 172.21.15.112:0/16285909 shutdown_connections 2024-09-12T02:42:49.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.092+0000 7fa67f200640 1 --2- 172.21.15.112:0/16285909 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa6801626a0 0x7fa68015e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:49.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.092+0000 7fa67f200640 1 --2- 172.21.15.112:0/16285909 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa65c06be60 0x7fa65c06e320 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:49.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.092+0000 7fa67f200640 1 --2- 172.21.15.112:0/16285909 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6800d0b50 0x7fa68015df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:49.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.092+0000 7fa67f200640 1 --2- 172.21.15.112:0/16285909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6800b3c70 0x7fa6801f5c90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:49.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.092+0000 7fa67f200640 1 -- 172.21.15.112:0/16285909 >> 172.21.15.112:0/16285909 conn(0x7fa6800d4e10 msgr2=0x7fa6801601a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:49.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.092+0000 7fa67f200640 1 -- 172.21.15.112:0/16285909 shutdown_connections 2024-09-12T02:42:49.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.092+0000 7fa67f200640 1 -- 172.21.15.112:0/16285909 wait complete. 2024-09-12T02:42:49.111 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T02:42:49.112 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T02:42:49.252 INFO:tasks.ceph.mds.c.smithi112.stderr:2024-09-12T02:42:49.251+0000 7f7e65400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:42:49.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.271+0000 7f7bc7c00640 1 Processor -- start 2024-09-12T02:42:49.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.271+0000 7f7bc7c00640 1 -- start start 2024-09-12T02:42:49.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.273+0000 7f7bc7c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7bc015b9d0 0x7f7bc00b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:49.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.273+0000 7f7bc7c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7bc006f600 0x7f7bc00728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:49.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.273+0000 7f7bc7c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bc00b54a0 con 0x7f7bc00b45d0 2024-09-12T02:42:49.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.273+0000 7f7bc7c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7bc00b4a60 con 0x7f7bc015b9d0 2024-09-12T02:42:49.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.273+0000 7f7bc7c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7bc00b3af0 con 0x7f7bc006f600 2024-09-12T02:42:49.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.273+0000 7f7bc5c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7bc006f600 0x7f7bc00728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:49.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.273+0000 7f7bc5200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7bc015b9d0 0x7f7bc00b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:49.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.273+0000 7f7bc5c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7bc006f600 0x7f7bc00728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:35214/0 (socket says 172.21.15.112:35214) 2024-09-12T02:42:49.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.273+0000 7f7bc5c00640 1 -- 172.21.15.112:0/981344434 learned_addr learned my addr 172.21.15.112:0/981344434 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:49.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.273+0000 7f7bb7e00640 1 --1- 172.21.15.112:0/981344434 >> v1:172.21.15.137:6789/0 conn(0x7f7bc00b45d0 0x7f7bc006eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.112:60302/0 (socket says 172.21.15.112:60302) 2024-09-12T02:42:49.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.274+0000 7f7bc5c00640 1 -- 172.21.15.112:0/981344434 >> v2:172.21.15.137:3300/0 conn(0x7f7bc015b9d0 msgr2=0x7f7bc00b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:49.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.274+0000 7f7bc5c00640 1 --2- 172.21.15.112:0/981344434 >> v2:172.21.15.137:3300/0 conn(0x7f7bc015b9d0 0x7f7bc00b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:49.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.274+0000 7f7bc5c00640 1 -- 172.21.15.112:0/981344434 >> v1:172.21.15.137:6789/0 conn(0x7f7bc00b45d0 legacy=0x7f7bc006eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:49.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.274+0000 7f7bc5c00640 1 -- 172.21.15.112:0/981344434 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bc00b3dd0 con 0x7f7bc006f600 2024-09-12T02:42:49.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.274+0000 7f7bc5200640 1 --2- 172.21.15.112:0/981344434 >> v2:172.21.15.137:3300/0 conn(0x7f7bc015b9d0 0x7f7bc00b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:42:49.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.275+0000 7f7bc5c00640 1 --2- 172.21.15.112:0/981344434 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7bc006f600 0x7f7bc00728c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8009e50 tx=0x7f7bb802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41023f13f0ee7f6a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:49.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.275+0000 7f7bbfe00640 1 -- 172.21.15.112:0/981344434 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8036070 con 0x7f7bc006f600 2024-09-12T02:42:49.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.275+0000 7f7bbfe00640 1 -- 172.21.15.112:0/981344434 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bb8031600 con 0x7f7bc006f600 2024-09-12T02:42:49.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.275+0000 7f7bbfe00640 1 -- 172.21.15.112:0/981344434 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb80319d0 con 0x7f7bc006f600 2024-09-12T02:42:49.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.275+0000 7f7bc7c00640 1 -- 172.21.15.112:0/981344434 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7bc006f600 msgr2=0x7f7bc00728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:49.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.275+0000 7f7bc7c00640 1 --2- 172.21.15.112:0/981344434 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7bc006f600 0x7f7bc00728c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8009e50 tx=0x7f7bb802a710 comp rx=0 tx=0).stop 2024-09-12T02:42:49.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.276+0000 7f7bc7c00640 1 -- 172.21.15.112:0/981344434 shutdown_connections 2024-09-12T02:42:49.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.276+0000 7f7bc7c00640 1 --2- 172.21.15.112:0/981344434 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7bc006f600 0x7f7bc00728c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:49.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.276+0000 7f7bc7c00640 1 --2- 172.21.15.112:0/981344434 >> v2:172.21.15.137:3300/0 conn(0x7f7bc015b9d0 0x7f7bc00b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:49.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.276+0000 7f7bc7c00640 1 -- 172.21.15.112:0/981344434 >> 172.21.15.112:0/981344434 conn(0x7f7bc006bbd0 msgr2=0x7f7bc006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:49.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.276+0000 7f7bc7c00640 1 -- 172.21.15.112:0/981344434 shutdown_connections 2024-09-12T02:42:49.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.276+0000 7f7bc7c00640 1 -- 172.21.15.112:0/981344434 wait complete. 2024-09-12T02:42:49.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.277+0000 7f7bc7c00640 1 Processor -- start 2024-09-12T02:42:49.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.277+0000 7f7bc7c00640 1 -- start start 2024-09-12T02:42:49.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.278+0000 7f7bc7c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7bc006f600 0x7f7bc0151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:49.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.278+0000 7f7bc7c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7bc00b45d0 0x7f7bc006e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:49.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.278+0000 7f7bc7c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7bc015b9d0 0x7f7bc006eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:49.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.278+0000 7f7bc7c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc015bf30 con 0x7f7bc006f600 2024-09-12T02:42:49.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.278+0000 7f7bc7c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc015bdb0 con 0x7f7bc00b45d0 2024-09-12T02:42:49.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.278+0000 7f7bc7c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7bc00cdcd0 con 0x7f7bc015b9d0 2024-09-12T02:42:49.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.279+0000 7f7bc5200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7bc006f600 0x7f7bc0151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:49.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.279+0000 7f7bc5200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7bc006f600 0x7f7bc0151800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50052/0 (socket says 172.21.15.112:50052) 2024-09-12T02:42:49.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.279+0000 7f7bc5200640 1 -- 172.21.15.112:0/4182514885 learned_addr learned my addr 172.21.15.112:0/4182514885 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:49.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.279+0000 7f7bc5c00640 1 --2- 172.21.15.112:0/4182514885 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7bc015b9d0 0x7f7bc006eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:49.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.279+0000 7f7bb7e00640 1 --2- 172.21.15.112:0/4182514885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7bc00b45d0 0x7f7bc006e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:49.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.279+0000 7f7bc5200640 1 -- 172.21.15.112:0/4182514885 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7bc015b9d0 msgr2=0x7f7bc006eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:49.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.279+0000 7f7bc5200640 1 --2- 172.21.15.112:0/4182514885 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7bc015b9d0 0x7f7bc006eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:49.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.279+0000 7f7bc5200640 1 -- 172.21.15.112:0/4182514885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7bc00b45d0 msgr2=0x7f7bc006e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:49.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.279+0000 7f7bc5200640 1 --2- 172.21.15.112:0/4182514885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7bc00b45d0 0x7f7bc006e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:49.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.279+0000 7f7bc5200640 1 -- 172.21.15.112:0/4182514885 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bc01f8b10 con 0x7f7bc006f600 2024-09-12T02:42:49.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.279+0000 7f7bc5200640 1 --2- 172.21.15.112:0/4182514885 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7bc006f600 0x7f7bc0151800 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7bb000e960 tx=0x7f7bb000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:49.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.280+0000 7f7bbd600640 1 -- 172.21.15.112:0/4182514885 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb0017070 con 0x7f7bc006f600 2024-09-12T02:42:49.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.280+0000 7f7bbd600640 1 -- 172.21.15.112:0/4182514885 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bb000ca00 con 0x7f7bc006f600 2024-09-12T02:42:49.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.280+0000 7f7bbd600640 1 -- 172.21.15.112:0/4182514885 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb000cdd0 con 0x7f7bc006f600 2024-09-12T02:42:49.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.280+0000 7f7bc7c00640 1 -- 172.21.15.112:0/4182514885 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bc01f8df0 con 0x7f7bc006f600 2024-09-12T02:42:49.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.280+0000 7f7bc7c00640 1 -- 172.21.15.112:0/4182514885 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bc01f93b0 con 0x7f7bc006f600 2024-09-12T02:42:49.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.281+0000 7f7bc7c00640 1 -- 172.21.15.112:0/4182514885 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bc0068a30 con 0x7f7bc006f600 2024-09-12T02:42:49.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.282+0000 7f7bbd600640 1 -- 172.21.15.112:0/4182514885 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7bb001a070 con 0x7f7bc006f600 2024-09-12T02:42:49.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.283+0000 7f7bbd600640 1 --2- 172.21.15.112:0/4182514885 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7b9c06be30 0x7f7b9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:49.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.283+0000 7f7bbd600640 1 -- 172.21.15.112:0/4182514885 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f7bb008b090 con 0x7f7bc006f600 2024-09-12T02:42:49.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.283+0000 7f7bb7e00640 1 --2- 172.21.15.112:0/4182514885 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7b9c06be30 0x7f7b9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:49.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.283+0000 7f7bb7e00640 1 --2- 172.21.15.112:0/4182514885 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7b9c06be30 0x7f7b9c06e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7bc00cd570 tx=0x7f7ba8007e70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:49.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.287+0000 7f7bbd600640 1 -- 172.21.15.112:0/4182514885 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7bb0059350 con 0x7f7bc006f600 2024-09-12T02:42:49.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:49.496+0000 7f7bc7c00640 1 -- 172.21.15.112:0/4182514885 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f7bc006dbc0 con 0x7f7bc006f600 2024-09-12T02:42:50.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.090+0000 7f7bbd600640 1 -- 172.21.15.112:0/4182514885 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f7bb005d650 con 0x7f7bc006f600 2024-09-12T02:42:50.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.093+0000 7f7bc7c00640 1 -- 172.21.15.112:0/4182514885 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7b9c06be30 msgr2=0x7f7b9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:50.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.093+0000 7f7bc7c00640 1 --2- 172.21.15.112:0/4182514885 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7b9c06be30 0x7f7b9c06e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7bc00cd570 tx=0x7f7ba8007e70 comp rx=0 tx=0).stop 2024-09-12T02:42:50.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.093+0000 7f7bc7c00640 1 -- 172.21.15.112:0/4182514885 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7bc006f600 msgr2=0x7f7bc0151800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:50.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.093+0000 7f7bc7c00640 1 --2- 172.21.15.112:0/4182514885 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7bc006f600 0x7f7bc0151800 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7bb000e960 tx=0x7f7bb000ee20 comp rx=0 tx=0).stop 2024-09-12T02:42:50.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.093+0000 7f7bc7c00640 1 -- 172.21.15.112:0/4182514885 shutdown_connections 2024-09-12T02:42:50.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.093+0000 7f7bc7c00640 1 --2- 172.21.15.112:0/4182514885 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7bc015b9d0 0x7f7bc006eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.093+0000 7f7bc7c00640 1 --2- 172.21.15.112:0/4182514885 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7b9c06be30 0x7f7b9c06e2f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.093+0000 7f7bc7c00640 1 --2- 172.21.15.112:0/4182514885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7bc00b45d0 0x7f7bc006e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.093+0000 7f7bc7c00640 1 --2- 172.21.15.112:0/4182514885 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7bc006f600 0x7f7bc0151800 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.093+0000 7f7bc7c00640 1 -- 172.21.15.112:0/4182514885 >> 172.21.15.112:0/4182514885 conn(0x7f7bc006bbd0 msgr2=0x7f7bc00afb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:50.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.093+0000 7f7bc7c00640 1 -- 172.21.15.112:0/4182514885 shutdown_connections 2024-09-12T02:42:50.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.093+0000 7f7bc7c00640 1 -- 172.21.15.112:0/4182514885 wait complete. 2024-09-12T02:42:50.112 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T02:42:50.112 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:42:50.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.264+0000 7f0d55600640 1 Processor -- start 2024-09-12T02:42:50.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.264+0000 7f0d55600640 1 -- start start 2024-09-12T02:42:50.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.265+0000 7f0d55600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d500d1710 0x7f0d500d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:50.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.265+0000 7f0d55600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0d500b1d70 0x7f0d500b2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:50.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.265+0000 7f0d55600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d500d2fb0 con 0x7f0d500b3e00 2024-09-12T02:42:50.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.265+0000 7f0d55600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f0d500d3cb0 con 0x7f0d500b1d70 2024-09-12T02:42:50.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.265+0000 7f0d55600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0d500d0b60 con 0x7f0d500d1710 2024-09-12T02:42:50.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.266+0000 7f0d4fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d500d1710 0x7f0d500d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:50.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.266+0000 7f0d54c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0d500b1d70 0x7f0d500b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:50.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.266+0000 7f0d54c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0d500b1d70 0x7f0d500b2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:54770/0 (socket says 172.21.15.112:54770) 2024-09-12T02:42:50.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.266+0000 7f0d4fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d500d1710 0x7f0d500d28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:35240/0 (socket says 172.21.15.112:35240) 2024-09-12T02:42:50.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.266+0000 7f0d54c00640 1 -- 172.21.15.112:0/3415436416 learned_addr learned my addr 172.21.15.112:0/3415436416 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:50.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.266+0000 7f0d54c00640 1 -- 172.21.15.112:0/3415436416 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d500d1710 msgr2=0x7f0d500d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:50.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.266+0000 7f0d54c00640 1 --2- 172.21.15.112:0/3415436416 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d500d1710 0x7f0d500d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.266+0000 7f0d54c00640 1 -- 172.21.15.112:0/3415436416 >> v1:172.21.15.137:6789/0 conn(0x7f0d500b3e00 legacy=0x7f0d500d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:50.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.266+0000 7f0d54c00640 1 -- 172.21.15.112:0/3415436416 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d500d3410 con 0x7f0d500b1d70 2024-09-12T02:42:50.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.267+0000 7f0d54c00640 1 --2- 172.21.15.112:0/3415436416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d500b1d70 0x7f0d500b2220 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0d48009e50 tx=0x7f0d4802a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36e6017b113f1a2a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:50.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.268+0000 7f0d4ea00640 1 -- 172.21.15.112:0/3415436416 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d48036070 con 0x7f0d500b1d70 2024-09-12T02:42:50.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.268+0000 7f0d4ea00640 1 -- 172.21.15.112:0/3415436416 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d48031600 con 0x7f0d500b1d70 2024-09-12T02:42:50.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.268+0000 7f0d4ea00640 1 -- 172.21.15.112:0/3415436416 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d480319d0 con 0x7f0d500b1d70 2024-09-12T02:42:50.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.268+0000 7f0d55600640 1 -- 172.21.15.112:0/3415436416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d500b1d70 msgr2=0x7f0d500b2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:50.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.268+0000 7f0d55600640 1 --2- 172.21.15.112:0/3415436416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d500b1d70 0x7f0d500b2220 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0d48009e50 tx=0x7f0d4802a710 comp rx=0 tx=0).stop 2024-09-12T02:42:50.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.268+0000 7f0d55600640 1 -- 172.21.15.112:0/3415436416 shutdown_connections 2024-09-12T02:42:50.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.268+0000 7f0d55600640 1 --2- 172.21.15.112:0/3415436416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d500b1d70 0x7f0d500b2220 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.268+0000 7f0d55600640 1 --2- 172.21.15.112:0/3415436416 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d500d1710 0x7f0d500d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.268+0000 7f0d55600640 1 -- 172.21.15.112:0/3415436416 >> 172.21.15.112:0/3415436416 conn(0x7f0d5009e030 msgr2=0x7f0d500d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:50.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.268+0000 7f0d55600640 1 -- 172.21.15.112:0/3415436416 shutdown_connections 2024-09-12T02:42:50.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.268+0000 7f0d55600640 1 -- 172.21.15.112:0/3415436416 wait complete. 2024-09-12T02:42:50.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.270+0000 7f0d55600640 1 Processor -- start 2024-09-12T02:42:50.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.270+0000 7f0d55600640 1 -- start start 2024-09-12T02:42:50.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.271+0000 7f0d55600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d500b1d70 0x7f0d500ba160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:50.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.271+0000 7f0d55600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d500b3e00 0x7f0d5014ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:50.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.271+0000 7f0d55600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d500d1710 0x7f0d5014e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:50.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.271+0000 7f0d55600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5015f110 con 0x7f0d500d1710 2024-09-12T02:42:50.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.271+0000 7f0d55600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0d500d39d0 con 0x7f0d500b1d70 2024-09-12T02:42:50.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.271+0000 7f0d55600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0d5015f290 con 0x7f0d500b3e00 2024-09-12T02:42:50.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.271+0000 7f0d54c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d500d1710 0x7f0d5014e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:50.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.271+0000 7f0d54c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d500d1710 0x7f0d5014e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50054/0 (socket says 172.21.15.112:50054) 2024-09-12T02:42:50.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.271+0000 7f0d54c00640 1 -- 172.21.15.112:0/556396447 learned_addr learned my addr 172.21.15.112:0/556396447 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:50.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.272+0000 7f0d4fe00640 1 --2- 172.21.15.112:0/556396447 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d500b1d70 0x7f0d500ba160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:50.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.272+0000 7f0d4f400640 1 --2- 172.21.15.112:0/556396447 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d500b3e00 0x7f0d5014ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:50.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.272+0000 7f0d54c00640 1 -- 172.21.15.112:0/556396447 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d500b3e00 msgr2=0x7f0d5014ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:50.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.272+0000 7f0d54c00640 1 --2- 172.21.15.112:0/556396447 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d500b3e00 0x7f0d5014ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.272+0000 7f0d54c00640 1 -- 172.21.15.112:0/556396447 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d500b1d70 msgr2=0x7f0d500ba160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:50.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.272+0000 7f0d54c00640 1 --2- 172.21.15.112:0/556396447 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d500b1d70 0x7f0d500ba160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.272+0000 7f0d54c00640 1 -- 172.21.15.112:0/556396447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d500b96c0 con 0x7f0d500d1710 2024-09-12T02:42:50.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.272+0000 7f0d4fe00640 1 --2- 172.21.15.112:0/556396447 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d500b1d70 0x7f0d500ba160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:50.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.272+0000 7f0d54c00640 1 --2- 172.21.15.112:0/556396447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d500d1710 0x7f0d5014e400 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0d48034040 tx=0x7f0d48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:50.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.272+0000 7f0d47e00640 1 -- 172.21.15.112:0/556396447 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4803f020 con 0x7f0d500d1710 2024-09-12T02:42:50.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.273+0000 7f0d47e00640 1 -- 172.21.15.112:0/556396447 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d48037040 con 0x7f0d500d1710 2024-09-12T02:42:50.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.273+0000 7f0d55600640 1 -- 172.21.15.112:0/556396447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d5015f410 con 0x7f0d500d1710 2024-09-12T02:42:50.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.273+0000 7f0d47e00640 1 -- 172.21.15.112:0/556396447 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d48036070 con 0x7f0d500d1710 2024-09-12T02:42:50.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.273+0000 7f0d55600640 1 -- 172.21.15.112:0/556396447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d5015f9d0 con 0x7f0d500d1710 2024-09-12T02:42:50.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.274+0000 7f0d55600640 1 -- 172.21.15.112:0/556396447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d500d28d0 con 0x7f0d500d1710 2024-09-12T02:42:50.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.274+0000 7f0d47e00640 1 -- 172.21.15.112:0/556396447 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0d48042020 con 0x7f0d500d1710 2024-09-12T02:42:50.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.275+0000 7f0d47e00640 1 --2- 172.21.15.112:0/556396447 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0d3006be30 0x7f0d3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:50.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.275+0000 7f0d47e00640 1 -- 172.21.15.112:0/556396447 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f0d480ab3e0 con 0x7f0d500d1710 2024-09-12T02:42:50.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.276+0000 7f0d4fe00640 1 --2- 172.21.15.112:0/556396447 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0d3006be30 0x7f0d3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:50.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.276+0000 7f0d4fe00640 1 --2- 172.21.15.112:0/556396447 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0d3006be30 0x7f0d3006e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0d40009af0 tx=0x7f0d40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:50.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.280+0000 7f0d47e00640 1 -- 172.21.15.112:0/556396447 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0d48049030 con 0x7f0d500d1710 2024-09-12T02:42:50.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.488+0000 7f0d55600640 1 -- 172.21.15.112:0/556396447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d500b49d0 con 0x7f0d500d1710 2024-09-12T02:42:50.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.488+0000 7f0d47e00640 1 -- 172.21.15.112:0/556396447 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5232 (secure 0 0 0) 0x7f0d48079610 con 0x7f0d500d1710 2024-09-12T02:42:50.489 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:42:50.490 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":18,"btime":"2024-09-12T02:42:50:089881+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/2907398106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2907398106},{"type":"v1","addr":"172.21.15.112:6836","nonce":2907398106}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3325408635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3325408635},{"type":"v1","addr":"172.21.15.137:6835","nonce":3325408635}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4678,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3355910952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3355910952},{"type":"v1","addr":"172.21.15.137:6833","nonce":3355910952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:42:46.463211+0000","modified":"2024-09-12T02:42:49.497590+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4761},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4761":{"gid":4761,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.112:6837/917811402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":917811402},{"type":"v1","addr":"172.21.15.112:6837","nonce":917811402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4761,"qdb_cluster":[4761]},"id":2}]} 2024-09-12T02:42:50.490 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 18 2024-09-12T02:42:50.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.490+0000 7f0d55600640 1 -- 172.21.15.112:0/556396447 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0d3006be30 msgr2=0x7f0d3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:50.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.491+0000 7f0d55600640 1 --2- 172.21.15.112:0/556396447 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0d3006be30 0x7f0d3006e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0d40009af0 tx=0x7f0d40008040 comp rx=0 tx=0).stop 2024-09-12T02:42:50.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.491+0000 7f0d55600640 1 -- 172.21.15.112:0/556396447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d500d1710 msgr2=0x7f0d5014e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:50.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.491+0000 7f0d55600640 1 --2- 172.21.15.112:0/556396447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d500d1710 0x7f0d5014e400 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0d48034040 tx=0x7f0d48004a40 comp rx=0 tx=0).stop 2024-09-12T02:42:50.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.491+0000 7f0d55600640 1 -- 172.21.15.112:0/556396447 shutdown_connections 2024-09-12T02:42:50.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.491+0000 7f0d55600640 1 --2- 172.21.15.112:0/556396447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d500d1710 0x7f0d5014e400 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.491+0000 7f0d55600640 1 --2- 172.21.15.112:0/556396447 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d500b3e00 0x7f0d5014ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.491+0000 7f0d55600640 1 --2- 172.21.15.112:0/556396447 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0d3006be30 0x7f0d3006e2f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.491+0000 7f0d55600640 1 --2- 172.21.15.112:0/556396447 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d500b1d70 0x7f0d500ba160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.491+0000 7f0d55600640 1 -- 172.21.15.112:0/556396447 >> 172.21.15.112:0/556396447 conn(0x7f0d5009e030 msgr2=0x7f0d5006dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:50.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.491+0000 7f0d55600640 1 -- 172.21.15.112:0/556396447 shutdown_connections 2024-09-12T02:42:50.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.491+0000 7f0d55600640 1 -- 172.21.15.112:0/556396447 wait complete. 2024-09-12T02:42:50.507 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:42:50.530 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:42:50.556 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:42:50.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.660+0000 7f434ea00640 1 Processor -- start 2024-09-12T02:42:50.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.660+0000 7f434ea00640 1 -- start start 2024-09-12T02:42:50.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.661+0000 7f434ea00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f43480d28d0 0x7f43480b2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:50.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.661+0000 7f434ea00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43480d2fb0 con 0x7f43480b3e00 2024-09-12T02:42:50.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.661+0000 7f434ea00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43480d0b60 con 0x7f43480d1710 2024-09-12T02:42:50.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.661+0000 7f434ea00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f43480d3cb0 con 0x7f43480d28d0 2024-09-12T02:42:50.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.662+0000 7f434cc00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f43480b3e00 0x7f43480b1d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36418/0 (socket says 172.21.15.112:36418) 2024-09-12T02:42:50.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.662+0000 7f434cc00640 1 -- 172.21.15.112:0/1002027177 learned_addr learned my addr 172.21.15.112:0/1002027177 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:50.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.662+0000 7f434e000640 1 --2- 172.21.15.112:0/1002027177 >> v2:172.21.15.112:3300/0 conn(0x7f43480d28d0 0x7f43480b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:50.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.662+0000 7f4347e00640 1 -- 172.21.15.112:0/1002027177 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 241846936 0 0) 0x7f43480d2fb0 con 0x7f43480b3e00 2024-09-12T02:42:50.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.662+0000 7f4347e00640 1 -- 172.21.15.112:0/1002027177 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4330003520 con 0x7f43480b3e00 2024-09-12T02:42:50.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.662+0000 7f434e000640 1 -- 172.21.15.112:0/1002027177 >> v1:172.21.15.137:6789/0 conn(0x7f43480d1710 legacy=0x7f43480d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:50.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.662+0000 7f434e000640 1 -- 172.21.15.112:0/1002027177 >> v1:172.21.15.112:6789/0 conn(0x7f43480b3e00 legacy=0x7f43480b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:50.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.662+0000 7f434e000640 1 -- 172.21.15.112:0/1002027177 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43480d3410 con 0x7f43480d28d0 2024-09-12T02:42:50.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.663+0000 7f434e000640 1 --2- 172.21.15.112:0/1002027177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43480d28d0 0x7f43480b2480 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4340009d90 tx=0x7f434002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ada5e58c17c145 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:50.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.663+0000 7f4347e00640 1 -- 172.21.15.112:0/1002027177 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4340007740 con 0x7f43480d28d0 2024-09-12T02:42:50.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.663+0000 7f4347e00640 1 -- 172.21.15.112:0/1002027177 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43400078e0 con 0x7f43480d28d0 2024-09-12T02:42:50.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.663+0000 7f4347e00640 1 -- 172.21.15.112:0/1002027177 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4340007cb0 con 0x7f43480d28d0 2024-09-12T02:42:50.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.664+0000 7f434ea00640 1 -- 172.21.15.112:0/1002027177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43480d28d0 msgr2=0x7f43480b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:50.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.664+0000 7f434ea00640 1 --2- 172.21.15.112:0/1002027177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43480d28d0 0x7f43480b2480 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4340009d90 tx=0x7f434002a6f0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.664+0000 7f434ea00640 1 -- 172.21.15.112:0/1002027177 shutdown_connections 2024-09-12T02:42:50.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.664+0000 7f434ea00640 1 --2- 172.21.15.112:0/1002027177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43480d28d0 0x7f43480b2480 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.664+0000 7f434ea00640 1 -- 172.21.15.112:0/1002027177 >> 172.21.15.112:0/1002027177 conn(0x7f434809e030 msgr2=0x7f43480d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:50.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.664+0000 7f434ea00640 1 -- 172.21.15.112:0/1002027177 shutdown_connections 2024-09-12T02:42:50.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.664+0000 7f434ea00640 1 -- 172.21.15.112:0/1002027177 wait complete. 2024-09-12T02:42:50.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.666+0000 7f434ea00640 1 Processor -- start 2024-09-12T02:42:50.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.666+0000 7f434ea00640 1 -- start start 2024-09-12T02:42:50.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.667+0000 7f434ea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43480b3e00 0x7f434815c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:50.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.667+0000 7f434ea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43480d1710 0x7f434806ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:50.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.667+0000 7f434ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43480d28d0 0x7f434806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:50.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.667+0000 7f434ea00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f43480d39d0 con 0x7f43480d28d0 2024-09-12T02:42:50.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.667+0000 7f434ea00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f43480d2d60 con 0x7f43480b3e00 2024-09-12T02:42:50.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.667+0000 7f434ea00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f434815f110 con 0x7f43480d1710 2024-09-12T02:42:50.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.667+0000 7f434e000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43480d28d0 0x7f434806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:50.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.667+0000 7f434e000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43480d28d0 0x7f434806d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50078/0 (socket says 172.21.15.112:50078) 2024-09-12T02:42:50.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.667+0000 7f434e000640 1 -- 172.21.15.112:0/89689878 learned_addr learned my addr 172.21.15.112:0/89689878 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:50.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.667+0000 7f434d600640 1 --2- 172.21.15.112:0/89689878 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43480b3e00 0x7f434815c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:50.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.667+0000 7f434cc00640 1 --2- 172.21.15.112:0/89689878 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43480d1710 0x7f434806ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:50.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.667+0000 7f434e000640 1 -- 172.21.15.112:0/89689878 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43480d1710 msgr2=0x7f434806ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:50.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.667+0000 7f434e000640 1 --2- 172.21.15.112:0/89689878 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43480d1710 0x7f434806ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.667+0000 7f434e000640 1 -- 172.21.15.112:0/89689878 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43480b3e00 msgr2=0x7f434815c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:50.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.667+0000 7f434e000640 1 --2- 172.21.15.112:0/89689878 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43480b3e00 0x7f434815c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.667+0000 7f434e000640 1 -- 172.21.15.112:0/89689878 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43480b4e20 con 0x7f43480d28d0 2024-09-12T02:42:50.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.668+0000 7f434e000640 1 --2- 172.21.15.112:0/89689878 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43480d28d0 0x7f434806d3d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4340009eb0 tx=0x7f4340004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:50.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.668+0000 7f4345600640 1 -- 172.21.15.112:0/89689878 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434003f070 con 0x7f43480d28d0 2024-09-12T02:42:50.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.668+0000 7f4345600640 1 -- 172.21.15.112:0/89689878 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4340031bc0 con 0x7f43480d28d0 2024-09-12T02:42:50.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.668+0000 7f434ea00640 1 -- 172.21.15.112:0/89689878 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43480b5100 con 0x7f43480d28d0 2024-09-12T02:42:50.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.668+0000 7f4345600640 1 -- 172.21.15.112:0/89689878 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4340009450 con 0x7f43480d28d0 2024-09-12T02:42:50.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.668+0000 7f434ea00640 1 -- 172.21.15.112:0/89689878 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43480c8690 con 0x7f43480d28d0 2024-09-12T02:42:50.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.669+0000 7f434ea00640 1 -- 172.21.15.112:0/89689878 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43480c8890 con 0x7f43480d28d0 2024-09-12T02:42:50.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.670+0000 7f4345600640 1 -- 172.21.15.112:0/89689878 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f434003b410 con 0x7f43480d28d0 2024-09-12T02:42:50.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.671+0000 7f4345600640 1 --2- 172.21.15.112:0/89689878 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f432806be30 0x7f432806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:50.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.671+0000 7f4345600640 1 -- 172.21.15.112:0/89689878 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f43400ac4c0 con 0x7f43480d28d0 2024-09-12T02:42:50.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.671+0000 7f434d600640 1 --2- 172.21.15.112:0/89689878 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f432806be30 0x7f432806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:50.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.672+0000 7f434d600640 1 --2- 172.21.15.112:0/89689878 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f432806be30 0x7f432806e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f433c001780 tx=0x7f433c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:50.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.675+0000 7f4345600640 1 -- 172.21.15.112:0/89689878 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f43480c8890 con 0x7f43480d28d0 2024-09-12T02:42:50.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.881+0000 7f434ea00640 1 -- 172.21.15.112:0/89689878 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f43480d1af0 con 0x7f43480d28d0 2024-09-12T02:42:50.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.882+0000 7f4345600640 1 -- 172.21.15.112:0/89689878 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16777 (secure 0 0 0) 0x7f434007a810 con 0x7f43480d28d0 2024-09-12T02:42:50.884 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:42:50.884 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":32,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:42:48.063764+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:42:44.784846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-12T02:42:45.450666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:42:50.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.885+0000 7f434ea00640 1 -- 172.21.15.112:0/89689878 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f432806be30 msgr2=0x7f432806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:50.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.885+0000 7f434ea00640 1 --2- 172.21.15.112:0/89689878 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f432806be30 0x7f432806e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f433c001780 tx=0x7f433c009040 comp rx=0 tx=0).stop 2024-09-12T02:42:50.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.885+0000 7f434ea00640 1 -- 172.21.15.112:0/89689878 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43480d28d0 msgr2=0x7f434806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:50.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.885+0000 7f434ea00640 1 --2- 172.21.15.112:0/89689878 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43480d28d0 0x7f434806d3d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4340009eb0 tx=0x7f4340004a40 comp rx=0 tx=0).stop 2024-09-12T02:42:50.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.885+0000 7f434ea00640 1 -- 172.21.15.112:0/89689878 shutdown_connections 2024-09-12T02:42:50.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.885+0000 7f434ea00640 1 --2- 172.21.15.112:0/89689878 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43480d28d0 0x7f434806d3d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.885+0000 7f434ea00640 1 --2- 172.21.15.112:0/89689878 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43480d1710 0x7f434806ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.885+0000 7f434ea00640 1 --2- 172.21.15.112:0/89689878 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f432806be30 0x7f432806e2f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.885+0000 7f434ea00640 1 --2- 172.21.15.112:0/89689878 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43480b3e00 0x7f434815c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:50.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.885+0000 7f434ea00640 1 -- 172.21.15.112:0/89689878 >> 172.21.15.112:0/89689878 conn(0x7f434809e030 msgr2=0x7f434806c480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:50.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.885+0000 7f434ea00640 1 -- 172.21.15.112:0/89689878 shutdown_connections 2024-09-12T02:42:50.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:50.885+0000 7f434ea00640 1 -- 172.21.15.112:0/89689878 wait complete. 2024-09-12T02:42:50.902 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:42:50.902 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:42:51.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.057+0000 7f6fb6200640 1 Processor -- start 2024-09-12T02:42:51.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.057+0000 7f6fb6200640 1 -- start start 2024-09-12T02:42:51.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.058+0000 7f6fb6200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6fb0071530 0x7f6fb00af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:51.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.058+0000 7f6fb6200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6fb00719a0 0x7f6fb00afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:51.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.058+0000 7f6fb6200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fb00ceeb0 con 0x7f6fb015cc50 2024-09-12T02:42:51.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.058+0000 7f6fb6200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f6fb015d030 con 0x7f6fb0071530 2024-09-12T02:42:51.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.058+0000 7f6fb6200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6fb00cf4c0 con 0x7f6fb00719a0 2024-09-12T02:42:51.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.058+0000 7f6faea00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6fb0071530 0x7f6fb00af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:51.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.059+0000 7f6faf400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f6fb015cc50 0x7f6fb00732f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36424/0 (socket says 172.21.15.112:36424) 2024-09-12T02:42:51.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.059+0000 7f6faf400640 1 -- 172.21.15.112:0/3598250316 learned_addr learned my addr 172.21.15.112:0/3598250316 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:51.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.059+0000 7f6fafe00640 1 --2- 172.21.15.112:0/3598250316 >> v2:172.21.15.137:3300/0 conn(0x7f6fb00719a0 0x7f6fb00afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:51.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.059+0000 7f6faea00640 1 -- 172.21.15.112:0/3598250316 >> v2:172.21.15.137:3300/0 conn(0x7f6fb00719a0 msgr2=0x7f6fb00afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:51.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.059+0000 7f6faea00640 1 --2- 172.21.15.112:0/3598250316 >> v2:172.21.15.137:3300/0 conn(0x7f6fb00719a0 0x7f6fb00afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.059+0000 7f6faea00640 1 -- 172.21.15.112:0/3598250316 >> v1:172.21.15.112:6789/0 conn(0x7f6fb015cc50 legacy=0x7f6fb00732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:51.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.059+0000 7f6faea00640 1 -- 172.21.15.112:0/3598250316 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb006e300 con 0x7f6fb0071530 2024-09-12T02:42:51.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.059+0000 7f6fafe00640 1 --2- 172.21.15.112:0/3598250316 >> v2:172.21.15.137:3300/0 conn(0x7f6fb00719a0 0x7f6fb00afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:51.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.060+0000 7f6faea00640 1 --2- 172.21.15.112:0/3598250316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fb0071530 0x7f6fb00af720 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00cf640 tx=0x7f6f9c02a0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8763d11bb6dddade server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:51.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.060+0000 7f6fae000640 1 -- 172.21.15.112:0/3598250316 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c037070 con 0x7f6fb0071530 2024-09-12T02:42:51.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.060+0000 7f6fae000640 1 -- 172.21.15.112:0/3598250316 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f9c02ae40 con 0x7f6fb0071530 2024-09-12T02:42:51.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.060+0000 7f6fae000640 1 -- 172.21.15.112:0/3598250316 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c032660 con 0x7f6fb0071530 2024-09-12T02:42:51.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.061+0000 7f6fb6200640 1 -- 172.21.15.112:0/3598250316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fb0071530 msgr2=0x7f6fb00af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:51.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.061+0000 7f6fb6200640 1 --2- 172.21.15.112:0/3598250316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fb0071530 0x7f6fb00af720 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00cf640 tx=0x7f6f9c02a0f0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.061+0000 7f6fb6200640 1 -- 172.21.15.112:0/3598250316 shutdown_connections 2024-09-12T02:42:51.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.061+0000 7f6fb6200640 1 --2- 172.21.15.112:0/3598250316 >> v2:172.21.15.137:3300/0 conn(0x7f6fb00719a0 0x7f6fb00afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.061+0000 7f6fb6200640 1 --2- 172.21.15.112:0/3598250316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fb0071530 0x7f6fb00af720 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.061+0000 7f6fb6200640 1 -- 172.21.15.112:0/3598250316 >> 172.21.15.112:0/3598250316 conn(0x7f6fb006bbd0 msgr2=0x7f6fb006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:51.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.061+0000 7f6fb6200640 1 -- 172.21.15.112:0/3598250316 shutdown_connections 2024-09-12T02:42:51.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.061+0000 7f6fb6200640 1 -- 172.21.15.112:0/3598250316 wait complete. 2024-09-12T02:42:51.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.063+0000 7f6fb6200640 1 Processor -- start 2024-09-12T02:42:51.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.063+0000 7f6fb6200640 1 -- start start 2024-09-12T02:42:51.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.064+0000 7f6fb6200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6fb0071530 0x7f6fb014b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:51.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.064+0000 7f6fb6200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fb00719a0 0x7f6fb015db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:51.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.064+0000 7f6fb6200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6fb015cc50 0x7f6fb00c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:51.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.064+0000 7f6fb6200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb006f510 con 0x7f6fb00719a0 2024-09-12T02:42:51.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.064+0000 7f6fb6200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb00cf150 con 0x7f6fb015cc50 2024-09-12T02:42:51.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.064+0000 7f6fb6200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6fb006f690 con 0x7f6fb0071530 2024-09-12T02:42:51.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.064+0000 7f6faea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fb00719a0 0x7f6fb015db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:51.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.064+0000 7f6faea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fb00719a0 0x7f6fb015db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50094/0 (socket says 172.21.15.112:50094) 2024-09-12T02:42:51.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.064+0000 7f6faea00640 1 -- 172.21.15.112:0/818784747 learned_addr learned my addr 172.21.15.112:0/818784747 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:51.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.064+0000 7f6faf400640 1 --2- 172.21.15.112:0/818784747 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6fb0071530 0x7f6fb014b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:51.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.064+0000 7f6fafe00640 1 --2- 172.21.15.112:0/818784747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6fb015cc50 0x7f6fb00c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:51.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.065+0000 7f6faea00640 1 -- 172.21.15.112:0/818784747 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6fb0071530 msgr2=0x7f6fb014b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:51.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.065+0000 7f6faea00640 1 --2- 172.21.15.112:0/818784747 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6fb0071530 0x7f6fb014b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.065+0000 7f6faea00640 1 -- 172.21.15.112:0/818784747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6fb015cc50 msgr2=0x7f6fb00c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:51.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.065+0000 7f6faea00640 1 --2- 172.21.15.112:0/818784747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6fb015cc50 0x7f6fb00c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.065+0000 7f6faea00640 1 -- 172.21.15.112:0/818784747 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb015e5f0 con 0x7f6fb00719a0 2024-09-12T02:42:51.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.065+0000 7f6faf400640 1 --2- 172.21.15.112:0/818784747 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6fb0071530 0x7f6fb014b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:42:51.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.065+0000 7f6fafe00640 1 --2- 172.21.15.112:0/818784747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6fb015cc50 0x7f6fb00c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:42:51.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.065+0000 7f6faea00640 1 --2- 172.21.15.112:0/818784747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fb00719a0 0x7f6fb015db60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c000c00 tx=0x7f6f9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:51.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.065+0000 7f6fa7400640 1 -- 172.21.15.112:0/818784747 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c041070 con 0x7f6fb00719a0 2024-09-12T02:42:51.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.065+0000 7f6fa7400640 1 -- 172.21.15.112:0/818784747 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f9c03c670 con 0x7f6fb00719a0 2024-09-12T02:42:51.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.065+0000 7f6fb6200640 1 -- 172.21.15.112:0/818784747 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fb015e8d0 con 0x7f6fb00719a0 2024-09-12T02:42:51.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.065+0000 7f6fa7400640 1 -- 172.21.15.112:0/818784747 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c037040 con 0x7f6fb00719a0 2024-09-12T02:42:51.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.065+0000 7f6fb6200640 1 -- 172.21.15.112:0/818784747 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fb015e0a0 con 0x7f6fb00719a0 2024-09-12T02:42:51.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.067+0000 7f6fb6200640 1 -- 172.21.15.112:0/818784747 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fb0068a30 con 0x7f6fb00719a0 2024-09-12T02:42:51.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.067+0000 7f6fa7400640 1 -- 172.21.15.112:0/818784747 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6f9c044070 con 0x7f6fb00719a0 2024-09-12T02:42:51.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.068+0000 7f6fa7400640 1 --2- 172.21.15.112:0/818784747 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6f9006be30 0x7f6f9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:51.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.068+0000 7f6fa7400640 1 -- 172.21.15.112:0/818784747 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f6f9c0ab6b0 con 0x7f6fb00719a0 2024-09-12T02:42:51.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.069+0000 7f6faf400640 1 --2- 172.21.15.112:0/818784747 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6f9006be30 0x7f6f9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:51.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.069+0000 7f6faf400640 1 --2- 172.21.15.112:0/818784747 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6f9006be30 0x7f6f9006e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0160b40 tx=0x7f6fa0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:51.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.076+0000 7f6fa7400640 1 -- 172.21.15.112:0/818784747 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6f9c07a210 con 0x7f6fb00719a0 2024-09-12T02:42:51.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.274+0000 7f6fb6200640 1 -- 172.21.15.112:0/818784747 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6fb015e3a0 con 0x7f6f9006be30 2024-09-12T02:42:51.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.280+0000 7f6fa7400640 1 -- 172.21.15.112:0/818784747 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247423 (secure 0 0 0) 0x7f6fb015e3a0 con 0x7f6f9006be30 2024-09-12T02:42:51.285 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:42:51.286 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:42:51.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.284+0000 7f6fb6200640 1 -- 172.21.15.112:0/818784747 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6f9006be30 msgr2=0x7f6f9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:51.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.284+0000 7f6fb6200640 1 --2- 172.21.15.112:0/818784747 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6f9006be30 0x7f6f9006e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0160b40 tx=0x7f6fa0009040 comp rx=0 tx=0).stop 2024-09-12T02:42:51.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.284+0000 7f6fb6200640 1 -- 172.21.15.112:0/818784747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fb00719a0 msgr2=0x7f6fb015db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:51.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.284+0000 7f6fb6200640 1 --2- 172.21.15.112:0/818784747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fb00719a0 0x7f6fb015db60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c000c00 tx=0x7f6f9c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.285+0000 7f6fb6200640 1 -- 172.21.15.112:0/818784747 shutdown_connections 2024-09-12T02:42:51.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.285+0000 7f6fb6200640 1 --2- 172.21.15.112:0/818784747 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6f9006be30 0x7f6f9006e2f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.285+0000 7f6fb6200640 1 --2- 172.21.15.112:0/818784747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6fb015cc50 0x7f6fb00c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.285+0000 7f6fb6200640 1 --2- 172.21.15.112:0/818784747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fb00719a0 0x7f6fb015db60 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.285+0000 7f6fb6200640 1 --2- 172.21.15.112:0/818784747 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6fb0071530 0x7f6fb014b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.285+0000 7f6fb6200640 1 -- 172.21.15.112:0/818784747 >> 172.21.15.112:0/818784747 conn(0x7f6fb006bbd0 msgr2=0x7f6fb01598b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:51.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.285+0000 7f6fb6200640 1 -- 172.21.15.112:0/818784747 shutdown_connections 2024-09-12T02:42:51.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.285+0000 7f6fb6200640 1 -- 172.21.15.112:0/818784747 wait complete. 2024-09-12T02:42:51.301 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-09-12T02:42:50.973145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":105,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560303,"statfs":{"total":1600000000,"available":1597750596,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.928750"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.073065+0000","last_change":"2024-09-12T02:42:47.072440+0000","last_active":"2024-09-12T02:42:47.073065+0000","last_peered":"2024-09-12T02:42:47.073065+0000","last_clean":"2024-09-12T02:42:47.073065+0000","last_became_active":"2024-09-12T02:42:47.072197+0000","last_became_peered":"2024-09-12T02:42:47.072197+0000","last_unstale":"2024-09-12T02:42:47.073065+0000","last_undegraded":"2024-09-12T02:42:47.073065+0000","last_fullsized":"2024-09-12T02:42:47.073065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:52.974637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.073738+0000","last_change":"2024-09-12T02:42:47.073619+0000","last_active":"2024-09-12T02:42:47.073738+0000","last_peered":"2024-09-12T02:42:47.073738+0000","last_clean":"2024-09-12T02:42:47.073738+0000","last_became_active":"2024-09-12T02:42:47.073278+0000","last_became_peered":"2024-09-12T02:42:47.073278+0000","last_unstale":"2024-09-12T02:42:47.073738+0000","last_undegraded":"2024-09-12T02:42:47.073738+0000","last_fullsized":"2024-09-12T02:42:47.073738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:13.655575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.079567+0000","last_change":"2024-09-12T02:42:47.078909+0000","last_active":"2024-09-12T02:42:47.079567+0000","last_peered":"2024-09-12T02:42:47.079567+0000","last_clean":"2024-09-12T02:42:47.079567+0000","last_became_active":"2024-09-12T02:42:47.078502+0000","last_became_peered":"2024-09-12T02:42:47.078502+0000","last_unstale":"2024-09-12T02:42:47.079567+0000","last_undegraded":"2024-09-12T02:42:47.079567+0000","last_fullsized":"2024-09-12T02:42:47.079567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:55.291881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.094526+0000","last_change":"2024-09-12T02:42:47.094404+0000","last_active":"2024-09-12T02:42:47.094526+0000","last_peered":"2024-09-12T02:42:47.094526+0000","last_clean":"2024-09-12T02:42:47.094526+0000","last_became_active":"2024-09-12T02:42:47.093499+0000","last_became_peered":"2024-09-12T02:42:47.093499+0000","last_unstale":"2024-09-12T02:42:47.094526+0000","last_undegraded":"2024-09-12T02:42:47.094526+0000","last_fullsized":"2024-09-12T02:42:47.094526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:52.109896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.088906+0000","last_change":"2024-09-12T02:42:47.088800+0000","last_active":"2024-09-12T02:42:47.088906+0000","last_peered":"2024-09-12T02:42:47.088906+0000","last_clean":"2024-09-12T02:42:47.088906+0000","last_became_active":"2024-09-12T02:42:47.088388+0000","last_became_peered":"2024-09-12T02:42:47.088388+0000","last_unstale":"2024-09-12T02:42:47.088906+0000","last_undegraded":"2024-09-12T02:42:47.088906+0000","last_fullsized":"2024-09-12T02:42:47.088906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:18:47.791518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.076779+0000","last_change":"2024-09-12T02:42:47.076643+0000","last_active":"2024-09-12T02:42:47.076779+0000","last_peered":"2024-09-12T02:42:47.076779+0000","last_clean":"2024-09-12T02:42:47.076779+0000","last_became_active":"2024-09-12T02:42:47.072725+0000","last_became_peered":"2024-09-12T02:42:47.072725+0000","last_unstale":"2024-09-12T02:42:47.076779+0000","last_undegraded":"2024-09-12T02:42:47.076779+0000","last_fullsized":"2024-09-12T02:42:47.076779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:05.782231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.078615+0000","last_change":"2024-09-12T02:42:47.076807+0000","last_active":"2024-09-12T02:42:47.078615+0000","last_peered":"2024-09-12T02:42:47.078615+0000","last_clean":"2024-09-12T02:42:47.078615+0000","last_became_active":"2024-09-12T02:42:47.076326+0000","last_became_peered":"2024-09-12T02:42:47.076326+0000","last_unstale":"2024-09-12T02:42:47.078615+0000","last_undegraded":"2024-09-12T02:42:47.078615+0000","last_fullsized":"2024-09-12T02:42:47.078615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:00.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.084206+0000","last_change":"2024-09-12T02:42:47.084119+0000","last_active":"2024-09-12T02:42:47.084206+0000","last_peered":"2024-09-12T02:42:47.084206+0000","last_clean":"2024-09-12T02:42:47.084206+0000","last_became_active":"2024-09-12T02:42:47.083918+0000","last_became_peered":"2024-09-12T02:42:47.083918+0000","last_unstale":"2024-09-12T02:42:47.084206+0000","last_undegraded":"2024-09-12T02:42:47.084206+0000","last_fullsized":"2024-09-12T02:42:47.084206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:03.888894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.087128+0000","last_change":"2024-09-12T02:42:47.087001+0000","last_active":"2024-09-12T02:42:47.087128+0000","last_peered":"2024-09-12T02:42:47.087128+0000","last_clean":"2024-09-12T02:42:47.087128+0000","last_became_active":"2024-09-12T02:42:47.086672+0000","last_became_peered":"2024-09-12T02:42:47.086672+0000","last_unstale":"2024-09-12T02:42:47.087128+0000","last_undegraded":"2024-09-12T02:42:47.087128+0000","last_fullsized":"2024-09-12T02:42:47.087128+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:46.222692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.081119+0000","last_change":"2024-09-12T02:42:47.080723+0000","last_active":"2024-09-12T02:42:47.081119+0000","last_peered":"2024-09-12T02:42:47.081119+0000","last_clean":"2024-09-12T02:42:47.081119+0000","last_became_active":"2024-09-12T02:42:47.080494+0000","last_became_peered":"2024-09-12T02:42:47.080494+0000","last_unstale":"2024-09-12T02:42:47.081119+0000","last_undegraded":"2024-09-12T02:42:47.081119+0000","last_fullsized":"2024-09-12T02:42:47.081119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:37.498849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.082185+0000","last_change":"2024-09-12T02:42:47.081501+0000","last_active":"2024-09-12T02:42:47.082185+0000","last_peered":"2024-09-12T02:42:47.082185+0000","last_clean":"2024-09-12T02:42:47.082185+0000","last_became_active":"2024-09-12T02:42:47.081248+0000","last_became_peered":"2024-09-12T02:42:47.081248+0000","last_unstale":"2024-09-12T02:42:47.082185+0000","last_undegraded":"2024-09-12T02:42:47.082185+0000","last_fullsized":"2024-09-12T02:42:47.082185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:42.530345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.075818+0000","last_change":"2024-09-12T02:42:47.075441+0000","last_active":"2024-09-12T02:42:47.075818+0000","last_peered":"2024-09-12T02:42:47.075818+0000","last_clean":"2024-09-12T02:42:47.075818+0000","last_became_active":"2024-09-12T02:42:47.074436+0000","last_became_peered":"2024-09-12T02:42:47.074436+0000","last_unstale":"2024-09-12T02:42:47.075818+0000","last_undegraded":"2024-09-12T02:42:47.075818+0000","last_fullsized":"2024-09-12T02:42:47.075818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:36.763915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.084174+0000","last_change":"2024-09-12T02:42:47.082388+0000","last_active":"2024-09-12T02:42:47.084174+0000","last_peered":"2024-09-12T02:42:47.084174+0000","last_clean":"2024-09-12T02:42:47.084174+0000","last_became_active":"2024-09-12T02:42:47.081603+0000","last_became_peered":"2024-09-12T02:42:47.081603+0000","last_unstale":"2024-09-12T02:42:47.084174+0000","last_undegraded":"2024-09-12T02:42:47.084174+0000","last_fullsized":"2024-09-12T02:42:47.084174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:09.320093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.087259+0000","last_change":"2024-09-12T02:42:47.087059+0000","last_active":"2024-09-12T02:42:47.087259+0000","last_peered":"2024-09-12T02:42:47.087259+0000","last_clean":"2024-09-12T02:42:47.087259+0000","last_became_active":"2024-09-12T02:42:47.086456+0000","last_became_peered":"2024-09-12T02:42:47.086456+0000","last_unstale":"2024-09-12T02:42:47.087259+0000","last_undegraded":"2024-09-12T02:42:47.087259+0000","last_fullsized":"2024-09-12T02:42:47.087259+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:28.620764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.071612+0000","last_change":"2024-09-12T02:42:47.071485+0000","last_active":"2024-09-12T02:42:47.071612+0000","last_peered":"2024-09-12T02:42:47.071612+0000","last_clean":"2024-09-12T02:42:47.071612+0000","last_became_active":"2024-09-12T02:42:47.071237+0000","last_became_peered":"2024-09-12T02:42:47.071237+0000","last_unstale":"2024-09-12T02:42:47.071612+0000","last_undegraded":"2024-09-12T02:42:47.071612+0000","last_fullsized":"2024-09-12T02:42:47.071612+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:00.153604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.085906+0000","last_change":"2024-09-12T02:42:47.085383+0000","last_active":"2024-09-12T02:42:47.085906+0000","last_peered":"2024-09-12T02:42:47.085906+0000","last_clean":"2024-09-12T02:42:47.085906+0000","last_became_active":"2024-09-12T02:42:47.084814+0000","last_became_peered":"2024-09-12T02:42:47.084814+0000","last_unstale":"2024-09-12T02:42:47.085906+0000","last_undegraded":"2024-09-12T02:42:47.085906+0000","last_fullsized":"2024-09-12T02:42:47.085906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:40.340748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.078591+0000","last_change":"2024-09-12T02:42:47.076608+0000","last_active":"2024-09-12T02:42:47.078591+0000","last_peered":"2024-09-12T02:42:47.078591+0000","last_clean":"2024-09-12T02:42:47.078591+0000","last_became_active":"2024-09-12T02:42:47.075966+0000","last_became_peered":"2024-09-12T02:42:47.075966+0000","last_unstale":"2024-09-12T02:42:47.078591+0000","last_undegraded":"2024-09-12T02:42:47.078591+0000","last_fullsized":"2024-09-12T02:42:47.078591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:02.490084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.078672+0000","last_change":"2024-09-12T02:42:47.078470+0000","last_active":"2024-09-12T02:42:47.078672+0000","last_peered":"2024-09-12T02:42:47.078672+0000","last_clean":"2024-09-12T02:42:47.078672+0000","last_became_active":"2024-09-12T02:42:47.078144+0000","last_became_peered":"2024-09-12T02:42:47.078144+0000","last_unstale":"2024-09-12T02:42:47.078672+0000","last_undegraded":"2024-09-12T02:42:47.078672+0000","last_fullsized":"2024-09-12T02:42:47.078672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:26.033254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.091553+0000","last_change":"2024-09-12T02:42:47.090464+0000","last_active":"2024-09-12T02:42:47.091553+0000","last_peered":"2024-09-12T02:42:47.091553+0000","last_clean":"2024-09-12T02:42:47.091553+0000","last_became_active":"2024-09-12T02:42:47.090205+0000","last_became_peered":"2024-09-12T02:42:47.090205+0000","last_unstale":"2024-09-12T02:42:47.091553+0000","last_undegraded":"2024-09-12T02:42:47.091553+0000","last_fullsized":"2024-09-12T02:42:47.091553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:17.987330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.088887+0000","last_change":"2024-09-12T02:42:47.088607+0000","last_active":"2024-09-12T02:42:47.088887+0000","last_peered":"2024-09-12T02:42:47.088887+0000","last_clean":"2024-09-12T02:42:47.088887+0000","last_became_active":"2024-09-12T02:42:47.086063+0000","last_became_peered":"2024-09-12T02:42:47.086063+0000","last_unstale":"2024-09-12T02:42:47.088887+0000","last_undegraded":"2024-09-12T02:42:47.088887+0000","last_fullsized":"2024-09-12T02:42:47.088887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:33.145600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.075182+0000","last_change":"2024-09-12T02:42:47.075035+0000","last_active":"2024-09-12T02:42:47.075182+0000","last_peered":"2024-09-12T02:42:47.075182+0000","last_clean":"2024-09-12T02:42:47.075182+0000","last_became_active":"2024-09-12T02:42:47.074738+0000","last_became_peered":"2024-09-12T02:42:47.074738+0000","last_unstale":"2024-09-12T02:42:47.075182+0000","last_undegraded":"2024-09-12T02:42:47.075182+0000","last_fullsized":"2024-09-12T02:42:47.075182+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:39.397700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.074056+0000","last_change":"2024-09-12T02:42:47.072868+0000","last_active":"2024-09-12T02:42:47.074056+0000","last_peered":"2024-09-12T02:42:47.074056+0000","last_clean":"2024-09-12T02:42:47.074056+0000","last_became_active":"2024-09-12T02:42:47.072607+0000","last_became_peered":"2024-09-12T02:42:47.072607+0000","last_unstale":"2024-09-12T02:42:47.074056+0000","last_undegraded":"2024-09-12T02:42:47.074056+0000","last_fullsized":"2024-09-12T02:42:47.074056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:59.956150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.075894+0000","last_change":"2024-09-12T02:42:47.075363+0000","last_active":"2024-09-12T02:42:47.075894+0000","last_peered":"2024-09-12T02:42:47.075894+0000","last_clean":"2024-09-12T02:42:47.075894+0000","last_became_active":"2024-09-12T02:42:47.075065+0000","last_became_peered":"2024-09-12T02:42:47.075065+0000","last_unstale":"2024-09-12T02:42:47.075894+0000","last_undegraded":"2024-09-12T02:42:47.075894+0000","last_fullsized":"2024-09-12T02:42:47.075894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:27.190073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.086277+0000","last_change":"2024-09-12T02:42:47.085350+0000","last_active":"2024-09-12T02:42:47.086277+0000","last_peered":"2024-09-12T02:42:47.086277+0000","last_clean":"2024-09-12T02:42:47.086277+0000","last_became_active":"2024-09-12T02:42:47.085129+0000","last_became_peered":"2024-09-12T02:42:47.085129+0000","last_unstale":"2024-09-12T02:42:47.086277+0000","last_undegraded":"2024-09-12T02:42:47.086277+0000","last_fullsized":"2024-09-12T02:42:47.086277+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:52.888734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.084561+0000","last_change":"2024-09-12T02:42:47.083771+0000","last_active":"2024-09-12T02:42:47.084561+0000","last_peered":"2024-09-12T02:42:47.084561+0000","last_clean":"2024-09-12T02:42:47.084561+0000","last_became_active":"2024-09-12T02:42:47.083531+0000","last_became_peered":"2024-09-12T02:42:47.083531+0000","last_unstale":"2024-09-12T02:42:47.084561+0000","last_undegraded":"2024-09-12T02:42:47.084561+0000","last_fullsized":"2024-09-12T02:42:47.084561+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:30.777823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.083244+0000","last_change":"2024-09-12T02:42:47.082301+0000","last_active":"2024-09-12T02:42:47.083244+0000","last_peered":"2024-09-12T02:42:47.083244+0000","last_clean":"2024-09-12T02:42:47.083244+0000","last_became_active":"2024-09-12T02:42:47.081733+0000","last_became_peered":"2024-09-12T02:42:47.081733+0000","last_unstale":"2024-09-12T02:42:47.083244+0000","last_undegraded":"2024-09-12T02:42:47.083244+0000","last_fullsized":"2024-09-12T02:42:47.083244+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:06.453475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.082305+0000","last_change":"2024-09-12T02:42:47.082207+0000","last_active":"2024-09-12T02:42:47.082305+0000","last_peered":"2024-09-12T02:42:47.082305+0000","last_clean":"2024-09-12T02:42:47.082305+0000","last_became_active":"2024-09-12T02:42:47.080694+0000","last_became_peered":"2024-09-12T02:42:47.080694+0000","last_unstale":"2024-09-12T02:42:47.082305+0000","last_undegraded":"2024-09-12T02:42:47.082305+0000","last_fullsized":"2024-09-12T02:42:47.082305+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:12.437256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.077017+0000","last_change":"2024-09-12T02:42:47.076827+0000","last_active":"2024-09-12T02:42:47.077017+0000","last_peered":"2024-09-12T02:42:47.077017+0000","last_clean":"2024-09-12T02:42:47.077017+0000","last_became_active":"2024-09-12T02:42:47.074998+0000","last_became_peered":"2024-09-12T02:42:47.074998+0000","last_unstale":"2024-09-12T02:42:47.077017+0000","last_undegraded":"2024-09-12T02:42:47.077017+0000","last_fullsized":"2024-09-12T02:42:47.077017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:19.537991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.077966+0000","last_change":"2024-09-12T02:42:47.076391+0000","last_active":"2024-09-12T02:42:47.077966+0000","last_peered":"2024-09-12T02:42:47.077966+0000","last_clean":"2024-09-12T02:42:47.077966+0000","last_became_active":"2024-09-12T02:42:47.075251+0000","last_became_peered":"2024-09-12T02:42:47.075251+0000","last_unstale":"2024-09-12T02:42:47.077966+0000","last_undegraded":"2024-09-12T02:42:47.077966+0000","last_fullsized":"2024-09-12T02:42:47.077966+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:09.628562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.082128+0000","last_change":"2024-09-12T02:42:47.081492+0000","last_active":"2024-09-12T02:42:47.082128+0000","last_peered":"2024-09-12T02:42:47.082128+0000","last_clean":"2024-09-12T02:42:47.082128+0000","last_became_active":"2024-09-12T02:42:47.080768+0000","last_became_peered":"2024-09-12T02:42:47.080768+0000","last_unstale":"2024-09-12T02:42:47.082128+0000","last_undegraded":"2024-09-12T02:42:47.082128+0000","last_fullsized":"2024-09-12T02:42:47.082128+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:23.391410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.086642+0000","last_change":"2024-09-12T02:42:47.085753+0000","last_active":"2024-09-12T02:42:47.086642+0000","last_peered":"2024-09-12T02:42:47.086642+0000","last_clean":"2024-09-12T02:42:47.086642+0000","last_became_active":"2024-09-12T02:42:47.085462+0000","last_became_peered":"2024-09-12T02:42:47.085462+0000","last_unstale":"2024-09-12T02:42:47.086642+0000","last_undegraded":"2024-09-12T02:42:47.086642+0000","last_fullsized":"2024-09-12T02:42:47.086642+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:49.430756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.082149+0000","last_change":"2024-09-12T02:42:47.081703+0000","last_active":"2024-09-12T02:42:47.082149+0000","last_peered":"2024-09-12T02:42:47.082149+0000","last_clean":"2024-09-12T02:42:47.082149+0000","last_became_active":"2024-09-12T02:42:47.080480+0000","last_became_peered":"2024-09-12T02:42:47.080480+0000","last_unstale":"2024-09-12T02:42:47.082149+0000","last_undegraded":"2024-09-12T02:42:47.082149+0000","last_fullsized":"2024-09-12T02:42:47.082149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:04.618352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.084988+0000","last_change":"2024-09-12T02:42:47.083430+0000","last_active":"2024-09-12T02:42:47.084988+0000","last_peered":"2024-09-12T02:42:47.084988+0000","last_clean":"2024-09-12T02:42:47.084988+0000","last_became_active":"2024-09-12T02:42:47.083190+0000","last_became_peered":"2024-09-12T02:42:47.083190+0000","last_unstale":"2024-09-12T02:42:47.084988+0000","last_undegraded":"2024-09-12T02:42:47.084988+0000","last_fullsized":"2024-09-12T02:42:47.084988+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:40.216844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.087954+0000","last_change":"2024-09-12T02:42:46.057390+0000","last_active":"2024-09-12T02:42:47.087954+0000","last_peered":"2024-09-12T02:42:47.087954+0000","last_clean":"2024-09-12T02:42:47.087954+0000","last_became_active":"2024-09-12T02:42:46.057149+0000","last_became_peered":"2024-09-12T02:42:46.057149+0000","last_unstale":"2024-09-12T02:42:47.087954+0000","last_undegraded":"2024-09-12T02:42:47.087954+0000","last_fullsized":"2024-09-12T02:42:47.087954+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:48.708552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.070920+0000","last_change":"2024-09-12T02:42:47.070788+0000","last_active":"2024-09-12T02:42:47.070920+0000","last_peered":"2024-09-12T02:42:47.070920+0000","last_clean":"2024-09-12T02:42:47.070920+0000","last_became_active":"2024-09-12T02:42:47.070542+0000","last_became_peered":"2024-09-12T02:42:47.070542+0000","last_unstale":"2024-09-12T02:42:47.070920+0000","last_undegraded":"2024-09-12T02:42:47.070920+0000","last_fullsized":"2024-09-12T02:42:47.070920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:56.700195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.092354+0000","last_change":"2024-09-12T02:42:46.064945+0000","last_active":"2024-09-12T02:42:47.092354+0000","last_peered":"2024-09-12T02:42:47.092354+0000","last_clean":"2024-09-12T02:42:47.092354+0000","last_became_active":"2024-09-12T02:42:46.064557+0000","last_became_peered":"2024-09-12T02:42:46.064557+0000","last_unstale":"2024-09-12T02:42:47.092354+0000","last_undegraded":"2024-09-12T02:42:47.092354+0000","last_fullsized":"2024-09-12T02:42:47.092354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:06.569726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.082089+0000","last_change":"2024-09-12T02:42:47.080373+0000","last_active":"2024-09-12T02:42:47.082089+0000","last_peered":"2024-09-12T02:42:47.082089+0000","last_clean":"2024-09-12T02:42:47.082089+0000","last_became_active":"2024-09-12T02:42:47.080090+0000","last_became_peered":"2024-09-12T02:42:47.080090+0000","last_unstale":"2024-09-12T02:42:47.082089+0000","last_undegraded":"2024-09-12T02:42:47.082089+0000","last_fullsized":"2024-09-12T02:42:47.082089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:28.927049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.092462+0000","last_change":"2024-09-12T02:42:46.057909+0000","last_active":"2024-09-12T02:42:47.092462+0000","last_peered":"2024-09-12T02:42:47.092462+0000","last_clean":"2024-09-12T02:42:47.092462+0000","last_became_active":"2024-09-12T02:42:46.056923+0000","last_became_peered":"2024-09-12T02:42:46.056923+0000","last_unstale":"2024-09-12T02:42:47.092462+0000","last_undegraded":"2024-09-12T02:42:47.092462+0000","last_fullsized":"2024-09-12T02:42:47.092462+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:05.973784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.081398+0000","last_change":"2024-09-12T02:42:47.081287+0000","last_active":"2024-09-12T02:42:47.081398+0000","last_peered":"2024-09-12T02:42:47.081398+0000","last_clean":"2024-09-12T02:42:47.081398+0000","last_became_active":"2024-09-12T02:42:47.081057+0000","last_became_peered":"2024-09-12T02:42:47.081057+0000","last_unstale":"2024-09-12T02:42:47.081398+0000","last_undegraded":"2024-09-12T02:42:47.081398+0000","last_fullsized":"2024-09-12T02:42:47.081398+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:37.737720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.093040+0000","last_change":"2024-09-12T02:42:46.064606+0000","last_active":"2024-09-12T02:42:47.093040+0000","last_peered":"2024-09-12T02:42:47.093040+0000","last_clean":"2024-09-12T02:42:47.093040+0000","last_became_active":"2024-09-12T02:42:46.064322+0000","last_became_peered":"2024-09-12T02:42:46.064322+0000","last_unstale":"2024-09-12T02:42:47.093040+0000","last_undegraded":"2024-09-12T02:42:47.093040+0000","last_fullsized":"2024-09-12T02:42:47.093040+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:18.157260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.083031+0000","last_change":"2024-09-12T02:42:47.082895+0000","last_active":"2024-09-12T02:42:47.083031+0000","last_peered":"2024-09-12T02:42:47.083031+0000","last_clean":"2024-09-12T02:42:47.083031+0000","last_became_active":"2024-09-12T02:42:47.082286+0000","last_became_peered":"2024-09-12T02:42:47.082286+0000","last_unstale":"2024-09-12T02:42:47.083031+0000","last_undegraded":"2024-09-12T02:42:47.083031+0000","last_fullsized":"2024-09-12T02:42:47.083031+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:16.023705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.091839+0000","last_change":"2024-09-12T02:42:46.052331+0000","last_active":"2024-09-12T02:42:47.091839+0000","last_peered":"2024-09-12T02:42:47.091839+0000","last_clean":"2024-09-12T02:42:47.091839+0000","last_became_active":"2024-09-12T02:42:46.052092+0000","last_became_peered":"2024-09-12T02:42:46.052092+0000","last_unstale":"2024-09-12T02:42:47.091839+0000","last_undegraded":"2024-09-12T02:42:47.091839+0000","last_fullsized":"2024-09-12T02:42:47.091839+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:54.797583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.079526+0000","last_change":"2024-09-12T02:42:47.077541+0000","last_active":"2024-09-12T02:42:47.079526+0000","last_peered":"2024-09-12T02:42:47.079526+0000","last_clean":"2024-09-12T02:42:47.079526+0000","last_became_active":"2024-09-12T02:42:47.076588+0000","last_became_peered":"2024-09-12T02:42:47.076588+0000","last_unstale":"2024-09-12T02:42:47.079526+0000","last_undegraded":"2024-09-12T02:42:47.079526+0000","last_fullsized":"2024-09-12T02:42:47.079526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:22.031336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.092997+0000","last_change":"2024-09-12T02:42:46.053652+0000","last_active":"2024-09-12T02:42:47.092997+0000","last_peered":"2024-09-12T02:42:47.092997+0000","last_clean":"2024-09-12T02:42:47.092997+0000","last_became_active":"2024-09-12T02:42:46.052111+0000","last_became_peered":"2024-09-12T02:42:46.052111+0000","last_unstale":"2024-09-12T02:42:47.092997+0000","last_undegraded":"2024-09-12T02:42:47.092997+0000","last_fullsized":"2024-09-12T02:42:47.092997+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:30.859449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.072092+0000","last_change":"2024-09-12T02:42:47.071843+0000","last_active":"2024-09-12T02:42:47.072092+0000","last_peered":"2024-09-12T02:42:47.072092+0000","last_clean":"2024-09-12T02:42:47.072092+0000","last_became_active":"2024-09-12T02:42:47.071570+0000","last_became_peered":"2024-09-12T02:42:47.071570+0000","last_unstale":"2024-09-12T02:42:47.072092+0000","last_undegraded":"2024-09-12T02:42:47.072092+0000","last_fullsized":"2024-09-12T02:42:47.072092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:20.839082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.069320+0000","last_change":"2024-09-12T02:42:46.057443+0000","last_active":"2024-09-12T02:42:47.069320+0000","last_peered":"2024-09-12T02:42:47.069320+0000","last_clean":"2024-09-12T02:42:47.069320+0000","last_became_active":"2024-09-12T02:42:46.057221+0000","last_became_peered":"2024-09-12T02:42:46.057221+0000","last_unstale":"2024-09-12T02:42:47.069320+0000","last_undegraded":"2024-09-12T02:42:47.069320+0000","last_fullsized":"2024-09-12T02:42:47.069320+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:48.440540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.089176+0000","last_change":"2024-09-12T02:42:47.085601+0000","last_active":"2024-09-12T02:42:47.089176+0000","last_peered":"2024-09-12T02:42:47.089176+0000","last_clean":"2024-09-12T02:42:47.089176+0000","last_became_active":"2024-09-12T02:42:47.085300+0000","last_became_peered":"2024-09-12T02:42:47.085300+0000","last_unstale":"2024-09-12T02:42:47.089176+0000","last_undegraded":"2024-09-12T02:42:47.089176+0000","last_fullsized":"2024-09-12T02:42:47.089176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:33.076955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.067011+0000","last_change":"2024-09-12T02:42:46.053626+0000","last_active":"2024-09-12T02:42:47.067011+0000","last_peered":"2024-09-12T02:42:47.067011+0000","last_clean":"2024-09-12T02:42:47.067011+0000","last_became_active":"2024-09-12T02:42:46.053065+0000","last_became_peered":"2024-09-12T02:42:46.053065+0000","last_unstale":"2024-09-12T02:42:47.067011+0000","last_undegraded":"2024-09-12T02:42:47.067011+0000","last_fullsized":"2024-09-12T02:42:47.067011+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:23.424835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.082069+0000","last_change":"2024-09-12T02:42:47.081713+0000","last_active":"2024-09-12T02:42:47.082069+0000","last_peered":"2024-09-12T02:42:47.082069+0000","last_clean":"2024-09-12T02:42:47.082069+0000","last_became_active":"2024-09-12T02:42:47.079830+0000","last_became_peered":"2024-09-12T02:42:47.079830+0000","last_unstale":"2024-09-12T02:42:47.082069+0000","last_undegraded":"2024-09-12T02:42:47.082069+0000","last_fullsized":"2024-09-12T02:42:47.082069+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:10.812030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.068173+0000","last_change":"2024-09-12T02:42:46.060692+0000","last_active":"2024-09-12T02:42:47.068173+0000","last_peered":"2024-09-12T02:42:47.068173+0000","last_clean":"2024-09-12T02:42:47.068173+0000","last_became_active":"2024-09-12T02:42:46.060420+0000","last_became_peered":"2024-09-12T02:42:46.060420+0000","last_unstale":"2024-09-12T02:42:47.068173+0000","last_undegraded":"2024-09-12T02:42:47.068173+0000","last_fullsized":"2024-09-12T02:42:47.068173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:20.062583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.083263+0000","last_change":"2024-09-12T02:42:47.082497+0000","last_active":"2024-09-12T02:42:47.083263+0000","last_peered":"2024-09-12T02:42:47.083263+0000","last_clean":"2024-09-12T02:42:47.083263+0000","last_became_active":"2024-09-12T02:42:47.082048+0000","last_became_peered":"2024-09-12T02:42:47.082048+0000","last_unstale":"2024-09-12T02:42:47.083263+0000","last_undegraded":"2024-09-12T02:42:47.083263+0000","last_fullsized":"2024-09-12T02:42:47.083263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:40.696324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.070041+0000","last_change":"2024-09-12T02:42:46.058703+0000","last_active":"2024-09-12T02:42:47.070041+0000","last_peered":"2024-09-12T02:42:47.070041+0000","last_clean":"2024-09-12T02:42:47.070041+0000","last_became_active":"2024-09-12T02:42:46.058479+0000","last_became_peered":"2024-09-12T02:42:46.058479+0000","last_unstale":"2024-09-12T02:42:47.070041+0000","last_undegraded":"2024-09-12T02:42:47.070041+0000","last_fullsized":"2024-09-12T02:42:47.070041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:25.998596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.085795+0000","last_change":"2024-09-12T02:42:47.084772+0000","last_active":"2024-09-12T02:42:47.085795+0000","last_peered":"2024-09-12T02:42:47.085795+0000","last_clean":"2024-09-12T02:42:47.085795+0000","last_became_active":"2024-09-12T02:42:47.084549+0000","last_became_peered":"2024-09-12T02:42:47.084549+0000","last_unstale":"2024-09-12T02:42:47.085795+0000","last_undegraded":"2024-09-12T02:42:47.085795+0000","last_fullsized":"2024-09-12T02:42:47.085795+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:51.781817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.092355+0000","last_change":"2024-09-12T02:42:46.062917+0000","last_active":"2024-09-12T02:42:47.092355+0000","last_peered":"2024-09-12T02:42:47.092355+0000","last_clean":"2024-09-12T02:42:47.092355+0000","last_became_active":"2024-09-12T02:42:46.062515+0000","last_became_peered":"2024-09-12T02:42:46.062515+0000","last_unstale":"2024-09-12T02:42:47.092355+0000","last_undegraded":"2024-09-12T02:42:47.092355+0000","last_fullsized":"2024-09-12T02:42:47.092355+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:04.510631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.079547+0000","last_change":"2024-09-12T02:42:47.078724+0000","last_active":"2024-09-12T02:42:47.079547+0000","last_peered":"2024-09-12T02:42:47.079547+0000","last_clean":"2024-09-12T02:42:47.079547+0000","last_became_active":"2024-09-12T02:42:47.078196+0000","last_became_peered":"2024-09-12T02:42:47.078196+0000","last_unstale":"2024-09-12T02:42:47.079547+0000","last_undegraded":"2024-09-12T02:42:47.079547+0000","last_fullsized":"2024-09-12T02:42:47.079547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:45.324518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.095201+0000","last_change":"2024-09-12T02:42:46.056089+0000","last_active":"2024-09-12T02:42:47.095201+0000","last_peered":"2024-09-12T02:42:47.095201+0000","last_clean":"2024-09-12T02:42:47.095201+0000","last_became_active":"2024-09-12T02:42:46.055856+0000","last_became_peered":"2024-09-12T02:42:46.055856+0000","last_unstale":"2024-09-12T02:42:47.095201+0000","last_undegraded":"2024-09-12T02:42:47.095201+0000","last_fullsized":"2024-09-12T02:42:47.095201+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:35.388597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.084532+0000","last_change":"2024-09-12T02:42:47.082891+0000","last_active":"2024-09-12T02:42:47.084532+0000","last_peered":"2024-09-12T02:42:47.084532+0000","last_clean":"2024-09-12T02:42:47.084532+0000","last_became_active":"2024-09-12T02:42:47.082581+0000","last_became_peered":"2024-09-12T02:42:47.082581+0000","last_unstale":"2024-09-12T02:42:47.084532+0000","last_undegraded":"2024-09-12T02:42:47.084532+0000","last_fullsized":"2024-09-12T02:42:47.084532+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:48.384436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.092408+0000","last_change":"2024-09-12T02:42:46.053838+0000","last_active":"2024-09-12T02:42:47.092408+0000","last_peered":"2024-09-12T02:42:47.092408+0000","last_clean":"2024-09-12T02:42:47.092408+0000","last_became_active":"2024-09-12T02:42:46.053384+0000","last_became_peered":"2024-09-12T02:42:46.053384+0000","last_unstale":"2024-09-12T02:42:47.092408+0000","last_undegraded":"2024-09-12T02:42:47.092408+0000","last_fullsized":"2024-09-12T02:42:47.092408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:25.462430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.075976+0000","last_change":"2024-09-12T02:42:47.074498+0000","last_active":"2024-09-12T02:42:47.075976+0000","last_peered":"2024-09-12T02:42:47.075976+0000","last_clean":"2024-09-12T02:42:47.075976+0000","last_became_active":"2024-09-12T02:42:47.074272+0000","last_became_peered":"2024-09-12T02:42:47.074272+0000","last_unstale":"2024-09-12T02:42:47.075976+0000","last_undegraded":"2024-09-12T02:42:47.075976+0000","last_fullsized":"2024-09-12T02:42:47.075976+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:37.225250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.078940+0000","last_change":"2024-09-12T02:42:46.060317+0000","last_active":"2024-09-12T02:42:47.078940+0000","last_peered":"2024-09-12T02:42:47.078940+0000","last_clean":"2024-09-12T02:42:47.078940+0000","last_became_active":"2024-09-12T02:42:46.059994+0000","last_became_peered":"2024-09-12T02:42:46.059994+0000","last_unstale":"2024-09-12T02:42:47.078940+0000","last_undegraded":"2024-09-12T02:42:47.078940+0000","last_fullsized":"2024-09-12T02:42:47.078940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:09.233941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.083228+0000","last_change":"2024-09-12T02:42:47.083117+0000","last_active":"2024-09-12T02:42:47.083228+0000","last_peered":"2024-09-12T02:42:47.083228+0000","last_clean":"2024-09-12T02:42:47.083228+0000","last_became_active":"2024-09-12T02:42:47.082667+0000","last_became_peered":"2024-09-12T02:42:47.082667+0000","last_unstale":"2024-09-12T02:42:47.083228+0000","last_undegraded":"2024-09-12T02:42:47.083228+0000","last_fullsized":"2024-09-12T02:42:47.083228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:19.282752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.066896+0000","last_change":"2024-09-12T02:42:46.062230+0000","last_active":"2024-09-12T02:42:47.066896+0000","last_peered":"2024-09-12T02:42:47.066896+0000","last_clean":"2024-09-12T02:42:47.066896+0000","last_became_active":"2024-09-12T02:42:46.061994+0000","last_became_peered":"2024-09-12T02:42:46.061994+0000","last_unstale":"2024-09-12T02:42:47.066896+0000","last_undegraded":"2024-09-12T02:42:47.066896+0000","last_fullsized":"2024-09-12T02:42:47.066896+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:50.658372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.076215+0000","last_change":"2024-09-12T02:42:47.076091+0000","last_active":"2024-09-12T02:42:47.076215+0000","last_peered":"2024-09-12T02:42:47.076215+0000","last_clean":"2024-09-12T02:42:47.076215+0000","last_became_active":"2024-09-12T02:42:47.075755+0000","last_became_peered":"2024-09-12T02:42:47.075755+0000","last_unstale":"2024-09-12T02:42:47.076215+0000","last_undegraded":"2024-09-12T02:42:47.076215+0000","last_fullsized":"2024-09-12T02:42:47.076215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:42.562954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.093908+0000","last_change":"2024-09-12T02:42:46.059039+0000","last_active":"2024-09-12T02:42:47.093908+0000","last_peered":"2024-09-12T02:42:47.093908+0000","last_clean":"2024-09-12T02:42:47.093908+0000","last_became_active":"2024-09-12T02:42:46.058782+0000","last_became_peered":"2024-09-12T02:42:46.058782+0000","last_unstale":"2024-09-12T02:42:47.093908+0000","last_undegraded":"2024-09-12T02:42:47.093908+0000","last_fullsized":"2024-09-12T02:42:47.093908+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:54.406789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.075943+0000","last_change":"2024-09-12T02:42:47.075554+0000","last_active":"2024-09-12T02:42:47.075943+0000","last_peered":"2024-09-12T02:42:47.075943+0000","last_clean":"2024-09-12T02:42:47.075943+0000","last_became_active":"2024-09-12T02:42:47.075289+0000","last_became_peered":"2024-09-12T02:42:47.075289+0000","last_unstale":"2024-09-12T02:42:47.075943+0000","last_undegraded":"2024-09-12T02:42:47.075943+0000","last_fullsized":"2024-09-12T02:42:47.075943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:34.248949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.095296+0000","last_change":"2024-09-12T02:42:46.058573+0000","last_active":"2024-09-12T02:42:47.095296+0000","last_peered":"2024-09-12T02:42:47.095296+0000","last_clean":"2024-09-12T02:42:47.095296+0000","last_became_active":"2024-09-12T02:42:46.057647+0000","last_became_peered":"2024-09-12T02:42:46.057647+0000","last_unstale":"2024-09-12T02:42:47.095296+0000","last_undegraded":"2024-09-12T02:42:47.095296+0000","last_fullsized":"2024-09-12T02:42:47.095296+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:43.003223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.080889+0000","last_change":"2024-09-12T02:42:47.080756+0000","last_active":"2024-09-12T02:42:47.080889+0000","last_peered":"2024-09-12T02:42:47.080889+0000","last_clean":"2024-09-12T02:42:47.080889+0000","last_became_active":"2024-09-12T02:42:47.080500+0000","last_became_peered":"2024-09-12T02:42:47.080500+0000","last_unstale":"2024-09-12T02:42:47.080889+0000","last_undegraded":"2024-09-12T02:42:47.080889+0000","last_fullsized":"2024-09-12T02:42:47.080889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:50.807391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.091670+0000","last_change":"2024-09-12T02:42:46.059700+0000","last_active":"2024-09-12T02:42:47.091670+0000","last_peered":"2024-09-12T02:42:47.091670+0000","last_clean":"2024-09-12T02:42:47.091670+0000","last_became_active":"2024-09-12T02:42:46.058195+0000","last_became_peered":"2024-09-12T02:42:46.058195+0000","last_unstale":"2024-09-12T02:42:47.091670+0000","last_undegraded":"2024-09-12T02:42:47.091670+0000","last_fullsized":"2024-09-12T02:42:47.091670+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:21.786669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.082155+0000","last_change":"2024-09-12T02:42:47.081995+0000","last_active":"2024-09-12T02:42:47.082155+0000","last_peered":"2024-09-12T02:42:47.082155+0000","last_clean":"2024-09-12T02:42:47.082155+0000","last_became_active":"2024-09-12T02:42:47.080357+0000","last_became_peered":"2024-09-12T02:42:47.080357+0000","last_unstale":"2024-09-12T02:42:47.082155+0000","last_undegraded":"2024-09-12T02:42:47.082155+0000","last_fullsized":"2024-09-12T02:42:47.082155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:03.733058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.091400+0000","last_change":"2024-09-12T02:42:46.063210+0000","last_active":"2024-09-12T02:42:47.091400+0000","last_peered":"2024-09-12T02:42:47.091400+0000","last_clean":"2024-09-12T02:42:47.091400+0000","last_became_active":"2024-09-12T02:42:46.062633+0000","last_became_peered":"2024-09-12T02:42:46.062633+0000","last_unstale":"2024-09-12T02:42:47.091400+0000","last_undegraded":"2024-09-12T02:42:47.091400+0000","last_fullsized":"2024-09-12T02:42:47.091400+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:17.388679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.085669+0000","last_change":"2024-09-12T02:42:47.084753+0000","last_active":"2024-09-12T02:42:47.085669+0000","last_peered":"2024-09-12T02:42:47.085669+0000","last_clean":"2024-09-12T02:42:47.085669+0000","last_became_active":"2024-09-12T02:42:47.084529+0000","last_became_peered":"2024-09-12T02:42:47.084529+0000","last_unstale":"2024-09-12T02:42:47.085669+0000","last_undegraded":"2024-09-12T02:42:47.085669+0000","last_fullsized":"2024-09-12T02:42:47.085669+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:01.011436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.069001+0000","last_change":"2024-09-12T02:42:46.057860+0000","last_active":"2024-09-12T02:42:47.069001+0000","last_peered":"2024-09-12T02:42:47.069001+0000","last_clean":"2024-09-12T02:42:47.069001+0000","last_became_active":"2024-09-12T02:42:46.057117+0000","last_became_peered":"2024-09-12T02:42:46.057117+0000","last_unstale":"2024-09-12T02:42:47.069001+0000","last_undegraded":"2024-09-12T02:42:47.069001+0000","last_fullsized":"2024-09-12T02:42:47.069001+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:27:34.238087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.088693+0000","last_change":"2024-09-12T02:42:47.087404+0000","last_active":"2024-09-12T02:42:47.088693+0000","last_peered":"2024-09-12T02:42:47.088693+0000","last_clean":"2024-09-12T02:42:47.088693+0000","last_became_active":"2024-09-12T02:42:47.086733+0000","last_became_peered":"2024-09-12T02:42:47.086733+0000","last_unstale":"2024-09-12T02:42:47.088693+0000","last_undegraded":"2024-09-12T02:42:47.088693+0000","last_fullsized":"2024-09-12T02:42:47.088693+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:14.187722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.094193+0000","last_change":"2024-09-12T02:42:46.058583+0000","last_active":"2024-09-12T02:42:47.094193+0000","last_peered":"2024-09-12T02:42:47.094193+0000","last_clean":"2024-09-12T02:42:47.094193+0000","last_became_active":"2024-09-12T02:42:46.056699+0000","last_became_peered":"2024-09-12T02:42:46.056699+0000","last_unstale":"2024-09-12T02:42:47.094193+0000","last_undegraded":"2024-09-12T02:42:47.094193+0000","last_fullsized":"2024-09-12T02:42:47.094193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:14.033359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.084153+0000","last_change":"2024-09-12T02:42:47.082205+0000","last_active":"2024-09-12T02:42:47.084153+0000","last_peered":"2024-09-12T02:42:47.084153+0000","last_clean":"2024-09-12T02:42:47.084153+0000","last_became_active":"2024-09-12T02:42:47.081315+0000","last_became_peered":"2024-09-12T02:42:47.081315+0000","last_unstale":"2024-09-12T02:42:47.084153+0000","last_undegraded":"2024-09-12T02:42:47.084153+0000","last_fullsized":"2024-09-12T02:42:47.084153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:52.074492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.067628+0000","last_change":"2024-09-12T02:42:46.056602+0000","last_active":"2024-09-12T02:42:47.067628+0000","last_peered":"2024-09-12T02:42:47.067628+0000","last_clean":"2024-09-12T02:42:47.067628+0000","last_became_active":"2024-09-12T02:42:46.055064+0000","last_became_peered":"2024-09-12T02:42:46.055064+0000","last_unstale":"2024-09-12T02:42:47.067628+0000","last_undegraded":"2024-09-12T02:42:47.067628+0000","last_fullsized":"2024-09-12T02:42:47.067628+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:47.903634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.090840+0000","last_change":"2024-09-12T02:42:47.089465+0000","last_active":"2024-09-12T02:42:47.090840+0000","last_peered":"2024-09-12T02:42:47.090840+0000","last_clean":"2024-09-12T02:42:47.090840+0000","last_became_active":"2024-09-12T02:42:47.089100+0000","last_became_peered":"2024-09-12T02:42:47.089100+0000","last_unstale":"2024-09-12T02:42:47.090840+0000","last_undegraded":"2024-09-12T02:42:47.090840+0000","last_fullsized":"2024-09-12T02:42:47.090840+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:42.038248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.067434+0000","last_change":"2024-09-12T02:42:46.061174+0000","last_active":"2024-09-12T02:42:47.067434+0000","last_peered":"2024-09-12T02:42:47.067434+0000","last_clean":"2024-09-12T02:42:47.067434+0000","last_became_active":"2024-09-12T02:42:46.058536+0000","last_became_peered":"2024-09-12T02:42:46.058536+0000","last_unstale":"2024-09-12T02:42:47.067434+0000","last_undegraded":"2024-09-12T02:42:47.067434+0000","last_fullsized":"2024-09-12T02:42:47.067434+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:08.719798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.082166+0000","last_change":"2024-09-12T02:42:47.081717+0000","last_active":"2024-09-12T02:42:47.082166+0000","last_peered":"2024-09-12T02:42:47.082166+0000","last_clean":"2024-09-12T02:42:47.082166+0000","last_became_active":"2024-09-12T02:42:47.081099+0000","last_became_peered":"2024-09-12T02:42:47.081099+0000","last_unstale":"2024-09-12T02:42:47.082166+0000","last_undegraded":"2024-09-12T02:42:47.082166+0000","last_fullsized":"2024-09-12T02:42:47.082166+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:49.660261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.069020+0000","last_change":"2024-09-12T02:42:46.061548+0000","last_active":"2024-09-12T02:42:47.069020+0000","last_peered":"2024-09-12T02:42:47.069020+0000","last_clean":"2024-09-12T02:42:47.069020+0000","last_became_active":"2024-09-12T02:42:46.061109+0000","last_became_peered":"2024-09-12T02:42:46.061109+0000","last_unstale":"2024-09-12T02:42:47.069020+0000","last_undegraded":"2024-09-12T02:42:47.069020+0000","last_fullsized":"2024-09-12T02:42:47.069020+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:57.979864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.084225+0000","last_change":"2024-09-12T02:42:47.082557+0000","last_active":"2024-09-12T02:42:47.084225+0000","last_peered":"2024-09-12T02:42:47.084225+0000","last_clean":"2024-09-12T02:42:47.084225+0000","last_became_active":"2024-09-12T02:42:47.081896+0000","last_became_peered":"2024-09-12T02:42:47.081896+0000","last_unstale":"2024-09-12T02:42:47.084225+0000","last_undegraded":"2024-09-12T02:42:47.084225+0000","last_fullsized":"2024-09-12T02:42:47.084225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:49.051086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.092957+0000","last_change":"2024-09-12T02:42:46.063112+0000","last_active":"2024-09-12T02:42:47.092957+0000","last_peered":"2024-09-12T02:42:47.092957+0000","last_clean":"2024-09-12T02:42:47.092957+0000","last_became_active":"2024-09-12T02:42:46.062112+0000","last_became_peered":"2024-09-12T02:42:46.062112+0000","last_unstale":"2024-09-12T02:42:47.092957+0000","last_undegraded":"2024-09-12T02:42:47.092957+0000","last_fullsized":"2024-09-12T02:42:47.092957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:10.764721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.083106+0000","last_change":"2024-09-12T02:42:47.082878+0000","last_active":"2024-09-12T02:42:47.083106+0000","last_peered":"2024-09-12T02:42:47.083106+0000","last_clean":"2024-09-12T02:42:47.083106+0000","last_became_active":"2024-09-12T02:42:47.082612+0000","last_became_peered":"2024-09-12T02:42:47.082612+0000","last_unstale":"2024-09-12T02:42:47.083106+0000","last_undegraded":"2024-09-12T02:42:47.083106+0000","last_fullsized":"2024-09-12T02:42:47.083106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:17.399178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.070508+0000","last_change":"2024-09-12T02:42:46.058902+0000","last_active":"2024-09-12T02:42:47.070508+0000","last_peered":"2024-09-12T02:42:47.070508+0000","last_clean":"2024-09-12T02:42:47.070508+0000","last_became_active":"2024-09-12T02:42:46.057163+0000","last_became_peered":"2024-09-12T02:42:46.057163+0000","last_unstale":"2024-09-12T02:42:47.070508+0000","last_undegraded":"2024-09-12T02:42:47.070508+0000","last_fullsized":"2024-09-12T02:42:47.070508+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:46.856504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.087934+0000","last_change":"2024-09-12T02:42:47.087806+0000","last_active":"2024-09-12T02:42:47.087934+0000","last_peered":"2024-09-12T02:42:47.087934+0000","last_clean":"2024-09-12T02:42:47.087934+0000","last_became_active":"2024-09-12T02:42:47.087574+0000","last_became_peered":"2024-09-12T02:42:47.087574+0000","last_unstale":"2024-09-12T02:42:47.087934+0000","last_undegraded":"2024-09-12T02:42:47.087934+0000","last_fullsized":"2024-09-12T02:42:47.087934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:20.689228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.075801+0000","last_change":"2024-09-12T02:42:46.062300+0000","last_active":"2024-09-12T02:42:47.075801+0000","last_peered":"2024-09-12T02:42:47.075801+0000","last_clean":"2024-09-12T02:42:47.075801+0000","last_became_active":"2024-09-12T02:42:46.061902+0000","last_became_peered":"2024-09-12T02:42:46.061902+0000","last_unstale":"2024-09-12T02:42:47.075801+0000","last_undegraded":"2024-09-12T02:42:47.075801+0000","last_fullsized":"2024-09-12T02:42:47.075801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:28.980786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.074507+0000","last_change":"2024-09-12T02:42:47.074332+0000","last_active":"2024-09-12T02:42:47.074507+0000","last_peered":"2024-09-12T02:42:47.074507+0000","last_clean":"2024-09-12T02:42:47.074507+0000","last_became_active":"2024-09-12T02:42:47.074017+0000","last_became_peered":"2024-09-12T02:42:47.074017+0000","last_unstale":"2024-09-12T02:42:47.074507+0000","last_undegraded":"2024-09-12T02:42:47.074507+0000","last_fullsized":"2024-09-12T02:42:47.074507+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:38.204166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.070483+0000","last_change":"2024-09-12T02:42:46.063655+0000","last_active":"2024-09-12T02:42:47.070483+0000","last_peered":"2024-09-12T02:42:47.070483+0000","last_clean":"2024-09-12T02:42:47.070483+0000","last_became_active":"2024-09-12T02:42:46.063419+0000","last_became_peered":"2024-09-12T02:42:46.063419+0000","last_unstale":"2024-09-12T02:42:47.070483+0000","last_undegraded":"2024-09-12T02:42:47.070483+0000","last_fullsized":"2024-09-12T02:42:47.070483+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:22.827569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.077812+0000","last_change":"2024-09-12T02:42:47.077598+0000","last_active":"2024-09-12T02:42:47.077812+0000","last_peered":"2024-09-12T02:42:47.077812+0000","last_clean":"2024-09-12T02:42:47.077812+0000","last_became_active":"2024-09-12T02:42:47.077350+0000","last_became_peered":"2024-09-12T02:42:47.077350+0000","last_unstale":"2024-09-12T02:42:47.077812+0000","last_undegraded":"2024-09-12T02:42:47.077812+0000","last_fullsized":"2024-09-12T02:42:47.077812+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:47.318379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.074915+0000","last_change":"2024-09-12T02:42:46.063288+0000","last_active":"2024-09-12T02:42:47.074915+0000","last_peered":"2024-09-12T02:42:47.074915+0000","last_clean":"2024-09-12T02:42:47.074915+0000","last_became_active":"2024-09-12T02:42:46.062738+0000","last_became_peered":"2024-09-12T02:42:46.062738+0000","last_unstale":"2024-09-12T02:42:47.074915+0000","last_undegraded":"2024-09-12T02:42:47.074915+0000","last_fullsized":"2024-09-12T02:42:47.074915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:07.356827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.089394+0000","last_change":"2024-09-12T02:42:47.089140+0000","last_active":"2024-09-12T02:42:47.089394+0000","last_peered":"2024-09-12T02:42:47.089394+0000","last_clean":"2024-09-12T02:42:47.089394+0000","last_became_active":"2024-09-12T02:42:47.088905+0000","last_became_peered":"2024-09-12T02:42:47.088905+0000","last_unstale":"2024-09-12T02:42:47.089394+0000","last_undegraded":"2024-09-12T02:42:47.089394+0000","last_fullsized":"2024-09-12T02:42:47.089394+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:50.957435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.066719+0000","last_change":"2024-09-12T02:42:46.059554+0000","last_active":"2024-09-12T02:42:47.066719+0000","last_peered":"2024-09-12T02:42:47.066719+0000","last_clean":"2024-09-12T02:42:47.066719+0000","last_became_active":"2024-09-12T02:42:46.059220+0000","last_became_peered":"2024-09-12T02:42:46.059220+0000","last_unstale":"2024-09-12T02:42:47.066719+0000","last_undegraded":"2024-09-12T02:42:47.066719+0000","last_fullsized":"2024-09-12T02:42:47.066719+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:30.681635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.078000+0000","last_change":"2024-09-12T02:42:47.077273+0000","last_active":"2024-09-12T02:42:47.078000+0000","last_peered":"2024-09-12T02:42:47.078000+0000","last_clean":"2024-09-12T02:42:47.078000+0000","last_became_active":"2024-09-12T02:42:47.073716+0000","last_became_peered":"2024-09-12T02:42:47.073716+0000","last_unstale":"2024-09-12T02:42:47.078000+0000","last_undegraded":"2024-09-12T02:42:47.078000+0000","last_fullsized":"2024-09-12T02:42:47.078000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:59.463828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.069872+0000","last_change":"2024-09-12T02:42:46.058132+0000","last_active":"2024-09-12T02:42:47.069872+0000","last_peered":"2024-09-12T02:42:47.069872+0000","last_clean":"2024-09-12T02:42:47.069872+0000","last_became_active":"2024-09-12T02:42:46.057899+0000","last_became_peered":"2024-09-12T02:42:46.057899+0000","last_unstale":"2024-09-12T02:42:47.069872+0000","last_undegraded":"2024-09-12T02:42:47.069872+0000","last_fullsized":"2024-09-12T02:42:47.069872+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:50.880449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.089053+0000","last_change":"2024-09-12T02:42:47.088894+0000","last_active":"2024-09-12T02:42:47.089053+0000","last_peered":"2024-09-12T02:42:47.089053+0000","last_clean":"2024-09-12T02:42:47.089053+0000","last_became_active":"2024-09-12T02:42:47.088657+0000","last_became_peered":"2024-09-12T02:42:47.088657+0000","last_unstale":"2024-09-12T02:42:47.089053+0000","last_undegraded":"2024-09-12T02:42:47.089053+0000","last_fullsized":"2024-09-12T02:42:47.089053+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:20.649533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.069031+0000","last_change":"2024-09-12T02:42:46.056851+0000","last_active":"2024-09-12T02:42:47.069031+0000","last_peered":"2024-09-12T02:42:47.069031+0000","last_clean":"2024-09-12T02:42:47.069031+0000","last_became_active":"2024-09-12T02:42:46.056281+0000","last_became_peered":"2024-09-12T02:42:46.056281+0000","last_unstale":"2024-09-12T02:42:47.069031+0000","last_undegraded":"2024-09-12T02:42:47.069031+0000","last_fullsized":"2024-09-12T02:42:47.069031+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:35.309875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":190,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.073892+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:42:47.073892+0000","last_peered":"2024-09-12T02:42:47.073892+0000","last_clean":"2024-09-12T02:42:47.073892+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:42:47.073892+0000","last_undegraded":"2024-09-12T02:42:47.073892+0000","last_fullsized":"2024-09-12T02:42:47.073892+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:45.426902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":706,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194606,"statfs":{"total":200000000,"available":199276561,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":130,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195182,"statfs":{"total":200000000,"available":199866403,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":130,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195181,"statfs":{"total":200000000,"available":199866347,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":9,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":129,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195182,"statfs":{"total":200000000,"available":199866915,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":131,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195181,"statfs":{"total":200000000,"available":199865385,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":129,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195182,"statfs":{"total":200000000,"available":199866949,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":131,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195181,"statfs":{"total":200000000,"available":199865385,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":706,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194606,"statfs":{"total":200000000,"available":199276651,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:42:51.306 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:42:51.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.494+0000 7f5508e00640 1 Processor -- start 2024-09-12T02:42:51.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.494+0000 7f5508e00640 1 -- start start 2024-09-12T02:42:51.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.495+0000 7f5508e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f55040b0770 0x7f55040708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:51.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.495+0000 7f5508e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55040b4ce0 0x7f55040b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:51.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.495+0000 7f5508e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55040b0c70 con 0x7f550415c800 2024-09-12T02:42:51.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.495+0000 7f5508e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f55040b0f50 con 0x7f55040b0770 2024-09-12T02:42:51.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.495+0000 7f5508e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f55040b1230 con 0x7f55040b4ce0 2024-09-12T02:42:51.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.495+0000 7f5503400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f550415c800 0x7f550415f7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36432/0 (socket says 172.21.15.112:36432) 2024-09-12T02:42:51.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.495+0000 7f5503400640 1 -- 172.21.15.112:0/2144652174 learned_addr learned my addr 172.21.15.112:0/2144652174 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:51.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.495+0000 7f54faa00640 1 --2- 172.21.15.112:0/2144652174 >> v2:172.21.15.112:3300/0 conn(0x7f55040b0770 0x7f55040708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:51.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.496+0000 7f5503e00640 1 --2- 172.21.15.112:0/2144652174 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55040b4ce0 0x7f55040b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:51.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.496+0000 7f54faa00640 1 -- 172.21.15.112:0/2144652174 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55040b4ce0 msgr2=0x7f55040b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:51.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.496+0000 7f54faa00640 1 --2- 172.21.15.112:0/2144652174 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55040b4ce0 0x7f55040b50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.496+0000 7f54faa00640 1 -- 172.21.15.112:0/2144652174 >> v1:172.21.15.112:6789/0 conn(0x7f550415c800 legacy=0x7f550415f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:51.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.496+0000 7f5502a00640 1 -- 172.21.15.112:0/2144652174 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2649241218 0 0) 0x7f55040b0c70 con 0x7f550415c800 2024-09-12T02:42:51.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.496+0000 7f54faa00640 1 -- 172.21.15.112:0/2144652174 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f550415f2a0 con 0x7f55040b0770 2024-09-12T02:42:51.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.497+0000 7f54faa00640 1 --2- 172.21.15.112:0/2144652174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55040b0770 0x7f55040708c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f54ec0097a0 tx=0x7f54ec02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ea0afeb947a05e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:51.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.497+0000 7f5502a00640 1 -- 172.21.15.112:0/2144652174 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ec037070 con 0x7f55040b0770 2024-09-12T02:42:51.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.497+0000 7f5502a00640 1 -- 172.21.15.112:0/2144652174 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54ec032440 con 0x7f55040b0770 2024-09-12T02:42:51.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.497+0000 7f5502a00640 1 -- 172.21.15.112:0/2144652174 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ec032810 con 0x7f55040b0770 2024-09-12T02:42:51.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.498+0000 7f5508e00640 1 -- 172.21.15.112:0/2144652174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55040b0770 msgr2=0x7f55040708c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:51.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.498+0000 7f5508e00640 1 --2- 172.21.15.112:0/2144652174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55040b0770 0x7f55040708c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f54ec0097a0 tx=0x7f54ec02a180 comp rx=0 tx=0).stop 2024-09-12T02:42:51.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.498+0000 7f5508e00640 1 -- 172.21.15.112:0/2144652174 shutdown_connections 2024-09-12T02:42:51.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.498+0000 7f5508e00640 1 --2- 172.21.15.112:0/2144652174 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55040b4ce0 0x7f55040b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.498+0000 7f5508e00640 1 --2- 172.21.15.112:0/2144652174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55040b0770 0x7f55040708c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.498+0000 7f5508e00640 1 -- 172.21.15.112:0/2144652174 >> 172.21.15.112:0/2144652174 conn(0x7f550406cce0 msgr2=0x7f550406d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:51.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.498+0000 7f5508e00640 1 -- 172.21.15.112:0/2144652174 shutdown_connections 2024-09-12T02:42:51.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.498+0000 7f5508e00640 1 -- 172.21.15.112:0/2144652174 wait complete. 2024-09-12T02:42:51.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.499+0000 7f5508e00640 1 Processor -- start 2024-09-12T02:42:51.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.499+0000 7f5508e00640 1 -- start start 2024-09-12T02:42:51.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.500+0000 7f5508e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55040b0770 0x7f550414a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:51.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.500+0000 7f5508e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55040b4ce0 0x7f5504156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:51.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.500+0000 7f5508e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f550415c800 0x7f550415dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:51.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.500+0000 7f5508e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f550406f360 con 0x7f55040b4ce0 2024-09-12T02:42:51.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.500+0000 7f5508e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f550406f1e0 con 0x7f550415c800 2024-09-12T02:42:51.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.500+0000 7f5508e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f550406bbd0 con 0x7f55040b0770 2024-09-12T02:42:51.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.501+0000 7f54faa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55040b4ce0 0x7f5504156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:51.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.501+0000 7f54faa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55040b4ce0 0x7f5504156950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50116/0 (socket says 172.21.15.112:50116) 2024-09-12T02:42:51.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.501+0000 7f54faa00640 1 -- 172.21.15.112:0/902668605 learned_addr learned my addr 172.21.15.112:0/902668605 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:51.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.501+0000 7f5503400640 1 --2- 172.21.15.112:0/902668605 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55040b0770 0x7f550414a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:51.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.501+0000 7f5503e00640 1 --2- 172.21.15.112:0/902668605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f550415c800 0x7f550415dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:51.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.501+0000 7f54faa00640 1 -- 172.21.15.112:0/902668605 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55040b0770 msgr2=0x7f550414a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:51.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.501+0000 7f54faa00640 1 --2- 172.21.15.112:0/902668605 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55040b0770 0x7f550414a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.501+0000 7f54faa00640 1 -- 172.21.15.112:0/902668605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f550415c800 msgr2=0x7f550415dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:51.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.501+0000 7f54faa00640 1 --2- 172.21.15.112:0/902668605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f550415c800 0x7f550415dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.501+0000 7f54faa00640 1 -- 172.21.15.112:0/902668605 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5504153ab0 con 0x7f55040b4ce0 2024-09-12T02:42:51.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.501+0000 7f5503e00640 1 --2- 172.21.15.112:0/902668605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f550415c800 0x7f550415dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:51.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.501+0000 7f54faa00640 1 --2- 172.21.15.112:0/902668605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55040b4ce0 0x7f5504156950 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f54ec035040 tx=0x7f54ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:51.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.501+0000 7f54fbe00640 1 -- 172.21.15.112:0/902668605 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ec037040 con 0x7f55040b4ce0 2024-09-12T02:42:51.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.502+0000 7f54fbe00640 1 -- 172.21.15.112:0/902668605 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54ec030770 con 0x7f55040b4ce0 2024-09-12T02:42:51.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.502+0000 7f5508e00640 1 -- 172.21.15.112:0/902668605 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5504153d00 con 0x7f55040b4ce0 2024-09-12T02:42:51.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.502+0000 7f54fbe00640 1 -- 172.21.15.112:0/902668605 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ec030b80 con 0x7f55040b4ce0 2024-09-12T02:42:51.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.502+0000 7f5508e00640 1 -- 172.21.15.112:0/902668605 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55041542a0 con 0x7f55040b4ce0 2024-09-12T02:42:51.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.503+0000 7f5508e00640 1 -- 172.21.15.112:0/902668605 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55040708c0 con 0x7f55040b4ce0 2024-09-12T02:42:51.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.504+0000 7f54fbe00640 1 -- 172.21.15.112:0/902668605 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f54ec044020 con 0x7f55040b4ce0 2024-09-12T02:42:51.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.504+0000 7f54fbe00640 1 --2- 172.21.15.112:0/902668605 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f54e006be60 0x7f54e006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:51.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.505+0000 7f54fbe00640 1 -- 172.21.15.112:0/902668605 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f54ec0ab2e0 con 0x7f55040b4ce0 2024-09-12T02:42:51.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.505+0000 7f5503400640 1 --2- 172.21.15.112:0/902668605 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f54e006be60 0x7f54e006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:51.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.505+0000 7f5503400640 1 --2- 172.21.15.112:0/902668605 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f54e006be60 0x7f54e006e320 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f54f4007fd0 tx=0x7f54f4007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:51.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.509+0000 7f54fbe00640 1 -- 172.21.15.112:0/902668605 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f54ec032e20 con 0x7f55040b4ce0 2024-09-12T02:42:51.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.682+0000 7f5508e00640 1 -- 172.21.15.112:0/902668605 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5504159cc0 con 0x7f54e006be60 2024-09-12T02:42:51.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.688+0000 7f54fbe00640 1 -- 172.21.15.112:0/902668605 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247423 (secure 0 0 0) 0x7f5504159cc0 con 0x7f54e006be60 2024-09-12T02:42:51.692 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:42:51.693 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:42:51.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.692+0000 7f5508e00640 1 -- 172.21.15.112:0/902668605 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f54e006be60 msgr2=0x7f54e006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:51.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.692+0000 7f5508e00640 1 --2- 172.21.15.112:0/902668605 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f54e006be60 0x7f54e006e320 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f54f4007fd0 tx=0x7f54f4007de0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.692+0000 7f5508e00640 1 -- 172.21.15.112:0/902668605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55040b4ce0 msgr2=0x7f5504156950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:51.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.692+0000 7f5508e00640 1 --2- 172.21.15.112:0/902668605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55040b4ce0 0x7f5504156950 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f54ec035040 tx=0x7f54ec0046c0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.692+0000 7f5508e00640 1 -- 172.21.15.112:0/902668605 shutdown_connections 2024-09-12T02:42:51.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.692+0000 7f5508e00640 1 --2- 172.21.15.112:0/902668605 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f54e006be60 0x7f54e006e320 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.692+0000 7f5508e00640 1 --2- 172.21.15.112:0/902668605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f550415c800 0x7f550415dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.692+0000 7f5508e00640 1 --2- 172.21.15.112:0/902668605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55040b4ce0 0x7f5504156950 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.692+0000 7f5508e00640 1 --2- 172.21.15.112:0/902668605 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55040b0770 0x7f550414a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.692+0000 7f5508e00640 1 -- 172.21.15.112:0/902668605 >> 172.21.15.112:0/902668605 conn(0x7f550406cce0 msgr2=0x7f55040af4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:51.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.692+0000 7f5508e00640 1 -- 172.21.15.112:0/902668605 shutdown_connections 2024-09-12T02:42:51.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.692+0000 7f5508e00640 1 -- 172.21.15.112:0/902668605 wait complete. 2024-09-12T02:42:51.709 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-09-12T02:42:50.973145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":105,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560303,"statfs":{"total":1600000000,"available":1597750596,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.928750"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.073065+0000","last_change":"2024-09-12T02:42:47.072440+0000","last_active":"2024-09-12T02:42:47.073065+0000","last_peered":"2024-09-12T02:42:47.073065+0000","last_clean":"2024-09-12T02:42:47.073065+0000","last_became_active":"2024-09-12T02:42:47.072197+0000","last_became_peered":"2024-09-12T02:42:47.072197+0000","last_unstale":"2024-09-12T02:42:47.073065+0000","last_undegraded":"2024-09-12T02:42:47.073065+0000","last_fullsized":"2024-09-12T02:42:47.073065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:52.974637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.073738+0000","last_change":"2024-09-12T02:42:47.073619+0000","last_active":"2024-09-12T02:42:47.073738+0000","last_peered":"2024-09-12T02:42:47.073738+0000","last_clean":"2024-09-12T02:42:47.073738+0000","last_became_active":"2024-09-12T02:42:47.073278+0000","last_became_peered":"2024-09-12T02:42:47.073278+0000","last_unstale":"2024-09-12T02:42:47.073738+0000","last_undegraded":"2024-09-12T02:42:47.073738+0000","last_fullsized":"2024-09-12T02:42:47.073738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:13.655575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.079567+0000","last_change":"2024-09-12T02:42:47.078909+0000","last_active":"2024-09-12T02:42:47.079567+0000","last_peered":"2024-09-12T02:42:47.079567+0000","last_clean":"2024-09-12T02:42:47.079567+0000","last_became_active":"2024-09-12T02:42:47.078502+0000","last_became_peered":"2024-09-12T02:42:47.078502+0000","last_unstale":"2024-09-12T02:42:47.079567+0000","last_undegraded":"2024-09-12T02:42:47.079567+0000","last_fullsized":"2024-09-12T02:42:47.079567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:55.291881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.094526+0000","last_change":"2024-09-12T02:42:47.094404+0000","last_active":"2024-09-12T02:42:47.094526+0000","last_peered":"2024-09-12T02:42:47.094526+0000","last_clean":"2024-09-12T02:42:47.094526+0000","last_became_active":"2024-09-12T02:42:47.093499+0000","last_became_peered":"2024-09-12T02:42:47.093499+0000","last_unstale":"2024-09-12T02:42:47.094526+0000","last_undegraded":"2024-09-12T02:42:47.094526+0000","last_fullsized":"2024-09-12T02:42:47.094526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:52.109896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.088906+0000","last_change":"2024-09-12T02:42:47.088800+0000","last_active":"2024-09-12T02:42:47.088906+0000","last_peered":"2024-09-12T02:42:47.088906+0000","last_clean":"2024-09-12T02:42:47.088906+0000","last_became_active":"2024-09-12T02:42:47.088388+0000","last_became_peered":"2024-09-12T02:42:47.088388+0000","last_unstale":"2024-09-12T02:42:47.088906+0000","last_undegraded":"2024-09-12T02:42:47.088906+0000","last_fullsized":"2024-09-12T02:42:47.088906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:18:47.791518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.076779+0000","last_change":"2024-09-12T02:42:47.076643+0000","last_active":"2024-09-12T02:42:47.076779+0000","last_peered":"2024-09-12T02:42:47.076779+0000","last_clean":"2024-09-12T02:42:47.076779+0000","last_became_active":"2024-09-12T02:42:47.072725+0000","last_became_peered":"2024-09-12T02:42:47.072725+0000","last_unstale":"2024-09-12T02:42:47.076779+0000","last_undegraded":"2024-09-12T02:42:47.076779+0000","last_fullsized":"2024-09-12T02:42:47.076779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:05.782231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.078615+0000","last_change":"2024-09-12T02:42:47.076807+0000","last_active":"2024-09-12T02:42:47.078615+0000","last_peered":"2024-09-12T02:42:47.078615+0000","last_clean":"2024-09-12T02:42:47.078615+0000","last_became_active":"2024-09-12T02:42:47.076326+0000","last_became_peered":"2024-09-12T02:42:47.076326+0000","last_unstale":"2024-09-12T02:42:47.078615+0000","last_undegraded":"2024-09-12T02:42:47.078615+0000","last_fullsized":"2024-09-12T02:42:47.078615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:00.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.084206+0000","last_change":"2024-09-12T02:42:47.084119+0000","last_active":"2024-09-12T02:42:47.084206+0000","last_peered":"2024-09-12T02:42:47.084206+0000","last_clean":"2024-09-12T02:42:47.084206+0000","last_became_active":"2024-09-12T02:42:47.083918+0000","last_became_peered":"2024-09-12T02:42:47.083918+0000","last_unstale":"2024-09-12T02:42:47.084206+0000","last_undegraded":"2024-09-12T02:42:47.084206+0000","last_fullsized":"2024-09-12T02:42:47.084206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:03.888894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.087128+0000","last_change":"2024-09-12T02:42:47.087001+0000","last_active":"2024-09-12T02:42:47.087128+0000","last_peered":"2024-09-12T02:42:47.087128+0000","last_clean":"2024-09-12T02:42:47.087128+0000","last_became_active":"2024-09-12T02:42:47.086672+0000","last_became_peered":"2024-09-12T02:42:47.086672+0000","last_unstale":"2024-09-12T02:42:47.087128+0000","last_undegraded":"2024-09-12T02:42:47.087128+0000","last_fullsized":"2024-09-12T02:42:47.087128+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:46.222692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.081119+0000","last_change":"2024-09-12T02:42:47.080723+0000","last_active":"2024-09-12T02:42:47.081119+0000","last_peered":"2024-09-12T02:42:47.081119+0000","last_clean":"2024-09-12T02:42:47.081119+0000","last_became_active":"2024-09-12T02:42:47.080494+0000","last_became_peered":"2024-09-12T02:42:47.080494+0000","last_unstale":"2024-09-12T02:42:47.081119+0000","last_undegraded":"2024-09-12T02:42:47.081119+0000","last_fullsized":"2024-09-12T02:42:47.081119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:37.498849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.082185+0000","last_change":"2024-09-12T02:42:47.081501+0000","last_active":"2024-09-12T02:42:47.082185+0000","last_peered":"2024-09-12T02:42:47.082185+0000","last_clean":"2024-09-12T02:42:47.082185+0000","last_became_active":"2024-09-12T02:42:47.081248+0000","last_became_peered":"2024-09-12T02:42:47.081248+0000","last_unstale":"2024-09-12T02:42:47.082185+0000","last_undegraded":"2024-09-12T02:42:47.082185+0000","last_fullsized":"2024-09-12T02:42:47.082185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:42.530345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.075818+0000","last_change":"2024-09-12T02:42:47.075441+0000","last_active":"2024-09-12T02:42:47.075818+0000","last_peered":"2024-09-12T02:42:47.075818+0000","last_clean":"2024-09-12T02:42:47.075818+0000","last_became_active":"2024-09-12T02:42:47.074436+0000","last_became_peered":"2024-09-12T02:42:47.074436+0000","last_unstale":"2024-09-12T02:42:47.075818+0000","last_undegraded":"2024-09-12T02:42:47.075818+0000","last_fullsized":"2024-09-12T02:42:47.075818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:36.763915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.084174+0000","last_change":"2024-09-12T02:42:47.082388+0000","last_active":"2024-09-12T02:42:47.084174+0000","last_peered":"2024-09-12T02:42:47.084174+0000","last_clean":"2024-09-12T02:42:47.084174+0000","last_became_active":"2024-09-12T02:42:47.081603+0000","last_became_peered":"2024-09-12T02:42:47.081603+0000","last_unstale":"2024-09-12T02:42:47.084174+0000","last_undegraded":"2024-09-12T02:42:47.084174+0000","last_fullsized":"2024-09-12T02:42:47.084174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:09.320093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.087259+0000","last_change":"2024-09-12T02:42:47.087059+0000","last_active":"2024-09-12T02:42:47.087259+0000","last_peered":"2024-09-12T02:42:47.087259+0000","last_clean":"2024-09-12T02:42:47.087259+0000","last_became_active":"2024-09-12T02:42:47.086456+0000","last_became_peered":"2024-09-12T02:42:47.086456+0000","last_unstale":"2024-09-12T02:42:47.087259+0000","last_undegraded":"2024-09-12T02:42:47.087259+0000","last_fullsized":"2024-09-12T02:42:47.087259+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:28.620764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.071612+0000","last_change":"2024-09-12T02:42:47.071485+0000","last_active":"2024-09-12T02:42:47.071612+0000","last_peered":"2024-09-12T02:42:47.071612+0000","last_clean":"2024-09-12T02:42:47.071612+0000","last_became_active":"2024-09-12T02:42:47.071237+0000","last_became_peered":"2024-09-12T02:42:47.071237+0000","last_unstale":"2024-09-12T02:42:47.071612+0000","last_undegraded":"2024-09-12T02:42:47.071612+0000","last_fullsized":"2024-09-12T02:42:47.071612+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:00.153604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.085906+0000","last_change":"2024-09-12T02:42:47.085383+0000","last_active":"2024-09-12T02:42:47.085906+0000","last_peered":"2024-09-12T02:42:47.085906+0000","last_clean":"2024-09-12T02:42:47.085906+0000","last_became_active":"2024-09-12T02:42:47.084814+0000","last_became_peered":"2024-09-12T02:42:47.084814+0000","last_unstale":"2024-09-12T02:42:47.085906+0000","last_undegraded":"2024-09-12T02:42:47.085906+0000","last_fullsized":"2024-09-12T02:42:47.085906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:40.340748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.078591+0000","last_change":"2024-09-12T02:42:47.076608+0000","last_active":"2024-09-12T02:42:47.078591+0000","last_peered":"2024-09-12T02:42:47.078591+0000","last_clean":"2024-09-12T02:42:47.078591+0000","last_became_active":"2024-09-12T02:42:47.075966+0000","last_became_peered":"2024-09-12T02:42:47.075966+0000","last_unstale":"2024-09-12T02:42:47.078591+0000","last_undegraded":"2024-09-12T02:42:47.078591+0000","last_fullsized":"2024-09-12T02:42:47.078591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:02.490084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.078672+0000","last_change":"2024-09-12T02:42:47.078470+0000","last_active":"2024-09-12T02:42:47.078672+0000","last_peered":"2024-09-12T02:42:47.078672+0000","last_clean":"2024-09-12T02:42:47.078672+0000","last_became_active":"2024-09-12T02:42:47.078144+0000","last_became_peered":"2024-09-12T02:42:47.078144+0000","last_unstale":"2024-09-12T02:42:47.078672+0000","last_undegraded":"2024-09-12T02:42:47.078672+0000","last_fullsized":"2024-09-12T02:42:47.078672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:26.033254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.091553+0000","last_change":"2024-09-12T02:42:47.090464+0000","last_active":"2024-09-12T02:42:47.091553+0000","last_peered":"2024-09-12T02:42:47.091553+0000","last_clean":"2024-09-12T02:42:47.091553+0000","last_became_active":"2024-09-12T02:42:47.090205+0000","last_became_peered":"2024-09-12T02:42:47.090205+0000","last_unstale":"2024-09-12T02:42:47.091553+0000","last_undegraded":"2024-09-12T02:42:47.091553+0000","last_fullsized":"2024-09-12T02:42:47.091553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:17.987330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.088887+0000","last_change":"2024-09-12T02:42:47.088607+0000","last_active":"2024-09-12T02:42:47.088887+0000","last_peered":"2024-09-12T02:42:47.088887+0000","last_clean":"2024-09-12T02:42:47.088887+0000","last_became_active":"2024-09-12T02:42:47.086063+0000","last_became_peered":"2024-09-12T02:42:47.086063+0000","last_unstale":"2024-09-12T02:42:47.088887+0000","last_undegraded":"2024-09-12T02:42:47.088887+0000","last_fullsized":"2024-09-12T02:42:47.088887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:33.145600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.075182+0000","last_change":"2024-09-12T02:42:47.075035+0000","last_active":"2024-09-12T02:42:47.075182+0000","last_peered":"2024-09-12T02:42:47.075182+0000","last_clean":"2024-09-12T02:42:47.075182+0000","last_became_active":"2024-09-12T02:42:47.074738+0000","last_became_peered":"2024-09-12T02:42:47.074738+0000","last_unstale":"2024-09-12T02:42:47.075182+0000","last_undegraded":"2024-09-12T02:42:47.075182+0000","last_fullsized":"2024-09-12T02:42:47.075182+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:39.397700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.074056+0000","last_change":"2024-09-12T02:42:47.072868+0000","last_active":"2024-09-12T02:42:47.074056+0000","last_peered":"2024-09-12T02:42:47.074056+0000","last_clean":"2024-09-12T02:42:47.074056+0000","last_became_active":"2024-09-12T02:42:47.072607+0000","last_became_peered":"2024-09-12T02:42:47.072607+0000","last_unstale":"2024-09-12T02:42:47.074056+0000","last_undegraded":"2024-09-12T02:42:47.074056+0000","last_fullsized":"2024-09-12T02:42:47.074056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:59.956150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.075894+0000","last_change":"2024-09-12T02:42:47.075363+0000","last_active":"2024-09-12T02:42:47.075894+0000","last_peered":"2024-09-12T02:42:47.075894+0000","last_clean":"2024-09-12T02:42:47.075894+0000","last_became_active":"2024-09-12T02:42:47.075065+0000","last_became_peered":"2024-09-12T02:42:47.075065+0000","last_unstale":"2024-09-12T02:42:47.075894+0000","last_undegraded":"2024-09-12T02:42:47.075894+0000","last_fullsized":"2024-09-12T02:42:47.075894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:27.190073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.086277+0000","last_change":"2024-09-12T02:42:47.085350+0000","last_active":"2024-09-12T02:42:47.086277+0000","last_peered":"2024-09-12T02:42:47.086277+0000","last_clean":"2024-09-12T02:42:47.086277+0000","last_became_active":"2024-09-12T02:42:47.085129+0000","last_became_peered":"2024-09-12T02:42:47.085129+0000","last_unstale":"2024-09-12T02:42:47.086277+0000","last_undegraded":"2024-09-12T02:42:47.086277+0000","last_fullsized":"2024-09-12T02:42:47.086277+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:52.888734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.084561+0000","last_change":"2024-09-12T02:42:47.083771+0000","last_active":"2024-09-12T02:42:47.084561+0000","last_peered":"2024-09-12T02:42:47.084561+0000","last_clean":"2024-09-12T02:42:47.084561+0000","last_became_active":"2024-09-12T02:42:47.083531+0000","last_became_peered":"2024-09-12T02:42:47.083531+0000","last_unstale":"2024-09-12T02:42:47.084561+0000","last_undegraded":"2024-09-12T02:42:47.084561+0000","last_fullsized":"2024-09-12T02:42:47.084561+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:30.777823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.083244+0000","last_change":"2024-09-12T02:42:47.082301+0000","last_active":"2024-09-12T02:42:47.083244+0000","last_peered":"2024-09-12T02:42:47.083244+0000","last_clean":"2024-09-12T02:42:47.083244+0000","last_became_active":"2024-09-12T02:42:47.081733+0000","last_became_peered":"2024-09-12T02:42:47.081733+0000","last_unstale":"2024-09-12T02:42:47.083244+0000","last_undegraded":"2024-09-12T02:42:47.083244+0000","last_fullsized":"2024-09-12T02:42:47.083244+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:06.453475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.082305+0000","last_change":"2024-09-12T02:42:47.082207+0000","last_active":"2024-09-12T02:42:47.082305+0000","last_peered":"2024-09-12T02:42:47.082305+0000","last_clean":"2024-09-12T02:42:47.082305+0000","last_became_active":"2024-09-12T02:42:47.080694+0000","last_became_peered":"2024-09-12T02:42:47.080694+0000","last_unstale":"2024-09-12T02:42:47.082305+0000","last_undegraded":"2024-09-12T02:42:47.082305+0000","last_fullsized":"2024-09-12T02:42:47.082305+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:12.437256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.077017+0000","last_change":"2024-09-12T02:42:47.076827+0000","last_active":"2024-09-12T02:42:47.077017+0000","last_peered":"2024-09-12T02:42:47.077017+0000","last_clean":"2024-09-12T02:42:47.077017+0000","last_became_active":"2024-09-12T02:42:47.074998+0000","last_became_peered":"2024-09-12T02:42:47.074998+0000","last_unstale":"2024-09-12T02:42:47.077017+0000","last_undegraded":"2024-09-12T02:42:47.077017+0000","last_fullsized":"2024-09-12T02:42:47.077017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:19.537991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.077966+0000","last_change":"2024-09-12T02:42:47.076391+0000","last_active":"2024-09-12T02:42:47.077966+0000","last_peered":"2024-09-12T02:42:47.077966+0000","last_clean":"2024-09-12T02:42:47.077966+0000","last_became_active":"2024-09-12T02:42:47.075251+0000","last_became_peered":"2024-09-12T02:42:47.075251+0000","last_unstale":"2024-09-12T02:42:47.077966+0000","last_undegraded":"2024-09-12T02:42:47.077966+0000","last_fullsized":"2024-09-12T02:42:47.077966+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:09.628562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.082128+0000","last_change":"2024-09-12T02:42:47.081492+0000","last_active":"2024-09-12T02:42:47.082128+0000","last_peered":"2024-09-12T02:42:47.082128+0000","last_clean":"2024-09-12T02:42:47.082128+0000","last_became_active":"2024-09-12T02:42:47.080768+0000","last_became_peered":"2024-09-12T02:42:47.080768+0000","last_unstale":"2024-09-12T02:42:47.082128+0000","last_undegraded":"2024-09-12T02:42:47.082128+0000","last_fullsized":"2024-09-12T02:42:47.082128+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:23.391410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.086642+0000","last_change":"2024-09-12T02:42:47.085753+0000","last_active":"2024-09-12T02:42:47.086642+0000","last_peered":"2024-09-12T02:42:47.086642+0000","last_clean":"2024-09-12T02:42:47.086642+0000","last_became_active":"2024-09-12T02:42:47.085462+0000","last_became_peered":"2024-09-12T02:42:47.085462+0000","last_unstale":"2024-09-12T02:42:47.086642+0000","last_undegraded":"2024-09-12T02:42:47.086642+0000","last_fullsized":"2024-09-12T02:42:47.086642+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:49.430756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.082149+0000","last_change":"2024-09-12T02:42:47.081703+0000","last_active":"2024-09-12T02:42:47.082149+0000","last_peered":"2024-09-12T02:42:47.082149+0000","last_clean":"2024-09-12T02:42:47.082149+0000","last_became_active":"2024-09-12T02:42:47.080480+0000","last_became_peered":"2024-09-12T02:42:47.080480+0000","last_unstale":"2024-09-12T02:42:47.082149+0000","last_undegraded":"2024-09-12T02:42:47.082149+0000","last_fullsized":"2024-09-12T02:42:47.082149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:04.618352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.084988+0000","last_change":"2024-09-12T02:42:47.083430+0000","last_active":"2024-09-12T02:42:47.084988+0000","last_peered":"2024-09-12T02:42:47.084988+0000","last_clean":"2024-09-12T02:42:47.084988+0000","last_became_active":"2024-09-12T02:42:47.083190+0000","last_became_peered":"2024-09-12T02:42:47.083190+0000","last_unstale":"2024-09-12T02:42:47.084988+0000","last_undegraded":"2024-09-12T02:42:47.084988+0000","last_fullsized":"2024-09-12T02:42:47.084988+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:40.216844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.087954+0000","last_change":"2024-09-12T02:42:46.057390+0000","last_active":"2024-09-12T02:42:47.087954+0000","last_peered":"2024-09-12T02:42:47.087954+0000","last_clean":"2024-09-12T02:42:47.087954+0000","last_became_active":"2024-09-12T02:42:46.057149+0000","last_became_peered":"2024-09-12T02:42:46.057149+0000","last_unstale":"2024-09-12T02:42:47.087954+0000","last_undegraded":"2024-09-12T02:42:47.087954+0000","last_fullsized":"2024-09-12T02:42:47.087954+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:48.708552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.070920+0000","last_change":"2024-09-12T02:42:47.070788+0000","last_active":"2024-09-12T02:42:47.070920+0000","last_peered":"2024-09-12T02:42:47.070920+0000","last_clean":"2024-09-12T02:42:47.070920+0000","last_became_active":"2024-09-12T02:42:47.070542+0000","last_became_peered":"2024-09-12T02:42:47.070542+0000","last_unstale":"2024-09-12T02:42:47.070920+0000","last_undegraded":"2024-09-12T02:42:47.070920+0000","last_fullsized":"2024-09-12T02:42:47.070920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:56.700195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.092354+0000","last_change":"2024-09-12T02:42:46.064945+0000","last_active":"2024-09-12T02:42:47.092354+0000","last_peered":"2024-09-12T02:42:47.092354+0000","last_clean":"2024-09-12T02:42:47.092354+0000","last_became_active":"2024-09-12T02:42:46.064557+0000","last_became_peered":"2024-09-12T02:42:46.064557+0000","last_unstale":"2024-09-12T02:42:47.092354+0000","last_undegraded":"2024-09-12T02:42:47.092354+0000","last_fullsized":"2024-09-12T02:42:47.092354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:06.569726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.082089+0000","last_change":"2024-09-12T02:42:47.080373+0000","last_active":"2024-09-12T02:42:47.082089+0000","last_peered":"2024-09-12T02:42:47.082089+0000","last_clean":"2024-09-12T02:42:47.082089+0000","last_became_active":"2024-09-12T02:42:47.080090+0000","last_became_peered":"2024-09-12T02:42:47.080090+0000","last_unstale":"2024-09-12T02:42:47.082089+0000","last_undegraded":"2024-09-12T02:42:47.082089+0000","last_fullsized":"2024-09-12T02:42:47.082089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:28.927049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.092462+0000","last_change":"2024-09-12T02:42:46.057909+0000","last_active":"2024-09-12T02:42:47.092462+0000","last_peered":"2024-09-12T02:42:47.092462+0000","last_clean":"2024-09-12T02:42:47.092462+0000","last_became_active":"2024-09-12T02:42:46.056923+0000","last_became_peered":"2024-09-12T02:42:46.056923+0000","last_unstale":"2024-09-12T02:42:47.092462+0000","last_undegraded":"2024-09-12T02:42:47.092462+0000","last_fullsized":"2024-09-12T02:42:47.092462+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:05.973784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.081398+0000","last_change":"2024-09-12T02:42:47.081287+0000","last_active":"2024-09-12T02:42:47.081398+0000","last_peered":"2024-09-12T02:42:47.081398+0000","last_clean":"2024-09-12T02:42:47.081398+0000","last_became_active":"2024-09-12T02:42:47.081057+0000","last_became_peered":"2024-09-12T02:42:47.081057+0000","last_unstale":"2024-09-12T02:42:47.081398+0000","last_undegraded":"2024-09-12T02:42:47.081398+0000","last_fullsized":"2024-09-12T02:42:47.081398+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:37.737720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.093040+0000","last_change":"2024-09-12T02:42:46.064606+0000","last_active":"2024-09-12T02:42:47.093040+0000","last_peered":"2024-09-12T02:42:47.093040+0000","last_clean":"2024-09-12T02:42:47.093040+0000","last_became_active":"2024-09-12T02:42:46.064322+0000","last_became_peered":"2024-09-12T02:42:46.064322+0000","last_unstale":"2024-09-12T02:42:47.093040+0000","last_undegraded":"2024-09-12T02:42:47.093040+0000","last_fullsized":"2024-09-12T02:42:47.093040+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:18.157260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.083031+0000","last_change":"2024-09-12T02:42:47.082895+0000","last_active":"2024-09-12T02:42:47.083031+0000","last_peered":"2024-09-12T02:42:47.083031+0000","last_clean":"2024-09-12T02:42:47.083031+0000","last_became_active":"2024-09-12T02:42:47.082286+0000","last_became_peered":"2024-09-12T02:42:47.082286+0000","last_unstale":"2024-09-12T02:42:47.083031+0000","last_undegraded":"2024-09-12T02:42:47.083031+0000","last_fullsized":"2024-09-12T02:42:47.083031+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:16.023705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.091839+0000","last_change":"2024-09-12T02:42:46.052331+0000","last_active":"2024-09-12T02:42:47.091839+0000","last_peered":"2024-09-12T02:42:47.091839+0000","last_clean":"2024-09-12T02:42:47.091839+0000","last_became_active":"2024-09-12T02:42:46.052092+0000","last_became_peered":"2024-09-12T02:42:46.052092+0000","last_unstale":"2024-09-12T02:42:47.091839+0000","last_undegraded":"2024-09-12T02:42:47.091839+0000","last_fullsized":"2024-09-12T02:42:47.091839+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:54.797583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.079526+0000","last_change":"2024-09-12T02:42:47.077541+0000","last_active":"2024-09-12T02:42:47.079526+0000","last_peered":"2024-09-12T02:42:47.079526+0000","last_clean":"2024-09-12T02:42:47.079526+0000","last_became_active":"2024-09-12T02:42:47.076588+0000","last_became_peered":"2024-09-12T02:42:47.076588+0000","last_unstale":"2024-09-12T02:42:47.079526+0000","last_undegraded":"2024-09-12T02:42:47.079526+0000","last_fullsized":"2024-09-12T02:42:47.079526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:22.031336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.092997+0000","last_change":"2024-09-12T02:42:46.053652+0000","last_active":"2024-09-12T02:42:47.092997+0000","last_peered":"2024-09-12T02:42:47.092997+0000","last_clean":"2024-09-12T02:42:47.092997+0000","last_became_active":"2024-09-12T02:42:46.052111+0000","last_became_peered":"2024-09-12T02:42:46.052111+0000","last_unstale":"2024-09-12T02:42:47.092997+0000","last_undegraded":"2024-09-12T02:42:47.092997+0000","last_fullsized":"2024-09-12T02:42:47.092997+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:30.859449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.072092+0000","last_change":"2024-09-12T02:42:47.071843+0000","last_active":"2024-09-12T02:42:47.072092+0000","last_peered":"2024-09-12T02:42:47.072092+0000","last_clean":"2024-09-12T02:42:47.072092+0000","last_became_active":"2024-09-12T02:42:47.071570+0000","last_became_peered":"2024-09-12T02:42:47.071570+0000","last_unstale":"2024-09-12T02:42:47.072092+0000","last_undegraded":"2024-09-12T02:42:47.072092+0000","last_fullsized":"2024-09-12T02:42:47.072092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:20.839082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.069320+0000","last_change":"2024-09-12T02:42:46.057443+0000","last_active":"2024-09-12T02:42:47.069320+0000","last_peered":"2024-09-12T02:42:47.069320+0000","last_clean":"2024-09-12T02:42:47.069320+0000","last_became_active":"2024-09-12T02:42:46.057221+0000","last_became_peered":"2024-09-12T02:42:46.057221+0000","last_unstale":"2024-09-12T02:42:47.069320+0000","last_undegraded":"2024-09-12T02:42:47.069320+0000","last_fullsized":"2024-09-12T02:42:47.069320+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:48.440540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.089176+0000","last_change":"2024-09-12T02:42:47.085601+0000","last_active":"2024-09-12T02:42:47.089176+0000","last_peered":"2024-09-12T02:42:47.089176+0000","last_clean":"2024-09-12T02:42:47.089176+0000","last_became_active":"2024-09-12T02:42:47.085300+0000","last_became_peered":"2024-09-12T02:42:47.085300+0000","last_unstale":"2024-09-12T02:42:47.089176+0000","last_undegraded":"2024-09-12T02:42:47.089176+0000","last_fullsized":"2024-09-12T02:42:47.089176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:33.076955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.067011+0000","last_change":"2024-09-12T02:42:46.053626+0000","last_active":"2024-09-12T02:42:47.067011+0000","last_peered":"2024-09-12T02:42:47.067011+0000","last_clean":"2024-09-12T02:42:47.067011+0000","last_became_active":"2024-09-12T02:42:46.053065+0000","last_became_peered":"2024-09-12T02:42:46.053065+0000","last_unstale":"2024-09-12T02:42:47.067011+0000","last_undegraded":"2024-09-12T02:42:47.067011+0000","last_fullsized":"2024-09-12T02:42:47.067011+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:23.424835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.082069+0000","last_change":"2024-09-12T02:42:47.081713+0000","last_active":"2024-09-12T02:42:47.082069+0000","last_peered":"2024-09-12T02:42:47.082069+0000","last_clean":"2024-09-12T02:42:47.082069+0000","last_became_active":"2024-09-12T02:42:47.079830+0000","last_became_peered":"2024-09-12T02:42:47.079830+0000","last_unstale":"2024-09-12T02:42:47.082069+0000","last_undegraded":"2024-09-12T02:42:47.082069+0000","last_fullsized":"2024-09-12T02:42:47.082069+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:10.812030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.068173+0000","last_change":"2024-09-12T02:42:46.060692+0000","last_active":"2024-09-12T02:42:47.068173+0000","last_peered":"2024-09-12T02:42:47.068173+0000","last_clean":"2024-09-12T02:42:47.068173+0000","last_became_active":"2024-09-12T02:42:46.060420+0000","last_became_peered":"2024-09-12T02:42:46.060420+0000","last_unstale":"2024-09-12T02:42:47.068173+0000","last_undegraded":"2024-09-12T02:42:47.068173+0000","last_fullsized":"2024-09-12T02:42:47.068173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:20.062583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.083263+0000","last_change":"2024-09-12T02:42:47.082497+0000","last_active":"2024-09-12T02:42:47.083263+0000","last_peered":"2024-09-12T02:42:47.083263+0000","last_clean":"2024-09-12T02:42:47.083263+0000","last_became_active":"2024-09-12T02:42:47.082048+0000","last_became_peered":"2024-09-12T02:42:47.082048+0000","last_unstale":"2024-09-12T02:42:47.083263+0000","last_undegraded":"2024-09-12T02:42:47.083263+0000","last_fullsized":"2024-09-12T02:42:47.083263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:40.696324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.070041+0000","last_change":"2024-09-12T02:42:46.058703+0000","last_active":"2024-09-12T02:42:47.070041+0000","last_peered":"2024-09-12T02:42:47.070041+0000","last_clean":"2024-09-12T02:42:47.070041+0000","last_became_active":"2024-09-12T02:42:46.058479+0000","last_became_peered":"2024-09-12T02:42:46.058479+0000","last_unstale":"2024-09-12T02:42:47.070041+0000","last_undegraded":"2024-09-12T02:42:47.070041+0000","last_fullsized":"2024-09-12T02:42:47.070041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:25.998596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.085795+0000","last_change":"2024-09-12T02:42:47.084772+0000","last_active":"2024-09-12T02:42:47.085795+0000","last_peered":"2024-09-12T02:42:47.085795+0000","last_clean":"2024-09-12T02:42:47.085795+0000","last_became_active":"2024-09-12T02:42:47.084549+0000","last_became_peered":"2024-09-12T02:42:47.084549+0000","last_unstale":"2024-09-12T02:42:47.085795+0000","last_undegraded":"2024-09-12T02:42:47.085795+0000","last_fullsized":"2024-09-12T02:42:47.085795+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:51.781817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.092355+0000","last_change":"2024-09-12T02:42:46.062917+0000","last_active":"2024-09-12T02:42:47.092355+0000","last_peered":"2024-09-12T02:42:47.092355+0000","last_clean":"2024-09-12T02:42:47.092355+0000","last_became_active":"2024-09-12T02:42:46.062515+0000","last_became_peered":"2024-09-12T02:42:46.062515+0000","last_unstale":"2024-09-12T02:42:47.092355+0000","last_undegraded":"2024-09-12T02:42:47.092355+0000","last_fullsized":"2024-09-12T02:42:47.092355+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:04.510631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.079547+0000","last_change":"2024-09-12T02:42:47.078724+0000","last_active":"2024-09-12T02:42:47.079547+0000","last_peered":"2024-09-12T02:42:47.079547+0000","last_clean":"2024-09-12T02:42:47.079547+0000","last_became_active":"2024-09-12T02:42:47.078196+0000","last_became_peered":"2024-09-12T02:42:47.078196+0000","last_unstale":"2024-09-12T02:42:47.079547+0000","last_undegraded":"2024-09-12T02:42:47.079547+0000","last_fullsized":"2024-09-12T02:42:47.079547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:45.324518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.095201+0000","last_change":"2024-09-12T02:42:46.056089+0000","last_active":"2024-09-12T02:42:47.095201+0000","last_peered":"2024-09-12T02:42:47.095201+0000","last_clean":"2024-09-12T02:42:47.095201+0000","last_became_active":"2024-09-12T02:42:46.055856+0000","last_became_peered":"2024-09-12T02:42:46.055856+0000","last_unstale":"2024-09-12T02:42:47.095201+0000","last_undegraded":"2024-09-12T02:42:47.095201+0000","last_fullsized":"2024-09-12T02:42:47.095201+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:35.388597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.084532+0000","last_change":"2024-09-12T02:42:47.082891+0000","last_active":"2024-09-12T02:42:47.084532+0000","last_peered":"2024-09-12T02:42:47.084532+0000","last_clean":"2024-09-12T02:42:47.084532+0000","last_became_active":"2024-09-12T02:42:47.082581+0000","last_became_peered":"2024-09-12T02:42:47.082581+0000","last_unstale":"2024-09-12T02:42:47.084532+0000","last_undegraded":"2024-09-12T02:42:47.084532+0000","last_fullsized":"2024-09-12T02:42:47.084532+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:48.384436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.092408+0000","last_change":"2024-09-12T02:42:46.053838+0000","last_active":"2024-09-12T02:42:47.092408+0000","last_peered":"2024-09-12T02:42:47.092408+0000","last_clean":"2024-09-12T02:42:47.092408+0000","last_became_active":"2024-09-12T02:42:46.053384+0000","last_became_peered":"2024-09-12T02:42:46.053384+0000","last_unstale":"2024-09-12T02:42:47.092408+0000","last_undegraded":"2024-09-12T02:42:47.092408+0000","last_fullsized":"2024-09-12T02:42:47.092408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:25.462430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.075976+0000","last_change":"2024-09-12T02:42:47.074498+0000","last_active":"2024-09-12T02:42:47.075976+0000","last_peered":"2024-09-12T02:42:47.075976+0000","last_clean":"2024-09-12T02:42:47.075976+0000","last_became_active":"2024-09-12T02:42:47.074272+0000","last_became_peered":"2024-09-12T02:42:47.074272+0000","last_unstale":"2024-09-12T02:42:47.075976+0000","last_undegraded":"2024-09-12T02:42:47.075976+0000","last_fullsized":"2024-09-12T02:42:47.075976+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:37.225250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.078940+0000","last_change":"2024-09-12T02:42:46.060317+0000","last_active":"2024-09-12T02:42:47.078940+0000","last_peered":"2024-09-12T02:42:47.078940+0000","last_clean":"2024-09-12T02:42:47.078940+0000","last_became_active":"2024-09-12T02:42:46.059994+0000","last_became_peered":"2024-09-12T02:42:46.059994+0000","last_unstale":"2024-09-12T02:42:47.078940+0000","last_undegraded":"2024-09-12T02:42:47.078940+0000","last_fullsized":"2024-09-12T02:42:47.078940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:09.233941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.083228+0000","last_change":"2024-09-12T02:42:47.083117+0000","last_active":"2024-09-12T02:42:47.083228+0000","last_peered":"2024-09-12T02:42:47.083228+0000","last_clean":"2024-09-12T02:42:47.083228+0000","last_became_active":"2024-09-12T02:42:47.082667+0000","last_became_peered":"2024-09-12T02:42:47.082667+0000","last_unstale":"2024-09-12T02:42:47.083228+0000","last_undegraded":"2024-09-12T02:42:47.083228+0000","last_fullsized":"2024-09-12T02:42:47.083228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:19.282752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.066896+0000","last_change":"2024-09-12T02:42:46.062230+0000","last_active":"2024-09-12T02:42:47.066896+0000","last_peered":"2024-09-12T02:42:47.066896+0000","last_clean":"2024-09-12T02:42:47.066896+0000","last_became_active":"2024-09-12T02:42:46.061994+0000","last_became_peered":"2024-09-12T02:42:46.061994+0000","last_unstale":"2024-09-12T02:42:47.066896+0000","last_undegraded":"2024-09-12T02:42:47.066896+0000","last_fullsized":"2024-09-12T02:42:47.066896+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:50.658372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.076215+0000","last_change":"2024-09-12T02:42:47.076091+0000","last_active":"2024-09-12T02:42:47.076215+0000","last_peered":"2024-09-12T02:42:47.076215+0000","last_clean":"2024-09-12T02:42:47.076215+0000","last_became_active":"2024-09-12T02:42:47.075755+0000","last_became_peered":"2024-09-12T02:42:47.075755+0000","last_unstale":"2024-09-12T02:42:47.076215+0000","last_undegraded":"2024-09-12T02:42:47.076215+0000","last_fullsized":"2024-09-12T02:42:47.076215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:42.562954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.093908+0000","last_change":"2024-09-12T02:42:46.059039+0000","last_active":"2024-09-12T02:42:47.093908+0000","last_peered":"2024-09-12T02:42:47.093908+0000","last_clean":"2024-09-12T02:42:47.093908+0000","last_became_active":"2024-09-12T02:42:46.058782+0000","last_became_peered":"2024-09-12T02:42:46.058782+0000","last_unstale":"2024-09-12T02:42:47.093908+0000","last_undegraded":"2024-09-12T02:42:47.093908+0000","last_fullsized":"2024-09-12T02:42:47.093908+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:54.406789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.075943+0000","last_change":"2024-09-12T02:42:47.075554+0000","last_active":"2024-09-12T02:42:47.075943+0000","last_peered":"2024-09-12T02:42:47.075943+0000","last_clean":"2024-09-12T02:42:47.075943+0000","last_became_active":"2024-09-12T02:42:47.075289+0000","last_became_peered":"2024-09-12T02:42:47.075289+0000","last_unstale":"2024-09-12T02:42:47.075943+0000","last_undegraded":"2024-09-12T02:42:47.075943+0000","last_fullsized":"2024-09-12T02:42:47.075943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:34.248949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.095296+0000","last_change":"2024-09-12T02:42:46.058573+0000","last_active":"2024-09-12T02:42:47.095296+0000","last_peered":"2024-09-12T02:42:47.095296+0000","last_clean":"2024-09-12T02:42:47.095296+0000","last_became_active":"2024-09-12T02:42:46.057647+0000","last_became_peered":"2024-09-12T02:42:46.057647+0000","last_unstale":"2024-09-12T02:42:47.095296+0000","last_undegraded":"2024-09-12T02:42:47.095296+0000","last_fullsized":"2024-09-12T02:42:47.095296+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:43.003223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.080889+0000","last_change":"2024-09-12T02:42:47.080756+0000","last_active":"2024-09-12T02:42:47.080889+0000","last_peered":"2024-09-12T02:42:47.080889+0000","last_clean":"2024-09-12T02:42:47.080889+0000","last_became_active":"2024-09-12T02:42:47.080500+0000","last_became_peered":"2024-09-12T02:42:47.080500+0000","last_unstale":"2024-09-12T02:42:47.080889+0000","last_undegraded":"2024-09-12T02:42:47.080889+0000","last_fullsized":"2024-09-12T02:42:47.080889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:50.807391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.091670+0000","last_change":"2024-09-12T02:42:46.059700+0000","last_active":"2024-09-12T02:42:47.091670+0000","last_peered":"2024-09-12T02:42:47.091670+0000","last_clean":"2024-09-12T02:42:47.091670+0000","last_became_active":"2024-09-12T02:42:46.058195+0000","last_became_peered":"2024-09-12T02:42:46.058195+0000","last_unstale":"2024-09-12T02:42:47.091670+0000","last_undegraded":"2024-09-12T02:42:47.091670+0000","last_fullsized":"2024-09-12T02:42:47.091670+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:21.786669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.082155+0000","last_change":"2024-09-12T02:42:47.081995+0000","last_active":"2024-09-12T02:42:47.082155+0000","last_peered":"2024-09-12T02:42:47.082155+0000","last_clean":"2024-09-12T02:42:47.082155+0000","last_became_active":"2024-09-12T02:42:47.080357+0000","last_became_peered":"2024-09-12T02:42:47.080357+0000","last_unstale":"2024-09-12T02:42:47.082155+0000","last_undegraded":"2024-09-12T02:42:47.082155+0000","last_fullsized":"2024-09-12T02:42:47.082155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:03.733058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.091400+0000","last_change":"2024-09-12T02:42:46.063210+0000","last_active":"2024-09-12T02:42:47.091400+0000","last_peered":"2024-09-12T02:42:47.091400+0000","last_clean":"2024-09-12T02:42:47.091400+0000","last_became_active":"2024-09-12T02:42:46.062633+0000","last_became_peered":"2024-09-12T02:42:46.062633+0000","last_unstale":"2024-09-12T02:42:47.091400+0000","last_undegraded":"2024-09-12T02:42:47.091400+0000","last_fullsized":"2024-09-12T02:42:47.091400+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:17.388679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.085669+0000","last_change":"2024-09-12T02:42:47.084753+0000","last_active":"2024-09-12T02:42:47.085669+0000","last_peered":"2024-09-12T02:42:47.085669+0000","last_clean":"2024-09-12T02:42:47.085669+0000","last_became_active":"2024-09-12T02:42:47.084529+0000","last_became_peered":"2024-09-12T02:42:47.084529+0000","last_unstale":"2024-09-12T02:42:47.085669+0000","last_undegraded":"2024-09-12T02:42:47.085669+0000","last_fullsized":"2024-09-12T02:42:47.085669+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:01.011436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.069001+0000","last_change":"2024-09-12T02:42:46.057860+0000","last_active":"2024-09-12T02:42:47.069001+0000","last_peered":"2024-09-12T02:42:47.069001+0000","last_clean":"2024-09-12T02:42:47.069001+0000","last_became_active":"2024-09-12T02:42:46.057117+0000","last_became_peered":"2024-09-12T02:42:46.057117+0000","last_unstale":"2024-09-12T02:42:47.069001+0000","last_undegraded":"2024-09-12T02:42:47.069001+0000","last_fullsized":"2024-09-12T02:42:47.069001+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:27:34.238087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.088693+0000","last_change":"2024-09-12T02:42:47.087404+0000","last_active":"2024-09-12T02:42:47.088693+0000","last_peered":"2024-09-12T02:42:47.088693+0000","last_clean":"2024-09-12T02:42:47.088693+0000","last_became_active":"2024-09-12T02:42:47.086733+0000","last_became_peered":"2024-09-12T02:42:47.086733+0000","last_unstale":"2024-09-12T02:42:47.088693+0000","last_undegraded":"2024-09-12T02:42:47.088693+0000","last_fullsized":"2024-09-12T02:42:47.088693+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:14.187722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.094193+0000","last_change":"2024-09-12T02:42:46.058583+0000","last_active":"2024-09-12T02:42:47.094193+0000","last_peered":"2024-09-12T02:42:47.094193+0000","last_clean":"2024-09-12T02:42:47.094193+0000","last_became_active":"2024-09-12T02:42:46.056699+0000","last_became_peered":"2024-09-12T02:42:46.056699+0000","last_unstale":"2024-09-12T02:42:47.094193+0000","last_undegraded":"2024-09-12T02:42:47.094193+0000","last_fullsized":"2024-09-12T02:42:47.094193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:14.033359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.084153+0000","last_change":"2024-09-12T02:42:47.082205+0000","last_active":"2024-09-12T02:42:47.084153+0000","last_peered":"2024-09-12T02:42:47.084153+0000","last_clean":"2024-09-12T02:42:47.084153+0000","last_became_active":"2024-09-12T02:42:47.081315+0000","last_became_peered":"2024-09-12T02:42:47.081315+0000","last_unstale":"2024-09-12T02:42:47.084153+0000","last_undegraded":"2024-09-12T02:42:47.084153+0000","last_fullsized":"2024-09-12T02:42:47.084153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:52.074492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.067628+0000","last_change":"2024-09-12T02:42:46.056602+0000","last_active":"2024-09-12T02:42:47.067628+0000","last_peered":"2024-09-12T02:42:47.067628+0000","last_clean":"2024-09-12T02:42:47.067628+0000","last_became_active":"2024-09-12T02:42:46.055064+0000","last_became_peered":"2024-09-12T02:42:46.055064+0000","last_unstale":"2024-09-12T02:42:47.067628+0000","last_undegraded":"2024-09-12T02:42:47.067628+0000","last_fullsized":"2024-09-12T02:42:47.067628+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:47.903634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.090840+0000","last_change":"2024-09-12T02:42:47.089465+0000","last_active":"2024-09-12T02:42:47.090840+0000","last_peered":"2024-09-12T02:42:47.090840+0000","last_clean":"2024-09-12T02:42:47.090840+0000","last_became_active":"2024-09-12T02:42:47.089100+0000","last_became_peered":"2024-09-12T02:42:47.089100+0000","last_unstale":"2024-09-12T02:42:47.090840+0000","last_undegraded":"2024-09-12T02:42:47.090840+0000","last_fullsized":"2024-09-12T02:42:47.090840+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:42.038248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.067434+0000","last_change":"2024-09-12T02:42:46.061174+0000","last_active":"2024-09-12T02:42:47.067434+0000","last_peered":"2024-09-12T02:42:47.067434+0000","last_clean":"2024-09-12T02:42:47.067434+0000","last_became_active":"2024-09-12T02:42:46.058536+0000","last_became_peered":"2024-09-12T02:42:46.058536+0000","last_unstale":"2024-09-12T02:42:47.067434+0000","last_undegraded":"2024-09-12T02:42:47.067434+0000","last_fullsized":"2024-09-12T02:42:47.067434+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:08.719798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.082166+0000","last_change":"2024-09-12T02:42:47.081717+0000","last_active":"2024-09-12T02:42:47.082166+0000","last_peered":"2024-09-12T02:42:47.082166+0000","last_clean":"2024-09-12T02:42:47.082166+0000","last_became_active":"2024-09-12T02:42:47.081099+0000","last_became_peered":"2024-09-12T02:42:47.081099+0000","last_unstale":"2024-09-12T02:42:47.082166+0000","last_undegraded":"2024-09-12T02:42:47.082166+0000","last_fullsized":"2024-09-12T02:42:47.082166+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:49.660261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.069020+0000","last_change":"2024-09-12T02:42:46.061548+0000","last_active":"2024-09-12T02:42:47.069020+0000","last_peered":"2024-09-12T02:42:47.069020+0000","last_clean":"2024-09-12T02:42:47.069020+0000","last_became_active":"2024-09-12T02:42:46.061109+0000","last_became_peered":"2024-09-12T02:42:46.061109+0000","last_unstale":"2024-09-12T02:42:47.069020+0000","last_undegraded":"2024-09-12T02:42:47.069020+0000","last_fullsized":"2024-09-12T02:42:47.069020+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:57.979864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.084225+0000","last_change":"2024-09-12T02:42:47.082557+0000","last_active":"2024-09-12T02:42:47.084225+0000","last_peered":"2024-09-12T02:42:47.084225+0000","last_clean":"2024-09-12T02:42:47.084225+0000","last_became_active":"2024-09-12T02:42:47.081896+0000","last_became_peered":"2024-09-12T02:42:47.081896+0000","last_unstale":"2024-09-12T02:42:47.084225+0000","last_undegraded":"2024-09-12T02:42:47.084225+0000","last_fullsized":"2024-09-12T02:42:47.084225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:49.051086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.092957+0000","last_change":"2024-09-12T02:42:46.063112+0000","last_active":"2024-09-12T02:42:47.092957+0000","last_peered":"2024-09-12T02:42:47.092957+0000","last_clean":"2024-09-12T02:42:47.092957+0000","last_became_active":"2024-09-12T02:42:46.062112+0000","last_became_peered":"2024-09-12T02:42:46.062112+0000","last_unstale":"2024-09-12T02:42:47.092957+0000","last_undegraded":"2024-09-12T02:42:47.092957+0000","last_fullsized":"2024-09-12T02:42:47.092957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:10.764721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.083106+0000","last_change":"2024-09-12T02:42:47.082878+0000","last_active":"2024-09-12T02:42:47.083106+0000","last_peered":"2024-09-12T02:42:47.083106+0000","last_clean":"2024-09-12T02:42:47.083106+0000","last_became_active":"2024-09-12T02:42:47.082612+0000","last_became_peered":"2024-09-12T02:42:47.082612+0000","last_unstale":"2024-09-12T02:42:47.083106+0000","last_undegraded":"2024-09-12T02:42:47.083106+0000","last_fullsized":"2024-09-12T02:42:47.083106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:17.399178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.070508+0000","last_change":"2024-09-12T02:42:46.058902+0000","last_active":"2024-09-12T02:42:47.070508+0000","last_peered":"2024-09-12T02:42:47.070508+0000","last_clean":"2024-09-12T02:42:47.070508+0000","last_became_active":"2024-09-12T02:42:46.057163+0000","last_became_peered":"2024-09-12T02:42:46.057163+0000","last_unstale":"2024-09-12T02:42:47.070508+0000","last_undegraded":"2024-09-12T02:42:47.070508+0000","last_fullsized":"2024-09-12T02:42:47.070508+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:46.856504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.087934+0000","last_change":"2024-09-12T02:42:47.087806+0000","last_active":"2024-09-12T02:42:47.087934+0000","last_peered":"2024-09-12T02:42:47.087934+0000","last_clean":"2024-09-12T02:42:47.087934+0000","last_became_active":"2024-09-12T02:42:47.087574+0000","last_became_peered":"2024-09-12T02:42:47.087574+0000","last_unstale":"2024-09-12T02:42:47.087934+0000","last_undegraded":"2024-09-12T02:42:47.087934+0000","last_fullsized":"2024-09-12T02:42:47.087934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:20.689228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.075801+0000","last_change":"2024-09-12T02:42:46.062300+0000","last_active":"2024-09-12T02:42:47.075801+0000","last_peered":"2024-09-12T02:42:47.075801+0000","last_clean":"2024-09-12T02:42:47.075801+0000","last_became_active":"2024-09-12T02:42:46.061902+0000","last_became_peered":"2024-09-12T02:42:46.061902+0000","last_unstale":"2024-09-12T02:42:47.075801+0000","last_undegraded":"2024-09-12T02:42:47.075801+0000","last_fullsized":"2024-09-12T02:42:47.075801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:28.980786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.074507+0000","last_change":"2024-09-12T02:42:47.074332+0000","last_active":"2024-09-12T02:42:47.074507+0000","last_peered":"2024-09-12T02:42:47.074507+0000","last_clean":"2024-09-12T02:42:47.074507+0000","last_became_active":"2024-09-12T02:42:47.074017+0000","last_became_peered":"2024-09-12T02:42:47.074017+0000","last_unstale":"2024-09-12T02:42:47.074507+0000","last_undegraded":"2024-09-12T02:42:47.074507+0000","last_fullsized":"2024-09-12T02:42:47.074507+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:38.204166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.070483+0000","last_change":"2024-09-12T02:42:46.063655+0000","last_active":"2024-09-12T02:42:47.070483+0000","last_peered":"2024-09-12T02:42:47.070483+0000","last_clean":"2024-09-12T02:42:47.070483+0000","last_became_active":"2024-09-12T02:42:46.063419+0000","last_became_peered":"2024-09-12T02:42:46.063419+0000","last_unstale":"2024-09-12T02:42:47.070483+0000","last_undegraded":"2024-09-12T02:42:47.070483+0000","last_fullsized":"2024-09-12T02:42:47.070483+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:22.827569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.077812+0000","last_change":"2024-09-12T02:42:47.077598+0000","last_active":"2024-09-12T02:42:47.077812+0000","last_peered":"2024-09-12T02:42:47.077812+0000","last_clean":"2024-09-12T02:42:47.077812+0000","last_became_active":"2024-09-12T02:42:47.077350+0000","last_became_peered":"2024-09-12T02:42:47.077350+0000","last_unstale":"2024-09-12T02:42:47.077812+0000","last_undegraded":"2024-09-12T02:42:47.077812+0000","last_fullsized":"2024-09-12T02:42:47.077812+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:47.318379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.074915+0000","last_change":"2024-09-12T02:42:46.063288+0000","last_active":"2024-09-12T02:42:47.074915+0000","last_peered":"2024-09-12T02:42:47.074915+0000","last_clean":"2024-09-12T02:42:47.074915+0000","last_became_active":"2024-09-12T02:42:46.062738+0000","last_became_peered":"2024-09-12T02:42:46.062738+0000","last_unstale":"2024-09-12T02:42:47.074915+0000","last_undegraded":"2024-09-12T02:42:47.074915+0000","last_fullsized":"2024-09-12T02:42:47.074915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:07.356827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.089394+0000","last_change":"2024-09-12T02:42:47.089140+0000","last_active":"2024-09-12T02:42:47.089394+0000","last_peered":"2024-09-12T02:42:47.089394+0000","last_clean":"2024-09-12T02:42:47.089394+0000","last_became_active":"2024-09-12T02:42:47.088905+0000","last_became_peered":"2024-09-12T02:42:47.088905+0000","last_unstale":"2024-09-12T02:42:47.089394+0000","last_undegraded":"2024-09-12T02:42:47.089394+0000","last_fullsized":"2024-09-12T02:42:47.089394+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:50.957435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.066719+0000","last_change":"2024-09-12T02:42:46.059554+0000","last_active":"2024-09-12T02:42:47.066719+0000","last_peered":"2024-09-12T02:42:47.066719+0000","last_clean":"2024-09-12T02:42:47.066719+0000","last_became_active":"2024-09-12T02:42:46.059220+0000","last_became_peered":"2024-09-12T02:42:46.059220+0000","last_unstale":"2024-09-12T02:42:47.066719+0000","last_undegraded":"2024-09-12T02:42:47.066719+0000","last_fullsized":"2024-09-12T02:42:47.066719+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:30.681635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.078000+0000","last_change":"2024-09-12T02:42:47.077273+0000","last_active":"2024-09-12T02:42:47.078000+0000","last_peered":"2024-09-12T02:42:47.078000+0000","last_clean":"2024-09-12T02:42:47.078000+0000","last_became_active":"2024-09-12T02:42:47.073716+0000","last_became_peered":"2024-09-12T02:42:47.073716+0000","last_unstale":"2024-09-12T02:42:47.078000+0000","last_undegraded":"2024-09-12T02:42:47.078000+0000","last_fullsized":"2024-09-12T02:42:47.078000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:59.463828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.069872+0000","last_change":"2024-09-12T02:42:46.058132+0000","last_active":"2024-09-12T02:42:47.069872+0000","last_peered":"2024-09-12T02:42:47.069872+0000","last_clean":"2024-09-12T02:42:47.069872+0000","last_became_active":"2024-09-12T02:42:46.057899+0000","last_became_peered":"2024-09-12T02:42:46.057899+0000","last_unstale":"2024-09-12T02:42:47.069872+0000","last_undegraded":"2024-09-12T02:42:47.069872+0000","last_fullsized":"2024-09-12T02:42:47.069872+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:50.880449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.089053+0000","last_change":"2024-09-12T02:42:47.088894+0000","last_active":"2024-09-12T02:42:47.089053+0000","last_peered":"2024-09-12T02:42:47.089053+0000","last_clean":"2024-09-12T02:42:47.089053+0000","last_became_active":"2024-09-12T02:42:47.088657+0000","last_became_peered":"2024-09-12T02:42:47.088657+0000","last_unstale":"2024-09-12T02:42:47.089053+0000","last_undegraded":"2024-09-12T02:42:47.089053+0000","last_fullsized":"2024-09-12T02:42:47.089053+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:46.043544+0000","last_clean_scrub_stamp":"2024-09-12T02:42:46.043544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:20.649533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.069031+0000","last_change":"2024-09-12T02:42:46.056851+0000","last_active":"2024-09-12T02:42:47.069031+0000","last_peered":"2024-09-12T02:42:47.069031+0000","last_clean":"2024-09-12T02:42:47.069031+0000","last_became_active":"2024-09-12T02:42:46.056281+0000","last_became_peered":"2024-09-12T02:42:46.056281+0000","last_unstale":"2024-09-12T02:42:47.069031+0000","last_undegraded":"2024-09-12T02:42:47.069031+0000","last_fullsized":"2024-09-12T02:42:47.069031+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:42:45.037351+0000","last_clean_scrub_stamp":"2024-09-12T02:42:45.037351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:35.309875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":190,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T02:42:47.073892+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:42:47.073892+0000","last_peered":"2024-09-12T02:42:47.073892+0000","last_clean":"2024-09-12T02:42:47.073892+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:42:47.073892+0000","last_undegraded":"2024-09-12T02:42:47.073892+0000","last_fullsized":"2024-09-12T02:42:47.073892+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:45.426902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":706,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194606,"statfs":{"total":200000000,"available":199276561,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":130,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195182,"statfs":{"total":200000000,"available":199866403,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":130,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195181,"statfs":{"total":200000000,"available":199866347,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":9,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":129,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195182,"statfs":{"total":200000000,"available":199866915,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":131,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195181,"statfs":{"total":200000000,"available":199865385,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":129,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195182,"statfs":{"total":200000000,"available":199866949,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":131,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195181,"statfs":{"total":200000000,"available":199865385,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":706,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194606,"statfs":{"total":200000000,"available":199276651,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:42:51.713 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:42:51.713 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T02:42:51.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.909+0000 7f808ea00640 1 Processor -- start 2024-09-12T02:42:51.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.909+0000 7f808ea00640 1 -- start start 2024-09-12T02:42:51.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.910+0000 7f808ea00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f80881605e0 0x7f8088160a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:51.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.910+0000 7f808ea00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8088071840 0x7f8088071cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:51.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.910+0000 7f808ea00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8088160f40 con 0x7f80881466f0 2024-09-12T02:42:51.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.910+0000 7f808ea00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f80880b3af0 con 0x7f8088071840 2024-09-12T02:42:51.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.910+0000 7f808ea00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f80880b3dd0 con 0x7f80881605e0 2024-09-12T02:42:51.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.910+0000 7f808ca00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8088071840 0x7f8088071cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:51.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.910+0000 7f808ca00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8088071840 0x7f8088071cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35952/0 (socket says 172.21.15.112:35952) 2024-09-12T02:42:51.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.910+0000 7f808ca00640 1 -- 172.21.15.112:0/3434041086 learned_addr learned my addr 172.21.15.112:0/3434041086 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:51.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.911+0000 7f8087400640 1 --2- 172.21.15.112:0/3434041086 >> v2:172.21.15.137:3300/0 conn(0x7f80881605e0 0x7f8088160a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:51.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.911+0000 7f808ca00640 1 -- 172.21.15.112:0/3434041086 >> v2:172.21.15.137:3300/0 conn(0x7f80881605e0 msgr2=0x7f8088160a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:51.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.911+0000 7f808ca00640 1 --2- 172.21.15.112:0/3434041086 >> v2:172.21.15.137:3300/0 conn(0x7f80881605e0 0x7f8088160a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.911+0000 7f808ca00640 1 -- 172.21.15.112:0/3434041086 >> v1:172.21.15.137:6789/0 conn(0x7f80881466f0 legacy=0x7f80880b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:51.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.911+0000 7f808ca00640 1 -- 172.21.15.112:0/3434041086 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80880b40b0 con 0x7f8088071840 2024-09-12T02:42:51.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.911+0000 7f8087400640 1 --2- 172.21.15.112:0/3434041086 >> v2:172.21.15.137:3300/0 conn(0x7f80881605e0 0x7f8088160a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:42:51.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.912+0000 7f808ca00640 1 --2- 172.21.15.112:0/3434041086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8088071840 0x7f8088071cd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f80880d1990 tx=0x7f808002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24db3bfad7112f03 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:51.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.912+0000 7f8086a00640 1 -- 172.21.15.112:0/3434041086 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8080036070 con 0x7f8088071840 2024-09-12T02:42:51.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.912+0000 7f8086a00640 1 -- 172.21.15.112:0/3434041086 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8080031600 con 0x7f8088071840 2024-09-12T02:42:51.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.912+0000 7f8086a00640 1 -- 172.21.15.112:0/3434041086 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80800319d0 con 0x7f8088071840 2024-09-12T02:42:51.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.913+0000 7f808ea00640 1 -- 172.21.15.112:0/3434041086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8088071840 msgr2=0x7f8088071cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:51.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.913+0000 7f808ea00640 1 --2- 172.21.15.112:0/3434041086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8088071840 0x7f8088071cd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f80880d1990 tx=0x7f808002a660 comp rx=0 tx=0).stop 2024-09-12T02:42:51.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.913+0000 7f808ea00640 1 -- 172.21.15.112:0/3434041086 shutdown_connections 2024-09-12T02:42:51.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.913+0000 7f808ea00640 1 --2- 172.21.15.112:0/3434041086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8088071840 0x7f8088071cd0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.913+0000 7f808ea00640 1 --2- 172.21.15.112:0/3434041086 >> v2:172.21.15.137:3300/0 conn(0x7f80881605e0 0x7f8088160a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.913+0000 7f808ea00640 1 -- 172.21.15.112:0/3434041086 >> 172.21.15.112:0/3434041086 conn(0x7f80880b28a0 msgr2=0x7f80880b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:51.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.913+0000 7f808ea00640 1 -- 172.21.15.112:0/3434041086 shutdown_connections 2024-09-12T02:42:51.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.913+0000 7f808ea00640 1 -- 172.21.15.112:0/3434041086 wait complete. 2024-09-12T02:42:51.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.914+0000 7f808ea00640 1 Processor -- start 2024-09-12T02:42:51.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.914+0000 7f808ea00640 1 -- start start 2024-09-12T02:42:51.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.915+0000 7f808ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8088071840 0x7f8088156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:51.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.915+0000 7f808ea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80881466f0 0x7f808815a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:51.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.915+0000 7f808ea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f80881605e0 0x7f808815d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:51.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.915+0000 7f808ea00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8088072390 con 0x7f8088071840 2024-09-12T02:42:51.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.915+0000 7f808ea00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8088072210 con 0x7f80881466f0 2024-09-12T02:42:51.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.915+0000 7f808ea00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f808815e1b0 con 0x7f80881605e0 2024-09-12T02:42:51.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.916+0000 7f8087e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8088071840 0x7f8088156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:51.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.916+0000 7f8087e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8088071840 0x7f8088156420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35954/0 (socket says 172.21.15.112:35954) 2024-09-12T02:42:51.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.916+0000 7f8087e00640 1 -- 172.21.15.112:0/1946378816 learned_addr learned my addr 172.21.15.112:0/1946378816 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:51.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.916+0000 7f8087400640 1 --2- 172.21.15.112:0/1946378816 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80881466f0 0x7f808815a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:51.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.916+0000 7f8087e00640 1 -- 172.21.15.112:0/1946378816 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f80881605e0 msgr2=0x7f808815d6d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:42:51.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.916+0000 7f8087e00640 1 --2- 172.21.15.112:0/1946378816 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f80881605e0 0x7f808815d6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.916+0000 7f8087e00640 1 -- 172.21.15.112:0/1946378816 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80881466f0 msgr2=0x7f808815a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:51.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.916+0000 7f8087e00640 1 --2- 172.21.15.112:0/1946378816 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80881466f0 0x7f808815a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.916+0000 7f8087e00640 1 -- 172.21.15.112:0/1946378816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f808815c630 con 0x7f8088071840 2024-09-12T02:42:51.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.916+0000 7f8087e00640 1 --2- 172.21.15.112:0/1946378816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8088071840 0x7f8088156420 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f807800c430 tx=0x7f807800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:51.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.916+0000 7f807fe00640 1 -- 172.21.15.112:0/1946378816 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8078011790 con 0x7f8088071840 2024-09-12T02:42:51.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.916+0000 7f807fe00640 1 -- 172.21.15.112:0/1946378816 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8078017070 con 0x7f8088071840 2024-09-12T02:42:51.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.916+0000 7f807fe00640 1 -- 172.21.15.112:0/1946378816 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8078011bb0 con 0x7f8088071840 2024-09-12T02:42:51.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.916+0000 7f808ea00640 1 -- 172.21.15.112:0/1946378816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f808815cbf0 con 0x7f8088071840 2024-09-12T02:42:51.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.917+0000 7f808ea00640 1 -- 172.21.15.112:0/1946378816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f808815d1b0 con 0x7f8088071840 2024-09-12T02:42:51.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.918+0000 7f808ea00640 1 -- 172.21.15.112:0/1946378816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f808815d3b0 con 0x7f8088071840 2024-09-12T02:42:51.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.918+0000 7f807fe00640 1 -- 172.21.15.112:0/1946378816 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f807801c460 con 0x7f8088071840 2024-09-12T02:42:51.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.920+0000 7f807fe00640 1 --2- 172.21.15.112:0/1946378816 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f806806be30 0x7f806806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:51.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.920+0000 7f807fe00640 1 -- 172.21.15.112:0/1946378816 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f807808ad60 con 0x7f8088071840 2024-09-12T02:42:51.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.920+0000 7f8087400640 1 --2- 172.21.15.112:0/1946378816 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f806806be30 0x7f806806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:51.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.921+0000 7f8087400640 1 --2- 172.21.15.112:0/1946378816 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f806806be30 0x7f806806e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f808815e7b0 tx=0x7f8074008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:51.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:51.924+0000 7f807fe00640 1 -- 172.21.15.112:0/1946378816 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8078059710 con 0x7f8088071840 2024-09-12T02:42:52.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.160+0000 7f808ea00640 1 -- 172.21.15.112:0/1946378816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f8088071cd0 con 0x7f8088071840 2024-09-12T02:42:52.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.163+0000 7f807fe00640 1 -- 172.21.15.112:0/1946378816 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f8078059010 con 0x7f8088071840 2024-09-12T02:42:52.164 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-09-12T02:42:52.164 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDUVOJmaG86ExAAD0SOlJOsLpoQZlgPJIPaxA== 2024-09-12T02:42:52.164 INFO:teuthology.orchestra.run.smithi112.stdout: caps mds = "allow" 2024-09-12T02:42:52.164 INFO:teuthology.orchestra.run.smithi112.stdout: caps mon = "allow r" 2024-09-12T02:42:52.165 INFO:teuthology.orchestra.run.smithi112.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T02:42:52.165 INFO:teuthology.orchestra.run.smithi112.stderr:updated caps for client.0 2024-09-12T02:42:52.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.165+0000 7f808ea00640 1 -- 172.21.15.112:0/1946378816 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f806806be30 msgr2=0x7f806806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:52.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.165+0000 7f808ea00640 1 --2- 172.21.15.112:0/1946378816 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f806806be30 0x7f806806e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f808815e7b0 tx=0x7f8074008040 comp rx=0 tx=0).stop 2024-09-12T02:42:52.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.165+0000 7f808ea00640 1 -- 172.21.15.112:0/1946378816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8088071840 msgr2=0x7f8088156420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:52.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.165+0000 7f808ea00640 1 --2- 172.21.15.112:0/1946378816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8088071840 0x7f8088156420 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f807800c430 tx=0x7f807800c8f0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.165+0000 7f808ea00640 1 -- 172.21.15.112:0/1946378816 shutdown_connections 2024-09-12T02:42:52.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.165+0000 7f808ea00640 1 --2- 172.21.15.112:0/1946378816 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f80881605e0 0x7f808815d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.165+0000 7f808ea00640 1 --2- 172.21.15.112:0/1946378816 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f806806be30 0x7f806806e2f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.165+0000 7f808ea00640 1 --2- 172.21.15.112:0/1946378816 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80881466f0 0x7f808815a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.165+0000 7f808ea00640 1 --2- 172.21.15.112:0/1946378816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8088071840 0x7f8088156420 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.165+0000 7f808ea00640 1 -- 172.21.15.112:0/1946378816 >> 172.21.15.112:0/1946378816 conn(0x7f80880b28a0 msgr2=0x7f808815fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:52.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.165+0000 7f808ea00640 1 -- 172.21.15.112:0/1946378816 shutdown_connections 2024-09-12T02:42:52.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.165+0000 7f808ea00640 1 -- 172.21.15.112:0/1946378816 wait complete. 2024-09-12T02:42:52.182 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:42:52.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.334+0000 7ff3e2400640 1 Processor -- start 2024-09-12T02:42:52.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.334+0000 7ff3e2400640 1 -- start start 2024-09-12T02:42:52.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.335+0000 7ff3e2400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3dc06f600 0x7ff3dc0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:52.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.335+0000 7ff3e2400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff3dc0b45d0 0x7ff3dc0728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:52.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.335+0000 7ff3e2400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3dc0b4a20 con 0x7ff3dc15b9d0 2024-09-12T02:42:52.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.336+0000 7ff3e2400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff3dc0b54a0 con 0x7ff3dc0b45d0 2024-09-12T02:42:52.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.336+0000 7ff3e2400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff3dc0b3af0 con 0x7ff3dc06f600 2024-09-12T02:42:52.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.336+0000 7ff3dbe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff3dc0b45d0 0x7ff3dc0728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:52.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.336+0000 7ff3dbe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff3dc0b45d0 0x7ff3dc0728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35964/0 (socket says 172.21.15.112:35964) 2024-09-12T02:42:52.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.336+0000 7ff3dbe00640 1 -- 172.21.15.112:0/4180564489 learned_addr learned my addr 172.21.15.112:0/4180564489 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:52.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.336+0000 7ff3daa00640 1 --2- 172.21.15.112:0/4180564489 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3dc06f600 0x7ff3dc0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:52.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.336+0000 7ff3dbe00640 1 -- 172.21.15.112:0/4180564489 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3dc06f600 msgr2=0x7ff3dc0b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:52.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.336+0000 7ff3dbe00640 1 --2- 172.21.15.112:0/4180564489 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3dc06f600 0x7ff3dc0b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.336+0000 7ff3dbe00640 1 -- 172.21.15.112:0/4180564489 >> v1:172.21.15.137:6789/0 conn(0x7ff3dc15b9d0 legacy=0x7ff3dc06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:52.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.336+0000 7ff3dbe00640 1 -- 172.21.15.112:0/4180564489 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3dc0b3dd0 con 0x7ff3dc0b45d0 2024-09-12T02:42:52.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.337+0000 7ff3dbe00640 1 --2- 172.21.15.112:0/4180564489 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3dc0b45d0 0x7ff3dc0728c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4009e50 tx=0x7ff3d402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed2273f12d755b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:52.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.337+0000 7ff3da000640 1 -- 172.21.15.112:0/4180564489 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4036070 con 0x7ff3dc0b45d0 2024-09-12T02:42:52.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.337+0000 7ff3da000640 1 -- 172.21.15.112:0/4180564489 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3d4031600 con 0x7ff3dc0b45d0 2024-09-12T02:42:52.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.337+0000 7ff3da000640 1 -- 172.21.15.112:0/4180564489 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d40319d0 con 0x7ff3dc0b45d0 2024-09-12T02:42:52.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.338+0000 7ff3e2400640 1 -- 172.21.15.112:0/4180564489 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3dc0b45d0 msgr2=0x7ff3dc0728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:52.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.338+0000 7ff3e2400640 1 --2- 172.21.15.112:0/4180564489 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3dc0b45d0 0x7ff3dc0728c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4009e50 tx=0x7ff3d402a710 comp rx=0 tx=0).stop 2024-09-12T02:42:52.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.338+0000 7ff3e2400640 1 -- 172.21.15.112:0/4180564489 shutdown_connections 2024-09-12T02:42:52.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.338+0000 7ff3e2400640 1 --2- 172.21.15.112:0/4180564489 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3dc0b45d0 0x7ff3dc0728c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.338+0000 7ff3e2400640 1 --2- 172.21.15.112:0/4180564489 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3dc06f600 0x7ff3dc0b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.338+0000 7ff3e2400640 1 -- 172.21.15.112:0/4180564489 >> 172.21.15.112:0/4180564489 conn(0x7ff3dc06bbd0 msgr2=0x7ff3dc06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:52.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.338+0000 7ff3e2400640 1 -- 172.21.15.112:0/4180564489 shutdown_connections 2024-09-12T02:42:52.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.338+0000 7ff3e2400640 1 -- 172.21.15.112:0/4180564489 wait complete. 2024-09-12T02:42:52.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.340+0000 7ff3e2400640 1 Processor -- start 2024-09-12T02:42:52.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.340+0000 7ff3e2400640 1 -- start start 2024-09-12T02:42:52.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.341+0000 7ff3e2400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3dc06f600 0x7ff3dc0aff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:52.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.341+0000 7ff3e2400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3dc0b45d0 0x7ff3dc0ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:52.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.341+0000 7ff3e2400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3dc15b9d0 0x7ff3dc14f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:52.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.341+0000 7ff3e2400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc15bf30 con 0x7ff3dc06f600 2024-09-12T02:42:52.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.341+0000 7ff3e2400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc15bdb0 con 0x7ff3dc0b45d0 2024-09-12T02:42:52.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.341+0000 7ff3e2400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff3dc0cdcd0 con 0x7ff3dc15b9d0 2024-09-12T02:42:52.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.341+0000 7ff3db400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3dc06f600 0x7ff3dc0aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:52.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.341+0000 7ff3db400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3dc06f600 0x7ff3dc0aff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35980/0 (socket says 172.21.15.112:35980) 2024-09-12T02:42:52.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.341+0000 7ff3db400640 1 -- 172.21.15.112:0/1929677787 learned_addr learned my addr 172.21.15.112:0/1929677787 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:52.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.341+0000 7ff3daa00640 1 --2- 172.21.15.112:0/1929677787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3dc0b45d0 0x7ff3dc0ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:52.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.341+0000 7ff3dbe00640 1 --2- 172.21.15.112:0/1929677787 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3dc15b9d0 0x7ff3dc14f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:52.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.341+0000 7ff3db400640 1 -- 172.21.15.112:0/1929677787 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3dc15b9d0 msgr2=0x7ff3dc14f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:52.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.341+0000 7ff3db400640 1 --2- 172.21.15.112:0/1929677787 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3dc15b9d0 0x7ff3dc14f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.341+0000 7ff3db400640 1 -- 172.21.15.112:0/1929677787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3dc0b45d0 msgr2=0x7ff3dc0ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:52.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.341+0000 7ff3db400640 1 --2- 172.21.15.112:0/1929677787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3dc0b45d0 0x7ff3dc0ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.341+0000 7ff3db400640 1 -- 172.21.15.112:0/1929677787 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3dc0aefb0 con 0x7ff3dc06f600 2024-09-12T02:42:52.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.342+0000 7ff3db400640 1 --2- 172.21.15.112:0/1929677787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3dc06f600 0x7ff3dc0aff80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00c3f0 tx=0x7ff3cc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:52.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.342+0000 7ff3d3400640 1 -- 172.21.15.112:0/1929677787 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc0052d0 con 0x7ff3dc06f600 2024-09-12T02:42:52.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.342+0000 7ff3d3400640 1 -- 172.21.15.112:0/1929677787 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3cc005490 con 0x7ff3dc06f600 2024-09-12T02:42:52.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.342+0000 7ff3d3400640 1 -- 172.21.15.112:0/1929677787 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc007260 con 0x7ff3dc06f600 2024-09-12T02:42:52.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.342+0000 7ff3e2400640 1 -- 172.21.15.112:0/1929677787 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3dc0af290 con 0x7ff3dc06f600 2024-09-12T02:42:52.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.342+0000 7ff3e2400640 1 -- 172.21.15.112:0/1929677787 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3dc14f9e0 con 0x7ff3dc06f600 2024-09-12T02:42:52.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.343+0000 7ff3e2400640 1 -- 172.21.15.112:0/1929677787 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3dc068a30 con 0x7ff3dc06f600 2024-09-12T02:42:52.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.344+0000 7ff3d3400640 1 -- 172.21.15.112:0/1929677787 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff3cc007400 con 0x7ff3dc06f600 2024-09-12T02:42:52.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.345+0000 7ff3d3400640 1 --2- 172.21.15.112:0/1929677787 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff3bc06be30 0x7ff3bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:52.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.345+0000 7ff3d3400640 1 -- 172.21.15.112:0/1929677787 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff3cc08a340 con 0x7ff3dc06f600 2024-09-12T02:42:52.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.345+0000 7ff3daa00640 1 --2- 172.21.15.112:0/1929677787 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff3bc06be30 0x7ff3bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:52.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.346+0000 7ff3daa00640 1 --2- 172.21.15.112:0/1929677787 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff3bc06be30 0x7ff3bc06e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc15f430 tx=0x7ff3c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:52.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.349+0000 7ff3d3400640 1 -- 172.21.15.112:0/1929677787 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff3cc058ce0 con 0x7ff3dc06f600 2024-09-12T02:42:52.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.558+0000 7ff3e2400640 1 -- 172.21.15.112:0/1929677787 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3dc158a50 con 0x7ff3dc06f600 2024-09-12T02:42:52.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.559+0000 7ff3d3400640 1 -- 172.21.15.112:0/1929677787 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5232 (secure 0 0 0) 0x7ff3cc0585e0 con 0x7ff3dc06f600 2024-09-12T02:42:52.560 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:42:52.560 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":18,"btime":"2024-09-12T02:42:50:089881+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/2907398106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2907398106},{"type":"v1","addr":"172.21.15.112:6836","nonce":2907398106}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3325408635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3325408635},{"type":"v1","addr":"172.21.15.137:6835","nonce":3325408635}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4678,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3355910952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3355910952},{"type":"v1","addr":"172.21.15.137:6833","nonce":3355910952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:42:46.463211+0000","modified":"2024-09-12T02:42:49.497590+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4761},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4761":{"gid":4761,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.112:6837/917811402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":917811402},{"type":"v1","addr":"172.21.15.112:6837","nonce":917811402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4761,"qdb_cluster":[4761]},"id":2}]} 2024-09-12T02:42:52.561 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 18 2024-09-12T02:42:52.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.561+0000 7ff3e2400640 1 -- 172.21.15.112:0/1929677787 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff3bc06be30 msgr2=0x7ff3bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:52.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.561+0000 7ff3e2400640 1 --2- 172.21.15.112:0/1929677787 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff3bc06be30 0x7ff3bc06e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc15f430 tx=0x7ff3c8008040 comp rx=0 tx=0).stop 2024-09-12T02:42:52.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.561+0000 7ff3e2400640 1 -- 172.21.15.112:0/1929677787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3dc06f600 msgr2=0x7ff3dc0aff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:52.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.561+0000 7ff3e2400640 1 --2- 172.21.15.112:0/1929677787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3dc06f600 0x7ff3dc0aff80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00c3f0 tx=0x7ff3cc00c8b0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.561+0000 7ff3e2400640 1 -- 172.21.15.112:0/1929677787 shutdown_connections 2024-09-12T02:42:52.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.561+0000 7ff3e2400640 1 --2- 172.21.15.112:0/1929677787 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3dc15b9d0 0x7ff3dc14f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.561+0000 7ff3e2400640 1 --2- 172.21.15.112:0/1929677787 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff3bc06be30 0x7ff3bc06e2f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.561+0000 7ff3e2400640 1 --2- 172.21.15.112:0/1929677787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3dc0b45d0 0x7ff3dc0ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.561+0000 7ff3e2400640 1 --2- 172.21.15.112:0/1929677787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3dc06f600 0x7ff3dc0aff80 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:52.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.561+0000 7ff3e2400640 1 -- 172.21.15.112:0/1929677787 >> 172.21.15.112:0/1929677787 conn(0x7ff3dc06bbd0 msgr2=0x7ff3dc0cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:52.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.562+0000 7ff3e2400640 1 -- 172.21.15.112:0/1929677787 shutdown_connections 2024-09-12T02:42:52.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:52.562+0000 7ff3e2400640 1 -- 172.21.15.112:0/1929677787 wait complete. 2024-09-12T02:42:52.981 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:42:46.463211+0000', 'modified': '2024-09-12T02:42:49.497590+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4761}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4761': {'gid': 4761, 'name': 'c', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.112:6837/917811402', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6835', 'nonce': 917811402}, {'type': 'v1', 'addr': '172.21.15.112:6837', 'nonce': 917811402}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4761, 'qdb_cluster': [4761]} 2024-09-12T02:42:52.981 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:42:52.982 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-12T02:42:53.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.138+0000 7fbb62400640 1 Processor -- start 2024-09-12T02:42:53.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.138+0000 7fbb62400640 1 -- start start 2024-09-12T02:42:53.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.139+0000 7fbb62400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbb5c0d1710 0x7fbb5c0d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:53.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.139+0000 7fbb62400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbb5c0b3e00 0x7fbb5c0d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:53.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.139+0000 7fbb62400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb5c0d2fb0 con 0x7fbb5c0cf7a0 2024-09-12T02:42:53.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.139+0000 7fbb62400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fbb5c0d3cb0 con 0x7fbb5c0b3e00 2024-09-12T02:42:53.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.139+0000 7fbb62400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fbb5c0d0b60 con 0x7fbb5c0d1710 2024-09-12T02:42:53.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.139+0000 7fbb5be00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbb5c0b3e00 0x7fbb5c0d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:53.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.139+0000 7fbb5be00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbb5c0b3e00 0x7fbb5c0d1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35986/0 (socket says 172.21.15.112:35986) 2024-09-12T02:42:53.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.139+0000 7fbb5be00640 1 -- 172.21.15.112:0/749844102 learned_addr learned my addr 172.21.15.112:0/749844102 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:53.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.140+0000 7fbb61000640 1 --2- 172.21.15.112:0/749844102 >> v2:172.21.15.137:3300/0 conn(0x7fbb5c0d1710 0x7fbb5c0d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:53.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.140+0000 7fbb5be00640 1 -- 172.21.15.112:0/749844102 >> v2:172.21.15.137:3300/0 conn(0x7fbb5c0d1710 msgr2=0x7fbb5c0d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:53.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.140+0000 7fbb5be00640 1 --2- 172.21.15.112:0/749844102 >> v2:172.21.15.137:3300/0 conn(0x7fbb5c0d1710 0x7fbb5c0d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.140+0000 7fbb5be00640 1 -- 172.21.15.112:0/749844102 >> v1:172.21.15.137:6789/0 conn(0x7fbb5c0cf7a0 legacy=0x7fbb5c0cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:53.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.140+0000 7fbb5be00640 1 -- 172.21.15.112:0/749844102 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb5c0d2030 con 0x7fbb5c0b3e00 2024-09-12T02:42:53.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.141+0000 7fbb5be00640 1 --2- 172.21.15.112:0/749844102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb5c0b3e00 0x7fbb5c0d1af0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c08dd50 tx=0x7fbb4802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9713c582c9cc4c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:53.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.141+0000 7fbb5b400640 1 -- 172.21.15.112:0/749844102 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb48037070 con 0x7fbb5c0b3e00 2024-09-12T02:42:53.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.141+0000 7fbb5b400640 1 -- 172.21.15.112:0/749844102 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb48032440 con 0x7fbb5c0b3e00 2024-09-12T02:42:53.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.141+0000 7fbb5b400640 1 -- 172.21.15.112:0/749844102 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb48032810 con 0x7fbb5c0b3e00 2024-09-12T02:42:53.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.142+0000 7fbb62400640 1 -- 172.21.15.112:0/749844102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb5c0b3e00 msgr2=0x7fbb5c0d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:53.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.142+0000 7fbb62400640 1 --2- 172.21.15.112:0/749844102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb5c0b3e00 0x7fbb5c0d1af0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c08dd50 tx=0x7fbb4802a230 comp rx=0 tx=0).stop 2024-09-12T02:42:53.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.142+0000 7fbb62400640 1 -- 172.21.15.112:0/749844102 shutdown_connections 2024-09-12T02:42:53.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.142+0000 7fbb62400640 1 --2- 172.21.15.112:0/749844102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb5c0b3e00 0x7fbb5c0d1af0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.142+0000 7fbb62400640 1 --2- 172.21.15.112:0/749844102 >> v2:172.21.15.137:3300/0 conn(0x7fbb5c0d1710 0x7fbb5c0d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.142+0000 7fbb62400640 1 -- 172.21.15.112:0/749844102 >> 172.21.15.112:0/749844102 conn(0x7fbb5c09e030 msgr2=0x7fbb5c0d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:53.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.142+0000 7fbb62400640 1 -- 172.21.15.112:0/749844102 shutdown_connections 2024-09-12T02:42:53.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.142+0000 7fbb62400640 1 -- 172.21.15.112:0/749844102 wait complete. 2024-09-12T02:42:53.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.143+0000 7fbb62400640 1 Processor -- start 2024-09-12T02:42:53.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.144+0000 7fbb62400640 1 -- start start 2024-09-12T02:42:53.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.144+0000 7fbb62400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb5c0b3e00 0x7fbb5c0cb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:53.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.144+0000 7fbb62400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb5c0cf7a0 0x7fbb5c14eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:53.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.144+0000 7fbb62400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb5c0d1710 0x7fbb5c0ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:53.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.144+0000 7fbb62400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c0d39d0 con 0x7fbb5c0d1710 2024-09-12T02:42:53.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.144+0000 7fbb62400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c0d36f0 con 0x7fbb5c0cf7a0 2024-09-12T02:42:53.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.144+0000 7fbb62400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbb5c15f110 con 0x7fbb5c0b3e00 2024-09-12T02:42:53.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.145+0000 7fbb61a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb5c0d1710 0x7fbb5c0ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:53.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.145+0000 7fbb61a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb5c0d1710 0x7fbb5c0ca0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35994/0 (socket says 172.21.15.112:35994) 2024-09-12T02:42:53.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.145+0000 7fbb61000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb5c0b3e00 0x7fbb5c0cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:53.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.145+0000 7fbb61a00640 1 -- 172.21.15.112:0/3815100734 learned_addr learned my addr 172.21.15.112:0/3815100734 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:53.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.145+0000 7fbb5be00640 1 --2- 172.21.15.112:0/3815100734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb5c0cf7a0 0x7fbb5c14eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:53.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.145+0000 7fbb61a00640 1 -- 172.21.15.112:0/3815100734 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb5c0b3e00 msgr2=0x7fbb5c0cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:53.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.145+0000 7fbb61a00640 1 --2- 172.21.15.112:0/3815100734 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb5c0b3e00 0x7fbb5c0cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.145+0000 7fbb61a00640 1 -- 172.21.15.112:0/3815100734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb5c0cf7a0 msgr2=0x7fbb5c14eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:53.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.145+0000 7fbb61a00640 1 --2- 172.21.15.112:0/3815100734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb5c0cf7a0 0x7fbb5c14eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.145+0000 7fbb61a00640 1 -- 172.21.15.112:0/3815100734 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb5c0ca780 con 0x7fbb5c0d1710 2024-09-12T02:42:53.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.145+0000 7fbb61a00640 1 --2- 172.21.15.112:0/3815100734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb5c0d1710 0x7fbb5c0ca0a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbb5400c780 tx=0x7fbb5400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:53.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.146+0000 7fbb58c00640 1 -- 172.21.15.112:0/3815100734 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb54004b60 con 0x7fbb5c0d1710 2024-09-12T02:42:53.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.146+0000 7fbb58c00640 1 -- 172.21.15.112:0/3815100734 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb54004d00 con 0x7fbb5c0d1710 2024-09-12T02:42:53.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.146+0000 7fbb58c00640 1 -- 172.21.15.112:0/3815100734 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5400aa30 con 0x7fbb5c0d1710 2024-09-12T02:42:53.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.146+0000 7fbb62400640 1 -- 172.21.15.112:0/3815100734 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb5c0caa60 con 0x7fbb5c0d1710 2024-09-12T02:42:53.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.146+0000 7fbb62400640 1 -- 172.21.15.112:0/3815100734 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb5c0cb020 con 0x7fbb5c0d1710 2024-09-12T02:42:53.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.148+0000 7fbb58c00640 1 -- 172.21.15.112:0/3815100734 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb5400abd0 con 0x7fbb5c0d1710 2024-09-12T02:42:53.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.149+0000 7fbb58c00640 1 --2- 172.21.15.112:0/3815100734 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbb3c06be60 0x7fbb3c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:53.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.149+0000 7fbb58c00640 1 -- 172.21.15.112:0/3815100734 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fbb5408af00 con 0x7fbb5c0d1710 2024-09-12T02:42:53.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.149+0000 7fbb61000640 1 --2- 172.21.15.112:0/3815100734 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbb3c06be60 0x7fbb3c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:53.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.149+0000 7fbb667ed740 1 Processor -- start 2024-09-12T02:42:53.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.149+0000 7fbb667ed740 1 -- start start 2024-09-12T02:42:53.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.150+0000 7fbb61000640 1 --2- 172.21.15.112:0/3815100734 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbb3c06be60 0x7fbb3c06e320 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbb50006fd0 tx=0x7fbb50008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:53.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.150+0000 7fbb667ed740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5576ffb97ea0 0x5576ffbdd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:53.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.150+0000 7fbb667ed740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576ffb95660 0x5576ffb98280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:53.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.150+0000 7fbb667ed740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576ffb99630 0x5576ffb92720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:53.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.150+0000 7fbb667ed740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5576ffaf63b0 con 0x5576ffb99630 2024-09-12T02:42:53.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.150+0000 7fbb667ed740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5576ffafb410 con 0x5576ffb95660 2024-09-12T02:42:53.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.150+0000 7fbb667ed740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x5576ffaa3620 con 0x5576ffb97ea0 2024-09-12T02:42:53.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.151+0000 7fbb61a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576ffb99630 0x5576ffb92720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:53.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.151+0000 7fbb61a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576ffb99630 0x5576ffb92720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35998/0 (socket says 172.21.15.112:35998) 2024-09-12T02:42:53.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.151+0000 7fbb61a00640 1 -- 172.21.15.112:0/1394376198 learned_addr learned my addr 172.21.15.112:0/1394376198 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:53.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.151+0000 7fbb5be00640 1 --2- 172.21.15.112:0/1394376198 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576ffb95660 0x5576ffb98280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:53.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.151+0000 7fbb61000640 1 --2- 172.21.15.112:0/1394376198 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5576ffb97ea0 0x5576ffbdd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:53.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.151+0000 7fbb61a00640 1 -- 172.21.15.112:0/1394376198 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5576ffb97ea0 msgr2=0x5576ffbdd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:53.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.151+0000 7fbb61a00640 1 --2- 172.21.15.112:0/1394376198 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5576ffb97ea0 0x5576ffbdd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.151+0000 7fbb61a00640 1 -- 172.21.15.112:0/1394376198 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576ffb95660 msgr2=0x5576ffb98280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:53.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.151+0000 7fbb61a00640 1 --2- 172.21.15.112:0/1394376198 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576ffb95660 0x5576ffb98280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.151+0000 7fbb61a00640 1 -- 172.21.15.112:0/1394376198 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576ff80e2d0 con 0x5576ffb99630 2024-09-12T02:42:53.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.151+0000 7fbb61a00640 1 --2- 172.21.15.112:0/1394376198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576ffb99630 0x5576ffb92720 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbb54058ce0 tx=0x7fbb5400cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3922966836f7b19d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:53.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.151+0000 7fbb4d600640 1 -- 172.21.15.112:0/1394376198 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb54071030 con 0x5576ffb99630 2024-09-12T02:42:53.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.151+0000 7fbb4d600640 1 -- 172.21.15.112:0/1394376198 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb540711d0 con 0x5576ffb99630 2024-09-12T02:42:53.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.152+0000 7fbb4d600640 1 -- 172.21.15.112:0/1394376198 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb54061d80 con 0x5576ffb99630 2024-09-12T02:42:53.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.152+0000 7fbb667ed740 1 -- 172.21.15.112:0/1394376198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576ffb99630 msgr2=0x5576ffb92720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:53.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.152+0000 7fbb667ed740 1 --2- 172.21.15.112:0/1394376198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576ffb99630 0x5576ffb92720 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbb54058ce0 tx=0x7fbb5400cef0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.152+0000 7fbb667ed740 1 -- 172.21.15.112:0/1394376198 shutdown_connections 2024-09-12T02:42:53.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.152+0000 7fbb667ed740 1 --2- 172.21.15.112:0/1394376198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576ffb99630 0x5576ffb92720 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.152+0000 7fbb667ed740 1 --2- 172.21.15.112:0/1394376198 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576ffb95660 0x5576ffb98280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.152+0000 7fbb667ed740 1 --2- 172.21.15.112:0/1394376198 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5576ffb97ea0 0x5576ffbdd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.152+0000 7fbb667ed740 1 -- 172.21.15.112:0/1394376198 >> 172.21.15.112:0/1394376198 conn(0x5576ffb948f0 msgr2=0x5576ffbdcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:53.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.152+0000 7fbb667ed740 1 -- 172.21.15.112:0/1394376198 shutdown_connections 2024-09-12T02:42:53.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.152+0000 7fbb667ed740 1 -- 172.21.15.112:0/1394376198 wait complete. 2024-09-12T02:42:53.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.153+0000 7fbb667ed740 1 -- start start 2024-09-12T02:42:53.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.153+0000 7fbb667ed740 1 Processor -- start 2024-09-12T02:42:53.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.154+0000 7fbb667ed740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576ffb97ea0 0x5576ffbc12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:53.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.154+0000 7fbb667ed740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576ffb99630 0x5576ffbc30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:53.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.154+0000 7fbb667ed740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5576ffbc35f0 0x5576ffbaf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:53.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.154+0000 7fbb667ed740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5576ffab6780 con 0x5576ffb99630 2024-09-12T02:42:53.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.154+0000 7fbb667ed740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5576ffaf73d0 con 0x5576ffb97ea0 2024-09-12T02:42:53.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.154+0000 7fbb667ed740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x5576ffaf63b0 con 0x5576ffbc35f0 2024-09-12T02:42:53.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.154+0000 7fbb667ed740 10 client.0 _ll_register_callbacks cb 0x5576ffaf45d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:42:53.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.154+0000 7fbb5be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576ffb99630 0x5576ffbc30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:53.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.154+0000 7fbb5be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576ffb99630 0x5576ffbc30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36002/0 (socket says 172.21.15.112:36002) 2024-09-12T02:42:53.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.154+0000 7fbb5be00640 1 -- 172.21.15.112:0/84217657 learned_addr learned my addr 172.21.15.112:0/84217657 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:53.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.154+0000 7fbb61000640 1 --2- 172.21.15.112:0/84217657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576ffb97ea0 0x5576ffbc12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:53.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.154+0000 7fbb61a00640 1 --2- 172.21.15.112:0/84217657 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5576ffbc35f0 0x5576ffbaf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:53.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.155+0000 7fbb5be00640 1 -- 172.21.15.112:0/84217657 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5576ffbc35f0 msgr2=0x5576ffbaf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:53.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.155+0000 7fbb5be00640 1 --2- 172.21.15.112:0/84217657 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5576ffbc35f0 0x5576ffbaf1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.155+0000 7fbb5be00640 1 -- 172.21.15.112:0/84217657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576ffb97ea0 msgr2=0x5576ffbc12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:53.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.155+0000 7fbb5be00640 1 --2- 172.21.15.112:0/84217657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576ffb97ea0 0x5576ffbc12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.155+0000 7fbb5be00640 1 -- 172.21.15.112:0/84217657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576ff8d86b0 con 0x5576ffb99630 2024-09-12T02:42:53.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.155+0000 7fbb5be00640 1 --2- 172.21.15.112:0/84217657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576ffb99630 0x5576ffbc30b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbb480090b0 tx=0x7fbb48004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c228fa7b181919c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:53.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.155+0000 7fbb42000640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-12T02:42:53.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.155+0000 7fbb42000640 1 -- 172.21.15.112:0/84217657 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb48037040 con 0x5576ffb99630 2024-09-12T02:42:53.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.155+0000 7fbb42000640 1 -- 172.21.15.112:0/84217657 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fbb48047aa0 con 0x5576ffb99630 2024-09-12T02:42:53.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.155+0000 7fbb667ed740 1 -- 172.21.15.112:0/84217657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb540711d0 con 0x5576ffb99630 2024-09-12T02:42:53.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.156+0000 7fbb42000640 1 -- 172.21.15.112:0/84217657 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fbb48047ca0 con 0x5576ffb99630 2024-09-12T02:42:53.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.156+0000 7fbb667ed740 10 client.4926 fetch_fsmap learned FSMap version 18 2024-09-12T02:42:53.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.156+0000 7fbb667ed740 1 -- 172.21.15.112:0/84217657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5576ffbaa0a0 con 0x5576ffb99630 2024-09-12T02:42:53.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.156+0000 7fbb42000640 1 -- 172.21.15.112:0/84217657 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb540711d0 con 0x5576ffb99630 2024-09-12T02:42:53.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.156+0000 7fbb42000640 1 -- 172.21.15.112:0/84217657 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7fbb4804e050 con 0x5576ffb99630 2024-09-12T02:42:53.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.156+0000 7fbb667ed740 10 client.4926 fetch_fsmap finished waiting for FSMap version 18 2024-09-12T02:42:53.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.156+0000 7fbb667ed740 10 client.4926 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:42:53.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.156+0000 7fbb667ed740 20 client.4926 populate_metadata read hostname 'smithi112' 2024-09-12T02:42:53.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.156+0000 7fbb667ed740 1 --2- 172.21.15.112:0/84217657 >> [v2:172.21.15.112:6835/917811402,v1:172.21.15.112:6837/917811402] conn(0x5576ffba9170 0x5576ffbaacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:53.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.156+0000 7fbb667ed740 4 client.4926 mds_command: new command op to 4761 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:42:53.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.156+0000 7fbb667ed740 1 -- 172.21.15.112:0/84217657 --> [v2:172.21.15.112:6835/917811402,v1:172.21.15.112:6837/917811402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576ffb08b40 con 0x5576ffba9170 2024-09-12T02:42:53.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.156+0000 7fbb61000640 1 --2- 172.21.15.112:0/84217657 >> [v2:172.21.15.112:6835/917811402,v1:172.21.15.112:6837/917811402] conn(0x5576ffba9170 0x5576ffbaacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:53.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.157+0000 7fbb61000640 1 --2- 172.21.15.112:0/84217657 >> [v2:172.21.15.112:6835/917811402,v1:172.21.15.112:6837/917811402] conn(0x5576ffba9170 0x5576ffbaacf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60b4540abb2355f9 server_cookie=b71dffa1487f9a8 in_seq=0 out_seq=0 2024-09-12T02:42:53.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.157+0000 7fbb42000640 10 client.4926 ms_handle_connect on v2:172.21.15.112:6835/917811402 2024-09-12T02:42:53.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.158+0000 7fbb42000640 1 -- 172.21.15.112:0/84217657 <== mds.0 v2:172.21.15.112:6835/917811402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5576ffb08b40 con 0x5576ffba9170 2024-09-12T02:42:53.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.158+0000 7fbb42000640 10 client.4926 handle_command_reply: tid=0 2024-09-12T02:42:53.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.158+0000 7fbb667ed740 1 client.4926 shutdown 2024-09-12T02:42:53.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.158+0000 7fbb667ed740 1 -- 172.21.15.112:0/84217657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576ffb99630 msgr2=0x5576ffbc30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:53.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.158+0000 7fbb667ed740 1 --2- 172.21.15.112:0/84217657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576ffb99630 0x5576ffbc30b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbb480090b0 tx=0x7fbb48004730 comp rx=0 tx=0).stop 2024-09-12T02:42:53.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.158+0000 7fbb667ed740 1 -- 172.21.15.112:0/84217657 shutdown_connections 2024-09-12T02:42:53.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.158+0000 7fbb667ed740 1 --2- 172.21.15.112:0/84217657 >> [v2:172.21.15.112:6835/917811402,v1:172.21.15.112:6837/917811402] conn(0x5576ffba9170 0x5576ffbaacf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.158+0000 7fbb667ed740 1 --2- 172.21.15.112:0/84217657 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5576ffbc35f0 0x5576ffbaf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.158+0000 7fbb667ed740 1 --2- 172.21.15.112:0/84217657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576ffb99630 0x5576ffbc30b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.158+0000 7fbb667ed740 1 --2- 172.21.15.112:0/84217657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576ffb97ea0 0x5576ffbc12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.158+0000 7fbb42000640 0 client.4926 ms_handle_reset on v2:172.21.15.112:6835/917811402 2024-09-12T02:42:53.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.158+0000 7fbb667ed740 1 -- 172.21.15.112:0/84217657 >> 172.21.15.112:0/84217657 conn(0x5576ffb95660 msgr2=0x5576ffbdab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:53.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.158+0000 7fbb667ed740 1 -- 172.21.15.112:0/84217657 shutdown_connections 2024-09-12T02:42:53.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.158+0000 7fbb667ed740 1 -- 172.21.15.112:0/84217657 wait complete. 2024-09-12T02:42:53.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.158+0000 7fbb667ed740 20 client.4926 trim_cache size 0 max 16384 2024-09-12T02:42:53.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.177+0000 7fbb667ed740 1 Processor -- start 2024-09-12T02:42:53.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.178+0000 7fbb667ed740 1 -- start start 2024-09-12T02:42:53.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.178+0000 7fbb667ed740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576ffb97ea0 0x5576ffbdab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:53.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.178+0000 7fbb667ed740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5576ffb99630 0x5576ffbdb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:53.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.178+0000 7fbb667ed740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576ffbc35f0 0x5576ffbdca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:53.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.178+0000 7fbb667ed740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c0b99c0 con 0x5576ffbc35f0 2024-09-12T02:42:53.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.178+0000 7fbb667ed740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c0b8d20 con 0x5576ffb97ea0 2024-09-12T02:42:53.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.178+0000 7fbb667ed740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbb5c0b9370 con 0x5576ffb99630 2024-09-12T02:42:53.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.179+0000 7fbb61a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576ffbc35f0 0x5576ffbdca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:53.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.179+0000 7fbb61a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576ffbc35f0 0x5576ffbdca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36018/0 (socket says 172.21.15.112:36018) 2024-09-12T02:42:53.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.179+0000 7fbb61a00640 1 -- 172.21.15.112:0/2879314193 learned_addr learned my addr 172.21.15.112:0/2879314193 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:53.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.179+0000 7fbb61000640 1 --2- 172.21.15.112:0/2879314193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576ffb97ea0 0x5576ffbdab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:53.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.179+0000 7fbb5be00640 1 --2- 172.21.15.112:0/2879314193 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5576ffb99630 0x5576ffbdb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:53.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.179+0000 7fbb61a00640 1 -- 172.21.15.112:0/2879314193 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5576ffb99630 msgr2=0x5576ffbdb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:53.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.179+0000 7fbb61a00640 1 --2- 172.21.15.112:0/2879314193 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5576ffb99630 0x5576ffbdb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.179+0000 7fbb61a00640 1 -- 172.21.15.112:0/2879314193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576ffb97ea0 msgr2=0x5576ffbdab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:53.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.179+0000 7fbb61a00640 1 --2- 172.21.15.112:0/2879314193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576ffb97ea0 0x5576ffbdab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.179+0000 7fbb61a00640 1 -- 172.21.15.112:0/2879314193 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576ffaf7360 con 0x5576ffbc35f0 2024-09-12T02:42:53.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.179+0000 7fbb61a00640 1 --2- 172.21.15.112:0/2879314193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576ffbc35f0 0x5576ffbdca00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbb54059410 tx=0x7fbb5405d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a52464455bed0f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:53.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.180+0000 7fbb4cc00640 1 -- 172.21.15.112:0/2879314193 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb54061d80 con 0x5576ffbc35f0 2024-09-12T02:42:53.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.180+0000 7fbb4cc00640 1 -- 172.21.15.112:0/2879314193 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb540572f0 con 0x5576ffbc35f0 2024-09-12T02:42:53.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.180+0000 7fbb4cc00640 1 -- 172.21.15.112:0/2879314193 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb540558c0 con 0x5576ffbc35f0 2024-09-12T02:42:53.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.180+0000 7fbb667ed740 1 -- 172.21.15.112:0/2879314193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576ffbc35f0 msgr2=0x5576ffbdca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:53.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.180+0000 7fbb667ed740 1 --2- 172.21.15.112:0/2879314193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576ffbc35f0 0x5576ffbdca00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbb54059410 tx=0x7fbb5405d000 comp rx=0 tx=0).stop 2024-09-12T02:42:53.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.180+0000 7fbb667ed740 1 -- 172.21.15.112:0/2879314193 shutdown_connections 2024-09-12T02:42:53.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.180+0000 7fbb667ed740 1 --2- 172.21.15.112:0/2879314193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576ffbc35f0 0x5576ffbdca00 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.180+0000 7fbb667ed740 1 --2- 172.21.15.112:0/2879314193 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5576ffb99630 0x5576ffbdb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.180+0000 7fbb667ed740 1 --2- 172.21.15.112:0/2879314193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576ffb97ea0 0x5576ffbdab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.180+0000 7fbb667ed740 1 -- 172.21.15.112:0/2879314193 >> 172.21.15.112:0/2879314193 conn(0x5576ffb95660 msgr2=0x5576ffbaee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:53.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.180+0000 7fbb667ed740 1 -- 172.21.15.112:0/2879314193 shutdown_connections 2024-09-12T02:42:53.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.180+0000 7fbb667ed740 1 -- 172.21.15.112:0/2879314193 wait complete. 2024-09-12T02:42:53.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.181+0000 7fbb667ed740 1 -- start start 2024-09-12T02:42:53.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.181+0000 7fbb667ed740 1 Processor -- start 2024-09-12T02:42:53.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.182+0000 7fbb667ed740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576ffb97ea0 0x5576ffbeb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:53.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.182+0000 7fbb667ed740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5576ffb99630 0x5576ffbbb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:53.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.182+0000 7fbb667ed740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576ffbc35f0 0x5576ffc5b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:53.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.182+0000 7fbb667ed740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5576ffba8ff0 con 0x5576ffbc35f0 2024-09-12T02:42:53.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.182+0000 7fbb667ed740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5576ffbab6a0 con 0x5576ffb97ea0 2024-09-12T02:42:53.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.182+0000 7fbb667ed740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x5576ffba95e0 con 0x5576ffb99630 2024-09-12T02:42:53.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.182+0000 7fbb667ed740 10 client.0 _ll_register_callbacks cb 0x7fbb480096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:42:53.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.182+0000 7fbb61a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576ffbc35f0 0x5576ffc5b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:53.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.182+0000 7fbb61a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576ffbc35f0 0x5576ffc5b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36022/0 (socket says 172.21.15.112:36022) 2024-09-12T02:42:53.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.182+0000 7fbb61a00640 1 -- 172.21.15.112:0/457972011 learned_addr learned my addr 172.21.15.112:0/457972011 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:53.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.183+0000 7fbb61000640 1 --2- 172.21.15.112:0/457972011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576ffb97ea0 0x5576ffbeb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:53.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.183+0000 7fbb5be00640 1 --2- 172.21.15.112:0/457972011 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5576ffb99630 0x5576ffbbb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:53.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.183+0000 7fbb61a00640 1 -- 172.21.15.112:0/457972011 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5576ffb99630 msgr2=0x5576ffbbb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:53.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.183+0000 7fbb61a00640 1 --2- 172.21.15.112:0/457972011 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5576ffb99630 0x5576ffbbb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.183+0000 7fbb61a00640 1 -- 172.21.15.112:0/457972011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576ffb97ea0 msgr2=0x5576ffbeb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:53.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.183+0000 7fbb61a00640 1 --2- 172.21.15.112:0/457972011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576ffb97ea0 0x5576ffbeb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.183+0000 7fbb61a00640 1 -- 172.21.15.112:0/457972011 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576ffbdbf30 con 0x5576ffbc35f0 2024-09-12T02:42:53.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.183+0000 7fbb61a00640 1 --2- 172.21.15.112:0/457972011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576ffbc35f0 0x5576ffc5b350 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbb540555f0 tx=0x7fbb54011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6583b23dbc74ca3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:53.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.183+0000 7fbb42000640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-12T02:42:53.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.183+0000 7fbb42000640 1 -- 172.21.15.112:0/457972011 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5405d150 con 0x5576ffbc35f0 2024-09-12T02:42:53.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.183+0000 7fbb42000640 1 -- 172.21.15.112:0/457972011 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fbb5405d2f0 con 0x5576ffbc35f0 2024-09-12T02:42:53.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.183+0000 7fbb667ed740 1 -- 172.21.15.112:0/457972011 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb540572f0 con 0x5576ffbc35f0 2024-09-12T02:42:53.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.184+0000 7fbb42000640 1 -- 172.21.15.112:0/457972011 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fbb540618f0 con 0x5576ffbc35f0 2024-09-12T02:42:53.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.184+0000 7fbb667ed740 10 client.4932 fetch_fsmap learned FSMap version 18 2024-09-12T02:42:53.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.184+0000 7fbb667ed740 1 -- 172.21.15.112:0/457972011 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5576ffbeb9d0 con 0x5576ffbc35f0 2024-09-12T02:42:53.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.184+0000 7fbb42000640 1 -- 172.21.15.112:0/457972011 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb540572f0 con 0x5576ffbc35f0 2024-09-12T02:42:53.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.184+0000 7fbb42000640 1 -- 172.21.15.112:0/457972011 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7fbb54006b50 con 0x5576ffbc35f0 2024-09-12T02:42:53.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.184+0000 7fbb667ed740 10 client.4932 fetch_fsmap finished waiting for FSMap version 18 2024-09-12T02:42:53.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.184+0000 7fbb667ed740 10 client.4932 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:42:53.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.184+0000 7fbb667ed740 20 client.4932 populate_metadata read hostname 'smithi112' 2024-09-12T02:42:53.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.184+0000 7fbb667ed740 1 --2- 172.21.15.112:0/457972011 >> [v2:172.21.15.112:6835/917811402,v1:172.21.15.112:6837/917811402] conn(0x5576ffbdab90 0x5576ffbdaf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:53.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.184+0000 7fbb667ed740 4 client.4932 mds_command: new command op to 4761 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:42:53.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.184+0000 7fbb667ed740 1 -- 172.21.15.112:0/457972011 --> [v2:172.21.15.112:6835/917811402,v1:172.21.15.112:6837/917811402] -- command(tid 0: {"prefix": "status"}) -- 0x5576ffb02e90 con 0x5576ffbdab90 2024-09-12T02:42:53.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.184+0000 7fbb61000640 1 --2- 172.21.15.112:0/457972011 >> [v2:172.21.15.112:6835/917811402,v1:172.21.15.112:6837/917811402] conn(0x5576ffbdab90 0x5576ffbdaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:53.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.185+0000 7fbb42000640 10 client.4932 ms_handle_connect on v2:172.21.15.112:6835/917811402 2024-09-12T02:42:53.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.185+0000 7fbb61000640 1 --2- 172.21.15.112:0/457972011 >> [v2:172.21.15.112:6835/917811402,v1:172.21.15.112:6837/917811402] conn(0x5576ffbdab90 0x5576ffbdaf70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52a844e9ffe90506 server_cookie=65fb3faf0c38a670 in_seq=0 out_seq=0 2024-09-12T02:42:53.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.185+0000 7fbb42000640 1 -- 172.21.15.112:0/457972011 <== mds.0 v2:172.21.15.112:6835/917811402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5576ffb02e90 con 0x5576ffbdab90 2024-09-12T02:42:53.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.185+0000 7fbb42000640 10 client.4932 handle_command_reply: tid=0 2024-09-12T02:42:53.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.185+0000 7fbb667ed740 1 client.4932 shutdown 2024-09-12T02:42:53.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.185+0000 7fbb667ed740 1 -- 172.21.15.112:0/457972011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576ffbc35f0 msgr2=0x5576ffc5b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:53.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.185+0000 7fbb667ed740 1 --2- 172.21.15.112:0/457972011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576ffbc35f0 0x5576ffc5b350 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbb540555f0 tx=0x7fbb54011000 comp rx=0 tx=0).stop 2024-09-12T02:42:53.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.185+0000 7fbb667ed740 1 -- 172.21.15.112:0/457972011 shutdown_connections 2024-09-12T02:42:53.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.185+0000 7fbb667ed740 1 --2- 172.21.15.112:0/457972011 >> [v2:172.21.15.112:6835/917811402,v1:172.21.15.112:6837/917811402] conn(0x5576ffbdab90 0x5576ffbdaf70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.185+0000 7fbb667ed740 1 --2- 172.21.15.112:0/457972011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5576ffbc35f0 0x5576ffc5b350 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.185+0000 7fbb667ed740 1 --2- 172.21.15.112:0/457972011 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5576ffb99630 0x5576ffbbb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.185+0000 7fbb667ed740 1 --2- 172.21.15.112:0/457972011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576ffb97ea0 0x5576ffbeb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.185+0000 7fbb42000640 0 client.4932 ms_handle_reset on v2:172.21.15.112:6835/917811402 2024-09-12T02:42:53.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.185+0000 7fbb667ed740 1 -- 172.21.15.112:0/457972011 >> 172.21.15.112:0/457972011 conn(0x5576ffb95660 msgr2=0x5576ffbaac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:53.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.185+0000 7fbb667ed740 1 -- 172.21.15.112:0/457972011 shutdown_connections 2024-09-12T02:42:53.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.185+0000 7fbb667ed740 1 -- 172.21.15.112:0/457972011 wait complete. 2024-09-12T02:42:53.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.185+0000 7fbb667ed740 20 client.4932 trim_cache size 0 max 16384 2024-09-12T02:42:53.192 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:42:53.192 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:42:53.192 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2024-09-12T02:42:53.192 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 4761, 2024-09-12T02:42:53.192 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2024-09-12T02:42:53.192 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2024-09-12T02:42:53.192 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2024-09-12T02:42:53.192 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 6.1214104899999997, 2024-09-12T02:42:53.192 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 18, 2024-09-12T02:42:53.192 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 32, 2024-09-12T02:42:53.192 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 32, 2024-09-12T02:42:53.193 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 19.721304997000001 2024-09-12T02:42:53.193 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:42:53.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.186+0000 7fbb62400640 1 -- 172.21.15.112:0/3815100734 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbb3c06be60 msgr2=0x7fbb3c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:53.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.186+0000 7fbb62400640 1 --2- 172.21.15.112:0/3815100734 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbb3c06be60 0x7fbb3c06e320 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbb50006fd0 tx=0x7fbb50008040 comp rx=0 tx=0).stop 2024-09-12T02:42:53.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.186+0000 7fbb62400640 1 -- 172.21.15.112:0/3815100734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb5c0d1710 msgr2=0x7fbb5c0ca0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:53.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.186+0000 7fbb62400640 1 --2- 172.21.15.112:0/3815100734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb5c0d1710 0x7fbb5c0ca0a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbb5400c780 tx=0x7fbb5400cc40 comp rx=0 tx=0).stop 2024-09-12T02:42:53.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.186+0000 7fbb62400640 1 -- 172.21.15.112:0/3815100734 shutdown_connections 2024-09-12T02:42:53.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.186+0000 7fbb62400640 1 --2- 172.21.15.112:0/3815100734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb5c0d1710 0x7fbb5c0ca0a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.186+0000 7fbb62400640 1 --2- 172.21.15.112:0/3815100734 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbb3c06be60 0x7fbb3c06e320 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.186+0000 7fbb62400640 1 --2- 172.21.15.112:0/3815100734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb5c0cf7a0 0x7fbb5c14eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.186+0000 7fbb62400640 1 --2- 172.21.15.112:0/3815100734 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb5c0b3e00 0x7fbb5c0cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.186+0000 7fbb62400640 1 -- 172.21.15.112:0/3815100734 >> 172.21.15.112:0/3815100734 conn(0x7fbb5c09e030 msgr2=0x7fbb5c0b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:53.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.186+0000 7fbb62400640 1 -- 172.21.15.112:0/3815100734 shutdown_connections 2024-09-12T02:42:53.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.186+0000 7fbb62400640 1 -- 172.21.15.112:0/3815100734 wait complete. 2024-09-12T02:42:53.203 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:42:53.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.354+0000 7f7404000640 1 Processor -- start 2024-09-12T02:42:53.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.354+0000 7f7404000640 1 -- start start 2024-09-12T02:42:53.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.356+0000 7f7404000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73fc0b4ec0 0x7f73fc0b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:53.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.356+0000 7f7404000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73fc0b54a0 con 0x7f73fc06f600 2024-09-12T02:42:53.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.356+0000 7f7404000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73fc0b3af0 con 0x7f73fc15b9d0 2024-09-12T02:42:53.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.356+0000 7f7404000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f73fc0b3dd0 con 0x7f73fc0b4ec0 2024-09-12T02:42:53.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.356+0000 7f7400c00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f73fc06f600 0x7f73fc0cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:54800/0 (socket says 172.21.15.112:54800) 2024-09-12T02:42:53.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.356+0000 7f7400c00640 1 -- 172.21.15.112:0/303699839 learned_addr learned my addr 172.21.15.112:0/303699839 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:53.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.356+0000 7f73fbe00640 1 -- 172.21.15.112:0/303699839 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 947811869 0 0) 0x7f73fc0b54a0 con 0x7f73fc06f600 2024-09-12T02:42:53.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.356+0000 7f7402000640 1 --2- 172.21.15.112:0/303699839 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73fc0b4ec0 0x7f73fc0b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:53.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.356+0000 7f73fbe00640 1 -- 172.21.15.112:0/303699839 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73e4003520 con 0x7f73fc06f600 2024-09-12T02:42:53.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.357+0000 7f73fbe00640 1 -- 172.21.15.112:0/303699839 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3623935414 0 0) 0x7f73e4003520 con 0x7f73fc06f600 2024-09-12T02:42:53.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.357+0000 7f73fbe00640 1 -- 172.21.15.112:0/303699839 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73fc0b4ec0 msgr2=0x7f73fc0b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:53.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.357+0000 7f73fbe00640 1 --2- 172.21.15.112:0/303699839 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73fc0b4ec0 0x7f73fc0b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.357+0000 7f73fbe00640 1 -- 172.21.15.112:0/303699839 >> v1:172.21.15.137:6789/0 conn(0x7f73fc15b9d0 legacy=0x7f73fc06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:53.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.357+0000 7f73fbe00640 1 -- 172.21.15.112:0/303699839 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73fc0b40b0 con 0x7f73fc06f600 2024-09-12T02:42:53.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.357+0000 7f73fbe00640 1 -- 172.21.15.112:0/303699839 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f73e80017f0 con 0x7f73fc06f600 2024-09-12T02:42:53.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.357+0000 7f73fbe00640 1 -- 172.21.15.112:0/303699839 >> v1:172.21.15.112:6789/0 conn(0x7f73fc06f600 legacy=0x7f73fc0cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:53.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.357+0000 7f73fbe00640 1 --2- 172.21.15.112:0/303699839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73e40039e0 0x7f73e4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:53.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.357+0000 7f73fbe00640 1 --2- 172.21.15.112:0/303699839 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73e4004800 0x7f73e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:53.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.357+0000 7f73fbe00640 1 --2- 172.21.15.112:0/303699839 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73fc0b4ec0 0x7f73e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:53.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.357+0000 7f73fbe00640 1 -- 172.21.15.112:0/303699839 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc0b3dd0 con 0x7f73e40039e0 2024-09-12T02:42:53.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.357+0000 7f73fbe00640 1 -- 172.21.15.112:0/303699839 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f73e400dc80 con 0x7f73e4004800 2024-09-12T02:42:53.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.357+0000 7f73fbe00640 1 -- 172.21.15.112:0/303699839 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f73e400de80 con 0x7f73fc0b4ec0 2024-09-12T02:42:53.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.357+0000 7f7401600640 1 --2- 172.21.15.112:0/303699839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73e40039e0 0x7f73e4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:53.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.357+0000 7f7402000640 1 --2- 172.21.15.112:0/303699839 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73fc0b4ec0 0x7f73e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:53.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.357+0000 7f7400c00640 1 --2- 172.21.15.112:0/303699839 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73e4004800 0x7f73e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:53.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.357+0000 7f7401600640 1 -- 172.21.15.112:0/303699839 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73fc0b4ec0 msgr2=0x7f73e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:53.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.357+0000 7f7401600640 1 --2- 172.21.15.112:0/303699839 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73fc0b4ec0 0x7f73e40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.357+0000 7f7401600640 1 -- 172.21.15.112:0/303699839 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73e4004800 msgr2=0x7f73e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:53.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.357+0000 7f7401600640 1 --2- 172.21.15.112:0/303699839 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73e4004800 0x7f73e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.357+0000 7f7401600640 1 -- 172.21.15.112:0/303699839 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73e4003520 con 0x7f73e40039e0 2024-09-12T02:42:53.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.358+0000 7f7401600640 1 --2- 172.21.15.112:0/303699839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73e40039e0 0x7f73e4003e00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f73f0001720 tx=0x7f73e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8764dd204051a1ac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:53.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.359+0000 7f73fbe00640 1 -- 172.21.15.112:0/303699839 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f0001370 con 0x7f73e40039e0 2024-09-12T02:42:53.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.359+0000 7f73fbe00640 1 -- 172.21.15.112:0/303699839 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73f00052d0 con 0x7f73e40039e0 2024-09-12T02:42:53.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.359+0000 7f73fbe00640 1 -- 172.21.15.112:0/303699839 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f002ab90 con 0x7f73e40039e0 2024-09-12T02:42:53.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.359+0000 7f7404000640 1 -- 172.21.15.112:0/303699839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73e40039e0 msgr2=0x7f73e4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:53.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.359+0000 7f7404000640 1 --2- 172.21.15.112:0/303699839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73e40039e0 0x7f73e4003e00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f73f0001720 tx=0x7f73e4005830 comp rx=0 tx=0).stop 2024-09-12T02:42:53.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.359+0000 7f7402000640 1 -- 172.21.15.112:0/303699839 reap_dead start 2024-09-12T02:42:53.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.359+0000 7f7404000640 1 -- 172.21.15.112:0/303699839 shutdown_connections 2024-09-12T02:42:53.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.359+0000 7f7404000640 1 -- 172.21.15.112:0/303699839 >> 172.21.15.112:0/303699839 conn(0x7f73fc06bbd0 msgr2=0x7f73fc06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:53.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.359+0000 7f7404000640 1 -- 172.21.15.112:0/303699839 shutdown_connections 2024-09-12T02:42:53.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.359+0000 7f7404000640 1 -- 172.21.15.112:0/303699839 wait complete. 2024-09-12T02:42:53.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.361+0000 7f7404000640 1 Processor -- start 2024-09-12T02:42:53.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.361+0000 7f7404000640 1 -- start start 2024-09-12T02:42:53.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.362+0000 7f7404000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73e40039e0 0x7f73fc14f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:53.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.362+0000 7f7404000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73fc1516c0 0x7f73fc0cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:53.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.362+0000 7f7404000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73fc151b40 0x7f73fc0ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:53.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.362+0000 7f7404000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc0b4750 con 0x7f73fc1516c0 2024-09-12T02:42:53.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.362+0000 7f7404000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc0b45d0 con 0x7f73fc151b40 2024-09-12T02:42:53.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.362+0000 7f7404000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f73fc0b48d0 con 0x7f73e40039e0 2024-09-12T02:42:53.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.362+0000 7f7400c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73fc1516c0 0x7f73fc0cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:53.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.362+0000 7f7400c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73fc1516c0 0x7f73fc0cdc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36030/0 (socket says 172.21.15.112:36030) 2024-09-12T02:42:53.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.362+0000 7f7400c00640 1 -- 172.21.15.112:0/2500836589 learned_addr learned my addr 172.21.15.112:0/2500836589 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:53.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.362+0000 7f7401600640 1 --2- 172.21.15.112:0/2500836589 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73e40039e0 0x7f73fc14f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:53.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.362+0000 7f7402000640 1 --2- 172.21.15.112:0/2500836589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73fc151b40 0x7f73fc0ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:53.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.363+0000 7f7400c00640 1 -- 172.21.15.112:0/2500836589 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73e40039e0 msgr2=0x7f73fc14f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:53.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.363+0000 7f7400c00640 1 --2- 172.21.15.112:0/2500836589 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73e40039e0 0x7f73fc14f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.363+0000 7f7400c00640 1 -- 172.21.15.112:0/2500836589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73fc151b40 msgr2=0x7f73fc0ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:53.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.363+0000 7f7400c00640 1 --2- 172.21.15.112:0/2500836589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73fc151b40 0x7f73fc0ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.363+0000 7f7400c00640 1 -- 172.21.15.112:0/2500836589 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73fc1f6310 con 0x7f73fc1516c0 2024-09-12T02:42:53.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.363+0000 7f7402000640 1 --2- 172.21.15.112:0/2500836589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73fc151b40 0x7f73fc0ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:53.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.363+0000 7f7400c00640 1 --2- 172.21.15.112:0/2500836589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73fc1516c0 0x7f73fc0cdc90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f73e800e5d0 tx=0x7f73e800ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:53.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.363+0000 7f73f9600640 1 -- 172.21.15.112:0/2500836589 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e80072e0 con 0x7f73fc1516c0 2024-09-12T02:42:53.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.363+0000 7f73f9600640 1 -- 172.21.15.112:0/2500836589 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73e8018070 con 0x7f73fc1516c0 2024-09-12T02:42:53.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.363+0000 7f7404000640 1 -- 172.21.15.112:0/2500836589 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73fc15c330 con 0x7f73fc1516c0 2024-09-12T02:42:53.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.363+0000 7f73f9600640 1 -- 172.21.15.112:0/2500836589 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e80057a0 con 0x7f73fc1516c0 2024-09-12T02:42:53.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.363+0000 7f7404000640 1 -- 172.21.15.112:0/2500836589 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73fc1f5590 con 0x7f73fc1516c0 2024-09-12T02:42:53.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.364+0000 7f7404000640 1 -- 172.21.15.112:0/2500836589 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73fc068a30 con 0x7f73fc1516c0 2024-09-12T02:42:53.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.365+0000 7f73f9600640 1 -- 172.21.15.112:0/2500836589 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f73e8005940 con 0x7f73fc1516c0 2024-09-12T02:42:53.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.366+0000 7f73f9600640 1 --2- 172.21.15.112:0/2500836589 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f73dc06be30 0x7f73dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:53.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.366+0000 7f73f9600640 1 -- 172.21.15.112:0/2500836589 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f73e808aaf0 con 0x7f73fc1516c0 2024-09-12T02:42:53.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.366+0000 7f7401600640 1 --2- 172.21.15.112:0/2500836589 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f73dc06be30 0x7f73dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:53.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.367+0000 7f7401600640 1 --2- 172.21.15.112:0/2500836589 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f73dc06be30 0x7f73dc06e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f73f0032000 tx=0x7f73f002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:53.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.370+0000 7f73f9600640 1 -- 172.21.15.112:0/2500836589 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f73e80594a0 con 0x7f73fc1516c0 2024-09-12T02:42:53.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.576+0000 7f7404000640 1 -- 172.21.15.112:0/2500836589 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f73fc0728c0 con 0x7f73fc1516c0 2024-09-12T02:42:53.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.576+0000 7f73f9600640 1 -- 172.21.15.112:0/2500836589 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7f73e8058da0 con 0x7f73fc1516c0 2024-09-12T02:42:53.577 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:42:53.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.578+0000 7f7404000640 1 -- 172.21.15.112:0/2500836589 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f73dc06be30 msgr2=0x7f73dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:53.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.578+0000 7f7404000640 1 --2- 172.21.15.112:0/2500836589 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f73dc06be30 0x7f73dc06e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f73f0032000 tx=0x7f73f002e000 comp rx=0 tx=0).stop 2024-09-12T02:42:53.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.578+0000 7f7404000640 1 -- 172.21.15.112:0/2500836589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73fc1516c0 msgr2=0x7f73fc0cdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:53.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.578+0000 7f7404000640 1 --2- 172.21.15.112:0/2500836589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73fc1516c0 0x7f73fc0cdc90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f73e800e5d0 tx=0x7f73e800ea90 comp rx=0 tx=0).stop 2024-09-12T02:42:53.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.578+0000 7f7404000640 1 -- 172.21.15.112:0/2500836589 shutdown_connections 2024-09-12T02:42:53.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.578+0000 7f7404000640 1 --2- 172.21.15.112:0/2500836589 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f73dc06be30 0x7f73dc06e2f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.578+0000 7f7404000640 1 --2- 172.21.15.112:0/2500836589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73fc151b40 0x7f73fc0ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.578+0000 7f7404000640 1 --2- 172.21.15.112:0/2500836589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73fc1516c0 0x7f73fc0cdc90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.578+0000 7f7404000640 1 --2- 172.21.15.112:0/2500836589 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73e40039e0 0x7f73fc14f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:53.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.578+0000 7f7404000640 1 -- 172.21.15.112:0/2500836589 >> 172.21.15.112:0/2500836589 conn(0x7f73fc06bbd0 msgr2=0x7f73fc0d13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:53.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.579+0000 7f7404000640 1 -- 172.21.15.112:0/2500836589 shutdown_connections 2024-09-12T02:42:53.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53.579+0000 7f7404000640 1 -- 172.21.15.112:0/2500836589 wait complete. 2024-09-12T02:42:53.595 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:42:53.595 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:42:53.596 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-09-12T02:42:53.596 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:42:53.596 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:42:53.596 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:42:53.596 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:42:53.596 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:42:53.596 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:42:53.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:53.596 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-09-12T02:42:53.632 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:42:53.632 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:42:53.632 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:42:53.632 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:53.632 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-12T02:42:53.632 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:53.632 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:42:53.632 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-09-12T02:42:53.633 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-09-12T02:42:53.633 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:42:53.633 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-09-12T02:42:53.633 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-09-12T02:42:53.633 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:42:53.633 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:42:53.633 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:42:53.633 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:42:53.633 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:42:53.633 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42705sec preferred_lft 42705sec 2024-09-12T02:42:53.633 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link noprefixroute 2024-09-12T02:42:53.633 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:53.633 INFO:teuthology.orchestra.run.smithi112.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:42:53.634 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 4e:56:d4:fc:33:ba brd ff:ff:ff:ff:ff:ff 2024-09-12T02:42:53.634 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:42:53.634 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:53.634 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::787f:67ff:fe10:c915/64 scope link 2024-09-12T02:42:53.634 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:53.634 INFO:teuthology.orchestra.run.smithi112.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:42:53.634 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 4e:56:d4:fc:33:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:42:53.634 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::4c56:d4ff:fefc:33ba/64 scope link 2024-09-12T02:42:53.634 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:53.635 INFO:teuthology.orchestra.run.smithi112.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:42:53.635 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 86:ed:0e:b6:37:5f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:42:53.635 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::84ed:eff:feb6:375f/64 scope link 2024-09-12T02:42:53.635 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:53.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:53.635 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:42:53.726 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-12T02:42:53.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:53.729 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-09-12T02:42:53.765 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-09-12T02:42:53.765 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:42:53.765 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:42:53.765 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:42:53.765 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:42:53.766 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:42:53.766 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-12T02:42:53.766 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:42:53.766 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:42:53.766 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:42:53.766 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-12T02:42:53.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:42:53.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:53.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:53.961 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-12T02:42:53.996 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:42:53.996 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:42:53.997 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:42:53.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:53.997 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2024-09-12T02:42:54.095 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:42:54.095 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:42:54.129 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:42:54.130 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:42:54.130 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:42:54.205 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T02:42:54.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:54.205 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:42:54.333 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:42:54.333 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:42:54.360 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:42:54.360 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:42:54.360 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-09-12T02:42:54.360 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 0@7c01f3b3-dec2-4449-a33f-f960d7527ea6.cephfs=/ 2024-09-12T02:42:54.360 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.112:3300/172.21.15.137:3300/172.21.15.137:3301" will pass to kernel 2024-09-12T02:42:54.361 INFO:teuthology.orchestra.run.smithi112.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:42:54.361 INFO:teuthology.orchestra.run.smithi112.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:42:54.361 INFO:teuthology.orchestra.run.smithi112.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:42:54.361 INFO:teuthology.orchestra.run.smithi112.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:42:54.361 INFO:teuthology.orchestra.run.smithi112.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:42:54.364 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:42:54.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:54.365 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:42:54.421 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:42:54.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:42:54.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:54.518 INFO:teuthology.orchestra.run.smithi112.stdout:client4634 2024-09-12T02:42:54.518 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:42:54.518 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:42:54.553 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:42:54.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.748+0000 7ff940a00640 1 Processor -- start 2024-09-12T02:42:54.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.748+0000 7ff940a00640 1 -- start start 2024-09-12T02:42:54.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.749+0000 7ff940a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff93c15a450 0x7ff93c06e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:54.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.749+0000 7ff940a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff93c0d0f30 0x7ff93c072900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:54.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.749+0000 7ff940a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff93c06e990 con 0x7ff93c0ce460 2024-09-12T02:42:54.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.749+0000 7ff940a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff93c071eb0 con 0x7ff93c0d0f30 2024-09-12T02:42:54.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.749+0000 7ff940a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff93c06ec70 con 0x7ff93c15a450 2024-09-12T02:42:54.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.749+0000 7ff93be00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff93c0d0f30 0x7ff93c072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:54.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.749+0000 7ff93be00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff93c0d0f30 0x7ff93c072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36032/0 (socket says 172.21.15.112:36032) 2024-09-12T02:42:54.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.749+0000 7ff93be00640 1 -- 172.21.15.112:0/3955019389 learned_addr learned my addr 172.21.15.112:0/3955019389 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:54.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.750+0000 7ff93be00640 1 -- 172.21.15.112:0/3955019389 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff93c15a450 msgr2=0x7ff93c06e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:54.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.750+0000 7ff93be00640 1 --2- 172.21.15.112:0/3955019389 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff93c15a450 0x7ff93c06e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:54.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.750+0000 7ff93be00640 1 -- 172.21.15.112:0/3955019389 >> v1:172.21.15.137:6789/0 conn(0x7ff93c0ce460 legacy=0x7ff93c0d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:54.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.750+0000 7ff93be00640 1 -- 172.21.15.112:0/3955019389 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff93c072100 con 0x7ff93c0d0f30 2024-09-12T02:42:54.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.751+0000 7ff93be00640 1 --2- 172.21.15.112:0/3955019389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff93c0d0f30 0x7ff93c072900 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff934009e50 tx=0x7ff93402a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75df1ba03da2df0c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:54.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.751+0000 7ff93a000640 1 -- 172.21.15.112:0/3955019389 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff934036070 con 0x7ff93c0d0f30 2024-09-12T02:42:54.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.751+0000 7ff93a000640 1 -- 172.21.15.112:0/3955019389 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff934031600 con 0x7ff93c0d0f30 2024-09-12T02:42:54.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.751+0000 7ff93a000640 1 -- 172.21.15.112:0/3955019389 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9340319d0 con 0x7ff93c0d0f30 2024-09-12T02:42:54.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.751+0000 7ff940a00640 1 -- 172.21.15.112:0/3955019389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff93c0d0f30 msgr2=0x7ff93c072900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:54.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.751+0000 7ff940a00640 1 --2- 172.21.15.112:0/3955019389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff93c0d0f30 0x7ff93c072900 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff934009e50 tx=0x7ff93402a750 comp rx=0 tx=0).stop 2024-09-12T02:42:54.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.752+0000 7ff940a00640 1 -- 172.21.15.112:0/3955019389 shutdown_connections 2024-09-12T02:42:54.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.752+0000 7ff940a00640 1 --2- 172.21.15.112:0/3955019389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff93c0d0f30 0x7ff93c072900 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:54.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.752+0000 7ff940a00640 1 --2- 172.21.15.112:0/3955019389 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff93c15a450 0x7ff93c06e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:54.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.752+0000 7ff940a00640 1 -- 172.21.15.112:0/3955019389 >> 172.21.15.112:0/3955019389 conn(0x7ff93c06bbd0 msgr2=0x7ff93c06bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:54.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.752+0000 7ff940a00640 1 -- 172.21.15.112:0/3955019389 shutdown_connections 2024-09-12T02:42:54.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.752+0000 7ff940a00640 1 -- 172.21.15.112:0/3955019389 wait complete. 2024-09-12T02:42:54.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.753+0000 7ff940a00640 1 Processor -- start 2024-09-12T02:42:54.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.753+0000 7ff940a00640 1 -- start start 2024-09-12T02:42:54.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.754+0000 7ff940a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff93c0ce460 0x7ff93c15bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:54.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.754+0000 7ff940a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff93c0d0f30 0x7ff93c0cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:54.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.754+0000 7ff940a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff93c15a450 0x7ff93c14e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:54.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.754+0000 7ff940a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff93c15a830 con 0x7ff93c0d0f30 2024-09-12T02:42:54.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.754+0000 7ff940a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff93c06e680 con 0x7ff93c0ce460 2024-09-12T02:42:54.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.754+0000 7ff940a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff93c15db60 con 0x7ff93c15a450 2024-09-12T02:42:54.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.754+0000 7ff93aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff93c0d0f30 0x7ff93c0cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:54.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.755+0000 7ff93aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff93c0d0f30 0x7ff93c0cd4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36038/0 (socket says 172.21.15.112:36038) 2024-09-12T02:42:54.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.755+0000 7ff93aa00640 1 -- 172.21.15.112:0/2961097827 learned_addr learned my addr 172.21.15.112:0/2961097827 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:54.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.755+0000 7ff93b400640 1 --2- 172.21.15.112:0/2961097827 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff93c0ce460 0x7ff93c15bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:54.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.755+0000 7ff93be00640 1 --2- 172.21.15.112:0/2961097827 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff93c15a450 0x7ff93c14e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:54.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.755+0000 7ff93aa00640 1 -- 172.21.15.112:0/2961097827 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff93c15a450 msgr2=0x7ff93c14e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:54.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.755+0000 7ff93aa00640 1 --2- 172.21.15.112:0/2961097827 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff93c15a450 0x7ff93c14e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:54.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.755+0000 7ff93aa00640 1 -- 172.21.15.112:0/2961097827 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff93c0ce460 msgr2=0x7ff93c15bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:54.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.755+0000 7ff93aa00640 1 --2- 172.21.15.112:0/2961097827 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff93c0ce460 0x7ff93c15bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:54.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.755+0000 7ff93aa00640 1 -- 172.21.15.112:0/2961097827 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff93c14d910 con 0x7ff93c0d0f30 2024-09-12T02:42:54.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.755+0000 7ff93be00640 1 --2- 172.21.15.112:0/2961097827 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff93c15a450 0x7ff93c14e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:54.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.755+0000 7ff93aa00640 1 --2- 172.21.15.112:0/2961097827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff93c0d0f30 0x7ff93c0cd4c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff92400b3c0 tx=0x7ff92400b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:54.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.755+0000 7ff933400640 1 -- 172.21.15.112:0/2961097827 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff924015020 con 0x7ff93c0d0f30 2024-09-12T02:42:54.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.756+0000 7ff933400640 1 -- 172.21.15.112:0/2961097827 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff924011830 con 0x7ff93c0d0f30 2024-09-12T02:42:54.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.756+0000 7ff933400640 1 -- 172.21.15.112:0/2961097827 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff924011c40 con 0x7ff93c0d0f30 2024-09-12T02:42:54.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.756+0000 7ff940a00640 1 -- 172.21.15.112:0/2961097827 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff93c14dbf0 con 0x7ff93c0d0f30 2024-09-12T02:42:54.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.756+0000 7ff940a00640 1 -- 172.21.15.112:0/2961097827 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff93c0b3c70 con 0x7ff93c0d0f30 2024-09-12T02:42:54.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.757+0000 7ff940a00640 1 -- 172.21.15.112:0/2961097827 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff93c0b3e70 con 0x7ff93c0d0f30 2024-09-12T02:42:54.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.758+0000 7ff933400640 1 -- 172.21.15.112:0/2961097827 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff924018020 con 0x7ff93c0d0f30 2024-09-12T02:42:54.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.759+0000 7ff933400640 1 --2- 172.21.15.112:0/2961097827 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff91806be60 0x7ff91806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:54.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.759+0000 7ff933400640 1 -- 172.21.15.112:0/2961097827 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff92408ae30 con 0x7ff93c0d0f30 2024-09-12T02:42:54.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.759+0000 7ff93b400640 1 --2- 172.21.15.112:0/2961097827 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff91806be60 0x7ff91806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:54.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.759+0000 7ff93b400640 1 --2- 172.21.15.112:0/2961097827 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff91806be60 0x7ff91806e320 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff93c159e60 tx=0x7ff92c009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:54.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.763+0000 7ff933400640 1 -- 172.21.15.112:0/2961097827 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff93c0b3e70 con 0x7ff93c0d0f30 2024-09-12T02:42:54.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.979+0000 7ff940a00640 1 -- 172.21.15.112:0/2961097827 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff93c06e140 con 0x7ff93c0d0f30 2024-09-12T02:42:54.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.979+0000 7ff933400640 1 -- 172.21.15.112:0/2961097827 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7ff92401f020 con 0x7ff93c0d0f30 2024-09-12T02:42:54.980 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:42:54.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.981+0000 7ff940a00640 1 -- 172.21.15.112:0/2961097827 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff91806be60 msgr2=0x7ff91806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:54.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.981+0000 7ff940a00640 1 --2- 172.21.15.112:0/2961097827 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff91806be60 0x7ff91806e320 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff93c159e60 tx=0x7ff92c009110 comp rx=0 tx=0).stop 2024-09-12T02:42:54.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.981+0000 7ff940a00640 1 -- 172.21.15.112:0/2961097827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff93c0d0f30 msgr2=0x7ff93c0cd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:54.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.981+0000 7ff940a00640 1 --2- 172.21.15.112:0/2961097827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff93c0d0f30 0x7ff93c0cd4c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff92400b3c0 tx=0x7ff92400b7c0 comp rx=0 tx=0).stop 2024-09-12T02:42:54.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.981+0000 7ff940a00640 1 -- 172.21.15.112:0/2961097827 shutdown_connections 2024-09-12T02:42:54.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.981+0000 7ff940a00640 1 --2- 172.21.15.112:0/2961097827 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff93c15a450 0x7ff93c14e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:54.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.981+0000 7ff940a00640 1 --2- 172.21.15.112:0/2961097827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff93c0d0f30 0x7ff93c0cd4c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:54.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.981+0000 7ff940a00640 1 --2- 172.21.15.112:0/2961097827 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff91806be60 0x7ff91806e320 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:54.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.981+0000 7ff940a00640 1 --2- 172.21.15.112:0/2961097827 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff93c0ce460 0x7ff93c15bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:54.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.981+0000 7ff940a00640 1 -- 172.21.15.112:0/2961097827 >> 172.21.15.112:0/2961097827 conn(0x7ff93c06bbd0 msgr2=0x7ff93c06c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:54.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.981+0000 7ff940a00640 1 -- 172.21.15.112:0/2961097827 shutdown_connections 2024-09-12T02:42:54.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:54.982+0000 7ff940a00640 1 -- 172.21.15.112:0/2961097827 wait complete. 2024-09-12T02:42:54.999 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:42:54.999 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:42:54.999 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-09-12T02:42:54.999 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T02:42:54.999 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T02:42:54.999 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:42:54.999 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:42:54.999 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:42:54.999 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:42:54.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:54.999 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-09-12T02:42:55.041 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:42:55.041 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:42:55.041 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:42:55.041 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:55.041 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-09-12T02:42:55.041 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:55.041 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:42:55.041 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-09-12T02:42:55.041 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-09-12T02:42:55.041 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:42:55.042 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-09-12T02:42:55.042 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-09-12T02:42:55.042 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:42:55.042 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:42:55.042 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:42:55.042 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:42:55.042 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:42:55.042 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42704sec preferred_lft 42704sec 2024-09-12T02:42:55.042 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::ec4:7aff:fe88:8137/64 scope link noprefixroute 2024-09-12T02:42:55.042 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:55.042 INFO:teuthology.orchestra.run.smithi137.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:42:55.042 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 62:9a:8e:f1:56:55 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:42:55.042 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:42:55.043 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:55.043 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::30c8:13ff:fe15:f79d/64 scope link 2024-09-12T02:42:55.043 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:55.043 INFO:teuthology.orchestra.run.smithi137.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:42:55.043 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 62:9a:8e:f1:56:55 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:42:55.043 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::609a:8eff:fef1:5655/64 scope link 2024-09-12T02:42:55.043 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:55.043 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:42:55.043 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 96:f4:ca:17:88:2a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T02:42:55.043 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::94f4:caff:fe17:882a/64 scope link 2024-09-12T02:42:55.043 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:42:55.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:55.044 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:42:55.138 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-09-12T02:42:55.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:55.142 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-09-12T02:42:55.180 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-09-12T02:42:55.180 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:42:55.180 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:42:55.180 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:42:55.180 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:42:55.181 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:42:55.181 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-09-12T02:42:55.181 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:42:55.181 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:42:55.181 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:42:55.181 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-09-12T02:42:55.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:42:55.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:55.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:55.379 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-09-12T02:42:55.415 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T02:42:55.415 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T02:42:55.415 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:42:55.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:55.415 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-09-12T02:42:55.511 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:42:55.511 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T02:42:55.546 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:42:55.547 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:42:55.547 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T02:42:55.621 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-12T02:42:55.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:55.621 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:42:55.750 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:42:55.750 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:42:55.777 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:42:55.777 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:42:55.777 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-09-12T02:42:55.777 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with new device syntax: 1@7c01f3b3-dec2-4449-a33f-f960d7527ea6.cephfs=/ 2024-09-12T02:42:55.777 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.112:3300/172.21.15.137:3300/172.21.15.137:3301" will pass to kernel 2024-09-12T02:42:55.778 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-12T02:42:55.778 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:42:55.779 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:42:55.779 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:42:55.779 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:42:55.781 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:42:55.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:42:55.782 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T02:42:55.837 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:42:55.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:42:55.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:42:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:55.926 INFO:teuthology.orchestra.run.smithi137.stdout:client4640 2024-09-12T02:42:55.926 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:42:55.926 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:42:55.962 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:42:56.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.115+0000 7f701c800640 1 Processor -- start 2024-09-12T02:42:56.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.115+0000 7f701c800640 1 -- start start 2024-09-12T02:42:56.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.117+0000 7f701c800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f701415b9d0 0x7f70140b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:56.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.117+0000 7f701c800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70140b54a0 con 0x7f701406f600 2024-09-12T02:42:56.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.117+0000 7f701c800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70140b3af0 con 0x7f70140b45d0 2024-09-12T02:42:56.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.117+0000 7f701c800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f70140b4a60 con 0x7f701415b9d0 2024-09-12T02:42:56.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.117+0000 7f701a800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f701406f600 0x7f70140cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:54814/0 (socket says 172.21.15.112:54814) 2024-09-12T02:42:56.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.117+0000 7f701a800640 1 -- 172.21.15.112:0/1128835917 learned_addr learned my addr 172.21.15.112:0/1128835917 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:56.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.117+0000 7f7019e00640 1 --2- 172.21.15.112:0/1128835917 >> v2:172.21.15.137:3300/0 conn(0x7f701415b9d0 0x7f70140b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:56.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.117+0000 7f7018a00640 1 -- 172.21.15.112:0/1128835917 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1958395377 0 0) 0x7f70140b54a0 con 0x7f701406f600 2024-09-12T02:42:56.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.117+0000 7f7018a00640 1 -- 172.21.15.112:0/1128835917 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ffc003520 con 0x7f701406f600 2024-09-12T02:42:56.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.118+0000 7f7019e00640 1 -- 172.21.15.112:0/1128835917 >> v1:172.21.15.137:6789/0 conn(0x7f70140b45d0 legacy=0x7f701406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:56.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.118+0000 7f7018a00640 1 -- 172.21.15.112:0/1128835917 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1264409105 0 0) 0x7f70140b3af0 con 0x7f70140b45d0 2024-09-12T02:42:56.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.118+0000 7f7019e00640 1 -- 172.21.15.112:0/1128835917 >> v1:172.21.15.112:6789/0 conn(0x7f701406f600 legacy=0x7f70140cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:56.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.118+0000 7f7019e00640 1 -- 172.21.15.112:0/1128835917 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70140b3dd0 con 0x7f701415b9d0 2024-09-12T02:42:56.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.119+0000 7f7019e00640 1 --2- 172.21.15.112:0/1128835917 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f701415b9d0 0x7f70140b4ec0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f70080097a0 tx=0x7f700802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5782140ddbde5668 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:56.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.119+0000 7f7018a00640 1 -- 172.21.15.112:0/1128835917 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7008037070 con 0x7f701415b9d0 2024-09-12T02:42:56.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.119+0000 7f7018a00640 1 -- 172.21.15.112:0/1128835917 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7008032440 con 0x7f701415b9d0 2024-09-12T02:42:56.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.119+0000 7f7018a00640 1 -- 172.21.15.112:0/1128835917 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70080327f0 con 0x7f701415b9d0 2024-09-12T02:42:56.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.119+0000 7f701c800640 1 -- 172.21.15.112:0/1128835917 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f701415b9d0 msgr2=0x7f70140b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:56.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.119+0000 7f701c800640 1 --2- 172.21.15.112:0/1128835917 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f701415b9d0 0x7f70140b4ec0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f70080097a0 tx=0x7f700802a1a0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.119+0000 7f701c800640 1 -- 172.21.15.112:0/1128835917 shutdown_connections 2024-09-12T02:42:56.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.119+0000 7f701c800640 1 --2- 172.21.15.112:0/1128835917 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f701415b9d0 0x7f70140b4ec0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.119+0000 7f701c800640 1 -- 172.21.15.112:0/1128835917 >> 172.21.15.112:0/1128835917 conn(0x7f701406bbd0 msgr2=0x7f701406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:56.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.120+0000 7f701c800640 1 -- 172.21.15.112:0/1128835917 shutdown_connections 2024-09-12T02:42:56.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.120+0000 7f701c800640 1 -- 172.21.15.112:0/1128835917 wait complete. 2024-09-12T02:42:56.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.121+0000 7f701c800640 1 Processor -- start 2024-09-12T02:42:56.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.121+0000 7f701c800640 1 -- start start 2024-09-12T02:42:56.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.122+0000 7f701c800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f701406f600 0x7f70141544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:56.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.122+0000 7f701c800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70140b45d0 0x7f70140ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:56.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.122+0000 7f701c800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f701415b9d0 0x7f701406e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:56.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.122+0000 7f701c800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f701415bf30 con 0x7f701406f600 2024-09-12T02:42:56.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.122+0000 7f701c800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f701415bdb0 con 0x7f701415b9d0 2024-09-12T02:42:56.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.122+0000 7f701c800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f70140728c0 con 0x7f70140b45d0 2024-09-12T02:42:56.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.122+0000 7f7019e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f701406f600 0x7f70141544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:56.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.122+0000 7f7019e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f701406f600 0x7f70141544b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36052/0 (socket says 172.21.15.112:36052) 2024-09-12T02:42:56.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.122+0000 7f7019e00640 1 -- 172.21.15.112:0/984518694 learned_addr learned my addr 172.21.15.112:0/984518694 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:56.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.122+0000 7f701a800640 1 --2- 172.21.15.112:0/984518694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f701415b9d0 0x7f701406e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:56.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.122+0000 7f7019400640 1 --2- 172.21.15.112:0/984518694 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70140b45d0 0x7f70140ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:56.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.123+0000 7f7019e00640 1 -- 172.21.15.112:0/984518694 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70140b45d0 msgr2=0x7f70140ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:56.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.123+0000 7f7019e00640 1 --2- 172.21.15.112:0/984518694 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70140b45d0 0x7f70140ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.123+0000 7f7019e00640 1 -- 172.21.15.112:0/984518694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f701415b9d0 msgr2=0x7f701406e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:56.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.123+0000 7f7019e00640 1 --2- 172.21.15.112:0/984518694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f701415b9d0 0x7f701406e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.123+0000 7f7019e00640 1 -- 172.21.15.112:0/984518694 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70140cdd30 con 0x7f701406f600 2024-09-12T02:42:56.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.123+0000 7f7019400640 1 --2- 172.21.15.112:0/984518694 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70140b45d0 0x7f70140ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:42:56.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.123+0000 7f7019e00640 1 --2- 172.21.15.112:0/984518694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f701406f600 0x7f70141544b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f700802a1e0 tx=0x7f70080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:56.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.123+0000 7f700e000640 1 -- 172.21.15.112:0/984518694 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7008037040 con 0x7f701406f600 2024-09-12T02:42:56.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.123+0000 7f700e000640 1 -- 172.21.15.112:0/984518694 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7008042070 con 0x7f701406f600 2024-09-12T02:42:56.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.123+0000 7f701c800640 1 -- 172.21.15.112:0/984518694 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7014154bb0 con 0x7f701406f600 2024-09-12T02:42:56.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.123+0000 7f700e000640 1 -- 172.21.15.112:0/984518694 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7008032810 con 0x7f701406f600 2024-09-12T02:42:56.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.124+0000 7f701c800640 1 -- 172.21.15.112:0/984518694 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7014154e90 con 0x7f701406f600 2024-09-12T02:42:56.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.125+0000 7f701c800640 1 -- 172.21.15.112:0/984518694 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7014068a30 con 0x7f701406f600 2024-09-12T02:42:56.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.125+0000 7f700e000640 1 -- 172.21.15.112:0/984518694 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f70080329b0 con 0x7f701406f600 2024-09-12T02:42:56.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.126+0000 7f700e000640 1 --2- 172.21.15.112:0/984518694 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6ff806be30 0x7f6ff806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:56.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.126+0000 7f700e000640 1 -- 172.21.15.112:0/984518694 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f70080ab850 con 0x7f701406f600 2024-09-12T02:42:56.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.127+0000 7f7019400640 1 --2- 172.21.15.112:0/984518694 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6ff806be30 0x7f6ff806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:56.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.127+0000 7f7019400640 1 --2- 172.21.15.112:0/984518694 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6ff806be30 0x7f6ff806e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7014154270 tx=0x7f7004009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:56.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.131+0000 7f700e000640 1 -- 172.21.15.112:0/984518694 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f700807a0e0 con 0x7f701406f600 2024-09-12T02:42:56.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.342+0000 7f701c800640 1 -- 172.21.15.112:0/984518694 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7014072c50 con 0x7f701406f600 2024-09-12T02:42:56.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.343+0000 7f700e000640 1 -- 172.21.15.112:0/984518694 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5232 (secure 0 0 0) 0x7f70080799e0 con 0x7f701406f600 2024-09-12T02:42:56.345 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:42:56.346 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":18,"btime":"2024-09-12T02:42:50:089881+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/2907398106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2907398106},{"type":"v1","addr":"172.21.15.112:6836","nonce":2907398106}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3325408635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3325408635},{"type":"v1","addr":"172.21.15.137:6835","nonce":3325408635}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4678,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3355910952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3355910952},{"type":"v1","addr":"172.21.15.137:6833","nonce":3355910952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:42:46.463211+0000","modified":"2024-09-12T02:42:49.497590+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4761},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4761":{"gid":4761,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.112:6837/917811402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":917811402},{"type":"v1","addr":"172.21.15.112:6837","nonce":917811402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4761,"qdb_cluster":[4761]},"id":2}]} 2024-09-12T02:42:56.346 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 18 2024-09-12T02:42:56.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.345+0000 7f701c800640 1 -- 172.21.15.112:0/984518694 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6ff806be30 msgr2=0x7f6ff806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:56.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.345+0000 7f701c800640 1 --2- 172.21.15.112:0/984518694 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6ff806be30 0x7f6ff806e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7014154270 tx=0x7f7004009040 comp rx=0 tx=0).stop 2024-09-12T02:42:56.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.345+0000 7f701c800640 1 -- 172.21.15.112:0/984518694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f701406f600 msgr2=0x7f70141544b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:56.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.345+0000 7f701c800640 1 --2- 172.21.15.112:0/984518694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f701406f600 0x7f70141544b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f700802a1e0 tx=0x7f70080046c0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.345+0000 7f701c800640 1 -- 172.21.15.112:0/984518694 shutdown_connections 2024-09-12T02:42:56.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.345+0000 7f701c800640 1 --2- 172.21.15.112:0/984518694 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6ff806be30 0x7f6ff806e2f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.345+0000 7f701c800640 1 --2- 172.21.15.112:0/984518694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f701415b9d0 0x7f701406e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.345+0000 7f701c800640 1 --2- 172.21.15.112:0/984518694 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70140b45d0 0x7f70140ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.345+0000 7f701c800640 1 --2- 172.21.15.112:0/984518694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f701406f600 0x7f70141544b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.345+0000 7f701c800640 1 -- 172.21.15.112:0/984518694 >> 172.21.15.112:0/984518694 conn(0x7f701406bbd0 msgr2=0x7f701415ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:56.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.345+0000 7f701c800640 1 -- 172.21.15.112:0/984518694 shutdown_connections 2024-09-12T02:42:56.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.345+0000 7f701c800640 1 -- 172.21.15.112:0/984518694 wait complete. 2024-09-12T02:42:56.362 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-12T02:42:56.535 INFO:teuthology.orchestra.run.smithi112.stdout:{"cluster_fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","whoami":0,"id":4761,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.4588667280000003,"mdsmap_epoch":18,"osdmap_epoch":32,"osdmap_epoch_barrier":32,"uptime":23.058765065999999} 2024-09-12T02:42:56.536 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", "fs_name": "cephfs", "id": 4761, "mdsmap_epoch": 18, "osdmap_epoch": 32, "osdmap_epoch_barrier": 32, "rank_uptime": 9.458866728, "state": "up:active", "uptime": 23.058765066, "want_state": "up:active", "whoami": 0 } 2024-09-12T02:42:56.536 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2024-09-12T02:42:56.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.686+0000 7f73f3e00640 1 Processor -- start 2024-09-12T02:42:56.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.686+0000 7f73f3e00640 1 -- start start 2024-09-12T02:42:56.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.687+0000 7f73f3e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f73ec06f600 0x7f73ec0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:56.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.687+0000 7f73f3e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73ec0b4a20 con 0x7f73ec0b45d0 2024-09-12T02:42:56.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.687+0000 7f73f3e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73ec0b54a0 con 0x7f73ec15b9d0 2024-09-12T02:42:56.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.687+0000 7f73f3e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f73ec0b3af0 con 0x7f73ec06f600 2024-09-12T02:42:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.688+0000 7f73f1e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f73ec0b45d0 0x7f73ec0cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:54830/0 (socket says 172.21.15.112:54830) 2024-09-12T02:42:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.688+0000 7f73f1e00640 1 -- 172.21.15.112:0/2625664914 learned_addr learned my addr 172.21.15.112:0/2625664914 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.688+0000 7f73f0a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f73ec06f600 0x7f73ec0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.688+0000 7f73f0a00640 1 -- 172.21.15.112:0/2625664914 >> v1:172.21.15.137:6789/0 conn(0x7f73ec15b9d0 legacy=0x7f73ec06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.688+0000 7f73f0a00640 1 -- 172.21.15.112:0/2625664914 >> v1:172.21.15.112:6789/0 conn(0x7f73ec0b45d0 legacy=0x7f73ec0cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.688+0000 7f73f0a00640 1 -- 172.21.15.112:0/2625664914 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ec0b3dd0 con 0x7f73ec06f600 2024-09-12T02:42:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.688+0000 7f73ebe00640 1 -- 172.21.15.112:0/2625664914 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1172943377 0 0) 0x7f73ec0b54a0 con 0x7f73ec15b9d0 2024-09-12T02:42:56.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.689+0000 7f73f0a00640 1 --2- 172.21.15.112:0/2625664914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73ec06f600 0x7f73ec0b4ec0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f73d8009790 tx=0x7f73d802a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ea1a9f9f4d0477 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:56.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.689+0000 7f73ebe00640 1 -- 172.21.15.112:0/2625664914 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d8037070 con 0x7f73ec06f600 2024-09-12T02:42:56.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.689+0000 7f73ebe00640 1 -- 172.21.15.112:0/2625664914 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73d802ad10 con 0x7f73ec06f600 2024-09-12T02:42:56.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.689+0000 7f73ebe00640 1 -- 172.21.15.112:0/2625664914 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d8032660 con 0x7f73ec06f600 2024-09-12T02:42:56.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.690+0000 7f73f3e00640 1 -- 172.21.15.112:0/2625664914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73ec06f600 msgr2=0x7f73ec0b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:56.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.690+0000 7f73f3e00640 1 --2- 172.21.15.112:0/2625664914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73ec06f600 0x7f73ec0b4ec0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f73d8009790 tx=0x7f73d802a080 comp rx=0 tx=0).stop 2024-09-12T02:42:56.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.690+0000 7f73f3e00640 1 -- 172.21.15.112:0/2625664914 shutdown_connections 2024-09-12T02:42:56.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.690+0000 7f73f3e00640 1 --2- 172.21.15.112:0/2625664914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73ec06f600 0x7f73ec0b4ec0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.690+0000 7f73f3e00640 1 -- 172.21.15.112:0/2625664914 >> 172.21.15.112:0/2625664914 conn(0x7f73ec06bbd0 msgr2=0x7f73ec06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:56.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.690+0000 7f73f3e00640 1 -- 172.21.15.112:0/2625664914 shutdown_connections 2024-09-12T02:42:56.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.690+0000 7f73f3e00640 1 -- 172.21.15.112:0/2625664914 wait complete. 2024-09-12T02:42:56.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.692+0000 7f73f3e00640 1 Processor -- start 2024-09-12T02:42:56.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.692+0000 7f73f3e00640 1 -- start start 2024-09-12T02:42:56.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.693+0000 7f73f3e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73ec06f600 0x7f73ec15ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:56.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.693+0000 7f73f3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73ec0b45d0 0x7f73ec158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:56.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.693+0000 7f73f3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73ec15b9d0 0x7f73ec159500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:56.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.693+0000 7f73f3e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f73ec15bf30 con 0x7f73ec15b9d0 2024-09-12T02:42:56.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.693+0000 7f73f3e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f73ec15bdb0 con 0x7f73ec0b45d0 2024-09-12T02:42:56.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.693+0000 7f73f3e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f73ec0728c0 con 0x7f73ec06f600 2024-09-12T02:42:56.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.693+0000 7f73f1e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73ec15b9d0 0x7f73ec159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:56.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.693+0000 7f73f1400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73ec06f600 0x7f73ec15ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:56.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.693+0000 7f73f1e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73ec15b9d0 0x7f73ec159500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36074/0 (socket says 172.21.15.112:36074) 2024-09-12T02:42:56.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.693+0000 7f73f1e00640 1 -- 172.21.15.112:0/1638768369 learned_addr learned my addr 172.21.15.112:0/1638768369 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:56.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.693+0000 7f73f0a00640 1 --2- 172.21.15.112:0/1638768369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73ec0b45d0 0x7f73ec158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:56.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.693+0000 7f73f1e00640 1 -- 172.21.15.112:0/1638768369 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73ec06f600 msgr2=0x7f73ec15ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:56.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.693+0000 7f73f1e00640 1 --2- 172.21.15.112:0/1638768369 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73ec06f600 0x7f73ec15ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.693+0000 7f73f1e00640 1 -- 172.21.15.112:0/1638768369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73ec0b45d0 msgr2=0x7f73ec158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:56.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.693+0000 7f73f1e00640 1 --2- 172.21.15.112:0/1638768369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73ec0b45d0 0x7f73ec158fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.693+0000 7f73f1e00640 1 -- 172.21.15.112:0/1638768369 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ec1535d0 con 0x7f73ec15b9d0 2024-09-12T02:42:56.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.694+0000 7f73f1e00640 1 --2- 172.21.15.112:0/1638768369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73ec15b9d0 0x7f73ec159500 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f73e400caf0 tx=0x7f73e40020b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:56.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.694+0000 7f73e9600640 1 -- 172.21.15.112:0/1638768369 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e4018070 con 0x7f73ec15b9d0 2024-09-12T02:42:56.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.694+0000 7f73e9600640 1 -- 172.21.15.112:0/1638768369 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73e400a6e0 con 0x7f73ec15b9d0 2024-09-12T02:42:56.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.694+0000 7f73f3e00640 1 -- 172.21.15.112:0/1638768369 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73ec15a2b0 con 0x7f73ec15b9d0 2024-09-12T02:42:56.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.694+0000 7f73e9600640 1 -- 172.21.15.112:0/1638768369 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e400ab10 con 0x7f73ec15b9d0 2024-09-12T02:42:56.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.694+0000 7f73f3e00640 1 -- 172.21.15.112:0/1638768369 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73ec0cd450 con 0x7f73ec15b9d0 2024-09-12T02:42:56.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.695+0000 7f73f3e00640 1 -- 172.21.15.112:0/1638768369 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73ec068a30 con 0x7f73ec15b9d0 2024-09-12T02:42:56.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.696+0000 7f73e9600640 1 -- 172.21.15.112:0/1638768369 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f73e401b070 con 0x7f73ec15b9d0 2024-09-12T02:42:56.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.697+0000 7f73e9600640 1 --2- 172.21.15.112:0/1638768369 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f73cc06be30 0x7f73cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:56.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.697+0000 7f73e9600640 1 -- 172.21.15.112:0/1638768369 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f73e408a620 con 0x7f73ec15b9d0 2024-09-12T02:42:56.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.698+0000 7f73f1400640 1 --2- 172.21.15.112:0/1638768369 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f73cc06be30 0x7f73cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:56.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.698+0000 7f73f1400640 1 --2- 172.21.15.112:0/1638768369 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f73cc06be30 0x7f73cc06e2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f73e0000f60 tx=0x7f73e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:56.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.702+0000 7f73e9600640 1 -- 172.21.15.112:0/1638768369 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f73ec1535d0 con 0x7f73ec15b9d0 2024-09-12T02:42:56.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.943+0000 7f73f3e00640 1 -- 172.21.15.112:0/1638768369 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) -- 0x7f73ec06dbc0 con 0x7f73ec15b9d0 2024-09-12T02:42:56.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.944+0000 7f73e9600640 1 -- 172.21.15.112:0/1638768369 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) ==== 75+0+1620 (secure 0 0 0) 0x7f73e40588e0 con 0x7f73ec15b9d0 2024-09-12T02:42:56.945 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:42:56.945 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:42:56.945 INFO:teuthology.orchestra.run.smithi112.stdout: "stats": { 2024-09-12T02:42:56.945 INFO:teuthology.orchestra.run.smithi112.stdout: "total_bytes": 1600000000, 2024-09-12T02:42:56.945 INFO:teuthology.orchestra.run.smithi112.stdout: "total_avail_bytes": 1597700196, 2024-09-12T02:42:56.945 INFO:teuthology.orchestra.run.smithi112.stdout: "total_used_bytes": 2299804, 2024-09-12T02:42:56.946 INFO:teuthology.orchestra.run.smithi112.stdout: "total_used_raw_bytes": 2299804, 2024-09-12T02:42:56.946 INFO:teuthology.orchestra.run.smithi112.stdout: "total_used_raw_ratio": 0.0014373775338754058, 2024-09-12T02:42:56.946 INFO:teuthology.orchestra.run.smithi112.stdout: "num_osds": 8, 2024-09-12T02:42:56.946 INFO:teuthology.orchestra.run.smithi112.stdout: "num_per_pool_osds": 0, 2024-09-12T02:42:56.946 INFO:teuthology.orchestra.run.smithi112.stdout: "num_per_pool_omap_osds": 0 2024-09-12T02:42:56.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:42:56.946 INFO:teuthology.orchestra.run.smithi112.stdout: "stats_by_class": { 2024-09-12T02:42:56.947 INFO:teuthology.orchestra.run.smithi112.stdout: "hdd": { 2024-09-12T02:42:56.947 INFO:teuthology.orchestra.run.smithi112.stdout: "total_bytes": 1600000000, 2024-09-12T02:42:56.947 INFO:teuthology.orchestra.run.smithi112.stdout: "total_avail_bytes": 1597700196, 2024-09-12T02:42:56.947 INFO:teuthology.orchestra.run.smithi112.stdout: "total_used_bytes": 2299804, 2024-09-12T02:42:56.947 INFO:teuthology.orchestra.run.smithi112.stdout: "total_used_raw_bytes": 2299804, 2024-09-12T02:42:56.947 INFO:teuthology.orchestra.run.smithi112.stdout: "total_used_raw_ratio": 0.0014373775338754058 2024-09-12T02:42:56.947 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:56.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:42:56.948 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-12T02:42:56.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:42:56.948 INFO:teuthology.orchestra.run.smithi112.stdout: "name": ".mgr", 2024-09-12T02:42:56.948 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 1, 2024-09-12T02:42:56.948 INFO:teuthology.orchestra.run.smithi112.stdout: "stats": { 2024-09-12T02:42:56.948 INFO:teuthology.orchestra.run.smithi112.stdout: "stored": 590368, 2024-09-12T02:42:56.948 INFO:teuthology.orchestra.run.smithi112.stdout: "objects": 2, 2024-09-12T02:42:56.948 INFO:teuthology.orchestra.run.smithi112.stdout: "kb_used": 577, 2024-09-12T02:42:56.948 INFO:teuthology.orchestra.run.smithi112.stdout: "bytes_used": 590368, 2024-09-12T02:42:56.948 INFO:teuthology.orchestra.run.smithi112.stdout: "percent_used": 0.00052959844470024109, 2024-09-12T02:42:56.948 INFO:teuthology.orchestra.run.smithi112.stdout: "max_avail": 557078080 2024-09-12T02:42:56.948 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:56.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:42:56.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:42:56.949 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "cephfs_metadata", 2024-09-12T02:42:56.949 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 4, 2024-09-12T02:42:56.949 INFO:teuthology.orchestra.run.smithi112.stdout: "stats": { 2024-09-12T02:42:56.949 INFO:teuthology.orchestra.run.smithi112.stdout: "stored": 2410, 2024-09-12T02:42:56.949 INFO:teuthology.orchestra.run.smithi112.stdout: "objects": 22, 2024-09-12T02:42:56.949 INFO:teuthology.orchestra.run.smithi112.stdout: "kb_used": 3, 2024-09-12T02:42:56.949 INFO:teuthology.orchestra.run.smithi112.stdout: "bytes_used": 2410, 2024-09-12T02:42:56.949 INFO:teuthology.orchestra.run.smithi112.stdout: "percent_used": 2.1630673927575117e-06, 2024-09-12T02:42:56.949 INFO:teuthology.orchestra.run.smithi112.stdout: "max_avail": 557078080 2024-09-12T02:42:56.949 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:56.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:42:56.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:42:56.950 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "cephfs_data", 2024-09-12T02:42:56.950 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 5, 2024-09-12T02:42:56.950 INFO:teuthology.orchestra.run.smithi112.stdout: "stats": { 2024-09-12T02:42:56.950 INFO:teuthology.orchestra.run.smithi112.stdout: "stored": 0, 2024-09-12T02:42:56.950 INFO:teuthology.orchestra.run.smithi112.stdout: "objects": 0, 2024-09-12T02:42:56.950 INFO:teuthology.orchestra.run.smithi112.stdout: "kb_used": 0, 2024-09-12T02:42:56.950 INFO:teuthology.orchestra.run.smithi112.stdout: "bytes_used": 0, 2024-09-12T02:42:56.950 INFO:teuthology.orchestra.run.smithi112.stdout: "percent_used": 0, 2024-09-12T02:42:56.951 INFO:teuthology.orchestra.run.smithi112.stdout: "max_avail": 557078080 2024-09-12T02:42:56.951 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:56.951 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:42:56.951 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:42:56.951 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:42:56.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.946+0000 7f73f3e00640 1 -- 172.21.15.112:0/1638768369 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f73cc06be30 msgr2=0x7f73cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:56.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.946+0000 7f73f3e00640 1 --2- 172.21.15.112:0/1638768369 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f73cc06be30 0x7f73cc06e2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f73e0000f60 tx=0x7f73e0009040 comp rx=0 tx=0).stop 2024-09-12T02:42:56.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.946+0000 7f73f3e00640 1 -- 172.21.15.112:0/1638768369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73ec15b9d0 msgr2=0x7f73ec159500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:56.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.946+0000 7f73f3e00640 1 --2- 172.21.15.112:0/1638768369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73ec15b9d0 0x7f73ec159500 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f73e400caf0 tx=0x7f73e40020b0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.946+0000 7f73f3e00640 1 -- 172.21.15.112:0/1638768369 shutdown_connections 2024-09-12T02:42:56.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.946+0000 7f73f3e00640 1 --2- 172.21.15.112:0/1638768369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73ec15b9d0 0x7f73ec159500 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.946+0000 7f73f3e00640 1 --2- 172.21.15.112:0/1638768369 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f73cc06be30 0x7f73cc06e2f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.946+0000 7f73f3e00640 1 --2- 172.21.15.112:0/1638768369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73ec0b45d0 0x7f73ec158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.946+0000 7f73f3e00640 1 --2- 172.21.15.112:0/1638768369 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73ec06f600 0x7f73ec15ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:56.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.946+0000 7f73f3e00640 1 -- 172.21.15.112:0/1638768369 >> 172.21.15.112:0/1638768369 conn(0x7f73ec06bbd0 msgr2=0x7f73ec15f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:56.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.946+0000 7f73f3e00640 1 -- 172.21.15.112:0/1638768369 shutdown_connections 2024-09-12T02:42:56.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:56.946+0000 7f73f3e00640 1 -- 172.21.15.112:0/1638768369 wait complete. 2024-09-12T02:42:56.963 DEBUG:teuthology.orchestra.run.smithi112:> stdin-killer -- python3 -c ' 2024-09-12T02:42:56.963 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-12T02:42:56.963 DEBUG:teuthology.orchestra.run.smithi112:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-12T02:42:56.963 DEBUG:teuthology.orchestra.run.smithi112:> os.fchmod(fd, 0O666) 2024-09-12T02:42:56.963 DEBUG:teuthology.orchestra.run.smithi112:> os.fsync(fd) 2024-09-12T02:42:56.963 DEBUG:teuthology.orchestra.run.smithi112:> os.close(fd) 2024-09-12T02:42:56.963 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-12T02:42:57.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:57.079 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:42:57.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:42:57.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:57.210 INFO:teuthology.orchestra.run.smithi112.stdout:client4634 2024-09-12T02:42:57.210 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/7c01f3b3-dec2-4449-a33f-f960d7527ea6.client4634/osdmap') 2024-09-12T02:42:57.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:42:57.308 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 32 barrier 32 flags 0x588000 2024-09-12T02:42:57.308 INFO:teuthology.orchestra.run.smithi112.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-12T02:42:57.308 INFO:teuthology.orchestra.run.smithi112.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-12T02:42:57.308 INFO:teuthology.orchestra.run.smithi112.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-12T02:42:57.308 INFO:teuthology.orchestra.run.smithi112.stdout:osd0 (2)172.21.15.112:6800 100% (exists, up) 100% -1 2024-09-12T02:42:57.308 INFO:teuthology.orchestra.run.smithi112.stdout:osd1 (2)172.21.15.112:6808 100% (exists, up) 100% -1 2024-09-12T02:42:57.309 INFO:teuthology.orchestra.run.smithi112.stdout:osd2 (2)172.21.15.112:6816 100% (exists, up) 100% -1 2024-09-12T02:42:57.309 INFO:teuthology.orchestra.run.smithi112.stdout:osd3 (2)172.21.15.112:6824 100% (exists, up) 100% -1 2024-09-12T02:42:57.309 INFO:teuthology.orchestra.run.smithi112.stdout:osd4 (2)172.21.15.137:6800 100% (exists, up) 100% -1 2024-09-12T02:42:57.309 INFO:teuthology.orchestra.run.smithi112.stdout:osd5 (2)172.21.15.137:6808 100% (exists, up) 100% -1 2024-09-12T02:42:57.309 INFO:teuthology.orchestra.run.smithi112.stdout:osd6 (2)172.21.15.137:6813 100% (exists, up) 100% -1 2024-09-12T02:42:57.309 INFO:teuthology.orchestra.run.smithi112.stdout:osd7 (2)172.21.15.137:6824 100% (exists, up) 100% -1 2024-09-12T02:42:57.309 INFO:teuthology.orchestra.run.smithi112.stderr:1+1 records in 2024-09-12T02:42:57.309 INFO:teuthology.orchestra.run.smithi112.stderr:1+1 records out 2024-09-12T02:42:57.309 INFO:teuthology.orchestra.run.smithi112.stderr:799 bytes copied, 0.000130845 s, 6.1 MB/s 2024-09-12T02:42:57.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:57.319 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2024-09-12T02:42:57.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.471+0000 7f199c800640 1 Processor -- start 2024-09-12T02:42:57.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.472+0000 7f199c800640 1 -- start start 2024-09-12T02:42:57.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.473+0000 7f199c800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1994162100 0x7f19940d58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:57.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.473+0000 7f199c800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19941624e0 0x7f19940b4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:57.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.473+0000 7f199c800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f19940d0510 0x7f19940d0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:57.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.473+0000 7f199c800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f19940cfa70 con 0x7f19940d0510 2024-09-12T02:42:57.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.473+0000 7f199c800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f19940d21d0 con 0x7f1994162100 2024-09-12T02:42:57.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.473+0000 7f199c800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f19940d24b0 con 0x7f19941624e0 2024-09-12T02:42:57.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.473+0000 7f199a800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f19940d0510 0x7f19940d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:57.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.473+0000 7f199a800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f19940d0510 0x7f19940d0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36084/0 (socket says 172.21.15.112:36084) 2024-09-12T02:42:57.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.473+0000 7f199a800640 1 -- 172.21.15.112:0/1474865927 learned_addr learned my addr 172.21.15.112:0/1474865927 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:57.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.473+0000 7f1999e00640 1 --2- 172.21.15.112:0/1474865927 >> v2:172.21.15.137:3300/0 conn(0x7f1994162100 0x7f19940d58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:57.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.473+0000 7f1999400640 1 --2- 172.21.15.112:0/1474865927 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19941624e0 0x7f19940b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:57.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.473+0000 7f199a800640 1 -- 172.21.15.112:0/1474865927 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19941624e0 msgr2=0x7f19940b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:57.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.473+0000 7f199a800640 1 --2- 172.21.15.112:0/1474865927 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19941624e0 0x7f19940b4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:57.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.473+0000 7f199a800640 1 -- 172.21.15.112:0/1474865927 >> v2:172.21.15.137:3300/0 conn(0x7f1994162100 msgr2=0x7f19940d58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:57.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.473+0000 7f199a800640 1 --2- 172.21.15.112:0/1474865927 >> v2:172.21.15.137:3300/0 conn(0x7f1994162100 0x7f19940d58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:57.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.473+0000 7f199a800640 1 -- 172.21.15.112:0/1474865927 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19940cfd10 con 0x7f19940d0510 2024-09-12T02:42:57.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.474+0000 7f199a800640 1 --2- 172.21.15.112:0/1474865927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19940d0510 0x7f19940d0960 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f19940b7970 tx=0x7f199002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb4032c27a9c712 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:57.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.475+0000 7f1998a00640 1 -- 172.21.15.112:0/1474865927 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1990036070 con 0x7f19940d0510 2024-09-12T02:42:57.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.475+0000 7f1998a00640 1 -- 172.21.15.112:0/1474865927 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1990031600 con 0x7f19940d0510 2024-09-12T02:42:57.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.475+0000 7f1998a00640 1 -- 172.21.15.112:0/1474865927 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19900319d0 con 0x7f19940d0510 2024-09-12T02:42:57.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.475+0000 7f199c800640 1 -- 172.21.15.112:0/1474865927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19940d0510 msgr2=0x7f19940d0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:57.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.475+0000 7f199c800640 1 --2- 172.21.15.112:0/1474865927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19940d0510 0x7f19940d0960 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f19940b7970 tx=0x7f199002a610 comp rx=0 tx=0).stop 2024-09-12T02:42:57.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.475+0000 7f199c800640 1 -- 172.21.15.112:0/1474865927 shutdown_connections 2024-09-12T02:42:57.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.475+0000 7f199c800640 1 --2- 172.21.15.112:0/1474865927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19940d0510 0x7f19940d0960 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:57.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.475+0000 7f199c800640 1 --2- 172.21.15.112:0/1474865927 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19941624e0 0x7f19940b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:57.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.475+0000 7f199c800640 1 --2- 172.21.15.112:0/1474865927 >> v2:172.21.15.137:3300/0 conn(0x7f1994162100 0x7f19940d58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:57.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.475+0000 7f199c800640 1 -- 172.21.15.112:0/1474865927 >> 172.21.15.112:0/1474865927 conn(0x7f19940d4db0 msgr2=0x7f19940d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:57.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.475+0000 7f199c800640 1 -- 172.21.15.112:0/1474865927 shutdown_connections 2024-09-12T02:42:57.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.475+0000 7f199c800640 1 -- 172.21.15.112:0/1474865927 wait complete. 2024-09-12T02:42:57.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.477+0000 7f199c800640 1 Processor -- start 2024-09-12T02:42:57.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.477+0000 7f199c800640 1 -- start start 2024-09-12T02:42:57.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.478+0000 7f199c800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19940d0510 0x7f1994156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:57.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.478+0000 7f199c800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1994162100 0x7f1994157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:57.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.478+0000 7f199c800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19941624e0 0x7f19940ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:57.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.478+0000 7f199c800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f19940d1df0 con 0x7f1994162100 2024-09-12T02:42:57.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.478+0000 7f199c800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f19940d0ea0 con 0x7f19941624e0 2024-09-12T02:42:57.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.478+0000 7f199c800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f19940d1f70 con 0x7f19940d0510 2024-09-12T02:42:57.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.478+0000 7f1999400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1994162100 0x7f1994157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:57.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.478+0000 7f1999400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1994162100 0x7f1994157410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36094/0 (socket says 172.21.15.112:36094) 2024-09-12T02:42:57.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.478+0000 7f1999400640 1 -- 172.21.15.112:0/1403708725 learned_addr learned my addr 172.21.15.112:0/1403708725 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:57.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.478+0000 7f1999e00640 1 --2- 172.21.15.112:0/1403708725 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19940d0510 0x7f1994156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:57.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.478+0000 7f199a800640 1 --2- 172.21.15.112:0/1403708725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19941624e0 0x7f19940ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:57.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.479+0000 7f1999400640 1 -- 172.21.15.112:0/1403708725 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19940d0510 msgr2=0x7f1994156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:57.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.479+0000 7f1999400640 1 --2- 172.21.15.112:0/1403708725 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19940d0510 0x7f1994156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:57.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.479+0000 7f1999400640 1 -- 172.21.15.112:0/1403708725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19941624e0 msgr2=0x7f19940ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:57.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.479+0000 7f1999400640 1 --2- 172.21.15.112:0/1403708725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19941624e0 0x7f19940ce1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:57.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.479+0000 7f1999400640 1 -- 172.21.15.112:0/1403708725 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19940ccb20 con 0x7f1994162100 2024-09-12T02:42:57.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.479+0000 7f1999400640 1 --2- 172.21.15.112:0/1403708725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1994162100 0x7f1994157410 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f198400d5f0 tx=0x7f198400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:57.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.479+0000 7f198e000640 1 -- 172.21.15.112:0/1403708725 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19840125f0 con 0x7f1994162100 2024-09-12T02:42:57.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.479+0000 7f198e000640 1 -- 172.21.15.112:0/1403708725 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1984019070 con 0x7f1994162100 2024-09-12T02:42:57.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.479+0000 7f199c800640 1 -- 172.21.15.112:0/1403708725 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19940cce00 con 0x7f1994162100 2024-09-12T02:42:57.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.479+0000 7f198e000640 1 -- 172.21.15.112:0/1403708725 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19840129d0 con 0x7f1994162100 2024-09-12T02:42:57.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.479+0000 7f199c800640 1 -- 172.21.15.112:0/1403708725 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19940cd6a0 con 0x7f1994162100 2024-09-12T02:42:57.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.480+0000 7f199c800640 1 -- 172.21.15.112:0/1403708725 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1994068f00 con 0x7f1994162100 2024-09-12T02:42:57.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.481+0000 7f198e000640 1 -- 172.21.15.112:0/1403708725 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1984012b70 con 0x7f1994162100 2024-09-12T02:42:57.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.482+0000 7f198e000640 1 --2- 172.21.15.112:0/1403708725 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f197806be30 0x7f197806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:57.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.482+0000 7f198e000640 1 -- 172.21.15.112:0/1403708725 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f198408b200 con 0x7f1994162100 2024-09-12T02:42:57.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.482+0000 7f1999e00640 1 --2- 172.21.15.112:0/1403708725 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f197806be30 0x7f197806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:57.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.483+0000 7f1999e00640 1 --2- 172.21.15.112:0/1403708725 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f197806be30 0x7f197806e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1988003610 tx=0x7f1988008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:57.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.486+0000 7f198e000640 1 -- 172.21.15.112:0/1403708725 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1994068f00 con 0x7f1994162100 2024-09-12T02:42:57.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:57.667+0000 7f199c800640 1 -- 172.21.15.112:0/1403708725 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) -- 0x7f19940b4270 con 0x7f1994162100 2024-09-12T02:42:58.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.183+0000 7f198e000640 1 -- 172.21.15.112:0/1403708725 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v33) ==== 93+0+0 (secure 0 0 0) 0x7f19940b4270 con 0x7f1994162100 2024-09-12T02:42:58.184 INFO:teuthology.orchestra.run.smithi112.stderr:pauserd,pausewr is set 2024-09-12T02:42:58.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.186+0000 7f199c800640 1 -- 172.21.15.112:0/1403708725 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f197806be30 msgr2=0x7f197806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:58.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.186+0000 7f199c800640 1 --2- 172.21.15.112:0/1403708725 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f197806be30 0x7f197806e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1988003610 tx=0x7f1988008040 comp rx=0 tx=0).stop 2024-09-12T02:42:58.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.187+0000 7f199c800640 1 -- 172.21.15.112:0/1403708725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1994162100 msgr2=0x7f1994157410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:58.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.187+0000 7f199c800640 1 --2- 172.21.15.112:0/1403708725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1994162100 0x7f1994157410 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f198400d5f0 tx=0x7f198400dab0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.187+0000 7f199c800640 1 -- 172.21.15.112:0/1403708725 shutdown_connections 2024-09-12T02:42:58.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.187+0000 7f199c800640 1 --2- 172.21.15.112:0/1403708725 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f197806be30 0x7f197806e2f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.187+0000 7f199c800640 1 --2- 172.21.15.112:0/1403708725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19941624e0 0x7f19940ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.187+0000 7f199c800640 1 --2- 172.21.15.112:0/1403708725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1994162100 0x7f1994157410 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.187+0000 7f199c800640 1 --2- 172.21.15.112:0/1403708725 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19940d0510 0x7f1994156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.187+0000 7f199c800640 1 -- 172.21.15.112:0/1403708725 >> 172.21.15.112:0/1403708725 conn(0x7f19940d4db0 msgr2=0x7f19940b32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:58.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.187+0000 7f199c800640 1 -- 172.21.15.112:0/1403708725 shutdown_connections 2024-09-12T02:42:58.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.187+0000 7f199c800640 1 -- 172.21.15.112:0/1403708725 wait complete. 2024-09-12T02:42:58.207 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2024-09-12T02:42:58.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.363+0000 7f307b000640 1 Processor -- start 2024-09-12T02:42:58.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.363+0000 7f307b000640 1 -- start start 2024-09-12T02:42:58.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.364+0000 7f307b000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f30740afe30 0x7f30740cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:58.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.364+0000 7f307b000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30740ceeb0 con 0x7f3074071530 2024-09-12T02:42:58.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.364+0000 7f307b000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f307406e300 con 0x7f307415cc50 2024-09-12T02:42:58.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.364+0000 7f307b000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f307415d030 con 0x7f30740afe30 2024-09-12T02:42:58.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.364+0000 7f306b400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f3074071530 0x7f30740af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:54834/0 (socket says 172.21.15.112:54834) 2024-09-12T02:42:58.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.364+0000 7f306b400640 1 -- 172.21.15.112:0/1181822159 learned_addr learned my addr 172.21.15.112:0/1181822159 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:58.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.365+0000 7f3079000640 1 --2- 172.21.15.112:0/1181822159 >> v2:172.21.15.137:3300/0 conn(0x7f30740afe30 0x7f30740cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:58.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.365+0000 7f3073400640 1 -- 172.21.15.112:0/1181822159 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3400254128 0 0) 0x7f30740ceeb0 con 0x7f3074071530 2024-09-12T02:42:58.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.365+0000 7f3073400640 1 -- 172.21.15.112:0/1181822159 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3058003520 con 0x7f3074071530 2024-09-12T02:42:58.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.365+0000 7f3073400640 1 -- 172.21.15.112:0/1181822159 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 586950034 0 0) 0x7f3058003520 con 0x7f3074071530 2024-09-12T02:42:58.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.365+0000 7f3073400640 1 -- 172.21.15.112:0/1181822159 >> v2:172.21.15.137:3300/0 conn(0x7f30740afe30 msgr2=0x7f30740cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:58.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.365+0000 7f3073400640 1 --2- 172.21.15.112:0/1181822159 >> v2:172.21.15.137:3300/0 conn(0x7f30740afe30 0x7f30740cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.365+0000 7f3073400640 1 -- 172.21.15.112:0/1181822159 >> v1:172.21.15.137:6789/0 conn(0x7f307415cc50 legacy=0x7f30740732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:58.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.365+0000 7f3073400640 1 -- 172.21.15.112:0/1181822159 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307406e5e0 con 0x7f3074071530 2024-09-12T02:42:58.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.365+0000 7f3073400640 1 -- 172.21.15.112:0/1181822159 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f305c005090 con 0x7f3074071530 2024-09-12T02:42:58.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.365+0000 7f3073400640 1 -- 172.21.15.112:0/1181822159 >> v1:172.21.15.112:6789/0 conn(0x7f3074071530 legacy=0x7f30740af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:58.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.365+0000 7f3073400640 1 --2- 172.21.15.112:0/1181822159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3058003a00 0x7f3058003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:58.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.365+0000 7f3073400640 1 --2- 172.21.15.112:0/1181822159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3058004800 0x7f3058004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:58.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.365+0000 7f3073400640 1 --2- 172.21.15.112:0/1181822159 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3058005210 0x7f305800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:58.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.365+0000 7f3073400640 1 -- 172.21.15.112:0/1181822159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f305800c130 con 0x7f3058003a00 2024-09-12T02:42:58.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.365+0000 7f3073400640 1 -- 172.21.15.112:0/1181822159 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f305800c2e0 con 0x7f3058004800 2024-09-12T02:42:58.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.365+0000 7f3073400640 1 -- 172.21.15.112:0/1181822159 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f305800c4e0 con 0x7f3058005210 2024-09-12T02:42:58.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.365+0000 7f3073e00640 1 --2- 172.21.15.112:0/1181822159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3058003a00 0x7f3058003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:58.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.366+0000 7f306b400640 1 --2- 172.21.15.112:0/1181822159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3058004800 0x7f3058004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:58.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.366+0000 7f3079000640 1 --2- 172.21.15.112:0/1181822159 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3058005210 0x7f305800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:58.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.366+0000 7f3073e00640 1 -- 172.21.15.112:0/1181822159 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3058005210 msgr2=0x7f305800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:58.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.366+0000 7f3073e00640 1 --2- 172.21.15.112:0/1181822159 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3058005210 0x7f305800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.366+0000 7f3073e00640 1 -- 172.21.15.112:0/1181822159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3058004800 msgr2=0x7f3058004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:42:58.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.366+0000 7f3073e00640 1 --2- 172.21.15.112:0/1181822159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3058004800 0x7f3058004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.366+0000 7f3073e00640 1 -- 172.21.15.112:0/1181822159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3058003520 con 0x7f3058003a00 2024-09-12T02:42:58.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.366+0000 7f3079000640 1 -- 172.21.15.112:0/1181822159 reap_dead start 2024-09-12T02:42:58.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.367+0000 7f3073e00640 1 --2- 172.21.15.112:0/1181822159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3058003a00 0x7f3058003e20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3064001720 tx=0x7f3058005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475cf3de31aa67f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:58.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.367+0000 7f3073400640 1 -- 172.21.15.112:0/1181822159 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3064001370 con 0x7f3058003a00 2024-09-12T02:42:58.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.367+0000 7f3073400640 1 -- 172.21.15.112:0/1181822159 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30640052d0 con 0x7f3058003a00 2024-09-12T02:42:58.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.367+0000 7f3073400640 1 -- 172.21.15.112:0/1181822159 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306402abc0 con 0x7f3058003a00 2024-09-12T02:42:58.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.368+0000 7f307b000640 1 -- 172.21.15.112:0/1181822159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3058003a00 msgr2=0x7f3058003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:58.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.368+0000 7f307b000640 1 --2- 172.21.15.112:0/1181822159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3058003a00 0x7f3058003e20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3064001720 tx=0x7f3058005830 comp rx=0 tx=0).stop 2024-09-12T02:42:58.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.368+0000 7f307b000640 1 -- 172.21.15.112:0/1181822159 shutdown_connections 2024-09-12T02:42:58.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.368+0000 7f307b000640 1 --2- 172.21.15.112:0/1181822159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3058003a00 0x7f3058003e20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.368+0000 7f307b000640 1 -- 172.21.15.112:0/1181822159 >> 172.21.15.112:0/1181822159 conn(0x7f307406bbd0 msgr2=0x7f307406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:58.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.368+0000 7f307b000640 1 -- 172.21.15.112:0/1181822159 shutdown_connections 2024-09-12T02:42:58.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.368+0000 7f307b000640 1 -- 172.21.15.112:0/1181822159 wait complete. 2024-09-12T02:42:58.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.369+0000 7f307b000640 1 Processor -- start 2024-09-12T02:42:58.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.369+0000 7f307b000640 1 -- start start 2024-09-12T02:42:58.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.370+0000 7f307b000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3058003a00 0x7f30741f6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:58.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.370+0000 7f307b000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3074151670 0x7f30741531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:58.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.370+0000 7f307b000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3074153700 0x7f3074154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:58.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.370+0000 7f307b000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f307406f510 con 0x7f3074153700 2024-09-12T02:42:58.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.370+0000 7f307b000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f30740cf4c0 con 0x7f3074151670 2024-09-12T02:42:58.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.370+0000 7f307b000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f307406f690 con 0x7f3058003a00 2024-09-12T02:42:58.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.371+0000 7f3079000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3074153700 0x7f3074154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:58.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.371+0000 7f3079000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3074153700 0x7f3074154a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36114/0 (socket says 172.21.15.112:36114) 2024-09-12T02:42:58.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.371+0000 7f3079000640 1 -- 172.21.15.112:0/3066557018 learned_addr learned my addr 172.21.15.112:0/3066557018 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:58.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.371+0000 7f306b400640 1 --2- 172.21.15.112:0/3066557018 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3074151670 0x7f30741531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:58.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.371+0000 7f3073e00640 1 --2- 172.21.15.112:0/3066557018 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3058003a00 0x7f30741f6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:58.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.371+0000 7f3079000640 1 -- 172.21.15.112:0/3066557018 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3058003a00 msgr2=0x7f30741f6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:58.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.371+0000 7f3079000640 1 --2- 172.21.15.112:0/3066557018 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3058003a00 0x7f30741f6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.371+0000 7f3079000640 1 -- 172.21.15.112:0/3066557018 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3074151670 msgr2=0x7f30741531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:58.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.371+0000 7f3079000640 1 --2- 172.21.15.112:0/3066557018 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3074151670 0x7f30741531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:58.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.371+0000 7f3079000640 1 -- 172.21.15.112:0/3066557018 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3074153ca0 con 0x7f3074153700 2024-09-12T02:42:58.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.371+0000 7f3079000640 1 --2- 172.21.15.112:0/3066557018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3074153700 0x7f3074154a60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f30740cf430 tx=0x7f306c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:58.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.371+0000 7f3070c00640 1 -- 172.21.15.112:0/3066557018 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306c00fd80 con 0x7f3074153700 2024-09-12T02:42:58.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.371+0000 7f3070c00640 1 -- 172.21.15.112:0/3066557018 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f306c01d070 con 0x7f3074153700 2024-09-12T02:42:58.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.371+0000 7f307b000640 1 -- 172.21.15.112:0/3066557018 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30740b3b10 con 0x7f3074153700 2024-09-12T02:42:58.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.372+0000 7f3070c00640 1 -- 172.21.15.112:0/3066557018 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306c015670 con 0x7f3074153700 2024-09-12T02:42:58.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.372+0000 7f307b000640 1 -- 172.21.15.112:0/3066557018 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3074151ad0 con 0x7f3074153700 2024-09-12T02:42:58.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.373+0000 7f307b000640 1 -- 172.21.15.112:0/3066557018 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3074068a30 con 0x7f3074153700 2024-09-12T02:42:58.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.373+0000 7f3070c00640 1 -- 172.21.15.112:0/3066557018 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f306c015810 con 0x7f3074153700 2024-09-12T02:42:58.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.374+0000 7f3070c00640 1 --2- 172.21.15.112:0/3066557018 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f305006be30 0x7f305006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:58.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.374+0000 7f3070c00640 1 -- 172.21.15.112:0/3066557018 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f306c08b940 con 0x7f3074153700 2024-09-12T02:42:58.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.375+0000 7f3073e00640 1 --2- 172.21.15.112:0/3066557018 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f305006be30 0x7f305006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:58.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.375+0000 7f3070c00640 1 -- 172.21.15.112:0/3066557018 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=34+}) -- 0x7f3050073960 con 0x7f3074153700 2024-09-12T02:42:58.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.375+0000 7f3073e00640 1 --2- 172.21.15.112:0/3066557018 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f305006be30 0x7f305006e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3064032000 tx=0x7f306402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:58.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.379+0000 7f3070c00640 1 -- 172.21.15.112:0/3066557018 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f306c027020 con 0x7f3074153700 2024-09-12T02:42:58.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:58.557+0000 7f307b000640 1 -- 172.21.15.112:0/3066557018 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) -- 0x7f307415c330 con 0x7f3074153700 2024-09-12T02:42:59.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.196+0000 7f3070c00640 1 -- 172.21.15.112:0/3066557018 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v34) ==== 97+0+0 (secure 0 0 0) 0x7f306c010040 con 0x7f3074153700 2024-09-12T02:42:59.197 INFO:teuthology.orchestra.run.smithi112.stderr:pauserd,pausewr is unset 2024-09-12T02:42:59.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.196+0000 7f3070c00640 1 -- 172.21.15.112:0/3066557018 <== mon.0 v2:172.21.15.112:3300/0 8 ==== osd_map(34..34 src has 1..34) ==== 288+0+0 (secure 0 0 0) 0x7f306c057c80 con 0x7f3074153700 2024-09-12T02:42:59.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.196+0000 7f3070c00640 1 -- 172.21.15.112:0/3066557018 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=35}) -- 0x7f30500743a0 con 0x7f3074153700 2024-09-12T02:42:59.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.199+0000 7f307b000640 1 -- 172.21.15.112:0/3066557018 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f305006be30 msgr2=0x7f305006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:59.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.199+0000 7f307b000640 1 --2- 172.21.15.112:0/3066557018 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f305006be30 0x7f305006e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3064032000 tx=0x7f306402e000 comp rx=0 tx=0).stop 2024-09-12T02:42:59.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.199+0000 7f307b000640 1 -- 172.21.15.112:0/3066557018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3074153700 msgr2=0x7f3074154a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:59.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.199+0000 7f307b000640 1 --2- 172.21.15.112:0/3066557018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3074153700 0x7f3074154a60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f30740cf430 tx=0x7f306c00f580 comp rx=0 tx=0).stop 2024-09-12T02:42:59.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.200+0000 7f307b000640 1 -- 172.21.15.112:0/3066557018 shutdown_connections 2024-09-12T02:42:59.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.200+0000 7f307b000640 1 --2- 172.21.15.112:0/3066557018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3074153700 0x7f3074154a60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:59.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.200+0000 7f307b000640 1 --2- 172.21.15.112:0/3066557018 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f305006be30 0x7f305006e2f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:59.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.200+0000 7f307b000640 1 --2- 172.21.15.112:0/3066557018 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3074151670 0x7f30741531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:59.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.200+0000 7f307b000640 1 --2- 172.21.15.112:0/3066557018 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3058003a00 0x7f30741f6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:59.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.200+0000 7f307b000640 1 -- 172.21.15.112:0/3066557018 >> 172.21.15.112:0/3066557018 conn(0x7f307406bbd0 msgr2=0x7f3074072390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:59.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.200+0000 7f307b000640 1 -- 172.21.15.112:0/3066557018 shutdown_connections 2024-09-12T02:42:59.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.200+0000 7f307b000640 1 -- 172.21.15.112:0/3066557018 wait complete. 2024-09-12T02:42:59.218 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:42:59.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.368+0000 7f83f1200640 1 Processor -- start 2024-09-12T02:42:59.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.369+0000 7f83f1200640 1 -- start start 2024-09-12T02:42:59.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.370+0000 7f83f1200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f83ec15cc50 0x7f83ec0732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:59.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.370+0000 7f83f1200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83ec073830 con 0x7f83ec071530 2024-09-12T02:42:59.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.370+0000 7f83f1200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83ec0ceeb0 con 0x7f83ec0afe30 2024-09-12T02:42:59.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.370+0000 7f83f1200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f83ec15d030 con 0x7f83ec15cc50 2024-09-12T02:42:59.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.370+0000 7f83e9e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f83ec15cc50 0x7f83ec0732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:59.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.370+0000 7f83e9400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f83ec071530 0x7f83ec0af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:54842/0 (socket says 172.21.15.112:54842) 2024-09-12T02:42:59.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.370+0000 7f83e9400640 1 -- 172.21.15.112:0/983083819 learned_addr learned my addr 172.21.15.112:0/983083819 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:42:59.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.371+0000 7f83e9e00640 1 -- 172.21.15.112:0/983083819 >> v1:172.21.15.137:6789/0 conn(0x7f83ec0afe30 legacy=0x7f83ec0cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:59.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.370+0000 7f83e8a00640 1 -- 172.21.15.112:0/983083819 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2001610678 0 0) 0x7f83d8001290 con 0x7f83ec071530 2024-09-12T02:42:59.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.371+0000 7f83e9e00640 1 -- 172.21.15.112:0/983083819 >> v1:172.21.15.112:6789/0 conn(0x7f83ec071530 legacy=0x7f83ec0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:59.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.371+0000 7f83e9e00640 1 -- 172.21.15.112:0/983083819 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83ec06e300 con 0x7f83ec15cc50 2024-09-12T02:42:59.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.372+0000 7f83e9e00640 1 --2- 172.21.15.112:0/983083819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83ec15cc50 0x7f83ec0732f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f83dc0097a0 tx=0x7f83dc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c85c9b7e4e59ca6e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:59.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.372+0000 7f83e8a00640 1 -- 172.21.15.112:0/983083819 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83dc037070 con 0x7f83ec15cc50 2024-09-12T02:42:59.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.372+0000 7f83e8a00640 1 -- 172.21.15.112:0/983083819 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83dc032440 con 0x7f83ec15cc50 2024-09-12T02:42:59.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.372+0000 7f83e8a00640 1 -- 172.21.15.112:0/983083819 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83dc032810 con 0x7f83ec15cc50 2024-09-12T02:42:59.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.372+0000 7f83f1200640 1 -- 172.21.15.112:0/983083819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83ec15cc50 msgr2=0x7f83ec0732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:59.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.372+0000 7f83f1200640 1 --2- 172.21.15.112:0/983083819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83ec15cc50 0x7f83ec0732f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f83dc0097a0 tx=0x7f83dc02a1a0 comp rx=0 tx=0).stop 2024-09-12T02:42:59.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.372+0000 7f83f1200640 1 -- 172.21.15.112:0/983083819 shutdown_connections 2024-09-12T02:42:59.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.372+0000 7f83f1200640 1 --2- 172.21.15.112:0/983083819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83ec15cc50 0x7f83ec0732f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:59.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.372+0000 7f83f1200640 1 -- 172.21.15.112:0/983083819 >> 172.21.15.112:0/983083819 conn(0x7f83ec06bbd0 msgr2=0x7f83ec06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:59.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.372+0000 7f83f1200640 1 -- 172.21.15.112:0/983083819 shutdown_connections 2024-09-12T02:42:59.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.373+0000 7f83f1200640 1 -- 172.21.15.112:0/983083819 wait complete. 2024-09-12T02:42:59.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.374+0000 7f83f1200640 1 Processor -- start 2024-09-12T02:42:59.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.374+0000 7f83f1200640 1 -- start start 2024-09-12T02:42:59.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.375+0000 7f83f1200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83ec071530 0x7f83ec14dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:59.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.375+0000 7f83f1200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83ec0afe30 0x7f83ec15a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:59.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.375+0000 7f83f1200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83ec15cc50 0x7f83ec1ea690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:59.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.375+0000 7f83f1200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f83ec0cf150 con 0x7f83ec071530 2024-09-12T02:42:59.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.375+0000 7f83f1200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f83ec0cf4c0 con 0x7f83ec15cc50 2024-09-12T02:42:59.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.375+0000 7f83f1200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f83ec06f510 con 0x7f83ec0afe30 2024-09-12T02:42:59.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.375+0000 7f83e9e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83ec071530 0x7f83ec14dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:59.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.375+0000 7f83e9e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83ec071530 0x7f83ec14dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36136/0 (socket says 172.21.15.112:36136) 2024-09-12T02:42:59.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.375+0000 7f83e9e00640 1 -- 172.21.15.112:0/2623675738 learned_addr learned my addr 172.21.15.112:0/2623675738 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:42:59.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.376+0000 7f83e9400640 1 --2- 172.21.15.112:0/2623675738 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83ec0afe30 0x7f83ec15a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:59.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.376+0000 7f83ea800640 1 --2- 172.21.15.112:0/2623675738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83ec15cc50 0x7f83ec1ea690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:59.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.376+0000 7f83e9e00640 1 -- 172.21.15.112:0/2623675738 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83ec0afe30 msgr2=0x7f83ec15a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:59.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.376+0000 7f83e9e00640 1 --2- 172.21.15.112:0/2623675738 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83ec0afe30 0x7f83ec15a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:59.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.376+0000 7f83e9e00640 1 -- 172.21.15.112:0/2623675738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83ec15cc50 msgr2=0x7f83ec1ea690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:59.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.376+0000 7f83e9e00640 1 --2- 172.21.15.112:0/2623675738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83ec15cc50 0x7f83ec1ea690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:59.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.376+0000 7f83e9e00640 1 -- 172.21.15.112:0/2623675738 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83ec14e100 con 0x7f83ec071530 2024-09-12T02:42:59.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.376+0000 7f83e9e00640 1 --2- 172.21.15.112:0/2623675738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83ec071530 0x7f83ec14dbc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f83dc035040 tx=0x7f83dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:59.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.376+0000 7f83e2000640 1 -- 172.21.15.112:0/2623675738 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83dc037050 con 0x7f83ec071530 2024-09-12T02:42:59.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.376+0000 7f83e2000640 1 -- 172.21.15.112:0/2623675738 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83dc038040 con 0x7f83ec071530 2024-09-12T02:42:59.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.376+0000 7f83e2000640 1 -- 172.21.15.112:0/2623675738 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83dc004490 con 0x7f83ec071530 2024-09-12T02:42:59.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.376+0000 7f83f1200640 1 -- 172.21.15.112:0/2623675738 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83ec1595a0 con 0x7f83ec071530 2024-09-12T02:42:59.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.376+0000 7f83f1200640 1 -- 172.21.15.112:0/2623675738 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83ec159b60 con 0x7f83ec071530 2024-09-12T02:42:59.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.378+0000 7f83f1200640 1 -- 172.21.15.112:0/2623675738 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83ec068a30 con 0x7f83ec071530 2024-09-12T02:42:59.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.378+0000 7f83e2000640 1 -- 172.21.15.112:0/2623675738 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f83dc030900 con 0x7f83ec071530 2024-09-12T02:42:59.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.380+0000 7f83e2000640 1 --2- 172.21.15.112:0/2623675738 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f83cc06be30 0x7f83cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:59.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.380+0000 7f83e2000640 1 -- 172.21.15.112:0/2623675738 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f83dc0ab9c0 con 0x7f83ec071530 2024-09-12T02:42:59.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.380+0000 7f83e9400640 1 --2- 172.21.15.112:0/2623675738 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f83cc06be30 0x7f83cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:59.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.380+0000 7f83e9400640 1 --2- 172.21.15.112:0/2623675738 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f83cc06be30 0x7f83cc06e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f83ec156be0 tx=0x7f83d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:59.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.384+0000 7f83e2000640 1 -- 172.21.15.112:0/2623675738 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f83dc0ade20 con 0x7f83ec071530 2024-09-12T02:42:59.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.559+0000 7f83f1200640 1 -- 172.21.15.112:0/2623675738 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83ec0730d0 con 0x7f83ec071530 2024-09-12T02:42:59.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.560+0000 7f83e2000640 1 -- 172.21.15.112:0/2623675738 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16777 (secure 0 0 0) 0x7f83dc07a520 con 0x7f83ec071530 2024-09-12T02:42:59.561 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:42:59.561 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":34,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:42:59.191807+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:42:44.784846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-12T02:42:45.450666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:42:59.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.562+0000 7f83f1200640 1 -- 172.21.15.112:0/2623675738 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f83cc06be30 msgr2=0x7f83cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:59.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.562+0000 7f83f1200640 1 --2- 172.21.15.112:0/2623675738 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f83cc06be30 0x7f83cc06e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f83ec156be0 tx=0x7f83d8009040 comp rx=0 tx=0).stop 2024-09-12T02:42:59.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.562+0000 7f83f1200640 1 -- 172.21.15.112:0/2623675738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83ec071530 msgr2=0x7f83ec14dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:59.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.562+0000 7f83f1200640 1 --2- 172.21.15.112:0/2623675738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83ec071530 0x7f83ec14dbc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f83dc035040 tx=0x7f83dc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:42:59.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.562+0000 7f83f1200640 1 -- 172.21.15.112:0/2623675738 shutdown_connections 2024-09-12T02:42:59.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.562+0000 7f83f1200640 1 --2- 172.21.15.112:0/2623675738 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f83cc06be30 0x7f83cc06e2f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:59.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.562+0000 7f83f1200640 1 --2- 172.21.15.112:0/2623675738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83ec15cc50 0x7f83ec1ea690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:59.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.562+0000 7f83f1200640 1 --2- 172.21.15.112:0/2623675738 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83ec0afe30 0x7f83ec15a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:59.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.562+0000 7f83f1200640 1 --2- 172.21.15.112:0/2623675738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83ec071530 0x7f83ec14dbc0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:59.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.562+0000 7f83f1200640 1 -- 172.21.15.112:0/2623675738 >> 172.21.15.112:0/2623675738 conn(0x7f83ec06bbd0 msgr2=0x7f83ec06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:59.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.562+0000 7f83f1200640 1 -- 172.21.15.112:0/2623675738 shutdown_connections 2024-09-12T02:42:59.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59.562+0000 7f83f1200640 1 -- 172.21.15.112:0/2623675738 wait complete. 2024-09-12T02:42:59.579 DEBUG:teuthology.orchestra.run.smithi112:> stdin-killer -- python3 -c ' 2024-09-12T02:42:59.579 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-12T02:42:59.579 DEBUG:teuthology.orchestra.run.smithi112:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-12T02:42:59.580 DEBUG:teuthology.orchestra.run.smithi112:> os.fchmod(fd, 0O666) 2024-09-12T02:42:59.580 DEBUG:teuthology.orchestra.run.smithi112:> os.fsync(fd) 2024-09-12T02:42:59.580 DEBUG:teuthology.orchestra.run.smithi112:> os.close(fd) 2024-09-12T02:42:59.580 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-12T02:42:59.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:59.692 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:42:59.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:42:59.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:59.820 INFO:teuthology.orchestra.run.smithi112.stdout:client4634 2024-09-12T02:42:59.820 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/7c01f3b3-dec2-4449-a33f-f960d7527ea6.client4634/osdmap') 2024-09-12T02:42:59.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:42:59.918 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 32 barrier 32 flags 0x588000 2024-09-12T02:42:59.918 INFO:teuthology.orchestra.run.smithi112.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-12T02:42:59.918 INFO:teuthology.orchestra.run.smithi112.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-12T02:42:59.919 INFO:teuthology.orchestra.run.smithi112.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-12T02:42:59.919 INFO:teuthology.orchestra.run.smithi112.stdout:osd0 (2)172.21.15.112:6800 100% (exists, up) 100% -1 2024-09-12T02:42:59.919 INFO:teuthology.orchestra.run.smithi112.stdout:osd1 (2)172.21.15.112:6808 100% (exists, up) 100% -1 2024-09-12T02:42:59.919 INFO:teuthology.orchestra.run.smithi112.stdout:osd2 (2)172.21.15.112:6816 100% (exists, up) 100% -1 2024-09-12T02:42:59.919 INFO:teuthology.orchestra.run.smithi112.stdout:osd3 (2)172.21.15.112:6824 100% (exists, up) 100% -1 2024-09-12T02:42:59.919 INFO:teuthology.orchestra.run.smithi112.stdout:osd4 (2)172.21.15.137:6800 100% (exists, up) 100% -1 2024-09-12T02:42:59.919 INFO:teuthology.orchestra.run.smithi112.stdout:osd5 (2)172.21.15.137:6808 100% (exists, up) 100% -1 2024-09-12T02:42:59.919 INFO:teuthology.orchestra.run.smithi112.stdout:osd6 (2)172.21.15.137:6813 100% (exists, up) 100% -1 2024-09-12T02:42:59.919 INFO:teuthology.orchestra.run.smithi112.stdout:osd7 (2)172.21.15.137:6824 100% (exists, up) 100% -1 2024-09-12T02:42:59.919 INFO:teuthology.orchestra.run.smithi112.stderr:1+1 records in 2024-09-12T02:42:59.920 INFO:teuthology.orchestra.run.smithi112.stderr:1+1 records out 2024-09-12T02:42:59.920 INFO:teuthology.orchestra.run.smithi112.stderr:799 bytes copied, 8.1968e-05 s, 9.7 MB/s 2024-09-12T02:42:59.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:42:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:42:59.929 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:43:00.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.080+0000 7fdb76800640 1 Processor -- start 2024-09-12T02:43:00.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.081+0000 7fdb76800640 1 -- start start 2024-09-12T02:43:00.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.082+0000 7fdb76800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb7015b9d0 0x7fdb700b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:00.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.082+0000 7fdb76800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdb700b45d0 0x7fdb700728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:00.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.082+0000 7fdb76800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb700b54a0 con 0x7fdb7006eef0 2024-09-12T02:43:00.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.082+0000 7fdb76800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fdb700b4a30 con 0x7fdb700b45d0 2024-09-12T02:43:00.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.082+0000 7fdb76800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdb700b3af0 con 0x7fdb7015b9d0 2024-09-12T02:43:00.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.082+0000 7fdb6fe00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fdb7006eef0 0x7fdb7006f300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:54856/0 (socket says 172.21.15.112:54856) 2024-09-12T02:43:00.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.082+0000 7fdb66a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdb700b45d0 0x7fdb700728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:00.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.082+0000 7fdb6fe00640 1 -- 172.21.15.112:0/225195200 learned_addr learned my addr 172.21.15.112:0/225195200 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:00.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.082+0000 7fdb6f400640 1 --2- 172.21.15.112:0/225195200 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb7015b9d0 0x7fdb700b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:00.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.083+0000 7fdb6ea00640 1 -- 172.21.15.112:0/225195200 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1660166579 0 0) 0x7fdb700b54a0 con 0x7fdb7006eef0 2024-09-12T02:43:00.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.083+0000 7fdb66a00640 1 -- 172.21.15.112:0/225195200 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb7015b9d0 msgr2=0x7fdb700b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:00.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.083+0000 7fdb66a00640 1 --2- 172.21.15.112:0/225195200 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb7015b9d0 0x7fdb700b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:00.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.083+0000 7fdb66a00640 1 -- 172.21.15.112:0/225195200 >> v1:172.21.15.112:6789/0 conn(0x7fdb7006eef0 legacy=0x7fdb7006f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:00.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.083+0000 7fdb66a00640 1 -- 172.21.15.112:0/225195200 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb700b3dd0 con 0x7fdb700b45d0 2024-09-12T02:43:00.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.084+0000 7fdb66a00640 1 --2- 172.21.15.112:0/225195200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb700b45d0 0x7fdb700728c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdb58009790 tx=0x7fdb5802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5efc40b58a093ea4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:00.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.084+0000 7fdb6ea00640 1 -- 172.21.15.112:0/225195200 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb58037070 con 0x7fdb700b45d0 2024-09-12T02:43:00.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.084+0000 7fdb6ea00640 1 -- 172.21.15.112:0/225195200 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb58032440 con 0x7fdb700b45d0 2024-09-12T02:43:00.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.084+0000 7fdb6ea00640 1 -- 172.21.15.112:0/225195200 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb58032810 con 0x7fdb700b45d0 2024-09-12T02:43:00.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.084+0000 7fdb76800640 1 -- 172.21.15.112:0/225195200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb700b45d0 msgr2=0x7fdb700728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:00.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.084+0000 7fdb76800640 1 --2- 172.21.15.112:0/225195200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb700b45d0 0x7fdb700728c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdb58009790 tx=0x7fdb5802a180 comp rx=0 tx=0).stop 2024-09-12T02:43:00.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.085+0000 7fdb76800640 1 -- 172.21.15.112:0/225195200 shutdown_connections 2024-09-12T02:43:00.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.085+0000 7fdb76800640 1 --2- 172.21.15.112:0/225195200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb700b45d0 0x7fdb700728c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:00.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.085+0000 7fdb76800640 1 --2- 172.21.15.112:0/225195200 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb7015b9d0 0x7fdb700b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:00.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.085+0000 7fdb76800640 1 -- 172.21.15.112:0/225195200 >> 172.21.15.112:0/225195200 conn(0x7fdb7006bbd0 msgr2=0x7fdb7006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:00.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.085+0000 7fdb76800640 1 -- 172.21.15.112:0/225195200 shutdown_connections 2024-09-12T02:43:00.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.085+0000 7fdb76800640 1 -- 172.21.15.112:0/225195200 wait complete. 2024-09-12T02:43:00.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.086+0000 7fdb76800640 1 Processor -- start 2024-09-12T02:43:00.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.086+0000 7fdb76800640 1 -- start start 2024-09-12T02:43:00.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.087+0000 7fdb76800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb7006eef0 0x7fdb70154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:00.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.087+0000 7fdb76800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb700b45d0 0x7fdb7015a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:00.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.087+0000 7fdb76800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb7015b9d0 0x7fdb701535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:00.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.087+0000 7fdb76800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7015bf30 con 0x7fdb700b45d0 2024-09-12T02:43:00.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.087+0000 7fdb76800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7015bdb0 con 0x7fdb7015b9d0 2024-09-12T02:43:00.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.087+0000 7fdb76800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdb700cdcd0 con 0x7fdb7006eef0 2024-09-12T02:43:00.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.087+0000 7fdb66a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb700b45d0 0x7fdb7015a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:00.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.088+0000 7fdb66a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb700b45d0 0x7fdb7015a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36148/0 (socket says 172.21.15.112:36148) 2024-09-12T02:43:00.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.088+0000 7fdb66a00640 1 -- 172.21.15.112:0/4074140747 learned_addr learned my addr 172.21.15.112:0/4074140747 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:00.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.088+0000 7fdb6f400640 1 --2- 172.21.15.112:0/4074140747 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb7006eef0 0x7fdb70154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:00.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.088+0000 7fdb6fe00640 1 --2- 172.21.15.112:0/4074140747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb7015b9d0 0x7fdb701535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:00.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.088+0000 7fdb66a00640 1 -- 172.21.15.112:0/4074140747 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb7006eef0 msgr2=0x7fdb70154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:00.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.088+0000 7fdb66a00640 1 --2- 172.21.15.112:0/4074140747 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb7006eef0 0x7fdb70154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:00.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.088+0000 7fdb66a00640 1 -- 172.21.15.112:0/4074140747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb7015b9d0 msgr2=0x7fdb701535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:00.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.088+0000 7fdb66a00640 1 --2- 172.21.15.112:0/4074140747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb7015b9d0 0x7fdb701535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:00.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.088+0000 7fdb66a00640 1 -- 172.21.15.112:0/4074140747 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb70154750 con 0x7fdb700b45d0 2024-09-12T02:43:00.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.088+0000 7fdb6fe00640 1 --2- 172.21.15.112:0/4074140747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb7015b9d0 0x7fdb701535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:43:00.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.088+0000 7fdb66a00640 1 --2- 172.21.15.112:0/4074140747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb700b45d0 0x7fdb7015a280 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdb58035040 tx=0x7fdb580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:00.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.088+0000 7fdb67e00640 1 -- 172.21.15.112:0/4074140747 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb58037040 con 0x7fdb700b45d0 2024-09-12T02:43:00.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.088+0000 7fdb67e00640 1 -- 172.21.15.112:0/4074140747 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb58005bd0 con 0x7fdb700b45d0 2024-09-12T02:43:00.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.088+0000 7fdb76800640 1 -- 172.21.15.112:0/4074140747 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb701549f0 con 0x7fdb700b45d0 2024-09-12T02:43:00.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.088+0000 7fdb67e00640 1 -- 172.21.15.112:0/4074140747 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb58006030 con 0x7fdb700b45d0 2024-09-12T02:43:00.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.089+0000 7fdb76800640 1 -- 172.21.15.112:0/4074140747 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb70152de0 con 0x7fdb700b45d0 2024-09-12T02:43:00.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.090+0000 7fdb76800640 1 -- 172.21.15.112:0/4074140747 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb7006dbc0 con 0x7fdb700b45d0 2024-09-12T02:43:00.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.090+0000 7fdb67e00640 1 -- 172.21.15.112:0/4074140747 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb580061d0 con 0x7fdb700b45d0 2024-09-12T02:43:00.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.091+0000 7fdb67e00640 1 --2- 172.21.15.112:0/4074140747 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdb4c06be30 0x7fdb4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:00.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.091+0000 7fdb67e00640 1 -- 172.21.15.112:0/4074140747 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fdb580ab660 con 0x7fdb700b45d0 2024-09-12T02:43:00.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.091+0000 7fdb6f400640 1 --2- 172.21.15.112:0/4074140747 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdb4c06be30 0x7fdb4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:00.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.092+0000 7fdb6f400640 1 --2- 172.21.15.112:0/4074140747 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdb4c06be30 0x7fdb4c06e2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdb70155f90 tx=0x7fdb60009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:00.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.096+0000 7fdb67e00640 1 -- 172.21.15.112:0/4074140747 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdb58079f70 con 0x7fdb700b45d0 2024-09-12T02:43:00.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.302+0000 7fdb76800640 1 -- 172.21.15.112:0/4074140747 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb70152090 con 0x7fdb700b45d0 2024-09-12T02:43:00.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.303+0000 7fdb67e00640 1 -- 172.21.15.112:0/4074140747 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5232 (secure 0 0 0) 0x7fdb58079870 con 0x7fdb700b45d0 2024-09-12T02:43:00.304 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:00.304 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":18,"btime":"2024-09-12T02:42:50:089881+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/2907398106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2907398106},{"type":"v1","addr":"172.21.15.112:6836","nonce":2907398106}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3325408635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3325408635},{"type":"v1","addr":"172.21.15.137:6835","nonce":3325408635}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4678,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3355910952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3355910952},{"type":"v1","addr":"172.21.15.137:6833","nonce":3355910952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:42:46.463211+0000","modified":"2024-09-12T02:42:49.497590+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4761},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4761":{"gid":4761,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.112:6837/917811402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":917811402},{"type":"v1","addr":"172.21.15.112:6837","nonce":917811402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4761,"qdb_cluster":[4761]},"id":2}]} 2024-09-12T02:43:00.304 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 18 2024-09-12T02:43:00.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.305+0000 7fdb76800640 1 -- 172.21.15.112:0/4074140747 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdb4c06be30 msgr2=0x7fdb4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:00.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.305+0000 7fdb76800640 1 --2- 172.21.15.112:0/4074140747 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdb4c06be30 0x7fdb4c06e2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdb70155f90 tx=0x7fdb60009190 comp rx=0 tx=0).stop 2024-09-12T02:43:00.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.305+0000 7fdb76800640 1 -- 172.21.15.112:0/4074140747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb700b45d0 msgr2=0x7fdb7015a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:00.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.305+0000 7fdb76800640 1 --2- 172.21.15.112:0/4074140747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb700b45d0 0x7fdb7015a280 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdb58035040 tx=0x7fdb580046c0 comp rx=0 tx=0).stop 2024-09-12T02:43:00.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.305+0000 7fdb76800640 1 -- 172.21.15.112:0/4074140747 shutdown_connections 2024-09-12T02:43:00.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.305+0000 7fdb76800640 1 --2- 172.21.15.112:0/4074140747 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdb4c06be30 0x7fdb4c06e2f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:00.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.305+0000 7fdb76800640 1 --2- 172.21.15.112:0/4074140747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb7015b9d0 0x7fdb701535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:00.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.305+0000 7fdb76800640 1 --2- 172.21.15.112:0/4074140747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb700b45d0 0x7fdb7015a280 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:00.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.305+0000 7fdb76800640 1 --2- 172.21.15.112:0/4074140747 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb7006eef0 0x7fdb70154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:00.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.305+0000 7fdb76800640 1 -- 172.21.15.112:0/4074140747 >> 172.21.15.112:0/4074140747 conn(0x7fdb7006bbd0 msgr2=0x7fdb700b54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:00.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.305+0000 7fdb76800640 1 -- 172.21.15.112:0/4074140747 shutdown_connections 2024-09-12T02:43:00.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00.305+0000 7fdb76800640 1 -- 172.21.15.112:0/4074140747 wait complete. 2024-09-12T02:43:00.321 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json osdmap barrier 34 2024-09-12T02:43:00.492 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2024-09-12T02:43:00.492 DEBUG:teuthology.orchestra.run.smithi112:> stdin-killer -- python3 -c ' 2024-09-12T02:43:00.492 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-12T02:43:00.492 DEBUG:teuthology.orchestra.run.smithi112:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-12T02:43:00.492 DEBUG:teuthology.orchestra.run.smithi112:> os.fchmod(fd, 0O666) 2024-09-12T02:43:00.492 DEBUG:teuthology.orchestra.run.smithi112:> os.fsync(fd) 2024-09-12T02:43:00.492 DEBUG:teuthology.orchestra.run.smithi112:> os.close(fd) 2024-09-12T02:43:00.492 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-12T02:43:00.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:43:00.606 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:43:00.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:43:00.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:43:00.735 INFO:teuthology.orchestra.run.smithi112.stdout:client4634 2024-09-12T02:43:00.735 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/7c01f3b3-dec2-4449-a33f-f960d7527ea6.client4634/osdmap') 2024-09-12T02:43:00.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:43:00.833 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 34 barrier 34 flags 0x588000 2024-09-12T02:43:00.833 INFO:teuthology.orchestra.run.smithi112.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-12T02:43:00.833 INFO:teuthology.orchestra.run.smithi112.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-12T02:43:00.833 INFO:teuthology.orchestra.run.smithi112.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-12T02:43:00.833 INFO:teuthology.orchestra.run.smithi112.stdout:osd0 (2)172.21.15.112:6800 100% (exists, up) 100% -1 2024-09-12T02:43:00.833 INFO:teuthology.orchestra.run.smithi112.stdout:osd1 (2)172.21.15.112:6808 100% (exists, up) 100% -1 2024-09-12T02:43:00.833 INFO:teuthology.orchestra.run.smithi112.stdout:osd2 (2)172.21.15.112:6816 100% (exists, up) 100% -1 2024-09-12T02:43:00.834 INFO:teuthology.orchestra.run.smithi112.stdout:osd3 (2)172.21.15.112:6824 100% (exists, up) 100% -1 2024-09-12T02:43:00.834 INFO:teuthology.orchestra.run.smithi112.stdout:osd4 (2)172.21.15.137:6800 100% (exists, up) 100% -1 2024-09-12T02:43:00.834 INFO:teuthology.orchestra.run.smithi112.stdout:osd5 (2)172.21.15.137:6808 100% (exists, up) 100% -1 2024-09-12T02:43:00.834 INFO:teuthology.orchestra.run.smithi112.stdout:osd6 (2)172.21.15.137:6813 100% (exists, up) 100% -1 2024-09-12T02:43:00.834 INFO:teuthology.orchestra.run.smithi112.stdout:osd7 (2)172.21.15.137:6824 100% (exists, up) 100% -1 2024-09-12T02:43:00.834 INFO:teuthology.orchestra.run.smithi112.stderr:1+1 records in 2024-09-12T02:43:00.834 INFO:teuthology.orchestra.run.smithi112.stderr:1+1 records out 2024-09-12T02:43:00.834 INFO:teuthology.orchestra.run.smithi112.stderr:799 bytes copied, 8.5469e-05 s, 9.3 MB/s 2024-09-12T02:43:00.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:43:00.844 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:43:00.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:43:00.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:43:00.933 INFO:teuthology.orchestra.run.smithi112.stdout:client4634 2024-09-12T02:43:00.933 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/7c01f3b3-dec2-4449-a33f-f960d7527ea6.client4634/osdmap') 2024-09-12T02:43:01.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:43:01.032 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 34 barrier 34 flags 0x588000 2024-09-12T02:43:01.032 INFO:teuthology.orchestra.run.smithi112.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-12T02:43:01.032 INFO:teuthology.orchestra.run.smithi112.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-12T02:43:01.032 INFO:teuthology.orchestra.run.smithi112.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-12T02:43:01.032 INFO:teuthology.orchestra.run.smithi112.stdout:osd0 (2)172.21.15.112:6800 100% (exists, up) 100% -1 2024-09-12T02:43:01.032 INFO:teuthology.orchestra.run.smithi112.stdout:osd1 (2)172.21.15.112:6808 100% (exists, up) 100% -1 2024-09-12T02:43:01.033 INFO:teuthology.orchestra.run.smithi112.stdout:osd2 (2)172.21.15.112:6816 100% (exists, up) 100% -1 2024-09-12T02:43:01.033 INFO:teuthology.orchestra.run.smithi112.stdout:osd3 (2)172.21.15.112:6824 100% (exists, up) 100% -1 2024-09-12T02:43:01.033 INFO:teuthology.orchestra.run.smithi112.stdout:osd4 (2)172.21.15.137:6800 100% (exists, up) 100% -1 2024-09-12T02:43:01.033 INFO:teuthology.orchestra.run.smithi112.stdout:osd5 (2)172.21.15.137:6808 100% (exists, up) 100% -1 2024-09-12T02:43:01.033 INFO:teuthology.orchestra.run.smithi112.stdout:osd6 (2)172.21.15.137:6813 100% (exists, up) 100% -1 2024-09-12T02:43:01.033 INFO:teuthology.orchestra.run.smithi112.stdout:osd7 (2)172.21.15.137:6824 100% (exists, up) 100% -1 2024-09-12T02:43:01.033 INFO:teuthology.orchestra.run.smithi112.stderr:1+1 records in 2024-09-12T02:43:01.033 INFO:teuthology.orchestra.run.smithi112.stderr:1+1 records out 2024-09-12T02:43:01.033 INFO:teuthology.orchestra.run.smithi112.stderr:799 bytes copied, 6.5882e-05 s, 12.1 MB/s 2024-09-12T02:43:01.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:43:01.045 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:43:01.045 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:43:01.045 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:43:01.146 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:43:01.238 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:43:01.238 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:43:01.239 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:43:01.239 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:43:01.274 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:43:01.274 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:43:01.350 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:43:01.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.542+0000 7fa0e7600640 1 Processor -- start 2024-09-12T02:43:01.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.542+0000 7fa0e7600640 1 -- start start 2024-09-12T02:43:01.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.543+0000 7fa0e7600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa0e0072cd0 0x7fa0e006cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:01.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.543+0000 7fa0e7600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0e00d1850 0x7fa0e006ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:01.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.543+0000 7fa0e7600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0e006bd00 con 0x7fa0e00730b0 2024-09-12T02:43:01.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.543+0000 7fa0e7600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa0e006c630 con 0x7fa0e0072cd0 2024-09-12T02:43:01.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.543+0000 7fa0e7600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa0e006bfe0 con 0x7fa0e00d1850 2024-09-12T02:43:01.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.544+0000 7fa0e4c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa0e0072cd0 0x7fa0e006cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:01.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.544+0000 7fa0dfe00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa0e00730b0 0x7fa0e00d1140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:54870/0 (socket says 172.21.15.112:54870) 2024-09-12T02:43:01.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.544+0000 7fa0dfe00640 1 -- 172.21.15.112:0/1925437801 learned_addr learned my addr 172.21.15.112:0/1925437801 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:01.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.544+0000 7fa0e6000640 1 --2- 172.21.15.112:0/1925437801 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0e00d1850 0x7fa0e006ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:01.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.544+0000 7fa0e4c00640 1 -- 172.21.15.112:0/1925437801 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0e00d1850 msgr2=0x7fa0e006ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:01.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.544+0000 7fa0e4c00640 1 --2- 172.21.15.112:0/1925437801 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0e00d1850 0x7fa0e006ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.544+0000 7fa0e4c00640 1 -- 172.21.15.112:0/1925437801 >> v1:172.21.15.112:6789/0 conn(0x7fa0e00730b0 legacy=0x7fa0e00d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:01.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.544+0000 7fa0e4c00640 1 -- 172.21.15.112:0/1925437801 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e006c2c0 con 0x7fa0e0072cd0 2024-09-12T02:43:01.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.544+0000 7fa0df400640 1 -- 172.21.15.112:0/1925437801 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1952326744 0 0) 0x7fa0e006bd00 con 0x7fa0e00730b0 2024-09-12T02:43:01.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.545+0000 7fa0e4c00640 1 --2- 172.21.15.112:0/1925437801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0e0072cd0 0x7fa0e006cac0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa0d40097a0 tx=0x7fa0d402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d384a83c86730071 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:01.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.545+0000 7fa0df400640 1 -- 172.21.15.112:0/1925437801 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4037070 con 0x7fa0e0072cd0 2024-09-12T02:43:01.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.545+0000 7fa0df400640 1 -- 172.21.15.112:0/1925437801 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0d402ae50 con 0x7fa0e0072cd0 2024-09-12T02:43:01.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.545+0000 7fa0df400640 1 -- 172.21.15.112:0/1925437801 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4032660 con 0x7fa0e0072cd0 2024-09-12T02:43:01.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.546+0000 7fa0e7600640 1 -- 172.21.15.112:0/1925437801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0e0072cd0 msgr2=0x7fa0e006cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:01.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.546+0000 7fa0e7600640 1 --2- 172.21.15.112:0/1925437801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0e0072cd0 0x7fa0e006cac0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa0d40097a0 tx=0x7fa0d402a100 comp rx=0 tx=0).stop 2024-09-12T02:43:01.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.546+0000 7fa0e7600640 1 -- 172.21.15.112:0/1925437801 shutdown_connections 2024-09-12T02:43:01.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.546+0000 7fa0e7600640 1 --2- 172.21.15.112:0/1925437801 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0e00d1850 0x7fa0e006ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.546+0000 7fa0e7600640 1 --2- 172.21.15.112:0/1925437801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0e0072cd0 0x7fa0e006cac0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.546+0000 7fa0e7600640 1 -- 172.21.15.112:0/1925437801 >> 172.21.15.112:0/1925437801 conn(0x7fa0e00d2180 msgr2=0x7fa0e00d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:01.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.546+0000 7fa0e7600640 1 -- 172.21.15.112:0/1925437801 shutdown_connections 2024-09-12T02:43:01.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.546+0000 7fa0e7600640 1 -- 172.21.15.112:0/1925437801 wait complete. 2024-09-12T02:43:01.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.548+0000 7fa0e7600640 1 Processor -- start 2024-09-12T02:43:01.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.548+0000 7fa0e7600640 1 -- start start 2024-09-12T02:43:01.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.549+0000 7fa0e7600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0e0072cd0 0x7fa0e00b5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:01.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.549+0000 7fa0e7600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0e00730b0 0x7fa0e00b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:01.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.549+0000 7fa0e7600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0e00d1850 0x7fa0e0153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:01.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.549+0000 7fa0e7600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e015f280 con 0x7fa0e00d1850 2024-09-12T02:43:01.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.549+0000 7fa0e7600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e0073540 con 0x7fa0e0072cd0 2024-09-12T02:43:01.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.549+0000 7fa0e7600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa0e015f400 con 0x7fa0e00730b0 2024-09-12T02:43:01.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.549+0000 7fa0e6000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0e00d1850 0x7fa0e0153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:01.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.549+0000 7fa0e6000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0e00d1850 0x7fa0e0153fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36162/0 (socket says 172.21.15.112:36162) 2024-09-12T02:43:01.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.549+0000 7fa0e6000640 1 -- 172.21.15.112:0/361275647 learned_addr learned my addr 172.21.15.112:0/361275647 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:01.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.549+0000 7fa0e4c00640 1 --2- 172.21.15.112:0/361275647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0e0072cd0 0x7fa0e00b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:01.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.549+0000 7fa0dfe00640 1 --2- 172.21.15.112:0/361275647 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0e00730b0 0x7fa0e00b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:01.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.549+0000 7fa0e6000640 1 -- 172.21.15.112:0/361275647 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0e00730b0 msgr2=0x7fa0e00b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:01.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.549+0000 7fa0e6000640 1 --2- 172.21.15.112:0/361275647 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0e00730b0 0x7fa0e00b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.549+0000 7fa0e6000640 1 -- 172.21.15.112:0/361275647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0e0072cd0 msgr2=0x7fa0e00b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:01.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.549+0000 7fa0e6000640 1 --2- 172.21.15.112:0/361275647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0e0072cd0 0x7fa0e00b5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.549+0000 7fa0e6000640 1 -- 172.21.15.112:0/361275647 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e0154990 con 0x7fa0e00d1850 2024-09-12T02:43:01.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.550+0000 7fa0e6000640 1 --2- 172.21.15.112:0/361275647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0e00d1850 0x7fa0e0153fc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8007d90 tx=0x7fa0d800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:01.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.550+0000 7fa0dcc00640 1 -- 172.21.15.112:0/361275647 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d8014420 con 0x7fa0e00d1850 2024-09-12T02:43:01.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.550+0000 7fa0dcc00640 1 -- 172.21.15.112:0/361275647 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0d8019070 con 0x7fa0e00d1850 2024-09-12T02:43:01.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.550+0000 7fa0dcc00640 1 -- 172.21.15.112:0/361275647 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d8014820 con 0x7fa0e00d1850 2024-09-12T02:43:01.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.550+0000 7fa0e7600640 1 -- 172.21.15.112:0/361275647 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0e00b3d50 con 0x7fa0e00d1850 2024-09-12T02:43:01.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.550+0000 7fa0e7600640 1 -- 172.21.15.112:0/361275647 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0e00b4310 con 0x7fa0e00d1850 2024-09-12T02:43:01.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.551+0000 7fa0e7600640 1 -- 172.21.15.112:0/361275647 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0e0068a30 con 0x7fa0e00d1850 2024-09-12T02:43:01.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.552+0000 7fa0dcc00640 1 -- 172.21.15.112:0/361275647 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa0d80149c0 con 0x7fa0e00d1850 2024-09-12T02:43:01.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.553+0000 7fa0dcc00640 1 --2- 172.21.15.112:0/361275647 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa0c006be30 0x7fa0c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:01.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.553+0000 7fa0dcc00640 1 -- 172.21.15.112:0/361275647 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fa0d808b4d0 con 0x7fa0e00d1850 2024-09-12T02:43:01.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.553+0000 7fa0e4c00640 1 --2- 172.21.15.112:0/361275647 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa0c006be30 0x7fa0c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:01.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.554+0000 7fa0e4c00640 1 --2- 172.21.15.112:0/361275647 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa0c006be30 0x7fa0c006e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4034000 tx=0x7fa0d402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:01.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.558+0000 7fa0dcc00640 1 -- 172.21.15.112:0/361275647 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa0e0154990 con 0x7fa0e00d1850 2024-09-12T02:43:01.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.740+0000 7fa0e7600640 1 -- 172.21.15.112:0/361275647 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa0e006bd00 con 0x7fa0e00d1850 2024-09-12T02:43:01.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.740+0000 7fa0dcc00640 1 -- 172.21.15.112:0/361275647 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7fa0d80598c0 con 0x7fa0e00d1850 2024-09-12T02:43:01.741 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-12T02:43:01.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.742+0000 7fa0e7600640 1 -- 172.21.15.112:0/361275647 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa0c006be30 msgr2=0x7fa0c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:01.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.742+0000 7fa0e7600640 1 --2- 172.21.15.112:0/361275647 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa0c006be30 0x7fa0c006e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4034000 tx=0x7fa0d402e000 comp rx=0 tx=0).stop 2024-09-12T02:43:01.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.742+0000 7fa0e7600640 1 -- 172.21.15.112:0/361275647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0e00d1850 msgr2=0x7fa0e0153fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:01.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.742+0000 7fa0e7600640 1 --2- 172.21.15.112:0/361275647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0e00d1850 0x7fa0e0153fc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8007d90 tx=0x7fa0d800e4b0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.742+0000 7fa0e7600640 1 -- 172.21.15.112:0/361275647 shutdown_connections 2024-09-12T02:43:01.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.742+0000 7fa0e7600640 1 --2- 172.21.15.112:0/361275647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0e00d1850 0x7fa0e0153fc0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.742+0000 7fa0e7600640 1 --2- 172.21.15.112:0/361275647 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0e00730b0 0x7fa0e00b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.742+0000 7fa0e7600640 1 --2- 172.21.15.112:0/361275647 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa0c006be30 0x7fa0c006e2f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.742+0000 7fa0e7600640 1 --2- 172.21.15.112:0/361275647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0e0072cd0 0x7fa0e00b5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:01.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.742+0000 7fa0e7600640 1 -- 172.21.15.112:0/361275647 >> 172.21.15.112:0/361275647 conn(0x7fa0e00d2180 msgr2=0x7fa0e00b13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:01.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.742+0000 7fa0e7600640 1 -- 172.21.15.112:0/361275647 shutdown_connections 2024-09-12T02:43:01.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:01.743+0000 7fa0e7600640 1 -- 172.21.15.112:0/361275647 wait complete. 2024-09-12T02:43:01.759 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:43:01.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:43:01.759 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T02:43:01.839 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-12T02:43:01.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:43:01.839 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:43:01.886 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:43:01.887 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:43:01.887 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:43:01.928 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:43:01.928 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:43:02.007 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:43:02.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.162+0000 7f673f800640 1 Processor -- start 2024-09-12T02:43:02.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.162+0000 7f673f800640 1 -- start start 2024-09-12T02:43:02.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.163+0000 7f673f800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f67380afe30 0x7f67380cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:02.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.163+0000 7f673f800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67380ceeb0 con 0x7f673815cc50 2024-09-12T02:43:02.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.163+0000 7f673f800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f673806e300 con 0x7f6738071530 2024-09-12T02:43:02.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.163+0000 7f673f800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f673815d030 con 0x7f67380afe30 2024-09-12T02:43:02.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.164+0000 7f673ce00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f673815cc50 0x7f67380732f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47018/0 (socket says 172.21.15.112:47018) 2024-09-12T02:43:02.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.164+0000 7f673ce00640 1 -- 172.21.15.112:0/2990819327 learned_addr learned my addr 172.21.15.112:0/2990819327 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:02.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.164+0000 7f673d800640 1 --2- 172.21.15.112:0/2990819327 >> v2:172.21.15.112:3300/0 conn(0x7f67380afe30 0x7f67380cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:02.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.164+0000 7f6737e00640 1 -- 172.21.15.112:0/2990819327 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 20233399 0 0) 0x7f67380ceeb0 con 0x7f673815cc50 2024-09-12T02:43:02.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.164+0000 7f6737e00640 1 -- 172.21.15.112:0/2990819327 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f671c003520 con 0x7f673815cc50 2024-09-12T02:43:02.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.164+0000 7f673d800640 1 -- 172.21.15.112:0/2990819327 >> v1:172.21.15.137:6789/0 conn(0x7f6738071530 legacy=0x7f67380af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:02.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.164+0000 7f673d800640 1 -- 172.21.15.112:0/2990819327 >> v1:172.21.15.112:6789/0 conn(0x7f673815cc50 legacy=0x7f67380732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:02.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.164+0000 7f673d800640 1 -- 172.21.15.112:0/2990819327 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f673806e5e0 con 0x7f67380afe30 2024-09-12T02:43:02.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.165+0000 7f673d800640 1 --2- 172.21.15.112:0/2990819327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67380afe30 0x7f67380cf950 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6730009d90 tx=0x7f673002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f268188956a93f08 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:02.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.165+0000 7f6737e00640 1 -- 172.21.15.112:0/2990819327 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6730031600 con 0x7f67380afe30 2024-09-12T02:43:02.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.165+0000 7f6737e00640 1 -- 172.21.15.112:0/2990819327 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67300317a0 con 0x7f67380afe30 2024-09-12T02:43:02.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.166+0000 7f6737e00640 1 -- 172.21.15.112:0/2990819327 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6730031b70 con 0x7f67380afe30 2024-09-12T02:43:02.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.166+0000 7f673f800640 1 -- 172.21.15.112:0/2990819327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67380afe30 msgr2=0x7f67380cf950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:02.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.166+0000 7f673f800640 1 --2- 172.21.15.112:0/2990819327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67380afe30 0x7f67380cf950 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6730009d90 tx=0x7f673002a610 comp rx=0 tx=0).stop 2024-09-12T02:43:02.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.166+0000 7f673f800640 1 -- 172.21.15.112:0/2990819327 shutdown_connections 2024-09-12T02:43:02.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.166+0000 7f673f800640 1 --2- 172.21.15.112:0/2990819327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67380afe30 0x7f67380cf950 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:02.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.166+0000 7f673f800640 1 -- 172.21.15.112:0/2990819327 >> 172.21.15.112:0/2990819327 conn(0x7f673806bbd0 msgr2=0x7f673806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:02.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.166+0000 7f673f800640 1 -- 172.21.15.112:0/2990819327 shutdown_connections 2024-09-12T02:43:02.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.166+0000 7f673f800640 1 -- 172.21.15.112:0/2990819327 wait complete. 2024-09-12T02:43:02.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.168+0000 7f673f800640 1 Processor -- start 2024-09-12T02:43:02.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.168+0000 7f673f800640 1 -- start start 2024-09-12T02:43:02.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.169+0000 7f673f800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6738071530 0x7f67381599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:02.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.169+0000 7f673f800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f67380afe30 0x7f673814f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:02.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.169+0000 7f673f800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f673815cc50 0x7f67381f5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:02.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.169+0000 7f673f800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f673806f510 con 0x7f6738071530 2024-09-12T02:43:02.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.169+0000 7f673f800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f67380cf4c0 con 0x7f673815cc50 2024-09-12T02:43:02.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.169+0000 7f673f800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f673806f690 con 0x7f67380afe30 2024-09-12T02:43:02.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.169+0000 7f673ce00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6738071530 0x7f67381599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:02.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.169+0000 7f673ce00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6738071530 0x7f67381599b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34904/0 (socket says 172.21.15.112:34904) 2024-09-12T02:43:02.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.169+0000 7f673ce00640 1 -- 172.21.15.112:0/3589165671 learned_addr learned my addr 172.21.15.112:0/3589165671 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:02.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.169+0000 7f673d800640 1 --2- 172.21.15.112:0/3589165671 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f673815cc50 0x7f67381f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:02.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.169+0000 7f672fe00640 1 --2- 172.21.15.112:0/3589165671 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f67380afe30 0x7f673814f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:02.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.169+0000 7f673ce00640 1 -- 172.21.15.112:0/3589165671 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f67380afe30 msgr2=0x7f673814f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:02.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.169+0000 7f673ce00640 1 --2- 172.21.15.112:0/3589165671 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f67380afe30 0x7f673814f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:02.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.169+0000 7f673ce00640 1 -- 172.21.15.112:0/3589165671 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f673815cc50 msgr2=0x7f67381f5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:02.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.169+0000 7f673ce00640 1 --2- 172.21.15.112:0/3589165671 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f673815cc50 0x7f67381f5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:02.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.169+0000 7f673ce00640 1 -- 172.21.15.112:0/3589165671 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67381f5ba0 con 0x7f6738071530 2024-09-12T02:43:02.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.169+0000 7f672fe00640 1 --2- 172.21.15.112:0/3589165671 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f67380afe30 0x7f673814f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:43:02.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.170+0000 7f673ce00640 1 --2- 172.21.15.112:0/3589165671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6738071530 0x7f67381599b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f672800c390 tx=0x7f672800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:02.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.170+0000 7f6735600640 1 -- 172.21.15.112:0/3589165671 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6728017070 con 0x7f6738071530 2024-09-12T02:43:02.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.170+0000 7f6735600640 1 -- 172.21.15.112:0/3589165671 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6728005ce0 con 0x7f6738071530 2024-09-12T02:43:02.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.170+0000 7f673f800640 1 -- 172.21.15.112:0/3589165671 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67381f5e80 con 0x7f6738071530 2024-09-12T02:43:02.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.170+0000 7f6735600640 1 -- 172.21.15.112:0/3589165671 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67280072f0 con 0x7f6738071530 2024-09-12T02:43:02.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.170+0000 7f673f800640 1 -- 172.21.15.112:0/3589165671 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6738159490 con 0x7f6738071530 2024-09-12T02:43:02.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.171+0000 7f673f800640 1 -- 172.21.15.112:0/3589165671 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6738068a30 con 0x7f6738071530 2024-09-12T02:43:02.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.172+0000 7f6735600640 1 -- 172.21.15.112:0/3589165671 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f672801a070 con 0x7f6738071530 2024-09-12T02:43:02.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.173+0000 7f6735600640 1 --2- 172.21.15.112:0/3589165671 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f671406be30 0x7f671406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:02.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.173+0000 7f6735600640 1 -- 172.21.15.112:0/3589165671 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f672808a1c0 con 0x7f6738071530 2024-09-12T02:43:02.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.173+0000 7f672fe00640 1 --2- 172.21.15.112:0/3589165671 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f671406be30 0x7f671406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:02.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.174+0000 7f672fe00640 1 --2- 172.21.15.112:0/3589165671 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f671406be30 0x7f671406e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6738150ba0 tx=0x7f6720009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:02.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.177+0000 7f6735600640 1 -- 172.21.15.112:0/3589165671 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6728058510 con 0x7f6738071530 2024-09-12T02:43:02.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.365+0000 7f673f800640 1 -- 172.21.15.112:0/3589165671 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f67380730d0 con 0x7f6738071530 2024-09-12T02:43:02.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.365+0000 7f6735600640 1 -- 172.21.15.112:0/3589165671 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7f672805c810 con 0x7f6738071530 2024-09-12T02:43:02.366 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-12T02:43:02.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.367+0000 7f673f800640 1 -- 172.21.15.112:0/3589165671 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f671406be30 msgr2=0x7f671406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:02.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.367+0000 7f673f800640 1 --2- 172.21.15.112:0/3589165671 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f671406be30 0x7f671406e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6738150ba0 tx=0x7f6720009040 comp rx=0 tx=0).stop 2024-09-12T02:43:02.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.367+0000 7f673f800640 1 -- 172.21.15.112:0/3589165671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6738071530 msgr2=0x7f67381599b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:02.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.367+0000 7f673f800640 1 --2- 172.21.15.112:0/3589165671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6738071530 0x7f67381599b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f672800c390 tx=0x7f672800c850 comp rx=0 tx=0).stop 2024-09-12T02:43:02.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.368+0000 7f673f800640 1 -- 172.21.15.112:0/3589165671 shutdown_connections 2024-09-12T02:43:02.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.368+0000 7f673f800640 1 --2- 172.21.15.112:0/3589165671 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f671406be30 0x7f671406e2f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:02.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.368+0000 7f673f800640 1 --2- 172.21.15.112:0/3589165671 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f673815cc50 0x7f67381f5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:02.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.368+0000 7f673f800640 1 --2- 172.21.15.112:0/3589165671 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f67380afe30 0x7f673814f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:02.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.368+0000 7f673f800640 1 --2- 172.21.15.112:0/3589165671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6738071530 0x7f67381599b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:02.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.368+0000 7f673f800640 1 -- 172.21.15.112:0/3589165671 >> 172.21.15.112:0/3589165671 conn(0x7f673806bbd0 msgr2=0x7f67380732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:02.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.368+0000 7f673f800640 1 -- 172.21.15.112:0/3589165671 shutdown_connections 2024-09-12T02:43:02.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.368+0000 7f673f800640 1 -- 172.21.15.112:0/3589165671 wait complete. 2024-09-12T02:43:02.383 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-12T02:43:02.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:43:02.384 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-12T02:43:02.452 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T02:43:02.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:43:02.452 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T02:43:02.490 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:43:02.490 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:43:02.490 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:43:02.525 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:43:02.526 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:43:02.526 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:43:02.526 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:43:02.568 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:43:02.568 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:43:02.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.718+0000 7f2413e00640 1 Processor -- start 2024-09-12T02:43:02.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.718+0000 7f2413e00640 1 -- start start 2024-09-12T02:43:02.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.719+0000 7f2413e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f240c15b9d0 0x7f240c0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:02.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.719+0000 7f2413e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f240c0b45d0 0x7f240c0728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:02.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.719+0000 7f2413e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f240c06eef0 0x7f240c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:02.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.719+0000 7f2413e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f240c0b4a60 con 0x7f240c15b9d0 2024-09-12T02:43:02.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.719+0000 7f2413e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f240c06f860 con 0x7f240c06eef0 2024-09-12T02:43:02.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.719+0000 7f2413e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f240c0b54a0 con 0x7f240c0b45d0 2024-09-12T02:43:02.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.720+0000 7f2411400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f240c15b9d0 0x7f240c0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:02.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.720+0000 7f2411400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f240c15b9d0 0x7f240c0b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34908/0 (socket says 172.21.15.112:34908) 2024-09-12T02:43:02.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.720+0000 7f2411400640 1 -- 172.21.15.112:0/2082177213 learned_addr learned my addr 172.21.15.112:0/2082177213 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:02.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.720+0000 7f2411400640 1 -- 172.21.15.112:0/2082177213 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f240c0b45d0 msgr2=0x7f240c0728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:02.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.720+0000 7f2411400640 1 --2- 172.21.15.112:0/2082177213 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f240c0b45d0 0x7f240c0728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:02.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.720+0000 7f2411400640 1 -- 172.21.15.112:0/2082177213 >> v2:172.21.15.137:3300/0 conn(0x7f240c06eef0 msgr2=0x7f240c06f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:02.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.720+0000 7f2411e00640 1 --2- 172.21.15.112:0/2082177213 >> v2:172.21.15.137:3300/0 conn(0x7f240c06eef0 0x7f240c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:02.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.720+0000 7f2411400640 1 --2- 172.21.15.112:0/2082177213 >> v2:172.21.15.137:3300/0 conn(0x7f240c06eef0 0x7f240c06f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:02.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.720+0000 7f2411400640 1 -- 172.21.15.112:0/2082177213 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240c0b3af0 con 0x7f240c15b9d0 2024-09-12T02:43:02.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.720+0000 7f2411e00640 1 --2- 172.21.15.112:0/2082177213 >> v2:172.21.15.137:3300/0 conn(0x7f240c06eef0 0x7f240c06f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:43:02.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.721+0000 7f2411400640 1 --2- 172.21.15.112:0/2082177213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f240c15b9d0 0x7f240c0b4ec0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f240c0b3680 tx=0x7f240002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed1dede2db75d9e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:02.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.721+0000 7f240be00640 1 -- 172.21.15.112:0/2082177213 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2400037070 con 0x7f240c15b9d0 2024-09-12T02:43:02.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.721+0000 7f240be00640 1 -- 172.21.15.112:0/2082177213 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2400032440 con 0x7f240c15b9d0 2024-09-12T02:43:02.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.721+0000 7f240be00640 1 -- 172.21.15.112:0/2082177213 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2400032810 con 0x7f240c15b9d0 2024-09-12T02:43:02.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.722+0000 7f2413e00640 1 -- 172.21.15.112:0/2082177213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f240c15b9d0 msgr2=0x7f240c0b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:02.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.722+0000 7f2413e00640 1 --2- 172.21.15.112:0/2082177213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f240c15b9d0 0x7f240c0b4ec0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f240c0b3680 tx=0x7f240002a210 comp rx=0 tx=0).stop 2024-09-12T02:43:02.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.722+0000 7f2413e00640 1 -- 172.21.15.112:0/2082177213 shutdown_connections 2024-09-12T02:43:02.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.722+0000 7f2413e00640 1 --2- 172.21.15.112:0/2082177213 >> v2:172.21.15.137:3300/0 conn(0x7f240c06eef0 0x7f240c06f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:02.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.722+0000 7f2413e00640 1 --2- 172.21.15.112:0/2082177213 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f240c0b45d0 0x7f240c0728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:02.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.722+0000 7f2413e00640 1 --2- 172.21.15.112:0/2082177213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f240c15b9d0 0x7f240c0b4ec0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:02.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.722+0000 7f2413e00640 1 -- 172.21.15.112:0/2082177213 >> 172.21.15.112:0/2082177213 conn(0x7f240c06bbd0 msgr2=0x7f240c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:02.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.722+0000 7f2413e00640 1 -- 172.21.15.112:0/2082177213 shutdown_connections 2024-09-12T02:43:02.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.722+0000 7f2413e00640 1 -- 172.21.15.112:0/2082177213 wait complete. 2024-09-12T02:43:02.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.724+0000 7f2413e00640 1 Processor -- start 2024-09-12T02:43:02.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.724+0000 7f2413e00640 1 -- start start 2024-09-12T02:43:02.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.724+0000 7f2413e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f240c06eef0 0x7f240c152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:02.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.725+0000 7f2413e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f240c0b45d0 0x7f240c153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:02.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.725+0000 7f2413e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f240c15b9d0 0x7f240c158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:02.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.725+0000 7f2413e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f240c15bdb0 con 0x7f240c06eef0 2024-09-12T02:43:02.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.725+0000 7f2413e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f240c0b40b0 con 0x7f240c15b9d0 2024-09-12T02:43:02.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.725+0000 7f2413e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f240c15bf30 con 0x7f240c0b45d0 2024-09-12T02:43:02.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.725+0000 7f2411400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f240c06eef0 0x7f240c152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:02.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.725+0000 7f2411400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f240c06eef0 0x7f240c152680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34914/0 (socket says 172.21.15.112:34914) 2024-09-12T02:43:02.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.725+0000 7f2411400640 1 -- 172.21.15.112:0/3450542534 learned_addr learned my addr 172.21.15.112:0/3450542534 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:02.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.725+0000 7f2410a00640 1 --2- 172.21.15.112:0/3450542534 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f240c0b45d0 0x7f240c153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:02.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.725+0000 7f2411e00640 1 --2- 172.21.15.112:0/3450542534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f240c15b9d0 0x7f240c158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:02.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.725+0000 7f2411400640 1 -- 172.21.15.112:0/3450542534 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f240c0b45d0 msgr2=0x7f240c153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:02.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.725+0000 7f2411400640 1 --2- 172.21.15.112:0/3450542534 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f240c0b45d0 0x7f240c153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:02.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.725+0000 7f2411400640 1 -- 172.21.15.112:0/3450542534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f240c15b9d0 msgr2=0x7f240c158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:02.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.725+0000 7f2411400640 1 --2- 172.21.15.112:0/3450542534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f240c15b9d0 0x7f240c158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:02.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.725+0000 7f2411400640 1 -- 172.21.15.112:0/3450542534 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240c1549c0 con 0x7f240c06eef0 2024-09-12T02:43:02.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.726+0000 7f2411400640 1 --2- 172.21.15.112:0/3450542534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f240c06eef0 0x7f240c152680 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2400000c00 tx=0x7f24000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:02.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.726+0000 7f2409600640 1 -- 172.21.15.112:0/3450542534 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2400037040 con 0x7f240c06eef0 2024-09-12T02:43:02.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.726+0000 7f2409600640 1 -- 172.21.15.112:0/3450542534 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2400042070 con 0x7f240c06eef0 2024-09-12T02:43:02.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.726+0000 7f2409600640 1 -- 172.21.15.112:0/3450542534 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2400030bd0 con 0x7f240c06eef0 2024-09-12T02:43:02.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.726+0000 7f2413e00640 1 -- 172.21.15.112:0/3450542534 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f240c154ca0 con 0x7f240c06eef0 2024-09-12T02:43:02.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.726+0000 7f2413e00640 1 -- 172.21.15.112:0/3450542534 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f240c155260 con 0x7f240c06eef0 2024-09-12T02:43:02.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.727+0000 7f2413e00640 1 -- 172.21.15.112:0/3450542534 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f240c068a30 con 0x7f240c06eef0 2024-09-12T02:43:02.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.728+0000 7f2409600640 1 -- 172.21.15.112:0/3450542534 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2400047460 con 0x7f240c06eef0 2024-09-12T02:43:02.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.729+0000 7f2409600640 1 --2- 172.21.15.112:0/3450542534 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f23ec06be80 0x7f23ec06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:02.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.729+0000 7f2409600640 1 -- 172.21.15.112:0/3450542534 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f24000ab8c0 con 0x7f240c06eef0 2024-09-12T02:43:02.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.729+0000 7f2410a00640 1 --2- 172.21.15.112:0/3450542534 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f23ec06be80 0x7f23ec06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:02.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.730+0000 7f2410a00640 1 --2- 172.21.15.112:0/3450542534 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f23ec06be80 0x7f23ec06e340 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f240c0727e0 tx=0x7f23f8009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:02.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.733+0000 7f2409600640 1 -- 172.21.15.112:0/3450542534 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2400079d00 con 0x7f240c06eef0 2024-09-12T02:43:02.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.938+0000 7f2413e00640 1 -- 172.21.15.112:0/3450542534 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f240c06f320 con 0x7f240c06eef0 2024-09-12T02:43:02.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.939+0000 7f2409600640 1 -- 172.21.15.112:0/3450542534 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5232 (secure 0 0 0) 0x7f240007e000 con 0x7f240c06eef0 2024-09-12T02:43:02.940 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:02.940 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":18,"btime":"2024-09-12T02:42:50:089881+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/2907398106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2907398106},{"type":"v1","addr":"172.21.15.112:6836","nonce":2907398106}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3325408635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3325408635},{"type":"v1","addr":"172.21.15.137:6835","nonce":3325408635}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4678,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3355910952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3355910952},{"type":"v1","addr":"172.21.15.137:6833","nonce":3355910952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:42:46.463211+0000","modified":"2024-09-12T02:42:49.497590+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4761},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4761":{"gid":4761,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.112:6837/917811402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":917811402},{"type":"v1","addr":"172.21.15.112:6837","nonce":917811402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4761,"qdb_cluster":[4761]},"id":2}]} 2024-09-12T02:43:02.941 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 18 2024-09-12T02:43:02.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.941+0000 7f2413e00640 1 -- 172.21.15.112:0/3450542534 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f23ec06be80 msgr2=0x7f23ec06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:02.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.941+0000 7f2413e00640 1 --2- 172.21.15.112:0/3450542534 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f23ec06be80 0x7f23ec06e340 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f240c0727e0 tx=0x7f23f8009110 comp rx=0 tx=0).stop 2024-09-12T02:43:02.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.941+0000 7f2413e00640 1 -- 172.21.15.112:0/3450542534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f240c06eef0 msgr2=0x7f240c152680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:02.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.941+0000 7f2413e00640 1 --2- 172.21.15.112:0/3450542534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f240c06eef0 0x7f240c152680 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2400000c00 tx=0x7f24000046c0 comp rx=0 tx=0).stop 2024-09-12T02:43:02.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.942+0000 7f2413e00640 1 -- 172.21.15.112:0/3450542534 shutdown_connections 2024-09-12T02:43:02.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.942+0000 7f2413e00640 1 --2- 172.21.15.112:0/3450542534 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f23ec06be80 0x7f23ec06e340 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:02.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.942+0000 7f2413e00640 1 --2- 172.21.15.112:0/3450542534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f240c15b9d0 0x7f240c158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:02.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.942+0000 7f2413e00640 1 --2- 172.21.15.112:0/3450542534 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f240c0b45d0 0x7f240c153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:02.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.942+0000 7f2413e00640 1 --2- 172.21.15.112:0/3450542534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f240c06eef0 0x7f240c152680 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:02.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.942+0000 7f2413e00640 1 -- 172.21.15.112:0/3450542534 >> 172.21.15.112:0/3450542534 conn(0x7f240c06bbd0 msgr2=0x7f240c071710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:02.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.942+0000 7f2413e00640 1 -- 172.21.15.112:0/3450542534 shutdown_connections 2024-09-12T02:43:02.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:02.942+0000 7f2413e00640 1 -- 172.21.15.112:0/3450542534 wait complete. 2024-09-12T02:43:02.958 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:43:03.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.113+0000 7f933fe00640 1 Processor -- start 2024-09-12T02:43:03.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.113+0000 7f933fe00640 1 -- start start 2024-09-12T02:43:03.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.116+0000 7f933fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9338071530 0x7f93380af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.116+0000 7f933fe00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93380ceeb0 con 0x7f9338071970 2024-09-12T02:43:03.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.116+0000 7f933fe00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f933806e300 con 0x7f933815cc50 2024-09-12T02:43:03.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.116+0000 7f933fe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f933815d030 con 0x7f9338071530 2024-09-12T02:43:03.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.116+0000 7f933de00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f9338071970 0x7f93380cf950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47032/0 (socket says 172.21.15.112:47032) 2024-09-12T02:43:03.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.116+0000 7f933de00640 1 -- 172.21.15.112:0/2086151690 learned_addr learned my addr 172.21.15.112:0/2086151690 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:03.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.116+0000 7f933ca00640 1 --2- 172.21.15.112:0/2086151690 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9338071530 0x7f93380af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.116+0000 7f9337e00640 1 -- 172.21.15.112:0/2086151690 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2044511428 0 0) 0x7f93380ceeb0 con 0x7f9338071970 2024-09-12T02:43:03.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.116+0000 7f9337e00640 1 -- 172.21.15.112:0/2086151690 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9320003520 con 0x7f9338071970 2024-09-12T02:43:03.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.116+0000 7f9337e00640 1 -- 172.21.15.112:0/2086151690 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3710541519 0 0) 0x7f933806e300 con 0x7f933815cc50 2024-09-12T02:43:03.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.116+0000 7f9337e00640 1 -- 172.21.15.112:0/2086151690 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93380ceeb0 con 0x7f933815cc50 2024-09-12T02:43:03.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.116+0000 7f933ca00640 1 -- 172.21.15.112:0/2086151690 >> v1:172.21.15.137:6789/0 conn(0x7f933815cc50 legacy=0x7f93380732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:03.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.116+0000 7f933ca00640 1 -- 172.21.15.112:0/2086151690 >> v1:172.21.15.112:6789/0 conn(0x7f9338071970 legacy=0x7f93380cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:03.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.116+0000 7f933ca00640 1 -- 172.21.15.112:0/2086151690 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f933806e5e0 con 0x7f9338071530 2024-09-12T02:43:03.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.117+0000 7f933ca00640 1 --2- 172.21.15.112:0/2086151690 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9338071530 0x7f93380af720 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f93240097c0 tx=0x7f932402a160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a32ce887a5fb423c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:03.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.117+0000 7f9337e00640 1 -- 172.21.15.112:0/2086151690 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9324037070 con 0x7f9338071530 2024-09-12T02:43:03.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.117+0000 7f9337e00640 1 -- 172.21.15.112:0/2086151690 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9324032440 con 0x7f9338071530 2024-09-12T02:43:03.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.117+0000 7f9337e00640 1 -- 172.21.15.112:0/2086151690 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9324032810 con 0x7f9338071530 2024-09-12T02:43:03.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.117+0000 7f933fe00640 1 -- 172.21.15.112:0/2086151690 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9338071530 msgr2=0x7f93380af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:03.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.117+0000 7f933fe00640 1 --2- 172.21.15.112:0/2086151690 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9338071530 0x7f93380af720 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f93240097c0 tx=0x7f932402a160 comp rx=0 tx=0).stop 2024-09-12T02:43:03.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.118+0000 7f933fe00640 1 -- 172.21.15.112:0/2086151690 shutdown_connections 2024-09-12T02:43:03.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.118+0000 7f933fe00640 1 --2- 172.21.15.112:0/2086151690 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9338071530 0x7f93380af720 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.118+0000 7f933fe00640 1 -- 172.21.15.112:0/2086151690 >> 172.21.15.112:0/2086151690 conn(0x7f933806bbd0 msgr2=0x7f933806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:03.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.118+0000 7f933fe00640 1 -- 172.21.15.112:0/2086151690 shutdown_connections 2024-09-12T02:43:03.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.118+0000 7f933fe00640 1 -- 172.21.15.112:0/2086151690 wait complete. 2024-09-12T02:43:03.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.119+0000 7f933fe00640 1 Processor -- start 2024-09-12T02:43:03.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.119+0000 7f933fe00640 1 -- start start 2024-09-12T02:43:03.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.120+0000 7f933fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9338071530 0x7f933815f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.120+0000 7f933fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9338071970 0x7f933815dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.120+0000 7f933fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f933815cc50 0x7f93381e8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.120+0000 7f933fe00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f933806f510 con 0x7f933815cc50 2024-09-12T02:43:03.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.120+0000 7f933fe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f93380cf4c0 con 0x7f9338071970 2024-09-12T02:43:03.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.120+0000 7f933fe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f933806f690 con 0x7f9338071530 2024-09-12T02:43:03.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.120+0000 7f933de00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f933815cc50 0x7f93381e8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.121+0000 7f933de00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f933815cc50 0x7f93381e8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34928/0 (socket says 172.21.15.112:34928) 2024-09-12T02:43:03.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.121+0000 7f933de00640 1 -- 172.21.15.112:0/3677607592 learned_addr learned my addr 172.21.15.112:0/3677607592 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:03.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.121+0000 7f933ca00640 1 --2- 172.21.15.112:0/3677607592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9338071970 0x7f933815dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.121+0000 7f933d400640 1 --2- 172.21.15.112:0/3677607592 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9338071530 0x7f933815f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.121+0000 7f933de00640 1 -- 172.21.15.112:0/3677607592 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9338071530 msgr2=0x7f933815f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:03.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.121+0000 7f933de00640 1 --2- 172.21.15.112:0/3677607592 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9338071530 0x7f933815f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.121+0000 7f933de00640 1 -- 172.21.15.112:0/3677607592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9338071970 msgr2=0x7f933815dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:03.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.121+0000 7f933de00640 1 --2- 172.21.15.112:0/3677607592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9338071970 0x7f933815dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.121+0000 7f933de00640 1 -- 172.21.15.112:0/3677607592 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f933815f820 con 0x7f933815cc50 2024-09-12T02:43:03.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.121+0000 7f933ca00640 1 --2- 172.21.15.112:0/3677607592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9338071970 0x7f933815dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:43:03.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.121+0000 7f933de00640 1 --2- 172.21.15.112:0/3677607592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f933815cc50 0x7f93381e8980 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f933000cbc0 tx=0x7f933000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:03.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.121+0000 7f9335600640 1 -- 172.21.15.112:0/3677607592 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9330017070 con 0x7f933815cc50 2024-09-12T02:43:03.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.121+0000 7f9335600640 1 -- 172.21.15.112:0/3677607592 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f933000aca0 con 0x7f933815cc50 2024-09-12T02:43:03.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.121+0000 7f933fe00640 1 -- 172.21.15.112:0/3677607592 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f933815fb00 con 0x7f933815cc50 2024-09-12T02:43:03.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.121+0000 7f9335600640 1 -- 172.21.15.112:0/3677607592 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9330012620 con 0x7f933815cc50 2024-09-12T02:43:03.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.122+0000 7f933fe00640 1 -- 172.21.15.112:0/3677607592 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93381600c0 con 0x7f933815cc50 2024-09-12T02:43:03.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.123+0000 7f933fe00640 1 -- 172.21.15.112:0/3677607592 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f933806df60 con 0x7f933815cc50 2024-09-12T02:43:03.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.123+0000 7f9335600640 1 -- 172.21.15.112:0/3677607592 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f933001a070 con 0x7f933815cc50 2024-09-12T02:43:03.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.124+0000 7f9335600640 1 --2- 172.21.15.112:0/3677607592 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f931806be30 0x7f931806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.124+0000 7f9335600640 1 -- 172.21.15.112:0/3677607592 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f933008acd0 con 0x7f933815cc50 2024-09-12T02:43:03.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.125+0000 7f933d400640 1 --2- 172.21.15.112:0/3677607592 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f931806be30 0x7f931806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.125+0000 7f933d400640 1 --2- 172.21.15.112:0/3677607592 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f931806be30 0x7f931806e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f932c0011e0 tx=0x7f932c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:03.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.128+0000 7f9335600640 1 -- 172.21.15.112:0/3677607592 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f93300595e0 con 0x7f933815cc50 2024-09-12T02:43:03.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.337+0000 7f933fe00640 1 -- 172.21.15.112:0/3677607592 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f93380b0fe0 con 0x7f933815cc50 2024-09-12T02:43:03.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.338+0000 7f9335600640 1 -- 172.21.15.112:0/3677607592 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5232 (secure 0 0 0) 0x7f9330058ee0 con 0x7f933815cc50 2024-09-12T02:43:03.339 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:03.339 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":18,"btime":"2024-09-12T02:42:50:089881+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/2907398106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2907398106},{"type":"v1","addr":"172.21.15.112:6836","nonce":2907398106}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3325408635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3325408635},{"type":"v1","addr":"172.21.15.137:6835","nonce":3325408635}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4678,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3355910952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3355910952},{"type":"v1","addr":"172.21.15.137:6833","nonce":3355910952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:42:46.463211+0000","modified":"2024-09-12T02:42:49.497590+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4761},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4761":{"gid":4761,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.112:6837/917811402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":917811402},{"type":"v1","addr":"172.21.15.112:6837","nonce":917811402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4761,"qdb_cluster":[4761]},"id":2}]} 2024-09-12T02:43:03.340 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 18 2024-09-12T02:43:03.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.340+0000 7f933fe00640 1 -- 172.21.15.112:0/3677607592 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f931806be30 msgr2=0x7f931806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:03.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.340+0000 7f933fe00640 1 --2- 172.21.15.112:0/3677607592 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f931806be30 0x7f931806e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f932c0011e0 tx=0x7f932c009040 comp rx=0 tx=0).stop 2024-09-12T02:43:03.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.340+0000 7f933fe00640 1 -- 172.21.15.112:0/3677607592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f933815cc50 msgr2=0x7f93381e8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:03.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.340+0000 7f933fe00640 1 --2- 172.21.15.112:0/3677607592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f933815cc50 0x7f93381e8980 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f933000cbc0 tx=0x7f933000a060 comp rx=0 tx=0).stop 2024-09-12T02:43:03.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.340+0000 7f933fe00640 1 -- 172.21.15.112:0/3677607592 shutdown_connections 2024-09-12T02:43:03.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.340+0000 7f933fe00640 1 --2- 172.21.15.112:0/3677607592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f933815cc50 0x7f93381e8980 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.340+0000 7f933fe00640 1 --2- 172.21.15.112:0/3677607592 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f931806be30 0x7f931806e2f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.340+0000 7f933fe00640 1 --2- 172.21.15.112:0/3677607592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9338071970 0x7f933815dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.340+0000 7f933fe00640 1 --2- 172.21.15.112:0/3677607592 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9338071530 0x7f933815f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.340+0000 7f933fe00640 1 -- 172.21.15.112:0/3677607592 >> 172.21.15.112:0/3677607592 conn(0x7f933806bbd0 msgr2=0x7f93381578f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:03.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.340+0000 7f933fe00640 1 -- 172.21.15.112:0/3677607592 shutdown_connections 2024-09-12T02:43:03.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.340+0000 7f933fe00640 1 -- 172.21.15.112:0/3677607592 wait complete. 2024-09-12T02:43:03.358 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:43:03.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.508+0000 7f4ff0a00640 1 Processor -- start 2024-09-12T02:43:03.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.508+0000 7f4ff0a00640 1 -- start start 2024-09-12T02:43:03.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.510+0000 7f4ff0a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4fec06d8c0 0x7f4fec0afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.510+0000 7f4ff0a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4fec06dca0 0x7f4fec06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.510+0000 7f4ff0a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fec0aedd0 con 0x7f4fec0ae8d0 2024-09-12T02:43:03.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.510+0000 7f4ff0a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4fec0af0b0 con 0x7f4fec06d8c0 2024-09-12T02:43:03.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.510+0000 7f4ff0a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4fec0af390 con 0x7f4fec06dca0 2024-09-12T02:43:03.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.510+0000 7f4fe9e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4fec06d8c0 0x7f4fec0afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.510+0000 7f4fe1400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f4fec0ae8d0 0x7f4fec0715a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47038/0 (socket says 172.21.15.112:47038) 2024-09-12T02:43:03.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.510+0000 7f4fe1400640 1 -- 172.21.15.112:0/965819156 learned_addr learned my addr 172.21.15.112:0/965819156 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:03.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.510+0000 7f4fea800640 1 --2- 172.21.15.112:0/965819156 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4fec06dca0 0x7f4fec06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.510+0000 7f4fe9e00640 1 -- 172.21.15.112:0/965819156 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4fec06dca0 msgr2=0x7f4fec06e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:03.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.510+0000 7f4fe9e00640 1 --2- 172.21.15.112:0/965819156 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4fec06dca0 0x7f4fec06e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.510+0000 7f4fe9e00640 1 -- 172.21.15.112:0/965819156 >> v1:172.21.15.112:6789/0 conn(0x7f4fec0ae8d0 legacy=0x7f4fec0715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:03.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.510+0000 7f4fe9e00640 1 -- 172.21.15.112:0/965819156 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fec0af670 con 0x7f4fec06d8c0 2024-09-12T02:43:03.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.511+0000 7f4fe9e00640 1 --2- 172.21.15.112:0/965819156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fec06d8c0 0x7f4fec0afe70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc0097a0 tx=0x7f4fdc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c463166b7a8380 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:03.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.512+0000 7f4fe9400640 1 -- 172.21.15.112:0/965819156 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc037070 con 0x7f4fec06d8c0 2024-09-12T02:43:03.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.512+0000 7f4fe9400640 1 -- 172.21.15.112:0/965819156 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fdc032440 con 0x7f4fec06d8c0 2024-09-12T02:43:03.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.512+0000 7f4fe9400640 1 -- 172.21.15.112:0/965819156 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc032810 con 0x7f4fec06d8c0 2024-09-12T02:43:03.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.512+0000 7f4ff0a00640 1 -- 172.21.15.112:0/965819156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fec06d8c0 msgr2=0x7f4fec0afe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:03.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.512+0000 7f4ff0a00640 1 --2- 172.21.15.112:0/965819156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fec06d8c0 0x7f4fec0afe70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc0097a0 tx=0x7f4fdc02a180 comp rx=0 tx=0).stop 2024-09-12T02:43:03.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.512+0000 7f4ff0a00640 1 -- 172.21.15.112:0/965819156 shutdown_connections 2024-09-12T02:43:03.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.512+0000 7f4ff0a00640 1 --2- 172.21.15.112:0/965819156 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4fec06dca0 0x7f4fec06e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.512+0000 7f4ff0a00640 1 --2- 172.21.15.112:0/965819156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fec06d8c0 0x7f4fec0afe70 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.512+0000 7f4ff0a00640 1 -- 172.21.15.112:0/965819156 >> 172.21.15.112:0/965819156 conn(0x7f4fec06bbd0 msgr2=0x7f4fec06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:03.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.512+0000 7f4ff0a00640 1 -- 172.21.15.112:0/965819156 shutdown_connections 2024-09-12T02:43:03.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.512+0000 7f4ff0a00640 1 -- 172.21.15.112:0/965819156 wait complete. 2024-09-12T02:43:03.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.514+0000 7f4ff0a00640 1 Processor -- start 2024-09-12T02:43:03.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.514+0000 7f4ff0a00640 1 -- start start 2024-09-12T02:43:03.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.515+0000 7f4ff0a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4fec06d8c0 0x7f4fec1452f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.515+0000 7f4ff0a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fec06dca0 0x7f4fec1e8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.515+0000 7f4ff0a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fec0ae8d0 0x7f4fec1e89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.515+0000 7f4ff0a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4fec0b38e0 con 0x7f4fec0ae8d0 2024-09-12T02:43:03.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.515+0000 7f4ff0a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4fec06e690 con 0x7f4fec06dca0 2024-09-12T02:43:03.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.515+0000 7f4ff0a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4fec0b3a60 con 0x7f4fec06d8c0 2024-09-12T02:43:03.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.515+0000 7f4fea800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fec0ae8d0 0x7f4fec1e89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.515+0000 7f4fea800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fec0ae8d0 0x7f4fec1e89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34956/0 (socket says 172.21.15.112:34956) 2024-09-12T02:43:03.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.515+0000 7f4fea800640 1 -- 172.21.15.112:0/1661053796 learned_addr learned my addr 172.21.15.112:0/1661053796 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:03.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.515+0000 7f4fe9e00640 1 --2- 172.21.15.112:0/1661053796 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4fec06d8c0 0x7f4fec1452f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.516+0000 7f4fe1400640 1 --2- 172.21.15.112:0/1661053796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fec06dca0 0x7f4fec1e8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.516+0000 7f4fea800640 1 -- 172.21.15.112:0/1661053796 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4fec06d8c0 msgr2=0x7f4fec1452f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:03.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.516+0000 7f4fea800640 1 --2- 172.21.15.112:0/1661053796 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4fec06d8c0 0x7f4fec1452f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.516+0000 7f4fea800640 1 -- 172.21.15.112:0/1661053796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fec06dca0 msgr2=0x7f4fec1e8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:03.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.516+0000 7f4fea800640 1 --2- 172.21.15.112:0/1661053796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fec06dca0 0x7f4fec1e8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.516+0000 7f4fea800640 1 -- 172.21.15.112:0/1661053796 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fec0d0300 con 0x7f4fec0ae8d0 2024-09-12T02:43:03.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.516+0000 7f4fea800640 1 --2- 172.21.15.112:0/1661053796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fec0ae8d0 0x7f4fec1e89b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4007e40 tx=0x7f4fe400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:03.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.516+0000 7f4fe2a00640 1 -- 172.21.15.112:0/1661053796 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4014620 con 0x7f4fec0ae8d0 2024-09-12T02:43:03.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.516+0000 7f4fe2a00640 1 -- 172.21.15.112:0/1661053796 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe4019070 con 0x7f4fec0ae8d0 2024-09-12T02:43:03.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.516+0000 7f4fe2a00640 1 -- 172.21.15.112:0/1661053796 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4014a20 con 0x7f4fec0ae8d0 2024-09-12T02:43:03.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.516+0000 7f4ff0a00640 1 -- 172.21.15.112:0/1661053796 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fec1e8fe0 con 0x7f4fec0ae8d0 2024-09-12T02:43:03.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.516+0000 7f4ff0a00640 1 -- 172.21.15.112:0/1661053796 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fec0cd430 con 0x7f4fec0ae8d0 2024-09-12T02:43:03.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.517+0000 7f4ff0a00640 1 -- 172.21.15.112:0/1661053796 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fec0afe70 con 0x7f4fec0ae8d0 2024-09-12T02:43:03.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.518+0000 7f4fe2a00640 1 -- 172.21.15.112:0/1661053796 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4fe4014bc0 con 0x7f4fec0ae8d0 2024-09-12T02:43:03.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.519+0000 7f4fe2a00640 1 --2- 172.21.15.112:0/1661053796 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4fc806be30 0x7f4fc806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.519+0000 7f4fe2a00640 1 -- 172.21.15.112:0/1661053796 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f4fe408b770 con 0x7f4fec0ae8d0 2024-09-12T02:43:03.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.519+0000 7f4fe9e00640 1 --2- 172.21.15.112:0/1661053796 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4fc806be30 0x7f4fc806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.520+0000 7f4fe9e00640 1 --2- 172.21.15.112:0/1661053796 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4fc806be30 0x7f4fc806e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc034000 tx=0x7f4fdc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:03.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.523+0000 7f4fe2a00640 1 -- 172.21.15.112:0/1661053796 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4fe405a080 con 0x7f4fec0ae8d0 2024-09-12T02:43:03.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.694+0000 7f4ff0a00640 1 -- 172.21.15.112:0/1661053796 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4fec0b5890 con 0x7f4fec0ae8d0 2024-09-12T02:43:03.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.697+0000 7f4fe2a00640 1 -- 172.21.15.112:0/1661053796 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16777 (secure 0 0 0) 0x7f4fe4059980 con 0x7f4fec0ae8d0 2024-09-12T02:43:03.697 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:03.697 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":34,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:42:59.191807+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:42:44.784846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-12T02:42:45.450666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:43:03.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.699+0000 7f4ff0a00640 1 -- 172.21.15.112:0/1661053796 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4fc806be30 msgr2=0x7f4fc806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:03.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.699+0000 7f4ff0a00640 1 --2- 172.21.15.112:0/1661053796 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4fc806be30 0x7f4fc806e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc034000 tx=0x7f4fdc02e000 comp rx=0 tx=0).stop 2024-09-12T02:43:03.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.699+0000 7f4ff0a00640 1 -- 172.21.15.112:0/1661053796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fec0ae8d0 msgr2=0x7f4fec1e89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:03.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.699+0000 7f4ff0a00640 1 --2- 172.21.15.112:0/1661053796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fec0ae8d0 0x7f4fec1e89b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4007e40 tx=0x7f4fe400e4b0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.699+0000 7f4ff0a00640 1 -- 172.21.15.112:0/1661053796 shutdown_connections 2024-09-12T02:43:03.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.699+0000 7f4ff0a00640 1 --2- 172.21.15.112:0/1661053796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fec0ae8d0 0x7f4fec1e89b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.699+0000 7f4ff0a00640 1 --2- 172.21.15.112:0/1661053796 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4fc806be30 0x7f4fc806e2f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.699+0000 7f4ff0a00640 1 --2- 172.21.15.112:0/1661053796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fec06dca0 0x7f4fec1e8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.699+0000 7f4ff0a00640 1 --2- 172.21.15.112:0/1661053796 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4fec06d8c0 0x7f4fec1452f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.699+0000 7f4ff0a00640 1 -- 172.21.15.112:0/1661053796 >> 172.21.15.112:0/1661053796 conn(0x7f4fec06bbd0 msgr2=0x7f4fec0b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:03.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.699+0000 7f4ff0a00640 1 -- 172.21.15.112:0/1661053796 shutdown_connections 2024-09-12T02:43:03.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.699+0000 7f4ff0a00640 1 -- 172.21.15.112:0/1661053796 wait complete. 2024-09-12T02:43:03.716 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:43:03.716 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:43:03.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.870+0000 7f3d10200640 1 Processor -- start 2024-09-12T02:43:03.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.870+0000 7f3d10200640 1 -- start start 2024-09-12T02:43:03.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.871+0000 7f3d10200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3d0815b9d0 0x7f3d080b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.872+0000 7f3d10200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d0806f600 0x7f3d080728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.872+0000 7f3d10200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d080b54a0 con 0x7f3d080b45d0 2024-09-12T02:43:03.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.872+0000 7f3d10200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f3d080b4a60 con 0x7f3d0815b9d0 2024-09-12T02:43:03.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.872+0000 7f3d10200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3d080b3af0 con 0x7f3d0806f600 2024-09-12T02:43:03.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.872+0000 7f3d0ce00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f3d080b45d0 0x7f3d0806eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47050/0 (socket says 172.21.15.112:47050) 2024-09-12T02:43:03.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.872+0000 7f3d0ce00640 1 -- 172.21.15.112:0/390398095 learned_addr learned my addr 172.21.15.112:0/390398095 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:03.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.872+0000 7f3d0d800640 1 --2- 172.21.15.112:0/390398095 >> v2:172.21.15.112:3300/0 conn(0x7f3d0815b9d0 0x7f3d080b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.872+0000 7f3d0e200640 1 --2- 172.21.15.112:0/390398095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d0806f600 0x7f3d080728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.872+0000 7f3d0d800640 1 -- 172.21.15.112:0/390398095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d0806f600 msgr2=0x7f3d080728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:03.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.872+0000 7f3d0d800640 1 --2- 172.21.15.112:0/390398095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d0806f600 0x7f3d080728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.872+0000 7f3d0d800640 1 -- 172.21.15.112:0/390398095 >> v1:172.21.15.112:6789/0 conn(0x7f3d080b45d0 legacy=0x7f3d0806eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:03.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.872+0000 7f3d0d800640 1 -- 172.21.15.112:0/390398095 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d080b3dd0 con 0x7f3d0815b9d0 2024-09-12T02:43:03.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.872+0000 7f3d07e00640 1 -- 172.21.15.112:0/390398095 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 825706663 0 0) 0x7f3d080b54a0 con 0x7f3d080b45d0 2024-09-12T02:43:03.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.873+0000 7f3d0d800640 1 --2- 172.21.15.112:0/390398095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d0815b9d0 0x7f3d080b4ec0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc0097a0 tx=0x7f3cfc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b559360912748ac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:03.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.874+0000 7f3d07e00640 1 -- 172.21.15.112:0/390398095 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc037070 con 0x7f3d0815b9d0 2024-09-12T02:43:03.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.874+0000 7f3d07e00640 1 -- 172.21.15.112:0/390398095 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cfc032440 con 0x7f3d0815b9d0 2024-09-12T02:43:03.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.874+0000 7f3d07e00640 1 -- 172.21.15.112:0/390398095 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc032810 con 0x7f3d0815b9d0 2024-09-12T02:43:03.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.874+0000 7f3d10200640 1 -- 172.21.15.112:0/390398095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d0815b9d0 msgr2=0x7f3d080b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:03.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.874+0000 7f3d10200640 1 --2- 172.21.15.112:0/390398095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d0815b9d0 0x7f3d080b4ec0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc0097a0 tx=0x7f3cfc02a180 comp rx=0 tx=0).stop 2024-09-12T02:43:03.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.874+0000 7f3d10200640 1 -- 172.21.15.112:0/390398095 shutdown_connections 2024-09-12T02:43:03.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.874+0000 7f3d10200640 1 --2- 172.21.15.112:0/390398095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d0806f600 0x7f3d080728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.874+0000 7f3d10200640 1 --2- 172.21.15.112:0/390398095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d0815b9d0 0x7f3d080b4ec0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.874+0000 7f3d10200640 1 -- 172.21.15.112:0/390398095 >> 172.21.15.112:0/390398095 conn(0x7f3d0806bbd0 msgr2=0x7f3d0806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:03.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.874+0000 7f3d10200640 1 -- 172.21.15.112:0/390398095 shutdown_connections 2024-09-12T02:43:03.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.874+0000 7f3d10200640 1 -- 172.21.15.112:0/390398095 wait complete. 2024-09-12T02:43:03.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.876+0000 7f3d10200640 1 Processor -- start 2024-09-12T02:43:03.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.876+0000 7f3d10200640 1 -- start start 2024-09-12T02:43:03.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.877+0000 7f3d10200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d0806f600 0x7f3d081549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.877+0000 7f3d10200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d080b45d0 0x7f3d081577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.877+0000 7f3d10200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d0815b9d0 0x7f3d08072160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.877+0000 7f3d10200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0815bf30 con 0x7f3d0815b9d0 2024-09-12T02:43:03.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.877+0000 7f3d10200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0815bdb0 con 0x7f3d0806f600 2024-09-12T02:43:03.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.877+0000 7f3d10200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3d080cdcd0 con 0x7f3d080b45d0 2024-09-12T02:43:03.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.877+0000 7f3d0e200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d0815b9d0 0x7f3d08072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.877+0000 7f3d0e200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d0815b9d0 0x7f3d08072160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34978/0 (socket says 172.21.15.112:34978) 2024-09-12T02:43:03.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.877+0000 7f3d0e200640 1 -- 172.21.15.112:0/3294096048 learned_addr learned my addr 172.21.15.112:0/3294096048 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:03.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.878+0000 7f3d0d800640 1 --2- 172.21.15.112:0/3294096048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d0806f600 0x7f3d081549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.878+0000 7f3d0ce00640 1 --2- 172.21.15.112:0/3294096048 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d080b45d0 0x7f3d081577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.878+0000 7f3d0e200640 1 -- 172.21.15.112:0/3294096048 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d080b45d0 msgr2=0x7f3d081577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:03.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.878+0000 7f3d0e200640 1 --2- 172.21.15.112:0/3294096048 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d080b45d0 0x7f3d081577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.878+0000 7f3d0e200640 1 -- 172.21.15.112:0/3294096048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d0806f600 msgr2=0x7f3d081549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:03.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.878+0000 7f3d0e200640 1 --2- 172.21.15.112:0/3294096048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d0806f600 0x7f3d081549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:03.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.878+0000 7f3d0e200640 1 -- 172.21.15.112:0/3294096048 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d08147a80 con 0x7f3d0815b9d0 2024-09-12T02:43:03.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.878+0000 7f3d0e200640 1 --2- 172.21.15.112:0/3294096048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d0815b9d0 0x7f3d08072160 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3d0000efc0 tx=0x7f3d0000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:03.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.878+0000 7f3d05600640 1 -- 172.21.15.112:0/3294096048 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d00018020 con 0x7f3d0815b9d0 2024-09-12T02:43:03.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.879+0000 7f3d05600640 1 -- 172.21.15.112:0/3294096048 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d00014480 con 0x7f3d0815b9d0 2024-09-12T02:43:03.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.879+0000 7f3d05600640 1 -- 172.21.15.112:0/3294096048 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d00014870 con 0x7f3d0815b9d0 2024-09-12T02:43:03.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.879+0000 7f3d10200640 1 -- 172.21.15.112:0/3294096048 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d08152d80 con 0x7f3d0815b9d0 2024-09-12T02:43:03.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.879+0000 7f3d10200640 1 -- 172.21.15.112:0/3294096048 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d08153340 con 0x7f3d0815b9d0 2024-09-12T02:43:03.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.880+0000 7f3d10200640 1 -- 172.21.15.112:0/3294096048 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d08068a30 con 0x7f3d0815b9d0 2024-09-12T02:43:03.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.881+0000 7f3d05600640 1 -- 172.21.15.112:0/3294096048 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d00005d10 con 0x7f3d0815b9d0 2024-09-12T02:43:03.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.881+0000 7f3d05600640 1 --2- 172.21.15.112:0/3294096048 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3ce8070240 0x7f3ce8072700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:03.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.882+0000 7f3d05600640 1 -- 172.21.15.112:0/3294096048 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f3d0008bc20 con 0x7f3d0815b9d0 2024-09-12T02:43:03.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.882+0000 7f3d0d800640 1 --2- 172.21.15.112:0/3294096048 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3ce8070240 0x7f3ce8072700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:03.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.882+0000 7f3d0d800640 1 --2- 172.21.15.112:0/3294096048 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3ce8070240 0x7f3ce8072700 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc034000 tx=0x7f3cfc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:03.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:03.886+0000 7f3d05600640 1 -- 172.21.15.112:0/3294096048 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3d00022030 con 0x7f3d0815b9d0 2024-09-12T02:43:04.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.092+0000 7f3d10200640 1 -- 172.21.15.112:0/3294096048 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d081582b0 con 0x7f3d0815b9d0 2024-09-12T02:43:04.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.092+0000 7f3d05600640 1 -- 172.21.15.112:0/3294096048 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5232 (secure 0 0 0) 0x7f3d00010040 con 0x7f3d0815b9d0 2024-09-12T02:43:04.093 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:04.093 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":18,"btime":"2024-09-12T02:42:50:089881+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/2907398106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2907398106},{"type":"v1","addr":"172.21.15.112:6836","nonce":2907398106}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3325408635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3325408635},{"type":"v1","addr":"172.21.15.137:6835","nonce":3325408635}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4678,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3355910952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3355910952},{"type":"v1","addr":"172.21.15.137:6833","nonce":3355910952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:42:46.463211+0000","modified":"2024-09-12T02:42:49.497590+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4761},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4761":{"gid":4761,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.112:6837/917811402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":917811402},{"type":"v1","addr":"172.21.15.112:6837","nonce":917811402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4761,"qdb_cluster":[4761]},"id":2}]} 2024-09-12T02:43:04.093 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 18 2024-09-12T02:43:04.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.095+0000 7f3d10200640 1 -- 172.21.15.112:0/3294096048 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3ce8070240 msgr2=0x7f3ce8072700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:04.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.095+0000 7f3d10200640 1 --2- 172.21.15.112:0/3294096048 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3ce8070240 0x7f3ce8072700 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc034000 tx=0x7f3cfc02e000 comp rx=0 tx=0).stop 2024-09-12T02:43:04.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.095+0000 7f3d10200640 1 -- 172.21.15.112:0/3294096048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d0815b9d0 msgr2=0x7f3d08072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:04.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.095+0000 7f3d10200640 1 --2- 172.21.15.112:0/3294096048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d0815b9d0 0x7f3d08072160 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3d0000efc0 tx=0x7f3d0000c490 comp rx=0 tx=0).stop 2024-09-12T02:43:04.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.095+0000 7f3d10200640 1 -- 172.21.15.112:0/3294096048 shutdown_connections 2024-09-12T02:43:04.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.095+0000 7f3d10200640 1 --2- 172.21.15.112:0/3294096048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d0815b9d0 0x7f3d08072160 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:04.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.095+0000 7f3d10200640 1 --2- 172.21.15.112:0/3294096048 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d080b45d0 0x7f3d081577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:04.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.095+0000 7f3d10200640 1 --2- 172.21.15.112:0/3294096048 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3ce8070240 0x7f3ce8072700 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:04.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.095+0000 7f3d10200640 1 --2- 172.21.15.112:0/3294096048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d0806f600 0x7f3d081549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:04.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.095+0000 7f3d10200640 1 -- 172.21.15.112:0/3294096048 >> 172.21.15.112:0/3294096048 conn(0x7f3d0806bbd0 msgr2=0x7f3d08071710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:04.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.095+0000 7f3d10200640 1 -- 172.21.15.112:0/3294096048 shutdown_connections 2024-09-12T02:43:04.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.095+0000 7f3d10200640 1 -- 172.21.15.112:0/3294096048 wait complete. 2024-09-12T02:43:04.111 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:43:04.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.265+0000 7f845e400640 1 Processor -- start 2024-09-12T02:43:04.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.265+0000 7f845e400640 1 -- start start 2024-09-12T02:43:04.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.266+0000 7f845e400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f84581623c0 0x7f84580d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:04.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.266+0000 7f845e400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f84580d0370 0x7f84580d3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:04.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.266+0000 7f845e400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84581627a0 con 0x7f84580d57e0 2024-09-12T02:43:04.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.266+0000 7f845e400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f84580d08e0 con 0x7f84581623c0 2024-09-12T02:43:04.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.266+0000 7f845e400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f84580d0bc0 con 0x7f84580d0370 2024-09-12T02:43:04.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.266+0000 7f845d000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f84581623c0 0x7f84580d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:04.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.266+0000 7f845d000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f84581623c0 0x7f84580d3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34988/0 (socket says 172.21.15.112:34988) 2024-09-12T02:43:04.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.266+0000 7f845d000640 1 -- 172.21.15.112:0/3505236435 learned_addr learned my addr 172.21.15.112:0/3505236435 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:04.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.267+0000 7f844fe00640 1 --2- 172.21.15.112:0/3505236435 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f84580d0370 0x7f84580d3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:04.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.267+0000 7f845d000640 1 -- 172.21.15.112:0/3505236435 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f84580d0370 msgr2=0x7f84580d3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:04.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.267+0000 7f845d000640 1 --2- 172.21.15.112:0/3505236435 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f84580d0370 0x7f84580d3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:04.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.267+0000 7f845d000640 1 -- 172.21.15.112:0/3505236435 >> v1:172.21.15.137:6789/0 conn(0x7f84580d57e0 legacy=0x7f84580b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:04.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.267+0000 7f845d000640 1 -- 172.21.15.112:0/3505236435 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84580d2930 con 0x7f84581623c0 2024-09-12T02:43:04.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.268+0000 7f845d000640 1 --2- 172.21.15.112:0/3505236435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84581623c0 0x7f84580d3410 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8448009870 tx=0x7f844802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=868ac139e4fe9cab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:04.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.268+0000 7f8457e00640 1 -- 172.21.15.112:0/3505236435 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8448037070 con 0x7f84581623c0 2024-09-12T02:43:04.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.268+0000 7f8457e00640 1 -- 172.21.15.112:0/3505236435 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8448032440 con 0x7f84581623c0 2024-09-12T02:43:04.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.268+0000 7f8457e00640 1 -- 172.21.15.112:0/3505236435 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8448032810 con 0x7f84581623c0 2024-09-12T02:43:04.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.268+0000 7f845e400640 1 -- 172.21.15.112:0/3505236435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84581623c0 msgr2=0x7f84580d3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:04.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.268+0000 7f845e400640 1 --2- 172.21.15.112:0/3505236435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84581623c0 0x7f84580d3410 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8448009870 tx=0x7f844802a2a0 comp rx=0 tx=0).stop 2024-09-12T02:43:04.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.268+0000 7f845e400640 1 -- 172.21.15.112:0/3505236435 shutdown_connections 2024-09-12T02:43:04.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.268+0000 7f845e400640 1 --2- 172.21.15.112:0/3505236435 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f84580d0370 0x7f84580d3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:04.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.268+0000 7f845e400640 1 --2- 172.21.15.112:0/3505236435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84581623c0 0x7f84580d3410 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:04.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.268+0000 7f845e400640 1 -- 172.21.15.112:0/3505236435 >> 172.21.15.112:0/3505236435 conn(0x7f84580d4cc0 msgr2=0x7f84580d50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:04.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.269+0000 7f845e400640 1 -- 172.21.15.112:0/3505236435 shutdown_connections 2024-09-12T02:43:04.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.269+0000 7f845e400640 1 -- 172.21.15.112:0/3505236435 wait complete. 2024-09-12T02:43:04.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.270+0000 7f845e400640 1 Processor -- start 2024-09-12T02:43:04.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.270+0000 7f845e400640 1 -- start start 2024-09-12T02:43:04.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.271+0000 7f845e400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84580d0370 0x7f8458160e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:04.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.271+0000 7f845e400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84580d57e0 0x7f84580c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:04.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.271+0000 7f845e400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f84581623c0 0x7f84580cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:04.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.271+0000 7f845e400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f84580b6460 con 0x7f84580d57e0 2024-09-12T02:43:04.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.271+0000 7f845e400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f84580d2ef0 con 0x7f84580d0370 2024-09-12T02:43:04.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.271+0000 7f845e400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f84580b65e0 con 0x7f84581623c0 2024-09-12T02:43:04.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.271+0000 7f844fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84580d57e0 0x7f84580c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:04.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.271+0000 7f844fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84580d57e0 0x7f84580c95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34998/0 (socket says 172.21.15.112:34998) 2024-09-12T02:43:04.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.271+0000 7f844fe00640 1 -- 172.21.15.112:0/1178340149 learned_addr learned my addr 172.21.15.112:0/1178340149 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:04.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.271+0000 7f845d000640 1 --2- 172.21.15.112:0/1178340149 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84580d0370 0x7f8458160e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:04.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.271+0000 7f845da00640 1 --2- 172.21.15.112:0/1178340149 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f84581623c0 0x7f84580cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:04.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.272+0000 7f844fe00640 1 -- 172.21.15.112:0/1178340149 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f84581623c0 msgr2=0x7f84580cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:04.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.272+0000 7f844fe00640 1 --2- 172.21.15.112:0/1178340149 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f84581623c0 0x7f84580cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:04.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.272+0000 7f844fe00640 1 -- 172.21.15.112:0/1178340149 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84580d0370 msgr2=0x7f8458160e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:04.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.272+0000 7f844fe00640 1 --2- 172.21.15.112:0/1178340149 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84580d0370 0x7f8458160e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:04.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.272+0000 7f844fe00640 1 -- 172.21.15.112:0/1178340149 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84581f8680 con 0x7f84580d57e0 2024-09-12T02:43:04.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.272+0000 7f844fe00640 1 --2- 172.21.15.112:0/1178340149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84580d57e0 0x7f84580c95a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f844000d830 tx=0x7f844000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:04.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.272+0000 7f8455600640 1 -- 172.21.15.112:0/1178340149 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f844000b6c0 con 0x7f84580d57e0 2024-09-12T02:43:04.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.272+0000 7f8455600640 1 -- 172.21.15.112:0/1178340149 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8440019070 con 0x7f84580d57e0 2024-09-12T02:43:04.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.272+0000 7f8455600640 1 -- 172.21.15.112:0/1178340149 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f844000ba80 con 0x7f84580d57e0 2024-09-12T02:43:04.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.272+0000 7f845e400640 1 -- 172.21.15.112:0/1178340149 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84581f8920 con 0x7f84580d57e0 2024-09-12T02:43:04.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.272+0000 7f845e400640 1 -- 172.21.15.112:0/1178340149 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84581f8ee0 con 0x7f84580d57e0 2024-09-12T02:43:04.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.273+0000 7f845e400640 1 -- 172.21.15.112:0/1178340149 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84580d3410 con 0x7f84580d57e0 2024-09-12T02:43:04.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.274+0000 7f8455600640 1 -- 172.21.15.112:0/1178340149 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f844001e460 con 0x7f84580d57e0 2024-09-12T02:43:04.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.276+0000 7f8455600640 1 --2- 172.21.15.112:0/1178340149 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f843406be30 0x7f843406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:04.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.276+0000 7f8455600640 1 -- 172.21.15.112:0/1178340149 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f844008b510 con 0x7f84580d57e0 2024-09-12T02:43:04.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.276+0000 7f845d000640 1 --2- 172.21.15.112:0/1178340149 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f843406be30 0x7f843406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:04.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.276+0000 7f845d000640 1 --2- 172.21.15.112:0/1178340149 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f843406be30 0x7f843406e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8448034000 tx=0x7f844802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:04.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.280+0000 7f8455600640 1 -- 172.21.15.112:0/1178340149 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8440059e20 con 0x7f84580d57e0 2024-09-12T02:43:04.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.487+0000 7f845e400640 1 -- 172.21.15.112:0/1178340149 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f845808e7c0 con 0x7f84580d57e0 2024-09-12T02:43:04.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.487+0000 7f8455600640 1 -- 172.21.15.112:0/1178340149 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5232 (secure 0 0 0) 0x7f8440059720 con 0x7f84580d57e0 2024-09-12T02:43:04.487 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:04.487 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":18,"btime":"2024-09-12T02:42:50:089881+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/2907398106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2907398106},{"type":"v1","addr":"172.21.15.112:6836","nonce":2907398106}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3325408635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3325408635},{"type":"v1","addr":"172.21.15.137:6835","nonce":3325408635}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4678,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3355910952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3355910952},{"type":"v1","addr":"172.21.15.137:6833","nonce":3355910952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:42:46.463211+0000","modified":"2024-09-12T02:42:49.497590+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4761},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4761":{"gid":4761,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.112:6837/917811402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":917811402},{"type":"v1","addr":"172.21.15.112:6837","nonce":917811402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4761,"qdb_cluster":[4761]},"id":2}]} 2024-09-12T02:43:04.488 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 18 2024-09-12T02:43:04.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.489+0000 7f845e400640 1 -- 172.21.15.112:0/1178340149 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f843406be30 msgr2=0x7f843406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:04.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.489+0000 7f845e400640 1 --2- 172.21.15.112:0/1178340149 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f843406be30 0x7f843406e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8448034000 tx=0x7f844802e000 comp rx=0 tx=0).stop 2024-09-12T02:43:04.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.489+0000 7f845e400640 1 -- 172.21.15.112:0/1178340149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84580d57e0 msgr2=0x7f84580c95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:04.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.489+0000 7f845e400640 1 --2- 172.21.15.112:0/1178340149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84580d57e0 0x7f84580c95a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f844000d830 tx=0x7f844000dcf0 comp rx=0 tx=0).stop 2024-09-12T02:43:04.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.489+0000 7f845e400640 1 -- 172.21.15.112:0/1178340149 shutdown_connections 2024-09-12T02:43:04.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.489+0000 7f845e400640 1 --2- 172.21.15.112:0/1178340149 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f84581623c0 0x7f84580cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:04.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.489+0000 7f845e400640 1 --2- 172.21.15.112:0/1178340149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84580d57e0 0x7f84580c95a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:04.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.489+0000 7f845e400640 1 --2- 172.21.15.112:0/1178340149 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f843406be30 0x7f843406e2f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:04.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.489+0000 7f845e400640 1 --2- 172.21.15.112:0/1178340149 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84580d0370 0x7f8458160e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:04.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.489+0000 7f845e400640 1 -- 172.21.15.112:0/1178340149 >> 172.21.15.112:0/1178340149 conn(0x7f84580d4cc0 msgr2=0x7f845806c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:04.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.489+0000 7f845e400640 1 -- 172.21.15.112:0/1178340149 shutdown_connections 2024-09-12T02:43:04.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.489+0000 7f845e400640 1 -- 172.21.15.112:0/1178340149 wait complete. 2024-09-12T02:43:04.505 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:43:04.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.656+0000 7fef22600640 1 Processor -- start 2024-09-12T02:43:04.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.656+0000 7fef22600640 1 -- start start 2024-09-12T02:43:04.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.657+0000 7fef22600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fef1c06f600 0x7fef1c0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:04.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.658+0000 7fef22600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef1c0b45d0 0x7fef1c0728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:04.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.658+0000 7fef22600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef1c0b4a20 con 0x7fef1c15b9d0 2024-09-12T02:43:04.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.658+0000 7fef22600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fef1c0b54a0 con 0x7fef1c06f600 2024-09-12T02:43:04.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.658+0000 7fef22600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fef1c0b3af0 con 0x7fef1c0b45d0 2024-09-12T02:43:04.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.658+0000 7fef12a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fef1c06f600 0x7fef1c0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:04.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.658+0000 7fef1be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef1c0b45d0 0x7fef1c0728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:04.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.658+0000 7fef12a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fef1c06f600 0x7fef1c0b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:39174/0 (socket says 172.21.15.112:39174) 2024-09-12T02:43:04.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.658+0000 7fef12a00640 1 -- 172.21.15.112:0/1514488723 learned_addr learned my addr 172.21.15.112:0/1514488723 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:04.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.658+0000 7fef12a00640 1 -- 172.21.15.112:0/1514488723 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef1c0b45d0 msgr2=0x7fef1c0728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:04.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.658+0000 7fef12a00640 1 --2- 172.21.15.112:0/1514488723 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef1c0b45d0 0x7fef1c0728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:04.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.658+0000 7fef12a00640 1 -- 172.21.15.112:0/1514488723 >> v1:172.21.15.137:6789/0 conn(0x7fef1c15b9d0 legacy=0x7fef1c06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:04.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.658+0000 7fef12a00640 1 -- 172.21.15.112:0/1514488723 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef1c0b3dd0 con 0x7fef1c06f600 2024-09-12T02:43:04.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.659+0000 7fef12a00640 1 --2- 172.21.15.112:0/1514488723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef1c06f600 0x7fef1c0b4ec0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fef04009850 tx=0x7fef0402a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=747d05eca62d7b98 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:04.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.660+0000 7fef1aa00640 1 -- 172.21.15.112:0/1514488723 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef04004030 con 0x7fef1c06f600 2024-09-12T02:43:04.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.660+0000 7fef1aa00640 1 -- 172.21.15.112:0/1514488723 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef040041d0 con 0x7fef1c06f600 2024-09-12T02:43:04.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.660+0000 7fef1aa00640 1 -- 172.21.15.112:0/1514488723 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef04003610 con 0x7fef1c06f600 2024-09-12T02:43:04.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.660+0000 7fef22600640 1 -- 172.21.15.112:0/1514488723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef1c06f600 msgr2=0x7fef1c0b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:04.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.660+0000 7fef22600640 1 --2- 172.21.15.112:0/1514488723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef1c06f600 0x7fef1c0b4ec0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fef04009850 tx=0x7fef0402a250 comp rx=0 tx=0).stop 2024-09-12T02:43:04.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.660+0000 7fef22600640 1 -- 172.21.15.112:0/1514488723 shutdown_connections 2024-09-12T02:43:04.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.660+0000 7fef22600640 1 --2- 172.21.15.112:0/1514488723 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef1c0b45d0 0x7fef1c0728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:04.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.660+0000 7fef22600640 1 --2- 172.21.15.112:0/1514488723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef1c06f600 0x7fef1c0b4ec0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:04.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.660+0000 7fef22600640 1 -- 172.21.15.112:0/1514488723 >> 172.21.15.112:0/1514488723 conn(0x7fef1c06bbd0 msgr2=0x7fef1c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:04.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.660+0000 7fef22600640 1 -- 172.21.15.112:0/1514488723 shutdown_connections 2024-09-12T02:43:04.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.660+0000 7fef22600640 1 -- 172.21.15.112:0/1514488723 wait complete. 2024-09-12T02:43:04.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.662+0000 7fef22600640 1 Processor -- start 2024-09-12T02:43:04.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.662+0000 7fef22600640 1 -- start start 2024-09-12T02:43:04.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.663+0000 7fef22600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef1c06f600 0x7fef1c14ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:04.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.663+0000 7fef22600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef1c0b45d0 0x7fef1c1556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:04.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.663+0000 7fef22600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef1c15b9d0 0x7fef1c155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:04.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.663+0000 7fef22600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fef1c15bf30 con 0x7fef1c06f600 2024-09-12T02:43:04.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.663+0000 7fef22600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fef1c15bdb0 con 0x7fef1c15b9d0 2024-09-12T02:43:04.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.663+0000 7fef22600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fef1c0cdcd0 con 0x7fef1c0b45d0 2024-09-12T02:43:04.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.663+0000 7fef1b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef1c06f600 0x7fef1c14ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:04.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.663+0000 7fef1b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef1c06f600 0x7fef1c14ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35006/0 (socket says 172.21.15.112:35006) 2024-09-12T02:43:04.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.663+0000 7fef1b400640 1 -- 172.21.15.112:0/4133229403 learned_addr learned my addr 172.21.15.112:0/4133229403 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:04.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.663+0000 7fef12a00640 1 --2- 172.21.15.112:0/4133229403 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef1c0b45d0 0x7fef1c1556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:04.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.663+0000 7fef1be00640 1 --2- 172.21.15.112:0/4133229403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef1c15b9d0 0x7fef1c155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:04.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.664+0000 7fef1b400640 1 -- 172.21.15.112:0/4133229403 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef1c0b45d0 msgr2=0x7fef1c1556f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:04.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.664+0000 7fef1b400640 1 --2- 172.21.15.112:0/4133229403 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef1c0b45d0 0x7fef1c1556f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:04.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.664+0000 7fef1b400640 1 -- 172.21.15.112:0/4133229403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef1c15b9d0 msgr2=0x7fef1c155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:04.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.664+0000 7fef1b400640 1 --2- 172.21.15.112:0/4133229403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef1c15b9d0 0x7fef1c155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:04.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.664+0000 7fef1b400640 1 -- 172.21.15.112:0/4133229403 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef1c1540a0 con 0x7fef1c06f600 2024-09-12T02:43:04.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.664+0000 7fef1b400640 1 --2- 172.21.15.112:0/4133229403 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef1c06f600 0x7fef1c14ee40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fef0c00c3c0 tx=0x7fef0c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:04.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.664+0000 7fef13e00640 1 -- 172.21.15.112:0/4133229403 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0c0052d0 con 0x7fef1c06f600 2024-09-12T02:43:04.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.664+0000 7fef13e00640 1 -- 172.21.15.112:0/4133229403 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef0c005490 con 0x7fef1c06f600 2024-09-12T02:43:04.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.664+0000 7fef22600640 1 -- 172.21.15.112:0/4133229403 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef1c151050 con 0x7fef1c06f600 2024-09-12T02:43:04.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.664+0000 7fef13e00640 1 -- 172.21.15.112:0/4133229403 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0c007260 con 0x7fef1c06f600 2024-09-12T02:43:04.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.664+0000 7fef22600640 1 -- 172.21.15.112:0/4133229403 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef1c151610 con 0x7fef1c06f600 2024-09-12T02:43:04.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.665+0000 7fef22600640 1 -- 172.21.15.112:0/4133229403 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef1c068a30 con 0x7fef1c06f600 2024-09-12T02:43:04.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.666+0000 7fef13e00640 1 -- 172.21.15.112:0/4133229403 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fef0c007400 con 0x7fef1c06f600 2024-09-12T02:43:04.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.667+0000 7fef13e00640 1 --2- 172.21.15.112:0/4133229403 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7feef806be30 0x7feef806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:04.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.667+0000 7fef13e00640 1 -- 172.21.15.112:0/4133229403 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fef0c08a200 con 0x7fef1c06f600 2024-09-12T02:43:04.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.667+0000 7fef12a00640 1 --2- 172.21.15.112:0/4133229403 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7feef806be30 0x7feef806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:04.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.668+0000 7fef12a00640 1 --2- 172.21.15.112:0/4133229403 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7feef806be30 0x7feef806e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fef04033000 tx=0x7fef0402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:04.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.671+0000 7fef13e00640 1 -- 172.21.15.112:0/4133229403 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fef0c0585f0 con 0x7fef1c06f600 2024-09-12T02:43:04.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.845+0000 7fef22600640 1 -- 172.21.15.112:0/4133229403 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fef1c072650 con 0x7fef1c06f600 2024-09-12T02:43:04.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.846+0000 7fef13e00640 1 -- 172.21.15.112:0/4133229403 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16777 (secure 0 0 0) 0x7fef0c05c8f0 con 0x7fef1c06f600 2024-09-12T02:43:04.847 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:04.847 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":34,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:42:59.191807+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:42:44.784846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-12T02:42:45.450666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:43:04.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.848+0000 7fef22600640 1 -- 172.21.15.112:0/4133229403 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7feef806be30 msgr2=0x7feef806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:04.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.848+0000 7fef22600640 1 --2- 172.21.15.112:0/4133229403 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7feef806be30 0x7feef806e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fef04033000 tx=0x7fef0402e000 comp rx=0 tx=0).stop 2024-09-12T02:43:04.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.848+0000 7fef22600640 1 -- 172.21.15.112:0/4133229403 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef1c06f600 msgr2=0x7fef1c14ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:04.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.848+0000 7fef22600640 1 --2- 172.21.15.112:0/4133229403 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef1c06f600 0x7fef1c14ee40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fef0c00c3c0 tx=0x7fef0c00c880 comp rx=0 tx=0).stop 2024-09-12T02:43:04.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.849+0000 7fef22600640 1 -- 172.21.15.112:0/4133229403 shutdown_connections 2024-09-12T02:43:04.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.849+0000 7fef22600640 1 --2- 172.21.15.112:0/4133229403 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7feef806be30 0x7feef806e2f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:04.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.849+0000 7fef22600640 1 --2- 172.21.15.112:0/4133229403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef1c15b9d0 0x7fef1c155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:04.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.849+0000 7fef22600640 1 --2- 172.21.15.112:0/4133229403 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef1c0b45d0 0x7fef1c1556f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:04.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.849+0000 7fef22600640 1 --2- 172.21.15.112:0/4133229403 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef1c06f600 0x7fef1c14ee40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:04.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.849+0000 7fef22600640 1 -- 172.21.15.112:0/4133229403 >> 172.21.15.112:0/4133229403 conn(0x7fef1c06bbd0 msgr2=0x7fef1c0b0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:04.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.849+0000 7fef22600640 1 -- 172.21.15.112:0/4133229403 shutdown_connections 2024-09-12T02:43:04.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:04.849+0000 7fef22600640 1 -- 172.21.15.112:0/4133229403 wait complete. 2024-09-12T02:43:04.865 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:43:05.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.017+0000 7f63ea600640 1 Processor -- start 2024-09-12T02:43:05.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.017+0000 7f63ea600640 1 -- start start 2024-09-12T02:43:05.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.019+0000 7f63ea600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63e406f600 0x7f63e40b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.019+0000 7f63ea600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f63e40b45d0 0x7f63e40728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.019+0000 7f63ea600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e40b4a20 con 0x7f63e415b9d0 2024-09-12T02:43:05.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.019+0000 7f63ea600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f63e40b54a0 con 0x7f63e40b45d0 2024-09-12T02:43:05.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.019+0000 7f63ea600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f63e40b3af0 con 0x7f63e406f600 2024-09-12T02:43:05.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.019+0000 7f63e3e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f63e40b45d0 0x7f63e40728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:05.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.019+0000 7f63e3e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f63e40b45d0 0x7f63e40728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35018/0 (socket says 172.21.15.112:35018) 2024-09-12T02:43:05.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.019+0000 7f63e3e00640 1 -- 172.21.15.112:0/3397290699 learned_addr learned my addr 172.21.15.112:0/3397290699 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:05.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.019+0000 7f63daa00640 1 --2- 172.21.15.112:0/3397290699 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63e406f600 0x7f63e40b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:05.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.019+0000 7f63e3e00640 1 -- 172.21.15.112:0/3397290699 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63e406f600 msgr2=0x7f63e40b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:05.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.019+0000 7f63e3e00640 1 --2- 172.21.15.112:0/3397290699 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63e406f600 0x7f63e40b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.019+0000 7f63e3e00640 1 -- 172.21.15.112:0/3397290699 >> v1:172.21.15.137:6789/0 conn(0x7f63e415b9d0 legacy=0x7f63e406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:05.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.019+0000 7f63e3e00640 1 -- 172.21.15.112:0/3397290699 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e40b3dd0 con 0x7f63e40b45d0 2024-09-12T02:43:05.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.020+0000 7f63e3e00640 1 --2- 172.21.15.112:0/3397290699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63e40b45d0 0x7f63e40728c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f63dc00d150 tx=0x7f63dc02c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d29bba1e11448f31 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:05.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.021+0000 7f63e2a00640 1 -- 172.21.15.112:0/3397290699 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc009600 con 0x7f63e40b45d0 2024-09-12T02:43:05.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.021+0000 7f63e2a00640 1 -- 172.21.15.112:0/3397290699 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63dc037070 con 0x7f63e40b45d0 2024-09-12T02:43:05.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.021+0000 7f63e2a00640 1 -- 172.21.15.112:0/3397290699 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc0099c0 con 0x7f63e40b45d0 2024-09-12T02:43:05.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.021+0000 7f63ea600640 1 -- 172.21.15.112:0/3397290699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63e40b45d0 msgr2=0x7f63e40728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:05.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.021+0000 7f63ea600640 1 --2- 172.21.15.112:0/3397290699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63e40b45d0 0x7f63e40728c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f63dc00d150 tx=0x7f63dc02c930 comp rx=0 tx=0).stop 2024-09-12T02:43:05.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.021+0000 7f63ea600640 1 -- 172.21.15.112:0/3397290699 shutdown_connections 2024-09-12T02:43:05.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.021+0000 7f63ea600640 1 --2- 172.21.15.112:0/3397290699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63e40b45d0 0x7f63e40728c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.021+0000 7f63ea600640 1 --2- 172.21.15.112:0/3397290699 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63e406f600 0x7f63e40b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.021+0000 7f63ea600640 1 -- 172.21.15.112:0/3397290699 >> 172.21.15.112:0/3397290699 conn(0x7f63e406bbd0 msgr2=0x7f63e406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:05.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.021+0000 7f63ea600640 1 -- 172.21.15.112:0/3397290699 shutdown_connections 2024-09-12T02:43:05.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.021+0000 7f63ea600640 1 -- 172.21.15.112:0/3397290699 wait complete. 2024-09-12T02:43:05.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.023+0000 7f63ea600640 1 Processor -- start 2024-09-12T02:43:05.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.023+0000 7f63ea600640 1 -- start start 2024-09-12T02:43:05.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.024+0000 7f63ea600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63e406f600 0x7f63e414ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.024+0000 7f63ea600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63e40b45d0 0x7f63e40ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.024+0000 7f63ea600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63e415b9d0 0x7f63e40b1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.024+0000 7f63ea600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f63e415bf30 con 0x7f63e415b9d0 2024-09-12T02:43:05.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.024+0000 7f63ea600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f63e415bdb0 con 0x7f63e406f600 2024-09-12T02:43:05.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.024+0000 7f63ea600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f63e40cdcd0 con 0x7f63e40b45d0 2024-09-12T02:43:05.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.024+0000 7f63e3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63e415b9d0 0x7f63e40b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:05.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.024+0000 7f63e3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63e406f600 0x7f63e414ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:05.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.024+0000 7f63e3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63e406f600 0x7f63e414ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:39188/0 (socket says 172.21.15.112:39188) 2024-09-12T02:43:05.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.024+0000 7f63e3400640 1 -- 172.21.15.112:0/1925060407 learned_addr learned my addr 172.21.15.112:0/1925060407 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:05.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.024+0000 7f63daa00640 1 --2- 172.21.15.112:0/1925060407 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63e40b45d0 0x7f63e40ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:05.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.025+0000 7f63e3400640 1 -- 172.21.15.112:0/1925060407 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63e40b45d0 msgr2=0x7f63e40ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:05.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.025+0000 7f63e3400640 1 --2- 172.21.15.112:0/1925060407 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63e40b45d0 0x7f63e40ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.025+0000 7f63e3400640 1 -- 172.21.15.112:0/1925060407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63e415b9d0 msgr2=0x7f63e40b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:05.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.025+0000 7f63e3400640 1 --2- 172.21.15.112:0/1925060407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63e415b9d0 0x7f63e40b1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.025+0000 7f63e3400640 1 -- 172.21.15.112:0/1925060407 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e41f43b0 con 0x7f63e406f600 2024-09-12T02:43:05.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.025+0000 7f63e3e00640 1 --2- 172.21.15.112:0/1925060407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63e415b9d0 0x7f63e40b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:43:05.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.025+0000 7f63e3400640 1 --2- 172.21.15.112:0/1925060407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63e406f600 0x7f63e414ec90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f63d400c3c0 tx=0x7f63d400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:05.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.025+0000 7f63dbe00640 1 -- 172.21.15.112:0/1925060407 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d40052d0 con 0x7f63e406f600 2024-09-12T02:43:05.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.025+0000 7f63dbe00640 1 -- 172.21.15.112:0/1925060407 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63d4005490 con 0x7f63e406f600 2024-09-12T02:43:05.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.025+0000 7f63dbe00640 1 -- 172.21.15.112:0/1925060407 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d4007260 con 0x7f63e406f600 2024-09-12T02:43:05.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.025+0000 7f63ea600640 1 -- 172.21.15.112:0/1925060407 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63e41f4650 con 0x7f63e406f600 2024-09-12T02:43:05.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.025+0000 7f63ea600640 1 -- 172.21.15.112:0/1925060407 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63e41f4c10 con 0x7f63e406f600 2024-09-12T02:43:05.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.026+0000 7f63ea600640 1 -- 172.21.15.112:0/1925060407 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63e4068a30 con 0x7f63e406f600 2024-09-12T02:43:05.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.027+0000 7f63dbe00640 1 -- 172.21.15.112:0/1925060407 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f63d4007400 con 0x7f63e406f600 2024-09-12T02:43:05.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.028+0000 7f63dbe00640 1 --2- 172.21.15.112:0/1925060407 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f63c006be30 0x7f63c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.028+0000 7f63dbe00640 1 -- 172.21.15.112:0/1925060407 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f63d408a280 con 0x7f63e406f600 2024-09-12T02:43:05.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.029+0000 7f63daa00640 1 --2- 172.21.15.112:0/1925060407 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f63c006be30 0x7f63c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:05.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.029+0000 7f63daa00640 1 --2- 172.21.15.112:0/1925060407 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f63c006be30 0x7f63c006e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f63cc006a30 tx=0x7f63cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:05.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.034+0000 7f63dbe00640 1 -- 172.21.15.112:0/1925060407 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f63d40585d0 con 0x7f63e406f600 2024-09-12T02:43:05.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.242+0000 7f63ea600640 1 -- 172.21.15.112:0/1925060407 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f63e4159f90 con 0x7f63e406f600 2024-09-12T02:43:05.243 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-12T02:43:05.243+0000 7f0216c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:43:05.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.254+0000 7f63dbe00640 1 -- 172.21.15.112:0/1925060407 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7f63d405c8d0 con 0x7f63e406f600 2024-09-12T02:43:05.253 INFO:teuthology.orchestra.run.smithi112.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:43:05.255 INFO:tasks.ceph.mds.c.smithi112.stderr: -6282> 2024-09-12T02:42:33.461+0000 7f7e6cc00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-12T02:43:05.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.257+0000 7f63ea600640 1 -- 172.21.15.112:0/1925060407 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f63c006be30 msgr2=0x7f63c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:05.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.257+0000 7f63ea600640 1 --2- 172.21.15.112:0/1925060407 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f63c006be30 0x7f63c006e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f63cc006a30 tx=0x7f63cc008040 comp rx=0 tx=0).stop 2024-09-12T02:43:05.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.257+0000 7f63ea600640 1 -- 172.21.15.112:0/1925060407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63e406f600 msgr2=0x7f63e414ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:05.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.257+0000 7f63ea600640 1 --2- 172.21.15.112:0/1925060407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63e406f600 0x7f63e414ec90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f63d400c3c0 tx=0x7f63d400c880 comp rx=0 tx=0).stop 2024-09-12T02:43:05.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.257+0000 7f63ea600640 1 -- 172.21.15.112:0/1925060407 shutdown_connections 2024-09-12T02:43:05.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.257+0000 7f63ea600640 1 --2- 172.21.15.112:0/1925060407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63e415b9d0 0x7f63e40b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.257+0000 7f63ea600640 1 --2- 172.21.15.112:0/1925060407 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f63e40b45d0 0x7f63e40ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.257+0000 7f63ea600640 1 --2- 172.21.15.112:0/1925060407 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f63c006be30 0x7f63c006e2f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.257+0000 7f63ea600640 1 --2- 172.21.15.112:0/1925060407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63e406f600 0x7f63e414ec90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.257+0000 7f63ea600640 1 -- 172.21.15.112:0/1925060407 >> 172.21.15.112:0/1925060407 conn(0x7f63e406bbd0 msgr2=0x7f63e40b56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:05.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.257+0000 7f63ea600640 1 -- 172.21.15.112:0/1925060407 shutdown_connections 2024-09-12T02:43:05.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.257+0000 7f63ea600640 1 -- 172.21.15.112:0/1925060407 wait complete. 2024-09-12T02:43:05.258 INFO:tasks.ceph.mds.c.smithi112.stderr: -5041> 2024-09-12T02:42:49.251+0000 7f7e65400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:43:05.281 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T02:43:05.320 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2024-09-12T02:43:05.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.437+0000 7f73abe00640 1 Processor -- start 2024-09-12T02:43:05.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.437+0000 7f73abe00640 1 -- start start 2024-09-12T02:43:05.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.438+0000 7f73abe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f73ac0d1710 0x7f73ac0d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.438+0000 7f73abe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f73ac0b3e00 0x7f73ac0d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.438+0000 7f73abe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73ac0cf7a0 0x7f73ac0cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.438+0000 7f73abe00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f73ac0d3cb0 con 0x7f73ac0d1710 2024-09-12T02:43:05.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.438+0000 7f73abe00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f73ac0d2fb0 con 0x7f73ac0b3e00 2024-09-12T02:43:05.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.438+0000 7f73abe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f73ac0d0b60 con 0x7f73ac0cf7a0 2024-09-12T02:43:05.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.438+0000 7f73aaa00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f73ac0d1710 0x7f73ac0d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:05.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.438+0000 7f73aaa00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f73ac0d1710 0x7f73ac0d28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35046/0 (socket says 172.21.15.112:35046) 2024-09-12T02:43:05.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.438+0000 7f73aaa00640 1 -- 172.21.15.112:0/2651791025 learned_addr learned my addr 172.21.15.112:0/2651791025 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:05.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.439+0000 7f73aa000640 1 --2- 172.21.15.112:0/2651791025 >> v2:172.21.15.137:3300/0 conn(0x7f73ac0b3e00 0x7f73ac0d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:05.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.439+0000 7f73ab400640 1 --2- 172.21.15.112:0/2651791025 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73ac0cf7a0 0x7f73ac0cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:05.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.439+0000 7f73aaa00640 1 -- 172.21.15.112:0/2651791025 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73ac0cf7a0 msgr2=0x7f73ac0cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:05.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.439+0000 7f73aaa00640 1 --2- 172.21.15.112:0/2651791025 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73ac0cf7a0 0x7f73ac0cfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.439+0000 7f73aaa00640 1 -- 172.21.15.112:0/2651791025 >> v2:172.21.15.137:3300/0 conn(0x7f73ac0b3e00 msgr2=0x7f73ac0d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:05.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.439+0000 7f73aaa00640 1 --2- 172.21.15.112:0/2651791025 >> v2:172.21.15.137:3300/0 conn(0x7f73ac0b3e00 0x7f73ac0d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.439+0000 7f73aaa00640 1 -- 172.21.15.112:0/2651791025 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ac0d2030 con 0x7f73ac0d1710 2024-09-12T02:43:05.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.439+0000 7f73ab400640 1 --2- 172.21.15.112:0/2651791025 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73ac0cf7a0 0x7f73ac0cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:43:05.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.440+0000 7f73aaa00640 1 --2- 172.21.15.112:0/2651791025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73ac0d1710 0x7f73ac0d28d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f73ac0d1190 tx=0x7f739c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a74e09534b56e3cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:05.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.440+0000 7f73a9600640 1 -- 172.21.15.112:0/2651791025 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739c037070 con 0x7f73ac0d1710 2024-09-12T02:43:05.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.440+0000 7f73a9600640 1 -- 172.21.15.112:0/2651791025 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f739c032440 con 0x7f73ac0d1710 2024-09-12T02:43:05.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.440+0000 7f73a9600640 1 -- 172.21.15.112:0/2651791025 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739c032810 con 0x7f73ac0d1710 2024-09-12T02:43:05.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.441+0000 7f73abe00640 1 -- 172.21.15.112:0/2651791025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73ac0d1710 msgr2=0x7f73ac0d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:05.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.441+0000 7f73abe00640 1 --2- 172.21.15.112:0/2651791025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73ac0d1710 0x7f73ac0d28d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f73ac0d1190 tx=0x7f739c02a1e0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.441+0000 7f73abe00640 1 -- 172.21.15.112:0/2651791025 shutdown_connections 2024-09-12T02:43:05.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.441+0000 7f73abe00640 1 --2- 172.21.15.112:0/2651791025 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73ac0cf7a0 0x7f73ac0cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.441+0000 7f73abe00640 1 --2- 172.21.15.112:0/2651791025 >> v2:172.21.15.137:3300/0 conn(0x7f73ac0b3e00 0x7f73ac0d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.441+0000 7f73abe00640 1 --2- 172.21.15.112:0/2651791025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73ac0d1710 0x7f73ac0d28d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.441+0000 7f73abe00640 1 -- 172.21.15.112:0/2651791025 >> 172.21.15.112:0/2651791025 conn(0x7f73ac09e030 msgr2=0x7f73ac0d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:05.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.441+0000 7f73abe00640 1 -- 172.21.15.112:0/2651791025 shutdown_connections 2024-09-12T02:43:05.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.441+0000 7f73abe00640 1 -- 172.21.15.112:0/2651791025 wait complete. 2024-09-12T02:43:05.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.442+0000 7f73abe00640 1 Processor -- start 2024-09-12T02:43:05.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.442+0000 7f73abe00640 1 -- start start 2024-09-12T02:43:05.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.443+0000 7f73abe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73ac0b3e00 0x7f73ac0b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.443+0000 7f73abe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73ac0cf7a0 0x7f73ac15c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.443+0000 7f73abe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73ac0d1710 0x7f73ac0ce880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.443+0000 7f73abe00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac0d39d0 con 0x7f73ac0b3e00 2024-09-12T02:43:05.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.443+0000 7f73abe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac0d36f0 con 0x7f73ac0cf7a0 2024-09-12T02:43:05.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.443+0000 7f73abe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f73ac15f110 con 0x7f73ac0d1710 2024-09-12T02:43:05.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.444+0000 7f73aaa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73ac0b3e00 0x7f73ac0b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:05.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.444+0000 7f73aaa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73ac0b3e00 0x7f73ac0b4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35056/0 (socket says 172.21.15.112:35056) 2024-09-12T02:43:05.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.444+0000 7f73aaa00640 1 -- 172.21.15.112:0/2851454067 learned_addr learned my addr 172.21.15.112:0/2851454067 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:05.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.444+0000 7f73aa000640 1 --2- 172.21.15.112:0/2851454067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73ac0cf7a0 0x7f73ac15c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:05.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.444+0000 7f73ab400640 1 --2- 172.21.15.112:0/2851454067 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73ac0d1710 0x7f73ac0ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:05.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.444+0000 7f73aaa00640 1 -- 172.21.15.112:0/2851454067 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73ac0d1710 msgr2=0x7f73ac0ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:05.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.444+0000 7f73aaa00640 1 --2- 172.21.15.112:0/2851454067 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73ac0d1710 0x7f73ac0ce880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.444+0000 7f73aaa00640 1 -- 172.21.15.112:0/2851454067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73ac0cf7a0 msgr2=0x7f73ac15c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:05.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.444+0000 7f73aaa00640 1 --2- 172.21.15.112:0/2851454067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73ac0cf7a0 0x7f73ac15c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:05.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.444+0000 7f73aaa00640 1 -- 172.21.15.112:0/2851454067 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ac0b4870 con 0x7f73ac0b3e00 2024-09-12T02:43:05.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.444+0000 7f73aaa00640 1 --2- 172.21.15.112:0/2851454067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73ac0b3e00 0x7f73ac0b4330 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f739c02a220 tx=0x7f739c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:05.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.445+0000 7f73a2a00640 1 -- 172.21.15.112:0/2851454067 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739c041020 con 0x7f73ac0b3e00 2024-09-12T02:43:05.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.445+0000 7f73a2a00640 1 -- 172.21.15.112:0/2851454067 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f739c0306c0 con 0x7f73ac0b3e00 2024-09-12T02:43:05.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.445+0000 7f73a2a00640 1 -- 172.21.15.112:0/2851454067 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739c037040 con 0x7f73ac0b3e00 2024-09-12T02:43:05.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.445+0000 7f73abe00640 1 -- 172.21.15.112:0/2851454067 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73ac0cbf70 con 0x7f73ac0b3e00 2024-09-12T02:43:05.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.445+0000 7f73abe00640 1 -- 172.21.15.112:0/2851454067 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73ac0c9620 con 0x7f73ac0b3e00 2024-09-12T02:43:05.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.446+0000 7f73abe00640 1 -- 172.21.15.112:0/2851454067 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73ac0c9440 con 0x7f73ac0b3e00 2024-09-12T02:43:05.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.447+0000 7f73a2a00640 1 -- 172.21.15.112:0/2851454067 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f739c044020 con 0x7f73ac0b3e00 2024-09-12T02:43:05.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.448+0000 7f73a2a00640 1 --2- 172.21.15.112:0/2851454067 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f738c06be60 0x7f738c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:05.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.448+0000 7f73a2a00640 1 -- 172.21.15.112:0/2851454067 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7f739c0ab6f0 con 0x7f73ac0b3e00 2024-09-12T02:43:05.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.448+0000 7f73aa000640 1 --2- 172.21.15.112:0/2851454067 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f738c06be60 0x7f738c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:05.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.448+0000 7f73aa000640 1 --2- 172.21.15.112:0/2851454067 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f738c06be60 0x7f738c06e320 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f73ac1f7f20 tx=0x7f7398008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:05.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.452+0000 7f73a2a00640 1 -- 172.21.15.112:0/2851454067 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f73ac0c9440 con 0x7f73ac0b3e00 2024-09-12T02:43:05.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:05.664+0000 7f73abe00640 1 -- 172.21.15.112:0/2851454067 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f73ac0d1af0 con 0x7f73ac0b3e00 2024-09-12T02:43:06.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.247+0000 7f73a2a00640 1 -- 172.21.15.112:0/2851454067 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7f739c04b030 con 0x7f73ac0b3e00 2024-09-12T02:43:06.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.250+0000 7f73abe00640 1 -- 172.21.15.112:0/2851454067 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f738c06be60 msgr2=0x7f738c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:06.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.250+0000 7f73abe00640 1 --2- 172.21.15.112:0/2851454067 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f738c06be60 0x7f738c06e320 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f73ac1f7f20 tx=0x7f7398008040 comp rx=0 tx=0).stop 2024-09-12T02:43:06.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.250+0000 7f73abe00640 1 -- 172.21.15.112:0/2851454067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73ac0b3e00 msgr2=0x7f73ac0b4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:06.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.250+0000 7f73abe00640 1 --2- 172.21.15.112:0/2851454067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73ac0b3e00 0x7f73ac0b4330 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f739c02a220 tx=0x7f739c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:43:06.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.250+0000 7f73abe00640 1 -- 172.21.15.112:0/2851454067 shutdown_connections 2024-09-12T02:43:06.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.250+0000 7f73abe00640 1 --2- 172.21.15.112:0/2851454067 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73ac0d1710 0x7f73ac0ce880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:06.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.250+0000 7f73abe00640 1 --2- 172.21.15.112:0/2851454067 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f738c06be60 0x7f738c06e320 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:06.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.250+0000 7f73abe00640 1 --2- 172.21.15.112:0/2851454067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73ac0cf7a0 0x7f73ac15c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:06.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.250+0000 7f73abe00640 1 --2- 172.21.15.112:0/2851454067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73ac0b3e00 0x7f73ac0b4330 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:06.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.250+0000 7f73abe00640 1 -- 172.21.15.112:0/2851454067 >> 172.21.15.112:0/2851454067 conn(0x7f73ac09e030 msgr2=0x7f73ac0d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:06.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.250+0000 7f73abe00640 1 -- 172.21.15.112:0/2851454067 shutdown_connections 2024-09-12T02:43:06.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.250+0000 7f73abe00640 1 -- 172.21.15.112:0/2851454067 wait complete. 2024-09-12T02:43:06.266 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T02:43:06.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.460+0000 7fc71d800640 1 Processor -- start 2024-09-12T02:43:06.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.460+0000 7fc71d800640 1 -- start start 2024-09-12T02:43:06.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.462+0000 7fc71d800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc7180b5190 0x7fc71815d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:06.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.462+0000 7fc71d800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7180d0970 0x7fc7180d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:06.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.462+0000 7fc71d800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7180d12c0 con 0x7fc718157190 2024-09-12T02:43:06.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.462+0000 7fc71d800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc71815d650 con 0x7fc7180b5190 2024-09-12T02:43:06.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.462+0000 7fc71d800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc7180720b0 con 0x7fc7180d0970 2024-09-12T02:43:06.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.462+0000 7fc716a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc718157190 0x7fc71806d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47072/0 (socket says 172.21.15.112:47072) 2024-09-12T02:43:06.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.462+0000 7fc716a00640 1 -- 172.21.15.112:0/4189143888 learned_addr learned my addr 172.21.15.112:0/4189143888 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:06.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.462+0000 7fc70e000640 1 --2- 172.21.15.112:0/4189143888 >> v2:172.21.15.137:3300/0 conn(0x7fc7180b5190 0x7fc71815d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:06.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.462+0000 7fc717400640 1 --2- 172.21.15.112:0/4189143888 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7180d0970 0x7fc7180d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:06.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.462+0000 7fc716000640 1 -- 172.21.15.112:0/4189143888 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4247065949 0 0) 0x7fc708001110 con 0x7fc718157190 2024-09-12T02:43:06.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.462+0000 7fc716000640 1 -- 172.21.15.112:0/4189143888 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6fc003520 con 0x7fc718157190 2024-09-12T02:43:06.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.463+0000 7fc716000640 1 -- 172.21.15.112:0/4189143888 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2864084584 0 0) 0x7fc6fc003520 con 0x7fc718157190 2024-09-12T02:43:06.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.463+0000 7fc716000640 1 -- 172.21.15.112:0/4189143888 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7180d0970 msgr2=0x7fc7180d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:06.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.463+0000 7fc716000640 1 --2- 172.21.15.112:0/4189143888 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7180d0970 0x7fc7180d0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:06.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.463+0000 7fc716000640 1 -- 172.21.15.112:0/4189143888 >> v2:172.21.15.137:3300/0 conn(0x7fc7180b5190 msgr2=0x7fc71815d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:06.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.463+0000 7fc716000640 1 --2- 172.21.15.112:0/4189143888 >> v2:172.21.15.137:3300/0 conn(0x7fc7180b5190 0x7fc71815d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:06.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.463+0000 7fc716000640 1 -- 172.21.15.112:0/4189143888 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71815d880 con 0x7fc718157190 2024-09-12T02:43:06.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.463+0000 7fc716000640 1 -- 172.21.15.112:0/4189143888 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7fc708001840 con 0x7fc718157190 2024-09-12T02:43:06.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.463+0000 7fc70e000640 1 --2- 172.21.15.112:0/4189143888 >> v2:172.21.15.137:3300/0 conn(0x7fc7180b5190 0x7fc71815d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:43:06.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.463+0000 7fc716000640 1 -- 172.21.15.112:0/4189143888 >> v1:172.21.15.112:6789/0 conn(0x7fc718157190 legacy=0x7fc71806d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:06.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.463+0000 7fc716000640 1 --2- 172.21.15.112:0/4189143888 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7180d0970 0x7fc6fc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:06.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.463+0000 7fc716000640 1 --2- 172.21.15.112:0/4189143888 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6fc003f30 0x7fc6fc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:06.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.463+0000 7fc716000640 1 --2- 172.21.15.112:0/4189143888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6fc004d40 0x7fc6fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:06.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.463+0000 7fc716000640 1 -- 172.21.15.112:0/4189143888 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc7180720b0 con 0x7fc6fc004d40 2024-09-12T02:43:06.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.463+0000 7fc716000640 1 -- 172.21.15.112:0/4189143888 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc6fc00b9c0 con 0x7fc6fc003f30 2024-09-12T02:43:06.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.463+0000 7fc716000640 1 -- 172.21.15.112:0/4189143888 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc6fc00bb40 con 0x7fc7180d0970 2024-09-12T02:43:06.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.463+0000 7fc717400640 1 --2- 172.21.15.112:0/4189143888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6fc004d40 0x7fc6fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:06.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.463+0000 7fc716a00640 1 --2- 172.21.15.112:0/4189143888 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7180d0970 0x7fc6fc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:06.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.463+0000 7fc70e000640 1 --2- 172.21.15.112:0/4189143888 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6fc003f30 0x7fc6fc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:06.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.464+0000 7fc717400640 1 -- 172.21.15.112:0/4189143888 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7180d0970 msgr2=0x7fc6fc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:06.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.464+0000 7fc717400640 1 --2- 172.21.15.112:0/4189143888 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7180d0970 0x7fc6fc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:06.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.464+0000 7fc717400640 1 -- 172.21.15.112:0/4189143888 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6fc003f30 msgr2=0x7fc6fc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:06.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.464+0000 7fc717400640 1 --2- 172.21.15.112:0/4189143888 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6fc003f30 0x7fc6fc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:06.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.464+0000 7fc717400640 1 -- 172.21.15.112:0/4189143888 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6fc003520 con 0x7fc6fc004d40 2024-09-12T02:43:06.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.464+0000 7fc716a00640 1 --2- 172.21.15.112:0/4189143888 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc7180d0970 0x7fc6fc0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:43:06.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.464+0000 7fc70e000640 1 --2- 172.21.15.112:0/4189143888 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6fc003f30 0x7fc6fc004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:43:06.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.465+0000 7fc717400640 1 --2- 172.21.15.112:0/4189143888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6fc004d40 0x7fc6fc0051c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc710009fc0 tx=0x7fc6fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=196d92766b9f557d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:06.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.465+0000 7fc716000640 1 -- 172.21.15.112:0/4189143888 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc710009c10 con 0x7fc6fc004d40 2024-09-12T02:43:06.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.465+0000 7fc716000640 1 -- 172.21.15.112:0/4189143888 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc710036070 con 0x7fc6fc004d40 2024-09-12T02:43:06.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.465+0000 7fc716000640 1 -- 172.21.15.112:0/4189143888 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc710031850 con 0x7fc6fc004d40 2024-09-12T02:43:06.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.465+0000 7fc71d800640 1 -- 172.21.15.112:0/4189143888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6fc004d40 msgr2=0x7fc6fc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:06.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.465+0000 7fc71d800640 1 --2- 172.21.15.112:0/4189143888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6fc004d40 0x7fc6fc0051c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc710009fc0 tx=0x7fc6fc005830 comp rx=0 tx=0).stop 2024-09-12T02:43:06.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.465+0000 7fc717400640 1 -- 172.21.15.112:0/4189143888 reap_dead start 2024-09-12T02:43:06.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.465+0000 7fc71d800640 1 -- 172.21.15.112:0/4189143888 shutdown_connections 2024-09-12T02:43:06.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.465+0000 7fc71d800640 1 -- 172.21.15.112:0/4189143888 >> 172.21.15.112:0/4189143888 conn(0x7fc7180b2730 msgr2=0x7fc7180b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:06.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.466+0000 7fc71d800640 1 -- 172.21.15.112:0/4189143888 shutdown_connections 2024-09-12T02:43:06.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.466+0000 7fc71d800640 1 -- 172.21.15.112:0/4189143888 wait complete. 2024-09-12T02:43:06.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.467+0000 7fc71d800640 1 Processor -- start 2024-09-12T02:43:06.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.467+0000 7fc71d800640 1 -- start start 2024-09-12T02:43:06.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.468+0000 7fc71d800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6fc004d40 0x7fc718154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:06.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.468+0000 7fc71d800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc71814d780 0x7fc7181f8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:06.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.468+0000 7fc71d800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc71814d1c0 0x7fc7181f89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:06.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.468+0000 7fc71d800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc718072350 con 0x7fc71814d780 2024-09-12T02:43:06.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.468+0000 7fc71d800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc71815de40 con 0x7fc71814d1c0 2024-09-12T02:43:06.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.468+0000 7fc71d800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc718157570 con 0x7fc6fc004d40 2024-09-12T02:43:06.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.469+0000 7fc70e000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc71814d780 0x7fc7181f8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:06.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.469+0000 7fc70e000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc71814d780 0x7fc7181f8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35060/0 (socket says 172.21.15.112:35060) 2024-09-12T02:43:06.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.469+0000 7fc70e000640 1 -- 172.21.15.112:0/1575247802 learned_addr learned my addr 172.21.15.112:0/1575247802 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:06.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.469+0000 7fc717400640 1 --2- 172.21.15.112:0/1575247802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc71814d1c0 0x7fc7181f89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:06.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.469+0000 7fc716a00640 1 --2- 172.21.15.112:0/1575247802 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6fc004d40 0x7fc718154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:06.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.469+0000 7fc70e000640 1 -- 172.21.15.112:0/1575247802 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6fc004d40 msgr2=0x7fc718154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:06.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.469+0000 7fc70e000640 1 --2- 172.21.15.112:0/1575247802 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6fc004d40 0x7fc718154b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:06.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.469+0000 7fc70e000640 1 -- 172.21.15.112:0/1575247802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc71814d1c0 msgr2=0x7fc7181f89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:06.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.469+0000 7fc70e000640 1 --2- 172.21.15.112:0/1575247802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc71814d1c0 0x7fc7181f89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:06.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.469+0000 7fc70e000640 1 -- 172.21.15.112:0/1575247802 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71814f4c0 con 0x7fc71814d780 2024-09-12T02:43:06.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.469+0000 7fc70e000640 1 --2- 172.21.15.112:0/1575247802 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc71814d780 0x7fc7181f8460 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc700011d00 tx=0x7fc70000f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:06.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.469+0000 7fc70f400640 1 -- 172.21.15.112:0/1575247802 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc700014440 con 0x7fc71814d780 2024-09-12T02:43:06.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.470+0000 7fc70f400640 1 -- 172.21.15.112:0/1575247802 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7000145e0 con 0x7fc71814d780 2024-09-12T02:43:06.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.470+0000 7fc70f400640 1 -- 172.21.15.112:0/1575247802 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc700014990 con 0x7fc71814d780 2024-09-12T02:43:06.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.470+0000 7fc71d800640 1 -- 172.21.15.112:0/1575247802 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc71814f7a0 con 0x7fc71814d780 2024-09-12T02:43:06.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.470+0000 7fc71d800640 1 -- 172.21.15.112:0/1575247802 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7181550c0 con 0x7fc71814d780 2024-09-12T02:43:06.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.471+0000 7fc71d800640 1 -- 172.21.15.112:0/1575247802 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7180d0d80 con 0x7fc71814d780 2024-09-12T02:43:06.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.472+0000 7fc70f400640 1 -- 172.21.15.112:0/1575247802 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc700012040 con 0x7fc71814d780 2024-09-12T02:43:06.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.472+0000 7fc70f400640 1 --2- 172.21.15.112:0/1575247802 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc6f406be30 0x7fc6f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:06.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.473+0000 7fc70f400640 1 -- 172.21.15.112:0/1575247802 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7fc70008b890 con 0x7fc71814d780 2024-09-12T02:43:06.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.473+0000 7fc716a00640 1 --2- 172.21.15.112:0/1575247802 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc6f406be30 0x7fc6f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:06.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.473+0000 7fc716a00640 1 --2- 172.21.15.112:0/1575247802 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc6f406be30 0x7fc6f406e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc708000ff0 tx=0x7fc708009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:06.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.477+0000 7fc70f400640 1 -- 172.21.15.112:0/1575247802 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc700019030 con 0x7fc71814d780 2024-09-12T02:43:06.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:06.648+0000 7fc71d800640 1 -- 172.21.15.112:0/1575247802 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc71814e700 con 0x7fc71814d780 2024-09-12T02:43:07.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.248+0000 7fc70f400640 1 -- 172.21.15.112:0/1575247802 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) ==== 181+0+0 (secure 0 0 0) 0x7fc70005a1d0 con 0x7fc71814d780 2024-09-12T02:43:07.249 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' removed 2024-09-12T02:43:07.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.251+0000 7fc71d800640 1 -- 172.21.15.112:0/1575247802 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc6f406be30 msgr2=0x7fc6f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:07.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.251+0000 7fc71d800640 1 --2- 172.21.15.112:0/1575247802 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc6f406be30 0x7fc6f406e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc708000ff0 tx=0x7fc708009040 comp rx=0 tx=0).stop 2024-09-12T02:43:07.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.251+0000 7fc71d800640 1 -- 172.21.15.112:0/1575247802 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc71814d780 msgr2=0x7fc7181f8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:07.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.251+0000 7fc71d800640 1 --2- 172.21.15.112:0/1575247802 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc71814d780 0x7fc7181f8460 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc700011d00 tx=0x7fc70000f610 comp rx=0 tx=0).stop 2024-09-12T02:43:07.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.251+0000 7fc71d800640 1 -- 172.21.15.112:0/1575247802 shutdown_connections 2024-09-12T02:43:07.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.251+0000 7fc71d800640 1 --2- 172.21.15.112:0/1575247802 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc6f406be30 0x7fc6f406e2f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.251+0000 7fc71d800640 1 --2- 172.21.15.112:0/1575247802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc71814d1c0 0x7fc7181f89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.251+0000 7fc71d800640 1 --2- 172.21.15.112:0/1575247802 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc71814d780 0x7fc7181f8460 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.251+0000 7fc71d800640 1 --2- 172.21.15.112:0/1575247802 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6fc004d40 0x7fc718154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.251+0000 7fc71d800640 1 -- 172.21.15.112:0/1575247802 >> 172.21.15.112:0/1575247802 conn(0x7fc7180b2730 msgr2=0x7fc718155440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:07.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.251+0000 7fc71d800640 1 -- 172.21.15.112:0/1575247802 shutdown_connections 2024-09-12T02:43:07.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.251+0000 7fc71d800640 1 -- 172.21.15.112:0/1575247802 wait complete. 2024-09-12T02:43:07.271 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T02:43:07.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.427+0000 7f8824000640 1 Processor -- start 2024-09-12T02:43:07.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.427+0000 7f8824000640 1 -- start start 2024-09-12T02:43:07.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.428+0000 7f8824000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f881c0d1080 0x7f881c15d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:07.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.428+0000 7f8824000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f881c0720b0 con 0x7f881c157190 2024-09-12T02:43:07.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.428+0000 7f8824000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f881c15d880 con 0x7f881c0b5190 2024-09-12T02:43:07.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.428+0000 7f8824000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f881c15d650 con 0x7f881c0d1080 2024-09-12T02:43:07.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.429+0000 7f8821600640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f881c157190 0x7f881c06d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47076/0 (socket says 172.21.15.112:47076) 2024-09-12T02:43:07.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.429+0000 7f8821600640 1 -- 172.21.15.112:0/4059877393 learned_addr learned my addr 172.21.15.112:0/4059877393 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:07.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.429+0000 7f8822000640 1 --2- 172.21.15.112:0/4059877393 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f881c0d1080 0x7f881c15d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:07.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.429+0000 7f881be00640 1 -- 172.21.15.112:0/4059877393 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 897313213 0 0) 0x7f881c0720b0 con 0x7f881c157190 2024-09-12T02:43:07.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.429+0000 7f881be00640 1 -- 172.21.15.112:0/4059877393 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8804003520 con 0x7f881c157190 2024-09-12T02:43:07.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.429+0000 7f881be00640 1 -- 172.21.15.112:0/4059877393 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 379228168 0 0) 0x7f8804003520 con 0x7f881c157190 2024-09-12T02:43:07.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.429+0000 7f881be00640 1 -- 172.21.15.112:0/4059877393 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f881c0d1080 msgr2=0x7f881c15d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:07.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.429+0000 7f881be00640 1 --2- 172.21.15.112:0/4059877393 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f881c0d1080 0x7f881c15d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.429+0000 7f881be00640 1 -- 172.21.15.112:0/4059877393 >> v1:172.21.15.137:6789/0 conn(0x7f881c0b5190 legacy=0x7f881c0d0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:07.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.429+0000 7f881be00640 1 -- 172.21.15.112:0/4059877393 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f881c15db60 con 0x7f881c157190 2024-09-12T02:43:07.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.429+0000 7f881be00640 1 -- 172.21.15.112:0/4059877393 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f8810001690 con 0x7f881c157190 2024-09-12T02:43:07.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.429+0000 7f881be00640 1 -- 172.21.15.112:0/4059877393 >> v1:172.21.15.112:6789/0 conn(0x7f881c157190 legacy=0x7f881c06d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:07.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.430+0000 7f881be00640 1 --2- 172.21.15.112:0/4059877393 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f881c0d1080 0x7f88040039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:07.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.430+0000 7f881be00640 1 --2- 172.21.15.112:0/4059877393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8804003f60 0x7f8804004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:07.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.430+0000 7f881be00640 1 --2- 172.21.15.112:0/4059877393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8804004d40 0x7f88040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:07.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.430+0000 7f881be00640 1 -- 172.21.15.112:0/4059877393 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f880400ba70 con 0x7f8804004d40 2024-09-12T02:43:07.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.430+0000 7f881be00640 1 -- 172.21.15.112:0/4059877393 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f880400bc20 con 0x7f8804003f60 2024-09-12T02:43:07.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.430+0000 7f881be00640 1 -- 172.21.15.112:0/4059877393 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f880400be20 con 0x7f881c0d1080 2024-09-12T02:43:07.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.430+0000 7f8822000640 1 --2- 172.21.15.112:0/4059877393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8804004d40 0x7f88040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:07.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.430+0000 7f8821600640 1 --2- 172.21.15.112:0/4059877393 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f881c0d1080 0x7f88040039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:07.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.430+0000 7f8820c00640 1 --2- 172.21.15.112:0/4059877393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8804003f60 0x7f8804004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:07.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.430+0000 7f8822000640 1 -- 172.21.15.112:0/4059877393 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f881c0d1080 msgr2=0x7f88040039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:07.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.430+0000 7f8822000640 1 --2- 172.21.15.112:0/4059877393 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f881c0d1080 0x7f88040039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.430+0000 7f8822000640 1 -- 172.21.15.112:0/4059877393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8804003f60 msgr2=0x7f8804004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:07.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.430+0000 7f8822000640 1 --2- 172.21.15.112:0/4059877393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8804003f60 0x7f8804004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.430+0000 7f8822000640 1 -- 172.21.15.112:0/4059877393 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8804003520 con 0x7f8804004d40 2024-09-12T02:43:07.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.431+0000 7f8822000640 1 --2- 172.21.15.112:0/4059877393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8804004d40 0x7f88040051c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8814009fc0 tx=0x7f8804005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7333f20261dcfaa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:07.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.431+0000 7f881be00640 1 -- 172.21.15.112:0/4059877393 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8814009c10 con 0x7f8804004d40 2024-09-12T02:43:07.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.431+0000 7f881be00640 1 -- 172.21.15.112:0/4059877393 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8814036070 con 0x7f8804004d40 2024-09-12T02:43:07.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.431+0000 7f881be00640 1 -- 172.21.15.112:0/4059877393 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8814031860 con 0x7f8804004d40 2024-09-12T02:43:07.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.432+0000 7f8824000640 1 -- 172.21.15.112:0/4059877393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8804004d40 msgr2=0x7f88040051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:07.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.432+0000 7f8824000640 1 --2- 172.21.15.112:0/4059877393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8804004d40 0x7f88040051c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8814009fc0 tx=0x7f8804005830 comp rx=0 tx=0).stop 2024-09-12T02:43:07.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.432+0000 7f8822000640 1 -- 172.21.15.112:0/4059877393 reap_dead start 2024-09-12T02:43:07.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.432+0000 7f8824000640 1 -- 172.21.15.112:0/4059877393 shutdown_connections 2024-09-12T02:43:07.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.432+0000 7f8824000640 1 -- 172.21.15.112:0/4059877393 >> 172.21.15.112:0/4059877393 conn(0x7f881c0b2730 msgr2=0x7f881c0b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:07.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.432+0000 7f8824000640 1 -- 172.21.15.112:0/4059877393 shutdown_connections 2024-09-12T02:43:07.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.432+0000 7f8824000640 1 -- 172.21.15.112:0/4059877393 wait complete. 2024-09-12T02:43:07.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.434+0000 7f8824000640 1 Processor -- start 2024-09-12T02:43:07.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.434+0000 7f8824000640 1 -- start start 2024-09-12T02:43:07.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.435+0000 7f8824000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f881c14abc0 0x7f881c14fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:07.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.435+0000 7f8824000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f881c14b4f0 0x7f881c15bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:07.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.435+0000 7f8824000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f881c14afa0 0x7f881c15c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:07.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.435+0000 7f8824000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f881c157570 con 0x7f881c14b4f0 2024-09-12T02:43:07.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.435+0000 7f8824000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f881c072350 con 0x7f881c14afa0 2024-09-12T02:43:07.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.435+0000 7f8824000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f881c15d110 con 0x7f881c14abc0 2024-09-12T02:43:07.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.435+0000 7f8820c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f881c14b4f0 0x7f881c15bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:07.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.435+0000 7f8820c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f881c14b4f0 0x7f881c15bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35074/0 (socket says 172.21.15.112:35074) 2024-09-12T02:43:07.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.435+0000 7f8820c00640 1 -- 172.21.15.112:0/2836523711 learned_addr learned my addr 172.21.15.112:0/2836523711 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:07.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.435+0000 7f8821600640 1 --2- 172.21.15.112:0/2836523711 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f881c14abc0 0x7f881c14fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:07.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.435+0000 7f8822000640 1 --2- 172.21.15.112:0/2836523711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f881c14afa0 0x7f881c15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:07.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.435+0000 7f8820c00640 1 -- 172.21.15.112:0/2836523711 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f881c14abc0 msgr2=0x7f881c14fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:07.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.435+0000 7f8820c00640 1 --2- 172.21.15.112:0/2836523711 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f881c14abc0 0x7f881c14fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.435+0000 7f8820c00640 1 -- 172.21.15.112:0/2836523711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f881c14afa0 msgr2=0x7f881c15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:07.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.435+0000 7f8820c00640 1 --2- 172.21.15.112:0/2836523711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f881c14afa0 0x7f881c15c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:07.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.435+0000 7f8820c00640 1 -- 172.21.15.112:0/2836523711 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f881c14f5a0 con 0x7f881c14b4f0 2024-09-12T02:43:07.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.435+0000 7f8822000640 1 --2- 172.21.15.112:0/2836523711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f881c14afa0 0x7f881c15c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:43:07.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.436+0000 7f8820c00640 1 --2- 172.21.15.112:0/2836523711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f881c14b4f0 0x7f881c15bb30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f880800e550 tx=0x7f880800ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:07.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.436+0000 7f8819600640 1 -- 172.21.15.112:0/2836523711 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88080052e0 con 0x7f881c14b4f0 2024-09-12T02:43:07.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.436+0000 7f8819600640 1 -- 172.21.15.112:0/2836523711 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8808018070 con 0x7f881c14b4f0 2024-09-12T02:43:07.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.436+0000 7f8824000640 1 -- 172.21.15.112:0/2836523711 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f881c14f880 con 0x7f881c14b4f0 2024-09-12T02:43:07.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.436+0000 7f8819600640 1 -- 172.21.15.112:0/2836523711 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8808003810 con 0x7f881c14b4f0 2024-09-12T02:43:07.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.436+0000 7f8824000640 1 -- 172.21.15.112:0/2836523711 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f881c152e90 con 0x7f881c14b4f0 2024-09-12T02:43:07.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.437+0000 7f8824000640 1 -- 172.21.15.112:0/2836523711 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f881c150500 con 0x7f881c14b4f0 2024-09-12T02:43:07.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.438+0000 7f8819600640 1 -- 172.21.15.112:0/2836523711 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f88080039b0 con 0x7f881c14b4f0 2024-09-12T02:43:07.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.439+0000 7f8819600640 1 --2- 172.21.15.112:0/2836523711 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f87fc06be30 0x7f87fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:07.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.439+0000 7f8819600640 1 -- 172.21.15.112:0/2836523711 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5357+0+0 (secure 0 0 0) 0x7f880808a930 con 0x7f881c14b4f0 2024-09-12T02:43:07.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.439+0000 7f8821600640 1 --2- 172.21.15.112:0/2836523711 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f87fc06be30 0x7f87fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:07.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.440+0000 7f8821600640 1 --2- 172.21.15.112:0/2836523711 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f87fc06be30 0x7f87fc06e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8810001ce0 tx=0x7f8810007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:07.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.443+0000 7f8819600640 1 -- 172.21.15.112:0/2836523711 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f881c150500 con 0x7f881c14b4f0 2024-09-12T02:43:07.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:07.615+0000 7f8824000640 1 -- 172.21.15.112:0/2836523711 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f881c14fa50 con 0x7f881c14b4f0 2024-09-12T02:43:08.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.258+0000 7f8819600640 1 -- 172.21.15.112:0/2836523711 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) ==== 169+0+0 (secure 0 0 0) 0x7f8808059430 con 0x7f881c14b4f0 2024-09-12T02:43:08.259 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' removed 2024-09-12T02:43:08.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.262+0000 7f8824000640 1 -- 172.21.15.112:0/2836523711 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f87fc06be30 msgr2=0x7f87fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:08.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.262+0000 7f8824000640 1 --2- 172.21.15.112:0/2836523711 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f87fc06be30 0x7f87fc06e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8810001ce0 tx=0x7f8810007040 comp rx=0 tx=0).stop 2024-09-12T02:43:08.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.262+0000 7f8824000640 1 -- 172.21.15.112:0/2836523711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f881c14b4f0 msgr2=0x7f881c15bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:08.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.262+0000 7f8824000640 1 --2- 172.21.15.112:0/2836523711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f881c14b4f0 0x7f881c15bb30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f880800e550 tx=0x7f880800ea10 comp rx=0 tx=0).stop 2024-09-12T02:43:08.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.262+0000 7f8824000640 1 -- 172.21.15.112:0/2836523711 shutdown_connections 2024-09-12T02:43:08.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.262+0000 7f8824000640 1 --2- 172.21.15.112:0/2836523711 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f87fc06be30 0x7f87fc06e2f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:08.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.262+0000 7f8824000640 1 --2- 172.21.15.112:0/2836523711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f881c14afa0 0x7f881c15c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:08.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.262+0000 7f8824000640 1 --2- 172.21.15.112:0/2836523711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f881c14b4f0 0x7f881c15bb30 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:08.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.262+0000 7f8824000640 1 --2- 172.21.15.112:0/2836523711 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f881c14abc0 0x7f881c14fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:08.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.262+0000 7f8824000640 1 -- 172.21.15.112:0/2836523711 >> 172.21.15.112:0/2836523711 conn(0x7f881c0b2730 msgr2=0x7f881c160690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:08.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.262+0000 7f8824000640 1 -- 172.21.15.112:0/2836523711 shutdown_connections 2024-09-12T02:43:08.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.263+0000 7f8824000640 1 -- 172.21.15.112:0/2836523711 wait complete. 2024-09-12T02:43:08.283 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T02:43:08.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.439+0000 7f29c7e00640 1 Processor -- start 2024-09-12T02:43:08.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.439+0000 7f29c7e00640 1 -- start start 2024-09-12T02:43:08.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.440+0000 7f29c7e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f29c80ce460 0x7f29c80d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:08.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.440+0000 7f29c7e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f29c815db60 0x7f29c80d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:08.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.440+0000 7f29c7e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29c806e990 con 0x7f29c815a450 2024-09-12T02:43:08.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.440+0000 7f29c7e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f29c8071eb0 con 0x7f29c80ce460 2024-09-12T02:43:08.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.440+0000 7f29c7e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f29c806ec70 con 0x7f29c815db60 2024-09-12T02:43:08.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.441+0000 7f29be000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f29c80ce460 0x7f29c80d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:08.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.441+0000 7f29be000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f29c80ce460 0x7f29c80d0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35080/0 (socket says 172.21.15.112:35080) 2024-09-12T02:43:08.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.441+0000 7f29be000640 1 -- 172.21.15.112:0/1111905790 learned_addr learned my addr 172.21.15.112:0/1111905790 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:08.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.441+0000 7f29c7400640 1 --2- 172.21.15.112:0/1111905790 >> v2:172.21.15.137:3300/0 conn(0x7f29c815db60 0x7f29c80d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:08.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.441+0000 7f29be000640 1 -- 172.21.15.112:0/1111905790 >> v2:172.21.15.137:3300/0 conn(0x7f29c815db60 msgr2=0x7f29c80d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:08.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.441+0000 7f29be000640 1 --2- 172.21.15.112:0/1111905790 >> v2:172.21.15.137:3300/0 conn(0x7f29c815db60 0x7f29c80d0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:08.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.441+0000 7f29be000640 1 -- 172.21.15.112:0/1111905790 >> v1:172.21.15.137:6789/0 conn(0x7f29c815a450 legacy=0x7f29c806e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:08.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.441+0000 7f29be000640 1 -- 172.21.15.112:0/1111905790 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c8072100 con 0x7f29c80ce460 2024-09-12T02:43:08.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.442+0000 7f29be000640 1 --2- 172.21.15.112:0/1111905790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29c80ce460 0x7f29c80d0820 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f29c80714c0 tx=0x7f29b002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3acab474b95342 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:08.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.443+0000 7f29c6000640 1 -- 172.21.15.112:0/1111905790 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b0037070 con 0x7f29c80ce460 2024-09-12T02:43:08.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.443+0000 7f29c6000640 1 -- 172.21.15.112:0/1111905790 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b002ae50 con 0x7f29c80ce460 2024-09-12T02:43:08.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.443+0000 7f29c6000640 1 -- 172.21.15.112:0/1111905790 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b0032860 con 0x7f29c80ce460 2024-09-12T02:43:08.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.443+0000 7f29c7e00640 1 -- 172.21.15.112:0/1111905790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29c80ce460 msgr2=0x7f29c80d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:08.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.443+0000 7f29c7e00640 1 --2- 172.21.15.112:0/1111905790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29c80ce460 0x7f29c80d0820 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f29c80714c0 tx=0x7f29b002a300 comp rx=0 tx=0).stop 2024-09-12T02:43:08.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.443+0000 7f29c7e00640 1 -- 172.21.15.112:0/1111905790 shutdown_connections 2024-09-12T02:43:08.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.443+0000 7f29c7e00640 1 --2- 172.21.15.112:0/1111905790 >> v2:172.21.15.137:3300/0 conn(0x7f29c815db60 0x7f29c80d0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:08.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.443+0000 7f29c7e00640 1 --2- 172.21.15.112:0/1111905790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29c80ce460 0x7f29c80d0820 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:08.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.443+0000 7f29c7e00640 1 -- 172.21.15.112:0/1111905790 >> 172.21.15.112:0/1111905790 conn(0x7f29c806bbd0 msgr2=0x7f29c806bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:08.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.443+0000 7f29c7e00640 1 -- 172.21.15.112:0/1111905790 shutdown_connections 2024-09-12T02:43:08.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.443+0000 7f29c7e00640 1 -- 172.21.15.112:0/1111905790 wait complete. 2024-09-12T02:43:08.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.445+0000 7f29c7e00640 1 Processor -- start 2024-09-12T02:43:08.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.445+0000 7f29c7e00640 1 -- start start 2024-09-12T02:43:08.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.446+0000 7f29c7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29c80ce460 0x7f29c815b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:08.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.446+0000 7f29c7e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29c815a450 0x7f29c81f8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:08.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.446+0000 7f29c7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29c815db60 0x7f29c80b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:08.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.446+0000 7f29c7e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f29c8072900 con 0x7f29c815db60 2024-09-12T02:43:08.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.446+0000 7f29c7e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f29c815a830 con 0x7f29c80ce460 2024-09-12T02:43:08.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.446+0000 7f29c7e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f29c8072a80 con 0x7f29c815a450 2024-09-12T02:43:08.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.446+0000 7f29c7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29c815db60 0x7f29c80b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:08.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.446+0000 7f29c7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29c815db60 0x7f29c80b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35084/0 (socket says 172.21.15.112:35084) 2024-09-12T02:43:08.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.446+0000 7f29c7400640 1 -- 172.21.15.112:0/3593219464 learned_addr learned my addr 172.21.15.112:0/3593219464 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:08.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.446+0000 7f29c6a00640 1 --2- 172.21.15.112:0/3593219464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29c80ce460 0x7f29c815b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:08.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.446+0000 7f29be000640 1 --2- 172.21.15.112:0/3593219464 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29c815a450 0x7f29c81f8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:08.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.446+0000 7f29c7400640 1 -- 172.21.15.112:0/3593219464 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29c815a450 msgr2=0x7f29c81f8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:08.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.446+0000 7f29c7400640 1 --2- 172.21.15.112:0/3593219464 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29c815a450 0x7f29c81f8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:08.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.446+0000 7f29c7400640 1 -- 172.21.15.112:0/3593219464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29c80ce460 msgr2=0x7f29c815b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:08.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.446+0000 7f29c7400640 1 --2- 172.21.15.112:0/3593219464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29c80ce460 0x7f29c815b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:08.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.446+0000 7f29c7400640 1 -- 172.21.15.112:0/3593219464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c815bc10 con 0x7f29c815db60 2024-09-12T02:43:08.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.447+0000 7f29c7400640 1 --2- 172.21.15.112:0/3593219464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29c815db60 0x7f29c80b39e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f29c0007e90 tx=0x7f29c000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:08.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.447+0000 7f29bf400640 1 -- 172.21.15.112:0/3593219464 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c0014420 con 0x7f29c815db60 2024-09-12T02:43:08.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.447+0000 7f29bf400640 1 -- 172.21.15.112:0/3593219464 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29c0019070 con 0x7f29c815db60 2024-09-12T02:43:08.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.447+0000 7f29bf400640 1 -- 172.21.15.112:0/3593219464 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c0014800 con 0x7f29c815db60 2024-09-12T02:43:08.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.447+0000 7f29c7e00640 1 -- 172.21.15.112:0/3593219464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29c815e4b0 con 0x7f29c815db60 2024-09-12T02:43:08.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.447+0000 7f29c7e00640 1 -- 172.21.15.112:0/3593219464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29c815ea70 con 0x7f29c815db60 2024-09-12T02:43:08.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.448+0000 7f29c7e00640 1 -- 172.21.15.112:0/3593219464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29c806e140 con 0x7f29c815db60 2024-09-12T02:43:08.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.449+0000 7f29bf400640 1 -- 172.21.15.112:0/3593219464 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f29c00149a0 con 0x7f29c815db60 2024-09-12T02:43:08.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.450+0000 7f29bf400640 1 --2- 172.21.15.112:0/3593219464 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f29a406be30 0x7f29a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:08.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.450+0000 7f29bf400640 1 -- 172.21.15.112:0/3593219464 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f29c008b400 con 0x7f29c815db60 2024-09-12T02:43:08.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.451+0000 7f29c6a00640 1 --2- 172.21.15.112:0/3593219464 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f29a406be30 0x7f29a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:08.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.451+0000 7f29c6a00640 1 --2- 172.21.15.112:0/3593219464 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f29a406be30 0x7f29a406e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f29b8001640 tx=0x7f29b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:08.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.455+0000 7f29bf400640 1 -- 172.21.15.112:0/3593219464 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f29c005a0a0 con 0x7f29c815db60 2024-09-12T02:43:08.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.629+0000 7f29c7e00640 1 -- 172.21.15.112:0/3593219464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f29c80aea50 con 0x7f29c815db60 2024-09-12T02:43:08.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.633+0000 7f29bf400640 1 -- 172.21.15.112:0/3593219464 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) ==== 104+0+0 (secure 0 0 0) 0x7f29c00599a0 con 0x7f29c815db60 2024-09-12T02:43:08.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.635+0000 7f29c7e00640 1 -- 172.21.15.112:0/3593219464 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f29a406be30 msgr2=0x7f29a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:08.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.635+0000 7f29c7e00640 1 --2- 172.21.15.112:0/3593219464 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f29a406be30 0x7f29a406e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f29b8001640 tx=0x7f29b8009040 comp rx=0 tx=0).stop 2024-09-12T02:43:08.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.635+0000 7f29c7e00640 1 -- 172.21.15.112:0/3593219464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29c815db60 msgr2=0x7f29c80b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:08.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.635+0000 7f29c7e00640 1 --2- 172.21.15.112:0/3593219464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29c815db60 0x7f29c80b39e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f29c0007e90 tx=0x7f29c000e4b0 comp rx=0 tx=0).stop 2024-09-12T02:43:08.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.635+0000 7f29c7e00640 1 -- 172.21.15.112:0/3593219464 shutdown_connections 2024-09-12T02:43:08.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.635+0000 7f29c7e00640 1 --2- 172.21.15.112:0/3593219464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29c815db60 0x7f29c80b39e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:08.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.635+0000 7f29c7e00640 1 --2- 172.21.15.112:0/3593219464 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29c815a450 0x7f29c81f8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:08.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.635+0000 7f29c7e00640 1 --2- 172.21.15.112:0/3593219464 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f29a406be30 0x7f29a406e2f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:08.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.635+0000 7f29c7e00640 1 --2- 172.21.15.112:0/3593219464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29c80ce460 0x7f29c815b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:08.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.635+0000 7f29c7e00640 1 -- 172.21.15.112:0/3593219464 >> 172.21.15.112:0/3593219464 conn(0x7f29c806bbd0 msgr2=0x7f29c806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:08.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.635+0000 7f29c7e00640 1 -- 172.21.15.112:0/3593219464 shutdown_connections 2024-09-12T02:43:08.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.635+0000 7f29c7e00640 1 -- 172.21.15.112:0/3593219464 wait complete. 2024-09-12T02:43:08.653 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2024-09-12T02:43:08.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.803+0000 7f2d16a00640 1 Processor -- start 2024-09-12T02:43:08.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.804+0000 7f2d16a00640 1 -- start start 2024-09-12T02:43:08.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.805+0000 7f2d16a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2d100ae8d0 0x7f2d100afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:08.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.805+0000 7f2d16a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2d1006dca0 0x7f2d1006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:08.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.805+0000 7f2d16a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d100aedd0 con 0x7f2d1006d8c0 2024-09-12T02:43:08.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.805+0000 7f2d16a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2d100af0b0 con 0x7f2d100ae8d0 2024-09-12T02:43:08.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.805+0000 7f2d16a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2d100af390 con 0x7f2d1006dca0 2024-09-12T02:43:08.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.805+0000 7f2d07400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2d100ae8d0 0x7f2d100afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:08.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.805+0000 7f2d07400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2d100ae8d0 0x7f2d100afe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35090/0 (socket says 172.21.15.112:35090) 2024-09-12T02:43:08.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.805+0000 7f2d07400640 1 -- 172.21.15.112:0/3277546177 learned_addr learned my addr 172.21.15.112:0/3277546177 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:08.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.805+0000 7f2d14a00640 1 --2- 172.21.15.112:0/3277546177 >> v2:172.21.15.137:3300/0 conn(0x7f2d1006dca0 0x7f2d1006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:08.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.806+0000 7f2d07400640 1 -- 172.21.15.112:0/3277546177 >> v2:172.21.15.137:3300/0 conn(0x7f2d1006dca0 msgr2=0x7f2d1006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:08.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.806+0000 7f2d07400640 1 --2- 172.21.15.112:0/3277546177 >> v2:172.21.15.137:3300/0 conn(0x7f2d1006dca0 0x7f2d1006e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:08.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.806+0000 7f2d07400640 1 -- 172.21.15.112:0/3277546177 >> v1:172.21.15.137:6789/0 conn(0x7f2d1006d8c0 legacy=0x7f2d100715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:08.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.806+0000 7f2d07400640 1 -- 172.21.15.112:0/3277546177 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d100af670 con 0x7f2d100ae8d0 2024-09-12T02:43:08.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.806+0000 7f2d14a00640 1 --2- 172.21.15.112:0/3277546177 >> v2:172.21.15.137:3300/0 conn(0x7f2d1006dca0 0x7f2d1006e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:43:08.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.807+0000 7f2d07400640 1 --2- 172.21.15.112:0/3277546177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d100ae8d0 0x7f2d100afe70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2d100d06c0 tx=0x7f2cf802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab60bfef8c31c6b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:08.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.807+0000 7f2d0f400640 1 -- 172.21.15.112:0/3277546177 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8004030 con 0x7f2d100ae8d0 2024-09-12T02:43:08.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.807+0000 7f2d0f400640 1 -- 172.21.15.112:0/3277546177 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cf80041d0 con 0x7f2d100ae8d0 2024-09-12T02:43:08.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.807+0000 7f2d0f400640 1 -- 172.21.15.112:0/3277546177 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8003610 con 0x7f2d100ae8d0 2024-09-12T02:43:08.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.807+0000 7f2d16a00640 1 -- 172.21.15.112:0/3277546177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d100ae8d0 msgr2=0x7f2d100afe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:08.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.807+0000 7f2d16a00640 1 --2- 172.21.15.112:0/3277546177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d100ae8d0 0x7f2d100afe70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2d100d06c0 tx=0x7f2cf802a250 comp rx=0 tx=0).stop 2024-09-12T02:43:08.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.807+0000 7f2d16a00640 1 -- 172.21.15.112:0/3277546177 shutdown_connections 2024-09-12T02:43:08.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.807+0000 7f2d16a00640 1 --2- 172.21.15.112:0/3277546177 >> v2:172.21.15.137:3300/0 conn(0x7f2d1006dca0 0x7f2d1006e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:08.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.807+0000 7f2d16a00640 1 --2- 172.21.15.112:0/3277546177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d100ae8d0 0x7f2d100afe70 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:08.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.807+0000 7f2d16a00640 1 -- 172.21.15.112:0/3277546177 >> 172.21.15.112:0/3277546177 conn(0x7f2d1006bbd0 msgr2=0x7f2d1006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:08.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.808+0000 7f2d16a00640 1 -- 172.21.15.112:0/3277546177 shutdown_connections 2024-09-12T02:43:08.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.808+0000 7f2d16a00640 1 -- 172.21.15.112:0/3277546177 wait complete. 2024-09-12T02:43:08.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.809+0000 7f2d16a00640 1 Processor -- start 2024-09-12T02:43:08.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.809+0000 7f2d16a00640 1 -- start start 2024-09-12T02:43:08.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.810+0000 7f2d16a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d1006d8c0 0x7f2d10155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:08.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.810+0000 7f2d16a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d1006dca0 0x7f2d10149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:08.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.810+0000 7f2d16a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d100ae8d0 0x7f2d1015a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:08.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.810+0000 7f2d16a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2d100b38e0 con 0x7f2d1006d8c0 2024-09-12T02:43:08.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.810+0000 7f2d16a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1006e690 con 0x7f2d100ae8d0 2024-09-12T02:43:08.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.810+0000 7f2d16a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2d100b3a60 con 0x7f2d1006dca0 2024-09-12T02:43:08.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.810+0000 7f2d0fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d1006d8c0 0x7f2d10155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:08.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.810+0000 7f2d0fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d1006d8c0 0x7f2d10155d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35104/0 (socket says 172.21.15.112:35104) 2024-09-12T02:43:08.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.810+0000 7f2d0fe00640 1 -- 172.21.15.112:0/1604394860 learned_addr learned my addr 172.21.15.112:0/1604394860 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:08.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.811+0000 7f2d14a00640 1 --2- 172.21.15.112:0/1604394860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d100ae8d0 0x7f2d1015a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:08.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.811+0000 7f2d07400640 1 --2- 172.21.15.112:0/1604394860 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d1006dca0 0x7f2d10149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:08.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.811+0000 7f2d0fe00640 1 -- 172.21.15.112:0/1604394860 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d1006dca0 msgr2=0x7f2d10149330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:08.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.811+0000 7f2d0fe00640 1 --2- 172.21.15.112:0/1604394860 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d1006dca0 0x7f2d10149330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:08.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.811+0000 7f2d0fe00640 1 -- 172.21.15.112:0/1604394860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d100ae8d0 msgr2=0x7f2d1015a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:08.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.811+0000 7f2d0fe00640 1 --2- 172.21.15.112:0/1604394860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d100ae8d0 0x7f2d1015a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:08.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.811+0000 7f2d0fe00640 1 -- 172.21.15.112:0/1604394860 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d100cd220 con 0x7f2d1006d8c0 2024-09-12T02:43:08.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.811+0000 7f2d07400640 1 --2- 172.21.15.112:0/1604394860 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d1006dca0 0x7f2d10149330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:43:08.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.811+0000 7f2d0fe00640 1 --2- 172.21.15.112:0/1604394860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d1006d8c0 0x7f2d10155d60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000c400 tx=0x7f2d0000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:08.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.811+0000 7f2d0cc00640 1 -- 172.21.15.112:0/1604394860 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d000052d0 con 0x7f2d1006d8c0 2024-09-12T02:43:08.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.811+0000 7f2d0cc00640 1 -- 172.21.15.112:0/1604394860 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d00005490 con 0x7f2d1006d8c0 2024-09-12T02:43:08.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.811+0000 7f2d16a00640 1 -- 172.21.15.112:0/1604394860 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d100cd500 con 0x7f2d1006d8c0 2024-09-12T02:43:08.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.811+0000 7f2d0cc00640 1 -- 172.21.15.112:0/1604394860 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d00007260 con 0x7f2d1006d8c0 2024-09-12T02:43:08.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.812+0000 7f2d16a00640 1 -- 172.21.15.112:0/1604394860 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d100cdac0 con 0x7f2d1006d8c0 2024-09-12T02:43:08.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.812+0000 7f2d16a00640 1 -- 172.21.15.112:0/1604394860 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d1006e150 con 0x7f2d1006d8c0 2024-09-12T02:43:08.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.813+0000 7f2d0cc00640 1 -- 172.21.15.112:0/1604394860 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2d00007400 con 0x7f2d1006d8c0 2024-09-12T02:43:08.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.814+0000 7f2d0cc00640 1 --2- 172.21.15.112:0/1604394860 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2cec06be30 0x7f2cec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:08.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.814+0000 7f2d0cc00640 1 -- 172.21.15.112:0/1604394860 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f2d0008a140 con 0x7f2d1006d8c0 2024-09-12T02:43:08.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.814+0000 7f2d07400640 1 --2- 172.21.15.112:0/1604394860 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2cec06be30 0x7f2cec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:08.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.815+0000 7f2d07400640 1 --2- 172.21.15.112:0/1604394860 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2cec06be30 0x7f2cec06e2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8033000 tx=0x7f2cf802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:08.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:08.821+0000 7f2d0cc00640 1 -- 172.21.15.112:0/1604394860 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2d00058d50 con 0x7f2d1006d8c0 2024-09-12T02:43:09.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.056+0000 7f2d16a00640 1 -- 172.21.15.112:0/1604394860 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) -- 0x7f2d100b5a60 con 0x7f2d1006d8c0 2024-09-12T02:43:09.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.260+0000 7f2d0cc00640 1 -- 172.21.15.112:0/1604394860 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v85) ==== 130+0+0 (secure 0 0 0) 0x7f2d00058650 con 0x7f2d1006d8c0 2024-09-12T02:43:09.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.262+0000 7f2d16a00640 1 -- 172.21.15.112:0/1604394860 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2cec06be30 msgr2=0x7f2cec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:09.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.262+0000 7f2d16a00640 1 --2- 172.21.15.112:0/1604394860 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2cec06be30 0x7f2cec06e2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8033000 tx=0x7f2cf802e000 comp rx=0 tx=0).stop 2024-09-12T02:43:09.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.262+0000 7f2d16a00640 1 -- 172.21.15.112:0/1604394860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d1006d8c0 msgr2=0x7f2d10155d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:09.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.262+0000 7f2d16a00640 1 --2- 172.21.15.112:0/1604394860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d1006d8c0 0x7f2d10155d60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000c400 tx=0x7f2d0000c8c0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.262+0000 7f2d16a00640 1 -- 172.21.15.112:0/1604394860 shutdown_connections 2024-09-12T02:43:09.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.262+0000 7f2d16a00640 1 --2- 172.21.15.112:0/1604394860 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2cec06be30 0x7f2cec06e2f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.262+0000 7f2d16a00640 1 --2- 172.21.15.112:0/1604394860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d100ae8d0 0x7f2d1015a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.262+0000 7f2d16a00640 1 --2- 172.21.15.112:0/1604394860 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d1006dca0 0x7f2d10149330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.262+0000 7f2d16a00640 1 --2- 172.21.15.112:0/1604394860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d1006d8c0 0x7f2d10155d60 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.262+0000 7f2d16a00640 1 -- 172.21.15.112:0/1604394860 >> 172.21.15.112:0/1604394860 conn(0x7f2d1006bbd0 msgr2=0x7f2d100729a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:09.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.263+0000 7f2d16a00640 1 -- 172.21.15.112:0/1604394860 shutdown_connections 2024-09-12T02:43:09.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.263+0000 7f2d16a00640 1 -- 172.21.15.112:0/1604394860 wait complete. 2024-09-12T02:43:09.279 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2024-09-12T02:43:09.279 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestClusterFull) 2024-09-12T02:43:09.280 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:43:09.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.431+0000 7fe745c00640 1 Processor -- start 2024-09-12T02:43:09.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.431+0000 7fe745c00640 1 -- start start 2024-09-12T02:43:09.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.433+0000 7fe745c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe74015b9d0 0x7fe7400b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.433+0000 7fe745c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe74006f600 0x7fe7400728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.433+0000 7fe745c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7400b54a0 con 0x7fe7400b45d0 2024-09-12T02:43:09.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.433+0000 7fe745c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe7400b4a30 con 0x7fe74006f600 2024-09-12T02:43:09.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.433+0000 7fe745c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe7400b3af0 con 0x7fe74015b9d0 2024-09-12T02:43:09.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.433+0000 7fe73e000640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe7400b45d0 0x7fe74006eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47082/0 (socket says 172.21.15.112:47082) 2024-09-12T02:43:09.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.433+0000 7fe73e000640 1 -- 172.21.15.112:0/2612872146 learned_addr learned my addr 172.21.15.112:0/2612872146 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:09.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.433+0000 7fe73ea00640 1 --2- 172.21.15.112:0/2612872146 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe74015b9d0 0x7fe7400b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.433+0000 7fe73f400640 1 --2- 172.21.15.112:0/2612872146 >> v2:172.21.15.137:3300/0 conn(0x7fe74006f600 0x7fe7400728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.434+0000 7fe73d600640 1 -- 172.21.15.112:0/2612872146 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2168491541 0 0) 0x7fe7400b54a0 con 0x7fe7400b45d0 2024-09-12T02:43:09.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.434+0000 7fe73d600640 1 -- 172.21.15.112:0/2612872146 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe724003520 con 0x7fe7400b45d0 2024-09-12T02:43:09.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.434+0000 7fe73f400640 1 -- 172.21.15.112:0/2612872146 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe74015b9d0 msgr2=0x7fe7400b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:09.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.434+0000 7fe73f400640 1 --2- 172.21.15.112:0/2612872146 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe74015b9d0 0x7fe7400b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.434+0000 7fe73f400640 1 -- 172.21.15.112:0/2612872146 >> v1:172.21.15.112:6789/0 conn(0x7fe7400b45d0 legacy=0x7fe74006eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:09.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.434+0000 7fe73d600640 1 -- 172.21.15.112:0/2612872146 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2189990902 0 0) 0x7fe724003520 con 0x7fe7400b45d0 2024-09-12T02:43:09.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.434+0000 7fe73f400640 1 -- 172.21.15.112:0/2612872146 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7400b3dd0 con 0x7fe74006f600 2024-09-12T02:43:09.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.434+0000 7fe73ea00640 1 --2- 172.21.15.112:0/2612872146 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe74015b9d0 0x7fe7400b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:43:09.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.435+0000 7fe73f400640 1 --2- 172.21.15.112:0/2612872146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe74006f600 0x7fe7400728c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe738009d90 tx=0x7fe73802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c68ce8b1ffd1b59b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:09.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.435+0000 7fe73d600640 1 -- 172.21.15.112:0/2612872146 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72c0017f0 con 0x7fe74006f600 2024-09-12T02:43:09.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.435+0000 7fe73d600640 1 -- 172.21.15.112:0/2612872146 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe738007540 con 0x7fe74006f600 2024-09-12T02:43:09.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.435+0000 7fe73d600640 1 -- 172.21.15.112:0/2612872146 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7380078f0 con 0x7fe74006f600 2024-09-12T02:43:09.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.436+0000 7fe745c00640 1 -- 172.21.15.112:0/2612872146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe74006f600 msgr2=0x7fe7400728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:09.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.436+0000 7fe745c00640 1 --2- 172.21.15.112:0/2612872146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe74006f600 0x7fe7400728c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe738009d90 tx=0x7fe73802a5f0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.436+0000 7fe745c00640 1 -- 172.21.15.112:0/2612872146 shutdown_connections 2024-09-12T02:43:09.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.436+0000 7fe745c00640 1 --2- 172.21.15.112:0/2612872146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe74006f600 0x7fe7400728c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.436+0000 7fe745c00640 1 --2- 172.21.15.112:0/2612872146 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe74015b9d0 0x7fe7400b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.436+0000 7fe745c00640 1 -- 172.21.15.112:0/2612872146 >> 172.21.15.112:0/2612872146 conn(0x7fe74006bbd0 msgr2=0x7fe74006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:09.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.436+0000 7fe745c00640 1 -- 172.21.15.112:0/2612872146 shutdown_connections 2024-09-12T02:43:09.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.436+0000 7fe745c00640 1 -- 172.21.15.112:0/2612872146 wait complete. 2024-09-12T02:43:09.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.438+0000 7fe745c00640 1 Processor -- start 2024-09-12T02:43:09.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.438+0000 7fe745c00640 1 -- start start 2024-09-12T02:43:09.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.439+0000 7fe745c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe74006f600 0x7fe740156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.439+0000 7fe745c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7400b45d0 0x7fe74015ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.439+0000 7fe745c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe74015b9d0 0x7fe74015e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.439+0000 7fe745c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe74015bf30 con 0x7fe74006f600 2024-09-12T02:43:09.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.439+0000 7fe745c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe74015bdb0 con 0x7fe74015b9d0 2024-09-12T02:43:09.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.439+0000 7fe745c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe7400cdcd0 con 0x7fe7400b45d0 2024-09-12T02:43:09.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.439+0000 7fe73ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe74006f600 0x7fe740156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.439+0000 7fe73ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe74006f600 0x7fe740156650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35108/0 (socket says 172.21.15.112:35108) 2024-09-12T02:43:09.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.439+0000 7fe73ea00640 1 -- 172.21.15.112:0/1000602694 learned_addr learned my addr 172.21.15.112:0/1000602694 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:09.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.439+0000 7fe73f400640 1 --2- 172.21.15.112:0/1000602694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe74015b9d0 0x7fe74015e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.439+0000 7fe73e000640 1 --2- 172.21.15.112:0/1000602694 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7400b45d0 0x7fe74015ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.439+0000 7fe73ea00640 1 -- 172.21.15.112:0/1000602694 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7400b45d0 msgr2=0x7fe74015ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:09.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.439+0000 7fe73ea00640 1 --2- 172.21.15.112:0/1000602694 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7400b45d0 0x7fe74015ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.439+0000 7fe73ea00640 1 -- 172.21.15.112:0/1000602694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe74015b9d0 msgr2=0x7fe74015e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:09.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.439+0000 7fe73ea00640 1 --2- 172.21.15.112:0/1000602694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe74015b9d0 0x7fe74015e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.439+0000 7fe73ea00640 1 -- 172.21.15.112:0/1000602694 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe74015a080 con 0x7fe74006f600 2024-09-12T02:43:09.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.440+0000 7fe73ea00640 1 --2- 172.21.15.112:0/1000602694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe74006f600 0x7fe740156650 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe73000e990 tx=0x7fe73000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:09.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.440+0000 7fe736a00640 1 -- 172.21.15.112:0/1000602694 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe730017070 con 0x7fe74006f600 2024-09-12T02:43:09.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.440+0000 7fe736a00640 1 -- 172.21.15.112:0/1000602694 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe73000c9e0 con 0x7fe74006f600 2024-09-12T02:43:09.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.440+0000 7fe736a00640 1 -- 172.21.15.112:0/1000602694 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73000cdb0 con 0x7fe74006f600 2024-09-12T02:43:09.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.440+0000 7fe745c00640 1 -- 172.21.15.112:0/1000602694 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe740156c30 con 0x7fe74006f600 2024-09-12T02:43:09.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.440+0000 7fe745c00640 1 -- 172.21.15.112:0/1000602694 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7401574d0 con 0x7fe74006f600 2024-09-12T02:43:09.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.441+0000 7fe745c00640 1 -- 172.21.15.112:0/1000602694 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe740068a30 con 0x7fe74006f600 2024-09-12T02:43:09.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.442+0000 7fe736a00640 1 -- 172.21.15.112:0/1000602694 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe73001a070 con 0x7fe74006f600 2024-09-12T02:43:09.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.443+0000 7fe736a00640 1 --2- 172.21.15.112:0/1000602694 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe72006be30 0x7fe72006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.443+0000 7fe736a00640 1 -- 172.21.15.112:0/1000602694 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fe73008aa60 con 0x7fe74006f600 2024-09-12T02:43:09.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.443+0000 7fe73e000640 1 --2- 172.21.15.112:0/1000602694 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe72006be30 0x7fe72006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.444+0000 7fe73e000640 1 --2- 172.21.15.112:0/1000602694 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe72006be30 0x7fe72006e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe740155050 tx=0x7fe72c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:09.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.447+0000 7fe736a00640 1 -- 172.21.15.112:0/1000602694 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe730059710 con 0x7fe74006f600 2024-09-12T02:43:09.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.621+0000 7fe745c00640 1 -- 172.21.15.112:0/1000602694 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe7400b0b10 con 0x7fe74006f600 2024-09-12T02:43:09.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.622+0000 7fe736a00640 1 -- 172.21.15.112:0/1000602694 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+13080 (secure 0 0 0) 0x7fe730059010 con 0x7fe74006f600 2024-09-12T02:43:09.623 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:09.623 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":37,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:43:08.257390+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6837/917811402":"2024-09-13T02:43:05.243595+0000","172.21.15.112:6835/917811402":"2024-09-13T02:43:05.243595+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:43:09.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.624+0000 7fe745c00640 1 -- 172.21.15.112:0/1000602694 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe72006be30 msgr2=0x7fe72006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:09.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.624+0000 7fe745c00640 1 --2- 172.21.15.112:0/1000602694 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe72006be30 0x7fe72006e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe740155050 tx=0x7fe72c009040 comp rx=0 tx=0).stop 2024-09-12T02:43:09.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.624+0000 7fe745c00640 1 -- 172.21.15.112:0/1000602694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe74006f600 msgr2=0x7fe740156650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:09.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.624+0000 7fe745c00640 1 --2- 172.21.15.112:0/1000602694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe74006f600 0x7fe740156650 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe73000e990 tx=0x7fe73000ee50 comp rx=0 tx=0).stop 2024-09-12T02:43:09.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.624+0000 7fe745c00640 1 -- 172.21.15.112:0/1000602694 shutdown_connections 2024-09-12T02:43:09.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.624+0000 7fe745c00640 1 --2- 172.21.15.112:0/1000602694 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe72006be30 0x7fe72006e2f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.624+0000 7fe745c00640 1 --2- 172.21.15.112:0/1000602694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe74015b9d0 0x7fe74015e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.624+0000 7fe745c00640 1 --2- 172.21.15.112:0/1000602694 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7400b45d0 0x7fe74015ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.624+0000 7fe745c00640 1 --2- 172.21.15.112:0/1000602694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe74006f600 0x7fe740156650 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.624+0000 7fe745c00640 1 -- 172.21.15.112:0/1000602694 >> 172.21.15.112:0/1000602694 conn(0x7fe74006bbd0 msgr2=0x7fe7401550f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:09.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.624+0000 7fe745c00640 1 -- 172.21.15.112:0/1000602694 shutdown_connections 2024-09-12T02:43:09.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.624+0000 7fe745c00640 1 -- 172.21.15.112:0/1000602694 wait complete. 2024-09-12T02:43:09.642 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:41:43.011599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:43:09.642 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T02:43:09.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.796+0000 7f778ca00640 1 Processor -- start 2024-09-12T02:43:09.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.797+0000 7f778ca00640 1 -- start start 2024-09-12T02:43:09.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.798+0000 7f778ca00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f778815b9d0 0x7f77880b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.798+0000 7f778ca00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f77880b45d0 0x7f77880728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.798+0000 7f778ca00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f778806eef0 0x7f778806f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.798+0000 7f778ca00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f77880b4a60 con 0x7f778815b9d0 2024-09-12T02:43:09.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.798+0000 7f778ca00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f778806f860 con 0x7f778806eef0 2024-09-12T02:43:09.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.798+0000 7f778ca00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f77880b54a0 con 0x7f77880b45d0 2024-09-12T02:43:09.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.798+0000 7f7785e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f778815b9d0 0x7f77880b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.798+0000 7f7785e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f778815b9d0 0x7f77880b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35110/0 (socket says 172.21.15.112:35110) 2024-09-12T02:43:09.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.798+0000 7f7785e00640 1 -- 172.21.15.112:0/2640115092 learned_addr learned my addr 172.21.15.112:0/2640115092 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:09.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.798+0000 7f7786800640 1 --2- 172.21.15.112:0/2640115092 >> v2:172.21.15.137:3300/0 conn(0x7f778806eef0 0x7f778806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.798+0000 7f7785400640 1 --2- 172.21.15.112:0/2640115092 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f77880b45d0 0x7f77880728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.798+0000 7f7785e00640 1 -- 172.21.15.112:0/2640115092 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f77880b45d0 msgr2=0x7f77880728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:09.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.798+0000 7f7785e00640 1 --2- 172.21.15.112:0/2640115092 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f77880b45d0 0x7f77880728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.798+0000 7f7785e00640 1 -- 172.21.15.112:0/2640115092 >> v2:172.21.15.137:3300/0 conn(0x7f778806eef0 msgr2=0x7f778806f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:09.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.798+0000 7f7785e00640 1 --2- 172.21.15.112:0/2640115092 >> v2:172.21.15.137:3300/0 conn(0x7f778806eef0 0x7f778806f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.799+0000 7f7785e00640 1 -- 172.21.15.112:0/2640115092 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77880b3af0 con 0x7f778815b9d0 2024-09-12T02:43:09.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.799+0000 7f7785e00640 1 --2- 172.21.15.112:0/2640115092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f778815b9d0 0x7f77880b4ec0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f77880b3680 tx=0x7f777802c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31820c5d5bec219c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:09.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.800+0000 7f7784a00640 1 -- 172.21.15.112:0/2640115092 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7778038070 con 0x7f778815b9d0 2024-09-12T02:43:09.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.800+0000 7f7784a00640 1 -- 172.21.15.112:0/2640115092 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7778031710 con 0x7f778815b9d0 2024-09-12T02:43:09.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.800+0000 7f7784a00640 1 -- 172.21.15.112:0/2640115092 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7778031ae0 con 0x7f778815b9d0 2024-09-12T02:43:09.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.800+0000 7f778ca00640 1 -- 172.21.15.112:0/2640115092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f778815b9d0 msgr2=0x7f77880b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:09.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.800+0000 7f778ca00640 1 --2- 172.21.15.112:0/2640115092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f778815b9d0 0x7f77880b4ec0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f77880b3680 tx=0x7f777802c420 comp rx=0 tx=0).stop 2024-09-12T02:43:09.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.800+0000 7f778ca00640 1 -- 172.21.15.112:0/2640115092 shutdown_connections 2024-09-12T02:43:09.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.800+0000 7f778ca00640 1 --2- 172.21.15.112:0/2640115092 >> v2:172.21.15.137:3300/0 conn(0x7f778806eef0 0x7f778806f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.800+0000 7f778ca00640 1 --2- 172.21.15.112:0/2640115092 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f77880b45d0 0x7f77880728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.800+0000 7f778ca00640 1 --2- 172.21.15.112:0/2640115092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f778815b9d0 0x7f77880b4ec0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.800+0000 7f778ca00640 1 -- 172.21.15.112:0/2640115092 >> 172.21.15.112:0/2640115092 conn(0x7f778806bbd0 msgr2=0x7f778806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:09.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.800+0000 7f778ca00640 1 -- 172.21.15.112:0/2640115092 shutdown_connections 2024-09-12T02:43:09.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.800+0000 7f778ca00640 1 -- 172.21.15.112:0/2640115092 wait complete. 2024-09-12T02:43:09.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.802+0000 7f778ca00640 1 Processor -- start 2024-09-12T02:43:09.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.802+0000 7f778ca00640 1 -- start start 2024-09-12T02:43:09.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.803+0000 7f778ca00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f778806eef0 0x7f77881f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.803+0000 7f778ca00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77880b45d0 0x7f778815f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.803+0000 7f778ca00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f778815b9d0 0x7f77881485f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.803+0000 7f778ca00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f778815bdb0 con 0x7f778815b9d0 2024-09-12T02:43:09.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.803+0000 7f778ca00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f77880b40b0 con 0x7f77880b45d0 2024-09-12T02:43:09.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.803+0000 7f778ca00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f778815bf30 con 0x7f778806eef0 2024-09-12T02:43:09.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.803+0000 7f7786800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f778815b9d0 0x7f77881485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.803+0000 7f7785e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f778806eef0 0x7f77881f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.803+0000 7f7786800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f778815b9d0 0x7f77881485f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35114/0 (socket says 172.21.15.112:35114) 2024-09-12T02:43:09.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.804+0000 7f7786800640 1 -- 172.21.15.112:0/3126336391 learned_addr learned my addr 172.21.15.112:0/3126336391 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:09.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.804+0000 7f7785400640 1 --2- 172.21.15.112:0/3126336391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77880b45d0 0x7f778815f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.804+0000 7f7786800640 1 -- 172.21.15.112:0/3126336391 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f778806eef0 msgr2=0x7f77881f4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:09.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.804+0000 7f7786800640 1 --2- 172.21.15.112:0/3126336391 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f778806eef0 0x7f77881f4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.804+0000 7f7786800640 1 -- 172.21.15.112:0/3126336391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77880b45d0 msgr2=0x7f778815f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:09.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.804+0000 7f7786800640 1 --2- 172.21.15.112:0/3126336391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77880b45d0 0x7f778815f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.804+0000 7f7786800640 1 -- 172.21.15.112:0/3126336391 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77881f8a20 con 0x7f778815b9d0 2024-09-12T02:43:09.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.804+0000 7f7786800640 1 --2- 172.21.15.112:0/3126336391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f778815b9d0 0x7f77881485f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7780007e70 tx=0x7f778000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:09.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.804+0000 7f777e000640 1 -- 172.21.15.112:0/3126336391 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7780014620 con 0x7f778815b9d0 2024-09-12T02:43:09.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.804+0000 7f777e000640 1 -- 172.21.15.112:0/3126336391 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7780019070 con 0x7f778815b9d0 2024-09-12T02:43:09.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.804+0000 7f777e000640 1 -- 172.21.15.112:0/3126336391 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7780014a20 con 0x7f778815b9d0 2024-09-12T02:43:09.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.804+0000 7f778ca00640 1 -- 172.21.15.112:0/3126336391 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77881f8d00 con 0x7f778815b9d0 2024-09-12T02:43:09.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.805+0000 7f778ca00640 1 -- 172.21.15.112:0/3126336391 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f778814f9e0 con 0x7f778815b9d0 2024-09-12T02:43:09.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.806+0000 7f778ca00640 1 -- 172.21.15.112:0/3126336391 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7788068a30 con 0x7f778815b9d0 2024-09-12T02:43:09.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.806+0000 7f777e000640 1 -- 172.21.15.112:0/3126336391 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7780014bc0 con 0x7f778815b9d0 2024-09-12T02:43:09.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.807+0000 7f777e000640 1 --2- 172.21.15.112:0/3126336391 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f776806be60 0x7f776806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:09.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.807+0000 7f777e000640 1 -- 172.21.15.112:0/3126336391 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f778008b2d0 con 0x7f778815b9d0 2024-09-12T02:43:09.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.807+0000 7f7785e00640 1 --2- 172.21.15.112:0/3126336391 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f776806be60 0x7f776806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:09.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.808+0000 7f7785e00640 1 --2- 172.21.15.112:0/3126336391 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f776806be60 0x7f776806e320 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7778035000 tx=0x7f7778008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:09.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.811+0000 7f777e000640 1 -- 172.21.15.112:0/3126336391 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7780059920 con 0x7f778815b9d0 2024-09-12T02:43:09.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.983+0000 7f778ca00640 1 -- 172.21.15.112:0/3126336391 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f778806f320 con 0x7f778815b9d0 2024-09-12T02:43:09.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.983+0000 7f777e000640 1 -- 172.21.15.112:0/3126336391 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) ==== 93+0+10 (secure 0 0 0) 0x7f778005dc20 con 0x7f778815b9d0 2024-09-12T02:43:09.985 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2024-09-12T02:43:09.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.985+0000 7f778ca00640 1 -- 172.21.15.112:0/3126336391 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f776806be60 msgr2=0x7f776806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:09.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.985+0000 7f778ca00640 1 --2- 172.21.15.112:0/3126336391 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f776806be60 0x7f776806e320 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7778035000 tx=0x7f7778008030 comp rx=0 tx=0).stop 2024-09-12T02:43:09.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.985+0000 7f778ca00640 1 -- 172.21.15.112:0/3126336391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f778815b9d0 msgr2=0x7f77881485f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:09.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.985+0000 7f778ca00640 1 --2- 172.21.15.112:0/3126336391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f778815b9d0 0x7f77881485f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7780007e70 tx=0x7f778000e4b0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.986+0000 7f778ca00640 1 -- 172.21.15.112:0/3126336391 shutdown_connections 2024-09-12T02:43:09.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.986+0000 7f778ca00640 1 --2- 172.21.15.112:0/3126336391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f778815b9d0 0x7f77881485f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.986+0000 7f778ca00640 1 --2- 172.21.15.112:0/3126336391 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f776806be60 0x7f776806e320 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.986+0000 7f778ca00640 1 --2- 172.21.15.112:0/3126336391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77880b45d0 0x7f778815f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.986+0000 7f778ca00640 1 --2- 172.21.15.112:0/3126336391 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f778806eef0 0x7f77881f4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:09.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.986+0000 7f778ca00640 1 -- 172.21.15.112:0/3126336391 >> 172.21.15.112:0/3126336391 conn(0x7f778806bbd0 msgr2=0x7f77880b1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:09.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.986+0000 7f778ca00640 1 -- 172.21.15.112:0/3126336391 shutdown_connections 2024-09-12T02:43:09.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:09.986+0000 7f778ca00640 1 -- 172.21.15.112:0/3126336391 wait complete. 2024-09-12T02:43:10.004 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2024-09-12T02:43:10.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.156+0000 7fc10f000640 1 Processor -- start 2024-09-12T02:43:10.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.156+0000 7fc10f000640 1 -- start start 2024-09-12T02:43:10.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.157+0000 7fc10f000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc10815b9d0 0x7fc1080b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:10.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.157+0000 7fc10f000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1080b45d0 0x7fc1080728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:10.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.157+0000 7fc10f000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc10806eef0 0x7fc10806f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:10.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.157+0000 7fc10f000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc1080b4a60 con 0x7fc10815b9d0 2024-09-12T02:43:10.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.157+0000 7fc10f000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc10806f860 con 0x7fc10806eef0 2024-09-12T02:43:10.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.157+0000 7fc10f000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc1080b54a0 con 0x7fc1080b45d0 2024-09-12T02:43:10.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.157+0000 7fc107e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc10815b9d0 0x7fc1080b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:10.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.157+0000 7fc107e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc10815b9d0 0x7fc1080b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35126/0 (socket says 172.21.15.112:35126) 2024-09-12T02:43:10.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.157+0000 7fc107e00640 1 -- 172.21.15.112:0/1426292970 learned_addr learned my addr 172.21.15.112:0/1426292970 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:10.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.157+0000 7fc10d000640 1 --2- 172.21.15.112:0/1426292970 >> v2:172.21.15.137:3300/0 conn(0x7fc10806eef0 0x7fc10806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:10.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.158+0000 7fc0ff400640 1 --2- 172.21.15.112:0/1426292970 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1080b45d0 0x7fc1080728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:10.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.158+0000 7fc107e00640 1 -- 172.21.15.112:0/1426292970 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1080b45d0 msgr2=0x7fc1080728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:10.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.158+0000 7fc107e00640 1 --2- 172.21.15.112:0/1426292970 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1080b45d0 0x7fc1080728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:10.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.158+0000 7fc107e00640 1 -- 172.21.15.112:0/1426292970 >> v2:172.21.15.137:3300/0 conn(0x7fc10806eef0 msgr2=0x7fc10806f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:10.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.158+0000 7fc107e00640 1 --2- 172.21.15.112:0/1426292970 >> v2:172.21.15.137:3300/0 conn(0x7fc10806eef0 0x7fc10806f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:10.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.158+0000 7fc107e00640 1 -- 172.21.15.112:0/1426292970 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1080b3af0 con 0x7fc10815b9d0 2024-09-12T02:43:10.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.159+0000 7fc107e00640 1 --2- 172.21.15.112:0/1426292970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc10815b9d0 0x7fc1080b4ec0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc1080b3680 tx=0x7fc0f802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b07bfd2878f6eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:10.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.159+0000 7fc107400640 1 -- 172.21.15.112:0/1426292970 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8037070 con 0x7fc10815b9d0 2024-09-12T02:43:10.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.159+0000 7fc107400640 1 -- 172.21.15.112:0/1426292970 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f8032440 con 0x7fc10815b9d0 2024-09-12T02:43:10.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.159+0000 7fc107400640 1 -- 172.21.15.112:0/1426292970 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8032810 con 0x7fc10815b9d0 2024-09-12T02:43:10.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.160+0000 7fc10f000640 1 -- 172.21.15.112:0/1426292970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc10815b9d0 msgr2=0x7fc1080b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:10.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.160+0000 7fc10f000640 1 --2- 172.21.15.112:0/1426292970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc10815b9d0 0x7fc1080b4ec0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc1080b3680 tx=0x7fc0f802a210 comp rx=0 tx=0).stop 2024-09-12T02:43:10.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.160+0000 7fc10f000640 1 -- 172.21.15.112:0/1426292970 shutdown_connections 2024-09-12T02:43:10.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.160+0000 7fc10f000640 1 --2- 172.21.15.112:0/1426292970 >> v2:172.21.15.137:3300/0 conn(0x7fc10806eef0 0x7fc10806f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:10.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.160+0000 7fc10f000640 1 --2- 172.21.15.112:0/1426292970 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1080b45d0 0x7fc1080728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:10.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.160+0000 7fc10f000640 1 --2- 172.21.15.112:0/1426292970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc10815b9d0 0x7fc1080b4ec0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:10.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.160+0000 7fc10f000640 1 -- 172.21.15.112:0/1426292970 >> 172.21.15.112:0/1426292970 conn(0x7fc10806bbd0 msgr2=0x7fc10806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:10.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.160+0000 7fc10f000640 1 -- 172.21.15.112:0/1426292970 shutdown_connections 2024-09-12T02:43:10.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.160+0000 7fc10f000640 1 -- 172.21.15.112:0/1426292970 wait complete. 2024-09-12T02:43:10.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.161+0000 7fc10f000640 1 Processor -- start 2024-09-12T02:43:10.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.162+0000 7fc10f000640 1 -- start start 2024-09-12T02:43:10.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.163+0000 7fc10f000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc10806eef0 0x7fc10814f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:10.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.163+0000 7fc10f000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1080b45d0 0x7fc108152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:10.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.163+0000 7fc10f000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc10815b9d0 0x7fc108154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:10.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.163+0000 7fc10f000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc10815bdb0 con 0x7fc10815b9d0 2024-09-12T02:43:10.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.163+0000 7fc10f000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc1080b40b0 con 0x7fc10806eef0 2024-09-12T02:43:10.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.163+0000 7fc10f000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc10815bf30 con 0x7fc1080b45d0 2024-09-12T02:43:10.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.163+0000 7fc10d000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc10815b9d0 0x7fc108154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:10.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.163+0000 7fc10d000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc10815b9d0 0x7fc108154320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35134/0 (socket says 172.21.15.112:35134) 2024-09-12T02:43:10.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.163+0000 7fc10d000640 1 -- 172.21.15.112:0/780254371 learned_addr learned my addr 172.21.15.112:0/780254371 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:10.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.163+0000 7fc0ff400640 1 --2- 172.21.15.112:0/780254371 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1080b45d0 0x7fc108152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:10.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.163+0000 7fc107e00640 1 --2- 172.21.15.112:0/780254371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc10806eef0 0x7fc10814f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:10.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.163+0000 7fc10d000640 1 -- 172.21.15.112:0/780254371 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1080b45d0 msgr2=0x7fc108152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:10.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.163+0000 7fc10d000640 1 --2- 172.21.15.112:0/780254371 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1080b45d0 0x7fc108152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:10.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.163+0000 7fc10d000640 1 -- 172.21.15.112:0/780254371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc10806eef0 msgr2=0x7fc10814f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:10.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.163+0000 7fc10d000640 1 --2- 172.21.15.112:0/780254371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc10806eef0 0x7fc10814f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:10.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.163+0000 7fc10d000640 1 -- 172.21.15.112:0/780254371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1080cee90 con 0x7fc10815b9d0 2024-09-12T02:43:10.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.164+0000 7fc10d000640 1 --2- 172.21.15.112:0/780254371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc10815b9d0 0x7fc108154320 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc10000efc0 tx=0x7fc10000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:10.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.164+0000 7fc104c00640 1 -- 172.21.15.112:0/780254371 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc100018020 con 0x7fc10815b9d0 2024-09-12T02:43:10.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.164+0000 7fc104c00640 1 -- 172.21.15.112:0/780254371 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc100014480 con 0x7fc10815b9d0 2024-09-12T02:43:10.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.164+0000 7fc10f000640 1 -- 172.21.15.112:0/780254371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1080cf170 con 0x7fc10815b9d0 2024-09-12T02:43:10.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.164+0000 7fc104c00640 1 -- 172.21.15.112:0/780254371 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc100014870 con 0x7fc10815b9d0 2024-09-12T02:43:10.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.164+0000 7fc10f000640 1 -- 172.21.15.112:0/780254371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1080717b0 con 0x7fc10815b9d0 2024-09-12T02:43:10.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.165+0000 7fc10f000640 1 -- 172.21.15.112:0/780254371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc108068a30 con 0x7fc10815b9d0 2024-09-12T02:43:10.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.166+0000 7fc104c00640 1 -- 172.21.15.112:0/780254371 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc100005d10 con 0x7fc10815b9d0 2024-09-12T02:43:10.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.167+0000 7fc104c00640 1 --2- 172.21.15.112:0/780254371 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc0e406be30 0x7fc0e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:10.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.167+0000 7fc104c00640 1 -- 172.21.15.112:0/780254371 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fc10008b590 con 0x7fc10815b9d0 2024-09-12T02:43:10.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.167+0000 7fc107e00640 1 --2- 172.21.15.112:0/780254371 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc0e406be30 0x7fc0e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:10.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.168+0000 7fc107e00640 1 --2- 172.21.15.112:0/780254371 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc0e406be30 0x7fc0e406e2f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8034000 tx=0x7fc0f802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:10.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.171+0000 7fc104c00640 1 -- 172.21.15.112:0/780254371 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc100022070 con 0x7fc10815b9d0 2024-09-12T02:43:10.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:10.412+0000 7fc10f000640 1 -- 172.21.15.112:0/780254371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) -- 0x7fc108164d70 con 0x7fc10815b9d0 2024-09-12T02:43:11.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.272+0000 7fc104c00640 1 -- 172.21.15.112:0/780254371 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v87) ==== 145+0+0 (secure 0 0 0) 0x7fc100010040 con 0x7fc10815b9d0 2024-09-12T02:43:11.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.275+0000 7fc10f000640 1 -- 172.21.15.112:0/780254371 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc0e406be30 msgr2=0x7fc0e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:11.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.275+0000 7fc10f000640 1 --2- 172.21.15.112:0/780254371 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc0e406be30 0x7fc0e406e2f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8034000 tx=0x7fc0f802e000 comp rx=0 tx=0).stop 2024-09-12T02:43:11.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.275+0000 7fc10f000640 1 -- 172.21.15.112:0/780254371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc10815b9d0 msgr2=0x7fc108154320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:11.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.275+0000 7fc10f000640 1 --2- 172.21.15.112:0/780254371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc10815b9d0 0x7fc108154320 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc10000efc0 tx=0x7fc10000c490 comp rx=0 tx=0).stop 2024-09-12T02:43:11.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.275+0000 7fc10f000640 1 -- 172.21.15.112:0/780254371 shutdown_connections 2024-09-12T02:43:11.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.275+0000 7fc10f000640 1 --2- 172.21.15.112:0/780254371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc10815b9d0 0x7fc108154320 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:11.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.275+0000 7fc10f000640 1 --2- 172.21.15.112:0/780254371 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1080b45d0 0x7fc108152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:11.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.275+0000 7fc10f000640 1 --2- 172.21.15.112:0/780254371 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc0e406be30 0x7fc0e406e2f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:11.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.275+0000 7fc10f000640 1 --2- 172.21.15.112:0/780254371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc10806eef0 0x7fc10814f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:11.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.275+0000 7fc10f000640 1 -- 172.21.15.112:0/780254371 >> 172.21.15.112:0/780254371 conn(0x7fc10806bbd0 msgr2=0x7fc108155890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:11.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.275+0000 7fc10f000640 1 -- 172.21.15.112:0/780254371 shutdown_connections 2024-09-12T02:43:11.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.275+0000 7fc10f000640 1 -- 172.21.15.112:0/780254371 wait complete. 2024-09-12T02:43:11.295 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2024-09-12T02:43:11.466 INFO:teuthology.orchestra.run.smithi112.stdout:{"osd_objectstore":"memstore"} 2024-09-12T02:43:11.466 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2024-09-12T02:43:11.466 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T02:43:11.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.621+0000 7fb4a6600640 1 Processor -- start 2024-09-12T02:43:11.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.621+0000 7fb4a6600640 1 -- start start 2024-09-12T02:43:11.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.623+0000 7fb4a6600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb4a00ae8d0 0x7fb4a00afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:11.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.623+0000 7fb4a6600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a006dca0 0x7fb4a006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:11.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.623+0000 7fb4a6600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4a00aedd0 con 0x7fb4a006d8c0 2024-09-12T02:43:11.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.623+0000 7fb4a6600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb4a00af0b0 con 0x7fb4a00ae8d0 2024-09-12T02:43:11.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.623+0000 7fb4a6600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb4a00af390 con 0x7fb4a006dca0 2024-09-12T02:43:11.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.623+0000 7fb496a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb4a00ae8d0 0x7fb4a00afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:11.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.623+0000 7fb49fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a006dca0 0x7fb4a006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:11.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.623+0000 7fb496a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb4a00ae8d0 0x7fb4a00afe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:39370/0 (socket says 172.21.15.112:39370) 2024-09-12T02:43:11.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.623+0000 7fb49fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a006dca0 0x7fb4a006e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:35910/0 (socket says 172.21.15.112:35910) 2024-09-12T02:43:11.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.623+0000 7fb496a00640 1 -- 172.21.15.112:0/1850803032 learned_addr learned my addr 172.21.15.112:0/1850803032 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:11.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.624+0000 7fb496a00640 1 -- 172.21.15.112:0/1850803032 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a006dca0 msgr2=0x7fb4a006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:11.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.624+0000 7fb496a00640 1 --2- 172.21.15.112:0/1850803032 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a006dca0 0x7fb4a006e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:11.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.624+0000 7fb496a00640 1 -- 172.21.15.112:0/1850803032 >> v1:172.21.15.137:6789/0 conn(0x7fb4a006d8c0 legacy=0x7fb4a00715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:11.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.624+0000 7fb496a00640 1 -- 172.21.15.112:0/1850803032 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4a00af670 con 0x7fb4a00ae8d0 2024-09-12T02:43:11.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.624+0000 7fb49ea00640 1 -- 172.21.15.112:0/1850803032 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2383057188 0 0) 0x7fb4a00aedd0 con 0x7fb4a006d8c0 2024-09-12T02:43:11.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.624+0000 7fb49fe00640 1 --2- 172.21.15.112:0/1850803032 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a006dca0 0x7fb4a006e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:43:11.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.625+0000 7fb496a00640 1 --2- 172.21.15.112:0/1850803032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4a00ae8d0 0x7fb4a00afe70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb488009850 tx=0x7fb48802a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36735a28c47bc601 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:11.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.625+0000 7fb49ea00640 1 -- 172.21.15.112:0/1850803032 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb488004030 con 0x7fb4a00ae8d0 2024-09-12T02:43:11.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.625+0000 7fb49ea00640 1 -- 172.21.15.112:0/1850803032 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4880041d0 con 0x7fb4a00ae8d0 2024-09-12T02:43:11.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.625+0000 7fb49ea00640 1 -- 172.21.15.112:0/1850803032 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb488003610 con 0x7fb4a00ae8d0 2024-09-12T02:43:11.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.626+0000 7fb4a6600640 1 -- 172.21.15.112:0/1850803032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4a00ae8d0 msgr2=0x7fb4a00afe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:11.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.626+0000 7fb4a6600640 1 --2- 172.21.15.112:0/1850803032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4a00ae8d0 0x7fb4a00afe70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb488009850 tx=0x7fb48802a250 comp rx=0 tx=0).stop 2024-09-12T02:43:11.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.626+0000 7fb4a6600640 1 -- 172.21.15.112:0/1850803032 shutdown_connections 2024-09-12T02:43:11.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.626+0000 7fb4a6600640 1 --2- 172.21.15.112:0/1850803032 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a006dca0 0x7fb4a006e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:11.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.626+0000 7fb4a6600640 1 --2- 172.21.15.112:0/1850803032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4a00ae8d0 0x7fb4a00afe70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:11.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.626+0000 7fb4a6600640 1 -- 172.21.15.112:0/1850803032 >> 172.21.15.112:0/1850803032 conn(0x7fb4a006bbd0 msgr2=0x7fb4a006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:11.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.626+0000 7fb4a6600640 1 -- 172.21.15.112:0/1850803032 shutdown_connections 2024-09-12T02:43:11.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.626+0000 7fb4a6600640 1 -- 172.21.15.112:0/1850803032 wait complete. 2024-09-12T02:43:11.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.627+0000 7fb4a6600640 1 Processor -- start 2024-09-12T02:43:11.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.628+0000 7fb4a6600640 1 -- start start 2024-09-12T02:43:11.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.628+0000 7fb4a6600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a006d8c0 0x7fb4a00ce790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:11.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.628+0000 7fb4a6600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4a006dca0 0x7fb4a014c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:11.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.628+0000 7fb4a6600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4a00ae8d0 0x7fb4a00cf640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:11.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.628+0000 7fb4a6600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a00b38e0 con 0x7fb4a00ae8d0 2024-09-12T02:43:11.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.628+0000 7fb4a6600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a006e690 con 0x7fb4a006dca0 2024-09-12T02:43:11.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.628+0000 7fb4a6600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb4a00b3a60 con 0x7fb4a006d8c0 2024-09-12T02:43:11.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.629+0000 7fb49fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4a00ae8d0 0x7fb4a00cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:11.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.629+0000 7fb49fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4a00ae8d0 0x7fb4a00cf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35138/0 (socket says 172.21.15.112:35138) 2024-09-12T02:43:11.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.629+0000 7fb49fe00640 1 -- 172.21.15.112:0/1675622361 learned_addr learned my addr 172.21.15.112:0/1675622361 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:11.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.629+0000 7fb49f400640 1 --2- 172.21.15.112:0/1675622361 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a006d8c0 0x7fb4a00ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:11.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.629+0000 7fb496a00640 1 --2- 172.21.15.112:0/1675622361 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4a006dca0 0x7fb4a014c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:11.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.629+0000 7fb49fe00640 1 -- 172.21.15.112:0/1675622361 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a006d8c0 msgr2=0x7fb4a00ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:11.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.629+0000 7fb49fe00640 1 --2- 172.21.15.112:0/1675622361 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a006d8c0 0x7fb4a00ce790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:11.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.629+0000 7fb49fe00640 1 -- 172.21.15.112:0/1675622361 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4a006dca0 msgr2=0x7fb4a014c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:11.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.629+0000 7fb49fe00640 1 --2- 172.21.15.112:0/1675622361 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4a006dca0 0x7fb4a014c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:11.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.629+0000 7fb49fe00640 1 -- 172.21.15.112:0/1675622361 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4a01573d0 con 0x7fb4a00ae8d0 2024-09-12T02:43:11.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.629+0000 7fb49fe00640 1 --2- 172.21.15.112:0/1675622361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4a00ae8d0 0x7fb4a00cf640 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb49800efc0 tx=0x7fb498009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:11.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.630+0000 7fb497e00640 1 -- 172.21.15.112:0/1675622361 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb498018030 con 0x7fb4a00ae8d0 2024-09-12T02:43:11.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.630+0000 7fb497e00640 1 -- 172.21.15.112:0/1675622361 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb49800cde0 con 0x7fb4a00ae8d0 2024-09-12T02:43:11.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.630+0000 7fb497e00640 1 -- 172.21.15.112:0/1675622361 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb498003bb0 con 0x7fb4a00ae8d0 2024-09-12T02:43:11.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.630+0000 7fb4a6600640 1 -- 172.21.15.112:0/1675622361 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4a014c9b0 con 0x7fb4a00ae8d0 2024-09-12T02:43:11.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.630+0000 7fb4a6600640 1 -- 172.21.15.112:0/1675622361 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4a00d0130 con 0x7fb4a00ae8d0 2024-09-12T02:43:11.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.631+0000 7fb4a6600640 1 -- 172.21.15.112:0/1675622361 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4a006e150 con 0x7fb4a00ae8d0 2024-09-12T02:43:11.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.632+0000 7fb497e00640 1 -- 172.21.15.112:0/1675622361 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb498005d10 con 0x7fb4a00ae8d0 2024-09-12T02:43:11.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.633+0000 7fb497e00640 1 --2- 172.21.15.112:0/1675622361 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb47c06be30 0x7fb47c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:11.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.633+0000 7fb497e00640 1 -- 172.21.15.112:0/1675622361 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fb49808b5b0 con 0x7fb4a00ae8d0 2024-09-12T02:43:11.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.633+0000 7fb49f400640 1 --2- 172.21.15.112:0/1675622361 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb47c06be30 0x7fb47c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:11.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.633+0000 7fb49f400640 1 --2- 172.21.15.112:0/1675622361 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb47c06be30 0x7fb47c06e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb490000f60 tx=0x7fb490009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:11.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.637+0000 7fb497e00640 1 -- 172.21.15.112:0/1675622361 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb498022070 con 0x7fb4a00ae8d0 2024-09-12T02:43:11.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.810+0000 7fb4a6600640 1 -- 172.21.15.112:0/1675622361 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fb4a00763b0 con 0x7fb4a00ae8d0 2024-09-12T02:43:11.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.815+0000 7fb497e00640 1 -- 172.21.15.112:0/1675622361 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) ==== 122+0+0 (secure 0 0 0) 0x7fb498010040 con 0x7fb4a00ae8d0 2024-09-12T02:43:11.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.817+0000 7fb4a6600640 1 -- 172.21.15.112:0/1675622361 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb47c06be30 msgr2=0x7fb47c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:11.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.817+0000 7fb4a6600640 1 --2- 172.21.15.112:0/1675622361 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb47c06be30 0x7fb47c06e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb490000f60 tx=0x7fb490009040 comp rx=0 tx=0).stop 2024-09-12T02:43:11.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.817+0000 7fb4a6600640 1 -- 172.21.15.112:0/1675622361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4a00ae8d0 msgr2=0x7fb4a00cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:11.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.817+0000 7fb4a6600640 1 --2- 172.21.15.112:0/1675622361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4a00ae8d0 0x7fb4a00cf640 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb49800efc0 tx=0x7fb498009f90 comp rx=0 tx=0).stop 2024-09-12T02:43:11.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.817+0000 7fb4a6600640 1 -- 172.21.15.112:0/1675622361 shutdown_connections 2024-09-12T02:43:11.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.817+0000 7fb4a6600640 1 --2- 172.21.15.112:0/1675622361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4a00ae8d0 0x7fb4a00cf640 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:11.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.817+0000 7fb4a6600640 1 --2- 172.21.15.112:0/1675622361 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb47c06be30 0x7fb47c06e2f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:11.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.817+0000 7fb4a6600640 1 --2- 172.21.15.112:0/1675622361 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4a006dca0 0x7fb4a014c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:11.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.817+0000 7fb4a6600640 1 --2- 172.21.15.112:0/1675622361 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a006d8c0 0x7fb4a00ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:11.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.817+0000 7fb4a6600640 1 -- 172.21.15.112:0/1675622361 >> 172.21.15.112:0/1675622361 conn(0x7fb4a006bbd0 msgr2=0x7fb4a0071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:11.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.817+0000 7fb4a6600640 1 -- 172.21.15.112:0/1675622361 shutdown_connections 2024-09-12T02:43:11.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:11.817+0000 7fb4a6600640 1 -- 172.21.15.112:0/1675622361 wait complete. 2024-09-12T02:43:11.833 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:43:11.834 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:43:11.928 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:43:12.029 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:43:12.029 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:43:12.029 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:43:12.065 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:43:12.190 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:43:12.190 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:43:12.230 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:43:12.230 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:43:12.230 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:43:12.281 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:43:12.282 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:43:12.282 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:43:12.320 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:43:12.320 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T02:43:12.320 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:43:12.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.477+0000 7f2dbf200640 1 Processor -- start 2024-09-12T02:43:12.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.477+0000 7f2dbf200640 1 -- start start 2024-09-12T02:43:12.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.478+0000 7f2dbf200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2db8160c30 0x7f2db8071a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:12.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.479+0000 7f2dbf200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2db8167500 0x7f2db8165080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:12.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.479+0000 7f2dbf200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2db8072370 con 0x7f2db8161010 2024-09-12T02:43:12.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.479+0000 7f2dbf200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2db8072650 con 0x7f2db8160c30 2024-09-12T02:43:12.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.479+0000 7f2dbf200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2db8072930 con 0x7f2db8167500 2024-09-12T02:43:12.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.479+0000 7f2dbd200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2db8167500 0x7f2db8165080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:12.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.479+0000 7f2dbd200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2db8167500 0x7f2db8165080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:37444/0 (socket says 172.21.15.112:37444) 2024-09-12T02:43:12.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.479+0000 7f2dbd200640 1 -- 172.21.15.112:0/2065995915 learned_addr learned my addr 172.21.15.112:0/2065995915 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:12.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.479+0000 7f2db7e00640 1 --2- 172.21.15.112:0/2065995915 >> v2:172.21.15.137:3300/0 conn(0x7f2db8160c30 0x7f2db8071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:12.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.480+0000 7f2dbd200640 1 -- 172.21.15.112:0/2065995915 >> v2:172.21.15.137:3300/0 conn(0x7f2db8160c30 msgr2=0x7f2db8071a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:12.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.480+0000 7f2dbd200640 1 --2- 172.21.15.112:0/2065995915 >> v2:172.21.15.137:3300/0 conn(0x7f2db8160c30 0x7f2db8071a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:12.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.480+0000 7f2dbd200640 1 -- 172.21.15.112:0/2065995915 >> v1:172.21.15.137:6789/0 conn(0x7f2db8161010 legacy=0x7f2db8166df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:12.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.480+0000 7f2dbd200640 1 -- 172.21.15.112:0/2065995915 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db8164b60 con 0x7f2db8167500 2024-09-12T02:43:12.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.481+0000 7f2dbd200640 1 --2- 172.21.15.112:0/2065995915 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2db8167500 0x7f2db8165080 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2db0009e50 tx=0x7f2db002a630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5347301b807123c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:12.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.481+0000 7f2db7400640 1 -- 172.21.15.112:0/2065995915 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db0036070 con 0x7f2db8167500 2024-09-12T02:43:12.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.481+0000 7f2db7400640 1 -- 172.21.15.112:0/2065995915 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db0031600 con 0x7f2db8167500 2024-09-12T02:43:12.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.481+0000 7f2db7400640 1 -- 172.21.15.112:0/2065995915 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db00319d0 con 0x7f2db8167500 2024-09-12T02:43:12.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.481+0000 7f2dbf200640 1 -- 172.21.15.112:0/2065995915 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2db8167500 msgr2=0x7f2db8165080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:12.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.481+0000 7f2dbf200640 1 --2- 172.21.15.112:0/2065995915 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2db8167500 0x7f2db8165080 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2db0009e50 tx=0x7f2db002a630 comp rx=0 tx=0).stop 2024-09-12T02:43:12.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.482+0000 7f2dbf200640 1 -- 172.21.15.112:0/2065995915 shutdown_connections 2024-09-12T02:43:12.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.482+0000 7f2dbf200640 1 --2- 172.21.15.112:0/2065995915 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2db8167500 0x7f2db8165080 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:12.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.482+0000 7f2dbf200640 1 --2- 172.21.15.112:0/2065995915 >> v2:172.21.15.137:3300/0 conn(0x7f2db8160c30 0x7f2db8071a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:12.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.482+0000 7f2dbf200640 1 -- 172.21.15.112:0/2065995915 >> 172.21.15.112:0/2065995915 conn(0x7f2db806bbd0 msgr2=0x7f2db806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:12.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.482+0000 7f2dbf200640 1 -- 172.21.15.112:0/2065995915 shutdown_connections 2024-09-12T02:43:12.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.482+0000 7f2dbf200640 1 -- 172.21.15.112:0/2065995915 wait complete. 2024-09-12T02:43:12.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.483+0000 7f2dbf200640 1 Processor -- start 2024-09-12T02:43:12.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.483+0000 7f2dbf200640 1 -- start start 2024-09-12T02:43:12.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.484+0000 7f2dbf200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2db8160c30 0x7f2db80ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:12.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.484+0000 7f2dbf200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2db8161010 0x7f2db80ce900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:12.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.484+0000 7f2dbf200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2db8167500 0x7f2db80cee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:12.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.484+0000 7f2dbf200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2db806f800 con 0x7f2db8167500 2024-09-12T02:43:12.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.484+0000 7f2dbf200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2db806f680 con 0x7f2db8161010 2024-09-12T02:43:12.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.484+0000 7f2dbf200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2db81655c0 con 0x7f2db8160c30 2024-09-12T02:43:12.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.484+0000 7f2dbd200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2db8167500 0x7f2db80cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:12.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.485+0000 7f2dbd200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2db8167500 0x7f2db80cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54600/0 (socket says 172.21.15.112:54600) 2024-09-12T02:43:12.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.485+0000 7f2dbd200640 1 -- 172.21.15.112:0/3116308579 learned_addr learned my addr 172.21.15.112:0/3116308579 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:12.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.485+0000 7f2daf400640 1 --2- 172.21.15.112:0/3116308579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2db8161010 0x7f2db80ce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:12.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.485+0000 7f2db7e00640 1 --2- 172.21.15.112:0/3116308579 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2db8160c30 0x7f2db80ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:12.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.485+0000 7f2dbd200640 1 -- 172.21.15.112:0/3116308579 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2db8160c30 msgr2=0x7f2db80ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:12.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.485+0000 7f2dbd200640 1 --2- 172.21.15.112:0/3116308579 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2db8160c30 0x7f2db80ca900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:12.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.485+0000 7f2dbd200640 1 -- 172.21.15.112:0/3116308579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2db8161010 msgr2=0x7f2db80ce900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:12.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.485+0000 7f2dbd200640 1 --2- 172.21.15.112:0/3116308579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2db8161010 0x7f2db80ce900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:12.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.485+0000 7f2dbd200640 1 -- 172.21.15.112:0/3116308579 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db80c6350 con 0x7f2db8167500 2024-09-12T02:43:12.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.485+0000 7f2dbd200640 1 --2- 172.21.15.112:0/3116308579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2db8167500 0x7f2db80cee40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2db0009e50 tx=0x7f2db0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:12.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.486+0000 7f2db4c00640 1 -- 172.21.15.112:0/3116308579 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db0041020 con 0x7f2db8167500 2024-09-12T02:43:12.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.486+0000 7f2db4c00640 1 -- 172.21.15.112:0/3116308579 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db0007780 con 0x7f2db8167500 2024-09-12T02:43:12.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.486+0000 7f2db4c00640 1 -- 172.21.15.112:0/3116308579 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db0036040 con 0x7f2db8167500 2024-09-12T02:43:12.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.486+0000 7f2dbf200640 1 -- 172.21.15.112:0/3116308579 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2db80c6630 con 0x7f2db8167500 2024-09-12T02:43:12.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.486+0000 7f2dbf200640 1 -- 172.21.15.112:0/3116308579 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2db80c6bf0 con 0x7f2db8167500 2024-09-12T02:43:12.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.487+0000 7f2dbf200640 1 -- 172.21.15.112:0/3116308579 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2db8068a30 con 0x7f2db8167500 2024-09-12T02:43:12.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.488+0000 7f2db4c00640 1 -- 172.21.15.112:0/3116308579 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2db0044020 con 0x7f2db8167500 2024-09-12T02:43:12.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.489+0000 7f2db4c00640 1 --2- 172.21.15.112:0/3116308579 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2d9406be30 0x7f2d9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:12.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.489+0000 7f2db4c00640 1 -- 172.21.15.112:0/3116308579 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f2db00ab690 con 0x7f2db8167500 2024-09-12T02:43:12.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.489+0000 7f2db7e00640 1 --2- 172.21.15.112:0/3116308579 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2d9406be30 0x7f2d9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:12.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.489+0000 7f2db7e00640 1 --2- 172.21.15.112:0/3116308579 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2d9406be30 0x7f2d9406e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2da8006fd0 tx=0x7f2da8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:12.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.493+0000 7f2db4c00640 1 -- 172.21.15.112:0/3116308579 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2db004b030 con 0x7f2db8167500 2024-09-12T02:43:12.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.702+0000 7f2dbf200640 1 -- 172.21.15.112:0/3116308579 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2db8165120 con 0x7f2db8167500 2024-09-12T02:43:12.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.703+0000 7f2db4c00640 1 -- 172.21.15.112:0/3116308579 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+3923 (secure 0 0 0) 0x7f2db0079ce0 con 0x7f2db8167500 2024-09-12T02:43:12.704 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:12.704 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":20,"btime":"2024-09-12T02:43:06:245817+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/2907398106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2907398106},{"type":"v1","addr":"172.21.15.112:6836","nonce":2907398106}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3325408635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3325408635},{"type":"v1","addr":"172.21.15.137:6835","nonce":3325408635}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4678,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3355910952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3355910952},{"type":"v1","addr":"172.21.15.137:6833","nonce":3355910952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5061,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3303234428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3303234428},{"type":"v1","addr":"172.21.15.112:6837","nonce":3303234428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[]} 2024-09-12T02:43:12.704 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 20 2024-09-12T02:43:12.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.705+0000 7f2dbf200640 1 -- 172.21.15.112:0/3116308579 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2d9406be30 msgr2=0x7f2d9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:12.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.705+0000 7f2dbf200640 1 --2- 172.21.15.112:0/3116308579 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2d9406be30 0x7f2d9406e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2da8006fd0 tx=0x7f2da8008040 comp rx=0 tx=0).stop 2024-09-12T02:43:12.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.705+0000 7f2dbf200640 1 -- 172.21.15.112:0/3116308579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2db8167500 msgr2=0x7f2db80cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:12.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.705+0000 7f2dbf200640 1 --2- 172.21.15.112:0/3116308579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2db8167500 0x7f2db80cee40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2db0009e50 tx=0x7f2db0004a40 comp rx=0 tx=0).stop 2024-09-12T02:43:12.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.705+0000 7f2dbf200640 1 -- 172.21.15.112:0/3116308579 shutdown_connections 2024-09-12T02:43:12.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.705+0000 7f2dbf200640 1 --2- 172.21.15.112:0/3116308579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2db8167500 0x7f2db80cee40 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:12.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.705+0000 7f2dbf200640 1 --2- 172.21.15.112:0/3116308579 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2d9406be30 0x7f2d9406e2f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:12.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.705+0000 7f2dbf200640 1 --2- 172.21.15.112:0/3116308579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2db8161010 0x7f2db80ce900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:12.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.705+0000 7f2dbf200640 1 --2- 172.21.15.112:0/3116308579 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2db8160c30 0x7f2db80ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:12.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.705+0000 7f2dbf200640 1 -- 172.21.15.112:0/3116308579 >> 172.21.15.112:0/3116308579 conn(0x7f2db806bbd0 msgr2=0x7f2db806e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:12.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.705+0000 7f2dbf200640 1 -- 172.21.15.112:0/3116308579 shutdown_connections 2024-09-12T02:43:12.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.705+0000 7f2dbf200640 1 -- 172.21.15.112:0/3116308579 wait complete. 2024-09-12T02:43:12.722 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T02:43:12.722 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T02:43:12.723 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T02:43:12.723 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:43:12.723 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T02:43:12.723 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T02:43:12.723 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T02:43:12.723 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:43:12.724 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T02:43:12.724 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T02:43:12.724 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T02:43:12.724 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:43:12.724 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T02:43:12.724 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T02:43:12.724 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T02:43:12.724 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:43:12.738 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T02:43:12.738 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T02:43:12.739 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T02:43:12.739 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T02:43:12.741 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T02:43:12.741 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T02:43:12.742 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T02:43:12.742 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T02:43:12.783 INFO:tasks.ceph.mds.c:Started 2024-09-12T02:43:12.784 DEBUG:teuthology.parallel:result is None 2024-09-12T02:43:12.786 INFO:tasks.ceph.mds.b:Started 2024-09-12T02:43:12.786 DEBUG:teuthology.parallel:result is None 2024-09-12T02:43:12.787 INFO:tasks.ceph.mds.a:Started 2024-09-12T02:43:12.787 DEBUG:teuthology.parallel:result is None 2024-09-12T02:43:12.789 INFO:tasks.ceph.mds.d:Started 2024-09-12T02:43:12.789 DEBUG:teuthology.parallel:result is None 2024-09-12T02:43:12.790 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T02:43:12.917 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-12T02:43:12.918 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2024-09-12T02:43:12.925 INFO:tasks.ceph.mds.b.smithi137.stdout:starting mds.b at 2024-09-12T02:43:12.926 INFO:tasks.ceph.mds.d.smithi137.stdout:starting mds.d at 2024-09-12T02:43:12.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.950+0000 7fa5ce200640 1 Processor -- start 2024-09-12T02:43:12.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.951+0000 7fa5ce200640 1 -- start start 2024-09-12T02:43:12.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.952+0000 7fa5ce200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa5c81624e0 0x7fa5c80d58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:12.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.952+0000 7fa5ce200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5c80cfa70 con 0x7fa5c80d0510 2024-09-12T02:43:12.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.952+0000 7fa5ce200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5c80d21d0 con 0x7fa5c8162100 2024-09-12T02:43:12.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.952+0000 7fa5ce200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa5c80b4e20 con 0x7fa5c81624e0 2024-09-12T02:43:12.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.952+0000 7fa5c7e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa5c80d0510 0x7fa5c80d0920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36000/0 (socket says 172.21.15.112:36000) 2024-09-12T02:43:12.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.952+0000 7fa5c6a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa5c81624e0 0x7fa5c80d58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:12.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.952+0000 7fa5c7e00640 1 -- 172.21.15.112:0/4071052760 learned_addr learned my addr 172.21.15.112:0/4071052760 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:12.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.953+0000 7fa5c6a00640 1 -- 172.21.15.112:0/4071052760 >> v1:172.21.15.137:6789/0 conn(0x7fa5c8162100 legacy=0x7fa5c80b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:12.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.953+0000 7fa5c6a00640 1 -- 172.21.15.112:0/4071052760 >> v1:172.21.15.112:6789/0 conn(0x7fa5c80d0510 legacy=0x7fa5c80d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:12.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.953+0000 7fa5c6000640 1 -- 172.21.15.112:0/4071052760 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2577268563 0 0) 0x7fa5c80d21d0 con 0x7fa5c8162100 2024-09-12T02:43:12.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.953+0000 7fa5c6a00640 1 -- 172.21.15.112:0/4071052760 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c80d24b0 con 0x7fa5c81624e0 2024-09-12T02:43:12.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.954+0000 7fa5c6a00640 1 --2- 172.21.15.112:0/4071052760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5c81624e0 0x7fa5c80d58d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40097a0 tx=0x7fa5b402a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61f625f546c682c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:12.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.954+0000 7fa5c6000640 1 -- 172.21.15.112:0/4071052760 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b4037070 con 0x7fa5c81624e0 2024-09-12T02:43:12.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.954+0000 7fa5c6000640 1 -- 172.21.15.112:0/4071052760 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b402ad30 con 0x7fa5c81624e0 2024-09-12T02:43:12.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.954+0000 7fa5c6000640 1 -- 172.21.15.112:0/4071052760 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b4032660 con 0x7fa5c81624e0 2024-09-12T02:43:12.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.954+0000 7fa5ce200640 1 -- 172.21.15.112:0/4071052760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5c81624e0 msgr2=0x7fa5c80d58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:12.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.954+0000 7fa5ce200640 1 --2- 172.21.15.112:0/4071052760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5c81624e0 0x7fa5c80d58d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40097a0 tx=0x7fa5b402a0a0 comp rx=0 tx=0).stop 2024-09-12T02:43:12.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.954+0000 7fa5ce200640 1 -- 172.21.15.112:0/4071052760 shutdown_connections 2024-09-12T02:43:12.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.954+0000 7fa5ce200640 1 --2- 172.21.15.112:0/4071052760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5c81624e0 0x7fa5c80d58d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:12.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.954+0000 7fa5ce200640 1 -- 172.21.15.112:0/4071052760 >> 172.21.15.112:0/4071052760 conn(0x7fa5c80d4db0 msgr2=0x7fa5c80d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:12.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.955+0000 7fa5ce200640 1 -- 172.21.15.112:0/4071052760 shutdown_connections 2024-09-12T02:43:12.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.955+0000 7fa5ce200640 1 -- 172.21.15.112:0/4071052760 wait complete. 2024-09-12T02:43:12.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.956+0000 7fa5ce200640 1 Processor -- start 2024-09-12T02:43:12.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.956+0000 7fa5ce200640 1 -- start start 2024-09-12T02:43:12.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.957+0000 7fa5ce200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5c80d0510 0x7fa5c80ce860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:12.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.957+0000 7fa5ce200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa5c8162100 0x7fa5c80ba500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:12.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.957+0000 7fa5ce200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5c81624e0 0x7fa5c8157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:12.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.957+0000 7fa5ce200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c80d1df0 con 0x7fa5c80d0510 2024-09-12T02:43:12.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.957+0000 7fa5ce200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c80cfff0 con 0x7fa5c81624e0 2024-09-12T02:43:12.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.957+0000 7fa5ce200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa5c80d1f70 con 0x7fa5c8162100 2024-09-12T02:43:12.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.957+0000 7fa5c7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5c80d0510 0x7fa5c80ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:12.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.957+0000 7fa5c7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5c80d0510 0x7fa5c80ce860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54642/0 (socket says 172.21.15.112:54642) 2024-09-12T02:43:12.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.957+0000 7fa5c7400640 1 -- 172.21.15.112:0/126056100 learned_addr learned my addr 172.21.15.112:0/126056100 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:12.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.958+0000 7fa5c6a00640 1 --2- 172.21.15.112:0/126056100 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa5c8162100 0x7fa5c80ba500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:12.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.958+0000 7fa5c7e00640 1 --2- 172.21.15.112:0/126056100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5c81624e0 0x7fa5c8157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:12.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.958+0000 7fa5c7400640 1 -- 172.21.15.112:0/126056100 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa5c8162100 msgr2=0x7fa5c80ba500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:12.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.958+0000 7fa5c7400640 1 --2- 172.21.15.112:0/126056100 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa5c8162100 0x7fa5c80ba500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:12.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.958+0000 7fa5c7400640 1 -- 172.21.15.112:0/126056100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5c81624e0 msgr2=0x7fa5c8157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:12.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.958+0000 7fa5c7400640 1 --2- 172.21.15.112:0/126056100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5c81624e0 0x7fa5c8157990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:12.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.958+0000 7fa5c7400640 1 -- 172.21.15.112:0/126056100 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c80cd7c0 con 0x7fa5c80d0510 2024-09-12T02:43:12.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.958+0000 7fa5c7400640 1 --2- 172.21.15.112:0/126056100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5c80d0510 0x7fa5c80ce860 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa5b800c460 tx=0x7fa5b800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:12.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.958+0000 7fa5bf400640 1 -- 172.21.15.112:0/126056100 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8005480 con 0x7fa5c80d0510 2024-09-12T02:43:12.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.958+0000 7fa5bf400640 1 -- 172.21.15.112:0/126056100 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b80035f0 con 0x7fa5c80d0510 2024-09-12T02:43:12.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.958+0000 7fa5bf400640 1 -- 172.21.15.112:0/126056100 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8003a00 con 0x7fa5c80d0510 2024-09-12T02:43:12.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.958+0000 7fa5ce200640 1 -- 172.21.15.112:0/126056100 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5c80cdaa0 con 0x7fa5c80d0510 2024-09-12T02:43:12.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.958+0000 7fa5ce200640 1 -- 172.21.15.112:0/126056100 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5c80ce060 con 0x7fa5c80d0510 2024-09-12T02:43:12.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.959+0000 7fa5ce200640 1 -- 172.21.15.112:0/126056100 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5c8162b80 con 0x7fa5c80d0510 2024-09-12T02:43:12.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.960+0000 7fa5bf400640 1 -- 172.21.15.112:0/126056100 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa5b8003ba0 con 0x7fa5c80d0510 2024-09-12T02:43:12.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.961+0000 7fa5bf400640 1 --2- 172.21.15.112:0/126056100 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa5a806bfd0 0x7fa5a806e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:12.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.961+0000 7fa5bf400640 1 -- 172.21.15.112:0/126056100 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fa5b808a6b0 con 0x7fa5c80d0510 2024-09-12T02:43:12.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.961+0000 7fa5c6a00640 1 --2- 172.21.15.112:0/126056100 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa5a806bfd0 0x7fa5a806e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:12.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.962+0000 7fa5c6a00640 1 --2- 172.21.15.112:0/126056100 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa5a806bfd0 0x7fa5a806e490 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4034000 tx=0x7fa5b402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:12.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:12.965+0000 7fa5bf400640 1 -- 172.21.15.112:0/126056100 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa5b8058d00 con 0x7fa5c80d0510 2024-09-12T02:43:13.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.150+0000 7fa5ce200640 1 -- 172.21.15.112:0/126056100 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fa5c806e120 con 0x7fa5c80d0510 2024-09-12T02:43:13.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.283+0000 7fa5bf400640 1 -- 172.21.15.112:0/126056100 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v39) ==== 97+0+0 (secure 0 0 0) 0x7fa5b805d000 con 0x7fa5c80d0510 2024-09-12T02:43:13.284 INFO:teuthology.orchestra.run.smithi112.stderr: removed all blocklist entries 2024-09-12T02:43:13.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.285+0000 7fa5ce200640 1 -- 172.21.15.112:0/126056100 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa5a806bfd0 msgr2=0x7fa5a806e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:13.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.285+0000 7fa5ce200640 1 --2- 172.21.15.112:0/126056100 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa5a806bfd0 0x7fa5a806e490 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4034000 tx=0x7fa5b402e000 comp rx=0 tx=0).stop 2024-09-12T02:43:13.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.285+0000 7fa5ce200640 1 -- 172.21.15.112:0/126056100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5c80d0510 msgr2=0x7fa5c80ce860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:13.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.285+0000 7fa5ce200640 1 --2- 172.21.15.112:0/126056100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5c80d0510 0x7fa5c80ce860 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa5b800c460 tx=0x7fa5b800c920 comp rx=0 tx=0).stop 2024-09-12T02:43:13.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.285+0000 7fa5ce200640 1 -- 172.21.15.112:0/126056100 shutdown_connections 2024-09-12T02:43:13.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.285+0000 7fa5ce200640 1 --2- 172.21.15.112:0/126056100 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa5a806bfd0 0x7fa5a806e490 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:13.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.285+0000 7fa5ce200640 1 --2- 172.21.15.112:0/126056100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5c81624e0 0x7fa5c8157990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:13.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.285+0000 7fa5ce200640 1 --2- 172.21.15.112:0/126056100 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa5c8162100 0x7fa5c80ba500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:13.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.285+0000 7fa5ce200640 1 --2- 172.21.15.112:0/126056100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5c80d0510 0x7fa5c80ce860 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:13.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.285+0000 7fa5ce200640 1 -- 172.21.15.112:0/126056100 >> 172.21.15.112:0/126056100 conn(0x7fa5c80d4db0 msgr2=0x7fa5c80b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:13.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.285+0000 7fa5ce200640 1 -- 172.21.15.112:0/126056100 shutdown_connections 2024-09-12T02:43:13.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.285+0000 7fa5ce200640 1 -- 172.21.15.112:0/126056100 wait complete. 2024-09-12T02:43:13.304 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T02:43:13.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.455+0000 7fdbe4600640 1 Processor -- start 2024-09-12T02:43:13.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.455+0000 7fdbe4600640 1 -- start start 2024-09-12T02:43:13.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.457+0000 7fdbe4600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdbdc071530 0x7fdbdc0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:13.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.457+0000 7fdbe4600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbdc0ceeb0 con 0x7fdbdc15cc50 2024-09-12T02:43:13.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.457+0000 7fdbe4600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbdc06e300 con 0x7fdbdc0719a0 2024-09-12T02:43:13.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.457+0000 7fdbe4600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fdbdc15d030 con 0x7fdbdc071530 2024-09-12T02:43:13.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.457+0000 7fdbe1c00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fdbdc15cc50 0x7fdbdc0732f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36014/0 (socket says 172.21.15.112:36014) 2024-09-12T02:43:13.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.457+0000 7fdbe1c00640 1 -- 172.21.15.112:0/2542010090 learned_addr learned my addr 172.21.15.112:0/2542010090 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:13.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.457+0000 7fdbe1200640 1 --2- 172.21.15.112:0/2542010090 >> v2:172.21.15.112:3300/0 conn(0x7fdbdc071530 0x7fdbdc0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:13.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.457+0000 7fdbe1200640 1 -- 172.21.15.112:0/2542010090 >> v1:172.21.15.137:6789/0 conn(0x7fdbdc0719a0 legacy=0x7fdbdc0cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:13.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.457+0000 7fdbe1200640 1 -- 172.21.15.112:0/2542010090 >> v1:172.21.15.112:6789/0 conn(0x7fdbdc15cc50 legacy=0x7fdbdc0732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:13.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.457+0000 7fdbdbe00640 1 -- 172.21.15.112:0/2542010090 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3684477578 0 0) 0x7fdbdc0ceeb0 con 0x7fdbdc15cc50 2024-09-12T02:43:13.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.458+0000 7fdbe1200640 1 -- 172.21.15.112:0/2542010090 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbdc06e5e0 con 0x7fdbdc071530 2024-09-12T02:43:13.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.459+0000 7fdbe1200640 1 --2- 172.21.15.112:0/2542010090 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbdc071530 0x7fdbdc0af720 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8009790 tx=0x7fdbc802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ee92a8ee05f6a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:13.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.459+0000 7fdbdbe00640 1 -- 172.21.15.112:0/2542010090 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8037070 con 0x7fdbdc071530 2024-09-12T02:43:13.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.459+0000 7fdbdbe00640 1 -- 172.21.15.112:0/2542010090 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc802ae40 con 0x7fdbdc071530 2024-09-12T02:43:13.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.459+0000 7fdbdbe00640 1 -- 172.21.15.112:0/2542010090 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8032660 con 0x7fdbdc071530 2024-09-12T02:43:13.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.459+0000 7fdbe4600640 1 -- 172.21.15.112:0/2542010090 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbdc071530 msgr2=0x7fdbdc0af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:13.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.459+0000 7fdbe4600640 1 --2- 172.21.15.112:0/2542010090 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbdc071530 0x7fdbdc0af720 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8009790 tx=0x7fdbc802a130 comp rx=0 tx=0).stop 2024-09-12T02:43:13.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.459+0000 7fdbe4600640 1 -- 172.21.15.112:0/2542010090 shutdown_connections 2024-09-12T02:43:13.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.459+0000 7fdbe4600640 1 --2- 172.21.15.112:0/2542010090 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbdc071530 0x7fdbdc0af720 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:13.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.459+0000 7fdbe4600640 1 -- 172.21.15.112:0/2542010090 >> 172.21.15.112:0/2542010090 conn(0x7fdbdc06bbd0 msgr2=0x7fdbdc06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:13.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.460+0000 7fdbe4600640 1 -- 172.21.15.112:0/2542010090 shutdown_connections 2024-09-12T02:43:13.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.460+0000 7fdbe4600640 1 -- 172.21.15.112:0/2542010090 wait complete. 2024-09-12T02:43:13.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.461+0000 7fdbe4600640 1 Processor -- start 2024-09-12T02:43:13.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.461+0000 7fdbe4600640 1 -- start start 2024-09-12T02:43:13.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.462+0000 7fdbe4600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdbdc071530 0x7fdbdc1507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:13.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.462+0000 7fdbe4600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdbdc0719a0 0x7fdbdc1510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:13.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.462+0000 7fdbe4600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbdc15cc50 0x7fdbdc1515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:13.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.462+0000 7fdbe4600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdbdc06f510 con 0x7fdbdc15cc50 2024-09-12T02:43:13.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.462+0000 7fdbe4600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdbdc0cf4c0 con 0x7fdbdc0719a0 2024-09-12T02:43:13.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.462+0000 7fdbe4600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdbdc06f690 con 0x7fdbdc071530 2024-09-12T02:43:13.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.462+0000 7fdbe2600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbdc15cc50 0x7fdbdc1515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:13.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.462+0000 7fdbe1200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdbdc0719a0 0x7fdbdc1510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:13.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.462+0000 7fdbe2600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbdc15cc50 0x7fdbdc1515f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54672/0 (socket says 172.21.15.112:54672) 2024-09-12T02:43:13.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.462+0000 7fdbe1c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdbdc071530 0x7fdbdc1507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:13.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.462+0000 7fdbe2600640 1 -- 172.21.15.112:0/3888361564 learned_addr learned my addr 172.21.15.112:0/3888361564 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:13.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.463+0000 7fdbe2600640 1 -- 172.21.15.112:0/3888361564 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdbdc071530 msgr2=0x7fdbdc1507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:13.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.463+0000 7fdbe2600640 1 --2- 172.21.15.112:0/3888361564 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdbdc071530 0x7fdbdc1507f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:13.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.463+0000 7fdbe2600640 1 -- 172.21.15.112:0/3888361564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdbdc0719a0 msgr2=0x7fdbdc1510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:13.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.463+0000 7fdbe2600640 1 --2- 172.21.15.112:0/3888361564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdbdc0719a0 0x7fdbdc1510b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:13.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.463+0000 7fdbe2600640 1 -- 172.21.15.112:0/3888361564 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbdc152550 con 0x7fdbdc15cc50 2024-09-12T02:43:13.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.463+0000 7fdbe2600640 1 --2- 172.21.15.112:0/3888361564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbdc15cc50 0x7fdbdc1515f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdbd400c700 tx=0x7fdbd400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:13.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.463+0000 7fdbd9600640 1 -- 172.21.15.112:0/3888361564 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd4016020 con 0x7fdbdc15cc50 2024-09-12T02:43:13.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.463+0000 7fdbd9600640 1 -- 172.21.15.112:0/3888361564 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbd400aa50 con 0x7fdbdc15cc50 2024-09-12T02:43:13.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.463+0000 7fdbe4600640 1 -- 172.21.15.112:0/3888361564 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbdc150d30 con 0x7fdbdc15cc50 2024-09-12T02:43:13.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.463+0000 7fdbd9600640 1 -- 172.21.15.112:0/3888361564 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd400ce10 con 0x7fdbdc15cc50 2024-09-12T02:43:13.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.464+0000 7fdbe4600640 1 -- 172.21.15.112:0/3888361564 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbdc1e8ba0 con 0x7fdbdc15cc50 2024-09-12T02:43:13.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.464+0000 7fdbe4600640 1 -- 172.21.15.112:0/3888361564 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbdc068a30 con 0x7fdbdc15cc50 2024-09-12T02:43:13.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.465+0000 7fdbd9600640 1 -- 172.21.15.112:0/3888361564 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdbd4019020 con 0x7fdbdc15cc50 2024-09-12T02:43:13.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.466+0000 7fdbd9600640 1 --2- 172.21.15.112:0/3888361564 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdbbc06be30 0x7fdbbc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:13.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.466+0000 7fdbd9600640 1 -- 172.21.15.112:0/3888361564 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7fdbd408acd0 con 0x7fdbdc15cc50 2024-09-12T02:43:13.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.467+0000 7fdbe1c00640 1 --2- 172.21.15.112:0/3888361564 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdbbc06be30 0x7fdbbc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:13.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.467+0000 7fdbe1c00640 1 --2- 172.21.15.112:0/3888361564 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdbbc06be30 0x7fdbbc06e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0007fd0 tx=0x7fdbd0007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:13.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.470+0000 7fdbd9600640 1 -- 172.21.15.112:0/3888361564 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdbd4020020 con 0x7fdbdc15cc50 2024-09-12T02:43:13.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.708+0000 7fdbe4600640 1 -- 172.21.15.112:0/3888361564 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fdbdc0696d0 con 0x7fdbdc15cc50 2024-09-12T02:43:13.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.709+0000 7fdbd9600640 1 -- 172.21.15.112:0/3888361564 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7fdbdc0696d0 con 0x7fdbdc15cc50 2024-09-12T02:43:13.710 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:13.710 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:43:13.710 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_dump": [ 2024-09-12T02:43:13.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:13.710 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.a", 2024-09-12T02:43:13.710 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmKE09KRAAtNq70LeeB9ENNxX91m10Fg==", 2024-09-12T02:43:13.711 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:43:13.711 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:43:13.711 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:43:13.711 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:43:13.711 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:43:13.711 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:13.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:13.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:13.711 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.b", 2024-09-12T02:43:13.711 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmMjYTARAAuIrofOOp9Dbrhkt314mhuw==", 2024-09-12T02:43:13.711 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:43:13.711 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:43:13.712 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:43:13.712 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:43:13.712 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:43:13.712 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:13.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:13.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:13.712 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.c", 2024-09-12T02:43:13.712 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmLQXzMhAAhk28JuqKhfbZtvRu9SSVrw==", 2024-09-12T02:43:13.712 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:43:13.712 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:43:13.712 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:43:13.712 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:43:13.713 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:43:13.713 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:13.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:13.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:13.713 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.d", 2024-09-12T02:43:13.713 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmaE7JChAAKlyynYJnHLs87BXyMC0xgA==", 2024-09-12T02:43:13.713 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:43:13.713 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:43:13.713 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:43:13.713 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:43:13.713 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:43:13.713 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:13.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:13.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:13.714 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.0", 2024-09-12T02:43:13.714 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDXVOJmFXfdIRAA+VpZNU0tEN6vAzR2C7nuLg==", 2024-09-12T02:43:13.714 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:43:13.714 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:43:13.714 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:43:13.714 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:43:13.714 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:13.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:13.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:13.715 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.1", 2024-09-12T02:43:13.715 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDXVOJmcgHyLBAA/OxfdQ1D+uFzbCnm1dJLxw==", 2024-09-12T02:43:13.715 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:43:13.715 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:43:13.715 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:43:13.715 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:43:13.715 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:13.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:13.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:13.715 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.2", 2024-09-12T02:43:13.715 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDXVOJm0baUNhAAuInNwHut2Xn0kBmjnJhdqw==", 2024-09-12T02:43:13.715 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:43:13.716 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:43:13.716 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:43:13.716 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:43:13.716 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:13.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:13.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:13.716 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.3", 2024-09-12T02:43:13.716 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDYVOJmL/O3BBAAZhQ4/70wj/2zEbMcfD4hQA==", 2024-09-12T02:43:13.716 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:43:13.716 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:43:13.716 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:43:13.716 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:43:13.717 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:13.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:13.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:13.717 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.4", 2024-09-12T02:43:13.717 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmC+sJAxAAUQofpG3g8DlGLQ8wUqtuSg==", 2024-09-12T02:43:13.717 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:43:13.717 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:43:13.717 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:43:13.717 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:43:13.717 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:13.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:13.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:13.717 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.5", 2024-09-12T02:43:13.717 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmY2OSDhAA2rg1HGjWx7G6IzFi6yQ/jQ==", 2024-09-12T02:43:13.718 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:43:13.718 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:43:13.718 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:43:13.718 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:43:13.718 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:13.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:13.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:13.719 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.6", 2024-09-12T02:43:13.719 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmydoaGRAAh/ozKewnY+RxiZ4EcOFA7A==", 2024-09-12T02:43:13.719 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:43:13.719 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:43:13.719 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:43:13.719 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:43:13.720 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:13.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:13.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:13.721 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.7", 2024-09-12T02:43:13.721 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmmB7cIhAAVhtz7OuxYBQgEKGvHdY33g==", 2024-09-12T02:43:13.721 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:43:13.721 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:43:13.721 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:43:13.721 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:43:13.721 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:13.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:13.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:13.721 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.0", 2024-09-12T02:43:13.721 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmaG86ExAAD0SOlJOsLpoQZlgPJIPaxA==", 2024-09-12T02:43:13.721 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:43:13.721 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:43:13.722 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow r", 2024-09-12T02:43:13.722 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T02:43:13.722 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:13.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:13.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:13.722 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.1", 2024-09-12T02:43:13.722 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmt7AeIBAAGRSEejG29OpANZqtia7KEw==", 2024-09-12T02:43:13.722 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:43:13.722 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:43:13.722 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:43:13.722 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:43:13.722 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:43:13.723 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:13.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:13.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:13.723 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.2", 2024-09-12T02:43:13.723 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmcUWtGRAAlV/gS/CDZKHb5bjbmDzjlg==", 2024-09-12T02:43:13.723 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:43:13.723 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:43:13.723 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:43:13.723 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:43:13.724 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:43:13.724 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:13.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:13.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:13.724 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.3", 2024-09-12T02:43:13.724 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJm2M97JhAAHKJoPBf6TN6Nu8muK6wzaw==", 2024-09-12T02:43:13.724 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:43:13.724 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:43:13.724 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:43:13.724 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:43:13.724 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:43:13.724 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:13.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:13.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:13.725 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.admin", 2024-09-12T02:43:13.725 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDSVOJmhl82NBAAvkcxnsY5u9lYO12FaRbP1A==", 2024-09-12T02:43:13.725 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:43:13.725 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-12T02:43:13.725 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:43:13.725 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:43:13.725 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:43:13.725 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:13.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:13.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:13.725 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.x", 2024-09-12T02:43:13.725 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmftawIhAAAKmfx8khERROoZ8BCLukAw==", 2024-09-12T02:43:13.726 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:43:13.726 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-12T02:43:13.726 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-12T02:43:13.726 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:43:13.726 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:13.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:13.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:13.726 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.y", 2024-09-12T02:43:13.726 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmcxtNGhAAAXWh1fMrVeFSy2hh3p2Rkw==", 2024-09-12T02:43:13.726 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:43:13.726 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-12T02:43:13.726 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-12T02:43:13.726 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:43:13.727 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:13.727 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:13.727 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:13.727 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:43:13.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.711+0000 7fdbe4600640 1 -- 172.21.15.112:0/3888361564 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdbbc06be30 msgr2=0x7fdbbc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:13.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.711+0000 7fdbe4600640 1 --2- 172.21.15.112:0/3888361564 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdbbc06be30 0x7fdbbc06e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0007fd0 tx=0x7fdbd0007de0 comp rx=0 tx=0).stop 2024-09-12T02:43:13.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.711+0000 7fdbe4600640 1 -- 172.21.15.112:0/3888361564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbdc15cc50 msgr2=0x7fdbdc1515f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:13.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.711+0000 7fdbe4600640 1 --2- 172.21.15.112:0/3888361564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbdc15cc50 0x7fdbdc1515f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdbd400c700 tx=0x7fdbd400cbc0 comp rx=0 tx=0).stop 2024-09-12T02:43:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.711+0000 7fdbe4600640 1 -- 172.21.15.112:0/3888361564 shutdown_connections 2024-09-12T02:43:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.711+0000 7fdbe4600640 1 --2- 172.21.15.112:0/3888361564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbdc15cc50 0x7fdbdc1515f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.711+0000 7fdbe4600640 1 --2- 172.21.15.112:0/3888361564 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdbbc06be30 0x7fdbbc06e2f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.711+0000 7fdbe4600640 1 --2- 172.21.15.112:0/3888361564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdbdc0719a0 0x7fdbdc1510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.711+0000 7fdbe4600640 1 --2- 172.21.15.112:0/3888361564 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdbdc071530 0x7fdbdc1507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.711+0000 7fdbe4600640 1 -- 172.21.15.112:0/3888361564 >> 172.21.15.112:0/3888361564 conn(0x7fdbdc06bbd0 msgr2=0x7fdbdc159320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.711+0000 7fdbe4600640 1 -- 172.21.15.112:0/3888361564 shutdown_connections 2024-09-12T02:43:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.711+0000 7fdbe4600640 1 -- 172.21.15.112:0/3888361564 wait complete. 2024-09-12T02:43:13.730 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T02:43:13.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.882+0000 7f8774c00640 1 Processor -- start 2024-09-12T02:43:13.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.882+0000 7f8774c00640 1 -- start start 2024-09-12T02:43:13.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.883+0000 7f8774c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f877015bb60 0x7f877006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:13.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.884+0000 7f8774c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8770072c80 0x7f877006f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:13.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.884+0000 7f8774c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f877015bf40 con 0x7f87700b56a0 2024-09-12T02:43:13.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.884+0000 7f8774c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f877006da70 con 0x7f877015bb60 2024-09-12T02:43:13.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.884+0000 7f8774c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f87700cdfd0 con 0x7f8770072c80 2024-09-12T02:43:13.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.884+0000 7f876de00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f877015bb60 0x7f877006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:13.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.884+0000 7f876e800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f87700b56a0 0x7f87700b39c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36022/0 (socket says 172.21.15.112:36022) 2024-09-12T02:43:13.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.884+0000 7f876e800640 1 -- 172.21.15.112:0/4096895848 learned_addr learned my addr 172.21.15.112:0/4096895848 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:13.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.884+0000 7f876d400640 1 --2- 172.21.15.112:0/4096895848 >> v2:172.21.15.137:3300/0 conn(0x7f8770072c80 0x7f877006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:13.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.884+0000 7f876de00640 1 -- 172.21.15.112:0/4096895848 >> v2:172.21.15.137:3300/0 conn(0x7f8770072c80 msgr2=0x7f877006f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:13.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.884+0000 7f876de00640 1 --2- 172.21.15.112:0/4096895848 >> v2:172.21.15.137:3300/0 conn(0x7f8770072c80 0x7f877006f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:13.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.884+0000 7f876de00640 1 -- 172.21.15.112:0/4096895848 >> v1:172.21.15.112:6789/0 conn(0x7f87700b56a0 legacy=0x7f87700b39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:13.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.884+0000 7f876de00640 1 -- 172.21.15.112:0/4096895848 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87700ce2b0 con 0x7f877015bb60 2024-09-12T02:43:13.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.884+0000 7f876ca00640 1 -- 172.21.15.112:0/4096895848 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4262842276 0 0) 0x7f877015bf40 con 0x7f87700b56a0 2024-09-12T02:43:13.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.885+0000 7f876de00640 1 --2- 172.21.15.112:0/4096895848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f877015bb60 0x7f877006ede0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f877006dbf0 tx=0x7f876002c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f891be427100eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:13.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.886+0000 7f876ca00640 1 -- 172.21.15.112:0/4096895848 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8760032750 con 0x7f877015bb60 2024-09-12T02:43:13.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.886+0000 7f876ca00640 1 -- 172.21.15.112:0/4096895848 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8760030050 con 0x7f877015bb60 2024-09-12T02:43:13.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.886+0000 7f876ca00640 1 -- 172.21.15.112:0/4096895848 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8760032b10 con 0x7f877015bb60 2024-09-12T02:43:13.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.886+0000 7f8774c00640 1 -- 172.21.15.112:0/4096895848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f877015bb60 msgr2=0x7f877006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:13.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.886+0000 7f8774c00640 1 --2- 172.21.15.112:0/4096895848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f877015bb60 0x7f877006ede0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f877006dbf0 tx=0x7f876002c850 comp rx=0 tx=0).stop 2024-09-12T02:43:13.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.886+0000 7f8774c00640 1 -- 172.21.15.112:0/4096895848 shutdown_connections 2024-09-12T02:43:13.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.886+0000 7f8774c00640 1 --2- 172.21.15.112:0/4096895848 >> v2:172.21.15.137:3300/0 conn(0x7f8770072c80 0x7f877006f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:13.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.886+0000 7f8774c00640 1 --2- 172.21.15.112:0/4096895848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f877015bb60 0x7f877006ede0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:13.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.886+0000 7f8774c00640 1 -- 172.21.15.112:0/4096895848 >> 172.21.15.112:0/4096895848 conn(0x7f87700b26c0 msgr2=0x7f87700b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:13.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.886+0000 7f8774c00640 1 -- 172.21.15.112:0/4096895848 shutdown_connections 2024-09-12T02:43:13.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.886+0000 7f8774c00640 1 -- 172.21.15.112:0/4096895848 wait complete. 2024-09-12T02:43:13.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.888+0000 7f8774c00640 1 Processor -- start 2024-09-12T02:43:13.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.888+0000 7f8774c00640 1 -- start start 2024-09-12T02:43:13.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.889+0000 7f8774c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8770072c80 0x7f87701f3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:13.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.889+0000 7f8774c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f87700b56a0 0x7f87700aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:13.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.889+0000 7f8774c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f877015bb60 0x7f8770071870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:13.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.889+0000 7f8774c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f877006d600 con 0x7f8770072c80 2024-09-12T02:43:13.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.889+0000 7f8774c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f87700ce870 con 0x7f877015bb60 2024-09-12T02:43:13.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.889+0000 7f8774c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f877006d780 con 0x7f87700b56a0 2024-09-12T02:43:13.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.889+0000 7f876de00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8770072c80 0x7f87701f3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:13.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.889+0000 7f876de00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8770072c80 0x7f87701f3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54694/0 (socket says 172.21.15.112:54694) 2024-09-12T02:43:13.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.889+0000 7f876de00640 1 -- 172.21.15.112:0/344177224 learned_addr learned my addr 172.21.15.112:0/344177224 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:13.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.889+0000 7f876de00640 1 -- 172.21.15.112:0/344177224 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f87700b56a0 msgr2=0x7f87700aefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:13.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.889+0000 7f876de00640 1 --2- 172.21.15.112:0/344177224 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f87700b56a0 0x7f87700aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:13.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.889+0000 7f876de00640 1 -- 172.21.15.112:0/344177224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f877015bb60 msgr2=0x7f8770071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:13.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.889+0000 7f876de00640 1 --2- 172.21.15.112:0/344177224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f877015bb60 0x7f8770071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:13.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.889+0000 7f876de00640 1 -- 172.21.15.112:0/344177224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87701f4190 con 0x7f8770072c80 2024-09-12T02:43:13.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.890+0000 7f876de00640 1 --2- 172.21.15.112:0/344177224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8770072c80 0x7f87701f3c50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f876000bb00 tx=0x7f87600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:13.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.890+0000 7f8766000640 1 -- 172.21.15.112:0/344177224 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8760041020 con 0x7f8770072c80 2024-09-12T02:43:13.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.890+0000 7f8766000640 1 -- 172.21.15.112:0/344177224 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8760034950 con 0x7f8770072c80 2024-09-12T02:43:13.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.890+0000 7f8766000640 1 -- 172.21.15.112:0/344177224 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8760034d40 con 0x7f8770072c80 2024-09-12T02:43:13.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.890+0000 7f8774c00640 1 -- 172.21.15.112:0/344177224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f877015db60 con 0x7f8770072c80 2024-09-12T02:43:13.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.890+0000 7f8774c00640 1 -- 172.21.15.112:0/344177224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f877015e120 con 0x7f8770072c80 2024-09-12T02:43:13.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.891+0000 7f8774c00640 1 -- 172.21.15.112:0/344177224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8770068a30 con 0x7f8770072c80 2024-09-12T02:43:13.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.892+0000 7f8766000640 1 -- 172.21.15.112:0/344177224 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8760044020 con 0x7f8770072c80 2024-09-12T02:43:13.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.893+0000 7f8766000640 1 --2- 172.21.15.112:0/344177224 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f875006be30 0x7f875006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:13.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.893+0000 7f8766000640 1 -- 172.21.15.112:0/344177224 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7f87600ab560 con 0x7f8770072c80 2024-09-12T02:43:13.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.893+0000 7f876d400640 1 --2- 172.21.15.112:0/344177224 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f875006be30 0x7f875006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:13.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.894+0000 7f876d400640 1 --2- 172.21.15.112:0/344177224 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f875006be30 0x7f875006e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f875c006a90 tx=0x7f875c006a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:13.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:13.897+0000 7f8766000640 1 -- 172.21.15.112:0/344177224 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f876004b030 con 0x7f8770072c80 2024-09-12T02:43:14.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.070+0000 7f8774c00640 1 -- 172.21.15.112:0/344177224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f87700b39c0 con 0x7f8770072c80 2024-09-12T02:43:14.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.070+0000 7f8766000640 1 -- 172.21.15.112:0/344177224 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v41) ==== 84+0+65 (secure 0 0 0) 0x7f876007a1c0 con 0x7f8770072c80 2024-09-12T02:43:14.072 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:14.072 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2024-09-12T02:43:14.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:14.072 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 1, 2024-09-12T02:43:14.072 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": ".mgr" 2024-09-12T02:43:14.072 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:14.072 INFO:teuthology.orchestra.run.smithi112.stdout:] 2024-09-12T02:43:14.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.072+0000 7f8774c00640 1 -- 172.21.15.112:0/344177224 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f875006be30 msgr2=0x7f875006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:14.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.072+0000 7f8774c00640 1 --2- 172.21.15.112:0/344177224 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f875006be30 0x7f875006e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f875c006a90 tx=0x7f875c006a20 comp rx=0 tx=0).stop 2024-09-12T02:43:14.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.072+0000 7f8774c00640 1 -- 172.21.15.112:0/344177224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8770072c80 msgr2=0x7f87701f3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:14.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.072+0000 7f8774c00640 1 --2- 172.21.15.112:0/344177224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8770072c80 0x7f87701f3c50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f876000bb00 tx=0x7f87600046c0 comp rx=0 tx=0).stop 2024-09-12T02:43:14.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.073+0000 7f8774c00640 1 -- 172.21.15.112:0/344177224 shutdown_connections 2024-09-12T02:43:14.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.073+0000 7f8774c00640 1 --2- 172.21.15.112:0/344177224 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f875006be30 0x7f875006e2f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:14.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.073+0000 7f8774c00640 1 --2- 172.21.15.112:0/344177224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f877015bb60 0x7f8770071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:14.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.073+0000 7f8774c00640 1 --2- 172.21.15.112:0/344177224 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f87700b56a0 0x7f87700aefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:14.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.073+0000 7f8774c00640 1 --2- 172.21.15.112:0/344177224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8770072c80 0x7f87701f3c50 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:14.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.073+0000 7f8774c00640 1 -- 172.21.15.112:0/344177224 >> 172.21.15.112:0/344177224 conn(0x7f87700b26c0 msgr2=0x7f87700d0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:14.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.073+0000 7f8774c00640 1 -- 172.21.15.112:0/344177224 shutdown_connections 2024-09-12T02:43:14.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.073+0000 7f8774c00640 1 -- 172.21.15.112:0/344177224 wait complete. 2024-09-12T02:43:14.089 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T02:43:14.089 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T02:43:14.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.245+0000 7ff543200640 1 Processor -- start 2024-09-12T02:43:14.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.245+0000 7ff543200640 1 -- start start 2024-09-12T02:43:14.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.246+0000 7ff543200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff53c0b5190 0x7ff53c15d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.246+0000 7ff543200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff53c0720b0 con 0x7ff53c0d0970 2024-09-12T02:43:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.246+0000 7ff543200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff53c15d880 con 0x7ff53c157190 2024-09-12T02:43:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.246+0000 7ff543200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff53c15d650 con 0x7ff53c0b5190 2024-09-12T02:43:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.247+0000 7ff541200640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff53c0d0970 0x7ff53c0d0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36030/0 (socket says 172.21.15.112:36030) 2024-09-12T02:43:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.247+0000 7ff541200640 1 -- 172.21.15.112:0/3215128759 learned_addr learned my addr 172.21.15.112:0/3215128759 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.247+0000 7ff53b400640 1 --2- 172.21.15.112:0/3215128759 >> v2:172.21.15.137:3300/0 conn(0x7ff53c0b5190 0x7ff53c15d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:14.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.247+0000 7ff53aa00640 1 -- 172.21.15.112:0/3215128759 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3426576348 0 0) 0x7ff53c0720b0 con 0x7ff53c0d0970 2024-09-12T02:43:14.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.247+0000 7ff53aa00640 1 -- 172.21.15.112:0/3215128759 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff520003520 con 0x7ff53c0d0970 2024-09-12T02:43:14.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.247+0000 7ff53aa00640 1 -- 172.21.15.112:0/3215128759 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3528120902 0 0) 0x7ff53c15d880 con 0x7ff53c157190 2024-09-12T02:43:14.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.247+0000 7ff53aa00640 1 -- 172.21.15.112:0/3215128759 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff53c0720b0 con 0x7ff53c157190 2024-09-12T02:43:14.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.247+0000 7ff53b400640 1 -- 172.21.15.112:0/3215128759 >> v1:172.21.15.137:6789/0 conn(0x7ff53c157190 legacy=0x7ff53c06d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:14.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.247+0000 7ff53b400640 1 -- 172.21.15.112:0/3215128759 >> v1:172.21.15.112:6789/0 conn(0x7ff53c0d0970 legacy=0x7ff53c0d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:14.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.247+0000 7ff53b400640 1 -- 172.21.15.112:0/3215128759 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff53c15db60 con 0x7ff53c0b5190 2024-09-12T02:43:14.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.248+0000 7ff53b400640 1 --2- 172.21.15.112:0/3215128759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff53c0b5190 0x7ff53c15d110 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff5280097a0 tx=0x7ff52802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9bfbacc4e0676ee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:14.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.249+0000 7ff53aa00640 1 -- 172.21.15.112:0/3215128759 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff528037070 con 0x7ff53c0b5190 2024-09-12T02:43:14.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.249+0000 7ff53aa00640 1 -- 172.21.15.112:0/3215128759 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff528032440 con 0x7ff53c0b5190 2024-09-12T02:43:14.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.249+0000 7ff53aa00640 1 -- 172.21.15.112:0/3215128759 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff528032810 con 0x7ff53c0b5190 2024-09-12T02:43:14.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.249+0000 7ff543200640 1 -- 172.21.15.112:0/3215128759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff53c0b5190 msgr2=0x7ff53c15d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:14.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.249+0000 7ff543200640 1 --2- 172.21.15.112:0/3215128759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff53c0b5190 0x7ff53c15d110 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff5280097a0 tx=0x7ff52802a230 comp rx=0 tx=0).stop 2024-09-12T02:43:14.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.249+0000 7ff543200640 1 -- 172.21.15.112:0/3215128759 shutdown_connections 2024-09-12T02:43:14.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.249+0000 7ff543200640 1 --2- 172.21.15.112:0/3215128759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff53c0b5190 0x7ff53c15d110 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:14.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.249+0000 7ff543200640 1 -- 172.21.15.112:0/3215128759 >> 172.21.15.112:0/3215128759 conn(0x7ff53c0b2730 msgr2=0x7ff53c0b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:14.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.249+0000 7ff543200640 1 -- 172.21.15.112:0/3215128759 shutdown_connections 2024-09-12T02:43:14.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.249+0000 7ff543200640 1 -- 172.21.15.112:0/3215128759 wait complete. 2024-09-12T02:43:14.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.251+0000 7ff543200640 1 Processor -- start 2024-09-12T02:43:14.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.251+0000 7ff543200640 1 -- start start 2024-09-12T02:43:14.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.252+0000 7ff543200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff53c0b5190 0x7ff53c152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:14.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.252+0000 7ff543200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff53c0d0970 0x7ff53c14f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:14.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.252+0000 7ff543200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff53c157190 0x7ff53c1f4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:14.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.252+0000 7ff543200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff53c157570 con 0x7ff53c0d0970 2024-09-12T02:43:14.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.252+0000 7ff543200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff53c072350 con 0x7ff53c157190 2024-09-12T02:43:14.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.252+0000 7ff543200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff53c072850 con 0x7ff53c0b5190 2024-09-12T02:43:14.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.252+0000 7ff53b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff53c0d0970 0x7ff53c14f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:14.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.252+0000 7ff53b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff53c0d0970 0x7ff53c14f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54698/0 (socket says 172.21.15.112:54698) 2024-09-12T02:43:14.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.252+0000 7ff53b400640 1 -- 172.21.15.112:0/1236728042 learned_addr learned my addr 172.21.15.112:0/1236728042 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:14.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.253+0000 7ff53be00640 1 --2- 172.21.15.112:0/1236728042 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff53c0b5190 0x7ff53c152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:14.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.253+0000 7ff541200640 1 --2- 172.21.15.112:0/1236728042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff53c157190 0x7ff53c1f4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:14.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.253+0000 7ff53b400640 1 -- 172.21.15.112:0/1236728042 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff53c0b5190 msgr2=0x7ff53c152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:14.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.253+0000 7ff53b400640 1 --2- 172.21.15.112:0/1236728042 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff53c0b5190 0x7ff53c152de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:14.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.253+0000 7ff53b400640 1 -- 172.21.15.112:0/1236728042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff53c157190 msgr2=0x7ff53c1f4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:14.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.253+0000 7ff53b400640 1 --2- 172.21.15.112:0/1236728042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff53c157190 0x7ff53c1f4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:14.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.253+0000 7ff53b400640 1 -- 172.21.15.112:0/1236728042 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff53c0d04e0 con 0x7ff53c0d0970 2024-09-12T02:43:14.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.253+0000 7ff53b400640 1 --2- 172.21.15.112:0/1236728042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff53c0d0970 0x7ff53c14f480 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff528035040 tx=0x7ff5280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:14.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.254+0000 7ff533e00640 1 -- 172.21.15.112:0/1236728042 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff528041030 con 0x7ff53c0d0970 2024-09-12T02:43:14.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.254+0000 7ff533e00640 1 -- 172.21.15.112:0/1236728042 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff52803d4e0 con 0x7ff53c0d0970 2024-09-12T02:43:14.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.254+0000 7ff533e00640 1 -- 172.21.15.112:0/1236728042 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff528037040 con 0x7ff53c0d0970 2024-09-12T02:43:14.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.254+0000 7ff543200640 1 -- 172.21.15.112:0/1236728042 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff53c14ff40 con 0x7ff53c0d0970 2024-09-12T02:43:14.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.254+0000 7ff543200640 1 -- 172.21.15.112:0/1236728042 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff53c1f48a0 con 0x7ff53c0d0970 2024-09-12T02:43:14.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.255+0000 7ff543200640 1 -- 172.21.15.112:0/1236728042 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff53c15d110 con 0x7ff53c0d0970 2024-09-12T02:43:14.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.256+0000 7ff533e00640 1 -- 172.21.15.112:0/1236728042 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff528044070 con 0x7ff53c0d0970 2024-09-12T02:43:14.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.257+0000 7ff533e00640 1 --2- 172.21.15.112:0/1236728042 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff51c06be30 0x7ff51c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:14.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.257+0000 7ff533e00640 1 -- 172.21.15.112:0/1236728042 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7ff5280aaf90 con 0x7ff53c0d0970 2024-09-12T02:43:14.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.257+0000 7ff53be00640 1 --2- 172.21.15.112:0/1236728042 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff51c06be30 0x7ff51c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:14.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.258+0000 7ff53be00640 1 --2- 172.21.15.112:0/1236728042 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff51c06be30 0x7ff51c06e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff52c0011e0 tx=0x7ff52c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:14.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.261+0000 7ff533e00640 1 -- 172.21.15.112:0/1236728042 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff528079650 con 0x7ff53c0d0970 2024-09-12T02:43:14.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:14.443+0000 7ff543200640 1 -- 172.21.15.112:0/1236728042 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff53c1f4a70 con 0x7ff53c0d0970 2024-09-12T02:43:15.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.298+0000 7ff533e00640 1 -- 172.21.15.112:0/1236728042 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v42) ==== 138+0+0 (secure 0 0 0) 0x7ff52807d950 con 0x7ff53c0d0970 2024-09-12T02:43:15.299 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' created 2024-09-12T02:43:15.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.300+0000 7ff543200640 1 -- 172.21.15.112:0/1236728042 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff51c06be30 msgr2=0x7ff51c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:15.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.300+0000 7ff543200640 1 --2- 172.21.15.112:0/1236728042 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff51c06be30 0x7ff51c06e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff52c0011e0 tx=0x7ff52c009040 comp rx=0 tx=0).stop 2024-09-12T02:43:15.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.300+0000 7ff543200640 1 -- 172.21.15.112:0/1236728042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff53c0d0970 msgr2=0x7ff53c14f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:15.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.300+0000 7ff543200640 1 --2- 172.21.15.112:0/1236728042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff53c0d0970 0x7ff53c14f480 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff528035040 tx=0x7ff5280046c0 comp rx=0 tx=0).stop 2024-09-12T02:43:15.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.301+0000 7ff543200640 1 -- 172.21.15.112:0/1236728042 shutdown_connections 2024-09-12T02:43:15.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.301+0000 7ff543200640 1 --2- 172.21.15.112:0/1236728042 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff51c06be30 0x7ff51c06e2f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:15.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.301+0000 7ff543200640 1 --2- 172.21.15.112:0/1236728042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff53c157190 0x7ff53c1f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:15.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.301+0000 7ff543200640 1 --2- 172.21.15.112:0/1236728042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff53c0d0970 0x7ff53c14f480 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:15.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.301+0000 7ff543200640 1 --2- 172.21.15.112:0/1236728042 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff53c0b5190 0x7ff53c152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:15.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.301+0000 7ff543200640 1 -- 172.21.15.112:0/1236728042 >> 172.21.15.112:0/1236728042 conn(0x7ff53c0b2730 msgr2=0x7ff53c0b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:15.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.301+0000 7ff543200640 1 -- 172.21.15.112:0/1236728042 shutdown_connections 2024-09-12T02:43:15.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.301+0000 7ff543200640 1 -- 172.21.15.112:0/1236728042 wait complete. 2024-09-12T02:43:15.321 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:43:15.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.482+0000 7f27f7e00640 1 Processor -- start 2024-09-12T02:43:15.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.482+0000 7f27f7e00640 1 -- start start 2024-09-12T02:43:15.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.484+0000 7f27f7e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f27f00735b0 0x7f27f00d0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:15.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.484+0000 7f27f7e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f27f0163690 0x7f27f006e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:15.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.484+0000 7f27f7e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27f006d860 con 0x7f27f00d0940 2024-09-12T02:43:15.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.484+0000 7f27f7e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f27f0163ee0 con 0x7f27f00735b0 2024-09-12T02:43:15.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.484+0000 7f27f7e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f27f01641c0 con 0x7f27f0163690 2024-09-12T02:43:15.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.484+0000 7f27f4a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f27f00735b0 0x7f27f00d0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:15.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.484+0000 7f27f4a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f27f00735b0 0x7f27f00d0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54712/0 (socket says 172.21.15.112:54712) 2024-09-12T02:43:15.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.484+0000 7f27f4a00640 1 -- 172.21.15.112:0/4138955605 learned_addr learned my addr 172.21.15.112:0/4138955605 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:15.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.484+0000 7f27f5e00640 1 --2- 172.21.15.112:0/4138955605 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f27f0163690 0x7f27f006e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:15.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.484+0000 7f27f4a00640 1 -- 172.21.15.112:0/4138955605 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f27f0163690 msgr2=0x7f27f006e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:15.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.484+0000 7f27f4a00640 1 --2- 172.21.15.112:0/4138955605 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f27f0163690 0x7f27f006e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:15.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.484+0000 7f27f4a00640 1 -- 172.21.15.112:0/4138955605 >> v1:172.21.15.137:6789/0 conn(0x7f27f00d0940 legacy=0x7f27f01647e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:15.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.484+0000 7f27f4a00640 1 -- 172.21.15.112:0/4138955605 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f01644a0 con 0x7f27f00735b0 2024-09-12T02:43:15.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.485+0000 7f27f4a00640 1 --2- 172.21.15.112:0/4138955605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27f00735b0 0x7f27f00d0d20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009870 tx=0x7f27dc02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=171bba34de4d4bad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:15.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.486+0000 7f27efe00640 1 -- 172.21.15.112:0/4138955605 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27dc037070 con 0x7f27f00735b0 2024-09-12T02:43:15.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.486+0000 7f27efe00640 1 -- 172.21.15.112:0/4138955605 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27dc032440 con 0x7f27f00735b0 2024-09-12T02:43:15.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.486+0000 7f27efe00640 1 -- 172.21.15.112:0/4138955605 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27dc032810 con 0x7f27f00735b0 2024-09-12T02:43:15.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.486+0000 7f27f7e00640 1 -- 172.21.15.112:0/4138955605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27f00735b0 msgr2=0x7f27f00d0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:15.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.486+0000 7f27f7e00640 1 --2- 172.21.15.112:0/4138955605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27f00735b0 0x7f27f00d0d20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009870 tx=0x7f27dc02a250 comp rx=0 tx=0).stop 2024-09-12T02:43:15.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.486+0000 7f27f7e00640 1 -- 172.21.15.112:0/4138955605 shutdown_connections 2024-09-12T02:43:15.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.486+0000 7f27f7e00640 1 --2- 172.21.15.112:0/4138955605 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f27f0163690 0x7f27f006e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:15.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.486+0000 7f27f7e00640 1 --2- 172.21.15.112:0/4138955605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27f00735b0 0x7f27f00d0d20 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:15.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.486+0000 7f27f7e00640 1 -- 172.21.15.112:0/4138955605 >> 172.21.15.112:0/4138955605 conn(0x7f27f00b28a0 msgr2=0x7f27f00b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:15.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.486+0000 7f27f7e00640 1 -- 172.21.15.112:0/4138955605 shutdown_connections 2024-09-12T02:43:15.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.486+0000 7f27f7e00640 1 -- 172.21.15.112:0/4138955605 wait complete. 2024-09-12T02:43:15.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.488+0000 7f27f7e00640 1 Processor -- start 2024-09-12T02:43:15.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.488+0000 7f27f7e00640 1 -- start start 2024-09-12T02:43:15.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.489+0000 7f27f7e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f27f00735b0 0x7f27f0165530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:15.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.489+0000 7f27f7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27f00d0940 0x7f27f00ad020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:15.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.489+0000 7f27f7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27f0163690 0x7f27f00ad560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:15.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.489+0000 7f27f7e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f27f015d9a0 con 0x7f27f0163690 2024-09-12T02:43:15.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.489+0000 7f27f7e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f27f00d1260 con 0x7f27f00d0940 2024-09-12T02:43:15.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.489+0000 7f27f7e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f27f015db20 con 0x7f27f00735b0 2024-09-12T02:43:15.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.489+0000 7f27f5e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27f0163690 0x7f27f00ad560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:15.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.489+0000 7f27f5e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27f0163690 0x7f27f00ad560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54722/0 (socket says 172.21.15.112:54722) 2024-09-12T02:43:15.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.489+0000 7f27f5e00640 1 -- 172.21.15.112:0/906498169 learned_addr learned my addr 172.21.15.112:0/906498169 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:15.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.489+0000 7f27f5400640 1 --2- 172.21.15.112:0/906498169 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f27f00735b0 0x7f27f0165530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:15.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.489+0000 7f27f4a00640 1 --2- 172.21.15.112:0/906498169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27f00d0940 0x7f27f00ad020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:15.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.490+0000 7f27f5e00640 1 -- 172.21.15.112:0/906498169 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f27f00735b0 msgr2=0x7f27f0165530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:15.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.490+0000 7f27f5e00640 1 --2- 172.21.15.112:0/906498169 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f27f00735b0 0x7f27f0165530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:15.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.490+0000 7f27f5e00640 1 -- 172.21.15.112:0/906498169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27f00d0940 msgr2=0x7f27f00ad020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:15.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.490+0000 7f27f5e00640 1 --2- 172.21.15.112:0/906498169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27f00d0940 0x7f27f00ad020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:15.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.490+0000 7f27f5e00640 1 -- 172.21.15.112:0/906498169 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f0161280 con 0x7f27f0163690 2024-09-12T02:43:15.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.490+0000 7f27f5e00640 1 --2- 172.21.15.112:0/906498169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27f0163690 0x7f27f00ad560 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f27e8007e90 tx=0x7f27e800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:15.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.490+0000 7f27ed600640 1 -- 172.21.15.112:0/906498169 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e8014420 con 0x7f27f0163690 2024-09-12T02:43:15.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.490+0000 7f27ed600640 1 -- 172.21.15.112:0/906498169 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27e8019070 con 0x7f27f0163690 2024-09-12T02:43:15.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.490+0000 7f27ed600640 1 -- 172.21.15.112:0/906498169 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e8014800 con 0x7f27f0163690 2024-09-12T02:43:15.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.490+0000 7f27f7e00640 1 -- 172.21.15.112:0/906498169 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27f0161560 con 0x7f27f0163690 2024-09-12T02:43:15.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.490+0000 7f27f7e00640 1 -- 172.21.15.112:0/906498169 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27f0161b20 con 0x7f27f0163690 2024-09-12T02:43:15.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.491+0000 7f27f7e00640 1 -- 172.21.15.112:0/906498169 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27f0163ae0 con 0x7f27f0163690 2024-09-12T02:43:15.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.492+0000 7f27ed600640 1 -- 172.21.15.112:0/906498169 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f27e80149a0 con 0x7f27f0163690 2024-09-12T02:43:15.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.493+0000 7f27ed600640 1 --2- 172.21.15.112:0/906498169 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f27d006be30 0x7f27d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:15.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.493+0000 7f27ed600640 1 -- 172.21.15.112:0/906498169 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5227+0+0 (secure 0 0 0) 0x7f27e808b460 con 0x7f27f0163690 2024-09-12T02:43:15.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.493+0000 7f27f5400640 1 --2- 172.21.15.112:0/906498169 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f27d006be30 0x7f27d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:15.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.494+0000 7f27f5400640 1 --2- 172.21.15.112:0/906498169 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f27d006be30 0x7f27d006e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f27e4007fd0 tx=0x7f27e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:15.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.498+0000 7f27ed600640 1 -- 172.21.15.112:0/906498169 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f27e8059f50 con 0x7f27f0163690 2024-09-12T02:43:15.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:15.671+0000 7f27f7e00640 1 -- 172.21.15.112:0/906498169 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f27f00b2e00 con 0x7f27f0163690 2024-09-12T02:43:16.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.310+0000 7f27ed600640 1 -- 172.21.15.112:0/906498169 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v43) ==== 170+0+0 (secure 0 0 0) 0x7f27e8059850 con 0x7f27f0163690 2024-09-12T02:43:16.311 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' created 2024-09-12T02:43:16.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.315+0000 7f27f7e00640 1 -- 172.21.15.112:0/906498169 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f27d006be30 msgr2=0x7f27d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:16.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.315+0000 7f27f7e00640 1 --2- 172.21.15.112:0/906498169 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f27d006be30 0x7f27d006e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f27e4007fd0 tx=0x7f27e4009040 comp rx=0 tx=0).stop 2024-09-12T02:43:16.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.315+0000 7f27f7e00640 1 -- 172.21.15.112:0/906498169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27f0163690 msgr2=0x7f27f00ad560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:16.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.315+0000 7f27f7e00640 1 --2- 172.21.15.112:0/906498169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27f0163690 0x7f27f00ad560 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f27e8007e90 tx=0x7f27e800e4b0 comp rx=0 tx=0).stop 2024-09-12T02:43:16.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.315+0000 7f27f7e00640 1 -- 172.21.15.112:0/906498169 shutdown_connections 2024-09-12T02:43:16.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.315+0000 7f27f7e00640 1 --2- 172.21.15.112:0/906498169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27f0163690 0x7f27f00ad560 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:16.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.315+0000 7f27f7e00640 1 --2- 172.21.15.112:0/906498169 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f27d006be30 0x7f27d006e2f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:16.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.315+0000 7f27f7e00640 1 --2- 172.21.15.112:0/906498169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27f00d0940 0x7f27f00ad020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:16.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.315+0000 7f27f7e00640 1 --2- 172.21.15.112:0/906498169 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f27f00735b0 0x7f27f0165530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:16.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.315+0000 7f27f7e00640 1 -- 172.21.15.112:0/906498169 >> 172.21.15.112:0/906498169 conn(0x7f27f00b28a0 msgr2=0x7f27f00b0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:16.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.317+0000 7f27f7e00640 1 -- 172.21.15.112:0/906498169 shutdown_connections 2024-09-12T02:43:16.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.317+0000 7f27f7e00640 1 -- 172.21.15.112:0/906498169 wait complete. 2024-09-12T02:43:16.342 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T02:43:16.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.499+0000 7f55c5800640 1 Processor -- start 2024-09-12T02:43:16.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.500+0000 7f55c5800640 1 -- start start 2024-09-12T02:43:16.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.501+0000 7f55c5800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f55c00d0370 0x7f55c00b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:16.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.501+0000 7f55c5800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f55c00d57e0 0x7f55c00b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:16.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.501+0000 7f55c5800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55c01627a0 con 0x7f55c01623c0 2024-09-12T02:43:16.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.501+0000 7f55c5800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f55c00d08e0 con 0x7f55c00d0370 2024-09-12T02:43:16.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.501+0000 7f55c5800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f55c00d0bc0 con 0x7f55c00d57e0 2024-09-12T02:43:16.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.501+0000 7f55b7400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f55c00d0370 0x7f55c00b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:16.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.501+0000 7f55bfe00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f55c01623c0 0x7f55c00d3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36042/0 (socket says 172.21.15.112:36042) 2024-09-12T02:43:16.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.501+0000 7f55bfe00640 1 -- 172.21.15.112:0/102005291 learned_addr learned my addr 172.21.15.112:0/102005291 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:16.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.501+0000 7f55c4e00640 1 --2- 172.21.15.112:0/102005291 >> v2:172.21.15.137:3300/0 conn(0x7f55c00d57e0 0x7f55c00b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:16.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.501+0000 7f55b7400640 1 -- 172.21.15.112:0/102005291 >> v2:172.21.15.137:3300/0 conn(0x7f55c00d57e0 msgr2=0x7f55c00b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:16.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.501+0000 7f55b7400640 1 --2- 172.21.15.112:0/102005291 >> v2:172.21.15.137:3300/0 conn(0x7f55c00d57e0 0x7f55c00b4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:16.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.501+0000 7f55b7400640 1 -- 172.21.15.112:0/102005291 >> v1:172.21.15.112:6789/0 conn(0x7f55c01623c0 legacy=0x7f55c00d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:16.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.501+0000 7f55bf400640 1 -- 172.21.15.112:0/102005291 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 399204339 0 0) 0x7f55c01627a0 con 0x7f55c01623c0 2024-09-12T02:43:16.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.501+0000 7f55b7400640 1 -- 172.21.15.112:0/102005291 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55c00d2930 con 0x7f55c00d0370 2024-09-12T02:43:16.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.501+0000 7f55c4e00640 1 --2- 172.21.15.112:0/102005291 >> v2:172.21.15.137:3300/0 conn(0x7f55c00d57e0 0x7f55c00b4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:43:16.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.502+0000 7f55b7400640 1 --2- 172.21.15.112:0/102005291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55c00d0370 0x7f55c00b4620 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f55c008dd50 tx=0x7f55a802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3bcbf100a597f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:16.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.503+0000 7f55bf400640 1 -- 172.21.15.112:0/102005291 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a8037070 con 0x7f55c00d0370 2024-09-12T02:43:16.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.503+0000 7f55bf400640 1 -- 172.21.15.112:0/102005291 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a8032440 con 0x7f55c00d0370 2024-09-12T02:43:16.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.503+0000 7f55bf400640 1 -- 172.21.15.112:0/102005291 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a8032810 con 0x7f55c00d0370 2024-09-12T02:43:16.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.503+0000 7f55c5800640 1 -- 172.21.15.112:0/102005291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55c00d0370 msgr2=0x7f55c00b4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:16.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.503+0000 7f55c5800640 1 --2- 172.21.15.112:0/102005291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55c00d0370 0x7f55c00b4620 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f55c008dd50 tx=0x7f55a802a230 comp rx=0 tx=0).stop 2024-09-12T02:43:16.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.503+0000 7f55c5800640 1 -- 172.21.15.112:0/102005291 shutdown_connections 2024-09-12T02:43:16.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.503+0000 7f55c5800640 1 --2- 172.21.15.112:0/102005291 >> v2:172.21.15.137:3300/0 conn(0x7f55c00d57e0 0x7f55c00b4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:16.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.503+0000 7f55c5800640 1 --2- 172.21.15.112:0/102005291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55c00d0370 0x7f55c00b4620 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:16.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.503+0000 7f55c5800640 1 -- 172.21.15.112:0/102005291 >> 172.21.15.112:0/102005291 conn(0x7f55c00d4cc0 msgr2=0x7f55c00d50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:16.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.503+0000 7f55c5800640 1 -- 172.21.15.112:0/102005291 shutdown_connections 2024-09-12T02:43:16.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.503+0000 7f55c5800640 1 -- 172.21.15.112:0/102005291 wait complete. 2024-09-12T02:43:16.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.505+0000 7f55c5800640 1 Processor -- start 2024-09-12T02:43:16.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.505+0000 7f55c5800640 1 -- start start 2024-09-12T02:43:16.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.506+0000 7f55c5800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55c00d0370 0x7f55c0154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:16.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.506+0000 7f55c5800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55c00d57e0 0x7f55c0161020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.506+0000 7f55c5800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55c01623c0 0x7f55c0161560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.506+0000 7f55c5800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f55c00b6460 con 0x7f55c00d57e0 2024-09-12T02:43:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.506+0000 7f55c5800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f55c00d2ef0 con 0x7f55c01623c0 2024-09-12T02:43:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.506+0000 7f55c5800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f55c00b65e0 con 0x7f55c00d0370 2024-09-12T02:43:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.506+0000 7f55b7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55c00d57e0 0x7f55c0161020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.506+0000 7f55b7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55c00d57e0 0x7f55c0161020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54738/0 (socket says 172.21.15.112:54738) 2024-09-12T02:43:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.506+0000 7f55b7400640 1 -- 172.21.15.112:0/2658630274 learned_addr learned my addr 172.21.15.112:0/2658630274 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.506+0000 7f55c4e00640 1 --2- 172.21.15.112:0/2658630274 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55c01623c0 0x7f55c0161560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.506+0000 7f55bfe00640 1 --2- 172.21.15.112:0/2658630274 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55c00d0370 0x7f55c0154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.506+0000 7f55b7400640 1 -- 172.21.15.112:0/2658630274 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55c00d0370 msgr2=0x7f55c0154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.506+0000 7f55b7400640 1 --2- 172.21.15.112:0/2658630274 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55c00d0370 0x7f55c0154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.507+0000 7f55b7400640 1 -- 172.21.15.112:0/2658630274 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55c01623c0 msgr2=0x7f55c0161560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.507+0000 7f55b7400640 1 --2- 172.21.15.112:0/2658630274 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55c01623c0 0x7f55c0161560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:16.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.507+0000 7f55b7400640 1 -- 172.21.15.112:0/2658630274 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55c01f8a80 con 0x7f55c00d57e0 2024-09-12T02:43:16.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.507+0000 7f55b7400640 1 --2- 172.21.15.112:0/2658630274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55c00d57e0 0x7f55c0161020 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f55a8009890 tx=0x7f55a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:16.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.507+0000 7f55bcc00640 1 -- 172.21.15.112:0/2658630274 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a8037040 con 0x7f55c00d57e0 2024-09-12T02:43:16.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.507+0000 7f55bcc00640 1 -- 172.21.15.112:0/2658630274 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a8042070 con 0x7f55c00d57e0 2024-09-12T02:43:16.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.507+0000 7f55bcc00640 1 -- 172.21.15.112:0/2658630274 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a8030a50 con 0x7f55c00d57e0 2024-09-12T02:43:16.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.507+0000 7f55c5800640 1 -- 172.21.15.112:0/2658630274 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55c0161b90 con 0x7f55c00d57e0 2024-09-12T02:43:16.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.507+0000 7f55c5800640 1 -- 172.21.15.112:0/2658630274 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55c015fd30 con 0x7f55c00d57e0 2024-09-12T02:43:16.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.508+0000 7f55c5800640 1 -- 172.21.15.112:0/2658630274 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55c008e7c0 con 0x7f55c00d57e0 2024-09-12T02:43:16.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.509+0000 7f55bcc00640 1 -- 172.21.15.112:0/2658630274 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f55a8030bf0 con 0x7f55c00d57e0 2024-09-12T02:43:16.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.510+0000 7f55bcc00640 1 --2- 172.21.15.112:0/2658630274 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f559c06be30 0x7f559c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:16.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.510+0000 7f55bcc00640 1 -- 172.21.15.112:0/2658630274 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5609+0+0 (secure 0 0 0) 0x7f55a80ab860 con 0x7f55c00d57e0 2024-09-12T02:43:16.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.510+0000 7f55bfe00640 1 --2- 172.21.15.112:0/2658630274 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f559c06be30 0x7f559c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:16.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.511+0000 7f55bfe00640 1 --2- 172.21.15.112:0/2658630274 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f559c06be30 0x7f559c06e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f55b0000f60 tx=0x7f55b0007b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:16.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.515+0000 7f55bcc00640 1 -- 172.21.15.112:0/2658630274 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f55a8045360 con 0x7f55c00d57e0 2024-09-12T02:43:16.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:16.721+0000 7f55c5800640 1 -- 172.21.15.112:0/2658630274 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f55c0068440 con 0x7f55c00d57e0 2024-09-12T02:43:17.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.324+0000 7f55bcc00640 1 -- 172.21.15.112:0/2658630274 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v23) ==== 172+0+0 (secure 0 0 0) 0x7f55a807a260 con 0x7f55c00d57e0 2024-09-12T02:43:17.329 INFO:teuthology.orchestra.run.smithi112.stderr:new fs with metadata pool 6 and data pool 7 2024-09-12T02:43:17.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.331+0000 7f55c5800640 1 -- 172.21.15.112:0/2658630274 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f559c06be30 msgr2=0x7f559c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:17.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.331+0000 7f55c5800640 1 --2- 172.21.15.112:0/2658630274 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f559c06be30 0x7f559c06e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f55b0000f60 tx=0x7f55b0007b50 comp rx=0 tx=0).stop 2024-09-12T02:43:17.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.331+0000 7f55c5800640 1 -- 172.21.15.112:0/2658630274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55c00d57e0 msgr2=0x7f55c0161020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:17.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.331+0000 7f55c5800640 1 --2- 172.21.15.112:0/2658630274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55c00d57e0 0x7f55c0161020 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f55a8009890 tx=0x7f55a80046c0 comp rx=0 tx=0).stop 2024-09-12T02:43:17.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.331+0000 7f55c5800640 1 -- 172.21.15.112:0/2658630274 shutdown_connections 2024-09-12T02:43:17.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.331+0000 7f55c5800640 1 --2- 172.21.15.112:0/2658630274 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f559c06be30 0x7f559c06e2f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:17.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.331+0000 7f55c5800640 1 --2- 172.21.15.112:0/2658630274 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55c01623c0 0x7f55c0161560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:17.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.331+0000 7f55c5800640 1 --2- 172.21.15.112:0/2658630274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55c00d57e0 0x7f55c0161020 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:17.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.331+0000 7f55c5800640 1 --2- 172.21.15.112:0/2658630274 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55c00d0370 0x7f55c0154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:17.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.331+0000 7f55c5800640 1 -- 172.21.15.112:0/2658630274 >> 172.21.15.112:0/2658630274 conn(0x7f55c00d4cc0 msgr2=0x7f55c01632e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:17.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.331+0000 7f55c5800640 1 -- 172.21.15.112:0/2658630274 shutdown_connections 2024-09-12T02:43:17.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.331+0000 7f55c5800640 1 -- 172.21.15.112:0/2658630274 wait complete. 2024-09-12T02:43:17.351 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:43:17.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.503+0000 7f8b85600640 1 Processor -- start 2024-09-12T02:43:17.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.503+0000 7f8b85600640 1 -- start start 2024-09-12T02:43:17.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.504+0000 7f8b85600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8b8015cc50 0x7f8b800732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:17.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.505+0000 7f8b85600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8b800afe30 0x7f8b800cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:17.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.505+0000 7f8b85600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b80073830 con 0x7f8b80071530 2024-09-12T02:43:17.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.505+0000 7f8b85600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8b8015d030 con 0x7f8b800afe30 2024-09-12T02:43:17.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.505+0000 7f8b85600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8b800cf4c0 con 0x7f8b8015cc50 2024-09-12T02:43:17.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.505+0000 7f8b7f400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8b800afe30 0x7f8b800cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:17.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.505+0000 7f8b76000640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8b80071530 0x7f8b800af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36052/0 (socket says 172.21.15.112:36052) 2024-09-12T02:43:17.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.505+0000 7f8b76000640 1 -- 172.21.15.112:0/3072353116 learned_addr learned my addr 172.21.15.112:0/3072353116 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:17.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.505+0000 7f8b7ea00640 1 --2- 172.21.15.112:0/3072353116 >> v2:172.21.15.137:3300/0 conn(0x7f8b8015cc50 0x7f8b800732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:17.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.505+0000 7f8b7f400640 1 -- 172.21.15.112:0/3072353116 >> v2:172.21.15.137:3300/0 conn(0x7f8b8015cc50 msgr2=0x7f8b800732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:17.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.505+0000 7f8b7f400640 1 --2- 172.21.15.112:0/3072353116 >> v2:172.21.15.137:3300/0 conn(0x7f8b8015cc50 0x7f8b800732f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:17.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.505+0000 7f8b7f400640 1 -- 172.21.15.112:0/3072353116 >> v1:172.21.15.112:6789/0 conn(0x7f8b80071530 legacy=0x7f8b800af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:17.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.505+0000 7f8b7f400640 1 -- 172.21.15.112:0/3072353116 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b800ceeb0 con 0x7f8b800afe30 2024-09-12T02:43:17.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.505+0000 7f8b7e000640 1 -- 172.21.15.112:0/3072353116 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2113210940 0 0) 0x7f8b68001290 con 0x7f8b80071530 2024-09-12T02:43:17.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.506+0000 7f8b7f400640 1 --2- 172.21.15.112:0/3072353116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b800afe30 0x7f8b800cf950 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8b80070060 tx=0x7f8b7802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4677b1a91e8424bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:17.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.507+0000 7f8b7e000640 1 -- 172.21.15.112:0/3072353116 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b78007740 con 0x7f8b800afe30 2024-09-12T02:43:17.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.507+0000 7f8b7e000640 1 -- 172.21.15.112:0/3072353116 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b780078e0 con 0x7f8b800afe30 2024-09-12T02:43:17.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.507+0000 7f8b7e000640 1 -- 172.21.15.112:0/3072353116 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b78007cb0 con 0x7f8b800afe30 2024-09-12T02:43:17.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.507+0000 7f8b85600640 1 -- 172.21.15.112:0/3072353116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b800afe30 msgr2=0x7f8b800cf950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:17.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.507+0000 7f8b85600640 1 --2- 172.21.15.112:0/3072353116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b800afe30 0x7f8b800cf950 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8b80070060 tx=0x7f8b7802a5f0 comp rx=0 tx=0).stop 2024-09-12T02:43:17.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.507+0000 7f8b85600640 1 -- 172.21.15.112:0/3072353116 shutdown_connections 2024-09-12T02:43:17.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.507+0000 7f8b85600640 1 --2- 172.21.15.112:0/3072353116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b800afe30 0x7f8b800cf950 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:17.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.507+0000 7f8b85600640 1 --2- 172.21.15.112:0/3072353116 >> v2:172.21.15.137:3300/0 conn(0x7f8b8015cc50 0x7f8b800732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:17.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.507+0000 7f8b85600640 1 -- 172.21.15.112:0/3072353116 >> 172.21.15.112:0/3072353116 conn(0x7f8b8006bbd0 msgr2=0x7f8b8006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:17.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.507+0000 7f8b85600640 1 -- 172.21.15.112:0/3072353116 shutdown_connections 2024-09-12T02:43:17.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.507+0000 7f8b85600640 1 -- 172.21.15.112:0/3072353116 wait complete. 2024-09-12T02:43:17.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.509+0000 7f8b85600640 1 Processor -- start 2024-09-12T02:43:17.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.509+0000 7f8b85600640 1 -- start start 2024-09-12T02:43:17.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.510+0000 7f8b85600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b80071530 0x7f8b8013b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:17.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.510+0000 7f8b85600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b800afe30 0x7f8b8015b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:17.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.510+0000 7f8b85600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8b8015cc50 0x7f8b801f85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:17.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.510+0000 7f8b85600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8b800cf150 con 0x7f8b800afe30 2024-09-12T02:43:17.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.510+0000 7f8b85600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8006e5e0 con 0x7f8b80071530 2024-09-12T02:43:17.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.510+0000 7f8b85600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8b8006f510 con 0x7f8b8015cc50 2024-09-12T02:43:17.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.510+0000 7f8b76000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b800afe30 0x7f8b8015b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:17.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.510+0000 7f8b76000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b800afe30 0x7f8b8015b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54750/0 (socket says 172.21.15.112:54750) 2024-09-12T02:43:17.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.510+0000 7f8b76000640 1 -- 172.21.15.112:0/3914555690 learned_addr learned my addr 172.21.15.112:0/3914555690 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:17.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.511+0000 7f8b7ea00640 1 --2- 172.21.15.112:0/3914555690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b80071530 0x7f8b8013b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:17.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.511+0000 7f8b7f400640 1 --2- 172.21.15.112:0/3914555690 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8b8015cc50 0x7f8b801f85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:17.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.511+0000 7f8b76000640 1 -- 172.21.15.112:0/3914555690 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8b8015cc50 msgr2=0x7f8b801f85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:17.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.511+0000 7f8b76000640 1 --2- 172.21.15.112:0/3914555690 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8b8015cc50 0x7f8b801f85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:17.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.511+0000 7f8b76000640 1 -- 172.21.15.112:0/3914555690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b80071530 msgr2=0x7f8b8013b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:17.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.511+0000 7f8b76000640 1 --2- 172.21.15.112:0/3914555690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b80071530 0x7f8b8013b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:17.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.511+0000 7f8b76000640 1 -- 172.21.15.112:0/3914555690 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b8015c270 con 0x7f8b800afe30 2024-09-12T02:43:17.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.511+0000 7f8b7f400640 1 --2- 172.21.15.112:0/3914555690 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8b8015cc50 0x7f8b801f85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:43:17.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.511+0000 7f8b76000640 1 --2- 172.21.15.112:0/3914555690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b800afe30 0x7f8b8015b9b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8b6800c4d0 tx=0x7f8b6800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:17.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.511+0000 7f8b77400640 1 -- 172.21.15.112:0/3914555690 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b68007480 con 0x7f8b800afe30 2024-09-12T02:43:17.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.511+0000 7f8b77400640 1 -- 172.21.15.112:0/3914555690 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b68007620 con 0x7f8b800afe30 2024-09-12T02:43:17.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.511+0000 7f8b85600640 1 -- 172.21.15.112:0/3914555690 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b80155a40 con 0x7f8b800afe30 2024-09-12T02:43:17.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.511+0000 7f8b77400640 1 -- 172.21.15.112:0/3914555690 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b680059c0 con 0x7f8b800afe30 2024-09-12T02:43:17.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.512+0000 7f8b85600640 1 -- 172.21.15.112:0/3914555690 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b80156000 con 0x7f8b800afe30 2024-09-12T02:43:17.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.513+0000 7f8b85600640 1 -- 172.21.15.112:0/3914555690 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b80068a30 con 0x7f8b800afe30 2024-09-12T02:43:17.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.514+0000 7f8b77400640 1 -- 172.21.15.112:0/3914555690 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8b68005b60 con 0x7f8b800afe30 2024-09-12T02:43:17.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.514+0000 7f8b77400640 1 --2- 172.21.15.112:0/3914555690 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8b5c06be30 0x7f8b5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:17.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.515+0000 7f8b77400640 1 -- 172.21.15.112:0/3914555690 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f8b6808aaa0 con 0x7f8b800afe30 2024-09-12T02:43:17.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.515+0000 7f8b7ea00640 1 --2- 172.21.15.112:0/3914555690 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8b5c06be30 0x7f8b5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:17.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.515+0000 7f8b7ea00640 1 --2- 172.21.15.112:0/3914555690 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8b5c06be30 0x7f8b5c06e2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8b70009aa0 tx=0x7f8b70009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:17.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.519+0000 7f8b77400640 1 -- 172.21.15.112:0/3914555690 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8b80073830 con 0x7f8b800afe30 2024-09-12T02:43:17.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.694+0000 7f8b85600640 1 -- 172.21.15.112:0/3914555690 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8b8006df60 con 0x7f8b800afe30 2024-09-12T02:43:17.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.695+0000 7f8b77400640 1 -- 172.21.15.112:0/3914555690 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+16734 (secure 0 0 0) 0x7f8b68059450 con 0x7f8b800afe30 2024-09-12T02:43:17.696 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:17.697 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":44,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:43:16.722621+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:43:14.483471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-12T02:43:15.711619+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:43:17.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.697+0000 7f8b85600640 1 -- 172.21.15.112:0/3914555690 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8b5c06be30 msgr2=0x7f8b5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:17.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.697+0000 7f8b85600640 1 --2- 172.21.15.112:0/3914555690 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8b5c06be30 0x7f8b5c06e2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8b70009aa0 tx=0x7f8b70009190 comp rx=0 tx=0).stop 2024-09-12T02:43:17.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.697+0000 7f8b85600640 1 -- 172.21.15.112:0/3914555690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b800afe30 msgr2=0x7f8b8015b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:17.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.697+0000 7f8b85600640 1 --2- 172.21.15.112:0/3914555690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b800afe30 0x7f8b8015b9b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8b6800c4d0 tx=0x7f8b6800c990 comp rx=0 tx=0).stop 2024-09-12T02:43:17.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.698+0000 7f8b85600640 1 -- 172.21.15.112:0/3914555690 shutdown_connections 2024-09-12T02:43:17.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.698+0000 7f8b85600640 1 --2- 172.21.15.112:0/3914555690 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8b8015cc50 0x7f8b801f85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:17.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.698+0000 7f8b85600640 1 --2- 172.21.15.112:0/3914555690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b800afe30 0x7f8b8015b9b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:17.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.698+0000 7f8b85600640 1 --2- 172.21.15.112:0/3914555690 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8b5c06be30 0x7f8b5c06e2f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:17.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.698+0000 7f8b85600640 1 --2- 172.21.15.112:0/3914555690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b80071530 0x7f8b8013b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:17.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.698+0000 7f8b85600640 1 -- 172.21.15.112:0/3914555690 >> 172.21.15.112:0/3914555690 conn(0x7f8b8006bbd0 msgr2=0x7f8b8006e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:17.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.698+0000 7f8b85600640 1 -- 172.21.15.112:0/3914555690 shutdown_connections 2024-09-12T02:43:17.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.698+0000 7f8b85600640 1 -- 172.21.15.112:0/3914555690 wait complete. 2024-09-12T02:43:17.714 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:43:17.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.865+0000 7f72f0800640 1 Processor -- start 2024-09-12T02:43:17.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.865+0000 7f72f0800640 1 -- start start 2024-09-12T02:43:17.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.867+0000 7f72f0800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f72e80b4ec0 0x7f72e80b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:17.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.867+0000 7f72f0800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72e80b54a0 con 0x7f72e815b9d0 2024-09-12T02:43:17.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.867+0000 7f72f0800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72e80b3af0 con 0x7f72e806f600 2024-09-12T02:43:17.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.867+0000 7f72f0800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f72e80b3dd0 con 0x7f72e80b4ec0 2024-09-12T02:43:17.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.867+0000 7f72ee800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f72e80b4ec0 0x7f72e80b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:17.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.867+0000 7f72ede00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f72e815b9d0 0x7f72e806eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36064/0 (socket says 172.21.15.112:36064) 2024-09-12T02:43:17.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.867+0000 7f72ede00640 1 -- 172.21.15.112:0/2341566590 learned_addr learned my addr 172.21.15.112:0/2341566590 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:17.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.867+0000 7f72ee800640 1 -- 172.21.15.112:0/2341566590 >> v1:172.21.15.137:6789/0 conn(0x7f72e806f600 legacy=0x7f72e80cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:17.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.867+0000 7f72ee800640 1 -- 172.21.15.112:0/2341566590 >> v1:172.21.15.112:6789/0 conn(0x7f72e815b9d0 legacy=0x7f72e806eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:17.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.867+0000 7f72ee800640 1 -- 172.21.15.112:0/2341566590 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e80b40b0 con 0x7f72e80b4ec0 2024-09-12T02:43:17.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.868+0000 7f72ee800640 1 --2- 172.21.15.112:0/2341566590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72e80b4ec0 0x7f72e80b45d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f72e4009d90 tx=0x7f72e402c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=348e69409107275a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:17.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.869+0000 7f72eca00640 1 -- 172.21.15.112:0/2341566590 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e4032770 con 0x7f72e80b4ec0 2024-09-12T02:43:17.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.869+0000 7f72eca00640 1 -- 172.21.15.112:0/2341566590 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e4038070 con 0x7f72e80b4ec0 2024-09-12T02:43:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.869+0000 7f72eca00640 1 -- 172.21.15.112:0/2341566590 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e4032b30 con 0x7f72e80b4ec0 2024-09-12T02:43:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.869+0000 7f72f0800640 1 -- 172.21.15.112:0/2341566590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72e80b4ec0 msgr2=0x7f72e80b45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.869+0000 7f72f0800640 1 --2- 172.21.15.112:0/2341566590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72e80b4ec0 0x7f72e80b45d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f72e4009d90 tx=0x7f72e402c870 comp rx=0 tx=0).stop 2024-09-12T02:43:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.869+0000 7f72f0800640 1 -- 172.21.15.112:0/2341566590 shutdown_connections 2024-09-12T02:43:17.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.869+0000 7f72f0800640 1 --2- 172.21.15.112:0/2341566590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72e80b4ec0 0x7f72e80b45d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:17.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.869+0000 7f72f0800640 1 -- 172.21.15.112:0/2341566590 >> 172.21.15.112:0/2341566590 conn(0x7f72e806bbd0 msgr2=0x7f72e806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:17.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.869+0000 7f72f0800640 1 -- 172.21.15.112:0/2341566590 shutdown_connections 2024-09-12T02:43:17.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.869+0000 7f72f0800640 1 -- 172.21.15.112:0/2341566590 wait complete. 2024-09-12T02:43:17.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.871+0000 7f72f0800640 1 Processor -- start 2024-09-12T02:43:17.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.871+0000 7f72f0800640 1 -- start start 2024-09-12T02:43:17.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.872+0000 7f72f0800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72e806f600 0x7f72e80ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:17.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.872+0000 7f72f0800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72e80b4ec0 0x7f72e81f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:17.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.872+0000 7f72f0800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72e815b9d0 0x7f72e81f4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:17.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.872+0000 7f72f0800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f72e8072a40 con 0x7f72e815b9d0 2024-09-12T02:43:17.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.872+0000 7f72f0800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f72e80728c0 con 0x7f72e80b4ec0 2024-09-12T02:43:17.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.872+0000 7f72f0800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f72e8072bc0 con 0x7f72e806f600 2024-09-12T02:43:17.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.872+0000 7f72ee800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72e815b9d0 0x7f72e81f4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:17.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.872+0000 7f72ee800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72e815b9d0 0x7f72e81f4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54762/0 (socket says 172.21.15.112:54762) 2024-09-12T02:43:17.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.872+0000 7f72ee800640 1 -- 172.21.15.112:0/92902579 learned_addr learned my addr 172.21.15.112:0/92902579 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:17.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.872+0000 7f72ed400640 1 --2- 172.21.15.112:0/92902579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72e80b4ec0 0x7f72e81f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:17.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.873+0000 7f72ede00640 1 --2- 172.21.15.112:0/92902579 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72e806f600 0x7f72e80ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:17.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.873+0000 7f72ee800640 1 -- 172.21.15.112:0/92902579 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72e806f600 msgr2=0x7f72e80ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:17.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.873+0000 7f72ee800640 1 --2- 172.21.15.112:0/92902579 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72e806f600 0x7f72e80ccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:17.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.873+0000 7f72ee800640 1 -- 172.21.15.112:0/92902579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72e80b4ec0 msgr2=0x7f72e81f4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:17.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.873+0000 7f72ee800640 1 --2- 172.21.15.112:0/92902579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72e80b4ec0 0x7f72e81f4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:17.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.873+0000 7f72ee800640 1 -- 172.21.15.112:0/92902579 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e815c530 con 0x7f72e815b9d0 2024-09-12T02:43:17.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.873+0000 7f72ee800640 1 --2- 172.21.15.112:0/92902579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72e815b9d0 0x7f72e81f4aa0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f72e4009d90 tx=0x7f72e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:17.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.873+0000 7f72e2000640 1 -- 172.21.15.112:0/92902579 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e4033810 con 0x7f72e815b9d0 2024-09-12T02:43:17.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.873+0000 7f72e2000640 1 -- 172.21.15.112:0/92902579 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e4032e50 con 0x7f72e815b9d0 2024-09-12T02:43:17.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.873+0000 7f72e2000640 1 -- 172.21.15.112:0/92902579 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e4033c10 con 0x7f72e815b9d0 2024-09-12T02:43:17.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.873+0000 7f72f0800640 1 -- 172.21.15.112:0/92902579 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72e8159b50 con 0x7f72e815b9d0 2024-09-12T02:43:17.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.874+0000 7f72f0800640 1 -- 172.21.15.112:0/92902579 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72e815a110 con 0x7f72e815b9d0 2024-09-12T02:43:17.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.875+0000 7f72f0800640 1 -- 172.21.15.112:0/92902579 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72e8068a30 con 0x7f72e815b9d0 2024-09-12T02:43:17.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.876+0000 7f72e2000640 1 -- 172.21.15.112:0/92902579 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f72e4005d10 con 0x7f72e815b9d0 2024-09-12T02:43:17.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.877+0000 7f72e2000640 1 --2- 172.21.15.112:0/92902579 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f72cc06be30 0x7f72cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:17.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.877+0000 7f72e2000640 1 -- 172.21.15.112:0/92902579 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f72e40ae0b0 con 0x7f72e815b9d0 2024-09-12T02:43:17.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.877+0000 7f72ede00640 1 --2- 172.21.15.112:0/92902579 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f72cc06be30 0x7f72cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:17.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.878+0000 7f72ede00640 1 --2- 172.21.15.112:0/92902579 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f72cc06be30 0x7f72cc06e2f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f72dc005880 tx=0x7f72dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:17.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:17.880+0000 7f72e2000640 1 -- 172.21.15.112:0/92902579 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f72e4042070 con 0x7f72e815b9d0 2024-09-12T02:43:18.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.055+0000 7f72f0800640 1 -- 172.21.15.112:0/92902579 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72e80b45d0 con 0x7f72e815b9d0 2024-09-12T02:43:18.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.057+0000 7f72e2000640 1 -- 172.21.15.112:0/92902579 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+16734 (secure 0 0 0) 0x7f72e407cb00 con 0x7f72e815b9d0 2024-09-12T02:43:18.058 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:18.058 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":44,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:43:16.722621+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:43:14.483471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-12T02:43:15.711619+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:43:18.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.059+0000 7f72f0800640 1 -- 172.21.15.112:0/92902579 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f72cc06be30 msgr2=0x7f72cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:18.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.059+0000 7f72f0800640 1 --2- 172.21.15.112:0/92902579 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f72cc06be30 0x7f72cc06e2f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f72dc005880 tx=0x7f72dc009040 comp rx=0 tx=0).stop 2024-09-12T02:43:18.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.059+0000 7f72f0800640 1 -- 172.21.15.112:0/92902579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72e815b9d0 msgr2=0x7f72e81f4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:18.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.059+0000 7f72f0800640 1 --2- 172.21.15.112:0/92902579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72e815b9d0 0x7f72e81f4aa0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f72e4009d90 tx=0x7f72e4004a40 comp rx=0 tx=0).stop 2024-09-12T02:43:18.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.059+0000 7f72f0800640 1 -- 172.21.15.112:0/92902579 shutdown_connections 2024-09-12T02:43:18.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.059+0000 7f72f0800640 1 --2- 172.21.15.112:0/92902579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72e815b9d0 0x7f72e81f4aa0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:18.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.059+0000 7f72f0800640 1 --2- 172.21.15.112:0/92902579 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f72cc06be30 0x7f72cc06e2f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:18.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.059+0000 7f72f0800640 1 --2- 172.21.15.112:0/92902579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72e80b4ec0 0x7f72e81f4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:18.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.059+0000 7f72f0800640 1 --2- 172.21.15.112:0/92902579 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72e806f600 0x7f72e80ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:18.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.059+0000 7f72f0800640 1 -- 172.21.15.112:0/92902579 >> 172.21.15.112:0/92902579 conn(0x7f72e806bbd0 msgr2=0x7f72e80ceb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:18.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.060+0000 7f72f0800640 1 -- 172.21.15.112:0/92902579 shutdown_connections 2024-09-12T02:43:18.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.060+0000 7f72f0800640 1 -- 172.21.15.112:0/92902579 wait complete. 2024-09-12T02:43:18.076 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T02:43:18.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.232+0000 7f8685000640 1 Processor -- start 2024-09-12T02:43:18.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.232+0000 7f8685000640 1 -- start start 2024-09-12T02:43:18.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.233+0000 7f8685000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f86800b3e00 0x7f86800d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:18.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.233+0000 7f8685000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86800b1d70 0x7f86800b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:18.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.233+0000 7f8685000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86800d2fb0 con 0x7f86800d1710 2024-09-12T02:43:18.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.233+0000 7f8685000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f86800d3cb0 con 0x7f86800b3e00 2024-09-12T02:43:18.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.233+0000 7f8685000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f86800d0b60 con 0x7f86800b1d70 2024-09-12T02:43:18.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.233+0000 7f867f400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f86800d1710 0x7f86800d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36074/0 (socket says 172.21.15.112:36074) 2024-09-12T02:43:18.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.233+0000 7f867f400640 1 -- 172.21.15.112:0/3867992605 learned_addr learned my addr 172.21.15.112:0/3867992605 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:18.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.233+0000 7f867ea00640 1 --2- 172.21.15.112:0/3867992605 >> v2:172.21.15.112:3300/0 conn(0x7f86800b3e00 0x7f86800d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:18.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.234+0000 7f867fe00640 1 --2- 172.21.15.112:0/3867992605 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86800b1d70 0x7f86800b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:18.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.234+0000 7f867e000640 1 -- 172.21.15.112:0/3867992605 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1414174451 0 0) 0x7f86800d2fb0 con 0x7f86800d1710 2024-09-12T02:43:18.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.234+0000 7f867e000640 1 -- 172.21.15.112:0/3867992605 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8664003520 con 0x7f86800d1710 2024-09-12T02:43:18.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.234+0000 7f867ea00640 1 -- 172.21.15.112:0/3867992605 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86800b1d70 msgr2=0x7f86800b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:18.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.234+0000 7f867ea00640 1 --2- 172.21.15.112:0/3867992605 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86800b1d70 0x7f86800b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:18.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.234+0000 7f867ea00640 1 -- 172.21.15.112:0/3867992605 >> v1:172.21.15.112:6789/0 conn(0x7f86800d1710 legacy=0x7f86800d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:18.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.234+0000 7f867ea00640 1 -- 172.21.15.112:0/3867992605 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86800d3410 con 0x7f86800b3e00 2024-09-12T02:43:18.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.234+0000 7f867fe00640 1 --2- 172.21.15.112:0/3867992605 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86800b1d70 0x7f86800b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:43:18.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.235+0000 7f867ea00640 1 --2- 172.21.15.112:0/3867992605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86800b3e00 0x7f86800d28d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f866c0097a0 tx=0x7f866c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=345bb61d10b43463 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:18.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.235+0000 7f867e000640 1 -- 172.21.15.112:0/3867992605 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c037070 con 0x7f86800b3e00 2024-09-12T02:43:18.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.235+0000 7f867e000640 1 -- 172.21.15.112:0/3867992605 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f866c032440 con 0x7f86800b3e00 2024-09-12T02:43:18.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.235+0000 7f867e000640 1 -- 172.21.15.112:0/3867992605 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c032810 con 0x7f86800b3e00 2024-09-12T02:43:18.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.236+0000 7f8685000640 1 -- 172.21.15.112:0/3867992605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86800b3e00 msgr2=0x7f86800d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:18.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.236+0000 7f8685000640 1 --2- 172.21.15.112:0/3867992605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86800b3e00 0x7f86800d28d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f866c0097a0 tx=0x7f866c02a180 comp rx=0 tx=0).stop 2024-09-12T02:43:18.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.236+0000 7f8685000640 1 -- 172.21.15.112:0/3867992605 shutdown_connections 2024-09-12T02:43:18.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.236+0000 7f8685000640 1 --2- 172.21.15.112:0/3867992605 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86800b1d70 0x7f86800b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:18.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.236+0000 7f8685000640 1 --2- 172.21.15.112:0/3867992605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86800b3e00 0x7f86800d28d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:18.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.236+0000 7f8685000640 1 -- 172.21.15.112:0/3867992605 >> 172.21.15.112:0/3867992605 conn(0x7f868009e030 msgr2=0x7f86800d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:18.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.236+0000 7f8685000640 1 -- 172.21.15.112:0/3867992605 shutdown_connections 2024-09-12T02:43:18.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.236+0000 7f8685000640 1 -- 172.21.15.112:0/3867992605 wait complete. 2024-09-12T02:43:18.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.237+0000 7f8685000640 1 Processor -- start 2024-09-12T02:43:18.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.237+0000 7f8685000640 1 -- start start 2024-09-12T02:43:18.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.238+0000 7f8685000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86800b1d70 0x7f8680162070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:18.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.238+0000 7f8685000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86800b3e00 0x7f86800ce020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:18.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.238+0000 7f8685000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86800d1710 0x7f86800b6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:18.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.238+0000 7f8685000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f868015f110 con 0x7f86800d1710 2024-09-12T02:43:18.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.238+0000 7f8685000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f86800d39d0 con 0x7f86800b1d70 2024-09-12T02:43:18.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.238+0000 7f8685000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f868015f290 con 0x7f86800b3e00 2024-09-12T02:43:18.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.239+0000 7f867fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86800d1710 0x7f86800b6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:18.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.239+0000 7f867fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86800d1710 0x7f86800b6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54790/0 (socket says 172.21.15.112:54790) 2024-09-12T02:43:18.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.239+0000 7f867fe00640 1 -- 172.21.15.112:0/606051944 learned_addr learned my addr 172.21.15.112:0/606051944 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:18.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.239+0000 7f867ea00640 1 --2- 172.21.15.112:0/606051944 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86800b3e00 0x7f86800ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:18.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.239+0000 7f867f400640 1 --2- 172.21.15.112:0/606051944 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86800b1d70 0x7f8680162070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:18.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.239+0000 7f867fe00640 1 -- 172.21.15.112:0/606051944 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86800b3e00 msgr2=0x7f86800ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:18.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.239+0000 7f867fe00640 1 --2- 172.21.15.112:0/606051944 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86800b3e00 0x7f86800ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:18.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.239+0000 7f867fe00640 1 -- 172.21.15.112:0/606051944 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86800b1d70 msgr2=0x7f8680162070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:18.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.239+0000 7f867fe00640 1 --2- 172.21.15.112:0/606051944 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86800b1d70 0x7f8680162070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:18.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.239+0000 7f867fe00640 1 -- 172.21.15.112:0/606051944 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86801f4970 con 0x7f86800d1710 2024-09-12T02:43:18.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.239+0000 7f867ea00640 1 --2- 172.21.15.112:0/606051944 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86800b3e00 0x7f86800ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:43:18.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.239+0000 7f867f400640 1 --2- 172.21.15.112:0/606051944 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86800b1d70 0x7f8680162070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:43:18.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.239+0000 7f867fe00640 1 --2- 172.21.15.112:0/606051944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86800d1710 0x7f86800b6df0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8678007f20 tx=0x7f867800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:18.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.239+0000 7f8677400640 1 -- 172.21.15.112:0/606051944 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f867801a070 con 0x7f86800d1710 2024-09-12T02:43:18.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.240+0000 7f8677400640 1 -- 172.21.15.112:0/606051944 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8678003b90 con 0x7f86800d1710 2024-09-12T02:43:18.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.240+0000 7f8685000640 1 -- 172.21.15.112:0/606051944 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86801582e0 con 0x7f86800d1710 2024-09-12T02:43:18.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.240+0000 7f8677400640 1 -- 172.21.15.112:0/606051944 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8678004030 con 0x7f86800d1710 2024-09-12T02:43:18.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.240+0000 7f8685000640 1 -- 172.21.15.112:0/606051944 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86800cd280 con 0x7f86800d1710 2024-09-12T02:43:18.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.241+0000 7f8685000640 1 -- 172.21.15.112:0/606051944 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86800d28d0 con 0x7f86800d1710 2024-09-12T02:43:18.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.242+0000 7f8677400640 1 -- 172.21.15.112:0/606051944 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f867801d070 con 0x7f86800d1710 2024-09-12T02:43:18.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.242+0000 7f8677400640 1 --2- 172.21.15.112:0/606051944 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f866006be30 0x7f866006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:18.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.242+0000 7f8677400640 1 -- 172.21.15.112:0/606051944 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f867808b240 con 0x7f86800d1710 2024-09-12T02:43:18.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.243+0000 7f867f400640 1 --2- 172.21.15.112:0/606051944 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f866006be30 0x7f866006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:18.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.243+0000 7f867f400640 1 --2- 172.21.15.112:0/606051944 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f866006be30 0x7f866006e2f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8670005880 tx=0x7f8670009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:18.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.247+0000 7f8677400640 1 -- 172.21.15.112:0/606051944 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8678010070 con 0x7f86800d1710 2024-09-12T02:43:18.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:18.458+0000 7f8685000640 1 -- 172.21.15.112:0/606051944 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f868006c900 con 0x7f86800d1710 2024-09-12T02:43:19.298 INFO:tasks.ceph.mds.b.smithi137.stderr:2024-09-12T02:43:19.298+0000 7f4685e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:43:19.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.336+0000 7f8677400640 1 -- 172.21.15.112:0/606051944 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v26) ==== 118+0+0 (secure 0 0 0) 0x7f8678059b50 con 0x7f86800d1710 2024-09-12T02:43:19.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.339+0000 7f8685000640 1 -- 172.21.15.112:0/606051944 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f866006be30 msgr2=0x7f866006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:19.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.339+0000 7f8685000640 1 --2- 172.21.15.112:0/606051944 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f866006be30 0x7f866006e2f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8670005880 tx=0x7f8670009040 comp rx=0 tx=0).stop 2024-09-12T02:43:19.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.339+0000 7f8685000640 1 -- 172.21.15.112:0/606051944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86800d1710 msgr2=0x7f86800b6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:19.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.339+0000 7f8685000640 1 --2- 172.21.15.112:0/606051944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86800d1710 0x7f86800b6df0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8678007f20 tx=0x7f867800d560 comp rx=0 tx=0).stop 2024-09-12T02:43:19.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.339+0000 7f8685000640 1 -- 172.21.15.112:0/606051944 shutdown_connections 2024-09-12T02:43:19.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.339+0000 7f8685000640 1 --2- 172.21.15.112:0/606051944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86800d1710 0x7f86800b6df0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:19.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.339+0000 7f8685000640 1 --2- 172.21.15.112:0/606051944 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86800b3e00 0x7f86800ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:19.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.339+0000 7f8685000640 1 --2- 172.21.15.112:0/606051944 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f866006be30 0x7f866006e2f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:19.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.339+0000 7f8685000640 1 --2- 172.21.15.112:0/606051944 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86800b1d70 0x7f8680162070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:19.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.339+0000 7f8685000640 1 -- 172.21.15.112:0/606051944 >> 172.21.15.112:0/606051944 conn(0x7f868009e030 msgr2=0x7f86800b21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:19.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.339+0000 7f8685000640 1 -- 172.21.15.112:0/606051944 shutdown_connections 2024-09-12T02:43:19.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.339+0000 7f8685000640 1 -- 172.21.15.112:0/606051944 wait complete. 2024-09-12T02:43:19.359 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T02:43:19.359 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T02:43:19.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.516+0000 7ff3c6e00640 1 Processor -- start 2024-09-12T02:43:19.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.516+0000 7ff3c6e00640 1 -- start start 2024-09-12T02:43:19.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.518+0000 7ff3c6e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff3c0071530 0x7ff3c00af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:19.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.518+0000 7ff3c6e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff3c00719a0 0x7ff3c00afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:19.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.518+0000 7ff3c6e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3c00ceeb0 con 0x7ff3c015cc50 2024-09-12T02:43:19.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.518+0000 7ff3c6e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff3c015d030 con 0x7ff3c0071530 2024-09-12T02:43:19.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.518+0000 7ff3c6e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff3c00cf4c0 con 0x7ff3c00719a0 2024-09-12T02:43:19.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.518+0000 7ff3b7400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff3c0071530 0x7ff3c00af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:19.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.518+0000 7ff3b7400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff3c0071530 0x7ff3c00af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54804/0 (socket says 172.21.15.112:54804) 2024-09-12T02:43:19.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.518+0000 7ff3b7400640 1 -- 172.21.15.112:0/24774760 learned_addr learned my addr 172.21.15.112:0/24774760 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:19.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.518+0000 7ff3c4e00640 1 --2- 172.21.15.112:0/24774760 >> v2:172.21.15.137:3300/0 conn(0x7ff3c00719a0 0x7ff3c00afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:19.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.518+0000 7ff3b7400640 1 -- 172.21.15.112:0/24774760 >> v2:172.21.15.137:3300/0 conn(0x7ff3c00719a0 msgr2=0x7ff3c00afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:19.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.518+0000 7ff3b7400640 1 --2- 172.21.15.112:0/24774760 >> v2:172.21.15.137:3300/0 conn(0x7ff3c00719a0 0x7ff3c00afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:19.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.518+0000 7ff3b7400640 1 -- 172.21.15.112:0/24774760 >> v1:172.21.15.137:6789/0 conn(0x7ff3c015cc50 legacy=0x7ff3c00732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:19.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.518+0000 7ff3b7400640 1 -- 172.21.15.112:0/24774760 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c006e300 con 0x7ff3c0071530 2024-09-12T02:43:19.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.518+0000 7ff3c4e00640 1 --2- 172.21.15.112:0/24774760 >> v2:172.21.15.137:3300/0 conn(0x7ff3c00719a0 0x7ff3c00afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:43:19.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.519+0000 7ff3b7400640 1 --2- 172.21.15.112:0/24774760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3c0071530 0x7ff3c00af720 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff3c00cf640 tx=0x7ff3a802a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323e76e47ce60263 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:19.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.520+0000 7ff3bf400640 1 -- 172.21.15.112:0/24774760 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a8004030 con 0x7ff3c0071530 2024-09-12T02:43:19.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.520+0000 7ff3bf400640 1 -- 172.21.15.112:0/24774760 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3a80041d0 con 0x7ff3c0071530 2024-09-12T02:43:19.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.520+0000 7ff3bf400640 1 -- 172.21.15.112:0/24774760 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a8003610 con 0x7ff3c0071530 2024-09-12T02:43:19.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.520+0000 7ff3c6e00640 1 -- 172.21.15.112:0/24774760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3c0071530 msgr2=0x7ff3c00af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:19.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.520+0000 7ff3c6e00640 1 --2- 172.21.15.112:0/24774760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3c0071530 0x7ff3c00af720 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff3c00cf640 tx=0x7ff3a802a160 comp rx=0 tx=0).stop 2024-09-12T02:43:19.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.520+0000 7ff3c6e00640 1 -- 172.21.15.112:0/24774760 shutdown_connections 2024-09-12T02:43:19.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.520+0000 7ff3c6e00640 1 --2- 172.21.15.112:0/24774760 >> v2:172.21.15.137:3300/0 conn(0x7ff3c00719a0 0x7ff3c00afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:19.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.520+0000 7ff3c6e00640 1 --2- 172.21.15.112:0/24774760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3c0071530 0x7ff3c00af720 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:19.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.520+0000 7ff3c6e00640 1 -- 172.21.15.112:0/24774760 >> 172.21.15.112:0/24774760 conn(0x7ff3c006bbd0 msgr2=0x7ff3c006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:19.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.520+0000 7ff3c6e00640 1 -- 172.21.15.112:0/24774760 shutdown_connections 2024-09-12T02:43:19.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.520+0000 7ff3c6e00640 1 -- 172.21.15.112:0/24774760 wait complete. 2024-09-12T02:43:19.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.522+0000 7ff3c6e00640 1 Processor -- start 2024-09-12T02:43:19.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.522+0000 7ff3c6e00640 1 -- start start 2024-09-12T02:43:19.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.523+0000 7ff3c6e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3c0071530 0x7ff3c0151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:19.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.523+0000 7ff3c6e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3c00719a0 0x7ff3c00b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:19.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.523+0000 7ff3c6e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3c015cc50 0x7ff3c0155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:19.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.523+0000 7ff3c6e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c006f510 con 0x7ff3c015cc50 2024-09-12T02:43:19.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.523+0000 7ff3c6e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c00cf150 con 0x7ff3c00719a0 2024-09-12T02:43:19.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.523+0000 7ff3c6e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff3c006f690 con 0x7ff3c0071530 2024-09-12T02:43:19.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.523+0000 7ff3c4e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3c015cc50 0x7ff3c0155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:19.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.523+0000 7ff3c4e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3c015cc50 0x7ff3c0155560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54812/0 (socket says 172.21.15.112:54812) 2024-09-12T02:43:19.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.523+0000 7ff3c4e00640 1 -- 172.21.15.112:0/1528271183 learned_addr learned my addr 172.21.15.112:0/1528271183 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:19.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.524+0000 7ff3c4e00640 1 -- 172.21.15.112:0/1528271183 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3c0071530 msgr2=0x7ff3c0151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:19.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.524+0000 7ff3c4e00640 1 --2- 172.21.15.112:0/1528271183 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3c0071530 0x7ff3c0151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:19.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.524+0000 7ff3c4e00640 1 -- 172.21.15.112:0/1528271183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3c00719a0 msgr2=0x7ff3c00b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:19.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.524+0000 7ff3c4e00640 1 --2- 172.21.15.112:0/1528271183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3c00719a0 0x7ff3c00b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:19.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.524+0000 7ff3c4e00640 1 -- 172.21.15.112:0/1528271183 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c0158340 con 0x7ff3c015cc50 2024-09-12T02:43:19.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.524+0000 7ff3c4e00640 1 --2- 172.21.15.112:0/1528271183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3c015cc50 0x7ff3c0155560 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff3b800ce80 tx=0x7ff3b800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:19.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.524+0000 7ff3bcc00640 1 -- 172.21.15.112:0/1528271183 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b801a070 con 0x7ff3c015cc50 2024-09-12T02:43:19.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.524+0000 7ff3bcc00640 1 -- 172.21.15.112:0/1528271183 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b800d880 con 0x7ff3c015cc50 2024-09-12T02:43:19.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.524+0000 7ff3c6e00640 1 -- 172.21.15.112:0/1528271183 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c0158620 con 0x7ff3c015cc50 2024-09-12T02:43:19.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.524+0000 7ff3bcc00640 1 -- 172.21.15.112:0/1528271183 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b800dc70 con 0x7ff3c015cc50 2024-09-12T02:43:19.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.524+0000 7ff3c6e00640 1 -- 172.21.15.112:0/1528271183 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c01f6380 con 0x7ff3c015cc50 2024-09-12T02:43:19.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.525+0000 7ff3c6e00640 1 -- 172.21.15.112:0/1528271183 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3c006df60 con 0x7ff3c015cc50 2024-09-12T02:43:19.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.526+0000 7ff3bcc00640 1 -- 172.21.15.112:0/1528271183 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff3b801d070 con 0x7ff3c015cc50 2024-09-12T02:43:19.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.527+0000 7ff3bcc00640 1 --2- 172.21.15.112:0/1528271183 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff39c06be30 0x7ff39c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:19.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.527+0000 7ff3bcc00640 1 -- 172.21.15.112:0/1528271183 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7ff3b808b620 con 0x7ff3c015cc50 2024-09-12T02:43:19.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.527+0000 7ff3bfe00640 1 --2- 172.21.15.112:0/1528271183 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff39c06be30 0x7ff39c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:19.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.528+0000 7ff3bfe00640 1 --2- 172.21.15.112:0/1528271183 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff39c06be30 0x7ff39c06e2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0009650 tx=0x7ff3b0006ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:19.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.531+0000 7ff3bcc00640 1 -- 172.21.15.112:0/1528271183 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff3b8059970 con 0x7ff3c015cc50 2024-09-12T02:43:19.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:19.742+0000 7ff3c6e00640 1 -- 172.21.15.112:0/1528271183 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff3c00ce490 con 0x7ff3c015cc50 2024-09-12T02:43:20.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.338+0000 7ff3bcc00640 1 -- 172.21.15.112:0/1528271183 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v27) ==== 122+0+0 (secure 0 0 0) 0x7ff3b805dc70 con 0x7ff3c015cc50 2024-09-12T02:43:20.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.340+0000 7ff3c6e00640 1 -- 172.21.15.112:0/1528271183 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff39c06be30 msgr2=0x7ff39c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:20.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.340+0000 7ff3c6e00640 1 --2- 172.21.15.112:0/1528271183 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff39c06be30 0x7ff39c06e2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0009650 tx=0x7ff3b0006ba0 comp rx=0 tx=0).stop 2024-09-12T02:43:20.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.340+0000 7ff3c6e00640 1 -- 172.21.15.112:0/1528271183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3c015cc50 msgr2=0x7ff3c0155560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:20.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.340+0000 7ff3c6e00640 1 --2- 172.21.15.112:0/1528271183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3c015cc50 0x7ff3c0155560 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff3b800ce80 tx=0x7ff3b800a710 comp rx=0 tx=0).stop 2024-09-12T02:43:20.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.340+0000 7ff3c6e00640 1 -- 172.21.15.112:0/1528271183 shutdown_connections 2024-09-12T02:43:20.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.340+0000 7ff3c6e00640 1 --2- 172.21.15.112:0/1528271183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3c015cc50 0x7ff3c0155560 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:20.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.340+0000 7ff3c6e00640 1 --2- 172.21.15.112:0/1528271183 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff39c06be30 0x7ff39c06e2f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:20.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.340+0000 7ff3c6e00640 1 --2- 172.21.15.112:0/1528271183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3c00719a0 0x7ff3c00b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:20.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.340+0000 7ff3c6e00640 1 --2- 172.21.15.112:0/1528271183 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3c0071530 0x7ff3c0151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:20.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.340+0000 7ff3c6e00640 1 -- 172.21.15.112:0/1528271183 >> 172.21.15.112:0/1528271183 conn(0x7ff3c006bbd0 msgr2=0x7ff3c00d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:20.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.341+0000 7ff3c6e00640 1 -- 172.21.15.112:0/1528271183 shutdown_connections 2024-09-12T02:43:20.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.341+0000 7ff3c6e00640 1 -- 172.21.15.112:0/1528271183 wait complete. 2024-09-12T02:43:20.359 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T02:43:20.359 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:43:20.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.513+0000 7fe65e200640 1 Processor -- start 2024-09-12T02:43:20.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.513+0000 7fe65e200640 1 -- start start 2024-09-12T02:43:20.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.514+0000 7fe65e200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6580d1710 0x7fe6580d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:20.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.514+0000 7fe65e200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe6580b3e00 0x7fe6580d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:20.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.514+0000 7fe65e200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6580d2fb0 con 0x7fe6580cf7a0 2024-09-12T02:43:20.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.514+0000 7fe65e200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe6580d3cb0 con 0x7fe6580b3e00 2024-09-12T02:43:20.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.514+0000 7fe65e200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe6580d0b60 con 0x7fe6580d1710 2024-09-12T02:43:20.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.514+0000 7fe65d800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe6580cf7a0 0x7fe6580cfc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36080/0 (socket says 172.21.15.112:36080) 2024-09-12T02:43:20.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.514+0000 7fe657e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe6580b3e00 0x7fe6580d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:20.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.514+0000 7fe65d800640 1 -- 172.21.15.112:0/1337495931 learned_addr learned my addr 172.21.15.112:0/1337495931 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:20.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.515+0000 7fe65ce00640 1 --2- 172.21.15.112:0/1337495931 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6580d1710 0x7fe6580d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:20.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.515+0000 7fe657e00640 1 -- 172.21.15.112:0/1337495931 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6580d1710 msgr2=0x7fe6580d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:20.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.515+0000 7fe657e00640 1 --2- 172.21.15.112:0/1337495931 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6580d1710 0x7fe6580d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:20.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.515+0000 7fe657e00640 1 -- 172.21.15.112:0/1337495931 >> v1:172.21.15.112:6789/0 conn(0x7fe6580cf7a0 legacy=0x7fe6580cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:20.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.515+0000 7fe657400640 1 -- 172.21.15.112:0/1337495931 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1070748080 0 0) 0x7fe6580d2fb0 con 0x7fe6580cf7a0 2024-09-12T02:43:20.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.515+0000 7fe657e00640 1 -- 172.21.15.112:0/1337495931 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6580d2030 con 0x7fe6580b3e00 2024-09-12T02:43:20.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.516+0000 7fe657e00640 1 --2- 172.21.15.112:0/1337495931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6580b3e00 0x7fe6580d1af0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe6440097a0 tx=0x7fe64402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89773fdb4227deda server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:20.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.516+0000 7fe657400640 1 -- 172.21.15.112:0/1337495931 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe644037070 con 0x7fe6580b3e00 2024-09-12T02:43:20.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.516+0000 7fe657400640 1 -- 172.21.15.112:0/1337495931 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe644032440 con 0x7fe6580b3e00 2024-09-12T02:43:20.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.516+0000 7fe657400640 1 -- 172.21.15.112:0/1337495931 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe644032810 con 0x7fe6580b3e00 2024-09-12T02:43:20.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.517+0000 7fe65e200640 1 -- 172.21.15.112:0/1337495931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6580b3e00 msgr2=0x7fe6580d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:20.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.517+0000 7fe65e200640 1 --2- 172.21.15.112:0/1337495931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6580b3e00 0x7fe6580d1af0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe6440097a0 tx=0x7fe64402a180 comp rx=0 tx=0).stop 2024-09-12T02:43:20.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.517+0000 7fe65e200640 1 -- 172.21.15.112:0/1337495931 shutdown_connections 2024-09-12T02:43:20.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.517+0000 7fe65e200640 1 --2- 172.21.15.112:0/1337495931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6580b3e00 0x7fe6580d1af0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:20.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.517+0000 7fe65e200640 1 --2- 172.21.15.112:0/1337495931 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6580d1710 0x7fe6580d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:20.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.517+0000 7fe65e200640 1 -- 172.21.15.112:0/1337495931 >> 172.21.15.112:0/1337495931 conn(0x7fe65809e030 msgr2=0x7fe6580d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:20.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.517+0000 7fe65e200640 1 -- 172.21.15.112:0/1337495931 shutdown_connections 2024-09-12T02:43:20.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.517+0000 7fe65e200640 1 -- 172.21.15.112:0/1337495931 wait complete. 2024-09-12T02:43:20.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.518+0000 7fe65e200640 1 Processor -- start 2024-09-12T02:43:20.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.519+0000 7fe65e200640 1 -- start start 2024-09-12T02:43:20.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.519+0000 7fe65e200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6580b3e00 0x7fe6580cb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:20.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.519+0000 7fe65e200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6580cf7a0 0x7fe6581f8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:20.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.519+0000 7fe65e200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6580d1710 0x7fe65815e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:20.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.519+0000 7fe65e200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe6580d39d0 con 0x7fe6580d1710 2024-09-12T02:43:20.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.519+0000 7fe65e200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe6580d36f0 con 0x7fe6580cf7a0 2024-09-12T02:43:20.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.519+0000 7fe65e200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe65815f110 con 0x7fe6580b3e00 2024-09-12T02:43:20.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.520+0000 7fe65d800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6580d1710 0x7fe65815e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:20.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.520+0000 7fe65d800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6580d1710 0x7fe65815e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54836/0 (socket says 172.21.15.112:54836) 2024-09-12T02:43:20.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.520+0000 7fe65d800640 1 -- 172.21.15.112:0/4039878302 learned_addr learned my addr 172.21.15.112:0/4039878302 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:20.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.520+0000 7fe65ce00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6580b3e00 0x7fe6580cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:20.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.520+0000 7fe657e00640 1 --2- 172.21.15.112:0/4039878302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6580cf7a0 0x7fe6581f8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:20.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.520+0000 7fe65d800640 1 -- 172.21.15.112:0/4039878302 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6580b3e00 msgr2=0x7fe6580cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:20.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.520+0000 7fe65d800640 1 --2- 172.21.15.112:0/4039878302 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6580b3e00 0x7fe6580cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:20.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.520+0000 7fe65d800640 1 -- 172.21.15.112:0/4039878302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6580cf7a0 msgr2=0x7fe6581f8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:20.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.520+0000 7fe65d800640 1 --2- 172.21.15.112:0/4039878302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6580cf7a0 0x7fe6581f8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:20.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.520+0000 7fe65d800640 1 -- 172.21.15.112:0/4039878302 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe658162030 con 0x7fe6580d1710 2024-09-12T02:43:20.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.521+0000 7fe65d800640 1 --2- 172.21.15.112:0/4039878302 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6580d1710 0x7fe65815e090 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe65000c7a0 tx=0x7fe65000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:20.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.521+0000 7fe654c00640 1 -- 172.21.15.112:0/4039878302 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe650018070 con 0x7fe6580d1710 2024-09-12T02:43:20.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.521+0000 7fe654c00640 1 -- 172.21.15.112:0/4039878302 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe65000a640 con 0x7fe6580d1710 2024-09-12T02:43:20.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.521+0000 7fe654c00640 1 -- 172.21.15.112:0/4039878302 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65000aab0 con 0x7fe6580d1710 2024-09-12T02:43:20.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.521+0000 7fe65e200640 1 -- 172.21.15.112:0/4039878302 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe658162310 con 0x7fe6580d1710 2024-09-12T02:43:20.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.521+0000 7fe65e200640 1 -- 172.21.15.112:0/4039878302 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6581f88d0 con 0x7fe6580d1710 2024-09-12T02:43:20.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.522+0000 7fe65e200640 1 -- 172.21.15.112:0/4039878302 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe65806c260 con 0x7fe6580d1710 2024-09-12T02:43:20.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.523+0000 7fe654c00640 1 -- 172.21.15.112:0/4039878302 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe65000ac50 con 0x7fe6580d1710 2024-09-12T02:43:20.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.524+0000 7fe654c00640 1 --2- 172.21.15.112:0/4039878302 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe63806be60 0x7fe63806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:20.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.524+0000 7fe654c00640 1 -- 172.21.15.112:0/4039878302 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fe65008a410 con 0x7fe6580d1710 2024-09-12T02:43:20.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.525+0000 7fe65ce00640 1 --2- 172.21.15.112:0/4039878302 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe63806be60 0x7fe63806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:20.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.525+0000 7fe65ce00640 1 --2- 172.21.15.112:0/4039878302 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe63806be60 0x7fe63806e320 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0079a0 tx=0x7fe64c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:20.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.529+0000 7fe654c00640 1 -- 172.21.15.112:0/4039878302 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe65806c260 con 0x7fe6580d1710 2024-09-12T02:43:20.681 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:43:20.686 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:43:20.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.737+0000 7fe65e200640 1 -- 172.21.15.112:0/4039878302 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe6580d1af0 con 0x7fe6580d1710 2024-09-12T02:43:20.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.738+0000 7fe654c00640 1 -- 172.21.15.112:0/4039878302 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5229 (secure 0 0 0) 0x7fe6500586d0 con 0x7fe6580d1710 2024-09-12T02:43:20.740 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:20.740 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":27,"btime":"2024-09-12T02:43:20:337397+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5008,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/362211662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":362211662},{"type":"v1","addr":"172.21.15.112:6836","nonce":362211662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5011,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/193733805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":193733805},{"type":"v1","addr":"172.21.15.112:6837","nonce":193733805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/3440642333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3440642333},{"type":"v1","addr":"172.21.15.137:6834","nonce":3440642333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:43:16.722971+0000","modified":"2024-09-12T02:43:19.743614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"b","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/3597512060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3597512060},{"type":"v1","addr":"172.21.15.137:6835","nonce":3597512060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":3}]} 2024-09-12T02:43:20.740 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 27 2024-09-12T02:43:20.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.740+0000 7fe65e200640 1 -- 172.21.15.112:0/4039878302 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe63806be60 msgr2=0x7fe63806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:20.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.740+0000 7fe65e200640 1 --2- 172.21.15.112:0/4039878302 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe63806be60 0x7fe63806e320 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0079a0 tx=0x7fe64c008040 comp rx=0 tx=0).stop 2024-09-12T02:43:20.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.740+0000 7fe65e200640 1 -- 172.21.15.112:0/4039878302 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6580d1710 msgr2=0x7fe65815e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:20.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.740+0000 7fe65e200640 1 --2- 172.21.15.112:0/4039878302 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6580d1710 0x7fe65815e090 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe65000c7a0 tx=0x7fe65000cc60 comp rx=0 tx=0).stop 2024-09-12T02:43:20.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.740+0000 7fe65e200640 1 -- 172.21.15.112:0/4039878302 shutdown_connections 2024-09-12T02:43:20.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.740+0000 7fe65e200640 1 --2- 172.21.15.112:0/4039878302 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6580d1710 0x7fe65815e090 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:20.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.740+0000 7fe65e200640 1 --2- 172.21.15.112:0/4039878302 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe63806be60 0x7fe63806e320 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:20.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.740+0000 7fe65e200640 1 --2- 172.21.15.112:0/4039878302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6580cf7a0 0x7fe6581f8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:20.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.740+0000 7fe65e200640 1 --2- 172.21.15.112:0/4039878302 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6580b3e00 0x7fe6580cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:20.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.740+0000 7fe65e200640 1 -- 172.21.15.112:0/4039878302 >> 172.21.15.112:0/4039878302 conn(0x7fe65809e030 msgr2=0x7fe65806d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:20.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.741+0000 7fe65e200640 1 -- 172.21.15.112:0/4039878302 shutdown_connections 2024-09-12T02:43:20.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.741+0000 7fe65e200640 1 -- 172.21.15.112:0/4039878302 wait complete. 2024-09-12T02:43:20.758 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:43:20.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.909+0000 7f8461000640 1 Processor -- start 2024-09-12T02:43:20.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.909+0000 7f8461000640 1 -- start start 2024-09-12T02:43:20.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.911+0000 7f8461000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f845c0b4aa0 0x7f845c06df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:20.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.911+0000 7f8461000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f845c144120 0x7f845c0cffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:20.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.911+0000 7f8461000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f845c06e540 con 0x7f845c06f620 2024-09-12T02:43:20.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.911+0000 7f8461000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f845c0d0510 con 0x7f845c144120 2024-09-12T02:43:20.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.911+0000 7f8461000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f845c06e820 con 0x7f845c0b4aa0 2024-09-12T02:43:20.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.911+0000 7f8459e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f845c06f620 0x7f845c15e990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36082/0 (socket says 172.21.15.112:36082) 2024-09-12T02:43:20.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.911+0000 7f8459e00640 1 -- 172.21.15.112:0/2255043922 learned_addr learned my addr 172.21.15.112:0/2255043922 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:20.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.911+0000 7f845a800640 1 --2- 172.21.15.112:0/2255043922 >> v2:172.21.15.112:3300/0 conn(0x7f845c144120 0x7f845c0cffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:20.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.911+0000 7f8451400640 1 --2- 172.21.15.112:0/2255043922 >> v2:172.21.15.137:3300/0 conn(0x7f845c0b4aa0 0x7f845c06df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:20.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.911+0000 7f8459400640 1 -- 172.21.15.112:0/2255043922 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3691940162 0 0) 0x7f845c06e540 con 0x7f845c06f620 2024-09-12T02:43:20.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.911+0000 7f8459400640 1 -- 172.21.15.112:0/2255043922 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8440005730 con 0x7f845c06f620 2024-09-12T02:43:20.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.912+0000 7f845a800640 1 -- 172.21.15.112:0/2255043922 >> v2:172.21.15.137:3300/0 conn(0x7f845c0b4aa0 msgr2=0x7f845c06df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:20.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.912+0000 7f845a800640 1 --2- 172.21.15.112:0/2255043922 >> v2:172.21.15.137:3300/0 conn(0x7f845c0b4aa0 0x7f845c06df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:20.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.912+0000 7f845a800640 1 -- 172.21.15.112:0/2255043922 >> v1:172.21.15.112:6789/0 conn(0x7f845c06f620 legacy=0x7f845c15e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:20.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.912+0000 7f845a800640 1 -- 172.21.15.112:0/2255043922 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f845c06eb00 con 0x7f845c144120 2024-09-12T02:43:20.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.912+0000 7f845a800640 1 --2- 172.21.15.112:0/2255043922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f845c144120 0x7f845c0cffd0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8454009d90 tx=0x7f845402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b95c95a9755bcad2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:20.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.913+0000 7f8459400640 1 -- 172.21.15.112:0/2255043922 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8454031600 con 0x7f845c144120 2024-09-12T02:43:20.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.913+0000 7f8459400640 1 -- 172.21.15.112:0/2255043922 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84540317a0 con 0x7f845c144120 2024-09-12T02:43:20.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.913+0000 7f8459400640 1 -- 172.21.15.112:0/2255043922 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8454031b70 con 0x7f845c144120 2024-09-12T02:43:20.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.913+0000 7f8461000640 1 -- 172.21.15.112:0/2255043922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f845c144120 msgr2=0x7f845c0cffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:20.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.913+0000 7f8461000640 1 --2- 172.21.15.112:0/2255043922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f845c144120 0x7f845c0cffd0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8454009d90 tx=0x7f845402a610 comp rx=0 tx=0).stop 2024-09-12T02:43:20.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.913+0000 7f8461000640 1 -- 172.21.15.112:0/2255043922 shutdown_connections 2024-09-12T02:43:20.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.913+0000 7f8461000640 1 --2- 172.21.15.112:0/2255043922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f845c144120 0x7f845c0cffd0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:20.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.913+0000 7f8461000640 1 --2- 172.21.15.112:0/2255043922 >> v2:172.21.15.137:3300/0 conn(0x7f845c0b4aa0 0x7f845c06df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:20.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.913+0000 7f8461000640 1 -- 172.21.15.112:0/2255043922 >> 172.21.15.112:0/2255043922 conn(0x7f845c06bbd0 msgr2=0x7f845c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:20.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.913+0000 7f8461000640 1 -- 172.21.15.112:0/2255043922 shutdown_connections 2024-09-12T02:43:20.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.913+0000 7f8461000640 1 -- 172.21.15.112:0/2255043922 wait complete. 2024-09-12T02:43:20.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.915+0000 7f8461000640 1 Processor -- start 2024-09-12T02:43:20.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.915+0000 7f8461000640 1 -- start start 2024-09-12T02:43:20.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.916+0000 7f8461000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f845c06f620 0x7f845c157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:20.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.916+0000 7f8461000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f845c0b4aa0 0x7f845c13aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:20.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.916+0000 7f8461000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f845c144120 0x7f845c0ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:20.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.916+0000 7f8461000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f845c144870 con 0x7f845c06f620 2024-09-12T02:43:20.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.916+0000 7f8461000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f845c06f0c0 con 0x7f845c0b4aa0 2024-09-12T02:43:20.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.916+0000 7f8461000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f845c15f0a0 con 0x7f845c144120 2024-09-12T02:43:20.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.916+0000 7f8459e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f845c06f620 0x7f845c157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:20.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.916+0000 7f8459e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f845c06f620 0x7f845c157500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54856/0 (socket says 172.21.15.112:54856) 2024-09-12T02:43:20.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.916+0000 7f8459e00640 1 -- 172.21.15.112:0/4155601693 learned_addr learned my addr 172.21.15.112:0/4155601693 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:20.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.917+0000 7f8451400640 1 --2- 172.21.15.112:0/4155601693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f845c0b4aa0 0x7f845c13aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:20.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.917+0000 7f845a800640 1 --2- 172.21.15.112:0/4155601693 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f845c144120 0x7f845c0ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:20.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.917+0000 7f8459e00640 1 -- 172.21.15.112:0/4155601693 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f845c144120 msgr2=0x7f845c0ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:20.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.917+0000 7f8459e00640 1 --2- 172.21.15.112:0/4155601693 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f845c144120 0x7f845c0ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:20.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.917+0000 7f8459e00640 1 -- 172.21.15.112:0/4155601693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f845c0b4aa0 msgr2=0x7f845c13aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:20.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.917+0000 7f8459e00640 1 --2- 172.21.15.112:0/4155601693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f845c0b4aa0 0x7f845c13aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:20.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.917+0000 7f8459e00640 1 -- 172.21.15.112:0/4155601693 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f845c1390e0 con 0x7f845c06f620 2024-09-12T02:43:20.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.917+0000 7f845a800640 1 --2- 172.21.15.112:0/4155601693 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f845c144120 0x7f845c0ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:43:20.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.917+0000 7f8459e00640 1 --2- 172.21.15.112:0/4155601693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f845c06f620 0x7f845c157500 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f844c00c390 tx=0x7f844c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:20.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.917+0000 7f8452a00640 1 -- 172.21.15.112:0/4155601693 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f844c017070 con 0x7f845c06f620 2024-09-12T02:43:20.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.917+0000 7f8452a00640 1 -- 172.21.15.112:0/4155601693 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f844c005ce0 con 0x7f845c06f620 2024-09-12T02:43:20.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.917+0000 7f8452a00640 1 -- 172.21.15.112:0/4155601693 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f844c0072f0 con 0x7f845c06f620 2024-09-12T02:43:20.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.917+0000 7f8461000640 1 -- 172.21.15.112:0/4155601693 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f845c1393c0 con 0x7f845c06f620 2024-09-12T02:43:20.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.917+0000 7f8461000640 1 -- 172.21.15.112:0/4155601693 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f845c139980 con 0x7f845c06f620 2024-09-12T02:43:20.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.918+0000 7f8461000640 1 -- 172.21.15.112:0/4155601693 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f845c06df60 con 0x7f845c06f620 2024-09-12T02:43:20.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.919+0000 7f8452a00640 1 -- 172.21.15.112:0/4155601693 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f844c01a070 con 0x7f845c06f620 2024-09-12T02:43:20.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.920+0000 7f8452a00640 1 --2- 172.21.15.112:0/4155601693 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f843806be30 0x7f843806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:20.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.920+0000 7f8452a00640 1 -- 172.21.15.112:0/4155601693 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f844c08a2c0 con 0x7f845c06f620 2024-09-12T02:43:20.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.920+0000 7f8451400640 1 --2- 172.21.15.112:0/4155601693 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f843806be30 0x7f843806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:20.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.921+0000 7f8451400640 1 --2- 172.21.15.112:0/4155601693 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f843806be30 0x7f843806e2f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f845c15e220 tx=0x7f8444008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:20.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:20.924+0000 7f8452a00640 1 -- 172.21.15.112:0/4155601693 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f844c058bd0 con 0x7f845c06f620 2024-09-12T02:43:21.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.097+0000 7f8461000640 1 -- 172.21.15.112:0/4155601693 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f845c143590 con 0x7f845c06f620 2024-09-12T02:43:21.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.098+0000 7f8452a00640 1 -- 172.21.15.112:0/4155601693 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16721 (secure 0 0 0) 0x7f844c08a0c0 con 0x7f845c06f620 2024-09-12T02:43:21.099 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:21.099 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":45,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:43:18.313153+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:43:14.483471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-12T02:43:15.711619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:43:21.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.100+0000 7f8461000640 1 -- 172.21.15.112:0/4155601693 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f843806be30 msgr2=0x7f843806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:21.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.100+0000 7f8461000640 1 --2- 172.21.15.112:0/4155601693 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f843806be30 0x7f843806e2f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f845c15e220 tx=0x7f8444008040 comp rx=0 tx=0).stop 2024-09-12T02:43:21.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.100+0000 7f8461000640 1 -- 172.21.15.112:0/4155601693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f845c06f620 msgr2=0x7f845c157500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:21.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.100+0000 7f8461000640 1 --2- 172.21.15.112:0/4155601693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f845c06f620 0x7f845c157500 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f844c00c390 tx=0x7f844c00c850 comp rx=0 tx=0).stop 2024-09-12T02:43:21.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.101+0000 7f8461000640 1 -- 172.21.15.112:0/4155601693 shutdown_connections 2024-09-12T02:43:21.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.101+0000 7f8461000640 1 --2- 172.21.15.112:0/4155601693 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f845c144120 0x7f845c0ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:21.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.101+0000 7f8461000640 1 --2- 172.21.15.112:0/4155601693 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f843806be30 0x7f843806e2f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:21.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.101+0000 7f8461000640 1 --2- 172.21.15.112:0/4155601693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f845c0b4aa0 0x7f845c13aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:21.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.101+0000 7f8461000640 1 --2- 172.21.15.112:0/4155601693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f845c06f620 0x7f845c157500 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:21.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.101+0000 7f8461000640 1 -- 172.21.15.112:0/4155601693 >> 172.21.15.112:0/4155601693 conn(0x7f845c06bbd0 msgr2=0x7f845c0b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:21.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.101+0000 7f8461000640 1 -- 172.21.15.112:0/4155601693 shutdown_connections 2024-09-12T02:43:21.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.101+0000 7f8461000640 1 -- 172.21.15.112:0/4155601693 wait complete. 2024-09-12T02:43:21.118 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:43:21.118 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:43:21.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.268+0000 7f790ba00640 1 Processor -- start 2024-09-12T02:43:21.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.269+0000 7f790ba00640 1 -- start start 2024-09-12T02:43:21.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.270+0000 7f790ba00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f790406f600 0x7f79040b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:21.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.270+0000 7f790ba00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f79040b45d0 0x7f79040728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:21.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.270+0000 7f790ba00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79040b4a20 con 0x7f790415b9d0 2024-09-12T02:43:21.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.270+0000 7f790ba00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f79040b54a0 con 0x7f790406f600 2024-09-12T02:43:21.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.270+0000 7f790ba00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f79040b3af0 con 0x7f79040b45d0 2024-09-12T02:43:21.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.270+0000 7f7909000640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f790415b9d0 0x7f790406eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36084/0 (socket says 172.21.15.112:36084) 2024-09-12T02:43:21.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.270+0000 7f7909000640 1 -- 172.21.15.112:0/768255006 learned_addr learned my addr 172.21.15.112:0/768255006 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:21.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.270+0000 7f78fbe00640 1 --2- 172.21.15.112:0/768255006 >> v2:172.21.15.112:3300/0 conn(0x7f790406f600 0x7f79040b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:21.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.270+0000 7f7909a00640 1 --2- 172.21.15.112:0/768255006 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f79040b45d0 0x7f79040728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:21.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.270+0000 7f78fbe00640 1 -- 172.21.15.112:0/768255006 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f79040b45d0 msgr2=0x7f79040728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:21.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.270+0000 7f78fbe00640 1 --2- 172.21.15.112:0/768255006 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f79040b45d0 0x7f79040728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:21.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.271+0000 7f78fbe00640 1 -- 172.21.15.112:0/768255006 >> v1:172.21.15.112:6789/0 conn(0x7f790415b9d0 legacy=0x7f790406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:21.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.271+0000 7f7903e00640 1 -- 172.21.15.112:0/768255006 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3769212510 0 0) 0x7f79040b4a20 con 0x7f790415b9d0 2024-09-12T02:43:21.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.271+0000 7f78fbe00640 1 -- 172.21.15.112:0/768255006 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79040b3dd0 con 0x7f790406f600 2024-09-12T02:43:21.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.272+0000 7f78fbe00640 1 --2- 172.21.15.112:0/768255006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f790406f600 0x7f79040b4ec0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f78ec009790 tx=0x7f78ec02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e670222dfdfde23 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:21.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.272+0000 7f7903e00640 1 -- 172.21.15.112:0/768255006 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ec037070 con 0x7f790406f600 2024-09-12T02:43:21.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.272+0000 7f7903e00640 1 -- 172.21.15.112:0/768255006 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78ec032440 con 0x7f790406f600 2024-09-12T02:43:21.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.272+0000 7f7903e00640 1 -- 172.21.15.112:0/768255006 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ec032810 con 0x7f790406f600 2024-09-12T02:43:21.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.272+0000 7f790ba00640 1 -- 172.21.15.112:0/768255006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f790406f600 msgr2=0x7f79040b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:21.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.272+0000 7f790ba00640 1 --2- 172.21.15.112:0/768255006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f790406f600 0x7f79040b4ec0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f78ec009790 tx=0x7f78ec02a180 comp rx=0 tx=0).stop 2024-09-12T02:43:21.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.272+0000 7f790ba00640 1 -- 172.21.15.112:0/768255006 shutdown_connections 2024-09-12T02:43:21.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.272+0000 7f790ba00640 1 --2- 172.21.15.112:0/768255006 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f79040b45d0 0x7f79040728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:21.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.272+0000 7f790ba00640 1 --2- 172.21.15.112:0/768255006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f790406f600 0x7f79040b4ec0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:21.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.272+0000 7f790ba00640 1 -- 172.21.15.112:0/768255006 >> 172.21.15.112:0/768255006 conn(0x7f790406bbd0 msgr2=0x7f790406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:21.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.272+0000 7f790ba00640 1 -- 172.21.15.112:0/768255006 shutdown_connections 2024-09-12T02:43:21.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.273+0000 7f790ba00640 1 -- 172.21.15.112:0/768255006 wait complete. 2024-09-12T02:43:21.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.274+0000 7f790ba00640 1 Processor -- start 2024-09-12T02:43:21.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.274+0000 7f790ba00640 1 -- start start 2024-09-12T02:43:21.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.275+0000 7f790ba00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f790406f600 0x7f7904152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:21.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.275+0000 7f790ba00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f79040b45d0 0x7f790415d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:21.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.275+0000 7f790ba00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f790415b9d0 0x7f79041f51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:21.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.275+0000 7f790ba00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f790415bf30 con 0x7f790415b9d0 2024-09-12T02:43:21.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.275+0000 7f790ba00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f790415bdb0 con 0x7f790406f600 2024-09-12T02:43:21.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.275+0000 7f790ba00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f79040cdcd0 con 0x7f79040b45d0 2024-09-12T02:43:21.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.275+0000 7f7909a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f790415b9d0 0x7f79041f51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:21.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.275+0000 7f7909a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f790415b9d0 0x7f79041f51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54876/0 (socket says 172.21.15.112:54876) 2024-09-12T02:43:21.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.275+0000 7f7909a00640 1 -- 172.21.15.112:0/1628013098 learned_addr learned my addr 172.21.15.112:0/1628013098 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:21.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.276+0000 7f78fbe00640 1 --2- 172.21.15.112:0/1628013098 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f79040b45d0 0x7f790415d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:21.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.276+0000 7f7909000640 1 --2- 172.21.15.112:0/1628013098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f790406f600 0x7f7904152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:21.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.276+0000 7f7909a00640 1 -- 172.21.15.112:0/1628013098 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f79040b45d0 msgr2=0x7f790415d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:21.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.276+0000 7f7909a00640 1 --2- 172.21.15.112:0/1628013098 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f79040b45d0 0x7f790415d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:21.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.276+0000 7f7909a00640 1 -- 172.21.15.112:0/1628013098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f790406f600 msgr2=0x7f7904152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:21.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.276+0000 7f7909a00640 1 --2- 172.21.15.112:0/1628013098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f790406f600 0x7f7904152940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:21.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.276+0000 7f7909a00640 1 -- 172.21.15.112:0/1628013098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790415ac10 con 0x7f790415b9d0 2024-09-12T02:43:21.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.276+0000 7f7909a00640 1 --2- 172.21.15.112:0/1628013098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f790415b9d0 0x7f79041f51f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f78fc007e40 tx=0x7f78fc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:21.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.276+0000 7f7901600640 1 -- 172.21.15.112:0/1628013098 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc014620 con 0x7f790415b9d0 2024-09-12T02:43:21.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.276+0000 7f7901600640 1 -- 172.21.15.112:0/1628013098 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78fc019070 con 0x7f790415b9d0 2024-09-12T02:43:21.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.276+0000 7f7901600640 1 -- 172.21.15.112:0/1628013098 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc014a20 con 0x7f790415b9d0 2024-09-12T02:43:21.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.276+0000 7f790ba00640 1 -- 172.21.15.112:0/1628013098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79041f5930 con 0x7f790415b9d0 2024-09-12T02:43:21.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.276+0000 7f790ba00640 1 -- 172.21.15.112:0/1628013098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79041f5ef0 con 0x7f790415b9d0 2024-09-12T02:43:21.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.277+0000 7f790ba00640 1 -- 172.21.15.112:0/1628013098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7904068a30 con 0x7f790415b9d0 2024-09-12T02:43:21.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.278+0000 7f7901600640 1 -- 172.21.15.112:0/1628013098 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f78fc014bc0 con 0x7f790415b9d0 2024-09-12T02:43:21.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.279+0000 7f7901600640 1 --2- 172.21.15.112:0/1628013098 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f78e006be30 0x7f78e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:21.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.279+0000 7f7901600640 1 -- 172.21.15.112:0/1628013098 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f78fc08b810 con 0x7f790415b9d0 2024-09-12T02:43:21.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.279+0000 7f7909000640 1 --2- 172.21.15.112:0/1628013098 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f78e006be30 0x7f78e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:21.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.280+0000 7f7909000640 1 --2- 172.21.15.112:0/1628013098 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f78e006be30 0x7f78e006e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f78f4000f60 tx=0x7f78f4007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:21.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.284+0000 7f7901600640 1 -- 172.21.15.112:0/1628013098 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f78fc05a120 con 0x7f790415b9d0 2024-09-12T02:43:21.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.456+0000 7f790ba00640 1 -- 172.21.15.112:0/1628013098 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f79040725a0 con 0x7f78e006be30 2024-09-12T02:43:21.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.463+0000 7f7901600640 1 -- 172.21.15.112:0/1628013098 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247420 (secure 0 0 0) 0x7f79040725a0 con 0x7f78e006be30 2024-09-12T02:43:21.467 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:21.468 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:43:21.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.466+0000 7f790ba00640 1 -- 172.21.15.112:0/1628013098 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f78e006be30 msgr2=0x7f78e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:21.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.466+0000 7f790ba00640 1 --2- 172.21.15.112:0/1628013098 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f78e006be30 0x7f78e006e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f78f4000f60 tx=0x7f78f4007c00 comp rx=0 tx=0).stop 2024-09-12T02:43:21.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.466+0000 7f790ba00640 1 -- 172.21.15.112:0/1628013098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f790415b9d0 msgr2=0x7f79041f51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:21.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.466+0000 7f790ba00640 1 --2- 172.21.15.112:0/1628013098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f790415b9d0 0x7f79041f51f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f78fc007e40 tx=0x7f78fc00e4b0 comp rx=0 tx=0).stop 2024-09-12T02:43:21.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.467+0000 7f790ba00640 1 -- 172.21.15.112:0/1628013098 shutdown_connections 2024-09-12T02:43:21.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.467+0000 7f790ba00640 1 --2- 172.21.15.112:0/1628013098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f790415b9d0 0x7f79041f51f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:21.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.467+0000 7f790ba00640 1 --2- 172.21.15.112:0/1628013098 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f79040b45d0 0x7f790415d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:21.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.467+0000 7f790ba00640 1 --2- 172.21.15.112:0/1628013098 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f78e006be30 0x7f78e006e2f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:21.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.467+0000 7f790ba00640 1 --2- 172.21.15.112:0/1628013098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f790406f600 0x7f7904152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:21.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.467+0000 7f790ba00640 1 -- 172.21.15.112:0/1628013098 >> 172.21.15.112:0/1628013098 conn(0x7f790406bbd0 msgr2=0x7f79040ccbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:21.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.467+0000 7f790ba00640 1 -- 172.21.15.112:0/1628013098 shutdown_connections 2024-09-12T02:43:21.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.467+0000 7f790ba00640 1 -- 172.21.15.112:0/1628013098 wait complete. 2024-09-12T02:43:21.484 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2024-09-12T02:43:20.978272+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2762,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559737,"statfs":{"total":1600000000,"available":1597171071,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.678513"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.330143+0000","last_change":"2024-09-12T02:43:17.329984+0000","last_active":"2024-09-12T02:43:17.330143+0000","last_peered":"2024-09-12T02:43:17.330143+0000","last_clean":"2024-09-12T02:43:17.330143+0000","last_became_active":"2024-09-12T02:43:17.329749+0000","last_became_peered":"2024-09-12T02:43:17.329749+0000","last_unstale":"2024-09-12T02:43:17.330143+0000","last_undegraded":"2024-09-12T02:43:17.330143+0000","last_fullsized":"2024-09-12T02:43:17.330143+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:27:46.889252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.326837+0000","last_change":"2024-09-12T02:43:17.326367+0000","last_active":"2024-09-12T02:43:17.326837+0000","last_peered":"2024-09-12T02:43:17.326837+0000","last_clean":"2024-09-12T02:43:17.326837+0000","last_became_active":"2024-09-12T02:43:17.326141+0000","last_became_peered":"2024-09-12T02:43:17.326141+0000","last_unstale":"2024-09-12T02:43:17.326837+0000","last_undegraded":"2024-09-12T02:43:17.326837+0000","last_fullsized":"2024-09-12T02:43:17.326837+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:22.926332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.327684+0000","last_change":"2024-09-12T02:43:17.327383+0000","last_active":"2024-09-12T02:43:17.327684+0000","last_peered":"2024-09-12T02:43:17.327684+0000","last_clean":"2024-09-12T02:43:17.327684+0000","last_became_active":"2024-09-12T02:43:17.327133+0000","last_became_peered":"2024-09-12T02:43:17.327133+0000","last_unstale":"2024-09-12T02:43:17.327684+0000","last_undegraded":"2024-09-12T02:43:17.327684+0000","last_fullsized":"2024-09-12T02:43:17.327684+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:52.076196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.324649+0000","last_change":"2024-09-12T02:43:17.324130+0000","last_active":"2024-09-12T02:43:17.324649+0000","last_peered":"2024-09-12T02:43:17.324649+0000","last_clean":"2024-09-12T02:43:17.324649+0000","last_became_active":"2024-09-12T02:43:17.323756+0000","last_became_peered":"2024-09-12T02:43:17.323756+0000","last_unstale":"2024-09-12T02:43:17.324649+0000","last_undegraded":"2024-09-12T02:43:17.324649+0000","last_fullsized":"2024-09-12T02:43:17.324649+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:50.454130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.328473+0000","last_change":"2024-09-12T02:43:17.328372+0000","last_active":"2024-09-12T02:43:17.328473+0000","last_peered":"2024-09-12T02:43:17.328473+0000","last_clean":"2024-09-12T02:43:17.328473+0000","last_became_active":"2024-09-12T02:43:17.328106+0000","last_became_peered":"2024-09-12T02:43:17.328106+0000","last_unstale":"2024-09-12T02:43:17.328473+0000","last_undegraded":"2024-09-12T02:43:17.328473+0000","last_fullsized":"2024-09-12T02:43:17.328473+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:21.102288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.331247+0000","last_change":"2024-09-12T02:43:17.330525+0000","last_active":"2024-09-12T02:43:17.331247+0000","last_peered":"2024-09-12T02:43:17.331247+0000","last_clean":"2024-09-12T02:43:17.331247+0000","last_became_active":"2024-09-12T02:43:17.330322+0000","last_became_peered":"2024-09-12T02:43:17.330322+0000","last_unstale":"2024-09-12T02:43:17.331247+0000","last_undegraded":"2024-09-12T02:43:17.331247+0000","last_fullsized":"2024-09-12T02:43:17.331247+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:23.225387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.332317+0000","last_change":"2024-09-12T02:43:17.332175+0000","last_active":"2024-09-12T02:43:17.332317+0000","last_peered":"2024-09-12T02:43:17.332317+0000","last_clean":"2024-09-12T02:43:17.332317+0000","last_became_active":"2024-09-12T02:43:17.331933+0000","last_became_peered":"2024-09-12T02:43:17.331933+0000","last_unstale":"2024-09-12T02:43:17.332317+0000","last_undegraded":"2024-09-12T02:43:17.332317+0000","last_fullsized":"2024-09-12T02:43:17.332317+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:39.258581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.323942+0000","last_change":"2024-09-12T02:43:17.323500+0000","last_active":"2024-09-12T02:43:17.323942+0000","last_peered":"2024-09-12T02:43:17.323942+0000","last_clean":"2024-09-12T02:43:17.323942+0000","last_became_active":"2024-09-12T02:43:17.323281+0000","last_became_peered":"2024-09-12T02:43:17.323281+0000","last_unstale":"2024-09-12T02:43:17.323942+0000","last_undegraded":"2024-09-12T02:43:17.323942+0000","last_fullsized":"2024-09-12T02:43:17.323942+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:48.297840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.326192+0000","last_change":"2024-09-12T02:43:17.325704+0000","last_active":"2024-09-12T02:43:17.326192+0000","last_peered":"2024-09-12T02:43:17.326192+0000","last_clean":"2024-09-12T02:43:17.326192+0000","last_became_active":"2024-09-12T02:43:17.325170+0000","last_became_peered":"2024-09-12T02:43:17.325170+0000","last_unstale":"2024-09-12T02:43:17.326192+0000","last_undegraded":"2024-09-12T02:43:17.326192+0000","last_fullsized":"2024-09-12T02:43:17.326192+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:33.497990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.326240+0000","last_change":"2024-09-12T02:43:17.325819+0000","last_active":"2024-09-12T02:43:17.326240+0000","last_peered":"2024-09-12T02:43:17.326240+0000","last_clean":"2024-09-12T02:43:17.326240+0000","last_became_active":"2024-09-12T02:43:17.321660+0000","last_became_peered":"2024-09-12T02:43:17.321660+0000","last_unstale":"2024-09-12T02:43:17.326240+0000","last_undegraded":"2024-09-12T02:43:17.326240+0000","last_fullsized":"2024-09-12T02:43:17.326240+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:10:52.752870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.330905+0000","last_change":"2024-09-12T02:43:17.330788+0000","last_active":"2024-09-12T02:43:17.330905+0000","last_peered":"2024-09-12T02:43:17.330905+0000","last_clean":"2024-09-12T02:43:17.330905+0000","last_became_active":"2024-09-12T02:43:17.330497+0000","last_became_peered":"2024-09-12T02:43:17.330497+0000","last_unstale":"2024-09-12T02:43:17.330905+0000","last_undegraded":"2024-09-12T02:43:17.330905+0000","last_fullsized":"2024-09-12T02:43:17.330905+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:04.686873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.331316+0000","last_change":"2024-09-12T02:43:17.331158+0000","last_active":"2024-09-12T02:43:17.331316+0000","last_peered":"2024-09-12T02:43:17.331316+0000","last_clean":"2024-09-12T02:43:17.331316+0000","last_became_active":"2024-09-12T02:43:17.330888+0000","last_became_peered":"2024-09-12T02:43:17.330888+0000","last_unstale":"2024-09-12T02:43:17.331316+0000","last_undegraded":"2024-09-12T02:43:17.331316+0000","last_fullsized":"2024-09-12T02:43:17.331316+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:19.979689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.330365+0000","last_change":"2024-09-12T02:43:17.330249+0000","last_active":"2024-09-12T02:43:17.330365+0000","last_peered":"2024-09-12T02:43:17.330365+0000","last_clean":"2024-09-12T02:43:17.330365+0000","last_became_active":"2024-09-12T02:43:17.329884+0000","last_became_peered":"2024-09-12T02:43:17.329884+0000","last_unstale":"2024-09-12T02:43:17.330365+0000","last_undegraded":"2024-09-12T02:43:17.330365+0000","last_fullsized":"2024-09-12T02:43:17.330365+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:18.849513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.326209+0000","last_change":"2024-09-12T02:43:17.326083+0000","last_active":"2024-09-12T02:43:17.326209+0000","last_peered":"2024-09-12T02:43:17.326209+0000","last_clean":"2024-09-12T02:43:17.326209+0000","last_became_active":"2024-09-12T02:43:17.325468+0000","last_became_peered":"2024-09-12T02:43:17.325468+0000","last_unstale":"2024-09-12T02:43:17.326209+0000","last_undegraded":"2024-09-12T02:43:17.326209+0000","last_fullsized":"2024-09-12T02:43:17.326209+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:23.166366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.322218+0000","last_change":"2024-09-12T02:43:17.321702+0000","last_active":"2024-09-12T02:43:17.322218+0000","last_peered":"2024-09-12T02:43:17.322218+0000","last_clean":"2024-09-12T02:43:17.322218+0000","last_became_active":"2024-09-12T02:43:17.321442+0000","last_became_peered":"2024-09-12T02:43:17.321442+0000","last_unstale":"2024-09-12T02:43:17.322218+0000","last_undegraded":"2024-09-12T02:43:17.322218+0000","last_fullsized":"2024-09-12T02:43:17.322218+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:02.459462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.322948+0000","last_change":"2024-09-12T02:43:17.322584+0000","last_active":"2024-09-12T02:43:17.322948+0000","last_peered":"2024-09-12T02:43:17.322948+0000","last_clean":"2024-09-12T02:43:17.322948+0000","last_became_active":"2024-09-12T02:43:17.321620+0000","last_became_peered":"2024-09-12T02:43:17.321620+0000","last_unstale":"2024-09-12T02:43:17.322948+0000","last_undegraded":"2024-09-12T02:43:17.322948+0000","last_fullsized":"2024-09-12T02:43:17.322948+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:46.331441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.323197+0000","last_change":"2024-09-12T02:43:17.323004+0000","last_active":"2024-09-12T02:43:17.323197+0000","last_peered":"2024-09-12T02:43:17.323197+0000","last_clean":"2024-09-12T02:43:17.323197+0000","last_became_active":"2024-09-12T02:43:17.322443+0000","last_became_peered":"2024-09-12T02:43:17.322443+0000","last_unstale":"2024-09-12T02:43:17.323197+0000","last_undegraded":"2024-09-12T02:43:17.323197+0000","last_fullsized":"2024-09-12T02:43:17.323197+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:16.015810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.327102+0000","last_change":"2024-09-12T02:43:17.326809+0000","last_active":"2024-09-12T02:43:17.327102+0000","last_peered":"2024-09-12T02:43:17.327102+0000","last_clean":"2024-09-12T02:43:17.327102+0000","last_became_active":"2024-09-12T02:43:17.326499+0000","last_became_peered":"2024-09-12T02:43:17.326499+0000","last_unstale":"2024-09-12T02:43:17.327102+0000","last_undegraded":"2024-09-12T02:43:17.327102+0000","last_fullsized":"2024-09-12T02:43:17.327102+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:42.572939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.322920+0000","last_change":"2024-09-12T02:43:17.322455+0000","last_active":"2024-09-12T02:43:17.322920+0000","last_peered":"2024-09-12T02:43:17.322920+0000","last_clean":"2024-09-12T02:43:17.322920+0000","last_became_active":"2024-09-12T02:43:17.322164+0000","last_became_peered":"2024-09-12T02:43:17.322164+0000","last_unstale":"2024-09-12T02:43:17.322920+0000","last_undegraded":"2024-09-12T02:43:17.322920+0000","last_fullsized":"2024-09-12T02:43:17.322920+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:40.988648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.328574+0000","last_change":"2024-09-12T02:43:17.327156+0000","last_active":"2024-09-12T02:43:17.328574+0000","last_peered":"2024-09-12T02:43:17.328574+0000","last_clean":"2024-09-12T02:43:17.328574+0000","last_became_active":"2024-09-12T02:43:17.326927+0000","last_became_peered":"2024-09-12T02:43:17.326927+0000","last_unstale":"2024-09-12T02:43:17.328574+0000","last_undegraded":"2024-09-12T02:43:17.328574+0000","last_fullsized":"2024-09-12T02:43:17.328574+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:22.068142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.331231+0000","last_change":"2024-09-12T02:43:17.330051+0000","last_active":"2024-09-12T02:43:17.331231+0000","last_peered":"2024-09-12T02:43:17.331231+0000","last_clean":"2024-09-12T02:43:17.331231+0000","last_became_active":"2024-09-12T02:43:17.329551+0000","last_became_peered":"2024-09-12T02:43:17.329551+0000","last_unstale":"2024-09-12T02:43:17.331231+0000","last_undegraded":"2024-09-12T02:43:17.331231+0000","last_fullsized":"2024-09-12T02:43:17.331231+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:55.573198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.323925+0000","last_change":"2024-09-12T02:43:17.323390+0000","last_active":"2024-09-12T02:43:17.323925+0000","last_peered":"2024-09-12T02:43:17.323925+0000","last_clean":"2024-09-12T02:43:17.323925+0000","last_became_active":"2024-09-12T02:43:17.321842+0000","last_became_peered":"2024-09-12T02:43:17.321842+0000","last_unstale":"2024-09-12T02:43:17.323925+0000","last_undegraded":"2024-09-12T02:43:17.323925+0000","last_fullsized":"2024-09-12T02:43:17.323925+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:58.852326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.328181+0000","last_change":"2024-09-12T02:43:17.327525+0000","last_active":"2024-09-12T02:43:17.328181+0000","last_peered":"2024-09-12T02:43:17.328181+0000","last_clean":"2024-09-12T02:43:17.328181+0000","last_became_active":"2024-09-12T02:43:17.327282+0000","last_became_peered":"2024-09-12T02:43:17.327282+0000","last_unstale":"2024-09-12T02:43:17.328181+0000","last_undegraded":"2024-09-12T02:43:17.328181+0000","last_fullsized":"2024-09-12T02:43:17.328181+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.929536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.332099+0000","last_change":"2024-09-12T02:43:17.330766+0000","last_active":"2024-09-12T02:43:17.332099+0000","last_peered":"2024-09-12T02:43:17.332099+0000","last_clean":"2024-09-12T02:43:17.332099+0000","last_became_active":"2024-09-12T02:43:17.330532+0000","last_became_peered":"2024-09-12T02:43:17.330532+0000","last_unstale":"2024-09-12T02:43:17.332099+0000","last_undegraded":"2024-09-12T02:43:17.332099+0000","last_fullsized":"2024-09-12T02:43:17.332099+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:33.187030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.327281+0000","last_change":"2024-09-12T02:43:17.327144+0000","last_active":"2024-09-12T02:43:17.327281+0000","last_peered":"2024-09-12T02:43:17.327281+0000","last_clean":"2024-09-12T02:43:17.327281+0000","last_became_active":"2024-09-12T02:43:17.326744+0000","last_became_peered":"2024-09-12T02:43:17.326744+0000","last_unstale":"2024-09-12T02:43:17.327281+0000","last_undegraded":"2024-09-12T02:43:17.327281+0000","last_fullsized":"2024-09-12T02:43:17.327281+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:42.914526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.332013+0000","last_change":"2024-09-12T02:43:17.331921+0000","last_active":"2024-09-12T02:43:17.332013+0000","last_peered":"2024-09-12T02:43:17.332013+0000","last_clean":"2024-09-12T02:43:17.332013+0000","last_became_active":"2024-09-12T02:43:17.331638+0000","last_became_peered":"2024-09-12T02:43:17.331638+0000","last_unstale":"2024-09-12T02:43:17.332013+0000","last_undegraded":"2024-09-12T02:43:17.332013+0000","last_fullsized":"2024-09-12T02:43:17.332013+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:25.075663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.323310+0000","last_change":"2024-09-12T02:43:17.323203+0000","last_active":"2024-09-12T02:43:17.323310+0000","last_peered":"2024-09-12T02:43:17.323310+0000","last_clean":"2024-09-12T02:43:17.323310+0000","last_became_active":"2024-09-12T02:43:17.322746+0000","last_became_peered":"2024-09-12T02:43:17.322746+0000","last_unstale":"2024-09-12T02:43:17.323310+0000","last_undegraded":"2024-09-12T02:43:17.323310+0000","last_fullsized":"2024-09-12T02:43:17.323310+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:08.359400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.326113+0000","last_change":"2024-09-12T02:43:17.324095+0000","last_active":"2024-09-12T02:43:17.326113+0000","last_peered":"2024-09-12T02:43:17.326113+0000","last_clean":"2024-09-12T02:43:17.326113+0000","last_became_active":"2024-09-12T02:43:17.323845+0000","last_became_peered":"2024-09-12T02:43:17.323845+0000","last_unstale":"2024-09-12T02:43:17.326113+0000","last_undegraded":"2024-09-12T02:43:17.326113+0000","last_fullsized":"2024-09-12T02:43:17.326113+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:49.399950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.324735+0000","last_change":"2024-09-12T02:43:17.324467+0000","last_active":"2024-09-12T02:43:17.324735+0000","last_peered":"2024-09-12T02:43:17.324735+0000","last_clean":"2024-09-12T02:43:17.324735+0000","last_became_active":"2024-09-12T02:43:17.324135+0000","last_became_peered":"2024-09-12T02:43:17.324135+0000","last_unstale":"2024-09-12T02:43:17.324735+0000","last_undegraded":"2024-09-12T02:43:17.324735+0000","last_fullsized":"2024-09-12T02:43:17.324735+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:23.665508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.328712+0000","last_change":"2024-09-12T02:43:17.328385+0000","last_active":"2024-09-12T02:43:17.328712+0000","last_peered":"2024-09-12T02:43:17.328712+0000","last_clean":"2024-09-12T02:43:17.328712+0000","last_became_active":"2024-09-12T02:43:17.327909+0000","last_became_peered":"2024-09-12T02:43:17.327909+0000","last_unstale":"2024-09-12T02:43:17.328712+0000","last_undegraded":"2024-09-12T02:43:17.328712+0000","last_fullsized":"2024-09-12T02:43:17.328712+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:15.652731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.322235+0000","last_change":"2024-09-12T02:43:17.322110+0000","last_active":"2024-09-12T02:43:17.322235+0000","last_peered":"2024-09-12T02:43:17.322235+0000","last_clean":"2024-09-12T02:43:17.322235+0000","last_became_active":"2024-09-12T02:43:17.321882+0000","last_became_peered":"2024-09-12T02:43:17.321882+0000","last_unstale":"2024-09-12T02:43:17.322235+0000","last_undegraded":"2024-09-12T02:43:17.322235+0000","last_fullsized":"2024-09-12T02:43:17.322235+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:04.770455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.328054+0000","last_change":"2024-09-12T02:43:17.324808+0000","last_active":"2024-09-12T02:43:17.328054+0000","last_peered":"2024-09-12T02:43:17.328054+0000","last_clean":"2024-09-12T02:43:17.328054+0000","last_became_active":"2024-09-12T02:43:17.324578+0000","last_became_peered":"2024-09-12T02:43:17.324578+0000","last_unstale":"2024-09-12T02:43:17.328054+0000","last_undegraded":"2024-09-12T02:43:17.328054+0000","last_fullsized":"2024-09-12T02:43:17.328054+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:55.572985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.329400+0000","last_change":"2024-09-12T02:43:17.329270+0000","last_active":"2024-09-12T02:43:17.329400+0000","last_peered":"2024-09-12T02:43:17.329400+0000","last_clean":"2024-09-12T02:43:17.329400+0000","last_became_active":"2024-09-12T02:43:17.327230+0000","last_became_peered":"2024-09-12T02:43:17.327230+0000","last_unstale":"2024-09-12T02:43:17.329400+0000","last_undegraded":"2024-09-12T02:43:17.329400+0000","last_fullsized":"2024-09-12T02:43:17.329400+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:06.485330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.342206+0000","last_change":"2024-09-12T02:43:16.322281+0000","last_active":"2024-09-12T02:43:17.342206+0000","last_peered":"2024-09-12T02:43:17.342206+0000","last_clean":"2024-09-12T02:43:17.342206+0000","last_became_active":"2024-09-12T02:43:16.318306+0000","last_became_peered":"2024-09-12T02:43:16.318306+0000","last_unstale":"2024-09-12T02:43:17.342206+0000","last_undegraded":"2024-09-12T02:43:17.342206+0000","last_fullsized":"2024-09-12T02:43:17.342206+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:34.220102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.325662+0000","last_change":"2024-09-12T02:43:17.325547+0000","last_active":"2024-09-12T02:43:17.325662+0000","last_peered":"2024-09-12T02:43:17.325662+0000","last_clean":"2024-09-12T02:43:17.325662+0000","last_became_active":"2024-09-12T02:43:17.324995+0000","last_became_peered":"2024-09-12T02:43:17.324995+0000","last_unstale":"2024-09-12T02:43:17.325662+0000","last_undegraded":"2024-09-12T02:43:17.325662+0000","last_fullsized":"2024-09-12T02:43:17.325662+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:22.063273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.340496+0000","last_change":"2024-09-12T02:43:16.325259+0000","last_active":"2024-09-12T02:43:17.340496+0000","last_peered":"2024-09-12T02:43:17.340496+0000","last_clean":"2024-09-12T02:43:17.340496+0000","last_became_active":"2024-09-12T02:43:16.325037+0000","last_became_peered":"2024-09-12T02:43:16.325037+0000","last_unstale":"2024-09-12T02:43:17.340496+0000","last_undegraded":"2024-09-12T02:43:17.340496+0000","last_fullsized":"2024-09-12T02:43:17.340496+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:44.350476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.323606+0000","last_change":"2024-09-12T02:43:17.323241+0000","last_active":"2024-09-12T02:43:17.323606+0000","last_peered":"2024-09-12T02:43:17.323606+0000","last_clean":"2024-09-12T02:43:17.323606+0000","last_became_active":"2024-09-12T02:43:17.323021+0000","last_became_peered":"2024-09-12T02:43:17.323021+0000","last_unstale":"2024-09-12T02:43:17.323606+0000","last_undegraded":"2024-09-12T02:43:17.323606+0000","last_fullsized":"2024-09-12T02:43:17.323606+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:49.746634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.341875+0000","last_change":"2024-09-12T02:43:16.323625+0000","last_active":"2024-09-12T02:43:17.341875+0000","last_peered":"2024-09-12T02:43:17.341875+0000","last_clean":"2024-09-12T02:43:17.341875+0000","last_became_active":"2024-09-12T02:43:16.323148+0000","last_became_peered":"2024-09-12T02:43:16.323148+0000","last_unstale":"2024-09-12T02:43:17.341875+0000","last_undegraded":"2024-09-12T02:43:17.341875+0000","last_fullsized":"2024-09-12T02:43:17.341875+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:39:44.736616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.328946+0000","last_change":"2024-09-12T02:43:17.328812+0000","last_active":"2024-09-12T02:43:17.328946+0000","last_peered":"2024-09-12T02:43:17.328946+0000","last_clean":"2024-09-12T02:43:17.328946+0000","last_became_active":"2024-09-12T02:43:17.328570+0000","last_became_peered":"2024-09-12T02:43:17.328570+0000","last_unstale":"2024-09-12T02:43:17.328946+0000","last_undegraded":"2024-09-12T02:43:17.328946+0000","last_fullsized":"2024-09-12T02:43:17.328946+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:03.434111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.340729+0000","last_change":"2024-09-12T02:43:16.325999+0000","last_active":"2024-09-12T02:43:17.340729+0000","last_peered":"2024-09-12T02:43:17.340729+0000","last_clean":"2024-09-12T02:43:17.340729+0000","last_became_active":"2024-09-12T02:43:16.325752+0000","last_became_peered":"2024-09-12T02:43:16.325752+0000","last_unstale":"2024-09-12T02:43:17.340729+0000","last_undegraded":"2024-09-12T02:43:17.340729+0000","last_fullsized":"2024-09-12T02:43:17.340729+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:44.963845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.324311+0000","last_change":"2024-09-12T02:43:17.324121+0000","last_active":"2024-09-12T02:43:17.324311+0000","last_peered":"2024-09-12T02:43:17.324311+0000","last_clean":"2024-09-12T02:43:17.324311+0000","last_became_active":"2024-09-12T02:43:17.323868+0000","last_became_peered":"2024-09-12T02:43:17.323868+0000","last_unstale":"2024-09-12T02:43:17.324311+0000","last_undegraded":"2024-09-12T02:43:17.324311+0000","last_fullsized":"2024-09-12T02:43:17.324311+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:42.393771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.341650+0000","last_change":"2024-09-12T02:43:16.324798+0000","last_active":"2024-09-12T02:43:17.341650+0000","last_peered":"2024-09-12T02:43:17.341650+0000","last_clean":"2024-09-12T02:43:17.341650+0000","last_became_active":"2024-09-12T02:43:16.323764+0000","last_became_peered":"2024-09-12T02:43:16.323764+0000","last_unstale":"2024-09-12T02:43:17.341650+0000","last_undegraded":"2024-09-12T02:43:17.341650+0000","last_fullsized":"2024-09-12T02:43:17.341650+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:39.133992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.319716+0000","last_change":"2024-09-12T02:43:17.319498+0000","last_active":"2024-09-12T02:43:17.319716+0000","last_peered":"2024-09-12T02:43:17.319716+0000","last_clean":"2024-09-12T02:43:17.319716+0000","last_became_active":"2024-09-12T02:43:17.319285+0000","last_became_peered":"2024-09-12T02:43:17.319285+0000","last_unstale":"2024-09-12T02:43:17.319716+0000","last_undegraded":"2024-09-12T02:43:17.319716+0000","last_fullsized":"2024-09-12T02:43:17.319716+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:47.022985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.339826+0000","last_change":"2024-09-12T02:43:16.328028+0000","last_active":"2024-09-12T02:43:17.339826+0000","last_peered":"2024-09-12T02:43:17.339826+0000","last_clean":"2024-09-12T02:43:17.339826+0000","last_became_active":"2024-09-12T02:43:16.327266+0000","last_became_peered":"2024-09-12T02:43:16.327266+0000","last_unstale":"2024-09-12T02:43:17.339826+0000","last_undegraded":"2024-09-12T02:43:17.339826+0000","last_fullsized":"2024-09-12T02:43:17.339826+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:19.146014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.326630+0000","last_change":"2024-09-12T02:43:17.326461+0000","last_active":"2024-09-12T02:43:17.326630+0000","last_peered":"2024-09-12T02:43:17.326630+0000","last_clean":"2024-09-12T02:43:17.326630+0000","last_became_active":"2024-09-12T02:43:17.323708+0000","last_became_peered":"2024-09-12T02:43:17.323708+0000","last_unstale":"2024-09-12T02:43:17.326630+0000","last_undegraded":"2024-09-12T02:43:17.326630+0000","last_fullsized":"2024-09-12T02:43:17.326630+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:39.882514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.318125+0000","last_change":"2024-09-12T02:43:16.326057+0000","last_active":"2024-09-12T02:43:17.318125+0000","last_peered":"2024-09-12T02:43:17.318125+0000","last_clean":"2024-09-12T02:43:17.318125+0000","last_became_active":"2024-09-12T02:43:16.324702+0000","last_became_peered":"2024-09-12T02:43:16.324702+0000","last_unstale":"2024-09-12T02:43:17.318125+0000","last_undegraded":"2024-09-12T02:43:17.318125+0000","last_fullsized":"2024-09-12T02:43:17.318125+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:57.868872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.330531+0000","last_change":"2024-09-12T02:43:17.330262+0000","last_active":"2024-09-12T02:43:17.330531+0000","last_peered":"2024-09-12T02:43:17.330531+0000","last_clean":"2024-09-12T02:43:17.330531+0000","last_became_active":"2024-09-12T02:43:17.330039+0000","last_became_peered":"2024-09-12T02:43:17.330039+0000","last_unstale":"2024-09-12T02:43:17.330531+0000","last_undegraded":"2024-09-12T02:43:17.330531+0000","last_fullsized":"2024-09-12T02:43:17.330531+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:09.600614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.316193+0000","last_change":"2024-09-12T02:43:16.327379+0000","last_active":"2024-09-12T02:43:17.316193+0000","last_peered":"2024-09-12T02:43:17.316193+0000","last_clean":"2024-09-12T02:43:17.316193+0000","last_became_active":"2024-09-12T02:43:16.326283+0000","last_became_peered":"2024-09-12T02:43:16.326283+0000","last_unstale":"2024-09-12T02:43:17.316193+0000","last_undegraded":"2024-09-12T02:43:17.316193+0000","last_fullsized":"2024-09-12T02:43:17.316193+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:53.453697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.326752+0000","last_change":"2024-09-12T02:43:17.326318+0000","last_active":"2024-09-12T02:43:17.326752+0000","last_peered":"2024-09-12T02:43:17.326752+0000","last_clean":"2024-09-12T02:43:17.326752+0000","last_became_active":"2024-09-12T02:43:17.326079+0000","last_became_peered":"2024-09-12T02:43:17.326079+0000","last_unstale":"2024-09-12T02:43:17.326752+0000","last_undegraded":"2024-09-12T02:43:17.326752+0000","last_fullsized":"2024-09-12T02:43:17.326752+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:37:51.242925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.319025+0000","last_change":"2024-09-12T02:43:16.324761+0000","last_active":"2024-09-12T02:43:17.319025+0000","last_peered":"2024-09-12T02:43:17.319025+0000","last_clean":"2024-09-12T02:43:17.319025+0000","last_became_active":"2024-09-12T02:43:16.324420+0000","last_became_peered":"2024-09-12T02:43:16.324420+0000","last_unstale":"2024-09-12T02:43:17.319025+0000","last_undegraded":"2024-09-12T02:43:17.319025+0000","last_fullsized":"2024-09-12T02:43:17.319025+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:17.800772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.332962+0000","last_change":"2024-09-12T02:43:17.332777+0000","last_active":"2024-09-12T02:43:17.332962+0000","last_peered":"2024-09-12T02:43:17.332962+0000","last_clean":"2024-09-12T02:43:17.332962+0000","last_became_active":"2024-09-12T02:43:17.331994+0000","last_became_peered":"2024-09-12T02:43:17.331994+0000","last_unstale":"2024-09-12T02:43:17.332962+0000","last_undegraded":"2024-09-12T02:43:17.332962+0000","last_fullsized":"2024-09-12T02:43:17.332962+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:14.620932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.314989+0000","last_change":"2024-09-12T02:43:16.323190+0000","last_active":"2024-09-12T02:43:17.314989+0000","last_peered":"2024-09-12T02:43:17.314989+0000","last_clean":"2024-09-12T02:43:17.314989+0000","last_became_active":"2024-09-12T02:43:16.322287+0000","last_became_peered":"2024-09-12T02:43:16.322287+0000","last_unstale":"2024-09-12T02:43:17.314989+0000","last_undegraded":"2024-09-12T02:43:17.314989+0000","last_fullsized":"2024-09-12T02:43:17.314989+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:47.701769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.329263+0000","last_change":"2024-09-12T02:43:17.327288+0000","last_active":"2024-09-12T02:43:17.329263+0000","last_peered":"2024-09-12T02:43:17.329263+0000","last_clean":"2024-09-12T02:43:17.329263+0000","last_became_active":"2024-09-12T02:43:17.326860+0000","last_became_peered":"2024-09-12T02:43:17.326860+0000","last_unstale":"2024-09-12T02:43:17.329263+0000","last_undegraded":"2024-09-12T02:43:17.329263+0000","last_fullsized":"2024-09-12T02:43:17.329263+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:32.329865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.341868+0000","last_change":"2024-09-12T02:43:16.321514+0000","last_active":"2024-09-12T02:43:17.341868+0000","last_peered":"2024-09-12T02:43:17.341868+0000","last_clean":"2024-09-12T02:43:17.341868+0000","last_became_active":"2024-09-12T02:43:16.321262+0000","last_became_peered":"2024-09-12T02:43:16.321262+0000","last_unstale":"2024-09-12T02:43:17.341868+0000","last_undegraded":"2024-09-12T02:43:17.341868+0000","last_fullsized":"2024-09-12T02:43:17.341868+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:28.906774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.333208+0000","last_change":"2024-09-12T02:43:17.333070+0000","last_active":"2024-09-12T02:43:17.333208+0000","last_peered":"2024-09-12T02:43:17.333208+0000","last_clean":"2024-09-12T02:43:17.333208+0000","last_became_active":"2024-09-12T02:43:17.332818+0000","last_became_peered":"2024-09-12T02:43:17.332818+0000","last_unstale":"2024-09-12T02:43:17.333208+0000","last_undegraded":"2024-09-12T02:43:17.333208+0000","last_fullsized":"2024-09-12T02:43:17.333208+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:30.830714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.343981+0000","last_change":"2024-09-12T02:43:16.321994+0000","last_active":"2024-09-12T02:43:17.343981+0000","last_peered":"2024-09-12T02:43:17.343981+0000","last_clean":"2024-09-12T02:43:17.343981+0000","last_became_active":"2024-09-12T02:43:16.321767+0000","last_became_peered":"2024-09-12T02:43:16.321767+0000","last_unstale":"2024-09-12T02:43:17.343981+0000","last_undegraded":"2024-09-12T02:43:17.343981+0000","last_fullsized":"2024-09-12T02:43:17.343981+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:52.413869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.322901+0000","last_change":"2024-09-12T02:43:17.322363+0000","last_active":"2024-09-12T02:43:17.322901+0000","last_peered":"2024-09-12T02:43:17.322901+0000","last_clean":"2024-09-12T02:43:17.322901+0000","last_became_active":"2024-09-12T02:43:17.321376+0000","last_became_peered":"2024-09-12T02:43:17.321376+0000","last_unstale":"2024-09-12T02:43:17.322901+0000","last_undegraded":"2024-09-12T02:43:17.322901+0000","last_fullsized":"2024-09-12T02:43:17.322901+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:20.775533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.342718+0000","last_change":"2024-09-12T02:43:16.326115+0000","last_active":"2024-09-12T02:43:17.342718+0000","last_peered":"2024-09-12T02:43:17.342718+0000","last_clean":"2024-09-12T02:43:17.342718+0000","last_became_active":"2024-09-12T02:43:16.322310+0000","last_became_peered":"2024-09-12T02:43:16.322310+0000","last_unstale":"2024-09-12T02:43:17.342718+0000","last_undegraded":"2024-09-12T02:43:17.342718+0000","last_fullsized":"2024-09-12T02:43:17.342718+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:05.549086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.327501+0000","last_change":"2024-09-12T02:43:17.327376+0000","last_active":"2024-09-12T02:43:17.327501+0000","last_peered":"2024-09-12T02:43:17.327501+0000","last_clean":"2024-09-12T02:43:17.327501+0000","last_became_active":"2024-09-12T02:43:17.327122+0000","last_became_peered":"2024-09-12T02:43:17.327122+0000","last_unstale":"2024-09-12T02:43:17.327501+0000","last_undegraded":"2024-09-12T02:43:17.327501+0000","last_fullsized":"2024-09-12T02:43:17.327501+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:30.334612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.327317+0000","last_change":"2024-09-12T02:43:16.327765+0000","last_active":"2024-09-12T02:43:17.327317+0000","last_peered":"2024-09-12T02:43:17.327317+0000","last_clean":"2024-09-12T02:43:17.327317+0000","last_became_active":"2024-09-12T02:43:16.326440+0000","last_became_peered":"2024-09-12T02:43:16.326440+0000","last_unstale":"2024-09-12T02:43:17.327317+0000","last_undegraded":"2024-09-12T02:43:17.327317+0000","last_fullsized":"2024-09-12T02:43:17.327317+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:17.051362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.329242+0000","last_change":"2024-09-12T02:43:17.325010+0000","last_active":"2024-09-12T02:43:17.329242+0000","last_peered":"2024-09-12T02:43:17.329242+0000","last_clean":"2024-09-12T02:43:17.329242+0000","last_became_active":"2024-09-12T02:43:17.324789+0000","last_became_peered":"2024-09-12T02:43:17.324789+0000","last_unstale":"2024-09-12T02:43:17.329242+0000","last_undegraded":"2024-09-12T02:43:17.329242+0000","last_fullsized":"2024-09-12T02:43:17.329242+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:17:43.845088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.316464+0000","last_change":"2024-09-12T02:43:16.324586+0000","last_active":"2024-09-12T02:43:17.316464+0000","last_peered":"2024-09-12T02:43:17.316464+0000","last_clean":"2024-09-12T02:43:17.316464+0000","last_became_active":"2024-09-12T02:43:16.323452+0000","last_became_peered":"2024-09-12T02:43:16.323452+0000","last_unstale":"2024-09-12T02:43:17.316464+0000","last_undegraded":"2024-09-12T02:43:17.316464+0000","last_fullsized":"2024-09-12T02:43:17.316464+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:31.174067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.329274+0000","last_change":"2024-09-12T02:43:17.329048+0000","last_active":"2024-09-12T02:43:17.329274+0000","last_peered":"2024-09-12T02:43:17.329274+0000","last_clean":"2024-09-12T02:43:17.329274+0000","last_became_active":"2024-09-12T02:43:17.328796+0000","last_became_peered":"2024-09-12T02:43:17.328796+0000","last_unstale":"2024-09-12T02:43:17.329274+0000","last_undegraded":"2024-09-12T02:43:17.329274+0000","last_fullsized":"2024-09-12T02:43:17.329274+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:03.934370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":20,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.343516+0000","last_change":"2024-09-12T02:43:16.322894+0000","last_active":"2024-09-12T02:43:17.343516+0000","last_peered":"2024-09-12T02:43:17.343516+0000","last_clean":"2024-09-12T02:43:17.343516+0000","last_became_active":"2024-09-12T02:43:16.320268+0000","last_became_peered":"2024-09-12T02:43:16.320268+0000","last_unstale":"2024-09-12T02:43:17.343516+0000","last_undegraded":"2024-09-12T02:43:17.343516+0000","last_fullsized":"2024-09-12T02:43:17.343516+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:12.492472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.320720+0000","last_change":"2024-09-12T02:43:17.320189+0000","last_active":"2024-09-12T02:43:17.320720+0000","last_peered":"2024-09-12T02:43:17.320720+0000","last_clean":"2024-09-12T02:43:17.320720+0000","last_became_active":"2024-09-12T02:43:17.319946+0000","last_became_peered":"2024-09-12T02:43:17.319946+0000","last_unstale":"2024-09-12T02:43:17.320720+0000","last_undegraded":"2024-09-12T02:43:17.320720+0000","last_fullsized":"2024-09-12T02:43:17.320720+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:48.948213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.342556+0000","last_change":"2024-09-12T02:43:16.325623+0000","last_active":"2024-09-12T02:43:17.342556+0000","last_peered":"2024-09-12T02:43:17.342556+0000","last_clean":"2024-09-12T02:43:17.342556+0000","last_became_active":"2024-09-12T02:43:16.325386+0000","last_became_peered":"2024-09-12T02:43:16.325386+0000","last_unstale":"2024-09-12T02:43:17.342556+0000","last_undegraded":"2024-09-12T02:43:17.342556+0000","last_fullsized":"2024-09-12T02:43:17.342556+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:00.823473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.320774+0000","last_change":"2024-09-12T02:43:17.320527+0000","last_active":"2024-09-12T02:43:17.320774+0000","last_peered":"2024-09-12T02:43:17.320774+0000","last_clean":"2024-09-12T02:43:17.320774+0000","last_became_active":"2024-09-12T02:43:17.319566+0000","last_became_peered":"2024-09-12T02:43:17.319566+0000","last_unstale":"2024-09-12T02:43:17.320774+0000","last_undegraded":"2024-09-12T02:43:17.320774+0000","last_fullsized":"2024-09-12T02:43:17.320774+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:39:56.280851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.342653+0000","last_change":"2024-09-12T02:43:16.328368+0000","last_active":"2024-09-12T02:43:17.342653+0000","last_peered":"2024-09-12T02:43:17.342653+0000","last_clean":"2024-09-12T02:43:17.342653+0000","last_became_active":"2024-09-12T02:43:16.327433+0000","last_became_peered":"2024-09-12T02:43:16.327433+0000","last_unstale":"2024-09-12T02:43:17.342653+0000","last_undegraded":"2024-09-12T02:43:17.342653+0000","last_fullsized":"2024-09-12T02:43:17.342653+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:03.888166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.324343+0000","last_change":"2024-09-12T02:43:17.324049+0000","last_active":"2024-09-12T02:43:17.324343+0000","last_peered":"2024-09-12T02:43:17.324343+0000","last_clean":"2024-09-12T02:43:17.324343+0000","last_became_active":"2024-09-12T02:43:17.323667+0000","last_became_peered":"2024-09-12T02:43:17.323667+0000","last_unstale":"2024-09-12T02:43:17.324343+0000","last_undegraded":"2024-09-12T02:43:17.324343+0000","last_fullsized":"2024-09-12T02:43:17.324343+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:54.051267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.342665+0000","last_change":"2024-09-12T02:43:16.320396+0000","last_active":"2024-09-12T02:43:17.342665+0000","last_peered":"2024-09-12T02:43:17.342665+0000","last_clean":"2024-09-12T02:43:17.342665+0000","last_became_active":"2024-09-12T02:43:16.319739+0000","last_became_peered":"2024-09-12T02:43:16.319739+0000","last_unstale":"2024-09-12T02:43:17.342665+0000","last_undegraded":"2024-09-12T02:43:17.342665+0000","last_fullsized":"2024-09-12T02:43:17.342665+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:43.628102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.327263+0000","last_change":"2024-09-12T02:43:17.327043+0000","last_active":"2024-09-12T02:43:17.327263+0000","last_peered":"2024-09-12T02:43:17.327263+0000","last_clean":"2024-09-12T02:43:17.327263+0000","last_became_active":"2024-09-12T02:43:17.326744+0000","last_became_peered":"2024-09-12T02:43:17.326744+0000","last_unstale":"2024-09-12T02:43:17.327263+0000","last_undegraded":"2024-09-12T02:43:17.327263+0000","last_fullsized":"2024-09-12T02:43:17.327263+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:05.929394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.316598+0000","last_change":"2024-09-12T02:43:16.324393+0000","last_active":"2024-09-12T02:43:17.316598+0000","last_peered":"2024-09-12T02:43:17.316598+0000","last_clean":"2024-09-12T02:43:17.316598+0000","last_became_active":"2024-09-12T02:43:16.322779+0000","last_became_peered":"2024-09-12T02:43:16.322779+0000","last_unstale":"2024-09-12T02:43:17.316598+0000","last_undegraded":"2024-09-12T02:43:17.316598+0000","last_fullsized":"2024-09-12T02:43:17.316598+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:31.350638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.329280+0000","last_change":"2024-09-12T02:43:17.327436+0000","last_active":"2024-09-12T02:43:17.329280+0000","last_peered":"2024-09-12T02:43:17.329280+0000","last_clean":"2024-09-12T02:43:17.329280+0000","last_became_active":"2024-09-12T02:43:17.327109+0000","last_became_peered":"2024-09-12T02:43:17.327109+0000","last_unstale":"2024-09-12T02:43:17.329280+0000","last_undegraded":"2024-09-12T02:43:17.329280+0000","last_fullsized":"2024-09-12T02:43:17.329280+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:46.171651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.341998+0000","last_change":"2024-09-12T02:43:16.322449+0000","last_active":"2024-09-12T02:43:17.341998+0000","last_peered":"2024-09-12T02:43:17.341998+0000","last_clean":"2024-09-12T02:43:17.341998+0000","last_became_active":"2024-09-12T02:43:16.322060+0000","last_became_peered":"2024-09-12T02:43:16.322060+0000","last_unstale":"2024-09-12T02:43:17.341998+0000","last_undegraded":"2024-09-12T02:43:17.341998+0000","last_fullsized":"2024-09-12T02:43:17.341998+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:59.230282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.328805+0000","last_change":"2024-09-12T02:43:17.326787+0000","last_active":"2024-09-12T02:43:17.328805+0000","last_peered":"2024-09-12T02:43:17.328805+0000","last_clean":"2024-09-12T02:43:17.328805+0000","last_became_active":"2024-09-12T02:43:17.323509+0000","last_became_peered":"2024-09-12T02:43:17.323509+0000","last_unstale":"2024-09-12T02:43:17.328805+0000","last_undegraded":"2024-09-12T02:43:17.328805+0000","last_fullsized":"2024-09-12T02:43:17.328805+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:02.016246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.318254+0000","last_change":"2024-09-12T02:43:16.323267+0000","last_active":"2024-09-12T02:43:17.318254+0000","last_peered":"2024-09-12T02:43:17.318254+0000","last_clean":"2024-09-12T02:43:17.318254+0000","last_became_active":"2024-09-12T02:43:16.323027+0000","last_became_peered":"2024-09-12T02:43:16.323027+0000","last_unstale":"2024-09-12T02:43:17.318254+0000","last_undegraded":"2024-09-12T02:43:17.318254+0000","last_fullsized":"2024-09-12T02:43:17.318254+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:39.490296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.330273+0000","last_change":"2024-09-12T02:43:17.330165+0000","last_active":"2024-09-12T02:43:17.330273+0000","last_peered":"2024-09-12T02:43:17.330273+0000","last_clean":"2024-09-12T02:43:17.330273+0000","last_became_active":"2024-09-12T02:43:17.329930+0000","last_became_peered":"2024-09-12T02:43:17.329930+0000","last_unstale":"2024-09-12T02:43:17.330273+0000","last_undegraded":"2024-09-12T02:43:17.330273+0000","last_fullsized":"2024-09-12T02:43:17.330273+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:07.862402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.316323+0000","last_change":"2024-09-12T02:43:16.327200+0000","last_active":"2024-09-12T02:43:17.316323+0000","last_peered":"2024-09-12T02:43:17.316323+0000","last_clean":"2024-09-12T02:43:17.316323+0000","last_became_active":"2024-09-12T02:43:16.325916+0000","last_became_peered":"2024-09-12T02:43:16.325916+0000","last_unstale":"2024-09-12T02:43:17.316323+0000","last_undegraded":"2024-09-12T02:43:17.316323+0000","last_fullsized":"2024-09-12T02:43:17.316323+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:16.697797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.329691+0000","last_change":"2024-09-12T02:43:17.329122+0000","last_active":"2024-09-12T02:43:17.329691+0000","last_peered":"2024-09-12T02:43:17.329691+0000","last_clean":"2024-09-12T02:43:17.329691+0000","last_became_active":"2024-09-12T02:43:17.328899+0000","last_became_peered":"2024-09-12T02:43:17.328899+0000","last_unstale":"2024-09-12T02:43:17.329691+0000","last_undegraded":"2024-09-12T02:43:17.329691+0000","last_fullsized":"2024-09-12T02:43:17.329691+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:11.301490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.327446+0000","last_change":"2024-09-12T02:43:16.328137+0000","last_active":"2024-09-12T02:43:17.327446+0000","last_peered":"2024-09-12T02:43:17.327446+0000","last_clean":"2024-09-12T02:43:17.327446+0000","last_became_active":"2024-09-12T02:43:16.327507+0000","last_became_peered":"2024-09-12T02:43:16.327507+0000","last_unstale":"2024-09-12T02:43:17.327446+0000","last_undegraded":"2024-09-12T02:43:17.327446+0000","last_fullsized":"2024-09-12T02:43:17.327446+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:33.410274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.320297+0000","last_change":"2024-09-12T02:43:17.320019+0000","last_active":"2024-09-12T02:43:17.320297+0000","last_peered":"2024-09-12T02:43:17.320297+0000","last_clean":"2024-09-12T02:43:17.320297+0000","last_became_active":"2024-09-12T02:43:17.319763+0000","last_became_peered":"2024-09-12T02:43:17.319763+0000","last_unstale":"2024-09-12T02:43:17.320297+0000","last_undegraded":"2024-09-12T02:43:17.320297+0000","last_fullsized":"2024-09-12T02:43:17.320297+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:30:41.241073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.316016+0000","last_change":"2024-09-12T02:43:16.326022+0000","last_active":"2024-09-12T02:43:17.316016+0000","last_peered":"2024-09-12T02:43:17.316016+0000","last_clean":"2024-09-12T02:43:17.316016+0000","last_became_active":"2024-09-12T02:43:16.325793+0000","last_became_peered":"2024-09-12T02:43:16.325793+0000","last_unstale":"2024-09-12T02:43:17.316016+0000","last_undegraded":"2024-09-12T02:43:17.316016+0000","last_fullsized":"2024-09-12T02:43:17.316016+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:01.213174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.327484+0000","last_change":"2024-09-12T02:43:17.326832+0000","last_active":"2024-09-12T02:43:17.327484+0000","last_peered":"2024-09-12T02:43:17.327484+0000","last_clean":"2024-09-12T02:43:17.327484+0000","last_became_active":"2024-09-12T02:43:17.325231+0000","last_became_peered":"2024-09-12T02:43:17.325231+0000","last_unstale":"2024-09-12T02:43:17.327484+0000","last_undegraded":"2024-09-12T02:43:17.327484+0000","last_fullsized":"2024-09-12T02:43:17.327484+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:43:07.885364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.328803+0000","last_change":"2024-09-12T02:43:16.320971+0000","last_active":"2024-09-12T02:43:17.328803+0000","last_peered":"2024-09-12T02:43:17.328803+0000","last_clean":"2024-09-12T02:43:17.328803+0000","last_became_active":"2024-09-12T02:43:16.320464+0000","last_became_peered":"2024-09-12T02:43:16.320464+0000","last_unstale":"2024-09-12T02:43:17.328803+0000","last_undegraded":"2024-09-12T02:43:17.328803+0000","last_fullsized":"2024-09-12T02:43:17.328803+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:26.313040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.333030+0000","last_change":"2024-09-12T02:43:17.332894+0000","last_active":"2024-09-12T02:43:17.333030+0000","last_peered":"2024-09-12T02:43:17.333030+0000","last_clean":"2024-09-12T02:43:17.333030+0000","last_became_active":"2024-09-12T02:43:17.332654+0000","last_became_peered":"2024-09-12T02:43:17.332654+0000","last_unstale":"2024-09-12T02:43:17.333030+0000","last_undegraded":"2024-09-12T02:43:17.333030+0000","last_fullsized":"2024-09-12T02:43:17.333030+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:11.204082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.325369+0000","last_change":"2024-09-12T02:43:16.323441+0000","last_active":"2024-09-12T02:43:17.325369+0000","last_peered":"2024-09-12T02:43:17.325369+0000","last_clean":"2024-09-12T02:43:17.325369+0000","last_became_active":"2024-09-12T02:43:16.322853+0000","last_became_peered":"2024-09-12T02:43:16.322853+0000","last_unstale":"2024-09-12T02:43:17.325369+0000","last_undegraded":"2024-09-12T02:43:17.325369+0000","last_fullsized":"2024-09-12T02:43:17.325369+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:39.083638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.329296+0000","last_change":"2024-09-12T02:43:17.328357+0000","last_active":"2024-09-12T02:43:17.329296+0000","last_peered":"2024-09-12T02:43:17.329296+0000","last_clean":"2024-09-12T02:43:17.329296+0000","last_became_active":"2024-09-12T02:43:17.326329+0000","last_became_peered":"2024-09-12T02:43:17.326329+0000","last_unstale":"2024-09-12T02:43:17.329296+0000","last_undegraded":"2024-09-12T02:43:17.329296+0000","last_fullsized":"2024-09-12T02:43:17.329296+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:46.968939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.327574+0000","last_change":"2024-09-12T02:43:16.324181+0000","last_active":"2024-09-12T02:43:17.327574+0000","last_peered":"2024-09-12T02:43:17.327574+0000","last_clean":"2024-09-12T02:43:17.327574+0000","last_became_active":"2024-09-12T02:43:16.323962+0000","last_became_peered":"2024-09-12T02:43:16.323962+0000","last_unstale":"2024-09-12T02:43:17.327574+0000","last_undegraded":"2024-09-12T02:43:17.327574+0000","last_fullsized":"2024-09-12T02:43:17.327574+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:00.441061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.331213+0000","last_change":"2024-09-12T02:43:17.329838+0000","last_active":"2024-09-12T02:43:17.331213+0000","last_peered":"2024-09-12T02:43:17.331213+0000","last_clean":"2024-09-12T02:43:17.331213+0000","last_became_active":"2024-09-12T02:43:17.324935+0000","last_became_peered":"2024-09-12T02:43:17.324935+0000","last_unstale":"2024-09-12T02:43:17.331213+0000","last_undegraded":"2024-09-12T02:43:17.331213+0000","last_fullsized":"2024-09-12T02:43:17.331213+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:11.206249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.318535+0000","last_change":"2024-09-12T02:43:16.327604+0000","last_active":"2024-09-12T02:43:17.318535+0000","last_peered":"2024-09-12T02:43:17.318535+0000","last_clean":"2024-09-12T02:43:17.318535+0000","last_became_active":"2024-09-12T02:43:16.327098+0000","last_became_peered":"2024-09-12T02:43:16.327098+0000","last_unstale":"2024-09-12T02:43:17.318535+0000","last_undegraded":"2024-09-12T02:43:17.318535+0000","last_fullsized":"2024-09-12T02:43:17.318535+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:21.653653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.329415+0000","last_change":"2024-09-12T02:43:17.329307+0000","last_active":"2024-09-12T02:43:17.329415+0000","last_peered":"2024-09-12T02:43:17.329415+0000","last_clean":"2024-09-12T02:43:17.329415+0000","last_became_active":"2024-09-12T02:43:17.329099+0000","last_became_peered":"2024-09-12T02:43:17.329099+0000","last_unstale":"2024-09-12T02:43:17.329415+0000","last_undegraded":"2024-09-12T02:43:17.329415+0000","last_fullsized":"2024-09-12T02:43:17.329415+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:56.245140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.323294+0000","last_change":"2024-09-12T02:43:16.319820+0000","last_active":"2024-09-12T02:43:17.323294+0000","last_peered":"2024-09-12T02:43:17.323294+0000","last_clean":"2024-09-12T02:43:17.323294+0000","last_became_active":"2024-09-12T02:43:16.319607+0000","last_became_peered":"2024-09-12T02:43:16.319607+0000","last_unstale":"2024-09-12T02:43:17.323294+0000","last_undegraded":"2024-09-12T02:43:17.323294+0000","last_fullsized":"2024-09-12T02:43:17.323294+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:09.314069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.325493+0000","last_change":"2024-09-12T02:43:17.325069+0000","last_active":"2024-09-12T02:43:17.325493+0000","last_peered":"2024-09-12T02:43:17.325493+0000","last_clean":"2024-09-12T02:43:17.325493+0000","last_became_active":"2024-09-12T02:43:17.324830+0000","last_became_peered":"2024-09-12T02:43:17.324830+0000","last_unstale":"2024-09-12T02:43:17.325493+0000","last_undegraded":"2024-09-12T02:43:17.325493+0000","last_fullsized":"2024-09-12T02:43:17.325493+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:29.436074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.315254+0000","last_change":"2024-09-12T02:43:16.318123+0000","last_active":"2024-09-12T02:43:17.315254+0000","last_peered":"2024-09-12T02:43:17.315254+0000","last_clean":"2024-09-12T02:43:17.315254+0000","last_became_active":"2024-09-12T02:43:16.317882+0000","last_became_peered":"2024-09-12T02:43:16.317882+0000","last_unstale":"2024-09-12T02:43:17.315254+0000","last_undegraded":"2024-09-12T02:43:17.315254+0000","last_fullsized":"2024-09-12T02:43:17.315254+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:08.224786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.328595+0000","last_change":"2024-09-12T02:43:17.328350+0000","last_active":"2024-09-12T02:43:17.328595+0000","last_peered":"2024-09-12T02:43:17.328595+0000","last_clean":"2024-09-12T02:43:17.328595+0000","last_became_active":"2024-09-12T02:43:17.328108+0000","last_became_peered":"2024-09-12T02:43:17.328108+0000","last_unstale":"2024-09-12T02:43:17.328595+0000","last_undegraded":"2024-09-12T02:43:17.328595+0000","last_fullsized":"2024-09-12T02:43:17.328595+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:13.345441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.342324+0000","last_change":"2024-09-12T02:43:16.326227+0000","last_active":"2024-09-12T02:43:17.342324+0000","last_peered":"2024-09-12T02:43:17.342324+0000","last_clean":"2024-09-12T02:43:17.342324+0000","last_became_active":"2024-09-12T02:43:16.325969+0000","last_became_peered":"2024-09-12T02:43:16.325969+0000","last_unstale":"2024-09-12T02:43:17.342324+0000","last_undegraded":"2024-09-12T02:43:17.342324+0000","last_fullsized":"2024-09-12T02:43:17.342324+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:57.149866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":212,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.328856+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:43:17.328856+0000","last_peered":"2024-09-12T02:43:17.328856+0000","last_clean":"2024-09-12T02:43:17.328856+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:43:17.328856+0000","last_undegraded":"2024-09-12T02:43:17.328856+0000","last_fullsized":"2024-09-12T02:43:17.328856+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:45.426902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":773,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194539,"statfs":{"total":200000000,"available":199208416,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":203,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195108,"statfs":{"total":200000000,"available":199791337,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199798784,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":204,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195107,"statfs":{"total":200000000,"available":199790397,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":203,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195108,"statfs":{"total":200000000,"available":199791371,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":204,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195107,"statfs":{"total":200000000,"available":199790375,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199798784,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":779,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194532,"statfs":{"total":200000000,"available":199201607,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:43:21.489 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:43:21.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.675+0000 7fbbb3200640 1 Processor -- start 2024-09-12T02:43:21.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.675+0000 7fbbb3200640 1 -- start start 2024-09-12T02:43:21.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.676+0000 7fbbb3200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbbb40b3e00 0x7fbbb40d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:21.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.676+0000 7fbbb3200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbbb40b1d70 0x7fbbb40b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:21.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.676+0000 7fbbb3200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbb40d2fb0 con 0x7fbbb40d1710 2024-09-12T02:43:21.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.676+0000 7fbbb3200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fbbb40d3cb0 con 0x7fbbb40b3e00 2024-09-12T02:43:21.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.676+0000 7fbbb3200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fbbb40d0b60 con 0x7fbbb40b1d70 2024-09-12T02:43:21.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.676+0000 7fbba9400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbbb40b3e00 0x7fbbb40d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:21.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.677+0000 7fbba9400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbbb40b3e00 0x7fbbb40d28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54886/0 (socket says 172.21.15.112:54886) 2024-09-12T02:43:21.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.677+0000 7fbba9400640 1 -- 172.21.15.112:0/2459074916 learned_addr learned my addr 172.21.15.112:0/2459074916 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:21.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.677+0000 7fbbb2800640 1 --2- 172.21.15.112:0/2459074916 >> v2:172.21.15.137:3300/0 conn(0x7fbbb40b1d70 0x7fbbb40b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:21.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.677+0000 7fbba9400640 1 -- 172.21.15.112:0/2459074916 >> v2:172.21.15.137:3300/0 conn(0x7fbbb40b1d70 msgr2=0x7fbbb40b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:21.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.677+0000 7fbba9400640 1 --2- 172.21.15.112:0/2459074916 >> v2:172.21.15.137:3300/0 conn(0x7fbbb40b1d70 0x7fbbb40b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:21.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.677+0000 7fbba9400640 1 -- 172.21.15.112:0/2459074916 >> v1:172.21.15.137:6789/0 conn(0x7fbbb40d1710 legacy=0x7fbbb40d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:21.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.677+0000 7fbba9400640 1 -- 172.21.15.112:0/2459074916 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb40d3410 con 0x7fbbb40b3e00 2024-09-12T02:43:21.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.678+0000 7fbba9400640 1 --2- 172.21.15.112:0/2459074916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbb40b3e00 0x7fbbb40d28d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbbb408ef20 tx=0x7fbb9c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daf4c0c009656895 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:21.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.678+0000 7fbbb1400640 1 -- 172.21.15.112:0/2459074916 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c037070 con 0x7fbbb40b3e00 2024-09-12T02:43:21.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.678+0000 7fbbb1400640 1 -- 172.21.15.112:0/2459074916 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb9c032440 con 0x7fbbb40b3e00 2024-09-12T02:43:21.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.678+0000 7fbbb1400640 1 -- 172.21.15.112:0/2459074916 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c032810 con 0x7fbbb40b3e00 2024-09-12T02:43:21.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.679+0000 7fbbb3200640 1 -- 172.21.15.112:0/2459074916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbb40b3e00 msgr2=0x7fbbb40d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:21.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.679+0000 7fbbb3200640 1 --2- 172.21.15.112:0/2459074916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbb40b3e00 0x7fbbb40d28d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbbb408ef20 tx=0x7fbb9c02a230 comp rx=0 tx=0).stop 2024-09-12T02:43:21.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.679+0000 7fbbb3200640 1 -- 172.21.15.112:0/2459074916 shutdown_connections 2024-09-12T02:43:21.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.679+0000 7fbbb3200640 1 --2- 172.21.15.112:0/2459074916 >> v2:172.21.15.137:3300/0 conn(0x7fbbb40b1d70 0x7fbbb40b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:21.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.679+0000 7fbbb3200640 1 --2- 172.21.15.112:0/2459074916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbb40b3e00 0x7fbbb40d28d0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:21.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.679+0000 7fbbb3200640 1 -- 172.21.15.112:0/2459074916 >> 172.21.15.112:0/2459074916 conn(0x7fbbb409e030 msgr2=0x7fbbb40d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:21.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.679+0000 7fbbb3200640 1 -- 172.21.15.112:0/2459074916 shutdown_connections 2024-09-12T02:43:21.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.679+0000 7fbbb3200640 1 -- 172.21.15.112:0/2459074916 wait complete. 2024-09-12T02:43:21.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.680+0000 7fbbb3200640 1 Processor -- start 2024-09-12T02:43:21.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.681+0000 7fbbb3200640 1 -- start start 2024-09-12T02:43:21.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.681+0000 7fbbb3200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbbb40b1d70 0x7fbbb40cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:21.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.681+0000 7fbbb3200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbb40b3e00 0x7fbbb414f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:21.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.681+0000 7fbbb3200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbb40d1710 0x7fbbb40cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:21.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.682+0000 7fbbb3200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb415f110 con 0x7fbbb40d1710 2024-09-12T02:43:21.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.682+0000 7fbbb3200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb40d39d0 con 0x7fbbb40b3e00 2024-09-12T02:43:21.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.682+0000 7fbbb3200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbbb415f290 con 0x7fbbb40b1d70 2024-09-12T02:43:21.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.682+0000 7fbbb2800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbb40d1710 0x7fbbb40cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:21.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.682+0000 7fbbb2800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbb40d1710 0x7fbbb40cbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54890/0 (socket says 172.21.15.112:54890) 2024-09-12T02:43:21.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.682+0000 7fbbb2800640 1 -- 172.21.15.112:0/1347395155 learned_addr learned my addr 172.21.15.112:0/1347395155 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:21.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.682+0000 7fbbb1e00640 1 --2- 172.21.15.112:0/1347395155 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbbb40b1d70 0x7fbbb40cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:21.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.682+0000 7fbba9400640 1 --2- 172.21.15.112:0/1347395155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbb40b3e00 0x7fbbb414f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:21.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.682+0000 7fbbb2800640 1 -- 172.21.15.112:0/1347395155 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbbb40b1d70 msgr2=0x7fbbb40cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:21.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.682+0000 7fbbb2800640 1 --2- 172.21.15.112:0/1347395155 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbbb40b1d70 0x7fbbb40cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:21.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.682+0000 7fbbb2800640 1 -- 172.21.15.112:0/1347395155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbb40b3e00 msgr2=0x7fbbb414f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:21.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.682+0000 7fbbb2800640 1 --2- 172.21.15.112:0/1347395155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbb40b3e00 0x7fbbb414f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:21.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.682+0000 7fbbb2800640 1 -- 172.21.15.112:0/1347395155 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb4160a20 con 0x7fbbb40d1710 2024-09-12T02:43:21.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.682+0000 7fbbb2800640 1 --2- 172.21.15.112:0/1347395155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbb40d1710 0x7fbbb40cbdd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fbbac007e70 tx=0x7fbbac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:21.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.683+0000 7fbbaaa00640 1 -- 172.21.15.112:0/1347395155 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbac014620 con 0x7fbbb40d1710 2024-09-12T02:43:21.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.683+0000 7fbbaaa00640 1 -- 172.21.15.112:0/1347395155 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbac019070 con 0x7fbbb40d1710 2024-09-12T02:43:21.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.683+0000 7fbbaaa00640 1 -- 172.21.15.112:0/1347395155 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbac014a20 con 0x7fbbb40d1710 2024-09-12T02:43:21.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.683+0000 7fbbb3200640 1 -- 172.21.15.112:0/1347395155 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbb4160d00 con 0x7fbbb40d1710 2024-09-12T02:43:21.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.683+0000 7fbbb3200640 1 -- 172.21.15.112:0/1347395155 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbb41612c0 con 0x7fbbb40d1710 2024-09-12T02:43:21.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.684+0000 7fbbb3200640 1 -- 172.21.15.112:0/1347395155 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbb40d28d0 con 0x7fbbb40d1710 2024-09-12T02:43:21.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.685+0000 7fbbaaa00640 1 -- 172.21.15.112:0/1347395155 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbbac014bc0 con 0x7fbbb40d1710 2024-09-12T02:43:21.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.685+0000 7fbbaaa00640 1 --2- 172.21.15.112:0/1347395155 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbb9006be60 0x7fbb9006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:21.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.686+0000 7fbbaaa00640 1 -- 172.21.15.112:0/1347395155 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fbbac08b710 con 0x7fbbb40d1710 2024-09-12T02:43:21.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.686+0000 7fbbb1e00640 1 --2- 172.21.15.112:0/1347395155 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbb9006be60 0x7fbb9006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:21.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.686+0000 7fbbb1e00640 1 --2- 172.21.15.112:0/1347395155 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbb9006be60 0x7fbb9006e320 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbba4006fd0 tx=0x7fbba4009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:21.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.690+0000 7fbbaaa00640 1 -- 172.21.15.112:0/1347395155 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbbac0599d0 con 0x7fbbb40d1710 2024-09-12T02:43:21.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.857+0000 7fbbb3200640 1 -- 172.21.15.112:0/1347395155 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbbb40b65a0 con 0x7fbb9006be60 2024-09-12T02:43:21.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.863+0000 7fbbaaa00640 1 -- 172.21.15.112:0/1347395155 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247420 (secure 0 0 0) 0x7fbbb40b65a0 con 0x7fbb9006be60 2024-09-12T02:43:21.867 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:21.868 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:43:21.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.867+0000 7fbbb3200640 1 -- 172.21.15.112:0/1347395155 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbb9006be60 msgr2=0x7fbb9006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:21.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.867+0000 7fbbb3200640 1 --2- 172.21.15.112:0/1347395155 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbb9006be60 0x7fbb9006e320 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbba4006fd0 tx=0x7fbba4009060 comp rx=0 tx=0).stop 2024-09-12T02:43:21.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.867+0000 7fbbb3200640 1 -- 172.21.15.112:0/1347395155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbb40d1710 msgr2=0x7fbbb40cbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:21.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.867+0000 7fbbb3200640 1 --2- 172.21.15.112:0/1347395155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbb40d1710 0x7fbbb40cbdd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fbbac007e70 tx=0x7fbbac00e4b0 comp rx=0 tx=0).stop 2024-09-12T02:43:21.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.867+0000 7fbbb3200640 1 -- 172.21.15.112:0/1347395155 shutdown_connections 2024-09-12T02:43:21.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.867+0000 7fbbb3200640 1 --2- 172.21.15.112:0/1347395155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbb40d1710 0x7fbbb40cbdd0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:21.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.867+0000 7fbbb3200640 1 --2- 172.21.15.112:0/1347395155 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbb9006be60 0x7fbb9006e320 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:21.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.867+0000 7fbbb3200640 1 --2- 172.21.15.112:0/1347395155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbb40b3e00 0x7fbbb414f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:21.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.867+0000 7fbbb3200640 1 --2- 172.21.15.112:0/1347395155 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbbb40b1d70 0x7fbbb40cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:21.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.867+0000 7fbbb3200640 1 -- 172.21.15.112:0/1347395155 >> 172.21.15.112:0/1347395155 conn(0x7fbbb409e030 msgr2=0x7fbbb406d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:21.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.867+0000 7fbbb3200640 1 -- 172.21.15.112:0/1347395155 shutdown_connections 2024-09-12T02:43:21.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:21.867+0000 7fbbb3200640 1 -- 172.21.15.112:0/1347395155 wait complete. 2024-09-12T02:43:21.884 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2024-09-12T02:43:20.978272+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2762,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559737,"statfs":{"total":1600000000,"available":1597171071,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.678513"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.330143+0000","last_change":"2024-09-12T02:43:17.329984+0000","last_active":"2024-09-12T02:43:17.330143+0000","last_peered":"2024-09-12T02:43:17.330143+0000","last_clean":"2024-09-12T02:43:17.330143+0000","last_became_active":"2024-09-12T02:43:17.329749+0000","last_became_peered":"2024-09-12T02:43:17.329749+0000","last_unstale":"2024-09-12T02:43:17.330143+0000","last_undegraded":"2024-09-12T02:43:17.330143+0000","last_fullsized":"2024-09-12T02:43:17.330143+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:27:46.889252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.326837+0000","last_change":"2024-09-12T02:43:17.326367+0000","last_active":"2024-09-12T02:43:17.326837+0000","last_peered":"2024-09-12T02:43:17.326837+0000","last_clean":"2024-09-12T02:43:17.326837+0000","last_became_active":"2024-09-12T02:43:17.326141+0000","last_became_peered":"2024-09-12T02:43:17.326141+0000","last_unstale":"2024-09-12T02:43:17.326837+0000","last_undegraded":"2024-09-12T02:43:17.326837+0000","last_fullsized":"2024-09-12T02:43:17.326837+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:22.926332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.327684+0000","last_change":"2024-09-12T02:43:17.327383+0000","last_active":"2024-09-12T02:43:17.327684+0000","last_peered":"2024-09-12T02:43:17.327684+0000","last_clean":"2024-09-12T02:43:17.327684+0000","last_became_active":"2024-09-12T02:43:17.327133+0000","last_became_peered":"2024-09-12T02:43:17.327133+0000","last_unstale":"2024-09-12T02:43:17.327684+0000","last_undegraded":"2024-09-12T02:43:17.327684+0000","last_fullsized":"2024-09-12T02:43:17.327684+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:52.076196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.324649+0000","last_change":"2024-09-12T02:43:17.324130+0000","last_active":"2024-09-12T02:43:17.324649+0000","last_peered":"2024-09-12T02:43:17.324649+0000","last_clean":"2024-09-12T02:43:17.324649+0000","last_became_active":"2024-09-12T02:43:17.323756+0000","last_became_peered":"2024-09-12T02:43:17.323756+0000","last_unstale":"2024-09-12T02:43:17.324649+0000","last_undegraded":"2024-09-12T02:43:17.324649+0000","last_fullsized":"2024-09-12T02:43:17.324649+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:50.454130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.328473+0000","last_change":"2024-09-12T02:43:17.328372+0000","last_active":"2024-09-12T02:43:17.328473+0000","last_peered":"2024-09-12T02:43:17.328473+0000","last_clean":"2024-09-12T02:43:17.328473+0000","last_became_active":"2024-09-12T02:43:17.328106+0000","last_became_peered":"2024-09-12T02:43:17.328106+0000","last_unstale":"2024-09-12T02:43:17.328473+0000","last_undegraded":"2024-09-12T02:43:17.328473+0000","last_fullsized":"2024-09-12T02:43:17.328473+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:21.102288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.331247+0000","last_change":"2024-09-12T02:43:17.330525+0000","last_active":"2024-09-12T02:43:17.331247+0000","last_peered":"2024-09-12T02:43:17.331247+0000","last_clean":"2024-09-12T02:43:17.331247+0000","last_became_active":"2024-09-12T02:43:17.330322+0000","last_became_peered":"2024-09-12T02:43:17.330322+0000","last_unstale":"2024-09-12T02:43:17.331247+0000","last_undegraded":"2024-09-12T02:43:17.331247+0000","last_fullsized":"2024-09-12T02:43:17.331247+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:23.225387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.332317+0000","last_change":"2024-09-12T02:43:17.332175+0000","last_active":"2024-09-12T02:43:17.332317+0000","last_peered":"2024-09-12T02:43:17.332317+0000","last_clean":"2024-09-12T02:43:17.332317+0000","last_became_active":"2024-09-12T02:43:17.331933+0000","last_became_peered":"2024-09-12T02:43:17.331933+0000","last_unstale":"2024-09-12T02:43:17.332317+0000","last_undegraded":"2024-09-12T02:43:17.332317+0000","last_fullsized":"2024-09-12T02:43:17.332317+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:39.258581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.323942+0000","last_change":"2024-09-12T02:43:17.323500+0000","last_active":"2024-09-12T02:43:17.323942+0000","last_peered":"2024-09-12T02:43:17.323942+0000","last_clean":"2024-09-12T02:43:17.323942+0000","last_became_active":"2024-09-12T02:43:17.323281+0000","last_became_peered":"2024-09-12T02:43:17.323281+0000","last_unstale":"2024-09-12T02:43:17.323942+0000","last_undegraded":"2024-09-12T02:43:17.323942+0000","last_fullsized":"2024-09-12T02:43:17.323942+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:48.297840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.326192+0000","last_change":"2024-09-12T02:43:17.325704+0000","last_active":"2024-09-12T02:43:17.326192+0000","last_peered":"2024-09-12T02:43:17.326192+0000","last_clean":"2024-09-12T02:43:17.326192+0000","last_became_active":"2024-09-12T02:43:17.325170+0000","last_became_peered":"2024-09-12T02:43:17.325170+0000","last_unstale":"2024-09-12T02:43:17.326192+0000","last_undegraded":"2024-09-12T02:43:17.326192+0000","last_fullsized":"2024-09-12T02:43:17.326192+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:33.497990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.326240+0000","last_change":"2024-09-12T02:43:17.325819+0000","last_active":"2024-09-12T02:43:17.326240+0000","last_peered":"2024-09-12T02:43:17.326240+0000","last_clean":"2024-09-12T02:43:17.326240+0000","last_became_active":"2024-09-12T02:43:17.321660+0000","last_became_peered":"2024-09-12T02:43:17.321660+0000","last_unstale":"2024-09-12T02:43:17.326240+0000","last_undegraded":"2024-09-12T02:43:17.326240+0000","last_fullsized":"2024-09-12T02:43:17.326240+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:10:52.752870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.330905+0000","last_change":"2024-09-12T02:43:17.330788+0000","last_active":"2024-09-12T02:43:17.330905+0000","last_peered":"2024-09-12T02:43:17.330905+0000","last_clean":"2024-09-12T02:43:17.330905+0000","last_became_active":"2024-09-12T02:43:17.330497+0000","last_became_peered":"2024-09-12T02:43:17.330497+0000","last_unstale":"2024-09-12T02:43:17.330905+0000","last_undegraded":"2024-09-12T02:43:17.330905+0000","last_fullsized":"2024-09-12T02:43:17.330905+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:04.686873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.331316+0000","last_change":"2024-09-12T02:43:17.331158+0000","last_active":"2024-09-12T02:43:17.331316+0000","last_peered":"2024-09-12T02:43:17.331316+0000","last_clean":"2024-09-12T02:43:17.331316+0000","last_became_active":"2024-09-12T02:43:17.330888+0000","last_became_peered":"2024-09-12T02:43:17.330888+0000","last_unstale":"2024-09-12T02:43:17.331316+0000","last_undegraded":"2024-09-12T02:43:17.331316+0000","last_fullsized":"2024-09-12T02:43:17.331316+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:19.979689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.330365+0000","last_change":"2024-09-12T02:43:17.330249+0000","last_active":"2024-09-12T02:43:17.330365+0000","last_peered":"2024-09-12T02:43:17.330365+0000","last_clean":"2024-09-12T02:43:17.330365+0000","last_became_active":"2024-09-12T02:43:17.329884+0000","last_became_peered":"2024-09-12T02:43:17.329884+0000","last_unstale":"2024-09-12T02:43:17.330365+0000","last_undegraded":"2024-09-12T02:43:17.330365+0000","last_fullsized":"2024-09-12T02:43:17.330365+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:18.849513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.326209+0000","last_change":"2024-09-12T02:43:17.326083+0000","last_active":"2024-09-12T02:43:17.326209+0000","last_peered":"2024-09-12T02:43:17.326209+0000","last_clean":"2024-09-12T02:43:17.326209+0000","last_became_active":"2024-09-12T02:43:17.325468+0000","last_became_peered":"2024-09-12T02:43:17.325468+0000","last_unstale":"2024-09-12T02:43:17.326209+0000","last_undegraded":"2024-09-12T02:43:17.326209+0000","last_fullsized":"2024-09-12T02:43:17.326209+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:23.166366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.322218+0000","last_change":"2024-09-12T02:43:17.321702+0000","last_active":"2024-09-12T02:43:17.322218+0000","last_peered":"2024-09-12T02:43:17.322218+0000","last_clean":"2024-09-12T02:43:17.322218+0000","last_became_active":"2024-09-12T02:43:17.321442+0000","last_became_peered":"2024-09-12T02:43:17.321442+0000","last_unstale":"2024-09-12T02:43:17.322218+0000","last_undegraded":"2024-09-12T02:43:17.322218+0000","last_fullsized":"2024-09-12T02:43:17.322218+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:02.459462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.322948+0000","last_change":"2024-09-12T02:43:17.322584+0000","last_active":"2024-09-12T02:43:17.322948+0000","last_peered":"2024-09-12T02:43:17.322948+0000","last_clean":"2024-09-12T02:43:17.322948+0000","last_became_active":"2024-09-12T02:43:17.321620+0000","last_became_peered":"2024-09-12T02:43:17.321620+0000","last_unstale":"2024-09-12T02:43:17.322948+0000","last_undegraded":"2024-09-12T02:43:17.322948+0000","last_fullsized":"2024-09-12T02:43:17.322948+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:46.331441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.323197+0000","last_change":"2024-09-12T02:43:17.323004+0000","last_active":"2024-09-12T02:43:17.323197+0000","last_peered":"2024-09-12T02:43:17.323197+0000","last_clean":"2024-09-12T02:43:17.323197+0000","last_became_active":"2024-09-12T02:43:17.322443+0000","last_became_peered":"2024-09-12T02:43:17.322443+0000","last_unstale":"2024-09-12T02:43:17.323197+0000","last_undegraded":"2024-09-12T02:43:17.323197+0000","last_fullsized":"2024-09-12T02:43:17.323197+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:16.015810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.327102+0000","last_change":"2024-09-12T02:43:17.326809+0000","last_active":"2024-09-12T02:43:17.327102+0000","last_peered":"2024-09-12T02:43:17.327102+0000","last_clean":"2024-09-12T02:43:17.327102+0000","last_became_active":"2024-09-12T02:43:17.326499+0000","last_became_peered":"2024-09-12T02:43:17.326499+0000","last_unstale":"2024-09-12T02:43:17.327102+0000","last_undegraded":"2024-09-12T02:43:17.327102+0000","last_fullsized":"2024-09-12T02:43:17.327102+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:42.572939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.322920+0000","last_change":"2024-09-12T02:43:17.322455+0000","last_active":"2024-09-12T02:43:17.322920+0000","last_peered":"2024-09-12T02:43:17.322920+0000","last_clean":"2024-09-12T02:43:17.322920+0000","last_became_active":"2024-09-12T02:43:17.322164+0000","last_became_peered":"2024-09-12T02:43:17.322164+0000","last_unstale":"2024-09-12T02:43:17.322920+0000","last_undegraded":"2024-09-12T02:43:17.322920+0000","last_fullsized":"2024-09-12T02:43:17.322920+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:40.988648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.328574+0000","last_change":"2024-09-12T02:43:17.327156+0000","last_active":"2024-09-12T02:43:17.328574+0000","last_peered":"2024-09-12T02:43:17.328574+0000","last_clean":"2024-09-12T02:43:17.328574+0000","last_became_active":"2024-09-12T02:43:17.326927+0000","last_became_peered":"2024-09-12T02:43:17.326927+0000","last_unstale":"2024-09-12T02:43:17.328574+0000","last_undegraded":"2024-09-12T02:43:17.328574+0000","last_fullsized":"2024-09-12T02:43:17.328574+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:22.068142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.331231+0000","last_change":"2024-09-12T02:43:17.330051+0000","last_active":"2024-09-12T02:43:17.331231+0000","last_peered":"2024-09-12T02:43:17.331231+0000","last_clean":"2024-09-12T02:43:17.331231+0000","last_became_active":"2024-09-12T02:43:17.329551+0000","last_became_peered":"2024-09-12T02:43:17.329551+0000","last_unstale":"2024-09-12T02:43:17.331231+0000","last_undegraded":"2024-09-12T02:43:17.331231+0000","last_fullsized":"2024-09-12T02:43:17.331231+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:55.573198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.323925+0000","last_change":"2024-09-12T02:43:17.323390+0000","last_active":"2024-09-12T02:43:17.323925+0000","last_peered":"2024-09-12T02:43:17.323925+0000","last_clean":"2024-09-12T02:43:17.323925+0000","last_became_active":"2024-09-12T02:43:17.321842+0000","last_became_peered":"2024-09-12T02:43:17.321842+0000","last_unstale":"2024-09-12T02:43:17.323925+0000","last_undegraded":"2024-09-12T02:43:17.323925+0000","last_fullsized":"2024-09-12T02:43:17.323925+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:58.852326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.328181+0000","last_change":"2024-09-12T02:43:17.327525+0000","last_active":"2024-09-12T02:43:17.328181+0000","last_peered":"2024-09-12T02:43:17.328181+0000","last_clean":"2024-09-12T02:43:17.328181+0000","last_became_active":"2024-09-12T02:43:17.327282+0000","last_became_peered":"2024-09-12T02:43:17.327282+0000","last_unstale":"2024-09-12T02:43:17.328181+0000","last_undegraded":"2024-09-12T02:43:17.328181+0000","last_fullsized":"2024-09-12T02:43:17.328181+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.929536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.332099+0000","last_change":"2024-09-12T02:43:17.330766+0000","last_active":"2024-09-12T02:43:17.332099+0000","last_peered":"2024-09-12T02:43:17.332099+0000","last_clean":"2024-09-12T02:43:17.332099+0000","last_became_active":"2024-09-12T02:43:17.330532+0000","last_became_peered":"2024-09-12T02:43:17.330532+0000","last_unstale":"2024-09-12T02:43:17.332099+0000","last_undegraded":"2024-09-12T02:43:17.332099+0000","last_fullsized":"2024-09-12T02:43:17.332099+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:33.187030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.327281+0000","last_change":"2024-09-12T02:43:17.327144+0000","last_active":"2024-09-12T02:43:17.327281+0000","last_peered":"2024-09-12T02:43:17.327281+0000","last_clean":"2024-09-12T02:43:17.327281+0000","last_became_active":"2024-09-12T02:43:17.326744+0000","last_became_peered":"2024-09-12T02:43:17.326744+0000","last_unstale":"2024-09-12T02:43:17.327281+0000","last_undegraded":"2024-09-12T02:43:17.327281+0000","last_fullsized":"2024-09-12T02:43:17.327281+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:42.914526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.332013+0000","last_change":"2024-09-12T02:43:17.331921+0000","last_active":"2024-09-12T02:43:17.332013+0000","last_peered":"2024-09-12T02:43:17.332013+0000","last_clean":"2024-09-12T02:43:17.332013+0000","last_became_active":"2024-09-12T02:43:17.331638+0000","last_became_peered":"2024-09-12T02:43:17.331638+0000","last_unstale":"2024-09-12T02:43:17.332013+0000","last_undegraded":"2024-09-12T02:43:17.332013+0000","last_fullsized":"2024-09-12T02:43:17.332013+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:25.075663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.323310+0000","last_change":"2024-09-12T02:43:17.323203+0000","last_active":"2024-09-12T02:43:17.323310+0000","last_peered":"2024-09-12T02:43:17.323310+0000","last_clean":"2024-09-12T02:43:17.323310+0000","last_became_active":"2024-09-12T02:43:17.322746+0000","last_became_peered":"2024-09-12T02:43:17.322746+0000","last_unstale":"2024-09-12T02:43:17.323310+0000","last_undegraded":"2024-09-12T02:43:17.323310+0000","last_fullsized":"2024-09-12T02:43:17.323310+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:08.359400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.326113+0000","last_change":"2024-09-12T02:43:17.324095+0000","last_active":"2024-09-12T02:43:17.326113+0000","last_peered":"2024-09-12T02:43:17.326113+0000","last_clean":"2024-09-12T02:43:17.326113+0000","last_became_active":"2024-09-12T02:43:17.323845+0000","last_became_peered":"2024-09-12T02:43:17.323845+0000","last_unstale":"2024-09-12T02:43:17.326113+0000","last_undegraded":"2024-09-12T02:43:17.326113+0000","last_fullsized":"2024-09-12T02:43:17.326113+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:49.399950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.324735+0000","last_change":"2024-09-12T02:43:17.324467+0000","last_active":"2024-09-12T02:43:17.324735+0000","last_peered":"2024-09-12T02:43:17.324735+0000","last_clean":"2024-09-12T02:43:17.324735+0000","last_became_active":"2024-09-12T02:43:17.324135+0000","last_became_peered":"2024-09-12T02:43:17.324135+0000","last_unstale":"2024-09-12T02:43:17.324735+0000","last_undegraded":"2024-09-12T02:43:17.324735+0000","last_fullsized":"2024-09-12T02:43:17.324735+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:23.665508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.328712+0000","last_change":"2024-09-12T02:43:17.328385+0000","last_active":"2024-09-12T02:43:17.328712+0000","last_peered":"2024-09-12T02:43:17.328712+0000","last_clean":"2024-09-12T02:43:17.328712+0000","last_became_active":"2024-09-12T02:43:17.327909+0000","last_became_peered":"2024-09-12T02:43:17.327909+0000","last_unstale":"2024-09-12T02:43:17.328712+0000","last_undegraded":"2024-09-12T02:43:17.328712+0000","last_fullsized":"2024-09-12T02:43:17.328712+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:15.652731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.322235+0000","last_change":"2024-09-12T02:43:17.322110+0000","last_active":"2024-09-12T02:43:17.322235+0000","last_peered":"2024-09-12T02:43:17.322235+0000","last_clean":"2024-09-12T02:43:17.322235+0000","last_became_active":"2024-09-12T02:43:17.321882+0000","last_became_peered":"2024-09-12T02:43:17.321882+0000","last_unstale":"2024-09-12T02:43:17.322235+0000","last_undegraded":"2024-09-12T02:43:17.322235+0000","last_fullsized":"2024-09-12T02:43:17.322235+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:04.770455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.328054+0000","last_change":"2024-09-12T02:43:17.324808+0000","last_active":"2024-09-12T02:43:17.328054+0000","last_peered":"2024-09-12T02:43:17.328054+0000","last_clean":"2024-09-12T02:43:17.328054+0000","last_became_active":"2024-09-12T02:43:17.324578+0000","last_became_peered":"2024-09-12T02:43:17.324578+0000","last_unstale":"2024-09-12T02:43:17.328054+0000","last_undegraded":"2024-09-12T02:43:17.328054+0000","last_fullsized":"2024-09-12T02:43:17.328054+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:55.572985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.329400+0000","last_change":"2024-09-12T02:43:17.329270+0000","last_active":"2024-09-12T02:43:17.329400+0000","last_peered":"2024-09-12T02:43:17.329400+0000","last_clean":"2024-09-12T02:43:17.329400+0000","last_became_active":"2024-09-12T02:43:17.327230+0000","last_became_peered":"2024-09-12T02:43:17.327230+0000","last_unstale":"2024-09-12T02:43:17.329400+0000","last_undegraded":"2024-09-12T02:43:17.329400+0000","last_fullsized":"2024-09-12T02:43:17.329400+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:06.485330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.342206+0000","last_change":"2024-09-12T02:43:16.322281+0000","last_active":"2024-09-12T02:43:17.342206+0000","last_peered":"2024-09-12T02:43:17.342206+0000","last_clean":"2024-09-12T02:43:17.342206+0000","last_became_active":"2024-09-12T02:43:16.318306+0000","last_became_peered":"2024-09-12T02:43:16.318306+0000","last_unstale":"2024-09-12T02:43:17.342206+0000","last_undegraded":"2024-09-12T02:43:17.342206+0000","last_fullsized":"2024-09-12T02:43:17.342206+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:34.220102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.325662+0000","last_change":"2024-09-12T02:43:17.325547+0000","last_active":"2024-09-12T02:43:17.325662+0000","last_peered":"2024-09-12T02:43:17.325662+0000","last_clean":"2024-09-12T02:43:17.325662+0000","last_became_active":"2024-09-12T02:43:17.324995+0000","last_became_peered":"2024-09-12T02:43:17.324995+0000","last_unstale":"2024-09-12T02:43:17.325662+0000","last_undegraded":"2024-09-12T02:43:17.325662+0000","last_fullsized":"2024-09-12T02:43:17.325662+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:22.063273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.340496+0000","last_change":"2024-09-12T02:43:16.325259+0000","last_active":"2024-09-12T02:43:17.340496+0000","last_peered":"2024-09-12T02:43:17.340496+0000","last_clean":"2024-09-12T02:43:17.340496+0000","last_became_active":"2024-09-12T02:43:16.325037+0000","last_became_peered":"2024-09-12T02:43:16.325037+0000","last_unstale":"2024-09-12T02:43:17.340496+0000","last_undegraded":"2024-09-12T02:43:17.340496+0000","last_fullsized":"2024-09-12T02:43:17.340496+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:44.350476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.323606+0000","last_change":"2024-09-12T02:43:17.323241+0000","last_active":"2024-09-12T02:43:17.323606+0000","last_peered":"2024-09-12T02:43:17.323606+0000","last_clean":"2024-09-12T02:43:17.323606+0000","last_became_active":"2024-09-12T02:43:17.323021+0000","last_became_peered":"2024-09-12T02:43:17.323021+0000","last_unstale":"2024-09-12T02:43:17.323606+0000","last_undegraded":"2024-09-12T02:43:17.323606+0000","last_fullsized":"2024-09-12T02:43:17.323606+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:49.746634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.341875+0000","last_change":"2024-09-12T02:43:16.323625+0000","last_active":"2024-09-12T02:43:17.341875+0000","last_peered":"2024-09-12T02:43:17.341875+0000","last_clean":"2024-09-12T02:43:17.341875+0000","last_became_active":"2024-09-12T02:43:16.323148+0000","last_became_peered":"2024-09-12T02:43:16.323148+0000","last_unstale":"2024-09-12T02:43:17.341875+0000","last_undegraded":"2024-09-12T02:43:17.341875+0000","last_fullsized":"2024-09-12T02:43:17.341875+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:39:44.736616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.328946+0000","last_change":"2024-09-12T02:43:17.328812+0000","last_active":"2024-09-12T02:43:17.328946+0000","last_peered":"2024-09-12T02:43:17.328946+0000","last_clean":"2024-09-12T02:43:17.328946+0000","last_became_active":"2024-09-12T02:43:17.328570+0000","last_became_peered":"2024-09-12T02:43:17.328570+0000","last_unstale":"2024-09-12T02:43:17.328946+0000","last_undegraded":"2024-09-12T02:43:17.328946+0000","last_fullsized":"2024-09-12T02:43:17.328946+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:03.434111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.340729+0000","last_change":"2024-09-12T02:43:16.325999+0000","last_active":"2024-09-12T02:43:17.340729+0000","last_peered":"2024-09-12T02:43:17.340729+0000","last_clean":"2024-09-12T02:43:17.340729+0000","last_became_active":"2024-09-12T02:43:16.325752+0000","last_became_peered":"2024-09-12T02:43:16.325752+0000","last_unstale":"2024-09-12T02:43:17.340729+0000","last_undegraded":"2024-09-12T02:43:17.340729+0000","last_fullsized":"2024-09-12T02:43:17.340729+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:44.963845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.324311+0000","last_change":"2024-09-12T02:43:17.324121+0000","last_active":"2024-09-12T02:43:17.324311+0000","last_peered":"2024-09-12T02:43:17.324311+0000","last_clean":"2024-09-12T02:43:17.324311+0000","last_became_active":"2024-09-12T02:43:17.323868+0000","last_became_peered":"2024-09-12T02:43:17.323868+0000","last_unstale":"2024-09-12T02:43:17.324311+0000","last_undegraded":"2024-09-12T02:43:17.324311+0000","last_fullsized":"2024-09-12T02:43:17.324311+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:42.393771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.341650+0000","last_change":"2024-09-12T02:43:16.324798+0000","last_active":"2024-09-12T02:43:17.341650+0000","last_peered":"2024-09-12T02:43:17.341650+0000","last_clean":"2024-09-12T02:43:17.341650+0000","last_became_active":"2024-09-12T02:43:16.323764+0000","last_became_peered":"2024-09-12T02:43:16.323764+0000","last_unstale":"2024-09-12T02:43:17.341650+0000","last_undegraded":"2024-09-12T02:43:17.341650+0000","last_fullsized":"2024-09-12T02:43:17.341650+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:39.133992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.319716+0000","last_change":"2024-09-12T02:43:17.319498+0000","last_active":"2024-09-12T02:43:17.319716+0000","last_peered":"2024-09-12T02:43:17.319716+0000","last_clean":"2024-09-12T02:43:17.319716+0000","last_became_active":"2024-09-12T02:43:17.319285+0000","last_became_peered":"2024-09-12T02:43:17.319285+0000","last_unstale":"2024-09-12T02:43:17.319716+0000","last_undegraded":"2024-09-12T02:43:17.319716+0000","last_fullsized":"2024-09-12T02:43:17.319716+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:47.022985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.339826+0000","last_change":"2024-09-12T02:43:16.328028+0000","last_active":"2024-09-12T02:43:17.339826+0000","last_peered":"2024-09-12T02:43:17.339826+0000","last_clean":"2024-09-12T02:43:17.339826+0000","last_became_active":"2024-09-12T02:43:16.327266+0000","last_became_peered":"2024-09-12T02:43:16.327266+0000","last_unstale":"2024-09-12T02:43:17.339826+0000","last_undegraded":"2024-09-12T02:43:17.339826+0000","last_fullsized":"2024-09-12T02:43:17.339826+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:19.146014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.326630+0000","last_change":"2024-09-12T02:43:17.326461+0000","last_active":"2024-09-12T02:43:17.326630+0000","last_peered":"2024-09-12T02:43:17.326630+0000","last_clean":"2024-09-12T02:43:17.326630+0000","last_became_active":"2024-09-12T02:43:17.323708+0000","last_became_peered":"2024-09-12T02:43:17.323708+0000","last_unstale":"2024-09-12T02:43:17.326630+0000","last_undegraded":"2024-09-12T02:43:17.326630+0000","last_fullsized":"2024-09-12T02:43:17.326630+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:39.882514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.318125+0000","last_change":"2024-09-12T02:43:16.326057+0000","last_active":"2024-09-12T02:43:17.318125+0000","last_peered":"2024-09-12T02:43:17.318125+0000","last_clean":"2024-09-12T02:43:17.318125+0000","last_became_active":"2024-09-12T02:43:16.324702+0000","last_became_peered":"2024-09-12T02:43:16.324702+0000","last_unstale":"2024-09-12T02:43:17.318125+0000","last_undegraded":"2024-09-12T02:43:17.318125+0000","last_fullsized":"2024-09-12T02:43:17.318125+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:57.868872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.330531+0000","last_change":"2024-09-12T02:43:17.330262+0000","last_active":"2024-09-12T02:43:17.330531+0000","last_peered":"2024-09-12T02:43:17.330531+0000","last_clean":"2024-09-12T02:43:17.330531+0000","last_became_active":"2024-09-12T02:43:17.330039+0000","last_became_peered":"2024-09-12T02:43:17.330039+0000","last_unstale":"2024-09-12T02:43:17.330531+0000","last_undegraded":"2024-09-12T02:43:17.330531+0000","last_fullsized":"2024-09-12T02:43:17.330531+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:09.600614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.316193+0000","last_change":"2024-09-12T02:43:16.327379+0000","last_active":"2024-09-12T02:43:17.316193+0000","last_peered":"2024-09-12T02:43:17.316193+0000","last_clean":"2024-09-12T02:43:17.316193+0000","last_became_active":"2024-09-12T02:43:16.326283+0000","last_became_peered":"2024-09-12T02:43:16.326283+0000","last_unstale":"2024-09-12T02:43:17.316193+0000","last_undegraded":"2024-09-12T02:43:17.316193+0000","last_fullsized":"2024-09-12T02:43:17.316193+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:53.453697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.326752+0000","last_change":"2024-09-12T02:43:17.326318+0000","last_active":"2024-09-12T02:43:17.326752+0000","last_peered":"2024-09-12T02:43:17.326752+0000","last_clean":"2024-09-12T02:43:17.326752+0000","last_became_active":"2024-09-12T02:43:17.326079+0000","last_became_peered":"2024-09-12T02:43:17.326079+0000","last_unstale":"2024-09-12T02:43:17.326752+0000","last_undegraded":"2024-09-12T02:43:17.326752+0000","last_fullsized":"2024-09-12T02:43:17.326752+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:37:51.242925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.319025+0000","last_change":"2024-09-12T02:43:16.324761+0000","last_active":"2024-09-12T02:43:17.319025+0000","last_peered":"2024-09-12T02:43:17.319025+0000","last_clean":"2024-09-12T02:43:17.319025+0000","last_became_active":"2024-09-12T02:43:16.324420+0000","last_became_peered":"2024-09-12T02:43:16.324420+0000","last_unstale":"2024-09-12T02:43:17.319025+0000","last_undegraded":"2024-09-12T02:43:17.319025+0000","last_fullsized":"2024-09-12T02:43:17.319025+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:17.800772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.332962+0000","last_change":"2024-09-12T02:43:17.332777+0000","last_active":"2024-09-12T02:43:17.332962+0000","last_peered":"2024-09-12T02:43:17.332962+0000","last_clean":"2024-09-12T02:43:17.332962+0000","last_became_active":"2024-09-12T02:43:17.331994+0000","last_became_peered":"2024-09-12T02:43:17.331994+0000","last_unstale":"2024-09-12T02:43:17.332962+0000","last_undegraded":"2024-09-12T02:43:17.332962+0000","last_fullsized":"2024-09-12T02:43:17.332962+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:14.620932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.314989+0000","last_change":"2024-09-12T02:43:16.323190+0000","last_active":"2024-09-12T02:43:17.314989+0000","last_peered":"2024-09-12T02:43:17.314989+0000","last_clean":"2024-09-12T02:43:17.314989+0000","last_became_active":"2024-09-12T02:43:16.322287+0000","last_became_peered":"2024-09-12T02:43:16.322287+0000","last_unstale":"2024-09-12T02:43:17.314989+0000","last_undegraded":"2024-09-12T02:43:17.314989+0000","last_fullsized":"2024-09-12T02:43:17.314989+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:47.701769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.329263+0000","last_change":"2024-09-12T02:43:17.327288+0000","last_active":"2024-09-12T02:43:17.329263+0000","last_peered":"2024-09-12T02:43:17.329263+0000","last_clean":"2024-09-12T02:43:17.329263+0000","last_became_active":"2024-09-12T02:43:17.326860+0000","last_became_peered":"2024-09-12T02:43:17.326860+0000","last_unstale":"2024-09-12T02:43:17.329263+0000","last_undegraded":"2024-09-12T02:43:17.329263+0000","last_fullsized":"2024-09-12T02:43:17.329263+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:32.329865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.341868+0000","last_change":"2024-09-12T02:43:16.321514+0000","last_active":"2024-09-12T02:43:17.341868+0000","last_peered":"2024-09-12T02:43:17.341868+0000","last_clean":"2024-09-12T02:43:17.341868+0000","last_became_active":"2024-09-12T02:43:16.321262+0000","last_became_peered":"2024-09-12T02:43:16.321262+0000","last_unstale":"2024-09-12T02:43:17.341868+0000","last_undegraded":"2024-09-12T02:43:17.341868+0000","last_fullsized":"2024-09-12T02:43:17.341868+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:28.906774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.333208+0000","last_change":"2024-09-12T02:43:17.333070+0000","last_active":"2024-09-12T02:43:17.333208+0000","last_peered":"2024-09-12T02:43:17.333208+0000","last_clean":"2024-09-12T02:43:17.333208+0000","last_became_active":"2024-09-12T02:43:17.332818+0000","last_became_peered":"2024-09-12T02:43:17.332818+0000","last_unstale":"2024-09-12T02:43:17.333208+0000","last_undegraded":"2024-09-12T02:43:17.333208+0000","last_fullsized":"2024-09-12T02:43:17.333208+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:30.830714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.343981+0000","last_change":"2024-09-12T02:43:16.321994+0000","last_active":"2024-09-12T02:43:17.343981+0000","last_peered":"2024-09-12T02:43:17.343981+0000","last_clean":"2024-09-12T02:43:17.343981+0000","last_became_active":"2024-09-12T02:43:16.321767+0000","last_became_peered":"2024-09-12T02:43:16.321767+0000","last_unstale":"2024-09-12T02:43:17.343981+0000","last_undegraded":"2024-09-12T02:43:17.343981+0000","last_fullsized":"2024-09-12T02:43:17.343981+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:52.413869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.322901+0000","last_change":"2024-09-12T02:43:17.322363+0000","last_active":"2024-09-12T02:43:17.322901+0000","last_peered":"2024-09-12T02:43:17.322901+0000","last_clean":"2024-09-12T02:43:17.322901+0000","last_became_active":"2024-09-12T02:43:17.321376+0000","last_became_peered":"2024-09-12T02:43:17.321376+0000","last_unstale":"2024-09-12T02:43:17.322901+0000","last_undegraded":"2024-09-12T02:43:17.322901+0000","last_fullsized":"2024-09-12T02:43:17.322901+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:20.775533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.342718+0000","last_change":"2024-09-12T02:43:16.326115+0000","last_active":"2024-09-12T02:43:17.342718+0000","last_peered":"2024-09-12T02:43:17.342718+0000","last_clean":"2024-09-12T02:43:17.342718+0000","last_became_active":"2024-09-12T02:43:16.322310+0000","last_became_peered":"2024-09-12T02:43:16.322310+0000","last_unstale":"2024-09-12T02:43:17.342718+0000","last_undegraded":"2024-09-12T02:43:17.342718+0000","last_fullsized":"2024-09-12T02:43:17.342718+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:05.549086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.327501+0000","last_change":"2024-09-12T02:43:17.327376+0000","last_active":"2024-09-12T02:43:17.327501+0000","last_peered":"2024-09-12T02:43:17.327501+0000","last_clean":"2024-09-12T02:43:17.327501+0000","last_became_active":"2024-09-12T02:43:17.327122+0000","last_became_peered":"2024-09-12T02:43:17.327122+0000","last_unstale":"2024-09-12T02:43:17.327501+0000","last_undegraded":"2024-09-12T02:43:17.327501+0000","last_fullsized":"2024-09-12T02:43:17.327501+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:30.334612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.327317+0000","last_change":"2024-09-12T02:43:16.327765+0000","last_active":"2024-09-12T02:43:17.327317+0000","last_peered":"2024-09-12T02:43:17.327317+0000","last_clean":"2024-09-12T02:43:17.327317+0000","last_became_active":"2024-09-12T02:43:16.326440+0000","last_became_peered":"2024-09-12T02:43:16.326440+0000","last_unstale":"2024-09-12T02:43:17.327317+0000","last_undegraded":"2024-09-12T02:43:17.327317+0000","last_fullsized":"2024-09-12T02:43:17.327317+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:17.051362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.329242+0000","last_change":"2024-09-12T02:43:17.325010+0000","last_active":"2024-09-12T02:43:17.329242+0000","last_peered":"2024-09-12T02:43:17.329242+0000","last_clean":"2024-09-12T02:43:17.329242+0000","last_became_active":"2024-09-12T02:43:17.324789+0000","last_became_peered":"2024-09-12T02:43:17.324789+0000","last_unstale":"2024-09-12T02:43:17.329242+0000","last_undegraded":"2024-09-12T02:43:17.329242+0000","last_fullsized":"2024-09-12T02:43:17.329242+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:17:43.845088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.316464+0000","last_change":"2024-09-12T02:43:16.324586+0000","last_active":"2024-09-12T02:43:17.316464+0000","last_peered":"2024-09-12T02:43:17.316464+0000","last_clean":"2024-09-12T02:43:17.316464+0000","last_became_active":"2024-09-12T02:43:16.323452+0000","last_became_peered":"2024-09-12T02:43:16.323452+0000","last_unstale":"2024-09-12T02:43:17.316464+0000","last_undegraded":"2024-09-12T02:43:17.316464+0000","last_fullsized":"2024-09-12T02:43:17.316464+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:31.174067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.329274+0000","last_change":"2024-09-12T02:43:17.329048+0000","last_active":"2024-09-12T02:43:17.329274+0000","last_peered":"2024-09-12T02:43:17.329274+0000","last_clean":"2024-09-12T02:43:17.329274+0000","last_became_active":"2024-09-12T02:43:17.328796+0000","last_became_peered":"2024-09-12T02:43:17.328796+0000","last_unstale":"2024-09-12T02:43:17.329274+0000","last_undegraded":"2024-09-12T02:43:17.329274+0000","last_fullsized":"2024-09-12T02:43:17.329274+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:03.934370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":20,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.343516+0000","last_change":"2024-09-12T02:43:16.322894+0000","last_active":"2024-09-12T02:43:17.343516+0000","last_peered":"2024-09-12T02:43:17.343516+0000","last_clean":"2024-09-12T02:43:17.343516+0000","last_became_active":"2024-09-12T02:43:16.320268+0000","last_became_peered":"2024-09-12T02:43:16.320268+0000","last_unstale":"2024-09-12T02:43:17.343516+0000","last_undegraded":"2024-09-12T02:43:17.343516+0000","last_fullsized":"2024-09-12T02:43:17.343516+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:12.492472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.320720+0000","last_change":"2024-09-12T02:43:17.320189+0000","last_active":"2024-09-12T02:43:17.320720+0000","last_peered":"2024-09-12T02:43:17.320720+0000","last_clean":"2024-09-12T02:43:17.320720+0000","last_became_active":"2024-09-12T02:43:17.319946+0000","last_became_peered":"2024-09-12T02:43:17.319946+0000","last_unstale":"2024-09-12T02:43:17.320720+0000","last_undegraded":"2024-09-12T02:43:17.320720+0000","last_fullsized":"2024-09-12T02:43:17.320720+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:48.948213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.342556+0000","last_change":"2024-09-12T02:43:16.325623+0000","last_active":"2024-09-12T02:43:17.342556+0000","last_peered":"2024-09-12T02:43:17.342556+0000","last_clean":"2024-09-12T02:43:17.342556+0000","last_became_active":"2024-09-12T02:43:16.325386+0000","last_became_peered":"2024-09-12T02:43:16.325386+0000","last_unstale":"2024-09-12T02:43:17.342556+0000","last_undegraded":"2024-09-12T02:43:17.342556+0000","last_fullsized":"2024-09-12T02:43:17.342556+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:00.823473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.320774+0000","last_change":"2024-09-12T02:43:17.320527+0000","last_active":"2024-09-12T02:43:17.320774+0000","last_peered":"2024-09-12T02:43:17.320774+0000","last_clean":"2024-09-12T02:43:17.320774+0000","last_became_active":"2024-09-12T02:43:17.319566+0000","last_became_peered":"2024-09-12T02:43:17.319566+0000","last_unstale":"2024-09-12T02:43:17.320774+0000","last_undegraded":"2024-09-12T02:43:17.320774+0000","last_fullsized":"2024-09-12T02:43:17.320774+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:39:56.280851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.342653+0000","last_change":"2024-09-12T02:43:16.328368+0000","last_active":"2024-09-12T02:43:17.342653+0000","last_peered":"2024-09-12T02:43:17.342653+0000","last_clean":"2024-09-12T02:43:17.342653+0000","last_became_active":"2024-09-12T02:43:16.327433+0000","last_became_peered":"2024-09-12T02:43:16.327433+0000","last_unstale":"2024-09-12T02:43:17.342653+0000","last_undegraded":"2024-09-12T02:43:17.342653+0000","last_fullsized":"2024-09-12T02:43:17.342653+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:03.888166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.324343+0000","last_change":"2024-09-12T02:43:17.324049+0000","last_active":"2024-09-12T02:43:17.324343+0000","last_peered":"2024-09-12T02:43:17.324343+0000","last_clean":"2024-09-12T02:43:17.324343+0000","last_became_active":"2024-09-12T02:43:17.323667+0000","last_became_peered":"2024-09-12T02:43:17.323667+0000","last_unstale":"2024-09-12T02:43:17.324343+0000","last_undegraded":"2024-09-12T02:43:17.324343+0000","last_fullsized":"2024-09-12T02:43:17.324343+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:54.051267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.342665+0000","last_change":"2024-09-12T02:43:16.320396+0000","last_active":"2024-09-12T02:43:17.342665+0000","last_peered":"2024-09-12T02:43:17.342665+0000","last_clean":"2024-09-12T02:43:17.342665+0000","last_became_active":"2024-09-12T02:43:16.319739+0000","last_became_peered":"2024-09-12T02:43:16.319739+0000","last_unstale":"2024-09-12T02:43:17.342665+0000","last_undegraded":"2024-09-12T02:43:17.342665+0000","last_fullsized":"2024-09-12T02:43:17.342665+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:43.628102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.327263+0000","last_change":"2024-09-12T02:43:17.327043+0000","last_active":"2024-09-12T02:43:17.327263+0000","last_peered":"2024-09-12T02:43:17.327263+0000","last_clean":"2024-09-12T02:43:17.327263+0000","last_became_active":"2024-09-12T02:43:17.326744+0000","last_became_peered":"2024-09-12T02:43:17.326744+0000","last_unstale":"2024-09-12T02:43:17.327263+0000","last_undegraded":"2024-09-12T02:43:17.327263+0000","last_fullsized":"2024-09-12T02:43:17.327263+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:05.929394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.316598+0000","last_change":"2024-09-12T02:43:16.324393+0000","last_active":"2024-09-12T02:43:17.316598+0000","last_peered":"2024-09-12T02:43:17.316598+0000","last_clean":"2024-09-12T02:43:17.316598+0000","last_became_active":"2024-09-12T02:43:16.322779+0000","last_became_peered":"2024-09-12T02:43:16.322779+0000","last_unstale":"2024-09-12T02:43:17.316598+0000","last_undegraded":"2024-09-12T02:43:17.316598+0000","last_fullsized":"2024-09-12T02:43:17.316598+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:31.350638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.329280+0000","last_change":"2024-09-12T02:43:17.327436+0000","last_active":"2024-09-12T02:43:17.329280+0000","last_peered":"2024-09-12T02:43:17.329280+0000","last_clean":"2024-09-12T02:43:17.329280+0000","last_became_active":"2024-09-12T02:43:17.327109+0000","last_became_peered":"2024-09-12T02:43:17.327109+0000","last_unstale":"2024-09-12T02:43:17.329280+0000","last_undegraded":"2024-09-12T02:43:17.329280+0000","last_fullsized":"2024-09-12T02:43:17.329280+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:46.171651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.341998+0000","last_change":"2024-09-12T02:43:16.322449+0000","last_active":"2024-09-12T02:43:17.341998+0000","last_peered":"2024-09-12T02:43:17.341998+0000","last_clean":"2024-09-12T02:43:17.341998+0000","last_became_active":"2024-09-12T02:43:16.322060+0000","last_became_peered":"2024-09-12T02:43:16.322060+0000","last_unstale":"2024-09-12T02:43:17.341998+0000","last_undegraded":"2024-09-12T02:43:17.341998+0000","last_fullsized":"2024-09-12T02:43:17.341998+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:59.230282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.328805+0000","last_change":"2024-09-12T02:43:17.326787+0000","last_active":"2024-09-12T02:43:17.328805+0000","last_peered":"2024-09-12T02:43:17.328805+0000","last_clean":"2024-09-12T02:43:17.328805+0000","last_became_active":"2024-09-12T02:43:17.323509+0000","last_became_peered":"2024-09-12T02:43:17.323509+0000","last_unstale":"2024-09-12T02:43:17.328805+0000","last_undegraded":"2024-09-12T02:43:17.328805+0000","last_fullsized":"2024-09-12T02:43:17.328805+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:02.016246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.318254+0000","last_change":"2024-09-12T02:43:16.323267+0000","last_active":"2024-09-12T02:43:17.318254+0000","last_peered":"2024-09-12T02:43:17.318254+0000","last_clean":"2024-09-12T02:43:17.318254+0000","last_became_active":"2024-09-12T02:43:16.323027+0000","last_became_peered":"2024-09-12T02:43:16.323027+0000","last_unstale":"2024-09-12T02:43:17.318254+0000","last_undegraded":"2024-09-12T02:43:17.318254+0000","last_fullsized":"2024-09-12T02:43:17.318254+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:39.490296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.330273+0000","last_change":"2024-09-12T02:43:17.330165+0000","last_active":"2024-09-12T02:43:17.330273+0000","last_peered":"2024-09-12T02:43:17.330273+0000","last_clean":"2024-09-12T02:43:17.330273+0000","last_became_active":"2024-09-12T02:43:17.329930+0000","last_became_peered":"2024-09-12T02:43:17.329930+0000","last_unstale":"2024-09-12T02:43:17.330273+0000","last_undegraded":"2024-09-12T02:43:17.330273+0000","last_fullsized":"2024-09-12T02:43:17.330273+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:07.862402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.316323+0000","last_change":"2024-09-12T02:43:16.327200+0000","last_active":"2024-09-12T02:43:17.316323+0000","last_peered":"2024-09-12T02:43:17.316323+0000","last_clean":"2024-09-12T02:43:17.316323+0000","last_became_active":"2024-09-12T02:43:16.325916+0000","last_became_peered":"2024-09-12T02:43:16.325916+0000","last_unstale":"2024-09-12T02:43:17.316323+0000","last_undegraded":"2024-09-12T02:43:17.316323+0000","last_fullsized":"2024-09-12T02:43:17.316323+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:16.697797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.329691+0000","last_change":"2024-09-12T02:43:17.329122+0000","last_active":"2024-09-12T02:43:17.329691+0000","last_peered":"2024-09-12T02:43:17.329691+0000","last_clean":"2024-09-12T02:43:17.329691+0000","last_became_active":"2024-09-12T02:43:17.328899+0000","last_became_peered":"2024-09-12T02:43:17.328899+0000","last_unstale":"2024-09-12T02:43:17.329691+0000","last_undegraded":"2024-09-12T02:43:17.329691+0000","last_fullsized":"2024-09-12T02:43:17.329691+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:11.301490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.327446+0000","last_change":"2024-09-12T02:43:16.328137+0000","last_active":"2024-09-12T02:43:17.327446+0000","last_peered":"2024-09-12T02:43:17.327446+0000","last_clean":"2024-09-12T02:43:17.327446+0000","last_became_active":"2024-09-12T02:43:16.327507+0000","last_became_peered":"2024-09-12T02:43:16.327507+0000","last_unstale":"2024-09-12T02:43:17.327446+0000","last_undegraded":"2024-09-12T02:43:17.327446+0000","last_fullsized":"2024-09-12T02:43:17.327446+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:33.410274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.320297+0000","last_change":"2024-09-12T02:43:17.320019+0000","last_active":"2024-09-12T02:43:17.320297+0000","last_peered":"2024-09-12T02:43:17.320297+0000","last_clean":"2024-09-12T02:43:17.320297+0000","last_became_active":"2024-09-12T02:43:17.319763+0000","last_became_peered":"2024-09-12T02:43:17.319763+0000","last_unstale":"2024-09-12T02:43:17.320297+0000","last_undegraded":"2024-09-12T02:43:17.320297+0000","last_fullsized":"2024-09-12T02:43:17.320297+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:30:41.241073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.316016+0000","last_change":"2024-09-12T02:43:16.326022+0000","last_active":"2024-09-12T02:43:17.316016+0000","last_peered":"2024-09-12T02:43:17.316016+0000","last_clean":"2024-09-12T02:43:17.316016+0000","last_became_active":"2024-09-12T02:43:16.325793+0000","last_became_peered":"2024-09-12T02:43:16.325793+0000","last_unstale":"2024-09-12T02:43:17.316016+0000","last_undegraded":"2024-09-12T02:43:17.316016+0000","last_fullsized":"2024-09-12T02:43:17.316016+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:01.213174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.327484+0000","last_change":"2024-09-12T02:43:17.326832+0000","last_active":"2024-09-12T02:43:17.327484+0000","last_peered":"2024-09-12T02:43:17.327484+0000","last_clean":"2024-09-12T02:43:17.327484+0000","last_became_active":"2024-09-12T02:43:17.325231+0000","last_became_peered":"2024-09-12T02:43:17.325231+0000","last_unstale":"2024-09-12T02:43:17.327484+0000","last_undegraded":"2024-09-12T02:43:17.327484+0000","last_fullsized":"2024-09-12T02:43:17.327484+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:43:07.885364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.328803+0000","last_change":"2024-09-12T02:43:16.320971+0000","last_active":"2024-09-12T02:43:17.328803+0000","last_peered":"2024-09-12T02:43:17.328803+0000","last_clean":"2024-09-12T02:43:17.328803+0000","last_became_active":"2024-09-12T02:43:16.320464+0000","last_became_peered":"2024-09-12T02:43:16.320464+0000","last_unstale":"2024-09-12T02:43:17.328803+0000","last_undegraded":"2024-09-12T02:43:17.328803+0000","last_fullsized":"2024-09-12T02:43:17.328803+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:26.313040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.333030+0000","last_change":"2024-09-12T02:43:17.332894+0000","last_active":"2024-09-12T02:43:17.333030+0000","last_peered":"2024-09-12T02:43:17.333030+0000","last_clean":"2024-09-12T02:43:17.333030+0000","last_became_active":"2024-09-12T02:43:17.332654+0000","last_became_peered":"2024-09-12T02:43:17.332654+0000","last_unstale":"2024-09-12T02:43:17.333030+0000","last_undegraded":"2024-09-12T02:43:17.333030+0000","last_fullsized":"2024-09-12T02:43:17.333030+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:11.204082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.325369+0000","last_change":"2024-09-12T02:43:16.323441+0000","last_active":"2024-09-12T02:43:17.325369+0000","last_peered":"2024-09-12T02:43:17.325369+0000","last_clean":"2024-09-12T02:43:17.325369+0000","last_became_active":"2024-09-12T02:43:16.322853+0000","last_became_peered":"2024-09-12T02:43:16.322853+0000","last_unstale":"2024-09-12T02:43:17.325369+0000","last_undegraded":"2024-09-12T02:43:17.325369+0000","last_fullsized":"2024-09-12T02:43:17.325369+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:39.083638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.329296+0000","last_change":"2024-09-12T02:43:17.328357+0000","last_active":"2024-09-12T02:43:17.329296+0000","last_peered":"2024-09-12T02:43:17.329296+0000","last_clean":"2024-09-12T02:43:17.329296+0000","last_became_active":"2024-09-12T02:43:17.326329+0000","last_became_peered":"2024-09-12T02:43:17.326329+0000","last_unstale":"2024-09-12T02:43:17.329296+0000","last_undegraded":"2024-09-12T02:43:17.329296+0000","last_fullsized":"2024-09-12T02:43:17.329296+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:46.968939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.327574+0000","last_change":"2024-09-12T02:43:16.324181+0000","last_active":"2024-09-12T02:43:17.327574+0000","last_peered":"2024-09-12T02:43:17.327574+0000","last_clean":"2024-09-12T02:43:17.327574+0000","last_became_active":"2024-09-12T02:43:16.323962+0000","last_became_peered":"2024-09-12T02:43:16.323962+0000","last_unstale":"2024-09-12T02:43:17.327574+0000","last_undegraded":"2024-09-12T02:43:17.327574+0000","last_fullsized":"2024-09-12T02:43:17.327574+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:00.441061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.331213+0000","last_change":"2024-09-12T02:43:17.329838+0000","last_active":"2024-09-12T02:43:17.331213+0000","last_peered":"2024-09-12T02:43:17.331213+0000","last_clean":"2024-09-12T02:43:17.331213+0000","last_became_active":"2024-09-12T02:43:17.324935+0000","last_became_peered":"2024-09-12T02:43:17.324935+0000","last_unstale":"2024-09-12T02:43:17.331213+0000","last_undegraded":"2024-09-12T02:43:17.331213+0000","last_fullsized":"2024-09-12T02:43:17.331213+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:11.206249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.318535+0000","last_change":"2024-09-12T02:43:16.327604+0000","last_active":"2024-09-12T02:43:17.318535+0000","last_peered":"2024-09-12T02:43:17.318535+0000","last_clean":"2024-09-12T02:43:17.318535+0000","last_became_active":"2024-09-12T02:43:16.327098+0000","last_became_peered":"2024-09-12T02:43:16.327098+0000","last_unstale":"2024-09-12T02:43:17.318535+0000","last_undegraded":"2024-09-12T02:43:17.318535+0000","last_fullsized":"2024-09-12T02:43:17.318535+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:21.653653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.329415+0000","last_change":"2024-09-12T02:43:17.329307+0000","last_active":"2024-09-12T02:43:17.329415+0000","last_peered":"2024-09-12T02:43:17.329415+0000","last_clean":"2024-09-12T02:43:17.329415+0000","last_became_active":"2024-09-12T02:43:17.329099+0000","last_became_peered":"2024-09-12T02:43:17.329099+0000","last_unstale":"2024-09-12T02:43:17.329415+0000","last_undegraded":"2024-09-12T02:43:17.329415+0000","last_fullsized":"2024-09-12T02:43:17.329415+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:56.245140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.323294+0000","last_change":"2024-09-12T02:43:16.319820+0000","last_active":"2024-09-12T02:43:17.323294+0000","last_peered":"2024-09-12T02:43:17.323294+0000","last_clean":"2024-09-12T02:43:17.323294+0000","last_became_active":"2024-09-12T02:43:16.319607+0000","last_became_peered":"2024-09-12T02:43:16.319607+0000","last_unstale":"2024-09-12T02:43:17.323294+0000","last_undegraded":"2024-09-12T02:43:17.323294+0000","last_fullsized":"2024-09-12T02:43:17.323294+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:09.314069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.325493+0000","last_change":"2024-09-12T02:43:17.325069+0000","last_active":"2024-09-12T02:43:17.325493+0000","last_peered":"2024-09-12T02:43:17.325493+0000","last_clean":"2024-09-12T02:43:17.325493+0000","last_became_active":"2024-09-12T02:43:17.324830+0000","last_became_peered":"2024-09-12T02:43:17.324830+0000","last_unstale":"2024-09-12T02:43:17.325493+0000","last_undegraded":"2024-09-12T02:43:17.325493+0000","last_fullsized":"2024-09-12T02:43:17.325493+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:29.436074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.315254+0000","last_change":"2024-09-12T02:43:16.318123+0000","last_active":"2024-09-12T02:43:17.315254+0000","last_peered":"2024-09-12T02:43:17.315254+0000","last_clean":"2024-09-12T02:43:17.315254+0000","last_became_active":"2024-09-12T02:43:16.317882+0000","last_became_peered":"2024-09-12T02:43:16.317882+0000","last_unstale":"2024-09-12T02:43:17.315254+0000","last_undegraded":"2024-09-12T02:43:17.315254+0000","last_fullsized":"2024-09-12T02:43:17.315254+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:08.224786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.328595+0000","last_change":"2024-09-12T02:43:17.328350+0000","last_active":"2024-09-12T02:43:17.328595+0000","last_peered":"2024-09-12T02:43:17.328595+0000","last_clean":"2024-09-12T02:43:17.328595+0000","last_became_active":"2024-09-12T02:43:17.328108+0000","last_became_peered":"2024-09-12T02:43:17.328108+0000","last_unstale":"2024-09-12T02:43:17.328595+0000","last_undegraded":"2024-09-12T02:43:17.328595+0000","last_fullsized":"2024-09-12T02:43:17.328595+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:16.299541+0000","last_clean_scrub_stamp":"2024-09-12T02:43:16.299541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:13.345441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.342324+0000","last_change":"2024-09-12T02:43:16.326227+0000","last_active":"2024-09-12T02:43:17.342324+0000","last_peered":"2024-09-12T02:43:17.342324+0000","last_clean":"2024-09-12T02:43:17.342324+0000","last_became_active":"2024-09-12T02:43:16.325969+0000","last_became_peered":"2024-09-12T02:43:16.325969+0000","last_unstale":"2024-09-12T02:43:17.342324+0000","last_undegraded":"2024-09-12T02:43:17.342324+0000","last_fullsized":"2024-09-12T02:43:17.342324+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:43:15.291539+0000","last_clean_scrub_stamp":"2024-09-12T02:43:15.291539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:57.149866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":212,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:43:17.328856+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:43:17.328856+0000","last_peered":"2024-09-12T02:43:17.328856+0000","last_clean":"2024-09-12T02:43:17.328856+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:43:17.328856+0000","last_undegraded":"2024-09-12T02:43:17.328856+0000","last_fullsized":"2024-09-12T02:43:17.328856+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:45.426902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":773,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194539,"statfs":{"total":200000000,"available":199208416,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":203,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195108,"statfs":{"total":200000000,"available":199791337,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199798784,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":204,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195107,"statfs":{"total":200000000,"available":199790397,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":203,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195108,"statfs":{"total":200000000,"available":199791371,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":204,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195107,"statfs":{"total":200000000,"available":199790375,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199798784,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":779,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194532,"statfs":{"total":200000000,"available":199201607,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:43:21.891 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:43:21.891 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T02:43:22.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.083+0000 7ff82aa00640 1 Processor -- start 2024-09-12T02:43:22.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.083+0000 7ff82aa00640 1 -- start start 2024-09-12T02:43:22.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.084+0000 7ff82aa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff82415f080 0x7ff8240d2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:22.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.084+0000 7ff82aa00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff8240d3490 0x7ff8240b7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:22.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.084+0000 7ff82aa00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8240d2660 con 0x7ff8240d59e0 2024-09-12T02:43:22.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.084+0000 7ff82aa00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff8240cf810 con 0x7ff8240d3490 2024-09-12T02:43:22.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.084+0000 7ff82aa00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff8240cfa90 con 0x7ff82415f080 2024-09-12T02:43:22.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.084+0000 7ff82a000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff8240d3490 0x7ff8240b7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:22.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.084+0000 7ff82a000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff8240d3490 0x7ff8240b7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40588/0 (socket says 172.21.15.112:40588) 2024-09-12T02:43:22.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.085+0000 7ff82a000640 1 -- 172.21.15.112:0/1819671857 learned_addr learned my addr 172.21.15.112:0/1819671857 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:22.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.085+0000 7ff829600640 1 --2- 172.21.15.112:0/1819671857 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff82415f080 0x7ff8240d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:22.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.085+0000 7ff82a000640 1 -- 172.21.15.112:0/1819671857 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff82415f080 msgr2=0x7ff8240d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:22.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.085+0000 7ff82a000640 1 --2- 172.21.15.112:0/1819671857 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff82415f080 0x7ff8240d2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:22.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.085+0000 7ff82a000640 1 -- 172.21.15.112:0/1819671857 >> v1:172.21.15.137:6789/0 conn(0x7ff8240d59e0 legacy=0x7ff8240d2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:22.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.085+0000 7ff82a000640 1 -- 172.21.15.112:0/1819671857 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8240cfd70 con 0x7ff8240d3490 2024-09-12T02:43:22.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.086+0000 7ff82a000640 1 --2- 172.21.15.112:0/1819671857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8240d3490 0x7ff8240b7b50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff81c009e50 tx=0x7ff81c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17fe476a0e0c3ce7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:22.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.086+0000 7ff823e00640 1 -- 172.21.15.112:0/1819671857 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff81c036070 con 0x7ff8240d3490 2024-09-12T02:43:22.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.086+0000 7ff823e00640 1 -- 172.21.15.112:0/1819671857 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff81c031600 con 0x7ff8240d3490 2024-09-12T02:43:22.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.086+0000 7ff823e00640 1 -- 172.21.15.112:0/1819671857 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff81c0319d0 con 0x7ff8240d3490 2024-09-12T02:43:22.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.087+0000 7ff82aa00640 1 -- 172.21.15.112:0/1819671857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8240d3490 msgr2=0x7ff8240b7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:22.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.087+0000 7ff82aa00640 1 --2- 172.21.15.112:0/1819671857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8240d3490 0x7ff8240b7b50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff81c009e50 tx=0x7ff81c02a7a0 comp rx=0 tx=0).stop 2024-09-12T02:43:22.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.087+0000 7ff82aa00640 1 -- 172.21.15.112:0/1819671857 shutdown_connections 2024-09-12T02:43:22.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.087+0000 7ff82aa00640 1 --2- 172.21.15.112:0/1819671857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8240d3490 0x7ff8240b7b50 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:22.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.087+0000 7ff82aa00640 1 --2- 172.21.15.112:0/1819671857 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff82415f080 0x7ff8240d2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:22.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.087+0000 7ff82aa00640 1 -- 172.21.15.112:0/1819671857 >> 172.21.15.112:0/1819671857 conn(0x7ff8240d4d00 msgr2=0x7ff8240d5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:22.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.087+0000 7ff82aa00640 1 -- 172.21.15.112:0/1819671857 shutdown_connections 2024-09-12T02:43:22.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.087+0000 7ff82aa00640 1 -- 172.21.15.112:0/1819671857 wait complete. 2024-09-12T02:43:22.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.088+0000 7ff82aa00640 1 Processor -- start 2024-09-12T02:43:22.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.089+0000 7ff82aa00640 1 -- start start 2024-09-12T02:43:22.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.089+0000 7ff82aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff8240d3490 0x7ff82415d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:22.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.089+0000 7ff82aa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff8240d59e0 0x7ff8240ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:22.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.089+0000 7ff82aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff82415f080 0x7ff8240cad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:22.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.089+0000 7ff82aa00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff8240d0610 con 0x7ff82415f080 2024-09-12T02:43:22.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.089+0000 7ff82aa00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff8240d0330 con 0x7ff8240d3490 2024-09-12T02:43:22.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.089+0000 7ff82aa00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff8240d0b30 con 0x7ff8240d59e0 2024-09-12T02:43:22.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.090+0000 7ff82a000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff82415f080 0x7ff8240cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:22.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.090+0000 7ff82a000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff82415f080 0x7ff8240cad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40598/0 (socket says 172.21.15.112:40598) 2024-09-12T02:43:22.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.090+0000 7ff82a000640 1 -- 172.21.15.112:0/615272935 learned_addr learned my addr 172.21.15.112:0/615272935 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:22.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.090+0000 7ff829600640 1 --2- 172.21.15.112:0/615272935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff8240d3490 0x7ff82415d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:22.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.090+0000 7ff828c00640 1 --2- 172.21.15.112:0/615272935 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff8240d59e0 0x7ff8240ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:22.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.090+0000 7ff82a000640 1 -- 172.21.15.112:0/615272935 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff8240d59e0 msgr2=0x7ff8240ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:22.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.090+0000 7ff82a000640 1 --2- 172.21.15.112:0/615272935 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff8240d59e0 0x7ff8240ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:22.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.090+0000 7ff82a000640 1 -- 172.21.15.112:0/615272935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff8240d3490 msgr2=0x7ff82415d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:22.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.090+0000 7ff82a000640 1 --2- 172.21.15.112:0/615272935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff8240d3490 0x7ff82415d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:22.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.090+0000 7ff82a000640 1 -- 172.21.15.112:0/615272935 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff82415ddf0 con 0x7ff82415f080 2024-09-12T02:43:22.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.091+0000 7ff82a000640 1 --2- 172.21.15.112:0/615272935 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff82415f080 0x7ff8240cad70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff81c034040 tx=0x7ff81c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:22.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.091+0000 7ff821600640 1 -- 172.21.15.112:0/615272935 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff81c041020 con 0x7ff82415f080 2024-09-12T02:43:22.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.091+0000 7ff821600640 1 -- 172.21.15.112:0/615272935 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff81c0077a0 con 0x7ff82415f080 2024-09-12T02:43:22.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.091+0000 7ff821600640 1 -- 172.21.15.112:0/615272935 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff81c036040 con 0x7ff82415f080 2024-09-12T02:43:22.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.091+0000 7ff82aa00640 1 -- 172.21.15.112:0/615272935 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8240cce20 con 0x7ff82415f080 2024-09-12T02:43:22.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.091+0000 7ff82aa00640 1 -- 172.21.15.112:0/615272935 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8240cd3e0 con 0x7ff82415f080 2024-09-12T02:43:22.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.092+0000 7ff82aa00640 1 -- 172.21.15.112:0/615272935 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8240d2120 con 0x7ff82415f080 2024-09-12T02:43:22.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.093+0000 7ff821600640 1 -- 172.21.15.112:0/615272935 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff81c044020 con 0x7ff82415f080 2024-09-12T02:43:22.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.094+0000 7ff821600640 1 --2- 172.21.15.112:0/615272935 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff80406be30 0x7ff80406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:22.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.094+0000 7ff821600640 1 -- 172.21.15.112:0/615272935 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7ff81c0ab8f0 con 0x7ff82415f080 2024-09-12T02:43:22.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.094+0000 7ff829600640 1 --2- 172.21.15.112:0/615272935 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff80406be30 0x7ff80406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:22.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.095+0000 7ff829600640 1 --2- 172.21.15.112:0/615272935 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff80406be30 0x7ff80406e2f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff818009aa0 tx=0x7ff818009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:22.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.098+0000 7ff821600640 1 -- 172.21.15.112:0/615272935 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff81c04b030 con 0x7ff82415f080 2024-09-12T02:43:22.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.337+0000 7ff82aa00640 1 -- 172.21.15.112:0/615272935 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7ff82408ea50 con 0x7ff82415f080 2024-09-12T02:43:22.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.340+0000 7ff821600640 1 -- 172.21.15.112:0/615272935 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7ff81c079d00 con 0x7ff82415f080 2024-09-12T02:43:22.341 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-09-12T02:43:22.341 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDUVOJmaG86ExAAD0SOlJOsLpoQZlgPJIPaxA== 2024-09-12T02:43:22.341 INFO:teuthology.orchestra.run.smithi112.stdout: caps mds = "allow" 2024-09-12T02:43:22.341 INFO:teuthology.orchestra.run.smithi112.stdout: caps mon = "allow r" 2024-09-12T02:43:22.341 INFO:teuthology.orchestra.run.smithi112.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T02:43:22.342 INFO:teuthology.orchestra.run.smithi112.stderr:updated caps for client.0 2024-09-12T02:43:22.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.342+0000 7ff82aa00640 1 -- 172.21.15.112:0/615272935 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff80406be30 msgr2=0x7ff80406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:22.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.342+0000 7ff82aa00640 1 --2- 172.21.15.112:0/615272935 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff80406be30 0x7ff80406e2f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff818009aa0 tx=0x7ff818009190 comp rx=0 tx=0).stop 2024-09-12T02:43:22.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.342+0000 7ff82aa00640 1 -- 172.21.15.112:0/615272935 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff82415f080 msgr2=0x7ff8240cad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:22.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.342+0000 7ff82aa00640 1 --2- 172.21.15.112:0/615272935 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff82415f080 0x7ff8240cad70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff81c034040 tx=0x7ff81c004a40 comp rx=0 tx=0).stop 2024-09-12T02:43:22.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.342+0000 7ff82aa00640 1 -- 172.21.15.112:0/615272935 shutdown_connections 2024-09-12T02:43:22.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.342+0000 7ff82aa00640 1 --2- 172.21.15.112:0/615272935 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff82415f080 0x7ff8240cad70 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:22.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.342+0000 7ff82aa00640 1 --2- 172.21.15.112:0/615272935 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff8240d59e0 0x7ff8240ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:22.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.342+0000 7ff82aa00640 1 --2- 172.21.15.112:0/615272935 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff80406be30 0x7ff80406e2f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:22.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.342+0000 7ff82aa00640 1 --2- 172.21.15.112:0/615272935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff8240d3490 0x7ff82415d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:22.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.343+0000 7ff82aa00640 1 -- 172.21.15.112:0/615272935 >> 172.21.15.112:0/615272935 conn(0x7ff8240d4d00 msgr2=0x7ff82415f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:22.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.343+0000 7ff82aa00640 1 -- 172.21.15.112:0/615272935 shutdown_connections 2024-09-12T02:43:22.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.343+0000 7ff82aa00640 1 -- 172.21.15.112:0/615272935 wait complete. 2024-09-12T02:43:22.359 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:43:22.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.509+0000 7f5254000640 1 Processor -- start 2024-09-12T02:43:22.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.510+0000 7f5254000640 1 -- start start 2024-09-12T02:43:22.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.511+0000 7f5254000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f524c0b4ec0 0x7f524c0b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:22.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.511+0000 7f5254000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f524c0b54a0 con 0x7f524c06f600 2024-09-12T02:43:22.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.511+0000 7f5254000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f524c0b3af0 con 0x7f524c15b9d0 2024-09-12T02:43:22.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.511+0000 7f5254000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f524c0b3dd0 con 0x7f524c0b4ec0 2024-09-12T02:43:22.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.511+0000 7f5250c00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f524c06f600 0x7f524c0cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:44752/0 (socket says 172.21.15.112:44752) 2024-09-12T02:43:22.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.511+0000 7f5250c00640 1 -- 172.21.15.112:0/3453752186 learned_addr learned my addr 172.21.15.112:0/3453752186 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:22.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.511+0000 7f5252000640 1 --2- 172.21.15.112:0/3453752186 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f524c0b4ec0 0x7f524c0b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:22.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.511+0000 7f524be00640 1 -- 172.21.15.112:0/3453752186 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 136534599 0 0) 0x7f524c0b54a0 con 0x7f524c06f600 2024-09-12T02:43:22.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.512+0000 7f524be00640 1 -- 172.21.15.112:0/3453752186 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5234003520 con 0x7f524c06f600 2024-09-12T02:43:22.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.512+0000 7f524be00640 1 -- 172.21.15.112:0/3453752186 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3744782155 0 0) 0x7f524c0b3af0 con 0x7f524c15b9d0 2024-09-12T02:43:22.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.512+0000 7f524be00640 1 -- 172.21.15.112:0/3453752186 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f524c0b54a0 con 0x7f524c15b9d0 2024-09-12T02:43:22.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.512+0000 7f5252000640 1 -- 172.21.15.112:0/3453752186 >> v1:172.21.15.137:6789/0 conn(0x7f524c15b9d0 legacy=0x7f524c06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:22.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.512+0000 7f5252000640 1 -- 172.21.15.112:0/3453752186 >> v1:172.21.15.112:6789/0 conn(0x7f524c06f600 legacy=0x7f524c0cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:22.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.512+0000 7f5252000640 1 -- 172.21.15.112:0/3453752186 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f524c0b40b0 con 0x7f524c0b4ec0 2024-09-12T02:43:22.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.513+0000 7f5252000640 1 --2- 172.21.15.112:0/3453752186 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f524c0b4ec0 0x7f524c0b45d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5244009dc0 tx=0x7f524402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8771240a8c282102 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:22.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.513+0000 7f524be00640 1 -- 172.21.15.112:0/3453752186 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5244007740 con 0x7f524c0b4ec0 2024-09-12T02:43:22.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.513+0000 7f524be00640 1 -- 172.21.15.112:0/3453752186 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52440078e0 con 0x7f524c0b4ec0 2024-09-12T02:43:22.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.513+0000 7f524be00640 1 -- 172.21.15.112:0/3453752186 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5244007cb0 con 0x7f524c0b4ec0 2024-09-12T02:43:22.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.514+0000 7f5254000640 1 -- 172.21.15.112:0/3453752186 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f524c0b4ec0 msgr2=0x7f524c0b45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:22.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.514+0000 7f5254000640 1 --2- 172.21.15.112:0/3453752186 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f524c0b4ec0 0x7f524c0b45d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5244009dc0 tx=0x7f524402a6d0 comp rx=0 tx=0).stop 2024-09-12T02:43:22.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.514+0000 7f5254000640 1 -- 172.21.15.112:0/3453752186 shutdown_connections 2024-09-12T02:43:22.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.514+0000 7f5254000640 1 --2- 172.21.15.112:0/3453752186 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f524c0b4ec0 0x7f524c0b45d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:22.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.514+0000 7f5254000640 1 -- 172.21.15.112:0/3453752186 >> 172.21.15.112:0/3453752186 conn(0x7f524c06bbd0 msgr2=0x7f524c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:22.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.514+0000 7f5254000640 1 -- 172.21.15.112:0/3453752186 shutdown_connections 2024-09-12T02:43:22.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.514+0000 7f5254000640 1 -- 172.21.15.112:0/3453752186 wait complete. 2024-09-12T02:43:22.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.515+0000 7f5254000640 1 Processor -- start 2024-09-12T02:43:22.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.516+0000 7f5254000640 1 -- start start 2024-09-12T02:43:22.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.516+0000 7f5254000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f524c06f600 0x7f524c1e5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:22.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.516+0000 7f5254000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f524c0b4ec0 0x7f524c142970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:22.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.516+0000 7f5254000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f524c15b9d0 0x7f524c142eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:22.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.516+0000 7f5254000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f524c072a40 con 0x7f524c15b9d0 2024-09-12T02:43:22.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.516+0000 7f5254000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f524c0728c0 con 0x7f524c06f600 2024-09-12T02:43:22.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.516+0000 7f5254000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f524c072bc0 con 0x7f524c0b4ec0 2024-09-12T02:43:22.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.517+0000 7f5252000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f524c15b9d0 0x7f524c142eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:22.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.517+0000 7f5252000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f524c15b9d0 0x7f524c142eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40604/0 (socket says 172.21.15.112:40604) 2024-09-12T02:43:22.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.517+0000 7f5252000640 1 -- 172.21.15.112:0/1660261889 learned_addr learned my addr 172.21.15.112:0/1660261889 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:22.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.517+0000 7f5250c00640 1 --2- 172.21.15.112:0/1660261889 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f524c0b4ec0 0x7f524c142970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:22.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.517+0000 7f5251600640 1 --2- 172.21.15.112:0/1660261889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f524c06f600 0x7f524c1e5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:22.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.517+0000 7f5252000640 1 -- 172.21.15.112:0/1660261889 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f524c0b4ec0 msgr2=0x7f524c142970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:22.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.517+0000 7f5252000640 1 --2- 172.21.15.112:0/1660261889 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f524c0b4ec0 0x7f524c142970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:22.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.517+0000 7f5252000640 1 -- 172.21.15.112:0/1660261889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f524c06f600 msgr2=0x7f524c1e5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:22.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.517+0000 7f5252000640 1 --2- 172.21.15.112:0/1660261889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f524c06f600 0x7f524c1e5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:22.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.517+0000 7f5252000640 1 -- 172.21.15.112:0/1660261889 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f524c143510 con 0x7f524c15b9d0 2024-09-12T02:43:22.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.518+0000 7f5252000640 1 --2- 172.21.15.112:0/1660261889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f524c15b9d0 0x7f524c142eb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5244009ee0 tx=0x7f5244004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:22.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.518+0000 7f5249600640 1 -- 172.21.15.112:0/1660261889 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5244040070 con 0x7f524c15b9d0 2024-09-12T02:43:22.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.518+0000 7f5249600640 1 -- 172.21.15.112:0/1660261889 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5244031bc0 con 0x7f524c15b9d0 2024-09-12T02:43:22.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.518+0000 7f5254000640 1 -- 172.21.15.112:0/1660261889 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f524c1437f0 con 0x7f524c15b9d0 2024-09-12T02:43:22.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.518+0000 7f5249600640 1 -- 172.21.15.112:0/1660261889 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5244009450 con 0x7f524c15b9d0 2024-09-12T02:43:22.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.518+0000 7f5254000640 1 -- 172.21.15.112:0/1660261889 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f524c1f6f20 con 0x7f524c15b9d0 2024-09-12T02:43:22.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.519+0000 7f5254000640 1 -- 172.21.15.112:0/1660261889 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f524c06d670 con 0x7f524c15b9d0 2024-09-12T02:43:22.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.520+0000 7f5249600640 1 -- 172.21.15.112:0/1660261889 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5244039040 con 0x7f524c15b9d0 2024-09-12T02:43:22.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.521+0000 7f5249600640 1 --2- 172.21.15.112:0/1660261889 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f522c06be30 0x7f522c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:22.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.521+0000 7f5249600640 1 -- 172.21.15.112:0/1660261889 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f52440ac4d0 con 0x7f524c15b9d0 2024-09-12T02:43:22.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.521+0000 7f5251600640 1 --2- 172.21.15.112:0/1660261889 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f522c06be30 0x7f522c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:22.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.522+0000 7f5251600640 1 --2- 172.21.15.112:0/1660261889 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f522c06be30 0x7f522c06e2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5240007fd0 tx=0x7f5240009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:22.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.525+0000 7f5249600640 1 -- 172.21.15.112:0/1660261889 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f524c06d670 con 0x7f524c15b9d0 2024-09-12T02:43:22.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.727+0000 7f5254000640 1 -- 172.21.15.112:0/1660261889 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f524c06dbc0 con 0x7f524c15b9d0 2024-09-12T02:43:22.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.728+0000 7f5249600640 1 -- 172.21.15.112:0/1660261889 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5229 (secure 0 0 0) 0x7f52440aae20 con 0x7f524c15b9d0 2024-09-12T02:43:22.729 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:22.729 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":27,"btime":"2024-09-12T02:43:20:337397+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5008,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/362211662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":362211662},{"type":"v1","addr":"172.21.15.112:6836","nonce":362211662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5011,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/193733805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":193733805},{"type":"v1","addr":"172.21.15.112:6837","nonce":193733805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/3440642333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3440642333},{"type":"v1","addr":"172.21.15.137:6834","nonce":3440642333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:43:16.722971+0000","modified":"2024-09-12T02:43:19.743614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"b","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/3597512060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3597512060},{"type":"v1","addr":"172.21.15.137:6835","nonce":3597512060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":3}]} 2024-09-12T02:43:22.729 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 27 2024-09-12T02:43:22.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.730+0000 7f5254000640 1 -- 172.21.15.112:0/1660261889 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f522c06be30 msgr2=0x7f522c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:22.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.730+0000 7f5254000640 1 --2- 172.21.15.112:0/1660261889 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f522c06be30 0x7f522c06e2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5240007fd0 tx=0x7f5240009040 comp rx=0 tx=0).stop 2024-09-12T02:43:22.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.730+0000 7f5254000640 1 -- 172.21.15.112:0/1660261889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f524c15b9d0 msgr2=0x7f524c142eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:22.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.730+0000 7f5254000640 1 --2- 172.21.15.112:0/1660261889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f524c15b9d0 0x7f524c142eb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5244009ee0 tx=0x7f5244004a40 comp rx=0 tx=0).stop 2024-09-12T02:43:22.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.730+0000 7f5254000640 1 -- 172.21.15.112:0/1660261889 shutdown_connections 2024-09-12T02:43:22.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.730+0000 7f5254000640 1 --2- 172.21.15.112:0/1660261889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f524c15b9d0 0x7f524c142eb0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:22.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.730+0000 7f5254000640 1 --2- 172.21.15.112:0/1660261889 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f524c0b4ec0 0x7f524c142970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:22.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.730+0000 7f5254000640 1 --2- 172.21.15.112:0/1660261889 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f522c06be30 0x7f522c06e2f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:22.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.730+0000 7f5254000640 1 --2- 172.21.15.112:0/1660261889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f524c06f600 0x7f524c1e5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:22.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.730+0000 7f5254000640 1 -- 172.21.15.112:0/1660261889 >> 172.21.15.112:0/1660261889 conn(0x7f524c06bbd0 msgr2=0x7f524c15f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:22.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.730+0000 7f5254000640 1 -- 172.21.15.112:0/1660261889 shutdown_connections 2024-09-12T02:43:22.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:22.730+0000 7f5254000640 1 -- 172.21.15.112:0/1660261889 wait complete. 2024-09-12T02:43:23.151 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:43:16.722971+0000', 'modified': '2024-09-12T02:43:19.743614+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5017}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5017': {'gid': 5017, 'name': 'b', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.137:6835/3597512060', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6833', 'nonce': 3597512060}, {'type': 'v1', 'addr': '172.21.15.137:6835', 'nonce': 3597512060}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5017, 'qdb_cluster': [5017]} 2024-09-12T02:43:23.151 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:43:23.151 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-12T02:43:23.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.304+0000 7fe76f600640 1 Processor -- start 2024-09-12T02:43:23.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.304+0000 7fe76f600640 1 -- start start 2024-09-12T02:43:23.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.305+0000 7fe76f600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe76815cc50 0x7fe7680732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:23.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.305+0000 7fe76f600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe7680afe30 0x7fe7680cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:23.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.305+0000 7fe76f600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe768073830 con 0x7fe768071530 2024-09-12T02:43:23.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.305+0000 7fe76f600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe76815d030 con 0x7fe76815cc50 2024-09-12T02:43:23.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.305+0000 7fe76f600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe7680cf4c0 con 0x7fe7680afe30 2024-09-12T02:43:23.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.306+0000 7fe76cc00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe76815cc50 0x7fe7680732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:23.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.306+0000 7fe767e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe768071530 0x7fe7680af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:44766/0 (socket says 172.21.15.112:44766) 2024-09-12T02:43:23.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.306+0000 7fe767e00640 1 -- 172.21.15.112:0/2324271843 learned_addr learned my addr 172.21.15.112:0/2324271843 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:23.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.306+0000 7fe76d600640 1 --2- 172.21.15.112:0/2324271843 >> v2:172.21.15.137:3300/0 conn(0x7fe7680afe30 0x7fe7680cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:23.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.306+0000 7fe76cc00640 1 -- 172.21.15.112:0/2324271843 >> v2:172.21.15.137:3300/0 conn(0x7fe7680afe30 msgr2=0x7fe7680cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:23.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.306+0000 7fe76cc00640 1 --2- 172.21.15.112:0/2324271843 >> v2:172.21.15.137:3300/0 conn(0x7fe7680afe30 0x7fe7680cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.306+0000 7fe76cc00640 1 -- 172.21.15.112:0/2324271843 >> v1:172.21.15.112:6789/0 conn(0x7fe768071530 legacy=0x7fe7680af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:23.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.306+0000 7fe76cc00640 1 -- 172.21.15.112:0/2324271843 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7680ceeb0 con 0x7fe76815cc50 2024-09-12T02:43:23.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.307+0000 7fe76cc00640 1 --2- 172.21.15.112:0/2324271843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76815cc50 0x7fe7680732f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe76806ffd0 tx=0x7fe75c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b9098cdf63bc0c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:23.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.307+0000 7fe767400640 1 -- 172.21.15.112:0/2324271843 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c037070 con 0x7fe76815cc50 2024-09-12T02:43:23.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.307+0000 7fe767400640 1 -- 172.21.15.112:0/2324271843 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe75c032440 con 0x7fe76815cc50 2024-09-12T02:43:23.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.307+0000 7fe767400640 1 -- 172.21.15.112:0/2324271843 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c02ae60 con 0x7fe76815cc50 2024-09-12T02:43:23.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.308+0000 7fe76f600640 1 -- 172.21.15.112:0/2324271843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76815cc50 msgr2=0x7fe7680732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:23.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.308+0000 7fe76f600640 1 --2- 172.21.15.112:0/2324271843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76815cc50 0x7fe7680732f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe76806ffd0 tx=0x7fe75c02a110 comp rx=0 tx=0).stop 2024-09-12T02:43:23.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.308+0000 7fe76f600640 1 -- 172.21.15.112:0/2324271843 shutdown_connections 2024-09-12T02:43:23.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.308+0000 7fe76f600640 1 --2- 172.21.15.112:0/2324271843 >> v2:172.21.15.137:3300/0 conn(0x7fe7680afe30 0x7fe7680cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.308+0000 7fe76f600640 1 --2- 172.21.15.112:0/2324271843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76815cc50 0x7fe7680732f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.308+0000 7fe76f600640 1 -- 172.21.15.112:0/2324271843 >> 172.21.15.112:0/2324271843 conn(0x7fe76806bbd0 msgr2=0x7fe76806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:23.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.308+0000 7fe76f600640 1 -- 172.21.15.112:0/2324271843 shutdown_connections 2024-09-12T02:43:23.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.308+0000 7fe76f600640 1 -- 172.21.15.112:0/2324271843 wait complete. 2024-09-12T02:43:23.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.310+0000 7fe76f600640 1 Processor -- start 2024-09-12T02:43:23.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.310+0000 7fe76f600640 1 -- start start 2024-09-12T02:43:23.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.310+0000 7fe76f600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe768071530 0x7fe7681488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:23.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.310+0000 7fe76f600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7680afe30 0x7fe768148e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:23.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.310+0000 7fe76f600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe76815cc50 0x7fe768145480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:23.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.311+0000 7fe76f600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe7680cf150 con 0x7fe768071530 2024-09-12T02:43:23.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.311+0000 7fe76f600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe76806e5e0 con 0x7fe7680afe30 2024-09-12T02:43:23.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.311+0000 7fe76f600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe76806f510 con 0x7fe76815cc50 2024-09-12T02:43:23.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.311+0000 7fe76cc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe768071530 0x7fe7681488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:23.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.311+0000 7fe76cc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe768071530 0x7fe7681488c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40628/0 (socket says 172.21.15.112:40628) 2024-09-12T02:43:23.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.311+0000 7fe76cc00640 1 -- 172.21.15.112:0/2765203124 learned_addr learned my addr 172.21.15.112:0/2765203124 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:23.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.311+0000 7fe76d600640 1 --2- 172.21.15.112:0/2765203124 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe76815cc50 0x7fe768145480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:23.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.311+0000 7fe767e00640 1 --2- 172.21.15.112:0/2765203124 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7680afe30 0x7fe768148e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:23.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.311+0000 7fe76cc00640 1 -- 172.21.15.112:0/2765203124 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe76815cc50 msgr2=0x7fe768145480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:23.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.311+0000 7fe76cc00640 1 --2- 172.21.15.112:0/2765203124 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe76815cc50 0x7fe768145480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.311+0000 7fe76cc00640 1 -- 172.21.15.112:0/2765203124 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7680afe30 msgr2=0x7fe768148e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:23.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.311+0000 7fe76cc00640 1 --2- 172.21.15.112:0/2765203124 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7680afe30 0x7fe768148e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.311+0000 7fe76cc00640 1 -- 172.21.15.112:0/2765203124 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7681542e0 con 0x7fe768071530 2024-09-12T02:43:23.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.311+0000 7fe76cc00640 1 --2- 172.21.15.112:0/2765203124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe768071530 0x7fe7681488c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe75c000c00 tx=0x7fe75c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:23.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.312+0000 7fe764c00640 1 -- 172.21.15.112:0/2765203124 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c037040 con 0x7fe768071530 2024-09-12T02:43:23.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.312+0000 7fe764c00640 1 -- 172.21.15.112:0/2765203124 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe75c042070 con 0x7fe768071530 2024-09-12T02:43:23.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.312+0000 7fe764c00640 1 -- 172.21.15.112:0/2765203124 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c030bd0 con 0x7fe768071530 2024-09-12T02:43:23.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.312+0000 7fe76f600640 1 -- 172.21.15.112:0/2765203124 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe768143180 con 0x7fe768071530 2024-09-12T02:43:23.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.312+0000 7fe76f600640 1 -- 172.21.15.112:0/2765203124 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe768143740 con 0x7fe768071530 2024-09-12T02:43:23.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.314+0000 7fe764c00640 1 -- 172.21.15.112:0/2765203124 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe75c047460 con 0x7fe768071530 2024-09-12T02:43:23.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.314+0000 7fe764c00640 1 --2- 172.21.15.112:0/2765203124 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe74806be60 0x7fe74806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:23.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.315+0000 7fe764c00640 1 -- 172.21.15.112:0/2765203124 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fe75c0abad0 con 0x7fe768071530 2024-09-12T02:43:23.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.315+0000 7fe767e00640 1 --2- 172.21.15.112:0/2765203124 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe74806be60 0x7fe74806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:23.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.315+0000 7fe772429740 1 Processor -- start 2024-09-12T02:43:23.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.315+0000 7fe767e00640 1 --2- 172.21.15.112:0/2765203124 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe74806be60 0x7fe74806e320 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe7680afb50 tx=0x7fe754009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:23.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.315+0000 7fe772429740 1 -- start start 2024-09-12T02:43:23.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.316+0000 7fe772429740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7b88e1cf0 0x55f7b8927490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:23.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.316+0000 7fe772429740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f7b88df4b0 0x55f7b88e20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:23.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.316+0000 7fe772429740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7b88e3480 0x55f7b88dc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:23.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.316+0000 7fe772429740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f7b88403b0 con 0x55f7b88e3480 2024-09-12T02:43:23.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.316+0000 7fe772429740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f7b8845410 con 0x55f7b88e1cf0 2024-09-12T02:43:23.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.316+0000 7fe772429740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55f7b87ed620 con 0x55f7b88df4b0 2024-09-12T02:43:23.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.317+0000 7fe76d600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7b88e3480 0x55f7b88dc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:23.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.317+0000 7fe76d600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7b88e3480 0x55f7b88dc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40632/0 (socket says 172.21.15.112:40632) 2024-09-12T02:43:23.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.317+0000 7fe76d600640 1 -- 172.21.15.112:0/3799998723 learned_addr learned my addr 172.21.15.112:0/3799998723 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:23.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.317+0000 7fe76cc00640 1 --2- 172.21.15.112:0/3799998723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7b88e1cf0 0x55f7b8927490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:23.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.317+0000 7fe767e00640 1 --2- 172.21.15.112:0/3799998723 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f7b88df4b0 0x55f7b88e20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:23.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.317+0000 7fe76d600640 1 -- 172.21.15.112:0/3799998723 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f7b88df4b0 msgr2=0x55f7b88e20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:23.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.317+0000 7fe76d600640 1 --2- 172.21.15.112:0/3799998723 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f7b88df4b0 0x55f7b88e20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.317+0000 7fe76d600640 1 -- 172.21.15.112:0/3799998723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7b88e1cf0 msgr2=0x55f7b8927490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:23.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.317+0000 7fe76d600640 1 --2- 172.21.15.112:0/3799998723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7b88e1cf0 0x55f7b8927490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.317+0000 7fe76d600640 1 -- 172.21.15.112:0/3799998723 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7b85582d0 con 0x55f7b88e3480 2024-09-12T02:43:23.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.317+0000 7fe76cc00640 1 --2- 172.21.15.112:0/3799998723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7b88e1cf0 0x55f7b8927490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:43:23.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.317+0000 7fe76d600640 1 --2- 172.21.15.112:0/3799998723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7b88e3480 0x55f7b88dc570 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe760007410 tx=0x7fe7600078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e38a1d317305f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:23.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.317+0000 7fe759200640 1 -- 172.21.15.112:0/3799998723 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7600147e0 con 0x55f7b88e3480 2024-09-12T02:43:23.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.317+0000 7fe759200640 1 -- 172.21.15.112:0/3799998723 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe76001a070 con 0x55f7b88e3480 2024-09-12T02:43:23.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.317+0000 7fe759200640 1 -- 172.21.15.112:0/3799998723 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe760014b80 con 0x55f7b88e3480 2024-09-12T02:43:23.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.318+0000 7fe772429740 1 -- 172.21.15.112:0/3799998723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7b88e3480 msgr2=0x55f7b88dc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:23.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.318+0000 7fe772429740 1 --2- 172.21.15.112:0/3799998723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7b88e3480 0x55f7b88dc570 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe760007410 tx=0x7fe7600078d0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.318+0000 7fe772429740 1 -- 172.21.15.112:0/3799998723 shutdown_connections 2024-09-12T02:43:23.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.318+0000 7fe772429740 1 --2- 172.21.15.112:0/3799998723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7b88e3480 0x55f7b88dc570 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.318+0000 7fe772429740 1 --2- 172.21.15.112:0/3799998723 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f7b88df4b0 0x55f7b88e20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.318+0000 7fe772429740 1 --2- 172.21.15.112:0/3799998723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7b88e1cf0 0x55f7b8927490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.318+0000 7fe772429740 1 -- 172.21.15.112:0/3799998723 >> 172.21.15.112:0/3799998723 conn(0x55f7b88de740 msgr2=0x55f7b8926960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:23.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.318+0000 7fe772429740 1 -- 172.21.15.112:0/3799998723 shutdown_connections 2024-09-12T02:43:23.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.318+0000 7fe772429740 1 -- 172.21.15.112:0/3799998723 wait complete. 2024-09-12T02:43:23.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.319+0000 7fe772429740 1 -- start start 2024-09-12T02:43:23.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.319+0000 7fe772429740 1 Processor -- start 2024-09-12T02:43:23.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.320+0000 7fe772429740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f7b88e1cf0 0x55f7b890adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:23.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.320+0000 7fe772429740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7b88e3480 0x55f7b89058e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:23.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.320+0000 7fe772429740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7b8902530 0x55f7b8936b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:23.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.320+0000 7fe772429740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f7b8800780 con 0x55f7b8902530 2024-09-12T02:43:23.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.320+0000 7fe772429740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f7b88413d0 con 0x55f7b88e3480 2024-09-12T02:43:23.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.320+0000 7fe772429740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55f7b88ddbe0 con 0x55f7b88e1cf0 2024-09-12T02:43:23.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.320+0000 7fe772429740 10 client.0 _ll_register_callbacks cb 0x55f7b883e5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:43:23.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.320+0000 7fe76d600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7b8902530 0x55f7b8936b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:23.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.320+0000 7fe76d600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7b8902530 0x55f7b8936b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40646/0 (socket says 172.21.15.112:40646) 2024-09-12T02:43:23.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.320+0000 7fe76d600640 1 -- 172.21.15.112:0/309006939 learned_addr learned my addr 172.21.15.112:0/309006939 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:23.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.320+0000 7fe76cc00640 1 --2- 172.21.15.112:0/309006939 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f7b88e1cf0 0x55f7b890adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:23.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.321+0000 7fe767e00640 1 --2- 172.21.15.112:0/309006939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7b88e3480 0x55f7b89058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:23.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.321+0000 7fe76d600640 1 -- 172.21.15.112:0/309006939 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f7b88e1cf0 msgr2=0x55f7b890adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:23.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.321+0000 7fe76d600640 1 --2- 172.21.15.112:0/309006939 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f7b88e1cf0 0x55f7b890adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.321+0000 7fe76d600640 1 -- 172.21.15.112:0/309006939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7b88e3480 msgr2=0x55f7b89058e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:23.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.321+0000 7fe76d600640 1 --2- 172.21.15.112:0/309006939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7b88e3480 0x55f7b89058e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.321+0000 7fe76d600640 1 -- 172.21.15.112:0/309006939 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7b86226b0 con 0x55f7b8902530 2024-09-12T02:43:23.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.321+0000 7fe76d600640 1 --2- 172.21.15.112:0/309006939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7b8902530 0x55f7b8936b80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe760007dd0 tx=0x7fe760004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac43d86c835ed2c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:23.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.321+0000 7fe74d600640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-12T02:43:23.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.321+0000 7fe74d600640 1 -- 172.21.15.112:0/309006939 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76002a480 con 0x55f7b8902530 2024-09-12T02:43:23.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.321+0000 7fe74d600640 1 -- 172.21.15.112:0/309006939 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fe76002a620 con 0x55f7b8902530 2024-09-12T02:43:23.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.321+0000 7fe772429740 1 -- 172.21.15.112:0/309006939 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe76001a070 con 0x55f7b8902530 2024-09-12T02:43:23.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.322+0000 7fe74d600640 1 -- 172.21.15.112:0/309006939 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe76002a820 con 0x55f7b8902530 2024-09-12T02:43:23.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.322+0000 7fe772429740 10 client.5277 fetch_fsmap learned FSMap version 27 2024-09-12T02:43:23.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.322+0000 7fe772429740 1 -- 172.21.15.112:0/309006939 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55f7b890a5c0 con 0x55f7b8902530 2024-09-12T02:43:23.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.322+0000 7fe74d600640 1 -- 172.21.15.112:0/309006939 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe76001a070 con 0x55f7b8902530 2024-09-12T02:43:23.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.322+0000 7fe74d600640 1 -- 172.21.15.112:0/309006939 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fe760015470 con 0x55f7b8902530 2024-09-12T02:43:23.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.322+0000 7fe772429740 10 client.5277 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:43:23.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.322+0000 7fe772429740 10 client.5277 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:43:23.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.322+0000 7fe772429740 20 client.5277 populate_metadata read hostname 'smithi112' 2024-09-12T02:43:23.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.322+0000 7fe772429740 1 --2- 172.21.15.112:0/309006939 >> [v2:172.21.15.137:6833/3597512060,v1:172.21.15.137:6835/3597512060] conn(0x55f7b8903830 0x55f7b8903c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:23.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.322+0000 7fe772429740 4 client.5277 mds_command: new command op to 5017 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:43:23.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.322+0000 7fe772429740 1 -- 172.21.15.112:0/309006939 --> [v2:172.21.15.137:6833/3597512060,v1:172.21.15.137:6835/3597512060] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f7b8852b40 con 0x55f7b8903830 2024-09-12T02:43:23.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.322+0000 7fe76cc00640 1 --2- 172.21.15.112:0/309006939 >> [v2:172.21.15.137:6833/3597512060,v1:172.21.15.137:6835/3597512060] conn(0x55f7b8903830 0x55f7b8903c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:23.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.323+0000 7fe76cc00640 1 --2- 172.21.15.112:0/309006939 >> [v2:172.21.15.137:6833/3597512060,v1:172.21.15.137:6835/3597512060] conn(0x55f7b8903830 0x55f7b8903c10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0689623e312427d server_cookie=283bcae4ba1c401e in_seq=0 out_seq=0 2024-09-12T02:43:23.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.323+0000 7fe74d600640 10 client.5277 ms_handle_connect on v2:172.21.15.137:6833/3597512060 2024-09-12T02:43:23.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.324+0000 7fe74d600640 1 -- 172.21.15.112:0/309006939 <== mds.0 v2:172.21.15.137:6833/3597512060 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f7b8852b40 con 0x55f7b8903830 2024-09-12T02:43:23.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.324+0000 7fe74d600640 10 client.5277 handle_command_reply: tid=0 2024-09-12T02:43:23.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.324+0000 7fe772429740 1 client.5277 shutdown 2024-09-12T02:43:23.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.324+0000 7fe772429740 1 -- 172.21.15.112:0/309006939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7b8902530 msgr2=0x55f7b8936b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:23.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.324+0000 7fe772429740 1 --2- 172.21.15.112:0/309006939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7b8902530 0x55f7b8936b80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe760007dd0 tx=0x7fe760004ab0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.324+0000 7fe772429740 1 -- 172.21.15.112:0/309006939 shutdown_connections 2024-09-12T02:43:23.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.324+0000 7fe772429740 1 --2- 172.21.15.112:0/309006939 >> [v2:172.21.15.137:6833/3597512060,v1:172.21.15.137:6835/3597512060] conn(0x55f7b8903830 0x55f7b8903c10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.324+0000 7fe772429740 1 --2- 172.21.15.112:0/309006939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7b8902530 0x55f7b8936b80 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.324+0000 7fe772429740 1 --2- 172.21.15.112:0/309006939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7b88e3480 0x55f7b89058e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.324+0000 7fe74d600640 0 client.5277 ms_handle_reset on v2:172.21.15.137:6833/3597512060 2024-09-12T02:43:23.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.324+0000 7fe772429740 1 --2- 172.21.15.112:0/309006939 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f7b88e1cf0 0x55f7b890adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.324+0000 7fe772429740 1 -- 172.21.15.112:0/309006939 >> 172.21.15.112:0/309006939 conn(0x55f7b88df4b0 msgr2=0x55f7b8925f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:23.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.325+0000 7fe772429740 1 -- 172.21.15.112:0/309006939 shutdown_connections 2024-09-12T02:43:23.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.325+0000 7fe772429740 1 -- 172.21.15.112:0/309006939 wait complete. 2024-09-12T02:43:23.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.325+0000 7fe772429740 20 client.5277 trim_cache size 0 max 16384 2024-09-12T02:43:23.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.343+0000 7fe772429740 1 Processor -- start 2024-09-12T02:43:23.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.343+0000 7fe772429740 1 -- start start 2024-09-12T02:43:23.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.344+0000 7fe772429740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7b88e1cf0 0x55f7b8900220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:23.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.344+0000 7fe772429740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f7b88e3480 0x55f7b894a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:23.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.344+0000 7fe772429740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7b8902530 0x55f7b894ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:23.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.344+0000 7fe772429740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe76815a830 con 0x55f7b88e1cf0 2024-09-12T02:43:23.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.344+0000 7fe772429740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe7681f5080 con 0x55f7b8902530 2024-09-12T02:43:23.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.344+0000 7fe772429740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe76815a1e0 con 0x55f7b88e3480 2024-09-12T02:43:23.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.344+0000 7fe76cc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7b88e1cf0 0x55f7b8900220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:23.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.344+0000 7fe76cc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7b88e1cf0 0x55f7b8900220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40658/0 (socket says 172.21.15.112:40658) 2024-09-12T02:43:23.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.344+0000 7fe76cc00640 1 -- 172.21.15.112:0/1939495732 learned_addr learned my addr 172.21.15.112:0/1939495732 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:23.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.344+0000 7fe767e00640 1 --2- 172.21.15.112:0/1939495732 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f7b88e3480 0x55f7b894a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:23.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.344+0000 7fe76d600640 1 --2- 172.21.15.112:0/1939495732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7b8902530 0x55f7b894ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:23.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.344+0000 7fe76cc00640 1 -- 172.21.15.112:0/1939495732 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f7b88e3480 msgr2=0x55f7b894a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:23.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.344+0000 7fe76cc00640 1 --2- 172.21.15.112:0/1939495732 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f7b88e3480 0x55f7b894a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.344+0000 7fe76cc00640 1 -- 172.21.15.112:0/1939495732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7b8902530 msgr2=0x55f7b894ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:23.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.344+0000 7fe76cc00640 1 --2- 172.21.15.112:0/1939495732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7b8902530 0x55f7b894ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.344+0000 7fe76cc00640 1 -- 172.21.15.112:0/1939495732 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7b88de4e0 con 0x55f7b88e1cf0 2024-09-12T02:43:23.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.345+0000 7fe76cc00640 1 --2- 172.21.15.112:0/1939495732 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7b88e1cf0 0x55f7b8900220 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe75c039fd0 tx=0x7fe75c009110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9f69c80f3649cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:23.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.345+0000 7fe74fe00640 1 -- 172.21.15.112:0/1939495732 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c0a7030 con 0x55f7b88e1cf0 2024-09-12T02:43:23.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.345+0000 7fe74fe00640 1 -- 172.21.15.112:0/1939495732 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe75c079ce0 con 0x55f7b88e1cf0 2024-09-12T02:43:23.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.345+0000 7fe74fe00640 1 -- 172.21.15.112:0/1939495732 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c08f040 con 0x55f7b88e1cf0 2024-09-12T02:43:23.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.346+0000 7fe772429740 1 -- 172.21.15.112:0/1939495732 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7b88e1cf0 msgr2=0x55f7b8900220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:23.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.346+0000 7fe772429740 1 --2- 172.21.15.112:0/1939495732 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7b88e1cf0 0x55f7b8900220 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe75c039fd0 tx=0x7fe75c009110 comp rx=0 tx=0).stop 2024-09-12T02:43:23.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.346+0000 7fe772429740 1 -- 172.21.15.112:0/1939495732 shutdown_connections 2024-09-12T02:43:23.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.346+0000 7fe772429740 1 --2- 172.21.15.112:0/1939495732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7b8902530 0x55f7b894ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.346+0000 7fe772429740 1 --2- 172.21.15.112:0/1939495732 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f7b88e3480 0x55f7b894a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.346+0000 7fe772429740 1 --2- 172.21.15.112:0/1939495732 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7b88e1cf0 0x55f7b8900220 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.346+0000 7fe772429740 1 -- 172.21.15.112:0/1939495732 >> 172.21.15.112:0/1939495732 conn(0x55f7b88df4b0 msgr2=0x55f7b890b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:23.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.346+0000 7fe772429740 1 -- 172.21.15.112:0/1939495732 shutdown_connections 2024-09-12T02:43:23.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.346+0000 7fe772429740 1 -- 172.21.15.112:0/1939495732 wait complete. 2024-09-12T02:43:23.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.346+0000 7fe772429740 1 -- start start 2024-09-12T02:43:23.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.347+0000 7fe772429740 1 Processor -- start 2024-09-12T02:43:23.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.347+0000 7fe772429740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7b88e1cf0 0x55f7b8926a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:23.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.348+0000 7fe772429740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f7b88e3480 0x55f7b89284c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:23.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.348+0000 7fe772429740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7b8902530 0x55f7b8928a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:23.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.348+0000 7fe772429740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f7b89029b0 con 0x55f7b88e1cf0 2024-09-12T02:43:23.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.348+0000 7fe772429740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f7b890a8a0 con 0x55f7b8902530 2024-09-12T02:43:23.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.348+0000 7fe772429740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55f7b890c220 con 0x55f7b88e3480 2024-09-12T02:43:23.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.348+0000 7fe772429740 10 client.0 _ll_register_callbacks cb 0x7fe760009eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:43:23.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.348+0000 7fe76cc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7b88e1cf0 0x55f7b8926a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:23.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.348+0000 7fe76cc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7b88e1cf0 0x55f7b8926a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40670/0 (socket says 172.21.15.112:40670) 2024-09-12T02:43:23.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.348+0000 7fe76cc00640 1 -- 172.21.15.112:0/4214525083 learned_addr learned my addr 172.21.15.112:0/4214525083 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:23.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.348+0000 7fe767e00640 1 --2- 172.21.15.112:0/4214525083 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f7b88e3480 0x55f7b89284c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:23.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.348+0000 7fe76d600640 1 --2- 172.21.15.112:0/4214525083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7b8902530 0x55f7b8928a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:23.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.348+0000 7fe76cc00640 1 -- 172.21.15.112:0/4214525083 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f7b88e3480 msgr2=0x55f7b89284c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:23.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.348+0000 7fe76cc00640 1 --2- 172.21.15.112:0/4214525083 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f7b88e3480 0x55f7b89284c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.348+0000 7fe76cc00640 1 -- 172.21.15.112:0/4214525083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7b8902530 msgr2=0x55f7b8928a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:23.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.348+0000 7fe76cc00640 1 --2- 172.21.15.112:0/4214525083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7b8902530 0x55f7b8928a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.348+0000 7fe76cc00640 1 -- 172.21.15.112:0/4214525083 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7b8926f90 con 0x55f7b88e1cf0 2024-09-12T02:43:23.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.348+0000 7fe76cc00640 1 --2- 172.21.15.112:0/4214525083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7b88e1cf0 0x55f7b8926a50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe75c076140 tx=0x7fe75c049040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ebb76f3505a82 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:23.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.348+0000 7fe74d600640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-12T02:43:23.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.349+0000 7fe74d600640 1 -- 172.21.15.112:0/4214525083 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c0a7030 con 0x55f7b88e1cf0 2024-09-12T02:43:23.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.349+0000 7fe74d600640 1 -- 172.21.15.112:0/4214525083 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fe75c077fe0 con 0x55f7b88e1cf0 2024-09-12T02:43:23.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.349+0000 7fe772429740 1 -- 172.21.15.112:0/4214525083 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe75c079ce0 con 0x55f7b88e1cf0 2024-09-12T02:43:23.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.349+0000 7fe74d600640 1 -- 172.21.15.112:0/4214525083 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe75c08f040 con 0x55f7b88e1cf0 2024-09-12T02:43:23.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.349+0000 7fe772429740 10 client.5283 fetch_fsmap learned FSMap version 27 2024-09-12T02:43:23.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.349+0000 7fe772429740 1 -- 172.21.15.112:0/4214525083 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55f7b8906b70 con 0x55f7b88e1cf0 2024-09-12T02:43:23.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.351+0000 7fe74d600640 1 -- 172.21.15.112:0/4214525083 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe75c079ce0 con 0x55f7b88e1cf0 2024-09-12T02:43:23.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.351+0000 7fe74d600640 1 -- 172.21.15.112:0/4214525083 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fe75c03a030 con 0x55f7b88e1cf0 2024-09-12T02:43:23.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.351+0000 7fe772429740 10 client.5283 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:43:23.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.351+0000 7fe772429740 10 client.5283 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:43:23.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.351+0000 7fe772429740 20 client.5283 populate_metadata read hostname 'smithi112' 2024-09-12T02:43:23.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.351+0000 7fe772429740 1 --2- 172.21.15.112:0/4214525083 >> [v2:172.21.15.137:6833/3597512060,v1:172.21.15.137:6835/3597512060] conn(0x55f7b8908380 0x55f7b89a48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:23.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.351+0000 7fe772429740 4 client.5283 mds_command: new command op to 5017 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:43:23.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.351+0000 7fe772429740 1 -- 172.21.15.112:0/4214525083 --> [v2:172.21.15.137:6833/3597512060,v1:172.21.15.137:6835/3597512060] -- command(tid 0: {"prefix": "status"}) -- 0x55f7b88e0db0 con 0x55f7b8908380 2024-09-12T02:43:23.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.352+0000 7fe767e00640 1 --2- 172.21.15.112:0/4214525083 >> [v2:172.21.15.137:6833/3597512060,v1:172.21.15.137:6835/3597512060] conn(0x55f7b8908380 0x55f7b89a48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:23.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.352+0000 7fe767e00640 1 --2- 172.21.15.112:0/4214525083 >> [v2:172.21.15.137:6833/3597512060,v1:172.21.15.137:6835/3597512060] conn(0x55f7b8908380 0x55f7b89a48d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8f6659d4d3c6711 server_cookie=bf764280dc3a0ddf in_seq=0 out_seq=0 2024-09-12T02:43:23.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.352+0000 7fe74d600640 10 client.5283 ms_handle_connect on v2:172.21.15.137:6833/3597512060 2024-09-12T02:43:23.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.353+0000 7fe74d600640 1 -- 172.21.15.112:0/4214525083 <== mds.0 v2:172.21.15.137:6833/3597512060 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55f7b88e0db0 con 0x55f7b8908380 2024-09-12T02:43:23.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.353+0000 7fe74d600640 10 client.5283 handle_command_reply: tid=0 2024-09-12T02:43:23.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.353+0000 7fe772429740 1 client.5283 shutdown 2024-09-12T02:43:23.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.353+0000 7fe772429740 1 -- 172.21.15.112:0/4214525083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7b88e1cf0 msgr2=0x55f7b8926a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:23.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.353+0000 7fe772429740 1 --2- 172.21.15.112:0/4214525083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7b88e1cf0 0x55f7b8926a50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe75c076140 tx=0x7fe75c049040 comp rx=0 tx=0).stop 2024-09-12T02:43:23.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.353+0000 7fe772429740 1 -- 172.21.15.112:0/4214525083 shutdown_connections 2024-09-12T02:43:23.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.353+0000 7fe772429740 1 --2- 172.21.15.112:0/4214525083 >> [v2:172.21.15.137:6833/3597512060,v1:172.21.15.137:6835/3597512060] conn(0x55f7b8908380 0x55f7b89a48d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.353+0000 7fe772429740 1 --2- 172.21.15.112:0/4214525083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7b8902530 0x55f7b8928a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.353+0000 7fe772429740 1 --2- 172.21.15.112:0/4214525083 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f7b88e3480 0x55f7b89284c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.353+0000 7fe74d600640 0 client.5283 ms_handle_reset on v2:172.21.15.137:6833/3597512060 2024-09-12T02:43:23.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.353+0000 7fe772429740 1 --2- 172.21.15.112:0/4214525083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7b88e1cf0 0x55f7b8926a50 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.353+0000 7fe772429740 1 -- 172.21.15.112:0/4214525083 >> 172.21.15.112:0/4214525083 conn(0x55f7b88df4b0 msgr2=0x55f7b8924f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:23.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.353+0000 7fe772429740 1 -- 172.21.15.112:0/4214525083 shutdown_connections 2024-09-12T02:43:23.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.353+0000 7fe772429740 1 -- 172.21.15.112:0/4214525083 wait complete. 2024-09-12T02:43:23.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.353+0000 7fe772429740 20 client.5283 trim_cache size 0 max 16384 2024-09-12T02:43:23.357 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:43:23.357 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:43:23.357 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2024-09-12T02:43:23.357 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 5017, 2024-09-12T02:43:23.357 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2024-09-12T02:43:23.357 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2024-09-12T02:43:23.357 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2024-09-12T02:43:23.357 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 6.0225859770000003, 2024-09-12T02:43:23.357 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 27, 2024-09-12T02:43:23.357 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 45, 2024-09-12T02:43:23.357 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 45, 2024-09-12T02:43:23.357 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 10.424051438999999 2024-09-12T02:43:23.357 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:43:23.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.354+0000 7fe76f600640 1 -- 172.21.15.112:0/2765203124 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe74806be60 msgr2=0x7fe74806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:23.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.354+0000 7fe76f600640 1 --2- 172.21.15.112:0/2765203124 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe74806be60 0x7fe74806e320 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe7680afb50 tx=0x7fe754009040 comp rx=0 tx=0).stop 2024-09-12T02:43:23.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.354+0000 7fe76f600640 1 -- 172.21.15.112:0/2765203124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe768071530 msgr2=0x7fe7681488c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:23.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.354+0000 7fe76f600640 1 --2- 172.21.15.112:0/2765203124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe768071530 0x7fe7681488c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe75c000c00 tx=0x7fe75c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.354+0000 7fe76f600640 1 -- 172.21.15.112:0/2765203124 shutdown_connections 2024-09-12T02:43:23.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.354+0000 7fe76f600640 1 --2- 172.21.15.112:0/2765203124 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe76815cc50 0x7fe768145480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.354+0000 7fe76f600640 1 --2- 172.21.15.112:0/2765203124 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe74806be60 0x7fe74806e320 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.354+0000 7fe76f600640 1 --2- 172.21.15.112:0/2765203124 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7680afe30 0x7fe768148e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.354+0000 7fe76f600640 1 --2- 172.21.15.112:0/2765203124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe768071530 0x7fe7681488c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.354+0000 7fe76f600640 1 -- 172.21.15.112:0/2765203124 >> 172.21.15.112:0/2765203124 conn(0x7fe76806bbd0 msgr2=0x7fe7680b0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:23.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.354+0000 7fe76f600640 1 -- 172.21.15.112:0/2765203124 shutdown_connections 2024-09-12T02:43:23.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.354+0000 7fe76f600640 1 -- 172.21.15.112:0/2765203124 wait complete. 2024-09-12T02:43:23.370 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:43:23.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.520+0000 7feaf1200640 1 Processor -- start 2024-09-12T02:43:23.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.521+0000 7feaf1200640 1 -- start start 2024-09-12T02:43:23.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.522+0000 7feaf1200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feaec0afe30 0x7feaec0cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:23.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.522+0000 7feaf1200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaec0ceeb0 con 0x7feaec15cc50 2024-09-12T02:43:23.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.522+0000 7feaf1200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaec06e300 con 0x7feaec071530 2024-09-12T02:43:23.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.522+0000 7feaf1200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7feaec15d030 con 0x7feaec0afe30 2024-09-12T02:43:23.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.522+0000 7feae9e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7feaec15cc50 0x7feaec0732f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:44770/0 (socket says 172.21.15.112:44770) 2024-09-12T02:43:23.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.522+0000 7feae9e00640 1 -- 172.21.15.112:0/1151048416 learned_addr learned my addr 172.21.15.112:0/1151048416 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:23.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.522+0000 7feaea800640 1 --2- 172.21.15.112:0/1151048416 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feaec0afe30 0x7feaec0cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:23.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.522+0000 7feae8a00640 1 -- 172.21.15.112:0/1151048416 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3134108966 0 0) 0x7feaec0ceeb0 con 0x7feaec15cc50 2024-09-12T02:43:23.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.522+0000 7feae8a00640 1 -- 172.21.15.112:0/1151048416 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fead0003520 con 0x7feaec15cc50 2024-09-12T02:43:23.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.523+0000 7feae8a00640 1 -- 172.21.15.112:0/1151048416 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3688703854 0 0) 0x7fead0003520 con 0x7feaec15cc50 2024-09-12T02:43:23.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.523+0000 7feae8a00640 1 -- 172.21.15.112:0/1151048416 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feaec0afe30 msgr2=0x7feaec0cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:23.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.523+0000 7feae8a00640 1 --2- 172.21.15.112:0/1151048416 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feaec0afe30 0x7feaec0cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.523+0000 7feae8a00640 1 -- 172.21.15.112:0/1151048416 >> v1:172.21.15.137:6789/0 conn(0x7feaec071530 legacy=0x7feaec0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:23.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.523+0000 7feae8a00640 1 -- 172.21.15.112:0/1151048416 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaec06e5e0 con 0x7feaec15cc50 2024-09-12T02:43:23.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.523+0000 7feae8a00640 1 -- 172.21.15.112:0/1151048416 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7feadc001670 con 0x7feaec15cc50 2024-09-12T02:43:23.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.523+0000 7feae8a00640 1 -- 172.21.15.112:0/1151048416 >> v1:172.21.15.112:6789/0 conn(0x7feaec15cc50 legacy=0x7feaec0732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:23.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.523+0000 7feae8a00640 1 --2- 172.21.15.112:0/1151048416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fead00039e0 0x7fead0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:23.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.523+0000 7feae8a00640 1 --2- 172.21.15.112:0/1151048416 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feaec0afe30 0x7fead0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:23.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.523+0000 7feae8a00640 1 --2- 172.21.15.112:0/1151048416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fead0004d40 0x7fead00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:23.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.523+0000 7feae8a00640 1 -- 172.21.15.112:0/1151048416 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fead000ba70 con 0x7fead0004d40 2024-09-12T02:43:23.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.523+0000 7feae8a00640 1 -- 172.21.15.112:0/1151048416 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fead000bc20 con 0x7fead00039e0 2024-09-12T02:43:23.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.523+0000 7feae8a00640 1 -- 172.21.15.112:0/1151048416 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fead000be20 con 0x7feaec0afe30 2024-09-12T02:43:23.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.523+0000 7feae9e00640 1 --2- 172.21.15.112:0/1151048416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fead00039e0 0x7fead0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:23.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.523+0000 7feaea800640 1 --2- 172.21.15.112:0/1151048416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fead0004d40 0x7fead00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:23.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.523+0000 7feae9400640 1 --2- 172.21.15.112:0/1151048416 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feaec0afe30 0x7fead0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:23.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.524+0000 7feaea800640 1 -- 172.21.15.112:0/1151048416 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feaec0afe30 msgr2=0x7fead0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:23.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.524+0000 7feaea800640 1 --2- 172.21.15.112:0/1151048416 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feaec0afe30 0x7fead0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.524+0000 7feaea800640 1 -- 172.21.15.112:0/1151048416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fead00039e0 msgr2=0x7fead0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:23.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.524+0000 7feaea800640 1 --2- 172.21.15.112:0/1151048416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fead00039e0 0x7fead0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.524+0000 7feaea800640 1 -- 172.21.15.112:0/1151048416 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead0003520 con 0x7fead0004d40 2024-09-12T02:43:23.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.525+0000 7feaea800640 1 --2- 172.21.15.112:0/1151048416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fead0004d40 0x7fead00051c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7feaec0710c0 tx=0x7fead0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e9f2bb0cd60a26a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:23.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.525+0000 7feae8a00640 1 -- 172.21.15.112:0/1151048416 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae4037070 con 0x7fead0004d40 2024-09-12T02:43:23.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.525+0000 7feae8a00640 1 -- 172.21.15.112:0/1151048416 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feae402e050 con 0x7fead0004d40 2024-09-12T02:43:23.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.525+0000 7feae8a00640 1 -- 172.21.15.112:0/1151048416 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae4009c10 con 0x7fead0004d40 2024-09-12T02:43:23.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.525+0000 7feaf1200640 1 -- 172.21.15.112:0/1151048416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fead0004d40 msgr2=0x7fead00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:23.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.525+0000 7feaf1200640 1 --2- 172.21.15.112:0/1151048416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fead0004d40 0x7fead00051c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7feaec0710c0 tx=0x7fead0005830 comp rx=0 tx=0).stop 2024-09-12T02:43:23.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.525+0000 7feaea800640 1 -- 172.21.15.112:0/1151048416 reap_dead start 2024-09-12T02:43:23.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.526+0000 7feaf1200640 1 -- 172.21.15.112:0/1151048416 shutdown_connections 2024-09-12T02:43:23.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.526+0000 7feaf1200640 1 -- 172.21.15.112:0/1151048416 >> 172.21.15.112:0/1151048416 conn(0x7feaec06bbd0 msgr2=0x7feaec06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:23.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.526+0000 7feaf1200640 1 -- 172.21.15.112:0/1151048416 shutdown_connections 2024-09-12T02:43:23.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.526+0000 7feaf1200640 1 -- 172.21.15.112:0/1151048416 wait complete. 2024-09-12T02:43:23.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.527+0000 7feaf1200640 1 Processor -- start 2024-09-12T02:43:23.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.527+0000 7feaf1200640 1 -- start start 2024-09-12T02:43:23.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.528+0000 7feaf1200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fead0004d40 0x7feaec1503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:23.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.528+0000 7feaf1200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feaec158580 0x7feaec0abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:23.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.528+0000 7feaf1200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaec0ae100 0x7feaec0ae580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:23.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.528+0000 7feaf1200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7feaec06f510 con 0x7feaec0ae100 2024-09-12T02:43:23.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.528+0000 7feaf1200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7feaec0cf4c0 con 0x7feaec158580 2024-09-12T02:43:23.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.528+0000 7feaf1200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7feaec06f690 con 0x7fead0004d40 2024-09-12T02:43:23.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.529+0000 7feaea800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaec0ae100 0x7feaec0ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:23.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.529+0000 7feaea800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaec0ae100 0x7feaec0ae580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40688/0 (socket says 172.21.15.112:40688) 2024-09-12T02:43:23.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.529+0000 7feaea800640 1 -- 172.21.15.112:0/3554704194 learned_addr learned my addr 172.21.15.112:0/3554704194 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:23.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.529+0000 7feae9400640 1 --2- 172.21.15.112:0/3554704194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feaec158580 0x7feaec0abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:23.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.529+0000 7feae9e00640 1 --2- 172.21.15.112:0/3554704194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fead0004d40 0x7feaec1503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:23.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.529+0000 7feaea800640 1 -- 172.21.15.112:0/3554704194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fead0004d40 msgr2=0x7feaec1503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:23.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.529+0000 7feaea800640 1 --2- 172.21.15.112:0/3554704194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fead0004d40 0x7feaec1503a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.529+0000 7feaea800640 1 -- 172.21.15.112:0/3554704194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feaec158580 msgr2=0x7feaec0abcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:23.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.529+0000 7feaea800640 1 --2- 172.21.15.112:0/3554704194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feaec158580 0x7feaec0abcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.529+0000 7feaea800640 1 -- 172.21.15.112:0/3554704194 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaec0ac550 con 0x7feaec0ae100 2024-09-12T02:43:23.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.529+0000 7feaea800640 1 --2- 172.21.15.112:0/3554704194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaec0ae100 0x7feaec0ae580 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7feae400e230 tx=0x7feae4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:23.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.530+0000 7feae2000640 1 -- 172.21.15.112:0/3554704194 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae4043020 con 0x7feaec0ae100 2024-09-12T02:43:23.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.530+0000 7feae2000640 1 -- 172.21.15.112:0/3554704194 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feae4003990 con 0x7feaec0ae100 2024-09-12T02:43:23.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.530+0000 7feaf1200640 1 -- 172.21.15.112:0/3554704194 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaec0ac830 con 0x7feaec0ae100 2024-09-12T02:43:23.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.530+0000 7feae2000640 1 -- 172.21.15.112:0/3554704194 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae4037040 con 0x7feaec0ae100 2024-09-12T02:43:23.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.530+0000 7feaf1200640 1 -- 172.21.15.112:0/3554704194 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaec1508e0 con 0x7feaec0ae100 2024-09-12T02:43:23.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.531+0000 7feaf1200640 1 -- 172.21.15.112:0/3554704194 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaec068a30 con 0x7feaec0ae100 2024-09-12T02:43:23.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.532+0000 7feae2000640 1 -- 172.21.15.112:0/3554704194 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feae4005d10 con 0x7feaec0ae100 2024-09-12T02:43:23.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.533+0000 7feae2000640 1 --2- 172.21.15.112:0/3554704194 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7feacc06be30 0x7feacc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:23.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.533+0000 7feae2000640 1 -- 172.21.15.112:0/3554704194 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7feae40ab6c0 con 0x7feaec0ae100 2024-09-12T02:43:23.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.533+0000 7feae9e00640 1 --2- 172.21.15.112:0/3554704194 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7feacc06be30 0x7feacc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:23.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.534+0000 7feae9e00640 1 --2- 172.21.15.112:0/3554704194 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7feacc06be30 0x7feacc06e2f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feadc000c00 tx=0x7feadc0078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:23.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.537+0000 7feae2000640 1 -- 172.21.15.112:0/3554704194 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feae404d020 con 0x7feaec0ae100 2024-09-12T02:43:23.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.744+0000 7feaf1200640 1 -- 172.21.15.112:0/3554704194 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7feaec06df60 con 0x7feaec0ae100 2024-09-12T02:43:23.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.745+0000 7feae2000640 1 -- 172.21.15.112:0/3554704194 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7feae4079bd0 con 0x7feaec0ae100 2024-09-12T02:43:23.746 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:43:23.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.747+0000 7feaf1200640 1 -- 172.21.15.112:0/3554704194 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7feacc06be30 msgr2=0x7feacc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:23.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.747+0000 7feaf1200640 1 --2- 172.21.15.112:0/3554704194 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7feacc06be30 0x7feacc06e2f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feadc000c00 tx=0x7feadc0078f0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.747+0000 7feaf1200640 1 -- 172.21.15.112:0/3554704194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaec0ae100 msgr2=0x7feaec0ae580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:23.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.747+0000 7feaf1200640 1 --2- 172.21.15.112:0/3554704194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaec0ae100 0x7feaec0ae580 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7feae400e230 tx=0x7feae4009750 comp rx=0 tx=0).stop 2024-09-12T02:43:23.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.747+0000 7feaf1200640 1 -- 172.21.15.112:0/3554704194 shutdown_connections 2024-09-12T02:43:23.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.747+0000 7feaf1200640 1 --2- 172.21.15.112:0/3554704194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaec0ae100 0x7feaec0ae580 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.747+0000 7feaf1200640 1 --2- 172.21.15.112:0/3554704194 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7feacc06be30 0x7feacc06e2f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.747+0000 7feaf1200640 1 --2- 172.21.15.112:0/3554704194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feaec158580 0x7feaec0abcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.747+0000 7feaf1200640 1 --2- 172.21.15.112:0/3554704194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fead0004d40 0x7feaec1503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:23.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.747+0000 7feaf1200640 1 -- 172.21.15.112:0/3554704194 >> 172.21.15.112:0/3554704194 conn(0x7feaec06bbd0 msgr2=0x7feaec0b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:23.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.747+0000 7feaf1200640 1 -- 172.21.15.112:0/3554704194 shutdown_connections 2024-09-12T02:43:23.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:23.747+0000 7feaf1200640 1 -- 172.21.15.112:0/3554704194 wait complete. 2024-09-12T02:43:23.763 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:43:23.764 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:43:23.764 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-09-12T02:43:23.764 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:43:23.764 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:43:23.764 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:43:23.764 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:43:23.764 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:43:23.764 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:43:23.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:43:23.764 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-09-12T02:43:23.800 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:43:23.800 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:43:23.800 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:43:23.800 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:43:23.800 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-12T02:43:23.801 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:43:23.801 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:43:23.801 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-09-12T02:43:23.801 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-09-12T02:43:23.801 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:43:23.801 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-09-12T02:43:23.801 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-09-12T02:43:23.801 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:43:23.801 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:43:23.801 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:43:23.801 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:43:23.801 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:43:23.802 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42675sec preferred_lft 42675sec 2024-09-12T02:43:23.802 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link noprefixroute 2024-09-12T02:43:23.802 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:43:23.802 INFO:teuthology.orchestra.run.smithi112.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:43:23.802 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 4e:56:d4:fc:33:ba brd ff:ff:ff:ff:ff:ff 2024-09-12T02:43:23.802 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:43:23.802 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:43:23.802 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::787f:67ff:fe10:c915/64 scope link 2024-09-12T02:43:23.802 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:43:23.802 INFO:teuthology.orchestra.run.smithi112.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:43:23.802 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 4e:56:d4:fc:33:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:43:23.802 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::4c56:d4ff:fefc:33ba/64 scope link 2024-09-12T02:43:23.803 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:43:23.803 INFO:teuthology.orchestra.run.smithi112.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:43:23.803 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 86:ed:0e:b6:37:5f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:43:23.803 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::84ed:eff:feb6:375f/64 scope link 2024-09-12T02:43:23.803 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:43:23.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:43:23.803 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:43:23.894 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-12T02:43:23.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:43:23.897 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-09-12T02:43:23.933 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-09-12T02:43:23.933 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:43:23.933 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:43:23.933 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:43:23.933 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:43:23.933 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:43:23.934 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-12T02:43:23.934 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:43:23.934 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:43:23.934 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:43:23.934 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-12T02:43:24.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:43:24.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:43:24.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:43:24.130 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-12T02:43:24.165 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:43:24.165 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:43:24.165 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:43:24.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:43:24.166 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2024-09-12T02:43:24.262 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:43:24.262 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:43:24.297 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:43:24.298 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:43:24.298 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:43:24.373 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T02:43:24.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:43:24.373 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:43:24.500 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:43:24.501 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:43:24.528 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:43:24.529 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:43:24.529 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-09-12T02:43:24.529 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 0@7c01f3b3-dec2-4449-a33f-f960d7527ea6.cephfs=/ 2024-09-12T02:43:24.529 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.112:3300/172.21.15.137:3300/172.21.15.137:3301" will pass to kernel 2024-09-12T02:43:24.533 INFO:teuthology.orchestra.run.smithi112.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:43:24.533 INFO:teuthology.orchestra.run.smithi112.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:43:24.533 INFO:teuthology.orchestra.run.smithi112.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:43:24.534 INFO:teuthology.orchestra.run.smithi112.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:43:24.534 INFO:teuthology.orchestra.run.smithi112.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:43:24.534 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:43:24.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:43:24.534 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:43:24.592 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:43:24.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:43:24.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:43:24.691 INFO:teuthology.orchestra.run.smithi112.stdout:client4862 2024-09-12T02:43:24.691 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:43:24.691 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:43:24.727 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:43:24.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.919+0000 7f55b8c00640 1 Processor -- start 2024-09-12T02:43:24.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.919+0000 7f55b8c00640 1 -- start start 2024-09-12T02:43:24.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.920+0000 7f55b8c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f55b415cc50 0x7f55b40732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:24.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.920+0000 7f55b8c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f55b4071530 0x7f55b40af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:24.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.920+0000 7f55b8c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55b4073830 con 0x7f55b40719a0 2024-09-12T02:43:24.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.920+0000 7f55b8c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f55b415d030 con 0x7f55b4071530 2024-09-12T02:43:24.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.920+0000 7f55b8c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f55b40cf4c0 con 0x7f55b415cc50 2024-09-12T02:43:24.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.921+0000 7f55b2800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f55b40719a0 0x7f55b40cf950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:44780/0 (socket says 172.21.15.112:44780) 2024-09-12T02:43:24.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.921+0000 7f55b2800640 1 -- 172.21.15.112:0/3910419268 learned_addr learned my addr 172.21.15.112:0/3910419268 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:24.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.921+0000 7f55b1400640 1 --2- 172.21.15.112:0/3910419268 >> v2:172.21.15.112:3300/0 conn(0x7f55b4071530 0x7f55b40af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:24.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.921+0000 7f55b1e00640 1 --2- 172.21.15.112:0/3910419268 >> v2:172.21.15.137:3300/0 conn(0x7f55b415cc50 0x7f55b40732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:24.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.921+0000 7f55b1400640 1 -- 172.21.15.112:0/3910419268 >> v2:172.21.15.137:3300/0 conn(0x7f55b415cc50 msgr2=0x7f55b40732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:24.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.921+0000 7f55b0a00640 1 -- 172.21.15.112:0/3910419268 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2606860888 0 0) 0x7f55ac001490 con 0x7f55b40719a0 2024-09-12T02:43:24.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.921+0000 7f55b1400640 1 --2- 172.21.15.112:0/3910419268 >> v2:172.21.15.137:3300/0 conn(0x7f55b415cc50 0x7f55b40732f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:24.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.921+0000 7f55b1400640 1 -- 172.21.15.112:0/3910419268 >> v1:172.21.15.112:6789/0 conn(0x7f55b40719a0 legacy=0x7f55b40cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:24.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.921+0000 7f55b1400640 1 -- 172.21.15.112:0/3910419268 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55b40ceeb0 con 0x7f55b4071530 2024-09-12T02:43:24.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.922+0000 7f55b1400640 1 --2- 172.21.15.112:0/3910419268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55b4071530 0x7f55b40af720 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f55b4070060 tx=0x7f55a002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0589b6851592fe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:24.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.922+0000 7f55b0a00640 1 -- 172.21.15.112:0/3910419268 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a0037070 con 0x7f55b4071530 2024-09-12T02:43:24.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.922+0000 7f55b0a00640 1 -- 172.21.15.112:0/3910419268 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a0032440 con 0x7f55b4071530 2024-09-12T02:43:24.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.923+0000 7f55b0a00640 1 -- 172.21.15.112:0/3910419268 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a002ae60 con 0x7f55b4071530 2024-09-12T02:43:24.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.923+0000 7f55b8c00640 1 -- 172.21.15.112:0/3910419268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55b4071530 msgr2=0x7f55b40af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:24.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.923+0000 7f55b8c00640 1 --2- 172.21.15.112:0/3910419268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55b4071530 0x7f55b40af720 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f55b4070060 tx=0x7f55a002a110 comp rx=0 tx=0).stop 2024-09-12T02:43:24.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.923+0000 7f55b8c00640 1 -- 172.21.15.112:0/3910419268 shutdown_connections 2024-09-12T02:43:24.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.923+0000 7f55b8c00640 1 --2- 172.21.15.112:0/3910419268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55b4071530 0x7f55b40af720 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:24.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.923+0000 7f55b8c00640 1 --2- 172.21.15.112:0/3910419268 >> v2:172.21.15.137:3300/0 conn(0x7f55b415cc50 0x7f55b40732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:24.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.923+0000 7f55b8c00640 1 -- 172.21.15.112:0/3910419268 >> 172.21.15.112:0/3910419268 conn(0x7f55b406bbd0 msgr2=0x7f55b406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:24.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.923+0000 7f55b8c00640 1 -- 172.21.15.112:0/3910419268 shutdown_connections 2024-09-12T02:43:24.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.923+0000 7f55b8c00640 1 -- 172.21.15.112:0/3910419268 wait complete. 2024-09-12T02:43:24.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.925+0000 7f55b8c00640 1 Processor -- start 2024-09-12T02:43:24.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.925+0000 7f55b8c00640 1 -- start start 2024-09-12T02:43:24.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.926+0000 7f55b8c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55b4071530 0x7f55b4150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:24.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.926+0000 7f55b8c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55b40719a0 0x7f55b41522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:24.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.926+0000 7f55b8c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55b415cc50 0x7f55b4147310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:24.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.926+0000 7f55b8c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f55b40cf150 con 0x7f55b415cc50 2024-09-12T02:43:24.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.926+0000 7f55b8c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f55b406e5e0 con 0x7f55b4071530 2024-09-12T02:43:24.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.926+0000 7f55b8c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f55b406f510 con 0x7f55b40719a0 2024-09-12T02:43:24.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.926+0000 7f55b2800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55b415cc50 0x7f55b4147310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:24.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.926+0000 7f55b2800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55b415cc50 0x7f55b4147310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40716/0 (socket says 172.21.15.112:40716) 2024-09-12T02:43:24.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.926+0000 7f55b2800640 1 -- 172.21.15.112:0/3967566500 learned_addr learned my addr 172.21.15.112:0/3967566500 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:24.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.926+0000 7f55b1e00640 1 --2- 172.21.15.112:0/3967566500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55b4071530 0x7f55b4150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:24.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.926+0000 7f55b1400640 1 --2- 172.21.15.112:0/3967566500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55b40719a0 0x7f55b41522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:24.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.926+0000 7f55b2800640 1 -- 172.21.15.112:0/3967566500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55b40719a0 msgr2=0x7f55b41522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:24.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.926+0000 7f55b2800640 1 --2- 172.21.15.112:0/3967566500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55b40719a0 0x7f55b41522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:24.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.926+0000 7f55b2800640 1 -- 172.21.15.112:0/3967566500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55b4071530 msgr2=0x7f55b4150bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:24.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.926+0000 7f55b2800640 1 --2- 172.21.15.112:0/3967566500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55b4071530 0x7f55b4150bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:24.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.926+0000 7f55b2800640 1 -- 172.21.15.112:0/3967566500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55b414fe30 con 0x7f55b415cc50 2024-09-12T02:43:24.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.926+0000 7f55b1400640 1 --2- 172.21.15.112:0/3967566500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55b40719a0 0x7f55b41522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:43:24.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.927+0000 7f55b2800640 1 --2- 172.21.15.112:0/3967566500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55b415cc50 0x7f55b4147310 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f55ac00c7c0 tx=0x7f55ac00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:24.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.927+0000 7f55aa000640 1 -- 172.21.15.112:0/3967566500 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ac018070 con 0x7f55b415cc50 2024-09-12T02:43:24.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.927+0000 7f55aa000640 1 -- 172.21.15.112:0/3967566500 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55ac00a5e0 con 0x7f55b415cc50 2024-09-12T02:43:24.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.927+0000 7f55aa000640 1 -- 172.21.15.112:0/3967566500 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ac00a9d0 con 0x7f55b415cc50 2024-09-12T02:43:24.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.927+0000 7f55b8c00640 1 -- 172.21.15.112:0/3967566500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55b4150110 con 0x7f55b415cc50 2024-09-12T02:43:24.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.927+0000 7f55b8c00640 1 -- 172.21.15.112:0/3967566500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55b41506d0 con 0x7f55b415cc50 2024-09-12T02:43:24.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.928+0000 7f55b8c00640 1 -- 172.21.15.112:0/3967566500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55b4068a30 con 0x7f55b415cc50 2024-09-12T02:43:24.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.929+0000 7f55aa000640 1 -- 172.21.15.112:0/3967566500 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f55ac01b070 con 0x7f55b415cc50 2024-09-12T02:43:24.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.930+0000 7f55aa000640 1 --2- 172.21.15.112:0/3967566500 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f559406be30 0x7f559406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:24.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.930+0000 7f55aa000640 1 -- 172.21.15.112:0/3967566500 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f55ac08a400 con 0x7f55b415cc50 2024-09-12T02:43:24.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.931+0000 7f55b1e00640 1 --2- 172.21.15.112:0/3967566500 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f559406be30 0x7f559406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:24.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.931+0000 7f55b1e00640 1 --2- 172.21.15.112:0/3967566500 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f559406be30 0x7f559406e2f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f55a40079a0 tx=0x7f55a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:24.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:24.935+0000 7f55aa000640 1 -- 172.21.15.112:0/3967566500 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f55b4073830 con 0x7f55b415cc50 2024-09-12T02:43:25.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:25.140+0000 7f55b8c00640 1 -- 172.21.15.112:0/3967566500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f55b415c790 con 0x7f55b415cc50 2024-09-12T02:43:25.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:25.140+0000 7f55aa000640 1 -- 172.21.15.112:0/3967566500 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7f55ac058750 con 0x7f55b415cc50 2024-09-12T02:43:25.141 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:43:25.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:25.142+0000 7f55b8c00640 1 -- 172.21.15.112:0/3967566500 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f559406be30 msgr2=0x7f559406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:25.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:25.142+0000 7f55b8c00640 1 --2- 172.21.15.112:0/3967566500 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f559406be30 0x7f559406e2f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f55a40079a0 tx=0x7f55a4008040 comp rx=0 tx=0).stop 2024-09-12T02:43:25.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:25.142+0000 7f55b8c00640 1 -- 172.21.15.112:0/3967566500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55b415cc50 msgr2=0x7f55b4147310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:25.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:25.142+0000 7f55b8c00640 1 --2- 172.21.15.112:0/3967566500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55b415cc50 0x7f55b4147310 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f55ac00c7c0 tx=0x7f55ac00cc80 comp rx=0 tx=0).stop 2024-09-12T02:43:25.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:25.142+0000 7f55b8c00640 1 -- 172.21.15.112:0/3967566500 shutdown_connections 2024-09-12T02:43:25.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:25.142+0000 7f55b8c00640 1 --2- 172.21.15.112:0/3967566500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55b415cc50 0x7f55b4147310 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:25.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:25.142+0000 7f55b8c00640 1 --2- 172.21.15.112:0/3967566500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f55b40719a0 0x7f55b41522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:25.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:25.143+0000 7f55b8c00640 1 --2- 172.21.15.112:0/3967566500 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f559406be30 0x7f559406e2f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:25.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:25.143+0000 7f55b8c00640 1 --2- 172.21.15.112:0/3967566500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55b4071530 0x7f55b4150bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:25.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:25.143+0000 7f55b8c00640 1 -- 172.21.15.112:0/3967566500 >> 172.21.15.112:0/3967566500 conn(0x7f55b406bbd0 msgr2=0x7f55b406e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:25.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:25.143+0000 7f55b8c00640 1 -- 172.21.15.112:0/3967566500 shutdown_connections 2024-09-12T02:43:25.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:25.143+0000 7f55b8c00640 1 -- 172.21.15.112:0/3967566500 wait complete. 2024-09-12T02:43:25.159 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:43:25.159 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:43:25.159 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-09-12T02:43:25.159 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T02:43:25.159 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T02:43:25.159 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:43:25.159 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:43:25.159 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:43:25.159 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:43:25.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:43:25.160 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-09-12T02:43:25.200 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:43:25.201 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:43:25.201 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:43:25.201 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:43:25.201 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-09-12T02:43:25.201 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:43:25.201 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:43:25.201 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-09-12T02:43:25.201 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-09-12T02:43:25.201 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:43:25.201 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-09-12T02:43:25.201 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-09-12T02:43:25.201 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:43:25.201 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:43:25.202 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:43:25.202 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:43:25.202 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:43:25.202 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42673sec preferred_lft 42673sec 2024-09-12T02:43:25.202 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::ec4:7aff:fe88:8137/64 scope link noprefixroute 2024-09-12T02:43:25.202 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:43:25.202 INFO:teuthology.orchestra.run.smithi137.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:43:25.202 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 62:9a:8e:f1:56:55 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:43:25.202 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:43:25.202 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:43:25.202 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::30c8:13ff:fe15:f79d/64 scope link 2024-09-12T02:43:25.202 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:43:25.202 INFO:teuthology.orchestra.run.smithi137.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:43:25.202 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 62:9a:8e:f1:56:55 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:43:25.203 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::609a:8eff:fef1:5655/64 scope link 2024-09-12T02:43:25.203 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:43:25.203 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:43:25.203 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 96:f4:ca:17:88:2a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T02:43:25.203 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::94f4:caff:fe17:882a/64 scope link 2024-09-12T02:43:25.203 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:43:25.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:43:25.203 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:43:25.298 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-09-12T02:43:25.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:43:25.302 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-09-12T02:43:25.341 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-09-12T02:43:25.341 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:43:25.341 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:43:25.342 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:43:25.342 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:43:25.342 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:43:25.342 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-09-12T02:43:25.342 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:43:25.342 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:43:25.342 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:43:25.342 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-09-12T02:43:25.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:43:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:43:25.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:43:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:43:25.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:43:25.538 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-09-12T02:43:25.574 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T02:43:25.574 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T02:43:25.574 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:43:25.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:43:25.574 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-09-12T02:43:25.671 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:43:25.671 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T02:43:25.706 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:43:25.706 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:43:25.706 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T02:43:25.781 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-12T02:43:25.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:43:25.782 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:43:25.910 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:43:25.910 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:43:25.937 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:43:25.937 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:43:25.937 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-09-12T02:43:25.937 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with new device syntax: 1@7c01f3b3-dec2-4449-a33f-f960d7527ea6.cephfs=/ 2024-09-12T02:43:25.937 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.112:3300/172.21.15.137:3300/172.21.15.137:3301" will pass to kernel 2024-09-12T02:43:25.939 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-12T02:43:25.939 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:43:25.939 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:43:25.939 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:43:25.939 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:43:25.942 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:43:25.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:43:25.942 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T02:43:25.997 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:43:26.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:43:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:43:26.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:43:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:43:26.085 INFO:teuthology.orchestra.run.smithi137.stdout:client5301 2024-09-12T02:43:26.085 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:43:26.085 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:43:26.121 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:43:26.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.277+0000 7f7b77a00640 1 Processor -- start 2024-09-12T02:43:26.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.277+0000 7f7b77a00640 1 -- start start 2024-09-12T02:43:26.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.279+0000 7f7b77a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b7015b9d0 0x7f7b700b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:26.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.279+0000 7f7b77a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7b7006f600 0x7f7b700728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:26.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.279+0000 7f7b77a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b700b54a0 con 0x7f7b700b45d0 2024-09-12T02:43:26.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.279+0000 7f7b77a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f7b700b4a30 con 0x7f7b7006f600 2024-09-12T02:43:26.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.279+0000 7f7b77a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7b700b3af0 con 0x7f7b7015b9d0 2024-09-12T02:43:26.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.279+0000 7f7b75a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7b7006f600 0x7f7b700728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:26.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.279+0000 7f7b67e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f7b700b45d0 0x7f7b7006eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:44786/0 (socket says 172.21.15.112:44786) 2024-09-12T02:43:26.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.279+0000 7f7b67e00640 1 -- 172.21.15.112:0/782086083 learned_addr learned my addr 172.21.15.112:0/782086083 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:26.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.279+0000 7f7b75000640 1 --2- 172.21.15.112:0/782086083 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b7015b9d0 0x7f7b700b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:26.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.279+0000 7f7b75a00640 1 -- 172.21.15.112:0/782086083 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b7015b9d0 msgr2=0x7f7b700b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:26.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.279+0000 7f7b75a00640 1 --2- 172.21.15.112:0/782086083 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b7015b9d0 0x7f7b700b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:26.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.279+0000 7f7b75a00640 1 -- 172.21.15.112:0/782086083 >> v1:172.21.15.112:6789/0 conn(0x7f7b700b45d0 legacy=0x7f7b7006eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:26.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.280+0000 7f7b75a00640 1 -- 172.21.15.112:0/782086083 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b700b3dd0 con 0x7f7b7006f600 2024-09-12T02:43:26.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.280+0000 7f7b6fe00640 1 -- 172.21.15.112:0/782086083 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2418017963 0 0) 0x7f7b700b54a0 con 0x7f7b700b45d0 2024-09-12T02:43:26.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.280+0000 7f7b75a00640 1 --2- 172.21.15.112:0/782086083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b7006f600 0x7f7b700728c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7b68009d90 tx=0x7f7b6802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f51f95ca04d1e13 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:26.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.281+0000 7f7b6fe00640 1 -- 172.21.15.112:0/782086083 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b68007740 con 0x7f7b7006f600 2024-09-12T02:43:26.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.281+0000 7f7b6fe00640 1 -- 172.21.15.112:0/782086083 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b680078e0 con 0x7f7b7006f600 2024-09-12T02:43:26.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.281+0000 7f7b6fe00640 1 -- 172.21.15.112:0/782086083 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b68007cb0 con 0x7f7b7006f600 2024-09-12T02:43:26.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.281+0000 7f7b77a00640 1 -- 172.21.15.112:0/782086083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b7006f600 msgr2=0x7f7b700728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:26.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.281+0000 7f7b77a00640 1 --2- 172.21.15.112:0/782086083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b7006f600 0x7f7b700728c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7b68009d90 tx=0x7f7b6802a660 comp rx=0 tx=0).stop 2024-09-12T02:43:26.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.281+0000 7f7b77a00640 1 -- 172.21.15.112:0/782086083 shutdown_connections 2024-09-12T02:43:26.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.281+0000 7f7b77a00640 1 --2- 172.21.15.112:0/782086083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b7006f600 0x7f7b700728c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:26.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.281+0000 7f7b77a00640 1 --2- 172.21.15.112:0/782086083 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b7015b9d0 0x7f7b700b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:26.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.281+0000 7f7b77a00640 1 -- 172.21.15.112:0/782086083 >> 172.21.15.112:0/782086083 conn(0x7f7b7006bbd0 msgr2=0x7f7b7006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:26.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.281+0000 7f7b77a00640 1 -- 172.21.15.112:0/782086083 shutdown_connections 2024-09-12T02:43:26.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.281+0000 7f7b77a00640 1 -- 172.21.15.112:0/782086083 wait complete. 2024-09-12T02:43:26.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.283+0000 7f7b77a00640 1 Processor -- start 2024-09-12T02:43:26.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.283+0000 7f7b77a00640 1 -- start start 2024-09-12T02:43:26.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.284+0000 7f7b77a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b7006f600 0x7f7b7014a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:26.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.284+0000 7f7b77a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b700b45d0 0x7f7b70157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:26.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.284+0000 7f7b77a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b7015b9d0 0x7f7b70157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:26.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.284+0000 7f7b77a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7015bf30 con 0x7f7b7006f600 2024-09-12T02:43:26.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.284+0000 7f7b77a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7015bdb0 con 0x7f7b7015b9d0 2024-09-12T02:43:26.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.284+0000 7f7b77a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7b700cdcd0 con 0x7f7b700b45d0 2024-09-12T02:43:26.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.284+0000 7f7b75000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b7006f600 0x7f7b7014a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:26.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.284+0000 7f7b75000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b7006f600 0x7f7b7014a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40726/0 (socket says 172.21.15.112:40726) 2024-09-12T02:43:26.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.284+0000 7f7b75000640 1 -- 172.21.15.112:0/4094386557 learned_addr learned my addr 172.21.15.112:0/4094386557 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:26.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.285+0000 7f7b75a00640 1 --2- 172.21.15.112:0/4094386557 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b7015b9d0 0x7f7b70157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:26.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.285+0000 7f7b67e00640 1 --2- 172.21.15.112:0/4094386557 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b700b45d0 0x7f7b70157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:26.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.285+0000 7f7b75000640 1 -- 172.21.15.112:0/4094386557 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b700b45d0 msgr2=0x7f7b70157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:26.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.285+0000 7f7b75000640 1 --2- 172.21.15.112:0/4094386557 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b700b45d0 0x7f7b70157820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:26.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.285+0000 7f7b75000640 1 -- 172.21.15.112:0/4094386557 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b7015b9d0 msgr2=0x7f7b70157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:26.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.285+0000 7f7b75000640 1 --2- 172.21.15.112:0/4094386557 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b7015b9d0 0x7f7b70157d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:26.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.285+0000 7f7b75000640 1 -- 172.21.15.112:0/4094386557 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b70153680 con 0x7f7b7006f600 2024-09-12T02:43:26.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.285+0000 7f7b67e00640 1 --2- 172.21.15.112:0/4094386557 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b700b45d0 0x7f7b70157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:43:26.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.285+0000 7f7b75000640 1 --2- 172.21.15.112:0/4094386557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b7006f600 0x7f7b7014a710 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7b6000e870 tx=0x7f7b6000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:26.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.285+0000 7f7b6d600640 1 -- 172.21.15.112:0/4094386557 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b60017070 con 0x7f7b7006f600 2024-09-12T02:43:26.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.285+0000 7f7b6d600640 1 -- 172.21.15.112:0/4094386557 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b6000c940 con 0x7f7b7006f600 2024-09-12T02:43:26.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.285+0000 7f7b6d600640 1 -- 172.21.15.112:0/4094386557 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6000cd30 con 0x7f7b7006f600 2024-09-12T02:43:26.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.285+0000 7f7b77a00640 1 -- 172.21.15.112:0/4094386557 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b701f6430 con 0x7f7b7006f600 2024-09-12T02:43:26.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.286+0000 7f7b77a00640 1 -- 172.21.15.112:0/4094386557 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b701f69f0 con 0x7f7b7006f600 2024-09-12T02:43:26.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.287+0000 7f7b77a00640 1 -- 172.21.15.112:0/4094386557 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b70068a30 con 0x7f7b7006f600 2024-09-12T02:43:26.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.288+0000 7f7b6d600640 1 -- 172.21.15.112:0/4094386557 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7b6001a070 con 0x7f7b7006f600 2024-09-12T02:43:26.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.288+0000 7f7b6d600640 1 --2- 172.21.15.112:0/4094386557 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7b4c06be30 0x7f7b4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:26.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.289+0000 7f7b6d600640 1 -- 172.21.15.112:0/4094386557 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f7b6008aff0 con 0x7f7b7006f600 2024-09-12T02:43:26.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.289+0000 7f7b67e00640 1 --2- 172.21.15.112:0/4094386557 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7b4c06be30 0x7f7b4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:26.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.289+0000 7f7b67e00640 1 --2- 172.21.15.112:0/4094386557 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7b4c06be30 0x7f7b4c06e2f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7b700730b0 tx=0x7f7b58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:26.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.293+0000 7f7b6d600640 1 -- 172.21.15.112:0/4094386557 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7b60059380 con 0x7f7b7006f600 2024-09-12T02:43:26.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.502+0000 7f7b77a00640 1 -- 172.21.15.112:0/4094386557 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b700afb80 con 0x7f7b7006f600 2024-09-12T02:43:26.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.503+0000 7f7b6d600640 1 -- 172.21.15.112:0/4094386557 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5229 (secure 0 0 0) 0x7f7b6005d680 con 0x7f7b7006f600 2024-09-12T02:43:26.504 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:26.504 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":27,"btime":"2024-09-12T02:43:20:337397+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5008,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/362211662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":362211662},{"type":"v1","addr":"172.21.15.112:6836","nonce":362211662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5011,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/193733805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":193733805},{"type":"v1","addr":"172.21.15.112:6837","nonce":193733805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/3440642333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3440642333},{"type":"v1","addr":"172.21.15.137:6834","nonce":3440642333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:43:16.722971+0000","modified":"2024-09-12T02:43:19.743614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"b","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/3597512060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3597512060},{"type":"v1","addr":"172.21.15.137:6835","nonce":3597512060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":3}]} 2024-09-12T02:43:26.504 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 27 2024-09-12T02:43:26.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.505+0000 7f7b77a00640 1 -- 172.21.15.112:0/4094386557 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7b4c06be30 msgr2=0x7f7b4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:26.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.505+0000 7f7b77a00640 1 --2- 172.21.15.112:0/4094386557 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7b4c06be30 0x7f7b4c06e2f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7b700730b0 tx=0x7f7b58009040 comp rx=0 tx=0).stop 2024-09-12T02:43:26.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.505+0000 7f7b77a00640 1 -- 172.21.15.112:0/4094386557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b7006f600 msgr2=0x7f7b7014a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:26.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.505+0000 7f7b77a00640 1 --2- 172.21.15.112:0/4094386557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b7006f600 0x7f7b7014a710 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7b6000e870 tx=0x7f7b6000ed30 comp rx=0 tx=0).stop 2024-09-12T02:43:26.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.505+0000 7f7b77a00640 1 -- 172.21.15.112:0/4094386557 shutdown_connections 2024-09-12T02:43:26.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.505+0000 7f7b77a00640 1 --2- 172.21.15.112:0/4094386557 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7b4c06be30 0x7f7b4c06e2f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:26.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.505+0000 7f7b77a00640 1 --2- 172.21.15.112:0/4094386557 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b7015b9d0 0x7f7b70157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:26.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.505+0000 7f7b77a00640 1 --2- 172.21.15.112:0/4094386557 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b700b45d0 0x7f7b70157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:26.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.505+0000 7f7b77a00640 1 --2- 172.21.15.112:0/4094386557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b7006f600 0x7f7b7014a710 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:26.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.505+0000 7f7b77a00640 1 -- 172.21.15.112:0/4094386557 >> 172.21.15.112:0/4094386557 conn(0x7f7b7006bbd0 msgr2=0x7f7b700ae8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:26.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.505+0000 7f7b77a00640 1 -- 172.21.15.112:0/4094386557 shutdown_connections 2024-09-12T02:43:26.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:26.505+0000 7f7b77a00640 1 -- 172.21.15.112:0/4094386557 wait complete. 2024-09-12T02:43:26.522 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2024-09-12T02:43:26.695 INFO:teuthology.orchestra.run.smithi137.stdout:{"cluster_fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","whoami":0,"id":5017,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.3527275710000009,"mdsmap_epoch":27,"osdmap_epoch":45,"osdmap_epoch_barrier":45,"uptime":13.754195707999999} 2024-09-12T02:43:26.696 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", "fs_name": "cephfs", "id": 5017, "mdsmap_epoch": 27, "osdmap_epoch": 45, "osdmap_epoch_barrier": 45, "rank_uptime": 9.352727571, "state": "up:active", "uptime": 13.754195708, "want_state": "up:active", "whoami": 0 } 2024-09-12T02:43:26.696 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-12T02:43:26.864 INFO:teuthology.orchestra.run.smithi112.stdout:{"osd_mon_report_interval":"5"} 2024-09-12T02:43:26.864 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-12T02:43:26.864 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2024-09-12T02:43:26.865 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:43:26.865 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:43:26.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:43:26.900 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2024-09-12T02:43:28.796 INFO:teuthology.orchestra.run.smithi112.stderr:265+0 records in 2024-09-12T02:43:28.797 INFO:teuthology.orchestra.run.smithi112.stderr:265+0 records out 2024-09-12T02:43:28.797 INFO:teuthology.orchestra.run.smithi112.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.81741 s, 153 MB/s 2024-09-12T02:43:28.798 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:43:28.798 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:43:28.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:43:28.833 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2024-09-12T02:43:30.939 INFO:teuthology.orchestra.run.smithi112.stderr:292+0 records in 2024-09-12T02:43:30.939 INFO:teuthology.orchestra.run.smithi112.stderr:292+0 records out 2024-09-12T02:43:30.939 INFO:teuthology.orchestra.run.smithi112.stderr:306184192 bytes (306 MB, 292 MiB) copied, 2.02757 s, 151 MB/s 2024-09-12T02:43:30.940 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2024-09-12T02:43:30.940 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-12T02:43:31.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.093+0000 7f515f200640 1 Processor -- start 2024-09-12T02:43:31.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.093+0000 7f515f200640 1 -- start start 2024-09-12T02:43:31.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.095+0000 7f515f200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f516006dbe0 0x7f51600b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:31.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.095+0000 7f515f200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f51600b69e0 0x7f51600b6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:31.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.095+0000 7f515f200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51600b0910 con 0x7f516015ed60 2024-09-12T02:43:31.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.095+0000 7f515f200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f51600b3c10 con 0x7f516006dbe0 2024-09-12T02:43:31.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.095+0000 7f515f200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f51600b3000 con 0x7f51600b69e0 2024-09-12T02:43:31.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.095+0000 7f515de00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f516015ed60 0x7f516006d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:44796/0 (socket says 172.21.15.112:44796) 2024-09-12T02:43:31.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.095+0000 7f515de00640 1 -- 172.21.15.112:0/1216608085 learned_addr learned my addr 172.21.15.112:0/1216608085 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:31.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.095+0000 7f5155400640 1 --2- 172.21.15.112:0/1216608085 >> v2:172.21.15.112:3300/0 conn(0x7f516006dbe0 0x7f51600b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:31.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.095+0000 7f5155400640 1 -- 172.21.15.112:0/1216608085 >> v2:172.21.15.137:3300/0 conn(0x7f51600b69e0 msgr2=0x7f51600b6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:31.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.095+0000 7f5155400640 1 --2- 172.21.15.112:0/1216608085 >> v2:172.21.15.137:3300/0 conn(0x7f51600b69e0 0x7f51600b6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:31.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.095+0000 7f5155400640 1 -- 172.21.15.112:0/1216608085 >> v1:172.21.15.112:6789/0 conn(0x7f516015ed60 legacy=0x7f516006d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:31.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.095+0000 7f5155400640 1 -- 172.21.15.112:0/1216608085 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51600b32e0 con 0x7f516006dbe0 2024-09-12T02:43:31.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.095+0000 7f515d400640 1 -- 172.21.15.112:0/1216608085 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2758483097 0 0) 0x7f51600b0910 con 0x7f516015ed60 2024-09-12T02:43:31.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.096+0000 7f5155400640 1 --2- 172.21.15.112:0/1216608085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f516006dbe0 0x7f51600b64a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f51600729b0 tx=0x7f514802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb6c8eab3a6b71d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:31.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.096+0000 7f515d400640 1 -- 172.21.15.112:0/1216608085 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5148037070 con 0x7f516006dbe0 2024-09-12T02:43:31.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.097+0000 7f515d400640 1 -- 172.21.15.112:0/1216608085 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5148032440 con 0x7f516006dbe0 2024-09-12T02:43:31.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.097+0000 7f515d400640 1 -- 172.21.15.112:0/1216608085 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514802ae60 con 0x7f516006dbe0 2024-09-12T02:43:31.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.097+0000 7f515f200640 1 -- 172.21.15.112:0/1216608085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f516006dbe0 msgr2=0x7f51600b64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:31.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.097+0000 7f515f200640 1 --2- 172.21.15.112:0/1216608085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f516006dbe0 0x7f51600b64a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f51600729b0 tx=0x7f514802a110 comp rx=0 tx=0).stop 2024-09-12T02:43:31.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.097+0000 7f515f200640 1 -- 172.21.15.112:0/1216608085 shutdown_connections 2024-09-12T02:43:31.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.097+0000 7f515f200640 1 --2- 172.21.15.112:0/1216608085 >> v2:172.21.15.137:3300/0 conn(0x7f51600b69e0 0x7f51600b6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:31.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.097+0000 7f515f200640 1 --2- 172.21.15.112:0/1216608085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f516006dbe0 0x7f51600b64a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:31.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.097+0000 7f515f200640 1 -- 172.21.15.112:0/1216608085 >> 172.21.15.112:0/1216608085 conn(0x7f51600b7e80 msgr2=0x7f51600b8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:31.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.097+0000 7f515f200640 1 -- 172.21.15.112:0/1216608085 shutdown_connections 2024-09-12T02:43:31.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.097+0000 7f515f200640 1 -- 172.21.15.112:0/1216608085 wait complete. 2024-09-12T02:43:31.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.099+0000 7f515f200640 1 Processor -- start 2024-09-12T02:43:31.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.099+0000 7f515f200640 1 -- start start 2024-09-12T02:43:31.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.100+0000 7f515f200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f516006dbe0 0x7f5160155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:31.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.100+0000 7f515f200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51600b69e0 0x7f51600ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:31.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.100+0000 7f515f200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f516015ed60 0x7f5160141440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:31.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.100+0000 7f515f200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f516006e270 con 0x7f51600b69e0 2024-09-12T02:43:31.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.100+0000 7f515f200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f51600b38a0 con 0x7f516015ed60 2024-09-12T02:43:31.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.100+0000 7f515f200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f51600b40a0 con 0x7f516006dbe0 2024-09-12T02:43:31.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.100+0000 7f5155400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51600b69e0 0x7f51600ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:31.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.100+0000 7f5155400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51600b69e0 0x7f51600ce3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40758/0 (socket says 172.21.15.112:40758) 2024-09-12T02:43:31.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.100+0000 7f5155400640 1 -- 172.21.15.112:0/1144148087 learned_addr learned my addr 172.21.15.112:0/1144148087 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:31.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.100+0000 7f5155400640 1 -- 172.21.15.112:0/1144148087 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f516006dbe0 msgr2=0x7f5160155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:31.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.100+0000 7f5155400640 1 --2- 172.21.15.112:0/1144148087 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f516006dbe0 0x7f5160155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:31.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.100+0000 7f5155400640 1 -- 172.21.15.112:0/1144148087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f516015ed60 msgr2=0x7f5160141440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:31.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.100+0000 7f515e800640 1 --2- 172.21.15.112:0/1144148087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f516015ed60 0x7f5160141440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:31.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.100+0000 7f5155400640 1 --2- 172.21.15.112:0/1144148087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f516015ed60 0x7f5160141440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:31.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.100+0000 7f5155400640 1 -- 172.21.15.112:0/1144148087 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5160154460 con 0x7f51600b69e0 2024-09-12T02:43:31.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.101+0000 7f5155400640 1 --2- 172.21.15.112:0/1144148087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51600b69e0 0x7f51600ce3a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5148035040 tx=0x7f51480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:31.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.101+0000 7f5156a00640 1 -- 172.21.15.112:0/1144148087 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5148037040 con 0x7f51600b69e0 2024-09-12T02:43:31.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.101+0000 7f5156a00640 1 -- 172.21.15.112:0/1144148087 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5148004230 con 0x7f51600b69e0 2024-09-12T02:43:31.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.101+0000 7f5156a00640 1 -- 172.21.15.112:0/1144148087 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5148032e20 con 0x7f51600b69e0 2024-09-12T02:43:31.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.101+0000 7f515f200640 1 -- 172.21.15.112:0/1144148087 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5160154740 con 0x7f51600b69e0 2024-09-12T02:43:31.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.101+0000 7f515f200640 1 -- 172.21.15.112:0/1144148087 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5160154d00 con 0x7f51600b69e0 2024-09-12T02:43:31.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.102+0000 7f515f200640 1 -- 172.21.15.112:0/1144148087 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51600b03f0 con 0x7f51600b69e0 2024-09-12T02:43:31.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.103+0000 7f5156a00640 1 -- 172.21.15.112:0/1144148087 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5148030770 con 0x7f51600b69e0 2024-09-12T02:43:31.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.104+0000 7f5156a00640 1 --2- 172.21.15.112:0/1144148087 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f513c06be30 0x7f513c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:31.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.104+0000 7f5156a00640 1 -- 172.21.15.112:0/1144148087 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f51480ac240 con 0x7f51600b69e0 2024-09-12T02:43:31.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.104+0000 7f515de00640 1 --2- 172.21.15.112:0/1144148087 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f513c06be30 0x7f513c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:31.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.105+0000 7f515de00640 1 --2- 172.21.15.112:0/1144148087 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f513c06be30 0x7f513c06e2f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5150007fd0 tx=0x7f5150007960 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:31.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.108+0000 7f5156a00640 1 -- 172.21.15.112:0/1144148087 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f514807ab50 con 0x7f51600b69e0 2024-09-12T02:43:31.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.281+0000 7f515f200640 1 -- 172.21.15.112:0/1144148087 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f51600b0110 con 0x7f51600b69e0 2024-09-12T02:43:31.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.282+0000 7f5156a00640 1 -- 172.21.15.112:0/1144148087 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v45) ==== 81+0+34252 (secure 0 0 0) 0x7f514807a450 con 0x7f51600b69e0 2024-09-12T02:43:31.284 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:31.284 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:43:31.284 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 45, 2024-09-12T02:43:31.284 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:43:31.284 INFO:teuthology.orchestra.run.smithi112.stdout: "created": "2024-09-12T02:41:36.162095+0000", 2024-09-12T02:43:31.284 INFO:teuthology.orchestra.run.smithi112.stdout: "modified": "2024-09-12T02:43:18.313153+0000", 2024-09-12T02:43:31.284 INFO:teuthology.orchestra.run.smithi112.stdout: "last_up_change": "2024-09-12T02:41:42.191169+0000", 2024-09-12T02:43:31.284 INFO:teuthology.orchestra.run.smithi112.stdout: "last_in_change": "2024-09-12T02:41:39.036600+0000", 2024-09-12T02:43:31.285 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:43:31.285 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_num": 5799936, 2024-09-12T02:43:31.285 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_set": [ 2024-09-12T02:43:31.285 INFO:teuthology.orchestra.run.smithi112.stdout: "pglog_hardlimit", 2024-09-12T02:43:31.285 INFO:teuthology.orchestra.run.smithi112.stdout: "purged_snapdirs", 2024-09-12T02:43:31.285 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_deletes", 2024-09-12T02:43:31.285 INFO:teuthology.orchestra.run.smithi112.stdout: "sortbitwise" 2024-09-12T02:43:31.285 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:31.285 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_version": 4, 2024-09-12T02:43:31.285 INFO:teuthology.orchestra.run.smithi112.stdout: "full_ratio": 0.69999998807907104, 2024-09-12T02:43:31.285 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-12T02:43:31.285 INFO:teuthology.orchestra.run.smithi112.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-12T02:43:31.285 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_snapshot": "", 2024-09-12T02:43:31.286 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_max": 7, 2024-09-12T02:43:31.286 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd": 8, 2024-09-12T02:43:31.286 INFO:teuthology.orchestra.run.smithi112.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:43:31.286 INFO:teuthology.orchestra.run.smithi112.stdout: "min_compat_client": "jewel", 2024-09-12T02:43:31.286 INFO:teuthology.orchestra.run.smithi112.stdout: "require_osd_release": "squid", 2024-09-12T02:43:31.286 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_crimson": false, 2024-09-12T02:43:31.286 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-12T02:43:31.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.286 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 1, 2024-09-12T02:43:31.286 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": ".mgr", 2024-09-12T02:43:31.286 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:41:43.011599+0000", 2024-09-12T02:43:31.286 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:43:31.286 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:43:31.287 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:43:31.287 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:43:31.287 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:43:31.287 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:43:31.287 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:43:31.287 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:43:31.287 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:43:31.287 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:43:31.287 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:43:31.287 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:43:31.287 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:43:31.287 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 1, 2024-09-12T02:43:31.287 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 1, 2024-09-12T02:43:31.287 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 1, 2024-09-12T02:43:31.288 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 1, 2024-09-12T02:43:31.288 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 1, 2024-09-12T02:43:31.288 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:43:31.288 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:43:31.288 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:43:31.288 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:43:31.288 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:43:31.288 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:43:31.288 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:43:31.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.288 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "16", 2024-09-12T02:43:31.288 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:43:31.289 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:43:31.289 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:43:31.289 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:43:31.289 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:43:31.289 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:43:31.289 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:43:31.289 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:43:31.289 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:43:31.289 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:43:31.289 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:43:31.289 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:43:31.289 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:43:31.289 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:43:31.290 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:43:31.290 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:43:31.290 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:43:31.290 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:43:31.290 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:43:31.290 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:43:31.290 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:43:31.290 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:43:31.290 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:43:31.290 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:43:31.290 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:43:31.290 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:43:31.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.291 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:43:31.291 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:43:31.291 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:43:31.291 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:43:31.291 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:43:31.291 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:43:31.291 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:43:31.291 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:43:31.291 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:43:31.291 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:43:31.291 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:43:31.291 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:43:31.291 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_max": 32, 2024-09-12T02:43:31.291 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 1 2024-09-12T02:43:31.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.291 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:43:31.292 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": {} 2024-09-12T02:43:31.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.292 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:43:31.292 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:43:31.292 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 8, 2024-09-12T02:43:31.292 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 8, 2024-09-12T02:43:31.292 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 0.25, 2024-09-12T02:43:31.292 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:43:31.292 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:43:31.292 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:43:31.292 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:43:31.292 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:43:31.292 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.293 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 6, 2024-09-12T02:43:31.293 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:43:31.293 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:43:14.483471+0000", 2024-09-12T02:43:31.293 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:43:31.293 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:43:31.293 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:43:31.293 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:43:31.293 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:43:31.293 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:43:31.293 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:43:31.293 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:43:31.293 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:43:31.293 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:43:31.293 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:43:31.294 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:43:31.294 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:43:31.294 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 32, 2024-09-12T02:43:31.294 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 32, 2024-09-12T02:43:31.294 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 32, 2024-09-12T02:43:31.294 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 32, 2024-09-12T02:43:31.294 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 32, 2024-09-12T02:43:31.294 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:43:31.294 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:43:31.294 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:43:31.294 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:43:31.294 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:43:31.294 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:43:31.294 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:43:31.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.295 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "44", 2024-09-12T02:43:31.295 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:43:31.295 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:43:31.295 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:43:31.295 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:43:31.295 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:43:31.295 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:43:31.295 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:43:31.295 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:43:31.295 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:43:31.295 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:43:31.295 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:43:31.295 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:43:31.296 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:43:31.296 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:43:31.296 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:43:31.296 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:43:31.296 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:43:31.296 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:43:31.296 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:43:31.296 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:43:31.296 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:43:31.297 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:43:31.297 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:43:31.297 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:43:31.297 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:43:31.297 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:43:31.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.297 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:43:31.297 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:43:31.297 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:43:31.297 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:43:31.297 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:43:31.297 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:43:31.297 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:43:31.297 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:43:31.298 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:43:31.298 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:43:31.298 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:43:31.298 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:43:31.298 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:43:31.298 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 16, 2024-09-12T02:43:31.298 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_priority": 5 2024-09-12T02:43:31.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.298 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:43:31.298 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:43:31.298 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": "cephfs" 2024-09-12T02:43:31.298 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.299 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:43:31.299 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:43:31.299 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.75, 2024-09-12T02:43:31.299 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.75, 2024-09-12T02:43:31.299 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:43:31.299 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.75, 2024-09-12T02:43:31.299 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.75, 2024-09-12T02:43:31.299 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:43:31.299 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:43:31.299 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:43:31.299 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.299 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 7, 2024-09-12T02:43:31.300 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_data", 2024-09-12T02:43:31.300 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:43:15.711619+0000", 2024-09-12T02:43:31.300 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:43:31.300 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:43:31.300 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:43:31.300 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:43:31.300 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:43:31.300 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:43:31.300 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:43:31.300 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:43:31.300 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:43:31.300 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:43:31.300 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:43:31.301 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:43:31.301 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:43:31.301 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 64, 2024-09-12T02:43:31.301 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 64, 2024-09-12T02:43:31.301 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 64, 2024-09-12T02:43:31.301 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 64, 2024-09-12T02:43:31.301 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 64, 2024-09-12T02:43:31.301 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:43:31.301 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:43:31.301 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:43:31.301 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:43:31.301 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:43:31.301 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:43:31.301 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:43:31.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.302 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "45", 2024-09-12T02:43:31.302 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:43:31.302 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:43:31.302 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:43:31.302 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:43:31.302 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:43:31.302 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:43:31.302 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:43:31.302 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:43:31.302 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:43:31.302 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:43:31.303 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:43:31.303 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:43:31.303 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:43:31.303 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:43:31.303 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:43:31.303 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:43:31.303 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:43:31.303 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:43:31.304 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:43:31.304 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:43:31.304 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:43:31.304 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:43:31.304 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:43:31.305 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:43:31.305 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:43:31.305 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:43:31.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.305 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:43:31.305 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:43:31.305 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:43:31.305 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:43:31.305 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:43:31.305 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:43:31.305 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:43:31.305 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:43:31.305 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:43:31.305 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:43:31.306 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:43:31.306 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:43:31.306 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 64, 2024-09-12T02:43:31.306 INFO:teuthology.orchestra.run.smithi112.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:43:31.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.306 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:43:31.306 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:43:31.306 INFO:teuthology.orchestra.run.smithi112.stdout: "data": "cephfs" 2024-09-12T02:43:31.306 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.306 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:43:31.306 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:43:31.306 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.75, 2024-09-12T02:43:31.306 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.75, 2024-09-12T02:43:31.307 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:43:31.307 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.75, 2024-09-12T02:43:31.307 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.75, 2024-09-12T02:43:31.307 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:43:31.307 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:43:31.307 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:43:31.307 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.307 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.307 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:31.307 INFO:teuthology.orchestra.run.smithi112.stdout: "osds": [ 2024-09-12T02:43:31.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.307 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:43:31.307 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:31.307 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:31.308 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:31.308 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:31.308 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:31.308 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:31.308 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:31.308 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:31.308 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:31.308 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:31.308 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:31.308 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:31.308 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.308 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.309 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6800", 2024-09-12T02:43:31.309 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:31.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.309 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.309 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6801", 2024-09-12T02:43:31.309 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:31.309 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.309 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.309 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:31.309 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.309 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.310 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6802", 2024-09-12T02:43:31.310 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:31.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.310 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.310 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6803", 2024-09-12T02:43:31.310 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:31.310 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.310 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.310 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:31.310 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.310 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.311 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6806", 2024-09-12T02:43:31.311 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:31.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.311 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.311 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6807", 2024-09-12T02:43:31.311 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:31.311 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.311 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.311 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:31.311 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.311 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.312 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6804", 2024-09-12T02:43:31.312 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:31.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.312 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.312 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6805", 2024-09-12T02:43:31.312 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:31.312 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.312 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.312 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6801/821571304", 2024-09-12T02:43:31.312 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6803/821571304", 2024-09-12T02:43:31.312 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6807/821571304", 2024-09-12T02:43:31.313 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6805/821571304", 2024-09-12T02:43:31.313 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:31.313 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:31.313 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:31.313 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.313 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:43:31.313 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:31.313 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:31.313 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:31.313 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:31.313 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:31.314 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:31.314 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:31.314 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:31.314 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:31.314 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:31.314 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:31.314 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:31.314 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.314 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.314 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6808", 2024-09-12T02:43:31.314 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:31.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.315 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.315 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6809", 2024-09-12T02:43:31.315 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:31.315 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.315 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.315 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:31.315 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.315 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.315 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6810", 2024-09-12T02:43:31.315 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:31.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.316 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.316 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6811", 2024-09-12T02:43:31.316 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:31.316 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.316 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.316 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:31.316 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.316 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.316 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6814", 2024-09-12T02:43:31.316 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:31.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.317 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.317 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6815", 2024-09-12T02:43:31.317 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:31.317 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.317 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.317 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:31.317 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.317 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.317 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6812", 2024-09-12T02:43:31.318 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:31.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.318 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.318 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6813", 2024-09-12T02:43:31.318 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:31.318 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.318 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.318 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6809/2642068641", 2024-09-12T02:43:31.318 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6811/2642068641", 2024-09-12T02:43:31.318 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6815/2642068641", 2024-09-12T02:43:31.318 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6813/2642068641", 2024-09-12T02:43:31.318 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:31.318 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:31.319 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:31.319 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.319 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:43:31.319 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:31.319 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:31.319 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:31.319 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:31.319 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:31.319 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:31.319 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:31.319 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:31.319 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:31.320 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:31.320 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:31.320 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:31.320 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.320 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.320 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6816", 2024-09-12T02:43:31.320 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:31.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.320 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.320 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6817", 2024-09-12T02:43:31.320 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:31.320 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.320 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.321 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:31.321 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.321 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.321 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6818", 2024-09-12T02:43:31.321 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:31.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.321 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.321 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6819", 2024-09-12T02:43:31.321 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:31.322 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.322 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.322 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:31.322 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.322 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.322 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6822", 2024-09-12T02:43:31.322 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:31.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.322 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.322 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6823", 2024-09-12T02:43:31.322 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:31.322 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.323 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.323 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:31.323 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.323 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.323 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6820", 2024-09-12T02:43:31.323 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:31.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.323 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.323 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6821", 2024-09-12T02:43:31.323 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6817/3365688807", 2024-09-12T02:43:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6819/3365688807", 2024-09-12T02:43:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6823/3365688807", 2024-09-12T02:43:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6821/3365688807", 2024-09-12T02:43:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.324 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:43:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:31.325 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.326 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.326 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6824", 2024-09-12T02:43:31.326 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:31.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.326 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.326 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6825", 2024-09-12T02:43:31.326 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:31.326 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.326 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.326 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:31.327 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.327 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.327 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6826", 2024-09-12T02:43:31.327 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:31.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.327 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.327 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6827", 2024-09-12T02:43:31.327 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:31.327 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.327 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.327 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:31.328 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.328 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.328 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6830", 2024-09-12T02:43:31.328 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:31.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.328 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.328 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6831", 2024-09-12T02:43:31.328 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:31.328 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.328 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.329 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:31.329 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.329 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.329 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6828", 2024-09-12T02:43:31.329 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:31.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.329 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.329 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6829", 2024-09-12T02:43:31.329 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:31.329 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.329 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.330 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6825/231774278", 2024-09-12T02:43:31.330 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6827/231774278", 2024-09-12T02:43:31.330 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6831/231774278", 2024-09-12T02:43:31.330 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6829/231774278", 2024-09-12T02:43:31.330 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:31.330 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:31.330 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:31.330 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.330 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:43:31.330 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:31.330 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:31.331 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:31.331 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:31.331 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:31.331 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:31.331 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:31.331 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:31.331 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:31.331 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:31.331 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:31.331 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:31.331 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.331 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.332 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6800", 2024-09-12T02:43:31.332 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:31.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.332 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.332 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6801", 2024-09-12T02:43:31.332 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:31.332 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.332 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.332 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:31.332 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.333 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.333 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6802", 2024-09-12T02:43:31.333 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:31.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.333 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.333 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.333 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6803", 2024-09-12T02:43:31.333 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:31.333 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.333 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.333 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:31.333 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.334 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.334 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6806", 2024-09-12T02:43:31.334 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:31.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.334 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.334 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6807", 2024-09-12T02:43:31.334 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:31.334 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.334 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.335 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:31.335 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.335 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.335 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6804", 2024-09-12T02:43:31.335 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:31.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.335 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.335 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6805", 2024-09-12T02:43:31.335 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:31.335 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.335 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.336 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6801/3671178153", 2024-09-12T02:43:31.336 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6803/3671178153", 2024-09-12T02:43:31.336 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6807/3671178153", 2024-09-12T02:43:31.336 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6805/3671178153", 2024-09-12T02:43:31.336 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:31.336 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:31.336 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:31.336 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.336 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:43:31.336 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:31.336 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:31.337 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:31.337 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:31.337 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:31.337 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:31.337 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:31.337 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:31.337 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:31.337 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:31.337 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:31.337 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:31.337 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.337 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.337 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6808", 2024-09-12T02:43:31.338 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:31.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.338 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.338 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6809", 2024-09-12T02:43:31.338 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:31.338 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.338 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.338 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:31.338 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.338 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.338 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6810", 2024-09-12T02:43:31.339 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:31.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.339 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.339 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6811", 2024-09-12T02:43:31.339 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:31.339 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.339 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.339 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:31.339 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.339 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.339 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6817", 2024-09-12T02:43:31.340 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:31.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.340 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.340 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6819", 2024-09-12T02:43:31.340 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:31.340 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.340 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.340 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:31.340 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.340 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.341 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6812", 2024-09-12T02:43:31.341 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:31.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.341 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.341 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6815", 2024-09-12T02:43:31.341 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:31.341 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.341 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.341 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6809/3193706134", 2024-09-12T02:43:31.341 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6811/3193706134", 2024-09-12T02:43:31.341 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6819/3193706134", 2024-09-12T02:43:31.341 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6815/3193706134", 2024-09-12T02:43:31.342 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:31.342 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:31.342 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:31.342 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.342 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:43:31.342 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:31.342 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:31.342 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:31.342 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:31.342 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:31.342 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:31.342 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:31.343 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:31.343 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:31.343 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:31.343 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:31.343 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:31.343 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.343 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.343 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6813", 2024-09-12T02:43:31.343 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:31.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.343 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.343 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6814", 2024-09-12T02:43:31.344 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:31.344 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.344 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.344 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:31.344 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.344 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.344 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6816", 2024-09-12T02:43:31.344 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:31.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.344 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.344 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6818", 2024-09-12T02:43:31.345 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:31.345 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.345 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.345 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:31.345 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.345 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.345 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6822", 2024-09-12T02:43:31.345 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:31.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.345 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.346 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6823", 2024-09-12T02:43:31.346 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:31.346 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.346 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.346 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:31.346 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.346 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.346 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6820", 2024-09-12T02:43:31.346 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:31.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.346 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.347 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6821", 2024-09-12T02:43:31.347 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:31.347 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.347 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.347 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6814/3738813293", 2024-09-12T02:43:31.347 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6818/3738813293", 2024-09-12T02:43:31.347 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6823/3738813293", 2024-09-12T02:43:31.347 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6821/3738813293", 2024-09-12T02:43:31.347 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:31.347 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:31.347 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:31.347 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.348 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:43:31.348 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:31.348 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:31.348 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:31.348 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:31.348 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:31.348 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:31.348 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:31.348 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:31.348 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:31.348 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:31.348 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:31.348 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:31.349 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.349 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.349 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6824", 2024-09-12T02:43:31.349 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:31.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.349 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.349 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6825", 2024-09-12T02:43:31.349 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:31.349 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.349 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.349 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:31.349 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.350 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.350 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6826", 2024-09-12T02:43:31.350 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:31.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.350 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.350 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6827", 2024-09-12T02:43:31.350 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:31.350 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.350 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.350 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:31.350 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.351 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.351 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6830", 2024-09-12T02:43:31.351 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:31.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.351 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.351 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6831", 2024-09-12T02:43:31.351 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:31.351 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.351 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.351 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:31.351 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:31.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.352 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:31.352 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6828", 2024-09-12T02:43:31.352 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:31.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.352 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:31.352 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6829", 2024-09-12T02:43:31.352 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:31.352 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.352 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.352 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6825/1421932609", 2024-09-12T02:43:31.353 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6827/1421932609", 2024-09-12T02:43:31.353 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6831/1421932609", 2024-09-12T02:43:31.353 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6829/1421932609", 2024-09-12T02:43:31.353 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:31.353 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:31.353 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:31.353 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:31.353 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.353 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:31.353 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_xinfo": [ 2024-09-12T02:43:31.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.353 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:43:31.353 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:31.353 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:31.353 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:31.354 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:31.354 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:31.354 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.220641+0000", 2024-09-12T02:43:31.354 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:31.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.354 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:43:31.354 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:31.354 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:31.354 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:31.354 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:31.354 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:31.354 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312574+0000", 2024-09-12T02:43:31.354 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:31.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.355 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:43:31.355 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:31.355 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:31.355 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:31.355 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:31.355 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:31.355 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.282771+0000", 2024-09-12T02:43:31.355 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:31.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.355 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:43:31.355 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:31.355 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:31.356 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:31.356 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:31.356 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:31.356 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.260478+0000", 2024-09-12T02:43:31.356 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:31.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.356 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:43:31.356 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:31.356 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:31.356 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:31.356 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:31.356 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:31.357 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.273397+0000", 2024-09-12T02:43:31.357 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:31.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.357 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:43:31.357 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:31.357 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:31.357 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:31.357 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:31.357 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:31.358 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312452+0000", 2024-09-12T02:43:31.358 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:31.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.358 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:43:31.358 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:31.358 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:31.358 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:31.358 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:31.358 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:31.358 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.308965+0000", 2024-09-12T02:43:31.358 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:31.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:31.359 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:43:31.359 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:31.359 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:31.359 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:31.359 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:31.359 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:31.359 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.337842+0000", 2024-09-12T02:43:31.359 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:31.359 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.359 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:31.359 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap": [], 2024-09-12T02:43:31.359 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_items": [], 2024-09-12T02:43:31.359 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_primaries": [], 2024-09-12T02:43:31.359 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_temp": [], 2024-09-12T02:43:31.360 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_temp": [], 2024-09-12T02:43:31.360 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklist": {}, 2024-09-12T02:43:31.360 INFO:teuthology.orchestra.run.smithi112.stdout: "range_blocklist": {}, 2024-09-12T02:43:31.360 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profiles": { 2024-09-12T02:43:31.360 INFO:teuthology.orchestra.run.smithi112.stdout: "default": { 2024-09-12T02:43:31.360 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-failure-domain": "osd", 2024-09-12T02:43:31.360 INFO:teuthology.orchestra.run.smithi112.stdout: "k": "2", 2024-09-12T02:43:31.360 INFO:teuthology.orchestra.run.smithi112.stdout: "m": "1", 2024-09-12T02:43:31.360 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin": "jerasure", 2024-09-12T02:43:31.360 INFO:teuthology.orchestra.run.smithi112.stdout: "technique": "reed_sol_van" 2024-09-12T02:43:31.360 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:31.360 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps_queue": [], 2024-09-12T02:43:31.360 INFO:teuthology.orchestra.run.smithi112.stdout: "new_removed_snaps": [], 2024-09-12T02:43:31.361 INFO:teuthology.orchestra.run.smithi112.stdout: "new_purged_snaps": [], 2024-09-12T02:43:31.361 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_node_flags": {}, 2024-09-12T02:43:31.361 INFO:teuthology.orchestra.run.smithi112.stdout: "device_class_flags": {}, 2024-09-12T02:43:31.361 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode": { 2024-09-12T02:43:31.361 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_enabled": false, 2024-09-12T02:43:31.361 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_bucket_count": 0, 2024-09-12T02:43:31.361 INFO:teuthology.orchestra.run.smithi112.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:43:31.361 INFO:teuthology.orchestra.run.smithi112.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:43:31.361 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_bucket": 0 2024-09-12T02:43:31.361 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:31.361 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:43:31.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.284+0000 7f515f200640 1 -- 172.21.15.112:0/1144148087 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f513c06be30 msgr2=0x7f513c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:31.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.285+0000 7f515f200640 1 --2- 172.21.15.112:0/1144148087 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f513c06be30 0x7f513c06e2f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5150007fd0 tx=0x7f5150007960 comp rx=0 tx=0).stop 2024-09-12T02:43:31.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.285+0000 7f515f200640 1 -- 172.21.15.112:0/1144148087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51600b69e0 msgr2=0x7f51600ce3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:31.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.285+0000 7f515f200640 1 --2- 172.21.15.112:0/1144148087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51600b69e0 0x7f51600ce3a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5148035040 tx=0x7f51480046c0 comp rx=0 tx=0).stop 2024-09-12T02:43:31.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.285+0000 7f515f200640 1 -- 172.21.15.112:0/1144148087 shutdown_connections 2024-09-12T02:43:31.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.285+0000 7f515f200640 1 --2- 172.21.15.112:0/1144148087 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f513c06be30 0x7f513c06e2f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:31.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.285+0000 7f515f200640 1 --2- 172.21.15.112:0/1144148087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f516015ed60 0x7f5160141440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:31.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.285+0000 7f515f200640 1 --2- 172.21.15.112:0/1144148087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51600b69e0 0x7f51600ce3a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:31.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.285+0000 7f515f200640 1 --2- 172.21.15.112:0/1144148087 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f516006dbe0 0x7f5160155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:31.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.285+0000 7f515f200640 1 -- 172.21.15.112:0/1144148087 >> 172.21.15.112:0/1144148087 conn(0x7f51600b7e80 msgr2=0x7f516006f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:31.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.285+0000 7f515f200640 1 -- 172.21.15.112:0/1144148087 shutdown_connections 2024-09-12T02:43:31.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:31.285+0000 7f515f200640 1 -- 172.21.15.112:0/1144148087 wait complete. 2024-09-12T02:43:31.364 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-12T02:43:33.038 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-12T02:43:33.037+0000 7f0219e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2024-09-12T02:43:36.365 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-12T02:43:36.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.526+0000 7ff708e00640 1 Processor -- start 2024-09-12T02:43:36.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.526+0000 7ff708e00640 1 -- start start 2024-09-12T02:43:36.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.527+0000 7ff708e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff70406f600 0x7ff7040b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:36.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.527+0000 7ff708e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7040b4a20 con 0x7ff7040b45d0 2024-09-12T02:43:36.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.527+0000 7ff708e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7040b54a0 con 0x7ff70415b9d0 2024-09-12T02:43:36.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.527+0000 7ff708e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff7040b3af0 con 0x7ff70406f600 2024-09-12T02:43:36.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.527+0000 7ff702800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff7040b45d0 0x7ff7040cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33414/0 (socket says 172.21.15.112:33414) 2024-09-12T02:43:36.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.527+0000 7ff702800640 1 -- 172.21.15.112:0/1565392307 learned_addr learned my addr 172.21.15.112:0/1565392307 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:36.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.528+0000 7ff701400640 1 --2- 172.21.15.112:0/1565392307 >> v2:172.21.15.137:3300/0 conn(0x7ff70406f600 0x7ff7040b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:36.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.528+0000 7ff700a00640 1 -- 172.21.15.112:0/1565392307 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4052720720 0 0) 0x7ff7040b4a20 con 0x7ff7040b45d0 2024-09-12T02:43:36.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.528+0000 7ff700a00640 1 -- 172.21.15.112:0/1565392307 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6e8003520 con 0x7ff7040b45d0 2024-09-12T02:43:36.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.528+0000 7ff700a00640 1 -- 172.21.15.112:0/1565392307 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2126310619 0 0) 0x7ff7040b54a0 con 0x7ff70415b9d0 2024-09-12T02:43:36.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.528+0000 7ff700a00640 1 -- 172.21.15.112:0/1565392307 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7040b4a20 con 0x7ff70415b9d0 2024-09-12T02:43:36.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.528+0000 7ff701400640 1 -- 172.21.15.112:0/1565392307 >> v1:172.21.15.137:6789/0 conn(0x7ff70415b9d0 legacy=0x7ff70406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:36.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.528+0000 7ff701400640 1 -- 172.21.15.112:0/1565392307 >> v1:172.21.15.112:6789/0 conn(0x7ff7040b45d0 legacy=0x7ff7040cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:36.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.528+0000 7ff701400640 1 -- 172.21.15.112:0/1565392307 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7040b3dd0 con 0x7ff70406f600 2024-09-12T02:43:36.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.529+0000 7ff701400640 1 --2- 172.21.15.112:0/1565392307 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff70406f600 0x7ff7040b4ec0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0009790 tx=0x7ff6f002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd499c30e2370884 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:36.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.530+0000 7ff700a00640 1 -- 172.21.15.112:0/1565392307 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0037070 con 0x7ff70406f600 2024-09-12T02:43:36.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.530+0000 7ff700a00640 1 -- 172.21.15.112:0/1565392307 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6f0032440 con 0x7ff70406f600 2024-09-12T02:43:36.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.530+0000 7ff700a00640 1 -- 172.21.15.112:0/1565392307 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0032810 con 0x7ff70406f600 2024-09-12T02:43:36.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.530+0000 7ff708e00640 1 -- 172.21.15.112:0/1565392307 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff70406f600 msgr2=0x7ff7040b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:36.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.530+0000 7ff708e00640 1 --2- 172.21.15.112:0/1565392307 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff70406f600 0x7ff7040b4ec0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0009790 tx=0x7ff6f002a180 comp rx=0 tx=0).stop 2024-09-12T02:43:36.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.530+0000 7ff708e00640 1 -- 172.21.15.112:0/1565392307 shutdown_connections 2024-09-12T02:43:36.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.530+0000 7ff708e00640 1 --2- 172.21.15.112:0/1565392307 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff70406f600 0x7ff7040b4ec0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:36.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.530+0000 7ff708e00640 1 -- 172.21.15.112:0/1565392307 >> 172.21.15.112:0/1565392307 conn(0x7ff70406bbd0 msgr2=0x7ff70406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:36.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.530+0000 7ff708e00640 1 -- 172.21.15.112:0/1565392307 shutdown_connections 2024-09-12T02:43:36.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.530+0000 7ff708e00640 1 -- 172.21.15.112:0/1565392307 wait complete. 2024-09-12T02:43:36.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.532+0000 7ff708e00640 1 Processor -- start 2024-09-12T02:43:36.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.532+0000 7ff708e00640 1 -- start start 2024-09-12T02:43:36.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.533+0000 7ff708e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff70406f600 0x7ff7041560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:36.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.533+0000 7ff708e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7040b45d0 0x7ff70415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:36.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.533+0000 7ff708e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff70415b9d0 0x7ff70415d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:36.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.533+0000 7ff708e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff70415bf30 con 0x7ff70415b9d0 2024-09-12T02:43:36.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.533+0000 7ff708e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff70415bdb0 con 0x7ff7040b45d0 2024-09-12T02:43:36.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.533+0000 7ff708e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff7040728c0 con 0x7ff70406f600 2024-09-12T02:43:36.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.533+0000 7ff702800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff70415b9d0 0x7ff70415d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:36.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.533+0000 7ff702800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff70415b9d0 0x7ff70415d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53516/0 (socket says 172.21.15.112:53516) 2024-09-12T02:43:36.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.533+0000 7ff702800640 1 -- 172.21.15.112:0/2487390657 learned_addr learned my addr 172.21.15.112:0/2487390657 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:36.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.533+0000 7ff701e00640 1 --2- 172.21.15.112:0/2487390657 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff70406f600 0x7ff7041560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:36.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.533+0000 7ff701400640 1 --2- 172.21.15.112:0/2487390657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7040b45d0 0x7ff70415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:36.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.533+0000 7ff702800640 1 -- 172.21.15.112:0/2487390657 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff70406f600 msgr2=0x7ff7041560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:36.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.533+0000 7ff702800640 1 --2- 172.21.15.112:0/2487390657 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff70406f600 0x7ff7041560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:36.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.533+0000 7ff702800640 1 -- 172.21.15.112:0/2487390657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7040b45d0 msgr2=0x7ff70415cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:36.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.533+0000 7ff702800640 1 --2- 172.21.15.112:0/2487390657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7040b45d0 0x7ff70415cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:36.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.534+0000 7ff702800640 1 -- 172.21.15.112:0/2487390657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff70415c350 con 0x7ff70415b9d0 2024-09-12T02:43:36.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.534+0000 7ff702800640 1 --2- 172.21.15.112:0/2487390657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff70415b9d0 0x7ff70415d000 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc00cba0 tx=0x7ff6fc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:36.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.534+0000 7ff6fa000640 1 -- 172.21.15.112:0/2487390657 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc017070 con 0x7ff70415b9d0 2024-09-12T02:43:36.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.534+0000 7ff6fa000640 1 -- 172.21.15.112:0/2487390657 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6fc00ace0 con 0x7ff70415b9d0 2024-09-12T02:43:36.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.534+0000 7ff708e00640 1 -- 172.21.15.112:0/2487390657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7041f8f50 con 0x7ff70415b9d0 2024-09-12T02:43:36.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.534+0000 7ff6fa000640 1 -- 172.21.15.112:0/2487390657 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc012620 con 0x7ff70415b9d0 2024-09-12T02:43:36.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.534+0000 7ff708e00640 1 -- 172.21.15.112:0/2487390657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7041f9510 con 0x7ff70415b9d0 2024-09-12T02:43:36.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.535+0000 7ff708e00640 1 -- 172.21.15.112:0/2487390657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff704068a30 con 0x7ff70415b9d0 2024-09-12T02:43:36.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.536+0000 7ff6fa000640 1 -- 172.21.15.112:0/2487390657 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff6fc01a070 con 0x7ff70415b9d0 2024-09-12T02:43:36.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.537+0000 7ff6fa000640 1 --2- 172.21.15.112:0/2487390657 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff6e406be30 0x7ff6e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:36.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.537+0000 7ff6fa000640 1 -- 172.21.15.112:0/2487390657 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7ff6fc08ace0 con 0x7ff70415b9d0 2024-09-12T02:43:36.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.537+0000 7ff6fa000640 1 -- 172.21.15.112:0/2487390657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=48}) -- 0x7ff6e4073960 con 0x7ff70415b9d0 2024-09-12T02:43:36.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.537+0000 7ff701e00640 1 --2- 172.21.15.112:0/2487390657 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff6e406be30 0x7ff6e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:36.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.538+0000 7ff701e00640 1 --2- 172.21.15.112:0/2487390657 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff6e406be30 0x7ff6e406e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4007fd0 tx=0x7ff6f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:36.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.541+0000 7ff6fa000640 1 -- 172.21.15.112:0/2487390657 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff6fc058fa0 con 0x7ff70415b9d0 2024-09-12T02:43:36.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.715+0000 7ff708e00640 1 -- 172.21.15.112:0/2487390657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7ff704072c50 con 0x7ff70415b9d0 2024-09-12T02:43:36.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.716+0000 7ff6fa000640 1 -- 172.21.15.112:0/2487390657 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v47) ==== 81+0+34371 (secure 0 0 0) 0x7ff6fc05d2a0 con 0x7ff70415b9d0 2024-09-12T02:43:36.718 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:36.718 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:43:36.718 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 47, 2024-09-12T02:43:36.718 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:43:36.718 INFO:teuthology.orchestra.run.smithi112.stdout: "created": "2024-09-12T02:41:36.162095+0000", 2024-09-12T02:43:36.718 INFO:teuthology.orchestra.run.smithi112.stdout: "modified": "2024-09-12T02:43:34.091103+0000", 2024-09-12T02:43:36.718 INFO:teuthology.orchestra.run.smithi112.stdout: "last_up_change": "2024-09-12T02:41:42.191169+0000", 2024-09-12T02:43:36.719 INFO:teuthology.orchestra.run.smithi112.stdout: "last_in_change": "2024-09-12T02:41:39.036600+0000", 2024-09-12T02:43:36.719 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:43:36.719 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_num": 5799936, 2024-09-12T02:43:36.719 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_set": [ 2024-09-12T02:43:36.719 INFO:teuthology.orchestra.run.smithi112.stdout: "pglog_hardlimit", 2024-09-12T02:43:36.719 INFO:teuthology.orchestra.run.smithi112.stdout: "purged_snapdirs", 2024-09-12T02:43:36.719 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_deletes", 2024-09-12T02:43:36.719 INFO:teuthology.orchestra.run.smithi112.stdout: "sortbitwise" 2024-09-12T02:43:36.719 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:36.719 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_version": 4, 2024-09-12T02:43:36.719 INFO:teuthology.orchestra.run.smithi112.stdout: "full_ratio": 0.69999998807907104, 2024-09-12T02:43:36.719 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-12T02:43:36.719 INFO:teuthology.orchestra.run.smithi112.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-12T02:43:36.720 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_snapshot": "", 2024-09-12T02:43:36.720 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_max": 7, 2024-09-12T02:43:36.720 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd": 8, 2024-09-12T02:43:36.720 INFO:teuthology.orchestra.run.smithi112.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:43:36.720 INFO:teuthology.orchestra.run.smithi112.stdout: "min_compat_client": "jewel", 2024-09-12T02:43:36.720 INFO:teuthology.orchestra.run.smithi112.stdout: "require_osd_release": "squid", 2024-09-12T02:43:36.720 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_crimson": false, 2024-09-12T02:43:36.720 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-12T02:43:36.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.720 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 1, 2024-09-12T02:43:36.720 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": ".mgr", 2024-09-12T02:43:36.720 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:41:43.011599+0000", 2024-09-12T02:43:36.720 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 3, 2024-09-12T02:43:36.721 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full", 2024-09-12T02:43:36.721 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:43:36.721 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:43:36.721 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:43:36.721 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:43:36.721 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:43:36.721 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:43:36.721 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:43:36.721 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:43:36.721 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:43:36.721 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:43:36.721 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:43:36.721 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 1, 2024-09-12T02:43:36.722 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 1, 2024-09-12T02:43:36.722 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 1, 2024-09-12T02:43:36.722 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 1, 2024-09-12T02:43:36.722 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 1, 2024-09-12T02:43:36.722 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:43:36.722 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:43:36.722 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:43:36.722 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:43:36.722 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:43:36.722 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:43:36.722 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:43:36.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.722 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "46", 2024-09-12T02:43:36.722 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:43:36.723 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:43:36.723 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:43:36.723 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:43:36.723 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:43:36.723 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:43:36.723 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:43:36.723 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:43:36.723 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:43:36.723 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:43:36.724 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:43:36.724 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:43:36.724 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:43:36.724 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:43:36.724 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:43:36.724 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:43:36.724 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:43:36.724 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:43:36.724 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:43:36.724 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:43:36.724 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:43:36.724 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:43:36.724 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:43:36.724 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:43:36.725 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:43:36.725 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:43:36.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.725 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:43:36.725 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:43:36.725 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:43:36.725 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:43:36.725 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:43:36.725 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:43:36.725 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:43:36.725 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:43:36.725 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:43:36.725 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:43:36.725 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:43:36.726 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:43:36.726 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_max": 32, 2024-09-12T02:43:36.726 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 1 2024-09-12T02:43:36.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.726 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:43:36.726 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": {} 2024-09-12T02:43:36.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.726 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:43:36.726 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:43:36.726 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 8, 2024-09-12T02:43:36.726 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 8, 2024-09-12T02:43:36.726 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 0.25, 2024-09-12T02:43:36.726 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:43:36.726 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:43:36.727 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:43:36.727 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:43:36.727 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:43:36.727 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.727 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 6, 2024-09-12T02:43:36.727 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:43:36.727 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:43:14.483471+0000", 2024-09-12T02:43:36.727 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 3, 2024-09-12T02:43:36.727 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full", 2024-09-12T02:43:36.727 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:43:36.727 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:43:36.727 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:43:36.728 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:43:36.728 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:43:36.728 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:43:36.728 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:43:36.728 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:43:36.728 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:43:36.728 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:43:36.728 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:43:36.728 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 32, 2024-09-12T02:43:36.728 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 32, 2024-09-12T02:43:36.728 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 32, 2024-09-12T02:43:36.728 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 32, 2024-09-12T02:43:36.728 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 32, 2024-09-12T02:43:36.729 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:43:36.729 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:43:36.729 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:43:36.729 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:43:36.729 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:43:36.729 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:43:36.729 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:43:36.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.729 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "46", 2024-09-12T02:43:36.729 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:43:36.729 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:43:36.729 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:43:36.729 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:43:36.729 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:43:36.729 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:43:36.730 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:43:36.730 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:43:36.730 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:43:36.730 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:43:36.730 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:43:36.730 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:43:36.731 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:43:36.731 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:43:36.731 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:43:36.731 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:43:36.731 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:43:36.731 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:43:36.731 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:43:36.731 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:43:36.731 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:43:36.732 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:43:36.732 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:43:36.732 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:43:36.732 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:43:36.732 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:43:36.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.732 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:43:36.732 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:43:36.732 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:43:36.732 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:43:36.732 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:43:36.732 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:43:36.732 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:43:36.733 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:43:36.733 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:43:36.733 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:43:36.733 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:43:36.733 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:43:36.733 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:43:36.733 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 16, 2024-09-12T02:43:36.733 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_priority": 5 2024-09-12T02:43:36.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.733 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:43:36.733 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:43:36.733 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": "cephfs" 2024-09-12T02:43:36.733 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.734 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:43:36.734 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:43:36.734 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.75, 2024-09-12T02:43:36.734 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.75, 2024-09-12T02:43:36.734 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:43:36.734 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.75, 2024-09-12T02:43:36.734 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.75, 2024-09-12T02:43:36.734 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:43:36.734 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:43:36.734 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:43:36.734 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.735 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 7, 2024-09-12T02:43:36.735 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_data", 2024-09-12T02:43:36.735 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:43:15.711619+0000", 2024-09-12T02:43:36.735 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 3, 2024-09-12T02:43:36.735 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full", 2024-09-12T02:43:36.735 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:43:36.735 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:43:36.735 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:43:36.735 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:43:36.735 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:43:36.735 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:43:36.735 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:43:36.736 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:43:36.736 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:43:36.736 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:43:36.736 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:43:36.736 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 64, 2024-09-12T02:43:36.736 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 64, 2024-09-12T02:43:36.736 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 64, 2024-09-12T02:43:36.736 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 64, 2024-09-12T02:43:36.736 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 64, 2024-09-12T02:43:36.736 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:43:36.736 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:43:36.737 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:43:36.737 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:43:36.737 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:43:36.737 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:43:36.737 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:43:36.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.737 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "46", 2024-09-12T02:43:36.737 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:43:36.737 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:43:36.737 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:43:36.737 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:43:36.737 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:43:36.738 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:43:36.738 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:43:36.738 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:43:36.738 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:43:36.738 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:43:36.738 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:43:36.738 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:43:36.738 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:43:36.738 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:43:36.738 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:43:36.738 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:43:36.738 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:43:36.738 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:43:36.738 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:43:36.739 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:43:36.739 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:43:36.739 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:43:36.739 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:43:36.739 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:43:36.739 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:43:36.739 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:43:36.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.739 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:43:36.739 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:43:36.739 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:43:36.739 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:43:36.740 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:43:36.740 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:43:36.740 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:43:36.740 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:43:36.740 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:43:36.740 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:43:36.740 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:43:36.740 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:43:36.741 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 64, 2024-09-12T02:43:36.741 INFO:teuthology.orchestra.run.smithi112.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:43:36.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.741 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:43:36.741 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:43:36.741 INFO:teuthology.orchestra.run.smithi112.stdout: "data": "cephfs" 2024-09-12T02:43:36.741 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.741 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:43:36.741 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:43:36.742 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.75, 2024-09-12T02:43:36.742 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.75, 2024-09-12T02:43:36.742 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:43:36.742 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.75, 2024-09-12T02:43:36.742 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.75, 2024-09-12T02:43:36.742 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:43:36.742 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:43:36.742 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:43:36.742 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.742 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.743 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:36.743 INFO:teuthology.orchestra.run.smithi112.stdout: "osds": [ 2024-09-12T02:43:36.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.743 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:43:36.743 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:36.743 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:36.743 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:36.743 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:36.743 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:36.743 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:36.743 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:36.743 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:36.744 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:36.744 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:36.744 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:36.744 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:36.744 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.744 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.744 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6800", 2024-09-12T02:43:36.744 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:36.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.745 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.745 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6801", 2024-09-12T02:43:36.745 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:36.745 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.745 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.745 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:36.745 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.745 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.745 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6802", 2024-09-12T02:43:36.745 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:36.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.746 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.746 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6803", 2024-09-12T02:43:36.746 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:36.746 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.746 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.746 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:36.746 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.746 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.746 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6806", 2024-09-12T02:43:36.747 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:36.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.747 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.747 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6807", 2024-09-12T02:43:36.747 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:36.747 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.747 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.747 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:36.747 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.747 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.748 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6804", 2024-09-12T02:43:36.748 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:36.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.748 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.748 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6805", 2024-09-12T02:43:36.748 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:36.748 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.748 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.748 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6801/821571304", 2024-09-12T02:43:36.748 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6803/821571304", 2024-09-12T02:43:36.748 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6807/821571304", 2024-09-12T02:43:36.749 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6805/821571304", 2024-09-12T02:43:36.749 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:36.749 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:36.749 INFO:teuthology.orchestra.run.smithi112.stdout: "full", 2024-09-12T02:43:36.749 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:36.749 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.749 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:43:36.749 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:36.750 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:36.750 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:36.750 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:36.750 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:36.750 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:36.750 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:36.750 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:36.750 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:36.750 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:36.750 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:36.750 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:36.751 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.751 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.751 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6808", 2024-09-12T02:43:36.751 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:36.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.751 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.751 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6809", 2024-09-12T02:43:36.751 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:36.751 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.751 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.752 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:36.752 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.752 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.752 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6810", 2024-09-12T02:43:36.752 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:36.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.752 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.752 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6811", 2024-09-12T02:43:36.753 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:36.753 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.753 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.753 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:36.753 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.753 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.753 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6814", 2024-09-12T02:43:36.753 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:36.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.753 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.754 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6815", 2024-09-12T02:43:36.754 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:36.754 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.754 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.754 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:36.754 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.754 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.754 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6812", 2024-09-12T02:43:36.754 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:36.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.755 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.755 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6813", 2024-09-12T02:43:36.755 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:36.755 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.755 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.755 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6809/2642068641", 2024-09-12T02:43:36.755 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6811/2642068641", 2024-09-12T02:43:36.755 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6815/2642068641", 2024-09-12T02:43:36.755 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6813/2642068641", 2024-09-12T02:43:36.756 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:36.756 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:36.756 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:36.756 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.756 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:43:36.756 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:36.756 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:36.756 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:36.756 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:36.757 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:36.757 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:36.757 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:36.757 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:36.757 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:36.757 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:36.757 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:36.758 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:36.758 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.758 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.758 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6816", 2024-09-12T02:43:36.758 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:36.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.758 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.758 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6817", 2024-09-12T02:43:36.759 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:36.759 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.759 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.759 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:36.759 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.759 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.760 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6818", 2024-09-12T02:43:36.760 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:36.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.760 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.760 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6819", 2024-09-12T02:43:36.760 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:36.761 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.761 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.761 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:36.761 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.761 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.762 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6822", 2024-09-12T02:43:36.762 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:36.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.762 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.762 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6823", 2024-09-12T02:43:36.762 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:36.762 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.762 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.763 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:36.763 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.763 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.763 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6820", 2024-09-12T02:43:36.763 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:36.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.763 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.763 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6821", 2024-09-12T02:43:36.763 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:36.764 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.764 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.764 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6817/3365688807", 2024-09-12T02:43:36.764 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6819/3365688807", 2024-09-12T02:43:36.764 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6823/3365688807", 2024-09-12T02:43:36.764 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6821/3365688807", 2024-09-12T02:43:36.764 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:36.764 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:36.764 INFO:teuthology.orchestra.run.smithi112.stdout: "full", 2024-09-12T02:43:36.764 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:36.764 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.765 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:43:36.765 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:36.765 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:36.765 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:36.765 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:36.765 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:36.765 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:36.765 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:36.765 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:36.766 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:36.766 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:36.766 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:36.766 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:36.766 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.766 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.766 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6824", 2024-09-12T02:43:36.766 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:36.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.767 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.767 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6825", 2024-09-12T02:43:36.767 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:36.767 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.767 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.767 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:36.767 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.767 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.768 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6826", 2024-09-12T02:43:36.768 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:36.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.768 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.768 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6827", 2024-09-12T02:43:36.768 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:36.768 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.768 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.768 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:36.768 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.769 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.769 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6830", 2024-09-12T02:43:36.769 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:36.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.769 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.769 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6831", 2024-09-12T02:43:36.769 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:36.769 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.769 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.770 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:36.770 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.770 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.770 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6828", 2024-09-12T02:43:36.770 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:36.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.770 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.770 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6829", 2024-09-12T02:43:36.770 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:36.770 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.770 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.771 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6825/231774278", 2024-09-12T02:43:36.771 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6827/231774278", 2024-09-12T02:43:36.771 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6831/231774278", 2024-09-12T02:43:36.771 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6829/231774278", 2024-09-12T02:43:36.771 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:36.771 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull", 2024-09-12T02:43:36.771 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:36.771 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:36.771 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.771 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:43:36.771 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:36.771 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:36.772 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:36.772 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:36.772 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:36.772 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:36.772 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:36.772 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:36.772 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:36.772 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:36.772 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:36.772 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:36.772 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.772 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.773 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6800", 2024-09-12T02:43:36.773 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:36.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.773 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.773 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6801", 2024-09-12T02:43:36.773 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:36.773 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.773 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.773 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:36.773 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.773 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.774 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6802", 2024-09-12T02:43:36.774 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:36.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.774 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.774 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6803", 2024-09-12T02:43:36.774 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:36.774 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.774 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.774 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:36.774 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.774 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.775 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6806", 2024-09-12T02:43:36.775 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:36.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.775 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.775 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6807", 2024-09-12T02:43:36.775 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:36.775 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.775 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.775 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:36.775 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.776 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.776 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6804", 2024-09-12T02:43:36.776 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:36.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.776 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.776 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6805", 2024-09-12T02:43:36.776 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:36.776 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.776 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.776 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6801/3671178153", 2024-09-12T02:43:36.777 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6803/3671178153", 2024-09-12T02:43:36.777 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6807/3671178153", 2024-09-12T02:43:36.777 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6805/3671178153", 2024-09-12T02:43:36.777 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:36.777 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:36.777 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:36.777 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.777 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:43:36.777 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:36.777 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:36.777 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:36.777 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:36.778 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:36.778 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:36.778 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:36.778 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:36.778 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:36.778 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:36.778 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:36.778 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:36.778 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.778 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.778 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6808", 2024-09-12T02:43:36.778 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:36.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.779 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.779 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6809", 2024-09-12T02:43:36.779 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:36.779 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.779 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.779 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:36.779 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.779 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.779 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6810", 2024-09-12T02:43:36.779 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:36.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.780 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.780 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6811", 2024-09-12T02:43:36.780 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:36.780 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.780 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.780 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:36.780 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.781 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.781 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6817", 2024-09-12T02:43:36.781 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:36.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.781 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.781 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6819", 2024-09-12T02:43:36.781 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:36.781 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.781 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.781 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:36.781 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.782 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.782 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6812", 2024-09-12T02:43:36.782 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:36.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.782 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.782 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6815", 2024-09-12T02:43:36.782 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:36.782 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.782 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.782 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6809/3193706134", 2024-09-12T02:43:36.782 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6811/3193706134", 2024-09-12T02:43:36.783 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6819/3193706134", 2024-09-12T02:43:36.783 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6815/3193706134", 2024-09-12T02:43:36.783 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:36.783 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:36.783 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:36.783 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.783 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:43:36.783 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:36.783 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:36.783 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:36.783 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:36.783 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:36.784 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:36.784 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:36.784 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:36.784 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:36.784 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:36.784 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:36.784 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:36.784 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.785 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.785 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6813", 2024-09-12T02:43:36.785 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:36.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.785 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.785 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6814", 2024-09-12T02:43:36.785 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:36.785 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.785 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.785 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:36.785 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.786 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.786 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6816", 2024-09-12T02:43:36.786 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:36.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.786 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.786 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6818", 2024-09-12T02:43:36.786 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:36.786 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.786 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.786 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:36.786 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.787 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.787 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6822", 2024-09-12T02:43:36.787 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:36.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.787 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.787 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6823", 2024-09-12T02:43:36.787 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:36.787 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.787 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.787 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:36.787 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.788 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.788 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6820", 2024-09-12T02:43:36.788 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:36.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.788 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.788 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6821", 2024-09-12T02:43:36.788 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:36.788 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.788 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.789 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6814/3738813293", 2024-09-12T02:43:36.789 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6818/3738813293", 2024-09-12T02:43:36.789 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6823/3738813293", 2024-09-12T02:43:36.789 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6821/3738813293", 2024-09-12T02:43:36.789 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:36.789 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:36.789 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:36.789 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.789 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:43:36.789 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:36.789 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:36.790 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:36.790 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:36.790 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:36.790 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:36.790 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:36.790 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:36.790 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:36.790 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:36.790 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:36.790 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:36.790 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.790 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.791 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6824", 2024-09-12T02:43:36.791 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:36.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.791 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.791 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6825", 2024-09-12T02:43:36.791 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:36.791 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.791 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.791 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:36.791 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.791 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.791 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6826", 2024-09-12T02:43:36.792 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:36.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.792 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.792 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6827", 2024-09-12T02:43:36.792 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:36.792 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.792 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.792 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:36.792 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.793 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.793 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6830", 2024-09-12T02:43:36.793 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:36.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.794 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.794 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6831", 2024-09-12T02:43:36.794 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:36.794 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.794 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.794 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:36.795 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:36.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.795 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:36.795 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6828", 2024-09-12T02:43:36.795 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:36.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.795 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:36.795 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6829", 2024-09-12T02:43:36.795 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:36.795 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.796 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.796 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6825/1421932609", 2024-09-12T02:43:36.796 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6827/1421932609", 2024-09-12T02:43:36.796 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6831/1421932609", 2024-09-12T02:43:36.796 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6829/1421932609", 2024-09-12T02:43:36.796 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:36.796 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:36.796 INFO:teuthology.orchestra.run.smithi112.stdout: "full", 2024-09-12T02:43:36.796 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:36.796 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:36.797 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.797 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:36.797 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_xinfo": [ 2024-09-12T02:43:36.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.797 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:43:36.797 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:36.797 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:36.797 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:36.797 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:36.797 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:36.797 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.220641+0000", 2024-09-12T02:43:36.798 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:36.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.798 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:43:36.798 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:36.798 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:36.798 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:36.798 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:36.798 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:36.799 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312574+0000", 2024-09-12T02:43:36.799 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:36.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.799 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:43:36.799 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:36.799 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:36.799 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:36.799 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:36.799 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:36.800 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.282771+0000", 2024-09-12T02:43:36.800 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:36.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.800 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:43:36.800 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:36.800 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:36.800 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:36.800 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:36.801 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:36.801 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.260478+0000", 2024-09-12T02:43:36.801 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:36.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.801 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:43:36.801 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:36.801 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:36.801 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:36.801 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:36.801 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:36.801 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.273397+0000", 2024-09-12T02:43:36.801 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:36.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.802 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:43:36.802 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:36.802 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:36.802 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:36.802 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:36.802 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:36.802 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312452+0000", 2024-09-12T02:43:36.802 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:36.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.802 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:43:36.802 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:36.802 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:36.803 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:36.803 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:36.803 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:36.803 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.308965+0000", 2024-09-12T02:43:36.803 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:36.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:36.803 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:43:36.803 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:36.803 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:36.803 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:36.803 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:36.803 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:36.803 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.337842+0000", 2024-09-12T02:43:36.804 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:36.804 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.804 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:36.804 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap": [], 2024-09-12T02:43:36.804 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_items": [], 2024-09-12T02:43:36.804 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_primaries": [], 2024-09-12T02:43:36.804 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_temp": [], 2024-09-12T02:43:36.804 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_temp": [], 2024-09-12T02:43:36.804 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklist": {}, 2024-09-12T02:43:36.804 INFO:teuthology.orchestra.run.smithi112.stdout: "range_blocklist": {}, 2024-09-12T02:43:36.804 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profiles": { 2024-09-12T02:43:36.804 INFO:teuthology.orchestra.run.smithi112.stdout: "default": { 2024-09-12T02:43:36.804 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-failure-domain": "osd", 2024-09-12T02:43:36.804 INFO:teuthology.orchestra.run.smithi112.stdout: "k": "2", 2024-09-12T02:43:36.804 INFO:teuthology.orchestra.run.smithi112.stdout: "m": "1", 2024-09-12T02:43:36.805 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin": "jerasure", 2024-09-12T02:43:36.805 INFO:teuthology.orchestra.run.smithi112.stdout: "technique": "reed_sol_van" 2024-09-12T02:43:36.805 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:36.805 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps_queue": [], 2024-09-12T02:43:36.805 INFO:teuthology.orchestra.run.smithi112.stdout: "new_removed_snaps": [], 2024-09-12T02:43:36.805 INFO:teuthology.orchestra.run.smithi112.stdout: "new_purged_snaps": [], 2024-09-12T02:43:36.805 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_node_flags": {}, 2024-09-12T02:43:36.805 INFO:teuthology.orchestra.run.smithi112.stdout: "device_class_flags": {}, 2024-09-12T02:43:36.805 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode": { 2024-09-12T02:43:36.805 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_enabled": false, 2024-09-12T02:43:36.805 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_bucket_count": 0, 2024-09-12T02:43:36.805 INFO:teuthology.orchestra.run.smithi112.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:43:36.805 INFO:teuthology.orchestra.run.smithi112.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:43:36.806 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_bucket": 0 2024-09-12T02:43:36.806 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:36.806 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:43:36.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.719+0000 7ff708e00640 1 -- 172.21.15.112:0/2487390657 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff6e406be30 msgr2=0x7ff6e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:36.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.719+0000 7ff708e00640 1 --2- 172.21.15.112:0/2487390657 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff6e406be30 0x7ff6e406e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4007fd0 tx=0x7ff6f4009040 comp rx=0 tx=0).stop 2024-09-12T02:43:36.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.719+0000 7ff708e00640 1 -- 172.21.15.112:0/2487390657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff70415b9d0 msgr2=0x7ff70415d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:36.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.719+0000 7ff708e00640 1 --2- 172.21.15.112:0/2487390657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff70415b9d0 0x7ff70415d000 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc00cba0 tx=0x7ff6fc00a430 comp rx=0 tx=0).stop 2024-09-12T02:43:36.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.719+0000 7ff708e00640 1 -- 172.21.15.112:0/2487390657 shutdown_connections 2024-09-12T02:43:36.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.719+0000 7ff708e00640 1 --2- 172.21.15.112:0/2487390657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff70415b9d0 0x7ff70415d000 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:36.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.719+0000 7ff708e00640 1 --2- 172.21.15.112:0/2487390657 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff6e406be30 0x7ff6e406e2f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:36.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.719+0000 7ff708e00640 1 --2- 172.21.15.112:0/2487390657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7040b45d0 0x7ff70415cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:36.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.719+0000 7ff708e00640 1 --2- 172.21.15.112:0/2487390657 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff70406f600 0x7ff7041560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:36.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.719+0000 7ff708e00640 1 -- 172.21.15.112:0/2487390657 >> 172.21.15.112:0/2487390657 conn(0x7ff70406bbd0 msgr2=0x7ff7040cf090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:36.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.719+0000 7ff708e00640 1 -- 172.21.15.112:0/2487390657 shutdown_connections 2024-09-12T02:43:36.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:36.719+0000 7ff708e00640 1 -- 172.21.15.112:0/2487390657 wait complete. 2024-09-12T02:43:36.809 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-12T02:43:36.809 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:43:36.809 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:43:36.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:43:36.845 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2024-09-12T02:43:37.231 INFO:teuthology.orchestra.run.smithi112.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2024-09-12T02:43:37.231 INFO:teuthology.orchestra.run.smithi112.stderr:50+0 records in 2024-09-12T02:43:37.231 INFO:teuthology.orchestra.run.smithi112.stderr:50+0 records out 2024-09-12T02:43:37.231 INFO:teuthology.orchestra.run.smithi112.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.299731 s, 175 MB/s 2024-09-12T02:43:37.232 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:43:37.233 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-12T02:43:37.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.385+0000 7fa695800640 1 Processor -- start 2024-09-12T02:43:37.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.385+0000 7fa695800640 1 -- start start 2024-09-12T02:43:37.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.386+0000 7fa695800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa69015cc50 0x7fa6900732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:37.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.386+0000 7fa695800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa690071530 0x7fa6900af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:37.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.386+0000 7fa695800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa6900719a0 0x7fa6900afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:37.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.386+0000 7fa695800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa69015d030 con 0x7fa690071530 2024-09-12T02:43:37.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.386+0000 7fa695800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa6900cf4c0 con 0x7fa69015cc50 2024-09-12T02:43:37.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.386+0000 7fa695800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa690073830 con 0x7fa6900719a0 2024-09-12T02:43:37.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.386+0000 7fa686000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa690071530 0x7fa6900af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:37.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.386+0000 7fa686000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa690071530 0x7fa6900af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53532/0 (socket says 172.21.15.112:53532) 2024-09-12T02:43:37.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.386+0000 7fa686000640 1 -- 172.21.15.112:0/618101615 learned_addr learned my addr 172.21.15.112:0/618101615 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:37.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.386+0000 7fa68ea00640 1 --2- 172.21.15.112:0/618101615 >> v2:172.21.15.137:3300/0 conn(0x7fa69015cc50 0x7fa6900732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:37.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.386+0000 7fa68f400640 1 --2- 172.21.15.112:0/618101615 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa6900719a0 0x7fa6900afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:37.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.387+0000 7fa686000640 1 -- 172.21.15.112:0/618101615 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa6900719a0 msgr2=0x7fa6900afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:37.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.387+0000 7fa686000640 1 --2- 172.21.15.112:0/618101615 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa6900719a0 0x7fa6900afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:37.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.387+0000 7fa686000640 1 -- 172.21.15.112:0/618101615 >> v2:172.21.15.137:3300/0 conn(0x7fa69015cc50 msgr2=0x7fa6900732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:37.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.387+0000 7fa686000640 1 --2- 172.21.15.112:0/618101615 >> v2:172.21.15.137:3300/0 conn(0x7fa69015cc50 0x7fa6900732f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:37.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.387+0000 7fa686000640 1 -- 172.21.15.112:0/618101615 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6900ceeb0 con 0x7fa690071530 2024-09-12T02:43:37.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.387+0000 7fa686000640 1 --2- 172.21.15.112:0/618101615 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa690071530 0x7fa6900af720 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa690070060 tx=0x7fa67802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc31f319b5da05df server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:37.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.388+0000 7fa68e000640 1 -- 172.21.15.112:0/618101615 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa678004030 con 0x7fa690071530 2024-09-12T02:43:37.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.388+0000 7fa68e000640 1 -- 172.21.15.112:0/618101615 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6780041d0 con 0x7fa690071530 2024-09-12T02:43:37.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.388+0000 7fa68e000640 1 -- 172.21.15.112:0/618101615 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa678003610 con 0x7fa690071530 2024-09-12T02:43:37.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.388+0000 7fa695800640 1 -- 172.21.15.112:0/618101615 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa690071530 msgr2=0x7fa6900af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:37.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.388+0000 7fa695800640 1 --2- 172.21.15.112:0/618101615 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa690071530 0x7fa6900af720 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa690070060 tx=0x7fa67802a130 comp rx=0 tx=0).stop 2024-09-12T02:43:37.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.388+0000 7fa695800640 1 -- 172.21.15.112:0/618101615 shutdown_connections 2024-09-12T02:43:37.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.388+0000 7fa695800640 1 --2- 172.21.15.112:0/618101615 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa6900719a0 0x7fa6900afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:37.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.388+0000 7fa695800640 1 --2- 172.21.15.112:0/618101615 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa690071530 0x7fa6900af720 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:37.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.388+0000 7fa695800640 1 --2- 172.21.15.112:0/618101615 >> v2:172.21.15.137:3300/0 conn(0x7fa69015cc50 0x7fa6900732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:37.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.388+0000 7fa695800640 1 -- 172.21.15.112:0/618101615 >> 172.21.15.112:0/618101615 conn(0x7fa69006bbd0 msgr2=0x7fa69006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:37.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.388+0000 7fa695800640 1 -- 172.21.15.112:0/618101615 shutdown_connections 2024-09-12T02:43:37.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.389+0000 7fa695800640 1 -- 172.21.15.112:0/618101615 wait complete. 2024-09-12T02:43:37.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.390+0000 7fa695800640 1 Processor -- start 2024-09-12T02:43:37.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.390+0000 7fa695800640 1 -- start start 2024-09-12T02:43:37.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.391+0000 7fa695800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa690071530 0x7fa690151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:37.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.391+0000 7fa695800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6900719a0 0x7fa69014d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:37.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.391+0000 7fa695800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa69015cc50 0x7fa6901505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:37.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.391+0000 7fa695800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa6900cf150 con 0x7fa690071530 2024-09-12T02:43:37.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.391+0000 7fa695800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa69006e5e0 con 0x7fa6900719a0 2024-09-12T02:43:37.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.391+0000 7fa695800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa69006f510 con 0x7fa69015cc50 2024-09-12T02:43:37.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.391+0000 7fa68ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa690071530 0x7fa690151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:37.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.391+0000 7fa68ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa690071530 0x7fa690151040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53542/0 (socket says 172.21.15.112:53542) 2024-09-12T02:43:37.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.391+0000 7fa68ea00640 1 -- 172.21.15.112:0/2717100486 learned_addr learned my addr 172.21.15.112:0/2717100486 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:37.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.391+0000 7fa686000640 1 --2- 172.21.15.112:0/2717100486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6900719a0 0x7fa69014d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:37.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.392+0000 7fa68f400640 1 --2- 172.21.15.112:0/2717100486 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa69015cc50 0x7fa6901505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:37.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.392+0000 7fa68ea00640 1 -- 172.21.15.112:0/2717100486 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa69015cc50 msgr2=0x7fa6901505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:37.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.392+0000 7fa68ea00640 1 --2- 172.21.15.112:0/2717100486 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa69015cc50 0x7fa6901505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:37.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.392+0000 7fa68ea00640 1 -- 172.21.15.112:0/2717100486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6900719a0 msgr2=0x7fa69014d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:37.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.392+0000 7fa68ea00640 1 --2- 172.21.15.112:0/2717100486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6900719a0 0x7fa69014d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:37.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.392+0000 7fa68ea00640 1 -- 172.21.15.112:0/2717100486 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa690150d40 con 0x7fa690071530 2024-09-12T02:43:37.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.392+0000 7fa68ea00640 1 --2- 172.21.15.112:0/2717100486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa690071530 0x7fa690151040 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa68000d830 tx=0x7fa68000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:37.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.392+0000 7fa687400640 1 -- 172.21.15.112:0/2717100486 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68000b6c0 con 0x7fa690071530 2024-09-12T02:43:37.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.392+0000 7fa687400640 1 -- 172.21.15.112:0/2717100486 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa680019070 con 0x7fa690071530 2024-09-12T02:43:37.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.392+0000 7fa687400640 1 -- 172.21.15.112:0/2717100486 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68000ba80 con 0x7fa690071530 2024-09-12T02:43:37.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.392+0000 7fa695800640 1 -- 172.21.15.112:0/2717100486 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6901f3cb0 con 0x7fa690071530 2024-09-12T02:43:37.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.392+0000 7fa695800640 1 -- 172.21.15.112:0/2717100486 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6901f31d0 con 0x7fa690071530 2024-09-12T02:43:37.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.393+0000 7fa695800640 1 -- 172.21.15.112:0/2717100486 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa690068a30 con 0x7fa690071530 2024-09-12T02:43:37.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.394+0000 7fa687400640 1 -- 172.21.15.112:0/2717100486 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa68001e460 con 0x7fa690071530 2024-09-12T02:43:37.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.395+0000 7fa687400640 1 --2- 172.21.15.112:0/2717100486 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa66c06be30 0x7fa66c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:37.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.395+0000 7fa687400640 1 -- 172.21.15.112:0/2717100486 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7fa68008b470 con 0x7fa690071530 2024-09-12T02:43:37.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.395+0000 7fa687400640 1 -- 172.21.15.112:0/2717100486 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=49}) -- 0x7fa66c0739c0 con 0x7fa690071530 2024-09-12T02:43:37.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.396+0000 7fa686000640 1 --2- 172.21.15.112:0/2717100486 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa66c06be30 0x7fa66c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:37.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.396+0000 7fa686000640 1 --2- 172.21.15.112:0/2717100486 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa66c06be30 0x7fa66c06e2f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa678033000 tx=0x7fa67802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:37.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.400+0000 7fa687400640 1 -- 172.21.15.112:0/2717100486 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa680059e20 con 0x7fa690071530 2024-09-12T02:43:37.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.572+0000 7fa695800640 1 -- 172.21.15.112:0/2717100486 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fa69006df60 con 0x7fa690071530 2024-09-12T02:43:37.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.573+0000 7fa687400640 1 -- 172.21.15.112:0/2717100486 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v48) ==== 81+0+34395 (secure 0 0 0) 0x7fa680059720 con 0x7fa690071530 2024-09-12T02:43:37.575 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:37.575 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:43:37.575 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 48, 2024-09-12T02:43:37.575 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:43:37.575 INFO:teuthology.orchestra.run.smithi112.stdout: "created": "2024-09-12T02:41:36.162095+0000", 2024-09-12T02:43:37.575 INFO:teuthology.orchestra.run.smithi112.stdout: "modified": "2024-09-12T02:43:37.107451+0000", 2024-09-12T02:43:37.575 INFO:teuthology.orchestra.run.smithi112.stdout: "last_up_change": "2024-09-12T02:41:42.191169+0000", 2024-09-12T02:43:37.575 INFO:teuthology.orchestra.run.smithi112.stdout: "last_in_change": "2024-09-12T02:41:39.036600+0000", 2024-09-12T02:43:37.576 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:43:37.576 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_num": 5799936, 2024-09-12T02:43:37.576 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_set": [ 2024-09-12T02:43:37.576 INFO:teuthology.orchestra.run.smithi112.stdout: "pglog_hardlimit", 2024-09-12T02:43:37.576 INFO:teuthology.orchestra.run.smithi112.stdout: "purged_snapdirs", 2024-09-12T02:43:37.576 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_deletes", 2024-09-12T02:43:37.576 INFO:teuthology.orchestra.run.smithi112.stdout: "sortbitwise" 2024-09-12T02:43:37.576 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:37.576 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_version": 4, 2024-09-12T02:43:37.576 INFO:teuthology.orchestra.run.smithi112.stdout: "full_ratio": 0.69999998807907104, 2024-09-12T02:43:37.576 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-12T02:43:37.577 INFO:teuthology.orchestra.run.smithi112.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-12T02:43:37.577 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_snapshot": "", 2024-09-12T02:43:37.577 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_max": 7, 2024-09-12T02:43:37.577 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd": 8, 2024-09-12T02:43:37.577 INFO:teuthology.orchestra.run.smithi112.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:43:37.577 INFO:teuthology.orchestra.run.smithi112.stdout: "min_compat_client": "jewel", 2024-09-12T02:43:37.577 INFO:teuthology.orchestra.run.smithi112.stdout: "require_osd_release": "squid", 2024-09-12T02:43:37.577 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_crimson": false, 2024-09-12T02:43:37.577 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-12T02:43:37.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.577 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 1, 2024-09-12T02:43:37.577 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": ".mgr", 2024-09-12T02:43:37.577 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:41:43.011599+0000", 2024-09-12T02:43:37.577 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 3, 2024-09-12T02:43:37.578 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full", 2024-09-12T02:43:37.578 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:43:37.578 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:43:37.578 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:43:37.578 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:43:37.578 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:43:37.578 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:43:37.578 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:43:37.578 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:43:37.578 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:43:37.578 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:43:37.578 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:43:37.578 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 1, 2024-09-12T02:43:37.578 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 1, 2024-09-12T02:43:37.578 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 1, 2024-09-12T02:43:37.579 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 1, 2024-09-12T02:43:37.579 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 1, 2024-09-12T02:43:37.579 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:43:37.579 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:43:37.579 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:43:37.579 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:43:37.579 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:43:37.579 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:43:37.579 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:43:37.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.579 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "46", 2024-09-12T02:43:37.579 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:43:37.579 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:43:37.580 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:43:37.580 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:43:37.580 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:43:37.580 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:43:37.580 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:43:37.580 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:43:37.580 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:43:37.580 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:43:37.580 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:43:37.580 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:43:37.580 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:43:37.580 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:43:37.580 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:43:37.580 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:43:37.581 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:43:37.581 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:43:37.581 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:43:37.581 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:43:37.581 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:43:37.581 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:43:37.581 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:43:37.581 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:43:37.581 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:43:37.581 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:43:37.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.581 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:43:37.581 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:43:37.581 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:43:37.582 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:43:37.582 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:43:37.582 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:43:37.582 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:43:37.582 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:43:37.582 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:43:37.582 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:43:37.582 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:43:37.582 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:43:37.582 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_max": 32, 2024-09-12T02:43:37.582 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 1 2024-09-12T02:43:37.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.582 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:43:37.582 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": {} 2024-09-12T02:43:37.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.583 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:43:37.583 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:43:37.583 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 8, 2024-09-12T02:43:37.583 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 8, 2024-09-12T02:43:37.583 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 0.25, 2024-09-12T02:43:37.583 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:43:37.583 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:43:37.583 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:43:37.583 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:43:37.583 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:43:37.583 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.584 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 6, 2024-09-12T02:43:37.584 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:43:37.584 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:43:14.483471+0000", 2024-09-12T02:43:37.584 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 3, 2024-09-12T02:43:37.584 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full", 2024-09-12T02:43:37.584 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:43:37.584 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:43:37.584 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:43:37.584 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:43:37.584 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:43:37.584 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:43:37.584 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:43:37.584 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:43:37.584 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:43:37.585 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:43:37.585 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:43:37.585 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 32, 2024-09-12T02:43:37.585 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 32, 2024-09-12T02:43:37.585 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 32, 2024-09-12T02:43:37.585 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 32, 2024-09-12T02:43:37.585 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 32, 2024-09-12T02:43:37.585 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:43:37.585 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:43:37.585 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:43:37.585 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:43:37.585 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:43:37.585 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:43:37.585 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:43:37.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.586 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "46", 2024-09-12T02:43:37.586 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:43:37.586 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:43:37.586 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:43:37.586 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:43:37.586 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:43:37.586 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:43:37.586 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:43:37.586 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:43:37.586 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:43:37.586 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:43:37.586 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:43:37.586 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:43:37.586 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:43:37.587 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:43:37.587 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:43:37.587 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:43:37.587 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:43:37.587 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:43:37.587 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:43:37.587 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:43:37.587 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:43:37.587 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:43:37.587 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:43:37.587 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:43:37.587 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:43:37.587 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:43:37.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.588 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:43:37.588 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:43:37.588 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:43:37.588 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:43:37.588 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:43:37.588 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:43:37.588 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:43:37.588 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:43:37.588 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:43:37.588 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:43:37.588 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:43:37.588 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:43:37.588 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:43:37.588 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 16, 2024-09-12T02:43:37.589 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_priority": 5 2024-09-12T02:43:37.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.589 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:43:37.589 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:43:37.589 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": "cephfs" 2024-09-12T02:43:37.589 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.589 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:43:37.589 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:43:37.589 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.75, 2024-09-12T02:43:37.589 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.75, 2024-09-12T02:43:37.589 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:43:37.589 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.75, 2024-09-12T02:43:37.590 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.75, 2024-09-12T02:43:37.590 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:43:37.590 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:43:37.590 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:43:37.590 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.590 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 7, 2024-09-12T02:43:37.590 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_data", 2024-09-12T02:43:37.590 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:43:15.711619+0000", 2024-09-12T02:43:37.590 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 3, 2024-09-12T02:43:37.590 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full", 2024-09-12T02:43:37.590 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:43:37.590 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:43:37.591 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:43:37.591 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:43:37.591 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:43:37.591 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:43:37.591 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:43:37.591 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:43:37.591 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:43:37.591 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:43:37.591 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:43:37.591 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 64, 2024-09-12T02:43:37.591 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 64, 2024-09-12T02:43:37.591 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 64, 2024-09-12T02:43:37.591 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 64, 2024-09-12T02:43:37.591 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 64, 2024-09-12T02:43:37.591 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:43:37.592 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:43:37.592 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:43:37.592 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:43:37.592 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:43:37.592 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:43:37.592 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:43:37.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.592 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "46", 2024-09-12T02:43:37.592 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:43:37.592 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:43:37.593 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:43:37.593 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:43:37.593 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:43:37.593 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:43:37.593 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:43:37.593 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:43:37.593 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:43:37.593 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:43:37.593 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:43:37.593 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:43:37.593 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:43:37.593 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:43:37.594 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:43:37.594 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:43:37.594 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:43:37.594 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:43:37.594 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:43:37.594 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:43:37.594 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:43:37.594 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:43:37.594 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:43:37.594 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:43:37.594 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:43:37.594 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:43:37.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.594 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:43:37.595 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:43:37.595 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:43:37.595 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:43:37.595 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:43:37.595 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:43:37.595 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:43:37.595 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:43:37.595 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:43:37.595 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:43:37.595 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:43:37.595 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:43:37.595 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 64, 2024-09-12T02:43:37.595 INFO:teuthology.orchestra.run.smithi112.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:43:37.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.596 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:43:37.596 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:43:37.596 INFO:teuthology.orchestra.run.smithi112.stdout: "data": "cephfs" 2024-09-12T02:43:37.596 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.596 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:43:37.596 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:43:37.596 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.75, 2024-09-12T02:43:37.596 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.75, 2024-09-12T02:43:37.596 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:43:37.596 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.75, 2024-09-12T02:43:37.596 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.75, 2024-09-12T02:43:37.596 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:43:37.597 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:43:37.597 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:43:37.597 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.597 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.597 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:37.597 INFO:teuthology.orchestra.run.smithi112.stdout: "osds": [ 2024-09-12T02:43:37.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.597 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:43:37.597 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:37.597 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:37.598 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:37.598 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:37.598 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:37.598 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:37.598 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:37.598 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:37.598 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:37.598 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:37.598 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:37.598 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:37.598 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.598 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.598 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6800", 2024-09-12T02:43:37.599 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:37.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.599 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.599 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6801", 2024-09-12T02:43:37.599 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:37.599 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.599 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.599 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:37.599 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.599 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.599 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6802", 2024-09-12T02:43:37.600 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:37.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.600 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.600 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6803", 2024-09-12T02:43:37.600 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:37.600 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.600 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.600 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:37.600 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.600 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.600 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6806", 2024-09-12T02:43:37.600 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:37.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.601 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.601 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6807", 2024-09-12T02:43:37.601 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:37.601 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.601 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.601 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:37.601 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.601 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.601 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6804", 2024-09-12T02:43:37.601 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:37.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.602 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.602 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6805", 2024-09-12T02:43:37.602 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:37.602 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.602 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.602 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6801/821571304", 2024-09-12T02:43:37.602 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6803/821571304", 2024-09-12T02:43:37.602 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6807/821571304", 2024-09-12T02:43:37.602 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6805/821571304", 2024-09-12T02:43:37.602 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:37.602 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:37.603 INFO:teuthology.orchestra.run.smithi112.stdout: "full", 2024-09-12T02:43:37.603 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:37.603 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.603 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:43:37.603 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:37.603 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:37.603 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:37.603 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:37.603 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:37.603 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:37.603 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:37.603 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:37.604 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:37.604 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:37.604 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:37.604 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:37.604 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.604 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.604 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6808", 2024-09-12T02:43:37.604 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:37.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.605 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.605 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6809", 2024-09-12T02:43:37.605 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:37.605 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.605 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.605 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:37.605 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.605 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.605 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6810", 2024-09-12T02:43:37.605 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:37.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.606 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.606 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6811", 2024-09-12T02:43:37.606 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:37.606 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.606 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.606 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:37.606 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.606 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.606 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6814", 2024-09-12T02:43:37.606 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:37.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.607 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.607 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6815", 2024-09-12T02:43:37.607 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:37.607 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.607 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.607 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:37.607 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.607 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.607 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6812", 2024-09-12T02:43:37.607 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:37.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.607 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.608 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6813", 2024-09-12T02:43:37.608 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:37.608 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.608 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.608 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6809/2642068641", 2024-09-12T02:43:37.608 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6811/2642068641", 2024-09-12T02:43:37.608 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6815/2642068641", 2024-09-12T02:43:37.608 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6813/2642068641", 2024-09-12T02:43:37.608 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:37.608 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:37.608 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:37.608 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.609 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:43:37.609 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:37.609 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:37.609 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:37.609 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:37.609 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:37.609 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:37.609 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:37.609 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:37.609 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:37.609 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:37.609 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:37.610 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:37.610 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.610 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.610 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6816", 2024-09-12T02:43:37.610 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:37.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.610 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.610 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6817", 2024-09-12T02:43:37.610 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:37.610 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.610 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.611 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:37.611 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.611 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.611 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6818", 2024-09-12T02:43:37.611 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:37.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.611 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.611 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6819", 2024-09-12T02:43:37.611 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:37.611 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.611 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.612 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:37.612 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.612 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.612 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6822", 2024-09-12T02:43:37.612 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:37.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.612 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.613 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6823", 2024-09-12T02:43:37.613 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:37.613 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.613 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.613 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:37.613 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.613 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.613 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6820", 2024-09-12T02:43:37.613 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:37.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.614 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.614 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6821", 2024-09-12T02:43:37.614 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:37.614 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.614 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.614 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6817/3365688807", 2024-09-12T02:43:37.614 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6819/3365688807", 2024-09-12T02:43:37.614 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6823/3365688807", 2024-09-12T02:43:37.614 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6821/3365688807", 2024-09-12T02:43:37.614 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:37.615 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:37.615 INFO:teuthology.orchestra.run.smithi112.stdout: "full", 2024-09-12T02:43:37.615 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:37.615 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.615 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:43:37.615 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:37.615 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:37.615 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:37.615 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:37.615 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:37.615 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:37.616 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:37.616 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:37.616 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:37.616 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:37.616 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:37.616 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:37.616 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.616 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.616 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6824", 2024-09-12T02:43:37.616 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:37.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.617 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.617 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6825", 2024-09-12T02:43:37.617 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:37.617 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.617 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.617 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:37.617 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.617 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.617 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6826", 2024-09-12T02:43:37.617 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:37.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.618 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.618 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6827", 2024-09-12T02:43:37.618 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:37.618 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.618 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.618 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:37.618 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.618 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.618 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6830", 2024-09-12T02:43:37.618 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:37.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.619 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.619 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6831", 2024-09-12T02:43:37.619 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:37.619 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.619 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.619 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:37.619 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.619 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.619 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.619 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6828", 2024-09-12T02:43:37.619 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:37.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.620 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.620 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6829", 2024-09-12T02:43:37.620 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:37.620 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.620 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.620 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6825/231774278", 2024-09-12T02:43:37.620 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6827/231774278", 2024-09-12T02:43:37.620 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6831/231774278", 2024-09-12T02:43:37.620 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6829/231774278", 2024-09-12T02:43:37.620 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:37.621 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull", 2024-09-12T02:43:37.621 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:37.621 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:37.621 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.621 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:43:37.621 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:37.621 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:37.621 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:37.621 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:37.621 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:37.621 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:37.621 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:37.622 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:37.622 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:37.622 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:37.622 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:37.622 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:37.622 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.622 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.622 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6800", 2024-09-12T02:43:37.622 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:37.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.622 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.623 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6801", 2024-09-12T02:43:37.623 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:37.623 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.623 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.623 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:37.623 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.623 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.623 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6802", 2024-09-12T02:43:37.623 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:37.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.623 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.624 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6803", 2024-09-12T02:43:37.624 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:37.624 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.624 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.624 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:37.624 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.624 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.624 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6806", 2024-09-12T02:43:37.624 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:37.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.624 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.625 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6807", 2024-09-12T02:43:37.625 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:37.625 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.625 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.625 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:37.625 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.625 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.625 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.625 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6804", 2024-09-12T02:43:37.625 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:37.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.625 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.626 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.626 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6805", 2024-09-12T02:43:37.626 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:37.626 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.626 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.626 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6801/3671178153", 2024-09-12T02:43:37.626 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6803/3671178153", 2024-09-12T02:43:37.626 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6807/3671178153", 2024-09-12T02:43:37.626 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6805/3671178153", 2024-09-12T02:43:37.626 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:37.626 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:37.626 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:37.626 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.627 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.627 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:43:37.627 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:37.627 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:37.627 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:37.627 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:37.627 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:37.627 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:37.627 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:37.627 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:37.627 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:37.627 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:37.628 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:37.628 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:37.628 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.628 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.628 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6808", 2024-09-12T02:43:37.628 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:37.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.628 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.628 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6809", 2024-09-12T02:43:37.628 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:37.628 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.629 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.629 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:37.629 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.629 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.629 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6810", 2024-09-12T02:43:37.629 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:37.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.629 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.629 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6811", 2024-09-12T02:43:37.629 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:37.629 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.630 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.630 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:37.630 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.630 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.630 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6817", 2024-09-12T02:43:37.630 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:37.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.630 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.630 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6819", 2024-09-12T02:43:37.630 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:37.631 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.631 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.631 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:37.631 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.631 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.631 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.631 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6812", 2024-09-12T02:43:37.631 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:37.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.631 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.631 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.631 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6815", 2024-09-12T02:43:37.632 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:37.632 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.632 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.632 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.632 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6809/3193706134", 2024-09-12T02:43:37.632 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6811/3193706134", 2024-09-12T02:43:37.632 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6819/3193706134", 2024-09-12T02:43:37.632 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6815/3193706134", 2024-09-12T02:43:37.632 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:37.632 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:37.632 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:37.632 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.633 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.633 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.633 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:43:37.633 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:37.633 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:37.633 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:37.633 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:37.633 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:37.633 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:37.633 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:37.633 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:37.633 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:37.633 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:37.634 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:37.634 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:37.634 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.634 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.634 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.634 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6813", 2024-09-12T02:43:37.634 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:37.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.634 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.634 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.634 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6814", 2024-09-12T02:43:37.634 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:37.634 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.635 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.635 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:37.635 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.635 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.635 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6816", 2024-09-12T02:43:37.635 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:37.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.635 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.635 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6818", 2024-09-12T02:43:37.636 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:37.636 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.636 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.636 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:37.636 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.636 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.636 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6822", 2024-09-12T02:43:37.636 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:37.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.637 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.637 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6823", 2024-09-12T02:43:37.637 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:37.637 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.637 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.637 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:37.637 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.637 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.637 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.637 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6820", 2024-09-12T02:43:37.637 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:37.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.638 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.638 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.638 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6821", 2024-09-12T02:43:37.638 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:37.638 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.638 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.638 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.638 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6814/3738813293", 2024-09-12T02:43:37.638 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6818/3738813293", 2024-09-12T02:43:37.638 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6823/3738813293", 2024-09-12T02:43:37.638 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6821/3738813293", 2024-09-12T02:43:37.638 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:37.638 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:37.639 INFO:teuthology.orchestra.run.smithi112.stdout: "full", 2024-09-12T02:43:37.639 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:37.639 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.639 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:43:37.639 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:37.639 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:37.639 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:37.639 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:37.639 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:37.639 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:37.639 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:37.639 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:37.640 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:37.640 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:37.640 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:37.640 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:37.640 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.640 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.640 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6824", 2024-09-12T02:43:37.640 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:37.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.640 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.640 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6825", 2024-09-12T02:43:37.641 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:37.641 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.641 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.641 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:37.641 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.641 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.641 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6826", 2024-09-12T02:43:37.641 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:37.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.641 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.642 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6827", 2024-09-12T02:43:37.642 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:37.642 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.642 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.642 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:37.642 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.642 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.642 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6830", 2024-09-12T02:43:37.642 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:37.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.643 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.643 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6831", 2024-09-12T02:43:37.643 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:37.643 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.643 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.643 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:37.643 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:37.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.643 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:37.643 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6828", 2024-09-12T02:43:37.643 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:37.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.644 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:37.644 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6829", 2024-09-12T02:43:37.644 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:37.644 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.644 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.644 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6825/1421932609", 2024-09-12T02:43:37.644 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6827/1421932609", 2024-09-12T02:43:37.644 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6831/1421932609", 2024-09-12T02:43:37.644 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6829/1421932609", 2024-09-12T02:43:37.645 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:37.645 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:37.645 INFO:teuthology.orchestra.run.smithi112.stdout: "full", 2024-09-12T02:43:37.645 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:37.645 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:37.645 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.645 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:37.645 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_xinfo": [ 2024-09-12T02:43:37.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.645 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:43:37.645 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:37.645 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:37.646 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:37.646 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:37.646 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:37.646 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.220641+0000", 2024-09-12T02:43:37.646 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:37.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.646 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:43:37.646 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:37.646 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:37.646 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:37.646 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:37.646 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:37.646 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312574+0000", 2024-09-12T02:43:37.647 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:37.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.647 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:43:37.647 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:37.647 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:37.647 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:37.647 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:37.647 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:37.647 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.282771+0000", 2024-09-12T02:43:37.647 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:37.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.647 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:43:37.648 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:37.648 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:37.648 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:37.648 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:37.648 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:37.648 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.260478+0000", 2024-09-12T02:43:37.648 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:37.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.648 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:43:37.648 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:37.648 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:37.648 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:37.648 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:37.649 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:37.649 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.273397+0000", 2024-09-12T02:43:37.649 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:37.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.649 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:43:37.649 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:37.649 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:37.649 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:37.649 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:37.649 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:37.649 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312452+0000", 2024-09-12T02:43:37.649 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:37.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.650 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:43:37.650 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:37.650 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:37.650 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:37.650 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:37.650 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:37.650 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.308965+0000", 2024-09-12T02:43:37.650 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:37.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:37.650 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:43:37.650 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:37.650 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:37.651 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:37.651 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:37.651 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:37.651 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.337842+0000", 2024-09-12T02:43:37.651 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:37.651 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.651 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:37.651 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap": [], 2024-09-12T02:43:37.651 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_items": [], 2024-09-12T02:43:37.651 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_primaries": [], 2024-09-12T02:43:37.651 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_temp": [], 2024-09-12T02:43:37.651 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_temp": [], 2024-09-12T02:43:37.651 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklist": {}, 2024-09-12T02:43:37.651 INFO:teuthology.orchestra.run.smithi112.stdout: "range_blocklist": {}, 2024-09-12T02:43:37.651 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profiles": { 2024-09-12T02:43:37.652 INFO:teuthology.orchestra.run.smithi112.stdout: "default": { 2024-09-12T02:43:37.652 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-failure-domain": "osd", 2024-09-12T02:43:37.652 INFO:teuthology.orchestra.run.smithi112.stdout: "k": "2", 2024-09-12T02:43:37.652 INFO:teuthology.orchestra.run.smithi112.stdout: "m": "1", 2024-09-12T02:43:37.652 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin": "jerasure", 2024-09-12T02:43:37.652 INFO:teuthology.orchestra.run.smithi112.stdout: "technique": "reed_sol_van" 2024-09-12T02:43:37.652 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:37.652 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps_queue": [], 2024-09-12T02:43:37.652 INFO:teuthology.orchestra.run.smithi112.stdout: "new_removed_snaps": [], 2024-09-12T02:43:37.652 INFO:teuthology.orchestra.run.smithi112.stdout: "new_purged_snaps": [], 2024-09-12T02:43:37.652 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_node_flags": {}, 2024-09-12T02:43:37.652 INFO:teuthology.orchestra.run.smithi112.stdout: "device_class_flags": {}, 2024-09-12T02:43:37.652 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode": { 2024-09-12T02:43:37.653 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_enabled": false, 2024-09-12T02:43:37.653 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_bucket_count": 0, 2024-09-12T02:43:37.653 INFO:teuthology.orchestra.run.smithi112.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:43:37.653 INFO:teuthology.orchestra.run.smithi112.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:43:37.653 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_bucket": 0 2024-09-12T02:43:37.653 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:37.653 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:43:37.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.576+0000 7fa695800640 1 -- 172.21.15.112:0/2717100486 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa66c06be30 msgr2=0x7fa66c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:37.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.576+0000 7fa695800640 1 --2- 172.21.15.112:0/2717100486 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa66c06be30 0x7fa66c06e2f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa678033000 tx=0x7fa67802e000 comp rx=0 tx=0).stop 2024-09-12T02:43:37.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.576+0000 7fa695800640 1 -- 172.21.15.112:0/2717100486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa690071530 msgr2=0x7fa690151040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:37.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.576+0000 7fa695800640 1 --2- 172.21.15.112:0/2717100486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa690071530 0x7fa690151040 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa68000d830 tx=0x7fa68000dcf0 comp rx=0 tx=0).stop 2024-09-12T02:43:37.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.576+0000 7fa695800640 1 -- 172.21.15.112:0/2717100486 shutdown_connections 2024-09-12T02:43:37.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.576+0000 7fa695800640 1 --2- 172.21.15.112:0/2717100486 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa69015cc50 0x7fa6901505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:37.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.576+0000 7fa695800640 1 --2- 172.21.15.112:0/2717100486 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa66c06be30 0x7fa66c06e2f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:37.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.576+0000 7fa695800640 1 --2- 172.21.15.112:0/2717100486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6900719a0 0x7fa69014d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:37.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.576+0000 7fa695800640 1 --2- 172.21.15.112:0/2717100486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa690071530 0x7fa690151040 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:37.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.576+0000 7fa695800640 1 -- 172.21.15.112:0/2717100486 >> 172.21.15.112:0/2717100486 conn(0x7fa69006bbd0 msgr2=0x7fa6901599e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:37.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.576+0000 7fa695800640 1 -- 172.21.15.112:0/2717100486 shutdown_connections 2024-09-12T02:43:37.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.576+0000 7fa695800640 1 -- 172.21.15.112:0/2717100486 wait complete. 2024-09-12T02:43:37.656 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:43:37.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.807+0000 7f8cc1200640 1 Processor -- start 2024-09-12T02:43:37.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.807+0000 7f8cc1200640 1 -- start start 2024-09-12T02:43:37.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.808+0000 7f8cc1200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8cbc15b9d0 0x7f8cbc0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:37.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.809+0000 7f8cc1200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8cbc06f600 0x7f8cbc0728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:37.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.809+0000 7f8cc1200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cbc0b54a0 con 0x7f8cbc0b45d0 2024-09-12T02:43:37.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.809+0000 7f8cc1200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8cbc0b4a60 con 0x7f8cbc15b9d0 2024-09-12T02:43:37.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.809+0000 7f8cc1200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8cbc0b3af0 con 0x7f8cbc06f600 2024-09-12T02:43:37.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.809+0000 7f8cb9e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8cbc15b9d0 0x7f8cbc0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:37.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.809+0000 7f8cb9e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8cbc15b9d0 0x7f8cbc0b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53548/0 (socket says 172.21.15.112:53548) 2024-09-12T02:43:37.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.809+0000 7f8cb9e00640 1 -- 172.21.15.112:0/2639227863 learned_addr learned my addr 172.21.15.112:0/2639227863 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:37.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.809+0000 7f8cba800640 1 --2- 172.21.15.112:0/2639227863 >> v2:172.21.15.137:3300/0 conn(0x7f8cbc06f600 0x7f8cbc0728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:37.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.809+0000 7f8cb9e00640 1 -- 172.21.15.112:0/2639227863 >> v2:172.21.15.137:3300/0 conn(0x7f8cbc06f600 msgr2=0x7f8cbc0728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:37.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.809+0000 7f8cb9e00640 1 --2- 172.21.15.112:0/2639227863 >> v2:172.21.15.137:3300/0 conn(0x7f8cbc06f600 0x7f8cbc0728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:37.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.809+0000 7f8cb9e00640 1 -- 172.21.15.112:0/2639227863 >> v1:172.21.15.137:6789/0 conn(0x7f8cbc0b45d0 legacy=0x7f8cbc06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:37.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.809+0000 7f8cb9e00640 1 -- 172.21.15.112:0/2639227863 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cbc0b3dd0 con 0x7f8cbc15b9d0 2024-09-12T02:43:37.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.810+0000 7f8cb9e00640 1 --2- 172.21.15.112:0/2639227863 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cbc15b9d0 0x7f8cbc0b4ec0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc072f80 tx=0x7f8cac02c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f18ab8184e518a7b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:37.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.811+0000 7f8cb9400640 1 -- 172.21.15.112:0/2639227863 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cac033640 con 0x7f8cbc15b9d0 2024-09-12T02:43:37.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.811+0000 7f8cb9400640 1 -- 172.21.15.112:0/2639227863 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cac038070 con 0x7f8cbc15b9d0 2024-09-12T02:43:37.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.811+0000 7f8cb9400640 1 -- 172.21.15.112:0/2639227863 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cac033a00 con 0x7f8cbc15b9d0 2024-09-12T02:43:37.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.811+0000 7f8cc1200640 1 -- 172.21.15.112:0/2639227863 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cbc15b9d0 msgr2=0x7f8cbc0b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:37.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.811+0000 7f8cc1200640 1 --2- 172.21.15.112:0/2639227863 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cbc15b9d0 0x7f8cbc0b4ec0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc072f80 tx=0x7f8cac02c8b0 comp rx=0 tx=0).stop 2024-09-12T02:43:37.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.811+0000 7f8cc1200640 1 -- 172.21.15.112:0/2639227863 shutdown_connections 2024-09-12T02:43:37.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.811+0000 7f8cc1200640 1 --2- 172.21.15.112:0/2639227863 >> v2:172.21.15.137:3300/0 conn(0x7f8cbc06f600 0x7f8cbc0728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:37.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.811+0000 7f8cc1200640 1 --2- 172.21.15.112:0/2639227863 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cbc15b9d0 0x7f8cbc0b4ec0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:37.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.811+0000 7f8cc1200640 1 -- 172.21.15.112:0/2639227863 >> 172.21.15.112:0/2639227863 conn(0x7f8cbc06bbd0 msgr2=0x7f8cbc06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:37.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.811+0000 7f8cc1200640 1 -- 172.21.15.112:0/2639227863 shutdown_connections 2024-09-12T02:43:37.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.811+0000 7f8cc1200640 1 -- 172.21.15.112:0/2639227863 wait complete. 2024-09-12T02:43:37.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.813+0000 7f8cc1200640 1 Processor -- start 2024-09-12T02:43:37.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.813+0000 7f8cc1200640 1 -- start start 2024-09-12T02:43:37.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.814+0000 7f8cc1200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cbc06f600 0x7f8cbc1548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:37.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.814+0000 7f8cc1200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8cbc0b45d0 0x7f8cbc1412b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:37.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.814+0000 7f8cc1200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8cbc15b9d0 0x7f8cbc15c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:37.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.814+0000 7f8cc1200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8cbc15bf30 con 0x7f8cbc06f600 2024-09-12T02:43:37.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.814+0000 7f8cc1200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8cbc15bdb0 con 0x7f8cbc15b9d0 2024-09-12T02:43:37.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.814+0000 7f8cc1200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8cbc0cdcd0 con 0x7f8cbc0b45d0 2024-09-12T02:43:37.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.814+0000 7f8cb9e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cbc06f600 0x7f8cbc1548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:37.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.814+0000 7f8cb9e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cbc06f600 0x7f8cbc1548f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53560/0 (socket says 172.21.15.112:53560) 2024-09-12T02:43:37.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.814+0000 7f8cb9e00640 1 -- 172.21.15.112:0/3176099888 learned_addr learned my addr 172.21.15.112:0/3176099888 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:37.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.814+0000 7f8cba800640 1 --2- 172.21.15.112:0/3176099888 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8cbc15b9d0 0x7f8cbc15c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:37.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.814+0000 7f8cb1400640 1 --2- 172.21.15.112:0/3176099888 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8cbc0b45d0 0x7f8cbc1412b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:37.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.815+0000 7f8cb9e00640 1 -- 172.21.15.112:0/3176099888 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8cbc0b45d0 msgr2=0x7f8cbc1412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:37.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.815+0000 7f8cb9e00640 1 --2- 172.21.15.112:0/3176099888 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8cbc0b45d0 0x7f8cbc1412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:37.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.815+0000 7f8cb9e00640 1 -- 172.21.15.112:0/3176099888 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8cbc15b9d0 msgr2=0x7f8cbc15c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:37.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.815+0000 7f8cb9e00640 1 --2- 172.21.15.112:0/3176099888 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8cbc15b9d0 0x7f8cbc15c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:37.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.815+0000 7f8cb9e00640 1 -- 172.21.15.112:0/3176099888 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cbc154e30 con 0x7f8cbc06f600 2024-09-12T02:43:37.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.815+0000 7f8cb9e00640 1 --2- 172.21.15.112:0/3176099888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cbc06f600 0x7f8cbc1548f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8cac02c8f0 tx=0x7f8cac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:37.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.815+0000 7f8cb2a00640 1 -- 172.21.15.112:0/3176099888 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cac0465f0 con 0x7f8cbc06f600 2024-09-12T02:43:37.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.815+0000 7f8cb2a00640 1 -- 172.21.15.112:0/3176099888 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cac033e50 con 0x7f8cbc06f600 2024-09-12T02:43:37.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.815+0000 7f8cb2a00640 1 -- 172.21.15.112:0/3176099888 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cac0469d0 con 0x7f8cbc06f600 2024-09-12T02:43:37.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.815+0000 7f8cc1200640 1 -- 172.21.15.112:0/3176099888 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cbc1f1620 con 0x7f8cbc06f600 2024-09-12T02:43:37.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.815+0000 7f8cc1200640 1 -- 172.21.15.112:0/3176099888 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cbc1f1be0 con 0x7f8cbc06f600 2024-09-12T02:43:37.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.816+0000 7f8cc1200640 1 -- 172.21.15.112:0/3176099888 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cbc06dbc0 con 0x7f8cbc06f600 2024-09-12T02:43:37.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.817+0000 7f8cb2a00640 1 -- 172.21.15.112:0/3176099888 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8cac04d060 con 0x7f8cbc06f600 2024-09-12T02:43:37.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.818+0000 7f8cb2a00640 1 --2- 172.21.15.112:0/3176099888 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8c9806be60 0x7f8c9806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:37.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.819+0000 7f8cb2a00640 1 -- 172.21.15.112:0/3176099888 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f8cac0ad630 con 0x7f8cbc06f600 2024-09-12T02:43:37.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.819+0000 7f8cb1400640 1 --2- 172.21.15.112:0/3176099888 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8c9806be60 0x7f8c9806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:37.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.819+0000 7f8cb2a00640 1 -- 172.21.15.112:0/3176099888 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=49}) -- 0x7f8c98073990 con 0x7f8cbc06f600 2024-09-12T02:43:37.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.819+0000 7f8cb1400640 1 --2- 172.21.15.112:0/3176099888 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8c9806be60 0x7f8c9806e320 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc15cdb0 tx=0x7f8ca4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:37.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:37.823+0000 7f8cb2a00640 1 -- 172.21.15.112:0/3176099888 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8cac041070 con 0x7f8cbc06f600 2024-09-12T02:43:38.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.029+0000 7f8cc1200640 1 -- 172.21.15.112:0/3176099888 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8cbc15a930 con 0x7f8cbc06f600 2024-09-12T02:43:38.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.030+0000 7f8cb2a00640 1 -- 172.21.15.112:0/3176099888 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5229 (secure 0 0 0) 0x7f8cac07bfd0 con 0x7f8cbc06f600 2024-09-12T02:43:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:38.031 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":27,"btime":"2024-09-12T02:43:20:337397+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5008,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/362211662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":362211662},{"type":"v1","addr":"172.21.15.112:6836","nonce":362211662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5011,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/193733805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":193733805},{"type":"v1","addr":"172.21.15.112:6837","nonce":193733805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/3440642333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3440642333},{"type":"v1","addr":"172.21.15.137:6834","nonce":3440642333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:43:16.722971+0000","modified":"2024-09-12T02:43:19.743614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"b","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/3597512060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3597512060},{"type":"v1","addr":"172.21.15.137:6835","nonce":3597512060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":3}]} 2024-09-12T02:43:38.031 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 27 2024-09-12T02:43:38.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.032+0000 7f8cc1200640 1 -- 172.21.15.112:0/3176099888 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8c9806be60 msgr2=0x7f8c9806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:38.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.032+0000 7f8cc1200640 1 --2- 172.21.15.112:0/3176099888 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8c9806be60 0x7f8c9806e320 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc15cdb0 tx=0x7f8ca4009040 comp rx=0 tx=0).stop 2024-09-12T02:43:38.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.032+0000 7f8cc1200640 1 -- 172.21.15.112:0/3176099888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cbc06f600 msgr2=0x7f8cbc1548f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:38.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.032+0000 7f8cc1200640 1 --2- 172.21.15.112:0/3176099888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cbc06f600 0x7f8cbc1548f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8cac02c8f0 tx=0x7f8cac0046c0 comp rx=0 tx=0).stop 2024-09-12T02:43:38.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.032+0000 7f8cc1200640 1 -- 172.21.15.112:0/3176099888 shutdown_connections 2024-09-12T02:43:38.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.032+0000 7f8cc1200640 1 --2- 172.21.15.112:0/3176099888 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8c9806be60 0x7f8c9806e320 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:38.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.032+0000 7f8cc1200640 1 --2- 172.21.15.112:0/3176099888 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8cbc15b9d0 0x7f8cbc15c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:38.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.032+0000 7f8cc1200640 1 --2- 172.21.15.112:0/3176099888 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8cbc0b45d0 0x7f8cbc1412b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:38.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.032+0000 7f8cc1200640 1 --2- 172.21.15.112:0/3176099888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cbc06f600 0x7f8cbc1548f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:38.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.032+0000 7f8cc1200640 1 -- 172.21.15.112:0/3176099888 >> 172.21.15.112:0/3176099888 conn(0x7f8cbc06bbd0 msgr2=0x7f8cbc0d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:38.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.032+0000 7f8cc1200640 1 -- 172.21.15.112:0/3176099888 shutdown_connections 2024-09-12T02:43:38.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.032+0000 7f8cc1200640 1 -- 172.21.15.112:0/3176099888 wait complete. 2024-09-12T02:43:38.048 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2024-09-12T02:43:38.233 INFO:teuthology.orchestra.run.smithi137.stdout:{"cluster_fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","whoami":0,"id":5017,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":20.890100603,"mdsmap_epoch":27,"osdmap_epoch":48,"osdmap_epoch_barrier":48,"uptime":25.291563916000001} 2024-09-12T02:43:38.234 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", "fs_name": "cephfs", "id": 5017, "mdsmap_epoch": 27, "osdmap_epoch": 48, "osdmap_epoch_barrier": 48, "rank_uptime": 20.890100603, "state": "up:active", "uptime": 25.291563916, "want_state": "up:active", "whoami": 0 } 2024-09-12T02:43:38.234 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:43:38.234 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:43:38.234 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:43:38.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:43:38.270 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2024-09-12T02:43:38.344 INFO:teuthology.orchestra.run.smithi112.stderr:dd: failed to open 'small_file_1': Permission denied 2024-09-12T02:43:38.345 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:43:38.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:43:38.346 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2024-09-12T02:43:38.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:43:38.424 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2024-09-12T02:43:38.556 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-12T02:43:38.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.707+0000 7f3a6b200640 1 Processor -- start 2024-09-12T02:43:38.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.708+0000 7f3a6b200640 1 -- start start 2024-09-12T02:43:38.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.709+0000 7f3a6b200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3a6415ed60 0x7f3a6406d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:38.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.709+0000 7f3a6b200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3a640b74b0 0x7f3a640b7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:38.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.709+0000 7f3a6b200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a640b3000 con 0x7f3a6406da10 2024-09-12T02:43:38.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.709+0000 7f3a6b200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f3a6406de60 con 0x7f3a6415ed60 2024-09-12T02:43:38.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.709+0000 7f3a6b200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3a640b3c10 con 0x7f3a640b74b0 2024-09-12T02:43:38.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.709+0000 7f3a69e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3a6415ed60 0x7f3a6406d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:38.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.709+0000 7f3a69e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3a6415ed60 0x7f3a6406d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53566/0 (socket says 172.21.15.112:53566) 2024-09-12T02:43:38.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.709+0000 7f3a69e00640 1 -- 172.21.15.112:0/3785259517 learned_addr learned my addr 172.21.15.112:0/3785259517 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:38.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.709+0000 7f3a69400640 1 --1- 172.21.15.112:0/3785259517 >> v1:172.21.15.112:6789/0 conn(0x7f3a6406da10 0x7f3a640af900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33416/0 (socket says 172.21.15.112:33416) 2024-09-12T02:43:38.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.710+0000 7f3a6a800640 1 --2- 172.21.15.112:0/3785259517 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3a640b74b0 0x7f3a640b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:38.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.710+0000 7f3a69e00640 1 -- 172.21.15.112:0/3785259517 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3a640b74b0 msgr2=0x7f3a640b7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:38.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.710+0000 7f3a69e00640 1 --2- 172.21.15.112:0/3785259517 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3a640b74b0 0x7f3a640b7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:38.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.710+0000 7f3a69e00640 1 -- 172.21.15.112:0/3785259517 >> v1:172.21.15.112:6789/0 conn(0x7f3a6406da10 legacy=0x7f3a640af900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:38.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.710+0000 7f3a69e00640 1 -- 172.21.15.112:0/3785259517 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a640b32e0 con 0x7f3a6415ed60 2024-09-12T02:43:38.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.710+0000 7f3a6a800640 1 --2- 172.21.15.112:0/3785259517 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3a640b74b0 0x7f3a640b7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:43:38.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.711+0000 7f3a69e00640 1 --2- 172.21.15.112:0/3785259517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a6415ed60 0x7f3a6406d4d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009870 tx=0x7f3a5802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34451e93faa14bb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:38.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.711+0000 7f3a68a00640 1 -- 172.21.15.112:0/3785259517 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a58037070 con 0x7f3a6415ed60 2024-09-12T02:43:38.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.711+0000 7f3a68a00640 1 -- 172.21.15.112:0/3785259517 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a58032440 con 0x7f3a6415ed60 2024-09-12T02:43:38.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.711+0000 7f3a68a00640 1 -- 172.21.15.112:0/3785259517 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a58032810 con 0x7f3a6415ed60 2024-09-12T02:43:38.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.711+0000 7f3a6b200640 1 -- 172.21.15.112:0/3785259517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a6415ed60 msgr2=0x7f3a6406d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:38.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.711+0000 7f3a6b200640 1 --2- 172.21.15.112:0/3785259517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a6415ed60 0x7f3a6406d4d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009870 tx=0x7f3a5802a250 comp rx=0 tx=0).stop 2024-09-12T02:43:38.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.711+0000 7f3a6b200640 1 -- 172.21.15.112:0/3785259517 shutdown_connections 2024-09-12T02:43:38.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.711+0000 7f3a6b200640 1 --2- 172.21.15.112:0/3785259517 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3a640b74b0 0x7f3a640b7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:38.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.712+0000 7f3a6b200640 1 --2- 172.21.15.112:0/3785259517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a6415ed60 0x7f3a6406d4d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:38.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.712+0000 7f3a6b200640 1 -- 172.21.15.112:0/3785259517 >> 172.21.15.112:0/3785259517 conn(0x7f3a640b7e80 msgr2=0x7f3a640b8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:38.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.712+0000 7f3a6b200640 1 -- 172.21.15.112:0/3785259517 shutdown_connections 2024-09-12T02:43:38.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.712+0000 7f3a6b200640 1 -- 172.21.15.112:0/3785259517 wait complete. 2024-09-12T02:43:38.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.713+0000 7f3a6b200640 1 Processor -- start 2024-09-12T02:43:38.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.713+0000 7f3a6b200640 1 -- start start 2024-09-12T02:43:38.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.714+0000 7f3a6b200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3a6406da10 0x7f3a6414c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:38.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.714+0000 7f3a6b200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a640b74b0 0x7f3a640cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:38.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.714+0000 7f3a6b200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a6415ed60 0x7f3a640cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:38.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.714+0000 7f3a6b200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6406e270 con 0x7f3a640b74b0 2024-09-12T02:43:38.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.714+0000 7f3a6b200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3a640b38a0 con 0x7f3a6415ed60 2024-09-12T02:43:38.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.714+0000 7f3a6b200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3a640b40a0 con 0x7f3a6406da10 2024-09-12T02:43:38.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.714+0000 7f3a69400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a640b74b0 0x7f3a640cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:38.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.714+0000 7f3a69400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a640b74b0 0x7f3a640cbce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53582/0 (socket says 172.21.15.112:53582) 2024-09-12T02:43:38.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.714+0000 7f3a69400640 1 -- 172.21.15.112:0/4106374348 learned_addr learned my addr 172.21.15.112:0/4106374348 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:38.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.715+0000 7f3a69400640 1 -- 172.21.15.112:0/4106374348 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3a6406da10 msgr2=0x7f3a6414c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:38.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.715+0000 7f3a69400640 1 --2- 172.21.15.112:0/4106374348 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3a6406da10 0x7f3a6414c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:38.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.715+0000 7f3a69400640 1 -- 172.21.15.112:0/4106374348 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a6415ed60 msgr2=0x7f3a640cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:38.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.715+0000 7f3a69400640 1 --2- 172.21.15.112:0/4106374348 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a6415ed60 0x7f3a640cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:38.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.715+0000 7f3a69400640 1 -- 172.21.15.112:0/4106374348 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a640cce80 con 0x7f3a640b74b0 2024-09-12T02:43:38.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.715+0000 7f3a69400640 1 --2- 172.21.15.112:0/4106374348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a640b74b0 0x7f3a640cbce0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3a5400c400 tx=0x7f3a5400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:38.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.715+0000 7f3a5e000640 1 -- 172.21.15.112:0/4106374348 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a540074e0 con 0x7f3a640b74b0 2024-09-12T02:43:38.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.715+0000 7f3a5e000640 1 -- 172.21.15.112:0/4106374348 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a54007680 con 0x7f3a640b74b0 2024-09-12T02:43:38.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.715+0000 7f3a5e000640 1 -- 172.21.15.112:0/4106374348 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a54004a00 con 0x7f3a640b74b0 2024-09-12T02:43:38.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.715+0000 7f3a6b200640 1 -- 172.21.15.112:0/4106374348 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a640cc5e0 con 0x7f3a640b74b0 2024-09-12T02:43:38.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.715+0000 7f3a6b200640 1 -- 172.21.15.112:0/4106374348 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a640ccba0 con 0x7f3a640b74b0 2024-09-12T02:43:38.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.716+0000 7f3a6b200640 1 -- 172.21.15.112:0/4106374348 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a6415f140 con 0x7f3a640b74b0 2024-09-12T02:43:38.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.717+0000 7f3a5e000640 1 -- 172.21.15.112:0/4106374348 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3a5401a020 con 0x7f3a640b74b0 2024-09-12T02:43:38.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.718+0000 7f3a5e000640 1 --2- 172.21.15.112:0/4106374348 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3a4806be30 0x7f3a4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:38.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.718+0000 7f3a5e000640 1 -- 172.21.15.112:0/4106374348 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f3a5408a760 con 0x7f3a640b74b0 2024-09-12T02:43:38.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.718+0000 7f3a5e000640 1 -- 172.21.15.112:0/4106374348 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=49}) -- 0x7f3a48073960 con 0x7f3a640b74b0 2024-09-12T02:43:38.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.718+0000 7f3a69e00640 1 --2- 172.21.15.112:0/4106374348 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3a4806be30 0x7f3a4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:38.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.719+0000 7f3a69e00640 1 --2- 172.21.15.112:0/4106374348 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3a4806be30 0x7f3a4806e2f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3a58034000 tx=0x7f3a5802c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:38.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.723+0000 7f3a5e000640 1 -- 172.21.15.112:0/4106374348 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3a54059070 con 0x7f3a640b74b0 2024-09-12T02:43:38.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.898+0000 7f3a6b200640 1 -- 172.21.15.112:0/4106374348 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f3a64070b40 con 0x7f3a640b74b0 2024-09-12T02:43:38.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.900+0000 7f3a5e000640 1 -- 172.21.15.112:0/4106374348 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v48) ==== 81+0+34395 (secure 0 0 0) 0x7f3a54058970 con 0x7f3a640b74b0 2024-09-12T02:43:38.901 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:38.901 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:43:38.901 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 48, 2024-09-12T02:43:38.902 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:43:38.902 INFO:teuthology.orchestra.run.smithi112.stdout: "created": "2024-09-12T02:41:36.162095+0000", 2024-09-12T02:43:38.902 INFO:teuthology.orchestra.run.smithi112.stdout: "modified": "2024-09-12T02:43:37.107451+0000", 2024-09-12T02:43:38.902 INFO:teuthology.orchestra.run.smithi112.stdout: "last_up_change": "2024-09-12T02:41:42.191169+0000", 2024-09-12T02:43:38.902 INFO:teuthology.orchestra.run.smithi112.stdout: "last_in_change": "2024-09-12T02:41:39.036600+0000", 2024-09-12T02:43:38.902 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:43:38.902 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_num": 5799936, 2024-09-12T02:43:38.902 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_set": [ 2024-09-12T02:43:38.902 INFO:teuthology.orchestra.run.smithi112.stdout: "pglog_hardlimit", 2024-09-12T02:43:38.903 INFO:teuthology.orchestra.run.smithi112.stdout: "purged_snapdirs", 2024-09-12T02:43:38.903 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_deletes", 2024-09-12T02:43:38.903 INFO:teuthology.orchestra.run.smithi112.stdout: "sortbitwise" 2024-09-12T02:43:38.903 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:38.903 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_version": 4, 2024-09-12T02:43:38.903 INFO:teuthology.orchestra.run.smithi112.stdout: "full_ratio": 0.69999998807907104, 2024-09-12T02:43:38.903 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-12T02:43:38.903 INFO:teuthology.orchestra.run.smithi112.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-12T02:43:38.903 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_snapshot": "", 2024-09-12T02:43:38.903 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_max": 7, 2024-09-12T02:43:38.903 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd": 8, 2024-09-12T02:43:38.903 INFO:teuthology.orchestra.run.smithi112.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:43:38.903 INFO:teuthology.orchestra.run.smithi112.stdout: "min_compat_client": "jewel", 2024-09-12T02:43:38.904 INFO:teuthology.orchestra.run.smithi112.stdout: "require_osd_release": "squid", 2024-09-12T02:43:38.904 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_crimson": false, 2024-09-12T02:43:38.904 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-12T02:43:38.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.904 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 1, 2024-09-12T02:43:38.904 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": ".mgr", 2024-09-12T02:43:38.904 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:41:43.011599+0000", 2024-09-12T02:43:38.904 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 3, 2024-09-12T02:43:38.904 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full", 2024-09-12T02:43:38.904 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:43:38.904 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:43:38.904 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:43:38.904 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:43:38.905 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:43:38.905 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:43:38.905 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:43:38.905 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:43:38.905 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:43:38.905 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:43:38.905 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:43:38.905 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 1, 2024-09-12T02:43:38.905 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 1, 2024-09-12T02:43:38.905 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 1, 2024-09-12T02:43:38.905 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 1, 2024-09-12T02:43:38.905 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 1, 2024-09-12T02:43:38.905 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:43:38.906 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:43:38.906 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:43:38.906 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:43:38.906 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:43:38.906 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:43:38.906 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:43:38.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.906 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "46", 2024-09-12T02:43:38.906 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:43:38.906 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:43:38.906 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:43:38.906 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:43:38.907 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:43:38.907 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:43:38.907 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:43:38.907 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:43:38.907 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:43:38.907 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:43:38.907 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:43:38.907 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:43:38.907 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:43:38.907 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:43:38.907 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:43:38.907 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:43:38.907 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:43:38.908 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:43:38.908 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:43:38.908 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:43:38.908 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:43:38.908 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:43:38.908 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:43:38.908 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:43:38.908 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:43:38.908 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:43:38.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.908 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:43:38.908 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:43:38.908 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:43:38.909 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:43:38.909 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:43:38.909 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:43:38.909 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:43:38.909 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:43:38.909 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:43:38.909 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:43:38.909 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:43:38.909 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:43:38.909 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_max": 32, 2024-09-12T02:43:38.909 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 1 2024-09-12T02:43:38.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.909 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:43:38.910 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": {} 2024-09-12T02:43:38.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.910 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:43:38.910 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:43:38.910 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 8, 2024-09-12T02:43:38.910 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 8, 2024-09-12T02:43:38.910 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 0.25, 2024-09-12T02:43:38.910 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:43:38.910 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:43:38.910 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:43:38.910 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:43:38.910 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:43:38.910 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.911 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 6, 2024-09-12T02:43:38.911 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:43:38.911 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:43:14.483471+0000", 2024-09-12T02:43:38.911 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 3, 2024-09-12T02:43:38.911 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full", 2024-09-12T02:43:38.911 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:43:38.911 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:43:38.911 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:43:38.911 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:43:38.911 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:43:38.912 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:43:38.912 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:43:38.912 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:43:38.912 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:43:38.912 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:43:38.912 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:43:38.912 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 32, 2024-09-12T02:43:38.912 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 32, 2024-09-12T02:43:38.912 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 32, 2024-09-12T02:43:38.912 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 32, 2024-09-12T02:43:38.912 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 32, 2024-09-12T02:43:38.912 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:43:38.912 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:43:38.913 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:43:38.913 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:43:38.913 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:43:38.913 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:43:38.913 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:43:38.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.913 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "46", 2024-09-12T02:43:38.913 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:43:38.913 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:43:38.913 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:43:38.913 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:43:38.913 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:43:38.913 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:43:38.913 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:43:38.914 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:43:38.914 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:43:38.914 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:43:38.914 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:43:38.914 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:43:38.914 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:43:38.914 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:43:38.914 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:43:38.914 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:43:38.914 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:43:38.914 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:43:38.914 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:43:38.914 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:43:38.914 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:43:38.915 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:43:38.915 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:43:38.915 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:43:38.915 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:43:38.915 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:43:38.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.915 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:43:38.915 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:43:38.915 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:43:38.915 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:43:38.915 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:43:38.915 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:43:38.915 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:43:38.915 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:43:38.916 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:43:38.916 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:43:38.916 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:43:38.916 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:43:38.916 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:43:38.916 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 16, 2024-09-12T02:43:38.916 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_priority": 5 2024-09-12T02:43:38.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.916 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:43:38.916 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:43:38.916 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": "cephfs" 2024-09-12T02:43:38.916 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.916 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:43:38.917 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:43:38.917 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.75, 2024-09-12T02:43:38.917 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.75, 2024-09-12T02:43:38.917 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:43:38.917 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.75, 2024-09-12T02:43:38.917 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.75, 2024-09-12T02:43:38.917 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:43:38.917 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:43:38.917 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:43:38.917 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.917 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 7, 2024-09-12T02:43:38.918 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_data", 2024-09-12T02:43:38.918 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:43:15.711619+0000", 2024-09-12T02:43:38.918 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 3, 2024-09-12T02:43:38.918 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full", 2024-09-12T02:43:38.918 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:43:38.918 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:43:38.918 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:43:38.918 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:43:38.918 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:43:38.918 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:43:38.918 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:43:38.918 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:43:38.918 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:43:38.919 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:43:38.919 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:43:38.919 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 64, 2024-09-12T02:43:38.919 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 64, 2024-09-12T02:43:38.919 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 64, 2024-09-12T02:43:38.919 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 64, 2024-09-12T02:43:38.919 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 64, 2024-09-12T02:43:38.919 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:43:38.919 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:43:38.919 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:43:38.919 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:43:38.919 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:43:38.919 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:43:38.920 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:43:38.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.920 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "46", 2024-09-12T02:43:38.920 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:43:38.920 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:43:38.920 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:43:38.920 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:43:38.920 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:43:38.920 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:43:38.920 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:43:38.920 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:43:38.920 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:43:38.920 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:43:38.921 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:43:38.921 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:43:38.921 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:43:38.921 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:43:38.921 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:43:38.921 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:43:38.921 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:43:38.921 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:43:38.921 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:43:38.921 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:43:38.921 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:43:38.921 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:43:38.921 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:43:38.922 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:43:38.922 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:43:38.922 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:43:38.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.922 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:43:38.922 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:43:38.922 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:43:38.922 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:43:38.922 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:43:38.922 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:43:38.922 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:43:38.922 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:43:38.922 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:43:38.922 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:43:38.923 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:43:38.923 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:43:38.923 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 64, 2024-09-12T02:43:38.923 INFO:teuthology.orchestra.run.smithi112.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:43:38.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.923 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:43:38.923 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:43:38.923 INFO:teuthology.orchestra.run.smithi112.stdout: "data": "cephfs" 2024-09-12T02:43:38.923 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.923 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:43:38.923 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:43:38.923 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.75, 2024-09-12T02:43:38.924 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.75, 2024-09-12T02:43:38.924 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:43:38.924 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.75, 2024-09-12T02:43:38.924 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.75, 2024-09-12T02:43:38.924 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:43:38.924 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:43:38.924 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:43:38.924 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.924 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.924 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:38.924 INFO:teuthology.orchestra.run.smithi112.stdout: "osds": [ 2024-09-12T02:43:38.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.924 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:43:38.925 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:38.925 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:38.925 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:38.925 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:38.925 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:38.925 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:38.925 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:38.925 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:38.925 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:38.925 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:38.925 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:38.925 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:38.925 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.926 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.926 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6800", 2024-09-12T02:43:38.926 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:38.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.926 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.926 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6801", 2024-09-12T02:43:38.926 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:38.926 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.926 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.926 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:38.926 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.927 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.927 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6802", 2024-09-12T02:43:38.927 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:38.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.927 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.927 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6803", 2024-09-12T02:43:38.927 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:38.927 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.927 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.927 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:38.927 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.928 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.928 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6806", 2024-09-12T02:43:38.928 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:38.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.928 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.928 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6807", 2024-09-12T02:43:38.928 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:38.928 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.928 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.928 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:38.928 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.929 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.929 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6804", 2024-09-12T02:43:38.929 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:38.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.929 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.929 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6805", 2024-09-12T02:43:38.929 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:38.929 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.929 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.929 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6801/821571304", 2024-09-12T02:43:38.930 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6803/821571304", 2024-09-12T02:43:38.930 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6807/821571304", 2024-09-12T02:43:38.930 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6805/821571304", 2024-09-12T02:43:38.930 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:38.930 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:38.930 INFO:teuthology.orchestra.run.smithi112.stdout: "full", 2024-09-12T02:43:38.930 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:38.930 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.930 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:43:38.930 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:38.930 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:38.930 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:38.930 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:38.931 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:38.931 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:38.931 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:38.931 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:38.931 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:38.931 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:38.931 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:38.931 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:38.931 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.932 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.932 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6808", 2024-09-12T02:43:38.932 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:38.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.932 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.932 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6809", 2024-09-12T02:43:38.932 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:38.932 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.932 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.932 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:38.933 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.933 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.933 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6810", 2024-09-12T02:43:38.933 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:38.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.933 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.933 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6811", 2024-09-12T02:43:38.933 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:38.933 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.933 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.933 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:38.934 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.934 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.934 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6814", 2024-09-12T02:43:38.934 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:38.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.934 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.934 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6815", 2024-09-12T02:43:38.934 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:38.934 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.934 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.934 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:38.935 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.935 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.935 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6812", 2024-09-12T02:43:38.935 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:38.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.935 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.935 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6813", 2024-09-12T02:43:38.935 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:38.935 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.935 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.935 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6809/2642068641", 2024-09-12T02:43:38.936 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6811/2642068641", 2024-09-12T02:43:38.936 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6815/2642068641", 2024-09-12T02:43:38.936 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6813/2642068641", 2024-09-12T02:43:38.936 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:38.936 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:38.936 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:38.936 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.936 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:43:38.936 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:38.936 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:38.936 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:38.937 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:38.937 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:38.937 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:38.937 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:38.937 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:38.937 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:38.937 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:38.937 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:38.937 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:38.937 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.937 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.937 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6816", 2024-09-12T02:43:38.938 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:38.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.938 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.938 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6817", 2024-09-12T02:43:38.938 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:38.938 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.938 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.938 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:38.938 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.938 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.938 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6818", 2024-09-12T02:43:38.939 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:38.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.939 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.939 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6819", 2024-09-12T02:43:38.939 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:38.939 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.939 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.939 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:38.939 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.939 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.940 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6822", 2024-09-12T02:43:38.940 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:38.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.940 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.940 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6823", 2024-09-12T02:43:38.940 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:38.940 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.940 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.940 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:38.940 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.941 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.941 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6820", 2024-09-12T02:43:38.941 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:38.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.941 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.941 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6821", 2024-09-12T02:43:38.941 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:38.941 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.941 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.941 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6817/3365688807", 2024-09-12T02:43:38.941 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6819/3365688807", 2024-09-12T02:43:38.941 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6823/3365688807", 2024-09-12T02:43:38.942 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6821/3365688807", 2024-09-12T02:43:38.942 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:38.942 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:38.942 INFO:teuthology.orchestra.run.smithi112.stdout: "full", 2024-09-12T02:43:38.942 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:38.942 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.942 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:43:38.942 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:38.942 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:38.942 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:38.942 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:38.943 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:38.943 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:38.943 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:38.943 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:38.943 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:38.943 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:38.943 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:38.943 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:38.943 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.943 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.943 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6824", 2024-09-12T02:43:38.943 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:38.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.944 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.944 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6825", 2024-09-12T02:43:38.944 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:38.944 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.944 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.944 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:38.944 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.944 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.944 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6826", 2024-09-12T02:43:38.945 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:38.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.945 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.945 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6827", 2024-09-12T02:43:38.945 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:38.945 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.945 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.945 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:38.945 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.945 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.946 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6830", 2024-09-12T02:43:38.946 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:38.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.946 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.946 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6831", 2024-09-12T02:43:38.946 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:38.946 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.946 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.947 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:38.947 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.947 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.947 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6828", 2024-09-12T02:43:38.947 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:38.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.947 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.947 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6829", 2024-09-12T02:43:38.947 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:38.947 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.948 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.948 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6825/231774278", 2024-09-12T02:43:38.948 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6827/231774278", 2024-09-12T02:43:38.948 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6831/231774278", 2024-09-12T02:43:38.948 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6829/231774278", 2024-09-12T02:43:38.948 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:38.948 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull", 2024-09-12T02:43:38.948 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:38.948 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:38.948 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.949 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:43:38.949 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:38.949 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:38.949 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:38.949 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:38.949 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:38.949 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:38.949 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:38.949 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:38.949 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:38.949 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:38.949 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:38.949 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:38.950 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.950 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.950 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6800", 2024-09-12T02:43:38.950 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:38.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.950 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.950 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6801", 2024-09-12T02:43:38.950 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:38.950 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.950 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.950 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:38.951 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.951 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.951 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6802", 2024-09-12T02:43:38.951 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:38.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.951 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.951 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6803", 2024-09-12T02:43:38.951 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:38.951 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.951 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.951 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:38.952 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.952 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.952 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6806", 2024-09-12T02:43:38.952 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:38.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.952 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.952 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6807", 2024-09-12T02:43:38.952 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:38.952 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.952 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.953 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:38.953 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.953 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.953 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6804", 2024-09-12T02:43:38.953 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:38.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.953 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.953 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6805", 2024-09-12T02:43:38.953 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:38.953 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.953 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.954 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6801/3671178153", 2024-09-12T02:43:38.954 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6803/3671178153", 2024-09-12T02:43:38.954 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6807/3671178153", 2024-09-12T02:43:38.954 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6805/3671178153", 2024-09-12T02:43:38.954 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:38.954 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:38.954 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:38.954 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.954 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:43:38.954 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:38.954 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:38.954 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:38.955 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:38.955 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:38.955 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:38.955 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:38.955 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:38.955 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:38.955 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:38.955 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:38.955 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:38.955 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.955 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.955 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6808", 2024-09-12T02:43:38.955 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:38.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.956 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.956 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6809", 2024-09-12T02:43:38.956 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:38.956 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.956 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.956 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:38.956 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.956 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.957 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6810", 2024-09-12T02:43:38.957 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:38.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.957 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.957 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.957 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6811", 2024-09-12T02:43:38.957 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:38.957 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.957 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.957 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:38.957 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.957 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.958 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.958 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6817", 2024-09-12T02:43:38.958 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:38.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.958 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.958 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6819", 2024-09-12T02:43:38.958 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:38.958 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.958 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.958 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:38.958 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.958 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.959 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6812", 2024-09-12T02:43:38.959 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:38.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.959 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.959 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6815", 2024-09-12T02:43:38.959 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:38.959 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.959 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.959 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6809/3193706134", 2024-09-12T02:43:38.959 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6811/3193706134", 2024-09-12T02:43:38.959 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6819/3193706134", 2024-09-12T02:43:38.959 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6815/3193706134", 2024-09-12T02:43:38.959 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:38.960 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:38.960 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:38.960 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.960 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:43:38.960 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:38.960 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:38.960 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:38.960 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:38.960 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:38.960 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:38.960 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:38.960 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:38.961 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:38.961 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:38.961 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:38.961 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:38.961 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.961 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.961 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6813", 2024-09-12T02:43:38.961 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:38.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.961 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.961 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6814", 2024-09-12T02:43:38.962 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:38.962 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.962 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.962 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:38.962 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.962 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.962 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6816", 2024-09-12T02:43:38.962 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:38.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.962 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.962 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6818", 2024-09-12T02:43:38.963 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:38.963 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.963 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.963 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.963 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:38.963 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.963 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.963 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.963 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6822", 2024-09-12T02:43:38.963 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:38.963 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.963 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.963 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.963 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6823", 2024-09-12T02:43:38.963 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:38.964 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.964 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.964 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.964 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:38.964 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.964 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.964 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.964 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6820", 2024-09-12T02:43:38.964 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:38.964 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.964 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.964 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.964 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6821", 2024-09-12T02:43:38.965 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:38.965 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.965 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.965 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6814/3738813293", 2024-09-12T02:43:38.965 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6818/3738813293", 2024-09-12T02:43:38.965 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6823/3738813293", 2024-09-12T02:43:38.965 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6821/3738813293", 2024-09-12T02:43:38.965 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:38.965 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:38.965 INFO:teuthology.orchestra.run.smithi112.stdout: "full", 2024-09-12T02:43:38.965 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:38.965 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.966 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.966 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:43:38.966 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:38.966 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:38.966 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:38.966 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:38.966 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:38.966 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:38.966 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:38.966 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:38.966 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:38.966 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:38.966 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:38.966 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:38.967 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.967 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.967 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6824", 2024-09-12T02:43:38.967 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:38.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.967 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.967 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6825", 2024-09-12T02:43:38.967 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:38.967 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.967 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.968 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:38.968 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.968 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.968 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6826", 2024-09-12T02:43:38.968 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:38.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.968 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.968 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6827", 2024-09-12T02:43:38.968 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:38.968 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.968 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.969 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:38.969 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.969 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.969 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6830", 2024-09-12T02:43:38.969 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:38.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.969 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.969 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6831", 2024-09-12T02:43:38.969 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:38.969 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.969 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.970 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:38.970 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:38.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.970 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:38.970 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6828", 2024-09-12T02:43:38.970 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:38.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.970 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:38.970 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6829", 2024-09-12T02:43:38.970 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:38.970 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.971 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.971 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6825/1421932609", 2024-09-12T02:43:38.971 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6827/1421932609", 2024-09-12T02:43:38.971 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6831/1421932609", 2024-09-12T02:43:38.971 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6829/1421932609", 2024-09-12T02:43:38.971 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:38.971 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:38.971 INFO:teuthology.orchestra.run.smithi112.stdout: "full", 2024-09-12T02:43:38.971 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:38.971 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:38.971 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.971 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:38.971 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_xinfo": [ 2024-09-12T02:43:38.972 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.972 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:43:38.972 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:38.972 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:38.972 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:38.972 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:38.972 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:38.972 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.220641+0000", 2024-09-12T02:43:38.972 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:38.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.972 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.972 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:43:38.972 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:38.972 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:38.973 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:38.973 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:38.973 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:38.973 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312574+0000", 2024-09-12T02:43:38.973 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:38.973 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.973 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.973 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:43:38.973 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:38.973 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:38.973 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:38.973 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:38.973 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:38.973 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.282771+0000", 2024-09-12T02:43:38.974 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:38.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.974 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:43:38.974 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:38.974 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:38.974 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:38.974 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:38.974 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:38.974 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.260478+0000", 2024-09-12T02:43:38.974 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:38.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.975 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:43:38.975 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:38.975 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:38.975 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:38.975 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:38.975 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:38.975 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.273397+0000", 2024-09-12T02:43:38.975 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:38.975 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.975 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.975 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:43:38.975 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:38.975 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:38.975 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:38.976 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:38.976 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:38.976 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312452+0000", 2024-09-12T02:43:38.976 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:38.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.976 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:43:38.976 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:38.976 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:38.976 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:38.976 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:38.976 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:38.976 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.308965+0000", 2024-09-12T02:43:38.977 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:38.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:38.977 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:43:38.977 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:38.977 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:38.977 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:38.977 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:38.977 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:38.977 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.337842+0000", 2024-09-12T02:43:38.977 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:38.977 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.977 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:38.977 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap": [], 2024-09-12T02:43:38.978 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_items": [], 2024-09-12T02:43:38.978 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_primaries": [], 2024-09-12T02:43:38.978 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_temp": [], 2024-09-12T02:43:38.978 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_temp": [], 2024-09-12T02:43:38.978 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklist": {}, 2024-09-12T02:43:38.978 INFO:teuthology.orchestra.run.smithi112.stdout: "range_blocklist": {}, 2024-09-12T02:43:38.978 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profiles": { 2024-09-12T02:43:38.978 INFO:teuthology.orchestra.run.smithi112.stdout: "default": { 2024-09-12T02:43:38.978 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-failure-domain": "osd", 2024-09-12T02:43:38.978 INFO:teuthology.orchestra.run.smithi112.stdout: "k": "2", 2024-09-12T02:43:38.978 INFO:teuthology.orchestra.run.smithi112.stdout: "m": "1", 2024-09-12T02:43:38.978 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin": "jerasure", 2024-09-12T02:43:38.978 INFO:teuthology.orchestra.run.smithi112.stdout: "technique": "reed_sol_van" 2024-09-12T02:43:38.978 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:38.979 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps_queue": [], 2024-09-12T02:43:38.979 INFO:teuthology.orchestra.run.smithi112.stdout: "new_removed_snaps": [], 2024-09-12T02:43:38.979 INFO:teuthology.orchestra.run.smithi112.stdout: "new_purged_snaps": [], 2024-09-12T02:43:38.979 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_node_flags": {}, 2024-09-12T02:43:38.979 INFO:teuthology.orchestra.run.smithi112.stdout: "device_class_flags": {}, 2024-09-12T02:43:38.979 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode": { 2024-09-12T02:43:38.979 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_enabled": false, 2024-09-12T02:43:38.979 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_bucket_count": 0, 2024-09-12T02:43:38.979 INFO:teuthology.orchestra.run.smithi112.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:43:38.979 INFO:teuthology.orchestra.run.smithi112.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:43:38.979 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_bucket": 0 2024-09-12T02:43:38.980 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:38.980 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:43:38.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.902+0000 7f3a6b200640 1 -- 172.21.15.112:0/4106374348 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3a4806be30 msgr2=0x7f3a4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:38.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.902+0000 7f3a6b200640 1 --2- 172.21.15.112:0/4106374348 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3a4806be30 0x7f3a4806e2f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3a58034000 tx=0x7f3a5802c000 comp rx=0 tx=0).stop 2024-09-12T02:43:38.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.902+0000 7f3a6b200640 1 -- 172.21.15.112:0/4106374348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a640b74b0 msgr2=0x7f3a640cbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:38.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.902+0000 7f3a6b200640 1 --2- 172.21.15.112:0/4106374348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a640b74b0 0x7f3a640cbce0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3a5400c400 tx=0x7f3a5400c8c0 comp rx=0 tx=0).stop 2024-09-12T02:43:38.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.902+0000 7f3a6b200640 1 -- 172.21.15.112:0/4106374348 shutdown_connections 2024-09-12T02:43:38.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.902+0000 7f3a6b200640 1 --2- 172.21.15.112:0/4106374348 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3a4806be30 0x7f3a4806e2f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:38.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.902+0000 7f3a6b200640 1 --2- 172.21.15.112:0/4106374348 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a6415ed60 0x7f3a640cdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:38.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.902+0000 7f3a6b200640 1 --2- 172.21.15.112:0/4106374348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a640b74b0 0x7f3a640cbce0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:38.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.902+0000 7f3a6b200640 1 --2- 172.21.15.112:0/4106374348 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3a6406da10 0x7f3a6414c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:38.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.902+0000 7f3a6b200640 1 -- 172.21.15.112:0/4106374348 >> 172.21.15.112:0/4106374348 conn(0x7f3a640b7e80 msgr2=0x7f3a6406f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:38.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.902+0000 7f3a6b200640 1 -- 172.21.15.112:0/4106374348 shutdown_connections 2024-09-12T02:43:38.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:38.902+0000 7f3a6b200640 1 -- 172.21.15.112:0/4106374348 wait complete. 2024-09-12T02:43:38.983 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-12T02:43:40.955 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-12T02:43:40.955+0000 7f0219e00640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2024-09-12T02:43:43.143 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-12T02:43:43.143+0000 7f0219e00640 -1 log_channel(cluster) log [ERR] : Health check failed: Full OSDs blocking recovery: 1 pg recovery_toofull (PG_RECOVERY_FULL) 2024-09-12T02:43:43.984 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-12T02:43:44.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.146+0000 7f53c4a00640 1 Processor -- start 2024-09-12T02:43:44.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.147+0000 7f53c4a00640 1 -- start start 2024-09-12T02:43:44.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.148+0000 7f53c4a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f53c00afe30 0x7f53c00cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:44.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.148+0000 7f53c4a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53c00ceeb0 con 0x7f53c0071530 2024-09-12T02:43:44.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.148+0000 7f53c4a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53c006e300 con 0x7f53c015cc50 2024-09-12T02:43:44.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.148+0000 7f53c4a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f53c015d030 con 0x7f53c00afe30 2024-09-12T02:43:44.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.148+0000 7f53b5400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f53c0071530 0x7f53c00af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:54742/0 (socket says 172.21.15.112:54742) 2024-09-12T02:43:44.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.148+0000 7f53b5400640 1 -- 172.21.15.112:0/745381687 learned_addr learned my addr 172.21.15.112:0/745381687 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:44.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.148+0000 7f53be800640 1 --2- 172.21.15.112:0/745381687 >> v2:172.21.15.112:3300/0 conn(0x7f53c00afe30 0x7f53c00cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:44.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.148+0000 7f53bd400640 1 -- 172.21.15.112:0/745381687 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2787224458 0 0) 0x7f53c00ceeb0 con 0x7f53c0071530 2024-09-12T02:43:44.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.148+0000 7f53bd400640 1 -- 172.21.15.112:0/745381687 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53a4003520 con 0x7f53c0071530 2024-09-12T02:43:44.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.149+0000 7f53be800640 1 -- 172.21.15.112:0/745381687 >> v1:172.21.15.137:6789/0 conn(0x7f53c015cc50 legacy=0x7f53c00732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:44.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.149+0000 7f53be800640 1 -- 172.21.15.112:0/745381687 >> v1:172.21.15.112:6789/0 conn(0x7f53c0071530 legacy=0x7f53c00af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:44.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.149+0000 7f53be800640 1 -- 172.21.15.112:0/745381687 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c006e5e0 con 0x7f53c00afe30 2024-09-12T02:43:44.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.150+0000 7f53be800640 1 --2- 172.21.15.112:0/745381687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53c00afe30 0x7f53c00cf950 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f53b8009d90 tx=0x7f53b802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5fcaa7646476627 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:44.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.153+0000 7f53bd400640 1 -- 172.21.15.112:0/745381687 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b8007740 con 0x7f53c00afe30 2024-09-12T02:43:44.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.153+0000 7f53bd400640 1 -- 172.21.15.112:0/745381687 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53b80078e0 con 0x7f53c00afe30 2024-09-12T02:43:44.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.153+0000 7f53bd400640 1 -- 172.21.15.112:0/745381687 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b8007cb0 con 0x7f53c00afe30 2024-09-12T02:43:44.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.153+0000 7f53c4a00640 1 -- 172.21.15.112:0/745381687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53c00afe30 msgr2=0x7f53c00cf950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:44.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.153+0000 7f53c4a00640 1 --2- 172.21.15.112:0/745381687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53c00afe30 0x7f53c00cf950 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f53b8009d90 tx=0x7f53b802a660 comp rx=0 tx=0).stop 2024-09-12T02:43:44.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.153+0000 7f53c4a00640 1 -- 172.21.15.112:0/745381687 shutdown_connections 2024-09-12T02:43:44.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.153+0000 7f53c4a00640 1 --2- 172.21.15.112:0/745381687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53c00afe30 0x7f53c00cf950 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:44.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.153+0000 7f53c4a00640 1 -- 172.21.15.112:0/745381687 >> 172.21.15.112:0/745381687 conn(0x7f53c006bbd0 msgr2=0x7f53c006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:44.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.153+0000 7f53c4a00640 1 -- 172.21.15.112:0/745381687 shutdown_connections 2024-09-12T02:43:44.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.153+0000 7f53c4a00640 1 -- 172.21.15.112:0/745381687 wait complete. 2024-09-12T02:43:44.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.156+0000 7f53c4a00640 1 Processor -- start 2024-09-12T02:43:44.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.157+0000 7f53c4a00640 1 -- start start 2024-09-12T02:43:44.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.158+0000 7f53c4a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53c0071530 0x7f53c014a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:44.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.158+0000 7f53c4a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f53c00afe30 0x7f53c015b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:44.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.158+0000 7f53c4a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53c015cc50 0x7f53c01f8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:44.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.158+0000 7f53c4a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f53c006f510 con 0x7f53c015cc50 2024-09-12T02:43:44.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.158+0000 7f53c4a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f53c00cf4c0 con 0x7f53c0071530 2024-09-12T02:43:44.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.158+0000 7f53c4a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f53c006f690 con 0x7f53c00afe30 2024-09-12T02:43:44.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.158+0000 7f53be800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53c015cc50 0x7f53c01f8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:44.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.158+0000 7f53be800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53c015cc50 0x7f53c01f8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47962/0 (socket says 172.21.15.112:47962) 2024-09-12T02:43:44.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.158+0000 7f53be800640 1 -- 172.21.15.112:0/3166840795 learned_addr learned my addr 172.21.15.112:0/3166840795 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:44.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.158+0000 7f53b5400640 1 --2- 172.21.15.112:0/3166840795 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f53c00afe30 0x7f53c015b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:44.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.158+0000 7f53bde00640 1 --2- 172.21.15.112:0/3166840795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53c0071530 0x7f53c014a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:44.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.159+0000 7f53be800640 1 -- 172.21.15.112:0/3166840795 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f53c00afe30 msgr2=0x7f53c015b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:44.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.159+0000 7f53be800640 1 --2- 172.21.15.112:0/3166840795 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f53c00afe30 0x7f53c015b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:44.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.159+0000 7f53be800640 1 -- 172.21.15.112:0/3166840795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53c0071530 msgr2=0x7f53c014a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:44.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.159+0000 7f53be800640 1 --2- 172.21.15.112:0/3166840795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53c0071530 0x7f53c014a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:44.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.159+0000 7f53be800640 1 -- 172.21.15.112:0/3166840795 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c015a950 con 0x7f53c015cc50 2024-09-12T02:43:44.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.159+0000 7f53be800640 1 --2- 172.21.15.112:0/3166840795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53c015cc50 0x7f53c01f8a40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f53b802ac50 tx=0x7f53b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:44.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.159+0000 7f53b6a00640 1 -- 172.21.15.112:0/3166840795 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b8040070 con 0x7f53c015cc50 2024-09-12T02:43:44.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.159+0000 7f53b6a00640 1 -- 172.21.15.112:0/3166840795 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53b8031bc0 con 0x7f53c015cc50 2024-09-12T02:43:44.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.159+0000 7f53c4a00640 1 -- 172.21.15.112:0/3166840795 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53c0150d60 con 0x7f53c015cc50 2024-09-12T02:43:44.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.159+0000 7f53b6a00640 1 -- 172.21.15.112:0/3166840795 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b8009450 con 0x7f53c015cc50 2024-09-12T02:43:44.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.160+0000 7f53c4a00640 1 -- 172.21.15.112:0/3166840795 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53c0151600 con 0x7f53c015cc50 2024-09-12T02:43:44.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.161+0000 7f53c4a00640 1 -- 172.21.15.112:0/3166840795 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53c0068a30 con 0x7f53c015cc50 2024-09-12T02:43:44.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.162+0000 7f53b6a00640 1 -- 172.21.15.112:0/3166840795 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f53b8039040 con 0x7f53c015cc50 2024-09-12T02:43:44.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.163+0000 7f53b6a00640 1 --2- 172.21.15.112:0/3166840795 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f539c06be30 0x7f539c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:44.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.163+0000 7f53b6a00640 1 -- 172.21.15.112:0/3166840795 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5767+0+0 (secure 0 0 0) 0x7f53b80ac5e0 con 0x7f53c015cc50 2024-09-12T02:43:44.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.163+0000 7f53bde00640 1 --2- 172.21.15.112:0/3166840795 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f539c06be30 0x7f539c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:44.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.163+0000 7f53b6a00640 1 -- 172.21.15.112:0/3166840795 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=53}) -- 0x7f539c073a20 con 0x7f53c015cc50 2024-09-12T02:43:44.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.164+0000 7f53bde00640 1 --2- 172.21.15.112:0/3166840795 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f539c06be30 0x7f539c06e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f53b00016e0 tx=0x7f53b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:44.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.167+0000 7f53b6a00640 1 -- 172.21.15.112:0/3166840795 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f53b807a860 con 0x7f53c015cc50 2024-09-12T02:43:44.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.343+0000 7f53c4a00640 1 -- 172.21.15.112:0/3166840795 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f53c00730d0 con 0x7f53c015cc50 2024-09-12T02:43:44.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.344+0000 7f53b6a00640 1 -- 172.21.15.112:0/3166840795 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v52) ==== 81+0+34714 (secure 0 0 0) 0x7f53b807eb60 con 0x7f53c015cc50 2024-09-12T02:43:44.345 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:44.345 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:43:44.345 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 52, 2024-09-12T02:43:44.345 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:43:44.345 INFO:teuthology.orchestra.run.smithi112.stdout: "created": "2024-09-12T02:41:36.162095+0000", 2024-09-12T02:43:44.345 INFO:teuthology.orchestra.run.smithi112.stdout: "modified": "2024-09-12T02:43:44.149364+0000", 2024-09-12T02:43:44.345 INFO:teuthology.orchestra.run.smithi112.stdout: "last_up_change": "2024-09-12T02:41:42.191169+0000", 2024-09-12T02:43:44.345 INFO:teuthology.orchestra.run.smithi112.stdout: "last_in_change": "2024-09-12T02:41:39.036600+0000", 2024-09-12T02:43:44.345 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:43:44.345 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_num": 5799936, 2024-09-12T02:43:44.345 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_set": [ 2024-09-12T02:43:44.345 INFO:teuthology.orchestra.run.smithi112.stdout: "pglog_hardlimit", 2024-09-12T02:43:44.345 INFO:teuthology.orchestra.run.smithi112.stdout: "purged_snapdirs", 2024-09-12T02:43:44.346 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_deletes", 2024-09-12T02:43:44.346 INFO:teuthology.orchestra.run.smithi112.stdout: "sortbitwise" 2024-09-12T02:43:44.346 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:44.346 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_version": 4, 2024-09-12T02:43:44.346 INFO:teuthology.orchestra.run.smithi112.stdout: "full_ratio": 0.69999998807907104, 2024-09-12T02:43:44.346 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-12T02:43:44.346 INFO:teuthology.orchestra.run.smithi112.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-12T02:43:44.346 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_snapshot": "", 2024-09-12T02:43:44.346 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_max": 7, 2024-09-12T02:43:44.346 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd": 8, 2024-09-12T02:43:44.346 INFO:teuthology.orchestra.run.smithi112.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:43:44.346 INFO:teuthology.orchestra.run.smithi112.stdout: "min_compat_client": "luminous", 2024-09-12T02:43:44.346 INFO:teuthology.orchestra.run.smithi112.stdout: "require_osd_release": "squid", 2024-09-12T02:43:44.347 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_crimson": false, 2024-09-12T02:43:44.347 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-12T02:43:44.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.347 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 1, 2024-09-12T02:43:44.347 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": ".mgr", 2024-09-12T02:43:44.347 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:41:43.011599+0000", 2024-09-12T02:43:44.347 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 3, 2024-09-12T02:43:44.347 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full", 2024-09-12T02:43:44.347 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:43:44.347 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:43:44.347 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:43:44.347 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:43:44.347 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:43:44.347 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:43:44.348 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:43:44.348 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:43:44.348 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:43:44.348 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:43:44.348 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:43:44.348 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 1, 2024-09-12T02:43:44.348 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 1, 2024-09-12T02:43:44.348 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 1, 2024-09-12T02:43:44.348 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 1, 2024-09-12T02:43:44.348 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 1, 2024-09-12T02:43:44.348 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:43:44.348 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:43:44.348 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:43:44.348 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:43:44.349 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:43:44.349 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:43:44.349 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:43:44.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.349 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "46", 2024-09-12T02:43:44.349 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:43:44.349 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:43:44.349 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:43:44.349 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:43:44.349 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:43:44.349 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:43:44.349 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:43:44.349 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:43:44.349 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:43:44.350 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:43:44.350 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:43:44.350 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:43:44.350 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:43:44.350 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:43:44.350 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:43:44.350 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:43:44.350 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:43:44.350 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:43:44.350 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:43:44.350 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:43:44.350 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:43:44.350 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:43:44.350 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:43:44.350 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:43:44.351 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:43:44.351 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:43:44.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.351 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:43:44.351 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:43:44.351 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:43:44.351 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:43:44.351 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:43:44.351 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:43:44.351 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:43:44.352 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:43:44.352 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:43:44.352 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:43:44.352 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:43:44.352 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:43:44.352 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_max": 32, 2024-09-12T02:43:44.352 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 1 2024-09-12T02:43:44.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.352 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:43:44.352 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": {} 2024-09-12T02:43:44.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.352 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:43:44.352 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:43:44.353 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 8, 2024-09-12T02:43:44.353 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 8, 2024-09-12T02:43:44.353 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 0.25, 2024-09-12T02:43:44.353 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:43:44.353 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:43:44.353 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:43:44.353 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:43:44.353 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:43:44.353 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.353 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 6, 2024-09-12T02:43:44.354 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:43:44.354 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:43:14.483471+0000", 2024-09-12T02:43:44.354 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 3, 2024-09-12T02:43:44.354 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full", 2024-09-12T02:43:44.354 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:43:44.354 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:43:44.354 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:43:44.354 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:43:44.354 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:43:44.354 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:43:44.354 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:43:44.354 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:43:44.354 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:43:44.354 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:43:44.355 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:43:44.355 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 32, 2024-09-12T02:43:44.355 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 32, 2024-09-12T02:43:44.355 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 32, 2024-09-12T02:43:44.355 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 32, 2024-09-12T02:43:44.355 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 32, 2024-09-12T02:43:44.355 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:43:44.355 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:43:44.355 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:43:44.355 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:43:44.356 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:43:44.356 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:43:44.356 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:43:44.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.356 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "46", 2024-09-12T02:43:44.356 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:43:44.356 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:43:44.356 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:43:44.356 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:43:44.356 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:43:44.356 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:43:44.356 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:43:44.356 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:43:44.356 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:43:44.357 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:43:44.357 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:43:44.357 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:43:44.357 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:43:44.357 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:43:44.357 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:43:44.357 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:43:44.357 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:43:44.357 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:43:44.357 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:43:44.357 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:43:44.357 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:43:44.357 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:43:44.357 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:43:44.358 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:43:44.358 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:43:44.358 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:43:44.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.358 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:43:44.358 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:43:44.358 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:43:44.358 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:43:44.358 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:43:44.358 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:43:44.358 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:43:44.358 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:43:44.358 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:43:44.358 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:43:44.359 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:43:44.359 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:43:44.359 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:43:44.359 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 16, 2024-09-12T02:43:44.359 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_priority": 5 2024-09-12T02:43:44.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.359 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:43:44.359 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:43:44.359 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": "cephfs" 2024-09-12T02:43:44.359 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.359 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:43:44.359 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:43:44.359 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.75, 2024-09-12T02:43:44.359 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.75, 2024-09-12T02:43:44.360 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:43:44.360 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.75, 2024-09-12T02:43:44.360 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.75, 2024-09-12T02:43:44.360 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:43:44.360 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:43:44.360 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:43:44.360 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.360 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 7, 2024-09-12T02:43:44.360 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_data", 2024-09-12T02:43:44.360 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:43:15.711619+0000", 2024-09-12T02:43:44.360 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 3, 2024-09-12T02:43:44.360 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full", 2024-09-12T02:43:44.361 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:43:44.361 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:43:44.361 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:43:44.361 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:43:44.361 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:43:44.361 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:43:44.361 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:43:44.361 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:43:44.361 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:43:44.361 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:43:44.361 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:43:44.361 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 64, 2024-09-12T02:43:44.361 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 64, 2024-09-12T02:43:44.361 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 64, 2024-09-12T02:43:44.362 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 64, 2024-09-12T02:43:44.362 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 64, 2024-09-12T02:43:44.362 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:43:44.362 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:43:44.362 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:43:44.362 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:43:44.362 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:43:44.364 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:43:44.364 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:43:44.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.364 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "46", 2024-09-12T02:43:44.364 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:43:44.364 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:43:44.364 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:43:44.364 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:43:44.364 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:43:44.364 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:43:44.364 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:43:44.364 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:43:44.365 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:43:44.365 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:43:44.365 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:43:44.365 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:43:44.365 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:43:44.365 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:43:44.365 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:43:44.365 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:43:44.365 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:43:44.365 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:43:44.365 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:43:44.365 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:43:44.365 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:43:44.365 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:43:44.366 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:43:44.366 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:43:44.366 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:43:44.366 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:43:44.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.366 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:43:44.366 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:43:44.366 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:43:44.366 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:43:44.366 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:43:44.366 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:43:44.366 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:43:44.366 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:43:44.366 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:43:44.367 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:43:44.367 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:43:44.367 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:43:44.367 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 64, 2024-09-12T02:43:44.367 INFO:teuthology.orchestra.run.smithi112.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:43:44.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.367 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:43:44.367 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:43:44.367 INFO:teuthology.orchestra.run.smithi112.stdout: "data": "cephfs" 2024-09-12T02:43:44.367 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.367 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:43:44.367 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:43:44.367 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.75, 2024-09-12T02:43:44.367 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.75, 2024-09-12T02:43:44.368 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:43:44.368 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.75, 2024-09-12T02:43:44.368 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.75, 2024-09-12T02:43:44.368 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:43:44.368 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:43:44.368 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:43:44.368 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.368 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.368 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:44.368 INFO:teuthology.orchestra.run.smithi112.stdout: "osds": [ 2024-09-12T02:43:44.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.368 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:43:44.368 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:44.368 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:44.369 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:44.369 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:44.369 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:44.369 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:44.369 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:44.369 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:44.369 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:44.369 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:44.369 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:44.369 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:44.369 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.369 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.369 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6800", 2024-09-12T02:43:44.370 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:44.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.370 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.370 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6801", 2024-09-12T02:43:44.370 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:44.370 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.370 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.370 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:44.370 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.370 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.370 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6802", 2024-09-12T02:43:44.371 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:44.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.371 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.371 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6803", 2024-09-12T02:43:44.371 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:44.371 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.371 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.371 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:44.371 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.371 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.371 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6806", 2024-09-12T02:43:44.371 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:44.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.372 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.372 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6807", 2024-09-12T02:43:44.372 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:44.372 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.372 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.372 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:44.373 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.373 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.373 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6804", 2024-09-12T02:43:44.373 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:44.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.373 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.373 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6805", 2024-09-12T02:43:44.373 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:44.373 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.373 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.373 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6801/821571304", 2024-09-12T02:43:44.373 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6803/821571304", 2024-09-12T02:43:44.374 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6807/821571304", 2024-09-12T02:43:44.374 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6805/821571304", 2024-09-12T02:43:44.374 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:44.374 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:44.374 INFO:teuthology.orchestra.run.smithi112.stdout: "full", 2024-09-12T02:43:44.374 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:44.374 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.374 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:43:44.375 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:44.375 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:44.375 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:44.375 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:44.375 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:44.375 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:44.375 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:44.375 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:44.375 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:44.375 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:44.375 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:44.375 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:44.375 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.376 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.376 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6808", 2024-09-12T02:43:44.376 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:44.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.376 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.376 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6809", 2024-09-12T02:43:44.376 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:44.376 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.376 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.377 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:44.377 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.377 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.377 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6810", 2024-09-12T02:43:44.377 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:44.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.377 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.377 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6811", 2024-09-12T02:43:44.377 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:44.377 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.377 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.378 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:44.378 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.378 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.378 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6814", 2024-09-12T02:43:44.378 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:44.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.378 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.378 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6815", 2024-09-12T02:43:44.379 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:44.379 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.379 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.379 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:44.379 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.379 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.379 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6812", 2024-09-12T02:43:44.379 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:44.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.380 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.380 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6813", 2024-09-12T02:43:44.380 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:44.380 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.380 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.380 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6809/2642068641", 2024-09-12T02:43:44.380 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6811/2642068641", 2024-09-12T02:43:44.380 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6815/2642068641", 2024-09-12T02:43:44.380 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6813/2642068641", 2024-09-12T02:43:44.380 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:44.380 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:44.380 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:44.380 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.381 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:43:44.381 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:44.381 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:44.381 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:44.381 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:44.381 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:44.381 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:44.381 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:44.381 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:44.381 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:44.381 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:44.381 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6816", 2024-09-12T02:43:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6817", 2024-09-12T02:43:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.383 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:44.383 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.383 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.383 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6818", 2024-09-12T02:43:44.383 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:44.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.383 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.384 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6819", 2024-09-12T02:43:44.384 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:44.384 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.384 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.384 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:44.384 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.384 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.384 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6822", 2024-09-12T02:43:44.384 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:44.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.384 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.385 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6823", 2024-09-12T02:43:44.385 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:44.385 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.385 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.385 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:44.385 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.385 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.385 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6820", 2024-09-12T02:43:44.385 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:44.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.386 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.386 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6821", 2024-09-12T02:43:44.386 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:44.386 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.386 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.386 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6817/3365688807", 2024-09-12T02:43:44.386 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6819/3365688807", 2024-09-12T02:43:44.386 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6823/3365688807", 2024-09-12T02:43:44.386 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6821/3365688807", 2024-09-12T02:43:44.386 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:44.386 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:44.386 INFO:teuthology.orchestra.run.smithi112.stdout: "full", 2024-09-12T02:43:44.387 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:44.387 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.387 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:43:44.387 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:44.387 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:44.387 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:44.387 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:44.387 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:44.387 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:44.387 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:44.387 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:44.387 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:44.387 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:44.388 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:44.388 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:44.388 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.388 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.388 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6824", 2024-09-12T02:43:44.388 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:44.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.388 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.388 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6825", 2024-09-12T02:43:44.388 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:44.389 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.389 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.389 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:44.389 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.389 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.389 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6826", 2024-09-12T02:43:44.389 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:44.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.390 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.390 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6827", 2024-09-12T02:43:44.390 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:44.390 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.390 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.390 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:44.390 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.390 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.390 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6830", 2024-09-12T02:43:44.390 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:44.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.391 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.391 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6831", 2024-09-12T02:43:44.391 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:44.391 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.391 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.391 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:44.391 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.391 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.391 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6828", 2024-09-12T02:43:44.391 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:44.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.391 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.392 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6829", 2024-09-12T02:43:44.392 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:44.392 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.392 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.392 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6825/231774278", 2024-09-12T02:43:44.392 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6827/231774278", 2024-09-12T02:43:44.392 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6831/231774278", 2024-09-12T02:43:44.392 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6829/231774278", 2024-09-12T02:43:44.392 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:44.392 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:44.392 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:44.392 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.393 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:43:44.393 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:44.393 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:44.393 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:44.393 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:44.393 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:44.393 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:44.393 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:44.393 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:44.393 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:44.393 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:44.393 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:44.393 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:44.394 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.394 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.394 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6800", 2024-09-12T02:43:44.394 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:44.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.394 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.394 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6801", 2024-09-12T02:43:44.394 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:44.394 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.394 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.394 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:44.395 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.395 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.395 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6802", 2024-09-12T02:43:44.395 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:44.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.395 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.395 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6803", 2024-09-12T02:43:44.395 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:44.395 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.395 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.395 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:44.396 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.396 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.396 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6806", 2024-09-12T02:43:44.396 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:44.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.396 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.396 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6807", 2024-09-12T02:43:44.396 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:44.396 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.396 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.397 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:44.397 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.397 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.397 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6804", 2024-09-12T02:43:44.397 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:44.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.397 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.397 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6805", 2024-09-12T02:43:44.397 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:44.397 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.397 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.398 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6801/3671178153", 2024-09-12T02:43:44.398 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6803/3671178153", 2024-09-12T02:43:44.398 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6807/3671178153", 2024-09-12T02:43:44.398 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6805/3671178153", 2024-09-12T02:43:44.398 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:44.398 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:44.398 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:44.398 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.398 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:43:44.398 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:44.398 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:44.399 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:44.399 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:44.399 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:44.399 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:44.399 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:44.399 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:44.399 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 49, 2024-09-12T02:43:44.399 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:44.399 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:44.399 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:44.399 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.399 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.399 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6808", 2024-09-12T02:43:44.399 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:44.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.400 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.400 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6809", 2024-09-12T02:43:44.400 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:44.400 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.400 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.400 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:44.400 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.400 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.400 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6810", 2024-09-12T02:43:44.400 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:44.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.401 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.401 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6811", 2024-09-12T02:43:44.401 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:44.401 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.401 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.401 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:44.401 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.401 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.401 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6817", 2024-09-12T02:43:44.401 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:44.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.402 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.402 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6819", 2024-09-12T02:43:44.402 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:44.402 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.402 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.402 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:44.402 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.402 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.402 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6812", 2024-09-12T02:43:44.402 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:44.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.403 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.403 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6815", 2024-09-12T02:43:44.403 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:44.403 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.403 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.403 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6809/3193706134", 2024-09-12T02:43:44.403 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6811/3193706134", 2024-09-12T02:43:44.403 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6819/3193706134", 2024-09-12T02:43:44.403 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6815/3193706134", 2024-09-12T02:43:44.403 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:44.403 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:44.404 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:44.404 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.404 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:43:44.404 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:44.404 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:44.404 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:44.404 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:44.404 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:44.405 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:44.405 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:44.405 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:44.405 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 49, 2024-09-12T02:43:44.405 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:44.405 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:44.405 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:44.405 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.406 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.406 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6813", 2024-09-12T02:43:44.406 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:44.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.406 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.406 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6814", 2024-09-12T02:43:44.406 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:44.406 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.406 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.406 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:44.406 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.407 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.407 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6816", 2024-09-12T02:43:44.407 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:44.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.407 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.407 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6818", 2024-09-12T02:43:44.407 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:44.407 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.407 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.407 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:44.407 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.408 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.408 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6822", 2024-09-12T02:43:44.408 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:44.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.408 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.408 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6823", 2024-09-12T02:43:44.408 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:44.408 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.408 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.408 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:44.408 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.409 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.409 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6820", 2024-09-12T02:43:44.409 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:44.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.409 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.409 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6821", 2024-09-12T02:43:44.409 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:44.409 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.409 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.409 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6814/3738813293", 2024-09-12T02:43:44.409 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6818/3738813293", 2024-09-12T02:43:44.409 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6823/3738813293", 2024-09-12T02:43:44.410 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6821/3738813293", 2024-09-12T02:43:44.410 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:44.410 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:44.410 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:44.410 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.410 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:43:44.410 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:44.410 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:44.410 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:44.410 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:44.410 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:44.410 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:44.410 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:44.411 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:44.411 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:44.411 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:44.411 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:44.411 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:44.411 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.411 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.411 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6824", 2024-09-12T02:43:44.411 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:44.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.411 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.411 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6825", 2024-09-12T02:43:44.412 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:44.412 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.412 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.412 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:44.412 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.412 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.412 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6826", 2024-09-12T02:43:44.412 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:44.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.412 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.412 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6827", 2024-09-12T02:43:44.412 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:44.413 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.413 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.413 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:44.413 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.413 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.413 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6830", 2024-09-12T02:43:44.413 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:44.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.413 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.413 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6831", 2024-09-12T02:43:44.414 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:44.414 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.414 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.414 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:44.414 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:44.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.414 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:44.414 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6828", 2024-09-12T02:43:44.414 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:44.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.415 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:44.415 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6829", 2024-09-12T02:43:44.415 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:44.415 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.415 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.415 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6825/1421932609", 2024-09-12T02:43:44.415 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6827/1421932609", 2024-09-12T02:43:44.415 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6831/1421932609", 2024-09-12T02:43:44.415 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6829/1421932609", 2024-09-12T02:43:44.415 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:44.415 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:44.415 INFO:teuthology.orchestra.run.smithi112.stdout: "full", 2024-09-12T02:43:44.415 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:44.415 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.416 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.416 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:44.416 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_xinfo": [ 2024-09-12T02:43:44.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.416 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:43:44.416 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:44.416 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:44.416 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:44.416 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:44.416 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:44.416 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.220641+0000", 2024-09-12T02:43:44.416 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:44.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.417 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:43:44.417 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:44.417 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:44.417 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:44.417 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:44.417 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:44.417 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312574+0000", 2024-09-12T02:43:44.417 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:44.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.417 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:43:44.417 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:44.418 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:44.418 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:44.418 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:44.418 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:44.418 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.282771+0000", 2024-09-12T02:43:44.418 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:44.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.418 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:43:44.418 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:44.418 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:44.418 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:44.418 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:44.418 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:44.419 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.260478+0000", 2024-09-12T02:43:44.419 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:44.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.419 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:43:44.419 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:44.419 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:44.419 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:44.419 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:44.419 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:44.419 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.273397+0000", 2024-09-12T02:43:44.419 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:44.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.419 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:43:44.420 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:44.420 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:44.420 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:44.420 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:44.420 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:44.420 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312452+0000", 2024-09-12T02:43:44.420 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:44.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.420 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:43:44.420 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:44.420 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:44.420 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:44.420 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:44.421 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:44.421 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.308965+0000", 2024-09-12T02:43:44.421 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:44.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.421 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:43:44.421 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:44.421 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:44.421 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:44.421 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:44.421 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:44.421 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.337842+0000", 2024-09-12T02:43:44.421 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:44.421 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.421 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:44.422 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap": [], 2024-09-12T02:43:44.422 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_items": [ 2024-09-12T02:43:44.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.422 INFO:teuthology.orchestra.run.smithi112.stdout: "pgid": "7.12", 2024-09-12T02:43:44.422 INFO:teuthology.orchestra.run.smithi112.stdout: "mappings": [ 2024-09-12T02:43:44.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.422 INFO:teuthology.orchestra.run.smithi112.stdout: "from": 0, 2024-09-12T02:43:44.422 INFO:teuthology.orchestra.run.smithi112.stdout: "to": 5 2024-09-12T02:43:44.422 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.422 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.423 INFO:teuthology.orchestra.run.smithi112.stdout: "pgid": "7.3b", 2024-09-12T02:43:44.423 INFO:teuthology.orchestra.run.smithi112.stdout: "mappings": [ 2024-09-12T02:43:44.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:44.423 INFO:teuthology.orchestra.run.smithi112.stdout: "from": 0, 2024-09-12T02:43:44.423 INFO:teuthology.orchestra.run.smithi112.stdout: "to": 4 2024-09-12T02:43:44.423 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.423 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:44.423 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.423 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:44.423 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_primaries": [], 2024-09-12T02:43:44.423 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_temp": [], 2024-09-12T02:43:44.423 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_temp": [], 2024-09-12T02:43:44.424 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklist": {}, 2024-09-12T02:43:44.424 INFO:teuthology.orchestra.run.smithi112.stdout: "range_blocklist": {}, 2024-09-12T02:43:44.424 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profiles": { 2024-09-12T02:43:44.424 INFO:teuthology.orchestra.run.smithi112.stdout: "default": { 2024-09-12T02:43:44.424 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-failure-domain": "osd", 2024-09-12T02:43:44.424 INFO:teuthology.orchestra.run.smithi112.stdout: "k": "2", 2024-09-12T02:43:44.424 INFO:teuthology.orchestra.run.smithi112.stdout: "m": "1", 2024-09-12T02:43:44.424 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin": "jerasure", 2024-09-12T02:43:44.424 INFO:teuthology.orchestra.run.smithi112.stdout: "technique": "reed_sol_van" 2024-09-12T02:43:44.424 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:44.424 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps_queue": [], 2024-09-12T02:43:44.424 INFO:teuthology.orchestra.run.smithi112.stdout: "new_removed_snaps": [], 2024-09-12T02:43:44.424 INFO:teuthology.orchestra.run.smithi112.stdout: "new_purged_snaps": [], 2024-09-12T02:43:44.425 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_node_flags": {}, 2024-09-12T02:43:44.425 INFO:teuthology.orchestra.run.smithi112.stdout: "device_class_flags": {}, 2024-09-12T02:43:44.425 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode": { 2024-09-12T02:43:44.425 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_enabled": false, 2024-09-12T02:43:44.425 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_bucket_count": 0, 2024-09-12T02:43:44.425 INFO:teuthology.orchestra.run.smithi112.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:43:44.425 INFO:teuthology.orchestra.run.smithi112.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:43:44.425 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_bucket": 0 2024-09-12T02:43:44.425 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:44.425 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:43:44.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.346+0000 7f53c4a00640 1 -- 172.21.15.112:0/3166840795 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f539c06be30 msgr2=0x7f539c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:44.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.346+0000 7f53c4a00640 1 --2- 172.21.15.112:0/3166840795 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f539c06be30 0x7f539c06e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f53b00016e0 tx=0x7f53b0009040 comp rx=0 tx=0).stop 2024-09-12T02:43:44.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.346+0000 7f53c4a00640 1 -- 172.21.15.112:0/3166840795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53c015cc50 msgr2=0x7f53c01f8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:44.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.346+0000 7f53c4a00640 1 --2- 172.21.15.112:0/3166840795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53c015cc50 0x7f53c01f8a40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f53b802ac50 tx=0x7f53b8004a40 comp rx=0 tx=0).stop 2024-09-12T02:43:44.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.346+0000 7f53c4a00640 1 -- 172.21.15.112:0/3166840795 shutdown_connections 2024-09-12T02:43:44.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.346+0000 7f53c4a00640 1 --2- 172.21.15.112:0/3166840795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53c015cc50 0x7f53c01f8a40 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:44.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.346+0000 7f53c4a00640 1 --2- 172.21.15.112:0/3166840795 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f53c00afe30 0x7f53c015b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:44.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.346+0000 7f53c4a00640 1 --2- 172.21.15.112:0/3166840795 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f539c06be30 0x7f539c06e2f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:44.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.346+0000 7f53c4a00640 1 --2- 172.21.15.112:0/3166840795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53c0071530 0x7f53c014a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:44.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.346+0000 7f53c4a00640 1 -- 172.21.15.112:0/3166840795 >> 172.21.15.112:0/3166840795 conn(0x7f53c006bbd0 msgr2=0x7f53c00732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:44.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.347+0000 7f53c4a00640 1 -- 172.21.15.112:0/3166840795 shutdown_connections 2024-09-12T02:43:44.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:44.347+0000 7f53c4a00640 1 -- 172.21.15.112:0/3166840795 wait complete. 2024-09-12T02:43:44.428 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-12T02:43:49.429 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-12T02:43:49.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.591+0000 7f0897600640 1 Processor -- start 2024-09-12T02:43:49.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.591+0000 7f0897600640 1 -- start start 2024-09-12T02:43:49.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.592+0000 7f0897600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f089015b9d0 0x7f08900b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:49.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.592+0000 7f0897600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08900b45d0 0x7f08900728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:49.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.593+0000 7f0897600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f089006eef0 0x7f089006f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:49.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.593+0000 7f0897600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f08900b4a60 con 0x7f089006eef0 2024-09-12T02:43:49.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.593+0000 7f0897600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f089006f860 con 0x7f089015b9d0 2024-09-12T02:43:49.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.593+0000 7f0897600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f08900b54a0 con 0x7f08900b45d0 2024-09-12T02:43:49.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.593+0000 7f0895600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f089006eef0 0x7f089006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:49.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.593+0000 7f0895600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f089006eef0 0x7f089006f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47978/0 (socket says 172.21.15.112:47978) 2024-09-12T02:43:49.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.593+0000 7f0895600640 1 -- 172.21.15.112:0/153077592 learned_addr learned my addr 172.21.15.112:0/153077592 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:49.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.593+0000 7f088fe00640 1 --2- 172.21.15.112:0/153077592 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08900b45d0 0x7f08900728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:49.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.593+0000 7f0894c00640 1 --2- 172.21.15.112:0/153077592 >> v2:172.21.15.137:3300/0 conn(0x7f089015b9d0 0x7f08900b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:49.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.593+0000 7f0895600640 1 -- 172.21.15.112:0/153077592 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08900b45d0 msgr2=0x7f08900728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:49.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.593+0000 7f0895600640 1 --2- 172.21.15.112:0/153077592 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08900b45d0 0x7f08900728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:49.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.593+0000 7f0895600640 1 -- 172.21.15.112:0/153077592 >> v2:172.21.15.137:3300/0 conn(0x7f089015b9d0 msgr2=0x7f08900b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:49.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.593+0000 7f0895600640 1 --2- 172.21.15.112:0/153077592 >> v2:172.21.15.137:3300/0 conn(0x7f089015b9d0 0x7f08900b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:49.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.593+0000 7f0895600640 1 -- 172.21.15.112:0/153077592 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08900b3af0 con 0x7f089006eef0 2024-09-12T02:43:49.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.594+0000 7f0895600640 1 --2- 172.21.15.112:0/153077592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f089006eef0 0x7f089006f320 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f089006d230 tx=0x7f088802a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec8bda33f15012f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:49.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.595+0000 7f088f400640 1 -- 172.21.15.112:0/153077592 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0888036070 con 0x7f089006eef0 2024-09-12T02:43:49.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.595+0000 7f088f400640 1 -- 172.21.15.112:0/153077592 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0888031600 con 0x7f089006eef0 2024-09-12T02:43:49.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.595+0000 7f088f400640 1 -- 172.21.15.112:0/153077592 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08880319d0 con 0x7f089006eef0 2024-09-12T02:43:49.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.595+0000 7f0897600640 1 -- 172.21.15.112:0/153077592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f089006eef0 msgr2=0x7f089006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:49.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.595+0000 7f0897600640 1 --2- 172.21.15.112:0/153077592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f089006eef0 0x7f089006f320 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f089006d230 tx=0x7f088802a6d0 comp rx=0 tx=0).stop 2024-09-12T02:43:49.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.595+0000 7f0897600640 1 -- 172.21.15.112:0/153077592 shutdown_connections 2024-09-12T02:43:49.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.595+0000 7f0897600640 1 --2- 172.21.15.112:0/153077592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f089006eef0 0x7f089006f320 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:49.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.595+0000 7f0897600640 1 --2- 172.21.15.112:0/153077592 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08900b45d0 0x7f08900728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:49.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.595+0000 7f0897600640 1 --2- 172.21.15.112:0/153077592 >> v2:172.21.15.137:3300/0 conn(0x7f089015b9d0 0x7f08900b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:49.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.595+0000 7f0897600640 1 -- 172.21.15.112:0/153077592 >> 172.21.15.112:0/153077592 conn(0x7f089006bbd0 msgr2=0x7f089006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:49.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.595+0000 7f0897600640 1 -- 172.21.15.112:0/153077592 shutdown_connections 2024-09-12T02:43:49.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.595+0000 7f0897600640 1 -- 172.21.15.112:0/153077592 wait complete. 2024-09-12T02:43:49.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.597+0000 7f0897600640 1 Processor -- start 2024-09-12T02:43:49.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.597+0000 7f0897600640 1 -- start start 2024-09-12T02:43:49.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.598+0000 7f0897600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f089006eef0 0x7f08901f5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:49.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.598+0000 7f0897600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08900b45d0 0x7f08901574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:49.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.598+0000 7f0897600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f089015b9d0 0x7f0890157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:49.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.598+0000 7f0897600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f089015bdb0 con 0x7f08900b45d0 2024-09-12T02:43:49.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.598+0000 7f0897600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f08900b40b0 con 0x7f089015b9d0 2024-09-12T02:43:49.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.598+0000 7f0897600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f089015bf30 con 0x7f089006eef0 2024-09-12T02:43:49.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.598+0000 7f088fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08900b45d0 0x7f08901574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:49.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.598+0000 7f088fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08900b45d0 0x7f08901574e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47980/0 (socket says 172.21.15.112:47980) 2024-09-12T02:43:49.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.598+0000 7f088fe00640 1 -- 172.21.15.112:0/4106721665 learned_addr learned my addr 172.21.15.112:0/4106721665 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:49.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.598+0000 7f088fe00640 1 -- 172.21.15.112:0/4106721665 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f089006eef0 msgr2=0x7f08901f5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:49.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.598+0000 7f0894c00640 1 --2- 172.21.15.112:0/4106721665 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f089006eef0 0x7f08901f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:49.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.599+0000 7f0895600640 1 --2- 172.21.15.112:0/4106721665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f089015b9d0 0x7f0890157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:49.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.599+0000 7f088fe00640 1 --2- 172.21.15.112:0/4106721665 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f089006eef0 0x7f08901f5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:49.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.599+0000 7f088fe00640 1 -- 172.21.15.112:0/4106721665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f089015b9d0 msgr2=0x7f0890157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:49.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.599+0000 7f088fe00640 1 --2- 172.21.15.112:0/4106721665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f089015b9d0 0x7f0890157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:49.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.599+0000 7f088fe00640 1 -- 172.21.15.112:0/4106721665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f089015cb10 con 0x7f08900b45d0 2024-09-12T02:43:49.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.599+0000 7f0894c00640 1 --2- 172.21.15.112:0/4106721665 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f089006eef0 0x7f08901f5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:43:49.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.599+0000 7f0895600640 1 --2- 172.21.15.112:0/4106721665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f089015b9d0 0x7f0890157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:43:49.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.599+0000 7f088fe00640 1 --2- 172.21.15.112:0/4106721665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08900b45d0 0x7f08901574e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f087c00d800 tx=0x7f087c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:49.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.599+0000 7f088cc00640 1 -- 172.21.15.112:0/4106721665 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c00b6c0 con 0x7f08900b45d0 2024-09-12T02:43:49.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.599+0000 7f088cc00640 1 -- 172.21.15.112:0/4106721665 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f087c019070 con 0x7f08900b45d0 2024-09-12T02:43:49.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.599+0000 7f0897600640 1 -- 172.21.15.112:0/4106721665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f089015cdf0 con 0x7f08900b45d0 2024-09-12T02:43:49.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.599+0000 7f088cc00640 1 -- 172.21.15.112:0/4106721665 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c00baa0 con 0x7f08900b45d0 2024-09-12T02:43:49.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.599+0000 7f0897600640 1 -- 172.21.15.112:0/4106721665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f089015d3b0 con 0x7f08900b45d0 2024-09-12T02:43:49.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.600+0000 7f0897600640 1 -- 172.21.15.112:0/4106721665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0890068a30 con 0x7f08900b45d0 2024-09-12T02:43:49.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.601+0000 7f088cc00640 1 -- 172.21.15.112:0/4106721665 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f087c00bc40 con 0x7f08900b45d0 2024-09-12T02:43:49.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.602+0000 7f088cc00640 1 --2- 172.21.15.112:0/4106721665 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f087006be30 0x7f087006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:49.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.602+0000 7f088cc00640 1 -- 172.21.15.112:0/4106721665 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5767+0+0 (secure 0 0 0) 0x7f087c08b3d0 con 0x7f08900b45d0 2024-09-12T02:43:49.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.602+0000 7f0894c00640 1 --2- 172.21.15.112:0/4106721665 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f087006be30 0x7f087006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:49.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.603+0000 7f0894c00640 1 --2- 172.21.15.112:0/4106721665 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f087006be30 0x7f087006e2f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0884006fd0 tx=0x7f0884008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:49.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.606+0000 7f088cc00640 1 -- 172.21.15.112:0/4106721665 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f087c059ca0 con 0x7f08900b45d0 2024-09-12T02:43:49.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.778+0000 7f0897600640 1 -- 172.21.15.112:0/4106721665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f089006dbc0 con 0x7f08900b45d0 2024-09-12T02:43:49.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.780+0000 7f088cc00640 1 -- 172.21.15.112:0/4106721665 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v53) ==== 81+0+34627 (secure 0 0 0) 0x7f087c0595a0 con 0x7f08900b45d0 2024-09-12T02:43:49.781 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:49.781 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:43:49.781 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 53, 2024-09-12T02:43:49.781 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:43:49.782 INFO:teuthology.orchestra.run.smithi112.stdout: "created": "2024-09-12T02:41:36.162095+0000", 2024-09-12T02:43:49.782 INFO:teuthology.orchestra.run.smithi112.stdout: "modified": "2024-09-12T02:43:45.155167+0000", 2024-09-12T02:43:49.782 INFO:teuthology.orchestra.run.smithi112.stdout: "last_up_change": "2024-09-12T02:41:42.191169+0000", 2024-09-12T02:43:49.782 INFO:teuthology.orchestra.run.smithi112.stdout: "last_in_change": "2024-09-12T02:41:39.036600+0000", 2024-09-12T02:43:49.782 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:43:49.782 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_num": 5799936, 2024-09-12T02:43:49.782 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_set": [ 2024-09-12T02:43:49.782 INFO:teuthology.orchestra.run.smithi112.stdout: "pglog_hardlimit", 2024-09-12T02:43:49.782 INFO:teuthology.orchestra.run.smithi112.stdout: "purged_snapdirs", 2024-09-12T02:43:49.782 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_deletes", 2024-09-12T02:43:49.782 INFO:teuthology.orchestra.run.smithi112.stdout: "sortbitwise" 2024-09-12T02:43:49.782 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:49.782 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_version": 4, 2024-09-12T02:43:49.783 INFO:teuthology.orchestra.run.smithi112.stdout: "full_ratio": 0.69999998807907104, 2024-09-12T02:43:49.783 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-12T02:43:49.783 INFO:teuthology.orchestra.run.smithi112.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-12T02:43:49.783 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_snapshot": "", 2024-09-12T02:43:49.783 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_max": 7, 2024-09-12T02:43:49.783 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd": 8, 2024-09-12T02:43:49.783 INFO:teuthology.orchestra.run.smithi112.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:43:49.783 INFO:teuthology.orchestra.run.smithi112.stdout: "min_compat_client": "luminous", 2024-09-12T02:43:49.783 INFO:teuthology.orchestra.run.smithi112.stdout: "require_osd_release": "squid", 2024-09-12T02:43:49.783 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_crimson": false, 2024-09-12T02:43:49.783 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-12T02:43:49.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.783 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 1, 2024-09-12T02:43:49.783 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": ".mgr", 2024-09-12T02:43:49.784 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:41:43.011599+0000", 2024-09-12T02:43:49.784 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:43:49.784 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:43:49.784 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:43:49.784 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:43:49.784 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:43:49.784 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:43:49.784 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:43:49.784 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:43:49.784 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:43:49.784 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:43:49.784 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:43:49.784 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:43:49.785 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:43:49.785 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 1, 2024-09-12T02:43:49.785 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 1, 2024-09-12T02:43:49.785 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 1, 2024-09-12T02:43:49.785 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 1, 2024-09-12T02:43:49.785 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 1, 2024-09-12T02:43:49.785 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:43:49.785 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:43:49.785 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:43:49.785 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:43:49.785 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:43:49.785 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:43:49.785 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:43:49.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.786 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "53", 2024-09-12T02:43:49.786 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:43:49.786 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:43:49.786 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:43:49.786 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:43:49.786 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:43:49.786 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:43:49.786 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:43:49.786 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:43:49.786 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:43:49.786 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:43:49.786 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:43:49.786 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:43:49.787 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:43:49.787 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:43:49.787 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:43:49.787 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:43:49.787 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:43:49.787 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:43:49.787 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:43:49.787 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:43:49.787 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:43:49.787 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:43:49.787 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:43:49.787 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:43:49.787 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:43:49.788 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:43:49.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.788 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:43:49.788 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:43:49.788 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:43:49.788 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:43:49.788 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:43:49.788 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:43:49.788 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:43:49.788 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:43:49.788 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:43:49.788 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:43:49.788 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:43:49.788 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:43:49.789 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_max": 32, 2024-09-12T02:43:49.789 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 1 2024-09-12T02:43:49.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.789 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:43:49.789 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": {} 2024-09-12T02:43:49.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.789 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:43:49.789 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:43:49.789 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 8, 2024-09-12T02:43:49.789 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 8, 2024-09-12T02:43:49.789 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 0.25, 2024-09-12T02:43:49.789 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:43:49.790 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:43:49.790 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:43:49.790 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:43:49.790 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:43:49.790 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.790 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 6, 2024-09-12T02:43:49.790 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:43:49.790 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:43:14.483471+0000", 2024-09-12T02:43:49.790 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:43:49.790 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:43:49.790 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:43:49.790 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:43:49.791 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:43:49.791 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:43:49.791 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:43:49.791 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:43:49.791 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:43:49.791 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:43:49.791 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:43:49.791 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:43:49.791 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:43:49.791 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 32, 2024-09-12T02:43:49.791 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 32, 2024-09-12T02:43:49.791 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 32, 2024-09-12T02:43:49.791 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 32, 2024-09-12T02:43:49.791 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 32, 2024-09-12T02:43:49.792 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:43:49.792 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:43:49.792 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:43:49.792 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:43:49.792 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:43:49.792 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:43:49.792 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:43:49.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.792 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "53", 2024-09-12T02:43:49.792 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:43:49.792 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:43:49.792 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:43:49.792 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:43:49.792 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:43:49.792 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:43:49.793 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:43:49.793 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:43:49.793 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:43:49.793 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:43:49.793 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:43:49.793 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:43:49.793 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:43:49.793 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:43:49.793 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:43:49.793 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:43:49.793 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:43:49.793 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:43:49.793 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:43:49.793 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:43:49.794 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:43:49.794 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:43:49.794 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:43:49.794 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:43:49.794 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:43:49.794 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:43:49.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.794 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:43:49.794 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:43:49.794 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:43:49.794 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:43:49.794 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:43:49.794 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:43:49.794 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:43:49.794 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:43:49.795 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:43:49.795 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:43:49.795 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:43:49.795 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:43:49.795 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:43:49.795 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 16, 2024-09-12T02:43:49.795 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_priority": 5 2024-09-12T02:43:49.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.795 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:43:49.795 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:43:49.795 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": "cephfs" 2024-09-12T02:43:49.795 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.795 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:43:49.795 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:43:49.796 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.75, 2024-09-12T02:43:49.796 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.75, 2024-09-12T02:43:49.796 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:43:49.796 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.75, 2024-09-12T02:43:49.796 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.75, 2024-09-12T02:43:49.796 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:43:49.796 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:43:49.796 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:43:49.796 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.796 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 7, 2024-09-12T02:43:49.796 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_data", 2024-09-12T02:43:49.797 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:43:15.711619+0000", 2024-09-12T02:43:49.797 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:43:49.797 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:43:49.797 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:43:49.797 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:43:49.797 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:43:49.797 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:43:49.797 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:43:49.797 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:43:49.797 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:43:49.797 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:43:49.797 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:43:49.797 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:43:49.797 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:43:49.798 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 64, 2024-09-12T02:43:49.798 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 64, 2024-09-12T02:43:49.798 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 64, 2024-09-12T02:43:49.798 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 64, 2024-09-12T02:43:49.798 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 64, 2024-09-12T02:43:49.798 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:43:49.798 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:43:49.798 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:43:49.798 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:43:49.798 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:43:49.798 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:43:49.798 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:43:49.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.798 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "53", 2024-09-12T02:43:49.799 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:43:49.799 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:43:49.799 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:43:49.799 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:43:49.799 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:43:49.799 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:43:49.799 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:43:49.799 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:43:49.799 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:43:49.799 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:43:49.799 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:43:49.799 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:43:49.799 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:43:49.800 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:43:49.800 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:43:49.800 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:43:49.800 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:43:49.800 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:43:49.800 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:43:49.800 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:43:49.800 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:43:49.800 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:43:49.800 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:43:49.800 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:43:49.801 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:43:49.801 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:43:49.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.801 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:43:49.801 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:43:49.801 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:43:49.801 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:43:49.801 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:43:49.801 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:43:49.801 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:43:49.801 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:43:49.801 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:43:49.801 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:43:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:43:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:43:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 64, 2024-09-12T02:43:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:43:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:43:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:43:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: "data": "cephfs" 2024-09-12T02:43:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:43:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:43:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.75, 2024-09-12T02:43:49.803 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.75, 2024-09-12T02:43:49.803 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:43:49.803 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.75, 2024-09-12T02:43:49.803 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.75, 2024-09-12T02:43:49.803 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:43:49.803 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:43:49.803 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:43:49.803 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.803 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.803 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:49.803 INFO:teuthology.orchestra.run.smithi112.stdout: "osds": [ 2024-09-12T02:43:49.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.803 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:43:49.804 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:49.804 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:49.804 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:49.804 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:49.804 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:49.804 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:49.804 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:49.804 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:49.804 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:49.804 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:49.804 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:49.804 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:49.805 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.805 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.805 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6800", 2024-09-12T02:43:49.805 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:49.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.805 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.805 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6801", 2024-09-12T02:43:49.805 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:49.805 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.805 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.806 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:49.806 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.806 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.806 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6802", 2024-09-12T02:43:49.806 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:49.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.806 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.806 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6803", 2024-09-12T02:43:49.806 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:49.806 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.806 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.807 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:49.807 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.807 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.807 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6806", 2024-09-12T02:43:49.807 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:49.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.807 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.807 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6807", 2024-09-12T02:43:49.807 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:49.807 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.807 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.808 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:49.808 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.808 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.808 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6804", 2024-09-12T02:43:49.808 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:49.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.808 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.808 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6805", 2024-09-12T02:43:49.808 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:49.808 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.808 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.809 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6801/821571304", 2024-09-12T02:43:49.809 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6803/821571304", 2024-09-12T02:43:49.809 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6807/821571304", 2024-09-12T02:43:49.809 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6805/821571304", 2024-09-12T02:43:49.809 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:49.809 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:49.809 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:49.809 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.809 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:43:49.809 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:49.809 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:49.809 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6808", 2024-09-12T02:43:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6809", 2024-09-12T02:43:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6810", 2024-09-12T02:43:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6811", 2024-09-12T02:43:49.812 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:49.812 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.812 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.812 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:49.812 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.812 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.812 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6814", 2024-09-12T02:43:49.812 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:49.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.812 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.812 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6815", 2024-09-12T02:43:49.812 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:49.812 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.813 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.813 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:49.813 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.813 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.813 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6812", 2024-09-12T02:43:49.813 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:49.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.813 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.813 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6813", 2024-09-12T02:43:49.813 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:49.813 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.813 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.814 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6809/2642068641", 2024-09-12T02:43:49.814 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6811/2642068641", 2024-09-12T02:43:49.814 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6815/2642068641", 2024-09-12T02:43:49.814 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6813/2642068641", 2024-09-12T02:43:49.814 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:49.814 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:49.814 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:49.814 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.814 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:43:49.814 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:49.814 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:49.815 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:49.815 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:49.815 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:49.815 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:49.815 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:49.815 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:49.815 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:49.815 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:49.815 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:49.815 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:49.815 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.815 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.815 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6816", 2024-09-12T02:43:49.815 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:49.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.816 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.816 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.816 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6817", 2024-09-12T02:43:49.816 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:49.816 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.816 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.816 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:49.816 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.816 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.816 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.816 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6818", 2024-09-12T02:43:49.817 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:49.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.817 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.817 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6819", 2024-09-12T02:43:49.817 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:49.817 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.817 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.817 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:49.817 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.817 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.817 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6822", 2024-09-12T02:43:49.817 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:49.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.818 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.818 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6823", 2024-09-12T02:43:49.818 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:49.818 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.818 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.818 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:49.818 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.818 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.818 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6820", 2024-09-12T02:43:49.818 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:49.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.819 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.819 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6821", 2024-09-12T02:43:49.819 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:49.819 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.819 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.819 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6817/3365688807", 2024-09-12T02:43:49.819 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6819/3365688807", 2024-09-12T02:43:49.819 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6823/3365688807", 2024-09-12T02:43:49.819 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6821/3365688807", 2024-09-12T02:43:49.819 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:49.819 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:49.819 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:49.819 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.820 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:43:49.820 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:49.820 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:49.820 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:49.820 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:49.820 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:49.820 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:49.820 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:49.820 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:49.820 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:49.820 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:49.820 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:49.820 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:49.820 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.821 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.821 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6824", 2024-09-12T02:43:49.821 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:49.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.821 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.821 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6825", 2024-09-12T02:43:49.821 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:49.821 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.821 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.821 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:49.821 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.822 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.822 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6826", 2024-09-12T02:43:49.822 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:49.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.822 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.822 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6827", 2024-09-12T02:43:49.822 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:49.822 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.822 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.822 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:49.822 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.822 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.823 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6830", 2024-09-12T02:43:49.823 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:49.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.823 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.823 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6831", 2024-09-12T02:43:49.823 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:49.823 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.823 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.823 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:49.823 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.823 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.823 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6828", 2024-09-12T02:43:49.824 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:49.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.824 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.824 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6829", 2024-09-12T02:43:49.824 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:49.824 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.824 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.824 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6825/231774278", 2024-09-12T02:43:49.824 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6827/231774278", 2024-09-12T02:43:49.824 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6831/231774278", 2024-09-12T02:43:49.824 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6829/231774278", 2024-09-12T02:43:49.824 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:49.824 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:49.825 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:49.825 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.825 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:43:49.825 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:49.825 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:49.825 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:49.825 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:49.825 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:49.825 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:49.825 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:49.825 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:49.825 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:49.825 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:49.826 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:49.826 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:49.826 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.826 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.826 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6800", 2024-09-12T02:43:49.826 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:49.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.826 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.826 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6801", 2024-09-12T02:43:49.826 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:49.826 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.826 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.827 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:49.827 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.827 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.827 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6802", 2024-09-12T02:43:49.827 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:49.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.827 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.827 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6803", 2024-09-12T02:43:49.827 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:49.827 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.827 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.827 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:49.827 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.828 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.828 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6806", 2024-09-12T02:43:49.828 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:49.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.828 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.828 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6807", 2024-09-12T02:43:49.828 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:49.828 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.828 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.828 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:49.828 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.828 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.829 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6804", 2024-09-12T02:43:49.829 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:49.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.829 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.829 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6805", 2024-09-12T02:43:49.829 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:49.829 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.829 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.829 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6801/3671178153", 2024-09-12T02:43:49.829 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6803/3671178153", 2024-09-12T02:43:49.829 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6807/3671178153", 2024-09-12T02:43:49.829 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6805/3671178153", 2024-09-12T02:43:49.829 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:49.830 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:49.830 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:49.830 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.830 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:43:49.830 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:49.830 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:49.830 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:49.830 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:49.830 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:49.830 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:49.830 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:49.831 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:49.831 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 49, 2024-09-12T02:43:49.831 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:49.831 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:49.831 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:49.831 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.831 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.831 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6808", 2024-09-12T02:43:49.831 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:49.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.831 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.831 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6809", 2024-09-12T02:43:49.832 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:49.832 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.832 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.832 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:49.832 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.832 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.832 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6810", 2024-09-12T02:43:49.832 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:49.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.832 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.832 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6811", 2024-09-12T02:43:49.833 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:49.833 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.833 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.833 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:49.833 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.833 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.833 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6817", 2024-09-12T02:43:49.833 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:49.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.833 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.833 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6819", 2024-09-12T02:43:49.833 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:49.833 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.834 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.834 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:49.834 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.834 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.834 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6812", 2024-09-12T02:43:49.834 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:49.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.834 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.834 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6815", 2024-09-12T02:43:49.834 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:49.834 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.834 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6809/3193706134", 2024-09-12T02:43:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6811/3193706134", 2024-09-12T02:43:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6819/3193706134", 2024-09-12T02:43:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6815/3193706134", 2024-09-12T02:43:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:43:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:49.836 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:49.836 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:49.836 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:49.836 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:49.836 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 49, 2024-09-12T02:43:49.836 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:49.836 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:49.836 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:49.836 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.836 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.836 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6813", 2024-09-12T02:43:49.836 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:49.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.837 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.837 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6814", 2024-09-12T02:43:49.837 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:49.837 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.837 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.837 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:49.837 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.837 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.837 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6816", 2024-09-12T02:43:49.837 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:49.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.838 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.838 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6818", 2024-09-12T02:43:49.838 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:49.838 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.838 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.838 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:49.838 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.839 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.839 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6822", 2024-09-12T02:43:49.839 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:49.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.839 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.839 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6823", 2024-09-12T02:43:49.839 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:49.839 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.839 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.839 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:49.839 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.840 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.840 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6820", 2024-09-12T02:43:49.840 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:49.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.840 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.840 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6821", 2024-09-12T02:43:49.840 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:49.840 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.840 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.840 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6814/3738813293", 2024-09-12T02:43:49.840 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6818/3738813293", 2024-09-12T02:43:49.841 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6823/3738813293", 2024-09-12T02:43:49.841 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6821/3738813293", 2024-09-12T02:43:49.841 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:49.841 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:49.841 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:49.841 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.841 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:43:49.841 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:49.841 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:49.841 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:49.841 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:49.841 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:49.842 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:49.842 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:49.842 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:49.842 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:49.842 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:49.842 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:49.842 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:49.842 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.842 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.842 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6824", 2024-09-12T02:43:49.842 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:49.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.842 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.843 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6825", 2024-09-12T02:43:49.843 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:49.843 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.843 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.843 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:49.843 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.843 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.843 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6826", 2024-09-12T02:43:49.843 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:49.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.843 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.844 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6827", 2024-09-12T02:43:49.844 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:49.844 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.844 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.844 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:49.844 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.844 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.844 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6830", 2024-09-12T02:43:49.844 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:49.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.844 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.844 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6831", 2024-09-12T02:43:49.844 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:49.845 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.845 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.845 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:49.845 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:49.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.845 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:49.845 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6828", 2024-09-12T02:43:49.845 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:49.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.845 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:49.845 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6829", 2024-09-12T02:43:49.845 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:49.846 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.846 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.846 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6825/1421932609", 2024-09-12T02:43:49.846 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6827/1421932609", 2024-09-12T02:43:49.846 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6831/1421932609", 2024-09-12T02:43:49.846 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6829/1421932609", 2024-09-12T02:43:49.846 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:49.846 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:49.846 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:49.846 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.846 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.846 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:49.846 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_xinfo": [ 2024-09-12T02:43:49.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.847 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:43:49.847 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:49.847 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:49.847 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:49.847 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:49.847 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:49.847 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.220641+0000", 2024-09-12T02:43:49.847 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:49.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.847 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:43:49.847 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:49.847 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:49.847 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:49.847 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:49.848 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:49.848 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312574+0000", 2024-09-12T02:43:49.848 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:49.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.848 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:43:49.848 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:49.848 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:49.848 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:49.848 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:49.848 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:49.848 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.282771+0000", 2024-09-12T02:43:49.848 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:49.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.849 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:43:49.849 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:49.849 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:49.849 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:49.849 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:49.849 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:49.849 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.260478+0000", 2024-09-12T02:43:49.849 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:49.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.849 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:43:49.849 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:49.849 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:49.850 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:49.850 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:49.850 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:49.850 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.273397+0000", 2024-09-12T02:43:49.850 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:49.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.850 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:43:49.850 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:49.850 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:49.850 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:49.850 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:49.850 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:49.850 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312452+0000", 2024-09-12T02:43:49.850 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:49.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.851 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:43:49.851 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:49.851 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:49.851 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:49.851 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:49.851 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:49.851 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.308965+0000", 2024-09-12T02:43:49.851 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:49.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.851 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:43:49.851 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:49.851 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:49.852 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:49.852 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:49.852 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:49.852 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.337842+0000", 2024-09-12T02:43:49.852 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:49.852 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.852 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:49.852 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap": [], 2024-09-12T02:43:49.852 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_items": [ 2024-09-12T02:43:49.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.852 INFO:teuthology.orchestra.run.smithi112.stdout: "pgid": "7.12", 2024-09-12T02:43:49.852 INFO:teuthology.orchestra.run.smithi112.stdout: "mappings": [ 2024-09-12T02:43:49.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.852 INFO:teuthology.orchestra.run.smithi112.stdout: "from": 0, 2024-09-12T02:43:49.852 INFO:teuthology.orchestra.run.smithi112.stdout: "to": 5 2024-09-12T02:43:49.852 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.853 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.853 INFO:teuthology.orchestra.run.smithi112.stdout: "pgid": "7.3b", 2024-09-12T02:43:49.853 INFO:teuthology.orchestra.run.smithi112.stdout: "mappings": [ 2024-09-12T02:43:49.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:49.853 INFO:teuthology.orchestra.run.smithi112.stdout: "from": 0, 2024-09-12T02:43:49.853 INFO:teuthology.orchestra.run.smithi112.stdout: "to": 4 2024-09-12T02:43:49.853 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.853 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:49.853 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.853 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:49.853 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_primaries": [], 2024-09-12T02:43:49.853 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_temp": [], 2024-09-12T02:43:49.854 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_temp": [], 2024-09-12T02:43:49.854 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklist": {}, 2024-09-12T02:43:49.854 INFO:teuthology.orchestra.run.smithi112.stdout: "range_blocklist": {}, 2024-09-12T02:43:49.854 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profiles": { 2024-09-12T02:43:49.854 INFO:teuthology.orchestra.run.smithi112.stdout: "default": { 2024-09-12T02:43:49.854 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-failure-domain": "osd", 2024-09-12T02:43:49.854 INFO:teuthology.orchestra.run.smithi112.stdout: "k": "2", 2024-09-12T02:43:49.854 INFO:teuthology.orchestra.run.smithi112.stdout: "m": "1", 2024-09-12T02:43:49.854 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin": "jerasure", 2024-09-12T02:43:49.854 INFO:teuthology.orchestra.run.smithi112.stdout: "technique": "reed_sol_van" 2024-09-12T02:43:49.854 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:49.854 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps_queue": [], 2024-09-12T02:43:49.854 INFO:teuthology.orchestra.run.smithi112.stdout: "new_removed_snaps": [], 2024-09-12T02:43:49.855 INFO:teuthology.orchestra.run.smithi112.stdout: "new_purged_snaps": [], 2024-09-12T02:43:49.855 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_node_flags": {}, 2024-09-12T02:43:49.855 INFO:teuthology.orchestra.run.smithi112.stdout: "device_class_flags": {}, 2024-09-12T02:43:49.855 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode": { 2024-09-12T02:43:49.855 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_enabled": false, 2024-09-12T02:43:49.855 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_bucket_count": 0, 2024-09-12T02:43:49.855 INFO:teuthology.orchestra.run.smithi112.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:43:49.855 INFO:teuthology.orchestra.run.smithi112.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:43:49.855 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_bucket": 0 2024-09-12T02:43:49.855 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:49.855 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:43:49.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.782+0000 7f0897600640 1 -- 172.21.15.112:0/4106721665 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f087006be30 msgr2=0x7f087006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:49.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.782+0000 7f0897600640 1 --2- 172.21.15.112:0/4106721665 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f087006be30 0x7f087006e2f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0884006fd0 tx=0x7f0884008040 comp rx=0 tx=0).stop 2024-09-12T02:43:49.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.782+0000 7f0897600640 1 -- 172.21.15.112:0/4106721665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08900b45d0 msgr2=0x7f08901574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:49.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.782+0000 7f0897600640 1 --2- 172.21.15.112:0/4106721665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08900b45d0 0x7f08901574e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f087c00d800 tx=0x7f087c00dcc0 comp rx=0 tx=0).stop 2024-09-12T02:43:49.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.782+0000 7f0897600640 1 -- 172.21.15.112:0/4106721665 shutdown_connections 2024-09-12T02:43:49.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.782+0000 7f0897600640 1 --2- 172.21.15.112:0/4106721665 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f087006be30 0x7f087006e2f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:49.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.782+0000 7f0897600640 1 --2- 172.21.15.112:0/4106721665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f089015b9d0 0x7f0890157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:49.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.782+0000 7f0897600640 1 --2- 172.21.15.112:0/4106721665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08900b45d0 0x7f08901574e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:49.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.782+0000 7f0897600640 1 --2- 172.21.15.112:0/4106721665 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f089006eef0 0x7f08901f5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:49.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.782+0000 7f0897600640 1 -- 172.21.15.112:0/4106721665 >> 172.21.15.112:0/4106721665 conn(0x7f089006bbd0 msgr2=0x7f08900b1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:49.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.782+0000 7f0897600640 1 -- 172.21.15.112:0/4106721665 shutdown_connections 2024-09-12T02:43:49.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:49.782+0000 7f0897600640 1 -- 172.21.15.112:0/4106721665 wait complete. 2024-09-12T02:43:49.858 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-12T02:43:49.858 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-12T02:43:50.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.009+0000 7f70ef800640 1 Processor -- start 2024-09-12T02:43:50.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.010+0000 7f70ef800640 1 -- start start 2024-09-12T02:43:50.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.011+0000 7f70ef800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70e815b9d0 0x7f70e80b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:50.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.011+0000 7f70ef800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70e80b54a0 con 0x7f70e806f600 2024-09-12T02:43:50.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.011+0000 7f70ef800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70e80b3af0 con 0x7f70e80b45d0 2024-09-12T02:43:50.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.011+0000 7f70ef800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f70e80b4a30 con 0x7f70e815b9d0 2024-09-12T02:43:50.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.011+0000 7f70ed800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f70e806f600 0x7f70e80cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:54748/0 (socket says 172.21.15.112:54748) 2024-09-12T02:43:50.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.011+0000 7f70ed800640 1 -- 172.21.15.112:0/2811845400 learned_addr learned my addr 172.21.15.112:0/2811845400 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:50.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.011+0000 7f70ece00640 1 --2- 172.21.15.112:0/2811845400 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70e815b9d0 0x7f70e80b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:50.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.012+0000 7f70e7e00640 1 -- 172.21.15.112:0/2811845400 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 669602892 0 0) 0x7f70e80b54a0 con 0x7f70e806f600 2024-09-12T02:43:50.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.012+0000 7f70e7e00640 1 -- 172.21.15.112:0/2811845400 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70cc003520 con 0x7f70e806f600 2024-09-12T02:43:50.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.012+0000 7f70e7e00640 1 -- 172.21.15.112:0/2811845400 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3750826459 0 0) 0x7f70e80b3af0 con 0x7f70e80b45d0 2024-09-12T02:43:50.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.012+0000 7f70e7e00640 1 -- 172.21.15.112:0/2811845400 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70e80b54a0 con 0x7f70e80b45d0 2024-09-12T02:43:50.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.012+0000 7f70ece00640 1 -- 172.21.15.112:0/2811845400 >> v1:172.21.15.137:6789/0 conn(0x7f70e80b45d0 legacy=0x7f70e806eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:50.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.012+0000 7f70e7e00640 1 -- 172.21.15.112:0/2811845400 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 680899722 0 0) 0x7f70cc003520 con 0x7f70e806f600 2024-09-12T02:43:50.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.012+0000 7f70ece00640 1 -- 172.21.15.112:0/2811845400 >> v1:172.21.15.112:6789/0 conn(0x7f70e806f600 legacy=0x7f70e80cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:50.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.012+0000 7f70ece00640 1 -- 172.21.15.112:0/2811845400 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e80b3dd0 con 0x7f70e815b9d0 2024-09-12T02:43:50.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.013+0000 7f70ece00640 1 --2- 172.21.15.112:0/2811845400 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70e815b9d0 0x7f70e80b4ec0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f70d80097d0 tx=0x7f70d802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dfcb49d1b793eda server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:50.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.013+0000 7f70e7e00640 1 -- 172.21.15.112:0/2811845400 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8037070 con 0x7f70e815b9d0 2024-09-12T02:43:50.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.013+0000 7f70e7e00640 1 -- 172.21.15.112:0/2811845400 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d802ac30 con 0x7f70e815b9d0 2024-09-12T02:43:50.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.013+0000 7f70e7e00640 1 -- 172.21.15.112:0/2811845400 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e00019f0 con 0x7f70e815b9d0 2024-09-12T02:43:50.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.014+0000 7f70ef800640 1 -- 172.21.15.112:0/2811845400 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70e815b9d0 msgr2=0x7f70e80b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:50.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.014+0000 7f70ef800640 1 --2- 172.21.15.112:0/2811845400 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70e815b9d0 0x7f70e80b4ec0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f70d80097d0 tx=0x7f70d802a1a0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.014+0000 7f70ef800640 1 -- 172.21.15.112:0/2811845400 shutdown_connections 2024-09-12T02:43:50.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.014+0000 7f70ef800640 1 --2- 172.21.15.112:0/2811845400 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70e815b9d0 0x7f70e80b4ec0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.014+0000 7f70ef800640 1 -- 172.21.15.112:0/2811845400 >> 172.21.15.112:0/2811845400 conn(0x7f70e806bbd0 msgr2=0x7f70e806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:50.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.014+0000 7f70ef800640 1 -- 172.21.15.112:0/2811845400 shutdown_connections 2024-09-12T02:43:50.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.014+0000 7f70ef800640 1 -- 172.21.15.112:0/2811845400 wait complete. 2024-09-12T02:43:50.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.016+0000 7f70ef800640 1 Processor -- start 2024-09-12T02:43:50.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.016+0000 7f70ef800640 1 -- start start 2024-09-12T02:43:50.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.017+0000 7f70ef800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70e806f600 0x7f70e8151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:50.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.017+0000 7f70ef800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70e80b45d0 0x7f70e80cf860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:50.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.017+0000 7f70ef800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70e815b9d0 0x7f70e815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:50.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.017+0000 7f70ef800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f70e815bf30 con 0x7f70e806f600 2024-09-12T02:43:50.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.017+0000 7f70ef800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f70e815bdb0 con 0x7f70e815b9d0 2024-09-12T02:43:50.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.017+0000 7f70ef800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f70e80728c0 con 0x7f70e80b45d0 2024-09-12T02:43:50.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.017+0000 7f70ece00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70e806f600 0x7f70e8151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:50.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.017+0000 7f70ece00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70e806f600 0x7f70e8151770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47984/0 (socket says 172.21.15.112:47984) 2024-09-12T02:43:50.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.017+0000 7f70ece00640 1 -- 172.21.15.112:0/1924124196 learned_addr learned my addr 172.21.15.112:0/1924124196 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:50.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.017+0000 7f70ece00640 1 -- 172.21.15.112:0/1924124196 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70e80b45d0 msgr2=0x7f70e80cf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:50.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.017+0000 7f70ece00640 1 --2- 172.21.15.112:0/1924124196 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70e80b45d0 0x7f70e80cf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.017+0000 7f70ece00640 1 -- 172.21.15.112:0/1924124196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70e815b9d0 msgr2=0x7f70e815c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:50.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.017+0000 7f70ece00640 1 --2- 172.21.15.112:0/1924124196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70e815b9d0 0x7f70e815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.017+0000 7f70ece00640 1 -- 172.21.15.112:0/1924124196 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e80cfda0 con 0x7f70e806f600 2024-09-12T02:43:50.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.018+0000 7f70ece00640 1 --2- 172.21.15.112:0/1924124196 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70e806f600 0x7f70e8151770 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f70d8035040 tx=0x7f70d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:50.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.018+0000 7f70e5600640 1 -- 172.21.15.112:0/1924124196 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8037050 con 0x7f70e806f600 2024-09-12T02:43:50.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.018+0000 7f70e5600640 1 -- 172.21.15.112:0/1924124196 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d8043070 con 0x7f70e806f600 2024-09-12T02:43:50.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.018+0000 7f70ef800640 1 -- 172.21.15.112:0/1924124196 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e80cde10 con 0x7f70e806f600 2024-09-12T02:43:50.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.018+0000 7f70e5600640 1 -- 172.21.15.112:0/1924124196 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d803e690 con 0x7f70e806f600 2024-09-12T02:43:50.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.018+0000 7f70ef800640 1 -- 172.21.15.112:0/1924124196 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e80ce3d0 con 0x7f70e806f600 2024-09-12T02:43:50.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.019+0000 7f70ef800640 1 -- 172.21.15.112:0/1924124196 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70e8068a30 con 0x7f70e806f600 2024-09-12T02:43:50.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.020+0000 7f70e5600640 1 -- 172.21.15.112:0/1924124196 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f70d803e830 con 0x7f70e806f600 2024-09-12T02:43:50.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.021+0000 7f70e5600640 1 --2- 172.21.15.112:0/1924124196 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f70c406be30 0x7f70c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:50.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.021+0000 7f70e5600640 1 -- 172.21.15.112:0/1924124196 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5767+0+0 (secure 0 0 0) 0x7f70d80ab780 con 0x7f70e806f600 2024-09-12T02:43:50.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.021+0000 7f70dfe00640 1 --2- 172.21.15.112:0/1924124196 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f70c406be30 0x7f70c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:50.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.022+0000 7f70dfe00640 1 --2- 172.21.15.112:0/1924124196 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f70c406be30 0x7f70c406e2f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f70d0007fd0 tx=0x7f70d0007940 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:50.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.026+0000 7f70e5600640 1 -- 172.21.15.112:0/1924124196 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f70d80044e0 con 0x7f70e806f600 2024-09-12T02:43:50.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.196+0000 7f70ef800640 1 -- 172.21.15.112:0/1924124196 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f70e8072c50 con 0x7f70e806f600 2024-09-12T02:43:50.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.197+0000 7f70e5600640 1 -- 172.21.15.112:0/1924124196 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v53) ==== 81+0+34627 (secure 0 0 0) 0x7f70d807a0e0 con 0x7f70e806f600 2024-09-12T02:43:50.199 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:50.199 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:43:50.199 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 53, 2024-09-12T02:43:50.199 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:43:50.199 INFO:teuthology.orchestra.run.smithi112.stdout: "created": "2024-09-12T02:41:36.162095+0000", 2024-09-12T02:43:50.199 INFO:teuthology.orchestra.run.smithi112.stdout: "modified": "2024-09-12T02:43:45.155167+0000", 2024-09-12T02:43:50.199 INFO:teuthology.orchestra.run.smithi112.stdout: "last_up_change": "2024-09-12T02:41:42.191169+0000", 2024-09-12T02:43:50.199 INFO:teuthology.orchestra.run.smithi112.stdout: "last_in_change": "2024-09-12T02:41:39.036600+0000", 2024-09-12T02:43:50.199 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:43:50.199 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_num": 5799936, 2024-09-12T02:43:50.200 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_set": [ 2024-09-12T02:43:50.200 INFO:teuthology.orchestra.run.smithi112.stdout: "pglog_hardlimit", 2024-09-12T02:43:50.200 INFO:teuthology.orchestra.run.smithi112.stdout: "purged_snapdirs", 2024-09-12T02:43:50.200 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_deletes", 2024-09-12T02:43:50.200 INFO:teuthology.orchestra.run.smithi112.stdout: "sortbitwise" 2024-09-12T02:43:50.200 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:50.200 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_version": 4, 2024-09-12T02:43:50.200 INFO:teuthology.orchestra.run.smithi112.stdout: "full_ratio": 0.69999998807907104, 2024-09-12T02:43:50.200 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-12T02:43:50.200 INFO:teuthology.orchestra.run.smithi112.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-12T02:43:50.200 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_snapshot": "", 2024-09-12T02:43:50.200 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_max": 7, 2024-09-12T02:43:50.200 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd": 8, 2024-09-12T02:43:50.201 INFO:teuthology.orchestra.run.smithi112.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:43:50.201 INFO:teuthology.orchestra.run.smithi112.stdout: "min_compat_client": "luminous", 2024-09-12T02:43:50.201 INFO:teuthology.orchestra.run.smithi112.stdout: "require_osd_release": "squid", 2024-09-12T02:43:50.201 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_crimson": false, 2024-09-12T02:43:50.201 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-12T02:43:50.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.201 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 1, 2024-09-12T02:43:50.201 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": ".mgr", 2024-09-12T02:43:50.201 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:41:43.011599+0000", 2024-09-12T02:43:50.201 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:43:50.201 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:43:50.201 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:43:50.201 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:43:50.202 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:43:50.202 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:43:50.202 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:43:50.202 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:43:50.202 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:43:50.202 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:43:50.202 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:43:50.202 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:43:50.202 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:43:50.202 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 1, 2024-09-12T02:43:50.202 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 1, 2024-09-12T02:43:50.202 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 1, 2024-09-12T02:43:50.202 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 1, 2024-09-12T02:43:50.203 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 1, 2024-09-12T02:43:50.203 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:43:50.203 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:43:50.203 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:43:50.203 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:43:50.203 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:43:50.203 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:43:50.203 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:43:50.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.203 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "53", 2024-09-12T02:43:50.203 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:43:50.203 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:43:50.203 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:43:50.203 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:43:50.204 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:43:50.204 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:43:50.204 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:43:50.204 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:43:50.204 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:43:50.204 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:43:50.204 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:43:50.204 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:43:50.204 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:43:50.204 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:43:50.204 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:43:50.204 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:43:50.204 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:43:50.204 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:43:50.205 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:43:50.205 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:43:50.205 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:43:50.205 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:43:50.205 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:43:50.205 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:43:50.205 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:43:50.205 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:43:50.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.205 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:43:50.205 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:43:50.205 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:43:50.205 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:43:50.206 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:43:50.206 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:43:50.206 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:43:50.206 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:43:50.206 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:43:50.206 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:43:50.206 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:43:50.206 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:43:50.206 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_max": 32, 2024-09-12T02:43:50.206 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 1 2024-09-12T02:43:50.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.206 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:43:50.206 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": {} 2024-09-12T02:43:50.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.207 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:43:50.207 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:43:50.207 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 8, 2024-09-12T02:43:50.207 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 8, 2024-09-12T02:43:50.207 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 0.25, 2024-09-12T02:43:50.207 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:43:50.207 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:43:50.207 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:43:50.207 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:43:50.207 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:43:50.207 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.208 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 6, 2024-09-12T02:43:50.208 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:43:50.208 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:43:14.483471+0000", 2024-09-12T02:43:50.208 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:43:50.208 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:43:50.208 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:43:50.208 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:43:50.208 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:43:50.208 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:43:50.209 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:43:50.209 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:43:50.209 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:43:50.209 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:43:50.209 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:43:50.209 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:43:50.209 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:43:50.209 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 32, 2024-09-12T02:43:50.209 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 32, 2024-09-12T02:43:50.209 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 32, 2024-09-12T02:43:50.210 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 32, 2024-09-12T02:43:50.210 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 32, 2024-09-12T02:43:50.210 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:43:50.210 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:43:50.210 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:43:50.210 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:43:50.210 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:43:50.210 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:43:50.210 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:43:50.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.210 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "53", 2024-09-12T02:43:50.210 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:43:50.210 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:43:50.211 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:43:50.211 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:43:50.211 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:43:50.211 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:43:50.211 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:43:50.211 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:43:50.211 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:43:50.211 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:43:50.211 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:43:50.211 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:43:50.211 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:43:50.212 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:43:50.212 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:43:50.212 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:43:50.212 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:43:50.212 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:43:50.212 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:43:50.212 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:43:50.212 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:43:50.212 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:43:50.212 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:43:50.213 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:43:50.213 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:43:50.213 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:43:50.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.213 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:43:50.213 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:43:50.213 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:43:50.213 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:43:50.213 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:43:50.213 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:43:50.213 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:43:50.213 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:43:50.214 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:43:50.214 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:43:50.214 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:43:50.214 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:43:50.214 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:43:50.214 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 16, 2024-09-12T02:43:50.214 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_priority": 5 2024-09-12T02:43:50.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.214 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:43:50.214 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:43:50.214 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": "cephfs" 2024-09-12T02:43:50.214 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.214 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:43:50.215 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:43:50.215 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.75, 2024-09-12T02:43:50.215 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.75, 2024-09-12T02:43:50.215 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:43:50.215 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.75, 2024-09-12T02:43:50.215 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.75, 2024-09-12T02:43:50.215 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:43:50.215 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:43:50.215 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:43:50.215 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.215 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 7, 2024-09-12T02:43:50.215 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_data", 2024-09-12T02:43:50.216 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:43:15.711619+0000", 2024-09-12T02:43:50.216 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:43:50.216 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:43:50.216 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:43:50.216 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:43:50.216 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:43:50.216 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:43:50.216 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:43:50.216 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:43:50.216 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:43:50.216 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:43:50.216 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:43:50.216 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:43:50.217 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:43:50.217 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 64, 2024-09-12T02:43:50.217 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 64, 2024-09-12T02:43:50.217 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 64, 2024-09-12T02:43:50.217 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 64, 2024-09-12T02:43:50.217 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 64, 2024-09-12T02:43:50.217 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:43:50.217 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:43:50.217 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:43:50.217 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:43:50.217 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:43:50.217 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:43:50.217 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:43:50.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.218 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "53", 2024-09-12T02:43:50.218 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:43:50.218 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:43:50.218 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:43:50.218 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:43:50.218 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:43:50.218 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:43:50.218 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:43:50.218 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:43:50.218 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:43:50.218 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:43:50.218 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:43:50.218 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:43:50.219 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:43:50.219 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:43:50.219 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:43:50.219 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:43:50.219 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:43:50.219 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:43:50.219 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:43:50.219 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:43:50.219 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:43:50.219 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:43:50.219 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:43:50.220 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:43:50.220 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:43:50.220 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:43:50.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.220 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:43:50.220 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:43:50.220 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:43:50.220 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:43:50.220 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:43:50.220 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:43:50.220 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:43:50.220 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:43:50.220 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:43:50.221 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:43:50.221 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:43:50.221 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:43:50.221 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 64, 2024-09-12T02:43:50.221 INFO:teuthology.orchestra.run.smithi112.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:43:50.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.221 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:43:50.221 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:43:50.221 INFO:teuthology.orchestra.run.smithi112.stdout: "data": "cephfs" 2024-09-12T02:43:50.221 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.221 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:43:50.221 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:43:50.221 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.75, 2024-09-12T02:43:50.222 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.75, 2024-09-12T02:43:50.222 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:43:50.222 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.75, 2024-09-12T02:43:50.222 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.75, 2024-09-12T02:43:50.222 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:43:50.222 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:43:50.222 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:43:50.222 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.222 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.222 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:50.222 INFO:teuthology.orchestra.run.smithi112.stdout: "osds": [ 2024-09-12T02:43:50.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.222 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:43:50.222 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:50.223 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:50.223 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:50.223 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:50.223 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:50.223 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:50.223 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:50.223 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:50.223 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:50.223 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:50.223 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:50.223 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:50.223 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.223 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.224 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6800", 2024-09-12T02:43:50.224 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:50.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.224 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.224 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6801", 2024-09-12T02:43:50.224 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:50.224 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.224 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.224 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:50.224 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.225 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.225 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6802", 2024-09-12T02:43:50.225 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:50.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.225 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.225 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6803", 2024-09-12T02:43:50.225 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:50.225 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.225 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.226 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:50.226 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.226 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.226 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6806", 2024-09-12T02:43:50.226 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:50.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.226 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.226 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6807", 2024-09-12T02:43:50.226 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:50.226 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.226 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.227 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:50.227 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.227 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.227 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6804", 2024-09-12T02:43:50.227 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:50.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.227 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.227 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6805", 2024-09-12T02:43:50.227 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:43:50.227 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.227 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.228 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6801/821571304", 2024-09-12T02:43:50.228 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6803/821571304", 2024-09-12T02:43:50.228 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6807/821571304", 2024-09-12T02:43:50.228 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6805/821571304", 2024-09-12T02:43:50.228 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:50.228 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:50.228 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:50.228 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.228 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:43:50.228 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:50.229 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:50.229 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:50.229 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:50.229 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:50.229 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:50.229 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:50.229 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:50.229 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:50.229 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:50.229 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:50.229 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:50.229 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.229 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.230 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6808", 2024-09-12T02:43:50.230 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:50.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.230 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.230 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6809", 2024-09-12T02:43:50.230 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:50.230 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.230 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.230 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:50.230 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.231 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.231 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6810", 2024-09-12T02:43:50.231 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:50.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.231 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.231 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6811", 2024-09-12T02:43:50.231 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:50.231 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.231 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.231 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:50.231 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.232 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.232 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6814", 2024-09-12T02:43:50.232 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:50.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.232 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.232 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6815", 2024-09-12T02:43:50.232 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:50.232 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.232 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.233 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:50.233 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.233 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.233 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6812", 2024-09-12T02:43:50.233 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:50.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.233 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.233 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6813", 2024-09-12T02:43:50.234 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:43:50.234 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.234 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.234 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6809/2642068641", 2024-09-12T02:43:50.234 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6811/2642068641", 2024-09-12T02:43:50.234 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6815/2642068641", 2024-09-12T02:43:50.234 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6813/2642068641", 2024-09-12T02:43:50.234 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:50.234 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:50.234 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:50.234 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.235 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:43:50.235 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:50.235 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:50.235 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:50.235 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:50.235 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:50.235 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:50.235 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:50.235 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:50.235 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:50.235 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:50.235 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:50.235 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:50.236 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.236 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.236 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6816", 2024-09-12T02:43:50.236 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:50.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.236 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.236 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6817", 2024-09-12T02:43:50.236 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:50.236 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.236 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.237 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:50.237 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.237 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.237 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6818", 2024-09-12T02:43:50.237 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:50.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.237 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.237 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6819", 2024-09-12T02:43:50.237 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:50.237 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.237 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.238 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:50.238 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.238 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.238 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6822", 2024-09-12T02:43:50.238 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:50.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.238 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.238 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6823", 2024-09-12T02:43:50.238 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:50.238 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.238 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.238 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:50.239 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.239 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.239 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6820", 2024-09-12T02:43:50.239 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:50.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.239 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.239 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6821", 2024-09-12T02:43:50.239 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:43:50.239 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.239 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.239 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6817/3365688807", 2024-09-12T02:43:50.239 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6819/3365688807", 2024-09-12T02:43:50.240 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6823/3365688807", 2024-09-12T02:43:50.240 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6821/3365688807", 2024-09-12T02:43:50.240 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:50.240 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:50.240 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:50.240 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.240 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:43:50.240 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:50.240 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:50.240 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:50.240 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:50.240 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:50.241 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:50.241 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:50.241 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:50.241 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:50.241 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:50.241 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:50.241 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:50.241 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.241 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.241 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6824", 2024-09-12T02:43:50.241 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:50.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.242 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.242 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6825", 2024-09-12T02:43:50.242 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:50.242 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.242 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.242 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:50.242 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.242 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.243 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6826", 2024-09-12T02:43:50.243 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:50.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.243 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.243 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6827", 2024-09-12T02:43:50.243 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:50.243 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.243 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.243 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:50.243 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.244 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.244 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6830", 2024-09-12T02:43:50.244 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:50.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.244 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.244 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6831", 2024-09-12T02:43:50.244 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:50.244 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.244 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.245 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:50.245 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.245 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.245 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6828", 2024-09-12T02:43:50.245 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:50.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.245 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.245 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6829", 2024-09-12T02:43:50.245 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:43:50.246 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.246 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.246 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6825/231774278", 2024-09-12T02:43:50.246 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6827/231774278", 2024-09-12T02:43:50.246 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6831/231774278", 2024-09-12T02:43:50.246 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6829/231774278", 2024-09-12T02:43:50.246 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:50.246 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:50.246 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:50.246 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.247 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:43:50.247 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:50.247 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:50.247 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:50.247 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:50.247 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:50.247 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:50.247 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:50.247 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:50.247 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:50.247 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:50.247 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:50.247 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:50.247 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.248 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.248 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6800", 2024-09-12T02:43:50.248 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:50.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.248 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.248 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6801", 2024-09-12T02:43:50.248 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:50.248 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.248 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.249 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:50.249 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.249 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.249 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6802", 2024-09-12T02:43:50.249 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:50.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.249 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.249 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6803", 2024-09-12T02:43:50.250 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:50.250 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.250 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.250 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:50.250 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.250 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.250 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6806", 2024-09-12T02:43:50.251 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:50.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.251 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.251 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6807", 2024-09-12T02:43:50.251 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:50.251 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.251 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.251 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:50.251 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.252 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.252 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6804", 2024-09-12T02:43:50.252 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:50.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.252 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.252 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6805", 2024-09-12T02:43:50.252 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:43:50.252 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.252 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.253 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6801/3671178153", 2024-09-12T02:43:50.253 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6803/3671178153", 2024-09-12T02:43:50.253 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6807/3671178153", 2024-09-12T02:43:50.253 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6805/3671178153", 2024-09-12T02:43:50.253 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:50.253 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:50.253 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:50.253 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.253 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:43:50.253 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:50.253 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:50.254 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:50.254 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:50.254 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:50.254 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:50.254 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:50.254 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:50.254 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 49, 2024-09-12T02:43:50.254 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:50.254 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:50.254 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:50.254 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.254 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.254 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6808", 2024-09-12T02:43:50.254 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:50.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.255 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.255 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6809", 2024-09-12T02:43:50.255 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:50.255 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.255 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.255 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:50.255 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.255 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.255 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6810", 2024-09-12T02:43:50.255 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:50.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.256 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.256 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6811", 2024-09-12T02:43:50.256 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:50.256 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.256 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.256 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:50.256 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.256 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.256 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6817", 2024-09-12T02:43:50.256 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:50.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.257 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.257 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6819", 2024-09-12T02:43:50.257 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:50.257 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.257 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.257 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:50.257 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.257 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.257 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6812", 2024-09-12T02:43:50.258 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:50.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.258 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.258 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6815", 2024-09-12T02:43:50.258 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:43:50.258 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.258 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.258 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6809/3193706134", 2024-09-12T02:43:50.258 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6811/3193706134", 2024-09-12T02:43:50.258 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6819/3193706134", 2024-09-12T02:43:50.258 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6815/3193706134", 2024-09-12T02:43:50.258 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:50.259 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:50.259 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:50.259 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.259 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:43:50.259 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:50.259 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:50.259 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:50.259 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:50.259 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:50.259 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:50.259 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:50.259 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:50.260 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 49, 2024-09-12T02:43:50.260 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:50.260 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:50.260 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:50.260 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.260 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.260 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6813", 2024-09-12T02:43:50.260 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:50.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.260 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.260 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6814", 2024-09-12T02:43:50.260 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:50.261 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.261 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.261 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:50.261 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.261 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.261 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6816", 2024-09-12T02:43:50.261 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:50.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.261 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.261 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6818", 2024-09-12T02:43:50.262 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:50.262 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.262 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.262 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:50.262 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.262 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.262 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6822", 2024-09-12T02:43:50.262 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:50.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.263 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.263 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6823", 2024-09-12T02:43:50.263 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:50.263 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.263 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.263 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:50.263 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.263 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.263 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6820", 2024-09-12T02:43:50.263 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:50.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.264 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.264 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6821", 2024-09-12T02:43:50.264 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:43:50.264 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.264 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.264 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6814/3738813293", 2024-09-12T02:43:50.264 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6818/3738813293", 2024-09-12T02:43:50.264 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6823/3738813293", 2024-09-12T02:43:50.264 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6821/3738813293", 2024-09-12T02:43:50.264 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:50.264 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:50.264 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:50.265 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.265 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:43:50.265 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:43:50.265 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:43:50.265 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:43:50.265 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:43:50.265 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:43:50.265 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:43:50.265 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:43:50.265 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:43:50.266 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 43, 2024-09-12T02:43:50.266 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:43:50.266 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:43:50.266 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:43:50.266 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.266 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.266 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6824", 2024-09-12T02:43:50.266 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:50.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.266 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.266 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6825", 2024-09-12T02:43:50.266 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:50.267 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.267 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.267 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:43:50.267 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.267 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.267 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6826", 2024-09-12T02:43:50.267 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:50.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.267 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.267 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6827", 2024-09-12T02:43:50.268 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:50.268 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.268 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.268 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:43:50.268 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.268 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.268 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6830", 2024-09-12T02:43:50.268 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:50.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.269 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.269 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6831", 2024-09-12T02:43:50.269 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:50.269 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.269 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.269 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:43:50.269 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:43:50.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.269 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:43:50.270 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6828", 2024-09-12T02:43:50.270 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:50.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.270 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:43:50.270 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6829", 2024-09-12T02:43:50.270 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:43:50.270 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.270 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.270 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6825/1421932609", 2024-09-12T02:43:50.270 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6827/1421932609", 2024-09-12T02:43:50.270 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6831/1421932609", 2024-09-12T02:43:50.270 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6829/1421932609", 2024-09-12T02:43:50.270 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:43:50.271 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:43:50.271 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:43:50.271 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.271 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.271 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:50.271 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_xinfo": [ 2024-09-12T02:43:50.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.271 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:43:50.271 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:50.271 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:50.271 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:50.271 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:50.272 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:50.272 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.220641+0000", 2024-09-12T02:43:50.272 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:50.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.272 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:43:50.272 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:50.272 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:50.272 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:50.272 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:50.272 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:50.272 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312574+0000", 2024-09-12T02:43:50.272 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:50.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.273 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:43:50.273 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:50.273 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:50.273 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:50.273 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:50.273 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:50.273 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.282771+0000", 2024-09-12T02:43:50.273 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:50.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.274 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:43:50.274 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:50.274 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:50.274 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:50.274 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:50.274 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:50.274 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.260478+0000", 2024-09-12T02:43:50.274 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:50.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.274 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:43:50.274 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:50.275 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:50.275 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:50.275 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:50.275 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:50.275 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.273397+0000", 2024-09-12T02:43:50.275 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:50.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.275 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:43:50.275 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:50.275 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:50.276 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:50.276 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:50.276 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:50.276 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312452+0000", 2024-09-12T02:43:50.276 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:50.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.276 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:43:50.276 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:50.276 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:50.277 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:50.277 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:50.277 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:50.277 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.308965+0000", 2024-09-12T02:43:50.277 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:50.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.277 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:43:50.277 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:43:50.277 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:43:50.277 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:43:50.277 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:43:50.277 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:43:50.278 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.337842+0000", 2024-09-12T02:43:50.278 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:43:50.278 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.278 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:50.278 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap": [], 2024-09-12T02:43:50.278 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_items": [ 2024-09-12T02:43:50.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.278 INFO:teuthology.orchestra.run.smithi112.stdout: "pgid": "7.12", 2024-09-12T02:43:50.278 INFO:teuthology.orchestra.run.smithi112.stdout: "mappings": [ 2024-09-12T02:43:50.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.278 INFO:teuthology.orchestra.run.smithi112.stdout: "from": 0, 2024-09-12T02:43:50.278 INFO:teuthology.orchestra.run.smithi112.stdout: "to": 5 2024-09-12T02:43:50.278 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.278 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.279 INFO:teuthology.orchestra.run.smithi112.stdout: "pgid": "7.3b", 2024-09-12T02:43:50.279 INFO:teuthology.orchestra.run.smithi112.stdout: "mappings": [ 2024-09-12T02:43:50.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:43:50.279 INFO:teuthology.orchestra.run.smithi112.stdout: "from": 0, 2024-09-12T02:43:50.279 INFO:teuthology.orchestra.run.smithi112.stdout: "to": 4 2024-09-12T02:43:50.279 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.279 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:43:50.280 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.280 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:43:50.280 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_primaries": [], 2024-09-12T02:43:50.280 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_temp": [], 2024-09-12T02:43:50.280 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_temp": [], 2024-09-12T02:43:50.280 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklist": {}, 2024-09-12T02:43:50.280 INFO:teuthology.orchestra.run.smithi112.stdout: "range_blocklist": {}, 2024-09-12T02:43:50.280 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profiles": { 2024-09-12T02:43:50.280 INFO:teuthology.orchestra.run.smithi112.stdout: "default": { 2024-09-12T02:43:50.280 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-failure-domain": "osd", 2024-09-12T02:43:50.280 INFO:teuthology.orchestra.run.smithi112.stdout: "k": "2", 2024-09-12T02:43:50.280 INFO:teuthology.orchestra.run.smithi112.stdout: "m": "1", 2024-09-12T02:43:50.281 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin": "jerasure", 2024-09-12T02:43:50.281 INFO:teuthology.orchestra.run.smithi112.stdout: "technique": "reed_sol_van" 2024-09-12T02:43:50.281 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:43:50.281 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps_queue": [], 2024-09-12T02:43:50.281 INFO:teuthology.orchestra.run.smithi112.stdout: "new_removed_snaps": [], 2024-09-12T02:43:50.281 INFO:teuthology.orchestra.run.smithi112.stdout: "new_purged_snaps": [], 2024-09-12T02:43:50.281 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_node_flags": {}, 2024-09-12T02:43:50.281 INFO:teuthology.orchestra.run.smithi112.stdout: "device_class_flags": {}, 2024-09-12T02:43:50.281 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode": { 2024-09-12T02:43:50.281 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_enabled": false, 2024-09-12T02:43:50.281 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_bucket_count": 0, 2024-09-12T02:43:50.281 INFO:teuthology.orchestra.run.smithi112.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:43:50.282 INFO:teuthology.orchestra.run.smithi112.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:43:50.282 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_bucket": 0 2024-09-12T02:43:50.282 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:43:50.282 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:43:50.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.200+0000 7f70ef800640 1 -- 172.21.15.112:0/1924124196 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f70c406be30 msgr2=0x7f70c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:50.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.200+0000 7f70ef800640 1 --2- 172.21.15.112:0/1924124196 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f70c406be30 0x7f70c406e2f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f70d0007fd0 tx=0x7f70d0007940 comp rx=0 tx=0).stop 2024-09-12T02:43:50.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.200+0000 7f70ef800640 1 -- 172.21.15.112:0/1924124196 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70e806f600 msgr2=0x7f70e8151770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:50.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.200+0000 7f70ef800640 1 --2- 172.21.15.112:0/1924124196 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70e806f600 0x7f70e8151770 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f70d8035040 tx=0x7f70d80046c0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.200+0000 7f70ef800640 1 -- 172.21.15.112:0/1924124196 shutdown_connections 2024-09-12T02:43:50.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.200+0000 7f70ef800640 1 --2- 172.21.15.112:0/1924124196 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f70c406be30 0x7f70c406e2f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.200+0000 7f70ef800640 1 --2- 172.21.15.112:0/1924124196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70e815b9d0 0x7f70e815c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.200+0000 7f70ef800640 1 --2- 172.21.15.112:0/1924124196 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70e80b45d0 0x7f70e80cf860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.200+0000 7f70ef800640 1 --2- 172.21.15.112:0/1924124196 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70e806f600 0x7f70e8151770 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.200+0000 7f70ef800640 1 -- 172.21.15.112:0/1924124196 >> 172.21.15.112:0/1924124196 conn(0x7f70e806bbd0 msgr2=0x7f70e815ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:50.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.200+0000 7f70ef800640 1 -- 172.21.15.112:0/1924124196 shutdown_connections 2024-09-12T02:43:50.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.200+0000 7f70ef800640 1 -- 172.21.15.112:0/1924124196 wait complete. 2024-09-12T02:43:50.285 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:43:50.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.437+0000 7f0b15600640 1 Processor -- start 2024-09-12T02:43:50.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.437+0000 7f0b15600640 1 -- start start 2024-09-12T02:43:50.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.439+0000 7f0b15600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0b10071530 0x7f0b100af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:50.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.439+0000 7f0b15600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b100ceeb0 con 0x7f0b100719a0 2024-09-12T02:43:50.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.439+0000 7f0b15600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b1006e300 con 0x7f0b1015cc50 2024-09-12T02:43:50.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.439+0000 7f0b15600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f0b1015d030 con 0x7f0b10071530 2024-09-12T02:43:50.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.439+0000 7f0b0f400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f0b100719a0 0x7f0b100cf950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:54754/0 (socket says 172.21.15.112:54754) 2024-09-12T02:43:50.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.439+0000 7f0b0f400640 1 -- 172.21.15.112:0/1384035007 learned_addr learned my addr 172.21.15.112:0/1384035007 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:50.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.439+0000 7f0b06000640 1 --2- 172.21.15.112:0/1384035007 >> v2:172.21.15.137:3300/0 conn(0x7f0b10071530 0x7f0b100af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:50.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.439+0000 7f0b0e000640 1 -- 172.21.15.112:0/1384035007 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 109122756 0 0) 0x7f0b100ceeb0 con 0x7f0b100719a0 2024-09-12T02:43:50.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.439+0000 7f0b0e000640 1 -- 172.21.15.112:0/1384035007 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0af4003520 con 0x7f0b100719a0 2024-09-12T02:43:50.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.440+0000 7f0b06000640 1 -- 172.21.15.112:0/1384035007 >> v1:172.21.15.137:6789/0 conn(0x7f0b1015cc50 legacy=0x7f0b100732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:50.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.440+0000 7f0b06000640 1 -- 172.21.15.112:0/1384035007 >> v1:172.21.15.112:6789/0 conn(0x7f0b100719a0 legacy=0x7f0b100cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:50.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.440+0000 7f0b06000640 1 -- 172.21.15.112:0/1384035007 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b1006e5e0 con 0x7f0b10071530 2024-09-12T02:43:50.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.441+0000 7f0b06000640 1 --2- 172.21.15.112:0/1384035007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b10071530 0x7f0b100af720 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0af8009790 tx=0x7f0af802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ab4ecd4ed7e23ad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:50.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.441+0000 7f0b0e000640 1 -- 172.21.15.112:0/1384035007 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af8037070 con 0x7f0b10071530 2024-09-12T02:43:50.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.441+0000 7f0b0e000640 1 -- 172.21.15.112:0/1384035007 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af8032440 con 0x7f0b10071530 2024-09-12T02:43:50.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.441+0000 7f0b0e000640 1 -- 172.21.15.112:0/1384035007 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af8032810 con 0x7f0b10071530 2024-09-12T02:43:50.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.441+0000 7f0b15600640 1 -- 172.21.15.112:0/1384035007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b10071530 msgr2=0x7f0b100af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:50.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.441+0000 7f0b15600640 1 --2- 172.21.15.112:0/1384035007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b10071530 0x7f0b100af720 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0af8009790 tx=0x7f0af802a180 comp rx=0 tx=0).stop 2024-09-12T02:43:50.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.441+0000 7f0b15600640 1 -- 172.21.15.112:0/1384035007 shutdown_connections 2024-09-12T02:43:50.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.441+0000 7f0b15600640 1 --2- 172.21.15.112:0/1384035007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b10071530 0x7f0b100af720 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.441+0000 7f0b15600640 1 -- 172.21.15.112:0/1384035007 >> 172.21.15.112:0/1384035007 conn(0x7f0b1006bbd0 msgr2=0x7f0b1006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:50.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.442+0000 7f0b15600640 1 -- 172.21.15.112:0/1384035007 shutdown_connections 2024-09-12T02:43:50.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.442+0000 7f0b15600640 1 -- 172.21.15.112:0/1384035007 wait complete. 2024-09-12T02:43:50.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.443+0000 7f0b15600640 1 Processor -- start 2024-09-12T02:43:50.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.443+0000 7f0b15600640 1 -- start start 2024-09-12T02:43:50.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.444+0000 7f0b15600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b10071530 0x7f0b101517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:50.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.444+0000 7f0b15600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b100719a0 0x7f0b1015dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:50.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.444+0000 7f0b15600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0b1015cc50 0x7f0b100cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:50.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.444+0000 7f0b15600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1006f510 con 0x7f0b10071530 2024-09-12T02:43:50.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.444+0000 7f0b15600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0b100cf4c0 con 0x7f0b100719a0 2024-09-12T02:43:50.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.444+0000 7f0b15600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0b1006f690 con 0x7f0b1015cc50 2024-09-12T02:43:50.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.444+0000 7f0b0ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b10071530 0x7f0b101517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:50.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.444+0000 7f0b0ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b10071530 0x7f0b101517e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47992/0 (socket says 172.21.15.112:47992) 2024-09-12T02:43:50.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.444+0000 7f0b0ea00640 1 -- 172.21.15.112:0/3718092933 learned_addr learned my addr 172.21.15.112:0/3718092933 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:50.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.445+0000 7f0b06000640 1 --2- 172.21.15.112:0/3718092933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b100719a0 0x7f0b1015dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:50.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.445+0000 7f0b0f400640 1 --2- 172.21.15.112:0/3718092933 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0b1015cc50 0x7f0b100cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:50.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.445+0000 7f0b0ea00640 1 -- 172.21.15.112:0/3718092933 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0b1015cc50 msgr2=0x7f0b100cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:50.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.445+0000 7f0b0ea00640 1 --2- 172.21.15.112:0/3718092933 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0b1015cc50 0x7f0b100cf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.445+0000 7f0b0ea00640 1 -- 172.21.15.112:0/3718092933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b100719a0 msgr2=0x7f0b1015dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:50.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.445+0000 7f0b0ea00640 1 --2- 172.21.15.112:0/3718092933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b100719a0 0x7f0b1015dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.445+0000 7f0b0ea00640 1 -- 172.21.15.112:0/3718092933 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b10152080 con 0x7f0b10071530 2024-09-12T02:43:50.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.445+0000 7f0b0ea00640 1 --2- 172.21.15.112:0/3718092933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b10071530 0x7f0b101517e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0b0000c3f0 tx=0x7f0b0000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:50.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.445+0000 7f0b07400640 1 -- 172.21.15.112:0/3718092933 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b000052d0 con 0x7f0b10071530 2024-09-12T02:43:50.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.445+0000 7f0b07400640 1 -- 172.21.15.112:0/3718092933 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b00005490 con 0x7f0b10071530 2024-09-12T02:43:50.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.445+0000 7f0b15600640 1 -- 172.21.15.112:0/3718092933 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b10152360 con 0x7f0b10071530 2024-09-12T02:43:50.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.445+0000 7f0b07400640 1 -- 172.21.15.112:0/3718092933 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b00007260 con 0x7f0b10071530 2024-09-12T02:43:50.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.446+0000 7f0b15600640 1 -- 172.21.15.112:0/3718092933 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b10152c00 con 0x7f0b10071530 2024-09-12T02:43:50.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.447+0000 7f0b15600640 1 -- 172.21.15.112:0/3718092933 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b10152750 con 0x7f0b10071530 2024-09-12T02:43:50.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.447+0000 7f0b07400640 1 -- 172.21.15.112:0/3718092933 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0b00007400 con 0x7f0b10071530 2024-09-12T02:43:50.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.448+0000 7f0b07400640 1 --2- 172.21.15.112:0/3718092933 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0aec06be30 0x7f0aec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:50.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.448+0000 7f0b07400640 1 -- 172.21.15.112:0/3718092933 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5767+0+0 (secure 0 0 0) 0x7f0b0008a2e0 con 0x7f0b10071530 2024-09-12T02:43:50.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.448+0000 7f0b06000640 1 --2- 172.21.15.112:0/3718092933 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0aec06be30 0x7f0aec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:50.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.449+0000 7f0b06000640 1 --2- 172.21.15.112:0/3718092933 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0aec06be30 0x7f0aec06e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0af8034000 tx=0x7f0af802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:50.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.453+0000 7f0b07400640 1 -- 172.21.15.112:0/3718092933 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0b00058570 con 0x7f0b10071530 2024-09-12T02:43:50.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.659+0000 7f0b15600640 1 -- 172.21.15.112:0/3718092933 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b10068a30 con 0x7f0b10071530 2024-09-12T02:43:50.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.659+0000 7f0b07400640 1 -- 172.21.15.112:0/3718092933 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5229 (secure 0 0 0) 0x7f0b0005c870 con 0x7f0b10071530 2024-09-12T02:43:50.661 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:50.661 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":27,"btime":"2024-09-12T02:43:20:337397+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5008,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/362211662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":362211662},{"type":"v1","addr":"172.21.15.112:6836","nonce":362211662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5011,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/193733805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":193733805},{"type":"v1","addr":"172.21.15.112:6837","nonce":193733805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/3440642333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3440642333},{"type":"v1","addr":"172.21.15.137:6834","nonce":3440642333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:43:16.722971+0000","modified":"2024-09-12T02:43:19.743614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"b","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/3597512060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3597512060},{"type":"v1","addr":"172.21.15.137:6835","nonce":3597512060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":3}]} 2024-09-12T02:43:50.661 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 27 2024-09-12T02:43:50.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.661+0000 7f0b15600640 1 -- 172.21.15.112:0/3718092933 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0aec06be30 msgr2=0x7f0aec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:50.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.661+0000 7f0b15600640 1 --2- 172.21.15.112:0/3718092933 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0aec06be30 0x7f0aec06e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0af8034000 tx=0x7f0af802e000 comp rx=0 tx=0).stop 2024-09-12T02:43:50.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.661+0000 7f0b15600640 1 -- 172.21.15.112:0/3718092933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b10071530 msgr2=0x7f0b101517e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:50.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.662+0000 7f0b15600640 1 --2- 172.21.15.112:0/3718092933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b10071530 0x7f0b101517e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0b0000c3f0 tx=0x7f0b0000c8b0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.662+0000 7f0b15600640 1 -- 172.21.15.112:0/3718092933 shutdown_connections 2024-09-12T02:43:50.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.662+0000 7f0b15600640 1 --2- 172.21.15.112:0/3718092933 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0b1015cc50 0x7f0b100cf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.662+0000 7f0b15600640 1 --2- 172.21.15.112:0/3718092933 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0aec06be30 0x7f0aec06e2f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.662+0000 7f0b15600640 1 --2- 172.21.15.112:0/3718092933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b100719a0 0x7f0b1015dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.662+0000 7f0b15600640 1 --2- 172.21.15.112:0/3718092933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b10071530 0x7f0b101517e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:50.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.662+0000 7f0b15600640 1 -- 172.21.15.112:0/3718092933 >> 172.21.15.112:0/3718092933 conn(0x7f0b1006bbd0 msgr2=0x7f0b10159250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:50.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.662+0000 7f0b15600640 1 -- 172.21.15.112:0/3718092933 shutdown_connections 2024-09-12T02:43:50.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:50.662+0000 7f0b15600640 1 -- 172.21.15.112:0/3718092933 wait complete. 2024-09-12T02:43:50.679 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2024-09-12T02:43:50.784 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:43:50.788 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:43:50.866 INFO:teuthology.orchestra.run.smithi137.stdout:{"cluster_fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","whoami":0,"id":5017,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":33.523344041999998,"mdsmap_epoch":27,"osdmap_epoch":53,"osdmap_epoch_barrier":48,"uptime":37.924809303000004} 2024-09-12T02:43:50.866 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", "fs_name": "cephfs", "id": 5017, "mdsmap_epoch": 27, "osdmap_epoch": 53, "osdmap_epoch_barrier": 48, "rank_uptime": 33.523344042, "state": "up:active", "uptime": 37.924809303, "want_state": "up:active", "whoami": 0 } 2024-09-12T02:43:50.867 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:43:50.867 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:43:50.867 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:43:50.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:43:50.942 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2024-09-12T02:43:51.364 INFO:teuthology.orchestra.run.smithi112.stderr:50+0 records in 2024-09-12T02:43:51.364 INFO:teuthology.orchestra.run.smithi112.stderr:50+0 records out 2024-09-12T02:43:51.364 INFO:teuthology.orchestra.run.smithi112.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.345416 s, 152 MB/s 2024-09-12T02:43:51.365 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:43:51.365 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:43:51.451 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:43:51.541 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:43:51.541 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:43:51.541 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:43:51.541 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:43:51.577 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:43:51.577 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:43:51.653 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:43:51.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.844+0000 7faadbc00640 1 Processor -- start 2024-09-12T02:43:51.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.845+0000 7faadbc00640 1 -- start start 2024-09-12T02:43:51.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.846+0000 7faadbc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faad4071530 0x7faad40af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:51.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.846+0000 7faadbc00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7faad4071970 0x7faad40afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:51.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.846+0000 7faadbc00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faad40ceeb0 con 0x7faad415cc50 2024-09-12T02:43:51.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.846+0000 7faadbc00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7faad415d030 con 0x7faad4071970 2024-09-12T02:43:51.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.846+0000 7faadbc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7faad40cf4c0 con 0x7faad4071530 2024-09-12T02:43:51.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.846+0000 7faad9200640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7faad415cc50 0x7faad40732f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38722/0 (socket says 172.21.15.112:38722) 2024-09-12T02:43:51.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.846+0000 7faad9200640 1 -- 172.21.15.112:0/3619194586 learned_addr learned my addr 172.21.15.112:0/3619194586 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:51.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.846+0000 7faacbe00640 1 --2- 172.21.15.112:0/3619194586 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faad4071530 0x7faad40af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:51.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.846+0000 7faad9c00640 1 --2- 172.21.15.112:0/3619194586 >> v2:172.21.15.137:3300/0 conn(0x7faad4071970 0x7faad40afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:51.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.846+0000 7faad3e00640 1 -- 172.21.15.112:0/3619194586 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 627926517 0 0) 0x7faad40ceeb0 con 0x7faad415cc50 2024-09-12T02:43:51.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.847+0000 7faad3e00640 1 -- 172.21.15.112:0/3619194586 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faab8003520 con 0x7faad415cc50 2024-09-12T02:43:51.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.847+0000 7faad3e00640 1 -- 172.21.15.112:0/3619194586 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1283132852 0 0) 0x7faab8003520 con 0x7faad415cc50 2024-09-12T02:43:51.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.847+0000 7faad3e00640 1 -- 172.21.15.112:0/3619194586 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faad4071530 msgr2=0x7faad40af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:51.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.847+0000 7faad3e00640 1 --2- 172.21.15.112:0/3619194586 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faad4071530 0x7faad40af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:51.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.847+0000 7faad3e00640 1 -- 172.21.15.112:0/3619194586 >> v2:172.21.15.137:3300/0 conn(0x7faad4071970 msgr2=0x7faad40afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:51.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.847+0000 7faad3e00640 1 --2- 172.21.15.112:0/3619194586 >> v2:172.21.15.137:3300/0 conn(0x7faad4071970 0x7faad40afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:51.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.847+0000 7faad3e00640 1 -- 172.21.15.112:0/3619194586 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faad406e300 con 0x7faad415cc50 2024-09-12T02:43:51.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.847+0000 7faad3e00640 1 -- 172.21.15.112:0/3619194586 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7faac4001670 con 0x7faad415cc50 2024-09-12T02:43:51.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.847+0000 7faad3e00640 1 -- 172.21.15.112:0/3619194586 >> v1:172.21.15.112:6789/0 conn(0x7faad415cc50 legacy=0x7faad40732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:51.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.847+0000 7faad3e00640 1 --2- 172.21.15.112:0/3619194586 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faad4071530 0x7faab80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:51.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.847+0000 7faad3e00640 1 --2- 172.21.15.112:0/3619194586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faab8003f30 0x7faab8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:51.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.847+0000 7faad3e00640 1 --2- 172.21.15.112:0/3619194586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faab8004d40 0x7faab80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:51.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.847+0000 7faad3e00640 1 -- 172.21.15.112:0/3619194586 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faad40cf4c0 con 0x7faab8003f30 2024-09-12T02:43:51.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.847+0000 7faad3e00640 1 -- 172.21.15.112:0/3619194586 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faab800b9c0 con 0x7faab8004d40 2024-09-12T02:43:51.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.847+0000 7faad3e00640 1 -- 172.21.15.112:0/3619194586 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7faab800bb90 con 0x7faad4071530 2024-09-12T02:43:51.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.847+0000 7faad9200640 1 --2- 172.21.15.112:0/3619194586 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faad4071530 0x7faab80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:51.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.847+0000 7faacbe00640 1 --2- 172.21.15.112:0/3619194586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faab8003f30 0x7faab8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:51.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.848+0000 7faad9c00640 1 --2- 172.21.15.112:0/3619194586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faab8004d40 0x7faab80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:51.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.848+0000 7faad9200640 1 -- 172.21.15.112:0/3619194586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faab8004d40 msgr2=0x7faab80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:51.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.848+0000 7faad9200640 1 --2- 172.21.15.112:0/3619194586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faab8004d40 0x7faab80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:51.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.848+0000 7faad9200640 1 -- 172.21.15.112:0/3619194586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faab8003f30 msgr2=0x7faab8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:51.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.848+0000 7faad9200640 1 --2- 172.21.15.112:0/3619194586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faab8003f30 0x7faab8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:51.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.848+0000 7faad9200640 1 -- 172.21.15.112:0/3619194586 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faab8003520 con 0x7faad4071530 2024-09-12T02:43:51.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.849+0000 7faad9200640 1 --2- 172.21.15.112:0/3619194586 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faad4071530 0x7faab80039b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faac400c2c0 tx=0x7faab8005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49945fde31f3a23e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:51.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.849+0000 7faad3e00640 1 -- 172.21.15.112:0/3619194586 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac4007d50 con 0x7faad4071530 2024-09-12T02:43:51.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.849+0000 7faad3e00640 1 -- 172.21.15.112:0/3619194586 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac402e070 con 0x7faad4071530 2024-09-12T02:43:51.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.849+0000 7faad3e00640 1 -- 172.21.15.112:0/3619194586 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac4005d70 con 0x7faad4071530 2024-09-12T02:43:51.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.849+0000 7faadbc00640 1 -- 172.21.15.112:0/3619194586 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faad4071530 msgr2=0x7faab80039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:51.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.849+0000 7faadbc00640 1 --2- 172.21.15.112:0/3619194586 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faad4071530 0x7faab80039b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faac400c2c0 tx=0x7faab8005830 comp rx=0 tx=0).stop 2024-09-12T02:43:51.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.850+0000 7faad9c00640 1 -- 172.21.15.112:0/3619194586 reap_dead start 2024-09-12T02:43:51.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.850+0000 7faadbc00640 1 -- 172.21.15.112:0/3619194586 shutdown_connections 2024-09-12T02:43:51.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.850+0000 7faadbc00640 1 -- 172.21.15.112:0/3619194586 >> 172.21.15.112:0/3619194586 conn(0x7faad406bbd0 msgr2=0x7faad406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:51.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.850+0000 7faadbc00640 1 -- 172.21.15.112:0/3619194586 shutdown_connections 2024-09-12T02:43:51.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.850+0000 7faadbc00640 1 -- 172.21.15.112:0/3619194586 wait complete. 2024-09-12T02:43:51.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.851+0000 7faadbc00640 1 Processor -- start 2024-09-12T02:43:51.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.851+0000 7faadbc00640 1 -- start start 2024-09-12T02:43:51.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.852+0000 7faadbc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faad4071530 0x7faad414dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:51.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.852+0000 7faadbc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faad4156060 0x7faad41564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:51.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.852+0000 7faadbc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faad40b5050 0x7faad40b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:51.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.852+0000 7faadbc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faad406f510 con 0x7faad4071530 2024-09-12T02:43:51.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.852+0000 7faadbc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faad40cf150 con 0x7faad40b5050 2024-09-12T02:43:51.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.852+0000 7faadbc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7faad406f690 con 0x7faad4156060 2024-09-12T02:43:51.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.853+0000 7faad9200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faad4071530 0x7faad414dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:51.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.853+0000 7faad9200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faad4071530 0x7faad414dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38054/0 (socket says 172.21.15.112:38054) 2024-09-12T02:43:51.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.853+0000 7faad9200640 1 -- 172.21.15.112:0/2520686302 learned_addr learned my addr 172.21.15.112:0/2520686302 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:51.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.853+0000 7faad9c00640 1 --2- 172.21.15.112:0/2520686302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faad40b5050 0x7faad40b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:51.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.853+0000 7faacbe00640 1 --2- 172.21.15.112:0/2520686302 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faad4156060 0x7faad41564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:51.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.853+0000 7faad9200640 1 -- 172.21.15.112:0/2520686302 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faad4156060 msgr2=0x7faad41564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:51.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.853+0000 7faad9200640 1 --2- 172.21.15.112:0/2520686302 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faad4156060 0x7faad41564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:51.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.853+0000 7faad9200640 1 -- 172.21.15.112:0/2520686302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faad40b5050 msgr2=0x7faad40b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:51.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.853+0000 7faad9200640 1 --2- 172.21.15.112:0/2520686302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faad40b5050 0x7faad40b54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:51.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.853+0000 7faad9200640 1 -- 172.21.15.112:0/2520686302 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faad40b3dc0 con 0x7faad4071530 2024-09-12T02:43:51.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.853+0000 7faad9c00640 1 --2- 172.21.15.112:0/2520686302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faad40b5050 0x7faad40b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:43:51.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.853+0000 7faad9200640 1 --2- 172.21.15.112:0/2520686302 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faad4071530 0x7faad414dc80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7faac400c2c0 tx=0x7faad406e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:51.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.854+0000 7faad1600640 1 -- 172.21.15.112:0/2520686302 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac4041070 con 0x7faad4071530 2024-09-12T02:43:51.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.854+0000 7faad1600640 1 -- 172.21.15.112:0/2520686302 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac4007280 con 0x7faad4071530 2024-09-12T02:43:51.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.854+0000 7faad1600640 1 -- 172.21.15.112:0/2520686302 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac4001c80 con 0x7faad4071530 2024-09-12T02:43:51.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.854+0000 7faadbc00640 1 -- 172.21.15.112:0/2520686302 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faad40b40a0 con 0x7faad4071530 2024-09-12T02:43:51.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.854+0000 7faadbc00640 1 -- 172.21.15.112:0/2520686302 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faad40b4660 con 0x7faad4071530 2024-09-12T02:43:51.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.855+0000 7faadbc00640 1 -- 172.21.15.112:0/2520686302 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faad4068a30 con 0x7faad4071530 2024-09-12T02:43:51.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.856+0000 7faad1600640 1 -- 172.21.15.112:0/2520686302 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faac4044070 con 0x7faad4071530 2024-09-12T02:43:51.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.857+0000 7faad1600640 1 --2- 172.21.15.112:0/2520686302 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7faab006be30 0x7faab006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:51.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.857+0000 7faad1600640 1 -- 172.21.15.112:0/2520686302 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5767+0+0 (secure 0 0 0) 0x7faac40aade0 con 0x7faad4071530 2024-09-12T02:43:51.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.857+0000 7faacbe00640 1 --2- 172.21.15.112:0/2520686302 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7faab006be30 0x7faab006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:51.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.858+0000 7faacbe00640 1 --2- 172.21.15.112:0/2520686302 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7faab006be30 0x7faab006e2f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7faad41f83b0 tx=0x7faabc009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:51.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:51.862+0000 7faad1600640 1 -- 172.21.15.112:0/2520686302 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faac404c020 con 0x7faad4071530 2024-09-12T02:43:52.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.045+0000 7faadbc00640 1 -- 172.21.15.112:0/2520686302 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7faad406df60 con 0x7faad4071530 2024-09-12T02:43:52.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.045+0000 7faad1600640 1 -- 172.21.15.112:0/2520686302 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v53) ==== 80+0+0 (secure 0 0 0) 0x7faac40796b0 con 0x7faad4071530 2024-09-12T02:43:52.046 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-12T02:43:52.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.048+0000 7faadbc00640 1 -- 172.21.15.112:0/2520686302 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7faab006be30 msgr2=0x7faab006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:52.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.048+0000 7faadbc00640 1 --2- 172.21.15.112:0/2520686302 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7faab006be30 0x7faab006e2f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7faad41f83b0 tx=0x7faabc009110 comp rx=0 tx=0).stop 2024-09-12T02:43:52.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.048+0000 7faadbc00640 1 -- 172.21.15.112:0/2520686302 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faad4071530 msgr2=0x7faad414dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:52.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.048+0000 7faadbc00640 1 --2- 172.21.15.112:0/2520686302 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faad4071530 0x7faad414dc80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7faac400c2c0 tx=0x7faad406e4d0 comp rx=0 tx=0).stop 2024-09-12T02:43:52.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.048+0000 7faadbc00640 1 -- 172.21.15.112:0/2520686302 shutdown_connections 2024-09-12T02:43:52.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.048+0000 7faadbc00640 1 --2- 172.21.15.112:0/2520686302 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7faab006be30 0x7faab006e2f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:52.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.048+0000 7faadbc00640 1 --2- 172.21.15.112:0/2520686302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faad40b5050 0x7faad40b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:52.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.048+0000 7faadbc00640 1 --2- 172.21.15.112:0/2520686302 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faad4156060 0x7faad41564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:52.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.048+0000 7faadbc00640 1 --2- 172.21.15.112:0/2520686302 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faad4071530 0x7faad414dc80 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:52.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.048+0000 7faadbc00640 1 -- 172.21.15.112:0/2520686302 >> 172.21.15.112:0/2520686302 conn(0x7faad406bbd0 msgr2=0x7faad40732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:52.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.048+0000 7faadbc00640 1 -- 172.21.15.112:0/2520686302 shutdown_connections 2024-09-12T02:43:52.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.048+0000 7faadbc00640 1 -- 172.21.15.112:0/2520686302 wait complete. 2024-09-12T02:43:52.064 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:43:52.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:43:52.064 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T02:43:52.163 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-12T02:43:52.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:43:52.163 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:43:52.205 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:43:52.205 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:43:52.205 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:43:52.242 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:43:52.242 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:43:52.317 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:43:52.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.471+0000 7f7b66e00640 1 Processor -- start 2024-09-12T02:43:52.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.471+0000 7f7b66e00640 1 -- start start 2024-09-12T02:43:52.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.472+0000 7f7b66e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7b6015f3b0 0x7f7b600732d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:52.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.472+0000 7f7b66e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7b60161c40 0x7f7b60168960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:52.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.472+0000 7f7b66e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b60073810 con 0x7f7b600b4180 2024-09-12T02:43:52.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.472+0000 7f7b66e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f7b601607a0 con 0x7f7b6015f3b0 2024-09-12T02:43:52.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.472+0000 7f7b66e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7b60073ab0 con 0x7f7b60161c40 2024-09-12T02:43:52.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.472+0000 7f7b65a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7b6015f3b0 0x7f7b600732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:52.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.472+0000 7f7b65a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7b6015f3b0 0x7f7b600732d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38056/0 (socket says 172.21.15.112:38056) 2024-09-12T02:43:52.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.472+0000 7f7b65a00640 1 -- 172.21.15.112:0/4458457 learned_addr learned my addr 172.21.15.112:0/4458457 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:52.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.472+0000 7f7b66400640 1 --2- 172.21.15.112:0/4458457 >> v2:172.21.15.137:3300/0 conn(0x7f7b60161c40 0x7f7b60168960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:52.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.473+0000 7f7b65a00640 1 -- 172.21.15.112:0/4458457 >> v2:172.21.15.137:3300/0 conn(0x7f7b60161c40 msgr2=0x7f7b60168960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:52.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.473+0000 7f7b65a00640 1 --2- 172.21.15.112:0/4458457 >> v2:172.21.15.137:3300/0 conn(0x7f7b60161c40 0x7f7b60168960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:52.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.473+0000 7f7b65a00640 1 -- 172.21.15.112:0/4458457 >> v1:172.21.15.137:6789/0 conn(0x7f7b600b4180 legacy=0x7f7b6015f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:52.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.473+0000 7f7b65a00640 1 -- 172.21.15.112:0/4458457 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b60073d90 con 0x7f7b6015f3b0 2024-09-12T02:43:52.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.473+0000 7f7b66400640 1 --2- 172.21.15.112:0/4458457 >> v2:172.21.15.137:3300/0 conn(0x7f7b60161c40 0x7f7b60168960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:43:52.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.474+0000 7f7b65a00640 1 --2- 172.21.15.112:0/4458457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b6015f3b0 0x7f7b600732d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7b600739e0 tx=0x7f7b5402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e05ae8a75f7b0c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:52.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.474+0000 7f7b5fe00640 1 -- 172.21.15.112:0/4458457 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b54036070 con 0x7f7b6015f3b0 2024-09-12T02:43:52.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.474+0000 7f7b5fe00640 1 -- 172.21.15.112:0/4458457 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b54031600 con 0x7f7b6015f3b0 2024-09-12T02:43:52.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.474+0000 7f7b5fe00640 1 -- 172.21.15.112:0/4458457 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b540319d0 con 0x7f7b6015f3b0 2024-09-12T02:43:52.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.475+0000 7f7b66e00640 1 -- 172.21.15.112:0/4458457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b6015f3b0 msgr2=0x7f7b600732d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:52.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.475+0000 7f7b66e00640 1 --2- 172.21.15.112:0/4458457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b6015f3b0 0x7f7b600732d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7b600739e0 tx=0x7f7b5402a6a0 comp rx=0 tx=0).stop 2024-09-12T02:43:52.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.475+0000 7f7b66e00640 1 -- 172.21.15.112:0/4458457 shutdown_connections 2024-09-12T02:43:52.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.475+0000 7f7b66e00640 1 --2- 172.21.15.112:0/4458457 >> v2:172.21.15.137:3300/0 conn(0x7f7b60161c40 0x7f7b60168960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:52.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.475+0000 7f7b66e00640 1 --2- 172.21.15.112:0/4458457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b6015f3b0 0x7f7b600732d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:52.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.475+0000 7f7b66e00640 1 -- 172.21.15.112:0/4458457 >> 172.21.15.112:0/4458457 conn(0x7f7b60072420 msgr2=0x7f7b600b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:52.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.475+0000 7f7b66e00640 1 -- 172.21.15.112:0/4458457 shutdown_connections 2024-09-12T02:43:52.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.475+0000 7f7b66e00640 1 -- 172.21.15.112:0/4458457 wait complete. 2024-09-12T02:43:52.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.476+0000 7f7b66e00640 1 Processor -- start 2024-09-12T02:43:52.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.476+0000 7f7b66e00640 1 -- start start 2024-09-12T02:43:52.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.477+0000 7f7b66e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b600b4180 0x7f7b60154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:52.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.477+0000 7f7b66e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b6015f3b0 0x7f7b6015a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:52.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.477+0000 7f7b66e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b60161c40 0x7f7b601f49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:52.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.477+0000 7f7b66e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7b60160020 con 0x7f7b6015f3b0 2024-09-12T02:43:52.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.477+0000 7f7b66e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6015fea0 con 0x7f7b60161c40 2024-09-12T02:43:52.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.477+0000 7f7b66e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7b601601a0 con 0x7f7b600b4180 2024-09-12T02:43:52.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.478+0000 7f7b65000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b6015f3b0 0x7f7b6015a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:52.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.478+0000 7f7b66400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b60161c40 0x7f7b601f49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:52.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.478+0000 7f7b65000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b6015f3b0 0x7f7b6015a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38058/0 (socket says 172.21.15.112:38058) 2024-09-12T02:43:52.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.478+0000 7f7b65000640 1 -- 172.21.15.112:0/128743987 learned_addr learned my addr 172.21.15.112:0/128743987 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:52.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.478+0000 7f7b65a00640 1 --2- 172.21.15.112:0/128743987 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b600b4180 0x7f7b60154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:52.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.478+0000 7f7b65000640 1 -- 172.21.15.112:0/128743987 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b600b4180 msgr2=0x7f7b60154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:52.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.478+0000 7f7b65000640 1 --2- 172.21.15.112:0/128743987 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b600b4180 0x7f7b60154cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:52.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.478+0000 7f7b65000640 1 -- 172.21.15.112:0/128743987 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b60161c40 msgr2=0x7f7b601f49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:52.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.478+0000 7f7b65000640 1 --2- 172.21.15.112:0/128743987 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b60161c40 0x7f7b601f49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:52.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.478+0000 7f7b65000640 1 -- 172.21.15.112:0/128743987 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b60156290 con 0x7f7b6015f3b0 2024-09-12T02:43:52.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.478+0000 7f7b65000640 1 --2- 172.21.15.112:0/128743987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b6015f3b0 0x7f7b6015a060 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c00c400 tx=0x7f7b4c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:52.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.478+0000 7f7b5d600640 1 -- 172.21.15.112:0/128743987 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c0052d0 con 0x7f7b6015f3b0 2024-09-12T02:43:52.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.479+0000 7f7b5d600640 1 -- 172.21.15.112:0/128743987 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b4c005490 con 0x7f7b6015f3b0 2024-09-12T02:43:52.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.479+0000 7f7b5d600640 1 -- 172.21.15.112:0/128743987 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c007260 con 0x7f7b6015f3b0 2024-09-12T02:43:52.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.479+0000 7f7b66e00640 1 -- 172.21.15.112:0/128743987 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b60156570 con 0x7f7b6015f3b0 2024-09-12T02:43:52.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.479+0000 7f7b66e00640 1 -- 172.21.15.112:0/128743987 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b60156b30 con 0x7f7b6015f3b0 2024-09-12T02:43:52.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.480+0000 7f7b66e00640 1 -- 172.21.15.112:0/128743987 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b600732d0 con 0x7f7b6015f3b0 2024-09-12T02:43:52.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.481+0000 7f7b5d600640 1 -- 172.21.15.112:0/128743987 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7b4c007400 con 0x7f7b6015f3b0 2024-09-12T02:43:52.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.481+0000 7f7b5d600640 1 --2- 172.21.15.112:0/128743987 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7b4006be30 0x7f7b4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:52.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.482+0000 7f7b5d600640 1 -- 172.21.15.112:0/128743987 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5767+0+0 (secure 0 0 0) 0x7f7b4c08a3d0 con 0x7f7b6015f3b0 2024-09-12T02:43:52.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.482+0000 7f7b65a00640 1 --2- 172.21.15.112:0/128743987 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7b4006be30 0x7f7b4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:52.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.482+0000 7f7b65a00640 1 --2- 172.21.15.112:0/128743987 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7b4006be30 0x7f7b4006e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7b54033000 tx=0x7f7b54009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:52.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.486+0000 7f7b5d600640 1 -- 172.21.15.112:0/128743987 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7b4c058650 con 0x7f7b6015f3b0 2024-09-12T02:43:52.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.669+0000 7f7b66e00640 1 -- 172.21.15.112:0/128743987 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7b60156d00 con 0x7f7b6015f3b0 2024-09-12T02:43:52.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.669+0000 7f7b5d600640 1 -- 172.21.15.112:0/128743987 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v53) ==== 80+0+0 (secure 0 0 0) 0x7f7b4c05c950 con 0x7f7b6015f3b0 2024-09-12T02:43:52.670 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-12T02:43:52.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.671+0000 7f7b66e00640 1 -- 172.21.15.112:0/128743987 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7b4006be30 msgr2=0x7f7b4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:52.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.671+0000 7f7b66e00640 1 --2- 172.21.15.112:0/128743987 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7b4006be30 0x7f7b4006e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7b54033000 tx=0x7f7b54009000 comp rx=0 tx=0).stop 2024-09-12T02:43:52.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.671+0000 7f7b66e00640 1 -- 172.21.15.112:0/128743987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b6015f3b0 msgr2=0x7f7b6015a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:52.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.671+0000 7f7b66e00640 1 --2- 172.21.15.112:0/128743987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b6015f3b0 0x7f7b6015a060 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c00c400 tx=0x7f7b4c00c8c0 comp rx=0 tx=0).stop 2024-09-12T02:43:52.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.671+0000 7f7b66e00640 1 -- 172.21.15.112:0/128743987 shutdown_connections 2024-09-12T02:43:52.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.671+0000 7f7b66e00640 1 --2- 172.21.15.112:0/128743987 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7b4006be30 0x7f7b4006e2f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:52.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.671+0000 7f7b66e00640 1 --2- 172.21.15.112:0/128743987 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b60161c40 0x7f7b601f49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:52.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.671+0000 7f7b66e00640 1 --2- 172.21.15.112:0/128743987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b6015f3b0 0x7f7b6015a060 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:52.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.671+0000 7f7b66e00640 1 --2- 172.21.15.112:0/128743987 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b600b4180 0x7f7b60154cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:52.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.671+0000 7f7b66e00640 1 -- 172.21.15.112:0/128743987 >> 172.21.15.112:0/128743987 conn(0x7f7b60072420 msgr2=0x7f7b600b5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:52.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.672+0000 7f7b66e00640 1 -- 172.21.15.112:0/128743987 shutdown_connections 2024-09-12T02:43:52.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:52.672+0000 7f7b66e00640 1 -- 172.21.15.112:0/128743987 wait complete. 2024-09-12T02:43:52.688 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-12T02:43:52.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:43:52.688 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-12T02:43:52.751 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T02:43:52.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:43:52.751 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T02:43:52.788 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:43:52.788 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:43:52.788 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:43:52.823 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:43:52.823 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:43:52.824 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:43:52.824 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:43:52.863 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:43:52.863 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:43:53.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.017+0000 7f243ee00640 1 Processor -- start 2024-09-12T02:43:53.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.017+0000 7f243ee00640 1 -- start start 2024-09-12T02:43:53.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.018+0000 7f243ee00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f24380d1710 0x7f24380d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.018+0000 7f243ee00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24380b1d70 0x7f24380b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.018+0000 7f243ee00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24380d2fb0 con 0x7f24380b3e00 2024-09-12T02:43:53.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.018+0000 7f243ee00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f24380d3cb0 con 0x7f24380d1710 2024-09-12T02:43:53.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.018+0000 7f243ee00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f24380d0b60 con 0x7f24380b1d70 2024-09-12T02:43:53.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.019+0000 7f243da00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f24380d1710 0x7f24380d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.019+0000 7f243e400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24380b1d70 0x7f24380b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.019+0000 7f243da00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f24380d1710 0x7f24380d28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:55930/0 (socket says 172.21.15.112:55930) 2024-09-12T02:43:53.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.019+0000 7f243da00640 1 -- 172.21.15.112:0/2868160277 learned_addr learned my addr 172.21.15.112:0/2868160277 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:53.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.019+0000 7f243d000640 1 --1- 172.21.15.112:0/2868160277 >> v1:172.21.15.137:6789/0 conn(0x7f24380b3e00 0x7f24380d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.112:46658/0 (socket says 172.21.15.112:46658) 2024-09-12T02:43:53.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.019+0000 7f243da00640 1 -- 172.21.15.112:0/2868160277 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24380b1d70 msgr2=0x7f24380b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:53.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.019+0000 7f243da00640 1 --2- 172.21.15.112:0/2868160277 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24380b1d70 0x7f24380b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.019+0000 7f243da00640 1 -- 172.21.15.112:0/2868160277 >> v1:172.21.15.137:6789/0 conn(0x7f24380b3e00 legacy=0x7f24380d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:53.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.019+0000 7f243da00640 1 -- 172.21.15.112:0/2868160277 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24380d3410 con 0x7f24380d1710 2024-09-12T02:43:53.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.019+0000 7f2437e00640 1 -- 172.21.15.112:0/2868160277 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2307850400 0 0) 0x7f24380d2fb0 con 0x7f24380b3e00 2024-09-12T02:43:53.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.019+0000 7f243e400640 1 --2- 172.21.15.112:0/2868160277 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24380b1d70 0x7f24380b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:43:53.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.020+0000 7f243da00640 1 --2- 172.21.15.112:0/2868160277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24380d1710 0x7f24380d28d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f242c009870 tx=0x7f242c02a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3099771d94513c2d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:53.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.020+0000 7f2437e00640 1 -- 172.21.15.112:0/2868160277 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c037070 con 0x7f24380d1710 2024-09-12T02:43:53.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.020+0000 7f2437e00640 1 -- 172.21.15.112:0/2868160277 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f242c032440 con 0x7f24380d1710 2024-09-12T02:43:53.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.020+0000 7f2437e00640 1 -- 172.21.15.112:0/2868160277 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c032810 con 0x7f24380d1710 2024-09-12T02:43:53.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.021+0000 7f243ee00640 1 -- 172.21.15.112:0/2868160277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24380d1710 msgr2=0x7f24380d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:53.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.021+0000 7f243ee00640 1 --2- 172.21.15.112:0/2868160277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24380d1710 0x7f24380d28d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f242c009870 tx=0x7f242c02a250 comp rx=0 tx=0).stop 2024-09-12T02:43:53.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.021+0000 7f243ee00640 1 -- 172.21.15.112:0/2868160277 shutdown_connections 2024-09-12T02:43:53.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.021+0000 7f243ee00640 1 --2- 172.21.15.112:0/2868160277 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24380b1d70 0x7f24380b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.021+0000 7f243ee00640 1 --2- 172.21.15.112:0/2868160277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24380d1710 0x7f24380d28d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.021+0000 7f243ee00640 1 -- 172.21.15.112:0/2868160277 >> 172.21.15.112:0/2868160277 conn(0x7f243809e030 msgr2=0x7f24380d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:53.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.021+0000 7f243ee00640 1 -- 172.21.15.112:0/2868160277 shutdown_connections 2024-09-12T02:43:53.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.021+0000 7f243ee00640 1 -- 172.21.15.112:0/2868160277 wait complete. 2024-09-12T02:43:53.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.023+0000 7f243ee00640 1 Processor -- start 2024-09-12T02:43:53.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.023+0000 7f243ee00640 1 -- start start 2024-09-12T02:43:53.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.024+0000 7f243ee00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24380b1d70 0x7f24381581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.024+0000 7f243ee00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24380b3e00 0x7f24381611f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.024+0000 7f243ee00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24380d1710 0x7f2438161730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.024+0000 7f243ee00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f243815f110 con 0x7f24380b3e00 2024-09-12T02:43:53.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.024+0000 7f243ee00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f24380d39d0 con 0x7f24380d1710 2024-09-12T02:43:53.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.024+0000 7f243ee00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f243815f290 con 0x7f24380b1d70 2024-09-12T02:43:53.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.024+0000 7f243d000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24380b3e00 0x7f24381611f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.024+0000 7f243d000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24380b3e00 0x7f24381611f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38064/0 (socket says 172.21.15.112:38064) 2024-09-12T02:43:53.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.024+0000 7f243da00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24380b1d70 0x7f24381581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.024+0000 7f243d000640 1 -- 172.21.15.112:0/4027607550 learned_addr learned my addr 172.21.15.112:0/4027607550 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:53.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.024+0000 7f243e400640 1 --2- 172.21.15.112:0/4027607550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24380d1710 0x7f2438161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.024+0000 7f243da00640 1 -- 172.21.15.112:0/4027607550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24380d1710 msgr2=0x7f2438161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:53.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.024+0000 7f243da00640 1 --2- 172.21.15.112:0/4027607550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24380d1710 0x7f2438161730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.024+0000 7f243da00640 1 -- 172.21.15.112:0/4027607550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24380b3e00 msgr2=0x7f24381611f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:53.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.024+0000 7f243da00640 1 --2- 172.21.15.112:0/4027607550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24380b3e00 0x7f24381611f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.024+0000 7f243da00640 1 -- 172.21.15.112:0/4027607550 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2438161d40 con 0x7f24380b1d70 2024-09-12T02:43:53.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.025+0000 7f243da00640 1 --2- 172.21.15.112:0/4027607550 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24380b1d70 0x7f24381581d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f242c031000 tx=0x7f242c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:53.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.025+0000 7f2435600640 1 -- 172.21.15.112:0/4027607550 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c041020 con 0x7f24380b1d70 2024-09-12T02:43:53.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.025+0000 7f2435600640 1 -- 172.21.15.112:0/4027607550 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f242c03d640 con 0x7f24380b1d70 2024-09-12T02:43:53.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.025+0000 7f2435600640 1 -- 172.21.15.112:0/4027607550 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c037040 con 0x7f24380b1d70 2024-09-12T02:43:53.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.025+0000 7f243ee00640 1 -- 172.21.15.112:0/4027607550 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2438162020 con 0x7f24380b1d70 2024-09-12T02:43:53.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.025+0000 7f243ee00640 1 -- 172.21.15.112:0/4027607550 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f24381625e0 con 0x7f24380b1d70 2024-09-12T02:43:53.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.026+0000 7f243ee00640 1 -- 172.21.15.112:0/4027607550 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24380d28d0 con 0x7f24380b1d70 2024-09-12T02:43:53.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.027+0000 7f2435600640 1 -- 172.21.15.112:0/4027607550 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f242c044020 con 0x7f24380b1d70 2024-09-12T02:43:53.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.028+0000 7f2435600640 1 --2- 172.21.15.112:0/4027607550 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f241806be30 0x7f241806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.028+0000 7f2435600640 1 -- 172.21.15.112:0/4027607550 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(53..53 src has 1..53) ==== 5767+0+0 (secure 0 0 0) 0x7f242c0ab600 con 0x7f24380b1d70 2024-09-12T02:43:53.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.028+0000 7f243d000640 1 --2- 172.21.15.112:0/4027607550 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f241806be30 0x7f241806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.029+0000 7f243d000640 1 --2- 172.21.15.112:0/4027607550 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f241806be30 0x7f241806e2f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f24380cacd0 tx=0x7f2424007e10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:53.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.032+0000 7f2435600640 1 -- 172.21.15.112:0/4027607550 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f242c04b030 con 0x7f24380b1d70 2024-09-12T02:43:53.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.244+0000 7f243ee00640 1 -- 172.21.15.112:0/4027607550 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24380b8f30 con 0x7f24380b1d70 2024-09-12T02:43:53.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.245+0000 7f2435600640 1 -- 172.21.15.112:0/4027607550 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5229 (secure 0 0 0) 0x7f242c07a080 con 0x7f24380b1d70 2024-09-12T02:43:53.247 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:53.247 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":27,"btime":"2024-09-12T02:43:20:337397+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5008,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/362211662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":362211662},{"type":"v1","addr":"172.21.15.112:6836","nonce":362211662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5011,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/193733805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":193733805},{"type":"v1","addr":"172.21.15.112:6837","nonce":193733805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/3440642333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3440642333},{"type":"v1","addr":"172.21.15.137:6834","nonce":3440642333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:43:16.722971+0000","modified":"2024-09-12T02:43:19.743614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"b","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/3597512060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3597512060},{"type":"v1","addr":"172.21.15.137:6835","nonce":3597512060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":3}]} 2024-09-12T02:43:53.247 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 27 2024-09-12T02:43:53.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.247+0000 7f243ee00640 1 -- 172.21.15.112:0/4027607550 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f241806be30 msgr2=0x7f241806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:53.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.247+0000 7f243ee00640 1 --2- 172.21.15.112:0/4027607550 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f241806be30 0x7f241806e2f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f24380cacd0 tx=0x7f2424007e10 comp rx=0 tx=0).stop 2024-09-12T02:43:53.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.247+0000 7f243ee00640 1 -- 172.21.15.112:0/4027607550 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24380b1d70 msgr2=0x7f24381581d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:53.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.247+0000 7f243ee00640 1 --2- 172.21.15.112:0/4027607550 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24380b1d70 0x7f24381581d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f242c031000 tx=0x7f242c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.247+0000 7f243ee00640 1 -- 172.21.15.112:0/4027607550 shutdown_connections 2024-09-12T02:43:53.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.247+0000 7f243ee00640 1 --2- 172.21.15.112:0/4027607550 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f241806be30 0x7f241806e2f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.247+0000 7f243ee00640 1 --2- 172.21.15.112:0/4027607550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24380d1710 0x7f2438161730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.247+0000 7f243ee00640 1 --2- 172.21.15.112:0/4027607550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24380b3e00 0x7f24381611f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.247+0000 7f243ee00640 1 --2- 172.21.15.112:0/4027607550 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24380b1d70 0x7f24381581d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.247+0000 7f243ee00640 1 -- 172.21.15.112:0/4027607550 >> 172.21.15.112:0/4027607550 conn(0x7f243809e030 msgr2=0x7f24380b7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:53.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.247+0000 7f243ee00640 1 -- 172.21.15.112:0/4027607550 shutdown_connections 2024-09-12T02:43:53.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.247+0000 7f243ee00640 1 -- 172.21.15.112:0/4027607550 wait complete. 2024-09-12T02:43:53.264 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:43:53.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.415+0000 7f3899000640 1 Processor -- start 2024-09-12T02:43:53.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.415+0000 7f3899000640 1 -- start start 2024-09-12T02:43:53.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.416+0000 7f3899000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f38940b3e00 0x7f38940d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.416+0000 7f3899000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38940d2fb0 con 0x7f38940b1d70 2024-09-12T02:43:53.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.416+0000 7f3899000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38940d0b60 con 0x7f38940d1710 2024-09-12T02:43:53.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.416+0000 7f3899000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f38940d3cb0 con 0x7f38940b3e00 2024-09-12T02:43:53.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.416+0000 7f3893e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f38940b1d70 0x7f38940b2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38730/0 (socket says 172.21.15.112:38730) 2024-09-12T02:43:53.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.416+0000 7f3893e00640 1 -- 172.21.15.112:0/3817607486 learned_addr learned my addr 172.21.15.112:0/3817607486 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:53.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.417+0000 7f3892a00640 1 --2- 172.21.15.112:0/3817607486 >> v2:172.21.15.137:3300/0 conn(0x7f38940b3e00 0x7f38940d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.417+0000 7f3892000640 1 -- 172.21.15.112:0/3817607486 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3914496182 0 0) 0x7f38940d2fb0 con 0x7f38940b1d70 2024-09-12T02:43:53.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.417+0000 7f3892000640 1 -- 172.21.15.112:0/3817607486 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3878003520 con 0x7f38940b1d70 2024-09-12T02:43:53.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.417+0000 7f3892a00640 1 -- 172.21.15.112:0/3817607486 >> v1:172.21.15.137:6789/0 conn(0x7f38940d1710 legacy=0x7f38940d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:53.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.417+0000 7f3892000640 1 -- 172.21.15.112:0/3817607486 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 176571770 0 0) 0x7f38940d0b60 con 0x7f38940d1710 2024-09-12T02:43:53.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.417+0000 7f3892a00640 1 -- 172.21.15.112:0/3817607486 >> v1:172.21.15.112:6789/0 conn(0x7f38940b1d70 legacy=0x7f38940b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:53.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.417+0000 7f3892a00640 1 -- 172.21.15.112:0/3817607486 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38940d3410 con 0x7f38940b3e00 2024-09-12T02:43:53.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.418+0000 7f3892a00640 1 --2- 172.21.15.112:0/3817607486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38940b3e00 0x7f38940d28d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f38800097a0 tx=0x7f388002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0d7d6a0f13be4a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:53.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.419+0000 7f3892000640 1 -- 172.21.15.112:0/3817607486 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3880037070 con 0x7f38940b3e00 2024-09-12T02:43:53.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.419+0000 7f3892000640 1 -- 172.21.15.112:0/3817607486 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3880032440 con 0x7f38940b3e00 2024-09-12T02:43:53.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.419+0000 7f3892000640 1 -- 172.21.15.112:0/3817607486 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3880032810 con 0x7f38940b3e00 2024-09-12T02:43:53.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.419+0000 7f3899000640 1 -- 172.21.15.112:0/3817607486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38940b3e00 msgr2=0x7f38940d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:53.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.419+0000 7f3899000640 1 --2- 172.21.15.112:0/3817607486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38940b3e00 0x7f38940d28d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f38800097a0 tx=0x7f388002a230 comp rx=0 tx=0).stop 2024-09-12T02:43:53.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.419+0000 7f3899000640 1 -- 172.21.15.112:0/3817607486 shutdown_connections 2024-09-12T02:43:53.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.419+0000 7f3899000640 1 --2- 172.21.15.112:0/3817607486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38940b3e00 0x7f38940d28d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.419+0000 7f3899000640 1 -- 172.21.15.112:0/3817607486 >> 172.21.15.112:0/3817607486 conn(0x7f389409e030 msgr2=0x7f38940d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:53.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.419+0000 7f3899000640 1 -- 172.21.15.112:0/3817607486 shutdown_connections 2024-09-12T02:43:53.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.419+0000 7f3899000640 1 -- 172.21.15.112:0/3817607486 wait complete. 2024-09-12T02:43:53.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.421+0000 7f3899000640 1 Processor -- start 2024-09-12T02:43:53.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.421+0000 7f3899000640 1 -- start start 2024-09-12T02:43:53.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.422+0000 7f3899000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38940b1d70 0x7f389414d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.422+0000 7f3899000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38940b3e00 0x7f389414dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.422+0000 7f3899000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38940d1710 0x7f3894150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.422+0000 7f3899000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f389415f110 con 0x7f38940d1710 2024-09-12T02:43:53.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.422+0000 7f3899000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f38940d39d0 con 0x7f38940b3e00 2024-09-12T02:43:53.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.422+0000 7f3899000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f389415f290 con 0x7f38940b1d70 2024-09-12T02:43:53.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.422+0000 7f3893e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38940d1710 0x7f3894150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.422+0000 7f3893e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38940d1710 0x7f3894150700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38074/0 (socket says 172.21.15.112:38074) 2024-09-12T02:43:53.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.422+0000 7f3893e00640 1 -- 172.21.15.112:0/2542542365 learned_addr learned my addr 172.21.15.112:0/2542542365 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:53.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.422+0000 7f3892a00640 1 --2- 172.21.15.112:0/2542542365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38940b3e00 0x7f389414dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.422+0000 7f3893400640 1 --2- 172.21.15.112:0/2542542365 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38940b1d70 0x7f389414d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.423+0000 7f3893e00640 1 -- 172.21.15.112:0/2542542365 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38940b1d70 msgr2=0x7f389414d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:53.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.423+0000 7f3893e00640 1 --2- 172.21.15.112:0/2542542365 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38940b1d70 0x7f389414d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.423+0000 7f3893e00640 1 -- 172.21.15.112:0/2542542365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38940b3e00 msgr2=0x7f389414dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:53.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.423+0000 7f3893e00640 1 --2- 172.21.15.112:0/2542542365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38940b3e00 0x7f389414dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.423+0000 7f3893e00640 1 -- 172.21.15.112:0/2542542365 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38940cdc80 con 0x7f38940d1710 2024-09-12T02:43:53.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.423+0000 7f3893400640 1 --2- 172.21.15.112:0/2542542365 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38940b1d70 0x7f389414d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:43:53.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.423+0000 7f3893e00640 1 --2- 172.21.15.112:0/2542542365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38940d1710 0x7f3894150700 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f388c00cb40 tx=0x7f388c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:53.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.423+0000 7f388b400640 1 -- 172.21.15.112:0/2542542365 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c017070 con 0x7f38940d1710 2024-09-12T02:43:53.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.423+0000 7f388b400640 1 -- 172.21.15.112:0/2542542365 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f388c00aca0 con 0x7f38940d1710 2024-09-12T02:43:53.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.423+0000 7f3899000640 1 -- 172.21.15.112:0/2542542365 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38940cdf60 con 0x7f38940d1710 2024-09-12T02:43:53.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.423+0000 7f388b400640 1 -- 172.21.15.112:0/2542542365 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c012620 con 0x7f38940d1710 2024-09-12T02:43:53.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.423+0000 7f3899000640 1 -- 172.21.15.112:0/2542542365 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38940ce520 con 0x7f38940d1710 2024-09-12T02:43:53.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.424+0000 7f3899000640 1 -- 172.21.15.112:0/2542542365 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38940ce900 con 0x7f38940d1710 2024-09-12T02:43:53.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.425+0000 7f388b400640 1 -- 172.21.15.112:0/2542542365 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f388c01a070 con 0x7f38940d1710 2024-09-12T02:43:53.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.426+0000 7f388b400640 1 --2- 172.21.15.112:0/2542542365 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f387406be30 0x7f387406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.426+0000 7f388b400640 1 -- 172.21.15.112:0/2542542365 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5767+0+0 (secure 0 0 0) 0x7f388c08ac70 con 0x7f38940d1710 2024-09-12T02:43:53.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.426+0000 7f3893400640 1 --2- 172.21.15.112:0/2542542365 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f387406be30 0x7f387406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.427+0000 7f3893400640 1 --2- 172.21.15.112:0/2542542365 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f387406be30 0x7f387406e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3884000f60 tx=0x7f3884009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:53.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.430+0000 7f388b400640 1 -- 172.21.15.112:0/2542542365 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f38940ce900 con 0x7f38940d1710 2024-09-12T02:43:53.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.636+0000 7f3899000640 1 -- 172.21.15.112:0/2542542365 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f389414e490 con 0x7f38940d1710 2024-09-12T02:43:53.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.636+0000 7f388b400640 1 -- 172.21.15.112:0/2542542365 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5229 (secure 0 0 0) 0x7f389414e490 con 0x7f38940d1710 2024-09-12T02:43:53.638 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:53.638 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":27,"btime":"2024-09-12T02:43:20:337397+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5008,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/362211662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":362211662},{"type":"v1","addr":"172.21.15.112:6836","nonce":362211662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5011,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/193733805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":193733805},{"type":"v1","addr":"172.21.15.112:6837","nonce":193733805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/3440642333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3440642333},{"type":"v1","addr":"172.21.15.137:6834","nonce":3440642333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:43:16.722971+0000","modified":"2024-09-12T02:43:19.743614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"b","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/3597512060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3597512060},{"type":"v1","addr":"172.21.15.137:6835","nonce":3597512060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":3}]} 2024-09-12T02:43:53.638 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 27 2024-09-12T02:43:53.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.639+0000 7f3899000640 1 -- 172.21.15.112:0/2542542365 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f387406be30 msgr2=0x7f387406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:53.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.639+0000 7f3899000640 1 --2- 172.21.15.112:0/2542542365 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f387406be30 0x7f387406e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3884000f60 tx=0x7f3884009040 comp rx=0 tx=0).stop 2024-09-12T02:43:53.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.639+0000 7f3899000640 1 -- 172.21.15.112:0/2542542365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38940d1710 msgr2=0x7f3894150700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:53.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.639+0000 7f3899000640 1 --2- 172.21.15.112:0/2542542365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38940d1710 0x7f3894150700 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f388c00cb40 tx=0x7f388c00a060 comp rx=0 tx=0).stop 2024-09-12T02:43:53.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.639+0000 7f3899000640 1 -- 172.21.15.112:0/2542542365 shutdown_connections 2024-09-12T02:43:53.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.639+0000 7f3899000640 1 --2- 172.21.15.112:0/2542542365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38940d1710 0x7f3894150700 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.639+0000 7f3899000640 1 --2- 172.21.15.112:0/2542542365 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f387406be30 0x7f387406e2f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.639+0000 7f3899000640 1 --2- 172.21.15.112:0/2542542365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38940b3e00 0x7f389414dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.639+0000 7f3899000640 1 --2- 172.21.15.112:0/2542542365 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38940b1d70 0x7f389414d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.639+0000 7f3899000640 1 -- 172.21.15.112:0/2542542365 >> 172.21.15.112:0/2542542365 conn(0x7f389409e030 msgr2=0x7f389406d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:53.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.639+0000 7f3899000640 1 -- 172.21.15.112:0/2542542365 shutdown_connections 2024-09-12T02:43:53.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.639+0000 7f3899000640 1 -- 172.21.15.112:0/2542542365 wait complete. 2024-09-12T02:43:53.656 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:43:53.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.807+0000 7f06e6400640 1 Processor -- start 2024-09-12T02:43:53.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.807+0000 7f06e6400640 1 -- start start 2024-09-12T02:43:53.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.808+0000 7f06e6400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f06e015cc50 0x7f06e00732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.808+0000 7f06e6400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06e0071530 0x7f06e00af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.808+0000 7f06e6400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06e0073830 con 0x7f06e0071970 2024-09-12T02:43:53.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.808+0000 7f06e6400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f06e015d030 con 0x7f06e015cc50 2024-09-12T02:43:53.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.808+0000 7f06e6400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f06e00cf4c0 con 0x7f06e0071530 2024-09-12T02:43:53.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.809+0000 7f06dfe00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f06e0071970 0x7f06e00cf950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38732/0 (socket says 172.21.15.112:38732) 2024-09-12T02:43:53.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.809+0000 7f06dfe00640 1 -- 172.21.15.112:0/3282520396 learned_addr learned my addr 172.21.15.112:0/3282520396 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:53.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.809+0000 7f06df400640 1 --2- 172.21.15.112:0/3282520396 >> v2:172.21.15.112:3300/0 conn(0x7f06e015cc50 0x7f06e00732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.809+0000 7f06d7e00640 1 --2- 172.21.15.112:0/3282520396 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06e0071530 0x7f06e00af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.809+0000 7f06df400640 1 -- 172.21.15.112:0/3282520396 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06e0071530 msgr2=0x7f06e00af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:53.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.809+0000 7f06df400640 1 --2- 172.21.15.112:0/3282520396 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06e0071530 0x7f06e00af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.809+0000 7f06df400640 1 -- 172.21.15.112:0/3282520396 >> v1:172.21.15.112:6789/0 conn(0x7f06e0071970 legacy=0x7f06e00cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:53.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.809+0000 7f06df400640 1 -- 172.21.15.112:0/3282520396 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e00ceeb0 con 0x7f06e015cc50 2024-09-12T02:43:53.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.810+0000 7f06df400640 1 --2- 172.21.15.112:0/3282520396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06e015cc50 0x7f06e00732f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f06d00097a0 tx=0x7f06d002a0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af40862dad52d29b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:53.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.810+0000 7f06dea00640 1 -- 172.21.15.112:0/3282520396 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0037070 con 0x7f06e015cc50 2024-09-12T02:43:53.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.810+0000 7f06dea00640 1 -- 172.21.15.112:0/3282520396 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d002ae40 con 0x7f06e015cc50 2024-09-12T02:43:53.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.810+0000 7f06dea00640 1 -- 172.21.15.112:0/3282520396 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0032660 con 0x7f06e015cc50 2024-09-12T02:43:53.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.811+0000 7f06e6400640 1 -- 172.21.15.112:0/3282520396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06e015cc50 msgr2=0x7f06e00732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:53.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.811+0000 7f06e6400640 1 --2- 172.21.15.112:0/3282520396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06e015cc50 0x7f06e00732f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f06d00097a0 tx=0x7f06d002a0f0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.811+0000 7f06e6400640 1 -- 172.21.15.112:0/3282520396 shutdown_connections 2024-09-12T02:43:53.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.811+0000 7f06e6400640 1 --2- 172.21.15.112:0/3282520396 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06e0071530 0x7f06e00af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.811+0000 7f06e6400640 1 --2- 172.21.15.112:0/3282520396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06e015cc50 0x7f06e00732f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.811+0000 7f06e6400640 1 -- 172.21.15.112:0/3282520396 >> 172.21.15.112:0/3282520396 conn(0x7f06e006bbd0 msgr2=0x7f06e006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:53.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.811+0000 7f06e6400640 1 -- 172.21.15.112:0/3282520396 shutdown_connections 2024-09-12T02:43:53.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.811+0000 7f06e6400640 1 -- 172.21.15.112:0/3282520396 wait complete. 2024-09-12T02:43:53.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.813+0000 7f06e6400640 1 Processor -- start 2024-09-12T02:43:53.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.813+0000 7f06e6400640 1 -- start start 2024-09-12T02:43:53.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.814+0000 7f06e6400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06e0071530 0x7f06e01442e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.814+0000 7f06e6400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06e0071970 0x7f06e00b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.814+0000 7f06e6400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06e015cc50 0x7f06e00ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.814+0000 7f06e6400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f06e00cf150 con 0x7f06e015cc50 2024-09-12T02:43:53.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.814+0000 7f06e6400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f06e006e5e0 con 0x7f06e0071970 2024-09-12T02:43:53.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.814+0000 7f06e6400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f06e006f510 con 0x7f06e0071530 2024-09-12T02:43:53.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.814+0000 7f06dfe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06e015cc50 0x7f06e00ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.814+0000 7f06dfe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06e015cc50 0x7f06e00ae8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38094/0 (socket says 172.21.15.112:38094) 2024-09-12T02:43:53.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.814+0000 7f06dfe00640 1 -- 172.21.15.112:0/257031287 learned_addr learned my addr 172.21.15.112:0/257031287 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:53.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.814+0000 7f06df400640 1 --2- 172.21.15.112:0/257031287 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06e0071530 0x7f06e01442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.814+0000 7f06d7e00640 1 --2- 172.21.15.112:0/257031287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06e0071970 0x7f06e00b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.814+0000 7f06dfe00640 1 -- 172.21.15.112:0/257031287 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06e0071530 msgr2=0x7f06e01442e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:53.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.814+0000 7f06dfe00640 1 --2- 172.21.15.112:0/257031287 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06e0071530 0x7f06e01442e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.814+0000 7f06dfe00640 1 -- 172.21.15.112:0/257031287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06e0071970 msgr2=0x7f06e00b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:53.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.814+0000 7f06dfe00640 1 --2- 172.21.15.112:0/257031287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06e0071970 0x7f06e00b52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:53.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.814+0000 7f06dfe00640 1 -- 172.21.15.112:0/257031287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e0144820 con 0x7f06e015cc50 2024-09-12T02:43:53.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.815+0000 7f06dfe00640 1 --2- 172.21.15.112:0/257031287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06e015cc50 0x7f06e00ae8d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f06d800cb10 tx=0x7f06d800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:53.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.815+0000 7f06d7400640 1 -- 172.21.15.112:0/257031287 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d8017070 con 0x7f06e015cc50 2024-09-12T02:43:53.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.815+0000 7f06d7400640 1 -- 172.21.15.112:0/257031287 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d800ac70 con 0x7f06e015cc50 2024-09-12T02:43:53.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.815+0000 7f06d7400640 1 -- 172.21.15.112:0/257031287 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d8012600 con 0x7f06e015cc50 2024-09-12T02:43:53.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.815+0000 7f06e6400640 1 -- 172.21.15.112:0/257031287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e01f8af0 con 0x7f06e015cc50 2024-09-12T02:43:53.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.815+0000 7f06e6400640 1 -- 172.21.15.112:0/257031287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e01f90b0 con 0x7f06e015cc50 2024-09-12T02:43:53.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.816+0000 7f06e6400640 1 -- 172.21.15.112:0/257031287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06e0068a30 con 0x7f06e015cc50 2024-09-12T02:43:53.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.817+0000 7f06d7400640 1 -- 172.21.15.112:0/257031287 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f06d801a070 con 0x7f06e015cc50 2024-09-12T02:43:53.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.818+0000 7f06d7400640 1 --2- 172.21.15.112:0/257031287 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f06bc06be30 0x7f06bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:53.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.818+0000 7f06d7400640 1 -- 172.21.15.112:0/257031287 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5767+0+0 (secure 0 0 0) 0x7f06d808ab30 con 0x7f06e015cc50 2024-09-12T02:43:53.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.818+0000 7f06df400640 1 --2- 172.21.15.112:0/257031287 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f06bc06be30 0x7f06bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:53.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.819+0000 7f06df400640 1 --2- 172.21.15.112:0/257031287 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f06bc06be30 0x7f06bc06e2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f06d0034000 tx=0x7f06d002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:53.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.822+0000 7f06d7400640 1 -- 172.21.15.112:0/257031287 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f06e0073830 con 0x7f06e015cc50 2024-09-12T02:43:53.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.996+0000 7f06e6400640 1 -- 172.21.15.112:0/257031287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f06e006df60 con 0x7f06e015cc50 2024-09-12T02:43:53.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:53.998+0000 7f06d7400640 1 -- 172.21.15.112:0/257031287 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+16817 (secure 0 0 0) 0x7f06d800ae20 con 0x7f06e015cc50 2024-09-12T02:43:53.999 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:53.999 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":53,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:43:45.155167+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:43:14.483471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-12T02:43:15.711619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.12","mappings":[{"from":0,"to":5}]},{"pgid":"7.3b","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:43:54.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.000+0000 7f06e6400640 1 -- 172.21.15.112:0/257031287 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f06bc06be30 msgr2=0x7f06bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:54.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.000+0000 7f06e6400640 1 --2- 172.21.15.112:0/257031287 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f06bc06be30 0x7f06bc06e2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f06d0034000 tx=0x7f06d002e000 comp rx=0 tx=0).stop 2024-09-12T02:43:54.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.000+0000 7f06e6400640 1 -- 172.21.15.112:0/257031287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06e015cc50 msgr2=0x7f06e00ae8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:54.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.000+0000 7f06e6400640 1 --2- 172.21.15.112:0/257031287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06e015cc50 0x7f06e00ae8d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f06d800cb10 tx=0x7f06d800a060 comp rx=0 tx=0).stop 2024-09-12T02:43:54.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.000+0000 7f06e6400640 1 -- 172.21.15.112:0/257031287 shutdown_connections 2024-09-12T02:43:54.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.000+0000 7f06e6400640 1 --2- 172.21.15.112:0/257031287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06e015cc50 0x7f06e00ae8d0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:54.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.000+0000 7f06e6400640 1 --2- 172.21.15.112:0/257031287 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f06bc06be30 0x7f06bc06e2f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:54.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.000+0000 7f06e6400640 1 --2- 172.21.15.112:0/257031287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06e0071970 0x7f06e00b52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:54.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.000+0000 7f06e6400640 1 --2- 172.21.15.112:0/257031287 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06e0071530 0x7f06e01442e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:54.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.000+0000 7f06e6400640 1 -- 172.21.15.112:0/257031287 >> 172.21.15.112:0/257031287 conn(0x7f06e006bbd0 msgr2=0x7f06e0072780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:54.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.000+0000 7f06e6400640 1 -- 172.21.15.112:0/257031287 shutdown_connections 2024-09-12T02:43:54.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.000+0000 7f06e6400640 1 -- 172.21.15.112:0/257031287 wait complete. 2024-09-12T02:43:54.017 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:43:54.018 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:43:54.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.168+0000 7f97b6600640 1 Processor -- start 2024-09-12T02:43:54.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.168+0000 7f97b6600640 1 -- start start 2024-09-12T02:43:54.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.169+0000 7f97b6600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f97b00b3e00 0x7f97b00d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:54.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.169+0000 7f97b6600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97b00d2fb0 con 0x7f97b00b1d70 2024-09-12T02:43:54.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.169+0000 7f97b6600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97b00d0b60 con 0x7f97b00d1710 2024-09-12T02:43:54.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.169+0000 7f97b6600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f97b00d3cb0 con 0x7f97b00b3e00 2024-09-12T02:43:54.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.169+0000 7f97afe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f97b00b3e00 0x7f97b00d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:54.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.169+0000 7f97b5c00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f97b00b1d70 0x7f97b00b2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38736/0 (socket says 172.21.15.112:38736) 2024-09-12T02:43:54.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.169+0000 7f97b5c00640 1 -- 172.21.15.112:0/2115803796 learned_addr learned my addr 172.21.15.112:0/2115803796 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:54.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.170+0000 7f97afe00640 1 -- 172.21.15.112:0/2115803796 >> v1:172.21.15.137:6789/0 conn(0x7f97b00d1710 legacy=0x7f97b00d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:54.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.170+0000 7f97afe00640 1 -- 172.21.15.112:0/2115803796 >> v1:172.21.15.112:6789/0 conn(0x7f97b00b1d70 legacy=0x7f97b00b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:54.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.170+0000 7f97afe00640 1 -- 172.21.15.112:0/2115803796 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97b00d3410 con 0x7f97b00b3e00 2024-09-12T02:43:54.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.170+0000 7f97af400640 1 -- 172.21.15.112:0/2115803796 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1838501473 0 0) 0x7f97b00d2fb0 con 0x7f97b00b1d70 2024-09-12T02:43:54.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.171+0000 7f97afe00640 1 --2- 172.21.15.112:0/2115803796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97b00b3e00 0x7f97b00d28d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f979c0097a0 tx=0x7f979c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed0c86cbeec24f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:54.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.171+0000 7f97af400640 1 -- 172.21.15.112:0/2115803796 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c037070 con 0x7f97b00b3e00 2024-09-12T02:43:54.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.171+0000 7f97af400640 1 -- 172.21.15.112:0/2115803796 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f979c032440 con 0x7f97b00b3e00 2024-09-12T02:43:54.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.171+0000 7f97af400640 1 -- 172.21.15.112:0/2115803796 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c032810 con 0x7f97b00b3e00 2024-09-12T02:43:54.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.171+0000 7f97b6600640 1 -- 172.21.15.112:0/2115803796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97b00b3e00 msgr2=0x7f97b00d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:54.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.171+0000 7f97b6600640 1 --2- 172.21.15.112:0/2115803796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97b00b3e00 0x7f97b00d28d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f979c0097a0 tx=0x7f979c02a1e0 comp rx=0 tx=0).stop 2024-09-12T02:43:54.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.172+0000 7f97b6600640 1 -- 172.21.15.112:0/2115803796 shutdown_connections 2024-09-12T02:43:54.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.172+0000 7f97b6600640 1 --2- 172.21.15.112:0/2115803796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97b00b3e00 0x7f97b00d28d0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:54.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.172+0000 7f97b6600640 1 -- 172.21.15.112:0/2115803796 >> 172.21.15.112:0/2115803796 conn(0x7f97b009e030 msgr2=0x7f97b00d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:54.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.172+0000 7f97b6600640 1 -- 172.21.15.112:0/2115803796 shutdown_connections 2024-09-12T02:43:54.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.172+0000 7f97b6600640 1 -- 172.21.15.112:0/2115803796 wait complete. 2024-09-12T02:43:54.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.173+0000 7f97b6600640 1 Processor -- start 2024-09-12T02:43:54.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.173+0000 7f97b6600640 1 -- start start 2024-09-12T02:43:54.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.174+0000 7f97b6600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97b00b1d70 0x7f97b015d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:54.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.174+0000 7f97b6600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97b00b3e00 0x7f97b01612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:54.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.174+0000 7f97b6600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97b00d1710 0x7f97b00b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:54.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.174+0000 7f97b6600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f97b015f110 con 0x7f97b00d1710 2024-09-12T02:43:54.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.174+0000 7f97b6600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f97b00d39d0 con 0x7f97b00b3e00 2024-09-12T02:43:54.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.174+0000 7f97b6600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f97b015f290 con 0x7f97b00b1d70 2024-09-12T02:43:54.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.174+0000 7f97b5c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97b00d1710 0x7f97b00b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:54.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.175+0000 7f97b5c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97b00d1710 0x7f97b00b21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38110/0 (socket says 172.21.15.112:38110) 2024-09-12T02:43:54.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.175+0000 7f97b5c00640 1 -- 172.21.15.112:0/3005574830 learned_addr learned my addr 172.21.15.112:0/3005574830 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:54.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.175+0000 7f97afe00640 1 --2- 172.21.15.112:0/3005574830 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97b00b3e00 0x7f97b01612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:54.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.175+0000 7f97b5200640 1 --2- 172.21.15.112:0/3005574830 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97b00b1d70 0x7f97b015d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:54.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.175+0000 7f97b5c00640 1 -- 172.21.15.112:0/3005574830 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97b00b1d70 msgr2=0x7f97b015d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:54.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.175+0000 7f97b5c00640 1 --2- 172.21.15.112:0/3005574830 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97b00b1d70 0x7f97b015d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:54.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.175+0000 7f97b5c00640 1 -- 172.21.15.112:0/3005574830 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97b00b3e00 msgr2=0x7f97b01612d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:54.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.175+0000 7f97b5c00640 1 --2- 172.21.15.112:0/3005574830 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97b00b3e00 0x7f97b01612d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:54.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.175+0000 7f97b5c00640 1 -- 172.21.15.112:0/3005574830 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97b00c91b0 con 0x7f97b00d1710 2024-09-12T02:43:54.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.175+0000 7f97b5c00640 1 --2- 172.21.15.112:0/3005574830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97b00d1710 0x7f97b00b21e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f97a800c7a0 tx=0x7f97a800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:54.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.175+0000 7f97acc00640 1 -- 172.21.15.112:0/3005574830 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a8018070 con 0x7f97b00d1710 2024-09-12T02:43:54.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.175+0000 7f97acc00640 1 -- 172.21.15.112:0/3005574830 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97a800a640 con 0x7f97b00d1710 2024-09-12T02:43:54.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.175+0000 7f97acc00640 1 -- 172.21.15.112:0/3005574830 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a800aa70 con 0x7f97b00d1710 2024-09-12T02:43:54.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.176+0000 7f97b6600640 1 -- 172.21.15.112:0/3005574830 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97b0161f70 con 0x7f97b00d1710 2024-09-12T02:43:54.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.176+0000 7f97b6600640 1 -- 172.21.15.112:0/3005574830 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97b00c9450 con 0x7f97b00d1710 2024-09-12T02:43:54.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.177+0000 7f97b6600640 1 -- 172.21.15.112:0/3005574830 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97b00d28d0 con 0x7f97b00d1710 2024-09-12T02:43:54.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.177+0000 7f97acc00640 1 -- 172.21.15.112:0/3005574830 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f97a801b070 con 0x7f97b00d1710 2024-09-12T02:43:54.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.179+0000 7f97acc00640 1 --2- 172.21.15.112:0/3005574830 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f979006be30 0x7f979006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:54.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.179+0000 7f97acc00640 1 -- 172.21.15.112:0/3005574830 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5767+0+0 (secure 0 0 0) 0x7f97a808a460 con 0x7f97b00d1710 2024-09-12T02:43:54.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.179+0000 7f97b5200640 1 --2- 172.21.15.112:0/3005574830 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f979006be30 0x7f979006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:54.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.179+0000 7f97b5200640 1 --2- 172.21.15.112:0/3005574830 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f979006be30 0x7f979006e2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f97b0162580 tx=0x7f97a4009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:54.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.183+0000 7f97acc00640 1 -- 172.21.15.112:0/3005574830 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f97a80586e0 con 0x7f97b00d1710 2024-09-12T02:43:54.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.392+0000 7f97b6600640 1 -- 172.21.15.112:0/3005574830 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97b0162660 con 0x7f97b00d1710 2024-09-12T02:43:54.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.393+0000 7f97acc00640 1 -- 172.21.15.112:0/3005574830 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5229 (secure 0 0 0) 0x7f97a805c9e0 con 0x7f97b00d1710 2024-09-12T02:43:54.394 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:54.394 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":27,"btime":"2024-09-12T02:43:20:337397+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5008,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/362211662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":362211662},{"type":"v1","addr":"172.21.15.112:6836","nonce":362211662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5011,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/193733805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":193733805},{"type":"v1","addr":"172.21.15.112:6837","nonce":193733805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/3440642333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3440642333},{"type":"v1","addr":"172.21.15.137:6834","nonce":3440642333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:43:16.722971+0000","modified":"2024-09-12T02:43:19.743614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"b","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/3597512060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3597512060},{"type":"v1","addr":"172.21.15.137:6835","nonce":3597512060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":3}]} 2024-09-12T02:43:54.394 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 27 2024-09-12T02:43:54.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.395+0000 7f97b6600640 1 -- 172.21.15.112:0/3005574830 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f979006be30 msgr2=0x7f979006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:54.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.395+0000 7f97b6600640 1 --2- 172.21.15.112:0/3005574830 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f979006be30 0x7f979006e2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f97b0162580 tx=0x7f97a4009060 comp rx=0 tx=0).stop 2024-09-12T02:43:54.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.395+0000 7f97b6600640 1 -- 172.21.15.112:0/3005574830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97b00d1710 msgr2=0x7f97b00b21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:54.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.395+0000 7f97b6600640 1 --2- 172.21.15.112:0/3005574830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97b00d1710 0x7f97b00b21e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f97a800c7a0 tx=0x7f97a800cc60 comp rx=0 tx=0).stop 2024-09-12T02:43:54.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.395+0000 7f97b6600640 1 -- 172.21.15.112:0/3005574830 shutdown_connections 2024-09-12T02:43:54.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.395+0000 7f97b6600640 1 --2- 172.21.15.112:0/3005574830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97b00d1710 0x7f97b00b21e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:54.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.395+0000 7f97b6600640 1 --2- 172.21.15.112:0/3005574830 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f979006be30 0x7f979006e2f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:54.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.395+0000 7f97b6600640 1 --2- 172.21.15.112:0/3005574830 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97b00b3e00 0x7f97b01612d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:54.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.395+0000 7f97b6600640 1 --2- 172.21.15.112:0/3005574830 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97b00b1d70 0x7f97b015d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:54.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.395+0000 7f97b6600640 1 -- 172.21.15.112:0/3005574830 >> 172.21.15.112:0/3005574830 conn(0x7f97b009e030 msgr2=0x7f97b01e9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:54.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.395+0000 7f97b6600640 1 -- 172.21.15.112:0/3005574830 shutdown_connections 2024-09-12T02:43:54.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.395+0000 7f97b6600640 1 -- 172.21.15.112:0/3005574830 wait complete. 2024-09-12T02:43:54.412 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:43:54.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.564+0000 7f8ac0400640 1 Processor -- start 2024-09-12T02:43:54.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.564+0000 7f8ac0400640 1 -- start start 2024-09-12T02:43:54.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.565+0000 7f8ac0400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ab815b9d0 0x7f8ab80b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:54.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.565+0000 7f8ac0400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8ab80b45d0 0x7f8ab80728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:54.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.565+0000 7f8ac0400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8ab806eef0 0x7f8ab806f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:54.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.565+0000 7f8ac0400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8ab80b4a30 con 0x7f8ab80b45d0 2024-09-12T02:43:54.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.565+0000 7f8ac0400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8ab806f840 con 0x7f8ab806eef0 2024-09-12T02:43:54.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.565+0000 7f8ac0400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab80b54a0 con 0x7f8ab815b9d0 2024-09-12T02:43:54.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.566+0000 7f8abd000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8ab80b45d0 0x7f8ab80728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:54.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.566+0000 7f8abd000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8ab80b45d0 0x7f8ab80728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38126/0 (socket says 172.21.15.112:38126) 2024-09-12T02:43:54.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.566+0000 7f8abd000640 1 -- 172.21.15.112:0/168179263 learned_addr learned my addr 172.21.15.112:0/168179263 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:54.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.566+0000 7f8abda00640 1 --2- 172.21.15.112:0/168179263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ab815b9d0 0x7f8ab80b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:54.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.566+0000 7f8abe400640 1 --2- 172.21.15.112:0/168179263 >> v2:172.21.15.137:3300/0 conn(0x7f8ab806eef0 0x7f8ab806f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:54.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.566+0000 7f8abd000640 1 -- 172.21.15.112:0/168179263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ab815b9d0 msgr2=0x7f8ab80b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:54.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.566+0000 7f8abd000640 1 --2- 172.21.15.112:0/168179263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ab815b9d0 0x7f8ab80b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:54.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.566+0000 7f8abd000640 1 -- 172.21.15.112:0/168179263 >> v2:172.21.15.137:3300/0 conn(0x7f8ab806eef0 msgr2=0x7f8ab806f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:54.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.566+0000 7f8abd000640 1 --2- 172.21.15.112:0/168179263 >> v2:172.21.15.137:3300/0 conn(0x7f8ab806eef0 0x7f8ab806f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:54.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.566+0000 7f8abd000640 1 -- 172.21.15.112:0/168179263 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab80b3af0 con 0x7f8ab80b45d0 2024-09-12T02:43:54.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.567+0000 7f8abd000640 1 --2- 172.21.15.112:0/168179263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ab80b45d0 0x7f8ab80728c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8068670 tx=0x7f8aa402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5fdb5736f3355c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:54.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.567+0000 7f8ab7e00640 1 -- 172.21.15.112:0/168179263 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4004030 con 0x7f8ab80b45d0 2024-09-12T02:43:54.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.567+0000 7f8ab7e00640 1 -- 172.21.15.112:0/168179263 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa40041d0 con 0x7f8ab80b45d0 2024-09-12T02:43:54.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.568+0000 7f8ab7e00640 1 -- 172.21.15.112:0/168179263 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4003610 con 0x7f8ab80b45d0 2024-09-12T02:43:54.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.568+0000 7f8ac0400640 1 -- 172.21.15.112:0/168179263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ab80b45d0 msgr2=0x7f8ab80728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:54.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.568+0000 7f8ac0400640 1 --2- 172.21.15.112:0/168179263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ab80b45d0 0x7f8ab80728c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8068670 tx=0x7f8aa402a1c0 comp rx=0 tx=0).stop 2024-09-12T02:43:54.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.568+0000 7f8ac0400640 1 -- 172.21.15.112:0/168179263 shutdown_connections 2024-09-12T02:43:54.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.568+0000 7f8ac0400640 1 --2- 172.21.15.112:0/168179263 >> v2:172.21.15.137:3300/0 conn(0x7f8ab806eef0 0x7f8ab806f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:54.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.568+0000 7f8ac0400640 1 --2- 172.21.15.112:0/168179263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ab80b45d0 0x7f8ab80728c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:54.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.568+0000 7f8ac0400640 1 --2- 172.21.15.112:0/168179263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ab815b9d0 0x7f8ab80b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:54.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.568+0000 7f8ac0400640 1 -- 172.21.15.112:0/168179263 >> 172.21.15.112:0/168179263 conn(0x7f8ab806bbd0 msgr2=0x7f8ab806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:54.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.568+0000 7f8ac0400640 1 -- 172.21.15.112:0/168179263 shutdown_connections 2024-09-12T02:43:54.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.568+0000 7f8ac0400640 1 -- 172.21.15.112:0/168179263 wait complete. 2024-09-12T02:43:54.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.570+0000 7f8ac0400640 1 Processor -- start 2024-09-12T02:43:54.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.570+0000 7f8ac0400640 1 -- start start 2024-09-12T02:43:54.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.571+0000 7f8ac0400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ab806eef0 0x7f8ab814f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:54.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.571+0000 7f8ac0400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ab80b45d0 0x7f8ab81518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:54.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.571+0000 7f8ac0400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ab815b9d0 0x7f8ab814fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:54.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.571+0000 7f8ac0400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab815bdb0 con 0x7f8ab806eef0 2024-09-12T02:43:54.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.571+0000 7f8ac0400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab80b40b0 con 0x7f8ab815b9d0 2024-09-12T02:43:54.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.571+0000 7f8ac0400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab815bf30 con 0x7f8ab80b45d0 2024-09-12T02:43:54.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.571+0000 7f8abda00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ab806eef0 0x7f8ab814f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:54.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.571+0000 7f8abda00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ab806eef0 0x7f8ab814f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38132/0 (socket says 172.21.15.112:38132) 2024-09-12T02:43:54.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.571+0000 7f8abda00640 1 -- 172.21.15.112:0/1967956115 learned_addr learned my addr 172.21.15.112:0/1967956115 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:54.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.571+0000 7f8abd000640 1 --2- 172.21.15.112:0/1967956115 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ab80b45d0 0x7f8ab81518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:54.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.571+0000 7f8abe400640 1 --2- 172.21.15.112:0/1967956115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ab815b9d0 0x7f8ab814fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:54.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.572+0000 7f8abda00640 1 -- 172.21.15.112:0/1967956115 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ab80b45d0 msgr2=0x7f8ab81518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:54.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.572+0000 7f8abda00640 1 --2- 172.21.15.112:0/1967956115 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ab80b45d0 0x7f8ab81518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:54.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.572+0000 7f8abda00640 1 -- 172.21.15.112:0/1967956115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ab815b9d0 msgr2=0x7f8ab814fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:54.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.572+0000 7f8abda00640 1 --2- 172.21.15.112:0/1967956115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ab815b9d0 0x7f8ab814fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:54.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.572+0000 7f8abda00640 1 -- 172.21.15.112:0/1967956115 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab8150850 con 0x7f8ab806eef0 2024-09-12T02:43:54.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.572+0000 7f8abd000640 1 --2- 172.21.15.112:0/1967956115 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ab80b45d0 0x7f8ab81518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:43:54.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.572+0000 7f8abda00640 1 --2- 172.21.15.112:0/1967956115 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ab806eef0 0x7f8ab814f430 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00d5f0 tx=0x7f8aac00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:54.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.572+0000 7f8ab5600640 1 -- 172.21.15.112:0/1967956115 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aac0125f0 con 0x7f8ab806eef0 2024-09-12T02:43:54.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.572+0000 7f8ab5600640 1 -- 172.21.15.112:0/1967956115 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aac019070 con 0x7f8ab806eef0 2024-09-12T02:43:54.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.572+0000 7f8ac0400640 1 -- 172.21.15.112:0/1967956115 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ab8150b30 con 0x7f8ab806eef0 2024-09-12T02:43:54.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.572+0000 7f8ab5600640 1 -- 172.21.15.112:0/1967956115 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aac0129d0 con 0x7f8ab806eef0 2024-09-12T02:43:54.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.572+0000 7f8ac0400640 1 -- 172.21.15.112:0/1967956115 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ab81513d0 con 0x7f8ab806eef0 2024-09-12T02:43:54.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.574+0000 7f8ac0400640 1 -- 172.21.15.112:0/1967956115 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ab8068a30 con 0x7f8ab806eef0 2024-09-12T02:43:54.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.574+0000 7f8ab5600640 1 -- 172.21.15.112:0/1967956115 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8aac012b70 con 0x7f8ab806eef0 2024-09-12T02:43:54.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.575+0000 7f8ab5600640 1 --2- 172.21.15.112:0/1967956115 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8a9806be30 0x7f8a9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:54.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.575+0000 7f8ab5600640 1 -- 172.21.15.112:0/1967956115 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5767+0+0 (secure 0 0 0) 0x7f8aac08b230 con 0x7f8ab806eef0 2024-09-12T02:43:54.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.575+0000 7f8abd000640 1 --2- 172.21.15.112:0/1967956115 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8a9806be30 0x7f8a9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:54.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.576+0000 7f8abd000640 1 --2- 172.21.15.112:0/1967956115 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8a9806be30 0x7f8a9806e2f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4033000 tx=0x7f8aa402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:54.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.579+0000 7f8ab5600640 1 -- 172.21.15.112:0/1967956115 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8aac059ba0 con 0x7f8ab806eef0 2024-09-12T02:43:54.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.784+0000 7f8ac0400640 1 -- 172.21.15.112:0/1967956115 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ab806f300 con 0x7f8ab806eef0 2024-09-12T02:43:54.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.785+0000 7f8ab5600640 1 -- 172.21.15.112:0/1967956115 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5229 (secure 0 0 0) 0x7f8aac0594a0 con 0x7f8ab806eef0 2024-09-12T02:43:54.786 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:54.786 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":27,"btime":"2024-09-12T02:43:20:337397+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5008,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/362211662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":362211662},{"type":"v1","addr":"172.21.15.112:6836","nonce":362211662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5011,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/193733805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":193733805},{"type":"v1","addr":"172.21.15.112:6837","nonce":193733805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/3440642333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3440642333},{"type":"v1","addr":"172.21.15.137:6834","nonce":3440642333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:43:16.722971+0000","modified":"2024-09-12T02:43:19.743614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5017":{"gid":5017,"name":"b","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/3597512060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3597512060},{"type":"v1","addr":"172.21.15.137:6835","nonce":3597512060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5017,"qdb_cluster":[5017]},"id":3}]} 2024-09-12T02:43:54.786 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 27 2024-09-12T02:43:54.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.787+0000 7f8ac0400640 1 -- 172.21.15.112:0/1967956115 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8a9806be30 msgr2=0x7f8a9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:54.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.787+0000 7f8ac0400640 1 --2- 172.21.15.112:0/1967956115 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8a9806be30 0x7f8a9806e2f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4033000 tx=0x7f8aa402e000 comp rx=0 tx=0).stop 2024-09-12T02:43:54.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.787+0000 7f8ac0400640 1 -- 172.21.15.112:0/1967956115 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ab806eef0 msgr2=0x7f8ab814f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:54.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.787+0000 7f8ac0400640 1 --2- 172.21.15.112:0/1967956115 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ab806eef0 0x7f8ab814f430 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00d5f0 tx=0x7f8aac00dab0 comp rx=0 tx=0).stop 2024-09-12T02:43:54.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.787+0000 7f8ac0400640 1 -- 172.21.15.112:0/1967956115 shutdown_connections 2024-09-12T02:43:54.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.787+0000 7f8ac0400640 1 --2- 172.21.15.112:0/1967956115 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8a9806be30 0x7f8a9806e2f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:54.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.787+0000 7f8ac0400640 1 --2- 172.21.15.112:0/1967956115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ab815b9d0 0x7f8ab814fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:54.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.787+0000 7f8ac0400640 1 --2- 172.21.15.112:0/1967956115 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ab80b45d0 0x7f8ab81518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:54.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.787+0000 7f8ac0400640 1 --2- 172.21.15.112:0/1967956115 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ab806eef0 0x7f8ab814f430 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:54.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.787+0000 7f8ac0400640 1 -- 172.21.15.112:0/1967956115 >> 172.21.15.112:0/1967956115 conn(0x7f8ab806bbd0 msgr2=0x7f8ab80cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:54.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.787+0000 7f8ac0400640 1 -- 172.21.15.112:0/1967956115 shutdown_connections 2024-09-12T02:43:54.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.787+0000 7f8ac0400640 1 -- 172.21.15.112:0/1967956115 wait complete. 2024-09-12T02:43:54.804 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:43:54.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.954+0000 7efda0c00640 1 Processor -- start 2024-09-12T02:43:54.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.955+0000 7efda0c00640 1 -- start start 2024-09-12T02:43:54.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.956+0000 7efda0c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd9c0b4ec0 0x7efd9c0b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:54.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.956+0000 7efda0c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd9c0b54a0 con 0x7efd9c06f600 2024-09-12T02:43:54.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.956+0000 7efda0c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd9c0b3af0 con 0x7efd9c15b9d0 2024-09-12T02:43:54.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.956+0000 7efda0c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7efd9c0b3dd0 con 0x7efd9c0b4ec0 2024-09-12T02:43:54.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.956+0000 7efd91400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7efd9c06f600 0x7efd9c0cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38748/0 (socket says 172.21.15.112:38748) 2024-09-12T02:43:54.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.956+0000 7efd91400640 1 -- 172.21.15.112:0/3286280139 learned_addr learned my addr 172.21.15.112:0/3286280139 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:54.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.956+0000 7efd9a800640 1 --2- 172.21.15.112:0/3286280139 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd9c0b4ec0 0x7efd9c0b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:54.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.956+0000 7efd99400640 1 -- 172.21.15.112:0/3286280139 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2566506524 0 0) 0x7efd9c0b54a0 con 0x7efd9c06f600 2024-09-12T02:43:54.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.957+0000 7efd99400640 1 -- 172.21.15.112:0/3286280139 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd80005730 con 0x7efd9c06f600 2024-09-12T02:43:54.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.957+0000 7efd99400640 1 -- 172.21.15.112:0/3286280139 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1843201535 0 0) 0x7efd80005730 con 0x7efd9c06f600 2024-09-12T02:43:54.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.957+0000 7efd99400640 1 -- 172.21.15.112:0/3286280139 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd9c0b4ec0 msgr2=0x7efd9c0b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:54.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.957+0000 7efd99400640 1 --2- 172.21.15.112:0/3286280139 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd9c0b4ec0 0x7efd9c0b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:54.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.957+0000 7efd99400640 1 -- 172.21.15.112:0/3286280139 >> v1:172.21.15.137:6789/0 conn(0x7efd9c15b9d0 legacy=0x7efd9c06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:54.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.957+0000 7efd99400640 1 -- 172.21.15.112:0/3286280139 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9c0b40b0 con 0x7efd9c06f600 2024-09-12T02:43:54.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.957+0000 7efd99400640 1 -- 172.21.15.112:0/3286280139 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7efd840017f0 con 0x7efd9c06f600 2024-09-12T02:43:54.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.957+0000 7efd9a800640 1 --2- 172.21.15.112:0/3286280139 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd9c0b4ec0 0x7efd9c0b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:43:54.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.957+0000 7efd99400640 1 -- 172.21.15.112:0/3286280139 >> v1:172.21.15.112:6789/0 conn(0x7efd9c06f600 legacy=0x7efd9c0cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:54.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.957+0000 7efd99400640 1 --2- 172.21.15.112:0/3286280139 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd9c0b4ec0 0x7efd80005bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:54.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.957+0000 7efd99400640 1 --2- 172.21.15.112:0/3286280139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd80006130 0x7efd80006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:54.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.957+0000 7efd99400640 1 --2- 172.21.15.112:0/3286280139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd80006f50 0x7efd800073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:54.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.957+0000 7efd99400640 1 -- 172.21.15.112:0/3286280139 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c0b3dd0 con 0x7efd80006130 2024-09-12T02:43:54.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.957+0000 7efd99400640 1 -- 172.21.15.112:0/3286280139 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efd8000dc30 con 0x7efd80006f50 2024-09-12T02:43:54.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.957+0000 7efd99400640 1 -- 172.21.15.112:0/3286280139 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7efd8000de30 con 0x7efd9c0b4ec0 2024-09-12T02:43:54.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.957+0000 7efd91400640 1 --2- 172.21.15.112:0/3286280139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd80006130 0x7efd80006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:54.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.957+0000 7efd99e00640 1 --2- 172.21.15.112:0/3286280139 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd9c0b4ec0 0x7efd80005bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:54.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.957+0000 7efd9a800640 1 --2- 172.21.15.112:0/3286280139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd80006f50 0x7efd800073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:54.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.958+0000 7efd91400640 1 -- 172.21.15.112:0/3286280139 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd9c0b4ec0 msgr2=0x7efd80005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:54.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.958+0000 7efd91400640 1 --2- 172.21.15.112:0/3286280139 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd9c0b4ec0 0x7efd80005bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:54.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.958+0000 7efd91400640 1 -- 172.21.15.112:0/3286280139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd80006f50 msgr2=0x7efd800073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:54.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.958+0000 7efd91400640 1 --2- 172.21.15.112:0/3286280139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd80006f50 0x7efd800073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:54.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.958+0000 7efd91400640 1 -- 172.21.15.112:0/3286280139 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd80005730 con 0x7efd80006130 2024-09-12T02:43:54.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.959+0000 7efd91400640 1 --2- 172.21.15.112:0/3286280139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd80006130 0x7efd80006a10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7efd9c06fff0 tx=0x7efd80007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec89a09ecd34b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:54.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.959+0000 7efd99400640 1 -- 172.21.15.112:0/3286280139 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd84007d20 con 0x7efd80006130 2024-09-12T02:43:54.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.959+0000 7efd99400640 1 -- 172.21.15.112:0/3286280139 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd84007270 con 0x7efd80006130 2024-09-12T02:43:54.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.959+0000 7efd99400640 1 -- 172.21.15.112:0/3286280139 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd840057a0 con 0x7efd80006130 2024-09-12T02:43:54.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.959+0000 7efda0c00640 1 -- 172.21.15.112:0/3286280139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd80006130 msgr2=0x7efd80006a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:54.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.959+0000 7efda0c00640 1 --2- 172.21.15.112:0/3286280139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd80006130 0x7efd80006a10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7efd9c06fff0 tx=0x7efd80007a40 comp rx=0 tx=0).stop 2024-09-12T02:43:54.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.959+0000 7efd9a800640 1 -- 172.21.15.112:0/3286280139 reap_dead start 2024-09-12T02:43:54.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.959+0000 7efda0c00640 1 -- 172.21.15.112:0/3286280139 shutdown_connections 2024-09-12T02:43:54.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.959+0000 7efda0c00640 1 -- 172.21.15.112:0/3286280139 >> 172.21.15.112:0/3286280139 conn(0x7efd9c06bbd0 msgr2=0x7efd9c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:54.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.960+0000 7efda0c00640 1 -- 172.21.15.112:0/3286280139 shutdown_connections 2024-09-12T02:43:54.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.960+0000 7efda0c00640 1 -- 172.21.15.112:0/3286280139 wait complete. 2024-09-12T02:43:54.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.961+0000 7efda0c00640 1 Processor -- start 2024-09-12T02:43:54.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.961+0000 7efda0c00640 1 -- start start 2024-09-12T02:43:54.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.962+0000 7efda0c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd80006130 0x7efd9c14fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:54.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.962+0000 7efda0c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd9c1f4d80 0x7efd9c15e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:54.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.962+0000 7efda0c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd9c150450 0x7efd9c15d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:54.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.962+0000 7efda0c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c0b4750 con 0x7efd9c1f4d80 2024-09-12T02:43:54.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.962+0000 7efda0c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c0b45d0 con 0x7efd9c150450 2024-09-12T02:43:54.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.962+0000 7efda0c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7efd9c0b48d0 con 0x7efd80006130 2024-09-12T02:43:54.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.962+0000 7efd91400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd9c1f4d80 0x7efd9c15e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:54.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.963+0000 7efd91400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd9c1f4d80 0x7efd9c15e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38146/0 (socket says 172.21.15.112:38146) 2024-09-12T02:43:54.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.963+0000 7efd91400640 1 -- 172.21.15.112:0/1446886587 learned_addr learned my addr 172.21.15.112:0/1446886587 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:54.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.963+0000 7efd99e00640 1 --2- 172.21.15.112:0/1446886587 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd80006130 0x7efd9c14fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:54.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.963+0000 7efd91400640 1 -- 172.21.15.112:0/1446886587 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd80006130 msgr2=0x7efd9c14fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:54.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.963+0000 7efd9a800640 1 --2- 172.21.15.112:0/1446886587 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd9c150450 0x7efd9c15d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:54.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.963+0000 7efd91400640 1 --2- 172.21.15.112:0/1446886587 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd80006130 0x7efd9c14fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:54.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.963+0000 7efd91400640 1 -- 172.21.15.112:0/1446886587 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd9c150450 msgr2=0x7efd9c15d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:54.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.963+0000 7efd91400640 1 --2- 172.21.15.112:0/1446886587 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd9c150450 0x7efd9c15d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:54.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.963+0000 7efd91400640 1 -- 172.21.15.112:0/1446886587 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9c15ebc0 con 0x7efd9c1f4d80 2024-09-12T02:43:54.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.963+0000 7efd99e00640 1 --2- 172.21.15.112:0/1446886587 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd80006130 0x7efd9c14fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:43:54.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.963+0000 7efd91400640 1 --2- 172.21.15.112:0/1446886587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd9c1f4d80 0x7efd9c15e680 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7efd84001380 tx=0x7efd9c0b3cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:54.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.963+0000 7efd92a00640 1 -- 172.21.15.112:0/1446886587 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd84041020 con 0x7efd9c1f4d80 2024-09-12T02:43:54.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.964+0000 7efd92a00640 1 -- 172.21.15.112:0/1446886587 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd84038040 con 0x7efd9c1f4d80 2024-09-12T02:43:54.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.964+0000 7efd92a00640 1 -- 172.21.15.112:0/1446886587 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd840059c0 con 0x7efd9c1f4d80 2024-09-12T02:43:54.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.964+0000 7efda0c00640 1 -- 172.21.15.112:0/1446886587 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd9c15ee90 con 0x7efd9c1f4d80 2024-09-12T02:43:54.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.964+0000 7efda0c00640 1 -- 172.21.15.112:0/1446886587 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd9c1f4580 con 0x7efd9c1f4d80 2024-09-12T02:43:54.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.965+0000 7efda0c00640 1 -- 172.21.15.112:0/1446886587 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd9c068a30 con 0x7efd9c1f4d80 2024-09-12T02:43:54.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.965+0000 7efd92a00640 1 -- 172.21.15.112:0/1446886587 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efd84044020 con 0x7efd9c1f4d80 2024-09-12T02:43:54.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.966+0000 7efd92a00640 1 --2- 172.21.15.112:0/1446886587 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efd7806be60 0x7efd7806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:54.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.966+0000 7efd92a00640 1 -- 172.21.15.112:0/1446886587 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5767+0+0 (secure 0 0 0) 0x7efd840aae20 con 0x7efd9c1f4d80 2024-09-12T02:43:54.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.967+0000 7efd99e00640 1 --2- 172.21.15.112:0/1446886587 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efd7806be60 0x7efd7806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:54.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.967+0000 7efd99e00640 1 --2- 172.21.15.112:0/1446886587 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efd7806be60 0x7efd7806e320 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efd8c003700 tx=0x7efd8c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:54.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:54.970+0000 7efd92a00640 1 -- 172.21.15.112:0/1446886587 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efd8404b070 con 0x7efd9c1f4d80 2024-09-12T02:43:55.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.146+0000 7efda0c00640 1 -- 172.21.15.112:0/1446886587 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd9c06ed40 con 0x7efd9c1f4d80 2024-09-12T02:43:55.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.148+0000 7efd92a00640 1 -- 172.21.15.112:0/1446886587 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+16817 (secure 0 0 0) 0x7efd84079780 con 0x7efd9c1f4d80 2024-09-12T02:43:55.149 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:55.149 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":53,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:43:45.155167+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:43:14.483471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-12T02:43:15.711619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.12","mappings":[{"from":0,"to":5}]},{"pgid":"7.3b","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:43:55.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.150+0000 7efda0c00640 1 -- 172.21.15.112:0/1446886587 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efd7806be60 msgr2=0x7efd7806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:55.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.150+0000 7efda0c00640 1 --2- 172.21.15.112:0/1446886587 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efd7806be60 0x7efd7806e320 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efd8c003700 tx=0x7efd8c009040 comp rx=0 tx=0).stop 2024-09-12T02:43:55.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.150+0000 7efda0c00640 1 -- 172.21.15.112:0/1446886587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd9c1f4d80 msgr2=0x7efd9c15e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:55.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.150+0000 7efda0c00640 1 --2- 172.21.15.112:0/1446886587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd9c1f4d80 0x7efd9c15e680 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7efd84001380 tx=0x7efd9c0b3cc0 comp rx=0 tx=0).stop 2024-09-12T02:43:55.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.150+0000 7efda0c00640 1 -- 172.21.15.112:0/1446886587 shutdown_connections 2024-09-12T02:43:55.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.150+0000 7efda0c00640 1 --2- 172.21.15.112:0/1446886587 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efd7806be60 0x7efd7806e320 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:55.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.150+0000 7efda0c00640 1 --2- 172.21.15.112:0/1446886587 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd9c150450 0x7efd9c15d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:55.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.150+0000 7efda0c00640 1 --2- 172.21.15.112:0/1446886587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd9c1f4d80 0x7efd9c15e680 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:55.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.150+0000 7efda0c00640 1 --2- 172.21.15.112:0/1446886587 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efd80006130 0x7efd9c14fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:55.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.150+0000 7efda0c00640 1 -- 172.21.15.112:0/1446886587 >> 172.21.15.112:0/1446886587 conn(0x7efd9c06bbd0 msgr2=0x7efd9c0b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:55.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.150+0000 7efda0c00640 1 -- 172.21.15.112:0/1446886587 shutdown_connections 2024-09-12T02:43:55.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.150+0000 7efda0c00640 1 -- 172.21.15.112:0/1446886587 wait complete. 2024-09-12T02:43:55.167 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:43:55.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.320+0000 7f7a15a00640 1 Processor -- start 2024-09-12T02:43:55.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.320+0000 7f7a15a00640 1 -- start start 2024-09-12T02:43:55.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.321+0000 7f7a15a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7a1015cc50 0x7f7a100732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:55.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.321+0000 7f7a15a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a10073830 con 0x7f7a100afe30 2024-09-12T02:43:55.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.321+0000 7f7a15a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a100ceeb0 con 0x7f7a10071530 2024-09-12T02:43:55.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.321+0000 7f7a15a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7a1015d030 con 0x7f7a1015cc50 2024-09-12T02:43:55.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.322+0000 7f7a0f400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f7a100afe30 0x7f7a100cf950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38756/0 (socket says 172.21.15.112:38756) 2024-09-12T02:43:55.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.322+0000 7f7a0f400640 1 -- 172.21.15.112:0/2311331787 learned_addr learned my addr 172.21.15.112:0/2311331787 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:55.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.322+0000 7f7a0ea00640 1 --2- 172.21.15.112:0/2311331787 >> v2:172.21.15.137:3300/0 conn(0x7f7a1015cc50 0x7f7a100732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:55.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.322+0000 7f7a0e000640 1 -- 172.21.15.112:0/2311331787 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 816374691 0 0) 0x7f7a08001490 con 0x7f7a100afe30 2024-09-12T02:43:55.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.322+0000 7f7a0e000640 1 -- 172.21.15.112:0/2311331787 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79f4003520 con 0x7f7a100afe30 2024-09-12T02:43:55.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.322+0000 7f7a0ea00640 1 -- 172.21.15.112:0/2311331787 >> v1:172.21.15.137:6789/0 conn(0x7f7a10071530 legacy=0x7f7a100af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:55.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.322+0000 7f7a0ea00640 1 -- 172.21.15.112:0/2311331787 >> v1:172.21.15.112:6789/0 conn(0x7f7a100afe30 legacy=0x7f7a100cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:55.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.322+0000 7f7a0ea00640 1 -- 172.21.15.112:0/2311331787 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a1006e300 con 0x7f7a1015cc50 2024-09-12T02:43:55.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.323+0000 7f7a0ea00640 1 --2- 172.21.15.112:0/2311331787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a1015cc50 0x7f7a100732f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7a000097a0 tx=0x7f7a0002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e912dbb205e8bb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:55.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.324+0000 7f7a0e000640 1 -- 172.21.15.112:0/2311331787 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a00037070 con 0x7f7a1015cc50 2024-09-12T02:43:55.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.324+0000 7f7a0e000640 1 -- 172.21.15.112:0/2311331787 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a00032440 con 0x7f7a1015cc50 2024-09-12T02:43:55.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.324+0000 7f7a0e000640 1 -- 172.21.15.112:0/2311331787 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a00032810 con 0x7f7a1015cc50 2024-09-12T02:43:55.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.324+0000 7f7a15a00640 1 -- 172.21.15.112:0/2311331787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a1015cc50 msgr2=0x7f7a100732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:55.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.324+0000 7f7a15a00640 1 --2- 172.21.15.112:0/2311331787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a1015cc50 0x7f7a100732f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7a000097a0 tx=0x7f7a0002a1a0 comp rx=0 tx=0).stop 2024-09-12T02:43:55.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.324+0000 7f7a15a00640 1 -- 172.21.15.112:0/2311331787 shutdown_connections 2024-09-12T02:43:55.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.324+0000 7f7a15a00640 1 --2- 172.21.15.112:0/2311331787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a1015cc50 0x7f7a100732f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:55.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.324+0000 7f7a15a00640 1 -- 172.21.15.112:0/2311331787 >> 172.21.15.112:0/2311331787 conn(0x7f7a1006bbd0 msgr2=0x7f7a1006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:55.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.324+0000 7f7a15a00640 1 -- 172.21.15.112:0/2311331787 shutdown_connections 2024-09-12T02:43:55.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.324+0000 7f7a15a00640 1 -- 172.21.15.112:0/2311331787 wait complete. 2024-09-12T02:43:55.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.326+0000 7f7a15a00640 1 Processor -- start 2024-09-12T02:43:55.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.326+0000 7f7a15a00640 1 -- start start 2024-09-12T02:43:55.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.327+0000 7f7a15a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a10071530 0x7f7a10159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:55.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.327+0000 7f7a15a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a100afe30 0x7f7a101f91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:55.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.327+0000 7f7a15a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a1015cc50 0x7f7a1014f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:55.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.327+0000 7f7a15a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7a100cf150 con 0x7f7a10071530 2024-09-12T02:43:55.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.327+0000 7f7a15a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7a100cf4c0 con 0x7f7a100afe30 2024-09-12T02:43:55.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.327+0000 7f7a15a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7a1006f510 con 0x7f7a1015cc50 2024-09-12T02:43:55.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.327+0000 7f7a0ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a10071530 0x7f7a10159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:55.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.327+0000 7f7a0ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a10071530 0x7f7a10159d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38158/0 (socket says 172.21.15.112:38158) 2024-09-12T02:43:55.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.327+0000 7f7a0ea00640 1 -- 172.21.15.112:0/2800529921 learned_addr learned my addr 172.21.15.112:0/2800529921 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:55.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.328+0000 7f7a0f400640 1 --2- 172.21.15.112:0/2800529921 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a1015cc50 0x7f7a1014f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:55.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.328+0000 7f7a06000640 1 --2- 172.21.15.112:0/2800529921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a100afe30 0x7f7a101f91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:55.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.328+0000 7f7a0ea00640 1 -- 172.21.15.112:0/2800529921 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a1015cc50 msgr2=0x7f7a1014f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:55.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.328+0000 7f7a0ea00640 1 --2- 172.21.15.112:0/2800529921 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a1015cc50 0x7f7a1014f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:55.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.328+0000 7f7a0ea00640 1 -- 172.21.15.112:0/2800529921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a100afe30 msgr2=0x7f7a101f91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:55.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.328+0000 7f7a0ea00640 1 --2- 172.21.15.112:0/2800529921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a100afe30 0x7f7a101f91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:55.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.328+0000 7f7a0ea00640 1 -- 172.21.15.112:0/2800529921 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a1015bf80 con 0x7f7a10071530 2024-09-12T02:43:55.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.328+0000 7f7a06000640 1 --2- 172.21.15.112:0/2800529921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a100afe30 0x7f7a101f91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:43:55.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.328+0000 7f7a0ea00640 1 --2- 172.21.15.112:0/2800529921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a10071530 0x7f7a10159d80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7a000098c0 tx=0x7f7a000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:55.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.328+0000 7f7a07400640 1 -- 172.21.15.112:0/2800529921 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a00037040 con 0x7f7a10071530 2024-09-12T02:43:55.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.328+0000 7f7a07400640 1 -- 172.21.15.112:0/2800529921 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a00030500 con 0x7f7a10071530 2024-09-12T02:43:55.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.328+0000 7f7a07400640 1 -- 172.21.15.112:0/2800529921 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a000308d0 con 0x7f7a10071530 2024-09-12T02:43:55.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.328+0000 7f7a15a00640 1 -- 172.21.15.112:0/2800529921 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a1015c260 con 0x7f7a10071530 2024-09-12T02:43:55.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.328+0000 7f7a15a00640 1 -- 172.21.15.112:0/2800529921 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a1015b730 con 0x7f7a10071530 2024-09-12T02:43:55.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.330+0000 7f7a15a00640 1 -- 172.21.15.112:0/2800529921 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a10068a30 con 0x7f7a10071530 2024-09-12T02:43:55.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.330+0000 7f7a07400640 1 -- 172.21.15.112:0/2800529921 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7a00044020 con 0x7f7a10071530 2024-09-12T02:43:55.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.331+0000 7f7a07400640 1 --2- 172.21.15.112:0/2800529921 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f79ec06be60 0x7f79ec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:55.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.331+0000 7f7a07400640 1 -- 172.21.15.112:0/2800529921 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5767+0+0 (secure 0 0 0) 0x7f7a000ab110 con 0x7f7a10071530 2024-09-12T02:43:55.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.331+0000 7f7a06000640 1 --2- 172.21.15.112:0/2800529921 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f79ec06be60 0x7f79ec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:55.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.332+0000 7f7a06000640 1 --2- 172.21.15.112:0/2800529921 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f79ec06be60 0x7f79ec06e320 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7a100afcf0 tx=0x7f79f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:55.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.335+0000 7f7a07400640 1 -- 172.21.15.112:0/2800529921 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7a000799e0 con 0x7f7a10071530 2024-09-12T02:43:55.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.541+0000 7f7a15a00640 1 -- 172.21.15.112:0/2800529921 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f7a1006df60 con 0x7f7a10071530 2024-09-12T02:43:55.543 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-12T02:43:55.542+0000 7f0216c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:43:55.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.544+0000 7f7a07400640 1 -- 172.21.15.112:0/2800529921 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) ==== 161+0+0 (secure 0 0 0) 0x7f7a000792e0 con 0x7f7a10071530 2024-09-12T02:43:55.545 INFO:teuthology.orchestra.run.smithi112.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:43:55.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.547+0000 7f7a15a00640 1 -- 172.21.15.112:0/2800529921 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f79ec06be60 msgr2=0x7f79ec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:55.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.547+0000 7f7a15a00640 1 --2- 172.21.15.112:0/2800529921 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f79ec06be60 0x7f79ec06e320 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7a100afcf0 tx=0x7f79f8009040 comp rx=0 tx=0).stop 2024-09-12T02:43:55.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.547+0000 7f7a15a00640 1 -- 172.21.15.112:0/2800529921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a10071530 msgr2=0x7f7a10159d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:55.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.547+0000 7f7a15a00640 1 --2- 172.21.15.112:0/2800529921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a10071530 0x7f7a10159d80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7a000098c0 tx=0x7f7a000046c0 comp rx=0 tx=0).stop 2024-09-12T02:43:55.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.548+0000 7f7a15a00640 1 -- 172.21.15.112:0/2800529921 shutdown_connections 2024-09-12T02:43:55.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.548+0000 7f7a15a00640 1 --2- 172.21.15.112:0/2800529921 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a1015cc50 0x7f7a1014f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:55.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.548+0000 7f7a15a00640 1 --2- 172.21.15.112:0/2800529921 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f79ec06be60 0x7f79ec06e320 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:55.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.548+0000 7f7a15a00640 1 --2- 172.21.15.112:0/2800529921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a100afe30 0x7f7a101f91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:55.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.548+0000 7f7a15a00640 1 --2- 172.21.15.112:0/2800529921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a10071530 0x7f7a10159d80 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:55.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.548+0000 7f7a15a00640 1 -- 172.21.15.112:0/2800529921 >> 172.21.15.112:0/2800529921 conn(0x7f7a1006bbd0 msgr2=0x7f7a10071fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:55.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.549+0000 7f7a15a00640 1 -- 172.21.15.112:0/2800529921 shutdown_connections 2024-09-12T02:43:55.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.549+0000 7f7a15a00640 1 -- 172.21.15.112:0/2800529921 wait complete. 2024-09-12T02:43:55.565 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T02:43:55.616 INFO:tasks.ceph.mds.b.smithi137.stdout:starting mds.b at 2024-09-12T02:43:55.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.719+0000 7f9a1be00640 1 Processor -- start 2024-09-12T02:43:55.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.719+0000 7f9a1be00640 1 -- start start 2024-09-12T02:43:55.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.720+0000 7f9a1be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9a1c0b3e00 0x7f9a1c0d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:55.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.720+0000 7f9a1be00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9a1c0b1d70 0x7f9a1c0b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:55.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.720+0000 7f9a1be00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a1c0d2fb0 con 0x7f9a1c0d1710 2024-09-12T02:43:55.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.720+0000 7f9a1be00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f9a1c0d3cb0 con 0x7f9a1c0b1d70 2024-09-12T02:43:55.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.720+0000 7f9a1be00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9a1c0d0b60 con 0x7f9a1c0b3e00 2024-09-12T02:43:55.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.720+0000 7f9a1b400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9a1c0b1d70 0x7f9a1c0b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:55.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.721+0000 7f9a1b400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9a1c0b1d70 0x7f9a1c0b2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38164/0 (socket says 172.21.15.112:38164) 2024-09-12T02:43:55.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.721+0000 7f9a1b400640 1 -- 172.21.15.112:0/1526007002 learned_addr learned my addr 172.21.15.112:0/1526007002 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:55.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.721+0000 7f9a1a000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9a1c0b3e00 0x7f9a1c0d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:55.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.721+0000 7f9a1b400640 1 -- 172.21.15.112:0/1526007002 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9a1c0b3e00 msgr2=0x7f9a1c0d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:55.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.721+0000 7f9a1b400640 1 --2- 172.21.15.112:0/1526007002 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9a1c0b3e00 0x7f9a1c0d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:55.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.721+0000 7f9a1b400640 1 -- 172.21.15.112:0/1526007002 >> v1:172.21.15.137:6789/0 conn(0x7f9a1c0d1710 legacy=0x7f9a1c0d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:55.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.721+0000 7f9a1b400640 1 -- 172.21.15.112:0/1526007002 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a1c0d3410 con 0x7f9a1c0b1d70 2024-09-12T02:43:55.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.721+0000 7f9a19600640 1 -- 172.21.15.112:0/1526007002 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2659057539 0 0) 0x7f9a1c0d2fb0 con 0x7f9a1c0d1710 2024-09-12T02:43:55.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.722+0000 7f9a1b400640 1 --2- 172.21.15.112:0/1526007002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a1c0b1d70 0x7f9a1c0b2200 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9a14009e50 tx=0x7f9a1402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a709af0abd61b110 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:55.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.722+0000 7f9a19600640 1 -- 172.21.15.112:0/1526007002 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a14036070 con 0x7f9a1c0b1d70 2024-09-12T02:43:55.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.722+0000 7f9a19600640 1 -- 172.21.15.112:0/1526007002 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a14031600 con 0x7f9a1c0b1d70 2024-09-12T02:43:55.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.722+0000 7f9a19600640 1 -- 172.21.15.112:0/1526007002 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a140319d0 con 0x7f9a1c0b1d70 2024-09-12T02:43:55.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.723+0000 7f9a1be00640 1 -- 172.21.15.112:0/1526007002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a1c0b1d70 msgr2=0x7f9a1c0b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:55.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.723+0000 7f9a1be00640 1 --2- 172.21.15.112:0/1526007002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a1c0b1d70 0x7f9a1c0b2200 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9a14009e50 tx=0x7f9a1402a730 comp rx=0 tx=0).stop 2024-09-12T02:43:55.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.723+0000 7f9a1be00640 1 -- 172.21.15.112:0/1526007002 shutdown_connections 2024-09-12T02:43:55.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.723+0000 7f9a1be00640 1 --2- 172.21.15.112:0/1526007002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a1c0b1d70 0x7f9a1c0b2200 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:55.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.723+0000 7f9a1be00640 1 --2- 172.21.15.112:0/1526007002 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9a1c0b3e00 0x7f9a1c0d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:55.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.723+0000 7f9a1be00640 1 -- 172.21.15.112:0/1526007002 >> 172.21.15.112:0/1526007002 conn(0x7f9a1c09e030 msgr2=0x7f9a1c0d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:55.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.723+0000 7f9a1be00640 1 -- 172.21.15.112:0/1526007002 shutdown_connections 2024-09-12T02:43:55.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.723+0000 7f9a1be00640 1 -- 172.21.15.112:0/1526007002 wait complete. 2024-09-12T02:43:55.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.724+0000 7f9a1be00640 1 Processor -- start 2024-09-12T02:43:55.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.725+0000 7f9a1be00640 1 -- start start 2024-09-12T02:43:55.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.725+0000 7f9a1be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a1c0b1d70 0x7f9a1c157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:55.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.725+0000 7f9a1be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9a1c0b3e00 0x7f9a1c0cd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:55.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.725+0000 7f9a1be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9a1c0d1710 0x7f9a1c0cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:55.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.725+0000 7f9a1be00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1c15f110 con 0x7f9a1c0b1d70 2024-09-12T02:43:55.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.725+0000 7f9a1be00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1c0d39d0 con 0x7f9a1c0b3e00 2024-09-12T02:43:55.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.725+0000 7f9a1be00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9a1c15f290 con 0x7f9a1c0d1710 2024-09-12T02:43:55.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.726+0000 7f9a1aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a1c0b1d70 0x7f9a1c157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:55.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.726+0000 7f9a1aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a1c0b1d70 0x7f9a1c157f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38178/0 (socket says 172.21.15.112:38178) 2024-09-12T02:43:55.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.726+0000 7f9a1aa00640 1 -- 172.21.15.112:0/1803053483 learned_addr learned my addr 172.21.15.112:0/1803053483 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:55.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.726+0000 7f9a1a000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9a1c0b3e00 0x7f9a1c0cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:55.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.726+0000 7f9a1b400640 1 --2- 172.21.15.112:0/1803053483 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9a1c0d1710 0x7f9a1c0cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:55.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.726+0000 7f9a1aa00640 1 -- 172.21.15.112:0/1803053483 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9a1c0d1710 msgr2=0x7f9a1c0cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:55.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.726+0000 7f9a1aa00640 1 --2- 172.21.15.112:0/1803053483 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9a1c0d1710 0x7f9a1c0cf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:55.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.726+0000 7f9a1aa00640 1 -- 172.21.15.112:0/1803053483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9a1c0b3e00 msgr2=0x7f9a1c0cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:55.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.726+0000 7f9a1aa00640 1 --2- 172.21.15.112:0/1803053483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9a1c0b3e00 0x7f9a1c0cd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:55.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.726+0000 7f9a1aa00640 1 -- 172.21.15.112:0/1803053483 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a1c1f4940 con 0x7f9a1c0b1d70 2024-09-12T02:43:55.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.726+0000 7f9a1aa00640 1 --2- 172.21.15.112:0/1803053483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a1c0b1d70 0x7f9a1c157f30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00c440 tx=0x7f9a0c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:55.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.727+0000 7f9a12a00640 1 -- 172.21.15.112:0/1803053483 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c017070 con 0x7f9a1c0b1d70 2024-09-12T02:43:55.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.727+0000 7f9a12a00640 1 -- 172.21.15.112:0/1803053483 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a0c005480 con 0x7f9a1c0b1d70 2024-09-12T02:43:55.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.727+0000 7f9a12a00640 1 -- 172.21.15.112:0/1803053483 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c003830 con 0x7f9a1c0b1d70 2024-09-12T02:43:55.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.727+0000 7f9a1be00640 1 -- 172.21.15.112:0/1803053483 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a1c0cb0b0 con 0x7f9a1c0b1d70 2024-09-12T02:43:55.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.727+0000 7f9a1be00640 1 -- 172.21.15.112:0/1803053483 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a1c0c86c0 con 0x7f9a1c0b1d70 2024-09-12T02:43:55.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.728+0000 7f9a1be00640 1 -- 172.21.15.112:0/1803053483 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a1c0d28d0 con 0x7f9a1c0b1d70 2024-09-12T02:43:55.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.729+0000 7f9a12a00640 1 -- 172.21.15.112:0/1803053483 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9a0c01a070 con 0x7f9a1c0b1d70 2024-09-12T02:43:55.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.730+0000 7f9a12a00640 1 --2- 172.21.15.112:0/1803053483 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f99fc06be30 0x7f99fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:55.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.730+0000 7f9a12a00640 1 -- 172.21.15.112:0/1803053483 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5853+0+0 (secure 0 0 0) 0x7f9a0c08a150 con 0x7f9a1c0b1d70 2024-09-12T02:43:55.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.730+0000 7f9a1a000640 1 --2- 172.21.15.112:0/1803053483 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f99fc06be30 0x7f99fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:55.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.731+0000 7f9a1a000640 1 --2- 172.21.15.112:0/1803053483 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f99fc06be30 0x7f99fc06e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9a08009b40 tx=0x7f9a08009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:55.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.734+0000 7f9a12a00640 1 -- 172.21.15.112:0/1803053483 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9a1c1f4940 con 0x7f9a1c0b1d70 2024-09-12T02:43:55.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:55.942+0000 7f9a1be00640 1 -- 172.21.15.112:0/1803053483 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f9a1c0cb5d0 con 0x7f9a1c0b1d70 2024-09-12T02:43:56.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.546+0000 7f9a12a00640 1 -- 172.21.15.112:0/1803053483 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) ==== 104+0+0 (secure 0 0 0) 0x7f9a0c058410 con 0x7f9a1c0b1d70 2024-09-12T02:43:56.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.549+0000 7f9a1be00640 1 -- 172.21.15.112:0/1803053483 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f99fc06be30 msgr2=0x7f99fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:56.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.549+0000 7f9a1be00640 1 --2- 172.21.15.112:0/1803053483 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f99fc06be30 0x7f99fc06e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9a08009b40 tx=0x7f9a08009190 comp rx=0 tx=0).stop 2024-09-12T02:43:56.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.549+0000 7f9a1be00640 1 -- 172.21.15.112:0/1803053483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a1c0b1d70 msgr2=0x7f9a1c157f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:56.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.549+0000 7f9a1be00640 1 --2- 172.21.15.112:0/1803053483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a1c0b1d70 0x7f9a1c157f30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00c440 tx=0x7f9a0c00c900 comp rx=0 tx=0).stop 2024-09-12T02:43:56.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.549+0000 7f9a1be00640 1 -- 172.21.15.112:0/1803053483 shutdown_connections 2024-09-12T02:43:56.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.549+0000 7f9a1be00640 1 --2- 172.21.15.112:0/1803053483 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9a1c0d1710 0x7f9a1c0cf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.549+0000 7f9a1be00640 1 --2- 172.21.15.112:0/1803053483 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f99fc06be30 0x7f99fc06e2f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.549+0000 7f9a1be00640 1 --2- 172.21.15.112:0/1803053483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9a1c0b3e00 0x7f9a1c0cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.549+0000 7f9a1be00640 1 --2- 172.21.15.112:0/1803053483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a1c0b1d70 0x7f9a1c157f30 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.549+0000 7f9a1be00640 1 -- 172.21.15.112:0/1803053483 >> 172.21.15.112:0/1803053483 conn(0x7f9a1c09e030 msgr2=0x7f9a1c0b8160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:56.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.549+0000 7f9a1be00640 1 -- 172.21.15.112:0/1803053483 shutdown_connections 2024-09-12T02:43:56.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.549+0000 7f9a1be00640 1 -- 172.21.15.112:0/1803053483 wait complete. 2024-09-12T02:43:56.567 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T02:43:56.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.723+0000 7ff2af200640 1 Processor -- start 2024-09-12T02:43:56.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.723+0000 7ff2af200640 1 -- start start 2024-09-12T02:43:56.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.725+0000 7ff2af200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2a80b4140 0x7ff2a80b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:56.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.725+0000 7ff2af200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff2a81602f0 0x7ff2a80ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:56.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.725+0000 7ff2af200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2a806eed0 con 0x7ff2a8144890 2024-09-12T02:43:56.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.725+0000 7ff2af200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff2a806f170 con 0x7ff2a81602f0 2024-09-12T02:43:56.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.725+0000 7ff2af200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff2a815f810 con 0x7ff2a80b4140 2024-09-12T02:43:56.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.725+0000 7ff2ad200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff2a81602f0 0x7ff2a80ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:56.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.725+0000 7ff2ad200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff2a81602f0 0x7ff2a80ce5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:56050/0 (socket says 172.21.15.112:56050) 2024-09-12T02:43:56.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.725+0000 7ff2ad200640 1 -- 172.21.15.112:0/2484459157 learned_addr learned my addr 172.21.15.112:0/2484459157 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:56.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.725+0000 7ff29f400640 1 --2- 172.21.15.112:0/2484459157 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2a80b4140 0x7ff2a80b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:56.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.726+0000 7ff2ad200640 1 -- 172.21.15.112:0/2484459157 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2a80b4140 msgr2=0x7ff2a80b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:56.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.726+0000 7ff2ad200640 1 --2- 172.21.15.112:0/2484459157 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2a80b4140 0x7ff2a80b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.726+0000 7ff2ad200640 1 -- 172.21.15.112:0/2484459157 >> v1:172.21.15.137:6789/0 conn(0x7ff2a8144890 legacy=0x7ff2a80b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:56.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.726+0000 7ff2ad200640 1 -- 172.21.15.112:0/2484459157 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a815faf0 con 0x7ff2a81602f0 2024-09-12T02:43:56.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.727+0000 7ff2ad200640 1 --2- 172.21.15.112:0/2484459157 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2a81602f0 0x7ff2a80ce5b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0009e50 tx=0x7ff2a002a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95271c34a0bf6936 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:56.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.727+0000 7ff2a7400640 1 -- 172.21.15.112:0/2484459157 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a0036070 con 0x7ff2a81602f0 2024-09-12T02:43:56.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.727+0000 7ff2a7400640 1 -- 172.21.15.112:0/2484459157 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2a0031600 con 0x7ff2a81602f0 2024-09-12T02:43:56.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.727+0000 7ff2a7400640 1 -- 172.21.15.112:0/2484459157 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a00319d0 con 0x7ff2a81602f0 2024-09-12T02:43:56.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.728+0000 7ff2af200640 1 -- 172.21.15.112:0/2484459157 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2a81602f0 msgr2=0x7ff2a80ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:56.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.728+0000 7ff2af200640 1 --2- 172.21.15.112:0/2484459157 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2a81602f0 0x7ff2a80ce5b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0009e50 tx=0x7ff2a002a710 comp rx=0 tx=0).stop 2024-09-12T02:43:56.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.728+0000 7ff2af200640 1 -- 172.21.15.112:0/2484459157 shutdown_connections 2024-09-12T02:43:56.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.728+0000 7ff2af200640 1 --2- 172.21.15.112:0/2484459157 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2a81602f0 0x7ff2a80ce5b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.728+0000 7ff2af200640 1 --2- 172.21.15.112:0/2484459157 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2a80b4140 0x7ff2a80b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.728+0000 7ff2af200640 1 -- 172.21.15.112:0/2484459157 >> 172.21.15.112:0/2484459157 conn(0x7ff2a80b2730 msgr2=0x7ff2a80b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:56.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.728+0000 7ff2af200640 1 -- 172.21.15.112:0/2484459157 shutdown_connections 2024-09-12T02:43:56.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.728+0000 7ff2af200640 1 -- 172.21.15.112:0/2484459157 wait complete. 2024-09-12T02:43:56.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.729+0000 7ff2af200640 1 Processor -- start 2024-09-12T02:43:56.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.729+0000 7ff2af200640 1 -- start start 2024-09-12T02:43:56.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.730+0000 7ff2af200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2a80b4140 0x7ff2a80ac490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:56.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.730+0000 7ff2af200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2a8144890 0x7ff2a815bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:56.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.730+0000 7ff2af200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2a81602f0 0x7ff2a81f5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:56.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.730+0000 7ff2af200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a8144df0 con 0x7ff2a80b4140 2024-09-12T02:43:56.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.730+0000 7ff2af200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a8144c70 con 0x7ff2a81602f0 2024-09-12T02:43:56.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.730+0000 7ff2af200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff2a80b3290 con 0x7ff2a8144890 2024-09-12T02:43:56.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.731+0000 7ff2a7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2a80b4140 0x7ff2a80ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:56.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.731+0000 7ff2a7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2a80b4140 0x7ff2a80ac490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38186/0 (socket says 172.21.15.112:38186) 2024-09-12T02:43:56.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.731+0000 7ff2a7e00640 1 -- 172.21.15.112:0/2731070302 learned_addr learned my addr 172.21.15.112:0/2731070302 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:56.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.731+0000 7ff2ad200640 1 --2- 172.21.15.112:0/2731070302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2a81602f0 0x7ff2a81f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:56.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.731+0000 7ff29f400640 1 --2- 172.21.15.112:0/2731070302 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2a8144890 0x7ff2a815bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:56.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.731+0000 7ff2ad200640 1 -- 172.21.15.112:0/2731070302 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2a8144890 msgr2=0x7ff2a815bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:56.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.731+0000 7ff2ad200640 1 --2- 172.21.15.112:0/2731070302 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2a8144890 0x7ff2a815bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.731+0000 7ff2ad200640 1 -- 172.21.15.112:0/2731070302 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2a80b4140 msgr2=0x7ff2a80ac490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:56.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.731+0000 7ff2ad200640 1 --2- 172.21.15.112:0/2731070302 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2a80b4140 0x7ff2a80ac490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:56.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.731+0000 7ff2ad200640 1 -- 172.21.15.112:0/2731070302 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a80ab3f0 con 0x7ff2a81602f0 2024-09-12T02:43:56.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.731+0000 7ff2a7e00640 1 --2- 172.21.15.112:0/2731070302 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2a80b4140 0x7ff2a80ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:43:56.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.731+0000 7ff2ad200640 1 --2- 172.21.15.112:0/2731070302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2a81602f0 0x7ff2a81f5f90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0030000 tx=0x7ff2a0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:56.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.732+0000 7ff2a4c00640 1 -- 172.21.15.112:0/2731070302 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a0036050 con 0x7ff2a81602f0 2024-09-12T02:43:56.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.732+0000 7ff2a4c00640 1 -- 172.21.15.112:0/2731070302 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2a0042070 con 0x7ff2a81602f0 2024-09-12T02:43:56.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.732+0000 7ff2a4c00640 1 -- 172.21.15.112:0/2731070302 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a0009510 con 0x7ff2a81602f0 2024-09-12T02:43:56.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.732+0000 7ff2af200640 1 -- 172.21.15.112:0/2731070302 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2a80ab6d0 con 0x7ff2a81602f0 2024-09-12T02:43:56.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.732+0000 7ff2af200640 1 -- 172.21.15.112:0/2731070302 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2a80abc90 con 0x7ff2a81602f0 2024-09-12T02:43:56.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.733+0000 7ff2af200640 1 -- 172.21.15.112:0/2731070302 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2a80b58c0 con 0x7ff2a81602f0 2024-09-12T02:43:56.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.734+0000 7ff2a4c00640 1 -- 172.21.15.112:0/2731070302 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff2a0007c10 con 0x7ff2a81602f0 2024-09-12T02:43:56.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.735+0000 7ff2a4c00640 1 --2- 172.21.15.112:0/2731070302 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff28406be30 0x7ff28406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:56.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.735+0000 7ff2a4c00640 1 -- 172.21.15.112:0/2731070302 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5853+0+0 (secure 0 0 0) 0x7ff2a00abb90 con 0x7ff2a81602f0 2024-09-12T02:43:56.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.735+0000 7ff2a7e00640 1 --2- 172.21.15.112:0/2731070302 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff28406be30 0x7ff28406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:56.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.735+0000 7ff2a7e00640 1 --2- 172.21.15.112:0/2731070302 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff28406be30 0x7ff28406e2f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff298001c10 tx=0x7ff298009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:56.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.741+0000 7ff2a4c00640 1 -- 172.21.15.112:0/2731070302 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff2a0079ee0 con 0x7ff2a81602f0 2024-09-12T02:43:56.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:56.914+0000 7ff2af200640 1 -- 172.21.15.112:0/2731070302 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff2a80b3ad0 con 0x7ff2a81602f0 2024-09-12T02:43:57.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.564+0000 7ff2a4c00640 1 -- 172.21.15.112:0/2731070302 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v55) ==== 181+0+0 (secure 0 0 0) 0x7ff2a007e1e0 con 0x7ff2a81602f0 2024-09-12T02:43:57.566 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' removed 2024-09-12T02:43:57.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.567+0000 7ff2af200640 1 -- 172.21.15.112:0/2731070302 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff28406be30 msgr2=0x7ff28406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:57.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.567+0000 7ff2af200640 1 --2- 172.21.15.112:0/2731070302 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff28406be30 0x7ff28406e2f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff298001c10 tx=0x7ff298009040 comp rx=0 tx=0).stop 2024-09-12T02:43:57.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.567+0000 7ff2af200640 1 -- 172.21.15.112:0/2731070302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2a81602f0 msgr2=0x7ff2a81f5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:57.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.567+0000 7ff2af200640 1 --2- 172.21.15.112:0/2731070302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2a81602f0 0x7ff2a81f5f90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0030000 tx=0x7ff2a0004a40 comp rx=0 tx=0).stop 2024-09-12T02:43:57.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.567+0000 7ff2af200640 1 -- 172.21.15.112:0/2731070302 shutdown_connections 2024-09-12T02:43:57.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.567+0000 7ff2af200640 1 --2- 172.21.15.112:0/2731070302 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff28406be30 0x7ff28406e2f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:57.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.567+0000 7ff2af200640 1 --2- 172.21.15.112:0/2731070302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2a81602f0 0x7ff2a81f5f90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:57.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.567+0000 7ff2af200640 1 --2- 172.21.15.112:0/2731070302 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2a8144890 0x7ff2a815bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:57.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.567+0000 7ff2af200640 1 --2- 172.21.15.112:0/2731070302 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2a80b4140 0x7ff2a80ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:57.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.567+0000 7ff2af200640 1 -- 172.21.15.112:0/2731070302 >> 172.21.15.112:0/2731070302 conn(0x7ff2a80b2730 msgr2=0x7ff2a80b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:57.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.567+0000 7ff2af200640 1 -- 172.21.15.112:0/2731070302 shutdown_connections 2024-09-12T02:43:57.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.567+0000 7ff2af200640 1 -- 172.21.15.112:0/2731070302 wait complete. 2024-09-12T02:43:57.585 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T02:43:57.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.742+0000 7f3baee00640 1 Processor -- start 2024-09-12T02:43:57.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.743+0000 7f3baee00640 1 -- start start 2024-09-12T02:43:57.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.744+0000 7f3baee00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3ba8144890 0x7f3ba80b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:57.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.744+0000 7f3baee00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3ba81602f0 0x7f3ba80b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:57.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.744+0000 7f3baee00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3ba80b3290 0x7f3ba80b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:57.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.744+0000 7f3baee00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f3ba806eed0 con 0x7f3ba80b3290 2024-09-12T02:43:57.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.744+0000 7f3baee00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3ba806f170 con 0x7f3ba81602f0 2024-09-12T02:43:57.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.744+0000 7f3baee00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3ba815f810 con 0x7f3ba8144890 2024-09-12T02:43:57.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.744+0000 7f3bace00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3ba80b3290 0x7f3ba80b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:57.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.744+0000 7f3bace00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3ba80b3290 0x7f3ba80b3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38188/0 (socket says 172.21.15.112:38188) 2024-09-12T02:43:57.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.744+0000 7f3bace00640 1 -- 172.21.15.112:0/1619889076 learned_addr learned my addr 172.21.15.112:0/1619889076 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:57.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.744+0000 7f3ba7e00640 1 --2- 172.21.15.112:0/1619889076 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3ba8144890 0x7f3ba80b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:57.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.745+0000 7f3b9f400640 1 --2- 172.21.15.112:0/1619889076 >> v2:172.21.15.137:3300/0 conn(0x7f3ba81602f0 0x7f3ba80b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:57.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.745+0000 7f3bace00640 1 -- 172.21.15.112:0/1619889076 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3ba8144890 msgr2=0x7f3ba80b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:57.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.745+0000 7f3bace00640 1 --2- 172.21.15.112:0/1619889076 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3ba8144890 0x7f3ba80b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:57.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.745+0000 7f3bace00640 1 -- 172.21.15.112:0/1619889076 >> v2:172.21.15.137:3300/0 conn(0x7f3ba81602f0 msgr2=0x7f3ba80b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:57.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.745+0000 7f3bace00640 1 --2- 172.21.15.112:0/1619889076 >> v2:172.21.15.137:3300/0 conn(0x7f3ba81602f0 0x7f3ba80b3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:57.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.745+0000 7f3bace00640 1 -- 172.21.15.112:0/1619889076 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ba815faf0 con 0x7f3ba80b3290 2024-09-12T02:43:57.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.745+0000 7f3ba7e00640 1 --2- 172.21.15.112:0/1619889076 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3ba8144890 0x7f3ba80b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:43:57.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.745+0000 7f3b9f400640 1 --2- 172.21.15.112:0/1619889076 >> v2:172.21.15.137:3300/0 conn(0x7f3ba81602f0 0x7f3ba80b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:43:57.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.746+0000 7f3bace00640 1 --2- 172.21.15.112:0/1619889076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ba80b3290 0x7f3ba80b3f70 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3ba806f520 tx=0x7f3ba002c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd397bbd9cf2ce36 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:57.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.746+0000 7f3ba7400640 1 -- 172.21.15.112:0/1619889076 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0039070 con 0x7f3ba80b3290 2024-09-12T02:43:57.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.746+0000 7f3ba7400640 1 -- 172.21.15.112:0/1619889076 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ba0009600 con 0x7f3ba80b3290 2024-09-12T02:43:57.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.746+0000 7f3ba7400640 1 -- 172.21.15.112:0/1619889076 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba00099f0 con 0x7f3ba80b3290 2024-09-12T02:43:57.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.746+0000 7f3baee00640 1 -- 172.21.15.112:0/1619889076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ba80b3290 msgr2=0x7f3ba80b3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:57.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.746+0000 7f3baee00640 1 --2- 172.21.15.112:0/1619889076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ba80b3290 0x7f3ba80b3f70 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3ba806f520 tx=0x7f3ba002c810 comp rx=0 tx=0).stop 2024-09-12T02:43:57.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.746+0000 7f3baee00640 1 -- 172.21.15.112:0/1619889076 shutdown_connections 2024-09-12T02:43:57.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.746+0000 7f3baee00640 1 --2- 172.21.15.112:0/1619889076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ba80b3290 0x7f3ba80b3f70 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:57.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.746+0000 7f3baee00640 1 --2- 172.21.15.112:0/1619889076 >> v2:172.21.15.137:3300/0 conn(0x7f3ba81602f0 0x7f3ba80b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:57.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.746+0000 7f3baee00640 1 --2- 172.21.15.112:0/1619889076 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3ba8144890 0x7f3ba80b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:57.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.746+0000 7f3baee00640 1 -- 172.21.15.112:0/1619889076 >> 172.21.15.112:0/1619889076 conn(0x7f3ba80b2730 msgr2=0x7f3ba80b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:57.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.747+0000 7f3baee00640 1 -- 172.21.15.112:0/1619889076 shutdown_connections 2024-09-12T02:43:57.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.747+0000 7f3baee00640 1 -- 172.21.15.112:0/1619889076 wait complete. 2024-09-12T02:43:57.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.748+0000 7f3baee00640 1 Processor -- start 2024-09-12T02:43:57.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.748+0000 7f3baee00640 1 -- start start 2024-09-12T02:43:57.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.749+0000 7f3baee00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ba80b3290 0x7f3ba8136d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:57.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.749+0000 7f3baee00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3ba8144890 0x7f3ba8141120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:57.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.749+0000 7f3baee00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ba81602f0 0x7f3ba80b1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:57.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.749+0000 7f3baee00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba8144df0 con 0x7f3ba81602f0 2024-09-12T02:43:57.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.749+0000 7f3baee00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba8144c70 con 0x7f3ba80b3290 2024-09-12T02:43:57.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.749+0000 7f3baee00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3ba80d0500 con 0x7f3ba8144890 2024-09-12T02:43:57.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.749+0000 7f3bace00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ba81602f0 0x7f3ba80b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:57.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.749+0000 7f3bace00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ba81602f0 0x7f3ba80b1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38198/0 (socket says 172.21.15.112:38198) 2024-09-12T02:43:57.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.749+0000 7f3bace00640 1 -- 172.21.15.112:0/4084422448 learned_addr learned my addr 172.21.15.112:0/4084422448 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:57.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.750+0000 7f3b9f400640 1 --2- 172.21.15.112:0/4084422448 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3ba8144890 0x7f3ba8141120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:57.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.750+0000 7f3ba7e00640 1 --2- 172.21.15.112:0/4084422448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ba80b3290 0x7f3ba8136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:57.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.750+0000 7f3bace00640 1 -- 172.21.15.112:0/4084422448 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3ba8144890 msgr2=0x7f3ba8141120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:57.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.750+0000 7f3bace00640 1 --2- 172.21.15.112:0/4084422448 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3ba8144890 0x7f3ba8141120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:57.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.750+0000 7f3bace00640 1 -- 172.21.15.112:0/4084422448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ba80b3290 msgr2=0x7f3ba8136d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:57.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.750+0000 7f3bace00640 1 --2- 172.21.15.112:0/4084422448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ba80b3290 0x7f3ba8136d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:57.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.750+0000 7f3bace00640 1 -- 172.21.15.112:0/4084422448 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ba81372b0 con 0x7f3ba81602f0 2024-09-12T02:43:57.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.750+0000 7f3ba7e00640 1 --2- 172.21.15.112:0/4084422448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ba80b3290 0x7f3ba8136d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:43:57.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.750+0000 7f3bace00640 1 --2- 172.21.15.112:0/4084422448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ba81602f0 0x7f3ba80b1720 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3ba002ce00 tx=0x7f3ba0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:57.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.750+0000 7f3ba4c00640 1 -- 172.21.15.112:0/4084422448 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0044070 con 0x7f3ba81602f0 2024-09-12T02:43:57.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.750+0000 7f3ba4c00640 1 -- 172.21.15.112:0/4084422448 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ba0004040 con 0x7f3ba81602f0 2024-09-12T02:43:57.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.750+0000 7f3baee00640 1 -- 172.21.15.112:0/4084422448 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ba815ec80 con 0x7f3ba81602f0 2024-09-12T02:43:57.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.750+0000 7f3ba4c00640 1 -- 172.21.15.112:0/4084422448 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0039070 con 0x7f3ba81602f0 2024-09-12T02:43:57.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.751+0000 7f3baee00640 1 -- 172.21.15.112:0/4084422448 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ba815dec0 con 0x7f3ba81602f0 2024-09-12T02:43:57.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.752+0000 7f3baee00640 1 -- 172.21.15.112:0/4084422448 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ba80b58c0 con 0x7f3ba81602f0 2024-09-12T02:43:57.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.752+0000 7f3ba4c00640 1 -- 172.21.15.112:0/4084422448 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3ba0047070 con 0x7f3ba81602f0 2024-09-12T02:43:57.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.753+0000 7f3ba4c00640 1 --2- 172.21.15.112:0/4084422448 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3b8406be30 0x7f3b8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:57.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.753+0000 7f3ba4c00640 1 -- 172.21.15.112:0/4084422448 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5415+0+0 (secure 0 0 0) 0x7f3ba00ab410 con 0x7f3ba81602f0 2024-09-12T02:43:57.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.754+0000 7f3ba7e00640 1 --2- 172.21.15.112:0/4084422448 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3b8406be30 0x7f3b8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:57.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.754+0000 7f3ba7e00640 1 --2- 172.21.15.112:0/4084422448 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3b8406be30 0x7f3b8406e2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3b9800aa30 tx=0x7f3b98008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:57.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.758+0000 7f3ba4c00640 1 -- 172.21.15.112:0/4084422448 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3ba81372b0 con 0x7f3ba81602f0 2024-09-12T02:43:57.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:57.931+0000 7f3baee00640 1 -- 172.21.15.112:0/4084422448 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3ba806e140 con 0x7f3ba81602f0 2024-09-12T02:43:58.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.558+0000 7f3ba4c00640 1 -- 172.21.15.112:0/4084422448 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v56) ==== 169+0+0 (secure 0 0 0) 0x7f3ba00797f0 con 0x7f3ba81602f0 2024-09-12T02:43:58.560 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' removed 2024-09-12T02:43:58.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.563+0000 7f3baee00640 1 -- 172.21.15.112:0/4084422448 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3b8406be30 msgr2=0x7f3b8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:58.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.563+0000 7f3baee00640 1 --2- 172.21.15.112:0/4084422448 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3b8406be30 0x7f3b8406e2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3b9800aa30 tx=0x7f3b98008040 comp rx=0 tx=0).stop 2024-09-12T02:43:58.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.563+0000 7f3baee00640 1 -- 172.21.15.112:0/4084422448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ba81602f0 msgr2=0x7f3ba80b1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:58.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.563+0000 7f3baee00640 1 --2- 172.21.15.112:0/4084422448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ba81602f0 0x7f3ba80b1720 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3ba002ce00 tx=0x7f3ba0004a40 comp rx=0 tx=0).stop 2024-09-12T02:43:58.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.563+0000 7f3baee00640 1 -- 172.21.15.112:0/4084422448 shutdown_connections 2024-09-12T02:43:58.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.563+0000 7f3baee00640 1 --2- 172.21.15.112:0/4084422448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ba81602f0 0x7f3ba80b1720 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:58.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.563+0000 7f3baee00640 1 --2- 172.21.15.112:0/4084422448 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3ba8144890 0x7f3ba8141120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:58.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.563+0000 7f3baee00640 1 --2- 172.21.15.112:0/4084422448 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3b8406be30 0x7f3b8406e2f0 secure :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3b9800aa30 tx=0x7f3b98008040 comp rx=0 tx=0).stop 2024-09-12T02:43:58.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.563+0000 7f3baee00640 1 --2- 172.21.15.112:0/4084422448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ba80b3290 0x7f3ba8136d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:58.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.563+0000 7f3baee00640 1 -- 172.21.15.112:0/4084422448 >> 172.21.15.112:0/4084422448 conn(0x7f3ba80b2730 msgr2=0x7f3ba80af4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:58.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.565+0000 7f3baee00640 1 -- 172.21.15.112:0/4084422448 shutdown_connections 2024-09-12T02:43:58.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.565+0000 7f3baee00640 1 -- 172.21.15.112:0/4084422448 wait complete. 2024-09-12T02:43:58.585 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T02:43:58.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.739+0000 7f7dab600640 1 Processor -- start 2024-09-12T02:43:58.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.740+0000 7f7dab600640 1 -- start start 2024-09-12T02:43:58.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.741+0000 7f7dab600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7da4071530 0x7f7da40af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:58.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.741+0000 7f7dab600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7da40719a0 0x7f7da40afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:58.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.741+0000 7f7dab600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7da40ceeb0 con 0x7f7da415cc50 2024-09-12T02:43:58.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.741+0000 7f7dab600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f7da415d030 con 0x7f7da4071530 2024-09-12T02:43:58.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.741+0000 7f7dab600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7da40cf4c0 con 0x7f7da40719a0 2024-09-12T02:43:58.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.741+0000 7f7da3e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7da4071530 0x7f7da40af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:58.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.741+0000 7f7da8c00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f7da415cc50 0x7f7da40732f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38762/0 (socket says 172.21.15.112:38762) 2024-09-12T02:43:58.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.741+0000 7f7da8c00640 1 -- 172.21.15.112:0/3890895797 learned_addr learned my addr 172.21.15.112:0/3890895797 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:58.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.742+0000 7f7da9600640 1 --2- 172.21.15.112:0/3890895797 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7da40719a0 0x7f7da40afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:58.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.742+0000 7f7da3e00640 1 -- 172.21.15.112:0/3890895797 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7da40719a0 msgr2=0x7f7da40afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:58.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.742+0000 7f7da3400640 1 -- 172.21.15.112:0/3890895797 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2844949172 0 0) 0x7f7da40ceeb0 con 0x7f7da415cc50 2024-09-12T02:43:58.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.742+0000 7f7da3e00640 1 --2- 172.21.15.112:0/3890895797 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7da40719a0 0x7f7da40afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:58.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.742+0000 7f7da3e00640 1 -- 172.21.15.112:0/3890895797 >> v1:172.21.15.112:6789/0 conn(0x7f7da415cc50 legacy=0x7f7da40732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:58.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.742+0000 7f7da3e00640 1 -- 172.21.15.112:0/3890895797 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da406e300 con 0x7f7da4071530 2024-09-12T02:43:58.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.743+0000 7f7da3e00640 1 --2- 172.21.15.112:0/3890895797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7da4071530 0x7f7da40af720 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7da40cf640 tx=0x7f7d9002a0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9867cdaf2c7fa64 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:58.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.743+0000 7f7da3400640 1 -- 172.21.15.112:0/3890895797 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d90037070 con 0x7f7da4071530 2024-09-12T02:43:58.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.743+0000 7f7da3400640 1 -- 172.21.15.112:0/3890895797 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d9002ae30 con 0x7f7da4071530 2024-09-12T02:43:58.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.743+0000 7f7da3400640 1 -- 172.21.15.112:0/3890895797 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d90032640 con 0x7f7da4071530 2024-09-12T02:43:58.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.743+0000 7f7dab600640 1 -- 172.21.15.112:0/3890895797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7da4071530 msgr2=0x7f7da40af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:58.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.743+0000 7f7dab600640 1 --2- 172.21.15.112:0/3890895797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7da4071530 0x7f7da40af720 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7da40cf640 tx=0x7f7d9002a0e0 comp rx=0 tx=0).stop 2024-09-12T02:43:58.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.744+0000 7f7dab600640 1 -- 172.21.15.112:0/3890895797 shutdown_connections 2024-09-12T02:43:58.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.744+0000 7f7dab600640 1 --2- 172.21.15.112:0/3890895797 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7da40719a0 0x7f7da40afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:58.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.744+0000 7f7dab600640 1 --2- 172.21.15.112:0/3890895797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7da4071530 0x7f7da40af720 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:58.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.744+0000 7f7dab600640 1 -- 172.21.15.112:0/3890895797 >> 172.21.15.112:0/3890895797 conn(0x7f7da406bbd0 msgr2=0x7f7da406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:58.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.744+0000 7f7dab600640 1 -- 172.21.15.112:0/3890895797 shutdown_connections 2024-09-12T02:43:58.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.744+0000 7f7dab600640 1 -- 172.21.15.112:0/3890895797 wait complete. 2024-09-12T02:43:58.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.745+0000 7f7dab600640 1 Processor -- start 2024-09-12T02:43:58.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.745+0000 7f7dab600640 1 -- start start 2024-09-12T02:43:58.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.746+0000 7f7dab600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7da4071530 0x7f7da414a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:58.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.746+0000 7f7dab600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7da40719a0 0x7f7da41554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:58.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.746+0000 7f7dab600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7da415cc50 0x7f7da4160980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:58.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.746+0000 7f7dab600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7da406f510 con 0x7f7da415cc50 2024-09-12T02:43:58.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.746+0000 7f7dab600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7da40cf150 con 0x7f7da40719a0 2024-09-12T02:43:58.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.746+0000 7f7dab600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7da406f690 con 0x7f7da4071530 2024-09-12T02:43:58.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.747+0000 7f7da9600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7da415cc50 0x7f7da4160980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:58.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.747+0000 7f7da9600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7da415cc50 0x7f7da4160980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38208/0 (socket says 172.21.15.112:38208) 2024-09-12T02:43:58.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.747+0000 7f7da9600640 1 -- 172.21.15.112:0/637940749 learned_addr learned my addr 172.21.15.112:0/637940749 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:58.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.747+0000 7f7da8c00640 1 --2- 172.21.15.112:0/637940749 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7da4071530 0x7f7da414a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:58.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.747+0000 7f7da3e00640 1 --2- 172.21.15.112:0/637940749 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7da40719a0 0x7f7da41554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:58.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.747+0000 7f7da9600640 1 -- 172.21.15.112:0/637940749 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7da4071530 msgr2=0x7f7da414a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:58.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.747+0000 7f7da9600640 1 --2- 172.21.15.112:0/637940749 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7da4071530 0x7f7da414a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:58.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.747+0000 7f7da9600640 1 -- 172.21.15.112:0/637940749 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7da40719a0 msgr2=0x7f7da41554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:58.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.747+0000 7f7da9600640 1 --2- 172.21.15.112:0/637940749 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7da40719a0 0x7f7da41554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:58.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.747+0000 7f7da9600640 1 -- 172.21.15.112:0/637940749 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da4155f60 con 0x7f7da415cc50 2024-09-12T02:43:58.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.747+0000 7f7da9600640 1 --2- 172.21.15.112:0/637940749 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7da415cc50 0x7f7da4160980 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c007de0 tx=0x7f7d9c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:58.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.748+0000 7f7da0c00640 1 -- 172.21.15.112:0/637940749 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c014620 con 0x7f7da415cc50 2024-09-12T02:43:58.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.748+0000 7f7da0c00640 1 -- 172.21.15.112:0/637940749 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d9c019070 con 0x7f7da415cc50 2024-09-12T02:43:58.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.748+0000 7f7da0c00640 1 -- 172.21.15.112:0/637940749 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c014a20 con 0x7f7da415cc50 2024-09-12T02:43:58.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.748+0000 7f7dab600640 1 -- 172.21.15.112:0/637940749 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7da4156240 con 0x7f7da415cc50 2024-09-12T02:43:58.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.748+0000 7f7dab600640 1 -- 172.21.15.112:0/637940749 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7da4156800 con 0x7f7da415cc50 2024-09-12T02:43:58.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.749+0000 7f7dab600640 1 -- 172.21.15.112:0/637940749 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7da4068a30 con 0x7f7da415cc50 2024-09-12T02:43:58.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.750+0000 7f7da0c00640 1 -- 172.21.15.112:0/637940749 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d9c014bc0 con 0x7f7da415cc50 2024-09-12T02:43:58.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.750+0000 7f7da0c00640 1 --2- 172.21.15.112:0/637940749 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7d8406be30 0x7f7d8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:58.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.751+0000 7f7da0c00640 1 -- 172.21.15.112:0/637940749 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 4943+0+0 (secure 0 0 0) 0x7f7d9c08b440 con 0x7f7da415cc50 2024-09-12T02:43:58.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.751+0000 7f7da8c00640 1 --2- 172.21.15.112:0/637940749 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7d8406be30 0x7f7d8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:58.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.751+0000 7f7da8c00640 1 --2- 172.21.15.112:0/637940749 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7d8406be30 0x7f7d8406e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7d98007fd0 tx=0x7f7d98007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:58.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.754+0000 7f7da0c00640 1 -- 172.21.15.112:0/637940749 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7d9c059a00 con 0x7f7da415cc50 2024-09-12T02:43:58.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.926+0000 7f7dab600640 1 -- 172.21.15.112:0/637940749 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f7da40730d0 con 0x7f7da415cc50 2024-09-12T02:43:58.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.930+0000 7f7da0c00640 1 -- 172.21.15.112:0/637940749 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) ==== 104+0+0 (secure 0 0 0) 0x7f7d9c05dd00 con 0x7f7da415cc50 2024-09-12T02:43:58.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.933+0000 7f7dab600640 1 -- 172.21.15.112:0/637940749 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7d8406be30 msgr2=0x7f7d8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:58.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.933+0000 7f7dab600640 1 --2- 172.21.15.112:0/637940749 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7d8406be30 0x7f7d8406e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7d98007fd0 tx=0x7f7d98007de0 comp rx=0 tx=0).stop 2024-09-12T02:43:58.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.933+0000 7f7dab600640 1 -- 172.21.15.112:0/637940749 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7da415cc50 msgr2=0x7f7da4160980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:58.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.933+0000 7f7dab600640 1 --2- 172.21.15.112:0/637940749 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7da415cc50 0x7f7da4160980 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c007de0 tx=0x7f7d9c00e4b0 comp rx=0 tx=0).stop 2024-09-12T02:43:58.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.933+0000 7f7dab600640 1 -- 172.21.15.112:0/637940749 shutdown_connections 2024-09-12T02:43:58.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.933+0000 7f7dab600640 1 --2- 172.21.15.112:0/637940749 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7da415cc50 0x7f7da4160980 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:58.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.933+0000 7f7dab600640 1 --2- 172.21.15.112:0/637940749 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7d8406be30 0x7f7d8406e2f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:58.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.933+0000 7f7dab600640 1 --2- 172.21.15.112:0/637940749 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7da40719a0 0x7f7da41554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:58.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.933+0000 7f7dab600640 1 --2- 172.21.15.112:0/637940749 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7da4071530 0x7f7da414a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:58.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.933+0000 7f7dab600640 1 -- 172.21.15.112:0/637940749 >> 172.21.15.112:0/637940749 conn(0x7f7da406bbd0 msgr2=0x7f7da40d0990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:58.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.933+0000 7f7dab600640 1 -- 172.21.15.112:0/637940749 shutdown_connections 2024-09-12T02:43:58.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:58.933+0000 7f7dab600640 1 -- 172.21.15.112:0/637940749 wait complete. 2024-09-12T02:43:58.950 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2024-09-12T02:43:59.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.109+0000 7ffbaea00640 1 Processor -- start 2024-09-12T02:43:59.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.109+0000 7ffbaea00640 1 -- start start 2024-09-12T02:43:59.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.111+0000 7ffbaea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffba815b9d0 0x7ffba80b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:59.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.111+0000 7ffbaea00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ffba80b45d0 0x7ffba80728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:59.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.111+0000 7ffbaea00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffba80b54a0 con 0x7ffba806eef0 2024-09-12T02:43:59.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.111+0000 7ffbaea00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ffba80b4a30 con 0x7ffba80b45d0 2024-09-12T02:43:59.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.111+0000 7ffbaea00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ffba80b3af0 con 0x7ffba815b9d0 2024-09-12T02:43:59.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.111+0000 7ffb9f400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ffba80b45d0 0x7ffba80728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:59.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.111+0000 7ffba7e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffba815b9d0 0x7ffba80b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:59.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.111+0000 7ffb9f400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ffba80b45d0 0x7ffba80728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:56106/0 (socket says 172.21.15.112:56106) 2024-09-12T02:43:59.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.111+0000 7ffba7e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffba815b9d0 0x7ffba80b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:49030/0 (socket says 172.21.15.112:49030) 2024-09-12T02:43:59.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.111+0000 7ffb9f400640 1 -- 172.21.15.112:0/2841107309 learned_addr learned my addr 172.21.15.112:0/2841107309 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:59.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.112+0000 7ffba7e00640 1 -- 172.21.15.112:0/2841107309 >> v2:172.21.15.137:3300/0 conn(0x7ffba80b45d0 msgr2=0x7ffba80728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:59.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.112+0000 7ffba7e00640 1 --2- 172.21.15.112:0/2841107309 >> v2:172.21.15.137:3300/0 conn(0x7ffba80b45d0 0x7ffba80728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:59.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.112+0000 7ffba7e00640 1 -- 172.21.15.112:0/2841107309 >> v1:172.21.15.137:6789/0 conn(0x7ffba806eef0 legacy=0x7ffba806f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:59.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.112+0000 7ffba7e00640 1 -- 172.21.15.112:0/2841107309 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba80b3dd0 con 0x7ffba815b9d0 2024-09-12T02:43:59.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.112+0000 7ffba7400640 1 -- 172.21.15.112:0/2841107309 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3236269706 0 0) 0x7ffba80b54a0 con 0x7ffba806eef0 2024-09-12T02:43:59.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.112+0000 7ffb9f400640 1 --2- 172.21.15.112:0/2841107309 >> v2:172.21.15.137:3300/0 conn(0x7ffba80b45d0 0x7ffba80728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:43:59.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.113+0000 7ffba7e00640 1 --2- 172.21.15.112:0/2841107309 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffba815b9d0 0x7ffba80b4ec0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffb980097a0 tx=0x7ffb9802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc3f6e741fde38b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:59.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.113+0000 7ffba7400640 1 -- 172.21.15.112:0/2841107309 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb98037070 con 0x7ffba815b9d0 2024-09-12T02:43:59.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.113+0000 7ffba7400640 1 -- 172.21.15.112:0/2841107309 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb98032440 con 0x7ffba815b9d0 2024-09-12T02:43:59.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.113+0000 7ffba7400640 1 -- 172.21.15.112:0/2841107309 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb98032810 con 0x7ffba815b9d0 2024-09-12T02:43:59.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.114+0000 7ffbaea00640 1 -- 172.21.15.112:0/2841107309 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffba815b9d0 msgr2=0x7ffba80b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:59.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.114+0000 7ffbaea00640 1 --2- 172.21.15.112:0/2841107309 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffba815b9d0 0x7ffba80b4ec0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffb980097a0 tx=0x7ffb9802a180 comp rx=0 tx=0).stop 2024-09-12T02:43:59.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.114+0000 7ffbaea00640 1 -- 172.21.15.112:0/2841107309 shutdown_connections 2024-09-12T02:43:59.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.114+0000 7ffbaea00640 1 --2- 172.21.15.112:0/2841107309 >> v2:172.21.15.137:3300/0 conn(0x7ffba80b45d0 0x7ffba80728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:59.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.114+0000 7ffbaea00640 1 --2- 172.21.15.112:0/2841107309 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffba815b9d0 0x7ffba80b4ec0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:59.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.114+0000 7ffbaea00640 1 -- 172.21.15.112:0/2841107309 >> 172.21.15.112:0/2841107309 conn(0x7ffba806bbd0 msgr2=0x7ffba806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:59.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.114+0000 7ffbaea00640 1 -- 172.21.15.112:0/2841107309 shutdown_connections 2024-09-12T02:43:59.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.114+0000 7ffbaea00640 1 -- 172.21.15.112:0/2841107309 wait complete. 2024-09-12T02:43:59.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.116+0000 7ffbaea00640 1 Processor -- start 2024-09-12T02:43:59.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.116+0000 7ffbaea00640 1 -- start start 2024-09-12T02:43:59.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.117+0000 7ffbaea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffba806eef0 0x7ffba8153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:59.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.117+0000 7ffbaea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffba80b45d0 0x7ffba81f5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:59.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.117+0000 7ffbaea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffba815b9d0 0x7ffba8154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:59.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.117+0000 7ffbaea00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ffba815bf30 con 0x7ffba806eef0 2024-09-12T02:43:59.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.117+0000 7ffbaea00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ffba815bdb0 con 0x7ffba815b9d0 2024-09-12T02:43:59.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.117+0000 7ffbaea00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ffba80cdcd0 con 0x7ffba80b45d0 2024-09-12T02:43:59.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.117+0000 7ffba7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffba806eef0 0x7ffba8153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:59.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.117+0000 7ffba7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffba806eef0 0x7ffba8153690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38214/0 (socket says 172.21.15.112:38214) 2024-09-12T02:43:59.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.117+0000 7ffba7e00640 1 -- 172.21.15.112:0/3455624411 learned_addr learned my addr 172.21.15.112:0/3455624411 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:59.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.117+0000 7ffbaca00640 1 --2- 172.21.15.112:0/3455624411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffba815b9d0 0x7ffba8154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:59.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.117+0000 7ffba7e00640 1 -- 172.21.15.112:0/3455624411 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffba80b45d0 msgr2=0x7ffba81f5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:59.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.117+0000 7ffba7e00640 1 --2- 172.21.15.112:0/3455624411 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffba80b45d0 0x7ffba81f5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:59.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.117+0000 7ffba7e00640 1 -- 172.21.15.112:0/3455624411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffba815b9d0 msgr2=0x7ffba8154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:59.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.117+0000 7ffba7e00640 1 --2- 172.21.15.112:0/3455624411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffba815b9d0 0x7ffba8154bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:59.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.117+0000 7ffba7e00640 1 -- 172.21.15.112:0/3455624411 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba81f60e0 con 0x7ffba806eef0 2024-09-12T02:43:59.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.117+0000 7ffbaca00640 1 --2- 172.21.15.112:0/3455624411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffba815b9d0 0x7ffba8154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:43:59.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.118+0000 7ffba7e00640 1 --2- 172.21.15.112:0/3455624411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffba806eef0 0x7ffba8153690 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ffb98035040 tx=0x7ffb980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:59.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.118+0000 7ffba4c00640 1 -- 172.21.15.112:0/3455624411 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb98037040 con 0x7ffba806eef0 2024-09-12T02:43:59.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.118+0000 7ffba4c00640 1 -- 172.21.15.112:0/3455624411 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb98030500 con 0x7ffba806eef0 2024-09-12T02:43:59.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.118+0000 7ffba4c00640 1 -- 172.21.15.112:0/3455624411 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb98030910 con 0x7ffba806eef0 2024-09-12T02:43:59.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.118+0000 7ffbaea00640 1 -- 172.21.15.112:0/3455624411 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffba81560d0 con 0x7ffba806eef0 2024-09-12T02:43:59.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.118+0000 7ffbaea00640 1 -- 172.21.15.112:0/3455624411 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffba81543c0 con 0x7ffba806eef0 2024-09-12T02:43:59.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.119+0000 7ffbaea00640 1 -- 172.21.15.112:0/3455624411 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffba8068a30 con 0x7ffba806eef0 2024-09-12T02:43:59.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.120+0000 7ffba4c00640 1 -- 172.21.15.112:0/3455624411 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffb98044020 con 0x7ffba806eef0 2024-09-12T02:43:59.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.121+0000 7ffba4c00640 1 --2- 172.21.15.112:0/3455624411 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ffb8406be30 0x7ffb8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:59.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.121+0000 7ffba4c00640 1 -- 172.21.15.112:0/3455624411 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 4943+0+0 (secure 0 0 0) 0x7ffb980aae00 con 0x7ffba806eef0 2024-09-12T02:43:59.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.121+0000 7ffb9f400640 1 --2- 172.21.15.112:0/3455624411 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ffb8406be30 0x7ffb8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:59.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.122+0000 7ffb9f400640 1 --2- 172.21.15.112:0/3455624411 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ffb8406be30 0x7ffb8406e2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ffb900095c0 tx=0x7ffb90006e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:59.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.125+0000 7ffba4c00640 1 -- 172.21.15.112:0/3455624411 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffb98079aa0 con 0x7ffba806eef0 2024-09-12T02:43:59.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.363+0000 7ffbaea00640 1 -- 172.21.15.112:0/3455624411 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) -- 0x7ffba80b5a00 con 0x7ffba806eef0 2024-09-12T02:43:59.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.567+0000 7ffba4c00640 1 -- 172.21.15.112:0/3455624411 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v131) ==== 142+0+0 (secure 0 0 0) 0x7ffb980793a0 con 0x7ffba806eef0 2024-09-12T02:43:59.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.570+0000 7ffbaea00640 1 -- 172.21.15.112:0/3455624411 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ffb8406be30 msgr2=0x7ffb8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:59.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.570+0000 7ffbaea00640 1 --2- 172.21.15.112:0/3455624411 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ffb8406be30 0x7ffb8406e2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ffb900095c0 tx=0x7ffb90006e30 comp rx=0 tx=0).stop 2024-09-12T02:43:59.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.570+0000 7ffbaea00640 1 -- 172.21.15.112:0/3455624411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffba806eef0 msgr2=0x7ffba8153690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:59.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.570+0000 7ffbaea00640 1 --2- 172.21.15.112:0/3455624411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffba806eef0 0x7ffba8153690 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ffb98035040 tx=0x7ffb980046c0 comp rx=0 tx=0).stop 2024-09-12T02:43:59.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.570+0000 7ffbaea00640 1 -- 172.21.15.112:0/3455624411 shutdown_connections 2024-09-12T02:43:59.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.570+0000 7ffbaea00640 1 --2- 172.21.15.112:0/3455624411 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ffb8406be30 0x7ffb8406e2f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:59.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.570+0000 7ffbaea00640 1 --2- 172.21.15.112:0/3455624411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffba815b9d0 0x7ffba8154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:59.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.570+0000 7ffbaea00640 1 --2- 172.21.15.112:0/3455624411 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffba80b45d0 0x7ffba81f5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:59.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.570+0000 7ffbaea00640 1 --2- 172.21.15.112:0/3455624411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffba806eef0 0x7ffba8153690 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:59.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.570+0000 7ffbaea00640 1 -- 172.21.15.112:0/3455624411 >> 172.21.15.112:0/3455624411 conn(0x7ffba806bbd0 msgr2=0x7ffba80af940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:59.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.570+0000 7ffbaea00640 1 -- 172.21.15.112:0/3455624411 shutdown_connections 2024-09-12T02:43:59.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.570+0000 7ffbaea00640 1 -- 172.21.15.112:0/3455624411 wait complete. 2024-09-12T02:43:59.588 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2024-09-12T02:43:59.588 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestClusterFull) 2024-09-12T02:43:59.589 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:43:59.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.740+0000 7f0f30600640 1 Processor -- start 2024-09-12T02:43:59.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.741+0000 7f0f30600640 1 -- start start 2024-09-12T02:43:59.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.742+0000 7f0f30600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0f28144120 0x7f0f2806df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:59.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.742+0000 7f0f30600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f2815f7b0 con 0x7f0f2806f620 2024-09-12T02:43:59.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.742+0000 7f0f30600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f2806e540 con 0x7f0f280b4aa0 2024-09-12T02:43:59.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.742+0000 7f0f30600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0f2806e820 con 0x7f0f28144120 2024-09-12T02:43:59.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.742+0000 7f0f2dc00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f0f2806f620 0x7f0f2815e990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38778/0 (socket says 172.21.15.112:38778) 2024-09-12T02:43:59.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.742+0000 7f0f2dc00640 1 -- 172.21.15.112:0/2294527853 learned_addr learned my addr 172.21.15.112:0/2294527853 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:43:59.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.742+0000 7f0f2e600640 1 --2- 172.21.15.112:0/2294527853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0f28144120 0x7f0f2806df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:59.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.742+0000 7f0f27e00640 1 -- 172.21.15.112:0/2294527853 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1052849191 0 0) 0x7f0f2815f7b0 con 0x7f0f2806f620 2024-09-12T02:43:59.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.742+0000 7f0f27e00640 1 -- 172.21.15.112:0/2294527853 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f10003520 con 0x7f0f2806f620 2024-09-12T02:43:59.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.743+0000 7f0f27e00640 1 -- 172.21.15.112:0/2294527853 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3570573306 0 0) 0x7f0f10003520 con 0x7f0f2806f620 2024-09-12T02:43:59.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.743+0000 7f0f27e00640 1 -- 172.21.15.112:0/2294527853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0f28144120 msgr2=0x7f0f2806df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:59.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.743+0000 7f0f27e00640 1 --2- 172.21.15.112:0/2294527853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0f28144120 0x7f0f2806df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:59.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.743+0000 7f0f27e00640 1 -- 172.21.15.112:0/2294527853 >> v1:172.21.15.137:6789/0 conn(0x7f0f280b4aa0 legacy=0x7f0f2815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:59.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.743+0000 7f0f27e00640 1 -- 172.21.15.112:0/2294527853 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f2806eb00 con 0x7f0f2806f620 2024-09-12T02:43:59.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.743+0000 7f0f27e00640 1 -- 172.21.15.112:0/2294527853 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f0f1c001670 con 0x7f0f2806f620 2024-09-12T02:43:59.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.743+0000 7f0f27e00640 1 -- 172.21.15.112:0/2294527853 >> v1:172.21.15.112:6789/0 conn(0x7f0f2806f620 legacy=0x7f0f2815e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:59.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.743+0000 7f0f27e00640 1 --2- 172.21.15.112:0/2294527853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f100039e0 0x7f0f10003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:59.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.743+0000 7f0f27e00640 1 --2- 172.21.15.112:0/2294527853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f10004390 0x7f0f10004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:59.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.743+0000 7f0f27e00640 1 --2- 172.21.15.112:0/2294527853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0f28144120 0x7f0f100050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:59.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.743+0000 7f0f27e00640 1 -- 172.21.15.112:0/2294527853 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2806e820 con 0x7f0f100039e0 2024-09-12T02:43:59.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.743+0000 7f0f27e00640 1 -- 172.21.15.112:0/2294527853 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1000b9c0 con 0x7f0f10004390 2024-09-12T02:43:59.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.743+0000 7f0f27e00640 1 -- 172.21.15.112:0/2294527853 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0f1000bbc0 con 0x7f0f28144120 2024-09-12T02:43:59.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.743+0000 7f0f2dc00640 1 --2- 172.21.15.112:0/2294527853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f100039e0 0x7f0f10003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:59.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.743+0000 7f0f2d200640 1 --2- 172.21.15.112:0/2294527853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f10004390 0x7f0f10004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:59.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.743+0000 7f0f2e600640 1 --2- 172.21.15.112:0/2294527853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0f28144120 0x7f0f100050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:59.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.744+0000 7f0f2dc00640 1 -- 172.21.15.112:0/2294527853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0f28144120 msgr2=0x7f0f100050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:59.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.744+0000 7f0f2dc00640 1 --2- 172.21.15.112:0/2294527853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0f28144120 0x7f0f100050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:59.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.744+0000 7f0f2dc00640 1 -- 172.21.15.112:0/2294527853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f10004390 msgr2=0x7f0f10004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:43:59.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.744+0000 7f0f2dc00640 1 --2- 172.21.15.112:0/2294527853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f10004390 0x7f0f10004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:59.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.744+0000 7f0f2dc00640 1 -- 172.21.15.112:0/2294527853 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f10003520 con 0x7f0f100039e0 2024-09-12T02:43:59.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.744+0000 7f0f2d200640 1 --2- 172.21.15.112:0/2294527853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f10004390 0x7f0f10004860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:43:59.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.745+0000 7f0f2dc00640 1 --2- 172.21.15.112:0/2294527853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f100039e0 0x7f0f10003dc0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c00c240 tx=0x7f0f10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29effdb76e34ebdc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:59.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.745+0000 7f0f27e00640 1 -- 172.21.15.112:0/2294527853 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c02e070 con 0x7f0f100039e0 2024-09-12T02:43:59.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.745+0000 7f0f27e00640 1 -- 172.21.15.112:0/2294527853 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f1c005af0 con 0x7f0f100039e0 2024-09-12T02:43:59.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.745+0000 7f0f27e00640 1 -- 172.21.15.112:0/2294527853 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c007d30 con 0x7f0f100039e0 2024-09-12T02:43:59.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.745+0000 7f0f30600640 1 -- 172.21.15.112:0/2294527853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f100039e0 msgr2=0x7f0f10003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:59.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.745+0000 7f0f30600640 1 --2- 172.21.15.112:0/2294527853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f100039e0 0x7f0f10003dc0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c00c240 tx=0x7f0f10005830 comp rx=0 tx=0).stop 2024-09-12T02:43:59.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.745+0000 7f0f2e600640 1 -- 172.21.15.112:0/2294527853 reap_dead start 2024-09-12T02:43:59.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.746+0000 7f0f30600640 1 -- 172.21.15.112:0/2294527853 shutdown_connections 2024-09-12T02:43:59.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.746+0000 7f0f30600640 1 -- 172.21.15.112:0/2294527853 >> 172.21.15.112:0/2294527853 conn(0x7f0f2806bbd0 msgr2=0x7f0f2806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:59.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.746+0000 7f0f30600640 1 -- 172.21.15.112:0/2294527853 shutdown_connections 2024-09-12T02:43:59.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.746+0000 7f0f30600640 1 -- 172.21.15.112:0/2294527853 wait complete. 2024-09-12T02:43:59.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.747+0000 7f0f30600640 1 Processor -- start 2024-09-12T02:43:59.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.747+0000 7f0f30600640 1 -- start start 2024-09-12T02:43:59.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.748+0000 7f0f30600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f100039e0 0x7f0f2815b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:59.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.748+0000 7f0f30600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f28135b10 0x7f0f28135f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:59.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.748+0000 7f0f30600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0f280ae8d0 0x7f0f280aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:59.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.748+0000 7f0f30600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0f28144870 con 0x7f0f28135b10 2024-09-12T02:43:59.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.748+0000 7f0f30600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2806f0c0 con 0x7f0f100039e0 2024-09-12T02:43:59.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.748+0000 7f0f30600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0f2806df60 con 0x7f0f280ae8d0 2024-09-12T02:43:59.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.749+0000 7f0f2d200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f28135b10 0x7f0f28135f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:59.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.749+0000 7f0f2d200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f28135b10 0x7f0f28135f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38238/0 (socket says 172.21.15.112:38238) 2024-09-12T02:43:59.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.749+0000 7f0f2d200640 1 -- 172.21.15.112:0/2400695401 learned_addr learned my addr 172.21.15.112:0/2400695401 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:43:59.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.749+0000 7f0f2e600640 1 --2- 172.21.15.112:0/2400695401 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0f280ae8d0 0x7f0f280aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:59.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.749+0000 7f0f2dc00640 1 --2- 172.21.15.112:0/2400695401 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f100039e0 0x7f0f2815b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:59.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.749+0000 7f0f2d200640 1 -- 172.21.15.112:0/2400695401 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0f280ae8d0 msgr2=0x7f0f280aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:59.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.749+0000 7f0f2d200640 1 --2- 172.21.15.112:0/2400695401 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0f280ae8d0 0x7f0f280aed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:59.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.749+0000 7f0f2d200640 1 -- 172.21.15.112:0/2400695401 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f100039e0 msgr2=0x7f0f2815b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:59.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.749+0000 7f0f2d200640 1 --2- 172.21.15.112:0/2400695401 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f100039e0 0x7f0f2815b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:59.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.749+0000 7f0f2d200640 1 -- 172.21.15.112:0/2400695401 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f28139f50 con 0x7f0f28135b10 2024-09-12T02:43:59.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.749+0000 7f0f2e600640 1 --2- 172.21.15.112:0/2400695401 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0f280ae8d0 0x7f0f280aed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:43:59.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.749+0000 7f0f2d200640 1 --2- 172.21.15.112:0/2400695401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f28135b10 0x7f0f28135f70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0f1400e600 tx=0x7f0f1400eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:59.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.750+0000 7f0f25600640 1 -- 172.21.15.112:0/2400695401 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f140052e0 con 0x7f0f28135b10 2024-09-12T02:43:59.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.750+0000 7f0f25600640 1 -- 172.21.15.112:0/2400695401 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f14018070 con 0x7f0f28135b10 2024-09-12T02:43:59.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.750+0000 7f0f30600640 1 -- 172.21.15.112:0/2400695401 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f2813a230 con 0x7f0f28135b10 2024-09-12T02:43:59.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.750+0000 7f0f25600640 1 -- 172.21.15.112:0/2400695401 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f14003640 con 0x7f0f28135b10 2024-09-12T02:43:59.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.750+0000 7f0f30600640 1 -- 172.21.15.112:0/2400695401 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f2813a7f0 con 0x7f0f28135b10 2024-09-12T02:43:59.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.751+0000 7f0f30600640 1 -- 172.21.15.112:0/2400695401 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f28068a30 con 0x7f0f28135b10 2024-09-12T02:43:59.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.752+0000 7f0f25600640 1 -- 172.21.15.112:0/2400695401 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0f140037e0 con 0x7f0f28135b10 2024-09-12T02:43:59.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.752+0000 7f0f25600640 1 --2- 172.21.15.112:0/2400695401 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0f0806be60 0x7f0f0806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:59.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.753+0000 7f0f25600640 1 -- 172.21.15.112:0/2400695401 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 4943+0+0 (secure 0 0 0) 0x7f0f1408a520 con 0x7f0f28135b10 2024-09-12T02:43:59.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.753+0000 7f0f2dc00640 1 --2- 172.21.15.112:0/2400695401 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0f0806be60 0x7f0f0806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:59.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.753+0000 7f0f2dc00640 1 --2- 172.21.15.112:0/2400695401 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0f0806be60 0x7f0f0806e320 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c00c240 tx=0x7f0f1c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:59.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.757+0000 7f0f25600640 1 -- 172.21.15.112:0/2400695401 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0f14059140 con 0x7f0f28135b10 2024-09-12T02:43:59.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.935+0000 7f0f30600640 1 -- 172.21.15.112:0/2400695401 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f281329a0 con 0x7f0f28135b10 2024-09-12T02:43:59.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.936+0000 7f0f25600640 1 -- 172.21.15.112:0/2400695401 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+13082 (secure 0 0 0) 0x7f0f281329a0 con 0x7f0f28135b10 2024-09-12T02:43:59.937 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:43:59.937 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":56,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:43:58.557592+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6835/3597512060":"2024-09-13T02:43:55.543385+0000","172.21.15.137:6833/3597512060":"2024-09-13T02:43:55.543385+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:43:59.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.938+0000 7f0f30600640 1 -- 172.21.15.112:0/2400695401 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0f0806be60 msgr2=0x7f0f0806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:59.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.938+0000 7f0f30600640 1 --2- 172.21.15.112:0/2400695401 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0f0806be60 0x7f0f0806e320 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c00c240 tx=0x7f0f1c02e000 comp rx=0 tx=0).stop 2024-09-12T02:43:59.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.938+0000 7f0f30600640 1 -- 172.21.15.112:0/2400695401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f28135b10 msgr2=0x7f0f28135f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:59.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.938+0000 7f0f30600640 1 --2- 172.21.15.112:0/2400695401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f28135b10 0x7f0f28135f70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0f1400e600 tx=0x7f0f1400eac0 comp rx=0 tx=0).stop 2024-09-12T02:43:59.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.938+0000 7f0f30600640 1 -- 172.21.15.112:0/2400695401 shutdown_connections 2024-09-12T02:43:59.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.938+0000 7f0f30600640 1 --2- 172.21.15.112:0/2400695401 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0f280ae8d0 0x7f0f280aed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:59.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.938+0000 7f0f30600640 1 --2- 172.21.15.112:0/2400695401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f28135b10 0x7f0f28135f70 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:59.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.938+0000 7f0f30600640 1 --2- 172.21.15.112:0/2400695401 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0f0806be60 0x7f0f0806e320 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:59.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.938+0000 7f0f30600640 1 --2- 172.21.15.112:0/2400695401 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f100039e0 0x7f0f2815b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:59.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.938+0000 7f0f30600640 1 -- 172.21.15.112:0/2400695401 >> 172.21.15.112:0/2400695401 conn(0x7f0f2806bbd0 msgr2=0x7f0f28138cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:59.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.938+0000 7f0f30600640 1 -- 172.21.15.112:0/2400695401 shutdown_connections 2024-09-12T02:43:59.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:43:59.938+0000 7f0f30600640 1 -- 172.21.15.112:0/2400695401 wait complete. 2024-09-12T02:43:59.955 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:41:43.011599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:43:59.956 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T02:44:00.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.110+0000 7f05fc800640 1 Processor -- start 2024-09-12T02:44:00.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.110+0000 7f05fc800640 1 -- start start 2024-09-12T02:44:00.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.111+0000 7f05fc800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f05f40afe30 0x7f05f40cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:00.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.111+0000 7f05fc800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f40ceeb0 con 0x7f05f4071530 2024-09-12T02:44:00.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.112+0000 7f05fc800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f406e300 con 0x7f05f415cc50 2024-09-12T02:44:00.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.112+0000 7f05fc800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f05f415d030 con 0x7f05f40afe30 2024-09-12T02:44:00.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.112+0000 7f05f9400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f05f4071530 0x7f05f40af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38794/0 (socket says 172.21.15.112:38794) 2024-09-12T02:44:00.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.112+0000 7f05f9400640 1 -- 172.21.15.112:0/588405481 learned_addr learned my addr 172.21.15.112:0/588405481 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:44:00.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.112+0000 7f05fa800640 1 --2- 172.21.15.112:0/588405481 >> v2:172.21.15.137:3300/0 conn(0x7f05f40afe30 0x7f05f40cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:00.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.112+0000 7f05f8a00640 1 -- 172.21.15.112:0/588405481 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3366534387 0 0) 0x7f05f40ceeb0 con 0x7f05f4071530 2024-09-12T02:44:00.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.112+0000 7f05f8a00640 1 -- 172.21.15.112:0/588405481 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05dc003520 con 0x7f05f4071530 2024-09-12T02:44:00.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.112+0000 7f05f8a00640 1 -- 172.21.15.112:0/588405481 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3925664978 0 0) 0x7f05dc003520 con 0x7f05f4071530 2024-09-12T02:44:00.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.112+0000 7f05f8a00640 1 -- 172.21.15.112:0/588405481 >> v2:172.21.15.137:3300/0 conn(0x7f05f40afe30 msgr2=0x7f05f40cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:00.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.112+0000 7f05f8a00640 1 --2- 172.21.15.112:0/588405481 >> v2:172.21.15.137:3300/0 conn(0x7f05f40afe30 0x7f05f40cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:00.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.112+0000 7f05f8a00640 1 -- 172.21.15.112:0/588405481 >> v1:172.21.15.137:6789/0 conn(0x7f05f415cc50 legacy=0x7f05f40732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:00.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.112+0000 7f05f8a00640 1 -- 172.21.15.112:0/588405481 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f406e5e0 con 0x7f05f4071530 2024-09-12T02:44:00.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.112+0000 7f05f8a00640 1 -- 172.21.15.112:0/588405481 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f05e40017f0 con 0x7f05f4071530 2024-09-12T02:44:00.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.113+0000 7f05f8a00640 1 -- 172.21.15.112:0/588405481 >> v1:172.21.15.112:6789/0 conn(0x7f05f4071530 legacy=0x7f05f40af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:00.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.113+0000 7f05f8a00640 1 --2- 172.21.15.112:0/588405481 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05dc003a00 0x7f05dc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:00.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.113+0000 7f05f8a00640 1 --2- 172.21.15.112:0/588405481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05dc004800 0x7f05dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:00.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.113+0000 7f05f8a00640 1 --2- 172.21.15.112:0/588405481 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05dc005210 0x7f05dc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:00.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.113+0000 7f05f8a00640 1 -- 172.21.15.112:0/588405481 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f05dc00c130 con 0x7f05dc004800 2024-09-12T02:44:00.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.113+0000 7f05f8a00640 1 -- 172.21.15.112:0/588405481 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f05dc00c2e0 con 0x7f05dc003a00 2024-09-12T02:44:00.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.113+0000 7f05f8a00640 1 -- 172.21.15.112:0/588405481 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f05dc00c4e0 con 0x7f05dc005210 2024-09-12T02:44:00.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.113+0000 7f05f9e00640 1 --2- 172.21.15.112:0/588405481 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05dc003a00 0x7f05dc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:00.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.113+0000 7f05f9400640 1 --2- 172.21.15.112:0/588405481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05dc004800 0x7f05dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:00.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.113+0000 7f05fa800640 1 --2- 172.21.15.112:0/588405481 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05dc005210 0x7f05dc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:00.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.113+0000 7f05f9e00640 1 -- 172.21.15.112:0/588405481 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05dc005210 msgr2=0x7f05dc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:00.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.113+0000 7f05f9e00640 1 --2- 172.21.15.112:0/588405481 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05dc005210 0x7f05dc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:00.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.113+0000 7f05f9e00640 1 -- 172.21.15.112:0/588405481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05dc004800 msgr2=0x7f05dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:00.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.113+0000 7f05f9e00640 1 --2- 172.21.15.112:0/588405481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05dc004800 0x7f05dc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:00.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.113+0000 7f05f9e00640 1 -- 172.21.15.112:0/588405481 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05dc003520 con 0x7f05dc003a00 2024-09-12T02:44:00.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.113+0000 7f05f9400640 1 --2- 172.21.15.112:0/588405481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05dc004800 0x7f05dc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:44:00.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.114+0000 7f05fa800640 1 -- 172.21.15.112:0/588405481 reap_dead start 2024-09-12T02:44:00.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.115+0000 7f05f9e00640 1 --2- 172.21.15.112:0/588405481 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05dc003a00 0x7f05dc003e20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f05e8001720 tx=0x7f05dc005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71a8957a1f3c2bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:00.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.115+0000 7f05f8a00640 1 -- 172.21.15.112:0/588405481 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e8001370 con 0x7f05dc003a00 2024-09-12T02:44:00.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.115+0000 7f05f8a00640 1 -- 172.21.15.112:0/588405481 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e80052d0 con 0x7f05dc003a00 2024-09-12T02:44:00.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.115+0000 7f05f8a00640 1 -- 172.21.15.112:0/588405481 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e802abc0 con 0x7f05dc003a00 2024-09-12T02:44:00.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.115+0000 7f05fc800640 1 -- 172.21.15.112:0/588405481 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05dc003a00 msgr2=0x7f05dc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:00.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.115+0000 7f05fc800640 1 --2- 172.21.15.112:0/588405481 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05dc003a00 0x7f05dc003e20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f05e8001720 tx=0x7f05dc005830 comp rx=0 tx=0).stop 2024-09-12T02:44:00.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.115+0000 7f05fc800640 1 -- 172.21.15.112:0/588405481 shutdown_connections 2024-09-12T02:44:00.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.115+0000 7f05fc800640 1 --2- 172.21.15.112:0/588405481 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05dc003a00 0x7f05dc003e20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:00.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.115+0000 7f05fc800640 1 -- 172.21.15.112:0/588405481 >> 172.21.15.112:0/588405481 conn(0x7f05f406bbd0 msgr2=0x7f05f406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:00.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.115+0000 7f05fc800640 1 -- 172.21.15.112:0/588405481 shutdown_connections 2024-09-12T02:44:00.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.116+0000 7f05fc800640 1 -- 172.21.15.112:0/588405481 wait complete. 2024-09-12T02:44:00.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.117+0000 7f05fc800640 1 Processor -- start 2024-09-12T02:44:00.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.117+0000 7f05fc800640 1 -- start start 2024-09-12T02:44:00.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.118+0000 7f05fc800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05dc003a00 0x7f05f41f2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:00.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.118+0000 7f05fc800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05f413bba0 0x7f05f4154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:00.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.118+0000 7f05fc800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05f413c000 0x7f05f4155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:00.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.118+0000 7f05fc800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f05f406f510 con 0x7f05f413bba0 2024-09-12T02:44:00.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.118+0000 7f05fc800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f05f40cf4c0 con 0x7f05f413c000 2024-09-12T02:44:00.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.118+0000 7f05fc800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f05f406f690 con 0x7f05dc003a00 2024-09-12T02:44:00.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.118+0000 7f05f9400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05f413bba0 0x7f05f4154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:00.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.118+0000 7f05f9400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05f413bba0 0x7f05f4154be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38246/0 (socket says 172.21.15.112:38246) 2024-09-12T02:44:00.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.118+0000 7f05f9400640 1 -- 172.21.15.112:0/3309525405 learned_addr learned my addr 172.21.15.112:0/3309525405 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:00.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.119+0000 7f05fa800640 1 --2- 172.21.15.112:0/3309525405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05f413c000 0x7f05f4155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:00.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.119+0000 7f05f9e00640 1 --2- 172.21.15.112:0/3309525405 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05dc003a00 0x7f05f41f2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:00.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.119+0000 7f05f9400640 1 -- 172.21.15.112:0/3309525405 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05dc003a00 msgr2=0x7f05f41f2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:00.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.119+0000 7f05f9400640 1 --2- 172.21.15.112:0/3309525405 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05dc003a00 0x7f05f41f2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:00.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.119+0000 7f05f9400640 1 -- 172.21.15.112:0/3309525405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05f413c000 msgr2=0x7f05f4155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:00.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.119+0000 7f05f9400640 1 --2- 172.21.15.112:0/3309525405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05f413c000 0x7f05f4155120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:00.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.119+0000 7f05f9400640 1 -- 172.21.15.112:0/3309525405 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f4153b40 con 0x7f05f413bba0 2024-09-12T02:44:00.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.119+0000 7f05fa800640 1 --2- 172.21.15.112:0/3309525405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05f413c000 0x7f05f4155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:44:00.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.119+0000 7f05f9400640 1 --2- 172.21.15.112:0/3309525405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05f413bba0 0x7f05f4154be0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f05e4000c00 tx=0x7f05e400fdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:00.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.119+0000 7f05ee000640 1 -- 172.21.15.112:0/3309525405 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e4007c20 con 0x7f05f413bba0 2024-09-12T02:44:00.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.119+0000 7f05ee000640 1 -- 172.21.15.112:0/3309525405 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e4018070 con 0x7f05f413bba0 2024-09-12T02:44:00.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.119+0000 7f05ee000640 1 -- 172.21.15.112:0/3309525405 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e4007520 con 0x7f05f413bba0 2024-09-12T02:44:00.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.119+0000 7f05fc800640 1 -- 172.21.15.112:0/3309525405 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05f4153e20 con 0x7f05f413bba0 2024-09-12T02:44:00.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.120+0000 7f05fc800640 1 -- 172.21.15.112:0/3309525405 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05f41543e0 con 0x7f05f413bba0 2024-09-12T02:44:00.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.120+0000 7f05fc800640 1 -- 172.21.15.112:0/3309525405 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05f4068a30 con 0x7f05f413bba0 2024-09-12T02:44:00.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.122+0000 7f05ee000640 1 -- 172.21.15.112:0/3309525405 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f05e40057a0 con 0x7f05f413bba0 2024-09-12T02:44:00.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.122+0000 7f05ee000640 1 --2- 172.21.15.112:0/3309525405 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f05d806be60 0x7f05d806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:00.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.122+0000 7f05ee000640 1 -- 172.21.15.112:0/3309525405 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 4943+0+0 (secure 0 0 0) 0x7f05e408ab90 con 0x7f05f413bba0 2024-09-12T02:44:00.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.123+0000 7f05f9e00640 1 --2- 172.21.15.112:0/3309525405 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f05d806be60 0x7f05d806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:00.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.123+0000 7f05f9e00640 1 --2- 172.21.15.112:0/3309525405 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f05d806be60 0x7f05d806e320 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f05e8032000 tx=0x7f05e802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:00.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.127+0000 7f05ee000640 1 -- 172.21.15.112:0/3309525405 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f05e4059710 con 0x7f05f413bba0 2024-09-12T02:44:00.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.299+0000 7f05fc800640 1 -- 172.21.15.112:0/3309525405 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f05f40b13a0 con 0x7f05f413bba0 2024-09-12T02:44:00.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.299+0000 7f05ee000640 1 -- 172.21.15.112:0/3309525405 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) ==== 93+0+10 (secure 0 0 0) 0x7f05e4059010 con 0x7f05f413bba0 2024-09-12T02:44:00.300 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2024-09-12T02:44:00.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.301+0000 7f05fc800640 1 -- 172.21.15.112:0/3309525405 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f05d806be60 msgr2=0x7f05d806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:00.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.301+0000 7f05fc800640 1 --2- 172.21.15.112:0/3309525405 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f05d806be60 0x7f05d806e320 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f05e8032000 tx=0x7f05e802e000 comp rx=0 tx=0).stop 2024-09-12T02:44:00.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.301+0000 7f05fc800640 1 -- 172.21.15.112:0/3309525405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05f413bba0 msgr2=0x7f05f4154be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:00.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.301+0000 7f05fc800640 1 --2- 172.21.15.112:0/3309525405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05f413bba0 0x7f05f4154be0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f05e4000c00 tx=0x7f05e400fdc0 comp rx=0 tx=0).stop 2024-09-12T02:44:00.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.301+0000 7f05fc800640 1 -- 172.21.15.112:0/3309525405 shutdown_connections 2024-09-12T02:44:00.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.301+0000 7f05fc800640 1 --2- 172.21.15.112:0/3309525405 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f05d806be60 0x7f05d806e320 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:00.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.301+0000 7f05fc800640 1 --2- 172.21.15.112:0/3309525405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05f413c000 0x7f05f4155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:00.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.301+0000 7f05fc800640 1 --2- 172.21.15.112:0/3309525405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05f413bba0 0x7f05f4154be0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:00.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.301+0000 7f05fc800640 1 --2- 172.21.15.112:0/3309525405 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05dc003a00 0x7f05f41f2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:00.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.301+0000 7f05fc800640 1 -- 172.21.15.112:0/3309525405 >> 172.21.15.112:0/3309525405 conn(0x7f05f406bbd0 msgr2=0x7f05f4158ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:00.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.302+0000 7f05fc800640 1 -- 172.21.15.112:0/3309525405 shutdown_connections 2024-09-12T02:44:00.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.302+0000 7f05fc800640 1 -- 172.21.15.112:0/3309525405 wait complete. 2024-09-12T02:44:00.318 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2024-09-12T02:44:00.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.469+0000 7f59d6e00640 1 Processor -- start 2024-09-12T02:44:00.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.469+0000 7f59d6e00640 1 -- start start 2024-09-12T02:44:00.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.470+0000 7f59d6e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f59d00d28d0 0x7f59d00b2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:00.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.470+0000 7f59d6e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59d00d2fb0 con 0x7f59d00b3e00 2024-09-12T02:44:00.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.470+0000 7f59d6e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59d00d0b60 con 0x7f59d00d1710 2024-09-12T02:44:00.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.470+0000 7f59d6e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f59d00d3cb0 con 0x7f59d00d28d0 2024-09-12T02:44:00.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.470+0000 7f59d5000640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f59d00b3e00 0x7f59d00b1d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38802/0 (socket says 172.21.15.112:38802) 2024-09-12T02:44:00.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.470+0000 7f59d5000640 1 -- 172.21.15.112:0/520563524 learned_addr learned my addr 172.21.15.112:0/520563524 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:44:00.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.471+0000 7f59d6400640 1 --2- 172.21.15.112:0/520563524 >> v2:172.21.15.137:3300/0 conn(0x7f59d00d28d0 0x7f59d00b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:00.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.471+0000 7f59cfe00640 1 -- 172.21.15.112:0/520563524 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2848065335 0 0) 0x7f59d00d2fb0 con 0x7f59d00b3e00 2024-09-12T02:44:00.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.471+0000 7f59cfe00640 1 -- 172.21.15.112:0/520563524 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59b8003520 con 0x7f59d00b3e00 2024-09-12T02:44:00.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.471+0000 7f59cfe00640 1 -- 172.21.15.112:0/520563524 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2245632971 0 0) 0x7f59b8003520 con 0x7f59d00b3e00 2024-09-12T02:44:00.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.471+0000 7f59d6400640 1 -- 172.21.15.112:0/520563524 >> v1:172.21.15.137:6789/0 conn(0x7f59d00d1710 legacy=0x7f59d00d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:00.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.471+0000 7f59d6400640 1 -- 172.21.15.112:0/520563524 >> v1:172.21.15.112:6789/0 conn(0x7f59d00b3e00 legacy=0x7f59d00b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:00.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.471+0000 7f59d6400640 1 -- 172.21.15.112:0/520563524 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d00d3410 con 0x7f59d00d28d0 2024-09-12T02:44:00.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.472+0000 7f59d6400640 1 --2- 172.21.15.112:0/520563524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59d00d28d0 0x7f59d00b2480 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f59c8009d90 tx=0x7f59c802a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0f1847ddc9fdb2d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:00.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.472+0000 7f59cfe00640 1 -- 172.21.15.112:0/520563524 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc001670 con 0x7f59d00d28d0 2024-09-12T02:44:00.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.473+0000 7f59cfe00640 1 -- 172.21.15.112:0/520563524 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59c8007540 con 0x7f59d00d28d0 2024-09-12T02:44:00.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.473+0000 7f59cfe00640 1 -- 172.21.15.112:0/520563524 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c8007910 con 0x7f59d00d28d0 2024-09-12T02:44:00.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.473+0000 7f59d6e00640 1 -- 172.21.15.112:0/520563524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59d00d28d0 msgr2=0x7f59d00b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:00.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.473+0000 7f59d6e00640 1 --2- 172.21.15.112:0/520563524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59d00d28d0 0x7f59d00b2480 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f59c8009d90 tx=0x7f59c802a680 comp rx=0 tx=0).stop 2024-09-12T02:44:00.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.473+0000 7f59d6e00640 1 -- 172.21.15.112:0/520563524 shutdown_connections 2024-09-12T02:44:00.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.473+0000 7f59d6e00640 1 --2- 172.21.15.112:0/520563524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59d00d28d0 0x7f59d00b2480 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:00.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.473+0000 7f59d6e00640 1 -- 172.21.15.112:0/520563524 >> 172.21.15.112:0/520563524 conn(0x7f59d009e030 msgr2=0x7f59d00d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:00.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.473+0000 7f59d6e00640 1 -- 172.21.15.112:0/520563524 shutdown_connections 2024-09-12T02:44:00.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.473+0000 7f59d6e00640 1 -- 172.21.15.112:0/520563524 wait complete. 2024-09-12T02:44:00.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.475+0000 7f59d6e00640 1 Processor -- start 2024-09-12T02:44:00.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.475+0000 7f59d6e00640 1 -- start start 2024-09-12T02:44:00.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.476+0000 7f59d6e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59d00b3e00 0x7f59d00b97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:00.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.476+0000 7f59d6e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59d00d1710 0x7f59d00b9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:00.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.476+0000 7f59d6e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f59d00d28d0 0x7f59d00cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:00.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.476+0000 7f59d6e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f59d00d39d0 con 0x7f59d00d1710 2024-09-12T02:44:00.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.476+0000 7f59d6e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f59d00d2d60 con 0x7f59d00b3e00 2024-09-12T02:44:00.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.476+0000 7f59d6e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f59d015f110 con 0x7f59d00d28d0 2024-09-12T02:44:00.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.476+0000 7f59d5000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59d00d1710 0x7f59d00b9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:00.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.476+0000 7f59d5000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59d00d1710 0x7f59d00b9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38252/0 (socket says 172.21.15.112:38252) 2024-09-12T02:44:00.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.476+0000 7f59d5000640 1 -- 172.21.15.112:0/2068764131 learned_addr learned my addr 172.21.15.112:0/2068764131 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:00.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.476+0000 7f59d5a00640 1 --2- 172.21.15.112:0/2068764131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59d00b3e00 0x7f59d00b97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:00.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.477+0000 7f59d6400640 1 --2- 172.21.15.112:0/2068764131 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f59d00d28d0 0x7f59d00cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:00.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.477+0000 7f59d5000640 1 -- 172.21.15.112:0/2068764131 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f59d00d28d0 msgr2=0x7f59d00cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:00.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.477+0000 7f59d5000640 1 --2- 172.21.15.112:0/2068764131 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f59d00d28d0 0x7f59d00cccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:00.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.477+0000 7f59d5000640 1 -- 172.21.15.112:0/2068764131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59d00b3e00 msgr2=0x7f59d00b97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:00.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.477+0000 7f59d5000640 1 --2- 172.21.15.112:0/2068764131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59d00b3e00 0x7f59d00b97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:00.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.477+0000 7f59d5000640 1 -- 172.21.15.112:0/2068764131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d00cd8d0 con 0x7f59d00d1710 2024-09-12T02:44:00.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.477+0000 7f59d6400640 1 --2- 172.21.15.112:0/2068764131 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f59d00d28d0 0x7f59d00cccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:44:00.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.477+0000 7f59d5a00640 1 --2- 172.21.15.112:0/2068764131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59d00b3e00 0x7f59d00b97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:44:00.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.477+0000 7f59d5000640 1 --2- 172.21.15.112:0/2068764131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59d00d1710 0x7f59d00b9d00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00c750 tx=0x7f59bc00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:00.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.477+0000 7f59cd600640 1 -- 172.21.15.112:0/2068764131 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc017070 con 0x7f59d00d1710 2024-09-12T02:44:00.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.477+0000 7f59cd600640 1 -- 172.21.15.112:0/2068764131 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59bc005ad0 con 0x7f59d00d1710 2024-09-12T02:44:00.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.477+0000 7f59cd600640 1 -- 172.21.15.112:0/2068764131 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc007070 con 0x7f59d00d1710 2024-09-12T02:44:00.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.477+0000 7f59d6e00640 1 -- 172.21.15.112:0/2068764131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59d0160350 con 0x7f59d00d1710 2024-09-12T02:44:00.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.477+0000 7f59d6e00640 1 -- 172.21.15.112:0/2068764131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59d015f870 con 0x7f59d00d1710 2024-09-12T02:44:00.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.478+0000 7f59d6e00640 1 -- 172.21.15.112:0/2068764131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59d00d1af0 con 0x7f59d00d1710 2024-09-12T02:44:00.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.479+0000 7f59cd600640 1 -- 172.21.15.112:0/2068764131 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f59bc01a070 con 0x7f59d00d1710 2024-09-12T02:44:00.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.480+0000 7f59cd600640 1 --2- 172.21.15.112:0/2068764131 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f59b006be30 0x7f59b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:00.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.480+0000 7f59cd600640 1 -- 172.21.15.112:0/2068764131 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 4943+0+0 (secure 0 0 0) 0x7f59bc08a170 con 0x7f59d00d1710 2024-09-12T02:44:00.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.480+0000 7f59d5a00640 1 --2- 172.21.15.112:0/2068764131 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f59b006be30 0x7f59b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:00.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.481+0000 7f59d5a00640 1 --2- 172.21.15.112:0/2068764131 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f59b006be30 0x7f59b006e2f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f59c4000f60 tx=0x7f59c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:00.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.485+0000 7f59cd600640 1 -- 172.21.15.112:0/2068764131 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f59bc058d80 con 0x7f59d00d1710 2024-09-12T02:44:00.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:00.725+0000 7f59d6e00640 1 -- 172.21.15.112:0/2068764131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) -- 0x7f59d006cce0 con 0x7f59d00d1710 2024-09-12T02:44:01.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.577+0000 7f59cd600640 1 -- 172.21.15.112:0/2068764131 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v133) ==== 137+0+0 (secure 0 0 0) 0x7f59bc058680 con 0x7f59d00d1710 2024-09-12T02:44:01.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.579+0000 7f59d6e00640 1 -- 172.21.15.112:0/2068764131 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f59b006be30 msgr2=0x7f59b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:01.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.579+0000 7f59d6e00640 1 --2- 172.21.15.112:0/2068764131 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f59b006be30 0x7f59b006e2f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f59c4000f60 tx=0x7f59c4009040 comp rx=0 tx=0).stop 2024-09-12T02:44:01.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.579+0000 7f59d6e00640 1 -- 172.21.15.112:0/2068764131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59d00d1710 msgr2=0x7f59d00b9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:01.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.579+0000 7f59d6e00640 1 --2- 172.21.15.112:0/2068764131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59d00d1710 0x7f59d00b9d00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00c750 tx=0x7f59bc00cc10 comp rx=0 tx=0).stop 2024-09-12T02:44:01.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.580+0000 7f59d6e00640 1 -- 172.21.15.112:0/2068764131 shutdown_connections 2024-09-12T02:44:01.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.580+0000 7f59d6e00640 1 --2- 172.21.15.112:0/2068764131 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f59d00d28d0 0x7f59d00cccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:01.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.580+0000 7f59d6e00640 1 --2- 172.21.15.112:0/2068764131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59d00d1710 0x7f59d00b9d00 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:01.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.580+0000 7f59d6e00640 1 --2- 172.21.15.112:0/2068764131 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f59b006be30 0x7f59b006e2f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:01.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.580+0000 7f59d6e00640 1 --2- 172.21.15.112:0/2068764131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59d00b3e00 0x7f59d00b97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:01.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.580+0000 7f59d6e00640 1 -- 172.21.15.112:0/2068764131 >> 172.21.15.112:0/2068764131 conn(0x7f59d009e030 msgr2=0x7f59d00b8010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:01.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.580+0000 7f59d6e00640 1 -- 172.21.15.112:0/2068764131 shutdown_connections 2024-09-12T02:44:01.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.580+0000 7f59d6e00640 1 -- 172.21.15.112:0/2068764131 wait complete. 2024-09-12T02:44:01.599 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2024-09-12T02:44:01.768 INFO:teuthology.orchestra.run.smithi112.stdout:{"osd_objectstore":"memstore"} 2024-09-12T02:44:01.768 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2024-09-12T02:44:01.769 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T02:44:01.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.927+0000 7f96f8a00640 1 Processor -- start 2024-09-12T02:44:01.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.927+0000 7f96f8a00640 1 -- start start 2024-09-12T02:44:01.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.928+0000 7f96f8a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f96f415cc50 0x7f96f40732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:01.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.928+0000 7f96f8a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f96f4071530 0x7f96f40af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:01.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.928+0000 7f96f8a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96f4073830 con 0x7f96f40719a0 2024-09-12T02:44:01.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.928+0000 7f96f8a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f96f415d030 con 0x7f96f4071530 2024-09-12T02:44:01.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.928+0000 7f96f8a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f96f40cf4c0 con 0x7f96f415cc50 2024-09-12T02:44:01.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.928+0000 7f96f1400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f96f4071530 0x7f96f40af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:01.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.929+0000 7f96f1400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f96f4071530 0x7f96f40af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50456/0 (socket says 172.21.15.112:50456) 2024-09-12T02:44:01.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.929+0000 7f96f1400640 1 -- 172.21.15.112:0/2372892650 learned_addr learned my addr 172.21.15.112:0/2372892650 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:01.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.929+0000 7f96f1e00640 1 --2- 172.21.15.112:0/2372892650 >> v2:172.21.15.137:3300/0 conn(0x7f96f415cc50 0x7f96f40732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:01.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.929+0000 7f96f1400640 1 -- 172.21.15.112:0/2372892650 >> v2:172.21.15.137:3300/0 conn(0x7f96f415cc50 msgr2=0x7f96f40732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:01.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.929+0000 7f96f1400640 1 --2- 172.21.15.112:0/2372892650 >> v2:172.21.15.137:3300/0 conn(0x7f96f415cc50 0x7f96f40732f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:01.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.929+0000 7f96f1400640 1 -- 172.21.15.112:0/2372892650 >> v1:172.21.15.137:6789/0 conn(0x7f96f40719a0 legacy=0x7f96f40cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:01.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.929+0000 7f96f1400640 1 -- 172.21.15.112:0/2372892650 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96f40ceeb0 con 0x7f96f4071530 2024-09-12T02:44:01.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.929+0000 7f96f1e00640 1 --2- 172.21.15.112:0/2372892650 >> v2:172.21.15.137:3300/0 conn(0x7f96f415cc50 0x7f96f40732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:44:01.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.930+0000 7f96f1400640 1 --2- 172.21.15.112:0/2372892650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96f4071530 0x7f96f40af720 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f96f4070060 tx=0x7f96e002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c189808f4ea5523 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:01.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.930+0000 7f96f0a00640 1 -- 172.21.15.112:0/2372892650 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e0004030 con 0x7f96f4071530 2024-09-12T02:44:01.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.930+0000 7f96f0a00640 1 -- 172.21.15.112:0/2372892650 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96e00041d0 con 0x7f96f4071530 2024-09-12T02:44:01.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.930+0000 7f96f0a00640 1 -- 172.21.15.112:0/2372892650 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e0003610 con 0x7f96f4071530 2024-09-12T02:44:01.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.931+0000 7f96f8a00640 1 -- 172.21.15.112:0/2372892650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96f4071530 msgr2=0x7f96f40af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:01.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.931+0000 7f96f8a00640 1 --2- 172.21.15.112:0/2372892650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96f4071530 0x7f96f40af720 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f96f4070060 tx=0x7f96e002a180 comp rx=0 tx=0).stop 2024-09-12T02:44:01.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.931+0000 7f96f8a00640 1 -- 172.21.15.112:0/2372892650 shutdown_connections 2024-09-12T02:44:01.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.931+0000 7f96f8a00640 1 --2- 172.21.15.112:0/2372892650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96f4071530 0x7f96f40af720 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:01.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.931+0000 7f96f8a00640 1 --2- 172.21.15.112:0/2372892650 >> v2:172.21.15.137:3300/0 conn(0x7f96f415cc50 0x7f96f40732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:01.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.931+0000 7f96f8a00640 1 -- 172.21.15.112:0/2372892650 >> 172.21.15.112:0/2372892650 conn(0x7f96f406bbd0 msgr2=0x7f96f406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:01.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.931+0000 7f96f8a00640 1 -- 172.21.15.112:0/2372892650 shutdown_connections 2024-09-12T02:44:01.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.931+0000 7f96f8a00640 1 -- 172.21.15.112:0/2372892650 wait complete. 2024-09-12T02:44:01.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.932+0000 7f96f8a00640 1 Processor -- start 2024-09-12T02:44:01.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.933+0000 7f96f8a00640 1 -- start start 2024-09-12T02:44:01.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.933+0000 7f96f8a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96f4071530 0x7f96f41403d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:01.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.933+0000 7f96f8a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96f40719a0 0x7f96f415b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:01.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.933+0000 7f96f8a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96f415cc50 0x7f96f415b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:01.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.933+0000 7f96f8a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f96f40cf150 con 0x7f96f4071530 2024-09-12T02:44:01.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.933+0000 7f96f8a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f96f406e5e0 con 0x7f96f40719a0 2024-09-12T02:44:01.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.933+0000 7f96f8a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f96f406f510 con 0x7f96f415cc50 2024-09-12T02:44:01.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.934+0000 7f96f1e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96f4071530 0x7f96f41403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:01.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.934+0000 7f96f1e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96f4071530 0x7f96f41403d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50472/0 (socket says 172.21.15.112:50472) 2024-09-12T02:44:01.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.934+0000 7f96f1e00640 1 -- 172.21.15.112:0/2727760242 learned_addr learned my addr 172.21.15.112:0/2727760242 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:01.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.934+0000 7f96f1400640 1 --2- 172.21.15.112:0/2727760242 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96f40719a0 0x7f96f415b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:01.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.934+0000 7f96f2800640 1 --2- 172.21.15.112:0/2727760242 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96f415cc50 0x7f96f415b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:01.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.934+0000 7f96f1e00640 1 -- 172.21.15.112:0/2727760242 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96f415cc50 msgr2=0x7f96f415b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:01.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.934+0000 7f96f1e00640 1 --2- 172.21.15.112:0/2727760242 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96f415cc50 0x7f96f415b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:01.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.934+0000 7f96f1e00640 1 -- 172.21.15.112:0/2727760242 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96f40719a0 msgr2=0x7f96f415b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:01.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.934+0000 7f96f1e00640 1 --2- 172.21.15.112:0/2727760242 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96f40719a0 0x7f96f415b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:01.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.934+0000 7f96f1e00640 1 -- 172.21.15.112:0/2727760242 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96f4140910 con 0x7f96f4071530 2024-09-12T02:44:01.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.934+0000 7f96f2800640 1 --2- 172.21.15.112:0/2727760242 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96f415cc50 0x7f96f415b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:44:01.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.934+0000 7f96f1e00640 1 --2- 172.21.15.112:0/2727760242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96f4071530 0x7f96f41403d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f96e400c7f0 tx=0x7f96e400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:01.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.935+0000 7f96ea000640 1 -- 172.21.15.112:0/2727760242 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e4015070 con 0x7f96f4071530 2024-09-12T02:44:01.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.935+0000 7f96ea000640 1 -- 172.21.15.112:0/2727760242 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96e4007820 con 0x7f96f4071530 2024-09-12T02:44:01.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.935+0000 7f96f8a00640 1 -- 172.21.15.112:0/2727760242 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96f41f9870 con 0x7f96f4071530 2024-09-12T02:44:01.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.935+0000 7f96ea000640 1 -- 172.21.15.112:0/2727760242 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e4007bd0 con 0x7f96f4071530 2024-09-12T02:44:01.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.935+0000 7f96f8a00640 1 -- 172.21.15.112:0/2727760242 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96f41f8d90 con 0x7f96f4071530 2024-09-12T02:44:01.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.936+0000 7f96f8a00640 1 -- 172.21.15.112:0/2727760242 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96f4068a30 con 0x7f96f4071530 2024-09-12T02:44:01.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.937+0000 7f96ea000640 1 -- 172.21.15.112:0/2727760242 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f96e4018070 con 0x7f96f4071530 2024-09-12T02:44:01.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.937+0000 7f96ea000640 1 --2- 172.21.15.112:0/2727760242 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f96d406be30 0x7f96d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:01.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.937+0000 7f96ea000640 1 -- 172.21.15.112:0/2727760242 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 4943+0+0 (secure 0 0 0) 0x7f96e408a980 con 0x7f96f4071530 2024-09-12T02:44:01.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.938+0000 7f96f1400640 1 --2- 172.21.15.112:0/2727760242 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f96d406be30 0x7f96d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:01.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.938+0000 7f96f1400640 1 --2- 172.21.15.112:0/2727760242 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f96d406be30 0x7f96d406e2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f96e0033000 tx=0x7f96e002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:01.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:01.942+0000 7f96ea000640 1 -- 172.21.15.112:0/2727760242 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f96f4140910 con 0x7f96f4071530 2024-09-12T02:44:02.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.115+0000 7f96f8a00640 1 -- 172.21.15.112:0/2727760242 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f96f40730d0 con 0x7f96f4071530 2024-09-12T02:44:02.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.119+0000 7f96ea000640 1 -- 172.21.15.112:0/2727760242 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7f96e4058fe0 con 0x7f96f4071530 2024-09-12T02:44:02.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.121+0000 7f96f8a00640 1 -- 172.21.15.112:0/2727760242 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f96d406be30 msgr2=0x7f96d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:02.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.121+0000 7f96f8a00640 1 --2- 172.21.15.112:0/2727760242 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f96d406be30 0x7f96d406e2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f96e0033000 tx=0x7f96e002e000 comp rx=0 tx=0).stop 2024-09-12T02:44:02.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.121+0000 7f96f8a00640 1 -- 172.21.15.112:0/2727760242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96f4071530 msgr2=0x7f96f41403d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:02.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.121+0000 7f96f8a00640 1 --2- 172.21.15.112:0/2727760242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96f4071530 0x7f96f41403d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f96e400c7f0 tx=0x7f96e400ccb0 comp rx=0 tx=0).stop 2024-09-12T02:44:02.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.121+0000 7f96f8a00640 1 -- 172.21.15.112:0/2727760242 shutdown_connections 2024-09-12T02:44:02.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.121+0000 7f96f8a00640 1 --2- 172.21.15.112:0/2727760242 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96f415cc50 0x7f96f415b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:02.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.121+0000 7f96f8a00640 1 --2- 172.21.15.112:0/2727760242 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f96d406be30 0x7f96d406e2f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:02.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.121+0000 7f96f8a00640 1 --2- 172.21.15.112:0/2727760242 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96f40719a0 0x7f96f415b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:02.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.121+0000 7f96f8a00640 1 --2- 172.21.15.112:0/2727760242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96f4071530 0x7f96f41403d0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:02.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.121+0000 7f96f8a00640 1 -- 172.21.15.112:0/2727760242 >> 172.21.15.112:0/2727760242 conn(0x7f96f406bbd0 msgr2=0x7f96f4157cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:02.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.121+0000 7f96f8a00640 1 -- 172.21.15.112:0/2727760242 shutdown_connections 2024-09-12T02:44:02.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.121+0000 7f96f8a00640 1 -- 172.21.15.112:0/2727760242 wait complete. 2024-09-12T02:44:02.138 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:44:02.139 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:44:02.235 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:44:02.331 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:44:02.331 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:44:02.331 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:44:02.366 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:44:02.367 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:44:02.367 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:44:02.403 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:44:02.404 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:44:02.404 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:44:02.441 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:44:02.441 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:44:02.441 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:44:02.479 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:44:02.480 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T02:44:02.480 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:44:02.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.633+0000 7f678cc00640 1 Processor -- start 2024-09-12T02:44:02.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.633+0000 7f678cc00640 1 -- start start 2024-09-12T02:44:02.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.634+0000 7f678cc00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f678815cc50 0x7f67880732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:02.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.634+0000 7f678cc00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6788073830 con 0x7f67880afe30 2024-09-12T02:44:02.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.634+0000 7f678cc00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67880ceeb0 con 0x7f6788071530 2024-09-12T02:44:02.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.634+0000 7f678cc00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f678815d030 con 0x7f678815cc50 2024-09-12T02:44:02.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.635+0000 7f6786800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f67880afe30 0x7f67880cf950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36298/0 (socket says 172.21.15.112:36298) 2024-09-12T02:44:02.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.635+0000 7f6786800640 1 -- 172.21.15.112:0/1525886203 learned_addr learned my addr 172.21.15.112:0/1525886203 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:44:02.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.635+0000 7f6785e00640 1 --2- 172.21.15.112:0/1525886203 >> v2:172.21.15.137:3300/0 conn(0x7f678815cc50 0x7f67880732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:02.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.635+0000 7f6784a00640 1 -- 172.21.15.112:0/1525886203 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2839609597 0 0) 0x7f6780001490 con 0x7f67880afe30 2024-09-12T02:44:02.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.635+0000 7f6784a00640 1 -- 172.21.15.112:0/1525886203 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f676c003520 con 0x7f67880afe30 2024-09-12T02:44:02.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.635+0000 7f6785e00640 1 -- 172.21.15.112:0/1525886203 >> v1:172.21.15.137:6789/0 conn(0x7f6788071530 legacy=0x7f67880af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:02.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.635+0000 7f6784a00640 1 -- 172.21.15.112:0/1525886203 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1046145913 0 0) 0x7f67880ceeb0 con 0x7f6788071530 2024-09-12T02:44:02.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.635+0000 7f6785e00640 1 -- 172.21.15.112:0/1525886203 >> v1:172.21.15.112:6789/0 conn(0x7f67880afe30 legacy=0x7f67880cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:02.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.635+0000 7f6785e00640 1 -- 172.21.15.112:0/1525886203 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f678806e300 con 0x7f678815cc50 2024-09-12T02:44:02.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.636+0000 7f6785e00640 1 --2- 172.21.15.112:0/1525886203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f678815cc50 0x7f67880732f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f67780097a0 tx=0x7f677802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8581dbe60b1296f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:02.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.637+0000 7f6784a00640 1 -- 172.21.15.112:0/1525886203 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6778037070 con 0x7f678815cc50 2024-09-12T02:44:02.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.637+0000 7f6784a00640 1 -- 172.21.15.112:0/1525886203 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6778032440 con 0x7f678815cc50 2024-09-12T02:44:02.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.637+0000 7f6784a00640 1 -- 172.21.15.112:0/1525886203 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67780327f0 con 0x7f678815cc50 2024-09-12T02:44:02.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.637+0000 7f678cc00640 1 -- 172.21.15.112:0/1525886203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f678815cc50 msgr2=0x7f67880732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:02.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.637+0000 7f678cc00640 1 --2- 172.21.15.112:0/1525886203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f678815cc50 0x7f67880732f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f67780097a0 tx=0x7f677802a1a0 comp rx=0 tx=0).stop 2024-09-12T02:44:02.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.637+0000 7f678cc00640 1 -- 172.21.15.112:0/1525886203 shutdown_connections 2024-09-12T02:44:02.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.637+0000 7f678cc00640 1 --2- 172.21.15.112:0/1525886203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f678815cc50 0x7f67880732f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:02.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.637+0000 7f678cc00640 1 -- 172.21.15.112:0/1525886203 >> 172.21.15.112:0/1525886203 conn(0x7f678806bbd0 msgr2=0x7f678806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:02.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.637+0000 7f678cc00640 1 -- 172.21.15.112:0/1525886203 shutdown_connections 2024-09-12T02:44:02.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.637+0000 7f678cc00640 1 -- 172.21.15.112:0/1525886203 wait complete. 2024-09-12T02:44:02.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.639+0000 7f678cc00640 1 Processor -- start 2024-09-12T02:44:02.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.639+0000 7f678cc00640 1 -- start start 2024-09-12T02:44:02.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.640+0000 7f678cc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6788071530 0x7f67881483b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:02.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.640+0000 7f678cc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67880afe30 0x7f6788152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:02.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.640+0000 7f678cc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f678815cc50 0x7f6788148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:02.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.640+0000 7f678cc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f67880cf150 con 0x7f6788071530 2024-09-12T02:44:02.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.640+0000 7f678cc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f67880cf4c0 con 0x7f67880afe30 2024-09-12T02:44:02.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.640+0000 7f678cc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f678806f510 con 0x7f678815cc50 2024-09-12T02:44:02.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.640+0000 7f6785e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6788071530 0x7f67881483b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:02.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.640+0000 7f6785e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6788071530 0x7f67881483b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50474/0 (socket says 172.21.15.112:50474) 2024-09-12T02:44:02.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.640+0000 7f6785e00640 1 -- 172.21.15.112:0/2685048150 learned_addr learned my addr 172.21.15.112:0/2685048150 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:02.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.640+0000 7f6786800640 1 --2- 172.21.15.112:0/2685048150 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f678815cc50 0x7f6788148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:02.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.640+0000 7f6785400640 1 --2- 172.21.15.112:0/2685048150 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67880afe30 0x7f6788152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:02.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.640+0000 7f6785e00640 1 -- 172.21.15.112:0/2685048150 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f678815cc50 msgr2=0x7f6788148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:02.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.640+0000 7f6785e00640 1 --2- 172.21.15.112:0/2685048150 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f678815cc50 0x7f6788148ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:02.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.640+0000 7f6785e00640 1 -- 172.21.15.112:0/2685048150 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67880afe30 msgr2=0x7f6788152130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:02.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.640+0000 7f6785e00640 1 --2- 172.21.15.112:0/2685048150 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67880afe30 0x7f6788152130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:02.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.641+0000 7f6785e00640 1 -- 172.21.15.112:0/2685048150 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f678814dad0 con 0x7f6788071530 2024-09-12T02:44:02.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.641+0000 7f6785e00640 1 --2- 172.21.15.112:0/2685048150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6788071530 0x7f67881483b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6778000c00 tx=0x7f67780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:02.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.641+0000 7f677e000640 1 -- 172.21.15.112:0/2685048150 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6778041070 con 0x7f6788071530 2024-09-12T02:44:02.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.641+0000 7f678cc00640 1 -- 172.21.15.112:0/2685048150 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67881478d0 con 0x7f6788071530 2024-09-12T02:44:02.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.641+0000 7f677e000640 1 -- 172.21.15.112:0/2685048150 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f677803c870 con 0x7f6788071530 2024-09-12T02:44:02.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.641+0000 7f677e000640 1 -- 172.21.15.112:0/2685048150 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6778037040 con 0x7f6788071530 2024-09-12T02:44:02.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.641+0000 7f678cc00640 1 -- 172.21.15.112:0/2685048150 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6788147e90 con 0x7f6788071530 2024-09-12T02:44:02.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.642+0000 7f678cc00640 1 -- 172.21.15.112:0/2685048150 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6788068a30 con 0x7f6788071530 2024-09-12T02:44:02.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.643+0000 7f677e000640 1 -- 172.21.15.112:0/2685048150 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6778044070 con 0x7f6788071530 2024-09-12T02:44:02.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.644+0000 7f677e000640 1 --2- 172.21.15.112:0/2685048150 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f676806be30 0x7f676806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:02.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.644+0000 7f677e000640 1 -- 172.21.15.112:0/2685048150 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 4943+0+0 (secure 0 0 0) 0x7f67780ab670 con 0x7f6788071530 2024-09-12T02:44:02.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.644+0000 7f6785400640 1 --2- 172.21.15.112:0/2685048150 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f676806be30 0x7f676806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:02.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.645+0000 7f6785400640 1 --2- 172.21.15.112:0/2685048150 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f676806be30 0x7f676806e2f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6774007fd0 tx=0x7f6774009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:02.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.648+0000 7f677e000640 1 -- 172.21.15.112:0/2685048150 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f677807a2a0 con 0x7f6788071530 2024-09-12T02:44:02.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.857+0000 7f678cc00640 1 -- 172.21.15.112:0/2685048150 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f678806df60 con 0x7f6788071530 2024-09-12T02:44:02.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.858+0000 7f677e000640 1 -- 172.21.15.112:0/2685048150 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+3917 (secure 0 0 0) 0x7f6778079ba0 con 0x7f6788071530 2024-09-12T02:44:02.859 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:44:02.859 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"btime":"2024-09-12T02:43:56:545750+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5008,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/362211662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":362211662},{"type":"v1","addr":"172.21.15.112:6836","nonce":362211662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5011,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/193733805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":193733805},{"type":"v1","addr":"172.21.15.112:6837","nonce":193733805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/3440642333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3440642333},{"type":"v1","addr":"172.21.15.137:6834","nonce":3440642333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5221,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1261748871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1261748871},{"type":"v1","addr":"172.21.15.137:6835","nonce":1261748871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[]} 2024-09-12T02:44:02.860 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 29 2024-09-12T02:44:02.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.860+0000 7f678cc00640 1 -- 172.21.15.112:0/2685048150 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f676806be30 msgr2=0x7f676806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:02.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.860+0000 7f678cc00640 1 --2- 172.21.15.112:0/2685048150 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f676806be30 0x7f676806e2f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6774007fd0 tx=0x7f6774009040 comp rx=0 tx=0).stop 2024-09-12T02:44:02.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.860+0000 7f678cc00640 1 -- 172.21.15.112:0/2685048150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6788071530 msgr2=0x7f67881483b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:02.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.860+0000 7f678cc00640 1 --2- 172.21.15.112:0/2685048150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6788071530 0x7f67881483b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6778000c00 tx=0x7f67780046c0 comp rx=0 tx=0).stop 2024-09-12T02:44:02.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.860+0000 7f678cc00640 1 -- 172.21.15.112:0/2685048150 shutdown_connections 2024-09-12T02:44:02.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.860+0000 7f678cc00640 1 --2- 172.21.15.112:0/2685048150 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f678815cc50 0x7f6788148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:02.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.860+0000 7f678cc00640 1 --2- 172.21.15.112:0/2685048150 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f676806be30 0x7f676806e2f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:02.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.860+0000 7f678cc00640 1 --2- 172.21.15.112:0/2685048150 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67880afe30 0x7f6788152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:02.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.860+0000 7f678cc00640 1 --2- 172.21.15.112:0/2685048150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6788071530 0x7f67881483b0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:02.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.860+0000 7f678cc00640 1 -- 172.21.15.112:0/2685048150 >> 172.21.15.112:0/2685048150 conn(0x7f678806bbd0 msgr2=0x7f67880b40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:02.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.861+0000 7f678cc00640 1 -- 172.21.15.112:0/2685048150 shutdown_connections 2024-09-12T02:44:02.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:02.861+0000 7f678cc00640 1 -- 172.21.15.112:0/2685048150 wait complete. 2024-09-12T02:44:02.877 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T02:44:02.877 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T02:44:02.878 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T02:44:02.878 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:44:02.878 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T02:44:02.878 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T02:44:02.878 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T02:44:02.878 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:44:02.879 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T02:44:02.879 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T02:44:02.879 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T02:44:02.879 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:44:02.879 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T02:44:02.879 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T02:44:02.879 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T02:44:02.880 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:44:02.896 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T02:44:02.896 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T02:44:02.897 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T02:44:02.898 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T02:44:02.899 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T02:44:02.899 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T02:44:02.900 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T02:44:02.900 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T02:44:02.940 INFO:tasks.ceph.mds.a:Started 2024-09-12T02:44:02.941 DEBUG:teuthology.parallel:result is None 2024-09-12T02:44:02.943 INFO:tasks.ceph.mds.c:Started 2024-09-12T02:44:02.944 DEBUG:teuthology.parallel:result is None 2024-09-12T02:44:02.946 INFO:tasks.ceph.mds.b:Started 2024-09-12T02:44:02.946 DEBUG:teuthology.parallel:result is None 2024-09-12T02:44:02.948 INFO:tasks.ceph.mds.d:Started 2024-09-12T02:44:02.948 DEBUG:teuthology.parallel:result is None 2024-09-12T02:44:02.949 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T02:44:03.071 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-12T02:44:03.073 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2024-09-12T02:44:03.079 INFO:tasks.ceph.mds.b.smithi137.stdout:starting mds.b at 2024-09-12T02:44:03.080 INFO:tasks.ceph.mds.d.smithi137.stdout:starting mds.d at 2024-09-12T02:44:03.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.112+0000 7fc3dbe00640 1 Processor -- start 2024-09-12T02:44:03.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.113+0000 7fc3dbe00640 1 -- start start 2024-09-12T02:44:03.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.114+0000 7fc3dbe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc3d40b2a50 0x7fc3d40b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:03.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.114+0000 7fc3dbe00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3d40d3830 con 0x7fc3d40d33c0 2024-09-12T02:44:03.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.114+0000 7fc3dbe00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3d40d3ac0 con 0x7fc3d41626d0 2024-09-12T02:44:03.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.114+0000 7fc3dbe00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc3d40d1d00 con 0x7fc3d40b2a50 2024-09-12T02:44:03.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.114+0000 7fc3d8a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc3d40b2a50 0x7fc3d40b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:03.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.114+0000 7fc3d9400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc3d41626d0 0x7fc3d40d2cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.112:48186/0 (socket says 172.21.15.112:48186) 2024-09-12T02:44:03.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.114+0000 7fc3d9400640 1 -- 172.21.15.112:0/606354367 learned_addr learned my addr 172.21.15.112:0/606354367 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:44:03.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.114+0000 7fc3d9e00640 1 --1- 172.21.15.112:0/606354367 >> v1:172.21.15.112:6789/0 conn(0x7fc3d40d33c0 0x7fc3d40cfa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36318/0 (socket says 172.21.15.112:36318) 2024-09-12T02:44:03.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.114+0000 7fc3d8a00640 1 -- 172.21.15.112:0/606354367 >> v1:172.21.15.137:6789/0 conn(0x7fc3d41626d0 legacy=0x7fc3d40d2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:03.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.114+0000 7fc3d8a00640 1 -- 172.21.15.112:0/606354367 >> v1:172.21.15.112:6789/0 conn(0x7fc3d40d33c0 legacy=0x7fc3d40cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:03.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.114+0000 7fc3d3e00640 1 -- 172.21.15.112:0/606354367 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2221156761 0 0) 0x7fc3d40d3ac0 con 0x7fc3d41626d0 2024-09-12T02:44:03.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.114+0000 7fc3d8a00640 1 -- 172.21.15.112:0/606354367 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d40d1fe0 con 0x7fc3d40b2a50 2024-09-12T02:44:03.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.115+0000 7fc3d8a00640 1 --2- 172.21.15.112:0/606354367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3d40b2a50 0x7fc3d40b3bb0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc3c00097a0 tx=0x7fc3c002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=423afce5d477d55f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:03.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.116+0000 7fc3d3e00640 1 -- 172.21.15.112:0/606354367 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0037070 con 0x7fc3d40b2a50 2024-09-12T02:44:03.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.116+0000 7fc3d3e00640 1 -- 172.21.15.112:0/606354367 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3c002adc0 con 0x7fc3d40b2a50 2024-09-12T02:44:03.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.116+0000 7fc3d3e00640 1 -- 172.21.15.112:0/606354367 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0032660 con 0x7fc3d40b2a50 2024-09-12T02:44:03.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.116+0000 7fc3dbe00640 1 -- 172.21.15.112:0/606354367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3d40b2a50 msgr2=0x7fc3d40b3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:03.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.116+0000 7fc3dbe00640 1 --2- 172.21.15.112:0/606354367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3d40b2a50 0x7fc3d40b3bb0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc3c00097a0 tx=0x7fc3c002a130 comp rx=0 tx=0).stop 2024-09-12T02:44:03.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.116+0000 7fc3dbe00640 1 -- 172.21.15.112:0/606354367 shutdown_connections 2024-09-12T02:44:03.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.116+0000 7fc3dbe00640 1 --2- 172.21.15.112:0/606354367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3d40b2a50 0x7fc3d40b3bb0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:03.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.116+0000 7fc3dbe00640 1 -- 172.21.15.112:0/606354367 >> 172.21.15.112:0/606354367 conn(0x7fc3d40d4db0 msgr2=0x7fc3d40d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:03.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.116+0000 7fc3dbe00640 1 -- 172.21.15.112:0/606354367 shutdown_connections 2024-09-12T02:44:03.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.116+0000 7fc3dbe00640 1 -- 172.21.15.112:0/606354367 wait complete. 2024-09-12T02:44:03.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.118+0000 7fc3dbe00640 1 Processor -- start 2024-09-12T02:44:03.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.118+0000 7fc3dbe00640 1 -- start start 2024-09-12T02:44:03.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.119+0000 7fc3dbe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3d40b2a50 0x7fc3d40c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:03.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.119+0000 7fc3dbe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3d40d33c0 0x7fc3d415cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:03.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.119+0000 7fc3dbe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3d41626d0 0x7fc3d40cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:03.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.119+0000 7fc3dbe00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d4162ab0 con 0x7fc3d40d33c0 2024-09-12T02:44:03.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.119+0000 7fc3dbe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d40d3da0 con 0x7fc3d41626d0 2024-09-12T02:44:03.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.119+0000 7fc3dbe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc3d415d450 con 0x7fc3d40b2a50 2024-09-12T02:44:03.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.119+0000 7fc3d8a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3d40d33c0 0x7fc3d415cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:03.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.119+0000 7fc3d8a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3d40d33c0 0x7fc3d415cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50514/0 (socket says 172.21.15.112:50514) 2024-09-12T02:44:03.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.119+0000 7fc3d8a00640 1 -- 172.21.15.112:0/2712112750 learned_addr learned my addr 172.21.15.112:0/2712112750 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:03.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.120+0000 7fc3d9e00640 1 --2- 172.21.15.112:0/2712112750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3d41626d0 0x7fc3d40cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:03.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.120+0000 7fc3d9400640 1 --2- 172.21.15.112:0/2712112750 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3d40b2a50 0x7fc3d40c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:03.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.120+0000 7fc3d8a00640 1 -- 172.21.15.112:0/2712112750 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3d40b2a50 msgr2=0x7fc3d40c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:03.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.120+0000 7fc3d8a00640 1 --2- 172.21.15.112:0/2712112750 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3d40b2a50 0x7fc3d40c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:03.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.120+0000 7fc3d8a00640 1 -- 172.21.15.112:0/2712112750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3d41626d0 msgr2=0x7fc3d40cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:03.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.120+0000 7fc3d8a00640 1 --2- 172.21.15.112:0/2712112750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3d41626d0 0x7fc3d40cdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:03.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.120+0000 7fc3d8a00640 1 -- 172.21.15.112:0/2712112750 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d40c8de0 con 0x7fc3d40d33c0 2024-09-12T02:44:03.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.120+0000 7fc3d9e00640 1 --2- 172.21.15.112:0/2712112750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3d41626d0 0x7fc3d40cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:44:03.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.120+0000 7fc3d9400640 1 --2- 172.21.15.112:0/2712112750 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3d40b2a50 0x7fc3d40c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:44:03.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.120+0000 7fc3d8a00640 1 --2- 172.21.15.112:0/2712112750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3d40d33c0 0x7fc3d415cf10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0035040 tx=0x7fc3c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:03.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.120+0000 7fc3d1600640 1 -- 172.21.15.112:0/2712112750 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0037040 con 0x7fc3d40d33c0 2024-09-12T02:44:03.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.120+0000 7fc3d1600640 1 -- 172.21.15.112:0/2712112750 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3c0004030 con 0x7fc3d40d33c0 2024-09-12T02:44:03.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.120+0000 7fc3d1600640 1 -- 172.21.15.112:0/2712112750 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0004440 con 0x7fc3d40d33c0 2024-09-12T02:44:03.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.120+0000 7fc3dbe00640 1 -- 172.21.15.112:0/2712112750 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3d40c90c0 con 0x7fc3d40d33c0 2024-09-12T02:44:03.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.121+0000 7fc3dbe00640 1 -- 172.21.15.112:0/2712112750 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3d40c9680 con 0x7fc3d40d33c0 2024-09-12T02:44:03.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.122+0000 7fc3dbe00640 1 -- 172.21.15.112:0/2712112750 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3d40b3bb0 con 0x7fc3d40d33c0 2024-09-12T02:44:03.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.123+0000 7fc3d1600640 1 -- 172.21.15.112:0/2712112750 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc3c0003610 con 0x7fc3d40d33c0 2024-09-12T02:44:03.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.124+0000 7fc3d1600640 1 --2- 172.21.15.112:0/2712112750 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc3b406be30 0x7fc3b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:03.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.124+0000 7fc3d1600640 1 -- 172.21.15.112:0/2712112750 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 4943+0+0 (secure 0 0 0) 0x7fc3c00ab680 con 0x7fc3d40d33c0 2024-09-12T02:44:03.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.124+0000 7fc3d9400640 1 --2- 172.21.15.112:0/2712112750 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc3b406be30 0x7fc3b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:03.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.125+0000 7fc3d9400640 1 --2- 172.21.15.112:0/2712112750 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc3b406be30 0x7fc3b406e2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8000f60 tx=0x7fc3c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:03.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.128+0000 7fc3d1600640 1 -- 172.21.15.112:0/2712112750 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc3c007a290 con 0x7fc3d40d33c0 2024-09-12T02:44:03.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.315+0000 7fc3dbe00640 1 -- 172.21.15.112:0/2712112750 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fc3d40c8570 con 0x7fc3d40d33c0 2024-09-12T02:44:03.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.597+0000 7fc3d1600640 1 -- 172.21.15.112:0/2712112750 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v58) ==== 97+0+0 (secure 0 0 0) 0x7fc3c0079b90 con 0x7fc3d40d33c0 2024-09-12T02:44:03.598 INFO:teuthology.orchestra.run.smithi112.stderr: removed all blocklist entries 2024-09-12T02:44:03.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.599+0000 7fc3dbe00640 1 -- 172.21.15.112:0/2712112750 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc3b406be30 msgr2=0x7fc3b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:03.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.599+0000 7fc3dbe00640 1 --2- 172.21.15.112:0/2712112750 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc3b406be30 0x7fc3b406e2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8000f60 tx=0x7fc3c8009040 comp rx=0 tx=0).stop 2024-09-12T02:44:03.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.599+0000 7fc3dbe00640 1 -- 172.21.15.112:0/2712112750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3d40d33c0 msgr2=0x7fc3d415cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:03.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.599+0000 7fc3dbe00640 1 --2- 172.21.15.112:0/2712112750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3d40d33c0 0x7fc3d415cf10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0035040 tx=0x7fc3c00046c0 comp rx=0 tx=0).stop 2024-09-12T02:44:03.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.599+0000 7fc3dbe00640 1 -- 172.21.15.112:0/2712112750 shutdown_connections 2024-09-12T02:44:03.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.599+0000 7fc3dbe00640 1 --2- 172.21.15.112:0/2712112750 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc3b406be30 0x7fc3b406e2f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:03.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.599+0000 7fc3dbe00640 1 --2- 172.21.15.112:0/2712112750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3d41626d0 0x7fc3d40cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:03.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.599+0000 7fc3dbe00640 1 --2- 172.21.15.112:0/2712112750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3d40d33c0 0x7fc3d415cf10 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:03.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.599+0000 7fc3dbe00640 1 --2- 172.21.15.112:0/2712112750 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3d40b2a50 0x7fc3d40c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:03.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.599+0000 7fc3dbe00640 1 -- 172.21.15.112:0/2712112750 >> 172.21.15.112:0/2712112750 conn(0x7fc3d40d4db0 msgr2=0x7fc3d4161540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:03.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.600+0000 7fc3dbe00640 1 -- 172.21.15.112:0/2712112750 shutdown_connections 2024-09-12T02:44:03.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.600+0000 7fc3dbe00640 1 -- 172.21.15.112:0/2712112750 wait complete. 2024-09-12T02:44:03.617 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T02:44:03.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.769+0000 7f52a7400640 1 Processor -- start 2024-09-12T02:44:03.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.769+0000 7f52a7400640 1 -- start start 2024-09-12T02:44:03.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.770+0000 7f52a7400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f52a006f600 0x7f52a00b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:03.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.771+0000 7f52a7400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f52a00b45d0 0x7f52a00728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:03.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.771+0000 7f52a7400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52a00b4a20 con 0x7f52a015b9d0 2024-09-12T02:44:03.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.771+0000 7f52a7400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f52a00b54a0 con 0x7f52a006f600 2024-09-12T02:44:03.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.771+0000 7f52a7400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f52a00b3af0 con 0x7f52a00b45d0 2024-09-12T02:44:03.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.771+0000 7f5297e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f52a006f600 0x7f52a00b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:03.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.771+0000 7f52a4a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f52a015b9d0 0x7f52a006eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36324/0 (socket says 172.21.15.112:36324) 2024-09-12T02:44:03.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.771+0000 7f52a4a00640 1 -- 172.21.15.112:0/3692652166 learned_addr learned my addr 172.21.15.112:0/3692652166 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:44:03.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.771+0000 7f5297e00640 1 -- 172.21.15.112:0/3692652166 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f52a00b45d0 msgr2=0x7f52a00728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:03.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.771+0000 7f5297e00640 1 --2- 172.21.15.112:0/3692652166 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f52a00b45d0 0x7f52a00728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:03.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.771+0000 7f5297e00640 1 -- 172.21.15.112:0/3692652166 >> v1:172.21.15.112:6789/0 conn(0x7f52a015b9d0 legacy=0x7f52a006eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:03.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.771+0000 7f5297e00640 1 -- 172.21.15.112:0/3692652166 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52a00b3dd0 con 0x7f52a006f600 2024-09-12T02:44:03.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.771+0000 7f529fe00640 1 -- 172.21.15.112:0/3692652166 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2705365713 0 0) 0x7f52a00b4a20 con 0x7f52a015b9d0 2024-09-12T02:44:03.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.772+0000 7f5297e00640 1 --2- 172.21.15.112:0/3692652166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52a006f600 0x7f52a00b4ec0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5288009790 tx=0x7f528802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a60ea3c9818deb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:03.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.772+0000 7f529fe00640 1 -- 172.21.15.112:0/3692652166 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5288037070 con 0x7f52a006f600 2024-09-12T02:44:03.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.772+0000 7f529fe00640 1 -- 172.21.15.112:0/3692652166 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5288032440 con 0x7f52a006f600 2024-09-12T02:44:03.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.772+0000 7f529fe00640 1 -- 172.21.15.112:0/3692652166 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5288032810 con 0x7f52a006f600 2024-09-12T02:44:03.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.773+0000 7f52a7400640 1 -- 172.21.15.112:0/3692652166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52a006f600 msgr2=0x7f52a00b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:03.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.773+0000 7f52a7400640 1 --2- 172.21.15.112:0/3692652166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52a006f600 0x7f52a00b4ec0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5288009790 tx=0x7f528802a180 comp rx=0 tx=0).stop 2024-09-12T02:44:03.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.773+0000 7f52a7400640 1 -- 172.21.15.112:0/3692652166 shutdown_connections 2024-09-12T02:44:03.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.773+0000 7f52a7400640 1 --2- 172.21.15.112:0/3692652166 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f52a00b45d0 0x7f52a00728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:03.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.773+0000 7f52a7400640 1 --2- 172.21.15.112:0/3692652166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52a006f600 0x7f52a00b4ec0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:03.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.773+0000 7f52a7400640 1 -- 172.21.15.112:0/3692652166 >> 172.21.15.112:0/3692652166 conn(0x7f52a006bbd0 msgr2=0x7f52a006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:03.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.773+0000 7f52a7400640 1 -- 172.21.15.112:0/3692652166 shutdown_connections 2024-09-12T02:44:03.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.773+0000 7f52a7400640 1 -- 172.21.15.112:0/3692652166 wait complete. 2024-09-12T02:44:03.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.775+0000 7f52a7400640 1 Processor -- start 2024-09-12T02:44:03.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.775+0000 7f52a7400640 1 -- start start 2024-09-12T02:44:03.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.776+0000 7f52a7400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f52a006f600 0x7f52a015a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:03.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.776+0000 7f52a7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52a00b45d0 0x7f52a0152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:03.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.776+0000 7f52a7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52a015b9d0 0x7f52a015e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:03.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.776+0000 7f52a7400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f52a015bf30 con 0x7f52a015b9d0 2024-09-12T02:44:03.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.776+0000 7f52a7400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f52a015bdb0 con 0x7f52a00b45d0 2024-09-12T02:44:03.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.776+0000 7f52a7400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f52a00cdcd0 con 0x7f52a006f600 2024-09-12T02:44:03.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.776+0000 7f52a4a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f52a006f600 0x7f52a015a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:03.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.776+0000 7f52a5400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52a015b9d0 0x7f52a015e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:03.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.776+0000 7f52a4a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f52a006f600 0x7f52a015a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:40440/0 (socket says 172.21.15.112:40440) 2024-09-12T02:44:03.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.776+0000 7f52a5400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52a015b9d0 0x7f52a015e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50532/0 (socket says 172.21.15.112:50532) 2024-09-12T02:44:03.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.776+0000 7f52a4a00640 1 -- 172.21.15.112:0/811322244 learned_addr learned my addr 172.21.15.112:0/811322244 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:03.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.777+0000 7f52a5400640 1 -- 172.21.15.112:0/811322244 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f52a006f600 msgr2=0x7f52a015a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:03.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.777+0000 7f52a5400640 1 --2- 172.21.15.112:0/811322244 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f52a006f600 0x7f52a015a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:03.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.777+0000 7f52a5400640 1 -- 172.21.15.112:0/811322244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52a00b45d0 msgr2=0x7f52a0152910 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:44:03.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.777+0000 7f52a5400640 1 --2- 172.21.15.112:0/811322244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52a00b45d0 0x7f52a0152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:03.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.777+0000 7f52a5400640 1 -- 172.21.15.112:0/811322244 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52a0158fc0 con 0x7f52a015b9d0 2024-09-12T02:44:03.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.777+0000 7f52a5400640 1 --2- 172.21.15.112:0/811322244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52a015b9d0 0x7f52a015e7d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f529800be50 tx=0x7f529800bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:03.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.777+0000 7f529d600640 1 -- 172.21.15.112:0/811322244 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5298019070 con 0x7f52a015b9d0 2024-09-12T02:44:03.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.777+0000 7f529d600640 1 -- 172.21.15.112:0/811322244 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5298014440 con 0x7f52a015b9d0 2024-09-12T02:44:03.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.777+0000 7f52a7400640 1 -- 172.21.15.112:0/811322244 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52a01592a0 con 0x7f52a015b9d0 2024-09-12T02:44:03.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.777+0000 7f529d600640 1 -- 172.21.15.112:0/811322244 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5298014830 con 0x7f52a015b9d0 2024-09-12T02:44:03.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.777+0000 7f52a7400640 1 -- 172.21.15.112:0/811322244 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52a0159860 con 0x7f52a015b9d0 2024-09-12T02:44:03.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.778+0000 7f52a7400640 1 -- 172.21.15.112:0/811322244 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52a0068a30 con 0x7f52a015b9d0 2024-09-12T02:44:03.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.779+0000 7f529d600640 1 -- 172.21.15.112:0/811322244 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f529801c070 con 0x7f52a015b9d0 2024-09-12T02:44:03.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.781+0000 7f529d600640 1 --2- 172.21.15.112:0/811322244 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f527c06be60 0x7f527c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:03.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.781+0000 7f529d600640 1 -- 172.21.15.112:0/811322244 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4857+0+0 (secure 0 0 0) 0x7f529808aa40 con 0x7f52a015b9d0 2024-09-12T02:44:03.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.781+0000 7f52a4a00640 1 --2- 172.21.15.112:0/811322244 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f527c06be60 0x7f527c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:03.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.781+0000 7f52a4a00640 1 --2- 172.21.15.112:0/811322244 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f527c06be60 0x7f527c06e320 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5290000f60 tx=0x7f5290007ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:03.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:03.785+0000 7f529d600640 1 -- 172.21.15.112:0/811322244 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f52980590e0 con 0x7f52a015b9d0 2024-09-12T02:44:04.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.022+0000 7f52a7400640 1 -- 172.21.15.112:0/811322244 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f52a006e380 con 0x7f52a015b9d0 2024-09-12T02:44:04.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.023+0000 7f529d600640 1 -- 172.21.15.112:0/811322244 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7f529805d3e0 con 0x7f52a015b9d0 2024-09-12T02:44:04.024 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:44:04.024 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:44:04.024 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_dump": [ 2024-09-12T02:44:04.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:44:04.024 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.a", 2024-09-12T02:44:04.024 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmKE09KRAAtNq70LeeB9ENNxX91m10Fg==", 2024-09-12T02:44:04.024 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:44:04.024 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:44:04.024 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:44:04.025 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:44:04.025 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:44:04.025 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:44:04.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:44:04.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:44:04.025 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.b", 2024-09-12T02:44:04.025 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmMjYTARAAuIrofOOp9Dbrhkt314mhuw==", 2024-09-12T02:44:04.025 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:44:04.025 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:44:04.025 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:44:04.025 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:44:04.025 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:44:04.025 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:44:04.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:44:04.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:44:04.026 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.c", 2024-09-12T02:44:04.026 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmLQXzMhAAhk28JuqKhfbZtvRu9SSVrw==", 2024-09-12T02:44:04.026 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:44:04.026 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:44:04.026 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:44:04.026 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:44:04.026 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:44:04.026 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:44:04.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:44:04.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:44:04.026 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.d", 2024-09-12T02:44:04.026 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmaE7JChAAKlyynYJnHLs87BXyMC0xgA==", 2024-09-12T02:44:04.027 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:44:04.027 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:44:04.027 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:44:04.027 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:44:04.027 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:44:04.027 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:44:04.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:44:04.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:44:04.027 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.0", 2024-09-12T02:44:04.027 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDXVOJmFXfdIRAA+VpZNU0tEN6vAzR2C7nuLg==", 2024-09-12T02:44:04.027 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:44:04.027 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:44:04.027 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:44:04.027 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:44:04.028 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:44:04.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:44:04.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:44:04.028 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.1", 2024-09-12T02:44:04.028 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDXVOJmcgHyLBAA/OxfdQ1D+uFzbCnm1dJLxw==", 2024-09-12T02:44:04.028 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:44:04.028 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:44:04.028 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:44:04.028 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:44:04.028 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:44:04.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:44:04.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:44:04.028 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.2", 2024-09-12T02:44:04.029 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDXVOJm0baUNhAAuInNwHut2Xn0kBmjnJhdqw==", 2024-09-12T02:44:04.029 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:44:04.029 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:44:04.029 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:44:04.029 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:44:04.029 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:44:04.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:44:04.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:44:04.029 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.3", 2024-09-12T02:44:04.029 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDYVOJmL/O3BBAAZhQ4/70wj/2zEbMcfD4hQA==", 2024-09-12T02:44:04.029 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:44:04.029 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:44:04.029 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:44:04.030 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:44:04.030 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:44:04.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:44:04.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:44:04.030 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.4", 2024-09-12T02:44:04.030 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmC+sJAxAAUQofpG3g8DlGLQ8wUqtuSg==", 2024-09-12T02:44:04.030 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:44:04.030 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:44:04.030 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:44:04.030 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:44:04.030 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:44:04.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:44:04.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:44:04.030 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.5", 2024-09-12T02:44:04.031 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmY2OSDhAA2rg1HGjWx7G6IzFi6yQ/jQ==", 2024-09-12T02:44:04.031 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:44:04.031 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:44:04.031 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:44:04.031 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:44:04.031 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:44:04.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:44:04.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:44:04.031 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.6", 2024-09-12T02:44:04.031 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmydoaGRAAh/ozKewnY+RxiZ4EcOFA7A==", 2024-09-12T02:44:04.031 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:44:04.031 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:44:04.031 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:44:04.031 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:44:04.032 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:44:04.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:44:04.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:44:04.032 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.7", 2024-09-12T02:44:04.032 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmmB7cIhAAVhtz7OuxYBQgEKGvHdY33g==", 2024-09-12T02:44:04.032 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:44:04.033 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:44:04.033 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:44:04.033 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:44:04.033 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:44:04.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:44:04.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:44:04.033 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.0", 2024-09-12T02:44:04.033 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmaG86ExAAD0SOlJOsLpoQZlgPJIPaxA==", 2024-09-12T02:44:04.034 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:44:04.034 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:44:04.034 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow r", 2024-09-12T02:44:04.034 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T02:44:04.034 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:44:04.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:44:04.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:44:04.034 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.1", 2024-09-12T02:44:04.034 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmt7AeIBAAGRSEejG29OpANZqtia7KEw==", 2024-09-12T02:44:04.034 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:44:04.034 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:44:04.034 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:44:04.035 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:44:04.035 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:44:04.035 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:44:04.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:44:04.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:44:04.035 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.2", 2024-09-12T02:44:04.035 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmcUWtGRAAlV/gS/CDZKHb5bjbmDzjlg==", 2024-09-12T02:44:04.035 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:44:04.035 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:44:04.035 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:44:04.035 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:44:04.035 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:44:04.035 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:44:04.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:44:04.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:44:04.036 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.3", 2024-09-12T02:44:04.036 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJm2M97JhAAHKJoPBf6TN6Nu8muK6wzaw==", 2024-09-12T02:44:04.036 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:44:04.036 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:44:04.036 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:44:04.036 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:44:04.036 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:44:04.036 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:44:04.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:44:04.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:44:04.036 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.admin", 2024-09-12T02:44:04.037 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDSVOJmhl82NBAAvkcxnsY5u9lYO12FaRbP1A==", 2024-09-12T02:44:04.037 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:44:04.037 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-12T02:44:04.037 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:44:04.037 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:44:04.037 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:44:04.037 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:44:04.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:44:04.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:44:04.037 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.x", 2024-09-12T02:44:04.037 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmftawIhAAAKmfx8khERROoZ8BCLukAw==", 2024-09-12T02:44:04.037 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:44:04.037 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-12T02:44:04.037 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-12T02:44:04.038 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:44:04.038 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:44:04.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:44:04.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:44:04.038 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.y", 2024-09-12T02:44:04.038 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmcxtNGhAAAXWh1fMrVeFSy2hh3p2Rkw==", 2024-09-12T02:44:04.038 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:44:04.038 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-12T02:44:04.038 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-12T02:44:04.038 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:44:04.038 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:44:04.038 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:44:04.038 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:44:04.039 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:44:04.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.025+0000 7f52a7400640 1 -- 172.21.15.112:0/811322244 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f527c06be60 msgr2=0x7f527c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:04.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.025+0000 7f52a7400640 1 --2- 172.21.15.112:0/811322244 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f527c06be60 0x7f527c06e320 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5290000f60 tx=0x7f5290007ea0 comp rx=0 tx=0).stop 2024-09-12T02:44:04.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.025+0000 7f52a7400640 1 -- 172.21.15.112:0/811322244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52a015b9d0 msgr2=0x7f52a015e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:04.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.025+0000 7f52a7400640 1 --2- 172.21.15.112:0/811322244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52a015b9d0 0x7f52a015e7d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f529800be50 tx=0x7f529800bf40 comp rx=0 tx=0).stop 2024-09-12T02:44:04.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.025+0000 7f52a7400640 1 -- 172.21.15.112:0/811322244 shutdown_connections 2024-09-12T02:44:04.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.025+0000 7f52a7400640 1 --2- 172.21.15.112:0/811322244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52a015b9d0 0x7f52a015e7d0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:04.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.025+0000 7f52a7400640 1 --2- 172.21.15.112:0/811322244 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f527c06be60 0x7f527c06e320 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:04.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.025+0000 7f52a7400640 1 --2- 172.21.15.112:0/811322244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52a00b45d0 0x7f52a0152910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:04.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.025+0000 7f52a7400640 1 --2- 172.21.15.112:0/811322244 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f52a006f600 0x7f52a015a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:04.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.025+0000 7f52a7400640 1 -- 172.21.15.112:0/811322244 >> 172.21.15.112:0/811322244 conn(0x7f52a006bbd0 msgr2=0x7f52a00b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:04.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.025+0000 7f52a7400640 1 -- 172.21.15.112:0/811322244 shutdown_connections 2024-09-12T02:44:04.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.025+0000 7f52a7400640 1 -- 172.21.15.112:0/811322244 wait complete. 2024-09-12T02:44:04.041 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T02:44:04.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.194+0000 7f2f16600640 1 Processor -- start 2024-09-12T02:44:04.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.194+0000 7f2f16600640 1 -- start start 2024-09-12T02:44:04.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.195+0000 7f2f16600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2f101460a0 0x7f2f10071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:04.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.196+0000 7f2f16600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f100cd480 con 0x7f2f10071a70 2024-09-12T02:44:04.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.196+0000 7f2f16600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f100cd760 con 0x7f2f10145a90 2024-09-12T02:44:04.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.196+0000 7f2f16600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2f10145e70 con 0x7f2f101460a0 2024-09-12T02:44:04.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.196+0000 7f2f0fe00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2f10071a70 0x7f2f10160620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36340/0 (socket says 172.21.15.112:36340) 2024-09-12T02:44:04.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.196+0000 7f2f0fe00640 1 -- 172.21.15.112:0/2533944033 learned_addr learned my addr 172.21.15.112:0/2533944033 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:44:04.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.196+0000 7f2f0ea00640 1 -- 172.21.15.112:0/2533944033 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2677208917 0 0) 0x7f2f100cd480 con 0x7f2f10071a70 2024-09-12T02:44:04.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.196+0000 7f2f0ea00640 1 -- 172.21.15.112:0/2533944033 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ef4003520 con 0x7f2f10071a70 2024-09-12T02:44:04.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.196+0000 7f2f06a00640 1 --2- 172.21.15.112:0/2533944033 >> v2:172.21.15.137:3300/0 conn(0x7f2f101460a0 0x7f2f10071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:04.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.196+0000 7f2f0ea00640 1 -- 172.21.15.112:0/2533944033 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2445458805 0 0) 0x7f2ef4003520 con 0x7f2f10071a70 2024-09-12T02:44:04.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.196+0000 7f2f0ea00640 1 -- 172.21.15.112:0/2533944033 >> v2:172.21.15.137:3300/0 conn(0x7f2f101460a0 msgr2=0x7f2f10071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:04.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.196+0000 7f2f0ea00640 1 --2- 172.21.15.112:0/2533944033 >> v2:172.21.15.137:3300/0 conn(0x7f2f101460a0 0x7f2f10071530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:04.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.196+0000 7f2f0ea00640 1 -- 172.21.15.112:0/2533944033 >> v1:172.21.15.137:6789/0 conn(0x7f2f10145a90 legacy=0x7f2f100cffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:04.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.196+0000 7f2f0ea00640 1 -- 172.21.15.112:0/2533944033 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f100d06e0 con 0x7f2f10071a70 2024-09-12T02:44:04.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.197+0000 7f2f0ea00640 1 -- 172.21.15.112:0/2533944033 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f2f080019f0 con 0x7f2f10071a70 2024-09-12T02:44:04.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.197+0000 7f2f0ea00640 1 -- 172.21.15.112:0/2533944033 >> v1:172.21.15.112:6789/0 conn(0x7f2f10071a70 legacy=0x7f2f10160620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:04.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.197+0000 7f2f0ea00640 1 --2- 172.21.15.112:0/2533944033 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ef40039b0 0x7f2ef4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:04.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.197+0000 7f2f0ea00640 1 --2- 172.21.15.112:0/2533944033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ef4004800 0x7f2ef4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:04.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.197+0000 7f2f0ea00640 1 --2- 172.21.15.112:0/2533944033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ef40053c0 0x7f2ef400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:04.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.197+0000 7f2f0ea00640 1 -- 172.21.15.112:0/2533944033 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2f10145e70 con 0x7f2ef4004800 2024-09-12T02:44:04.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.197+0000 7f2f0ea00640 1 -- 172.21.15.112:0/2533944033 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef400c250 con 0x7f2ef40053c0 2024-09-12T02:44:04.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.197+0000 7f2f0ea00640 1 -- 172.21.15.112:0/2533944033 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2ef400c450 con 0x7f2ef40039b0 2024-09-12T02:44:04.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.197+0000 7f2f0fe00640 1 --2- 172.21.15.112:0/2533944033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ef40053c0 0x7f2ef400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:04.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.197+0000 7f2f06a00640 1 --2- 172.21.15.112:0/2533944033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ef4004800 0x7f2ef4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:04.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.197+0000 7f2f0f400640 1 --2- 172.21.15.112:0/2533944033 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ef40039b0 0x7f2ef4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:04.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.197+0000 7f2f06a00640 1 -- 172.21.15.112:0/2533944033 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ef40039b0 msgr2=0x7f2ef4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:04.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.197+0000 7f2f06a00640 1 --2- 172.21.15.112:0/2533944033 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ef40039b0 0x7f2ef4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:04.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.197+0000 7f2f06a00640 1 -- 172.21.15.112:0/2533944033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ef40053c0 msgr2=0x7f2ef400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:04.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.197+0000 7f2f06a00640 1 --2- 172.21.15.112:0/2533944033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ef40053c0 0x7f2ef400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:04.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.197+0000 7f2f06a00640 1 -- 172.21.15.112:0/2533944033 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef4003520 con 0x7f2ef4004800 2024-09-12T02:44:04.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.197+0000 7f2f0fe00640 1 -- 172.21.15.112:0/2533944033 reap_dead start 2024-09-12T02:44:04.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.198+0000 7f2f06a00640 1 --2- 172.21.15.112:0/2533944033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ef4004800 0x7f2ef4004c80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2ef800ba30 tx=0x7f2ef4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c5c27e97b11bd64 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:04.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.199+0000 7f2f0ea00640 1 -- 172.21.15.112:0/2533944033 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8030070 con 0x7f2ef4004800 2024-09-12T02:44:04.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.199+0000 7f2f0ea00640 1 -- 172.21.15.112:0/2533944033 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef802ade0 con 0x7f2ef4004800 2024-09-12T02:44:04.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.199+0000 7f2f0ea00640 1 -- 172.21.15.112:0/2533944033 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef800b600 con 0x7f2ef4004800 2024-09-12T02:44:04.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.199+0000 7f2f16600640 1 -- 172.21.15.112:0/2533944033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ef4004800 msgr2=0x7f2ef4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:04.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.199+0000 7f2f16600640 1 --2- 172.21.15.112:0/2533944033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ef4004800 0x7f2ef4004c80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2ef800ba30 tx=0x7f2ef4005830 comp rx=0 tx=0).stop 2024-09-12T02:44:04.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.199+0000 7f2f16600640 1 -- 172.21.15.112:0/2533944033 shutdown_connections 2024-09-12T02:44:04.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.199+0000 7f2f16600640 1 --2- 172.21.15.112:0/2533944033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ef4004800 0x7f2ef4004c80 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:04.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.199+0000 7f2f16600640 1 -- 172.21.15.112:0/2533944033 >> 172.21.15.112:0/2533944033 conn(0x7f2f100b26c0 msgr2=0x7f2f100b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:04.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.199+0000 7f2f16600640 1 -- 172.21.15.112:0/2533944033 shutdown_connections 2024-09-12T02:44:04.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.199+0000 7f2f16600640 1 -- 172.21.15.112:0/2533944033 wait complete. 2024-09-12T02:44:04.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.201+0000 7f2f16600640 1 Processor -- start 2024-09-12T02:44:04.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.201+0000 7f2f16600640 1 -- start start 2024-09-12T02:44:04.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.202+0000 7f2f16600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ef4004800 0x7f2f101e4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:04.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.202+0000 7f2f16600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f101e56a0 0x7f2f100ade90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:04.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.202+0000 7f2f16600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f100ae3d0 0x7f2f100c5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:04.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.202+0000 7f2f16600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1006f340 con 0x7f2f100ae3d0 2024-09-12T02:44:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.202+0000 7f2f16600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2f100cfb40 con 0x7f2f101e56a0 2024-09-12T02:44:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.202+0000 7f2f16600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2f1006f4c0 con 0x7f2ef4004800 2024-09-12T02:44:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.202+0000 7f2f0fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f100ae3d0 0x7f2f100c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.202+0000 7f2f0fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f100ae3d0 0x7f2f100c5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50548/0 (socket says 172.21.15.112:50548) 2024-09-12T02:44:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.202+0000 7f2f0fe00640 1 -- 172.21.15.112:0/4177961606 learned_addr learned my addr 172.21.15.112:0/4177961606 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.202+0000 7f2f06a00640 1 --2- 172.21.15.112:0/4177961606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f101e56a0 0x7f2f100ade90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.202+0000 7f2f0f400640 1 --2- 172.21.15.112:0/4177961606 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ef4004800 0x7f2f101e4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.203+0000 7f2f0fe00640 1 -- 172.21.15.112:0/4177961606 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ef4004800 msgr2=0x7f2f101e4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.203+0000 7f2f0fe00640 1 --2- 172.21.15.112:0/4177961606 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ef4004800 0x7f2f101e4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.203+0000 7f2f0fe00640 1 -- 172.21.15.112:0/4177961606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f101e56a0 msgr2=0x7f2f100ade90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:04.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.203+0000 7f2f0fe00640 1 --2- 172.21.15.112:0/4177961606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f101e56a0 0x7f2f100ade90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:04.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.203+0000 7f2f0fe00640 1 -- 172.21.15.112:0/4177961606 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f100ae850 con 0x7f2f100ae3d0 2024-09-12T02:44:04.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.203+0000 7f2f0fe00640 1 --2- 172.21.15.112:0/4177961606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f100ae3d0 0x7f2f100c5930 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2f08002050 tx=0x7f2f080079d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:04.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.203+0000 7f2f07e00640 1 -- 172.21.15.112:0/4177961606 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f08017020 con 0x7f2f100ae3d0 2024-09-12T02:44:04.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.203+0000 7f2f07e00640 1 -- 172.21.15.112:0/4177961606 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f0800aaa0 con 0x7f2f100ae3d0 2024-09-12T02:44:04.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.203+0000 7f2f07e00640 1 -- 172.21.15.112:0/4177961606 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f080133f0 con 0x7f2f100ae3d0 2024-09-12T02:44:04.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.203+0000 7f2f16600640 1 -- 172.21.15.112:0/4177961606 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f100aeb30 con 0x7f2f100ae3d0 2024-09-12T02:44:04.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.203+0000 7f2f16600640 1 -- 172.21.15.112:0/4177961606 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f100af0f0 con 0x7f2f100ae3d0 2024-09-12T02:44:04.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.205+0000 7f2f16600640 1 -- 172.21.15.112:0/4177961606 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f10068a30 con 0x7f2f100ae3d0 2024-09-12T02:44:04.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.205+0000 7f2f07e00640 1 -- 172.21.15.112:0/4177961606 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2f0801a020 con 0x7f2f100ae3d0 2024-09-12T02:44:04.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.206+0000 7f2f07e00640 1 --2- 172.21.15.112:0/4177961606 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2eec06be30 0x7f2eec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:04.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.206+0000 7f2f07e00640 1 -- 172.21.15.112:0/4177961606 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4857+0+0 (secure 0 0 0) 0x7f2f0808b180 con 0x7f2f100ae3d0 2024-09-12T02:44:04.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.206+0000 7f2f0f400640 1 --2- 172.21.15.112:0/4177961606 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2eec06be30 0x7f2eec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:04.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.207+0000 7f2f0f400640 1 --2- 172.21.15.112:0/4177961606 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2eec06be30 0x7f2eec06e2f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2f1006b5e0 tx=0x7f2f00009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:04.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.211+0000 7f2f07e00640 1 -- 172.21.15.112:0/4177961606 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2f08021020 con 0x7f2f100ae3d0 2024-09-12T02:44:04.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.386+0000 7f2f16600640 1 -- 172.21.15.112:0/4177961606 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f2f10071530 con 0x7f2f100ae3d0 2024-09-12T02:44:04.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.387+0000 7f2f07e00640 1 -- 172.21.15.112:0/4177961606 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v60) ==== 84+0+65 (secure 0 0 0) 0x7f2f08089e20 con 0x7f2f100ae3d0 2024-09-12T02:44:04.388 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:44:04.388 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2024-09-12T02:44:04.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:44:04.388 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 1, 2024-09-12T02:44:04.388 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": ".mgr" 2024-09-12T02:44:04.388 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:44:04.388 INFO:teuthology.orchestra.run.smithi112.stdout:] 2024-09-12T02:44:04.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.389+0000 7f2f16600640 1 -- 172.21.15.112:0/4177961606 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2eec06be30 msgr2=0x7f2eec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:04.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.389+0000 7f2f16600640 1 --2- 172.21.15.112:0/4177961606 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2eec06be30 0x7f2eec06e2f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2f1006b5e0 tx=0x7f2f00009040 comp rx=0 tx=0).stop 2024-09-12T02:44:04.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.389+0000 7f2f16600640 1 -- 172.21.15.112:0/4177961606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f100ae3d0 msgr2=0x7f2f100c5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:04.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.389+0000 7f2f16600640 1 --2- 172.21.15.112:0/4177961606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f100ae3d0 0x7f2f100c5930 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2f08002050 tx=0x7f2f080079d0 comp rx=0 tx=0).stop 2024-09-12T02:44:04.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.389+0000 7f2f16600640 1 -- 172.21.15.112:0/4177961606 shutdown_connections 2024-09-12T02:44:04.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.389+0000 7f2f16600640 1 --2- 172.21.15.112:0/4177961606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f100ae3d0 0x7f2f100c5930 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:04.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.389+0000 7f2f16600640 1 --2- 172.21.15.112:0/4177961606 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2eec06be30 0x7f2eec06e2f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:04.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.389+0000 7f2f16600640 1 --2- 172.21.15.112:0/4177961606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f101e56a0 0x7f2f100ade90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:04.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.389+0000 7f2f16600640 1 --2- 172.21.15.112:0/4177961606 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ef4004800 0x7f2f101e4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:04.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.389+0000 7f2f16600640 1 -- 172.21.15.112:0/4177961606 >> 172.21.15.112:0/4177961606 conn(0x7f2f100b26c0 msgr2=0x7f2f100cf190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:04.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.389+0000 7f2f16600640 1 -- 172.21.15.112:0/4177961606 shutdown_connections 2024-09-12T02:44:04.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.389+0000 7f2f16600640 1 -- 172.21.15.112:0/4177961606 wait complete. 2024-09-12T02:44:04.405 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T02:44:04.406 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T02:44:04.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.562+0000 7f1d29400640 1 Processor -- start 2024-09-12T02:44:04.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.562+0000 7f1d29400640 1 -- start start 2024-09-12T02:44:04.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.563+0000 7f1d29400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1d2415b880 0x7f1d24072470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:04.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.563+0000 7f1d29400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d2406e580 0x7f1d2406ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:04.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.563+0000 7f1d29400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d24073820 con 0x7f1d2415fdc0 2024-09-12T02:44:04.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.563+0000 7f1d29400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f1d24160330 con 0x7f1d2415b880 2024-09-12T02:44:04.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.563+0000 7f1d29400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1d24071fe0 con 0x7f1d2406e580 2024-09-12T02:44:04.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.563+0000 7f1d23e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1d2415b880 0x7f1d24072470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:04.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.564+0000 7f1d23e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1d2415b880 0x7f1d24072470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50550/0 (socket says 172.21.15.112:50550) 2024-09-12T02:44:04.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.564+0000 7f1d23e00640 1 -- 172.21.15.112:0/1709297858 learned_addr learned my addr 172.21.15.112:0/1709297858 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:04.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.564+0000 7f1d28a00640 1 --2- 172.21.15.112:0/1709297858 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d2406e580 0x7f1d2406ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:04.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.564+0000 7f1d23e00640 1 -- 172.21.15.112:0/1709297858 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d2406e580 msgr2=0x7f1d2406ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:04.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.564+0000 7f1d23e00640 1 --2- 172.21.15.112:0/1709297858 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d2406e580 0x7f1d2406ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:04.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.564+0000 7f1d23e00640 1 -- 172.21.15.112:0/1709297858 >> v1:172.21.15.137:6789/0 conn(0x7f1d2415fdc0 legacy=0x7f1d240cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:04.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.564+0000 7f1d23e00640 1 -- 172.21.15.112:0/1709297858 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d240716b0 con 0x7f1d2415b880 2024-09-12T02:44:04.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.565+0000 7f1d23e00640 1 --2- 172.21.15.112:0/1709297858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d2415b880 0x7f1d24072470 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1d14009870 tx=0x7f1d1402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=642998963d1c8c58 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:04.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.565+0000 7f1d23400640 1 -- 172.21.15.112:0/1709297858 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d14037070 con 0x7f1d2415b880 2024-09-12T02:44:04.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.565+0000 7f1d23400640 1 -- 172.21.15.112:0/1709297858 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d14032440 con 0x7f1d2415b880 2024-09-12T02:44:04.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.565+0000 7f1d23400640 1 -- 172.21.15.112:0/1709297858 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d14032810 con 0x7f1d2415b880 2024-09-12T02:44:04.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.566+0000 7f1d29400640 1 -- 172.21.15.112:0/1709297858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d2415b880 msgr2=0x7f1d24072470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:04.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.566+0000 7f1d29400640 1 --2- 172.21.15.112:0/1709297858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d2415b880 0x7f1d24072470 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1d14009870 tx=0x7f1d1402a1c0 comp rx=0 tx=0).stop 2024-09-12T02:44:04.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.566+0000 7f1d29400640 1 -- 172.21.15.112:0/1709297858 shutdown_connections 2024-09-12T02:44:04.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.566+0000 7f1d29400640 1 --2- 172.21.15.112:0/1709297858 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d2406e580 0x7f1d2406ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:04.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.566+0000 7f1d29400640 1 --2- 172.21.15.112:0/1709297858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d2415b880 0x7f1d24072470 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:04.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.566+0000 7f1d29400640 1 -- 172.21.15.112:0/1709297858 >> 172.21.15.112:0/1709297858 conn(0x7f1d240b26c0 msgr2=0x7f1d240b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:04.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.566+0000 7f1d29400640 1 -- 172.21.15.112:0/1709297858 shutdown_connections 2024-09-12T02:44:04.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.566+0000 7f1d29400640 1 -- 172.21.15.112:0/1709297858 wait complete. 2024-09-12T02:44:04.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.568+0000 7f1d29400640 1 Processor -- start 2024-09-12T02:44:04.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.568+0000 7f1d29400640 1 -- start start 2024-09-12T02:44:04.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.569+0000 7f1d29400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d2406e580 0x7f1d240cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:04.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.569+0000 7f1d29400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d2415b880 0x7f1d241568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:04.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.569+0000 7f1d29400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d2415fdc0 0x7f1d241e5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:04.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.569+0000 7f1d29400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2415bc60 con 0x7f1d2415b880 2024-09-12T02:44:04.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.569+0000 7f1d29400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1d24071c70 con 0x7f1d2406e580 2024-09-12T02:44:04.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.569+0000 7f1d29400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1d240ced00 con 0x7f1d2415fdc0 2024-09-12T02:44:04.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.569+0000 7f1d1b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d2415b880 0x7f1d241568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:04.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.569+0000 7f1d1b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d2415b880 0x7f1d241568f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50564/0 (socket says 172.21.15.112:50564) 2024-09-12T02:44:04.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.569+0000 7f1d1b400640 1 -- 172.21.15.112:0/3123631345 learned_addr learned my addr 172.21.15.112:0/3123631345 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:04.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.569+0000 7f1d23e00640 1 --2- 172.21.15.112:0/3123631345 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d2406e580 0x7f1d240cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:04.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.569+0000 7f1d28a00640 1 --2- 172.21.15.112:0/3123631345 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d2415fdc0 0x7f1d241e5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:04.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.569+0000 7f1d1b400640 1 -- 172.21.15.112:0/3123631345 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d2415fdc0 msgr2=0x7f1d241e5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:04.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.569+0000 7f1d1b400640 1 --2- 172.21.15.112:0/3123631345 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d2415fdc0 0x7f1d241e5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:04.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.569+0000 7f1d1b400640 1 -- 172.21.15.112:0/3123631345 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d2406e580 msgr2=0x7f1d240cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:04.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.569+0000 7f1d1b400640 1 --2- 172.21.15.112:0/3123631345 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d2406e580 0x7f1d240cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:04.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.569+0000 7f1d1b400640 1 -- 172.21.15.112:0/3123631345 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d24156e30 con 0x7f1d2415b880 2024-09-12T02:44:04.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.570+0000 7f1d1b400640 1 --2- 172.21.15.112:0/3123631345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d2415b880 0x7f1d241568f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c00c440 tx=0x7f1d0c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:04.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.570+0000 7f1d20c00640 1 -- 172.21.15.112:0/3123631345 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c0052d0 con 0x7f1d2415b880 2024-09-12T02:44:04.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.570+0000 7f1d20c00640 1 -- 172.21.15.112:0/3123631345 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d0c005470 con 0x7f1d2415b880 2024-09-12T02:44:04.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.570+0000 7f1d20c00640 1 -- 172.21.15.112:0/3123631345 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c007260 con 0x7f1d2415b880 2024-09-12T02:44:04.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.570+0000 7f1d29400640 1 -- 172.21.15.112:0/3123631345 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d241e6410 con 0x7f1d2415b880 2024-09-12T02:44:04.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.570+0000 7f1d29400640 1 -- 172.21.15.112:0/3123631345 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d2415c6c0 con 0x7f1d2415b880 2024-09-12T02:44:04.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.571+0000 7f1d29400640 1 -- 172.21.15.112:0/3123631345 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d24072450 con 0x7f1d2415b880 2024-09-12T02:44:04.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.572+0000 7f1d20c00640 1 -- 172.21.15.112:0/3123631345 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1d0c007400 con 0x7f1d2415b880 2024-09-12T02:44:04.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.573+0000 7f1d20c00640 1 --2- 172.21.15.112:0/3123631345 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1d0006be60 0x7f1d0006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:04.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.573+0000 7f1d20c00640 1 -- 172.21.15.112:0/3123631345 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4857+0+0 (secure 0 0 0) 0x7f1d0c089fd0 con 0x7f1d2415b880 2024-09-12T02:44:04.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.573+0000 7f1d23e00640 1 --2- 172.21.15.112:0/3123631345 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1d0006be60 0x7f1d0006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:04.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.574+0000 7f1d23e00640 1 --2- 172.21.15.112:0/3123631345 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1d0006be60 0x7f1d0006e320 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1d14034000 tx=0x7f1d1402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:04.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.577+0000 7f1d20c00640 1 -- 172.21.15.112:0/3123631345 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1d0c058c30 con 0x7f1d2415b880 2024-09-12T02:44:04.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:04.754+0000 7f1d29400640 1 -- 172.21.15.112:0/3123631345 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f1d2415acd0 con 0x7f1d2415b880 2024-09-12T02:44:05.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.602+0000 7f1d20c00640 1 -- 172.21.15.112:0/3123631345 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v61) ==== 138+0+0 (secure 0 0 0) 0x7f1d0c058530 con 0x7f1d2415b880 2024-09-12T02:44:05.603 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' created 2024-09-12T02:44:05.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.605+0000 7f1d29400640 1 -- 172.21.15.112:0/3123631345 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1d0006be60 msgr2=0x7f1d0006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:05.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.605+0000 7f1d29400640 1 --2- 172.21.15.112:0/3123631345 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1d0006be60 0x7f1d0006e320 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1d14034000 tx=0x7f1d1402e000 comp rx=0 tx=0).stop 2024-09-12T02:44:05.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.605+0000 7f1d29400640 1 -- 172.21.15.112:0/3123631345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d2415b880 msgr2=0x7f1d241568f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:05.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.605+0000 7f1d29400640 1 --2- 172.21.15.112:0/3123631345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d2415b880 0x7f1d241568f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c00c440 tx=0x7f1d0c00c900 comp rx=0 tx=0).stop 2024-09-12T02:44:05.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.606+0000 7f1d29400640 1 -- 172.21.15.112:0/3123631345 shutdown_connections 2024-09-12T02:44:05.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.606+0000 7f1d29400640 1 --2- 172.21.15.112:0/3123631345 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d2415fdc0 0x7f1d241e5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:05.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.606+0000 7f1d29400640 1 --2- 172.21.15.112:0/3123631345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d2415b880 0x7f1d241568f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:05.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.606+0000 7f1d29400640 1 --2- 172.21.15.112:0/3123631345 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1d0006be60 0x7f1d0006e320 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:05.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.606+0000 7f1d29400640 1 --2- 172.21.15.112:0/3123631345 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d2406e580 0x7f1d240cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:05.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.606+0000 7f1d29400640 1 -- 172.21.15.112:0/3123631345 >> 172.21.15.112:0/3123631345 conn(0x7f1d240b26c0 msgr2=0x7f1d240b1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:05.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.606+0000 7f1d29400640 1 -- 172.21.15.112:0/3123631345 shutdown_connections 2024-09-12T02:44:05.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.606+0000 7f1d29400640 1 -- 172.21.15.112:0/3123631345 wait complete. 2024-09-12T02:44:05.626 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:44:05.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.786+0000 7f79b8a00640 1 Processor -- start 2024-09-12T02:44:05.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.786+0000 7f79b8a00640 1 -- start start 2024-09-12T02:44:05.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.788+0000 7f79b8a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f79b4145440 0x7f79b415fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:05.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.788+0000 7f79b8a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f79b4160260 0x7f79b40d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:05.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.788+0000 7f79b8a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79b415f540 con 0x7f79b4144d00 2024-09-12T02:44:05.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.788+0000 7f79b8a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f79b415c830 con 0x7f79b4145440 2024-09-12T02:44:05.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.788+0000 7f79b8a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f79b415cb10 con 0x7f79b4160260 2024-09-12T02:44:05.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.788+0000 7f79a9400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f79b4145440 0x7f79b415fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:05.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.788+0000 7f79a9400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f79b4145440 0x7f79b415fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50566/0 (socket says 172.21.15.112:50566) 2024-09-12T02:44:05.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.788+0000 7f79a9400640 1 -- 172.21.15.112:0/4280341356 learned_addr learned my addr 172.21.15.112:0/4280341356 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:05.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.788+0000 7f79b2800640 1 --2- 172.21.15.112:0/4280341356 >> v2:172.21.15.137:3300/0 conn(0x7f79b4160260 0x7f79b40d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:05.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.788+0000 7f79a9400640 1 -- 172.21.15.112:0/4280341356 >> v2:172.21.15.137:3300/0 conn(0x7f79b4160260 msgr2=0x7f79b40d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:05.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.788+0000 7f79a9400640 1 --2- 172.21.15.112:0/4280341356 >> v2:172.21.15.137:3300/0 conn(0x7f79b4160260 0x7f79b40d0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:05.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.788+0000 7f79a9400640 1 -- 172.21.15.112:0/4280341356 >> v1:172.21.15.137:6789/0 conn(0x7f79b4144d00 legacy=0x7f79b415bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:05.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.788+0000 7f79a9400640 1 -- 172.21.15.112:0/4280341356 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79b415cdf0 con 0x7f79b4145440 2024-09-12T02:44:05.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.788+0000 7f79b2800640 1 --2- 172.21.15.112:0/4280341356 >> v2:172.21.15.137:3300/0 conn(0x7f79b4160260 0x7f79b40d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:44:05.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.789+0000 7f79a9400640 1 --2- 172.21.15.112:0/4280341356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79b4145440 0x7f79b415fd20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f79b406de80 tx=0x7f799c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0eb02c56660fc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:05.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.790+0000 7f79b1400640 1 -- 172.21.15.112:0/4280341356 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c037070 con 0x7f79b4145440 2024-09-12T02:44:05.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.790+0000 7f79b1400640 1 -- 172.21.15.112:0/4280341356 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f799c032440 con 0x7f79b4145440 2024-09-12T02:44:05.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.790+0000 7f79b1400640 1 -- 172.21.15.112:0/4280341356 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c032810 con 0x7f79b4145440 2024-09-12T02:44:05.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.790+0000 7f79b8a00640 1 -- 172.21.15.112:0/4280341356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79b4145440 msgr2=0x7f79b415fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:05.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.790+0000 7f79b8a00640 1 --2- 172.21.15.112:0/4280341356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79b4145440 0x7f79b415fd20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f79b406de80 tx=0x7f799c02a1a0 comp rx=0 tx=0).stop 2024-09-12T02:44:05.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.790+0000 7f79b8a00640 1 -- 172.21.15.112:0/4280341356 shutdown_connections 2024-09-12T02:44:05.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.790+0000 7f79b8a00640 1 --2- 172.21.15.112:0/4280341356 >> v2:172.21.15.137:3300/0 conn(0x7f79b4160260 0x7f79b40d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:05.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.790+0000 7f79b8a00640 1 --2- 172.21.15.112:0/4280341356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79b4145440 0x7f79b415fd20 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:05.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.790+0000 7f79b8a00640 1 -- 172.21.15.112:0/4280341356 >> 172.21.15.112:0/4280341356 conn(0x7f79b40b28a0 msgr2=0x7f79b40b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:05.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.790+0000 7f79b8a00640 1 -- 172.21.15.112:0/4280341356 shutdown_connections 2024-09-12T02:44:05.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.790+0000 7f79b8a00640 1 -- 172.21.15.112:0/4280341356 wait complete. 2024-09-12T02:44:05.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.792+0000 7f79b8a00640 1 Processor -- start 2024-09-12T02:44:05.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.792+0000 7f79b8a00640 1 -- start start 2024-09-12T02:44:05.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.793+0000 7f79b8a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79b4144d00 0x7f79b4141c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:05.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.793+0000 7f79b8a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f79b4145440 0x7f79b413e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:05.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.793+0000 7f79b8a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79b4160260 0x7f79b413e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:05.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.793+0000 7f79b8a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f79b4145260 con 0x7f79b4144d00 2024-09-12T02:44:05.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.793+0000 7f79b8a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f79b41450e0 con 0x7f79b4160260 2024-09-12T02:44:05.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.793+0000 7f79b8a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f79b40d0ec0 con 0x7f79b4145440 2024-09-12T02:44:05.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.793+0000 7f79b1e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79b4144d00 0x7f79b4141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:05.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.793+0000 7f79b1e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79b4144d00 0x7f79b4141c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50570/0 (socket says 172.21.15.112:50570) 2024-09-12T02:44:05.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.793+0000 7f79b1e00640 1 -- 172.21.15.112:0/2480430457 learned_addr learned my addr 172.21.15.112:0/2480430457 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:05.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.794+0000 7f79b2800640 1 --2- 172.21.15.112:0/2480430457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79b4160260 0x7f79b413e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:05.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.794+0000 7f79a9400640 1 --2- 172.21.15.112:0/2480430457 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f79b4145440 0x7f79b413e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:05.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.794+0000 7f79b1e00640 1 -- 172.21.15.112:0/2480430457 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f79b4145440 msgr2=0x7f79b413e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:05.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.794+0000 7f79b1e00640 1 --2- 172.21.15.112:0/2480430457 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f79b4145440 0x7f79b413e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:05.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.794+0000 7f79b1e00640 1 -- 172.21.15.112:0/2480430457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79b4160260 msgr2=0x7f79b413e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:05.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.794+0000 7f79b1e00640 1 --2- 172.21.15.112:0/2480430457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79b4160260 0x7f79b413e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:05.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.794+0000 7f79b1e00640 1 -- 172.21.15.112:0/2480430457 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79b413c3f0 con 0x7f79b4144d00 2024-09-12T02:44:05.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.794+0000 7f79b2800640 1 --2- 172.21.15.112:0/2480430457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79b4160260 0x7f79b413e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:44:05.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.794+0000 7f79a9400640 1 --2- 172.21.15.112:0/2480430457 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f79b4145440 0x7f79b413e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:44:05.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.794+0000 7f79b1e00640 1 --2- 172.21.15.112:0/2480430457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79b4144d00 0x7f79b4141c70 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f79a400b3e0 tx=0x7f79a400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:05.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.794+0000 7f79aaa00640 1 -- 172.21.15.112:0/2480430457 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a4015020 con 0x7f79b4144d00 2024-09-12T02:44:05.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.794+0000 7f79aaa00640 1 -- 172.21.15.112:0/2480430457 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79a4011850 con 0x7f79b4144d00 2024-09-12T02:44:05.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.794+0000 7f79b8a00640 1 -- 172.21.15.112:0/2480430457 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79b413c6d0 con 0x7f79b4144d00 2024-09-12T02:44:05.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.794+0000 7f79aaa00640 1 -- 172.21.15.112:0/2480430457 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a4011c40 con 0x7f79b4144d00 2024-09-12T02:44:05.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.794+0000 7f79b8a00640 1 -- 172.21.15.112:0/2480430457 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79b413cc90 con 0x7f79b4144d00 2024-09-12T02:44:05.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.795+0000 7f79b8a00640 1 -- 172.21.15.112:0/2480430457 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79b40d1250 con 0x7f79b4144d00 2024-09-12T02:44:05.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.796+0000 7f79aaa00640 1 -- 172.21.15.112:0/2480430457 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f79a4018020 con 0x7f79b4144d00 2024-09-12T02:44:05.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.797+0000 7f79aaa00640 1 --2- 172.21.15.112:0/2480430457 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f799006be30 0x7f799006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:05.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.798+0000 7f79aaa00640 1 -- 172.21.15.112:0/2480430457 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5227+0+0 (secure 0 0 0) 0x7f79a408ab70 con 0x7f79b4144d00 2024-09-12T02:44:05.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.798+0000 7f79a9400640 1 --2- 172.21.15.112:0/2480430457 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f799006be30 0x7f799006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:05.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.798+0000 7f79a9400640 1 --2- 172.21.15.112:0/2480430457 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f799006be30 0x7f799006e2f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f799c034000 tx=0x7f799c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:05.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.803+0000 7f79aaa00640 1 -- 172.21.15.112:0/2480430457 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f79a401f020 con 0x7f79b4144d00 2024-09-12T02:44:05.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:05.978+0000 7f79b8a00640 1 -- 172.21.15.112:0/2480430457 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f79b40cfe40 con 0x7f79b4144d00 2024-09-12T02:44:06.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.605+0000 7f79aaa00640 1 -- 172.21.15.112:0/2480430457 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v62) ==== 170+0+0 (secure 0 0 0) 0x7f79a40172c0 con 0x7f79b4144d00 2024-09-12T02:44:06.606 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' created 2024-09-12T02:44:06.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.608+0000 7f79b8a00640 1 -- 172.21.15.112:0/2480430457 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f799006be30 msgr2=0x7f799006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:06.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.609+0000 7f79b8a00640 1 --2- 172.21.15.112:0/2480430457 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f799006be30 0x7f799006e2f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f799c034000 tx=0x7f799c02e000 comp rx=0 tx=0).stop 2024-09-12T02:44:06.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.609+0000 7f79b8a00640 1 -- 172.21.15.112:0/2480430457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79b4144d00 msgr2=0x7f79b4141c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:06.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.609+0000 7f79b8a00640 1 --2- 172.21.15.112:0/2480430457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79b4144d00 0x7f79b4141c70 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f79a400b3e0 tx=0x7f79a400b8a0 comp rx=0 tx=0).stop 2024-09-12T02:44:06.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.609+0000 7f79b8a00640 1 -- 172.21.15.112:0/2480430457 shutdown_connections 2024-09-12T02:44:06.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.609+0000 7f79b8a00640 1 --2- 172.21.15.112:0/2480430457 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f799006be30 0x7f799006e2f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:06.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.609+0000 7f79b8a00640 1 --2- 172.21.15.112:0/2480430457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79b4160260 0x7f79b413e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:06.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.609+0000 7f79b8a00640 1 --2- 172.21.15.112:0/2480430457 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f79b4145440 0x7f79b413e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:06.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.609+0000 7f79b8a00640 1 --2- 172.21.15.112:0/2480430457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79b4144d00 0x7f79b4141c70 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:06.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.609+0000 7f79b8a00640 1 -- 172.21.15.112:0/2480430457 >> 172.21.15.112:0/2480430457 conn(0x7f79b40b28a0 msgr2=0x7f79b4071650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:06.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.611+0000 7f79b8a00640 1 -- 172.21.15.112:0/2480430457 shutdown_connections 2024-09-12T02:44:06.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.612+0000 7f79b8a00640 1 -- 172.21.15.112:0/2480430457 wait complete. 2024-09-12T02:44:06.638 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T02:44:06.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.793+0000 7f23eac00640 1 Processor -- start 2024-09-12T02:44:06.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.793+0000 7f23eac00640 1 -- start start 2024-09-12T02:44:06.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.794+0000 7f23eac00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f23e40b3e00 0x7f23e40d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:06.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.794+0000 7f23eac00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f23e40b1d70 0x7f23e40b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:06.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.794+0000 7f23eac00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23e40d2fb0 con 0x7f23e40d1710 2024-09-12T02:44:06.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.794+0000 7f23eac00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f23e40d3cb0 con 0x7f23e40b3e00 2024-09-12T02:44:06.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.794+0000 7f23eac00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f23e40d0b60 con 0x7f23e40b1d70 2024-09-12T02:44:06.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.794+0000 7f23e8e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f23e40b3e00 0x7f23e40d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:06.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.794+0000 7f23e9800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f23e40d1710 0x7f23e40d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36348/0 (socket says 172.21.15.112:36348) 2024-09-12T02:44:06.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.794+0000 7f23e9800640 1 -- 172.21.15.112:0/2861484182 learned_addr learned my addr 172.21.15.112:0/2861484182 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:44:06.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.795+0000 7f23ea200640 1 --2- 172.21.15.112:0/2861484182 >> v2:172.21.15.137:3300/0 conn(0x7f23e40b1d70 0x7f23e40b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:06.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.795+0000 7f23e8e00640 1 -- 172.21.15.112:0/2861484182 >> v2:172.21.15.137:3300/0 conn(0x7f23e40b1d70 msgr2=0x7f23e40b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:06.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.795+0000 7f23e8e00640 1 --2- 172.21.15.112:0/2861484182 >> v2:172.21.15.137:3300/0 conn(0x7f23e40b1d70 0x7f23e40b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:06.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.795+0000 7f23e8e00640 1 -- 172.21.15.112:0/2861484182 >> v1:172.21.15.112:6789/0 conn(0x7f23e40d1710 legacy=0x7f23e40d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:06.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.795+0000 7f23e8e00640 1 -- 172.21.15.112:0/2861484182 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e40d3410 con 0x7f23e40b3e00 2024-09-12T02:44:06.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.795+0000 7f23ea200640 1 --2- 172.21.15.112:0/2861484182 >> v2:172.21.15.137:3300/0 conn(0x7f23e40b1d70 0x7f23e40b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:44:06.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.795+0000 7f23e3e00640 1 -- 172.21.15.112:0/2861484182 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3076408257 0 0) 0x7f23e40d2fb0 con 0x7f23e40d1710 2024-09-12T02:44:06.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.796+0000 7f23e8e00640 1 --2- 172.21.15.112:0/2861484182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23e40b3e00 0x7f23e40d28d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f23e408ef20 tx=0x7f23d002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c62c6e88082d23 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:06.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.796+0000 7f23e3e00640 1 -- 172.21.15.112:0/2861484182 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d0037070 con 0x7f23e40b3e00 2024-09-12T02:44:06.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.796+0000 7f23e3e00640 1 -- 172.21.15.112:0/2861484182 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d0032440 con 0x7f23e40b3e00 2024-09-12T02:44:06.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.796+0000 7f23e3e00640 1 -- 172.21.15.112:0/2861484182 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d0032810 con 0x7f23e40b3e00 2024-09-12T02:44:06.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.797+0000 7f23eac00640 1 -- 172.21.15.112:0/2861484182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23e40b3e00 msgr2=0x7f23e40d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:06.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.797+0000 7f23eac00640 1 --2- 172.21.15.112:0/2861484182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23e40b3e00 0x7f23e40d28d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f23e408ef20 tx=0x7f23d002a1a0 comp rx=0 tx=0).stop 2024-09-12T02:44:06.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.797+0000 7f23eac00640 1 -- 172.21.15.112:0/2861484182 shutdown_connections 2024-09-12T02:44:06.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.797+0000 7f23eac00640 1 --2- 172.21.15.112:0/2861484182 >> v2:172.21.15.137:3300/0 conn(0x7f23e40b1d70 0x7f23e40b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:06.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.797+0000 7f23eac00640 1 --2- 172.21.15.112:0/2861484182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23e40b3e00 0x7f23e40d28d0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:06.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.797+0000 7f23eac00640 1 -- 172.21.15.112:0/2861484182 >> 172.21.15.112:0/2861484182 conn(0x7f23e409e030 msgr2=0x7f23e40d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:06.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.797+0000 7f23eac00640 1 -- 172.21.15.112:0/2861484182 shutdown_connections 2024-09-12T02:44:06.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.797+0000 7f23eac00640 1 -- 172.21.15.112:0/2861484182 wait complete. 2024-09-12T02:44:06.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.798+0000 7f23eac00640 1 Processor -- start 2024-09-12T02:44:06.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.799+0000 7f23eac00640 1 -- start start 2024-09-12T02:44:06.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.799+0000 7f23eac00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23e40b1d70 0x7f23e40b9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:06.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.799+0000 7f23eac00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f23e40b3e00 0x7f23e4159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:06.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.799+0000 7f23eac00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23e40d1710 0x7f23e40b8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:06.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.799+0000 7f23eac00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f23e415f110 con 0x7f23e40d1710 2024-09-12T02:44:06.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.799+0000 7f23eac00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f23e40d39d0 con 0x7f23e40b1d70 2024-09-12T02:44:06.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.799+0000 7f23eac00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f23e415f290 con 0x7f23e40b3e00 2024-09-12T02:44:06.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.800+0000 7f23ea200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23e40d1710 0x7f23e40b8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:06.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.800+0000 7f23ea200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23e40d1710 0x7f23e40b8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50580/0 (socket says 172.21.15.112:50580) 2024-09-12T02:44:06.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.800+0000 7f23ea200640 1 -- 172.21.15.112:0/62889344 learned_addr learned my addr 172.21.15.112:0/62889344 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:06.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.800+0000 7f23ea200640 1 -- 172.21.15.112:0/62889344 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f23e40b3e00 msgr2=0x7f23e4159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:06.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.800+0000 7f23ea200640 1 --2- 172.21.15.112:0/62889344 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f23e40b3e00 0x7f23e4159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:06.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.800+0000 7f23ea200640 1 -- 172.21.15.112:0/62889344 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23e40b1d70 msgr2=0x7f23e40b9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:06.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.800+0000 7f23ea200640 1 --2- 172.21.15.112:0/62889344 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23e40b1d70 0x7f23e40b9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:06.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.800+0000 7f23ea200640 1 -- 172.21.15.112:0/62889344 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e4159b40 con 0x7f23e40d1710 2024-09-12T02:44:06.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.800+0000 7f23ea200640 1 --2- 172.21.15.112:0/62889344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23e40d1710 0x7f23e40b8540 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f23dc00cf20 tx=0x7f23dc00a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:06.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.801+0000 7f23e1600640 1 -- 172.21.15.112:0/62889344 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc01a070 con 0x7f23e40d1710 2024-09-12T02:44:06.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.801+0000 7f23e1600640 1 -- 172.21.15.112:0/62889344 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23dc00d840 con 0x7f23e40d1710 2024-09-12T02:44:06.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.801+0000 7f23e1600640 1 -- 172.21.15.112:0/62889344 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc00dc30 con 0x7f23e40d1710 2024-09-12T02:44:06.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.801+0000 7f23eac00640 1 -- 172.21.15.112:0/62889344 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e40cbdd0 con 0x7f23e40d1710 2024-09-12T02:44:06.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.801+0000 7f23eac00640 1 -- 172.21.15.112:0/62889344 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e40cc670 con 0x7f23e40d1710 2024-09-12T02:44:06.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.802+0000 7f23eac00640 1 -- 172.21.15.112:0/62889344 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23e40d28d0 con 0x7f23e40d1710 2024-09-12T02:44:06.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.803+0000 7f23e1600640 1 -- 172.21.15.112:0/62889344 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f23dc01d070 con 0x7f23e40d1710 2024-09-12T02:44:06.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.804+0000 7f23e1600640 1 --2- 172.21.15.112:0/62889344 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f23c406be60 0x7f23c406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:06.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.804+0000 7f23e1600640 1 -- 172.21.15.112:0/62889344 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5609+0+0 (secure 0 0 0) 0x7f23dc08b680 con 0x7f23e40d1710 2024-09-12T02:44:06.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.804+0000 7f23e9800640 1 --2- 172.21.15.112:0/62889344 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f23c406be60 0x7f23c406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:06.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.805+0000 7f23e9800640 1 --2- 172.21.15.112:0/62889344 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f23c406be60 0x7f23c406e320 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f23d8007fd0 tx=0x7f23d8007960 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:06.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:06.809+0000 7f23e1600640 1 -- 172.21.15.112:0/62889344 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f23dc05a080 con 0x7f23e40d1710 2024-09-12T02:44:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.015+0000 7f23eac00640 1 -- 172.21.15.112:0/62889344 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f23e40b61f0 con 0x7f23e40d1710 2024-09-12T02:44:07.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.637+0000 7f23e1600640 1 -- 172.21.15.112:0/62889344 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v32) ==== 172+0+0 (secure 0 0 0) 0x7f23dc059980 con 0x7f23e40d1710 2024-09-12T02:44:07.640 INFO:teuthology.orchestra.run.smithi112.stderr:new fs with metadata pool 8 and data pool 9 2024-09-12T02:44:07.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.646+0000 7f23eac00640 1 -- 172.21.15.112:0/62889344 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f23c406be60 msgr2=0x7f23c406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:07.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.646+0000 7f23eac00640 1 --2- 172.21.15.112:0/62889344 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f23c406be60 0x7f23c406e320 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f23d8007fd0 tx=0x7f23d8007960 comp rx=0 tx=0).stop 2024-09-12T02:44:07.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.646+0000 7f23eac00640 1 -- 172.21.15.112:0/62889344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23e40d1710 msgr2=0x7f23e40b8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:07.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.646+0000 7f23eac00640 1 --2- 172.21.15.112:0/62889344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23e40d1710 0x7f23e40b8540 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f23dc00cf20 tx=0x7f23dc00a7d0 comp rx=0 tx=0).stop 2024-09-12T02:44:07.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.646+0000 7f23eac00640 1 -- 172.21.15.112:0/62889344 shutdown_connections 2024-09-12T02:44:07.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.646+0000 7f23eac00640 1 --2- 172.21.15.112:0/62889344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23e40d1710 0x7f23e40b8540 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:07.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.646+0000 7f23eac00640 1 --2- 172.21.15.112:0/62889344 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f23e40b3e00 0x7f23e4159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:07.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.646+0000 7f23eac00640 1 --2- 172.21.15.112:0/62889344 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f23c406be60 0x7f23c406e320 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:07.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.646+0000 7f23eac00640 1 --2- 172.21.15.112:0/62889344 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23e40b1d70 0x7f23e40b9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:07.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.646+0000 7f23eac00640 1 -- 172.21.15.112:0/62889344 >> 172.21.15.112:0/62889344 conn(0x7f23e409e030 msgr2=0x7f23e406d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:07.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.647+0000 7f23eac00640 1 -- 172.21.15.112:0/62889344 shutdown_connections 2024-09-12T02:44:07.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.647+0000 7f23eac00640 1 -- 172.21.15.112:0/62889344 wait complete. 2024-09-12T02:44:07.670 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:44:07.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.824+0000 7ff43ee00640 1 Processor -- start 2024-09-12T02:44:07.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.824+0000 7ff43ee00640 1 -- start start 2024-09-12T02:44:07.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.826+0000 7ff43ee00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4380afe30 0x7ff4380cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:07.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.826+0000 7ff43ee00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4380ceeb0 con 0x7ff43815cc50 2024-09-12T02:44:07.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.826+0000 7ff43ee00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff43806e300 con 0x7ff438071530 2024-09-12T02:44:07.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.826+0000 7ff43ee00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff43815d030 con 0x7ff4380afe30 2024-09-12T02:44:07.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.826+0000 7ff437e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff43815cc50 0x7ff4380732f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36356/0 (socket says 172.21.15.112:36356) 2024-09-12T02:44:07.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.826+0000 7ff437e00640 1 -- 172.21.15.112:0/441030906 learned_addr learned my addr 172.21.15.112:0/441030906 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:44:07.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.826+0000 7ff43ce00640 1 --2- 172.21.15.112:0/441030906 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4380afe30 0x7ff4380cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:07.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.826+0000 7ff437400640 1 -- 172.21.15.112:0/441030906 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 62021768 0 0) 0x7ff4380ceeb0 con 0x7ff43815cc50 2024-09-12T02:44:07.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.826+0000 7ff437400640 1 -- 172.21.15.112:0/441030906 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff41c003520 con 0x7ff43815cc50 2024-09-12T02:44:07.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.827+0000 7ff437400640 1 -- 172.21.15.112:0/441030906 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4042533778 0 0) 0x7ff41c003520 con 0x7ff43815cc50 2024-09-12T02:44:07.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.827+0000 7ff437400640 1 -- 172.21.15.112:0/441030906 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4380afe30 msgr2=0x7ff4380cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:07.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.827+0000 7ff437400640 1 --2- 172.21.15.112:0/441030906 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4380afe30 0x7ff4380cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:07.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.827+0000 7ff437400640 1 -- 172.21.15.112:0/441030906 >> v1:172.21.15.137:6789/0 conn(0x7ff438071530 legacy=0x7ff4380af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:07.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.827+0000 7ff437400640 1 -- 172.21.15.112:0/441030906 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff43806e5e0 con 0x7ff43815cc50 2024-09-12T02:44:07.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.827+0000 7ff437400640 1 -- 172.21.15.112:0/441030906 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7ff428001670 con 0x7ff43815cc50 2024-09-12T02:44:07.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.827+0000 7ff437400640 1 -- 172.21.15.112:0/441030906 >> v1:172.21.15.112:6789/0 conn(0x7ff43815cc50 legacy=0x7ff4380732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:07.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.827+0000 7ff437400640 1 --2- 172.21.15.112:0/441030906 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff41c0039e0 0x7ff41c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:07.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.827+0000 7ff437400640 1 --2- 172.21.15.112:0/441030906 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4380afe30 0x7ff41c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:07.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.827+0000 7ff437400640 1 --2- 172.21.15.112:0/441030906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff41c004d40 0x7ff41c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:07.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.827+0000 7ff437400640 1 -- 172.21.15.112:0/441030906 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c00baf0 con 0x7ff41c0039e0 2024-09-12T02:44:07.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.827+0000 7ff437400640 1 -- 172.21.15.112:0/441030906 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c00bca0 con 0x7ff41c004d40 2024-09-12T02:44:07.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.827+0000 7ff437400640 1 -- 172.21.15.112:0/441030906 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff41c00bea0 con 0x7ff4380afe30 2024-09-12T02:44:07.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.827+0000 7ff437e00640 1 --2- 172.21.15.112:0/441030906 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff41c0039e0 0x7ff41c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:07.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.827+0000 7ff43ce00640 1 --2- 172.21.15.112:0/441030906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff41c004d40 0x7ff41c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:07.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.827+0000 7ff42f400640 1 --2- 172.21.15.112:0/441030906 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4380afe30 0x7ff41c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:07.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.827+0000 7ff437e00640 1 -- 172.21.15.112:0/441030906 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4380afe30 msgr2=0x7ff41c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:07.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.827+0000 7ff437e00640 1 --2- 172.21.15.112:0/441030906 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4380afe30 0x7ff41c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:07.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.827+0000 7ff437e00640 1 -- 172.21.15.112:0/441030906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff41c004d40 msgr2=0x7ff41c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:07.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.827+0000 7ff437e00640 1 --2- 172.21.15.112:0/441030906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff41c004d40 0x7ff41c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:07.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.827+0000 7ff437e00640 1 -- 172.21.15.112:0/441030906 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41c003520 con 0x7ff41c0039e0 2024-09-12T02:44:07.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.828+0000 7ff437e00640 1 --2- 172.21.15.112:0/441030906 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff41c0039e0 0x7ff41c003e00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff42800c240 tx=0x7ff41c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d7dc0cda02aa0e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:07.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.829+0000 7ff437400640 1 -- 172.21.15.112:0/441030906 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff428007cf0 con 0x7ff41c0039e0 2024-09-12T02:44:07.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.829+0000 7ff437400640 1 -- 172.21.15.112:0/441030906 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff428005af0 con 0x7ff41c0039e0 2024-09-12T02:44:07.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.829+0000 7ff437400640 1 -- 172.21.15.112:0/441030906 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff428007070 con 0x7ff41c0039e0 2024-09-12T02:44:07.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.829+0000 7ff43ee00640 1 -- 172.21.15.112:0/441030906 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff41c0039e0 msgr2=0x7ff41c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:07.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.829+0000 7ff43ee00640 1 --2- 172.21.15.112:0/441030906 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff41c0039e0 0x7ff41c003e00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff42800c240 tx=0x7ff41c005830 comp rx=0 tx=0).stop 2024-09-12T02:44:07.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.829+0000 7ff43ce00640 1 -- 172.21.15.112:0/441030906 reap_dead start 2024-09-12T02:44:07.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.829+0000 7ff43ee00640 1 -- 172.21.15.112:0/441030906 shutdown_connections 2024-09-12T02:44:07.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.829+0000 7ff43ee00640 1 -- 172.21.15.112:0/441030906 >> 172.21.15.112:0/441030906 conn(0x7ff43806bbd0 msgr2=0x7ff43806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:07.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.829+0000 7ff43ee00640 1 -- 172.21.15.112:0/441030906 shutdown_connections 2024-09-12T02:44:07.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.829+0000 7ff43ee00640 1 -- 172.21.15.112:0/441030906 wait complete. 2024-09-12T02:44:07.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.831+0000 7ff43ee00640 1 Processor -- start 2024-09-12T02:44:07.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.831+0000 7ff43ee00640 1 -- start start 2024-09-12T02:44:07.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.832+0000 7ff43ee00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff41c0039e0 0x7ff438146300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:07.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.832+0000 7ff43ee00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4380b39e0 0x7ff4380b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:07.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.832+0000 7ff43ee00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4380b43a0 0x7ff4381e73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:07.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.832+0000 7ff43ee00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff43806f510 con 0x7ff4380b43a0 2024-09-12T02:44:07.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.832+0000 7ff43ee00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff4380cf4c0 con 0x7ff41c0039e0 2024-09-12T02:44:07.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.832+0000 7ff43ee00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff43806f690 con 0x7ff4380b39e0 2024-09-12T02:44:07.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.832+0000 7ff43ce00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4380b43a0 0x7ff4381e73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:07.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.832+0000 7ff43ce00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4380b43a0 0x7ff4381e73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50586/0 (socket says 172.21.15.112:50586) 2024-09-12T02:44:07.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.832+0000 7ff43ce00640 1 -- 172.21.15.112:0/2154416216 learned_addr learned my addr 172.21.15.112:0/2154416216 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:07.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.832+0000 7ff437e00640 1 --2- 172.21.15.112:0/2154416216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff41c0039e0 0x7ff438146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:07.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.832+0000 7ff42f400640 1 --2- 172.21.15.112:0/2154416216 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4380b39e0 0x7ff4380b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:07.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.833+0000 7ff43ce00640 1 -- 172.21.15.112:0/2154416216 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4380b39e0 msgr2=0x7ff4380b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:07.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.833+0000 7ff43ce00640 1 --2- 172.21.15.112:0/2154416216 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4380b39e0 0x7ff4380b3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:07.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.833+0000 7ff43ce00640 1 -- 172.21.15.112:0/2154416216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff41c0039e0 msgr2=0x7ff438146300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:07.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.833+0000 7ff43ce00640 1 --2- 172.21.15.112:0/2154416216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff41c0039e0 0x7ff438146300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:07.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.833+0000 7ff43ce00640 1 -- 172.21.15.112:0/2154416216 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4380b4820 con 0x7ff4380b43a0 2024-09-12T02:44:07.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.833+0000 7ff43ce00640 1 --2- 172.21.15.112:0/2154416216 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4380b43a0 0x7ff4381e73d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff43806fff0 tx=0x7ff4300115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:07.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.833+0000 7ff434c00640 1 -- 172.21.15.112:0/2154416216 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff430011db0 con 0x7ff4380b43a0 2024-09-12T02:44:07.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.833+0000 7ff434c00640 1 -- 172.21.15.112:0/2154416216 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff43001b070 con 0x7ff4380b43a0 2024-09-12T02:44:07.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.833+0000 7ff434c00640 1 -- 172.21.15.112:0/2154416216 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff430003990 con 0x7ff4380b43a0 2024-09-12T02:44:07.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.833+0000 7ff43ee00640 1 -- 172.21.15.112:0/2154416216 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff438155250 con 0x7ff4380b43a0 2024-09-12T02:44:07.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.833+0000 7ff43ee00640 1 -- 172.21.15.112:0/2154416216 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4381e6bd0 con 0x7ff4380b43a0 2024-09-12T02:44:07.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.834+0000 7ff43ee00640 1 -- 172.21.15.112:0/2154416216 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff438068a30 con 0x7ff4380b43a0 2024-09-12T02:44:07.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.835+0000 7ff434c00640 1 -- 172.21.15.112:0/2154416216 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff430005d10 con 0x7ff4380b43a0 2024-09-12T02:44:07.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.837+0000 7ff434c00640 1 --2- 172.21.15.112:0/2154416216 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff41406be60 0x7ff41406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:07.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.837+0000 7ff434c00640 1 -- 172.21.15.112:0/2154416216 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7ff43008b0d0 con 0x7ff4380b43a0 2024-09-12T02:44:07.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.837+0000 7ff437e00640 1 --2- 172.21.15.112:0/2154416216 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff41406be60 0x7ff41406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:07.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.837+0000 7ff437e00640 1 --2- 172.21.15.112:0/2154416216 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff41406be60 0x7ff41406e320 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff428032000 tx=0x7ff428009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:07.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:07.841+0000 7ff434c00640 1 -- 172.21.15.112:0/2154416216 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff430059390 con 0x7ff4380b43a0 2024-09-12T02:44:08.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.016+0000 7ff43ee00640 1 -- 172.21.15.112:0/2154416216 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff4380b0f10 con 0x7ff4380b43a0 2024-09-12T02:44:08.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.017+0000 7ff434c00640 1 -- 172.21.15.112:0/2154416216 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+16786 (secure 0 0 0) 0x7ff43005d690 con 0x7ff4380b43a0 2024-09-12T02:44:08.018 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:44:08.018 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":63,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:44:07.016530+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:44:04.794578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-12T02:44:06.019611+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:44:08.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.019+0000 7ff43ee00640 1 -- 172.21.15.112:0/2154416216 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff41406be60 msgr2=0x7ff41406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:08.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.019+0000 7ff43ee00640 1 --2- 172.21.15.112:0/2154416216 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff41406be60 0x7ff41406e320 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff428032000 tx=0x7ff428009030 comp rx=0 tx=0).stop 2024-09-12T02:44:08.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.019+0000 7ff43ee00640 1 -- 172.21.15.112:0/2154416216 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4380b43a0 msgr2=0x7ff4381e73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:08.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.019+0000 7ff43ee00640 1 --2- 172.21.15.112:0/2154416216 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4380b43a0 0x7ff4381e73d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff43806fff0 tx=0x7ff4300115a0 comp rx=0 tx=0).stop 2024-09-12T02:44:08.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.019+0000 7ff43ee00640 1 -- 172.21.15.112:0/2154416216 shutdown_connections 2024-09-12T02:44:08.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.019+0000 7ff43ee00640 1 --2- 172.21.15.112:0/2154416216 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4380b43a0 0x7ff4381e73d0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:08.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.019+0000 7ff43ee00640 1 --2- 172.21.15.112:0/2154416216 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4380b39e0 0x7ff4380b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:08.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.019+0000 7ff43ee00640 1 --2- 172.21.15.112:0/2154416216 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff41406be60 0x7ff41406e320 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:08.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.019+0000 7ff43ee00640 1 --2- 172.21.15.112:0/2154416216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff41c0039e0 0x7ff438146300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:08.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.020+0000 7ff43ee00640 1 -- 172.21.15.112:0/2154416216 >> 172.21.15.112:0/2154416216 conn(0x7ff43806bbd0 msgr2=0x7ff4381594b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:08.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.020+0000 7ff43ee00640 1 -- 172.21.15.112:0/2154416216 shutdown_connections 2024-09-12T02:44:08.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.020+0000 7ff43ee00640 1 -- 172.21.15.112:0/2154416216 wait complete. 2024-09-12T02:44:08.037 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:44:08.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.190+0000 7fc25fc00640 1 Processor -- start 2024-09-12T02:44:08.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.190+0000 7fc25fc00640 1 -- start start 2024-09-12T02:44:08.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.191+0000 7fc25fc00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc258162100 0x7fc2580d58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:08.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.191+0000 7fc25fc00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc2581624e0 0x7fc2580b4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:08.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.191+0000 7fc25fc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2580d0510 0x7fc2580d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:08.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.191+0000 7fc25fc00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc2580cfa70 con 0x7fc2581624e0 2024-09-12T02:44:08.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.191+0000 7fc25fc00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc2580d21d0 con 0x7fc258162100 2024-09-12T02:44:08.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.191+0000 7fc25fc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc2580d24b0 con 0x7fc2580d0510 2024-09-12T02:44:08.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.192+0000 7fc24fe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc2581624e0 0x7fc2580b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:08.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.192+0000 7fc24fe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc2581624e0 0x7fc2580b4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50596/0 (socket says 172.21.15.112:50596) 2024-09-12T02:44:08.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.192+0000 7fc24fe00640 1 -- 172.21.15.112:0/1454929620 learned_addr learned my addr 172.21.15.112:0/1454929620 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:08.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.192+0000 7fc25dc00640 1 --2- 172.21.15.112:0/1454929620 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2580d0510 0x7fc2580d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:08.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.192+0000 7fc25d200640 1 --2- 172.21.15.112:0/1454929620 >> v2:172.21.15.137:3300/0 conn(0x7fc258162100 0x7fc2580d58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:08.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.192+0000 7fc24fe00640 1 -- 172.21.15.112:0/1454929620 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2580d0510 msgr2=0x7fc2580d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:08.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.192+0000 7fc24fe00640 1 --2- 172.21.15.112:0/1454929620 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2580d0510 0x7fc2580d0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:08.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.192+0000 7fc24fe00640 1 -- 172.21.15.112:0/1454929620 >> v2:172.21.15.137:3300/0 conn(0x7fc258162100 msgr2=0x7fc2580d58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:08.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.192+0000 7fc24fe00640 1 --2- 172.21.15.112:0/1454929620 >> v2:172.21.15.137:3300/0 conn(0x7fc258162100 0x7fc2580d58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:08.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.192+0000 7fc24fe00640 1 -- 172.21.15.112:0/1454929620 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2580cfd10 con 0x7fc2581624e0 2024-09-12T02:44:08.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.193+0000 7fc24fe00640 1 --2- 172.21.15.112:0/1454929620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2581624e0 0x7fc2580b4710 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc2580b7970 tx=0x7fc24002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b840b83060f8d9b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:08.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.193+0000 7fc257e00640 1 -- 172.21.15.112:0/1454929620 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc240037070 con 0x7fc2581624e0 2024-09-12T02:44:08.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.193+0000 7fc257e00640 1 -- 172.21.15.112:0/1454929620 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc240032440 con 0x7fc2581624e0 2024-09-12T02:44:08.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.193+0000 7fc257e00640 1 -- 172.21.15.112:0/1454929620 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc240032810 con 0x7fc2581624e0 2024-09-12T02:44:08.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.194+0000 7fc25fc00640 1 -- 172.21.15.112:0/1454929620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2581624e0 msgr2=0x7fc2580b4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:08.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.194+0000 7fc25fc00640 1 --2- 172.21.15.112:0/1454929620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2581624e0 0x7fc2580b4710 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc2580b7970 tx=0x7fc24002a140 comp rx=0 tx=0).stop 2024-09-12T02:44:08.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.194+0000 7fc25fc00640 1 -- 172.21.15.112:0/1454929620 shutdown_connections 2024-09-12T02:44:08.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.194+0000 7fc25fc00640 1 --2- 172.21.15.112:0/1454929620 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2580d0510 0x7fc2580d0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:08.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.194+0000 7fc25fc00640 1 --2- 172.21.15.112:0/1454929620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2581624e0 0x7fc2580b4710 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:08.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.194+0000 7fc25fc00640 1 --2- 172.21.15.112:0/1454929620 >> v2:172.21.15.137:3300/0 conn(0x7fc258162100 0x7fc2580d58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:08.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.194+0000 7fc25fc00640 1 -- 172.21.15.112:0/1454929620 >> 172.21.15.112:0/1454929620 conn(0x7fc2580d4db0 msgr2=0x7fc2580d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:08.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.194+0000 7fc25fc00640 1 -- 172.21.15.112:0/1454929620 shutdown_connections 2024-09-12T02:44:08.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.194+0000 7fc25fc00640 1 -- 172.21.15.112:0/1454929620 wait complete. 2024-09-12T02:44:08.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.195+0000 7fc25fc00640 1 Processor -- start 2024-09-12T02:44:08.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.196+0000 7fc25fc00640 1 -- start start 2024-09-12T02:44:08.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.196+0000 7fc25fc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2580d0510 0x7fc258157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:08.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.196+0000 7fc25fc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc258162100 0x7fc2580c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:08.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.196+0000 7fc25fc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2581624e0 0x7fc2580caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:08.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.196+0000 7fc25fc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc2580d1df0 con 0x7fc258162100 2024-09-12T02:44:08.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.197+0000 7fc25fc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc2580d0e60 con 0x7fc2581624e0 2024-09-12T02:44:08.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.197+0000 7fc25fc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc2580d1f70 con 0x7fc2580d0510 2024-09-12T02:44:08.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.197+0000 7fc24fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc258162100 0x7fc2580c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:08.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.197+0000 7fc24fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc258162100 0x7fc2580c9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50602/0 (socket says 172.21.15.112:50602) 2024-09-12T02:44:08.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.197+0000 7fc24fe00640 1 -- 172.21.15.112:0/1626859152 learned_addr learned my addr 172.21.15.112:0/1626859152 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:08.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.197+0000 7fc25d200640 1 --2- 172.21.15.112:0/1626859152 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2580d0510 0x7fc258157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:08.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.197+0000 7fc25dc00640 1 --2- 172.21.15.112:0/1626859152 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2581624e0 0x7fc2580caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:08.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.197+0000 7fc24fe00640 1 -- 172.21.15.112:0/1626859152 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2580d0510 msgr2=0x7fc258157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:08.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.197+0000 7fc24fe00640 1 --2- 172.21.15.112:0/1626859152 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2580d0510 0x7fc258157fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:08.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.197+0000 7fc24fe00640 1 -- 172.21.15.112:0/1626859152 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2581624e0 msgr2=0x7fc2580caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:08.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.197+0000 7fc24fe00640 1 --2- 172.21.15.112:0/1626859152 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2581624e0 0x7fc2580caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:08.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.197+0000 7fc24fe00640 1 -- 172.21.15.112:0/1626859152 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2580b6600 con 0x7fc258162100 2024-09-12T02:44:08.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.197+0000 7fc24fe00640 1 --2- 172.21.15.112:0/1626859152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc258162100 0x7fc2580c9160 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc240000c00 tx=0x7fc2400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:08.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.198+0000 7fc255600640 1 -- 172.21.15.112:0/1626859152 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc240041020 con 0x7fc258162100 2024-09-12T02:44:08.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.198+0000 7fc255600640 1 -- 172.21.15.112:0/1626859152 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc24003d620 con 0x7fc258162100 2024-09-12T02:44:08.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.198+0000 7fc25fc00640 1 -- 172.21.15.112:0/1626859152 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2580b68e0 con 0x7fc258162100 2024-09-12T02:44:08.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.198+0000 7fc255600640 1 -- 172.21.15.112:0/1626859152 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc240037040 con 0x7fc258162100 2024-09-12T02:44:08.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.198+0000 7fc25fc00640 1 -- 172.21.15.112:0/1626859152 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2580b6ea0 con 0x7fc258162100 2024-09-12T02:44:08.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.199+0000 7fc25fc00640 1 -- 172.21.15.112:0/1626859152 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc258162b80 con 0x7fc258162100 2024-09-12T02:44:08.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.200+0000 7fc255600640 1 -- 172.21.15.112:0/1626859152 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc240044020 con 0x7fc258162100 2024-09-12T02:44:08.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.201+0000 7fc255600640 1 --2- 172.21.15.112:0/1626859152 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc23406be60 0x7fc23406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:08.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.201+0000 7fc255600640 1 -- 172.21.15.112:0/1626859152 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7fc2400ab380 con 0x7fc258162100 2024-09-12T02:44:08.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.202+0000 7fc25d200640 1 --2- 172.21.15.112:0/1626859152 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc23406be60 0x7fc23406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:08.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.202+0000 7fc25d200640 1 --2- 172.21.15.112:0/1626859152 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc23406be60 0x7fc23406e320 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc2580b8000 tx=0x7fc248009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:08.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.206+0000 7fc255600640 1 -- 172.21.15.112:0/1626859152 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc24004b030 con 0x7fc258162100 2024-09-12T02:44:08.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.378+0000 7fc25fc00640 1 -- 172.21.15.112:0/1626859152 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc258068de0 con 0x7fc258162100 2024-09-12T02:44:08.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.380+0000 7fc255600640 1 -- 172.21.15.112:0/1626859152 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+16786 (secure 0 0 0) 0x7fc2400796d0 con 0x7fc258162100 2024-09-12T02:44:08.381 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:44:08.381 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":63,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:44:07.016530+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:44:04.794578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-12T02:44:06.019611+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:44:08.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.382+0000 7fc25fc00640 1 -- 172.21.15.112:0/1626859152 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc23406be60 msgr2=0x7fc23406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:08.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.382+0000 7fc25fc00640 1 --2- 172.21.15.112:0/1626859152 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc23406be60 0x7fc23406e320 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc2580b8000 tx=0x7fc248009190 comp rx=0 tx=0).stop 2024-09-12T02:44:08.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.382+0000 7fc25fc00640 1 -- 172.21.15.112:0/1626859152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc258162100 msgr2=0x7fc2580c9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:08.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.382+0000 7fc25fc00640 1 --2- 172.21.15.112:0/1626859152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc258162100 0x7fc2580c9160 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc240000c00 tx=0x7fc2400046c0 comp rx=0 tx=0).stop 2024-09-12T02:44:08.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.382+0000 7fc25fc00640 1 -- 172.21.15.112:0/1626859152 shutdown_connections 2024-09-12T02:44:08.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.382+0000 7fc25fc00640 1 --2- 172.21.15.112:0/1626859152 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc23406be60 0x7fc23406e320 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:08.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.382+0000 7fc25fc00640 1 --2- 172.21.15.112:0/1626859152 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2581624e0 0x7fc2580caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:08.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.382+0000 7fc25fc00640 1 --2- 172.21.15.112:0/1626859152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc258162100 0x7fc2580c9160 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:08.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.382+0000 7fc25fc00640 1 --2- 172.21.15.112:0/1626859152 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2580d0510 0x7fc258157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:08.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.382+0000 7fc25fc00640 1 -- 172.21.15.112:0/1626859152 >> 172.21.15.112:0/1626859152 conn(0x7fc2580d4db0 msgr2=0x7fc2580b2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:08.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.382+0000 7fc25fc00640 1 -- 172.21.15.112:0/1626859152 shutdown_connections 2024-09-12T02:44:08.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.382+0000 7fc25fc00640 1 -- 172.21.15.112:0/1626859152 wait complete. 2024-09-12T02:44:08.399 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T02:44:08.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.554+0000 7f79faa00640 1 Processor -- start 2024-09-12T02:44:08.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.554+0000 7f79faa00640 1 -- start start 2024-09-12T02:44:08.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.556+0000 7f79faa00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f79f406f600 0x7f79f40b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:08.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.556+0000 7f79faa00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79f40b4a20 con 0x7f79f40b45d0 2024-09-12T02:44:08.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.556+0000 7f79faa00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79f40b54a0 con 0x7f79f415b9d0 2024-09-12T02:44:08.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.556+0000 7f79faa00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f79f40b3af0 con 0x7f79f406f600 2024-09-12T02:44:08.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.556+0000 7f79f8a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f79f40b45d0 0x7f79f40cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36372/0 (socket says 172.21.15.112:36372) 2024-09-12T02:44:08.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.556+0000 7f79f8a00640 1 -- 172.21.15.112:0/1900362120 learned_addr learned my addr 172.21.15.112:0/1900362120 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:44:08.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.556+0000 7f79f3400640 1 --2- 172.21.15.112:0/1900362120 >> v2:172.21.15.137:3300/0 conn(0x7f79f406f600 0x7f79f40b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:08.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.556+0000 7f79f2a00640 1 -- 172.21.15.112:0/1900362120 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2456181104 0 0) 0x7f79f40b4a20 con 0x7f79f40b45d0 2024-09-12T02:44:08.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.556+0000 7f79f2a00640 1 -- 172.21.15.112:0/1900362120 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79d8003520 con 0x7f79f40b45d0 2024-09-12T02:44:08.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.557+0000 7f79f3400640 1 -- 172.21.15.112:0/1900362120 >> v1:172.21.15.137:6789/0 conn(0x7f79f415b9d0 legacy=0x7f79f406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:08.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.557+0000 7f79f3400640 1 -- 172.21.15.112:0/1900362120 >> v1:172.21.15.112:6789/0 conn(0x7f79f40b45d0 legacy=0x7f79f40cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:08.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.557+0000 7f79f2a00640 1 -- 172.21.15.112:0/1900362120 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3463198030 0 0) 0x7f79f40b54a0 con 0x7f79f415b9d0 2024-09-12T02:44:08.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.557+0000 7f79f3400640 1 -- 172.21.15.112:0/1900362120 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79f40b3dd0 con 0x7f79f406f600 2024-09-12T02:44:08.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.558+0000 7f79f3400640 1 --2- 172.21.15.112:0/1900362120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79f406f600 0x7f79f40b4ec0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f79e0009790 tx=0x7f79e002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60b57cef53661587 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:08.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.558+0000 7f79f2a00640 1 -- 172.21.15.112:0/1900362120 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e0037070 con 0x7f79f406f600 2024-09-12T02:44:08.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.558+0000 7f79f2a00640 1 -- 172.21.15.112:0/1900362120 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79e002ab90 con 0x7f79f406f600 2024-09-12T02:44:08.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.558+0000 7f79f2a00640 1 -- 172.21.15.112:0/1900362120 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec0019f0 con 0x7f79f406f600 2024-09-12T02:44:08.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.559+0000 7f79faa00640 1 -- 172.21.15.112:0/1900362120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79f406f600 msgr2=0x7f79f40b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:08.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.559+0000 7f79faa00640 1 --2- 172.21.15.112:0/1900362120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79f406f600 0x7f79f40b4ec0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f79e0009790 tx=0x7f79e002a100 comp rx=0 tx=0).stop 2024-09-12T02:44:08.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.559+0000 7f79faa00640 1 -- 172.21.15.112:0/1900362120 shutdown_connections 2024-09-12T02:44:08.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.559+0000 7f79faa00640 1 --2- 172.21.15.112:0/1900362120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79f406f600 0x7f79f40b4ec0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:08.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.559+0000 7f79faa00640 1 -- 172.21.15.112:0/1900362120 >> 172.21.15.112:0/1900362120 conn(0x7f79f406bbd0 msgr2=0x7f79f406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:08.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.559+0000 7f79faa00640 1 -- 172.21.15.112:0/1900362120 shutdown_connections 2024-09-12T02:44:08.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.559+0000 7f79faa00640 1 -- 172.21.15.112:0/1900362120 wait complete. 2024-09-12T02:44:08.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.560+0000 7f79faa00640 1 Processor -- start 2024-09-12T02:44:08.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.561+0000 7f79faa00640 1 -- start start 2024-09-12T02:44:08.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.561+0000 7f79faa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f79f406f600 0x7f79f41561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:08.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.561+0000 7f79faa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79f40b45d0 0x7f79f4157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:08.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.562+0000 7f79faa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79f415b9d0 0x7f79f4149030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:08.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.562+0000 7f79faa00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f79f415bf30 con 0x7f79f40b45d0 2024-09-12T02:44:08.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.562+0000 7f79faa00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f79f415bdb0 con 0x7f79f415b9d0 2024-09-12T02:44:08.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.562+0000 7f79faa00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f79f40728c0 con 0x7f79f406f600 2024-09-12T02:44:08.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.562+0000 7f79f3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79f40b45d0 0x7f79f4157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:08.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.562+0000 7f79f3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79f40b45d0 0x7f79f4157b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50616/0 (socket says 172.21.15.112:50616) 2024-09-12T02:44:08.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.562+0000 7f79f3400640 1 -- 172.21.15.112:0/2987926906 learned_addr learned my addr 172.21.15.112:0/2987926906 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:08.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.562+0000 7f79f3e00640 1 --2- 172.21.15.112:0/2987926906 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f79f406f600 0x7f79f41561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:08.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.562+0000 7f79f8a00640 1 --2- 172.21.15.112:0/2987926906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79f415b9d0 0x7f79f4149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:08.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.562+0000 7f79f3400640 1 -- 172.21.15.112:0/2987926906 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f79f406f600 msgr2=0x7f79f41561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:08.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.562+0000 7f79f3400640 1 --2- 172.21.15.112:0/2987926906 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f79f406f600 0x7f79f41561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:08.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.562+0000 7f79f3400640 1 -- 172.21.15.112:0/2987926906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79f415b9d0 msgr2=0x7f79f4149030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:08.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.562+0000 7f79f3400640 1 --2- 172.21.15.112:0/2987926906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79f415b9d0 0x7f79f4149030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:08.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.562+0000 7f79f3400640 1 -- 172.21.15.112:0/2987926906 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79f4156ad0 con 0x7f79f40b45d0 2024-09-12T02:44:08.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.562+0000 7f79f8a00640 1 --2- 172.21.15.112:0/2987926906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79f415b9d0 0x7f79f4149030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:44:08.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.563+0000 7f79f3400640 1 --2- 172.21.15.112:0/2987926906 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79f40b45d0 0x7f79f4157b70 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f79e0035040 tx=0x7f79e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:08.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.563+0000 7f79ebe00640 1 -- 172.21.15.112:0/2987926906 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e0037040 con 0x7f79f40b45d0 2024-09-12T02:44:08.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.563+0000 7f79ebe00640 1 -- 172.21.15.112:0/2987926906 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79e0004070 con 0x7f79f40b45d0 2024-09-12T02:44:08.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.563+0000 7f79ebe00640 1 -- 172.21.15.112:0/2987926906 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e0004460 con 0x7f79f40b45d0 2024-09-12T02:44:08.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.563+0000 7f79faa00640 1 -- 172.21.15.112:0/2987926906 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79f4156db0 con 0x7f79f40b45d0 2024-09-12T02:44:08.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.563+0000 7f79faa00640 1 -- 172.21.15.112:0/2987926906 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79f4157370 con 0x7f79f40b45d0 2024-09-12T02:44:08.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.564+0000 7f79faa00640 1 -- 172.21.15.112:0/2987926906 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79f4068a30 con 0x7f79f40b45d0 2024-09-12T02:44:08.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.565+0000 7f79ebe00640 1 -- 172.21.15.112:0/2987926906 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f79e003a040 con 0x7f79f40b45d0 2024-09-12T02:44:08.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.566+0000 7f79ebe00640 1 --2- 172.21.15.112:0/2987926906 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f79d406be30 0x7f79d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:08.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.566+0000 7f79ebe00640 1 -- 172.21.15.112:0/2987926906 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7f79e00ab530 con 0x7f79f40b45d0 2024-09-12T02:44:08.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.566+0000 7f79f3e00640 1 --2- 172.21.15.112:0/2987926906 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f79d406be30 0x7f79d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:08.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.566+0000 7f79f3e00640 1 --2- 172.21.15.112:0/2987926906 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f79d406be30 0x7f79d406e2f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f79e4000f60 tx=0x7f79e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:08.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.570+0000 7f79ebe00640 1 -- 172.21.15.112:0/2987926906 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f79e0079f60 con 0x7f79f40b45d0 2024-09-12T02:44:08.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:08.781+0000 7f79faa00640 1 -- 172.21.15.112:0/2987926906 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f79f406ed40 con 0x7f79f40b45d0 2024-09-12T02:44:09.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.653+0000 7f79ebe00640 1 -- 172.21.15.112:0/2987926906 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v35) ==== 118+0+0 (secure 0 0 0) 0x7f79e0079860 con 0x7f79f40b45d0 2024-09-12T02:44:09.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.656+0000 7f79faa00640 1 -- 172.21.15.112:0/2987926906 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f79d406be30 msgr2=0x7f79d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:09.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.656+0000 7f79faa00640 1 --2- 172.21.15.112:0/2987926906 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f79d406be30 0x7f79d406e2f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f79e4000f60 tx=0x7f79e4009040 comp rx=0 tx=0).stop 2024-09-12T02:44:09.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.656+0000 7f79faa00640 1 -- 172.21.15.112:0/2987926906 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79f40b45d0 msgr2=0x7f79f4157b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:09.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.656+0000 7f79faa00640 1 --2- 172.21.15.112:0/2987926906 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79f40b45d0 0x7f79f4157b70 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f79e0035040 tx=0x7f79e00046c0 comp rx=0 tx=0).stop 2024-09-12T02:44:09.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.656+0000 7f79faa00640 1 -- 172.21.15.112:0/2987926906 shutdown_connections 2024-09-12T02:44:09.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.656+0000 7f79faa00640 1 --2- 172.21.15.112:0/2987926906 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f79d406be30 0x7f79d406e2f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:09.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.656+0000 7f79faa00640 1 --2- 172.21.15.112:0/2987926906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79f415b9d0 0x7f79f4149030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:09.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.656+0000 7f79faa00640 1 --2- 172.21.15.112:0/2987926906 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79f40b45d0 0x7f79f4157b70 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:09.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.656+0000 7f79faa00640 1 --2- 172.21.15.112:0/2987926906 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f79f406f600 0x7f79f41561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:09.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.656+0000 7f79faa00640 1 -- 172.21.15.112:0/2987926906 >> 172.21.15.112:0/2987926906 conn(0x7f79f406bbd0 msgr2=0x7f79f4154550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:09.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.656+0000 7f79faa00640 1 -- 172.21.15.112:0/2987926906 shutdown_connections 2024-09-12T02:44:09.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.656+0000 7f79faa00640 1 -- 172.21.15.112:0/2987926906 wait complete. 2024-09-12T02:44:09.676 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T02:44:09.676 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T02:44:09.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.834+0000 7fe90a400640 1 Processor -- start 2024-09-12T02:44:09.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.834+0000 7fe90a400640 1 -- start start 2024-09-12T02:44:09.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.835+0000 7fe90a400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe90415b9d0 0x7fe9040b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:09.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.836+0000 7fe90a400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9040b54a0 con 0x7fe9040b45d0 2024-09-12T02:44:09.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.836+0000 7fe90a400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9040b3af0 con 0x7fe90406f600 2024-09-12T02:44:09.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.836+0000 7fe90a400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe9040b4a60 con 0x7fe90415b9d0 2024-09-12T02:44:09.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.836+0000 7fe8faa00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe9040b45d0 0x7fe90406eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36382/0 (socket says 172.21.15.112:36382) 2024-09-12T02:44:09.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.836+0000 7fe8faa00640 1 -- 172.21.15.112:0/2713470342 learned_addr learned my addr 172.21.15.112:0/2713470342 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:44:09.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.836+0000 7fe903400640 1 --2- 172.21.15.112:0/2713470342 >> v2:172.21.15.137:3300/0 conn(0x7fe90415b9d0 0x7fe9040b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:09.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.836+0000 7fe902a00640 1 -- 172.21.15.112:0/2713470342 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2500201226 0 0) 0x7fe9040b54a0 con 0x7fe9040b45d0 2024-09-12T02:44:09.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.836+0000 7fe902a00640 1 -- 172.21.15.112:0/2713470342 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8e8005730 con 0x7fe9040b45d0 2024-09-12T02:44:09.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.837+0000 7fe903400640 1 -- 172.21.15.112:0/2713470342 >> v1:172.21.15.137:6789/0 conn(0x7fe90406f600 legacy=0x7fe9040cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:09.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.837+0000 7fe903400640 1 -- 172.21.15.112:0/2713470342 >> v1:172.21.15.112:6789/0 conn(0x7fe9040b45d0 legacy=0x7fe90406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:09.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.837+0000 7fe903400640 1 -- 172.21.15.112:0/2713470342 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9040b3dd0 con 0x7fe90415b9d0 2024-09-12T02:44:09.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.838+0000 7fe903400640 1 --2- 172.21.15.112:0/2713470342 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe90415b9d0 0x7fe9040b4ec0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe8f40097a0 tx=0x7fe8f402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48909f317b45a9d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:09.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.838+0000 7fe902a00640 1 -- 172.21.15.112:0/2713470342 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f4037070 con 0x7fe90415b9d0 2024-09-12T02:44:09.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.838+0000 7fe902a00640 1 -- 172.21.15.112:0/2713470342 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8f4032440 con 0x7fe90415b9d0 2024-09-12T02:44:09.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.838+0000 7fe902a00640 1 -- 172.21.15.112:0/2713470342 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f4032810 con 0x7fe90415b9d0 2024-09-12T02:44:09.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.839+0000 7fe90a400640 1 -- 172.21.15.112:0/2713470342 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe90415b9d0 msgr2=0x7fe9040b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:09.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.839+0000 7fe90a400640 1 --2- 172.21.15.112:0/2713470342 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe90415b9d0 0x7fe9040b4ec0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe8f40097a0 tx=0x7fe8f402a1a0 comp rx=0 tx=0).stop 2024-09-12T02:44:09.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.839+0000 7fe90a400640 1 -- 172.21.15.112:0/2713470342 shutdown_connections 2024-09-12T02:44:09.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.839+0000 7fe90a400640 1 --2- 172.21.15.112:0/2713470342 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe90415b9d0 0x7fe9040b4ec0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:09.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.839+0000 7fe90a400640 1 -- 172.21.15.112:0/2713470342 >> 172.21.15.112:0/2713470342 conn(0x7fe90406bbd0 msgr2=0x7fe90406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:09.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.839+0000 7fe90a400640 1 -- 172.21.15.112:0/2713470342 shutdown_connections 2024-09-12T02:44:09.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.839+0000 7fe90a400640 1 -- 172.21.15.112:0/2713470342 wait complete. 2024-09-12T02:44:09.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.841+0000 7fe90a400640 1 Processor -- start 2024-09-12T02:44:09.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.841+0000 7fe90a400640 1 -- start start 2024-09-12T02:44:09.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.842+0000 7fe90a400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe90406f600 0x7fe9041597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:09.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.842+0000 7fe90a400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9040b45d0 0x7fe904156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:09.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.842+0000 7fe90a400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe90415b9d0 0x7fe9040ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:09.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.842+0000 7fe90a400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe90415bf30 con 0x7fe9040b45d0 2024-09-12T02:44:09.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.842+0000 7fe90a400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe90415bdb0 con 0x7fe90406f600 2024-09-12T02:44:09.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.842+0000 7fe90a400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe9040728c0 con 0x7fe90415b9d0 2024-09-12T02:44:09.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.842+0000 7fe8faa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9040b45d0 0x7fe904156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:09.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.842+0000 7fe8faa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9040b45d0 0x7fe904156700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50632/0 (socket says 172.21.15.112:50632) 2024-09-12T02:44:09.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.842+0000 7fe8faa00640 1 -- 172.21.15.112:0/1025474518 learned_addr learned my addr 172.21.15.112:0/1025474518 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:09.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.842+0000 7fe903400640 1 --2- 172.21.15.112:0/1025474518 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe90406f600 0x7fe9041597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:09.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.842+0000 7fe903e00640 1 --2- 172.21.15.112:0/1025474518 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe90415b9d0 0x7fe9040ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:09.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.842+0000 7fe8faa00640 1 -- 172.21.15.112:0/1025474518 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe90415b9d0 msgr2=0x7fe9040ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:09.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.842+0000 7fe8faa00640 1 --2- 172.21.15.112:0/1025474518 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe90415b9d0 0x7fe9040ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:09.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.842+0000 7fe8faa00640 1 -- 172.21.15.112:0/1025474518 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe90406f600 msgr2=0x7fe9041597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:09.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.842+0000 7fe8faa00640 1 --2- 172.21.15.112:0/1025474518 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe90406f600 0x7fe9041597a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:09.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.842+0000 7fe8faa00640 1 -- 172.21.15.112:0/1025474518 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe904159ce0 con 0x7fe9040b45d0 2024-09-12T02:44:09.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.843+0000 7fe8faa00640 1 --2- 172.21.15.112:0/1025474518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9040b45d0 0x7fe904156700 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec00c4d0 tx=0x7fe8ec00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:09.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.843+0000 7fe8fbe00640 1 -- 172.21.15.112:0/1025474518 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec017070 con 0x7fe9040b45d0 2024-09-12T02:44:09.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.843+0000 7fe8fbe00640 1 -- 172.21.15.112:0/1025474518 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8ec005ce0 con 0x7fe9040b45d0 2024-09-12T02:44:09.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.843+0000 7fe90a400640 1 -- 172.21.15.112:0/1025474518 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9041f54e0 con 0x7fe9040b45d0 2024-09-12T02:44:09.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.843+0000 7fe8fbe00640 1 -- 172.21.15.112:0/1025474518 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec007290 con 0x7fe9040b45d0 2024-09-12T02:44:09.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.843+0000 7fe90a400640 1 -- 172.21.15.112:0/1025474518 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9041f5a80 con 0x7fe9040b45d0 2024-09-12T02:44:09.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.844+0000 7fe90a400640 1 -- 172.21.15.112:0/1025474518 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe904068a30 con 0x7fe9040b45d0 2024-09-12T02:44:09.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.845+0000 7fe8fbe00640 1 -- 172.21.15.112:0/1025474518 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe8ec01a070 con 0x7fe9040b45d0 2024-09-12T02:44:09.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.846+0000 7fe8fbe00640 1 --2- 172.21.15.112:0/1025474518 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe8e006be30 0x7fe8e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:09.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.846+0000 7fe8fbe00640 1 -- 172.21.15.112:0/1025474518 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5709+0+0 (secure 0 0 0) 0x7fe8ec08a280 con 0x7fe9040b45d0 2024-09-12T02:44:09.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.846+0000 7fe903400640 1 --2- 172.21.15.112:0/1025474518 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe8e006be30 0x7fe8e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:09.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.847+0000 7fe903400640 1 --2- 172.21.15.112:0/1025474518 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe8e006be30 0x7fe8e006e2f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4034000 tx=0x7fe8f402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:09.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:09.851+0000 7fe8fbe00640 1 -- 172.21.15.112:0/1025474518 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe8ec058540 con 0x7fe9040b45d0 2024-09-12T02:44:10.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.057+0000 7fe90a400640 1 -- 172.21.15.112:0/1025474518 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fe904069100 con 0x7fe9040b45d0 2024-09-12T02:44:10.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.656+0000 7fe8fbe00640 1 -- 172.21.15.112:0/1025474518 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7fe8ec05c840 con 0x7fe9040b45d0 2024-09-12T02:44:10.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.658+0000 7fe90a400640 1 -- 172.21.15.112:0/1025474518 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe8e006be30 msgr2=0x7fe8e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:10.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.658+0000 7fe90a400640 1 --2- 172.21.15.112:0/1025474518 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe8e006be30 0x7fe8e006e2f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4034000 tx=0x7fe8f402e000 comp rx=0 tx=0).stop 2024-09-12T02:44:10.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.658+0000 7fe90a400640 1 -- 172.21.15.112:0/1025474518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9040b45d0 msgr2=0x7fe904156700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:10.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.658+0000 7fe90a400640 1 --2- 172.21.15.112:0/1025474518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9040b45d0 0x7fe904156700 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec00c4d0 tx=0x7fe8ec00c990 comp rx=0 tx=0).stop 2024-09-12T02:44:10.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.658+0000 7fe90a400640 1 -- 172.21.15.112:0/1025474518 shutdown_connections 2024-09-12T02:44:10.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.658+0000 7fe90a400640 1 --2- 172.21.15.112:0/1025474518 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe90415b9d0 0x7fe9040ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:10.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.658+0000 7fe90a400640 1 --2- 172.21.15.112:0/1025474518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9040b45d0 0x7fe904156700 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:10.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.658+0000 7fe90a400640 1 --2- 172.21.15.112:0/1025474518 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe8e006be30 0x7fe8e006e2f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:10.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.658+0000 7fe90a400640 1 --2- 172.21.15.112:0/1025474518 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe90406f600 0x7fe9041597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:10.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.658+0000 7fe90a400640 1 -- 172.21.15.112:0/1025474518 >> 172.21.15.112:0/1025474518 conn(0x7fe90406bbd0 msgr2=0x7fe9040d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:10.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.659+0000 7fe90a400640 1 -- 172.21.15.112:0/1025474518 shutdown_connections 2024-09-12T02:44:10.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.659+0000 7fe90a400640 1 -- 172.21.15.112:0/1025474518 wait complete. 2024-09-12T02:44:10.676 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T02:44:10.676 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:44:10.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.829+0000 7f04b8000640 1 Processor -- start 2024-09-12T02:44:10.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.829+0000 7f04b8000640 1 -- start start 2024-09-12T02:44:10.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.830+0000 7f04b8000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f04b015b9d0 0x7f04b00b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:10.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.830+0000 7f04b8000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f04b00b45d0 0x7f04b00728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:10.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.830+0000 7f04b8000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04b00b54a0 con 0x7f04b006eef0 2024-09-12T02:44:10.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.830+0000 7f04b8000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f04b00b4a60 con 0x7f04b015b9d0 2024-09-12T02:44:10.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.830+0000 7f04b8000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f04b00b3af0 con 0x7f04b00b45d0 2024-09-12T02:44:10.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.831+0000 7f04b5600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f04b015b9d0 0x7f04b00b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:10.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.831+0000 7f04b5600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f04b015b9d0 0x7f04b00b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50640/0 (socket says 172.21.15.112:50640) 2024-09-12T02:44:10.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.831+0000 7f04b5600640 1 -- 172.21.15.112:0/1580601514 learned_addr learned my addr 172.21.15.112:0/1580601514 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:10.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.831+0000 7f04b4c00640 1 --2- 172.21.15.112:0/1580601514 >> v2:172.21.15.137:3300/0 conn(0x7f04b00b45d0 0x7f04b00728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:10.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.831+0000 7f04b5600640 1 -- 172.21.15.112:0/1580601514 >> v2:172.21.15.137:3300/0 conn(0x7f04b00b45d0 msgr2=0x7f04b00728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:10.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.831+0000 7f04b5600640 1 --2- 172.21.15.112:0/1580601514 >> v2:172.21.15.137:3300/0 conn(0x7f04b00b45d0 0x7f04b00728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:10.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.831+0000 7f04b5600640 1 -- 172.21.15.112:0/1580601514 >> v1:172.21.15.137:6789/0 conn(0x7f04b006eef0 legacy=0x7f04b006f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:10.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.831+0000 7f04b5600640 1 -- 172.21.15.112:0/1580601514 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b00b3dd0 con 0x7f04b015b9d0 2024-09-12T02:44:10.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.832+0000 7f04b5600640 1 --2- 172.21.15.112:0/1580601514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04b015b9d0 0x7f04b00b4ec0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f04b0068670 tx=0x7f04a402a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922a6687f2bb9cc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:10.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.832+0000 7f04afe00640 1 -- 172.21.15.112:0/1580601514 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a4037070 con 0x7f04b015b9d0 2024-09-12T02:44:10.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.832+0000 7f04afe00640 1 -- 172.21.15.112:0/1580601514 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04a4032440 con 0x7f04b015b9d0 2024-09-12T02:44:10.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.832+0000 7f04afe00640 1 -- 172.21.15.112:0/1580601514 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a4032810 con 0x7f04b015b9d0 2024-09-12T02:44:10.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.833+0000 7f04b8000640 1 -- 172.21.15.112:0/1580601514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04b015b9d0 msgr2=0x7f04b00b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:10.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.833+0000 7f04b8000640 1 --2- 172.21.15.112:0/1580601514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04b015b9d0 0x7f04b00b4ec0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f04b0068670 tx=0x7f04a402a1f0 comp rx=0 tx=0).stop 2024-09-12T02:44:10.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.833+0000 7f04b8000640 1 -- 172.21.15.112:0/1580601514 shutdown_connections 2024-09-12T02:44:10.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.833+0000 7f04b8000640 1 --2- 172.21.15.112:0/1580601514 >> v2:172.21.15.137:3300/0 conn(0x7f04b00b45d0 0x7f04b00728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:10.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.833+0000 7f04b8000640 1 --2- 172.21.15.112:0/1580601514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04b015b9d0 0x7f04b00b4ec0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:10.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.833+0000 7f04b8000640 1 -- 172.21.15.112:0/1580601514 >> 172.21.15.112:0/1580601514 conn(0x7f04b006bbd0 msgr2=0x7f04b006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:10.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.833+0000 7f04b8000640 1 -- 172.21.15.112:0/1580601514 shutdown_connections 2024-09-12T02:44:10.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.833+0000 7f04b8000640 1 -- 172.21.15.112:0/1580601514 wait complete. 2024-09-12T02:44:10.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.835+0000 7f04b8000640 1 Processor -- start 2024-09-12T02:44:10.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.835+0000 7f04b8000640 1 -- start start 2024-09-12T02:44:10.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.835+0000 7f04b8000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04b006eef0 0x7f04b015c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:10.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.836+0000 7f04b8000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f04b00b45d0 0x7f04b0151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:10.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.836+0000 7f04b8000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04b015b9d0 0x7f04b015da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:10.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.836+0000 7f04b8000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f04b015bf30 con 0x7f04b006eef0 2024-09-12T02:44:10.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.836+0000 7f04b8000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f04b015bdb0 con 0x7f04b015b9d0 2024-09-12T02:44:10.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.836+0000 7f04b8000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f04b00cdcd0 con 0x7f04b00b45d0 2024-09-12T02:44:10.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.836+0000 7f04b5600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04b006eef0 0x7f04b015c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:10.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.836+0000 7f04b5600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04b006eef0 0x7f04b015c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50650/0 (socket says 172.21.15.112:50650) 2024-09-12T02:44:10.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.836+0000 7f04b5600640 1 -- 172.21.15.112:0/3681421329 learned_addr learned my addr 172.21.15.112:0/3681421329 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:10.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.836+0000 7f04b6000640 1 --2- 172.21.15.112:0/3681421329 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04b015b9d0 0x7f04b015da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:10.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.836+0000 7f04b4c00640 1 --2- 172.21.15.112:0/3681421329 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f04b00b45d0 0x7f04b0151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:10.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.836+0000 7f04b5600640 1 -- 172.21.15.112:0/3681421329 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f04b00b45d0 msgr2=0x7f04b0151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:10.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.836+0000 7f04b5600640 1 --2- 172.21.15.112:0/3681421329 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f04b00b45d0 0x7f04b0151770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:10.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.836+0000 7f04b5600640 1 -- 172.21.15.112:0/3681421329 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04b015b9d0 msgr2=0x7f04b015da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:10.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.836+0000 7f04b5600640 1 --2- 172.21.15.112:0/3681421329 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04b015b9d0 0x7f04b015da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:10.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.836+0000 7f04b5600640 1 -- 172.21.15.112:0/3681421329 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b0151cb0 con 0x7f04b006eef0 2024-09-12T02:44:10.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.836+0000 7f04b5600640 1 --2- 172.21.15.112:0/3681421329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04b006eef0 0x7f04b015c240 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f04a402a230 tx=0x7f04a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:10.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.837+0000 7f04ad600640 1 -- 172.21.15.112:0/3681421329 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a4041020 con 0x7f04b006eef0 2024-09-12T02:44:10.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.837+0000 7f04ad600640 1 -- 172.21.15.112:0/3681421329 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04a40306c0 con 0x7f04b006eef0 2024-09-12T02:44:10.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.837+0000 7f04ad600640 1 -- 172.21.15.112:0/3681421329 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a4037040 con 0x7f04b006eef0 2024-09-12T02:44:10.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.837+0000 7f04b8000640 1 -- 172.21.15.112:0/3681421329 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04b015c9a0 con 0x7f04b006eef0 2024-09-12T02:44:10.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.837+0000 7f04b8000640 1 -- 172.21.15.112:0/3681421329 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04b015cf20 con 0x7f04b006eef0 2024-09-12T02:44:10.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.838+0000 7f04b8000640 1 -- 172.21.15.112:0/3681421329 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04b0068a30 con 0x7f04b006eef0 2024-09-12T02:44:10.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.839+0000 7f04ad600640 1 -- 172.21.15.112:0/3681421329 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f04a4044020 con 0x7f04b006eef0 2024-09-12T02:44:10.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.839+0000 7f04ad600640 1 --2- 172.21.15.112:0/3681421329 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f049006be30 0x7f049006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:10.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.840+0000 7f04ad600640 1 -- 172.21.15.112:0/3681421329 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5709+0+0 (secure 0 0 0) 0x7f04a40ab670 con 0x7f04b006eef0 2024-09-12T02:44:10.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.840+0000 7f04b4c00640 1 --2- 172.21.15.112:0/3681421329 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f049006be30 0x7f049006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:10.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.840+0000 7f04b4c00640 1 --2- 172.21.15.112:0/3681421329 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f049006be30 0x7f049006e2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f04b01f8880 tx=0x7f049c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:10.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:10.844+0000 7f04ad600640 1 -- 172.21.15.112:0/3681421329 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f04a404b030 con 0x7f04b006eef0 2024-09-12T02:44:11.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.050+0000 7f04b8000640 1 -- 172.21.15.112:0/3681421329 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04b006dbc0 con 0x7f04b006eef0 2024-09-12T02:44:11.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.051+0000 7f04ad600640 1 -- 172.21.15.112:0/3681421329 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5235 (secure 0 0 0) 0x7f04a407a010 con 0x7f04b006eef0 2024-09-12T02:44:11.052 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:44:11.052 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":36,"btime":"2024-09-12T02:44:10:654160+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4997,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1412930245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1412930245},{"type":"v1","addr":"172.21.15.137:6834","nonce":1412930245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5299,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1045746375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1045746375},{"type":"v1","addr":"172.21.15.112:6837","nonce":1045746375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5305,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1625140900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1625140900},{"type":"v1","addr":"172.21.15.137:6835","nonce":1625140900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:44:07.016881+0000","modified":"2024-09-12T02:44:10.058498+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5508":{"gid":5508,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/3039296510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3039296510},{"type":"v1","addr":"172.21.15.112:6835","nonce":3039296510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5508,"qdb_cluster":[5508]},"id":4}]} 2024-09-12T02:44:11.052 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 36 2024-09-12T02:44:11.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.053+0000 7f04b8000640 1 -- 172.21.15.112:0/3681421329 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f049006be30 msgr2=0x7f049006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:11.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.053+0000 7f04b8000640 1 --2- 172.21.15.112:0/3681421329 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f049006be30 0x7f049006e2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f04b01f8880 tx=0x7f049c008040 comp rx=0 tx=0).stop 2024-09-12T02:44:11.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.053+0000 7f04b8000640 1 -- 172.21.15.112:0/3681421329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04b006eef0 msgr2=0x7f04b015c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:11.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.053+0000 7f04b8000640 1 --2- 172.21.15.112:0/3681421329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04b006eef0 0x7f04b015c240 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f04a402a230 tx=0x7f04a40046c0 comp rx=0 tx=0).stop 2024-09-12T02:44:11.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.053+0000 7f04b8000640 1 -- 172.21.15.112:0/3681421329 shutdown_connections 2024-09-12T02:44:11.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.053+0000 7f04b8000640 1 --2- 172.21.15.112:0/3681421329 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f049006be30 0x7f049006e2f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:11.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.053+0000 7f04b8000640 1 --2- 172.21.15.112:0/3681421329 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04b015b9d0 0x7f04b015da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:11.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.053+0000 7f04b8000640 1 --2- 172.21.15.112:0/3681421329 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f04b00b45d0 0x7f04b0151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:11.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.053+0000 7f04b8000640 1 --2- 172.21.15.112:0/3681421329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04b006eef0 0x7f04b015c240 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:11.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.053+0000 7f04b8000640 1 -- 172.21.15.112:0/3681421329 >> 172.21.15.112:0/3681421329 conn(0x7f04b006bbd0 msgr2=0x7f04b00b0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:11.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.053+0000 7f04b8000640 1 -- 172.21.15.112:0/3681421329 shutdown_connections 2024-09-12T02:44:11.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.053+0000 7f04b8000640 1 -- 172.21.15.112:0/3681421329 wait complete. 2024-09-12T02:44:11.073 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:44:11.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.224+0000 7efcbb800640 1 Processor -- start 2024-09-12T02:44:11.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.224+0000 7efcbb800640 1 -- start start 2024-09-12T02:44:11.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.225+0000 7efcbb800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efcb415cc50 0x7efcb40732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:11.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.225+0000 7efcbb800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efcb4071530 0x7efcb40af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:11.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.225+0000 7efcbb800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efcb40719a0 0x7efcb40afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:11.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.225+0000 7efcbb800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7efcb415d030 con 0x7efcb4071530 2024-09-12T02:44:11.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.225+0000 7efcbb800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7efcb40cf4c0 con 0x7efcb415cc50 2024-09-12T02:44:11.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.225+0000 7efcbb800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7efcb4073830 con 0x7efcb40719a0 2024-09-12T02:44:11.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.226+0000 7efcb3e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efcb4071530 0x7efcb40af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:11.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.226+0000 7efcb3e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efcb4071530 0x7efcb40af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50666/0 (socket says 172.21.15.112:50666) 2024-09-12T02:44:11.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.226+0000 7efcb3e00640 1 -- 172.21.15.112:0/1301962104 learned_addr learned my addr 172.21.15.112:0/1301962104 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:11.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.226+0000 7efcb9800640 1 --2- 172.21.15.112:0/1301962104 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efcb40719a0 0x7efcb40afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:11.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.226+0000 7efcb8e00640 1 --2- 172.21.15.112:0/1301962104 >> v2:172.21.15.137:3300/0 conn(0x7efcb415cc50 0x7efcb40732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:11.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.226+0000 7efcb3e00640 1 -- 172.21.15.112:0/1301962104 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efcb40719a0 msgr2=0x7efcb40afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:11.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.226+0000 7efcb3e00640 1 --2- 172.21.15.112:0/1301962104 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efcb40719a0 0x7efcb40afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:11.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.226+0000 7efcb3e00640 1 -- 172.21.15.112:0/1301962104 >> v2:172.21.15.137:3300/0 conn(0x7efcb415cc50 msgr2=0x7efcb40732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:11.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.226+0000 7efcb3e00640 1 --2- 172.21.15.112:0/1301962104 >> v2:172.21.15.137:3300/0 conn(0x7efcb415cc50 0x7efcb40732f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:11.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.226+0000 7efcb3e00640 1 -- 172.21.15.112:0/1301962104 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb40ceeb0 con 0x7efcb4071530 2024-09-12T02:44:11.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.227+0000 7efcb3e00640 1 --2- 172.21.15.112:0/1301962104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcb4071530 0x7efcb40af720 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7efcb4070060 tx=0x7efca002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394b4f70996c4616 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:11.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.227+0000 7efcb3400640 1 -- 172.21.15.112:0/1301962104 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca0004030 con 0x7efcb4071530 2024-09-12T02:44:11.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.227+0000 7efcb3400640 1 -- 172.21.15.112:0/1301962104 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efca00041d0 con 0x7efcb4071530 2024-09-12T02:44:11.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.227+0000 7efcb3400640 1 -- 172.21.15.112:0/1301962104 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca0003610 con 0x7efcb4071530 2024-09-12T02:44:11.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.228+0000 7efcbb800640 1 -- 172.21.15.112:0/1301962104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcb4071530 msgr2=0x7efcb40af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:11.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.228+0000 7efcbb800640 1 --2- 172.21.15.112:0/1301962104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcb4071530 0x7efcb40af720 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7efcb4070060 tx=0x7efca002a130 comp rx=0 tx=0).stop 2024-09-12T02:44:11.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.228+0000 7efcbb800640 1 -- 172.21.15.112:0/1301962104 shutdown_connections 2024-09-12T02:44:11.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.228+0000 7efcbb800640 1 --2- 172.21.15.112:0/1301962104 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efcb40719a0 0x7efcb40afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:11.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.228+0000 7efcbb800640 1 --2- 172.21.15.112:0/1301962104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcb4071530 0x7efcb40af720 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:11.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.228+0000 7efcbb800640 1 --2- 172.21.15.112:0/1301962104 >> v2:172.21.15.137:3300/0 conn(0x7efcb415cc50 0x7efcb40732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:11.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.228+0000 7efcbb800640 1 -- 172.21.15.112:0/1301962104 >> 172.21.15.112:0/1301962104 conn(0x7efcb406bbd0 msgr2=0x7efcb406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:11.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.228+0000 7efcbb800640 1 -- 172.21.15.112:0/1301962104 shutdown_connections 2024-09-12T02:44:11.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.228+0000 7efcbb800640 1 -- 172.21.15.112:0/1301962104 wait complete. 2024-09-12T02:44:11.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.229+0000 7efcbb800640 1 Processor -- start 2024-09-12T02:44:11.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.230+0000 7efcbb800640 1 -- start start 2024-09-12T02:44:11.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.230+0000 7efcbb800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcb4071530 0x7efcb41497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:11.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.230+0000 7efcbb800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcb40719a0 0x7efcb4148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:11.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.230+0000 7efcbb800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efcb415cc50 0x7efcb41524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:11.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.230+0000 7efcbb800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efcb40cf150 con 0x7efcb4071530 2024-09-12T02:44:11.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.230+0000 7efcbb800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efcb406e5e0 con 0x7efcb40719a0 2024-09-12T02:44:11.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.230+0000 7efcbb800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7efcb406f510 con 0x7efcb415cc50 2024-09-12T02:44:11.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.231+0000 7efcb8e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcb4071530 0x7efcb41497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:11.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.231+0000 7efcb8e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcb4071530 0x7efcb41497d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50680/0 (socket says 172.21.15.112:50680) 2024-09-12T02:44:11.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.231+0000 7efcb8e00640 1 -- 172.21.15.112:0/3221588072 learned_addr learned my addr 172.21.15.112:0/3221588072 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:11.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.231+0000 7efcb3e00640 1 --2- 172.21.15.112:0/3221588072 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcb40719a0 0x7efcb4148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:11.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.231+0000 7efcb9800640 1 --2- 172.21.15.112:0/3221588072 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efcb415cc50 0x7efcb41524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:11.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.231+0000 7efcb8e00640 1 -- 172.21.15.112:0/3221588072 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efcb415cc50 msgr2=0x7efcb41524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:11.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.231+0000 7efcb8e00640 1 --2- 172.21.15.112:0/3221588072 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efcb415cc50 0x7efcb41524c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:11.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.231+0000 7efcb8e00640 1 -- 172.21.15.112:0/3221588072 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcb40719a0 msgr2=0x7efcb4148270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:11.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.231+0000 7efcb8e00640 1 --2- 172.21.15.112:0/3221588072 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcb40719a0 0x7efcb4148270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:11.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.231+0000 7efcb8e00640 1 -- 172.21.15.112:0/3221588072 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb4148c00 con 0x7efcb4071530 2024-09-12T02:44:11.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.231+0000 7efcb8e00640 1 --2- 172.21.15.112:0/3221588072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcb4071530 0x7efcb41497d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7efca800e9e0 tx=0x7efca800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:11.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.232+0000 7efcb0c00640 1 -- 172.21.15.112:0/3221588072 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca8017070 con 0x7efcb4071530 2024-09-12T02:44:11.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.232+0000 7efcb0c00640 1 -- 172.21.15.112:0/3221588072 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efca800c9d0 con 0x7efcb4071530 2024-09-12T02:44:11.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.232+0000 7efcb0c00640 1 -- 172.21.15.112:0/3221588072 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca800cdc0 con 0x7efcb4071530 2024-09-12T02:44:11.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.232+0000 7efcbb800640 1 -- 172.21.15.112:0/3221588072 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcb415d780 con 0x7efcb4071530 2024-09-12T02:44:11.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.232+0000 7efcbb800640 1 -- 172.21.15.112:0/3221588072 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcb415dd40 con 0x7efcb4071530 2024-09-12T02:44:11.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.233+0000 7efcbb800640 1 -- 172.21.15.112:0/3221588072 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcb4068a30 con 0x7efcb4071530 2024-09-12T02:44:11.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.234+0000 7efcb0c00640 1 -- 172.21.15.112:0/3221588072 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efca801a070 con 0x7efcb4071530 2024-09-12T02:44:11.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.235+0000 7efcb0c00640 1 --2- 172.21.15.112:0/3221588072 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efc9406be30 0x7efc9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:11.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.235+0000 7efcb0c00640 1 -- 172.21.15.112:0/3221588072 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5709+0+0 (secure 0 0 0) 0x7efca808adf0 con 0x7efcb4071530 2024-09-12T02:44:11.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.235+0000 7efcb3e00640 1 --2- 172.21.15.112:0/3221588072 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efc9406be30 0x7efc9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:11.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.235+0000 7efcb3e00640 1 --2- 172.21.15.112:0/3221588072 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efc9406be30 0x7efc9406e2f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efca0033000 tx=0x7efca002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:11.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.239+0000 7efcb0c00640 1 -- 172.21.15.112:0/3221588072 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efca8059140 con 0x7efcb4071530 2024-09-12T02:44:11.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.414+0000 7efcbb800640 1 -- 172.21.15.112:0/3221588072 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efcb406df60 con 0x7efcb4071530 2024-09-12T02:44:11.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.415+0000 7efcb0c00640 1 -- 172.21.15.112:0/3221588072 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+16773 (secure 0 0 0) 0x7efca805d440 con 0x7efcb4071530 2024-09-12T02:44:11.417 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:44:11.417 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":64,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:44:08.622066+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:44:04.794578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-12T02:44:06.019611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:44:11.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.417+0000 7efcbb800640 1 -- 172.21.15.112:0/3221588072 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efc9406be30 msgr2=0x7efc9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:11.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.417+0000 7efcbb800640 1 --2- 172.21.15.112:0/3221588072 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efc9406be30 0x7efc9406e2f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efca0033000 tx=0x7efca002e000 comp rx=0 tx=0).stop 2024-09-12T02:44:11.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.417+0000 7efcbb800640 1 -- 172.21.15.112:0/3221588072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcb4071530 msgr2=0x7efcb41497d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:11.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.417+0000 7efcbb800640 1 --2- 172.21.15.112:0/3221588072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcb4071530 0x7efcb41497d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7efca800e9e0 tx=0x7efca800eea0 comp rx=0 tx=0).stop 2024-09-12T02:44:11.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.418+0000 7efcbb800640 1 -- 172.21.15.112:0/3221588072 shutdown_connections 2024-09-12T02:44:11.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.418+0000 7efcbb800640 1 --2- 172.21.15.112:0/3221588072 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efcb415cc50 0x7efcb41524c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:11.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.418+0000 7efcbb800640 1 --2- 172.21.15.112:0/3221588072 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efc9406be30 0x7efc9406e2f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:11.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.418+0000 7efcbb800640 1 --2- 172.21.15.112:0/3221588072 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcb40719a0 0x7efcb4148270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:11.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.418+0000 7efcbb800640 1 --2- 172.21.15.112:0/3221588072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcb4071530 0x7efcb41497d0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:11.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.418+0000 7efcbb800640 1 -- 172.21.15.112:0/3221588072 >> 172.21.15.112:0/3221588072 conn(0x7efcb406bbd0 msgr2=0x7efcb40b4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:11.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.418+0000 7efcbb800640 1 -- 172.21.15.112:0/3221588072 shutdown_connections 2024-09-12T02:44:11.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.418+0000 7efcbb800640 1 -- 172.21.15.112:0/3221588072 wait complete. 2024-09-12T02:44:11.434 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:44:11.435 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:44:11.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.585+0000 7f1c83400640 1 Processor -- start 2024-09-12T02:44:11.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.585+0000 7f1c83400640 1 -- start start 2024-09-12T02:44:11.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.587+0000 7f1c83400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1c7c15b9d0 0x7f1c7c0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:11.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.587+0000 7f1c83400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1c7c06f600 0x7f1c7c0728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:11.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.587+0000 7f1c83400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c7c0b54a0 con 0x7f1c7c0b45d0 2024-09-12T02:44:11.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.587+0000 7f1c83400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f1c7c0b4a60 con 0x7f1c7c15b9d0 2024-09-12T02:44:11.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.587+0000 7f1c83400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1c7c0b3af0 con 0x7f1c7c06f600 2024-09-12T02:44:11.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.587+0000 7f1c80a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1c7c15b9d0 0x7f1c7c0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:11.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.587+0000 7f1c80a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1c7c15b9d0 0x7f1c7c0b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50682/0 (socket says 172.21.15.112:50682) 2024-09-12T02:44:11.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.587+0000 7f1c80a00640 1 -- 172.21.15.112:0/3255344195 learned_addr learned my addr 172.21.15.112:0/3255344195 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:11.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.587+0000 7f1c81400640 1 --2- 172.21.15.112:0/3255344195 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1c7c06f600 0x7f1c7c0728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:11.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.587+0000 7f1c80a00640 1 -- 172.21.15.112:0/3255344195 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1c7c06f600 msgr2=0x7f1c7c0728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:11.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.587+0000 7f1c80a00640 1 --2- 172.21.15.112:0/3255344195 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1c7c06f600 0x7f1c7c0728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:11.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.587+0000 7f1c80a00640 1 -- 172.21.15.112:0/3255344195 >> v1:172.21.15.137:6789/0 conn(0x7f1c7c0b45d0 legacy=0x7f1c7c06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:11.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.587+0000 7f1c80a00640 1 -- 172.21.15.112:0/3255344195 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c7c0b3dd0 con 0x7f1c7c15b9d0 2024-09-12T02:44:11.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.588+0000 7f1c80a00640 1 --2- 172.21.15.112:0/3255344195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c7c15b9d0 0x7f1c7c0b4ec0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c00bb10 tx=0x7f1c6c02c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc791f01f5e3cb18 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:11.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.589+0000 7f1c7be00640 1 -- 172.21.15.112:0/3255344195 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c036020 con 0x7f1c7c15b9d0 2024-09-12T02:44:11.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.589+0000 7f1c7be00640 1 -- 172.21.15.112:0/3255344195 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c6c032820 con 0x7f1c7c15b9d0 2024-09-12T02:44:11.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.589+0000 7f1c7be00640 1 -- 172.21.15.112:0/3255344195 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c032bf0 con 0x7f1c7c15b9d0 2024-09-12T02:44:11.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.589+0000 7f1c83400640 1 -- 172.21.15.112:0/3255344195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c7c15b9d0 msgr2=0x7f1c7c0b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:11.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.589+0000 7f1c83400640 1 --2- 172.21.15.112:0/3255344195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c7c15b9d0 0x7f1c7c0b4ec0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c00bb10 tx=0x7f1c6c02c920 comp rx=0 tx=0).stop 2024-09-12T02:44:11.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.589+0000 7f1c83400640 1 -- 172.21.15.112:0/3255344195 shutdown_connections 2024-09-12T02:44:11.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.589+0000 7f1c83400640 1 --2- 172.21.15.112:0/3255344195 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1c7c06f600 0x7f1c7c0728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:11.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.589+0000 7f1c83400640 1 --2- 172.21.15.112:0/3255344195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c7c15b9d0 0x7f1c7c0b4ec0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:11.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.589+0000 7f1c83400640 1 -- 172.21.15.112:0/3255344195 >> 172.21.15.112:0/3255344195 conn(0x7f1c7c06bbd0 msgr2=0x7f1c7c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:11.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.589+0000 7f1c83400640 1 -- 172.21.15.112:0/3255344195 shutdown_connections 2024-09-12T02:44:11.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.589+0000 7f1c83400640 1 -- 172.21.15.112:0/3255344195 wait complete. 2024-09-12T02:44:11.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.591+0000 7f1c83400640 1 Processor -- start 2024-09-12T02:44:11.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.591+0000 7f1c83400640 1 -- start start 2024-09-12T02:44:11.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.592+0000 7f1c83400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c7c06f600 0x7f1c7c157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:11.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.592+0000 7f1c83400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1c7c0b45d0 0x7f1c7c15e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:11.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.592+0000 7f1c83400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c7c15b9d0 0x7f1c7c15e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:11.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.592+0000 7f1c83400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7c15bf30 con 0x7f1c7c06f600 2024-09-12T02:44:11.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.592+0000 7f1c83400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7c15bdb0 con 0x7f1c7c15b9d0 2024-09-12T02:44:11.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.592+0000 7f1c83400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1c7c0cdcd0 con 0x7f1c7c0b45d0 2024-09-12T02:44:11.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.592+0000 7f1c80a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c7c06f600 0x7f1c7c157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:11.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.592+0000 7f1c80a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c7c06f600 0x7f1c7c157fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50698/0 (socket says 172.21.15.112:50698) 2024-09-12T02:44:11.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.592+0000 7f1c80a00640 1 -- 172.21.15.112:0/3881566889 learned_addr learned my addr 172.21.15.112:0/3881566889 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:11.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.592+0000 7f1c81400640 1 --2- 172.21.15.112:0/3881566889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c7c15b9d0 0x7f1c7c15e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:11.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.592+0000 7f1c73e00640 1 --2- 172.21.15.112:0/3881566889 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1c7c0b45d0 0x7f1c7c15e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:11.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.592+0000 7f1c80a00640 1 -- 172.21.15.112:0/3881566889 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1c7c0b45d0 msgr2=0x7f1c7c15e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:11.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.592+0000 7f1c80a00640 1 --2- 172.21.15.112:0/3881566889 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1c7c0b45d0 0x7f1c7c15e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:11.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.592+0000 7f1c80a00640 1 -- 172.21.15.112:0/3881566889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c7c15b9d0 msgr2=0x7f1c7c15e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:11.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.592+0000 7f1c80a00640 1 --2- 172.21.15.112:0/3881566889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c7c15b9d0 0x7f1c7c15e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:11.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.593+0000 7f1c80a00640 1 -- 172.21.15.112:0/3881566889 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c7c1f54c0 con 0x7f1c7c06f600 2024-09-12T02:44:11.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.593+0000 7f1c73e00640 1 --2- 172.21.15.112:0/3881566889 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1c7c0b45d0 0x7f1c7c15e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:44:11.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.593+0000 7f1c80a00640 1 --2- 172.21.15.112:0/3881566889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c7c06f600 0x7f1c7c157fe0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c00b2c0 tx=0x7f1c6c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:11.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.593+0000 7f1c79600640 1 -- 172.21.15.112:0/3881566889 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c042070 con 0x7f1c7c06f600 2024-09-12T02:44:11.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.593+0000 7f1c79600640 1 -- 172.21.15.112:0/3881566889 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c6c031cb0 con 0x7f1c7c06f600 2024-09-12T02:44:11.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.593+0000 7f1c79600640 1 -- 172.21.15.112:0/3881566889 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c036040 con 0x7f1c7c06f600 2024-09-12T02:44:11.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.593+0000 7f1c83400640 1 -- 172.21.15.112:0/3881566889 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c7c158950 con 0x7f1c7c06f600 2024-09-12T02:44:11.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.593+0000 7f1c83400640 1 -- 172.21.15.112:0/3881566889 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c7c158f10 con 0x7f1c7c06f600 2024-09-12T02:44:11.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.594+0000 7f1c83400640 1 -- 172.21.15.112:0/3881566889 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c7c068a30 con 0x7f1c7c06f600 2024-09-12T02:44:11.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.595+0000 7f1c79600640 1 -- 172.21.15.112:0/3881566889 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1c6c045070 con 0x7f1c7c06f600 2024-09-12T02:44:11.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.596+0000 7f1c79600640 1 --2- 172.21.15.112:0/3881566889 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1c5806be30 0x7f1c5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:11.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.596+0000 7f1c79600640 1 -- 172.21.15.112:0/3881566889 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5709+0+0 (secure 0 0 0) 0x7f1c6c0aba20 con 0x7f1c7c06f600 2024-09-12T02:44:11.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.596+0000 7f1c73e00640 1 --2- 172.21.15.112:0/3881566889 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1c5806be30 0x7f1c5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:11.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.597+0000 7f1c73e00640 1 --2- 172.21.15.112:0/3881566889 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1c5806be30 0x7f1c5806e2f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c155d40 tx=0x7f1c64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:11.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.601+0000 7f1c79600640 1 -- 172.21.15.112:0/3881566889 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1c6c02f070 con 0x7f1c7c06f600 2024-09-12T02:44:11.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.775+0000 7f1c83400640 1 -- 172.21.15.112:0/3881566889 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1c7c153a70 con 0x7f1c5806be30 2024-09-12T02:44:11.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.782+0000 7f1c79600640 1 -- 172.21.15.112:0/3881566889 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247422 (secure 0 0 0) 0x7f1c7c153a70 con 0x7f1c5806be30 2024-09-12T02:44:11.786 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:44:11.787 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:44:11.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.786+0000 7f1c83400640 1 -- 172.21.15.112:0/3881566889 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1c5806be30 msgr2=0x7f1c5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:11.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.786+0000 7f1c83400640 1 --2- 172.21.15.112:0/3881566889 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1c5806be30 0x7f1c5806e2f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c155d40 tx=0x7f1c64009040 comp rx=0 tx=0).stop 2024-09-12T02:44:11.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.786+0000 7f1c83400640 1 -- 172.21.15.112:0/3881566889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c7c06f600 msgr2=0x7f1c7c157fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:11.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.786+0000 7f1c83400640 1 --2- 172.21.15.112:0/3881566889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c7c06f600 0x7f1c7c157fe0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c00b2c0 tx=0x7f1c6c004730 comp rx=0 tx=0).stop 2024-09-12T02:44:11.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.786+0000 7f1c83400640 1 -- 172.21.15.112:0/3881566889 shutdown_connections 2024-09-12T02:44:11.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.786+0000 7f1c83400640 1 --2- 172.21.15.112:0/3881566889 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1c5806be30 0x7f1c5806e2f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:11.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.786+0000 7f1c83400640 1 --2- 172.21.15.112:0/3881566889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c7c15b9d0 0x7f1c7c15e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:11.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.786+0000 7f1c83400640 1 --2- 172.21.15.112:0/3881566889 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1c7c0b45d0 0x7f1c7c15e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:11.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.786+0000 7f1c83400640 1 --2- 172.21.15.112:0/3881566889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c7c06f600 0x7f1c7c157fe0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:11.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.786+0000 7f1c83400640 1 -- 172.21.15.112:0/3881566889 >> 172.21.15.112:0/3881566889 conn(0x7f1c7c06bbd0 msgr2=0x7f1c7c0b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:11.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.786+0000 7f1c83400640 1 -- 172.21.15.112:0/3881566889 shutdown_connections 2024-09-12T02:44:11.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.786+0000 7f1c83400640 1 -- 172.21.15.112:0/3881566889 wait complete. 2024-09-12T02:44:11.802 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2024-09-12T02:44:10.988154+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":77,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558873,"statfs":{"total":1600000000,"available":1596286576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.383720"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.634965+0000","last_change":"2024-09-12T02:44:07.634167+0000","last_active":"2024-09-12T02:44:07.634965+0000","last_peered":"2024-09-12T02:44:07.634965+0000","last_clean":"2024-09-12T02:44:07.634965+0000","last_became_active":"2024-09-12T02:44:07.633933+0000","last_became_peered":"2024-09-12T02:44:07.633933+0000","last_unstale":"2024-09-12T02:44:07.634965+0000","last_undegraded":"2024-09-12T02:44:07.634965+0000","last_fullsized":"2024-09-12T02:44:07.634965+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:40.948521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.645720+0000","last_change":"2024-09-12T02:44:07.645531+0000","last_active":"2024-09-12T02:44:07.645720+0000","last_peered":"2024-09-12T02:44:07.645720+0000","last_clean":"2024-09-12T02:44:07.645720+0000","last_became_active":"2024-09-12T02:44:07.644978+0000","last_became_peered":"2024-09-12T02:44:07.644978+0000","last_unstale":"2024-09-12T02:44:07.645720+0000","last_undegraded":"2024-09-12T02:44:07.645720+0000","last_fullsized":"2024-09-12T02:44:07.645720+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:29.840477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.637883+0000","last_change":"2024-09-12T02:44:07.637687+0000","last_active":"2024-09-12T02:44:07.637883+0000","last_peered":"2024-09-12T02:44:07.637883+0000","last_clean":"2024-09-12T02:44:07.637883+0000","last_became_active":"2024-09-12T02:44:07.635906+0000","last_became_peered":"2024-09-12T02:44:07.635906+0000","last_unstale":"2024-09-12T02:44:07.637883+0000","last_undegraded":"2024-09-12T02:44:07.637883+0000","last_fullsized":"2024-09-12T02:44:07.637883+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:46.471519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.641566+0000","last_change":"2024-09-12T02:44:07.641089+0000","last_active":"2024-09-12T02:44:07.641566+0000","last_peered":"2024-09-12T02:44:07.641566+0000","last_clean":"2024-09-12T02:44:07.641566+0000","last_became_active":"2024-09-12T02:44:07.640800+0000","last_became_peered":"2024-09-12T02:44:07.640800+0000","last_unstale":"2024-09-12T02:44:07.641566+0000","last_undegraded":"2024-09-12T02:44:07.641566+0000","last_fullsized":"2024-09-12T02:44:07.641566+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:59.803768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.642496+0000","last_change":"2024-09-12T02:44:07.639953+0000","last_active":"2024-09-12T02:44:07.642496+0000","last_peered":"2024-09-12T02:44:07.642496+0000","last_clean":"2024-09-12T02:44:07.642496+0000","last_became_active":"2024-09-12T02:44:07.638551+0000","last_became_peered":"2024-09-12T02:44:07.638551+0000","last_unstale":"2024-09-12T02:44:07.642496+0000","last_undegraded":"2024-09-12T02:44:07.642496+0000","last_fullsized":"2024-09-12T02:44:07.642496+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:49.508071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.646817+0000","last_change":"2024-09-12T02:44:07.646675+0000","last_active":"2024-09-12T02:44:07.646817+0000","last_peered":"2024-09-12T02:44:07.646817+0000","last_clean":"2024-09-12T02:44:07.646817+0000","last_became_active":"2024-09-12T02:44:07.646101+0000","last_became_peered":"2024-09-12T02:44:07.646101+0000","last_unstale":"2024-09-12T02:44:07.646817+0000","last_undegraded":"2024-09-12T02:44:07.646817+0000","last_fullsized":"2024-09-12T02:44:07.646817+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:02.479369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.639556+0000","last_change":"2024-09-12T02:44:07.638748+0000","last_active":"2024-09-12T02:44:07.639556+0000","last_peered":"2024-09-12T02:44:07.639556+0000","last_clean":"2024-09-12T02:44:07.639556+0000","last_became_active":"2024-09-12T02:44:07.638506+0000","last_became_peered":"2024-09-12T02:44:07.638506+0000","last_unstale":"2024-09-12T02:44:07.639556+0000","last_undegraded":"2024-09-12T02:44:07.639556+0000","last_fullsized":"2024-09-12T02:44:07.639556+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:44.600760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.628325+0000","last_change":"2024-09-12T02:44:07.628084+0000","last_active":"2024-09-12T02:44:07.628325+0000","last_peered":"2024-09-12T02:44:07.628325+0000","last_clean":"2024-09-12T02:44:07.628325+0000","last_became_active":"2024-09-12T02:44:07.627835+0000","last_became_peered":"2024-09-12T02:44:07.627835+0000","last_unstale":"2024-09-12T02:44:07.628325+0000","last_undegraded":"2024-09-12T02:44:07.628325+0000","last_fullsized":"2024-09-12T02:44:07.628325+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:15.323684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.640347+0000","last_change":"2024-09-12T02:44:07.639872+0000","last_active":"2024-09-12T02:44:07.640347+0000","last_peered":"2024-09-12T02:44:07.640347+0000","last_clean":"2024-09-12T02:44:07.640347+0000","last_became_active":"2024-09-12T02:44:07.639552+0000","last_became_peered":"2024-09-12T02:44:07.639552+0000","last_unstale":"2024-09-12T02:44:07.640347+0000","last_undegraded":"2024-09-12T02:44:07.640347+0000","last_fullsized":"2024-09-12T02:44:07.640347+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:16.533652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.642693+0000","last_change":"2024-09-12T02:44:07.640937+0000","last_active":"2024-09-12T02:44:07.642693+0000","last_peered":"2024-09-12T02:44:07.642693+0000","last_clean":"2024-09-12T02:44:07.642693+0000","last_became_active":"2024-09-12T02:44:07.640689+0000","last_became_peered":"2024-09-12T02:44:07.640689+0000","last_unstale":"2024-09-12T02:44:07.642693+0000","last_undegraded":"2024-09-12T02:44:07.642693+0000","last_fullsized":"2024-09-12T02:44:07.642693+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:07.672600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.645122+0000","last_change":"2024-09-12T02:44:07.644319+0000","last_active":"2024-09-12T02:44:07.645122+0000","last_peered":"2024-09-12T02:44:07.645122+0000","last_clean":"2024-09-12T02:44:07.645122+0000","last_became_active":"2024-09-12T02:44:07.644065+0000","last_became_peered":"2024-09-12T02:44:07.644065+0000","last_unstale":"2024-09-12T02:44:07.645122+0000","last_undegraded":"2024-09-12T02:44:07.645122+0000","last_fullsized":"2024-09-12T02:44:07.645122+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:36.571111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.641524+0000","last_change":"2024-09-12T02:44:07.639697+0000","last_active":"2024-09-12T02:44:07.641524+0000","last_peered":"2024-09-12T02:44:07.641524+0000","last_clean":"2024-09-12T02:44:07.641524+0000","last_became_active":"2024-09-12T02:44:07.639472+0000","last_became_peered":"2024-09-12T02:44:07.639472+0000","last_unstale":"2024-09-12T02:44:07.641524+0000","last_undegraded":"2024-09-12T02:44:07.641524+0000","last_fullsized":"2024-09-12T02:44:07.641524+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:14.725762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.637036+0000","last_change":"2024-09-12T02:44:07.636862+0000","last_active":"2024-09-12T02:44:07.637036+0000","last_peered":"2024-09-12T02:44:07.637036+0000","last_clean":"2024-09-12T02:44:07.637036+0000","last_became_active":"2024-09-12T02:44:07.636635+0000","last_became_peered":"2024-09-12T02:44:07.636635+0000","last_unstale":"2024-09-12T02:44:07.637036+0000","last_undegraded":"2024-09-12T02:44:07.637036+0000","last_fullsized":"2024-09-12T02:44:07.637036+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:05.732409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.632949+0000","last_change":"2024-09-12T02:44:07.632539+0000","last_active":"2024-09-12T02:44:07.632949+0000","last_peered":"2024-09-12T02:44:07.632949+0000","last_clean":"2024-09-12T02:44:07.632949+0000","last_became_active":"2024-09-12T02:44:07.632267+0000","last_became_peered":"2024-09-12T02:44:07.632267+0000","last_unstale":"2024-09-12T02:44:07.632949+0000","last_undegraded":"2024-09-12T02:44:07.632949+0000","last_fullsized":"2024-09-12T02:44:07.632949+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:59.587065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.640367+0000","last_change":"2024-09-12T02:44:07.640199+0000","last_active":"2024-09-12T02:44:07.640367+0000","last_peered":"2024-09-12T02:44:07.640367+0000","last_clean":"2024-09-12T02:44:07.640367+0000","last_became_active":"2024-09-12T02:44:07.639721+0000","last_became_peered":"2024-09-12T02:44:07.639721+0000","last_unstale":"2024-09-12T02:44:07.640367+0000","last_undegraded":"2024-09-12T02:44:07.640367+0000","last_fullsized":"2024-09-12T02:44:07.640367+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:03.912653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.639357+0000","last_change":"2024-09-12T02:44:07.639248+0000","last_active":"2024-09-12T02:44:07.639357+0000","last_peered":"2024-09-12T02:44:07.639357+0000","last_clean":"2024-09-12T02:44:07.639357+0000","last_became_active":"2024-09-12T02:44:07.638848+0000","last_became_peered":"2024-09-12T02:44:07.638848+0000","last_unstale":"2024-09-12T02:44:07.639357+0000","last_undegraded":"2024-09-12T02:44:07.639357+0000","last_fullsized":"2024-09-12T02:44:07.639357+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:40.452221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.629227+0000","last_change":"2024-09-12T02:44:07.629033+0000","last_active":"2024-09-12T02:44:07.629227+0000","last_peered":"2024-09-12T02:44:07.629227+0000","last_clean":"2024-09-12T02:44:07.629227+0000","last_became_active":"2024-09-12T02:44:07.628562+0000","last_became_peered":"2024-09-12T02:44:07.628562+0000","last_unstale":"2024-09-12T02:44:07.629227+0000","last_undegraded":"2024-09-12T02:44:07.629227+0000","last_fullsized":"2024-09-12T02:44:07.629227+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:30.599896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.643226+0000","last_change":"2024-09-12T02:44:07.642762+0000","last_active":"2024-09-12T02:44:07.643226+0000","last_peered":"2024-09-12T02:44:07.643226+0000","last_clean":"2024-09-12T02:44:07.643226+0000","last_became_active":"2024-09-12T02:44:07.639880+0000","last_became_peered":"2024-09-12T02:44:07.639880+0000","last_unstale":"2024-09-12T02:44:07.643226+0000","last_undegraded":"2024-09-12T02:44:07.643226+0000","last_fullsized":"2024-09-12T02:44:07.643226+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:18.481418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.638586+0000","last_change":"2024-09-12T02:44:07.638465+0000","last_active":"2024-09-12T02:44:07.638586+0000","last_peered":"2024-09-12T02:44:07.638586+0000","last_clean":"2024-09-12T02:44:07.638586+0000","last_became_active":"2024-09-12T02:44:07.636908+0000","last_became_peered":"2024-09-12T02:44:07.636908+0000","last_unstale":"2024-09-12T02:44:07.638586+0000","last_undegraded":"2024-09-12T02:44:07.638586+0000","last_fullsized":"2024-09-12T02:44:07.638586+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:59.931766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.638641+0000","last_change":"2024-09-12T02:44:07.636341+0000","last_active":"2024-09-12T02:44:07.638641+0000","last_peered":"2024-09-12T02:44:07.638641+0000","last_clean":"2024-09-12T02:44:07.638641+0000","last_became_active":"2024-09-12T02:44:07.635538+0000","last_became_peered":"2024-09-12T02:44:07.635538+0000","last_unstale":"2024-09-12T02:44:07.638641+0000","last_undegraded":"2024-09-12T02:44:07.638641+0000","last_fullsized":"2024-09-12T02:44:07.638641+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:34.364415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.641464+0000","last_change":"2024-09-12T02:44:07.641350+0000","last_active":"2024-09-12T02:44:07.641464+0000","last_peered":"2024-09-12T02:44:07.641464+0000","last_clean":"2024-09-12T02:44:07.641464+0000","last_became_active":"2024-09-12T02:44:07.641078+0000","last_became_peered":"2024-09-12T02:44:07.641078+0000","last_unstale":"2024-09-12T02:44:07.641464+0000","last_undegraded":"2024-09-12T02:44:07.641464+0000","last_fullsized":"2024-09-12T02:44:07.641464+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:33.259323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.633472+0000","last_change":"2024-09-12T02:44:07.633290+0000","last_active":"2024-09-12T02:44:07.633472+0000","last_peered":"2024-09-12T02:44:07.633472+0000","last_clean":"2024-09-12T02:44:07.633472+0000","last_became_active":"2024-09-12T02:44:07.632984+0000","last_became_peered":"2024-09-12T02:44:07.632984+0000","last_unstale":"2024-09-12T02:44:07.633472+0000","last_undegraded":"2024-09-12T02:44:07.633472+0000","last_fullsized":"2024-09-12T02:44:07.633472+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:42.162338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.642485+0000","last_change":"2024-09-12T02:44:07.640230+0000","last_active":"2024-09-12T02:44:07.642485+0000","last_peered":"2024-09-12T02:44:07.642485+0000","last_clean":"2024-09-12T02:44:07.642485+0000","last_became_active":"2024-09-12T02:44:07.637967+0000","last_became_peered":"2024-09-12T02:44:07.637967+0000","last_unstale":"2024-09-12T02:44:07.642485+0000","last_undegraded":"2024-09-12T02:44:07.642485+0000","last_fullsized":"2024-09-12T02:44:07.642485+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:32.424862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.638221+0000","last_change":"2024-09-12T02:44:07.637654+0000","last_active":"2024-09-12T02:44:07.638221+0000","last_peered":"2024-09-12T02:44:07.638221+0000","last_clean":"2024-09-12T02:44:07.638221+0000","last_became_active":"2024-09-12T02:44:07.637401+0000","last_became_peered":"2024-09-12T02:44:07.637401+0000","last_unstale":"2024-09-12T02:44:07.638221+0000","last_undegraded":"2024-09-12T02:44:07.638221+0000","last_fullsized":"2024-09-12T02:44:07.638221+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:22.317277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.642544+0000","last_change":"2024-09-12T02:44:07.640150+0000","last_active":"2024-09-12T02:44:07.642544+0000","last_peered":"2024-09-12T02:44:07.642544+0000","last_clean":"2024-09-12T02:44:07.642544+0000","last_became_active":"2024-09-12T02:44:07.639716+0000","last_became_peered":"2024-09-12T02:44:07.639716+0000","last_unstale":"2024-09-12T02:44:07.642544+0000","last_undegraded":"2024-09-12T02:44:07.642544+0000","last_fullsized":"2024-09-12T02:44:07.642544+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:37.719482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.641545+0000","last_change":"2024-09-12T02:44:07.640726+0000","last_active":"2024-09-12T02:44:07.641545+0000","last_peered":"2024-09-12T02:44:07.641545+0000","last_clean":"2024-09-12T02:44:07.641545+0000","last_became_active":"2024-09-12T02:44:07.640490+0000","last_became_peered":"2024-09-12T02:44:07.640490+0000","last_unstale":"2024-09-12T02:44:07.641545+0000","last_undegraded":"2024-09-12T02:44:07.641545+0000","last_fullsized":"2024-09-12T02:44:07.641545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:27.363660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.640328+0000","last_change":"2024-09-12T02:44:07.639953+0000","last_active":"2024-09-12T02:44:07.640328+0000","last_peered":"2024-09-12T02:44:07.640328+0000","last_clean":"2024-09-12T02:44:07.640328+0000","last_became_active":"2024-09-12T02:44:07.639710+0000","last_became_peered":"2024-09-12T02:44:07.639710+0000","last_unstale":"2024-09-12T02:44:07.640328+0000","last_undegraded":"2024-09-12T02:44:07.640328+0000","last_fullsized":"2024-09-12T02:44:07.640328+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:00.022218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.637317+0000","last_change":"2024-09-12T02:44:07.637170+0000","last_active":"2024-09-12T02:44:07.637317+0000","last_peered":"2024-09-12T02:44:07.637317+0000","last_clean":"2024-09-12T02:44:07.637317+0000","last_became_active":"2024-09-12T02:44:07.636907+0000","last_became_peered":"2024-09-12T02:44:07.636907+0000","last_unstale":"2024-09-12T02:44:07.637317+0000","last_undegraded":"2024-09-12T02:44:07.637317+0000","last_fullsized":"2024-09-12T02:44:07.637317+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:13.961581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.640460+0000","last_change":"2024-09-12T02:44:07.636343+0000","last_active":"2024-09-12T02:44:07.640460+0000","last_peered":"2024-09-12T02:44:07.640460+0000","last_clean":"2024-09-12T02:44:07.640460+0000","last_became_active":"2024-09-12T02:44:07.636100+0000","last_became_peered":"2024-09-12T02:44:07.636100+0000","last_unstale":"2024-09-12T02:44:07.640460+0000","last_undegraded":"2024-09-12T02:44:07.640460+0000","last_fullsized":"2024-09-12T02:44:07.640460+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:50.438160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.634563+0000","last_change":"2024-09-12T02:44:07.634393+0000","last_active":"2024-09-12T02:44:07.634563+0000","last_peered":"2024-09-12T02:44:07.634563+0000","last_clean":"2024-09-12T02:44:07.634563+0000","last_became_active":"2024-09-12T02:44:07.634075+0000","last_became_peered":"2024-09-12T02:44:07.634075+0000","last_unstale":"2024-09-12T02:44:07.634563+0000","last_undegraded":"2024-09-12T02:44:07.634563+0000","last_fullsized":"2024-09-12T02:44:07.634563+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:04.876463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.642562+0000","last_change":"2024-09-12T02:44:07.640229+0000","last_active":"2024-09-12T02:44:07.642562+0000","last_peered":"2024-09-12T02:44:07.642562+0000","last_clean":"2024-09-12T02:44:07.642562+0000","last_became_active":"2024-09-12T02:44:07.638371+0000","last_became_peered":"2024-09-12T02:44:07.638371+0000","last_unstale":"2024-09-12T02:44:07.642562+0000","last_undegraded":"2024-09-12T02:44:07.642562+0000","last_fullsized":"2024-09-12T02:44:07.642562+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:14.643489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.637624+0000","last_change":"2024-09-12T02:44:07.635924+0000","last_active":"2024-09-12T02:44:07.637624+0000","last_peered":"2024-09-12T02:44:07.637624+0000","last_clean":"2024-09-12T02:44:07.637624+0000","last_became_active":"2024-09-12T02:44:07.635694+0000","last_became_peered":"2024-09-12T02:44:07.635694+0000","last_unstale":"2024-09-12T02:44:07.637624+0000","last_undegraded":"2024-09-12T02:44:07.637624+0000","last_fullsized":"2024-09-12T02:44:07.637624+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:59.967373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.641963+0000","last_change":"2024-09-12T02:44:07.641587+0000","last_active":"2024-09-12T02:44:07.641963+0000","last_peered":"2024-09-12T02:44:07.641963+0000","last_clean":"2024-09-12T02:44:07.641963+0000","last_became_active":"2024-09-12T02:44:07.640457+0000","last_became_peered":"2024-09-12T02:44:07.640457+0000","last_unstale":"2024-09-12T02:44:07.641963+0000","last_undegraded":"2024-09-12T02:44:07.641963+0000","last_fullsized":"2024-09-12T02:44:07.641963+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:05.705126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"63'4","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.654452+0000","last_change":"2024-09-12T02:44:06.621930+0000","last_active":"2024-09-12T02:44:07.654452+0000","last_peered":"2024-09-12T02:44:07.654452+0000","last_clean":"2024-09-12T02:44:07.654452+0000","last_became_active":"2024-09-12T02:44:06.621489+0000","last_became_peered":"2024-09-12T02:44:06.621489+0000","last_unstale":"2024-09-12T02:44:07.654452+0000","last_undegraded":"2024-09-12T02:44:07.654452+0000","last_fullsized":"2024-09-12T02:44:07.654452+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:27.545583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.645178+0000","last_change":"2024-09-12T02:44:07.644479+0000","last_active":"2024-09-12T02:44:07.645178+0000","last_peered":"2024-09-12T02:44:07.645178+0000","last_clean":"2024-09-12T02:44:07.645178+0000","last_became_active":"2024-09-12T02:44:07.644024+0000","last_became_peered":"2024-09-12T02:44:07.644024+0000","last_unstale":"2024-09-12T02:44:07.645178+0000","last_undegraded":"2024-09-12T02:44:07.645178+0000","last_fullsized":"2024-09-12T02:44:07.645178+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:57.987911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"63'1","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.655648+0000","last_change":"2024-09-12T02:44:06.624092+0000","last_active":"2024-09-12T02:44:07.655648+0000","last_peered":"2024-09-12T02:44:07.655648+0000","last_clean":"2024-09-12T02:44:07.655648+0000","last_became_active":"2024-09-12T02:44:06.623854+0000","last_became_peered":"2024-09-12T02:44:06.623854+0000","last_unstale":"2024-09-12T02:44:07.655648+0000","last_undegraded":"2024-09-12T02:44:07.655648+0000","last_fullsized":"2024-09-12T02:44:07.655648+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:24.048066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.646983+0000","last_change":"2024-09-12T02:44:07.646877+0000","last_active":"2024-09-12T02:44:07.646983+0000","last_peered":"2024-09-12T02:44:07.646983+0000","last_clean":"2024-09-12T02:44:07.646983+0000","last_became_active":"2024-09-12T02:44:07.646417+0000","last_became_peered":"2024-09-12T02:44:07.646417+0000","last_unstale":"2024-09-12T02:44:07.646983+0000","last_undegraded":"2024-09-12T02:44:07.646983+0000","last_fullsized":"2024-09-12T02:44:07.646983+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:23.016714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.655045+0000","last_change":"2024-09-12T02:44:06.621395+0000","last_active":"2024-09-12T02:44:07.655045+0000","last_peered":"2024-09-12T02:44:07.655045+0000","last_clean":"2024-09-12T02:44:07.655045+0000","last_became_active":"2024-09-12T02:44:06.620707+0000","last_became_peered":"2024-09-12T02:44:06.620707+0000","last_unstale":"2024-09-12T02:44:07.655045+0000","last_undegraded":"2024-09-12T02:44:07.655045+0000","last_fullsized":"2024-09-12T02:44:07.655045+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:41.948741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.638086+0000","last_change":"2024-09-12T02:44:07.637925+0000","last_active":"2024-09-12T02:44:07.638086+0000","last_peered":"2024-09-12T02:44:07.638086+0000","last_clean":"2024-09-12T02:44:07.638086+0000","last_became_active":"2024-09-12T02:44:07.637686+0000","last_became_peered":"2024-09-12T02:44:07.637686+0000","last_unstale":"2024-09-12T02:44:07.638086+0000","last_undegraded":"2024-09-12T02:44:07.638086+0000","last_fullsized":"2024-09-12T02:44:07.638086+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:22.481936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.655479+0000","last_change":"2024-09-12T02:44:06.625021+0000","last_active":"2024-09-12T02:44:07.655479+0000","last_peered":"2024-09-12T02:44:07.655479+0000","last_clean":"2024-09-12T02:44:07.655479+0000","last_became_active":"2024-09-12T02:44:06.624473+0000","last_became_peered":"2024-09-12T02:44:06.624473+0000","last_unstale":"2024-09-12T02:44:07.655479+0000","last_undegraded":"2024-09-12T02:44:07.655479+0000","last_fullsized":"2024-09-12T02:44:07.655479+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:37:55.092387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.632371+0000","last_change":"2024-09-12T02:44:07.632024+0000","last_active":"2024-09-12T02:44:07.632371+0000","last_peered":"2024-09-12T02:44:07.632371+0000","last_clean":"2024-09-12T02:44:07.632371+0000","last_became_active":"2024-09-12T02:44:07.631771+0000","last_became_peered":"2024-09-12T02:44:07.631771+0000","last_unstale":"2024-09-12T02:44:07.632371+0000","last_undegraded":"2024-09-12T02:44:07.632371+0000","last_fullsized":"2024-09-12T02:44:07.632371+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:16:59.225888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"63'1","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.653111+0000","last_change":"2024-09-12T02:44:06.622413+0000","last_active":"2024-09-12T02:44:07.653111+0000","last_peered":"2024-09-12T02:44:07.653111+0000","last_clean":"2024-09-12T02:44:07.653111+0000","last_became_active":"2024-09-12T02:44:06.621970+0000","last_became_peered":"2024-09-12T02:44:06.621970+0000","last_unstale":"2024-09-12T02:44:07.653111+0000","last_undegraded":"2024-09-12T02:44:07.653111+0000","last_fullsized":"2024-09-12T02:44:07.653111+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:07.907791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.643803+0000","last_change":"2024-09-12T02:44:07.643090+0000","last_active":"2024-09-12T02:44:07.643803+0000","last_peered":"2024-09-12T02:44:07.643803+0000","last_clean":"2024-09-12T02:44:07.643803+0000","last_became_active":"2024-09-12T02:44:07.642310+0000","last_became_peered":"2024-09-12T02:44:07.642310+0000","last_unstale":"2024-09-12T02:44:07.643803+0000","last_undegraded":"2024-09-12T02:44:07.643803+0000","last_fullsized":"2024-09-12T02:44:07.643803+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:43.388572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"63'1","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.654683+0000","last_change":"2024-09-12T02:44:06.619726+0000","last_active":"2024-09-12T02:44:07.654683+0000","last_peered":"2024-09-12T02:44:07.654683+0000","last_clean":"2024-09-12T02:44:07.654683+0000","last_became_active":"2024-09-12T02:44:06.617949+0000","last_became_peered":"2024-09-12T02:44:06.617949+0000","last_unstale":"2024-09-12T02:44:07.654683+0000","last_undegraded":"2024-09-12T02:44:07.654683+0000","last_fullsized":"2024-09-12T02:44:07.654683+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:47.323575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.637059+0000","last_change":"2024-09-12T02:44:07.636142+0000","last_active":"2024-09-12T02:44:07.637059+0000","last_peered":"2024-09-12T02:44:07.637059+0000","last_clean":"2024-09-12T02:44:07.637059+0000","last_became_active":"2024-09-12T02:44:07.634808+0000","last_became_peered":"2024-09-12T02:44:07.634808+0000","last_unstale":"2024-09-12T02:44:07.637059+0000","last_undegraded":"2024-09-12T02:44:07.637059+0000","last_fullsized":"2024-09-12T02:44:07.637059+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:58.689886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.633969+0000","last_change":"2024-09-12T02:44:06.618070+0000","last_active":"2024-09-12T02:44:07.633969+0000","last_peered":"2024-09-12T02:44:07.633969+0000","last_clean":"2024-09-12T02:44:07.633969+0000","last_became_active":"2024-09-12T02:44:06.617819+0000","last_became_peered":"2024-09-12T02:44:06.617819+0000","last_unstale":"2024-09-12T02:44:07.633969+0000","last_undegraded":"2024-09-12T02:44:07.633969+0000","last_fullsized":"2024-09-12T02:44:07.633969+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:17.682485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.627801+0000","last_change":"2024-09-12T02:44:07.627539+0000","last_active":"2024-09-12T02:44:07.627801+0000","last_peered":"2024-09-12T02:44:07.627801+0000","last_clean":"2024-09-12T02:44:07.627801+0000","last_became_active":"2024-09-12T02:44:07.627273+0000","last_became_peered":"2024-09-12T02:44:07.627273+0000","last_unstale":"2024-09-12T02:44:07.627801+0000","last_undegraded":"2024-09-12T02:44:07.627801+0000","last_fullsized":"2024-09-12T02:44:07.627801+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:27.403872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.626063+0000","last_change":"2024-09-12T02:44:06.619419+0000","last_active":"2024-09-12T02:44:07.626063+0000","last_peered":"2024-09-12T02:44:07.626063+0000","last_clean":"2024-09-12T02:44:07.626063+0000","last_became_active":"2024-09-12T02:44:06.617138+0000","last_became_peered":"2024-09-12T02:44:06.617138+0000","last_unstale":"2024-09-12T02:44:07.626063+0000","last_undegraded":"2024-09-12T02:44:07.626063+0000","last_fullsized":"2024-09-12T02:44:07.626063+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:44.681143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.643266+0000","last_change":"2024-09-12T02:44:07.643100+0000","last_active":"2024-09-12T02:44:07.643266+0000","last_peered":"2024-09-12T02:44:07.643266+0000","last_clean":"2024-09-12T02:44:07.643266+0000","last_became_active":"2024-09-12T02:44:07.642816+0000","last_became_peered":"2024-09-12T02:44:07.642816+0000","last_unstale":"2024-09-12T02:44:07.643266+0000","last_undegraded":"2024-09-12T02:44:07.643266+0000","last_fullsized":"2024-09-12T02:44:07.643266+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:00.882378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.632269+0000","last_change":"2024-09-12T02:44:06.626271+0000","last_active":"2024-09-12T02:44:07.632269+0000","last_peered":"2024-09-12T02:44:07.632269+0000","last_clean":"2024-09-12T02:44:07.632269+0000","last_became_active":"2024-09-12T02:44:06.625674+0000","last_became_peered":"2024-09-12T02:44:06.625674+0000","last_unstale":"2024-09-12T02:44:07.632269+0000","last_undegraded":"2024-09-12T02:44:07.632269+0000","last_fullsized":"2024-09-12T02:44:07.632269+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:38.384642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.645561+0000","last_change":"2024-09-12T02:44:07.645448+0000","last_active":"2024-09-12T02:44:07.645561+0000","last_peered":"2024-09-12T02:44:07.645561+0000","last_clean":"2024-09-12T02:44:07.645561+0000","last_became_active":"2024-09-12T02:44:07.644843+0000","last_became_peered":"2024-09-12T02:44:07.644843+0000","last_unstale":"2024-09-12T02:44:07.645561+0000","last_undegraded":"2024-09-12T02:44:07.645561+0000","last_fullsized":"2024-09-12T02:44:07.645561+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:31.331987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.627881+0000","last_change":"2024-09-12T02:44:06.623562+0000","last_active":"2024-09-12T02:44:07.627881+0000","last_peered":"2024-09-12T02:44:07.627881+0000","last_clean":"2024-09-12T02:44:07.627881+0000","last_became_active":"2024-09-12T02:44:06.623337+0000","last_became_peered":"2024-09-12T02:44:06.623337+0000","last_unstale":"2024-09-12T02:44:07.627881+0000","last_undegraded":"2024-09-12T02:44:07.627881+0000","last_fullsized":"2024-09-12T02:44:07.627881+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:35.263368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.645048+0000","last_change":"2024-09-12T02:44:07.643300+0000","last_active":"2024-09-12T02:44:07.645048+0000","last_peered":"2024-09-12T02:44:07.645048+0000","last_clean":"2024-09-12T02:44:07.645048+0000","last_became_active":"2024-09-12T02:44:07.643015+0000","last_became_peered":"2024-09-12T02:44:07.643015+0000","last_unstale":"2024-09-12T02:44:07.645048+0000","last_undegraded":"2024-09-12T02:44:07.645048+0000","last_fullsized":"2024-09-12T02:44:07.645048+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:07.931996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"63'3","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.657067+0000","last_change":"2024-09-12T02:44:06.626834+0000","last_active":"2024-09-12T02:44:07.657067+0000","last_peered":"2024-09-12T02:44:07.657067+0000","last_clean":"2024-09-12T02:44:07.657067+0000","last_became_active":"2024-09-12T02:44:06.626505+0000","last_became_peered":"2024-09-12T02:44:06.626505+0000","last_unstale":"2024-09-12T02:44:07.657067+0000","last_undegraded":"2024-09-12T02:44:07.657067+0000","last_fullsized":"2024-09-12T02:44:07.657067+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:20.596672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.643246+0000","last_change":"2024-09-12T02:44:07.643004+0000","last_active":"2024-09-12T02:44:07.643246+0000","last_peered":"2024-09-12T02:44:07.643246+0000","last_clean":"2024-09-12T02:44:07.643246+0000","last_became_active":"2024-09-12T02:44:07.642515+0000","last_became_peered":"2024-09-12T02:44:07.642515+0000","last_unstale":"2024-09-12T02:44:07.643246+0000","last_undegraded":"2024-09-12T02:44:07.643246+0000","last_fullsized":"2024-09-12T02:44:07.643246+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:34.641352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"63'6","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.656435+0000","last_change":"2024-09-12T02:44:06.620075+0000","last_active":"2024-09-12T02:44:07.656435+0000","last_peered":"2024-09-12T02:44:07.656435+0000","last_clean":"2024-09-12T02:44:07.656435+0000","last_became_active":"2024-09-12T02:44:06.619775+0000","last_became_peered":"2024-09-12T02:44:06.619775+0000","last_unstale":"2024-09-12T02:44:07.656435+0000","last_undegraded":"2024-09-12T02:44:07.656435+0000","last_fullsized":"2024-09-12T02:44:07.656435+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:26.666227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.644565+0000","last_change":"2024-09-12T02:44:07.644416+0000","last_active":"2024-09-12T02:44:07.644565+0000","last_peered":"2024-09-12T02:44:07.644565+0000","last_clean":"2024-09-12T02:44:07.644565+0000","last_became_active":"2024-09-12T02:44:07.644147+0000","last_became_peered":"2024-09-12T02:44:07.644147+0000","last_unstale":"2024-09-12T02:44:07.644565+0000","last_undegraded":"2024-09-12T02:44:07.644565+0000","last_fullsized":"2024-09-12T02:44:07.644565+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:38.503324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.653459+0000","last_change":"2024-09-12T02:44:06.620886+0000","last_active":"2024-09-12T02:44:07.653459+0000","last_peered":"2024-09-12T02:44:07.653459+0000","last_clean":"2024-09-12T02:44:07.653459+0000","last_became_active":"2024-09-12T02:44:06.620618+0000","last_became_peered":"2024-09-12T02:44:06.620618+0000","last_unstale":"2024-09-12T02:44:07.653459+0000","last_undegraded":"2024-09-12T02:44:07.653459+0000","last_fullsized":"2024-09-12T02:44:07.653459+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:31.840905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.635904+0000","last_change":"2024-09-12T02:44:07.634974+0000","last_active":"2024-09-12T02:44:07.635904+0000","last_peered":"2024-09-12T02:44:07.635904+0000","last_clean":"2024-09-12T02:44:07.635904+0000","last_became_active":"2024-09-12T02:44:07.634714+0000","last_became_peered":"2024-09-12T02:44:07.634714+0000","last_unstale":"2024-09-12T02:44:07.635904+0000","last_undegraded":"2024-09-12T02:44:07.635904+0000","last_fullsized":"2024-09-12T02:44:07.635904+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:23.157215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.624186+0000","last_change":"2024-09-12T02:44:06.624222+0000","last_active":"2024-09-12T02:44:07.624186+0000","last_peered":"2024-09-12T02:44:07.624186+0000","last_clean":"2024-09-12T02:44:07.624186+0000","last_became_active":"2024-09-12T02:44:06.623970+0000","last_became_peered":"2024-09-12T02:44:06.623970+0000","last_unstale":"2024-09-12T02:44:07.624186+0000","last_undegraded":"2024-09-12T02:44:07.624186+0000","last_fullsized":"2024-09-12T02:44:07.624186+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:44.344006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.634371+0000","last_change":"2024-09-12T02:44:07.634175+0000","last_active":"2024-09-12T02:44:07.634371+0000","last_peered":"2024-09-12T02:44:07.634371+0000","last_clean":"2024-09-12T02:44:07.634371+0000","last_became_active":"2024-09-12T02:44:07.633909+0000","last_became_peered":"2024-09-12T02:44:07.633909+0000","last_unstale":"2024-09-12T02:44:07.634371+0000","last_undegraded":"2024-09-12T02:44:07.634371+0000","last_fullsized":"2024-09-12T02:44:07.634371+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:06.515571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.634590+0000","last_change":"2024-09-12T02:44:06.624573+0000","last_active":"2024-09-12T02:44:07.634590+0000","last_peered":"2024-09-12T02:44:07.634590+0000","last_clean":"2024-09-12T02:44:07.634590+0000","last_became_active":"2024-09-12T02:44:06.623572+0000","last_became_peered":"2024-09-12T02:44:06.623572+0000","last_unstale":"2024-09-12T02:44:07.634590+0000","last_undegraded":"2024-09-12T02:44:07.634590+0000","last_fullsized":"2024-09-12T02:44:07.634590+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:55.163491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.634545+0000","last_change":"2024-09-12T02:44:07.633848+0000","last_active":"2024-09-12T02:44:07.634545+0000","last_peered":"2024-09-12T02:44:07.634545+0000","last_clean":"2024-09-12T02:44:07.634545+0000","last_became_active":"2024-09-12T02:44:07.633579+0000","last_became_peered":"2024-09-12T02:44:07.633579+0000","last_unstale":"2024-09-12T02:44:07.634545+0000","last_undegraded":"2024-09-12T02:44:07.634545+0000","last_fullsized":"2024-09-12T02:44:07.634545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:45.413102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"63'8","reported_seq":20,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.656026+0000","last_change":"2024-09-12T02:44:06.626113+0000","last_active":"2024-09-12T02:44:07.656026+0000","last_peered":"2024-09-12T02:44:07.656026+0000","last_clean":"2024-09-12T02:44:07.656026+0000","last_became_active":"2024-09-12T02:44:06.623951+0000","last_became_peered":"2024-09-12T02:44:06.623951+0000","last_unstale":"2024-09-12T02:44:07.656026+0000","last_undegraded":"2024-09-12T02:44:07.656026+0000","last_fullsized":"2024-09-12T02:44:07.656026+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:07.788024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.640990+0000","last_change":"2024-09-12T02:44:07.640837+0000","last_active":"2024-09-12T02:44:07.640990+0000","last_peered":"2024-09-12T02:44:07.640990+0000","last_clean":"2024-09-12T02:44:07.640990+0000","last_became_active":"2024-09-12T02:44:07.640564+0000","last_became_peered":"2024-09-12T02:44:07.640564+0000","last_unstale":"2024-09-12T02:44:07.640990+0000","last_undegraded":"2024-09-12T02:44:07.640990+0000","last_fullsized":"2024-09-12T02:44:07.640990+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:57.907067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"63'1","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.653699+0000","last_change":"2024-09-12T02:44:06.621984+0000","last_active":"2024-09-12T02:44:07.653699+0000","last_peered":"2024-09-12T02:44:07.653699+0000","last_clean":"2024-09-12T02:44:07.653699+0000","last_became_active":"2024-09-12T02:44:06.621783+0000","last_became_peered":"2024-09-12T02:44:06.621783+0000","last_unstale":"2024-09-12T02:44:07.653699+0000","last_undegraded":"2024-09-12T02:44:07.653699+0000","last_fullsized":"2024-09-12T02:44:07.653699+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:59.160750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.645207+0000","last_change":"2024-09-12T02:44:07.644792+0000","last_active":"2024-09-12T02:44:07.645207+0000","last_peered":"2024-09-12T02:44:07.645207+0000","last_clean":"2024-09-12T02:44:07.645207+0000","last_became_active":"2024-09-12T02:44:07.644134+0000","last_became_peered":"2024-09-12T02:44:07.644134+0000","last_unstale":"2024-09-12T02:44:07.645207+0000","last_undegraded":"2024-09-12T02:44:07.645207+0000","last_fullsized":"2024-09-12T02:44:07.645207+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:20:30.623253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.654614+0000","last_change":"2024-09-12T02:44:06.621560+0000","last_active":"2024-09-12T02:44:07.654614+0000","last_peered":"2024-09-12T02:44:07.654614+0000","last_clean":"2024-09-12T02:44:07.654614+0000","last_became_active":"2024-09-12T02:44:06.621040+0000","last_became_peered":"2024-09-12T02:44:06.621040+0000","last_unstale":"2024-09-12T02:44:07.654614+0000","last_undegraded":"2024-09-12T02:44:07.654614+0000","last_fullsized":"2024-09-12T02:44:07.654614+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:18.782382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.628959+0000","last_change":"2024-09-12T02:44:07.628843+0000","last_active":"2024-09-12T02:44:07.628959+0000","last_peered":"2024-09-12T02:44:07.628959+0000","last_clean":"2024-09-12T02:44:07.628959+0000","last_became_active":"2024-09-12T02:44:07.628260+0000","last_became_peered":"2024-09-12T02:44:07.628260+0000","last_unstale":"2024-09-12T02:44:07.628959+0000","last_undegraded":"2024-09-12T02:44:07.628959+0000","last_fullsized":"2024-09-12T02:44:07.628959+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:49.130483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"63'1","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.655614+0000","last_change":"2024-09-12T02:44:06.624756+0000","last_active":"2024-09-12T02:44:07.655614+0000","last_peered":"2024-09-12T02:44:07.655614+0000","last_clean":"2024-09-12T02:44:07.655614+0000","last_became_active":"2024-09-12T02:44:06.623727+0000","last_became_peered":"2024-09-12T02:44:06.623727+0000","last_unstale":"2024-09-12T02:44:07.655614+0000","last_undegraded":"2024-09-12T02:44:07.655614+0000","last_fullsized":"2024-09-12T02:44:07.655614+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:57.069795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.645750+0000","last_change":"2024-09-12T02:44:07.645654+0000","last_active":"2024-09-12T02:44:07.645750+0000","last_peered":"2024-09-12T02:44:07.645750+0000","last_clean":"2024-09-12T02:44:07.645750+0000","last_became_active":"2024-09-12T02:44:07.645217+0000","last_became_peered":"2024-09-12T02:44:07.645217+0000","last_unstale":"2024-09-12T02:44:07.645750+0000","last_undegraded":"2024-09-12T02:44:07.645750+0000","last_fullsized":"2024-09-12T02:44:07.645750+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:32.512907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.635048+0000","last_change":"2024-09-12T02:44:06.623344+0000","last_active":"2024-09-12T02:44:07.635048+0000","last_peered":"2024-09-12T02:44:07.635048+0000","last_clean":"2024-09-12T02:44:07.635048+0000","last_became_active":"2024-09-12T02:44:06.622929+0000","last_became_peered":"2024-09-12T02:44:06.622929+0000","last_unstale":"2024-09-12T02:44:07.635048+0000","last_undegraded":"2024-09-12T02:44:07.635048+0000","last_fullsized":"2024-09-12T02:44:07.635048+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:20.465064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.645247+0000","last_change":"2024-09-12T02:44:07.645012+0000","last_active":"2024-09-12T02:44:07.645247+0000","last_peered":"2024-09-12T02:44:07.645247+0000","last_clean":"2024-09-12T02:44:07.645247+0000","last_became_active":"2024-09-12T02:44:07.644542+0000","last_became_peered":"2024-09-12T02:44:07.644542+0000","last_unstale":"2024-09-12T02:44:07.645247+0000","last_undegraded":"2024-09-12T02:44:07.645247+0000","last_fullsized":"2024-09-12T02:44:07.645247+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:27.061931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.653902+0000","last_change":"2024-09-12T02:44:06.615146+0000","last_active":"2024-09-12T02:44:07.653902+0000","last_peered":"2024-09-12T02:44:07.653902+0000","last_clean":"2024-09-12T02:44:07.653902+0000","last_became_active":"2024-09-12T02:44:06.614913+0000","last_became_peered":"2024-09-12T02:44:06.614913+0000","last_unstale":"2024-09-12T02:44:07.653902+0000","last_undegraded":"2024-09-12T02:44:07.653902+0000","last_fullsized":"2024-09-12T02:44:07.653902+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:57.775910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.638620+0000","last_change":"2024-09-12T02:44:07.638471+0000","last_active":"2024-09-12T02:44:07.638620+0000","last_peered":"2024-09-12T02:44:07.638620+0000","last_clean":"2024-09-12T02:44:07.638620+0000","last_became_active":"2024-09-12T02:44:07.637248+0000","last_became_peered":"2024-09-12T02:44:07.637248+0000","last_unstale":"2024-09-12T02:44:07.638620+0000","last_undegraded":"2024-09-12T02:44:07.638620+0000","last_fullsized":"2024-09-12T02:44:07.638620+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:38.199387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.634254+0000","last_change":"2024-09-12T02:44:06.621422+0000","last_active":"2024-09-12T02:44:07.634254+0000","last_peered":"2024-09-12T02:44:07.634254+0000","last_clean":"2024-09-12T02:44:07.634254+0000","last_became_active":"2024-09-12T02:44:06.620971+0000","last_became_peered":"2024-09-12T02:44:06.620971+0000","last_unstale":"2024-09-12T02:44:07.634254+0000","last_undegraded":"2024-09-12T02:44:07.634254+0000","last_fullsized":"2024-09-12T02:44:07.634254+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:53.553824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.641983+0000","last_change":"2024-09-12T02:44:07.641802+0000","last_active":"2024-09-12T02:44:07.641983+0000","last_peered":"2024-09-12T02:44:07.641983+0000","last_clean":"2024-09-12T02:44:07.641983+0000","last_became_active":"2024-09-12T02:44:07.641595+0000","last_became_peered":"2024-09-12T02:44:07.641595+0000","last_unstale":"2024-09-12T02:44:07.641983+0000","last_undegraded":"2024-09-12T02:44:07.641983+0000","last_fullsized":"2024-09-12T02:44:07.641983+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:16.244941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.632879+0000","last_change":"2024-09-12T02:44:06.613007+0000","last_active":"2024-09-12T02:44:07.632879+0000","last_peered":"2024-09-12T02:44:07.632879+0000","last_clean":"2024-09-12T02:44:07.632879+0000","last_became_active":"2024-09-12T02:44:06.612629+0000","last_became_peered":"2024-09-12T02:44:06.612629+0000","last_unstale":"2024-09-12T02:44:07.632879+0000","last_undegraded":"2024-09-12T02:44:07.632879+0000","last_fullsized":"2024-09-12T02:44:07.632879+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:11.145842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.637723+0000","last_change":"2024-09-12T02:44:07.637048+0000","last_active":"2024-09-12T02:44:07.637723+0000","last_peered":"2024-09-12T02:44:07.637723+0000","last_clean":"2024-09-12T02:44:07.637723+0000","last_became_active":"2024-09-12T02:44:07.636783+0000","last_became_peered":"2024-09-12T02:44:07.636783+0000","last_unstale":"2024-09-12T02:44:07.637723+0000","last_undegraded":"2024-09-12T02:44:07.637723+0000","last_fullsized":"2024-09-12T02:44:07.637723+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:32.664471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.655488+0000","last_change":"2024-09-12T02:44:06.613948+0000","last_active":"2024-09-12T02:44:07.655488+0000","last_peered":"2024-09-12T02:44:07.655488+0000","last_clean":"2024-09-12T02:44:07.655488+0000","last_became_active":"2024-09-12T02:44:06.613722+0000","last_became_peered":"2024-09-12T02:44:06.613722+0000","last_unstale":"2024-09-12T02:44:07.655488+0000","last_undegraded":"2024-09-12T02:44:07.655488+0000","last_fullsized":"2024-09-12T02:44:07.655488+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:36.820981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.642251+0000","last_change":"2024-09-12T02:44:07.642112+0000","last_active":"2024-09-12T02:44:07.642251+0000","last_peered":"2024-09-12T02:44:07.642251+0000","last_clean":"2024-09-12T02:44:07.642251+0000","last_became_active":"2024-09-12T02:44:07.641736+0000","last_became_peered":"2024-09-12T02:44:07.641736+0000","last_unstale":"2024-09-12T02:44:07.642251+0000","last_undegraded":"2024-09-12T02:44:07.642251+0000","last_fullsized":"2024-09-12T02:44:07.642251+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:15.565701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.634503+0000","last_change":"2024-09-12T02:44:06.620442+0000","last_active":"2024-09-12T02:44:07.634503+0000","last_peered":"2024-09-12T02:44:07.634503+0000","last_clean":"2024-09-12T02:44:07.634503+0000","last_became_active":"2024-09-12T02:44:06.620172+0000","last_became_peered":"2024-09-12T02:44:06.620172+0000","last_unstale":"2024-09-12T02:44:07.634503+0000","last_undegraded":"2024-09-12T02:44:07.634503+0000","last_fullsized":"2024-09-12T02:44:07.634503+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:28.931010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.640657+0000","last_change":"2024-09-12T02:44:07.636730+0000","last_active":"2024-09-12T02:44:07.640657+0000","last_peered":"2024-09-12T02:44:07.640657+0000","last_clean":"2024-09-12T02:44:07.640657+0000","last_became_active":"2024-09-12T02:44:07.636470+0000","last_became_peered":"2024-09-12T02:44:07.636470+0000","last_unstale":"2024-09-12T02:44:07.640657+0000","last_undegraded":"2024-09-12T02:44:07.640657+0000","last_fullsized":"2024-09-12T02:44:07.640657+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:56.633705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.624516+0000","last_change":"2024-09-12T02:44:06.616304+0000","last_active":"2024-09-12T02:44:07.624516+0000","last_peered":"2024-09-12T02:44:07.624516+0000","last_clean":"2024-09-12T02:44:07.624516+0000","last_became_active":"2024-09-12T02:44:06.616013+0000","last_became_peered":"2024-09-12T02:44:06.616013+0000","last_unstale":"2024-09-12T02:44:07.624516+0000","last_undegraded":"2024-09-12T02:44:07.624516+0000","last_fullsized":"2024-09-12T02:44:07.624516+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:33.406489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.637220+0000","last_change":"2024-09-12T02:44:07.636912+0000","last_active":"2024-09-12T02:44:07.637220+0000","last_peered":"2024-09-12T02:44:07.637220+0000","last_clean":"2024-09-12T02:44:07.637220+0000","last_became_active":"2024-09-12T02:44:07.636689+0000","last_became_peered":"2024-09-12T02:44:07.636689+0000","last_unstale":"2024-09-12T02:44:07.637220+0000","last_undegraded":"2024-09-12T02:44:07.637220+0000","last_fullsized":"2024-09-12T02:44:07.637220+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:25.292003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.631206+0000","last_change":"2024-09-12T02:44:06.617026+0000","last_active":"2024-09-12T02:44:07.631206+0000","last_peered":"2024-09-12T02:44:07.631206+0000","last_clean":"2024-09-12T02:44:07.631206+0000","last_became_active":"2024-09-12T02:44:06.616768+0000","last_became_peered":"2024-09-12T02:44:06.616768+0000","last_unstale":"2024-09-12T02:44:07.631206+0000","last_undegraded":"2024-09-12T02:44:07.631206+0000","last_fullsized":"2024-09-12T02:44:07.631206+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:32.491624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.645433+0000","last_change":"2024-09-12T02:44:07.645314+0000","last_active":"2024-09-12T02:44:07.645433+0000","last_peered":"2024-09-12T02:44:07.645433+0000","last_clean":"2024-09-12T02:44:07.645433+0000","last_became_active":"2024-09-12T02:44:07.644660+0000","last_became_peered":"2024-09-12T02:44:07.644660+0000","last_unstale":"2024-09-12T02:44:07.645433+0000","last_undegraded":"2024-09-12T02:44:07.645433+0000","last_fullsized":"2024-09-12T02:44:07.645433+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:39:24.581758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.635590+0000","last_change":"2024-09-12T02:44:06.614105+0000","last_active":"2024-09-12T02:44:07.635590+0000","last_peered":"2024-09-12T02:44:07.635590+0000","last_clean":"2024-09-12T02:44:07.635590+0000","last_became_active":"2024-09-12T02:44:06.613496+0000","last_became_peered":"2024-09-12T02:44:06.613496+0000","last_unstale":"2024-09-12T02:44:07.635590+0000","last_undegraded":"2024-09-12T02:44:07.635590+0000","last_fullsized":"2024-09-12T02:44:07.635590+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:09.405109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.635935+0000","last_change":"2024-09-12T02:44:07.635541+0000","last_active":"2024-09-12T02:44:07.635935+0000","last_peered":"2024-09-12T02:44:07.635935+0000","last_clean":"2024-09-12T02:44:07.635935+0000","last_became_active":"2024-09-12T02:44:07.634963+0000","last_became_peered":"2024-09-12T02:44:07.634963+0000","last_unstale":"2024-09-12T02:44:07.635935+0000","last_undegraded":"2024-09-12T02:44:07.635935+0000","last_fullsized":"2024-09-12T02:44:07.635935+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:14.394498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.626497+0000","last_change":"2024-09-12T02:44:06.622209+0000","last_active":"2024-09-12T02:44:07.626497+0000","last_peered":"2024-09-12T02:44:07.626497+0000","last_clean":"2024-09-12T02:44:07.626497+0000","last_became_active":"2024-09-12T02:44:06.621628+0000","last_became_peered":"2024-09-12T02:44:06.621628+0000","last_unstale":"2024-09-12T02:44:07.626497+0000","last_undegraded":"2024-09-12T02:44:07.626497+0000","last_fullsized":"2024-09-12T02:44:07.626497+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:43.889039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.634864+0000","last_change":"2024-09-12T02:44:07.634740+0000","last_active":"2024-09-12T02:44:07.634864+0000","last_peered":"2024-09-12T02:44:07.634864+0000","last_clean":"2024-09-12T02:44:07.634864+0000","last_became_active":"2024-09-12T02:44:07.634501+0000","last_became_peered":"2024-09-12T02:44:07.634501+0000","last_unstale":"2024-09-12T02:44:07.634864+0000","last_undegraded":"2024-09-12T02:44:07.634864+0000","last_fullsized":"2024-09-12T02:44:07.634864+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:23.108644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.633463+0000","last_change":"2024-09-12T02:44:06.620211+0000","last_active":"2024-09-12T02:44:07.633463+0000","last_peered":"2024-09-12T02:44:07.633463+0000","last_clean":"2024-09-12T02:44:07.633463+0000","last_became_active":"2024-09-12T02:44:06.619968+0000","last_became_peered":"2024-09-12T02:44:06.619968+0000","last_unstale":"2024-09-12T02:44:07.633463+0000","last_undegraded":"2024-09-12T02:44:07.633463+0000","last_fullsized":"2024-09-12T02:44:07.633463+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:21.008320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.627342+0000","last_change":"2024-09-12T02:44:07.627197+0000","last_active":"2024-09-12T02:44:07.627342+0000","last_peered":"2024-09-12T02:44:07.627342+0000","last_clean":"2024-09-12T02:44:07.627342+0000","last_became_active":"2024-09-12T02:44:07.626935+0000","last_became_peered":"2024-09-12T02:44:07.626935+0000","last_unstale":"2024-09-12T02:44:07.627342+0000","last_undegraded":"2024-09-12T02:44:07.627342+0000","last_fullsized":"2024-09-12T02:44:07.627342+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:03.729281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.626495+0000","last_change":"2024-09-12T02:44:06.611581+0000","last_active":"2024-09-12T02:44:07.626495+0000","last_peered":"2024-09-12T02:44:07.626495+0000","last_clean":"2024-09-12T02:44:07.626495+0000","last_became_active":"2024-09-12T02:44:06.610832+0000","last_became_peered":"2024-09-12T02:44:06.610832+0000","last_unstale":"2024-09-12T02:44:07.626495+0000","last_undegraded":"2024-09-12T02:44:07.626495+0000","last_fullsized":"2024-09-12T02:44:07.626495+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:50.323894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.635376+0000","last_change":"2024-09-12T02:44:07.635243+0000","last_active":"2024-09-12T02:44:07.635376+0000","last_peered":"2024-09-12T02:44:07.635376+0000","last_clean":"2024-09-12T02:44:07.635376+0000","last_became_active":"2024-09-12T02:44:07.635009+0000","last_became_peered":"2024-09-12T02:44:07.635009+0000","last_unstale":"2024-09-12T02:44:07.635376+0000","last_undegraded":"2024-09-12T02:44:07.635376+0000","last_fullsized":"2024-09-12T02:44:07.635376+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:37.665724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.624718+0000","last_change":"2024-09-12T02:44:06.611975+0000","last_active":"2024-09-12T02:44:07.624718+0000","last_peered":"2024-09-12T02:44:07.624718+0000","last_clean":"2024-09-12T02:44:07.624718+0000","last_became_active":"2024-09-12T02:44:06.611015+0000","last_became_peered":"2024-09-12T02:44:06.611015+0000","last_unstale":"2024-09-12T02:44:07.624718+0000","last_undegraded":"2024-09-12T02:44:07.624718+0000","last_fullsized":"2024-09-12T02:44:07.624718+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:25.663670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":250,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.629985+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:44:07.629985+0000","last_peered":"2024-09-12T02:44:07.629985+0000","last_clean":"2024-09-12T02:44:07.629985+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:44:07.629985+0000","last_undegraded":"2024-09-12T02:44:07.629985+0000","last_fullsized":"2024-09-12T02:44:07.629985+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:19.941592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":883,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194428,"statfs":{"total":200000000,"available":199095014,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":313,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194998,"statfs":{"total":200000000,"available":199678607,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":307,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195005,"statfs":{"total":200000000,"available":199685382,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":307,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195005,"statfs":{"total":200000000,"available":199685382,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":307,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195005,"statfs":{"total":200000000,"available":199685382,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":307,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195005,"statfs":{"total":200000000,"available":199685382,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":307,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195005,"statfs":{"total":200000000,"available":199685382,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":892,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194419,"statfs":{"total":200000000,"available":199086045,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:44:11.807 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:44:11.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.994+0000 7f12a7200640 1 Processor -- start 2024-09-12T02:44:11.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.995+0000 7f12a7200640 1 -- start start 2024-09-12T02:44:11.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.996+0000 7f12a7200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12a015b9d0 0x7f12a00b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:11.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.996+0000 7f12a7200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f12a006f600 0x7f12a00728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:11.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.996+0000 7f12a7200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12a00b54a0 con 0x7f12a00b45d0 2024-09-12T02:44:11.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.996+0000 7f12a7200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f12a00b4a30 con 0x7f12a006f600 2024-09-12T02:44:11.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.996+0000 7f12a7200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f12a00b3af0 con 0x7f12a015b9d0 2024-09-12T02:44:11.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.996+0000 7f1297400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f12a00b45d0 0x7f12a006eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:56440/0 (socket says 172.21.15.112:56440) 2024-09-12T02:44:11.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.996+0000 7f1297400640 1 -- 172.21.15.112:0/126349318 learned_addr learned my addr 172.21.15.112:0/126349318 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:44:11.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.996+0000 7f129fe00640 1 --2- 172.21.15.112:0/126349318 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12a015b9d0 0x7f12a00b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:11.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.996+0000 7f12a5200640 1 --2- 172.21.15.112:0/126349318 >> v2:172.21.15.137:3300/0 conn(0x7f12a006f600 0x7f12a00728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:11.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.996+0000 7f129f400640 1 -- 172.21.15.112:0/126349318 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 958670365 0 0) 0x7f12a00b54a0 con 0x7f12a00b45d0 2024-09-12T02:44:11.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.996+0000 7f129f400640 1 -- 172.21.15.112:0/126349318 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1284003520 con 0x7f12a00b45d0 2024-09-12T02:44:11.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.997+0000 7f129f400640 1 -- 172.21.15.112:0/126349318 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2472578836 0 0) 0x7f1284003520 con 0x7f12a00b45d0 2024-09-12T02:44:11.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.997+0000 7f129f400640 1 -- 172.21.15.112:0/126349318 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12a015b9d0 msgr2=0x7f12a00b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:11.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.997+0000 7f129f400640 1 --2- 172.21.15.112:0/126349318 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12a015b9d0 0x7f12a00b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:11.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.997+0000 7f129f400640 1 -- 172.21.15.112:0/126349318 >> v2:172.21.15.137:3300/0 conn(0x7f12a006f600 msgr2=0x7f12a00728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:11.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.997+0000 7f129f400640 1 --2- 172.21.15.112:0/126349318 >> v2:172.21.15.137:3300/0 conn(0x7f12a006f600 0x7f12a00728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:11.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.997+0000 7f129f400640 1 -- 172.21.15.112:0/126349318 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a00b3dd0 con 0x7f12a00b45d0 2024-09-12T02:44:11.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.997+0000 7f129f400640 1 -- 172.21.15.112:0/126349318 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f12880017f0 con 0x7f12a00b45d0 2024-09-12T02:44:12.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.997+0000 7f129f400640 1 -- 172.21.15.112:0/126349318 >> v1:172.21.15.112:6789/0 conn(0x7f12a00b45d0 legacy=0x7f12a006eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:12.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.997+0000 7f129f400640 1 --2- 172.21.15.112:0/126349318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12840039e0 0x7f1284003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:12.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.997+0000 7f129f400640 1 --2- 172.21.15.112:0/126349318 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12a015b9d0 0x7f1284004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:12.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.997+0000 7f129f400640 1 --2- 172.21.15.112:0/126349318 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1284004d40 0x7f12840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:12.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.997+0000 7f129f400640 1 -- 172.21.15.112:0/126349318 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f12a00b4a30 con 0x7f1284004d40 2024-09-12T02:44:12.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.997+0000 7f129f400640 1 -- 172.21.15.112:0/126349318 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f12a00b3af0 con 0x7f12840039e0 2024-09-12T02:44:12.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.997+0000 7f129f400640 1 -- 172.21.15.112:0/126349318 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f128400b9c0 con 0x7f12a015b9d0 2024-09-12T02:44:12.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.997+0000 7f12a5200640 1 --2- 172.21.15.112:0/126349318 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1284004d40 0x7f12840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:12.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.997+0000 7f1297400640 1 --2- 172.21.15.112:0/126349318 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12a015b9d0 0x7f1284004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:12.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.997+0000 7f129fe00640 1 --2- 172.21.15.112:0/126349318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12840039e0 0x7f1284003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:12.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.998+0000 7f12a5200640 1 -- 172.21.15.112:0/126349318 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12a015b9d0 msgr2=0x7f1284004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:12.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.998+0000 7f12a5200640 1 --2- 172.21.15.112:0/126349318 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12a015b9d0 0x7f1284004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:12.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.998+0000 7f12a5200640 1 -- 172.21.15.112:0/126349318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12840039e0 msgr2=0x7f1284003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:12.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.998+0000 7f12a5200640 1 --2- 172.21.15.112:0/126349318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12840039e0 0x7f1284003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:12.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.998+0000 7f12a5200640 1 -- 172.21.15.112:0/126349318 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1284003520 con 0x7f1284004d40 2024-09-12T02:44:12.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.999+0000 7f12a5200640 1 --2- 172.21.15.112:0/126349318 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1284004d40 0x7f12840051c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f129800e170 tx=0x7f1284005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b84322399df4849 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:12.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.999+0000 7f129f400640 1 -- 172.21.15.112:0/126349318 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298034020 con 0x7f1284004d40 2024-09-12T02:44:12.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.999+0000 7f129f400640 1 -- 172.21.15.112:0/126349318 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1298030430 con 0x7f1284004d40 2024-09-12T02:44:12.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.999+0000 7f129f400640 1 -- 172.21.15.112:0/126349318 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298009c10 con 0x7f1284004d40 2024-09-12T02:44:12.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.999+0000 7f12a7200640 1 -- 172.21.15.112:0/126349318 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1284004d40 msgr2=0x7f12840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:12.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.999+0000 7f12a7200640 1 --2- 172.21.15.112:0/126349318 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1284004d40 0x7f12840051c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f129800e170 tx=0x7f1284005830 comp rx=0 tx=0).stop 2024-09-12T02:44:12.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.999+0000 7f12a5200640 1 -- 172.21.15.112:0/126349318 reap_dead start 2024-09-12T02:44:12.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.999+0000 7f12a7200640 1 -- 172.21.15.112:0/126349318 shutdown_connections 2024-09-12T02:44:12.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:11.999+0000 7f12a7200640 1 -- 172.21.15.112:0/126349318 >> 172.21.15.112:0/126349318 conn(0x7f12a006bbd0 msgr2=0x7f12a006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:12.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.000+0000 7f12a7200640 1 -- 172.21.15.112:0/126349318 shutdown_connections 2024-09-12T02:44:12.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.000+0000 7f12a7200640 1 -- 172.21.15.112:0/126349318 wait complete. 2024-09-12T02:44:12.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.001+0000 7f12a7200640 1 Processor -- start 2024-09-12T02:44:12.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.001+0000 7f12a7200640 1 -- start start 2024-09-12T02:44:12.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.002+0000 7f12a7200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1284004d40 0x7f12a00ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:12.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.002+0000 7f12a7200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12a015ecd0 0x7f12a01412e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:12.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.002+0000 7f12a7200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12a015a750 0x7f12a015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:12.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.002+0000 7f12a7200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f12a015bf30 con 0x7f12a015a750 2024-09-12T02:44:12.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.002+0000 7f12a7200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f12a015bdb0 con 0x7f1284004d40 2024-09-12T02:44:12.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.002+0000 7f12a7200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f12a00b4ec0 con 0x7f12a015ecd0 2024-09-12T02:44:12.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.002+0000 7f12a5200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12a015a750 0x7f12a015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:12.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.002+0000 7f12a5200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12a015a750 0x7f12a015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50348/0 (socket says 172.21.15.112:50348) 2024-09-12T02:44:12.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.002+0000 7f12a5200640 1 -- 172.21.15.112:0/2821027993 learned_addr learned my addr 172.21.15.112:0/2821027993 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:12.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.003+0000 7f1297400640 1 --2- 172.21.15.112:0/2821027993 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12a015ecd0 0x7f12a01412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:12.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.003+0000 7f129fe00640 1 --2- 172.21.15.112:0/2821027993 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1284004d40 0x7f12a00ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:12.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.003+0000 7f12a5200640 1 -- 172.21.15.112:0/2821027993 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12a015ecd0 msgr2=0x7f12a01412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:12.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.003+0000 7f12a5200640 1 --2- 172.21.15.112:0/2821027993 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12a015ecd0 0x7f12a01412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:12.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.003+0000 7f12a5200640 1 -- 172.21.15.112:0/2821027993 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1284004d40 msgr2=0x7f12a00ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:12.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.003+0000 7f12a5200640 1 --2- 172.21.15.112:0/2821027993 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1284004d40 0x7f12a00ce8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:12.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.003+0000 7f12a5200640 1 -- 172.21.15.112:0/2821027993 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a015f150 con 0x7f12a015a750 2024-09-12T02:44:12.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.003+0000 7f12a5200640 1 --2- 172.21.15.112:0/2821027993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12a015a750 0x7f12a015abd0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1298009f90 tx=0x7f1298009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:12.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.003+0000 7f129cc00640 1 -- 172.21.15.112:0/2821027993 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298034040 con 0x7f12a015a750 2024-09-12T02:44:12.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.003+0000 7f129cc00640 1 -- 172.21.15.112:0/2821027993 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1298003b90 con 0x7f12a015a750 2024-09-12T02:44:12.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.003+0000 7f129cc00640 1 -- 172.21.15.112:0/2821027993 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298004020 con 0x7f12a015a750 2024-09-12T02:44:12.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.003+0000 7f12a7200640 1 -- 172.21.15.112:0/2821027993 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12a00cefe0 con 0x7f12a015a750 2024-09-12T02:44:12.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.003+0000 7f12a7200640 1 -- 172.21.15.112:0/2821027993 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12a00cf5a0 con 0x7f12a015a750 2024-09-12T02:44:12.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.004+0000 7f12a7200640 1 -- 172.21.15.112:0/2821027993 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12a015b110 con 0x7f12a015a750 2024-09-12T02:44:12.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.005+0000 7f129cc00640 1 -- 172.21.15.112:0/2821027993 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1298037020 con 0x7f12a015a750 2024-09-12T02:44:12.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.006+0000 7f129cc00640 1 --2- 172.21.15.112:0/2821027993 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f127c06be30 0x7f127c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:12.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.006+0000 7f129cc00640 1 -- 172.21.15.112:0/2821027993 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5709+0+0 (secure 0 0 0) 0x7f12980ac230 con 0x7f12a015a750 2024-09-12T02:44:12.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.006+0000 7f129fe00640 1 --2- 172.21.15.112:0/2821027993 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f127c06be30 0x7f127c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:12.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.007+0000 7f129fe00640 1 --2- 172.21.15.112:0/2821027993 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f127c06be30 0x7f127c06e2f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1290009b00 tx=0x7f1290008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:12.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.011+0000 7f129cc00640 1 -- 172.21.15.112:0/2821027993 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1298048060 con 0x7f12a015a750 2024-09-12T02:44:12.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.180+0000 7f12a7200640 1 -- 172.21.15.112:0/2821027993 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f12a0068a30 con 0x7f127c06be30 2024-09-12T02:44:12.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.186+0000 7f129cc00640 1 -- 172.21.15.112:0/2821027993 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247422 (secure 0 0 0) 0x7f12a0068a30 con 0x7f127c06be30 2024-09-12T02:44:12.190 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:44:12.191 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:44:12.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.190+0000 7f12a7200640 1 -- 172.21.15.112:0/2821027993 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f127c06be30 msgr2=0x7f127c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:12.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.190+0000 7f12a7200640 1 --2- 172.21.15.112:0/2821027993 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f127c06be30 0x7f127c06e2f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1290009b00 tx=0x7f1290008040 comp rx=0 tx=0).stop 2024-09-12T02:44:12.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.190+0000 7f12a7200640 1 -- 172.21.15.112:0/2821027993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12a015a750 msgr2=0x7f12a015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:12.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.190+0000 7f12a7200640 1 --2- 172.21.15.112:0/2821027993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12a015a750 0x7f12a015abd0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1298009f90 tx=0x7f1298009750 comp rx=0 tx=0).stop 2024-09-12T02:44:12.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.190+0000 7f12a7200640 1 -- 172.21.15.112:0/2821027993 shutdown_connections 2024-09-12T02:44:12.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.190+0000 7f12a7200640 1 --2- 172.21.15.112:0/2821027993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12a015a750 0x7f12a015abd0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:12.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.190+0000 7f12a7200640 1 --2- 172.21.15.112:0/2821027993 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12a015ecd0 0x7f12a01412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:12.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.190+0000 7f12a7200640 1 --2- 172.21.15.112:0/2821027993 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f127c06be30 0x7f127c06e2f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:12.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.190+0000 7f12a7200640 1 --2- 172.21.15.112:0/2821027993 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1284004d40 0x7f12a00ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:12.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.190+0000 7f12a7200640 1 -- 172.21.15.112:0/2821027993 >> 172.21.15.112:0/2821027993 conn(0x7f12a006bbd0 msgr2=0x7f12a00cdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:12.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.190+0000 7f12a7200640 1 -- 172.21.15.112:0/2821027993 shutdown_connections 2024-09-12T02:44:12.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.190+0000 7f12a7200640 1 -- 172.21.15.112:0/2821027993 wait complete. 2024-09-12T02:44:12.206 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2024-09-12T02:44:10.988154+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":77,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558873,"statfs":{"total":1600000000,"available":1596286576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.383720"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.634965+0000","last_change":"2024-09-12T02:44:07.634167+0000","last_active":"2024-09-12T02:44:07.634965+0000","last_peered":"2024-09-12T02:44:07.634965+0000","last_clean":"2024-09-12T02:44:07.634965+0000","last_became_active":"2024-09-12T02:44:07.633933+0000","last_became_peered":"2024-09-12T02:44:07.633933+0000","last_unstale":"2024-09-12T02:44:07.634965+0000","last_undegraded":"2024-09-12T02:44:07.634965+0000","last_fullsized":"2024-09-12T02:44:07.634965+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:40.948521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.645720+0000","last_change":"2024-09-12T02:44:07.645531+0000","last_active":"2024-09-12T02:44:07.645720+0000","last_peered":"2024-09-12T02:44:07.645720+0000","last_clean":"2024-09-12T02:44:07.645720+0000","last_became_active":"2024-09-12T02:44:07.644978+0000","last_became_peered":"2024-09-12T02:44:07.644978+0000","last_unstale":"2024-09-12T02:44:07.645720+0000","last_undegraded":"2024-09-12T02:44:07.645720+0000","last_fullsized":"2024-09-12T02:44:07.645720+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:29.840477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.637883+0000","last_change":"2024-09-12T02:44:07.637687+0000","last_active":"2024-09-12T02:44:07.637883+0000","last_peered":"2024-09-12T02:44:07.637883+0000","last_clean":"2024-09-12T02:44:07.637883+0000","last_became_active":"2024-09-12T02:44:07.635906+0000","last_became_peered":"2024-09-12T02:44:07.635906+0000","last_unstale":"2024-09-12T02:44:07.637883+0000","last_undegraded":"2024-09-12T02:44:07.637883+0000","last_fullsized":"2024-09-12T02:44:07.637883+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:46.471519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.641566+0000","last_change":"2024-09-12T02:44:07.641089+0000","last_active":"2024-09-12T02:44:07.641566+0000","last_peered":"2024-09-12T02:44:07.641566+0000","last_clean":"2024-09-12T02:44:07.641566+0000","last_became_active":"2024-09-12T02:44:07.640800+0000","last_became_peered":"2024-09-12T02:44:07.640800+0000","last_unstale":"2024-09-12T02:44:07.641566+0000","last_undegraded":"2024-09-12T02:44:07.641566+0000","last_fullsized":"2024-09-12T02:44:07.641566+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:59.803768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.642496+0000","last_change":"2024-09-12T02:44:07.639953+0000","last_active":"2024-09-12T02:44:07.642496+0000","last_peered":"2024-09-12T02:44:07.642496+0000","last_clean":"2024-09-12T02:44:07.642496+0000","last_became_active":"2024-09-12T02:44:07.638551+0000","last_became_peered":"2024-09-12T02:44:07.638551+0000","last_unstale":"2024-09-12T02:44:07.642496+0000","last_undegraded":"2024-09-12T02:44:07.642496+0000","last_fullsized":"2024-09-12T02:44:07.642496+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:49.508071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.646817+0000","last_change":"2024-09-12T02:44:07.646675+0000","last_active":"2024-09-12T02:44:07.646817+0000","last_peered":"2024-09-12T02:44:07.646817+0000","last_clean":"2024-09-12T02:44:07.646817+0000","last_became_active":"2024-09-12T02:44:07.646101+0000","last_became_peered":"2024-09-12T02:44:07.646101+0000","last_unstale":"2024-09-12T02:44:07.646817+0000","last_undegraded":"2024-09-12T02:44:07.646817+0000","last_fullsized":"2024-09-12T02:44:07.646817+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:02.479369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.639556+0000","last_change":"2024-09-12T02:44:07.638748+0000","last_active":"2024-09-12T02:44:07.639556+0000","last_peered":"2024-09-12T02:44:07.639556+0000","last_clean":"2024-09-12T02:44:07.639556+0000","last_became_active":"2024-09-12T02:44:07.638506+0000","last_became_peered":"2024-09-12T02:44:07.638506+0000","last_unstale":"2024-09-12T02:44:07.639556+0000","last_undegraded":"2024-09-12T02:44:07.639556+0000","last_fullsized":"2024-09-12T02:44:07.639556+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:44.600760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.628325+0000","last_change":"2024-09-12T02:44:07.628084+0000","last_active":"2024-09-12T02:44:07.628325+0000","last_peered":"2024-09-12T02:44:07.628325+0000","last_clean":"2024-09-12T02:44:07.628325+0000","last_became_active":"2024-09-12T02:44:07.627835+0000","last_became_peered":"2024-09-12T02:44:07.627835+0000","last_unstale":"2024-09-12T02:44:07.628325+0000","last_undegraded":"2024-09-12T02:44:07.628325+0000","last_fullsized":"2024-09-12T02:44:07.628325+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:15.323684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.640347+0000","last_change":"2024-09-12T02:44:07.639872+0000","last_active":"2024-09-12T02:44:07.640347+0000","last_peered":"2024-09-12T02:44:07.640347+0000","last_clean":"2024-09-12T02:44:07.640347+0000","last_became_active":"2024-09-12T02:44:07.639552+0000","last_became_peered":"2024-09-12T02:44:07.639552+0000","last_unstale":"2024-09-12T02:44:07.640347+0000","last_undegraded":"2024-09-12T02:44:07.640347+0000","last_fullsized":"2024-09-12T02:44:07.640347+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:16.533652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.642693+0000","last_change":"2024-09-12T02:44:07.640937+0000","last_active":"2024-09-12T02:44:07.642693+0000","last_peered":"2024-09-12T02:44:07.642693+0000","last_clean":"2024-09-12T02:44:07.642693+0000","last_became_active":"2024-09-12T02:44:07.640689+0000","last_became_peered":"2024-09-12T02:44:07.640689+0000","last_unstale":"2024-09-12T02:44:07.642693+0000","last_undegraded":"2024-09-12T02:44:07.642693+0000","last_fullsized":"2024-09-12T02:44:07.642693+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:07.672600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.645122+0000","last_change":"2024-09-12T02:44:07.644319+0000","last_active":"2024-09-12T02:44:07.645122+0000","last_peered":"2024-09-12T02:44:07.645122+0000","last_clean":"2024-09-12T02:44:07.645122+0000","last_became_active":"2024-09-12T02:44:07.644065+0000","last_became_peered":"2024-09-12T02:44:07.644065+0000","last_unstale":"2024-09-12T02:44:07.645122+0000","last_undegraded":"2024-09-12T02:44:07.645122+0000","last_fullsized":"2024-09-12T02:44:07.645122+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:36.571111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.641524+0000","last_change":"2024-09-12T02:44:07.639697+0000","last_active":"2024-09-12T02:44:07.641524+0000","last_peered":"2024-09-12T02:44:07.641524+0000","last_clean":"2024-09-12T02:44:07.641524+0000","last_became_active":"2024-09-12T02:44:07.639472+0000","last_became_peered":"2024-09-12T02:44:07.639472+0000","last_unstale":"2024-09-12T02:44:07.641524+0000","last_undegraded":"2024-09-12T02:44:07.641524+0000","last_fullsized":"2024-09-12T02:44:07.641524+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:14.725762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.637036+0000","last_change":"2024-09-12T02:44:07.636862+0000","last_active":"2024-09-12T02:44:07.637036+0000","last_peered":"2024-09-12T02:44:07.637036+0000","last_clean":"2024-09-12T02:44:07.637036+0000","last_became_active":"2024-09-12T02:44:07.636635+0000","last_became_peered":"2024-09-12T02:44:07.636635+0000","last_unstale":"2024-09-12T02:44:07.637036+0000","last_undegraded":"2024-09-12T02:44:07.637036+0000","last_fullsized":"2024-09-12T02:44:07.637036+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:05.732409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.632949+0000","last_change":"2024-09-12T02:44:07.632539+0000","last_active":"2024-09-12T02:44:07.632949+0000","last_peered":"2024-09-12T02:44:07.632949+0000","last_clean":"2024-09-12T02:44:07.632949+0000","last_became_active":"2024-09-12T02:44:07.632267+0000","last_became_peered":"2024-09-12T02:44:07.632267+0000","last_unstale":"2024-09-12T02:44:07.632949+0000","last_undegraded":"2024-09-12T02:44:07.632949+0000","last_fullsized":"2024-09-12T02:44:07.632949+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:59.587065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.640367+0000","last_change":"2024-09-12T02:44:07.640199+0000","last_active":"2024-09-12T02:44:07.640367+0000","last_peered":"2024-09-12T02:44:07.640367+0000","last_clean":"2024-09-12T02:44:07.640367+0000","last_became_active":"2024-09-12T02:44:07.639721+0000","last_became_peered":"2024-09-12T02:44:07.639721+0000","last_unstale":"2024-09-12T02:44:07.640367+0000","last_undegraded":"2024-09-12T02:44:07.640367+0000","last_fullsized":"2024-09-12T02:44:07.640367+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:03.912653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.639357+0000","last_change":"2024-09-12T02:44:07.639248+0000","last_active":"2024-09-12T02:44:07.639357+0000","last_peered":"2024-09-12T02:44:07.639357+0000","last_clean":"2024-09-12T02:44:07.639357+0000","last_became_active":"2024-09-12T02:44:07.638848+0000","last_became_peered":"2024-09-12T02:44:07.638848+0000","last_unstale":"2024-09-12T02:44:07.639357+0000","last_undegraded":"2024-09-12T02:44:07.639357+0000","last_fullsized":"2024-09-12T02:44:07.639357+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:40.452221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.629227+0000","last_change":"2024-09-12T02:44:07.629033+0000","last_active":"2024-09-12T02:44:07.629227+0000","last_peered":"2024-09-12T02:44:07.629227+0000","last_clean":"2024-09-12T02:44:07.629227+0000","last_became_active":"2024-09-12T02:44:07.628562+0000","last_became_peered":"2024-09-12T02:44:07.628562+0000","last_unstale":"2024-09-12T02:44:07.629227+0000","last_undegraded":"2024-09-12T02:44:07.629227+0000","last_fullsized":"2024-09-12T02:44:07.629227+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:30.599896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.643226+0000","last_change":"2024-09-12T02:44:07.642762+0000","last_active":"2024-09-12T02:44:07.643226+0000","last_peered":"2024-09-12T02:44:07.643226+0000","last_clean":"2024-09-12T02:44:07.643226+0000","last_became_active":"2024-09-12T02:44:07.639880+0000","last_became_peered":"2024-09-12T02:44:07.639880+0000","last_unstale":"2024-09-12T02:44:07.643226+0000","last_undegraded":"2024-09-12T02:44:07.643226+0000","last_fullsized":"2024-09-12T02:44:07.643226+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:18.481418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.638586+0000","last_change":"2024-09-12T02:44:07.638465+0000","last_active":"2024-09-12T02:44:07.638586+0000","last_peered":"2024-09-12T02:44:07.638586+0000","last_clean":"2024-09-12T02:44:07.638586+0000","last_became_active":"2024-09-12T02:44:07.636908+0000","last_became_peered":"2024-09-12T02:44:07.636908+0000","last_unstale":"2024-09-12T02:44:07.638586+0000","last_undegraded":"2024-09-12T02:44:07.638586+0000","last_fullsized":"2024-09-12T02:44:07.638586+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:59.931766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.638641+0000","last_change":"2024-09-12T02:44:07.636341+0000","last_active":"2024-09-12T02:44:07.638641+0000","last_peered":"2024-09-12T02:44:07.638641+0000","last_clean":"2024-09-12T02:44:07.638641+0000","last_became_active":"2024-09-12T02:44:07.635538+0000","last_became_peered":"2024-09-12T02:44:07.635538+0000","last_unstale":"2024-09-12T02:44:07.638641+0000","last_undegraded":"2024-09-12T02:44:07.638641+0000","last_fullsized":"2024-09-12T02:44:07.638641+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:34.364415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.641464+0000","last_change":"2024-09-12T02:44:07.641350+0000","last_active":"2024-09-12T02:44:07.641464+0000","last_peered":"2024-09-12T02:44:07.641464+0000","last_clean":"2024-09-12T02:44:07.641464+0000","last_became_active":"2024-09-12T02:44:07.641078+0000","last_became_peered":"2024-09-12T02:44:07.641078+0000","last_unstale":"2024-09-12T02:44:07.641464+0000","last_undegraded":"2024-09-12T02:44:07.641464+0000","last_fullsized":"2024-09-12T02:44:07.641464+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:33.259323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.633472+0000","last_change":"2024-09-12T02:44:07.633290+0000","last_active":"2024-09-12T02:44:07.633472+0000","last_peered":"2024-09-12T02:44:07.633472+0000","last_clean":"2024-09-12T02:44:07.633472+0000","last_became_active":"2024-09-12T02:44:07.632984+0000","last_became_peered":"2024-09-12T02:44:07.632984+0000","last_unstale":"2024-09-12T02:44:07.633472+0000","last_undegraded":"2024-09-12T02:44:07.633472+0000","last_fullsized":"2024-09-12T02:44:07.633472+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:42.162338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.642485+0000","last_change":"2024-09-12T02:44:07.640230+0000","last_active":"2024-09-12T02:44:07.642485+0000","last_peered":"2024-09-12T02:44:07.642485+0000","last_clean":"2024-09-12T02:44:07.642485+0000","last_became_active":"2024-09-12T02:44:07.637967+0000","last_became_peered":"2024-09-12T02:44:07.637967+0000","last_unstale":"2024-09-12T02:44:07.642485+0000","last_undegraded":"2024-09-12T02:44:07.642485+0000","last_fullsized":"2024-09-12T02:44:07.642485+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:32.424862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.638221+0000","last_change":"2024-09-12T02:44:07.637654+0000","last_active":"2024-09-12T02:44:07.638221+0000","last_peered":"2024-09-12T02:44:07.638221+0000","last_clean":"2024-09-12T02:44:07.638221+0000","last_became_active":"2024-09-12T02:44:07.637401+0000","last_became_peered":"2024-09-12T02:44:07.637401+0000","last_unstale":"2024-09-12T02:44:07.638221+0000","last_undegraded":"2024-09-12T02:44:07.638221+0000","last_fullsized":"2024-09-12T02:44:07.638221+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:22.317277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.642544+0000","last_change":"2024-09-12T02:44:07.640150+0000","last_active":"2024-09-12T02:44:07.642544+0000","last_peered":"2024-09-12T02:44:07.642544+0000","last_clean":"2024-09-12T02:44:07.642544+0000","last_became_active":"2024-09-12T02:44:07.639716+0000","last_became_peered":"2024-09-12T02:44:07.639716+0000","last_unstale":"2024-09-12T02:44:07.642544+0000","last_undegraded":"2024-09-12T02:44:07.642544+0000","last_fullsized":"2024-09-12T02:44:07.642544+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:37.719482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.641545+0000","last_change":"2024-09-12T02:44:07.640726+0000","last_active":"2024-09-12T02:44:07.641545+0000","last_peered":"2024-09-12T02:44:07.641545+0000","last_clean":"2024-09-12T02:44:07.641545+0000","last_became_active":"2024-09-12T02:44:07.640490+0000","last_became_peered":"2024-09-12T02:44:07.640490+0000","last_unstale":"2024-09-12T02:44:07.641545+0000","last_undegraded":"2024-09-12T02:44:07.641545+0000","last_fullsized":"2024-09-12T02:44:07.641545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:27.363660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.640328+0000","last_change":"2024-09-12T02:44:07.639953+0000","last_active":"2024-09-12T02:44:07.640328+0000","last_peered":"2024-09-12T02:44:07.640328+0000","last_clean":"2024-09-12T02:44:07.640328+0000","last_became_active":"2024-09-12T02:44:07.639710+0000","last_became_peered":"2024-09-12T02:44:07.639710+0000","last_unstale":"2024-09-12T02:44:07.640328+0000","last_undegraded":"2024-09-12T02:44:07.640328+0000","last_fullsized":"2024-09-12T02:44:07.640328+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:00.022218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.637317+0000","last_change":"2024-09-12T02:44:07.637170+0000","last_active":"2024-09-12T02:44:07.637317+0000","last_peered":"2024-09-12T02:44:07.637317+0000","last_clean":"2024-09-12T02:44:07.637317+0000","last_became_active":"2024-09-12T02:44:07.636907+0000","last_became_peered":"2024-09-12T02:44:07.636907+0000","last_unstale":"2024-09-12T02:44:07.637317+0000","last_undegraded":"2024-09-12T02:44:07.637317+0000","last_fullsized":"2024-09-12T02:44:07.637317+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:13.961581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.640460+0000","last_change":"2024-09-12T02:44:07.636343+0000","last_active":"2024-09-12T02:44:07.640460+0000","last_peered":"2024-09-12T02:44:07.640460+0000","last_clean":"2024-09-12T02:44:07.640460+0000","last_became_active":"2024-09-12T02:44:07.636100+0000","last_became_peered":"2024-09-12T02:44:07.636100+0000","last_unstale":"2024-09-12T02:44:07.640460+0000","last_undegraded":"2024-09-12T02:44:07.640460+0000","last_fullsized":"2024-09-12T02:44:07.640460+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:50.438160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.634563+0000","last_change":"2024-09-12T02:44:07.634393+0000","last_active":"2024-09-12T02:44:07.634563+0000","last_peered":"2024-09-12T02:44:07.634563+0000","last_clean":"2024-09-12T02:44:07.634563+0000","last_became_active":"2024-09-12T02:44:07.634075+0000","last_became_peered":"2024-09-12T02:44:07.634075+0000","last_unstale":"2024-09-12T02:44:07.634563+0000","last_undegraded":"2024-09-12T02:44:07.634563+0000","last_fullsized":"2024-09-12T02:44:07.634563+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:04.876463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.642562+0000","last_change":"2024-09-12T02:44:07.640229+0000","last_active":"2024-09-12T02:44:07.642562+0000","last_peered":"2024-09-12T02:44:07.642562+0000","last_clean":"2024-09-12T02:44:07.642562+0000","last_became_active":"2024-09-12T02:44:07.638371+0000","last_became_peered":"2024-09-12T02:44:07.638371+0000","last_unstale":"2024-09-12T02:44:07.642562+0000","last_undegraded":"2024-09-12T02:44:07.642562+0000","last_fullsized":"2024-09-12T02:44:07.642562+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:14.643489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.637624+0000","last_change":"2024-09-12T02:44:07.635924+0000","last_active":"2024-09-12T02:44:07.637624+0000","last_peered":"2024-09-12T02:44:07.637624+0000","last_clean":"2024-09-12T02:44:07.637624+0000","last_became_active":"2024-09-12T02:44:07.635694+0000","last_became_peered":"2024-09-12T02:44:07.635694+0000","last_unstale":"2024-09-12T02:44:07.637624+0000","last_undegraded":"2024-09-12T02:44:07.637624+0000","last_fullsized":"2024-09-12T02:44:07.637624+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:59.967373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.641963+0000","last_change":"2024-09-12T02:44:07.641587+0000","last_active":"2024-09-12T02:44:07.641963+0000","last_peered":"2024-09-12T02:44:07.641963+0000","last_clean":"2024-09-12T02:44:07.641963+0000","last_became_active":"2024-09-12T02:44:07.640457+0000","last_became_peered":"2024-09-12T02:44:07.640457+0000","last_unstale":"2024-09-12T02:44:07.641963+0000","last_undegraded":"2024-09-12T02:44:07.641963+0000","last_fullsized":"2024-09-12T02:44:07.641963+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:05.705126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"63'4","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.654452+0000","last_change":"2024-09-12T02:44:06.621930+0000","last_active":"2024-09-12T02:44:07.654452+0000","last_peered":"2024-09-12T02:44:07.654452+0000","last_clean":"2024-09-12T02:44:07.654452+0000","last_became_active":"2024-09-12T02:44:06.621489+0000","last_became_peered":"2024-09-12T02:44:06.621489+0000","last_unstale":"2024-09-12T02:44:07.654452+0000","last_undegraded":"2024-09-12T02:44:07.654452+0000","last_fullsized":"2024-09-12T02:44:07.654452+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:27.545583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.645178+0000","last_change":"2024-09-12T02:44:07.644479+0000","last_active":"2024-09-12T02:44:07.645178+0000","last_peered":"2024-09-12T02:44:07.645178+0000","last_clean":"2024-09-12T02:44:07.645178+0000","last_became_active":"2024-09-12T02:44:07.644024+0000","last_became_peered":"2024-09-12T02:44:07.644024+0000","last_unstale":"2024-09-12T02:44:07.645178+0000","last_undegraded":"2024-09-12T02:44:07.645178+0000","last_fullsized":"2024-09-12T02:44:07.645178+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:57.987911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"63'1","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.655648+0000","last_change":"2024-09-12T02:44:06.624092+0000","last_active":"2024-09-12T02:44:07.655648+0000","last_peered":"2024-09-12T02:44:07.655648+0000","last_clean":"2024-09-12T02:44:07.655648+0000","last_became_active":"2024-09-12T02:44:06.623854+0000","last_became_peered":"2024-09-12T02:44:06.623854+0000","last_unstale":"2024-09-12T02:44:07.655648+0000","last_undegraded":"2024-09-12T02:44:07.655648+0000","last_fullsized":"2024-09-12T02:44:07.655648+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:24.048066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.646983+0000","last_change":"2024-09-12T02:44:07.646877+0000","last_active":"2024-09-12T02:44:07.646983+0000","last_peered":"2024-09-12T02:44:07.646983+0000","last_clean":"2024-09-12T02:44:07.646983+0000","last_became_active":"2024-09-12T02:44:07.646417+0000","last_became_peered":"2024-09-12T02:44:07.646417+0000","last_unstale":"2024-09-12T02:44:07.646983+0000","last_undegraded":"2024-09-12T02:44:07.646983+0000","last_fullsized":"2024-09-12T02:44:07.646983+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:23.016714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.655045+0000","last_change":"2024-09-12T02:44:06.621395+0000","last_active":"2024-09-12T02:44:07.655045+0000","last_peered":"2024-09-12T02:44:07.655045+0000","last_clean":"2024-09-12T02:44:07.655045+0000","last_became_active":"2024-09-12T02:44:06.620707+0000","last_became_peered":"2024-09-12T02:44:06.620707+0000","last_unstale":"2024-09-12T02:44:07.655045+0000","last_undegraded":"2024-09-12T02:44:07.655045+0000","last_fullsized":"2024-09-12T02:44:07.655045+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:41.948741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.638086+0000","last_change":"2024-09-12T02:44:07.637925+0000","last_active":"2024-09-12T02:44:07.638086+0000","last_peered":"2024-09-12T02:44:07.638086+0000","last_clean":"2024-09-12T02:44:07.638086+0000","last_became_active":"2024-09-12T02:44:07.637686+0000","last_became_peered":"2024-09-12T02:44:07.637686+0000","last_unstale":"2024-09-12T02:44:07.638086+0000","last_undegraded":"2024-09-12T02:44:07.638086+0000","last_fullsized":"2024-09-12T02:44:07.638086+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:22.481936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.655479+0000","last_change":"2024-09-12T02:44:06.625021+0000","last_active":"2024-09-12T02:44:07.655479+0000","last_peered":"2024-09-12T02:44:07.655479+0000","last_clean":"2024-09-12T02:44:07.655479+0000","last_became_active":"2024-09-12T02:44:06.624473+0000","last_became_peered":"2024-09-12T02:44:06.624473+0000","last_unstale":"2024-09-12T02:44:07.655479+0000","last_undegraded":"2024-09-12T02:44:07.655479+0000","last_fullsized":"2024-09-12T02:44:07.655479+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:37:55.092387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.632371+0000","last_change":"2024-09-12T02:44:07.632024+0000","last_active":"2024-09-12T02:44:07.632371+0000","last_peered":"2024-09-12T02:44:07.632371+0000","last_clean":"2024-09-12T02:44:07.632371+0000","last_became_active":"2024-09-12T02:44:07.631771+0000","last_became_peered":"2024-09-12T02:44:07.631771+0000","last_unstale":"2024-09-12T02:44:07.632371+0000","last_undegraded":"2024-09-12T02:44:07.632371+0000","last_fullsized":"2024-09-12T02:44:07.632371+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:16:59.225888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"63'1","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.653111+0000","last_change":"2024-09-12T02:44:06.622413+0000","last_active":"2024-09-12T02:44:07.653111+0000","last_peered":"2024-09-12T02:44:07.653111+0000","last_clean":"2024-09-12T02:44:07.653111+0000","last_became_active":"2024-09-12T02:44:06.621970+0000","last_became_peered":"2024-09-12T02:44:06.621970+0000","last_unstale":"2024-09-12T02:44:07.653111+0000","last_undegraded":"2024-09-12T02:44:07.653111+0000","last_fullsized":"2024-09-12T02:44:07.653111+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:07.907791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.643803+0000","last_change":"2024-09-12T02:44:07.643090+0000","last_active":"2024-09-12T02:44:07.643803+0000","last_peered":"2024-09-12T02:44:07.643803+0000","last_clean":"2024-09-12T02:44:07.643803+0000","last_became_active":"2024-09-12T02:44:07.642310+0000","last_became_peered":"2024-09-12T02:44:07.642310+0000","last_unstale":"2024-09-12T02:44:07.643803+0000","last_undegraded":"2024-09-12T02:44:07.643803+0000","last_fullsized":"2024-09-12T02:44:07.643803+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:43.388572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"63'1","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.654683+0000","last_change":"2024-09-12T02:44:06.619726+0000","last_active":"2024-09-12T02:44:07.654683+0000","last_peered":"2024-09-12T02:44:07.654683+0000","last_clean":"2024-09-12T02:44:07.654683+0000","last_became_active":"2024-09-12T02:44:06.617949+0000","last_became_peered":"2024-09-12T02:44:06.617949+0000","last_unstale":"2024-09-12T02:44:07.654683+0000","last_undegraded":"2024-09-12T02:44:07.654683+0000","last_fullsized":"2024-09-12T02:44:07.654683+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:47.323575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.637059+0000","last_change":"2024-09-12T02:44:07.636142+0000","last_active":"2024-09-12T02:44:07.637059+0000","last_peered":"2024-09-12T02:44:07.637059+0000","last_clean":"2024-09-12T02:44:07.637059+0000","last_became_active":"2024-09-12T02:44:07.634808+0000","last_became_peered":"2024-09-12T02:44:07.634808+0000","last_unstale":"2024-09-12T02:44:07.637059+0000","last_undegraded":"2024-09-12T02:44:07.637059+0000","last_fullsized":"2024-09-12T02:44:07.637059+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:58.689886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.633969+0000","last_change":"2024-09-12T02:44:06.618070+0000","last_active":"2024-09-12T02:44:07.633969+0000","last_peered":"2024-09-12T02:44:07.633969+0000","last_clean":"2024-09-12T02:44:07.633969+0000","last_became_active":"2024-09-12T02:44:06.617819+0000","last_became_peered":"2024-09-12T02:44:06.617819+0000","last_unstale":"2024-09-12T02:44:07.633969+0000","last_undegraded":"2024-09-12T02:44:07.633969+0000","last_fullsized":"2024-09-12T02:44:07.633969+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:17.682485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.627801+0000","last_change":"2024-09-12T02:44:07.627539+0000","last_active":"2024-09-12T02:44:07.627801+0000","last_peered":"2024-09-12T02:44:07.627801+0000","last_clean":"2024-09-12T02:44:07.627801+0000","last_became_active":"2024-09-12T02:44:07.627273+0000","last_became_peered":"2024-09-12T02:44:07.627273+0000","last_unstale":"2024-09-12T02:44:07.627801+0000","last_undegraded":"2024-09-12T02:44:07.627801+0000","last_fullsized":"2024-09-12T02:44:07.627801+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:27.403872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.626063+0000","last_change":"2024-09-12T02:44:06.619419+0000","last_active":"2024-09-12T02:44:07.626063+0000","last_peered":"2024-09-12T02:44:07.626063+0000","last_clean":"2024-09-12T02:44:07.626063+0000","last_became_active":"2024-09-12T02:44:06.617138+0000","last_became_peered":"2024-09-12T02:44:06.617138+0000","last_unstale":"2024-09-12T02:44:07.626063+0000","last_undegraded":"2024-09-12T02:44:07.626063+0000","last_fullsized":"2024-09-12T02:44:07.626063+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:44.681143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.643266+0000","last_change":"2024-09-12T02:44:07.643100+0000","last_active":"2024-09-12T02:44:07.643266+0000","last_peered":"2024-09-12T02:44:07.643266+0000","last_clean":"2024-09-12T02:44:07.643266+0000","last_became_active":"2024-09-12T02:44:07.642816+0000","last_became_peered":"2024-09-12T02:44:07.642816+0000","last_unstale":"2024-09-12T02:44:07.643266+0000","last_undegraded":"2024-09-12T02:44:07.643266+0000","last_fullsized":"2024-09-12T02:44:07.643266+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:00.882378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.632269+0000","last_change":"2024-09-12T02:44:06.626271+0000","last_active":"2024-09-12T02:44:07.632269+0000","last_peered":"2024-09-12T02:44:07.632269+0000","last_clean":"2024-09-12T02:44:07.632269+0000","last_became_active":"2024-09-12T02:44:06.625674+0000","last_became_peered":"2024-09-12T02:44:06.625674+0000","last_unstale":"2024-09-12T02:44:07.632269+0000","last_undegraded":"2024-09-12T02:44:07.632269+0000","last_fullsized":"2024-09-12T02:44:07.632269+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:38.384642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.645561+0000","last_change":"2024-09-12T02:44:07.645448+0000","last_active":"2024-09-12T02:44:07.645561+0000","last_peered":"2024-09-12T02:44:07.645561+0000","last_clean":"2024-09-12T02:44:07.645561+0000","last_became_active":"2024-09-12T02:44:07.644843+0000","last_became_peered":"2024-09-12T02:44:07.644843+0000","last_unstale":"2024-09-12T02:44:07.645561+0000","last_undegraded":"2024-09-12T02:44:07.645561+0000","last_fullsized":"2024-09-12T02:44:07.645561+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:31.331987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.627881+0000","last_change":"2024-09-12T02:44:06.623562+0000","last_active":"2024-09-12T02:44:07.627881+0000","last_peered":"2024-09-12T02:44:07.627881+0000","last_clean":"2024-09-12T02:44:07.627881+0000","last_became_active":"2024-09-12T02:44:06.623337+0000","last_became_peered":"2024-09-12T02:44:06.623337+0000","last_unstale":"2024-09-12T02:44:07.627881+0000","last_undegraded":"2024-09-12T02:44:07.627881+0000","last_fullsized":"2024-09-12T02:44:07.627881+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:35.263368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.645048+0000","last_change":"2024-09-12T02:44:07.643300+0000","last_active":"2024-09-12T02:44:07.645048+0000","last_peered":"2024-09-12T02:44:07.645048+0000","last_clean":"2024-09-12T02:44:07.645048+0000","last_became_active":"2024-09-12T02:44:07.643015+0000","last_became_peered":"2024-09-12T02:44:07.643015+0000","last_unstale":"2024-09-12T02:44:07.645048+0000","last_undegraded":"2024-09-12T02:44:07.645048+0000","last_fullsized":"2024-09-12T02:44:07.645048+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:07.931996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"63'3","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.657067+0000","last_change":"2024-09-12T02:44:06.626834+0000","last_active":"2024-09-12T02:44:07.657067+0000","last_peered":"2024-09-12T02:44:07.657067+0000","last_clean":"2024-09-12T02:44:07.657067+0000","last_became_active":"2024-09-12T02:44:06.626505+0000","last_became_peered":"2024-09-12T02:44:06.626505+0000","last_unstale":"2024-09-12T02:44:07.657067+0000","last_undegraded":"2024-09-12T02:44:07.657067+0000","last_fullsized":"2024-09-12T02:44:07.657067+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:20.596672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.643246+0000","last_change":"2024-09-12T02:44:07.643004+0000","last_active":"2024-09-12T02:44:07.643246+0000","last_peered":"2024-09-12T02:44:07.643246+0000","last_clean":"2024-09-12T02:44:07.643246+0000","last_became_active":"2024-09-12T02:44:07.642515+0000","last_became_peered":"2024-09-12T02:44:07.642515+0000","last_unstale":"2024-09-12T02:44:07.643246+0000","last_undegraded":"2024-09-12T02:44:07.643246+0000","last_fullsized":"2024-09-12T02:44:07.643246+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:34.641352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"63'6","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.656435+0000","last_change":"2024-09-12T02:44:06.620075+0000","last_active":"2024-09-12T02:44:07.656435+0000","last_peered":"2024-09-12T02:44:07.656435+0000","last_clean":"2024-09-12T02:44:07.656435+0000","last_became_active":"2024-09-12T02:44:06.619775+0000","last_became_peered":"2024-09-12T02:44:06.619775+0000","last_unstale":"2024-09-12T02:44:07.656435+0000","last_undegraded":"2024-09-12T02:44:07.656435+0000","last_fullsized":"2024-09-12T02:44:07.656435+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:26.666227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.644565+0000","last_change":"2024-09-12T02:44:07.644416+0000","last_active":"2024-09-12T02:44:07.644565+0000","last_peered":"2024-09-12T02:44:07.644565+0000","last_clean":"2024-09-12T02:44:07.644565+0000","last_became_active":"2024-09-12T02:44:07.644147+0000","last_became_peered":"2024-09-12T02:44:07.644147+0000","last_unstale":"2024-09-12T02:44:07.644565+0000","last_undegraded":"2024-09-12T02:44:07.644565+0000","last_fullsized":"2024-09-12T02:44:07.644565+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:38.503324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.653459+0000","last_change":"2024-09-12T02:44:06.620886+0000","last_active":"2024-09-12T02:44:07.653459+0000","last_peered":"2024-09-12T02:44:07.653459+0000","last_clean":"2024-09-12T02:44:07.653459+0000","last_became_active":"2024-09-12T02:44:06.620618+0000","last_became_peered":"2024-09-12T02:44:06.620618+0000","last_unstale":"2024-09-12T02:44:07.653459+0000","last_undegraded":"2024-09-12T02:44:07.653459+0000","last_fullsized":"2024-09-12T02:44:07.653459+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:31.840905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.635904+0000","last_change":"2024-09-12T02:44:07.634974+0000","last_active":"2024-09-12T02:44:07.635904+0000","last_peered":"2024-09-12T02:44:07.635904+0000","last_clean":"2024-09-12T02:44:07.635904+0000","last_became_active":"2024-09-12T02:44:07.634714+0000","last_became_peered":"2024-09-12T02:44:07.634714+0000","last_unstale":"2024-09-12T02:44:07.635904+0000","last_undegraded":"2024-09-12T02:44:07.635904+0000","last_fullsized":"2024-09-12T02:44:07.635904+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:23.157215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.624186+0000","last_change":"2024-09-12T02:44:06.624222+0000","last_active":"2024-09-12T02:44:07.624186+0000","last_peered":"2024-09-12T02:44:07.624186+0000","last_clean":"2024-09-12T02:44:07.624186+0000","last_became_active":"2024-09-12T02:44:06.623970+0000","last_became_peered":"2024-09-12T02:44:06.623970+0000","last_unstale":"2024-09-12T02:44:07.624186+0000","last_undegraded":"2024-09-12T02:44:07.624186+0000","last_fullsized":"2024-09-12T02:44:07.624186+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:44.344006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.634371+0000","last_change":"2024-09-12T02:44:07.634175+0000","last_active":"2024-09-12T02:44:07.634371+0000","last_peered":"2024-09-12T02:44:07.634371+0000","last_clean":"2024-09-12T02:44:07.634371+0000","last_became_active":"2024-09-12T02:44:07.633909+0000","last_became_peered":"2024-09-12T02:44:07.633909+0000","last_unstale":"2024-09-12T02:44:07.634371+0000","last_undegraded":"2024-09-12T02:44:07.634371+0000","last_fullsized":"2024-09-12T02:44:07.634371+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:06.515571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.634590+0000","last_change":"2024-09-12T02:44:06.624573+0000","last_active":"2024-09-12T02:44:07.634590+0000","last_peered":"2024-09-12T02:44:07.634590+0000","last_clean":"2024-09-12T02:44:07.634590+0000","last_became_active":"2024-09-12T02:44:06.623572+0000","last_became_peered":"2024-09-12T02:44:06.623572+0000","last_unstale":"2024-09-12T02:44:07.634590+0000","last_undegraded":"2024-09-12T02:44:07.634590+0000","last_fullsized":"2024-09-12T02:44:07.634590+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:55.163491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.634545+0000","last_change":"2024-09-12T02:44:07.633848+0000","last_active":"2024-09-12T02:44:07.634545+0000","last_peered":"2024-09-12T02:44:07.634545+0000","last_clean":"2024-09-12T02:44:07.634545+0000","last_became_active":"2024-09-12T02:44:07.633579+0000","last_became_peered":"2024-09-12T02:44:07.633579+0000","last_unstale":"2024-09-12T02:44:07.634545+0000","last_undegraded":"2024-09-12T02:44:07.634545+0000","last_fullsized":"2024-09-12T02:44:07.634545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:45.413102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"63'8","reported_seq":20,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.656026+0000","last_change":"2024-09-12T02:44:06.626113+0000","last_active":"2024-09-12T02:44:07.656026+0000","last_peered":"2024-09-12T02:44:07.656026+0000","last_clean":"2024-09-12T02:44:07.656026+0000","last_became_active":"2024-09-12T02:44:06.623951+0000","last_became_peered":"2024-09-12T02:44:06.623951+0000","last_unstale":"2024-09-12T02:44:07.656026+0000","last_undegraded":"2024-09-12T02:44:07.656026+0000","last_fullsized":"2024-09-12T02:44:07.656026+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:07.788024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.640990+0000","last_change":"2024-09-12T02:44:07.640837+0000","last_active":"2024-09-12T02:44:07.640990+0000","last_peered":"2024-09-12T02:44:07.640990+0000","last_clean":"2024-09-12T02:44:07.640990+0000","last_became_active":"2024-09-12T02:44:07.640564+0000","last_became_peered":"2024-09-12T02:44:07.640564+0000","last_unstale":"2024-09-12T02:44:07.640990+0000","last_undegraded":"2024-09-12T02:44:07.640990+0000","last_fullsized":"2024-09-12T02:44:07.640990+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:57.907067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"63'1","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.653699+0000","last_change":"2024-09-12T02:44:06.621984+0000","last_active":"2024-09-12T02:44:07.653699+0000","last_peered":"2024-09-12T02:44:07.653699+0000","last_clean":"2024-09-12T02:44:07.653699+0000","last_became_active":"2024-09-12T02:44:06.621783+0000","last_became_peered":"2024-09-12T02:44:06.621783+0000","last_unstale":"2024-09-12T02:44:07.653699+0000","last_undegraded":"2024-09-12T02:44:07.653699+0000","last_fullsized":"2024-09-12T02:44:07.653699+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:59.160750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.645207+0000","last_change":"2024-09-12T02:44:07.644792+0000","last_active":"2024-09-12T02:44:07.645207+0000","last_peered":"2024-09-12T02:44:07.645207+0000","last_clean":"2024-09-12T02:44:07.645207+0000","last_became_active":"2024-09-12T02:44:07.644134+0000","last_became_peered":"2024-09-12T02:44:07.644134+0000","last_unstale":"2024-09-12T02:44:07.645207+0000","last_undegraded":"2024-09-12T02:44:07.645207+0000","last_fullsized":"2024-09-12T02:44:07.645207+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:20:30.623253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.654614+0000","last_change":"2024-09-12T02:44:06.621560+0000","last_active":"2024-09-12T02:44:07.654614+0000","last_peered":"2024-09-12T02:44:07.654614+0000","last_clean":"2024-09-12T02:44:07.654614+0000","last_became_active":"2024-09-12T02:44:06.621040+0000","last_became_peered":"2024-09-12T02:44:06.621040+0000","last_unstale":"2024-09-12T02:44:07.654614+0000","last_undegraded":"2024-09-12T02:44:07.654614+0000","last_fullsized":"2024-09-12T02:44:07.654614+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:18.782382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.628959+0000","last_change":"2024-09-12T02:44:07.628843+0000","last_active":"2024-09-12T02:44:07.628959+0000","last_peered":"2024-09-12T02:44:07.628959+0000","last_clean":"2024-09-12T02:44:07.628959+0000","last_became_active":"2024-09-12T02:44:07.628260+0000","last_became_peered":"2024-09-12T02:44:07.628260+0000","last_unstale":"2024-09-12T02:44:07.628959+0000","last_undegraded":"2024-09-12T02:44:07.628959+0000","last_fullsized":"2024-09-12T02:44:07.628959+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:49.130483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"63'1","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.655614+0000","last_change":"2024-09-12T02:44:06.624756+0000","last_active":"2024-09-12T02:44:07.655614+0000","last_peered":"2024-09-12T02:44:07.655614+0000","last_clean":"2024-09-12T02:44:07.655614+0000","last_became_active":"2024-09-12T02:44:06.623727+0000","last_became_peered":"2024-09-12T02:44:06.623727+0000","last_unstale":"2024-09-12T02:44:07.655614+0000","last_undegraded":"2024-09-12T02:44:07.655614+0000","last_fullsized":"2024-09-12T02:44:07.655614+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:57.069795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.645750+0000","last_change":"2024-09-12T02:44:07.645654+0000","last_active":"2024-09-12T02:44:07.645750+0000","last_peered":"2024-09-12T02:44:07.645750+0000","last_clean":"2024-09-12T02:44:07.645750+0000","last_became_active":"2024-09-12T02:44:07.645217+0000","last_became_peered":"2024-09-12T02:44:07.645217+0000","last_unstale":"2024-09-12T02:44:07.645750+0000","last_undegraded":"2024-09-12T02:44:07.645750+0000","last_fullsized":"2024-09-12T02:44:07.645750+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:32.512907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.635048+0000","last_change":"2024-09-12T02:44:06.623344+0000","last_active":"2024-09-12T02:44:07.635048+0000","last_peered":"2024-09-12T02:44:07.635048+0000","last_clean":"2024-09-12T02:44:07.635048+0000","last_became_active":"2024-09-12T02:44:06.622929+0000","last_became_peered":"2024-09-12T02:44:06.622929+0000","last_unstale":"2024-09-12T02:44:07.635048+0000","last_undegraded":"2024-09-12T02:44:07.635048+0000","last_fullsized":"2024-09-12T02:44:07.635048+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:20.465064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.645247+0000","last_change":"2024-09-12T02:44:07.645012+0000","last_active":"2024-09-12T02:44:07.645247+0000","last_peered":"2024-09-12T02:44:07.645247+0000","last_clean":"2024-09-12T02:44:07.645247+0000","last_became_active":"2024-09-12T02:44:07.644542+0000","last_became_peered":"2024-09-12T02:44:07.644542+0000","last_unstale":"2024-09-12T02:44:07.645247+0000","last_undegraded":"2024-09-12T02:44:07.645247+0000","last_fullsized":"2024-09-12T02:44:07.645247+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:27.061931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.653902+0000","last_change":"2024-09-12T02:44:06.615146+0000","last_active":"2024-09-12T02:44:07.653902+0000","last_peered":"2024-09-12T02:44:07.653902+0000","last_clean":"2024-09-12T02:44:07.653902+0000","last_became_active":"2024-09-12T02:44:06.614913+0000","last_became_peered":"2024-09-12T02:44:06.614913+0000","last_unstale":"2024-09-12T02:44:07.653902+0000","last_undegraded":"2024-09-12T02:44:07.653902+0000","last_fullsized":"2024-09-12T02:44:07.653902+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:57.775910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.638620+0000","last_change":"2024-09-12T02:44:07.638471+0000","last_active":"2024-09-12T02:44:07.638620+0000","last_peered":"2024-09-12T02:44:07.638620+0000","last_clean":"2024-09-12T02:44:07.638620+0000","last_became_active":"2024-09-12T02:44:07.637248+0000","last_became_peered":"2024-09-12T02:44:07.637248+0000","last_unstale":"2024-09-12T02:44:07.638620+0000","last_undegraded":"2024-09-12T02:44:07.638620+0000","last_fullsized":"2024-09-12T02:44:07.638620+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:38.199387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.634254+0000","last_change":"2024-09-12T02:44:06.621422+0000","last_active":"2024-09-12T02:44:07.634254+0000","last_peered":"2024-09-12T02:44:07.634254+0000","last_clean":"2024-09-12T02:44:07.634254+0000","last_became_active":"2024-09-12T02:44:06.620971+0000","last_became_peered":"2024-09-12T02:44:06.620971+0000","last_unstale":"2024-09-12T02:44:07.634254+0000","last_undegraded":"2024-09-12T02:44:07.634254+0000","last_fullsized":"2024-09-12T02:44:07.634254+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:53.553824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.641983+0000","last_change":"2024-09-12T02:44:07.641802+0000","last_active":"2024-09-12T02:44:07.641983+0000","last_peered":"2024-09-12T02:44:07.641983+0000","last_clean":"2024-09-12T02:44:07.641983+0000","last_became_active":"2024-09-12T02:44:07.641595+0000","last_became_peered":"2024-09-12T02:44:07.641595+0000","last_unstale":"2024-09-12T02:44:07.641983+0000","last_undegraded":"2024-09-12T02:44:07.641983+0000","last_fullsized":"2024-09-12T02:44:07.641983+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:16.244941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.632879+0000","last_change":"2024-09-12T02:44:06.613007+0000","last_active":"2024-09-12T02:44:07.632879+0000","last_peered":"2024-09-12T02:44:07.632879+0000","last_clean":"2024-09-12T02:44:07.632879+0000","last_became_active":"2024-09-12T02:44:06.612629+0000","last_became_peered":"2024-09-12T02:44:06.612629+0000","last_unstale":"2024-09-12T02:44:07.632879+0000","last_undegraded":"2024-09-12T02:44:07.632879+0000","last_fullsized":"2024-09-12T02:44:07.632879+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:11.145842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.637723+0000","last_change":"2024-09-12T02:44:07.637048+0000","last_active":"2024-09-12T02:44:07.637723+0000","last_peered":"2024-09-12T02:44:07.637723+0000","last_clean":"2024-09-12T02:44:07.637723+0000","last_became_active":"2024-09-12T02:44:07.636783+0000","last_became_peered":"2024-09-12T02:44:07.636783+0000","last_unstale":"2024-09-12T02:44:07.637723+0000","last_undegraded":"2024-09-12T02:44:07.637723+0000","last_fullsized":"2024-09-12T02:44:07.637723+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:32.664471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.655488+0000","last_change":"2024-09-12T02:44:06.613948+0000","last_active":"2024-09-12T02:44:07.655488+0000","last_peered":"2024-09-12T02:44:07.655488+0000","last_clean":"2024-09-12T02:44:07.655488+0000","last_became_active":"2024-09-12T02:44:06.613722+0000","last_became_peered":"2024-09-12T02:44:06.613722+0000","last_unstale":"2024-09-12T02:44:07.655488+0000","last_undegraded":"2024-09-12T02:44:07.655488+0000","last_fullsized":"2024-09-12T02:44:07.655488+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:36.820981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.642251+0000","last_change":"2024-09-12T02:44:07.642112+0000","last_active":"2024-09-12T02:44:07.642251+0000","last_peered":"2024-09-12T02:44:07.642251+0000","last_clean":"2024-09-12T02:44:07.642251+0000","last_became_active":"2024-09-12T02:44:07.641736+0000","last_became_peered":"2024-09-12T02:44:07.641736+0000","last_unstale":"2024-09-12T02:44:07.642251+0000","last_undegraded":"2024-09-12T02:44:07.642251+0000","last_fullsized":"2024-09-12T02:44:07.642251+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:15.565701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.634503+0000","last_change":"2024-09-12T02:44:06.620442+0000","last_active":"2024-09-12T02:44:07.634503+0000","last_peered":"2024-09-12T02:44:07.634503+0000","last_clean":"2024-09-12T02:44:07.634503+0000","last_became_active":"2024-09-12T02:44:06.620172+0000","last_became_peered":"2024-09-12T02:44:06.620172+0000","last_unstale":"2024-09-12T02:44:07.634503+0000","last_undegraded":"2024-09-12T02:44:07.634503+0000","last_fullsized":"2024-09-12T02:44:07.634503+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:28.931010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.640657+0000","last_change":"2024-09-12T02:44:07.636730+0000","last_active":"2024-09-12T02:44:07.640657+0000","last_peered":"2024-09-12T02:44:07.640657+0000","last_clean":"2024-09-12T02:44:07.640657+0000","last_became_active":"2024-09-12T02:44:07.636470+0000","last_became_peered":"2024-09-12T02:44:07.636470+0000","last_unstale":"2024-09-12T02:44:07.640657+0000","last_undegraded":"2024-09-12T02:44:07.640657+0000","last_fullsized":"2024-09-12T02:44:07.640657+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:56.633705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.624516+0000","last_change":"2024-09-12T02:44:06.616304+0000","last_active":"2024-09-12T02:44:07.624516+0000","last_peered":"2024-09-12T02:44:07.624516+0000","last_clean":"2024-09-12T02:44:07.624516+0000","last_became_active":"2024-09-12T02:44:06.616013+0000","last_became_peered":"2024-09-12T02:44:06.616013+0000","last_unstale":"2024-09-12T02:44:07.624516+0000","last_undegraded":"2024-09-12T02:44:07.624516+0000","last_fullsized":"2024-09-12T02:44:07.624516+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:33.406489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.637220+0000","last_change":"2024-09-12T02:44:07.636912+0000","last_active":"2024-09-12T02:44:07.637220+0000","last_peered":"2024-09-12T02:44:07.637220+0000","last_clean":"2024-09-12T02:44:07.637220+0000","last_became_active":"2024-09-12T02:44:07.636689+0000","last_became_peered":"2024-09-12T02:44:07.636689+0000","last_unstale":"2024-09-12T02:44:07.637220+0000","last_undegraded":"2024-09-12T02:44:07.637220+0000","last_fullsized":"2024-09-12T02:44:07.637220+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:25.292003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.631206+0000","last_change":"2024-09-12T02:44:06.617026+0000","last_active":"2024-09-12T02:44:07.631206+0000","last_peered":"2024-09-12T02:44:07.631206+0000","last_clean":"2024-09-12T02:44:07.631206+0000","last_became_active":"2024-09-12T02:44:06.616768+0000","last_became_peered":"2024-09-12T02:44:06.616768+0000","last_unstale":"2024-09-12T02:44:07.631206+0000","last_undegraded":"2024-09-12T02:44:07.631206+0000","last_fullsized":"2024-09-12T02:44:07.631206+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:32.491624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.645433+0000","last_change":"2024-09-12T02:44:07.645314+0000","last_active":"2024-09-12T02:44:07.645433+0000","last_peered":"2024-09-12T02:44:07.645433+0000","last_clean":"2024-09-12T02:44:07.645433+0000","last_became_active":"2024-09-12T02:44:07.644660+0000","last_became_peered":"2024-09-12T02:44:07.644660+0000","last_unstale":"2024-09-12T02:44:07.645433+0000","last_undegraded":"2024-09-12T02:44:07.645433+0000","last_fullsized":"2024-09-12T02:44:07.645433+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:39:24.581758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.635590+0000","last_change":"2024-09-12T02:44:06.614105+0000","last_active":"2024-09-12T02:44:07.635590+0000","last_peered":"2024-09-12T02:44:07.635590+0000","last_clean":"2024-09-12T02:44:07.635590+0000","last_became_active":"2024-09-12T02:44:06.613496+0000","last_became_peered":"2024-09-12T02:44:06.613496+0000","last_unstale":"2024-09-12T02:44:07.635590+0000","last_undegraded":"2024-09-12T02:44:07.635590+0000","last_fullsized":"2024-09-12T02:44:07.635590+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:09.405109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.635935+0000","last_change":"2024-09-12T02:44:07.635541+0000","last_active":"2024-09-12T02:44:07.635935+0000","last_peered":"2024-09-12T02:44:07.635935+0000","last_clean":"2024-09-12T02:44:07.635935+0000","last_became_active":"2024-09-12T02:44:07.634963+0000","last_became_peered":"2024-09-12T02:44:07.634963+0000","last_unstale":"2024-09-12T02:44:07.635935+0000","last_undegraded":"2024-09-12T02:44:07.635935+0000","last_fullsized":"2024-09-12T02:44:07.635935+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:14.394498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.626497+0000","last_change":"2024-09-12T02:44:06.622209+0000","last_active":"2024-09-12T02:44:07.626497+0000","last_peered":"2024-09-12T02:44:07.626497+0000","last_clean":"2024-09-12T02:44:07.626497+0000","last_became_active":"2024-09-12T02:44:06.621628+0000","last_became_peered":"2024-09-12T02:44:06.621628+0000","last_unstale":"2024-09-12T02:44:07.626497+0000","last_undegraded":"2024-09-12T02:44:07.626497+0000","last_fullsized":"2024-09-12T02:44:07.626497+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:43.889039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.634864+0000","last_change":"2024-09-12T02:44:07.634740+0000","last_active":"2024-09-12T02:44:07.634864+0000","last_peered":"2024-09-12T02:44:07.634864+0000","last_clean":"2024-09-12T02:44:07.634864+0000","last_became_active":"2024-09-12T02:44:07.634501+0000","last_became_peered":"2024-09-12T02:44:07.634501+0000","last_unstale":"2024-09-12T02:44:07.634864+0000","last_undegraded":"2024-09-12T02:44:07.634864+0000","last_fullsized":"2024-09-12T02:44:07.634864+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:23.108644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.633463+0000","last_change":"2024-09-12T02:44:06.620211+0000","last_active":"2024-09-12T02:44:07.633463+0000","last_peered":"2024-09-12T02:44:07.633463+0000","last_clean":"2024-09-12T02:44:07.633463+0000","last_became_active":"2024-09-12T02:44:06.619968+0000","last_became_peered":"2024-09-12T02:44:06.619968+0000","last_unstale":"2024-09-12T02:44:07.633463+0000","last_undegraded":"2024-09-12T02:44:07.633463+0000","last_fullsized":"2024-09-12T02:44:07.633463+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:21.008320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.627342+0000","last_change":"2024-09-12T02:44:07.627197+0000","last_active":"2024-09-12T02:44:07.627342+0000","last_peered":"2024-09-12T02:44:07.627342+0000","last_clean":"2024-09-12T02:44:07.627342+0000","last_became_active":"2024-09-12T02:44:07.626935+0000","last_became_peered":"2024-09-12T02:44:07.626935+0000","last_unstale":"2024-09-12T02:44:07.627342+0000","last_undegraded":"2024-09-12T02:44:07.627342+0000","last_fullsized":"2024-09-12T02:44:07.627342+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:03.729281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.626495+0000","last_change":"2024-09-12T02:44:06.611581+0000","last_active":"2024-09-12T02:44:07.626495+0000","last_peered":"2024-09-12T02:44:07.626495+0000","last_clean":"2024-09-12T02:44:07.626495+0000","last_became_active":"2024-09-12T02:44:06.610832+0000","last_became_peered":"2024-09-12T02:44:06.610832+0000","last_unstale":"2024-09-12T02:44:07.626495+0000","last_undegraded":"2024-09-12T02:44:07.626495+0000","last_fullsized":"2024-09-12T02:44:07.626495+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:50.323894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.635376+0000","last_change":"2024-09-12T02:44:07.635243+0000","last_active":"2024-09-12T02:44:07.635376+0000","last_peered":"2024-09-12T02:44:07.635376+0000","last_clean":"2024-09-12T02:44:07.635376+0000","last_became_active":"2024-09-12T02:44:07.635009+0000","last_became_peered":"2024-09-12T02:44:07.635009+0000","last_unstale":"2024-09-12T02:44:07.635376+0000","last_undegraded":"2024-09-12T02:44:07.635376+0000","last_fullsized":"2024-09-12T02:44:07.635376+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:06.603684+0000","last_clean_scrub_stamp":"2024-09-12T02:44:06.603684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:37.665724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.624718+0000","last_change":"2024-09-12T02:44:06.611975+0000","last_active":"2024-09-12T02:44:07.624718+0000","last_peered":"2024-09-12T02:44:07.624718+0000","last_clean":"2024-09-12T02:44:07.624718+0000","last_became_active":"2024-09-12T02:44:06.611015+0000","last_became_peered":"2024-09-12T02:44:06.611015+0000","last_unstale":"2024-09-12T02:44:07.624718+0000","last_undegraded":"2024-09-12T02:44:07.624718+0000","last_fullsized":"2024-09-12T02:44:07.624718+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:44:05.597600+0000","last_clean_scrub_stamp":"2024-09-12T02:44:05.597600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:25.663670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":250,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T02:44:07.629985+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:44:07.629985+0000","last_peered":"2024-09-12T02:44:07.629985+0000","last_clean":"2024-09-12T02:44:07.629985+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:44:07.629985+0000","last_undegraded":"2024-09-12T02:44:07.629985+0000","last_fullsized":"2024-09-12T02:44:07.629985+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:19.941592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":883,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194428,"statfs":{"total":200000000,"available":199095014,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":313,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194998,"statfs":{"total":200000000,"available":199678607,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":307,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195005,"statfs":{"total":200000000,"available":199685382,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":307,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195005,"statfs":{"total":200000000,"available":199685382,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":307,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195005,"statfs":{"total":200000000,"available":199685382,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":307,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195005,"statfs":{"total":200000000,"available":199685382,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":307,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195005,"statfs":{"total":200000000,"available":199685382,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":892,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194419,"statfs":{"total":200000000,"available":199086045,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:44:12.210 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:44:12.210 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T02:44:12.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.405+0000 7f2e91a00640 1 Processor -- start 2024-09-12T02:44:12.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.405+0000 7f2e91a00640 1 -- start start 2024-09-12T02:44:12.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.406+0000 7f2e91a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2e8c06d680 0x7f2e8c06da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:12.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.407+0000 7f2e91a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e8c0b24d0 con 0x7f2e8c0b7300 2024-09-12T02:44:12.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.407+0000 7f2e91a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e8c06dfa0 con 0x7f2e8c0b7770 2024-09-12T02:44:12.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.407+0000 7f2e91a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2e8c0b2770 con 0x7f2e8c06d680 2024-09-12T02:44:12.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.407+0000 7f2e83400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2e8c0b7300 0x7f2e8c0b3530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:56456/0 (socket says 172.21.15.112:56456) 2024-09-12T02:44:12.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.407+0000 7f2e83400640 1 -- 172.21.15.112:0/3895034426 learned_addr learned my addr 172.21.15.112:0/3895034426 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:44:12.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.407+0000 7f2e8be00640 1 --2- 172.21.15.112:0/3895034426 >> v2:172.21.15.112:3300/0 conn(0x7f2e8c06d680 0x7f2e8c06da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:12.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.407+0000 7f2e8b400640 1 -- 172.21.15.112:0/3895034426 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1241826206 0 0) 0x7f2e8c0b24d0 con 0x7f2e8c0b7300 2024-09-12T02:44:12.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.407+0000 7f2e8be00640 1 -- 172.21.15.112:0/3895034426 >> v1:172.21.15.137:6789/0 conn(0x7f2e8c0b7770 legacy=0x7f2e8c0b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:12.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.407+0000 7f2e8be00640 1 -- 172.21.15.112:0/3895034426 >> v1:172.21.15.112:6789/0 conn(0x7f2e8c0b7300 legacy=0x7f2e8c0b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:12.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.407+0000 7f2e8be00640 1 -- 172.21.15.112:0/3895034426 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8c0b2a50 con 0x7f2e8c06d680 2024-09-12T02:44:12.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.408+0000 7f2e8be00640 1 --2- 172.21.15.112:0/3895034426 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e8c06d680 0x7f2e8c06da60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c0097d0 tx=0x7f2e7c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f234fc03a04a6e17 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:12.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.409+0000 7f2e8b400640 1 -- 172.21.15.112:0/3895034426 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c037070 con 0x7f2e8c06d680 2024-09-12T02:44:12.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.409+0000 7f2e8b400640 1 -- 172.21.15.112:0/3895034426 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e7c032440 con 0x7f2e8c06d680 2024-09-12T02:44:12.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.409+0000 7f2e8b400640 1 -- 172.21.15.112:0/3895034426 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c032810 con 0x7f2e8c06d680 2024-09-12T02:44:12.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.409+0000 7f2e91a00640 1 -- 172.21.15.112:0/3895034426 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e8c06d680 msgr2=0x7f2e8c06da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:12.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.409+0000 7f2e91a00640 1 --2- 172.21.15.112:0/3895034426 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e8c06d680 0x7f2e8c06da60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c0097d0 tx=0x7f2e7c02a270 comp rx=0 tx=0).stop 2024-09-12T02:44:12.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.409+0000 7f2e91a00640 1 -- 172.21.15.112:0/3895034426 shutdown_connections 2024-09-12T02:44:12.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.409+0000 7f2e91a00640 1 --2- 172.21.15.112:0/3895034426 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e8c06d680 0x7f2e8c06da60 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:12.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.409+0000 7f2e91a00640 1 -- 172.21.15.112:0/3895034426 >> 172.21.15.112:0/3895034426 conn(0x7f2e8c0b7ea0 msgr2=0x7f2e8c0b82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:12.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.409+0000 7f2e91a00640 1 -- 172.21.15.112:0/3895034426 shutdown_connections 2024-09-12T02:44:12.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.409+0000 7f2e91a00640 1 -- 172.21.15.112:0/3895034426 wait complete. 2024-09-12T02:44:12.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.411+0000 7f2e91a00640 1 Processor -- start 2024-09-12T02:44:12.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.411+0000 7f2e91a00640 1 -- start start 2024-09-12T02:44:12.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.412+0000 7f2e91a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e8c06d680 0x7f2e8c151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:12.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.412+0000 7f2e91a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e8c0b7300 0x7f2e8c155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:12.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.412+0000 7f2e91a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e8c0b7770 0x7f2e8c157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:12.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.412+0000 7f2e91a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8c0b6670 con 0x7f2e8c06d680 2024-09-12T02:44:12.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.412+0000 7f2e91a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8c0b3010 con 0x7f2e8c0b7770 2024-09-12T02:44:12.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.412+0000 7f2e91a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2e8c0b4350 con 0x7f2e8c0b7300 2024-09-12T02:44:12.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.412+0000 7f2e8be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e8c06d680 0x7f2e8c151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:12.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.412+0000 7f2e8be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e8c06d680 0x7f2e8c151750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50364/0 (socket says 172.21.15.112:50364) 2024-09-12T02:44:12.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.412+0000 7f2e8be00640 1 -- 172.21.15.112:0/850521675 learned_addr learned my addr 172.21.15.112:0/850521675 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:12.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.412+0000 7f2e83400640 1 --2- 172.21.15.112:0/850521675 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e8c0b7300 0x7f2e8c155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:12.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.412+0000 7f2e91000640 1 --2- 172.21.15.112:0/850521675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e8c0b7770 0x7f2e8c157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:12.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.412+0000 7f2e8be00640 1 -- 172.21.15.112:0/850521675 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e8c0b7300 msgr2=0x7f2e8c155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:12.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.412+0000 7f2e8be00640 1 --2- 172.21.15.112:0/850521675 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e8c0b7300 0x7f2e8c155480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:12.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.412+0000 7f2e8be00640 1 -- 172.21.15.112:0/850521675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e8c0b7770 msgr2=0x7f2e8c157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:12.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.412+0000 7f2e8be00640 1 --2- 172.21.15.112:0/850521675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e8c0b7770 0x7f2e8c157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:12.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.412+0000 7f2e8be00640 1 -- 172.21.15.112:0/850521675 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8c1559c0 con 0x7f2e8c06d680 2024-09-12T02:44:12.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.413+0000 7f2e8be00640 1 --2- 172.21.15.112:0/850521675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e8c06d680 0x7f2e8c151750 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c0097d0 tx=0x7f2e7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:12.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.413+0000 7f2e88c00640 1 -- 172.21.15.112:0/850521675 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c037050 con 0x7f2e8c06d680 2024-09-12T02:44:12.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.413+0000 7f2e88c00640 1 -- 172.21.15.112:0/850521675 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e7c038040 con 0x7f2e8c06d680 2024-09-12T02:44:12.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.413+0000 7f2e88c00640 1 -- 172.21.15.112:0/850521675 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c004490 con 0x7f2e8c06d680 2024-09-12T02:44:12.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.413+0000 7f2e91a00640 1 -- 172.21.15.112:0/850521675 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e8c155c40 con 0x7f2e8c06d680 2024-09-12T02:44:12.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.413+0000 7f2e91a00640 1 -- 172.21.15.112:0/850521675 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e8c156200 con 0x7f2e8c06d680 2024-09-12T02:44:12.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.414+0000 7f2e91a00640 1 -- 172.21.15.112:0/850521675 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e8c0af960 con 0x7f2e8c06d680 2024-09-12T02:44:12.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.415+0000 7f2e88c00640 1 -- 172.21.15.112:0/850521675 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e7c030900 con 0x7f2e8c06d680 2024-09-12T02:44:12.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.416+0000 7f2e88c00640 1 --2- 172.21.15.112:0/850521675 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2e6806be30 0x7f2e6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:12.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.416+0000 7f2e88c00640 1 -- 172.21.15.112:0/850521675 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5709+0+0 (secure 0 0 0) 0x7f2e7c0abb20 con 0x7f2e8c06d680 2024-09-12T02:44:12.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.416+0000 7f2e83400640 1 --2- 172.21.15.112:0/850521675 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2e6806be30 0x7f2e6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:12.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.417+0000 7f2e83400640 1 --2- 172.21.15.112:0/850521675 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2e6806be30 0x7f2e6806e2f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c071030 tx=0x7f2e74007bb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:12.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.420+0000 7f2e88c00640 1 -- 172.21.15.112:0/850521675 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e8c1559c0 con 0x7f2e8c06d680 2024-09-12T02:44:12.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.655+0000 7f2e91a00640 1 -- 172.21.15.112:0/850521675 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f2e8c0709c0 con 0x7f2e8c06d680 2024-09-12T02:44:12.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.658+0000 7f2e88c00640 1 -- 172.21.15.112:0/850521675 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f2e7c07a680 con 0x7f2e8c06d680 2024-09-12T02:44:12.659 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-09-12T02:44:12.659 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDUVOJmaG86ExAAD0SOlJOsLpoQZlgPJIPaxA== 2024-09-12T02:44:12.659 INFO:teuthology.orchestra.run.smithi112.stdout: caps mds = "allow" 2024-09-12T02:44:12.659 INFO:teuthology.orchestra.run.smithi112.stdout: caps mon = "allow r" 2024-09-12T02:44:12.659 INFO:teuthology.orchestra.run.smithi112.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T02:44:12.659 INFO:teuthology.orchestra.run.smithi112.stderr:updated caps for client.0 2024-09-12T02:44:12.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.660+0000 7f2e91a00640 1 -- 172.21.15.112:0/850521675 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2e6806be30 msgr2=0x7f2e6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:12.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.660+0000 7f2e91a00640 1 --2- 172.21.15.112:0/850521675 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2e6806be30 0x7f2e6806e2f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c071030 tx=0x7f2e74007bb0 comp rx=0 tx=0).stop 2024-09-12T02:44:12.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.660+0000 7f2e91a00640 1 -- 172.21.15.112:0/850521675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e8c06d680 msgr2=0x7f2e8c151750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:12.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.660+0000 7f2e91a00640 1 --2- 172.21.15.112:0/850521675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e8c06d680 0x7f2e8c151750 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c0097d0 tx=0x7f2e7c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:44:12.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.660+0000 7f2e91a00640 1 -- 172.21.15.112:0/850521675 shutdown_connections 2024-09-12T02:44:12.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.660+0000 7f2e91a00640 1 --2- 172.21.15.112:0/850521675 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2e6806be30 0x7f2e6806e2f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:12.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.660+0000 7f2e91a00640 1 --2- 172.21.15.112:0/850521675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e8c0b7770 0x7f2e8c157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:12.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.660+0000 7f2e91a00640 1 --2- 172.21.15.112:0/850521675 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e8c0b7300 0x7f2e8c155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:12.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.660+0000 7f2e91a00640 1 --2- 172.21.15.112:0/850521675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e8c06d680 0x7f2e8c151750 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:12.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.660+0000 7f2e91a00640 1 -- 172.21.15.112:0/850521675 >> 172.21.15.112:0/850521675 conn(0x7f2e8c0b7ea0 msgr2=0x7f2e8c0b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:12.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.660+0000 7f2e91a00640 1 -- 172.21.15.112:0/850521675 shutdown_connections 2024-09-12T02:44:12.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.660+0000 7f2e91a00640 1 -- 172.21.15.112:0/850521675 wait complete. 2024-09-12T02:44:12.678 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:44:12.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.829+0000 7fc0dec00640 1 Processor -- start 2024-09-12T02:44:12.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.829+0000 7fc0dec00640 1 -- start start 2024-09-12T02:44:12.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.830+0000 7fc0dec00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc0d815cc50 0x7fc0d80732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:12.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.830+0000 7fc0dec00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0d80afe30 0x7fc0d80cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:12.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.830+0000 7fc0dec00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0d8073830 con 0x7fc0d8071530 2024-09-12T02:44:12.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.830+0000 7fc0dec00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc0d815d030 con 0x7fc0d815cc50 2024-09-12T02:44:12.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.830+0000 7fc0dec00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc0d80cf4c0 con 0x7fc0d80afe30 2024-09-12T02:44:12.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.831+0000 7fc0d7e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc0d815cc50 0x7fc0d80732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:12.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.831+0000 7fc0dcc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0d80afe30 0x7fc0d80cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:12.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.831+0000 7fc0d7e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc0d815cc50 0x7fc0d80732f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:43792/0 (socket says 172.21.15.112:43792) 2024-09-12T02:44:12.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.831+0000 7fc0d7e00640 1 -- 172.21.15.112:0/2122285958 learned_addr learned my addr 172.21.15.112:0/2122285958 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:12.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.831+0000 7fc0d7e00640 1 -- 172.21.15.112:0/2122285958 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0d80afe30 msgr2=0x7fc0d80cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:12.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.831+0000 7fc0d7e00640 1 --2- 172.21.15.112:0/2122285958 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0d80afe30 0x7fc0d80cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:12.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.831+0000 7fc0d7e00640 1 -- 172.21.15.112:0/2122285958 >> v1:172.21.15.137:6789/0 conn(0x7fc0d8071530 legacy=0x7fc0d80af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:12.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.831+0000 7fc0d7e00640 1 -- 172.21.15.112:0/2122285958 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d80ceeb0 con 0x7fc0d815cc50 2024-09-12T02:44:12.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.832+0000 7fc0d7e00640 1 --2- 172.21.15.112:0/2122285958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0d815cc50 0x7fc0d80732f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8009870 tx=0x7fc0c802a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6e2b27e3ee1d163 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:12.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.832+0000 7fc0d6a00640 1 -- 172.21.15.112:0/2122285958 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c8037070 con 0x7fc0d815cc50 2024-09-12T02:44:12.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.832+0000 7fc0d6a00640 1 -- 172.21.15.112:0/2122285958 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0c8032440 con 0x7fc0d815cc50 2024-09-12T02:44:12.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.832+0000 7fc0d6a00640 1 -- 172.21.15.112:0/2122285958 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c8032810 con 0x7fc0d815cc50 2024-09-12T02:44:12.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.833+0000 7fc0dec00640 1 -- 172.21.15.112:0/2122285958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0d815cc50 msgr2=0x7fc0d80732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:12.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.833+0000 7fc0dec00640 1 --2- 172.21.15.112:0/2122285958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0d815cc50 0x7fc0d80732f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8009870 tx=0x7fc0c802a1e0 comp rx=0 tx=0).stop 2024-09-12T02:44:12.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.833+0000 7fc0dec00640 1 -- 172.21.15.112:0/2122285958 shutdown_connections 2024-09-12T02:44:12.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.833+0000 7fc0dec00640 1 --2- 172.21.15.112:0/2122285958 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0d80afe30 0x7fc0d80cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:12.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.833+0000 7fc0dec00640 1 --2- 172.21.15.112:0/2122285958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0d815cc50 0x7fc0d80732f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:12.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.833+0000 7fc0dec00640 1 -- 172.21.15.112:0/2122285958 >> 172.21.15.112:0/2122285958 conn(0x7fc0d806bbd0 msgr2=0x7fc0d806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:12.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.833+0000 7fc0dec00640 1 -- 172.21.15.112:0/2122285958 shutdown_connections 2024-09-12T02:44:12.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.833+0000 7fc0dec00640 1 -- 172.21.15.112:0/2122285958 wait complete. 2024-09-12T02:44:12.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.835+0000 7fc0dec00640 1 Processor -- start 2024-09-12T02:44:12.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.835+0000 7fc0dec00640 1 -- start start 2024-09-12T02:44:12.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.836+0000 7fc0dec00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0d8071530 0x7fc0d8154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:12.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.836+0000 7fc0dec00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0d80afe30 0x7fc0d8150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:12.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.836+0000 7fc0dec00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0d815cc50 0x7fc0d8150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:12.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.836+0000 7fc0dec00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d80cf150 con 0x7fc0d80afe30 2024-09-12T02:44:12.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.836+0000 7fc0dec00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d806e5e0 con 0x7fc0d8071530 2024-09-12T02:44:12.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.836+0000 7fc0dec00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc0d806f510 con 0x7fc0d815cc50 2024-09-12T02:44:12.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.836+0000 7fc0d7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0d80afe30 0x7fc0d8150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:12.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.836+0000 7fc0d7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0d80afe30 0x7fc0d8150150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50370/0 (socket says 172.21.15.112:50370) 2024-09-12T02:44:12.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.836+0000 7fc0d7400640 1 -- 172.21.15.112:0/1756145111 learned_addr learned my addr 172.21.15.112:0/1756145111 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:12.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.836+0000 7fc0d7e00640 1 --2- 172.21.15.112:0/1756145111 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0d8071530 0x7fc0d8154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:12.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.836+0000 7fc0dcc00640 1 --2- 172.21.15.112:0/1756145111 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0d815cc50 0x7fc0d8150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:12.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.837+0000 7fc0d7400640 1 -- 172.21.15.112:0/1756145111 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0d815cc50 msgr2=0x7fc0d8150690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:12.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.837+0000 7fc0d7400640 1 --2- 172.21.15.112:0/1756145111 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0d815cc50 0x7fc0d8150690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:12.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.837+0000 7fc0d7400640 1 -- 172.21.15.112:0/1756145111 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0d8071530 msgr2=0x7fc0d8154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:12.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.837+0000 7fc0d7400640 1 --2- 172.21.15.112:0/1756145111 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0d8071530 0x7fc0d8154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:12.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.837+0000 7fc0d7400640 1 -- 172.21.15.112:0/1756145111 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d8155b20 con 0x7fc0d80afe30 2024-09-12T02:44:12.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.837+0000 7fc0d7400640 1 --2- 172.21.15.112:0/1756145111 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0d80afe30 0x7fc0d8150150 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc0c400c400 tx=0x7fc0c400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:12.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.837+0000 7fc0cfe00640 1 -- 172.21.15.112:0/1756145111 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c40052d0 con 0x7fc0d80afe30 2024-09-12T02:44:12.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.837+0000 7fc0cfe00640 1 -- 172.21.15.112:0/1756145111 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0c40054b0 con 0x7fc0d80afe30 2024-09-12T02:44:12.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.837+0000 7fc0dec00640 1 -- 172.21.15.112:0/1756145111 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0d8155e00 con 0x7fc0d80afe30 2024-09-12T02:44:12.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.837+0000 7fc0cfe00640 1 -- 172.21.15.112:0/1756145111 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c4006a40 con 0x7fc0d80afe30 2024-09-12T02:44:12.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.837+0000 7fc0dec00640 1 -- 172.21.15.112:0/1756145111 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0d81553d0 con 0x7fc0d80afe30 2024-09-12T02:44:12.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.838+0000 7fc0dec00640 1 -- 172.21.15.112:0/1756145111 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0d8068a30 con 0x7fc0d80afe30 2024-09-12T02:44:12.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.839+0000 7fc0cfe00640 1 -- 172.21.15.112:0/1756145111 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc0c4006be0 con 0x7fc0d80afe30 2024-09-12T02:44:12.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.840+0000 7fc0cfe00640 1 --2- 172.21.15.112:0/1756145111 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc0b806be60 0x7fc0b806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:12.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.840+0000 7fc0cfe00640 1 -- 172.21.15.112:0/1756145111 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5709+0+0 (secure 0 0 0) 0x7fc0c408a280 con 0x7fc0d80afe30 2024-09-12T02:44:12.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.840+0000 7fc0d7e00640 1 --2- 172.21.15.112:0/1756145111 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc0b806be60 0x7fc0b806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:12.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.841+0000 7fc0d7e00640 1 --2- 172.21.15.112:0/1756145111 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc0b806be60 0x7fc0b806e320 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8034000 tx=0x7fc0c802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:12.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:12.844+0000 7fc0cfe00640 1 -- 172.21.15.112:0/1756145111 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc0d8073830 con 0x7fc0d80afe30 2024-09-12T02:44:13.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.050+0000 7fc0dec00640 1 -- 172.21.15.112:0/1756145111 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc0d806df60 con 0x7fc0d80afe30 2024-09-12T02:44:13.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.050+0000 7fc0cfe00640 1 -- 172.21.15.112:0/1756145111 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5235 (secure 0 0 0) 0x7fc0c40585d0 con 0x7fc0d80afe30 2024-09-12T02:44:13.052 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:44:13.052 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":36,"btime":"2024-09-12T02:44:10:654160+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4997,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1412930245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1412930245},{"type":"v1","addr":"172.21.15.137:6834","nonce":1412930245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5299,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1045746375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1045746375},{"type":"v1","addr":"172.21.15.112:6837","nonce":1045746375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5305,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1625140900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1625140900},{"type":"v1","addr":"172.21.15.137:6835","nonce":1625140900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:44:07.016881+0000","modified":"2024-09-12T02:44:10.058498+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5508":{"gid":5508,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/3039296510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3039296510},{"type":"v1","addr":"172.21.15.112:6835","nonce":3039296510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5508,"qdb_cluster":[5508]},"id":4}]} 2024-09-12T02:44:13.052 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 36 2024-09-12T02:44:13.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.053+0000 7fc0dec00640 1 -- 172.21.15.112:0/1756145111 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc0b806be60 msgr2=0x7fc0b806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:13.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.053+0000 7fc0dec00640 1 --2- 172.21.15.112:0/1756145111 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc0b806be60 0x7fc0b806e320 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8034000 tx=0x7fc0c802e000 comp rx=0 tx=0).stop 2024-09-12T02:44:13.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.053+0000 7fc0dec00640 1 -- 172.21.15.112:0/1756145111 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0d80afe30 msgr2=0x7fc0d8150150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:13.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.053+0000 7fc0dec00640 1 --2- 172.21.15.112:0/1756145111 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0d80afe30 0x7fc0d8150150 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc0c400c400 tx=0x7fc0c400c8c0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.053+0000 7fc0dec00640 1 -- 172.21.15.112:0/1756145111 shutdown_connections 2024-09-12T02:44:13.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.053+0000 7fc0dec00640 1 --2- 172.21.15.112:0/1756145111 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0d815cc50 0x7fc0d8150690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.053+0000 7fc0dec00640 1 --2- 172.21.15.112:0/1756145111 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0d80afe30 0x7fc0d8150150 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.053+0000 7fc0dec00640 1 --2- 172.21.15.112:0/1756145111 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc0b806be60 0x7fc0b806e320 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.053+0000 7fc0dec00640 1 --2- 172.21.15.112:0/1756145111 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0d8071530 0x7fc0d8154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.053+0000 7fc0dec00640 1 -- 172.21.15.112:0/1756145111 >> 172.21.15.112:0/1756145111 conn(0x7fc0d806bbd0 msgr2=0x7fc0d80cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:13.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.053+0000 7fc0dec00640 1 -- 172.21.15.112:0/1756145111 shutdown_connections 2024-09-12T02:44:13.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.053+0000 7fc0dec00640 1 -- 172.21.15.112:0/1756145111 wait complete. 2024-09-12T02:44:13.471 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:44:07.016881+0000', 'modified': '2024-09-12T02:44:10.058498+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5508}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5508': {'gid': 5508, 'name': 'a', 'rank': 0, 'incarnation': 32, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.112:6835/3039296510', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6834', 'nonce': 3039296510}, {'type': 'v1', 'addr': '172.21.15.112:6835', 'nonce': 3039296510}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5508, 'qdb_cluster': [5508]} 2024-09-12T02:44:13.471 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:44:13.472 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-12T02:44:13.591 INFO:tasks.ceph.mds.a.smithi112.stderr:2024-09-12T02:44:13.590+0000 7fbec5a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:44:13.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.626+0000 7ff9c9e00640 1 Processor -- start 2024-09-12T02:44:13.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.626+0000 7ff9c9e00640 1 -- start start 2024-09-12T02:44:13.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.627+0000 7ff9c9e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff9c4071530 0x7ff9c40af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:13.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.627+0000 7ff9c9e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff9c40719a0 0x7ff9c40afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:13.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.627+0000 7ff9c9e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9c40ceeb0 con 0x7ff9c415cc50 2024-09-12T02:44:13.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.627+0000 7ff9c9e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff9c415d030 con 0x7ff9c4071530 2024-09-12T02:44:13.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.627+0000 7ff9c9e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff9c40cf4c0 con 0x7ff9c40719a0 2024-09-12T02:44:13.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.628+0000 7ff9ba000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff9c4071530 0x7ff9c40af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:13.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.628+0000 7ff9c2a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff9c415cc50 0x7ff9c40732f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:56466/0 (socket says 172.21.15.112:56466) 2024-09-12T02:44:13.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.628+0000 7ff9c2a00640 1 -- 172.21.15.112:0/1877791138 learned_addr learned my addr 172.21.15.112:0/1877791138 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:44:13.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.628+0000 7ff9c3400640 1 --2- 172.21.15.112:0/1877791138 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff9c40719a0 0x7ff9c40afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:13.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.628+0000 7ff9ba000640 1 -- 172.21.15.112:0/1877791138 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff9c40719a0 msgr2=0x7ff9c40afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:13.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.628+0000 7ff9ba000640 1 --2- 172.21.15.112:0/1877791138 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff9c40719a0 0x7ff9c40afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.628+0000 7ff9ba000640 1 -- 172.21.15.112:0/1877791138 >> v1:172.21.15.112:6789/0 conn(0x7ff9c415cc50 legacy=0x7ff9c40732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:13.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.628+0000 7ff9ba000640 1 -- 172.21.15.112:0/1877791138 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c406e300 con 0x7ff9c4071530 2024-09-12T02:44:13.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.628+0000 7ff9c2000640 1 -- 172.21.15.112:0/1877791138 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2528263558 0 0) 0x7ff9c40ceeb0 con 0x7ff9c415cc50 2024-09-12T02:44:13.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.629+0000 7ff9ba000640 1 --2- 172.21.15.112:0/1877791138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9c4071530 0x7ff9c40af720 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40cf640 tx=0x7ff9ac02a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6535a62bb5b3fc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:13.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.629+0000 7ff9c2000640 1 -- 172.21.15.112:0/1877791138 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac037070 con 0x7ff9c4071530 2024-09-12T02:44:13.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.630+0000 7ff9c2000640 1 -- 172.21.15.112:0/1877791138 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9ac02ae20 con 0x7ff9c4071530 2024-09-12T02:44:13.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.630+0000 7ff9c2000640 1 -- 172.21.15.112:0/1877791138 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac032660 con 0x7ff9c4071530 2024-09-12T02:44:13.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.630+0000 7ff9c9e00640 1 -- 172.21.15.112:0/1877791138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9c4071530 msgr2=0x7ff9c40af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:13.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.630+0000 7ff9c9e00640 1 --2- 172.21.15.112:0/1877791138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9c4071530 0x7ff9c40af720 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40cf640 tx=0x7ff9ac02a0d0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.630+0000 7ff9c9e00640 1 -- 172.21.15.112:0/1877791138 shutdown_connections 2024-09-12T02:44:13.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.630+0000 7ff9c9e00640 1 --2- 172.21.15.112:0/1877791138 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff9c40719a0 0x7ff9c40afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.630+0000 7ff9c9e00640 1 --2- 172.21.15.112:0/1877791138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9c4071530 0x7ff9c40af720 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.630+0000 7ff9c9e00640 1 -- 172.21.15.112:0/1877791138 >> 172.21.15.112:0/1877791138 conn(0x7ff9c406bbd0 msgr2=0x7ff9c406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:13.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.630+0000 7ff9c9e00640 1 -- 172.21.15.112:0/1877791138 shutdown_connections 2024-09-12T02:44:13.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.630+0000 7ff9c9e00640 1 -- 172.21.15.112:0/1877791138 wait complete. 2024-09-12T02:44:13.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.632+0000 7ff9c9e00640 1 Processor -- start 2024-09-12T02:44:13.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.632+0000 7ff9c9e00640 1 -- start start 2024-09-12T02:44:13.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.633+0000 7ff9c9e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff9c4071530 0x7ff9c4160af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:13.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.633+0000 7ff9c9e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9c40719a0 0x7ff9c4150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:13.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.633+0000 7ff9c9e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9c415cc50 0x7ff9c40ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:13.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.633+0000 7ff9c9e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c406f510 con 0x7ff9c415cc50 2024-09-12T02:44:13.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.633+0000 7ff9c9e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c40cf150 con 0x7ff9c40719a0 2024-09-12T02:44:13.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.633+0000 7ff9c9e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff9c406f690 con 0x7ff9c4071530 2024-09-12T02:44:13.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.633+0000 7ff9c3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9c415cc50 0x7ff9c40ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:13.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.633+0000 7ff9c3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9c415cc50 0x7ff9c40ae8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50398/0 (socket says 172.21.15.112:50398) 2024-09-12T02:44:13.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.633+0000 7ff9c3400640 1 -- 172.21.15.112:0/617218764 learned_addr learned my addr 172.21.15.112:0/617218764 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:13.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.633+0000 7ff9ba000640 1 --2- 172.21.15.112:0/617218764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9c40719a0 0x7ff9c4150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:13.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.633+0000 7ff9c2a00640 1 --2- 172.21.15.112:0/617218764 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff9c4071530 0x7ff9c4160af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:13.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.633+0000 7ff9c3400640 1 -- 172.21.15.112:0/617218764 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff9c4071530 msgr2=0x7ff9c4160af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:13.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.633+0000 7ff9c3400640 1 --2- 172.21.15.112:0/617218764 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff9c4071530 0x7ff9c4160af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.633+0000 7ff9c3400640 1 -- 172.21.15.112:0/617218764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9c40719a0 msgr2=0x7ff9c4150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:13.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.633+0000 7ff9c3400640 1 --2- 172.21.15.112:0/617218764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9c40719a0 0x7ff9c4150990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.633+0000 7ff9c3400640 1 -- 172.21.15.112:0/617218764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c4151850 con 0x7ff9c415cc50 2024-09-12T02:44:13.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.633+0000 7ff9ba000640 1 --2- 172.21.15.112:0/617218764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9c40719a0 0x7ff9c4150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:44:13.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.634+0000 7ff9c3400640 1 --2- 172.21.15.112:0/617218764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9c415cc50 0x7ff9c40ae8d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc00ef90 tx=0x7ff9bc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:13.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.634+0000 7ff9bbe00640 1 -- 172.21.15.112:0/617218764 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc018020 con 0x7ff9c415cc50 2024-09-12T02:44:13.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.634+0000 7ff9bbe00640 1 -- 172.21.15.112:0/617218764 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9bc014480 con 0x7ff9c415cc50 2024-09-12T02:44:13.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.634+0000 7ff9bbe00640 1 -- 172.21.15.112:0/617218764 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc014870 con 0x7ff9c415cc50 2024-09-12T02:44:13.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.634+0000 7ff9c9e00640 1 -- 172.21.15.112:0/617218764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9c40b54f0 con 0x7ff9c415cc50 2024-09-12T02:44:13.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.634+0000 7ff9c9e00640 1 -- 172.21.15.112:0/617218764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9c4151040 con 0x7ff9c415cc50 2024-09-12T02:44:13.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.636+0000 7ff9bbe00640 1 -- 172.21.15.112:0/617218764 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff9bc005d10 con 0x7ff9c415cc50 2024-09-12T02:44:13.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.637+0000 7ff9bbe00640 1 --2- 172.21.15.112:0/617218764 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff9a006be30 0x7ff9a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:13.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.638+0000 7ff9bbe00640 1 -- 172.21.15.112:0/617218764 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5709+0+0 (secure 0 0 0) 0x7ff9bc08bdc0 con 0x7ff9c415cc50 2024-09-12T02:44:13.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.638+0000 7ff9c2a00640 1 --2- 172.21.15.112:0/617218764 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff9a006be30 0x7ff9a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:13.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.638+0000 7ff9ccc68740 1 Processor -- start 2024-09-12T02:44:13.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.638+0000 7ff9ccc68740 1 -- start start 2024-09-12T02:44:13.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.638+0000 7ff9c2a00640 1 --2- 172.21.15.112:0/617218764 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff9a006be30 0x7ff9a006e2f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4000f60 tx=0x7ff9b4007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:13.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.639+0000 7ff9ccc68740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55685a037cf0 0x55685a07d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:13.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.639+0000 7ff9ccc68740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55685a0354b0 0x55685a0380d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:13.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.639+0000 7ff9ccc68740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55685a039480 0x55685a032570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:13.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.639+0000 7ff9ccc68740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x556859f963b0 con 0x55685a039480 2024-09-12T02:44:13.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.639+0000 7ff9ccc68740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556859f9b410 con 0x55685a037cf0 2024-09-12T02:44:13.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.639+0000 7ff9ccc68740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x556859f43620 con 0x55685a0354b0 2024-09-12T02:44:13.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.639+0000 7ff9c3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55685a039480 0x55685a032570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:13.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.639+0000 7ff9c3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55685a039480 0x55685a032570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50414/0 (socket says 172.21.15.112:50414) 2024-09-12T02:44:13.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.639+0000 7ff9c3400640 1 -- 172.21.15.112:0/3786605828 learned_addr learned my addr 172.21.15.112:0/3786605828 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:13.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.639+0000 7ff9ba000640 1 --2- 172.21.15.112:0/3786605828 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55685a0354b0 0x55685a0380d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:13.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.639+0000 7ff9c2a00640 1 --2- 172.21.15.112:0/3786605828 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55685a037cf0 0x55685a07d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:13.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.640+0000 7ff9c3400640 1 -- 172.21.15.112:0/3786605828 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55685a0354b0 msgr2=0x55685a0380d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:13.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.640+0000 7ff9c3400640 1 --2- 172.21.15.112:0/3786605828 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55685a0354b0 0x55685a0380d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.640+0000 7ff9c3400640 1 -- 172.21.15.112:0/3786605828 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55685a037cf0 msgr2=0x55685a07d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:13.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.640+0000 7ff9c3400640 1 --2- 172.21.15.112:0/3786605828 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55685a037cf0 0x55685a07d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.640+0000 7ff9c3400640 1 -- 172.21.15.112:0/3786605828 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556859cae2d0 con 0x55685a039480 2024-09-12T02:44:13.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.640+0000 7ff9ba000640 1 --2- 172.21.15.112:0/3786605828 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55685a0354b0 0x55685a0380d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:44:13.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.640+0000 7ff9c3400640 1 --2- 172.21.15.112:0/3786605828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55685a039480 0x55685a032570 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc059f60 tx=0x7ff9bc059c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34051a8d26108c6a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:13.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.640+0000 7ff9b3400640 1 -- 172.21.15.112:0/3786605828 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc0582d0 con 0x55685a039480 2024-09-12T02:44:13.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.640+0000 7ff9b3400640 1 -- 172.21.15.112:0/3786605828 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9bc088070 con 0x55685a039480 2024-09-12T02:44:13.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.640+0000 7ff9b3400640 1 -- 172.21.15.112:0/3786605828 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc083bb0 con 0x55685a039480 2024-09-12T02:44:13.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.641+0000 7ff9ccc68740 1 -- 172.21.15.112:0/3786605828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55685a039480 msgr2=0x55685a032570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:13.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.641+0000 7ff9ccc68740 1 --2- 172.21.15.112:0/3786605828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55685a039480 0x55685a032570 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc059f60 tx=0x7ff9bc059c20 comp rx=0 tx=0).stop 2024-09-12T02:44:13.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.641+0000 7ff9ccc68740 1 -- 172.21.15.112:0/3786605828 shutdown_connections 2024-09-12T02:44:13.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.641+0000 7ff9ccc68740 1 --2- 172.21.15.112:0/3786605828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55685a039480 0x55685a032570 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.641+0000 7ff9ccc68740 1 --2- 172.21.15.112:0/3786605828 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55685a0354b0 0x55685a0380d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.641+0000 7ff9ccc68740 1 --2- 172.21.15.112:0/3786605828 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55685a037cf0 0x55685a07d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.641+0000 7ff9ccc68740 1 -- 172.21.15.112:0/3786605828 >> 172.21.15.112:0/3786605828 conn(0x55685a034740 msgr2=0x55685a07c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:13.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.641+0000 7ff9ccc68740 1 -- 172.21.15.112:0/3786605828 shutdown_connections 2024-09-12T02:44:13.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.641+0000 7ff9ccc68740 1 -- 172.21.15.112:0/3786605828 wait complete. 2024-09-12T02:44:13.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.642+0000 7ff9ccc68740 1 -- start start 2024-09-12T02:44:13.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.642+0000 7ff9ccc68740 1 Processor -- start 2024-09-12T02:44:13.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.643+0000 7ff9ccc68740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55685a037cf0 0x55685a061d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:13.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.643+0000 7ff9ccc68740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55685a039480 0x55685a062290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:13.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.643+0000 7ff9ccc68740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55685a051100 0x55685a060710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:13.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.643+0000 7ff9ccc68740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x556859f56780 con 0x55685a051100 2024-09-12T02:44:13.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.643+0000 7ff9ccc68740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556859f973d0 con 0x55685a039480 2024-09-12T02:44:13.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.643+0000 7ff9ccc68740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55685a033be0 con 0x55685a037cf0 2024-09-12T02:44:13.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.643+0000 7ff9ccc68740 10 client.0 _ll_register_callbacks cb 0x556859f945d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:44:13.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.643+0000 7ff9c3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55685a051100 0x55685a060710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:13.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.643+0000 7ff9c3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55685a051100 0x55685a060710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50418/0 (socket says 172.21.15.112:50418) 2024-09-12T02:44:13.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.643+0000 7ff9c3400640 1 -- 172.21.15.112:0/387234094 learned_addr learned my addr 172.21.15.112:0/387234094 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:13.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.643+0000 7ff9c2a00640 1 --2- 172.21.15.112:0/387234094 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55685a037cf0 0x55685a061d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:13.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.643+0000 7ff9ba000640 1 --2- 172.21.15.112:0/387234094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55685a039480 0x55685a062290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:13.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.644+0000 7ff9c3400640 1 -- 172.21.15.112:0/387234094 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55685a037cf0 msgr2=0x55685a061d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:13.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.644+0000 7ff9c3400640 1 --2- 172.21.15.112:0/387234094 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55685a037cf0 0x55685a061d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.644+0000 7ff9c3400640 1 -- 172.21.15.112:0/387234094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55685a039480 msgr2=0x55685a062290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:13.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.644+0000 7ff9c3400640 1 --2- 172.21.15.112:0/387234094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55685a039480 0x55685a062290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.644+0000 7ff9c3400640 1 -- 172.21.15.112:0/387234094 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556859d786b0 con 0x55685a051100 2024-09-12T02:44:13.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.644+0000 7ff9c3400640 1 --2- 172.21.15.112:0/387234094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55685a051100 0x55685a060710 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0070b0 tx=0x7ff9bc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6355d9e9a5552822 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:13.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.644+0000 7ff9a7e00640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-12T02:44:13.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.644+0000 7ff9a7e00640 1 -- 172.21.15.112:0/387234094 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc083db0 con 0x55685a051100 2024-09-12T02:44:13.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.644+0000 7ff9ccc68740 1 -- 172.21.15.112:0/387234094 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9bc088070 con 0x55685a051100 2024-09-12T02:44:13.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.644+0000 7ff9a7e00640 1 -- 172.21.15.112:0/387234094 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 5709+0+0 (secure 0 0 0) 0x7ff9bc024bb0 con 0x55685a051100 2024-09-12T02:44:13.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.644+0000 7ff9a7e00640 1 -- 172.21.15.112:0/387234094 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7ff9bc079070 con 0x55685a051100 2024-09-12T02:44:13.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.644+0000 7ff9ccc68740 10 client.5637 fetch_fsmap learned FSMap version 36 2024-09-12T02:44:13.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.644+0000 7ff9ccc68740 1 -- 172.21.15.112:0/387234094 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x55685a0585f0 con 0x55685a051100 2024-09-12T02:44:13.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.644+0000 7ff9a7e00640 1 -- 172.21.15.112:0/387234094 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9bc088070 con 0x55685a051100 2024-09-12T02:44:13.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.645+0000 7ff9a7e00640 1 -- 172.21.15.112:0/387234094 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 36) ==== 3502+0+0 (secure 0 0 0) 0x7ff9bc059420 con 0x55685a051100 2024-09-12T02:44:13.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.645+0000 7ff9ccc68740 10 client.5637 fetch_fsmap finished waiting for FSMap version 36 2024-09-12T02:44:13.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.645+0000 7ff9ccc68740 10 client.5637 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T02:44:13.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.645+0000 7ff9ccc68740 20 client.5637 populate_metadata read hostname 'smithi112' 2024-09-12T02:44:13.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.645+0000 7ff9ccc68740 1 --2- 172.21.15.112:0/387234094 >> [v2:172.21.15.112:6834/3039296510,v1:172.21.15.112:6835/3039296510] conn(0x55685a059790 0x55685a059b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:13.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.645+0000 7ff9ccc68740 4 client.5637 mds_command: new command op to 5508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:44:13.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.645+0000 7ff9ccc68740 1 -- 172.21.15.112:0/387234094 --> [v2:172.21.15.112:6834/3039296510,v1:172.21.15.112:6835/3039296510] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556859fa8b40 con 0x55685a059790 2024-09-12T02:44:13.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.645+0000 7ff9c2a00640 1 --2- 172.21.15.112:0/387234094 >> [v2:172.21.15.112:6834/3039296510,v1:172.21.15.112:6835/3039296510] conn(0x55685a059790 0x55685a059b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:13.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.646+0000 7ff9c2a00640 1 --2- 172.21.15.112:0/387234094 >> [v2:172.21.15.112:6834/3039296510,v1:172.21.15.112:6835/3039296510] conn(0x55685a059790 0x55685a059b70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75e3a1ee8fab9b9c server_cookie=9ea139925b1410c in_seq=0 out_seq=0 2024-09-12T02:44:13.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.646+0000 7ff9a7e00640 10 client.5637 ms_handle_connect on v2:172.21.15.112:6834/3039296510 2024-09-12T02:44:13.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.646+0000 7ff9a7e00640 1 -- 172.21.15.112:0/387234094 <== mds.0 v2:172.21.15.112:6834/3039296510 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556859fa8b40 con 0x55685a059790 2024-09-12T02:44:13.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.646+0000 7ff9a7e00640 10 client.5637 handle_command_reply: tid=0 2024-09-12T02:44:13.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.646+0000 7ff9ccc68740 1 client.5637 shutdown 2024-09-12T02:44:13.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.647+0000 7ff9ccc68740 1 -- 172.21.15.112:0/387234094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55685a051100 msgr2=0x55685a060710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:13.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.647+0000 7ff9ccc68740 1 --2- 172.21.15.112:0/387234094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55685a051100 0x55685a060710 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0070b0 tx=0x7ff9bc013000 comp rx=0 tx=0).stop 2024-09-12T02:44:13.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.647+0000 7ff9ccc68740 1 -- 172.21.15.112:0/387234094 shutdown_connections 2024-09-12T02:44:13.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.647+0000 7ff9ccc68740 1 --2- 172.21.15.112:0/387234094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55685a051100 0x55685a060710 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.647+0000 7ff9ccc68740 1 --2- 172.21.15.112:0/387234094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55685a039480 0x55685a062290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.647+0000 7ff9ccc68740 1 --2- 172.21.15.112:0/387234094 >> [v2:172.21.15.112:6834/3039296510,v1:172.21.15.112:6835/3039296510] conn(0x55685a059790 0x55685a059b70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.647+0000 7ff9ccc68740 1 --2- 172.21.15.112:0/387234094 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55685a037cf0 0x55685a061d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.647+0000 7ff9ccc68740 1 -- 172.21.15.112:0/387234094 >> 172.21.15.112:0/387234094 conn(0x55685a0354b0 msgr2=0x55685a07bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:13.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.647+0000 7ff9a7e00640 0 client.5637 ms_handle_reset on v2:172.21.15.112:6834/3039296510 2024-09-12T02:44:13.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.647+0000 7ff9ccc68740 1 -- 172.21.15.112:0/387234094 shutdown_connections 2024-09-12T02:44:13.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.647+0000 7ff9ccc68740 1 -- 172.21.15.112:0/387234094 wait complete. 2024-09-12T02:44:13.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.647+0000 7ff9ccc68740 20 client.5637 trim_cache size 0 max 16384 2024-09-12T02:44:13.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.665+0000 7ff9ccc68740 1 Processor -- start 2024-09-12T02:44:13.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.666+0000 7ff9ccc68740 1 -- start start 2024-09-12T02:44:13.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.666+0000 7ff9ccc68740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55685a037cf0 0x55685a07abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:13.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.666+0000 7ff9ccc68740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55685a039480 0x55685a07c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:13.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.666+0000 7ff9ccc68740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55685a051100 0x55685a07cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:13.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.667+0000 7ff9ccc68740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c42000c0 con 0x55685a037cf0 2024-09-12T02:44:13.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.667+0000 7ff9ccc68740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c40b45c0 con 0x55685a039480 2024-09-12T02:44:13.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.667+0000 7ff9ccc68740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff9c41ffaa0 con 0x55685a051100 2024-09-12T02:44:13.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.667+0000 7ff9c2a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55685a037cf0 0x55685a07abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:13.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.667+0000 7ff9c2a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55685a037cf0 0x55685a07abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50434/0 (socket says 172.21.15.112:50434) 2024-09-12T02:44:13.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.667+0000 7ff9c2a00640 1 -- 172.21.15.112:0/3449216212 learned_addr learned my addr 172.21.15.112:0/3449216212 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:13.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.667+0000 7ff9c3400640 1 --2- 172.21.15.112:0/3449216212 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55685a051100 0x55685a07cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:13.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.667+0000 7ff9ba000640 1 --2- 172.21.15.112:0/3449216212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55685a039480 0x55685a07c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:13.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.667+0000 7ff9c2a00640 1 -- 172.21.15.112:0/3449216212 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55685a051100 msgr2=0x55685a07cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:13.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.667+0000 7ff9c2a00640 1 --2- 172.21.15.112:0/3449216212 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55685a051100 0x55685a07cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.667+0000 7ff9c2a00640 1 -- 172.21.15.112:0/3449216212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55685a039480 msgr2=0x55685a07c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:13.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.667+0000 7ff9c2a00640 1 --2- 172.21.15.112:0/3449216212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55685a039480 0x55685a07c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.667+0000 7ff9c2a00640 1 -- 172.21.15.112:0/3449216212 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556859f5de20 con 0x55685a037cf0 2024-09-12T02:44:13.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.667+0000 7ff9c3400640 1 --2- 172.21.15.112:0/3449216212 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55685a051100 0x55685a07cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:44:13.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.667+0000 7ff9ba000640 1 --2- 172.21.15.112:0/3449216212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55685a039480 0x55685a07c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:44:13.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.667+0000 7ff9c2a00640 1 --2- 172.21.15.112:0/3449216212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55685a037cf0 0x55685a07abd0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4007400 tx=0x7ff9b4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7333d9dcd57acf4c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:13.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.672+0000 7ff9b2a00640 1 -- 172.21.15.112:0/3449216212 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4001bf0 con 0x55685a037cf0 2024-09-12T02:44:13.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.672+0000 7ff9b2a00640 1 -- 172.21.15.112:0/3449216212 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b4013420 con 0x55685a037cf0 2024-09-12T02:44:13.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.672+0000 7ff9b2a00640 1 -- 172.21.15.112:0/3449216212 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b40135d0 con 0x55685a037cf0 2024-09-12T02:44:13.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.673+0000 7ff9ccc68740 1 -- 172.21.15.112:0/3449216212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55685a037cf0 msgr2=0x55685a07abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:13.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.673+0000 7ff9ccc68740 1 --2- 172.21.15.112:0/3449216212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55685a037cf0 0x55685a07abd0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4007400 tx=0x7ff9b4012000 comp rx=0 tx=0).stop 2024-09-12T02:44:13.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.673+0000 7ff9ccc68740 1 -- 172.21.15.112:0/3449216212 shutdown_connections 2024-09-12T02:44:13.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.673+0000 7ff9ccc68740 1 --2- 172.21.15.112:0/3449216212 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55685a051100 0x55685a07cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.673+0000 7ff9ccc68740 1 --2- 172.21.15.112:0/3449216212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55685a039480 0x55685a07c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.673+0000 7ff9ccc68740 1 --2- 172.21.15.112:0/3449216212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55685a037cf0 0x55685a07abd0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.673+0000 7ff9ccc68740 1 -- 172.21.15.112:0/3449216212 >> 172.21.15.112:0/3449216212 conn(0x55685a0354b0 msgr2=0x55685a0a0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:13.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.673+0000 7ff9ccc68740 1 -- 172.21.15.112:0/3449216212 shutdown_connections 2024-09-12T02:44:13.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.673+0000 7ff9ccc68740 1 -- 172.21.15.112:0/3449216212 wait complete. 2024-09-12T02:44:13.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.674+0000 7ff9ccc68740 1 -- start start 2024-09-12T02:44:13.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.674+0000 7ff9ccc68740 1 Processor -- start 2024-09-12T02:44:13.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.675+0000 7ff9ccc68740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55685a037cf0 0x55685a0e42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:13.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.675+0000 7ff9ccc68740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55685a039480 0x55685a057590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:13.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.675+0000 7ff9ccc68740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55685a051100 0x55685a05f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:13.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.675+0000 7ff9ccc68740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55685a058bb0 con 0x55685a051100 2024-09-12T02:44:13.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.675+0000 7ff9ccc68740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556859f56780 con 0x55685a037cf0 2024-09-12T02:44:13.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.675+0000 7ff9ccc68740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55685a05b670 con 0x55685a039480 2024-09-12T02:44:13.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.675+0000 7ff9ccc68740 10 client.0 _ll_register_callbacks cb 0x7ff9b4007d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:44:13.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.675+0000 7ff9c3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55685a051100 0x55685a05f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:13.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.675+0000 7ff9c3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55685a051100 0x55685a05f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50440/0 (socket says 172.21.15.112:50440) 2024-09-12T02:44:13.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.675+0000 7ff9c3400640 1 -- 172.21.15.112:0/4126982688 learned_addr learned my addr 172.21.15.112:0/4126982688 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:13.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.675+0000 7ff9ba000640 1 --2- 172.21.15.112:0/4126982688 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55685a039480 0x55685a057590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:13.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.675+0000 7ff9c2a00640 1 --2- 172.21.15.112:0/4126982688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55685a037cf0 0x55685a0e42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:13.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.675+0000 7ff9c3400640 1 -- 172.21.15.112:0/4126982688 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55685a039480 msgr2=0x55685a057590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:13.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.675+0000 7ff9c3400640 1 --2- 172.21.15.112:0/4126982688 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55685a039480 0x55685a057590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.675+0000 7ff9c3400640 1 -- 172.21.15.112:0/4126982688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55685a037cf0 msgr2=0x55685a0e42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:13.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.675+0000 7ff9c3400640 1 --2- 172.21.15.112:0/4126982688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55685a037cf0 0x55685a0e42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.675+0000 7ff9c3400640 1 -- 172.21.15.112:0/4126982688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55685a050670 con 0x55685a051100 2024-09-12T02:44:13.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.676+0000 7ff9c3400640 1 --2- 172.21.15.112:0/4126982688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55685a051100 0x55685a05f6d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc056430 tx=0x7ff9bc0562f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ed51d41b7cf3ba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:13.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.676+0000 7ff9a7e00640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-12T02:44:13.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.676+0000 7ff9a7e00640 1 -- 172.21.15.112:0/4126982688 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc024bb0 con 0x55685a051100 2024-09-12T02:44:13.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.676+0000 7ff9a7e00640 1 -- 172.21.15.112:0/4126982688 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 5709+0+0 (secure 0 0 0) 0x7ff9bc055f30 con 0x55685a051100 2024-09-12T02:44:13.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.676+0000 7ff9ccc68740 1 -- 172.21.15.112:0/4126982688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9b4013420 con 0x55685a051100 2024-09-12T02:44:13.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.677+0000 7ff9a7e00640 1 -- 172.21.15.112:0/4126982688 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7ff9bc083bb0 con 0x55685a051100 2024-09-12T02:44:13.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.677+0000 7ff9ccc68740 10 client.5643 fetch_fsmap learned FSMap version 36 2024-09-12T02:44:13.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.677+0000 7ff9ccc68740 1 -- 172.21.15.112:0/4126982688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x55685a050670 con 0x55685a051100 2024-09-12T02:44:13.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.677+0000 7ff9a7e00640 1 -- 172.21.15.112:0/4126982688 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b4013420 con 0x55685a051100 2024-09-12T02:44:13.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.677+0000 7ff9a7e00640 1 -- 172.21.15.112:0/4126982688 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 36) ==== 3502+0+0 (secure 0 0 0) 0x7ff9bc06c030 con 0x55685a051100 2024-09-12T02:44:13.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.677+0000 7ff9ccc68740 10 client.5643 fetch_fsmap finished waiting for FSMap version 36 2024-09-12T02:44:13.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.677+0000 7ff9ccc68740 10 client.5643 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T02:44:13.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.677+0000 7ff9ccc68740 20 client.5643 populate_metadata read hostname 'smithi112' 2024-09-12T02:44:13.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.677+0000 7ff9ccc68740 1 --2- 172.21.15.112:0/4126982688 >> [v2:172.21.15.112:6834/3039296510,v1:172.21.15.112:6835/3039296510] conn(0x55685a053ee0 0x55685a05c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:13.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.677+0000 7ff9ccc68740 4 client.5643 mds_command: new command op to 5508 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:44:13.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.677+0000 7ff9ccc68740 1 -- 172.21.15.112:0/4126982688 --> [v2:172.21.15.112:6834/3039296510,v1:172.21.15.112:6835/3039296510] -- command(tid 0: {"prefix": "status"}) -- 0x556859fa2e90 con 0x55685a053ee0 2024-09-12T02:44:13.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.677+0000 7ff9c2a00640 1 --2- 172.21.15.112:0/4126982688 >> [v2:172.21.15.112:6834/3039296510,v1:172.21.15.112:6835/3039296510] conn(0x55685a053ee0 0x55685a05c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:13.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.678+0000 7ff9a7e00640 10 client.5643 ms_handle_connect on v2:172.21.15.112:6834/3039296510 2024-09-12T02:44:13.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.678+0000 7ff9c2a00640 1 --2- 172.21.15.112:0/4126982688 >> [v2:172.21.15.112:6834/3039296510,v1:172.21.15.112:6835/3039296510] conn(0x55685a053ee0 0x55685a05c840 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3268b89628e2524 server_cookie=46ce07d96593e099 in_seq=0 out_seq=0 2024-09-12T02:44:13.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.678+0000 7ff9a7e00640 1 -- 172.21.15.112:0/4126982688 <== mds.0 v2:172.21.15.112:6834/3039296510 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x556859fa2e90 con 0x55685a053ee0 2024-09-12T02:44:13.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.678+0000 7ff9a7e00640 10 client.5643 handle_command_reply: tid=0 2024-09-12T02:44:13.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.678+0000 7ff9ccc68740 1 client.5643 shutdown 2024-09-12T02:44:13.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.678+0000 7ff9ccc68740 1 -- 172.21.15.112:0/4126982688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55685a051100 msgr2=0x55685a05f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:13.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.678+0000 7ff9ccc68740 1 --2- 172.21.15.112:0/4126982688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55685a051100 0x55685a05f6d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc056430 tx=0x7ff9bc0562f0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.678+0000 7ff9ccc68740 1 -- 172.21.15.112:0/4126982688 shutdown_connections 2024-09-12T02:44:13.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.678+0000 7ff9ccc68740 1 --2- 172.21.15.112:0/4126982688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55685a051100 0x55685a05f6d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.678+0000 7ff9ccc68740 1 --2- 172.21.15.112:0/4126982688 >> [v2:172.21.15.112:6834/3039296510,v1:172.21.15.112:6835/3039296510] conn(0x55685a053ee0 0x55685a05c840 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.678+0000 7ff9ccc68740 1 --2- 172.21.15.112:0/4126982688 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55685a039480 0x55685a057590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.678+0000 7ff9ccc68740 1 --2- 172.21.15.112:0/4126982688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55685a037cf0 0x55685a0e42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.678+0000 7ff9ccc68740 1 -- 172.21.15.112:0/4126982688 >> 172.21.15.112:0/4126982688 conn(0x55685a0354b0 msgr2=0x55685a0604f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:13.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.678+0000 7ff9a7e00640 0 client.5643 ms_handle_reset on v2:172.21.15.112:6834/3039296510 2024-09-12T02:44:13.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.678+0000 7ff9ccc68740 1 -- 172.21.15.112:0/4126982688 shutdown_connections 2024-09-12T02:44:13.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.678+0000 7ff9ccc68740 1 -- 172.21.15.112:0/4126982688 wait complete. 2024-09-12T02:44:13.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.679+0000 7ff9ccc68740 20 client.5643 trim_cache size 0 max 16384 2024-09-12T02:44:13.684 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:44:13.684 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:44:13.684 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2024-09-12T02:44:13.684 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 5508, 2024-09-12T02:44:13.685 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2024-09-12T02:44:13.685 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2024-09-12T02:44:13.685 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2024-09-12T02:44:13.685 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 6.0405949259999998, 2024-09-12T02:44:13.685 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 36, 2024-09-12T02:44:13.685 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 64, 2024-09-12T02:44:13.685 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 64, 2024-09-12T02:44:13.685 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 10.604250138999999 2024-09-12T02:44:13.685 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:44:13.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.679+0000 7ff9c9e00640 1 -- 172.21.15.112:0/617218764 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff9a006be30 msgr2=0x7ff9a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:13.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.679+0000 7ff9c9e00640 1 --2- 172.21.15.112:0/617218764 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff9a006be30 0x7ff9a006e2f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4000f60 tx=0x7ff9b4007c00 comp rx=0 tx=0).stop 2024-09-12T02:44:13.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.679+0000 7ff9c9e00640 1 -- 172.21.15.112:0/617218764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9c415cc50 msgr2=0x7ff9c40ae8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:13.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.679+0000 7ff9c9e00640 1 --2- 172.21.15.112:0/617218764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9c415cc50 0x7ff9c40ae8d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc00ef90 tx=0x7ff9bc00c490 comp rx=0 tx=0).stop 2024-09-12T02:44:13.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.679+0000 7ff9c9e00640 1 -- 172.21.15.112:0/617218764 shutdown_connections 2024-09-12T02:44:13.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.679+0000 7ff9c9e00640 1 --2- 172.21.15.112:0/617218764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9c415cc50 0x7ff9c40ae8d0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.679+0000 7ff9c9e00640 1 --2- 172.21.15.112:0/617218764 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff9a006be30 0x7ff9a006e2f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.679+0000 7ff9c9e00640 1 --2- 172.21.15.112:0/617218764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9c40719a0 0x7ff9c4150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.679+0000 7ff9c9e00640 1 --2- 172.21.15.112:0/617218764 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff9c4071530 0x7ff9c4160af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.679+0000 7ff9c9e00640 1 -- 172.21.15.112:0/617218764 >> 172.21.15.112:0/617218764 conn(0x7ff9c406bbd0 msgr2=0x7ff9c4159950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:13.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.679+0000 7ff9c9e00640 1 -- 172.21.15.112:0/617218764 shutdown_connections 2024-09-12T02:44:13.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.679+0000 7ff9c9e00640 1 -- 172.21.15.112:0/617218764 wait complete. 2024-09-12T02:44:13.695 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:44:13.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.846+0000 7fdcb9800640 1 Processor -- start 2024-09-12T02:44:13.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.846+0000 7fdcb9800640 1 -- start start 2024-09-12T02:44:13.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.848+0000 7fdcb9800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdcb415b9d0 0x7fdcb40b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:13.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.848+0000 7fdcb9800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcb406f600 0x7fdcb40728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:13.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.848+0000 7fdcb9800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcb40b54a0 con 0x7fdcb40b45d0 2024-09-12T02:44:13.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.848+0000 7fdcb9800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fdcb40b4a60 con 0x7fdcb415b9d0 2024-09-12T02:44:13.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.848+0000 7fdcb9800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdcb40b3af0 con 0x7fdcb406f600 2024-09-12T02:44:13.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.848+0000 7fdcaa000640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fdcb40b45d0 0x7fdcb406eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:56480/0 (socket says 172.21.15.112:56480) 2024-09-12T02:44:13.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.848+0000 7fdcaa000640 1 -- 172.21.15.112:0/812971997 learned_addr learned my addr 172.21.15.112:0/812971997 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:44:13.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.848+0000 7fdcb2a00640 1 --2- 172.21.15.112:0/812971997 >> v2:172.21.15.112:3300/0 conn(0x7fdcb415b9d0 0x7fdcb40b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:13.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.848+0000 7fdcb3400640 1 --2- 172.21.15.112:0/812971997 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcb406f600 0x7fdcb40728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:13.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.848+0000 7fdcb2a00640 1 -- 172.21.15.112:0/812971997 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcb406f600 msgr2=0x7fdcb40728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:13.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.848+0000 7fdcb2a00640 1 --2- 172.21.15.112:0/812971997 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcb406f600 0x7fdcb40728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.848+0000 7fdcb2a00640 1 -- 172.21.15.112:0/812971997 >> v1:172.21.15.112:6789/0 conn(0x7fdcb40b45d0 legacy=0x7fdcb406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:13.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.848+0000 7fdcb2000640 1 -- 172.21.15.112:0/812971997 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2166697543 0 0) 0x7fdcb40b54a0 con 0x7fdcb40b45d0 2024-09-12T02:44:13.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.848+0000 7fdcb2a00640 1 -- 172.21.15.112:0/812971997 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcb40b3dd0 con 0x7fdcb415b9d0 2024-09-12T02:44:13.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.848+0000 7fdcb3400640 1 --2- 172.21.15.112:0/812971997 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcb406f600 0x7fdcb40728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:44:13.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.849+0000 7fdcb2a00640 1 --2- 172.21.15.112:0/812971997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcb415b9d0 0x7fdcb40b4ec0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fdca40097a0 tx=0x7fdca402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55e9c9caf7d89467 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:13.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.850+0000 7fdcb2000640 1 -- 172.21.15.112:0/812971997 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca4037070 con 0x7fdcb415b9d0 2024-09-12T02:44:13.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.850+0000 7fdcb2000640 1 -- 172.21.15.112:0/812971997 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdca4032440 con 0x7fdcb415b9d0 2024-09-12T02:44:13.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.850+0000 7fdcb2000640 1 -- 172.21.15.112:0/812971997 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca4032810 con 0x7fdcb415b9d0 2024-09-12T02:44:13.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.850+0000 7fdcb9800640 1 -- 172.21.15.112:0/812971997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcb415b9d0 msgr2=0x7fdcb40b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:13.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.850+0000 7fdcb9800640 1 --2- 172.21.15.112:0/812971997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcb415b9d0 0x7fdcb40b4ec0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fdca40097a0 tx=0x7fdca402a180 comp rx=0 tx=0).stop 2024-09-12T02:44:13.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.850+0000 7fdcb9800640 1 -- 172.21.15.112:0/812971997 shutdown_connections 2024-09-12T02:44:13.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.850+0000 7fdcb9800640 1 --2- 172.21.15.112:0/812971997 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcb406f600 0x7fdcb40728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.850+0000 7fdcb9800640 1 --2- 172.21.15.112:0/812971997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcb415b9d0 0x7fdcb40b4ec0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.850+0000 7fdcb9800640 1 -- 172.21.15.112:0/812971997 >> 172.21.15.112:0/812971997 conn(0x7fdcb406bbd0 msgr2=0x7fdcb406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:13.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.850+0000 7fdcb9800640 1 -- 172.21.15.112:0/812971997 shutdown_connections 2024-09-12T02:44:13.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.850+0000 7fdcb9800640 1 -- 172.21.15.112:0/812971997 wait complete. 2024-09-12T02:44:13.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.852+0000 7fdcb9800640 1 Processor -- start 2024-09-12T02:44:13.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.852+0000 7fdcb9800640 1 -- start start 2024-09-12T02:44:13.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.853+0000 7fdcb9800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcb406f600 0x7fdcb414f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:13.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.853+0000 7fdcb9800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcb40b45d0 0x7fdcb4155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:13.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.853+0000 7fdcb9800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcb415b9d0 0x7fdcb41f1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:13.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.853+0000 7fdcb9800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb415bf30 con 0x7fdcb40b45d0 2024-09-12T02:44:13.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.853+0000 7fdcb9800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb415bdb0 con 0x7fdcb406f600 2024-09-12T02:44:13.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.853+0000 7fdcb9800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdcb40cdcd0 con 0x7fdcb415b9d0 2024-09-12T02:44:13.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.853+0000 7fdcaa000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcb40b45d0 0x7fdcb4155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:13.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.853+0000 7fdcaa000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcb40b45d0 0x7fdcb4155dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50466/0 (socket says 172.21.15.112:50466) 2024-09-12T02:44:13.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.853+0000 7fdcaa000640 1 -- 172.21.15.112:0/2470143233 learned_addr learned my addr 172.21.15.112:0/2470143233 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:13.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.853+0000 7fdcb3400640 1 --2- 172.21.15.112:0/2470143233 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcb415b9d0 0x7fdcb41f1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:13.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.853+0000 7fdcb2a00640 1 --2- 172.21.15.112:0/2470143233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcb406f600 0x7fdcb414f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:13.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.853+0000 7fdcaa000640 1 -- 172.21.15.112:0/2470143233 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcb415b9d0 msgr2=0x7fdcb41f1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:13.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.853+0000 7fdcaa000640 1 --2- 172.21.15.112:0/2470143233 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcb415b9d0 0x7fdcb41f1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.853+0000 7fdcaa000640 1 -- 172.21.15.112:0/2470143233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcb406f600 msgr2=0x7fdcb414f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:13.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.853+0000 7fdcaa000640 1 --2- 172.21.15.112:0/2470143233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcb406f600 0x7fdcb414f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.854+0000 7fdcaa000640 1 -- 172.21.15.112:0/2470143233 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcb41f1a00 con 0x7fdcb40b45d0 2024-09-12T02:44:13.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.854+0000 7fdcaa000640 1 --2- 172.21.15.112:0/2470143233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcb40b45d0 0x7fdcb4155dc0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c00c4d0 tx=0x7fdc9c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:13.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.854+0000 7fdcab400640 1 -- 172.21.15.112:0/2470143233 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c007480 con 0x7fdcb40b45d0 2024-09-12T02:44:13.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.854+0000 7fdcab400640 1 -- 172.21.15.112:0/2470143233 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc9c0057a0 con 0x7fdcb40b45d0 2024-09-12T02:44:13.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.854+0000 7fdcb9800640 1 -- 172.21.15.112:0/2470143233 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcb41f1ce0 con 0x7fdcb40b45d0 2024-09-12T02:44:13.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.854+0000 7fdcab400640 1 -- 172.21.15.112:0/2470143233 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c007620 con 0x7fdcb40b45d0 2024-09-12T02:44:13.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.854+0000 7fdcb9800640 1 -- 172.21.15.112:0/2470143233 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcb4156300 con 0x7fdcb40b45d0 2024-09-12T02:44:13.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.855+0000 7fdcb9800640 1 -- 172.21.15.112:0/2470143233 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcb4068a30 con 0x7fdcb40b45d0 2024-09-12T02:44:13.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.856+0000 7fdcab400640 1 -- 172.21.15.112:0/2470143233 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdc9c005b50 con 0x7fdcb40b45d0 2024-09-12T02:44:13.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.857+0000 7fdcab400640 1 --2- 172.21.15.112:0/2470143233 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdc9006be30 0x7fdc9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:13.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.857+0000 7fdcab400640 1 -- 172.21.15.112:0/2470143233 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5709+0+0 (secure 0 0 0) 0x7fdc9c08aa10 con 0x7fdcb40b45d0 2024-09-12T02:44:13.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.857+0000 7fdcb2a00640 1 --2- 172.21.15.112:0/2470143233 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdc9006be30 0x7fdc9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:13.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.858+0000 7fdcb2a00640 1 --2- 172.21.15.112:0/2470143233 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdc9006be30 0x7fdc9006e2f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdca4034000 tx=0x7fdca402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:13.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:13.861+0000 7fdcab400640 1 -- 172.21.15.112:0/2470143233 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc9c0593b0 con 0x7fdcb40b45d0 2024-09-12T02:44:14.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:14.072+0000 7fdcb9800640 1 -- 172.21.15.112:0/2470143233 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fdcb406ed40 con 0x7fdcb40b45d0 2024-09-12T02:44:14.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:14.072+0000 7fdcab400640 1 -- 172.21.15.112:0/2470143233 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) ==== 53+0+73 (secure 0 0 0) 0x7fdc9c058cb0 con 0x7fdcb40b45d0 2024-09-12T02:44:14.073 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:44:14.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:14.074+0000 7fdcb9800640 1 -- 172.21.15.112:0/2470143233 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdc9006be30 msgr2=0x7fdc9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:14.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:14.074+0000 7fdcb9800640 1 --2- 172.21.15.112:0/2470143233 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdc9006be30 0x7fdc9006e2f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdca4034000 tx=0x7fdca402e000 comp rx=0 tx=0).stop 2024-09-12T02:44:14.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:14.074+0000 7fdcb9800640 1 -- 172.21.15.112:0/2470143233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcb40b45d0 msgr2=0x7fdcb4155dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:14.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:14.074+0000 7fdcb9800640 1 --2- 172.21.15.112:0/2470143233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcb40b45d0 0x7fdcb4155dc0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c00c4d0 tx=0x7fdc9c00c990 comp rx=0 tx=0).stop 2024-09-12T02:44:14.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:14.074+0000 7fdcb9800640 1 -- 172.21.15.112:0/2470143233 shutdown_connections 2024-09-12T02:44:14.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:14.074+0000 7fdcb9800640 1 --2- 172.21.15.112:0/2470143233 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcb415b9d0 0x7fdcb41f1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:14.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:14.074+0000 7fdcb9800640 1 --2- 172.21.15.112:0/2470143233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcb40b45d0 0x7fdcb4155dc0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:14.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:14.074+0000 7fdcb9800640 1 --2- 172.21.15.112:0/2470143233 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdc9006be30 0x7fdc9006e2f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:14.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:14.074+0000 7fdcb9800640 1 --2- 172.21.15.112:0/2470143233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcb406f600 0x7fdcb414f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:14.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:14.074+0000 7fdcb9800640 1 -- 172.21.15.112:0/2470143233 >> 172.21.15.112:0/2470143233 conn(0x7fdcb406bbd0 msgr2=0x7fdcb40d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:14.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:14.074+0000 7fdcb9800640 1 -- 172.21.15.112:0/2470143233 shutdown_connections 2024-09-12T02:44:14.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:14.074+0000 7fdcb9800640 1 -- 172.21.15.112:0/2470143233 wait complete. 2024-09-12T02:44:14.091 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:44:14.092 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:44:14.092 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-09-12T02:44:14.092 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:44:14.092 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:44:14.092 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:44:14.092 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:44:14.092 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:44:14.092 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:44:14.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:44:14.093 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-09-12T02:44:14.130 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:44:14.130 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:44:14.130 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:44:14.130 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:44:14.130 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-12T02:44:14.130 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:44:14.131 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:44:14.131 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-09-12T02:44:14.131 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-09-12T02:44:14.131 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:44:14.131 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-09-12T02:44:14.131 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-09-12T02:44:14.131 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:44:14.131 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:44:14.131 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:44:14.131 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:44:14.131 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:44:14.131 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42624sec preferred_lft 42624sec 2024-09-12T02:44:14.131 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link noprefixroute 2024-09-12T02:44:14.132 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:44:14.132 INFO:teuthology.orchestra.run.smithi112.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:44:14.132 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 4e:56:d4:fc:33:ba brd ff:ff:ff:ff:ff:ff 2024-09-12T02:44:14.132 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:44:14.132 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:44:14.132 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::787f:67ff:fe10:c915/64 scope link 2024-09-12T02:44:14.132 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:44:14.132 INFO:teuthology.orchestra.run.smithi112.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:44:14.132 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 4e:56:d4:fc:33:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:44:14.132 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::4c56:d4ff:fefc:33ba/64 scope link 2024-09-12T02:44:14.132 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:44:14.132 INFO:teuthology.orchestra.run.smithi112.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:44:14.132 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 86:ed:0e:b6:37:5f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:44:14.132 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::84ed:eff:feb6:375f/64 scope link 2024-09-12T02:44:14.133 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:44:14.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:44:14.133 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:44:14.223 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-12T02:44:14.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:44:14.226 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-09-12T02:44:14.262 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-09-12T02:44:14.262 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:44:14.262 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:44:14.263 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:44:14.263 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:44:14.263 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:44:14.263 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-12T02:44:14.263 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:44:14.263 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:44:14.263 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:44:14.263 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-12T02:44:14.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:44:14.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:44:14.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:44:14.457 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-12T02:44:14.493 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:44:14.493 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:44:14.493 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:44:14.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:44:14.493 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2024-09-12T02:44:14.589 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:44:14.590 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:44:14.630 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:44:14.631 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:44:14.631 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:44:14.706 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T02:44:14.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:44:14.706 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:44:14.835 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:44:14.835 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:44:14.862 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:44:14.863 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:44:14.863 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-09-12T02:44:14.863 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 0@7c01f3b3-dec2-4449-a33f-f960d7527ea6.cephfs=/ 2024-09-12T02:44:14.863 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.112:3300/172.21.15.137:3300/172.21.15.137:3301" will pass to kernel 2024-09-12T02:44:14.864 INFO:teuthology.orchestra.run.smithi112.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:44:14.864 INFO:teuthology.orchestra.run.smithi112.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:44:14.864 INFO:teuthology.orchestra.run.smithi112.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:44:14.864 INFO:teuthology.orchestra.run.smithi112.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:44:14.864 INFO:teuthology.orchestra.run.smithi112.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:44:14.867 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:44:14.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:44:14.867 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:44:14.922 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:44:15.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:44:15.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:44:15.017 INFO:teuthology.orchestra.run.smithi112.stdout:client5081 2024-09-12T02:44:15.017 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:44:15.017 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:44:15.053 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:44:15.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.245+0000 7f73c3e00640 1 Processor -- start 2024-09-12T02:44:15.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.245+0000 7f73c3e00640 1 -- start start 2024-09-12T02:44:15.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.246+0000 7f73c3e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f73c40d1710 0x7f73c40d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:15.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.246+0000 7f73c3e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f73c40b1d70 0x7f73c40b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:15.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.246+0000 7f73c3e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73c40d2fb0 con 0x7f73c40b3e00 2024-09-12T02:44:15.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.246+0000 7f73c3e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f73c40d3cb0 con 0x7f73c40b1d70 2024-09-12T02:44:15.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.246+0000 7f73c3e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f73c40d0b60 con 0x7f73c40d1710 2024-09-12T02:44:15.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.246+0000 7f73c2000640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f73c40b3e00 0x7f73c40d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:56482/0 (socket says 172.21.15.112:56482) 2024-09-12T02:44:15.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.246+0000 7f73c2000640 1 -- 172.21.15.112:0/4265903424 learned_addr learned my addr 172.21.15.112:0/4265903424 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:44:15.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.246+0000 7f73c3400640 1 --2- 172.21.15.112:0/4265903424 >> v2:172.21.15.112:3300/0 conn(0x7f73c40b1d70 0x7f73c40b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:15.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.247+0000 7f73c2a00640 1 --2- 172.21.15.112:0/4265903424 >> v2:172.21.15.137:3300/0 conn(0x7f73c40d1710 0x7f73c40d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:15.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.247+0000 7f73c3400640 1 -- 172.21.15.112:0/4265903424 >> v2:172.21.15.137:3300/0 conn(0x7f73c40d1710 msgr2=0x7f73c40d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:15.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.247+0000 7f73c3400640 1 --2- 172.21.15.112:0/4265903424 >> v2:172.21.15.137:3300/0 conn(0x7f73c40d1710 0x7f73c40d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:15.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.247+0000 7f73c3400640 1 -- 172.21.15.112:0/4265903424 >> v1:172.21.15.112:6789/0 conn(0x7f73c40b3e00 legacy=0x7f73c40d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:15.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.247+0000 7f73c3400640 1 -- 172.21.15.112:0/4265903424 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c40d3410 con 0x7f73c40b1d70 2024-09-12T02:44:15.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.248+0000 7f73c3400640 1 --2- 172.21.15.112:0/4265903424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c40b1d70 0x7f73c40b2200 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f73c408dd50 tx=0x7f73bc02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a8211849892376b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:15.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.248+0000 7f73c1600640 1 -- 172.21.15.112:0/4265903424 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73bc007740 con 0x7f73c40b1d70 2024-09-12T02:44:15.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.248+0000 7f73c1600640 1 -- 172.21.15.112:0/4265903424 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73bc0078e0 con 0x7f73c40b1d70 2024-09-12T02:44:15.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.248+0000 7f73c1600640 1 -- 172.21.15.112:0/4265903424 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73bc007cb0 con 0x7f73c40b1d70 2024-09-12T02:44:15.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.249+0000 7f73c3e00640 1 -- 172.21.15.112:0/4265903424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c40b1d70 msgr2=0x7f73c40b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:15.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.249+0000 7f73c3e00640 1 --2- 172.21.15.112:0/4265903424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c40b1d70 0x7f73c40b2200 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f73c408dd50 tx=0x7f73bc02a680 comp rx=0 tx=0).stop 2024-09-12T02:44:15.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.249+0000 7f73c3e00640 1 -- 172.21.15.112:0/4265903424 shutdown_connections 2024-09-12T02:44:15.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.249+0000 7f73c3e00640 1 --2- 172.21.15.112:0/4265903424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c40b1d70 0x7f73c40b2200 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:15.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.249+0000 7f73c3e00640 1 --2- 172.21.15.112:0/4265903424 >> v2:172.21.15.137:3300/0 conn(0x7f73c40d1710 0x7f73c40d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:15.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.249+0000 7f73c3e00640 1 -- 172.21.15.112:0/4265903424 >> 172.21.15.112:0/4265903424 conn(0x7f73c409e030 msgr2=0x7f73c40d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:15.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.249+0000 7f73c3e00640 1 -- 172.21.15.112:0/4265903424 shutdown_connections 2024-09-12T02:44:15.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.249+0000 7f73c3e00640 1 -- 172.21.15.112:0/4265903424 wait complete. 2024-09-12T02:44:15.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.250+0000 7f73c3e00640 1 Processor -- start 2024-09-12T02:44:15.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.250+0000 7f73c3e00640 1 -- start start 2024-09-12T02:44:15.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.251+0000 7f73c3e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73c40b1d70 0x7f73c41f50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:15.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.251+0000 7f73c3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c40b3e00 0x7f73c40b8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:15.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.251+0000 7f73c3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73c40d1710 0x7f73c40b4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:15.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.251+0000 7f73c3e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f73c415f110 con 0x7f73c40b3e00 2024-09-12T02:44:15.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.251+0000 7f73c3e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f73c40d39d0 con 0x7f73c40d1710 2024-09-12T02:44:15.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.251+0000 7f73c3e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f73c415f290 con 0x7f73c40b1d70 2024-09-12T02:44:15.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.252+0000 7f73c2000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c40b3e00 0x7f73c40b8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:15.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.252+0000 7f73c2000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c40b3e00 0x7f73c40b8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50496/0 (socket says 172.21.15.112:50496) 2024-09-12T02:44:15.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.252+0000 7f73c2000640 1 -- 172.21.15.112:0/165681756 learned_addr learned my addr 172.21.15.112:0/165681756 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:15.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.252+0000 7f73c3400640 1 --2- 172.21.15.112:0/165681756 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73c40d1710 0x7f73c40b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:15.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.252+0000 7f73c2a00640 1 --2- 172.21.15.112:0/165681756 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73c40b1d70 0x7f73c41f50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:15.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.252+0000 7f73c2000640 1 -- 172.21.15.112:0/165681756 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73c40b1d70 msgr2=0x7f73c41f50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:15.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.252+0000 7f73c2000640 1 --2- 172.21.15.112:0/165681756 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73c40b1d70 0x7f73c41f50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:15.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.252+0000 7f73c2000640 1 -- 172.21.15.112:0/165681756 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73c40d1710 msgr2=0x7f73c40b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:15.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.252+0000 7f73c2000640 1 --2- 172.21.15.112:0/165681756 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73c40d1710 0x7f73c40b4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:15.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.252+0000 7f73c2000640 1 -- 172.21.15.112:0/165681756 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c40b9850 con 0x7f73c40b3e00 2024-09-12T02:44:15.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.252+0000 7f73c3400640 1 --2- 172.21.15.112:0/165681756 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73c40d1710 0x7f73c40b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:44:15.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.252+0000 7f73c2000640 1 --2- 172.21.15.112:0/165681756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c40b3e00 0x7f73c40b8f50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f73b000c400 tx=0x7f73b000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:15.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.252+0000 7f73baa00640 1 -- 172.21.15.112:0/165681756 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b0017070 con 0x7f73c40b3e00 2024-09-12T02:44:15.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.252+0000 7f73baa00640 1 -- 172.21.15.112:0/165681756 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73b0005ce0 con 0x7f73c40b3e00 2024-09-12T02:44:15.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.252+0000 7f73c3e00640 1 -- 172.21.15.112:0/165681756 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73c40b9b30 con 0x7f73c40b3e00 2024-09-12T02:44:15.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.253+0000 7f73baa00640 1 -- 172.21.15.112:0/165681756 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b00072f0 con 0x7f73c40b3e00 2024-09-12T02:44:15.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.253+0000 7f73c3e00640 1 -- 172.21.15.112:0/165681756 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73c40ba0f0 con 0x7f73c40b3e00 2024-09-12T02:44:15.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.254+0000 7f73c3e00640 1 -- 172.21.15.112:0/165681756 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73c40d28d0 con 0x7f73c40b3e00 2024-09-12T02:44:15.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.255+0000 7f73baa00640 1 -- 172.21.15.112:0/165681756 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f73b001a070 con 0x7f73c40b3e00 2024-09-12T02:44:15.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.255+0000 7f73baa00640 1 --2- 172.21.15.112:0/165681756 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f73a406be30 0x7f73a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:15.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.255+0000 7f73baa00640 1 -- 172.21.15.112:0/165681756 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5709+0+0 (secure 0 0 0) 0x7f73b008a330 con 0x7f73c40b3e00 2024-09-12T02:44:15.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.256+0000 7f73c2a00640 1 --2- 172.21.15.112:0/165681756 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f73a406be30 0x7f73a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:15.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.256+0000 7f73c2a00640 1 --2- 172.21.15.112:0/165681756 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f73a406be30 0x7f73a406e2f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f73b4006fd0 tx=0x7f73b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:15.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.260+0000 7f73baa00640 1 -- 172.21.15.112:0/165681756 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f73b0058c40 con 0x7f73c40b3e00 2024-09-12T02:44:15.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.463+0000 7f73c3e00640 1 -- 172.21.15.112:0/165681756 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f73c4068440 con 0x7f73c40b3e00 2024-09-12T02:44:15.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.464+0000 7f73baa00640 1 -- 172.21.15.112:0/165681756 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) ==== 53+0+73 (secure 0 0 0) 0x7f73b0058540 con 0x7f73c40b3e00 2024-09-12T02:44:15.465 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:44:15.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.466+0000 7f73c3e00640 1 -- 172.21.15.112:0/165681756 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f73a406be30 msgr2=0x7f73a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:15.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.466+0000 7f73c3e00640 1 --2- 172.21.15.112:0/165681756 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f73a406be30 0x7f73a406e2f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f73b4006fd0 tx=0x7f73b4008040 comp rx=0 tx=0).stop 2024-09-12T02:44:15.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.466+0000 7f73c3e00640 1 -- 172.21.15.112:0/165681756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c40b3e00 msgr2=0x7f73c40b8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:15.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.466+0000 7f73c3e00640 1 --2- 172.21.15.112:0/165681756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c40b3e00 0x7f73c40b8f50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f73b000c400 tx=0x7f73b000c8c0 comp rx=0 tx=0).stop 2024-09-12T02:44:15.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.466+0000 7f73c3e00640 1 -- 172.21.15.112:0/165681756 shutdown_connections 2024-09-12T02:44:15.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.466+0000 7f73c3e00640 1 --2- 172.21.15.112:0/165681756 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f73a406be30 0x7f73a406e2f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:15.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.466+0000 7f73c3e00640 1 --2- 172.21.15.112:0/165681756 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73c40d1710 0x7f73c40b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:15.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.466+0000 7f73c3e00640 1 --2- 172.21.15.112:0/165681756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c40b3e00 0x7f73c40b8f50 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:15.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.466+0000 7f73c3e00640 1 --2- 172.21.15.112:0/165681756 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73c40b1d70 0x7f73c41f50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:15.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.466+0000 7f73c3e00640 1 -- 172.21.15.112:0/165681756 >> 172.21.15.112:0/165681756 conn(0x7f73c409e030 msgr2=0x7f73c40b2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:15.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.466+0000 7f73c3e00640 1 -- 172.21.15.112:0/165681756 shutdown_connections 2024-09-12T02:44:15.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:15.466+0000 7f73c3e00640 1 -- 172.21.15.112:0/165681756 wait complete. 2024-09-12T02:44:15.483 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:44:15.483 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:44:15.483 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-09-12T02:44:15.483 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T02:44:15.483 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T02:44:15.483 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:44:15.483 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:44:15.483 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:44:15.483 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:44:15.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:44:15.484 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-09-12T02:44:15.524 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:44:15.524 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:44:15.524 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:44:15.525 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:44:15.525 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-09-12T02:44:15.525 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:44:15.525 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:44:15.525 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-09-12T02:44:15.525 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-09-12T02:44:15.525 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:44:15.525 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-09-12T02:44:15.525 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-09-12T02:44:15.525 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:44:15.525 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:44:15.525 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:44:15.526 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:44:15.526 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:44:15.526 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42623sec preferred_lft 42623sec 2024-09-12T02:44:15.526 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::ec4:7aff:fe88:8137/64 scope link noprefixroute 2024-09-12T02:44:15.526 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:44:15.526 INFO:teuthology.orchestra.run.smithi137.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:44:15.526 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 62:9a:8e:f1:56:55 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:44:15.526 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:44:15.526 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:44:15.526 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::30c8:13ff:fe15:f79d/64 scope link 2024-09-12T02:44:15.526 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:44:15.526 INFO:teuthology.orchestra.run.smithi137.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:44:15.526 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 62:9a:8e:f1:56:55 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:44:15.527 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::609a:8eff:fef1:5655/64 scope link 2024-09-12T02:44:15.527 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:44:15.527 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:44:15.527 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 96:f4:ca:17:88:2a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T02:44:15.527 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::94f4:caff:fe17:882a/64 scope link 2024-09-12T02:44:15.527 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:44:15.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:44:15.527 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:44:15.622 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-09-12T02:44:15.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:44:15.625 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-09-12T02:44:15.664 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-09-12T02:44:15.665 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:44:15.665 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:44:15.665 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:44:15.665 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:44:15.665 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:44:15.665 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-09-12T02:44:15.665 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:44:15.665 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:44:15.665 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:44:15.666 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-09-12T02:44:15.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:44:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:44:15.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:44:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:44:15.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:44:15.862 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-09-12T02:44:15.897 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T02:44:15.898 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T02:44:15.898 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:44:15.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:44:15.898 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-09-12T02:44:15.993 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:44:15.993 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T02:44:16.028 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:44:16.029 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:44:16.029 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T02:44:16.103 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-12T02:44:16.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:44:16.103 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:44:16.232 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:44:16.233 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:44:16.262 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:44:16.262 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:44:16.262 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-09-12T02:44:16.262 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with new device syntax: 1@7c01f3b3-dec2-4449-a33f-f960d7527ea6.cephfs=/ 2024-09-12T02:44:16.262 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.112:3300/172.21.15.137:3300/172.21.15.137:3301" will pass to kernel 2024-09-12T02:44:16.264 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-12T02:44:16.265 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:44:16.265 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:44:16.265 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:44:16.265 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:44:16.268 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:44:16.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:44:16.268 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T02:44:16.323 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:44:16.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:44:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:44:16.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:44:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:44:16.414 INFO:teuthology.orchestra.run.smithi137.stdout:client5664 2024-09-12T02:44:16.414 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:44:16.414 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:44:16.450 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:44:16.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.604+0000 7f10fa400640 1 Processor -- start 2024-09-12T02:44:16.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.604+0000 7f10fa400640 1 -- start start 2024-09-12T02:44:16.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.605+0000 7f10fa400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f10f415cc50 0x7f10f40732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:16.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.605+0000 7f10fa400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f10f40afe30 0x7f10f40cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:16.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.605+0000 7f10fa400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10f4073830 con 0x7f10f4071530 2024-09-12T02:44:16.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.605+0000 7f10fa400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f10f415d030 con 0x7f10f415cc50 2024-09-12T02:44:16.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.605+0000 7f10fa400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f10f40cf4c0 con 0x7f10f40afe30 2024-09-12T02:44:16.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.605+0000 7f10f3400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f10f415cc50 0x7f10f40732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:16.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.606+0000 7f10f3400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f10f415cc50 0x7f10f40732f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50506/0 (socket says 172.21.15.112:50506) 2024-09-12T02:44:16.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.606+0000 7f10f3400640 1 -- 172.21.15.112:0/723900691 learned_addr learned my addr 172.21.15.112:0/723900691 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:16.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.606+0000 7f10f3e00640 1 --2- 172.21.15.112:0/723900691 >> v2:172.21.15.137:3300/0 conn(0x7f10f40afe30 0x7f10f40cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:16.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.606+0000 7f10f3400640 1 -- 172.21.15.112:0/723900691 >> v2:172.21.15.137:3300/0 conn(0x7f10f40afe30 msgr2=0x7f10f40cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:44:16.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.606+0000 7f10f3400640 1 --2- 172.21.15.112:0/723900691 >> v2:172.21.15.137:3300/0 conn(0x7f10f40afe30 0x7f10f40cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:16.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.606+0000 7f10f3400640 1 -- 172.21.15.112:0/723900691 >> v1:172.21.15.137:6789/0 conn(0x7f10f4071530 legacy=0x7f10f40af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:16.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.606+0000 7f10f3400640 1 -- 172.21.15.112:0/723900691 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f40ceeb0 con 0x7f10f415cc50 2024-09-12T02:44:16.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.607+0000 7f10f3400640 1 --2- 172.21.15.112:0/723900691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10f415cc50 0x7f10f40732f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f10f406ffd0 tx=0x7f10e402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee36881ac37d173 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:16.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.607+0000 7f10f2a00640 1 -- 172.21.15.112:0/723900691 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e4037070 con 0x7f10f415cc50 2024-09-12T02:44:16.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.607+0000 7f10f2a00640 1 -- 172.21.15.112:0/723900691 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10e4032440 con 0x7f10f415cc50 2024-09-12T02:44:16.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.607+0000 7f10f2a00640 1 -- 172.21.15.112:0/723900691 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e4032810 con 0x7f10f415cc50 2024-09-12T02:44:16.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.608+0000 7f10fa400640 1 -- 172.21.15.112:0/723900691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10f415cc50 msgr2=0x7f10f40732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:16.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.608+0000 7f10fa400640 1 --2- 172.21.15.112:0/723900691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10f415cc50 0x7f10f40732f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f10f406ffd0 tx=0x7f10e402a1e0 comp rx=0 tx=0).stop 2024-09-12T02:44:16.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.608+0000 7f10fa400640 1 -- 172.21.15.112:0/723900691 shutdown_connections 2024-09-12T02:44:16.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.608+0000 7f10fa400640 1 --2- 172.21.15.112:0/723900691 >> v2:172.21.15.137:3300/0 conn(0x7f10f40afe30 0x7f10f40cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:16.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.608+0000 7f10fa400640 1 --2- 172.21.15.112:0/723900691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10f415cc50 0x7f10f40732f0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:16.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.608+0000 7f10fa400640 1 -- 172.21.15.112:0/723900691 >> 172.21.15.112:0/723900691 conn(0x7f10f406bbd0 msgr2=0x7f10f406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:16.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.608+0000 7f10fa400640 1 -- 172.21.15.112:0/723900691 shutdown_connections 2024-09-12T02:44:16.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.608+0000 7f10fa400640 1 -- 172.21.15.112:0/723900691 wait complete. 2024-09-12T02:44:16.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.609+0000 7f10fa400640 1 Processor -- start 2024-09-12T02:44:16.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.610+0000 7f10fa400640 1 -- start start 2024-09-12T02:44:16.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.610+0000 7f10fa400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10f4071530 0x7f10f41f35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:16.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.610+0000 7f10fa400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10f40afe30 0x7f10f4153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:16.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.610+0000 7f10fa400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10f415cc50 0x7f10f414c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:16.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.610+0000 7f10fa400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f10f40cf150 con 0x7f10f4071530 2024-09-12T02:44:16.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.610+0000 7f10fa400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f10f406e5e0 con 0x7f10f415cc50 2024-09-12T02:44:16.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.610+0000 7f10fa400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f10f406f510 con 0x7f10f40afe30 2024-09-12T02:44:16.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.611+0000 7f10f3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10f4071530 0x7f10f41f35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:16.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.611+0000 7f10f3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10f4071530 0x7f10f41f35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50508/0 (socket says 172.21.15.112:50508) 2024-09-12T02:44:16.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.611+0000 7f10f3400640 1 -- 172.21.15.112:0/80300869 learned_addr learned my addr 172.21.15.112:0/80300869 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:44:16.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.611+0000 7f10f3e00640 1 --2- 172.21.15.112:0/80300869 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10f415cc50 0x7f10f414c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:16.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.611+0000 7f10ebe00640 1 --2- 172.21.15.112:0/80300869 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10f40afe30 0x7f10f4153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:16.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.611+0000 7f10f3400640 1 -- 172.21.15.112:0/80300869 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10f40afe30 msgr2=0x7f10f4153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:16.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.611+0000 7f10f3400640 1 --2- 172.21.15.112:0/80300869 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10f40afe30 0x7f10f4153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:16.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.611+0000 7f10f3400640 1 -- 172.21.15.112:0/80300869 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10f415cc50 msgr2=0x7f10f414c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:16.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.611+0000 7f10f3400640 1 --2- 172.21.15.112:0/80300869 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10f415cc50 0x7f10f414c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:16.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.611+0000 7f10f3400640 1 -- 172.21.15.112:0/80300869 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f41f4570 con 0x7f10f4071530 2024-09-12T02:44:16.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.611+0000 7f10ebe00640 1 --2- 172.21.15.112:0/80300869 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10f40afe30 0x7f10f4153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:44:16.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.611+0000 7f10f3400640 1 --2- 172.21.15.112:0/80300869 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10f4071530 0x7f10f41f35f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f10e402a220 tx=0x7f10e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:16.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.612+0000 7f10eb400640 1 -- 172.21.15.112:0/80300869 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e4037040 con 0x7f10f4071530 2024-09-12T02:44:16.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.612+0000 7f10eb400640 1 -- 172.21.15.112:0/80300869 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10e4042070 con 0x7f10f4071530 2024-09-12T02:44:16.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.612+0000 7f10eb400640 1 -- 172.21.15.112:0/80300869 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e4030880 con 0x7f10f4071530 2024-09-12T02:44:16.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.612+0000 7f10fa400640 1 -- 172.21.15.112:0/80300869 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10f41f3cd0 con 0x7f10f4071530 2024-09-12T02:44:16.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.612+0000 7f10fa400640 1 -- 172.21.15.112:0/80300869 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10f41f4290 con 0x7f10f4071530 2024-09-12T02:44:16.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.613+0000 7f10fa400640 1 -- 172.21.15.112:0/80300869 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10f4068a30 con 0x7f10f4071530 2024-09-12T02:44:16.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.614+0000 7f10eb400640 1 -- 172.21.15.112:0/80300869 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f10e4030a20 con 0x7f10f4071530 2024-09-12T02:44:16.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.614+0000 7f10eb400640 1 --2- 172.21.15.112:0/80300869 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f10d006be30 0x7f10d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:16.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.615+0000 7f10eb400640 1 -- 172.21.15.112:0/80300869 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5709+0+0 (secure 0 0 0) 0x7f10e40ab710 con 0x7f10f4071530 2024-09-12T02:44:16.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.615+0000 7f10ebe00640 1 --2- 172.21.15.112:0/80300869 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f10d006be30 0x7f10d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:16.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.615+0000 7f10ebe00640 1 --2- 172.21.15.112:0/80300869 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f10d006be30 0x7f10d006e2f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f10f40cda10 tx=0x7f10dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:16.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.619+0000 7f10eb400640 1 -- 172.21.15.112:0/80300869 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f10e407a020 con 0x7f10f4071530 2024-09-12T02:44:16.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.828+0000 7f10fa400640 1 -- 172.21.15.112:0/80300869 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10f4159bd0 con 0x7f10f4071530 2024-09-12T02:44:16.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.829+0000 7f10eb400640 1 -- 172.21.15.112:0/80300869 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5235 (secure 0 0 0) 0x7f10e4079920 con 0x7f10f4071530 2024-09-12T02:44:16.830 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:44:16.830 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":36,"btime":"2024-09-12T02:44:10:654160+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4997,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1412930245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1412930245},{"type":"v1","addr":"172.21.15.137:6834","nonce":1412930245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5299,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1045746375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1045746375},{"type":"v1","addr":"172.21.15.112:6837","nonce":1045746375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5305,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1625140900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1625140900},{"type":"v1","addr":"172.21.15.137:6835","nonce":1625140900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:44:07.016881+0000","modified":"2024-09-12T02:44:10.058498+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5508":{"gid":5508,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/3039296510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3039296510},{"type":"v1","addr":"172.21.15.112:6835","nonce":3039296510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5508,"qdb_cluster":[5508]},"id":4}]} 2024-09-12T02:44:16.830 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 36 2024-09-12T02:44:16.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.831+0000 7f10fa400640 1 -- 172.21.15.112:0/80300869 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f10d006be30 msgr2=0x7f10d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:16.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.831+0000 7f10fa400640 1 --2- 172.21.15.112:0/80300869 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f10d006be30 0x7f10d006e2f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f10f40cda10 tx=0x7f10dc009040 comp rx=0 tx=0).stop 2024-09-12T02:44:16.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.831+0000 7f10fa400640 1 -- 172.21.15.112:0/80300869 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10f4071530 msgr2=0x7f10f41f35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:16.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.831+0000 7f10fa400640 1 --2- 172.21.15.112:0/80300869 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10f4071530 0x7f10f41f35f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f10e402a220 tx=0x7f10e40046c0 comp rx=0 tx=0).stop 2024-09-12T02:44:16.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.831+0000 7f10fa400640 1 -- 172.21.15.112:0/80300869 shutdown_connections 2024-09-12T02:44:16.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.831+0000 7f10fa400640 1 --2- 172.21.15.112:0/80300869 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f10d006be30 0x7f10d006e2f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:16.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.831+0000 7f10fa400640 1 --2- 172.21.15.112:0/80300869 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10f415cc50 0x7f10f414c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:16.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.831+0000 7f10fa400640 1 --2- 172.21.15.112:0/80300869 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10f40afe30 0x7f10f4153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:16.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.831+0000 7f10fa400640 1 --2- 172.21.15.112:0/80300869 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10f4071530 0x7f10f41f35f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:16.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.831+0000 7f10fa400640 1 -- 172.21.15.112:0/80300869 >> 172.21.15.112:0/80300869 conn(0x7f10f406bbd0 msgr2=0x7f10f406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:16.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.831+0000 7f10fa400640 1 -- 172.21.15.112:0/80300869 shutdown_connections 2024-09-12T02:44:16.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:44:16.831+0000 7f10fa400640 1 -- 172.21.15.112:0/80300869 wait complete. 2024-09-12T02:44:16.849 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-12T02:44:17.022 INFO:teuthology.orchestra.run.smithi112.stdout:{"cluster_fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","whoami":0,"id":5508,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.3711123460000003,"mdsmap_epoch":36,"osdmap_epoch":64,"osdmap_epoch_barrier":64,"uptime":13.934767675} 2024-09-12T02:44:17.022 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", "fs_name": "cephfs", "id": 5508, "mdsmap_epoch": 36, "osdmap_epoch": 64, "osdmap_epoch_barrier": 64, "rank_uptime": 9.371112346, "state": "up:active", "uptime": 13.934767675, "want_state": "up:active", "whoami": 0 } 2024-09-12T02:44:17.023 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-12T02:44:17.188 INFO:teuthology.orchestra.run.smithi112.stdout:{"osd_mon_report_interval":"5"} 2024-09-12T02:44:17.189 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-12T02:44:17.189 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2024-09-12T02:44:17.349 INFO:teuthology.orchestra.run.smithi112.stdout:{"mon_tick_interval":"5"} 2024-09-12T02:44:17.350 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2024-09-12T02:44:17.350 INFO:tasks.cephfs.test_full:pool capacity 557078080, 531MB should be enough to fill it 2024-09-12T02:44:17.350 DEBUG:teuthology.orchestra.run.smithi112:> stdin-killer -- python3 -c ' 2024-09-12T02:44:17.350 DEBUG:teuthology.orchestra.run.smithi112:> import time 2024-09-12T02:44:17.350 DEBUG:teuthology.orchestra.run.smithi112:> import datetime 2024-09-12T02:44:17.350 DEBUG:teuthology.orchestra.run.smithi112:> import subprocess 2024-09-12T02:44:17.350 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-12T02:44:17.350 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:44:17.350 DEBUG:teuthology.orchestra.run.smithi112:> # Write some buffered data through before going full, all should be well 2024-09-12T02:44:17.350 DEBUG:teuthology.orchestra.run.smithi112:> print("writing some data through which we expect to succeed") 2024-09-12T02:44:17.350 DEBUG:teuthology.orchestra.run.smithi112:> bytes = 0 2024-09-12T02:44:17.351 DEBUG:teuthology.orchestra.run.smithi112:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2024-09-12T02:44:17.351 DEBUG:teuthology.orchestra.run.smithi112:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2024-09-12T02:44:17.351 DEBUG:teuthology.orchestra.run.smithi112:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2024-09-12T02:44:17.351 DEBUG:teuthology.orchestra.run.smithi112:> os.fsync(f) 2024-09-12T02:44:17.351 DEBUG:teuthology.orchestra.run.smithi112:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2024-09-12T02:44:17.351 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:44:17.351 DEBUG:teuthology.orchestra.run.smithi112:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2024-09-12T02:44:17.351 DEBUG:teuthology.orchestra.run.smithi112:> # writing until we see an error from fsync. As long as we'"'"'re doing 2024-09-12T02:44:17.351 DEBUG:teuthology.orchestra.run.smithi112:> # buffered IO, the error should always only appear from fsync and not 2024-09-12T02:44:17.351 DEBUG:teuthology.orchestra.run.smithi112:> # from write 2024-09-12T02:44:17.351 DEBUG:teuthology.orchestra.run.smithi112:> full = False 2024-09-12T02:44:17.351 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:44:17.351 DEBUG:teuthology.orchestra.run.smithi112:> for n in range(0, int(531 * 0.9)): 2024-09-12T02:44:17.351 DEBUG:teuthology.orchestra.run.smithi112:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-12T02:44:17.352 DEBUG:teuthology.orchestra.run.smithi112:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2024-09-12T02:44:17.352 DEBUG:teuthology.orchestra.run.smithi112:> print("done writing {0} bytes".format(bytes)) 2024-09-12T02:44:17.352 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:44:17.352 DEBUG:teuthology.orchestra.run.smithi112:> # OK, now we should sneak in under the full condition 2024-09-12T02:44:17.352 DEBUG:teuthology.orchestra.run.smithi112:> # due to the time it takes the OSDs to report to the 2024-09-12T02:44:17.352 DEBUG:teuthology.orchestra.run.smithi112:> # mons, and get a successful fsync on our full-making data 2024-09-12T02:44:17.352 DEBUG:teuthology.orchestra.run.smithi112:> os.fsync(f) 2024-09-12T02:44:17.352 DEBUG:teuthology.orchestra.run.smithi112:> print("successfully fsync'"'"'ed prior to getting full state reported") 2024-09-12T02:44:17.352 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:44:17.352 DEBUG:teuthology.orchestra.run.smithi112:> # buffered write, add more dirty data to the buffer 2024-09-12T02:44:17.352 DEBUG:teuthology.orchestra.run.smithi112:> print("starting buffered write") 2024-09-12T02:44:17.352 DEBUG:teuthology.orchestra.run.smithi112:> try: 2024-09-12T02:44:17.352 DEBUG:teuthology.orchestra.run.smithi112:> for n in range(0, int(531 * 0.2)): 2024-09-12T02:44:17.352 DEBUG:teuthology.orchestra.run.smithi112:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-12T02:44:17.353 DEBUG:teuthology.orchestra.run.smithi112:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2024-09-12T02:44:17.353 DEBUG:teuthology.orchestra.run.smithi112:> time.sleep(15.0) 2024-09-12T02:44:17.353 DEBUG:teuthology.orchestra.run.smithi112:> except OSError: 2024-09-12T02:44:17.353 DEBUG:teuthology.orchestra.run.smithi112:> pass; 2024-09-12T02:44:17.353 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:44:17.353 DEBUG:teuthology.orchestra.run.smithi112:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2024-09-12T02:44:17.353 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:44:17.353 DEBUG:teuthology.orchestra.run.smithi112:> # Wait long enough for a background flush that should fail 2024-09-12T02:44:17.353 DEBUG:teuthology.orchestra.run.smithi112:> time.sleep(30) 2024-09-12T02:44:17.353 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:44:17.353 DEBUG:teuthology.orchestra.run.smithi112:> if False: 2024-09-12T02:44:17.353 DEBUG:teuthology.orchestra.run.smithi112:> # ...and check that the failed background flush is reflected in fclose 2024-09-12T02:44:17.353 DEBUG:teuthology.orchestra.run.smithi112:> try: 2024-09-12T02:44:17.353 DEBUG:teuthology.orchestra.run.smithi112:> os.close(f) 2024-09-12T02:44:17.353 DEBUG:teuthology.orchestra.run.smithi112:> except OSError: 2024-09-12T02:44:17.354 DEBUG:teuthology.orchestra.run.smithi112:> print("close() returned an error as expected") 2024-09-12T02:44:17.354 DEBUG:teuthology.orchestra.run.smithi112:> else: 2024-09-12T02:44:17.354 DEBUG:teuthology.orchestra.run.smithi112:> raise RuntimeError("close() failed to raise error") 2024-09-12T02:44:17.354 DEBUG:teuthology.orchestra.run.smithi112:> else: 2024-09-12T02:44:17.354 DEBUG:teuthology.orchestra.run.smithi112:> # The kernel cephfs client does not raise errors on fclose 2024-09-12T02:44:17.354 DEBUG:teuthology.orchestra.run.smithi112:> os.close(f) 2024-09-12T02:44:17.354 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:44:17.354 DEBUG:teuthology.orchestra.run.smithi112:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2024-09-12T02:44:17.354 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-12T02:44:18.241 INFO:teuthology.orchestra.run.smithi112.stdout:writing some data through which we expect to succeed 2024-09-12T02:44:18.242 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed data successfully, will now attempt to fill fs 2024-09-12T02:44:18.242 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 1572864 bytes via buffered write, may repeat 2024-09-12T02:44:18.242 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 2621440 bytes via buffered write, may repeat 2024-09-12T02:44:18.242 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 3670016 bytes via buffered write, may repeat 2024-09-12T02:44:18.242 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 4718592 bytes via buffered write, may repeat 2024-09-12T02:44:18.242 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 5767168 bytes via buffered write, may repeat 2024-09-12T02:44:18.242 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 6815744 bytes via buffered write, may repeat 2024-09-12T02:44:18.242 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 7864320 bytes via buffered write, may repeat 2024-09-12T02:44:18.242 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 8912896 bytes via buffered write, may repeat 2024-09-12T02:44:18.242 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 9961472 bytes via buffered write, may repeat 2024-09-12T02:44:18.243 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 11010048 bytes via buffered write, may repeat 2024-09-12T02:44:18.243 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 12058624 bytes via buffered write, may repeat 2024-09-12T02:44:18.243 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 13107200 bytes via buffered write, may repeat 2024-09-12T02:44:18.243 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 14155776 bytes via buffered write, may repeat 2024-09-12T02:44:18.243 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 15204352 bytes via buffered write, may repeat 2024-09-12T02:44:18.243 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 16252928 bytes via buffered write, may repeat 2024-09-12T02:44:18.243 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 17301504 bytes via buffered write, may repeat 2024-09-12T02:44:18.243 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 18350080 bytes via buffered write, may repeat 2024-09-12T02:44:18.243 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 19398656 bytes via buffered write, may repeat 2024-09-12T02:44:18.243 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 20447232 bytes via buffered write, may repeat 2024-09-12T02:44:18.243 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 21495808 bytes via buffered write, may repeat 2024-09-12T02:44:18.243 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 22544384 bytes via buffered write, may repeat 2024-09-12T02:44:18.243 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 23592960 bytes via buffered write, may repeat 2024-09-12T02:44:18.244 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 24641536 bytes via buffered write, may repeat 2024-09-12T02:44:18.244 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 25690112 bytes via buffered write, may repeat 2024-09-12T02:44:18.244 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 26738688 bytes via buffered write, may repeat 2024-09-12T02:44:18.244 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 27787264 bytes via buffered write, may repeat 2024-09-12T02:44:18.244 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 28835840 bytes via buffered write, may repeat 2024-09-12T02:44:18.244 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 29884416 bytes via buffered write, may repeat 2024-09-12T02:44:18.244 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 30932992 bytes via buffered write, may repeat 2024-09-12T02:44:18.244 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 31981568 bytes via buffered write, may repeat 2024-09-12T02:44:18.244 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 33030144 bytes via buffered write, may repeat 2024-09-12T02:44:18.244 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 34078720 bytes via buffered write, may repeat 2024-09-12T02:44:18.244 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 35127296 bytes via buffered write, may repeat 2024-09-12T02:44:18.244 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 36175872 bytes via buffered write, may repeat 2024-09-12T02:44:18.245 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 37224448 bytes via buffered write, may repeat 2024-09-12T02:44:18.245 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 38273024 bytes via buffered write, may repeat 2024-09-12T02:44:18.245 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 39321600 bytes via buffered write, may repeat 2024-09-12T02:44:18.245 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 40370176 bytes via buffered write, may repeat 2024-09-12T02:44:18.245 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 41418752 bytes via buffered write, may repeat 2024-09-12T02:44:18.245 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 42467328 bytes via buffered write, may repeat 2024-09-12T02:44:18.245 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 43515904 bytes via buffered write, may repeat 2024-09-12T02:44:18.245 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 44564480 bytes via buffered write, may repeat 2024-09-12T02:44:18.245 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 45613056 bytes via buffered write, may repeat 2024-09-12T02:44:18.245 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 46661632 bytes via buffered write, may repeat 2024-09-12T02:44:18.245 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 47710208 bytes via buffered write, may repeat 2024-09-12T02:44:18.245 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 48758784 bytes via buffered write, may repeat 2024-09-12T02:44:18.245 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 49807360 bytes via buffered write, may repeat 2024-09-12T02:44:18.245 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 50855936 bytes via buffered write, may repeat 2024-09-12T02:44:18.246 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 51904512 bytes via buffered write, may repeat 2024-09-12T02:44:18.246 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 52953088 bytes via buffered write, may repeat 2024-09-12T02:44:18.246 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 54001664 bytes via buffered write, may repeat 2024-09-12T02:44:18.246 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 55050240 bytes via buffered write, may repeat 2024-09-12T02:44:18.246 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 56098816 bytes via buffered write, may repeat 2024-09-12T02:44:18.246 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 57147392 bytes via buffered write, may repeat 2024-09-12T02:44:18.246 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 58195968 bytes via buffered write, may repeat 2024-09-12T02:44:18.246 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 59244544 bytes via buffered write, may repeat 2024-09-12T02:44:18.246 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 60293120 bytes via buffered write, may repeat 2024-09-12T02:44:18.246 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 61341696 bytes via buffered write, may repeat 2024-09-12T02:44:18.246 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 62390272 bytes via buffered write, may repeat 2024-09-12T02:44:18.246 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 63438848 bytes via buffered write, may repeat 2024-09-12T02:44:18.246 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 64487424 bytes via buffered write, may repeat 2024-09-12T02:44:18.246 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 65536000 bytes via buffered write, may repeat 2024-09-12T02:44:18.247 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 66584576 bytes via buffered write, may repeat 2024-09-12T02:44:18.247 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 67633152 bytes via buffered write, may repeat 2024-09-12T02:44:18.247 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 68681728 bytes via buffered write, may repeat 2024-09-12T02:44:18.247 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 69730304 bytes via buffered write, may repeat 2024-09-12T02:44:18.247 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 70778880 bytes via buffered write, may repeat 2024-09-12T02:44:18.247 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 71827456 bytes via buffered write, may repeat 2024-09-12T02:44:18.247 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 72876032 bytes via buffered write, may repeat 2024-09-12T02:44:18.247 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 73924608 bytes via buffered write, may repeat 2024-09-12T02:44:18.247 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 74973184 bytes via buffered write, may repeat 2024-09-12T02:44:18.247 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 76021760 bytes via buffered write, may repeat 2024-09-12T02:44:18.248 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 77070336 bytes via buffered write, may repeat 2024-09-12T02:44:18.248 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 78118912 bytes via buffered write, may repeat 2024-09-12T02:44:18.248 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 79167488 bytes via buffered write, may repeat 2024-09-12T02:44:18.248 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 80216064 bytes via buffered write, may repeat 2024-09-12T02:44:18.248 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 81264640 bytes via buffered write, may repeat 2024-09-12T02:44:18.248 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 82313216 bytes via buffered write, may repeat 2024-09-12T02:44:18.248 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 83361792 bytes via buffered write, may repeat 2024-09-12T02:44:18.248 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 84410368 bytes via buffered write, may repeat 2024-09-12T02:44:18.248 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 85458944 bytes via buffered write, may repeat 2024-09-12T02:44:18.248 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 86507520 bytes via buffered write, may repeat 2024-09-12T02:44:18.248 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 87556096 bytes via buffered write, may repeat 2024-09-12T02:44:18.249 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 88604672 bytes via buffered write, may repeat 2024-09-12T02:44:18.249 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 89653248 bytes via buffered write, may repeat 2024-09-12T02:44:18.249 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 90701824 bytes via buffered write, may repeat 2024-09-12T02:44:18.249 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 91750400 bytes via buffered write, may repeat 2024-09-12T02:44:18.249 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 92798976 bytes via buffered write, may repeat 2024-09-12T02:44:18.249 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 93847552 bytes via buffered write, may repeat 2024-09-12T02:44:18.249 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 94896128 bytes via buffered write, may repeat 2024-09-12T02:44:18.249 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 95944704 bytes via buffered write, may repeat 2024-09-12T02:44:18.249 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 96993280 bytes via buffered write, may repeat 2024-09-12T02:44:18.249 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 98041856 bytes via buffered write, may repeat 2024-09-12T02:44:18.249 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 99090432 bytes via buffered write, may repeat 2024-09-12T02:44:18.249 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 100139008 bytes via buffered write, may repeat 2024-09-12T02:44:18.249 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 101187584 bytes via buffered write, may repeat 2024-09-12T02:44:18.250 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 102236160 bytes via buffered write, may repeat 2024-09-12T02:44:18.250 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 103284736 bytes via buffered write, may repeat 2024-09-12T02:44:18.250 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 104333312 bytes via buffered write, may repeat 2024-09-12T02:44:18.250 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 105381888 bytes via buffered write, may repeat 2024-09-12T02:44:18.250 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 106430464 bytes via buffered write, may repeat 2024-09-12T02:44:18.250 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 107479040 bytes via buffered write, may repeat 2024-09-12T02:44:18.250 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 108527616 bytes via buffered write, may repeat 2024-09-12T02:44:18.250 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 109576192 bytes via buffered write, may repeat 2024-09-12T02:44:18.250 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 110624768 bytes via buffered write, may repeat 2024-09-12T02:44:18.250 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 111673344 bytes via buffered write, may repeat 2024-09-12T02:44:18.251 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 112721920 bytes via buffered write, may repeat 2024-09-12T02:44:18.251 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 113770496 bytes via buffered write, may repeat 2024-09-12T02:44:18.251 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 114819072 bytes via buffered write, may repeat 2024-09-12T02:44:18.251 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 115867648 bytes via buffered write, may repeat 2024-09-12T02:44:18.251 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 116916224 bytes via buffered write, may repeat 2024-09-12T02:44:18.251 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 117964800 bytes via buffered write, may repeat 2024-09-12T02:44:18.251 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 119013376 bytes via buffered write, may repeat 2024-09-12T02:44:18.251 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 120061952 bytes via buffered write, may repeat 2024-09-12T02:44:18.251 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 121110528 bytes via buffered write, may repeat 2024-09-12T02:44:18.251 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 122159104 bytes via buffered write, may repeat 2024-09-12T02:44:18.251 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 123207680 bytes via buffered write, may repeat 2024-09-12T02:44:18.251 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 124256256 bytes via buffered write, may repeat 2024-09-12T02:44:18.251 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 125304832 bytes via buffered write, may repeat 2024-09-12T02:44:18.252 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 126353408 bytes via buffered write, may repeat 2024-09-12T02:44:18.252 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 127401984 bytes via buffered write, may repeat 2024-09-12T02:44:18.252 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 128450560 bytes via buffered write, may repeat 2024-09-12T02:44:18.252 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 129499136 bytes via buffered write, may repeat 2024-09-12T02:44:18.252 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 130547712 bytes via buffered write, may repeat 2024-09-12T02:44:18.252 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 131596288 bytes via buffered write, may repeat 2024-09-12T02:44:18.252 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 132644864 bytes via buffered write, may repeat 2024-09-12T02:44:18.252 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 133693440 bytes via buffered write, may repeat 2024-09-12T02:44:18.252 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 134742016 bytes via buffered write, may repeat 2024-09-12T02:44:18.252 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 135790592 bytes via buffered write, may repeat 2024-09-12T02:44:18.252 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 136839168 bytes via buffered write, may repeat 2024-09-12T02:44:18.252 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 137887744 bytes via buffered write, may repeat 2024-09-12T02:44:18.252 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 138936320 bytes via buffered write, may repeat 2024-09-12T02:44:18.253 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 139984896 bytes via buffered write, may repeat 2024-09-12T02:44:18.253 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 141033472 bytes via buffered write, may repeat 2024-09-12T02:44:18.253 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 142082048 bytes via buffered write, may repeat 2024-09-12T02:44:18.253 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 143130624 bytes via buffered write, may repeat 2024-09-12T02:44:18.253 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 144179200 bytes via buffered write, may repeat 2024-09-12T02:44:18.253 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 145227776 bytes via buffered write, may repeat 2024-09-12T02:44:18.253 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 146276352 bytes via buffered write, may repeat 2024-09-12T02:44:18.253 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 147324928 bytes via buffered write, may repeat 2024-09-12T02:44:18.253 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 148373504 bytes via buffered write, may repeat 2024-09-12T02:44:18.253 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 149422080 bytes via buffered write, may repeat 2024-09-12T02:44:18.254 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 150470656 bytes via buffered write, may repeat 2024-09-12T02:44:18.254 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 151519232 bytes via buffered write, may repeat 2024-09-12T02:44:18.254 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 152567808 bytes via buffered write, may repeat 2024-09-12T02:44:18.254 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 153616384 bytes via buffered write, may repeat 2024-09-12T02:44:18.254 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 154664960 bytes via buffered write, may repeat 2024-09-12T02:44:18.254 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 155713536 bytes via buffered write, may repeat 2024-09-12T02:44:18.254 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 156762112 bytes via buffered write, may repeat 2024-09-12T02:44:18.254 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 157810688 bytes via buffered write, may repeat 2024-09-12T02:44:18.254 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 158859264 bytes via buffered write, may repeat 2024-09-12T02:44:18.254 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 159907840 bytes via buffered write, may repeat 2024-09-12T02:44:18.254 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 160956416 bytes via buffered write, may repeat 2024-09-12T02:44:18.254 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 162004992 bytes via buffered write, may repeat 2024-09-12T02:44:18.389 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 163053568 bytes via buffered write, may repeat 2024-09-12T02:44:18.389 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 164102144 bytes via buffered write, may repeat 2024-09-12T02:44:18.389 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 165150720 bytes via buffered write, may repeat 2024-09-12T02:44:18.389 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 166199296 bytes via buffered write, may repeat 2024-09-12T02:44:18.389 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 167247872 bytes via buffered write, may repeat 2024-09-12T02:44:18.389 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 168296448 bytes via buffered write, may repeat 2024-09-12T02:44:18.389 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 169345024 bytes via buffered write, may repeat 2024-09-12T02:44:18.389 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 170393600 bytes via buffered write, may repeat 2024-09-12T02:44:18.389 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 171442176 bytes via buffered write, may repeat 2024-09-12T02:44:18.390 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 172490752 bytes via buffered write, may repeat 2024-09-12T02:44:18.390 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 173539328 bytes via buffered write, may repeat 2024-09-12T02:44:18.390 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 174587904 bytes via buffered write, may repeat 2024-09-12T02:44:18.390 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 175636480 bytes via buffered write, may repeat 2024-09-12T02:44:18.390 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 176685056 bytes via buffered write, may repeat 2024-09-12T02:44:18.390 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 177733632 bytes via buffered write, may repeat 2024-09-12T02:44:18.390 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 178782208 bytes via buffered write, may repeat 2024-09-12T02:44:18.390 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 179830784 bytes via buffered write, may repeat 2024-09-12T02:44:18.390 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 180879360 bytes via buffered write, may repeat 2024-09-12T02:44:18.390 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 181927936 bytes via buffered write, may repeat 2024-09-12T02:44:18.390 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 182976512 bytes via buffered write, may repeat 2024-09-12T02:44:18.390 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 184025088 bytes via buffered write, may repeat 2024-09-12T02:44:18.390 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 185073664 bytes via buffered write, may repeat 2024-09-12T02:44:18.390 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 186122240 bytes via buffered write, may repeat 2024-09-12T02:44:18.390 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 187170816 bytes via buffered write, may repeat 2024-09-12T02:44:18.391 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 188219392 bytes via buffered write, may repeat 2024-09-12T02:44:18.391 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 189267968 bytes via buffered write, may repeat 2024-09-12T02:44:18.391 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 190316544 bytes via buffered write, may repeat 2024-09-12T02:44:18.391 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 191365120 bytes via buffered write, may repeat 2024-09-12T02:44:18.391 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 192413696 bytes via buffered write, may repeat 2024-09-12T02:44:18.391 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 193462272 bytes via buffered write, may repeat 2024-09-12T02:44:18.391 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 194510848 bytes via buffered write, may repeat 2024-09-12T02:44:18.391 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 195559424 bytes via buffered write, may repeat 2024-09-12T02:44:18.391 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 196608000 bytes via buffered write, may repeat 2024-09-12T02:44:18.391 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 197656576 bytes via buffered write, may repeat 2024-09-12T02:44:18.391 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 198705152 bytes via buffered write, may repeat 2024-09-12T02:44:18.391 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 199753728 bytes via buffered write, may repeat 2024-09-12T02:44:18.391 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 200802304 bytes via buffered write, may repeat 2024-09-12T02:44:18.391 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 201850880 bytes via buffered write, may repeat 2024-09-12T02:44:18.392 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 202899456 bytes via buffered write, may repeat 2024-09-12T02:44:18.392 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 203948032 bytes via buffered write, may repeat 2024-09-12T02:44:18.392 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 204996608 bytes via buffered write, may repeat 2024-09-12T02:44:18.392 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 206045184 bytes via buffered write, may repeat 2024-09-12T02:44:18.392 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 207093760 bytes via buffered write, may repeat 2024-09-12T02:44:18.392 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 208142336 bytes via buffered write, may repeat 2024-09-12T02:44:18.392 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 209190912 bytes via buffered write, may repeat 2024-09-12T02:44:18.392 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 210239488 bytes via buffered write, may repeat 2024-09-12T02:44:18.392 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 211288064 bytes via buffered write, may repeat 2024-09-12T02:44:18.392 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 212336640 bytes via buffered write, may repeat 2024-09-12T02:44:18.392 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 213385216 bytes via buffered write, may repeat 2024-09-12T02:44:18.392 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 214433792 bytes via buffered write, may repeat 2024-09-12T02:44:18.392 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 215482368 bytes via buffered write, may repeat 2024-09-12T02:44:18.392 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 216530944 bytes via buffered write, may repeat 2024-09-12T02:44:18.393 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 217579520 bytes via buffered write, may repeat 2024-09-12T02:44:18.393 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 218628096 bytes via buffered write, may repeat 2024-09-12T02:44:18.393 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 219676672 bytes via buffered write, may repeat 2024-09-12T02:44:18.393 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 220725248 bytes via buffered write, may repeat 2024-09-12T02:44:18.393 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 221773824 bytes via buffered write, may repeat 2024-09-12T02:44:18.393 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 222822400 bytes via buffered write, may repeat 2024-09-12T02:44:18.393 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 223870976 bytes via buffered write, may repeat 2024-09-12T02:44:18.393 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 224919552 bytes via buffered write, may repeat 2024-09-12T02:44:18.393 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 225968128 bytes via buffered write, may repeat 2024-09-12T02:44:18.393 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 227016704 bytes via buffered write, may repeat 2024-09-12T02:44:18.393 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 228065280 bytes via buffered write, may repeat 2024-09-12T02:44:18.393 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 229113856 bytes via buffered write, may repeat 2024-09-12T02:44:18.393 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 230162432 bytes via buffered write, may repeat 2024-09-12T02:44:18.393 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 231211008 bytes via buffered write, may repeat 2024-09-12T02:44:18.394 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 232259584 bytes via buffered write, may repeat 2024-09-12T02:44:18.394 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 233308160 bytes via buffered write, may repeat 2024-09-12T02:44:18.394 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 234356736 bytes via buffered write, may repeat 2024-09-12T02:44:18.394 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 235405312 bytes via buffered write, may repeat 2024-09-12T02:44:18.394 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 236453888 bytes via buffered write, may repeat 2024-09-12T02:44:18.394 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 237502464 bytes via buffered write, may repeat 2024-09-12T02:44:18.394 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 238551040 bytes via buffered write, may repeat 2024-09-12T02:44:18.394 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 239599616 bytes via buffered write, may repeat 2024-09-12T02:44:18.394 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 240648192 bytes via buffered write, may repeat 2024-09-12T02:44:18.394 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 241696768 bytes via buffered write, may repeat 2024-09-12T02:44:18.394 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 242745344 bytes via buffered write, may repeat 2024-09-12T02:44:18.394 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 243793920 bytes via buffered write, may repeat 2024-09-12T02:44:18.394 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 244842496 bytes via buffered write, may repeat 2024-09-12T02:44:18.394 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 245891072 bytes via buffered write, may repeat 2024-09-12T02:44:18.394 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 246939648 bytes via buffered write, may repeat 2024-09-12T02:44:18.395 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 247988224 bytes via buffered write, may repeat 2024-09-12T02:44:18.395 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 249036800 bytes via buffered write, may repeat 2024-09-12T02:44:18.395 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 250085376 bytes via buffered write, may repeat 2024-09-12T02:44:18.395 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 251133952 bytes via buffered write, may repeat 2024-09-12T02:44:18.395 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 252182528 bytes via buffered write, may repeat 2024-09-12T02:44:18.395 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 253231104 bytes via buffered write, may repeat 2024-09-12T02:44:18.395 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 254279680 bytes via buffered write, may repeat 2024-09-12T02:44:18.395 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 255328256 bytes via buffered write, may repeat 2024-09-12T02:44:18.395 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 256376832 bytes via buffered write, may repeat 2024-09-12T02:44:18.395 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 257425408 bytes via buffered write, may repeat 2024-09-12T02:44:18.395 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 258473984 bytes via buffered write, may repeat 2024-09-12T02:44:18.395 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 259522560 bytes via buffered write, may repeat 2024-09-12T02:44:18.395 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 260571136 bytes via buffered write, may repeat 2024-09-12T02:44:18.396 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 261619712 bytes via buffered write, may repeat 2024-09-12T02:44:18.396 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 262668288 bytes via buffered write, may repeat 2024-09-12T02:44:18.396 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 263716864 bytes via buffered write, may repeat 2024-09-12T02:44:18.396 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 264765440 bytes via buffered write, may repeat 2024-09-12T02:44:18.396 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 265814016 bytes via buffered write, may repeat 2024-09-12T02:44:18.396 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 266862592 bytes via buffered write, may repeat 2024-09-12T02:44:18.396 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 267911168 bytes via buffered write, may repeat 2024-09-12T02:44:18.396 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 268959744 bytes via buffered write, may repeat 2024-09-12T02:44:18.396 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 270008320 bytes via buffered write, may repeat 2024-09-12T02:44:18.396 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 271056896 bytes via buffered write, may repeat 2024-09-12T02:44:18.396 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 272105472 bytes via buffered write, may repeat 2024-09-12T02:44:18.396 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 273154048 bytes via buffered write, may repeat 2024-09-12T02:44:18.396 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 274202624 bytes via buffered write, may repeat 2024-09-12T02:44:18.396 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 275251200 bytes via buffered write, may repeat 2024-09-12T02:44:18.397 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 276299776 bytes via buffered write, may repeat 2024-09-12T02:44:18.397 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 277348352 bytes via buffered write, may repeat 2024-09-12T02:44:18.397 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 278396928 bytes via buffered write, may repeat 2024-09-12T02:44:18.397 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 279445504 bytes via buffered write, may repeat 2024-09-12T02:44:18.397 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 280494080 bytes via buffered write, may repeat 2024-09-12T02:44:18.397 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 281542656 bytes via buffered write, may repeat 2024-09-12T02:44:18.397 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 282591232 bytes via buffered write, may repeat 2024-09-12T02:44:18.397 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 283639808 bytes via buffered write, may repeat 2024-09-12T02:44:18.397 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 284688384 bytes via buffered write, may repeat 2024-09-12T02:44:18.397 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 285736960 bytes via buffered write, may repeat 2024-09-12T02:44:18.397 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 286785536 bytes via buffered write, may repeat 2024-09-12T02:44:18.397 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 287834112 bytes via buffered write, may repeat 2024-09-12T02:44:18.397 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 288882688 bytes via buffered write, may repeat 2024-09-12T02:44:18.397 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 289931264 bytes via buffered write, may repeat 2024-09-12T02:44:18.397 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 290979840 bytes via buffered write, may repeat 2024-09-12T02:44:18.398 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 292028416 bytes via buffered write, may repeat 2024-09-12T02:44:18.398 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 293076992 bytes via buffered write, may repeat 2024-09-12T02:44:18.398 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 294125568 bytes via buffered write, may repeat 2024-09-12T02:44:18.398 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 295174144 bytes via buffered write, may repeat 2024-09-12T02:44:18.398 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 296222720 bytes via buffered write, may repeat 2024-09-12T02:44:18.398 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 297271296 bytes via buffered write, may repeat 2024-09-12T02:44:18.398 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 298319872 bytes via buffered write, may repeat 2024-09-12T02:44:18.398 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 299368448 bytes via buffered write, may repeat 2024-09-12T02:44:18.398 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 300417024 bytes via buffered write, may repeat 2024-09-12T02:44:18.398 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 301465600 bytes via buffered write, may repeat 2024-09-12T02:44:18.398 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 302514176 bytes via buffered write, may repeat 2024-09-12T02:44:18.398 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 303562752 bytes via buffered write, may repeat 2024-09-12T02:44:18.398 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 304611328 bytes via buffered write, may repeat 2024-09-12T02:44:18.399 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 305659904 bytes via buffered write, may repeat 2024-09-12T02:44:18.399 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 306708480 bytes via buffered write, may repeat 2024-09-12T02:44:18.399 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 307757056 bytes via buffered write, may repeat 2024-09-12T02:44:18.399 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 308805632 bytes via buffered write, may repeat 2024-09-12T02:44:18.399 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 309854208 bytes via buffered write, may repeat 2024-09-12T02:44:18.399 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 310902784 bytes via buffered write, may repeat 2024-09-12T02:44:18.399 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 311951360 bytes via buffered write, may repeat 2024-09-12T02:44:18.399 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 312999936 bytes via buffered write, may repeat 2024-09-12T02:44:18.399 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 314048512 bytes via buffered write, may repeat 2024-09-12T02:44:18.399 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 315097088 bytes via buffered write, may repeat 2024-09-12T02:44:18.399 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 316145664 bytes via buffered write, may repeat 2024-09-12T02:44:18.399 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 317194240 bytes via buffered write, may repeat 2024-09-12T02:44:18.399 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 318242816 bytes via buffered write, may repeat 2024-09-12T02:44:18.399 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 319291392 bytes via buffered write, may repeat 2024-09-12T02:44:18.400 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 320339968 bytes via buffered write, may repeat 2024-09-12T02:44:18.400 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 321388544 bytes via buffered write, may repeat 2024-09-12T02:44:18.400 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 322437120 bytes via buffered write, may repeat 2024-09-12T02:44:18.400 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 323485696 bytes via buffered write, may repeat 2024-09-12T02:44:18.534 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 324534272 bytes via buffered write, may repeat 2024-09-12T02:44:18.534 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 325582848 bytes via buffered write, may repeat 2024-09-12T02:44:18.534 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 326631424 bytes via buffered write, may repeat 2024-09-12T02:44:18.534 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 327680000 bytes via buffered write, may repeat 2024-09-12T02:44:18.534 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 328728576 bytes via buffered write, may repeat 2024-09-12T02:44:18.534 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 329777152 bytes via buffered write, may repeat 2024-09-12T02:44:18.534 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 330825728 bytes via buffered write, may repeat 2024-09-12T02:44:18.535 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 331874304 bytes via buffered write, may repeat 2024-09-12T02:44:18.535 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 332922880 bytes via buffered write, may repeat 2024-09-12T02:44:18.535 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 333971456 bytes via buffered write, may repeat 2024-09-12T02:44:18.535 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 335020032 bytes via buffered write, may repeat 2024-09-12T02:44:18.535 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 336068608 bytes via buffered write, may repeat 2024-09-12T02:44:18.535 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 337117184 bytes via buffered write, may repeat 2024-09-12T02:44:18.535 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 338165760 bytes via buffered write, may repeat 2024-09-12T02:44:18.535 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 339214336 bytes via buffered write, may repeat 2024-09-12T02:44:18.535 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 340262912 bytes via buffered write, may repeat 2024-09-12T02:44:18.535 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 341311488 bytes via buffered write, may repeat 2024-09-12T02:44:18.535 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 342360064 bytes via buffered write, may repeat 2024-09-12T02:44:18.535 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 343408640 bytes via buffered write, may repeat 2024-09-12T02:44:18.535 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 344457216 bytes via buffered write, may repeat 2024-09-12T02:44:18.535 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 345505792 bytes via buffered write, may repeat 2024-09-12T02:44:18.536 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 346554368 bytes via buffered write, may repeat 2024-09-12T02:44:18.536 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 347602944 bytes via buffered write, may repeat 2024-09-12T02:44:18.536 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 348651520 bytes via buffered write, may repeat 2024-09-12T02:44:18.536 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 349700096 bytes via buffered write, may repeat 2024-09-12T02:44:18.536 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 350748672 bytes via buffered write, may repeat 2024-09-12T02:44:18.536 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 351797248 bytes via buffered write, may repeat 2024-09-12T02:44:18.536 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 352845824 bytes via buffered write, may repeat 2024-09-12T02:44:18.536 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 353894400 bytes via buffered write, may repeat 2024-09-12T02:44:18.536 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 354942976 bytes via buffered write, may repeat 2024-09-12T02:44:18.536 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 355991552 bytes via buffered write, may repeat 2024-09-12T02:44:18.536 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 357040128 bytes via buffered write, may repeat 2024-09-12T02:44:18.536 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 358088704 bytes via buffered write, may repeat 2024-09-12T02:44:18.536 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 359137280 bytes via buffered write, may repeat 2024-09-12T02:44:18.537 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 360185856 bytes via buffered write, may repeat 2024-09-12T02:44:18.537 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 361234432 bytes via buffered write, may repeat 2024-09-12T02:44:18.537 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 362283008 bytes via buffered write, may repeat 2024-09-12T02:44:18.537 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 363331584 bytes via buffered write, may repeat 2024-09-12T02:44:18.537 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 364380160 bytes via buffered write, may repeat 2024-09-12T02:44:18.537 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 365428736 bytes via buffered write, may repeat 2024-09-12T02:44:18.537 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 366477312 bytes via buffered write, may repeat 2024-09-12T02:44:18.537 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 367525888 bytes via buffered write, may repeat 2024-09-12T02:44:18.537 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 368574464 bytes via buffered write, may repeat 2024-09-12T02:44:18.537 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 369623040 bytes via buffered write, may repeat 2024-09-12T02:44:18.537 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 370671616 bytes via buffered write, may repeat 2024-09-12T02:44:18.537 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 371720192 bytes via buffered write, may repeat 2024-09-12T02:44:18.537 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 372768768 bytes via buffered write, may repeat 2024-09-12T02:44:18.537 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 373817344 bytes via buffered write, may repeat 2024-09-12T02:44:18.538 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 374865920 bytes via buffered write, may repeat 2024-09-12T02:44:18.538 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 375914496 bytes via buffered write, may repeat 2024-09-12T02:44:18.538 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 376963072 bytes via buffered write, may repeat 2024-09-12T02:44:18.538 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 378011648 bytes via buffered write, may repeat 2024-09-12T02:44:18.538 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 379060224 bytes via buffered write, may repeat 2024-09-12T02:44:18.538 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 380108800 bytes via buffered write, may repeat 2024-09-12T02:44:18.538 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 381157376 bytes via buffered write, may repeat 2024-09-12T02:44:18.538 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 382205952 bytes via buffered write, may repeat 2024-09-12T02:44:18.538 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 383254528 bytes via buffered write, may repeat 2024-09-12T02:44:18.538 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 384303104 bytes via buffered write, may repeat 2024-09-12T02:44:18.538 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 385351680 bytes via buffered write, may repeat 2024-09-12T02:44:18.538 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 386400256 bytes via buffered write, may repeat 2024-09-12T02:44:18.538 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 387448832 bytes via buffered write, may repeat 2024-09-12T02:44:18.538 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 388497408 bytes via buffered write, may repeat 2024-09-12T02:44:18.538 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 389545984 bytes via buffered write, may repeat 2024-09-12T02:44:18.539 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 390594560 bytes via buffered write, may repeat 2024-09-12T02:44:18.539 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 391643136 bytes via buffered write, may repeat 2024-09-12T02:44:18.539 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 392691712 bytes via buffered write, may repeat 2024-09-12T02:44:18.539 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 393740288 bytes via buffered write, may repeat 2024-09-12T02:44:18.539 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 394788864 bytes via buffered write, may repeat 2024-09-12T02:44:18.539 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 395837440 bytes via buffered write, may repeat 2024-09-12T02:44:18.539 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 396886016 bytes via buffered write, may repeat 2024-09-12T02:44:18.539 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 397934592 bytes via buffered write, may repeat 2024-09-12T02:44:18.539 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 398983168 bytes via buffered write, may repeat 2024-09-12T02:44:18.539 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 400031744 bytes via buffered write, may repeat 2024-09-12T02:44:18.539 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 401080320 bytes via buffered write, may repeat 2024-09-12T02:44:18.539 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 402128896 bytes via buffered write, may repeat 2024-09-12T02:44:18.539 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 403177472 bytes via buffered write, may repeat 2024-09-12T02:44:18.539 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 404226048 bytes via buffered write, may repeat 2024-09-12T02:44:18.540 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 405274624 bytes via buffered write, may repeat 2024-09-12T02:44:18.540 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 406323200 bytes via buffered write, may repeat 2024-09-12T02:44:18.540 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 407371776 bytes via buffered write, may repeat 2024-09-12T02:44:18.540 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 408420352 bytes via buffered write, may repeat 2024-09-12T02:44:18.540 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 409468928 bytes via buffered write, may repeat 2024-09-12T02:44:18.540 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 410517504 bytes via buffered write, may repeat 2024-09-12T02:44:18.540 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 411566080 bytes via buffered write, may repeat 2024-09-12T02:44:18.540 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 412614656 bytes via buffered write, may repeat 2024-09-12T02:44:18.540 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 413663232 bytes via buffered write, may repeat 2024-09-12T02:44:18.540 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 414711808 bytes via buffered write, may repeat 2024-09-12T02:44:18.540 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 415760384 bytes via buffered write, may repeat 2024-09-12T02:44:18.540 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 416808960 bytes via buffered write, may repeat 2024-09-12T02:44:18.540 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 417857536 bytes via buffered write, may repeat 2024-09-12T02:44:18.540 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 418906112 bytes via buffered write, may repeat 2024-09-12T02:44:18.541 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 419954688 bytes via buffered write, may repeat 2024-09-12T02:44:18.541 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 421003264 bytes via buffered write, may repeat 2024-09-12T02:44:18.541 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 422051840 bytes via buffered write, may repeat 2024-09-12T02:44:18.541 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 423100416 bytes via buffered write, may repeat 2024-09-12T02:44:18.541 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 424148992 bytes via buffered write, may repeat 2024-09-12T02:44:18.541 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 425197568 bytes via buffered write, may repeat 2024-09-12T02:44:18.541 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 426246144 bytes via buffered write, may repeat 2024-09-12T02:44:18.541 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 427294720 bytes via buffered write, may repeat 2024-09-12T02:44:18.541 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 428343296 bytes via buffered write, may repeat 2024-09-12T02:44:18.541 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 429391872 bytes via buffered write, may repeat 2024-09-12T02:44:18.541 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 430440448 bytes via buffered write, may repeat 2024-09-12T02:44:18.541 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 431489024 bytes via buffered write, may repeat 2024-09-12T02:44:18.541 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 432537600 bytes via buffered write, may repeat 2024-09-12T02:44:18.542 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 433586176 bytes via buffered write, may repeat 2024-09-12T02:44:18.542 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 434634752 bytes via buffered write, may repeat 2024-09-12T02:44:18.542 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 435683328 bytes via buffered write, may repeat 2024-09-12T02:44:18.542 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 436731904 bytes via buffered write, may repeat 2024-09-12T02:44:18.542 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 437780480 bytes via buffered write, may repeat 2024-09-12T02:44:18.542 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 438829056 bytes via buffered write, may repeat 2024-09-12T02:44:18.542 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 439877632 bytes via buffered write, may repeat 2024-09-12T02:44:18.542 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 440926208 bytes via buffered write, may repeat 2024-09-12T02:44:18.542 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 441974784 bytes via buffered write, may repeat 2024-09-12T02:44:18.542 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 443023360 bytes via buffered write, may repeat 2024-09-12T02:44:18.542 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 444071936 bytes via buffered write, may repeat 2024-09-12T02:44:18.542 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 445120512 bytes via buffered write, may repeat 2024-09-12T02:44:18.542 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 446169088 bytes via buffered write, may repeat 2024-09-12T02:44:18.542 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 447217664 bytes via buffered write, may repeat 2024-09-12T02:44:18.542 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 448266240 bytes via buffered write, may repeat 2024-09-12T02:44:18.543 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 449314816 bytes via buffered write, may repeat 2024-09-12T02:44:18.543 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 450363392 bytes via buffered write, may repeat 2024-09-12T02:44:18.543 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 451411968 bytes via buffered write, may repeat 2024-09-12T02:44:18.543 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 452460544 bytes via buffered write, may repeat 2024-09-12T02:44:18.543 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 453509120 bytes via buffered write, may repeat 2024-09-12T02:44:18.543 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 454557696 bytes via buffered write, may repeat 2024-09-12T02:44:18.543 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 455606272 bytes via buffered write, may repeat 2024-09-12T02:44:18.543 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 456654848 bytes via buffered write, may repeat 2024-09-12T02:44:18.543 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 457703424 bytes via buffered write, may repeat 2024-09-12T02:44:18.543 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 458752000 bytes via buffered write, may repeat 2024-09-12T02:44:18.543 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 459800576 bytes via buffered write, may repeat 2024-09-12T02:44:18.543 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 460849152 bytes via buffered write, may repeat 2024-09-12T02:44:18.543 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 461897728 bytes via buffered write, may repeat 2024-09-12T02:44:18.544 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 462946304 bytes via buffered write, may repeat 2024-09-12T02:44:18.544 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 463994880 bytes via buffered write, may repeat 2024-09-12T02:44:18.544 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 465043456 bytes via buffered write, may repeat 2024-09-12T02:44:18.544 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 466092032 bytes via buffered write, may repeat 2024-09-12T02:44:18.544 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 467140608 bytes via buffered write, may repeat 2024-09-12T02:44:18.544 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 468189184 bytes via buffered write, may repeat 2024-09-12T02:44:18.544 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 469237760 bytes via buffered write, may repeat 2024-09-12T02:44:18.544 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 470286336 bytes via buffered write, may repeat 2024-09-12T02:44:18.544 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 471334912 bytes via buffered write, may repeat 2024-09-12T02:44:18.544 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 472383488 bytes via buffered write, may repeat 2024-09-12T02:44:18.544 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 473432064 bytes via buffered write, may repeat 2024-09-12T02:44:18.544 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 474480640 bytes via buffered write, may repeat 2024-09-12T02:44:18.544 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 475529216 bytes via buffered write, may repeat 2024-09-12T02:44:18.544 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 476577792 bytes via buffered write, may repeat 2024-09-12T02:44:18.545 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 477626368 bytes via buffered write, may repeat 2024-09-12T02:44:18.545 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 478674944 bytes via buffered write, may repeat 2024-09-12T02:44:18.545 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 479723520 bytes via buffered write, may repeat 2024-09-12T02:44:18.545 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 480772096 bytes via buffered write, may repeat 2024-09-12T02:44:18.545 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 481820672 bytes via buffered write, may repeat 2024-09-12T02:44:18.545 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 482869248 bytes via buffered write, may repeat 2024-09-12T02:44:18.545 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 483917824 bytes via buffered write, may repeat 2024-09-12T02:44:18.545 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 484966400 bytes via buffered write, may repeat 2024-09-12T02:44:20.869 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:44:20.875 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:44:22.047 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-12T02:44:22.047+0000 7f0219e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2024-09-12T02:44:30.963 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-12T02:44:30.962+0000 7f0219e00640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2024-09-12T02:44:50.981 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:44:50.986 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:45:19.787 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 486014976 bytes via buffered write, may repeat 2024-09-12T02:45:19.787 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 487063552 bytes via buffered write, may repeat 2024-09-12T02:45:19.787 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 488112128 bytes via buffered write, may repeat 2024-09-12T02:45:19.787 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 489160704 bytes via buffered write, may repeat 2024-09-12T02:45:19.787 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 490209280 bytes via buffered write, may repeat 2024-09-12T02:45:19.788 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 491257856 bytes via buffered write, may repeat 2024-09-12T02:45:19.788 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 492306432 bytes via buffered write, may repeat 2024-09-12T02:45:19.788 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 493355008 bytes via buffered write, may repeat 2024-09-12T02:45:19.788 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 494403584 bytes via buffered write, may repeat 2024-09-12T02:45:19.788 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 495452160 bytes via buffered write, may repeat 2024-09-12T02:45:19.788 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 496500736 bytes via buffered write, may repeat 2024-09-12T02:45:19.788 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 497549312 bytes via buffered write, may repeat 2024-09-12T02:45:19.788 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 498597888 bytes via buffered write, may repeat 2024-09-12T02:45:19.788 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 499646464 bytes via buffered write, may repeat 2024-09-12T02:45:19.788 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 500695040 bytes via buffered write, may repeat 2024-09-12T02:45:19.788 INFO:teuthology.orchestra.run.smithi112.stdout:done writing 500695040 bytes 2024-09-12T02:45:19.788 INFO:teuthology.orchestra.run.smithi112.stdout:successfully fsync'ed prior to getting full state reported 2024-09-12T02:45:19.789 INFO:teuthology.orchestra.run.smithi112.stdout:starting buffered write 2024-09-12T02:45:19.789 INFO:teuthology.orchestra.run.smithi112.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-12T02:45:19.789 INFO:teuthology.orchestra.run.smithi112.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-12T02:45:19.789 INFO:teuthology.orchestra.run.smithi112.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2024-09-12T02:45:19.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:45:19.801 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:45:19.801 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:45:19.891 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:45:19.981 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:45:19.981 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:45:19.981 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:45:19.981 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:45:20.017 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:45:20.017 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:45:20.093 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:45:20.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.288+0000 7fc94b400640 1 Processor -- start 2024-09-12T02:45:20.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.288+0000 7fc94b400640 1 -- start start 2024-09-12T02:45:20.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.289+0000 7fc94b400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc94415cc50 0x7fc9440732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.289+0000 7fc94b400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc944071530 0x7fc9440af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.289+0000 7fc94b400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc944073830 con 0x7fc944071970 2024-09-12T02:45:20.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.289+0000 7fc94b400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc94415d030 con 0x7fc94415cc50 2024-09-12T02:45:20.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.289+0000 7fc94b400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc9440cf4c0 con 0x7fc944071530 2024-09-12T02:45:20.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.290+0000 7fc949400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc944071970 0x7fc9440cf950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52146/0 (socket says 172.21.15.112:52146) 2024-09-12T02:45:20.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.290+0000 7fc949400640 1 -- 172.21.15.112:0/1065691370 learned_addr learned my addr 172.21.15.112:0/1065691370 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:45:20.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.290+0000 7fc93be00640 1 --2- 172.21.15.112:0/1065691370 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc944071530 0x7fc9440af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.290+0000 7fc948a00640 1 --2- 172.21.15.112:0/1065691370 >> v2:172.21.15.137:3300/0 conn(0x7fc94415cc50 0x7fc9440732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.290+0000 7fc943e00640 1 -- 172.21.15.112:0/1065691370 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2566785321 0 0) 0x7fc93c001490 con 0x7fc944071970 2024-09-12T02:45:20.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.290+0000 7fc943e00640 1 -- 172.21.15.112:0/1065691370 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc928003520 con 0x7fc944071970 2024-09-12T02:45:20.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.290+0000 7fc93be00640 1 -- 172.21.15.112:0/1065691370 >> v2:172.21.15.137:3300/0 conn(0x7fc94415cc50 msgr2=0x7fc9440732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:20.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.290+0000 7fc93be00640 1 --2- 172.21.15.112:0/1065691370 >> v2:172.21.15.137:3300/0 conn(0x7fc94415cc50 0x7fc9440732f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.290+0000 7fc943e00640 1 -- 172.21.15.112:0/1065691370 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3377248221 0 0) 0x7fc928003520 con 0x7fc944071970 2024-09-12T02:45:20.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.290+0000 7fc93be00640 1 -- 172.21.15.112:0/1065691370 >> v1:172.21.15.112:6789/0 conn(0x7fc944071970 legacy=0x7fc9440cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:20.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.291+0000 7fc93be00640 1 -- 172.21.15.112:0/1065691370 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9440ceeb0 con 0x7fc944071530 2024-09-12T02:45:20.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.292+0000 7fc93be00640 1 --2- 172.21.15.112:0/1065691370 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc944071530 0x7fc9440af720 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009790 tx=0x7fc92c02a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f97ef8b417fbd216 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:20.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.292+0000 7fc943e00640 1 -- 172.21.15.112:0/1065691370 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c037070 con 0x7fc944071530 2024-09-12T02:45:20.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.292+0000 7fc943e00640 1 -- 172.21.15.112:0/1065691370 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc92c02ab10 con 0x7fc944071530 2024-09-12T02:45:20.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.292+0000 7fc943e00640 1 -- 172.21.15.112:0/1065691370 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93c001bc0 con 0x7fc944071530 2024-09-12T02:45:20.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.292+0000 7fc94b400640 1 -- 172.21.15.112:0/1065691370 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc944071530 msgr2=0x7fc9440af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:20.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.292+0000 7fc94b400640 1 --2- 172.21.15.112:0/1065691370 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc944071530 0x7fc9440af720 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009790 tx=0x7fc92c02a080 comp rx=0 tx=0).stop 2024-09-12T02:45:20.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.293+0000 7fc94b400640 1 -- 172.21.15.112:0/1065691370 shutdown_connections 2024-09-12T02:45:20.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.293+0000 7fc94b400640 1 --2- 172.21.15.112:0/1065691370 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc944071530 0x7fc9440af720 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.293+0000 7fc94b400640 1 --2- 172.21.15.112:0/1065691370 >> v2:172.21.15.137:3300/0 conn(0x7fc94415cc50 0x7fc9440732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.293+0000 7fc94b400640 1 -- 172.21.15.112:0/1065691370 >> 172.21.15.112:0/1065691370 conn(0x7fc94406bbd0 msgr2=0x7fc94406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:20.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.293+0000 7fc94b400640 1 -- 172.21.15.112:0/1065691370 shutdown_connections 2024-09-12T02:45:20.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.293+0000 7fc94b400640 1 -- 172.21.15.112:0/1065691370 wait complete. 2024-09-12T02:45:20.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.294+0000 7fc94b400640 1 Processor -- start 2024-09-12T02:45:20.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.294+0000 7fc94b400640 1 -- start start 2024-09-12T02:45:20.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.295+0000 7fc94b400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc944071530 0x7fc9441f2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.295+0000 7fc94b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc944071970 0x7fc9441f84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.295+0000 7fc94b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc94415cc50 0x7fc9441f8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.295+0000 7fc94b400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc9440cf150 con 0x7fc944071970 2024-09-12T02:45:20.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.295+0000 7fc94b400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc94406e5e0 con 0x7fc94415cc50 2024-09-12T02:45:20.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.295+0000 7fc94b400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc94406f510 con 0x7fc944071530 2024-09-12T02:45:20.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.295+0000 7fc93be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc944071970 0x7fc9441f84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.295+0000 7fc93be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc944071970 0x7fc9441f84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48068/0 (socket says 172.21.15.112:48068) 2024-09-12T02:45:20.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.295+0000 7fc93be00640 1 -- 172.21.15.112:0/3309791885 learned_addr learned my addr 172.21.15.112:0/3309791885 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:20.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.296+0000 7fc948a00640 1 --2- 172.21.15.112:0/3309791885 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc944071530 0x7fc9441f2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.296+0000 7fc949400640 1 --2- 172.21.15.112:0/3309791885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc94415cc50 0x7fc9441f8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.296+0000 7fc93be00640 1 -- 172.21.15.112:0/3309791885 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc944071530 msgr2=0x7fc9441f2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:20.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.296+0000 7fc93be00640 1 --2- 172.21.15.112:0/3309791885 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc944071530 0x7fc9441f2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.296+0000 7fc93be00640 1 -- 172.21.15.112:0/3309791885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc94415cc50 msgr2=0x7fc9441f8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:20.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.296+0000 7fc93be00640 1 --2- 172.21.15.112:0/3309791885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc94415cc50 0x7fc9441f8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.296+0000 7fc93be00640 1 -- 172.21.15.112:0/3309791885 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc944146800 con 0x7fc944071970 2024-09-12T02:45:20.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.296+0000 7fc949400640 1 --2- 172.21.15.112:0/3309791885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc94415cc50 0x7fc9441f8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:45:20.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.296+0000 7fc93be00640 1 --2- 172.21.15.112:0/3309791885 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc944071970 0x7fc9441f84e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc92c02a670 tx=0x7fc92c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:20.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.296+0000 7fc941600640 1 -- 172.21.15.112:0/3309791885 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c037050 con 0x7fc944071970 2024-09-12T02:45:20.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.296+0000 7fc941600640 1 -- 172.21.15.112:0/3309791885 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc92c043070 con 0x7fc944071970 2024-09-12T02:45:20.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.296+0000 7fc94b400640 1 -- 172.21.15.112:0/3309791885 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9440b3b10 con 0x7fc944071970 2024-09-12T02:45:20.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.296+0000 7fc941600640 1 -- 172.21.15.112:0/3309791885 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c003c20 con 0x7fc944071970 2024-09-12T02:45:20.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.297+0000 7fc94b400640 1 -- 172.21.15.112:0/3309791885 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9440b40d0 con 0x7fc944071970 2024-09-12T02:45:20.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.298+0000 7fc94b400640 1 -- 172.21.15.112:0/3309791885 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc944068a30 con 0x7fc944071970 2024-09-12T02:45:20.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.299+0000 7fc941600640 1 -- 172.21.15.112:0/3309791885 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc92c048460 con 0x7fc944071970 2024-09-12T02:45:20.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.299+0000 7fc941600640 1 --2- 172.21.15.112:0/3309791885 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc92006be30 0x7fc92006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.300+0000 7fc941600640 1 -- 172.21.15.112:0/3309791885 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7fc92c0ab590 con 0x7fc944071970 2024-09-12T02:45:20.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.300+0000 7fc948a00640 1 --2- 172.21.15.112:0/3309791885 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc92006be30 0x7fc92006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.300+0000 7fc941600640 1 -- 172.21.15.112:0/3309791885 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=67}) -- 0x7fc920073960 con 0x7fc944071970 2024-09-12T02:45:20.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.300+0000 7fc948a00640 1 --2- 172.21.15.112:0/3309791885 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc92006be30 0x7fc92006e2f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc934009aa0 tx=0x7fc934009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:20.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.304+0000 7fc941600640 1 -- 172.21.15.112:0/3309791885 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc92c079f30 con 0x7fc944071970 2024-09-12T02:45:20.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.487+0000 7fc94b400640 1 -- 172.21.15.112:0/3309791885 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc94406df60 con 0x7fc944071970 2024-09-12T02:45:20.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.487+0000 7fc941600640 1 -- 172.21.15.112:0/3309791885 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v66) ==== 80+0+0 (secure 0 0 0) 0x7fc92c079830 con 0x7fc944071970 2024-09-12T02:45:20.489 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-12T02:45:20.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.489+0000 7fc94b400640 1 -- 172.21.15.112:0/3309791885 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc92006be30 msgr2=0x7fc92006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:20.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.489+0000 7fc94b400640 1 --2- 172.21.15.112:0/3309791885 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc92006be30 0x7fc92006e2f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc934009aa0 tx=0x7fc934009190 comp rx=0 tx=0).stop 2024-09-12T02:45:20.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.489+0000 7fc94b400640 1 -- 172.21.15.112:0/3309791885 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc944071970 msgr2=0x7fc9441f84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:20.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.489+0000 7fc94b400640 1 --2- 172.21.15.112:0/3309791885 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc944071970 0x7fc9441f84e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc92c02a670 tx=0x7fc92c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.490+0000 7fc94b400640 1 -- 172.21.15.112:0/3309791885 shutdown_connections 2024-09-12T02:45:20.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.490+0000 7fc94b400640 1 --2- 172.21.15.112:0/3309791885 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc92006be30 0x7fc92006e2f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.490+0000 7fc94b400640 1 --2- 172.21.15.112:0/3309791885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc94415cc50 0x7fc9441f8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.490+0000 7fc94b400640 1 --2- 172.21.15.112:0/3309791885 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc944071970 0x7fc9441f84e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.490+0000 7fc94b400640 1 --2- 172.21.15.112:0/3309791885 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc944071530 0x7fc9441f2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.490+0000 7fc94b400640 1 -- 172.21.15.112:0/3309791885 >> 172.21.15.112:0/3309791885 conn(0x7fc94406bbd0 msgr2=0x7fc94415b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:20.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.490+0000 7fc94b400640 1 -- 172.21.15.112:0/3309791885 shutdown_connections 2024-09-12T02:45:20.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.490+0000 7fc94b400640 1 -- 172.21.15.112:0/3309791885 wait complete. 2024-09-12T02:45:20.507 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:45:20.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:45:20.508 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T02:45:20.572 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-12T02:45:20.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:45:20.572 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:45:20.609 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:45:20.609 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:45:20.609 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:45:20.650 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:45:20.650 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:45:20.741 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:45:20.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.950+0000 7f1e9ea00640 1 Processor -- start 2024-09-12T02:45:20.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.950+0000 7f1e9ea00640 1 -- start start 2024-09-12T02:45:20.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.951+0000 7f1e9ea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e980b60c0 0x7f1e981631e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.951+0000 7f1e9ea00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e980b2c20 con 0x7f1e9815ee20 2024-09-12T02:45:20.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.951+0000 7f1e9ea00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e980b4240 con 0x7f1e980b3930 2024-09-12T02:45:20.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.951+0000 7f1e9ea00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1e98075a80 con 0x7f1e980b60c0 2024-09-12T02:45:20.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.951+0000 7f1e97e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f1e9815ee20 0x7f1e98162ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52152/0 (socket says 172.21.15.112:52152) 2024-09-12T02:45:20.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.951+0000 7f1e97e00640 1 -- 172.21.15.112:0/2493365354 learned_addr learned my addr 172.21.15.112:0/2493365354 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:45:20.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.951+0000 7f1e97400640 1 --2- 172.21.15.112:0/2493365354 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e980b60c0 0x7f1e981631e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.951+0000 7f1e96a00640 1 -- 172.21.15.112:0/2493365354 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2704263273 0 0) 0x7f1e980b2c20 con 0x7f1e9815ee20 2024-09-12T02:45:20.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.952+0000 7f1e96a00640 1 -- 172.21.15.112:0/2493365354 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e7c003520 con 0x7f1e9815ee20 2024-09-12T02:45:20.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.952+0000 7f1e96a00640 1 -- 172.21.15.112:0/2493365354 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 30911138 0 0) 0x7f1e980b4240 con 0x7f1e980b3930 2024-09-12T02:45:20.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.952+0000 7f1e96a00640 1 -- 172.21.15.112:0/2493365354 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e980b2c20 con 0x7f1e980b3930 2024-09-12T02:45:20.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.952+0000 7f1e97400640 1 -- 172.21.15.112:0/2493365354 >> v1:172.21.15.137:6789/0 conn(0x7f1e980b3930 legacy=0x7f1e98073240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:20.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.952+0000 7f1e97400640 1 -- 172.21.15.112:0/2493365354 >> v1:172.21.15.112:6789/0 conn(0x7f1e9815ee20 legacy=0x7f1e98162ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:20.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.952+0000 7f1e96a00640 1 -- 172.21.15.112:0/2493365354 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3392113687 0 0) 0x7f1e7c003520 con 0x7f1e9815ee20 2024-09-12T02:45:20.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.952+0000 7f1e97400640 1 -- 172.21.15.112:0/2493365354 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e980b2940 con 0x7f1e980b60c0 2024-09-12T02:45:20.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.953+0000 7f1e97400640 1 --2- 172.21.15.112:0/2493365354 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e980b60c0 0x7f1e981631e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1e840097d0 tx=0x7f1e8402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fa785b45fd96c64 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:20.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.953+0000 7f1e96a00640 1 -- 172.21.15.112:0/2493365354 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e84037070 con 0x7f1e980b60c0 2024-09-12T02:45:20.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.953+0000 7f1e96a00640 1 -- 172.21.15.112:0/2493365354 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e8402ab90 con 0x7f1e980b60c0 2024-09-12T02:45:20.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.953+0000 7f1e96a00640 1 -- 172.21.15.112:0/2493365354 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e88001670 con 0x7f1e980b60c0 2024-09-12T02:45:20.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.954+0000 7f1e9ea00640 1 -- 172.21.15.112:0/2493365354 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e980b60c0 msgr2=0x7f1e981631e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:20.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.954+0000 7f1e9ea00640 1 --2- 172.21.15.112:0/2493365354 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e980b60c0 0x7f1e981631e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1e840097d0 tx=0x7f1e8402a100 comp rx=0 tx=0).stop 2024-09-12T02:45:20.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.954+0000 7f1e9ea00640 1 -- 172.21.15.112:0/2493365354 shutdown_connections 2024-09-12T02:45:20.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.954+0000 7f1e9ea00640 1 --2- 172.21.15.112:0/2493365354 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e980b60c0 0x7f1e981631e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.954+0000 7f1e9ea00640 1 -- 172.21.15.112:0/2493365354 >> 172.21.15.112:0/2493365354 conn(0x7f1e980b2e10 msgr2=0x7f1e980b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:20.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.954+0000 7f1e9ea00640 1 -- 172.21.15.112:0/2493365354 shutdown_connections 2024-09-12T02:45:20.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.954+0000 7f1e9ea00640 1 -- 172.21.15.112:0/2493365354 wait complete. 2024-09-12T02:45:20.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.955+0000 7f1e9ea00640 1 Processor -- start 2024-09-12T02:45:20.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.956+0000 7f1e9ea00640 1 -- start start 2024-09-12T02:45:20.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.956+0000 7f1e9ea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e980b3930 0x7f1e9814d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.956+0000 7f1e9ea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e980b60c0 0x7f1e98161de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.956+0000 7f1e9ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e9815ee20 0x7f1e98162320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.956+0000 7f1e9ea00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9815f200 con 0x7f1e9815ee20 2024-09-12T02:45:20.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.956+0000 7f1e9ea00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1e980b5b30 con 0x7f1e980b3930 2024-09-12T02:45:20.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.956+0000 7f1e9ea00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1e9815f380 con 0x7f1e980b60c0 2024-09-12T02:45:20.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.957+0000 7f1e9ca00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e9815ee20 0x7f1e98162320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.957+0000 7f1e9ca00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e9815ee20 0x7f1e98162320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48070/0 (socket says 172.21.15.112:48070) 2024-09-12T02:45:20.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.957+0000 7f1e97400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e980b60c0 0x7f1e98161de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.957+0000 7f1e97e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e980b3930 0x7f1e9814d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.957+0000 7f1e9ca00640 1 -- 172.21.15.112:0/1319114388 learned_addr learned my addr 172.21.15.112:0/1319114388 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:20.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.957+0000 7f1e9ca00640 1 -- 172.21.15.112:0/1319114388 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e980b60c0 msgr2=0x7f1e98161de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:20.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.957+0000 7f1e9ca00640 1 --2- 172.21.15.112:0/1319114388 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e980b60c0 0x7f1e98161de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.957+0000 7f1e9ca00640 1 -- 172.21.15.112:0/1319114388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e980b3930 msgr2=0x7f1e9814d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:20.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.957+0000 7f1e9ca00640 1 --2- 172.21.15.112:0/1319114388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e980b3930 0x7f1e9814d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.957+0000 7f1e9ca00640 1 -- 172.21.15.112:0/1319114388 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e981f4e90 con 0x7f1e9815ee20 2024-09-12T02:45:20.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.957+0000 7f1e9ca00640 1 --2- 172.21.15.112:0/1319114388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e9815ee20 0x7f1e98162320 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1e9000c7d0 tx=0x7f1e9000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:20.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.958+0000 7f1e8fe00640 1 -- 172.21.15.112:0/1319114388 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e90003b70 con 0x7f1e9815ee20 2024-09-12T02:45:20.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.958+0000 7f1e8fe00640 1 -- 172.21.15.112:0/1319114388 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e90003d10 con 0x7f1e9815ee20 2024-09-12T02:45:20.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.958+0000 7f1e8fe00640 1 -- 172.21.15.112:0/1319114388 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9000aa90 con 0x7f1e9815ee20 2024-09-12T02:45:20.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.958+0000 7f1e9ea00640 1 -- 172.21.15.112:0/1319114388 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e981f5100 con 0x7f1e9815ee20 2024-09-12T02:45:20.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.958+0000 7f1e9ea00640 1 -- 172.21.15.112:0/1319114388 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e980ce870 con 0x7f1e9815ee20 2024-09-12T02:45:20.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.959+0000 7f1e9ea00640 1 -- 172.21.15.112:0/1319114388 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e98162860 con 0x7f1e9815ee20 2024-09-12T02:45:20.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.960+0000 7f1e8fe00640 1 -- 172.21.15.112:0/1319114388 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1e9000ac30 con 0x7f1e9815ee20 2024-09-12T02:45:20.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.960+0000 7f1e8fe00640 1 --2- 172.21.15.112:0/1319114388 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1e7806be80 0x7f1e7806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.961+0000 7f1e8fe00640 1 -- 172.21.15.112:0/1319114388 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7f1e9008ad00 con 0x7f1e9815ee20 2024-09-12T02:45:20.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.961+0000 7f1e97e00640 1 --2- 172.21.15.112:0/1319114388 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1e7806be80 0x7f1e7806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.961+0000 7f1e8fe00640 1 -- 172.21.15.112:0/1319114388 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=67}) -- 0x7f1e780739b0 con 0x7f1e9815ee20 2024-09-12T02:45:20.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.961+0000 7f1e97e00640 1 --2- 172.21.15.112:0/1319114388 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1e7806be80 0x7f1e7806e340 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1e880017e0 tx=0x7f1e88001610 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:20.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:20.965+0000 7f1e8fe00640 1 -- 172.21.15.112:0/1319114388 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1e90058fb0 con 0x7f1e9815ee20 2024-09-12T02:45:21.118 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:45:21.123 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:45:21.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.152+0000 7f1e9ea00640 1 -- 172.21.15.112:0/1319114388 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1e98162ad0 con 0x7f1e9815ee20 2024-09-12T02:45:21.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.152+0000 7f1e8fe00640 1 -- 172.21.15.112:0/1319114388 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v66) ==== 80+0+0 (secure 0 0 0) 0x7f1e9005d2b0 con 0x7f1e9815ee20 2024-09-12T02:45:21.153 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-12T02:45:21.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.154+0000 7f1e9ea00640 1 -- 172.21.15.112:0/1319114388 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1e7806be80 msgr2=0x7f1e7806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:21.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.154+0000 7f1e9ea00640 1 --2- 172.21.15.112:0/1319114388 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1e7806be80 0x7f1e7806e340 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1e880017e0 tx=0x7f1e88001610 comp rx=0 tx=0).stop 2024-09-12T02:45:21.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.154+0000 7f1e9ea00640 1 -- 172.21.15.112:0/1319114388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e9815ee20 msgr2=0x7f1e98162320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:21.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.154+0000 7f1e9ea00640 1 --2- 172.21.15.112:0/1319114388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e9815ee20 0x7f1e98162320 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1e9000c7d0 tx=0x7f1e9000cc90 comp rx=0 tx=0).stop 2024-09-12T02:45:21.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.155+0000 7f1e9ea00640 1 -- 172.21.15.112:0/1319114388 shutdown_connections 2024-09-12T02:45:21.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.155+0000 7f1e9ea00640 1 --2- 172.21.15.112:0/1319114388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e9815ee20 0x7f1e98162320 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:21.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.155+0000 7f1e9ea00640 1 --2- 172.21.15.112:0/1319114388 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e980b60c0 0x7f1e98161de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:21.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.155+0000 7f1e9ea00640 1 --2- 172.21.15.112:0/1319114388 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1e7806be80 0x7f1e7806e340 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:21.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.155+0000 7f1e9ea00640 1 --2- 172.21.15.112:0/1319114388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e980b3930 0x7f1e9814d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:21.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.155+0000 7f1e9ea00640 1 -- 172.21.15.112:0/1319114388 >> 172.21.15.112:0/1319114388 conn(0x7f1e980b2e10 msgr2=0x7f1e9806f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:21.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.155+0000 7f1e9ea00640 1 -- 172.21.15.112:0/1319114388 shutdown_connections 2024-09-12T02:45:21.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.155+0000 7f1e9ea00640 1 -- 172.21.15.112:0/1319114388 wait complete. 2024-09-12T02:45:21.171 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-12T02:45:21.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:45:21.172 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-12T02:45:21.233 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T02:45:21.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:45:21.233 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T02:45:21.269 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:45:21.269 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:45:21.269 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:45:21.305 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:45:21.305 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:45:21.305 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:45:21.305 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:45:21.357 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:45:21.357 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:45:21.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.508+0000 7f2501800640 1 Processor -- start 2024-09-12T02:45:21.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.508+0000 7f2501800640 1 -- start start 2024-09-12T02:45:21.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.509+0000 7f2501800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24fc071530 0x7f24fc0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:21.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.509+0000 7f2501800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f24fc071970 0x7f24fc0afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:21.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.509+0000 7f2501800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24fc0ceeb0 con 0x7f24fc15cc50 2024-09-12T02:45:21.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.510+0000 7f2501800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f24fc15d030 con 0x7f24fc071970 2024-09-12T02:45:21.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.510+0000 7f2501800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f24fc0cf4c0 con 0x7f24fc071530 2024-09-12T02:45:21.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.510+0000 7f24fb400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f24fc071970 0x7f24fc0afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:21.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.510+0000 7f24faa00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f24fc15cc50 0x7f24fc0732f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52168/0 (socket says 172.21.15.112:52168) 2024-09-12T02:45:21.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.510+0000 7f24faa00640 1 -- 172.21.15.112:0/1828884047 learned_addr learned my addr 172.21.15.112:0/1828884047 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:45:21.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.510+0000 7f24f2000640 1 --2- 172.21.15.112:0/1828884047 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24fc071530 0x7f24fc0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:21.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.510+0000 7f24fb400640 1 -- 172.21.15.112:0/1828884047 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24fc071530 msgr2=0x7f24fc0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:21.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.510+0000 7f24fb400640 1 --2- 172.21.15.112:0/1828884047 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24fc071530 0x7f24fc0af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:21.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.510+0000 7f24fb400640 1 -- 172.21.15.112:0/1828884047 >> v1:172.21.15.112:6789/0 conn(0x7f24fc15cc50 legacy=0x7f24fc0732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:21.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.510+0000 7f24fb400640 1 -- 172.21.15.112:0/1828884047 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24fc06e300 con 0x7f24fc071970 2024-09-12T02:45:21.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.510+0000 7f24fa000640 1 -- 172.21.15.112:0/1828884047 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2700419840 0 0) 0x7f24fc0ceeb0 con 0x7f24fc15cc50 2024-09-12T02:45:21.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.511+0000 7f24fb400640 1 --2- 172.21.15.112:0/1828884047 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24fc071970 0x7f24fc0afc60 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009d90 tx=0x7f24f402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de1be43e79f9506 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:21.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.511+0000 7f24fa000640 1 -- 172.21.15.112:0/1828884047 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f4031600 con 0x7f24fc071970 2024-09-12T02:45:21.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.511+0000 7f24fa000640 1 -- 172.21.15.112:0/1828884047 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f40317a0 con 0x7f24fc071970 2024-09-12T02:45:21.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.511+0000 7f24fa000640 1 -- 172.21.15.112:0/1828884047 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f4031b70 con 0x7f24fc071970 2024-09-12T02:45:21.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.512+0000 7f2501800640 1 -- 172.21.15.112:0/1828884047 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24fc071970 msgr2=0x7f24fc0afc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:21.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.512+0000 7f2501800640 1 --2- 172.21.15.112:0/1828884047 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24fc071970 0x7f24fc0afc60 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009d90 tx=0x7f24f402a5d0 comp rx=0 tx=0).stop 2024-09-12T02:45:21.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.512+0000 7f2501800640 1 -- 172.21.15.112:0/1828884047 shutdown_connections 2024-09-12T02:45:21.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.512+0000 7f2501800640 1 --2- 172.21.15.112:0/1828884047 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24fc071970 0x7f24fc0afc60 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:21.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.512+0000 7f2501800640 1 --2- 172.21.15.112:0/1828884047 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24fc071530 0x7f24fc0af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:21.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.512+0000 7f2501800640 1 -- 172.21.15.112:0/1828884047 >> 172.21.15.112:0/1828884047 conn(0x7f24fc06bbd0 msgr2=0x7f24fc06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:21.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.512+0000 7f2501800640 1 -- 172.21.15.112:0/1828884047 shutdown_connections 2024-09-12T02:45:21.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.512+0000 7f2501800640 1 -- 172.21.15.112:0/1828884047 wait complete. 2024-09-12T02:45:21.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.514+0000 7f2501800640 1 Processor -- start 2024-09-12T02:45:21.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.514+0000 7f2501800640 1 -- start start 2024-09-12T02:45:21.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.515+0000 7f2501800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24fc071530 0x7f24fc0af160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:21.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.515+0000 7f2501800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24fc071970 0x7f24fc159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:21.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.515+0000 7f2501800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24fc15cc50 0x7f24fc14f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:21.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.515+0000 7f2501800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f24fc06f510 con 0x7f24fc071970 2024-09-12T02:45:21.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.515+0000 7f2501800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f24fc0cf150 con 0x7f24fc15cc50 2024-09-12T02:45:21.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.515+0000 7f2501800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f24fc06f690 con 0x7f24fc071530 2024-09-12T02:45:21.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.515+0000 7f24f2000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24fc071970 0x7f24fc159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:21.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.515+0000 7f24f2000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24fc071970 0x7f24fc159d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48074/0 (socket says 172.21.15.112:48074) 2024-09-12T02:45:21.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.515+0000 7f24f2000640 1 -- 172.21.15.112:0/551283662 learned_addr learned my addr 172.21.15.112:0/551283662 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:21.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.515+0000 7f24faa00640 1 --2- 172.21.15.112:0/551283662 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24fc071530 0x7f24fc0af160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:21.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.515+0000 7f24fb400640 1 --2- 172.21.15.112:0/551283662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24fc15cc50 0x7f24fc14f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:21.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.516+0000 7f24f2000640 1 -- 172.21.15.112:0/551283662 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24fc071530 msgr2=0x7f24fc0af160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:21.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.516+0000 7f24f2000640 1 --2- 172.21.15.112:0/551283662 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24fc071530 0x7f24fc0af160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:21.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.516+0000 7f24f2000640 1 -- 172.21.15.112:0/551283662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24fc15cc50 msgr2=0x7f24fc14f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:21.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.516+0000 7f24f2000640 1 --2- 172.21.15.112:0/551283662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24fc15cc50 0x7f24fc14f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:21.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.516+0000 7f24f2000640 1 -- 172.21.15.112:0/551283662 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24fc14f970 con 0x7f24fc071970 2024-09-12T02:45:21.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.516+0000 7f24f2000640 1 --2- 172.21.15.112:0/551283662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24fc071970 0x7f24fc159d80 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f24e400d7d0 tx=0x7f24e400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:21.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.516+0000 7f24f3400640 1 -- 172.21.15.112:0/551283662 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e4004020 con 0x7f24fc071970 2024-09-12T02:45:21.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.516+0000 7f24f3400640 1 -- 172.21.15.112:0/551283662 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e40041c0 con 0x7f24fc071970 2024-09-12T02:45:21.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.516+0000 7f24f3400640 1 -- 172.21.15.112:0/551283662 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e40043b0 con 0x7f24fc071970 2024-09-12T02:45:21.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.516+0000 7f2501800640 1 -- 172.21.15.112:0/551283662 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24fc158fc0 con 0x7f24fc071970 2024-09-12T02:45:21.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.516+0000 7f2501800640 1 -- 172.21.15.112:0/551283662 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24fc159580 con 0x7f24fc071970 2024-09-12T02:45:21.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.517+0000 7f2501800640 1 -- 172.21.15.112:0/551283662 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24fc068a30 con 0x7f24fc071970 2024-09-12T02:45:21.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.518+0000 7f24f3400640 1 -- 172.21.15.112:0/551283662 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f24e401b020 con 0x7f24fc071970 2024-09-12T02:45:21.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.519+0000 7f24f3400640 1 --2- 172.21.15.112:0/551283662 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f24d806be30 0x7f24d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:21.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.519+0000 7f24f3400640 1 -- 172.21.15.112:0/551283662 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7f24e408a990 con 0x7f24fc071970 2024-09-12T02:45:21.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.519+0000 7f24f3400640 1 -- 172.21.15.112:0/551283662 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=67}) -- 0x7f24d8073960 con 0x7f24fc071970 2024-09-12T02:45:21.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.519+0000 7f24faa00640 1 --2- 172.21.15.112:0/551283662 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f24d806be30 0x7f24d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:21.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.520+0000 7f24faa00640 1 --2- 172.21.15.112:0/551283662 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f24d806be30 0x7f24d806e2f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f24ec007fd0 tx=0x7f24ec007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:21.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.524+0000 7f24f3400640 1 -- 172.21.15.112:0/551283662 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f24e4022020 con 0x7f24fc071970 2024-09-12T02:45:21.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.728+0000 7f2501800640 1 -- 172.21.15.112:0/551283662 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24fc06df60 con 0x7f24fc071970 2024-09-12T02:45:21.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.729+0000 7f24f3400640 1 -- 172.21.15.112:0/551283662 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5235 (secure 0 0 0) 0x7f24e4058c50 con 0x7f24fc071970 2024-09-12T02:45:21.730 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:45:21.730 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":36,"btime":"2024-09-12T02:44:10:654160+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4997,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1412930245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1412930245},{"type":"v1","addr":"172.21.15.137:6834","nonce":1412930245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5299,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1045746375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1045746375},{"type":"v1","addr":"172.21.15.112:6837","nonce":1045746375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5305,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1625140900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1625140900},{"type":"v1","addr":"172.21.15.137:6835","nonce":1625140900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:44:07.016881+0000","modified":"2024-09-12T02:44:10.058498+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5508":{"gid":5508,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/3039296510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3039296510},{"type":"v1","addr":"172.21.15.112:6835","nonce":3039296510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5508,"qdb_cluster":[5508]},"id":4}]} 2024-09-12T02:45:21.730 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 36 2024-09-12T02:45:21.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.731+0000 7f2501800640 1 -- 172.21.15.112:0/551283662 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f24d806be30 msgr2=0x7f24d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:21.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.731+0000 7f2501800640 1 --2- 172.21.15.112:0/551283662 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f24d806be30 0x7f24d806e2f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f24ec007fd0 tx=0x7f24ec007de0 comp rx=0 tx=0).stop 2024-09-12T02:45:21.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.731+0000 7f2501800640 1 -- 172.21.15.112:0/551283662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24fc071970 msgr2=0x7f24fc159d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:21.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.731+0000 7f2501800640 1 --2- 172.21.15.112:0/551283662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24fc071970 0x7f24fc159d80 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f24e400d7d0 tx=0x7f24e400dc90 comp rx=0 tx=0).stop 2024-09-12T02:45:21.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.731+0000 7f2501800640 1 -- 172.21.15.112:0/551283662 shutdown_connections 2024-09-12T02:45:21.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.731+0000 7f2501800640 1 --2- 172.21.15.112:0/551283662 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f24d806be30 0x7f24d806e2f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:21.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.731+0000 7f2501800640 1 --2- 172.21.15.112:0/551283662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24fc15cc50 0x7f24fc14f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:21.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.731+0000 7f2501800640 1 --2- 172.21.15.112:0/551283662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24fc071970 0x7f24fc159d80 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:21.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.731+0000 7f2501800640 1 --2- 172.21.15.112:0/551283662 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24fc071530 0x7f24fc0af160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:21.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.731+0000 7f2501800640 1 -- 172.21.15.112:0/551283662 >> 172.21.15.112:0/551283662 conn(0x7f24fc06bbd0 msgr2=0x7f24fc0b39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:21.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.731+0000 7f2501800640 1 -- 172.21.15.112:0/551283662 shutdown_connections 2024-09-12T02:45:21.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.731+0000 7f2501800640 1 -- 172.21.15.112:0/551283662 wait complete. 2024-09-12T02:45:21.747 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:45:21.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.898+0000 7f2e36000640 1 Processor -- start 2024-09-12T02:45:21.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.898+0000 7f2e36000640 1 -- start start 2024-09-12T02:45:21.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.899+0000 7f2e36000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e3006f600 0x7f2e300b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:21.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.899+0000 7f2e36000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2e300b45d0 0x7f2e300728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:21.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.899+0000 7f2e36000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e300b4a20 con 0x7f2e3015b9d0 2024-09-12T02:45:21.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.899+0000 7f2e36000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2e300b54a0 con 0x7f2e300b45d0 2024-09-12T02:45:21.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.899+0000 7f2e36000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2e300b3af0 con 0x7f2e3006f600 2024-09-12T02:45:21.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.899+0000 7f2e2f400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2e3015b9d0 0x7f2e3006eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55672/0 (socket says 172.21.15.112:55672) 2024-09-12T02:45:21.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.899+0000 7f2e2f400640 1 -- 172.21.15.112:0/822943071 learned_addr learned my addr 172.21.15.112:0/822943071 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:45:21.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.900+0000 7f2e26a00640 1 --2- 172.21.15.112:0/822943071 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e3006f600 0x7f2e300b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:21.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.900+0000 7f2e2fe00640 1 --2- 172.21.15.112:0/822943071 >> v2:172.21.15.137:3300/0 conn(0x7f2e300b45d0 0x7f2e300728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:21.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.900+0000 7f2e2ea00640 1 -- 172.21.15.112:0/822943071 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1814543705 0 0) 0x7f2e300b4a20 con 0x7f2e3015b9d0 2024-09-12T02:45:21.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.900+0000 7f2e2ea00640 1 -- 172.21.15.112:0/822943071 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e14003520 con 0x7f2e3015b9d0 2024-09-12T02:45:21.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.900+0000 7f2e26a00640 1 -- 172.21.15.112:0/822943071 >> v2:172.21.15.137:3300/0 conn(0x7f2e300b45d0 msgr2=0x7f2e300728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:21.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.900+0000 7f2e26a00640 1 --2- 172.21.15.112:0/822943071 >> v2:172.21.15.137:3300/0 conn(0x7f2e300b45d0 0x7f2e300728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:21.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.900+0000 7f2e26a00640 1 -- 172.21.15.112:0/822943071 >> v1:172.21.15.112:6789/0 conn(0x7f2e3015b9d0 legacy=0x7f2e3006eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:21.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.900+0000 7f2e26a00640 1 -- 172.21.15.112:0/822943071 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e300b3dd0 con 0x7f2e3006f600 2024-09-12T02:45:21.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.901+0000 7f2e26a00640 1 --2- 172.21.15.112:0/822943071 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e3006f600 0x7f2e300b4ec0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2e18009790 tx=0x7f2e1802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc102bebe329653 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:21.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.901+0000 7f2e2ea00640 1 -- 172.21.15.112:0/822943071 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e18037070 con 0x7f2e3006f600 2024-09-12T02:45:21.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.901+0000 7f2e2ea00640 1 -- 172.21.15.112:0/822943071 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e18032440 con 0x7f2e3006f600 2024-09-12T02:45:21.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.901+0000 7f2e2ea00640 1 -- 172.21.15.112:0/822943071 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e18032810 con 0x7f2e3006f600 2024-09-12T02:45:21.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.902+0000 7f2e36000640 1 -- 172.21.15.112:0/822943071 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e3006f600 msgr2=0x7f2e300b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:21.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.902+0000 7f2e36000640 1 --2- 172.21.15.112:0/822943071 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e3006f600 0x7f2e300b4ec0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2e18009790 tx=0x7f2e1802a180 comp rx=0 tx=0).stop 2024-09-12T02:45:21.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.902+0000 7f2e36000640 1 -- 172.21.15.112:0/822943071 shutdown_connections 2024-09-12T02:45:21.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.902+0000 7f2e36000640 1 --2- 172.21.15.112:0/822943071 >> v2:172.21.15.137:3300/0 conn(0x7f2e300b45d0 0x7f2e300728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:21.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.902+0000 7f2e36000640 1 --2- 172.21.15.112:0/822943071 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e3006f600 0x7f2e300b4ec0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:21.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.902+0000 7f2e36000640 1 -- 172.21.15.112:0/822943071 >> 172.21.15.112:0/822943071 conn(0x7f2e3006bbd0 msgr2=0x7f2e3006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:21.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.902+0000 7f2e36000640 1 -- 172.21.15.112:0/822943071 shutdown_connections 2024-09-12T02:45:21.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.902+0000 7f2e36000640 1 -- 172.21.15.112:0/822943071 wait complete. 2024-09-12T02:45:21.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.904+0000 7f2e36000640 1 Processor -- start 2024-09-12T02:45:21.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.904+0000 7f2e36000640 1 -- start start 2024-09-12T02:45:21.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.905+0000 7f2e36000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e3006f600 0x7f2e3014f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:21.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.905+0000 7f2e36000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e300b45d0 0x7f2e30151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:21.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.905+0000 7f2e36000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e3015b9d0 0x7f2e300b0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:21.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.905+0000 7f2e36000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3015bf30 con 0x7f2e3015b9d0 2024-09-12T02:45:21.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.905+0000 7f2e36000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3015bdb0 con 0x7f2e3006f600 2024-09-12T02:45:21.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.905+0000 7f2e36000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2e300cdcd0 con 0x7f2e300b45d0 2024-09-12T02:45:21.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.905+0000 7f2e2fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e3015b9d0 0x7f2e300b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:21.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.905+0000 7f2e2fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e3015b9d0 0x7f2e300b0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56528/0 (socket says 172.21.15.112:56528) 2024-09-12T02:45:21.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.905+0000 7f2e2f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e3006f600 0x7f2e3014f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:21.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.905+0000 7f2e26a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e300b45d0 0x7f2e30151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:21.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.905+0000 7f2e2fe00640 1 -- 172.21.15.112:0/47003804 learned_addr learned my addr 172.21.15.112:0/47003804 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:21.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.905+0000 7f2e2fe00640 1 -- 172.21.15.112:0/47003804 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e300b45d0 msgr2=0x7f2e30151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:21.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.905+0000 7f2e2fe00640 1 --2- 172.21.15.112:0/47003804 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e300b45d0 0x7f2e30151940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:21.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.905+0000 7f2e2fe00640 1 -- 172.21.15.112:0/47003804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e3006f600 msgr2=0x7f2e3014f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:21.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.905+0000 7f2e2fe00640 1 --2- 172.21.15.112:0/47003804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e3006f600 0x7f2e3014f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:21.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.905+0000 7f2e2fe00640 1 -- 172.21.15.112:0/47003804 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e30152a70 con 0x7f2e3015b9d0 2024-09-12T02:45:21.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.906+0000 7f2e2fe00640 1 --2- 172.21.15.112:0/47003804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e3015b9d0 0x7f2e300b0550 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800e930 tx=0x7f2e2800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:21.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.906+0000 7f2e27e00640 1 -- 172.21.15.112:0/47003804 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e28017070 con 0x7f2e3015b9d0 2024-09-12T02:45:21.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.906+0000 7f2e27e00640 1 -- 172.21.15.112:0/47003804 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e2800c980 con 0x7f2e3015b9d0 2024-09-12T02:45:21.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.906+0000 7f2e27e00640 1 -- 172.21.15.112:0/47003804 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2800cd70 con 0x7f2e3015b9d0 2024-09-12T02:45:21.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.906+0000 7f2e36000640 1 -- 172.21.15.112:0/47003804 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e300af4f0 con 0x7f2e3015b9d0 2024-09-12T02:45:21.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.906+0000 7f2e36000640 1 -- 172.21.15.112:0/47003804 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e3015db90 con 0x7f2e3015b9d0 2024-09-12T02:45:21.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.907+0000 7f2e36000640 1 -- 172.21.15.112:0/47003804 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e30068a30 con 0x7f2e3015b9d0 2024-09-12T02:45:21.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.908+0000 7f2e27e00640 1 -- 172.21.15.112:0/47003804 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e2801a070 con 0x7f2e3015b9d0 2024-09-12T02:45:21.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.909+0000 7f2e27e00640 1 --2- 172.21.15.112:0/47003804 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2e0c06be30 0x7f2e0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:21.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.909+0000 7f2e27e00640 1 -- 172.21.15.112:0/47003804 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7f2e2808b1e0 con 0x7f2e3015b9d0 2024-09-12T02:45:21.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.909+0000 7f2e2f400640 1 --2- 172.21.15.112:0/47003804 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2e0c06be30 0x7f2e0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:21.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.909+0000 7f2e27e00640 1 -- 172.21.15.112:0/47003804 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=67}) -- 0x7f2e0c073960 con 0x7f2e3015b9d0 2024-09-12T02:45:21.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.910+0000 7f2e2f400640 1 --2- 172.21.15.112:0/47003804 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2e0c06be30 0x7f2e0c06e2f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2e20005c00 tx=0x7f2e20009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:21.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:21.913+0000 7f2e27e00640 1 -- 172.21.15.112:0/47003804 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e28059560 con 0x7f2e3015b9d0 2024-09-12T02:45:22.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.120+0000 7f2e36000640 1 -- 172.21.15.112:0/47003804 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e3006dbc0 con 0x7f2e3015b9d0 2024-09-12T02:45:22.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.120+0000 7f2e27e00640 1 -- 172.21.15.112:0/47003804 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5235 (secure 0 0 0) 0x7f2e2805d860 con 0x7f2e3015b9d0 2024-09-12T02:45:22.178 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:45:22.178 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":36,"btime":"2024-09-12T02:44:10:654160+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4997,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1412930245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1412930245},{"type":"v1","addr":"172.21.15.137:6834","nonce":1412930245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5299,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1045746375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1045746375},{"type":"v1","addr":"172.21.15.112:6837","nonce":1045746375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5305,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1625140900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1625140900},{"type":"v1","addr":"172.21.15.137:6835","nonce":1625140900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:44:07.016881+0000","modified":"2024-09-12T02:44:10.058498+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5508":{"gid":5508,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/3039296510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3039296510},{"type":"v1","addr":"172.21.15.112:6835","nonce":3039296510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5508,"qdb_cluster":[5508]},"id":4}]} 2024-09-12T02:45:22.180 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 36 2024-09-12T02:45:22.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.123+0000 7f2e36000640 1 -- 172.21.15.112:0/47003804 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2e0c06be30 msgr2=0x7f2e0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:22.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.123+0000 7f2e36000640 1 --2- 172.21.15.112:0/47003804 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2e0c06be30 0x7f2e0c06e2f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2e20005c00 tx=0x7f2e20009040 comp rx=0 tx=0).stop 2024-09-12T02:45:22.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.123+0000 7f2e36000640 1 -- 172.21.15.112:0/47003804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e3015b9d0 msgr2=0x7f2e300b0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:22.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.123+0000 7f2e36000640 1 --2- 172.21.15.112:0/47003804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e3015b9d0 0x7f2e300b0550 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800e930 tx=0x7f2e2800edf0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.123+0000 7f2e36000640 1 -- 172.21.15.112:0/47003804 shutdown_connections 2024-09-12T02:45:22.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.123+0000 7f2e36000640 1 --2- 172.21.15.112:0/47003804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e3015b9d0 0x7f2e300b0550 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.123+0000 7f2e36000640 1 --2- 172.21.15.112:0/47003804 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e300b45d0 0x7f2e30151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.123+0000 7f2e36000640 1 --2- 172.21.15.112:0/47003804 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2e0c06be30 0x7f2e0c06e2f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.123+0000 7f2e36000640 1 --2- 172.21.15.112:0/47003804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e3006f600 0x7f2e3014f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.123+0000 7f2e36000640 1 -- 172.21.15.112:0/47003804 >> 172.21.15.112:0/47003804 conn(0x7f2e3006bbd0 msgr2=0x7f2e300ceb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:22.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.123+0000 7f2e36000640 1 -- 172.21.15.112:0/47003804 shutdown_connections 2024-09-12T02:45:22.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.123+0000 7f2e36000640 1 -- 172.21.15.112:0/47003804 wait complete. 2024-09-12T02:45:22.181 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:45:22.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.333+0000 7fe130600640 1 Processor -- start 2024-09-12T02:45:22.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.333+0000 7fe130600640 1 -- start start 2024-09-12T02:45:22.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.334+0000 7fe130600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe12815cc50 0x7fe1280732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:22.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.334+0000 7fe130600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe1280afe30 0x7fe1280cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:22.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.334+0000 7fe130600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe128073830 con 0x7fe128071530 2024-09-12T02:45:22.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.334+0000 7fe130600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe12815d030 con 0x7fe1280afe30 2024-09-12T02:45:22.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.334+0000 7fe130600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe1280cf4c0 con 0x7fe12815cc50 2024-09-12T02:45:22.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.334+0000 7fe12e600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe1280afe30 0x7fe1280cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:22.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.335+0000 7fe12e600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe1280afe30 0x7fe1280cf950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56542/0 (socket says 172.21.15.112:56542) 2024-09-12T02:45:22.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.335+0000 7fe12e600640 1 -- 172.21.15.112:0/3013775325 learned_addr learned my addr 172.21.15.112:0/3013775325 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:22.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.335+0000 7fe12dc00640 1 --2- 172.21.15.112:0/3013775325 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe12815cc50 0x7fe1280732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:22.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.335+0000 7fe12e600640 1 -- 172.21.15.112:0/3013775325 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe12815cc50 msgr2=0x7fe1280732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:22.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.335+0000 7fe12e600640 1 --2- 172.21.15.112:0/3013775325 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe12815cc50 0x7fe1280732f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.335+0000 7fe12e600640 1 -- 172.21.15.112:0/3013775325 >> v1:172.21.15.137:6789/0 conn(0x7fe128071530 legacy=0x7fe1280af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:22.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.335+0000 7fe12e600640 1 -- 172.21.15.112:0/3013775325 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1280ceeb0 con 0x7fe1280afe30 2024-09-12T02:45:22.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.336+0000 7fe12e600640 1 --2- 172.21.15.112:0/3013775325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1280afe30 0x7fe1280cf950 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe120009e80 tx=0x7fe12002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f5df3c7650cfe4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:22.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.336+0000 7fe127e00640 1 -- 172.21.15.112:0/3013775325 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe120036070 con 0x7fe1280afe30 2024-09-12T02:45:22.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.336+0000 7fe127e00640 1 -- 172.21.15.112:0/3013775325 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe120031600 con 0x7fe1280afe30 2024-09-12T02:45:22.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.336+0000 7fe127e00640 1 -- 172.21.15.112:0/3013775325 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1200319d0 con 0x7fe1280afe30 2024-09-12T02:45:22.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.337+0000 7fe130600640 1 -- 172.21.15.112:0/3013775325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1280afe30 msgr2=0x7fe1280cf950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:22.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.337+0000 7fe130600640 1 --2- 172.21.15.112:0/3013775325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1280afe30 0x7fe1280cf950 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe120009e80 tx=0x7fe12002a660 comp rx=0 tx=0).stop 2024-09-12T02:45:22.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.337+0000 7fe130600640 1 -- 172.21.15.112:0/3013775325 shutdown_connections 2024-09-12T02:45:22.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.337+0000 7fe130600640 1 --2- 172.21.15.112:0/3013775325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1280afe30 0x7fe1280cf950 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.337+0000 7fe130600640 1 --2- 172.21.15.112:0/3013775325 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe12815cc50 0x7fe1280732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.337+0000 7fe130600640 1 -- 172.21.15.112:0/3013775325 >> 172.21.15.112:0/3013775325 conn(0x7fe12806bbd0 msgr2=0x7fe12806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:22.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.337+0000 7fe130600640 1 -- 172.21.15.112:0/3013775325 shutdown_connections 2024-09-12T02:45:22.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.337+0000 7fe130600640 1 -- 172.21.15.112:0/3013775325 wait complete. 2024-09-12T02:45:22.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.338+0000 7fe130600640 1 Processor -- start 2024-09-12T02:45:22.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.339+0000 7fe130600640 1 -- start start 2024-09-12T02:45:22.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.339+0000 7fe130600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe128071530 0x7fe1281f4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:22.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.339+0000 7fe130600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe1280afe30 0x7fe128140050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:22.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.339+0000 7fe130600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe12815cc50 0x7fe1281519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:22.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.339+0000 7fe130600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe1280cf150 con 0x7fe12815cc50 2024-09-12T02:45:22.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.339+0000 7fe130600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe12806e5e0 con 0x7fe1280afe30 2024-09-12T02:45:22.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.339+0000 7fe130600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe12806f510 con 0x7fe128071530 2024-09-12T02:45:22.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.340+0000 7fe12e600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe12815cc50 0x7fe1281519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:22.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.340+0000 7fe12e600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe12815cc50 0x7fe1281519e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56558/0 (socket says 172.21.15.112:56558) 2024-09-12T02:45:22.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.340+0000 7fe12e600640 1 -- 172.21.15.112:0/2487661027 learned_addr learned my addr 172.21.15.112:0/2487661027 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:22.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.340+0000 7fe12dc00640 1 --2- 172.21.15.112:0/2487661027 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe128071530 0x7fe1281f4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:22.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.340+0000 7fe12d200640 1 --2- 172.21.15.112:0/2487661027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe1280afe30 0x7fe128140050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:22.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.340+0000 7fe12e600640 1 -- 172.21.15.112:0/2487661027 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe128071530 msgr2=0x7fe1281f4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:22.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.340+0000 7fe12e600640 1 --2- 172.21.15.112:0/2487661027 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe128071530 0x7fe1281f4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.340+0000 7fe12e600640 1 -- 172.21.15.112:0/2487661027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe1280afe30 msgr2=0x7fe128140050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:22.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.340+0000 7fe12e600640 1 --2- 172.21.15.112:0/2487661027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe1280afe30 0x7fe128140050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.340+0000 7fe12e600640 1 -- 172.21.15.112:0/2487661027 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1281f53b0 con 0x7fe12815cc50 2024-09-12T02:45:22.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.340+0000 7fe12d200640 1 --2- 172.21.15.112:0/2487661027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe1280afe30 0x7fe128140050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:45:22.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.340+0000 7fe12e600640 1 --2- 172.21.15.112:0/2487661027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe12815cc50 0x7fe1281519e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fe120034040 tx=0x7fe120004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:22.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.341+0000 7fe125600640 1 -- 172.21.15.112:0/2487661027 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe120036050 con 0x7fe12815cc50 2024-09-12T02:45:22.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.341+0000 7fe125600640 1 -- 172.21.15.112:0/2487661027 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe120042070 con 0x7fe12815cc50 2024-09-12T02:45:22.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.341+0000 7fe130600640 1 -- 172.21.15.112:0/2487661027 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1280b3a80 con 0x7fe12815cc50 2024-09-12T02:45:22.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.341+0000 7fe125600640 1 -- 172.21.15.112:0/2487661027 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe120009510 con 0x7fe12815cc50 2024-09-12T02:45:22.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.341+0000 7fe130600640 1 -- 172.21.15.112:0/2487661027 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1280b4000 con 0x7fe12815cc50 2024-09-12T02:45:22.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.342+0000 7fe130600640 1 -- 172.21.15.112:0/2487661027 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe12806df60 con 0x7fe12815cc50 2024-09-12T02:45:22.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.343+0000 7fe125600640 1 -- 172.21.15.112:0/2487661027 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe120007bd0 con 0x7fe12815cc50 2024-09-12T02:45:22.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.343+0000 7fe125600640 1 --2- 172.21.15.112:0/2487661027 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe10806be30 0x7fe10806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:22.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.344+0000 7fe125600640 1 -- 172.21.15.112:0/2487661027 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7fe1200abc80 con 0x7fe12815cc50 2024-09-12T02:45:22.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.344+0000 7fe12dc00640 1 --2- 172.21.15.112:0/2487661027 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe10806be30 0x7fe10806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:22.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.344+0000 7fe125600640 1 -- 172.21.15.112:0/2487661027 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=67}) -- 0x7fe108073960 con 0x7fe12815cc50 2024-09-12T02:45:22.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.344+0000 7fe12dc00640 1 --2- 172.21.15.112:0/2487661027 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe10806be30 0x7fe10806e2f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe11c0079a0 tx=0x7fe11c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:22.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.348+0000 7fe125600640 1 -- 172.21.15.112:0/2487661027 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe1281f53b0 con 0x7fe12815cc50 2024-09-12T02:45:22.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.522+0000 7fe130600640 1 -- 172.21.15.112:0/2487661027 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1280730d0 con 0x7fe12815cc50 2024-09-12T02:45:22.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.524+0000 7fe125600640 1 -- 172.21.15.112:0/2487661027 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) ==== 74+0+16831 (secure 0 0 0) 0x7fe128073830 con 0x7fe12815cc50 2024-09-12T02:45:22.525 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:45:22.525 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":66,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:44:23.055402+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:44:04.794578+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-12T02:44:06.019611+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:45:22.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.526+0000 7fe130600640 1 -- 172.21.15.112:0/2487661027 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe10806be30 msgr2=0x7fe10806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:22.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.526+0000 7fe130600640 1 --2- 172.21.15.112:0/2487661027 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe10806be30 0x7fe10806e2f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe11c0079a0 tx=0x7fe11c008040 comp rx=0 tx=0).stop 2024-09-12T02:45:22.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.526+0000 7fe130600640 1 -- 172.21.15.112:0/2487661027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe12815cc50 msgr2=0x7fe1281519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:22.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.526+0000 7fe130600640 1 --2- 172.21.15.112:0/2487661027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe12815cc50 0x7fe1281519e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fe120034040 tx=0x7fe120004a40 comp rx=0 tx=0).stop 2024-09-12T02:45:22.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.526+0000 7fe130600640 1 -- 172.21.15.112:0/2487661027 shutdown_connections 2024-09-12T02:45:22.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.526+0000 7fe130600640 1 --2- 172.21.15.112:0/2487661027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe12815cc50 0x7fe1281519e0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.526+0000 7fe130600640 1 --2- 172.21.15.112:0/2487661027 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe10806be30 0x7fe10806e2f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.526+0000 7fe130600640 1 --2- 172.21.15.112:0/2487661027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe1280afe30 0x7fe128140050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.526+0000 7fe130600640 1 --2- 172.21.15.112:0/2487661027 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe128071530 0x7fe1281f4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.526+0000 7fe130600640 1 -- 172.21.15.112:0/2487661027 >> 172.21.15.112:0/2487661027 conn(0x7fe12806bbd0 msgr2=0x7fe1280b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:22.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.526+0000 7fe130600640 1 -- 172.21.15.112:0/2487661027 shutdown_connections 2024-09-12T02:45:22.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.526+0000 7fe130600640 1 -- 172.21.15.112:0/2487661027 wait complete. 2024-09-12T02:45:22.542 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:45:22.543 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:45:22.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.694+0000 7f29af200640 1 Processor -- start 2024-09-12T02:45:22.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.694+0000 7f29af200640 1 -- start start 2024-09-12T02:45:22.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.695+0000 7f29af200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f29a80d1710 0x7f29a80d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:22.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.695+0000 7f29af200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f29a80b3e00 0x7f29a80d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:22.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.695+0000 7f29af200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29a80d2fb0 con 0x7f29a80cf7a0 2024-09-12T02:45:22.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.695+0000 7f29af200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f29a80d3cb0 con 0x7f29a80b3e00 2024-09-12T02:45:22.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.695+0000 7f29af200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f29a80d0b60 con 0x7f29a80d1710 2024-09-12T02:45:22.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.695+0000 7f29ad400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f29a80b3e00 0x7f29a80d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:22.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.695+0000 7f29ad400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f29a80b3e00 0x7f29a80d1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56568/0 (socket says 172.21.15.112:56568) 2024-09-12T02:45:22.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.695+0000 7f29ad400640 1 -- 172.21.15.112:0/1672089445 learned_addr learned my addr 172.21.15.112:0/1672089445 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:22.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.696+0000 7f29ade00640 1 --2- 172.21.15.112:0/1672089445 >> v2:172.21.15.137:3300/0 conn(0x7f29a80d1710 0x7f29a80d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:22.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.696+0000 7f29ad400640 1 -- 172.21.15.112:0/1672089445 >> v2:172.21.15.137:3300/0 conn(0x7f29a80d1710 msgr2=0x7f29a80d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:22.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.696+0000 7f29ad400640 1 --2- 172.21.15.112:0/1672089445 >> v2:172.21.15.137:3300/0 conn(0x7f29a80d1710 0x7f29a80d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.696+0000 7f29ad400640 1 -- 172.21.15.112:0/1672089445 >> v1:172.21.15.137:6789/0 conn(0x7f29a80cf7a0 legacy=0x7f29a80cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:22.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.696+0000 7f29ad400640 1 -- 172.21.15.112:0/1672089445 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a80d2030 con 0x7f29a80b3e00 2024-09-12T02:45:22.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.696+0000 7f29ade00640 1 --2- 172.21.15.112:0/1672089445 >> v2:172.21.15.137:3300/0 conn(0x7f29a80d1710 0x7f29a80d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:45:22.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.697+0000 7f29ad400640 1 --2- 172.21.15.112:0/1672089445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a80b3e00 0x7f29a80d1af0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f29a808dd50 tx=0x7f299802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=544eed04421b2de1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:22.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.697+0000 7f29aca00640 1 -- 172.21.15.112:0/1672089445 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2998037070 con 0x7f29a80b3e00 2024-09-12T02:45:22.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.697+0000 7f29aca00640 1 -- 172.21.15.112:0/1672089445 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2998032440 con 0x7f29a80b3e00 2024-09-12T02:45:22.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.697+0000 7f29aca00640 1 -- 172.21.15.112:0/1672089445 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2998032810 con 0x7f29a80b3e00 2024-09-12T02:45:22.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.697+0000 7f29af200640 1 -- 172.21.15.112:0/1672089445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a80b3e00 msgr2=0x7f29a80d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:22.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.697+0000 7f29af200640 1 --2- 172.21.15.112:0/1672089445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a80b3e00 0x7f29a80d1af0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f29a808dd50 tx=0x7f299802a230 comp rx=0 tx=0).stop 2024-09-12T02:45:22.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.698+0000 7f29af200640 1 -- 172.21.15.112:0/1672089445 shutdown_connections 2024-09-12T02:45:22.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.698+0000 7f29af200640 1 --2- 172.21.15.112:0/1672089445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a80b3e00 0x7f29a80d1af0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.698+0000 7f29af200640 1 --2- 172.21.15.112:0/1672089445 >> v2:172.21.15.137:3300/0 conn(0x7f29a80d1710 0x7f29a80d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.698+0000 7f29af200640 1 -- 172.21.15.112:0/1672089445 >> 172.21.15.112:0/1672089445 conn(0x7f29a809e030 msgr2=0x7f29a80d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:22.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.698+0000 7f29af200640 1 -- 172.21.15.112:0/1672089445 shutdown_connections 2024-09-12T02:45:22.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.698+0000 7f29af200640 1 -- 172.21.15.112:0/1672089445 wait complete. 2024-09-12T02:45:22.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.699+0000 7f29af200640 1 Processor -- start 2024-09-12T02:45:22.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.699+0000 7f29af200640 1 -- start start 2024-09-12T02:45:22.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.700+0000 7f29af200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a80b3e00 0x7f29a80ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:22.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.700+0000 7f29af200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29a80cf7a0 0x7f29a814da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:22.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.700+0000 7f29af200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29a80d1710 0x7f29a80b9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:22.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.700+0000 7f29af200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f29a80d39d0 con 0x7f29a80b3e00 2024-09-12T02:45:22.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.700+0000 7f29af200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f29a80d36f0 con 0x7f29a80cf7a0 2024-09-12T02:45:22.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.700+0000 7f29af200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f29a815f110 con 0x7f29a80d1710 2024-09-12T02:45:22.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.700+0000 7f29ade00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a80b3e00 0x7f29a80ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:22.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.700+0000 7f29ade00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a80b3e00 0x7f29a80ca7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56576/0 (socket says 172.21.15.112:56576) 2024-09-12T02:45:22.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.700+0000 7f29ade00640 1 -- 172.21.15.112:0/2828082734 learned_addr learned my addr 172.21.15.112:0/2828082734 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:22.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.701+0000 7f29ad400640 1 --2- 172.21.15.112:0/2828082734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29a80cf7a0 0x7f29a814da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:22.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.701+0000 7f29ae800640 1 --2- 172.21.15.112:0/2828082734 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29a80d1710 0x7f29a80b9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:22.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.701+0000 7f29ade00640 1 -- 172.21.15.112:0/2828082734 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29a80d1710 msgr2=0x7f29a80b9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:22.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.701+0000 7f29ade00640 1 --2- 172.21.15.112:0/2828082734 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29a80d1710 0x7f29a80b9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.701+0000 7f29ade00640 1 -- 172.21.15.112:0/2828082734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29a80cf7a0 msgr2=0x7f29a814da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:22.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.701+0000 7f29ade00640 1 --2- 172.21.15.112:0/2828082734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29a80cf7a0 0x7f29a814da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.701+0000 7f29ade00640 1 -- 172.21.15.112:0/2828082734 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a80ba9d0 con 0x7f29a80b3e00 2024-09-12T02:45:22.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.701+0000 7f29ae800640 1 --2- 172.21.15.112:0/2828082734 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29a80d1710 0x7f29a80b9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:45:22.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.701+0000 7f29ade00640 1 --2- 172.21.15.112:0/2828082734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a80b3e00 0x7f29a80ca7d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f299c00c7f0 tx=0x7f299c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:22.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.701+0000 7f29a2000640 1 -- 172.21.15.112:0/2828082734 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299c015070 con 0x7f29a80b3e00 2024-09-12T02:45:22.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.701+0000 7f29a2000640 1 -- 172.21.15.112:0/2828082734 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f299c007a30 con 0x7f29a80b3e00 2024-09-12T02:45:22.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.701+0000 7f29a2000640 1 -- 172.21.15.112:0/2828082734 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299c007e00 con 0x7f29a80b3e00 2024-09-12T02:45:22.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.701+0000 7f29af200640 1 -- 172.21.15.112:0/2828082734 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29a80c9730 con 0x7f29a80b3e00 2024-09-12T02:45:22.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.702+0000 7f29af200640 1 -- 172.21.15.112:0/2828082734 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29a80c9cf0 con 0x7f29a80b3e00 2024-09-12T02:45:22.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.703+0000 7f29af200640 1 -- 172.21.15.112:0/2828082734 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29a80d1af0 con 0x7f29a80b3e00 2024-09-12T02:45:22.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.703+0000 7f29a2000640 1 -- 172.21.15.112:0/2828082734 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f299c018070 con 0x7f29a80b3e00 2024-09-12T02:45:22.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.704+0000 7f29a2000640 1 --2- 172.21.15.112:0/2828082734 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f298c06be30 0x7f298c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:22.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.704+0000 7f29a2000640 1 -- 172.21.15.112:0/2828082734 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7f299c08aef0 con 0x7f29a80b3e00 2024-09-12T02:45:22.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.704+0000 7f29a2000640 1 -- 172.21.15.112:0/2828082734 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=67}) -- 0x7f298c073960 con 0x7f29a80b3e00 2024-09-12T02:45:22.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.704+0000 7f29ad400640 1 --2- 172.21.15.112:0/2828082734 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f298c06be30 0x7f298c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:22.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.705+0000 7f29ad400640 1 --2- 172.21.15.112:0/2828082734 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f298c06be30 0x7f298c06e2f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2998034000 tx=0x7f299802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:22.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.709+0000 7f29a2000640 1 -- 172.21.15.112:0/2828082734 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f299c059800 con 0x7f29a80b3e00 2024-09-12T02:45:22.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.914+0000 7f29af200640 1 -- 172.21.15.112:0/2828082734 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29a80b28d0 con 0x7f29a80b3e00 2024-09-12T02:45:22.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.914+0000 7f29a2000640 1 -- 172.21.15.112:0/2828082734 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5235 (secure 0 0 0) 0x7f299c059100 con 0x7f29a80b3e00 2024-09-12T02:45:22.915 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:45:22.915 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":36,"btime":"2024-09-12T02:44:10:654160+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4997,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1412930245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1412930245},{"type":"v1","addr":"172.21.15.137:6834","nonce":1412930245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5299,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1045746375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1045746375},{"type":"v1","addr":"172.21.15.112:6837","nonce":1045746375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5305,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1625140900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1625140900},{"type":"v1","addr":"172.21.15.137:6835","nonce":1625140900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:44:07.016881+0000","modified":"2024-09-12T02:44:10.058498+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5508":{"gid":5508,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/3039296510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3039296510},{"type":"v1","addr":"172.21.15.112:6835","nonce":3039296510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5508,"qdb_cluster":[5508]},"id":4}]} 2024-09-12T02:45:22.916 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 36 2024-09-12T02:45:22.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.916+0000 7f29af200640 1 -- 172.21.15.112:0/2828082734 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f298c06be30 msgr2=0x7f298c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:22.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.916+0000 7f29af200640 1 --2- 172.21.15.112:0/2828082734 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f298c06be30 0x7f298c06e2f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2998034000 tx=0x7f299802e000 comp rx=0 tx=0).stop 2024-09-12T02:45:22.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.916+0000 7f29af200640 1 -- 172.21.15.112:0/2828082734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a80b3e00 msgr2=0x7f29a80ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:22.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.916+0000 7f29af200640 1 --2- 172.21.15.112:0/2828082734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a80b3e00 0x7f29a80ca7d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f299c00c7f0 tx=0x7f299c00cbf0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.916+0000 7f29af200640 1 -- 172.21.15.112:0/2828082734 shutdown_connections 2024-09-12T02:45:22.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.916+0000 7f29af200640 1 --2- 172.21.15.112:0/2828082734 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29a80d1710 0x7f29a80b9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.916+0000 7f29af200640 1 --2- 172.21.15.112:0/2828082734 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f298c06be30 0x7f298c06e2f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.916+0000 7f29af200640 1 --2- 172.21.15.112:0/2828082734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29a80cf7a0 0x7f29a814da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.916+0000 7f29af200640 1 --2- 172.21.15.112:0/2828082734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a80b3e00 0x7f29a80ca7d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:22.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.916+0000 7f29af200640 1 -- 172.21.15.112:0/2828082734 >> 172.21.15.112:0/2828082734 conn(0x7f29a809e030 msgr2=0x7f29a80b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:22.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.917+0000 7f29af200640 1 -- 172.21.15.112:0/2828082734 shutdown_connections 2024-09-12T02:45:22.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:22.917+0000 7f29af200640 1 -- 172.21.15.112:0/2828082734 wait complete. 2024-09-12T02:45:22.933 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:45:23.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.083+0000 7f4c33e00640 1 Processor -- start 2024-09-12T02:45:23.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.084+0000 7f4c33e00640 1 -- start start 2024-09-12T02:45:23.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.085+0000 7f4c33e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4c2c15b9d0 0x7f4c2c0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:23.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.085+0000 7f4c33e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c2c0b54a0 con 0x7f4c2c0b45d0 2024-09-12T02:45:23.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.085+0000 7f4c33e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c2c0b3af0 con 0x7f4c2c06f600 2024-09-12T02:45:23.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.085+0000 7f4c33e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4c2c0b4a60 con 0x7f4c2c15b9d0 2024-09-12T02:45:23.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.085+0000 7f4c31400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4c2c15b9d0 0x7f4c2c0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:23.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.085+0000 7f4c30a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f4c2c0b45d0 0x7f4c2c06eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55684/0 (socket says 172.21.15.112:55684) 2024-09-12T02:45:23.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.085+0000 7f4c30a00640 1 -- 172.21.15.112:0/2160722465 learned_addr learned my addr 172.21.15.112:0/2160722465 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:45:23.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.086+0000 7f4c31400640 1 -- 172.21.15.112:0/2160722465 >> v1:172.21.15.137:6789/0 conn(0x7f4c2c06f600 legacy=0x7f4c2c0cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:23.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.086+0000 7f4c31400640 1 -- 172.21.15.112:0/2160722465 >> v1:172.21.15.112:6789/0 conn(0x7f4c2c0b45d0 legacy=0x7f4c2c06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:23.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.086+0000 7f4c31400640 1 -- 172.21.15.112:0/2160722465 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c2c0b3dd0 con 0x7f4c2c15b9d0 2024-09-12T02:45:23.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.087+0000 7f4c31400640 1 --2- 172.21.15.112:0/2160722465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c2c15b9d0 0x7f4c2c0b4ec0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4c200097a0 tx=0x7f4c2002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e79195da6fd849e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:23.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.087+0000 7f4c2be00640 1 -- 172.21.15.112:0/2160722465 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c20037070 con 0x7f4c2c15b9d0 2024-09-12T02:45:23.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.087+0000 7f4c2be00640 1 -- 172.21.15.112:0/2160722465 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c2002ae50 con 0x7f4c2c15b9d0 2024-09-12T02:45:23.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.087+0000 7f4c2be00640 1 -- 172.21.15.112:0/2160722465 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c20032660 con 0x7f4c2c15b9d0 2024-09-12T02:45:23.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.087+0000 7f4c33e00640 1 -- 172.21.15.112:0/2160722465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c2c15b9d0 msgr2=0x7f4c2c0b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:23.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.087+0000 7f4c33e00640 1 --2- 172.21.15.112:0/2160722465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c2c15b9d0 0x7f4c2c0b4ec0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4c200097a0 tx=0x7f4c2002a140 comp rx=0 tx=0).stop 2024-09-12T02:45:23.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.087+0000 7f4c33e00640 1 -- 172.21.15.112:0/2160722465 shutdown_connections 2024-09-12T02:45:23.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.087+0000 7f4c33e00640 1 --2- 172.21.15.112:0/2160722465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c2c15b9d0 0x7f4c2c0b4ec0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:23.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.087+0000 7f4c33e00640 1 -- 172.21.15.112:0/2160722465 >> 172.21.15.112:0/2160722465 conn(0x7f4c2c06bbd0 msgr2=0x7f4c2c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:23.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.088+0000 7f4c33e00640 1 -- 172.21.15.112:0/2160722465 shutdown_connections 2024-09-12T02:45:23.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.088+0000 7f4c33e00640 1 -- 172.21.15.112:0/2160722465 wait complete. 2024-09-12T02:45:23.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.089+0000 7f4c33e00640 1 Processor -- start 2024-09-12T02:45:23.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.089+0000 7f4c33e00640 1 -- start start 2024-09-12T02:45:23.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.090+0000 7f4c33e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c2c06f600 0x7f4c2c15e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:23.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.090+0000 7f4c33e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c2c0b45d0 0x7f4c2c151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:23.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.090+0000 7f4c33e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c2c15b9d0 0x7f4c2c15f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:23.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.090+0000 7f4c33e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2c15bf30 con 0x7f4c2c15b9d0 2024-09-12T02:45:23.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.090+0000 7f4c33e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2c15bdb0 con 0x7f4c2c06f600 2024-09-12T02:45:23.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.090+0000 7f4c33e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4c2c0728c0 con 0x7f4c2c0b45d0 2024-09-12T02:45:23.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.090+0000 7f4c31e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c2c15b9d0 0x7f4c2c15f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:23.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.090+0000 7f4c31e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c2c15b9d0 0x7f4c2c15f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56602/0 (socket says 172.21.15.112:56602) 2024-09-12T02:45:23.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.090+0000 7f4c31e00640 1 -- 172.21.15.112:0/2160994698 learned_addr learned my addr 172.21.15.112:0/2160994698 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:23.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.091+0000 7f4c30a00640 1 --2- 172.21.15.112:0/2160994698 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c2c0b45d0 0x7f4c2c151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:23.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.091+0000 7f4c31e00640 1 -- 172.21.15.112:0/2160994698 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c2c0b45d0 msgr2=0x7f4c2c151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:23.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.091+0000 7f4c31400640 1 --2- 172.21.15.112:0/2160994698 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c2c06f600 0x7f4c2c15e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:23.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.091+0000 7f4c31e00640 1 --2- 172.21.15.112:0/2160994698 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c2c0b45d0 0x7f4c2c151750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:23.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.091+0000 7f4c31e00640 1 -- 172.21.15.112:0/2160994698 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c2c06f600 msgr2=0x7f4c2c15e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:23.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.091+0000 7f4c31e00640 1 --2- 172.21.15.112:0/2160994698 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c2c06f600 0x7f4c2c15e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:23.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.091+0000 7f4c31e00640 1 -- 172.21.15.112:0/2160994698 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c2c15f080 con 0x7f4c2c15b9d0 2024-09-12T02:45:23.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.091+0000 7f4c30a00640 1 --2- 172.21.15.112:0/2160994698 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c2c0b45d0 0x7f4c2c151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:45:23.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.091+0000 7f4c31400640 1 --2- 172.21.15.112:0/2160994698 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c2c06f600 0x7f4c2c15e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:45:23.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.091+0000 7f4c31e00640 1 --2- 172.21.15.112:0/2160994698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c2c15b9d0 0x7f4c2c15f590 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4c2400c780 tx=0x7f4c2400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:23.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.091+0000 7f4c29600640 1 -- 172.21.15.112:0/2160994698 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c24017070 con 0x7f4c2c15b9d0 2024-09-12T02:45:23.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.091+0000 7f4c29600640 1 -- 172.21.15.112:0/2160994698 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c24003da0 con 0x7f4c2c15b9d0 2024-09-12T02:45:23.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.091+0000 7f4c29600640 1 -- 172.21.15.112:0/2160994698 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c240052b0 con 0x7f4c2c15b9d0 2024-09-12T02:45:23.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.091+0000 7f4c33e00640 1 -- 172.21.15.112:0/2160994698 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c2c153590 con 0x7f4c2c15b9d0 2024-09-12T02:45:23.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.091+0000 7f4c33e00640 1 -- 172.21.15.112:0/2160994698 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c2c153b50 con 0x7f4c2c15b9d0 2024-09-12T02:45:23.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.092+0000 7f4c33e00640 1 -- 172.21.15.112:0/2160994698 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c2c0696d0 con 0x7f4c2c15b9d0 2024-09-12T02:45:23.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.094+0000 7f4c29600640 1 -- 172.21.15.112:0/2160994698 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4c24005450 con 0x7f4c2c15b9d0 2024-09-12T02:45:23.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.094+0000 7f4c29600640 1 --2- 172.21.15.112:0/2160994698 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4c0c06be30 0x7f4c0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:23.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.094+0000 7f4c29600640 1 -- 172.21.15.112:0/2160994698 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7f4c2408a480 con 0x7f4c2c15b9d0 2024-09-12T02:45:23.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.095+0000 7f4c31400640 1 --2- 172.21.15.112:0/2160994698 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4c0c06be30 0x7f4c0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:23.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.095+0000 7f4c29600640 1 -- 172.21.15.112:0/2160994698 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=67}) -- 0x7f4c0c073960 con 0x7f4c2c15b9d0 2024-09-12T02:45:23.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.095+0000 7f4c31400640 1 --2- 172.21.15.112:0/2160994698 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4c0c06be30 0x7f4c0c06e2f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4c20034000 tx=0x7f4c2002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:23.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.098+0000 7f4c29600640 1 -- 172.21.15.112:0/2160994698 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4c2c0696d0 con 0x7f4c2c15b9d0 2024-09-12T02:45:23.179 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-12T02:45:23.178+0000 7f0219e00640 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2024-09-12T02:45:23.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.188+0000 7f4c29600640 1 -- 172.21.15.112:0/2160994698 <== mon.0 v2:172.21.15.112:3300/0 7 ==== osd_map(67..67 src has 1..67) ==== 312+0+0 (secure 0 0 0) 0x7f4c240bed50 con 0x7f4c2c15b9d0 2024-09-12T02:45:23.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.189+0000 7f4c29600640 1 -- 172.21.15.112:0/2160994698 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=68}) -- 0x7f4c0c074250 con 0x7f4c2c15b9d0 2024-09-12T02:45:23.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.309+0000 7f4c33e00640 1 -- 172.21.15.112:0/2160994698 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c2c0b1690 con 0x7f4c2c15b9d0 2024-09-12T02:45:23.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.310+0000 7f4c29600640 1 -- 172.21.15.112:0/2160994698 <== mon.0 v2:172.21.15.112:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5235 (secure 0 0 0) 0x7f4c24058e20 con 0x7f4c2c15b9d0 2024-09-12T02:45:23.312 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:45:23.312 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":36,"btime":"2024-09-12T02:44:10:654160+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4997,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1412930245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1412930245},{"type":"v1","addr":"172.21.15.137:6834","nonce":1412930245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5299,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1045746375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1045746375},{"type":"v1","addr":"172.21.15.112:6837","nonce":1045746375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5305,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1625140900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1625140900},{"type":"v1","addr":"172.21.15.137:6835","nonce":1625140900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:44:07.016881+0000","modified":"2024-09-12T02:44:10.058498+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5508":{"gid":5508,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/3039296510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3039296510},{"type":"v1","addr":"172.21.15.112:6835","nonce":3039296510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5508,"qdb_cluster":[5508]},"id":4}]} 2024-09-12T02:45:23.312 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 36 2024-09-12T02:45:23.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.312+0000 7f4c33e00640 1 -- 172.21.15.112:0/2160994698 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4c0c06be30 msgr2=0x7f4c0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:23.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.312+0000 7f4c33e00640 1 --2- 172.21.15.112:0/2160994698 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4c0c06be30 0x7f4c0c06e2f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4c20034000 tx=0x7f4c2002e000 comp rx=0 tx=0).stop 2024-09-12T02:45:23.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.312+0000 7f4c33e00640 1 -- 172.21.15.112:0/2160994698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c2c15b9d0 msgr2=0x7f4c2c15f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:23.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.312+0000 7f4c33e00640 1 --2- 172.21.15.112:0/2160994698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c2c15b9d0 0x7f4c2c15f590 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4c2400c780 tx=0x7f4c2400cc40 comp rx=0 tx=0).stop 2024-09-12T02:45:23.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.312+0000 7f4c33e00640 1 -- 172.21.15.112:0/2160994698 shutdown_connections 2024-09-12T02:45:23.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.312+0000 7f4c33e00640 1 --2- 172.21.15.112:0/2160994698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c2c15b9d0 0x7f4c2c15f590 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:23.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.312+0000 7f4c33e00640 1 --2- 172.21.15.112:0/2160994698 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c2c0b45d0 0x7f4c2c151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:23.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.312+0000 7f4c33e00640 1 --2- 172.21.15.112:0/2160994698 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4c0c06be30 0x7f4c0c06e2f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:23.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.312+0000 7f4c33e00640 1 --2- 172.21.15.112:0/2160994698 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c2c06f600 0x7f4c2c15e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:23.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.312+0000 7f4c33e00640 1 -- 172.21.15.112:0/2160994698 >> 172.21.15.112:0/2160994698 conn(0x7f4c2c06bbd0 msgr2=0x7f4c2c0afd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:23.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.313+0000 7f4c33e00640 1 -- 172.21.15.112:0/2160994698 shutdown_connections 2024-09-12T02:45:23.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.313+0000 7f4c33e00640 1 -- 172.21.15.112:0/2160994698 wait complete. 2024-09-12T02:45:23.329 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:45:23.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.480+0000 7f589c200640 1 Processor -- start 2024-09-12T02:45:23.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.480+0000 7f589c200640 1 -- start start 2024-09-12T02:45:23.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.481+0000 7f589c200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f589415b9d0 0x7f58940b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:23.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.482+0000 7f589c200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f589406f600 0x7f58940728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:23.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.482+0000 7f589c200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58940b54a0 con 0x7f58940b45d0 2024-09-12T02:45:23.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.482+0000 7f589c200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f58940b4a60 con 0x7f589415b9d0 2024-09-12T02:45:23.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.482+0000 7f589c200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f58940b3af0 con 0x7f589406f600 2024-09-12T02:45:23.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.482+0000 7f5899800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f589415b9d0 0x7f58940b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:23.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.482+0000 7f5899800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f589415b9d0 0x7f58940b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56608/0 (socket says 172.21.15.112:56608) 2024-09-12T02:45:23.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.482+0000 7f5899800640 1 -- 172.21.15.112:0/2082556154 learned_addr learned my addr 172.21.15.112:0/2082556154 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:23.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.482+0000 7f5899800640 1 -- 172.21.15.112:0/2082556154 >> v2:172.21.15.137:3300/0 conn(0x7f589406f600 msgr2=0x7f58940728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:23.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.482+0000 7f5899800640 1 --2- 172.21.15.112:0/2082556154 >> v2:172.21.15.137:3300/0 conn(0x7f589406f600 0x7f58940728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:23.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.482+0000 7f5899800640 1 -- 172.21.15.112:0/2082556154 >> v1:172.21.15.137:6789/0 conn(0x7f58940b45d0 legacy=0x7f589406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:23.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.482+0000 7f5899800640 1 -- 172.21.15.112:0/2082556154 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58940b3dd0 con 0x7f589415b9d0 2024-09-12T02:45:23.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.483+0000 7f5899800640 1 --2- 172.21.15.112:0/2082556154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f589415b9d0 0x7f58940b4ec0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5894072f80 tx=0x7f588802c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaed37914c03ff6e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:23.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.483+0000 7f5893e00640 1 -- 172.21.15.112:0/2082556154 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5888039070 con 0x7f589415b9d0 2024-09-12T02:45:23.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.483+0000 7f5893e00640 1 -- 172.21.15.112:0/2082556154 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5888034640 con 0x7f589415b9d0 2024-09-12T02:45:23.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.483+0000 7f5893e00640 1 -- 172.21.15.112:0/2082556154 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5888034a10 con 0x7f589415b9d0 2024-09-12T02:45:23.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.484+0000 7f589c200640 1 -- 172.21.15.112:0/2082556154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f589415b9d0 msgr2=0x7f58940b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:23.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.484+0000 7f589c200640 1 --2- 172.21.15.112:0/2082556154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f589415b9d0 0x7f58940b4ec0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5894072f80 tx=0x7f588802c3b0 comp rx=0 tx=0).stop 2024-09-12T02:45:23.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.484+0000 7f589c200640 1 -- 172.21.15.112:0/2082556154 shutdown_connections 2024-09-12T02:45:23.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.484+0000 7f589c200640 1 --2- 172.21.15.112:0/2082556154 >> v2:172.21.15.137:3300/0 conn(0x7f589406f600 0x7f58940728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:23.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.484+0000 7f589c200640 1 --2- 172.21.15.112:0/2082556154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f589415b9d0 0x7f58940b4ec0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:23.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.484+0000 7f589c200640 1 -- 172.21.15.112:0/2082556154 >> 172.21.15.112:0/2082556154 conn(0x7f589406bbd0 msgr2=0x7f589406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:23.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.484+0000 7f589c200640 1 -- 172.21.15.112:0/2082556154 shutdown_connections 2024-09-12T02:45:23.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.484+0000 7f589c200640 1 -- 172.21.15.112:0/2082556154 wait complete. 2024-09-12T02:45:23.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.486+0000 7f589c200640 1 Processor -- start 2024-09-12T02:45:23.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.486+0000 7f589c200640 1 -- start start 2024-09-12T02:45:23.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.487+0000 7f589c200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f589406f600 0x7f58941503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:23.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.487+0000 7f589c200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58940b45d0 0x7f58941548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:23.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.487+0000 7f589c200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f589415b9d0 0x7f5894155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:23.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.487+0000 7f589c200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f589415bf30 con 0x7f589406f600 2024-09-12T02:45:23.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.487+0000 7f589c200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f589415bdb0 con 0x7f58940b45d0 2024-09-12T02:45:23.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.487+0000 7f589c200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f58940cdcd0 con 0x7f589415b9d0 2024-09-12T02:45:23.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.487+0000 7f5899800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f589406f600 0x7f58941503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:23.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.487+0000 7f5899800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f589406f600 0x7f58941503a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56622/0 (socket says 172.21.15.112:56622) 2024-09-12T02:45:23.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.487+0000 7f5899800640 1 -- 172.21.15.112:0/3424419681 learned_addr learned my addr 172.21.15.112:0/3424419681 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:23.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.487+0000 7f5898e00640 1 --2- 172.21.15.112:0/3424419681 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58940b45d0 0x7f58941548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:23.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.487+0000 7f589a200640 1 --2- 172.21.15.112:0/3424419681 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f589415b9d0 0x7f5894155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:23.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.487+0000 7f5899800640 1 -- 172.21.15.112:0/3424419681 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f589415b9d0 msgr2=0x7f5894155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:23.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.487+0000 7f5899800640 1 --2- 172.21.15.112:0/3424419681 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f589415b9d0 0x7f5894155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:23.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.487+0000 7f5899800640 1 -- 172.21.15.112:0/3424419681 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58940b45d0 msgr2=0x7f58941548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:23.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.487+0000 7f5899800640 1 --2- 172.21.15.112:0/3424419681 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58940b45d0 0x7f58941548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:23.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.487+0000 7f5899800640 1 -- 172.21.15.112:0/3424419681 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5894154e10 con 0x7f589406f600 2024-09-12T02:45:23.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.488+0000 7f5899800640 1 --2- 172.21.15.112:0/3424419681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f589406f600 0x7f58941503a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f588802c3f0 tx=0x7f58880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:23.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.488+0000 7f5891600640 1 -- 172.21.15.112:0/3424419681 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5888039040 con 0x7f589406f600 2024-09-12T02:45:23.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.488+0000 7f5891600640 1 -- 172.21.15.112:0/3424419681 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5888044070 con 0x7f589406f600 2024-09-12T02:45:23.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.488+0000 7f589c200640 1 -- 172.21.15.112:0/3424419681 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5894150f70 con 0x7f589406f600 2024-09-12T02:45:23.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.488+0000 7f5891600640 1 -- 172.21.15.112:0/3424419681 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58880329b0 con 0x7f589406f600 2024-09-12T02:45:23.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.488+0000 7f589c200640 1 -- 172.21.15.112:0/3424419681 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5894151530 con 0x7f589406f600 2024-09-12T02:45:23.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.489+0000 7f589c200640 1 -- 172.21.15.112:0/3424419681 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5894068a30 con 0x7f589406f600 2024-09-12T02:45:23.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.490+0000 7f5891600640 1 -- 172.21.15.112:0/3424419681 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5888032b50 con 0x7f589406f600 2024-09-12T02:45:23.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.491+0000 7f5891600640 1 --2- 172.21.15.112:0/3424419681 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f587406be30 0x7f587406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:23.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.491+0000 7f5891600640 1 -- 172.21.15.112:0/3424419681 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5709+0+0 (secure 0 0 0) 0x7f58880aba00 con 0x7f589406f600 2024-09-12T02:45:23.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.491+0000 7f5898e00640 1 --2- 172.21.15.112:0/3424419681 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f587406be30 0x7f587406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:23.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.491+0000 7f5891600640 1 -- 172.21.15.112:0/3424419681 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=68}) -- 0x7f5874073960 con 0x7f589406f600 2024-09-12T02:45:23.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.492+0000 7f5898e00640 1 --2- 172.21.15.112:0/3424419681 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f587406be30 0x7f587406e2f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f589415ad50 tx=0x7f5880009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:23.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.495+0000 7f5891600640 1 -- 172.21.15.112:0/3424419681 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f588807a3a0 con 0x7f589406f600 2024-09-12T02:45:23.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.670+0000 7f589c200640 1 -- 172.21.15.112:0/3424419681 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f589415a6e0 con 0x7f589406f600 2024-09-12T02:45:23.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.671+0000 7f5891600640 1 -- 172.21.15.112:0/3424419681 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+16802 (secure 0 0 0) 0x7f5888079ca0 con 0x7f589406f600 2024-09-12T02:45:23.672 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:45:23.673 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":67,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:45:23.179294+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:44:04.794578+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-12T02:44:06.019611+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:45:23.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.673+0000 7f589c200640 1 -- 172.21.15.112:0/3424419681 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f587406be30 msgr2=0x7f587406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:23.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.673+0000 7f589c200640 1 --2- 172.21.15.112:0/3424419681 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f587406be30 0x7f587406e2f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f589415ad50 tx=0x7f5880009040 comp rx=0 tx=0).stop 2024-09-12T02:45:23.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.673+0000 7f589c200640 1 -- 172.21.15.112:0/3424419681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f589406f600 msgr2=0x7f58941503a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:23.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.673+0000 7f589c200640 1 --2- 172.21.15.112:0/3424419681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f589406f600 0x7f58941503a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f588802c3f0 tx=0x7f58880046c0 comp rx=0 tx=0).stop 2024-09-12T02:45:23.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.673+0000 7f589c200640 1 -- 172.21.15.112:0/3424419681 shutdown_connections 2024-09-12T02:45:23.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.673+0000 7f589c200640 1 --2- 172.21.15.112:0/3424419681 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f589415b9d0 0x7f5894155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:23.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.673+0000 7f589c200640 1 --2- 172.21.15.112:0/3424419681 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f587406be30 0x7f587406e2f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:23.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.673+0000 7f589c200640 1 --2- 172.21.15.112:0/3424419681 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58940b45d0 0x7f58941548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:23.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.674+0000 7f589c200640 1 --2- 172.21.15.112:0/3424419681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f589406f600 0x7f58941503a0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:23.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.674+0000 7f589c200640 1 -- 172.21.15.112:0/3424419681 >> 172.21.15.112:0/3424419681 conn(0x7f589406bbd0 msgr2=0x7f58940d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:23.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.674+0000 7f589c200640 1 -- 172.21.15.112:0/3424419681 shutdown_connections 2024-09-12T02:45:23.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.674+0000 7f589c200640 1 -- 172.21.15.112:0/3424419681 wait complete. 2024-09-12T02:45:23.690 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:45:23.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.842+0000 7fea3b200640 1 Processor -- start 2024-09-12T02:45:23.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.842+0000 7fea3b200640 1 -- start start 2024-09-12T02:45:23.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.843+0000 7fea3b200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fea340b3e00 0x7fea340d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:23.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.843+0000 7fea3b200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fea340b1d70 0x7fea340b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:23.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.843+0000 7fea3b200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea340d2fb0 con 0x7fea340d1710 2024-09-12T02:45:23.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.843+0000 7fea3b200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fea340d3cb0 con 0x7fea340b1d70 2024-09-12T02:45:23.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.843+0000 7fea3b200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fea340d0b60 con 0x7fea340b3e00 2024-09-12T02:45:23.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.843+0000 7fea39e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fea340d1710 0x7fea340d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55686/0 (socket says 172.21.15.112:55686) 2024-09-12T02:45:23.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.843+0000 7fea39e00640 1 -- 172.21.15.112:0/715389011 learned_addr learned my addr 172.21.15.112:0/715389011 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:45:23.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.844+0000 7fea39400640 1 --2- 172.21.15.112:0/715389011 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fea340b3e00 0x7fea340d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:23.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.844+0000 7fea3a800640 1 --2- 172.21.15.112:0/715389011 >> v2:172.21.15.137:3300/0 conn(0x7fea340b1d70 0x7fea340b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:23.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.844+0000 7fea38a00640 1 -- 172.21.15.112:0/715389011 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4209836551 0 0) 0x7fea340d2fb0 con 0x7fea340d1710 2024-09-12T02:45:23.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.844+0000 7fea38a00640 1 -- 172.21.15.112:0/715389011 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea1c003520 con 0x7fea340d1710 2024-09-12T02:45:23.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.844+0000 7fea38a00640 1 -- 172.21.15.112:0/715389011 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3471903057 0 0) 0x7fea1c003520 con 0x7fea340d1710 2024-09-12T02:45:23.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.844+0000 7fea38a00640 1 -- 172.21.15.112:0/715389011 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fea340b3e00 msgr2=0x7fea340d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:23.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.844+0000 7fea38a00640 1 --2- 172.21.15.112:0/715389011 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fea340b3e00 0x7fea340d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:23.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.844+0000 7fea38a00640 1 -- 172.21.15.112:0/715389011 >> v2:172.21.15.137:3300/0 conn(0x7fea340b1d70 msgr2=0x7fea340b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:23.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.844+0000 7fea38a00640 1 --2- 172.21.15.112:0/715389011 >> v2:172.21.15.137:3300/0 conn(0x7fea340b1d70 0x7fea340b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:23.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.844+0000 7fea38a00640 1 -- 172.21.15.112:0/715389011 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea340d3410 con 0x7fea340d1710 2024-09-12T02:45:23.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.844+0000 7fea38a00640 1 -- 172.21.15.112:0/715389011 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7fea28001670 con 0x7fea340d1710 2024-09-12T02:45:23.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.844+0000 7fea38a00640 1 -- 172.21.15.112:0/715389011 >> v1:172.21.15.112:6789/0 conn(0x7fea340d1710 legacy=0x7fea340d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:23.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.844+0000 7fea38a00640 1 --2- 172.21.15.112:0/715389011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea1c0039b0 0x7fea1c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:23.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.844+0000 7fea38a00640 1 --2- 172.21.15.112:0/715389011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea1c004800 0x7fea1c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:23.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.844+0000 7fea38a00640 1 --2- 172.21.15.112:0/715389011 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fea340b3e00 0x7fea1c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:23.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.844+0000 7fea38a00640 1 -- 172.21.15.112:0/715389011 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fea340d3cb0 con 0x7fea1c0039b0 2024-09-12T02:45:23.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.844+0000 7fea38a00640 1 -- 172.21.15.112:0/715389011 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fea340d0b60 con 0x7fea1c004800 2024-09-12T02:45:23.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.844+0000 7fea38a00640 1 -- 172.21.15.112:0/715389011 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fea1c00b9c0 con 0x7fea340b3e00 2024-09-12T02:45:23.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.844+0000 7fea39e00640 1 --2- 172.21.15.112:0/715389011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea1c0039b0 0x7fea1c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:23.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.844+0000 7fea39400640 1 --2- 172.21.15.112:0/715389011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea1c004800 0x7fea1c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:23.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.845+0000 7fea3a800640 1 --2- 172.21.15.112:0/715389011 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fea340b3e00 0x7fea1c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:23.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.845+0000 7fea39e00640 1 -- 172.21.15.112:0/715389011 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fea340b3e00 msgr2=0x7fea1c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:23.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.845+0000 7fea39e00640 1 --2- 172.21.15.112:0/715389011 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fea340b3e00 0x7fea1c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:23.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.845+0000 7fea39e00640 1 -- 172.21.15.112:0/715389011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea1c004800 msgr2=0x7fea1c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:23.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.845+0000 7fea39e00640 1 --2- 172.21.15.112:0/715389011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea1c004800 0x7fea1c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:23.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.845+0000 7fea39e00640 1 -- 172.21.15.112:0/715389011 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea1c003520 con 0x7fea1c0039b0 2024-09-12T02:45:23.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.845+0000 7fea3a800640 1 --2- 172.21.15.112:0/715389011 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fea340b3e00 0x7fea1c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:45:23.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.846+0000 7fea39e00640 1 --2- 172.21.15.112:0/715389011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea1c0039b0 0x7fea1c003dd0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fea2800c190 tx=0x7fea1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70fbf971997ef8b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:23.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.846+0000 7fea38a00640 1 -- 172.21.15.112:0/715389011 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea28007c80 con 0x7fea1c0039b0 2024-09-12T02:45:23.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.846+0000 7fea38a00640 1 -- 172.21.15.112:0/715389011 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea2802e070 con 0x7fea1c0039b0 2024-09-12T02:45:23.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.846+0000 7fea38a00640 1 -- 172.21.15.112:0/715389011 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea28005d30 con 0x7fea1c0039b0 2024-09-12T02:45:23.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.846+0000 7fea3b200640 1 -- 172.21.15.112:0/715389011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea1c0039b0 msgr2=0x7fea1c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:23.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.846+0000 7fea3b200640 1 --2- 172.21.15.112:0/715389011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea1c0039b0 0x7fea1c003dd0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fea2800c190 tx=0x7fea1c005830 comp rx=0 tx=0).stop 2024-09-12T02:45:23.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.846+0000 7fea3a800640 1 -- 172.21.15.112:0/715389011 reap_dead start 2024-09-12T02:45:23.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.846+0000 7fea3b200640 1 -- 172.21.15.112:0/715389011 shutdown_connections 2024-09-12T02:45:23.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.846+0000 7fea3b200640 1 -- 172.21.15.112:0/715389011 >> 172.21.15.112:0/715389011 conn(0x7fea3409e030 msgr2=0x7fea340d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:23.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.847+0000 7fea3b200640 1 -- 172.21.15.112:0/715389011 shutdown_connections 2024-09-12T02:45:23.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.847+0000 7fea3b200640 1 -- 172.21.15.112:0/715389011 wait complete. 2024-09-12T02:45:23.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.848+0000 7fea3b200640 1 Processor -- start 2024-09-12T02:45:23.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.848+0000 7fea3b200640 1 -- start start 2024-09-12T02:45:23.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.849+0000 7fea3b200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea1c0039b0 0x7fea340b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:23.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.849+0000 7fea3b200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fea340cce20 0x7fea340cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:23.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.849+0000 7fea3b200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea340b7070 0x7fea3415f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:23.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.849+0000 7fea3b200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fea3415f110 con 0x7fea1c0039b0 2024-09-12T02:45:23.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.849+0000 7fea3b200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fea340d39d0 con 0x7fea340b7070 2024-09-12T02:45:23.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.849+0000 7fea3b200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fea3415f290 con 0x7fea340cce20 2024-09-12T02:45:23.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.850+0000 7fea39e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea1c0039b0 0x7fea340b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:23.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.850+0000 7fea39e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea1c0039b0 0x7fea340b4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56640/0 (socket says 172.21.15.112:56640) 2024-09-12T02:45:23.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.850+0000 7fea39e00640 1 -- 172.21.15.112:0/3377920187 learned_addr learned my addr 172.21.15.112:0/3377920187 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:23.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.850+0000 7fea3a800640 1 --2- 172.21.15.112:0/3377920187 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea340b7070 0x7fea3415f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:23.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.850+0000 7fea39400640 1 --2- 172.21.15.112:0/3377920187 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fea340cce20 0x7fea340cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:23.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.850+0000 7fea39e00640 1 -- 172.21.15.112:0/3377920187 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fea340cce20 msgr2=0x7fea340cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:23.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.850+0000 7fea39e00640 1 --2- 172.21.15.112:0/3377920187 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fea340cce20 0x7fea340cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:23.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.850+0000 7fea39e00640 1 -- 172.21.15.112:0/3377920187 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea340b7070 msgr2=0x7fea3415f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:23.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.850+0000 7fea39e00640 1 --2- 172.21.15.112:0/3377920187 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea340b7070 0x7fea3415f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:23.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.850+0000 7fea39e00640 1 -- 172.21.15.112:0/3377920187 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea340ce790 con 0x7fea1c0039b0 2024-09-12T02:45:23.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.850+0000 7fea39400640 1 --2- 172.21.15.112:0/3377920187 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fea340cce20 0x7fea340cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:45:23.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.850+0000 7fea39e00640 1 --2- 172.21.15.112:0/3377920187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea1c0039b0 0x7fea340b4330 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fea2802ad70 tx=0x7fea28001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:23.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.850+0000 7fea2e000640 1 -- 172.21.15.112:0/3377920187 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea28045070 con 0x7fea1c0039b0 2024-09-12T02:45:23.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.850+0000 7fea2e000640 1 -- 172.21.15.112:0/3377920187 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea28007270 con 0x7fea1c0039b0 2024-09-12T02:45:23.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.850+0000 7fea2e000640 1 -- 172.21.15.112:0/3377920187 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea28007660 con 0x7fea1c0039b0 2024-09-12T02:45:23.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.851+0000 7fea3b200640 1 -- 172.21.15.112:0/3377920187 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea340ce4b0 con 0x7fea1c0039b0 2024-09-12T02:45:23.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.851+0000 7fea3b200640 1 -- 172.21.15.112:0/3377920187 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea340c9840 con 0x7fea1c0039b0 2024-09-12T02:45:23.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.852+0000 7fea3b200640 1 -- 172.21.15.112:0/3377920187 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea340d28d0 con 0x7fea1c0039b0 2024-09-12T02:45:23.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.853+0000 7fea2e000640 1 -- 172.21.15.112:0/3377920187 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fea28048070 con 0x7fea1c0039b0 2024-09-12T02:45:23.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.854+0000 7fea2e000640 1 --2- 172.21.15.112:0/3377920187 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fea1806be30 0x7fea1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:23.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.854+0000 7fea2e000640 1 -- 172.21.15.112:0/3377920187 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5709+0+0 (secure 0 0 0) 0x7fea280aace0 con 0x7fea1c0039b0 2024-09-12T02:45:23.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.854+0000 7fea2e000640 1 -- 172.21.15.112:0/3377920187 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=68}) -- 0x7fea18073960 con 0x7fea1c0039b0 2024-09-12T02:45:23.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.854+0000 7fea39400640 1 --2- 172.21.15.112:0/3377920187 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fea1806be30 0x7fea1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:23.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.854+0000 7fea39400640 1 --2- 172.21.15.112:0/3377920187 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fea1806be30 0x7fea1806e2f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fea341589c0 tx=0x7fea24008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:23.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:23.858+0000 7fea2e000640 1 -- 172.21.15.112:0/3377920187 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fea2803c040 con 0x7fea1c0039b0 2024-09-12T02:45:24.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.066+0000 7fea3b200640 1 -- 172.21.15.112:0/3377920187 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fea340ba490 con 0x7fea1c0039b0 2024-09-12T02:45:24.068 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-12T02:45:24.067+0000 7f0216c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:45:24.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.069+0000 7fea2e000640 1 -- 172.21.15.112:0/3377920187 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) ==== 161+0+0 (secure 0 0 0) 0x7fea28078fa0 con 0x7fea1c0039b0 2024-09-12T02:45:24.070 INFO:teuthology.orchestra.run.smithi112.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:45:24.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.070+0000 7fea2e000640 1 -- 172.21.15.112:0/3377920187 <== mon.0 v2:172.21.15.112:3300/0 8 ==== osd_map(68..68 src has 1..68) ==== 382+0+0 (secure 0 0 0) 0x7fea280b1080 con 0x7fea1c0039b0 2024-09-12T02:45:24.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.070+0000 7fea2e000640 1 -- 172.21.15.112:0/3377920187 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=69}) -- 0x7fea18074340 con 0x7fea1c0039b0 2024-09-12T02:45:24.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.072+0000 7fea3b200640 1 -- 172.21.15.112:0/3377920187 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fea1806be30 msgr2=0x7fea1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:24.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.072+0000 7fea3b200640 1 --2- 172.21.15.112:0/3377920187 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fea1806be30 0x7fea1806e2f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fea341589c0 tx=0x7fea24008040 comp rx=0 tx=0).stop 2024-09-12T02:45:24.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.072+0000 7fea3b200640 1 -- 172.21.15.112:0/3377920187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea1c0039b0 msgr2=0x7fea340b4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:24.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.072+0000 7fea3b200640 1 --2- 172.21.15.112:0/3377920187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea1c0039b0 0x7fea340b4330 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fea2802ad70 tx=0x7fea28001970 comp rx=0 tx=0).stop 2024-09-12T02:45:24.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.073+0000 7fea3b200640 1 -- 172.21.15.112:0/3377920187 shutdown_connections 2024-09-12T02:45:24.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.073+0000 7fea3b200640 1 --2- 172.21.15.112:0/3377920187 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fea1806be30 0x7fea1806e2f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:24.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.073+0000 7fea3b200640 1 --2- 172.21.15.112:0/3377920187 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea340b7070 0x7fea3415f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:24.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.073+0000 7fea3b200640 1 --2- 172.21.15.112:0/3377920187 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fea340cce20 0x7fea340cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:24.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.073+0000 7fea3b200640 1 --2- 172.21.15.112:0/3377920187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea1c0039b0 0x7fea340b4330 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:24.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.073+0000 7fea3b200640 1 -- 172.21.15.112:0/3377920187 >> 172.21.15.112:0/3377920187 conn(0x7fea3409e030 msgr2=0x7fea340b7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:24.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.074+0000 7fea3b200640 1 -- 172.21.15.112:0/3377920187 shutdown_connections 2024-09-12T02:45:24.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.074+0000 7fea3b200640 1 -- 172.21.15.112:0/3377920187 wait complete. 2024-09-12T02:45:24.091 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T02:45:24.139 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-12T02:45:24.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.247+0000 7f056fe00640 1 Processor -- start 2024-09-12T02:45:24.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.248+0000 7f056fe00640 1 -- start start 2024-09-12T02:45:24.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.249+0000 7f056fe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f05700d58a0 0x7f05700b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:24.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.249+0000 7f056fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05700b2cd0 0x7f05700b3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:24.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.249+0000 7f056fe00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05700b1c30 con 0x7f0570162510 2024-09-12T02:45:24.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.249+0000 7f056fe00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f05700b1f10 con 0x7f05700d58a0 2024-09-12T02:45:24.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.249+0000 7f056fe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f05700b21f0 con 0x7f05700b2cd0 2024-09-12T02:45:24.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.249+0000 7f0566000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f05700d58a0 0x7f05700b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:24.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.249+0000 7f0566000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f05700d58a0 0x7f05700b4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56652/0 (socket says 172.21.15.112:56652) 2024-09-12T02:45:24.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.249+0000 7f0566000640 1 -- 172.21.15.112:0/625769494 learned_addr learned my addr 172.21.15.112:0/625769494 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:24.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.249+0000 7f056f400640 1 --2- 172.21.15.112:0/625769494 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05700b2cd0 0x7f05700b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:24.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.249+0000 7f0566000640 1 -- 172.21.15.112:0/625769494 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05700b2cd0 msgr2=0x7f05700b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:24.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.249+0000 7f0566000640 1 --2- 172.21.15.112:0/625769494 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05700b2cd0 0x7f05700b3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:24.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.250+0000 7f0566000640 1 -- 172.21.15.112:0/625769494 >> v1:172.21.15.137:6789/0 conn(0x7f0570162510 legacy=0x7f05700b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:24.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.250+0000 7f0566000640 1 -- 172.21.15.112:0/625769494 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05700b24d0 con 0x7f05700d58a0 2024-09-12T02:45:24.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.250+0000 7f0566000640 1 --2- 172.21.15.112:0/625769494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05700d58a0 0x7f05700b4df0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0558009870 tx=0x7f055802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829424330d5ae13a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:24.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.251+0000 7f056e000640 1 -- 172.21.15.112:0/625769494 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0558037070 con 0x7f05700d58a0 2024-09-12T02:45:24.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.251+0000 7f056e000640 1 -- 172.21.15.112:0/625769494 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0558032440 con 0x7f05700d58a0 2024-09-12T02:45:24.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.251+0000 7f056e000640 1 -- 172.21.15.112:0/625769494 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0558032810 con 0x7f05700d58a0 2024-09-12T02:45:24.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.251+0000 7f056fe00640 1 -- 172.21.15.112:0/625769494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05700d58a0 msgr2=0x7f05700b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:24.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.251+0000 7f056fe00640 1 --2- 172.21.15.112:0/625769494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05700d58a0 0x7f05700b4df0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0558009870 tx=0x7f055802a270 comp rx=0 tx=0).stop 2024-09-12T02:45:24.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.251+0000 7f056fe00640 1 -- 172.21.15.112:0/625769494 shutdown_connections 2024-09-12T02:45:24.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.251+0000 7f056fe00640 1 --2- 172.21.15.112:0/625769494 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05700b2cd0 0x7f05700b3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:24.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.251+0000 7f056fe00640 1 --2- 172.21.15.112:0/625769494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05700d58a0 0x7f05700b4df0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:24.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.251+0000 7f056fe00640 1 -- 172.21.15.112:0/625769494 >> 172.21.15.112:0/625769494 conn(0x7f05700d4d80 msgr2=0x7f05700d5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:24.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.251+0000 7f056fe00640 1 -- 172.21.15.112:0/625769494 shutdown_connections 2024-09-12T02:45:24.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.251+0000 7f056fe00640 1 -- 172.21.15.112:0/625769494 wait complete. 2024-09-12T02:45:24.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.253+0000 7f056fe00640 1 Processor -- start 2024-09-12T02:45:24.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.253+0000 7f056fe00640 1 -- start start 2024-09-12T02:45:24.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.254+0000 7f056fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05700b2cd0 0x7f057015df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:24.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.254+0000 7f056fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05700d58a0 0x7f05700b8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:24.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.254+0000 7f056fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0570162510 0x7f057015eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:24.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.254+0000 7f056fe00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f05700b5330 con 0x7f0570162510 2024-09-12T02:45:24.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.254+0000 7f056fe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f05701628f0 con 0x7f05700b2cd0 2024-09-12T02:45:24.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.254+0000 7f056fe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f05700b54b0 con 0x7f05700d58a0 2024-09-12T02:45:24.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.254+0000 7f056f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0570162510 0x7f057015eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:24.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.254+0000 7f056ea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05700b2cd0 0x7f057015df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:24.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.254+0000 7f056f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0570162510 0x7f057015eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56662/0 (socket says 172.21.15.112:56662) 2024-09-12T02:45:24.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.254+0000 7f056f400640 1 -- 172.21.15.112:0/811936925 learned_addr learned my addr 172.21.15.112:0/811936925 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:24.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.254+0000 7f0566000640 1 --2- 172.21.15.112:0/811936925 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05700d58a0 0x7f05700b8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:24.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.255+0000 7f056f400640 1 -- 172.21.15.112:0/811936925 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05700d58a0 msgr2=0x7f05700b8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:24.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.255+0000 7f056f400640 1 --2- 172.21.15.112:0/811936925 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05700d58a0 0x7f05700b8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:24.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.255+0000 7f056f400640 1 -- 172.21.15.112:0/811936925 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05700b2cd0 msgr2=0x7f057015df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:24.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.255+0000 7f056f400640 1 --2- 172.21.15.112:0/811936925 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05700b2cd0 0x7f057015df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:24.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.255+0000 7f056f400640 1 -- 172.21.15.112:0/811936925 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05700b9430 con 0x7f0570162510 2024-09-12T02:45:24.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.255+0000 7f056f400640 1 --2- 172.21.15.112:0/811936925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0570162510 0x7f057015eb30 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0568007e70 tx=0x7f056800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:24.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.255+0000 7f0567400640 1 -- 172.21.15.112:0/811936925 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0568014620 con 0x7f0570162510 2024-09-12T02:45:24.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.255+0000 7f0567400640 1 -- 172.21.15.112:0/811936925 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0568019070 con 0x7f0570162510 2024-09-12T02:45:24.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.255+0000 7f0567400640 1 -- 172.21.15.112:0/811936925 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0568014a20 con 0x7f0570162510 2024-09-12T02:45:24.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.255+0000 7f056fe00640 1 -- 172.21.15.112:0/811936925 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05700b9710 con 0x7f0570162510 2024-09-12T02:45:24.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.256+0000 7f056fe00640 1 -- 172.21.15.112:0/811936925 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05700b9cd0 con 0x7f0570162510 2024-09-12T02:45:24.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.256+0000 7f056fe00640 1 -- 172.21.15.112:0/811936925 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05700cf2d0 con 0x7f0570162510 2024-09-12T02:45:24.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.257+0000 7f0567400640 1 -- 172.21.15.112:0/811936925 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0568014bc0 con 0x7f0570162510 2024-09-12T02:45:24.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.258+0000 7f0567400640 1 --2- 172.21.15.112:0/811936925 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f054c06be30 0x7f054c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:24.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.258+0000 7f0567400640 1 -- 172.21.15.112:0/811936925 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5795+0+0 (secure 0 0 0) 0x7f056808b6c0 con 0x7f0570162510 2024-09-12T02:45:24.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.259+0000 7f056ea00640 1 --2- 172.21.15.112:0/811936925 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f054c06be30 0x7f054c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:24.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.259+0000 7f0567400640 1 -- 172.21.15.112:0/811936925 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=69}) -- 0x7f054c073a60 con 0x7f0570162510 2024-09-12T02:45:24.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.259+0000 7f056ea00640 1 --2- 172.21.15.112:0/811936925 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f054c06be30 0x7f054c06e2f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f05600016e0 tx=0x7f0560009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:24.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.263+0000 7f0567400640 1 -- 172.21.15.112:0/811936925 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f05680599b0 con 0x7f0570162510 2024-09-12T02:45:24.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:24.470+0000 7f056fe00640 1 -- 172.21.15.112:0/811936925 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f05700b9140 con 0x7f0570162510 2024-09-12T02:45:25.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.071+0000 7f0567400640 1 -- 172.21.15.112:0/811936925 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) ==== 104+0+0 (secure 0 0 0) 0x7f056805dcb0 con 0x7f0570162510 2024-09-12T02:45:25.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.074+0000 7f056fe00640 1 -- 172.21.15.112:0/811936925 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f054c06be30 msgr2=0x7f054c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:25.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.074+0000 7f056fe00640 1 --2- 172.21.15.112:0/811936925 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f054c06be30 0x7f054c06e2f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f05600016e0 tx=0x7f0560009040 comp rx=0 tx=0).stop 2024-09-12T02:45:25.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.074+0000 7f056fe00640 1 -- 172.21.15.112:0/811936925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0570162510 msgr2=0x7f057015eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:25.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.074+0000 7f056fe00640 1 --2- 172.21.15.112:0/811936925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0570162510 0x7f057015eb30 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0568007e70 tx=0x7f056800e4b0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.074+0000 7f056fe00640 1 -- 172.21.15.112:0/811936925 shutdown_connections 2024-09-12T02:45:25.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.074+0000 7f056fe00640 1 --2- 172.21.15.112:0/811936925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0570162510 0x7f057015eb30 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.074+0000 7f056fe00640 1 --2- 172.21.15.112:0/811936925 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05700d58a0 0x7f05700b8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.074+0000 7f056fe00640 1 --2- 172.21.15.112:0/811936925 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f054c06be30 0x7f054c06e2f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.074+0000 7f056fe00640 1 --2- 172.21.15.112:0/811936925 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05700b2cd0 0x7f057015df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.074+0000 7f056fe00640 1 -- 172.21.15.112:0/811936925 >> 172.21.15.112:0/811936925 conn(0x7f05700d4d80 msgr2=0x7f05700b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:25.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.074+0000 7f056fe00640 1 -- 172.21.15.112:0/811936925 shutdown_connections 2024-09-12T02:45:25.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.074+0000 7f056fe00640 1 -- 172.21.15.112:0/811936925 wait complete. 2024-09-12T02:45:25.093 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T02:45:25.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.255+0000 7fafc0200640 1 Processor -- start 2024-09-12T02:45:25.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.255+0000 7fafc0200640 1 -- start start 2024-09-12T02:45:25.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.257+0000 7fafc0200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafb8157190 0x7fafb80b5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:25.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.257+0000 7fafc0200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fafb80d0970 0x7fafb80d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:25.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.257+0000 7fafc0200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafb80720b0 con 0x7fafb815d110 2024-09-12T02:45:25.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.257+0000 7fafc0200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fafb80d1300 con 0x7fafb80d0970 2024-09-12T02:45:25.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.257+0000 7fafc0200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fafb815d880 con 0x7fafb8157190 2024-09-12T02:45:25.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.257+0000 7fafbe200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fafb80d0970 0x7fafb80d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:25.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.257+0000 7fafbe200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fafb80d0970 0x7fafb80d0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56678/0 (socket says 172.21.15.112:56678) 2024-09-12T02:45:25.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.257+0000 7fafbe200640 1 -- 172.21.15.112:0/936239361 learned_addr learned my addr 172.21.15.112:0/936239361 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:25.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.258+0000 7fafbd800640 1 --2- 172.21.15.112:0/936239361 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafb8157190 0x7fafb80b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:25.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.258+0000 7fafbe200640 1 -- 172.21.15.112:0/936239361 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafb8157190 msgr2=0x7fafb80b5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:25.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.258+0000 7fafbe200640 1 --2- 172.21.15.112:0/936239361 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafb8157190 0x7fafb80b5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.258+0000 7fafbe200640 1 -- 172.21.15.112:0/936239361 >> v1:172.21.15.137:6789/0 conn(0x7fafb815d110 legacy=0x7fafb806d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:25.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.258+0000 7fafbe200640 1 -- 172.21.15.112:0/936239361 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb815db60 con 0x7fafb80d0970 2024-09-12T02:45:25.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.259+0000 7fafbe200640 1 --2- 172.21.15.112:0/936239361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb80d0970 0x7fafb80d0dc0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fafb0009e50 tx=0x7fafb002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1a355c68e316e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:25.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.259+0000 7fafb7e00640 1 -- 172.21.15.112:0/936239361 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0036070 con 0x7fafb80d0970 2024-09-12T02:45:25.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.259+0000 7fafb7e00640 1 -- 172.21.15.112:0/936239361 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb0031600 con 0x7fafb80d0970 2024-09-12T02:45:25.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.259+0000 7fafb7e00640 1 -- 172.21.15.112:0/936239361 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb00319d0 con 0x7fafb80d0970 2024-09-12T02:45:25.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.260+0000 7fafc0200640 1 -- 172.21.15.112:0/936239361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb80d0970 msgr2=0x7fafb80d0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:25.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.260+0000 7fafc0200640 1 --2- 172.21.15.112:0/936239361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb80d0970 0x7fafb80d0dc0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fafb0009e50 tx=0x7fafb002a710 comp rx=0 tx=0).stop 2024-09-12T02:45:25.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.260+0000 7fafc0200640 1 -- 172.21.15.112:0/936239361 shutdown_connections 2024-09-12T02:45:25.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.260+0000 7fafc0200640 1 --2- 172.21.15.112:0/936239361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb80d0970 0x7fafb80d0dc0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.260+0000 7fafc0200640 1 --2- 172.21.15.112:0/936239361 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafb8157190 0x7fafb80b5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.260+0000 7fafc0200640 1 -- 172.21.15.112:0/936239361 >> 172.21.15.112:0/936239361 conn(0x7fafb80b2730 msgr2=0x7fafb80b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:25.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.260+0000 7fafc0200640 1 -- 172.21.15.112:0/936239361 shutdown_connections 2024-09-12T02:45:25.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.260+0000 7fafc0200640 1 -- 172.21.15.112:0/936239361 wait complete. 2024-09-12T02:45:25.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.261+0000 7fafc0200640 1 Processor -- start 2024-09-12T02:45:25.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.261+0000 7fafc0200640 1 -- start start 2024-09-12T02:45:25.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.262+0000 7fafc0200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb80d0970 0x7fafb8142420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:25.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.262+0000 7fafc0200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafb8157190 0x7fafb8155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:25.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.262+0000 7fafc0200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafb815d110 0x7fafb81561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:25.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.262+0000 7fafc0200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fafb815d5a0 con 0x7fafb80d0970 2024-09-12T02:45:25.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.262+0000 7fafc0200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fafb8072350 con 0x7fafb815d110 2024-09-12T02:45:25.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.262+0000 7fafc0200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fafb8157570 con 0x7fafb8157190 2024-09-12T02:45:25.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.263+0000 7fafbd800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb80d0970 0x7fafb8142420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:25.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.263+0000 7fafbd800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb80d0970 0x7fafb8142420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56694/0 (socket says 172.21.15.112:56694) 2024-09-12T02:45:25.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.263+0000 7fafbd800640 1 -- 172.21.15.112:0/3716950118 learned_addr learned my addr 172.21.15.112:0/3716950118 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:25.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.263+0000 7fafbe200640 1 --2- 172.21.15.112:0/3716950118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafb815d110 0x7fafb81561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:25.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.263+0000 7fafbce00640 1 --2- 172.21.15.112:0/3716950118 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafb8157190 0x7fafb8155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:25.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.263+0000 7fafbd800640 1 -- 172.21.15.112:0/3716950118 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafb8157190 msgr2=0x7fafb8155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:25.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.263+0000 7fafbd800640 1 --2- 172.21.15.112:0/3716950118 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafb8157190 0x7fafb8155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.263+0000 7fafbd800640 1 -- 172.21.15.112:0/3716950118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafb815d110 msgr2=0x7fafb81561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:25.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.263+0000 7fafbd800640 1 --2- 172.21.15.112:0/3716950118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafb815d110 0x7fafb81561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.263+0000 7fafbd800640 1 -- 172.21.15.112:0/3716950118 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb8142960 con 0x7fafb80d0970 2024-09-12T02:45:25.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.263+0000 7fafbce00640 1 --2- 172.21.15.112:0/3716950118 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafb8157190 0x7fafb8155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:45:25.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.263+0000 7fafbd800640 1 --2- 172.21.15.112:0/3716950118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb80d0970 0x7fafb8142420 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fafac00e9e0 tx=0x7fafac00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:25.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.264+0000 7fafb5600640 1 -- 172.21.15.112:0/3716950118 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac017070 con 0x7fafb80d0970 2024-09-12T02:45:25.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.264+0000 7fafb5600640 1 -- 172.21.15.112:0/3716950118 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafac00c9d0 con 0x7fafb80d0970 2024-09-12T02:45:25.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.264+0000 7fafb5600640 1 -- 172.21.15.112:0/3716950118 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac00cdc0 con 0x7fafb80d0970 2024-09-12T02:45:25.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.264+0000 7fafc0200640 1 -- 172.21.15.112:0/3716950118 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb814f8b0 con 0x7fafb80d0970 2024-09-12T02:45:25.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.264+0000 7fafc0200640 1 -- 172.21.15.112:0/3716950118 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb814fe70 con 0x7fafb80d0970 2024-09-12T02:45:25.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.265+0000 7fafc0200640 1 -- 172.21.15.112:0/3716950118 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafb8152d30 con 0x7fafb80d0970 2024-09-12T02:45:25.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.266+0000 7fafb5600640 1 -- 172.21.15.112:0/3716950118 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fafac01a070 con 0x7fafb80d0970 2024-09-12T02:45:25.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.267+0000 7fafb5600640 1 --2- 172.21.15.112:0/3716950118 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7faf9806be30 0x7faf9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:25.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.267+0000 7fafb5600640 1 -- 172.21.15.112:0/3716950118 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5795+0+0 (secure 0 0 0) 0x7fafac08b150 con 0x7fafb80d0970 2024-09-12T02:45:25.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.267+0000 7fafb5600640 1 -- 172.21.15.112:0/3716950118 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=69}) -- 0x7faf98073a70 con 0x7fafb80d0970 2024-09-12T02:45:25.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.267+0000 7fafbce00640 1 --2- 172.21.15.112:0/3716950118 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7faf9806be30 0x7faf9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:25.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.268+0000 7fafbce00640 1 --2- 172.21.15.112:0/3716950118 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7faf9806be30 0x7faf9806e2f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fafb806e280 tx=0x7fafa4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:25.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.271+0000 7fafb5600640 1 -- 172.21.15.112:0/3716950118 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fafb8152d30 con 0x7fafb80d0970 2024-09-12T02:45:25.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:25.444+0000 7fafc0200640 1 -- 172.21.15.112:0/3716950118 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fafb8155760 con 0x7fafb80d0970 2024-09-12T02:45:26.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.199+0000 7fafb5600640 1 -- 172.21.15.112:0/3716950118 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v69) ==== 181+0+0 (secure 0 0 0) 0x7fafb8142960 con 0x7fafb80d0970 2024-09-12T02:45:26.201 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' removed 2024-09-12T02:45:26.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.200+0000 7fafb5600640 1 -- 172.21.15.112:0/3716950118 <== mon.0 v2:172.21.15.112:3300/0 8 ==== osd_map(69..69 src has 1..69) ==== 1065+0+0 (secure 0 0 0) 0x7fafac0bfd50 con 0x7fafb80d0970 2024-09-12T02:45:26.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.200+0000 7fafb5600640 1 -- 172.21.15.112:0/3716950118 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=70}) -- 0x7faf98071ea0 con 0x7fafb80d0970 2024-09-12T02:45:26.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.207+0000 7fafc0200640 1 -- 172.21.15.112:0/3716950118 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7faf9806be30 msgr2=0x7faf9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:26.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.207+0000 7fafc0200640 1 --2- 172.21.15.112:0/3716950118 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7faf9806be30 0x7faf9806e2f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fafb806e280 tx=0x7fafa4009040 comp rx=0 tx=0).stop 2024-09-12T02:45:26.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.207+0000 7fafc0200640 1 -- 172.21.15.112:0/3716950118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb80d0970 msgr2=0x7fafb8142420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:26.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.207+0000 7fafc0200640 1 --2- 172.21.15.112:0/3716950118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb80d0970 0x7fafb8142420 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fafac00e9e0 tx=0x7fafac00eea0 comp rx=0 tx=0).stop 2024-09-12T02:45:26.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.207+0000 7fafc0200640 1 -- 172.21.15.112:0/3716950118 shutdown_connections 2024-09-12T02:45:26.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.207+0000 7fafc0200640 1 --2- 172.21.15.112:0/3716950118 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7faf9806be30 0x7faf9806e2f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:26.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.207+0000 7fafc0200640 1 --2- 172.21.15.112:0/3716950118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafb815d110 0x7fafb81561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:26.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.207+0000 7fafc0200640 1 --2- 172.21.15.112:0/3716950118 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafb8157190 0x7fafb8155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:26.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.207+0000 7fafc0200640 1 --2- 172.21.15.112:0/3716950118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb80d0970 0x7fafb8142420 secure :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fafac00e9e0 tx=0x7fafac00eea0 comp rx=0 tx=0).stop 2024-09-12T02:45:26.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.207+0000 7fafc0200640 1 -- 172.21.15.112:0/3716950118 >> 172.21.15.112:0/3716950118 conn(0x7fafb80b2730 msgr2=0x7fafb815bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:26.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.208+0000 7fafc0200640 1 -- 172.21.15.112:0/3716950118 shutdown_connections 2024-09-12T02:45:26.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.208+0000 7fafc0200640 1 -- 172.21.15.112:0/3716950118 wait complete. 2024-09-12T02:45:26.227 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T02:45:26.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.383+0000 7f629ec00640 1 Processor -- start 2024-09-12T02:45:26.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.383+0000 7f629ec00640 1 -- start start 2024-09-12T02:45:26.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.385+0000 7f629ec00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f62981602f0 0x7f62980b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:26.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.385+0000 7f629ec00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f629806eed0 con 0x7f6298144890 2024-09-12T02:45:26.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.385+0000 7f629ec00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f629806f170 con 0x7f62980b4140 2024-09-12T02:45:26.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.385+0000 7f629ec00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f629815f810 con 0x7f62981602f0 2024-09-12T02:45:26.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.385+0000 7f6297e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f6298144890 0x7f62980b3a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55694/0 (socket says 172.21.15.112:55694) 2024-09-12T02:45:26.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.385+0000 7f6297e00640 1 -- 172.21.15.112:0/854480985 learned_addr learned my addr 172.21.15.112:0/854480985 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:45:26.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.385+0000 7f629cc00640 1 --2- 172.21.15.112:0/854480985 >> v2:172.21.15.137:3300/0 conn(0x7f62981602f0 0x7f62980b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:26.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.385+0000 7f6297400640 1 -- 172.21.15.112:0/854480985 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3260696348 0 0) 0x7f629806eed0 con 0x7f6298144890 2024-09-12T02:45:26.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.385+0000 7f6297400640 1 -- 172.21.15.112:0/854480985 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f627c003520 con 0x7f6298144890 2024-09-12T02:45:26.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.386+0000 7f6297400640 1 -- 172.21.15.112:0/854480985 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2758638670 0 0) 0x7f627c003520 con 0x7f6298144890 2024-09-12T02:45:26.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.386+0000 7f6297400640 1 -- 172.21.15.112:0/854480985 >> v2:172.21.15.137:3300/0 conn(0x7f62981602f0 msgr2=0x7f62980b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:26.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.386+0000 7f6297400640 1 --2- 172.21.15.112:0/854480985 >> v2:172.21.15.137:3300/0 conn(0x7f62981602f0 0x7f62980b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:26.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.386+0000 7f6297400640 1 -- 172.21.15.112:0/854480985 >> v1:172.21.15.137:6789/0 conn(0x7f62980b4140 legacy=0x7f62980ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:26.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.386+0000 7f6297400640 1 -- 172.21.15.112:0/854480985 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f629815faf0 con 0x7f6298144890 2024-09-12T02:45:26.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.386+0000 7f6297400640 1 -- 172.21.15.112:0/854480985 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f6288001690 con 0x7f6298144890 2024-09-12T02:45:26.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.386+0000 7f6297400640 1 -- 172.21.15.112:0/854480985 >> v1:172.21.15.112:6789/0 conn(0x7f6298144890 legacy=0x7f62980b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:26.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.386+0000 7f6297400640 1 --2- 172.21.15.112:0/854480985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f627c0039b0 0x7f627c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:26.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.386+0000 7f6297400640 1 --2- 172.21.15.112:0/854480985 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f627c004800 0x7f627c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:26.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.386+0000 7f6297400640 1 --2- 172.21.15.112:0/854480985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f627c0051c0 0x7f627c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:26.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.386+0000 7f6297400640 1 -- 172.21.15.112:0/854480985 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f629815f810 con 0x7f627c0039b0 2024-09-12T02:45:26.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.386+0000 7f6297400640 1 -- 172.21.15.112:0/854480985 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f627c00e270 con 0x7f627c0051c0 2024-09-12T02:45:26.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.386+0000 7f6297400640 1 -- 172.21.15.112:0/854480985 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f627c00e470 con 0x7f627c004800 2024-09-12T02:45:26.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.386+0000 7f6297e00640 1 --2- 172.21.15.112:0/854480985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f627c0039b0 0x7f627c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:26.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.386+0000 7f629cc00640 1 --2- 172.21.15.112:0/854480985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f627c0051c0 0x7f627c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:26.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.386+0000 7f628f400640 1 --2- 172.21.15.112:0/854480985 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f627c004800 0x7f627c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:26.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.386+0000 7f6297e00640 1 -- 172.21.15.112:0/854480985 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f627c004800 msgr2=0x7f627c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:26.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.386+0000 7f6297e00640 1 --2- 172.21.15.112:0/854480985 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f627c004800 0x7f627c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:26.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.386+0000 7f6297e00640 1 -- 172.21.15.112:0/854480985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f627c0051c0 msgr2=0x7f627c00dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:26.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.386+0000 7f6297e00640 1 --2- 172.21.15.112:0/854480985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f627c0051c0 0x7f627c00dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:26.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.386+0000 7f6297e00640 1 -- 172.21.15.112:0/854480985 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f627c003520 con 0x7f627c0039b0 2024-09-12T02:45:26.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.386+0000 7f629cc00640 1 --2- 172.21.15.112:0/854480985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f627c0051c0 0x7f627c00dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:45:26.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.386+0000 7f629cc00640 1 -- 172.21.15.112:0/854480985 reap_dead start 2024-09-12T02:45:26.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.387+0000 7f6297e00640 1 --2- 172.21.15.112:0/854480985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f627c0039b0 0x7f627c003dd0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6288007fd0 tx=0x7f627c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831cabaa1223ef2c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:26.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.388+0000 7f6297400640 1 -- 172.21.15.112:0/854480985 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6288007d50 con 0x7f627c0039b0 2024-09-12T02:45:26.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.388+0000 7f6297400640 1 -- 172.21.15.112:0/854480985 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6288005af0 con 0x7f627c0039b0 2024-09-12T02:45:26.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.388+0000 7f6297400640 1 -- 172.21.15.112:0/854480985 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6288007070 con 0x7f627c0039b0 2024-09-12T02:45:26.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.388+0000 7f629ec00640 1 -- 172.21.15.112:0/854480985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f627c0039b0 msgr2=0x7f627c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:26.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.388+0000 7f629ec00640 1 --2- 172.21.15.112:0/854480985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f627c0039b0 0x7f627c003dd0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6288007fd0 tx=0x7f627c005830 comp rx=0 tx=0).stop 2024-09-12T02:45:26.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.388+0000 7f629ec00640 1 -- 172.21.15.112:0/854480985 shutdown_connections 2024-09-12T02:45:26.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.388+0000 7f629ec00640 1 --2- 172.21.15.112:0/854480985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f627c0039b0 0x7f627c003dd0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:26.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.388+0000 7f629ec00640 1 -- 172.21.15.112:0/854480985 >> 172.21.15.112:0/854480985 conn(0x7f62980b2730 msgr2=0x7f62980b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:26.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.388+0000 7f629ec00640 1 -- 172.21.15.112:0/854480985 shutdown_connections 2024-09-12T02:45:26.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.388+0000 7f629ec00640 1 -- 172.21.15.112:0/854480985 wait complete. 2024-09-12T02:45:26.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.390+0000 7f629ec00640 1 Processor -- start 2024-09-12T02:45:26.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.390+0000 7f629ec00640 1 -- start start 2024-09-12T02:45:26.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.391+0000 7f629ec00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f627c0039b0 0x7f62981427d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:26.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.391+0000 7f629ec00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f629815bb70 0x7f629815d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:26.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.391+0000 7f629ec00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6298142f40 0x7f62981f0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:26.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.391+0000 7f629ec00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6298144df0 con 0x7f627c0039b0 2024-09-12T02:45:26.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.391+0000 7f629ec00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6298144c70 con 0x7f6298142f40 2024-09-12T02:45:26.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.391+0000 7f629ec00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f62980b3290 con 0x7f629815bb70 2024-09-12T02:45:26.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.391+0000 7f6297e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f627c0039b0 0x7f62981427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:26.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.391+0000 7f6297e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f627c0039b0 0x7f62981427d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56720/0 (socket says 172.21.15.112:56720) 2024-09-12T02:45:26.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.391+0000 7f6297e00640 1 -- 172.21.15.112:0/3535562375 learned_addr learned my addr 172.21.15.112:0/3535562375 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:26.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.391+0000 7f628f400640 1 --2- 172.21.15.112:0/3535562375 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f629815bb70 0x7f629815d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:26.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.391+0000 7f629cc00640 1 --2- 172.21.15.112:0/3535562375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6298142f40 0x7f62981f0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:26.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.391+0000 7f6297e00640 1 -- 172.21.15.112:0/3535562375 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f629815bb70 msgr2=0x7f629815d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:26.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.391+0000 7f6297e00640 1 --2- 172.21.15.112:0/3535562375 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f629815bb70 0x7f629815d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:26.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.391+0000 7f6297e00640 1 -- 172.21.15.112:0/3535562375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6298142f40 msgr2=0x7f62981f0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:26.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.391+0000 7f6297e00640 1 --2- 172.21.15.112:0/3535562375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6298142f40 0x7f62981f0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:26.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.391+0000 7f6297e00640 1 -- 172.21.15.112:0/3535562375 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6298142d10 con 0x7f627c0039b0 2024-09-12T02:45:26.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.392+0000 7f6297e00640 1 --2- 172.21.15.112:0/3535562375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f627c0039b0 0x7f62981427d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f628802add0 tx=0x7f6288001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:26.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.392+0000 7f6294c00640 1 -- 172.21.15.112:0/3535562375 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6288041070 con 0x7f627c0039b0 2024-09-12T02:45:26.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.392+0000 7f6294c00640 1 -- 172.21.15.112:0/3535562375 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6288001690 con 0x7f627c0039b0 2024-09-12T02:45:26.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.392+0000 7f6294c00640 1 -- 172.21.15.112:0/3535562375 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6288037040 con 0x7f627c0039b0 2024-09-12T02:45:26.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.392+0000 7f629ec00640 1 -- 172.21.15.112:0/3535562375 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f629815c070 con 0x7f627c0039b0 2024-09-12T02:45:26.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.392+0000 7f629ec00640 1 -- 172.21.15.112:0/3535562375 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f629815c630 con 0x7f627c0039b0 2024-09-12T02:45:26.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.393+0000 7f629ec00640 1 -- 172.21.15.112:0/3535562375 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62980b58c0 con 0x7f627c0039b0 2024-09-12T02:45:26.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.394+0000 7f6294c00640 1 -- 172.21.15.112:0/3535562375 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6288044070 con 0x7f627c0039b0 2024-09-12T02:45:26.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.395+0000 7f6294c00640 1 --2- 172.21.15.112:0/3535562375 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f627406be60 0x7f627406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:26.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.395+0000 7f6294c00640 1 -- 172.21.15.112:0/3535562375 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5357+0+0 (secure 0 0 0) 0x7f62880a9fa0 con 0x7f627c0039b0 2024-09-12T02:45:26.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.395+0000 7f628f400640 1 --2- 172.21.15.112:0/3535562375 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f627406be60 0x7f627406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:26.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.396+0000 7f628f400640 1 --2- 172.21.15.112:0/3535562375 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f627406be60 0x7f627406e320 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6298072c30 tx=0x7f6280009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:26.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.399+0000 7f6294c00640 1 -- 172.21.15.112:0/3535562375 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f62880783c0 con 0x7f627c0039b0 2024-09-12T02:45:26.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:26.572+0000 7f629ec00640 1 -- 172.21.15.112:0/3535562375 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f62980731a0 con 0x7f627c0039b0 2024-09-12T02:45:27.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.205+0000 7f6294c00640 1 -- 172.21.15.112:0/3535562375 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v70) ==== 169+0+0 (secure 0 0 0) 0x7f628807c6c0 con 0x7f627c0039b0 2024-09-12T02:45:27.206 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' removed 2024-09-12T02:45:27.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.210+0000 7f629ec00640 1 -- 172.21.15.112:0/3535562375 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f627406be60 msgr2=0x7f627406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:27.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.210+0000 7f629ec00640 1 --2- 172.21.15.112:0/3535562375 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f627406be60 0x7f627406e320 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6298072c30 tx=0x7f6280009040 comp rx=0 tx=0).stop 2024-09-12T02:45:27.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.210+0000 7f629ec00640 1 -- 172.21.15.112:0/3535562375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f627c0039b0 msgr2=0x7f62981427d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:27.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.210+0000 7f629ec00640 1 --2- 172.21.15.112:0/3535562375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f627c0039b0 0x7f62981427d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f628802add0 tx=0x7f6288001a60 comp rx=0 tx=0).stop 2024-09-12T02:45:27.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.210+0000 7f629ec00640 1 -- 172.21.15.112:0/3535562375 shutdown_connections 2024-09-12T02:45:27.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.210+0000 7f629ec00640 1 --2- 172.21.15.112:0/3535562375 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f627406be60 0x7f627406e320 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.210+0000 7f629ec00640 1 --2- 172.21.15.112:0/3535562375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6298142f40 0x7f62981f0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.210+0000 7f629ec00640 1 --2- 172.21.15.112:0/3535562375 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f629815bb70 0x7f629815d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.210+0000 7f629ec00640 1 --2- 172.21.15.112:0/3535562375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f627c0039b0 0x7f62981427d0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.210+0000 7f629ec00640 1 -- 172.21.15.112:0/3535562375 >> 172.21.15.112:0/3535562375 conn(0x7f62980b2730 msgr2=0x7f62980cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:27.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.210+0000 7f629ec00640 1 -- 172.21.15.112:0/3535562375 shutdown_connections 2024-09-12T02:45:27.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.210+0000 7f629ec00640 1 -- 172.21.15.112:0/3535562375 wait complete. 2024-09-12T02:45:27.232 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T02:45:27.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.384+0000 7f667fc00640 1 Processor -- start 2024-09-12T02:45:27.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.384+0000 7f667fc00640 1 -- start start 2024-09-12T02:45:27.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.386+0000 7f667fc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f667815cc50 0x7f66780732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.386+0000 7f667fc00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6678071530 0x7f66780af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.386+0000 7f667fc00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6678073830 con 0x7f6678071970 2024-09-12T02:45:27.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.386+0000 7f667fc00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f667815d030 con 0x7f6678071530 2024-09-12T02:45:27.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.386+0000 7f667fc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f66780cf4c0 con 0x7f667815cc50 2024-09-12T02:45:27.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.386+0000 7f666fe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6678071530 0x7f66780af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.386+0000 7f666fe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6678071530 0x7f66780af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56722/0 (socket says 172.21.15.112:56722) 2024-09-12T02:45:27.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.386+0000 7f666fe00640 1 -- 172.21.15.112:0/2415152033 learned_addr learned my addr 172.21.15.112:0/2415152033 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:27.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.386+0000 7f667d200640 1 --2- 172.21.15.112:0/2415152033 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f667815cc50 0x7f66780732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.386+0000 7f666fe00640 1 -- 172.21.15.112:0/2415152033 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f667815cc50 msgr2=0x7f66780732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:27.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.386+0000 7f666fe00640 1 --2- 172.21.15.112:0/2415152033 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f667815cc50 0x7f66780732f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.386+0000 7f666fe00640 1 -- 172.21.15.112:0/2415152033 >> v1:172.21.15.137:6789/0 conn(0x7f6678071970 legacy=0x7f66780cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:27.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.386+0000 7f666fe00640 1 -- 172.21.15.112:0/2415152033 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66780ceeb0 con 0x7f6678071530 2024-09-12T02:45:27.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.386+0000 7f667d200640 1 --2- 172.21.15.112:0/2415152033 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f667815cc50 0x7f66780732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:45:27.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.387+0000 7f666fe00640 1 --2- 172.21.15.112:0/2415152033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6678071530 0x7f66780af720 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6660009850 tx=0x7f666002a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e03e8bc4d3a6e7d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:27.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.388+0000 7f6677e00640 1 -- 172.21.15.112:0/2415152033 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666002ae60 con 0x7f6678071530 2024-09-12T02:45:27.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.388+0000 7f6677e00640 1 -- 172.21.15.112:0/2415152033 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6660004030 con 0x7f6678071530 2024-09-12T02:45:27.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.388+0000 7f6677e00640 1 -- 172.21.15.112:0/2415152033 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6660004460 con 0x7f6678071530 2024-09-12T02:45:27.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.388+0000 7f667fc00640 1 -- 172.21.15.112:0/2415152033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6678071530 msgr2=0x7f66780af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:27.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.388+0000 7f667fc00640 1 --2- 172.21.15.112:0/2415152033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6678071530 0x7f66780af720 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6660009850 tx=0x7f666002a150 comp rx=0 tx=0).stop 2024-09-12T02:45:27.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.388+0000 7f667fc00640 1 -- 172.21.15.112:0/2415152033 shutdown_connections 2024-09-12T02:45:27.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.388+0000 7f667fc00640 1 --2- 172.21.15.112:0/2415152033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6678071530 0x7f66780af720 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.388+0000 7f667fc00640 1 --2- 172.21.15.112:0/2415152033 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f667815cc50 0x7f66780732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.388+0000 7f667fc00640 1 -- 172.21.15.112:0/2415152033 >> 172.21.15.112:0/2415152033 conn(0x7f667806bbd0 msgr2=0x7f667806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:27.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.388+0000 7f667fc00640 1 -- 172.21.15.112:0/2415152033 shutdown_connections 2024-09-12T02:45:27.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.388+0000 7f667fc00640 1 -- 172.21.15.112:0/2415152033 wait complete. 2024-09-12T02:45:27.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.390+0000 7f667fc00640 1 Processor -- start 2024-09-12T02:45:27.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.390+0000 7f667fc00640 1 -- start start 2024-09-12T02:45:27.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.391+0000 7f667fc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6678071530 0x7f66780aa530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.391+0000 7f667fc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6678071970 0x7f66781f3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.391+0000 7f667fc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f667815cc50 0x7f667814ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.391+0000 7f667fc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f66780cf150 con 0x7f667815cc50 2024-09-12T02:45:27.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.391+0000 7f667fc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f667806e5e0 con 0x7f6678071970 2024-09-12T02:45:27.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.391+0000 7f667fc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f667806f510 con 0x7f6678071530 2024-09-12T02:45:27.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.391+0000 7f667dc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f667815cc50 0x7f667814ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.391+0000 7f667dc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f667815cc50 0x7f667814ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56724/0 (socket says 172.21.15.112:56724) 2024-09-12T02:45:27.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.391+0000 7f667dc00640 1 -- 172.21.15.112:0/1001758200 learned_addr learned my addr 172.21.15.112:0/1001758200 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:27.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.391+0000 7f667d200640 1 --2- 172.21.15.112:0/1001758200 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6678071530 0x7f66780aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.391+0000 7f666fe00640 1 --2- 172.21.15.112:0/1001758200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6678071970 0x7f66781f3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.392+0000 7f667dc00640 1 -- 172.21.15.112:0/1001758200 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6678071530 msgr2=0x7f66780aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:27.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.392+0000 7f667dc00640 1 --2- 172.21.15.112:0/1001758200 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6678071530 0x7f66780aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.392+0000 7f667dc00640 1 -- 172.21.15.112:0/1001758200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6678071970 msgr2=0x7f66781f3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:27.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.392+0000 7f667dc00640 1 --2- 172.21.15.112:0/1001758200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6678071970 0x7f66781f3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.392+0000 7f667dc00640 1 -- 172.21.15.112:0/1001758200 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66780aac30 con 0x7f667815cc50 2024-09-12T02:45:27.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.392+0000 7f667dc00640 1 --2- 172.21.15.112:0/1001758200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f667815cc50 0x7f667814ad00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f667000c7b0 tx=0x7f667000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:27.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.392+0000 7f6675600640 1 -- 172.21.15.112:0/1001758200 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6670017070 con 0x7f667815cc50 2024-09-12T02:45:27.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.392+0000 7f6675600640 1 -- 172.21.15.112:0/1001758200 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6670003da0 con 0x7f667815cc50 2024-09-12T02:45:27.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.392+0000 7f667fc00640 1 -- 172.21.15.112:0/1001758200 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66780aaf10 con 0x7f667815cc50 2024-09-12T02:45:27.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.392+0000 7f6675600640 1 -- 172.21.15.112:0/1001758200 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f667000ce60 con 0x7f667815cc50 2024-09-12T02:45:27.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.393+0000 7f667fc00640 1 -- 172.21.15.112:0/1001758200 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66780ab4d0 con 0x7f667815cc50 2024-09-12T02:45:27.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.393+0000 7f667fc00640 1 -- 172.21.15.112:0/1001758200 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6678068a30 con 0x7f667815cc50 2024-09-12T02:45:27.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.394+0000 7f6675600640 1 -- 172.21.15.112:0/1001758200 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f667001a070 con 0x7f667815cc50 2024-09-12T02:45:27.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.395+0000 7f6675600640 1 --2- 172.21.15.112:0/1001758200 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f665406be30 0x7f665406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.395+0000 7f6675600640 1 -- 172.21.15.112:0/1001758200 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 4943+0+0 (secure 0 0 0) 0x7f667008a0c0 con 0x7f667815cc50 2024-09-12T02:45:27.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.395+0000 7f667d200640 1 --2- 172.21.15.112:0/1001758200 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f665406be30 0x7f665406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.396+0000 7f667d200640 1 --2- 172.21.15.112:0/1001758200 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f665406be30 0x7f665406e2f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f66780ad270 tx=0x7f6668008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:27.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.400+0000 7f6675600640 1 -- 172.21.15.112:0/1001758200 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6670058710 con 0x7f667815cc50 2024-09-12T02:45:27.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.573+0000 7f667fc00640 1 -- 172.21.15.112:0/1001758200 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f667806df60 con 0x7f667815cc50 2024-09-12T02:45:27.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.578+0000 7f6675600640 1 -- 172.21.15.112:0/1001758200 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) ==== 104+0+0 (secure 0 0 0) 0x7f667005ca10 con 0x7f667815cc50 2024-09-12T02:45:27.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.580+0000 7f667fc00640 1 -- 172.21.15.112:0/1001758200 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f665406be30 msgr2=0x7f665406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:27.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.580+0000 7f667fc00640 1 --2- 172.21.15.112:0/1001758200 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f665406be30 0x7f665406e2f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f66780ad270 tx=0x7f6668008040 comp rx=0 tx=0).stop 2024-09-12T02:45:27.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.580+0000 7f667fc00640 1 -- 172.21.15.112:0/1001758200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f667815cc50 msgr2=0x7f667814ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:27.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.580+0000 7f667fc00640 1 --2- 172.21.15.112:0/1001758200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f667815cc50 0x7f667814ad00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f667000c7b0 tx=0x7f667000cc70 comp rx=0 tx=0).stop 2024-09-12T02:45:27.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.580+0000 7f667fc00640 1 -- 172.21.15.112:0/1001758200 shutdown_connections 2024-09-12T02:45:27.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.580+0000 7f667fc00640 1 --2- 172.21.15.112:0/1001758200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f667815cc50 0x7f667814ad00 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.580+0000 7f667fc00640 1 --2- 172.21.15.112:0/1001758200 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f665406be30 0x7f665406e2f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.580+0000 7f667fc00640 1 --2- 172.21.15.112:0/1001758200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6678071970 0x7f66781f3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.580+0000 7f667fc00640 1 --2- 172.21.15.112:0/1001758200 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6678071530 0x7f66780aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.580+0000 7f667fc00640 1 -- 172.21.15.112:0/1001758200 >> 172.21.15.112:0/1001758200 conn(0x7f667806bbd0 msgr2=0x7f66780cf950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:27.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.580+0000 7f667fc00640 1 -- 172.21.15.112:0/1001758200 shutdown_connections 2024-09-12T02:45:27.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.580+0000 7f667fc00640 1 -- 172.21.15.112:0/1001758200 wait complete. 2024-09-12T02:45:27.597 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2024-09-12T02:45:27.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.748+0000 7fe791600640 1 Processor -- start 2024-09-12T02:45:27.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.748+0000 7fe791600640 1 -- start start 2024-09-12T02:45:27.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.749+0000 7fe791600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe78c0b3e00 0x7fe78c0d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.749+0000 7fe791600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe78c0b1d70 0x7fe78c0b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.749+0000 7fe791600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe78c0d2fb0 con 0x7fe78c0d1710 2024-09-12T02:45:27.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.749+0000 7fe791600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe78c0d3cb0 con 0x7fe78c0b3e00 2024-09-12T02:45:27.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.749+0000 7fe791600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe78c0d0b60 con 0x7fe78c0b1d70 2024-09-12T02:45:27.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.750+0000 7fe78be00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe78c0d1710 0x7fe78c0d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55704/0 (socket says 172.21.15.112:55704) 2024-09-12T02:45:27.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.750+0000 7fe78be00640 1 -- 172.21.15.112:0/1603086878 learned_addr learned my addr 172.21.15.112:0/1603086878 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:45:27.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.750+0000 7fe790c00640 1 --2- 172.21.15.112:0/1603086878 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe78c0b1d70 0x7fe78c0b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.750+0000 7fe78b400640 1 --2- 172.21.15.112:0/1603086878 >> v2:172.21.15.137:3300/0 conn(0x7fe78c0b3e00 0x7fe78c0d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.750+0000 7fe78aa00640 1 -- 172.21.15.112:0/1603086878 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1970169683 0 0) 0x7fe78c0d2fb0 con 0x7fe78c0d1710 2024-09-12T02:45:27.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.750+0000 7fe78aa00640 1 -- 172.21.15.112:0/1603086878 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe770003520 con 0x7fe78c0d1710 2024-09-12T02:45:27.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.750+0000 7fe790c00640 1 -- 172.21.15.112:0/1603086878 >> v2:172.21.15.137:3300/0 conn(0x7fe78c0b3e00 msgr2=0x7fe78c0d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:27.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.750+0000 7fe78aa00640 1 -- 172.21.15.112:0/1603086878 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1393029333 0 0) 0x7fe770003520 con 0x7fe78c0d1710 2024-09-12T02:45:27.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.750+0000 7fe790c00640 1 --2- 172.21.15.112:0/1603086878 >> v2:172.21.15.137:3300/0 conn(0x7fe78c0b3e00 0x7fe78c0d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.750+0000 7fe790c00640 1 -- 172.21.15.112:0/1603086878 >> v1:172.21.15.112:6789/0 conn(0x7fe78c0d1710 legacy=0x7fe78c0d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:27.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.750+0000 7fe790c00640 1 -- 172.21.15.112:0/1603086878 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe78c0d3410 con 0x7fe78c0b1d70 2024-09-12T02:45:27.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.750+0000 7fe78b400640 1 --2- 172.21.15.112:0/1603086878 >> v2:172.21.15.137:3300/0 conn(0x7fe78c0b3e00 0x7fe78c0d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:45:27.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.751+0000 7fe790c00640 1 --2- 172.21.15.112:0/1603086878 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe78c0b1d70 0x7fe78c0b2200 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe784009d90 tx=0x7fe78402a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=228c2569b3a873bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:27.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.752+0000 7fe78aa00640 1 -- 172.21.15.112:0/1603086878 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77c001670 con 0x7fe78c0b1d70 2024-09-12T02:45:27.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.752+0000 7fe78aa00640 1 -- 172.21.15.112:0/1603086878 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe784007540 con 0x7fe78c0b1d70 2024-09-12T02:45:27.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.752+0000 7fe78aa00640 1 -- 172.21.15.112:0/1603086878 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7840078f0 con 0x7fe78c0b1d70 2024-09-12T02:45:27.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.752+0000 7fe791600640 1 -- 172.21.15.112:0/1603086878 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe78c0b1d70 msgr2=0x7fe78c0b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:27.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.752+0000 7fe791600640 1 --2- 172.21.15.112:0/1603086878 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe78c0b1d70 0x7fe78c0b2200 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe784009d90 tx=0x7fe78402a5f0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.752+0000 7fe791600640 1 -- 172.21.15.112:0/1603086878 shutdown_connections 2024-09-12T02:45:27.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.752+0000 7fe791600640 1 --2- 172.21.15.112:0/1603086878 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe78c0b1d70 0x7fe78c0b2200 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.752+0000 7fe791600640 1 --2- 172.21.15.112:0/1603086878 >> v2:172.21.15.137:3300/0 conn(0x7fe78c0b3e00 0x7fe78c0d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.752+0000 7fe791600640 1 -- 172.21.15.112:0/1603086878 >> 172.21.15.112:0/1603086878 conn(0x7fe78c09e030 msgr2=0x7fe78c0d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:27.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.752+0000 7fe791600640 1 -- 172.21.15.112:0/1603086878 shutdown_connections 2024-09-12T02:45:27.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.752+0000 7fe791600640 1 -- 172.21.15.112:0/1603086878 wait complete. 2024-09-12T02:45:27.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.754+0000 7fe791600640 1 Processor -- start 2024-09-12T02:45:27.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.754+0000 7fe791600640 1 -- start start 2024-09-12T02:45:27.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.755+0000 7fe791600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe78c0b1d70 0x7fe78c1500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.755+0000 7fe791600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe78c0b3e00 0x7fe78c0b6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.755+0000 7fe791600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe78c0d1710 0x7fe78c0b6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.755+0000 7fe791600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe78c15f110 con 0x7fe78c0d1710 2024-09-12T02:45:27.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.755+0000 7fe791600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe78c0d39d0 con 0x7fe78c0b1d70 2024-09-12T02:45:27.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.755+0000 7fe791600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe78c15f290 con 0x7fe78c0b3e00 2024-09-12T02:45:27.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.755+0000 7fe790c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe78c0d1710 0x7fe78c0b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.755+0000 7fe790c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe78c0d1710 0x7fe78c0b6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56730/0 (socket says 172.21.15.112:56730) 2024-09-12T02:45:27.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.755+0000 7fe790c00640 1 -- 172.21.15.112:0/1483919702 learned_addr learned my addr 172.21.15.112:0/1483919702 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:27.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.755+0000 7fe78b400640 1 --2- 172.21.15.112:0/1483919702 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe78c0b3e00 0x7fe78c0b6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.755+0000 7fe78be00640 1 --2- 172.21.15.112:0/1483919702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe78c0b1d70 0x7fe78c1500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.756+0000 7fe790c00640 1 -- 172.21.15.112:0/1483919702 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe78c0b3e00 msgr2=0x7fe78c0b6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:27.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.756+0000 7fe790c00640 1 --2- 172.21.15.112:0/1483919702 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe78c0b3e00 0x7fe78c0b6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.756+0000 7fe790c00640 1 -- 172.21.15.112:0/1483919702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe78c0b1d70 msgr2=0x7fe78c1500e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:27.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.756+0000 7fe790c00640 1 --2- 172.21.15.112:0/1483919702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe78c0b1d70 0x7fe78c1500e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.756+0000 7fe790c00640 1 -- 172.21.15.112:0/1483919702 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe78c1600e0 con 0x7fe78c0d1710 2024-09-12T02:45:27.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.756+0000 7fe790c00640 1 --2- 172.21.15.112:0/1483919702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe78c0d1710 0x7fe78c0b6880 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe78402abe0 tx=0x7fe784004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:27.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.756+0000 7fe783e00640 1 -- 172.21.15.112:0/1483919702 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe784009450 con 0x7fe78c0d1710 2024-09-12T02:45:27.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.756+0000 7fe783e00640 1 -- 172.21.15.112:0/1483919702 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe784004240 con 0x7fe78c0d1710 2024-09-12T02:45:27.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.756+0000 7fe783e00640 1 -- 172.21.15.112:0/1483919702 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7840045f0 con 0x7fe78c0d1710 2024-09-12T02:45:27.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.756+0000 7fe791600640 1 -- 172.21.15.112:0/1483919702 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe78c1603c0 con 0x7fe78c0d1710 2024-09-12T02:45:27.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.756+0000 7fe791600640 1 -- 172.21.15.112:0/1483919702 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe78c160980 con 0x7fe78c0d1710 2024-09-12T02:45:27.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.757+0000 7fe791600640 1 -- 172.21.15.112:0/1483919702 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe78c0d28d0 con 0x7fe78c0d1710 2024-09-12T02:45:27.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.758+0000 7fe783e00640 1 -- 172.21.15.112:0/1483919702 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe784039040 con 0x7fe78c0d1710 2024-09-12T02:45:27.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.759+0000 7fe783e00640 1 --2- 172.21.15.112:0/1483919702 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe76c06be30 0x7fe76c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.759+0000 7fe783e00640 1 -- 172.21.15.112:0/1483919702 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 4943+0+0 (secure 0 0 0) 0x7fe7840abdf0 con 0x7fe78c0d1710 2024-09-12T02:45:27.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.759+0000 7fe78be00640 1 --2- 172.21.15.112:0/1483919702 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe76c06be30 0x7fe76c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.760+0000 7fe78be00640 1 --2- 172.21.15.112:0/1483919702 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe76c06be30 0x7fe76c06e2f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe77c005880 tx=0x7fe77c0057f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:27.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:27.763+0000 7fe783e00640 1 -- 172.21.15.112:0/1483919702 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe784040030 con 0x7fe78c0d1710 2024-09-12T02:45:28.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.000+0000 7fe791600640 1 -- 172.21.15.112:0/1483919702 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) -- 0x7fe78c0ba640 con 0x7fe78c0d1710 2024-09-12T02:45:28.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.207+0000 7fe783e00640 1 -- 172.21.15.112:0/1483919702 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v190) ==== 134+0+0 (secure 0 0 0) 0x7fe78407a3c0 con 0x7fe78c0d1710 2024-09-12T02:45:28.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.209+0000 7fe791600640 1 -- 172.21.15.112:0/1483919702 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe76c06be30 msgr2=0x7fe76c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:28.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.209+0000 7fe791600640 1 --2- 172.21.15.112:0/1483919702 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe76c06be30 0x7fe76c06e2f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe77c005880 tx=0x7fe77c0057f0 comp rx=0 tx=0).stop 2024-09-12T02:45:28.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.209+0000 7fe791600640 1 -- 172.21.15.112:0/1483919702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe78c0d1710 msgr2=0x7fe78c0b6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:28.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.209+0000 7fe791600640 1 --2- 172.21.15.112:0/1483919702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe78c0d1710 0x7fe78c0b6880 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe78402abe0 tx=0x7fe784004a40 comp rx=0 tx=0).stop 2024-09-12T02:45:28.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.209+0000 7fe791600640 1 -- 172.21.15.112:0/1483919702 shutdown_connections 2024-09-12T02:45:28.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.209+0000 7fe791600640 1 --2- 172.21.15.112:0/1483919702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe78c0d1710 0x7fe78c0b6880 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:28.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.209+0000 7fe791600640 1 --2- 172.21.15.112:0/1483919702 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe78c0b3e00 0x7fe78c0b6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:28.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.209+0000 7fe791600640 1 --2- 172.21.15.112:0/1483919702 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe76c06be30 0x7fe76c06e2f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:28.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.209+0000 7fe791600640 1 --2- 172.21.15.112:0/1483919702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe78c0b1d70 0x7fe78c1500e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:28.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.209+0000 7fe791600640 1 -- 172.21.15.112:0/1483919702 >> 172.21.15.112:0/1483919702 conn(0x7fe78c09e030 msgr2=0x7fe78c06c480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:28.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.210+0000 7fe791600640 1 -- 172.21.15.112:0/1483919702 shutdown_connections 2024-09-12T02:45:28.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.210+0000 7fe791600640 1 -- 172.21.15.112:0/1483919702 wait complete. 2024-09-12T02:45:28.227 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestClusterFull) ... ok 2024-09-12T02:45:28.227 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) That when the full flag is encountered during asynchronous 2024-09-12T02:45:28.227 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestClusterFull) 2024-09-12T02:45:28.228 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:45:28.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.380+0000 7fc057200640 1 Processor -- start 2024-09-12T02:45:28.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.381+0000 7fc057200640 1 -- start start 2024-09-12T02:45:28.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.382+0000 7fc057200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc05806d590 0x7fc05806f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:28.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.382+0000 7fc057200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc0580d0820 0x7fc0580d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:28.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.382+0000 7fc057200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0580b42c0 con 0x7fc05815b9a0 2024-09-12T02:45:28.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.382+0000 7fc057200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc05806de70 con 0x7fc05806d590 2024-09-12T02:45:28.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.382+0000 7fc057200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc05815bd80 con 0x7fc0580d0820 2024-09-12T02:45:28.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.382+0000 7fc055e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc05815b9a0 0x7fc0580b5020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55720/0 (socket says 172.21.15.112:55720) 2024-09-12T02:45:28.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.382+0000 7fc055e00640 1 -- 172.21.15.112:0/4102144032 learned_addr learned my addr 172.21.15.112:0/4102144032 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:45:28.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.382+0000 7fc055400640 1 --2- 172.21.15.112:0/4102144032 >> v2:172.21.15.112:3300/0 conn(0x7fc05806d590 0x7fc05806f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:28.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.383+0000 7fc056800640 1 --2- 172.21.15.112:0/4102144032 >> v2:172.21.15.137:3300/0 conn(0x7fc0580d0820 0x7fc0580d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:28.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.383+0000 7fc055400640 1 -- 172.21.15.112:0/4102144032 >> v2:172.21.15.137:3300/0 conn(0x7fc0580d0820 msgr2=0x7fc0580d0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:28.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.383+0000 7fc055400640 1 --2- 172.21.15.112:0/4102144032 >> v2:172.21.15.137:3300/0 conn(0x7fc0580d0820 0x7fc0580d0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:28.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.383+0000 7fc055400640 1 -- 172.21.15.112:0/4102144032 >> v1:172.21.15.112:6789/0 conn(0x7fc05815b9a0 legacy=0x7fc0580b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:28.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.383+0000 7fc054a00640 1 -- 172.21.15.112:0/4102144032 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4096408978 0 0) 0x7fc048001110 con 0x7fc05815b9a0 2024-09-12T02:45:28.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.383+0000 7fc055400640 1 -- 172.21.15.112:0/4102144032 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0580b5730 con 0x7fc05806d590 2024-09-12T02:45:28.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.383+0000 7fc056800640 1 --2- 172.21.15.112:0/4102144032 >> v2:172.21.15.137:3300/0 conn(0x7fc0580d0820 0x7fc0580d0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:45:28.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.384+0000 7fc055400640 1 --2- 172.21.15.112:0/4102144032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc05806d590 0x7fc05806f270 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc05806f7b0 tx=0x7fc04402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef383527e9769d14 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:28.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.384+0000 7fc054a00640 1 -- 172.21.15.112:0/4102144032 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc044037070 con 0x7fc05806d590 2024-09-12T02:45:28.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.384+0000 7fc054a00640 1 -- 172.21.15.112:0/4102144032 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc044032440 con 0x7fc05806d590 2024-09-12T02:45:28.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.384+0000 7fc054a00640 1 -- 172.21.15.112:0/4102144032 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc044032810 con 0x7fc05806d590 2024-09-12T02:45:28.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.384+0000 7fc057200640 1 -- 172.21.15.112:0/4102144032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc05806d590 msgr2=0x7fc05806f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:28.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.384+0000 7fc057200640 1 --2- 172.21.15.112:0/4102144032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc05806d590 0x7fc05806f270 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc05806f7b0 tx=0x7fc04402a1a0 comp rx=0 tx=0).stop 2024-09-12T02:45:28.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.384+0000 7fc057200640 1 -- 172.21.15.112:0/4102144032 shutdown_connections 2024-09-12T02:45:28.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.384+0000 7fc057200640 1 --2- 172.21.15.112:0/4102144032 >> v2:172.21.15.137:3300/0 conn(0x7fc0580d0820 0x7fc0580d0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:28.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.385+0000 7fc057200640 1 --2- 172.21.15.112:0/4102144032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc05806d590 0x7fc05806f270 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:28.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.385+0000 7fc057200640 1 -- 172.21.15.112:0/4102144032 >> 172.21.15.112:0/4102144032 conn(0x7fc05806bbd0 msgr2=0x7fc05806bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:28.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.385+0000 7fc057200640 1 -- 172.21.15.112:0/4102144032 shutdown_connections 2024-09-12T02:45:28.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.385+0000 7fc057200640 1 -- 172.21.15.112:0/4102144032 wait complete. 2024-09-12T02:45:28.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.386+0000 7fc057200640 1 Processor -- start 2024-09-12T02:45:28.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.386+0000 7fc057200640 1 -- start start 2024-09-12T02:45:28.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.387+0000 7fc057200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc05806d590 0x7fc058152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:28.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.387+0000 7fc057200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0580d0820 0x7fc0580c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:28.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.387+0000 7fc057200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc05815b9a0 0x7fc0580c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:28.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.387+0000 7fc057200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc0580b4820 con 0x7fc05815b9a0 2024-09-12T02:45:28.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.387+0000 7fc057200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc0580b4540 con 0x7fc0580d0820 2024-09-12T02:45:28.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.387+0000 7fc057200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc0580b4b00 con 0x7fc05806d590 2024-09-12T02:45:28.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.387+0000 7fc056800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc05815b9a0 0x7fc0580c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:28.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.388+0000 7fc056800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc05815b9a0 0x7fc0580c5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56742/0 (socket says 172.21.15.112:56742) 2024-09-12T02:45:28.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.388+0000 7fc056800640 1 -- 172.21.15.112:0/3555616303 learned_addr learned my addr 172.21.15.112:0/3555616303 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:28.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.388+0000 7fc055400640 1 --2- 172.21.15.112:0/3555616303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0580d0820 0x7fc0580c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:28.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.388+0000 7fc055e00640 1 --2- 172.21.15.112:0/3555616303 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc05806d590 0x7fc058152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:28.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.388+0000 7fc056800640 1 -- 172.21.15.112:0/3555616303 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc05806d590 msgr2=0x7fc058152540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:28.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.388+0000 7fc056800640 1 --2- 172.21.15.112:0/3555616303 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc05806d590 0x7fc058152540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:28.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.388+0000 7fc056800640 1 -- 172.21.15.112:0/3555616303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0580d0820 msgr2=0x7fc0580c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:28.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.388+0000 7fc056800640 1 --2- 172.21.15.112:0/3555616303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0580d0820 0x7fc0580c5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:28.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.388+0000 7fc056800640 1 -- 172.21.15.112:0/3555616303 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0580c63c0 con 0x7fc05815b9a0 2024-09-12T02:45:28.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.388+0000 7fc056800640 1 --2- 172.21.15.112:0/3555616303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc05815b9a0 0x7fc0580c5d90 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc05000cef0 tx=0x7fc05000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:28.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.388+0000 7fc04e000640 1 -- 172.21.15.112:0/3555616303 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05001a070 con 0x7fc05815b9a0 2024-09-12T02:45:28.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.388+0000 7fc04e000640 1 -- 172.21.15.112:0/3555616303 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc05000d860 con 0x7fc05815b9a0 2024-09-12T02:45:28.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.388+0000 7fc057200640 1 -- 172.21.15.112:0/3555616303 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0580c66a0 con 0x7fc05815b9a0 2024-09-12T02:45:28.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.388+0000 7fc04e000640 1 -- 172.21.15.112:0/3555616303 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05000dc50 con 0x7fc05815b9a0 2024-09-12T02:45:28.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.389+0000 7fc057200640 1 -- 172.21.15.112:0/3555616303 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0580c6f40 con 0x7fc05815b9a0 2024-09-12T02:45:28.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.390+0000 7fc057200640 1 -- 172.21.15.112:0/3555616303 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0580c6a90 con 0x7fc05815b9a0 2024-09-12T02:45:28.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.390+0000 7fc04e000640 1 -- 172.21.15.112:0/3555616303 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc05001d070 con 0x7fc05815b9a0 2024-09-12T02:45:28.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.392+0000 7fc04e000640 1 --2- 172.21.15.112:0/3555616303 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc03806be30 0x7fc03806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:28.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.392+0000 7fc04e000640 1 -- 172.21.15.112:0/3555616303 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 4943+0+0 (secure 0 0 0) 0x7fc05008b3a0 con 0x7fc05815b9a0 2024-09-12T02:45:28.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.392+0000 7fc055e00640 1 --2- 172.21.15.112:0/3555616303 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc03806be30 0x7fc03806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:28.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.392+0000 7fc055e00640 1 --2- 172.21.15.112:0/3555616303 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc03806be30 0x7fc03806e2f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc048000f60 tx=0x7fc048007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:28.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.396+0000 7fc04e000640 1 -- 172.21.15.112:0/3555616303 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc050059ab0 con 0x7fc05815b9a0 2024-09-12T02:45:28.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.572+0000 7fc057200640 1 -- 172.21.15.112:0/3555616303 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc0580b5b50 con 0x7fc05815b9a0 2024-09-12T02:45:28.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.573+0000 7fc04e000640 1 -- 172.21.15.112:0/3555616303 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+13082 (secure 0 0 0) 0x7fc05005ddb0 con 0x7fc05815b9a0 2024-09-12T02:45:28.574 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:45:28.575 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":70,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:45:27.200995+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6835/3039296510":"2024-09-13T02:45:24.068147+0000","172.21.15.112:6834/3039296510":"2024-09-13T02:45:24.068147+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:45:28.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.575+0000 7fc057200640 1 -- 172.21.15.112:0/3555616303 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc03806be30 msgr2=0x7fc03806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:28.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.575+0000 7fc057200640 1 --2- 172.21.15.112:0/3555616303 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc03806be30 0x7fc03806e2f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc048000f60 tx=0x7fc048007c00 comp rx=0 tx=0).stop 2024-09-12T02:45:28.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.575+0000 7fc057200640 1 -- 172.21.15.112:0/3555616303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc05815b9a0 msgr2=0x7fc0580c5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:28.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.575+0000 7fc057200640 1 --2- 172.21.15.112:0/3555616303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc05815b9a0 0x7fc0580c5d90 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc05000cef0 tx=0x7fc05000a710 comp rx=0 tx=0).stop 2024-09-12T02:45:28.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.576+0000 7fc057200640 1 -- 172.21.15.112:0/3555616303 shutdown_connections 2024-09-12T02:45:28.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.576+0000 7fc057200640 1 --2- 172.21.15.112:0/3555616303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc05815b9a0 0x7fc0580c5d90 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:28.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.576+0000 7fc057200640 1 --2- 172.21.15.112:0/3555616303 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc03806be30 0x7fc03806e2f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:28.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.576+0000 7fc057200640 1 --2- 172.21.15.112:0/3555616303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0580d0820 0x7fc0580c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:28.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.576+0000 7fc057200640 1 --2- 172.21.15.112:0/3555616303 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc05806d590 0x7fc058152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:28.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.576+0000 7fc057200640 1 -- 172.21.15.112:0/3555616303 >> 172.21.15.112:0/3555616303 conn(0x7fc05806bbd0 msgr2=0x7fc0580ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:28.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.576+0000 7fc057200640 1 -- 172.21.15.112:0/3555616303 shutdown_connections 2024-09-12T02:45:28.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.576+0000 7fc057200640 1 -- 172.21.15.112:0/3555616303 wait complete. 2024-09-12T02:45:28.592 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:41:43.011599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:45:28.593 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T02:45:28.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.747+0000 7f9c5c800640 1 Processor -- start 2024-09-12T02:45:28.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.747+0000 7f9c5c800640 1 -- start start 2024-09-12T02:45:28.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.749+0000 7f9c5c800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9c5415cc50 0x7f9c540732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:28.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.749+0000 7f9c5c800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9c54071530 0x7f9c540af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:28.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.749+0000 7f9c5c800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c540719a0 0x7f9c540afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:28.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.749+0000 7f9c5c800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f9c5415d030 con 0x7f9c54071530 2024-09-12T02:45:28.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.749+0000 7f9c5c800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f9c540cf4c0 con 0x7f9c5415cc50 2024-09-12T02:45:28.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.749+0000 7f9c5c800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9c54073830 con 0x7f9c540719a0 2024-09-12T02:45:28.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.749+0000 7f9c59400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9c54071530 0x7f9c540af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:28.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.749+0000 7f9c59400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9c54071530 0x7f9c540af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56756/0 (socket says 172.21.15.112:56756) 2024-09-12T02:45:28.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.749+0000 7f9c59400640 1 -- 172.21.15.112:0/888789821 learned_addr learned my addr 172.21.15.112:0/888789821 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:28.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.749+0000 7f9c5a800640 1 --2- 172.21.15.112:0/888789821 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c540719a0 0x7f9c540afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:28.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.749+0000 7f9c59e00640 1 --2- 172.21.15.112:0/888789821 >> v2:172.21.15.137:3300/0 conn(0x7f9c5415cc50 0x7f9c540732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:28.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.749+0000 7f9c59400640 1 -- 172.21.15.112:0/888789821 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c540719a0 msgr2=0x7f9c540afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:28.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.749+0000 7f9c59400640 1 --2- 172.21.15.112:0/888789821 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c540719a0 0x7f9c540afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:28.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.749+0000 7f9c59400640 1 -- 172.21.15.112:0/888789821 >> v2:172.21.15.137:3300/0 conn(0x7f9c5415cc50 msgr2=0x7f9c540732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:28.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.749+0000 7f9c59400640 1 --2- 172.21.15.112:0/888789821 >> v2:172.21.15.137:3300/0 conn(0x7f9c5415cc50 0x7f9c540732f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:28.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.749+0000 7f9c59400640 1 -- 172.21.15.112:0/888789821 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c540ceeb0 con 0x7f9c54071530 2024-09-12T02:45:28.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.749+0000 7f9c59e00640 1 --2- 172.21.15.112:0/888789821 >> v2:172.21.15.137:3300/0 conn(0x7f9c5415cc50 0x7f9c540732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:45:28.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.750+0000 7f9c59400640 1 --2- 172.21.15.112:0/888789821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c54071530 0x7f9c540af720 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9c54070060 tx=0x7f9c4402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84c63dca52ee8e20 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:28.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.751+0000 7f9c58a00640 1 -- 172.21.15.112:0/888789821 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c44004030 con 0x7f9c54071530 2024-09-12T02:45:28.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.751+0000 7f9c58a00640 1 -- 172.21.15.112:0/888789821 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c440041d0 con 0x7f9c54071530 2024-09-12T02:45:28.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.751+0000 7f9c58a00640 1 -- 172.21.15.112:0/888789821 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c44003610 con 0x7f9c54071530 2024-09-12T02:45:28.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.751+0000 7f9c5c800640 1 -- 172.21.15.112:0/888789821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c54071530 msgr2=0x7f9c540af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:28.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.751+0000 7f9c5c800640 1 --2- 172.21.15.112:0/888789821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c54071530 0x7f9c540af720 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9c54070060 tx=0x7f9c4402a130 comp rx=0 tx=0).stop 2024-09-12T02:45:28.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.751+0000 7f9c5c800640 1 -- 172.21.15.112:0/888789821 shutdown_connections 2024-09-12T02:45:28.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.751+0000 7f9c5c800640 1 --2- 172.21.15.112:0/888789821 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c540719a0 0x7f9c540afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:28.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.751+0000 7f9c5c800640 1 --2- 172.21.15.112:0/888789821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c54071530 0x7f9c540af720 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:28.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.751+0000 7f9c5c800640 1 --2- 172.21.15.112:0/888789821 >> v2:172.21.15.137:3300/0 conn(0x7f9c5415cc50 0x7f9c540732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:28.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.751+0000 7f9c5c800640 1 -- 172.21.15.112:0/888789821 >> 172.21.15.112:0/888789821 conn(0x7f9c5406bbd0 msgr2=0x7f9c5406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:28.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.751+0000 7f9c5c800640 1 -- 172.21.15.112:0/888789821 shutdown_connections 2024-09-12T02:45:28.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.751+0000 7f9c5c800640 1 -- 172.21.15.112:0/888789821 wait complete. 2024-09-12T02:45:28.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.753+0000 7f9c5c800640 1 Processor -- start 2024-09-12T02:45:28.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.753+0000 7f9c5c800640 1 -- start start 2024-09-12T02:45:28.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.754+0000 7f9c5c800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c54071530 0x7f9c540af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:28.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.754+0000 7f9c5c800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c540719a0 0x7f9c54152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:28.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.754+0000 7f9c5c800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c5415cc50 0x7f9c54151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:28.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.754+0000 7f9c5c800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9c540cf150 con 0x7f9c54071530 2024-09-12T02:45:28.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.754+0000 7f9c5c800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5406e5e0 con 0x7f9c540719a0 2024-09-12T02:45:28.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.754+0000 7f9c5c800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9c5406f510 con 0x7f9c5415cc50 2024-09-12T02:45:28.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.754+0000 7f9c59e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c54071530 0x7f9c540af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:28.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.754+0000 7f9c59e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c54071530 0x7f9c540af6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56758/0 (socket says 172.21.15.112:56758) 2024-09-12T02:45:28.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.754+0000 7f9c59e00640 1 -- 172.21.15.112:0/4102531713 learned_addr learned my addr 172.21.15.112:0/4102531713 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:28.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.754+0000 7f9c59400640 1 --2- 172.21.15.112:0/4102531713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c540719a0 0x7f9c54152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:28.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.754+0000 7f9c5a800640 1 --2- 172.21.15.112:0/4102531713 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c5415cc50 0x7f9c54151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:28.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.755+0000 7f9c59e00640 1 -- 172.21.15.112:0/4102531713 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c5415cc50 msgr2=0x7f9c54151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:28.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.755+0000 7f9c59e00640 1 --2- 172.21.15.112:0/4102531713 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c5415cc50 0x7f9c54151320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:28.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.755+0000 7f9c59e00640 1 -- 172.21.15.112:0/4102531713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c540719a0 msgr2=0x7f9c54152130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:28.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.755+0000 7f9c59e00640 1 --2- 172.21.15.112:0/4102531713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c540719a0 0x7f9c54152130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:28.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.755+0000 7f9c59e00640 1 -- 172.21.15.112:0/4102531713 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c54151860 con 0x7f9c54071530 2024-09-12T02:45:28.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.755+0000 7f9c59e00640 1 --2- 172.21.15.112:0/4102531713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c54071530 0x7f9c540af6f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9c4800c820 tx=0x7f9c4800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:28.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.755+0000 7f9c4e000640 1 -- 172.21.15.112:0/4102531713 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c48015070 con 0x7f9c54071530 2024-09-12T02:45:28.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.755+0000 7f9c4e000640 1 -- 172.21.15.112:0/4102531713 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c48007a30 con 0x7f9c54071530 2024-09-12T02:45:28.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.755+0000 7f9c4e000640 1 -- 172.21.15.112:0/4102531713 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c48007e00 con 0x7f9c54071530 2024-09-12T02:45:28.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.755+0000 7f9c5c800640 1 -- 172.21.15.112:0/4102531713 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c540afd80 con 0x7f9c54071530 2024-09-12T02:45:28.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.755+0000 7f9c5c800640 1 -- 172.21.15.112:0/4102531713 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c541e7910 con 0x7f9c54071530 2024-09-12T02:45:28.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.756+0000 7f9c5c800640 1 -- 172.21.15.112:0/4102531713 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c54068a30 con 0x7f9c54071530 2024-09-12T02:45:28.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.757+0000 7f9c4e000640 1 -- 172.21.15.112:0/4102531713 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9c48018070 con 0x7f9c54071530 2024-09-12T02:45:28.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.758+0000 7f9c4e000640 1 --2- 172.21.15.112:0/4102531713 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9c3806be30 0x7f9c3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:28.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.758+0000 7f9c4e000640 1 -- 172.21.15.112:0/4102531713 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 4943+0+0 (secure 0 0 0) 0x7f9c4808aac0 con 0x7f9c54071530 2024-09-12T02:45:28.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.758+0000 7f9c59400640 1 --2- 172.21.15.112:0/4102531713 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9c3806be30 0x7f9c3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:28.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.759+0000 7f9c59400640 1 --2- 172.21.15.112:0/4102531713 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9c3806be30 0x7f9c3806e2f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9c44033000 tx=0x7f9c4402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:28.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.763+0000 7f9c4e000640 1 -- 172.21.15.112:0/4102531713 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9c48059080 con 0x7f9c54071530 2024-09-12T02:45:28.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.933+0000 7f9c5c800640 1 -- 172.21.15.112:0/4102531713 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9c540730d0 con 0x7f9c54071530 2024-09-12T02:45:28.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.933+0000 7f9c4e000640 1 -- 172.21.15.112:0/4102531713 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) ==== 93+0+10 (secure 0 0 0) 0x7f9c4805d380 con 0x7f9c54071530 2024-09-12T02:45:28.934 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2024-09-12T02:45:28.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.935+0000 7f9c5c800640 1 -- 172.21.15.112:0/4102531713 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9c3806be30 msgr2=0x7f9c3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:28.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.935+0000 7f9c5c800640 1 --2- 172.21.15.112:0/4102531713 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9c3806be30 0x7f9c3806e2f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9c44033000 tx=0x7f9c4402e000 comp rx=0 tx=0).stop 2024-09-12T02:45:28.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.935+0000 7f9c5c800640 1 -- 172.21.15.112:0/4102531713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c54071530 msgr2=0x7f9c540af6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:28.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.935+0000 7f9c5c800640 1 --2- 172.21.15.112:0/4102531713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c54071530 0x7f9c540af6f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9c4800c820 tx=0x7f9c4800cc20 comp rx=0 tx=0).stop 2024-09-12T02:45:28.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.935+0000 7f9c5c800640 1 -- 172.21.15.112:0/4102531713 shutdown_connections 2024-09-12T02:45:28.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.935+0000 7f9c5c800640 1 --2- 172.21.15.112:0/4102531713 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c5415cc50 0x7f9c54151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:28.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.935+0000 7f9c5c800640 1 --2- 172.21.15.112:0/4102531713 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9c3806be30 0x7f9c3806e2f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:28.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.935+0000 7f9c5c800640 1 --2- 172.21.15.112:0/4102531713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c540719a0 0x7f9c54152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:28.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.935+0000 7f9c5c800640 1 --2- 172.21.15.112:0/4102531713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c54071530 0x7f9c540af6f0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:28.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.935+0000 7f9c5c800640 1 -- 172.21.15.112:0/4102531713 >> 172.21.15.112:0/4102531713 conn(0x7f9c5406bbd0 msgr2=0x7f9c540d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:28.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.935+0000 7f9c5c800640 1 -- 172.21.15.112:0/4102531713 shutdown_connections 2024-09-12T02:45:28.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:28.935+0000 7f9c5c800640 1 -- 172.21.15.112:0/4102531713 wait complete. 2024-09-12T02:45:28.952 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2024-09-12T02:45:29.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.104+0000 7f7107200640 1 Processor -- start 2024-09-12T02:45:29.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.104+0000 7f7107200640 1 -- start start 2024-09-12T02:45:29.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.105+0000 7f7107200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f71080d1710 0x7f71080d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:29.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.105+0000 7f7107200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f71080b1d70 0x7f71080b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:29.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.105+0000 7f7107200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71080d2fb0 con 0x7f71080b3e00 2024-09-12T02:45:29.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.105+0000 7f7107200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f71080d3cb0 con 0x7f71080d1710 2024-09-12T02:45:29.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.105+0000 7f7107200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f71080d0b60 con 0x7f71080b1d70 2024-09-12T02:45:29.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.105+0000 7f7105e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f71080d1710 0x7f71080d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:29.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.105+0000 7f7105e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f71080d1710 0x7f71080d28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56764/0 (socket says 172.21.15.112:56764) 2024-09-12T02:45:29.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.105+0000 7f7105e00640 1 -- 172.21.15.112:0/2220073988 learned_addr learned my addr 172.21.15.112:0/2220073988 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:29.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.106+0000 7f7106800640 1 --2- 172.21.15.112:0/2220073988 >> v2:172.21.15.137:3300/0 conn(0x7f71080b1d70 0x7f71080b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:29.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.106+0000 7f7105e00640 1 -- 172.21.15.112:0/2220073988 >> v2:172.21.15.137:3300/0 conn(0x7f71080b1d70 msgr2=0x7f71080b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:29.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.106+0000 7f7105e00640 1 --2- 172.21.15.112:0/2220073988 >> v2:172.21.15.137:3300/0 conn(0x7f71080b1d70 0x7f71080b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:29.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.106+0000 7f7105e00640 1 -- 172.21.15.112:0/2220073988 >> v1:172.21.15.137:6789/0 conn(0x7f71080b3e00 legacy=0x7f71080d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:29.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.106+0000 7f7105e00640 1 -- 172.21.15.112:0/2220073988 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71080d3410 con 0x7f71080d1710 2024-09-12T02:45:29.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.107+0000 7f7105e00640 1 --2- 172.21.15.112:0/2220073988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71080d1710 0x7f71080d28d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f710808ef20 tx=0x7f70f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b81a9360d13528a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:29.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.107+0000 7f7104a00640 1 -- 172.21.15.112:0/2220073988 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f8037070 con 0x7f71080d1710 2024-09-12T02:45:29.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.107+0000 7f7104a00640 1 -- 172.21.15.112:0/2220073988 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70f8032440 con 0x7f71080d1710 2024-09-12T02:45:29.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.107+0000 7f7104a00640 1 -- 172.21.15.112:0/2220073988 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f8032810 con 0x7f71080d1710 2024-09-12T02:45:29.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.108+0000 7f7107200640 1 -- 172.21.15.112:0/2220073988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71080d1710 msgr2=0x7f71080d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:29.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.108+0000 7f7107200640 1 --2- 172.21.15.112:0/2220073988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71080d1710 0x7f71080d28d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f710808ef20 tx=0x7f70f802a270 comp rx=0 tx=0).stop 2024-09-12T02:45:29.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.108+0000 7f7107200640 1 -- 172.21.15.112:0/2220073988 shutdown_connections 2024-09-12T02:45:29.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.108+0000 7f7107200640 1 --2- 172.21.15.112:0/2220073988 >> v2:172.21.15.137:3300/0 conn(0x7f71080b1d70 0x7f71080b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:29.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.108+0000 7f7107200640 1 --2- 172.21.15.112:0/2220073988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71080d1710 0x7f71080d28d0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:29.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.108+0000 7f7107200640 1 -- 172.21.15.112:0/2220073988 >> 172.21.15.112:0/2220073988 conn(0x7f710809e030 msgr2=0x7f71080d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:29.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.108+0000 7f7107200640 1 -- 172.21.15.112:0/2220073988 shutdown_connections 2024-09-12T02:45:29.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.108+0000 7f7107200640 1 -- 172.21.15.112:0/2220073988 wait complete. 2024-09-12T02:45:29.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.109+0000 7f7107200640 1 Processor -- start 2024-09-12T02:45:29.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.109+0000 7f7107200640 1 -- start start 2024-09-12T02:45:29.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.110+0000 7f7107200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71080b1d70 0x7f71080ce620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:29.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.110+0000 7f7107200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71080b3e00 0x7f71081ea7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:29.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.110+0000 7f7107200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71080d1710 0x7f71081ead20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:29.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.110+0000 7f7107200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f710815f110 con 0x7f71080d1710 2024-09-12T02:45:29.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.110+0000 7f7107200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f71080d39d0 con 0x7f71080b3e00 2024-09-12T02:45:29.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.110+0000 7f7107200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f710815f290 con 0x7f71080b1d70 2024-09-12T02:45:29.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.111+0000 7f7106800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71080d1710 0x7f71081ead20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:29.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.111+0000 7f7106800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71080d1710 0x7f71081ead20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56774/0 (socket says 172.21.15.112:56774) 2024-09-12T02:45:29.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.111+0000 7f7106800640 1 -- 172.21.15.112:0/1953924882 learned_addr learned my addr 172.21.15.112:0/1953924882 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:29.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.111+0000 7f7105e00640 1 --2- 172.21.15.112:0/1953924882 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71080b1d70 0x7f71080ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:29.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.111+0000 7f7105400640 1 --2- 172.21.15.112:0/1953924882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71080b3e00 0x7f71081ea7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:29.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.111+0000 7f7106800640 1 -- 172.21.15.112:0/1953924882 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71080b1d70 msgr2=0x7f71080ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:29.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.111+0000 7f7106800640 1 --2- 172.21.15.112:0/1953924882 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71080b1d70 0x7f71080ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:29.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.111+0000 7f7106800640 1 -- 172.21.15.112:0/1953924882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71080b3e00 msgr2=0x7f71081ea7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:29.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.111+0000 7f7106800640 1 --2- 172.21.15.112:0/1953924882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71080b3e00 0x7f71081ea7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:29.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.111+0000 7f7106800640 1 -- 172.21.15.112:0/1953924882 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71081fcad0 con 0x7f71080d1710 2024-09-12T02:45:29.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.111+0000 7f7106800640 1 --2- 172.21.15.112:0/1953924882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71080d1710 0x7f71081ead20 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7100009dd0 tx=0x7f710000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:29.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.112+0000 7f70fe000640 1 -- 172.21.15.112:0/1953924882 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100018020 con 0x7f71080d1710 2024-09-12T02:45:29.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.112+0000 7f70fe000640 1 -- 172.21.15.112:0/1953924882 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7100014480 con 0x7f71080d1710 2024-09-12T02:45:29.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.112+0000 7f70fe000640 1 -- 172.21.15.112:0/1953924882 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100014870 con 0x7f71080d1710 2024-09-12T02:45:29.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.112+0000 7f7107200640 1 -- 172.21.15.112:0/1953924882 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71081fcdb0 con 0x7f71080d1710 2024-09-12T02:45:29.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.112+0000 7f7107200640 1 -- 172.21.15.112:0/1953924882 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71081fd370 con 0x7f71080d1710 2024-09-12T02:45:29.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.113+0000 7f7107200640 1 -- 172.21.15.112:0/1953924882 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71081fd750 con 0x7f71080d1710 2024-09-12T02:45:29.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.114+0000 7f70fe000640 1 -- 172.21.15.112:0/1953924882 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7100005d10 con 0x7f71080d1710 2024-09-12T02:45:29.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.115+0000 7f70fe000640 1 --2- 172.21.15.112:0/1953924882 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f70e806be30 0x7f70e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:29.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.115+0000 7f70fe000640 1 -- 172.21.15.112:0/1953924882 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 4943+0+0 (secure 0 0 0) 0x7f710008ba10 con 0x7f71080d1710 2024-09-12T02:45:29.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.115+0000 7f7105e00640 1 --2- 172.21.15.112:0/1953924882 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f70e806be30 0x7f70e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:29.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.116+0000 7f7105e00640 1 --2- 172.21.15.112:0/1953924882 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f70e806be30 0x7f70e806e2f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f70f8034000 tx=0x7f70f802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:29.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.119+0000 7f70fe000640 1 -- 172.21.15.112:0/1953924882 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f71081fd750 con 0x7f71080d1710 2024-09-12T02:45:29.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:29.361+0000 7f7107200640 1 -- 172.21.15.112:0/1953924882 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) -- 0x7f71080d28d0 con 0x7f71080d1710 2024-09-12T02:45:30.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.217+0000 7f70fe000640 1 -- 172.21.15.112:0/1953924882 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v192) ==== 136+0+0 (secure 0 0 0) 0x7f7100022030 con 0x7f71080d1710 2024-09-12T02:45:30.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.219+0000 7f7107200640 1 -- 172.21.15.112:0/1953924882 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f70e806be30 msgr2=0x7f70e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:30.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.219+0000 7f7107200640 1 --2- 172.21.15.112:0/1953924882 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f70e806be30 0x7f70e806e2f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f70f8034000 tx=0x7f70f802e000 comp rx=0 tx=0).stop 2024-09-12T02:45:30.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.219+0000 7f7107200640 1 -- 172.21.15.112:0/1953924882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71080d1710 msgr2=0x7f71081ead20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:30.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.219+0000 7f7107200640 1 --2- 172.21.15.112:0/1953924882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71080d1710 0x7f71081ead20 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7100009dd0 tx=0x7f710000c490 comp rx=0 tx=0).stop 2024-09-12T02:45:30.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.219+0000 7f7107200640 1 -- 172.21.15.112:0/1953924882 shutdown_connections 2024-09-12T02:45:30.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.219+0000 7f7107200640 1 --2- 172.21.15.112:0/1953924882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71080d1710 0x7f71081ead20 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:30.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.219+0000 7f7107200640 1 --2- 172.21.15.112:0/1953924882 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f70e806be30 0x7f70e806e2f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:30.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.219+0000 7f7107200640 1 --2- 172.21.15.112:0/1953924882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71080b3e00 0x7f71081ea7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:30.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.219+0000 7f7107200640 1 --2- 172.21.15.112:0/1953924882 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71080b1d70 0x7f71080ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:30.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.219+0000 7f7107200640 1 -- 172.21.15.112:0/1953924882 >> 172.21.15.112:0/1953924882 conn(0x7f710809e030 msgr2=0x7f71080b8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:30.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.220+0000 7f7107200640 1 -- 172.21.15.112:0/1953924882 shutdown_connections 2024-09-12T02:45:30.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.220+0000 7f7107200640 1 -- 172.21.15.112:0/1953924882 wait complete. 2024-09-12T02:45:30.239 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2024-09-12T02:45:30.409 INFO:teuthology.orchestra.run.smithi112.stdout:{"osd_objectstore":"memstore"} 2024-09-12T02:45:30.410 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2024-09-12T02:45:30.410 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T02:45:30.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.564+0000 7f3d87e00640 1 Processor -- start 2024-09-12T02:45:30.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.565+0000 7f3d87e00640 1 -- start start 2024-09-12T02:45:30.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.566+0000 7f3d87e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3d880d1710 0x7f3d880d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:30.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.566+0000 7f3d87e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3d880b3e00 0x7f3d880d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:30.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.566+0000 7f3d87e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d880cf7a0 0x7f3d880cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:30.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.566+0000 7f3d87e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f3d880d3cb0 con 0x7f3d880b3e00 2024-09-12T02:45:30.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.566+0000 7f3d87e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3d880d2fb0 con 0x7f3d880d1710 2024-09-12T02:45:30.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.566+0000 7f3d87e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3d880d0b60 con 0x7f3d880cf7a0 2024-09-12T02:45:30.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.566+0000 7f3d7e000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3d880b3e00 0x7f3d880d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:30.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.566+0000 7f3d7e000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3d880b3e00 0x7f3d880d1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56788/0 (socket says 172.21.15.112:56788) 2024-09-12T02:45:30.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.566+0000 7f3d7e000640 1 -- 172.21.15.112:0/80607733 learned_addr learned my addr 172.21.15.112:0/80607733 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:30.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.566+0000 7f3d87400640 1 --2- 172.21.15.112:0/80607733 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d880cf7a0 0x7f3d880cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:30.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.566+0000 7f3d86a00640 1 --2- 172.21.15.112:0/80607733 >> v2:172.21.15.137:3300/0 conn(0x7f3d880d1710 0x7f3d880d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:30.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.566+0000 7f3d7e000640 1 -- 172.21.15.112:0/80607733 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d880cf7a0 msgr2=0x7f3d880cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:30.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.566+0000 7f3d7e000640 1 --2- 172.21.15.112:0/80607733 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d880cf7a0 0x7f3d880cfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:30.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.566+0000 7f3d7e000640 1 -- 172.21.15.112:0/80607733 >> v2:172.21.15.137:3300/0 conn(0x7f3d880d1710 msgr2=0x7f3d880d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:30.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.566+0000 7f3d7e000640 1 --2- 172.21.15.112:0/80607733 >> v2:172.21.15.137:3300/0 conn(0x7f3d880d1710 0x7f3d880d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:30.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.566+0000 7f3d7e000640 1 -- 172.21.15.112:0/80607733 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d880d2030 con 0x7f3d880b3e00 2024-09-12T02:45:30.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.566+0000 7f3d86a00640 1 --2- 172.21.15.112:0/80607733 >> v2:172.21.15.137:3300/0 conn(0x7f3d880d1710 0x7f3d880d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:45:30.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.567+0000 7f3d7e000640 1 --2- 172.21.15.112:0/80607733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d880b3e00 0x7f3d880d1af0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3d8808dd50 tx=0x7f3d7002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=502a6f4963382093 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:30.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.568+0000 7f3d86000640 1 -- 172.21.15.112:0/80607733 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d70037070 con 0x7f3d880b3e00 2024-09-12T02:45:30.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.568+0000 7f3d86000640 1 -- 172.21.15.112:0/80607733 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d70032440 con 0x7f3d880b3e00 2024-09-12T02:45:30.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.568+0000 7f3d86000640 1 -- 172.21.15.112:0/80607733 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d70032810 con 0x7f3d880b3e00 2024-09-12T02:45:30.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.568+0000 7f3d87e00640 1 -- 172.21.15.112:0/80607733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d880b3e00 msgr2=0x7f3d880d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:30.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.568+0000 7f3d87e00640 1 --2- 172.21.15.112:0/80607733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d880b3e00 0x7f3d880d1af0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3d8808dd50 tx=0x7f3d7002a1e0 comp rx=0 tx=0).stop 2024-09-12T02:45:30.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.568+0000 7f3d87e00640 1 -- 172.21.15.112:0/80607733 shutdown_connections 2024-09-12T02:45:30.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.568+0000 7f3d87e00640 1 --2- 172.21.15.112:0/80607733 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d880cf7a0 0x7f3d880cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:30.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.568+0000 7f3d87e00640 1 --2- 172.21.15.112:0/80607733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d880b3e00 0x7f3d880d1af0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:30.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.568+0000 7f3d87e00640 1 --2- 172.21.15.112:0/80607733 >> v2:172.21.15.137:3300/0 conn(0x7f3d880d1710 0x7f3d880d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:30.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.568+0000 7f3d87e00640 1 -- 172.21.15.112:0/80607733 >> 172.21.15.112:0/80607733 conn(0x7f3d8809e030 msgr2=0x7f3d880d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:30.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.568+0000 7f3d87e00640 1 -- 172.21.15.112:0/80607733 shutdown_connections 2024-09-12T02:45:30.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.568+0000 7f3d87e00640 1 -- 172.21.15.112:0/80607733 wait complete. 2024-09-12T02:45:30.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.570+0000 7f3d87e00640 1 Processor -- start 2024-09-12T02:45:30.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.570+0000 7f3d87e00640 1 -- start start 2024-09-12T02:45:30.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.571+0000 7f3d87e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d880b3e00 0x7f3d8815cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:30.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.571+0000 7f3d87e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d880cf7a0 0x7f3d880c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:30.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.571+0000 7f3d87e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d880d1710 0x7f3d880b8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:30.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.571+0000 7f3d87e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3d880d39d0 con 0x7f3d880b3e00 2024-09-12T02:45:30.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.571+0000 7f3d87e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3d880d36f0 con 0x7f3d880cf7a0 2024-09-12T02:45:30.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.571+0000 7f3d87e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3d8815f110 con 0x7f3d880d1710 2024-09-12T02:45:30.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.571+0000 7f3d86a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d880b3e00 0x7f3d8815cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:30.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.571+0000 7f3d86a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d880b3e00 0x7f3d8815cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56792/0 (socket says 172.21.15.112:56792) 2024-09-12T02:45:30.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.571+0000 7f3d86a00640 1 -- 172.21.15.112:0/1140838413 learned_addr learned my addr 172.21.15.112:0/1140838413 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:30.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.571+0000 7f3d7e000640 1 --2- 172.21.15.112:0/1140838413 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d880cf7a0 0x7f3d880c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:30.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.571+0000 7f3d86a00640 1 -- 172.21.15.112:0/1140838413 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d880d1710 msgr2=0x7f3d880b8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:30.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.571+0000 7f3d87400640 1 --2- 172.21.15.112:0/1140838413 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d880d1710 0x7f3d880b8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:30.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.571+0000 7f3d86a00640 1 --2- 172.21.15.112:0/1140838413 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d880d1710 0x7f3d880b8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:30.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.571+0000 7f3d86a00640 1 -- 172.21.15.112:0/1140838413 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d880cf7a0 msgr2=0x7f3d880c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:30.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.571+0000 7f3d86a00640 1 --2- 172.21.15.112:0/1140838413 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d880cf7a0 0x7f3d880c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:30.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.572+0000 7f3d86a00640 1 -- 172.21.15.112:0/1140838413 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d880b7cd0 con 0x7f3d880b3e00 2024-09-12T02:45:30.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.572+0000 7f3d7e000640 1 --2- 172.21.15.112:0/1140838413 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d880cf7a0 0x7f3d880c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:45:30.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.572+0000 7f3d87400640 1 --2- 172.21.15.112:0/1140838413 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d880d1710 0x7f3d880b8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:45:30.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.572+0000 7f3d86a00640 1 --2- 172.21.15.112:0/1140838413 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d880b3e00 0x7f3d8815cd20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f3d7800d800 tx=0x7f3d7800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:30.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.572+0000 7f3d7f400640 1 -- 172.21.15.112:0/1140838413 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d78004030 con 0x7f3d880b3e00 2024-09-12T02:45:30.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.572+0000 7f3d7f400640 1 -- 172.21.15.112:0/1140838413 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d780041d0 con 0x7f3d880b3e00 2024-09-12T02:45:30.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.572+0000 7f3d7f400640 1 -- 172.21.15.112:0/1140838413 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d780096a0 con 0x7f3d880b3e00 2024-09-12T02:45:30.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.572+0000 7f3d87e00640 1 -- 172.21.15.112:0/1140838413 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d880b7f70 con 0x7f3d880b3e00 2024-09-12T02:45:30.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.572+0000 7f3d87e00640 1 -- 172.21.15.112:0/1140838413 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d880b8530 con 0x7f3d880b3e00 2024-09-12T02:45:30.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.573+0000 7f3d87e00640 1 -- 172.21.15.112:0/1140838413 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d880d1af0 con 0x7f3d880b3e00 2024-09-12T02:45:30.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.574+0000 7f3d7f400640 1 -- 172.21.15.112:0/1140838413 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d78009840 con 0x7f3d880b3e00 2024-09-12T02:45:30.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.575+0000 7f3d7f400640 1 --2- 172.21.15.112:0/1140838413 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3d6406be30 0x7f3d6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:30.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.575+0000 7f3d7f400640 1 -- 172.21.15.112:0/1140838413 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 4943+0+0 (secure 0 0 0) 0x7f3d7808ae40 con 0x7f3d880b3e00 2024-09-12T02:45:30.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.575+0000 7f3d7e000640 1 --2- 172.21.15.112:0/1140838413 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3d6406be30 0x7f3d6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:30.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.576+0000 7f3d7e000640 1 --2- 172.21.15.112:0/1140838413 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3d6406be30 0x7f3d6406e2f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3d70034000 tx=0x7f3d7002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:30.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.579+0000 7f3d7f400640 1 -- 172.21.15.112:0/1140838413 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3d78059ae0 con 0x7f3d880b3e00 2024-09-12T02:45:30.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.750+0000 7f3d87e00640 1 -- 172.21.15.112:0/1140838413 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f3d8806cea0 con 0x7f3d880b3e00 2024-09-12T02:45:30.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.754+0000 7f3d7f400640 1 -- 172.21.15.112:0/1140838413 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f3d780593e0 con 0x7f3d880b3e00 2024-09-12T02:45:30.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.757+0000 7f3d87e00640 1 -- 172.21.15.112:0/1140838413 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3d6406be30 msgr2=0x7f3d6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:30.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.757+0000 7f3d87e00640 1 --2- 172.21.15.112:0/1140838413 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3d6406be30 0x7f3d6406e2f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3d70034000 tx=0x7f3d7002e000 comp rx=0 tx=0).stop 2024-09-12T02:45:30.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.757+0000 7f3d87e00640 1 -- 172.21.15.112:0/1140838413 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d880b3e00 msgr2=0x7f3d8815cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:30.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.757+0000 7f3d87e00640 1 --2- 172.21.15.112:0/1140838413 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d880b3e00 0x7f3d8815cd20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f3d7800d800 tx=0x7f3d7800dcc0 comp rx=0 tx=0).stop 2024-09-12T02:45:30.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.757+0000 7f3d87e00640 1 -- 172.21.15.112:0/1140838413 shutdown_connections 2024-09-12T02:45:30.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.757+0000 7f3d87e00640 1 --2- 172.21.15.112:0/1140838413 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d880d1710 0x7f3d880b8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:30.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.757+0000 7f3d87e00640 1 --2- 172.21.15.112:0/1140838413 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3d6406be30 0x7f3d6406e2f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:30.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.757+0000 7f3d87e00640 1 --2- 172.21.15.112:0/1140838413 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d880cf7a0 0x7f3d880c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:30.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.757+0000 7f3d87e00640 1 --2- 172.21.15.112:0/1140838413 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d880b3e00 0x7f3d8815cd20 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:30.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.757+0000 7f3d87e00640 1 -- 172.21.15.112:0/1140838413 >> 172.21.15.112:0/1140838413 conn(0x7f3d8809e030 msgr2=0x7f3d8815dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:30.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.757+0000 7f3d87e00640 1 -- 172.21.15.112:0/1140838413 shutdown_connections 2024-09-12T02:45:30.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:30.757+0000 7f3d87e00640 1 -- 172.21.15.112:0/1140838413 wait complete. 2024-09-12T02:45:30.774 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:45:30.774 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:45:30.864 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:45:30.951 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:45:30.951 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:45:30.952 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:45:30.987 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:45:30.987 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:45:30.987 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:45:31.025 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:45:31.025 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:45:31.025 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:45:31.064 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:45:31.065 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:45:31.065 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:45:31.101 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:45:31.102 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T02:45:31.102 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:45:31.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.257+0000 7f05cc600640 1 Processor -- start 2024-09-12T02:45:31.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.257+0000 7f05cc600640 1 -- start start 2024-09-12T02:45:31.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.258+0000 7f05cc600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f05c4071530 0x7f05c40af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:31.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.258+0000 7f05cc600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05c40719a0 0x7f05c40afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:31.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.258+0000 7f05cc600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05c40ceeb0 con 0x7f05c415cc50 2024-09-12T02:45:31.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.258+0000 7f05cc600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f05c415d030 con 0x7f05c4071530 2024-09-12T02:45:31.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.258+0000 7f05cc600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f05c40cf4c0 con 0x7f05c40719a0 2024-09-12T02:45:31.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.259+0000 7f05c9200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f05c4071530 0x7f05c40af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:31.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.259+0000 7f05c9200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f05c4071530 0x7f05c40af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56802/0 (socket says 172.21.15.112:56802) 2024-09-12T02:45:31.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.259+0000 7f05c9200640 1 -- 172.21.15.112:0/2191356690 learned_addr learned my addr 172.21.15.112:0/2191356690 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:31.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.259+0000 7f05c9c00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f05c415cc50 0x7f05c40732f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55724/0 (socket says 172.21.15.112:55724) 2024-09-12T02:45:31.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.259+0000 7f05ca600640 1 --2- 172.21.15.112:0/2191356690 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05c40719a0 0x7f05c40afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:31.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.259+0000 7f05c9200640 1 -- 172.21.15.112:0/2191356690 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05c40719a0 msgr2=0x7f05c40afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:31.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.259+0000 7f05c9200640 1 --2- 172.21.15.112:0/2191356690 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05c40719a0 0x7f05c40afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:31.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.259+0000 7f05c9200640 1 -- 172.21.15.112:0/2191356690 >> v1:172.21.15.112:6789/0 conn(0x7f05c415cc50 legacy=0x7f05c40732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:31.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.259+0000 7f05c9200640 1 -- 172.21.15.112:0/2191356690 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c406e300 con 0x7f05c4071530 2024-09-12T02:45:31.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.259+0000 7f05c3e00640 1 -- 172.21.15.112:0/2191356690 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3858976924 0 0) 0x7f05c40ceeb0 con 0x7f05c415cc50 2024-09-12T02:45:31.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.259+0000 7f05ca600640 1 --2- 172.21.15.112:0/2191356690 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05c40719a0 0x7f05c40afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:45:31.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.260+0000 7f05c9200640 1 --2- 172.21.15.112:0/2191356690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c4071530 0x7f05c40af720 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f05c40cf640 tx=0x7f05b002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16bcda4ab64bd3a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:31.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.260+0000 7f05c3e00640 1 -- 172.21.15.112:0/2191356690 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b0004030 con 0x7f05c4071530 2024-09-12T02:45:31.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.260+0000 7f05c3e00640 1 -- 172.21.15.112:0/2191356690 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b00041d0 con 0x7f05c4071530 2024-09-12T02:45:31.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.260+0000 7f05c3e00640 1 -- 172.21.15.112:0/2191356690 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b0003610 con 0x7f05c4071530 2024-09-12T02:45:31.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.261+0000 7f05cc600640 1 -- 172.21.15.112:0/2191356690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c4071530 msgr2=0x7f05c40af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:31.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.261+0000 7f05cc600640 1 --2- 172.21.15.112:0/2191356690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c4071530 0x7f05c40af720 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f05c40cf640 tx=0x7f05b002a1a0 comp rx=0 tx=0).stop 2024-09-12T02:45:31.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.261+0000 7f05cc600640 1 -- 172.21.15.112:0/2191356690 shutdown_connections 2024-09-12T02:45:31.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.261+0000 7f05cc600640 1 --2- 172.21.15.112:0/2191356690 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05c40719a0 0x7f05c40afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:31.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.261+0000 7f05cc600640 1 --2- 172.21.15.112:0/2191356690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c4071530 0x7f05c40af720 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:31.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.261+0000 7f05cc600640 1 -- 172.21.15.112:0/2191356690 >> 172.21.15.112:0/2191356690 conn(0x7f05c406bbd0 msgr2=0x7f05c406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:31.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.261+0000 7f05cc600640 1 -- 172.21.15.112:0/2191356690 shutdown_connections 2024-09-12T02:45:31.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.261+0000 7f05cc600640 1 -- 172.21.15.112:0/2191356690 wait complete. 2024-09-12T02:45:31.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.263+0000 7f05cc600640 1 Processor -- start 2024-09-12T02:45:31.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.263+0000 7f05cc600640 1 -- start start 2024-09-12T02:45:31.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.264+0000 7f05cc600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05c4071530 0x7f05c4153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:31.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.264+0000 7f05cc600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c40719a0 0x7f05c4149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:31.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.264+0000 7f05cc600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05c415cc50 0x7f05c40b4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:31.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.264+0000 7f05cc600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f05c406f510 con 0x7f05c40719a0 2024-09-12T02:45:31.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.264+0000 7f05cc600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f05c40cf150 con 0x7f05c4071530 2024-09-12T02:45:31.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.264+0000 7f05cc600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f05c406f690 con 0x7f05c415cc50 2024-09-12T02:45:31.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.264+0000 7f05c9200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c40719a0 0x7f05c4149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:31.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.264+0000 7f05c9200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c40719a0 0x7f05c4149780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56816/0 (socket says 172.21.15.112:56816) 2024-09-12T02:45:31.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.264+0000 7f05c9200640 1 -- 172.21.15.112:0/2701662458 learned_addr learned my addr 172.21.15.112:0/2701662458 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:31.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.264+0000 7f05c9c00640 1 --2- 172.21.15.112:0/2701662458 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05c4071530 0x7f05c4153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:31.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.264+0000 7f05ca600640 1 --2- 172.21.15.112:0/2701662458 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05c415cc50 0x7f05c40b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:31.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.264+0000 7f05c9200640 1 -- 172.21.15.112:0/2701662458 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05c415cc50 msgr2=0x7f05c40b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:31.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.264+0000 7f05c9200640 1 --2- 172.21.15.112:0/2701662458 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05c415cc50 0x7f05c40b4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:31.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.264+0000 7f05c9200640 1 -- 172.21.15.112:0/2701662458 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05c4071530 msgr2=0x7f05c4153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:31.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.264+0000 7f05c9200640 1 --2- 172.21.15.112:0/2701662458 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05c4071530 0x7f05c4153560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:31.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.264+0000 7f05c9200640 1 -- 172.21.15.112:0/2701662458 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c40b45b0 con 0x7f05c40719a0 2024-09-12T02:45:31.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.264+0000 7f05c9c00640 1 --2- 172.21.15.112:0/2701662458 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05c4071530 0x7f05c4153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:45:31.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.264+0000 7f05ca600640 1 --2- 172.21.15.112:0/2701662458 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05c415cc50 0x7f05c40b4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:45:31.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.265+0000 7f05c9200640 1 --2- 172.21.15.112:0/2701662458 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c40719a0 0x7f05c4149780 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f05b0034040 tx=0x7f05b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:31.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.265+0000 7f05c1600640 1 -- 172.21.15.112:0/2701662458 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b0041030 con 0x7f05c40719a0 2024-09-12T02:45:31.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.265+0000 7f05c1600640 1 -- 172.21.15.112:0/2701662458 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b0003c50 con 0x7f05c40719a0 2024-09-12T02:45:31.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.265+0000 7f05c1600640 1 -- 172.21.15.112:0/2701662458 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b0003e60 con 0x7f05c40719a0 2024-09-12T02:45:31.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.265+0000 7f05cc600640 1 -- 172.21.15.112:0/2701662458 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05c40b4880 con 0x7f05c40719a0 2024-09-12T02:45:31.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.265+0000 7f05cc600640 1 -- 172.21.15.112:0/2701662458 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05c40b4e40 con 0x7f05c40719a0 2024-09-12T02:45:31.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.266+0000 7f05cc600640 1 -- 172.21.15.112:0/2701662458 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05c4068a30 con 0x7f05c40719a0 2024-09-12T02:45:31.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.267+0000 7f05c1600640 1 -- 172.21.15.112:0/2701662458 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f05b0044070 con 0x7f05c40719a0 2024-09-12T02:45:31.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.268+0000 7f05c1600640 1 --2- 172.21.15.112:0/2701662458 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f05a406be30 0x7f05a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:31.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.268+0000 7f05c1600640 1 -- 172.21.15.112:0/2701662458 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 4943+0+0 (secure 0 0 0) 0x7f05b00ab840 con 0x7f05c40719a0 2024-09-12T02:45:31.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.268+0000 7f05c9c00640 1 --2- 172.21.15.112:0/2701662458 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f05a406be30 0x7f05a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:31.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.269+0000 7f05c9c00640 1 --2- 172.21.15.112:0/2701662458 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f05a406be30 0x7f05a406e2f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f05b8000f60 tx=0x7f05b8007ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:31.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.273+0000 7f05c1600640 1 -- 172.21.15.112:0/2701662458 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f05b007a450 con 0x7f05c40719a0 2024-09-12T02:45:31.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.477+0000 7f05cc600640 1 -- 172.21.15.112:0/2701662458 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f05c406df60 con 0x7f05c40719a0 2024-09-12T02:45:31.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.478+0000 7f05c1600640 1 -- 172.21.15.112:0/2701662458 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+3923 (secure 0 0 0) 0x7f05b0079d50 con 0x7f05c40719a0 2024-09-12T02:45:31.479 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:45:31.479 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":38,"btime":"2024-09-12T02:45:25:070486+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4997,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1412930245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1412930245},{"type":"v1","addr":"172.21.15.137:6834","nonce":1412930245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5299,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1045746375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1045746375},{"type":"v1","addr":"172.21.15.112:6837","nonce":1045746375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5305,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1625140900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1625140900},{"type":"v1","addr":"172.21.15.137:6835","nonce":1625140900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5736,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3396153107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3396153107},{"type":"v1","addr":"172.21.15.112:6835","nonce":3396153107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[]} 2024-09-12T02:45:31.479 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 38 2024-09-12T02:45:31.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.480+0000 7f05cc600640 1 -- 172.21.15.112:0/2701662458 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f05a406be30 msgr2=0x7f05a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:31.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.480+0000 7f05cc600640 1 --2- 172.21.15.112:0/2701662458 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f05a406be30 0x7f05a406e2f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f05b8000f60 tx=0x7f05b8007ca0 comp rx=0 tx=0).stop 2024-09-12T02:45:31.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.480+0000 7f05cc600640 1 -- 172.21.15.112:0/2701662458 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c40719a0 msgr2=0x7f05c4149780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:31.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.480+0000 7f05cc600640 1 --2- 172.21.15.112:0/2701662458 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c40719a0 0x7f05c4149780 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f05b0034040 tx=0x7f05b00046c0 comp rx=0 tx=0).stop 2024-09-12T02:45:31.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.480+0000 7f05cc600640 1 -- 172.21.15.112:0/2701662458 shutdown_connections 2024-09-12T02:45:31.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.480+0000 7f05cc600640 1 --2- 172.21.15.112:0/2701662458 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05c415cc50 0x7f05c40b4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:31.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.480+0000 7f05cc600640 1 --2- 172.21.15.112:0/2701662458 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c40719a0 0x7f05c4149780 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:31.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.480+0000 7f05cc600640 1 --2- 172.21.15.112:0/2701662458 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f05a406be30 0x7f05a406e2f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:31.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.480+0000 7f05cc600640 1 --2- 172.21.15.112:0/2701662458 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05c4071530 0x7f05c4153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:31.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.480+0000 7f05cc600640 1 -- 172.21.15.112:0/2701662458 >> 172.21.15.112:0/2701662458 conn(0x7f05c406bbd0 msgr2=0x7f05c4158120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:31.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.480+0000 7f05cc600640 1 -- 172.21.15.112:0/2701662458 shutdown_connections 2024-09-12T02:45:31.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.480+0000 7f05cc600640 1 -- 172.21.15.112:0/2701662458 wait complete. 2024-09-12T02:45:31.496 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T02:45:31.497 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T02:45:31.497 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T02:45:31.497 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:45:31.497 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T02:45:31.497 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T02:45:31.497 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T02:45:31.497 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:45:31.498 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T02:45:31.498 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T02:45:31.498 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T02:45:31.498 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:45:31.498 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T02:45:31.498 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T02:45:31.498 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T02:45:31.498 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:45:31.513 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T02:45:31.513 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T02:45:31.514 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T02:45:31.514 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T02:45:31.515 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T02:45:31.515 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T02:45:31.516 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T02:45:31.516 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T02:45:31.557 INFO:tasks.ceph.mds.b:Started 2024-09-12T02:45:31.558 DEBUG:teuthology.parallel:result is None 2024-09-12T02:45:31.559 INFO:tasks.ceph.mds.d:Started 2024-09-12T02:45:31.560 DEBUG:teuthology.parallel:result is None 2024-09-12T02:45:31.560 INFO:tasks.ceph.mds.a:Started 2024-09-12T02:45:31.560 DEBUG:teuthology.parallel:result is None 2024-09-12T02:45:31.562 INFO:tasks.ceph.mds.c:Started 2024-09-12T02:45:31.562 DEBUG:teuthology.parallel:result is None 2024-09-12T02:45:31.562 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T02:45:31.685 INFO:tasks.ceph.mds.b.smithi137.stdout:starting mds.b at 2024-09-12T02:45:31.685 INFO:tasks.ceph.mds.d.smithi137.stdout:starting mds.d at 2024-09-12T02:45:31.689 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2024-09-12T02:45:31.690 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-12T02:45:31.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.721+0000 7f4807200640 1 Processor -- start 2024-09-12T02:45:31.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.721+0000 7f4807200640 1 -- start start 2024-09-12T02:45:31.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.722+0000 7f4807200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f48080d1710 0x7f48080d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:31.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.722+0000 7f4807200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f48080b1d70 0x7f48080b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:31.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.722+0000 7f4807200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48080d2fb0 con 0x7f48080b3e00 2024-09-12T02:45:31.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.722+0000 7f4807200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f48080d3cb0 con 0x7f48080d1710 2024-09-12T02:45:31.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.722+0000 7f4807200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f48080d0b60 con 0x7f48080b1d70 2024-09-12T02:45:31.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.722+0000 7f4805e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f48080d1710 0x7f48080d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:31.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.722+0000 7f4805400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f48080b3e00 0x7f48080d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55742/0 (socket says 172.21.15.112:55742) 2024-09-12T02:45:31.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.722+0000 7f4805400640 1 -- 172.21.15.112:0/4276169537 learned_addr learned my addr 172.21.15.112:0/4276169537 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:45:31.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.723+0000 7f4806800640 1 --2- 172.21.15.112:0/4276169537 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f48080b1d70 0x7f48080b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:31.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.723+0000 7f4805e00640 1 -- 172.21.15.112:0/4276169537 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f48080b1d70 msgr2=0x7f48080b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:31.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.723+0000 7f4805e00640 1 --2- 172.21.15.112:0/4276169537 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f48080b1d70 0x7f48080b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:31.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.723+0000 7f4805e00640 1 -- 172.21.15.112:0/4276169537 >> v1:172.21.15.112:6789/0 conn(0x7f48080b3e00 legacy=0x7f48080d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:31.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.723+0000 7f4805e00640 1 -- 172.21.15.112:0/4276169537 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48080d3410 con 0x7f48080d1710 2024-09-12T02:45:31.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.724+0000 7f4805e00640 1 --2- 172.21.15.112:0/4276169537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48080d1710 0x7f48080d28d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f47f80097a0 tx=0x7f47f802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763813b05e4ac407 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:31.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.724+0000 7f4804a00640 1 -- 172.21.15.112:0/4276169537 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f8037070 con 0x7f48080d1710 2024-09-12T02:45:31.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.724+0000 7f4804a00640 1 -- 172.21.15.112:0/4276169537 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47f8032440 con 0x7f48080d1710 2024-09-12T02:45:31.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.724+0000 7f4804a00640 1 -- 172.21.15.112:0/4276169537 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f8032810 con 0x7f48080d1710 2024-09-12T02:45:31.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.725+0000 7f4807200640 1 -- 172.21.15.112:0/4276169537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48080d1710 msgr2=0x7f48080d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:31.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.725+0000 7f4807200640 1 --2- 172.21.15.112:0/4276169537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48080d1710 0x7f48080d28d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f47f80097a0 tx=0x7f47f802a180 comp rx=0 tx=0).stop 2024-09-12T02:45:31.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.725+0000 7f4807200640 1 -- 172.21.15.112:0/4276169537 shutdown_connections 2024-09-12T02:45:31.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.725+0000 7f4807200640 1 --2- 172.21.15.112:0/4276169537 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f48080b1d70 0x7f48080b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:31.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.725+0000 7f4807200640 1 --2- 172.21.15.112:0/4276169537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48080d1710 0x7f48080d28d0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:31.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.725+0000 7f4807200640 1 -- 172.21.15.112:0/4276169537 >> 172.21.15.112:0/4276169537 conn(0x7f480809e030 msgr2=0x7f48080d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:31.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.725+0000 7f4807200640 1 -- 172.21.15.112:0/4276169537 shutdown_connections 2024-09-12T02:45:31.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.725+0000 7f4807200640 1 -- 172.21.15.112:0/4276169537 wait complete. 2024-09-12T02:45:31.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.726+0000 7f4807200640 1 Processor -- start 2024-09-12T02:45:31.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.727+0000 7f4807200640 1 -- start start 2024-09-12T02:45:31.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.727+0000 7f4807200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f48080b1d70 0x7f4808161950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:31.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.727+0000 7f4807200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48080b3e00 0x7f4808158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:31.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.727+0000 7f4807200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48080d1710 0x7f48080cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:31.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.727+0000 7f4807200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f480815f110 con 0x7f48080b3e00 2024-09-12T02:45:31.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.727+0000 7f4807200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f48080d39d0 con 0x7f48080d1710 2024-09-12T02:45:31.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.727+0000 7f4807200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f480815f290 con 0x7f48080b1d70 2024-09-12T02:45:31.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.728+0000 7f4805400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48080b3e00 0x7f4808158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:31.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.728+0000 7f4805e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f48080b1d70 0x7f4808161950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:31.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.728+0000 7f4805e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f48080b1d70 0x7f4808161950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:59386/0 (socket says 172.21.15.112:59386) 2024-09-12T02:45:31.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.728+0000 7f4805e00640 1 -- 172.21.15.112:0/3743170880 learned_addr learned my addr 172.21.15.112:0/3743170880 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:31.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.728+0000 7f4806800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48080d1710 0x7f48080cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:31.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.728+0000 7f4805400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48080b3e00 0x7f4808158360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56866/0 (socket says 172.21.15.112:56866) 2024-09-12T02:45:31.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.728+0000 7f4805400640 1 -- 172.21.15.112:0/3743170880 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f48080b1d70 msgr2=0x7f4808161950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:31.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.728+0000 7f4805400640 1 --2- 172.21.15.112:0/3743170880 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f48080b1d70 0x7f4808161950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:31.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.728+0000 7f4805400640 1 -- 172.21.15.112:0/3743170880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48080d1710 msgr2=0x7f48080cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:31.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.728+0000 7f4805400640 1 --2- 172.21.15.112:0/3743170880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48080d1710 0x7f48080cc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:31.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.728+0000 7f4805400640 1 -- 172.21.15.112:0/3743170880 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48081608b0 con 0x7f48080b3e00 2024-09-12T02:45:31.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.728+0000 7f4805e00640 1 --2- 172.21.15.112:0/3743170880 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f48080b1d70 0x7f4808161950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:45:31.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.728+0000 7f4806800640 1 --2- 172.21.15.112:0/3743170880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48080d1710 0x7f48080cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:45:31.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.728+0000 7f4805400640 1 --2- 172.21.15.112:0/3743170880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48080b3e00 0x7f4808158360 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f47f4000f60 tx=0x7f47f400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:31.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.729+0000 7f47fe000640 1 -- 172.21.15.112:0/3743170880 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f4017070 con 0x7f48080b3e00 2024-09-12T02:45:31.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.729+0000 7f47fe000640 1 -- 172.21.15.112:0/3743170880 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47f4005ce0 con 0x7f48080b3e00 2024-09-12T02:45:31.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.729+0000 7f47fe000640 1 -- 172.21.15.112:0/3743170880 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f4007310 con 0x7f48080b3e00 2024-09-12T02:45:31.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.729+0000 7f4807200640 1 -- 172.21.15.112:0/3743170880 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4808160b90 con 0x7f48080b3e00 2024-09-12T02:45:31.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.729+0000 7f4807200640 1 -- 172.21.15.112:0/3743170880 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4808161430 con 0x7f48080b3e00 2024-09-12T02:45:31.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.730+0000 7f4807200640 1 -- 172.21.15.112:0/3743170880 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48080d49e0 con 0x7f48080b3e00 2024-09-12T02:45:31.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.731+0000 7f47fe000640 1 -- 172.21.15.112:0/3743170880 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f47f401a070 con 0x7f48080b3e00 2024-09-12T02:45:31.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.732+0000 7f47fe000640 1 --2- 172.21.15.112:0/3743170880 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f47e806be30 0x7f47e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:31.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.732+0000 7f47fe000640 1 -- 172.21.15.112:0/3743170880 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 4943+0+0 (secure 0 0 0) 0x7f47f4089ec0 con 0x7f48080b3e00 2024-09-12T02:45:31.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.732+0000 7f4805e00640 1 --2- 172.21.15.112:0/3743170880 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f47e806be30 0x7f47e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:31.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.733+0000 7f4805e00640 1 --2- 172.21.15.112:0/3743170880 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f47e806be30 0x7f47e806e2f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f47f8000c00 tx=0x7f47f802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:31.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.737+0000 7f47fe000640 1 -- 172.21.15.112:0/3743170880 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f48080d49e0 con 0x7f48080b3e00 2024-09-12T02:45:31.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:31.922+0000 7f4807200640 1 -- 172.21.15.112:0/3743170880 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f48080d28d0 con 0x7f48080b3e00 2024-09-12T02:45:32.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.768+0000 7f47fe000640 1 -- 172.21.15.112:0/3743170880 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v75) ==== 97+0+0 (secure 0 0 0) 0x7f47f4058480 con 0x7f48080b3e00 2024-09-12T02:45:32.769 INFO:teuthology.orchestra.run.smithi112.stderr: removed all blocklist entries 2024-09-12T02:45:32.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.770+0000 7f4807200640 1 -- 172.21.15.112:0/3743170880 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f47e806be30 msgr2=0x7f47e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:32.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.770+0000 7f4807200640 1 --2- 172.21.15.112:0/3743170880 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f47e806be30 0x7f47e806e2f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f47f8000c00 tx=0x7f47f802e000 comp rx=0 tx=0).stop 2024-09-12T02:45:32.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.770+0000 7f4807200640 1 -- 172.21.15.112:0/3743170880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48080b3e00 msgr2=0x7f4808158360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:32.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.770+0000 7f4807200640 1 --2- 172.21.15.112:0/3743170880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48080b3e00 0x7f4808158360 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f47f4000f60 tx=0x7f47f400c800 comp rx=0 tx=0).stop 2024-09-12T02:45:32.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.770+0000 7f4807200640 1 -- 172.21.15.112:0/3743170880 shutdown_connections 2024-09-12T02:45:32.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.770+0000 7f4807200640 1 --2- 172.21.15.112:0/3743170880 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f47e806be30 0x7f47e806e2f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:32.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.770+0000 7f4807200640 1 --2- 172.21.15.112:0/3743170880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48080d1710 0x7f48080cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:32.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.770+0000 7f4807200640 1 --2- 172.21.15.112:0/3743170880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48080b3e00 0x7f4808158360 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:32.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.770+0000 7f4807200640 1 --2- 172.21.15.112:0/3743170880 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f48080b1d70 0x7f4808161950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:32.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.770+0000 7f4807200640 1 -- 172.21.15.112:0/3743170880 >> 172.21.15.112:0/3743170880 conn(0x7f480809e030 msgr2=0x7f48080b8280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:32.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.770+0000 7f4807200640 1 -- 172.21.15.112:0/3743170880 shutdown_connections 2024-09-12T02:45:32.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.770+0000 7f4807200640 1 -- 172.21.15.112:0/3743170880 wait complete. 2024-09-12T02:45:32.789 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T02:45:32.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.944+0000 7f363d200640 1 Processor -- start 2024-09-12T02:45:32.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.944+0000 7f363d200640 1 -- start start 2024-09-12T02:45:32.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.946+0000 7f363d200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3638071530 0x7f36380af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:32.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.946+0000 7f363d200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36380ceeb0 con 0x7f36380719a0 2024-09-12T02:45:32.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.946+0000 7f363d200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f363806e300 con 0x7f363815cc50 2024-09-12T02:45:32.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.946+0000 7f363d200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f363815d030 con 0x7f3638071530 2024-09-12T02:45:32.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.946+0000 7f362d400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3638071530 0x7f36380af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:32.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.946+0000 7f3636800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f36380719a0 0x7f36380cf950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38060/0 (socket says 172.21.15.112:38060) 2024-09-12T02:45:32.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.946+0000 7f3636800640 1 -- 172.21.15.112:0/4184200558 learned_addr learned my addr 172.21.15.112:0/4184200558 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:45:32.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.946+0000 7f362d400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3638071530 0x7f36380af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48064/0 (socket says 172.21.15.112:48064) 2024-09-12T02:45:32.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.946+0000 7f362d400640 1 -- 172.21.15.112:0/4184200558 >> v1:172.21.15.137:6789/0 conn(0x7f363815cc50 legacy=0x7f36380732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:32.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.946+0000 7f362d400640 1 -- 172.21.15.112:0/4184200558 >> v1:172.21.15.112:6789/0 conn(0x7f36380719a0 legacy=0x7f36380cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:32.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.946+0000 7f362d400640 1 -- 172.21.15.112:0/4184200558 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f363806e5e0 con 0x7f3638071530 2024-09-12T02:45:32.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.946+0000 7f3635400640 1 -- 172.21.15.112:0/4184200558 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2229308432 0 0) 0x7f36380ceeb0 con 0x7f36380719a0 2024-09-12T02:45:32.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.947+0000 7f362d400640 1 --2- 172.21.15.112:0/4184200558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3638071530 0x7f36380af720 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3620009790 tx=0x7f362002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc28d36b4800f45d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:32.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.947+0000 7f3635400640 1 -- 172.21.15.112:0/4184200558 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3620037070 con 0x7f3638071530 2024-09-12T02:45:32.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.948+0000 7f3635400640 1 -- 172.21.15.112:0/4184200558 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3620032440 con 0x7f3638071530 2024-09-12T02:45:32.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.948+0000 7f3635400640 1 -- 172.21.15.112:0/4184200558 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3620032810 con 0x7f3638071530 2024-09-12T02:45:32.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.948+0000 7f363d200640 1 -- 172.21.15.112:0/4184200558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3638071530 msgr2=0x7f36380af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:32.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.948+0000 7f363d200640 1 --2- 172.21.15.112:0/4184200558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3638071530 0x7f36380af720 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3620009790 tx=0x7f362002a180 comp rx=0 tx=0).stop 2024-09-12T02:45:32.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.948+0000 7f363d200640 1 -- 172.21.15.112:0/4184200558 shutdown_connections 2024-09-12T02:45:32.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.948+0000 7f363d200640 1 --2- 172.21.15.112:0/4184200558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3638071530 0x7f36380af720 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:32.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.948+0000 7f363d200640 1 -- 172.21.15.112:0/4184200558 >> 172.21.15.112:0/4184200558 conn(0x7f363806bbd0 msgr2=0x7f363806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:32.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.948+0000 7f363d200640 1 -- 172.21.15.112:0/4184200558 shutdown_connections 2024-09-12T02:45:32.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.948+0000 7f363d200640 1 -- 172.21.15.112:0/4184200558 wait complete. 2024-09-12T02:45:32.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.950+0000 7f363d200640 1 Processor -- start 2024-09-12T02:45:32.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.950+0000 7f363d200640 1 -- start start 2024-09-12T02:45:32.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.951+0000 7f363d200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3638071530 0x7f363815b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:32.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.951+0000 7f363d200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36380719a0 0x7f3638146020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:32.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.951+0000 7f363d200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f363815cc50 0x7f3638146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:32.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.951+0000 7f363d200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f363806f510 con 0x7f36380719a0 2024-09-12T02:45:32.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.951+0000 7f363d200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f36380cf4c0 con 0x7f363815cc50 2024-09-12T02:45:32.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.951+0000 7f363d200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f363806f690 con 0x7f3638071530 2024-09-12T02:45:32.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.951+0000 7f362d400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36380719a0 0x7f3638146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:32.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.951+0000 7f362d400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36380719a0 0x7f3638146020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48076/0 (socket says 172.21.15.112:48076) 2024-09-12T02:45:32.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.951+0000 7f362d400640 1 -- 172.21.15.112:0/1051003953 learned_addr learned my addr 172.21.15.112:0/1051003953 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:32.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.951+0000 7f3636800640 1 --2- 172.21.15.112:0/1051003953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f363815cc50 0x7f3638146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:32.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.951+0000 7f3635e00640 1 --2- 172.21.15.112:0/1051003953 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3638071530 0x7f363815b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:32.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.952+0000 7f362d400640 1 -- 172.21.15.112:0/1051003953 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3638071530 msgr2=0x7f363815b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:32.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.952+0000 7f362d400640 1 --2- 172.21.15.112:0/1051003953 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3638071530 0x7f363815b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:32.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.952+0000 7f362d400640 1 -- 172.21.15.112:0/1051003953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f363815cc50 msgr2=0x7f3638146560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:32.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.952+0000 7f362d400640 1 --2- 172.21.15.112:0/1051003953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f363815cc50 0x7f3638146560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:32.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.952+0000 7f362d400640 1 -- 172.21.15.112:0/1051003953 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3638155110 con 0x7f36380719a0 2024-09-12T02:45:32.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.952+0000 7f3635e00640 1 --2- 172.21.15.112:0/1051003953 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3638071530 0x7f363815b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:45:32.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.952+0000 7f362d400640 1 --2- 172.21.15.112:0/1051003953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36380719a0 0x7f3638146020 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f3620035040 tx=0x7f36200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:32.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.952+0000 7f362ea00640 1 -- 172.21.15.112:0/1051003953 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3620037050 con 0x7f36380719a0 2024-09-12T02:45:32.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.952+0000 7f362ea00640 1 -- 172.21.15.112:0/1051003953 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3620038040 con 0x7f36380719a0 2024-09-12T02:45:32.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.952+0000 7f362ea00640 1 -- 172.21.15.112:0/1051003953 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3620005dd0 con 0x7f36380719a0 2024-09-12T02:45:32.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.952+0000 7f363d200640 1 -- 172.21.15.112:0/1051003953 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36381553b0 con 0x7f36380719a0 2024-09-12T02:45:32.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.952+0000 7f363d200640 1 -- 172.21.15.112:0/1051003953 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3638155970 con 0x7f36380719a0 2024-09-12T02:45:32.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.954+0000 7f363d200640 1 -- 172.21.15.112:0/1051003953 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3638068a30 con 0x7f36380719a0 2024-09-12T02:45:32.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.954+0000 7f362ea00640 1 -- 172.21.15.112:0/1051003953 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3620030900 con 0x7f36380719a0 2024-09-12T02:45:32.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.955+0000 7f362ea00640 1 --2- 172.21.15.112:0/1051003953 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f361406be30 0x7f361406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:32.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.955+0000 7f362ea00640 1 -- 172.21.15.112:0/1051003953 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 4857+0+0 (secure 0 0 0) 0x7f36200ab750 con 0x7f36380719a0 2024-09-12T02:45:32.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.955+0000 7f3635e00640 1 --2- 172.21.15.112:0/1051003953 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f361406be30 0x7f361406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:32.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.956+0000 7f3635e00640 1 --2- 172.21.15.112:0/1051003953 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f361406be30 0x7f361406e2f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3628007fd0 tx=0x7f3628009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:32.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:32.959+0000 7f362ea00640 1 -- 172.21.15.112:0/1051003953 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f362007a570 con 0x7f36380719a0 2024-09-12T02:45:33.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.194+0000 7f363d200640 1 -- 172.21.15.112:0/1051003953 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f36380730d0 con 0x7f36380719a0 2024-09-12T02:45:33.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.195+0000 7f362ea00640 1 -- 172.21.15.112:0/1051003953 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7f3620079e70 con 0x7f36380719a0 2024-09-12T02:45:33.196 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:45:33.196 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:45:33.196 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_dump": [ 2024-09-12T02:45:33.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:45:33.196 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.a", 2024-09-12T02:45:33.196 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmKE09KRAAtNq70LeeB9ENNxX91m10Fg==", 2024-09-12T02:45:33.196 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:45:33.196 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:45:33.196 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:45:33.196 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:45:33.196 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:45:33.197 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:45:33.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:45:33.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:45:33.197 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.b", 2024-09-12T02:45:33.197 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmMjYTARAAuIrofOOp9Dbrhkt314mhuw==", 2024-09-12T02:45:33.197 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:45:33.197 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:45:33.197 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:45:33.197 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:45:33.197 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:45:33.197 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:45:33.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:45:33.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:45:33.198 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.c", 2024-09-12T02:45:33.198 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmLQXzMhAAhk28JuqKhfbZtvRu9SSVrw==", 2024-09-12T02:45:33.198 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:45:33.198 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:45:33.198 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:45:33.198 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:45:33.198 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:45:33.198 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:45:33.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:45:33.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:45:33.199 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.d", 2024-09-12T02:45:33.199 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmaE7JChAAKlyynYJnHLs87BXyMC0xgA==", 2024-09-12T02:45:33.199 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:45:33.199 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:45:33.199 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:45:33.199 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:45:33.199 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:45:33.199 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:45:33.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:45:33.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:45:33.200 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.0", 2024-09-12T02:45:33.200 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDXVOJmFXfdIRAA+VpZNU0tEN6vAzR2C7nuLg==", 2024-09-12T02:45:33.200 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:45:33.200 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:45:33.200 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:45:33.200 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:45:33.200 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:45:33.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:45:33.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:45:33.201 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.1", 2024-09-12T02:45:33.201 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDXVOJmcgHyLBAA/OxfdQ1D+uFzbCnm1dJLxw==", 2024-09-12T02:45:33.201 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:45:33.201 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:45:33.201 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:45:33.201 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:45:33.201 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:45:33.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:45:33.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:45:33.202 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.2", 2024-09-12T02:45:33.202 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDXVOJm0baUNhAAuInNwHut2Xn0kBmjnJhdqw==", 2024-09-12T02:45:33.202 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:45:33.202 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:45:33.203 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:45:33.203 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:45:33.203 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:45:33.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:45:33.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:45:33.203 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.3", 2024-09-12T02:45:33.203 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDYVOJmL/O3BBAAZhQ4/70wj/2zEbMcfD4hQA==", 2024-09-12T02:45:33.204 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:45:33.204 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:45:33.204 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:45:33.204 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:45:33.204 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:45:33.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:45:33.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:45:33.204 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.4", 2024-09-12T02:45:33.204 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmC+sJAxAAUQofpG3g8DlGLQ8wUqtuSg==", 2024-09-12T02:45:33.204 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:45:33.204 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:45:33.205 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:45:33.205 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:45:33.205 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:45:33.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:45:33.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:45:33.205 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.5", 2024-09-12T02:45:33.205 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmY2OSDhAA2rg1HGjWx7G6IzFi6yQ/jQ==", 2024-09-12T02:45:33.205 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:45:33.205 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:45:33.205 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:45:33.205 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:45:33.206 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:45:33.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:45:33.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:45:33.206 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.6", 2024-09-12T02:45:33.206 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmydoaGRAAh/ozKewnY+RxiZ4EcOFA7A==", 2024-09-12T02:45:33.206 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:45:33.206 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:45:33.206 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:45:33.206 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:45:33.206 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:45:33.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:45:33.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:45:33.207 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.7", 2024-09-12T02:45:33.207 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmmB7cIhAAVhtz7OuxYBQgEKGvHdY33g==", 2024-09-12T02:45:33.207 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:45:33.207 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:45:33.207 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:45:33.207 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:45:33.207 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:45:33.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:45:33.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:45:33.207 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.0", 2024-09-12T02:45:33.207 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmaG86ExAAD0SOlJOsLpoQZlgPJIPaxA==", 2024-09-12T02:45:33.208 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:45:33.208 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:45:33.208 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow r", 2024-09-12T02:45:33.208 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T02:45:33.208 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:45:33.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:45:33.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:45:33.208 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.1", 2024-09-12T02:45:33.208 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmt7AeIBAAGRSEejG29OpANZqtia7KEw==", 2024-09-12T02:45:33.208 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:45:33.208 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:45:33.208 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:45:33.208 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:45:33.209 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:45:33.209 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:45:33.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:45:33.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:45:33.209 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.2", 2024-09-12T02:45:33.209 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmcUWtGRAAlV/gS/CDZKHb5bjbmDzjlg==", 2024-09-12T02:45:33.209 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:45:33.209 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:45:33.209 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:45:33.209 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:45:33.209 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:45:33.210 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:45:33.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:45:33.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:45:33.210 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.3", 2024-09-12T02:45:33.210 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJm2M97JhAAHKJoPBf6TN6Nu8muK6wzaw==", 2024-09-12T02:45:33.210 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:45:33.210 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:45:33.210 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:45:33.210 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:45:33.210 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:45:33.210 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:45:33.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:45:33.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:45:33.211 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.admin", 2024-09-12T02:45:33.211 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDSVOJmhl82NBAAvkcxnsY5u9lYO12FaRbP1A==", 2024-09-12T02:45:33.211 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:45:33.211 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-12T02:45:33.211 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:45:33.211 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:45:33.211 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:45:33.211 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:45:33.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:45:33.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:45:33.212 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.x", 2024-09-12T02:45:33.212 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmftawIhAAAKmfx8khERROoZ8BCLukAw==", 2024-09-12T02:45:33.212 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:45:33.212 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-12T02:45:33.212 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-12T02:45:33.212 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:45:33.212 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:45:33.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:45:33.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:45:33.212 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.y", 2024-09-12T02:45:33.212 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmcxtNGhAAAXWh1fMrVeFSy2hh3p2Rkw==", 2024-09-12T02:45:33.212 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:45:33.213 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-12T02:45:33.213 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-12T02:45:33.213 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:45:33.213 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:45:33.213 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:45:33.213 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:45:33.213 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:45:33.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.197+0000 7f363d200640 1 -- 172.21.15.112:0/1051003953 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f361406be30 msgr2=0x7f361406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:33.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.197+0000 7f363d200640 1 --2- 172.21.15.112:0/1051003953 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f361406be30 0x7f361406e2f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3628007fd0 tx=0x7f3628009040 comp rx=0 tx=0).stop 2024-09-12T02:45:33.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.197+0000 7f363d200640 1 -- 172.21.15.112:0/1051003953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36380719a0 msgr2=0x7f3638146020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:33.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.197+0000 7f363d200640 1 --2- 172.21.15.112:0/1051003953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36380719a0 0x7f3638146020 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f3620035040 tx=0x7f36200046c0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.197+0000 7f363d200640 1 -- 172.21.15.112:0/1051003953 shutdown_connections 2024-09-12T02:45:33.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.197+0000 7f363d200640 1 --2- 172.21.15.112:0/1051003953 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f361406be30 0x7f361406e2f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.197+0000 7f363d200640 1 --2- 172.21.15.112:0/1051003953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f363815cc50 0x7f3638146560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.197+0000 7f363d200640 1 --2- 172.21.15.112:0/1051003953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36380719a0 0x7f3638146020 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.197+0000 7f363d200640 1 --2- 172.21.15.112:0/1051003953 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3638071530 0x7f363815b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.197+0000 7f363d200640 1 -- 172.21.15.112:0/1051003953 >> 172.21.15.112:0/1051003953 conn(0x7f363806bbd0 msgr2=0x7f36380b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:33.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.197+0000 7f363d200640 1 -- 172.21.15.112:0/1051003953 shutdown_connections 2024-09-12T02:45:33.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.197+0000 7f363d200640 1 -- 172.21.15.112:0/1051003953 wait complete. 2024-09-12T02:45:33.216 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T02:45:33.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.368+0000 7f8d0cc00640 1 Processor -- start 2024-09-12T02:45:33.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.368+0000 7f8d0cc00640 1 -- start start 2024-09-12T02:45:33.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.369+0000 7f8d0cc00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8d081624b0 0x7f8d080d2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:33.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.369+0000 7f8d0cc00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d080d3910 con 0x7f8d080b3ad0 2024-09-12T02:45:33.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.369+0000 7f8d0cc00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d080d3bf0 con 0x7f8d080d09d0 2024-09-12T02:45:33.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.369+0000 7f8d0cc00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8d080d3ed0 con 0x7f8d081624b0 2024-09-12T02:45:33.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.369+0000 7f8d07400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8d081624b0 0x7f8d080d2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:33.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.369+0000 7f8d06a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8d080b3ad0 0x7f8d080b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38068/0 (socket says 172.21.15.112:38068) 2024-09-12T02:45:33.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.369+0000 7f8d06a00640 1 -- 172.21.15.112:0/3150922824 learned_addr learned my addr 172.21.15.112:0/3150922824 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:45:33.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.370+0000 7f8d07400640 1 -- 172.21.15.112:0/3150922824 >> v1:172.21.15.137:6789/0 conn(0x7f8d080d09d0 legacy=0x7f8d080b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:33.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.370+0000 7f8d07400640 1 -- 172.21.15.112:0/3150922824 >> v1:172.21.15.112:6789/0 conn(0x7f8d080b3ad0 legacy=0x7f8d080b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:33.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.370+0000 7f8d07400640 1 -- 172.21.15.112:0/3150922824 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d080d1d50 con 0x7f8d081624b0 2024-09-12T02:45:33.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.371+0000 7f8d07400640 1 --2- 172.21.15.112:0/3150922824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d081624b0 0x7f8d080d2cb0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8cf80097d0 tx=0x7f8cf802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f41b16b870670c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:33.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.371+0000 7f8d06000640 1 -- 172.21.15.112:0/3150922824 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8037070 con 0x7f8d081624b0 2024-09-12T02:45:33.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.371+0000 7f8d06000640 1 -- 172.21.15.112:0/3150922824 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf8032440 con 0x7f8d081624b0 2024-09-12T02:45:33.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.371+0000 7f8d06000640 1 -- 172.21.15.112:0/3150922824 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8032810 con 0x7f8d081624b0 2024-09-12T02:45:33.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.372+0000 7f8d0cc00640 1 -- 172.21.15.112:0/3150922824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d081624b0 msgr2=0x7f8d080d2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:33.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.372+0000 7f8d0cc00640 1 --2- 172.21.15.112:0/3150922824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d081624b0 0x7f8d080d2cb0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8cf80097d0 tx=0x7f8cf802a210 comp rx=0 tx=0).stop 2024-09-12T02:45:33.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.372+0000 7f8d0cc00640 1 -- 172.21.15.112:0/3150922824 shutdown_connections 2024-09-12T02:45:33.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.372+0000 7f8d0cc00640 1 --2- 172.21.15.112:0/3150922824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d081624b0 0x7f8d080d2cb0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.372+0000 7f8d0cc00640 1 -- 172.21.15.112:0/3150922824 >> 172.21.15.112:0/3150922824 conn(0x7f8d080d4db0 msgr2=0x7f8d080d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:33.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.372+0000 7f8d0cc00640 1 -- 172.21.15.112:0/3150922824 shutdown_connections 2024-09-12T02:45:33.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.372+0000 7f8d0cc00640 1 -- 172.21.15.112:0/3150922824 wait complete. 2024-09-12T02:45:33.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.373+0000 7f8d0cc00640 1 Processor -- start 2024-09-12T02:45:33.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.373+0000 7f8d0cc00640 1 -- start start 2024-09-12T02:45:33.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.374+0000 7f8d0cc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d080b3ad0 0x7f8d080c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:33.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.374+0000 7f8d0cc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8d080d09d0 0x7f8d080c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:33.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.374+0000 7f8d0cc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d081624b0 0x7f8d080b8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:33.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.374+0000 7f8d0cc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8d080d2550 con 0x7f8d080b3ad0 2024-09-12T02:45:33.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.374+0000 7f8d0cc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8d080b4120 con 0x7f8d081624b0 2024-09-12T02:45:33.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.374+0000 7f8d0cc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8d08157bb0 con 0x7f8d080d09d0 2024-09-12T02:45:33.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.374+0000 7f8d07400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d080b3ad0 0x7f8d080c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:33.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.375+0000 7f8d07400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d080b3ad0 0x7f8d080c88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48092/0 (socket says 172.21.15.112:48092) 2024-09-12T02:45:33.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.375+0000 7f8d07400640 1 -- 172.21.15.112:0/4042542580 learned_addr learned my addr 172.21.15.112:0/4042542580 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:33.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.375+0000 7f8d07e00640 1 --2- 172.21.15.112:0/4042542580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d081624b0 0x7f8d080b8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:33.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.375+0000 7f8d06a00640 1 --2- 172.21.15.112:0/4042542580 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8d080d09d0 0x7f8d080c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:33.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.375+0000 7f8d07400640 1 -- 172.21.15.112:0/4042542580 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8d080d09d0 msgr2=0x7f8d080c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:33.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.375+0000 7f8d07400640 1 --2- 172.21.15.112:0/4042542580 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8d080d09d0 0x7f8d080c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.375+0000 7f8d07400640 1 -- 172.21.15.112:0/4042542580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d081624b0 msgr2=0x7f8d080b8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:33.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.375+0000 7f8d07400640 1 --2- 172.21.15.112:0/4042542580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d081624b0 0x7f8d080b8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.375+0000 7f8d07400640 1 -- 172.21.15.112:0/4042542580 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d080cab00 con 0x7f8d080b3ad0 2024-09-12T02:45:33.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.375+0000 7f8d06a00640 1 --2- 172.21.15.112:0/4042542580 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8d080d09d0 0x7f8d080c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:45:33.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.375+0000 7f8d07e00640 1 --2- 172.21.15.112:0/4042542580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d081624b0 0x7f8d080b8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:45:33.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.375+0000 7f8d07400640 1 --2- 172.21.15.112:0/4042542580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d080b3ad0 0x7f8d080c88e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8000c00 tx=0x7f8cf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:33.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.375+0000 7f8cff400640 1 -- 172.21.15.112:0/4042542580 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8037040 con 0x7f8d080b3ad0 2024-09-12T02:45:33.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.376+0000 7f8cff400640 1 -- 172.21.15.112:0/4042542580 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf8004230 con 0x7f8d080b3ad0 2024-09-12T02:45:33.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.376+0000 7f8d0cc00640 1 -- 172.21.15.112:0/4042542580 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d080bab40 con 0x7f8d080b3ad0 2024-09-12T02:45:33.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.376+0000 7f8cff400640 1 -- 172.21.15.112:0/4042542580 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8032e20 con 0x7f8d080b3ad0 2024-09-12T02:45:33.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.376+0000 7f8d0cc00640 1 -- 172.21.15.112:0/4042542580 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d080cb080 con 0x7f8d080b3ad0 2024-09-12T02:45:33.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.377+0000 7f8d0cc00640 1 -- 172.21.15.112:0/4042542580 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d08162890 con 0x7f8d080b3ad0 2024-09-12T02:45:33.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.377+0000 7f8cff400640 1 -- 172.21.15.112:0/4042542580 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8cf8030770 con 0x7f8d080b3ad0 2024-09-12T02:45:33.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.378+0000 7f8cff400640 1 --2- 172.21.15.112:0/4042542580 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8ce806be60 0x7f8ce806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:33.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.378+0000 7f8cff400640 1 -- 172.21.15.112:0/4042542580 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 4857+0+0 (secure 0 0 0) 0x7f8cf80aba00 con 0x7f8d080b3ad0 2024-09-12T02:45:33.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.378+0000 7f8d06a00640 1 --2- 172.21.15.112:0/4042542580 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8ce806be60 0x7f8ce806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:33.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.379+0000 7f8d06a00640 1 --2- 172.21.15.112:0/4042542580 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8ce806be60 0x7f8ce806e320 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8d080b2e20 tx=0x7f8cf4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:33.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.383+0000 7f8cff400640 1 -- 172.21.15.112:0/4042542580 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8cf807a6f0 con 0x7f8d080b3ad0 2024-09-12T02:45:33.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.556+0000 7f8d0cc00640 1 -- 172.21.15.112:0/4042542580 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8d080c8680 con 0x7f8d080b3ad0 2024-09-12T02:45:33.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.557+0000 7f8cff400640 1 -- 172.21.15.112:0/4042542580 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) ==== 84+0+65 (secure 0 0 0) 0x7f8cf8079ff0 con 0x7f8d080b3ad0 2024-09-12T02:45:33.558 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:45:33.558 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2024-09-12T02:45:33.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:45:33.558 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 1, 2024-09-12T02:45:33.558 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": ".mgr" 2024-09-12T02:45:33.558 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:45:33.559 INFO:teuthology.orchestra.run.smithi112.stdout:] 2024-09-12T02:45:33.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.559+0000 7f8d0cc00640 1 -- 172.21.15.112:0/4042542580 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8ce806be60 msgr2=0x7f8ce806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:33.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.559+0000 7f8d0cc00640 1 --2- 172.21.15.112:0/4042542580 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8ce806be60 0x7f8ce806e320 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8d080b2e20 tx=0x7f8cf4009040 comp rx=0 tx=0).stop 2024-09-12T02:45:33.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.559+0000 7f8d0cc00640 1 -- 172.21.15.112:0/4042542580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d080b3ad0 msgr2=0x7f8d080c88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:33.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.559+0000 7f8d0cc00640 1 --2- 172.21.15.112:0/4042542580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d080b3ad0 0x7f8d080c88e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8000c00 tx=0x7f8cf80046c0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.559+0000 7f8d0cc00640 1 -- 172.21.15.112:0/4042542580 shutdown_connections 2024-09-12T02:45:33.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.559+0000 7f8d0cc00640 1 --2- 172.21.15.112:0/4042542580 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8ce806be60 0x7f8ce806e320 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.559+0000 7f8d0cc00640 1 --2- 172.21.15.112:0/4042542580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d081624b0 0x7f8d080b8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.559+0000 7f8d0cc00640 1 --2- 172.21.15.112:0/4042542580 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8d080d09d0 0x7f8d080c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.559+0000 7f8d0cc00640 1 --2- 172.21.15.112:0/4042542580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d080b3ad0 0x7f8d080c88e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.559+0000 7f8d0cc00640 1 -- 172.21.15.112:0/4042542580 >> 172.21.15.112:0/4042542580 conn(0x7f8d080d4db0 msgr2=0x7f8d080b4710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:33.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.559+0000 7f8d0cc00640 1 -- 172.21.15.112:0/4042542580 shutdown_connections 2024-09-12T02:45:33.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.559+0000 7f8d0cc00640 1 -- 172.21.15.112:0/4042542580 wait complete. 2024-09-12T02:45:33.575 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T02:45:33.575 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T02:45:33.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.730+0000 7fbb63a00640 1 Processor -- start 2024-09-12T02:45:33.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.731+0000 7fbb63a00640 1 -- start start 2024-09-12T02:45:33.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.732+0000 7fbb63a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb5c144890 0x7fbb5c0b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:33.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.732+0000 7fbb63a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbb5c1602f0 0x7fbb5c0b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:33.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.732+0000 7fbb63a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb5c06eed0 con 0x7fbb5c0b3290 2024-09-12T02:45:33.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.732+0000 7fbb63a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fbb5c06f170 con 0x7fbb5c1602f0 2024-09-12T02:45:33.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.732+0000 7fbb63a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbb5c15f810 con 0x7fbb5c144890 2024-09-12T02:45:33.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.732+0000 7fbb61a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fbb5c0b3290 0x7fbb5c0d0500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38074/0 (socket says 172.21.15.112:38074) 2024-09-12T02:45:33.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.732+0000 7fbb61a00640 1 -- 172.21.15.112:0/2322923942 learned_addr learned my addr 172.21.15.112:0/2322923942 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:45:33.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.732+0000 7fbb61000640 1 --2- 172.21.15.112:0/2322923942 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb5c144890 0x7fbb5c0b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:33.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.732+0000 7fbb53e00640 1 --2- 172.21.15.112:0/2322923942 >> v2:172.21.15.137:3300/0 conn(0x7fbb5c1602f0 0x7fbb5c0b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:33.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.733+0000 7fbb5be00640 1 -- 172.21.15.112:0/2322923942 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1823994393 0 0) 0x7fbb5c06eed0 con 0x7fbb5c0b3290 2024-09-12T02:45:33.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.733+0000 7fbb5be00640 1 -- 172.21.15.112:0/2322923942 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb40003520 con 0x7fbb5c0b3290 2024-09-12T02:45:33.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.733+0000 7fbb61000640 1 -- 172.21.15.112:0/2322923942 >> v2:172.21.15.137:3300/0 conn(0x7fbb5c1602f0 msgr2=0x7fbb5c0b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:33.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.733+0000 7fbb61000640 1 --2- 172.21.15.112:0/2322923942 >> v2:172.21.15.137:3300/0 conn(0x7fbb5c1602f0 0x7fbb5c0b3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.733+0000 7fbb61000640 1 -- 172.21.15.112:0/2322923942 >> v1:172.21.15.112:6789/0 conn(0x7fbb5c0b3290 legacy=0x7fbb5c0d0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:33.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.733+0000 7fbb61000640 1 -- 172.21.15.112:0/2322923942 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb5c15faf0 con 0x7fbb5c144890 2024-09-12T02:45:33.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.733+0000 7fbb53e00640 1 --2- 172.21.15.112:0/2322923942 >> v2:172.21.15.137:3300/0 conn(0x7fbb5c1602f0 0x7fbb5c0b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:45:33.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.734+0000 7fbb61000640 1 --2- 172.21.15.112:0/2322923942 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb5c144890 0x7fbb5c0b58c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c0097a0 tx=0x7fbb4c02a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80b63b4e75085e1d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:33.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.734+0000 7fbb5be00640 1 -- 172.21.15.112:0/2322923942 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c037070 con 0x7fbb5c144890 2024-09-12T02:45:33.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.734+0000 7fbb5be00640 1 -- 172.21.15.112:0/2322923942 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb4c02ae40 con 0x7fbb5c144890 2024-09-12T02:45:33.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.734+0000 7fbb5be00640 1 -- 172.21.15.112:0/2322923942 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c032660 con 0x7fbb5c144890 2024-09-12T02:45:33.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.735+0000 7fbb63a00640 1 -- 172.21.15.112:0/2322923942 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb5c144890 msgr2=0x7fbb5c0b58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:33.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.735+0000 7fbb63a00640 1 --2- 172.21.15.112:0/2322923942 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb5c144890 0x7fbb5c0b58c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c0097a0 tx=0x7fbb4c02a0f0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.735+0000 7fbb63a00640 1 -- 172.21.15.112:0/2322923942 shutdown_connections 2024-09-12T02:45:33.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.735+0000 7fbb63a00640 1 --2- 172.21.15.112:0/2322923942 >> v2:172.21.15.137:3300/0 conn(0x7fbb5c1602f0 0x7fbb5c0b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.735+0000 7fbb63a00640 1 --2- 172.21.15.112:0/2322923942 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb5c144890 0x7fbb5c0b58c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.735+0000 7fbb63a00640 1 -- 172.21.15.112:0/2322923942 >> 172.21.15.112:0/2322923942 conn(0x7fbb5c0b2730 msgr2=0x7fbb5c0b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:33.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.735+0000 7fbb63a00640 1 -- 172.21.15.112:0/2322923942 shutdown_connections 2024-09-12T02:45:33.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.735+0000 7fbb63a00640 1 -- 172.21.15.112:0/2322923942 wait complete. 2024-09-12T02:45:33.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.737+0000 7fbb63a00640 1 Processor -- start 2024-09-12T02:45:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.737+0000 7fbb63a00640 1 -- start start 2024-09-12T02:45:33.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.738+0000 7fbb63a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb5c0b3290 0x7fbb5c15eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:33.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.738+0000 7fbb63a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb5c144890 0x7fbb5c1f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:33.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.738+0000 7fbb63a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb5c1602f0 0x7fbb5c0cd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:33.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.738+0000 7fbb63a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c144df0 con 0x7fbb5c0b3290 2024-09-12T02:45:33.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.738+0000 7fbb63a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c144c70 con 0x7fbb5c1602f0 2024-09-12T02:45:33.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.738+0000 7fbb63a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbb5c0b3f70 con 0x7fbb5c144890 2024-09-12T02:45:33.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.738+0000 7fbb61000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb5c0b3290 0x7fbb5c15eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:33.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.738+0000 7fbb61000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb5c0b3290 0x7fbb5c15eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48106/0 (socket says 172.21.15.112:48106) 2024-09-12T02:45:33.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.738+0000 7fbb61000640 1 -- 172.21.15.112:0/730637126 learned_addr learned my addr 172.21.15.112:0/730637126 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:33.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.738+0000 7fbb61000640 1 -- 172.21.15.112:0/730637126 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb5c144890 msgr2=0x7fbb5c1f33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:33.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.738+0000 7fbb61000640 1 --2- 172.21.15.112:0/730637126 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb5c144890 0x7fbb5c1f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.738+0000 7fbb61000640 1 -- 172.21.15.112:0/730637126 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb5c1602f0 msgr2=0x7fbb5c0cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:33.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.738+0000 7fbb61000640 1 --2- 172.21.15.112:0/730637126 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb5c1602f0 0x7fbb5c0cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.738+0000 7fbb61000640 1 -- 172.21.15.112:0/730637126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb5c1f38e0 con 0x7fbb5c0b3290 2024-09-12T02:45:33.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.739+0000 7fbb61000640 1 --2- 172.21.15.112:0/730637126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb5c0b3290 0x7fbb5c15eea0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c02a130 tx=0x7fbb4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:33.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.739+0000 7fbb59600640 1 -- 172.21.15.112:0/730637126 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c041070 con 0x7fbb5c0b3290 2024-09-12T02:45:33.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.739+0000 7fbb59600640 1 -- 172.21.15.112:0/730637126 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb4c03c460 con 0x7fbb5c0b3290 2024-09-12T02:45:33.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.739+0000 7fbb59600640 1 -- 172.21.15.112:0/730637126 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c037040 con 0x7fbb5c0b3290 2024-09-12T02:45:33.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.739+0000 7fbb63a00640 1 -- 172.21.15.112:0/730637126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb5c1f3c10 con 0x7fbb5c0b3290 2024-09-12T02:45:33.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.739+0000 7fbb63a00640 1 -- 172.21.15.112:0/730637126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb5c1f41d0 con 0x7fbb5c0b3290 2024-09-12T02:45:33.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.740+0000 7fbb63a00640 1 -- 172.21.15.112:0/730637126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb5c0b42f0 con 0x7fbb5c0b3290 2024-09-12T02:45:33.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.741+0000 7fbb59600640 1 -- 172.21.15.112:0/730637126 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb4c044070 con 0x7fbb5c0b3290 2024-09-12T02:45:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.742+0000 7fbb59600640 1 --2- 172.21.15.112:0/730637126 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbb3806be30 0x7fbb3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.742+0000 7fbb59600640 1 -- 172.21.15.112:0/730637126 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 4857+0+0 (secure 0 0 0) 0x7fbb4c0ab100 con 0x7fbb5c0b3290 2024-09-12T02:45:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.742+0000 7fbb53e00640 1 --2- 172.21.15.112:0/730637126 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbb3806be30 0x7fbb3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.743+0000 7fbb53e00640 1 --2- 172.21.15.112:0/730637126 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbb3806be30 0x7fbb3806e2f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbb44006e80 tx=0x7fbb44006dd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:33.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.746+0000 7fbb59600640 1 -- 172.21.15.112:0/730637126 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbb5c1f38e0 con 0x7fbb5c0b3290 2024-09-12T02:45:33.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:33.921+0000 7fbb63a00640 1 -- 172.21.15.112:0/730637126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fbb5c0d1390 con 0x7fbb5c0b3290 2024-09-12T02:45:34.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.772+0000 7fbb59600640 1 -- 172.21.15.112:0/730637126 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v76) ==== 138+0+0 (secure 0 0 0) 0x7fbb4c079df0 con 0x7fbb5c0b3290 2024-09-12T02:45:34.773 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' created 2024-09-12T02:45:34.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.775+0000 7fbb63a00640 1 -- 172.21.15.112:0/730637126 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbb3806be30 msgr2=0x7fbb3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:34.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.775+0000 7fbb63a00640 1 --2- 172.21.15.112:0/730637126 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbb3806be30 0x7fbb3806e2f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbb44006e80 tx=0x7fbb44006dd0 comp rx=0 tx=0).stop 2024-09-12T02:45:34.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.775+0000 7fbb63a00640 1 -- 172.21.15.112:0/730637126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb5c0b3290 msgr2=0x7fbb5c15eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:34.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.775+0000 7fbb63a00640 1 --2- 172.21.15.112:0/730637126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb5c0b3290 0x7fbb5c15eea0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c02a130 tx=0x7fbb4c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:45:34.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.775+0000 7fbb63a00640 1 -- 172.21.15.112:0/730637126 shutdown_connections 2024-09-12T02:45:34.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.775+0000 7fbb63a00640 1 --2- 172.21.15.112:0/730637126 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbb3806be30 0x7fbb3806e2f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:34.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.775+0000 7fbb63a00640 1 --2- 172.21.15.112:0/730637126 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb5c1602f0 0x7fbb5c0cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:34.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.775+0000 7fbb63a00640 1 --2- 172.21.15.112:0/730637126 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb5c144890 0x7fbb5c1f33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:34.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.775+0000 7fbb63a00640 1 --2- 172.21.15.112:0/730637126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb5c0b3290 0x7fbb5c15eea0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:34.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.775+0000 7fbb63a00640 1 -- 172.21.15.112:0/730637126 >> 172.21.15.112:0/730637126 conn(0x7fbb5c0b2730 msgr2=0x7fbb5c0b1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:34.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.776+0000 7fbb63a00640 1 -- 172.21.15.112:0/730637126 shutdown_connections 2024-09-12T02:45:34.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.776+0000 7fbb63a00640 1 -- 172.21.15.112:0/730637126 wait complete. 2024-09-12T02:45:34.796 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:45:34.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.956+0000 7f330e800640 1 Processor -- start 2024-09-12T02:45:34.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.956+0000 7f330e800640 1 -- start start 2024-09-12T02:45:34.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.957+0000 7f330e800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f330806d680 0x7f330806da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:34.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.957+0000 7f330e800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f33080b7300 0x7f33080b7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:34.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.957+0000 7f330e800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f33080b3530 0x7f33080b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:34.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.957+0000 7f330e800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f33080b24d0 con 0x7f33080b7300 2024-09-12T02:45:34.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.957+0000 7f330e800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f330806dfa0 con 0x7f33080b3530 2024-09-12T02:45:34.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.957+0000 7f330e800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f33080b2770 con 0x7f330806d680 2024-09-12T02:45:34.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.958+0000 7f330ca00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f33080b7300 0x7f33080b7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:34.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.958+0000 7f330ca00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f33080b7300 0x7f33080b7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48114/0 (socket says 172.21.15.112:48114) 2024-09-12T02:45:34.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.958+0000 7f330ca00640 1 -- 172.21.15.112:0/2613252970 learned_addr learned my addr 172.21.15.112:0/2613252970 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:34.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.958+0000 7f330d400640 1 --2- 172.21.15.112:0/2613252970 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f330806d680 0x7f330806da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:34.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.958+0000 7f330de00640 1 --2- 172.21.15.112:0/2613252970 >> v2:172.21.15.137:3300/0 conn(0x7f33080b3530 0x7f33080b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:34.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.958+0000 7f330ca00640 1 -- 172.21.15.112:0/2613252970 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f330806d680 msgr2=0x7f330806da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:34.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.958+0000 7f330ca00640 1 --2- 172.21.15.112:0/2613252970 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f330806d680 0x7f330806da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:34.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.958+0000 7f330ca00640 1 -- 172.21.15.112:0/2613252970 >> v2:172.21.15.137:3300/0 conn(0x7f33080b3530 msgr2=0x7f33080b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:34.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.958+0000 7f330ca00640 1 --2- 172.21.15.112:0/2613252970 >> v2:172.21.15.137:3300/0 conn(0x7f33080b3530 0x7f33080b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:34.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.958+0000 7f330ca00640 1 -- 172.21.15.112:0/2613252970 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33080b2a50 con 0x7f33080b7300 2024-09-12T02:45:34.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.959+0000 7f330ca00640 1 --2- 172.21.15.112:0/2613252970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33080b7300 0x7f33080b7740 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3308073690 tx=0x7f32f402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3f67e4907e45d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:34.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.959+0000 7f3307e00640 1 -- 172.21.15.112:0/2613252970 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f4037070 con 0x7f33080b7300 2024-09-12T02:45:34.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.960+0000 7f3307e00640 1 -- 172.21.15.112:0/2613252970 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f4032440 con 0x7f33080b7300 2024-09-12T02:45:34.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.960+0000 7f3307e00640 1 -- 172.21.15.112:0/2613252970 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f4032810 con 0x7f33080b7300 2024-09-12T02:45:34.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.960+0000 7f330e800640 1 -- 172.21.15.112:0/2613252970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33080b7300 msgr2=0x7f33080b7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:34.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.960+0000 7f330e800640 1 --2- 172.21.15.112:0/2613252970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33080b7300 0x7f33080b7740 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3308073690 tx=0x7f32f402a1e0 comp rx=0 tx=0).stop 2024-09-12T02:45:34.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.960+0000 7f330e800640 1 -- 172.21.15.112:0/2613252970 shutdown_connections 2024-09-12T02:45:34.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.960+0000 7f330e800640 1 --2- 172.21.15.112:0/2613252970 >> v2:172.21.15.137:3300/0 conn(0x7f33080b3530 0x7f33080b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:34.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.960+0000 7f330e800640 1 --2- 172.21.15.112:0/2613252970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33080b7300 0x7f33080b7740 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:34.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.960+0000 7f330e800640 1 --2- 172.21.15.112:0/2613252970 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f330806d680 0x7f330806da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:34.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.960+0000 7f330e800640 1 -- 172.21.15.112:0/2613252970 >> 172.21.15.112:0/2613252970 conn(0x7f33080b7ea0 msgr2=0x7f33080b82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:34.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.960+0000 7f330e800640 1 -- 172.21.15.112:0/2613252970 shutdown_connections 2024-09-12T02:45:34.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.960+0000 7f330e800640 1 -- 172.21.15.112:0/2613252970 wait complete. 2024-09-12T02:45:34.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.962+0000 7f330e800640 1 Processor -- start 2024-09-12T02:45:34.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.962+0000 7f330e800640 1 -- start start 2024-09-12T02:45:34.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.963+0000 7f330e800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f330806d680 0x7f3308161a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:34.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.963+0000 7f330e800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33080b3530 0x7f33081f7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:34.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.963+0000 7f330e800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33080b7300 0x7f33081f8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:34.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.963+0000 7f330e800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f33080b6670 con 0x7f33080b3530 2024-09-12T02:45:34.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.963+0000 7f330e800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f33080b3010 con 0x7f330806d680 2024-09-12T02:45:34.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.963+0000 7f330e800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f33080af960 con 0x7f33080b7300 2024-09-12T02:45:34.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.963+0000 7f330ca00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33080b3530 0x7f33081f7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:34.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.963+0000 7f330ca00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33080b3530 0x7f33081f7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48120/0 (socket says 172.21.15.112:48120) 2024-09-12T02:45:34.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.963+0000 7f330ca00640 1 -- 172.21.15.112:0/1062011786 learned_addr learned my addr 172.21.15.112:0/1062011786 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:34.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.963+0000 7f330d400640 1 --2- 172.21.15.112:0/1062011786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f330806d680 0x7f3308161a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:34.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.963+0000 7f330de00640 1 --2- 172.21.15.112:0/1062011786 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33080b7300 0x7f33081f8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:34.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.963+0000 7f330ca00640 1 -- 172.21.15.112:0/1062011786 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33080b7300 msgr2=0x7f33081f8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:34.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.964+0000 7f330ca00640 1 --2- 172.21.15.112:0/1062011786 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33080b7300 0x7f33081f8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:34.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.964+0000 7f330ca00640 1 -- 172.21.15.112:0/1062011786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f330806d680 msgr2=0x7f3308161a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:34.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.964+0000 7f330ca00640 1 --2- 172.21.15.112:0/1062011786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f330806d680 0x7f3308161a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:34.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.964+0000 7f330ca00640 1 -- 172.21.15.112:0/1062011786 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3308160da0 con 0x7f33080b3530 2024-09-12T02:45:34.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.964+0000 7f330de00640 1 --2- 172.21.15.112:0/1062011786 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33080b7300 0x7f33081f8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:45:34.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.964+0000 7f330ca00640 1 --2- 172.21.15.112:0/1062011786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33080b3530 0x7f33081f7e00 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f32f40090b0 tx=0x7f32f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:34.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.964+0000 7f3305600640 1 -- 172.21.15.112:0/1062011786 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f4041020 con 0x7f33080b3530 2024-09-12T02:45:34.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.964+0000 7f3305600640 1 -- 172.21.15.112:0/1062011786 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f40306c0 con 0x7f33080b3530 2024-09-12T02:45:34.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.964+0000 7f3305600640 1 -- 172.21.15.112:0/1062011786 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f4037040 con 0x7f33080b3530 2024-09-12T02:45:34.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.964+0000 7f330e800640 1 -- 172.21.15.112:0/1062011786 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33081f59d0 con 0x7f33080b3530 2024-09-12T02:45:34.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.964+0000 7f330e800640 1 -- 172.21.15.112:0/1062011786 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33081f5f90 con 0x7f33080b3530 2024-09-12T02:45:34.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.965+0000 7f330e800640 1 -- 172.21.15.112:0/1062011786 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33080763a0 con 0x7f33080b3530 2024-09-12T02:45:34.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.967+0000 7f3305600640 1 -- 172.21.15.112:0/1062011786 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f32f4044020 con 0x7f33080b3530 2024-09-12T02:45:34.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.967+0000 7f3305600640 1 --2- 172.21.15.112:0/1062011786 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f32e806be30 0x7f32e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:34.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.967+0000 7f3305600640 1 -- 172.21.15.112:0/1062011786 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5227+0+0 (secure 0 0 0) 0x7f32f40ab920 con 0x7f33080b3530 2024-09-12T02:45:34.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.968+0000 7f330d400640 1 --2- 172.21.15.112:0/1062011786 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f32e806be30 0x7f32e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:34.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.968+0000 7f330d400640 1 --2- 172.21.15.112:0/1062011786 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f32e806be30 0x7f32e806e2f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f32fc006fd0 tx=0x7f32fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:34.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:34.971+0000 7f3305600640 1 -- 172.21.15.112:0/1062011786 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f32f404b030 con 0x7f33080b3530 2024-09-12T02:45:35.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.143+0000 7f330e800640 1 -- 172.21.15.112:0/1062011786 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f33080b8a00 con 0x7f33080b3530 2024-09-12T02:45:35.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.781+0000 7f3305600640 1 -- 172.21.15.112:0/1062011786 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v77) ==== 170+0+0 (secure 0 0 0) 0x7f32f407a490 con 0x7f33080b3530 2024-09-12T02:45:35.781 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' created 2024-09-12T02:45:35.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.784+0000 7f330e800640 1 -- 172.21.15.112:0/1062011786 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f32e806be30 msgr2=0x7f32e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:35.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.784+0000 7f330e800640 1 --2- 172.21.15.112:0/1062011786 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f32e806be30 0x7f32e806e2f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f32fc006fd0 tx=0x7f32fc008040 comp rx=0 tx=0).stop 2024-09-12T02:45:35.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.784+0000 7f330e800640 1 -- 172.21.15.112:0/1062011786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33080b3530 msgr2=0x7f33081f7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:35.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.784+0000 7f330e800640 1 --2- 172.21.15.112:0/1062011786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33080b3530 0x7f33081f7e00 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f32f40090b0 tx=0x7f32f40046c0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.784+0000 7f330e800640 1 -- 172.21.15.112:0/1062011786 shutdown_connections 2024-09-12T02:45:35.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.784+0000 7f330e800640 1 --2- 172.21.15.112:0/1062011786 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33080b7300 0x7f33081f8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.784+0000 7f330e800640 1 --2- 172.21.15.112:0/1062011786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33080b3530 0x7f33081f7e00 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.784+0000 7f330e800640 1 --2- 172.21.15.112:0/1062011786 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f32e806be30 0x7f32e806e2f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.784+0000 7f330e800640 1 --2- 172.21.15.112:0/1062011786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f330806d680 0x7f3308161a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.784+0000 7f330e800640 1 -- 172.21.15.112:0/1062011786 >> 172.21.15.112:0/1062011786 conn(0x7f33080b7ea0 msgr2=0x7f33080b82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:35.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.785+0000 7f330e800640 1 -- 172.21.15.112:0/1062011786 shutdown_connections 2024-09-12T02:45:35.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.786+0000 7f330e800640 1 -- 172.21.15.112:0/1062011786 wait complete. 2024-09-12T02:45:35.811 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T02:45:35.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.966+0000 7faa44a00640 1 Processor -- start 2024-09-12T02:45:35.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.967+0000 7faa44a00640 1 -- start start 2024-09-12T02:45:35.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.968+0000 7faa44a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa4015cc50 0x7faa400732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:35.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.968+0000 7faa44a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7faa40071530 0x7faa400af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:35.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.968+0000 7faa44a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa40073830 con 0x7faa40071970 2024-09-12T02:45:35.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.968+0000 7faa44a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7faa4015d030 con 0x7faa40071530 2024-09-12T02:45:35.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.968+0000 7faa44a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7faa400cf4c0 con 0x7faa4015cc50 2024-09-12T02:45:35.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.968+0000 7faa37e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7faa40071530 0x7faa400af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:35.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.968+0000 7faa3de00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa4015cc50 0x7faa400732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:35.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.968+0000 7faa3e800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7faa40071970 0x7faa400cf950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.112:43664/0 (socket says 172.21.15.112:43664) 2024-09-12T02:45:35.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.968+0000 7faa3e800640 1 -- 172.21.15.112:0/1480135053 learned_addr learned my addr 172.21.15.112:0/1480135053 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:45:35.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.969+0000 7faa3d400640 1 -- 172.21.15.112:0/1480135053 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1808024487 0 0) 0x7faa38001490 con 0x7faa40071970 2024-09-12T02:45:35.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.969+0000 7faa3d400640 1 -- 172.21.15.112:0/1480135053 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa24003520 con 0x7faa40071970 2024-09-12T02:45:35.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.969+0000 7faa3de00640 1 -- 172.21.15.112:0/1480135053 >> v2:172.21.15.137:3300/0 conn(0x7faa40071530 msgr2=0x7faa400af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:35.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.969+0000 7faa3de00640 1 --2- 172.21.15.112:0/1480135053 >> v2:172.21.15.137:3300/0 conn(0x7faa40071530 0x7faa400af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.969+0000 7faa3de00640 1 -- 172.21.15.112:0/1480135053 >> v1:172.21.15.137:6789/0 conn(0x7faa40071970 legacy=0x7faa400cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:35.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.969+0000 7faa3de00640 1 -- 172.21.15.112:0/1480135053 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa400ceeb0 con 0x7faa4015cc50 2024-09-12T02:45:35.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.969+0000 7faa37e00640 1 --2- 172.21.15.112:0/1480135053 >> v2:172.21.15.137:3300/0 conn(0x7faa40071530 0x7faa400af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:45:35.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.970+0000 7faa3de00640 1 --2- 172.21.15.112:0/1480135053 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa4015cc50 0x7faa400732f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faa300097a0 tx=0x7faa3002a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fa593ed0090c446 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:35.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.970+0000 7faa3d400640 1 -- 172.21.15.112:0/1480135053 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa30037070 con 0x7faa4015cc50 2024-09-12T02:45:35.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.970+0000 7faa3d400640 1 -- 172.21.15.112:0/1480135053 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa3002ae40 con 0x7faa4015cc50 2024-09-12T02:45:35.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.971+0000 7faa3d400640 1 -- 172.21.15.112:0/1480135053 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa30032640 con 0x7faa4015cc50 2024-09-12T02:45:35.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.971+0000 7faa44a00640 1 -- 172.21.15.112:0/1480135053 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa4015cc50 msgr2=0x7faa400732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:35.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.971+0000 7faa44a00640 1 --2- 172.21.15.112:0/1480135053 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa4015cc50 0x7faa400732f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faa300097a0 tx=0x7faa3002a0f0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.971+0000 7faa44a00640 1 -- 172.21.15.112:0/1480135053 shutdown_connections 2024-09-12T02:45:35.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.971+0000 7faa44a00640 1 --2- 172.21.15.112:0/1480135053 >> v2:172.21.15.137:3300/0 conn(0x7faa40071530 0x7faa400af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.971+0000 7faa44a00640 1 --2- 172.21.15.112:0/1480135053 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa4015cc50 0x7faa400732f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.971+0000 7faa44a00640 1 -- 172.21.15.112:0/1480135053 >> 172.21.15.112:0/1480135053 conn(0x7faa4006bbd0 msgr2=0x7faa4006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:35.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.971+0000 7faa44a00640 1 -- 172.21.15.112:0/1480135053 shutdown_connections 2024-09-12T02:45:35.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.971+0000 7faa44a00640 1 -- 172.21.15.112:0/1480135053 wait complete. 2024-09-12T02:45:35.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.973+0000 7faa44a00640 1 Processor -- start 2024-09-12T02:45:35.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.973+0000 7faa44a00640 1 -- start start 2024-09-12T02:45:35.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.974+0000 7faa44a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa40071530 0x7faa401495f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:35.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.974+0000 7faa44a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa40071970 0x7faa400b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:35.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.974+0000 7faa44a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa4015cc50 0x7faa400ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:35.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.974+0000 7faa44a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faa400cf150 con 0x7faa4015cc50 2024-09-12T02:45:35.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.974+0000 7faa44a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faa4006e5e0 con 0x7faa40071970 2024-09-12T02:45:35.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.974+0000 7faa44a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7faa4006f510 con 0x7faa40071530 2024-09-12T02:45:35.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.974+0000 7faa3e800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa4015cc50 0x7faa400ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:35.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.974+0000 7faa3e800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa4015cc50 0x7faa400ae8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48134/0 (socket says 172.21.15.112:48134) 2024-09-12T02:45:35.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.974+0000 7faa3e800640 1 -- 172.21.15.112:0/2749096364 learned_addr learned my addr 172.21.15.112:0/2749096364 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:35.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.974+0000 7faa37e00640 1 --2- 172.21.15.112:0/2749096364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa40071970 0x7faa400b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:35.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.974+0000 7faa3de00640 1 --2- 172.21.15.112:0/2749096364 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa40071530 0x7faa401495f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:35.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.975+0000 7faa3e800640 1 -- 172.21.15.112:0/2749096364 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa40071530 msgr2=0x7faa401495f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:35.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.975+0000 7faa3e800640 1 --2- 172.21.15.112:0/2749096364 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa40071530 0x7faa401495f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.975+0000 7faa3e800640 1 -- 172.21.15.112:0/2749096364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa40071970 msgr2=0x7faa400b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:35.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.975+0000 7faa3e800640 1 --2- 172.21.15.112:0/2749096364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa40071970 0x7faa400b4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:35.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.975+0000 7faa3e800640 1 -- 172.21.15.112:0/2749096364 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa40155a90 con 0x7faa4015cc50 2024-09-12T02:45:35.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.975+0000 7faa3e800640 1 --2- 172.21.15.112:0/2749096364 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa4015cc50 0x7faa400ae8d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7faa3800caf0 tx=0x7faa3800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:35.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.975+0000 7faa36000640 1 -- 172.21.15.112:0/2749096364 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa38017070 con 0x7faa4015cc50 2024-09-12T02:45:35.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.975+0000 7faa36000640 1 -- 172.21.15.112:0/2749096364 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa3800aca0 con 0x7faa4015cc50 2024-09-12T02:45:35.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.975+0000 7faa44a00640 1 -- 172.21.15.112:0/2749096364 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa40155d70 con 0x7faa4015cc50 2024-09-12T02:45:35.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.975+0000 7faa36000640 1 -- 172.21.15.112:0/2749096364 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa38012600 con 0x7faa4015cc50 2024-09-12T02:45:35.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.976+0000 7faa44a00640 1 -- 172.21.15.112:0/2749096364 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa40156330 con 0x7faa4015cc50 2024-09-12T02:45:35.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.976+0000 7faa44a00640 1 -- 172.21.15.112:0/2749096364 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa40068a30 con 0x7faa4015cc50 2024-09-12T02:45:35.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.977+0000 7faa36000640 1 -- 172.21.15.112:0/2749096364 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa3801a070 con 0x7faa4015cc50 2024-09-12T02:45:35.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.978+0000 7faa36000640 1 --2- 172.21.15.112:0/2749096364 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7faa1c06be60 0x7faa1c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:35.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.978+0000 7faa36000640 1 -- 172.21.15.112:0/2749096364 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5609+0+0 (secure 0 0 0) 0x7faa3808abb0 con 0x7faa4015cc50 2024-09-12T02:45:35.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.979+0000 7faa3de00640 1 --2- 172.21.15.112:0/2749096364 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7faa1c06be60 0x7faa1c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:35.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.979+0000 7faa3de00640 1 --2- 172.21.15.112:0/2749096364 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7faa1c06be60 0x7faa1c06e320 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faa30034000 tx=0x7faa3002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:35.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:35.983+0000 7faa36000640 1 -- 172.21.15.112:0/2749096364 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faa40073830 con 0x7faa4015cc50 2024-09-12T02:45:36.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.193+0000 7faa44a00640 1 -- 172.21.15.112:0/2749096364 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7faa4006df60 con 0x7faa4015cc50 2024-09-12T02:45:36.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.782+0000 7faa36000640 1 -- 172.21.15.112:0/2749096364 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v40) ==== 174+0+0 (secure 0 0 0) 0x7faa38058ed0 con 0x7faa4015cc50 2024-09-12T02:45:36.783 INFO:teuthology.orchestra.run.smithi112.stderr:new fs with metadata pool 10 and data pool 11 2024-09-12T02:45:36.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.785+0000 7faa44a00640 1 -- 172.21.15.112:0/2749096364 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7faa1c06be60 msgr2=0x7faa1c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:36.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.785+0000 7faa44a00640 1 --2- 172.21.15.112:0/2749096364 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7faa1c06be60 0x7faa1c06e320 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faa30034000 tx=0x7faa3002e000 comp rx=0 tx=0).stop 2024-09-12T02:45:36.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.785+0000 7faa44a00640 1 -- 172.21.15.112:0/2749096364 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa4015cc50 msgr2=0x7faa400ae8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:36.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.785+0000 7faa44a00640 1 --2- 172.21.15.112:0/2749096364 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa4015cc50 0x7faa400ae8d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7faa3800caf0 tx=0x7faa3800a060 comp rx=0 tx=0).stop 2024-09-12T02:45:36.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.785+0000 7faa44a00640 1 -- 172.21.15.112:0/2749096364 shutdown_connections 2024-09-12T02:45:36.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.786+0000 7faa44a00640 1 --2- 172.21.15.112:0/2749096364 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa4015cc50 0x7faa400ae8d0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:36.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.786+0000 7faa44a00640 1 --2- 172.21.15.112:0/2749096364 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7faa1c06be60 0x7faa1c06e320 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:36.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.786+0000 7faa44a00640 1 --2- 172.21.15.112:0/2749096364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa40071970 0x7faa400b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:36.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.786+0000 7faa44a00640 1 --2- 172.21.15.112:0/2749096364 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa40071530 0x7faa401495f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:36.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.786+0000 7faa44a00640 1 -- 172.21.15.112:0/2749096364 >> 172.21.15.112:0/2749096364 conn(0x7faa4006bbd0 msgr2=0x7faa4006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:36.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.786+0000 7faa44a00640 1 -- 172.21.15.112:0/2749096364 shutdown_connections 2024-09-12T02:45:36.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.786+0000 7faa44a00640 1 -- 172.21.15.112:0/2749096364 wait complete. 2024-09-12T02:45:36.818 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:45:36.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.971+0000 7f0f4d800640 1 Processor -- start 2024-09-12T02:45:36.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.971+0000 7f0f4d800640 1 -- start start 2024-09-12T02:45:36.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.971+0000 7f0f4d800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0f481626d0 0x7f0f480b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:36.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.971+0000 7f0f4d800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0f480d2cb0 0x7f0f480d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:36.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.971+0000 7f0f4d800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f480d3ac0 con 0x7f0f480b1a40 2024-09-12T02:45:36.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.971+0000 7f0f4d800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f0f480d1d00 con 0x7f0f481626d0 2024-09-12T02:45:36.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.971+0000 7f0f4d800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0f480d1fe0 con 0x7f0f480d2cb0 2024-09-12T02:45:36.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.971+0000 7f0f46a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0f481626d0 0x7f0f480b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:36.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.971+0000 7f0f47400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f0f480b1a40 0x7f0f480b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38078/0 (socket says 172.21.15.112:38078) 2024-09-12T02:45:36.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.971+0000 7f0f47400640 1 -- 172.21.15.112:0/844954246 learned_addr learned my addr 172.21.15.112:0/844954246 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:45:36.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.972+0000 7f0f46000640 1 --2- 172.21.15.112:0/844954246 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0f480d2cb0 0x7f0f480d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:36.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.972+0000 7f0f46a00640 1 -- 172.21.15.112:0/844954246 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0f480d2cb0 msgr2=0x7f0f480d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:36.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.972+0000 7f0f46a00640 1 --2- 172.21.15.112:0/844954246 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0f480d2cb0 0x7f0f480d3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:36.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.972+0000 7f0f46a00640 1 -- 172.21.15.112:0/844954246 >> v1:172.21.15.112:6789/0 conn(0x7f0f480b1a40 legacy=0x7f0f480b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:36.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.972+0000 7f0f46a00640 1 -- 172.21.15.112:0/844954246 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f480d22c0 con 0x7f0f481626d0 2024-09-12T02:45:36.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.973+0000 7f0f46a00640 1 --2- 172.21.15.112:0/844954246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f481626d0 0x7f0f480b3bb0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0f380097a0 tx=0x7f0f3802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70041afffb028925 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:36.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.973+0000 7f0f45600640 1 -- 172.21.15.112:0/844954246 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f38037070 con 0x7f0f481626d0 2024-09-12T02:45:36.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.973+0000 7f0f45600640 1 -- 172.21.15.112:0/844954246 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f38032440 con 0x7f0f481626d0 2024-09-12T02:45:36.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.973+0000 7f0f45600640 1 -- 172.21.15.112:0/844954246 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f38032810 con 0x7f0f481626d0 2024-09-12T02:45:36.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.974+0000 7f0f4d800640 1 -- 172.21.15.112:0/844954246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f481626d0 msgr2=0x7f0f480b3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:36.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.974+0000 7f0f4d800640 1 --2- 172.21.15.112:0/844954246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f481626d0 0x7f0f480b3bb0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0f380097a0 tx=0x7f0f3802a180 comp rx=0 tx=0).stop 2024-09-12T02:45:36.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.974+0000 7f0f4d800640 1 -- 172.21.15.112:0/844954246 shutdown_connections 2024-09-12T02:45:36.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.974+0000 7f0f4d800640 1 --2- 172.21.15.112:0/844954246 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0f480d2cb0 0x7f0f480d3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:36.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.974+0000 7f0f4d800640 1 --2- 172.21.15.112:0/844954246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f481626d0 0x7f0f480b3bb0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:36.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.974+0000 7f0f4d800640 1 -- 172.21.15.112:0/844954246 >> 172.21.15.112:0/844954246 conn(0x7f0f480d4db0 msgr2=0x7f0f480d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:36.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.974+0000 7f0f4d800640 1 -- 172.21.15.112:0/844954246 shutdown_connections 2024-09-12T02:45:36.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.974+0000 7f0f4d800640 1 -- 172.21.15.112:0/844954246 wait complete. 2024-09-12T02:45:36.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.975+0000 7f0f4d800640 1 Processor -- start 2024-09-12T02:45:36.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.976+0000 7f0f4d800640 1 -- start start 2024-09-12T02:45:36.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.976+0000 7f0f4d800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0f480b1a40 0x7f0f4814e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:36.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.976+0000 7f0f4d800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f480d2cb0 0x7f0f480d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:36.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.976+0000 7f0f4d800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f481626d0 0x7f0f480d1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:36.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.976+0000 7f0f4d800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0f480d3f20 con 0x7f0f481626d0 2024-09-12T02:45:36.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.976+0000 7f0f4d800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0f480d3da0 con 0x7f0f480d2cb0 2024-09-12T02:45:36.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.976+0000 7f0f4d800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0f480d3650 con 0x7f0f480b1a40 2024-09-12T02:45:36.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.977+0000 7f0f47400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f481626d0 0x7f0f480d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:36.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.977+0000 7f0f47400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f481626d0 0x7f0f480d1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48164/0 (socket says 172.21.15.112:48164) 2024-09-12T02:45:36.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.977+0000 7f0f47400640 1 -- 172.21.15.112:0/4128239065 learned_addr learned my addr 172.21.15.112:0/4128239065 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:36.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.977+0000 7f0f46a00640 1 --2- 172.21.15.112:0/4128239065 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0f480b1a40 0x7f0f4814e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:36.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.977+0000 7f0f46000640 1 --2- 172.21.15.112:0/4128239065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f480d2cb0 0x7f0f480d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:36.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.977+0000 7f0f47400640 1 -- 172.21.15.112:0/4128239065 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0f480b1a40 msgr2=0x7f0f4814e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:36.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.977+0000 7f0f47400640 1 --2- 172.21.15.112:0/4128239065 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0f480b1a40 0x7f0f4814e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:36.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.977+0000 7f0f47400640 1 -- 172.21.15.112:0/4128239065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f480d2cb0 msgr2=0x7f0f480d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:36.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.977+0000 7f0f47400640 1 --2- 172.21.15.112:0/4128239065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f480d2cb0 0x7f0f480d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:36.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.977+0000 7f0f47400640 1 -- 172.21.15.112:0/4128239065 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4814ff90 con 0x7f0f481626d0 2024-09-12T02:45:36.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.977+0000 7f0f46000640 1 --2- 172.21.15.112:0/4128239065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f480d2cb0 0x7f0f480d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:45:36.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.977+0000 7f0f47400640 1 --2- 172.21.15.112:0/4128239065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f481626d0 0x7f0f480d1630 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000caa0 tx=0x7f0f4000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:36.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.978+0000 7f0f3ea00640 1 -- 172.21.15.112:0/4128239065 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f40017070 con 0x7f0f481626d0 2024-09-12T02:45:36.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.978+0000 7f0f3ea00640 1 -- 172.21.15.112:0/4128239065 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4000ac00 con 0x7f0f481626d0 2024-09-12T02:45:36.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.978+0000 7f0f3ea00640 1 -- 172.21.15.112:0/4128239065 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f40012620 con 0x7f0f481626d0 2024-09-12T02:45:36.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.978+0000 7f0f4d800640 1 -- 172.21.15.112:0/4128239065 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f48150270 con 0x7f0f481626d0 2024-09-12T02:45:36.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.978+0000 7f0f4d800640 1 -- 172.21.15.112:0/4128239065 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f48150830 con 0x7f0f481626d0 2024-09-12T02:45:36.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.979+0000 7f0f4d800640 1 -- 172.21.15.112:0/4128239065 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f480d3110 con 0x7f0f481626d0 2024-09-12T02:45:36.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.980+0000 7f0f3ea00640 1 -- 172.21.15.112:0/4128239065 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0f4001a070 con 0x7f0f481626d0 2024-09-12T02:45:36.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.981+0000 7f0f3ea00640 1 --2- 172.21.15.112:0/4128239065 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0f2806be30 0x7f0f2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:36.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.981+0000 7f0f3ea00640 1 -- 172.21.15.112:0/4128239065 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5709+0+0 (secure 0 0 0) 0x7f0f4008aac0 con 0x7f0f481626d0 2024-09-12T02:45:36.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.981+0000 7f0f46a00640 1 --2- 172.21.15.112:0/4128239065 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0f2806be30 0x7f0f2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:36.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.982+0000 7f0f46a00640 1 --2- 172.21.15.112:0/4128239065 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0f2806be30 0x7f0f2806e2f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0f38034000 tx=0x7f0f3802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:36.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:36.986+0000 7f0f3ea00640 1 -- 172.21.15.112:0/4128239065 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0f40058eb0 con 0x7f0f481626d0 2024-09-12T02:45:37.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.161+0000 7f0f4d800640 1 -- 172.21.15.112:0/4128239065 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f480b3040 con 0x7f0f481626d0 2024-09-12T02:45:37.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.162+0000 7f0f3ea00640 1 -- 172.21.15.112:0/4128239065 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+16789 (secure 0 0 0) 0x7f0f4005d1b0 con 0x7f0f481626d0 2024-09-12T02:45:37.162 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:45:37.163 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":78,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:45:36.194585+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:45:33.961909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-12T02:45:35.184607+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:45:37.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.165+0000 7f0f4d800640 1 -- 172.21.15.112:0/4128239065 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0f2806be30 msgr2=0x7f0f2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:37.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.165+0000 7f0f4d800640 1 --2- 172.21.15.112:0/4128239065 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0f2806be30 0x7f0f2806e2f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0f38034000 tx=0x7f0f3802e000 comp rx=0 tx=0).stop 2024-09-12T02:45:37.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.165+0000 7f0f4d800640 1 -- 172.21.15.112:0/4128239065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f481626d0 msgr2=0x7f0f480d1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:37.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.165+0000 7f0f4d800640 1 --2- 172.21.15.112:0/4128239065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f481626d0 0x7f0f480d1630 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000caa0 tx=0x7f0f4000cf60 comp rx=0 tx=0).stop 2024-09-12T02:45:37.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.165+0000 7f0f4d800640 1 -- 172.21.15.112:0/4128239065 shutdown_connections 2024-09-12T02:45:37.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.165+0000 7f0f4d800640 1 --2- 172.21.15.112:0/4128239065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f481626d0 0x7f0f480d1630 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:37.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.165+0000 7f0f4d800640 1 --2- 172.21.15.112:0/4128239065 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0f2806be30 0x7f0f2806e2f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:37.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.165+0000 7f0f4d800640 1 --2- 172.21.15.112:0/4128239065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f480d2cb0 0x7f0f480d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:37.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.165+0000 7f0f4d800640 1 --2- 172.21.15.112:0/4128239065 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0f480b1a40 0x7f0f4814e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:37.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.165+0000 7f0f4d800640 1 -- 172.21.15.112:0/4128239065 >> 172.21.15.112:0/4128239065 conn(0x7f0f480d4db0 msgr2=0x7f0f480b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:37.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.165+0000 7f0f4d800640 1 -- 172.21.15.112:0/4128239065 shutdown_connections 2024-09-12T02:45:37.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.165+0000 7f0f4d800640 1 -- 172.21.15.112:0/4128239065 wait complete. 2024-09-12T02:45:37.181 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:45:37.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.334+0000 7f0eef600640 1 Processor -- start 2024-09-12T02:45:37.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.334+0000 7f0eef600640 1 -- start start 2024-09-12T02:45:37.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.335+0000 7f0eef600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0ee815b9d0 0x7f0ee80b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:37.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.335+0000 7f0eef600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ee806f600 0x7f0ee80728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:37.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.335+0000 7f0eef600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ee80b54a0 con 0x7f0ee80b45d0 2024-09-12T02:45:37.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.335+0000 7f0eef600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f0ee80b4a60 con 0x7f0ee815b9d0 2024-09-12T02:45:37.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.335+0000 7f0eef600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0ee80b3af0 con 0x7f0ee806f600 2024-09-12T02:45:37.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.336+0000 7f0eecc00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0ee815b9d0 0x7f0ee80b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:37.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.336+0000 7f0eecc00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0ee815b9d0 0x7f0ee80b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48180/0 (socket says 172.21.15.112:48180) 2024-09-12T02:45:37.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.336+0000 7f0eecc00640 1 -- 172.21.15.112:0/2040129870 learned_addr learned my addr 172.21.15.112:0/2040129870 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:37.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.336+0000 7f0edfe00640 1 --1- 172.21.15.112:0/2040129870 >> v1:172.21.15.112:6789/0 conn(0x7f0ee80b45d0 0x7f0ee806eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38084/0 (socket says 172.21.15.112:38084) 2024-09-12T02:45:37.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.336+0000 7f0eed600640 1 --2- 172.21.15.112:0/2040129870 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ee806f600 0x7f0ee80728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:37.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.336+0000 7f0eecc00640 1 -- 172.21.15.112:0/2040129870 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ee806f600 msgr2=0x7f0ee80728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:37.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.336+0000 7f0eecc00640 1 --2- 172.21.15.112:0/2040129870 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ee806f600 0x7f0ee80728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:37.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.336+0000 7f0eecc00640 1 -- 172.21.15.112:0/2040129870 >> v1:172.21.15.112:6789/0 conn(0x7f0ee80b45d0 legacy=0x7f0ee806eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:37.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.336+0000 7f0eecc00640 1 -- 172.21.15.112:0/2040129870 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee80b3dd0 con 0x7f0ee815b9d0 2024-09-12T02:45:37.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.336+0000 7f0ee7e00640 1 -- 172.21.15.112:0/2040129870 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2073260213 0 0) 0x7f0ee80b54a0 con 0x7f0ee80b45d0 2024-09-12T02:45:37.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.337+0000 7f0eecc00640 1 --2- 172.21.15.112:0/2040129870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee815b9d0 0x7f0ee80b4ec0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8009870 tx=0x7f0ed802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdacfd6ad9b2d846 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:37.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.337+0000 7f0ee7e00640 1 -- 172.21.15.112:0/2040129870 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8037070 con 0x7f0ee815b9d0 2024-09-12T02:45:37.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.337+0000 7f0ee7e00640 1 -- 172.21.15.112:0/2040129870 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed8032440 con 0x7f0ee815b9d0 2024-09-12T02:45:37.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.337+0000 7f0ee7e00640 1 -- 172.21.15.112:0/2040129870 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8032810 con 0x7f0ee815b9d0 2024-09-12T02:45:37.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.338+0000 7f0eef600640 1 -- 172.21.15.112:0/2040129870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee815b9d0 msgr2=0x7f0ee80b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:37.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.338+0000 7f0eef600640 1 --2- 172.21.15.112:0/2040129870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee815b9d0 0x7f0ee80b4ec0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8009870 tx=0x7f0ed802a270 comp rx=0 tx=0).stop 2024-09-12T02:45:37.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.338+0000 7f0eef600640 1 -- 172.21.15.112:0/2040129870 shutdown_connections 2024-09-12T02:45:37.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.338+0000 7f0eef600640 1 --2- 172.21.15.112:0/2040129870 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ee806f600 0x7f0ee80728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:37.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.338+0000 7f0eef600640 1 --2- 172.21.15.112:0/2040129870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee815b9d0 0x7f0ee80b4ec0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:37.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.338+0000 7f0eef600640 1 -- 172.21.15.112:0/2040129870 >> 172.21.15.112:0/2040129870 conn(0x7f0ee806bbd0 msgr2=0x7f0ee806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:37.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.338+0000 7f0eef600640 1 -- 172.21.15.112:0/2040129870 shutdown_connections 2024-09-12T02:45:37.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.338+0000 7f0eef600640 1 -- 172.21.15.112:0/2040129870 wait complete. 2024-09-12T02:45:37.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.340+0000 7f0eef600640 1 Processor -- start 2024-09-12T02:45:37.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.340+0000 7f0eef600640 1 -- start start 2024-09-12T02:45:37.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.341+0000 7f0eef600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ee806f600 0x7f0ee8153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:37.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.341+0000 7f0eef600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee80b45d0 0x7f0ee8164f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:37.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.341+0000 7f0eef600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ee815b9d0 0x7f0ee8152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:37.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.341+0000 7f0eef600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee815bf30 con 0x7f0ee80b45d0 2024-09-12T02:45:37.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.341+0000 7f0eef600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee815bdb0 con 0x7f0ee806f600 2024-09-12T02:45:37.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.341+0000 7f0eef600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0ee80cdcd0 con 0x7f0ee815b9d0 2024-09-12T02:45:37.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.341+0000 7f0edfe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee80b45d0 0x7f0ee8164f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:37.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.341+0000 7f0edfe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee80b45d0 0x7f0ee8164f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48186/0 (socket says 172.21.15.112:48186) 2024-09-12T02:45:37.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.341+0000 7f0edfe00640 1 -- 172.21.15.112:0/349152370 learned_addr learned my addr 172.21.15.112:0/349152370 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:37.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.341+0000 7f0eecc00640 1 --2- 172.21.15.112:0/349152370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ee806f600 0x7f0ee8153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:37.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.341+0000 7f0eed600640 1 --2- 172.21.15.112:0/349152370 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ee815b9d0 0x7f0ee8152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:37.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.342+0000 7f0edfe00640 1 -- 172.21.15.112:0/349152370 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ee815b9d0 msgr2=0x7f0ee8152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:37.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.342+0000 7f0edfe00640 1 --2- 172.21.15.112:0/349152370 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ee815b9d0 0x7f0ee8152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:37.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.342+0000 7f0edfe00640 1 -- 172.21.15.112:0/349152370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ee806f600 msgr2=0x7f0ee8153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:37.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.342+0000 7f0edfe00640 1 --2- 172.21.15.112:0/349152370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ee806f600 0x7f0ee8153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:37.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.342+0000 7f0edfe00640 1 -- 172.21.15.112:0/349152370 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee8158c50 con 0x7f0ee80b45d0 2024-09-12T02:45:37.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.342+0000 7f0edfe00640 1 --2- 172.21.15.112:0/349152370 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee80b45d0 0x7f0ee8164f80 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000c4d0 tx=0x7f0ed000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:37.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.342+0000 7f0ee5600640 1 -- 172.21.15.112:0/349152370 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0007480 con 0x7f0ee80b45d0 2024-09-12T02:45:37.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.342+0000 7f0ee5600640 1 -- 172.21.15.112:0/349152370 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed00057a0 con 0x7f0ee80b45d0 2024-09-12T02:45:37.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.342+0000 7f0ee5600640 1 -- 172.21.15.112:0/349152370 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0007620 con 0x7f0ee80b45d0 2024-09-12T02:45:37.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.342+0000 7f0eef600640 1 -- 172.21.15.112:0/349152370 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ee8158f30 con 0x7f0ee80b45d0 2024-09-12T02:45:37.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.342+0000 7f0eef600640 1 -- 172.21.15.112:0/349152370 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ee81654c0 con 0x7f0ee80b45d0 2024-09-12T02:45:37.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.343+0000 7f0eef600640 1 -- 172.21.15.112:0/349152370 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ee8068a30 con 0x7f0ee80b45d0 2024-09-12T02:45:37.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.344+0000 7f0ee5600640 1 -- 172.21.15.112:0/349152370 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0ed0005b50 con 0x7f0ee80b45d0 2024-09-12T02:45:37.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.345+0000 7f0ee5600640 1 --2- 172.21.15.112:0/349152370 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0ec406be60 0x7f0ec406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:37.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.345+0000 7f0ee5600640 1 -- 172.21.15.112:0/349152370 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5709+0+0 (secure 0 0 0) 0x7f0ed008aa60 con 0x7f0ee80b45d0 2024-09-12T02:45:37.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.345+0000 7f0eecc00640 1 --2- 172.21.15.112:0/349152370 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0ec406be60 0x7f0ec406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:37.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.346+0000 7f0eecc00640 1 --2- 172.21.15.112:0/349152370 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0ec406be60 0x7f0ec406e320 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8034000 tx=0x7f0ed802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:37.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.350+0000 7f0ee5600640 1 -- 172.21.15.112:0/349152370 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0ed0058ca0 con 0x7f0ee80b45d0 2024-09-12T02:45:37.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.523+0000 7f0eef600640 1 -- 172.21.15.112:0/349152370 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ee806dbc0 con 0x7f0ee80b45d0 2024-09-12T02:45:37.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.524+0000 7f0ee5600640 1 -- 172.21.15.112:0/349152370 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+16789 (secure 0 0 0) 0x7f0ed005cfa0 con 0x7f0ee80b45d0 2024-09-12T02:45:37.524 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:45:37.524 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":78,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:45:36.194585+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:45:33.961909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-12T02:45:35.184607+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:45:37.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.526+0000 7f0eef600640 1 -- 172.21.15.112:0/349152370 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0ec406be60 msgr2=0x7f0ec406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:37.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.526+0000 7f0eef600640 1 --2- 172.21.15.112:0/349152370 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0ec406be60 0x7f0ec406e320 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8034000 tx=0x7f0ed802e000 comp rx=0 tx=0).stop 2024-09-12T02:45:37.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.526+0000 7f0eef600640 1 -- 172.21.15.112:0/349152370 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee80b45d0 msgr2=0x7f0ee8164f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:37.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.526+0000 7f0eef600640 1 --2- 172.21.15.112:0/349152370 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee80b45d0 0x7f0ee8164f80 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000c4d0 tx=0x7f0ed000c990 comp rx=0 tx=0).stop 2024-09-12T02:45:37.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.526+0000 7f0eef600640 1 -- 172.21.15.112:0/349152370 shutdown_connections 2024-09-12T02:45:37.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.526+0000 7f0eef600640 1 --2- 172.21.15.112:0/349152370 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ee815b9d0 0x7f0ee8152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:37.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.526+0000 7f0eef600640 1 --2- 172.21.15.112:0/349152370 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee80b45d0 0x7f0ee8164f80 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:37.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.526+0000 7f0eef600640 1 --2- 172.21.15.112:0/349152370 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0ec406be60 0x7f0ec406e320 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:37.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.526+0000 7f0eef600640 1 --2- 172.21.15.112:0/349152370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ee806f600 0x7f0ee8153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:37.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.526+0000 7f0eef600640 1 -- 172.21.15.112:0/349152370 >> 172.21.15.112:0/349152370 conn(0x7f0ee806bbd0 msgr2=0x7f0ee80b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:37.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.526+0000 7f0eef600640 1 -- 172.21.15.112:0/349152370 shutdown_connections 2024-09-12T02:45:37.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.526+0000 7f0eef600640 1 -- 172.21.15.112:0/349152370 wait complete. 2024-09-12T02:45:37.543 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T02:45:37.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.700+0000 7fb9f1e00640 1 Processor -- start 2024-09-12T02:45:37.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.700+0000 7fb9f1e00640 1 -- start start 2024-09-12T02:45:37.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.701+0000 7fb9f1e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb9ec06f4b0 0x7fb9ec0b5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:37.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.701+0000 7fb9f1e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9ec0b4f80 con 0x7fb9ec1620f0 2024-09-12T02:45:37.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.701+0000 7fb9f1e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9ec1624d0 con 0x7fb9ec0afd70 2024-09-12T02:45:37.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.701+0000 7fb9f1e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb9ec0d0de0 con 0x7fb9ec06f4b0 2024-09-12T02:45:37.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.701+0000 7fb9ebe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb9ec06f4b0 0x7fb9ec0b5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:37.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.701+0000 7fb9f0a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb9ec1620f0 0x7fb9ec06eda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38086/0 (socket says 172.21.15.112:38086) 2024-09-12T02:45:37.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.701+0000 7fb9f0a00640 1 -- 172.21.15.112:0/2161891979 learned_addr learned my addr 172.21.15.112:0/2161891979 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:45:37.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.702+0000 7fb9ebe00640 1 -- 172.21.15.112:0/2161891979 >> v1:172.21.15.137:6789/0 conn(0x7fb9ec0afd70 legacy=0x7fb9ec0ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:37.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.702+0000 7fb9ebe00640 1 -- 172.21.15.112:0/2161891979 >> v1:172.21.15.112:6789/0 conn(0x7fb9ec1620f0 legacy=0x7fb9ec06eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:37.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.702+0000 7fb9ebe00640 1 -- 172.21.15.112:0/2161891979 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ec0d10c0 con 0x7fb9ec06f4b0 2024-09-12T02:45:37.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.703+0000 7fb9ebe00640 1 --2- 172.21.15.112:0/2161891979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9ec06f4b0 0x7fb9ec0b5740 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb9d80097a0 tx=0x7fb9d802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1499908d095c468a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:37.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.703+0000 7fb9eb400640 1 -- 172.21.15.112:0/2161891979 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8037070 con 0x7fb9ec06f4b0 2024-09-12T02:45:37.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.703+0000 7fb9eb400640 1 -- 172.21.15.112:0/2161891979 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9d802adc0 con 0x7fb9ec06f4b0 2024-09-12T02:45:37.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.703+0000 7fb9eb400640 1 -- 172.21.15.112:0/2161891979 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8032660 con 0x7fb9ec06f4b0 2024-09-12T02:45:37.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.704+0000 7fb9f1e00640 1 -- 172.21.15.112:0/2161891979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9ec06f4b0 msgr2=0x7fb9ec0b5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:37.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.704+0000 7fb9f1e00640 1 --2- 172.21.15.112:0/2161891979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9ec06f4b0 0x7fb9ec0b5740 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb9d80097a0 tx=0x7fb9d802a0b0 comp rx=0 tx=0).stop 2024-09-12T02:45:37.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.704+0000 7fb9f1e00640 1 -- 172.21.15.112:0/2161891979 shutdown_connections 2024-09-12T02:45:37.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.704+0000 7fb9f1e00640 1 --2- 172.21.15.112:0/2161891979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9ec06f4b0 0x7fb9ec0b5740 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:37.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.704+0000 7fb9f1e00640 1 -- 172.21.15.112:0/2161891979 >> 172.21.15.112:0/2161891979 conn(0x7fb9ec06bbd0 msgr2=0x7fb9ec06bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:37.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.704+0000 7fb9f1e00640 1 -- 172.21.15.112:0/2161891979 shutdown_connections 2024-09-12T02:45:37.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.704+0000 7fb9f1e00640 1 -- 172.21.15.112:0/2161891979 wait complete. 2024-09-12T02:45:37.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.705+0000 7fb9f1e00640 1 Processor -- start 2024-09-12T02:45:37.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.705+0000 7fb9f1e00640 1 -- start start 2024-09-12T02:45:37.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.706+0000 7fb9f1e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9ec06f4b0 0x7fb9ec15c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:37.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.706+0000 7fb9f1e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb9ec0afd70 0x7fb9ec15ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:37.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.706+0000 7fb9f1e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9ec1620f0 0x7fb9ec14ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:37.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.706+0000 7fb9f1e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ec0d13a0 con 0x7fb9ec06f4b0 2024-09-12T02:45:37.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.706+0000 7fb9f1e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ec0737d0 con 0x7fb9ec1620f0 2024-09-12T02:45:37.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.706+0000 7fb9f1e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb9ec0d0820 con 0x7fb9ec0afd70 2024-09-12T02:45:37.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.707+0000 7fb9f0a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9ec06f4b0 0x7fb9ec15c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:37.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.707+0000 7fb9f0a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9ec06f4b0 0x7fb9ec15c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48216/0 (socket says 172.21.15.112:48216) 2024-09-12T02:45:37.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.707+0000 7fb9f0a00640 1 -- 172.21.15.112:0/163932548 learned_addr learned my addr 172.21.15.112:0/163932548 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:37.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.707+0000 7fb9ebe00640 1 --2- 172.21.15.112:0/163932548 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb9ec0afd70 0x7fb9ec15ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:37.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.707+0000 7fb9f1400640 1 --2- 172.21.15.112:0/163932548 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9ec1620f0 0x7fb9ec14ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:37.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.707+0000 7fb9f0a00640 1 -- 172.21.15.112:0/163932548 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb9ec0afd70 msgr2=0x7fb9ec15ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:37.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.707+0000 7fb9f0a00640 1 --2- 172.21.15.112:0/163932548 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb9ec0afd70 0x7fb9ec15ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:37.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.707+0000 7fb9f0a00640 1 -- 172.21.15.112:0/163932548 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9ec1620f0 msgr2=0x7fb9ec14ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:37.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.707+0000 7fb9f0a00640 1 --2- 172.21.15.112:0/163932548 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9ec1620f0 0x7fb9ec14ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:37.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.707+0000 7fb9f0a00640 1 -- 172.21.15.112:0/163932548 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ec159f80 con 0x7fb9ec06f4b0 2024-09-12T02:45:37.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.707+0000 7fb9f0a00640 1 --2- 172.21.15.112:0/163932548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9ec06f4b0 0x7fb9ec15c160 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb9e000c3c0 tx=0x7fb9e000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:37.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.708+0000 7fb9e8c00640 1 -- 172.21.15.112:0/163932548 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0017070 con 0x7fb9ec06f4b0 2024-09-12T02:45:37.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.708+0000 7fb9e8c00640 1 -- 172.21.15.112:0/163932548 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9e0005ce0 con 0x7fb9ec06f4b0 2024-09-12T02:45:37.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.708+0000 7fb9e8c00640 1 -- 172.21.15.112:0/163932548 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e00072f0 con 0x7fb9ec06f4b0 2024-09-12T02:45:37.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.708+0000 7fb9f1e00640 1 -- 172.21.15.112:0/163932548 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9ec15a260 con 0x7fb9ec06f4b0 2024-09-12T02:45:37.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.708+0000 7fb9f1e00640 1 -- 172.21.15.112:0/163932548 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9ec15ab20 con 0x7fb9ec06f4b0 2024-09-12T02:45:37.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.709+0000 7fb9f1e00640 1 -- 172.21.15.112:0/163932548 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9ec15a910 con 0x7fb9ec06f4b0 2024-09-12T02:45:37.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.710+0000 7fb9e8c00640 1 -- 172.21.15.112:0/163932548 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb9e001a070 con 0x7fb9ec06f4b0 2024-09-12T02:45:37.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.711+0000 7fb9e8c00640 1 --2- 172.21.15.112:0/163932548 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb9cc06be30 0x7fb9cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:37.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.711+0000 7fb9e8c00640 1 -- 172.21.15.112:0/163932548 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5709+0+0 (secure 0 0 0) 0x7fb9e008a1b0 con 0x7fb9ec06f4b0 2024-09-12T02:45:37.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.711+0000 7fb9ebe00640 1 --2- 172.21.15.112:0/163932548 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb9cc06be30 0x7fb9cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:37.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.712+0000 7fb9ebe00640 1 --2- 172.21.15.112:0/163932548 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb9cc06be30 0x7fb9cc06e2f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8034000 tx=0x7fb9d802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:37.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.715+0000 7fb9e8c00640 1 -- 172.21.15.112:0/163932548 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb9e0058470 con 0x7fb9ec06f4b0 2024-09-12T02:45:37.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:37.929+0000 7fb9f1e00640 1 -- 172.21.15.112:0/163932548 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb9ec0b5740 con 0x7fb9ec06f4b0 2024-09-12T02:45:38.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.811+0000 7fb9e8c00640 1 -- 172.21.15.112:0/163932548 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v43) ==== 118+0+0 (secure 0 0 0) 0x7fb9e005c770 con 0x7fb9ec06f4b0 2024-09-12T02:45:38.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.814+0000 7fb9f1e00640 1 -- 172.21.15.112:0/163932548 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb9cc06be30 msgr2=0x7fb9cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:38.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.814+0000 7fb9f1e00640 1 --2- 172.21.15.112:0/163932548 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb9cc06be30 0x7fb9cc06e2f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8034000 tx=0x7fb9d802e000 comp rx=0 tx=0).stop 2024-09-12T02:45:38.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.814+0000 7fb9f1e00640 1 -- 172.21.15.112:0/163932548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9ec06f4b0 msgr2=0x7fb9ec15c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:38.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.814+0000 7fb9f1e00640 1 --2- 172.21.15.112:0/163932548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9ec06f4b0 0x7fb9ec15c160 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb9e000c3c0 tx=0x7fb9e000c880 comp rx=0 tx=0).stop 2024-09-12T02:45:38.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.814+0000 7fb9f1e00640 1 -- 172.21.15.112:0/163932548 shutdown_connections 2024-09-12T02:45:38.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.814+0000 7fb9f1e00640 1 --2- 172.21.15.112:0/163932548 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb9cc06be30 0x7fb9cc06e2f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:38.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.814+0000 7fb9f1e00640 1 --2- 172.21.15.112:0/163932548 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9ec1620f0 0x7fb9ec14ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:38.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.814+0000 7fb9f1e00640 1 --2- 172.21.15.112:0/163932548 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb9ec0afd70 0x7fb9ec15ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:38.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.814+0000 7fb9f1e00640 1 --2- 172.21.15.112:0/163932548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9ec06f4b0 0x7fb9ec15c160 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:38.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.814+0000 7fb9f1e00640 1 -- 172.21.15.112:0/163932548 >> 172.21.15.112:0/163932548 conn(0x7fb9ec06bbd0 msgr2=0x7fb9ec0cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:38.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.814+0000 7fb9f1e00640 1 -- 172.21.15.112:0/163932548 shutdown_connections 2024-09-12T02:45:38.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.814+0000 7fb9f1e00640 1 -- 172.21.15.112:0/163932548 wait complete. 2024-09-12T02:45:38.831 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T02:45:38.832 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T02:45:38.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.992+0000 7f9488600640 1 Processor -- start 2024-09-12T02:45:38.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.992+0000 7f9488600640 1 -- start start 2024-09-12T02:45:38.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.993+0000 7f9488600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f948006e050 0x7f94800cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:38.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.993+0000 7f9488600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9480071ff0 0x7f948006e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:38.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.994+0000 7f9488600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f948015b6a0 con 0x7f948006e970 2024-09-12T02:45:38.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.994+0000 7f9488600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f94800b43b0 con 0x7f9480071ff0 2024-09-12T02:45:38.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.994+0000 7f9488600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f94800b3a80 con 0x7f948006e050 2024-09-12T02:45:38.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.994+0000 7f9485200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9480071ff0 0x7f948006e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:38.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.994+0000 7f9486600640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f948006e970 0x7f94800b4840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38090/0 (socket says 172.21.15.112:38090) 2024-09-12T02:45:38.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.994+0000 7f9486600640 1 -- 172.21.15.112:0/417780336 learned_addr learned my addr 172.21.15.112:0/417780336 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:45:38.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.994+0000 7f9485c00640 1 --2- 172.21.15.112:0/417780336 >> v2:172.21.15.137:3300/0 conn(0x7f948006e050 0x7f94800cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:38.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.994+0000 7f9485200640 1 -- 172.21.15.112:0/417780336 >> v2:172.21.15.137:3300/0 conn(0x7f948006e050 msgr2=0x7f94800cfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:38.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.994+0000 7f9485200640 1 --2- 172.21.15.112:0/417780336 >> v2:172.21.15.137:3300/0 conn(0x7f948006e050 0x7f94800cfff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:38.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.994+0000 7f9485200640 1 -- 172.21.15.112:0/417780336 >> v1:172.21.15.112:6789/0 conn(0x7f948006e970 legacy=0x7f94800b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:38.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.994+0000 7f9485200640 1 -- 172.21.15.112:0/417780336 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94800b3d60 con 0x7f9480071ff0 2024-09-12T02:45:38.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.994+0000 7f947fe00640 1 -- 172.21.15.112:0/417780336 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3561898830 0 0) 0x7f948015b6a0 con 0x7f948006e970 2024-09-12T02:45:38.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.995+0000 7f9485200640 1 --2- 172.21.15.112:0/417780336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9480071ff0 0x7f948006e430 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f948006d260 tx=0x7f946c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc63638710ac8e39 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:38.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.996+0000 7f947fe00640 1 -- 172.21.15.112:0/417780336 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f946c037070 con 0x7f9480071ff0 2024-09-12T02:45:38.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.996+0000 7f947fe00640 1 -- 172.21.15.112:0/417780336 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f946c032440 con 0x7f9480071ff0 2024-09-12T02:45:38.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.996+0000 7f947fe00640 1 -- 172.21.15.112:0/417780336 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f946c032810 con 0x7f9480071ff0 2024-09-12T02:45:38.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.996+0000 7f9488600640 1 -- 172.21.15.112:0/417780336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9480071ff0 msgr2=0x7f948006e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:38.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.996+0000 7f9488600640 1 --2- 172.21.15.112:0/417780336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9480071ff0 0x7f948006e430 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f948006d260 tx=0x7f946c02a1a0 comp rx=0 tx=0).stop 2024-09-12T02:45:38.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.996+0000 7f9488600640 1 -- 172.21.15.112:0/417780336 shutdown_connections 2024-09-12T02:45:38.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.996+0000 7f9488600640 1 --2- 172.21.15.112:0/417780336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9480071ff0 0x7f948006e430 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:38.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.996+0000 7f9488600640 1 --2- 172.21.15.112:0/417780336 >> v2:172.21.15.137:3300/0 conn(0x7f948006e050 0x7f94800cfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:38.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.996+0000 7f9488600640 1 -- 172.21.15.112:0/417780336 >> 172.21.15.112:0/417780336 conn(0x7f948006bbd0 msgr2=0x7f948006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:38.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.996+0000 7f9488600640 1 -- 172.21.15.112:0/417780336 shutdown_connections 2024-09-12T02:45:38.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.996+0000 7f9488600640 1 -- 172.21.15.112:0/417780336 wait complete. 2024-09-12T02:45:38.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.998+0000 7f9488600640 1 Processor -- start 2024-09-12T02:45:38.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.998+0000 7f9488600640 1 -- start start 2024-09-12T02:45:39.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.999+0000 7f9488600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f948006e050 0x7f9480148950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:39.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.999+0000 7f9488600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f948006e970 0x7f94800aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:39.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.999+0000 7f9488600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9480071ff0 0x7f948015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:39.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.999+0000 7f9488600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f948006d550 con 0x7f948006e970 2024-09-12T02:45:39.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.999+0000 7f9488600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f94800d0530 con 0x7f948006e050 2024-09-12T02:45:39.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.999+0000 7f9488600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f948006d6d0 con 0x7f9480071ff0 2024-09-12T02:45:39.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.999+0000 7f9485200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f948006e970 0x7f94800aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:39.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.999+0000 7f9485200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f948006e970 0x7f94800aeb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48242/0 (socket says 172.21.15.112:48242) 2024-09-12T02:45:39.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:38.999+0000 7f9485200640 1 -- 172.21.15.112:0/216449138 learned_addr learned my addr 172.21.15.112:0/216449138 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:39.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.000+0000 7f9486600640 1 --2- 172.21.15.112:0/216449138 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9480071ff0 0x7f948015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:39.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.000+0000 7f9485c00640 1 --2- 172.21.15.112:0/216449138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f948006e050 0x7f9480148950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:39.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.000+0000 7f9485200640 1 -- 172.21.15.112:0/216449138 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9480071ff0 msgr2=0x7f948015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:39.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.000+0000 7f9485200640 1 --2- 172.21.15.112:0/216449138 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9480071ff0 0x7f948015c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:39.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.000+0000 7f9485200640 1 -- 172.21.15.112:0/216449138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f948006e050 msgr2=0x7f9480148950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:39.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.000+0000 7f9485200640 1 --2- 172.21.15.112:0/216449138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f948006e050 0x7f9480148950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:39.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.000+0000 7f9485200640 1 -- 172.21.15.112:0/216449138 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9480149180 con 0x7f948006e970 2024-09-12T02:45:39.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.000+0000 7f9485200640 1 --2- 172.21.15.112:0/216449138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f948006e970 0x7f94800aeb40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f946c035040 tx=0x7f946c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:39.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.000+0000 7f947d600640 1 -- 172.21.15.112:0/216449138 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f946c043070 con 0x7f948006e970 2024-09-12T02:45:39.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.000+0000 7f947d600640 1 -- 172.21.15.112:0/216449138 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f946c038040 con 0x7f948006e970 2024-09-12T02:45:39.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.000+0000 7f947d600640 1 -- 172.21.15.112:0/216449138 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f946c037050 con 0x7f948006e970 2024-09-12T02:45:39.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.001+0000 7f9488600640 1 -- 172.21.15.112:0/216449138 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9480149460 con 0x7f948006e970 2024-09-12T02:45:39.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.001+0000 7f9488600640 1 -- 172.21.15.112:0/216449138 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f948015b8b0 con 0x7f948006e970 2024-09-12T02:45:39.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.002+0000 7f9488600640 1 -- 172.21.15.112:0/216449138 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f948006da30 con 0x7f948006e970 2024-09-12T02:45:39.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.003+0000 7f947d600640 1 -- 172.21.15.112:0/216449138 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f946c046070 con 0x7f948006e970 2024-09-12T02:45:39.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.003+0000 7f947d600640 1 --2- 172.21.15.112:0/216449138 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f946006be30 0x7f946006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:39.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.003+0000 7f947d600640 1 -- 172.21.15.112:0/216449138 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5709+0+0 (secure 0 0 0) 0x7f946c0aaf30 con 0x7f948006e970 2024-09-12T02:45:39.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.004+0000 7f9485c00640 1 --2- 172.21.15.112:0/216449138 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f946006be30 0x7f946006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:39.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.004+0000 7f9485c00640 1 --2- 172.21.15.112:0/216449138 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f946006be30 0x7f946006e2f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9474009b40 tx=0x7f9474009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:39.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.007+0000 7f947d600640 1 -- 172.21.15.112:0/216449138 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f946c079290 con 0x7f948006e970 2024-09-12T02:45:39.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.213+0000 7f9488600640 1 -- 172.21.15.112:0/216449138 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f94800cf5b0 con 0x7f948006e970 2024-09-12T02:45:39.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.816+0000 7f947d600640 1 -- 172.21.15.112:0/216449138 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v44) ==== 122+0+0 (secure 0 0 0) 0x7f946c07d590 con 0x7f948006e970 2024-09-12T02:45:39.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.819+0000 7f9488600640 1 -- 172.21.15.112:0/216449138 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f946006be30 msgr2=0x7f946006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:39.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.819+0000 7f9488600640 1 --2- 172.21.15.112:0/216449138 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f946006be30 0x7f946006e2f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9474009b40 tx=0x7f9474009190 comp rx=0 tx=0).stop 2024-09-12T02:45:39.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.819+0000 7f9488600640 1 -- 172.21.15.112:0/216449138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f948006e970 msgr2=0x7f94800aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:39.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.819+0000 7f9488600640 1 --2- 172.21.15.112:0/216449138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f948006e970 0x7f94800aeb40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f946c035040 tx=0x7f946c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:45:39.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.819+0000 7f9488600640 1 -- 172.21.15.112:0/216449138 shutdown_connections 2024-09-12T02:45:39.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.819+0000 7f9488600640 1 --2- 172.21.15.112:0/216449138 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9480071ff0 0x7f948015c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:39.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.819+0000 7f9488600640 1 --2- 172.21.15.112:0/216449138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f948006e970 0x7f94800aeb40 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:39.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.819+0000 7f9488600640 1 --2- 172.21.15.112:0/216449138 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f946006be30 0x7f946006e2f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:39.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.819+0000 7f9488600640 1 --2- 172.21.15.112:0/216449138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f948006e050 0x7f9480148950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:39.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.819+0000 7f9488600640 1 -- 172.21.15.112:0/216449138 >> 172.21.15.112:0/216449138 conn(0x7f948006bbd0 msgr2=0x7f94800ce480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:39.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.820+0000 7f9488600640 1 -- 172.21.15.112:0/216449138 shutdown_connections 2024-09-12T02:45:39.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.820+0000 7f9488600640 1 -- 172.21.15.112:0/216449138 wait complete. 2024-09-12T02:45:39.839 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T02:45:39.839 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:45:39.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.996+0000 7f5019200640 1 Processor -- start 2024-09-12T02:45:39.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.996+0000 7f5019200640 1 -- start start 2024-09-12T02:45:39.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.997+0000 7f5019200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f501406f600 0x7f50140b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:39.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.997+0000 7f5019200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f50140b45d0 0x7f50140728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:39.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.997+0000 7f5019200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50140b4a20 con 0x7f501415b9d0 2024-09-12T02:45:39.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.997+0000 7f5019200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f50140b54a0 con 0x7f50140b45d0 2024-09-12T02:45:39.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.997+0000 7f5019200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f50140b3af0 con 0x7f501406f600 2024-09-12T02:45:39.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.998+0000 7f5011e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f501415b9d0 0x7f501406eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38102/0 (socket says 172.21.15.112:38102) 2024-09-12T02:45:39.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.998+0000 7f5011e00640 1 -- 172.21.15.112:0/4187744580 learned_addr learned my addr 172.21.15.112:0/4187744580 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:45:39.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.998+0000 7f5012800640 1 --2- 172.21.15.112:0/4187744580 >> v2:172.21.15.112:3300/0 conn(0x7f50140b45d0 0x7f50140728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:40.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.998+0000 7f500be00640 1 --2- 172.21.15.112:0/4187744580 >> v2:172.21.15.137:3300/0 conn(0x7f501406f600 0x7f50140b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:40.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.998+0000 7f5011400640 1 -- 172.21.15.112:0/4187744580 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 531449330 0 0) 0x7f50140b4a20 con 0x7f501415b9d0 2024-09-12T02:45:40.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.998+0000 7f5011400640 1 -- 172.21.15.112:0/4187744580 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ff8003520 con 0x7f501415b9d0 2024-09-12T02:45:40.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.998+0000 7f5012800640 1 -- 172.21.15.112:0/4187744580 >> v2:172.21.15.137:3300/0 conn(0x7f501406f600 msgr2=0x7f50140b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:40.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.998+0000 7f5012800640 1 --2- 172.21.15.112:0/4187744580 >> v2:172.21.15.137:3300/0 conn(0x7f501406f600 0x7f50140b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.998+0000 7f5012800640 1 -- 172.21.15.112:0/4187744580 >> v1:172.21.15.112:6789/0 conn(0x7f501415b9d0 legacy=0x7f501406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:40.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.998+0000 7f5012800640 1 -- 172.21.15.112:0/4187744580 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50140b3dd0 con 0x7f50140b45d0 2024-09-12T02:45:40.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.999+0000 7f5012800640 1 --2- 172.21.15.112:0/4187744580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50140b45d0 0x7f50140728c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5014071200 tx=0x7f500c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e83032a4c7dc915a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:40.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:39.999+0000 7f5011400640 1 -- 172.21.15.112:0/4187744580 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500c007740 con 0x7f50140b45d0 2024-09-12T02:45:40.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.000+0000 7f5011400640 1 -- 172.21.15.112:0/4187744580 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f500c0078e0 con 0x7f50140b45d0 2024-09-12T02:45:40.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.000+0000 7f5011400640 1 -- 172.21.15.112:0/4187744580 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500c007c90 con 0x7f50140b45d0 2024-09-12T02:45:40.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.000+0000 7f5019200640 1 -- 172.21.15.112:0/4187744580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50140b45d0 msgr2=0x7f50140728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:40.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.000+0000 7f5019200640 1 --2- 172.21.15.112:0/4187744580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50140b45d0 0x7f50140728c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5014071200 tx=0x7f500c02a5f0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.000+0000 7f5019200640 1 -- 172.21.15.112:0/4187744580 shutdown_connections 2024-09-12T02:45:40.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.000+0000 7f5019200640 1 --2- 172.21.15.112:0/4187744580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50140b45d0 0x7f50140728c0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.000+0000 7f5019200640 1 --2- 172.21.15.112:0/4187744580 >> v2:172.21.15.137:3300/0 conn(0x7f501406f600 0x7f50140b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.000+0000 7f5019200640 1 -- 172.21.15.112:0/4187744580 >> 172.21.15.112:0/4187744580 conn(0x7f501406bbd0 msgr2=0x7f501406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:40.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.000+0000 7f5019200640 1 -- 172.21.15.112:0/4187744580 shutdown_connections 2024-09-12T02:45:40.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.000+0000 7f5019200640 1 -- 172.21.15.112:0/4187744580 wait complete. 2024-09-12T02:45:40.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.002+0000 7f5019200640 1 Processor -- start 2024-09-12T02:45:40.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.002+0000 7f5019200640 1 -- start start 2024-09-12T02:45:40.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.003+0000 7f5019200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f501406f600 0x7f501415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:40.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.003+0000 7f5019200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50140b45d0 0x7f50141493f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:40.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.003+0000 7f5019200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f501415b9d0 0x7f5014156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:40.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.003+0000 7f5019200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f501415bf30 con 0x7f501406f600 2024-09-12T02:45:40.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.003+0000 7f5019200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f501415bdb0 con 0x7f50140b45d0 2024-09-12T02:45:40.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.003+0000 7f5019200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f50140cdcd0 con 0x7f501415b9d0 2024-09-12T02:45:40.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.003+0000 7f5011e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f501406f600 0x7f501415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:40.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.003+0000 7f5011e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f501406f600 0x7f501415c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48260/0 (socket says 172.21.15.112:48260) 2024-09-12T02:45:40.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.003+0000 7f5011e00640 1 -- 172.21.15.112:0/2855606847 learned_addr learned my addr 172.21.15.112:0/2855606847 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:40.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.004+0000 7f5011e00640 1 -- 172.21.15.112:0/2855606847 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f501415b9d0 msgr2=0x7f5014156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:40.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.004+0000 7f5011e00640 1 --2- 172.21.15.112:0/2855606847 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f501415b9d0 0x7f5014156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.004+0000 7f5011e00640 1 -- 172.21.15.112:0/2855606847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50140b45d0 msgr2=0x7f50141493f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:40.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.004+0000 7f5011e00640 1 --2- 172.21.15.112:0/2855606847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50140b45d0 0x7f50141493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.004+0000 7f5011e00640 1 -- 172.21.15.112:0/2855606847 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5014154210 con 0x7f501406f600 2024-09-12T02:45:40.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.004+0000 7f5011e00640 1 --2- 172.21.15.112:0/2855606847 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f501406f600 0x7f501415c0b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f500400c390 tx=0x7f500400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:40.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.004+0000 7f500a000640 1 -- 172.21.15.112:0/2855606847 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5004017070 con 0x7f501406f600 2024-09-12T02:45:40.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.004+0000 7f500a000640 1 -- 172.21.15.112:0/2855606847 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5004005ce0 con 0x7f501406f600 2024-09-12T02:45:40.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.004+0000 7f5019200640 1 -- 172.21.15.112:0/2855606847 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50141544f0 con 0x7f501406f600 2024-09-12T02:45:40.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.004+0000 7f500a000640 1 -- 172.21.15.112:0/2855606847 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50040072f0 con 0x7f501406f600 2024-09-12T02:45:40.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.004+0000 7f5019200640 1 -- 172.21.15.112:0/2855606847 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5014154ab0 con 0x7f501406f600 2024-09-12T02:45:40.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.005+0000 7f5019200640 1 -- 172.21.15.112:0/2855606847 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5014068a30 con 0x7f501406f600 2024-09-12T02:45:40.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.006+0000 7f500a000640 1 -- 172.21.15.112:0/2855606847 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f500401a070 con 0x7f501406f600 2024-09-12T02:45:40.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.007+0000 7f500a000640 1 --2- 172.21.15.112:0/2855606847 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4ff006be30 0x7f4ff006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:40.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.008+0000 7f500a000640 1 -- 172.21.15.112:0/2855606847 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5709+0+0 (secure 0 0 0) 0x7f500408a270 con 0x7f501406f600 2024-09-12T02:45:40.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.008+0000 7f500be00640 1 --2- 172.21.15.112:0/2855606847 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4ff006be30 0x7f4ff006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:40.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.008+0000 7f500be00640 1 --2- 172.21.15.112:0/2855606847 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4ff006be30 0x7f4ff006e2f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc006a30 tx=0x7f4ffc0069c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:40.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.012+0000 7f500a000640 1 -- 172.21.15.112:0/2855606847 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5004058c10 con 0x7f501406f600 2024-09-12T02:45:40.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.218+0000 7f5019200640 1 -- 172.21.15.112:0/2855606847 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5014158d60 con 0x7f501406f600 2024-09-12T02:45:40.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.218+0000 7f500a000640 1 -- 172.21.15.112:0/2855606847 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5234 (secure 0 0 0) 0x7f5004058510 con 0x7f501406f600 2024-09-12T02:45:40.220 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:45:40.220 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":44,"btime":"2024-09-12T02:45:39:811882+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/2773143619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2773143619},{"type":"v1","addr":"172.21.15.137:6834","nonce":2773143619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5186,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2810064950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2810064950},{"type":"v1","addr":"172.21.15.137:6835","nonce":2810064950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5192,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/366104267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":366104267},{"type":"v1","addr":"172.21.15.112:6837","nonce":366104267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:45:36.194908+0000","modified":"2024-09-12T02:45:39.214065+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5545":{"gid":5545,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/1248364583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1248364583},{"type":"v1","addr":"172.21.15.112:6836","nonce":1248364583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5545,"qdb_cluster":[5545]},"id":5}]} 2024-09-12T02:45:40.220 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 44 2024-09-12T02:45:40.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.220+0000 7f5019200640 1 -- 172.21.15.112:0/2855606847 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4ff006be30 msgr2=0x7f4ff006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:40.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.220+0000 7f5019200640 1 --2- 172.21.15.112:0/2855606847 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4ff006be30 0x7f4ff006e2f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc006a30 tx=0x7f4ffc0069c0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.220+0000 7f5019200640 1 -- 172.21.15.112:0/2855606847 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f501406f600 msgr2=0x7f501415c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:40.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.220+0000 7f5019200640 1 --2- 172.21.15.112:0/2855606847 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f501406f600 0x7f501415c0b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f500400c390 tx=0x7f500400c850 comp rx=0 tx=0).stop 2024-09-12T02:45:40.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.221+0000 7f5019200640 1 -- 172.21.15.112:0/2855606847 shutdown_connections 2024-09-12T02:45:40.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.221+0000 7f5019200640 1 --2- 172.21.15.112:0/2855606847 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f501415b9d0 0x7f5014156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.221+0000 7f5019200640 1 --2- 172.21.15.112:0/2855606847 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4ff006be30 0x7f4ff006e2f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.221+0000 7f5019200640 1 --2- 172.21.15.112:0/2855606847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50140b45d0 0x7f50141493f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.221+0000 7f5019200640 1 --2- 172.21.15.112:0/2855606847 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f501406f600 0x7f501415c0b0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.221+0000 7f5019200640 1 -- 172.21.15.112:0/2855606847 >> 172.21.15.112:0/2855606847 conn(0x7f501406bbd0 msgr2=0x7f50140af430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:40.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.221+0000 7f5019200640 1 -- 172.21.15.112:0/2855606847 shutdown_connections 2024-09-12T02:45:40.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.221+0000 7f5019200640 1 -- 172.21.15.112:0/2855606847 wait complete. 2024-09-12T02:45:40.237 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:45:40.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.388+0000 7ff22fe00640 1 Processor -- start 2024-09-12T02:45:40.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.388+0000 7ff22fe00640 1 -- start start 2024-09-12T02:45:40.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.389+0000 7ff22fe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff2300d1710 0x7ff2300d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:40.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.389+0000 7ff22fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2300b1d70 0x7ff2300b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:40.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.389+0000 7ff22fe00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2300d2fb0 con 0x7ff2300b3e00 2024-09-12T02:45:40.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.389+0000 7ff22fe00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff2300d3cb0 con 0x7ff2300d1710 2024-09-12T02:45:40.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.389+0000 7ff22fe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff2300d0b60 con 0x7ff2300b1d70 2024-09-12T02:45:40.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.389+0000 7ff22ea00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff2300d1710 0x7ff2300d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:40.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.389+0000 7ff22ea00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff2300d1710 0x7ff2300d28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:47488/0 (socket says 172.21.15.112:47488) 2024-09-12T02:45:40.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.389+0000 7ff22ea00640 1 -- 172.21.15.112:0/2297627602 learned_addr learned my addr 172.21.15.112:0/2297627602 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:40.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.389+0000 7ff22e000640 1 --1- 172.21.15.112:0/2297627602 >> v1:172.21.15.137:6789/0 conn(0x7ff2300b3e00 0x7ff2300d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.112:43680/0 (socket says 172.21.15.112:43680) 2024-09-12T02:45:40.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.389+0000 7ff22f400640 1 --2- 172.21.15.112:0/2297627602 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2300b1d70 0x7ff2300b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:40.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.390+0000 7ff22ea00640 1 -- 172.21.15.112:0/2297627602 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2300b1d70 msgr2=0x7ff2300b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:40.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.390+0000 7ff22ea00640 1 --2- 172.21.15.112:0/2297627602 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2300b1d70 0x7ff2300b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.390+0000 7ff22ea00640 1 -- 172.21.15.112:0/2297627602 >> v1:172.21.15.137:6789/0 conn(0x7ff2300b3e00 legacy=0x7ff2300d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:40.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.390+0000 7ff22ea00640 1 -- 172.21.15.112:0/2297627602 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2300d3410 con 0x7ff2300d1710 2024-09-12T02:45:40.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.391+0000 7ff22ea00640 1 --2- 172.21.15.112:0/2297627602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2300d1710 0x7ff2300d28d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff220009870 tx=0x7ff22002a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24931da95ab4b6aa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:40.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.391+0000 7ff22d600640 1 -- 172.21.15.112:0/2297627602 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff220037070 con 0x7ff2300d1710 2024-09-12T02:45:40.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.391+0000 7ff22d600640 1 -- 172.21.15.112:0/2297627602 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff220032440 con 0x7ff2300d1710 2024-09-12T02:45:40.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.391+0000 7ff22d600640 1 -- 172.21.15.112:0/2297627602 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff220032810 con 0x7ff2300d1710 2024-09-12T02:45:40.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.392+0000 7ff22fe00640 1 -- 172.21.15.112:0/2297627602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2300d1710 msgr2=0x7ff2300d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:40.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.392+0000 7ff22fe00640 1 --2- 172.21.15.112:0/2297627602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2300d1710 0x7ff2300d28d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff220009870 tx=0x7ff22002a250 comp rx=0 tx=0).stop 2024-09-12T02:45:40.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.392+0000 7ff22fe00640 1 -- 172.21.15.112:0/2297627602 shutdown_connections 2024-09-12T02:45:40.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.392+0000 7ff22fe00640 1 --2- 172.21.15.112:0/2297627602 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2300b1d70 0x7ff2300b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.392+0000 7ff22fe00640 1 --2- 172.21.15.112:0/2297627602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2300d1710 0x7ff2300d28d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.392+0000 7ff22fe00640 1 -- 172.21.15.112:0/2297627602 >> 172.21.15.112:0/2297627602 conn(0x7ff23009e030 msgr2=0x7ff2300d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:40.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.392+0000 7ff22fe00640 1 -- 172.21.15.112:0/2297627602 shutdown_connections 2024-09-12T02:45:40.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.392+0000 7ff22fe00640 1 -- 172.21.15.112:0/2297627602 wait complete. 2024-09-12T02:45:40.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.393+0000 7ff22fe00640 1 Processor -- start 2024-09-12T02:45:40.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.394+0000 7ff22fe00640 1 -- start start 2024-09-12T02:45:40.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.394+0000 7ff22fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2300b1d70 0x7ff230161950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:40.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.394+0000 7ff22fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2300b3e00 0x7ff230158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:40.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.394+0000 7ff22fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2300d1710 0x7ff2300cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:40.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.394+0000 7ff22fe00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff23015f110 con 0x7ff2300b1d70 2024-09-12T02:45:40.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.394+0000 7ff22fe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff2300d39d0 con 0x7ff2300d1710 2024-09-12T02:45:40.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.394+0000 7ff22fe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff23015f290 con 0x7ff2300b3e00 2024-09-12T02:45:40.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.395+0000 7ff22ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2300b1d70 0x7ff230161950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:40.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.395+0000 7ff22ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2300b1d70 0x7ff230161950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48264/0 (socket says 172.21.15.112:48264) 2024-09-12T02:45:40.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.395+0000 7ff22ea00640 1 -- 172.21.15.112:0/4256744080 learned_addr learned my addr 172.21.15.112:0/4256744080 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:40.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.395+0000 7ff22f400640 1 --2- 172.21.15.112:0/4256744080 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2300d1710 0x7ff2300cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:40.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.395+0000 7ff22e000640 1 --2- 172.21.15.112:0/4256744080 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2300b3e00 0x7ff230158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:40.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.395+0000 7ff22ea00640 1 -- 172.21.15.112:0/4256744080 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2300b3e00 msgr2=0x7ff230158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:40.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.395+0000 7ff22ea00640 1 --2- 172.21.15.112:0/4256744080 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2300b3e00 0x7ff230158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.395+0000 7ff22ea00640 1 -- 172.21.15.112:0/4256744080 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2300d1710 msgr2=0x7ff2300cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:40.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.395+0000 7ff22ea00640 1 --2- 172.21.15.112:0/4256744080 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2300d1710 0x7ff2300cc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.395+0000 7ff22ea00640 1 -- 172.21.15.112:0/4256744080 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2301608b0 con 0x7ff2300b1d70 2024-09-12T02:45:40.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.396+0000 7ff22ea00640 1 --2- 172.21.15.112:0/4256744080 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2300b1d70 0x7ff230161950 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff220000c00 tx=0x7ff2200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:40.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.396+0000 7ff226a00640 1 -- 172.21.15.112:0/4256744080 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff220041020 con 0x7ff2300b1d70 2024-09-12T02:45:40.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.396+0000 7ff226a00640 1 -- 172.21.15.112:0/4256744080 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff22003d620 con 0x7ff2300b1d70 2024-09-12T02:45:40.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.396+0000 7ff22fe00640 1 -- 172.21.15.112:0/4256744080 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff230160b90 con 0x7ff2300b1d70 2024-09-12T02:45:40.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.396+0000 7ff226a00640 1 -- 172.21.15.112:0/4256744080 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff220037040 con 0x7ff2300b1d70 2024-09-12T02:45:40.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.396+0000 7ff22fe00640 1 -- 172.21.15.112:0/4256744080 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff230161150 con 0x7ff2300b1d70 2024-09-12T02:45:40.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.397+0000 7ff22fe00640 1 -- 172.21.15.112:0/4256744080 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2300d49e0 con 0x7ff2300b1d70 2024-09-12T02:45:40.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.398+0000 7ff226a00640 1 -- 172.21.15.112:0/4256744080 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff220044020 con 0x7ff2300b1d70 2024-09-12T02:45:40.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.399+0000 7ff226a00640 1 --2- 172.21.15.112:0/4256744080 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff21006be30 0x7ff21006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:40.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.399+0000 7ff226a00640 1 -- 172.21.15.112:0/4256744080 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5709+0+0 (secure 0 0 0) 0x7ff2200ab420 con 0x7ff2300b1d70 2024-09-12T02:45:40.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.399+0000 7ff22e000640 1 --2- 172.21.15.112:0/4256744080 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff21006be30 0x7ff21006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:40.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.400+0000 7ff22e000640 1 --2- 172.21.15.112:0/4256744080 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff21006be30 0x7ff21006e2f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff2300b4550 tx=0x7ff21c007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:40.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.403+0000 7ff226a00640 1 -- 172.21.15.112:0/4256744080 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff2300d49e0 con 0x7ff2300b1d70 2024-09-12T02:45:40.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.578+0000 7ff22fe00640 1 -- 172.21.15.112:0/4256744080 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff23006d4f0 con 0x7ff2300b1d70 2024-09-12T02:45:40.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.579+0000 7ff226a00640 1 -- 172.21.15.112:0/4256744080 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+16776 (secure 0 0 0) 0x7ff22004b030 con 0x7ff2300b1d70 2024-09-12T02:45:40.581 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:45:40.581 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":79,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:45:37.783716+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:45:33.961909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-12T02:45:35.184607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:45:40.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.581+0000 7ff22fe00640 1 -- 172.21.15.112:0/4256744080 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff21006be30 msgr2=0x7ff21006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:40.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.581+0000 7ff22fe00640 1 --2- 172.21.15.112:0/4256744080 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff21006be30 0x7ff21006e2f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff2300b4550 tx=0x7ff21c007e80 comp rx=0 tx=0).stop 2024-09-12T02:45:40.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.581+0000 7ff22fe00640 1 -- 172.21.15.112:0/4256744080 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2300b1d70 msgr2=0x7ff230161950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:40.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.581+0000 7ff22fe00640 1 --2- 172.21.15.112:0/4256744080 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2300b1d70 0x7ff230161950 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff220000c00 tx=0x7ff2200046c0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.582+0000 7ff22fe00640 1 -- 172.21.15.112:0/4256744080 shutdown_connections 2024-09-12T02:45:40.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.582+0000 7ff22fe00640 1 --2- 172.21.15.112:0/4256744080 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff21006be30 0x7ff21006e2f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.582+0000 7ff22fe00640 1 --2- 172.21.15.112:0/4256744080 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2300d1710 0x7ff2300cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.582+0000 7ff22fe00640 1 --2- 172.21.15.112:0/4256744080 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2300b3e00 0x7ff230158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.582+0000 7ff22fe00640 1 --2- 172.21.15.112:0/4256744080 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2300b1d70 0x7ff230161950 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.582+0000 7ff22fe00640 1 -- 172.21.15.112:0/4256744080 >> 172.21.15.112:0/4256744080 conn(0x7ff23009e030 msgr2=0x7ff2300b8280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:40.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.582+0000 7ff22fe00640 1 -- 172.21.15.112:0/4256744080 shutdown_connections 2024-09-12T02:45:40.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.582+0000 7ff22fe00640 1 -- 172.21.15.112:0/4256744080 wait complete. 2024-09-12T02:45:40.599 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:45:40.599 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:45:40.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.749+0000 7f8434200640 1 Processor -- start 2024-09-12T02:45:40.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.749+0000 7f8434200640 1 -- start start 2024-09-12T02:45:40.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.751+0000 7f8434200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f842c15b9d0 0x7f842c0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:40.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.751+0000 7f8434200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f842c06f600 0x7f842c0728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:40.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.751+0000 7f8434200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f842c0b54a0 con 0x7f842c0b45d0 2024-09-12T02:45:40.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.751+0000 7f8434200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f842c0b4a60 con 0x7f842c15b9d0 2024-09-12T02:45:40.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.751+0000 7f8434200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f842c0b3af0 con 0x7f842c06f600 2024-09-12T02:45:40.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.751+0000 7f8431800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f842c15b9d0 0x7f842c0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:40.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.751+0000 7f8431800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f842c15b9d0 0x7f842c0b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48280/0 (socket says 172.21.15.112:48280) 2024-09-12T02:45:40.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.751+0000 7f8431800640 1 -- 172.21.15.112:0/1396430616 learned_addr learned my addr 172.21.15.112:0/1396430616 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:40.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.751+0000 7f8432200640 1 --2- 172.21.15.112:0/1396430616 >> v2:172.21.15.137:3300/0 conn(0x7f842c06f600 0x7f842c0728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:40.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.751+0000 7f8431800640 1 -- 172.21.15.112:0/1396430616 >> v2:172.21.15.137:3300/0 conn(0x7f842c06f600 msgr2=0x7f842c0728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:40.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.751+0000 7f8431800640 1 --2- 172.21.15.112:0/1396430616 >> v2:172.21.15.137:3300/0 conn(0x7f842c06f600 0x7f842c0728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.751+0000 7f8431800640 1 -- 172.21.15.112:0/1396430616 >> v1:172.21.15.137:6789/0 conn(0x7f842c0b45d0 legacy=0x7f842c06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:40.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.751+0000 7f8431800640 1 -- 172.21.15.112:0/1396430616 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f842c0b3dd0 con 0x7f842c15b9d0 2024-09-12T02:45:40.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.752+0000 7f8431800640 1 --2- 172.21.15.112:0/1396430616 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f842c15b9d0 0x7f842c0b4ec0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f842c072f80 tx=0x7f842002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be89d075998574bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:40.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.753+0000 7f842be00640 1 -- 172.21.15.112:0/1396430616 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8420037070 con 0x7f842c15b9d0 2024-09-12T02:45:40.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.753+0000 7f842be00640 1 -- 172.21.15.112:0/1396430616 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8420032440 con 0x7f842c15b9d0 2024-09-12T02:45:40.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.753+0000 7f842be00640 1 -- 172.21.15.112:0/1396430616 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8420032810 con 0x7f842c15b9d0 2024-09-12T02:45:40.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.753+0000 7f8434200640 1 -- 172.21.15.112:0/1396430616 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f842c15b9d0 msgr2=0x7f842c0b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:40.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.753+0000 7f8434200640 1 --2- 172.21.15.112:0/1396430616 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f842c15b9d0 0x7f842c0b4ec0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f842c072f80 tx=0x7f842002a1a0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.753+0000 7f8434200640 1 -- 172.21.15.112:0/1396430616 shutdown_connections 2024-09-12T02:45:40.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.753+0000 7f8434200640 1 --2- 172.21.15.112:0/1396430616 >> v2:172.21.15.137:3300/0 conn(0x7f842c06f600 0x7f842c0728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.753+0000 7f8434200640 1 --2- 172.21.15.112:0/1396430616 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f842c15b9d0 0x7f842c0b4ec0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.753+0000 7f8434200640 1 -- 172.21.15.112:0/1396430616 >> 172.21.15.112:0/1396430616 conn(0x7f842c06bbd0 msgr2=0x7f842c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:40.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.753+0000 7f8434200640 1 -- 172.21.15.112:0/1396430616 shutdown_connections 2024-09-12T02:45:40.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.753+0000 7f8434200640 1 -- 172.21.15.112:0/1396430616 wait complete. 2024-09-12T02:45:40.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.755+0000 7f8434200640 1 Processor -- start 2024-09-12T02:45:40.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.755+0000 7f8434200640 1 -- start start 2024-09-12T02:45:40.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.756+0000 7f8434200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f842c06f600 0x7f842c0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:40.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.756+0000 7f8434200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f842c0b45d0 0x7f842c0ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:40.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.756+0000 7f8434200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f842c15b9d0 0x7f842c1513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:40.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.756+0000 7f8434200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f842c15bf30 con 0x7f842c0b45d0 2024-09-12T02:45:40.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.756+0000 7f8434200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f842c15bdb0 con 0x7f842c15b9d0 2024-09-12T02:45:40.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.756+0000 7f8434200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f842c0cdcd0 con 0x7f842c06f600 2024-09-12T02:45:40.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.756+0000 7f8430e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f842c0b45d0 0x7f842c0ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:40.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.756+0000 7f8430e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f842c0b45d0 0x7f842c0ae8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48290/0 (socket says 172.21.15.112:48290) 2024-09-12T02:45:40.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.756+0000 7f8430e00640 1 -- 172.21.15.112:0/2558960608 learned_addr learned my addr 172.21.15.112:0/2558960608 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:40.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.756+0000 7f8431800640 1 --2- 172.21.15.112:0/2558960608 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f842c06f600 0x7f842c0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:40.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.756+0000 7f8432200640 1 --2- 172.21.15.112:0/2558960608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f842c15b9d0 0x7f842c1513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:40.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.757+0000 7f8430e00640 1 -- 172.21.15.112:0/2558960608 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f842c06f600 msgr2=0x7f842c0ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:40.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.757+0000 7f8430e00640 1 --2- 172.21.15.112:0/2558960608 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f842c06f600 0x7f842c0ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.757+0000 7f8430e00640 1 -- 172.21.15.112:0/2558960608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f842c15b9d0 msgr2=0x7f842c1513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:40.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.757+0000 7f8430e00640 1 --2- 172.21.15.112:0/2558960608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f842c15b9d0 0x7f842c1513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.757+0000 7f8430e00640 1 -- 172.21.15.112:0/2558960608 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f842c0af240 con 0x7f842c0b45d0 2024-09-12T02:45:40.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.757+0000 7f8430e00640 1 --2- 172.21.15.112:0/2558960608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f842c0b45d0 0x7f842c0ae8d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f841800c450 tx=0x7f841800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:40.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.757+0000 7f8429600640 1 -- 172.21.15.112:0/2558960608 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8418016020 con 0x7f842c0b45d0 2024-09-12T02:45:40.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.757+0000 7f8429600640 1 -- 172.21.15.112:0/2558960608 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8418012830 con 0x7f842c0b45d0 2024-09-12T02:45:40.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.757+0000 7f8429600640 1 -- 172.21.15.112:0/2558960608 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8418012c20 con 0x7f842c0b45d0 2024-09-12T02:45:40.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.757+0000 7f8434200640 1 -- 172.21.15.112:0/2558960608 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f842c0af520 con 0x7f842c0b45d0 2024-09-12T02:45:40.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.757+0000 7f8434200640 1 -- 172.21.15.112:0/2558960608 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f842c0afae0 con 0x7f842c0b45d0 2024-09-12T02:45:40.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.758+0000 7f8434200640 1 -- 172.21.15.112:0/2558960608 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f842c06dbc0 con 0x7f842c0b45d0 2024-09-12T02:45:40.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.759+0000 7f8429600640 1 -- 172.21.15.112:0/2558960608 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8418019020 con 0x7f842c0b45d0 2024-09-12T02:45:40.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.760+0000 7f8429600640 1 --2- 172.21.15.112:0/2558960608 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f840c06be30 0x7f840c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:40.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.760+0000 7f8429600640 1 -- 172.21.15.112:0/2558960608 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5709+0+0 (secure 0 0 0) 0x7f841808ab80 con 0x7f842c0b45d0 2024-09-12T02:45:40.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.760+0000 7f8431800640 1 --2- 172.21.15.112:0/2558960608 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f840c06be30 0x7f840c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:40.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.761+0000 7f8431800640 1 --2- 172.21.15.112:0/2558960608 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f840c06be30 0x7f840c06e2f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8420034000 tx=0x7f842002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:40.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.764+0000 7f8429600640 1 -- 172.21.15.112:0/2558960608 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8418058ed0 con 0x7f842c0b45d0 2024-09-12T02:45:40.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.936+0000 7f8434200640 1 -- 172.21.15.112:0/2558960608 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f842c06e7f0 con 0x7f840c06be30 2024-09-12T02:45:40.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.943+0000 7f8429600640 1 -- 172.21.15.112:0/2558960608 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247546 (secure 0 0 0) 0x7f842c06e7f0 con 0x7f840c06be30 2024-09-12T02:45:40.948 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:45:40.951 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:45:40.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.946+0000 7f8434200640 1 -- 172.21.15.112:0/2558960608 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f840c06be30 msgr2=0x7f840c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:40.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.946+0000 7f8434200640 1 --2- 172.21.15.112:0/2558960608 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f840c06be30 0x7f840c06e2f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8420034000 tx=0x7f842002e000 comp rx=0 tx=0).stop 2024-09-12T02:45:40.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.946+0000 7f8434200640 1 -- 172.21.15.112:0/2558960608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f842c0b45d0 msgr2=0x7f842c0ae8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:40.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.946+0000 7f8434200640 1 --2- 172.21.15.112:0/2558960608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f842c0b45d0 0x7f842c0ae8d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f841800c450 tx=0x7f841800c910 comp rx=0 tx=0).stop 2024-09-12T02:45:40.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.946+0000 7f8434200640 1 -- 172.21.15.112:0/2558960608 shutdown_connections 2024-09-12T02:45:40.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.946+0000 7f8434200640 1 --2- 172.21.15.112:0/2558960608 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f840c06be30 0x7f840c06e2f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.946+0000 7f8434200640 1 --2- 172.21.15.112:0/2558960608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f842c15b9d0 0x7f842c1513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.946+0000 7f8434200640 1 --2- 172.21.15.112:0/2558960608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f842c0b45d0 0x7f842c0ae8d0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.946+0000 7f8434200640 1 --2- 172.21.15.112:0/2558960608 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f842c06f600 0x7f842c0ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.946+0000 7f8434200640 1 -- 172.21.15.112:0/2558960608 >> 172.21.15.112:0/2558960608 conn(0x7f842c06bbd0 msgr2=0x7f842c071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:40.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.947+0000 7f8434200640 1 -- 172.21.15.112:0/2558960608 shutdown_connections 2024-09-12T02:45:40.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:40.947+0000 7f8434200640 1 -- 172.21.15.112:0/2558960608 wait complete. 2024-09-12T02:45:40.964 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2024-09-12T02:45:39.008742+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":103,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4358,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558141,"statfs":{"total":1600000000,"available":1595537260,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.232904"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.812002+0000","last_change":"2024-09-12T02:45:36.811318+0000","last_active":"2024-09-12T02:45:36.812002+0000","last_peered":"2024-09-12T02:45:36.812002+0000","last_clean":"2024-09-12T02:45:36.812002+0000","last_became_active":"2024-09-12T02:45:36.809713+0000","last_became_peered":"2024-09-12T02:45:36.809713+0000","last_unstale":"2024-09-12T02:45:36.812002+0000","last_undegraded":"2024-09-12T02:45:36.812002+0000","last_fullsized":"2024-09-12T02:45:36.812002+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:03.648643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.789914+0000","last_change":"2024-09-12T02:45:36.794302+0000","last_active":"2024-09-12T02:45:37.789914+0000","last_peered":"2024-09-12T02:45:37.789914+0000","last_clean":"2024-09-12T02:45:37.789914+0000","last_became_active":"2024-09-12T02:45:36.793855+0000","last_became_peered":"2024-09-12T02:45:36.793855+0000","last_unstale":"2024-09-12T02:45:37.789914+0000","last_undegraded":"2024-09-12T02:45:37.789914+0000","last_fullsized":"2024-09-12T02:45:37.789914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:44.765054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.789881+0000","last_change":"2024-09-12T02:45:36.793712+0000","last_active":"2024-09-12T02:45:37.789881+0000","last_peered":"2024-09-12T02:45:37.789881+0000","last_clean":"2024-09-12T02:45:37.789881+0000","last_became_active":"2024-09-12T02:45:36.792956+0000","last_became_peered":"2024-09-12T02:45:36.792956+0000","last_unstale":"2024-09-12T02:45:37.789881+0000","last_undegraded":"2024-09-12T02:45:37.789881+0000","last_fullsized":"2024-09-12T02:45:37.789881+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:46.475950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.799470+0000","last_change":"2024-09-12T02:45:36.799057+0000","last_active":"2024-09-12T02:45:36.799470+0000","last_peered":"2024-09-12T02:45:36.799470+0000","last_clean":"2024-09-12T02:45:36.799470+0000","last_became_active":"2024-09-12T02:45:36.797436+0000","last_became_peered":"2024-09-12T02:45:36.797436+0000","last_unstale":"2024-09-12T02:45:36.799470+0000","last_undegraded":"2024-09-12T02:45:36.799470+0000","last_fullsized":"2024-09-12T02:45:36.799470+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:07.148244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.806758+0000","last_change":"2024-09-12T02:45:36.805645+0000","last_active":"2024-09-12T02:45:36.806758+0000","last_peered":"2024-09-12T02:45:36.806758+0000","last_clean":"2024-09-12T02:45:36.806758+0000","last_became_active":"2024-09-12T02:45:36.805212+0000","last_became_peered":"2024-09-12T02:45:36.805212+0000","last_unstale":"2024-09-12T02:45:36.806758+0000","last_undegraded":"2024-09-12T02:45:36.806758+0000","last_fullsized":"2024-09-12T02:45:36.806758+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:40.575138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790257+0000","last_change":"2024-09-12T02:45:36.799087+0000","last_active":"2024-09-12T02:45:37.790257+0000","last_peered":"2024-09-12T02:45:37.790257+0000","last_clean":"2024-09-12T02:45:37.790257+0000","last_became_active":"2024-09-12T02:45:36.798703+0000","last_became_peered":"2024-09-12T02:45:36.798703+0000","last_unstale":"2024-09-12T02:45:37.790257+0000","last_undegraded":"2024-09-12T02:45:37.790257+0000","last_fullsized":"2024-09-12T02:45:37.790257+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:29.850324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.798475+0000","last_change":"2024-09-12T02:45:36.797544+0000","last_active":"2024-09-12T02:45:36.798475+0000","last_peered":"2024-09-12T02:45:36.798475+0000","last_clean":"2024-09-12T02:45:36.798475+0000","last_became_active":"2024-09-12T02:45:36.797311+0000","last_became_peered":"2024-09-12T02:45:36.797311+0000","last_unstale":"2024-09-12T02:45:36.798475+0000","last_undegraded":"2024-09-12T02:45:36.798475+0000","last_fullsized":"2024-09-12T02:45:36.798475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:40.229301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.789995+0000","last_change":"2024-09-12T02:45:36.795872+0000","last_active":"2024-09-12T02:45:37.789995+0000","last_peered":"2024-09-12T02:45:37.789995+0000","last_clean":"2024-09-12T02:45:37.789995+0000","last_became_active":"2024-09-12T02:45:36.795503+0000","last_became_peered":"2024-09-12T02:45:36.795503+0000","last_unstale":"2024-09-12T02:45:37.789995+0000","last_undegraded":"2024-09-12T02:45:37.789995+0000","last_fullsized":"2024-09-12T02:45:37.789995+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:31.887965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.808650+0000","last_change":"2024-09-12T02:45:36.807566+0000","last_active":"2024-09-12T02:45:36.808650+0000","last_peered":"2024-09-12T02:45:36.808650+0000","last_clean":"2024-09-12T02:45:36.808650+0000","last_became_active":"2024-09-12T02:45:36.807034+0000","last_became_peered":"2024-09-12T02:45:36.807034+0000","last_unstale":"2024-09-12T02:45:36.808650+0000","last_undegraded":"2024-09-12T02:45:36.808650+0000","last_fullsized":"2024-09-12T02:45:36.808650+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:09.690925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.787647+0000","last_change":"2024-09-12T02:45:36.806464+0000","last_active":"2024-09-12T02:45:37.787647+0000","last_peered":"2024-09-12T02:45:37.787647+0000","last_clean":"2024-09-12T02:45:37.787647+0000","last_became_active":"2024-09-12T02:45:36.806230+0000","last_became_peered":"2024-09-12T02:45:36.806230+0000","last_unstale":"2024-09-12T02:45:37.787647+0000","last_undegraded":"2024-09-12T02:45:37.787647+0000","last_fullsized":"2024-09-12T02:45:37.787647+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:13.728501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.801804+0000","last_change":"2024-09-12T02:45:36.801467+0000","last_active":"2024-09-12T02:45:36.801804+0000","last_peered":"2024-09-12T02:45:36.801804+0000","last_clean":"2024-09-12T02:45:36.801804+0000","last_became_active":"2024-09-12T02:45:36.801217+0000","last_became_peered":"2024-09-12T02:45:36.801217+0000","last_unstale":"2024-09-12T02:45:36.801804+0000","last_undegraded":"2024-09-12T02:45:36.801804+0000","last_fullsized":"2024-09-12T02:45:36.801804+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:21.285612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.810488+0000","last_change":"2024-09-12T02:45:36.810217+0000","last_active":"2024-09-12T02:45:36.810488+0000","last_peered":"2024-09-12T02:45:36.810488+0000","last_clean":"2024-09-12T02:45:36.810488+0000","last_became_active":"2024-09-12T02:45:36.809636+0000","last_became_peered":"2024-09-12T02:45:36.809636+0000","last_unstale":"2024-09-12T02:45:36.810488+0000","last_undegraded":"2024-09-12T02:45:36.810488+0000","last_fullsized":"2024-09-12T02:45:36.810488+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:16.040688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.802400+0000","last_change":"2024-09-12T02:45:36.802228+0000","last_active":"2024-09-12T02:45:36.802400+0000","last_peered":"2024-09-12T02:45:36.802400+0000","last_clean":"2024-09-12T02:45:36.802400+0000","last_became_active":"2024-09-12T02:45:36.800908+0000","last_became_peered":"2024-09-12T02:45:36.800908+0000","last_unstale":"2024-09-12T02:45:36.802400+0000","last_undegraded":"2024-09-12T02:45:36.802400+0000","last_fullsized":"2024-09-12T02:45:36.802400+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:17.520432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.808629+0000","last_change":"2024-09-12T02:45:36.807283+0000","last_active":"2024-09-12T02:45:36.808629+0000","last_peered":"2024-09-12T02:45:36.808629+0000","last_clean":"2024-09-12T02:45:36.808629+0000","last_became_active":"2024-09-12T02:45:36.806735+0000","last_became_peered":"2024-09-12T02:45:36.806735+0000","last_unstale":"2024-09-12T02:45:36.808629+0000","last_undegraded":"2024-09-12T02:45:36.808629+0000","last_fullsized":"2024-09-12T02:45:36.808629+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:37.430188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.807154+0000","last_change":"2024-09-12T02:45:36.807012+0000","last_active":"2024-09-12T02:45:36.807154+0000","last_peered":"2024-09-12T02:45:36.807154+0000","last_clean":"2024-09-12T02:45:36.807154+0000","last_became_active":"2024-09-12T02:45:36.806797+0000","last_became_peered":"2024-09-12T02:45:36.806797+0000","last_unstale":"2024-09-12T02:45:36.807154+0000","last_undegraded":"2024-09-12T02:45:36.807154+0000","last_fullsized":"2024-09-12T02:45:36.807154+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:47.711648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.787881+0000","last_change":"2024-09-12T02:45:36.798162+0000","last_active":"2024-09-12T02:45:37.787881+0000","last_peered":"2024-09-12T02:45:37.787881+0000","last_clean":"2024-09-12T02:45:37.787881+0000","last_became_active":"2024-09-12T02:45:36.797878+0000","last_became_peered":"2024-09-12T02:45:36.797878+0000","last_unstale":"2024-09-12T02:45:37.787881+0000","last_undegraded":"2024-09-12T02:45:37.787881+0000","last_fullsized":"2024-09-12T02:45:37.787881+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:23.648364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.809693+0000","last_change":"2024-09-12T02:45:36.808982+0000","last_active":"2024-09-12T02:45:36.809693+0000","last_peered":"2024-09-12T02:45:36.809693+0000","last_clean":"2024-09-12T02:45:36.809693+0000","last_became_active":"2024-09-12T02:45:36.805095+0000","last_became_peered":"2024-09-12T02:45:36.805095+0000","last_unstale":"2024-09-12T02:45:36.809693+0000","last_undegraded":"2024-09-12T02:45:36.809693+0000","last_fullsized":"2024-09-12T02:45:36.809693+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:53.865444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.798468+0000","last_change":"2024-09-12T02:45:36.797703+0000","last_active":"2024-09-12T02:45:36.798468+0000","last_peered":"2024-09-12T02:45:36.798468+0000","last_clean":"2024-09-12T02:45:36.798468+0000","last_became_active":"2024-09-12T02:45:36.797358+0000","last_became_peered":"2024-09-12T02:45:36.797358+0000","last_unstale":"2024-09-12T02:45:36.798468+0000","last_undegraded":"2024-09-12T02:45:36.798468+0000","last_fullsized":"2024-09-12T02:45:36.798468+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:42.160699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790053+0000","last_change":"2024-09-12T02:45:36.796188+0000","last_active":"2024-09-12T02:45:37.790053+0000","last_peered":"2024-09-12T02:45:37.790053+0000","last_clean":"2024-09-12T02:45:37.790053+0000","last_became_active":"2024-09-12T02:45:36.795801+0000","last_became_peered":"2024-09-12T02:45:36.795801+0000","last_unstale":"2024-09-12T02:45:37.790053+0000","last_undegraded":"2024-09-12T02:45:37.790053+0000","last_fullsized":"2024-09-12T02:45:37.790053+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:05.209397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.800628+0000","last_change":"2024-09-12T02:45:36.800225+0000","last_active":"2024-09-12T02:45:36.800628+0000","last_peered":"2024-09-12T02:45:36.800628+0000","last_clean":"2024-09-12T02:45:36.800628+0000","last_became_active":"2024-09-12T02:45:36.799980+0000","last_became_peered":"2024-09-12T02:45:36.799980+0000","last_unstale":"2024-09-12T02:45:36.800628+0000","last_undegraded":"2024-09-12T02:45:36.800628+0000","last_fullsized":"2024-09-12T02:45:36.800628+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:13.459308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.787611+0000","last_change":"2024-09-12T02:45:36.796436+0000","last_active":"2024-09-12T02:45:37.787611+0000","last_peered":"2024-09-12T02:45:37.787611+0000","last_clean":"2024-09-12T02:45:37.787611+0000","last_became_active":"2024-09-12T02:45:36.792214+0000","last_became_peered":"2024-09-12T02:45:36.792214+0000","last_unstale":"2024-09-12T02:45:37.787611+0000","last_undegraded":"2024-09-12T02:45:37.787611+0000","last_fullsized":"2024-09-12T02:45:37.787611+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:46.388828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.787476+0000","last_change":"2024-09-12T02:45:36.803773+0000","last_active":"2024-09-12T02:45:37.787476+0000","last_peered":"2024-09-12T02:45:37.787476+0000","last_clean":"2024-09-12T02:45:37.787476+0000","last_became_active":"2024-09-12T02:45:36.803510+0000","last_became_peered":"2024-09-12T02:45:36.803510+0000","last_unstale":"2024-09-12T02:45:37.787476+0000","last_undegraded":"2024-09-12T02:45:37.787476+0000","last_fullsized":"2024-09-12T02:45:37.787476+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:49.736080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.801766+0000","last_change":"2024-09-12T02:45:36.799762+0000","last_active":"2024-09-12T02:45:36.801766+0000","last_peered":"2024-09-12T02:45:36.801766+0000","last_clean":"2024-09-12T02:45:36.801766+0000","last_became_active":"2024-09-12T02:45:36.799497+0000","last_became_peered":"2024-09-12T02:45:36.799497+0000","last_unstale":"2024-09-12T02:45:36.801766+0000","last_undegraded":"2024-09-12T02:45:36.801766+0000","last_fullsized":"2024-09-12T02:45:36.801766+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:54.601397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.810242+0000","last_change":"2024-09-12T02:45:36.809466+0000","last_active":"2024-09-12T02:45:36.810242+0000","last_peered":"2024-09-12T02:45:36.810242+0000","last_clean":"2024-09-12T02:45:36.810242+0000","last_became_active":"2024-09-12T02:45:36.806706+0000","last_became_peered":"2024-09-12T02:45:36.806706+0000","last_unstale":"2024-09-12T02:45:36.810242+0000","last_undegraded":"2024-09-12T02:45:36.810242+0000","last_fullsized":"2024-09-12T02:45:36.810242+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:35.791927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.787742+0000","last_change":"2024-09-12T02:45:36.802573+0000","last_active":"2024-09-12T02:45:37.787742+0000","last_peered":"2024-09-12T02:45:37.787742+0000","last_clean":"2024-09-12T02:45:37.787742+0000","last_became_active":"2024-09-12T02:45:36.798202+0000","last_became_peered":"2024-09-12T02:45:36.798202+0000","last_unstale":"2024-09-12T02:45:37.787742+0000","last_undegraded":"2024-09-12T02:45:37.787742+0000","last_fullsized":"2024-09-12T02:45:37.787742+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:58.814724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.804920+0000","last_change":"2024-09-12T02:45:36.802400+0000","last_active":"2024-09-12T02:45:36.804920+0000","last_peered":"2024-09-12T02:45:36.804920+0000","last_clean":"2024-09-12T02:45:36.804920+0000","last_became_active":"2024-09-12T02:45:36.802152+0000","last_became_peered":"2024-09-12T02:45:36.802152+0000","last_unstale":"2024-09-12T02:45:36.804920+0000","last_undegraded":"2024-09-12T02:45:36.804920+0000","last_fullsized":"2024-09-12T02:45:36.804920+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:43.625342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790127+0000","last_change":"2024-09-12T02:45:36.798671+0000","last_active":"2024-09-12T02:45:37.790127+0000","last_peered":"2024-09-12T02:45:37.790127+0000","last_clean":"2024-09-12T02:45:37.790127+0000","last_became_active":"2024-09-12T02:45:36.798215+0000","last_became_peered":"2024-09-12T02:45:36.798215+0000","last_unstale":"2024-09-12T02:45:37.790127+0000","last_undegraded":"2024-09-12T02:45:37.790127+0000","last_fullsized":"2024-09-12T02:45:37.790127+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:38.169716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.787316+0000","last_change":"2024-09-12T02:45:36.801763+0000","last_active":"2024-09-12T02:45:37.787316+0000","last_peered":"2024-09-12T02:45:37.787316+0000","last_clean":"2024-09-12T02:45:37.787316+0000","last_became_active":"2024-09-12T02:45:36.801536+0000","last_became_peered":"2024-09-12T02:45:36.801536+0000","last_unstale":"2024-09-12T02:45:37.787316+0000","last_undegraded":"2024-09-12T02:45:37.787316+0000","last_fullsized":"2024-09-12T02:45:37.787316+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:53.939037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.789991+0000","last_change":"2024-09-12T02:45:36.795023+0000","last_active":"2024-09-12T02:45:37.789991+0000","last_peered":"2024-09-12T02:45:37.789991+0000","last_clean":"2024-09-12T02:45:37.789991+0000","last_became_active":"2024-09-12T02:45:36.794606+0000","last_became_peered":"2024-09-12T02:45:36.794606+0000","last_unstale":"2024-09-12T02:45:37.789991+0000","last_undegraded":"2024-09-12T02:45:37.789991+0000","last_fullsized":"2024-09-12T02:45:37.789991+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:24:58.946403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.804899+0000","last_change":"2024-09-12T02:45:36.801471+0000","last_active":"2024-09-12T02:45:36.804899+0000","last_peered":"2024-09-12T02:45:36.804899+0000","last_clean":"2024-09-12T02:45:36.804899+0000","last_became_active":"2024-09-12T02:45:36.801167+0000","last_became_peered":"2024-09-12T02:45:36.801167+0000","last_unstale":"2024-09-12T02:45:36.804899+0000","last_undegraded":"2024-09-12T02:45:36.804899+0000","last_fullsized":"2024-09-12T02:45:36.804899+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:24.312374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.809576+0000","last_change":"2024-09-12T02:45:36.808291+0000","last_active":"2024-09-12T02:45:36.809576+0000","last_peered":"2024-09-12T02:45:36.809576+0000","last_clean":"2024-09-12T02:45:36.809576+0000","last_became_active":"2024-09-12T02:45:36.807875+0000","last_became_peered":"2024-09-12T02:45:36.807875+0000","last_unstale":"2024-09-12T02:45:36.809576+0000","last_undegraded":"2024-09-12T02:45:36.809576+0000","last_fullsized":"2024-09-12T02:45:36.809576+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:13.642623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790126+0000","last_change":"2024-09-12T02:45:36.794115+0000","last_active":"2024-09-12T02:45:37.790126+0000","last_peered":"2024-09-12T02:45:37.790126+0000","last_clean":"2024-09-12T02:45:37.790126+0000","last_became_active":"2024-09-12T02:45:36.792578+0000","last_became_peered":"2024-09-12T02:45:36.792578+0000","last_unstale":"2024-09-12T02:45:37.790126+0000","last_undegraded":"2024-09-12T02:45:37.790126+0000","last_fullsized":"2024-09-12T02:45:37.790126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:22.885549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.810307+0000","last_change":"2024-09-12T02:45:36.809681+0000","last_active":"2024-09-12T02:45:36.810307+0000","last_peered":"2024-09-12T02:45:36.810307+0000","last_clean":"2024-09-12T02:45:36.810307+0000","last_became_active":"2024-09-12T02:45:36.807049+0000","last_became_peered":"2024-09-12T02:45:36.807049+0000","last_unstale":"2024-09-12T02:45:36.810307+0000","last_undegraded":"2024-09-12T02:45:36.810307+0000","last_fullsized":"2024-09-12T02:45:36.810307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:50.409672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"78'4","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.811361+0000","last_change":"2024-09-12T02:45:35.798725+0000","last_active":"2024-09-12T02:45:36.811361+0000","last_peered":"2024-09-12T02:45:36.811361+0000","last_clean":"2024-09-12T02:45:36.811361+0000","last_became_active":"2024-09-12T02:45:35.798491+0000","last_became_peered":"2024-09-12T02:45:35.798491+0000","last_unstale":"2024-09-12T02:45:36.811361+0000","last_undegraded":"2024-09-12T02:45:36.811361+0000","last_fullsized":"2024-09-12T02:45:36.811361+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:36.408422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.804717+0000","last_change":"2024-09-12T02:45:36.800286+0000","last_active":"2024-09-12T02:45:36.804717+0000","last_peered":"2024-09-12T02:45:36.804717+0000","last_clean":"2024-09-12T02:45:36.804717+0000","last_became_active":"2024-09-12T02:45:36.799997+0000","last_became_peered":"2024-09-12T02:45:36.799997+0000","last_unstale":"2024-09-12T02:45:36.804717+0000","last_undegraded":"2024-09-12T02:45:36.804717+0000","last_fullsized":"2024-09-12T02:45:36.804717+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:19.732183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"78'1","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.807311+0000","last_change":"2024-09-12T02:45:35.794720+0000","last_active":"2024-09-12T02:45:36.807311+0000","last_peered":"2024-09-12T02:45:36.807311+0000","last_clean":"2024-09-12T02:45:36.807311+0000","last_became_active":"2024-09-12T02:45:35.794468+0000","last_became_peered":"2024-09-12T02:45:35.794468+0000","last_unstale":"2024-09-12T02:45:36.807311+0000","last_undegraded":"2024-09-12T02:45:36.807311+0000","last_fullsized":"2024-09-12T02:45:36.807311+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:39.462555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790440+0000","last_change":"2024-09-12T02:45:36.801369+0000","last_active":"2024-09-12T02:45:37.790440+0000","last_peered":"2024-09-12T02:45:37.790440+0000","last_clean":"2024-09-12T02:45:37.790440+0000","last_became_active":"2024-09-12T02:45:36.800630+0000","last_became_peered":"2024-09-12T02:45:36.800630+0000","last_unstale":"2024-09-12T02:45:37.790440+0000","last_undegraded":"2024-09-12T02:45:37.790440+0000","last_fullsized":"2024-09-12T02:45:37.790440+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:45.213602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"78'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.787880+0000","last_change":"2024-09-12T02:45:35.800284+0000","last_active":"2024-09-12T02:45:37.787880+0000","last_peered":"2024-09-12T02:45:37.787880+0000","last_clean":"2024-09-12T02:45:37.787880+0000","last_became_active":"2024-09-12T02:45:35.799990+0000","last_became_peered":"2024-09-12T02:45:35.799990+0000","last_unstale":"2024-09-12T02:45:37.787880+0000","last_undegraded":"2024-09-12T02:45:37.787880+0000","last_fullsized":"2024-09-12T02:45:37.787880+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:42.128027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.801788+0000","last_change":"2024-09-12T02:45:36.800951+0000","last_active":"2024-09-12T02:45:36.801788+0000","last_peered":"2024-09-12T02:45:36.801788+0000","last_clean":"2024-09-12T02:45:36.801788+0000","last_became_active":"2024-09-12T02:45:36.800705+0000","last_became_peered":"2024-09-12T02:45:36.800705+0000","last_unstale":"2024-09-12T02:45:36.801788+0000","last_undegraded":"2024-09-12T02:45:36.801788+0000","last_fullsized":"2024-09-12T02:45:36.801788+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:47.442908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"78'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790689+0000","last_change":"2024-09-12T02:45:35.797170+0000","last_active":"2024-09-12T02:45:37.790689+0000","last_peered":"2024-09-12T02:45:37.790689+0000","last_clean":"2024-09-12T02:45:37.790689+0000","last_became_active":"2024-09-12T02:45:35.796252+0000","last_became_peered":"2024-09-12T02:45:35.796252+0000","last_unstale":"2024-09-12T02:45:37.790689+0000","last_undegraded":"2024-09-12T02:45:37.790689+0000","last_fullsized":"2024-09-12T02:45:37.790689+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:45.368969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.798496+0000","last_change":"2024-09-12T02:45:36.798270+0000","last_active":"2024-09-12T02:45:36.798496+0000","last_peered":"2024-09-12T02:45:36.798496+0000","last_clean":"2024-09-12T02:45:36.798496+0000","last_became_active":"2024-09-12T02:45:36.798034+0000","last_became_peered":"2024-09-12T02:45:36.798034+0000","last_unstale":"2024-09-12T02:45:36.798496+0000","last_undegraded":"2024-09-12T02:45:36.798496+0000","last_fullsized":"2024-09-12T02:45:36.798496+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:11.913020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"78'1","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790293+0000","last_change":"2024-09-12T02:45:35.797531+0000","last_active":"2024-09-12T02:45:37.790293+0000","last_peered":"2024-09-12T02:45:37.790293+0000","last_clean":"2024-09-12T02:45:37.790293+0000","last_became_active":"2024-09-12T02:45:35.797312+0000","last_became_peered":"2024-09-12T02:45:35.797312+0000","last_unstale":"2024-09-12T02:45:37.790293+0000","last_undegraded":"2024-09-12T02:45:37.790293+0000","last_fullsized":"2024-09-12T02:45:37.790293+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:05.634405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.787599+0000","last_change":"2024-09-12T02:45:36.797894+0000","last_active":"2024-09-12T02:45:37.787599+0000","last_peered":"2024-09-12T02:45:37.787599+0000","last_clean":"2024-09-12T02:45:37.787599+0000","last_became_active":"2024-09-12T02:45:36.797527+0000","last_became_peered":"2024-09-12T02:45:36.797527+0000","last_unstale":"2024-09-12T02:45:37.787599+0000","last_undegraded":"2024-09-12T02:45:37.787599+0000","last_fullsized":"2024-09-12T02:45:37.787599+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:11.817654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"78'1","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790308+0000","last_change":"2024-09-12T02:45:35.795500+0000","last_active":"2024-09-12T02:45:37.790308+0000","last_peered":"2024-09-12T02:45:37.790308+0000","last_clean":"2024-09-12T02:45:37.790308+0000","last_became_active":"2024-09-12T02:45:35.792644+0000","last_became_peered":"2024-09-12T02:45:35.792644+0000","last_unstale":"2024-09-12T02:45:37.790308+0000","last_undegraded":"2024-09-12T02:45:37.790308+0000","last_fullsized":"2024-09-12T02:45:37.790308+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:40.359239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.807113+0000","last_change":"2024-09-12T02:45:36.806204+0000","last_active":"2024-09-12T02:45:36.807113+0000","last_peered":"2024-09-12T02:45:36.807113+0000","last_clean":"2024-09-12T02:45:36.807113+0000","last_became_active":"2024-09-12T02:45:36.805930+0000","last_became_peered":"2024-09-12T02:45:36.805930+0000","last_unstale":"2024-09-12T02:45:36.807113+0000","last_undegraded":"2024-09-12T02:45:36.807113+0000","last_fullsized":"2024-09-12T02:45:36.807113+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:56.047333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.792475+0000","last_change":"2024-09-12T02:45:35.797211+0000","last_active":"2024-09-12T02:45:36.792475+0000","last_peered":"2024-09-12T02:45:36.792475+0000","last_clean":"2024-09-12T02:45:36.792475+0000","last_became_active":"2024-09-12T02:45:35.796954+0000","last_became_peered":"2024-09-12T02:45:35.796954+0000","last_unstale":"2024-09-12T02:45:36.792475+0000","last_undegraded":"2024-09-12T02:45:36.792475+0000","last_fullsized":"2024-09-12T02:45:36.792475+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:16.863257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.800609+0000","last_change":"2024-09-12T02:45:36.800191+0000","last_active":"2024-09-12T02:45:36.800609+0000","last_peered":"2024-09-12T02:45:36.800609+0000","last_clean":"2024-09-12T02:45:36.800609+0000","last_became_active":"2024-09-12T02:45:36.799948+0000","last_became_peered":"2024-09-12T02:45:36.799948+0000","last_unstale":"2024-09-12T02:45:36.800609+0000","last_undegraded":"2024-09-12T02:45:36.800609+0000","last_fullsized":"2024-09-12T02:45:36.800609+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:48.308577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.799681+0000","last_change":"2024-09-12T02:45:35.795614+0000","last_active":"2024-09-12T02:45:36.799681+0000","last_peered":"2024-09-12T02:45:36.799681+0000","last_clean":"2024-09-12T02:45:36.799681+0000","last_became_active":"2024-09-12T02:45:35.794794+0000","last_became_peered":"2024-09-12T02:45:35.794794+0000","last_unstale":"2024-09-12T02:45:36.799681+0000","last_undegraded":"2024-09-12T02:45:36.799681+0000","last_fullsized":"2024-09-12T02:45:36.799681+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:06.049136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.805275+0000","last_change":"2024-09-12T02:45:36.804674+0000","last_active":"2024-09-12T02:45:36.805275+0000","last_peered":"2024-09-12T02:45:36.805275+0000","last_clean":"2024-09-12T02:45:36.805275+0000","last_became_active":"2024-09-12T02:45:36.803696+0000","last_became_peered":"2024-09-12T02:45:36.803696+0000","last_unstale":"2024-09-12T02:45:36.805275+0000","last_undegraded":"2024-09-12T02:45:36.805275+0000","last_fullsized":"2024-09-12T02:45:36.805275+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:51.669969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.787720+0000","last_change":"2024-09-12T02:45:35.796881+0000","last_active":"2024-09-12T02:45:37.787720+0000","last_peered":"2024-09-12T02:45:37.787720+0000","last_clean":"2024-09-12T02:45:37.787720+0000","last_became_active":"2024-09-12T02:45:35.796391+0000","last_became_peered":"2024-09-12T02:45:35.796391+0000","last_unstale":"2024-09-12T02:45:37.787720+0000","last_undegraded":"2024-09-12T02:45:37.787720+0000","last_fullsized":"2024-09-12T02:45:37.787720+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:12:17.576072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.806676+0000","last_change":"2024-09-12T02:45:36.803874+0000","last_active":"2024-09-12T02:45:36.806676+0000","last_peered":"2024-09-12T02:45:36.806676+0000","last_clean":"2024-09-12T02:45:36.806676+0000","last_became_active":"2024-09-12T02:45:36.803552+0000","last_became_peered":"2024-09-12T02:45:36.803552+0000","last_unstale":"2024-09-12T02:45:36.806676+0000","last_undegraded":"2024-09-12T02:45:36.806676+0000","last_fullsized":"2024-09-12T02:45:36.806676+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:08.005159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790237+0000","last_change":"2024-09-12T02:45:35.793958+0000","last_active":"2024-09-12T02:45:37.790237+0000","last_peered":"2024-09-12T02:45:37.790237+0000","last_clean":"2024-09-12T02:45:37.790237+0000","last_became_active":"2024-09-12T02:45:35.791051+0000","last_became_peered":"2024-09-12T02:45:35.791051+0000","last_unstale":"2024-09-12T02:45:37.790237+0000","last_undegraded":"2024-09-12T02:45:37.790237+0000","last_fullsized":"2024-09-12T02:45:37.790237+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:09.771681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790230+0000","last_change":"2024-09-12T02:45:36.793006+0000","last_active":"2024-09-12T02:45:37.790230+0000","last_peered":"2024-09-12T02:45:37.790230+0000","last_clean":"2024-09-12T02:45:37.790230+0000","last_became_active":"2024-09-12T02:45:36.792683+0000","last_became_peered":"2024-09-12T02:45:36.792683+0000","last_unstale":"2024-09-12T02:45:37.790230+0000","last_undegraded":"2024-09-12T02:45:37.790230+0000","last_fullsized":"2024-09-12T02:45:37.790230+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:26.431236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"78'3","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790018+0000","last_change":"2024-09-12T02:45:35.789058+0000","last_active":"2024-09-12T02:45:37.790018+0000","last_peered":"2024-09-12T02:45:37.790018+0000","last_clean":"2024-09-12T02:45:37.790018+0000","last_became_active":"2024-09-12T02:45:35.787998+0000","last_became_peered":"2024-09-12T02:45:35.787998+0000","last_unstale":"2024-09-12T02:45:37.790018+0000","last_undegraded":"2024-09-12T02:45:37.790018+0000","last_fullsized":"2024-09-12T02:45:37.790018+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:13.943517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.804748+0000","last_change":"2024-09-12T02:45:36.802211+0000","last_active":"2024-09-12T02:45:36.804748+0000","last_peered":"2024-09-12T02:45:36.804748+0000","last_clean":"2024-09-12T02:45:36.804748+0000","last_became_active":"2024-09-12T02:45:36.801262+0000","last_became_peered":"2024-09-12T02:45:36.801262+0000","last_unstale":"2024-09-12T02:45:36.804748+0000","last_undegraded":"2024-09-12T02:45:36.804748+0000","last_fullsized":"2024-09-12T02:45:36.804748+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:57.529792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"78'6","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.811953+0000","last_change":"2024-09-12T02:45:35.790984+0000","last_active":"2024-09-12T02:45:36.811953+0000","last_peered":"2024-09-12T02:45:36.811953+0000","last_clean":"2024-09-12T02:45:36.811953+0000","last_became_active":"2024-09-12T02:45:35.790709+0000","last_became_peered":"2024-09-12T02:45:35.790709+0000","last_unstale":"2024-09-12T02:45:36.811953+0000","last_undegraded":"2024-09-12T02:45:36.811953+0000","last_fullsized":"2024-09-12T02:45:36.811953+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:58.662017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.812023+0000","last_change":"2024-09-12T02:45:36.811561+0000","last_active":"2024-09-12T02:45:36.812023+0000","last_peered":"2024-09-12T02:45:36.812023+0000","last_clean":"2024-09-12T02:45:36.812023+0000","last_became_active":"2024-09-12T02:45:36.811073+0000","last_became_peered":"2024-09-12T02:45:36.811073+0000","last_unstale":"2024-09-12T02:45:36.812023+0000","last_undegraded":"2024-09-12T02:45:36.812023+0000","last_fullsized":"2024-09-12T02:45:36.812023+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:40.624371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"78'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.809026+0000","last_change":"2024-09-12T02:45:35.797428+0000","last_active":"2024-09-12T02:45:36.809026+0000","last_peered":"2024-09-12T02:45:36.809026+0000","last_clean":"2024-09-12T02:45:36.809026+0000","last_became_active":"2024-09-12T02:45:35.797200+0000","last_became_peered":"2024-09-12T02:45:35.797200+0000","last_unstale":"2024-09-12T02:45:36.809026+0000","last_undegraded":"2024-09-12T02:45:36.809026+0000","last_fullsized":"2024-09-12T02:45:36.809026+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:39.636365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.800238+0000","last_change":"2024-09-12T02:45:36.799376+0000","last_active":"2024-09-12T02:45:36.800238+0000","last_peered":"2024-09-12T02:45:36.800238+0000","last_clean":"2024-09-12T02:45:36.800238+0000","last_became_active":"2024-09-12T02:45:36.799108+0000","last_became_peered":"2024-09-12T02:45:36.799108+0000","last_unstale":"2024-09-12T02:45:36.800238+0000","last_undegraded":"2024-09-12T02:45:36.800238+0000","last_fullsized":"2024-09-12T02:45:36.800238+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:36.993943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790777+0000","last_change":"2024-09-12T02:45:35.797399+0000","last_active":"2024-09-12T02:45:37.790777+0000","last_peered":"2024-09-12T02:45:37.790777+0000","last_clean":"2024-09-12T02:45:37.790777+0000","last_became_active":"2024-09-12T02:45:35.796700+0000","last_became_peered":"2024-09-12T02:45:35.796700+0000","last_unstale":"2024-09-12T02:45:37.790777+0000","last_undegraded":"2024-09-12T02:45:37.790777+0000","last_fullsized":"2024-09-12T02:45:37.790777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:30.494933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.802382+0000","last_change":"2024-09-12T02:45:36.801925+0000","last_active":"2024-09-12T02:45:36.802382+0000","last_peered":"2024-09-12T02:45:36.802382+0000","last_clean":"2024-09-12T02:45:36.802382+0000","last_became_active":"2024-09-12T02:45:36.799808+0000","last_became_peered":"2024-09-12T02:45:36.799808+0000","last_unstale":"2024-09-12T02:45:36.802382+0000","last_undegraded":"2024-09-12T02:45:36.802382+0000","last_fullsized":"2024-09-12T02:45:36.802382+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:11.846309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.794151+0000","last_change":"2024-09-12T02:45:35.791738+0000","last_active":"2024-09-12T02:45:36.794151+0000","last_peered":"2024-09-12T02:45:36.794151+0000","last_clean":"2024-09-12T02:45:36.794151+0000","last_became_active":"2024-09-12T02:45:35.791497+0000","last_became_peered":"2024-09-12T02:45:35.791497+0000","last_unstale":"2024-09-12T02:45:36.794151+0000","last_undegraded":"2024-09-12T02:45:36.794151+0000","last_fullsized":"2024-09-12T02:45:36.794151+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:59.953571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.808884+0000","last_change":"2024-09-12T02:45:36.808692+0000","last_active":"2024-09-12T02:45:36.808884+0000","last_peered":"2024-09-12T02:45:36.808884+0000","last_clean":"2024-09-12T02:45:36.808884+0000","last_became_active":"2024-09-12T02:45:36.803869+0000","last_became_peered":"2024-09-12T02:45:36.803869+0000","last_unstale":"2024-09-12T02:45:36.808884+0000","last_undegraded":"2024-09-12T02:45:36.808884+0000","last_fullsized":"2024-09-12T02:45:36.808884+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:58.134631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"78'8","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.787441+0000","last_change":"2024-09-12T02:45:35.799288+0000","last_active":"2024-09-12T02:45:37.787441+0000","last_peered":"2024-09-12T02:45:37.787441+0000","last_clean":"2024-09-12T02:45:37.787441+0000","last_became_active":"2024-09-12T02:45:35.798825+0000","last_became_peered":"2024-09-12T02:45:35.798825+0000","last_unstale":"2024-09-12T02:45:37.787441+0000","last_undegraded":"2024-09-12T02:45:37.787441+0000","last_fullsized":"2024-09-12T02:45:37.787441+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:03.188803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.787822+0000","last_change":"2024-09-12T02:45:36.799784+0000","last_active":"2024-09-12T02:45:37.787822+0000","last_peered":"2024-09-12T02:45:37.787822+0000","last_clean":"2024-09-12T02:45:37.787822+0000","last_became_active":"2024-09-12T02:45:36.797141+0000","last_became_peered":"2024-09-12T02:45:36.797141+0000","last_unstale":"2024-09-12T02:45:37.787822+0000","last_undegraded":"2024-09-12T02:45:37.787822+0000","last_fullsized":"2024-09-12T02:45:37.787822+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:59.330265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"78'1","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790379+0000","last_change":"2024-09-12T02:45:35.787185+0000","last_active":"2024-09-12T02:45:37.790379+0000","last_peered":"2024-09-12T02:45:37.790379+0000","last_clean":"2024-09-12T02:45:37.790379+0000","last_became_active":"2024-09-12T02:45:35.786882+0000","last_became_peered":"2024-09-12T02:45:35.786882+0000","last_unstale":"2024-09-12T02:45:37.790379+0000","last_undegraded":"2024-09-12T02:45:37.790379+0000","last_fullsized":"2024-09-12T02:45:37.790379+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:43.486359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.798033+0000","last_change":"2024-09-12T02:45:36.797887+0000","last_active":"2024-09-12T02:45:36.798033+0000","last_peered":"2024-09-12T02:45:36.798033+0000","last_clean":"2024-09-12T02:45:36.798033+0000","last_became_active":"2024-09-12T02:45:36.797598+0000","last_became_peered":"2024-09-12T02:45:36.797598+0000","last_unstale":"2024-09-12T02:45:36.798033+0000","last_undegraded":"2024-09-12T02:45:36.798033+0000","last_fullsized":"2024-09-12T02:45:36.798033+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:17.939332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"78'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.787957+0000","last_change":"2024-09-12T02:45:35.798493+0000","last_active":"2024-09-12T02:45:37.787957+0000","last_peered":"2024-09-12T02:45:37.787957+0000","last_clean":"2024-09-12T02:45:37.787957+0000","last_became_active":"2024-09-12T02:45:35.797870+0000","last_became_peered":"2024-09-12T02:45:35.797870+0000","last_unstale":"2024-09-12T02:45:37.787957+0000","last_undegraded":"2024-09-12T02:45:37.787957+0000","last_fullsized":"2024-09-12T02:45:37.787957+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:54.554983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.810500+0000","last_change":"2024-09-12T02:45:36.810402+0000","last_active":"2024-09-12T02:45:36.810500+0000","last_peered":"2024-09-12T02:45:36.810500+0000","last_clean":"2024-09-12T02:45:36.810500+0000","last_became_active":"2024-09-12T02:45:36.809936+0000","last_became_peered":"2024-09-12T02:45:36.809936+0000","last_unstale":"2024-09-12T02:45:36.810500+0000","last_undegraded":"2024-09-12T02:45:36.810500+0000","last_fullsized":"2024-09-12T02:45:36.810500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:02:15.989543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"78'1","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790955+0000","last_change":"2024-09-12T02:45:35.798128+0000","last_active":"2024-09-12T02:45:37.790955+0000","last_peered":"2024-09-12T02:45:37.790955+0000","last_clean":"2024-09-12T02:45:37.790955+0000","last_became_active":"2024-09-12T02:45:35.797732+0000","last_became_peered":"2024-09-12T02:45:35.797732+0000","last_unstale":"2024-09-12T02:45:37.790955+0000","last_undegraded":"2024-09-12T02:45:37.790955+0000","last_fullsized":"2024-09-12T02:45:37.790955+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:02.351061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.807096+0000","last_change":"2024-09-12T02:45:36.806148+0000","last_active":"2024-09-12T02:45:36.807096+0000","last_peered":"2024-09-12T02:45:36.807096+0000","last_clean":"2024-09-12T02:45:36.807096+0000","last_became_active":"2024-09-12T02:45:36.805359+0000","last_became_peered":"2024-09-12T02:45:36.805359+0000","last_unstale":"2024-09-12T02:45:36.807096+0000","last_undegraded":"2024-09-12T02:45:36.807096+0000","last_fullsized":"2024-09-12T02:45:36.807096+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:12.146954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.793811+0000","last_change":"2024-09-12T02:45:35.800714+0000","last_active":"2024-09-12T02:45:36.793811+0000","last_peered":"2024-09-12T02:45:36.793811+0000","last_clean":"2024-09-12T02:45:36.793811+0000","last_became_active":"2024-09-12T02:45:35.800480+0000","last_became_peered":"2024-09-12T02:45:35.800480+0000","last_unstale":"2024-09-12T02:45:36.793811+0000","last_undegraded":"2024-09-12T02:45:36.793811+0000","last_fullsized":"2024-09-12T02:45:36.793811+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:18.387594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.789961+0000","last_change":"2024-09-12T02:45:36.794321+0000","last_active":"2024-09-12T02:45:37.789961+0000","last_peered":"2024-09-12T02:45:37.789961+0000","last_clean":"2024-09-12T02:45:37.789961+0000","last_became_active":"2024-09-12T02:45:36.794100+0000","last_became_peered":"2024-09-12T02:45:36.794100+0000","last_unstale":"2024-09-12T02:45:37.789961+0000","last_undegraded":"2024-09-12T02:45:37.789961+0000","last_fullsized":"2024-09-12T02:45:37.789961+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:11.599300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790481+0000","last_change":"2024-09-12T02:45:35.794634+0000","last_active":"2024-09-12T02:45:37.790481+0000","last_peered":"2024-09-12T02:45:37.790481+0000","last_clean":"2024-09-12T02:45:37.790481+0000","last_became_active":"2024-09-12T02:45:35.794189+0000","last_became_peered":"2024-09-12T02:45:35.794189+0000","last_unstale":"2024-09-12T02:45:37.790481+0000","last_undegraded":"2024-09-12T02:45:37.790481+0000","last_fullsized":"2024-09-12T02:45:37.790481+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:55.394061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.789955+0000","last_change":"2024-09-12T02:45:36.797679+0000","last_active":"2024-09-12T02:45:37.789955+0000","last_peered":"2024-09-12T02:45:37.789955+0000","last_clean":"2024-09-12T02:45:37.789955+0000","last_became_active":"2024-09-12T02:45:36.796569+0000","last_became_peered":"2024-09-12T02:45:36.796569+0000","last_unstale":"2024-09-12T02:45:37.789955+0000","last_undegraded":"2024-09-12T02:45:37.789955+0000","last_fullsized":"2024-09-12T02:45:37.789955+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:52.978156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.793941+0000","last_change":"2024-09-12T02:45:35.792797+0000","last_active":"2024-09-12T02:45:36.793941+0000","last_peered":"2024-09-12T02:45:36.793941+0000","last_clean":"2024-09-12T02:45:36.793941+0000","last_became_active":"2024-09-12T02:45:35.792562+0000","last_became_peered":"2024-09-12T02:45:35.792562+0000","last_unstale":"2024-09-12T02:45:36.793941+0000","last_undegraded":"2024-09-12T02:45:36.793941+0000","last_fullsized":"2024-09-12T02:45:36.793941+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:54.086461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.789881+0000","last_change":"2024-09-12T02:45:36.793915+0000","last_active":"2024-09-12T02:45:37.789881+0000","last_peered":"2024-09-12T02:45:37.789881+0000","last_clean":"2024-09-12T02:45:37.789881+0000","last_became_active":"2024-09-12T02:45:36.793691+0000","last_became_peered":"2024-09-12T02:45:36.793691+0000","last_unstale":"2024-09-12T02:45:37.789881+0000","last_undegraded":"2024-09-12T02:45:37.789881+0000","last_fullsized":"2024-09-12T02:45:37.789881+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:31.146374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.791301+0000","last_change":"2024-09-12T02:45:35.793009+0000","last_active":"2024-09-12T02:45:36.791301+0000","last_peered":"2024-09-12T02:45:36.791301+0000","last_clean":"2024-09-12T02:45:36.791301+0000","last_became_active":"2024-09-12T02:45:35.792753+0000","last_became_peered":"2024-09-12T02:45:35.792753+0000","last_unstale":"2024-09-12T02:45:36.791301+0000","last_undegraded":"2024-09-12T02:45:36.791301+0000","last_fullsized":"2024-09-12T02:45:36.791301+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:49.614182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.804162+0000","last_change":"2024-09-12T02:45:36.803809+0000","last_active":"2024-09-12T02:45:36.804162+0000","last_peered":"2024-09-12T02:45:36.804162+0000","last_clean":"2024-09-12T02:45:36.804162+0000","last_became_active":"2024-09-12T02:45:36.803588+0000","last_became_peered":"2024-09-12T02:45:36.803588+0000","last_unstale":"2024-09-12T02:45:36.804162+0000","last_undegraded":"2024-09-12T02:45:36.804162+0000","last_fullsized":"2024-09-12T02:45:36.804162+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:11.729042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"78'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790337+0000","last_change":"2024-09-12T02:45:35.794190+0000","last_active":"2024-09-12T02:45:37.790337+0000","last_peered":"2024-09-12T02:45:37.790337+0000","last_clean":"2024-09-12T02:45:37.790337+0000","last_became_active":"2024-09-12T02:45:35.792863+0000","last_became_peered":"2024-09-12T02:45:35.792863+0000","last_unstale":"2024-09-12T02:45:37.790337+0000","last_undegraded":"2024-09-12T02:45:37.790337+0000","last_fullsized":"2024-09-12T02:45:37.790337+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:09.412617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.805255+0000","last_change":"2024-09-12T02:45:36.804463+0000","last_active":"2024-09-12T02:45:36.805255+0000","last_peered":"2024-09-12T02:45:36.805255+0000","last_clean":"2024-09-12T02:45:36.805255+0000","last_became_active":"2024-09-12T02:45:36.803378+0000","last_became_peered":"2024-09-12T02:45:36.803378+0000","last_unstale":"2024-09-12T02:45:36.805255+0000","last_undegraded":"2024-09-12T02:45:36.805255+0000","last_fullsized":"2024-09-12T02:45:36.805255+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:14.645221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.792252+0000","last_change":"2024-09-12T02:45:35.793514+0000","last_active":"2024-09-12T02:45:36.792252+0000","last_peered":"2024-09-12T02:45:36.792252+0000","last_clean":"2024-09-12T02:45:36.792252+0000","last_became_active":"2024-09-12T02:45:35.792069+0000","last_became_peered":"2024-09-12T02:45:35.792069+0000","last_unstale":"2024-09-12T02:45:36.792252+0000","last_undegraded":"2024-09-12T02:45:36.792252+0000","last_fullsized":"2024-09-12T02:45:36.792252+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:11.820596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.808852+0000","last_change":"2024-09-12T02:45:36.808720+0000","last_active":"2024-09-12T02:45:36.808852+0000","last_peered":"2024-09-12T02:45:36.808852+0000","last_clean":"2024-09-12T02:45:36.808852+0000","last_became_active":"2024-09-12T02:45:36.807129+0000","last_became_peered":"2024-09-12T02:45:36.807129+0000","last_unstale":"2024-09-12T02:45:36.808852+0000","last_undegraded":"2024-09-12T02:45:36.808852+0000","last_fullsized":"2024-09-12T02:45:36.808852+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:42:11.288259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.802518+0000","last_change":"2024-09-12T02:45:35.794102+0000","last_active":"2024-09-12T02:45:36.802518+0000","last_peered":"2024-09-12T02:45:36.802518+0000","last_clean":"2024-09-12T02:45:36.802518+0000","last_became_active":"2024-09-12T02:45:35.792023+0000","last_became_peered":"2024-09-12T02:45:35.792023+0000","last_unstale":"2024-09-12T02:45:36.802518+0000","last_undegraded":"2024-09-12T02:45:36.802518+0000","last_fullsized":"2024-09-12T02:45:36.802518+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:29.389137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.810569+0000","last_change":"2024-09-12T02:45:36.810450+0000","last_active":"2024-09-12T02:45:36.810569+0000","last_peered":"2024-09-12T02:45:36.810569+0000","last_clean":"2024-09-12T02:45:36.810569+0000","last_became_active":"2024-09-12T02:45:36.809174+0000","last_became_peered":"2024-09-12T02:45:36.809174+0000","last_unstale":"2024-09-12T02:45:36.810569+0000","last_undegraded":"2024-09-12T02:45:36.810569+0000","last_fullsized":"2024-09-12T02:45:36.810569+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:45.925579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.791249+0000","last_change":"2024-09-12T02:45:35.798644+0000","last_active":"2024-09-12T02:45:36.791249+0000","last_peered":"2024-09-12T02:45:36.791249+0000","last_clean":"2024-09-12T02:45:36.791249+0000","last_became_active":"2024-09-12T02:45:35.798421+0000","last_became_peered":"2024-09-12T02:45:35.798421+0000","last_unstale":"2024-09-12T02:45:36.791249+0000","last_undegraded":"2024-09-12T02:45:36.791249+0000","last_fullsized":"2024-09-12T02:45:36.791249+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:45.814654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.807144+0000","last_change":"2024-09-12T02:45:36.806255+0000","last_active":"2024-09-12T02:45:36.807144+0000","last_peered":"2024-09-12T02:45:36.807144+0000","last_clean":"2024-09-12T02:45:36.807144+0000","last_became_active":"2024-09-12T02:45:36.803499+0000","last_became_peered":"2024-09-12T02:45:36.803499+0000","last_unstale":"2024-09-12T02:45:36.807144+0000","last_undegraded":"2024-09-12T02:45:36.807144+0000","last_fullsized":"2024-09-12T02:45:36.807144+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:12.200836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.796263+0000","last_change":"2024-09-12T02:45:35.794449+0000","last_active":"2024-09-12T02:45:36.796263+0000","last_peered":"2024-09-12T02:45:36.796263+0000","last_clean":"2024-09-12T02:45:36.796263+0000","last_became_active":"2024-09-12T02:45:35.794212+0000","last_became_peered":"2024-09-12T02:45:35.794212+0000","last_unstale":"2024-09-12T02:45:36.796263+0000","last_undegraded":"2024-09-12T02:45:36.796263+0000","last_fullsized":"2024-09-12T02:45:36.796263+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:18.750018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790590+0000","last_change":"2024-09-12T02:45:36.801579+0000","last_active":"2024-09-12T02:45:37.790590+0000","last_peered":"2024-09-12T02:45:37.790590+0000","last_clean":"2024-09-12T02:45:37.790590+0000","last_became_active":"2024-09-12T02:45:36.801035+0000","last_became_peered":"2024-09-12T02:45:36.801035+0000","last_unstale":"2024-09-12T02:45:37.790590+0000","last_undegraded":"2024-09-12T02:45:37.790590+0000","last_fullsized":"2024-09-12T02:45:37.790590+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:36:45.562084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.793466+0000","last_change":"2024-09-12T02:45:35.798628+0000","last_active":"2024-09-12T02:45:36.793466+0000","last_peered":"2024-09-12T02:45:36.793466+0000","last_clean":"2024-09-12T02:45:36.793466+0000","last_became_active":"2024-09-12T02:45:35.798378+0000","last_became_peered":"2024-09-12T02:45:35.798378+0000","last_unstale":"2024-09-12T02:45:36.793466+0000","last_undegraded":"2024-09-12T02:45:36.793466+0000","last_fullsized":"2024-09-12T02:45:36.793466+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:10.114324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.799488+0000","last_change":"2024-09-12T02:45:36.799276+0000","last_active":"2024-09-12T02:45:36.799488+0000","last_peered":"2024-09-12T02:45:36.799488+0000","last_clean":"2024-09-12T02:45:36.799488+0000","last_became_active":"2024-09-12T02:45:36.798841+0000","last_became_peered":"2024-09-12T02:45:36.798841+0000","last_unstale":"2024-09-12T02:45:36.799488+0000","last_undegraded":"2024-09-12T02:45:36.799488+0000","last_fullsized":"2024-09-12T02:45:36.799488+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:33.379839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.787563+0000","last_change":"2024-09-12T02:45:35.799098+0000","last_active":"2024-09-12T02:45:37.787563+0000","last_peered":"2024-09-12T02:45:37.787563+0000","last_clean":"2024-09-12T02:45:37.787563+0000","last_became_active":"2024-09-12T02:45:35.798431+0000","last_became_peered":"2024-09-12T02:45:35.798431+0000","last_unstale":"2024-09-12T02:45:37.787563+0000","last_undegraded":"2024-09-12T02:45:37.787563+0000","last_fullsized":"2024-09-12T02:45:37.787563+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:43.963605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790167+0000","last_change":"2024-09-12T02:45:36.791403+0000","last_active":"2024-09-12T02:45:37.790167+0000","last_peered":"2024-09-12T02:45:37.790167+0000","last_clean":"2024-09-12T02:45:37.790167+0000","last_became_active":"2024-09-12T02:45:36.791142+0000","last_became_peered":"2024-09-12T02:45:36.791142+0000","last_unstale":"2024-09-12T02:45:37.790167+0000","last_undegraded":"2024-09-12T02:45:37.790167+0000","last_fullsized":"2024-09-12T02:45:37.790167+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:58.999746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790560+0000","last_change":"2024-09-12T02:45:35.794430+0000","last_active":"2024-09-12T02:45:37.790560+0000","last_peered":"2024-09-12T02:45:37.790560+0000","last_clean":"2024-09-12T02:45:37.790560+0000","last_became_active":"2024-09-12T02:45:35.793822+0000","last_became_peered":"2024-09-12T02:45:35.793822+0000","last_unstale":"2024-09-12T02:45:37.790560+0000","last_undegraded":"2024-09-12T02:45:37.790560+0000","last_fullsized":"2024-09-12T02:45:37.790560+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:12.489976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790081+0000","last_change":"2024-09-12T02:45:36.794818+0000","last_active":"2024-09-12T02:45:37.790081+0000","last_peered":"2024-09-12T02:45:37.790081+0000","last_clean":"2024-09-12T02:45:37.790081+0000","last_became_active":"2024-09-12T02:45:36.793900+0000","last_became_peered":"2024-09-12T02:45:36.793900+0000","last_unstale":"2024-09-12T02:45:37.790081+0000","last_undegraded":"2024-09-12T02:45:37.790081+0000","last_fullsized":"2024-09-12T02:45:37.790081+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:58.539221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"78'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790490+0000","last_change":"2024-09-12T02:45:35.792877+0000","last_active":"2024-09-12T02:45:37.790490+0000","last_peered":"2024-09-12T02:45:37.790490+0000","last_clean":"2024-09-12T02:45:37.790490+0000","last_became_active":"2024-09-12T02:45:35.792212+0000","last_became_peered":"2024-09-12T02:45:35.792212+0000","last_unstale":"2024-09-12T02:45:37.790490+0000","last_undegraded":"2024-09-12T02:45:37.790490+0000","last_fullsized":"2024-09-12T02:45:37.790490+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:21.757656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":279,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.797037+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:45:36.797037+0000","last_peered":"2024-09-12T02:45:36.797037+0000","last_clean":"2024-09-12T02:45:36.797037+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:45:36.797037+0000","last_undegraded":"2024-09-12T02:45:36.797037+0000","last_fullsized":"2024-09-12T02:45:36.797037+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:55.927391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":977,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194335,"statfs":{"total":200000000,"available":198999368,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":400,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194912,"statfs":{"total":200000000,"available":199590260,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":400,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194912,"statfs":{"total":200000000,"available":199590262,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":400,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194912,"statfs":{"total":200000000,"available":199590282,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":400,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194912,"statfs":{"total":200000000,"available":199590240,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":401,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194910,"statfs":{"total":200000000,"available":199588740,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":402,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194910,"statfs":{"total":200000000,"available":199588124,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":976,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194335,"statfs":{"total":200000000,"available":198999984,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:45:40.972 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:45:41.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.156+0000 7f09fca00640 1 Processor -- start 2024-09-12T02:45:41.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.156+0000 7f09fca00640 1 -- start start 2024-09-12T02:45:41.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.157+0000 7f09fca00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f09f80b3e00 0x7f09f80d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:41.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.157+0000 7f09fca00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f09f80b1d70 0x7f09f80b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:41.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.157+0000 7f09fca00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09f80d2fb0 con 0x7f09f80d1710 2024-09-12T02:45:41.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.157+0000 7f09fca00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f09f80d3cb0 con 0x7f09f80b3e00 2024-09-12T02:45:41.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.157+0000 7f09fca00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f09f80d0b60 con 0x7f09f80b1d70 2024-09-12T02:45:41.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.158+0000 7f09f6a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f09f80b3e00 0x7f09f80d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:41.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.158+0000 7f09f6a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f09f80b3e00 0x7f09f80d28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48296/0 (socket says 172.21.15.112:48296) 2024-09-12T02:45:41.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.158+0000 7f09f6a00640 1 -- 172.21.15.112:0/3092952548 learned_addr learned my addr 172.21.15.112:0/3092952548 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:41.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.158+0000 7f09f7e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f09f80b1d70 0x7f09f80b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:41.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.158+0000 7f09f6a00640 1 -- 172.21.15.112:0/3092952548 >> v2:172.21.15.137:3300/0 conn(0x7f09f80b1d70 msgr2=0x7f09f80b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:41.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.158+0000 7f09f6a00640 1 --2- 172.21.15.112:0/3092952548 >> v2:172.21.15.137:3300/0 conn(0x7f09f80b1d70 0x7f09f80b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:41.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.158+0000 7f09f6a00640 1 -- 172.21.15.112:0/3092952548 >> v1:172.21.15.137:6789/0 conn(0x7f09f80d1710 legacy=0x7f09f80d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:41.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.158+0000 7f09f6a00640 1 -- 172.21.15.112:0/3092952548 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f80d3410 con 0x7f09f80b3e00 2024-09-12T02:45:41.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.159+0000 7f09f6a00640 1 --2- 172.21.15.112:0/3092952548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09f80b3e00 0x7f09f80d28d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f09f808ef20 tx=0x7f09e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb06e41a16ba4c32 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:41.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.159+0000 7f09f6000640 1 -- 172.21.15.112:0/3092952548 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e4037070 con 0x7f09f80b3e00 2024-09-12T02:45:41.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.159+0000 7f09f6000640 1 -- 172.21.15.112:0/3092952548 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e4032440 con 0x7f09f80b3e00 2024-09-12T02:45:41.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.159+0000 7f09f6000640 1 -- 172.21.15.112:0/3092952548 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e4032810 con 0x7f09f80b3e00 2024-09-12T02:45:41.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.160+0000 7f09fca00640 1 -- 172.21.15.112:0/3092952548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09f80b3e00 msgr2=0x7f09f80d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:41.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.160+0000 7f09fca00640 1 --2- 172.21.15.112:0/3092952548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09f80b3e00 0x7f09f80d28d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f09f808ef20 tx=0x7f09e402a270 comp rx=0 tx=0).stop 2024-09-12T02:45:41.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.160+0000 7f09fca00640 1 -- 172.21.15.112:0/3092952548 shutdown_connections 2024-09-12T02:45:41.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.160+0000 7f09fca00640 1 --2- 172.21.15.112:0/3092952548 >> v2:172.21.15.137:3300/0 conn(0x7f09f80b1d70 0x7f09f80b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:41.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.160+0000 7f09fca00640 1 --2- 172.21.15.112:0/3092952548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09f80b3e00 0x7f09f80d28d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:41.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.160+0000 7f09fca00640 1 -- 172.21.15.112:0/3092952548 >> 172.21.15.112:0/3092952548 conn(0x7f09f809e030 msgr2=0x7f09f80d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:41.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.160+0000 7f09fca00640 1 -- 172.21.15.112:0/3092952548 shutdown_connections 2024-09-12T02:45:41.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.160+0000 7f09fca00640 1 -- 172.21.15.112:0/3092952548 wait complete. 2024-09-12T02:45:41.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.162+0000 7f09fca00640 1 Processor -- start 2024-09-12T02:45:41.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.162+0000 7f09fca00640 1 -- start start 2024-09-12T02:45:41.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.163+0000 7f09fca00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09f80b1d70 0x7f09f8158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:41.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.163+0000 7f09fca00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09f80b3e00 0x7f09f80b8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:41.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.163+0000 7f09fca00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09f80d1710 0x7f09f8161da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:41.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.163+0000 7f09fca00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f09f815f110 con 0x7f09f80b3e00 2024-09-12T02:45:41.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.163+0000 7f09fca00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f09f80d39d0 con 0x7f09f80b1d70 2024-09-12T02:45:41.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.163+0000 7f09fca00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f09f815f290 con 0x7f09f80d1710 2024-09-12T02:45:41.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.163+0000 7f09f6a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09f80b3e00 0x7f09f80b8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:41.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.163+0000 7f09f6a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09f80b3e00 0x7f09f80b8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48304/0 (socket says 172.21.15.112:48304) 2024-09-12T02:45:41.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.163+0000 7f09f6a00640 1 -- 172.21.15.112:0/641395407 learned_addr learned my addr 172.21.15.112:0/641395407 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:41.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.163+0000 7f09f7400640 1 --2- 172.21.15.112:0/641395407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09f80b1d70 0x7f09f8158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:41.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.163+0000 7f09f7e00640 1 --2- 172.21.15.112:0/641395407 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09f80d1710 0x7f09f8161da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:41.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.163+0000 7f09f6a00640 1 -- 172.21.15.112:0/641395407 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09f80d1710 msgr2=0x7f09f8161da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:41.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.163+0000 7f09f6a00640 1 --2- 172.21.15.112:0/641395407 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09f80d1710 0x7f09f8161da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:41.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.163+0000 7f09f6a00640 1 -- 172.21.15.112:0/641395407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09f80b1d70 msgr2=0x7f09f8158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:41.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.163+0000 7f09f6a00640 1 --2- 172.21.15.112:0/641395407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09f80b1d70 0x7f09f8158160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:41.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.163+0000 7f09f6a00640 1 -- 172.21.15.112:0/641395407 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f80cd070 con 0x7f09f80b3e00 2024-09-12T02:45:41.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.163+0000 7f09f7400640 1 --2- 172.21.15.112:0/641395407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09f80b1d70 0x7f09f8158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:45:41.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.164+0000 7f09f6a00640 1 --2- 172.21.15.112:0/641395407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09f80b3e00 0x7f09f80b8590 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f09e402a2b0 tx=0x7f09e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:41.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.164+0000 7f09ef400640 1 -- 172.21.15.112:0/641395407 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e4037040 con 0x7f09f80b3e00 2024-09-12T02:45:41.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.164+0000 7f09ef400640 1 -- 172.21.15.112:0/641395407 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e4042070 con 0x7f09f80b3e00 2024-09-12T02:45:41.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.164+0000 7f09ef400640 1 -- 172.21.15.112:0/641395407 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e4030880 con 0x7f09f80b3e00 2024-09-12T02:45:41.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.164+0000 7f09fca00640 1 -- 172.21.15.112:0/641395407 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09f80cd350 con 0x7f09f80b3e00 2024-09-12T02:45:41.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.164+0000 7f09fca00640 1 -- 172.21.15.112:0/641395407 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09f80cd910 con 0x7f09f80b3e00 2024-09-12T02:45:41.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.165+0000 7f09fca00640 1 -- 172.21.15.112:0/641395407 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09f8073ea0 con 0x7f09f80b3e00 2024-09-12T02:45:41.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.166+0000 7f09ef400640 1 -- 172.21.15.112:0/641395407 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f09e4030a20 con 0x7f09f80b3e00 2024-09-12T02:45:41.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.167+0000 7f09ef400640 1 --2- 172.21.15.112:0/641395407 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f09d806be30 0x7f09d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:41.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.167+0000 7f09ef400640 1 -- 172.21.15.112:0/641395407 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5709+0+0 (secure 0 0 0) 0x7f09e40ab6a0 con 0x7f09f80b3e00 2024-09-12T02:45:41.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.167+0000 7f09f7400640 1 --2- 172.21.15.112:0/641395407 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f09d806be30 0x7f09d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:41.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.168+0000 7f09f7400640 1 --2- 172.21.15.112:0/641395407 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f09d806be30 0x7f09d806e2f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f09f806d150 tx=0x7f09e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:41.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.171+0000 7f09ef400640 1 -- 172.21.15.112:0/641395407 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f09f8073ea0 con 0x7f09f80b3e00 2024-09-12T02:45:41.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.340+0000 7f09fca00640 1 -- 172.21.15.112:0/641395407 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f09f80cce20 con 0x7f09d806be30 2024-09-12T02:45:41.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.346+0000 7f09ef400640 1 -- 172.21.15.112:0/641395407 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247546 (secure 0 0 0) 0x7f09f80cce20 con 0x7f09d806be30 2024-09-12T02:45:41.350 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:45:41.351 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:45:41.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.350+0000 7f09fca00640 1 -- 172.21.15.112:0/641395407 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f09d806be30 msgr2=0x7f09d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:41.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.350+0000 7f09fca00640 1 --2- 172.21.15.112:0/641395407 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f09d806be30 0x7f09d806e2f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f09f806d150 tx=0x7f09e8009040 comp rx=0 tx=0).stop 2024-09-12T02:45:41.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.350+0000 7f09fca00640 1 -- 172.21.15.112:0/641395407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09f80b3e00 msgr2=0x7f09f80b8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:41.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.350+0000 7f09fca00640 1 --2- 172.21.15.112:0/641395407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09f80b3e00 0x7f09f80b8590 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f09e402a2b0 tx=0x7f09e40046c0 comp rx=0 tx=0).stop 2024-09-12T02:45:41.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.350+0000 7f09fca00640 1 -- 172.21.15.112:0/641395407 shutdown_connections 2024-09-12T02:45:41.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.350+0000 7f09fca00640 1 --2- 172.21.15.112:0/641395407 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09f80d1710 0x7f09f8161da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:41.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.350+0000 7f09fca00640 1 --2- 172.21.15.112:0/641395407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09f80b3e00 0x7f09f80b8590 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:41.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.350+0000 7f09fca00640 1 --2- 172.21.15.112:0/641395407 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f09d806be30 0x7f09d806e2f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:41.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.350+0000 7f09fca00640 1 --2- 172.21.15.112:0/641395407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09f80b1d70 0x7f09f8158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:41.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.350+0000 7f09fca00640 1 -- 172.21.15.112:0/641395407 >> 172.21.15.112:0/641395407 conn(0x7f09f809e030 msgr2=0x7f09f80cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:41.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.350+0000 7f09fca00640 1 -- 172.21.15.112:0/641395407 shutdown_connections 2024-09-12T02:45:41.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.350+0000 7f09fca00640 1 -- 172.21.15.112:0/641395407 wait complete. 2024-09-12T02:45:41.366 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2024-09-12T02:45:41.009153+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":103,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4358,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558141,"statfs":{"total":1600000000,"available":1595537260,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001014"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.812002+0000","last_change":"2024-09-12T02:45:36.811318+0000","last_active":"2024-09-12T02:45:36.812002+0000","last_peered":"2024-09-12T02:45:36.812002+0000","last_clean":"2024-09-12T02:45:36.812002+0000","last_became_active":"2024-09-12T02:45:36.809713+0000","last_became_peered":"2024-09-12T02:45:36.809713+0000","last_unstale":"2024-09-12T02:45:36.812002+0000","last_undegraded":"2024-09-12T02:45:36.812002+0000","last_fullsized":"2024-09-12T02:45:36.812002+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:03.648643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.789914+0000","last_change":"2024-09-12T02:45:36.794302+0000","last_active":"2024-09-12T02:45:37.789914+0000","last_peered":"2024-09-12T02:45:37.789914+0000","last_clean":"2024-09-12T02:45:37.789914+0000","last_became_active":"2024-09-12T02:45:36.793855+0000","last_became_peered":"2024-09-12T02:45:36.793855+0000","last_unstale":"2024-09-12T02:45:37.789914+0000","last_undegraded":"2024-09-12T02:45:37.789914+0000","last_fullsized":"2024-09-12T02:45:37.789914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:44.765054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.789881+0000","last_change":"2024-09-12T02:45:36.793712+0000","last_active":"2024-09-12T02:45:37.789881+0000","last_peered":"2024-09-12T02:45:37.789881+0000","last_clean":"2024-09-12T02:45:37.789881+0000","last_became_active":"2024-09-12T02:45:36.792956+0000","last_became_peered":"2024-09-12T02:45:36.792956+0000","last_unstale":"2024-09-12T02:45:37.789881+0000","last_undegraded":"2024-09-12T02:45:37.789881+0000","last_fullsized":"2024-09-12T02:45:37.789881+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:46.475950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.799470+0000","last_change":"2024-09-12T02:45:36.799057+0000","last_active":"2024-09-12T02:45:36.799470+0000","last_peered":"2024-09-12T02:45:36.799470+0000","last_clean":"2024-09-12T02:45:36.799470+0000","last_became_active":"2024-09-12T02:45:36.797436+0000","last_became_peered":"2024-09-12T02:45:36.797436+0000","last_unstale":"2024-09-12T02:45:36.799470+0000","last_undegraded":"2024-09-12T02:45:36.799470+0000","last_fullsized":"2024-09-12T02:45:36.799470+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:07.148244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.806758+0000","last_change":"2024-09-12T02:45:36.805645+0000","last_active":"2024-09-12T02:45:36.806758+0000","last_peered":"2024-09-12T02:45:36.806758+0000","last_clean":"2024-09-12T02:45:36.806758+0000","last_became_active":"2024-09-12T02:45:36.805212+0000","last_became_peered":"2024-09-12T02:45:36.805212+0000","last_unstale":"2024-09-12T02:45:36.806758+0000","last_undegraded":"2024-09-12T02:45:36.806758+0000","last_fullsized":"2024-09-12T02:45:36.806758+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:40.575138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790257+0000","last_change":"2024-09-12T02:45:36.799087+0000","last_active":"2024-09-12T02:45:37.790257+0000","last_peered":"2024-09-12T02:45:37.790257+0000","last_clean":"2024-09-12T02:45:37.790257+0000","last_became_active":"2024-09-12T02:45:36.798703+0000","last_became_peered":"2024-09-12T02:45:36.798703+0000","last_unstale":"2024-09-12T02:45:37.790257+0000","last_undegraded":"2024-09-12T02:45:37.790257+0000","last_fullsized":"2024-09-12T02:45:37.790257+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:29.850324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.798475+0000","last_change":"2024-09-12T02:45:36.797544+0000","last_active":"2024-09-12T02:45:36.798475+0000","last_peered":"2024-09-12T02:45:36.798475+0000","last_clean":"2024-09-12T02:45:36.798475+0000","last_became_active":"2024-09-12T02:45:36.797311+0000","last_became_peered":"2024-09-12T02:45:36.797311+0000","last_unstale":"2024-09-12T02:45:36.798475+0000","last_undegraded":"2024-09-12T02:45:36.798475+0000","last_fullsized":"2024-09-12T02:45:36.798475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:40.229301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.789995+0000","last_change":"2024-09-12T02:45:36.795872+0000","last_active":"2024-09-12T02:45:37.789995+0000","last_peered":"2024-09-12T02:45:37.789995+0000","last_clean":"2024-09-12T02:45:37.789995+0000","last_became_active":"2024-09-12T02:45:36.795503+0000","last_became_peered":"2024-09-12T02:45:36.795503+0000","last_unstale":"2024-09-12T02:45:37.789995+0000","last_undegraded":"2024-09-12T02:45:37.789995+0000","last_fullsized":"2024-09-12T02:45:37.789995+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:31.887965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.808650+0000","last_change":"2024-09-12T02:45:36.807566+0000","last_active":"2024-09-12T02:45:36.808650+0000","last_peered":"2024-09-12T02:45:36.808650+0000","last_clean":"2024-09-12T02:45:36.808650+0000","last_became_active":"2024-09-12T02:45:36.807034+0000","last_became_peered":"2024-09-12T02:45:36.807034+0000","last_unstale":"2024-09-12T02:45:36.808650+0000","last_undegraded":"2024-09-12T02:45:36.808650+0000","last_fullsized":"2024-09-12T02:45:36.808650+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:09.690925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.787647+0000","last_change":"2024-09-12T02:45:36.806464+0000","last_active":"2024-09-12T02:45:37.787647+0000","last_peered":"2024-09-12T02:45:37.787647+0000","last_clean":"2024-09-12T02:45:37.787647+0000","last_became_active":"2024-09-12T02:45:36.806230+0000","last_became_peered":"2024-09-12T02:45:36.806230+0000","last_unstale":"2024-09-12T02:45:37.787647+0000","last_undegraded":"2024-09-12T02:45:37.787647+0000","last_fullsized":"2024-09-12T02:45:37.787647+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:13.728501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.801804+0000","last_change":"2024-09-12T02:45:36.801467+0000","last_active":"2024-09-12T02:45:36.801804+0000","last_peered":"2024-09-12T02:45:36.801804+0000","last_clean":"2024-09-12T02:45:36.801804+0000","last_became_active":"2024-09-12T02:45:36.801217+0000","last_became_peered":"2024-09-12T02:45:36.801217+0000","last_unstale":"2024-09-12T02:45:36.801804+0000","last_undegraded":"2024-09-12T02:45:36.801804+0000","last_fullsized":"2024-09-12T02:45:36.801804+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:21.285612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.810488+0000","last_change":"2024-09-12T02:45:36.810217+0000","last_active":"2024-09-12T02:45:36.810488+0000","last_peered":"2024-09-12T02:45:36.810488+0000","last_clean":"2024-09-12T02:45:36.810488+0000","last_became_active":"2024-09-12T02:45:36.809636+0000","last_became_peered":"2024-09-12T02:45:36.809636+0000","last_unstale":"2024-09-12T02:45:36.810488+0000","last_undegraded":"2024-09-12T02:45:36.810488+0000","last_fullsized":"2024-09-12T02:45:36.810488+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:16.040688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.802400+0000","last_change":"2024-09-12T02:45:36.802228+0000","last_active":"2024-09-12T02:45:36.802400+0000","last_peered":"2024-09-12T02:45:36.802400+0000","last_clean":"2024-09-12T02:45:36.802400+0000","last_became_active":"2024-09-12T02:45:36.800908+0000","last_became_peered":"2024-09-12T02:45:36.800908+0000","last_unstale":"2024-09-12T02:45:36.802400+0000","last_undegraded":"2024-09-12T02:45:36.802400+0000","last_fullsized":"2024-09-12T02:45:36.802400+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:17.520432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.808629+0000","last_change":"2024-09-12T02:45:36.807283+0000","last_active":"2024-09-12T02:45:36.808629+0000","last_peered":"2024-09-12T02:45:36.808629+0000","last_clean":"2024-09-12T02:45:36.808629+0000","last_became_active":"2024-09-12T02:45:36.806735+0000","last_became_peered":"2024-09-12T02:45:36.806735+0000","last_unstale":"2024-09-12T02:45:36.808629+0000","last_undegraded":"2024-09-12T02:45:36.808629+0000","last_fullsized":"2024-09-12T02:45:36.808629+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:37.430188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.807154+0000","last_change":"2024-09-12T02:45:36.807012+0000","last_active":"2024-09-12T02:45:36.807154+0000","last_peered":"2024-09-12T02:45:36.807154+0000","last_clean":"2024-09-12T02:45:36.807154+0000","last_became_active":"2024-09-12T02:45:36.806797+0000","last_became_peered":"2024-09-12T02:45:36.806797+0000","last_unstale":"2024-09-12T02:45:36.807154+0000","last_undegraded":"2024-09-12T02:45:36.807154+0000","last_fullsized":"2024-09-12T02:45:36.807154+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:47.711648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.787881+0000","last_change":"2024-09-12T02:45:36.798162+0000","last_active":"2024-09-12T02:45:37.787881+0000","last_peered":"2024-09-12T02:45:37.787881+0000","last_clean":"2024-09-12T02:45:37.787881+0000","last_became_active":"2024-09-12T02:45:36.797878+0000","last_became_peered":"2024-09-12T02:45:36.797878+0000","last_unstale":"2024-09-12T02:45:37.787881+0000","last_undegraded":"2024-09-12T02:45:37.787881+0000","last_fullsized":"2024-09-12T02:45:37.787881+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:23.648364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.809693+0000","last_change":"2024-09-12T02:45:36.808982+0000","last_active":"2024-09-12T02:45:36.809693+0000","last_peered":"2024-09-12T02:45:36.809693+0000","last_clean":"2024-09-12T02:45:36.809693+0000","last_became_active":"2024-09-12T02:45:36.805095+0000","last_became_peered":"2024-09-12T02:45:36.805095+0000","last_unstale":"2024-09-12T02:45:36.809693+0000","last_undegraded":"2024-09-12T02:45:36.809693+0000","last_fullsized":"2024-09-12T02:45:36.809693+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:53.865444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.798468+0000","last_change":"2024-09-12T02:45:36.797703+0000","last_active":"2024-09-12T02:45:36.798468+0000","last_peered":"2024-09-12T02:45:36.798468+0000","last_clean":"2024-09-12T02:45:36.798468+0000","last_became_active":"2024-09-12T02:45:36.797358+0000","last_became_peered":"2024-09-12T02:45:36.797358+0000","last_unstale":"2024-09-12T02:45:36.798468+0000","last_undegraded":"2024-09-12T02:45:36.798468+0000","last_fullsized":"2024-09-12T02:45:36.798468+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:42.160699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790053+0000","last_change":"2024-09-12T02:45:36.796188+0000","last_active":"2024-09-12T02:45:37.790053+0000","last_peered":"2024-09-12T02:45:37.790053+0000","last_clean":"2024-09-12T02:45:37.790053+0000","last_became_active":"2024-09-12T02:45:36.795801+0000","last_became_peered":"2024-09-12T02:45:36.795801+0000","last_unstale":"2024-09-12T02:45:37.790053+0000","last_undegraded":"2024-09-12T02:45:37.790053+0000","last_fullsized":"2024-09-12T02:45:37.790053+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:05.209397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.800628+0000","last_change":"2024-09-12T02:45:36.800225+0000","last_active":"2024-09-12T02:45:36.800628+0000","last_peered":"2024-09-12T02:45:36.800628+0000","last_clean":"2024-09-12T02:45:36.800628+0000","last_became_active":"2024-09-12T02:45:36.799980+0000","last_became_peered":"2024-09-12T02:45:36.799980+0000","last_unstale":"2024-09-12T02:45:36.800628+0000","last_undegraded":"2024-09-12T02:45:36.800628+0000","last_fullsized":"2024-09-12T02:45:36.800628+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:13.459308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.787611+0000","last_change":"2024-09-12T02:45:36.796436+0000","last_active":"2024-09-12T02:45:37.787611+0000","last_peered":"2024-09-12T02:45:37.787611+0000","last_clean":"2024-09-12T02:45:37.787611+0000","last_became_active":"2024-09-12T02:45:36.792214+0000","last_became_peered":"2024-09-12T02:45:36.792214+0000","last_unstale":"2024-09-12T02:45:37.787611+0000","last_undegraded":"2024-09-12T02:45:37.787611+0000","last_fullsized":"2024-09-12T02:45:37.787611+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:46.388828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.787476+0000","last_change":"2024-09-12T02:45:36.803773+0000","last_active":"2024-09-12T02:45:37.787476+0000","last_peered":"2024-09-12T02:45:37.787476+0000","last_clean":"2024-09-12T02:45:37.787476+0000","last_became_active":"2024-09-12T02:45:36.803510+0000","last_became_peered":"2024-09-12T02:45:36.803510+0000","last_unstale":"2024-09-12T02:45:37.787476+0000","last_undegraded":"2024-09-12T02:45:37.787476+0000","last_fullsized":"2024-09-12T02:45:37.787476+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:49.736080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.801766+0000","last_change":"2024-09-12T02:45:36.799762+0000","last_active":"2024-09-12T02:45:36.801766+0000","last_peered":"2024-09-12T02:45:36.801766+0000","last_clean":"2024-09-12T02:45:36.801766+0000","last_became_active":"2024-09-12T02:45:36.799497+0000","last_became_peered":"2024-09-12T02:45:36.799497+0000","last_unstale":"2024-09-12T02:45:36.801766+0000","last_undegraded":"2024-09-12T02:45:36.801766+0000","last_fullsized":"2024-09-12T02:45:36.801766+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:54.601397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.810242+0000","last_change":"2024-09-12T02:45:36.809466+0000","last_active":"2024-09-12T02:45:36.810242+0000","last_peered":"2024-09-12T02:45:36.810242+0000","last_clean":"2024-09-12T02:45:36.810242+0000","last_became_active":"2024-09-12T02:45:36.806706+0000","last_became_peered":"2024-09-12T02:45:36.806706+0000","last_unstale":"2024-09-12T02:45:36.810242+0000","last_undegraded":"2024-09-12T02:45:36.810242+0000","last_fullsized":"2024-09-12T02:45:36.810242+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:35.791927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.787742+0000","last_change":"2024-09-12T02:45:36.802573+0000","last_active":"2024-09-12T02:45:37.787742+0000","last_peered":"2024-09-12T02:45:37.787742+0000","last_clean":"2024-09-12T02:45:37.787742+0000","last_became_active":"2024-09-12T02:45:36.798202+0000","last_became_peered":"2024-09-12T02:45:36.798202+0000","last_unstale":"2024-09-12T02:45:37.787742+0000","last_undegraded":"2024-09-12T02:45:37.787742+0000","last_fullsized":"2024-09-12T02:45:37.787742+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:58.814724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.804920+0000","last_change":"2024-09-12T02:45:36.802400+0000","last_active":"2024-09-12T02:45:36.804920+0000","last_peered":"2024-09-12T02:45:36.804920+0000","last_clean":"2024-09-12T02:45:36.804920+0000","last_became_active":"2024-09-12T02:45:36.802152+0000","last_became_peered":"2024-09-12T02:45:36.802152+0000","last_unstale":"2024-09-12T02:45:36.804920+0000","last_undegraded":"2024-09-12T02:45:36.804920+0000","last_fullsized":"2024-09-12T02:45:36.804920+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:43.625342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790127+0000","last_change":"2024-09-12T02:45:36.798671+0000","last_active":"2024-09-12T02:45:37.790127+0000","last_peered":"2024-09-12T02:45:37.790127+0000","last_clean":"2024-09-12T02:45:37.790127+0000","last_became_active":"2024-09-12T02:45:36.798215+0000","last_became_peered":"2024-09-12T02:45:36.798215+0000","last_unstale":"2024-09-12T02:45:37.790127+0000","last_undegraded":"2024-09-12T02:45:37.790127+0000","last_fullsized":"2024-09-12T02:45:37.790127+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:38.169716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.787316+0000","last_change":"2024-09-12T02:45:36.801763+0000","last_active":"2024-09-12T02:45:37.787316+0000","last_peered":"2024-09-12T02:45:37.787316+0000","last_clean":"2024-09-12T02:45:37.787316+0000","last_became_active":"2024-09-12T02:45:36.801536+0000","last_became_peered":"2024-09-12T02:45:36.801536+0000","last_unstale":"2024-09-12T02:45:37.787316+0000","last_undegraded":"2024-09-12T02:45:37.787316+0000","last_fullsized":"2024-09-12T02:45:37.787316+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:53.939037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.789991+0000","last_change":"2024-09-12T02:45:36.795023+0000","last_active":"2024-09-12T02:45:37.789991+0000","last_peered":"2024-09-12T02:45:37.789991+0000","last_clean":"2024-09-12T02:45:37.789991+0000","last_became_active":"2024-09-12T02:45:36.794606+0000","last_became_peered":"2024-09-12T02:45:36.794606+0000","last_unstale":"2024-09-12T02:45:37.789991+0000","last_undegraded":"2024-09-12T02:45:37.789991+0000","last_fullsized":"2024-09-12T02:45:37.789991+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:24:58.946403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.804899+0000","last_change":"2024-09-12T02:45:36.801471+0000","last_active":"2024-09-12T02:45:36.804899+0000","last_peered":"2024-09-12T02:45:36.804899+0000","last_clean":"2024-09-12T02:45:36.804899+0000","last_became_active":"2024-09-12T02:45:36.801167+0000","last_became_peered":"2024-09-12T02:45:36.801167+0000","last_unstale":"2024-09-12T02:45:36.804899+0000","last_undegraded":"2024-09-12T02:45:36.804899+0000","last_fullsized":"2024-09-12T02:45:36.804899+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:24.312374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.809576+0000","last_change":"2024-09-12T02:45:36.808291+0000","last_active":"2024-09-12T02:45:36.809576+0000","last_peered":"2024-09-12T02:45:36.809576+0000","last_clean":"2024-09-12T02:45:36.809576+0000","last_became_active":"2024-09-12T02:45:36.807875+0000","last_became_peered":"2024-09-12T02:45:36.807875+0000","last_unstale":"2024-09-12T02:45:36.809576+0000","last_undegraded":"2024-09-12T02:45:36.809576+0000","last_fullsized":"2024-09-12T02:45:36.809576+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:13.642623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790126+0000","last_change":"2024-09-12T02:45:36.794115+0000","last_active":"2024-09-12T02:45:37.790126+0000","last_peered":"2024-09-12T02:45:37.790126+0000","last_clean":"2024-09-12T02:45:37.790126+0000","last_became_active":"2024-09-12T02:45:36.792578+0000","last_became_peered":"2024-09-12T02:45:36.792578+0000","last_unstale":"2024-09-12T02:45:37.790126+0000","last_undegraded":"2024-09-12T02:45:37.790126+0000","last_fullsized":"2024-09-12T02:45:37.790126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:22.885549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.810307+0000","last_change":"2024-09-12T02:45:36.809681+0000","last_active":"2024-09-12T02:45:36.810307+0000","last_peered":"2024-09-12T02:45:36.810307+0000","last_clean":"2024-09-12T02:45:36.810307+0000","last_became_active":"2024-09-12T02:45:36.807049+0000","last_became_peered":"2024-09-12T02:45:36.807049+0000","last_unstale":"2024-09-12T02:45:36.810307+0000","last_undegraded":"2024-09-12T02:45:36.810307+0000","last_fullsized":"2024-09-12T02:45:36.810307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:50.409672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"78'4","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.811361+0000","last_change":"2024-09-12T02:45:35.798725+0000","last_active":"2024-09-12T02:45:36.811361+0000","last_peered":"2024-09-12T02:45:36.811361+0000","last_clean":"2024-09-12T02:45:36.811361+0000","last_became_active":"2024-09-12T02:45:35.798491+0000","last_became_peered":"2024-09-12T02:45:35.798491+0000","last_unstale":"2024-09-12T02:45:36.811361+0000","last_undegraded":"2024-09-12T02:45:36.811361+0000","last_fullsized":"2024-09-12T02:45:36.811361+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:36.408422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.804717+0000","last_change":"2024-09-12T02:45:36.800286+0000","last_active":"2024-09-12T02:45:36.804717+0000","last_peered":"2024-09-12T02:45:36.804717+0000","last_clean":"2024-09-12T02:45:36.804717+0000","last_became_active":"2024-09-12T02:45:36.799997+0000","last_became_peered":"2024-09-12T02:45:36.799997+0000","last_unstale":"2024-09-12T02:45:36.804717+0000","last_undegraded":"2024-09-12T02:45:36.804717+0000","last_fullsized":"2024-09-12T02:45:36.804717+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:19.732183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"78'1","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.807311+0000","last_change":"2024-09-12T02:45:35.794720+0000","last_active":"2024-09-12T02:45:36.807311+0000","last_peered":"2024-09-12T02:45:36.807311+0000","last_clean":"2024-09-12T02:45:36.807311+0000","last_became_active":"2024-09-12T02:45:35.794468+0000","last_became_peered":"2024-09-12T02:45:35.794468+0000","last_unstale":"2024-09-12T02:45:36.807311+0000","last_undegraded":"2024-09-12T02:45:36.807311+0000","last_fullsized":"2024-09-12T02:45:36.807311+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:39.462555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790440+0000","last_change":"2024-09-12T02:45:36.801369+0000","last_active":"2024-09-12T02:45:37.790440+0000","last_peered":"2024-09-12T02:45:37.790440+0000","last_clean":"2024-09-12T02:45:37.790440+0000","last_became_active":"2024-09-12T02:45:36.800630+0000","last_became_peered":"2024-09-12T02:45:36.800630+0000","last_unstale":"2024-09-12T02:45:37.790440+0000","last_undegraded":"2024-09-12T02:45:37.790440+0000","last_fullsized":"2024-09-12T02:45:37.790440+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:45.213602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"78'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.787880+0000","last_change":"2024-09-12T02:45:35.800284+0000","last_active":"2024-09-12T02:45:37.787880+0000","last_peered":"2024-09-12T02:45:37.787880+0000","last_clean":"2024-09-12T02:45:37.787880+0000","last_became_active":"2024-09-12T02:45:35.799990+0000","last_became_peered":"2024-09-12T02:45:35.799990+0000","last_unstale":"2024-09-12T02:45:37.787880+0000","last_undegraded":"2024-09-12T02:45:37.787880+0000","last_fullsized":"2024-09-12T02:45:37.787880+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:42.128027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.801788+0000","last_change":"2024-09-12T02:45:36.800951+0000","last_active":"2024-09-12T02:45:36.801788+0000","last_peered":"2024-09-12T02:45:36.801788+0000","last_clean":"2024-09-12T02:45:36.801788+0000","last_became_active":"2024-09-12T02:45:36.800705+0000","last_became_peered":"2024-09-12T02:45:36.800705+0000","last_unstale":"2024-09-12T02:45:36.801788+0000","last_undegraded":"2024-09-12T02:45:36.801788+0000","last_fullsized":"2024-09-12T02:45:36.801788+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:47.442908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"78'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790689+0000","last_change":"2024-09-12T02:45:35.797170+0000","last_active":"2024-09-12T02:45:37.790689+0000","last_peered":"2024-09-12T02:45:37.790689+0000","last_clean":"2024-09-12T02:45:37.790689+0000","last_became_active":"2024-09-12T02:45:35.796252+0000","last_became_peered":"2024-09-12T02:45:35.796252+0000","last_unstale":"2024-09-12T02:45:37.790689+0000","last_undegraded":"2024-09-12T02:45:37.790689+0000","last_fullsized":"2024-09-12T02:45:37.790689+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:45.368969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.798496+0000","last_change":"2024-09-12T02:45:36.798270+0000","last_active":"2024-09-12T02:45:36.798496+0000","last_peered":"2024-09-12T02:45:36.798496+0000","last_clean":"2024-09-12T02:45:36.798496+0000","last_became_active":"2024-09-12T02:45:36.798034+0000","last_became_peered":"2024-09-12T02:45:36.798034+0000","last_unstale":"2024-09-12T02:45:36.798496+0000","last_undegraded":"2024-09-12T02:45:36.798496+0000","last_fullsized":"2024-09-12T02:45:36.798496+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:11.913020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"78'1","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790293+0000","last_change":"2024-09-12T02:45:35.797531+0000","last_active":"2024-09-12T02:45:37.790293+0000","last_peered":"2024-09-12T02:45:37.790293+0000","last_clean":"2024-09-12T02:45:37.790293+0000","last_became_active":"2024-09-12T02:45:35.797312+0000","last_became_peered":"2024-09-12T02:45:35.797312+0000","last_unstale":"2024-09-12T02:45:37.790293+0000","last_undegraded":"2024-09-12T02:45:37.790293+0000","last_fullsized":"2024-09-12T02:45:37.790293+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:05.634405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.787599+0000","last_change":"2024-09-12T02:45:36.797894+0000","last_active":"2024-09-12T02:45:37.787599+0000","last_peered":"2024-09-12T02:45:37.787599+0000","last_clean":"2024-09-12T02:45:37.787599+0000","last_became_active":"2024-09-12T02:45:36.797527+0000","last_became_peered":"2024-09-12T02:45:36.797527+0000","last_unstale":"2024-09-12T02:45:37.787599+0000","last_undegraded":"2024-09-12T02:45:37.787599+0000","last_fullsized":"2024-09-12T02:45:37.787599+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:11.817654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"78'1","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790308+0000","last_change":"2024-09-12T02:45:35.795500+0000","last_active":"2024-09-12T02:45:37.790308+0000","last_peered":"2024-09-12T02:45:37.790308+0000","last_clean":"2024-09-12T02:45:37.790308+0000","last_became_active":"2024-09-12T02:45:35.792644+0000","last_became_peered":"2024-09-12T02:45:35.792644+0000","last_unstale":"2024-09-12T02:45:37.790308+0000","last_undegraded":"2024-09-12T02:45:37.790308+0000","last_fullsized":"2024-09-12T02:45:37.790308+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:40.359239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.807113+0000","last_change":"2024-09-12T02:45:36.806204+0000","last_active":"2024-09-12T02:45:36.807113+0000","last_peered":"2024-09-12T02:45:36.807113+0000","last_clean":"2024-09-12T02:45:36.807113+0000","last_became_active":"2024-09-12T02:45:36.805930+0000","last_became_peered":"2024-09-12T02:45:36.805930+0000","last_unstale":"2024-09-12T02:45:36.807113+0000","last_undegraded":"2024-09-12T02:45:36.807113+0000","last_fullsized":"2024-09-12T02:45:36.807113+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:56.047333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.792475+0000","last_change":"2024-09-12T02:45:35.797211+0000","last_active":"2024-09-12T02:45:36.792475+0000","last_peered":"2024-09-12T02:45:36.792475+0000","last_clean":"2024-09-12T02:45:36.792475+0000","last_became_active":"2024-09-12T02:45:35.796954+0000","last_became_peered":"2024-09-12T02:45:35.796954+0000","last_unstale":"2024-09-12T02:45:36.792475+0000","last_undegraded":"2024-09-12T02:45:36.792475+0000","last_fullsized":"2024-09-12T02:45:36.792475+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:16.863257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.800609+0000","last_change":"2024-09-12T02:45:36.800191+0000","last_active":"2024-09-12T02:45:36.800609+0000","last_peered":"2024-09-12T02:45:36.800609+0000","last_clean":"2024-09-12T02:45:36.800609+0000","last_became_active":"2024-09-12T02:45:36.799948+0000","last_became_peered":"2024-09-12T02:45:36.799948+0000","last_unstale":"2024-09-12T02:45:36.800609+0000","last_undegraded":"2024-09-12T02:45:36.800609+0000","last_fullsized":"2024-09-12T02:45:36.800609+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:48.308577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.799681+0000","last_change":"2024-09-12T02:45:35.795614+0000","last_active":"2024-09-12T02:45:36.799681+0000","last_peered":"2024-09-12T02:45:36.799681+0000","last_clean":"2024-09-12T02:45:36.799681+0000","last_became_active":"2024-09-12T02:45:35.794794+0000","last_became_peered":"2024-09-12T02:45:35.794794+0000","last_unstale":"2024-09-12T02:45:36.799681+0000","last_undegraded":"2024-09-12T02:45:36.799681+0000","last_fullsized":"2024-09-12T02:45:36.799681+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:06.049136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.805275+0000","last_change":"2024-09-12T02:45:36.804674+0000","last_active":"2024-09-12T02:45:36.805275+0000","last_peered":"2024-09-12T02:45:36.805275+0000","last_clean":"2024-09-12T02:45:36.805275+0000","last_became_active":"2024-09-12T02:45:36.803696+0000","last_became_peered":"2024-09-12T02:45:36.803696+0000","last_unstale":"2024-09-12T02:45:36.805275+0000","last_undegraded":"2024-09-12T02:45:36.805275+0000","last_fullsized":"2024-09-12T02:45:36.805275+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:51.669969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.787720+0000","last_change":"2024-09-12T02:45:35.796881+0000","last_active":"2024-09-12T02:45:37.787720+0000","last_peered":"2024-09-12T02:45:37.787720+0000","last_clean":"2024-09-12T02:45:37.787720+0000","last_became_active":"2024-09-12T02:45:35.796391+0000","last_became_peered":"2024-09-12T02:45:35.796391+0000","last_unstale":"2024-09-12T02:45:37.787720+0000","last_undegraded":"2024-09-12T02:45:37.787720+0000","last_fullsized":"2024-09-12T02:45:37.787720+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:12:17.576072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.806676+0000","last_change":"2024-09-12T02:45:36.803874+0000","last_active":"2024-09-12T02:45:36.806676+0000","last_peered":"2024-09-12T02:45:36.806676+0000","last_clean":"2024-09-12T02:45:36.806676+0000","last_became_active":"2024-09-12T02:45:36.803552+0000","last_became_peered":"2024-09-12T02:45:36.803552+0000","last_unstale":"2024-09-12T02:45:36.806676+0000","last_undegraded":"2024-09-12T02:45:36.806676+0000","last_fullsized":"2024-09-12T02:45:36.806676+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:08.005159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790237+0000","last_change":"2024-09-12T02:45:35.793958+0000","last_active":"2024-09-12T02:45:37.790237+0000","last_peered":"2024-09-12T02:45:37.790237+0000","last_clean":"2024-09-12T02:45:37.790237+0000","last_became_active":"2024-09-12T02:45:35.791051+0000","last_became_peered":"2024-09-12T02:45:35.791051+0000","last_unstale":"2024-09-12T02:45:37.790237+0000","last_undegraded":"2024-09-12T02:45:37.790237+0000","last_fullsized":"2024-09-12T02:45:37.790237+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:09.771681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790230+0000","last_change":"2024-09-12T02:45:36.793006+0000","last_active":"2024-09-12T02:45:37.790230+0000","last_peered":"2024-09-12T02:45:37.790230+0000","last_clean":"2024-09-12T02:45:37.790230+0000","last_became_active":"2024-09-12T02:45:36.792683+0000","last_became_peered":"2024-09-12T02:45:36.792683+0000","last_unstale":"2024-09-12T02:45:37.790230+0000","last_undegraded":"2024-09-12T02:45:37.790230+0000","last_fullsized":"2024-09-12T02:45:37.790230+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:26.431236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"78'3","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790018+0000","last_change":"2024-09-12T02:45:35.789058+0000","last_active":"2024-09-12T02:45:37.790018+0000","last_peered":"2024-09-12T02:45:37.790018+0000","last_clean":"2024-09-12T02:45:37.790018+0000","last_became_active":"2024-09-12T02:45:35.787998+0000","last_became_peered":"2024-09-12T02:45:35.787998+0000","last_unstale":"2024-09-12T02:45:37.790018+0000","last_undegraded":"2024-09-12T02:45:37.790018+0000","last_fullsized":"2024-09-12T02:45:37.790018+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:13.943517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.804748+0000","last_change":"2024-09-12T02:45:36.802211+0000","last_active":"2024-09-12T02:45:36.804748+0000","last_peered":"2024-09-12T02:45:36.804748+0000","last_clean":"2024-09-12T02:45:36.804748+0000","last_became_active":"2024-09-12T02:45:36.801262+0000","last_became_peered":"2024-09-12T02:45:36.801262+0000","last_unstale":"2024-09-12T02:45:36.804748+0000","last_undegraded":"2024-09-12T02:45:36.804748+0000","last_fullsized":"2024-09-12T02:45:36.804748+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:57.529792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"78'6","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.811953+0000","last_change":"2024-09-12T02:45:35.790984+0000","last_active":"2024-09-12T02:45:36.811953+0000","last_peered":"2024-09-12T02:45:36.811953+0000","last_clean":"2024-09-12T02:45:36.811953+0000","last_became_active":"2024-09-12T02:45:35.790709+0000","last_became_peered":"2024-09-12T02:45:35.790709+0000","last_unstale":"2024-09-12T02:45:36.811953+0000","last_undegraded":"2024-09-12T02:45:36.811953+0000","last_fullsized":"2024-09-12T02:45:36.811953+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:58.662017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.812023+0000","last_change":"2024-09-12T02:45:36.811561+0000","last_active":"2024-09-12T02:45:36.812023+0000","last_peered":"2024-09-12T02:45:36.812023+0000","last_clean":"2024-09-12T02:45:36.812023+0000","last_became_active":"2024-09-12T02:45:36.811073+0000","last_became_peered":"2024-09-12T02:45:36.811073+0000","last_unstale":"2024-09-12T02:45:36.812023+0000","last_undegraded":"2024-09-12T02:45:36.812023+0000","last_fullsized":"2024-09-12T02:45:36.812023+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:40.624371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"78'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.809026+0000","last_change":"2024-09-12T02:45:35.797428+0000","last_active":"2024-09-12T02:45:36.809026+0000","last_peered":"2024-09-12T02:45:36.809026+0000","last_clean":"2024-09-12T02:45:36.809026+0000","last_became_active":"2024-09-12T02:45:35.797200+0000","last_became_peered":"2024-09-12T02:45:35.797200+0000","last_unstale":"2024-09-12T02:45:36.809026+0000","last_undegraded":"2024-09-12T02:45:36.809026+0000","last_fullsized":"2024-09-12T02:45:36.809026+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:39.636365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.800238+0000","last_change":"2024-09-12T02:45:36.799376+0000","last_active":"2024-09-12T02:45:36.800238+0000","last_peered":"2024-09-12T02:45:36.800238+0000","last_clean":"2024-09-12T02:45:36.800238+0000","last_became_active":"2024-09-12T02:45:36.799108+0000","last_became_peered":"2024-09-12T02:45:36.799108+0000","last_unstale":"2024-09-12T02:45:36.800238+0000","last_undegraded":"2024-09-12T02:45:36.800238+0000","last_fullsized":"2024-09-12T02:45:36.800238+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:36.993943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790777+0000","last_change":"2024-09-12T02:45:35.797399+0000","last_active":"2024-09-12T02:45:37.790777+0000","last_peered":"2024-09-12T02:45:37.790777+0000","last_clean":"2024-09-12T02:45:37.790777+0000","last_became_active":"2024-09-12T02:45:35.796700+0000","last_became_peered":"2024-09-12T02:45:35.796700+0000","last_unstale":"2024-09-12T02:45:37.790777+0000","last_undegraded":"2024-09-12T02:45:37.790777+0000","last_fullsized":"2024-09-12T02:45:37.790777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:30.494933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.802382+0000","last_change":"2024-09-12T02:45:36.801925+0000","last_active":"2024-09-12T02:45:36.802382+0000","last_peered":"2024-09-12T02:45:36.802382+0000","last_clean":"2024-09-12T02:45:36.802382+0000","last_became_active":"2024-09-12T02:45:36.799808+0000","last_became_peered":"2024-09-12T02:45:36.799808+0000","last_unstale":"2024-09-12T02:45:36.802382+0000","last_undegraded":"2024-09-12T02:45:36.802382+0000","last_fullsized":"2024-09-12T02:45:36.802382+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:11.846309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.794151+0000","last_change":"2024-09-12T02:45:35.791738+0000","last_active":"2024-09-12T02:45:36.794151+0000","last_peered":"2024-09-12T02:45:36.794151+0000","last_clean":"2024-09-12T02:45:36.794151+0000","last_became_active":"2024-09-12T02:45:35.791497+0000","last_became_peered":"2024-09-12T02:45:35.791497+0000","last_unstale":"2024-09-12T02:45:36.794151+0000","last_undegraded":"2024-09-12T02:45:36.794151+0000","last_fullsized":"2024-09-12T02:45:36.794151+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:59.953571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.808884+0000","last_change":"2024-09-12T02:45:36.808692+0000","last_active":"2024-09-12T02:45:36.808884+0000","last_peered":"2024-09-12T02:45:36.808884+0000","last_clean":"2024-09-12T02:45:36.808884+0000","last_became_active":"2024-09-12T02:45:36.803869+0000","last_became_peered":"2024-09-12T02:45:36.803869+0000","last_unstale":"2024-09-12T02:45:36.808884+0000","last_undegraded":"2024-09-12T02:45:36.808884+0000","last_fullsized":"2024-09-12T02:45:36.808884+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:58.134631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"78'8","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.787441+0000","last_change":"2024-09-12T02:45:35.799288+0000","last_active":"2024-09-12T02:45:37.787441+0000","last_peered":"2024-09-12T02:45:37.787441+0000","last_clean":"2024-09-12T02:45:37.787441+0000","last_became_active":"2024-09-12T02:45:35.798825+0000","last_became_peered":"2024-09-12T02:45:35.798825+0000","last_unstale":"2024-09-12T02:45:37.787441+0000","last_undegraded":"2024-09-12T02:45:37.787441+0000","last_fullsized":"2024-09-12T02:45:37.787441+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:03.188803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.787822+0000","last_change":"2024-09-12T02:45:36.799784+0000","last_active":"2024-09-12T02:45:37.787822+0000","last_peered":"2024-09-12T02:45:37.787822+0000","last_clean":"2024-09-12T02:45:37.787822+0000","last_became_active":"2024-09-12T02:45:36.797141+0000","last_became_peered":"2024-09-12T02:45:36.797141+0000","last_unstale":"2024-09-12T02:45:37.787822+0000","last_undegraded":"2024-09-12T02:45:37.787822+0000","last_fullsized":"2024-09-12T02:45:37.787822+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:59.330265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"78'1","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790379+0000","last_change":"2024-09-12T02:45:35.787185+0000","last_active":"2024-09-12T02:45:37.790379+0000","last_peered":"2024-09-12T02:45:37.790379+0000","last_clean":"2024-09-12T02:45:37.790379+0000","last_became_active":"2024-09-12T02:45:35.786882+0000","last_became_peered":"2024-09-12T02:45:35.786882+0000","last_unstale":"2024-09-12T02:45:37.790379+0000","last_undegraded":"2024-09-12T02:45:37.790379+0000","last_fullsized":"2024-09-12T02:45:37.790379+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:43.486359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.798033+0000","last_change":"2024-09-12T02:45:36.797887+0000","last_active":"2024-09-12T02:45:36.798033+0000","last_peered":"2024-09-12T02:45:36.798033+0000","last_clean":"2024-09-12T02:45:36.798033+0000","last_became_active":"2024-09-12T02:45:36.797598+0000","last_became_peered":"2024-09-12T02:45:36.797598+0000","last_unstale":"2024-09-12T02:45:36.798033+0000","last_undegraded":"2024-09-12T02:45:36.798033+0000","last_fullsized":"2024-09-12T02:45:36.798033+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:17.939332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"78'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.787957+0000","last_change":"2024-09-12T02:45:35.798493+0000","last_active":"2024-09-12T02:45:37.787957+0000","last_peered":"2024-09-12T02:45:37.787957+0000","last_clean":"2024-09-12T02:45:37.787957+0000","last_became_active":"2024-09-12T02:45:35.797870+0000","last_became_peered":"2024-09-12T02:45:35.797870+0000","last_unstale":"2024-09-12T02:45:37.787957+0000","last_undegraded":"2024-09-12T02:45:37.787957+0000","last_fullsized":"2024-09-12T02:45:37.787957+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:54.554983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.810500+0000","last_change":"2024-09-12T02:45:36.810402+0000","last_active":"2024-09-12T02:45:36.810500+0000","last_peered":"2024-09-12T02:45:36.810500+0000","last_clean":"2024-09-12T02:45:36.810500+0000","last_became_active":"2024-09-12T02:45:36.809936+0000","last_became_peered":"2024-09-12T02:45:36.809936+0000","last_unstale":"2024-09-12T02:45:36.810500+0000","last_undegraded":"2024-09-12T02:45:36.810500+0000","last_fullsized":"2024-09-12T02:45:36.810500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:02:15.989543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"78'1","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790955+0000","last_change":"2024-09-12T02:45:35.798128+0000","last_active":"2024-09-12T02:45:37.790955+0000","last_peered":"2024-09-12T02:45:37.790955+0000","last_clean":"2024-09-12T02:45:37.790955+0000","last_became_active":"2024-09-12T02:45:35.797732+0000","last_became_peered":"2024-09-12T02:45:35.797732+0000","last_unstale":"2024-09-12T02:45:37.790955+0000","last_undegraded":"2024-09-12T02:45:37.790955+0000","last_fullsized":"2024-09-12T02:45:37.790955+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:02.351061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.807096+0000","last_change":"2024-09-12T02:45:36.806148+0000","last_active":"2024-09-12T02:45:36.807096+0000","last_peered":"2024-09-12T02:45:36.807096+0000","last_clean":"2024-09-12T02:45:36.807096+0000","last_became_active":"2024-09-12T02:45:36.805359+0000","last_became_peered":"2024-09-12T02:45:36.805359+0000","last_unstale":"2024-09-12T02:45:36.807096+0000","last_undegraded":"2024-09-12T02:45:36.807096+0000","last_fullsized":"2024-09-12T02:45:36.807096+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:12.146954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.793811+0000","last_change":"2024-09-12T02:45:35.800714+0000","last_active":"2024-09-12T02:45:36.793811+0000","last_peered":"2024-09-12T02:45:36.793811+0000","last_clean":"2024-09-12T02:45:36.793811+0000","last_became_active":"2024-09-12T02:45:35.800480+0000","last_became_peered":"2024-09-12T02:45:35.800480+0000","last_unstale":"2024-09-12T02:45:36.793811+0000","last_undegraded":"2024-09-12T02:45:36.793811+0000","last_fullsized":"2024-09-12T02:45:36.793811+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:18.387594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.789961+0000","last_change":"2024-09-12T02:45:36.794321+0000","last_active":"2024-09-12T02:45:37.789961+0000","last_peered":"2024-09-12T02:45:37.789961+0000","last_clean":"2024-09-12T02:45:37.789961+0000","last_became_active":"2024-09-12T02:45:36.794100+0000","last_became_peered":"2024-09-12T02:45:36.794100+0000","last_unstale":"2024-09-12T02:45:37.789961+0000","last_undegraded":"2024-09-12T02:45:37.789961+0000","last_fullsized":"2024-09-12T02:45:37.789961+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:11.599300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790481+0000","last_change":"2024-09-12T02:45:35.794634+0000","last_active":"2024-09-12T02:45:37.790481+0000","last_peered":"2024-09-12T02:45:37.790481+0000","last_clean":"2024-09-12T02:45:37.790481+0000","last_became_active":"2024-09-12T02:45:35.794189+0000","last_became_peered":"2024-09-12T02:45:35.794189+0000","last_unstale":"2024-09-12T02:45:37.790481+0000","last_undegraded":"2024-09-12T02:45:37.790481+0000","last_fullsized":"2024-09-12T02:45:37.790481+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:55.394061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.789955+0000","last_change":"2024-09-12T02:45:36.797679+0000","last_active":"2024-09-12T02:45:37.789955+0000","last_peered":"2024-09-12T02:45:37.789955+0000","last_clean":"2024-09-12T02:45:37.789955+0000","last_became_active":"2024-09-12T02:45:36.796569+0000","last_became_peered":"2024-09-12T02:45:36.796569+0000","last_unstale":"2024-09-12T02:45:37.789955+0000","last_undegraded":"2024-09-12T02:45:37.789955+0000","last_fullsized":"2024-09-12T02:45:37.789955+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:52.978156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.793941+0000","last_change":"2024-09-12T02:45:35.792797+0000","last_active":"2024-09-12T02:45:36.793941+0000","last_peered":"2024-09-12T02:45:36.793941+0000","last_clean":"2024-09-12T02:45:36.793941+0000","last_became_active":"2024-09-12T02:45:35.792562+0000","last_became_peered":"2024-09-12T02:45:35.792562+0000","last_unstale":"2024-09-12T02:45:36.793941+0000","last_undegraded":"2024-09-12T02:45:36.793941+0000","last_fullsized":"2024-09-12T02:45:36.793941+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:54.086461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.789881+0000","last_change":"2024-09-12T02:45:36.793915+0000","last_active":"2024-09-12T02:45:37.789881+0000","last_peered":"2024-09-12T02:45:37.789881+0000","last_clean":"2024-09-12T02:45:37.789881+0000","last_became_active":"2024-09-12T02:45:36.793691+0000","last_became_peered":"2024-09-12T02:45:36.793691+0000","last_unstale":"2024-09-12T02:45:37.789881+0000","last_undegraded":"2024-09-12T02:45:37.789881+0000","last_fullsized":"2024-09-12T02:45:37.789881+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:31.146374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.791301+0000","last_change":"2024-09-12T02:45:35.793009+0000","last_active":"2024-09-12T02:45:36.791301+0000","last_peered":"2024-09-12T02:45:36.791301+0000","last_clean":"2024-09-12T02:45:36.791301+0000","last_became_active":"2024-09-12T02:45:35.792753+0000","last_became_peered":"2024-09-12T02:45:35.792753+0000","last_unstale":"2024-09-12T02:45:36.791301+0000","last_undegraded":"2024-09-12T02:45:36.791301+0000","last_fullsized":"2024-09-12T02:45:36.791301+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:49.614182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.804162+0000","last_change":"2024-09-12T02:45:36.803809+0000","last_active":"2024-09-12T02:45:36.804162+0000","last_peered":"2024-09-12T02:45:36.804162+0000","last_clean":"2024-09-12T02:45:36.804162+0000","last_became_active":"2024-09-12T02:45:36.803588+0000","last_became_peered":"2024-09-12T02:45:36.803588+0000","last_unstale":"2024-09-12T02:45:36.804162+0000","last_undegraded":"2024-09-12T02:45:36.804162+0000","last_fullsized":"2024-09-12T02:45:36.804162+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:11.729042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"78'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790337+0000","last_change":"2024-09-12T02:45:35.794190+0000","last_active":"2024-09-12T02:45:37.790337+0000","last_peered":"2024-09-12T02:45:37.790337+0000","last_clean":"2024-09-12T02:45:37.790337+0000","last_became_active":"2024-09-12T02:45:35.792863+0000","last_became_peered":"2024-09-12T02:45:35.792863+0000","last_unstale":"2024-09-12T02:45:37.790337+0000","last_undegraded":"2024-09-12T02:45:37.790337+0000","last_fullsized":"2024-09-12T02:45:37.790337+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:09.412617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.805255+0000","last_change":"2024-09-12T02:45:36.804463+0000","last_active":"2024-09-12T02:45:36.805255+0000","last_peered":"2024-09-12T02:45:36.805255+0000","last_clean":"2024-09-12T02:45:36.805255+0000","last_became_active":"2024-09-12T02:45:36.803378+0000","last_became_peered":"2024-09-12T02:45:36.803378+0000","last_unstale":"2024-09-12T02:45:36.805255+0000","last_undegraded":"2024-09-12T02:45:36.805255+0000","last_fullsized":"2024-09-12T02:45:36.805255+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:14.645221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.792252+0000","last_change":"2024-09-12T02:45:35.793514+0000","last_active":"2024-09-12T02:45:36.792252+0000","last_peered":"2024-09-12T02:45:36.792252+0000","last_clean":"2024-09-12T02:45:36.792252+0000","last_became_active":"2024-09-12T02:45:35.792069+0000","last_became_peered":"2024-09-12T02:45:35.792069+0000","last_unstale":"2024-09-12T02:45:36.792252+0000","last_undegraded":"2024-09-12T02:45:36.792252+0000","last_fullsized":"2024-09-12T02:45:36.792252+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:11.820596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.808852+0000","last_change":"2024-09-12T02:45:36.808720+0000","last_active":"2024-09-12T02:45:36.808852+0000","last_peered":"2024-09-12T02:45:36.808852+0000","last_clean":"2024-09-12T02:45:36.808852+0000","last_became_active":"2024-09-12T02:45:36.807129+0000","last_became_peered":"2024-09-12T02:45:36.807129+0000","last_unstale":"2024-09-12T02:45:36.808852+0000","last_undegraded":"2024-09-12T02:45:36.808852+0000","last_fullsized":"2024-09-12T02:45:36.808852+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:42:11.288259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.802518+0000","last_change":"2024-09-12T02:45:35.794102+0000","last_active":"2024-09-12T02:45:36.802518+0000","last_peered":"2024-09-12T02:45:36.802518+0000","last_clean":"2024-09-12T02:45:36.802518+0000","last_became_active":"2024-09-12T02:45:35.792023+0000","last_became_peered":"2024-09-12T02:45:35.792023+0000","last_unstale":"2024-09-12T02:45:36.802518+0000","last_undegraded":"2024-09-12T02:45:36.802518+0000","last_fullsized":"2024-09-12T02:45:36.802518+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:29.389137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.810569+0000","last_change":"2024-09-12T02:45:36.810450+0000","last_active":"2024-09-12T02:45:36.810569+0000","last_peered":"2024-09-12T02:45:36.810569+0000","last_clean":"2024-09-12T02:45:36.810569+0000","last_became_active":"2024-09-12T02:45:36.809174+0000","last_became_peered":"2024-09-12T02:45:36.809174+0000","last_unstale":"2024-09-12T02:45:36.810569+0000","last_undegraded":"2024-09-12T02:45:36.810569+0000","last_fullsized":"2024-09-12T02:45:36.810569+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:45.925579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.791249+0000","last_change":"2024-09-12T02:45:35.798644+0000","last_active":"2024-09-12T02:45:36.791249+0000","last_peered":"2024-09-12T02:45:36.791249+0000","last_clean":"2024-09-12T02:45:36.791249+0000","last_became_active":"2024-09-12T02:45:35.798421+0000","last_became_peered":"2024-09-12T02:45:35.798421+0000","last_unstale":"2024-09-12T02:45:36.791249+0000","last_undegraded":"2024-09-12T02:45:36.791249+0000","last_fullsized":"2024-09-12T02:45:36.791249+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:45.814654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.807144+0000","last_change":"2024-09-12T02:45:36.806255+0000","last_active":"2024-09-12T02:45:36.807144+0000","last_peered":"2024-09-12T02:45:36.807144+0000","last_clean":"2024-09-12T02:45:36.807144+0000","last_became_active":"2024-09-12T02:45:36.803499+0000","last_became_peered":"2024-09-12T02:45:36.803499+0000","last_unstale":"2024-09-12T02:45:36.807144+0000","last_undegraded":"2024-09-12T02:45:36.807144+0000","last_fullsized":"2024-09-12T02:45:36.807144+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:12.200836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.796263+0000","last_change":"2024-09-12T02:45:35.794449+0000","last_active":"2024-09-12T02:45:36.796263+0000","last_peered":"2024-09-12T02:45:36.796263+0000","last_clean":"2024-09-12T02:45:36.796263+0000","last_became_active":"2024-09-12T02:45:35.794212+0000","last_became_peered":"2024-09-12T02:45:35.794212+0000","last_unstale":"2024-09-12T02:45:36.796263+0000","last_undegraded":"2024-09-12T02:45:36.796263+0000","last_fullsized":"2024-09-12T02:45:36.796263+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:18.750018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790590+0000","last_change":"2024-09-12T02:45:36.801579+0000","last_active":"2024-09-12T02:45:37.790590+0000","last_peered":"2024-09-12T02:45:37.790590+0000","last_clean":"2024-09-12T02:45:37.790590+0000","last_became_active":"2024-09-12T02:45:36.801035+0000","last_became_peered":"2024-09-12T02:45:36.801035+0000","last_unstale":"2024-09-12T02:45:37.790590+0000","last_undegraded":"2024-09-12T02:45:37.790590+0000","last_fullsized":"2024-09-12T02:45:37.790590+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:36:45.562084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.793466+0000","last_change":"2024-09-12T02:45:35.798628+0000","last_active":"2024-09-12T02:45:36.793466+0000","last_peered":"2024-09-12T02:45:36.793466+0000","last_clean":"2024-09-12T02:45:36.793466+0000","last_became_active":"2024-09-12T02:45:35.798378+0000","last_became_peered":"2024-09-12T02:45:35.798378+0000","last_unstale":"2024-09-12T02:45:36.793466+0000","last_undegraded":"2024-09-12T02:45:36.793466+0000","last_fullsized":"2024-09-12T02:45:36.793466+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:10.114324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.799488+0000","last_change":"2024-09-12T02:45:36.799276+0000","last_active":"2024-09-12T02:45:36.799488+0000","last_peered":"2024-09-12T02:45:36.799488+0000","last_clean":"2024-09-12T02:45:36.799488+0000","last_became_active":"2024-09-12T02:45:36.798841+0000","last_became_peered":"2024-09-12T02:45:36.798841+0000","last_unstale":"2024-09-12T02:45:36.799488+0000","last_undegraded":"2024-09-12T02:45:36.799488+0000","last_fullsized":"2024-09-12T02:45:36.799488+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:33.379839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.787563+0000","last_change":"2024-09-12T02:45:35.799098+0000","last_active":"2024-09-12T02:45:37.787563+0000","last_peered":"2024-09-12T02:45:37.787563+0000","last_clean":"2024-09-12T02:45:37.787563+0000","last_became_active":"2024-09-12T02:45:35.798431+0000","last_became_peered":"2024-09-12T02:45:35.798431+0000","last_unstale":"2024-09-12T02:45:37.787563+0000","last_undegraded":"2024-09-12T02:45:37.787563+0000","last_fullsized":"2024-09-12T02:45:37.787563+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:43.963605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790167+0000","last_change":"2024-09-12T02:45:36.791403+0000","last_active":"2024-09-12T02:45:37.790167+0000","last_peered":"2024-09-12T02:45:37.790167+0000","last_clean":"2024-09-12T02:45:37.790167+0000","last_became_active":"2024-09-12T02:45:36.791142+0000","last_became_peered":"2024-09-12T02:45:36.791142+0000","last_unstale":"2024-09-12T02:45:37.790167+0000","last_undegraded":"2024-09-12T02:45:37.790167+0000","last_fullsized":"2024-09-12T02:45:37.790167+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:58.999746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790560+0000","last_change":"2024-09-12T02:45:35.794430+0000","last_active":"2024-09-12T02:45:37.790560+0000","last_peered":"2024-09-12T02:45:37.790560+0000","last_clean":"2024-09-12T02:45:37.790560+0000","last_became_active":"2024-09-12T02:45:35.793822+0000","last_became_peered":"2024-09-12T02:45:35.793822+0000","last_unstale":"2024-09-12T02:45:37.790560+0000","last_undegraded":"2024-09-12T02:45:37.790560+0000","last_fullsized":"2024-09-12T02:45:37.790560+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:12.489976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790081+0000","last_change":"2024-09-12T02:45:36.794818+0000","last_active":"2024-09-12T02:45:37.790081+0000","last_peered":"2024-09-12T02:45:37.790081+0000","last_clean":"2024-09-12T02:45:37.790081+0000","last_became_active":"2024-09-12T02:45:36.793900+0000","last_became_peered":"2024-09-12T02:45:36.793900+0000","last_unstale":"2024-09-12T02:45:37.790081+0000","last_undegraded":"2024-09-12T02:45:37.790081+0000","last_fullsized":"2024-09-12T02:45:37.790081+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:35.773592+0000","last_clean_scrub_stamp":"2024-09-12T02:45:35.773592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:58.539221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"78'2","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:45:37.790490+0000","last_change":"2024-09-12T02:45:35.792877+0000","last_active":"2024-09-12T02:45:37.790490+0000","last_peered":"2024-09-12T02:45:37.790490+0000","last_clean":"2024-09-12T02:45:37.790490+0000","last_became_active":"2024-09-12T02:45:35.792212+0000","last_became_peered":"2024-09-12T02:45:35.792212+0000","last_unstale":"2024-09-12T02:45:37.790490+0000","last_undegraded":"2024-09-12T02:45:37.790490+0000","last_fullsized":"2024-09-12T02:45:37.790490+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.770672+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.770672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:21.757656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":279,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T02:45:36.797037+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:45:36.797037+0000","last_peered":"2024-09-12T02:45:36.797037+0000","last_clean":"2024-09-12T02:45:36.797037+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:45:36.797037+0000","last_undegraded":"2024-09-12T02:45:36.797037+0000","last_fullsized":"2024-09-12T02:45:36.797037+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:55.927391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":977,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194335,"statfs":{"total":200000000,"available":198999368,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":400,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194912,"statfs":{"total":200000000,"available":199590260,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":400,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194912,"statfs":{"total":200000000,"available":199590262,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":400,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194912,"statfs":{"total":200000000,"available":199590282,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":400,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194912,"statfs":{"total":200000000,"available":199590240,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":401,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194910,"statfs":{"total":200000000,"available":199588740,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":402,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194910,"statfs":{"total":200000000,"available":199588124,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":976,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194335,"statfs":{"total":200000000,"available":198999984,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:45:41.370 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:45:41.371 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T02:45:41.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.566+0000 7f7cbf200640 1 Processor -- start 2024-09-12T02:45:41.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.567+0000 7f7cbf200640 1 -- start start 2024-09-12T02:45:41.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.568+0000 7f7cbf200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7cc01465b0 0x7f7cc00b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:41.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.568+0000 7f7cbf200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7cc00b3f00 0x7f7cc00b5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:41.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.568+0000 7f7cbf200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cc00b4480 con 0x7f7cc00b5ab0 2024-09-12T02:45:41.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.568+0000 7f7cbf200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f7cc00b4760 con 0x7f7cc01465b0 2024-09-12T02:45:41.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.568+0000 7f7cbf200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7cc00b4a40 con 0x7f7cc00b3f00 2024-09-12T02:45:41.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.568+0000 7f7cbde00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7cc01465b0 0x7f7cc00b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:41.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.568+0000 7f7cbe800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f7cc00b5ab0 0x7f7cc0160540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38106/0 (socket says 172.21.15.112:38106) 2024-09-12T02:45:41.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.568+0000 7f7cbe800640 1 -- 172.21.15.112:0/875066198 learned_addr learned my addr 172.21.15.112:0/875066198 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:45:41.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.569+0000 7f7cbde00640 1 -- 172.21.15.112:0/875066198 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7cc00b3f00 msgr2=0x7f7cc00b5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:41.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.569+0000 7f7cb5400640 1 --2- 172.21.15.112:0/875066198 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7cc00b3f00 0x7f7cc00b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:41.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.569+0000 7f7cbde00640 1 --2- 172.21.15.112:0/875066198 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7cc00b3f00 0x7f7cc00b5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:41.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.569+0000 7f7cbde00640 1 -- 172.21.15.112:0/875066198 >> v1:172.21.15.112:6789/0 conn(0x7f7cc00b5ab0 legacy=0x7f7cc0160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:41.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.569+0000 7f7cbde00640 1 -- 172.21.15.112:0/875066198 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc00ceeb0 con 0x7f7cc01465b0 2024-09-12T02:45:41.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.569+0000 7f7cb5400640 1 --2- 172.21.15.112:0/875066198 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7cc00b3f00 0x7f7cc00b5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:45:41.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.569+0000 7f7cbd400640 1 -- 172.21.15.112:0/875066198 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3298393114 0 0) 0x7f7cc00b4480 con 0x7f7cc00b5ab0 2024-09-12T02:45:41.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.570+0000 7f7cbde00640 1 --2- 172.21.15.112:0/875066198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cc01465b0 0x7f7cc00b39c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f7cb00097a0 tx=0x7f7cb002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601484d145e70236 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:41.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.570+0000 7f7cbd400640 1 -- 172.21.15.112:0/875066198 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0037070 con 0x7f7cc01465b0 2024-09-12T02:45:41.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.570+0000 7f7cbd400640 1 -- 172.21.15.112:0/875066198 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cb002ae50 con 0x7f7cc01465b0 2024-09-12T02:45:41.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.570+0000 7f7cbd400640 1 -- 172.21.15.112:0/875066198 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0032660 con 0x7f7cc01465b0 2024-09-12T02:45:41.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.570+0000 7f7cbf200640 1 -- 172.21.15.112:0/875066198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cc01465b0 msgr2=0x7f7cc00b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:41.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.570+0000 7f7cbf200640 1 --2- 172.21.15.112:0/875066198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cc01465b0 0x7f7cc00b39c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f7cb00097a0 tx=0x7f7cb002a100 comp rx=0 tx=0).stop 2024-09-12T02:45:41.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.570+0000 7f7cbf200640 1 -- 172.21.15.112:0/875066198 shutdown_connections 2024-09-12T02:45:41.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.570+0000 7f7cbf200640 1 --2- 172.21.15.112:0/875066198 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7cc00b3f00 0x7f7cc00b5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:41.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.570+0000 7f7cbf200640 1 --2- 172.21.15.112:0/875066198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cc01465b0 0x7f7cc00b39c0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:41.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.570+0000 7f7cbf200640 1 -- 172.21.15.112:0/875066198 >> 172.21.15.112:0/875066198 conn(0x7f7cc00b26c0 msgr2=0x7f7cc00b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:41.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.571+0000 7f7cbf200640 1 -- 172.21.15.112:0/875066198 shutdown_connections 2024-09-12T02:45:41.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.571+0000 7f7cbf200640 1 -- 172.21.15.112:0/875066198 wait complete. 2024-09-12T02:45:41.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.572+0000 7f7cbf200640 1 Processor -- start 2024-09-12T02:45:41.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.572+0000 7f7cbf200640 1 -- start start 2024-09-12T02:45:41.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.573+0000 7f7cbf200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7cc00b3f00 0x7f7cc0142790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:41.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.573+0000 7f7cbf200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cc00b5ab0 0x7f7cc0072e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.573+0000 7f7cbf200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cc01465b0 0x7f7cc00b1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.573+0000 7f7cbf200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc00d03e0 con 0x7f7cc01465b0 2024-09-12T02:45:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.573+0000 7f7cbf200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc00cd5d0 con 0x7f7cc00b5ab0 2024-09-12T02:45:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.573+0000 7f7cbf200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7cc00d0560 con 0x7f7cc00b3f00 2024-09-12T02:45:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.573+0000 7f7cbe800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cc01465b0 0x7f7cc00b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.573+0000 7f7cbe800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cc01465b0 0x7f7cc00b1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48312/0 (socket says 172.21.15.112:48312) 2024-09-12T02:45:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.573+0000 7f7cbe800640 1 -- 172.21.15.112:0/4231749889 learned_addr learned my addr 172.21.15.112:0/4231749889 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.574+0000 7f7cb5400640 1 --2- 172.21.15.112:0/4231749889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cc00b5ab0 0x7f7cc0072e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.574+0000 7f7cbde00640 1 --2- 172.21.15.112:0/4231749889 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7cc00b3f00 0x7f7cc0142790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.574+0000 7f7cbe800640 1 -- 172.21.15.112:0/4231749889 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7cc00b3f00 msgr2=0x7f7cc0142790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.574+0000 7f7cbe800640 1 --2- 172.21.15.112:0/4231749889 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7cc00b3f00 0x7f7cc0142790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.574+0000 7f7cbe800640 1 -- 172.21.15.112:0/4231749889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cc00b5ab0 msgr2=0x7f7cc0072e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:41.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.574+0000 7f7cbe800640 1 --2- 172.21.15.112:0/4231749889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cc00b5ab0 0x7f7cc0072e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:41.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.574+0000 7f7cbe800640 1 -- 172.21.15.112:0/4231749889 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc015e200 con 0x7f7cc01465b0 2024-09-12T02:45:41.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.574+0000 7f7cbde00640 1 --2- 172.21.15.112:0/4231749889 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7cc00b3f00 0x7f7cc0142790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:45:41.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.574+0000 7f7cbe800640 1 --2- 172.21.15.112:0/4231749889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cc01465b0 0x7f7cc00b1680 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f7cb800c7a0 tx=0x7f7cb800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:41.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.574+0000 7f7cb6a00640 1 -- 172.21.15.112:0/4231749889 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8018070 con 0x7f7cc01465b0 2024-09-12T02:45:41.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.574+0000 7f7cb6a00640 1 -- 172.21.15.112:0/4231749889 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cb800a640 con 0x7f7cc01465b0 2024-09-12T02:45:41.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.574+0000 7f7cb6a00640 1 -- 172.21.15.112:0/4231749889 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb800aab0 con 0x7f7cc01465b0 2024-09-12T02:45:41.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.574+0000 7f7cbf200640 1 -- 172.21.15.112:0/4231749889 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cc015e4e0 con 0x7f7cc01465b0 2024-09-12T02:45:41.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.574+0000 7f7cbf200640 1 -- 172.21.15.112:0/4231749889 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cc015eaa0 con 0x7f7cc01465b0 2024-09-12T02:45:41.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.576+0000 7f7cbf200640 1 -- 172.21.15.112:0/4231749889 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cc0068a30 con 0x7f7cc01465b0 2024-09-12T02:45:41.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.576+0000 7f7cb6a00640 1 -- 172.21.15.112:0/4231749889 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7cb801b070 con 0x7f7cc01465b0 2024-09-12T02:45:41.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.577+0000 7f7cb6a00640 1 --2- 172.21.15.112:0/4231749889 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7c9c06be30 0x7f7c9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:41.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.577+0000 7f7cb6a00640 1 -- 172.21.15.112:0/4231749889 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5709+0+0 (secure 0 0 0) 0x7f7cb808a3f0 con 0x7f7cc01465b0 2024-09-12T02:45:41.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.577+0000 7f7cbde00640 1 --2- 172.21.15.112:0/4231749889 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7c9c06be30 0x7f7c9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:41.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.578+0000 7f7cbde00640 1 --2- 172.21.15.112:0/4231749889 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7c9c06be30 0x7f7c9c06e2f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0034000 tx=0x7f7cb002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:41.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.582+0000 7f7cb6a00640 1 -- 172.21.15.112:0/4231749889 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7cb8058750 con 0x7f7cc01465b0 2024-09-12T02:45:41.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.819+0000 7f7cbf200640 1 -- 172.21.15.112:0/4231749889 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f7cc00690c0 con 0x7f7cc01465b0 2024-09-12T02:45:41.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.831+0000 7f7cb6a00640 1 -- 172.21.15.112:0/4231749889 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7f7cb805ca50 con 0x7f7cc01465b0 2024-09-12T02:45:41.833 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-09-12T02:45:41.833 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDUVOJmaG86ExAAD0SOlJOsLpoQZlgPJIPaxA== 2024-09-12T02:45:41.833 INFO:teuthology.orchestra.run.smithi112.stdout: caps mds = "allow" 2024-09-12T02:45:41.833 INFO:teuthology.orchestra.run.smithi112.stdout: caps mon = "allow r" 2024-09-12T02:45:41.833 INFO:teuthology.orchestra.run.smithi112.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T02:45:41.833 INFO:teuthology.orchestra.run.smithi112.stderr:updated caps for client.0 2024-09-12T02:45:41.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.834+0000 7f7cbf200640 1 -- 172.21.15.112:0/4231749889 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7c9c06be30 msgr2=0x7f7c9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:41.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.834+0000 7f7cbf200640 1 --2- 172.21.15.112:0/4231749889 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7c9c06be30 0x7f7c9c06e2f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0034000 tx=0x7f7cb002e000 comp rx=0 tx=0).stop 2024-09-12T02:45:41.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.834+0000 7f7cbf200640 1 -- 172.21.15.112:0/4231749889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cc01465b0 msgr2=0x7f7cc00b1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:41.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.834+0000 7f7cbf200640 1 --2- 172.21.15.112:0/4231749889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cc01465b0 0x7f7cc00b1680 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f7cb800c7a0 tx=0x7f7cb800cc60 comp rx=0 tx=0).stop 2024-09-12T02:45:41.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.834+0000 7f7cbf200640 1 -- 172.21.15.112:0/4231749889 shutdown_connections 2024-09-12T02:45:41.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.834+0000 7f7cbf200640 1 --2- 172.21.15.112:0/4231749889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cc01465b0 0x7f7cc00b1680 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:41.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.834+0000 7f7cbf200640 1 --2- 172.21.15.112:0/4231749889 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7c9c06be30 0x7f7c9c06e2f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:41.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.834+0000 7f7cbf200640 1 --2- 172.21.15.112:0/4231749889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cc00b5ab0 0x7f7cc0072e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:41.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.834+0000 7f7cbf200640 1 --2- 172.21.15.112:0/4231749889 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7cc00b3f00 0x7f7cc0142790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:41.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.834+0000 7f7cbf200640 1 -- 172.21.15.112:0/4231749889 >> 172.21.15.112:0/4231749889 conn(0x7f7cc00b26c0 msgr2=0x7f7cc006d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:41.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.834+0000 7f7cbf200640 1 -- 172.21.15.112:0/4231749889 shutdown_connections 2024-09-12T02:45:41.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:41.835+0000 7f7cbf200640 1 -- 172.21.15.112:0/4231749889 wait complete. 2024-09-12T02:45:41.851 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:45:42.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.002+0000 7fd617600640 1 Processor -- start 2024-09-12T02:45:42.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.002+0000 7fd617600640 1 -- start start 2024-09-12T02:45:42.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.004+0000 7fd617600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6100afe30 0x7fd6100cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.004+0000 7fd617600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6100ceeb0 con 0x7fd610071530 2024-09-12T02:45:42.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.004+0000 7fd617600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd61006e300 con 0x7fd61015cc50 2024-09-12T02:45:42.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.004+0000 7fd617600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd61015d030 con 0x7fd6100afe30 2024-09-12T02:45:42.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.004+0000 7fd607e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd610071530 0x7fd6100af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59090/0 (socket says 172.21.15.112:59090) 2024-09-12T02:45:42.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.004+0000 7fd607e00640 1 -- 172.21.15.112:0/1842249250 learned_addr learned my addr 172.21.15.112:0/1842249250 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:45:42.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.004+0000 7fd615600640 1 --2- 172.21.15.112:0/1842249250 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6100afe30 0x7fd6100cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:42.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.004+0000 7fd60fe00640 1 -- 172.21.15.112:0/1842249250 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4226997944 0 0) 0x7fd6100ceeb0 con 0x7fd610071530 2024-09-12T02:45:42.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.004+0000 7fd60fe00640 1 -- 172.21.15.112:0/1842249250 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5f4003520 con 0x7fd610071530 2024-09-12T02:45:42.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.005+0000 7fd60fe00640 1 -- 172.21.15.112:0/1842249250 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1551771496 0 0) 0x7fd5f4003520 con 0x7fd610071530 2024-09-12T02:45:42.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.005+0000 7fd60fe00640 1 -- 172.21.15.112:0/1842249250 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6100afe30 msgr2=0x7fd6100cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:42.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.005+0000 7fd60fe00640 1 --2- 172.21.15.112:0/1842249250 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6100afe30 0x7fd6100cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.005+0000 7fd60fe00640 1 -- 172.21.15.112:0/1842249250 >> v1:172.21.15.137:6789/0 conn(0x7fd61015cc50 legacy=0x7fd6100732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:42.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.005+0000 7fd60fe00640 1 -- 172.21.15.112:0/1842249250 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd61006e5e0 con 0x7fd610071530 2024-09-12T02:45:42.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.005+0000 7fd60fe00640 1 -- 172.21.15.112:0/1842249250 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7fd5f80017f0 con 0x7fd610071530 2024-09-12T02:45:42.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.005+0000 7fd60fe00640 1 -- 172.21.15.112:0/1842249250 >> v1:172.21.15.112:6789/0 conn(0x7fd610071530 legacy=0x7fd6100af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:42.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.005+0000 7fd60fe00640 1 --2- 172.21.15.112:0/1842249250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5f40039e0 0x7fd5f4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.005+0000 7fd60fe00640 1 --2- 172.21.15.112:0/1842249250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5f4004800 0x7fd5f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.005+0000 7fd60fe00640 1 --2- 172.21.15.112:0/1842249250 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6100afe30 0x7fd5f4005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.005+0000 7fd60fe00640 1 -- 172.21.15.112:0/1842249250 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f400bb50 con 0x7fd5f40039e0 2024-09-12T02:45:42.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.005+0000 7fd60fe00640 1 -- 172.21.15.112:0/1842249250 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f400bd00 con 0x7fd5f4004800 2024-09-12T02:45:42.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.005+0000 7fd60fe00640 1 -- 172.21.15.112:0/1842249250 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd5f400bf00 con 0x7fd6100afe30 2024-09-12T02:45:42.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.005+0000 7fd614c00640 1 --2- 172.21.15.112:0/1842249250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5f40039e0 0x7fd5f4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:42.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.005+0000 7fd615600640 1 --2- 172.21.15.112:0/1842249250 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6100afe30 0x7fd5f4005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:42.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.005+0000 7fd607e00640 1 --2- 172.21.15.112:0/1842249250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5f4004800 0x7fd5f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:42.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.005+0000 7fd614c00640 1 -- 172.21.15.112:0/1842249250 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6100afe30 msgr2=0x7fd5f4005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:42.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.005+0000 7fd614c00640 1 --2- 172.21.15.112:0/1842249250 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6100afe30 0x7fd5f4005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.005+0000 7fd614c00640 1 -- 172.21.15.112:0/1842249250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5f4004800 msgr2=0x7fd5f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:42.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.005+0000 7fd614c00640 1 --2- 172.21.15.112:0/1842249250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5f4004800 0x7fd5f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.005+0000 7fd614c00640 1 -- 172.21.15.112:0/1842249250 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f4003520 con 0x7fd5f40039e0 2024-09-12T02:45:42.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.006+0000 7fd614c00640 1 --2- 172.21.15.112:0/1842249250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5f40039e0 0x7fd5f4003e00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd600001750 tx=0x7fd5f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63c93e6ad34bde5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:42.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.007+0000 7fd60fe00640 1 -- 172.21.15.112:0/1842249250 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd600001370 con 0x7fd5f40039e0 2024-09-12T02:45:42.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.007+0000 7fd60fe00640 1 -- 172.21.15.112:0/1842249250 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6000052d0 con 0x7fd5f40039e0 2024-09-12T02:45:42.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.007+0000 7fd60fe00640 1 -- 172.21.15.112:0/1842249250 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60002abe0 con 0x7fd5f40039e0 2024-09-12T02:45:42.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.007+0000 7fd617600640 1 -- 172.21.15.112:0/1842249250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5f40039e0 msgr2=0x7fd5f4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:42.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.007+0000 7fd617600640 1 --2- 172.21.15.112:0/1842249250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5f40039e0 0x7fd5f4003e00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd600001750 tx=0x7fd5f4005830 comp rx=0 tx=0).stop 2024-09-12T02:45:42.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.007+0000 7fd615600640 1 -- 172.21.15.112:0/1842249250 reap_dead start 2024-09-12T02:45:42.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.007+0000 7fd617600640 1 -- 172.21.15.112:0/1842249250 shutdown_connections 2024-09-12T02:45:42.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.007+0000 7fd617600640 1 -- 172.21.15.112:0/1842249250 >> 172.21.15.112:0/1842249250 conn(0x7fd61006bbd0 msgr2=0x7fd61006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:42.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.007+0000 7fd617600640 1 -- 172.21.15.112:0/1842249250 shutdown_connections 2024-09-12T02:45:42.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.007+0000 7fd617600640 1 -- 172.21.15.112:0/1842249250 wait complete. 2024-09-12T02:45:42.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.009+0000 7fd617600640 1 Processor -- start 2024-09-12T02:45:42.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.009+0000 7fd617600640 1 -- start start 2024-09-12T02:45:42.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.010+0000 7fd617600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5f40039e0 0x7fd61015a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.010+0000 7fd617600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd610156040 0x7fd6101402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.010+0000 7fd617600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd610154590 0x7fd610154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.010+0000 7fd617600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd61006f510 con 0x7fd610154590 2024-09-12T02:45:42.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.010+0000 7fd617600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd6100cf4c0 con 0x7fd5f40039e0 2024-09-12T02:45:42.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.010+0000 7fd617600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd61006f690 con 0x7fd610156040 2024-09-12T02:45:42.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.010+0000 7fd615600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd610154590 0x7fd610154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:42.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.010+0000 7fd615600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd610154590 0x7fd610154a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50788/0 (socket says 172.21.15.112:50788) 2024-09-12T02:45:42.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.010+0000 7fd615600640 1 -- 172.21.15.112:0/3288514321 learned_addr learned my addr 172.21.15.112:0/3288514321 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:42.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.010+0000 7fd614c00640 1 --2- 172.21.15.112:0/3288514321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5f40039e0 0x7fd61015a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:42.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.010+0000 7fd607e00640 1 --2- 172.21.15.112:0/3288514321 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd610156040 0x7fd6101402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:42.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.011+0000 7fd615600640 1 -- 172.21.15.112:0/3288514321 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd610156040 msgr2=0x7fd6101402a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:42.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.011+0000 7fd615600640 1 --2- 172.21.15.112:0/3288514321 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd610156040 0x7fd6101402a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.011+0000 7fd615600640 1 -- 172.21.15.112:0/3288514321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5f40039e0 msgr2=0x7fd61015a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:42.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.011+0000 7fd615600640 1 --2- 172.21.15.112:0/3288514321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5f40039e0 0x7fd61015a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.011+0000 7fd615600640 1 -- 172.21.15.112:0/3288514321 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd61015a750 con 0x7fd610154590 2024-09-12T02:45:42.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.011+0000 7fd615600640 1 --2- 172.21.15.112:0/3288514321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd610154590 0x7fd610154a40 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd61006fff0 tx=0x7fd60800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:42.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.011+0000 7fd60d600640 1 -- 172.21.15.112:0/3288514321 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd608015430 con 0x7fd610154590 2024-09-12T02:45:42.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.011+0000 7fd60d600640 1 -- 172.21.15.112:0/3288514321 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd60801d070 con 0x7fd610154590 2024-09-12T02:45:42.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.011+0000 7fd60d600640 1 -- 172.21.15.112:0/3288514321 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd608015830 con 0x7fd610154590 2024-09-12T02:45:42.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.011+0000 7fd617600640 1 -- 172.21.15.112:0/3288514321 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd61015aa30 con 0x7fd610154590 2024-09-12T02:45:42.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.011+0000 7fd617600640 1 -- 172.21.15.112:0/3288514321 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd61015aff0 con 0x7fd610154590 2024-09-12T02:45:42.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.012+0000 7fd617600640 1 -- 172.21.15.112:0/3288514321 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd610068a30 con 0x7fd610154590 2024-09-12T02:45:42.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.013+0000 7fd60d600640 1 -- 172.21.15.112:0/3288514321 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd6080159d0 con 0x7fd610154590 2024-09-12T02:45:42.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.014+0000 7fd60d600640 1 --2- 172.21.15.112:0/3288514321 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd5ec06bdd0 0x7fd5ec06e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.014+0000 7fd60d600640 1 -- 172.21.15.112:0/3288514321 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5767+0+0 (secure 0 0 0) 0x7fd60808b8a0 con 0x7fd610154590 2024-09-12T02:45:42.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.014+0000 7fd614c00640 1 --2- 172.21.15.112:0/3288514321 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd5ec06bdd0 0x7fd5ec06e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:42.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.015+0000 7fd614c00640 1 --2- 172.21.15.112:0/3288514321 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd5ec06bdd0 0x7fd5ec06e290 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd600032000 tx=0x7fd60002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:42.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.018+0000 7fd60d600640 1 -- 172.21.15.112:0/3288514321 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd608010040 con 0x7fd610154590 2024-09-12T02:45:42.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.228+0000 7fd617600640 1 -- 172.21.15.112:0/3288514321 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd61006df60 con 0x7fd610154590 2024-09-12T02:45:42.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.228+0000 7fd60d600640 1 -- 172.21.15.112:0/3288514321 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5234 (secure 0 0 0) 0x7fd60805a170 con 0x7fd610154590 2024-09-12T02:45:42.230 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:45:42.230 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":44,"btime":"2024-09-12T02:45:39:811882+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/2773143619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2773143619},{"type":"v1","addr":"172.21.15.137:6834","nonce":2773143619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5186,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2810064950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2810064950},{"type":"v1","addr":"172.21.15.137:6835","nonce":2810064950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5192,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/366104267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":366104267},{"type":"v1","addr":"172.21.15.112:6837","nonce":366104267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:45:36.194908+0000","modified":"2024-09-12T02:45:39.214065+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5545":{"gid":5545,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/1248364583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1248364583},{"type":"v1","addr":"172.21.15.112:6836","nonce":1248364583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5545,"qdb_cluster":[5545]},"id":5}]} 2024-09-12T02:45:42.231 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 44 2024-09-12T02:45:42.231 INFO:tasks.ceph.mds.a.smithi112.stderr:2024-09-12T02:45:42.229+0000 7f8adb400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:45:42.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.230+0000 7fd617600640 1 -- 172.21.15.112:0/3288514321 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd5ec06bdd0 msgr2=0x7fd5ec06e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:42.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.230+0000 7fd617600640 1 --2- 172.21.15.112:0/3288514321 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd5ec06bdd0 0x7fd5ec06e290 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd600032000 tx=0x7fd60002e000 comp rx=0 tx=0).stop 2024-09-12T02:45:42.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.230+0000 7fd617600640 1 -- 172.21.15.112:0/3288514321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd610154590 msgr2=0x7fd610154a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:42.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.230+0000 7fd617600640 1 --2- 172.21.15.112:0/3288514321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd610154590 0x7fd610154a40 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd61006fff0 tx=0x7fd60800f580 comp rx=0 tx=0).stop 2024-09-12T02:45:42.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.230+0000 7fd617600640 1 -- 172.21.15.112:0/3288514321 shutdown_connections 2024-09-12T02:45:42.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.230+0000 7fd617600640 1 --2- 172.21.15.112:0/3288514321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd610154590 0x7fd610154a40 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.230+0000 7fd617600640 1 --2- 172.21.15.112:0/3288514321 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd610156040 0x7fd6101402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.231+0000 7fd617600640 1 --2- 172.21.15.112:0/3288514321 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd5ec06bdd0 0x7fd5ec06e290 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.231+0000 7fd617600640 1 --2- 172.21.15.112:0/3288514321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5f40039e0 0x7fd61015a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.231+0000 7fd617600640 1 -- 172.21.15.112:0/3288514321 >> 172.21.15.112:0/3288514321 conn(0x7fd61006bbd0 msgr2=0x7fd6100732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:42.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.231+0000 7fd617600640 1 -- 172.21.15.112:0/3288514321 shutdown_connections 2024-09-12T02:45:42.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.231+0000 7fd617600640 1 -- 172.21.15.112:0/3288514321 wait complete. 2024-09-12T02:45:42.651 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 44, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:45:36.194908+0000', 'modified': '2024-09-12T02:45:39.214065+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5545}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5545': {'gid': 5545, 'name': 'a', 'rank': 0, 'incarnation': 40, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.112:6836/1248364583', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6835', 'nonce': 1248364583}, {'type': 'v1', 'addr': '172.21.15.112:6836', 'nonce': 1248364583}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5545, 'qdb_cluster': [5545]} 2024-09-12T02:45:42.651 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:45:42.651 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-12T02:45:42.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.805+0000 7fcb30c00640 1 Processor -- start 2024-09-12T02:45:42.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.805+0000 7fcb30c00640 1 -- start start 2024-09-12T02:45:42.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.806+0000 7fcb30c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcb2c0d0370 0x7fcb2c0b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.806+0000 7fcb30c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb2c1627a0 con 0x7fcb2c0d57e0 2024-09-12T02:45:42.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.806+0000 7fcb30c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb2c0d08e0 con 0x7fcb2c1623c0 2024-09-12T02:45:42.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.806+0000 7fcb30c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fcb2c0d0bc0 con 0x7fcb2c0d0370 2024-09-12T02:45:42.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.807+0000 7fcb2be00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fcb2c0d57e0 0x7fcb2c0d1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59094/0 (socket says 172.21.15.112:59094) 2024-09-12T02:45:42.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.807+0000 7fcb22a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcb2c0d0370 0x7fcb2c0b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:42.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.807+0000 7fcb2be00640 1 -- 172.21.15.112:0/2426339032 learned_addr learned my addr 172.21.15.112:0/2426339032 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:45:42.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.807+0000 7fcb22a00640 1 -- 172.21.15.112:0/2426339032 >> v1:172.21.15.137:6789/0 conn(0x7fcb2c1623c0 legacy=0x7fcb2c0d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:42.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.807+0000 7fcb22a00640 1 -- 172.21.15.112:0/2426339032 >> v1:172.21.15.112:6789/0 conn(0x7fcb2c0d57e0 legacy=0x7fcb2c0d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:42.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.807+0000 7fcb22a00640 1 -- 172.21.15.112:0/2426339032 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb2c0d2930 con 0x7fcb2c0d0370 2024-09-12T02:45:42.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.808+0000 7fcb22a00640 1 --2- 172.21.15.112:0/2426339032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb2c0d0370 0x7fcb2c0b4620 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fcb140097a0 tx=0x7fcb1402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43cf6b3bbdd5bdda server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:42.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.808+0000 7fcb2aa00640 1 -- 172.21.15.112:0/2426339032 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb14037070 con 0x7fcb2c0d0370 2024-09-12T02:45:42.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.808+0000 7fcb2aa00640 1 -- 172.21.15.112:0/2426339032 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb14032640 con 0x7fcb2c0d0370 2024-09-12T02:45:42.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.808+0000 7fcb2aa00640 1 -- 172.21.15.112:0/2426339032 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb14032a10 con 0x7fcb2c0d0370 2024-09-12T02:45:42.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.809+0000 7fcb30c00640 1 -- 172.21.15.112:0/2426339032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb2c0d0370 msgr2=0x7fcb2c0b4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:42.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.809+0000 7fcb30c00640 1 --2- 172.21.15.112:0/2426339032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb2c0d0370 0x7fcb2c0b4620 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fcb140097a0 tx=0x7fcb1402a2c0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.809+0000 7fcb30c00640 1 -- 172.21.15.112:0/2426339032 shutdown_connections 2024-09-12T02:45:42.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.809+0000 7fcb30c00640 1 --2- 172.21.15.112:0/2426339032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb2c0d0370 0x7fcb2c0b4620 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.809+0000 7fcb30c00640 1 -- 172.21.15.112:0/2426339032 >> 172.21.15.112:0/2426339032 conn(0x7fcb2c0d4cc0 msgr2=0x7fcb2c0d50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:42.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.809+0000 7fcb30c00640 1 -- 172.21.15.112:0/2426339032 shutdown_connections 2024-09-12T02:45:42.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.809+0000 7fcb30c00640 1 -- 172.21.15.112:0/2426339032 wait complete. 2024-09-12T02:45:42.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.811+0000 7fcb30c00640 1 Processor -- start 2024-09-12T02:45:42.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.811+0000 7fcb30c00640 1 -- start start 2024-09-12T02:45:42.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.812+0000 7fcb30c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcb2c0d0370 0x7fcb2c15e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.812+0000 7fcb30c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb2c0d57e0 0x7fcb2c0ce860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.812+0000 7fcb30c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb2c1623c0 0x7fcb2c160a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.812+0000 7fcb30c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2c0b6460 con 0x7fcb2c0d57e0 2024-09-12T02:45:42.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.812+0000 7fcb30c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2c0d2ef0 con 0x7fcb2c1623c0 2024-09-12T02:45:42.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.812+0000 7fcb30c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fcb2c0b65e0 con 0x7fcb2c0d0370 2024-09-12T02:45:42.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.812+0000 7fcb22a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb2c0d57e0 0x7fcb2c0ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:42.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.812+0000 7fcb22a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb2c0d57e0 0x7fcb2c0ce860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50798/0 (socket says 172.21.15.112:50798) 2024-09-12T02:45:42.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.812+0000 7fcb22a00640 1 -- 172.21.15.112:0/3162581602 learned_addr learned my addr 172.21.15.112:0/3162581602 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:42.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.812+0000 7fcb2be00640 1 --2- 172.21.15.112:0/3162581602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb2c1623c0 0x7fcb2c160a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:42.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.812+0000 7fcb2b400640 1 --2- 172.21.15.112:0/3162581602 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcb2c0d0370 0x7fcb2c15e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:42.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.812+0000 7fcb22a00640 1 -- 172.21.15.112:0/3162581602 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcb2c0d0370 msgr2=0x7fcb2c15e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:42.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.812+0000 7fcb22a00640 1 --2- 172.21.15.112:0/3162581602 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcb2c0d0370 0x7fcb2c15e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.812+0000 7fcb22a00640 1 -- 172.21.15.112:0/3162581602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb2c1623c0 msgr2=0x7fcb2c160a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:42.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.812+0000 7fcb22a00640 1 --2- 172.21.15.112:0/3162581602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb2c1623c0 0x7fcb2c160a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.812+0000 7fcb22a00640 1 -- 172.21.15.112:0/3162581602 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb2c0b7cb0 con 0x7fcb2c0d57e0 2024-09-12T02:45:42.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.813+0000 7fcb22a00640 1 --2- 172.21.15.112:0/3162581602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb2c0d57e0 0x7fcb2c0ce860 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fcb14035040 tx=0x7fcb140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:42.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.813+0000 7fcb23e00640 1 -- 172.21.15.112:0/3162581602 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb14041030 con 0x7fcb2c0d57e0 2024-09-12T02:45:42.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.813+0000 7fcb23e00640 1 -- 172.21.15.112:0/3162581602 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb14030750 con 0x7fcb2c0d57e0 2024-09-12T02:45:42.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.813+0000 7fcb23e00640 1 -- 172.21.15.112:0/3162581602 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb14037040 con 0x7fcb2c0d57e0 2024-09-12T02:45:42.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.813+0000 7fcb30c00640 1 -- 172.21.15.112:0/3162581602 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb2c0b7f90 con 0x7fcb2c0d57e0 2024-09-12T02:45:42.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.813+0000 7fcb30c00640 1 -- 172.21.15.112:0/3162581602 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb2c0b8550 con 0x7fcb2c0d57e0 2024-09-12T02:45:42.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.815+0000 7fcb23e00640 1 -- 172.21.15.112:0/3162581602 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb14044070 con 0x7fcb2c0d57e0 2024-09-12T02:45:42.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.816+0000 7fcb23e00640 1 --2- 172.21.15.112:0/3162581602 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcb0806be30 0x7fcb0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.816+0000 7fcb23e00640 1 -- 172.21.15.112:0/3162581602 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5767+0+0 (secure 0 0 0) 0x7fcb140ab830 con 0x7fcb2c0d57e0 2024-09-12T02:45:42.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.816+0000 7fcb2b400640 1 --2- 172.21.15.112:0/3162581602 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcb0806be30 0x7fcb0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:42.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.816+0000 7fcb2b400640 1 --2- 172.21.15.112:0/3162581602 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcb0806be30 0x7fcb0806e2f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c007fd0 tx=0x7fcb1c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:42.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.817+0000 7fcb35085740 1 Processor -- start 2024-09-12T02:45:42.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.817+0000 7fcb35085740 1 -- start start 2024-09-12T02:45:42.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.817+0000 7fcb35085740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55611ceccea0 0x55611cf12640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.817+0000 7fcb35085740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55611ceca660 0x55611cecd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.817+0000 7fcb35085740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55611cece630 0x55611cec7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.817+0000 7fcb35085740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55611ce2b3b0 con 0x55611ceccea0 2024-09-12T02:45:42.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.817+0000 7fcb35085740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55611ce30410 con 0x55611ceca660 2024-09-12T02:45:42.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.817+0000 7fcb35085740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55611cdd8620 con 0x55611cece630 2024-09-12T02:45:42.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.818+0000 7fcb2b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55611ceccea0 0x55611cf12640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:42.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.818+0000 7fcb2b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55611ceccea0 0x55611cf12640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50812/0 (socket says 172.21.15.112:50812) 2024-09-12T02:45:42.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.818+0000 7fcb2be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55611cece630 0x55611cec7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:42.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.818+0000 7fcb2b400640 1 -- 172.21.15.112:0/1030563675 learned_addr learned my addr 172.21.15.112:0/1030563675 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:42.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.818+0000 7fcb22a00640 1 --2- 172.21.15.112:0/1030563675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55611ceca660 0x55611cecd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:42.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.818+0000 7fcb2b400640 1 -- 172.21.15.112:0/1030563675 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55611cece630 msgr2=0x55611cec7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:42.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.818+0000 7fcb2b400640 1 --2- 172.21.15.112:0/1030563675 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55611cece630 0x55611cec7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.818+0000 7fcb2b400640 1 -- 172.21.15.112:0/1030563675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55611ceca660 msgr2=0x55611cecd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:42.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.818+0000 7fcb2b400640 1 --2- 172.21.15.112:0/1030563675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55611ceca660 0x55611cecd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.818+0000 7fcb2b400640 1 -- 172.21.15.112:0/1030563675 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55611cb432d0 con 0x55611ceccea0 2024-09-12T02:45:42.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.818+0000 7fcb2b400640 1 --2- 172.21.15.112:0/1030563675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55611ceccea0 0x55611cf12640 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c005310 tx=0x7fcb1c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f601c125025b922c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:42.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.819+0000 7fcb1b400640 1 -- 172.21.15.112:0/1030563675 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c021450 con 0x55611ceccea0 2024-09-12T02:45:42.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.819+0000 7fcb1b400640 1 -- 172.21.15.112:0/1030563675 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb1c0215f0 con 0x55611ceccea0 2024-09-12T02:45:42.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.819+0000 7fcb1b400640 1 -- 172.21.15.112:0/1030563675 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c0219a0 con 0x55611ceccea0 2024-09-12T02:45:42.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.819+0000 7fcb35085740 1 -- 172.21.15.112:0/1030563675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55611ceccea0 msgr2=0x55611cf12640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:42.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.819+0000 7fcb35085740 1 --2- 172.21.15.112:0/1030563675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55611ceccea0 0x55611cf12640 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c005310 tx=0x7fcb1c011000 comp rx=0 tx=0).stop 2024-09-12T02:45:42.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.819+0000 7fcb35085740 1 -- 172.21.15.112:0/1030563675 shutdown_connections 2024-09-12T02:45:42.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.819+0000 7fcb35085740 1 --2- 172.21.15.112:0/1030563675 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55611cece630 0x55611cec7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.819+0000 7fcb35085740 1 --2- 172.21.15.112:0/1030563675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55611ceca660 0x55611cecd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.819+0000 7fcb35085740 1 --2- 172.21.15.112:0/1030563675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55611ceccea0 0x55611cf12640 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.819+0000 7fcb35085740 1 -- 172.21.15.112:0/1030563675 >> 172.21.15.112:0/1030563675 conn(0x55611cec98f0 msgr2=0x55611cf11b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:42.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.819+0000 7fcb35085740 1 -- 172.21.15.112:0/1030563675 shutdown_connections 2024-09-12T02:45:42.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.819+0000 7fcb35085740 1 -- 172.21.15.112:0/1030563675 wait complete. 2024-09-12T02:45:42.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.820+0000 7fcb35085740 1 -- start start 2024-09-12T02:45:42.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.820+0000 7fcb35085740 1 Processor -- start 2024-09-12T02:45:42.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.821+0000 7fcb35085740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55611ceccea0 0x55611cef63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.821+0000 7fcb35085740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55611cece630 0x55611cee55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.821+0000 7fcb35085740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55611cf0d590 0x55611cf0ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.821+0000 7fcb35085740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55611cdeb780 con 0x55611ceccea0 2024-09-12T02:45:42.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.821+0000 7fcb35085740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55611ce2c3d0 con 0x55611cece630 2024-09-12T02:45:42.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.821+0000 7fcb35085740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55611cec8d90 con 0x55611cf0d590 2024-09-12T02:45:42.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.822+0000 7fcb35085740 10 client.0 _ll_register_callbacks cb 0x55611ce295d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:45:42.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.822+0000 7fcb2b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55611ceccea0 0x55611cef63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:42.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.822+0000 7fcb2b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55611ceccea0 0x55611cef63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50820/0 (socket says 172.21.15.112:50820) 2024-09-12T02:45:42.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.822+0000 7fcb2b400640 1 -- 172.21.15.112:0/814355800 learned_addr learned my addr 172.21.15.112:0/814355800 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:42.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.822+0000 7fcb2be00640 1 --2- 172.21.15.112:0/814355800 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55611cf0d590 0x55611cf0ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:42.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.822+0000 7fcb22a00640 1 --2- 172.21.15.112:0/814355800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55611cece630 0x55611cee55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:42.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.822+0000 7fcb2b400640 1 -- 172.21.15.112:0/814355800 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55611cf0d590 msgr2=0x55611cf0ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:42.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.822+0000 7fcb2b400640 1 --2- 172.21.15.112:0/814355800 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55611cf0d590 0x55611cf0ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.822+0000 7fcb2b400640 1 -- 172.21.15.112:0/814355800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55611cece630 msgr2=0x55611cee55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:42.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.822+0000 7fcb2b400640 1 --2- 172.21.15.112:0/814355800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55611cece630 0x55611cee55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.822+0000 7fcb2b400640 1 -- 172.21.15.112:0/814355800 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55611cc0d6b0 con 0x55611ceccea0 2024-09-12T02:45:42.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.823+0000 7fcb2b400640 1 --2- 172.21.15.112:0/814355800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55611ceccea0 0x55611cef63c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c0052b0 tx=0x7fcb1c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8e06c80288bbfe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:42.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.823+0000 7fcb0fe00640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-12T02:45:42.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.824+0000 7fcb0fe00640 1 -- 172.21.15.112:0/814355800 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c021450 con 0x55611ceccea0 2024-09-12T02:45:42.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.825+0000 7fcb0fe00640 1 -- 172.21.15.112:0/814355800 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 5767+0+0 (secure 0 0 0) 0x7fcb1c022d70 con 0x55611ceccea0 2024-09-12T02:45:42.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.825+0000 7fcb35085740 1 -- 172.21.15.112:0/814355800 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb1c0215f0 con 0x55611ceccea0 2024-09-12T02:45:42.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.825+0000 7fcb0fe00640 1 -- 172.21.15.112:0/814355800 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fcb1c034050 con 0x55611ceccea0 2024-09-12T02:45:42.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.825+0000 7fcb35085740 10 client.5961 fetch_fsmap learned FSMap version 44 2024-09-12T02:45:42.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.825+0000 7fcb35085740 1 -- 172.21.15.112:0/814355800 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) -- 0x55611cf22b50 con 0x55611ceccea0 2024-09-12T02:45:42.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.825+0000 7fcb0fe00640 1 -- 172.21.15.112:0/814355800 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb1c0215f0 con 0x55611ceccea0 2024-09-12T02:45:42.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.825+0000 7fcb0fe00640 1 -- 172.21.15.112:0/814355800 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 44) ==== 3502+0+0 (secure 0 0 0) 0x7fcb1c037020 con 0x55611ceccea0 2024-09-12T02:45:42.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.825+0000 7fcb35085740 10 client.5961 fetch_fsmap finished waiting for FSMap version 44 2024-09-12T02:45:42.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.825+0000 7fcb35085740 10 client.5961 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T02:45:42.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.825+0000 7fcb35085740 20 client.5961 populate_metadata read hostname 'smithi112' 2024-09-12T02:45:42.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.825+0000 7fcb35085740 1 --2- 172.21.15.112:0/814355800 >> [v2:172.21.15.112:6835/1248364583,v1:172.21.15.112:6836/1248364583] conn(0x55611cef1f20 0x55611cef0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.825+0000 7fcb35085740 4 client.5961 mds_command: new command op to 5545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:45:42.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.825+0000 7fcb35085740 1 -- 172.21.15.112:0/814355800 --> [v2:172.21.15.112:6835/1248364583,v1:172.21.15.112:6836/1248364583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55611ce3db40 con 0x55611cef1f20 2024-09-12T02:45:42.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.826+0000 7fcb22a00640 1 --2- 172.21.15.112:0/814355800 >> [v2:172.21.15.112:6835/1248364583,v1:172.21.15.112:6836/1248364583] conn(0x55611cef1f20 0x55611cef0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:42.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.826+0000 7fcb22a00640 1 --2- 172.21.15.112:0/814355800 >> [v2:172.21.15.112:6835/1248364583,v1:172.21.15.112:6836/1248364583] conn(0x55611cef1f20 0x55611cef0920 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44246fa1d7a935ad server_cookie=d4ba9196f671c558 in_seq=0 out_seq=0 2024-09-12T02:45:42.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.826+0000 7fcb0fe00640 10 client.5961 ms_handle_connect on v2:172.21.15.112:6835/1248364583 2024-09-12T02:45:42.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.827+0000 7fcb0fe00640 1 -- 172.21.15.112:0/814355800 <== mds.0 v2:172.21.15.112:6835/1248364583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55611ce3db40 con 0x55611cef1f20 2024-09-12T02:45:42.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.827+0000 7fcb0fe00640 10 client.5961 handle_command_reply: tid=0 2024-09-12T02:45:42.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.827+0000 7fcb35085740 1 client.5961 shutdown 2024-09-12T02:45:42.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.827+0000 7fcb35085740 1 -- 172.21.15.112:0/814355800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55611ceccea0 msgr2=0x55611cef63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:42.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.827+0000 7fcb35085740 1 --2- 172.21.15.112:0/814355800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55611ceccea0 0x55611cef63c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c0052b0 tx=0x7fcb1c000bc0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.827+0000 7fcb35085740 1 -- 172.21.15.112:0/814355800 shutdown_connections 2024-09-12T02:45:42.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.827+0000 7fcb35085740 1 --2- 172.21.15.112:0/814355800 >> [v2:172.21.15.112:6835/1248364583,v1:172.21.15.112:6836/1248364583] conn(0x55611cef1f20 0x55611cef0920 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.827+0000 7fcb35085740 1 --2- 172.21.15.112:0/814355800 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55611cf0d590 0x55611cf0ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.827+0000 7fcb35085740 1 --2- 172.21.15.112:0/814355800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55611cece630 0x55611cee55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.827+0000 7fcb35085740 1 --2- 172.21.15.112:0/814355800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55611ceccea0 0x55611cef63c0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.827+0000 7fcb0fe00640 0 client.5961 ms_handle_reset on v2:172.21.15.112:6835/1248364583 2024-09-12T02:45:42.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.827+0000 7fcb35085740 1 -- 172.21.15.112:0/814355800 >> 172.21.15.112:0/814355800 conn(0x55611ceca660 msgr2=0x55611cf11100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:42.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.827+0000 7fcb35085740 1 -- 172.21.15.112:0/814355800 shutdown_connections 2024-09-12T02:45:42.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.827+0000 7fcb35085740 1 -- 172.21.15.112:0/814355800 wait complete. 2024-09-12T02:45:42.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.828+0000 7fcb35085740 20 client.5961 trim_cache size 0 max 16384 2024-09-12T02:45:42.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.848+0000 7fcb35085740 1 Processor -- start 2024-09-12T02:45:42.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.848+0000 7fcb35085740 1 -- start start 2024-09-12T02:45:42.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.849+0000 7fcb35085740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55611ceccea0 0x55611cf0fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.849+0000 7fcb35085740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55611cece630 0x55611cec7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.849+0000 7fcb35085740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55611cf0d590 0x55611cec8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.849+0000 7fcb35085740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2c0cd070 con 0x55611cece630 2024-09-12T02:45:42.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.849+0000 7fcb35085740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2c1f90f0 con 0x55611cf0d590 2024-09-12T02:45:42.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.849+0000 7fcb35085740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fcb2c0cca20 con 0x55611ceccea0 2024-09-12T02:45:42.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.849+0000 7fcb22a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55611cece630 0x55611cec7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:42.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.849+0000 7fcb22a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55611cece630 0x55611cec7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50832/0 (socket says 172.21.15.112:50832) 2024-09-12T02:45:42.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.849+0000 7fcb22a00640 1 -- 172.21.15.112:0/2853437763 learned_addr learned my addr 172.21.15.112:0/2853437763 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:42.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.849+0000 7fcb22a00640 1 -- 172.21.15.112:0/2853437763 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55611ceccea0 msgr2=0x55611cf0fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:42.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.849+0000 7fcb22a00640 1 --2- 172.21.15.112:0/2853437763 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55611ceccea0 0x55611cf0fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.849+0000 7fcb22a00640 1 -- 172.21.15.112:0/2853437763 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55611cf0d590 msgr2=0x55611cec8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:42.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.849+0000 7fcb22a00640 1 --2- 172.21.15.112:0/2853437763 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55611cf0d590 0x55611cec8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.849+0000 7fcb22a00640 1 -- 172.21.15.112:0/2853437763 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55611cf0f090 con 0x55611cece630 2024-09-12T02:45:42.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.850+0000 7fcb22a00640 1 --2- 172.21.15.112:0/2853437763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55611cece630 0x55611cec7f20 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fcb14079ab0 tx=0x7fcb1407c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a352ee54a762e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:42.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.850+0000 7fcb1aa00640 1 -- 172.21.15.112:0/2853437763 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb14082700 con 0x55611cece630 2024-09-12T02:45:42.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.850+0000 7fcb1aa00640 1 -- 172.21.15.112:0/2853437763 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb1407ae50 con 0x55611cece630 2024-09-12T02:45:42.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.850+0000 7fcb1aa00640 1 -- 172.21.15.112:0/2853437763 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb14077e20 con 0x55611cece630 2024-09-12T02:45:42.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.850+0000 7fcb35085740 1 -- 172.21.15.112:0/2853437763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55611cece630 msgr2=0x55611cec7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:42.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.850+0000 7fcb35085740 1 --2- 172.21.15.112:0/2853437763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55611cece630 0x55611cec7f20 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fcb14079ab0 tx=0x7fcb1407c040 comp rx=0 tx=0).stop 2024-09-12T02:45:42.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.851+0000 7fcb35085740 1 -- 172.21.15.112:0/2853437763 shutdown_connections 2024-09-12T02:45:42.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.851+0000 7fcb35085740 1 --2- 172.21.15.112:0/2853437763 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55611cf0d590 0x55611cec8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.851+0000 7fcb35085740 1 --2- 172.21.15.112:0/2853437763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55611cece630 0x55611cec7f20 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.851+0000 7fcb35085740 1 --2- 172.21.15.112:0/2853437763 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55611ceccea0 0x55611cf0fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.851+0000 7fcb35085740 1 -- 172.21.15.112:0/2853437763 >> 172.21.15.112:0/2853437763 conn(0x55611ceca660 msgr2=0x55611cee5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:42.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.851+0000 7fcb35085740 1 -- 172.21.15.112:0/2853437763 shutdown_connections 2024-09-12T02:45:42.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.851+0000 7fcb35085740 1 -- 172.21.15.112:0/2853437763 wait complete. 2024-09-12T02:45:42.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.851+0000 7fcb35085740 1 -- start start 2024-09-12T02:45:42.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.851+0000 7fcb35085740 1 Processor -- start 2024-09-12T02:45:42.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.852+0000 7fcb35085740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55611ceccea0 0x55611cf767f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.852+0000 7fcb35085740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55611cece630 0x55611cf0fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.852+0000 7fcb35085740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55611cf0d590 0x55611cf100d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.852+0000 7fcb35085740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55611cef1da0 con 0x55611cf0d590 2024-09-12T02:45:42.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.852+0000 7fcb35085740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55611cef2a10 con 0x55611cece630 2024-09-12T02:45:42.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.852+0000 7fcb35085740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55611cef2390 con 0x55611ceccea0 2024-09-12T02:45:42.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.852+0000 7fcb35085740 10 client.0 _ll_register_callbacks cb 0x7fcb14009400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:45:42.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.853+0000 7fcb2be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55611cf0d590 0x55611cf100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:42.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.853+0000 7fcb2b400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55611ceccea0 0x55611cf767f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:42.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.853+0000 7fcb2be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55611cf0d590 0x55611cf100d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50846/0 (socket says 172.21.15.112:50846) 2024-09-12T02:45:42.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.853+0000 7fcb2be00640 1 -- 172.21.15.112:0/4168287310 learned_addr learned my addr 172.21.15.112:0/4168287310 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:42.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.853+0000 7fcb22a00640 1 --2- 172.21.15.112:0/4168287310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55611cece630 0x55611cf0fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:42.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.853+0000 7fcb2be00640 1 -- 172.21.15.112:0/4168287310 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55611ceccea0 msgr2=0x55611cf767f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:42.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.853+0000 7fcb2be00640 1 --2- 172.21.15.112:0/4168287310 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55611ceccea0 0x55611cf767f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.853+0000 7fcb2be00640 1 -- 172.21.15.112:0/4168287310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55611cece630 msgr2=0x55611cf0fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:42.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.853+0000 7fcb2be00640 1 --2- 172.21.15.112:0/4168287310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55611cece630 0x55611cf0fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.853+0000 7fcb2be00640 1 -- 172.21.15.112:0/4168287310 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55611cec9690 con 0x55611cf0d590 2024-09-12T02:45:42.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.853+0000 7fcb2be00640 1 --2- 172.21.15.112:0/4168287310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55611cf0d590 0x55611cf100d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fcb24014930 tx=0x7fcb24014df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9fc7bd7d65dce58 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:42.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.853+0000 7fcb0fe00640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-12T02:45:42.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.854+0000 7fcb0fe00640 1 -- 172.21.15.112:0/4168287310 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2401a070 con 0x55611cf0d590 2024-09-12T02:45:42.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.854+0000 7fcb0fe00640 1 -- 172.21.15.112:0/4168287310 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 5767+0+0 (secure 0 0 0) 0x7fcb24012a70 con 0x55611cf0d590 2024-09-12T02:45:42.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.854+0000 7fcb35085740 1 -- 172.21.15.112:0/4168287310 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb1407ae50 con 0x55611cf0d590 2024-09-12T02:45:42.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.854+0000 7fcb0fe00640 1 -- 172.21.15.112:0/4168287310 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fcb24025050 con 0x55611cf0d590 2024-09-12T02:45:42.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.854+0000 7fcb35085740 10 client.5967 fetch_fsmap learned FSMap version 44 2024-09-12T02:45:42.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.854+0000 7fcb35085740 1 -- 172.21.15.112:0/4168287310 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) -- 0x55611cf94350 con 0x55611cf0d590 2024-09-12T02:45:42.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.854+0000 7fcb0fe00640 1 -- 172.21.15.112:0/4168287310 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb1407ae50 con 0x55611cf0d590 2024-09-12T02:45:42.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.854+0000 7fcb0fe00640 1 -- 172.21.15.112:0/4168287310 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 44) ==== 3502+0+0 (secure 0 0 0) 0x7fcb24028020 con 0x55611cf0d590 2024-09-12T02:45:42.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.854+0000 7fcb35085740 10 client.5967 fetch_fsmap finished waiting for FSMap version 44 2024-09-12T02:45:42.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.854+0000 7fcb35085740 10 client.5967 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T02:45:42.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.854+0000 7fcb35085740 20 client.5967 populate_metadata read hostname 'smithi112' 2024-09-12T02:45:42.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.854+0000 7fcb35085740 1 --2- 172.21.15.112:0/4168287310 >> [v2:172.21.15.112:6835/1248364583,v1:172.21.15.112:6836/1248364583] conn(0x55611cf0c760 0x55611cef4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.854+0000 7fcb35085740 4 client.5967 mds_command: new command op to 5545 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:45:42.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.854+0000 7fcb35085740 1 -- 172.21.15.112:0/4168287310 --> [v2:172.21.15.112:6835/1248364583,v1:172.21.15.112:6836/1248364583] -- command(tid 0: {"prefix": "status"}) -- 0x55611ce37e90 con 0x55611cf0c760 2024-09-12T02:45:42.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.854+0000 7fcb2b400640 1 --2- 172.21.15.112:0/4168287310 >> [v2:172.21.15.112:6835/1248364583,v1:172.21.15.112:6836/1248364583] conn(0x55611cf0c760 0x55611cef4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:42.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.855+0000 7fcb2b400640 1 --2- 172.21.15.112:0/4168287310 >> [v2:172.21.15.112:6835/1248364583,v1:172.21.15.112:6836/1248364583] conn(0x55611cf0c760 0x55611cef4880 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fe46ed13cbeb66e server_cookie=a33b6c6c97ab917d in_seq=0 out_seq=0 2024-09-12T02:45:42.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.855+0000 7fcb0fe00640 10 client.5967 ms_handle_connect on v2:172.21.15.112:6835/1248364583 2024-09-12T02:45:42.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.855+0000 7fcb0fe00640 1 -- 172.21.15.112:0/4168287310 <== mds.0 v2:172.21.15.112:6835/1248364583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55611ce37e90 con 0x55611cf0c760 2024-09-12T02:45:42.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.855+0000 7fcb0fe00640 10 client.5967 handle_command_reply: tid=0 2024-09-12T02:45:42.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.855+0000 7fcb35085740 1 client.5967 shutdown 2024-09-12T02:45:42.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.855+0000 7fcb35085740 1 -- 172.21.15.112:0/4168287310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55611cf0d590 msgr2=0x55611cf100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:42.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.855+0000 7fcb35085740 1 --2- 172.21.15.112:0/4168287310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55611cf0d590 0x55611cf100d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fcb24014930 tx=0x7fcb24014df0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.855+0000 7fcb35085740 1 -- 172.21.15.112:0/4168287310 shutdown_connections 2024-09-12T02:45:42.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.855+0000 7fcb35085740 1 --2- 172.21.15.112:0/4168287310 >> [v2:172.21.15.112:6835/1248364583,v1:172.21.15.112:6836/1248364583] conn(0x55611cf0c760 0x55611cef4880 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.855+0000 7fcb35085740 1 --2- 172.21.15.112:0/4168287310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55611cf0d590 0x55611cf100d0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.855+0000 7fcb35085740 1 --2- 172.21.15.112:0/4168287310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55611cece630 0x55611cf0fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.855+0000 7fcb35085740 1 --2- 172.21.15.112:0/4168287310 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55611ceccea0 0x55611cf767f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.855+0000 7fcb35085740 1 -- 172.21.15.112:0/4168287310 >> 172.21.15.112:0/4168287310 conn(0x55611ceca660 msgr2=0x55611cec2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:42.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.855+0000 7fcb0fe00640 0 client.5967 ms_handle_reset on v2:172.21.15.112:6835/1248364583 2024-09-12T02:45:42.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.856+0000 7fcb35085740 1 -- 172.21.15.112:0/4168287310 shutdown_connections 2024-09-12T02:45:42.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.856+0000 7fcb35085740 1 -- 172.21.15.112:0/4168287310 wait complete. 2024-09-12T02:45:42.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.856+0000 7fcb35085740 20 client.5967 trim_cache size 0 max 16384 2024-09-12T02:45:42.861 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:45:42.861 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:45:42.861 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2024-09-12T02:45:42.861 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 5545, 2024-09-12T02:45:42.861 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2024-09-12T02:45:42.861 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2024-09-12T02:45:42.861 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2024-09-12T02:45:42.861 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 6.071326741, 2024-09-12T02:45:42.861 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 44, 2024-09-12T02:45:42.861 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 81, 2024-09-12T02:45:42.861 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 79, 2024-09-12T02:45:42.861 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 11.161965261000001 2024-09-12T02:45:42.861 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:45:42.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.856+0000 7fcb30c00640 1 -- 172.21.15.112:0/3162581602 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcb0806be30 msgr2=0x7fcb0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:42.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.856+0000 7fcb30c00640 1 --2- 172.21.15.112:0/3162581602 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcb0806be30 0x7fcb0806e2f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c007fd0 tx=0x7fcb1c009040 comp rx=0 tx=0).stop 2024-09-12T02:45:42.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.856+0000 7fcb30c00640 1 -- 172.21.15.112:0/3162581602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb2c0d57e0 msgr2=0x7fcb2c0ce860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:42.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.856+0000 7fcb30c00640 1 --2- 172.21.15.112:0/3162581602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb2c0d57e0 0x7fcb2c0ce860 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fcb14035040 tx=0x7fcb140046c0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.856+0000 7fcb30c00640 1 -- 172.21.15.112:0/3162581602 shutdown_connections 2024-09-12T02:45:42.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.856+0000 7fcb30c00640 1 --2- 172.21.15.112:0/3162581602 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcb0806be30 0x7fcb0806e2f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.856+0000 7fcb30c00640 1 --2- 172.21.15.112:0/3162581602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb2c1623c0 0x7fcb2c160a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.856+0000 7fcb30c00640 1 --2- 172.21.15.112:0/3162581602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb2c0d57e0 0x7fcb2c0ce860 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.856+0000 7fcb30c00640 1 --2- 172.21.15.112:0/3162581602 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcb2c0d0370 0x7fcb2c15e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.856+0000 7fcb30c00640 1 -- 172.21.15.112:0/3162581602 >> 172.21.15.112:0/3162581602 conn(0x7fcb2c0d4cc0 msgr2=0x7fcb2c15ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:42.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.857+0000 7fcb30c00640 1 -- 172.21.15.112:0/3162581602 shutdown_connections 2024-09-12T02:45:42.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:42.857+0000 7fcb30c00640 1 -- 172.21.15.112:0/3162581602 wait complete. 2024-09-12T02:45:42.872 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:45:43.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.024+0000 7fb2cfa00640 1 Processor -- start 2024-09-12T02:45:43.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.024+0000 7fb2cfa00640 1 -- start start 2024-09-12T02:45:43.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.025+0000 7fb2cfa00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb2c815cc50 0x7fb2c80732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:43.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.025+0000 7fb2cfa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb2c80afe30 0x7fb2c80cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:43.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.025+0000 7fb2cfa00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2c8073830 con 0x7fb2c8071530 2024-09-12T02:45:43.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.026+0000 7fb2cfa00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb2c815d030 con 0x7fb2c815cc50 2024-09-12T02:45:43.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.026+0000 7fb2cfa00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb2c80cf4c0 con 0x7fb2c80afe30 2024-09-12T02:45:43.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.026+0000 7fb2cd000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb2c815cc50 0x7fb2c80732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:43.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.026+0000 7fb2bfe00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb2c8071530 0x7fb2c80af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59096/0 (socket says 172.21.15.112:59096) 2024-09-12T02:45:43.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.026+0000 7fb2bfe00640 1 -- 172.21.15.112:0/1867300393 learned_addr learned my addr 172.21.15.112:0/1867300393 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:45:43.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.026+0000 7fb2cda00640 1 --2- 172.21.15.112:0/1867300393 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb2c80afe30 0x7fb2c80cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:43.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.026+0000 7fb2cd000640 1 -- 172.21.15.112:0/1867300393 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb2c80afe30 msgr2=0x7fb2c80cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:43.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.026+0000 7fb2cd000640 1 --2- 172.21.15.112:0/1867300393 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb2c80afe30 0x7fb2c80cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:43.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.026+0000 7fb2cd000640 1 -- 172.21.15.112:0/1867300393 >> v1:172.21.15.112:6789/0 conn(0x7fb2c8071530 legacy=0x7fb2c80af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:43.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.026+0000 7fb2cd000640 1 -- 172.21.15.112:0/1867300393 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c80ceeb0 con 0x7fb2c815cc50 2024-09-12T02:45:43.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.026+0000 7fb2c7e00640 1 -- 172.21.15.112:0/1867300393 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1799030682 0 0) 0x7fb2b0001290 con 0x7fb2c8071530 2024-09-12T02:45:43.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.027+0000 7fb2cd000640 1 --2- 172.21.15.112:0/1867300393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2c815cc50 0x7fb2c80732f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb2b80097a0 tx=0x7fb2b802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2583a1a1b3c306f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:43.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.027+0000 7fb2c7e00640 1 -- 172.21.15.112:0/1867300393 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b8037070 con 0x7fb2c815cc50 2024-09-12T02:45:43.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.028+0000 7fb2c7e00640 1 -- 172.21.15.112:0/1867300393 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b802ae50 con 0x7fb2c815cc50 2024-09-12T02:45:43.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.028+0000 7fb2c7e00640 1 -- 172.21.15.112:0/1867300393 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b8032660 con 0x7fb2c815cc50 2024-09-12T02:45:43.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.028+0000 7fb2cfa00640 1 -- 172.21.15.112:0/1867300393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2c815cc50 msgr2=0x7fb2c80732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:43.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.028+0000 7fb2cfa00640 1 --2- 172.21.15.112:0/1867300393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2c815cc50 0x7fb2c80732f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb2b80097a0 tx=0x7fb2b802a100 comp rx=0 tx=0).stop 2024-09-12T02:45:43.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.028+0000 7fb2cfa00640 1 -- 172.21.15.112:0/1867300393 shutdown_connections 2024-09-12T02:45:43.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.028+0000 7fb2cfa00640 1 --2- 172.21.15.112:0/1867300393 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb2c80afe30 0x7fb2c80cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:43.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.028+0000 7fb2cfa00640 1 --2- 172.21.15.112:0/1867300393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2c815cc50 0x7fb2c80732f0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:43.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.028+0000 7fb2cfa00640 1 -- 172.21.15.112:0/1867300393 >> 172.21.15.112:0/1867300393 conn(0x7fb2c806bbd0 msgr2=0x7fb2c806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:43.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.028+0000 7fb2cfa00640 1 -- 172.21.15.112:0/1867300393 shutdown_connections 2024-09-12T02:45:43.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.028+0000 7fb2cfa00640 1 -- 172.21.15.112:0/1867300393 wait complete. 2024-09-12T02:45:43.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.030+0000 7fb2cfa00640 1 Processor -- start 2024-09-12T02:45:43.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.030+0000 7fb2cfa00640 1 -- start start 2024-09-12T02:45:43.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.031+0000 7fb2cfa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb2c8071530 0x7fb2c8148530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:43.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.031+0000 7fb2cfa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2c80afe30 0x7fb2c80ac0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:43.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.031+0000 7fb2cfa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2c815cc50 0x7fb2c80ac5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:43.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.031+0000 7fb2cfa00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c80cf150 con 0x7fb2c80afe30 2024-09-12T02:45:43.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.031+0000 7fb2cfa00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c806e5e0 con 0x7fb2c815cc50 2024-09-12T02:45:43.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.031+0000 7fb2cfa00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb2c806f510 con 0x7fb2c8071530 2024-09-12T02:45:43.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.031+0000 7fb2bfe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2c80afe30 0x7fb2c80ac0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:43.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.031+0000 7fb2bfe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2c80afe30 0x7fb2c80ac0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50870/0 (socket says 172.21.15.112:50870) 2024-09-12T02:45:43.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.031+0000 7fb2bfe00640 1 -- 172.21.15.112:0/1237952434 learned_addr learned my addr 172.21.15.112:0/1237952434 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:43.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.031+0000 7fb2cda00640 1 --2- 172.21.15.112:0/1237952434 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2c815cc50 0x7fb2c80ac5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:43.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.031+0000 7fb2cd000640 1 --2- 172.21.15.112:0/1237952434 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb2c8071530 0x7fb2c8148530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:43.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.032+0000 7fb2bfe00640 1 -- 172.21.15.112:0/1237952434 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb2c8071530 msgr2=0x7fb2c8148530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:43.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.032+0000 7fb2bfe00640 1 --2- 172.21.15.112:0/1237952434 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb2c8071530 0x7fb2c8148530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:43.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.032+0000 7fb2bfe00640 1 -- 172.21.15.112:0/1237952434 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2c815cc50 msgr2=0x7fb2c80ac5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:43.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.032+0000 7fb2bfe00640 1 --2- 172.21.15.112:0/1237952434 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2c815cc50 0x7fb2c80ac5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:43.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.032+0000 7fb2bfe00640 1 -- 172.21.15.112:0/1237952434 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c8148a70 con 0x7fb2c80afe30 2024-09-12T02:45:43.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.032+0000 7fb2cd000640 1 --2- 172.21.15.112:0/1237952434 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb2c8071530 0x7fb2c8148530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:45:43.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.032+0000 7fb2cda00640 1 --2- 172.21.15.112:0/1237952434 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2c815cc50 0x7fb2c80ac5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:45:43.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.032+0000 7fb2bfe00640 1 --2- 172.21.15.112:0/1237952434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2c80afe30 0x7fb2c80ac0b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000c4d0 tx=0x7fb2b000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:43.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.032+0000 7fb2c5600640 1 -- 172.21.15.112:0/1237952434 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0007480 con 0x7fb2c80afe30 2024-09-12T02:45:43.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.032+0000 7fb2c5600640 1 -- 172.21.15.112:0/1237952434 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b0007620 con 0x7fb2c80afe30 2024-09-12T02:45:43.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.032+0000 7fb2c5600640 1 -- 172.21.15.112:0/1237952434 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b00059c0 con 0x7fb2c80afe30 2024-09-12T02:45:43.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.032+0000 7fb2cfa00640 1 -- 172.21.15.112:0/1237952434 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2c80ab460 con 0x7fb2c80afe30 2024-09-12T02:45:43.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.032+0000 7fb2cfa00640 1 -- 172.21.15.112:0/1237952434 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2c80abd00 con 0x7fb2c80afe30 2024-09-12T02:45:43.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.033+0000 7fb2cfa00640 1 -- 172.21.15.112:0/1237952434 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2c8068a30 con 0x7fb2c80afe30 2024-09-12T02:45:43.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.034+0000 7fb2c5600640 1 -- 172.21.15.112:0/1237952434 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb2b0005b60 con 0x7fb2c80afe30 2024-09-12T02:45:43.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.035+0000 7fb2c5600640 1 --2- 172.21.15.112:0/1237952434 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb2a406be30 0x7fb2a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:43.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.035+0000 7fb2c5600640 1 -- 172.21.15.112:0/1237952434 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5767+0+0 (secure 0 0 0) 0x7fb2b008ab20 con 0x7fb2c80afe30 2024-09-12T02:45:43.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.035+0000 7fb2cd000640 1 --2- 172.21.15.112:0/1237952434 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb2a406be30 0x7fb2a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:43.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.036+0000 7fb2cd000640 1 --2- 172.21.15.112:0/1237952434 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb2a406be30 0x7fb2a406e2f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8034000 tx=0x7fb2b802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:43.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.040+0000 7fb2c5600640 1 -- 172.21.15.112:0/1237952434 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb2c8073830 con 0x7fb2c80afe30 2024-09-12T02:45:43.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.245+0000 7fb2cfa00640 1 -- 172.21.15.112:0/1237952434 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb2c80730d0 con 0x7fb2c80afe30 2024-09-12T02:45:43.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.246+0000 7fb2c5600640 1 -- 172.21.15.112:0/1237952434 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v44) ==== 53+0+73 (secure 0 0 0) 0x7fb2b00182b0 con 0x7fb2c80afe30 2024-09-12T02:45:43.267 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:45:43.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.248+0000 7fb2cfa00640 1 -- 172.21.15.112:0/1237952434 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb2a406be30 msgr2=0x7fb2a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:43.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.248+0000 7fb2cfa00640 1 --2- 172.21.15.112:0/1237952434 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb2a406be30 0x7fb2a406e2f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8034000 tx=0x7fb2b802e000 comp rx=0 tx=0).stop 2024-09-12T02:45:43.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.248+0000 7fb2cfa00640 1 -- 172.21.15.112:0/1237952434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2c80afe30 msgr2=0x7fb2c80ac0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:43.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.248+0000 7fb2cfa00640 1 --2- 172.21.15.112:0/1237952434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2c80afe30 0x7fb2c80ac0b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000c4d0 tx=0x7fb2b000c990 comp rx=0 tx=0).stop 2024-09-12T02:45:43.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.248+0000 7fb2cfa00640 1 -- 172.21.15.112:0/1237952434 shutdown_connections 2024-09-12T02:45:43.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.248+0000 7fb2cfa00640 1 --2- 172.21.15.112:0/1237952434 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb2a406be30 0x7fb2a406e2f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:43.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.248+0000 7fb2cfa00640 1 --2- 172.21.15.112:0/1237952434 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2c815cc50 0x7fb2c80ac5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:43.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.248+0000 7fb2cfa00640 1 --2- 172.21.15.112:0/1237952434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2c80afe30 0x7fb2c80ac0b0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:43.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.248+0000 7fb2cfa00640 1 --2- 172.21.15.112:0/1237952434 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb2c8071530 0x7fb2c8148530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:43.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.248+0000 7fb2cfa00640 1 -- 172.21.15.112:0/1237952434 >> 172.21.15.112:0/1237952434 conn(0x7fb2c806bbd0 msgr2=0x7fb2c806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:43.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.248+0000 7fb2cfa00640 1 -- 172.21.15.112:0/1237952434 shutdown_connections 2024-09-12T02:45:43.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43.248+0000 7fb2cfa00640 1 -- 172.21.15.112:0/1237952434 wait complete. 2024-09-12T02:45:43.273 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:45:43.273 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:45:43.273 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-09-12T02:45:43.273 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:45:43.273 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:45:43.273 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:45:43.273 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:45:43.273 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:45:43.273 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:45:43.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:45:43.274 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-09-12T02:45:43.321 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:45:43.321 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:45:43.322 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:45:43.322 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:45:43.322 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-12T02:45:43.322 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:45:43.322 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:45:43.322 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-09-12T02:45:43.322 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-09-12T02:45:43.322 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:45:43.322 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-09-12T02:45:43.322 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-09-12T02:45:43.322 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:45:43.322 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:45:43.322 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:45:43.322 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:45:43.323 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:45:43.323 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42535sec preferred_lft 42535sec 2024-09-12T02:45:43.323 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link noprefixroute 2024-09-12T02:45:43.323 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:45:43.323 INFO:teuthology.orchestra.run.smithi112.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:45:43.323 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 4e:56:d4:fc:33:ba brd ff:ff:ff:ff:ff:ff 2024-09-12T02:45:43.323 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:45:43.323 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:45:43.323 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::787f:67ff:fe10:c915/64 scope link 2024-09-12T02:45:43.323 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:45:43.323 INFO:teuthology.orchestra.run.smithi112.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:45:43.323 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 4e:56:d4:fc:33:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:45:43.323 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::4c56:d4ff:fefc:33ba/64 scope link 2024-09-12T02:45:43.323 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:45:43.324 INFO:teuthology.orchestra.run.smithi112.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:45:43.324 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 86:ed:0e:b6:37:5f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:45:43.324 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::84ed:eff:feb6:375f/64 scope link 2024-09-12T02:45:43.324 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:45:43.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:45:43.324 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:45:43.431 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-12T02:45:43.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:45:43.434 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-09-12T02:45:43.471 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-09-12T02:45:43.471 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:45:43.471 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:45:43.471 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:45:43.471 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:45:43.472 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:45:43.472 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-12T02:45:43.472 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:45:43.472 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:45:43.472 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:45:43.472 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-12T02:45:43.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:45:43.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:45:43.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:45:43.675 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-12T02:45:43.710 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:45:43.710 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:45:43.710 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:45:43.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:45:43.711 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2024-09-12T02:45:43.809 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:45:43.809 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:45:43.844 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:45:43.845 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:45:43.845 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:45:43.920 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T02:45:43.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:45:43.920 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:45:44.049 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:45:44.049 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:45:44.074 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:45:44.074 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:45:44.075 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-09-12T02:45:44.075 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 0@7c01f3b3-dec2-4449-a33f-f960d7527ea6.cephfs=/ 2024-09-12T02:45:44.075 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.112:3300/172.21.15.137:3300/172.21.15.137:3301" will pass to kernel 2024-09-12T02:45:44.076 INFO:teuthology.orchestra.run.smithi112.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:45:44.076 INFO:teuthology.orchestra.run.smithi112.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:45:44.076 INFO:teuthology.orchestra.run.smithi112.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:45:44.076 INFO:teuthology.orchestra.run.smithi112.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:45:44.076 INFO:teuthology.orchestra.run.smithi112.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:45:44.079 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:45:44.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:45:44.079 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:45:44.135 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:45:44.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:45:44.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:45:44.232 INFO:teuthology.orchestra.run.smithi112.stdout:client5650 2024-09-12T02:45:44.232 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:45:44.232 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:45:44.268 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:45:44.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.460+0000 7fba3d400640 1 Processor -- start 2024-09-12T02:45:44.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.461+0000 7fba3d400640 1 -- start start 2024-09-12T02:45:44.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.462+0000 7fba3d400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba3815cc50 0x7fba380732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:44.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.462+0000 7fba3d400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fba38071530 0x7fba380af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:44.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.462+0000 7fba3d400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba38073830 con 0x7fba38071970 2024-09-12T02:45:44.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.462+0000 7fba3d400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fba3815d030 con 0x7fba38071530 2024-09-12T02:45:44.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.462+0000 7fba3d400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fba380cf4c0 con 0x7fba3815cc50 2024-09-12T02:45:44.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.462+0000 7fba37200640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fba38071970 0x7fba380cf950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59098/0 (socket says 172.21.15.112:59098) 2024-09-12T02:45:44.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.462+0000 7fba37200640 1 -- 172.21.15.112:0/2459953478 learned_addr learned my addr 172.21.15.112:0/2459953478 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:45:44.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.462+0000 7fba36800640 1 --2- 172.21.15.112:0/2459953478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba3815cc50 0x7fba380732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:44.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.462+0000 7fba2de00640 1 --2- 172.21.15.112:0/2459953478 >> v2:172.21.15.137:3300/0 conn(0x7fba38071530 0x7fba380af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:44.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.463+0000 7fba35e00640 1 -- 172.21.15.112:0/2459953478 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3858528272 0 0) 0x7fba30001490 con 0x7fba38071970 2024-09-12T02:45:44.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.463+0000 7fba35e00640 1 -- 172.21.15.112:0/2459953478 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba1c003520 con 0x7fba38071970 2024-09-12T02:45:44.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.463+0000 7fba35e00640 1 -- 172.21.15.112:0/2459953478 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4248186786 0 0) 0x7fba1c003520 con 0x7fba38071970 2024-09-12T02:45:44.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.463+0000 7fba35e00640 1 -- 172.21.15.112:0/2459953478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba3815cc50 msgr2=0x7fba380732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:44.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.463+0000 7fba35e00640 1 --2- 172.21.15.112:0/2459953478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba3815cc50 0x7fba380732f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:44.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.463+0000 7fba35e00640 1 -- 172.21.15.112:0/2459953478 >> v2:172.21.15.137:3300/0 conn(0x7fba38071530 msgr2=0x7fba380af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:44.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.463+0000 7fba35e00640 1 --2- 172.21.15.112:0/2459953478 >> v2:172.21.15.137:3300/0 conn(0x7fba38071530 0x7fba380af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:44.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.463+0000 7fba35e00640 1 -- 172.21.15.112:0/2459953478 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba380ceeb0 con 0x7fba38071970 2024-09-12T02:45:44.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.463+0000 7fba35e00640 1 -- 172.21.15.112:0/2459953478 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7fba30001bc0 con 0x7fba38071970 2024-09-12T02:45:44.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.463+0000 7fba35e00640 1 -- 172.21.15.112:0/2459953478 >> v1:172.21.15.112:6789/0 conn(0x7fba38071970 legacy=0x7fba380cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:44.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.463+0000 7fba35e00640 1 --2- 172.21.15.112:0/2459953478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba1c0039b0 0x7fba1c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:44.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.463+0000 7fba35e00640 1 --2- 172.21.15.112:0/2459953478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba1c004800 0x7fba1c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:44.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.463+0000 7fba35e00640 1 --2- 172.21.15.112:0/2459953478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba3815cc50 0x7fba1c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:44.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.463+0000 7fba35e00640 1 -- 172.21.15.112:0/2459953478 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fba380cf4c0 con 0x7fba1c0039b0 2024-09-12T02:45:44.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.463+0000 7fba35e00640 1 -- 172.21.15.112:0/2459953478 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fba1c00b9c0 con 0x7fba1c004800 2024-09-12T02:45:44.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.463+0000 7fba35e00640 1 -- 172.21.15.112:0/2459953478 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fba1c00bb40 con 0x7fba3815cc50 2024-09-12T02:45:44.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.463+0000 7fba36800640 1 --2- 172.21.15.112:0/2459953478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba1c0039b0 0x7fba1c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:44.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.463+0000 7fba2de00640 1 --2- 172.21.15.112:0/2459953478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba1c004800 0x7fba1c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:44.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.463+0000 7fba37200640 1 --2- 172.21.15.112:0/2459953478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba3815cc50 0x7fba1c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:44.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.464+0000 7fba36800640 1 -- 172.21.15.112:0/2459953478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba3815cc50 msgr2=0x7fba1c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:44.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.464+0000 7fba36800640 1 --2- 172.21.15.112:0/2459953478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba3815cc50 0x7fba1c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:44.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.464+0000 7fba36800640 1 -- 172.21.15.112:0/2459953478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba1c004800 msgr2=0x7fba1c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:45:44.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.464+0000 7fba36800640 1 --2- 172.21.15.112:0/2459953478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba1c004800 0x7fba1c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:44.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.464+0000 7fba36800640 1 -- 172.21.15.112:0/2459953478 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba1c003520 con 0x7fba1c0039b0 2024-09-12T02:45:44.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.464+0000 7fba37200640 1 --2- 172.21.15.112:0/2459953478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba3815cc50 0x7fba1c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:45:44.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.465+0000 7fba36800640 1 --2- 172.21.15.112:0/2459953478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba1c0039b0 0x7fba1c003dd0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fba28009af0 tx=0x7fba1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea03923578e0fd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:44.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.465+0000 7fba35e00640 1 -- 172.21.15.112:0/2459953478 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba28036070 con 0x7fba1c0039b0 2024-09-12T02:45:44.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.465+0000 7fba35e00640 1 -- 172.21.15.112:0/2459953478 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba28031400 con 0x7fba1c0039b0 2024-09-12T02:45:44.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.465+0000 7fba35e00640 1 -- 172.21.15.112:0/2459953478 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba28009690 con 0x7fba1c0039b0 2024-09-12T02:45:44.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.465+0000 7fba3d400640 1 -- 172.21.15.112:0/2459953478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba1c0039b0 msgr2=0x7fba1c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:44.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.465+0000 7fba3d400640 1 --2- 172.21.15.112:0/2459953478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba1c0039b0 0x7fba1c003dd0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fba28009af0 tx=0x7fba1c005830 comp rx=0 tx=0).stop 2024-09-12T02:45:44.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.465+0000 7fba37200640 1 -- 172.21.15.112:0/2459953478 reap_dead start 2024-09-12T02:45:44.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.466+0000 7fba3d400640 1 -- 172.21.15.112:0/2459953478 shutdown_connections 2024-09-12T02:45:44.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.466+0000 7fba3d400640 1 -- 172.21.15.112:0/2459953478 >> 172.21.15.112:0/2459953478 conn(0x7fba3806bbd0 msgr2=0x7fba3806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:44.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.466+0000 7fba3d400640 1 -- 172.21.15.112:0/2459953478 shutdown_connections 2024-09-12T02:45:44.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.466+0000 7fba3d400640 1 -- 172.21.15.112:0/2459953478 wait complete. 2024-09-12T02:45:44.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.467+0000 7fba3d400640 1 Processor -- start 2024-09-12T02:45:44.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.467+0000 7fba3d400640 1 -- start start 2024-09-12T02:45:44.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.468+0000 7fba3d400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba1c0039b0 0x7fba38152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:44.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.468+0000 7fba3d400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba38159990 0x7fba380b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:44.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.468+0000 7fba3d400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba381551f0 0x7fba38155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:44.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.468+0000 7fba3d400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fba380cf150 con 0x7fba1c0039b0 2024-09-12T02:45:44.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.468+0000 7fba3d400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fba3806e5e0 con 0x7fba381551f0 2024-09-12T02:45:44.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.468+0000 7fba3d400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fba3806f510 con 0x7fba38159990 2024-09-12T02:45:44.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.468+0000 7fba36800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba1c0039b0 0x7fba38152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:44.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.468+0000 7fba36800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba1c0039b0 0x7fba38152e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50896/0 (socket says 172.21.15.112:50896) 2024-09-12T02:45:44.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.468+0000 7fba36800640 1 -- 172.21.15.112:0/2184686748 learned_addr learned my addr 172.21.15.112:0/2184686748 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:44.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.469+0000 7fba37200640 1 --2- 172.21.15.112:0/2184686748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba381551f0 0x7fba38155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:44.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.469+0000 7fba2de00640 1 --2- 172.21.15.112:0/2184686748 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba38159990 0x7fba380b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:44.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.469+0000 7fba36800640 1 -- 172.21.15.112:0/2184686748 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba38159990 msgr2=0x7fba380b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:44.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.469+0000 7fba36800640 1 --2- 172.21.15.112:0/2184686748 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba38159990 0x7fba380b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:44.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.469+0000 7fba36800640 1 -- 172.21.15.112:0/2184686748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba381551f0 msgr2=0x7fba38155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:44.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.469+0000 7fba36800640 1 --2- 172.21.15.112:0/2184686748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba381551f0 0x7fba38155680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:44.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.469+0000 7fba36800640 1 -- 172.21.15.112:0/2184686748 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba38153770 con 0x7fba1c0039b0 2024-09-12T02:45:44.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.469+0000 7fba37200640 1 --2- 172.21.15.112:0/2184686748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba381551f0 0x7fba38155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:45:44.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.469+0000 7fba36800640 1 --2- 172.21.15.112:0/2184686748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba1c0039b0 0x7fba38152e20 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fba28034040 tx=0x7fba28004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:44.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.469+0000 7fba2f400640 1 -- 172.21.15.112:0/2184686748 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba28041020 con 0x7fba1c0039b0 2024-09-12T02:45:44.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.469+0000 7fba2f400640 1 -- 172.21.15.112:0/2184686748 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba2803c470 con 0x7fba1c0039b0 2024-09-12T02:45:44.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.469+0000 7fba3d400640 1 -- 172.21.15.112:0/2184686748 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba38153a50 con 0x7fba1c0039b0 2024-09-12T02:45:44.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.469+0000 7fba2f400640 1 -- 172.21.15.112:0/2184686748 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba28036040 con 0x7fba1c0039b0 2024-09-12T02:45:44.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.470+0000 7fba3d400640 1 -- 172.21.15.112:0/2184686748 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba3815b4e0 con 0x7fba1c0039b0 2024-09-12T02:45:44.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.471+0000 7fba3d400640 1 -- 172.21.15.112:0/2184686748 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba3806df60 con 0x7fba1c0039b0 2024-09-12T02:45:44.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.471+0000 7fba2f400640 1 -- 172.21.15.112:0/2184686748 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba28044020 con 0x7fba1c0039b0 2024-09-12T02:45:44.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.472+0000 7fba2f400640 1 --2- 172.21.15.112:0/2184686748 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fba1406be30 0x7fba1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:44.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.472+0000 7fba2f400640 1 -- 172.21.15.112:0/2184686748 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5767+0+0 (secure 0 0 0) 0x7fba280ab720 con 0x7fba1c0039b0 2024-09-12T02:45:44.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.472+0000 7fba2de00640 1 --2- 172.21.15.112:0/2184686748 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fba1406be30 0x7fba1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:44.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.473+0000 7fba2de00640 1 --2- 172.21.15.112:0/2184686748 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fba1406be30 0x7fba1406e2f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fba380b4890 tx=0x7fba20008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:44.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.476+0000 7fba2f400640 1 -- 172.21.15.112:0/2184686748 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fba2804b030 con 0x7fba1c0039b0 2024-09-12T02:45:44.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.681+0000 7fba3d400640 1 -- 172.21.15.112:0/2184686748 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fba380b0620 con 0x7fba1c0039b0 2024-09-12T02:45:44.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.681+0000 7fba2f400640 1 -- 172.21.15.112:0/2184686748 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v44) ==== 53+0+73 (secure 0 0 0) 0x7fba28079ff0 con 0x7fba1c0039b0 2024-09-12T02:45:44.682 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:45:44.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.683+0000 7fba3d400640 1 -- 172.21.15.112:0/2184686748 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fba1406be30 msgr2=0x7fba1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:44.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.683+0000 7fba3d400640 1 --2- 172.21.15.112:0/2184686748 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fba1406be30 0x7fba1406e2f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fba380b4890 tx=0x7fba20008040 comp rx=0 tx=0).stop 2024-09-12T02:45:44.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.683+0000 7fba3d400640 1 -- 172.21.15.112:0/2184686748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba1c0039b0 msgr2=0x7fba38152e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:44.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.683+0000 7fba3d400640 1 --2- 172.21.15.112:0/2184686748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba1c0039b0 0x7fba38152e20 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fba28034040 tx=0x7fba28004730 comp rx=0 tx=0).stop 2024-09-12T02:45:44.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.684+0000 7fba3d400640 1 -- 172.21.15.112:0/2184686748 shutdown_connections 2024-09-12T02:45:44.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.684+0000 7fba3d400640 1 --2- 172.21.15.112:0/2184686748 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fba1406be30 0x7fba1406e2f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:44.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.684+0000 7fba3d400640 1 --2- 172.21.15.112:0/2184686748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba381551f0 0x7fba38155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:44.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.684+0000 7fba3d400640 1 --2- 172.21.15.112:0/2184686748 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba38159990 0x7fba380b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:44.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.684+0000 7fba3d400640 1 --2- 172.21.15.112:0/2184686748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba1c0039b0 0x7fba38152e20 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:44.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.684+0000 7fba3d400640 1 -- 172.21.15.112:0/2184686748 >> 172.21.15.112:0/2184686748 conn(0x7fba3806bbd0 msgr2=0x7fba380af810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:44.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.684+0000 7fba3d400640 1 -- 172.21.15.112:0/2184686748 shutdown_connections 2024-09-12T02:45:44.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:44.684+0000 7fba3d400640 1 -- 172.21.15.112:0/2184686748 wait complete. 2024-09-12T02:45:44.701 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:45:44.701 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:45:44.701 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-09-12T02:45:44.701 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T02:45:44.701 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T02:45:44.701 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:45:44.701 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:45:44.701 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:45:44.701 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:45:44.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:45:44.702 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-09-12T02:45:44.742 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:45:44.742 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:45:44.742 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:45:44.742 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:45:44.742 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-09-12T02:45:44.742 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:45:44.743 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:45:44.743 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-09-12T02:45:44.743 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-09-12T02:45:44.743 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:45:44.743 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-09-12T02:45:44.743 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-09-12T02:45:44.743 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:45:44.743 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:45:44.743 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:45:44.743 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:45:44.743 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:45:44.743 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42534sec preferred_lft 42534sec 2024-09-12T02:45:44.743 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::ec4:7aff:fe88:8137/64 scope link noprefixroute 2024-09-12T02:45:44.743 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:45:44.744 INFO:teuthology.orchestra.run.smithi137.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:45:44.744 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 62:9a:8e:f1:56:55 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:45:44.744 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:45:44.744 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:45:44.744 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::30c8:13ff:fe15:f79d/64 scope link 2024-09-12T02:45:44.744 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:45:44.744 INFO:teuthology.orchestra.run.smithi137.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:45:44.744 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 62:9a:8e:f1:56:55 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:45:44.744 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::609a:8eff:fef1:5655/64 scope link 2024-09-12T02:45:44.744 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:45:44.744 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:45:44.744 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 96:f4:ca:17:88:2a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T02:45:44.744 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::94f4:caff:fe17:882a/64 scope link 2024-09-12T02:45:44.745 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:45:44.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:45:44.745 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:45:44.844 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-09-12T02:45:44.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:45:44.847 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-09-12T02:45:44.885 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-09-12T02:45:44.885 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:45:44.886 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:45:44.886 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:45:44.886 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:45:44.886 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:45:44.886 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-09-12T02:45:44.886 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:45:44.886 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:45:44.886 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:45:44.886 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-09-12T02:45:45.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:45:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:45:45.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:45:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:45:45.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:45:45.082 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-09-12T02:45:45.117 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T02:45:45.118 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T02:45:45.118 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:45:45.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:45:45.118 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-09-12T02:45:45.214 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:45:45.214 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T02:45:45.250 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:45:45.250 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:45:45.250 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T02:45:45.325 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-12T02:45:45.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:45:45.325 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:45:45.454 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:45:45.454 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:45:45.480 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:45:45.481 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:45:45.481 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-09-12T02:45:45.481 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with new device syntax: 1@7c01f3b3-dec2-4449-a33f-f960d7527ea6.cephfs=/ 2024-09-12T02:45:45.481 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.112:3300/172.21.15.137:3300/172.21.15.137:3301" will pass to kernel 2024-09-12T02:45:45.483 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-12T02:45:45.483 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:45:45.483 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:45:45.483 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:45:45.483 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:45:45.486 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:45:45.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:45:45.486 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T02:45:45.542 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:45:45.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:45:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:45:45.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:45:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:45:45.631 INFO:teuthology.orchestra.run.smithi137.stdout:client5659 2024-09-12T02:45:45.632 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:45:45.632 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:45:45.667 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:45:45.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.828+0000 7f008b200640 1 Processor -- start 2024-09-12T02:45:45.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.828+0000 7f008b200640 1 -- start start 2024-09-12T02:45:45.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.830+0000 7f008b200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f008c0b4d30 0x7f008c0d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:45.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.830+0000 7f008b200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f008c1627a0 con 0x7f008c0d0370 2024-09-12T02:45:45.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.830+0000 7f008b200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f008c0d08e0 con 0x7f008c1623c0 2024-09-12T02:45:45.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.830+0000 7f008b200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f008c0d0bc0 con 0x7f008c0b4d30 2024-09-12T02:45:45.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.830+0000 7f0081400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f008c0d0370 0x7f008c0b4620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59104/0 (socket says 172.21.15.112:59104) 2024-09-12T02:45:45.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.830+0000 7f0081400640 1 -- 172.21.15.112:0/1876951230 learned_addr learned my addr 172.21.15.112:0/1876951230 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:45:45.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.830+0000 7f008a800640 1 --2- 172.21.15.112:0/1876951230 >> v2:172.21.15.112:3300/0 conn(0x7f008c0b4d30 0x7f008c0d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:45.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.830+0000 7f0089400640 1 -- 172.21.15.112:0/1876951230 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4256335661 0 0) 0x7f008c1627a0 con 0x7f008c0d0370 2024-09-12T02:45:45.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.830+0000 7f0089400640 1 -- 172.21.15.112:0/1876951230 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0070003520 con 0x7f008c0d0370 2024-09-12T02:45:45.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.830+0000 7f008a800640 1 -- 172.21.15.112:0/1876951230 >> v1:172.21.15.137:6789/0 conn(0x7f008c1623c0 legacy=0x7f008c0d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:45.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.830+0000 7f008a800640 1 -- 172.21.15.112:0/1876951230 >> v1:172.21.15.112:6789/0 conn(0x7f008c0d0370 legacy=0x7f008c0b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:45.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.830+0000 7f008a800640 1 -- 172.21.15.112:0/1876951230 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f008c0d2930 con 0x7f008c0b4d30 2024-09-12T02:45:45.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.831+0000 7f008a800640 1 --2- 172.21.15.112:0/1876951230 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f008c0b4d30 0x7f008c0d1400 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0084009d90 tx=0x7f008402a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9441d38e8a4b764f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:45.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.832+0000 7f0089400640 1 -- 172.21.15.112:0/1876951230 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0084037070 con 0x7f008c0b4d30 2024-09-12T02:45:45.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.832+0000 7f0089400640 1 -- 172.21.15.112:0/1876951230 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0084007740 con 0x7f008c0b4d30 2024-09-12T02:45:45.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.832+0000 7f0089400640 1 -- 172.21.15.112:0/1876951230 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0084007af0 con 0x7f008c0b4d30 2024-09-12T02:45:45.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.832+0000 7f008b200640 1 -- 172.21.15.112:0/1876951230 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f008c0b4d30 msgr2=0x7f008c0d1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:45.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.832+0000 7f008b200640 1 --2- 172.21.15.112:0/1876951230 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f008c0b4d30 0x7f008c0d1400 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0084009d90 tx=0x7f008402a780 comp rx=0 tx=0).stop 2024-09-12T02:45:45.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.832+0000 7f008b200640 1 -- 172.21.15.112:0/1876951230 shutdown_connections 2024-09-12T02:45:45.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.832+0000 7f008b200640 1 --2- 172.21.15.112:0/1876951230 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f008c0b4d30 0x7f008c0d1400 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:45.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.832+0000 7f008b200640 1 -- 172.21.15.112:0/1876951230 >> 172.21.15.112:0/1876951230 conn(0x7f008c0d4cc0 msgr2=0x7f008c0d50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:45.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.832+0000 7f008b200640 1 -- 172.21.15.112:0/1876951230 shutdown_connections 2024-09-12T02:45:45.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.832+0000 7f008b200640 1 -- 172.21.15.112:0/1876951230 wait complete. 2024-09-12T02:45:45.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.834+0000 7f008b200640 1 Processor -- start 2024-09-12T02:45:45.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.834+0000 7f008b200640 1 -- start start 2024-09-12T02:45:45.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.835+0000 7f008b200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f008c0d0370 0x7f008c0b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:45.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.835+0000 7f008b200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f008c1623c0 0x7f008c0b7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:45.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.835+0000 7f008b200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f008c15ea30 0x7f008c15eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:45.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.835+0000 7f008b200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f008c0b6460 con 0x7f008c15ea30 2024-09-12T02:45:45.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.835+0000 7f008b200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f008c0d2ef0 con 0x7f008c1623c0 2024-09-12T02:45:45.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.835+0000 7f008b200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f008c0b65e0 con 0x7f008c0d0370 2024-09-12T02:45:45.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.835+0000 7f008a800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f008c15ea30 0x7f008c15eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:45.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.835+0000 7f008a800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f008c15ea30 0x7f008c15eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50912/0 (socket says 172.21.15.112:50912) 2024-09-12T02:45:45.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.835+0000 7f008a800640 1 -- 172.21.15.112:0/2909586909 learned_addr learned my addr 172.21.15.112:0/2909586909 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:45:45.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.836+0000 7f0081400640 1 --2- 172.21.15.112:0/2909586909 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f008c1623c0 0x7f008c0b7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:45.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.836+0000 7f0089e00640 1 --2- 172.21.15.112:0/2909586909 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f008c0d0370 0x7f008c0b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:45.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.836+0000 7f008a800640 1 -- 172.21.15.112:0/2909586909 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f008c0d0370 msgr2=0x7f008c0b8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:45.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.836+0000 7f008a800640 1 --2- 172.21.15.112:0/2909586909 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f008c0d0370 0x7f008c0b8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:45.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.836+0000 7f008a800640 1 -- 172.21.15.112:0/2909586909 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f008c1623c0 msgr2=0x7f008c0b7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:45.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.836+0000 7f008a800640 1 --2- 172.21.15.112:0/2909586909 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f008c1623c0 0x7f008c0b7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:45.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.836+0000 7f008a800640 1 -- 172.21.15.112:0/2909586909 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f008c1f82e0 con 0x7f008c15ea30 2024-09-12T02:45:45.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.836+0000 7f008a800640 1 --2- 172.21.15.112:0/2909586909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f008c15ea30 0x7f008c15eec0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f0084035040 tx=0x7f0084004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:45.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.836+0000 7f0082a00640 1 -- 172.21.15.112:0/2909586909 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0084042070 con 0x7f008c15ea30 2024-09-12T02:45:45.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.836+0000 7f0082a00640 1 -- 172.21.15.112:0/2909586909 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0084003990 con 0x7f008c15ea30 2024-09-12T02:45:45.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.836+0000 7f008b200640 1 -- 172.21.15.112:0/2909586909 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f008c1f55d0 con 0x7f008c15ea30 2024-09-12T02:45:45.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.836+0000 7f0082a00640 1 -- 172.21.15.112:0/2909586909 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0084037040 con 0x7f008c15ea30 2024-09-12T02:45:45.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.837+0000 7f008b200640 1 -- 172.21.15.112:0/2909586909 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f008c0b9660 con 0x7f008c15ea30 2024-09-12T02:45:45.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.838+0000 7f008b200640 1 -- 172.21.15.112:0/2909586909 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f008c0d57e0 con 0x7f008c15ea30 2024-09-12T02:45:45.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.838+0000 7f0082a00640 1 -- 172.21.15.112:0/2909586909 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0084032870 con 0x7f008c15ea30 2024-09-12T02:45:45.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.839+0000 7f0082a00640 1 --2- 172.21.15.112:0/2909586909 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f006806be30 0x7f006806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:45.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.839+0000 7f0082a00640 1 -- 172.21.15.112:0/2909586909 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5767+0+0 (secure 0 0 0) 0x7f00840abbe0 con 0x7f008c15ea30 2024-09-12T02:45:45.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.839+0000 7f0089e00640 1 --2- 172.21.15.112:0/2909586909 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f006806be30 0x7f006806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:45.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.840+0000 7f0089e00640 1 --2- 172.21.15.112:0/2909586909 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f006806be30 0x7f006806e2f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f007c000f60 tx=0x7f007c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:45.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:45.843+0000 7f0082a00640 1 -- 172.21.15.112:0/2909586909 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f008404c020 con 0x7f008c15ea30 2024-09-12T02:45:46.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:46.055+0000 7f008b200640 1 -- 172.21.15.112:0/2909586909 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f008c08e7c0 con 0x7f008c15ea30 2024-09-12T02:45:46.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:46.055+0000 7f0082a00640 1 -- 172.21.15.112:0/2909586909 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5234 (secure 0 0 0) 0x7f0084079f90 con 0x7f008c15ea30 2024-09-12T02:45:46.056 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:45:46.056 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":44,"btime":"2024-09-12T02:45:39:811882+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/2773143619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2773143619},{"type":"v1","addr":"172.21.15.137:6834","nonce":2773143619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5186,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2810064950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2810064950},{"type":"v1","addr":"172.21.15.137:6835","nonce":2810064950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5192,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/366104267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":366104267},{"type":"v1","addr":"172.21.15.112:6837","nonce":366104267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:45:36.194908+0000","modified":"2024-09-12T02:45:39.214065+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5545":{"gid":5545,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/1248364583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1248364583},{"type":"v1","addr":"172.21.15.112:6836","nonce":1248364583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5545,"qdb_cluster":[5545]},"id":5}]} 2024-09-12T02:45:46.057 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 44 2024-09-12T02:45:46.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:46.058+0000 7f008b200640 1 -- 172.21.15.112:0/2909586909 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f006806be30 msgr2=0x7f006806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:46.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:46.058+0000 7f008b200640 1 --2- 172.21.15.112:0/2909586909 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f006806be30 0x7f006806e2f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f007c000f60 tx=0x7f007c009040 comp rx=0 tx=0).stop 2024-09-12T02:45:46.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:46.058+0000 7f008b200640 1 -- 172.21.15.112:0/2909586909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f008c15ea30 msgr2=0x7f008c15eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:46.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:46.058+0000 7f008b200640 1 --2- 172.21.15.112:0/2909586909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f008c15ea30 0x7f008c15eec0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f0084035040 tx=0x7f0084004a40 comp rx=0 tx=0).stop 2024-09-12T02:45:46.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:46.058+0000 7f008b200640 1 -- 172.21.15.112:0/2909586909 shutdown_connections 2024-09-12T02:45:46.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:46.058+0000 7f008b200640 1 --2- 172.21.15.112:0/2909586909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f008c15ea30 0x7f008c15eec0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:46.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:46.058+0000 7f008b200640 1 --2- 172.21.15.112:0/2909586909 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f006806be30 0x7f006806e2f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:46.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:46.058+0000 7f008b200640 1 --2- 172.21.15.112:0/2909586909 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f008c1623c0 0x7f008c0b7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:46.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:46.058+0000 7f008b200640 1 --2- 172.21.15.112:0/2909586909 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f008c0d0370 0x7f008c0b8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:46.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:46.058+0000 7f008b200640 1 -- 172.21.15.112:0/2909586909 >> 172.21.15.112:0/2909586909 conn(0x7f008c0d4cc0 msgr2=0x7f008c0b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:46.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:46.058+0000 7f008b200640 1 -- 172.21.15.112:0/2909586909 shutdown_connections 2024-09-12T02:45:46.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:45:46.058+0000 7f008b200640 1 -- 172.21.15.112:0/2909586909 wait complete. 2024-09-12T02:45:46.075 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-12T02:45:46.248 INFO:teuthology.orchestra.run.smithi112.stdout:{"cluster_fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","whoami":0,"id":5545,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.4509442850000003,"mdsmap_epoch":44,"osdmap_epoch":81,"osdmap_epoch_barrier":79,"uptime":14.541585659000001} 2024-09-12T02:45:46.249 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", "fs_name": "cephfs", "id": 5545, "mdsmap_epoch": 44, "osdmap_epoch": 81, "osdmap_epoch_barrier": 79, "rank_uptime": 9.450944285, "state": "up:active", "uptime": 14.541585659, "want_state": "up:active", "whoami": 0 } 2024-09-12T02:45:46.249 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-12T02:45:46.416 INFO:teuthology.orchestra.run.smithi112.stdout:{"osd_mon_report_interval":"5"} 2024-09-12T02:45:46.416 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-12T02:45:46.417 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2024-09-12T02:45:46.576 INFO:teuthology.orchestra.run.smithi112.stdout:{"mon_tick_interval":"5"} 2024-09-12T02:45:46.577 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2024-09-12T02:45:46.577 INFO:tasks.cephfs.test_full:pool capacity 557078080, 531MB should be enough to fill it 2024-09-12T02:45:46.577 DEBUG:teuthology.orchestra.run.smithi112:> stdin-killer -- python3 -c ' 2024-09-12T02:45:46.577 DEBUG:teuthology.orchestra.run.smithi112:> import time 2024-09-12T02:45:46.577 DEBUG:teuthology.orchestra.run.smithi112:> import datetime 2024-09-12T02:45:46.577 DEBUG:teuthology.orchestra.run.smithi112:> import subprocess 2024-09-12T02:45:46.577 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-12T02:45:46.577 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:45:46.578 DEBUG:teuthology.orchestra.run.smithi112:> # Write some buffered data through before going full, all should be well 2024-09-12T02:45:46.578 DEBUG:teuthology.orchestra.run.smithi112:> print("writing some data through which we expect to succeed") 2024-09-12T02:45:46.578 DEBUG:teuthology.orchestra.run.smithi112:> bytes = 0 2024-09-12T02:45:46.578 DEBUG:teuthology.orchestra.run.smithi112:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2024-09-12T02:45:46.578 DEBUG:teuthology.orchestra.run.smithi112:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2024-09-12T02:45:46.578 DEBUG:teuthology.orchestra.run.smithi112:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2024-09-12T02:45:46.578 DEBUG:teuthology.orchestra.run.smithi112:> os.fsync(f) 2024-09-12T02:45:46.578 DEBUG:teuthology.orchestra.run.smithi112:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2024-09-12T02:45:46.578 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:45:46.578 DEBUG:teuthology.orchestra.run.smithi112:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2024-09-12T02:45:46.578 DEBUG:teuthology.orchestra.run.smithi112:> # writing until we see an error from fsync. As long as we'"'"'re doing 2024-09-12T02:45:46.578 DEBUG:teuthology.orchestra.run.smithi112:> # buffered IO, the error should always only appear from fsync and not 2024-09-12T02:45:46.578 DEBUG:teuthology.orchestra.run.smithi112:> # from write 2024-09-12T02:45:46.578 DEBUG:teuthology.orchestra.run.smithi112:> full = False 2024-09-12T02:45:46.578 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:45:46.579 DEBUG:teuthology.orchestra.run.smithi112:> for n in range(0, int(531 * 1.1)): 2024-09-12T02:45:46.579 DEBUG:teuthology.orchestra.run.smithi112:> try: 2024-09-12T02:45:46.579 DEBUG:teuthology.orchestra.run.smithi112:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-12T02:45:46.579 DEBUG:teuthology.orchestra.run.smithi112:> print("wrote bytes via buffered write, moving on to fsync") 2024-09-12T02:45:46.579 DEBUG:teuthology.orchestra.run.smithi112:> except OSError as e: 2024-09-12T02:45:46.579 DEBUG:teuthology.orchestra.run.smithi112:> if False: 2024-09-12T02:45:46.579 DEBUG:teuthology.orchestra.run.smithi112:> print("Unexpected error %s from write() instead of fsync()" % e) 2024-09-12T02:45:46.579 DEBUG:teuthology.orchestra.run.smithi112:> raise 2024-09-12T02:45:46.579 DEBUG:teuthology.orchestra.run.smithi112:> else: 2024-09-12T02:45:46.579 DEBUG:teuthology.orchestra.run.smithi112:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-12T02:45:46.579 DEBUG:teuthology.orchestra.run.smithi112:> full = True 2024-09-12T02:45:46.579 DEBUG:teuthology.orchestra.run.smithi112:> break 2024-09-12T02:45:46.579 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:45:46.579 DEBUG:teuthology.orchestra.run.smithi112:> try: 2024-09-12T02:45:46.579 DEBUG:teuthology.orchestra.run.smithi112:> os.fsync(f) 2024-09-12T02:45:46.580 DEBUG:teuthology.orchestra.run.smithi112:> print("fsync'"'"'ed successfully") 2024-09-12T02:45:46.580 DEBUG:teuthology.orchestra.run.smithi112:> except OSError as e: 2024-09-12T02:45:46.580 DEBUG:teuthology.orchestra.run.smithi112:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-12T02:45:46.580 DEBUG:teuthology.orchestra.run.smithi112:> full = True 2024-09-12T02:45:46.580 DEBUG:teuthology.orchestra.run.smithi112:> break 2024-09-12T02:45:46.580 DEBUG:teuthology.orchestra.run.smithi112:> else: 2024-09-12T02:45:46.580 DEBUG:teuthology.orchestra.run.smithi112:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-12T02:45:46.580 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:45:46.580 DEBUG:teuthology.orchestra.run.smithi112:> if n > 531 * 0.9: 2024-09-12T02:45:46.580 DEBUG:teuthology.orchestra.run.smithi112:> # Be cautious in the last region where we expect to hit 2024-09-12T02:45:46.580 DEBUG:teuthology.orchestra.run.smithi112:> # the full condition, so that we don'"'"'t overshoot too dramatically 2024-09-12T02:45:46.580 DEBUG:teuthology.orchestra.run.smithi112:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2024-09-12T02:45:46.580 DEBUG:teuthology.orchestra.run.smithi112:> time.sleep(15.0) 2024-09-12T02:45:46.580 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:45:46.580 DEBUG:teuthology.orchestra.run.smithi112:> if not full: 2024-09-12T02:45:46.581 DEBUG:teuthology.orchestra.run.smithi112:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2024-09-12T02:45:46.581 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:45:46.581 DEBUG:teuthology.orchestra.run.smithi112:> # close() should not raise an error because we already caught it in 2024-09-12T02:45:46.581 DEBUG:teuthology.orchestra.run.smithi112:> # fsync. There shouldn'"'"'t have been any more writeback errors 2024-09-12T02:45:46.581 DEBUG:teuthology.orchestra.run.smithi112:> # since then because all IOs got cancelled on the full flag. 2024-09-12T02:45:46.581 DEBUG:teuthology.orchestra.run.smithi112:> print("calling close") 2024-09-12T02:45:46.581 DEBUG:teuthology.orchestra.run.smithi112:> os.close(f) 2024-09-12T02:45:46.581 DEBUG:teuthology.orchestra.run.smithi112:> print("close() did not raise error") 2024-09-12T02:45:46.581 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:45:46.581 DEBUG:teuthology.orchestra.run.smithi112:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2024-09-12T02:45:46.581 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-12T02:45:47.287 INFO:teuthology.orchestra.run.smithi112.stdout:writing some data through which we expect to succeed 2024-09-12T02:45:47.287 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed data successfully, will now attempt to fill fs 2024-09-12T02:45:47.287 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.287 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.287 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 1.00 MB 2024-09-12T02:45:47.287 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.287 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.287 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 2.00 MB 2024-09-12T02:45:47.287 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.287 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.288 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 3.00 MB 2024-09-12T02:45:47.288 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.288 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.288 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 4.00 MB 2024-09-12T02:45:47.288 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.288 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.288 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 5.00 MB 2024-09-12T02:45:47.289 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.289 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.289 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 6.00 MB 2024-09-12T02:45:47.289 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.289 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.289 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 7.00 MB 2024-09-12T02:45:47.289 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.289 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.289 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 8.00 MB 2024-09-12T02:45:47.289 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.289 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.289 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 9.00 MB 2024-09-12T02:45:47.289 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.290 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.290 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 10.00 MB 2024-09-12T02:45:47.290 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.290 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.290 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 11.00 MB 2024-09-12T02:45:47.290 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.290 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.290 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 12.00 MB 2024-09-12T02:45:47.290 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.290 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.290 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 13.00 MB 2024-09-12T02:45:47.290 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.290 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.291 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 14.00 MB 2024-09-12T02:45:47.291 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.291 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.291 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 15.00 MB 2024-09-12T02:45:47.291 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.291 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.291 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 16.00 MB 2024-09-12T02:45:47.291 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.291 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.291 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 17.00 MB 2024-09-12T02:45:47.291 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.291 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.292 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 18.00 MB 2024-09-12T02:45:47.292 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.292 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.292 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 19.00 MB 2024-09-12T02:45:47.292 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.292 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.293 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 20.00 MB 2024-09-12T02:45:47.293 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.293 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.293 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 21.00 MB 2024-09-12T02:45:47.293 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.293 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.293 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 22.00 MB 2024-09-12T02:45:47.293 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.293 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.293 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 23.00 MB 2024-09-12T02:45:47.293 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.293 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.294 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 24.00 MB 2024-09-12T02:45:47.294 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.294 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.294 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 25.00 MB 2024-09-12T02:45:47.294 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.294 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.294 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 26.00 MB 2024-09-12T02:45:47.294 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.295 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.295 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 27.00 MB 2024-09-12T02:45:47.295 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.295 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.295 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 28.00 MB 2024-09-12T02:45:47.295 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.295 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.295 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 29.00 MB 2024-09-12T02:45:47.296 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.296 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.296 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 30.00 MB 2024-09-12T02:45:47.296 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.296 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.296 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 31.00 MB 2024-09-12T02:45:47.296 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.297 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.297 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 32.00 MB 2024-09-12T02:45:47.297 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.297 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.297 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 33.00 MB 2024-09-12T02:45:47.297 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.297 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.297 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 34.00 MB 2024-09-12T02:45:47.297 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.297 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.297 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 35.00 MB 2024-09-12T02:45:47.297 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.298 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.298 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 36.00 MB 2024-09-12T02:45:47.298 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.298 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.298 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 37.00 MB 2024-09-12T02:45:47.298 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.298 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.298 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 38.00 MB 2024-09-12T02:45:47.298 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.299 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.299 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 39.00 MB 2024-09-12T02:45:47.299 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.299 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.299 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 40.00 MB 2024-09-12T02:45:47.299 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.299 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.299 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 41.00 MB 2024-09-12T02:45:47.299 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.299 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.300 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 42.00 MB 2024-09-12T02:45:47.300 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.300 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.300 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 43.00 MB 2024-09-12T02:45:47.300 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.300 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.301 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 44.00 MB 2024-09-12T02:45:47.301 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.301 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.301 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 45.00 MB 2024-09-12T02:45:47.301 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.301 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.301 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 46.00 MB 2024-09-12T02:45:47.301 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.301 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.301 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 47.00 MB 2024-09-12T02:45:47.302 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.302 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.302 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 48.00 MB 2024-09-12T02:45:47.302 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.302 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.302 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 49.00 MB 2024-09-12T02:45:47.302 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.302 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.303 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 50.00 MB 2024-09-12T02:45:47.303 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.303 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.303 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 51.00 MB 2024-09-12T02:45:47.303 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.303 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.303 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 52.00 MB 2024-09-12T02:45:47.304 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.304 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.304 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 53.00 MB 2024-09-12T02:45:47.304 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.304 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.304 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 54.00 MB 2024-09-12T02:45:47.304 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.304 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.305 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 55.00 MB 2024-09-12T02:45:47.305 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.305 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.305 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 56.00 MB 2024-09-12T02:45:47.305 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.305 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.305 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 57.00 MB 2024-09-12T02:45:47.305 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.305 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.305 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 58.00 MB 2024-09-12T02:45:47.305 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.305 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.305 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 59.00 MB 2024-09-12T02:45:47.306 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.306 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.306 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 60.00 MB 2024-09-12T02:45:47.306 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.306 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.306 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 61.00 MB 2024-09-12T02:45:47.306 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.306 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.306 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 62.00 MB 2024-09-12T02:45:47.306 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.306 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.306 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 63.00 MB 2024-09-12T02:45:47.306 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.307 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.307 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 64.00 MB 2024-09-12T02:45:47.307 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.307 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.307 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 65.00 MB 2024-09-12T02:45:47.307 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.307 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.307 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 66.00 MB 2024-09-12T02:45:47.307 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.307 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.307 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 67.00 MB 2024-09-12T02:45:47.307 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.307 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.307 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 68.00 MB 2024-09-12T02:45:47.308 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.308 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.308 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 69.00 MB 2024-09-12T02:45:47.308 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.308 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.308 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 70.00 MB 2024-09-12T02:45:47.308 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.308 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.308 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 71.00 MB 2024-09-12T02:45:47.308 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.308 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.308 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 72.00 MB 2024-09-12T02:45:47.308 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.308 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.309 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 73.00 MB 2024-09-12T02:45:47.309 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.309 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.309 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 74.00 MB 2024-09-12T02:45:47.309 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.309 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.309 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 75.00 MB 2024-09-12T02:45:47.309 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.309 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.309 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 76.00 MB 2024-09-12T02:45:47.309 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.309 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.309 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 77.00 MB 2024-09-12T02:45:47.309 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.309 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.310 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 78.00 MB 2024-09-12T02:45:47.310 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.310 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.310 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 79.00 MB 2024-09-12T02:45:47.310 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.310 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.310 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 80.00 MB 2024-09-12T02:45:47.836 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.836 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.836 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 81.00 MB 2024-09-12T02:45:47.836 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.837 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.837 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 82.00 MB 2024-09-12T02:45:47.837 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.837 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.837 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 83.00 MB 2024-09-12T02:45:47.837 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.837 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.837 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 84.00 MB 2024-09-12T02:45:47.837 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.837 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.837 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 85.00 MB 2024-09-12T02:45:47.837 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.837 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.838 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 86.00 MB 2024-09-12T02:45:47.840 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.841 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.841 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 87.00 MB 2024-09-12T02:45:47.841 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.841 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.841 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 88.00 MB 2024-09-12T02:45:47.841 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.841 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.841 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 89.00 MB 2024-09-12T02:45:47.841 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.841 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.841 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 90.00 MB 2024-09-12T02:45:47.841 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.841 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.841 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 91.00 MB 2024-09-12T02:45:47.842 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.842 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.842 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 92.00 MB 2024-09-12T02:45:47.842 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.842 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.842 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 93.00 MB 2024-09-12T02:45:47.842 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.842 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.842 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 94.00 MB 2024-09-12T02:45:47.842 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.842 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.842 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 95.00 MB 2024-09-12T02:45:47.842 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.842 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.843 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 96.00 MB 2024-09-12T02:45:47.843 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.843 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.843 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 97.00 MB 2024-09-12T02:45:47.843 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.843 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.843 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 98.00 MB 2024-09-12T02:45:47.843 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.843 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.843 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 99.00 MB 2024-09-12T02:45:47.843 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.843 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.843 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 100.00 MB 2024-09-12T02:45:47.843 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.844 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.844 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 101.00 MB 2024-09-12T02:45:47.844 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.844 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.844 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 102.00 MB 2024-09-12T02:45:47.844 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.844 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.844 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 103.00 MB 2024-09-12T02:45:47.844 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.844 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.844 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 104.00 MB 2024-09-12T02:45:47.844 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.844 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.844 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 105.00 MB 2024-09-12T02:45:47.845 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.845 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.845 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 106.00 MB 2024-09-12T02:45:47.845 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.845 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.845 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 107.00 MB 2024-09-12T02:45:47.845 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.845 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.845 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 108.00 MB 2024-09-12T02:45:47.845 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.845 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.845 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 109.00 MB 2024-09-12T02:45:47.845 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.845 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.846 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 110.00 MB 2024-09-12T02:45:47.846 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.846 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.846 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 111.00 MB 2024-09-12T02:45:47.846 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.846 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.846 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 112.00 MB 2024-09-12T02:45:47.846 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.846 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.846 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 113.00 MB 2024-09-12T02:45:47.846 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.846 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.846 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 114.00 MB 2024-09-12T02:45:47.846 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.847 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.847 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 115.00 MB 2024-09-12T02:45:47.847 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.847 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.847 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 116.00 MB 2024-09-12T02:45:47.847 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.847 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.847 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 117.00 MB 2024-09-12T02:45:47.847 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.847 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.847 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 118.00 MB 2024-09-12T02:45:47.847 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.847 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.847 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 119.00 MB 2024-09-12T02:45:47.848 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.848 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.848 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 120.00 MB 2024-09-12T02:45:47.848 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.848 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.848 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 121.00 MB 2024-09-12T02:45:47.848 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.848 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.848 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 122.00 MB 2024-09-12T02:45:47.848 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.848 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.848 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 123.00 MB 2024-09-12T02:45:47.848 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.848 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.849 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 124.00 MB 2024-09-12T02:45:47.849 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.849 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.849 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 125.00 MB 2024-09-12T02:45:47.849 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.849 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.849 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 126.00 MB 2024-09-12T02:45:47.849 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.849 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.849 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 127.00 MB 2024-09-12T02:45:47.849 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.849 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.849 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 128.00 MB 2024-09-12T02:45:47.849 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.850 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.850 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 129.00 MB 2024-09-12T02:45:47.850 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.850 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.850 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 130.00 MB 2024-09-12T02:45:47.850 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.850 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.850 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 131.00 MB 2024-09-12T02:45:47.850 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.850 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.850 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 132.00 MB 2024-09-12T02:45:47.850 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.850 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.850 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 133.00 MB 2024-09-12T02:45:47.850 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.851 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.851 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 134.00 MB 2024-09-12T02:45:47.851 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.851 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.851 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 135.00 MB 2024-09-12T02:45:47.851 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.851 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.851 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 136.00 MB 2024-09-12T02:45:47.851 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.851 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.851 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 137.00 MB 2024-09-12T02:45:47.851 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.851 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.851 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 138.00 MB 2024-09-12T02:45:47.852 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.852 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.852 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 139.00 MB 2024-09-12T02:45:47.852 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.852 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.852 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 140.00 MB 2024-09-12T02:45:47.852 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.852 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.852 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 141.00 MB 2024-09-12T02:45:47.852 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.852 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.852 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 142.00 MB 2024-09-12T02:45:47.852 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.852 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.852 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 143.00 MB 2024-09-12T02:45:47.853 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.853 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.853 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 144.00 MB 2024-09-12T02:45:47.853 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.853 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.853 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 145.00 MB 2024-09-12T02:45:47.853 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.853 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.853 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 146.00 MB 2024-09-12T02:45:47.853 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.853 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.853 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 147.00 MB 2024-09-12T02:45:47.853 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.853 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.854 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 148.00 MB 2024-09-12T02:45:47.854 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.854 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.854 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 149.00 MB 2024-09-12T02:45:47.854 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.854 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.854 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 150.00 MB 2024-09-12T02:45:47.854 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.854 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.854 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 151.00 MB 2024-09-12T02:45:47.854 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.854 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.854 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 152.00 MB 2024-09-12T02:45:47.854 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.855 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.855 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 153.00 MB 2024-09-12T02:45:47.855 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.855 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.855 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 154.00 MB 2024-09-12T02:45:47.855 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.855 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.855 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 155.00 MB 2024-09-12T02:45:47.855 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.855 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.855 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 156.00 MB 2024-09-12T02:45:47.855 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.855 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.855 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 157.00 MB 2024-09-12T02:45:47.856 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.856 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.856 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 158.00 MB 2024-09-12T02:45:47.856 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.856 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.856 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 159.00 MB 2024-09-12T02:45:47.856 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:47.856 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:47.856 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 160.00 MB 2024-09-12T02:45:47.856 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.380 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.380 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 161.00 MB 2024-09-12T02:45:48.380 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.380 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.380 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 162.00 MB 2024-09-12T02:45:48.380 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.381 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.381 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 163.00 MB 2024-09-12T02:45:48.381 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.381 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.381 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 164.00 MB 2024-09-12T02:45:48.381 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.381 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.381 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 165.00 MB 2024-09-12T02:45:48.381 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.381 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.381 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 166.00 MB 2024-09-12T02:45:48.381 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.381 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.382 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 167.00 MB 2024-09-12T02:45:48.382 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.382 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.382 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 168.00 MB 2024-09-12T02:45:48.382 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.382 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.382 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 169.00 MB 2024-09-12T02:45:48.382 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.382 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.382 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 170.00 MB 2024-09-12T02:45:48.382 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.382 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.382 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 171.00 MB 2024-09-12T02:45:48.383 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.383 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.383 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 172.00 MB 2024-09-12T02:45:48.383 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.383 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.383 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 173.00 MB 2024-09-12T02:45:48.383 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.383 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.383 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 174.00 MB 2024-09-12T02:45:48.383 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.383 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.383 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 175.00 MB 2024-09-12T02:45:48.383 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 176.00 MB 2024-09-12T02:45:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 177.00 MB 2024-09-12T02:45:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 178.00 MB 2024-09-12T02:45:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 179.00 MB 2024-09-12T02:45:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 180.00 MB 2024-09-12T02:45:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 181.00 MB 2024-09-12T02:45:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 182.00 MB 2024-09-12T02:45:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 183.00 MB 2024-09-12T02:45:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 184.00 MB 2024-09-12T02:45:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 185.00 MB 2024-09-12T02:45:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 186.00 MB 2024-09-12T02:45:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 187.00 MB 2024-09-12T02:45:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 188.00 MB 2024-09-12T02:45:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 189.00 MB 2024-09-12T02:45:48.387 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.387 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.387 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 190.00 MB 2024-09-12T02:45:48.387 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.387 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.387 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 191.00 MB 2024-09-12T02:45:48.387 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.387 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.387 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 192.00 MB 2024-09-12T02:45:48.387 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.387 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.387 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 193.00 MB 2024-09-12T02:45:48.387 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.387 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.388 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 194.00 MB 2024-09-12T02:45:48.388 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.388 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.388 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 195.00 MB 2024-09-12T02:45:48.388 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.388 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.389 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 196.00 MB 2024-09-12T02:45:48.389 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.389 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.389 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 197.00 MB 2024-09-12T02:45:48.389 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.389 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.389 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 198.00 MB 2024-09-12T02:45:48.389 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.389 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.389 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 199.00 MB 2024-09-12T02:45:48.389 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.389 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.389 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 200.00 MB 2024-09-12T02:45:48.390 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.390 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.390 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 201.00 MB 2024-09-12T02:45:48.390 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.390 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.390 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 202.00 MB 2024-09-12T02:45:48.390 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.390 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.390 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 203.00 MB 2024-09-12T02:45:48.390 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.391 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.391 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 204.00 MB 2024-09-12T02:45:48.391 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.391 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.391 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 205.00 MB 2024-09-12T02:45:48.391 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.391 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.391 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 206.00 MB 2024-09-12T02:45:48.391 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.391 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.391 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 207.00 MB 2024-09-12T02:45:48.391 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.391 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.392 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 208.00 MB 2024-09-12T02:45:48.392 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.392 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.392 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 209.00 MB 2024-09-12T02:45:48.392 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.392 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.392 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 210.00 MB 2024-09-12T02:45:48.392 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.392 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.392 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 211.00 MB 2024-09-12T02:45:48.392 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.392 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.392 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 212.00 MB 2024-09-12T02:45:48.392 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.393 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.393 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 213.00 MB 2024-09-12T02:45:48.393 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.393 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.393 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 214.00 MB 2024-09-12T02:45:48.393 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.393 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.393 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 215.00 MB 2024-09-12T02:45:48.393 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.393 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.393 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 216.00 MB 2024-09-12T02:45:48.393 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.393 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.393 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 217.00 MB 2024-09-12T02:45:48.394 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.394 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.394 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 218.00 MB 2024-09-12T02:45:48.394 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.394 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.394 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 219.00 MB 2024-09-12T02:45:48.394 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.394 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.394 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 220.00 MB 2024-09-12T02:45:48.394 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.394 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.394 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 221.00 MB 2024-09-12T02:45:48.394 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.394 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.395 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 222.00 MB 2024-09-12T02:45:48.395 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.395 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.395 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 223.00 MB 2024-09-12T02:45:48.395 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.395 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.395 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 224.00 MB 2024-09-12T02:45:48.395 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.395 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.395 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 225.00 MB 2024-09-12T02:45:48.395 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.395 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.395 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 226.00 MB 2024-09-12T02:45:48.395 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.396 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.396 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 227.00 MB 2024-09-12T02:45:48.396 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.396 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.396 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 228.00 MB 2024-09-12T02:45:48.396 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.396 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.396 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 229.00 MB 2024-09-12T02:45:48.396 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.396 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.396 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 230.00 MB 2024-09-12T02:45:48.396 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.396 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.396 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 231.00 MB 2024-09-12T02:45:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 232.00 MB 2024-09-12T02:45:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 233.00 MB 2024-09-12T02:45:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 234.00 MB 2024-09-12T02:45:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 235.00 MB 2024-09-12T02:45:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 236.00 MB 2024-09-12T02:45:48.398 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.398 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.398 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 237.00 MB 2024-09-12T02:45:48.398 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.398 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.398 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 238.00 MB 2024-09-12T02:45:48.398 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.398 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.398 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 239.00 MB 2024-09-12T02:45:48.398 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.399 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.399 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 240.00 MB 2024-09-12T02:45:48.399 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.399 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.978 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 241.00 MB 2024-09-12T02:45:48.979 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.979 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.979 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 242.00 MB 2024-09-12T02:45:48.979 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.979 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.979 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 243.00 MB 2024-09-12T02:45:48.980 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.980 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.980 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 244.00 MB 2024-09-12T02:45:48.980 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.980 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.980 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 245.00 MB 2024-09-12T02:45:48.980 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.981 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.981 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 246.00 MB 2024-09-12T02:45:48.981 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.981 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.981 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 247.00 MB 2024-09-12T02:45:48.981 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.981 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.981 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 248.00 MB 2024-09-12T02:45:48.982 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.982 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.982 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 249.00 MB 2024-09-12T02:45:48.982 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.982 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.982 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 250.00 MB 2024-09-12T02:45:48.983 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.983 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.983 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 251.00 MB 2024-09-12T02:45:48.983 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.983 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.983 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 252.00 MB 2024-09-12T02:45:48.983 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.984 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.984 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 253.00 MB 2024-09-12T02:45:48.985 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.985 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.985 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 254.00 MB 2024-09-12T02:45:48.985 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.985 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.985 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 255.00 MB 2024-09-12T02:45:48.985 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.985 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.985 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 256.00 MB 2024-09-12T02:45:48.985 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.986 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.986 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 257.00 MB 2024-09-12T02:45:48.986 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.986 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.986 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 258.00 MB 2024-09-12T02:45:48.986 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.986 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.986 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 259.00 MB 2024-09-12T02:45:48.986 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.987 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.987 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 260.00 MB 2024-09-12T02:45:48.987 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.987 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.987 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 261.00 MB 2024-09-12T02:45:48.987 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.987 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.987 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 262.00 MB 2024-09-12T02:45:48.987 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.987 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.987 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 263.00 MB 2024-09-12T02:45:48.988 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.988 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.988 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 264.00 MB 2024-09-12T02:45:48.988 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.988 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.988 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 265.00 MB 2024-09-12T02:45:48.988 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.988 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.988 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 266.00 MB 2024-09-12T02:45:48.988 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.989 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.989 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 267.00 MB 2024-09-12T02:45:48.989 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.989 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.989 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 268.00 MB 2024-09-12T02:45:48.989 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.989 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.989 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 269.00 MB 2024-09-12T02:45:48.989 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.989 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.989 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 270.00 MB 2024-09-12T02:45:48.989 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.990 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.990 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 271.00 MB 2024-09-12T02:45:48.990 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.990 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.990 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 272.00 MB 2024-09-12T02:45:48.990 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.990 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.990 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 273.00 MB 2024-09-12T02:45:48.990 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.990 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.990 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 274.00 MB 2024-09-12T02:45:48.990 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.990 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.990 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 275.00 MB 2024-09-12T02:45:48.991 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.991 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.991 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 276.00 MB 2024-09-12T02:45:48.991 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.991 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.991 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 277.00 MB 2024-09-12T02:45:48.991 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.991 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.991 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 278.00 MB 2024-09-12T02:45:48.991 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.991 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.992 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 279.00 MB 2024-09-12T02:45:48.992 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.992 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.992 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 280.00 MB 2024-09-12T02:45:48.992 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.992 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.992 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 281.00 MB 2024-09-12T02:45:48.992 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.992 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.992 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 282.00 MB 2024-09-12T02:45:48.992 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.992 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.992 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 283.00 MB 2024-09-12T02:45:48.993 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.993 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.993 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 284.00 MB 2024-09-12T02:45:48.993 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.993 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.993 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 285.00 MB 2024-09-12T02:45:48.993 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.993 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.993 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 286.00 MB 2024-09-12T02:45:48.993 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.993 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.993 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 287.00 MB 2024-09-12T02:45:48.994 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.994 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.994 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 288.00 MB 2024-09-12T02:45:48.994 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.994 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.994 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 289.00 MB 2024-09-12T02:45:48.994 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.994 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.995 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 290.00 MB 2024-09-12T02:45:48.995 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.995 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.995 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 291.00 MB 2024-09-12T02:45:48.995 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.995 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.995 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 292.00 MB 2024-09-12T02:45:48.995 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.995 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.995 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 293.00 MB 2024-09-12T02:45:48.995 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.995 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.996 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 294.00 MB 2024-09-12T02:45:48.996 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.996 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.996 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 295.00 MB 2024-09-12T02:45:48.996 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.996 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.996 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 296.00 MB 2024-09-12T02:45:48.996 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.996 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.996 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 297.00 MB 2024-09-12T02:45:48.996 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.996 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.997 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 298.00 MB 2024-09-12T02:45:48.997 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.997 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.997 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 299.00 MB 2024-09-12T02:45:48.997 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.997 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.997 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 300.00 MB 2024-09-12T02:45:48.997 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.997 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.997 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 301.00 MB 2024-09-12T02:45:48.998 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.998 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.998 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 302.00 MB 2024-09-12T02:45:48.998 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.998 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.999 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 303.00 MB 2024-09-12T02:45:48.999 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.999 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.999 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 304.00 MB 2024-09-12T02:45:48.999 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.999 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.999 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 305.00 MB 2024-09-12T02:45:48.999 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.999 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.999 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 306.00 MB 2024-09-12T02:45:48.999 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:48.999 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:48.999 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 307.00 MB 2024-09-12T02:45:49.000 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.000 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.000 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 308.00 MB 2024-09-12T02:45:49.000 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.000 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.000 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 309.00 MB 2024-09-12T02:45:49.000 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.000 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.000 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 310.00 MB 2024-09-12T02:45:49.000 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.000 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.000 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 311.00 MB 2024-09-12T02:45:49.001 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.001 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.001 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 312.00 MB 2024-09-12T02:45:49.001 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.002 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.002 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 313.00 MB 2024-09-12T02:45:49.002 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.002 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.002 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 314.00 MB 2024-09-12T02:45:49.002 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.002 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.002 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 315.00 MB 2024-09-12T02:45:49.002 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.002 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.002 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 316.00 MB 2024-09-12T02:45:49.002 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.003 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.003 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 317.00 MB 2024-09-12T02:45:49.003 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.003 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.003 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 318.00 MB 2024-09-12T02:45:49.003 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.003 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.003 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 319.00 MB 2024-09-12T02:45:49.003 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.003 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.004 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 320.00 MB 2024-09-12T02:45:49.004 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.004 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.004 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 321.00 MB 2024-09-12T02:45:49.558 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.558 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.558 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 322.00 MB 2024-09-12T02:45:49.558 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.559 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.559 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 323.00 MB 2024-09-12T02:45:49.559 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.559 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.559 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 324.00 MB 2024-09-12T02:45:49.559 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.559 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.559 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 325.00 MB 2024-09-12T02:45:49.559 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.559 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.559 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 326.00 MB 2024-09-12T02:45:49.559 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.560 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.560 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 327.00 MB 2024-09-12T02:45:49.560 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.560 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.560 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 328.00 MB 2024-09-12T02:45:49.560 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.560 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.560 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 329.00 MB 2024-09-12T02:45:49.560 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.560 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.560 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 330.00 MB 2024-09-12T02:45:49.560 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.560 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.561 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 331.00 MB 2024-09-12T02:45:49.561 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.561 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.561 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 332.00 MB 2024-09-12T02:45:49.561 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.561 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.561 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 333.00 MB 2024-09-12T02:45:49.561 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.561 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.561 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 334.00 MB 2024-09-12T02:45:49.561 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.561 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.562 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 335.00 MB 2024-09-12T02:45:49.562 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.562 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.562 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 336.00 MB 2024-09-12T02:45:49.562 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.562 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.562 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 337.00 MB 2024-09-12T02:45:49.562 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.562 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.562 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 338.00 MB 2024-09-12T02:45:49.562 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.562 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.562 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 339.00 MB 2024-09-12T02:45:49.562 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.563 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.563 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 340.00 MB 2024-09-12T02:45:49.563 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.563 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.563 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 341.00 MB 2024-09-12T02:45:49.563 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.563 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.563 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 342.00 MB 2024-09-12T02:45:49.563 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.563 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.563 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 343.00 MB 2024-09-12T02:45:49.563 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.563 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.563 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 344.00 MB 2024-09-12T02:45:49.564 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.564 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.564 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 345.00 MB 2024-09-12T02:45:49.564 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.564 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.564 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 346.00 MB 2024-09-12T02:45:49.564 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.564 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.564 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 347.00 MB 2024-09-12T02:45:49.564 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.564 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.564 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 348.00 MB 2024-09-12T02:45:49.564 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.565 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.565 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 349.00 MB 2024-09-12T02:45:49.565 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.565 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.565 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 350.00 MB 2024-09-12T02:45:49.565 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.565 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.565 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 351.00 MB 2024-09-12T02:45:49.565 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.565 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.565 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 352.00 MB 2024-09-12T02:45:49.565 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.565 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.565 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 353.00 MB 2024-09-12T02:45:49.566 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.566 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.566 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 354.00 MB 2024-09-12T02:45:49.566 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.566 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.566 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 355.00 MB 2024-09-12T02:45:49.566 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.566 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.566 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 356.00 MB 2024-09-12T02:45:49.566 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.566 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.566 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 357.00 MB 2024-09-12T02:45:49.566 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.566 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.567 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 358.00 MB 2024-09-12T02:45:49.567 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.567 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.567 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 359.00 MB 2024-09-12T02:45:49.567 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.567 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.567 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 360.00 MB 2024-09-12T02:45:49.567 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.567 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.567 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 361.00 MB 2024-09-12T02:45:49.567 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.567 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.567 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 362.00 MB 2024-09-12T02:45:49.567 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.568 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.568 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 363.00 MB 2024-09-12T02:45:49.568 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.568 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.568 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 364.00 MB 2024-09-12T02:45:49.568 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.568 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.568 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 365.00 MB 2024-09-12T02:45:49.568 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.568 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.568 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 366.00 MB 2024-09-12T02:45:49.568 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.568 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.568 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 367.00 MB 2024-09-12T02:45:49.569 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.569 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.569 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 368.00 MB 2024-09-12T02:45:49.569 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.569 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.569 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 369.00 MB 2024-09-12T02:45:49.569 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.569 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.569 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 370.00 MB 2024-09-12T02:45:49.569 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.569 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.569 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 371.00 MB 2024-09-12T02:45:49.569 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.569 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.570 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 372.00 MB 2024-09-12T02:45:49.570 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.570 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.570 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 373.00 MB 2024-09-12T02:45:49.570 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.570 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.570 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 374.00 MB 2024-09-12T02:45:49.570 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.570 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.570 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 375.00 MB 2024-09-12T02:45:49.570 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.570 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.570 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 376.00 MB 2024-09-12T02:45:49.570 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.571 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.571 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 377.00 MB 2024-09-12T02:45:49.571 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.571 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.571 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 378.00 MB 2024-09-12T02:45:49.571 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.571 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.571 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 379.00 MB 2024-09-12T02:45:49.571 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.571 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.571 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 380.00 MB 2024-09-12T02:45:49.571 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.571 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.571 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 381.00 MB 2024-09-12T02:45:49.571 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.572 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.572 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 382.00 MB 2024-09-12T02:45:49.572 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.572 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.572 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 383.00 MB 2024-09-12T02:45:49.572 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.572 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.572 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 384.00 MB 2024-09-12T02:45:49.572 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.572 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.572 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 385.00 MB 2024-09-12T02:45:49.572 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.572 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.573 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 386.00 MB 2024-09-12T02:45:49.573 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.573 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.573 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 387.00 MB 2024-09-12T02:45:49.573 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.573 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.573 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 388.00 MB 2024-09-12T02:45:49.573 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.573 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.573 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 389.00 MB 2024-09-12T02:45:49.573 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.573 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.573 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 390.00 MB 2024-09-12T02:45:49.573 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.574 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.574 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 391.00 MB 2024-09-12T02:45:49.574 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.574 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.574 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 392.00 MB 2024-09-12T02:45:49.574 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.574 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.574 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 393.00 MB 2024-09-12T02:45:49.574 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.574 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.574 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 394.00 MB 2024-09-12T02:45:49.574 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.574 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.574 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 395.00 MB 2024-09-12T02:45:49.575 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.575 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.575 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 396.00 MB 2024-09-12T02:45:49.575 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.575 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.575 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 397.00 MB 2024-09-12T02:45:49.575 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.575 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.575 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 398.00 MB 2024-09-12T02:45:49.575 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.575 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.575 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 399.00 MB 2024-09-12T02:45:49.575 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.575 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.576 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 400.00 MB 2024-09-12T02:45:49.576 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:45:49.576 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:45:49.576 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 401.00 MB 2024-09-12T02:45:51.283 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:45:51.288 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:45:52.067 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-12T02:45:52.066+0000 7f0219e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2024-09-12T02:46:00.979 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-12T02:46:00.978+0000 7f0219e00640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2024-09-12T02:46:20.134 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.135 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.135 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 402.00 MB 2024-09-12T02:46:20.135 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.135 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.135 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 403.00 MB 2024-09-12T02:46:20.135 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.135 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.135 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 404.00 MB 2024-09-12T02:46:20.135 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.136 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.136 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 405.00 MB 2024-09-12T02:46:20.136 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.136 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.136 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 406.00 MB 2024-09-12T02:46:20.136 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.136 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.136 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 407.00 MB 2024-09-12T02:46:20.136 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.137 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.137 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 408.00 MB 2024-09-12T02:46:20.137 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.137 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.137 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 409.00 MB 2024-09-12T02:46:20.137 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.137 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.137 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 410.00 MB 2024-09-12T02:46:20.137 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.137 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.137 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 411.00 MB 2024-09-12T02:46:20.138 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.138 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.138 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 412.00 MB 2024-09-12T02:46:20.138 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.138 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.138 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 413.00 MB 2024-09-12T02:46:20.138 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.138 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.138 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 414.00 MB 2024-09-12T02:46:20.138 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.138 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.139 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 415.00 MB 2024-09-12T02:46:20.139 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.139 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.139 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 416.00 MB 2024-09-12T02:46:20.139 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.139 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.139 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 417.00 MB 2024-09-12T02:46:20.139 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.139 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.139 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 418.00 MB 2024-09-12T02:46:20.139 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.140 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.140 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 419.00 MB 2024-09-12T02:46:20.140 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.140 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.140 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 420.00 MB 2024-09-12T02:46:20.140 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.140 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.140 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 421.00 MB 2024-09-12T02:46:20.140 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.140 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.140 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 422.00 MB 2024-09-12T02:46:20.141 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.141 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.141 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 423.00 MB 2024-09-12T02:46:20.141 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.141 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.141 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 424.00 MB 2024-09-12T02:46:20.141 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.141 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.141 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 425.00 MB 2024-09-12T02:46:20.141 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.141 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.142 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 426.00 MB 2024-09-12T02:46:20.142 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.142 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.142 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 427.00 MB 2024-09-12T02:46:20.142 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.142 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.142 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 428.00 MB 2024-09-12T02:46:20.142 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.142 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.142 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 429.00 MB 2024-09-12T02:46:20.142 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.142 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.143 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 430.00 MB 2024-09-12T02:46:20.143 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.143 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.143 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 431.00 MB 2024-09-12T02:46:20.143 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.143 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.143 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 432.00 MB 2024-09-12T02:46:20.143 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.144 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.144 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 433.00 MB 2024-09-12T02:46:20.144 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.144 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.144 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 434.00 MB 2024-09-12T02:46:20.144 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.144 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.144 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 435.00 MB 2024-09-12T02:46:20.144 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.144 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.145 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 436.00 MB 2024-09-12T02:46:20.145 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.145 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.145 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 437.00 MB 2024-09-12T02:46:20.145 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.145 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.145 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 438.00 MB 2024-09-12T02:46:20.145 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.145 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.145 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 439.00 MB 2024-09-12T02:46:20.146 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.146 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.146 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 440.00 MB 2024-09-12T02:46:20.146 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.146 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.146 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 441.00 MB 2024-09-12T02:46:20.146 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.146 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.146 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 442.00 MB 2024-09-12T02:46:20.146 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.147 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.147 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 443.00 MB 2024-09-12T02:46:20.147 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.147 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.147 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 444.00 MB 2024-09-12T02:46:20.147 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.147 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.147 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 445.00 MB 2024-09-12T02:46:20.147 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.147 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.147 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 446.00 MB 2024-09-12T02:46:20.148 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.148 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.148 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 447.00 MB 2024-09-12T02:46:20.148 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.148 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.148 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 448.00 MB 2024-09-12T02:46:20.148 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.149 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.149 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 449.00 MB 2024-09-12T02:46:20.149 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.149 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.149 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 450.00 MB 2024-09-12T02:46:20.149 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.149 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.149 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 451.00 MB 2024-09-12T02:46:20.149 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.149 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.149 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 452.00 MB 2024-09-12T02:46:20.150 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.150 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.150 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 453.00 MB 2024-09-12T02:46:20.150 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.150 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.150 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 454.00 MB 2024-09-12T02:46:20.150 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.150 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.150 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 455.00 MB 2024-09-12T02:46:20.150 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.150 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.150 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 456.00 MB 2024-09-12T02:46:20.151 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.151 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.151 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 457.00 MB 2024-09-12T02:46:20.151 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.151 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.151 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 458.00 MB 2024-09-12T02:46:20.151 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.151 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.151 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 459.00 MB 2024-09-12T02:46:20.151 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.151 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.152 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 460.00 MB 2024-09-12T02:46:20.152 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.152 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.152 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 461.00 MB 2024-09-12T02:46:20.152 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.152 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.152 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 462.00 MB 2024-09-12T02:46:20.152 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.152 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.152 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 463.00 MB 2024-09-12T02:46:20.152 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.152 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.153 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 464.00 MB 2024-09-12T02:46:20.153 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.153 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.153 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 465.00 MB 2024-09-12T02:46:20.153 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.153 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.153 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 466.00 MB 2024-09-12T02:46:20.153 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.153 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.153 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 467.00 MB 2024-09-12T02:46:20.153 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.154 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.154 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 468.00 MB 2024-09-12T02:46:20.154 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.154 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.154 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 469.00 MB 2024-09-12T02:46:20.154 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.154 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.154 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 470.00 MB 2024-09-12T02:46:20.154 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.154 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.154 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 471.00 MB 2024-09-12T02:46:20.155 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.155 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.155 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 472.00 MB 2024-09-12T02:46:20.155 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.155 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.155 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 473.00 MB 2024-09-12T02:46:20.155 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.155 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.155 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 474.00 MB 2024-09-12T02:46:20.155 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.155 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.156 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 475.00 MB 2024-09-12T02:46:20.156 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.156 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.156 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 476.00 MB 2024-09-12T02:46:20.156 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.156 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.156 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 477.00 MB 2024-09-12T02:46:20.156 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.156 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.156 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 478.00 MB 2024-09-12T02:46:20.156 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.157 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.157 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 479.00 MB 2024-09-12T02:46:20.157 INFO:teuthology.orchestra.run.smithi112.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-12T02:46:20.157 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:46:20.157 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:46:20.157 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 480.00 MB 2024-09-12T02:46:20.157 INFO:teuthology.orchestra.run.smithi112.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-12T02:46:20.224 INFO:teuthology.orchestra.run.smithi112.stdout:Reached fullness after 480.00 MB 2024-09-12T02:46:20.224 INFO:teuthology.orchestra.run.smithi112.stdout:calling close 2024-09-12T02:46:20.224 INFO:teuthology.orchestra.run.smithi112.stdout:close() did not raise error 2024-09-12T02:46:20.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:46:20.239 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:46:20.240 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:46:20.322 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:46:20.425 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:46:20.425 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:46:20.426 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:46:20.426 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:46:20.462 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:46:20.462 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:46:20.537 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:46:20.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.731+0000 7f44f7e00640 1 Processor -- start 2024-09-12T02:46:20.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.731+0000 7f44f7e00640 1 -- start start 2024-09-12T02:46:20.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.732+0000 7f44f7e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f44f815ed60 0x7f44f806d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:20.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.732+0000 7f44f7e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f44f80b74b0 0x7f44f80b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:20.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.732+0000 7f44f7e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44f80b3000 con 0x7f44f806da10 2024-09-12T02:46:20.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.732+0000 7f44f7e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f44f806de60 con 0x7f44f815ed60 2024-09-12T02:46:20.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.732+0000 7f44f7e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f44f80b3c10 con 0x7f44f80b74b0 2024-09-12T02:46:20.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.732+0000 7f44f6a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f44f815ed60 0x7f44f806d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:20.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.732+0000 7f44f6a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f44f815ed60 0x7f44f806d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40042/0 (socket says 172.21.15.112:40042) 2024-09-12T02:46:20.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.732+0000 7f44f6a00640 1 -- 172.21.15.112:0/2338534790 learned_addr learned my addr 172.21.15.112:0/2338534790 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:20.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.733+0000 7f44f7400640 1 --2- 172.21.15.112:0/2338534790 >> v2:172.21.15.137:3300/0 conn(0x7f44f80b74b0 0x7f44f80b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:20.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.733+0000 7f44f6a00640 1 -- 172.21.15.112:0/2338534790 >> v2:172.21.15.137:3300/0 conn(0x7f44f80b74b0 msgr2=0x7f44f80b78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:20.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.733+0000 7f44f6a00640 1 --2- 172.21.15.112:0/2338534790 >> v2:172.21.15.137:3300/0 conn(0x7f44f80b74b0 0x7f44f80b78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:20.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.733+0000 7f44f6a00640 1 -- 172.21.15.112:0/2338534790 >> v1:172.21.15.137:6789/0 conn(0x7f44f806da10 legacy=0x7f44f80af900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:20.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.733+0000 7f44f6a00640 1 -- 172.21.15.112:0/2338534790 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f80b32e0 con 0x7f44f815ed60 2024-09-12T02:46:20.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.733+0000 7f44f7400640 1 --2- 172.21.15.112:0/2338534790 >> v2:172.21.15.137:3300/0 conn(0x7f44f80b74b0 0x7f44f80b78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:46:20.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.734+0000 7f44f6a00640 1 --2- 172.21.15.112:0/2338534790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44f815ed60 0x7f44f806d4d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f44f806f130 tx=0x7f44e802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38cb6c4103334b58 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:20.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.734+0000 7f44f6000640 1 -- 172.21.15.112:0/2338534790 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e8037070 con 0x7f44f815ed60 2024-09-12T02:46:20.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.734+0000 7f44f6000640 1 -- 172.21.15.112:0/2338534790 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44e8032440 con 0x7f44f815ed60 2024-09-12T02:46:20.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.734+0000 7f44f6000640 1 -- 172.21.15.112:0/2338534790 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e8032810 con 0x7f44f815ed60 2024-09-12T02:46:20.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.735+0000 7f44f7e00640 1 -- 172.21.15.112:0/2338534790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44f815ed60 msgr2=0x7f44f806d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:20.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.735+0000 7f44f7e00640 1 --2- 172.21.15.112:0/2338534790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44f815ed60 0x7f44f806d4d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f44f806f130 tx=0x7f44e802a230 comp rx=0 tx=0).stop 2024-09-12T02:46:20.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.735+0000 7f44f7e00640 1 -- 172.21.15.112:0/2338534790 shutdown_connections 2024-09-12T02:46:20.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.735+0000 7f44f7e00640 1 --2- 172.21.15.112:0/2338534790 >> v2:172.21.15.137:3300/0 conn(0x7f44f80b74b0 0x7f44f80b78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:20.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.735+0000 7f44f7e00640 1 --2- 172.21.15.112:0/2338534790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44f815ed60 0x7f44f806d4d0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:20.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.735+0000 7f44f7e00640 1 -- 172.21.15.112:0/2338534790 >> 172.21.15.112:0/2338534790 conn(0x7f44f80b7e80 msgr2=0x7f44f80b8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:20.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.735+0000 7f44f7e00640 1 -- 172.21.15.112:0/2338534790 shutdown_connections 2024-09-12T02:46:20.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.735+0000 7f44f7e00640 1 -- 172.21.15.112:0/2338534790 wait complete. 2024-09-12T02:46:20.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.737+0000 7f44f7e00640 1 Processor -- start 2024-09-12T02:46:20.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.737+0000 7f44f7e00640 1 -- start start 2024-09-12T02:46:20.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.737+0000 7f44f7e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44f806da10 0x7f44f80b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:20.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.738+0000 7f44f7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44f80b74b0 0x7f44f80cd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:20.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.738+0000 7f44f7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44f815ed60 0x7f44f81f5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:20.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.738+0000 7f44f7e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f44f806e270 con 0x7f44f815ed60 2024-09-12T02:46:20.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.738+0000 7f44f7e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f44f80b38a0 con 0x7f44f80b74b0 2024-09-12T02:46:20.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.738+0000 7f44f7e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f44f80b40a0 con 0x7f44f806da10 2024-09-12T02:46:20.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.738+0000 7f44f7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44f815ed60 0x7f44f81f5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:20.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.738+0000 7f44f7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44f815ed60 0x7f44f81f5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40050/0 (socket says 172.21.15.112:40050) 2024-09-12T02:46:20.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.738+0000 7f44f7400640 1 -- 172.21.15.112:0/4189813026 learned_addr learned my addr 172.21.15.112:0/4189813026 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:20.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.738+0000 7f44f6a00640 1 --2- 172.21.15.112:0/4189813026 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44f806da10 0x7f44f80b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:20.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.738+0000 7f44efe00640 1 --2- 172.21.15.112:0/4189813026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44f80b74b0 0x7f44f80cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:20.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.738+0000 7f44f7400640 1 -- 172.21.15.112:0/4189813026 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44f806da10 msgr2=0x7f44f80b0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:20.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.738+0000 7f44f7400640 1 --2- 172.21.15.112:0/4189813026 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44f806da10 0x7f44f80b0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:20.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.738+0000 7f44f7400640 1 -- 172.21.15.112:0/4189813026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44f80b74b0 msgr2=0x7f44f80cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:20.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.738+0000 7f44f7400640 1 --2- 172.21.15.112:0/4189813026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44f80b74b0 0x7f44f80cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:20.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.738+0000 7f44f7400640 1 -- 172.21.15.112:0/4189813026 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f81f5b70 con 0x7f44f815ed60 2024-09-12T02:46:20.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.738+0000 7f44efe00640 1 --2- 172.21.15.112:0/4189813026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44f80b74b0 0x7f44f80cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:20.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.739+0000 7f44f7400640 1 --2- 172.21.15.112:0/4189813026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44f815ed60 0x7f44f81f5630 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f44f000cef0 tx=0x7f44f000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:20.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.739+0000 7f44eea00640 1 -- 172.21.15.112:0/4189813026 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f001a070 con 0x7f44f815ed60 2024-09-12T02:46:20.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.739+0000 7f44eea00640 1 -- 172.21.15.112:0/4189813026 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44f000d860 con 0x7f44f815ed60 2024-09-12T02:46:20.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.739+0000 7f44f7e00640 1 -- 172.21.15.112:0/4189813026 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44f80b2620 con 0x7f44f815ed60 2024-09-12T02:46:20.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.739+0000 7f44eea00640 1 -- 172.21.15.112:0/4189813026 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f000dc50 con 0x7f44f815ed60 2024-09-12T02:46:20.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.739+0000 7f44f7e00640 1 -- 172.21.15.112:0/4189813026 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44f80b0030 con 0x7f44f815ed60 2024-09-12T02:46:20.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.740+0000 7f44f7e00640 1 -- 172.21.15.112:0/4189813026 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44f815f140 con 0x7f44f815ed60 2024-09-12T02:46:20.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.741+0000 7f44eea00640 1 -- 172.21.15.112:0/4189813026 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f44f001d070 con 0x7f44f815ed60 2024-09-12T02:46:20.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.742+0000 7f44eea00640 1 --2- 172.21.15.112:0/4189813026 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f44d406be30 0x7f44d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:20.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.742+0000 7f44eea00640 1 -- 172.21.15.112:0/4189813026 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f44f008b6d0 con 0x7f44f815ed60 2024-09-12T02:46:20.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.742+0000 7f44f6a00640 1 --2- 172.21.15.112:0/4189813026 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f44d406be30 0x7f44d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:20.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.742+0000 7f44eea00640 1 -- 172.21.15.112:0/4189813026 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=85}) -- 0x7f44d4073a20 con 0x7f44f815ed60 2024-09-12T02:46:20.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.743+0000 7f44f6a00640 1 --2- 172.21.15.112:0/4189813026 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f44d406be30 0x7f44d406e2f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f44e8034000 tx=0x7f44e802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:20.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.746+0000 7f44eea00640 1 -- 172.21.15.112:0/4189813026 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f44f81f5b70 con 0x7f44f815ed60 2024-09-12T02:46:20.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.932+0000 7f44f7e00640 1 -- 172.21.15.112:0/4189813026 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f44f80b2c30 con 0x7f44f815ed60 2024-09-12T02:46:20.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.932+0000 7f44eea00640 1 -- 172.21.15.112:0/4189813026 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v84) ==== 80+0+0 (secure 0 0 0) 0x7f44f0059ab0 con 0x7f44f815ed60 2024-09-12T02:46:20.933 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-12T02:46:20.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.934+0000 7f44f7e00640 1 -- 172.21.15.112:0/4189813026 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f44d406be30 msgr2=0x7f44d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:20.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.934+0000 7f44f7e00640 1 --2- 172.21.15.112:0/4189813026 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f44d406be30 0x7f44d406e2f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f44e8034000 tx=0x7f44e802e000 comp rx=0 tx=0).stop 2024-09-12T02:46:20.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.934+0000 7f44f7e00640 1 -- 172.21.15.112:0/4189813026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44f815ed60 msgr2=0x7f44f81f5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:20.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.934+0000 7f44f7e00640 1 --2- 172.21.15.112:0/4189813026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44f815ed60 0x7f44f81f5630 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f44f000cef0 tx=0x7f44f000a710 comp rx=0 tx=0).stop 2024-09-12T02:46:20.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.935+0000 7f44f7e00640 1 -- 172.21.15.112:0/4189813026 shutdown_connections 2024-09-12T02:46:20.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.935+0000 7f44f7e00640 1 --2- 172.21.15.112:0/4189813026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44f815ed60 0x7f44f81f5630 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:20.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.935+0000 7f44f7e00640 1 --2- 172.21.15.112:0/4189813026 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f44d406be30 0x7f44d406e2f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:20.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.935+0000 7f44f7e00640 1 --2- 172.21.15.112:0/4189813026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44f80b74b0 0x7f44f80cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:20.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.935+0000 7f44f7e00640 1 --2- 172.21.15.112:0/4189813026 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44f806da10 0x7f44f80b0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:20.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.935+0000 7f44f7e00640 1 -- 172.21.15.112:0/4189813026 >> 172.21.15.112:0/4189813026 conn(0x7f44f80b7e80 msgr2=0x7f44f815dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:20.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.935+0000 7f44f7e00640 1 -- 172.21.15.112:0/4189813026 shutdown_connections 2024-09-12T02:46:20.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:20.935+0000 7f44f7e00640 1 -- 172.21.15.112:0/4189813026 wait complete. 2024-09-12T02:46:20.951 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:46:20.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:20.951 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T02:46:21.015 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-12T02:46:21.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:21.015 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:46:21.051 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:46:21.051 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:46:21.052 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:46:21.092 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:46:21.092 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:46:21.171 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:46:21.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.325+0000 7f4599e00640 1 Processor -- start 2024-09-12T02:46:21.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.325+0000 7f4599e00640 1 -- start start 2024-09-12T02:46:21.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.326+0000 7f4599e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45940d1710 0x7f45940d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:21.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.326+0000 7f4599e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f45940b3e00 0x7f45940d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:21.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.326+0000 7f4599e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f45940cf7a0 0x7f45940cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:21.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.326+0000 7f4599e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f45940d3cb0 con 0x7f45940cf7a0 2024-09-12T02:46:21.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.326+0000 7f4599e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f45940d2fb0 con 0x7f45940b3e00 2024-09-12T02:46:21.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.326+0000 7f4599e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f45940d0b60 con 0x7f45940d1710 2024-09-12T02:46:21.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.326+0000 7f4599400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f45940cf7a0 0x7f45940cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:21.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.327+0000 7f4599400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f45940cf7a0 0x7f45940cfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40064/0 (socket says 172.21.15.112:40064) 2024-09-12T02:46:21.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.327+0000 7f4599400640 1 -- 172.21.15.112:0/4148831263 learned_addr learned my addr 172.21.15.112:0/4148831263 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:21.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.327+0000 7f4593e00640 1 --2- 172.21.15.112:0/4148831263 >> v2:172.21.15.137:3300/0 conn(0x7f45940b3e00 0x7f45940d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:21.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.327+0000 7f4598a00640 1 --2- 172.21.15.112:0/4148831263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45940d1710 0x7f45940d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:21.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.327+0000 7f4599400640 1 -- 172.21.15.112:0/4148831263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45940d1710 msgr2=0x7f45940d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:21.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.327+0000 7f4599400640 1 --2- 172.21.15.112:0/4148831263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45940d1710 0x7f45940d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:21.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.327+0000 7f4599400640 1 -- 172.21.15.112:0/4148831263 >> v2:172.21.15.137:3300/0 conn(0x7f45940b3e00 msgr2=0x7f45940d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:21.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.327+0000 7f4599400640 1 --2- 172.21.15.112:0/4148831263 >> v2:172.21.15.137:3300/0 conn(0x7f45940b3e00 0x7f45940d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:21.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.327+0000 7f4599400640 1 -- 172.21.15.112:0/4148831263 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45940d2030 con 0x7f45940cf7a0 2024-09-12T02:46:21.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.327+0000 7f4598a00640 1 --2- 172.21.15.112:0/4148831263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45940d1710 0x7f45940d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:21.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.328+0000 7f4599400640 1 --2- 172.21.15.112:0/4148831263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45940cf7a0 0x7f45940cfc50 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f459406ee50 tx=0x7f458c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d69c668211b3388 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:21.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.328+0000 7f4593400640 1 -- 172.21.15.112:0/4148831263 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c036070 con 0x7f45940cf7a0 2024-09-12T02:46:21.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.328+0000 7f4593400640 1 -- 172.21.15.112:0/4148831263 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f458c031600 con 0x7f45940cf7a0 2024-09-12T02:46:21.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.328+0000 7f4593400640 1 -- 172.21.15.112:0/4148831263 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c0319d0 con 0x7f45940cf7a0 2024-09-12T02:46:21.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.329+0000 7f4599e00640 1 -- 172.21.15.112:0/4148831263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45940cf7a0 msgr2=0x7f45940cfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:21.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.329+0000 7f4599e00640 1 --2- 172.21.15.112:0/4148831263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45940cf7a0 0x7f45940cfc50 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f459406ee50 tx=0x7f458c02a6a0 comp rx=0 tx=0).stop 2024-09-12T02:46:21.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.329+0000 7f4599e00640 1 -- 172.21.15.112:0/4148831263 shutdown_connections 2024-09-12T02:46:21.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.329+0000 7f4599e00640 1 --2- 172.21.15.112:0/4148831263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45940cf7a0 0x7f45940cfc50 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:21.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.329+0000 7f4599e00640 1 --2- 172.21.15.112:0/4148831263 >> v2:172.21.15.137:3300/0 conn(0x7f45940b3e00 0x7f45940d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:21.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.329+0000 7f4599e00640 1 --2- 172.21.15.112:0/4148831263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45940d1710 0x7f45940d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:21.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.329+0000 7f4599e00640 1 -- 172.21.15.112:0/4148831263 >> 172.21.15.112:0/4148831263 conn(0x7f459409e030 msgr2=0x7f45940d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:21.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.329+0000 7f4599e00640 1 -- 172.21.15.112:0/4148831263 shutdown_connections 2024-09-12T02:46:21.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.329+0000 7f4599e00640 1 -- 172.21.15.112:0/4148831263 wait complete. 2024-09-12T02:46:21.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.331+0000 7f4599e00640 1 Processor -- start 2024-09-12T02:46:21.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.331+0000 7f4599e00640 1 -- start start 2024-09-12T02:46:21.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.332+0000 7f4599e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45940b3e00 0x7f4594152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:21.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.332+0000 7f4599e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45940cf7a0 0x7f45940b9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:21.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.332+0000 7f4599e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45940d1710 0x7f459415f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:21.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.332+0000 7f4599e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f45940d39d0 con 0x7f45940b3e00 2024-09-12T02:46:21.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.332+0000 7f4599e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f45940d36f0 con 0x7f45940d1710 2024-09-12T02:46:21.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.332+0000 7f4599e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f459415f110 con 0x7f45940cf7a0 2024-09-12T02:46:21.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.332+0000 7f4598a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45940b3e00 0x7f4594152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:21.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.332+0000 7f4598a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45940b3e00 0x7f4594152170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40072/0 (socket says 172.21.15.112:40072) 2024-09-12T02:46:21.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.332+0000 7f4598a00640 1 -- 172.21.15.112:0/1885193873 learned_addr learned my addr 172.21.15.112:0/1885193873 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:21.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.332+0000 7f4598a00640 1 -- 172.21.15.112:0/1885193873 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45940cf7a0 msgr2=0x7f45940b9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:21.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.332+0000 7f4598a00640 1 --2- 172.21.15.112:0/1885193873 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45940cf7a0 0x7f45940b9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:21.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.332+0000 7f4598a00640 1 -- 172.21.15.112:0/1885193873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45940d1710 msgr2=0x7f459415f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:21.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.332+0000 7f4598a00640 1 --2- 172.21.15.112:0/1885193873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45940d1710 0x7f459415f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:21.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.332+0000 7f4598a00640 1 -- 172.21.15.112:0/1885193873 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45941526b0 con 0x7f45940b3e00 2024-09-12T02:46:21.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.333+0000 7f4598a00640 1 --2- 172.21.15.112:0/1885193873 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45940b3e00 0x7f4594152170 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f458800d7d0 tx=0x7f458800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:21.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.333+0000 7f4590c00640 1 -- 172.21.15.112:0/1885193873 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4588004030 con 0x7f45940b3e00 2024-09-12T02:46:21.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.333+0000 7f4590c00640 1 -- 172.21.15.112:0/1885193873 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45880041d0 con 0x7f45940b3e00 2024-09-12T02:46:21.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.333+0000 7f4599e00640 1 -- 172.21.15.112:0/1885193873 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45940cc920 con 0x7f45940b3e00 2024-09-12T02:46:21.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.333+0000 7f4590c00640 1 -- 172.21.15.112:0/1885193873 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45880096a0 con 0x7f45940b3e00 2024-09-12T02:46:21.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.333+0000 7f4599e00640 1 -- 172.21.15.112:0/1885193873 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45940ba2c0 con 0x7f45940b3e00 2024-09-12T02:46:21.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.334+0000 7f4599e00640 1 -- 172.21.15.112:0/1885193873 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45940ba4c0 con 0x7f45940b3e00 2024-09-12T02:46:21.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.335+0000 7f4590c00640 1 -- 172.21.15.112:0/1885193873 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4588009840 con 0x7f45940b3e00 2024-09-12T02:46:21.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.336+0000 7f4590c00640 1 --2- 172.21.15.112:0/1885193873 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f457406be30 0x7f457406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:21.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.336+0000 7f4590c00640 1 -- 172.21.15.112:0/1885193873 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f458808b200 con 0x7f45940b3e00 2024-09-12T02:46:21.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.336+0000 7f4593e00640 1 --2- 172.21.15.112:0/1885193873 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f457406be30 0x7f457406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:21.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.336+0000 7f4590c00640 1 -- 172.21.15.112:0/1885193873 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=85}) -- 0x7f4574073a80 con 0x7f45940b3e00 2024-09-12T02:46:21.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.336+0000 7f4593e00640 1 --2- 172.21.15.112:0/1885193873 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f457406be30 0x7f457406e2f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4580006a90 tx=0x7f4580006a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:21.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.340+0000 7f4590c00640 1 -- 172.21.15.112:0/1885193873 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f45941526b0 con 0x7f45940b3e00 2024-09-12T02:46:21.457 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:46:21.461 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:46:21.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.529+0000 7f4599e00640 1 -- 172.21.15.112:0/1885193873 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f45940d1af0 con 0x7f45940b3e00 2024-09-12T02:46:21.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.530+0000 7f4590c00640 1 -- 172.21.15.112:0/1885193873 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v84) ==== 80+0+0 (secure 0 0 0) 0x7f4588059ad0 con 0x7f45940b3e00 2024-09-12T02:46:21.531 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-12T02:46:21.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.532+0000 7f4599e00640 1 -- 172.21.15.112:0/1885193873 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f457406be30 msgr2=0x7f457406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:21.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.532+0000 7f4599e00640 1 --2- 172.21.15.112:0/1885193873 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f457406be30 0x7f457406e2f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4580006a90 tx=0x7f4580006a20 comp rx=0 tx=0).stop 2024-09-12T02:46:21.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.532+0000 7f4599e00640 1 -- 172.21.15.112:0/1885193873 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45940b3e00 msgr2=0x7f4594152170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:21.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.532+0000 7f4599e00640 1 --2- 172.21.15.112:0/1885193873 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45940b3e00 0x7f4594152170 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f458800d7d0 tx=0x7f458800dc90 comp rx=0 tx=0).stop 2024-09-12T02:46:21.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.532+0000 7f4599e00640 1 -- 172.21.15.112:0/1885193873 shutdown_connections 2024-09-12T02:46:21.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.532+0000 7f4599e00640 1 --2- 172.21.15.112:0/1885193873 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f457406be30 0x7f457406e2f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:21.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.532+0000 7f4599e00640 1 --2- 172.21.15.112:0/1885193873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45940d1710 0x7f459415f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:21.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.532+0000 7f4599e00640 1 --2- 172.21.15.112:0/1885193873 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45940cf7a0 0x7f45940b9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:21.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.532+0000 7f4599e00640 1 --2- 172.21.15.112:0/1885193873 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45940b3e00 0x7f4594152170 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:21.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.532+0000 7f4599e00640 1 -- 172.21.15.112:0/1885193873 >> 172.21.15.112:0/1885193873 conn(0x7f459409e030 msgr2=0x7f45940b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:21.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.532+0000 7f4599e00640 1 -- 172.21.15.112:0/1885193873 shutdown_connections 2024-09-12T02:46:21.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.532+0000 7f4599e00640 1 -- 172.21.15.112:0/1885193873 wait complete. 2024-09-12T02:46:21.549 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-12T02:46:21.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:21.549 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-12T02:46:21.611 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T02:46:21.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:21.611 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T02:46:21.688 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:46:21.688 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:46:21.688 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:46:21.724 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:46:21.724 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:46:21.724 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:46:21.725 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:46:21.763 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:46:21.763 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:46:21.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.977+0000 7f8363a00640 1 Processor -- start 2024-09-12T02:46:21.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.978+0000 7f8363a00640 1 -- start start 2024-09-12T02:46:21.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.980+0000 7f8363a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f835c0d0c20 0x7f835c0d58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:21.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.980+0000 7f8363a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f835c0cfa70 con 0x7f835c1624e0 2024-09-12T02:46:21.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.980+0000 7f8363a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f835c0d21d0 con 0x7f835c162100 2024-09-12T02:46:21.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.980+0000 7f8363a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f835c0b4e20 con 0x7f835c0d0c20 2024-09-12T02:46:21.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.980+0000 7f8361000640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f835c162100 0x7f835c0b4710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.112:53660/0 (socket says 172.21.15.112:53660) 2024-09-12T02:46:21.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.980+0000 7f8361000640 1 -- 172.21.15.112:0/1370019666 learned_addr learned my addr 172.21.15.112:0/1370019666 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:46:21.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.981+0000 7f8361a00640 1 --2- 172.21.15.112:0/1370019666 >> v2:172.21.15.137:3300/0 conn(0x7f835c0d0c20 0x7f835c0d58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:21.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.982+0000 7f835be00640 1 -- 172.21.15.112:0/1370019666 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 378708369 0 0) 0x7f835c0d21d0 con 0x7f835c162100 2024-09-12T02:46:21.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.982+0000 7f835be00640 1 -- 172.21.15.112:0/1370019666 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8340003520 con 0x7f835c162100 2024-09-12T02:46:21.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.982+0000 7f8361a00640 1 -- 172.21.15.112:0/1370019666 >> v1:172.21.15.137:6789/0 conn(0x7f835c162100 legacy=0x7f835c0b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:21.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.982+0000 7f8361a00640 1 -- 172.21.15.112:0/1370019666 >> v1:172.21.15.112:6789/0 conn(0x7f835c1624e0 legacy=0x7f835c0d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:21.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.982+0000 7f8361a00640 1 -- 172.21.15.112:0/1370019666 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f835c0d24b0 con 0x7f835c0d0c20 2024-09-12T02:46:21.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.983+0000 7f8361a00640 1 --2- 172.21.15.112:0/1370019666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f835c0d0c20 0x7f835c0d58d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f83540097a0 tx=0x7f835402a140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=deef24a7d0e605ba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:21.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.984+0000 7f835be00640 1 -- 172.21.15.112:0/1370019666 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8354037070 con 0x7f835c0d0c20 2024-09-12T02:46:21.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.984+0000 7f835be00640 1 -- 172.21.15.112:0/1370019666 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f835402ae50 con 0x7f835c0d0c20 2024-09-12T02:46:21.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.984+0000 7f835be00640 1 -- 172.21.15.112:0/1370019666 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8354032660 con 0x7f835c0d0c20 2024-09-12T02:46:21.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.986+0000 7f8363a00640 1 -- 172.21.15.112:0/1370019666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f835c0d0c20 msgr2=0x7f835c0d58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:21.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.986+0000 7f8363a00640 1 --2- 172.21.15.112:0/1370019666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f835c0d0c20 0x7f835c0d58d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f83540097a0 tx=0x7f835402a140 comp rx=0 tx=0).stop 2024-09-12T02:46:21.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.986+0000 7f8363a00640 1 -- 172.21.15.112:0/1370019666 shutdown_connections 2024-09-12T02:46:21.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.986+0000 7f8363a00640 1 --2- 172.21.15.112:0/1370019666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f835c0d0c20 0x7f835c0d58d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:21.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.986+0000 7f8363a00640 1 -- 172.21.15.112:0/1370019666 >> 172.21.15.112:0/1370019666 conn(0x7f835c0d4db0 msgr2=0x7f835c0d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:21.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.987+0000 7f8363a00640 1 -- 172.21.15.112:0/1370019666 shutdown_connections 2024-09-12T02:46:21.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.987+0000 7f8363a00640 1 -- 172.21.15.112:0/1370019666 wait complete. 2024-09-12T02:46:21.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.989+0000 7f8363a00640 1 Processor -- start 2024-09-12T02:46:21.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.989+0000 7f8363a00640 1 -- start start 2024-09-12T02:46:21.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.991+0000 7f8363a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f835c0d0c20 0x7f835c0ce180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:21.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.991+0000 7f8363a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f835c162100 0x7f835c0c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:21.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.991+0000 7f8363a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f835c1624e0 0x7f835c0c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:21.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.991+0000 7f8363a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f835c0d1df0 con 0x7f835c1624e0 2024-09-12T02:46:21.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.991+0000 7f8363a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f835c0cfff0 con 0x7f835c0d0c20 2024-09-12T02:46:21.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.991+0000 7f8363a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f835c0d1f70 con 0x7f835c162100 2024-09-12T02:46:21.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.992+0000 7f8353e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f835c162100 0x7f835c0c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:21.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.992+0000 7f8353e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f835c162100 0x7f835c0c9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:38714/0 (socket says 172.21.15.112:38714) 2024-09-12T02:46:21.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.992+0000 7f8353e00640 1 -- 172.21.15.112:0/1733839593 learned_addr learned my addr 172.21.15.112:0/1733839593 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:21.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.992+0000 7f8361000640 1 --2- 172.21.15.112:0/1733839593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f835c0d0c20 0x7f835c0ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:21.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.992+0000 7f8361a00640 1 --2- 172.21.15.112:0/1733839593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f835c1624e0 0x7f835c0c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:21.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.992+0000 7f8361000640 1 -- 172.21.15.112:0/1733839593 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f835c162100 msgr2=0x7f835c0c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:21.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.992+0000 7f8361000640 1 --2- 172.21.15.112:0/1733839593 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f835c162100 0x7f835c0c9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:21.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.992+0000 7f8361000640 1 -- 172.21.15.112:0/1733839593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f835c1624e0 msgr2=0x7f835c0c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:21.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.992+0000 7f8361000640 1 --2- 172.21.15.112:0/1733839593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f835c1624e0 0x7f835c0c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:21.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.992+0000 7f8361000640 1 -- 172.21.15.112:0/1733839593 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f835c06d9a0 con 0x7f835c0d0c20 2024-09-12T02:46:21.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.993+0000 7f8361a00640 1 --2- 172.21.15.112:0/1733839593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f835c1624e0 0x7f835c0c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:46:21.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.993+0000 7f8361000640 1 --2- 172.21.15.112:0/1733839593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f835c0d0c20 0x7f835c0ce180 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f834c00c8c0 tx=0x7f834c00cd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:21.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.994+0000 7f8359600640 1 -- 172.21.15.112:0/1733839593 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c018070 con 0x7f835c0d0c20 2024-09-12T02:46:21.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.994+0000 7f8359600640 1 -- 172.21.15.112:0/1733839593 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f834c00a640 con 0x7f835c0d0c20 2024-09-12T02:46:21.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.994+0000 7f8359600640 1 -- 172.21.15.112:0/1733839593 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c00aa10 con 0x7f835c0d0c20 2024-09-12T02:46:21.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.994+0000 7f8363a00640 1 -- 172.21.15.112:0/1733839593 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f835c06dc80 con 0x7f835c0d0c20 2024-09-12T02:46:21.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.994+0000 7f8363a00640 1 -- 172.21.15.112:0/1733839593 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f835c0cd980 con 0x7f835c0d0c20 2024-09-12T02:46:21.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.996+0000 7f8363a00640 1 -- 172.21.15.112:0/1733839593 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f835c162b80 con 0x7f835c0d0c20 2024-09-12T02:46:21.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.997+0000 7f8359600640 1 -- 172.21.15.112:0/1733839593 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f834c01b070 con 0x7f835c0d0c20 2024-09-12T02:46:21.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.998+0000 7f8359600640 1 --2- 172.21.15.112:0/1733839593 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f833806be80 0x7f833806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:21.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.998+0000 7f8359600640 1 -- 172.21.15.112:0/1733839593 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f834c08a5e0 con 0x7f835c0d0c20 2024-09-12T02:46:21.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.998+0000 7f8359600640 1 -- 172.21.15.112:0/1733839593 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=85}) -- 0x7f8338073a70 con 0x7f835c0d0c20 2024-09-12T02:46:21.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.998+0000 7f8353e00640 1 --2- 172.21.15.112:0/1733839593 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f833806be80 0x7f833806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:22.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:21.999+0000 7f8353e00640 1 --2- 172.21.15.112:0/1733839593 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f833806be80 0x7f833806e340 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f835c0b73f0 tx=0x7f8344009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:22.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.003+0000 7f8359600640 1 -- 172.21.15.112:0/1733839593 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f834c0588e0 con 0x7f835c0d0c20 2024-09-12T02:46:22.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.225+0000 7f8363a00640 1 -- 172.21.15.112:0/1733839593 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f835c0b7eb0 con 0x7f835c0d0c20 2024-09-12T02:46:22.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.226+0000 7f8359600640 1 -- 172.21.15.112:0/1733839593 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5234 (secure 0 0 0) 0x7f834c05cbe0 con 0x7f835c0d0c20 2024-09-12T02:46:22.227 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:46:22.227 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":44,"btime":"2024-09-12T02:45:39:811882+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/2773143619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2773143619},{"type":"v1","addr":"172.21.15.137:6834","nonce":2773143619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5186,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2810064950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2810064950},{"type":"v1","addr":"172.21.15.137:6835","nonce":2810064950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5192,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/366104267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":366104267},{"type":"v1","addr":"172.21.15.112:6837","nonce":366104267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:45:36.194908+0000","modified":"2024-09-12T02:45:39.214065+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5545":{"gid":5545,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/1248364583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1248364583},{"type":"v1","addr":"172.21.15.112:6836","nonce":1248364583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5545,"qdb_cluster":[5545]},"id":5}]} 2024-09-12T02:46:22.227 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 44 2024-09-12T02:46:22.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.228+0000 7f8363a00640 1 -- 172.21.15.112:0/1733839593 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f833806be80 msgr2=0x7f833806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:22.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.228+0000 7f8363a00640 1 --2- 172.21.15.112:0/1733839593 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f833806be80 0x7f833806e340 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f835c0b73f0 tx=0x7f8344009040 comp rx=0 tx=0).stop 2024-09-12T02:46:22.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.228+0000 7f8363a00640 1 -- 172.21.15.112:0/1733839593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f835c0d0c20 msgr2=0x7f835c0ce180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:22.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.228+0000 7f8363a00640 1 --2- 172.21.15.112:0/1733839593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f835c0d0c20 0x7f835c0ce180 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f834c00c8c0 tx=0x7f834c00cd80 comp rx=0 tx=0).stop 2024-09-12T02:46:22.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.228+0000 7f8363a00640 1 -- 172.21.15.112:0/1733839593 shutdown_connections 2024-09-12T02:46:22.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.228+0000 7f8363a00640 1 --2- 172.21.15.112:0/1733839593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f835c1624e0 0x7f835c0c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.228+0000 7f8363a00640 1 --2- 172.21.15.112:0/1733839593 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f835c162100 0x7f835c0c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.228+0000 7f8363a00640 1 --2- 172.21.15.112:0/1733839593 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f833806be80 0x7f833806e340 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.228+0000 7f8363a00640 1 --2- 172.21.15.112:0/1733839593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f835c0d0c20 0x7f835c0ce180 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.228+0000 7f8363a00640 1 -- 172.21.15.112:0/1733839593 >> 172.21.15.112:0/1733839593 conn(0x7f835c0d4db0 msgr2=0x7f835c0b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:22.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.229+0000 7f8363a00640 1 -- 172.21.15.112:0/1733839593 shutdown_connections 2024-09-12T02:46:22.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.229+0000 7f8363a00640 1 -- 172.21.15.112:0/1733839593 wait complete. 2024-09-12T02:46:22.245 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:46:22.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.397+0000 7fef4da00640 1 Processor -- start 2024-09-12T02:46:22.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.397+0000 7fef4da00640 1 -- start start 2024-09-12T02:46:22.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.399+0000 7fef4da00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fef48071530 0x7fef480af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:22.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.399+0000 7fef4da00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef480ceeb0 con 0x7fef480719a0 2024-09-12T02:46:22.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.399+0000 7fef4da00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef4806e300 con 0x7fef4815cc50 2024-09-12T02:46:22.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.399+0000 7fef4da00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fef4815d030 con 0x7fef48071530 2024-09-12T02:46:22.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.399+0000 7fef47400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fef480719a0 0x7fef480cf950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59698/0 (socket says 172.21.15.112:59698) 2024-09-12T02:46:22.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.399+0000 7fef47400640 1 -- 172.21.15.112:0/1428068602 learned_addr learned my addr 172.21.15.112:0/1428068602 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:46:22.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.399+0000 7fef3e000640 1 --2- 172.21.15.112:0/1428068602 >> v2:172.21.15.137:3300/0 conn(0x7fef48071530 0x7fef480af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:22.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.399+0000 7fef46000640 1 -- 172.21.15.112:0/1428068602 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1185888829 0 0) 0x7fef480ceeb0 con 0x7fef480719a0 2024-09-12T02:46:22.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.399+0000 7fef46000640 1 -- 172.21.15.112:0/1428068602 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef2c003520 con 0x7fef480719a0 2024-09-12T02:46:22.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.400+0000 7fef46000640 1 -- 172.21.15.112:0/1428068602 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1335070208 0 0) 0x7fef2c003520 con 0x7fef480719a0 2024-09-12T02:46:22.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.400+0000 7fef46000640 1 -- 172.21.15.112:0/1428068602 >> v2:172.21.15.137:3300/0 conn(0x7fef48071530 msgr2=0x7fef480af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:22.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.400+0000 7fef46000640 1 --2- 172.21.15.112:0/1428068602 >> v2:172.21.15.137:3300/0 conn(0x7fef48071530 0x7fef480af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.400+0000 7fef46000640 1 -- 172.21.15.112:0/1428068602 >> v1:172.21.15.137:6789/0 conn(0x7fef4815cc50 legacy=0x7fef480732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:22.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.400+0000 7fef46000640 1 -- 172.21.15.112:0/1428068602 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef4806e5e0 con 0x7fef480719a0 2024-09-12T02:46:22.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.400+0000 7fef46000640 1 -- 172.21.15.112:0/1428068602 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7fef400019f0 con 0x7fef480719a0 2024-09-12T02:46:22.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.400+0000 7fef46000640 1 -- 172.21.15.112:0/1428068602 >> v1:172.21.15.112:6789/0 conn(0x7fef480719a0 legacy=0x7fef480cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:22.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.400+0000 7fef46000640 1 --2- 172.21.15.112:0/1428068602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef2c0039b0 0x7fef2c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:22.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.400+0000 7fef46000640 1 --2- 172.21.15.112:0/1428068602 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef2c004800 0x7fef2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:22.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.400+0000 7fef46000640 1 --2- 172.21.15.112:0/1428068602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef2c0051c0 0x7fef2c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:22.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.400+0000 7fef46000640 1 -- 172.21.15.112:0/1428068602 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fef2c00c130 con 0x7fef2c0051c0 2024-09-12T02:46:22.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.400+0000 7fef46000640 1 -- 172.21.15.112:0/1428068602 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fef2c00c2e0 con 0x7fef2c0039b0 2024-09-12T02:46:22.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.400+0000 7fef46000640 1 -- 172.21.15.112:0/1428068602 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fef2c00c4e0 con 0x7fef2c004800 2024-09-12T02:46:22.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.400+0000 7fef46a00640 1 --2- 172.21.15.112:0/1428068602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef2c0039b0 0x7fef2c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:22.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.400+0000 7fef47400640 1 --2- 172.21.15.112:0/1428068602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef2c0051c0 0x7fef2c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:22.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.400+0000 7fef3e000640 1 --2- 172.21.15.112:0/1428068602 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef2c004800 0x7fef2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:22.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.401+0000 7fef47400640 1 -- 172.21.15.112:0/1428068602 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef2c004800 msgr2=0x7fef2c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:22.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.401+0000 7fef47400640 1 --2- 172.21.15.112:0/1428068602 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef2c004800 0x7fef2c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.401+0000 7fef47400640 1 -- 172.21.15.112:0/1428068602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef2c0039b0 msgr2=0x7fef2c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:22.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.401+0000 7fef47400640 1 --2- 172.21.15.112:0/1428068602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef2c0039b0 0x7fef2c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.401+0000 7fef47400640 1 -- 172.21.15.112:0/1428068602 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef2c003520 con 0x7fef2c0051c0 2024-09-12T02:46:22.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.401+0000 7fef46a00640 1 --2- 172.21.15.112:0/1428068602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef2c0039b0 0x7fef2c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:46:22.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.401+0000 7fef47400640 1 -- 172.21.15.112:0/1428068602 reap_dead start 2024-09-12T02:46:22.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.401+0000 7fef47400640 1 --2- 172.21.15.112:0/1428068602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef2c0051c0 0x7fef2c00b9c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fef4000a810 tx=0x7fef2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22ba68d76dba36a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:22.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.402+0000 7fef46000640 1 -- 172.21.15.112:0/1428068602 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef38001370 con 0x7fef2c0051c0 2024-09-12T02:46:22.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.402+0000 7fef46000640 1 -- 172.21.15.112:0/1428068602 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef4002f070 con 0x7fef2c0051c0 2024-09-12T02:46:22.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.402+0000 7fef46000640 1 -- 172.21.15.112:0/1428068602 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4000a460 con 0x7fef2c0051c0 2024-09-12T02:46:22.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.402+0000 7fef4da00640 1 -- 172.21.15.112:0/1428068602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef2c0051c0 msgr2=0x7fef2c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:22.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.402+0000 7fef4da00640 1 --2- 172.21.15.112:0/1428068602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef2c0051c0 0x7fef2c00b9c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fef4000a810 tx=0x7fef2c005830 comp rx=0 tx=0).stop 2024-09-12T02:46:22.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.402+0000 7fef4da00640 1 -- 172.21.15.112:0/1428068602 shutdown_connections 2024-09-12T02:46:22.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.402+0000 7fef4da00640 1 --2- 172.21.15.112:0/1428068602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef2c0051c0 0x7fef2c00b9c0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.402+0000 7fef4da00640 1 -- 172.21.15.112:0/1428068602 >> 172.21.15.112:0/1428068602 conn(0x7fef4806bbd0 msgr2=0x7fef4806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:22.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.402+0000 7fef4da00640 1 -- 172.21.15.112:0/1428068602 shutdown_connections 2024-09-12T02:46:22.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.402+0000 7fef4da00640 1 -- 172.21.15.112:0/1428068602 wait complete. 2024-09-12T02:46:22.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.404+0000 7fef4da00640 1 Processor -- start 2024-09-12T02:46:22.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.404+0000 7fef4da00640 1 -- start start 2024-09-12T02:46:22.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.405+0000 7fef4da00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef2c0051c0 0x7fef480ab840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:22.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.405+0000 7fef4da00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef4814bae0 0x7fef480ac650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:22.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.405+0000 7fef4da00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef4815b810 0x7fef4815bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:22.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.405+0000 7fef4da00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fef4806f510 con 0x7fef4815b810 2024-09-12T02:46:22.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.405+0000 7fef4da00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fef480cf4c0 con 0x7fef4814bae0 2024-09-12T02:46:22.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.405+0000 7fef4da00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fef4806f690 con 0x7fef2c0051c0 2024-09-12T02:46:22.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.405+0000 7fef47400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef4815b810 0x7fef4815bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:22.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.405+0000 7fef47400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef4815b810 0x7fef4815bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58536/0 (socket says 172.21.15.112:58536) 2024-09-12T02:46:22.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.405+0000 7fef47400640 1 -- 172.21.15.112:0/4002919635 learned_addr learned my addr 172.21.15.112:0/4002919635 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:22.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.406+0000 7fef3e000640 1 --2- 172.21.15.112:0/4002919635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef4814bae0 0x7fef480ac650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:22.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.406+0000 7fef46a00640 1 --2- 172.21.15.112:0/4002919635 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef2c0051c0 0x7fef480ab840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:22.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.406+0000 7fef47400640 1 -- 172.21.15.112:0/4002919635 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef2c0051c0 msgr2=0x7fef480ab840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:22.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.406+0000 7fef47400640 1 --2- 172.21.15.112:0/4002919635 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef2c0051c0 0x7fef480ab840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.406+0000 7fef47400640 1 -- 172.21.15.112:0/4002919635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef4814bae0 msgr2=0x7fef480ac650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:22.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.406+0000 7fef47400640 1 --2- 172.21.15.112:0/4002919635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef4814bae0 0x7fef480ac650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.406+0000 7fef47400640 1 -- 172.21.15.112:0/4002919635 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef480aa4c0 con 0x7fef4815b810 2024-09-12T02:46:22.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.406+0000 7fef47400640 1 --2- 172.21.15.112:0/4002919635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef4815b810 0x7fef4815bc90 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fef4000a810 tx=0x7fef4806e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:22.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.406+0000 7fef3f400640 1 -- 172.21.15.112:0/4002919635 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef40044070 con 0x7fef4815b810 2024-09-12T02:46:22.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.406+0000 7fef3f400640 1 -- 172.21.15.112:0/4002919635 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef400019e0 con 0x7fef4815b810 2024-09-12T02:46:22.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.406+0000 7fef4da00640 1 -- 172.21.15.112:0/4002919635 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef480aa7a0 con 0x7fef4815b810 2024-09-12T02:46:22.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.406+0000 7fef3f400640 1 -- 172.21.15.112:0/4002919635 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4000a460 con 0x7fef4815b810 2024-09-12T02:46:22.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.407+0000 7fef4da00640 1 -- 172.21.15.112:0/4002919635 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef480aad60 con 0x7fef4815b810 2024-09-12T02:46:22.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.408+0000 7fef4da00640 1 -- 172.21.15.112:0/4002919635 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef48068a30 con 0x7fef4815b810 2024-09-12T02:46:22.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.408+0000 7fef3f400640 1 -- 172.21.15.112:0/4002919635 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fef40047070 con 0x7fef4815b810 2024-09-12T02:46:22.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.409+0000 7fef3f400640 1 --2- 172.21.15.112:0/4002919635 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fef2406be30 0x7fef2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:22.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.409+0000 7fef3f400640 1 -- 172.21.15.112:0/4002919635 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7fef400aab30 con 0x7fef4815b810 2024-09-12T02:46:22.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.409+0000 7fef46a00640 1 --2- 172.21.15.112:0/4002919635 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fef2406be30 0x7fef2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:22.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.409+0000 7fef3f400640 1 -- 172.21.15.112:0/4002919635 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=85}) -- 0x7fef24073a80 con 0x7fef4815b810 2024-09-12T02:46:22.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.410+0000 7fef46a00640 1 --2- 172.21.15.112:0/4002919635 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fef2406be30 0x7fef2406e2f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fef38001760 tx=0x7fef38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:22.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.413+0000 7fef3f400640 1 -- 172.21.15.112:0/4002919635 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fef40078d20 con 0x7fef4815b810 2024-09-12T02:46:22.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.625+0000 7fef4da00640 1 -- 172.21.15.112:0/4002919635 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef480735a0 con 0x7fef4815b810 2024-09-12T02:46:22.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.625+0000 7fef3f400640 1 -- 172.21.15.112:0/4002919635 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5234 (secure 0 0 0) 0x7fef4007d020 con 0x7fef4815b810 2024-09-12T02:46:22.626 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:46:22.626 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":44,"btime":"2024-09-12T02:45:39:811882+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/2773143619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2773143619},{"type":"v1","addr":"172.21.15.137:6834","nonce":2773143619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5186,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2810064950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2810064950},{"type":"v1","addr":"172.21.15.137:6835","nonce":2810064950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5192,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/366104267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":366104267},{"type":"v1","addr":"172.21.15.112:6837","nonce":366104267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:45:36.194908+0000","modified":"2024-09-12T02:45:39.214065+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5545":{"gid":5545,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/1248364583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1248364583},{"type":"v1","addr":"172.21.15.112:6836","nonce":1248364583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5545,"qdb_cluster":[5545]},"id":5}]} 2024-09-12T02:46:22.627 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 44 2024-09-12T02:46:22.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.628+0000 7fef4da00640 1 -- 172.21.15.112:0/4002919635 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fef2406be30 msgr2=0x7fef2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:22.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.628+0000 7fef4da00640 1 --2- 172.21.15.112:0/4002919635 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fef2406be30 0x7fef2406e2f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fef38001760 tx=0x7fef38009040 comp rx=0 tx=0).stop 2024-09-12T02:46:22.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.628+0000 7fef4da00640 1 -- 172.21.15.112:0/4002919635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef4815b810 msgr2=0x7fef4815bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:22.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.628+0000 7fef4da00640 1 --2- 172.21.15.112:0/4002919635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef4815b810 0x7fef4815bc90 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fef4000a810 tx=0x7fef4806e4d0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.628+0000 7fef4da00640 1 -- 172.21.15.112:0/4002919635 shutdown_connections 2024-09-12T02:46:22.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.628+0000 7fef4da00640 1 --2- 172.21.15.112:0/4002919635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef4815b810 0x7fef4815bc90 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.628+0000 7fef4da00640 1 --2- 172.21.15.112:0/4002919635 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fef2406be30 0x7fef2406e2f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.628+0000 7fef4da00640 1 --2- 172.21.15.112:0/4002919635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef4814bae0 0x7fef480ac650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.628+0000 7fef4da00640 1 --2- 172.21.15.112:0/4002919635 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fef2c0051c0 0x7fef480ab840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.628+0000 7fef4da00640 1 -- 172.21.15.112:0/4002919635 >> 172.21.15.112:0/4002919635 conn(0x7fef4806bbd0 msgr2=0x7fef481576f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:22.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.628+0000 7fef4da00640 1 -- 172.21.15.112:0/4002919635 shutdown_connections 2024-09-12T02:46:22.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.628+0000 7fef4da00640 1 -- 172.21.15.112:0/4002919635 wait complete. 2024-09-12T02:46:22.645 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:46:22.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.797+0000 7f8ac7800640 1 Processor -- start 2024-09-12T02:46:22.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.798+0000 7f8ac7800640 1 -- start start 2024-09-12T02:46:22.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.799+0000 7f8ac7800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ac015b9d0 0x7f8ac00b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:22.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.799+0000 7f8ac7800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8ac00b45d0 0x7f8ac00728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:22.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.799+0000 7f8ac7800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8ac006eef0 0x7f8ac006f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:22.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.799+0000 7f8ac7800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8ac00b4a30 con 0x7f8ac00b45d0 2024-09-12T02:46:22.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.799+0000 7f8ac7800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8ac006f840 con 0x7f8ac006eef0 2024-09-12T02:46:22.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.799+0000 7f8ac7800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8ac00b54a0 con 0x7f8ac015b9d0 2024-09-12T02:46:22.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.799+0000 7f8ab7e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8ac00b45d0 0x7f8ac00728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:22.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.799+0000 7f8ab7e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8ac00b45d0 0x7f8ac00728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58550/0 (socket says 172.21.15.112:58550) 2024-09-12T02:46:22.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.799+0000 7f8ab7e00640 1 -- 172.21.15.112:0/2902088336 learned_addr learned my addr 172.21.15.112:0/2902088336 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:22.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.799+0000 7f8ac5800640 1 --2- 172.21.15.112:0/2902088336 >> v2:172.21.15.137:3300/0 conn(0x7f8ac006eef0 0x7f8ac006f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:22.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.799+0000 7f8ab7e00640 1 -- 172.21.15.112:0/2902088336 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ac015b9d0 msgr2=0x7f8ac00b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:22.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.799+0000 7f8ab7e00640 1 --2- 172.21.15.112:0/2902088336 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ac015b9d0 0x7f8ac00b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.799+0000 7f8ab7e00640 1 -- 172.21.15.112:0/2902088336 >> v2:172.21.15.137:3300/0 conn(0x7f8ac006eef0 msgr2=0x7f8ac006f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:22.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.799+0000 7f8ab7e00640 1 --2- 172.21.15.112:0/2902088336 >> v2:172.21.15.137:3300/0 conn(0x7f8ac006eef0 0x7f8ac006f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.799+0000 7f8ab7e00640 1 -- 172.21.15.112:0/2902088336 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac00b3af0 con 0x7f8ac00b45d0 2024-09-12T02:46:22.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.799+0000 7f8ac5800640 1 --2- 172.21.15.112:0/2902088336 >> v2:172.21.15.137:3300/0 conn(0x7f8ac006eef0 0x7f8ac006f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:22.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.800+0000 7f8ab7e00640 1 --2- 172.21.15.112:0/2902088336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ac00b45d0 0x7f8ac00728c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0068670 tx=0x7f8aa802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a974370df3c6cf0e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:22.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.801+0000 7f8abfe00640 1 -- 172.21.15.112:0/2902088336 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8004030 con 0x7f8ac00b45d0 2024-09-12T02:46:22.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.801+0000 7f8abfe00640 1 -- 172.21.15.112:0/2902088336 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa80041d0 con 0x7f8ac00b45d0 2024-09-12T02:46:22.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.801+0000 7f8abfe00640 1 -- 172.21.15.112:0/2902088336 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8003610 con 0x7f8ac00b45d0 2024-09-12T02:46:22.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.801+0000 7f8ac7800640 1 -- 172.21.15.112:0/2902088336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ac00b45d0 msgr2=0x7f8ac00728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:22.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.801+0000 7f8ac7800640 1 --2- 172.21.15.112:0/2902088336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ac00b45d0 0x7f8ac00728c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0068670 tx=0x7f8aa802a1c0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.801+0000 7f8ac7800640 1 -- 172.21.15.112:0/2902088336 shutdown_connections 2024-09-12T02:46:22.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.801+0000 7f8ac7800640 1 --2- 172.21.15.112:0/2902088336 >> v2:172.21.15.137:3300/0 conn(0x7f8ac006eef0 0x7f8ac006f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.801+0000 7f8ac7800640 1 --2- 172.21.15.112:0/2902088336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ac00b45d0 0x7f8ac00728c0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.801+0000 7f8ac7800640 1 --2- 172.21.15.112:0/2902088336 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ac015b9d0 0x7f8ac00b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.801+0000 7f8ac7800640 1 -- 172.21.15.112:0/2902088336 >> 172.21.15.112:0/2902088336 conn(0x7f8ac006bbd0 msgr2=0x7f8ac006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:22.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.801+0000 7f8ac7800640 1 -- 172.21.15.112:0/2902088336 shutdown_connections 2024-09-12T02:46:22.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.801+0000 7f8ac7800640 1 -- 172.21.15.112:0/2902088336 wait complete. 2024-09-12T02:46:22.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.803+0000 7f8ac7800640 1 Processor -- start 2024-09-12T02:46:22.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.803+0000 7f8ac7800640 1 -- start start 2024-09-12T02:46:22.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.804+0000 7f8ac7800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ac006eef0 0x7f8ac0154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:22.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.804+0000 7f8ac7800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ac00b45d0 0x7f8ac0161680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:22.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.804+0000 7f8ac7800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ac015b9d0 0x7f8ac01570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:22.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.804+0000 7f8ac7800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac015bdb0 con 0x7f8ac00b45d0 2024-09-12T02:46:22.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.804+0000 7f8ac7800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac00b40b0 con 0x7f8ac015b9d0 2024-09-12T02:46:22.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.804+0000 7f8ac7800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8ac015bf30 con 0x7f8ac006eef0 2024-09-12T02:46:22.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.804+0000 7f8ab7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ac00b45d0 0x7f8ac0161680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:22.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.804+0000 7f8ab7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ac00b45d0 0x7f8ac0161680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58566/0 (socket says 172.21.15.112:58566) 2024-09-12T02:46:22.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.804+0000 7f8ab7e00640 1 -- 172.21.15.112:0/1777360579 learned_addr learned my addr 172.21.15.112:0/1777360579 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:22.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.804+0000 7f8ab7e00640 1 -- 172.21.15.112:0/1777360579 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ac006eef0 msgr2=0x7f8ac0154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:22.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.804+0000 7f8ab7e00640 1 --2- 172.21.15.112:0/1777360579 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ac006eef0 0x7f8ac0154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.804+0000 7f8ab7e00640 1 -- 172.21.15.112:0/1777360579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ac015b9d0 msgr2=0x7f8ac01570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:22.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.804+0000 7f8ab7e00640 1 --2- 172.21.15.112:0/1777360579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ac015b9d0 0x7f8ac01570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.804+0000 7f8ab7e00640 1 -- 172.21.15.112:0/1777360579 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac015c230 con 0x7f8ac00b45d0 2024-09-12T02:46:22.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.805+0000 7f8ab7e00640 1 --2- 172.21.15.112:0/1777360579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ac00b45d0 0x7f8ac0161680 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009940 tx=0x7f8aa80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:22.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.805+0000 7f8abd600640 1 -- 172.21.15.112:0/1777360579 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8041030 con 0x7f8ac00b45d0 2024-09-12T02:46:22.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.805+0000 7f8abd600640 1 -- 172.21.15.112:0/1777360579 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa8003c50 con 0x7f8ac00b45d0 2024-09-12T02:46:22.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.805+0000 7f8ac7800640 1 -- 172.21.15.112:0/1777360579 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ac015c510 con 0x7f8ac00b45d0 2024-09-12T02:46:22.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.805+0000 7f8abd600640 1 -- 172.21.15.112:0/1777360579 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8004030 con 0x7f8ac00b45d0 2024-09-12T02:46:22.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.805+0000 7f8ac7800640 1 -- 172.21.15.112:0/1777360579 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ac015cad0 con 0x7f8ac00b45d0 2024-09-12T02:46:22.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.806+0000 7f8ac7800640 1 -- 172.21.15.112:0/1777360579 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ac0068a30 con 0x7f8ac00b45d0 2024-09-12T02:46:22.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.807+0000 7f8abd600640 1 -- 172.21.15.112:0/1777360579 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8aa8044070 con 0x7f8ac00b45d0 2024-09-12T02:46:22.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.808+0000 7f8abd600640 1 --2- 172.21.15.112:0/1777360579 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8a9c06be30 0x7f8a9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:22.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.808+0000 7f8abd600640 1 -- 172.21.15.112:0/1777360579 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f8aa80aba50 con 0x7f8ac00b45d0 2024-09-12T02:46:22.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.808+0000 7f8ac4e00640 1 --2- 172.21.15.112:0/1777360579 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8a9c06be30 0x7f8a9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:22.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.808+0000 7f8abd600640 1 -- 172.21.15.112:0/1777360579 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=85}) -- 0x7f8a9c073a80 con 0x7f8ac00b45d0 2024-09-12T02:46:22.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.809+0000 7f8ac4e00640 1 --2- 172.21.15.112:0/1777360579 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8a9c06be30 0x7f8a9c06e2f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8ac015e820 tx=0x7f8ab0006bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:22.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.812+0000 7f8abd600640 1 -- 172.21.15.112:0/1777360579 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8aa803b3b0 con 0x7f8ac00b45d0 2024-09-12T02:46:22.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.990+0000 7f8ac7800640 1 -- 172.21.15.112:0/1777360579 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ac0158dc0 con 0x7f8ac00b45d0 2024-09-12T02:46:22.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.991+0000 7f8abd600640 1 -- 172.21.15.112:0/1777360579 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+16916 (secure 0 0 0) 0x7f8ac0158dc0 con 0x7f8ac00b45d0 2024-09-12T02:46:22.992 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:46:22.992 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":84,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:45:54.078558+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:45:33.961909+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-12T02:45:35.184607+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.4","mappings":[{"from":6,"to":0}]},{"pgid":"11.3e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:46:22.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.993+0000 7f8ac7800640 1 -- 172.21.15.112:0/1777360579 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8a9c06be30 msgr2=0x7f8a9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:22.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.993+0000 7f8ac7800640 1 --2- 172.21.15.112:0/1777360579 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8a9c06be30 0x7f8a9c06e2f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8ac015e820 tx=0x7f8ab0006bf0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.993+0000 7f8ac7800640 1 -- 172.21.15.112:0/1777360579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ac00b45d0 msgr2=0x7f8ac0161680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:22.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.993+0000 7f8ac7800640 1 --2- 172.21.15.112:0/1777360579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ac00b45d0 0x7f8ac0161680 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009940 tx=0x7f8aa80046c0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.993+0000 7f8ac7800640 1 -- 172.21.15.112:0/1777360579 shutdown_connections 2024-09-12T02:46:22.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.993+0000 7f8ac7800640 1 --2- 172.21.15.112:0/1777360579 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8a9c06be30 0x7f8a9c06e2f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.993+0000 7f8ac7800640 1 --2- 172.21.15.112:0/1777360579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ac015b9d0 0x7f8ac01570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.993+0000 7f8ac7800640 1 --2- 172.21.15.112:0/1777360579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ac00b45d0 0x7f8ac0161680 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.993+0000 7f8ac7800640 1 --2- 172.21.15.112:0/1777360579 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ac006eef0 0x7f8ac0154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.993+0000 7f8ac7800640 1 -- 172.21.15.112:0/1777360579 >> 172.21.15.112:0/1777360579 conn(0x7f8ac006bbd0 msgr2=0x7f8ac01586b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:22.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.993+0000 7f8ac7800640 1 -- 172.21.15.112:0/1777360579 shutdown_connections 2024-09-12T02:46:22.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:22.993+0000 7f8ac7800640 1 -- 172.21.15.112:0/1777360579 wait complete. 2024-09-12T02:46:23.011 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:46:23.011 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:46:23.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.163+0000 7f122cc00640 1 Processor -- start 2024-09-12T02:46:23.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.163+0000 7f122cc00640 1 -- start start 2024-09-12T02:46:23.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.164+0000 7f122cc00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1228162510 0x7f12280d58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:23.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.164+0000 7f122cc00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f12280b46e0 0x7f12280b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:23.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.164+0000 7f122cc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12280b50b0 0x7f12280d2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:23.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.164+0000 7f122cc00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f12280b5540 con 0x7f1228162510 2024-09-12T02:46:23.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.164+0000 7f122cc00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f12280b1c30 con 0x7f12280b46e0 2024-09-12T02:46:23.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.164+0000 7f122cc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f12280b1f10 con 0x7f12280b50b0 2024-09-12T02:46:23.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.164+0000 7f1227400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1228162510 0x7f12280d58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:23.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.165+0000 7f1227400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1228162510 0x7f12280d58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58582/0 (socket says 172.21.15.112:58582) 2024-09-12T02:46:23.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.165+0000 7f1227400640 1 -- 172.21.15.112:0/1269583352 learned_addr learned my addr 172.21.15.112:0/1269583352 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:23.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.165+0000 7f1226a00640 1 --2- 172.21.15.112:0/1269583352 >> v2:172.21.15.137:3300/0 conn(0x7f12280b46e0 0x7f12280b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:23.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.165+0000 7f1227e00640 1 --2- 172.21.15.112:0/1269583352 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12280b50b0 0x7f12280d2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:23.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.165+0000 7f1227400640 1 -- 172.21.15.112:0/1269583352 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12280b50b0 msgr2=0x7f12280d2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:23.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.165+0000 7f1227400640 1 --2- 172.21.15.112:0/1269583352 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12280b50b0 0x7f12280d2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.165+0000 7f1227400640 1 -- 172.21.15.112:0/1269583352 >> v2:172.21.15.137:3300/0 conn(0x7f12280b46e0 msgr2=0x7f12280b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:23.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.165+0000 7f1227400640 1 --2- 172.21.15.112:0/1269583352 >> v2:172.21.15.137:3300/0 conn(0x7f12280b46e0 0x7f12280b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.165+0000 7f1227400640 1 -- 172.21.15.112:0/1269583352 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12280b21f0 con 0x7f1228162510 2024-09-12T02:46:23.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.166+0000 7f1227400640 1 --2- 172.21.15.112:0/1269583352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1228162510 0x7f12280d58a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f122808e9d0 tx=0x7f121802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=852ade36ee1cb50a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:23.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.166+0000 7f1226000640 1 -- 172.21.15.112:0/1269583352 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1218037070 con 0x7f1228162510 2024-09-12T02:46:23.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.166+0000 7f1226000640 1 -- 172.21.15.112:0/1269583352 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1218032440 con 0x7f1228162510 2024-09-12T02:46:23.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.166+0000 7f1226000640 1 -- 172.21.15.112:0/1269583352 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1218032810 con 0x7f1228162510 2024-09-12T02:46:23.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.167+0000 7f122cc00640 1 -- 172.21.15.112:0/1269583352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1228162510 msgr2=0x7f12280d58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:23.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.167+0000 7f122cc00640 1 --2- 172.21.15.112:0/1269583352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1228162510 0x7f12280d58a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f122808e9d0 tx=0x7f121802a1e0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.167+0000 7f122cc00640 1 -- 172.21.15.112:0/1269583352 shutdown_connections 2024-09-12T02:46:23.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.167+0000 7f122cc00640 1 --2- 172.21.15.112:0/1269583352 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12280b50b0 0x7f12280d2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.167+0000 7f122cc00640 1 --2- 172.21.15.112:0/1269583352 >> v2:172.21.15.137:3300/0 conn(0x7f12280b46e0 0x7f12280b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.167+0000 7f122cc00640 1 --2- 172.21.15.112:0/1269583352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1228162510 0x7f12280d58a0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.167+0000 7f122cc00640 1 -- 172.21.15.112:0/1269583352 >> 172.21.15.112:0/1269583352 conn(0x7f12280d4d80 msgr2=0x7f12280d5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:23.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.167+0000 7f122cc00640 1 -- 172.21.15.112:0/1269583352 shutdown_connections 2024-09-12T02:46:23.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.167+0000 7f122cc00640 1 -- 172.21.15.112:0/1269583352 wait complete. 2024-09-12T02:46:23.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.169+0000 7f122cc00640 1 Processor -- start 2024-09-12T02:46:23.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.169+0000 7f122cc00640 1 -- start start 2024-09-12T02:46:23.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.170+0000 7f122cc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12280b46e0 0x7f12281516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:23.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.170+0000 7f122cc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12280b50b0 0x7f122815e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:23.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.170+0000 7f122cc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1228162510 0x7f12281f3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:23.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.170+0000 7f122cc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f12281628f0 con 0x7f12280b46e0 2024-09-12T02:46:23.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.170+0000 7f122cc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f12280b27b0 con 0x7f1228162510 2024-09-12T02:46:23.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.170+0000 7f122cc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f12280d3230 con 0x7f12280b50b0 2024-09-12T02:46:23.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.170+0000 7f1227e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1228162510 0x7f12281f3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:23.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.170+0000 7f1227e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1228162510 0x7f12281f3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:33208/0 (socket says 172.21.15.112:33208) 2024-09-12T02:46:23.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.170+0000 7f1226a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12280b50b0 0x7f122815e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:23.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.170+0000 7f1227e00640 1 -- 172.21.15.112:0/2068850682 learned_addr learned my addr 172.21.15.112:0/2068850682 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:23.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.170+0000 7f1227400640 1 --2- 172.21.15.112:0/2068850682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12280b46e0 0x7f12281516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:23.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.170+0000 7f1227e00640 1 -- 172.21.15.112:0/2068850682 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12280b50b0 msgr2=0x7f122815e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:23.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.170+0000 7f1227e00640 1 --2- 172.21.15.112:0/2068850682 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12280b50b0 0x7f122815e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.170+0000 7f1227e00640 1 -- 172.21.15.112:0/2068850682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12280b46e0 msgr2=0x7f12281516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:23.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.170+0000 7f1227e00640 1 --2- 172.21.15.112:0/2068850682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12280b46e0 0x7f12281516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.170+0000 7f1227e00640 1 -- 172.21.15.112:0/2068850682 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f122815e7d0 con 0x7f1228162510 2024-09-12T02:46:23.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.170+0000 7f1226a00640 1 --2- 172.21.15.112:0/2068850682 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12280b50b0 0x7f122815e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:46:23.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.171+0000 7f1227e00640 1 --2- 172.21.15.112:0/2068850682 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1228162510 0x7f12281f3d70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f122000efc0 tx=0x7f122000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:23.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.171+0000 7f121f400640 1 -- 172.21.15.112:0/2068850682 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1220018020 con 0x7f1228162510 2024-09-12T02:46:23.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.171+0000 7f121f400640 1 -- 172.21.15.112:0/2068850682 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1220014480 con 0x7f1228162510 2024-09-12T02:46:23.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.171+0000 7f122cc00640 1 -- 172.21.15.112:0/2068850682 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f122815eab0 con 0x7f1228162510 2024-09-12T02:46:23.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.171+0000 7f121f400640 1 -- 172.21.15.112:0/2068850682 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1220014870 con 0x7f1228162510 2024-09-12T02:46:23.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.172+0000 7f122cc00640 1 -- 172.21.15.112:0/2068850682 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f122814ed30 con 0x7f1228162510 2024-09-12T02:46:23.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.172+0000 7f122cc00640 1 -- 172.21.15.112:0/2068850682 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f122814ef30 con 0x7f1228162510 2024-09-12T02:46:23.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.174+0000 7f121f400640 1 -- 172.21.15.112:0/2068850682 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1220005d10 con 0x7f1228162510 2024-09-12T02:46:23.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.174+0000 7f121f400640 1 --2- 172.21.15.112:0/2068850682 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f120806be30 0x7f120806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:23.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.175+0000 7f121f400640 1 -- 172.21.15.112:0/2068850682 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f122008be30 con 0x7f1228162510 2024-09-12T02:46:23.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.175+0000 7f121f400640 1 -- 172.21.15.112:0/2068850682 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=85}) -- 0x7f1208073a20 con 0x7f1228162510 2024-09-12T02:46:23.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.175+0000 7f1227400640 1 --2- 172.21.15.112:0/2068850682 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f120806be30 0x7f120806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:23.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.175+0000 7f1227400640 1 --2- 172.21.15.112:0/2068850682 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f120806be30 0x7f120806e2f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1218034000 tx=0x7f121802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:23.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.178+0000 7f121f400640 1 -- 172.21.15.112:0/2068850682 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f122814ef30 con 0x7f1228162510 2024-09-12T02:46:23.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.388+0000 7f122cc00640 1 -- 172.21.15.112:0/2068850682 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f12280b44c0 con 0x7f1228162510 2024-09-12T02:46:23.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.389+0000 7f121f400640 1 -- 172.21.15.112:0/2068850682 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5234 (secure 0 0 0) 0x7f1220022030 con 0x7f1228162510 2024-09-12T02:46:23.390 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:46:23.390 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":44,"btime":"2024-09-12T02:45:39:811882+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/2773143619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2773143619},{"type":"v1","addr":"172.21.15.137:6834","nonce":2773143619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5186,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2810064950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2810064950},{"type":"v1","addr":"172.21.15.137:6835","nonce":2810064950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5192,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/366104267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":366104267},{"type":"v1","addr":"172.21.15.112:6837","nonce":366104267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:45:36.194908+0000","modified":"2024-09-12T02:45:39.214065+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5545":{"gid":5545,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/1248364583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1248364583},{"type":"v1","addr":"172.21.15.112:6836","nonce":1248364583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5545,"qdb_cluster":[5545]},"id":5}]} 2024-09-12T02:46:23.390 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 44 2024-09-12T02:46:23.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.391+0000 7f122cc00640 1 -- 172.21.15.112:0/2068850682 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f120806be30 msgr2=0x7f120806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:23.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.391+0000 7f122cc00640 1 --2- 172.21.15.112:0/2068850682 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f120806be30 0x7f120806e2f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1218034000 tx=0x7f121802e000 comp rx=0 tx=0).stop 2024-09-12T02:46:23.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.391+0000 7f122cc00640 1 -- 172.21.15.112:0/2068850682 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1228162510 msgr2=0x7f12281f3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:23.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.391+0000 7f122cc00640 1 --2- 172.21.15.112:0/2068850682 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1228162510 0x7f12281f3d70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f122000efc0 tx=0x7f122000c490 comp rx=0 tx=0).stop 2024-09-12T02:46:23.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.391+0000 7f122cc00640 1 -- 172.21.15.112:0/2068850682 shutdown_connections 2024-09-12T02:46:23.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.391+0000 7f122cc00640 1 --2- 172.21.15.112:0/2068850682 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f120806be30 0x7f120806e2f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.391+0000 7f122cc00640 1 --2- 172.21.15.112:0/2068850682 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1228162510 0x7f12281f3d70 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.391+0000 7f122cc00640 1 --2- 172.21.15.112:0/2068850682 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12280b50b0 0x7f122815e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.391+0000 7f122cc00640 1 --2- 172.21.15.112:0/2068850682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12280b46e0 0x7f12281516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.391+0000 7f122cc00640 1 -- 172.21.15.112:0/2068850682 >> 172.21.15.112:0/2068850682 conn(0x7f12280d4d80 msgr2=0x7f122806db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:23.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.391+0000 7f122cc00640 1 -- 172.21.15.112:0/2068850682 shutdown_connections 2024-09-12T02:46:23.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.391+0000 7f122cc00640 1 -- 172.21.15.112:0/2068850682 wait complete. 2024-09-12T02:46:23.408 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:46:23.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.558+0000 7f377ba00640 1 Processor -- start 2024-09-12T02:46:23.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.558+0000 7f377ba00640 1 -- start start 2024-09-12T02:46:23.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.560+0000 7f377ba00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f377406f600 0x7f37740b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:23.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.560+0000 7f377ba00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f37740b45d0 0x7f37740728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:23.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.560+0000 7f377ba00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37740b4a20 con 0x7f377415b9d0 2024-09-12T02:46:23.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.560+0000 7f377ba00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f37740b54a0 con 0x7f377406f600 2024-09-12T02:46:23.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.560+0000 7f377ba00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f37740b3af0 con 0x7f37740b45d0 2024-09-12T02:46:23.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.560+0000 7f3779000640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f377415b9d0 0x7f377406eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59702/0 (socket says 172.21.15.112:59702) 2024-09-12T02:46:23.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.560+0000 7f376be00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f377406f600 0x7f37740b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:23.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.560+0000 7f3779000640 1 -- 172.21.15.112:0/1885374670 learned_addr learned my addr 172.21.15.112:0/1885374670 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:46:23.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.560+0000 7f3779a00640 1 --2- 172.21.15.112:0/1885374670 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f37740b45d0 0x7f37740728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:23.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.561+0000 7f376be00640 1 -- 172.21.15.112:0/1885374670 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f37740b45d0 msgr2=0x7f37740728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:23.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.561+0000 7f376be00640 1 --2- 172.21.15.112:0/1885374670 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f37740b45d0 0x7f37740728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.561+0000 7f376be00640 1 -- 172.21.15.112:0/1885374670 >> v1:172.21.15.112:6789/0 conn(0x7f377415b9d0 legacy=0x7f377406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:23.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.561+0000 7f376be00640 1 -- 172.21.15.112:0/1885374670 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37740b3dd0 con 0x7f377406f600 2024-09-12T02:46:23.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.561+0000 7f3773e00640 1 -- 172.21.15.112:0/1885374670 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2220497777 0 0) 0x7f37740b4a20 con 0x7f377415b9d0 2024-09-12T02:46:23.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.562+0000 7f376be00640 1 --2- 172.21.15.112:0/1885374670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f377406f600 0x7f37740b4ec0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f375c009790 tx=0x7f375c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=299fffd7e82c2a6f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:23.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.562+0000 7f3773e00640 1 -- 172.21.15.112:0/1885374670 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c037070 con 0x7f377406f600 2024-09-12T02:46:23.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.562+0000 7f3773e00640 1 -- 172.21.15.112:0/1885374670 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f375c032440 con 0x7f377406f600 2024-09-12T02:46:23.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.562+0000 7f3773e00640 1 -- 172.21.15.112:0/1885374670 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c032810 con 0x7f377406f600 2024-09-12T02:46:23.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.562+0000 7f377ba00640 1 -- 172.21.15.112:0/1885374670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f377406f600 msgr2=0x7f37740b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:23.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.562+0000 7f377ba00640 1 --2- 172.21.15.112:0/1885374670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f377406f600 0x7f37740b4ec0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f375c009790 tx=0x7f375c02a180 comp rx=0 tx=0).stop 2024-09-12T02:46:23.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.562+0000 7f377ba00640 1 -- 172.21.15.112:0/1885374670 shutdown_connections 2024-09-12T02:46:23.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.562+0000 7f377ba00640 1 --2- 172.21.15.112:0/1885374670 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f37740b45d0 0x7f37740728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.562+0000 7f377ba00640 1 --2- 172.21.15.112:0/1885374670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f377406f600 0x7f37740b4ec0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.562+0000 7f377ba00640 1 -- 172.21.15.112:0/1885374670 >> 172.21.15.112:0/1885374670 conn(0x7f377406bbd0 msgr2=0x7f377406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:23.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.563+0000 7f377ba00640 1 -- 172.21.15.112:0/1885374670 shutdown_connections 2024-09-12T02:46:23.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.563+0000 7f377ba00640 1 -- 172.21.15.112:0/1885374670 wait complete. 2024-09-12T02:46:23.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.564+0000 7f377ba00640 1 Processor -- start 2024-09-12T02:46:23.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.564+0000 7f377ba00640 1 -- start start 2024-09-12T02:46:23.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.565+0000 7f377ba00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f377406f600 0x7f3774152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:23.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.565+0000 7f377ba00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f37740b45d0 0x7f377415d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:23.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.565+0000 7f377ba00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f377415b9d0 0x7f37741f51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:23.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.565+0000 7f377ba00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f377415bf30 con 0x7f377406f600 2024-09-12T02:46:23.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.565+0000 7f377ba00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f377415bdb0 con 0x7f377415b9d0 2024-09-12T02:46:23.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.565+0000 7f377ba00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f37740cdcd0 con 0x7f37740b45d0 2024-09-12T02:46:23.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.565+0000 7f3779000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f377406f600 0x7f3774152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:23.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.565+0000 7f3779000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f377406f600 0x7f3774152940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58616/0 (socket says 172.21.15.112:58616) 2024-09-12T02:46:23.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.565+0000 7f3779000640 1 -- 172.21.15.112:0/1443207592 learned_addr learned my addr 172.21.15.112:0/1443207592 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:23.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.566+0000 7f3779a00640 1 --2- 172.21.15.112:0/1443207592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f377415b9d0 0x7f37741f51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:23.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.566+0000 7f376be00640 1 --2- 172.21.15.112:0/1443207592 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f37740b45d0 0x7f377415d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:23.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.566+0000 7f3779000640 1 -- 172.21.15.112:0/1443207592 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f37740b45d0 msgr2=0x7f377415d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:23.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.566+0000 7f3779000640 1 --2- 172.21.15.112:0/1443207592 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f37740b45d0 0x7f377415d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.566+0000 7f3779000640 1 -- 172.21.15.112:0/1443207592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f377415b9d0 msgr2=0x7f37741f51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:23.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.566+0000 7f3779000640 1 --2- 172.21.15.112:0/1443207592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f377415b9d0 0x7f37741f51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.566+0000 7f3779000640 1 -- 172.21.15.112:0/1443207592 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f377415ac10 con 0x7f377406f600 2024-09-12T02:46:23.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.566+0000 7f3779a00640 1 --2- 172.21.15.112:0/1443207592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f377415b9d0 0x7f37741f51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:23.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.566+0000 7f3779000640 1 --2- 172.21.15.112:0/1443207592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f377406f600 0x7f3774152940 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f376400c430 tx=0x7f376400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:23.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.566+0000 7f3771600640 1 -- 172.21.15.112:0/1443207592 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37640074e0 con 0x7f377406f600 2024-09-12T02:46:23.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.566+0000 7f3771600640 1 -- 172.21.15.112:0/1443207592 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37640047e0 con 0x7f377406f600 2024-09-12T02:46:23.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.566+0000 7f377ba00640 1 -- 172.21.15.112:0/1443207592 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37741f5930 con 0x7f377406f600 2024-09-12T02:46:23.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.566+0000 7f3771600640 1 -- 172.21.15.112:0/1443207592 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3764004bd0 con 0x7f377406f600 2024-09-12T02:46:23.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.567+0000 7f377ba00640 1 -- 172.21.15.112:0/1443207592 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37741f5ef0 con 0x7f377406f600 2024-09-12T02:46:23.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.567+0000 7f377ba00640 1 -- 172.21.15.112:0/1443207592 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37740cd300 con 0x7f377406f600 2024-09-12T02:46:23.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.568+0000 7f3771600640 1 -- 172.21.15.112:0/1443207592 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3764011070 con 0x7f377406f600 2024-09-12T02:46:23.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.569+0000 7f3771600640 1 --2- 172.21.15.112:0/1443207592 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f375006be30 0x7f375006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:23.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.569+0000 7f3771600640 1 -- 172.21.15.112:0/1443207592 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f376408abb0 con 0x7f377406f600 2024-09-12T02:46:23.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.570+0000 7f376be00640 1 --2- 172.21.15.112:0/1443207592 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f375006be30 0x7f375006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:23.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.570+0000 7f3771600640 1 -- 172.21.15.112:0/1443207592 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=85}) -- 0x7f3750073a20 con 0x7f377406f600 2024-09-12T02:46:23.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.570+0000 7f376be00640 1 --2- 172.21.15.112:0/1443207592 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f375006be30 0x7f375006e2f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f375c034000 tx=0x7f375c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:23.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.573+0000 7f3771600640 1 -- 172.21.15.112:0/1443207592 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f37740cd300 con 0x7f377406f600 2024-09-12T02:46:23.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.781+0000 7f377ba00640 1 -- 172.21.15.112:0/1443207592 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37740722c0 con 0x7f377406f600 2024-09-12T02:46:23.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.782+0000 7f3771600640 1 -- 172.21.15.112:0/1443207592 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5234 (secure 0 0 0) 0x7f3764059480 con 0x7f377406f600 2024-09-12T02:46:23.783 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:46:23.783 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":44,"btime":"2024-09-12T02:45:39:811882+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/2773143619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2773143619},{"type":"v1","addr":"172.21.15.137:6834","nonce":2773143619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5186,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2810064950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2810064950},{"type":"v1","addr":"172.21.15.137:6835","nonce":2810064950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5192,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/366104267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":366104267},{"type":"v1","addr":"172.21.15.112:6837","nonce":366104267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:45:36.194908+0000","modified":"2024-09-12T02:45:39.214065+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5545":{"gid":5545,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/1248364583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1248364583},{"type":"v1","addr":"172.21.15.112:6836","nonce":1248364583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5545,"qdb_cluster":[5545]},"id":5}]} 2024-09-12T02:46:23.783 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 44 2024-09-12T02:46:23.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.784+0000 7f377ba00640 1 -- 172.21.15.112:0/1443207592 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f375006be30 msgr2=0x7f375006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:23.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.784+0000 7f377ba00640 1 --2- 172.21.15.112:0/1443207592 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f375006be30 0x7f375006e2f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f375c034000 tx=0x7f375c02e000 comp rx=0 tx=0).stop 2024-09-12T02:46:23.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.784+0000 7f377ba00640 1 -- 172.21.15.112:0/1443207592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f377406f600 msgr2=0x7f3774152940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:23.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.784+0000 7f377ba00640 1 --2- 172.21.15.112:0/1443207592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f377406f600 0x7f3774152940 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f376400c430 tx=0x7f376400c8f0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.784+0000 7f377ba00640 1 -- 172.21.15.112:0/1443207592 shutdown_connections 2024-09-12T02:46:23.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.784+0000 7f377ba00640 1 --2- 172.21.15.112:0/1443207592 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f375006be30 0x7f375006e2f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.784+0000 7f377ba00640 1 --2- 172.21.15.112:0/1443207592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f377415b9d0 0x7f37741f51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.784+0000 7f377ba00640 1 --2- 172.21.15.112:0/1443207592 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f37740b45d0 0x7f377415d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.784+0000 7f377ba00640 1 --2- 172.21.15.112:0/1443207592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f377406f600 0x7f3774152940 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.784+0000 7f377ba00640 1 -- 172.21.15.112:0/1443207592 >> 172.21.15.112:0/1443207592 conn(0x7f377406bbd0 msgr2=0x7f37740ccbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:23.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.784+0000 7f377ba00640 1 -- 172.21.15.112:0/1443207592 shutdown_connections 2024-09-12T02:46:23.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.784+0000 7f377ba00640 1 -- 172.21.15.112:0/1443207592 wait complete. 2024-09-12T02:46:23.803 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:46:23.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.955+0000 7fba24400640 1 Processor -- start 2024-09-12T02:46:23.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.955+0000 7fba24400640 1 -- start start 2024-09-12T02:46:23.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.957+0000 7fba24400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba1c06f600 0x7fba1c0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:23.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.957+0000 7fba24400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba1c0b4a20 con 0x7fba1c0b45d0 2024-09-12T02:46:23.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.957+0000 7fba24400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba1c0b54a0 con 0x7fba1c15b9d0 2024-09-12T02:46:23.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.957+0000 7fba24400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fba1c0b3af0 con 0x7fba1c06f600 2024-09-12T02:46:23.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.957+0000 7fba22400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fba1c0b45d0 0x7fba1c0cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59714/0 (socket says 172.21.15.112:59714) 2024-09-12T02:46:23.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.957+0000 7fba22400640 1 -- 172.21.15.112:0/4206847788 learned_addr learned my addr 172.21.15.112:0/4206847788 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:46:23.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.957+0000 7fba21000640 1 --2- 172.21.15.112:0/4206847788 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba1c06f600 0x7fba1c0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:23.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.957+0000 7fba1be00640 1 -- 172.21.15.112:0/4206847788 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4016964485 0 0) 0x7fba1c0b4a20 con 0x7fba1c0b45d0 2024-09-12T02:46:23.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.957+0000 7fba1be00640 1 -- 172.21.15.112:0/4206847788 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba04005730 con 0x7fba1c0b45d0 2024-09-12T02:46:23.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.958+0000 7fba21000640 1 -- 172.21.15.112:0/4206847788 >> v1:172.21.15.137:6789/0 conn(0x7fba1c15b9d0 legacy=0x7fba1c06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:23.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.958+0000 7fba21000640 1 -- 172.21.15.112:0/4206847788 >> v1:172.21.15.112:6789/0 conn(0x7fba1c0b45d0 legacy=0x7fba1c0cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:23.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.958+0000 7fba21000640 1 -- 172.21.15.112:0/4206847788 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba1c0b3dd0 con 0x7fba1c06f600 2024-09-12T02:46:23.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.959+0000 7fba21000640 1 --2- 172.21.15.112:0/4206847788 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba1c06f600 0x7fba1c0b4ec0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fba08009740 tx=0x7fba0802a0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=281b0448eb01448a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:23.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.959+0000 7fba1be00640 1 -- 172.21.15.112:0/4206847788 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba08037070 con 0x7fba1c06f600 2024-09-12T02:46:23.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.959+0000 7fba1be00640 1 -- 172.21.15.112:0/4206847788 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba0802adb0 con 0x7fba1c06f600 2024-09-12T02:46:23.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.959+0000 7fba1be00640 1 -- 172.21.15.112:0/4206847788 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba08032640 con 0x7fba1c06f600 2024-09-12T02:46:23.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.959+0000 7fba24400640 1 -- 172.21.15.112:0/4206847788 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba1c06f600 msgr2=0x7fba1c0b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:23.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.959+0000 7fba24400640 1 --2- 172.21.15.112:0/4206847788 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba1c06f600 0x7fba1c0b4ec0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fba08009740 tx=0x7fba0802a0a0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.960+0000 7fba24400640 1 -- 172.21.15.112:0/4206847788 shutdown_connections 2024-09-12T02:46:23.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.960+0000 7fba24400640 1 --2- 172.21.15.112:0/4206847788 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba1c06f600 0x7fba1c0b4ec0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.960+0000 7fba24400640 1 -- 172.21.15.112:0/4206847788 >> 172.21.15.112:0/4206847788 conn(0x7fba1c06bbd0 msgr2=0x7fba1c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:23.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.960+0000 7fba24400640 1 -- 172.21.15.112:0/4206847788 shutdown_connections 2024-09-12T02:46:23.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.960+0000 7fba24400640 1 -- 172.21.15.112:0/4206847788 wait complete. 2024-09-12T02:46:23.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.961+0000 7fba24400640 1 Processor -- start 2024-09-12T02:46:23.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.961+0000 7fba24400640 1 -- start start 2024-09-12T02:46:23.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.962+0000 7fba24400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba1c06f600 0x7fba1c153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:23.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.962+0000 7fba24400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba1c0b45d0 0x7fba1c1f4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:23.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.962+0000 7fba24400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba1c15b9d0 0x7fba1c0b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:23.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.962+0000 7fba24400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fba1c15bf30 con 0x7fba1c15b9d0 2024-09-12T02:46:23.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.962+0000 7fba24400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fba1c15bdb0 con 0x7fba1c06f600 2024-09-12T02:46:23.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.962+0000 7fba24400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fba1c0728c0 con 0x7fba1c0b45d0 2024-09-12T02:46:23.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.962+0000 7fba22400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba1c15b9d0 0x7fba1c0b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:23.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.962+0000 7fba22400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba1c15b9d0 0x7fba1c0b16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58620/0 (socket says 172.21.15.112:58620) 2024-09-12T02:46:23.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.962+0000 7fba22400640 1 -- 172.21.15.112:0/450840515 learned_addr learned my addr 172.21.15.112:0/450840515 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:23.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.963+0000 7fba21a00640 1 --2- 172.21.15.112:0/450840515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba1c06f600 0x7fba1c153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:23.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.963+0000 7fba21000640 1 --2- 172.21.15.112:0/450840515 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba1c0b45d0 0x7fba1c1f4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:23.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.963+0000 7fba22400640 1 -- 172.21.15.112:0/450840515 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba1c0b45d0 msgr2=0x7fba1c1f4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:23.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.963+0000 7fba22400640 1 --2- 172.21.15.112:0/450840515 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba1c0b45d0 0x7fba1c1f4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.963+0000 7fba22400640 1 -- 172.21.15.112:0/450840515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba1c06f600 msgr2=0x7fba1c153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:23.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.963+0000 7fba22400640 1 --2- 172.21.15.112:0/450840515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba1c06f600 0x7fba1c153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.963+0000 7fba22400640 1 -- 172.21.15.112:0/450840515 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba1c15cb90 con 0x7fba1c15b9d0 2024-09-12T02:46:23.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.963+0000 7fba22400640 1 --2- 172.21.15.112:0/450840515 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba1c15b9d0 0x7fba1c0b16a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fba1400cb40 tx=0x7fba1400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:23.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.963+0000 7fba19600640 1 -- 172.21.15.112:0/450840515 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba14017070 con 0x7fba1c15b9d0 2024-09-12T02:46:23.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.963+0000 7fba19600640 1 -- 172.21.15.112:0/450840515 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba1400aca0 con 0x7fba1c15b9d0 2024-09-12T02:46:23.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.963+0000 7fba19600640 1 -- 172.21.15.112:0/450840515 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba14012620 con 0x7fba1c15b9d0 2024-09-12T02:46:23.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.963+0000 7fba24400640 1 -- 172.21.15.112:0/450840515 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba1c15ce70 con 0x7fba1c15b9d0 2024-09-12T02:46:23.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.964+0000 7fba24400640 1 -- 172.21.15.112:0/450840515 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba1c1593d0 con 0x7fba1c15b9d0 2024-09-12T02:46:23.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.965+0000 7fba24400640 1 -- 172.21.15.112:0/450840515 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba1c068a30 con 0x7fba1c15b9d0 2024-09-12T02:46:23.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.965+0000 7fba19600640 1 -- 172.21.15.112:0/450840515 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba1401a070 con 0x7fba1c15b9d0 2024-09-12T02:46:23.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.966+0000 7fba19600640 1 --2- 172.21.15.112:0/450840515 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb9fc06be30 0x7fb9fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:23.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.966+0000 7fba19600640 1 -- 172.21.15.112:0/450840515 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7fba1408ace0 con 0x7fba1c15b9d0 2024-09-12T02:46:23.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.967+0000 7fba21a00640 1 --2- 172.21.15.112:0/450840515 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb9fc06be30 0x7fb9fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:23.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.967+0000 7fba19600640 1 -- 172.21.15.112:0/450840515 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=85}) -- 0x7fb9fc073a20 con 0x7fba1c15b9d0 2024-09-12T02:46:23.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.967+0000 7fba21a00640 1 --2- 172.21.15.112:0/450840515 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb9fc06be30 0x7fb9fc06e2f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fba10000f60 tx=0x7fba10009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:23.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:23.970+0000 7fba19600640 1 -- 172.21.15.112:0/450840515 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fba14058ff0 con 0x7fba1c15b9d0 2024-09-12T02:46:24.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.142+0000 7fba24400640 1 -- 172.21.15.112:0/450840515 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fba1c072c50 con 0x7fba1c15b9d0 2024-09-12T02:46:24.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.143+0000 7fba19600640 1 -- 172.21.15.112:0/450840515 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+16916 (secure 0 0 0) 0x7fba1405d2f0 con 0x7fba1c15b9d0 2024-09-12T02:46:24.145 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:46:24.145 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":84,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:45:54.078558+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:45:33.961909+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-12T02:45:35.184607+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.4","mappings":[{"from":6,"to":0}]},{"pgid":"11.3e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:46:24.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.146+0000 7fba24400640 1 -- 172.21.15.112:0/450840515 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb9fc06be30 msgr2=0x7fb9fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:24.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.146+0000 7fba24400640 1 --2- 172.21.15.112:0/450840515 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb9fc06be30 0x7fb9fc06e2f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fba10000f60 tx=0x7fba10009040 comp rx=0 tx=0).stop 2024-09-12T02:46:24.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.146+0000 7fba24400640 1 -- 172.21.15.112:0/450840515 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba1c15b9d0 msgr2=0x7fba1c0b16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:24.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.146+0000 7fba24400640 1 --2- 172.21.15.112:0/450840515 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba1c15b9d0 0x7fba1c0b16a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fba1400cb40 tx=0x7fba1400a060 comp rx=0 tx=0).stop 2024-09-12T02:46:24.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.146+0000 7fba24400640 1 -- 172.21.15.112:0/450840515 shutdown_connections 2024-09-12T02:46:24.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.146+0000 7fba24400640 1 --2- 172.21.15.112:0/450840515 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba1c15b9d0 0x7fba1c0b16a0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:24.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.146+0000 7fba24400640 1 --2- 172.21.15.112:0/450840515 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba1c0b45d0 0x7fba1c1f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:24.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.146+0000 7fba24400640 1 --2- 172.21.15.112:0/450840515 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb9fc06be30 0x7fb9fc06e2f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:24.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.146+0000 7fba24400640 1 --2- 172.21.15.112:0/450840515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba1c06f600 0x7fba1c153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:24.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.146+0000 7fba24400640 1 -- 172.21.15.112:0/450840515 >> 172.21.15.112:0/450840515 conn(0x7fba1c06bbd0 msgr2=0x7fba1c071f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:24.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.146+0000 7fba24400640 1 -- 172.21.15.112:0/450840515 shutdown_connections 2024-09-12T02:46:24.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.146+0000 7fba24400640 1 -- 172.21.15.112:0/450840515 wait complete. 2024-09-12T02:46:24.163 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:46:24.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.315+0000 7ff7f8000640 1 Processor -- start 2024-09-12T02:46:24.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.315+0000 7ff7f8000640 1 -- start start 2024-09-12T02:46:24.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.316+0000 7ff7f8000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff7f006f600 0x7ff7f00b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:24.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.316+0000 7ff7f8000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7f00b4a20 con 0x7ff7f015b9d0 2024-09-12T02:46:24.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.316+0000 7ff7f8000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7f00b54a0 con 0x7ff7f00b45d0 2024-09-12T02:46:24.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.316+0000 7ff7f8000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff7f00b3af0 con 0x7ff7f006f600 2024-09-12T02:46:24.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.316+0000 7ff7f4c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff7f006f600 0x7ff7f00b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:24.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.316+0000 7ff7f5600640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff7f015b9d0 0x7ff7f006eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59720/0 (socket says 172.21.15.112:59720) 2024-09-12T02:46:24.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.316+0000 7ff7f5600640 1 -- 172.21.15.112:0/1376342118 learned_addr learned my addr 172.21.15.112:0/1376342118 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:46:24.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.317+0000 7ff7f4c00640 1 -- 172.21.15.112:0/1376342118 >> v1:172.21.15.137:6789/0 conn(0x7ff7f00b45d0 legacy=0x7ff7f00cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:24.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.317+0000 7ff7f4c00640 1 -- 172.21.15.112:0/1376342118 >> v1:172.21.15.112:6789/0 conn(0x7ff7f015b9d0 legacy=0x7ff7f006eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:24.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.317+0000 7ff7efe00640 1 -- 172.21.15.112:0/1376342118 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1551630401 0 0) 0x7ff7f00b4a20 con 0x7ff7f015b9d0 2024-09-12T02:46:24.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.317+0000 7ff7f4c00640 1 -- 172.21.15.112:0/1376342118 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f00b3dd0 con 0x7ff7f006f600 2024-09-12T02:46:24.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.318+0000 7ff7f4c00640 1 --2- 172.21.15.112:0/1376342118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7f006f600 0x7ff7f00b4ec0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc009790 tx=0x7ff7dc02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d88a448bd90ee313 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:24.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.318+0000 7ff7efe00640 1 -- 172.21.15.112:0/1376342118 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc037070 con 0x7ff7f006f600 2024-09-12T02:46:24.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.318+0000 7ff7efe00640 1 -- 172.21.15.112:0/1376342118 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7dc02ae40 con 0x7ff7f006f600 2024-09-12T02:46:24.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.318+0000 7ff7efe00640 1 -- 172.21.15.112:0/1376342118 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc032660 con 0x7ff7f006f600 2024-09-12T02:46:24.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.319+0000 7ff7f8000640 1 -- 172.21.15.112:0/1376342118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7f006f600 msgr2=0x7ff7f00b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:24.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.319+0000 7ff7f8000640 1 --2- 172.21.15.112:0/1376342118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7f006f600 0x7ff7f00b4ec0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc009790 tx=0x7ff7dc02a130 comp rx=0 tx=0).stop 2024-09-12T02:46:24.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.319+0000 7ff7f8000640 1 -- 172.21.15.112:0/1376342118 shutdown_connections 2024-09-12T02:46:24.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.319+0000 7ff7f8000640 1 --2- 172.21.15.112:0/1376342118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7f006f600 0x7ff7f00b4ec0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:24.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.319+0000 7ff7f8000640 1 -- 172.21.15.112:0/1376342118 >> 172.21.15.112:0/1376342118 conn(0x7ff7f006bbd0 msgr2=0x7ff7f006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:24.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.319+0000 7ff7f8000640 1 -- 172.21.15.112:0/1376342118 shutdown_connections 2024-09-12T02:46:24.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.319+0000 7ff7f8000640 1 -- 172.21.15.112:0/1376342118 wait complete. 2024-09-12T02:46:24.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.320+0000 7ff7f8000640 1 Processor -- start 2024-09-12T02:46:24.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.321+0000 7ff7f8000640 1 -- start start 2024-09-12T02:46:24.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.321+0000 7ff7f8000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7f006f600 0x7ff7f0158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:24.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.321+0000 7ff7f8000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7f00b45d0 0x7ff7f006e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:24.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.322+0000 7ff7f8000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff7f015b9d0 0x7ff7f015e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:24.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.322+0000 7ff7f8000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f015bf30 con 0x7ff7f00b45d0 2024-09-12T02:46:24.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.322+0000 7ff7f8000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f015bdb0 con 0x7ff7f006f600 2024-09-12T02:46:24.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.322+0000 7ff7f8000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff7f00728c0 con 0x7ff7f015b9d0 2024-09-12T02:46:24.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.322+0000 7ff7f4c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7f00b45d0 0x7ff7f006e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:24.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.322+0000 7ff7f4c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7f00b45d0 0x7ff7f006e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58642/0 (socket says 172.21.15.112:58642) 2024-09-12T02:46:24.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.322+0000 7ff7f4c00640 1 -- 172.21.15.112:0/2551005727 learned_addr learned my addr 172.21.15.112:0/2551005727 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:24.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.322+0000 7ff7f5600640 1 --2- 172.21.15.112:0/2551005727 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7f006f600 0x7ff7f0158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:24.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.322+0000 7ff7f6000640 1 --2- 172.21.15.112:0/2551005727 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff7f015b9d0 0x7ff7f015e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:24.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.322+0000 7ff7f4c00640 1 -- 172.21.15.112:0/2551005727 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff7f015b9d0 msgr2=0x7ff7f015e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:24.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.322+0000 7ff7f4c00640 1 --2- 172.21.15.112:0/2551005727 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff7f015b9d0 0x7ff7f015e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:24.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.322+0000 7ff7f4c00640 1 -- 172.21.15.112:0/2551005727 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7f006f600 msgr2=0x7ff7f0158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:24.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.322+0000 7ff7f4c00640 1 --2- 172.21.15.112:0/2551005727 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7f006f600 0x7ff7f0158fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:24.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.322+0000 7ff7f4c00640 1 -- 172.21.15.112:0/2551005727 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f0159810 con 0x7ff7f00b45d0 2024-09-12T02:46:24.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.322+0000 7ff7f6000640 1 --2- 172.21.15.112:0/2551005727 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff7f015b9d0 0x7ff7f015e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:46:24.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.323+0000 7ff7f4c00640 1 --2- 172.21.15.112:0/2551005727 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7f00b45d0 0x7ff7f006e6b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc035040 tx=0x7ff7dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:24.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.323+0000 7ff7ed600640 1 -- 172.21.15.112:0/2551005727 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc042020 con 0x7ff7f00b45d0 2024-09-12T02:46:24.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.323+0000 7ff7ed600640 1 -- 172.21.15.112:0/2551005727 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7dc005ba0 con 0x7ff7f00b45d0 2024-09-12T02:46:24.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.323+0000 7ff7ed600640 1 -- 172.21.15.112:0/2551005727 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc037040 con 0x7ff7f00b45d0 2024-09-12T02:46:24.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.323+0000 7ff7f8000640 1 -- 172.21.15.112:0/2551005727 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7f0159af0 con 0x7ff7f00b45d0 2024-09-12T02:46:24.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.323+0000 7ff7f8000640 1 -- 172.21.15.112:0/2551005727 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7f0159500 con 0x7ff7f00b45d0 2024-09-12T02:46:24.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.324+0000 7ff7f8000640 1 -- 172.21.15.112:0/2551005727 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7f0072c50 con 0x7ff7f00b45d0 2024-09-12T02:46:24.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.325+0000 7ff7ed600640 1 -- 172.21.15.112:0/2551005727 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff7dc045020 con 0x7ff7f00b45d0 2024-09-12T02:46:24.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.326+0000 7ff7ed600640 1 --2- 172.21.15.112:0/2551005727 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff7d006be30 0x7ff7d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:24.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.326+0000 7ff7ed600640 1 -- 172.21.15.112:0/2551005727 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7ff7dc0ab5b0 con 0x7ff7f00b45d0 2024-09-12T02:46:24.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.326+0000 7ff7f5600640 1 --2- 172.21.15.112:0/2551005727 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff7d006be30 0x7ff7d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:24.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.326+0000 7ff7ed600640 1 -- 172.21.15.112:0/2551005727 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=85}) -- 0x7ff7d0073a20 con 0x7ff7f00b45d0 2024-09-12T02:46:24.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.327+0000 7ff7f5600640 1 --2- 172.21.15.112:0/2551005727 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff7d006be30 0x7ff7d006e2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4000f60 tx=0x7ff7e4007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:24.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.330+0000 7ff7ed600640 1 -- 172.21.15.112:0/2551005727 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff7dc0a9e20 con 0x7ff7f00b45d0 2024-09-12T02:46:24.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.536+0000 7ff7f8000640 1 -- 172.21.15.112:0/2551005727 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff7f006dbc0 con 0x7ff7f00b45d0 2024-09-12T02:46:24.537 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-12T02:46:24.537+0000 7f0216c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:46:24.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.539+0000 7ff7ed600640 1 -- 172.21.15.112:0/2551005727 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v45) ==== 161+0+0 (secure 0 0 0) 0x7ff7dc04c030 con 0x7ff7f00b45d0 2024-09-12T02:46:24.539 INFO:teuthology.orchestra.run.smithi112.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:46:24.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.539+0000 7ff7ed600640 1 -- 172.21.15.112:0/2551005727 <== mon.0 v2:172.21.15.112:3300/0 8 ==== osd_map(85..85 src has 1..85) ==== 374+0+0 (secure 0 0 0) 0x7ff7dc0dfd50 con 0x7ff7f00b45d0 2024-09-12T02:46:24.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.539+0000 7ff7ed600640 1 -- 172.21.15.112:0/2551005727 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=86}) -- 0x7ff7d0074460 con 0x7ff7f00b45d0 2024-09-12T02:46:24.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.542+0000 7ff7f8000640 1 -- 172.21.15.112:0/2551005727 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff7d006be30 msgr2=0x7ff7d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:24.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.542+0000 7ff7f8000640 1 --2- 172.21.15.112:0/2551005727 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff7d006be30 0x7ff7d006e2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4000f60 tx=0x7ff7e4007c00 comp rx=0 tx=0).stop 2024-09-12T02:46:24.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.542+0000 7ff7f8000640 1 -- 172.21.15.112:0/2551005727 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7f00b45d0 msgr2=0x7ff7f006e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:24.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.542+0000 7ff7f8000640 1 --2- 172.21.15.112:0/2551005727 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7f00b45d0 0x7ff7f006e6b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc035040 tx=0x7ff7dc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:46:24.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.542+0000 7ff7f8000640 1 -- 172.21.15.112:0/2551005727 shutdown_connections 2024-09-12T02:46:24.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.542+0000 7ff7f8000640 1 --2- 172.21.15.112:0/2551005727 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff7f015b9d0 0x7ff7f015e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:24.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.542+0000 7ff7f8000640 1 --2- 172.21.15.112:0/2551005727 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7f00b45d0 0x7ff7f006e6b0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:24.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.542+0000 7ff7f8000640 1 --2- 172.21.15.112:0/2551005727 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff7d006be30 0x7ff7d006e2f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:24.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.542+0000 7ff7f8000640 1 --2- 172.21.15.112:0/2551005727 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7f006f600 0x7ff7f0158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:24.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.542+0000 7ff7f8000640 1 -- 172.21.15.112:0/2551005727 >> 172.21.15.112:0/2551005727 conn(0x7ff7f006bbd0 msgr2=0x7ff7f00b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:24.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.542+0000 7ff7f8000640 1 -- 172.21.15.112:0/2551005727 shutdown_connections 2024-09-12T02:46:24.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.542+0000 7ff7f8000640 1 -- 172.21.15.112:0/2551005727 wait complete. 2024-09-12T02:46:24.561 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T02:46:24.612 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-12T02:46:24.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.717+0000 7f1e59200640 1 Processor -- start 2024-09-12T02:46:24.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.717+0000 7f1e59200640 1 -- start start 2024-09-12T02:46:24.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.718+0000 7f1e59200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e5415b9d0 0x7f1e540b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:24.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.718+0000 7f1e59200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1e540b45d0 0x7f1e540728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:24.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.719+0000 7f1e59200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e540b54a0 con 0x7f1e5406eef0 2024-09-12T02:46:24.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.719+0000 7f1e59200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f1e540b4a30 con 0x7f1e540b45d0 2024-09-12T02:46:24.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.719+0000 7f1e59200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1e540b3af0 con 0x7f1e5415b9d0 2024-09-12T02:46:24.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.719+0000 7f1e51e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e5415b9d0 0x7f1e540b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:24.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.719+0000 7f1e51e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e5415b9d0 0x7f1e540b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:38858/0 (socket says 172.21.15.112:38858) 2024-09-12T02:46:24.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.719+0000 7f1e51e00640 1 -- 172.21.15.112:0/143377865 learned_addr learned my addr 172.21.15.112:0/143377865 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:24.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.719+0000 7f1e49400640 1 --2- 172.21.15.112:0/143377865 >> v2:172.21.15.137:3300/0 conn(0x7f1e540b45d0 0x7f1e540728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:24.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.720+0000 7f1e51400640 1 -- 172.21.15.112:0/143377865 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1889078950 0 0) 0x7f1e540b54a0 con 0x7f1e5406eef0 2024-09-12T02:46:24.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.720+0000 7f1e51400640 1 -- 172.21.15.112:0/143377865 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e38003520 con 0x7f1e5406eef0 2024-09-12T02:46:24.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.720+0000 7f1e51e00640 1 -- 172.21.15.112:0/143377865 >> v2:172.21.15.137:3300/0 conn(0x7f1e540b45d0 msgr2=0x7f1e540728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:24.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.720+0000 7f1e51e00640 1 --2- 172.21.15.112:0/143377865 >> v2:172.21.15.137:3300/0 conn(0x7f1e540b45d0 0x7f1e540728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:24.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.720+0000 7f1e51e00640 1 -- 172.21.15.112:0/143377865 >> v1:172.21.15.137:6789/0 conn(0x7f1e5406eef0 legacy=0x7f1e5406f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:24.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.720+0000 7f1e51e00640 1 -- 172.21.15.112:0/143377865 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e540b3dd0 con 0x7f1e5415b9d0 2024-09-12T02:46:24.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.721+0000 7f1e51e00640 1 --2- 172.21.15.112:0/143377865 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e5415b9d0 0x7f1e540b4ec0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1e44009870 tx=0x7f1e4402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98572b21a44745a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:24.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.721+0000 7f1e51400640 1 -- 172.21.15.112:0/143377865 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e44037070 con 0x7f1e5415b9d0 2024-09-12T02:46:24.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.721+0000 7f1e51400640 1 -- 172.21.15.112:0/143377865 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e44032440 con 0x7f1e5415b9d0 2024-09-12T02:46:24.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.721+0000 7f1e51400640 1 -- 172.21.15.112:0/143377865 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e44032810 con 0x7f1e5415b9d0 2024-09-12T02:46:24.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.722+0000 7f1e59200640 1 -- 172.21.15.112:0/143377865 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e5415b9d0 msgr2=0x7f1e540b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:24.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.722+0000 7f1e59200640 1 --2- 172.21.15.112:0/143377865 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e5415b9d0 0x7f1e540b4ec0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1e44009870 tx=0x7f1e4402a270 comp rx=0 tx=0).stop 2024-09-12T02:46:24.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.722+0000 7f1e59200640 1 -- 172.21.15.112:0/143377865 shutdown_connections 2024-09-12T02:46:24.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.722+0000 7f1e59200640 1 --2- 172.21.15.112:0/143377865 >> v2:172.21.15.137:3300/0 conn(0x7f1e540b45d0 0x7f1e540728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:24.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.722+0000 7f1e59200640 1 --2- 172.21.15.112:0/143377865 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e5415b9d0 0x7f1e540b4ec0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:24.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.722+0000 7f1e59200640 1 -- 172.21.15.112:0/143377865 >> 172.21.15.112:0/143377865 conn(0x7f1e5406bbd0 msgr2=0x7f1e5406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:24.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.722+0000 7f1e59200640 1 -- 172.21.15.112:0/143377865 shutdown_connections 2024-09-12T02:46:24.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.722+0000 7f1e59200640 1 -- 172.21.15.112:0/143377865 wait complete. 2024-09-12T02:46:24.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.724+0000 7f1e59200640 1 Processor -- start 2024-09-12T02:46:24.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.724+0000 7f1e59200640 1 -- start start 2024-09-12T02:46:24.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.725+0000 7f1e59200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e5406eef0 0x7f1e541550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:24.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.725+0000 7f1e59200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e540b45d0 0x7f1e54167dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:24.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.725+0000 7f1e59200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e5415b9d0 0x7f1e54153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:24.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.725+0000 7f1e59200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5415bf30 con 0x7f1e5406eef0 2024-09-12T02:46:24.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.725+0000 7f1e59200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5415bdb0 con 0x7f1e540b45d0 2024-09-12T02:46:24.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.725+0000 7f1e59200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1e540cdcd0 con 0x7f1e5415b9d0 2024-09-12T02:46:24.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.725+0000 7f1e51e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e5406eef0 0x7f1e541550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:24.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.725+0000 7f1e51e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e5406eef0 0x7f1e541550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58668/0 (socket says 172.21.15.112:58668) 2024-09-12T02:46:24.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.725+0000 7f1e51e00640 1 -- 172.21.15.112:0/693439139 learned_addr learned my addr 172.21.15.112:0/693439139 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:24.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.725+0000 7f1e51e00640 1 -- 172.21.15.112:0/693439139 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e5415b9d0 msgr2=0x7f1e54153ca0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:46:24.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.725+0000 7f1e51e00640 1 --2- 172.21.15.112:0/693439139 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e5415b9d0 0x7f1e54153ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:24.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.725+0000 7f1e51e00640 1 -- 172.21.15.112:0/693439139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e540b45d0 msgr2=0x7f1e54167dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:46:24.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.725+0000 7f1e51e00640 1 --2- 172.21.15.112:0/693439139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e540b45d0 0x7f1e54167dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:24.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.725+0000 7f1e51e00640 1 -- 172.21.15.112:0/693439139 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e54166180 con 0x7f1e5406eef0 2024-09-12T02:46:24.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.726+0000 7f1e51e00640 1 --2- 172.21.15.112:0/693439139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e5406eef0 0x7f1e541550a0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f1e44009870 tx=0x7f1e440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:24.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.726+0000 7f1e4aa00640 1 -- 172.21.15.112:0/693439139 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e44041020 con 0x7f1e5406eef0 2024-09-12T02:46:24.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.726+0000 7f1e4aa00640 1 -- 172.21.15.112:0/693439139 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e4403d620 con 0x7f1e5406eef0 2024-09-12T02:46:24.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.726+0000 7f1e4aa00640 1 -- 172.21.15.112:0/693439139 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e44037040 con 0x7f1e5406eef0 2024-09-12T02:46:24.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.726+0000 7f1e59200640 1 -- 172.21.15.112:0/693439139 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e54166460 con 0x7f1e5406eef0 2024-09-12T02:46:24.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.726+0000 7f1e59200640 1 -- 172.21.15.112:0/693439139 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e54166a20 con 0x7f1e5406eef0 2024-09-12T02:46:24.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.727+0000 7f1e59200640 1 -- 172.21.15.112:0/693439139 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e54068a30 con 0x7f1e5406eef0 2024-09-12T02:46:24.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.728+0000 7f1e4aa00640 1 -- 172.21.15.112:0/693439139 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1e44044020 con 0x7f1e5406eef0 2024-09-12T02:46:24.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.729+0000 7f1e4aa00640 1 --2- 172.21.15.112:0/693439139 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1e3006be30 0x7f1e3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:24.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.729+0000 7f1e4aa00640 1 -- 172.21.15.112:0/693439139 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5853+0+0 (secure 0 0 0) 0x7f1e440ab610 con 0x7f1e5406eef0 2024-09-12T02:46:24.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.730+0000 7f1e49400640 1 --2- 172.21.15.112:0/693439139 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1e3006be30 0x7f1e3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:24.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.730+0000 7f1e4aa00640 1 -- 172.21.15.112:0/693439139 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=86}) -- 0x7f1e30073b20 con 0x7f1e5406eef0 2024-09-12T02:46:24.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.730+0000 7f1e49400640 1 --2- 172.21.15.112:0/693439139 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1e3006be30 0x7f1e3006e2f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1e540d07b0 tx=0x7f1e3c009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:24.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.734+0000 7f1e4aa00640 1 -- 172.21.15.112:0/693439139 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1e4404b030 con 0x7f1e5406eef0 2024-09-12T02:46:24.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:24.948+0000 7f1e59200640 1 -- 172.21.15.112:0/693439139 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f1e5406dbc0 con 0x7f1e5406eef0 2024-09-12T02:46:25.540 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-12T02:46:25.539+0000 7f0219e00640 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2024-09-12T02:46:25.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.544+0000 7f1e4aa00640 1 -- 172.21.15.112:0/693439139 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v46) ==== 104+0+0 (secure 0 0 0) 0x7f1e44079f20 con 0x7f1e5406eef0 2024-09-12T02:46:25.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.545+0000 7f1e4aa00640 1 -- 172.21.15.112:0/693439139 <== mon.0 v2:172.21.15.112:3300/0 8 ==== osd_map(86..86 src has 1..86) ==== 304+0+0 (secure 0 0 0) 0x7f1e440dfd50 con 0x7f1e5406eef0 2024-09-12T02:46:25.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.545+0000 7f1e4aa00640 1 -- 172.21.15.112:0/693439139 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=87}) -- 0x7f1e30074640 con 0x7f1e5406eef0 2024-09-12T02:46:25.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.549+0000 7f1e59200640 1 -- 172.21.15.112:0/693439139 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1e3006be30 msgr2=0x7f1e3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:25.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.549+0000 7f1e59200640 1 --2- 172.21.15.112:0/693439139 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1e3006be30 0x7f1e3006e2f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1e540d07b0 tx=0x7f1e3c009110 comp rx=0 tx=0).stop 2024-09-12T02:46:25.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.549+0000 7f1e59200640 1 -- 172.21.15.112:0/693439139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e5406eef0 msgr2=0x7f1e541550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:25.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.549+0000 7f1e59200640 1 --2- 172.21.15.112:0/693439139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e5406eef0 0x7f1e541550a0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f1e44009870 tx=0x7f1e440046c0 comp rx=0 tx=0).stop 2024-09-12T02:46:25.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.549+0000 7f1e59200640 1 -- 172.21.15.112:0/693439139 shutdown_connections 2024-09-12T02:46:25.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.549+0000 7f1e59200640 1 --2- 172.21.15.112:0/693439139 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e5415b9d0 0x7f1e54153ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:25.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.549+0000 7f1e59200640 1 --2- 172.21.15.112:0/693439139 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1e3006be30 0x7f1e3006e2f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:25.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.549+0000 7f1e59200640 1 --2- 172.21.15.112:0/693439139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e540b45d0 0x7f1e54167dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:25.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.549+0000 7f1e59200640 1 --2- 172.21.15.112:0/693439139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e5406eef0 0x7f1e541550a0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:25.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.549+0000 7f1e59200640 1 -- 172.21.15.112:0/693439139 >> 172.21.15.112:0/693439139 conn(0x7f1e5406bbd0 msgr2=0x7f1e540b54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:25.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.549+0000 7f1e59200640 1 -- 172.21.15.112:0/693439139 shutdown_connections 2024-09-12T02:46:25.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.549+0000 7f1e59200640 1 -- 172.21.15.112:0/693439139 wait complete. 2024-09-12T02:46:25.567 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T02:46:25.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.725+0000 7fd863800640 1 Processor -- start 2024-09-12T02:46:25.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.725+0000 7fd863800640 1 -- start start 2024-09-12T02:46:25.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.726+0000 7fd863800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd85c144890 0x7fd85c0b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:25.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.726+0000 7fd863800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd85c1602f0 0x7fd85c0b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:25.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.726+0000 7fd863800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd85c0b3290 0x7fd85c0b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:25.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.726+0000 7fd863800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd85c06eed0 con 0x7fd85c0b3290 2024-09-12T02:46:25.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.726+0000 7fd863800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd85c06f170 con 0x7fd85c144890 2024-09-12T02:46:25.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.726+0000 7fd863800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd85c15f810 con 0x7fd85c1602f0 2024-09-12T02:46:25.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.726+0000 7fd861800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd85c0b3290 0x7fd85c0b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:25.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.727+0000 7fd861800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd85c0b3290 0x7fd85c0b3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58674/0 (socket says 172.21.15.112:58674) 2024-09-12T02:46:25.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.727+0000 7fd861800640 1 -- 172.21.15.112:0/2683299981 learned_addr learned my addr 172.21.15.112:0/2683299981 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:25.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.727+0000 7fd860e00640 1 --2- 172.21.15.112:0/2683299981 >> v2:172.21.15.137:3300/0 conn(0x7fd85c144890 0x7fd85c0b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:25.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.727+0000 7fd85be00640 1 --2- 172.21.15.112:0/2683299981 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd85c1602f0 0x7fd85c0b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:25.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.727+0000 7fd861800640 1 -- 172.21.15.112:0/2683299981 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd85c1602f0 msgr2=0x7fd85c0b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:25.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.727+0000 7fd861800640 1 --2- 172.21.15.112:0/2683299981 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd85c1602f0 0x7fd85c0b3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:25.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.727+0000 7fd861800640 1 -- 172.21.15.112:0/2683299981 >> v2:172.21.15.137:3300/0 conn(0x7fd85c144890 msgr2=0x7fd85c0b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:25.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.727+0000 7fd861800640 1 --2- 172.21.15.112:0/2683299981 >> v2:172.21.15.137:3300/0 conn(0x7fd85c144890 0x7fd85c0b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:25.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.727+0000 7fd861800640 1 -- 172.21.15.112:0/2683299981 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85c15faf0 con 0x7fd85c0b3290 2024-09-12T02:46:25.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.728+0000 7fd861800640 1 --2- 172.21.15.112:0/2683299981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd85c0b3290 0x7fd85c0b3f70 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd85c0688a0 tx=0x7fd85402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6adcfda5fca9e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:25.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.728+0000 7fd85b400640 1 -- 172.21.15.112:0/2683299981 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd854036070 con 0x7fd85c0b3290 2024-09-12T02:46:25.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.728+0000 7fd85b400640 1 -- 172.21.15.112:0/2683299981 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd854031600 con 0x7fd85c0b3290 2024-09-12T02:46:25.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.728+0000 7fd85b400640 1 -- 172.21.15.112:0/2683299981 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8540319d0 con 0x7fd85c0b3290 2024-09-12T02:46:25.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.729+0000 7fd863800640 1 -- 172.21.15.112:0/2683299981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd85c0b3290 msgr2=0x7fd85c0b3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:25.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.729+0000 7fd863800640 1 --2- 172.21.15.112:0/2683299981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd85c0b3290 0x7fd85c0b3f70 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd85c0688a0 tx=0x7fd85402a6a0 comp rx=0 tx=0).stop 2024-09-12T02:46:25.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.729+0000 7fd863800640 1 -- 172.21.15.112:0/2683299981 shutdown_connections 2024-09-12T02:46:25.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.729+0000 7fd863800640 1 --2- 172.21.15.112:0/2683299981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd85c0b3290 0x7fd85c0b3f70 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:25.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.729+0000 7fd863800640 1 --2- 172.21.15.112:0/2683299981 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd85c1602f0 0x7fd85c0b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:25.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.729+0000 7fd863800640 1 --2- 172.21.15.112:0/2683299981 >> v2:172.21.15.137:3300/0 conn(0x7fd85c144890 0x7fd85c0b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:25.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.729+0000 7fd863800640 1 -- 172.21.15.112:0/2683299981 >> 172.21.15.112:0/2683299981 conn(0x7fd85c0b2730 msgr2=0x7fd85c0b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:25.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.729+0000 7fd863800640 1 -- 172.21.15.112:0/2683299981 shutdown_connections 2024-09-12T02:46:25.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.729+0000 7fd863800640 1 -- 172.21.15.112:0/2683299981 wait complete. 2024-09-12T02:46:25.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.731+0000 7fd863800640 1 Processor -- start 2024-09-12T02:46:25.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.731+0000 7fd863800640 1 -- start start 2024-09-12T02:46:25.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.732+0000 7fd863800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd85c0b3290 0x7fd85c13e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:25.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.732+0000 7fd863800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd85c144890 0x7fd85c138630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:25.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.732+0000 7fd863800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd85c1602f0 0x7fd85c15e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:25.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.732+0000 7fd863800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c144df0 con 0x7fd85c1602f0 2024-09-12T02:46:25.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.732+0000 7fd863800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c144c70 con 0x7fd85c0b3290 2024-09-12T02:46:25.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.732+0000 7fd863800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd85c0d0500 con 0x7fd85c144890 2024-09-12T02:46:25.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.732+0000 7fd861800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd85c1602f0 0x7fd85c15e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:25.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.732+0000 7fd861800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd85c1602f0 0x7fd85c15e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58690/0 (socket says 172.21.15.112:58690) 2024-09-12T02:46:25.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.732+0000 7fd861800640 1 -- 172.21.15.112:0/3055043688 learned_addr learned my addr 172.21.15.112:0/3055043688 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:25.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.732+0000 7fd860e00640 1 --2- 172.21.15.112:0/3055043688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd85c0b3290 0x7fd85c13e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:25.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.732+0000 7fd85be00640 1 --2- 172.21.15.112:0/3055043688 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd85c144890 0x7fd85c138630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:25.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.732+0000 7fd861800640 1 -- 172.21.15.112:0/3055043688 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd85c144890 msgr2=0x7fd85c138630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:25.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.732+0000 7fd861800640 1 --2- 172.21.15.112:0/3055043688 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd85c144890 0x7fd85c138630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:25.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.732+0000 7fd861800640 1 -- 172.21.15.112:0/3055043688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd85c0b3290 msgr2=0x7fd85c13e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:25.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.732+0000 7fd861800640 1 --2- 172.21.15.112:0/3055043688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd85c0b3290 0x7fd85c13e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:25.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.732+0000 7fd861800640 1 -- 172.21.15.112:0/3055043688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85c135fc0 con 0x7fd85c1602f0 2024-09-12T02:46:25.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.733+0000 7fd861800640 1 --2- 172.21.15.112:0/3055043688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd85c1602f0 0x7fd85c15e6f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd854034040 tx=0x7fd854004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:25.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.733+0000 7fd858c00640 1 -- 172.21.15.112:0/3055043688 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd854036050 con 0x7fd85c1602f0 2024-09-12T02:46:25.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.733+0000 7fd858c00640 1 -- 172.21.15.112:0/3055043688 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd854042070 con 0x7fd85c1602f0 2024-09-12T02:46:25.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.733+0000 7fd863800640 1 -- 172.21.15.112:0/3055043688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd85c136260 con 0x7fd85c1602f0 2024-09-12T02:46:25.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.733+0000 7fd858c00640 1 -- 172.21.15.112:0/3055043688 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd854009510 con 0x7fd85c1602f0 2024-09-12T02:46:25.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.733+0000 7fd863800640 1 -- 172.21.15.112:0/3055043688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd85c136820 con 0x7fd85c1602f0 2024-09-12T02:46:25.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.734+0000 7fd863800640 1 -- 172.21.15.112:0/3055043688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd85c0b58c0 con 0x7fd85c1602f0 2024-09-12T02:46:25.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.735+0000 7fd858c00640 1 -- 172.21.15.112:0/3055043688 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd854007bf0 con 0x7fd85c1602f0 2024-09-12T02:46:25.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.736+0000 7fd858c00640 1 --2- 172.21.15.112:0/3055043688 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd83c06be30 0x7fd83c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:25.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.736+0000 7fd858c00640 1 -- 172.21.15.112:0/3055043688 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5853+0+0 (secure 0 0 0) 0x7fd8540abb30 con 0x7fd85c1602f0 2024-09-12T02:46:25.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.736+0000 7fd860e00640 1 --2- 172.21.15.112:0/3055043688 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd83c06be30 0x7fd83c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:25.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.736+0000 7fd858c00640 1 -- 172.21.15.112:0/3055043688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=87}) -- 0x7fd83c073b20 con 0x7fd85c1602f0 2024-09-12T02:46:25.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.737+0000 7fd860e00640 1 --2- 172.21.15.112:0/3055043688 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd83c06be30 0x7fd83c06e2f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd85c135f70 tx=0x7fd84c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:25.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.741+0000 7fd858c00640 1 -- 172.21.15.112:0/3055043688 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd854079f10 con 0x7fd85c1602f0 2024-09-12T02:46:25.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:25.913+0000 7fd863800640 1 -- 172.21.15.112:0/3055043688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd85c13c3d0 con 0x7fd85c1602f0 2024-09-12T02:46:26.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.546+0000 7fd858c00640 1 -- 172.21.15.112:0/3055043688 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v87) ==== 181+0+0 (secure 0 0 0) 0x7fd85407e210 con 0x7fd85c1602f0 2024-09-12T02:46:26.547 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' removed 2024-09-12T02:46:26.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.547+0000 7fd858c00640 1 -- 172.21.15.112:0/3055043688 <== mon.0 v2:172.21.15.112:3300/0 8 ==== osd_map(87..87 src has 1..87) ==== 304+0+0 (secure 0 0 0) 0x7fd854077fb0 con 0x7fd85c1602f0 2024-09-12T02:46:26.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.547+0000 7fd858c00640 1 -- 172.21.15.112:0/3055043688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=88}) -- 0x7fd83c071f50 con 0x7fd85c1602f0 2024-09-12T02:46:26.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.551+0000 7fd863800640 1 -- 172.21.15.112:0/3055043688 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd83c06be30 msgr2=0x7fd83c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:26.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.551+0000 7fd863800640 1 --2- 172.21.15.112:0/3055043688 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd83c06be30 0x7fd83c06e2f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd85c135f70 tx=0x7fd84c009190 comp rx=0 tx=0).stop 2024-09-12T02:46:26.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.551+0000 7fd863800640 1 -- 172.21.15.112:0/3055043688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd85c1602f0 msgr2=0x7fd85c15e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:26.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.551+0000 7fd863800640 1 --2- 172.21.15.112:0/3055043688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd85c1602f0 0x7fd85c15e6f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd854034040 tx=0x7fd854004a40 comp rx=0 tx=0).stop 2024-09-12T02:46:26.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.552+0000 7fd863800640 1 -- 172.21.15.112:0/3055043688 shutdown_connections 2024-09-12T02:46:26.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.552+0000 7fd863800640 1 --2- 172.21.15.112:0/3055043688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd85c1602f0 0x7fd85c15e6f0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.552+0000 7fd863800640 1 --2- 172.21.15.112:0/3055043688 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd85c144890 0x7fd85c138630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.552+0000 7fd863800640 1 --2- 172.21.15.112:0/3055043688 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd83c06be30 0x7fd83c06e2f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.552+0000 7fd863800640 1 --2- 172.21.15.112:0/3055043688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd85c0b3290 0x7fd85c13e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.552+0000 7fd863800640 1 -- 172.21.15.112:0/3055043688 >> 172.21.15.112:0/3055043688 conn(0x7fd85c0b2730 msgr2=0x7fd85c0b1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:26.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.553+0000 7fd863800640 1 -- 172.21.15.112:0/3055043688 shutdown_connections 2024-09-12T02:46:26.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.553+0000 7fd863800640 1 -- 172.21.15.112:0/3055043688 wait complete. 2024-09-12T02:46:26.572 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T02:46:26.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.728+0000 7fc958200640 1 Processor -- start 2024-09-12T02:46:26.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.728+0000 7fc958200640 1 -- start start 2024-09-12T02:46:26.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.730+0000 7fc958200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc9500d10b0 0x7fc9500b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:26.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.730+0000 7fc958200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc95006dd30 0x7fc95006e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:26.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.730+0000 7fc958200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9500af530 con 0x7fc9500b5820 2024-09-12T02:46:26.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.730+0000 7fc958200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc9500af2e0 con 0x7fc9500d10b0 2024-09-12T02:46:26.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.730+0000 7fc958200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc9500af810 con 0x7fc95006dd30 2024-09-12T02:46:26.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.730+0000 7fc955800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc9500d10b0 0x7fc9500b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:26.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.730+0000 7fc955800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc9500d10b0 0x7fc9500b3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58694/0 (socket says 172.21.15.112:58694) 2024-09-12T02:46:26.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.730+0000 7fc955800640 1 -- 172.21.15.112:0/3450929538 learned_addr learned my addr 172.21.15.112:0/3450929538 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:26.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.730+0000 7fc956200640 1 --2- 172.21.15.112:0/3450929538 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc95006dd30 0x7fc95006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:26.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.730+0000 7fc955800640 1 -- 172.21.15.112:0/3450929538 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc95006dd30 msgr2=0x7fc95006e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:26.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.730+0000 7fc955800640 1 --2- 172.21.15.112:0/3450929538 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc95006dd30 0x7fc95006e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.730+0000 7fc955800640 1 -- 172.21.15.112:0/3450929538 >> v1:172.21.15.137:6789/0 conn(0x7fc9500b5820 legacy=0x7fc9500b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:26.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.730+0000 7fc955800640 1 -- 172.21.15.112:0/3450929538 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95006d550 con 0x7fc9500d10b0 2024-09-12T02:46:26.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.730+0000 7fc956200640 1 --2- 172.21.15.112:0/3450929538 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc95006dd30 0x7fc95006e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:46:26.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.731+0000 7fc955800640 1 --2- 172.21.15.112:0/3450929538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9500d10b0 0x7fc9500b3220 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc944009870 tx=0x7fc94402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aa2363df4a6275d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:26.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.732+0000 7fc94fe00640 1 -- 172.21.15.112:0/3450929538 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc944037070 con 0x7fc9500d10b0 2024-09-12T02:46:26.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.732+0000 7fc94fe00640 1 -- 172.21.15.112:0/3450929538 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc944032440 con 0x7fc9500d10b0 2024-09-12T02:46:26.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.732+0000 7fc94fe00640 1 -- 172.21.15.112:0/3450929538 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc944032810 con 0x7fc9500d10b0 2024-09-12T02:46:26.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.732+0000 7fc958200640 1 -- 172.21.15.112:0/3450929538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9500d10b0 msgr2=0x7fc9500b3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:26.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.732+0000 7fc958200640 1 --2- 172.21.15.112:0/3450929538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9500d10b0 0x7fc9500b3220 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc944009870 tx=0x7fc94402a200 comp rx=0 tx=0).stop 2024-09-12T02:46:26.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.732+0000 7fc958200640 1 -- 172.21.15.112:0/3450929538 shutdown_connections 2024-09-12T02:46:26.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.732+0000 7fc958200640 1 --2- 172.21.15.112:0/3450929538 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc95006dd30 0x7fc95006e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.732+0000 7fc958200640 1 --2- 172.21.15.112:0/3450929538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9500d10b0 0x7fc9500b3220 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.732+0000 7fc958200640 1 -- 172.21.15.112:0/3450929538 >> 172.21.15.112:0/3450929538 conn(0x7fc9500b2730 msgr2=0x7fc9500b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:26.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.732+0000 7fc958200640 1 -- 172.21.15.112:0/3450929538 shutdown_connections 2024-09-12T02:46:26.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.732+0000 7fc958200640 1 -- 172.21.15.112:0/3450929538 wait complete. 2024-09-12T02:46:26.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.734+0000 7fc958200640 1 Processor -- start 2024-09-12T02:46:26.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.734+0000 7fc958200640 1 -- start start 2024-09-12T02:46:26.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.735+0000 7fc958200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc95006dd30 0x7fc95015bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:26.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.735+0000 7fc958200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9500b5820 0x7fc9501e8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:26.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.735+0000 7fc958200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc9500d10b0 0x7fc9501e8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:26.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.735+0000 7fc958200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc9500b4140 con 0x7fc95006dd30 2024-09-12T02:46:26.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.735+0000 7fc958200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc9500d1490 con 0x7fc9500b5820 2024-09-12T02:46:26.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.735+0000 7fc958200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc9500c6820 con 0x7fc9500d10b0 2024-09-12T02:46:26.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.735+0000 7fc955800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc95006dd30 0x7fc95015bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:26.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.735+0000 7fc955800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc95006dd30 0x7fc95015bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58706/0 (socket says 172.21.15.112:58706) 2024-09-12T02:46:26.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.735+0000 7fc955800640 1 -- 172.21.15.112:0/3003854965 learned_addr learned my addr 172.21.15.112:0/3003854965 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:26.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.735+0000 7fc956200640 1 --2- 172.21.15.112:0/3003854965 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc9500d10b0 0x7fc9501e8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:26.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.735+0000 7fc955800640 1 -- 172.21.15.112:0/3003854965 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc9500d10b0 msgr2=0x7fc9501e8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:26.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.735+0000 7fc954e00640 1 --2- 172.21.15.112:0/3003854965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9500b5820 0x7fc9501e8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:26.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.735+0000 7fc955800640 1 --2- 172.21.15.112:0/3003854965 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc9500d10b0 0x7fc9501e8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.735+0000 7fc955800640 1 -- 172.21.15.112:0/3003854965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9500b5820 msgr2=0x7fc9501e8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:26.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.735+0000 7fc955800640 1 --2- 172.21.15.112:0/3003854965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9500b5820 0x7fc9501e8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:26.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.735+0000 7fc955800640 1 -- 172.21.15.112:0/3003854965 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9500c6b00 con 0x7fc95006dd30 2024-09-12T02:46:26.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.735+0000 7fc956200640 1 --2- 172.21.15.112:0/3003854965 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc9500d10b0 0x7fc9501e8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:46:26.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.735+0000 7fc954e00640 1 --2- 172.21.15.112:0/3003854965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9500b5820 0x7fc9501e8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:46:26.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.736+0000 7fc955800640 1 --2- 172.21.15.112:0/3003854965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc95006dd30 0x7fc95015bc00 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fc944009870 tx=0x7fc9440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:26.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.736+0000 7fc94d600640 1 -- 172.21.15.112:0/3003854965 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc944041020 con 0x7fc95006dd30 2024-09-12T02:46:26.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.736+0000 7fc94d600640 1 -- 172.21.15.112:0/3003854965 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc944030970 con 0x7fc95006dd30 2024-09-12T02:46:26.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.736+0000 7fc94d600640 1 -- 172.21.15.112:0/3003854965 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc944037040 con 0x7fc95006dd30 2024-09-12T02:46:26.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.736+0000 7fc958200640 1 -- 172.21.15.112:0/3003854965 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc950160560 con 0x7fc95006dd30 2024-09-12T02:46:26.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.736+0000 7fc958200640 1 -- 172.21.15.112:0/3003854965 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc950160b20 con 0x7fc95006dd30 2024-09-12T02:46:26.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.737+0000 7fc958200640 1 -- 172.21.15.112:0/3003854965 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc95015c1a0 con 0x7fc95006dd30 2024-09-12T02:46:26.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.738+0000 7fc94d600640 1 -- 172.21.15.112:0/3003854965 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc944044020 con 0x7fc95006dd30 2024-09-12T02:46:26.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.739+0000 7fc94d600640 1 --2- 172.21.15.112:0/3003854965 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc93006be30 0x7fc93006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:26.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.739+0000 7fc94d600640 1 -- 172.21.15.112:0/3003854965 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5415+0+0 (secure 0 0 0) 0x7fc9440ab7e0 con 0x7fc95006dd30 2024-09-12T02:46:26.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.739+0000 7fc94d600640 1 -- 172.21.15.112:0/3003854965 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=88}) -- 0x7fc930072cc0 con 0x7fc95006dd30 2024-09-12T02:46:26.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.739+0000 7fc954e00640 1 --2- 172.21.15.112:0/3003854965 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc93006be30 0x7fc93006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:26.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.740+0000 7fc954e00640 1 --2- 172.21.15.112:0/3003854965 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc93006be30 0x7fc93006e2f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc9501623d0 tx=0x7fc93c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:26.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.744+0000 7fc94d600640 1 -- 172.21.15.112:0/3003854965 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc95015c1a0 con 0x7fc95006dd30 2024-09-12T02:46:26.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:26.915+0000 7fc958200640 1 -- 172.21.15.112:0/3003854965 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc9500b3220 con 0x7fc95006dd30 2024-09-12T02:46:27.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.552+0000 7fc94d600640 1 -- 172.21.15.112:0/3003854965 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v88) ==== 169+0+0 (secure 0 0 0) 0x7fc9440ab070 con 0x7fc95006dd30 2024-09-12T02:46:27.554 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' removed 2024-09-12T02:46:27.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.553+0000 7fc94d600640 1 -- 172.21.15.112:0/3003854965 <== mon.0 v2:172.21.15.112:3300/0 8 ==== osd_map(88..88 src has 1..88) ==== 330+0+0 (secure 0 0 0) 0x7fc9440dfd50 con 0x7fc95006dd30 2024-09-12T02:46:27.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.553+0000 7fc94d600640 1 -- 172.21.15.112:0/3003854965 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=89}) -- 0x7fc930071a50 con 0x7fc95006dd30 2024-09-12T02:46:27.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.561+0000 7fc958200640 1 -- 172.21.15.112:0/3003854965 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc93006be30 msgr2=0x7fc93006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:27.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.561+0000 7fc958200640 1 --2- 172.21.15.112:0/3003854965 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc93006be30 0x7fc93006e2f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc9501623d0 tx=0x7fc93c009040 comp rx=0 tx=0).stop 2024-09-12T02:46:27.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.561+0000 7fc958200640 1 -- 172.21.15.112:0/3003854965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc95006dd30 msgr2=0x7fc95015bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:27.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.561+0000 7fc958200640 1 --2- 172.21.15.112:0/3003854965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc95006dd30 0x7fc95015bc00 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fc944009870 tx=0x7fc9440046c0 comp rx=0 tx=0).stop 2024-09-12T02:46:27.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.562+0000 7fc958200640 1 -- 172.21.15.112:0/3003854965 shutdown_connections 2024-09-12T02:46:27.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.562+0000 7fc958200640 1 --2- 172.21.15.112:0/3003854965 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc9500d10b0 0x7fc9501e8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:27.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.562+0000 7fc958200640 1 --2- 172.21.15.112:0/3003854965 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc93006be30 0x7fc93006e2f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:27.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.562+0000 7fc958200640 1 --2- 172.21.15.112:0/3003854965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9500b5820 0x7fc9501e8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:27.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.562+0000 7fc958200640 1 --2- 172.21.15.112:0/3003854965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc95006dd30 0x7fc95015bc00 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:27.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.562+0000 7fc958200640 1 -- 172.21.15.112:0/3003854965 >> 172.21.15.112:0/3003854965 conn(0x7fc9500b2730 msgr2=0x7fc950071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:27.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.562+0000 7fc958200640 1 -- 172.21.15.112:0/3003854965 shutdown_connections 2024-09-12T02:46:27.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.563+0000 7fc958200640 1 -- 172.21.15.112:0/3003854965 wait complete. 2024-09-12T02:46:27.583 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T02:46:27.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.739+0000 7fbe79200640 1 Processor -- start 2024-09-12T02:46:27.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.739+0000 7fbe79200640 1 -- start start 2024-09-12T02:46:27.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.740+0000 7fbe79200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbe7415cc50 0x7fbe740732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:27.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.740+0000 7fbe79200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe740afe30 0x7fbe740cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:27.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.740+0000 7fbe79200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe74073830 con 0x7fbe74071530 2024-09-12T02:46:27.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.740+0000 7fbe79200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fbe7415d030 con 0x7fbe7415cc50 2024-09-12T02:46:27.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.740+0000 7fbe79200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbe740cf4c0 con 0x7fbe740afe30 2024-09-12T02:46:27.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.741+0000 7fbe71e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbe7415cc50 0x7fbe740732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:27.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.741+0000 7fbe71400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fbe74071530 0x7fbe740af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59742/0 (socket says 172.21.15.112:59742) 2024-09-12T02:46:27.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.741+0000 7fbe71400640 1 -- 172.21.15.112:0/2025827402 learned_addr learned my addr 172.21.15.112:0/2025827402 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:46:27.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.741+0000 7fbe72800640 1 --2- 172.21.15.112:0/2025827402 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe740afe30 0x7fbe740cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:27.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.741+0000 7fbe71e00640 1 -- 172.21.15.112:0/2025827402 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe740afe30 msgr2=0x7fbe740cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:27.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.741+0000 7fbe71e00640 1 --2- 172.21.15.112:0/2025827402 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe740afe30 0x7fbe740cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:27.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.741+0000 7fbe71e00640 1 -- 172.21.15.112:0/2025827402 >> v1:172.21.15.112:6789/0 conn(0x7fbe74071530 legacy=0x7fbe740af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:27.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.741+0000 7fbe71e00640 1 -- 172.21.15.112:0/2025827402 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe740ceeb0 con 0x7fbe7415cc50 2024-09-12T02:46:27.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.741+0000 7fbe70a00640 1 -- 172.21.15.112:0/2025827402 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2256284185 0 0) 0x7fbe60001290 con 0x7fbe74071530 2024-09-12T02:46:27.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.742+0000 7fbe71e00640 1 --2- 172.21.15.112:0/2025827402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe7415cc50 0x7fbe740732f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fbe640097a0 tx=0x7fbe6402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b801ed282d10b65 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:27.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.742+0000 7fbe70a00640 1 -- 172.21.15.112:0/2025827402 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe64037070 con 0x7fbe7415cc50 2024-09-12T02:46:27.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.742+0000 7fbe70a00640 1 -- 172.21.15.112:0/2025827402 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe6402ae50 con 0x7fbe7415cc50 2024-09-12T02:46:27.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.742+0000 7fbe70a00640 1 -- 172.21.15.112:0/2025827402 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe64032660 con 0x7fbe7415cc50 2024-09-12T02:46:27.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.743+0000 7fbe79200640 1 -- 172.21.15.112:0/2025827402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe7415cc50 msgr2=0x7fbe740732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:27.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.743+0000 7fbe79200640 1 --2- 172.21.15.112:0/2025827402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe7415cc50 0x7fbe740732f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fbe640097a0 tx=0x7fbe6402a100 comp rx=0 tx=0).stop 2024-09-12T02:46:27.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.743+0000 7fbe79200640 1 -- 172.21.15.112:0/2025827402 shutdown_connections 2024-09-12T02:46:27.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.743+0000 7fbe79200640 1 --2- 172.21.15.112:0/2025827402 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe740afe30 0x7fbe740cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:27.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.743+0000 7fbe79200640 1 --2- 172.21.15.112:0/2025827402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe7415cc50 0x7fbe740732f0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:27.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.743+0000 7fbe79200640 1 -- 172.21.15.112:0/2025827402 >> 172.21.15.112:0/2025827402 conn(0x7fbe7406bbd0 msgr2=0x7fbe7406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:27.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.743+0000 7fbe79200640 1 -- 172.21.15.112:0/2025827402 shutdown_connections 2024-09-12T02:46:27.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.743+0000 7fbe79200640 1 -- 172.21.15.112:0/2025827402 wait complete. 2024-09-12T02:46:27.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.745+0000 7fbe79200640 1 Processor -- start 2024-09-12T02:46:27.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.745+0000 7fbe79200640 1 -- start start 2024-09-12T02:46:27.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.746+0000 7fbe79200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe74071530 0x7fbe7414e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:27.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.746+0000 7fbe79200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe740afe30 0x7fbe7415bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:27.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.746+0000 7fbe79200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe7415cc50 0x7fbe74155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:27.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.746+0000 7fbe79200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbe740cf150 con 0x7fbe7415cc50 2024-09-12T02:46:27.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.746+0000 7fbe79200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7406e5e0 con 0x7fbe740afe30 2024-09-12T02:46:27.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.746+0000 7fbe79200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbe7406f510 con 0x7fbe74071530 2024-09-12T02:46:27.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.746+0000 7fbe72800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe7415cc50 0x7fbe74155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:27.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.746+0000 7fbe72800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe7415cc50 0x7fbe74155ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58714/0 (socket says 172.21.15.112:58714) 2024-09-12T02:46:27.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.746+0000 7fbe72800640 1 -- 172.21.15.112:0/3147475024 learned_addr learned my addr 172.21.15.112:0/3147475024 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:27.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.746+0000 7fbe71e00640 1 --2- 172.21.15.112:0/3147475024 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe74071530 0x7fbe7414e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:27.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.746+0000 7fbe71400640 1 --2- 172.21.15.112:0/3147475024 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe740afe30 0x7fbe7415bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:27.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.746+0000 7fbe72800640 1 -- 172.21.15.112:0/3147475024 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe74071530 msgr2=0x7fbe7414e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:27.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.746+0000 7fbe72800640 1 --2- 172.21.15.112:0/3147475024 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe74071530 0x7fbe7414e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:27.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.746+0000 7fbe72800640 1 -- 172.21.15.112:0/3147475024 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe740afe30 msgr2=0x7fbe7415bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:27.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.746+0000 7fbe72800640 1 --2- 172.21.15.112:0/3147475024 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe740afe30 0x7fbe7415bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:27.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.746+0000 7fbe72800640 1 -- 172.21.15.112:0/3147475024 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe7414ea60 con 0x7fbe7415cc50 2024-09-12T02:46:27.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.746+0000 7fbe71400640 1 --2- 172.21.15.112:0/3147475024 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe740afe30 0x7fbe7415bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:27.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.747+0000 7fbe72800640 1 --2- 172.21.15.112:0/3147475024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe7415cc50 0x7fbe74155ed0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00ef90 tx=0x7fbe6c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:27.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.747+0000 7fbe6a000640 1 -- 172.21.15.112:0/3147475024 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c018020 con 0x7fbe7415cc50 2024-09-12T02:46:27.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.747+0000 7fbe6a000640 1 -- 172.21.15.112:0/3147475024 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe6c014480 con 0x7fbe7415cc50 2024-09-12T02:46:27.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.747+0000 7fbe6a000640 1 -- 172.21.15.112:0/3147475024 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c014870 con 0x7fbe7415cc50 2024-09-12T02:46:27.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.747+0000 7fbe79200640 1 -- 172.21.15.112:0/3147475024 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe74153970 con 0x7fbe7415cc50 2024-09-12T02:46:27.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.747+0000 7fbe79200640 1 -- 172.21.15.112:0/3147475024 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe74153f30 con 0x7fbe7415cc50 2024-09-12T02:46:27.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.748+0000 7fbe79200640 1 -- 172.21.15.112:0/3147475024 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe7406df60 con 0x7fbe7415cc50 2024-09-12T02:46:27.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.749+0000 7fbe6a000640 1 -- 172.21.15.112:0/3147475024 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbe6c005d10 con 0x7fbe7415cc50 2024-09-12T02:46:27.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.750+0000 7fbe6a000640 1 --2- 172.21.15.112:0/3147475024 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbe5406be30 0x7fbe5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:27.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.750+0000 7fbe6a000640 1 -- 172.21.15.112:0/3147475024 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 4943+0+0 (secure 0 0 0) 0x7fbe6c08b950 con 0x7fbe7415cc50 2024-09-12T02:46:27.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.750+0000 7fbe71e00640 1 --2- 172.21.15.112:0/3147475024 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbe5406be30 0x7fbe5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:27.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.751+0000 7fbe6a000640 1 -- 172.21.15.112:0/3147475024 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=89}) -- 0x7fbe54071620 con 0x7fbe7415cc50 2024-09-12T02:46:27.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.751+0000 7fbe71e00640 1 --2- 172.21.15.112:0/3147475024 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbe5406be30 0x7fbe5406e2f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbe64034000 tx=0x7fbe6402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:27.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.755+0000 7fbe6a000640 1 -- 172.21.15.112:0/3147475024 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe6c022030 con 0x7fbe7415cc50 2024-09-12T02:46:27.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.928+0000 7fbe79200640 1 -- 172.21.15.112:0/3147475024 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fbe740730d0 con 0x7fbe7415cc50 2024-09-12T02:46:27.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.932+0000 7fbe6a000640 1 -- 172.21.15.112:0/3147475024 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) ==== 104+0+0 (secure 0 0 0) 0x7fbe7414ea60 con 0x7fbe7415cc50 2024-09-12T02:46:27.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.935+0000 7fbe79200640 1 -- 172.21.15.112:0/3147475024 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbe5406be30 msgr2=0x7fbe5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:27.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.935+0000 7fbe79200640 1 --2- 172.21.15.112:0/3147475024 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbe5406be30 0x7fbe5406e2f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbe64034000 tx=0x7fbe6402e000 comp rx=0 tx=0).stop 2024-09-12T02:46:27.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.935+0000 7fbe79200640 1 -- 172.21.15.112:0/3147475024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe7415cc50 msgr2=0x7fbe74155ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:27.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.935+0000 7fbe79200640 1 --2- 172.21.15.112:0/3147475024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe7415cc50 0x7fbe74155ed0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00ef90 tx=0x7fbe6c00c490 comp rx=0 tx=0).stop 2024-09-12T02:46:27.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.935+0000 7fbe79200640 1 -- 172.21.15.112:0/3147475024 shutdown_connections 2024-09-12T02:46:27.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.935+0000 7fbe79200640 1 --2- 172.21.15.112:0/3147475024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe7415cc50 0x7fbe74155ed0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:27.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.935+0000 7fbe79200640 1 --2- 172.21.15.112:0/3147475024 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbe5406be30 0x7fbe5406e2f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:27.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.935+0000 7fbe79200640 1 --2- 172.21.15.112:0/3147475024 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe740afe30 0x7fbe7415bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:27.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.935+0000 7fbe79200640 1 --2- 172.21.15.112:0/3147475024 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe74071530 0x7fbe7414e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:27.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.935+0000 7fbe79200640 1 -- 172.21.15.112:0/3147475024 >> 172.21.15.112:0/3147475024 conn(0x7fbe7406bbd0 msgr2=0x7fbe7406e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:27.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.935+0000 7fbe79200640 1 -- 172.21.15.112:0/3147475024 shutdown_connections 2024-09-12T02:46:27.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:27.935+0000 7fbe79200640 1 -- 172.21.15.112:0/3147475024 wait complete. 2024-09-12T02:46:27.951 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2024-09-12T02:46:28.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.105+0000 7f1c37e00640 1 Processor -- start 2024-09-12T02:46:28.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.106+0000 7f1c37e00640 1 -- start start 2024-09-12T02:46:28.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.107+0000 7f1c37e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1c3006f600 0x7f1c300b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:28.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.107+0000 7f1c37e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1c300b45d0 0x7f1c300728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:28.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.107+0000 7f1c37e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c300b4a20 con 0x7f1c3015b9d0 2024-09-12T02:46:28.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.107+0000 7f1c37e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f1c300b54a0 con 0x7f1c300b45d0 2024-09-12T02:46:28.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.107+0000 7f1c37e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1c300b3af0 con 0x7f1c3006f600 2024-09-12T02:46:28.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.107+0000 7f1c35e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1c300b45d0 0x7f1c300728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:28.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.107+0000 7f1c35400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f1c3015b9d0 0x7f1c3006eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59758/0 (socket says 172.21.15.112:59758) 2024-09-12T02:46:28.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.107+0000 7f1c35e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1c300b45d0 0x7f1c300728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58726/0 (socket says 172.21.15.112:58726) 2024-09-12T02:46:28.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.107+0000 7f1c35400640 1 -- 172.21.15.112:0/352590527 learned_addr learned my addr 172.21.15.112:0/352590527 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:46:28.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.108+0000 7f1c34a00640 1 --2- 172.21.15.112:0/352590527 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1c3006f600 0x7f1c300b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:28.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.108+0000 7f1c35e00640 1 -- 172.21.15.112:0/352590527 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1c3006f600 msgr2=0x7f1c300b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:28.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.108+0000 7f1c35e00640 1 --2- 172.21.15.112:0/352590527 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1c3006f600 0x7f1c300b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:28.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.108+0000 7f1c35e00640 1 -- 172.21.15.112:0/352590527 >> v1:172.21.15.112:6789/0 conn(0x7f1c3015b9d0 legacy=0x7f1c3006eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:28.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.108+0000 7f1c35e00640 1 -- 172.21.15.112:0/352590527 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c300b3dd0 con 0x7f1c300b45d0 2024-09-12T02:46:28.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.108+0000 7f1c2fe00640 1 -- 172.21.15.112:0/352590527 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2761070387 0 0) 0x7f1c300b4a20 con 0x7f1c3015b9d0 2024-09-12T02:46:28.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.109+0000 7f1c35e00640 1 --2- 172.21.15.112:0/352590527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c300b45d0 0x7f1c300728c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f1c28009d90 tx=0x7f1c2802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=697afe9d6dd9e678 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:28.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.109+0000 7f1c2fe00640 1 -- 172.21.15.112:0/352590527 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c28007740 con 0x7f1c300b45d0 2024-09-12T02:46:28.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.109+0000 7f1c2fe00640 1 -- 172.21.15.112:0/352590527 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c280078e0 con 0x7f1c300b45d0 2024-09-12T02:46:28.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.109+0000 7f1c2fe00640 1 -- 172.21.15.112:0/352590527 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c28007cb0 con 0x7f1c300b45d0 2024-09-12T02:46:28.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.109+0000 7f1c37e00640 1 -- 172.21.15.112:0/352590527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c300b45d0 msgr2=0x7f1c300728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:28.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.109+0000 7f1c37e00640 1 --2- 172.21.15.112:0/352590527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c300b45d0 0x7f1c300728c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f1c28009d90 tx=0x7f1c2802a660 comp rx=0 tx=0).stop 2024-09-12T02:46:28.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.109+0000 7f1c37e00640 1 -- 172.21.15.112:0/352590527 shutdown_connections 2024-09-12T02:46:28.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.109+0000 7f1c37e00640 1 --2- 172.21.15.112:0/352590527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c300b45d0 0x7f1c300728c0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:28.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.109+0000 7f1c37e00640 1 --2- 172.21.15.112:0/352590527 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1c3006f600 0x7f1c300b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:28.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.109+0000 7f1c37e00640 1 -- 172.21.15.112:0/352590527 >> 172.21.15.112:0/352590527 conn(0x7f1c3006bbd0 msgr2=0x7f1c3006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:28.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.110+0000 7f1c37e00640 1 -- 172.21.15.112:0/352590527 shutdown_connections 2024-09-12T02:46:28.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.110+0000 7f1c37e00640 1 -- 172.21.15.112:0/352590527 wait complete. 2024-09-12T02:46:28.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.111+0000 7f1c37e00640 1 Processor -- start 2024-09-12T02:46:28.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.111+0000 7f1c37e00640 1 -- start start 2024-09-12T02:46:28.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.112+0000 7f1c37e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c3006f600 0x7f1c3014d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:28.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.112+0000 7f1c37e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1c300b45d0 0x7f1c30157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:28.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.112+0000 7f1c37e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c3015b9d0 0x7f1c301f4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:28.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.112+0000 7f1c37e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1c3015bf30 con 0x7f1c3006f600 2024-09-12T02:46:28.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.112+0000 7f1c37e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1c3015bdb0 con 0x7f1c3015b9d0 2024-09-12T02:46:28.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.112+0000 7f1c37e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1c300cdcd0 con 0x7f1c300b45d0 2024-09-12T02:46:28.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.112+0000 7f1c35400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c3006f600 0x7f1c3014d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:28.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.112+0000 7f1c35400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c3006f600 0x7f1c3014d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58740/0 (socket says 172.21.15.112:58740) 2024-09-12T02:46:28.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.112+0000 7f1c35400640 1 -- 172.21.15.112:0/2461542 learned_addr learned my addr 172.21.15.112:0/2461542 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:28.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.113+0000 7f1c34a00640 1 --2- 172.21.15.112:0/2461542 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1c300b45d0 0x7f1c30157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:28.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.113+0000 7f1c35e00640 1 --2- 172.21.15.112:0/2461542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c3015b9d0 0x7f1c301f4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:28.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.113+0000 7f1c35400640 1 -- 172.21.15.112:0/2461542 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1c300b45d0 msgr2=0x7f1c30157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:28.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.113+0000 7f1c35400640 1 --2- 172.21.15.112:0/2461542 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1c300b45d0 0x7f1c30157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:28.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.113+0000 7f1c35400640 1 -- 172.21.15.112:0/2461542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c3015b9d0 msgr2=0x7f1c301f4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:28.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.113+0000 7f1c35400640 1 --2- 172.21.15.112:0/2461542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c3015b9d0 0x7f1c301f4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:28.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.113+0000 7f1c35400640 1 -- 172.21.15.112:0/2461542 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c3015d5a0 con 0x7f1c3006f600 2024-09-12T02:46:28.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.113+0000 7f1c35400640 1 --2- 172.21.15.112:0/2461542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c3006f600 0x7f1c3014d6c0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1c2400c430 tx=0x7f1c2400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:28.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.113+0000 7f1c2d600640 1 -- 172.21.15.112:0/2461542 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c240074e0 con 0x7f1c3006f600 2024-09-12T02:46:28.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.113+0000 7f1c2d600640 1 -- 172.21.15.112:0/2461542 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c240047e0 con 0x7f1c3006f600 2024-09-12T02:46:28.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.113+0000 7f1c37e00640 1 -- 172.21.15.112:0/2461542 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c3015d880 con 0x7f1c3006f600 2024-09-12T02:46:28.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.113+0000 7f1c2d600640 1 -- 172.21.15.112:0/2461542 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c24004bd0 con 0x7f1c3006f600 2024-09-12T02:46:28.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.114+0000 7f1c37e00640 1 -- 172.21.15.112:0/2461542 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c3015de40 con 0x7f1c3006f600 2024-09-12T02:46:28.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.114+0000 7f1c37e00640 1 -- 172.21.15.112:0/2461542 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c3006ed40 con 0x7f1c3006f600 2024-09-12T02:46:28.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.116+0000 7f1c2d600640 1 -- 172.21.15.112:0/2461542 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1c24011070 con 0x7f1c3006f600 2024-09-12T02:46:28.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.117+0000 7f1c2d600640 1 --2- 172.21.15.112:0/2461542 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1c1006be30 0x7f1c1006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:28.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.117+0000 7f1c2d600640 1 -- 172.21.15.112:0/2461542 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 4943+0+0 (secure 0 0 0) 0x7f1c2408a810 con 0x7f1c3006f600 2024-09-12T02:46:28.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.117+0000 7f1c34a00640 1 --2- 172.21.15.112:0/2461542 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1c1006be30 0x7f1c1006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:28.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.117+0000 7f1c2d600640 1 -- 172.21.15.112:0/2461542 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=89}) -- 0x7f1c10071620 con 0x7f1c3006f600 2024-09-12T02:46:28.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.118+0000 7f1c34a00640 1 --2- 172.21.15.112:0/2461542 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1c1006be30 0x7f1c1006e2f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1c300cfb40 tx=0x7f1c1c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:28.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.121+0000 7f1c2d600640 1 -- 172.21.15.112:0/2461542 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1c240594b0 con 0x7f1c3006f600 2024-09-12T02:46:28.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:28.362+0000 7f1c37e00640 1 -- 172.21.15.112:0/2461542 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) -- 0x7f1c300763b0 con 0x7f1c3006f600 2024-09-12T02:46:29.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.175+0000 7f1c2d600640 1 -- 172.21.15.112:0/2461542 <== mon.0 v2:172.21.15.112:3300/0 7 ==== osd_map(89..89 src has 1..89) ==== 666+0+0 (secure 0 0 0) 0x7f1c240bed50 con 0x7f1c3006f600 2024-09-12T02:46:29.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.175+0000 7f1c2d600640 1 -- 172.21.15.112:0/2461542 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=90}) -- 0x7f1c10072050 con 0x7f1c3006f600 2024-09-12T02:46:29.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.175+0000 7f1c2d600640 1 -- 172.21.15.112:0/2461542 <== mon.0 v2:172.21.15.112:3300/0 8 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v237) ==== 133+0+0 (secure 0 0 0) 0x7f1c24058db0 con 0x7f1c3006f600 2024-09-12T02:46:29.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.178+0000 7f1c37e00640 1 -- 172.21.15.112:0/2461542 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1c1006be30 msgr2=0x7f1c1006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:29.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.178+0000 7f1c37e00640 1 --2- 172.21.15.112:0/2461542 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1c1006be30 0x7f1c1006e2f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1c300cfb40 tx=0x7f1c1c008040 comp rx=0 tx=0).stop 2024-09-12T02:46:29.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.178+0000 7f1c37e00640 1 -- 172.21.15.112:0/2461542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c3006f600 msgr2=0x7f1c3014d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:29.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.178+0000 7f1c37e00640 1 --2- 172.21.15.112:0/2461542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c3006f600 0x7f1c3014d6c0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1c2400c430 tx=0x7f1c2400c8f0 comp rx=0 tx=0).stop 2024-09-12T02:46:29.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.178+0000 7f1c37e00640 1 -- 172.21.15.112:0/2461542 shutdown_connections 2024-09-12T02:46:29.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.178+0000 7f1c37e00640 1 --2- 172.21.15.112:0/2461542 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1c1006be30 0x7f1c1006e2f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:29.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.178+0000 7f1c37e00640 1 --2- 172.21.15.112:0/2461542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c3015b9d0 0x7f1c301f4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:29.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.178+0000 7f1c37e00640 1 --2- 172.21.15.112:0/2461542 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1c300b45d0 0x7f1c30157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:29.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.178+0000 7f1c37e00640 1 --2- 172.21.15.112:0/2461542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c3006f600 0x7f1c3014d6c0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:29.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.178+0000 7f1c37e00640 1 -- 172.21.15.112:0/2461542 >> 172.21.15.112:0/2461542 conn(0x7f1c3006bbd0 msgr2=0x7f1c300b18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:29.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.179+0000 7f1c37e00640 1 -- 172.21.15.112:0/2461542 shutdown_connections 2024-09-12T02:46:29.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.179+0000 7f1c37e00640 1 -- 172.21.15.112:0/2461542 wait complete. 2024-09-12T02:46:29.198 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2024-09-12T02:46:29.198 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestClusterFull) 2024-09-12T02:46:29.199 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:46:29.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.353+0000 7fe2f8e00640 1 Processor -- start 2024-09-12T02:46:29.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.353+0000 7fe2f8e00640 1 -- start start 2024-09-12T02:46:29.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.354+0000 7fe2f8e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe2f40b0770 0x7fe2f40708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:29.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.354+0000 7fe2f8e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2f40b0c70 con 0x7fe2f40b4ce0 2024-09-12T02:46:29.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.355+0000 7fe2f8e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2f40b0f50 con 0x7fe2f415c800 2024-09-12T02:46:29.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.355+0000 7fe2f8e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe2f40b1230 con 0x7fe2f40b0770 2024-09-12T02:46:29.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.355+0000 7fe2f2a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe2f40b0770 0x7fe2f40708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:29.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.355+0000 7fe2f2a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe2f40b0770 0x7fe2f40708c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58744/0 (socket says 172.21.15.112:58744) 2024-09-12T02:46:29.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.355+0000 7fe2f2a00640 1 -- 172.21.15.112:0/881604422 learned_addr learned my addr 172.21.15.112:0/881604422 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:29.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.355+0000 7fe2f2a00640 1 -- 172.21.15.112:0/881604422 >> v1:172.21.15.137:6789/0 conn(0x7fe2f415c800 legacy=0x7fe2f415f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:29.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.355+0000 7fe2f2a00640 1 -- 172.21.15.112:0/881604422 >> v1:172.21.15.112:6789/0 conn(0x7fe2f40b4ce0 legacy=0x7fe2f406bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:29.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.355+0000 7fe2f2a00640 1 -- 172.21.15.112:0/881604422 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f415f2a0 con 0x7fe2f40b0770 2024-09-12T02:46:29.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.356+0000 7fe2f2a00640 1 --2- 172.21.15.112:0/881604422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2f40b0770 0x7fe2f40708c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0009870 tx=0x7fe2e002a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35f9adf85e68c69 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:29.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.356+0000 7fe2f2000640 1 -- 172.21.15.112:0/881604422 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e0037070 con 0x7fe2f40b0770 2024-09-12T02:46:29.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.357+0000 7fe2f2000640 1 -- 172.21.15.112:0/881604422 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2e0032440 con 0x7fe2f40b0770 2024-09-12T02:46:29.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.357+0000 7fe2f2000640 1 -- 172.21.15.112:0/881604422 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e0032810 con 0x7fe2f40b0770 2024-09-12T02:46:29.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.357+0000 7fe2f8e00640 1 -- 172.21.15.112:0/881604422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2f40b0770 msgr2=0x7fe2f40708c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:29.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.357+0000 7fe2f8e00640 1 --2- 172.21.15.112:0/881604422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2f40b0770 0x7fe2f40708c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0009870 tx=0x7fe2e002a200 comp rx=0 tx=0).stop 2024-09-12T02:46:29.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.357+0000 7fe2f8e00640 1 -- 172.21.15.112:0/881604422 shutdown_connections 2024-09-12T02:46:29.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.357+0000 7fe2f8e00640 1 --2- 172.21.15.112:0/881604422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2f40b0770 0x7fe2f40708c0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:29.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.357+0000 7fe2f8e00640 1 -- 172.21.15.112:0/881604422 >> 172.21.15.112:0/881604422 conn(0x7fe2f406cce0 msgr2=0x7fe2f406d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:29.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.357+0000 7fe2f8e00640 1 -- 172.21.15.112:0/881604422 shutdown_connections 2024-09-12T02:46:29.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.357+0000 7fe2f8e00640 1 -- 172.21.15.112:0/881604422 wait complete. 2024-09-12T02:46:29.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.359+0000 7fe2f8e00640 1 Processor -- start 2024-09-12T02:46:29.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.359+0000 7fe2f8e00640 1 -- start start 2024-09-12T02:46:29.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.360+0000 7fe2f8e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2f40b0770 0x7fe2f4151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:29.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.360+0000 7fe2f8e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe2f40b4ce0 0x7fe2f415e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:29.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.360+0000 7fe2f8e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2f415c800 0x7fe2f4156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:29.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.360+0000 7fe2f8e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f406f360 con 0x7fe2f415c800 2024-09-12T02:46:29.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.360+0000 7fe2f8e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f406f1e0 con 0x7fe2f40b0770 2024-09-12T02:46:29.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.360+0000 7fe2f8e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe2f406c2e0 con 0x7fe2f40b4ce0 2024-09-12T02:46:29.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.360+0000 7fe2f3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2f415c800 0x7fe2f4156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:29.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.360+0000 7fe2f3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2f415c800 0x7fe2f4156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58758/0 (socket says 172.21.15.112:58758) 2024-09-12T02:46:29.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.360+0000 7fe2f3e00640 1 -- 172.21.15.112:0/2301286101 learned_addr learned my addr 172.21.15.112:0/2301286101 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:29.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.361+0000 7fe2f3400640 1 --2- 172.21.15.112:0/2301286101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2f40b0770 0x7fe2f4151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:29.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.361+0000 7fe2f3e00640 1 -- 172.21.15.112:0/2301286101 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe2f40b4ce0 msgr2=0x7fe2f415e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:29.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.361+0000 7fe2f2a00640 1 --2- 172.21.15.112:0/2301286101 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe2f40b4ce0 0x7fe2f415e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:29.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.361+0000 7fe2f3e00640 1 --2- 172.21.15.112:0/2301286101 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe2f40b4ce0 0x7fe2f415e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:29.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.361+0000 7fe2f3e00640 1 -- 172.21.15.112:0/2301286101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2f40b0770 msgr2=0x7fe2f4151530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:29.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.361+0000 7fe2f3e00640 1 --2- 172.21.15.112:0/2301286101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2f40b0770 0x7fe2f4151530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:29.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.361+0000 7fe2f3e00640 1 -- 172.21.15.112:0/2301286101 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f415d2a0 con 0x7fe2f415c800 2024-09-12T02:46:29.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.361+0000 7fe2f3400640 1 --2- 172.21.15.112:0/2301286101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2f40b0770 0x7fe2f4151530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:46:29.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.361+0000 7fe2f2a00640 1 --2- 172.21.15.112:0/2301286101 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe2f40b4ce0 0x7fe2f415e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:46:29.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.361+0000 7fe2f3e00640 1 --2- 172.21.15.112:0/2301286101 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2f415c800 0x7fe2f4156b30 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00caf0 tx=0x7fe2ec002090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:29.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.361+0000 7fe2eb400640 1 -- 172.21.15.112:0/2301286101 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec017070 con 0x7fe2f415c800 2024-09-12T02:46:29.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.361+0000 7fe2eb400640 1 -- 172.21.15.112:0/2301286101 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2ec003da0 con 0x7fe2f415c800 2024-09-12T02:46:29.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.361+0000 7fe2f8e00640 1 -- 172.21.15.112:0/2301286101 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2f415d580 con 0x7fe2f415c800 2024-09-12T02:46:29.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.361+0000 7fe2eb400640 1 -- 172.21.15.112:0/2301286101 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec00a940 con 0x7fe2f415c800 2024-09-12T02:46:29.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.361+0000 7fe2f8e00640 1 -- 172.21.15.112:0/2301286101 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2f415de20 con 0x7fe2f415c800 2024-09-12T02:46:29.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.363+0000 7fe2f8e00640 1 -- 172.21.15.112:0/2301286101 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2f415d750 con 0x7fe2f415c800 2024-09-12T02:46:29.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.363+0000 7fe2eb400640 1 -- 172.21.15.112:0/2301286101 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe2ec01a070 con 0x7fe2f415c800 2024-09-12T02:46:29.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.364+0000 7fe2eb400640 1 --2- 172.21.15.112:0/2301286101 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe2d406be30 0x7fe2d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:29.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.364+0000 7fe2eb400640 1 -- 172.21.15.112:0/2301286101 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 4943+0+0 (secure 0 0 0) 0x7fe2ec08a330 con 0x7fe2f415c800 2024-09-12T02:46:29.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.364+0000 7fe2f3400640 1 --2- 172.21.15.112:0/2301286101 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe2d406be30 0x7fe2d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:29.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.365+0000 7fe2f3400640 1 --2- 172.21.15.112:0/2301286101 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe2d406be30 0x7fe2d406e2f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4000f60 tx=0x7fe2e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:29.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.369+0000 7fe2eb400640 1 -- 172.21.15.112:0/2301286101 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe2ec059070 con 0x7fe2f415c800 2024-09-12T02:46:29.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.541+0000 7fe2f8e00640 1 -- 172.21.15.112:0/2301286101 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe2f40708c0 con 0x7fe2f415c800 2024-09-12T02:46:29.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.542+0000 7fe2eb400640 1 -- 172.21.15.112:0/2301286101 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+13083 (secure 0 0 0) 0x7fe2ec058970 con 0x7fe2f415c800 2024-09-12T02:46:29.543 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:46:29.543 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":89,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:46:29.170583+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6836/1248364583":"2024-09-13T02:46:24.537763+0000","172.21.15.112:6835/1248364583":"2024-09-13T02:46:24.537763+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:46:29.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.544+0000 7fe2f8e00640 1 -- 172.21.15.112:0/2301286101 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe2d406be30 msgr2=0x7fe2d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:29.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.544+0000 7fe2f8e00640 1 --2- 172.21.15.112:0/2301286101 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe2d406be30 0x7fe2d406e2f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4000f60 tx=0x7fe2e4009040 comp rx=0 tx=0).stop 2024-09-12T02:46:29.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.544+0000 7fe2f8e00640 1 -- 172.21.15.112:0/2301286101 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2f415c800 msgr2=0x7fe2f4156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:29.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.544+0000 7fe2f8e00640 1 --2- 172.21.15.112:0/2301286101 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2f415c800 0x7fe2f4156b30 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00caf0 tx=0x7fe2ec002090 comp rx=0 tx=0).stop 2024-09-12T02:46:29.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.544+0000 7fe2f8e00640 1 -- 172.21.15.112:0/2301286101 shutdown_connections 2024-09-12T02:46:29.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.544+0000 7fe2f8e00640 1 --2- 172.21.15.112:0/2301286101 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2f415c800 0x7fe2f4156b30 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:29.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.544+0000 7fe2f8e00640 1 --2- 172.21.15.112:0/2301286101 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe2f40b4ce0 0x7fe2f415e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:29.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.544+0000 7fe2f8e00640 1 --2- 172.21.15.112:0/2301286101 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe2d406be30 0x7fe2d406e2f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:29.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.544+0000 7fe2f8e00640 1 --2- 172.21.15.112:0/2301286101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2f40b0770 0x7fe2f4151530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:29.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.544+0000 7fe2f8e00640 1 -- 172.21.15.112:0/2301286101 >> 172.21.15.112:0/2301286101 conn(0x7fe2f406cce0 msgr2=0x7fe2f4067c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:29.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.545+0000 7fe2f8e00640 1 -- 172.21.15.112:0/2301286101 shutdown_connections 2024-09-12T02:46:29.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.545+0000 7fe2f8e00640 1 -- 172.21.15.112:0/2301286101 wait complete. 2024-09-12T02:46:29.561 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:41:43.011599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:46:29.561 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T02:46:29.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.716+0000 7f9a80a00640 1 Processor -- start 2024-09-12T02:46:29.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.716+0000 7f9a80a00640 1 -- start start 2024-09-12T02:46:29.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.717+0000 7f9a80a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9a7c0d1710 0x7f9a7c0d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:29.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.717+0000 7f9a80a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9a7c0b3e00 0x7f9a7c0d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:29.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.717+0000 7f9a80a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a7c0d2fb0 con 0x7f9a7c0cf7a0 2024-09-12T02:46:29.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.717+0000 7f9a80a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f9a7c0d3cb0 con 0x7f9a7c0d1710 2024-09-12T02:46:29.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.717+0000 7f9a80a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9a7c0d0b60 con 0x7f9a7c0b3e00 2024-09-12T02:46:29.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.717+0000 7f9a7b400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9a7c0d1710 0x7f9a7c0d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:29.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.717+0000 7f9a7b400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9a7c0d1710 0x7f9a7c0d28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58762/0 (socket says 172.21.15.112:58762) 2024-09-12T02:46:29.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.717+0000 7f9a7b400640 1 -- 172.21.15.112:0/2845063107 learned_addr learned my addr 172.21.15.112:0/2845063107 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:29.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.717+0000 7f9a7aa00640 1 --2- 172.21.15.112:0/2845063107 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9a7c0b3e00 0x7f9a7c0d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:29.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.718+0000 7f9a7b400640 1 -- 172.21.15.112:0/2845063107 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9a7c0b3e00 msgr2=0x7f9a7c0d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:29.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.718+0000 7f9a7b400640 1 --2- 172.21.15.112:0/2845063107 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9a7c0b3e00 0x7f9a7c0d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:29.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.718+0000 7f9a7b400640 1 -- 172.21.15.112:0/2845063107 >> v1:172.21.15.137:6789/0 conn(0x7f9a7c0cf7a0 legacy=0x7f9a7c0cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:29.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.718+0000 7f9a7b400640 1 -- 172.21.15.112:0/2845063107 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a7c0d2030 con 0x7f9a7c0d1710 2024-09-12T02:46:29.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.719+0000 7f9a7b400640 1 --2- 172.21.15.112:0/2845063107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a7c0d1710 0x7f9a7c0d28d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c009870 tx=0x7f9a6c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a00b19e9f197a5a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:29.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.719+0000 7f9a7a000640 1 -- 172.21.15.112:0/2845063107 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c037070 con 0x7f9a7c0d1710 2024-09-12T02:46:29.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.719+0000 7f9a7a000640 1 -- 172.21.15.112:0/2845063107 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a6c032440 con 0x7f9a7c0d1710 2024-09-12T02:46:29.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.719+0000 7f9a7a000640 1 -- 172.21.15.112:0/2845063107 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c032810 con 0x7f9a7c0d1710 2024-09-12T02:46:29.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.719+0000 7f9a80a00640 1 -- 172.21.15.112:0/2845063107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a7c0d1710 msgr2=0x7f9a7c0d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:29.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.719+0000 7f9a80a00640 1 --2- 172.21.15.112:0/2845063107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a7c0d1710 0x7f9a7c0d28d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c009870 tx=0x7f9a6c02a270 comp rx=0 tx=0).stop 2024-09-12T02:46:29.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.720+0000 7f9a80a00640 1 -- 172.21.15.112:0/2845063107 shutdown_connections 2024-09-12T02:46:29.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.720+0000 7f9a80a00640 1 --2- 172.21.15.112:0/2845063107 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9a7c0b3e00 0x7f9a7c0d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:29.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.720+0000 7f9a80a00640 1 --2- 172.21.15.112:0/2845063107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a7c0d1710 0x7f9a7c0d28d0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:29.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.720+0000 7f9a80a00640 1 -- 172.21.15.112:0/2845063107 >> 172.21.15.112:0/2845063107 conn(0x7f9a7c09e030 msgr2=0x7f9a7c0d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:29.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.720+0000 7f9a80a00640 1 -- 172.21.15.112:0/2845063107 shutdown_connections 2024-09-12T02:46:29.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.720+0000 7f9a80a00640 1 -- 172.21.15.112:0/2845063107 wait complete. 2024-09-12T02:46:29.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.721+0000 7f9a80a00640 1 Processor -- start 2024-09-12T02:46:29.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.721+0000 7f9a80a00640 1 -- start start 2024-09-12T02:46:29.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.722+0000 7f9a80a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9a7c0b3e00 0x7f9a7c161f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:29.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.722+0000 7f9a80a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a7c0cf7a0 0x7f9a7c156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:29.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.722+0000 7f9a80a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9a7c0d1710 0x7f9a7c0ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:29.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.722+0000 7f9a80a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c0d39d0 con 0x7f9a7c0cf7a0 2024-09-12T02:46:29.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.722+0000 7f9a80a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c0d36f0 con 0x7f9a7c0d1710 2024-09-12T02:46:29.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.722+0000 7f9a80a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9a7c15f110 con 0x7f9a7c0b3e00 2024-09-12T02:46:29.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.722+0000 7f9a7aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a7c0cf7a0 0x7f9a7c156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:29.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.723+0000 7f9a7aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a7c0cf7a0 0x7f9a7c156d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58768/0 (socket says 172.21.15.112:58768) 2024-09-12T02:46:29.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.723+0000 7f9a7be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9a7c0d1710 0x7f9a7c0ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:29.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.723+0000 7f9a7aa00640 1 -- 172.21.15.112:0/206814188 learned_addr learned my addr 172.21.15.112:0/206814188 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:29.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.723+0000 7f9a7b400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9a7c0b3e00 0x7f9a7c161f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:29.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.723+0000 7f9a7aa00640 1 -- 172.21.15.112:0/206814188 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9a7c0b3e00 msgr2=0x7f9a7c161f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:29.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.723+0000 7f9a7aa00640 1 --2- 172.21.15.112:0/206814188 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9a7c0b3e00 0x7f9a7c161f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:29.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.723+0000 7f9a7aa00640 1 -- 172.21.15.112:0/206814188 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9a7c0d1710 msgr2=0x7f9a7c0ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:29.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.723+0000 7f9a7aa00640 1 --2- 172.21.15.112:0/206814188 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9a7c0d1710 0x7f9a7c0ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:29.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.723+0000 7f9a7aa00640 1 -- 172.21.15.112:0/206814188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a7c0ce700 con 0x7f9a7c0cf7a0 2024-09-12T02:46:29.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.723+0000 7f9a7aa00640 1 --2- 172.21.15.112:0/206814188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a7c0cf7a0 0x7f9a7c156d70 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f9a6800d800 tx=0x7f9a6800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:29.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.723+0000 7f9a73400640 1 -- 172.21.15.112:0/206814188 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6800b6c0 con 0x7f9a7c0cf7a0 2024-09-12T02:46:29.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.723+0000 7f9a73400640 1 -- 172.21.15.112:0/206814188 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a68019070 con 0x7f9a7c0cf7a0 2024-09-12T02:46:29.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.723+0000 7f9a80a00640 1 -- 172.21.15.112:0/206814188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a7c0ce9a0 con 0x7f9a7c0cf7a0 2024-09-12T02:46:29.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.724+0000 7f9a73400640 1 -- 172.21.15.112:0/206814188 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6800ba80 con 0x7f9a7c0cf7a0 2024-09-12T02:46:29.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.724+0000 7f9a80a00640 1 -- 172.21.15.112:0/206814188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a7c0cc150 con 0x7f9a7c0cf7a0 2024-09-12T02:46:29.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.725+0000 7f9a80a00640 1 -- 172.21.15.112:0/206814188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a7c0d1af0 con 0x7f9a7c0cf7a0 2024-09-12T02:46:29.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.725+0000 7f9a73400640 1 -- 172.21.15.112:0/206814188 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9a6800bc20 con 0x7f9a7c0cf7a0 2024-09-12T02:46:29.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.726+0000 7f9a73400640 1 --2- 172.21.15.112:0/206814188 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9a5c06be30 0x7f9a5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:29.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.726+0000 7f9a73400640 1 -- 172.21.15.112:0/206814188 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 4943+0+0 (secure 0 0 0) 0x7f9a6808af70 con 0x7f9a7c0cf7a0 2024-09-12T02:46:29.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.727+0000 7f9a7b400640 1 --2- 172.21.15.112:0/206814188 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9a5c06be30 0x7f9a5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:29.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.727+0000 7f9a7b400640 1 --2- 172.21.15.112:0/206814188 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9a5c06be30 0x7f9a5c06e2f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c034000 tx=0x7f9a6c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:29.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.731+0000 7f9a73400640 1 -- 172.21.15.112:0/206814188 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9a68059530 con 0x7f9a7c0cf7a0 2024-09-12T02:46:29.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.904+0000 7f9a80a00640 1 -- 172.21.15.112:0/206814188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9a7c0b2bb0 con 0x7f9a7c0cf7a0 2024-09-12T02:46:29.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.905+0000 7f9a73400640 1 -- 172.21.15.112:0/206814188 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7f9a6805d830 con 0x7f9a7c0cf7a0 2024-09-12T02:46:29.906 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2024-09-12T02:46:29.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.907+0000 7f9a80a00640 1 -- 172.21.15.112:0/206814188 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9a5c06be30 msgr2=0x7f9a5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:29.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.907+0000 7f9a80a00640 1 --2- 172.21.15.112:0/206814188 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9a5c06be30 0x7f9a5c06e2f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c034000 tx=0x7f9a6c02e000 comp rx=0 tx=0).stop 2024-09-12T02:46:29.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.907+0000 7f9a80a00640 1 -- 172.21.15.112:0/206814188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a7c0cf7a0 msgr2=0x7f9a7c156d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:29.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.907+0000 7f9a80a00640 1 --2- 172.21.15.112:0/206814188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a7c0cf7a0 0x7f9a7c156d70 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f9a6800d800 tx=0x7f9a6800dcc0 comp rx=0 tx=0).stop 2024-09-12T02:46:29.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.907+0000 7f9a80a00640 1 -- 172.21.15.112:0/206814188 shutdown_connections 2024-09-12T02:46:29.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.907+0000 7f9a80a00640 1 --2- 172.21.15.112:0/206814188 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9a5c06be30 0x7f9a5c06e2f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:29.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.907+0000 7f9a80a00640 1 --2- 172.21.15.112:0/206814188 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9a7c0d1710 0x7f9a7c0ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:29.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.907+0000 7f9a80a00640 1 --2- 172.21.15.112:0/206814188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a7c0cf7a0 0x7f9a7c156d70 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:29.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.907+0000 7f9a80a00640 1 --2- 172.21.15.112:0/206814188 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9a7c0b3e00 0x7f9a7c161f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:29.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.907+0000 7f9a80a00640 1 -- 172.21.15.112:0/206814188 >> 172.21.15.112:0/206814188 conn(0x7f9a7c09e030 msgr2=0x7f9a7c0d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:29.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.907+0000 7f9a80a00640 1 -- 172.21.15.112:0/206814188 shutdown_connections 2024-09-12T02:46:29.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:29.907+0000 7f9a80a00640 1 -- 172.21.15.112:0/206814188 wait complete. 2024-09-12T02:46:29.923 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2024-09-12T02:46:30.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.075+0000 7f3bff200640 1 Processor -- start 2024-09-12T02:46:30.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.075+0000 7f3bff200640 1 -- start start 2024-09-12T02:46:30.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.076+0000 7f3bff200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3c000d1710 0x7f3c000d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:30.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.076+0000 7f3bff200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3c000b1d70 0x7f3c000b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:30.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.076+0000 7f3bff200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c000d2fb0 con 0x7f3c000b3e00 2024-09-12T02:46:30.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.076+0000 7f3bff200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f3c000d3cb0 con 0x7f3c000d1710 2024-09-12T02:46:30.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.076+0000 7f3bff200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3c000d0b60 con 0x7f3c000b1d70 2024-09-12T02:46:30.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.077+0000 7f3bfde00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3c000d1710 0x7f3c000d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:30.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.077+0000 7f3bfde00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3c000d1710 0x7f3c000d28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58770/0 (socket says 172.21.15.112:58770) 2024-09-12T02:46:30.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.077+0000 7f3bfde00640 1 -- 172.21.15.112:0/2011862538 learned_addr learned my addr 172.21.15.112:0/2011862538 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:30.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.077+0000 7f3bfe800640 1 --2- 172.21.15.112:0/2011862538 >> v2:172.21.15.137:3300/0 conn(0x7f3c000b1d70 0x7f3c000b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:30.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.077+0000 7f3bfde00640 1 -- 172.21.15.112:0/2011862538 >> v2:172.21.15.137:3300/0 conn(0x7f3c000b1d70 msgr2=0x7f3c000b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:30.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.077+0000 7f3bfde00640 1 --2- 172.21.15.112:0/2011862538 >> v2:172.21.15.137:3300/0 conn(0x7f3c000b1d70 0x7f3c000b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:30.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.077+0000 7f3bfde00640 1 -- 172.21.15.112:0/2011862538 >> v1:172.21.15.137:6789/0 conn(0x7f3c000b3e00 legacy=0x7f3c000d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:30.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.077+0000 7f3bfde00640 1 -- 172.21.15.112:0/2011862538 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c000d3410 con 0x7f3c000d1710 2024-09-12T02:46:30.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.078+0000 7f3bfde00640 1 --2- 172.21.15.112:0/2011862538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c000d1710 0x7f3c000d28d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f3c0008ef20 tx=0x7f3bf002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b810ba67c44f616 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:30.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.078+0000 7f3bfd400640 1 -- 172.21.15.112:0/2011862538 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0037070 con 0x7f3c000d1710 2024-09-12T02:46:30.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.078+0000 7f3bfd400640 1 -- 172.21.15.112:0/2011862538 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf0032440 con 0x7f3c000d1710 2024-09-12T02:46:30.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.078+0000 7f3bfd400640 1 -- 172.21.15.112:0/2011862538 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0032810 con 0x7f3c000d1710 2024-09-12T02:46:30.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.079+0000 7f3bff200640 1 -- 172.21.15.112:0/2011862538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c000d1710 msgr2=0x7f3c000d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:30.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.079+0000 7f3bff200640 1 --2- 172.21.15.112:0/2011862538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c000d1710 0x7f3c000d28d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f3c0008ef20 tx=0x7f3bf002a270 comp rx=0 tx=0).stop 2024-09-12T02:46:30.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.079+0000 7f3bff200640 1 -- 172.21.15.112:0/2011862538 shutdown_connections 2024-09-12T02:46:30.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.079+0000 7f3bff200640 1 --2- 172.21.15.112:0/2011862538 >> v2:172.21.15.137:3300/0 conn(0x7f3c000b1d70 0x7f3c000b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:30.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.079+0000 7f3bff200640 1 --2- 172.21.15.112:0/2011862538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c000d1710 0x7f3c000d28d0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:30.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.079+0000 7f3bff200640 1 -- 172.21.15.112:0/2011862538 >> 172.21.15.112:0/2011862538 conn(0x7f3c0009e030 msgr2=0x7f3c000d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:30.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.079+0000 7f3bff200640 1 -- 172.21.15.112:0/2011862538 shutdown_connections 2024-09-12T02:46:30.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.079+0000 7f3bff200640 1 -- 172.21.15.112:0/2011862538 wait complete. 2024-09-12T02:46:30.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.081+0000 7f3bff200640 1 Processor -- start 2024-09-12T02:46:30.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.081+0000 7f3bff200640 1 -- start start 2024-09-12T02:46:30.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.082+0000 7f3bff200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3c000b1d70 0x7f3c00157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:30.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.082+0000 7f3bff200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3c000b3e00 0x7f3c001f5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:30.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.082+0000 7f3bff200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c000d1710 0x7f3c001ea7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:30.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.082+0000 7f3bff200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0015f110 con 0x7f3c000d1710 2024-09-12T02:46:30.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.082+0000 7f3bff200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3c000d39d0 con 0x7f3c000b1d70 2024-09-12T02:46:30.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.082+0000 7f3bff200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3c0015f290 con 0x7f3c000b3e00 2024-09-12T02:46:30.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.082+0000 7f3bfe800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c000d1710 0x7f3c001ea7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:30.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.082+0000 7f3bfe800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c000d1710 0x7f3c001ea7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58776/0 (socket says 172.21.15.112:58776) 2024-09-12T02:46:30.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.082+0000 7f3bfe800640 1 -- 172.21.15.112:0/3562960500 learned_addr learned my addr 172.21.15.112:0/3562960500 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:30.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.082+0000 7f3bfde00640 1 --2- 172.21.15.112:0/3562960500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3c000b1d70 0x7f3c00157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:30.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.082+0000 7f3bf5400640 1 --2- 172.21.15.112:0/3562960500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3c000b3e00 0x7f3c001f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:30.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.082+0000 7f3bfe800640 1 -- 172.21.15.112:0/3562960500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3c000b3e00 msgr2=0x7f3c001f5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:30.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.082+0000 7f3bfe800640 1 --2- 172.21.15.112:0/3562960500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3c000b3e00 0x7f3c001f5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:30.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.082+0000 7f3bfe800640 1 -- 172.21.15.112:0/3562960500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3c000b1d70 msgr2=0x7f3c00157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:30.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.082+0000 7f3bfe800640 1 --2- 172.21.15.112:0/3562960500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3c000b1d70 0x7f3c00157b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:30.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.082+0000 7f3bfe800640 1 -- 172.21.15.112:0/3562960500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c001f9350 con 0x7f3c000d1710 2024-09-12T02:46:30.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.082+0000 7f3bf5400640 1 --2- 172.21.15.112:0/3562960500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3c000b3e00 0x7f3c001f5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:30.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.083+0000 7f3bfe800640 1 --2- 172.21.15.112:0/3562960500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c000d1710 0x7f3c001ea7e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f3bf800d830 tx=0x7f3bf800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:30.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.083+0000 7f3bf6a00640 1 -- 172.21.15.112:0/3562960500 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf800b6c0 con 0x7f3c000d1710 2024-09-12T02:46:30.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.083+0000 7f3bf6a00640 1 -- 172.21.15.112:0/3562960500 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf8019070 con 0x7f3c000d1710 2024-09-12T02:46:30.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.083+0000 7f3bf6a00640 1 -- 172.21.15.112:0/3562960500 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf800bac0 con 0x7f3c000d1710 2024-09-12T02:46:30.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.083+0000 7f3bff200640 1 -- 172.21.15.112:0/3562960500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c00158090 con 0x7f3c000d1710 2024-09-12T02:46:30.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.083+0000 7f3bff200640 1 -- 172.21.15.112:0/3562960500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c001f8ab0 con 0x7f3c000d1710 2024-09-12T02:46:30.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.084+0000 7f3bff200640 1 -- 172.21.15.112:0/3562960500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c000d28d0 con 0x7f3c000d1710 2024-09-12T02:46:30.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.085+0000 7f3bf6a00640 1 -- 172.21.15.112:0/3562960500 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3bf801e460 con 0x7f3c000d1710 2024-09-12T02:46:30.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.086+0000 7f3bf6a00640 1 --2- 172.21.15.112:0/3562960500 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3bdc06be30 0x7f3bdc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:30.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.086+0000 7f3bf6a00640 1 -- 172.21.15.112:0/3562960500 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 4943+0+0 (secure 0 0 0) 0x7f3bf808b140 con 0x7f3c000d1710 2024-09-12T02:46:30.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.086+0000 7f3bfde00640 1 --2- 172.21.15.112:0/3562960500 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3bdc06be30 0x7f3bdc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:30.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.087+0000 7f3bfde00640 1 --2- 172.21.15.112:0/3562960500 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3bdc06be30 0x7f3bdc06e2f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0034000 tx=0x7f3bf002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:30.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.090+0000 7f3bf6a00640 1 -- 172.21.15.112:0/3562960500 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3bf8059df0 con 0x7f3c000d1710 2024-09-12T02:46:30.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:30.332+0000 7f3bff200640 1 -- 172.21.15.112:0/3562960500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) -- 0x7f3c0006c480 con 0x7f3c000d1710 2024-09-12T02:46:31.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.181+0000 7f3bf6a00640 1 -- 172.21.15.112:0/3562960500 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v239) ==== 140+0+0 (secure 0 0 0) 0x7f3bf80596f0 con 0x7f3c000d1710 2024-09-12T02:46:31.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.184+0000 7f3bff200640 1 -- 172.21.15.112:0/3562960500 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3bdc06be30 msgr2=0x7f3bdc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:31.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.184+0000 7f3bff200640 1 --2- 172.21.15.112:0/3562960500 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3bdc06be30 0x7f3bdc06e2f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0034000 tx=0x7f3bf002e000 comp rx=0 tx=0).stop 2024-09-12T02:46:31.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.184+0000 7f3bff200640 1 -- 172.21.15.112:0/3562960500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c000d1710 msgr2=0x7f3c001ea7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:31.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.184+0000 7f3bff200640 1 --2- 172.21.15.112:0/3562960500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c000d1710 0x7f3c001ea7e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f3bf800d830 tx=0x7f3bf800dcf0 comp rx=0 tx=0).stop 2024-09-12T02:46:31.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.184+0000 7f3bff200640 1 -- 172.21.15.112:0/3562960500 shutdown_connections 2024-09-12T02:46:31.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.184+0000 7f3bff200640 1 --2- 172.21.15.112:0/3562960500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c000d1710 0x7f3c001ea7e0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:31.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.184+0000 7f3bff200640 1 --2- 172.21.15.112:0/3562960500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3c000b3e00 0x7f3c001f5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:31.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.184+0000 7f3bff200640 1 --2- 172.21.15.112:0/3562960500 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3bdc06be30 0x7f3bdc06e2f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:31.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.184+0000 7f3bff200640 1 --2- 172.21.15.112:0/3562960500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3c000b1d70 0x7f3c00157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:31.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.184+0000 7f3bff200640 1 -- 172.21.15.112:0/3562960500 >> 172.21.15.112:0/3562960500 conn(0x7f3c0009e030 msgr2=0x7f3c000b8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:31.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.184+0000 7f3bff200640 1 -- 172.21.15.112:0/3562960500 shutdown_connections 2024-09-12T02:46:31.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.184+0000 7f3bff200640 1 -- 172.21.15.112:0/3562960500 wait complete. 2024-09-12T02:46:31.203 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2024-09-12T02:46:31.372 INFO:teuthology.orchestra.run.smithi112.stdout:{"osd_objectstore":"memstore"} 2024-09-12T02:46:31.372 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2024-09-12T02:46:31.373 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T02:46:31.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.529+0000 7efde6400640 1 Processor -- start 2024-09-12T02:46:31.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.529+0000 7efde6400640 1 -- start start 2024-09-12T02:46:31.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.530+0000 7efde6400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efde015b9d0 0x7efde00b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:31.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.530+0000 7efde6400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efde006f600 0x7efde00728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:31.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.530+0000 7efde6400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efde00b54a0 con 0x7efde00b45d0 2024-09-12T02:46:31.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.531+0000 7efde6400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7efde00b4a60 con 0x7efde006f600 2024-09-12T02:46:31.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.531+0000 7efde6400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7efde00b3af0 con 0x7efde015b9d0 2024-09-12T02:46:31.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.531+0000 7efddfe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efde006f600 0x7efde00728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:31.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.531+0000 7efddfe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efde006f600 0x7efde00728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58790/0 (socket says 172.21.15.112:58790) 2024-09-12T02:46:31.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.531+0000 7efddfe00640 1 -- 172.21.15.112:0/574917658 learned_addr learned my addr 172.21.15.112:0/574917658 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:31.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.531+0000 7efddea00640 1 --1- 172.21.15.112:0/574917658 >> v1:172.21.15.112:6789/0 conn(0x7efde00b45d0 0x7efde006eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59780/0 (socket says 172.21.15.112:59780) 2024-09-12T02:46:31.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.531+0000 7efddf400640 1 --2- 172.21.15.112:0/574917658 >> v2:172.21.15.137:3300/0 conn(0x7efde015b9d0 0x7efde00b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:31.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.531+0000 7efddfe00640 1 -- 172.21.15.112:0/574917658 >> v2:172.21.15.137:3300/0 conn(0x7efde015b9d0 msgr2=0x7efde00b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:31.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.531+0000 7efddfe00640 1 --2- 172.21.15.112:0/574917658 >> v2:172.21.15.137:3300/0 conn(0x7efde015b9d0 0x7efde00b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:31.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.531+0000 7efddfe00640 1 -- 172.21.15.112:0/574917658 >> v1:172.21.15.112:6789/0 conn(0x7efde00b45d0 legacy=0x7efde006eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:31.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.531+0000 7efddfe00640 1 -- 172.21.15.112:0/574917658 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde00b3dd0 con 0x7efde006f600 2024-09-12T02:46:31.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.532+0000 7efddfe00640 1 --2- 172.21.15.112:0/574917658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efde006f600 0x7efde00728c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7efde006d230 tx=0x7efdd802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2102e56d863dff50 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:31.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.532+0000 7efdde000640 1 -- 172.21.15.112:0/574917658 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd8036070 con 0x7efde006f600 2024-09-12T02:46:31.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.532+0000 7efdde000640 1 -- 172.21.15.112:0/574917658 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdd8031600 con 0x7efde006f600 2024-09-12T02:46:31.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.532+0000 7efdde000640 1 -- 172.21.15.112:0/574917658 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd80319d0 con 0x7efde006f600 2024-09-12T02:46:31.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.533+0000 7efde6400640 1 -- 172.21.15.112:0/574917658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efde006f600 msgr2=0x7efde00728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:31.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.533+0000 7efde6400640 1 --2- 172.21.15.112:0/574917658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efde006f600 0x7efde00728c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7efde006d230 tx=0x7efdd802a6a0 comp rx=0 tx=0).stop 2024-09-12T02:46:31.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.533+0000 7efde6400640 1 -- 172.21.15.112:0/574917658 shutdown_connections 2024-09-12T02:46:31.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.533+0000 7efde6400640 1 --2- 172.21.15.112:0/574917658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efde006f600 0x7efde00728c0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:31.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.533+0000 7efde6400640 1 --2- 172.21.15.112:0/574917658 >> v2:172.21.15.137:3300/0 conn(0x7efde015b9d0 0x7efde00b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:31.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.533+0000 7efde6400640 1 -- 172.21.15.112:0/574917658 >> 172.21.15.112:0/574917658 conn(0x7efde006bbd0 msgr2=0x7efde006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:31.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.533+0000 7efde6400640 1 -- 172.21.15.112:0/574917658 shutdown_connections 2024-09-12T02:46:31.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.533+0000 7efde6400640 1 -- 172.21.15.112:0/574917658 wait complete. 2024-09-12T02:46:31.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.535+0000 7efde6400640 1 Processor -- start 2024-09-12T02:46:31.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.535+0000 7efde6400640 1 -- start start 2024-09-12T02:46:31.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.536+0000 7efde6400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efde006f600 0x7efde014e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:31.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.536+0000 7efde6400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efde00b45d0 0x7efde00c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:31.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.536+0000 7efde6400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efde015b9d0 0x7efde014fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:31.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.536+0000 7efde6400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efde015bf30 con 0x7efde00b45d0 2024-09-12T02:46:31.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.536+0000 7efde6400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efde015bdb0 con 0x7efde015b9d0 2024-09-12T02:46:31.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.536+0000 7efde6400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7efde00cdcd0 con 0x7efde006f600 2024-09-12T02:46:31.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.536+0000 7efddea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efde00b45d0 0x7efde00c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:31.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.536+0000 7efddea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efde00b45d0 0x7efde00c5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58792/0 (socket says 172.21.15.112:58792) 2024-09-12T02:46:31.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.536+0000 7efddea00640 1 -- 172.21.15.112:0/2976057439 learned_addr learned my addr 172.21.15.112:0/2976057439 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:31.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.536+0000 7efddf400640 1 --2- 172.21.15.112:0/2976057439 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efde006f600 0x7efde014e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:31.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.536+0000 7efddfe00640 1 --2- 172.21.15.112:0/2976057439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efde015b9d0 0x7efde014fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:31.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.537+0000 7efddea00640 1 -- 172.21.15.112:0/2976057439 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efde006f600 msgr2=0x7efde014e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:31.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.537+0000 7efddea00640 1 --2- 172.21.15.112:0/2976057439 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efde006f600 0x7efde014e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:31.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.537+0000 7efddea00640 1 -- 172.21.15.112:0/2976057439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efde015b9d0 msgr2=0x7efde014fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:31.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.537+0000 7efddea00640 1 --2- 172.21.15.112:0/2976057439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efde015b9d0 0x7efde014fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:31.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.537+0000 7efddea00640 1 -- 172.21.15.112:0/2976057439 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde014e980 con 0x7efde00b45d0 2024-09-12T02:46:31.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.537+0000 7efddea00640 1 --2- 172.21.15.112:0/2976057439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efde00b45d0 0x7efde00c5ac0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7efdcc007fd0 tx=0x7efdcc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:31.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.537+0000 7efdd7400640 1 -- 172.21.15.112:0/2976057439 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc017070 con 0x7efde00b45d0 2024-09-12T02:46:31.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.537+0000 7efdd7400640 1 -- 172.21.15.112:0/2976057439 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdcc0074e0 con 0x7efde00b45d0 2024-09-12T02:46:31.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.537+0000 7efdd7400640 1 -- 172.21.15.112:0/2976057439 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc0059c0 con 0x7efde00b45d0 2024-09-12T02:46:31.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.537+0000 7efde6400640 1 -- 172.21.15.112:0/2976057439 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efde014ec60 con 0x7efde00b45d0 2024-09-12T02:46:31.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.537+0000 7efde6400640 1 -- 172.21.15.112:0/2976057439 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efde014f220 con 0x7efde00b45d0 2024-09-12T02:46:31.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.538+0000 7efde6400640 1 -- 172.21.15.112:0/2976057439 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efde006ed40 con 0x7efde00b45d0 2024-09-12T02:46:31.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.539+0000 7efdd7400640 1 -- 172.21.15.112:0/2976057439 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efdcc01a070 con 0x7efde00b45d0 2024-09-12T02:46:31.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.540+0000 7efdd7400640 1 --2- 172.21.15.112:0/2976057439 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efdc006be30 0x7efdc006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:31.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.540+0000 7efdd7400640 1 -- 172.21.15.112:0/2976057439 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 4943+0+0 (secure 0 0 0) 0x7efdcc089e60 con 0x7efde00b45d0 2024-09-12T02:46:31.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.540+0000 7efddf400640 1 --2- 172.21.15.112:0/2976057439 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efdc006be30 0x7efdc006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:31.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.541+0000 7efddf400640 1 --2- 172.21.15.112:0/2976057439 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efdc006be30 0x7efdc006e2f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efdd00079a0 tx=0x7efdd0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:31.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.545+0000 7efdd7400640 1 -- 172.21.15.112:0/2976057439 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efdcc0584b0 con 0x7efde00b45d0 2024-09-12T02:46:31.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.718+0000 7efde6400640 1 -- 172.21.15.112:0/2976057439 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7efde00b1200 con 0x7efde00b45d0 2024-09-12T02:46:31.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.723+0000 7efdd7400640 1 -- 172.21.15.112:0/2976057439 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7efdcc05c7b0 con 0x7efde00b45d0 2024-09-12T02:46:31.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.725+0000 7efde6400640 1 -- 172.21.15.112:0/2976057439 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efdc006be30 msgr2=0x7efdc006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:31.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.725+0000 7efde6400640 1 --2- 172.21.15.112:0/2976057439 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efdc006be30 0x7efdc006e2f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efdd00079a0 tx=0x7efdd0008040 comp rx=0 tx=0).stop 2024-09-12T02:46:31.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.725+0000 7efde6400640 1 -- 172.21.15.112:0/2976057439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efde00b45d0 msgr2=0x7efde00c5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:31.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.725+0000 7efde6400640 1 --2- 172.21.15.112:0/2976057439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efde00b45d0 0x7efde00c5ac0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7efdcc007fd0 tx=0x7efdcc00c890 comp rx=0 tx=0).stop 2024-09-12T02:46:31.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.725+0000 7efde6400640 1 -- 172.21.15.112:0/2976057439 shutdown_connections 2024-09-12T02:46:31.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.725+0000 7efde6400640 1 --2- 172.21.15.112:0/2976057439 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efdc006be30 0x7efdc006e2f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:31.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.725+0000 7efde6400640 1 --2- 172.21.15.112:0/2976057439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efde015b9d0 0x7efde014fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:31.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.725+0000 7efde6400640 1 --2- 172.21.15.112:0/2976057439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efde00b45d0 0x7efde00c5ac0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:31.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.725+0000 7efde6400640 1 --2- 172.21.15.112:0/2976057439 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efde006f600 0x7efde014e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:31.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.725+0000 7efde6400640 1 -- 172.21.15.112:0/2976057439 >> 172.21.15.112:0/2976057439 conn(0x7efde006bbd0 msgr2=0x7efde0158040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:31.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.726+0000 7efde6400640 1 -- 172.21.15.112:0/2976057439 shutdown_connections 2024-09-12T02:46:31.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:31.726+0000 7efde6400640 1 -- 172.21.15.112:0/2976057439 wait complete. 2024-09-12T02:46:31.743 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:46:31.743 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:46:31.834 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:46:31.937 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:46:31.937 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:46:31.937 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:46:31.972 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:46:31.973 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:46:31.973 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:46:32.010 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:46:32.010 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:46:32.010 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:46:32.047 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:46:32.047 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:46:32.048 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:46:32.086 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:46:32.086 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T02:46:32.087 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:46:32.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.241+0000 7fa0da600640 1 Processor -- start 2024-09-12T02:46:32.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.241+0000 7fa0da600640 1 -- start start 2024-09-12T02:46:32.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.243+0000 7fa0da600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa0d40afe30 0x7fa0d40cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:32.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.243+0000 7fa0da600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0d40ceeb0 con 0x7fa0d4071530 2024-09-12T02:46:32.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.243+0000 7fa0da600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0d406e300 con 0x7fa0d415cc50 2024-09-12T02:46:32.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.243+0000 7fa0da600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa0d415d030 con 0x7fa0d40afe30 2024-09-12T02:46:32.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.243+0000 7fa0cbe00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa0d4071530 0x7fa0d40af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55544/0 (socket says 172.21.15.112:55544) 2024-09-12T02:46:32.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.243+0000 7fa0cbe00640 1 -- 172.21.15.112:0/340899007 learned_addr learned my addr 172.21.15.112:0/340899007 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:46:32.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.243+0000 7fa0d3e00640 1 --2- 172.21.15.112:0/340899007 >> v2:172.21.15.137:3300/0 conn(0x7fa0d40afe30 0x7fa0d40cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:32.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.243+0000 7fa0d2a00640 1 -- 172.21.15.112:0/340899007 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 179751441 0 0) 0x7fa0d40ceeb0 con 0x7fa0d4071530 2024-09-12T02:46:32.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.243+0000 7fa0d2a00640 1 -- 172.21.15.112:0/340899007 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0b8003520 con 0x7fa0d4071530 2024-09-12T02:46:32.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.243+0000 7fa0d2a00640 1 -- 172.21.15.112:0/340899007 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2186006846 0 0) 0x7fa0d406e300 con 0x7fa0d415cc50 2024-09-12T02:46:32.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.243+0000 7fa0d2a00640 1 -- 172.21.15.112:0/340899007 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0d40ceeb0 con 0x7fa0d415cc50 2024-09-12T02:46:32.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.243+0000 7fa0d3e00640 1 -- 172.21.15.112:0/340899007 >> v1:172.21.15.137:6789/0 conn(0x7fa0d415cc50 legacy=0x7fa0d40732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:32.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.244+0000 7fa0d3e00640 1 -- 172.21.15.112:0/340899007 >> v1:172.21.15.112:6789/0 conn(0x7fa0d4071530 legacy=0x7fa0d40af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:32.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.244+0000 7fa0d3e00640 1 -- 172.21.15.112:0/340899007 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0d406e5e0 con 0x7fa0d40afe30 2024-09-12T02:46:32.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.245+0000 7fa0d3e00640 1 --2- 172.21.15.112:0/340899007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0d40afe30 0x7fa0d40cf950 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc009d90 tx=0x7fa0cc02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2397d8f8fe211b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:32.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.245+0000 7fa0d2a00640 1 -- 172.21.15.112:0/340899007 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc007740 con 0x7fa0d40afe30 2024-09-12T02:46:32.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.245+0000 7fa0d2a00640 1 -- 172.21.15.112:0/340899007 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0cc0078e0 con 0x7fa0d40afe30 2024-09-12T02:46:32.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.245+0000 7fa0d2a00640 1 -- 172.21.15.112:0/340899007 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc007c90 con 0x7fa0d40afe30 2024-09-12T02:46:32.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.245+0000 7fa0da600640 1 -- 172.21.15.112:0/340899007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0d40afe30 msgr2=0x7fa0d40cf950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:32.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.245+0000 7fa0da600640 1 --2- 172.21.15.112:0/340899007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0d40afe30 0x7fa0d40cf950 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc009d90 tx=0x7fa0cc02a660 comp rx=0 tx=0).stop 2024-09-12T02:46:32.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.245+0000 7fa0da600640 1 -- 172.21.15.112:0/340899007 shutdown_connections 2024-09-12T02:46:32.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.245+0000 7fa0da600640 1 --2- 172.21.15.112:0/340899007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0d40afe30 0x7fa0d40cf950 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:32.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.245+0000 7fa0da600640 1 -- 172.21.15.112:0/340899007 >> 172.21.15.112:0/340899007 conn(0x7fa0d406bbd0 msgr2=0x7fa0d406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:32.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.246+0000 7fa0da600640 1 -- 172.21.15.112:0/340899007 shutdown_connections 2024-09-12T02:46:32.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.246+0000 7fa0da600640 1 -- 172.21.15.112:0/340899007 wait complete. 2024-09-12T02:46:32.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.247+0000 7fa0da600640 1 Processor -- start 2024-09-12T02:46:32.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.247+0000 7fa0da600640 1 -- start start 2024-09-12T02:46:32.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.248+0000 7fa0da600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0d4071530 0x7fa0d415dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:32.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.248+0000 7fa0da600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0d40afe30 0x7fa0d4152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:32.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.248+0000 7fa0da600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0d415cc50 0x7fa0d4153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:32.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.248+0000 7fa0da600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d406f510 con 0x7fa0d40afe30 2024-09-12T02:46:32.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.248+0000 7fa0da600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d40cf4c0 con 0x7fa0d4071530 2024-09-12T02:46:32.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.248+0000 7fa0da600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa0d406f690 con 0x7fa0d415cc50 2024-09-12T02:46:32.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.248+0000 7fa0cbe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0d40afe30 0x7fa0d4152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:32.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.248+0000 7fa0cbe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0d40afe30 0x7fa0d4152a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36796/0 (socket says 172.21.15.112:36796) 2024-09-12T02:46:32.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.248+0000 7fa0cbe00640 1 -- 172.21.15.112:0/1521585249 learned_addr learned my addr 172.21.15.112:0/1521585249 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:32.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.249+0000 7fa0d3400640 1 --2- 172.21.15.112:0/1521585249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0d4071530 0x7fa0d415dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:32.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.249+0000 7fa0d3e00640 1 --2- 172.21.15.112:0/1521585249 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0d415cc50 0x7fa0d4153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:32.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.249+0000 7fa0cbe00640 1 -- 172.21.15.112:0/1521585249 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0d415cc50 msgr2=0x7fa0d4153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:32.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.249+0000 7fa0cbe00640 1 --2- 172.21.15.112:0/1521585249 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0d415cc50 0x7fa0d4153d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:32.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.249+0000 7fa0cbe00640 1 -- 172.21.15.112:0/1521585249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0d4071530 msgr2=0x7fa0d415dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:32.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.249+0000 7fa0cbe00640 1 --2- 172.21.15.112:0/1521585249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0d4071530 0x7fa0d415dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:32.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.249+0000 7fa0cbe00640 1 -- 172.21.15.112:0/1521585249 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0d41534e0 con 0x7fa0d40afe30 2024-09-12T02:46:32.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.249+0000 7fa0d3400640 1 --2- 172.21.15.112:0/1521585249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0d4071530 0x7fa0d415dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:46:32.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.249+0000 7fa0d3e00640 1 --2- 172.21.15.112:0/1521585249 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0d415cc50 0x7fa0d4153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:46:32.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.249+0000 7fa0cbe00640 1 --2- 172.21.15.112:0/1521585249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0d40afe30 0x7fa0d4152a00 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc00c4e0 tx=0x7fa0bc00c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:32.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.249+0000 7fa0cb400640 1 -- 172.21.15.112:0/1521585249 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc017070 con 0x7fa0d40afe30 2024-09-12T02:46:32.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.249+0000 7fa0cb400640 1 -- 172.21.15.112:0/1521585249 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0bc007480 con 0x7fa0d40afe30 2024-09-12T02:46:32.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.249+0000 7fa0cb400640 1 -- 172.21.15.112:0/1521585249 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc0059a0 con 0x7fa0d40afe30 2024-09-12T02:46:32.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.249+0000 7fa0da600640 1 -- 172.21.15.112:0/1521585249 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0d414eb50 con 0x7fa0d40afe30 2024-09-12T02:46:32.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.249+0000 7fa0da600640 1 -- 172.21.15.112:0/1521585249 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0d414f110 con 0x7fa0d40afe30 2024-09-12T02:46:32.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.250+0000 7fa0da600640 1 -- 172.21.15.112:0/1521585249 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0d4068a30 con 0x7fa0d40afe30 2024-09-12T02:46:32.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.251+0000 7fa0cb400640 1 -- 172.21.15.112:0/1521585249 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa0bc01a070 con 0x7fa0d40afe30 2024-09-12T02:46:32.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.252+0000 7fa0cb400640 1 --2- 172.21.15.112:0/1521585249 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa0b006be60 0x7fa0b006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:32.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.252+0000 7fa0cb400640 1 -- 172.21.15.112:0/1521585249 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 4943+0+0 (secure 0 0 0) 0x7fa0bc089e80 con 0x7fa0d40afe30 2024-09-12T02:46:32.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.252+0000 7fa0d3400640 1 --2- 172.21.15.112:0/1521585249 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa0b006be60 0x7fa0b006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:32.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.253+0000 7fa0d3400640 1 --2- 172.21.15.112:0/1521585249 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa0b006be60 0x7fa0b006e320 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40011e0 tx=0x7fa0c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:32.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.256+0000 7fa0cb400640 1 -- 172.21.15.112:0/1521585249 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa0bc058440 con 0x7fa0d40afe30 2024-09-12T02:46:32.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.462+0000 7fa0da600640 1 -- 172.21.15.112:0/1521585249 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0d406df60 con 0x7fa0d40afe30 2024-09-12T02:46:32.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.463+0000 7fa0cb400640 1 -- 172.21.15.112:0/1521585249 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+3920 (secure 0 0 0) 0x7fa0bc05c740 con 0x7fa0d40afe30 2024-09-12T02:46:32.464 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:46:32.464 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":46,"btime":"2024-09-12T02:46:25:540538+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/2773143619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2773143619},{"type":"v1","addr":"172.21.15.137:6834","nonce":2773143619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5186,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2810064950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2810064950},{"type":"v1","addr":"172.21.15.137:6835","nonce":2810064950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5192,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/366104267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":366104267},{"type":"v1","addr":"172.21.15.112:6837","nonce":366104267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6060,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/1642319372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1642319372},{"type":"v1","addr":"172.21.15.112:6836","nonce":1642319372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[]} 2024-09-12T02:46:32.464 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 46 2024-09-12T02:46:32.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.465+0000 7fa0da600640 1 -- 172.21.15.112:0/1521585249 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa0b006be60 msgr2=0x7fa0b006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:32.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.465+0000 7fa0da600640 1 --2- 172.21.15.112:0/1521585249 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa0b006be60 0x7fa0b006e320 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40011e0 tx=0x7fa0c4009040 comp rx=0 tx=0).stop 2024-09-12T02:46:32.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.465+0000 7fa0da600640 1 -- 172.21.15.112:0/1521585249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0d40afe30 msgr2=0x7fa0d4152a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:32.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.465+0000 7fa0da600640 1 --2- 172.21.15.112:0/1521585249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0d40afe30 0x7fa0d4152a00 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc00c4e0 tx=0x7fa0bc00c9a0 comp rx=0 tx=0).stop 2024-09-12T02:46:32.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.465+0000 7fa0da600640 1 -- 172.21.15.112:0/1521585249 shutdown_connections 2024-09-12T02:46:32.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.465+0000 7fa0da600640 1 --2- 172.21.15.112:0/1521585249 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0d415cc50 0x7fa0d4153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:32.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.465+0000 7fa0da600640 1 --2- 172.21.15.112:0/1521585249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0d40afe30 0x7fa0d4152a00 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:32.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.465+0000 7fa0da600640 1 --2- 172.21.15.112:0/1521585249 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa0b006be60 0x7fa0b006e320 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:32.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.465+0000 7fa0da600640 1 --2- 172.21.15.112:0/1521585249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0d4071530 0x7fa0d415dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:32.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.465+0000 7fa0da600640 1 -- 172.21.15.112:0/1521585249 >> 172.21.15.112:0/1521585249 conn(0x7fa0d406bbd0 msgr2=0x7fa0d41592a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:32.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.465+0000 7fa0da600640 1 -- 172.21.15.112:0/1521585249 shutdown_connections 2024-09-12T02:46:32.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.465+0000 7fa0da600640 1 -- 172.21.15.112:0/1521585249 wait complete. 2024-09-12T02:46:32.482 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T02:46:32.482 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T02:46:32.482 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T02:46:32.482 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:46:32.483 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T02:46:32.483 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T02:46:32.483 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T02:46:32.483 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:46:32.483 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T02:46:32.483 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T02:46:32.484 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T02:46:32.484 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:46:32.484 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T02:46:32.484 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T02:46:32.484 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T02:46:32.484 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:46:32.498 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T02:46:32.498 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T02:46:32.499 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T02:46:32.499 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T02:46:32.500 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T02:46:32.500 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T02:46:32.501 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T02:46:32.501 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T02:46:32.543 INFO:tasks.ceph.mds.c:Started 2024-09-12T02:46:32.543 DEBUG:teuthology.parallel:result is None 2024-09-12T02:46:32.545 INFO:tasks.ceph.mds.b:Started 2024-09-12T02:46:32.545 DEBUG:teuthology.parallel:result is None 2024-09-12T02:46:32.545 INFO:tasks.ceph.mds.a:Started 2024-09-12T02:46:32.546 DEBUG:teuthology.parallel:result is None 2024-09-12T02:46:32.547 INFO:tasks.ceph.mds.d:Started 2024-09-12T02:46:32.547 DEBUG:teuthology.parallel:result is None 2024-09-12T02:46:32.548 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T02:46:32.674 INFO:tasks.ceph.mds.b.smithi137.stdout:starting mds.b at 2024-09-12T02:46:32.674 INFO:tasks.ceph.mds.d.smithi137.stdout:starting mds.d at 2024-09-12T02:46:32.674 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2024-09-12T02:46:32.675 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-12T02:46:32.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.706+0000 7fd071a00640 1 Processor -- start 2024-09-12T02:46:32.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.706+0000 7fd071a00640 1 -- start start 2024-09-12T02:46:32.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.708+0000 7fd071a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd06c160c30 0x7fd06c071a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:32.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.708+0000 7fd071a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd06c167500 0x7fd06c165080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:32.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.708+0000 7fd071a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd06c072370 con 0x7fd06c161010 2024-09-12T02:46:32.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.708+0000 7fd071a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd06c072650 con 0x7fd06c167500 2024-09-12T02:46:32.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.708+0000 7fd071a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd06c072930 con 0x7fd06c160c30 2024-09-12T02:46:32.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.708+0000 7fd06b400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd06c167500 0x7fd06c165080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:32.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.708+0000 7fd06b400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd06c167500 0x7fd06c165080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36850/0 (socket says 172.21.15.112:36850) 2024-09-12T02:46:32.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.708+0000 7fd06b400640 1 -- 172.21.15.112:0/2081927614 learned_addr learned my addr 172.21.15.112:0/2081927614 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:32.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.708+0000 7fd06aa00640 1 --2- 172.21.15.112:0/2081927614 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd06c160c30 0x7fd06c071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:32.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.708+0000 7fd06b400640 1 -- 172.21.15.112:0/2081927614 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd06c160c30 msgr2=0x7fd06c071a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:32.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.708+0000 7fd06b400640 1 --2- 172.21.15.112:0/2081927614 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd06c160c30 0x7fd06c071a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:32.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.708+0000 7fd06b400640 1 -- 172.21.15.112:0/2081927614 >> v1:172.21.15.137:6789/0 conn(0x7fd06c161010 legacy=0x7fd06c166df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:32.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.708+0000 7fd06b400640 1 -- 172.21.15.112:0/2081927614 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd06c164b60 con 0x7fd06c167500 2024-09-12T02:46:32.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.709+0000 7fd06b400640 1 --2- 172.21.15.112:0/2081927614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd06c167500 0x7fd06c165080 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd064009e50 tx=0x7fd06402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c6cba6f3ae5aab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:32.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.710+0000 7fd069600640 1 -- 172.21.15.112:0/2081927614 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd064036070 con 0x7fd06c167500 2024-09-12T02:46:32.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.710+0000 7fd069600640 1 -- 172.21.15.112:0/2081927614 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd064031600 con 0x7fd06c167500 2024-09-12T02:46:32.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.710+0000 7fd069600640 1 -- 172.21.15.112:0/2081927614 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0640319d0 con 0x7fd06c167500 2024-09-12T02:46:32.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.710+0000 7fd071a00640 1 -- 172.21.15.112:0/2081927614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd06c167500 msgr2=0x7fd06c165080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:32.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.710+0000 7fd071a00640 1 --2- 172.21.15.112:0/2081927614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd06c167500 0x7fd06c165080 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd064009e50 tx=0x7fd06402a680 comp rx=0 tx=0).stop 2024-09-12T02:46:32.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.710+0000 7fd071a00640 1 -- 172.21.15.112:0/2081927614 shutdown_connections 2024-09-12T02:46:32.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.710+0000 7fd071a00640 1 --2- 172.21.15.112:0/2081927614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd06c167500 0x7fd06c165080 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:32.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.710+0000 7fd071a00640 1 --2- 172.21.15.112:0/2081927614 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd06c160c30 0x7fd06c071a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:32.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.710+0000 7fd071a00640 1 -- 172.21.15.112:0/2081927614 >> 172.21.15.112:0/2081927614 conn(0x7fd06c06bbd0 msgr2=0x7fd06c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:32.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.710+0000 7fd071a00640 1 -- 172.21.15.112:0/2081927614 shutdown_connections 2024-09-12T02:46:32.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.710+0000 7fd071a00640 1 -- 172.21.15.112:0/2081927614 wait complete. 2024-09-12T02:46:32.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.712+0000 7fd071a00640 1 Processor -- start 2024-09-12T02:46:32.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.712+0000 7fd071a00640 1 -- start start 2024-09-12T02:46:32.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.713+0000 7fd071a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd06c160c30 0x7fd06c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:32.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.713+0000 7fd071a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd06c161010 0x7fd06c0b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:32.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.713+0000 7fd071a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd06c167500 0x7fd06c0b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:32.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.713+0000 7fd071a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd06c06f800 con 0x7fd06c161010 2024-09-12T02:46:32.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.713+0000 7fd071a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd06c06f680 con 0x7fd06c167500 2024-09-12T02:46:32.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.713+0000 7fd071a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd06c1655c0 con 0x7fd06c160c30 2024-09-12T02:46:32.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.713+0000 7fd06a000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd06c161010 0x7fd06c0b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:32.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.713+0000 7fd06a000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd06c161010 0x7fd06c0b4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36856/0 (socket says 172.21.15.112:36856) 2024-09-12T02:46:32.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.713+0000 7fd06a000640 1 -- 172.21.15.112:0/588345061 learned_addr learned my addr 172.21.15.112:0/588345061 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:32.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.713+0000 7fd06b400640 1 --2- 172.21.15.112:0/588345061 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd06c167500 0x7fd06c0b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:32.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.714+0000 7fd06aa00640 1 --2- 172.21.15.112:0/588345061 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd06c160c30 0x7fd06c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:32.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.714+0000 7fd06a000640 1 -- 172.21.15.112:0/588345061 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd06c160c30 msgr2=0x7fd06c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:32.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.714+0000 7fd06a000640 1 --2- 172.21.15.112:0/588345061 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd06c160c30 0x7fd06c0cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:32.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.714+0000 7fd06a000640 1 -- 172.21.15.112:0/588345061 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd06c167500 msgr2=0x7fd06c0b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:32.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.714+0000 7fd06a000640 1 --2- 172.21.15.112:0/588345061 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd06c167500 0x7fd06c0b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:32.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.714+0000 7fd06a000640 1 -- 172.21.15.112:0/588345061 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd06c14c9a0 con 0x7fd06c161010 2024-09-12T02:46:32.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.714+0000 7fd06a000640 1 --2- 172.21.15.112:0/588345061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd06c161010 0x7fd06c0b4a00 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fd05800c390 tx=0x7fd05800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:32.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.714+0000 7fd062a00640 1 -- 172.21.15.112:0/588345061 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0580052d0 con 0x7fd06c161010 2024-09-12T02:46:32.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.714+0000 7fd062a00640 1 -- 172.21.15.112:0/588345061 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd058005470 con 0x7fd06c161010 2024-09-12T02:46:32.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.714+0000 7fd062a00640 1 -- 172.21.15.112:0/588345061 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd058006a60 con 0x7fd06c161010 2024-09-12T02:46:32.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.714+0000 7fd071a00640 1 -- 172.21.15.112:0/588345061 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd06c14cc80 con 0x7fd06c161010 2024-09-12T02:46:32.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.715+0000 7fd071a00640 1 -- 172.21.15.112:0/588345061 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd06c14d240 con 0x7fd06c161010 2024-09-12T02:46:32.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.715+0000 7fd071a00640 1 -- 172.21.15.112:0/588345061 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd06c068a30 con 0x7fd06c161010 2024-09-12T02:46:32.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.716+0000 7fd062a00640 1 -- 172.21.15.112:0/588345061 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd058003640 con 0x7fd06c161010 2024-09-12T02:46:32.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.717+0000 7fd062a00640 1 --2- 172.21.15.112:0/588345061 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd04c06be30 0x7fd04c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:32.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.717+0000 7fd062a00640 1 -- 172.21.15.112:0/588345061 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 4943+0+0 (secure 0 0 0) 0x7fd058089fb0 con 0x7fd06c161010 2024-09-12T02:46:32.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.717+0000 7fd06aa00640 1 --2- 172.21.15.112:0/588345061 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd04c06be30 0x7fd04c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:32.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.718+0000 7fd06aa00640 1 --2- 172.21.15.112:0/588345061 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd04c06be30 0x7fd04c06e2f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd05c006fd0 tx=0x7fd05c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:32.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.721+0000 7fd062a00640 1 -- 172.21.15.112:0/588345061 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd058058600 con 0x7fd06c161010 2024-09-12T02:46:32.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:32.905+0000 7fd071a00640 1 -- 172.21.15.112:0/588345061 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fd06c071980 con 0x7fd06c161010 2024-09-12T02:46:33.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.193+0000 7fd062a00640 1 -- 172.21.15.112:0/588345061 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v91) ==== 97+0+0 (secure 0 0 0) 0x7fd05805c900 con 0x7fd06c161010 2024-09-12T02:46:33.194 INFO:teuthology.orchestra.run.smithi112.stderr: removed all blocklist entries 2024-09-12T02:46:33.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.196+0000 7fd071a00640 1 -- 172.21.15.112:0/588345061 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd04c06be30 msgr2=0x7fd04c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:33.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.196+0000 7fd071a00640 1 --2- 172.21.15.112:0/588345061 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd04c06be30 0x7fd04c06e2f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd05c006fd0 tx=0x7fd05c008040 comp rx=0 tx=0).stop 2024-09-12T02:46:33.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.196+0000 7fd071a00640 1 -- 172.21.15.112:0/588345061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd06c161010 msgr2=0x7fd06c0b4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:33.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.196+0000 7fd071a00640 1 --2- 172.21.15.112:0/588345061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd06c161010 0x7fd06c0b4a00 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fd05800c390 tx=0x7fd05800c850 comp rx=0 tx=0).stop 2024-09-12T02:46:33.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.196+0000 7fd071a00640 1 -- 172.21.15.112:0/588345061 shutdown_connections 2024-09-12T02:46:33.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.196+0000 7fd071a00640 1 --2- 172.21.15.112:0/588345061 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd04c06be30 0x7fd04c06e2f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.196+0000 7fd071a00640 1 --2- 172.21.15.112:0/588345061 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd06c167500 0x7fd06c0b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.196+0000 7fd071a00640 1 --2- 172.21.15.112:0/588345061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd06c161010 0x7fd06c0b4a00 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.196+0000 7fd071a00640 1 --2- 172.21.15.112:0/588345061 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd06c160c30 0x7fd06c0cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.196+0000 7fd071a00640 1 -- 172.21.15.112:0/588345061 >> 172.21.15.112:0/588345061 conn(0x7fd06c06bbd0 msgr2=0x7fd06c072c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:33.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.197+0000 7fd071a00640 1 -- 172.21.15.112:0/588345061 shutdown_connections 2024-09-12T02:46:33.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.197+0000 7fd071a00640 1 -- 172.21.15.112:0/588345061 wait complete. 2024-09-12T02:46:33.215 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T02:46:33.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.367+0000 7f578cc00640 1 Processor -- start 2024-09-12T02:46:33.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.367+0000 7f578cc00640 1 -- start start 2024-09-12T02:46:33.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.368+0000 7f578cc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f57880afe30 0x7f57880cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:33.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.368+0000 7f578cc00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57880ceeb0 con 0x7f578815cc50 2024-09-12T02:46:33.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.368+0000 7f578cc00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f578806e300 con 0x7f5788071530 2024-09-12T02:46:33.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.368+0000 7f578cc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f578815d030 con 0x7f57880afe30 2024-09-12T02:46:33.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.368+0000 7f5785e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f578815cc50 0x7f57880732f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55558/0 (socket says 172.21.15.112:55558) 2024-09-12T02:46:33.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.368+0000 7f5785e00640 1 -- 172.21.15.112:0/1432696136 learned_addr learned my addr 172.21.15.112:0/1432696136 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:46:33.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.369+0000 7f5786800640 1 --2- 172.21.15.112:0/1432696136 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f57880afe30 0x7f57880cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:33.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.369+0000 7f5784a00640 1 -- 172.21.15.112:0/1432696136 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1110594587 0 0) 0x7f57880ceeb0 con 0x7f578815cc50 2024-09-12T02:46:33.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.369+0000 7f5784a00640 1 -- 172.21.15.112:0/1432696136 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f576c003520 con 0x7f578815cc50 2024-09-12T02:46:33.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.369+0000 7f5784a00640 1 -- 172.21.15.112:0/1432696136 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 233901388 0 0) 0x7f578806e300 con 0x7f5788071530 2024-09-12T02:46:33.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.369+0000 7f5784a00640 1 -- 172.21.15.112:0/1432696136 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57880ceeb0 con 0x7f5788071530 2024-09-12T02:46:33.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.369+0000 7f5786800640 1 -- 172.21.15.112:0/1432696136 >> v1:172.21.15.137:6789/0 conn(0x7f5788071530 legacy=0x7f57880af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:33.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.369+0000 7f5786800640 1 -- 172.21.15.112:0/1432696136 >> v1:172.21.15.112:6789/0 conn(0x7f578815cc50 legacy=0x7f57880732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:33.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.369+0000 7f5784a00640 1 -- 172.21.15.112:0/1432696136 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3488727125 0 0) 0x7f576c003520 con 0x7f578815cc50 2024-09-12T02:46:33.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.369+0000 7f5786800640 1 -- 172.21.15.112:0/1432696136 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f578806e5e0 con 0x7f57880afe30 2024-09-12T02:46:33.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.370+0000 7f5786800640 1 --2- 172.21.15.112:0/1432696136 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f57880afe30 0x7f57880cf950 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5780009dc0 tx=0x7f578002a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf16fd68a0551e9e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:33.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.371+0000 7f5784a00640 1 -- 172.21.15.112:0/1432696136 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578002ae60 con 0x7f57880afe30 2024-09-12T02:46:33.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.371+0000 7f5784a00640 1 -- 172.21.15.112:0/1432696136 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5780007740 con 0x7f57880afe30 2024-09-12T02:46:33.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.371+0000 7f5784a00640 1 -- 172.21.15.112:0/1432696136 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5780007b10 con 0x7f57880afe30 2024-09-12T02:46:33.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.371+0000 7f578cc00640 1 -- 172.21.15.112:0/1432696136 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f57880afe30 msgr2=0x7f57880cf950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:33.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.371+0000 7f578cc00640 1 --2- 172.21.15.112:0/1432696136 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f57880afe30 0x7f57880cf950 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5780009dc0 tx=0x7f578002a640 comp rx=0 tx=0).stop 2024-09-12T02:46:33.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.371+0000 7f578cc00640 1 -- 172.21.15.112:0/1432696136 shutdown_connections 2024-09-12T02:46:33.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.371+0000 7f578cc00640 1 --2- 172.21.15.112:0/1432696136 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f57880afe30 0x7f57880cf950 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.371+0000 7f578cc00640 1 -- 172.21.15.112:0/1432696136 >> 172.21.15.112:0/1432696136 conn(0x7f578806bbd0 msgr2=0x7f578806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:33.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.371+0000 7f578cc00640 1 -- 172.21.15.112:0/1432696136 shutdown_connections 2024-09-12T02:46:33.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.371+0000 7f578cc00640 1 -- 172.21.15.112:0/1432696136 wait complete. 2024-09-12T02:46:33.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.373+0000 7f578cc00640 1 Processor -- start 2024-09-12T02:46:33.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.373+0000 7f578cc00640 1 -- start start 2024-09-12T02:46:33.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.374+0000 7f578cc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5788071530 0x7f578814d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:33.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.374+0000 7f578cc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f57880afe30 0x7f5788145640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:33.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.374+0000 7f578cc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f578815cc50 0x7f57880b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:33.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.374+0000 7f578cc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f578806f510 con 0x7f5788071530 2024-09-12T02:46:33.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.374+0000 7f578cc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f57880cf4c0 con 0x7f578815cc50 2024-09-12T02:46:33.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.374+0000 7f578cc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f578806f690 con 0x7f57880afe30 2024-09-12T02:46:33.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.374+0000 7f5785e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5788071530 0x7f578814d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:33.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.374+0000 7f5785e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5788071530 0x7f578814d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36868/0 (socket says 172.21.15.112:36868) 2024-09-12T02:46:33.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.374+0000 7f5785e00640 1 -- 172.21.15.112:0/393082238 learned_addr learned my addr 172.21.15.112:0/393082238 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:33.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.374+0000 7f5786800640 1 --2- 172.21.15.112:0/393082238 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f578815cc50 0x7f57880b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:33.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.374+0000 7f5785400640 1 --2- 172.21.15.112:0/393082238 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f57880afe30 0x7f5788145640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:33.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.374+0000 7f5785e00640 1 -- 172.21.15.112:0/393082238 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f57880afe30 msgr2=0x7f5788145640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:33.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.374+0000 7f5785e00640 1 --2- 172.21.15.112:0/393082238 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f57880afe30 0x7f5788145640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.374+0000 7f5785e00640 1 -- 172.21.15.112:0/393082238 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f578815cc50 msgr2=0x7f57880b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:33.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.374+0000 7f5785e00640 1 --2- 172.21.15.112:0/393082238 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f578815cc50 0x7f57880b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.375+0000 7f5785e00640 1 -- 172.21.15.112:0/393082238 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57881f81d0 con 0x7f5788071530 2024-09-12T02:46:33.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.375+0000 7f5786800640 1 --2- 172.21.15.112:0/393082238 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f578815cc50 0x7f57880b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:46:33.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.375+0000 7f5785e00640 1 --2- 172.21.15.112:0/393082238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5788071530 0x7f578814d540 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f577800c3e0 tx=0x7f5778001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:33.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.375+0000 7f577e000640 1 -- 172.21.15.112:0/393082238 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5778017070 con 0x7f5788071530 2024-09-12T02:46:33.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.375+0000 7f577e000640 1 -- 172.21.15.112:0/393082238 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5778005ce0 con 0x7f5788071530 2024-09-12T02:46:33.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.375+0000 7f578cc00640 1 -- 172.21.15.112:0/393082238 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57881f84b0 con 0x7f5788071530 2024-09-12T02:46:33.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.375+0000 7f577e000640 1 -- 172.21.15.112:0/393082238 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5778007310 con 0x7f5788071530 2024-09-12T02:46:33.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.375+0000 7f578cc00640 1 -- 172.21.15.112:0/393082238 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57881f8a70 con 0x7f5788071530 2024-09-12T02:46:33.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.376+0000 7f578cc00640 1 -- 172.21.15.112:0/393082238 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5788068a30 con 0x7f5788071530 2024-09-12T02:46:33.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.377+0000 7f577e000640 1 -- 172.21.15.112:0/393082238 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f577801a070 con 0x7f5788071530 2024-09-12T02:46:33.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.378+0000 7f577e000640 1 --2- 172.21.15.112:0/393082238 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f576806be30 0x7f576806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:33.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.378+0000 7f577e000640 1 -- 172.21.15.112:0/393082238 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 4857+0+0 (secure 0 0 0) 0x7f5778089f50 con 0x7f5788071530 2024-09-12T02:46:33.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.378+0000 7f5785400640 1 --2- 172.21.15.112:0/393082238 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f576806be30 0x7f576806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:33.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.379+0000 7f5785400640 1 --2- 172.21.15.112:0/393082238 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f576806be30 0x7f576806e2f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f57880b1bb0 tx=0x7f5774009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:33.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.382+0000 7f577e000640 1 -- 172.21.15.112:0/393082238 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5778058560 con 0x7f5788071530 2024-09-12T02:46:33.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.616+0000 7f578cc00640 1 -- 172.21.15.112:0/393082238 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f57880b0bc0 con 0x7f5788071530 2024-09-12T02:46:33.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.617+0000 7f577e000640 1 -- 172.21.15.112:0/393082238 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7f577805c860 con 0x7f5788071530 2024-09-12T02:46:33.618 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:46:33.618 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:46:33.618 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_dump": [ 2024-09-12T02:46:33.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:33.618 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.a", 2024-09-12T02:46:33.618 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmKE09KRAAtNq70LeeB9ENNxX91m10Fg==", 2024-09-12T02:46:33.618 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:46:33.618 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:46:33.618 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:46:33.618 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:46:33.619 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:46:33.619 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:33.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:33.619 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:33.619 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.b", 2024-09-12T02:46:33.619 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmMjYTARAAuIrofOOp9Dbrhkt314mhuw==", 2024-09-12T02:46:33.619 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:46:33.619 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:46:33.619 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:46:33.619 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:46:33.619 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:46:33.619 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:33.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:33.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:33.620 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.c", 2024-09-12T02:46:33.620 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmLQXzMhAAhk28JuqKhfbZtvRu9SSVrw==", 2024-09-12T02:46:33.620 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:46:33.620 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:46:33.620 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:46:33.620 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:46:33.620 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:46:33.620 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:33.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:33.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:33.621 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.d", 2024-09-12T02:46:33.621 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmaE7JChAAKlyynYJnHLs87BXyMC0xgA==", 2024-09-12T02:46:33.621 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:46:33.621 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:46:33.621 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:46:33.621 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:46:33.621 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:46:33.621 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:33.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:33.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:33.621 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.0", 2024-09-12T02:46:33.622 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDXVOJmFXfdIRAA+VpZNU0tEN6vAzR2C7nuLg==", 2024-09-12T02:46:33.622 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:46:33.622 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:46:33.622 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:46:33.622 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:46:33.622 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:33.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:33.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:33.622 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.1", 2024-09-12T02:46:33.622 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDXVOJmcgHyLBAA/OxfdQ1D+uFzbCnm1dJLxw==", 2024-09-12T02:46:33.622 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:46:33.622 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:46:33.622 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:46:33.623 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:46:33.623 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:33.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:33.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:33.623 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.2", 2024-09-12T02:46:33.623 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDXVOJm0baUNhAAuInNwHut2Xn0kBmjnJhdqw==", 2024-09-12T02:46:33.623 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:46:33.623 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:46:33.623 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:46:33.623 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:46:33.623 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:33.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:33.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:33.624 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.3", 2024-09-12T02:46:33.624 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDYVOJmL/O3BBAAZhQ4/70wj/2zEbMcfD4hQA==", 2024-09-12T02:46:33.624 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:46:33.624 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:46:33.624 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:46:33.624 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:46:33.624 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:33.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:33.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:33.624 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.4", 2024-09-12T02:46:33.625 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmC+sJAxAAUQofpG3g8DlGLQ8wUqtuSg==", 2024-09-12T02:46:33.625 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:46:33.625 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:46:33.625 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:46:33.625 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:46:33.625 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:33.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:33.625 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:33.625 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.5", 2024-09-12T02:46:33.625 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmY2OSDhAA2rg1HGjWx7G6IzFi6yQ/jQ==", 2024-09-12T02:46:33.625 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:46:33.625 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:46:33.625 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:46:33.625 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:46:33.626 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:33.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:33.626 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:33.626 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.6", 2024-09-12T02:46:33.626 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmydoaGRAAh/ozKewnY+RxiZ4EcOFA7A==", 2024-09-12T02:46:33.626 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:46:33.626 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:46:33.626 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:46:33.626 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:46:33.626 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:33.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:33.626 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:33.626 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.7", 2024-09-12T02:46:33.626 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmmB7cIhAAVhtz7OuxYBQgEKGvHdY33g==", 2024-09-12T02:46:33.626 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:46:33.627 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:46:33.627 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:46:33.627 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:46:33.627 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:33.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:33.627 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:33.627 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.0", 2024-09-12T02:46:33.627 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmaG86ExAAD0SOlJOsLpoQZlgPJIPaxA==", 2024-09-12T02:46:33.627 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:46:33.627 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:46:33.627 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow r", 2024-09-12T02:46:33.627 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T02:46:33.627 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:33.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.1", 2024-09-12T02:46:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmt7AeIBAAGRSEejG29OpANZqtia7KEw==", 2024-09-12T02:46:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:46:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:46:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:46:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:46:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:46:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.2", 2024-09-12T02:46:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmcUWtGRAAlV/gS/CDZKHb5bjbmDzjlg==", 2024-09-12T02:46:33.628 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:46:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:46:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:46:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:46:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:46:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.3", 2024-09-12T02:46:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJm2M97JhAAHKJoPBf6TN6Nu8muK6wzaw==", 2024-09-12T02:46:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:46:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:46:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:46:33.629 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:46:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:46:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.admin", 2024-09-12T02:46:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDSVOJmhl82NBAAvkcxnsY5u9lYO12FaRbP1A==", 2024-09-12T02:46:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:46:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-12T02:46:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:46:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:46:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:46:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:33.630 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.x", 2024-09-12T02:46:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmftawIhAAAKmfx8khERROoZ8BCLukAw==", 2024-09-12T02:46:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:46:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-12T02:46:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-12T02:46:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:46:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.y", 2024-09-12T02:46:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmcxtNGhAAAXWh1fMrVeFSy2hh3p2Rkw==", 2024-09-12T02:46:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:46:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-12T02:46:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-12T02:46:33.631 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:46:33.632 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:33.632 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:33.632 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:33.632 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:46:33.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.619+0000 7f578cc00640 1 -- 172.21.15.112:0/393082238 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f576806be30 msgr2=0x7f576806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:33.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.619+0000 7f578cc00640 1 --2- 172.21.15.112:0/393082238 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f576806be30 0x7f576806e2f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f57880b1bb0 tx=0x7f5774009040 comp rx=0 tx=0).stop 2024-09-12T02:46:33.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.619+0000 7f578cc00640 1 -- 172.21.15.112:0/393082238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5788071530 msgr2=0x7f578814d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:33.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.619+0000 7f578cc00640 1 --2- 172.21.15.112:0/393082238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5788071530 0x7f578814d540 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f577800c3e0 tx=0x7f5778001e70 comp rx=0 tx=0).stop 2024-09-12T02:46:33.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.619+0000 7f578cc00640 1 -- 172.21.15.112:0/393082238 shutdown_connections 2024-09-12T02:46:33.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.619+0000 7f578cc00640 1 --2- 172.21.15.112:0/393082238 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f576806be30 0x7f576806e2f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.619+0000 7f578cc00640 1 --2- 172.21.15.112:0/393082238 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f578815cc50 0x7f57880b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.619+0000 7f578cc00640 1 --2- 172.21.15.112:0/393082238 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f57880afe30 0x7f5788145640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.619+0000 7f578cc00640 1 --2- 172.21.15.112:0/393082238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5788071530 0x7f578814d540 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.619+0000 7f578cc00640 1 -- 172.21.15.112:0/393082238 >> 172.21.15.112:0/393082238 conn(0x7f578806bbd0 msgr2=0x7f57880cf950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:33.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.619+0000 7f578cc00640 1 -- 172.21.15.112:0/393082238 shutdown_connections 2024-09-12T02:46:33.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.619+0000 7f578cc00640 1 -- 172.21.15.112:0/393082238 wait complete. 2024-09-12T02:46:33.636 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T02:46:33.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.790+0000 7f7d56800640 1 Processor -- start 2024-09-12T02:46:33.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.790+0000 7f7d56800640 1 -- start start 2024-09-12T02:46:33.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.792+0000 7f7d56800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d5015bb60 0x7f7d5006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:33.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.792+0000 7f7d56800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7d500cfda0 0x7f7d5006f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:33.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.792+0000 7f7d56800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d5015bf40 con 0x7f7d50072c80 2024-09-12T02:46:33.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.792+0000 7f7d56800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f7d5006da70 con 0x7f7d500cfda0 2024-09-12T02:46:33.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.792+0000 7f7d56800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7d500cdfd0 con 0x7f7d5015bb60 2024-09-12T02:46:33.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.792+0000 7f7d4fe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7d500cfda0 0x7f7d5006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:33.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.792+0000 7f7d4f400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d5015bb60 0x7f7d5006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:33.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.792+0000 7f7d4fe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7d500cfda0 0x7f7d5006f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36874/0 (socket says 172.21.15.112:36874) 2024-09-12T02:46:33.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.792+0000 7f7d4fe00640 1 -- 172.21.15.112:0/4064001105 learned_addr learned my addr 172.21.15.112:0/4064001105 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:33.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.792+0000 7f7d46a00640 1 --1- 172.21.15.112:0/4064001105 >> v1:172.21.15.137:6789/0 conn(0x7f7d50072c80 0x7f7d500b39c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.112:34148/0 (socket says 172.21.15.112:34148) 2024-09-12T02:46:33.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.792+0000 7f7d4f400640 1 -- 172.21.15.112:0/4064001105 >> v2:172.21.15.112:3300/0 conn(0x7f7d500cfda0 msgr2=0x7f7d5006f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:33.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.792+0000 7f7d4f400640 1 --2- 172.21.15.112:0/4064001105 >> v2:172.21.15.112:3300/0 conn(0x7f7d500cfda0 0x7f7d5006f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.792+0000 7f7d4f400640 1 -- 172.21.15.112:0/4064001105 >> v1:172.21.15.137:6789/0 conn(0x7f7d50072c80 legacy=0x7f7d500b39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:33.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.792+0000 7f7d4f400640 1 -- 172.21.15.112:0/4064001105 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d500ce2b0 con 0x7f7d5015bb60 2024-09-12T02:46:33.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.792+0000 7f7d4fe00640 1 --2- 172.21.15.112:0/4064001105 >> v2:172.21.15.112:3300/0 conn(0x7f7d500cfda0 0x7f7d5006f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:46:33.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.793+0000 7f7d4f400640 1 --2- 172.21.15.112:0/4064001105 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d5015bb60 0x7f7d5006ede0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7d400097a0 tx=0x7f7d4002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d026ab6ff4eb4460 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:33.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.794+0000 7f7d4ea00640 1 -- 172.21.15.112:0/4064001105 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d40037070 con 0x7f7d5015bb60 2024-09-12T02:46:33.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.794+0000 7f7d4ea00640 1 -- 172.21.15.112:0/4064001105 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d40032440 con 0x7f7d5015bb60 2024-09-12T02:46:33.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.794+0000 7f7d4ea00640 1 -- 172.21.15.112:0/4064001105 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d40032810 con 0x7f7d5015bb60 2024-09-12T02:46:33.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.794+0000 7f7d56800640 1 -- 172.21.15.112:0/4064001105 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d5015bb60 msgr2=0x7f7d5006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:33.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.794+0000 7f7d56800640 1 --2- 172.21.15.112:0/4064001105 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d5015bb60 0x7f7d5006ede0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7d400097a0 tx=0x7f7d4002a180 comp rx=0 tx=0).stop 2024-09-12T02:46:33.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.794+0000 7f7d56800640 1 -- 172.21.15.112:0/4064001105 shutdown_connections 2024-09-12T02:46:33.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.794+0000 7f7d56800640 1 --2- 172.21.15.112:0/4064001105 >> v2:172.21.15.112:3300/0 conn(0x7f7d500cfda0 0x7f7d5006f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.794+0000 7f7d56800640 1 --2- 172.21.15.112:0/4064001105 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d5015bb60 0x7f7d5006ede0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.794+0000 7f7d56800640 1 -- 172.21.15.112:0/4064001105 >> 172.21.15.112:0/4064001105 conn(0x7f7d500b26c0 msgr2=0x7f7d500b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:33.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.794+0000 7f7d56800640 1 -- 172.21.15.112:0/4064001105 shutdown_connections 2024-09-12T02:46:33.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.794+0000 7f7d56800640 1 -- 172.21.15.112:0/4064001105 wait complete. 2024-09-12T02:46:33.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.796+0000 7f7d56800640 1 Processor -- start 2024-09-12T02:46:33.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.796+0000 7f7d56800640 1 -- start start 2024-09-12T02:46:33.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.797+0000 7f7d56800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d50072c80 0x7f7d501444c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:33.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.797+0000 7f7d56800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d500cfda0 0x7f7d5015c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:33.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.797+0000 7f7d56800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d5015bb60 0x7f7d5015c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:33.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.797+0000 7f7d56800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7d5006d600 con 0x7f7d50072c80 2024-09-12T02:46:33.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.797+0000 7f7d56800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7d500ce870 con 0x7f7d5015bb60 2024-09-12T02:46:33.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.797+0000 7f7d56800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7d5006d780 con 0x7f7d500cfda0 2024-09-12T02:46:33.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.797+0000 7f7d4f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d50072c80 0x7f7d501444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:33.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.797+0000 7f7d4f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d50072c80 0x7f7d501444c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36880/0 (socket says 172.21.15.112:36880) 2024-09-12T02:46:33.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.797+0000 7f7d4f400640 1 -- 172.21.15.112:0/2839133960 learned_addr learned my addr 172.21.15.112:0/2839133960 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:33.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.797+0000 7f7d4f400640 1 -- 172.21.15.112:0/2839133960 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d500cfda0 msgr2=0x7f7d5015c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:33.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.797+0000 7f7d4f400640 1 --2- 172.21.15.112:0/2839133960 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d500cfda0 0x7f7d5015c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.797+0000 7f7d4f400640 1 -- 172.21.15.112:0/2839133960 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d5015bb60 msgr2=0x7f7d5015c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:33.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.797+0000 7f7d4f400640 1 --2- 172.21.15.112:0/2839133960 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d5015bb60 0x7f7d5015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.798+0000 7f7d4f400640 1 -- 172.21.15.112:0/2839133960 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d5015cbc0 con 0x7f7d50072c80 2024-09-12T02:46:33.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.798+0000 7f7d4f400640 1 --2- 172.21.15.112:0/2839133960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d50072c80 0x7f7d501444c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f7d400098c0 tx=0x7f7d400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:33.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.798+0000 7f7d47e00640 1 -- 172.21.15.112:0/2839133960 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d40037040 con 0x7f7d50072c80 2024-09-12T02:46:33.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.798+0000 7f7d47e00640 1 -- 172.21.15.112:0/2839133960 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d40042070 con 0x7f7d50072c80 2024-09-12T02:46:33.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.798+0000 7f7d56800640 1 -- 172.21.15.112:0/2839133960 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d5015e6f0 con 0x7f7d50072c80 2024-09-12T02:46:33.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.798+0000 7f7d47e00640 1 -- 172.21.15.112:0/2839133960 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d40030920 con 0x7f7d50072c80 2024-09-12T02:46:33.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.798+0000 7f7d56800640 1 -- 172.21.15.112:0/2839133960 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d5014e9d0 con 0x7f7d50072c80 2024-09-12T02:46:33.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.799+0000 7f7d56800640 1 -- 172.21.15.112:0/2839133960 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d50068a30 con 0x7f7d50072c80 2024-09-12T02:46:33.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.800+0000 7f7d47e00640 1 -- 172.21.15.112:0/2839133960 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d40030ac0 con 0x7f7d50072c80 2024-09-12T02:46:33.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.801+0000 7f7d47e00640 1 --2- 172.21.15.112:0/2839133960 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7d2c06be30 0x7f7d2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:33.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.801+0000 7f7d47e00640 1 -- 172.21.15.112:0/2839133960 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 4857+0+0 (secure 0 0 0) 0x7f7d400ab490 con 0x7f7d50072c80 2024-09-12T02:46:33.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.801+0000 7f7d46a00640 1 --2- 172.21.15.112:0/2839133960 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7d2c06be30 0x7f7d2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:33.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.802+0000 7f7d46a00640 1 --2- 172.21.15.112:0/2839133960 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7d2c06be30 0x7f7d2c06e2f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7d38000f60 tx=0x7f7d38007a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:33.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.805+0000 7f7d47e00640 1 -- 172.21.15.112:0/2839133960 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7d4007a220 con 0x7f7d50072c80 2024-09-12T02:46:33.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.983+0000 7f7d56800640 1 -- 172.21.15.112:0/2839133960 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f7d500b56a0 con 0x7f7d50072c80 2024-09-12T02:46:33.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.983+0000 7f7d47e00640 1 -- 172.21.15.112:0/2839133960 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v93) ==== 84+0+65 (secure 0 0 0) 0x7f7d40079b20 con 0x7f7d50072c80 2024-09-12T02:46:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:46:33.984 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2024-09-12T02:46:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 1, 2024-09-12T02:46:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": ".mgr" 2024-09-12T02:46:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:33.985 INFO:teuthology.orchestra.run.smithi112.stdout:] 2024-09-12T02:46:33.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.985+0000 7f7d56800640 1 -- 172.21.15.112:0/2839133960 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7d2c06be30 msgr2=0x7f7d2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:33.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.985+0000 7f7d56800640 1 --2- 172.21.15.112:0/2839133960 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7d2c06be30 0x7f7d2c06e2f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7d38000f60 tx=0x7f7d38007a00 comp rx=0 tx=0).stop 2024-09-12T02:46:33.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.985+0000 7f7d56800640 1 -- 172.21.15.112:0/2839133960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d50072c80 msgr2=0x7f7d501444c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:33.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.985+0000 7f7d56800640 1 --2- 172.21.15.112:0/2839133960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d50072c80 0x7f7d501444c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f7d400098c0 tx=0x7f7d400046c0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.985+0000 7f7d56800640 1 -- 172.21.15.112:0/2839133960 shutdown_connections 2024-09-12T02:46:33.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.985+0000 7f7d56800640 1 --2- 172.21.15.112:0/2839133960 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7d2c06be30 0x7f7d2c06e2f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.985+0000 7f7d56800640 1 --2- 172.21.15.112:0/2839133960 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d5015bb60 0x7f7d5015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.985+0000 7f7d56800640 1 --2- 172.21.15.112:0/2839133960 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d500cfda0 0x7f7d5015c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.985+0000 7f7d56800640 1 --2- 172.21.15.112:0/2839133960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d50072c80 0x7f7d501444c0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.985+0000 7f7d56800640 1 -- 172.21.15.112:0/2839133960 >> 172.21.15.112:0/2839133960 conn(0x7f7d500b26c0 msgr2=0x7f7d500b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:33.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.985+0000 7f7d56800640 1 -- 172.21.15.112:0/2839133960 shutdown_connections 2024-09-12T02:46:33.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:33.985+0000 7f7d56800640 1 -- 172.21.15.112:0/2839133960 wait complete. 2024-09-12T02:46:34.001 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T02:46:34.002 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T02:46:34.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.157+0000 7fe89f800640 1 Processor -- start 2024-09-12T02:46:34.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.157+0000 7fe89f800640 1 -- start start 2024-09-12T02:46:34.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.159+0000 7fe89f800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe8980b5820 0x7fe8980b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:34.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.159+0000 7fe89f800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe89806dd30 0x7fe89806e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:34.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.159+0000 7fe89f800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8980af530 con 0x7fe8980d10b0 2024-09-12T02:46:34.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.159+0000 7fe89f800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe89806e680 con 0x7fe8980b5820 2024-09-12T02:46:34.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.159+0000 7fe89f800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe8980af2e0 con 0x7fe89806dd30 2024-09-12T02:46:34.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.159+0000 7fe897e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe8980b5820 0x7fe8980b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:34.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.159+0000 7fe897e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe8980b5820 0x7fe8980b3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36890/0 (socket says 172.21.15.112:36890) 2024-09-12T02:46:34.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.159+0000 7fe897e00640 1 -- 172.21.15.112:0/1606214762 learned_addr learned my addr 172.21.15.112:0/1606214762 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:34.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.159+0000 7fe89d800640 1 --2- 172.21.15.112:0/1606214762 >> v2:172.21.15.137:3300/0 conn(0x7fe89806dd30 0x7fe89806e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:34.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.159+0000 7fe897e00640 1 -- 172.21.15.112:0/1606214762 >> v2:172.21.15.137:3300/0 conn(0x7fe89806dd30 msgr2=0x7fe89806e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:34.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.159+0000 7fe897e00640 1 --2- 172.21.15.112:0/1606214762 >> v2:172.21.15.137:3300/0 conn(0x7fe89806dd30 0x7fe89806e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:34.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.159+0000 7fe897e00640 1 -- 172.21.15.112:0/1606214762 >> v1:172.21.15.137:6789/0 conn(0x7fe8980d10b0 legacy=0x7fe8980b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:34.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.159+0000 7fe897e00640 1 -- 172.21.15.112:0/1606214762 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8980af810 con 0x7fe8980b5820 2024-09-12T02:46:34.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.159+0000 7fe89d800640 1 --2- 172.21.15.112:0/1606214762 >> v2:172.21.15.137:3300/0 conn(0x7fe89806dd30 0x7fe89806e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:46:34.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.160+0000 7fe897e00640 1 --2- 172.21.15.112:0/1606214762 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8980b5820 0x7fe8980b3220 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fe8980cd430 tx=0x7fe88402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb729bfc7522044 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:34.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.161+0000 7fe897400640 1 -- 172.21.15.112:0/1606214762 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884037070 con 0x7fe8980b5820 2024-09-12T02:46:34.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.161+0000 7fe897400640 1 -- 172.21.15.112:0/1606214762 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe884032440 con 0x7fe8980b5820 2024-09-12T02:46:34.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.161+0000 7fe897400640 1 -- 172.21.15.112:0/1606214762 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884032810 con 0x7fe8980b5820 2024-09-12T02:46:34.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.161+0000 7fe89f800640 1 -- 172.21.15.112:0/1606214762 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8980b5820 msgr2=0x7fe8980b3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:34.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.161+0000 7fe89f800640 1 --2- 172.21.15.112:0/1606214762 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8980b5820 0x7fe8980b3220 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fe8980cd430 tx=0x7fe88402a230 comp rx=0 tx=0).stop 2024-09-12T02:46:34.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.161+0000 7fe89f800640 1 -- 172.21.15.112:0/1606214762 shutdown_connections 2024-09-12T02:46:34.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.161+0000 7fe89f800640 1 --2- 172.21.15.112:0/1606214762 >> v2:172.21.15.137:3300/0 conn(0x7fe89806dd30 0x7fe89806e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:34.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.161+0000 7fe89f800640 1 --2- 172.21.15.112:0/1606214762 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8980b5820 0x7fe8980b3220 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:34.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.161+0000 7fe89f800640 1 -- 172.21.15.112:0/1606214762 >> 172.21.15.112:0/1606214762 conn(0x7fe8980b2730 msgr2=0x7fe8980b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:34.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.161+0000 7fe89f800640 1 -- 172.21.15.112:0/1606214762 shutdown_connections 2024-09-12T02:46:34.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.161+0000 7fe89f800640 1 -- 172.21.15.112:0/1606214762 wait complete. 2024-09-12T02:46:34.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.163+0000 7fe89f800640 1 Processor -- start 2024-09-12T02:46:34.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.163+0000 7fe89f800640 1 -- start start 2024-09-12T02:46:34.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.164+0000 7fe89f800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe89806dd30 0x7fe89815f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:34.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.164+0000 7fe89f800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8980b5820 0x7fe8981540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:34.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.164+0000 7fe89f800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8980d10b0 0x7fe8981e7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:34.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.164+0000 7fe89f800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe8980d1490 con 0x7fe8980d10b0 2024-09-12T02:46:34.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.164+0000 7fe89f800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe89806d830 con 0x7fe89806dd30 2024-09-12T02:46:34.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.164+0000 7fe89f800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe8980b4140 con 0x7fe8980b5820 2024-09-12T02:46:34.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.164+0000 7fe89d800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8980d10b0 0x7fe8981e7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:34.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.164+0000 7fe89d800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8980d10b0 0x7fe8981e7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36892/0 (socket says 172.21.15.112:36892) 2024-09-12T02:46:34.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.164+0000 7fe89d800640 1 -- 172.21.15.112:0/2098954825 learned_addr learned my addr 172.21.15.112:0/2098954825 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:34.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.164+0000 7fe897e00640 1 --2- 172.21.15.112:0/2098954825 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8980b5820 0x7fe8981540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:34.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.164+0000 7fe89ce00640 1 --2- 172.21.15.112:0/2098954825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe89806dd30 0x7fe89815f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:34.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.165+0000 7fe89d800640 1 -- 172.21.15.112:0/2098954825 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8980b5820 msgr2=0x7fe8981540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:34.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.165+0000 7fe89d800640 1 --2- 172.21.15.112:0/2098954825 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8980b5820 0x7fe8981540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:34.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.165+0000 7fe89d800640 1 -- 172.21.15.112:0/2098954825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe89806dd30 msgr2=0x7fe89815f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:34.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.165+0000 7fe89d800640 1 --2- 172.21.15.112:0/2098954825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe89806dd30 0x7fe89815f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:34.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.165+0000 7fe89d800640 1 -- 172.21.15.112:0/2098954825 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8981f4330 con 0x7fe8980d10b0 2024-09-12T02:46:34.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.165+0000 7fe897e00640 1 --2- 172.21.15.112:0/2098954825 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8980b5820 0x7fe8981540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:34.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.165+0000 7fe89d800640 1 --2- 172.21.15.112:0/2098954825 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8980d10b0 0x7fe8981e7e60 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fe89000cd50 tx=0x7fe89000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:34.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.165+0000 7fe894c00640 1 -- 172.21.15.112:0/2098954825 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89000f680 con 0x7fe8980d10b0 2024-09-12T02:46:34.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.165+0000 7fe894c00640 1 -- 172.21.15.112:0/2098954825 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe89000f840 con 0x7fe8980d10b0 2024-09-12T02:46:34.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.165+0000 7fe894c00640 1 -- 172.21.15.112:0/2098954825 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89000fc30 con 0x7fe8980d10b0 2024-09-12T02:46:34.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.165+0000 7fe89f800640 1 -- 172.21.15.112:0/2098954825 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe89815fe20 con 0x7fe8980d10b0 2024-09-12T02:46:34.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.165+0000 7fe89f800640 1 -- 172.21.15.112:0/2098954825 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8981603e0 con 0x7fe8980d10b0 2024-09-12T02:46:34.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.166+0000 7fe89f800640 1 -- 172.21.15.112:0/2098954825 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe89806e140 con 0x7fe8980d10b0 2024-09-12T02:46:34.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.167+0000 7fe894c00640 1 -- 172.21.15.112:0/2098954825 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe89000e3e0 con 0x7fe8980d10b0 2024-09-12T02:46:34.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.168+0000 7fe894c00640 1 --2- 172.21.15.112:0/2098954825 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe87806be60 0x7fe87806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:34.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.168+0000 7fe894c00640 1 -- 172.21.15.112:0/2098954825 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 4857+0+0 (secure 0 0 0) 0x7fe89008b7e0 con 0x7fe8980d10b0 2024-09-12T02:46:34.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.168+0000 7fe89ce00640 1 --2- 172.21.15.112:0/2098954825 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe87806be60 0x7fe87806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:34.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.169+0000 7fe89ce00640 1 --2- 172.21.15.112:0/2098954825 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe87806be60 0x7fe87806e320 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe88c004f60 tx=0x7fe88c007e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:34.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.173+0000 7fe894c00640 1 -- 172.21.15.112:0/2098954825 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe890014030 con 0x7fe8980d10b0 2024-09-12T02:46:34.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:34.352+0000 7fe89f800640 1 -- 172.21.15.112:0/2098954825 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe898076460 con 0x7fe8980d10b0 2024-09-12T02:46:35.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.204+0000 7fe894c00640 1 -- 172.21.15.112:0/2098954825 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v94) ==== 138+0+0 (secure 0 0 0) 0x7fe89005a4d0 con 0x7fe8980d10b0 2024-09-12T02:46:35.205 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' created 2024-09-12T02:46:35.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.207+0000 7fe89f800640 1 -- 172.21.15.112:0/2098954825 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe87806be60 msgr2=0x7fe87806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:35.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.207+0000 7fe89f800640 1 --2- 172.21.15.112:0/2098954825 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe87806be60 0x7fe87806e320 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe88c004f60 tx=0x7fe88c007e30 comp rx=0 tx=0).stop 2024-09-12T02:46:35.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.207+0000 7fe89f800640 1 -- 172.21.15.112:0/2098954825 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8980d10b0 msgr2=0x7fe8981e7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:35.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.207+0000 7fe89f800640 1 --2- 172.21.15.112:0/2098954825 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8980d10b0 0x7fe8981e7e60 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fe89000cd50 tx=0x7fe89000a650 comp rx=0 tx=0).stop 2024-09-12T02:46:35.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.207+0000 7fe89f800640 1 -- 172.21.15.112:0/2098954825 shutdown_connections 2024-09-12T02:46:35.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.207+0000 7fe89f800640 1 --2- 172.21.15.112:0/2098954825 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8980d10b0 0x7fe8981e7e60 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:35.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.207+0000 7fe89f800640 1 --2- 172.21.15.112:0/2098954825 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8980b5820 0x7fe8981540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:35.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.207+0000 7fe89f800640 1 --2- 172.21.15.112:0/2098954825 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe87806be60 0x7fe87806e320 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:35.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.207+0000 7fe89f800640 1 --2- 172.21.15.112:0/2098954825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe89806dd30 0x7fe89815f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:35.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.207+0000 7fe89f800640 1 -- 172.21.15.112:0/2098954825 >> 172.21.15.112:0/2098954825 conn(0x7fe8980b2730 msgr2=0x7fe8980ae960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:35.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.208+0000 7fe89f800640 1 -- 172.21.15.112:0/2098954825 shutdown_connections 2024-09-12T02:46:35.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.208+0000 7fe89f800640 1 -- 172.21.15.112:0/2098954825 wait complete. 2024-09-12T02:46:35.227 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:46:35.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.387+0000 7f008de00640 1 Processor -- start 2024-09-12T02:46:35.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.387+0000 7f008de00640 1 -- start start 2024-09-12T02:46:35.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.388+0000 7f008de00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00881466f0 0x7f00880b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:35.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.388+0000 7f008de00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0088071840 0x7f0088071cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:35.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.388+0000 7f008de00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00880b3af0 con 0x7f00881605e0 2024-09-12T02:46:35.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.388+0000 7f008de00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f00880b3dd0 con 0x7f0088071840 2024-09-12T02:46:35.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.388+0000 7f008de00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f00880b40b0 con 0x7f00881466f0 2024-09-12T02:46:35.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.389+0000 7f0087400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0088071840 0x7f0088071cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:35.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.389+0000 7f0087400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0088071840 0x7f0088071cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36906/0 (socket says 172.21.15.112:36906) 2024-09-12T02:46:35.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.389+0000 7f0087400640 1 -- 172.21.15.112:0/2979320853 learned_addr learned my addr 172.21.15.112:0/2979320853 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:35.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.389+0000 7f0086a00640 1 --2- 172.21.15.112:0/2979320853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00881466f0 0x7f00880b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:35.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.389+0000 7f0087400640 1 -- 172.21.15.112:0/2979320853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00881466f0 msgr2=0x7f00880b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:35.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.389+0000 7f0087400640 1 --2- 172.21.15.112:0/2979320853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00881466f0 0x7f00880b48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:35.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.389+0000 7f0087400640 1 -- 172.21.15.112:0/2979320853 >> v1:172.21.15.137:6789/0 conn(0x7f00881605e0 legacy=0x7f0088160a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:35.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.389+0000 7f0087400640 1 -- 172.21.15.112:0/2979320853 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00880b4390 con 0x7f0088071840 2024-09-12T02:46:35.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.390+0000 7f0087400640 1 --2- 172.21.15.112:0/2979320853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0088071840 0x7f0088071cf0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0080009e80 tx=0x7f008002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a87528c425bccea4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:35.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.391+0000 7f0085600640 1 -- 172.21.15.112:0/2979320853 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0080036070 con 0x7f0088071840 2024-09-12T02:46:35.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.391+0000 7f0085600640 1 -- 172.21.15.112:0/2979320853 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0080031600 con 0x7f0088071840 2024-09-12T02:46:35.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.391+0000 7f0085600640 1 -- 172.21.15.112:0/2979320853 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00800319d0 con 0x7f0088071840 2024-09-12T02:46:35.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.391+0000 7f008de00640 1 -- 172.21.15.112:0/2979320853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0088071840 msgr2=0x7f0088071cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:35.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.391+0000 7f008de00640 1 --2- 172.21.15.112:0/2979320853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0088071840 0x7f0088071cf0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0080009e80 tx=0x7f008002a6c0 comp rx=0 tx=0).stop 2024-09-12T02:46:35.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.391+0000 7f008de00640 1 -- 172.21.15.112:0/2979320853 shutdown_connections 2024-09-12T02:46:35.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.391+0000 7f008de00640 1 --2- 172.21.15.112:0/2979320853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0088071840 0x7f0088071cf0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:35.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.391+0000 7f008de00640 1 --2- 172.21.15.112:0/2979320853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00881466f0 0x7f00880b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:35.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.391+0000 7f008de00640 1 -- 172.21.15.112:0/2979320853 >> 172.21.15.112:0/2979320853 conn(0x7f00880b28a0 msgr2=0x7f00880b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:35.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.391+0000 7f008de00640 1 -- 172.21.15.112:0/2979320853 shutdown_connections 2024-09-12T02:46:35.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.391+0000 7f008de00640 1 -- 172.21.15.112:0/2979320853 wait complete. 2024-09-12T02:46:35.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.393+0000 7f008de00640 1 Processor -- start 2024-09-12T02:46:35.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.393+0000 7f008de00640 1 -- start start 2024-09-12T02:46:35.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.394+0000 7f008de00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0088071840 0x7f00881f5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:35.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.394+0000 7f008de00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00881466f0 0x7f00880d0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:35.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.394+0000 7f008de00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00881605e0 0x7f008815c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:35.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.394+0000 7f008de00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f00880723b0 con 0x7f00881605e0 2024-09-12T02:46:35.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.394+0000 7f008de00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0088072230 con 0x7f0088071840 2024-09-12T02:46:35.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.394+0000 7f008de00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f008815e1b0 con 0x7f00881466f0 2024-09-12T02:46:35.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.394+0000 7f0087400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00881605e0 0x7f008815c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:35.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.394+0000 7f0087400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00881605e0 0x7f008815c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36922/0 (socket says 172.21.15.112:36922) 2024-09-12T02:46:35.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.394+0000 7f0087400640 1 -- 172.21.15.112:0/2051146716 learned_addr learned my addr 172.21.15.112:0/2051146716 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:35.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.395+0000 7f0086000640 1 --2- 172.21.15.112:0/2051146716 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00881466f0 0x7f00880d0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:35.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.395+0000 7f0086a00640 1 --2- 172.21.15.112:0/2051146716 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0088071840 0x7f00881f5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:35.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.395+0000 7f0087400640 1 -- 172.21.15.112:0/2051146716 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00881466f0 msgr2=0x7f00880d0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:35.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.395+0000 7f0087400640 1 --2- 172.21.15.112:0/2051146716 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00881466f0 0x7f00880d0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:35.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.395+0000 7f0087400640 1 -- 172.21.15.112:0/2051146716 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0088071840 msgr2=0x7f00881f5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:35.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.395+0000 7f0087400640 1 --2- 172.21.15.112:0/2051146716 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0088071840 0x7f00881f5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:35.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.395+0000 7f0087400640 1 -- 172.21.15.112:0/2051146716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f008815c680 con 0x7f00881605e0 2024-09-12T02:46:35.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.395+0000 7f0087400640 1 --2- 172.21.15.112:0/2051146716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00881605e0 0x7f008815c940 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f0080009fa0 tx=0x7f0080004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:35.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.395+0000 7f007f400640 1 -- 172.21.15.112:0/2051146716 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008003f020 con 0x7f00881605e0 2024-09-12T02:46:35.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.395+0000 7f007f400640 1 -- 172.21.15.112:0/2051146716 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0080037040 con 0x7f00881605e0 2024-09-12T02:46:35.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.395+0000 7f007f400640 1 -- 172.21.15.112:0/2051146716 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0080036070 con 0x7f00881605e0 2024-09-12T02:46:35.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.395+0000 7f008de00640 1 -- 172.21.15.112:0/2051146716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00880d10d0 con 0x7f00881605e0 2024-09-12T02:46:35.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.396+0000 7f008de00640 1 -- 172.21.15.112:0/2051146716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00880cf2d0 con 0x7f00881605e0 2024-09-12T02:46:35.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.397+0000 7f008de00640 1 -- 172.21.15.112:0/2051146716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0088071cf0 con 0x7f00881605e0 2024-09-12T02:46:35.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.398+0000 7f007f400640 1 -- 172.21.15.112:0/2051146716 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0080042020 con 0x7f00881605e0 2024-09-12T02:46:35.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.398+0000 7f007f400640 1 --2- 172.21.15.112:0/2051146716 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f006806be30 0x7f006806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:35.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.398+0000 7f007f400640 1 -- 172.21.15.112:0/2051146716 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5227+0+0 (secure 0 0 0) 0x7f00800ab190 con 0x7f00881605e0 2024-09-12T02:46:35.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.399+0000 7f0086a00640 1 --2- 172.21.15.112:0/2051146716 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f006806be30 0x7f006806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:35.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.399+0000 7f0086a00640 1 --2- 172.21.15.112:0/2051146716 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f006806be30 0x7f006806e2f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0078006fd0 tx=0x7f0078008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:35.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.403+0000 7f007f400640 1 -- 172.21.15.112:0/2051146716 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0080049030 con 0x7f00881605e0 2024-09-12T02:46:35.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:35.574+0000 7f008de00640 1 -- 172.21.15.112:0/2051146716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f0088160c30 con 0x7f00881605e0 2024-09-12T02:46:36.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.215+0000 7f007f400640 1 -- 172.21.15.112:0/2051146716 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v95) ==== 170+0+0 (secure 0 0 0) 0x7f0080079630 con 0x7f00881605e0 2024-09-12T02:46:36.216 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' created 2024-09-12T02:46:36.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.217+0000 7f008de00640 1 -- 172.21.15.112:0/2051146716 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f006806be30 msgr2=0x7f006806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:36.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.217+0000 7f008de00640 1 --2- 172.21.15.112:0/2051146716 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f006806be30 0x7f006806e2f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0078006fd0 tx=0x7f0078008040 comp rx=0 tx=0).stop 2024-09-12T02:46:36.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.217+0000 7f008de00640 1 -- 172.21.15.112:0/2051146716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00881605e0 msgr2=0x7f008815c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:36.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.217+0000 7f008de00640 1 --2- 172.21.15.112:0/2051146716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00881605e0 0x7f008815c940 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f0080009fa0 tx=0x7f0080004a40 comp rx=0 tx=0).stop 2024-09-12T02:46:36.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.218+0000 7f008de00640 1 -- 172.21.15.112:0/2051146716 shutdown_connections 2024-09-12T02:46:36.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.218+0000 7f008de00640 1 --2- 172.21.15.112:0/2051146716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00881605e0 0x7f008815c940 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:36.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.218+0000 7f008de00640 1 --2- 172.21.15.112:0/2051146716 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00881466f0 0x7f00880d0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:36.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.218+0000 7f008de00640 1 --2- 172.21.15.112:0/2051146716 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f006806be30 0x7f006806e2f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:36.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.218+0000 7f008de00640 1 --2- 172.21.15.112:0/2051146716 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0088071840 0x7f00881f5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:36.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.218+0000 7f008de00640 1 -- 172.21.15.112:0/2051146716 >> 172.21.15.112:0/2051146716 conn(0x7f00880b28a0 msgr2=0x7f0088142b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:36.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.218+0000 7f008de00640 1 -- 172.21.15.112:0/2051146716 shutdown_connections 2024-09-12T02:46:36.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.219+0000 7f008de00640 1 -- 172.21.15.112:0/2051146716 wait complete. 2024-09-12T02:46:36.246 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T02:46:36.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.400+0000 7fe99be00640 1 Processor -- start 2024-09-12T02:46:36.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.400+0000 7fe99be00640 1 -- start start 2024-09-12T02:46:36.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.402+0000 7fe99be00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe99415b9d0 0x7fe9940b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:36.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.402+0000 7fe99be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe99406f600 0x7fe9940728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:36.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.402+0000 7fe99be00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9940b54a0 con 0x7fe9940b45d0 2024-09-12T02:46:36.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.402+0000 7fe99be00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe9940b4a60 con 0x7fe99415b9d0 2024-09-12T02:46:36.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.402+0000 7fe99be00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe9940b3af0 con 0x7fe99406f600 2024-09-12T02:46:36.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.402+0000 7fe999400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe99415b9d0 0x7fe9940b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:36.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.402+0000 7fe999400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe99415b9d0 0x7fe9940b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36930/0 (socket says 172.21.15.112:36930) 2024-09-12T02:46:36.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.402+0000 7fe999400640 1 -- 172.21.15.112:0/1749692211 learned_addr learned my addr 172.21.15.112:0/1749692211 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:36.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.402+0000 7fe999e00640 1 --2- 172.21.15.112:0/1749692211 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe99406f600 0x7fe9940728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:36.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.402+0000 7fe999400640 1 -- 172.21.15.112:0/1749692211 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe99406f600 msgr2=0x7fe9940728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:36.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.402+0000 7fe999400640 1 --2- 172.21.15.112:0/1749692211 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe99406f600 0x7fe9940728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:36.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.402+0000 7fe999400640 1 -- 172.21.15.112:0/1749692211 >> v1:172.21.15.112:6789/0 conn(0x7fe9940b45d0 legacy=0x7fe99406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:36.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.402+0000 7fe999400640 1 -- 172.21.15.112:0/1749692211 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9940b3dd0 con 0x7fe99415b9d0 2024-09-12T02:46:36.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.402+0000 7fe999e00640 1 --2- 172.21.15.112:0/1749692211 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe99406f600 0x7fe9940728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:46:36.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.403+0000 7fe999400640 1 --2- 172.21.15.112:0/1749692211 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe99415b9d0 0x7fe9940b4ec0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fe988009870 tx=0x7fe98802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c7a46114d6e4df server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:36.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.404+0000 7fe993e00640 1 -- 172.21.15.112:0/1749692211 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe988037070 con 0x7fe99415b9d0 2024-09-12T02:46:36.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.404+0000 7fe993e00640 1 -- 172.21.15.112:0/1749692211 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe988032440 con 0x7fe99415b9d0 2024-09-12T02:46:36.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.404+0000 7fe993e00640 1 -- 172.21.15.112:0/1749692211 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe988032810 con 0x7fe99415b9d0 2024-09-12T02:46:36.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.404+0000 7fe99be00640 1 -- 172.21.15.112:0/1749692211 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe99415b9d0 msgr2=0x7fe9940b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:36.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.404+0000 7fe99be00640 1 --2- 172.21.15.112:0/1749692211 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe99415b9d0 0x7fe9940b4ec0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fe988009870 tx=0x7fe98802a270 comp rx=0 tx=0).stop 2024-09-12T02:46:36.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.404+0000 7fe99be00640 1 -- 172.21.15.112:0/1749692211 shutdown_connections 2024-09-12T02:46:36.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.404+0000 7fe99be00640 1 --2- 172.21.15.112:0/1749692211 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe99406f600 0x7fe9940728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:36.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.404+0000 7fe99be00640 1 --2- 172.21.15.112:0/1749692211 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe99415b9d0 0x7fe9940b4ec0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:36.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.404+0000 7fe99be00640 1 -- 172.21.15.112:0/1749692211 >> 172.21.15.112:0/1749692211 conn(0x7fe99406bbd0 msgr2=0x7fe99406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:36.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.404+0000 7fe99be00640 1 -- 172.21.15.112:0/1749692211 shutdown_connections 2024-09-12T02:46:36.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.404+0000 7fe99be00640 1 -- 172.21.15.112:0/1749692211 wait complete. 2024-09-12T02:46:36.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.406+0000 7fe99be00640 1 Processor -- start 2024-09-12T02:46:36.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.406+0000 7fe99be00640 1 -- start start 2024-09-12T02:46:36.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.407+0000 7fe99be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe99406f600 0x7fe9941540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:36.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.407+0000 7fe99be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9940b45d0 0x7fe99415d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:36.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.407+0000 7fe99be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe99415b9d0 0x7fe994153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:36.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.407+0000 7fe99be00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe99415bf30 con 0x7fe9940b45d0 2024-09-12T02:46:36.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.407+0000 7fe99be00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe99415bdb0 con 0x7fe99406f600 2024-09-12T02:46:36.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.407+0000 7fe99be00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe9940cdcd0 con 0x7fe99415b9d0 2024-09-12T02:46:36.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.407+0000 7fe998a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9940b45d0 0x7fe99415d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:36.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.407+0000 7fe998a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9940b45d0 0x7fe99415d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36938/0 (socket says 172.21.15.112:36938) 2024-09-12T02:46:36.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.407+0000 7fe998a00640 1 -- 172.21.15.112:0/694892248 learned_addr learned my addr 172.21.15.112:0/694892248 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:36.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.408+0000 7fe999400640 1 --2- 172.21.15.112:0/694892248 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe99406f600 0x7fe9941540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:36.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.408+0000 7fe999e00640 1 --2- 172.21.15.112:0/694892248 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe99415b9d0 0x7fe994153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:36.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.408+0000 7fe998a00640 1 -- 172.21.15.112:0/694892248 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe99415b9d0 msgr2=0x7fe994153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:36.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.408+0000 7fe998a00640 1 --2- 172.21.15.112:0/694892248 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe99415b9d0 0x7fe994153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:36.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.408+0000 7fe998a00640 1 -- 172.21.15.112:0/694892248 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe99406f600 msgr2=0x7fe9941540d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:36.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.408+0000 7fe998a00640 1 --2- 172.21.15.112:0/694892248 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe99406f600 0x7fe9941540d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:36.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.408+0000 7fe998a00640 1 -- 172.21.15.112:0/694892248 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99415e120 con 0x7fe9940b45d0 2024-09-12T02:46:36.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.408+0000 7fe998a00640 1 --2- 172.21.15.112:0/694892248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9940b45d0 0x7fe99415d1f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fe98000c430 tx=0x7fe98000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:36.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.408+0000 7fe991600640 1 -- 172.21.15.112:0/694892248 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe980017070 con 0x7fe9940b45d0 2024-09-12T02:46:36.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.408+0000 7fe991600640 1 -- 172.21.15.112:0/694892248 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9800035f0 con 0x7fe9940b45d0 2024-09-12T02:46:36.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.408+0000 7fe991600640 1 -- 172.21.15.112:0/694892248 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe980003a20 con 0x7fe9940b45d0 2024-09-12T02:46:36.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.408+0000 7fe99be00640 1 -- 172.21.15.112:0/694892248 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe994156ce0 con 0x7fe9940b45d0 2024-09-12T02:46:36.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.408+0000 7fe99be00640 1 -- 172.21.15.112:0/694892248 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe99415de40 con 0x7fe9940b45d0 2024-09-12T02:46:36.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.409+0000 7fe99be00640 1 -- 172.21.15.112:0/694892248 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe994068a30 con 0x7fe9940b45d0 2024-09-12T02:46:36.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.410+0000 7fe991600640 1 -- 172.21.15.112:0/694892248 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe980003bc0 con 0x7fe9940b45d0 2024-09-12T02:46:36.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.411+0000 7fe991600640 1 --2- 172.21.15.112:0/694892248 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe97406be30 0x7fe97406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:36.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.411+0000 7fe991600640 1 -- 172.21.15.112:0/694892248 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5609+0+0 (secure 0 0 0) 0x7fe98008a0e0 con 0x7fe9940b45d0 2024-09-12T02:46:36.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.412+0000 7fe999400640 1 --2- 172.21.15.112:0/694892248 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe97406be30 0x7fe97406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:36.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.412+0000 7fe999400640 1 --2- 172.21.15.112:0/694892248 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe97406be30 0x7fe97406e2f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe988034000 tx=0x7fe98802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:36.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.416+0000 7fe991600640 1 -- 172.21.15.112:0/694892248 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe980058a50 con 0x7fe9940b45d0 2024-09-12T02:46:36.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:36.621+0000 7fe99be00640 1 -- 172.21.15.112:0/694892248 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe99406dbc0 con 0x7fe9940b45d0 2024-09-12T02:46:37.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.231+0000 7fe991600640 1 -- 172.21.15.112:0/694892248 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v49) ==== 174+0+0 (secure 0 0 0) 0x7fe980058350 con 0x7fe9940b45d0 2024-09-12T02:46:37.232 INFO:teuthology.orchestra.run.smithi112.stderr:new fs with metadata pool 12 and data pool 13 2024-09-12T02:46:37.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.237+0000 7fe99be00640 1 -- 172.21.15.112:0/694892248 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe97406be30 msgr2=0x7fe97406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:37.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.237+0000 7fe99be00640 1 --2- 172.21.15.112:0/694892248 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe97406be30 0x7fe97406e2f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe988034000 tx=0x7fe98802e000 comp rx=0 tx=0).stop 2024-09-12T02:46:37.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.237+0000 7fe99be00640 1 -- 172.21.15.112:0/694892248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9940b45d0 msgr2=0x7fe99415d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:37.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.237+0000 7fe99be00640 1 --2- 172.21.15.112:0/694892248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9940b45d0 0x7fe99415d1f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fe98000c430 tx=0x7fe98000c8f0 comp rx=0 tx=0).stop 2024-09-12T02:46:37.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.238+0000 7fe99be00640 1 -- 172.21.15.112:0/694892248 shutdown_connections 2024-09-12T02:46:37.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.238+0000 7fe99be00640 1 --2- 172.21.15.112:0/694892248 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe99415b9d0 0x7fe994153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:37.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.238+0000 7fe99be00640 1 --2- 172.21.15.112:0/694892248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9940b45d0 0x7fe99415d1f0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:37.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.238+0000 7fe99be00640 1 --2- 172.21.15.112:0/694892248 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe97406be30 0x7fe97406e2f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:37.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.238+0000 7fe99be00640 1 --2- 172.21.15.112:0/694892248 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe99406f600 0x7fe9941540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:37.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.238+0000 7fe99be00640 1 -- 172.21.15.112:0/694892248 >> 172.21.15.112:0/694892248 conn(0x7fe99406bbd0 msgr2=0x7fe9940d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:37.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.238+0000 7fe99be00640 1 -- 172.21.15.112:0/694892248 shutdown_connections 2024-09-12T02:46:37.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.239+0000 7fe99be00640 1 -- 172.21.15.112:0/694892248 wait complete. 2024-09-12T02:46:37.260 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:46:37.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.412+0000 7f36fd800640 1 Processor -- start 2024-09-12T02:46:37.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.412+0000 7f36fd800640 1 -- start start 2024-09-12T02:46:37.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.413+0000 7f36fd800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f36f815b9d0 0x7f36f80b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:37.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.413+0000 7f36fd800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36f806f600 0x7f36f80728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:37.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.413+0000 7f36fd800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36f80b54a0 con 0x7f36f80b45d0 2024-09-12T02:46:37.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.413+0000 7f36fd800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f36f80b4a60 con 0x7f36f815b9d0 2024-09-12T02:46:37.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.413+0000 7f36fd800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f36f80b3af0 con 0x7f36f806f600 2024-09-12T02:46:37.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.414+0000 7f36f6000640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f36f80b45d0 0x7f36f806eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55574/0 (socket says 172.21.15.112:55574) 2024-09-12T02:46:37.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.414+0000 7f36f6000640 1 -- 172.21.15.112:0/324680156 learned_addr learned my addr 172.21.15.112:0/324680156 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:46:37.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.414+0000 7f36f6a00640 1 --2- 172.21.15.112:0/324680156 >> v2:172.21.15.137:3300/0 conn(0x7f36f815b9d0 0x7f36f80b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:37.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.414+0000 7f36f7400640 1 --2- 172.21.15.112:0/324680156 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36f806f600 0x7f36f80728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:37.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.414+0000 7f36f5600640 1 -- 172.21.15.112:0/324680156 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2896918882 0 0) 0x7f36f80b54a0 con 0x7f36f80b45d0 2024-09-12T02:46:37.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.414+0000 7f36f5600640 1 -- 172.21.15.112:0/324680156 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36dc003520 con 0x7f36f80b45d0 2024-09-12T02:46:37.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.414+0000 7f36f7400640 1 -- 172.21.15.112:0/324680156 >> v2:172.21.15.137:3300/0 conn(0x7f36f815b9d0 msgr2=0x7f36f80b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:37.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.414+0000 7f36f7400640 1 --2- 172.21.15.112:0/324680156 >> v2:172.21.15.137:3300/0 conn(0x7f36f815b9d0 0x7f36f80b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:37.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.414+0000 7f36f7400640 1 -- 172.21.15.112:0/324680156 >> v1:172.21.15.112:6789/0 conn(0x7f36f80b45d0 legacy=0x7f36f806eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:37.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.414+0000 7f36f7400640 1 -- 172.21.15.112:0/324680156 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f80b3dd0 con 0x7f36f806f600 2024-09-12T02:46:37.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.415+0000 7f36f7400640 1 --2- 172.21.15.112:0/324680156 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36f806f600 0x7f36f80728c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f36f0009d90 tx=0x7f36f002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1aaa4e2adb3af66f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:37.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.416+0000 7f36f5600640 1 -- 172.21.15.112:0/324680156 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f0007740 con 0x7f36f806f600 2024-09-12T02:46:37.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.416+0000 7f36f5600640 1 -- 172.21.15.112:0/324680156 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36f00078e0 con 0x7f36f806f600 2024-09-12T02:46:37.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.416+0000 7f36f5600640 1 -- 172.21.15.112:0/324680156 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f0007cb0 con 0x7f36f806f600 2024-09-12T02:46:37.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.416+0000 7f36fd800640 1 -- 172.21.15.112:0/324680156 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36f806f600 msgr2=0x7f36f80728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:37.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.416+0000 7f36fd800640 1 --2- 172.21.15.112:0/324680156 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36f806f600 0x7f36f80728c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f36f0009d90 tx=0x7f36f002a660 comp rx=0 tx=0).stop 2024-09-12T02:46:37.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.416+0000 7f36fd800640 1 -- 172.21.15.112:0/324680156 shutdown_connections 2024-09-12T02:46:37.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.416+0000 7f36fd800640 1 --2- 172.21.15.112:0/324680156 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36f806f600 0x7f36f80728c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:37.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.416+0000 7f36fd800640 1 --2- 172.21.15.112:0/324680156 >> v2:172.21.15.137:3300/0 conn(0x7f36f815b9d0 0x7f36f80b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:37.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.416+0000 7f36fd800640 1 -- 172.21.15.112:0/324680156 >> 172.21.15.112:0/324680156 conn(0x7f36f806bbd0 msgr2=0x7f36f806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:37.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.417+0000 7f36fd800640 1 -- 172.21.15.112:0/324680156 shutdown_connections 2024-09-12T02:46:37.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.417+0000 7f36fd800640 1 -- 172.21.15.112:0/324680156 wait complete. 2024-09-12T02:46:37.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.418+0000 7f36fd800640 1 Processor -- start 2024-09-12T02:46:37.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.418+0000 7f36fd800640 1 -- start start 2024-09-12T02:46:37.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.419+0000 7f36fd800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36f806f600 0x7f36f81f5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:37.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.419+0000 7f36fd800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36f80b45d0 0x7f36f8155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:37.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.419+0000 7f36fd800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36f815b9d0 0x7f36f815a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:37.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.419+0000 7f36fd800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f36f815bf30 con 0x7f36f806f600 2024-09-12T02:46:37.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.419+0000 7f36fd800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f36f815bdb0 con 0x7f36f815b9d0 2024-09-12T02:46:37.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.419+0000 7f36fd800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f36f80cdcd0 con 0x7f36f80b45d0 2024-09-12T02:46:37.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.419+0000 7f36f6a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36f806f600 0x7f36f81f5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:37.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.419+0000 7f36f6a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36f806f600 0x7f36f81f5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36950/0 (socket says 172.21.15.112:36950) 2024-09-12T02:46:37.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.419+0000 7f36f6a00640 1 -- 172.21.15.112:0/2280293632 learned_addr learned my addr 172.21.15.112:0/2280293632 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:37.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.419+0000 7f36f6000640 1 --2- 172.21.15.112:0/2280293632 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36f80b45d0 0x7f36f8155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:37.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.420+0000 7f36f7400640 1 --2- 172.21.15.112:0/2280293632 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36f815b9d0 0x7f36f815a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:37.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.420+0000 7f36f6a00640 1 -- 172.21.15.112:0/2280293632 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36f80b45d0 msgr2=0x7f36f8155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:37.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.420+0000 7f36f6a00640 1 --2- 172.21.15.112:0/2280293632 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36f80b45d0 0x7f36f8155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:37.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.420+0000 7f36f6a00640 1 -- 172.21.15.112:0/2280293632 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36f815b9d0 msgr2=0x7f36f815a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:37.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.420+0000 7f36f6a00640 1 --2- 172.21.15.112:0/2280293632 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36f815b9d0 0x7f36f815a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:37.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.420+0000 7f36f6a00640 1 -- 172.21.15.112:0/2280293632 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f81f6520 con 0x7f36f806f600 2024-09-12T02:46:37.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.420+0000 7f36f6a00640 1 --2- 172.21.15.112:0/2280293632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36f806f600 0x7f36f81f5fe0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f36e800e870 tx=0x7f36e800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:37.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.420+0000 7f36eea00640 1 -- 172.21.15.112:0/2280293632 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e8017070 con 0x7f36f806f600 2024-09-12T02:46:37.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.420+0000 7f36eea00640 1 -- 172.21.15.112:0/2280293632 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36e800c940 con 0x7f36f806f600 2024-09-12T02:46:37.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.420+0000 7f36eea00640 1 -- 172.21.15.112:0/2280293632 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e800cd30 con 0x7f36f806f600 2024-09-12T02:46:37.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.420+0000 7f36fd800640 1 -- 172.21.15.112:0/2280293632 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36f8159060 con 0x7f36f806f600 2024-09-12T02:46:37.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.420+0000 7f36fd800640 1 -- 172.21.15.112:0/2280293632 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36f8159900 con 0x7f36f806f600 2024-09-12T02:46:37.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.422+0000 7f36fd800640 1 -- 172.21.15.112:0/2280293632 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36f806ed40 con 0x7f36f806f600 2024-09-12T02:46:37.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.422+0000 7f36eea00640 1 -- 172.21.15.112:0/2280293632 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f36e801a070 con 0x7f36f806f600 2024-09-12T02:46:37.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.423+0000 7f36eea00640 1 --2- 172.21.15.112:0/2280293632 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f36d806be30 0x7f36d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:37.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.423+0000 7f36eea00640 1 -- 172.21.15.112:0/2280293632 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 5709+0+0 (secure 0 0 0) 0x7f36e808ad00 con 0x7f36f806f600 2024-09-12T02:46:37.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.423+0000 7f36f6000640 1 --2- 172.21.15.112:0/2280293632 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f36d806be30 0x7f36d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:37.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.424+0000 7f36f6000640 1 --2- 172.21.15.112:0/2280293632 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f36d806be30 0x7f36d806e2f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f36f8158dd0 tx=0x7f36e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:37.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.428+0000 7f36eea00640 1 -- 172.21.15.112:0/2280293632 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f36f81f6520 con 0x7f36f806f600 2024-09-12T02:46:37.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.601+0000 7f36fd800640 1 -- 172.21.15.112:0/2280293632 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f36f80cf080 con 0x7f36f806f600 2024-09-12T02:46:37.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.602+0000 7f36eea00640 1 -- 172.21.15.112:0/2280293632 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) ==== 74+0+16781 (secure 0 0 0) 0x7f36e8058fc0 con 0x7f36f806f600 2024-09-12T02:46:37.603 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:46:37.604 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":96,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:46:36.623055+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:46:34.392830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-12T02:46:35.615193+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:46:37.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.604+0000 7f36fd800640 1 -- 172.21.15.112:0/2280293632 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f36d806be30 msgr2=0x7f36d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:37.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.604+0000 7f36fd800640 1 --2- 172.21.15.112:0/2280293632 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f36d806be30 0x7f36d806e2f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f36f8158dd0 tx=0x7f36e4009040 comp rx=0 tx=0).stop 2024-09-12T02:46:37.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.604+0000 7f36fd800640 1 -- 172.21.15.112:0/2280293632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36f806f600 msgr2=0x7f36f81f5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:37.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.604+0000 7f36fd800640 1 --2- 172.21.15.112:0/2280293632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36f806f600 0x7f36f81f5fe0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f36e800e870 tx=0x7f36e800ed30 comp rx=0 tx=0).stop 2024-09-12T02:46:37.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.605+0000 7f36fd800640 1 -- 172.21.15.112:0/2280293632 shutdown_connections 2024-09-12T02:46:37.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.605+0000 7f36fd800640 1 --2- 172.21.15.112:0/2280293632 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f36d806be30 0x7f36d806e2f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:37.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.605+0000 7f36fd800640 1 --2- 172.21.15.112:0/2280293632 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36f815b9d0 0x7f36f815a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:37.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.605+0000 7f36fd800640 1 --2- 172.21.15.112:0/2280293632 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36f80b45d0 0x7f36f8155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:37.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.605+0000 7f36fd800640 1 --2- 172.21.15.112:0/2280293632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36f806f600 0x7f36f81f5fe0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:37.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.605+0000 7f36fd800640 1 -- 172.21.15.112:0/2280293632 >> 172.21.15.112:0/2280293632 conn(0x7f36f806bbd0 msgr2=0x7f36f8071710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:37.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.605+0000 7f36fd800640 1 -- 172.21.15.112:0/2280293632 shutdown_connections 2024-09-12T02:46:37.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.605+0000 7f36fd800640 1 -- 172.21.15.112:0/2280293632 wait complete. 2024-09-12T02:46:37.622 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:46:37.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.773+0000 7f02dac00640 1 Processor -- start 2024-09-12T02:46:37.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.773+0000 7f02dac00640 1 -- start start 2024-09-12T02:46:37.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.775+0000 7f02dac00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02d415b9d0 0x7f02d40b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:37.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.775+0000 7f02dac00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f02d40b45d0 0x7f02d40728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:37.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.775+0000 7f02dac00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02d40b54a0 con 0x7f02d406eef0 2024-09-12T02:46:37.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.775+0000 7f02dac00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f02d40b4a30 con 0x7f02d40b45d0 2024-09-12T02:46:37.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.775+0000 7f02dac00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f02d40b3af0 con 0x7f02d415b9d0 2024-09-12T02:46:37.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.775+0000 7f02d3400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f02d40b45d0 0x7f02d40728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:37.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.775+0000 7f02d3400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f02d40b45d0 0x7f02d40728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36966/0 (socket says 172.21.15.112:36966) 2024-09-12T02:46:37.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.775+0000 7f02d3400640 1 -- 172.21.15.112:0/807325556 learned_addr learned my addr 172.21.15.112:0/807325556 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:37.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.775+0000 7f02d3e00640 1 --2- 172.21.15.112:0/807325556 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02d415b9d0 0x7f02d40b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:37.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.776+0000 7f02d3400640 1 -- 172.21.15.112:0/807325556 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02d415b9d0 msgr2=0x7f02d40b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:37.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.776+0000 7f02d3400640 1 --2- 172.21.15.112:0/807325556 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02d415b9d0 0x7f02d40b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:37.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.776+0000 7f02d3400640 1 -- 172.21.15.112:0/807325556 >> v1:172.21.15.112:6789/0 conn(0x7f02d406eef0 legacy=0x7f02d406f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:37.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.776+0000 7f02d3400640 1 -- 172.21.15.112:0/807325556 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d40b3dd0 con 0x7f02d40b45d0 2024-09-12T02:46:37.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.777+0000 7f02d3400640 1 --2- 172.21.15.112:0/807325556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02d40b45d0 0x7f02d40728c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f02c0009850 tx=0x7f02c002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb8680a308b765a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:37.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.777+0000 7f02d2a00640 1 -- 172.21.15.112:0/807325556 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c0004030 con 0x7f02d40b45d0 2024-09-12T02:46:37.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.777+0000 7f02d2a00640 1 -- 172.21.15.112:0/807325556 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02c00041d0 con 0x7f02d40b45d0 2024-09-12T02:46:37.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.777+0000 7f02d2a00640 1 -- 172.21.15.112:0/807325556 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c0003610 con 0x7f02d40b45d0 2024-09-12T02:46:37.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.777+0000 7f02dac00640 1 -- 172.21.15.112:0/807325556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02d40b45d0 msgr2=0x7f02d40728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:37.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.777+0000 7f02dac00640 1 --2- 172.21.15.112:0/807325556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02d40b45d0 0x7f02d40728c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f02c0009850 tx=0x7f02c002a230 comp rx=0 tx=0).stop 2024-09-12T02:46:37.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.777+0000 7f02dac00640 1 -- 172.21.15.112:0/807325556 shutdown_connections 2024-09-12T02:46:37.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.777+0000 7f02dac00640 1 --2- 172.21.15.112:0/807325556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02d40b45d0 0x7f02d40728c0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:37.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.777+0000 7f02dac00640 1 --2- 172.21.15.112:0/807325556 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02d415b9d0 0x7f02d40b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:37.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.777+0000 7f02dac00640 1 -- 172.21.15.112:0/807325556 >> 172.21.15.112:0/807325556 conn(0x7f02d406bbd0 msgr2=0x7f02d406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:37.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.778+0000 7f02dac00640 1 -- 172.21.15.112:0/807325556 shutdown_connections 2024-09-12T02:46:37.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.778+0000 7f02dac00640 1 -- 172.21.15.112:0/807325556 wait complete. 2024-09-12T02:46:37.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.779+0000 7f02dac00640 1 Processor -- start 2024-09-12T02:46:37.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.779+0000 7f02dac00640 1 -- start start 2024-09-12T02:46:37.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.780+0000 7f02dac00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02d406eef0 0x7f02d4168830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:37.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.780+0000 7f02dac00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02d40b45d0 0x7f02d415da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:37.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.780+0000 7f02dac00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02d415b9d0 0x7f02d4153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:37.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.780+0000 7f02dac00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f02d415bf30 con 0x7f02d40b45d0 2024-09-12T02:46:37.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.780+0000 7f02dac00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f02d415bdb0 con 0x7f02d415b9d0 2024-09-12T02:46:37.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.780+0000 7f02dac00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f02d40cdcd0 con 0x7f02d406eef0 2024-09-12T02:46:37.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.780+0000 7f02d3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02d40b45d0 0x7f02d415da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:37.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.780+0000 7f02d3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02d40b45d0 0x7f02d415da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36976/0 (socket says 172.21.15.112:36976) 2024-09-12T02:46:37.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.781+0000 7f02d3400640 1 -- 172.21.15.112:0/647704960 learned_addr learned my addr 172.21.15.112:0/647704960 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:37.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.781+0000 7f02d3400640 1 -- 172.21.15.112:0/647704960 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02d406eef0 msgr2=0x7f02d4168830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:37.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.781+0000 7f02d3e00640 1 --2- 172.21.15.112:0/647704960 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02d406eef0 0x7f02d4168830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:37.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.781+0000 7f02d8c00640 1 --2- 172.21.15.112:0/647704960 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02d415b9d0 0x7f02d4153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:37.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.781+0000 7f02d3400640 1 --2- 172.21.15.112:0/647704960 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02d406eef0 0x7f02d4168830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:37.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.781+0000 7f02d3400640 1 -- 172.21.15.112:0/647704960 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02d415b9d0 msgr2=0x7f02d4153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:37.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.781+0000 7f02d3400640 1 --2- 172.21.15.112:0/647704960 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02d415b9d0 0x7f02d4153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:37.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.781+0000 7f02d3400640 1 -- 172.21.15.112:0/647704960 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d4168e10 con 0x7f02d40b45d0 2024-09-12T02:46:37.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.781+0000 7f02d3e00640 1 --2- 172.21.15.112:0/647704960 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02d406eef0 0x7f02d4168830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:46:37.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.781+0000 7f02d8c00640 1 --2- 172.21.15.112:0/647704960 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02d415b9d0 0x7f02d4153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:46:37.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.781+0000 7f02d3400640 1 --2- 172.21.15.112:0/647704960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02d40b45d0 0x7f02d415da70 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f02c0034040 tx=0x7f02c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:37.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.781+0000 7f02cbe00640 1 -- 172.21.15.112:0/647704960 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c0041030 con 0x7f02d40b45d0 2024-09-12T02:46:37.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.781+0000 7f02cbe00640 1 -- 172.21.15.112:0/647704960 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02c0003c50 con 0x7f02d40b45d0 2024-09-12T02:46:37.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.781+0000 7f02cbe00640 1 -- 172.21.15.112:0/647704960 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c0004030 con 0x7f02d40b45d0 2024-09-12T02:46:37.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.782+0000 7f02dac00640 1 -- 172.21.15.112:0/647704960 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02d40af480 con 0x7f02d40b45d0 2024-09-12T02:46:37.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.782+0000 7f02dac00640 1 -- 172.21.15.112:0/647704960 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02d415dfb0 con 0x7f02d40b45d0 2024-09-12T02:46:37.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.783+0000 7f02dac00640 1 -- 172.21.15.112:0/647704960 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02d4068a30 con 0x7f02d40b45d0 2024-09-12T02:46:37.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.784+0000 7f02cbe00640 1 -- 172.21.15.112:0/647704960 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f02c0044070 con 0x7f02d40b45d0 2024-09-12T02:46:37.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.784+0000 7f02cbe00640 1 --2- 172.21.15.112:0/647704960 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f02b406be30 0x7f02b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:37.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.784+0000 7f02cbe00640 1 -- 172.21.15.112:0/647704960 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 5709+0+0 (secure 0 0 0) 0x7f02c00abad0 con 0x7f02d40b45d0 2024-09-12T02:46:37.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.785+0000 7f02d3e00640 1 --2- 172.21.15.112:0/647704960 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f02b406be30 0x7f02b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:37.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.785+0000 7f02d3e00640 1 --2- 172.21.15.112:0/647704960 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f02b406be30 0x7f02b406e2f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f02c4009f50 tx=0x7f02c400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:37.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.788+0000 7f02cbe00640 1 -- 172.21.15.112:0/647704960 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f02c003b3b0 con 0x7f02d40b45d0 2024-09-12T02:46:37.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.964+0000 7f02dac00640 1 -- 172.21.15.112:0/647704960 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f02d406dbc0 con 0x7f02d40b45d0 2024-09-12T02:46:37.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.966+0000 7f02cbe00640 1 -- 172.21.15.112:0/647704960 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) ==== 74+0+16781 (secure 0 0 0) 0x7f02c007a350 con 0x7f02d40b45d0 2024-09-12T02:46:37.967 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:46:37.967 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":96,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:46:36.623055+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:46:34.392830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-12T02:46:35.615193+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:46:37.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.968+0000 7f02dac00640 1 -- 172.21.15.112:0/647704960 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f02b406be30 msgr2=0x7f02b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:37.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.968+0000 7f02dac00640 1 --2- 172.21.15.112:0/647704960 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f02b406be30 0x7f02b406e2f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f02c4009f50 tx=0x7f02c400b040 comp rx=0 tx=0).stop 2024-09-12T02:46:37.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.968+0000 7f02dac00640 1 -- 172.21.15.112:0/647704960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02d40b45d0 msgr2=0x7f02d415da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:37.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.968+0000 7f02dac00640 1 --2- 172.21.15.112:0/647704960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02d40b45d0 0x7f02d415da70 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f02c0034040 tx=0x7f02c00046c0 comp rx=0 tx=0).stop 2024-09-12T02:46:37.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.968+0000 7f02dac00640 1 -- 172.21.15.112:0/647704960 shutdown_connections 2024-09-12T02:46:37.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.968+0000 7f02dac00640 1 --2- 172.21.15.112:0/647704960 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f02b406be30 0x7f02b406e2f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:37.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.968+0000 7f02dac00640 1 --2- 172.21.15.112:0/647704960 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02d415b9d0 0x7f02d4153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:37.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.968+0000 7f02dac00640 1 --2- 172.21.15.112:0/647704960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02d40b45d0 0x7f02d415da70 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:37.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.968+0000 7f02dac00640 1 --2- 172.21.15.112:0/647704960 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02d406eef0 0x7f02d4168830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:37.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.968+0000 7f02dac00640 1 -- 172.21.15.112:0/647704960 >> 172.21.15.112:0/647704960 conn(0x7f02d406bbd0 msgr2=0x7f02d406dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:37.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.968+0000 7f02dac00640 1 -- 172.21.15.112:0/647704960 shutdown_connections 2024-09-12T02:46:37.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:37.968+0000 7f02dac00640 1 -- 172.21.15.112:0/647704960 wait complete. 2024-09-12T02:46:37.985 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T02:46:38.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.141+0000 7f9ab6600640 1 Processor -- start 2024-09-12T02:46:38.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.141+0000 7f9ab6600640 1 -- start start 2024-09-12T02:46:38.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.142+0000 7f9ab6600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ab00d58a0 0x7f9ab00b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:38.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.142+0000 7f9ab6600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9ab00b2cd0 0x7f9ab00b3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:38.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.142+0000 7f9ab6600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ab00b1c30 con 0x7f9ab0162510 2024-09-12T02:46:38.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.142+0000 7f9ab6600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f9ab00d5d00 con 0x7f9ab00b2cd0 2024-09-12T02:46:38.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.142+0000 7f9ab6600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9ab00b1f10 con 0x7f9ab00d58a0 2024-09-12T02:46:38.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.142+0000 7f9ab5c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9ab00b2cd0 0x7f9ab00b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:38.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.143+0000 7f9ab5c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9ab00b2cd0 0x7f9ab00b3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36992/0 (socket says 172.21.15.112:36992) 2024-09-12T02:46:38.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.143+0000 7f9ab5c00640 1 -- 172.21.15.112:0/2729836537 learned_addr learned my addr 172.21.15.112:0/2729836537 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:38.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.143+0000 7f9aafe00640 1 --2- 172.21.15.112:0/2729836537 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ab00d58a0 0x7f9ab00b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:38.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.143+0000 7f9ab5c00640 1 -- 172.21.15.112:0/2729836537 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ab00d58a0 msgr2=0x7f9ab00b4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:38.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.143+0000 7f9ab5c00640 1 --2- 172.21.15.112:0/2729836537 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ab00d58a0 0x7f9ab00b4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:38.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.143+0000 7f9ab5c00640 1 -- 172.21.15.112:0/2729836537 >> v1:172.21.15.112:6789/0 conn(0x7f9ab0162510 legacy=0x7f9ab00b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:38.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.143+0000 7f9ab5c00640 1 -- 172.21.15.112:0/2729836537 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab00b21f0 con 0x7f9ab00b2cd0 2024-09-12T02:46:38.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.144+0000 7f9ab5c00640 1 --2- 172.21.15.112:0/2729836537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ab00b2cd0 0x7f9ab00b3160 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009e50 tx=0x7f9aa802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22730dc7554f7728 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:38.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.144+0000 7f9aaf400640 1 -- 172.21.15.112:0/2729836537 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8036070 con 0x7f9ab00b2cd0 2024-09-12T02:46:38.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.144+0000 7f9aaf400640 1 -- 172.21.15.112:0/2729836537 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aa8031600 con 0x7f9ab00b2cd0 2024-09-12T02:46:38.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.144+0000 7f9aaf400640 1 -- 172.21.15.112:0/2729836537 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa80319d0 con 0x7f9ab00b2cd0 2024-09-12T02:46:38.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.145+0000 7f9ab6600640 1 -- 172.21.15.112:0/2729836537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ab00b2cd0 msgr2=0x7f9ab00b3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:38.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.145+0000 7f9ab6600640 1 --2- 172.21.15.112:0/2729836537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ab00b2cd0 0x7f9ab00b3160 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009e50 tx=0x7f9aa802a710 comp rx=0 tx=0).stop 2024-09-12T02:46:38.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.145+0000 7f9ab6600640 1 -- 172.21.15.112:0/2729836537 shutdown_connections 2024-09-12T02:46:38.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.145+0000 7f9ab6600640 1 --2- 172.21.15.112:0/2729836537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ab00b2cd0 0x7f9ab00b3160 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:38.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.145+0000 7f9ab6600640 1 --2- 172.21.15.112:0/2729836537 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ab00d58a0 0x7f9ab00b4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:38.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.145+0000 7f9ab6600640 1 -- 172.21.15.112:0/2729836537 >> 172.21.15.112:0/2729836537 conn(0x7f9ab00d4d80 msgr2=0x7f9ab00d5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:38.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.145+0000 7f9ab6600640 1 -- 172.21.15.112:0/2729836537 shutdown_connections 2024-09-12T02:46:38.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.145+0000 7f9ab6600640 1 -- 172.21.15.112:0/2729836537 wait complete. 2024-09-12T02:46:38.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.146+0000 7f9ab6600640 1 Processor -- start 2024-09-12T02:46:38.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.147+0000 7f9ab6600640 1 -- start start 2024-09-12T02:46:38.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.147+0000 7f9ab6600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ab00b2cd0 0x7f9ab01f8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:38.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.147+0000 7f9ab6600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ab00d58a0 0x7f9ab00ba4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:38.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.147+0000 7f9ab6600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ab0162510 0x7f9ab01555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:38.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.147+0000 7f9ab6600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab01628f0 con 0x7f9ab00b2cd0 2024-09-12T02:46:38.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.147+0000 7f9ab6600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab00b27b0 con 0x7f9ab00d58a0 2024-09-12T02:46:38.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.147+0000 7f9ab6600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9ab00b5330 con 0x7f9ab0162510 2024-09-12T02:46:38.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.148+0000 7f9ab5200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ab00b2cd0 0x7f9ab01f8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:38.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.148+0000 7f9ab5200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ab00b2cd0 0x7f9ab01f8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36994/0 (socket says 172.21.15.112:36994) 2024-09-12T02:46:38.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.148+0000 7f9ab5200640 1 -- 172.21.15.112:0/1601118520 learned_addr learned my addr 172.21.15.112:0/1601118520 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:38.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.148+0000 7f9ab5c00640 1 --2- 172.21.15.112:0/1601118520 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ab0162510 0x7f9ab01555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:38.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.148+0000 7f9aafe00640 1 --2- 172.21.15.112:0/1601118520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ab00d58a0 0x7f9ab00ba4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:38.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.148+0000 7f9ab5200640 1 -- 172.21.15.112:0/1601118520 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ab0162510 msgr2=0x7f9ab01555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:38.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.148+0000 7f9ab5200640 1 --2- 172.21.15.112:0/1601118520 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ab0162510 0x7f9ab01555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:38.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.148+0000 7f9ab5200640 1 -- 172.21.15.112:0/1601118520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ab00d58a0 msgr2=0x7f9ab00ba4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:38.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.148+0000 7f9ab5200640 1 --2- 172.21.15.112:0/1601118520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ab00d58a0 0x7f9ab00ba4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:38.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.148+0000 7f9ab5200640 1 -- 172.21.15.112:0/1601118520 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab00cc5b0 con 0x7f9ab00b2cd0 2024-09-12T02:46:38.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.148+0000 7f9ab5200640 1 --2- 172.21.15.112:0/1601118520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ab00b2cd0 0x7f9ab01f8ae0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400c3c0 tx=0x7f9aa400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:38.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.149+0000 7f9aacc00640 1 -- 172.21.15.112:0/1601118520 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa40052d0 con 0x7f9ab00b2cd0 2024-09-12T02:46:38.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.149+0000 7f9aacc00640 1 -- 172.21.15.112:0/1601118520 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aa4005490 con 0x7f9ab00b2cd0 2024-09-12T02:46:38.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.149+0000 7f9ab6600640 1 -- 172.21.15.112:0/1601118520 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ab00cc890 con 0x7f9ab00b2cd0 2024-09-12T02:46:38.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.149+0000 7f9aacc00640 1 -- 172.21.15.112:0/1601118520 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4007260 con 0x7f9ab00b2cd0 2024-09-12T02:46:38.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.149+0000 7f9ab6600640 1 -- 172.21.15.112:0/1601118520 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ab00cce50 con 0x7f9ab00b2cd0 2024-09-12T02:46:38.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.150+0000 7f9ab6600640 1 -- 172.21.15.112:0/1601118520 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ab00cd050 con 0x7f9ab00b2cd0 2024-09-12T02:46:38.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.151+0000 7f9aacc00640 1 -- 172.21.15.112:0/1601118520 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9aa4007400 con 0x7f9ab00b2cd0 2024-09-12T02:46:38.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.152+0000 7f9aacc00640 1 --2- 172.21.15.112:0/1601118520 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9a9006be30 0x7f9a9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:38.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.152+0000 7f9aacc00640 1 -- 172.21.15.112:0/1601118520 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 5709+0+0 (secure 0 0 0) 0x7f9aa408a350 con 0x7f9ab00b2cd0 2024-09-12T02:46:38.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.152+0000 7f9aafe00640 1 --2- 172.21.15.112:0/1601118520 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9a9006be30 0x7f9a9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:38.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.153+0000 7f9aafe00640 1 --2- 172.21.15.112:0/1601118520 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9a9006be30 0x7f9a9006e2f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9ab01f9020 tx=0x7f9a9c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:38.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.156+0000 7f9aacc00640 1 -- 172.21.15.112:0/1601118520 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9ab00cd050 con 0x7f9ab00b2cd0 2024-09-12T02:46:38.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:38.371+0000 7f9ab6600640 1 -- 172.21.15.112:0/1601118520 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9ab006c590 con 0x7f9ab00b2cd0 2024-09-12T02:46:39.199 INFO:tasks.ceph.mds.a.smithi112.stderr:2024-09-12T02:46:39.199+0000 7fbe86000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:46:39.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.249+0000 7f9aacc00640 1 -- 172.21.15.112:0/1601118520 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v52) ==== 118+0+0 (secure 0 0 0) 0x7f9aa4058cf0 con 0x7f9ab00b2cd0 2024-09-12T02:46:39.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.251+0000 7f9ab6600640 1 -- 172.21.15.112:0/1601118520 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9a9006be30 msgr2=0x7f9a9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:39.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.251+0000 7f9ab6600640 1 --2- 172.21.15.112:0/1601118520 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9a9006be30 0x7f9a9006e2f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9ab01f9020 tx=0x7f9a9c008040 comp rx=0 tx=0).stop 2024-09-12T02:46:39.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.252+0000 7f9ab6600640 1 -- 172.21.15.112:0/1601118520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ab00b2cd0 msgr2=0x7f9ab01f8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:39.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.252+0000 7f9ab6600640 1 --2- 172.21.15.112:0/1601118520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ab00b2cd0 0x7f9ab01f8ae0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400c3c0 tx=0x7f9aa400c880 comp rx=0 tx=0).stop 2024-09-12T02:46:39.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.252+0000 7f9ab6600640 1 -- 172.21.15.112:0/1601118520 shutdown_connections 2024-09-12T02:46:39.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.252+0000 7f9ab6600640 1 --2- 172.21.15.112:0/1601118520 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ab0162510 0x7f9ab01555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:39.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.252+0000 7f9ab6600640 1 --2- 172.21.15.112:0/1601118520 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9a9006be30 0x7f9a9006e2f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:39.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.252+0000 7f9ab6600640 1 --2- 172.21.15.112:0/1601118520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ab00d58a0 0x7f9ab00ba4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:39.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.252+0000 7f9ab6600640 1 --2- 172.21.15.112:0/1601118520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ab00b2cd0 0x7f9ab01f8ae0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:39.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.252+0000 7f9ab6600640 1 -- 172.21.15.112:0/1601118520 >> 172.21.15.112:0/1601118520 conn(0x7f9ab00d4d80 msgr2=0x7f9ab006d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:39.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.252+0000 7f9ab6600640 1 -- 172.21.15.112:0/1601118520 shutdown_connections 2024-09-12T02:46:39.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.252+0000 7f9ab6600640 1 -- 172.21.15.112:0/1601118520 wait complete. 2024-09-12T02:46:39.271 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T02:46:39.271 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T02:46:39.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.427+0000 7f0e63200640 1 Processor -- start 2024-09-12T02:46:39.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.428+0000 7f0e63200640 1 -- start start 2024-09-12T02:46:39.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.429+0000 7f0e63200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e6415f3b0 0x7f0e640732d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:39.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.429+0000 7f0e63200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0e64161c40 0x7f0e64168960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:39.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.429+0000 7f0e63200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e64073810 con 0x7f0e640b4180 2024-09-12T02:46:39.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.429+0000 7f0e63200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f0e641607a0 con 0x7f0e64161c40 2024-09-12T02:46:39.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.429+0000 7f0e63200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0e64073ab0 con 0x7f0e6415f3b0 2024-09-12T02:46:39.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.429+0000 7f0e59400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f0e640b4180 0x7f0e6415f790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55602/0 (socket says 172.21.15.112:55602) 2024-09-12T02:46:39.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.429+0000 7f0e59400640 1 -- 172.21.15.112:0/32973738 learned_addr learned my addr 172.21.15.112:0/32973738 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:46:39.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.429+0000 7f0e62800640 1 --2- 172.21.15.112:0/32973738 >> v2:172.21.15.137:3300/0 conn(0x7f0e64161c40 0x7f0e64168960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:39.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.429+0000 7f0e61e00640 1 --2- 172.21.15.112:0/32973738 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e6415f3b0 0x7f0e640732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:39.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.429+0000 7f0e61400640 1 -- 172.21.15.112:0/32973738 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3301201185 0 0) 0x7f0e64073810 con 0x7f0e640b4180 2024-09-12T02:46:39.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.429+0000 7f0e61400640 1 -- 172.21.15.112:0/32973738 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e48003520 con 0x7f0e640b4180 2024-09-12T02:46:39.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.430+0000 7f0e61400640 1 -- 172.21.15.112:0/32973738 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2011056716 0 0) 0x7f0e48003520 con 0x7f0e640b4180 2024-09-12T02:46:39.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.430+0000 7f0e61400640 1 -- 172.21.15.112:0/32973738 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e6415f3b0 msgr2=0x7f0e640732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:39.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.430+0000 7f0e61400640 1 --2- 172.21.15.112:0/32973738 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e6415f3b0 0x7f0e640732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:39.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.430+0000 7f0e61400640 1 -- 172.21.15.112:0/32973738 >> v2:172.21.15.137:3300/0 conn(0x7f0e64161c40 msgr2=0x7f0e64168960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:39.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.430+0000 7f0e61400640 1 --2- 172.21.15.112:0/32973738 >> v2:172.21.15.137:3300/0 conn(0x7f0e64161c40 0x7f0e64168960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:39.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.430+0000 7f0e61400640 1 -- 172.21.15.112:0/32973738 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e64073d90 con 0x7f0e640b4180 2024-09-12T02:46:39.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.430+0000 7f0e61400640 1 -- 172.21.15.112:0/32973738 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f0e4c001670 con 0x7f0e640b4180 2024-09-12T02:46:39.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.430+0000 7f0e61400640 1 -- 172.21.15.112:0/32973738 >> v1:172.21.15.112:6789/0 conn(0x7f0e640b4180 legacy=0x7f0e6415f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:39.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.430+0000 7f0e61400640 1 --2- 172.21.15.112:0/32973738 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e6415f3b0 0x7f0e480039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:39.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.430+0000 7f0e61400640 1 --2- 172.21.15.112:0/32973738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e48003f30 0x7f0e48004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:39.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.430+0000 7f0e61400640 1 --2- 172.21.15.112:0/32973738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e48004d40 0x7f0e480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:39.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.430+0000 7f0e61400640 1 -- 172.21.15.112:0/32973738 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0e641607a0 con 0x7f0e48004d40 2024-09-12T02:46:39.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.430+0000 7f0e61400640 1 -- 172.21.15.112:0/32973738 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0e64073ab0 con 0x7f0e48003f30 2024-09-12T02:46:39.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.430+0000 7f0e61400640 1 -- 172.21.15.112:0/32973738 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0e4800ba10 con 0x7f0e6415f3b0 2024-09-12T02:46:39.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.430+0000 7f0e62800640 1 --2- 172.21.15.112:0/32973738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e48004d40 0x7f0e480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:39.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.430+0000 7f0e61e00640 1 --2- 172.21.15.112:0/32973738 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e6415f3b0 0x7f0e480039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:39.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.430+0000 7f0e59400640 1 --2- 172.21.15.112:0/32973738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e48003f30 0x7f0e48004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:39.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.430+0000 7f0e62800640 1 -- 172.21.15.112:0/32973738 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e6415f3b0 msgr2=0x7f0e480039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:39.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.430+0000 7f0e62800640 1 --2- 172.21.15.112:0/32973738 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e6415f3b0 0x7f0e480039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:39.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.430+0000 7f0e62800640 1 -- 172.21.15.112:0/32973738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e48003f30 msgr2=0x7f0e48004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:39.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.430+0000 7f0e62800640 1 --2- 172.21.15.112:0/32973738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e48003f30 0x7f0e48004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:39.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.431+0000 7f0e62800640 1 -- 172.21.15.112:0/32973738 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e48003520 con 0x7f0e48004d40 2024-09-12T02:46:39.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.431+0000 7f0e62800640 1 --2- 172.21.15.112:0/32973738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e48004d40 0x7f0e480051c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c00e170 tx=0x7f0e48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e37ffba240c65e52 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:39.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.432+0000 7f0e61400640 1 -- 172.21.15.112:0/32973738 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c034020 con 0x7f0e48004d40 2024-09-12T02:46:39.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.432+0000 7f0e61400640 1 -- 172.21.15.112:0/32973738 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e5c030430 con 0x7f0e48004d40 2024-09-12T02:46:39.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.432+0000 7f0e61400640 1 -- 172.21.15.112:0/32973738 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c009c10 con 0x7f0e48004d40 2024-09-12T02:46:39.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.432+0000 7f0e63200640 1 -- 172.21.15.112:0/32973738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e48004d40 msgr2=0x7f0e480051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:39.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.432+0000 7f0e63200640 1 --2- 172.21.15.112:0/32973738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e48004d40 0x7f0e480051c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c00e170 tx=0x7f0e48005830 comp rx=0 tx=0).stop 2024-09-12T02:46:39.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.432+0000 7f0e62800640 1 -- 172.21.15.112:0/32973738 reap_dead start 2024-09-12T02:46:39.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.432+0000 7f0e63200640 1 -- 172.21.15.112:0/32973738 shutdown_connections 2024-09-12T02:46:39.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.432+0000 7f0e63200640 1 -- 172.21.15.112:0/32973738 >> 172.21.15.112:0/32973738 conn(0x7f0e64072420 msgr2=0x7f0e640b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:39.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.433+0000 7f0e63200640 1 -- 172.21.15.112:0/32973738 shutdown_connections 2024-09-12T02:46:39.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.433+0000 7f0e63200640 1 -- 172.21.15.112:0/32973738 wait complete. 2024-09-12T02:46:39.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.434+0000 7f0e63200640 1 Processor -- start 2024-09-12T02:46:39.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.434+0000 7f0e63200640 1 -- start start 2024-09-12T02:46:39.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.435+0000 7f0e63200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e48004d40 0x7f0e6409c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:39.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.435+0000 7f0e63200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e6409ca10 0x7f0e6409e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:39.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.435+0000 7f0e63200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e64157970 0x7f0e64157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:39.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.435+0000 7f0e63200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0e64160020 con 0x7f0e6409ca10 2024-09-12T02:46:39.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.435+0000 7f0e63200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6415fea0 con 0x7f0e48004d40 2024-09-12T02:46:39.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.435+0000 7f0e63200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0e641601a0 con 0x7f0e64157970 2024-09-12T02:46:39.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.435+0000 7f0e59400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e6409ca10 0x7f0e6409e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:39.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.435+0000 7f0e59400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e6409ca10 0x7f0e6409e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37022/0 (socket says 172.21.15.112:37022) 2024-09-12T02:46:39.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.435+0000 7f0e59400640 1 -- 172.21.15.112:0/3513771492 learned_addr learned my addr 172.21.15.112:0/3513771492 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:39.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.436+0000 7f0e62800640 1 --2- 172.21.15.112:0/3513771492 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e64157970 0x7f0e64157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:39.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.436+0000 7f0e61e00640 1 --2- 172.21.15.112:0/3513771492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e48004d40 0x7f0e6409c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:39.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.436+0000 7f0e59400640 1 -- 172.21.15.112:0/3513771492 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e64157970 msgr2=0x7f0e64157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:39.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.436+0000 7f0e59400640 1 --2- 172.21.15.112:0/3513771492 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e64157970 0x7f0e64157e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:39.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.436+0000 7f0e59400640 1 -- 172.21.15.112:0/3513771492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e48004d40 msgr2=0x7f0e6409c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:39.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.436+0000 7f0e59400640 1 --2- 172.21.15.112:0/3513771492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e48004d40 0x7f0e6409c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:39.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.436+0000 7f0e59400640 1 -- 172.21.15.112:0/3513771492 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e6409ce70 con 0x7f0e6409ca10 2024-09-12T02:46:39.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.436+0000 7f0e62800640 1 --2- 172.21.15.112:0/3513771492 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e64157970 0x7f0e64157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:39.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.436+0000 7f0e61e00640 1 --2- 172.21.15.112:0/3513771492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e48004d40 0x7f0e6409c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:39.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.436+0000 7f0e59400640 1 --2- 172.21.15.112:0/3513771492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e6409ca10 0x7f0e6409e8d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c0079f0 tx=0x7f0e4c0077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:39.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.436+0000 7f0e5aa00640 1 -- 172.21.15.112:0/3513771492 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c00f9c0 con 0x7f0e6409ca10 2024-09-12T02:46:39.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.436+0000 7f0e5aa00640 1 -- 172.21.15.112:0/3513771492 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e4c018070 con 0x7f0e6409ca10 2024-09-12T02:46:39.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.436+0000 7f0e5aa00640 1 -- 172.21.15.112:0/3513771492 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c00fdc0 con 0x7f0e6409ca10 2024-09-12T02:46:39.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.436+0000 7f0e63200640 1 -- 172.21.15.112:0/3513771492 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e6415a860 con 0x7f0e6409ca10 2024-09-12T02:46:39.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.437+0000 7f0e63200640 1 -- 172.21.15.112:0/3513771492 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e6415ae20 con 0x7f0e6409ca10 2024-09-12T02:46:39.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.437+0000 7f0e63200640 1 -- 172.21.15.112:0/3513771492 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e640732d0 con 0x7f0e6409ca10 2024-09-12T02:46:39.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.438+0000 7f0e5aa00640 1 -- 172.21.15.112:0/3513771492 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0e4c01d460 con 0x7f0e6409ca10 2024-09-12T02:46:39.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.439+0000 7f0e5aa00640 1 --2- 172.21.15.112:0/3513771492 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0e4006be60 0x7f0e4006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:39.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.439+0000 7f0e5aa00640 1 -- 172.21.15.112:0/3513771492 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5709+0+0 (secure 0 0 0) 0x7f0e4c08b000 con 0x7f0e6409ca10 2024-09-12T02:46:39.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.439+0000 7f0e61e00640 1 --2- 172.21.15.112:0/3513771492 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0e4006be60 0x7f0e4006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:39.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.440+0000 7f0e61e00640 1 --2- 172.21.15.112:0/3513771492 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0e4006be60 0x7f0e4006e320 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0e54009bc0 tx=0x7f0e54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:39.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.444+0000 7f0e5aa00640 1 -- 172.21.15.112:0/3513771492 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0e4c059920 con 0x7f0e6409ca10 2024-09-12T02:46:39.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:39.651+0000 7f0e63200640 1 -- 172.21.15.112:0/3513771492 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f0e6415d820 con 0x7f0e6409ca10 2024-09-12T02:46:40.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.250+0000 7f0e5aa00640 1 -- 172.21.15.112:0/3513771492 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v53) ==== 122+0+0 (secure 0 0 0) 0x7f0e4c059220 con 0x7f0e6409ca10 2024-09-12T02:46:40.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.253+0000 7f0e63200640 1 -- 172.21.15.112:0/3513771492 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0e4006be60 msgr2=0x7f0e4006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:40.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.253+0000 7f0e63200640 1 --2- 172.21.15.112:0/3513771492 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0e4006be60 0x7f0e4006e320 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0e54009bc0 tx=0x7f0e54008040 comp rx=0 tx=0).stop 2024-09-12T02:46:40.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.253+0000 7f0e63200640 1 -- 172.21.15.112:0/3513771492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e6409ca10 msgr2=0x7f0e6409e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:40.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.253+0000 7f0e63200640 1 --2- 172.21.15.112:0/3513771492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e6409ca10 0x7f0e6409e8d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c0079f0 tx=0x7f0e4c0077a0 comp rx=0 tx=0).stop 2024-09-12T02:46:40.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.253+0000 7f0e63200640 1 -- 172.21.15.112:0/3513771492 shutdown_connections 2024-09-12T02:46:40.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.253+0000 7f0e63200640 1 --2- 172.21.15.112:0/3513771492 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0e64157970 0x7f0e64157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:40.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.253+0000 7f0e63200640 1 --2- 172.21.15.112:0/3513771492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e6409ca10 0x7f0e6409e8d0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:40.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.253+0000 7f0e63200640 1 --2- 172.21.15.112:0/3513771492 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0e4006be60 0x7f0e4006e320 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:40.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.253+0000 7f0e63200640 1 --2- 172.21.15.112:0/3513771492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e48004d40 0x7f0e6409c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:40.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.253+0000 7f0e63200640 1 -- 172.21.15.112:0/3513771492 >> 172.21.15.112:0/3513771492 conn(0x7f0e64072420 msgr2=0x7f0e640b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:40.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.254+0000 7f0e63200640 1 -- 172.21.15.112:0/3513771492 shutdown_connections 2024-09-12T02:46:40.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.254+0000 7f0e63200640 1 -- 172.21.15.112:0/3513771492 wait complete. 2024-09-12T02:46:40.273 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T02:46:40.273 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:46:40.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.426+0000 7f3506400640 1 Processor -- start 2024-09-12T02:46:40.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.426+0000 7f3506400640 1 -- start start 2024-09-12T02:46:40.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.427+0000 7f3506400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f350006f600 0x7f35000b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:40.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.427+0000 7f3506400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f35000b45d0 0x7f35000728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:40.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.427+0000 7f3506400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35000b4a20 con 0x7f350015b9d0 2024-09-12T02:46:40.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.427+0000 7f3506400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f35000b54a0 con 0x7f35000b45d0 2024-09-12T02:46:40.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.427+0000 7f3506400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f35000b3af0 con 0x7f350006f600 2024-09-12T02:46:40.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.428+0000 7f34ff400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f350015b9d0 0x7f350006eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55604/0 (socket says 172.21.15.112:55604) 2024-09-12T02:46:40.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.428+0000 7f34ff400640 1 -- 172.21.15.112:0/4033052042 learned_addr learned my addr 172.21.15.112:0/4033052042 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:46:40.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.428+0000 7f34f6a00640 1 --2- 172.21.15.112:0/4033052042 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f350006f600 0x7f35000b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:40.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.428+0000 7f34ffe00640 1 --2- 172.21.15.112:0/4033052042 >> v2:172.21.15.137:3300/0 conn(0x7f35000b45d0 0x7f35000728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:40.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.428+0000 7f34fea00640 1 -- 172.21.15.112:0/4033052042 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2166830092 0 0) 0x7f35000b4a20 con 0x7f350015b9d0 2024-09-12T02:46:40.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.428+0000 7f34fea00640 1 -- 172.21.15.112:0/4033052042 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34e4003520 con 0x7f350015b9d0 2024-09-12T02:46:40.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.428+0000 7f34fea00640 1 -- 172.21.15.112:0/4033052042 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2006351176 0 0) 0x7f34e4003520 con 0x7f350015b9d0 2024-09-12T02:46:40.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.428+0000 7f34fea00640 1 -- 172.21.15.112:0/4033052042 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f350006f600 msgr2=0x7f35000b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:40.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.428+0000 7f34fea00640 1 --2- 172.21.15.112:0/4033052042 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f350006f600 0x7f35000b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:40.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.428+0000 7f34fea00640 1 -- 172.21.15.112:0/4033052042 >> v2:172.21.15.137:3300/0 conn(0x7f35000b45d0 msgr2=0x7f35000728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:40.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.428+0000 7f34fea00640 1 --2- 172.21.15.112:0/4033052042 >> v2:172.21.15.137:3300/0 conn(0x7f35000b45d0 0x7f35000728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:40.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.428+0000 7f34fea00640 1 -- 172.21.15.112:0/4033052042 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35000b3dd0 con 0x7f350015b9d0 2024-09-12T02:46:40.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.428+0000 7f34fea00640 1 -- 172.21.15.112:0/4033052042 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f34f0001670 con 0x7f350015b9d0 2024-09-12T02:46:40.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.428+0000 7f34fea00640 1 -- 172.21.15.112:0/4033052042 >> v1:172.21.15.112:6789/0 conn(0x7f350015b9d0 legacy=0x7f350006eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:40.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.429+0000 7f34fea00640 1 --2- 172.21.15.112:0/4033052042 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f350006f600 0x7f34e40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:40.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.429+0000 7f34fea00640 1 --2- 172.21.15.112:0/4033052042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34e4003f80 0x7f34e4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:40.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.429+0000 7f34fea00640 1 --2- 172.21.15.112:0/4033052042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34e4004d40 0x7f34e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:40.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.429+0000 7f34fea00640 1 -- 172.21.15.112:0/4033052042 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f35000b54a0 con 0x7f34e4003f80 2024-09-12T02:46:40.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.429+0000 7f34fea00640 1 -- 172.21.15.112:0/4033052042 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f35000b3af0 con 0x7f34e4004d40 2024-09-12T02:46:40.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.429+0000 7f34fea00640 1 -- 172.21.15.112:0/4033052042 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f34e400dbd0 con 0x7f350006f600 2024-09-12T02:46:40.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.429+0000 7f34f6a00640 1 --2- 172.21.15.112:0/4033052042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34e4003f80 0x7f34e4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:40.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.429+0000 7f34ff400640 1 --2- 172.21.15.112:0/4033052042 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f350006f600 0x7f34e40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:40.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.429+0000 7f34ffe00640 1 --2- 172.21.15.112:0/4033052042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34e4004d40 0x7f34e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:40.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.429+0000 7f34f6a00640 1 -- 172.21.15.112:0/4033052042 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f350006f600 msgr2=0x7f34e40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:40.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.429+0000 7f34f6a00640 1 --2- 172.21.15.112:0/4033052042 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f350006f600 0x7f34e40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:40.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.429+0000 7f34f6a00640 1 -- 172.21.15.112:0/4033052042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34e4004d40 msgr2=0x7f34e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:40.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.429+0000 7f34f6a00640 1 --2- 172.21.15.112:0/4033052042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34e4004d40 0x7f34e40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:40.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.429+0000 7f34f6a00640 1 -- 172.21.15.112:0/4033052042 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e4003520 con 0x7f34e4003f80 2024-09-12T02:46:40.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.430+0000 7f34f6a00640 1 --2- 172.21.15.112:0/4033052042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34e4003f80 0x7f34e4004800 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f34e8009ae0 tx=0x7f34e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec2aa160151e158 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:40.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.430+0000 7f34fea00640 1 -- 172.21.15.112:0/4033052042 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e8036070 con 0x7f34e4003f80 2024-09-12T02:46:40.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.430+0000 7f34fea00640 1 -- 172.21.15.112:0/4033052042 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34e8005990 con 0x7f34e4003f80 2024-09-12T02:46:40.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.431+0000 7f34fea00640 1 -- 172.21.15.112:0/4033052042 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e8009680 con 0x7f34e4003f80 2024-09-12T02:46:40.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.431+0000 7f3506400640 1 -- 172.21.15.112:0/4033052042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34e4003f80 msgr2=0x7f34e4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:40.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.431+0000 7f3506400640 1 --2- 172.21.15.112:0/4033052042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34e4003f80 0x7f34e4004800 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f34e8009ae0 tx=0x7f34e4005830 comp rx=0 tx=0).stop 2024-09-12T02:46:40.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.431+0000 7f34ffe00640 1 -- 172.21.15.112:0/4033052042 reap_dead start 2024-09-12T02:46:40.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.431+0000 7f3506400640 1 -- 172.21.15.112:0/4033052042 shutdown_connections 2024-09-12T02:46:40.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.431+0000 7f3506400640 1 -- 172.21.15.112:0/4033052042 >> 172.21.15.112:0/4033052042 conn(0x7f350006bbd0 msgr2=0x7f350006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:40.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.431+0000 7f3506400640 1 -- 172.21.15.112:0/4033052042 shutdown_connections 2024-09-12T02:46:40.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.431+0000 7f3506400640 1 -- 172.21.15.112:0/4033052042 wait complete. 2024-09-12T02:46:40.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.433+0000 7f3506400640 1 Processor -- start 2024-09-12T02:46:40.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.433+0000 7f3506400640 1 -- start start 2024-09-12T02:46:40.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.434+0000 7f3506400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34e4003f80 0x7f350014f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:40.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.434+0000 7f3506400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f35001525f0 0x7f3500158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:40.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.434+0000 7f3506400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3500152a70 0x7f3500159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:40.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.434+0000 7f3506400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f350015bf30 con 0x7f3500152a70 2024-09-12T02:46:40.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.434+0000 7f3506400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f350015bdb0 con 0x7f34e4003f80 2024-09-12T02:46:40.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.434+0000 7f3506400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f35000b4ec0 con 0x7f35001525f0 2024-09-12T02:46:40.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.434+0000 7f34ff400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34e4003f80 0x7f350014f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:40.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.434+0000 7f34ffe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3500152a70 0x7f3500159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:40.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.434+0000 7f34f6a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f35001525f0 0x7f3500158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:40.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.434+0000 7f34ff400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34e4003f80 0x7f350014f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:46320/0 (socket says 172.21.15.112:46320) 2024-09-12T02:46:40.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.434+0000 7f34ff400640 1 -- 172.21.15.112:0/768650365 learned_addr learned my addr 172.21.15.112:0/768650365 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:40.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.435+0000 7f34ffe00640 1 -- 172.21.15.112:0/768650365 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f35001525f0 msgr2=0x7f3500158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:40.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.435+0000 7f34ffe00640 1 --2- 172.21.15.112:0/768650365 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f35001525f0 0x7f3500158dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:40.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.435+0000 7f34ffe00640 1 -- 172.21.15.112:0/768650365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34e4003f80 msgr2=0x7f350014f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:40.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.435+0000 7f34ffe00640 1 --2- 172.21.15.112:0/768650365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34e4003f80 0x7f350014f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:40.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.435+0000 7f34ffe00640 1 -- 172.21.15.112:0/768650365 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35001537d0 con 0x7f3500152a70 2024-09-12T02:46:40.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.435+0000 7f34ff400640 1 --2- 172.21.15.112:0/768650365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34e4003f80 0x7f350014f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:46:40.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.435+0000 7f34ffe00640 1 --2- 172.21.15.112:0/768650365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3500152a70 0x7f3500159300 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f350006d260 tx=0x7f34f800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:40.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.435+0000 7f34f7e00640 1 -- 172.21.15.112:0/768650365 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f800fde0 con 0x7f3500152a70 2024-09-12T02:46:40.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.435+0000 7f34f7e00640 1 -- 172.21.15.112:0/768650365 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34f801d070 con 0x7f3500152a70 2024-09-12T02:46:40.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.435+0000 7f3506400640 1 -- 172.21.15.112:0/768650365 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3500153ab0 con 0x7f3500152a70 2024-09-12T02:46:40.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.435+0000 7f34f7e00640 1 -- 172.21.15.112:0/768650365 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f8015670 con 0x7f3500152a70 2024-09-12T02:46:40.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.435+0000 7f3506400640 1 -- 172.21.15.112:0/768650365 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3500154070 con 0x7f3500152a70 2024-09-12T02:46:40.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.437+0000 7f3506400640 1 -- 172.21.15.112:0/768650365 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3500068a30 con 0x7f3500152a70 2024-09-12T02:46:40.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.437+0000 7f34f7e00640 1 -- 172.21.15.112:0/768650365 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f34f8015810 con 0x7f3500152a70 2024-09-12T02:46:40.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.438+0000 7f34f7e00640 1 --2- 172.21.15.112:0/768650365 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f34dc06be60 0x7f34dc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:40.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.438+0000 7f34f7e00640 1 -- 172.21.15.112:0/768650365 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5709+0+0 (secure 0 0 0) 0x7f34f808b6f0 con 0x7f3500152a70 2024-09-12T02:46:40.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.438+0000 7f34ff400640 1 --2- 172.21.15.112:0/768650365 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f34dc06be60 0x7f34dc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:40.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.439+0000 7f34ff400640 1 --2- 172.21.15.112:0/768650365 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f34dc06be60 0x7f34dc06e320 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f34f00018a0 tx=0x7f34f0001e00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:40.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.442+0000 7f34f7e00640 1 -- 172.21.15.112:0/768650365 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f34f8010040 con 0x7f3500152a70 2024-09-12T02:46:40.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.648+0000 7f3506400640 1 -- 172.21.15.112:0/768650365 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f350006dbc0 con 0x7f3500152a70 2024-09-12T02:46:40.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.649+0000 7f34f7e00640 1 -- 172.21.15.112:0/768650365 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5234 (secure 0 0 0) 0x7f34f80599b0 con 0x7f3500152a70 2024-09-12T02:46:40.650 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:46:40.651 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":53,"btime":"2024-09-12T02:46:40:250353+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1897464411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1897464411},{"type":"v1","addr":"172.21.15.137:6834","nonce":1897464411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":5785,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3500913266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3500913266},{"type":"v1","addr":"172.21.15.137:6835","nonce":3500913266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":6144,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/611029461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":611029461},{"type":"v1","addr":"172.21.15.112:6836","nonce":611029461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:46:36.623382+0000","modified":"2024-09-12T02:46:39.653409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6150":{"gid":6150,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/1018665478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1018665478},{"type":"v1","addr":"172.21.15.112:6837","nonce":1018665478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6150,"qdb_cluster":[6150]},"id":6}]} 2024-09-12T02:46:40.651 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 53 2024-09-12T02:46:40.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.651+0000 7f3506400640 1 -- 172.21.15.112:0/768650365 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f34dc06be60 msgr2=0x7f34dc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:40.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.651+0000 7f3506400640 1 --2- 172.21.15.112:0/768650365 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f34dc06be60 0x7f34dc06e320 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f34f00018a0 tx=0x7f34f0001e00 comp rx=0 tx=0).stop 2024-09-12T02:46:40.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.651+0000 7f3506400640 1 -- 172.21.15.112:0/768650365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3500152a70 msgr2=0x7f3500159300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:40.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.651+0000 7f3506400640 1 --2- 172.21.15.112:0/768650365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3500152a70 0x7f3500159300 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f350006d260 tx=0x7f34f800f580 comp rx=0 tx=0).stop 2024-09-12T02:46:40.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.651+0000 7f3506400640 1 -- 172.21.15.112:0/768650365 shutdown_connections 2024-09-12T02:46:40.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.651+0000 7f3506400640 1 --2- 172.21.15.112:0/768650365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3500152a70 0x7f3500159300 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:40.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.651+0000 7f3506400640 1 --2- 172.21.15.112:0/768650365 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f35001525f0 0x7f3500158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:40.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.651+0000 7f3506400640 1 --2- 172.21.15.112:0/768650365 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f34dc06be60 0x7f34dc06e320 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:40.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.651+0000 7f3506400640 1 --2- 172.21.15.112:0/768650365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34e4003f80 0x7f350014f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:40.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.651+0000 7f3506400640 1 -- 172.21.15.112:0/768650365 >> 172.21.15.112:0/768650365 conn(0x7f350006bbd0 msgr2=0x7f35000d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:40.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.651+0000 7f3506400640 1 -- 172.21.15.112:0/768650365 shutdown_connections 2024-09-12T02:46:40.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.651+0000 7f3506400640 1 -- 172.21.15.112:0/768650365 wait complete. 2024-09-12T02:46:40.668 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:46:40.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.820+0000 7fe6f3800640 1 Processor -- start 2024-09-12T02:46:40.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.820+0000 7fe6f3800640 1 -- start start 2024-09-12T02:46:40.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.821+0000 7fe6f3800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe6ec15cc50 0x7fe6ec0732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:40.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.821+0000 7fe6f3800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ec073830 con 0x7fe6ec071530 2024-09-12T02:46:40.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.821+0000 7fe6f3800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ec0ceeb0 con 0x7fe6ec0afe30 2024-09-12T02:46:40.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.821+0000 7fe6f3800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe6ec15d030 con 0x7fe6ec15cc50 2024-09-12T02:46:40.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.821+0000 7fe6f0e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe6ec15cc50 0x7fe6ec0732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:40.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.822+0000 7fe6f0e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe6ec15cc50 0x7fe6ec0732f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37062/0 (socket says 172.21.15.112:37062) 2024-09-12T02:46:40.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.822+0000 7fe6f0e00640 1 -- 172.21.15.112:0/2870155993 learned_addr learned my addr 172.21.15.112:0/2870155993 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:40.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.822+0000 7fe6f0e00640 1 -- 172.21.15.112:0/2870155993 >> v1:172.21.15.137:6789/0 conn(0x7fe6ec0afe30 legacy=0x7fe6ec0cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:40.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.822+0000 7fe6f0e00640 1 -- 172.21.15.112:0/2870155993 >> v1:172.21.15.112:6789/0 conn(0x7fe6ec071530 legacy=0x7fe6ec0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:40.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.822+0000 7fe6f0e00640 1 -- 172.21.15.112:0/2870155993 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ec06e300 con 0x7fe6ec15cc50 2024-09-12T02:46:40.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.823+0000 7fe6f0e00640 1 --2- 172.21.15.112:0/2870155993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6ec15cc50 0x7fe6ec0732f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0009870 tx=0x7fe6e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae088ec6af9598e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:40.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.823+0000 7fe6eb400640 1 -- 172.21.15.112:0/2870155993 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0037070 con 0x7fe6ec15cc50 2024-09-12T02:46:40.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.823+0000 7fe6eb400640 1 -- 172.21.15.112:0/2870155993 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6e0032440 con 0x7fe6ec15cc50 2024-09-12T02:46:40.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.823+0000 7fe6eb400640 1 -- 172.21.15.112:0/2870155993 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0032810 con 0x7fe6ec15cc50 2024-09-12T02:46:40.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.824+0000 7fe6f3800640 1 -- 172.21.15.112:0/2870155993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6ec15cc50 msgr2=0x7fe6ec0732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:40.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.824+0000 7fe6f3800640 1 --2- 172.21.15.112:0/2870155993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6ec15cc50 0x7fe6ec0732f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0009870 tx=0x7fe6e002a270 comp rx=0 tx=0).stop 2024-09-12T02:46:40.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.824+0000 7fe6f3800640 1 -- 172.21.15.112:0/2870155993 shutdown_connections 2024-09-12T02:46:40.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.824+0000 7fe6f3800640 1 --2- 172.21.15.112:0/2870155993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6ec15cc50 0x7fe6ec0732f0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:40.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.824+0000 7fe6f3800640 1 -- 172.21.15.112:0/2870155993 >> 172.21.15.112:0/2870155993 conn(0x7fe6ec06bbd0 msgr2=0x7fe6ec06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:40.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.824+0000 7fe6f3800640 1 -- 172.21.15.112:0/2870155993 shutdown_connections 2024-09-12T02:46:40.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.824+0000 7fe6f3800640 1 -- 172.21.15.112:0/2870155993 wait complete. 2024-09-12T02:46:40.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.825+0000 7fe6f3800640 1 Processor -- start 2024-09-12T02:46:40.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.826+0000 7fe6f3800640 1 -- start start 2024-09-12T02:46:40.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.826+0000 7fe6f3800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6ec071530 0x7fe6ec156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:40.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.826+0000 7fe6f3800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ec0afe30 0x7fe6ec1519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:40.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.827+0000 7fe6f3800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6ec15cc50 0x7fe6ec145490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:40.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.827+0000 7fe6f3800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec0cf150 con 0x7fe6ec15cc50 2024-09-12T02:46:40.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.827+0000 7fe6f3800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec0cf4c0 con 0x7fe6ec0afe30 2024-09-12T02:46:40.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.827+0000 7fe6f3800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe6ec06f510 con 0x7fe6ec071530 2024-09-12T02:46:40.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.827+0000 7fe6f1800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6ec15cc50 0x7fe6ec145490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:40.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.827+0000 7fe6f1800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6ec15cc50 0x7fe6ec145490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37074/0 (socket says 172.21.15.112:37074) 2024-09-12T02:46:40.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.827+0000 7fe6f1800640 1 -- 172.21.15.112:0/1232558045 learned_addr learned my addr 172.21.15.112:0/1232558045 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:40.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.827+0000 7fe6f0e00640 1 --2- 172.21.15.112:0/1232558045 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6ec071530 0x7fe6ec156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:40.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.827+0000 7fe6ebe00640 1 --2- 172.21.15.112:0/1232558045 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ec0afe30 0x7fe6ec1519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:40.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.827+0000 7fe6f1800640 1 -- 172.21.15.112:0/1232558045 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6ec071530 msgr2=0x7fe6ec156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:40.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.827+0000 7fe6f1800640 1 --2- 172.21.15.112:0/1232558045 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6ec071530 0x7fe6ec156ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:40.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.827+0000 7fe6f1800640 1 -- 172.21.15.112:0/1232558045 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ec0afe30 msgr2=0x7fe6ec1519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:40.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.827+0000 7fe6f1800640 1 --2- 172.21.15.112:0/1232558045 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ec0afe30 0x7fe6ec1519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:40.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.827+0000 7fe6f1800640 1 -- 172.21.15.112:0/1232558045 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ec154530 con 0x7fe6ec15cc50 2024-09-12T02:46:40.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.827+0000 7fe6f1800640 1 --2- 172.21.15.112:0/1232558045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6ec15cc50 0x7fe6ec145490 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400c730 tx=0x7fe6e400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:40.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.828+0000 7fe6e8c00640 1 -- 172.21.15.112:0/1232558045 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4003b70 con 0x7fe6ec15cc50 2024-09-12T02:46:40.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.828+0000 7fe6e8c00640 1 -- 172.21.15.112:0/1232558045 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6e4003d10 con 0x7fe6ec15cc50 2024-09-12T02:46:40.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.828+0000 7fe6f3800640 1 -- 172.21.15.112:0/1232558045 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6ec152210 con 0x7fe6ec15cc50 2024-09-12T02:46:40.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.828+0000 7fe6e8c00640 1 -- 172.21.15.112:0/1232558045 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e400aa90 con 0x7fe6ec15cc50 2024-09-12T02:46:40.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.828+0000 7fe6f3800640 1 -- 172.21.15.112:0/1232558045 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6ec1527d0 con 0x7fe6ec15cc50 2024-09-12T02:46:40.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.829+0000 7fe6f3800640 1 -- 172.21.15.112:0/1232558045 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6ec06df60 con 0x7fe6ec15cc50 2024-09-12T02:46:40.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.830+0000 7fe6e8c00640 1 -- 172.21.15.112:0/1232558045 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe6e400ac30 con 0x7fe6ec15cc50 2024-09-12T02:46:40.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.831+0000 7fe6e8c00640 1 --2- 172.21.15.112:0/1232558045 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe6cc06be30 0x7fe6cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:40.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.831+0000 7fe6e8c00640 1 -- 172.21.15.112:0/1232558045 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5709+0+0 (secure 0 0 0) 0x7fe6e408ac30 con 0x7fe6ec15cc50 2024-09-12T02:46:40.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.831+0000 7fe6f0e00640 1 --2- 172.21.15.112:0/1232558045 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe6cc06be30 0x7fe6cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:40.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.831+0000 7fe6f0e00640 1 --2- 172.21.15.112:0/1232558045 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe6cc06be30 0x7fe6cc06e2f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0034000 tx=0x7fe6e002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:40.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:40.835+0000 7fe6e8c00640 1 -- 172.21.15.112:0/1232558045 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe6e4058f90 con 0x7fe6ec15cc50 2024-09-12T02:46:41.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.012+0000 7fe6f3800640 1 -- 172.21.15.112:0/1232558045 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe6ec0b0600 con 0x7fe6ec15cc50 2024-09-12T02:46:41.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.013+0000 7fe6e8c00640 1 -- 172.21.15.112:0/1232558045 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+16768 (secure 0 0 0) 0x7fe6e405d290 con 0x7fe6ec15cc50 2024-09-12T02:46:41.014 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:46:41.015 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":97,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:46:38.218410+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:46:34.392830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-12T02:46:35.615193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:46:41.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.015+0000 7fe6f3800640 1 -- 172.21.15.112:0/1232558045 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe6cc06be30 msgr2=0x7fe6cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:41.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.015+0000 7fe6f3800640 1 --2- 172.21.15.112:0/1232558045 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe6cc06be30 0x7fe6cc06e2f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0034000 tx=0x7fe6e002e000 comp rx=0 tx=0).stop 2024-09-12T02:46:41.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.015+0000 7fe6f3800640 1 -- 172.21.15.112:0/1232558045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6ec15cc50 msgr2=0x7fe6ec145490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:41.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.015+0000 7fe6f3800640 1 --2- 172.21.15.112:0/1232558045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6ec15cc50 0x7fe6ec145490 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400c730 tx=0x7fe6e400cbf0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.015+0000 7fe6f3800640 1 -- 172.21.15.112:0/1232558045 shutdown_connections 2024-09-12T02:46:41.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.015+0000 7fe6f3800640 1 --2- 172.21.15.112:0/1232558045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6ec15cc50 0x7fe6ec145490 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.015+0000 7fe6f3800640 1 --2- 172.21.15.112:0/1232558045 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe6cc06be30 0x7fe6cc06e2f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.015+0000 7fe6f3800640 1 --2- 172.21.15.112:0/1232558045 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ec0afe30 0x7fe6ec1519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.015+0000 7fe6f3800640 1 --2- 172.21.15.112:0/1232558045 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6ec071530 0x7fe6ec156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.015+0000 7fe6f3800640 1 -- 172.21.15.112:0/1232558045 >> 172.21.15.112:0/1232558045 conn(0x7fe6ec06bbd0 msgr2=0x7fe6ec0cf950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:41.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.015+0000 7fe6f3800640 1 -- 172.21.15.112:0/1232558045 shutdown_connections 2024-09-12T02:46:41.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.016+0000 7fe6f3800640 1 -- 172.21.15.112:0/1232558045 wait complete. 2024-09-12T02:46:41.034 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:46:41.035 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:46:41.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.186+0000 7fb346600640 1 Processor -- start 2024-09-12T02:46:41.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.186+0000 7fb346600640 1 -- start start 2024-09-12T02:46:41.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.187+0000 7fb346600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3400d28d0 0x7fb3400b2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:41.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.187+0000 7fb346600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3400d2fb0 con 0x7fb3400d1710 2024-09-12T02:46:41.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.187+0000 7fb346600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3400d0b60 con 0x7fb3400b3e00 2024-09-12T02:46:41.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.187+0000 7fb346600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb3400d3cb0 con 0x7fb3400d28d0 2024-09-12T02:46:41.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.187+0000 7fb345200640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb3400d1710 0x7fb3400d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55614/0 (socket says 172.21.15.112:55614) 2024-09-12T02:46:41.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.187+0000 7fb345200640 1 -- 172.21.15.112:0/1576364258 learned_addr learned my addr 172.21.15.112:0/1576364258 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:46:41.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.188+0000 7fb33f400640 1 -- 172.21.15.112:0/1576364258 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2968848880 0 0) 0x7fb3400d2fb0 con 0x7fb3400d1710 2024-09-12T02:46:41.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.188+0000 7fb33f400640 1 -- 172.21.15.112:0/1576364258 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb328003520 con 0x7fb3400d1710 2024-09-12T02:46:41.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.188+0000 7fb345c00640 1 --2- 172.21.15.112:0/1576364258 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3400d28d0 0x7fb3400b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:41.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.188+0000 7fb33f400640 1 -- 172.21.15.112:0/1576364258 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2775455845 0 0) 0x7fb328003520 con 0x7fb3400d1710 2024-09-12T02:46:41.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.188+0000 7fb33f400640 1 -- 172.21.15.112:0/1576364258 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3400d28d0 msgr2=0x7fb3400b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:41.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.188+0000 7fb33f400640 1 --2- 172.21.15.112:0/1576364258 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3400d28d0 0x7fb3400b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.188+0000 7fb33f400640 1 -- 172.21.15.112:0/1576364258 >> v1:172.21.15.137:6789/0 conn(0x7fb3400b3e00 legacy=0x7fb3400b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:41.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.188+0000 7fb33f400640 1 -- 172.21.15.112:0/1576364258 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3400d3410 con 0x7fb3400d1710 2024-09-12T02:46:41.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.188+0000 7fb33f400640 1 -- 172.21.15.112:0/1576364258 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7fb334001670 con 0x7fb3400d1710 2024-09-12T02:46:41.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.188+0000 7fb33f400640 1 -- 172.21.15.112:0/1576364258 >> v1:172.21.15.112:6789/0 conn(0x7fb3400d1710 legacy=0x7fb3400d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:41.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.188+0000 7fb33f400640 1 --2- 172.21.15.112:0/1576364258 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3280039e0 0x7fb328003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:41.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.188+0000 7fb33f400640 1 --2- 172.21.15.112:0/1576364258 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3400d28d0 0x7fb328004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:41.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.188+0000 7fb33f400640 1 --2- 172.21.15.112:0/1576364258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb328004d40 0x7fb3280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:41.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.188+0000 7fb33f400640 1 -- 172.21.15.112:0/1576364258 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb3400d3cb0 con 0x7fb3280039e0 2024-09-12T02:46:41.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.188+0000 7fb33f400640 1 -- 172.21.15.112:0/1576364258 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb32800baa0 con 0x7fb328004d40 2024-09-12T02:46:41.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.188+0000 7fb33f400640 1 -- 172.21.15.112:0/1576364258 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb32800bca0 con 0x7fb3400d28d0 2024-09-12T02:46:41.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.189+0000 7fb345200640 1 --2- 172.21.15.112:0/1576364258 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3280039e0 0x7fb328003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:41.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.189+0000 7fb33fe00640 1 --2- 172.21.15.112:0/1576364258 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3400d28d0 0x7fb328004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:41.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.189+0000 7fb345c00640 1 --2- 172.21.15.112:0/1576364258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb328004d40 0x7fb3280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:41.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.189+0000 7fb345200640 1 -- 172.21.15.112:0/1576364258 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3400d28d0 msgr2=0x7fb328004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:41.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.189+0000 7fb345200640 1 --2- 172.21.15.112:0/1576364258 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3400d28d0 0x7fb328004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.189+0000 7fb345200640 1 -- 172.21.15.112:0/1576364258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb328004d40 msgr2=0x7fb3280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:41.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.189+0000 7fb345200640 1 --2- 172.21.15.112:0/1576364258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb328004d40 0x7fb3280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.189+0000 7fb345200640 1 -- 172.21.15.112:0/1576364258 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb328003520 con 0x7fb3280039e0 2024-09-12T02:46:41.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.190+0000 7fb345200640 1 --2- 172.21.15.112:0/1576364258 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3280039e0 0x7fb328003e00 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb334001eb0 tx=0x7fb328005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a291a8ef87a2d01 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:41.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.190+0000 7fb33f400640 1 -- 172.21.15.112:0/1576364258 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb334007d30 con 0x7fb3280039e0 2024-09-12T02:46:41.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.190+0000 7fb33f400640 1 -- 172.21.15.112:0/1576364258 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3340058d0 con 0x7fb3280039e0 2024-09-12T02:46:41.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.190+0000 7fb33f400640 1 -- 172.21.15.112:0/1576364258 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb334005ce0 con 0x7fb3280039e0 2024-09-12T02:46:41.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.191+0000 7fb346600640 1 -- 172.21.15.112:0/1576364258 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3280039e0 msgr2=0x7fb328003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:41.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.191+0000 7fb346600640 1 --2- 172.21.15.112:0/1576364258 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3280039e0 0x7fb328003e00 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb334001eb0 tx=0x7fb328005830 comp rx=0 tx=0).stop 2024-09-12T02:46:41.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.191+0000 7fb345c00640 1 -- 172.21.15.112:0/1576364258 reap_dead start 2024-09-12T02:46:41.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.191+0000 7fb346600640 1 -- 172.21.15.112:0/1576364258 shutdown_connections 2024-09-12T02:46:41.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.191+0000 7fb346600640 1 -- 172.21.15.112:0/1576364258 >> 172.21.15.112:0/1576364258 conn(0x7fb34009e030 msgr2=0x7fb3400d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:41.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.191+0000 7fb346600640 1 -- 172.21.15.112:0/1576364258 shutdown_connections 2024-09-12T02:46:41.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.191+0000 7fb346600640 1 -- 172.21.15.112:0/1576364258 wait complete. 2024-09-12T02:46:41.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.192+0000 7fb346600640 1 Processor -- start 2024-09-12T02:46:41.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.193+0000 7fb346600640 1 -- start start 2024-09-12T02:46:41.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.193+0000 7fb346600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3280039e0 0x7fb3400cae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:41.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.193+0000 7fb346600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb34015b100 0x7fb340156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:41.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.193+0000 7fb346600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3400b4330 0x7fb3400b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:41.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.194+0000 7fb346600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb3400d39d0 con 0x7fb3400b4330 2024-09-12T02:46:41.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.194+0000 7fb346600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb3400d2d60 con 0x7fb34015b100 2024-09-12T02:46:41.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.194+0000 7fb346600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb34015f110 con 0x7fb3280039e0 2024-09-12T02:46:41.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.194+0000 7fb345c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3400b4330 0x7fb3400b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:41.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.194+0000 7fb345200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3280039e0 0x7fb3400cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:41.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.194+0000 7fb345c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3400b4330 0x7fb3400b47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37092/0 (socket says 172.21.15.112:37092) 2024-09-12T02:46:41.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.194+0000 7fb345c00640 1 -- 172.21.15.112:0/344828571 learned_addr learned my addr 172.21.15.112:0/344828571 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:41.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.194+0000 7fb33fe00640 1 --2- 172.21.15.112:0/344828571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb34015b100 0x7fb340156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:41.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.194+0000 7fb345c00640 1 -- 172.21.15.112:0/344828571 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3280039e0 msgr2=0x7fb3400cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:41.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.194+0000 7fb345c00640 1 --2- 172.21.15.112:0/344828571 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3280039e0 0x7fb3400cae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.194+0000 7fb345c00640 1 -- 172.21.15.112:0/344828571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb34015b100 msgr2=0x7fb340156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:41.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.194+0000 7fb345c00640 1 --2- 172.21.15.112:0/344828571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb34015b100 0x7fb340156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.194+0000 7fb345c00640 1 -- 172.21.15.112:0/344828571 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb34015b870 con 0x7fb3400b4330 2024-09-12T02:46:41.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.194+0000 7fb345c00640 1 --2- 172.21.15.112:0/344828571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3400b4330 0x7fb3400b47e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb3400b4300 tx=0x7fb33800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:41.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.195+0000 7fb33cc00640 1 -- 172.21.15.112:0/344828571 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33800fe10 con 0x7fb3400b4330 2024-09-12T02:46:41.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.195+0000 7fb33cc00640 1 -- 172.21.15.112:0/344828571 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb338015430 con 0x7fb3400b4330 2024-09-12T02:46:41.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.195+0000 7fb346600640 1 -- 172.21.15.112:0/344828571 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb34015bb50 con 0x7fb3400b4330 2024-09-12T02:46:41.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.195+0000 7fb33cc00640 1 -- 172.21.15.112:0/344828571 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb338015820 con 0x7fb3400b4330 2024-09-12T02:46:41.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.195+0000 7fb346600640 1 -- 172.21.15.112:0/344828571 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb340159f50 con 0x7fb3400b4330 2024-09-12T02:46:41.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.196+0000 7fb346600640 1 -- 172.21.15.112:0/344828571 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb34015a150 con 0x7fb3400b4330 2024-09-12T02:46:41.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.197+0000 7fb33cc00640 1 -- 172.21.15.112:0/344828571 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb3380159c0 con 0x7fb3400b4330 2024-09-12T02:46:41.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.198+0000 7fb33cc00640 1 --2- 172.21.15.112:0/344828571 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb32006be60 0x7fb32006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:41.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.198+0000 7fb33cc00640 1 -- 172.21.15.112:0/344828571 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5709+0+0 (secure 0 0 0) 0x7fb33808bb10 con 0x7fb3400b4330 2024-09-12T02:46:41.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.198+0000 7fb345200640 1 --2- 172.21.15.112:0/344828571 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb32006be60 0x7fb32006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:41.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.199+0000 7fb345200640 1 --2- 172.21.15.112:0/344828571 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb32006be60 0x7fb32006e320 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb334033000 tx=0x7fb334035040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:41.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.202+0000 7fb33cc00640 1 -- 172.21.15.112:0/344828571 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb34015a150 con 0x7fb3400b4330 2024-09-12T02:46:41.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.376+0000 7fb346600640 1 -- 172.21.15.112:0/344828571 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb3400d1af0 con 0x7fb32006be60 2024-09-12T02:46:41.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.382+0000 7fb33cc00640 1 -- 172.21.15.112:0/344828571 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247523 (secure 0 0 0) 0x7fb3400d1af0 con 0x7fb32006be60 2024-09-12T02:46:41.386 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:46:41.388 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:46:41.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.386+0000 7fb346600640 1 -- 172.21.15.112:0/344828571 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb32006be60 msgr2=0x7fb32006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:41.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.386+0000 7fb346600640 1 --2- 172.21.15.112:0/344828571 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb32006be60 0x7fb32006e320 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb334033000 tx=0x7fb334035040 comp rx=0 tx=0).stop 2024-09-12T02:46:41.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.386+0000 7fb346600640 1 -- 172.21.15.112:0/344828571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3400b4330 msgr2=0x7fb3400b47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:41.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.386+0000 7fb346600640 1 --2- 172.21.15.112:0/344828571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3400b4330 0x7fb3400b47e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb3400b4300 tx=0x7fb33800f580 comp rx=0 tx=0).stop 2024-09-12T02:46:41.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.386+0000 7fb346600640 1 -- 172.21.15.112:0/344828571 shutdown_connections 2024-09-12T02:46:41.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.386+0000 7fb346600640 1 --2- 172.21.15.112:0/344828571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3400b4330 0x7fb3400b47e0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.386+0000 7fb346600640 1 --2- 172.21.15.112:0/344828571 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb32006be60 0x7fb32006e320 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.386+0000 7fb346600640 1 --2- 172.21.15.112:0/344828571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb34015b100 0x7fb340156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.386+0000 7fb346600640 1 --2- 172.21.15.112:0/344828571 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3280039e0 0x7fb3400cae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.386+0000 7fb346600640 1 -- 172.21.15.112:0/344828571 >> 172.21.15.112:0/344828571 conn(0x7fb34009e030 msgr2=0x7fb3400cf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:41.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.386+0000 7fb346600640 1 -- 172.21.15.112:0/344828571 shutdown_connections 2024-09-12T02:46:41.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.387+0000 7fb346600640 1 -- 172.21.15.112:0/344828571 wait complete. 2024-09-12T02:46:41.403 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":238,"stamp":"2024-09-12T02:46:41.022852+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5171,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557328,"statfs":{"total":1600000000,"available":1594703956,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.814328"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.233048+0000","last_change":"2024-09-12T02:46:37.232841+0000","last_active":"2024-09-12T02:46:37.233048+0000","last_peered":"2024-09-12T02:46:37.233048+0000","last_clean":"2024-09-12T02:46:37.233048+0000","last_became_active":"2024-09-12T02:46:37.232064+0000","last_became_peered":"2024-09-12T02:46:37.232064+0000","last_unstale":"2024-09-12T02:46:37.233048+0000","last_undegraded":"2024-09-12T02:46:37.233048+0000","last_fullsized":"2024-09-12T02:46:37.233048+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:26.894173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.236314+0000","last_change":"2024-09-12T02:46:37.234712+0000","last_active":"2024-09-12T02:46:37.236314+0000","last_peered":"2024-09-12T02:46:37.236314+0000","last_clean":"2024-09-12T02:46:37.236314+0000","last_became_active":"2024-09-12T02:46:37.233847+0000","last_became_peered":"2024-09-12T02:46:37.233847+0000","last_unstale":"2024-09-12T02:46:37.236314+0000","last_undegraded":"2024-09-12T02:46:37.236314+0000","last_fullsized":"2024-09-12T02:46:37.236314+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:33:37.099814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.236016+0000","last_change":"2024-09-12T02:46:37.235338+0000","last_active":"2024-09-12T02:46:37.236016+0000","last_peered":"2024-09-12T02:46:37.236016+0000","last_clean":"2024-09-12T02:46:37.236016+0000","last_became_active":"2024-09-12T02:46:37.234425+0000","last_became_peered":"2024-09-12T02:46:37.234425+0000","last_unstale":"2024-09-12T02:46:37.236016+0000","last_undegraded":"2024-09-12T02:46:37.236016+0000","last_fullsized":"2024-09-12T02:46:37.236016+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:28.370452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.232482+0000","last_change":"2024-09-12T02:46:37.232336+0000","last_active":"2024-09-12T02:46:37.232482+0000","last_peered":"2024-09-12T02:46:37.232482+0000","last_clean":"2024-09-12T02:46:37.232482+0000","last_became_active":"2024-09-12T02:46:37.230054+0000","last_became_peered":"2024-09-12T02:46:37.230054+0000","last_unstale":"2024-09-12T02:46:37.232482+0000","last_undegraded":"2024-09-12T02:46:37.232482+0000","last_fullsized":"2024-09-12T02:46:37.232482+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:41.363182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.239109+0000","last_change":"2024-09-12T02:46:37.238988+0000","last_active":"2024-09-12T02:46:37.239109+0000","last_peered":"2024-09-12T02:46:37.239109+0000","last_clean":"2024-09-12T02:46:37.239109+0000","last_became_active":"2024-09-12T02:46:37.238732+0000","last_became_peered":"2024-09-12T02:46:37.238732+0000","last_unstale":"2024-09-12T02:46:37.239109+0000","last_undegraded":"2024-09-12T02:46:37.239109+0000","last_fullsized":"2024-09-12T02:46:37.239109+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:13.696027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.237415+0000","last_change":"2024-09-12T02:46:37.235451+0000","last_active":"2024-09-12T02:46:37.237415+0000","last_peered":"2024-09-12T02:46:37.237415+0000","last_clean":"2024-09-12T02:46:37.237415+0000","last_became_active":"2024-09-12T02:46:37.233775+0000","last_became_peered":"2024-09-12T02:46:37.233775+0000","last_unstale":"2024-09-12T02:46:37.237415+0000","last_undegraded":"2024-09-12T02:46:37.237415+0000","last_fullsized":"2024-09-12T02:46:37.237415+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:59.564683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.232134+0000","last_change":"2024-09-12T02:46:37.231757+0000","last_active":"2024-09-12T02:46:37.232134+0000","last_peered":"2024-09-12T02:46:37.232134+0000","last_clean":"2024-09-12T02:46:37.232134+0000","last_became_active":"2024-09-12T02:46:37.231434+0000","last_became_peered":"2024-09-12T02:46:37.231434+0000","last_unstale":"2024-09-12T02:46:37.232134+0000","last_undegraded":"2024-09-12T02:46:37.232134+0000","last_fullsized":"2024-09-12T02:46:37.232134+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:17.338161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.232373+0000","last_change":"2024-09-12T02:46:37.232157+0000","last_active":"2024-09-12T02:46:37.232373+0000","last_peered":"2024-09-12T02:46:37.232373+0000","last_clean":"2024-09-12T02:46:37.232373+0000","last_became_active":"2024-09-12T02:46:37.231906+0000","last_became_peered":"2024-09-12T02:46:37.231906+0000","last_unstale":"2024-09-12T02:46:37.232373+0000","last_undegraded":"2024-09-12T02:46:37.232373+0000","last_fullsized":"2024-09-12T02:46:37.232373+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:25.743940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.231440+0000","last_change":"2024-09-12T02:46:37.231142+0000","last_active":"2024-09-12T02:46:37.231440+0000","last_peered":"2024-09-12T02:46:37.231440+0000","last_clean":"2024-09-12T02:46:37.231440+0000","last_became_active":"2024-09-12T02:46:37.230906+0000","last_became_peered":"2024-09-12T02:46:37.230906+0000","last_unstale":"2024-09-12T02:46:37.231440+0000","last_undegraded":"2024-09-12T02:46:37.231440+0000","last_fullsized":"2024-09-12T02:46:37.231440+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:04.667906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.223517+0000","last_change":"2024-09-12T02:46:37.223110+0000","last_active":"2024-09-12T02:46:37.223517+0000","last_peered":"2024-09-12T02:46:37.223517+0000","last_clean":"2024-09-12T02:46:37.223517+0000","last_became_active":"2024-09-12T02:46:37.222694+0000","last_became_peered":"2024-09-12T02:46:37.222694+0000","last_unstale":"2024-09-12T02:46:37.223517+0000","last_undegraded":"2024-09-12T02:46:37.223517+0000","last_fullsized":"2024-09-12T02:46:37.223517+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:51.969455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.236767+0000","last_change":"2024-09-12T02:46:37.235935+0000","last_active":"2024-09-12T02:46:37.236767+0000","last_peered":"2024-09-12T02:46:37.236767+0000","last_clean":"2024-09-12T02:46:37.236767+0000","last_became_active":"2024-09-12T02:46:37.235169+0000","last_became_peered":"2024-09-12T02:46:37.235169+0000","last_unstale":"2024-09-12T02:46:37.236767+0000","last_undegraded":"2024-09-12T02:46:37.236767+0000","last_fullsized":"2024-09-12T02:46:37.236767+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:13.794267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.222634+0000","last_change":"2024-09-12T02:46:37.222500+0000","last_active":"2024-09-12T02:46:37.222634+0000","last_peered":"2024-09-12T02:46:37.222634+0000","last_clean":"2024-09-12T02:46:37.222634+0000","last_became_active":"2024-09-12T02:46:37.222213+0000","last_became_peered":"2024-09-12T02:46:37.222213+0000","last_unstale":"2024-09-12T02:46:37.222634+0000","last_undegraded":"2024-09-12T02:46:37.222634+0000","last_fullsized":"2024-09-12T02:46:37.222634+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:12.657311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.238120+0000","last_change":"2024-09-12T02:46:37.237861+0000","last_active":"2024-09-12T02:46:37.238120+0000","last_peered":"2024-09-12T02:46:37.238120+0000","last_clean":"2024-09-12T02:46:37.238120+0000","last_became_active":"2024-09-12T02:46:37.237618+0000","last_became_peered":"2024-09-12T02:46:37.237618+0000","last_unstale":"2024-09-12T02:46:37.238120+0000","last_undegraded":"2024-09-12T02:46:37.238120+0000","last_fullsized":"2024-09-12T02:46:37.238120+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:04.842956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.230603+0000","last_change":"2024-09-12T02:46:37.230450+0000","last_active":"2024-09-12T02:46:37.230603+0000","last_peered":"2024-09-12T02:46:37.230603+0000","last_clean":"2024-09-12T02:46:37.230603+0000","last_became_active":"2024-09-12T02:46:37.229774+0000","last_became_peered":"2024-09-12T02:46:37.229774+0000","last_unstale":"2024-09-12T02:46:37.230603+0000","last_undegraded":"2024-09-12T02:46:37.230603+0000","last_fullsized":"2024-09-12T02:46:37.230603+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:42.707681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.235030+0000","last_change":"2024-09-12T02:46:37.233951+0000","last_active":"2024-09-12T02:46:37.235030+0000","last_peered":"2024-09-12T02:46:37.235030+0000","last_clean":"2024-09-12T02:46:37.235030+0000","last_became_active":"2024-09-12T02:46:37.233714+0000","last_became_peered":"2024-09-12T02:46:37.233714+0000","last_unstale":"2024-09-12T02:46:37.235030+0000","last_undegraded":"2024-09-12T02:46:37.235030+0000","last_fullsized":"2024-09-12T02:46:37.235030+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:14.722250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.236842+0000","last_change":"2024-09-12T02:46:37.236069+0000","last_active":"2024-09-12T02:46:37.236842+0000","last_peered":"2024-09-12T02:46:37.236842+0000","last_clean":"2024-09-12T02:46:37.236842+0000","last_became_active":"2024-09-12T02:46:37.234141+0000","last_became_peered":"2024-09-12T02:46:37.234141+0000","last_unstale":"2024-09-12T02:46:37.236842+0000","last_undegraded":"2024-09-12T02:46:37.236842+0000","last_fullsized":"2024-09-12T02:46:37.236842+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:19:29.876850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.236810+0000","last_change":"2024-09-12T02:46:37.235344+0000","last_active":"2024-09-12T02:46:37.236810+0000","last_peered":"2024-09-12T02:46:37.236810+0000","last_clean":"2024-09-12T02:46:37.236810+0000","last_became_active":"2024-09-12T02:46:37.234569+0000","last_became_peered":"2024-09-12T02:46:37.234569+0000","last_unstale":"2024-09-12T02:46:37.236810+0000","last_undegraded":"2024-09-12T02:46:37.236810+0000","last_fullsized":"2024-09-12T02:46:37.236810+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:48.247538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.226323+0000","last_change":"2024-09-12T02:46:37.225945+0000","last_active":"2024-09-12T02:46:37.226323+0000","last_peered":"2024-09-12T02:46:37.226323+0000","last_clean":"2024-09-12T02:46:37.226323+0000","last_became_active":"2024-09-12T02:46:37.225712+0000","last_became_peered":"2024-09-12T02:46:37.225712+0000","last_unstale":"2024-09-12T02:46:37.226323+0000","last_undegraded":"2024-09-12T02:46:37.226323+0000","last_fullsized":"2024-09-12T02:46:37.226323+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:11.114696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.229234+0000","last_change":"2024-09-12T02:46:37.229015+0000","last_active":"2024-09-12T02:46:37.229234+0000","last_peered":"2024-09-12T02:46:37.229234+0000","last_clean":"2024-09-12T02:46:37.229234+0000","last_became_active":"2024-09-12T02:46:37.228159+0000","last_became_peered":"2024-09-12T02:46:37.228159+0000","last_unstale":"2024-09-12T02:46:37.229234+0000","last_undegraded":"2024-09-12T02:46:37.229234+0000","last_fullsized":"2024-09-12T02:46:37.229234+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:10.039467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.226660+0000","last_change":"2024-09-12T02:46:37.226390+0000","last_active":"2024-09-12T02:46:37.226660+0000","last_peered":"2024-09-12T02:46:37.226660+0000","last_clean":"2024-09-12T02:46:37.226660+0000","last_became_active":"2024-09-12T02:46:37.225019+0000","last_became_peered":"2024-09-12T02:46:37.225019+0000","last_unstale":"2024-09-12T02:46:37.226660+0000","last_undegraded":"2024-09-12T02:46:37.226660+0000","last_fullsized":"2024-09-12T02:46:37.226660+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:28.010732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.226636+0000","last_change":"2024-09-12T02:46:37.226272+0000","last_active":"2024-09-12T02:46:37.226636+0000","last_peered":"2024-09-12T02:46:37.226636+0000","last_clean":"2024-09-12T02:46:37.226636+0000","last_became_active":"2024-09-12T02:46:37.226043+0000","last_became_peered":"2024-09-12T02:46:37.226043+0000","last_unstale":"2024-09-12T02:46:37.226636+0000","last_undegraded":"2024-09-12T02:46:37.226636+0000","last_fullsized":"2024-09-12T02:46:37.226636+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:41.406457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.236264+0000","last_change":"2024-09-12T02:46:37.234531+0000","last_active":"2024-09-12T02:46:37.236264+0000","last_peered":"2024-09-12T02:46:37.236264+0000","last_clean":"2024-09-12T02:46:37.236264+0000","last_became_active":"2024-09-12T02:46:37.233608+0000","last_became_peered":"2024-09-12T02:46:37.233608+0000","last_unstale":"2024-09-12T02:46:37.236264+0000","last_undegraded":"2024-09-12T02:46:37.236264+0000","last_fullsized":"2024-09-12T02:46:37.236264+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:24.820842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.226475+0000","last_change":"2024-09-12T02:46:37.226302+0000","last_active":"2024-09-12T02:46:37.226475+0000","last_peered":"2024-09-12T02:46:37.226475+0000","last_clean":"2024-09-12T02:46:37.226475+0000","last_became_active":"2024-09-12T02:46:37.225769+0000","last_became_peered":"2024-09-12T02:46:37.225769+0000","last_unstale":"2024-09-12T02:46:37.226475+0000","last_undegraded":"2024-09-12T02:46:37.226475+0000","last_fullsized":"2024-09-12T02:46:37.226475+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:04.390339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.227623+0000","last_change":"2024-09-12T02:46:37.227189+0000","last_active":"2024-09-12T02:46:37.227623+0000","last_peered":"2024-09-12T02:46:37.227623+0000","last_clean":"2024-09-12T02:46:37.227623+0000","last_became_active":"2024-09-12T02:46:37.226746+0000","last_became_peered":"2024-09-12T02:46:37.226746+0000","last_unstale":"2024-09-12T02:46:37.227623+0000","last_undegraded":"2024-09-12T02:46:37.227623+0000","last_fullsized":"2024-09-12T02:46:37.227623+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:38.957540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.233103+0000","last_change":"2024-09-12T02:46:37.230732+0000","last_active":"2024-09-12T02:46:37.233103+0000","last_peered":"2024-09-12T02:46:37.233103+0000","last_clean":"2024-09-12T02:46:37.233103+0000","last_became_active":"2024-09-12T02:46:37.230226+0000","last_became_peered":"2024-09-12T02:46:37.230226+0000","last_unstale":"2024-09-12T02:46:37.233103+0000","last_undegraded":"2024-09-12T02:46:37.233103+0000","last_fullsized":"2024-09-12T02:46:37.233103+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:31.700760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.237507+0000","last_change":"2024-09-12T02:46:37.237378+0000","last_active":"2024-09-12T02:46:37.237507+0000","last_peered":"2024-09-12T02:46:37.237507+0000","last_clean":"2024-09-12T02:46:37.237507+0000","last_became_active":"2024-09-12T02:46:37.237144+0000","last_became_peered":"2024-09-12T02:46:37.237144+0000","last_unstale":"2024-09-12T02:46:37.237507+0000","last_undegraded":"2024-09-12T02:46:37.237507+0000","last_fullsized":"2024-09-12T02:46:37.237507+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:12.957684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.236827+0000","last_change":"2024-09-12T02:46:37.235529+0000","last_active":"2024-09-12T02:46:37.236827+0000","last_peered":"2024-09-12T02:46:37.236827+0000","last_clean":"2024-09-12T02:46:37.236827+0000","last_became_active":"2024-09-12T02:46:37.234883+0000","last_became_peered":"2024-09-12T02:46:37.234883+0000","last_unstale":"2024-09-12T02:46:37.236827+0000","last_undegraded":"2024-09-12T02:46:37.236827+0000","last_fullsized":"2024-09-12T02:46:37.236827+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:19.843744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.232631+0000","last_change":"2024-09-12T02:46:37.231843+0000","last_active":"2024-09-12T02:46:37.232631+0000","last_peered":"2024-09-12T02:46:37.232631+0000","last_clean":"2024-09-12T02:46:37.232631+0000","last_became_active":"2024-09-12T02:46:37.231124+0000","last_became_peered":"2024-09-12T02:46:37.231124+0000","last_unstale":"2024-09-12T02:46:37.232631+0000","last_undegraded":"2024-09-12T02:46:37.232631+0000","last_fullsized":"2024-09-12T02:46:37.232631+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:10.922240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.230673+0000","last_change":"2024-09-12T02:46:37.229578+0000","last_active":"2024-09-12T02:46:37.230673+0000","last_peered":"2024-09-12T02:46:37.230673+0000","last_clean":"2024-09-12T02:46:37.230673+0000","last_became_active":"2024-09-12T02:46:37.229361+0000","last_became_peered":"2024-09-12T02:46:37.229361+0000","last_unstale":"2024-09-12T02:46:37.230673+0000","last_undegraded":"2024-09-12T02:46:37.230673+0000","last_fullsized":"2024-09-12T02:46:37.230673+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:21.423466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.236281+0000","last_change":"2024-09-12T02:46:37.232089+0000","last_active":"2024-09-12T02:46:37.236281+0000","last_peered":"2024-09-12T02:46:37.236281+0000","last_clean":"2024-09-12T02:46:37.236281+0000","last_became_active":"2024-09-12T02:46:37.230526+0000","last_became_peered":"2024-09-12T02:46:37.230526+0000","last_unstale":"2024-09-12T02:46:37.236281+0000","last_undegraded":"2024-09-12T02:46:37.236281+0000","last_fullsized":"2024-09-12T02:46:37.236281+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:57.476104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.229230+0000","last_change":"2024-09-12T02:46:37.228932+0000","last_active":"2024-09-12T02:46:37.229230+0000","last_peered":"2024-09-12T02:46:37.229230+0000","last_clean":"2024-09-12T02:46:37.229230+0000","last_became_active":"2024-09-12T02:46:37.228557+0000","last_became_peered":"2024-09-12T02:46:37.228557+0000","last_unstale":"2024-09-12T02:46:37.229230+0000","last_undegraded":"2024-09-12T02:46:37.229230+0000","last_fullsized":"2024-09-12T02:46:37.229230+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:02:48.763691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.236120+0000","last_change":"2024-09-12T02:46:37.235658+0000","last_active":"2024-09-12T02:46:37.236120+0000","last_peered":"2024-09-12T02:46:37.236120+0000","last_clean":"2024-09-12T02:46:37.236120+0000","last_became_active":"2024-09-12T02:46:37.235414+0000","last_became_peered":"2024-09-12T02:46:37.235414+0000","last_unstale":"2024-09-12T02:46:37.236120+0000","last_undegraded":"2024-09-12T02:46:37.236120+0000","last_fullsized":"2024-09-12T02:46:37.236120+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:09.317064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.234197+0000","last_change":"2024-09-12T02:46:37.233824+0000","last_active":"2024-09-12T02:46:37.234197+0000","last_peered":"2024-09-12T02:46:37.234197+0000","last_clean":"2024-09-12T02:46:37.234197+0000","last_became_active":"2024-09-12T02:46:37.233587+0000","last_became_peered":"2024-09-12T02:46:37.233587+0000","last_unstale":"2024-09-12T02:46:37.234197+0000","last_undegraded":"2024-09-12T02:46:37.234197+0000","last_fullsized":"2024-09-12T02:46:37.234197+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:20:41.222651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"96'4","reported_seq":16,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.246329+0000","last_change":"2024-09-12T02:46:36.224784+0000","last_active":"2024-09-12T02:46:37.246329+0000","last_peered":"2024-09-12T02:46:37.246329+0000","last_clean":"2024-09-12T02:46:37.246329+0000","last_became_active":"2024-09-12T02:46:36.223693+0000","last_became_peered":"2024-09-12T02:46:36.223693+0000","last_unstale":"2024-09-12T02:46:37.246329+0000","last_undegraded":"2024-09-12T02:46:37.246329+0000","last_fullsized":"2024-09-12T02:46:37.246329+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:32.885521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.226756+0000","last_change":"2024-09-12T02:46:37.226514+0000","last_active":"2024-09-12T02:46:37.226756+0000","last_peered":"2024-09-12T02:46:37.226756+0000","last_clean":"2024-09-12T02:46:37.226756+0000","last_became_active":"2024-09-12T02:46:37.226079+0000","last_became_peered":"2024-09-12T02:46:37.226079+0000","last_unstale":"2024-09-12T02:46:37.226756+0000","last_undegraded":"2024-09-12T02:46:37.226756+0000","last_fullsized":"2024-09-12T02:46:37.226756+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:00.717404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"96'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.245805+0000","last_change":"2024-09-12T02:46:36.227519+0000","last_active":"2024-09-12T02:46:37.245805+0000","last_peered":"2024-09-12T02:46:37.245805+0000","last_clean":"2024-09-12T02:46:37.245805+0000","last_became_active":"2024-09-12T02:46:36.227269+0000","last_became_peered":"2024-09-12T02:46:36.227269+0000","last_unstale":"2024-09-12T02:46:37.245805+0000","last_undegraded":"2024-09-12T02:46:37.245805+0000","last_fullsized":"2024-09-12T02:46:37.245805+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:53.528592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.232978+0000","last_change":"2024-09-12T02:46:37.232560+0000","last_active":"2024-09-12T02:46:37.232978+0000","last_peered":"2024-09-12T02:46:37.232978+0000","last_clean":"2024-09-12T02:46:37.232978+0000","last_became_active":"2024-09-12T02:46:37.229771+0000","last_became_peered":"2024-09-12T02:46:37.229771+0000","last_unstale":"2024-09-12T02:46:37.232978+0000","last_undegraded":"2024-09-12T02:46:37.232978+0000","last_fullsized":"2024-09-12T02:46:37.232978+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:00.122978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"96'2","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.245894+0000","last_change":"2024-09-12T02:46:36.232686+0000","last_active":"2024-09-12T02:46:37.245894+0000","last_peered":"2024-09-12T02:46:37.245894+0000","last_clean":"2024-09-12T02:46:37.245894+0000","last_became_active":"2024-09-12T02:46:36.232408+0000","last_became_peered":"2024-09-12T02:46:36.232408+0000","last_unstale":"2024-09-12T02:46:37.245894+0000","last_undegraded":"2024-09-12T02:46:37.245894+0000","last_fullsized":"2024-09-12T02:46:37.245894+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:03.709806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.239261+0000","last_change":"2024-09-12T02:46:37.239144+0000","last_active":"2024-09-12T02:46:37.239261+0000","last_peered":"2024-09-12T02:46:37.239261+0000","last_clean":"2024-09-12T02:46:37.239261+0000","last_became_active":"2024-09-12T02:46:37.238780+0000","last_became_peered":"2024-09-12T02:46:37.238780+0000","last_unstale":"2024-09-12T02:46:37.239261+0000","last_undegraded":"2024-09-12T02:46:37.239261+0000","last_fullsized":"2024-09-12T02:46:37.239261+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:07.423132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"96'2","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.245962+0000","last_change":"2024-09-12T02:46:36.227985+0000","last_active":"2024-09-12T02:46:37.245962+0000","last_peered":"2024-09-12T02:46:37.245962+0000","last_clean":"2024-09-12T02:46:37.245962+0000","last_became_active":"2024-09-12T02:46:36.227755+0000","last_became_peered":"2024-09-12T02:46:36.227755+0000","last_unstale":"2024-09-12T02:46:37.245962+0000","last_undegraded":"2024-09-12T02:46:37.245962+0000","last_fullsized":"2024-09-12T02:46:37.245962+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:42.091263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.230715+0000","last_change":"2024-09-12T02:46:37.230587+0000","last_active":"2024-09-12T02:46:37.230715+0000","last_peered":"2024-09-12T02:46:37.230715+0000","last_clean":"2024-09-12T02:46:37.230715+0000","last_became_active":"2024-09-12T02:46:37.228608+0000","last_became_peered":"2024-09-12T02:46:37.228608+0000","last_unstale":"2024-09-12T02:46:37.230715+0000","last_undegraded":"2024-09-12T02:46:37.230715+0000","last_fullsized":"2024-09-12T02:46:37.230715+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:36.655180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"96'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.246073+0000","last_change":"2024-09-12T02:46:36.231221+0000","last_active":"2024-09-12T02:46:37.246073+0000","last_peered":"2024-09-12T02:46:37.246073+0000","last_clean":"2024-09-12T02:46:37.246073+0000","last_became_active":"2024-09-12T02:46:36.230799+0000","last_became_peered":"2024-09-12T02:46:36.230799+0000","last_unstale":"2024-09-12T02:46:37.246073+0000","last_undegraded":"2024-09-12T02:46:37.246073+0000","last_fullsized":"2024-09-12T02:46:37.246073+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:26.403745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.236790+0000","last_change":"2024-09-12T02:46:37.235143+0000","last_active":"2024-09-12T02:46:37.236790+0000","last_peered":"2024-09-12T02:46:37.236790+0000","last_clean":"2024-09-12T02:46:37.236790+0000","last_became_active":"2024-09-12T02:46:37.234060+0000","last_became_peered":"2024-09-12T02:46:37.234060+0000","last_unstale":"2024-09-12T02:46:37.236790+0000","last_undegraded":"2024-09-12T02:46:37.236790+0000","last_fullsized":"2024-09-12T02:46:37.236790+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:22:28.123640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"96'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.245290+0000","last_change":"2024-09-12T02:46:36.229233+0000","last_active":"2024-09-12T02:46:37.245290+0000","last_peered":"2024-09-12T02:46:37.245290+0000","last_clean":"2024-09-12T02:46:37.245290+0000","last_became_active":"2024-09-12T02:46:36.228991+0000","last_became_peered":"2024-09-12T02:46:36.228991+0000","last_unstale":"2024-09-12T02:46:37.245290+0000","last_undegraded":"2024-09-12T02:46:37.245290+0000","last_fullsized":"2024-09-12T02:46:37.245290+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:04.783283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.236750+0000","last_change":"2024-09-12T02:46:37.236294+0000","last_active":"2024-09-12T02:46:37.236750+0000","last_peered":"2024-09-12T02:46:37.236750+0000","last_clean":"2024-09-12T02:46:37.236750+0000","last_became_active":"2024-09-12T02:46:37.234858+0000","last_became_peered":"2024-09-12T02:46:37.234858+0000","last_unstale":"2024-09-12T02:46:37.236750+0000","last_undegraded":"2024-09-12T02:46:37.236750+0000","last_fullsized":"2024-09-12T02:46:37.236750+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:02.281116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.225087+0000","last_change":"2024-09-12T02:46:36.230876+0000","last_active":"2024-09-12T02:46:37.225087+0000","last_peered":"2024-09-12T02:46:37.225087+0000","last_clean":"2024-09-12T02:46:37.225087+0000","last_became_active":"2024-09-12T02:46:36.230401+0000","last_became_peered":"2024-09-12T02:46:36.230401+0000","last_unstale":"2024-09-12T02:46:37.225087+0000","last_undegraded":"2024-09-12T02:46:37.225087+0000","last_fullsized":"2024-09-12T02:46:37.225087+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:48.935489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.235049+0000","last_change":"2024-09-12T02:46:37.234144+0000","last_active":"2024-09-12T02:46:37.235049+0000","last_peered":"2024-09-12T02:46:37.235049+0000","last_clean":"2024-09-12T02:46:37.235049+0000","last_became_active":"2024-09-12T02:46:37.233905+0000","last_became_peered":"2024-09-12T02:46:37.233905+0000","last_unstale":"2024-09-12T02:46:37.235049+0000","last_undegraded":"2024-09-12T02:46:37.235049+0000","last_fullsized":"2024-09-12T02:46:37.235049+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:21.369391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.227573+0000","last_change":"2024-09-12T02:46:36.235026+0000","last_active":"2024-09-12T02:46:37.227573+0000","last_peered":"2024-09-12T02:46:37.227573+0000","last_clean":"2024-09-12T02:46:37.227573+0000","last_became_active":"2024-09-12T02:46:36.234023+0000","last_became_peered":"2024-09-12T02:46:36.234023+0000","last_unstale":"2024-09-12T02:46:37.227573+0000","last_undegraded":"2024-09-12T02:46:37.227573+0000","last_fullsized":"2024-09-12T02:46:37.227573+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:53.220323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.235580+0000","last_change":"2024-09-12T02:46:37.235470+0000","last_active":"2024-09-12T02:46:37.235580+0000","last_peered":"2024-09-12T02:46:37.235580+0000","last_clean":"2024-09-12T02:46:37.235580+0000","last_became_active":"2024-09-12T02:46:37.235244+0000","last_became_peered":"2024-09-12T02:46:37.235244+0000","last_unstale":"2024-09-12T02:46:37.235580+0000","last_undegraded":"2024-09-12T02:46:37.235580+0000","last_fullsized":"2024-09-12T02:46:37.235580+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:16.547682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.221434+0000","last_change":"2024-09-12T02:46:36.222330+0000","last_active":"2024-09-12T02:46:37.221434+0000","last_peered":"2024-09-12T02:46:37.221434+0000","last_clean":"2024-09-12T02:46:37.221434+0000","last_became_active":"2024-09-12T02:46:36.222092+0000","last_became_peered":"2024-09-12T02:46:36.222092+0000","last_unstale":"2024-09-12T02:46:37.221434+0000","last_undegraded":"2024-09-12T02:46:37.221434+0000","last_fullsized":"2024-09-12T02:46:37.221434+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:24.261647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.237435+0000","last_change":"2024-09-12T02:46:37.236042+0000","last_active":"2024-09-12T02:46:37.237435+0000","last_peered":"2024-09-12T02:46:37.237435+0000","last_clean":"2024-09-12T02:46:37.237435+0000","last_became_active":"2024-09-12T02:46:37.235724+0000","last_became_peered":"2024-09-12T02:46:37.235724+0000","last_unstale":"2024-09-12T02:46:37.237435+0000","last_undegraded":"2024-09-12T02:46:37.237435+0000","last_fullsized":"2024-09-12T02:46:37.237435+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:09.032503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.221358+0000","last_change":"2024-09-12T02:46:36.226055+0000","last_active":"2024-09-12T02:46:37.221358+0000","last_peered":"2024-09-12T02:46:37.221358+0000","last_clean":"2024-09-12T02:46:37.221358+0000","last_became_active":"2024-09-12T02:46:36.224942+0000","last_became_peered":"2024-09-12T02:46:36.224942+0000","last_unstale":"2024-09-12T02:46:37.221358+0000","last_undegraded":"2024-09-12T02:46:37.221358+0000","last_fullsized":"2024-09-12T02:46:37.221358+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:31.269516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.228538+0000","last_change":"2024-09-12T02:46:37.228366+0000","last_active":"2024-09-12T02:46:37.228538+0000","last_peered":"2024-09-12T02:46:37.228538+0000","last_clean":"2024-09-12T02:46:37.228538+0000","last_became_active":"2024-09-12T02:46:37.227388+0000","last_became_peered":"2024-09-12T02:46:37.227388+0000","last_unstale":"2024-09-12T02:46:37.228538+0000","last_undegraded":"2024-09-12T02:46:37.228538+0000","last_fullsized":"2024-09-12T02:46:37.228538+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:00.551706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"96'3","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.247285+0000","last_change":"2024-09-12T02:46:36.226586+0000","last_active":"2024-09-12T02:46:37.247285+0000","last_peered":"2024-09-12T02:46:37.247285+0000","last_clean":"2024-09-12T02:46:37.247285+0000","last_became_active":"2024-09-12T02:46:36.224545+0000","last_became_peered":"2024-09-12T02:46:36.224545+0000","last_unstale":"2024-09-12T02:46:37.247285+0000","last_undegraded":"2024-09-12T02:46:37.247285+0000","last_fullsized":"2024-09-12T02:46:37.247285+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:27.957556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.228215+0000","last_change":"2024-09-12T02:46:37.228057+0000","last_active":"2024-09-12T02:46:37.228215+0000","last_peered":"2024-09-12T02:46:37.228215+0000","last_clean":"2024-09-12T02:46:37.228215+0000","last_became_active":"2024-09-12T02:46:37.226988+0000","last_became_peered":"2024-09-12T02:46:37.226988+0000","last_unstale":"2024-09-12T02:46:37.228215+0000","last_undegraded":"2024-09-12T02:46:37.228215+0000","last_fullsized":"2024-09-12T02:46:37.228215+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:17.385150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"96'6","reported_seq":18,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.248168+0000","last_change":"2024-09-12T02:46:36.229471+0000","last_active":"2024-09-12T02:46:37.248168+0000","last_peered":"2024-09-12T02:46:37.248168+0000","last_clean":"2024-09-12T02:46:37.248168+0000","last_became_active":"2024-09-12T02:46:36.229083+0000","last_became_peered":"2024-09-12T02:46:36.229083+0000","last_unstale":"2024-09-12T02:46:37.248168+0000","last_undegraded":"2024-09-12T02:46:37.248168+0000","last_fullsized":"2024-09-12T02:46:37.248168+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:33.793157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.230909+0000","last_change":"2024-09-12T02:46:37.230796+0000","last_active":"2024-09-12T02:46:37.230909+0000","last_peered":"2024-09-12T02:46:37.230909+0000","last_clean":"2024-09-12T02:46:37.230909+0000","last_became_active":"2024-09-12T02:46:37.230274+0000","last_became_peered":"2024-09-12T02:46:37.230274+0000","last_unstale":"2024-09-12T02:46:37.230909+0000","last_undegraded":"2024-09-12T02:46:37.230909+0000","last_fullsized":"2024-09-12T02:46:37.230909+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:06.439648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"96'2","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.247084+0000","last_change":"2024-09-12T02:46:36.235179+0000","last_active":"2024-09-12T02:46:37.247084+0000","last_peered":"2024-09-12T02:46:37.247084+0000","last_clean":"2024-09-12T02:46:37.247084+0000","last_became_active":"2024-09-12T02:46:36.234486+0000","last_became_peered":"2024-09-12T02:46:36.234486+0000","last_unstale":"2024-09-12T02:46:37.247084+0000","last_undegraded":"2024-09-12T02:46:37.247084+0000","last_fullsized":"2024-09-12T02:46:37.247084+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:29.161560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.238323+0000","last_change":"2024-09-12T02:46:37.238112+0000","last_active":"2024-09-12T02:46:37.238323+0000","last_peered":"2024-09-12T02:46:37.238323+0000","last_clean":"2024-09-12T02:46:37.238323+0000","last_became_active":"2024-09-12T02:46:37.235909+0000","last_became_peered":"2024-09-12T02:46:37.235909+0000","last_unstale":"2024-09-12T02:46:37.238323+0000","last_undegraded":"2024-09-12T02:46:37.238323+0000","last_fullsized":"2024-09-12T02:46:37.238323+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:29.776465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.220884+0000","last_change":"2024-09-12T02:46:36.223977+0000","last_active":"2024-09-12T02:46:37.220884+0000","last_peered":"2024-09-12T02:46:37.220884+0000","last_clean":"2024-09-12T02:46:37.220884+0000","last_became_active":"2024-09-12T02:46:36.223757+0000","last_became_peered":"2024-09-12T02:46:36.223757+0000","last_unstale":"2024-09-12T02:46:37.220884+0000","last_undegraded":"2024-09-12T02:46:37.220884+0000","last_fullsized":"2024-09-12T02:46:37.220884+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:29.487280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.230693+0000","last_change":"2024-09-12T02:46:37.230419+0000","last_active":"2024-09-12T02:46:37.230693+0000","last_peered":"2024-09-12T02:46:37.230693+0000","last_clean":"2024-09-12T02:46:37.230693+0000","last_became_active":"2024-09-12T02:46:37.228360+0000","last_became_peered":"2024-09-12T02:46:37.228360+0000","last_unstale":"2024-09-12T02:46:37.230693+0000","last_undegraded":"2024-09-12T02:46:37.230693+0000","last_fullsized":"2024-09-12T02:46:37.230693+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:17.993272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.226275+0000","last_change":"2024-09-12T02:46:36.231223+0000","last_active":"2024-09-12T02:46:37.226275+0000","last_peered":"2024-09-12T02:46:37.226275+0000","last_clean":"2024-09-12T02:46:37.226275+0000","last_became_active":"2024-09-12T02:46:36.230808+0000","last_became_peered":"2024-09-12T02:46:36.230808+0000","last_unstale":"2024-09-12T02:46:37.226275+0000","last_undegraded":"2024-09-12T02:46:37.226275+0000","last_fullsized":"2024-09-12T02:46:37.226275+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:52.222934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.236234+0000","last_change":"2024-09-12T02:46:37.234353+0000","last_active":"2024-09-12T02:46:37.236234+0000","last_peered":"2024-09-12T02:46:37.236234+0000","last_clean":"2024-09-12T02:46:37.236234+0000","last_became_active":"2024-09-12T02:46:37.233216+0000","last_became_peered":"2024-09-12T02:46:37.233216+0000","last_unstale":"2024-09-12T02:46:37.236234+0000","last_undegraded":"2024-09-12T02:46:37.236234+0000","last_fullsized":"2024-09-12T02:46:37.236234+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:25.123973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"96'8","reported_seq":20,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.246737+0000","last_change":"2024-09-12T02:46:36.231452+0000","last_active":"2024-09-12T02:46:37.246737+0000","last_peered":"2024-09-12T02:46:37.246737+0000","last_clean":"2024-09-12T02:46:37.246737+0000","last_became_active":"2024-09-12T02:46:36.231187+0000","last_became_peered":"2024-09-12T02:46:36.231187+0000","last_unstale":"2024-09-12T02:46:37.246737+0000","last_undegraded":"2024-09-12T02:46:37.246737+0000","last_fullsized":"2024-09-12T02:46:37.246737+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:31.450544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.238566+0000","last_change":"2024-09-12T02:46:37.238418+0000","last_active":"2024-09-12T02:46:37.238566+0000","last_peered":"2024-09-12T02:46:37.238566+0000","last_clean":"2024-09-12T02:46:37.238566+0000","last_became_active":"2024-09-12T02:46:37.237814+0000","last_became_peered":"2024-09-12T02:46:37.237814+0000","last_unstale":"2024-09-12T02:46:37.238566+0000","last_undegraded":"2024-09-12T02:46:37.238566+0000","last_fullsized":"2024-09-12T02:46:37.238566+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:53.038531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"96'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.243078+0000","last_change":"2024-09-12T02:46:36.225486+0000","last_active":"2024-09-12T02:46:37.243078+0000","last_peered":"2024-09-12T02:46:37.243078+0000","last_clean":"2024-09-12T02:46:37.243078+0000","last_became_active":"2024-09-12T02:46:36.224981+0000","last_became_peered":"2024-09-12T02:46:36.224981+0000","last_unstale":"2024-09-12T02:46:37.243078+0000","last_undegraded":"2024-09-12T02:46:37.243078+0000","last_fullsized":"2024-09-12T02:46:37.243078+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:51.188438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.233030+0000","last_change":"2024-09-12T02:46:37.232389+0000","last_active":"2024-09-12T02:46:37.233030+0000","last_peered":"2024-09-12T02:46:37.233030+0000","last_clean":"2024-09-12T02:46:37.233030+0000","last_became_active":"2024-09-12T02:46:37.232144+0000","last_became_peered":"2024-09-12T02:46:37.232144+0000","last_unstale":"2024-09-12T02:46:37.233030+0000","last_undegraded":"2024-09-12T02:46:37.233030+0000","last_fullsized":"2024-09-12T02:46:37.233030+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:47.341868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"96'2","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.246649+0000","last_change":"2024-09-12T02:46:36.232098+0000","last_active":"2024-09-12T02:46:37.246649+0000","last_peered":"2024-09-12T02:46:37.246649+0000","last_clean":"2024-09-12T02:46:37.246649+0000","last_became_active":"2024-09-12T02:46:36.231801+0000","last_became_peered":"2024-09-12T02:46:36.231801+0000","last_unstale":"2024-09-12T02:46:37.246649+0000","last_undegraded":"2024-09-12T02:46:37.246649+0000","last_fullsized":"2024-09-12T02:46:37.246649+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:55.301285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.236858+0000","last_change":"2024-09-12T02:46:37.236677+0000","last_active":"2024-09-12T02:46:37.236858+0000","last_peered":"2024-09-12T02:46:37.236858+0000","last_clean":"2024-09-12T02:46:37.236858+0000","last_became_active":"2024-09-12T02:46:37.236451+0000","last_became_peered":"2024-09-12T02:46:37.236451+0000","last_unstale":"2024-09-12T02:46:37.236858+0000","last_undegraded":"2024-09-12T02:46:37.236858+0000","last_fullsized":"2024-09-12T02:46:37.236858+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:56.933279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.223706+0000","last_change":"2024-09-12T02:46:36.230493+0000","last_active":"2024-09-12T02:46:37.223706+0000","last_peered":"2024-09-12T02:46:37.223706+0000","last_clean":"2024-09-12T02:46:37.223706+0000","last_became_active":"2024-09-12T02:46:36.230258+0000","last_became_peered":"2024-09-12T02:46:36.230258+0000","last_unstale":"2024-09-12T02:46:37.223706+0000","last_undegraded":"2024-09-12T02:46:37.223706+0000","last_fullsized":"2024-09-12T02:46:37.223706+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:25.182309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.230377+0000","last_change":"2024-09-12T02:46:37.230275+0000","last_active":"2024-09-12T02:46:37.230377+0000","last_peered":"2024-09-12T02:46:37.230377+0000","last_clean":"2024-09-12T02:46:37.230377+0000","last_became_active":"2024-09-12T02:46:37.229475+0000","last_became_peered":"2024-09-12T02:46:37.229475+0000","last_unstale":"2024-09-12T02:46:37.230377+0000","last_undegraded":"2024-09-12T02:46:37.230377+0000","last_fullsized":"2024-09-12T02:46:37.230377+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:13.733067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"96'2","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.246195+0000","last_change":"2024-09-12T02:46:36.223413+0000","last_active":"2024-09-12T02:46:37.246195+0000","last_peered":"2024-09-12T02:46:37.246195+0000","last_clean":"2024-09-12T02:46:37.246195+0000","last_became_active":"2024-09-12T02:46:36.222696+0000","last_became_peered":"2024-09-12T02:46:36.222696+0000","last_unstale":"2024-09-12T02:46:37.246195+0000","last_undegraded":"2024-09-12T02:46:37.246195+0000","last_fullsized":"2024-09-12T02:46:37.246195+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:11.318470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.229846+0000","last_change":"2024-09-12T02:46:37.229537+0000","last_active":"2024-09-12T02:46:37.229846+0000","last_peered":"2024-09-12T02:46:37.229846+0000","last_clean":"2024-09-12T02:46:37.229846+0000","last_became_active":"2024-09-12T02:46:37.229310+0000","last_became_peered":"2024-09-12T02:46:37.229310+0000","last_unstale":"2024-09-12T02:46:37.229846+0000","last_undegraded":"2024-09-12T02:46:37.229846+0000","last_fullsized":"2024-09-12T02:46:37.229846+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:01.704884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.220724+0000","last_change":"2024-09-12T02:46:36.229150+0000","last_active":"2024-09-12T02:46:37.220724+0000","last_peered":"2024-09-12T02:46:37.220724+0000","last_clean":"2024-09-12T02:46:37.220724+0000","last_became_active":"2024-09-12T02:46:36.228902+0000","last_became_peered":"2024-09-12T02:46:36.228902+0000","last_unstale":"2024-09-12T02:46:37.220724+0000","last_undegraded":"2024-09-12T02:46:37.220724+0000","last_fullsized":"2024-09-12T02:46:37.220724+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:18.326131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.231394+0000","last_change":"2024-09-12T02:46:37.230501+0000","last_active":"2024-09-12T02:46:37.231394+0000","last_peered":"2024-09-12T02:46:37.231394+0000","last_clean":"2024-09-12T02:46:37.231394+0000","last_became_active":"2024-09-12T02:46:37.230157+0000","last_became_peered":"2024-09-12T02:46:37.230157+0000","last_unstale":"2024-09-12T02:46:37.231394+0000","last_undegraded":"2024-09-12T02:46:37.231394+0000","last_fullsized":"2024-09-12T02:46:37.231394+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:50.779729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.219865+0000","last_change":"2024-09-12T02:46:36.231450+0000","last_active":"2024-09-12T02:46:37.219865+0000","last_peered":"2024-09-12T02:46:37.219865+0000","last_clean":"2024-09-12T02:46:37.219865+0000","last_became_active":"2024-09-12T02:46:36.231165+0000","last_became_peered":"2024-09-12T02:46:36.231165+0000","last_unstale":"2024-09-12T02:46:37.219865+0000","last_undegraded":"2024-09-12T02:46:37.219865+0000","last_fullsized":"2024-09-12T02:46:37.219865+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:42.201000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.232353+0000","last_change":"2024-09-12T02:46:37.231651+0000","last_active":"2024-09-12T02:46:37.232353+0000","last_peered":"2024-09-12T02:46:37.232353+0000","last_clean":"2024-09-12T02:46:37.232353+0000","last_became_active":"2024-09-12T02:46:37.230613+0000","last_became_peered":"2024-09-12T02:46:37.230613+0000","last_unstale":"2024-09-12T02:46:37.232353+0000","last_undegraded":"2024-09-12T02:46:37.232353+0000","last_fullsized":"2024-09-12T02:46:37.232353+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:02.840095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.221025+0000","last_change":"2024-09-12T02:46:36.222140+0000","last_active":"2024-09-12T02:46:37.221025+0000","last_peered":"2024-09-12T02:46:37.221025+0000","last_clean":"2024-09-12T02:46:37.221025+0000","last_became_active":"2024-09-12T02:46:36.221853+0000","last_became_peered":"2024-09-12T02:46:36.221853+0000","last_unstale":"2024-09-12T02:46:37.221025+0000","last_undegraded":"2024-09-12T02:46:37.221025+0000","last_fullsized":"2024-09-12T02:46:37.221025+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:38.316668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.232612+0000","last_change":"2024-09-12T02:46:37.232332+0000","last_active":"2024-09-12T02:46:37.232612+0000","last_peered":"2024-09-12T02:46:37.232612+0000","last_clean":"2024-09-12T02:46:37.232612+0000","last_became_active":"2024-09-12T02:46:37.230705+0000","last_became_peered":"2024-09-12T02:46:37.230705+0000","last_unstale":"2024-09-12T02:46:37.232612+0000","last_undegraded":"2024-09-12T02:46:37.232612+0000","last_fullsized":"2024-09-12T02:46:37.232612+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:04.466536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"96'2","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.247428+0000","last_change":"2024-09-12T02:46:36.232563+0000","last_active":"2024-09-12T02:46:37.247428+0000","last_peered":"2024-09-12T02:46:37.247428+0000","last_clean":"2024-09-12T02:46:37.247428+0000","last_became_active":"2024-09-12T02:46:36.231991+0000","last_became_peered":"2024-09-12T02:46:36.231991+0000","last_unstale":"2024-09-12T02:46:37.247428+0000","last_undegraded":"2024-09-12T02:46:37.247428+0000","last_fullsized":"2024-09-12T02:46:37.247428+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:06.733631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.236156+0000","last_change":"2024-09-12T02:46:37.236010+0000","last_active":"2024-09-12T02:46:37.236156+0000","last_peered":"2024-09-12T02:46:37.236156+0000","last_clean":"2024-09-12T02:46:37.236156+0000","last_became_active":"2024-09-12T02:46:37.235691+0000","last_became_peered":"2024-09-12T02:46:37.235691+0000","last_unstale":"2024-09-12T02:46:37.236156+0000","last_undegraded":"2024-09-12T02:46:37.236156+0000","last_fullsized":"2024-09-12T02:46:37.236156+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:03.394491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.228011+0000","last_change":"2024-09-12T02:46:36.233334+0000","last_active":"2024-09-12T02:46:37.228011+0000","last_peered":"2024-09-12T02:46:37.228011+0000","last_clean":"2024-09-12T02:46:37.228011+0000","last_became_active":"2024-09-12T02:46:36.233115+0000","last_became_peered":"2024-09-12T02:46:36.233115+0000","last_unstale":"2024-09-12T02:46:37.228011+0000","last_undegraded":"2024-09-12T02:46:37.228011+0000","last_fullsized":"2024-09-12T02:46:37.228011+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:52.491438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.225257+0000","last_change":"2024-09-12T02:46:37.225141+0000","last_active":"2024-09-12T02:46:37.225257+0000","last_peered":"2024-09-12T02:46:37.225257+0000","last_clean":"2024-09-12T02:46:37.225257+0000","last_became_active":"2024-09-12T02:46:37.224895+0000","last_became_peered":"2024-09-12T02:46:37.224895+0000","last_unstale":"2024-09-12T02:46:37.225257+0000","last_undegraded":"2024-09-12T02:46:37.225257+0000","last_fullsized":"2024-09-12T02:46:37.225257+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:05.657223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.222000+0000","last_change":"2024-09-12T02:46:36.224654+0000","last_active":"2024-09-12T02:46:37.222000+0000","last_peered":"2024-09-12T02:46:37.222000+0000","last_clean":"2024-09-12T02:46:37.222000+0000","last_became_active":"2024-09-12T02:46:36.224408+0000","last_became_peered":"2024-09-12T02:46:36.224408+0000","last_unstale":"2024-09-12T02:46:37.222000+0000","last_undegraded":"2024-09-12T02:46:37.222000+0000","last_fullsized":"2024-09-12T02:46:37.222000+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:16.849515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.233252+0000","last_change":"2024-09-12T02:46:37.233091+0000","last_active":"2024-09-12T02:46:37.233252+0000","last_peered":"2024-09-12T02:46:37.233252+0000","last_clean":"2024-09-12T02:46:37.233252+0000","last_became_active":"2024-09-12T02:46:37.231664+0000","last_became_peered":"2024-09-12T02:46:37.231664+0000","last_unstale":"2024-09-12T02:46:37.233252+0000","last_undegraded":"2024-09-12T02:46:37.233252+0000","last_fullsized":"2024-09-12T02:46:37.233252+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:25.219781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.222231+0000","last_change":"2024-09-12T02:46:36.227511+0000","last_active":"2024-09-12T02:46:37.222231+0000","last_peered":"2024-09-12T02:46:37.222231+0000","last_clean":"2024-09-12T02:46:37.222231+0000","last_became_active":"2024-09-12T02:46:36.227092+0000","last_became_peered":"2024-09-12T02:46:36.227092+0000","last_unstale":"2024-09-12T02:46:37.222231+0000","last_undegraded":"2024-09-12T02:46:37.222231+0000","last_fullsized":"2024-09-12T02:46:37.222231+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:00.257008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.229865+0000","last_change":"2024-09-12T02:46:37.229645+0000","last_active":"2024-09-12T02:46:37.229865+0000","last_peered":"2024-09-12T02:46:37.229865+0000","last_clean":"2024-09-12T02:46:37.229865+0000","last_became_active":"2024-09-12T02:46:37.229427+0000","last_became_peered":"2024-09-12T02:46:37.229427+0000","last_unstale":"2024-09-12T02:46:37.229865+0000","last_undegraded":"2024-09-12T02:46:37.229865+0000","last_fullsized":"2024-09-12T02:46:37.229865+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:10.901089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.224216+0000","last_change":"2024-09-12T02:46:36.232368+0000","last_active":"2024-09-12T02:46:37.224216+0000","last_peered":"2024-09-12T02:46:37.224216+0000","last_clean":"2024-09-12T02:46:37.224216+0000","last_became_active":"2024-09-12T02:46:36.231924+0000","last_became_peered":"2024-09-12T02:46:36.231924+0000","last_unstale":"2024-09-12T02:46:37.224216+0000","last_undegraded":"2024-09-12T02:46:37.224216+0000","last_fullsized":"2024-09-12T02:46:37.224216+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:14.540032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.230813+0000","last_change":"2024-09-12T02:46:37.230607+0000","last_active":"2024-09-12T02:46:37.230813+0000","last_peered":"2024-09-12T02:46:37.230813+0000","last_clean":"2024-09-12T02:46:37.230813+0000","last_became_active":"2024-09-12T02:46:37.229968+0000","last_became_peered":"2024-09-12T02:46:37.229968+0000","last_unstale":"2024-09-12T02:46:37.230813+0000","last_undegraded":"2024-09-12T02:46:37.230813+0000","last_fullsized":"2024-09-12T02:46:37.230813+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:00.646946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.226227+0000","last_change":"2024-09-12T02:46:36.229399+0000","last_active":"2024-09-12T02:46:37.226227+0000","last_peered":"2024-09-12T02:46:37.226227+0000","last_clean":"2024-09-12T02:46:37.226227+0000","last_became_active":"2024-09-12T02:46:36.229064+0000","last_became_peered":"2024-09-12T02:46:36.229064+0000","last_unstale":"2024-09-12T02:46:37.226227+0000","last_undegraded":"2024-09-12T02:46:37.226227+0000","last_fullsized":"2024-09-12T02:46:37.226227+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:27:22.060833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.237916+0000","last_change":"2024-09-12T02:46:37.237783+0000","last_active":"2024-09-12T02:46:37.237916+0000","last_peered":"2024-09-12T02:46:37.237916+0000","last_clean":"2024-09-12T02:46:37.237916+0000","last_became_active":"2024-09-12T02:46:37.237531+0000","last_became_peered":"2024-09-12T02:46:37.237531+0000","last_unstale":"2024-09-12T02:46:37.237916+0000","last_undegraded":"2024-09-12T02:46:37.237916+0000","last_fullsized":"2024-09-12T02:46:37.237916+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:40.459177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.223103+0000","last_change":"2024-09-12T02:46:36.228530+0000","last_active":"2024-09-12T02:46:37.223103+0000","last_peered":"2024-09-12T02:46:37.223103+0000","last_clean":"2024-09-12T02:46:37.223103+0000","last_became_active":"2024-09-12T02:46:36.228153+0000","last_became_peered":"2024-09-12T02:46:36.228153+0000","last_unstale":"2024-09-12T02:46:37.223103+0000","last_undegraded":"2024-09-12T02:46:37.223103+0000","last_fullsized":"2024-09-12T02:46:37.223103+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:20.076895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.227501+0000","last_change":"2024-09-12T02:46:37.227378+0000","last_active":"2024-09-12T02:46:37.227501+0000","last_peered":"2024-09-12T02:46:37.227501+0000","last_clean":"2024-09-12T02:46:37.227501+0000","last_became_active":"2024-09-12T02:46:37.227148+0000","last_became_peered":"2024-09-12T02:46:37.227148+0000","last_unstale":"2024-09-12T02:46:37.227501+0000","last_undegraded":"2024-09-12T02:46:37.227501+0000","last_fullsized":"2024-09-12T02:46:37.227501+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:29.461189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.228717+0000","last_change":"2024-09-12T02:46:36.230343+0000","last_active":"2024-09-12T02:46:37.228717+0000","last_peered":"2024-09-12T02:46:37.228717+0000","last_clean":"2024-09-12T02:46:37.228717+0000","last_became_active":"2024-09-12T02:46:36.229891+0000","last_became_peered":"2024-09-12T02:46:36.229891+0000","last_unstale":"2024-09-12T02:46:37.228717+0000","last_undegraded":"2024-09-12T02:46:37.228717+0000","last_fullsized":"2024-09-12T02:46:37.228717+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:28.130288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.236332+0000","last_change":"2024-09-12T02:46:37.234924+0000","last_active":"2024-09-12T02:46:37.236332+0000","last_peered":"2024-09-12T02:46:37.236332+0000","last_clean":"2024-09-12T02:46:37.236332+0000","last_became_active":"2024-09-12T02:46:37.234137+0000","last_became_peered":"2024-09-12T02:46:37.234137+0000","last_unstale":"2024-09-12T02:46:37.236332+0000","last_undegraded":"2024-09-12T02:46:37.236332+0000","last_fullsized":"2024-09-12T02:46:37.236332+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:48.954739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"96'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.246773+0000","last_change":"2024-09-12T02:46:36.228613+0000","last_active":"2024-09-12T02:46:37.246773+0000","last_peered":"2024-09-12T02:46:37.246773+0000","last_clean":"2024-09-12T02:46:37.246773+0000","last_became_active":"2024-09-12T02:46:36.228388+0000","last_became_peered":"2024-09-12T02:46:36.228388+0000","last_unstale":"2024-09-12T02:46:37.246773+0000","last_undegraded":"2024-09-12T02:46:37.246773+0000","last_fullsized":"2024-09-12T02:46:37.246773+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:44.223620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":317,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.230025+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:46:37.230025+0000","last_peered":"2024-09-12T02:46:37.230025+0000","last_clean":"2024-09-12T02:46:37.230025+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:46:37.230025+0000","last_undegraded":"2024-09-12T02:46:37.230025+0000","last_fullsized":"2024-09-12T02:46:37.230025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:03.222374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574909,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1080,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194232,"statfs":{"total":200000000,"available":198893853,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":504,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194808,"statfs":{"total":200000000,"available":199483597,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574909,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":497,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194815,"statfs":{"total":200000000,"available":199491066,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":497,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194815,"statfs":{"total":200000000,"available":199491066,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574909,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":505,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194807,"statfs":{"total":200000000,"available":199482679,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":504,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194808,"statfs":{"total":200000000,"available":199483709,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":503,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194808,"statfs":{"total":200000000,"available":199484097,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574909,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1080,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194232,"statfs":{"total":200000000,"available":198893889,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:46:41.407 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:46:41.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.594+0000 7f73bce00640 1 Processor -- start 2024-09-12T02:46:41.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.594+0000 7f73bce00640 1 -- start start 2024-09-12T02:46:41.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.595+0000 7f73bce00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f73b81626d0 0x7f73b80b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:41.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.595+0000 7f73bce00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73b80d2cb0 0x7f73b80d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:41.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.595+0000 7f73bce00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f73b80b1a40 0x7f73b80b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:41.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.595+0000 7f73bce00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f73b80d3ac0 con 0x7f73b81626d0 2024-09-12T02:46:41.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.595+0000 7f73bce00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f73b80d1d00 con 0x7f73b80b1a40 2024-09-12T02:46:41.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.595+0000 7f73bce00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f73b80d1fe0 con 0x7f73b80d2cb0 2024-09-12T02:46:41.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.595+0000 7f73b5e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f73b81626d0 0x7f73b80b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:41.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.595+0000 7f73b5e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f73b81626d0 0x7f73b80b3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37108/0 (socket says 172.21.15.112:37108) 2024-09-12T02:46:41.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.595+0000 7f73b5e00640 1 -- 172.21.15.112:0/218928345 learned_addr learned my addr 172.21.15.112:0/218928345 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:41.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.595+0000 7f73b6800640 1 --2- 172.21.15.112:0/218928345 >> v2:172.21.15.137:3300/0 conn(0x7f73b80b1a40 0x7f73b80b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:41.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.595+0000 7f73b5400640 1 --2- 172.21.15.112:0/218928345 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73b80d2cb0 0x7f73b80d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:41.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.596+0000 7f73b5e00640 1 -- 172.21.15.112:0/218928345 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73b80d2cb0 msgr2=0x7f73b80d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:41.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.596+0000 7f73b5e00640 1 --2- 172.21.15.112:0/218928345 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73b80d2cb0 0x7f73b80d3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.596+0000 7f73b5e00640 1 -- 172.21.15.112:0/218928345 >> v2:172.21.15.137:3300/0 conn(0x7f73b80b1a40 msgr2=0x7f73b80b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:41.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.596+0000 7f73b5e00640 1 --2- 172.21.15.112:0/218928345 >> v2:172.21.15.137:3300/0 conn(0x7f73b80b1a40 0x7f73b80b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.596+0000 7f73b5e00640 1 -- 172.21.15.112:0/218928345 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b80d22c0 con 0x7f73b81626d0 2024-09-12T02:46:41.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.596+0000 7f73b5400640 1 --2- 172.21.15.112:0/218928345 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73b80d2cb0 0x7f73b80d3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:41.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.597+0000 7f73b5e00640 1 --2- 172.21.15.112:0/218928345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b81626d0 0x7f73b80b3bb0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f73b806bd10 tx=0x7f73a802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6383c8bd33f9a83 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:41.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.597+0000 7f73b4a00640 1 -- 172.21.15.112:0/218928345 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a8036070 con 0x7f73b81626d0 2024-09-12T02:46:41.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.597+0000 7f73b4a00640 1 -- 172.21.15.112:0/218928345 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73a8031600 con 0x7f73b81626d0 2024-09-12T02:46:41.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.597+0000 7f73b4a00640 1 -- 172.21.15.112:0/218928345 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a80319d0 con 0x7f73b81626d0 2024-09-12T02:46:41.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.597+0000 7f73bce00640 1 -- 172.21.15.112:0/218928345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b81626d0 msgr2=0x7f73b80b3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:41.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.597+0000 7f73bce00640 1 --2- 172.21.15.112:0/218928345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b81626d0 0x7f73b80b3bb0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f73b806bd10 tx=0x7f73a802a6a0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.597+0000 7f73bce00640 1 -- 172.21.15.112:0/218928345 shutdown_connections 2024-09-12T02:46:41.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.597+0000 7f73bce00640 1 --2- 172.21.15.112:0/218928345 >> v2:172.21.15.137:3300/0 conn(0x7f73b80b1a40 0x7f73b80b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.597+0000 7f73bce00640 1 --2- 172.21.15.112:0/218928345 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73b80d2cb0 0x7f73b80d3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.597+0000 7f73bce00640 1 --2- 172.21.15.112:0/218928345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b81626d0 0x7f73b80b3bb0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.597+0000 7f73bce00640 1 -- 172.21.15.112:0/218928345 >> 172.21.15.112:0/218928345 conn(0x7f73b80d4db0 msgr2=0x7f73b80d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:41.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.598+0000 7f73bce00640 1 -- 172.21.15.112:0/218928345 shutdown_connections 2024-09-12T02:46:41.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.598+0000 7f73bce00640 1 -- 172.21.15.112:0/218928345 wait complete. 2024-09-12T02:46:41.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.599+0000 7f73bce00640 1 Processor -- start 2024-09-12T02:46:41.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.599+0000 7f73bce00640 1 -- start start 2024-09-12T02:46:41.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.600+0000 7f73bce00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73b80b1a40 0x7f73b80b9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:41.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.600+0000 7f73bce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73b80d2cb0 0x7f73b81f4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:41.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.600+0000 7f73bce00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b81626d0 0x7f73b809eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:41.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.600+0000 7f73bce00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f73b80d3f20 con 0x7f73b81626d0 2024-09-12T02:46:41.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.600+0000 7f73bce00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f73b80d3da0 con 0x7f73b80d2cb0 2024-09-12T02:46:41.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.600+0000 7f73bce00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f73b80d3650 con 0x7f73b80b1a40 2024-09-12T02:46:41.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.600+0000 7f73b6800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b81626d0 0x7f73b809eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:41.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.600+0000 7f73b6800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b81626d0 0x7f73b809eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37112/0 (socket says 172.21.15.112:37112) 2024-09-12T02:46:41.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.600+0000 7f73b6800640 1 -- 172.21.15.112:0/2421756963 learned_addr learned my addr 172.21.15.112:0/2421756963 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:41.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.601+0000 7f73b5e00640 1 --2- 172.21.15.112:0/2421756963 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73b80b1a40 0x7f73b80b9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:41.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.601+0000 7f73b5400640 1 --2- 172.21.15.112:0/2421756963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73b80d2cb0 0x7f73b81f4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:41.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.601+0000 7f73b6800640 1 -- 172.21.15.112:0/2421756963 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73b80b1a40 msgr2=0x7f73b80b9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:41.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.601+0000 7f73b6800640 1 --2- 172.21.15.112:0/2421756963 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73b80b1a40 0x7f73b80b9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.601+0000 7f73b6800640 1 -- 172.21.15.112:0/2421756963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73b80d2cb0 msgr2=0x7f73b81f4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:41.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.601+0000 7f73b6800640 1 --2- 172.21.15.112:0/2421756963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73b80d2cb0 0x7f73b81f4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.601+0000 7f73b6800640 1 -- 172.21.15.112:0/2421756963 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b80a0b80 con 0x7f73b81626d0 2024-09-12T02:46:41.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.601+0000 7f73b5400640 1 --2- 172.21.15.112:0/2421756963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73b80d2cb0 0x7f73b81f4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:46:41.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.601+0000 7f73b5e00640 1 --2- 172.21.15.112:0/2421756963 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73b80b1a40 0x7f73b80b9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:46:41.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.601+0000 7f73b6800640 1 --2- 172.21.15.112:0/2421756963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b81626d0 0x7f73b809eb50 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f73b000e830 tx=0x7f73b000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:41.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.601+0000 7f73ae000640 1 -- 172.21.15.112:0/2421756963 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b0017070 con 0x7f73b81626d0 2024-09-12T02:46:41.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.601+0000 7f73ae000640 1 -- 172.21.15.112:0/2421756963 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73b000c940 con 0x7f73b81626d0 2024-09-12T02:46:41.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.601+0000 7f73ae000640 1 -- 172.21.15.112:0/2421756963 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b000cd30 con 0x7f73b81626d0 2024-09-12T02:46:41.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.601+0000 7f73bce00640 1 -- 172.21.15.112:0/2421756963 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73b80b9db0 con 0x7f73b81626d0 2024-09-12T02:46:41.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.601+0000 7f73bce00640 1 -- 172.21.15.112:0/2421756963 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73b80ba370 con 0x7f73b81626d0 2024-09-12T02:46:41.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.602+0000 7f73bce00640 1 -- 172.21.15.112:0/2421756963 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73b8073fd0 con 0x7f73b81626d0 2024-09-12T02:46:41.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.603+0000 7f73ae000640 1 -- 172.21.15.112:0/2421756963 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f73b001a070 con 0x7f73b81626d0 2024-09-12T02:46:41.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.604+0000 7f73ae000640 1 --2- 172.21.15.112:0/2421756963 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f739806be30 0x7f739806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:41.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.604+0000 7f73ae000640 1 -- 172.21.15.112:0/2421756963 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5709+0+0 (secure 0 0 0) 0x7f73b008aec0 con 0x7f73b81626d0 2024-09-12T02:46:41.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.604+0000 7f73b5e00640 1 --2- 172.21.15.112:0/2421756963 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f739806be30 0x7f739806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:41.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.605+0000 7f73b5e00640 1 --2- 172.21.15.112:0/2421756963 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f739806be30 0x7f739806e2f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f73a8033000 tx=0x7f73a8009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:41.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.608+0000 7f73ae000640 1 -- 172.21.15.112:0/2421756963 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f73b8073fd0 con 0x7f73b81626d0 2024-09-12T02:46:41.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.777+0000 7f73bce00640 1 -- 172.21.15.112:0/2421756963 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f73b81f4690 con 0x7f739806be30 2024-09-12T02:46:41.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.783+0000 7f73ae000640 1 -- 172.21.15.112:0/2421756963 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247523 (secure 0 0 0) 0x7f73b81f4690 con 0x7f739806be30 2024-09-12T02:46:41.787 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:46:41.788 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:46:41.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.787+0000 7f73bce00640 1 -- 172.21.15.112:0/2421756963 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f739806be30 msgr2=0x7f739806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:41.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.787+0000 7f73bce00640 1 --2- 172.21.15.112:0/2421756963 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f739806be30 0x7f739806e2f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f73a8033000 tx=0x7f73a8009000 comp rx=0 tx=0).stop 2024-09-12T02:46:41.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.787+0000 7f73bce00640 1 -- 172.21.15.112:0/2421756963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b81626d0 msgr2=0x7f73b809eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:41.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.787+0000 7f73bce00640 1 --2- 172.21.15.112:0/2421756963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b81626d0 0x7f73b809eb50 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f73b000e830 tx=0x7f73b000ecf0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.787+0000 7f73bce00640 1 -- 172.21.15.112:0/2421756963 shutdown_connections 2024-09-12T02:46:41.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.787+0000 7f73bce00640 1 --2- 172.21.15.112:0/2421756963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b81626d0 0x7f73b809eb50 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.787+0000 7f73bce00640 1 --2- 172.21.15.112:0/2421756963 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f739806be30 0x7f739806e2f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.787+0000 7f73bce00640 1 --2- 172.21.15.112:0/2421756963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73b80d2cb0 0x7f73b81f4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.787+0000 7f73bce00640 1 --2- 172.21.15.112:0/2421756963 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73b80b1a40 0x7f73b80b9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.787+0000 7f73bce00640 1 -- 172.21.15.112:0/2421756963 >> 172.21.15.112:0/2421756963 conn(0x7f73b80d4db0 msgr2=0x7f73b80d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:41.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.787+0000 7f73bce00640 1 -- 172.21.15.112:0/2421756963 shutdown_connections 2024-09-12T02:46:41.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:41.787+0000 7f73bce00640 1 -- 172.21.15.112:0/2421756963 wait complete. 2024-09-12T02:46:41.804 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":238,"stamp":"2024-09-12T02:46:41.022852+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5171,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557328,"statfs":{"total":1600000000,"available":1594703956,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.814328"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.233048+0000","last_change":"2024-09-12T02:46:37.232841+0000","last_active":"2024-09-12T02:46:37.233048+0000","last_peered":"2024-09-12T02:46:37.233048+0000","last_clean":"2024-09-12T02:46:37.233048+0000","last_became_active":"2024-09-12T02:46:37.232064+0000","last_became_peered":"2024-09-12T02:46:37.232064+0000","last_unstale":"2024-09-12T02:46:37.233048+0000","last_undegraded":"2024-09-12T02:46:37.233048+0000","last_fullsized":"2024-09-12T02:46:37.233048+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:26.894173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.236314+0000","last_change":"2024-09-12T02:46:37.234712+0000","last_active":"2024-09-12T02:46:37.236314+0000","last_peered":"2024-09-12T02:46:37.236314+0000","last_clean":"2024-09-12T02:46:37.236314+0000","last_became_active":"2024-09-12T02:46:37.233847+0000","last_became_peered":"2024-09-12T02:46:37.233847+0000","last_unstale":"2024-09-12T02:46:37.236314+0000","last_undegraded":"2024-09-12T02:46:37.236314+0000","last_fullsized":"2024-09-12T02:46:37.236314+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:33:37.099814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.236016+0000","last_change":"2024-09-12T02:46:37.235338+0000","last_active":"2024-09-12T02:46:37.236016+0000","last_peered":"2024-09-12T02:46:37.236016+0000","last_clean":"2024-09-12T02:46:37.236016+0000","last_became_active":"2024-09-12T02:46:37.234425+0000","last_became_peered":"2024-09-12T02:46:37.234425+0000","last_unstale":"2024-09-12T02:46:37.236016+0000","last_undegraded":"2024-09-12T02:46:37.236016+0000","last_fullsized":"2024-09-12T02:46:37.236016+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:28.370452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.232482+0000","last_change":"2024-09-12T02:46:37.232336+0000","last_active":"2024-09-12T02:46:37.232482+0000","last_peered":"2024-09-12T02:46:37.232482+0000","last_clean":"2024-09-12T02:46:37.232482+0000","last_became_active":"2024-09-12T02:46:37.230054+0000","last_became_peered":"2024-09-12T02:46:37.230054+0000","last_unstale":"2024-09-12T02:46:37.232482+0000","last_undegraded":"2024-09-12T02:46:37.232482+0000","last_fullsized":"2024-09-12T02:46:37.232482+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:41.363182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.239109+0000","last_change":"2024-09-12T02:46:37.238988+0000","last_active":"2024-09-12T02:46:37.239109+0000","last_peered":"2024-09-12T02:46:37.239109+0000","last_clean":"2024-09-12T02:46:37.239109+0000","last_became_active":"2024-09-12T02:46:37.238732+0000","last_became_peered":"2024-09-12T02:46:37.238732+0000","last_unstale":"2024-09-12T02:46:37.239109+0000","last_undegraded":"2024-09-12T02:46:37.239109+0000","last_fullsized":"2024-09-12T02:46:37.239109+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:13.696027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.237415+0000","last_change":"2024-09-12T02:46:37.235451+0000","last_active":"2024-09-12T02:46:37.237415+0000","last_peered":"2024-09-12T02:46:37.237415+0000","last_clean":"2024-09-12T02:46:37.237415+0000","last_became_active":"2024-09-12T02:46:37.233775+0000","last_became_peered":"2024-09-12T02:46:37.233775+0000","last_unstale":"2024-09-12T02:46:37.237415+0000","last_undegraded":"2024-09-12T02:46:37.237415+0000","last_fullsized":"2024-09-12T02:46:37.237415+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:59.564683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.232134+0000","last_change":"2024-09-12T02:46:37.231757+0000","last_active":"2024-09-12T02:46:37.232134+0000","last_peered":"2024-09-12T02:46:37.232134+0000","last_clean":"2024-09-12T02:46:37.232134+0000","last_became_active":"2024-09-12T02:46:37.231434+0000","last_became_peered":"2024-09-12T02:46:37.231434+0000","last_unstale":"2024-09-12T02:46:37.232134+0000","last_undegraded":"2024-09-12T02:46:37.232134+0000","last_fullsized":"2024-09-12T02:46:37.232134+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:17.338161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.232373+0000","last_change":"2024-09-12T02:46:37.232157+0000","last_active":"2024-09-12T02:46:37.232373+0000","last_peered":"2024-09-12T02:46:37.232373+0000","last_clean":"2024-09-12T02:46:37.232373+0000","last_became_active":"2024-09-12T02:46:37.231906+0000","last_became_peered":"2024-09-12T02:46:37.231906+0000","last_unstale":"2024-09-12T02:46:37.232373+0000","last_undegraded":"2024-09-12T02:46:37.232373+0000","last_fullsized":"2024-09-12T02:46:37.232373+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:25.743940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.231440+0000","last_change":"2024-09-12T02:46:37.231142+0000","last_active":"2024-09-12T02:46:37.231440+0000","last_peered":"2024-09-12T02:46:37.231440+0000","last_clean":"2024-09-12T02:46:37.231440+0000","last_became_active":"2024-09-12T02:46:37.230906+0000","last_became_peered":"2024-09-12T02:46:37.230906+0000","last_unstale":"2024-09-12T02:46:37.231440+0000","last_undegraded":"2024-09-12T02:46:37.231440+0000","last_fullsized":"2024-09-12T02:46:37.231440+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:04.667906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.223517+0000","last_change":"2024-09-12T02:46:37.223110+0000","last_active":"2024-09-12T02:46:37.223517+0000","last_peered":"2024-09-12T02:46:37.223517+0000","last_clean":"2024-09-12T02:46:37.223517+0000","last_became_active":"2024-09-12T02:46:37.222694+0000","last_became_peered":"2024-09-12T02:46:37.222694+0000","last_unstale":"2024-09-12T02:46:37.223517+0000","last_undegraded":"2024-09-12T02:46:37.223517+0000","last_fullsized":"2024-09-12T02:46:37.223517+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:51.969455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.236767+0000","last_change":"2024-09-12T02:46:37.235935+0000","last_active":"2024-09-12T02:46:37.236767+0000","last_peered":"2024-09-12T02:46:37.236767+0000","last_clean":"2024-09-12T02:46:37.236767+0000","last_became_active":"2024-09-12T02:46:37.235169+0000","last_became_peered":"2024-09-12T02:46:37.235169+0000","last_unstale":"2024-09-12T02:46:37.236767+0000","last_undegraded":"2024-09-12T02:46:37.236767+0000","last_fullsized":"2024-09-12T02:46:37.236767+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:13.794267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.222634+0000","last_change":"2024-09-12T02:46:37.222500+0000","last_active":"2024-09-12T02:46:37.222634+0000","last_peered":"2024-09-12T02:46:37.222634+0000","last_clean":"2024-09-12T02:46:37.222634+0000","last_became_active":"2024-09-12T02:46:37.222213+0000","last_became_peered":"2024-09-12T02:46:37.222213+0000","last_unstale":"2024-09-12T02:46:37.222634+0000","last_undegraded":"2024-09-12T02:46:37.222634+0000","last_fullsized":"2024-09-12T02:46:37.222634+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:12.657311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.238120+0000","last_change":"2024-09-12T02:46:37.237861+0000","last_active":"2024-09-12T02:46:37.238120+0000","last_peered":"2024-09-12T02:46:37.238120+0000","last_clean":"2024-09-12T02:46:37.238120+0000","last_became_active":"2024-09-12T02:46:37.237618+0000","last_became_peered":"2024-09-12T02:46:37.237618+0000","last_unstale":"2024-09-12T02:46:37.238120+0000","last_undegraded":"2024-09-12T02:46:37.238120+0000","last_fullsized":"2024-09-12T02:46:37.238120+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:04.842956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.230603+0000","last_change":"2024-09-12T02:46:37.230450+0000","last_active":"2024-09-12T02:46:37.230603+0000","last_peered":"2024-09-12T02:46:37.230603+0000","last_clean":"2024-09-12T02:46:37.230603+0000","last_became_active":"2024-09-12T02:46:37.229774+0000","last_became_peered":"2024-09-12T02:46:37.229774+0000","last_unstale":"2024-09-12T02:46:37.230603+0000","last_undegraded":"2024-09-12T02:46:37.230603+0000","last_fullsized":"2024-09-12T02:46:37.230603+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:42.707681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.235030+0000","last_change":"2024-09-12T02:46:37.233951+0000","last_active":"2024-09-12T02:46:37.235030+0000","last_peered":"2024-09-12T02:46:37.235030+0000","last_clean":"2024-09-12T02:46:37.235030+0000","last_became_active":"2024-09-12T02:46:37.233714+0000","last_became_peered":"2024-09-12T02:46:37.233714+0000","last_unstale":"2024-09-12T02:46:37.235030+0000","last_undegraded":"2024-09-12T02:46:37.235030+0000","last_fullsized":"2024-09-12T02:46:37.235030+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:14.722250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.236842+0000","last_change":"2024-09-12T02:46:37.236069+0000","last_active":"2024-09-12T02:46:37.236842+0000","last_peered":"2024-09-12T02:46:37.236842+0000","last_clean":"2024-09-12T02:46:37.236842+0000","last_became_active":"2024-09-12T02:46:37.234141+0000","last_became_peered":"2024-09-12T02:46:37.234141+0000","last_unstale":"2024-09-12T02:46:37.236842+0000","last_undegraded":"2024-09-12T02:46:37.236842+0000","last_fullsized":"2024-09-12T02:46:37.236842+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:19:29.876850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.236810+0000","last_change":"2024-09-12T02:46:37.235344+0000","last_active":"2024-09-12T02:46:37.236810+0000","last_peered":"2024-09-12T02:46:37.236810+0000","last_clean":"2024-09-12T02:46:37.236810+0000","last_became_active":"2024-09-12T02:46:37.234569+0000","last_became_peered":"2024-09-12T02:46:37.234569+0000","last_unstale":"2024-09-12T02:46:37.236810+0000","last_undegraded":"2024-09-12T02:46:37.236810+0000","last_fullsized":"2024-09-12T02:46:37.236810+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:48.247538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.226323+0000","last_change":"2024-09-12T02:46:37.225945+0000","last_active":"2024-09-12T02:46:37.226323+0000","last_peered":"2024-09-12T02:46:37.226323+0000","last_clean":"2024-09-12T02:46:37.226323+0000","last_became_active":"2024-09-12T02:46:37.225712+0000","last_became_peered":"2024-09-12T02:46:37.225712+0000","last_unstale":"2024-09-12T02:46:37.226323+0000","last_undegraded":"2024-09-12T02:46:37.226323+0000","last_fullsized":"2024-09-12T02:46:37.226323+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:11.114696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.229234+0000","last_change":"2024-09-12T02:46:37.229015+0000","last_active":"2024-09-12T02:46:37.229234+0000","last_peered":"2024-09-12T02:46:37.229234+0000","last_clean":"2024-09-12T02:46:37.229234+0000","last_became_active":"2024-09-12T02:46:37.228159+0000","last_became_peered":"2024-09-12T02:46:37.228159+0000","last_unstale":"2024-09-12T02:46:37.229234+0000","last_undegraded":"2024-09-12T02:46:37.229234+0000","last_fullsized":"2024-09-12T02:46:37.229234+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:10.039467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.226660+0000","last_change":"2024-09-12T02:46:37.226390+0000","last_active":"2024-09-12T02:46:37.226660+0000","last_peered":"2024-09-12T02:46:37.226660+0000","last_clean":"2024-09-12T02:46:37.226660+0000","last_became_active":"2024-09-12T02:46:37.225019+0000","last_became_peered":"2024-09-12T02:46:37.225019+0000","last_unstale":"2024-09-12T02:46:37.226660+0000","last_undegraded":"2024-09-12T02:46:37.226660+0000","last_fullsized":"2024-09-12T02:46:37.226660+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:28.010732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.226636+0000","last_change":"2024-09-12T02:46:37.226272+0000","last_active":"2024-09-12T02:46:37.226636+0000","last_peered":"2024-09-12T02:46:37.226636+0000","last_clean":"2024-09-12T02:46:37.226636+0000","last_became_active":"2024-09-12T02:46:37.226043+0000","last_became_peered":"2024-09-12T02:46:37.226043+0000","last_unstale":"2024-09-12T02:46:37.226636+0000","last_undegraded":"2024-09-12T02:46:37.226636+0000","last_fullsized":"2024-09-12T02:46:37.226636+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:41.406457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.236264+0000","last_change":"2024-09-12T02:46:37.234531+0000","last_active":"2024-09-12T02:46:37.236264+0000","last_peered":"2024-09-12T02:46:37.236264+0000","last_clean":"2024-09-12T02:46:37.236264+0000","last_became_active":"2024-09-12T02:46:37.233608+0000","last_became_peered":"2024-09-12T02:46:37.233608+0000","last_unstale":"2024-09-12T02:46:37.236264+0000","last_undegraded":"2024-09-12T02:46:37.236264+0000","last_fullsized":"2024-09-12T02:46:37.236264+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:24.820842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.226475+0000","last_change":"2024-09-12T02:46:37.226302+0000","last_active":"2024-09-12T02:46:37.226475+0000","last_peered":"2024-09-12T02:46:37.226475+0000","last_clean":"2024-09-12T02:46:37.226475+0000","last_became_active":"2024-09-12T02:46:37.225769+0000","last_became_peered":"2024-09-12T02:46:37.225769+0000","last_unstale":"2024-09-12T02:46:37.226475+0000","last_undegraded":"2024-09-12T02:46:37.226475+0000","last_fullsized":"2024-09-12T02:46:37.226475+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:04.390339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.227623+0000","last_change":"2024-09-12T02:46:37.227189+0000","last_active":"2024-09-12T02:46:37.227623+0000","last_peered":"2024-09-12T02:46:37.227623+0000","last_clean":"2024-09-12T02:46:37.227623+0000","last_became_active":"2024-09-12T02:46:37.226746+0000","last_became_peered":"2024-09-12T02:46:37.226746+0000","last_unstale":"2024-09-12T02:46:37.227623+0000","last_undegraded":"2024-09-12T02:46:37.227623+0000","last_fullsized":"2024-09-12T02:46:37.227623+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:38.957540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.233103+0000","last_change":"2024-09-12T02:46:37.230732+0000","last_active":"2024-09-12T02:46:37.233103+0000","last_peered":"2024-09-12T02:46:37.233103+0000","last_clean":"2024-09-12T02:46:37.233103+0000","last_became_active":"2024-09-12T02:46:37.230226+0000","last_became_peered":"2024-09-12T02:46:37.230226+0000","last_unstale":"2024-09-12T02:46:37.233103+0000","last_undegraded":"2024-09-12T02:46:37.233103+0000","last_fullsized":"2024-09-12T02:46:37.233103+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:31.700760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.237507+0000","last_change":"2024-09-12T02:46:37.237378+0000","last_active":"2024-09-12T02:46:37.237507+0000","last_peered":"2024-09-12T02:46:37.237507+0000","last_clean":"2024-09-12T02:46:37.237507+0000","last_became_active":"2024-09-12T02:46:37.237144+0000","last_became_peered":"2024-09-12T02:46:37.237144+0000","last_unstale":"2024-09-12T02:46:37.237507+0000","last_undegraded":"2024-09-12T02:46:37.237507+0000","last_fullsized":"2024-09-12T02:46:37.237507+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:12.957684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.236827+0000","last_change":"2024-09-12T02:46:37.235529+0000","last_active":"2024-09-12T02:46:37.236827+0000","last_peered":"2024-09-12T02:46:37.236827+0000","last_clean":"2024-09-12T02:46:37.236827+0000","last_became_active":"2024-09-12T02:46:37.234883+0000","last_became_peered":"2024-09-12T02:46:37.234883+0000","last_unstale":"2024-09-12T02:46:37.236827+0000","last_undegraded":"2024-09-12T02:46:37.236827+0000","last_fullsized":"2024-09-12T02:46:37.236827+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:19.843744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.232631+0000","last_change":"2024-09-12T02:46:37.231843+0000","last_active":"2024-09-12T02:46:37.232631+0000","last_peered":"2024-09-12T02:46:37.232631+0000","last_clean":"2024-09-12T02:46:37.232631+0000","last_became_active":"2024-09-12T02:46:37.231124+0000","last_became_peered":"2024-09-12T02:46:37.231124+0000","last_unstale":"2024-09-12T02:46:37.232631+0000","last_undegraded":"2024-09-12T02:46:37.232631+0000","last_fullsized":"2024-09-12T02:46:37.232631+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:10.922240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.230673+0000","last_change":"2024-09-12T02:46:37.229578+0000","last_active":"2024-09-12T02:46:37.230673+0000","last_peered":"2024-09-12T02:46:37.230673+0000","last_clean":"2024-09-12T02:46:37.230673+0000","last_became_active":"2024-09-12T02:46:37.229361+0000","last_became_peered":"2024-09-12T02:46:37.229361+0000","last_unstale":"2024-09-12T02:46:37.230673+0000","last_undegraded":"2024-09-12T02:46:37.230673+0000","last_fullsized":"2024-09-12T02:46:37.230673+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:21.423466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.236281+0000","last_change":"2024-09-12T02:46:37.232089+0000","last_active":"2024-09-12T02:46:37.236281+0000","last_peered":"2024-09-12T02:46:37.236281+0000","last_clean":"2024-09-12T02:46:37.236281+0000","last_became_active":"2024-09-12T02:46:37.230526+0000","last_became_peered":"2024-09-12T02:46:37.230526+0000","last_unstale":"2024-09-12T02:46:37.236281+0000","last_undegraded":"2024-09-12T02:46:37.236281+0000","last_fullsized":"2024-09-12T02:46:37.236281+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:57.476104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.229230+0000","last_change":"2024-09-12T02:46:37.228932+0000","last_active":"2024-09-12T02:46:37.229230+0000","last_peered":"2024-09-12T02:46:37.229230+0000","last_clean":"2024-09-12T02:46:37.229230+0000","last_became_active":"2024-09-12T02:46:37.228557+0000","last_became_peered":"2024-09-12T02:46:37.228557+0000","last_unstale":"2024-09-12T02:46:37.229230+0000","last_undegraded":"2024-09-12T02:46:37.229230+0000","last_fullsized":"2024-09-12T02:46:37.229230+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:02:48.763691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.236120+0000","last_change":"2024-09-12T02:46:37.235658+0000","last_active":"2024-09-12T02:46:37.236120+0000","last_peered":"2024-09-12T02:46:37.236120+0000","last_clean":"2024-09-12T02:46:37.236120+0000","last_became_active":"2024-09-12T02:46:37.235414+0000","last_became_peered":"2024-09-12T02:46:37.235414+0000","last_unstale":"2024-09-12T02:46:37.236120+0000","last_undegraded":"2024-09-12T02:46:37.236120+0000","last_fullsized":"2024-09-12T02:46:37.236120+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:09.317064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.234197+0000","last_change":"2024-09-12T02:46:37.233824+0000","last_active":"2024-09-12T02:46:37.234197+0000","last_peered":"2024-09-12T02:46:37.234197+0000","last_clean":"2024-09-12T02:46:37.234197+0000","last_became_active":"2024-09-12T02:46:37.233587+0000","last_became_peered":"2024-09-12T02:46:37.233587+0000","last_unstale":"2024-09-12T02:46:37.234197+0000","last_undegraded":"2024-09-12T02:46:37.234197+0000","last_fullsized":"2024-09-12T02:46:37.234197+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:20:41.222651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"96'4","reported_seq":16,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.246329+0000","last_change":"2024-09-12T02:46:36.224784+0000","last_active":"2024-09-12T02:46:37.246329+0000","last_peered":"2024-09-12T02:46:37.246329+0000","last_clean":"2024-09-12T02:46:37.246329+0000","last_became_active":"2024-09-12T02:46:36.223693+0000","last_became_peered":"2024-09-12T02:46:36.223693+0000","last_unstale":"2024-09-12T02:46:37.246329+0000","last_undegraded":"2024-09-12T02:46:37.246329+0000","last_fullsized":"2024-09-12T02:46:37.246329+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:32.885521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.226756+0000","last_change":"2024-09-12T02:46:37.226514+0000","last_active":"2024-09-12T02:46:37.226756+0000","last_peered":"2024-09-12T02:46:37.226756+0000","last_clean":"2024-09-12T02:46:37.226756+0000","last_became_active":"2024-09-12T02:46:37.226079+0000","last_became_peered":"2024-09-12T02:46:37.226079+0000","last_unstale":"2024-09-12T02:46:37.226756+0000","last_undegraded":"2024-09-12T02:46:37.226756+0000","last_fullsized":"2024-09-12T02:46:37.226756+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:00.717404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"96'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.245805+0000","last_change":"2024-09-12T02:46:36.227519+0000","last_active":"2024-09-12T02:46:37.245805+0000","last_peered":"2024-09-12T02:46:37.245805+0000","last_clean":"2024-09-12T02:46:37.245805+0000","last_became_active":"2024-09-12T02:46:36.227269+0000","last_became_peered":"2024-09-12T02:46:36.227269+0000","last_unstale":"2024-09-12T02:46:37.245805+0000","last_undegraded":"2024-09-12T02:46:37.245805+0000","last_fullsized":"2024-09-12T02:46:37.245805+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:53.528592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.232978+0000","last_change":"2024-09-12T02:46:37.232560+0000","last_active":"2024-09-12T02:46:37.232978+0000","last_peered":"2024-09-12T02:46:37.232978+0000","last_clean":"2024-09-12T02:46:37.232978+0000","last_became_active":"2024-09-12T02:46:37.229771+0000","last_became_peered":"2024-09-12T02:46:37.229771+0000","last_unstale":"2024-09-12T02:46:37.232978+0000","last_undegraded":"2024-09-12T02:46:37.232978+0000","last_fullsized":"2024-09-12T02:46:37.232978+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:00.122978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"96'2","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.245894+0000","last_change":"2024-09-12T02:46:36.232686+0000","last_active":"2024-09-12T02:46:37.245894+0000","last_peered":"2024-09-12T02:46:37.245894+0000","last_clean":"2024-09-12T02:46:37.245894+0000","last_became_active":"2024-09-12T02:46:36.232408+0000","last_became_peered":"2024-09-12T02:46:36.232408+0000","last_unstale":"2024-09-12T02:46:37.245894+0000","last_undegraded":"2024-09-12T02:46:37.245894+0000","last_fullsized":"2024-09-12T02:46:37.245894+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:03.709806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.239261+0000","last_change":"2024-09-12T02:46:37.239144+0000","last_active":"2024-09-12T02:46:37.239261+0000","last_peered":"2024-09-12T02:46:37.239261+0000","last_clean":"2024-09-12T02:46:37.239261+0000","last_became_active":"2024-09-12T02:46:37.238780+0000","last_became_peered":"2024-09-12T02:46:37.238780+0000","last_unstale":"2024-09-12T02:46:37.239261+0000","last_undegraded":"2024-09-12T02:46:37.239261+0000","last_fullsized":"2024-09-12T02:46:37.239261+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:07.423132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"96'2","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.245962+0000","last_change":"2024-09-12T02:46:36.227985+0000","last_active":"2024-09-12T02:46:37.245962+0000","last_peered":"2024-09-12T02:46:37.245962+0000","last_clean":"2024-09-12T02:46:37.245962+0000","last_became_active":"2024-09-12T02:46:36.227755+0000","last_became_peered":"2024-09-12T02:46:36.227755+0000","last_unstale":"2024-09-12T02:46:37.245962+0000","last_undegraded":"2024-09-12T02:46:37.245962+0000","last_fullsized":"2024-09-12T02:46:37.245962+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:42.091263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.230715+0000","last_change":"2024-09-12T02:46:37.230587+0000","last_active":"2024-09-12T02:46:37.230715+0000","last_peered":"2024-09-12T02:46:37.230715+0000","last_clean":"2024-09-12T02:46:37.230715+0000","last_became_active":"2024-09-12T02:46:37.228608+0000","last_became_peered":"2024-09-12T02:46:37.228608+0000","last_unstale":"2024-09-12T02:46:37.230715+0000","last_undegraded":"2024-09-12T02:46:37.230715+0000","last_fullsized":"2024-09-12T02:46:37.230715+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:36.655180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"96'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.246073+0000","last_change":"2024-09-12T02:46:36.231221+0000","last_active":"2024-09-12T02:46:37.246073+0000","last_peered":"2024-09-12T02:46:37.246073+0000","last_clean":"2024-09-12T02:46:37.246073+0000","last_became_active":"2024-09-12T02:46:36.230799+0000","last_became_peered":"2024-09-12T02:46:36.230799+0000","last_unstale":"2024-09-12T02:46:37.246073+0000","last_undegraded":"2024-09-12T02:46:37.246073+0000","last_fullsized":"2024-09-12T02:46:37.246073+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:26.403745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.236790+0000","last_change":"2024-09-12T02:46:37.235143+0000","last_active":"2024-09-12T02:46:37.236790+0000","last_peered":"2024-09-12T02:46:37.236790+0000","last_clean":"2024-09-12T02:46:37.236790+0000","last_became_active":"2024-09-12T02:46:37.234060+0000","last_became_peered":"2024-09-12T02:46:37.234060+0000","last_unstale":"2024-09-12T02:46:37.236790+0000","last_undegraded":"2024-09-12T02:46:37.236790+0000","last_fullsized":"2024-09-12T02:46:37.236790+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:22:28.123640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"96'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.245290+0000","last_change":"2024-09-12T02:46:36.229233+0000","last_active":"2024-09-12T02:46:37.245290+0000","last_peered":"2024-09-12T02:46:37.245290+0000","last_clean":"2024-09-12T02:46:37.245290+0000","last_became_active":"2024-09-12T02:46:36.228991+0000","last_became_peered":"2024-09-12T02:46:36.228991+0000","last_unstale":"2024-09-12T02:46:37.245290+0000","last_undegraded":"2024-09-12T02:46:37.245290+0000","last_fullsized":"2024-09-12T02:46:37.245290+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:04.783283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.236750+0000","last_change":"2024-09-12T02:46:37.236294+0000","last_active":"2024-09-12T02:46:37.236750+0000","last_peered":"2024-09-12T02:46:37.236750+0000","last_clean":"2024-09-12T02:46:37.236750+0000","last_became_active":"2024-09-12T02:46:37.234858+0000","last_became_peered":"2024-09-12T02:46:37.234858+0000","last_unstale":"2024-09-12T02:46:37.236750+0000","last_undegraded":"2024-09-12T02:46:37.236750+0000","last_fullsized":"2024-09-12T02:46:37.236750+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:02.281116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.225087+0000","last_change":"2024-09-12T02:46:36.230876+0000","last_active":"2024-09-12T02:46:37.225087+0000","last_peered":"2024-09-12T02:46:37.225087+0000","last_clean":"2024-09-12T02:46:37.225087+0000","last_became_active":"2024-09-12T02:46:36.230401+0000","last_became_peered":"2024-09-12T02:46:36.230401+0000","last_unstale":"2024-09-12T02:46:37.225087+0000","last_undegraded":"2024-09-12T02:46:37.225087+0000","last_fullsized":"2024-09-12T02:46:37.225087+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:48.935489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.235049+0000","last_change":"2024-09-12T02:46:37.234144+0000","last_active":"2024-09-12T02:46:37.235049+0000","last_peered":"2024-09-12T02:46:37.235049+0000","last_clean":"2024-09-12T02:46:37.235049+0000","last_became_active":"2024-09-12T02:46:37.233905+0000","last_became_peered":"2024-09-12T02:46:37.233905+0000","last_unstale":"2024-09-12T02:46:37.235049+0000","last_undegraded":"2024-09-12T02:46:37.235049+0000","last_fullsized":"2024-09-12T02:46:37.235049+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:21.369391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.227573+0000","last_change":"2024-09-12T02:46:36.235026+0000","last_active":"2024-09-12T02:46:37.227573+0000","last_peered":"2024-09-12T02:46:37.227573+0000","last_clean":"2024-09-12T02:46:37.227573+0000","last_became_active":"2024-09-12T02:46:36.234023+0000","last_became_peered":"2024-09-12T02:46:36.234023+0000","last_unstale":"2024-09-12T02:46:37.227573+0000","last_undegraded":"2024-09-12T02:46:37.227573+0000","last_fullsized":"2024-09-12T02:46:37.227573+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:53.220323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.235580+0000","last_change":"2024-09-12T02:46:37.235470+0000","last_active":"2024-09-12T02:46:37.235580+0000","last_peered":"2024-09-12T02:46:37.235580+0000","last_clean":"2024-09-12T02:46:37.235580+0000","last_became_active":"2024-09-12T02:46:37.235244+0000","last_became_peered":"2024-09-12T02:46:37.235244+0000","last_unstale":"2024-09-12T02:46:37.235580+0000","last_undegraded":"2024-09-12T02:46:37.235580+0000","last_fullsized":"2024-09-12T02:46:37.235580+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:16.547682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.221434+0000","last_change":"2024-09-12T02:46:36.222330+0000","last_active":"2024-09-12T02:46:37.221434+0000","last_peered":"2024-09-12T02:46:37.221434+0000","last_clean":"2024-09-12T02:46:37.221434+0000","last_became_active":"2024-09-12T02:46:36.222092+0000","last_became_peered":"2024-09-12T02:46:36.222092+0000","last_unstale":"2024-09-12T02:46:37.221434+0000","last_undegraded":"2024-09-12T02:46:37.221434+0000","last_fullsized":"2024-09-12T02:46:37.221434+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:24.261647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.237435+0000","last_change":"2024-09-12T02:46:37.236042+0000","last_active":"2024-09-12T02:46:37.237435+0000","last_peered":"2024-09-12T02:46:37.237435+0000","last_clean":"2024-09-12T02:46:37.237435+0000","last_became_active":"2024-09-12T02:46:37.235724+0000","last_became_peered":"2024-09-12T02:46:37.235724+0000","last_unstale":"2024-09-12T02:46:37.237435+0000","last_undegraded":"2024-09-12T02:46:37.237435+0000","last_fullsized":"2024-09-12T02:46:37.237435+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:09.032503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.221358+0000","last_change":"2024-09-12T02:46:36.226055+0000","last_active":"2024-09-12T02:46:37.221358+0000","last_peered":"2024-09-12T02:46:37.221358+0000","last_clean":"2024-09-12T02:46:37.221358+0000","last_became_active":"2024-09-12T02:46:36.224942+0000","last_became_peered":"2024-09-12T02:46:36.224942+0000","last_unstale":"2024-09-12T02:46:37.221358+0000","last_undegraded":"2024-09-12T02:46:37.221358+0000","last_fullsized":"2024-09-12T02:46:37.221358+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:31.269516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.228538+0000","last_change":"2024-09-12T02:46:37.228366+0000","last_active":"2024-09-12T02:46:37.228538+0000","last_peered":"2024-09-12T02:46:37.228538+0000","last_clean":"2024-09-12T02:46:37.228538+0000","last_became_active":"2024-09-12T02:46:37.227388+0000","last_became_peered":"2024-09-12T02:46:37.227388+0000","last_unstale":"2024-09-12T02:46:37.228538+0000","last_undegraded":"2024-09-12T02:46:37.228538+0000","last_fullsized":"2024-09-12T02:46:37.228538+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:00.551706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"96'3","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.247285+0000","last_change":"2024-09-12T02:46:36.226586+0000","last_active":"2024-09-12T02:46:37.247285+0000","last_peered":"2024-09-12T02:46:37.247285+0000","last_clean":"2024-09-12T02:46:37.247285+0000","last_became_active":"2024-09-12T02:46:36.224545+0000","last_became_peered":"2024-09-12T02:46:36.224545+0000","last_unstale":"2024-09-12T02:46:37.247285+0000","last_undegraded":"2024-09-12T02:46:37.247285+0000","last_fullsized":"2024-09-12T02:46:37.247285+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:27.957556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.228215+0000","last_change":"2024-09-12T02:46:37.228057+0000","last_active":"2024-09-12T02:46:37.228215+0000","last_peered":"2024-09-12T02:46:37.228215+0000","last_clean":"2024-09-12T02:46:37.228215+0000","last_became_active":"2024-09-12T02:46:37.226988+0000","last_became_peered":"2024-09-12T02:46:37.226988+0000","last_unstale":"2024-09-12T02:46:37.228215+0000","last_undegraded":"2024-09-12T02:46:37.228215+0000","last_fullsized":"2024-09-12T02:46:37.228215+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:17.385150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"96'6","reported_seq":18,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.248168+0000","last_change":"2024-09-12T02:46:36.229471+0000","last_active":"2024-09-12T02:46:37.248168+0000","last_peered":"2024-09-12T02:46:37.248168+0000","last_clean":"2024-09-12T02:46:37.248168+0000","last_became_active":"2024-09-12T02:46:36.229083+0000","last_became_peered":"2024-09-12T02:46:36.229083+0000","last_unstale":"2024-09-12T02:46:37.248168+0000","last_undegraded":"2024-09-12T02:46:37.248168+0000","last_fullsized":"2024-09-12T02:46:37.248168+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:33.793157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.230909+0000","last_change":"2024-09-12T02:46:37.230796+0000","last_active":"2024-09-12T02:46:37.230909+0000","last_peered":"2024-09-12T02:46:37.230909+0000","last_clean":"2024-09-12T02:46:37.230909+0000","last_became_active":"2024-09-12T02:46:37.230274+0000","last_became_peered":"2024-09-12T02:46:37.230274+0000","last_unstale":"2024-09-12T02:46:37.230909+0000","last_undegraded":"2024-09-12T02:46:37.230909+0000","last_fullsized":"2024-09-12T02:46:37.230909+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:06.439648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"96'2","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.247084+0000","last_change":"2024-09-12T02:46:36.235179+0000","last_active":"2024-09-12T02:46:37.247084+0000","last_peered":"2024-09-12T02:46:37.247084+0000","last_clean":"2024-09-12T02:46:37.247084+0000","last_became_active":"2024-09-12T02:46:36.234486+0000","last_became_peered":"2024-09-12T02:46:36.234486+0000","last_unstale":"2024-09-12T02:46:37.247084+0000","last_undegraded":"2024-09-12T02:46:37.247084+0000","last_fullsized":"2024-09-12T02:46:37.247084+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:29.161560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.238323+0000","last_change":"2024-09-12T02:46:37.238112+0000","last_active":"2024-09-12T02:46:37.238323+0000","last_peered":"2024-09-12T02:46:37.238323+0000","last_clean":"2024-09-12T02:46:37.238323+0000","last_became_active":"2024-09-12T02:46:37.235909+0000","last_became_peered":"2024-09-12T02:46:37.235909+0000","last_unstale":"2024-09-12T02:46:37.238323+0000","last_undegraded":"2024-09-12T02:46:37.238323+0000","last_fullsized":"2024-09-12T02:46:37.238323+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:29.776465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.220884+0000","last_change":"2024-09-12T02:46:36.223977+0000","last_active":"2024-09-12T02:46:37.220884+0000","last_peered":"2024-09-12T02:46:37.220884+0000","last_clean":"2024-09-12T02:46:37.220884+0000","last_became_active":"2024-09-12T02:46:36.223757+0000","last_became_peered":"2024-09-12T02:46:36.223757+0000","last_unstale":"2024-09-12T02:46:37.220884+0000","last_undegraded":"2024-09-12T02:46:37.220884+0000","last_fullsized":"2024-09-12T02:46:37.220884+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:29.487280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.230693+0000","last_change":"2024-09-12T02:46:37.230419+0000","last_active":"2024-09-12T02:46:37.230693+0000","last_peered":"2024-09-12T02:46:37.230693+0000","last_clean":"2024-09-12T02:46:37.230693+0000","last_became_active":"2024-09-12T02:46:37.228360+0000","last_became_peered":"2024-09-12T02:46:37.228360+0000","last_unstale":"2024-09-12T02:46:37.230693+0000","last_undegraded":"2024-09-12T02:46:37.230693+0000","last_fullsized":"2024-09-12T02:46:37.230693+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:17.993272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.226275+0000","last_change":"2024-09-12T02:46:36.231223+0000","last_active":"2024-09-12T02:46:37.226275+0000","last_peered":"2024-09-12T02:46:37.226275+0000","last_clean":"2024-09-12T02:46:37.226275+0000","last_became_active":"2024-09-12T02:46:36.230808+0000","last_became_peered":"2024-09-12T02:46:36.230808+0000","last_unstale":"2024-09-12T02:46:37.226275+0000","last_undegraded":"2024-09-12T02:46:37.226275+0000","last_fullsized":"2024-09-12T02:46:37.226275+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:52.222934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.236234+0000","last_change":"2024-09-12T02:46:37.234353+0000","last_active":"2024-09-12T02:46:37.236234+0000","last_peered":"2024-09-12T02:46:37.236234+0000","last_clean":"2024-09-12T02:46:37.236234+0000","last_became_active":"2024-09-12T02:46:37.233216+0000","last_became_peered":"2024-09-12T02:46:37.233216+0000","last_unstale":"2024-09-12T02:46:37.236234+0000","last_undegraded":"2024-09-12T02:46:37.236234+0000","last_fullsized":"2024-09-12T02:46:37.236234+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:25.123973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"96'8","reported_seq":20,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.246737+0000","last_change":"2024-09-12T02:46:36.231452+0000","last_active":"2024-09-12T02:46:37.246737+0000","last_peered":"2024-09-12T02:46:37.246737+0000","last_clean":"2024-09-12T02:46:37.246737+0000","last_became_active":"2024-09-12T02:46:36.231187+0000","last_became_peered":"2024-09-12T02:46:36.231187+0000","last_unstale":"2024-09-12T02:46:37.246737+0000","last_undegraded":"2024-09-12T02:46:37.246737+0000","last_fullsized":"2024-09-12T02:46:37.246737+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:31.450544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.238566+0000","last_change":"2024-09-12T02:46:37.238418+0000","last_active":"2024-09-12T02:46:37.238566+0000","last_peered":"2024-09-12T02:46:37.238566+0000","last_clean":"2024-09-12T02:46:37.238566+0000","last_became_active":"2024-09-12T02:46:37.237814+0000","last_became_peered":"2024-09-12T02:46:37.237814+0000","last_unstale":"2024-09-12T02:46:37.238566+0000","last_undegraded":"2024-09-12T02:46:37.238566+0000","last_fullsized":"2024-09-12T02:46:37.238566+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:53.038531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"96'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.243078+0000","last_change":"2024-09-12T02:46:36.225486+0000","last_active":"2024-09-12T02:46:37.243078+0000","last_peered":"2024-09-12T02:46:37.243078+0000","last_clean":"2024-09-12T02:46:37.243078+0000","last_became_active":"2024-09-12T02:46:36.224981+0000","last_became_peered":"2024-09-12T02:46:36.224981+0000","last_unstale":"2024-09-12T02:46:37.243078+0000","last_undegraded":"2024-09-12T02:46:37.243078+0000","last_fullsized":"2024-09-12T02:46:37.243078+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:51.188438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.233030+0000","last_change":"2024-09-12T02:46:37.232389+0000","last_active":"2024-09-12T02:46:37.233030+0000","last_peered":"2024-09-12T02:46:37.233030+0000","last_clean":"2024-09-12T02:46:37.233030+0000","last_became_active":"2024-09-12T02:46:37.232144+0000","last_became_peered":"2024-09-12T02:46:37.232144+0000","last_unstale":"2024-09-12T02:46:37.233030+0000","last_undegraded":"2024-09-12T02:46:37.233030+0000","last_fullsized":"2024-09-12T02:46:37.233030+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:47.341868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"96'2","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.246649+0000","last_change":"2024-09-12T02:46:36.232098+0000","last_active":"2024-09-12T02:46:37.246649+0000","last_peered":"2024-09-12T02:46:37.246649+0000","last_clean":"2024-09-12T02:46:37.246649+0000","last_became_active":"2024-09-12T02:46:36.231801+0000","last_became_peered":"2024-09-12T02:46:36.231801+0000","last_unstale":"2024-09-12T02:46:37.246649+0000","last_undegraded":"2024-09-12T02:46:37.246649+0000","last_fullsized":"2024-09-12T02:46:37.246649+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:55.301285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.236858+0000","last_change":"2024-09-12T02:46:37.236677+0000","last_active":"2024-09-12T02:46:37.236858+0000","last_peered":"2024-09-12T02:46:37.236858+0000","last_clean":"2024-09-12T02:46:37.236858+0000","last_became_active":"2024-09-12T02:46:37.236451+0000","last_became_peered":"2024-09-12T02:46:37.236451+0000","last_unstale":"2024-09-12T02:46:37.236858+0000","last_undegraded":"2024-09-12T02:46:37.236858+0000","last_fullsized":"2024-09-12T02:46:37.236858+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:56.933279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.223706+0000","last_change":"2024-09-12T02:46:36.230493+0000","last_active":"2024-09-12T02:46:37.223706+0000","last_peered":"2024-09-12T02:46:37.223706+0000","last_clean":"2024-09-12T02:46:37.223706+0000","last_became_active":"2024-09-12T02:46:36.230258+0000","last_became_peered":"2024-09-12T02:46:36.230258+0000","last_unstale":"2024-09-12T02:46:37.223706+0000","last_undegraded":"2024-09-12T02:46:37.223706+0000","last_fullsized":"2024-09-12T02:46:37.223706+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:25.182309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.230377+0000","last_change":"2024-09-12T02:46:37.230275+0000","last_active":"2024-09-12T02:46:37.230377+0000","last_peered":"2024-09-12T02:46:37.230377+0000","last_clean":"2024-09-12T02:46:37.230377+0000","last_became_active":"2024-09-12T02:46:37.229475+0000","last_became_peered":"2024-09-12T02:46:37.229475+0000","last_unstale":"2024-09-12T02:46:37.230377+0000","last_undegraded":"2024-09-12T02:46:37.230377+0000","last_fullsized":"2024-09-12T02:46:37.230377+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:13.733067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"96'2","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.246195+0000","last_change":"2024-09-12T02:46:36.223413+0000","last_active":"2024-09-12T02:46:37.246195+0000","last_peered":"2024-09-12T02:46:37.246195+0000","last_clean":"2024-09-12T02:46:37.246195+0000","last_became_active":"2024-09-12T02:46:36.222696+0000","last_became_peered":"2024-09-12T02:46:36.222696+0000","last_unstale":"2024-09-12T02:46:37.246195+0000","last_undegraded":"2024-09-12T02:46:37.246195+0000","last_fullsized":"2024-09-12T02:46:37.246195+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:11.318470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.229846+0000","last_change":"2024-09-12T02:46:37.229537+0000","last_active":"2024-09-12T02:46:37.229846+0000","last_peered":"2024-09-12T02:46:37.229846+0000","last_clean":"2024-09-12T02:46:37.229846+0000","last_became_active":"2024-09-12T02:46:37.229310+0000","last_became_peered":"2024-09-12T02:46:37.229310+0000","last_unstale":"2024-09-12T02:46:37.229846+0000","last_undegraded":"2024-09-12T02:46:37.229846+0000","last_fullsized":"2024-09-12T02:46:37.229846+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:01.704884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.220724+0000","last_change":"2024-09-12T02:46:36.229150+0000","last_active":"2024-09-12T02:46:37.220724+0000","last_peered":"2024-09-12T02:46:37.220724+0000","last_clean":"2024-09-12T02:46:37.220724+0000","last_became_active":"2024-09-12T02:46:36.228902+0000","last_became_peered":"2024-09-12T02:46:36.228902+0000","last_unstale":"2024-09-12T02:46:37.220724+0000","last_undegraded":"2024-09-12T02:46:37.220724+0000","last_fullsized":"2024-09-12T02:46:37.220724+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:18.326131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.231394+0000","last_change":"2024-09-12T02:46:37.230501+0000","last_active":"2024-09-12T02:46:37.231394+0000","last_peered":"2024-09-12T02:46:37.231394+0000","last_clean":"2024-09-12T02:46:37.231394+0000","last_became_active":"2024-09-12T02:46:37.230157+0000","last_became_peered":"2024-09-12T02:46:37.230157+0000","last_unstale":"2024-09-12T02:46:37.231394+0000","last_undegraded":"2024-09-12T02:46:37.231394+0000","last_fullsized":"2024-09-12T02:46:37.231394+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:50.779729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.219865+0000","last_change":"2024-09-12T02:46:36.231450+0000","last_active":"2024-09-12T02:46:37.219865+0000","last_peered":"2024-09-12T02:46:37.219865+0000","last_clean":"2024-09-12T02:46:37.219865+0000","last_became_active":"2024-09-12T02:46:36.231165+0000","last_became_peered":"2024-09-12T02:46:36.231165+0000","last_unstale":"2024-09-12T02:46:37.219865+0000","last_undegraded":"2024-09-12T02:46:37.219865+0000","last_fullsized":"2024-09-12T02:46:37.219865+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:42.201000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.232353+0000","last_change":"2024-09-12T02:46:37.231651+0000","last_active":"2024-09-12T02:46:37.232353+0000","last_peered":"2024-09-12T02:46:37.232353+0000","last_clean":"2024-09-12T02:46:37.232353+0000","last_became_active":"2024-09-12T02:46:37.230613+0000","last_became_peered":"2024-09-12T02:46:37.230613+0000","last_unstale":"2024-09-12T02:46:37.232353+0000","last_undegraded":"2024-09-12T02:46:37.232353+0000","last_fullsized":"2024-09-12T02:46:37.232353+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:02.840095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.221025+0000","last_change":"2024-09-12T02:46:36.222140+0000","last_active":"2024-09-12T02:46:37.221025+0000","last_peered":"2024-09-12T02:46:37.221025+0000","last_clean":"2024-09-12T02:46:37.221025+0000","last_became_active":"2024-09-12T02:46:36.221853+0000","last_became_peered":"2024-09-12T02:46:36.221853+0000","last_unstale":"2024-09-12T02:46:37.221025+0000","last_undegraded":"2024-09-12T02:46:37.221025+0000","last_fullsized":"2024-09-12T02:46:37.221025+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:38.316668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.232612+0000","last_change":"2024-09-12T02:46:37.232332+0000","last_active":"2024-09-12T02:46:37.232612+0000","last_peered":"2024-09-12T02:46:37.232612+0000","last_clean":"2024-09-12T02:46:37.232612+0000","last_became_active":"2024-09-12T02:46:37.230705+0000","last_became_peered":"2024-09-12T02:46:37.230705+0000","last_unstale":"2024-09-12T02:46:37.232612+0000","last_undegraded":"2024-09-12T02:46:37.232612+0000","last_fullsized":"2024-09-12T02:46:37.232612+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:04.466536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"96'2","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.247428+0000","last_change":"2024-09-12T02:46:36.232563+0000","last_active":"2024-09-12T02:46:37.247428+0000","last_peered":"2024-09-12T02:46:37.247428+0000","last_clean":"2024-09-12T02:46:37.247428+0000","last_became_active":"2024-09-12T02:46:36.231991+0000","last_became_peered":"2024-09-12T02:46:36.231991+0000","last_unstale":"2024-09-12T02:46:37.247428+0000","last_undegraded":"2024-09-12T02:46:37.247428+0000","last_fullsized":"2024-09-12T02:46:37.247428+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:06.733631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.236156+0000","last_change":"2024-09-12T02:46:37.236010+0000","last_active":"2024-09-12T02:46:37.236156+0000","last_peered":"2024-09-12T02:46:37.236156+0000","last_clean":"2024-09-12T02:46:37.236156+0000","last_became_active":"2024-09-12T02:46:37.235691+0000","last_became_peered":"2024-09-12T02:46:37.235691+0000","last_unstale":"2024-09-12T02:46:37.236156+0000","last_undegraded":"2024-09-12T02:46:37.236156+0000","last_fullsized":"2024-09-12T02:46:37.236156+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:03.394491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.228011+0000","last_change":"2024-09-12T02:46:36.233334+0000","last_active":"2024-09-12T02:46:37.228011+0000","last_peered":"2024-09-12T02:46:37.228011+0000","last_clean":"2024-09-12T02:46:37.228011+0000","last_became_active":"2024-09-12T02:46:36.233115+0000","last_became_peered":"2024-09-12T02:46:36.233115+0000","last_unstale":"2024-09-12T02:46:37.228011+0000","last_undegraded":"2024-09-12T02:46:37.228011+0000","last_fullsized":"2024-09-12T02:46:37.228011+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:52.491438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.225257+0000","last_change":"2024-09-12T02:46:37.225141+0000","last_active":"2024-09-12T02:46:37.225257+0000","last_peered":"2024-09-12T02:46:37.225257+0000","last_clean":"2024-09-12T02:46:37.225257+0000","last_became_active":"2024-09-12T02:46:37.224895+0000","last_became_peered":"2024-09-12T02:46:37.224895+0000","last_unstale":"2024-09-12T02:46:37.225257+0000","last_undegraded":"2024-09-12T02:46:37.225257+0000","last_fullsized":"2024-09-12T02:46:37.225257+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:05.657223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.222000+0000","last_change":"2024-09-12T02:46:36.224654+0000","last_active":"2024-09-12T02:46:37.222000+0000","last_peered":"2024-09-12T02:46:37.222000+0000","last_clean":"2024-09-12T02:46:37.222000+0000","last_became_active":"2024-09-12T02:46:36.224408+0000","last_became_peered":"2024-09-12T02:46:36.224408+0000","last_unstale":"2024-09-12T02:46:37.222000+0000","last_undegraded":"2024-09-12T02:46:37.222000+0000","last_fullsized":"2024-09-12T02:46:37.222000+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:16.849515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.233252+0000","last_change":"2024-09-12T02:46:37.233091+0000","last_active":"2024-09-12T02:46:37.233252+0000","last_peered":"2024-09-12T02:46:37.233252+0000","last_clean":"2024-09-12T02:46:37.233252+0000","last_became_active":"2024-09-12T02:46:37.231664+0000","last_became_peered":"2024-09-12T02:46:37.231664+0000","last_unstale":"2024-09-12T02:46:37.233252+0000","last_undegraded":"2024-09-12T02:46:37.233252+0000","last_fullsized":"2024-09-12T02:46:37.233252+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:25.219781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.222231+0000","last_change":"2024-09-12T02:46:36.227511+0000","last_active":"2024-09-12T02:46:37.222231+0000","last_peered":"2024-09-12T02:46:37.222231+0000","last_clean":"2024-09-12T02:46:37.222231+0000","last_became_active":"2024-09-12T02:46:36.227092+0000","last_became_peered":"2024-09-12T02:46:36.227092+0000","last_unstale":"2024-09-12T02:46:37.222231+0000","last_undegraded":"2024-09-12T02:46:37.222231+0000","last_fullsized":"2024-09-12T02:46:37.222231+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:00.257008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.229865+0000","last_change":"2024-09-12T02:46:37.229645+0000","last_active":"2024-09-12T02:46:37.229865+0000","last_peered":"2024-09-12T02:46:37.229865+0000","last_clean":"2024-09-12T02:46:37.229865+0000","last_became_active":"2024-09-12T02:46:37.229427+0000","last_became_peered":"2024-09-12T02:46:37.229427+0000","last_unstale":"2024-09-12T02:46:37.229865+0000","last_undegraded":"2024-09-12T02:46:37.229865+0000","last_fullsized":"2024-09-12T02:46:37.229865+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:10.901089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.224216+0000","last_change":"2024-09-12T02:46:36.232368+0000","last_active":"2024-09-12T02:46:37.224216+0000","last_peered":"2024-09-12T02:46:37.224216+0000","last_clean":"2024-09-12T02:46:37.224216+0000","last_became_active":"2024-09-12T02:46:36.231924+0000","last_became_peered":"2024-09-12T02:46:36.231924+0000","last_unstale":"2024-09-12T02:46:37.224216+0000","last_undegraded":"2024-09-12T02:46:37.224216+0000","last_fullsized":"2024-09-12T02:46:37.224216+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:14.540032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.230813+0000","last_change":"2024-09-12T02:46:37.230607+0000","last_active":"2024-09-12T02:46:37.230813+0000","last_peered":"2024-09-12T02:46:37.230813+0000","last_clean":"2024-09-12T02:46:37.230813+0000","last_became_active":"2024-09-12T02:46:37.229968+0000","last_became_peered":"2024-09-12T02:46:37.229968+0000","last_unstale":"2024-09-12T02:46:37.230813+0000","last_undegraded":"2024-09-12T02:46:37.230813+0000","last_fullsized":"2024-09-12T02:46:37.230813+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:00.646946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.226227+0000","last_change":"2024-09-12T02:46:36.229399+0000","last_active":"2024-09-12T02:46:37.226227+0000","last_peered":"2024-09-12T02:46:37.226227+0000","last_clean":"2024-09-12T02:46:37.226227+0000","last_became_active":"2024-09-12T02:46:36.229064+0000","last_became_peered":"2024-09-12T02:46:36.229064+0000","last_unstale":"2024-09-12T02:46:37.226227+0000","last_undegraded":"2024-09-12T02:46:37.226227+0000","last_fullsized":"2024-09-12T02:46:37.226227+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:27:22.060833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.237916+0000","last_change":"2024-09-12T02:46:37.237783+0000","last_active":"2024-09-12T02:46:37.237916+0000","last_peered":"2024-09-12T02:46:37.237916+0000","last_clean":"2024-09-12T02:46:37.237916+0000","last_became_active":"2024-09-12T02:46:37.237531+0000","last_became_peered":"2024-09-12T02:46:37.237531+0000","last_unstale":"2024-09-12T02:46:37.237916+0000","last_undegraded":"2024-09-12T02:46:37.237916+0000","last_fullsized":"2024-09-12T02:46:37.237916+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:40.459177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.223103+0000","last_change":"2024-09-12T02:46:36.228530+0000","last_active":"2024-09-12T02:46:37.223103+0000","last_peered":"2024-09-12T02:46:37.223103+0000","last_clean":"2024-09-12T02:46:37.223103+0000","last_became_active":"2024-09-12T02:46:36.228153+0000","last_became_peered":"2024-09-12T02:46:36.228153+0000","last_unstale":"2024-09-12T02:46:37.223103+0000","last_undegraded":"2024-09-12T02:46:37.223103+0000","last_fullsized":"2024-09-12T02:46:37.223103+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:20.076895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.227501+0000","last_change":"2024-09-12T02:46:37.227378+0000","last_active":"2024-09-12T02:46:37.227501+0000","last_peered":"2024-09-12T02:46:37.227501+0000","last_clean":"2024-09-12T02:46:37.227501+0000","last_became_active":"2024-09-12T02:46:37.227148+0000","last_became_peered":"2024-09-12T02:46:37.227148+0000","last_unstale":"2024-09-12T02:46:37.227501+0000","last_undegraded":"2024-09-12T02:46:37.227501+0000","last_fullsized":"2024-09-12T02:46:37.227501+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:29.461189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.228717+0000","last_change":"2024-09-12T02:46:36.230343+0000","last_active":"2024-09-12T02:46:37.228717+0000","last_peered":"2024-09-12T02:46:37.228717+0000","last_clean":"2024-09-12T02:46:37.228717+0000","last_became_active":"2024-09-12T02:46:36.229891+0000","last_became_peered":"2024-09-12T02:46:36.229891+0000","last_unstale":"2024-09-12T02:46:37.228717+0000","last_undegraded":"2024-09-12T02:46:37.228717+0000","last_fullsized":"2024-09-12T02:46:37.228717+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:28.130288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.236332+0000","last_change":"2024-09-12T02:46:37.234924+0000","last_active":"2024-09-12T02:46:37.236332+0000","last_peered":"2024-09-12T02:46:37.236332+0000","last_clean":"2024-09-12T02:46:37.236332+0000","last_became_active":"2024-09-12T02:46:37.234137+0000","last_became_peered":"2024-09-12T02:46:37.234137+0000","last_unstale":"2024-09-12T02:46:37.236332+0000","last_undegraded":"2024-09-12T02:46:37.236332+0000","last_fullsized":"2024-09-12T02:46:37.236332+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:36.205587+0000","last_clean_scrub_stamp":"2024-09-12T02:46:36.205587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:48.954739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"96'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.246773+0000","last_change":"2024-09-12T02:46:36.228613+0000","last_active":"2024-09-12T02:46:37.246773+0000","last_peered":"2024-09-12T02:46:37.246773+0000","last_clean":"2024-09-12T02:46:37.246773+0000","last_became_active":"2024-09-12T02:46:36.228388+0000","last_became_peered":"2024-09-12T02:46:36.228388+0000","last_unstale":"2024-09-12T02:46:37.246773+0000","last_undegraded":"2024-09-12T02:46:37.246773+0000","last_fullsized":"2024-09-12T02:46:37.246773+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:46:35.197910+0000","last_clean_scrub_stamp":"2024-09-12T02:46:35.197910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:44.223620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":317,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:37.230025+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:46:37.230025+0000","last_peered":"2024-09-12T02:46:37.230025+0000","last_clean":"2024-09-12T02:46:37.230025+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:46:37.230025+0000","last_undegraded":"2024-09-12T02:46:37.230025+0000","last_fullsized":"2024-09-12T02:46:37.230025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:03.222374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574909,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1080,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194232,"statfs":{"total":200000000,"available":198893853,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":504,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194808,"statfs":{"total":200000000,"available":199483597,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574909,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":497,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194815,"statfs":{"total":200000000,"available":199491066,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":497,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194815,"statfs":{"total":200000000,"available":199491066,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574909,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":505,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194807,"statfs":{"total":200000000,"available":199482679,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":504,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194808,"statfs":{"total":200000000,"available":199483709,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":503,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194808,"statfs":{"total":200000000,"available":199484097,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574909,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1080,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194232,"statfs":{"total":200000000,"available":198893889,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:46:41.808 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:46:41.808 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T02:46:42.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.004+0000 7f0134a00640 1 Processor -- start 2024-09-12T02:46:42.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.004+0000 7f0134a00640 1 -- start start 2024-09-12T02:46:42.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.005+0000 7f0134a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f01301605e0 0x7f0130160a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:42.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.005+0000 7f0134a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0130160f40 con 0x7f0130071840 2024-09-12T02:46:42.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.005+0000 7f0134a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01300b3af0 con 0x7f01301466f0 2024-09-12T02:46:42.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.005+0000 7f0134a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f01300b3dd0 con 0x7f01301605e0 2024-09-12T02:46:42.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.006+0000 7f012d400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f01301605e0 0x7f0130160a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:42.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.006+0000 7f012d400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f01301605e0 0x7f0130160a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48080/0 (socket says 172.21.15.112:48080) 2024-09-12T02:46:42.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.006+0000 7f012d400640 1 -- 172.21.15.112:0/3489330462 learned_addr learned my addr 172.21.15.112:0/3489330462 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:42.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.006+0000 7f012d400640 1 -- 172.21.15.112:0/3489330462 >> v1:172.21.15.137:6789/0 conn(0x7f01301466f0 legacy=0x7f01300b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:42.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.006+0000 7f012d400640 1 -- 172.21.15.112:0/3489330462 >> v1:172.21.15.112:6789/0 conn(0x7f0130071840 legacy=0x7f0130071cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:42.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.006+0000 7f012d400640 1 -- 172.21.15.112:0/3489330462 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01300b40b0 con 0x7f01301605e0 2024-09-12T02:46:42.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.007+0000 7f012d400640 1 --2- 172.21.15.112:0/3489330462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01301605e0 0x7f0130160a00 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f011c009870 tx=0x7f011c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e08cf2330b4730 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:42.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.007+0000 7f012ca00640 1 -- 172.21.15.112:0/3489330462 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011c037070 con 0x7f01301605e0 2024-09-12T02:46:42.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.007+0000 7f012ca00640 1 -- 172.21.15.112:0/3489330462 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f011c032440 con 0x7f01301605e0 2024-09-12T02:46:42.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.007+0000 7f012ca00640 1 -- 172.21.15.112:0/3489330462 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011c032810 con 0x7f01301605e0 2024-09-12T02:46:42.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.008+0000 7f0134a00640 1 -- 172.21.15.112:0/3489330462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01301605e0 msgr2=0x7f0130160a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:42.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.008+0000 7f0134a00640 1 --2- 172.21.15.112:0/3489330462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01301605e0 0x7f0130160a00 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f011c009870 tx=0x7f011c02a270 comp rx=0 tx=0).stop 2024-09-12T02:46:42.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.008+0000 7f0134a00640 1 -- 172.21.15.112:0/3489330462 shutdown_connections 2024-09-12T02:46:42.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.008+0000 7f0134a00640 1 --2- 172.21.15.112:0/3489330462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01301605e0 0x7f0130160a00 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:42.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.008+0000 7f0134a00640 1 -- 172.21.15.112:0/3489330462 >> 172.21.15.112:0/3489330462 conn(0x7f01300b28a0 msgr2=0x7f01300b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:42.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.008+0000 7f0134a00640 1 -- 172.21.15.112:0/3489330462 shutdown_connections 2024-09-12T02:46:42.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.008+0000 7f0134a00640 1 -- 172.21.15.112:0/3489330462 wait complete. 2024-09-12T02:46:42.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.010+0000 7f0134a00640 1 Processor -- start 2024-09-12T02:46:42.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.010+0000 7f0134a00640 1 -- start start 2024-09-12T02:46:42.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.011+0000 7f0134a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0130071840 0x7f0130142400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:42.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.011+0000 7f0134a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01301466f0 0x7f01301455b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:42.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.011+0000 7f0134a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01301605e0 0x7f013015ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:42.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.011+0000 7f0134a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f013015e330 con 0x7f01301466f0 2024-09-12T02:46:42.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.011+0000 7f0134a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f013015e1b0 con 0x7f01301605e0 2024-09-12T02:46:42.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.011+0000 7f0134a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f013015e4b0 con 0x7f0130071840 2024-09-12T02:46:42.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.011+0000 7f012d400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01301466f0 0x7f01301455b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:42.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.011+0000 7f012d400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01301466f0 0x7f01301455b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48092/0 (socket says 172.21.15.112:48092) 2024-09-12T02:46:42.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.011+0000 7f012d400640 1 -- 172.21.15.112:0/1993933098 learned_addr learned my addr 172.21.15.112:0/1993933098 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:42.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.011+0000 7f012de00640 1 --2- 172.21.15.112:0/1993933098 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0130071840 0x7f0130142400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:42.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.011+0000 7f012e800640 1 --2- 172.21.15.112:0/1993933098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01301605e0 0x7f013015ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:42.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.011+0000 7f012d400640 1 -- 172.21.15.112:0/1993933098 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0130071840 msgr2=0x7f0130142400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:42.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.011+0000 7f012d400640 1 --2- 172.21.15.112:0/1993933098 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0130071840 0x7f0130142400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:42.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.012+0000 7f012d400640 1 -- 172.21.15.112:0/1993933098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01301605e0 msgr2=0x7f013015ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:42.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.012+0000 7f012d400640 1 --2- 172.21.15.112:0/1993933098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01301605e0 0x7f013015ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:42.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.012+0000 7f012d400640 1 -- 172.21.15.112:0/1993933098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01301597f0 con 0x7f01301466f0 2024-09-12T02:46:42.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.012+0000 7f012d400640 1 --2- 172.21.15.112:0/1993933098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01301466f0 0x7f01301455b0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f011c000c00 tx=0x7f011c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:42.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.012+0000 7f0126000640 1 -- 172.21.15.112:0/1993933098 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011c037040 con 0x7f01301466f0 2024-09-12T02:46:42.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.012+0000 7f0126000640 1 -- 172.21.15.112:0/1993933098 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f011c042070 con 0x7f01301466f0 2024-09-12T02:46:42.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.012+0000 7f0126000640 1 -- 172.21.15.112:0/1993933098 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011c030bd0 con 0x7f01301466f0 2024-09-12T02:46:42.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.012+0000 7f0134a00640 1 -- 172.21.15.112:0/1993933098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0130159a90 con 0x7f01301466f0 2024-09-12T02:46:42.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.012+0000 7f0134a00640 1 -- 172.21.15.112:0/1993933098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f013015a050 con 0x7f01301466f0 2024-09-12T02:46:42.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.013+0000 7f0134a00640 1 -- 172.21.15.112:0/1993933098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0130160a00 con 0x7f01301466f0 2024-09-12T02:46:42.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.014+0000 7f0126000640 1 -- 172.21.15.112:0/1993933098 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f011c047460 con 0x7f01301466f0 2024-09-12T02:46:42.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.015+0000 7f0126000640 1 --2- 172.21.15.112:0/1993933098 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f011006be30 0x7f011006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:42.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.015+0000 7f0126000640 1 -- 172.21.15.112:0/1993933098 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5709+0+0 (secure 0 0 0) 0x7f011c0ab9b0 con 0x7f01301466f0 2024-09-12T02:46:42.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.015+0000 7f012de00640 1 --2- 172.21.15.112:0/1993933098 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f011006be30 0x7f011006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:42.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.016+0000 7f012de00640 1 --2- 172.21.15.112:0/1993933098 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f011006be30 0x7f011006e2f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f01300d14f0 tx=0x7f0120009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:42.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.019+0000 7f0126000640 1 -- 172.21.15.112:0/1993933098 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f011c079cb0 con 0x7f01301466f0 2024-09-12T02:46:42.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.252+0000 7f0134a00640 1 -- 172.21.15.112:0/1993933098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f01301e7680 con 0x7f01301466f0 2024-09-12T02:46:42.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.255+0000 7f0126000640 1 -- 172.21.15.112:0/1993933098 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7f011c07dfb0 con 0x7f01301466f0 2024-09-12T02:46:42.256 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-09-12T02:46:42.256 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDUVOJmaG86ExAAD0SOlJOsLpoQZlgPJIPaxA== 2024-09-12T02:46:42.256 INFO:teuthology.orchestra.run.smithi112.stdout: caps mds = "allow" 2024-09-12T02:46:42.256 INFO:teuthology.orchestra.run.smithi112.stdout: caps mon = "allow r" 2024-09-12T02:46:42.257 INFO:teuthology.orchestra.run.smithi112.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T02:46:42.257 INFO:teuthology.orchestra.run.smithi112.stderr:updated caps for client.0 2024-09-12T02:46:42.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.257+0000 7f0134a00640 1 -- 172.21.15.112:0/1993933098 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f011006be30 msgr2=0x7f011006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:42.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.257+0000 7f0134a00640 1 --2- 172.21.15.112:0/1993933098 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f011006be30 0x7f011006e2f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f01300d14f0 tx=0x7f0120009040 comp rx=0 tx=0).stop 2024-09-12T02:46:42.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.257+0000 7f0134a00640 1 -- 172.21.15.112:0/1993933098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01301466f0 msgr2=0x7f01301455b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:42.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.257+0000 7f0134a00640 1 --2- 172.21.15.112:0/1993933098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01301466f0 0x7f01301455b0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f011c000c00 tx=0x7f011c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:46:42.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.258+0000 7f0134a00640 1 -- 172.21.15.112:0/1993933098 shutdown_connections 2024-09-12T02:46:42.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.258+0000 7f0134a00640 1 --2- 172.21.15.112:0/1993933098 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f011006be30 0x7f011006e2f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:42.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.258+0000 7f0134a00640 1 --2- 172.21.15.112:0/1993933098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01301605e0 0x7f013015ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:42.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.258+0000 7f0134a00640 1 --2- 172.21.15.112:0/1993933098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01301466f0 0x7f01301455b0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:42.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.258+0000 7f0134a00640 1 --2- 172.21.15.112:0/1993933098 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0130071840 0x7f0130142400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:42.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.258+0000 7f0134a00640 1 -- 172.21.15.112:0/1993933098 >> 172.21.15.112:0/1993933098 conn(0x7f01300b28a0 msgr2=0x7f01301e7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:42.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.258+0000 7f0134a00640 1 -- 172.21.15.112:0/1993933098 shutdown_connections 2024-09-12T02:46:42.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.258+0000 7f0134a00640 1 -- 172.21.15.112:0/1993933098 wait complete. 2024-09-12T02:46:42.275 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:46:42.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.427+0000 7f98cb400640 1 Processor -- start 2024-09-12T02:46:42.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.427+0000 7f98cb400640 1 -- start start 2024-09-12T02:46:42.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.429+0000 7f98cb400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f98c406f600 0x7f98c40b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:42.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.429+0000 7f98cb400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98c40b45d0 0x7f98c40728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:42.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.429+0000 7f98cb400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98c40b4a20 con 0x7f98c415b9d0 2024-09-12T02:46:42.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.429+0000 7f98cb400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f98c40b54a0 con 0x7f98c406f600 2024-09-12T02:46:42.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.429+0000 7f98cb400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f98c40b3af0 con 0x7f98c40b45d0 2024-09-12T02:46:42.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.429+0000 7f98c8a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f98c415b9d0 0x7f98c406eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59732/0 (socket says 172.21.15.112:59732) 2024-09-12T02:46:42.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.429+0000 7f98c8a00640 1 -- 172.21.15.112:0/1816321307 learned_addr learned my addr 172.21.15.112:0/1816321307 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:46:42.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.429+0000 7f98bbe00640 1 --2- 172.21.15.112:0/1816321307 >> v2:172.21.15.137:3300/0 conn(0x7f98c406f600 0x7f98c40b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:42.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.429+0000 7f98c9400640 1 --2- 172.21.15.112:0/1816321307 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98c40b45d0 0x7f98c40728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:42.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.429+0000 7f98c3e00640 1 -- 172.21.15.112:0/1816321307 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 36905354 0 0) 0x7f98c40b4a20 con 0x7f98c415b9d0 2024-09-12T02:46:42.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.429+0000 7f98c3e00640 1 -- 172.21.15.112:0/1816321307 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98a8003520 con 0x7f98c415b9d0 2024-09-12T02:46:42.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.430+0000 7f98c3e00640 1 -- 172.21.15.112:0/1816321307 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2687370766 0 0) 0x7f98a8003520 con 0x7f98c415b9d0 2024-09-12T02:46:42.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.430+0000 7f98c3e00640 1 -- 172.21.15.112:0/1816321307 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98c40b45d0 msgr2=0x7f98c40728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:42.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.430+0000 7f98c3e00640 1 --2- 172.21.15.112:0/1816321307 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98c40b45d0 0x7f98c40728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:42.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.430+0000 7f98c3e00640 1 -- 172.21.15.112:0/1816321307 >> v2:172.21.15.137:3300/0 conn(0x7f98c406f600 msgr2=0x7f98c40b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:42.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.430+0000 7f98c3e00640 1 --2- 172.21.15.112:0/1816321307 >> v2:172.21.15.137:3300/0 conn(0x7f98c406f600 0x7f98c40b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:42.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.430+0000 7f98c3e00640 1 -- 172.21.15.112:0/1816321307 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98c40b3dd0 con 0x7f98c415b9d0 2024-09-12T02:46:42.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.430+0000 7f98c3e00640 1 -- 172.21.15.112:0/1816321307 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f98b4001670 con 0x7f98c415b9d0 2024-09-12T02:46:42.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.430+0000 7f98c3e00640 1 -- 172.21.15.112:0/1816321307 >> v1:172.21.15.112:6789/0 conn(0x7f98c415b9d0 legacy=0x7f98c406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:42.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.430+0000 7f98c3e00640 1 --2- 172.21.15.112:0/1816321307 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98a80039b0 0x7f98a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:42.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.430+0000 7f98c3e00640 1 --2- 172.21.15.112:0/1816321307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98a8004800 0x7f98a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:42.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.430+0000 7f98c3e00640 1 --2- 172.21.15.112:0/1816321307 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98c40b45d0 0x7f98a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:42.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.430+0000 7f98c3e00640 1 -- 172.21.15.112:0/1816321307 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f98c40b54a0 con 0x7f98a8004800 2024-09-12T02:46:42.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.430+0000 7f98c3e00640 1 -- 172.21.15.112:0/1816321307 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f98c40b3af0 con 0x7f98a80039b0 2024-09-12T02:46:42.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.430+0000 7f98c3e00640 1 -- 172.21.15.112:0/1816321307 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f98a800dbd0 con 0x7f98c40b45d0 2024-09-12T02:46:42.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.430+0000 7f98bbe00640 1 --2- 172.21.15.112:0/1816321307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98a8004800 0x7f98a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:42.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.430+0000 7f98c8a00640 1 --2- 172.21.15.112:0/1816321307 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98a80039b0 0x7f98a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:42.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.430+0000 7f98c9400640 1 --2- 172.21.15.112:0/1816321307 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98c40b45d0 0x7f98a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:42.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.430+0000 7f98bbe00640 1 -- 172.21.15.112:0/1816321307 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98c40b45d0 msgr2=0x7f98a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:42.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.430+0000 7f98bbe00640 1 --2- 172.21.15.112:0/1816321307 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98c40b45d0 0x7f98a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:42.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.430+0000 7f98bbe00640 1 -- 172.21.15.112:0/1816321307 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98a80039b0 msgr2=0x7f98a8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:42.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.430+0000 7f98bbe00640 1 --2- 172.21.15.112:0/1816321307 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98a80039b0 0x7f98a8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:42.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.430+0000 7f98bbe00640 1 -- 172.21.15.112:0/1816321307 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a8003520 con 0x7f98a8004800 2024-09-12T02:46:42.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.431+0000 7f98bbe00640 1 --2- 172.21.15.112:0/1816321307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98a8004800 0x7f98a8004c80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f98c406fff0 tx=0x7f98a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e707cadfc51c73b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:42.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.432+0000 7f98c3e00640 1 -- 172.21.15.112:0/1816321307 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98ac036070 con 0x7f98a8004800 2024-09-12T02:46:42.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.432+0000 7f98c3e00640 1 -- 172.21.15.112:0/1816321307 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98ac005990 con 0x7f98a8004800 2024-09-12T02:46:42.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.432+0000 7f98c3e00640 1 -- 172.21.15.112:0/1816321307 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98ac009680 con 0x7f98a8004800 2024-09-12T02:46:42.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.432+0000 7f98cb400640 1 -- 172.21.15.112:0/1816321307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98a8004800 msgr2=0x7f98a8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:42.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.432+0000 7f98cb400640 1 --2- 172.21.15.112:0/1816321307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98a8004800 0x7f98a8004c80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f98c406fff0 tx=0x7f98a8005830 comp rx=0 tx=0).stop 2024-09-12T02:46:42.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.432+0000 7f98c9400640 1 -- 172.21.15.112:0/1816321307 reap_dead start 2024-09-12T02:46:42.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.432+0000 7f98cb400640 1 -- 172.21.15.112:0/1816321307 shutdown_connections 2024-09-12T02:46:42.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.432+0000 7f98cb400640 1 -- 172.21.15.112:0/1816321307 >> 172.21.15.112:0/1816321307 conn(0x7f98c406bbd0 msgr2=0x7f98c406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:42.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.432+0000 7f98cb400640 1 -- 172.21.15.112:0/1816321307 shutdown_connections 2024-09-12T02:46:42.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.432+0000 7f98cb400640 1 -- 172.21.15.112:0/1816321307 wait complete. 2024-09-12T02:46:42.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.434+0000 7f98cb400640 1 Processor -- start 2024-09-12T02:46:42.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.434+0000 7f98cb400640 1 -- start start 2024-09-12T02:46:42.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.435+0000 7f98cb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98a8004800 0x7f98c4152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:42.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.435+0000 7f98cb400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98c414ebd0 0x7f98c40cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:42.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.435+0000 7f98cb400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98c414f050 0x7f98c40cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:42.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.435+0000 7f98cb400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f98c415bf30 con 0x7f98c414f050 2024-09-12T02:46:42.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.435+0000 7f98cb400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f98c415bdb0 con 0x7f98a8004800 2024-09-12T02:46:42.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.435+0000 7f98cb400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f98c40728c0 con 0x7f98c414ebd0 2024-09-12T02:46:42.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.435+0000 7f98c9400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98c414f050 0x7f98c40cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:42.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.435+0000 7f98c9400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98c414f050 0x7f98c40cfa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48102/0 (socket says 172.21.15.112:48102) 2024-09-12T02:46:42.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.435+0000 7f98c9400640 1 -- 172.21.15.112:0/254740725 learned_addr learned my addr 172.21.15.112:0/254740725 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:42.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.435+0000 7f98c9400640 1 -- 172.21.15.112:0/254740725 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98c414ebd0 msgr2=0x7f98c40cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:42.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.435+0000 7f98c9400640 1 --2- 172.21.15.112:0/254740725 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98c414ebd0 0x7f98c40cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:42.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.436+0000 7f98c9400640 1 -- 172.21.15.112:0/254740725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98a8004800 msgr2=0x7f98c4152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:42.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.436+0000 7f98c8a00640 1 --2- 172.21.15.112:0/254740725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98a8004800 0x7f98c4152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:42.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.436+0000 7f98c9400640 1 --2- 172.21.15.112:0/254740725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98a8004800 0x7f98c4152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:42.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.436+0000 7f98c9400640 1 -- 172.21.15.112:0/254740725 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98c414f810 con 0x7f98c414f050 2024-09-12T02:46:42.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.436+0000 7f98c8a00640 1 --2- 172.21.15.112:0/254740725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98a8004800 0x7f98c4152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:46:42.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.436+0000 7f98c9400640 1 --2- 172.21.15.112:0/254740725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98c414f050 0x7f98c40cfa20 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f98c415f560 tx=0x7f98bc0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:42.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.436+0000 7f98c1600640 1 -- 172.21.15.112:0/254740725 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98bc003990 con 0x7f98c414f050 2024-09-12T02:46:42.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.436+0000 7f98c1600640 1 -- 172.21.15.112:0/254740725 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98bc01b070 con 0x7f98c414f050 2024-09-12T02:46:42.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.436+0000 7f98cb400640 1 -- 172.21.15.112:0/254740725 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98c4150eb0 con 0x7f98c414f050 2024-09-12T02:46:42.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.436+0000 7f98c1600640 1 -- 172.21.15.112:0/254740725 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98bc003b70 con 0x7f98c414f050 2024-09-12T02:46:42.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.436+0000 7f98cb400640 1 -- 172.21.15.112:0/254740725 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98c4151470 con 0x7f98c414f050 2024-09-12T02:46:42.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.437+0000 7f98cb400640 1 -- 172.21.15.112:0/254740725 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98c4068a30 con 0x7f98c414f050 2024-09-12T02:46:42.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.438+0000 7f98c1600640 1 -- 172.21.15.112:0/254740725 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f98bc005d10 con 0x7f98c414f050 2024-09-12T02:46:42.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.439+0000 7f98c1600640 1 --2- 172.21.15.112:0/254740725 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f98a006be30 0x7f98a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:42.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.439+0000 7f98c1600640 1 -- 172.21.15.112:0/254740725 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5738+0+0 (secure 0 0 0) 0x7f98bc08b490 con 0x7f98c414f050 2024-09-12T02:46:42.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.439+0000 7f98c8a00640 1 --2- 172.21.15.112:0/254740725 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f98a006be30 0x7f98a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:42.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.440+0000 7f98c8a00640 1 --2- 172.21.15.112:0/254740725 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f98a006be30 0x7f98a006e2f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f98c41f87f0 tx=0x7f98b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:42.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.444+0000 7f98c1600640 1 -- 172.21.15.112:0/254740725 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f98bc025020 con 0x7f98c414f050 2024-09-12T02:46:42.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.649+0000 7f98cb400640 1 -- 172.21.15.112:0/254740725 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98c406ed40 con 0x7f98c414f050 2024-09-12T02:46:42.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.650+0000 7f98c1600640 1 -- 172.21.15.112:0/254740725 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5234 (secure 0 0 0) 0x7f98bc059e10 con 0x7f98c414f050 2024-09-12T02:46:42.651 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:46:42.651 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":53,"btime":"2024-09-12T02:46:40:250353+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1897464411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1897464411},{"type":"v1","addr":"172.21.15.137:6834","nonce":1897464411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":5785,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3500913266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3500913266},{"type":"v1","addr":"172.21.15.137:6835","nonce":3500913266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":6144,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/611029461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":611029461},{"type":"v1","addr":"172.21.15.112:6836","nonce":611029461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:46:36.623382+0000","modified":"2024-09-12T02:46:39.653409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6150":{"gid":6150,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/1018665478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1018665478},{"type":"v1","addr":"172.21.15.112:6837","nonce":1018665478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6150,"qdb_cluster":[6150]},"id":6}]} 2024-09-12T02:46:42.651 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 53 2024-09-12T02:46:42.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.652+0000 7f98cb400640 1 -- 172.21.15.112:0/254740725 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f98a006be30 msgr2=0x7f98a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:42.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.652+0000 7f98cb400640 1 --2- 172.21.15.112:0/254740725 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f98a006be30 0x7f98a006e2f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f98c41f87f0 tx=0x7f98b4009040 comp rx=0 tx=0).stop 2024-09-12T02:46:42.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.652+0000 7f98cb400640 1 -- 172.21.15.112:0/254740725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98c414f050 msgr2=0x7f98c40cfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:42.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.652+0000 7f98cb400640 1 --2- 172.21.15.112:0/254740725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98c414f050 0x7f98c40cfa20 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f98c415f560 tx=0x7f98bc0115a0 comp rx=0 tx=0).stop 2024-09-12T02:46:42.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.652+0000 7f98cb400640 1 -- 172.21.15.112:0/254740725 shutdown_connections 2024-09-12T02:46:42.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.652+0000 7f98cb400640 1 --2- 172.21.15.112:0/254740725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98c414f050 0x7f98c40cfa20 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:42.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.652+0000 7f98cb400640 1 --2- 172.21.15.112:0/254740725 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98c414ebd0 0x7f98c40cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:42.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.652+0000 7f98cb400640 1 --2- 172.21.15.112:0/254740725 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f98a006be30 0x7f98a006e2f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:42.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.652+0000 7f98cb400640 1 --2- 172.21.15.112:0/254740725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98a8004800 0x7f98c4152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:42.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.652+0000 7f98cb400640 1 -- 172.21.15.112:0/254740725 >> 172.21.15.112:0/254740725 conn(0x7f98c406bbd0 msgr2=0x7f98c40d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:42.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.652+0000 7f98cb400640 1 -- 172.21.15.112:0/254740725 shutdown_connections 2024-09-12T02:46:42.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:42.652+0000 7f98cb400640 1 -- 172.21.15.112:0/254740725 wait complete. 2024-09-12T02:46:43.072 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 53, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:46:36.623382+0000', 'modified': '2024-09-12T02:46:39.653409+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6150}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6150': {'gid': 6150, 'name': 'a', 'rank': 0, 'incarnation': 49, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.112:6837/1018665478', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6835', 'nonce': 1018665478}, {'type': 'v1', 'addr': '172.21.15.112:6837', 'nonce': 1018665478}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6150, 'qdb_cluster': [6150]} 2024-09-12T02:46:43.072 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:46:43.073 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-12T02:46:43.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.225+0000 7f40b7400640 1 Processor -- start 2024-09-12T02:46:43.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.225+0000 7f40b7400640 1 -- start start 2024-09-12T02:46:43.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.226+0000 7f40b7400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f40b015ec70 0x7f40b0070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.226+0000 7f40b7400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f40b00b0db0 0x7f40b006bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.226+0000 7f40b7400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40b0070f70 con 0x7f40b006c110 2024-09-12T02:46:43.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.226+0000 7f40b7400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f40b0162900 con 0x7f40b015ec70 2024-09-12T02:46:43.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.226+0000 7f40b7400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f40b0162be0 con 0x7f40b00b0db0 2024-09-12T02:46:43.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.226+0000 7f40b4a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f40b015ec70 0x7f40b0070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.227+0000 7f40b4a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f40b015ec70 0x7f40b0070a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48110/0 (socket says 172.21.15.112:48110) 2024-09-12T02:46:43.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.227+0000 7f40b4a00640 1 -- 172.21.15.112:0/1548694896 learned_addr learned my addr 172.21.15.112:0/1548694896 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:43.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.227+0000 7f40afe00640 1 --2- 172.21.15.112:0/1548694896 >> v2:172.21.15.137:3300/0 conn(0x7f40b00b0db0 0x7f40b006bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.227+0000 7f40b4a00640 1 -- 172.21.15.112:0/1548694896 >> v2:172.21.15.137:3300/0 conn(0x7f40b00b0db0 msgr2=0x7f40b006bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:43.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.227+0000 7f40b4a00640 1 --2- 172.21.15.112:0/1548694896 >> v2:172.21.15.137:3300/0 conn(0x7f40b00b0db0 0x7f40b006bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.227+0000 7f40b4a00640 1 -- 172.21.15.112:0/1548694896 >> v1:172.21.15.112:6789/0 conn(0x7f40b006c110 legacy=0x7f40b0072640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:43.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.227+0000 7f40b4a00640 1 -- 172.21.15.112:0/1548694896 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b0162ec0 con 0x7f40b015ec70 2024-09-12T02:46:43.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.228+0000 7f40b4a00640 1 --2- 172.21.15.112:0/1548694896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40b015ec70 0x7f40b0070a30 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f40b0162860 tx=0x7f40a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0b15ef4570a679 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:43.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.228+0000 7f40af400640 1 -- 172.21.15.112:0/1548694896 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a4037070 con 0x7f40b015ec70 2024-09-12T02:46:43.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.228+0000 7f40af400640 1 -- 172.21.15.112:0/1548694896 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40a4032440 con 0x7f40b015ec70 2024-09-12T02:46:43.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.228+0000 7f40af400640 1 -- 172.21.15.112:0/1548694896 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a4032810 con 0x7f40b015ec70 2024-09-12T02:46:43.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.229+0000 7f40b7400640 1 -- 172.21.15.112:0/1548694896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40b015ec70 msgr2=0x7f40b0070a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:43.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.229+0000 7f40b7400640 1 --2- 172.21.15.112:0/1548694896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40b015ec70 0x7f40b0070a30 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f40b0162860 tx=0x7f40a402a270 comp rx=0 tx=0).stop 2024-09-12T02:46:43.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.229+0000 7f40b7400640 1 -- 172.21.15.112:0/1548694896 shutdown_connections 2024-09-12T02:46:43.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.229+0000 7f40b7400640 1 --2- 172.21.15.112:0/1548694896 >> v2:172.21.15.137:3300/0 conn(0x7f40b00b0db0 0x7f40b006bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.229+0000 7f40b7400640 1 --2- 172.21.15.112:0/1548694896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40b015ec70 0x7f40b0070a30 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.229+0000 7f40b7400640 1 -- 172.21.15.112:0/1548694896 >> 172.21.15.112:0/1548694896 conn(0x7f40b006cce0 msgr2=0x7f40b006d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:43.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.229+0000 7f40b7400640 1 -- 172.21.15.112:0/1548694896 shutdown_connections 2024-09-12T02:46:43.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.229+0000 7f40b7400640 1 -- 172.21.15.112:0/1548694896 wait complete. 2024-09-12T02:46:43.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.231+0000 7f40b7400640 1 Processor -- start 2024-09-12T02:46:43.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.231+0000 7f40b7400640 1 -- start start 2024-09-12T02:46:43.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.232+0000 7f40b7400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f40b006c110 0x7f40b00c6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.232+0000 7f40b7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40b00b0db0 0x7f40b014d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.232+0000 7f40b7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40b015ec70 0x7f40b00c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.232+0000 7f40b7400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f40b006f530 con 0x7f40b015ec70 2024-09-12T02:46:43.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.232+0000 7f40b7400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f40b0163480 con 0x7f40b00b0db0 2024-09-12T02:46:43.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.232+0000 7f40b7400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f40b015f050 con 0x7f40b006c110 2024-09-12T02:46:43.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.232+0000 7f40b5400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40b015ec70 0x7f40b00c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.232+0000 7f40b5400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40b015ec70 0x7f40b00c72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48120/0 (socket says 172.21.15.112:48120) 2024-09-12T02:46:43.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.232+0000 7f40b5400640 1 -- 172.21.15.112:0/1255518207 learned_addr learned my addr 172.21.15.112:0/1255518207 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:43.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.232+0000 7f40afe00640 1 --2- 172.21.15.112:0/1255518207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40b00b0db0 0x7f40b014d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.232+0000 7f40b4a00640 1 --2- 172.21.15.112:0/1255518207 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f40b006c110 0x7f40b00c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.232+0000 7f40b5400640 1 -- 172.21.15.112:0/1255518207 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f40b006c110 msgr2=0x7f40b00c6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:43.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.232+0000 7f40b5400640 1 --2- 172.21.15.112:0/1255518207 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f40b006c110 0x7f40b00c6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.232+0000 7f40b5400640 1 -- 172.21.15.112:0/1255518207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40b00b0db0 msgr2=0x7f40b014d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:43.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.232+0000 7f40b5400640 1 --2- 172.21.15.112:0/1255518207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40b00b0db0 0x7f40b014d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.232+0000 7f40b5400640 1 -- 172.21.15.112:0/1255518207 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b00c6f20 con 0x7f40b015ec70 2024-09-12T02:46:43.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.233+0000 7f40b5400640 1 --2- 172.21.15.112:0/1255518207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40b015ec70 0x7f40b00c72e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f40a800c7a0 tx=0x7f40a800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:43.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.233+0000 7f40acc00640 1 -- 172.21.15.112:0/1255518207 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a8003b70 con 0x7f40b015ec70 2024-09-12T02:46:43.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.233+0000 7f40acc00640 1 -- 172.21.15.112:0/1255518207 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40a8003d30 con 0x7f40b015ec70 2024-09-12T02:46:43.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.233+0000 7f40acc00640 1 -- 172.21.15.112:0/1255518207 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a800aa30 con 0x7f40b015ec70 2024-09-12T02:46:43.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.233+0000 7f40b7400640 1 -- 172.21.15.112:0/1255518207 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40b014eb30 con 0x7f40b015ec70 2024-09-12T02:46:43.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.233+0000 7f40b7400640 1 -- 172.21.15.112:0/1255518207 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40b014f0f0 con 0x7f40b015ec70 2024-09-12T02:46:43.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.235+0000 7f40acc00640 1 -- 172.21.15.112:0/1255518207 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f40a800abd0 con 0x7f40b015ec70 2024-09-12T02:46:43.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.236+0000 7f40acc00640 1 --2- 172.21.15.112:0/1255518207 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f409006be30 0x7f409006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.236+0000 7f40acc00640 1 -- 172.21.15.112:0/1255518207 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5738+0+0 (secure 0 0 0) 0x7f40a808ac10 con 0x7f40b015ec70 2024-09-12T02:46:43.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.236+0000 7f40b4a00640 1 --2- 172.21.15.112:0/1255518207 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f409006be30 0x7f409006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.236+0000 7f40ba1c4740 1 Processor -- start 2024-09-12T02:46:43.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.237+0000 7f40ba1c4740 1 -- start start 2024-09-12T02:46:43.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.237+0000 7f40b4a00640 1 --2- 172.21.15.112:0/1255518207 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f409006be30 0x7f409006e2f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f40a4034000 tx=0x7f40a402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:43.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.237+0000 7f40ba1c4740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e1541f5cf0 0x55e15423b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.237+0000 7f40ba1c4740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55e1541f34b0 0x55e1541f60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.237+0000 7f40ba1c4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e1541f7480 0x55e1541f0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.237+0000 7f40ba1c4740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55e1541543b0 con 0x55e1541f5cf0 2024-09-12T02:46:43.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.237+0000 7f40ba1c4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e154159410 con 0x55e1541f7480 2024-09-12T02:46:43.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.238+0000 7f40ba1c4740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55e154101620 con 0x55e1541f34b0 2024-09-12T02:46:43.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.238+0000 7f40b4a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e1541f5cf0 0x55e15423b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.238+0000 7f40b4a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e1541f5cf0 0x55e15423b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48132/0 (socket says 172.21.15.112:48132) 2024-09-12T02:46:43.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.238+0000 7f40b4a00640 1 -- 172.21.15.112:0/3218689894 learned_addr learned my addr 172.21.15.112:0/3218689894 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:43.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.238+0000 7f40b5400640 1 --2- 172.21.15.112:0/3218689894 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e1541f7480 0x55e1541f0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.238+0000 7f40afe00640 1 --2- 172.21.15.112:0/3218689894 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55e1541f34b0 0x55e1541f60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.238+0000 7f40b4a00640 1 -- 172.21.15.112:0/3218689894 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55e1541f34b0 msgr2=0x55e1541f60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:43.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.238+0000 7f40b4a00640 1 --2- 172.21.15.112:0/3218689894 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55e1541f34b0 0x55e1541f60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.238+0000 7f40b4a00640 1 -- 172.21.15.112:0/3218689894 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e1541f7480 msgr2=0x55e1541f0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:43.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.238+0000 7f40b4a00640 1 --2- 172.21.15.112:0/3218689894 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e1541f7480 0x55e1541f0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.238+0000 7f40b4a00640 1 -- 172.21.15.112:0/3218689894 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e153e6c2d0 con 0x55e1541f5cf0 2024-09-12T02:46:43.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.238+0000 7f40b5400640 1 --2- 172.21.15.112:0/3218689894 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e1541f7480 0x55e1541f0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:46:43.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.238+0000 7f40afe00640 1 --2- 172.21.15.112:0/3218689894 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55e1541f34b0 0x55e1541f60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:46:43.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.238+0000 7f40b4a00640 1 --2- 172.21.15.112:0/3218689894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e1541f5cf0 0x55e15423b490 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f40a403e040 tx=0x7f40a402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee16c89ffb43a49b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:43.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.239+0000 7f40a1200640 1 -- 172.21.15.112:0/3218689894 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a4037040 con 0x55e1541f5cf0 2024-09-12T02:46:43.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.239+0000 7f40a1200640 1 -- 172.21.15.112:0/3218689894 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40a404e070 con 0x55e1541f5cf0 2024-09-12T02:46:43.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.239+0000 7f40a1200640 1 -- 172.21.15.112:0/3218689894 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a4032db0 con 0x55e1541f5cf0 2024-09-12T02:46:43.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.239+0000 7f40ba1c4740 1 -- 172.21.15.112:0/3218689894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e1541f5cf0 msgr2=0x55e15423b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:43.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.239+0000 7f40ba1c4740 1 --2- 172.21.15.112:0/3218689894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e1541f5cf0 0x55e15423b490 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f40a403e040 tx=0x7f40a402c000 comp rx=0 tx=0).stop 2024-09-12T02:46:43.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.239+0000 7f40ba1c4740 1 -- 172.21.15.112:0/3218689894 shutdown_connections 2024-09-12T02:46:43.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.239+0000 7f40ba1c4740 1 --2- 172.21.15.112:0/3218689894 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e1541f7480 0x55e1541f0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.239+0000 7f40ba1c4740 1 --2- 172.21.15.112:0/3218689894 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55e1541f34b0 0x55e1541f60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.239+0000 7f40ba1c4740 1 --2- 172.21.15.112:0/3218689894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e1541f5cf0 0x55e15423b490 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.239+0000 7f40ba1c4740 1 -- 172.21.15.112:0/3218689894 >> 172.21.15.112:0/3218689894 conn(0x55e1541f2740 msgr2=0x55e15423a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:43.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.240+0000 7f40ba1c4740 1 -- 172.21.15.112:0/3218689894 shutdown_connections 2024-09-12T02:46:43.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.240+0000 7f40ba1c4740 1 -- 172.21.15.112:0/3218689894 wait complete. 2024-09-12T02:46:43.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.240+0000 7f40ba1c4740 1 -- start start 2024-09-12T02:46:43.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.240+0000 7f40ba1c4740 1 Processor -- start 2024-09-12T02:46:43.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.241+0000 7f40ba1c4740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55e1541f5cf0 0x55e154215a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.241+0000 7f40ba1c4740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e1541f7480 0x55e15421fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.241+0000 7f40ba1c4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e1542162a0 0x55e1542202d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.241+0000 7f40ba1c4740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55e154114780 con 0x55e1541f7480 2024-09-12T02:46:43.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.241+0000 7f40ba1c4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e1541553d0 con 0x55e1542162a0 2024-09-12T02:46:43.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.241+0000 7f40ba1c4740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55e1541f1be0 con 0x55e1541f5cf0 2024-09-12T02:46:43.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.241+0000 7f40ba1c4740 10 client.0 _ll_register_callbacks cb 0x55e1541525d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:43.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.242+0000 7f40afe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e1541f7480 0x55e15421fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.242+0000 7f40afe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e1541f7480 0x55e15421fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48134/0 (socket says 172.21.15.112:48134) 2024-09-12T02:46:43.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.242+0000 7f40afe00640 1 -- 172.21.15.112:0/2340990835 learned_addr learned my addr 172.21.15.112:0/2340990835 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:43.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.242+0000 7f40b4a00640 1 --2- 172.21.15.112:0/2340990835 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55e1541f5cf0 0x55e154215a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.242+0000 7f40b5400640 1 --2- 172.21.15.112:0/2340990835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e1542162a0 0x55e1542202d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.242+0000 7f40afe00640 1 -- 172.21.15.112:0/2340990835 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55e1541f5cf0 msgr2=0x55e154215a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:43.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.242+0000 7f40afe00640 1 --2- 172.21.15.112:0/2340990835 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55e1541f5cf0 0x55e154215a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.242+0000 7f40afe00640 1 -- 172.21.15.112:0/2340990835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e1542162a0 msgr2=0x55e1542202d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:43.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.242+0000 7f40afe00640 1 --2- 172.21.15.112:0/2340990835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e1542162a0 0x55e1542202d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.242+0000 7f40afe00640 1 -- 172.21.15.112:0/2340990835 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e153f366b0 con 0x55e1541f7480 2024-09-12T02:46:43.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.242+0000 7f40afe00640 1 --2- 172.21.15.112:0/2340990835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e1541f7480 0x55e15421fd90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f409c013310 tx=0x7f409c0137d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8955f998b1c9d85 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:43.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.242+0000 7f4095600640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-12T02:46:43.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.243+0000 7f4095600640 1 -- 172.21.15.112:0/2340990835 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c01b020 con 0x55e1541f7480 2024-09-12T02:46:43.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.243+0000 7f4095600640 1 -- 172.21.15.112:0/2340990835 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 5738+0+0 (secure 0 0 0) 0x7f409c004240 con 0x55e1541f7480 2024-09-12T02:46:43.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.243+0000 7f40ba1c4740 1 -- 172.21.15.112:0/2340990835 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40a404e070 con 0x55e1541f7480 2024-09-12T02:46:43.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.243+0000 7f4095600640 1 -- 172.21.15.112:0/2340990835 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f409c025050 con 0x55e1541f7480 2024-09-12T02:46:43.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.243+0000 7f40ba1c4740 10 client.6270 fetch_fsmap learned FSMap version 53 2024-09-12T02:46:43.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.243+0000 7f40ba1c4740 1 -- 172.21.15.112:0/2340990835 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x55e15421d990 con 0x55e1541f7480 2024-09-12T02:46:43.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.243+0000 7f4095600640 1 -- 172.21.15.112:0/2340990835 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40a404e070 con 0x55e1541f7480 2024-09-12T02:46:43.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.243+0000 7f4095600640 1 -- 172.21.15.112:0/2340990835 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 53) ==== 3502+0+0 (secure 0 0 0) 0x7f409c028020 con 0x55e1541f7480 2024-09-12T02:46:43.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.243+0000 7f40ba1c4740 10 client.6270 fetch_fsmap finished waiting for FSMap version 53 2024-09-12T02:46:43.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.243+0000 7f40ba1c4740 10 client.6270 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T02:46:43.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.243+0000 7f40ba1c4740 20 client.6270 populate_metadata read hostname 'smithi112' 2024-09-12T02:46:43.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.243+0000 7f40ba1c4740 1 --2- 172.21.15.112:0/2340990835 >> [v2:172.21.15.112:6835/1018665478,v1:172.21.15.112:6837/1018665478] conn(0x55e15421e940 0x55e154219380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.243+0000 7f40ba1c4740 4 client.6270 mds_command: new command op to 6150 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:46:43.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.243+0000 7f40ba1c4740 1 -- 172.21.15.112:0/2340990835 --> [v2:172.21.15.112:6835/1018665478,v1:172.21.15.112:6837/1018665478] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e154166b40 con 0x55e15421e940 2024-09-12T02:46:43.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.244+0000 7f40b4a00640 1 --2- 172.21.15.112:0/2340990835 >> [v2:172.21.15.112:6835/1018665478,v1:172.21.15.112:6837/1018665478] conn(0x55e15421e940 0x55e154219380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.244+0000 7f40b4a00640 1 --2- 172.21.15.112:0/2340990835 >> [v2:172.21.15.112:6835/1018665478,v1:172.21.15.112:6837/1018665478] conn(0x55e15421e940 0x55e154219380 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be55bbd8e3eb2827 server_cookie=b37fffbde2e0ec3c in_seq=0 out_seq=0 2024-09-12T02:46:43.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.244+0000 7f4095600640 10 client.6270 ms_handle_connect on v2:172.21.15.112:6835/1018665478 2024-09-12T02:46:43.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.245+0000 7f4095600640 1 -- 172.21.15.112:0/2340990835 <== mds.0 v2:172.21.15.112:6835/1018665478 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e154166b40 con 0x55e15421e940 2024-09-12T02:46:43.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.245+0000 7f4095600640 10 client.6270 handle_command_reply: tid=0 2024-09-12T02:46:43.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.245+0000 7f40ba1c4740 1 client.6270 shutdown 2024-09-12T02:46:43.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.245+0000 7f40ba1c4740 1 -- 172.21.15.112:0/2340990835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e1541f7480 msgr2=0x55e15421fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:43.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.245+0000 7f40ba1c4740 1 --2- 172.21.15.112:0/2340990835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e1541f7480 0x55e15421fd90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f409c013310 tx=0x7f409c0137d0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.245+0000 7f40ba1c4740 1 -- 172.21.15.112:0/2340990835 shutdown_connections 2024-09-12T02:46:43.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.245+0000 7f40ba1c4740 1 --2- 172.21.15.112:0/2340990835 >> [v2:172.21.15.112:6835/1018665478,v1:172.21.15.112:6837/1018665478] conn(0x55e15421e940 0x55e154219380 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.245+0000 7f40ba1c4740 1 --2- 172.21.15.112:0/2340990835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e1542162a0 0x55e1542202d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.245+0000 7f40ba1c4740 1 --2- 172.21.15.112:0/2340990835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e1541f7480 0x55e15421fd90 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.245+0000 7f40ba1c4740 1 --2- 172.21.15.112:0/2340990835 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55e1541f5cf0 0x55e154215a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.245+0000 7f4095600640 0 client.6270 ms_handle_reset on v2:172.21.15.112:6835/1018665478 2024-09-12T02:46:43.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.245+0000 7f40ba1c4740 1 -- 172.21.15.112:0/2340990835 >> 172.21.15.112:0/2340990835 conn(0x55e1541f34b0 msgr2=0x55e15423a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:43.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.246+0000 7f40ba1c4740 1 -- 172.21.15.112:0/2340990835 shutdown_connections 2024-09-12T02:46:43.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.246+0000 7f40ba1c4740 1 -- 172.21.15.112:0/2340990835 wait complete. 2024-09-12T02:46:43.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.246+0000 7f40ba1c4740 20 client.6270 trim_cache size 0 max 16384 2024-09-12T02:46:43.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.264+0000 7f40ba1c4740 1 Processor -- start 2024-09-12T02:46:43.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.264+0000 7f40ba1c4740 1 -- start start 2024-09-12T02:46:43.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.265+0000 7f40ba1c4740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e1541f5cf0 0x55e15424ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.265+0000 7f40ba1c4740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55e1541f7480 0x55e15424cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.265+0000 7f40ba1c4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e1542162a0 0x55e15423c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.265+0000 7f40ba1c4740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f40b02003b0 con 0x55e1541f5cf0 2024-09-12T02:46:43.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.265+0000 7f40ba1c4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f40b00d0420 con 0x55e1542162a0 2024-09-12T02:46:43.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.265+0000 7f40ba1c4740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f40b00d0a70 con 0x55e1541f7480 2024-09-12T02:46:43.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.265+0000 7f40b4a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e1541f5cf0 0x55e15424ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.265+0000 7f40b4a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e1541f5cf0 0x55e15424ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48138/0 (socket says 172.21.15.112:48138) 2024-09-12T02:46:43.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.265+0000 7f40b4a00640 1 -- 172.21.15.112:0/235616871 learned_addr learned my addr 172.21.15.112:0/235616871 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:43.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.266+0000 7f40b4a00640 1 -- 172.21.15.112:0/235616871 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55e1541f7480 msgr2=0x55e15424cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:43.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.266+0000 7f40b4a00640 1 --2- 172.21.15.112:0/235616871 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55e1541f7480 0x55e15424cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.266+0000 7f40b4a00640 1 -- 172.21.15.112:0/235616871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e1542162a0 msgr2=0x55e15423c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:43.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.266+0000 7f40b4a00640 1 --2- 172.21.15.112:0/235616871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e1542162a0 0x55e15423c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.266+0000 7f40b4a00640 1 -- 172.21.15.112:0/235616871 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e154239b20 con 0x55e1541f5cf0 2024-09-12T02:46:43.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.266+0000 7f40b4a00640 1 --2- 172.21.15.112:0/235616871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e1541f5cf0 0x55e15424ca70 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f40a4009960 tx=0x7f40a4009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289258bc1db68742 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:43.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.266+0000 7f4097e00640 1 -- 172.21.15.112:0/235616871 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a4037040 con 0x55e1541f5cf0 2024-09-12T02:46:43.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.266+0000 7f4097e00640 1 -- 172.21.15.112:0/235616871 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40a404e040 con 0x55e1541f5cf0 2024-09-12T02:46:43.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.266+0000 7f4097e00640 1 -- 172.21.15.112:0/235616871 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a405b7e0 con 0x55e1541f5cf0 2024-09-12T02:46:43.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.267+0000 7f40ba1c4740 1 -- 172.21.15.112:0/235616871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e1541f5cf0 msgr2=0x55e15424ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:43.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.267+0000 7f40ba1c4740 1 --2- 172.21.15.112:0/235616871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e1541f5cf0 0x55e15424ca70 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f40a4009960 tx=0x7f40a4009240 comp rx=0 tx=0).stop 2024-09-12T02:46:43.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.267+0000 7f40ba1c4740 1 -- 172.21.15.112:0/235616871 shutdown_connections 2024-09-12T02:46:43.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.267+0000 7f40ba1c4740 1 --2- 172.21.15.112:0/235616871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e1542162a0 0x55e15423c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.267+0000 7f40ba1c4740 1 --2- 172.21.15.112:0/235616871 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55e1541f7480 0x55e15424cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.267+0000 7f40ba1c4740 1 --2- 172.21.15.112:0/235616871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e1541f5cf0 0x55e15424ca70 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.267+0000 7f40ba1c4740 1 -- 172.21.15.112:0/235616871 >> 172.21.15.112:0/235616871 conn(0x55e1541f34b0 msgr2=0x55e154216fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:43.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.267+0000 7f40ba1c4740 1 -- 172.21.15.112:0/235616871 shutdown_connections 2024-09-12T02:46:43.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.267+0000 7f40ba1c4740 1 -- 172.21.15.112:0/235616871 wait complete. 2024-09-12T02:46:43.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.268+0000 7f40ba1c4740 1 -- start start 2024-09-12T02:46:43.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.268+0000 7f40ba1c4740 1 Processor -- start 2024-09-12T02:46:43.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.269+0000 7f40ba1c4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e1541f5cf0 0x55e1542ab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.269+0000 7f40ba1c4740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55e1541f7480 0x55e154239fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.269+0000 7f40ba1c4740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e1542162a0 0x55e15423a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.269+0000 7f40ba1c4740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55e15424c4f0 con 0x55e1542162a0 2024-09-12T02:46:43.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.269+0000 7f40ba1c4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e15421dc70 con 0x55e1541f5cf0 2024-09-12T02:46:43.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.269+0000 7f40ba1c4740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55e15421ed90 con 0x55e1541f7480 2024-09-12T02:46:43.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.269+0000 7f40ba1c4740 10 client.0 _ll_register_callbacks cb 0x7f409c009710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:43.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.269+0000 7f40b5400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e1542162a0 0x55e15423a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.269+0000 7f40b4a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e1541f5cf0 0x55e1542ab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.269+0000 7f40b5400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e1542162a0 0x55e15423a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48150/0 (socket says 172.21.15.112:48150) 2024-09-12T02:46:43.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.269+0000 7f40b5400640 1 -- 172.21.15.112:0/1988768902 learned_addr learned my addr 172.21.15.112:0/1988768902 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:43.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.269+0000 7f40afe00640 1 --2- 172.21.15.112:0/1988768902 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55e1541f7480 0x55e154239fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.270+0000 7f40b5400640 1 -- 172.21.15.112:0/1988768902 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55e1541f7480 msgr2=0x55e154239fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:43.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.270+0000 7f40b5400640 1 --2- 172.21.15.112:0/1988768902 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55e1541f7480 0x55e154239fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.270+0000 7f40b5400640 1 -- 172.21.15.112:0/1988768902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e1541f5cf0 msgr2=0x55e1542ab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:43.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.270+0000 7f40b5400640 1 --2- 172.21.15.112:0/1988768902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e1541f5cf0 0x55e1542ab7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.270+0000 7f40b5400640 1 -- 172.21.15.112:0/1988768902 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1542abd30 con 0x55e1542162a0 2024-09-12T02:46:43.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.270+0000 7f40b4a00640 1 --2- 172.21.15.112:0/1988768902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e1541f5cf0 0x55e1542ab7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:46:43.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.270+0000 7f40b5400640 1 --2- 172.21.15.112:0/1988768902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e1542162a0 0x55e15423a520 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f40a800a430 tx=0x7f40a8059060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d626428d7e451 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:43.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.270+0000 7f4095600640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-12T02:46:43.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.272+0000 7f4095600640 1 -- 172.21.15.112:0/1988768902 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a8086070 con 0x55e1542162a0 2024-09-12T02:46:43.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.272+0000 7f4095600640 1 -- 172.21.15.112:0/1988768902 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 5738+0+0 (secure 0 0 0) 0x7f40a8057250 con 0x55e1542162a0 2024-09-12T02:46:43.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.272+0000 7f40ba1c4740 1 -- 172.21.15.112:0/1988768902 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40a404e040 con 0x55e1542162a0 2024-09-12T02:46:43.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.272+0000 7f4095600640 1 -- 172.21.15.112:0/1988768902 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f40a8077050 con 0x55e1542162a0 2024-09-12T02:46:43.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.272+0000 7f40ba1c4740 10 client.6276 fetch_fsmap learned FSMap version 53 2024-09-12T02:46:43.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.272+0000 7f40ba1c4740 1 -- 172.21.15.112:0/1988768902 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x55e15425dc90 con 0x55e1542162a0 2024-09-12T02:46:43.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.272+0000 7f4095600640 1 -- 172.21.15.112:0/1988768902 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40a404e040 con 0x55e1542162a0 2024-09-12T02:46:43.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.272+0000 7f4095600640 1 -- 172.21.15.112:0/1988768902 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 53) ==== 3502+0+0 (secure 0 0 0) 0x7f40a80555c0 con 0x55e1542162a0 2024-09-12T02:46:43.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.272+0000 7f40ba1c4740 10 client.6276 fetch_fsmap finished waiting for FSMap version 53 2024-09-12T02:46:43.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.272+0000 7f40ba1c4740 10 client.6276 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T02:46:43.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.272+0000 7f40ba1c4740 20 client.6276 populate_metadata read hostname 'smithi112' 2024-09-12T02:46:43.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.272+0000 7f40ba1c4740 1 --2- 172.21.15.112:0/1988768902 >> [v2:172.21.15.112:6835/1018665478,v1:172.21.15.112:6837/1018665478] conn(0x55e15421bc80 0x55e15423c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.272+0000 7f40ba1c4740 4 client.6276 mds_command: new command op to 6150 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:46:43.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.272+0000 7f40ba1c4740 1 -- 172.21.15.112:0/1988768902 --> [v2:172.21.15.112:6835/1018665478,v1:172.21.15.112:6837/1018665478] -- command(tid 0: {"prefix": "status"}) -- 0x55e154160e90 con 0x55e15421bc80 2024-09-12T02:46:43.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.272+0000 7f40b4a00640 1 --2- 172.21.15.112:0/1988768902 >> [v2:172.21.15.112:6835/1018665478,v1:172.21.15.112:6837/1018665478] conn(0x55e15421bc80 0x55e15423c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.273+0000 7f40b4a00640 1 --2- 172.21.15.112:0/1988768902 >> [v2:172.21.15.112:6835/1018665478,v1:172.21.15.112:6837/1018665478] conn(0x55e15421bc80 0x55e15423c4c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60ee9d1f9f623547 server_cookie=429746b8a8ec25bc in_seq=0 out_seq=0 2024-09-12T02:46:43.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.273+0000 7f4095600640 10 client.6276 ms_handle_connect on v2:172.21.15.112:6835/1018665478 2024-09-12T02:46:43.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.273+0000 7f4095600640 1 -- 172.21.15.112:0/1988768902 <== mds.0 v2:172.21.15.112:6835/1018665478 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55e154160e90 con 0x55e15421bc80 2024-09-12T02:46:43.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.273+0000 7f4095600640 10 client.6276 handle_command_reply: tid=0 2024-09-12T02:46:43.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.273+0000 7f40ba1c4740 1 client.6276 shutdown 2024-09-12T02:46:43.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.274+0000 7f40ba1c4740 1 -- 172.21.15.112:0/1988768902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e1542162a0 msgr2=0x55e15423a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:43.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.274+0000 7f40ba1c4740 1 --2- 172.21.15.112:0/1988768902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e1542162a0 0x55e15423a520 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f40a800a430 tx=0x7f40a8059060 comp rx=0 tx=0).stop 2024-09-12T02:46:43.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.274+0000 7f40ba1c4740 1 -- 172.21.15.112:0/1988768902 shutdown_connections 2024-09-12T02:46:43.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.274+0000 7f40ba1c4740 1 --2- 172.21.15.112:0/1988768902 >> [v2:172.21.15.112:6835/1018665478,v1:172.21.15.112:6837/1018665478] conn(0x55e15421bc80 0x55e15423c4c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.274+0000 7f40ba1c4740 1 --2- 172.21.15.112:0/1988768902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e1542162a0 0x55e15423a520 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.274+0000 7f40ba1c4740 1 --2- 172.21.15.112:0/1988768902 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55e1541f7480 0x55e154239fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.274+0000 7f40ba1c4740 1 --2- 172.21.15.112:0/1988768902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e1541f5cf0 0x55e1542ab7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.274+0000 7f4095600640 0 client.6276 ms_handle_reset on v2:172.21.15.112:6835/1018665478 2024-09-12T02:46:43.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.274+0000 7f40ba1c4740 1 -- 172.21.15.112:0/1988768902 >> 172.21.15.112:0/1988768902 conn(0x55e1541f34b0 msgr2=0x55e154216fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:43.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.274+0000 7f40ba1c4740 1 -- 172.21.15.112:0/1988768902 shutdown_connections 2024-09-12T02:46:43.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.274+0000 7f40ba1c4740 1 -- 172.21.15.112:0/1988768902 wait complete. 2024-09-12T02:46:43.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.274+0000 7f40ba1c4740 20 client.6276 trim_cache size 0 max 16384 2024-09-12T02:46:43.278 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:46:43.278 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:46:43.278 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2024-09-12T02:46:43.279 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 6150, 2024-09-12T02:46:43.279 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2024-09-12T02:46:43.279 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2024-09-12T02:46:43.279 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2024-09-12T02:46:43.279 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 6.0417392789999997, 2024-09-12T02:46:43.279 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 53, 2024-09-12T02:46:43.279 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 99, 2024-09-12T02:46:43.279 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 97, 2024-09-12T02:46:43.279 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 10.596402983000001 2024-09-12T02:46:43.280 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:46:43.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.275+0000 7f40b7400640 1 -- 172.21.15.112:0/1255518207 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f409006be30 msgr2=0x7f409006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:43.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.275+0000 7f40b7400640 1 --2- 172.21.15.112:0/1255518207 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f409006be30 0x7f409006e2f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f40a4034000 tx=0x7f40a402e000 comp rx=0 tx=0).stop 2024-09-12T02:46:43.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.275+0000 7f40b7400640 1 -- 172.21.15.112:0/1255518207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40b015ec70 msgr2=0x7f40b00c72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:43.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.275+0000 7f40b7400640 1 --2- 172.21.15.112:0/1255518207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40b015ec70 0x7f40b00c72e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f40a800c7a0 tx=0x7f40a800cc60 comp rx=0 tx=0).stop 2024-09-12T02:46:43.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.275+0000 7f40b7400640 1 -- 172.21.15.112:0/1255518207 shutdown_connections 2024-09-12T02:46:43.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.275+0000 7f40b7400640 1 --2- 172.21.15.112:0/1255518207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40b015ec70 0x7f40b00c72e0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.275+0000 7f40b7400640 1 --2- 172.21.15.112:0/1255518207 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f409006be30 0x7f409006e2f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.275+0000 7f40b7400640 1 --2- 172.21.15.112:0/1255518207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40b00b0db0 0x7f40b014d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.275+0000 7f40b7400640 1 --2- 172.21.15.112:0/1255518207 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f40b006c110 0x7f40b00c6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.275+0000 7f40b7400640 1 -- 172.21.15.112:0/1255518207 >> 172.21.15.112:0/1255518207 conn(0x7f40b006cce0 msgr2=0x7f40b006d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:43.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.275+0000 7f40b7400640 1 -- 172.21.15.112:0/1255518207 shutdown_connections 2024-09-12T02:46:43.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.275+0000 7f40b7400640 1 -- 172.21.15.112:0/1255518207 wait complete. 2024-09-12T02:46:43.291 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:46:43.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.442+0000 7f3f1aa00640 1 Processor -- start 2024-09-12T02:46:43.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.442+0000 7f3f1aa00640 1 -- start start 2024-09-12T02:46:43.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.444+0000 7f3f1aa00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3f14071530 0x7f3f140af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.444+0000 7f3f1aa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f140719a0 0x7f3f140afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.444+0000 7f3f1aa00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f140ceeb0 con 0x7f3f1415cc50 2024-09-12T02:46:43.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.444+0000 7f3f1aa00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f3f1415d030 con 0x7f3f14071530 2024-09-12T02:46:43.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.444+0000 7f3f1aa00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3f140cf4c0 con 0x7f3f140719a0 2024-09-12T02:46:43.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.444+0000 7f3f13400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3f14071530 0x7f3f140af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.444+0000 7f3f13400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3f14071530 0x7f3f140af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48166/0 (socket says 172.21.15.112:48166) 2024-09-12T02:46:43.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.444+0000 7f3f13400640 1 -- 172.21.15.112:0/3925728033 learned_addr learned my addr 172.21.15.112:0/3925728033 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:43.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.444+0000 7f3f18a00640 1 --2- 172.21.15.112:0/3925728033 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f140719a0 0x7f3f140afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.444+0000 7f3f13400640 1 -- 172.21.15.112:0/3925728033 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f140719a0 msgr2=0x7f3f140afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:43.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.444+0000 7f3f13400640 1 --2- 172.21.15.112:0/3925728033 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f140719a0 0x7f3f140afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.444+0000 7f3f13400640 1 -- 172.21.15.112:0/3925728033 >> v1:172.21.15.137:6789/0 conn(0x7f3f1415cc50 legacy=0x7f3f140732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:43.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.444+0000 7f3f13400640 1 -- 172.21.15.112:0/3925728033 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1406e300 con 0x7f3f14071530 2024-09-12T02:46:43.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.444+0000 7f3f18a00640 1 --2- 172.21.15.112:0/3925728033 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f140719a0 0x7f3f140afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:46:43.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.445+0000 7f3f13400640 1 --2- 172.21.15.112:0/3925728033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f14071530 0x7f3f140af720 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f3f140cf640 tx=0x7f3f0002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934a89aeb802bc37 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:43.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.446+0000 7f3f12a00640 1 -- 172.21.15.112:0/3925728033 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0002ae50 con 0x7f3f14071530 2024-09-12T02:46:43.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.446+0000 7f3f12a00640 1 -- 172.21.15.112:0/3925728033 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f00004030 con 0x7f3f14071530 2024-09-12T02:46:43.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.446+0000 7f3f12a00640 1 -- 172.21.15.112:0/3925728033 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f00004460 con 0x7f3f14071530 2024-09-12T02:46:43.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.446+0000 7f3f1aa00640 1 -- 172.21.15.112:0/3925728033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f14071530 msgr2=0x7f3f140af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:43.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.446+0000 7f3f1aa00640 1 --2- 172.21.15.112:0/3925728033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f14071530 0x7f3f140af720 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f3f140cf640 tx=0x7f3f0002a140 comp rx=0 tx=0).stop 2024-09-12T02:46:43.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.446+0000 7f3f1aa00640 1 -- 172.21.15.112:0/3925728033 shutdown_connections 2024-09-12T02:46:43.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.446+0000 7f3f1aa00640 1 --2- 172.21.15.112:0/3925728033 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f140719a0 0x7f3f140afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.446+0000 7f3f1aa00640 1 --2- 172.21.15.112:0/3925728033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f14071530 0x7f3f140af720 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.446+0000 7f3f1aa00640 1 -- 172.21.15.112:0/3925728033 >> 172.21.15.112:0/3925728033 conn(0x7f3f1406bbd0 msgr2=0x7f3f1406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:43.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.446+0000 7f3f1aa00640 1 -- 172.21.15.112:0/3925728033 shutdown_connections 2024-09-12T02:46:43.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.446+0000 7f3f1aa00640 1 -- 172.21.15.112:0/3925728033 wait complete. 2024-09-12T02:46:43.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.448+0000 7f3f1aa00640 1 Processor -- start 2024-09-12T02:46:43.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.448+0000 7f3f1aa00640 1 -- start start 2024-09-12T02:46:43.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.449+0000 7f3f1aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f14071530 0x7f3f14154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.449+0000 7f3f1aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f140719a0 0x7f3f1415b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.449+0000 7f3f1aa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f1415cc50 0x7f3f1415b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.449+0000 7f3f1aa00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1406f510 con 0x7f3f14071530 2024-09-12T02:46:43.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.449+0000 7f3f1aa00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3f140cf150 con 0x7f3f140719a0 2024-09-12T02:46:43.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.449+0000 7f3f1aa00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3f1406f690 con 0x7f3f1415cc50 2024-09-12T02:46:43.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.449+0000 7f3f13e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f14071530 0x7f3f14154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.449+0000 7f3f13e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f14071530 0x7f3f14154510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48182/0 (socket says 172.21.15.112:48182) 2024-09-12T02:46:43.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.449+0000 7f3f13e00640 1 -- 172.21.15.112:0/1385656769 learned_addr learned my addr 172.21.15.112:0/1385656769 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:43.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.449+0000 7f3f13400640 1 --2- 172.21.15.112:0/1385656769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f140719a0 0x7f3f1415b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.449+0000 7f3f18a00640 1 --2- 172.21.15.112:0/1385656769 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f1415cc50 0x7f3f1415b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.450+0000 7f3f13e00640 1 -- 172.21.15.112:0/1385656769 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f1415cc50 msgr2=0x7f3f1415b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:43.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.450+0000 7f3f13e00640 1 --2- 172.21.15.112:0/1385656769 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f1415cc50 0x7f3f1415b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.450+0000 7f3f13e00640 1 -- 172.21.15.112:0/1385656769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f140719a0 msgr2=0x7f3f1415b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:43.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.450+0000 7f3f13e00640 1 --2- 172.21.15.112:0/1385656769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f140719a0 0x7f3f1415b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.450+0000 7f3f13e00640 1 -- 172.21.15.112:0/1385656769 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f14154d60 con 0x7f3f14071530 2024-09-12T02:46:43.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.450+0000 7f3f13400640 1 --2- 172.21.15.112:0/1385656769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f140719a0 0x7f3f1415b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:43.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.450+0000 7f3f13e00640 1 --2- 172.21.15.112:0/1385656769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f14071530 0x7f3f14154510 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400b3f0 tx=0x7f3f0400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:43.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.450+0000 7f3f0be00640 1 -- 172.21.15.112:0/1385656769 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f04015020 con 0x7f3f14071530 2024-09-12T02:46:43.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.450+0000 7f3f0be00640 1 -- 172.21.15.112:0/1385656769 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f04011830 con 0x7f3f14071530 2024-09-12T02:46:43.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.450+0000 7f3f0be00640 1 -- 172.21.15.112:0/1385656769 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f04011c20 con 0x7f3f14071530 2024-09-12T02:46:43.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.450+0000 7f3f1aa00640 1 -- 172.21.15.112:0/1385656769 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f14155040 con 0x7f3f14071530 2024-09-12T02:46:43.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.450+0000 7f3f1aa00640 1 -- 172.21.15.112:0/1385656769 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f14155600 con 0x7f3f14071530 2024-09-12T02:46:43.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.451+0000 7f3f1aa00640 1 -- 172.21.15.112:0/1385656769 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f1406df60 con 0x7f3f14071530 2024-09-12T02:46:43.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.452+0000 7f3f0be00640 1 -- 172.21.15.112:0/1385656769 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3f04018020 con 0x7f3f14071530 2024-09-12T02:46:43.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.453+0000 7f3f0be00640 1 --2- 172.21.15.112:0/1385656769 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3ef406be30 0x7f3ef406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.454+0000 7f3f0be00640 1 -- 172.21.15.112:0/1385656769 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5738+0+0 (secure 0 0 0) 0x7f3f0408abc0 con 0x7f3f14071530 2024-09-12T02:46:43.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.454+0000 7f3f13400640 1 --2- 172.21.15.112:0/1385656769 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3ef406be30 0x7f3ef406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.454+0000 7f3f13400640 1 --2- 172.21.15.112:0/1385656769 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3ef406be30 0x7f3ef406e2f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3f00033000 tx=0x7f3f0002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:43.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.458+0000 7f3f0be00640 1 -- 172.21.15.112:0/1385656769 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3f0401f030 con 0x7f3f14071530 2024-09-12T02:46:43.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.670+0000 7f3f1aa00640 1 -- 172.21.15.112:0/1385656769 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3f140b06b0 con 0x7f3f14071530 2024-09-12T02:46:43.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.671+0000 7f3f0be00640 1 -- 172.21.15.112:0/1385656769 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) ==== 53+0+73 (secure 0 0 0) 0x7f3f040172c0 con 0x7f3f14071530 2024-09-12T02:46:43.672 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:46:43.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.673+0000 7f3f1aa00640 1 -- 172.21.15.112:0/1385656769 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3ef406be30 msgr2=0x7f3ef406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:43.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.673+0000 7f3f1aa00640 1 --2- 172.21.15.112:0/1385656769 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3ef406be30 0x7f3ef406e2f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3f00033000 tx=0x7f3f0002e000 comp rx=0 tx=0).stop 2024-09-12T02:46:43.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.673+0000 7f3f1aa00640 1 -- 172.21.15.112:0/1385656769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f14071530 msgr2=0x7f3f14154510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:43.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.673+0000 7f3f1aa00640 1 --2- 172.21.15.112:0/1385656769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f14071530 0x7f3f14154510 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400b3f0 tx=0x7f3f0400b8b0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.673+0000 7f3f1aa00640 1 -- 172.21.15.112:0/1385656769 shutdown_connections 2024-09-12T02:46:43.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.673+0000 7f3f1aa00640 1 --2- 172.21.15.112:0/1385656769 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f1415cc50 0x7f3f1415b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.673+0000 7f3f1aa00640 1 --2- 172.21.15.112:0/1385656769 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3ef406be30 0x7f3ef406e2f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.673+0000 7f3f1aa00640 1 --2- 172.21.15.112:0/1385656769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f140719a0 0x7f3f1415b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.673+0000 7f3f1aa00640 1 --2- 172.21.15.112:0/1385656769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f14071530 0x7f3f14154510 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.673+0000 7f3f1aa00640 1 -- 172.21.15.112:0/1385656769 >> 172.21.15.112:0/1385656769 conn(0x7f3f1406bbd0 msgr2=0x7f3f140732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:43.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.674+0000 7f3f1aa00640 1 -- 172.21.15.112:0/1385656769 shutdown_connections 2024-09-12T02:46:43.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43.674+0000 7f3f1aa00640 1 -- 172.21.15.112:0/1385656769 wait complete. 2024-09-12T02:46:43.690 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:46:43.690 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:46:43.690 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-09-12T02:46:43.690 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:46:43.690 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:46:43.691 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:46:43.691 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:46:43.691 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:46:43.691 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:46:43.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:43.691 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-09-12T02:46:43.727 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:46:43.727 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:46:43.727 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:46:43.727 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:46:43.727 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-12T02:46:43.728 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:46:43.728 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:46:43.728 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-09-12T02:46:43.728 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-09-12T02:46:43.728 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:46:43.728 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-09-12T02:46:43.728 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-09-12T02:46:43.728 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:46:43.728 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:46:43.728 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:46:43.728 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:46:43.728 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:46:43.728 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42475sec preferred_lft 42475sec 2024-09-12T02:46:43.728 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link noprefixroute 2024-09-12T02:46:43.729 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:46:43.729 INFO:teuthology.orchestra.run.smithi112.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:46:43.729 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 4e:56:d4:fc:33:ba brd ff:ff:ff:ff:ff:ff 2024-09-12T02:46:43.729 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:46:43.729 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:46:43.729 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::787f:67ff:fe10:c915/64 scope link 2024-09-12T02:46:43.729 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:46:43.729 INFO:teuthology.orchestra.run.smithi112.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:46:43.729 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 4e:56:d4:fc:33:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:46:43.729 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::4c56:d4ff:fefc:33ba/64 scope link 2024-09-12T02:46:43.729 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:46:43.729 INFO:teuthology.orchestra.run.smithi112.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:46:43.729 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 86:ed:0e:b6:37:5f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:46:43.730 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::84ed:eff:feb6:375f/64 scope link 2024-09-12T02:46:43.730 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:46:43.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:43.730 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:46:43.820 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-12T02:46:43.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:43.823 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-09-12T02:46:43.859 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-09-12T02:46:43.860 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:46:43.860 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:46:43.860 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:46:43.860 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:46:43.860 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:46:43.860 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-12T02:46:43.860 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:46:43.860 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:46:43.861 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:46:43.861 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-12T02:46:43.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:46:44.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:46:44.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:44.055 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-12T02:46:44.090 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:46:44.091 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:46:44.091 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:46:44.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:44.091 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2024-09-12T02:46:44.186 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:46:44.186 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:46:44.221 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:46:44.222 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:46:44.222 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:46:44.296 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T02:46:44.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:44.297 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:46:44.425 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:46:44.426 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:46:44.452 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:46:44.452 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:46:44.453 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-09-12T02:46:44.453 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 0@7c01f3b3-dec2-4449-a33f-f960d7527ea6.cephfs=/ 2024-09-12T02:46:44.453 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.112:3300/172.21.15.137:3300/172.21.15.137:3301" will pass to kernel 2024-09-12T02:46:44.454 INFO:teuthology.orchestra.run.smithi112.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:46:44.454 INFO:teuthology.orchestra.run.smithi112.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:46:44.454 INFO:teuthology.orchestra.run.smithi112.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:46:44.454 INFO:teuthology.orchestra.run.smithi112.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:46:44.454 INFO:teuthology.orchestra.run.smithi112.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:46:44.457 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:46:44.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:44.457 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:46:44.513 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:46:44.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:46:44.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:46:44.609 INFO:teuthology.orchestra.run.smithi112.stdout:client5459 2024-09-12T02:46:44.609 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:46:44.609 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:46:44.645 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:46:44.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.836+0000 7f1604e00640 1 Processor -- start 2024-09-12T02:46:44.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.836+0000 7f1604e00640 1 -- start start 2024-09-12T02:46:44.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.837+0000 7f1604e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f160015cc50 0x7f16000732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:44.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.837+0000 7f1604e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f16000afe30 0x7f16000cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:44.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.837+0000 7f1604e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1600073830 con 0x7f1600071530 2024-09-12T02:46:44.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.837+0000 7f1604e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f160015d030 con 0x7f16000afe30 2024-09-12T02:46:44.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.837+0000 7f1604e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f16000cf4c0 con 0x7f160015cc50 2024-09-12T02:46:44.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.837+0000 7f15fd400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f1600071530 0x7f16000af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59752/0 (socket says 172.21.15.112:59752) 2024-09-12T02:46:44.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.837+0000 7f15fd400640 1 -- 172.21.15.112:0/1135808365 learned_addr learned my addr 172.21.15.112:0/1135808365 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:46:44.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.837+0000 7f15fde00640 1 --2- 172.21.15.112:0/1135808365 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f160015cc50 0x7f16000732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:44.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.837+0000 7f15fe800640 1 --2- 172.21.15.112:0/1135808365 >> v2:172.21.15.137:3300/0 conn(0x7f16000afe30 0x7f16000cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:44.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.838+0000 7f15fca00640 1 -- 172.21.15.112:0/1135808365 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 991044394 0 0) 0x7f15ec001290 con 0x7f1600071530 2024-09-12T02:46:44.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.838+0000 7f15fca00640 1 -- 172.21.15.112:0/1135808365 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15e4003520 con 0x7f1600071530 2024-09-12T02:46:44.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.838+0000 7f15fca00640 1 -- 172.21.15.112:0/1135808365 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1621446863 0 0) 0x7f15e4003520 con 0x7f1600071530 2024-09-12T02:46:44.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.838+0000 7f15fde00640 1 -- 172.21.15.112:0/1135808365 >> v2:172.21.15.137:3300/0 conn(0x7f16000afe30 msgr2=0x7f16000cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:44.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.838+0000 7f15fde00640 1 --2- 172.21.15.112:0/1135808365 >> v2:172.21.15.137:3300/0 conn(0x7f16000afe30 0x7f16000cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:44.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.838+0000 7f15fde00640 1 -- 172.21.15.112:0/1135808365 >> v1:172.21.15.112:6789/0 conn(0x7f1600071530 legacy=0x7f16000af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:44.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.838+0000 7f15fde00640 1 -- 172.21.15.112:0/1135808365 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16000ceeb0 con 0x7f160015cc50 2024-09-12T02:46:44.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.838+0000 7f15fe800640 1 --2- 172.21.15.112:0/1135808365 >> v2:172.21.15.137:3300/0 conn(0x7f16000afe30 0x7f16000cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:46:44.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.839+0000 7f15fde00640 1 --2- 172.21.15.112:0/1135808365 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f160015cc50 0x7f16000732f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f15f00097d0 tx=0x7f15f002a0b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1e14637520fc842 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:44.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.839+0000 7f15fca00640 1 -- 172.21.15.112:0/1135808365 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f0037070 con 0x7f160015cc50 2024-09-12T02:46:44.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.839+0000 7f15fca00640 1 -- 172.21.15.112:0/1135808365 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f002ab40 con 0x7f160015cc50 2024-09-12T02:46:44.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.839+0000 7f15fca00640 1 -- 172.21.15.112:0/1135808365 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ec0019c0 con 0x7f160015cc50 2024-09-12T02:46:44.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.840+0000 7f1604e00640 1 -- 172.21.15.112:0/1135808365 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f160015cc50 msgr2=0x7f16000732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:44.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.840+0000 7f1604e00640 1 --2- 172.21.15.112:0/1135808365 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f160015cc50 0x7f16000732f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f15f00097d0 tx=0x7f15f002a0b0 comp rx=0 tx=0).stop 2024-09-12T02:46:44.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.840+0000 7f1604e00640 1 -- 172.21.15.112:0/1135808365 shutdown_connections 2024-09-12T02:46:44.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.840+0000 7f1604e00640 1 --2- 172.21.15.112:0/1135808365 >> v2:172.21.15.137:3300/0 conn(0x7f16000afe30 0x7f16000cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:44.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.840+0000 7f1604e00640 1 --2- 172.21.15.112:0/1135808365 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f160015cc50 0x7f16000732f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:44.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.840+0000 7f1604e00640 1 -- 172.21.15.112:0/1135808365 >> 172.21.15.112:0/1135808365 conn(0x7f160006bbd0 msgr2=0x7f160006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:44.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.840+0000 7f1604e00640 1 -- 172.21.15.112:0/1135808365 shutdown_connections 2024-09-12T02:46:44.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.840+0000 7f1604e00640 1 -- 172.21.15.112:0/1135808365 wait complete. 2024-09-12T02:46:44.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.842+0000 7f1604e00640 1 Processor -- start 2024-09-12T02:46:44.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.842+0000 7f1604e00640 1 -- start start 2024-09-12T02:46:44.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.843+0000 7f1604e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1600071530 0x7f160014f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:44.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.843+0000 7f1604e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f16000afe30 0x7f16001e9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:44.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.843+0000 7f1604e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f160015cc50 0x7f16001e6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:44.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.843+0000 7f1604e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f16000cf150 con 0x7f1600071530 2024-09-12T02:46:44.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.843+0000 7f1604e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f160006e5e0 con 0x7f160015cc50 2024-09-12T02:46:44.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.843+0000 7f1604e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f160006f510 con 0x7f16000afe30 2024-09-12T02:46:44.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.843+0000 7f15fde00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1600071530 0x7f160014f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:44.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.843+0000 7f15fde00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1600071530 0x7f160014f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48192/0 (socket says 172.21.15.112:48192) 2024-09-12T02:46:44.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.843+0000 7f15fde00640 1 -- 172.21.15.112:0/2215313378 learned_addr learned my addr 172.21.15.112:0/2215313378 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:44.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.843+0000 7f15fe800640 1 --2- 172.21.15.112:0/2215313378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f160015cc50 0x7f16001e6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:44.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.843+0000 7f15fd400640 1 --2- 172.21.15.112:0/2215313378 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f16000afe30 0x7f16001e9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:44.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.843+0000 7f15fde00640 1 -- 172.21.15.112:0/2215313378 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f16000afe30 msgr2=0x7f16001e9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:44.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.843+0000 7f15fde00640 1 --2- 172.21.15.112:0/2215313378 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f16000afe30 0x7f16001e9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:44.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.843+0000 7f15fde00640 1 -- 172.21.15.112:0/2215313378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f160015cc50 msgr2=0x7f16001e6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:44.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.843+0000 7f15fde00640 1 --2- 172.21.15.112:0/2215313378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f160015cc50 0x7f16001e6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:44.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.843+0000 7f15fde00640 1 -- 172.21.15.112:0/2215313378 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16001564c0 con 0x7f1600071530 2024-09-12T02:46:44.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.843+0000 7f15fe800640 1 --2- 172.21.15.112:0/2215313378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f160015cc50 0x7f16001e6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:46:44.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.843+0000 7f15fd400640 1 --2- 172.21.15.112:0/2215313378 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f16000afe30 0x7f16001e9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:46:44.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.844+0000 7f15fde00640 1 --2- 172.21.15.112:0/2215313378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1600071530 0x7f160014f3c0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f15f002a6a0 tx=0x7f15f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:44.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.844+0000 7f15f6000640 1 -- 172.21.15.112:0/2215313378 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f0037070 con 0x7f1600071530 2024-09-12T02:46:44.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.844+0000 7f15f6000640 1 -- 172.21.15.112:0/2215313378 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f0038040 con 0x7f1600071530 2024-09-12T02:46:44.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.844+0000 7f1604e00640 1 -- 172.21.15.112:0/2215313378 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16001567a0 con 0x7f1600071530 2024-09-12T02:46:44.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.844+0000 7f15f6000640 1 -- 172.21.15.112:0/2215313378 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f0004450 con 0x7f1600071530 2024-09-12T02:46:44.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.844+0000 7f1604e00640 1 -- 172.21.15.112:0/2215313378 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1600159ce0 con 0x7f1600071530 2024-09-12T02:46:44.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.845+0000 7f1604e00640 1 -- 172.21.15.112:0/2215313378 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f160006df60 con 0x7f1600071530 2024-09-12T02:46:44.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.846+0000 7f15f6000640 1 -- 172.21.15.112:0/2215313378 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f15f003e690 con 0x7f1600071530 2024-09-12T02:46:44.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.847+0000 7f15f6000640 1 --2- 172.21.15.112:0/2215313378 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f15e006be30 0x7f15e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:44.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.847+0000 7f15f6000640 1 -- 172.21.15.112:0/2215313378 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5738+0+0 (secure 0 0 0) 0x7f15f00abb30 con 0x7f1600071530 2024-09-12T02:46:44.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.847+0000 7f15fd400640 1 --2- 172.21.15.112:0/2215313378 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f15e006be30 0x7f15e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:44.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.848+0000 7f15fd400640 1 --2- 172.21.15.112:0/2215313378 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f15e006be30 0x7f15e006e2f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1600157670 tx=0x7f15ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:44.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:44.851+0000 7f15f6000640 1 -- 172.21.15.112:0/2215313378 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f15f007a4c0 con 0x7f1600071530 2024-09-12T02:46:45.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:45.059+0000 7f1604e00640 1 -- 172.21.15.112:0/2215313378 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f16000730d0 con 0x7f1600071530 2024-09-12T02:46:45.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:45.059+0000 7f15f6000640 1 -- 172.21.15.112:0/2215313378 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) ==== 53+0+73 (secure 0 0 0) 0x7f15f0079dc0 con 0x7f1600071530 2024-09-12T02:46:45.060 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:46:45.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:45.062+0000 7f1604e00640 1 -- 172.21.15.112:0/2215313378 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f15e006be30 msgr2=0x7f15e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:45.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:45.062+0000 7f1604e00640 1 --2- 172.21.15.112:0/2215313378 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f15e006be30 0x7f15e006e2f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1600157670 tx=0x7f15ec009040 comp rx=0 tx=0).stop 2024-09-12T02:46:45.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:45.062+0000 7f1604e00640 1 -- 172.21.15.112:0/2215313378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1600071530 msgr2=0x7f160014f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:45.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:45.062+0000 7f1604e00640 1 --2- 172.21.15.112:0/2215313378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1600071530 0x7f160014f3c0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f15f002a6a0 tx=0x7f15f00046c0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:45.062+0000 7f1604e00640 1 -- 172.21.15.112:0/2215313378 shutdown_connections 2024-09-12T02:46:45.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:45.062+0000 7f1604e00640 1 --2- 172.21.15.112:0/2215313378 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f15e006be30 0x7f15e006e2f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:45.062+0000 7f1604e00640 1 --2- 172.21.15.112:0/2215313378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f160015cc50 0x7f16001e6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:45.062+0000 7f1604e00640 1 --2- 172.21.15.112:0/2215313378 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f16000afe30 0x7f16001e9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:45.062+0000 7f1604e00640 1 --2- 172.21.15.112:0/2215313378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1600071530 0x7f160014f3c0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:45.062+0000 7f1604e00640 1 -- 172.21.15.112:0/2215313378 >> 172.21.15.112:0/2215313378 conn(0x7f160006bbd0 msgr2=0x7f16001579f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:45.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:45.062+0000 7f1604e00640 1 -- 172.21.15.112:0/2215313378 shutdown_connections 2024-09-12T02:46:45.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:45.062+0000 7f1604e00640 1 -- 172.21.15.112:0/2215313378 wait complete. 2024-09-12T02:46:45.078 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:46:45.078 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:46:45.079 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-09-12T02:46:45.079 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T02:46:45.079 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T02:46:45.079 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:46:45.079 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:46:45.079 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:46:45.079 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:46:45.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:45.079 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-09-12T02:46:45.120 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:46:45.120 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:46:45.120 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:46:45.120 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:46:45.120 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-09-12T02:46:45.120 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:46:45.120 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:46:45.120 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-09-12T02:46:45.120 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-09-12T02:46:45.121 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:46:45.121 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-09-12T02:46:45.121 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-09-12T02:46:45.121 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:46:45.121 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:46:45.121 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:46:45.121 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:46:45.121 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:46:45.121 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42474sec preferred_lft 42474sec 2024-09-12T02:46:45.121 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::ec4:7aff:fe88:8137/64 scope link noprefixroute 2024-09-12T02:46:45.121 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:46:45.121 INFO:teuthology.orchestra.run.smithi137.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:46:45.121 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 62:9a:8e:f1:56:55 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:46:45.121 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:46:45.122 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:46:45.122 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::30c8:13ff:fe15:f79d/64 scope link 2024-09-12T02:46:45.122 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:46:45.122 INFO:teuthology.orchestra.run.smithi137.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:46:45.122 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 62:9a:8e:f1:56:55 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:46:45.122 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::609a:8eff:fef1:5655/64 scope link 2024-09-12T02:46:45.122 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:46:45.122 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:46:45.122 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 96:f4:ca:17:88:2a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T02:46:45.122 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::94f4:caff:fe17:882a/64 scope link 2024-09-12T02:46:45.122 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:46:45.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:45.123 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:46:45.223 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-09-12T02:46:45.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:45.228 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-09-12T02:46:45.267 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-09-12T02:46:45.267 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:46:45.267 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:46:45.267 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:46:45.267 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:46:45.268 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:46:45.268 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-09-12T02:46:45.268 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:46:45.268 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:46:45.268 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:46:45.268 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-09-12T02:46:45.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:46:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:46:45.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:46:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:46:45.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:45.466 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-09-12T02:46:45.501 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T02:46:45.502 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T02:46:45.502 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:46:45.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:45.502 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-09-12T02:46:45.597 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:46:45.597 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T02:46:45.632 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:46:45.633 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:46:45.633 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T02:46:45.707 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-12T02:46:45.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:45.707 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:46:45.837 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:46:45.837 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:46:45.864 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:46:45.864 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:46:45.864 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-09-12T02:46:45.864 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with new device syntax: 1@7c01f3b3-dec2-4449-a33f-f960d7527ea6.cephfs=/ 2024-09-12T02:46:45.864 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.112:3300/172.21.15.137:3300/172.21.15.137:3301" will pass to kernel 2024-09-12T02:46:45.865 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-12T02:46:45.866 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:46:45.866 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:46:45.866 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:46:45.866 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:46:45.868 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:46:45.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:45.869 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T02:46:45.924 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:46:46.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:46:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:46:46.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:46:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:46:46.013 INFO:teuthology.orchestra.run.smithi137.stdout:client6291 2024-09-12T02:46:46.013 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:46:46.013 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:46:46.049 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:46:46.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.206+0000 7fdcb3800640 1 Processor -- start 2024-09-12T02:46:46.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.206+0000 7fdcb3800640 1 -- start start 2024-09-12T02:46:46.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.208+0000 7fdcb3800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcac15b9d0 0x7fdcac0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:46.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.208+0000 7fdcb3800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdcac06f600 0x7fdcac0728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:46.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.208+0000 7fdcb3800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcac0b54a0 con 0x7fdcac0b45d0 2024-09-12T02:46:46.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.208+0000 7fdcb3800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fdcac0b4a30 con 0x7fdcac06f600 2024-09-12T02:46:46.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.208+0000 7fdcb3800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdcac0b3af0 con 0x7fdcac15b9d0 2024-09-12T02:46:46.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.208+0000 7fdcb1800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdcac06f600 0x7fdcac0728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:46.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.208+0000 7fdcb1800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdcac06f600 0x7fdcac0728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48198/0 (socket says 172.21.15.112:48198) 2024-09-12T02:46:46.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.208+0000 7fdcb1800640 1 -- 172.21.15.112:0/3440838705 learned_addr learned my addr 172.21.15.112:0/3440838705 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:46.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.209+0000 7fdcb1800640 1 -- 172.21.15.112:0/3440838705 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcac15b9d0 msgr2=0x7fdcac0b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:46.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.209+0000 7fdcb1800640 1 --2- 172.21.15.112:0/3440838705 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcac15b9d0 0x7fdcac0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.209+0000 7fdcb1800640 1 -- 172.21.15.112:0/3440838705 >> v1:172.21.15.137:6789/0 conn(0x7fdcac0b45d0 legacy=0x7fdcac06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:46.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.209+0000 7fdcb1800640 1 -- 172.21.15.112:0/3440838705 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcac0b3dd0 con 0x7fdcac06f600 2024-09-12T02:46:46.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.210+0000 7fdcb1800640 1 --2- 172.21.15.112:0/3440838705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcac06f600 0x7fdcac0728c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fdca4009e50 tx=0x7fdca402c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f46974c29d65089 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:46.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.210+0000 7fdcab400640 1 -- 172.21.15.112:0/3440838705 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca4039070 con 0x7fdcac06f600 2024-09-12T02:46:46.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.210+0000 7fdcab400640 1 -- 172.21.15.112:0/3440838705 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdca4034680 con 0x7fdcac06f600 2024-09-12T02:46:46.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.210+0000 7fdcab400640 1 -- 172.21.15.112:0/3440838705 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca4034a50 con 0x7fdcac06f600 2024-09-12T02:46:46.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.210+0000 7fdcb3800640 1 -- 172.21.15.112:0/3440838705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcac06f600 msgr2=0x7fdcac0728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:46.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.210+0000 7fdcb3800640 1 --2- 172.21.15.112:0/3440838705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcac06f600 0x7fdcac0728c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fdca4009e50 tx=0x7fdca402c8d0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.211+0000 7fdcb3800640 1 -- 172.21.15.112:0/3440838705 shutdown_connections 2024-09-12T02:46:46.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.211+0000 7fdcb3800640 1 --2- 172.21.15.112:0/3440838705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcac06f600 0x7fdcac0728c0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.211+0000 7fdcb3800640 1 --2- 172.21.15.112:0/3440838705 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcac15b9d0 0x7fdcac0b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.211+0000 7fdcb3800640 1 -- 172.21.15.112:0/3440838705 >> 172.21.15.112:0/3440838705 conn(0x7fdcac06bbd0 msgr2=0x7fdcac06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:46.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.211+0000 7fdcb3800640 1 -- 172.21.15.112:0/3440838705 shutdown_connections 2024-09-12T02:46:46.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.211+0000 7fdcb3800640 1 -- 172.21.15.112:0/3440838705 wait complete. 2024-09-12T02:46:46.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.212+0000 7fdcb3800640 1 Processor -- start 2024-09-12T02:46:46.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.212+0000 7fdcb3800640 1 -- start start 2024-09-12T02:46:46.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.213+0000 7fdcb3800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcac06f600 0x7fdcac0ad640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:46.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.213+0000 7fdcb3800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcac0b45d0 0x7fdcac1f0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:46.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.213+0000 7fdcb3800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcac15b9d0 0x7fdcac15da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:46.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.213+0000 7fdcb3800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdcac15bf30 con 0x7fdcac06f600 2024-09-12T02:46:46.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.213+0000 7fdcb3800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdcac15bdb0 con 0x7fdcac0b45d0 2024-09-12T02:46:46.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.213+0000 7fdcb3800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdcac0cdcd0 con 0x7fdcac15b9d0 2024-09-12T02:46:46.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.214+0000 7fdcb0e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcac06f600 0x7fdcac0ad640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:46.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.214+0000 7fdcb0e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcac06f600 0x7fdcac0ad640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48210/0 (socket says 172.21.15.112:48210) 2024-09-12T02:46:46.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.214+0000 7fdcb0e00640 1 -- 172.21.15.112:0/2770779182 learned_addr learned my addr 172.21.15.112:0/2770779182 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:46.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.214+0000 7fdcb1800640 1 --2- 172.21.15.112:0/2770779182 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcac15b9d0 0x7fdcac15da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:46.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.214+0000 7fdcabe00640 1 --2- 172.21.15.112:0/2770779182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcac0b45d0 0x7fdcac1f0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:46.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.214+0000 7fdcb0e00640 1 -- 172.21.15.112:0/2770779182 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcac15b9d0 msgr2=0x7fdcac15da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:46.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.214+0000 7fdcb0e00640 1 --2- 172.21.15.112:0/2770779182 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcac15b9d0 0x7fdcac15da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.214+0000 7fdcb0e00640 1 -- 172.21.15.112:0/2770779182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcac0b45d0 msgr2=0x7fdcac1f0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:46.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.214+0000 7fdcb0e00640 1 --2- 172.21.15.112:0/2770779182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcac0b45d0 0x7fdcac1f0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.214+0000 7fdcb0e00640 1 -- 172.21.15.112:0/2770779182 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcac1f1430 con 0x7fdcac06f600 2024-09-12T02:46:46.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.214+0000 7fdcb0e00640 1 --2- 172.21.15.112:0/2770779182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcac06f600 0x7fdcac0ad640 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c00b410 tx=0x7fdc9c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:46.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.214+0000 7fdca8c00640 1 -- 172.21.15.112:0/2770779182 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c015020 con 0x7fdcac06f600 2024-09-12T02:46:46.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.215+0000 7fdca8c00640 1 -- 172.21.15.112:0/2770779182 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc9c011850 con 0x7fdcac06f600 2024-09-12T02:46:46.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.215+0000 7fdca8c00640 1 -- 172.21.15.112:0/2770779182 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c011c40 con 0x7fdcac06f600 2024-09-12T02:46:46.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.215+0000 7fdcb3800640 1 -- 172.21.15.112:0/2770779182 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcac0aa660 con 0x7fdcac06f600 2024-09-12T02:46:46.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.215+0000 7fdcb3800640 1 -- 172.21.15.112:0/2770779182 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcac0aac20 con 0x7fdcac06f600 2024-09-12T02:46:46.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.216+0000 7fdcb3800640 1 -- 172.21.15.112:0/2770779182 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcac068a30 con 0x7fdcac06f600 2024-09-12T02:46:46.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.217+0000 7fdca8c00640 1 -- 172.21.15.112:0/2770779182 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdc9c018020 con 0x7fdcac06f600 2024-09-12T02:46:46.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.218+0000 7fdca8c00640 1 --2- 172.21.15.112:0/2770779182 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdc8c06be60 0x7fdc8c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:46.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.218+0000 7fdca8c00640 1 -- 172.21.15.112:0/2770779182 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5738+0+0 (secure 0 0 0) 0x7fdc9c08ac40 con 0x7fdcac06f600 2024-09-12T02:46:46.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.218+0000 7fdcabe00640 1 --2- 172.21.15.112:0/2770779182 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdc8c06be60 0x7fdc8c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:46.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.218+0000 7fdcabe00640 1 --2- 172.21.15.112:0/2770779182 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdc8c06be60 0x7fdc8c06e320 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdcac15e8f0 tx=0x7fdc98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:46.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.222+0000 7fdca8c00640 1 -- 172.21.15.112:0/2770779182 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc9c01f020 con 0x7fdcac06f600 2024-09-12T02:46:46.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.428+0000 7fdcb3800640 1 -- 172.21.15.112:0/2770779182 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdcac068360 con 0x7fdcac06f600 2024-09-12T02:46:46.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.429+0000 7fdca8c00640 1 -- 172.21.15.112:0/2770779182 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5234 (secure 0 0 0) 0x7fdc9c058f70 con 0x7fdcac06f600 2024-09-12T02:46:46.430 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:46:46.430 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":53,"btime":"2024-09-12T02:46:40:250353+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1897464411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1897464411},{"type":"v1","addr":"172.21.15.137:6834","nonce":1897464411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":5785,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3500913266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3500913266},{"type":"v1","addr":"172.21.15.137:6835","nonce":3500913266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":6144,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/611029461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":611029461},{"type":"v1","addr":"172.21.15.112:6836","nonce":611029461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:46:36.623382+0000","modified":"2024-09-12T02:46:39.653409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6150":{"gid":6150,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/1018665478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1018665478},{"type":"v1","addr":"172.21.15.112:6837","nonce":1018665478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6150,"qdb_cluster":[6150]},"id":6}]} 2024-09-12T02:46:46.430 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 53 2024-09-12T02:46:46.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.431+0000 7fdcb3800640 1 -- 172.21.15.112:0/2770779182 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdc8c06be60 msgr2=0x7fdc8c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:46.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.431+0000 7fdcb3800640 1 --2- 172.21.15.112:0/2770779182 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdc8c06be60 0x7fdc8c06e320 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdcac15e8f0 tx=0x7fdc98009040 comp rx=0 tx=0).stop 2024-09-12T02:46:46.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.431+0000 7fdcb3800640 1 -- 172.21.15.112:0/2770779182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcac06f600 msgr2=0x7fdcac0ad640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:46.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.431+0000 7fdcb3800640 1 --2- 172.21.15.112:0/2770779182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcac06f600 0x7fdcac0ad640 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c00b410 tx=0x7fdc9c00b8d0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.431+0000 7fdcb3800640 1 -- 172.21.15.112:0/2770779182 shutdown_connections 2024-09-12T02:46:46.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.431+0000 7fdcb3800640 1 --2- 172.21.15.112:0/2770779182 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcac15b9d0 0x7fdcac15da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.431+0000 7fdcb3800640 1 --2- 172.21.15.112:0/2770779182 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdc8c06be60 0x7fdc8c06e320 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.431+0000 7fdcb3800640 1 --2- 172.21.15.112:0/2770779182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcac0b45d0 0x7fdcac1f0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.431+0000 7fdcb3800640 1 --2- 172.21.15.112:0/2770779182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcac06f600 0x7fdcac0ad640 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:46.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.431+0000 7fdcb3800640 1 -- 172.21.15.112:0/2770779182 >> 172.21.15.112:0/2770779182 conn(0x7fdcac06bbd0 msgr2=0x7fdcac156210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:46.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.431+0000 7fdcb3800640 1 -- 172.21.15.112:0/2770779182 shutdown_connections 2024-09-12T02:46:46.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:46.431+0000 7fdcb3800640 1 -- 172.21.15.112:0/2770779182 wait complete. 2024-09-12T02:46:46.448 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-12T02:46:46.621 INFO:teuthology.orchestra.run.smithi112.stdout:{"cluster_fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","whoami":0,"id":6150,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.3762247139999992,"mdsmap_epoch":53,"osdmap_epoch":99,"osdmap_epoch_barrier":97,"uptime":13.930886190000001} 2024-09-12T02:46:46.621 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", "fs_name": "cephfs", "id": 6150, "mdsmap_epoch": 53, "osdmap_epoch": 99, "osdmap_epoch_barrier": 97, "rank_uptime": 9.376224714, "state": "up:active", "uptime": 13.93088619, "want_state": "up:active", "whoami": 0 } 2024-09-12T02:46:46.622 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-12T02:46:46.789 INFO:teuthology.orchestra.run.smithi112.stdout:{"osd_mon_report_interval":"5"} 2024-09-12T02:46:46.789 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-12T02:46:46.789 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2024-09-12T02:46:46.790 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:46:46.790 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:46:46.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:46.826 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2024-09-12T02:46:48.802 INFO:teuthology.orchestra.run.smithi112.stderr:265+0 records in 2024-09-12T02:46:48.802 INFO:teuthology.orchestra.run.smithi112.stderr:265+0 records out 2024-09-12T02:46:48.803 INFO:teuthology.orchestra.run.smithi112.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.89791 s, 146 MB/s 2024-09-12T02:46:48.804 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:46:48.804 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:46:48.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:48.839 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2024-09-12T02:46:51.031 INFO:teuthology.orchestra.run.smithi112.stderr:292+0 records in 2024-09-12T02:46:51.031 INFO:teuthology.orchestra.run.smithi112.stderr:292+0 records out 2024-09-12T02:46:51.031 INFO:teuthology.orchestra.run.smithi112.stderr:306184192 bytes (306 MB, 292 MiB) copied, 2.11519 s, 145 MB/s 2024-09-12T02:46:51.032 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2024-09-12T02:46:51.033 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-12T02:46:51.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.184+0000 7f4ca7200640 1 Processor -- start 2024-09-12T02:46:51.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.184+0000 7f4ca7200640 1 -- start start 2024-09-12T02:46:51.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.185+0000 7f4ca7200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ca015c800 0x7f4ca00708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:51.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.185+0000 7f4ca7200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4ca00b4ce0 0x7f4ca00b5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:51.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.185+0000 7f4ca7200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ca00b0c70 con 0x7f4ca00b0770 2024-09-12T02:46:51.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.185+0000 7f4ca7200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4ca00b0f50 con 0x7f4ca00b4ce0 2024-09-12T02:46:51.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.185+0000 7f4ca7200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4ca00b1230 con 0x7f4ca015c800 2024-09-12T02:46:51.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.186+0000 7f4ca5400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f4ca00b0770 0x7f4ca015f7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59766/0 (socket says 172.21.15.112:59766) 2024-09-12T02:46:51.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.186+0000 7f4ca6800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4ca00b4ce0 0x7f4ca00b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:51.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.186+0000 7f4ca5400640 1 -- 172.21.15.112:0/2380502394 learned_addr learned my addr 172.21.15.112:0/2380502394 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:46:51.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.186+0000 7f4ca5e00640 1 --2- 172.21.15.112:0/2380502394 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ca015c800 0x7f4ca00708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:51.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.186+0000 7f4ca6800640 1 -- 172.21.15.112:0/2380502394 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ca015c800 msgr2=0x7f4ca00708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:51.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.186+0000 7f4ca6800640 1 --2- 172.21.15.112:0/2380502394 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ca015c800 0x7f4ca00708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.186+0000 7f4ca6800640 1 -- 172.21.15.112:0/2380502394 >> v1:172.21.15.112:6789/0 conn(0x7f4ca00b0770 legacy=0x7f4ca015f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:51.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.186+0000 7f4ca6800640 1 -- 172.21.15.112:0/2380502394 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca015f2a0 con 0x7f4ca00b4ce0 2024-09-12T02:46:51.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.186+0000 7f4ca4a00640 1 -- 172.21.15.112:0/2380502394 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3556266656 0 0) 0x7f4ca00b0c70 con 0x7f4ca00b0770 2024-09-12T02:46:51.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.187+0000 7f4ca6800640 1 --2- 172.21.15.112:0/2380502394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ca00b4ce0 0x7f4ca00b5150 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c009d90 tx=0x7f4c9c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd5640545e11fc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:51.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.187+0000 7f4ca4a00640 1 -- 172.21.15.112:0/2380502394 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c007740 con 0x7f4ca00b4ce0 2024-09-12T02:46:51.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.187+0000 7f4ca4a00640 1 -- 172.21.15.112:0/2380502394 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c9c0078e0 con 0x7f4ca00b4ce0 2024-09-12T02:46:51.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.187+0000 7f4ca4a00640 1 -- 172.21.15.112:0/2380502394 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c007cb0 con 0x7f4ca00b4ce0 2024-09-12T02:46:51.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.188+0000 7f4ca7200640 1 -- 172.21.15.112:0/2380502394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ca00b4ce0 msgr2=0x7f4ca00b5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:51.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.188+0000 7f4ca7200640 1 --2- 172.21.15.112:0/2380502394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ca00b4ce0 0x7f4ca00b5150 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c009d90 tx=0x7f4c9c02a660 comp rx=0 tx=0).stop 2024-09-12T02:46:51.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.188+0000 7f4ca7200640 1 -- 172.21.15.112:0/2380502394 shutdown_connections 2024-09-12T02:46:51.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.188+0000 7f4ca7200640 1 --2- 172.21.15.112:0/2380502394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ca00b4ce0 0x7f4ca00b5150 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.188+0000 7f4ca7200640 1 --2- 172.21.15.112:0/2380502394 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ca015c800 0x7f4ca00708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.188+0000 7f4ca7200640 1 -- 172.21.15.112:0/2380502394 >> 172.21.15.112:0/2380502394 conn(0x7f4ca006cce0 msgr2=0x7f4ca006d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:51.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.188+0000 7f4ca7200640 1 -- 172.21.15.112:0/2380502394 shutdown_connections 2024-09-12T02:46:51.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.188+0000 7f4ca7200640 1 -- 172.21.15.112:0/2380502394 wait complete. 2024-09-12T02:46:51.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.190+0000 7f4ca7200640 1 Processor -- start 2024-09-12T02:46:51.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.190+0000 7f4ca7200640 1 -- start start 2024-09-12T02:46:51.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.191+0000 7f4ca7200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ca00b0770 0x7f4ca01f7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:51.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.191+0000 7f4ca7200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ca00b4ce0 0x7f4ca00d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:51.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.191+0000 7f4ca7200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ca015c800 0x7f4ca00c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:51.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.191+0000 7f4ca7200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca006f360 con 0x7f4ca00b4ce0 2024-09-12T02:46:51.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.191+0000 7f4ca7200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca006f1e0 con 0x7f4ca015c800 2024-09-12T02:46:51.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.191+0000 7f4ca7200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4ca006bbd0 con 0x7f4ca00b0770 2024-09-12T02:46:51.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.191+0000 7f4ca5400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ca00b4ce0 0x7f4ca00d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:51.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.191+0000 7f4ca5400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ca00b4ce0 0x7f4ca00d0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48238/0 (socket says 172.21.15.112:48238) 2024-09-12T02:46:51.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.191+0000 7f4ca5400640 1 -- 172.21.15.112:0/3534100679 learned_addr learned my addr 172.21.15.112:0/3534100679 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:51.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.191+0000 7f4ca6800640 1 --2- 172.21.15.112:0/3534100679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ca015c800 0x7f4ca00c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:51.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.191+0000 7f4ca5e00640 1 --2- 172.21.15.112:0/3534100679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ca00b0770 0x7f4ca01f7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:51.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.191+0000 7f4ca5400640 1 -- 172.21.15.112:0/3534100679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ca00b0770 msgr2=0x7f4ca01f7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:51.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.191+0000 7f4ca5400640 1 --2- 172.21.15.112:0/3534100679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ca00b0770 0x7f4ca01f7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.191+0000 7f4ca5400640 1 -- 172.21.15.112:0/3534100679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ca015c800 msgr2=0x7f4ca00c6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:51.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.191+0000 7f4ca5400640 1 --2- 172.21.15.112:0/3534100679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ca015c800 0x7f4ca00c6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.191+0000 7f4ca5400640 1 -- 172.21.15.112:0/3534100679 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca00d1220 con 0x7f4ca00b4ce0 2024-09-12T02:46:51.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.192+0000 7f4ca5400640 1 --2- 172.21.15.112:0/3534100679 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ca00b4ce0 0x7f4ca00d0ce0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f4c9000c4d0 tx=0x7f4c9000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:51.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.192+0000 7f4c9a000640 1 -- 172.21.15.112:0/3534100679 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c90018070 con 0x7f4ca00b4ce0 2024-09-12T02:46:51.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.192+0000 7f4c9a000640 1 -- 172.21.15.112:0/3534100679 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c90007500 con 0x7f4ca00b4ce0 2024-09-12T02:46:51.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.192+0000 7f4c9a000640 1 -- 172.21.15.112:0/3534100679 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c90004a20 con 0x7f4ca00b4ce0 2024-09-12T02:46:51.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.192+0000 7f4ca7200640 1 -- 172.21.15.112:0/3534100679 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ca00c6fd0 con 0x7f4ca00b4ce0 2024-09-12T02:46:51.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.192+0000 7f4ca7200640 1 -- 172.21.15.112:0/3534100679 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ca01f83e0 con 0x7f4ca00b4ce0 2024-09-12T02:46:51.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.193+0000 7f4ca7200640 1 -- 172.21.15.112:0/3534100679 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ca00708c0 con 0x7f4ca00b4ce0 2024-09-12T02:46:51.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.194+0000 7f4c9a000640 1 -- 172.21.15.112:0/3534100679 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4c90004bc0 con 0x7f4ca00b4ce0 2024-09-12T02:46:51.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.195+0000 7f4c9a000640 1 --2- 172.21.15.112:0/3534100679 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4c8406be30 0x7f4c8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:51.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.195+0000 7f4c9a000640 1 -- 172.21.15.112:0/3534100679 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5738+0+0 (secure 0 0 0) 0x7f4c9008a170 con 0x7f4ca00b4ce0 2024-09-12T02:46:51.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.195+0000 7f4ca5e00640 1 --2- 172.21.15.112:0/3534100679 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4c8406be30 0x7f4c8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:51.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.196+0000 7f4ca5e00640 1 --2- 172.21.15.112:0/3534100679 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4c8406be30 0x7f4c8406e2f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4ca00b3630 tx=0x7f4c94009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:51.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.199+0000 7f4c9a000640 1 -- 172.21.15.112:0/3534100679 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ca00c6fd0 con 0x7f4ca00b4ce0 2024-09-12T02:46:51.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.374+0000 7f4ca7200640 1 -- 172.21.15.112:0/3534100679 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f4ca015a710 con 0x7f4ca00b4ce0 2024-09-12T02:46:51.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.376+0000 7f4c9a000640 1 -- 172.21.15.112:0/3534100679 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v99) ==== 81+0+34491 (secure 0 0 0) 0x7f4c90058410 con 0x7f4ca00b4ce0 2024-09-12T02:46:51.377 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:46:51.377 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:46:51.377 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 99, 2024-09-12T02:46:51.378 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:46:51.378 INFO:teuthology.orchestra.run.smithi112.stdout: "created": "2024-09-12T02:41:36.162095+0000", 2024-09-12T02:46:51.378 INFO:teuthology.orchestra.run.smithi112.stdout: "modified": "2024-09-12T02:46:43.269526+0000", 2024-09-12T02:46:51.378 INFO:teuthology.orchestra.run.smithi112.stdout: "last_up_change": "2024-09-12T02:41:42.191169+0000", 2024-09-12T02:46:51.378 INFO:teuthology.orchestra.run.smithi112.stdout: "last_in_change": "2024-09-12T02:41:39.036600+0000", 2024-09-12T02:46:51.378 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:46:51.378 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_num": 5799936, 2024-09-12T02:46:51.378 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_set": [ 2024-09-12T02:46:51.378 INFO:teuthology.orchestra.run.smithi112.stdout: "pglog_hardlimit", 2024-09-12T02:46:51.378 INFO:teuthology.orchestra.run.smithi112.stdout: "purged_snapdirs", 2024-09-12T02:46:51.378 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_deletes", 2024-09-12T02:46:51.378 INFO:teuthology.orchestra.run.smithi112.stdout: "sortbitwise" 2024-09-12T02:46:51.378 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:46:51.378 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_version": 4, 2024-09-12T02:46:51.379 INFO:teuthology.orchestra.run.smithi112.stdout: "full_ratio": 0.69999998807907104, 2024-09-12T02:46:51.379 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-12T02:46:51.379 INFO:teuthology.orchestra.run.smithi112.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-12T02:46:51.379 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_snapshot": "", 2024-09-12T02:46:51.379 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_max": 13, 2024-09-12T02:46:51.379 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd": 8, 2024-09-12T02:46:51.379 INFO:teuthology.orchestra.run.smithi112.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:46:51.379 INFO:teuthology.orchestra.run.smithi112.stdout: "min_compat_client": "luminous", 2024-09-12T02:46:51.379 INFO:teuthology.orchestra.run.smithi112.stdout: "require_osd_release": "squid", 2024-09-12T02:46:51.379 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_crimson": false, 2024-09-12T02:46:51.379 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-12T02:46:51.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.379 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 1, 2024-09-12T02:46:51.380 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": ".mgr", 2024-09-12T02:46:51.380 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:41:43.011599+0000", 2024-09-12T02:46:51.380 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:46:51.380 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:46:51.380 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:46:51.380 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:46:51.380 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:46:51.380 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:46:51.380 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:46:51.380 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:46:51.380 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:46:51.380 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:46:51.380 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:46:51.381 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:46:51.381 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:46:51.381 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 1, 2024-09-12T02:46:51.381 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 1, 2024-09-12T02:46:51.381 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 1, 2024-09-12T02:46:51.381 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 1, 2024-09-12T02:46:51.381 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 1, 2024-09-12T02:46:51.381 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:46:51.381 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:46:51.381 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:46:51.381 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:46:51.381 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:46:51.381 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:46:51.381 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:46:51.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.382 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "89", 2024-09-12T02:46:51.382 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:46:51.382 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:46:51.382 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:46:51.382 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:46:51.382 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:46:51.382 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:46:51.382 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:46:51.382 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:46:51.382 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:46:51.382 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:46:51.382 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:46:51.382 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:46:51.383 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:46:51.383 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:46:51.383 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:46:51.383 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:46:51.383 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:46:51.383 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:46:51.383 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:46:51.383 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:46:51.383 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:46:51.383 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:46:51.383 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:46:51.383 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:46:51.383 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:46:51.384 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:46:51.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.384 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:46:51.384 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:46:51.384 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:46:51.384 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:46:51.384 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:46:51.384 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:46:51.384 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:46:51.384 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:46:51.384 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:46:51.384 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:46:51.384 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:46:51.384 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:46:51.385 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_max": 32, 2024-09-12T02:46:51.385 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 1 2024-09-12T02:46:51.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.385 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:46:51.385 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": {} 2024-09-12T02:46:51.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.385 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:46:51.385 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:46:51.385 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 8, 2024-09-12T02:46:51.385 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 8, 2024-09-12T02:46:51.385 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 0.25, 2024-09-12T02:46:51.385 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:46:51.385 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:46:51.386 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:46:51.386 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:46:51.386 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:46:51.386 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.386 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 12, 2024-09-12T02:46:51.386 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:46:51.386 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:46:34.392830+0000", 2024-09-12T02:46:51.386 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:46:51.387 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:46:51.387 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:46:51.387 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:46:51.387 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:46:51.387 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:46:51.387 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:46:51.387 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:46:51.387 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:46:51.387 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:46:51.387 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:46:51.387 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:46:51.387 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:46:51.387 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 32, 2024-09-12T02:46:51.387 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 32, 2024-09-12T02:46:51.388 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 32, 2024-09-12T02:46:51.388 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 32, 2024-09-12T02:46:51.388 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 32, 2024-09-12T02:46:51.388 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:46:51.388 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:46:51.388 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:46:51.388 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:46:51.388 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:46:51.388 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:46:51.388 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:46:51.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.388 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "96", 2024-09-12T02:46:51.388 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:46:51.388 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:46:51.389 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:46:51.389 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:46:51.389 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:46:51.389 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:46:51.389 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:46:51.389 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:46:51.389 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:46:51.389 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:46:51.389 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:46:51.389 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:46:51.389 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:46:51.389 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:46:51.389 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:46:51.389 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:46:51.390 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:46:51.390 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:46:51.390 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:46:51.390 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:46:51.390 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:46:51.390 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:46:51.390 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:46:51.390 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:46:51.390 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:46:51.390 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:46:51.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.391 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:46:51.391 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:46:51.391 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:46:51.391 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:46:51.391 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:46:51.391 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:46:51.391 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:46:51.391 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:46:51.391 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:46:51.391 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:46:51.391 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:46:51.391 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:46:51.391 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:46:51.391 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 16, 2024-09-12T02:46:51.392 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_priority": 5 2024-09-12T02:46:51.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.392 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:46:51.392 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:46:51.392 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": "cephfs" 2024-09-12T02:46:51.392 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.392 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:46:51.392 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:46:51.393 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 2, 2024-09-12T02:46:51.393 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 2, 2024-09-12T02:46:51.393 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:46:51.393 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:46:51.393 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:46:51.393 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:46:51.393 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:46:51.393 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:46:51.393 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.393 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 13, 2024-09-12T02:46:51.393 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_data", 2024-09-12T02:46:51.393 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:46:35.615193+0000", 2024-09-12T02:46:51.394 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:46:51.394 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:46:51.394 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:46:51.394 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:46:51.394 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:46:51.394 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:46:51.394 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:46:51.394 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:46:51.394 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:46:51.394 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:46:51.394 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:46:51.394 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:46:51.394 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:46:51.394 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 64, 2024-09-12T02:46:51.394 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 64, 2024-09-12T02:46:51.395 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 64, 2024-09-12T02:46:51.395 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 64, 2024-09-12T02:46:51.395 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 64, 2024-09-12T02:46:51.395 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:46:51.395 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:46:51.395 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:46:51.395 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:46:51.395 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:46:51.395 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:46:51.395 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:46:51.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.396 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "97", 2024-09-12T02:46:51.396 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:46:51.396 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:46:51.396 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:46:51.396 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:46:51.396 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:46:51.396 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:46:51.396 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:46:51.396 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:46:51.396 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:46:51.396 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:46:51.396 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:46:51.397 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:46:51.397 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:46:51.397 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:46:51.397 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:46:51.397 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:46:51.400 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:46:51.400 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:46:51.400 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:46:51.401 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:46:51.401 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:46:51.401 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:46:51.401 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:46:51.401 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:46:51.401 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:46:51.401 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:46:51.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.401 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:46:51.401 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:46:51.401 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:46:51.401 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:46:51.402 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:46:51.402 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:46:51.402 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:46:51.402 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:46:51.402 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:46:51.402 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:46:51.402 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:46:51.402 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:46:51.402 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 64, 2024-09-12T02:46:51.402 INFO:teuthology.orchestra.run.smithi112.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:46:51.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.402 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:46:51.402 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:46:51.402 INFO:teuthology.orchestra.run.smithi112.stdout: "data": "cephfs" 2024-09-12T02:46:51.403 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.403 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:46:51.403 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:46:51.403 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.3799999952316284, 2024-09-12T02:46:51.403 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.3799999952316284, 2024-09-12T02:46:51.403 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:46:51.403 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-12T02:46:51.403 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-12T02:46:51.403 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:46:51.403 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:46:51.403 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:46:51.403 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.403 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.404 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:46:51.404 INFO:teuthology.orchestra.run.smithi112.stdout: "osds": [ 2024-09-12T02:46:51.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.404 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:46:51.404 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:51.404 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:51.404 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:51.404 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:51.404 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:51.404 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:51.404 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:51.404 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:51.404 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:46:51.404 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:51.405 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:51.405 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:51.405 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.405 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.405 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6800", 2024-09-12T02:46:51.405 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:51.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.405 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.405 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6801", 2024-09-12T02:46:51.405 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:51.405 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.406 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.406 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:51.406 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.406 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.406 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6802", 2024-09-12T02:46:51.406 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:51.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.406 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.406 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6803", 2024-09-12T02:46:51.406 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:51.406 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.407 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.407 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:51.407 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.407 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.407 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6806", 2024-09-12T02:46:51.407 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:51.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.407 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.407 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6807", 2024-09-12T02:46:51.407 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:51.407 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.408 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.408 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:51.408 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.408 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.408 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6804", 2024-09-12T02:46:51.408 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:51.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.408 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.408 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6805", 2024-09-12T02:46:51.408 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:51.408 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.408 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.409 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6801/821571304", 2024-09-12T02:46:51.409 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6803/821571304", 2024-09-12T02:46:51.409 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6807/821571304", 2024-09-12T02:46:51.409 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6805/821571304", 2024-09-12T02:46:51.409 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:51.409 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:51.409 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:51.409 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.409 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:46:51.410 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:51.410 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:51.410 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:51.410 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:51.410 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:51.410 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:51.410 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:51.410 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:51.410 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:46:51.410 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:51.410 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:51.410 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:51.410 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.411 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.411 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6808", 2024-09-12T02:46:51.411 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:51.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.411 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.411 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6809", 2024-09-12T02:46:51.411 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:51.411 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.411 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.411 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:51.411 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.412 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.412 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6810", 2024-09-12T02:46:51.412 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:51.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.412 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.412 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6811", 2024-09-12T02:46:51.412 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:51.412 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.412 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.412 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:51.412 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.413 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.413 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6814", 2024-09-12T02:46:51.413 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:51.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.413 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.413 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6815", 2024-09-12T02:46:51.413 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:51.413 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.413 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.413 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:51.414 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.414 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.414 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6812", 2024-09-12T02:46:51.414 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:51.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.414 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.415 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6813", 2024-09-12T02:46:51.415 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:51.415 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.415 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.415 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6809/2642068641", 2024-09-12T02:46:51.415 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6811/2642068641", 2024-09-12T02:46:51.415 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6815/2642068641", 2024-09-12T02:46:51.415 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6813/2642068641", 2024-09-12T02:46:51.415 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:51.415 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:51.415 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:51.415 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.416 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:46:51.416 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:51.416 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:51.416 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:51.416 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:51.416 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:51.416 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:51.416 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:51.416 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:51.416 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:46:51.416 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:51.416 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:51.416 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:51.416 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.417 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.417 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6816", 2024-09-12T02:46:51.417 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:51.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.417 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.417 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6817", 2024-09-12T02:46:51.417 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:51.417 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.417 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.417 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:51.418 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.418 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.418 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6818", 2024-09-12T02:46:51.418 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:51.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.418 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.418 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6819", 2024-09-12T02:46:51.418 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:51.418 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.418 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.418 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:51.419 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.419 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.419 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6822", 2024-09-12T02:46:51.419 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:51.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.419 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.419 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6823", 2024-09-12T02:46:51.419 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:51.419 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.419 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.419 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:51.420 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.420 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.420 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6820", 2024-09-12T02:46:51.420 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:51.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.420 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.420 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6821", 2024-09-12T02:46:51.420 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:51.420 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.420 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.420 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6817/3365688807", 2024-09-12T02:46:51.421 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6819/3365688807", 2024-09-12T02:46:51.421 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6823/3365688807", 2024-09-12T02:46:51.421 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6821/3365688807", 2024-09-12T02:46:51.421 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:51.421 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:51.421 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:51.421 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.421 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:46:51.421 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:51.421 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:51.421 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:51.421 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:51.422 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:51.422 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:51.422 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:51.422 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:51.422 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 98, 2024-09-12T02:46:51.422 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:51.422 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:51.422 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:51.422 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.422 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.422 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6824", 2024-09-12T02:46:51.422 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:51.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.423 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.423 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6825", 2024-09-12T02:46:51.423 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:51.423 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.423 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.423 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:51.423 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.423 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.423 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6826", 2024-09-12T02:46:51.424 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:51.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.424 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.424 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6827", 2024-09-12T02:46:51.424 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:51.424 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.424 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.424 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:51.424 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.424 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.424 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6830", 2024-09-12T02:46:51.425 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:51.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.425 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.425 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6831", 2024-09-12T02:46:51.425 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:51.425 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.425 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.425 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:51.425 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.425 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.426 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6828", 2024-09-12T02:46:51.426 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:51.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.426 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.426 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6829", 2024-09-12T02:46:51.426 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:51.426 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.426 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.426 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6825/231774278", 2024-09-12T02:46:51.426 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6827/231774278", 2024-09-12T02:46:51.426 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6831/231774278", 2024-09-12T02:46:51.426 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6829/231774278", 2024-09-12T02:46:51.427 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:51.427 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:51.427 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:51.427 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.427 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:46:51.427 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:51.427 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:51.427 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:51.427 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:51.427 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:51.427 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:51.427 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:51.428 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:51.428 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:46:51.428 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:51.428 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:51.428 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:51.428 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.428 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.428 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6800", 2024-09-12T02:46:51.428 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:51.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.428 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.428 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6801", 2024-09-12T02:46:51.429 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:51.429 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.429 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.429 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:51.429 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.429 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.429 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6802", 2024-09-12T02:46:51.429 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:51.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.429 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.429 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6803", 2024-09-12T02:46:51.430 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:51.430 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.430 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.430 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:51.430 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.430 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.430 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6806", 2024-09-12T02:46:51.430 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:51.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.430 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.431 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6807", 2024-09-12T02:46:51.431 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:51.431 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.431 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.431 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:51.431 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.431 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.431 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6804", 2024-09-12T02:46:51.431 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:51.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.431 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.432 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6805", 2024-09-12T02:46:51.432 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:51.432 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.432 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.432 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6801/3671178153", 2024-09-12T02:46:51.432 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6803/3671178153", 2024-09-12T02:46:51.432 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6807/3671178153", 2024-09-12T02:46:51.432 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6805/3671178153", 2024-09-12T02:46:51.432 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:51.432 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:51.432 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:51.432 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.433 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:46:51.433 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:51.433 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:51.433 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:51.433 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:51.433 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:51.433 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:51.433 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:51.433 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:51.433 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:46:51.433 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:51.433 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:51.433 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:51.434 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.434 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.434 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6808", 2024-09-12T02:46:51.434 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:51.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.434 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.434 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6809", 2024-09-12T02:46:51.434 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:51.434 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.434 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.434 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:51.435 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.435 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.435 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6810", 2024-09-12T02:46:51.435 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:51.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.435 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.435 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6811", 2024-09-12T02:46:51.435 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:51.435 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.435 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.435 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:51.436 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.436 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.436 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6817", 2024-09-12T02:46:51.436 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:51.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.436 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.436 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6819", 2024-09-12T02:46:51.436 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:51.436 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.436 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.436 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:51.437 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.437 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.437 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6812", 2024-09-12T02:46:51.437 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:51.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.437 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.437 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6815", 2024-09-12T02:46:51.437 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:51.437 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.437 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.438 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6809/3193706134", 2024-09-12T02:46:51.438 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6811/3193706134", 2024-09-12T02:46:51.438 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6819/3193706134", 2024-09-12T02:46:51.438 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6815/3193706134", 2024-09-12T02:46:51.438 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:51.438 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:51.438 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:51.438 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.438 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:46:51.438 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:51.438 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:51.438 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:51.439 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:51.439 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:51.439 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:51.439 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:51.439 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:51.439 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:46:51.439 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:51.439 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:51.439 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:51.439 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.439 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.439 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6813", 2024-09-12T02:46:51.439 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:51.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.440 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.440 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6814", 2024-09-12T02:46:51.440 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:51.440 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.440 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.440 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:51.440 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.440 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.440 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6816", 2024-09-12T02:46:51.441 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:51.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.441 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.441 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6818", 2024-09-12T02:46:51.441 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:51.441 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.441 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.441 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:51.441 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.441 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.441 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6822", 2024-09-12T02:46:51.441 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:51.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.442 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.442 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6823", 2024-09-12T02:46:51.442 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:51.442 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.442 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.442 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:51.442 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.442 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.442 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6820", 2024-09-12T02:46:51.442 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:51.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.443 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.443 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6821", 2024-09-12T02:46:51.443 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:51.443 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.443 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.443 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6814/3738813293", 2024-09-12T02:46:51.443 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6818/3738813293", 2024-09-12T02:46:51.443 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6823/3738813293", 2024-09-12T02:46:51.443 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6821/3738813293", 2024-09-12T02:46:51.443 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:51.443 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:51.444 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:51.444 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.444 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:46:51.444 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:51.444 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:51.444 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:51.444 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:51.444 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:51.444 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:51.444 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:51.444 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:51.444 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:46:51.445 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:51.445 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:51.445 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:51.445 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.445 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.445 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6824", 2024-09-12T02:46:51.445 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:51.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.445 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.445 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6825", 2024-09-12T02:46:51.445 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:51.446 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.446 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.446 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:51.446 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.446 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.446 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6826", 2024-09-12T02:46:51.446 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:51.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.446 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.446 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6827", 2024-09-12T02:46:51.446 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:51.447 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.447 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.447 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:51.447 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.447 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.447 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6830", 2024-09-12T02:46:51.447 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:51.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.447 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.447 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6831", 2024-09-12T02:46:51.447 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:51.447 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.448 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.448 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:51.448 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:51.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.448 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:51.448 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6828", 2024-09-12T02:46:51.448 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:51.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.448 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:51.448 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6829", 2024-09-12T02:46:51.448 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:51.448 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.449 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.449 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6825/1421932609", 2024-09-12T02:46:51.449 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6827/1421932609", 2024-09-12T02:46:51.449 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6831/1421932609", 2024-09-12T02:46:51.449 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6829/1421932609", 2024-09-12T02:46:51.449 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:51.449 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:51.449 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:51.449 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.449 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.449 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:46:51.449 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_xinfo": [ 2024-09-12T02:46:51.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.450 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:46:51.450 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:51.450 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:51.450 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:51.450 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:51.450 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:51.450 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.220641+0000", 2024-09-12T02:46:51.450 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:51.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.450 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:46:51.450 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:51.450 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:51.450 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:51.451 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:51.451 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:51.451 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312574+0000", 2024-09-12T02:46:51.451 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:51.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.451 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:46:51.451 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:51.451 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:51.451 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:51.451 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:51.451 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:51.451 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.282771+0000", 2024-09-12T02:46:51.451 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:51.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.452 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:46:51.452 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:51.452 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:51.452 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:51.452 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:51.452 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:51.452 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.260478+0000", 2024-09-12T02:46:51.452 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:51.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.452 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:46:51.452 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:51.453 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:51.453 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:51.453 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:51.453 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:51.453 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.273397+0000", 2024-09-12T02:46:51.453 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:51.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.453 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:46:51.453 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:51.453 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:51.453 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:51.453 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:51.453 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:51.454 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312452+0000", 2024-09-12T02:46:51.454 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:51.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.454 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:46:51.454 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:51.454 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:51.454 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:51.454 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:51.454 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:51.454 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.308965+0000", 2024-09-12T02:46:51.454 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:51.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.454 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:46:51.455 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:51.455 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:51.455 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:51.455 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:51.455 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:51.455 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.337842+0000", 2024-09-12T02:46:51.455 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:51.455 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.455 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:46:51.455 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap": [], 2024-09-12T02:46:51.455 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_items": [ 2024-09-12T02:46:51.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.455 INFO:teuthology.orchestra.run.smithi112.stdout: "pgid": "13.2a", 2024-09-12T02:46:51.455 INFO:teuthology.orchestra.run.smithi112.stdout: "mappings": [ 2024-09-12T02:46:51.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:51.456 INFO:teuthology.orchestra.run.smithi112.stdout: "from": 1, 2024-09-12T02:46:51.456 INFO:teuthology.orchestra.run.smithi112.stdout: "to": 3 2024-09-12T02:46:51.456 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.456 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:51.456 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.456 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:46:51.456 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_primaries": [], 2024-09-12T02:46:51.456 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_temp": [], 2024-09-12T02:46:51.456 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_temp": [], 2024-09-12T02:46:51.456 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklist": {}, 2024-09-12T02:46:51.456 INFO:teuthology.orchestra.run.smithi112.stdout: "range_blocklist": {}, 2024-09-12T02:46:51.456 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profiles": { 2024-09-12T02:46:51.456 INFO:teuthology.orchestra.run.smithi112.stdout: "default": { 2024-09-12T02:46:51.457 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-failure-domain": "osd", 2024-09-12T02:46:51.457 INFO:teuthology.orchestra.run.smithi112.stdout: "k": "2", 2024-09-12T02:46:51.457 INFO:teuthology.orchestra.run.smithi112.stdout: "m": "1", 2024-09-12T02:46:51.457 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin": "jerasure", 2024-09-12T02:46:51.457 INFO:teuthology.orchestra.run.smithi112.stdout: "technique": "reed_sol_van" 2024-09-12T02:46:51.457 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:51.457 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps_queue": [], 2024-09-12T02:46:51.457 INFO:teuthology.orchestra.run.smithi112.stdout: "new_removed_snaps": [], 2024-09-12T02:46:51.457 INFO:teuthology.orchestra.run.smithi112.stdout: "new_purged_snaps": [], 2024-09-12T02:46:51.457 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_node_flags": {}, 2024-09-12T02:46:51.457 INFO:teuthology.orchestra.run.smithi112.stdout: "device_class_flags": {}, 2024-09-12T02:46:51.457 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode": { 2024-09-12T02:46:51.457 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_enabled": false, 2024-09-12T02:46:51.457 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_bucket_count": 0, 2024-09-12T02:46:51.458 INFO:teuthology.orchestra.run.smithi112.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:46:51.458 INFO:teuthology.orchestra.run.smithi112.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:46:51.458 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_bucket": 0 2024-09-12T02:46:51.458 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:51.458 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:46:51.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.378+0000 7f4ca7200640 1 -- 172.21.15.112:0/3534100679 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4c8406be30 msgr2=0x7f4c8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:51.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.378+0000 7f4ca7200640 1 --2- 172.21.15.112:0/3534100679 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4c8406be30 0x7f4c8406e2f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4ca00b3630 tx=0x7f4c94009190 comp rx=0 tx=0).stop 2024-09-12T02:46:51.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.378+0000 7f4ca7200640 1 -- 172.21.15.112:0/3534100679 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ca00b4ce0 msgr2=0x7f4ca00d0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:51.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.378+0000 7f4ca7200640 1 --2- 172.21.15.112:0/3534100679 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ca00b4ce0 0x7f4ca00d0ce0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f4c9000c4d0 tx=0x7f4c9000c990 comp rx=0 tx=0).stop 2024-09-12T02:46:51.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.378+0000 7f4ca7200640 1 -- 172.21.15.112:0/3534100679 shutdown_connections 2024-09-12T02:46:51.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.378+0000 7f4ca7200640 1 --2- 172.21.15.112:0/3534100679 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4c8406be30 0x7f4c8406e2f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.378+0000 7f4ca7200640 1 --2- 172.21.15.112:0/3534100679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ca015c800 0x7f4ca00c6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.378+0000 7f4ca7200640 1 --2- 172.21.15.112:0/3534100679 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ca00b4ce0 0x7f4ca00d0ce0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.378+0000 7f4ca7200640 1 --2- 172.21.15.112:0/3534100679 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ca00b0770 0x7f4ca01f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.378+0000 7f4ca7200640 1 -- 172.21.15.112:0/3534100679 >> 172.21.15.112:0/3534100679 conn(0x7f4ca006cce0 msgr2=0x7f4ca006d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:51.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.378+0000 7f4ca7200640 1 -- 172.21.15.112:0/3534100679 shutdown_connections 2024-09-12T02:46:51.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:51.378+0000 7f4ca7200640 1 -- 172.21.15.112:0/3534100679 wait complete. 2024-09-12T02:46:51.461 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-12T02:46:51.558 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:46:51.562 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:46:54.092 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-12T02:46:54.092+0000 7f0219e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2024-09-12T02:46:56.462 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-12T02:46:56.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.625+0000 7f8f7f200640 1 Processor -- start 2024-09-12T02:46:56.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.625+0000 7f8f7f200640 1 -- start start 2024-09-12T02:46:56.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.626+0000 7f8f7f200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8f780d0370 0x7f8f780b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:56.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.626+0000 7f8f7f200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8f780d57e0 0x7f8f780b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:56.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.626+0000 7f8f7f200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f781627a0 con 0x7f8f781623c0 2024-09-12T02:46:56.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.626+0000 7f8f7f200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8f780d08e0 con 0x7f8f780d0370 2024-09-12T02:46:56.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.626+0000 7f8f7f200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8f780d0bc0 con 0x7f8f780d57e0 2024-09-12T02:46:56.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.626+0000 7f8f7d400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8f780d0370 0x7f8f780b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:56.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.626+0000 7f8f7d400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8f780d0370 0x7f8f780b4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37350/0 (socket says 172.21.15.112:37350) 2024-09-12T02:46:56.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.626+0000 7f8f7d400640 1 -- 172.21.15.112:0/2576315312 learned_addr learned my addr 172.21.15.112:0/2576315312 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:56.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.627+0000 7f8f7e800640 1 --2- 172.21.15.112:0/2576315312 >> v2:172.21.15.137:3300/0 conn(0x7f8f780d57e0 0x7f8f780b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:56.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.627+0000 7f8f7d400640 1 -- 172.21.15.112:0/2576315312 >> v2:172.21.15.137:3300/0 conn(0x7f8f780d57e0 msgr2=0x7f8f780b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:56.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.627+0000 7f8f7d400640 1 --2- 172.21.15.112:0/2576315312 >> v2:172.21.15.137:3300/0 conn(0x7f8f780d57e0 0x7f8f780b4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:56.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.627+0000 7f8f7d400640 1 -- 172.21.15.112:0/2576315312 >> v1:172.21.15.137:6789/0 conn(0x7f8f781623c0 legacy=0x7f8f780d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:56.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.627+0000 7f8f7d400640 1 -- 172.21.15.112:0/2576315312 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f780d2930 con 0x7f8f780d0370 2024-09-12T02:46:56.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.628+0000 7f8f7d400640 1 --2- 172.21.15.112:0/2576315312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f780d0370 0x7f8f780b4620 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f8f7808dd50 tx=0x7f8f6802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de72b1707df750af server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:56.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.628+0000 7f8f7ca00640 1 -- 172.21.15.112:0/2576315312 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f68037070 con 0x7f8f780d0370 2024-09-12T02:46:56.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.628+0000 7f8f7ca00640 1 -- 172.21.15.112:0/2576315312 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f6802ae50 con 0x7f8f780d0370 2024-09-12T02:46:56.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.628+0000 7f8f7ca00640 1 -- 172.21.15.112:0/2576315312 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f68032860 con 0x7f8f780d0370 2024-09-12T02:46:56.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.629+0000 7f8f7f200640 1 -- 172.21.15.112:0/2576315312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f780d0370 msgr2=0x7f8f780b4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:56.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.629+0000 7f8f7f200640 1 --2- 172.21.15.112:0/2576315312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f780d0370 0x7f8f780b4620 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f8f7808dd50 tx=0x7f8f6802a300 comp rx=0 tx=0).stop 2024-09-12T02:46:56.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.629+0000 7f8f7f200640 1 -- 172.21.15.112:0/2576315312 shutdown_connections 2024-09-12T02:46:56.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.629+0000 7f8f7f200640 1 --2- 172.21.15.112:0/2576315312 >> v2:172.21.15.137:3300/0 conn(0x7f8f780d57e0 0x7f8f780b4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:56.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.629+0000 7f8f7f200640 1 --2- 172.21.15.112:0/2576315312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f780d0370 0x7f8f780b4620 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:56.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.629+0000 7f8f7f200640 1 -- 172.21.15.112:0/2576315312 >> 172.21.15.112:0/2576315312 conn(0x7f8f780d4cc0 msgr2=0x7f8f780d50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:56.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.629+0000 7f8f7f200640 1 -- 172.21.15.112:0/2576315312 shutdown_connections 2024-09-12T02:46:56.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.629+0000 7f8f7f200640 1 -- 172.21.15.112:0/2576315312 wait complete. 2024-09-12T02:46:56.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.630+0000 7f8f7f200640 1 Processor -- start 2024-09-12T02:46:56.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.631+0000 7f8f7f200640 1 -- start start 2024-09-12T02:46:56.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.631+0000 7f8f7f200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f780d0370 0x7f8f78158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:56.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.631+0000 7f8f7f200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f780d57e0 0x7f8f780ba500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:56.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.631+0000 7f8f7f200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8f781623c0 0x7f8f780b9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:56.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.631+0000 7f8f7f200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8f780b6460 con 0x7f8f780d57e0 2024-09-12T02:46:56.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.631+0000 7f8f7f200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8f780d2ef0 con 0x7f8f780d0370 2024-09-12T02:46:56.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.631+0000 7f8f7f200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8f780b65e0 con 0x7f8f781623c0 2024-09-12T02:46:56.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.632+0000 7f8f7d400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f780d57e0 0x7f8f780ba500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:56.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.632+0000 7f8f7d400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f780d57e0 0x7f8f780ba500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37358/0 (socket says 172.21.15.112:37358) 2024-09-12T02:46:56.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.632+0000 7f8f7d400640 1 -- 172.21.15.112:0/189191189 learned_addr learned my addr 172.21.15.112:0/189191189 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:56.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.632+0000 7f8f7de00640 1 --2- 172.21.15.112:0/189191189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f780d0370 0x7f8f78158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:56.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.632+0000 7f8f7e800640 1 --2- 172.21.15.112:0/189191189 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8f781623c0 0x7f8f780b9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:56.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.632+0000 7f8f7d400640 1 -- 172.21.15.112:0/189191189 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8f781623c0 msgr2=0x7f8f780b9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:56.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.632+0000 7f8f7d400640 1 --2- 172.21.15.112:0/189191189 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8f781623c0 0x7f8f780b9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:56.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.632+0000 7f8f7d400640 1 -- 172.21.15.112:0/189191189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f780d0370 msgr2=0x7f8f78158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:56.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.632+0000 7f8f7d400640 1 --2- 172.21.15.112:0/189191189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f780d0370 0x7f8f78158100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:56.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.632+0000 7f8f7d400640 1 -- 172.21.15.112:0/189191189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f780b8650 con 0x7f8f780d57e0 2024-09-12T02:46:56.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.632+0000 7f8f7de00640 1 --2- 172.21.15.112:0/189191189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f780d0370 0x7f8f78158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:56.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.632+0000 7f8f7e800640 1 --2- 172.21.15.112:0/189191189 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8f781623c0 0x7f8f780b9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:56.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.632+0000 7f8f7d400640 1 --2- 172.21.15.112:0/189191189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f780d57e0 0x7f8f780ba500 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8f6802a340 tx=0x7f8f680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:56.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.633+0000 7f8f72000640 1 -- 172.21.15.112:0/189191189 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f68041020 con 0x7f8f780d57e0 2024-09-12T02:46:56.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.633+0000 7f8f72000640 1 -- 172.21.15.112:0/189191189 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f6803c890 con 0x7f8f780d57e0 2024-09-12T02:46:56.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.633+0000 7f8f72000640 1 -- 172.21.15.112:0/189191189 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f68037040 con 0x7f8f780d57e0 2024-09-12T02:46:56.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.633+0000 7f8f7f200640 1 -- 172.21.15.112:0/189191189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f780b8920 con 0x7f8f780d57e0 2024-09-12T02:46:56.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.633+0000 7f8f7f200640 1 -- 172.21.15.112:0/189191189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f780b8ee0 con 0x7f8f780d57e0 2024-09-12T02:46:56.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.634+0000 7f8f7f200640 1 -- 172.21.15.112:0/189191189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f780ba2e0 con 0x7f8f780d57e0 2024-09-12T02:46:56.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.635+0000 7f8f72000640 1 -- 172.21.15.112:0/189191189 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8f68044020 con 0x7f8f780d57e0 2024-09-12T02:46:56.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.636+0000 7f8f72000640 1 --2- 172.21.15.112:0/189191189 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8f5c06be30 0x7f8f5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:56.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.636+0000 7f8f72000640 1 -- 172.21.15.112:0/189191189 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5738+0+0 (secure 0 0 0) 0x7f8f680ab7a0 con 0x7f8f780d57e0 2024-09-12T02:46:56.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.636+0000 7f8f7de00640 1 --2- 172.21.15.112:0/189191189 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8f5c06be30 0x7f8f5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:56.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.636+0000 7f8f72000640 1 -- 172.21.15.112:0/189191189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=105}) -- 0x7f8f5c0739c0 con 0x7f8f780d57e0 2024-09-12T02:46:56.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.637+0000 7f8f7de00640 1 --2- 172.21.15.112:0/189191189 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8f5c06be30 0x7f8f5c06e2f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c001700 tx=0x7f8f6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:56.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.640+0000 7f8f72000640 1 -- 172.21.15.112:0/189191189 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8f6804b030 con 0x7f8f780d57e0 2024-09-12T02:46:56.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.813+0000 7f8f7f200640 1 -- 172.21.15.112:0/189191189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f8f7808e7c0 con 0x7f8f780d57e0 2024-09-12T02:46:56.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.815+0000 7f8f72000640 1 -- 172.21.15.112:0/189191189 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v104) ==== 81+0+34638 (secure 0 0 0) 0x7f8f6807a090 con 0x7f8f780d57e0 2024-09-12T02:46:56.816 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:46:56.816 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:46:56.817 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 104, 2024-09-12T02:46:56.817 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:46:56.817 INFO:teuthology.orchestra.run.smithi112.stdout: "created": "2024-09-12T02:41:36.162095+0000", 2024-09-12T02:46:56.817 INFO:teuthology.orchestra.run.smithi112.stdout: "modified": "2024-09-12T02:46:56.105207+0000", 2024-09-12T02:46:56.817 INFO:teuthology.orchestra.run.smithi112.stdout: "last_up_change": "2024-09-12T02:41:42.191169+0000", 2024-09-12T02:46:56.817 INFO:teuthology.orchestra.run.smithi112.stdout: "last_in_change": "2024-09-12T02:41:39.036600+0000", 2024-09-12T02:46:56.817 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:46:56.817 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_num": 5799936, 2024-09-12T02:46:56.817 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_set": [ 2024-09-12T02:46:56.817 INFO:teuthology.orchestra.run.smithi112.stdout: "pglog_hardlimit", 2024-09-12T02:46:56.817 INFO:teuthology.orchestra.run.smithi112.stdout: "purged_snapdirs", 2024-09-12T02:46:56.817 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_deletes", 2024-09-12T02:46:56.817 INFO:teuthology.orchestra.run.smithi112.stdout: "sortbitwise" 2024-09-12T02:46:56.817 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:46:56.818 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_version": 4, 2024-09-12T02:46:56.818 INFO:teuthology.orchestra.run.smithi112.stdout: "full_ratio": 0.69999998807907104, 2024-09-12T02:46:56.818 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-12T02:46:56.818 INFO:teuthology.orchestra.run.smithi112.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-12T02:46:56.818 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_snapshot": "", 2024-09-12T02:46:56.818 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_max": 13, 2024-09-12T02:46:56.818 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd": 8, 2024-09-12T02:46:56.818 INFO:teuthology.orchestra.run.smithi112.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:46:56.818 INFO:teuthology.orchestra.run.smithi112.stdout: "min_compat_client": "luminous", 2024-09-12T02:46:56.818 INFO:teuthology.orchestra.run.smithi112.stdout: "require_osd_release": "squid", 2024-09-12T02:46:56.818 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_crimson": false, 2024-09-12T02:46:56.818 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-12T02:46:56.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.818 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 1, 2024-09-12T02:46:56.819 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": ".mgr", 2024-09-12T02:46:56.819 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:41:43.011599+0000", 2024-09-12T02:46:56.819 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 3, 2024-09-12T02:46:56.819 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full", 2024-09-12T02:46:56.819 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:46:56.819 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:46:56.819 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:46:56.819 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:46:56.819 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:46:56.819 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:46:56.819 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:46:56.819 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:46:56.819 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:46:56.819 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:46:56.820 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:46:56.820 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 1, 2024-09-12T02:46:56.820 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 1, 2024-09-12T02:46:56.820 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 1, 2024-09-12T02:46:56.820 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 1, 2024-09-12T02:46:56.820 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 1, 2024-09-12T02:46:56.820 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:46:56.820 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:46:56.820 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:46:56.820 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:46:56.820 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:46:56.820 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:46:56.820 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:46:56.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.821 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "102", 2024-09-12T02:46:56.821 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:46:56.821 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:46:56.821 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:46:56.821 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:46:56.821 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:46:56.821 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:46:56.821 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:46:56.821 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:46:56.821 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:46:56.821 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:46:56.821 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:46:56.821 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:46:56.822 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:46:56.822 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:46:56.822 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:46:56.822 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:46:56.822 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:46:56.822 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:46:56.822 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:46:56.822 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:46:56.822 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:46:56.822 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:46:56.822 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:46:56.822 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:46:56.822 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:46:56.822 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:46:56.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.823 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:46:56.823 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:46:56.823 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:46:56.823 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:46:56.823 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:46:56.823 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:46:56.823 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:46:56.823 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:46:56.823 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:46:56.823 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:46:56.823 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:46:56.823 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:46:56.823 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_max": 32, 2024-09-12T02:46:56.824 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 1 2024-09-12T02:46:56.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.824 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:46:56.824 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": {} 2024-09-12T02:46:56.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.824 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:46:56.824 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:46:56.824 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 8, 2024-09-12T02:46:56.824 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 8, 2024-09-12T02:46:56.824 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 0.25, 2024-09-12T02:46:56.824 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:46:56.824 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:46:56.824 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:46:56.825 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:46:56.825 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:46:56.825 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.825 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 12, 2024-09-12T02:46:56.825 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:46:56.825 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:46:34.392830+0000", 2024-09-12T02:46:56.825 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 3, 2024-09-12T02:46:56.825 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full", 2024-09-12T02:46:56.825 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:46:56.825 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:46:56.825 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:46:56.825 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:46:56.826 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:46:56.826 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:46:56.826 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:46:56.826 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:46:56.826 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:46:56.826 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:46:56.826 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:46:56.826 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 32, 2024-09-12T02:46:56.826 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 32, 2024-09-12T02:46:56.826 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 32, 2024-09-12T02:46:56.826 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 32, 2024-09-12T02:46:56.826 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 32, 2024-09-12T02:46:56.826 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:46:56.826 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:46:56.827 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:46:56.827 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:46:56.827 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:46:56.827 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:46:56.827 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:46:56.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.827 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "102", 2024-09-12T02:46:56.827 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:46:56.827 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:46:56.827 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:46:56.827 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:46:56.827 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:46:56.827 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:46:56.827 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:46:56.828 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:46:56.828 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:46:56.828 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:46:56.828 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:46:56.828 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:46:56.828 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:46:56.828 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:46:56.828 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:46:56.828 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:46:56.828 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:46:56.828 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:46:56.828 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:46:56.828 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:46:56.828 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:46:56.829 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:46:56.829 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:46:56.829 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:46:56.829 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:46:56.829 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:46:56.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.829 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:46:56.829 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:46:56.829 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:46:56.829 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:46:56.829 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:46:56.829 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:46:56.829 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:46:56.829 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:46:56.829 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:46:56.830 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:46:56.830 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:46:56.830 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:46:56.830 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:46:56.830 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 16, 2024-09-12T02:46:56.830 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_priority": 5 2024-09-12T02:46:56.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.830 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:46:56.830 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:46:56.830 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": "cephfs" 2024-09-12T02:46:56.830 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.830 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:46:56.830 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:46:56.831 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 2, 2024-09-12T02:46:56.831 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 2, 2024-09-12T02:46:56.831 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:46:56.831 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:46:56.831 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:46:56.831 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:46:56.832 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:46:56.832 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:46:56.832 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.832 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 13, 2024-09-12T02:46:56.832 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_data", 2024-09-12T02:46:56.832 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:46:35.615193+0000", 2024-09-12T02:46:56.832 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 3, 2024-09-12T02:46:56.832 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full", 2024-09-12T02:46:56.832 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:46:56.832 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:46:56.832 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:46:56.833 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:46:56.833 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:46:56.833 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:46:56.833 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:46:56.833 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:46:56.833 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:46:56.833 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:46:56.833 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:46:56.833 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 64, 2024-09-12T02:46:56.833 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 64, 2024-09-12T02:46:56.833 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 64, 2024-09-12T02:46:56.833 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 64, 2024-09-12T02:46:56.833 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 64, 2024-09-12T02:46:56.833 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:46:56.834 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:46:56.834 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:46:56.834 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:46:56.834 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:46:56.834 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:46:56.834 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:46:56.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.834 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "102", 2024-09-12T02:46:56.834 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:46:56.834 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:46:56.834 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:46:56.834 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:46:56.834 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:46:56.834 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:46:56.835 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:46:56.835 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:46:56.835 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:46:56.835 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:46:56.835 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:46:56.835 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:46:56.835 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:46:56.835 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:46:56.835 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:46:56.835 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:46:56.835 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:46:56.835 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:46:56.835 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:46:56.836 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:46:56.836 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:46:56.836 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:46:56.836 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:46:56.836 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:46:56.836 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:46:56.836 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:46:56.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.836 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:46:56.836 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:46:56.836 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:46:56.836 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:46:56.837 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:46:56.837 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:46:56.837 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:46:56.837 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:46:56.837 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:46:56.837 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:46:56.837 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:46:56.837 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:46:56.837 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 64, 2024-09-12T02:46:56.837 INFO:teuthology.orchestra.run.smithi112.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:46:56.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.837 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:46:56.837 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:46:56.837 INFO:teuthology.orchestra.run.smithi112.stdout: "data": "cephfs" 2024-09-12T02:46:56.838 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.838 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:46:56.838 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:46:56.838 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.3799999952316284, 2024-09-12T02:46:56.838 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.3799999952316284, 2024-09-12T02:46:56.838 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:46:56.838 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-12T02:46:56.838 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-12T02:46:56.838 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:46:56.838 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:46:56.838 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:46:56.838 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.838 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.839 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:46:56.839 INFO:teuthology.orchestra.run.smithi112.stdout: "osds": [ 2024-09-12T02:46:56.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.839 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:46:56.839 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:56.839 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:56.839 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:56.839 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:56.839 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:56.839 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:56.839 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:56.839 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:56.839 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:46:56.839 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:56.840 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:56.840 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:56.840 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.840 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.840 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6800", 2024-09-12T02:46:56.840 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:56.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.840 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.840 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6801", 2024-09-12T02:46:56.840 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:56.840 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.840 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.841 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:56.841 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.841 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.841 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6802", 2024-09-12T02:46:56.841 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:56.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.841 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.841 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6803", 2024-09-12T02:46:56.841 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:56.841 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.842 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.842 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:56.842 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.842 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.842 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6806", 2024-09-12T02:46:56.842 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:56.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.842 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.842 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6807", 2024-09-12T02:46:56.842 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:56.842 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.843 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.843 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:56.843 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.843 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.843 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6804", 2024-09-12T02:46:56.843 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:56.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.843 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.843 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6805", 2024-09-12T02:46:56.843 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:56.843 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.844 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.844 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6801/821571304", 2024-09-12T02:46:56.844 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6803/821571304", 2024-09-12T02:46:56.844 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6807/821571304", 2024-09-12T02:46:56.844 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6805/821571304", 2024-09-12T02:46:56.844 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:56.844 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:56.844 INFO:teuthology.orchestra.run.smithi112.stdout: "full", 2024-09-12T02:46:56.844 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:56.844 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.844 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:46:56.844 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:56.845 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:56.845 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:56.845 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:56.845 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:56.845 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:56.845 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:56.845 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:56.845 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:46:56.845 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:56.845 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:56.845 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:56.845 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.846 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.846 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6808", 2024-09-12T02:46:56.846 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:56.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.846 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.846 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6809", 2024-09-12T02:46:56.846 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:56.846 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.846 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.846 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:56.846 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.846 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.847 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6810", 2024-09-12T02:46:56.847 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:56.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.847 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.847 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6811", 2024-09-12T02:46:56.847 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:56.847 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.847 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.847 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:56.847 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.847 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.848 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6814", 2024-09-12T02:46:56.848 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:56.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.848 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.848 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6815", 2024-09-12T02:46:56.848 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:56.848 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.848 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.848 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:56.848 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.848 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.849 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6812", 2024-09-12T02:46:56.849 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:56.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.849 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.849 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6813", 2024-09-12T02:46:56.849 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:56.849 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.849 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.849 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6809/2642068641", 2024-09-12T02:46:56.849 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6811/2642068641", 2024-09-12T02:46:56.849 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6815/2642068641", 2024-09-12T02:46:56.849 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6813/2642068641", 2024-09-12T02:46:56.850 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:56.850 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:56.850 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:56.850 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.850 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:46:56.850 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:56.850 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:56.850 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:56.850 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:56.850 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:56.850 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:56.850 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:56.851 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:56.851 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:46:56.851 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:56.851 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:56.851 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:56.851 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.851 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.851 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6816", 2024-09-12T02:46:56.851 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:56.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.851 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.851 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6817", 2024-09-12T02:46:56.851 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:56.852 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.852 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.852 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:56.852 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.852 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.852 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6818", 2024-09-12T02:46:56.852 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:56.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.852 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.852 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6819", 2024-09-12T02:46:56.853 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:56.853 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.853 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.853 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:56.853 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.853 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.853 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6822", 2024-09-12T02:46:56.853 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:56.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.853 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.853 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6823", 2024-09-12T02:46:56.854 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:56.854 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.854 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.854 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:56.854 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.854 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.854 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6820", 2024-09-12T02:46:56.854 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:56.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.854 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.854 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6821", 2024-09-12T02:46:56.855 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:56.855 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.855 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.855 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6817/3365688807", 2024-09-12T02:46:56.855 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6819/3365688807", 2024-09-12T02:46:56.855 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6823/3365688807", 2024-09-12T02:46:56.855 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6821/3365688807", 2024-09-12T02:46:56.855 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:56.855 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:56.855 INFO:teuthology.orchestra.run.smithi112.stdout: "full", 2024-09-12T02:46:56.855 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:56.855 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.856 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:46:56.856 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:56.856 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:56.856 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:56.856 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:56.856 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:56.856 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:56.856 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:56.856 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:56.856 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 98, 2024-09-12T02:46:56.856 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:56.856 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:56.856 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:56.857 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.857 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.857 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6824", 2024-09-12T02:46:56.857 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:56.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.857 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.857 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6825", 2024-09-12T02:46:56.857 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:56.857 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.857 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.858 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:56.858 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.858 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.858 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6826", 2024-09-12T02:46:56.858 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:56.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.858 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.858 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6827", 2024-09-12T02:46:56.858 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:56.858 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.858 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.859 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:56.859 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.859 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.859 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6830", 2024-09-12T02:46:56.859 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:56.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.859 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.859 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6831", 2024-09-12T02:46:56.859 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:56.859 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.859 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.860 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:56.860 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.860 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.860 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6828", 2024-09-12T02:46:56.860 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:56.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.860 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.860 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6829", 2024-09-12T02:46:56.860 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:56.860 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.861 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.861 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6825/231774278", 2024-09-12T02:46:56.861 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6827/231774278", 2024-09-12T02:46:56.861 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6831/231774278", 2024-09-12T02:46:56.861 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6829/231774278", 2024-09-12T02:46:56.861 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:56.861 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:56.861 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:56.861 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.861 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:46:56.862 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:56.862 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:56.862 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:56.862 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:56.862 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:56.862 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:56.862 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:56.862 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:56.862 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:46:56.862 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:56.862 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:56.862 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:56.862 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.863 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.863 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6800", 2024-09-12T02:46:56.863 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:56.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.863 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.863 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6801", 2024-09-12T02:46:56.863 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:56.863 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.863 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.863 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:56.863 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.864 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.864 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6802", 2024-09-12T02:46:56.864 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:56.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.864 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.864 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6803", 2024-09-12T02:46:56.864 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:56.864 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.864 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.864 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:56.864 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.865 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.865 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6806", 2024-09-12T02:46:56.865 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:56.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.865 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.865 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6807", 2024-09-12T02:46:56.865 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:56.865 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.865 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.865 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:56.866 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.866 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.866 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6804", 2024-09-12T02:46:56.866 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:56.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.866 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.866 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6805", 2024-09-12T02:46:56.866 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:56.866 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.866 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.866 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6801/3671178153", 2024-09-12T02:46:56.867 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6803/3671178153", 2024-09-12T02:46:56.867 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6807/3671178153", 2024-09-12T02:46:56.867 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6805/3671178153", 2024-09-12T02:46:56.867 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:56.867 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:56.867 INFO:teuthology.orchestra.run.smithi112.stdout: "full", 2024-09-12T02:46:56.867 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:56.867 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.867 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:46:56.867 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:56.867 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:56.868 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:56.868 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:56.868 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:56.868 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:56.868 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:56.868 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:56.868 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:46:56.868 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:56.868 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:56.868 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:56.868 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.868 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.868 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6808", 2024-09-12T02:46:56.869 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:56.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.869 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.869 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6809", 2024-09-12T02:46:56.869 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:56.869 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.869 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.869 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:56.869 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.869 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.869 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6810", 2024-09-12T02:46:56.870 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:56.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.870 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.870 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6811", 2024-09-12T02:46:56.870 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:56.870 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.870 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.870 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:56.870 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.870 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.871 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6817", 2024-09-12T02:46:56.871 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:56.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.871 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.871 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6819", 2024-09-12T02:46:56.871 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:56.871 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.871 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.871 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:56.871 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.871 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.872 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6812", 2024-09-12T02:46:56.872 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:56.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.872 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.872 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6815", 2024-09-12T02:46:56.872 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:56.872 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.872 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.872 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6809/3193706134", 2024-09-12T02:46:56.872 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6811/3193706134", 2024-09-12T02:46:56.872 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6819/3193706134", 2024-09-12T02:46:56.873 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6815/3193706134", 2024-09-12T02:46:56.873 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:56.873 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:56.873 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:56.873 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.873 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:46:56.873 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:56.873 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:56.873 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:56.873 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:56.873 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:56.873 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:56.874 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:56.874 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:56.874 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:46:56.874 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:56.874 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:56.874 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:56.874 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.874 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.874 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6813", 2024-09-12T02:46:56.874 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:56.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.875 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.875 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6814", 2024-09-12T02:46:56.875 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:56.875 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.875 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.875 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:56.875 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.876 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.876 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6816", 2024-09-12T02:46:56.876 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:56.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.876 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.876 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6818", 2024-09-12T02:46:56.876 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:56.876 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.876 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.876 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:56.876 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.877 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.877 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6822", 2024-09-12T02:46:56.877 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:56.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.877 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.877 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6823", 2024-09-12T02:46:56.877 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:56.877 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.877 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.877 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:56.877 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.878 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.878 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6820", 2024-09-12T02:46:56.878 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:56.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.878 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.878 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6821", 2024-09-12T02:46:56.878 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:56.878 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.878 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.878 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6814/3738813293", 2024-09-12T02:46:56.878 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6818/3738813293", 2024-09-12T02:46:56.879 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6823/3738813293", 2024-09-12T02:46:56.879 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6821/3738813293", 2024-09-12T02:46:56.879 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:56.879 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:56.879 INFO:teuthology.orchestra.run.smithi112.stdout: "full", 2024-09-12T02:46:56.879 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:56.879 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.879 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:46:56.879 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:56.879 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:56.879 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:56.880 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:56.880 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:56.880 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:56.880 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:56.880 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:56.880 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:46:56.880 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:56.880 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:56.880 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:56.880 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.880 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.880 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6824", 2024-09-12T02:46:56.880 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:56.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.881 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.881 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6825", 2024-09-12T02:46:56.881 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:56.881 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.881 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.881 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:56.881 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.881 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.881 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6826", 2024-09-12T02:46:56.882 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:56.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.882 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.882 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6827", 2024-09-12T02:46:56.882 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:56.882 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.882 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.882 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:56.882 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.882 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.882 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6830", 2024-09-12T02:46:56.883 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:56.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.883 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.883 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6831", 2024-09-12T02:46:56.883 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:56.883 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.883 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.883 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:56.883 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:56.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.883 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:56.883 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6828", 2024-09-12T02:46:56.884 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:56.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.884 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:56.884 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6829", 2024-09-12T02:46:56.884 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:56.884 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.884 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.884 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6825/1421932609", 2024-09-12T02:46:56.884 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6827/1421932609", 2024-09-12T02:46:56.884 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6831/1421932609", 2024-09-12T02:46:56.884 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6829/1421932609", 2024-09-12T02:46:56.885 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:56.885 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull", 2024-09-12T02:46:56.885 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:56.885 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:56.885 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.885 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.885 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:46:56.885 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_xinfo": [ 2024-09-12T02:46:56.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.885 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:46:56.885 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:56.885 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:56.885 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:56.886 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:56.886 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:56.886 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.220641+0000", 2024-09-12T02:46:56.886 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:56.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.886 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:46:56.886 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:56.886 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:56.886 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:56.886 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:56.886 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:56.886 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312574+0000", 2024-09-12T02:46:56.886 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:56.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.887 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:46:56.887 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:56.887 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:56.887 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:56.887 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:56.887 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:56.887 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.282771+0000", 2024-09-12T02:46:56.887 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:56.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.887 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:46:56.887 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:56.888 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:56.888 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:56.888 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:56.888 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:56.888 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.260478+0000", 2024-09-12T02:46:56.888 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:56.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.888 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:46:56.888 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:56.888 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:56.888 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:56.888 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:56.889 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:56.889 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.273397+0000", 2024-09-12T02:46:56.889 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:56.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.889 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:46:56.889 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:56.889 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:56.889 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:56.889 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:56.889 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:56.889 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312452+0000", 2024-09-12T02:46:56.889 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:56.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.890 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:46:56.890 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:56.890 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:56.890 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:56.890 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:56.890 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:56.890 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.308965+0000", 2024-09-12T02:46:56.890 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:56.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.890 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:46:56.890 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:56.891 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:56.891 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:56.891 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:56.891 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:56.891 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.337842+0000", 2024-09-12T02:46:56.891 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:56.891 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.891 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:46:56.891 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap": [], 2024-09-12T02:46:56.891 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_items": [ 2024-09-12T02:46:56.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.891 INFO:teuthology.orchestra.run.smithi112.stdout: "pgid": "13.2a", 2024-09-12T02:46:56.891 INFO:teuthology.orchestra.run.smithi112.stdout: "mappings": [ 2024-09-12T02:46:56.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:56.892 INFO:teuthology.orchestra.run.smithi112.stdout: "from": 1, 2024-09-12T02:46:56.892 INFO:teuthology.orchestra.run.smithi112.stdout: "to": 3 2024-09-12T02:46:56.892 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.892 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:56.892 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.892 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:46:56.892 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_primaries": [], 2024-09-12T02:46:56.892 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_temp": [], 2024-09-12T02:46:56.892 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_temp": [], 2024-09-12T02:46:56.892 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklist": {}, 2024-09-12T02:46:56.892 INFO:teuthology.orchestra.run.smithi112.stdout: "range_blocklist": {}, 2024-09-12T02:46:56.892 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profiles": { 2024-09-12T02:46:56.892 INFO:teuthology.orchestra.run.smithi112.stdout: "default": { 2024-09-12T02:46:56.892 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-failure-domain": "osd", 2024-09-12T02:46:56.893 INFO:teuthology.orchestra.run.smithi112.stdout: "k": "2", 2024-09-12T02:46:56.893 INFO:teuthology.orchestra.run.smithi112.stdout: "m": "1", 2024-09-12T02:46:56.893 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin": "jerasure", 2024-09-12T02:46:56.893 INFO:teuthology.orchestra.run.smithi112.stdout: "technique": "reed_sol_van" 2024-09-12T02:46:56.893 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:56.893 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps_queue": [], 2024-09-12T02:46:56.893 INFO:teuthology.orchestra.run.smithi112.stdout: "new_removed_snaps": [], 2024-09-12T02:46:56.893 INFO:teuthology.orchestra.run.smithi112.stdout: "new_purged_snaps": [], 2024-09-12T02:46:56.893 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_node_flags": {}, 2024-09-12T02:46:56.893 INFO:teuthology.orchestra.run.smithi112.stdout: "device_class_flags": {}, 2024-09-12T02:46:56.893 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode": { 2024-09-12T02:46:56.893 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_enabled": false, 2024-09-12T02:46:56.893 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_bucket_count": 0, 2024-09-12T02:46:56.894 INFO:teuthology.orchestra.run.smithi112.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:46:56.894 INFO:teuthology.orchestra.run.smithi112.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:46:56.894 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_bucket": 0 2024-09-12T02:46:56.894 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:56.894 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:46:56.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.817+0000 7f8f7f200640 1 -- 172.21.15.112:0/189191189 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8f5c06be30 msgr2=0x7f8f5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:56.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.817+0000 7f8f7f200640 1 --2- 172.21.15.112:0/189191189 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8f5c06be30 0x7f8f5c06e2f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c001700 tx=0x7f8f6c009040 comp rx=0 tx=0).stop 2024-09-12T02:46:56.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.817+0000 7f8f7f200640 1 -- 172.21.15.112:0/189191189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f780d57e0 msgr2=0x7f8f780ba500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:56.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.817+0000 7f8f7f200640 1 --2- 172.21.15.112:0/189191189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f780d57e0 0x7f8f780ba500 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8f6802a340 tx=0x7f8f680046c0 comp rx=0 tx=0).stop 2024-09-12T02:46:56.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.817+0000 7f8f7f200640 1 -- 172.21.15.112:0/189191189 shutdown_connections 2024-09-12T02:46:56.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.817+0000 7f8f7f200640 1 --2- 172.21.15.112:0/189191189 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8f781623c0 0x7f8f780b9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:56.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.817+0000 7f8f7f200640 1 --2- 172.21.15.112:0/189191189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f780d57e0 0x7f8f780ba500 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:56.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.817+0000 7f8f7f200640 1 --2- 172.21.15.112:0/189191189 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8f5c06be30 0x7f8f5c06e2f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:56.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.817+0000 7f8f7f200640 1 --2- 172.21.15.112:0/189191189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f780d0370 0x7f8f78158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:56.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.817+0000 7f8f7f200640 1 -- 172.21.15.112:0/189191189 >> 172.21.15.112:0/189191189 conn(0x7f8f780d4cc0 msgr2=0x7f8f780cf7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:56.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.817+0000 7f8f7f200640 1 -- 172.21.15.112:0/189191189 shutdown_connections 2024-09-12T02:46:56.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:56.817+0000 7f8f7f200640 1 -- 172.21.15.112:0/189191189 wait complete. 2024-09-12T02:46:56.897 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-12T02:46:56.897 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:46:56.897 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:46:56.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:56.933 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2024-09-12T02:46:57.287 INFO:teuthology.orchestra.run.smithi112.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2024-09-12T02:46:57.287 INFO:teuthology.orchestra.run.smithi112.stderr:50+0 records in 2024-09-12T02:46:57.288 INFO:teuthology.orchestra.run.smithi112.stderr:50+0 records out 2024-09-12T02:46:57.288 INFO:teuthology.orchestra.run.smithi112.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.264712 s, 198 MB/s 2024-09-12T02:46:57.288 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:46:57.289 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-12T02:46:57.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.440+0000 7f43e8200640 1 Processor -- start 2024-09-12T02:46:57.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.440+0000 7f43e8200640 1 -- start start 2024-09-12T02:46:57.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.441+0000 7f43e8200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43e006f600 0x7f43e00b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.441+0000 7f43e8200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43e00b4a20 con 0x7f43e015b9d0 2024-09-12T02:46:57.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.441+0000 7f43e8200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43e00b54a0 con 0x7f43e00b45d0 2024-09-12T02:46:57.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.441+0000 7f43e8200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f43e00b3af0 con 0x7f43e006f600 2024-09-12T02:46:57.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.441+0000 7f43e5800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f43e015b9d0 0x7f43e006eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48274/0 (socket says 172.21.15.112:48274) 2024-09-12T02:46:57.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.441+0000 7f43e5800640 1 -- 172.21.15.112:0/3711371671 learned_addr learned my addr 172.21.15.112:0/3711371671 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:46:57.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.442+0000 7f43e4e00640 1 --2- 172.21.15.112:0/3711371671 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43e006f600 0x7f43e00b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:57.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.442+0000 7f43dfe00640 1 -- 172.21.15.112:0/3711371671 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 313567296 0 0) 0x7f43e00b4a20 con 0x7f43e015b9d0 2024-09-12T02:46:57.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.442+0000 7f43dfe00640 1 -- 172.21.15.112:0/3711371671 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43c8005730 con 0x7f43e015b9d0 2024-09-12T02:46:57.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.442+0000 7f43dfe00640 1 -- 172.21.15.112:0/3711371671 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3289949379 0 0) 0x7f43c8005730 con 0x7f43e015b9d0 2024-09-12T02:46:57.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.442+0000 7f43dfe00640 1 -- 172.21.15.112:0/3711371671 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43e006f600 msgr2=0x7f43e00b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:57.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.442+0000 7f43dfe00640 1 --2- 172.21.15.112:0/3711371671 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43e006f600 0x7f43e00b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.442+0000 7f43dfe00640 1 -- 172.21.15.112:0/3711371671 >> v1:172.21.15.137:6789/0 conn(0x7f43e00b45d0 legacy=0x7f43e00cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:57.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.442+0000 7f43dfe00640 1 -- 172.21.15.112:0/3711371671 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e00b3dd0 con 0x7f43e015b9d0 2024-09-12T02:46:57.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.442+0000 7f43dfe00640 1 -- 172.21.15.112:0/3711371671 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f43d4001670 con 0x7f43e015b9d0 2024-09-12T02:46:57.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.442+0000 7f43dfe00640 1 -- 172.21.15.112:0/3711371671 >> v1:172.21.15.112:6789/0 conn(0x7f43e015b9d0 legacy=0x7f43e006eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:57.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.442+0000 7f43dfe00640 1 --2- 172.21.15.112:0/3711371671 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43c8005bf0 0x7f43c8006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.442+0000 7f43dfe00640 1 --2- 172.21.15.112:0/3711371671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43c8006a10 0x7f43c8006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.442+0000 7f43dfe00640 1 --2- 172.21.15.112:0/3711371671 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43e006f600 0x7f43c80073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.442+0000 7f43dfe00640 1 -- 172.21.15.112:0/3711371671 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f43e00b3af0 con 0x7f43c8006a10 2024-09-12T02:46:57.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.442+0000 7f43dfe00640 1 -- 172.21.15.112:0/3711371671 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f43c800dce0 con 0x7f43c8005bf0 2024-09-12T02:46:57.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.442+0000 7f43dfe00640 1 -- 172.21.15.112:0/3711371671 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f43c800dee0 con 0x7f43e006f600 2024-09-12T02:46:57.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.443+0000 7f43e4e00640 1 --2- 172.21.15.112:0/3711371671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43c8006a10 0x7f43c8006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:57.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.443+0000 7f43e5800640 1 --2- 172.21.15.112:0/3711371671 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43c8005bf0 0x7f43c8006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:57.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.443+0000 7f43e6200640 1 --2- 172.21.15.112:0/3711371671 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43e006f600 0x7f43c80073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:57.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.443+0000 7f43e4e00640 1 -- 172.21.15.112:0/3711371671 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43e006f600 msgr2=0x7f43c80073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:57.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.443+0000 7f43e4e00640 1 --2- 172.21.15.112:0/3711371671 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43e006f600 0x7f43c80073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.443+0000 7f43e4e00640 1 -- 172.21.15.112:0/3711371671 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43c8005bf0 msgr2=0x7f43c8006010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:57.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.443+0000 7f43e4e00640 1 --2- 172.21.15.112:0/3711371671 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43c8005bf0 0x7f43c8006010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.443+0000 7f43e4e00640 1 -- 172.21.15.112:0/3711371671 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c8005730 con 0x7f43c8006a10 2024-09-12T02:46:57.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.444+0000 7f43e4e00640 1 --2- 172.21.15.112:0/3711371671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43c8006a10 0x7f43c8006e90 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f43cc009a80 tx=0x7f43c8007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c878ede5d4cefcc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:57.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.444+0000 7f43dfe00640 1 -- 172.21.15.112:0/3711371671 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43cc036070 con 0x7f43c8006a10 2024-09-12T02:46:57.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.444+0000 7f43dfe00640 1 -- 172.21.15.112:0/3711371671 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43cc005990 con 0x7f43c8006a10 2024-09-12T02:46:57.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.444+0000 7f43dfe00640 1 -- 172.21.15.112:0/3711371671 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43cc009680 con 0x7f43c8006a10 2024-09-12T02:46:57.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.445+0000 7f43e8200640 1 -- 172.21.15.112:0/3711371671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43c8006a10 msgr2=0x7f43c8006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:57.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.445+0000 7f43e8200640 1 --2- 172.21.15.112:0/3711371671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43c8006a10 0x7f43c8006e90 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f43cc009a80 tx=0x7f43c8007a40 comp rx=0 tx=0).stop 2024-09-12T02:46:57.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.445+0000 7f43e6200640 1 -- 172.21.15.112:0/3711371671 reap_dead start 2024-09-12T02:46:57.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.445+0000 7f43e8200640 1 -- 172.21.15.112:0/3711371671 shutdown_connections 2024-09-12T02:46:57.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.445+0000 7f43e8200640 1 -- 172.21.15.112:0/3711371671 >> 172.21.15.112:0/3711371671 conn(0x7f43e006bbd0 msgr2=0x7f43e006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:57.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.445+0000 7f43e8200640 1 -- 172.21.15.112:0/3711371671 shutdown_connections 2024-09-12T02:46:57.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.445+0000 7f43e8200640 1 -- 172.21.15.112:0/3711371671 wait complete. 2024-09-12T02:46:57.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.446+0000 7f43e8200640 1 Processor -- start 2024-09-12T02:46:57.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.446+0000 7f43e8200640 1 -- start start 2024-09-12T02:46:57.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.447+0000 7f43e8200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43c8006a10 0x7f43e014c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.447+0000 7f43e8200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43e014d2f0 0x7f43e014ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.447+0000 7f43e8200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43e0150470 0x7f43e00ce400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.447+0000 7f43e8200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f43e015bf30 con 0x7f43e0150470 2024-09-12T02:46:57.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.447+0000 7f43e8200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f43e015bdb0 con 0x7f43e014d2f0 2024-09-12T02:46:57.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.447+0000 7f43e8200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f43e00b4ec0 con 0x7f43c8006a10 2024-09-12T02:46:57.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.448+0000 7f43e6200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43e0150470 0x7f43e00ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:57.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.448+0000 7f43e5800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43c8006a10 0x7f43e014c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:57.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.448+0000 7f43e6200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43e0150470 0x7f43e00ce400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37384/0 (socket says 172.21.15.112:37384) 2024-09-12T02:46:57.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.448+0000 7f43e6200640 1 -- 172.21.15.112:0/395587954 learned_addr learned my addr 172.21.15.112:0/395587954 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:57.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.448+0000 7f43e4e00640 1 --2- 172.21.15.112:0/395587954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43e014d2f0 0x7f43e014ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:57.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.448+0000 7f43e6200640 1 -- 172.21.15.112:0/395587954 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43c8006a10 msgr2=0x7f43e014c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:57.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.448+0000 7f43e6200640 1 --2- 172.21.15.112:0/395587954 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43c8006a10 0x7f43e014c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.448+0000 7f43e6200640 1 -- 172.21.15.112:0/395587954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43e014d2f0 msgr2=0x7f43e014ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:57.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.448+0000 7f43e6200640 1 --2- 172.21.15.112:0/395587954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43e014d2f0 0x7f43e014ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.448+0000 7f43e6200640 1 -- 172.21.15.112:0/395587954 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e0150a20 con 0x7f43e0150470 2024-09-12T02:46:57.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.448+0000 7f43e6200640 1 --2- 172.21.15.112:0/395587954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43e0150470 0x7f43e00ce400 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f43e015f560 tx=0x7f43d800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:57.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.449+0000 7f43dd600640 1 -- 172.21.15.112:0/395587954 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d8003970 con 0x7f43e0150470 2024-09-12T02:46:57.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.449+0000 7f43dd600640 1 -- 172.21.15.112:0/395587954 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43d8018070 con 0x7f43e0150470 2024-09-12T02:46:57.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.449+0000 7f43e8200640 1 -- 172.21.15.112:0/395587954 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43e0150d00 con 0x7f43e0150470 2024-09-12T02:46:57.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.449+0000 7f43dd600640 1 -- 172.21.15.112:0/395587954 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d8003d50 con 0x7f43e0150470 2024-09-12T02:46:57.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.449+0000 7f43e8200640 1 -- 172.21.15.112:0/395587954 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43e01512c0 con 0x7f43e0150470 2024-09-12T02:46:57.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.450+0000 7f43e8200640 1 -- 172.21.15.112:0/395587954 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43e00b1b30 con 0x7f43e0150470 2024-09-12T02:46:57.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.451+0000 7f43dd600640 1 -- 172.21.15.112:0/395587954 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f43d80050d0 con 0x7f43e0150470 2024-09-12T02:46:57.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.452+0000 7f43dd600640 1 --2- 172.21.15.112:0/395587954 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f43c006be30 0x7f43c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.452+0000 7f43dd600640 1 -- 172.21.15.112:0/395587954 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5738+0+0 (secure 0 0 0) 0x7f43d808aaf0 con 0x7f43e0150470 2024-09-12T02:46:57.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.452+0000 7f43e5800640 1 --2- 172.21.15.112:0/395587954 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f43c006be30 0x7f43c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:57.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.452+0000 7f43dd600640 1 -- 172.21.15.112:0/395587954 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=105}) -- 0x7f43c0073a20 con 0x7f43e0150470 2024-09-12T02:46:57.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.452+0000 7f43e5800640 1 --2- 172.21.15.112:0/395587954 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f43c006be30 0x7f43c006e2f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f43d4007d40 tx=0x7f43d4001430 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:57.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.456+0000 7f43dd600640 1 -- 172.21.15.112:0/395587954 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f43e00b1b30 con 0x7f43e0150470 2024-09-12T02:46:57.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.630+0000 7f43e8200640 1 -- 172.21.15.112:0/395587954 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f43e006dbc0 con 0x7f43e0150470 2024-09-12T02:46:57.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.631+0000 7f43dd600640 1 -- 172.21.15.112:0/395587954 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v104) ==== 81+0+34638 (secure 0 0 0) 0x7f43d8058d90 con 0x7f43e0150470 2024-09-12T02:46:57.633 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:46:57.633 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:46:57.633 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 104, 2024-09-12T02:46:57.633 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:46:57.633 INFO:teuthology.orchestra.run.smithi112.stdout: "created": "2024-09-12T02:41:36.162095+0000", 2024-09-12T02:46:57.633 INFO:teuthology.orchestra.run.smithi112.stdout: "modified": "2024-09-12T02:46:56.105207+0000", 2024-09-12T02:46:57.633 INFO:teuthology.orchestra.run.smithi112.stdout: "last_up_change": "2024-09-12T02:41:42.191169+0000", 2024-09-12T02:46:57.634 INFO:teuthology.orchestra.run.smithi112.stdout: "last_in_change": "2024-09-12T02:41:39.036600+0000", 2024-09-12T02:46:57.634 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:46:57.634 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_num": 5799936, 2024-09-12T02:46:57.634 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_set": [ 2024-09-12T02:46:57.634 INFO:teuthology.orchestra.run.smithi112.stdout: "pglog_hardlimit", 2024-09-12T02:46:57.634 INFO:teuthology.orchestra.run.smithi112.stdout: "purged_snapdirs", 2024-09-12T02:46:57.634 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_deletes", 2024-09-12T02:46:57.634 INFO:teuthology.orchestra.run.smithi112.stdout: "sortbitwise" 2024-09-12T02:46:57.634 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:46:57.634 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_version": 4, 2024-09-12T02:46:57.634 INFO:teuthology.orchestra.run.smithi112.stdout: "full_ratio": 0.69999998807907104, 2024-09-12T02:46:57.634 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-12T02:46:57.635 INFO:teuthology.orchestra.run.smithi112.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-12T02:46:57.635 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_snapshot": "", 2024-09-12T02:46:57.635 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_max": 13, 2024-09-12T02:46:57.635 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd": 8, 2024-09-12T02:46:57.635 INFO:teuthology.orchestra.run.smithi112.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:46:57.635 INFO:teuthology.orchestra.run.smithi112.stdout: "min_compat_client": "luminous", 2024-09-12T02:46:57.635 INFO:teuthology.orchestra.run.smithi112.stdout: "require_osd_release": "squid", 2024-09-12T02:46:57.635 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_crimson": false, 2024-09-12T02:46:57.635 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-12T02:46:57.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.635 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 1, 2024-09-12T02:46:57.636 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": ".mgr", 2024-09-12T02:46:57.636 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:41:43.011599+0000", 2024-09-12T02:46:57.636 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 3, 2024-09-12T02:46:57.636 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full", 2024-09-12T02:46:57.636 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:46:57.636 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:46:57.636 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:46:57.636 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:46:57.636 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:46:57.636 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:46:57.636 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:46:57.636 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:46:57.637 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:46:57.637 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:46:57.637 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:46:57.637 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 1, 2024-09-12T02:46:57.637 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 1, 2024-09-12T02:46:57.637 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 1, 2024-09-12T02:46:57.637 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 1, 2024-09-12T02:46:57.637 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 1, 2024-09-12T02:46:57.637 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:46:57.637 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:46:57.637 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:46:57.637 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:46:57.637 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:46:57.638 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:46:57.638 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:46:57.638 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.638 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "102", 2024-09-12T02:46:57.638 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:46:57.638 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:46:57.638 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:46:57.638 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:46:57.638 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:46:57.638 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:46:57.638 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:46:57.638 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:46:57.638 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:46:57.639 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:46:57.639 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:46:57.639 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:46:57.639 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:46:57.639 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:46:57.639 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:46:57.639 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:46:57.639 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:46:57.639 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:46:57.639 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:46:57.639 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:46:57.639 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:46:57.639 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:46:57.640 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:46:57.640 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:46:57.640 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:46:57.640 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:46:57.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.640 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:46:57.640 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:46:57.640 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:46:57.640 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:46:57.640 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:46:57.640 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:46:57.640 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:46:57.640 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:46:57.641 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:46:57.641 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:46:57.641 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:46:57.641 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:46:57.641 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_max": 32, 2024-09-12T02:46:57.641 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 1 2024-09-12T02:46:57.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.641 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:46:57.641 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": {} 2024-09-12T02:46:57.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.641 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:46:57.641 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:46:57.642 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 8, 2024-09-12T02:46:57.642 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 8, 2024-09-12T02:46:57.642 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 0.25, 2024-09-12T02:46:57.642 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:46:57.642 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:46:57.642 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:46:57.642 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:46:57.642 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:46:57.642 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.642 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 12, 2024-09-12T02:46:57.642 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:46:57.642 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:46:34.392830+0000", 2024-09-12T02:46:57.642 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 3, 2024-09-12T02:46:57.643 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full", 2024-09-12T02:46:57.643 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:46:57.643 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:46:57.643 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:46:57.643 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:46:57.643 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:46:57.643 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:46:57.643 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:46:57.643 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:46:57.643 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:46:57.643 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:46:57.643 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:46:57.643 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 32, 2024-09-12T02:46:57.644 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 32, 2024-09-12T02:46:57.644 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 32, 2024-09-12T02:46:57.644 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 32, 2024-09-12T02:46:57.644 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 32, 2024-09-12T02:46:57.644 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:46:57.644 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:46:57.644 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:46:57.644 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:46:57.644 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:46:57.644 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:46:57.644 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:46:57.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.644 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "102", 2024-09-12T02:46:57.644 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:46:57.645 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:46:57.645 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:46:57.645 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:46:57.645 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:46:57.645 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:46:57.645 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:46:57.645 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:46:57.645 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:46:57.645 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:46:57.645 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:46:57.645 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:46:57.645 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:46:57.645 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:46:57.646 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:46:57.646 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:46:57.646 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:46:57.646 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:46:57.646 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:46:57.646 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:46:57.646 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:46:57.646 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:46:57.646 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:46:57.646 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:46:57.646 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:46:57.646 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:46:57.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.646 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:46:57.647 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:46:57.647 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:46:57.647 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:46:57.647 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:46:57.647 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:46:57.647 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:46:57.647 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:46:57.647 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:46:57.647 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:46:57.647 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:46:57.647 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:46:57.647 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:46:57.647 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 16, 2024-09-12T02:46:57.647 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_priority": 5 2024-09-12T02:46:57.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.648 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:46:57.648 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:46:57.648 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": "cephfs" 2024-09-12T02:46:57.648 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.648 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:46:57.648 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:46:57.648 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 2, 2024-09-12T02:46:57.648 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 2, 2024-09-12T02:46:57.648 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:46:57.648 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:46:57.648 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:46:57.648 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:46:57.649 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:46:57.649 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:46:57.649 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.649 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 13, 2024-09-12T02:46:57.649 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_data", 2024-09-12T02:46:57.649 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:46:35.615193+0000", 2024-09-12T02:46:57.649 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 3, 2024-09-12T02:46:57.649 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full", 2024-09-12T02:46:57.649 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:46:57.649 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:46:57.649 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:46:57.650 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:46:57.650 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:46:57.650 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:46:57.650 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:46:57.650 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:46:57.650 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:46:57.650 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:46:57.650 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:46:57.650 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 64, 2024-09-12T02:46:57.650 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 64, 2024-09-12T02:46:57.650 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 64, 2024-09-12T02:46:57.650 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 64, 2024-09-12T02:46:57.650 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 64, 2024-09-12T02:46:57.651 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:46:57.651 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:46:57.651 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:46:57.651 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:46:57.651 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:46:57.651 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:46:57.651 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:46:57.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.651 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "102", 2024-09-12T02:46:57.651 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:46:57.651 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:46:57.651 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:46:57.651 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:46:57.652 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:46:57.652 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:46:57.652 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:46:57.652 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:46:57.652 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:46:57.652 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:46:57.652 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:46:57.652 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:46:57.652 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:46:57.652 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:46:57.652 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:46:57.652 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:46:57.653 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:46:57.653 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:46:57.653 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:46:57.653 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:46:57.653 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:46:57.653 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:46:57.653 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:46:57.653 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:46:57.653 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:46:57.653 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:46:57.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.654 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:46:57.654 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:46:57.654 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:46:57.654 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:46:57.654 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:46:57.654 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:46:57.654 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:46:57.654 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:46:57.654 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:46:57.654 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:46:57.654 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:46:57.654 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:46:57.655 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 64, 2024-09-12T02:46:57.655 INFO:teuthology.orchestra.run.smithi112.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:46:57.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.655 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:46:57.655 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:46:57.655 INFO:teuthology.orchestra.run.smithi112.stdout: "data": "cephfs" 2024-09-12T02:46:57.655 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.655 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:46:57.655 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:46:57.655 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.3799999952316284, 2024-09-12T02:46:57.655 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.3799999952316284, 2024-09-12T02:46:57.655 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:46:57.656 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-12T02:46:57.656 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-12T02:46:57.656 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:46:57.656 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:46:57.656 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:46:57.656 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.656 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.656 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:46:57.656 INFO:teuthology.orchestra.run.smithi112.stdout: "osds": [ 2024-09-12T02:46:57.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.656 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:46:57.656 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:57.656 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:57.657 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:57.657 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:57.657 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:57.657 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:57.657 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:57.657 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:57.657 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:46:57.657 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:57.657 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:57.657 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:57.657 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.658 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.658 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6800", 2024-09-12T02:46:57.658 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:57.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.658 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.658 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6801", 2024-09-12T02:46:57.658 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:57.658 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.658 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.658 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:57.658 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.659 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.659 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6802", 2024-09-12T02:46:57.659 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:57.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.659 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.659 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6803", 2024-09-12T02:46:57.659 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:57.659 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.659 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.659 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:57.660 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.660 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.660 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6806", 2024-09-12T02:46:57.660 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:57.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.660 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.660 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6807", 2024-09-12T02:46:57.660 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:57.660 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.660 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.661 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:57.661 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.661 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.661 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6804", 2024-09-12T02:46:57.661 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:57.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.661 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.661 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6805", 2024-09-12T02:46:57.661 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:57.661 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.661 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.662 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6801/821571304", 2024-09-12T02:46:57.662 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6803/821571304", 2024-09-12T02:46:57.662 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6807/821571304", 2024-09-12T02:46:57.662 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6805/821571304", 2024-09-12T02:46:57.662 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:57.662 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:57.662 INFO:teuthology.orchestra.run.smithi112.stdout: "full", 2024-09-12T02:46:57.662 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:57.662 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.662 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:46:57.662 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:57.662 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:46:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.663 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6808", 2024-09-12T02:46:57.664 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:57.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.664 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.664 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6809", 2024-09-12T02:46:57.664 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:57.664 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.664 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.664 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:57.664 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.664 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.664 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6810", 2024-09-12T02:46:57.665 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:57.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.665 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.665 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6811", 2024-09-12T02:46:57.665 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:57.665 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.665 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.665 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:57.665 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.665 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.666 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6814", 2024-09-12T02:46:57.666 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:57.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.666 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.666 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6815", 2024-09-12T02:46:57.666 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:57.666 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.666 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.666 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:57.666 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.666 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.667 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6812", 2024-09-12T02:46:57.667 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:57.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.667 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.667 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6813", 2024-09-12T02:46:57.667 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:57.667 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.667 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.667 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6809/2642068641", 2024-09-12T02:46:57.667 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6811/2642068641", 2024-09-12T02:46:57.667 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6815/2642068641", 2024-09-12T02:46:57.667 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6813/2642068641", 2024-09-12T02:46:57.668 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:57.668 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:57.668 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:57.668 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.668 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:46:57.668 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:57.668 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:57.668 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:57.668 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:57.668 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:57.668 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:57.668 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:57.669 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:57.669 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:46:57.669 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:57.669 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:57.669 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:57.669 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.669 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.669 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6816", 2024-09-12T02:46:57.669 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:57.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.669 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.669 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6817", 2024-09-12T02:46:57.670 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:57.670 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.670 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.670 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:57.670 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.670 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.670 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6818", 2024-09-12T02:46:57.670 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:57.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.670 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.671 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6819", 2024-09-12T02:46:57.671 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:57.671 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.671 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.671 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:57.671 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.671 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.671 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6822", 2024-09-12T02:46:57.671 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:57.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.672 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.672 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6823", 2024-09-12T02:46:57.672 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:57.672 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.672 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.672 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:57.672 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.672 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.672 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6820", 2024-09-12T02:46:57.672 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:57.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.673 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.673 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6821", 2024-09-12T02:46:57.673 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:57.673 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.673 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.673 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6817/3365688807", 2024-09-12T02:46:57.673 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6819/3365688807", 2024-09-12T02:46:57.673 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6823/3365688807", 2024-09-12T02:46:57.673 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6821/3365688807", 2024-09-12T02:46:57.673 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:57.673 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:57.674 INFO:teuthology.orchestra.run.smithi112.stdout: "full", 2024-09-12T02:46:57.674 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:57.674 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.674 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:46:57.674 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:57.674 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:57.674 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:57.674 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:57.674 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:57.674 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:57.674 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:57.674 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:57.675 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 98, 2024-09-12T02:46:57.675 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:57.675 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:57.675 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:57.675 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.675 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.675 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6824", 2024-09-12T02:46:57.675 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:57.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.675 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.675 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6825", 2024-09-12T02:46:57.675 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:57.676 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.676 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.676 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:57.676 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.676 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.676 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6826", 2024-09-12T02:46:57.676 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:57.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.676 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.676 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6827", 2024-09-12T02:46:57.677 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:57.677 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.677 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.677 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:57.677 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.677 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.677 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6830", 2024-09-12T02:46:57.677 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:57.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.677 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.678 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6831", 2024-09-12T02:46:57.678 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:57.678 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.678 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.678 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:57.678 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.678 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.678 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6828", 2024-09-12T02:46:57.678 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:57.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.678 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.679 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6829", 2024-09-12T02:46:57.679 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:57.679 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.679 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.679 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6825/231774278", 2024-09-12T02:46:57.679 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6827/231774278", 2024-09-12T02:46:57.679 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6831/231774278", 2024-09-12T02:46:57.679 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6829/231774278", 2024-09-12T02:46:57.679 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:57.679 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:57.679 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:57.679 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.680 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:46:57.680 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:57.680 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:57.680 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:57.680 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:57.680 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:57.680 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:57.680 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:57.680 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:57.680 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:46:57.680 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:57.680 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:57.681 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:57.681 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.681 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.681 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6800", 2024-09-12T02:46:57.681 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:57.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.681 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.681 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6801", 2024-09-12T02:46:57.681 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:57.681 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.681 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.682 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:57.682 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.682 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.682 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6802", 2024-09-12T02:46:57.682 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:57.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.682 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.682 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6803", 2024-09-12T02:46:57.682 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:57.682 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.682 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.683 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:57.683 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.683 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.683 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6806", 2024-09-12T02:46:57.683 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:57.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.683 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.683 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6807", 2024-09-12T02:46:57.683 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:57.683 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.684 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.684 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:57.684 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.684 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.684 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6804", 2024-09-12T02:46:57.684 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:57.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.684 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.684 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6805", 2024-09-12T02:46:57.684 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:57.684 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.685 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.685 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6801/3671178153", 2024-09-12T02:46:57.685 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6803/3671178153", 2024-09-12T02:46:57.685 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6807/3671178153", 2024-09-12T02:46:57.685 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6805/3671178153", 2024-09-12T02:46:57.685 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:57.685 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:57.685 INFO:teuthology.orchestra.run.smithi112.stdout: "full", 2024-09-12T02:46:57.685 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:57.685 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.686 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:46:57.686 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:57.686 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:57.686 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:57.686 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:57.686 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:57.686 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:57.686 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:57.686 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:57.686 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:46:57.686 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:57.686 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:57.686 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:57.686 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.687 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.687 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6808", 2024-09-12T02:46:57.687 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:57.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.687 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.687 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6809", 2024-09-12T02:46:57.687 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:57.687 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.687 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.687 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:57.688 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.688 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.688 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6810", 2024-09-12T02:46:57.688 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:57.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.688 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.688 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6811", 2024-09-12T02:46:57.688 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:57.688 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.688 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.689 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:57.689 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.689 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.689 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6817", 2024-09-12T02:46:57.689 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:57.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.689 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.689 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6819", 2024-09-12T02:46:57.689 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:57.689 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.689 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.690 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:57.690 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.690 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.690 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6812", 2024-09-12T02:46:57.690 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:57.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.690 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.690 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6815", 2024-09-12T02:46:57.690 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:57.690 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.690 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.691 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6809/3193706134", 2024-09-12T02:46:57.691 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6811/3193706134", 2024-09-12T02:46:57.691 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6819/3193706134", 2024-09-12T02:46:57.691 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6815/3193706134", 2024-09-12T02:46:57.691 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:57.691 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:57.691 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:57.691 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.691 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:46:57.691 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:57.691 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:57.692 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:57.692 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:57.692 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:57.692 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:57.692 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:57.692 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:57.692 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:46:57.692 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:57.692 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:57.692 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:57.692 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.692 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.693 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6813", 2024-09-12T02:46:57.693 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:57.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.693 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.693 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6814", 2024-09-12T02:46:57.693 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:57.693 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.693 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.693 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:57.693 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.693 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.694 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6816", 2024-09-12T02:46:57.694 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:57.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.694 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.694 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6818", 2024-09-12T02:46:57.694 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:57.694 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.694 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.694 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:57.694 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.695 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.695 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6822", 2024-09-12T02:46:57.695 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:57.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.695 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.695 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6823", 2024-09-12T02:46:57.695 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:57.695 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.695 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.695 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:57.695 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.696 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.696 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6820", 2024-09-12T02:46:57.696 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:57.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.696 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.696 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6821", 2024-09-12T02:46:57.696 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:57.696 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.696 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.696 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6814/3738813293", 2024-09-12T02:46:57.696 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6818/3738813293", 2024-09-12T02:46:57.697 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6823/3738813293", 2024-09-12T02:46:57.697 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6821/3738813293", 2024-09-12T02:46:57.697 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:57.697 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:57.697 INFO:teuthology.orchestra.run.smithi112.stdout: "full", 2024-09-12T02:46:57.697 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:57.697 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.697 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:46:57.697 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:57.697 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:57.697 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:57.698 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:57.698 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:57.698 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:57.698 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:57.698 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:57.698 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:46:57.698 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:57.698 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:57.698 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:57.698 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.698 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.698 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6824", 2024-09-12T02:46:57.698 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:57.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.699 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.699 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6825", 2024-09-12T02:46:57.699 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:57.699 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.699 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.699 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:57.699 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.699 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.699 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6826", 2024-09-12T02:46:57.699 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:57.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.700 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.700 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6827", 2024-09-12T02:46:57.700 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:57.700 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.700 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.700 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:57.700 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.700 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.700 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6830", 2024-09-12T02:46:57.700 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:57.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.701 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.701 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6831", 2024-09-12T02:46:57.701 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:57.701 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.701 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.701 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:57.701 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:57.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.701 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:57.701 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6828", 2024-09-12T02:46:57.702 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:57.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.702 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:57.702 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6829", 2024-09-12T02:46:57.702 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:57.702 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.702 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.702 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6825/1421932609", 2024-09-12T02:46:57.702 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6827/1421932609", 2024-09-12T02:46:57.702 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6831/1421932609", 2024-09-12T02:46:57.702 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6829/1421932609", 2024-09-12T02:46:57.702 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:57.703 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull", 2024-09-12T02:46:57.703 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:57.703 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:57.703 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.703 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.703 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:46:57.703 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_xinfo": [ 2024-09-12T02:46:57.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.703 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:46:57.703 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:57.703 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:57.703 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:57.703 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:57.703 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:57.704 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.220641+0000", 2024-09-12T02:46:57.704 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:57.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.704 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:46:57.704 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:57.704 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:57.704 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:57.704 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:57.704 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:57.704 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312574+0000", 2024-09-12T02:46:57.704 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:57.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.705 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:46:57.705 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:57.705 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:57.705 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:57.705 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:57.705 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:57.705 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.282771+0000", 2024-09-12T02:46:57.705 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:57.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.705 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:46:57.705 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:57.705 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:57.706 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:57.706 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:57.706 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:57.706 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.260478+0000", 2024-09-12T02:46:57.706 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:57.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.706 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:46:57.706 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:57.706 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:57.706 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:57.706 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:57.706 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:57.706 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.273397+0000", 2024-09-12T02:46:57.706 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:57.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.707 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:46:57.707 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:57.707 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:57.707 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:57.707 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:57.707 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:57.707 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312452+0000", 2024-09-12T02:46:57.707 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:57.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.707 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:46:57.708 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:57.708 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:57.708 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:57.708 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:57.708 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:57.708 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.308965+0000", 2024-09-12T02:46:57.708 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:57.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.708 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:46:57.708 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:57.708 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:57.708 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:57.708 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:57.709 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:57.709 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.337842+0000", 2024-09-12T02:46:57.709 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:57.709 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.709 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:46:57.709 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap": [], 2024-09-12T02:46:57.709 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_items": [ 2024-09-12T02:46:57.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.709 INFO:teuthology.orchestra.run.smithi112.stdout: "pgid": "13.2a", 2024-09-12T02:46:57.709 INFO:teuthology.orchestra.run.smithi112.stdout: "mappings": [ 2024-09-12T02:46:57.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:57.709 INFO:teuthology.orchestra.run.smithi112.stdout: "from": 1, 2024-09-12T02:46:57.709 INFO:teuthology.orchestra.run.smithi112.stdout: "to": 3 2024-09-12T02:46:57.709 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.710 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:57.710 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.710 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:46:57.710 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_primaries": [], 2024-09-12T02:46:57.710 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_temp": [], 2024-09-12T02:46:57.710 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_temp": [], 2024-09-12T02:46:57.710 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklist": {}, 2024-09-12T02:46:57.710 INFO:teuthology.orchestra.run.smithi112.stdout: "range_blocklist": {}, 2024-09-12T02:46:57.710 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profiles": { 2024-09-12T02:46:57.710 INFO:teuthology.orchestra.run.smithi112.stdout: "default": { 2024-09-12T02:46:57.710 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-failure-domain": "osd", 2024-09-12T02:46:57.710 INFO:teuthology.orchestra.run.smithi112.stdout: "k": "2", 2024-09-12T02:46:57.710 INFO:teuthology.orchestra.run.smithi112.stdout: "m": "1", 2024-09-12T02:46:57.710 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin": "jerasure", 2024-09-12T02:46:57.711 INFO:teuthology.orchestra.run.smithi112.stdout: "technique": "reed_sol_van" 2024-09-12T02:46:57.711 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:57.711 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps_queue": [], 2024-09-12T02:46:57.711 INFO:teuthology.orchestra.run.smithi112.stdout: "new_removed_snaps": [], 2024-09-12T02:46:57.711 INFO:teuthology.orchestra.run.smithi112.stdout: "new_purged_snaps": [], 2024-09-12T02:46:57.711 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_node_flags": {}, 2024-09-12T02:46:57.711 INFO:teuthology.orchestra.run.smithi112.stdout: "device_class_flags": {}, 2024-09-12T02:46:57.711 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode": { 2024-09-12T02:46:57.711 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_enabled": false, 2024-09-12T02:46:57.711 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_bucket_count": 0, 2024-09-12T02:46:57.711 INFO:teuthology.orchestra.run.smithi112.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:46:57.711 INFO:teuthology.orchestra.run.smithi112.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:46:57.711 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_bucket": 0 2024-09-12T02:46:57.712 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:57.712 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:46:57.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.634+0000 7f43e8200640 1 -- 172.21.15.112:0/395587954 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f43c006be30 msgr2=0x7f43c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:57.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.634+0000 7f43e8200640 1 --2- 172.21.15.112:0/395587954 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f43c006be30 0x7f43c006e2f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f43d4007d40 tx=0x7f43d4001430 comp rx=0 tx=0).stop 2024-09-12T02:46:57.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.634+0000 7f43e8200640 1 -- 172.21.15.112:0/395587954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43e0150470 msgr2=0x7f43e00ce400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:57.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.634+0000 7f43e8200640 1 --2- 172.21.15.112:0/395587954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43e0150470 0x7f43e00ce400 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f43e015f560 tx=0x7f43d800ec10 comp rx=0 tx=0).stop 2024-09-12T02:46:57.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.634+0000 7f43e8200640 1 -- 172.21.15.112:0/395587954 shutdown_connections 2024-09-12T02:46:57.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.634+0000 7f43e8200640 1 --2- 172.21.15.112:0/395587954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43e0150470 0x7f43e00ce400 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.634+0000 7f43e8200640 1 --2- 172.21.15.112:0/395587954 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f43c006be30 0x7f43c006e2f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.634+0000 7f43e8200640 1 --2- 172.21.15.112:0/395587954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43e014d2f0 0x7f43e014ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.634+0000 7f43e8200640 1 --2- 172.21.15.112:0/395587954 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43c8006a10 0x7f43e014c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.634+0000 7f43e8200640 1 -- 172.21.15.112:0/395587954 >> 172.21.15.112:0/395587954 conn(0x7f43e006bbd0 msgr2=0x7f43e00b1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:57.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.634+0000 7f43e8200640 1 -- 172.21.15.112:0/395587954 shutdown_connections 2024-09-12T02:46:57.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.634+0000 7f43e8200640 1 -- 172.21.15.112:0/395587954 wait complete. 2024-09-12T02:46:57.715 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:46:57.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.866+0000 7f738aa00640 1 Processor -- start 2024-09-12T02:46:57.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.866+0000 7f738aa00640 1 -- start start 2024-09-12T02:46:57.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.867+0000 7f738aa00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f73840ae8d0 0x7f73840afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.867+0000 7f738aa00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f738406dca0 0x7f738406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.867+0000 7f738aa00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73840aedd0 con 0x7f738406d8c0 2024-09-12T02:46:57.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.867+0000 7f738aa00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f73840af0b0 con 0x7f73840ae8d0 2024-09-12T02:46:57.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.867+0000 7f738aa00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f73840af390 con 0x7f738406dca0 2024-09-12T02:46:57.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.867+0000 7f7383e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f738406d8c0 0x7f73840715a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48290/0 (socket says 172.21.15.112:48290) 2024-09-12T02:46:57.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.867+0000 7f7383e00640 1 -- 172.21.15.112:0/2577510654 learned_addr learned my addr 172.21.15.112:0/2577510654 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:46:57.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.868+0000 7f7383400640 1 --2- 172.21.15.112:0/2577510654 >> v2:172.21.15.112:3300/0 conn(0x7f73840ae8d0 0x7f73840afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:57.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.868+0000 7f7388a00640 1 --2- 172.21.15.112:0/2577510654 >> v2:172.21.15.137:3300/0 conn(0x7f738406dca0 0x7f738406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:57.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.868+0000 7f7382a00640 1 -- 172.21.15.112:0/2577510654 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1811926560 0 0) 0x7f73840aedd0 con 0x7f738406d8c0 2024-09-12T02:46:57.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.868+0000 7f7382a00640 1 -- 172.21.15.112:0/2577510654 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7368003520 con 0x7f738406d8c0 2024-09-12T02:46:57.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.868+0000 7f7383400640 1 -- 172.21.15.112:0/2577510654 >> v2:172.21.15.137:3300/0 conn(0x7f738406dca0 msgr2=0x7f738406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:57.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.868+0000 7f7383400640 1 --2- 172.21.15.112:0/2577510654 >> v2:172.21.15.137:3300/0 conn(0x7f738406dca0 0x7f738406e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.868+0000 7f7383400640 1 -- 172.21.15.112:0/2577510654 >> v1:172.21.15.112:6789/0 conn(0x7f738406d8c0 legacy=0x7f73840715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:57.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.868+0000 7f7383400640 1 -- 172.21.15.112:0/2577510654 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73840af670 con 0x7f73840ae8d0 2024-09-12T02:46:57.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.869+0000 7f7383400640 1 --2- 172.21.15.112:0/2577510654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73840ae8d0 0x7f73840afe70 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f73840d06c0 tx=0x7f737002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32d20e262e22df4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:57.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.869+0000 7f7382a00640 1 -- 172.21.15.112:0/2577510654 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7370037070 con 0x7f73840ae8d0 2024-09-12T02:46:57.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.869+0000 7f7382a00640 1 -- 172.21.15.112:0/2577510654 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7370032440 con 0x7f73840ae8d0 2024-09-12T02:46:57.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.869+0000 7f7382a00640 1 -- 172.21.15.112:0/2577510654 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7370032810 con 0x7f73840ae8d0 2024-09-12T02:46:57.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.870+0000 7f738aa00640 1 -- 172.21.15.112:0/2577510654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73840ae8d0 msgr2=0x7f73840afe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:57.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.870+0000 7f738aa00640 1 --2- 172.21.15.112:0/2577510654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73840ae8d0 0x7f73840afe70 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f73840d06c0 tx=0x7f737002a1a0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.870+0000 7f738aa00640 1 -- 172.21.15.112:0/2577510654 shutdown_connections 2024-09-12T02:46:57.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.870+0000 7f738aa00640 1 --2- 172.21.15.112:0/2577510654 >> v2:172.21.15.137:3300/0 conn(0x7f738406dca0 0x7f738406e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.870+0000 7f738aa00640 1 --2- 172.21.15.112:0/2577510654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73840ae8d0 0x7f73840afe70 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.870+0000 7f738aa00640 1 -- 172.21.15.112:0/2577510654 >> 172.21.15.112:0/2577510654 conn(0x7f738406bbd0 msgr2=0x7f738406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:57.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.870+0000 7f738aa00640 1 -- 172.21.15.112:0/2577510654 shutdown_connections 2024-09-12T02:46:57.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.870+0000 7f738aa00640 1 -- 172.21.15.112:0/2577510654 wait complete. 2024-09-12T02:46:57.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.872+0000 7f738aa00640 1 Processor -- start 2024-09-12T02:46:57.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.872+0000 7f738aa00640 1 -- start start 2024-09-12T02:46:57.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.872+0000 7f738aa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f738406d8c0 0x7f73840ced90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.873+0000 7f738aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f738406dca0 0x7f7384156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.873+0000 7f738aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73840ae8d0 0x7f7384157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.873+0000 7f738aa00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f73840b38e0 con 0x7f73840ae8d0 2024-09-12T02:46:57.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.873+0000 7f738aa00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f738406e690 con 0x7f738406dca0 2024-09-12T02:46:57.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.873+0000 7f738aa00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f73840b3a60 con 0x7f738406d8c0 2024-09-12T02:46:57.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.873+0000 7f7388a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73840ae8d0 0x7f7384157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:57.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.873+0000 7f7388a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73840ae8d0 0x7f7384157210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37402/0 (socket says 172.21.15.112:37402) 2024-09-12T02:46:57.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.873+0000 7f7388a00640 1 -- 172.21.15.112:0/3528678296 learned_addr learned my addr 172.21.15.112:0/3528678296 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:57.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.873+0000 7f7383400640 1 --2- 172.21.15.112:0/3528678296 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f738406dca0 0x7f7384156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:57.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.873+0000 7f7383e00640 1 --2- 172.21.15.112:0/3528678296 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f738406d8c0 0x7f73840ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:57.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.873+0000 7f7388a00640 1 -- 172.21.15.112:0/3528678296 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f738406d8c0 msgr2=0x7f73840ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:57.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.873+0000 7f7388a00640 1 --2- 172.21.15.112:0/3528678296 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f738406d8c0 0x7f73840ced90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.873+0000 7f7388a00640 1 -- 172.21.15.112:0/3528678296 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f738406dca0 msgr2=0x7f7384156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:57.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.873+0000 7f7388a00640 1 --2- 172.21.15.112:0/3528678296 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f738406dca0 0x7f7384156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:57.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.873+0000 7f7388a00640 1 -- 172.21.15.112:0/3528678296 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73841f5440 con 0x7f73840ae8d0 2024-09-12T02:46:57.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.874+0000 7f7388a00640 1 --2- 172.21.15.112:0/3528678296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73840ae8d0 0x7f7384157210 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f737c00efc0 tx=0x7f737c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:57.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.874+0000 7f737be00640 1 -- 172.21.15.112:0/3528678296 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c018020 con 0x7f73840ae8d0 2024-09-12T02:46:57.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.874+0000 7f737be00640 1 -- 172.21.15.112:0/3528678296 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f737c014480 con 0x7f73840ae8d0 2024-09-12T02:46:57.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.874+0000 7f737be00640 1 -- 172.21.15.112:0/3528678296 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c014870 con 0x7f73840ae8d0 2024-09-12T02:46:57.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.874+0000 7f738aa00640 1 -- 172.21.15.112:0/3528678296 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f738415f530 con 0x7f73840ae8d0 2024-09-12T02:46:57.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.874+0000 7f738aa00640 1 -- 172.21.15.112:0/3528678296 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f738415faf0 con 0x7f73840ae8d0 2024-09-12T02:46:57.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.875+0000 7f738aa00640 1 -- 172.21.15.112:0/3528678296 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7384068a30 con 0x7f73840ae8d0 2024-09-12T02:46:57.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.876+0000 7f737be00640 1 -- 172.21.15.112:0/3528678296 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f737c005d10 con 0x7f73840ae8d0 2024-09-12T02:46:57.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.877+0000 7f737be00640 1 --2- 172.21.15.112:0/3528678296 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f736406be30 0x7f736406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:57.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.877+0000 7f737be00640 1 -- 172.21.15.112:0/3528678296 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5738+0+0 (secure 0 0 0) 0x7f737c08b940 con 0x7f73840ae8d0 2024-09-12T02:46:57.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.877+0000 7f737be00640 1 -- 172.21.15.112:0/3528678296 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=105}) -- 0x7f73640739c0 con 0x7f73840ae8d0 2024-09-12T02:46:57.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.877+0000 7f7383e00640 1 --2- 172.21.15.112:0/3528678296 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f736406be30 0x7f736406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:57.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.878+0000 7f7383e00640 1 --2- 172.21.15.112:0/3528678296 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f736406be30 0x7f736406e2f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7374005880 tx=0x7f7374009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:57.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:57.881+0000 7f737be00640 1 -- 172.21.15.112:0/3528678296 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f737c022070 con 0x7f73840ae8d0 2024-09-12T02:46:58.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.090+0000 7f738aa00640 1 -- 172.21.15.112:0/3528678296 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f738406e150 con 0x7f73840ae8d0 2024-09-12T02:46:58.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.091+0000 7f737be00640 1 -- 172.21.15.112:0/3528678296 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5234 (secure 0 0 0) 0x7f737c010040 con 0x7f73840ae8d0 2024-09-12T02:46:58.092 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:46:58.092 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":53,"btime":"2024-09-12T02:46:40:250353+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1897464411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1897464411},{"type":"v1","addr":"172.21.15.137:6834","nonce":1897464411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":5785,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3500913266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3500913266},{"type":"v1","addr":"172.21.15.137:6835","nonce":3500913266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":6144,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/611029461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":611029461},{"type":"v1","addr":"172.21.15.112:6836","nonce":611029461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:46:36.623382+0000","modified":"2024-09-12T02:46:39.653409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6150":{"gid":6150,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/1018665478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1018665478},{"type":"v1","addr":"172.21.15.112:6837","nonce":1018665478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6150,"qdb_cluster":[6150]},"id":6}]} 2024-09-12T02:46:58.092 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 53 2024-09-12T02:46:58.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.093+0000 7f738aa00640 1 -- 172.21.15.112:0/3528678296 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f736406be30 msgr2=0x7f736406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:58.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.093+0000 7f738aa00640 1 --2- 172.21.15.112:0/3528678296 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f736406be30 0x7f736406e2f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7374005880 tx=0x7f7374009040 comp rx=0 tx=0).stop 2024-09-12T02:46:58.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.093+0000 7f738aa00640 1 -- 172.21.15.112:0/3528678296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73840ae8d0 msgr2=0x7f7384157210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:58.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.093+0000 7f738aa00640 1 --2- 172.21.15.112:0/3528678296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73840ae8d0 0x7f7384157210 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f737c00efc0 tx=0x7f737c00c490 comp rx=0 tx=0).stop 2024-09-12T02:46:58.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.093+0000 7f738aa00640 1 -- 172.21.15.112:0/3528678296 shutdown_connections 2024-09-12T02:46:58.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.093+0000 7f738aa00640 1 --2- 172.21.15.112:0/3528678296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73840ae8d0 0x7f7384157210 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.093+0000 7f738aa00640 1 --2- 172.21.15.112:0/3528678296 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f736406be30 0x7f736406e2f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.093+0000 7f738aa00640 1 --2- 172.21.15.112:0/3528678296 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f738406dca0 0x7f7384156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.093+0000 7f738aa00640 1 --2- 172.21.15.112:0/3528678296 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f738406d8c0 0x7f73840ced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.093+0000 7f738aa00640 1 -- 172.21.15.112:0/3528678296 >> 172.21.15.112:0/3528678296 conn(0x7f738406bbd0 msgr2=0x7f738415e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:58.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.093+0000 7f738aa00640 1 -- 172.21.15.112:0/3528678296 shutdown_connections 2024-09-12T02:46:58.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.093+0000 7f738aa00640 1 -- 172.21.15.112:0/3528678296 wait complete. 2024-09-12T02:46:58.109 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-12T02:46:58.284 INFO:teuthology.orchestra.run.smithi112.stdout:{"cluster_fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","whoami":0,"id":6150,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":21.039480664999999,"mdsmap_epoch":53,"osdmap_epoch":105,"osdmap_epoch_barrier":104,"uptime":25.594141638} 2024-09-12T02:46:58.284 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", "fs_name": "cephfs", "id": 6150, "mdsmap_epoch": 53, "osdmap_epoch": 105, "osdmap_epoch_barrier": 104, "rank_uptime": 21.039480665, "state": "up:active", "uptime": 25.594141638, "want_state": "up:active", "whoami": 0 } 2024-09-12T02:46:58.284 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:46:58.285 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:46:58.285 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:46:58.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:58.320 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2024-09-12T02:46:58.394 INFO:teuthology.orchestra.run.smithi112.stderr:dd: failed to open 'small_file_1': Permission denied 2024-09-12T02:46:58.394 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:46:58.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:58.395 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2024-09-12T02:46:58.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:58.473 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2024-09-12T02:46:58.614 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-12T02:46:58.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.765+0000 7f09b7400640 1 Processor -- start 2024-09-12T02:46:58.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.765+0000 7f09b7400640 1 -- start start 2024-09-12T02:46:58.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.767+0000 7f09b7400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f09b015b9d0 0x7f09b00b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.767+0000 7f09b7400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09b006f600 0x7f09b00728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.767+0000 7f09b7400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09b00b54a0 con 0x7f09b00b45d0 2024-09-12T02:46:58.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.767+0000 7f09b7400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f09b00b4a60 con 0x7f09b015b9d0 2024-09-12T02:46:58.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.767+0000 7f09b7400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f09b00b3af0 con 0x7f09b006f600 2024-09-12T02:46:58.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.767+0000 7f09a7e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f09b00b45d0 0x7f09b006eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48296/0 (socket says 172.21.15.112:48296) 2024-09-12T02:46:58.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.767+0000 7f09a7e00640 1 -- 172.21.15.112:0/3898681074 learned_addr learned my addr 172.21.15.112:0/3898681074 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:46:58.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.767+0000 7f09b4a00640 1 --2- 172.21.15.112:0/3898681074 >> v2:172.21.15.137:3300/0 conn(0x7f09b015b9d0 0x7f09b00b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:58.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.767+0000 7f09b5400640 1 --2- 172.21.15.112:0/3898681074 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09b006f600 0x7f09b00728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:58.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.767+0000 7f09afe00640 1 -- 172.21.15.112:0/3898681074 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 897586854 0 0) 0x7f09b00b54a0 con 0x7f09b00b45d0 2024-09-12T02:46:58.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.767+0000 7f09afe00640 1 -- 172.21.15.112:0/3898681074 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0994003520 con 0x7f09b00b45d0 2024-09-12T02:46:58.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.768+0000 7f09afe00640 1 -- 172.21.15.112:0/3898681074 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4087629623 0 0) 0x7f0994003520 con 0x7f09b00b45d0 2024-09-12T02:46:58.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.768+0000 7f09afe00640 1 -- 172.21.15.112:0/3898681074 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09b006f600 msgr2=0x7f09b00728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:58.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.768+0000 7f09afe00640 1 --2- 172.21.15.112:0/3898681074 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09b006f600 0x7f09b00728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.768+0000 7f09afe00640 1 -- 172.21.15.112:0/3898681074 >> v2:172.21.15.137:3300/0 conn(0x7f09b015b9d0 msgr2=0x7f09b00b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:58.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.768+0000 7f09afe00640 1 --2- 172.21.15.112:0/3898681074 >> v2:172.21.15.137:3300/0 conn(0x7f09b015b9d0 0x7f09b00b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.768+0000 7f09afe00640 1 -- 172.21.15.112:0/3898681074 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b00b3dd0 con 0x7f09b00b45d0 2024-09-12T02:46:58.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.768+0000 7f09afe00640 1 -- 172.21.15.112:0/3898681074 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f09980017f0 con 0x7f09b00b45d0 2024-09-12T02:46:58.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.768+0000 7f09afe00640 1 -- 172.21.15.112:0/3898681074 >> v1:172.21.15.112:6789/0 conn(0x7f09b00b45d0 legacy=0x7f09b006eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:58.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.768+0000 7f09afe00640 1 --2- 172.21.15.112:0/3898681074 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09b006f600 0x7f09940039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.768+0000 7f09afe00640 1 --2- 172.21.15.112:0/3898681074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0994003f30 0x7f0994004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.768+0000 7f09afe00640 1 --2- 172.21.15.112:0/3898681074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0994004d40 0x7f09940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.768+0000 7f09afe00640 1 -- 172.21.15.112:0/3898681074 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f09b00b3af0 con 0x7f0994004d40 2024-09-12T02:46:58.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.768+0000 7f09afe00640 1 -- 172.21.15.112:0/3898681074 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f099400b9c0 con 0x7f0994003f30 2024-09-12T02:46:58.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.768+0000 7f09afe00640 1 -- 172.21.15.112:0/3898681074 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f099400bb40 con 0x7f09b006f600 2024-09-12T02:46:58.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.768+0000 7f09b5400640 1 --2- 172.21.15.112:0/3898681074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0994004d40 0x7f09940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:58.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.768+0000 7f09b4a00640 1 --2- 172.21.15.112:0/3898681074 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09b006f600 0x7f09940039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:58.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.768+0000 7f09a7e00640 1 --2- 172.21.15.112:0/3898681074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0994003f30 0x7f0994004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:58.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.769+0000 7f09b5400640 1 -- 172.21.15.112:0/3898681074 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09b006f600 msgr2=0x7f09940039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:58.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.769+0000 7f09b5400640 1 --2- 172.21.15.112:0/3898681074 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09b006f600 0x7f09940039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.769+0000 7f09b5400640 1 -- 172.21.15.112:0/3898681074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0994003f30 msgr2=0x7f0994004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:58.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.769+0000 7f09b5400640 1 --2- 172.21.15.112:0/3898681074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0994003f30 0x7f0994004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.769+0000 7f09b5400640 1 -- 172.21.15.112:0/3898681074 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b00b3dd0 con 0x7f0994004d40 2024-09-12T02:46:58.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.770+0000 7f09b5400640 1 --2- 172.21.15.112:0/3898681074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0994004d40 0x7f09940051c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009f90 tx=0x7f0994005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41baa08c801b9822 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:58.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.770+0000 7f09afe00640 1 -- 172.21.15.112:0/3898681074 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a8009c10 con 0x7f0994004d40 2024-09-12T02:46:58.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.770+0000 7f09afe00640 1 -- 172.21.15.112:0/3898681074 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09a8036070 con 0x7f0994004d40 2024-09-12T02:46:58.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.770+0000 7f09afe00640 1 -- 172.21.15.112:0/3898681074 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a8031810 con 0x7f0994004d40 2024-09-12T02:46:58.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.770+0000 7f09b7400640 1 -- 172.21.15.112:0/3898681074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0994004d40 msgr2=0x7f09940051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:58.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.770+0000 7f09b7400640 1 --2- 172.21.15.112:0/3898681074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0994004d40 0x7f09940051c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009f90 tx=0x7f0994005830 comp rx=0 tx=0).stop 2024-09-12T02:46:58.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.770+0000 7f09b5400640 1 -- 172.21.15.112:0/3898681074 reap_dead start 2024-09-12T02:46:58.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.770+0000 7f09b7400640 1 -- 172.21.15.112:0/3898681074 shutdown_connections 2024-09-12T02:46:58.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.770+0000 7f09b7400640 1 -- 172.21.15.112:0/3898681074 >> 172.21.15.112:0/3898681074 conn(0x7f09b006bbd0 msgr2=0x7f09b006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:58.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.771+0000 7f09b7400640 1 -- 172.21.15.112:0/3898681074 shutdown_connections 2024-09-12T02:46:58.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.771+0000 7f09b7400640 1 -- 172.21.15.112:0/3898681074 wait complete. 2024-09-12T02:46:58.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.772+0000 7f09b7400640 1 Processor -- start 2024-09-12T02:46:58.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.772+0000 7f09b7400640 1 -- start start 2024-09-12T02:46:58.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.773+0000 7f09b7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0994004d40 0x7f09b015cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.773+0000 7f09b7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09b015fa10 0x7f09b01f0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.773+0000 7f09b7400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09b01472a0 0x7f09b015d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.773+0000 7f09b7400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f09b015bf30 con 0x7f09b015fa10 2024-09-12T02:46:58.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.773+0000 7f09b7400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f09b015bdb0 con 0x7f0994004d40 2024-09-12T02:46:58.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.773+0000 7f09b7400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f09b00728c0 con 0x7f09b01472a0 2024-09-12T02:46:58.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.773+0000 7f09a7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09b015fa10 0x7f09b01f0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:58.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.773+0000 7f09a7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09b015fa10 0x7f09b01f0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37416/0 (socket says 172.21.15.112:37416) 2024-09-12T02:46:58.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.773+0000 7f09a7e00640 1 -- 172.21.15.112:0/22775370 learned_addr learned my addr 172.21.15.112:0/22775370 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:46:58.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.773+0000 7f09b4a00640 1 --2- 172.21.15.112:0/22775370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0994004d40 0x7f09b015cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:58.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.774+0000 7f09b5400640 1 --2- 172.21.15.112:0/22775370 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09b01472a0 0x7f09b015d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:58.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.774+0000 7f09a7e00640 1 -- 172.21.15.112:0/22775370 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09b01472a0 msgr2=0x7f09b015d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:58.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.774+0000 7f09a7e00640 1 --2- 172.21.15.112:0/22775370 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09b01472a0 0x7f09b015d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.774+0000 7f09a7e00640 1 -- 172.21.15.112:0/22775370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0994004d40 msgr2=0x7f09b015cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:58.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.774+0000 7f09a7e00640 1 --2- 172.21.15.112:0/22775370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0994004d40 0x7f09b015cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.774+0000 7f09a7e00640 1 -- 172.21.15.112:0/22775370 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b0152ed0 con 0x7f09b015fa10 2024-09-12T02:46:58.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.774+0000 7f09b4a00640 1 --2- 172.21.15.112:0/22775370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0994004d40 0x7f09b015cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:58.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.774+0000 7f09a7e00640 1 --2- 172.21.15.112:0/22775370 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09b015fa10 0x7f09b01f0e10 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f0998006ab0 tx=0x7f0998006f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:58.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.774+0000 7f09ad600640 1 -- 172.21.15.112:0/22775370 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099801b470 con 0x7f09b015fa10 2024-09-12T02:46:58.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.774+0000 7f09ad600640 1 -- 172.21.15.112:0/22775370 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0998016070 con 0x7f09b015fa10 2024-09-12T02:46:58.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.774+0000 7f09b7400640 1 -- 172.21.15.112:0/22775370 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09b01531b0 con 0x7f09b015fa10 2024-09-12T02:46:58.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.774+0000 7f09ad600640 1 -- 172.21.15.112:0/22775370 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099801b870 con 0x7f09b015fa10 2024-09-12T02:46:58.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.774+0000 7f09b7400640 1 -- 172.21.15.112:0/22775370 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09b0153770 con 0x7f09b015fa10 2024-09-12T02:46:58.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.775+0000 7f09b7400640 1 -- 172.21.15.112:0/22775370 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09b0068a30 con 0x7f09b015fa10 2024-09-12T02:46:58.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.776+0000 7f09ad600640 1 -- 172.21.15.112:0/22775370 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0998012450 con 0x7f09b015fa10 2024-09-12T02:46:58.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.777+0000 7f09ad600640 1 --2- 172.21.15.112:0/22775370 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f098c06be60 0x7f098c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.777+0000 7f09ad600640 1 -- 172.21.15.112:0/22775370 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5738+0+0 (secure 0 0 0) 0x7f099808e230 con 0x7f09b015fa10 2024-09-12T02:46:58.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.778+0000 7f09ad600640 1 -- 172.21.15.112:0/22775370 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=106}) -- 0x7f098c0739f0 con 0x7f09b015fa10 2024-09-12T02:46:58.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.778+0000 7f09b4a00640 1 --2- 172.21.15.112:0/22775370 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f098c06be60 0x7f098c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:58.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.778+0000 7f09b4a00640 1 --2- 172.21.15.112:0/22775370 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f098c06be60 0x7f098c06e320 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009c40 tx=0x7f09a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:58.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.781+0000 7f09ad600640 1 -- 172.21.15.112:0/22775370 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f099805cb20 con 0x7f09b015fa10 2024-09-12T02:46:58.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.955+0000 7f09b7400640 1 -- 172.21.15.112:0/22775370 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f09b0072c50 con 0x7f09b015fa10 2024-09-12T02:46:58.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.957+0000 7f09ad600640 1 -- 172.21.15.112:0/22775370 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v105) ==== 81+0+34662 (secure 0 0 0) 0x7f099805c420 con 0x7f09b015fa10 2024-09-12T02:46:58.959 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:46:58.959 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:46:58.959 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 105, 2024-09-12T02:46:58.959 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:46:58.959 INFO:teuthology.orchestra.run.smithi112.stdout: "created": "2024-09-12T02:41:36.162095+0000", 2024-09-12T02:46:58.960 INFO:teuthology.orchestra.run.smithi112.stdout: "modified": "2024-09-12T02:46:58.119420+0000", 2024-09-12T02:46:58.960 INFO:teuthology.orchestra.run.smithi112.stdout: "last_up_change": "2024-09-12T02:41:42.191169+0000", 2024-09-12T02:46:58.960 INFO:teuthology.orchestra.run.smithi112.stdout: "last_in_change": "2024-09-12T02:41:39.036600+0000", 2024-09-12T02:46:58.960 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:46:58.960 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_num": 5799936, 2024-09-12T02:46:58.961 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_set": [ 2024-09-12T02:46:58.961 INFO:teuthology.orchestra.run.smithi112.stdout: "pglog_hardlimit", 2024-09-12T02:46:58.961 INFO:teuthology.orchestra.run.smithi112.stdout: "purged_snapdirs", 2024-09-12T02:46:58.961 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_deletes", 2024-09-12T02:46:58.961 INFO:teuthology.orchestra.run.smithi112.stdout: "sortbitwise" 2024-09-12T02:46:58.961 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:46:58.961 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_version": 4, 2024-09-12T02:46:58.961 INFO:teuthology.orchestra.run.smithi112.stdout: "full_ratio": 0.69999998807907104, 2024-09-12T02:46:58.961 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-12T02:46:58.961 INFO:teuthology.orchestra.run.smithi112.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-12T02:46:58.962 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_snapshot": "", 2024-09-12T02:46:58.962 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_max": 13, 2024-09-12T02:46:58.962 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd": 8, 2024-09-12T02:46:58.962 INFO:teuthology.orchestra.run.smithi112.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:46:58.962 INFO:teuthology.orchestra.run.smithi112.stdout: "min_compat_client": "luminous", 2024-09-12T02:46:58.962 INFO:teuthology.orchestra.run.smithi112.stdout: "require_osd_release": "squid", 2024-09-12T02:46:58.962 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_crimson": false, 2024-09-12T02:46:58.962 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-12T02:46:58.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:58.962 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 1, 2024-09-12T02:46:58.962 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": ".mgr", 2024-09-12T02:46:58.963 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:41:43.011599+0000", 2024-09-12T02:46:58.963 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 3, 2024-09-12T02:46:58.963 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full", 2024-09-12T02:46:58.963 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:46:58.963 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:46:58.963 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:46:58.963 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:46:58.963 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:46:58.963 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:46:58.963 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:46:58.964 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:46:58.964 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:46:58.964 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:46:58.964 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:46:58.964 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 1, 2024-09-12T02:46:58.964 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 1, 2024-09-12T02:46:58.964 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 1, 2024-09-12T02:46:58.964 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 1, 2024-09-12T02:46:58.964 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 1, 2024-09-12T02:46:58.964 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:46:58.964 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:46:58.965 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:46:58.965 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:46:58.965 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:46:58.965 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:46:58.965 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:46:58.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:58.965 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "102", 2024-09-12T02:46:58.965 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:46:58.965 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:46:58.965 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:46:58.965 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:46:58.965 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:46:58.965 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:46:58.966 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:46:58.966 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:46:58.966 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:46:58.966 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:46:58.966 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:46:58.966 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:46:58.966 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:46:58.966 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:46:58.966 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:46:58.966 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:46:58.966 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:46:58.966 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:46:58.966 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:46:58.966 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:46:58.967 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:46:58.967 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:46:58.967 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:46:58.967 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:46:58.967 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:46:58.967 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:46:58.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:58.967 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:46:58.967 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:46:58.967 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:46:58.967 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:46:58.967 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:46:58.967 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:46:58.967 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:46:58.968 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:46:58.968 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:46:58.968 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:46:58.968 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:46:58.968 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:46:58.968 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_max": 32, 2024-09-12T02:46:58.968 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 1 2024-09-12T02:46:58.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:58.968 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:46:58.968 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": {} 2024-09-12T02:46:58.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:58.969 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:46:58.969 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:46:58.969 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 8, 2024-09-12T02:46:58.969 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 8, 2024-09-12T02:46:58.969 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 0.25, 2024-09-12T02:46:58.969 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:46:58.969 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:46:58.969 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:46:58.969 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:46:58.969 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:46:58.969 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:58.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:58.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:58.970 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 12, 2024-09-12T02:46:58.970 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:46:58.970 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:46:34.392830+0000", 2024-09-12T02:46:58.970 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 3, 2024-09-12T02:46:58.970 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full", 2024-09-12T02:46:58.970 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:46:58.970 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:46:58.970 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:46:58.970 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:46:58.970 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:46:58.970 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:46:58.970 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:46:58.970 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:46:58.970 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:46:58.971 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:46:58.971 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:46:58.971 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 32, 2024-09-12T02:46:58.971 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 32, 2024-09-12T02:46:58.971 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 32, 2024-09-12T02:46:58.971 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 32, 2024-09-12T02:46:58.971 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 32, 2024-09-12T02:46:58.971 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:46:58.971 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:46:58.971 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:46:58.971 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:46:58.971 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:46:58.971 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:46:58.971 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:46:58.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:58.972 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "102", 2024-09-12T02:46:58.972 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:46:58.972 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:46:58.972 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:46:58.972 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:46:58.972 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:46:58.972 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:46:58.972 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:46:58.972 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:46:58.972 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:46:58.973 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:46:58.973 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:46:58.973 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:46:58.973 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:46:58.973 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:46:58.973 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:46:58.973 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:46:58.973 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:46:58.973 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:46:58.973 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:46:58.973 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:46:58.973 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:46:58.973 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:46:58.974 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:46:58.974 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:46:58.974 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:46:58.974 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:46:58.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:58.974 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:46:58.974 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:46:58.974 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:46:58.974 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:46:58.974 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:46:58.974 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:46:58.974 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:46:58.974 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:46:58.974 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:46:58.975 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:46:58.975 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:46:58.975 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:46:58.975 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:46:58.975 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 16, 2024-09-12T02:46:58.975 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_priority": 5 2024-09-12T02:46:58.975 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:58.975 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:46:58.975 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:46:58.975 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": "cephfs" 2024-09-12T02:46:58.975 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:58.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:58.976 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:46:58.976 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:46:58.976 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 2, 2024-09-12T02:46:58.976 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 2, 2024-09-12T02:46:58.976 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:46:58.976 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:46:58.976 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:46:58.976 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:46:58.976 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:46:58.976 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:46:58.977 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:58.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:58.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:58.977 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 13, 2024-09-12T02:46:58.977 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_data", 2024-09-12T02:46:58.977 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:46:35.615193+0000", 2024-09-12T02:46:58.977 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 3, 2024-09-12T02:46:58.977 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full", 2024-09-12T02:46:58.977 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:46:58.977 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:46:58.977 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:46:58.977 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:46:58.977 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:46:58.978 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:46:58.978 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:46:58.978 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:46:58.978 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:46:58.978 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:46:58.978 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:46:58.978 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 64, 2024-09-12T02:46:58.978 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 64, 2024-09-12T02:46:58.978 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 64, 2024-09-12T02:46:58.978 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 64, 2024-09-12T02:46:58.978 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 64, 2024-09-12T02:46:58.978 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:46:58.978 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:46:58.978 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:46:58.978 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:46:58.979 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:46:58.979 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:46:58.979 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:46:58.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:58.979 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "102", 2024-09-12T02:46:58.979 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:46:58.979 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:46:58.979 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:46:58.979 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:46:58.979 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:46:58.979 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:46:58.979 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:46:58.979 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:46:58.980 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:46:58.980 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:46:58.980 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:46:58.980 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:46:58.980 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:46:58.980 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:46:58.980 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:46:58.980 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:46:58.980 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:46:58.980 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:46:58.980 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:46:58.980 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:46:58.980 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:46:58.981 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:46:58.981 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:46:58.981 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:46:58.981 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:46:58.981 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:46:58.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:58.981 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:46:58.981 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:46:58.981 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:46:58.981 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:46:58.981 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:46:58.981 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:46:58.981 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:46:58.982 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:46:58.982 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:46:58.982 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:46:58.982 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:46:58.982 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:46:58.982 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 64, 2024-09-12T02:46:58.982 INFO:teuthology.orchestra.run.smithi112.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:46:58.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:58.982 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:46:58.982 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:46:58.982 INFO:teuthology.orchestra.run.smithi112.stdout: "data": "cephfs" 2024-09-12T02:46:58.982 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:58.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:58.982 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:46:58.983 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:46:58.983 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.3799999952316284, 2024-09-12T02:46:58.983 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.3799999952316284, 2024-09-12T02:46:58.983 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:46:58.983 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-12T02:46:58.983 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-12T02:46:58.983 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:46:58.983 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:46:58.983 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:46:58.983 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:58.983 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:58.983 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:46:58.983 INFO:teuthology.orchestra.run.smithi112.stdout: "osds": [ 2024-09-12T02:46:58.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:58.984 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:46:58.984 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:58.984 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:58.984 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:58.984 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:58.984 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:58.984 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:58.984 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:58.984 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:58.984 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:46:58.984 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:58.984 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:58.985 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:58.985 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:58.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:58.985 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:58.985 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6800", 2024-09-12T02:46:58.985 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:58.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:58.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:58.985 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:58.985 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6801", 2024-09-12T02:46:58.985 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:58.985 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:58.985 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:58.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:58.986 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:58.986 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:58.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:58.986 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:58.986 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6802", 2024-09-12T02:46:58.986 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:58.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:58.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:58.986 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:58.986 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6803", 2024-09-12T02:46:58.987 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:58.987 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:58.987 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:58.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:58.988 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:58.988 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:58.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:58.988 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:58.989 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6806", 2024-09-12T02:46:58.989 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:58.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:58.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:58.989 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:58.989 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6807", 2024-09-12T02:46:58.989 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:58.989 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:58.990 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:58.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:58.990 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:58.990 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:58.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:58.990 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:58.990 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6804", 2024-09-12T02:46:58.990 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:58.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:58.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:58.993 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:58.993 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6805", 2024-09-12T02:46:58.993 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:46:58.993 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:58.994 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:58.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:58.994 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6801/821571304", 2024-09-12T02:46:58.994 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6803/821571304", 2024-09-12T02:46:58.994 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6807/821571304", 2024-09-12T02:46:58.994 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6805/821571304", 2024-09-12T02:46:58.994 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:58.994 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:58.994 INFO:teuthology.orchestra.run.smithi112.stdout: "full", 2024-09-12T02:46:58.994 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:58.994 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:58.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:58.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:58.995 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:46:58.995 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:58.995 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:58.995 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:58.995 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:58.995 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:58.995 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:58.995 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:58.995 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:58.995 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:46:58.995 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:58.995 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:58.995 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:58.995 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:58.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:58.996 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:58.996 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6808", 2024-09-12T02:46:58.996 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:58.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:58.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:58.996 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:58.996 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6809", 2024-09-12T02:46:58.996 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:58.996 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:58.996 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:58.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:58.996 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:58.997 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:58.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:58.997 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:58.997 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6810", 2024-09-12T02:46:58.997 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:58.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:58.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:58.997 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:58.997 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6811", 2024-09-12T02:46:58.998 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:58.998 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:58.998 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:58.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:58.998 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:58.998 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:58.998 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:58.998 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:58.998 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6814", 2024-09-12T02:46:58.998 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:58.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:58.998 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:58.999 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:58.999 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6815", 2024-09-12T02:46:58.999 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:58.999 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:58.999 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:58.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:58.999 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:58.999 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:58.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:58.999 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:58.999 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6812", 2024-09-12T02:46:58.999 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:58.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:58.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.000 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:59.000 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6813", 2024-09-12T02:46:59.000 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:46:59.000 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.000 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.000 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6809/2642068641", 2024-09-12T02:46:59.000 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6811/2642068641", 2024-09-12T02:46:59.000 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6815/2642068641", 2024-09-12T02:46:59.000 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6813/2642068641", 2024-09-12T02:46:59.000 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:59.000 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:59.000 INFO:teuthology.orchestra.run.smithi112.stdout: "full", 2024-09-12T02:46:59.000 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:59.001 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.001 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:46:59.001 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:59.001 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:59.001 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:59.001 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:59.001 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:59.001 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:59.001 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:59.001 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:59.001 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:46:59.001 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:59.002 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:59.002 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:59.002 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:59.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.002 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:59.002 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6816", 2024-09-12T02:46:59.002 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:59.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.002 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:59.002 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6817", 2024-09-12T02:46:59.002 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:59.002 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.002 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.003 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:59.003 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:59.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.003 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:59.003 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6818", 2024-09-12T02:46:59.003 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:59.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.004 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:59.004 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6819", 2024-09-12T02:46:59.004 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:59.004 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.004 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.004 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:59.004 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:59.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.004 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:59.004 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6822", 2024-09-12T02:46:59.004 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:59.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.005 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:59.005 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6823", 2024-09-12T02:46:59.005 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:59.005 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.005 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.005 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:59.005 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:59.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.005 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:59.005 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6820", 2024-09-12T02:46:59.005 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:59.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.006 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:59.006 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6821", 2024-09-12T02:46:59.006 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:46:59.006 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.006 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.006 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6817/3365688807", 2024-09-12T02:46:59.006 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6819/3365688807", 2024-09-12T02:46:59.006 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6823/3365688807", 2024-09-12T02:46:59.006 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6821/3365688807", 2024-09-12T02:46:59.006 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:59.006 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:59.007 INFO:teuthology.orchestra.run.smithi112.stdout: "full", 2024-09-12T02:46:59.007 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:59.007 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.007 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:46:59.007 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:59.007 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:59.007 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:59.007 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:59.007 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:59.007 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:59.007 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:59.007 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:59.008 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 98, 2024-09-12T02:46:59.008 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:59.008 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:59.008 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:59.008 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:59.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.008 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:59.008 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6824", 2024-09-12T02:46:59.008 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:59.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.008 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:59.008 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6825", 2024-09-12T02:46:59.009 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:59.009 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.009 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.009 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:59.009 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:59.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.009 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:59.009 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6826", 2024-09-12T02:46:59.009 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:59.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.009 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:59.009 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6827", 2024-09-12T02:46:59.010 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:59.010 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.010 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.010 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:59.010 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:59.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.010 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:59.010 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6830", 2024-09-12T02:46:59.010 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:59.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.010 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:59.010 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6831", 2024-09-12T02:46:59.011 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:59.011 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.011 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.011 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:59.011 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:59.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.011 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:59.011 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6828", 2024-09-12T02:46:59.011 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:59.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.011 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:59.011 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6829", 2024-09-12T02:46:59.012 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:46:59.012 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.012 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.012 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6825/231774278", 2024-09-12T02:46:59.012 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6827/231774278", 2024-09-12T02:46:59.012 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6831/231774278", 2024-09-12T02:46:59.012 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6829/231774278", 2024-09-12T02:46:59.012 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:59.012 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:59.012 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:59.012 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.013 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:46:59.013 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:59.013 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:59.013 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:59.013 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:59.013 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:59.013 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:59.013 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:59.013 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:59.013 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:46:59.013 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:59.013 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:59.013 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:59.013 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:59.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.014 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:59.014 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6800", 2024-09-12T02:46:59.014 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:59.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.014 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:59.014 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6801", 2024-09-12T02:46:59.014 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:59.014 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.014 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.014 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:59.015 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:59.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.015 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:59.015 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6802", 2024-09-12T02:46:59.015 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:59.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.015 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:59.015 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6803", 2024-09-12T02:46:59.015 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:59.015 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.016 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.016 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:59.016 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:59.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.016 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:59.016 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6806", 2024-09-12T02:46:59.016 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:59.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.016 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:59.017 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6807", 2024-09-12T02:46:59.017 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:59.017 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.017 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.017 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:59.017 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:59.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.017 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:59.017 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6804", 2024-09-12T02:46:59.017 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:59.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.018 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:59.018 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6805", 2024-09-12T02:46:59.018 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:46:59.018 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.018 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.018 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6801/3671178153", 2024-09-12T02:46:59.018 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6803/3671178153", 2024-09-12T02:46:59.018 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6807/3671178153", 2024-09-12T02:46:59.019 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6805/3671178153", 2024-09-12T02:46:59.019 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:59.019 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:59.019 INFO:teuthology.orchestra.run.smithi112.stdout: "full", 2024-09-12T02:46:59.019 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:59.019 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.019 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:46:59.019 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:59.019 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:59.019 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:59.019 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:59.020 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:59.020 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:59.020 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:59.020 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:59.020 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:46:59.020 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:59.020 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:59.020 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:59.020 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:59.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.021 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:59.021 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6808", 2024-09-12T02:46:59.021 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:59.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.021 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:59.021 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6809", 2024-09-12T02:46:59.021 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:59.021 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.021 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.022 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:59.022 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:59.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.022 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:59.022 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6810", 2024-09-12T02:46:59.022 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:59.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.022 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:59.022 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6811", 2024-09-12T02:46:59.022 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:59.023 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.023 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.023 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:59.023 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:59.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.024 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:59.024 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6817", 2024-09-12T02:46:59.024 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:59.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.024 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:59.024 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6819", 2024-09-12T02:46:59.024 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:59.024 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.024 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.025 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:59.025 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:59.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.025 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:59.025 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6812", 2024-09-12T02:46:59.025 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:59.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.025 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:59.025 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6815", 2024-09-12T02:46:59.026 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:46:59.026 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.026 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.026 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6809/3193706134", 2024-09-12T02:46:59.026 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6811/3193706134", 2024-09-12T02:46:59.026 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6819/3193706134", 2024-09-12T02:46:59.026 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6815/3193706134", 2024-09-12T02:46:59.026 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:59.027 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:59.027 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:59.027 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.027 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:46:59.027 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:59.027 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:59.027 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:59.027 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:59.028 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:59.028 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:59.028 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:59.028 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:59.028 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:46:59.028 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:59.028 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:59.028 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:59.028 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:59.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.028 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:59.028 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6813", 2024-09-12T02:46:59.028 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:59.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.029 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:59.029 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6814", 2024-09-12T02:46:59.029 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:59.029 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.029 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.029 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:59.029 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:59.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.029 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:59.029 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6816", 2024-09-12T02:46:59.029 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:59.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.030 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:59.030 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6818", 2024-09-12T02:46:59.030 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:59.030 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.030 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.030 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:59.030 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:59.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.030 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:59.030 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6822", 2024-09-12T02:46:59.030 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:59.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.031 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:59.031 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6823", 2024-09-12T02:46:59.031 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:59.031 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.031 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.031 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:59.031 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:59.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.031 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:59.031 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6820", 2024-09-12T02:46:59.032 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:59.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.032 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:59.032 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6821", 2024-09-12T02:46:59.032 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:46:59.032 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.032 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.032 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6814/3738813293", 2024-09-12T02:46:59.032 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6818/3738813293", 2024-09-12T02:46:59.032 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6823/3738813293", 2024-09-12T02:46:59.032 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6821/3738813293", 2024-09-12T02:46:59.033 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:59.033 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:59.033 INFO:teuthology.orchestra.run.smithi112.stdout: "full", 2024-09-12T02:46:59.033 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:59.033 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.033 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:46:59.033 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:46:59.033 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:46:59.033 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:46:59.033 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:46:59.034 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:46:59.034 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:46:59.034 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:46:59.034 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:46:59.034 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:46:59.034 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:46:59.034 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:46:59.034 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:46:59.034 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:59.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.034 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:59.034 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6824", 2024-09-12T02:46:59.035 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:59.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.035 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:59.035 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6825", 2024-09-12T02:46:59.035 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:59.035 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.035 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.035 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:46:59.035 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:59.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.035 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:59.036 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6826", 2024-09-12T02:46:59.036 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:59.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.036 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:59.036 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6827", 2024-09-12T02:46:59.036 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:59.036 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.036 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.036 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:46:59.036 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:59.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.037 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:59.037 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6830", 2024-09-12T02:46:59.037 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:59.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.037 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:59.037 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6831", 2024-09-12T02:46:59.037 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:59.037 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.037 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.037 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:46:59.037 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:46:59.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.038 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:46:59.038 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6828", 2024-09-12T02:46:59.038 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:59.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.038 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:46:59.038 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6829", 2024-09-12T02:46:59.038 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:46:59.038 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.038 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.038 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6825/1421932609", 2024-09-12T02:46:59.039 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6827/1421932609", 2024-09-12T02:46:59.039 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6831/1421932609", 2024-09-12T02:46:59.039 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6829/1421932609", 2024-09-12T02:46:59.039 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:46:59.039 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull", 2024-09-12T02:46:59.039 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:46:59.039 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:46:59.039 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.039 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.039 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:46:59.039 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_xinfo": [ 2024-09-12T02:46:59.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.039 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:46:59.039 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:59.040 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:59.040 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:59.040 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:59.040 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:59.040 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.220641+0000", 2024-09-12T02:46:59.040 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:59.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.040 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:46:59.040 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:59.040 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:59.040 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:59.040 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:59.040 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:59.041 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312574+0000", 2024-09-12T02:46:59.041 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:59.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.041 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:46:59.041 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:59.041 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:59.041 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:59.041 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:59.041 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:59.041 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.282771+0000", 2024-09-12T02:46:59.041 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:59.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.042 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:46:59.042 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:59.042 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:59.042 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:59.042 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:59.042 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:59.042 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.260478+0000", 2024-09-12T02:46:59.042 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:59.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.042 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:46:59.042 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:59.042 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:59.043 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:59.043 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:59.043 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:59.043 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.273397+0000", 2024-09-12T02:46:59.043 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:59.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.043 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:46:59.043 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:59.043 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:59.043 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:59.043 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:59.043 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:59.043 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312452+0000", 2024-09-12T02:46:59.044 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:59.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.044 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:46:59.044 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:59.044 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:59.044 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:59.044 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:59.044 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:59.044 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.308965+0000", 2024-09-12T02:46:59.044 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:59.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.045 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:46:59.045 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:46:59.045 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:46:59.045 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:46:59.045 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:46:59.045 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:46:59.045 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.337842+0000", 2024-09-12T02:46:59.045 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:46:59.045 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.045 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:46:59.045 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap": [], 2024-09-12T02:46:59.045 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_items": [ 2024-09-12T02:46:59.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.045 INFO:teuthology.orchestra.run.smithi112.stdout: "pgid": "13.2a", 2024-09-12T02:46:59.045 INFO:teuthology.orchestra.run.smithi112.stdout: "mappings": [ 2024-09-12T02:46:59.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:46:59.046 INFO:teuthology.orchestra.run.smithi112.stdout: "from": 1, 2024-09-12T02:46:59.046 INFO:teuthology.orchestra.run.smithi112.stdout: "to": 3 2024-09-12T02:46:59.046 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.046 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:46:59.046 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.046 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:46:59.046 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_primaries": [], 2024-09-12T02:46:59.046 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_temp": [], 2024-09-12T02:46:59.046 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_temp": [], 2024-09-12T02:46:59.046 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklist": {}, 2024-09-12T02:46:59.046 INFO:teuthology.orchestra.run.smithi112.stdout: "range_blocklist": {}, 2024-09-12T02:46:59.046 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profiles": { 2024-09-12T02:46:59.046 INFO:teuthology.orchestra.run.smithi112.stdout: "default": { 2024-09-12T02:46:59.047 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-failure-domain": "osd", 2024-09-12T02:46:59.047 INFO:teuthology.orchestra.run.smithi112.stdout: "k": "2", 2024-09-12T02:46:59.047 INFO:teuthology.orchestra.run.smithi112.stdout: "m": "1", 2024-09-12T02:46:59.047 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin": "jerasure", 2024-09-12T02:46:59.047 INFO:teuthology.orchestra.run.smithi112.stdout: "technique": "reed_sol_van" 2024-09-12T02:46:59.047 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:46:59.047 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps_queue": [], 2024-09-12T02:46:59.047 INFO:teuthology.orchestra.run.smithi112.stdout: "new_removed_snaps": [], 2024-09-12T02:46:59.047 INFO:teuthology.orchestra.run.smithi112.stdout: "new_purged_snaps": [], 2024-09-12T02:46:59.048 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_node_flags": {}, 2024-09-12T02:46:59.048 INFO:teuthology.orchestra.run.smithi112.stdout: "device_class_flags": {}, 2024-09-12T02:46:59.048 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode": { 2024-09-12T02:46:59.048 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_enabled": false, 2024-09-12T02:46:59.048 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_bucket_count": 0, 2024-09-12T02:46:59.048 INFO:teuthology.orchestra.run.smithi112.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:46:59.048 INFO:teuthology.orchestra.run.smithi112.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:46:59.048 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_bucket": 0 2024-09-12T02:46:59.048 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:46:59.048 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:46:59.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.959+0000 7f09b7400640 1 -- 172.21.15.112:0/22775370 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f098c06be60 msgr2=0x7f098c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:59.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.959+0000 7f09b7400640 1 --2- 172.21.15.112:0/22775370 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f098c06be60 0x7f098c06e320 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009c40 tx=0x7f09a0008040 comp rx=0 tx=0).stop 2024-09-12T02:46:59.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.959+0000 7f09b7400640 1 -- 172.21.15.112:0/22775370 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09b015fa10 msgr2=0x7f09b01f0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:59.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.959+0000 7f09b7400640 1 --2- 172.21.15.112:0/22775370 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09b015fa10 0x7f09b01f0e10 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f0998006ab0 tx=0x7f0998006f70 comp rx=0 tx=0).stop 2024-09-12T02:46:59.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.959+0000 7f09b7400640 1 -- 172.21.15.112:0/22775370 shutdown_connections 2024-09-12T02:46:59.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.959+0000 7f09b7400640 1 --2- 172.21.15.112:0/22775370 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09b01472a0 0x7f09b015d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:59.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.959+0000 7f09b7400640 1 --2- 172.21.15.112:0/22775370 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09b015fa10 0x7f09b01f0e10 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:59.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.959+0000 7f09b7400640 1 --2- 172.21.15.112:0/22775370 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f098c06be60 0x7f098c06e320 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:59.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.959+0000 7f09b7400640 1 --2- 172.21.15.112:0/22775370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0994004d40 0x7f09b015cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:59.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.959+0000 7f09b7400640 1 -- 172.21.15.112:0/22775370 >> 172.21.15.112:0/22775370 conn(0x7f09b006bbd0 msgr2=0x7f09b00b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:59.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.959+0000 7f09b7400640 1 -- 172.21.15.112:0/22775370 shutdown_connections 2024-09-12T02:46:59.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:46:58.959+0000 7f09b7400640 1 -- 172.21.15.112:0/22775370 wait complete. 2024-09-12T02:46:59.051 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-12T02:47:00.136 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-12T02:47:00.135+0000 7f0219e00640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2024-09-12T02:47:04.053 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-12T02:47:04.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.216+0000 7f2012c00640 1 Processor -- start 2024-09-12T02:47:04.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.216+0000 7f2012c00640 1 -- start start 2024-09-12T02:47:04.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.218+0000 7f2012c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f200c071530 0x7f200c0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:04.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.218+0000 7f2012c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f200c071970 0x7f200c0afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:04.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.218+0000 7f2012c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f200c0ceeb0 con 0x7f200c15cc50 2024-09-12T02:47:04.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.218+0000 7f2012c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f200c15d030 con 0x7f200c071970 2024-09-12T02:47:04.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.218+0000 7f2012c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f200c0cf4c0 con 0x7f200c071530 2024-09-12T02:47:04.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.218+0000 7f200be00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f200c15cc50 0x7f200c0732f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33024/0 (socket says 172.21.15.112:33024) 2024-09-12T02:47:04.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.218+0000 7f200be00640 1 -- 172.21.15.112:0/3737727640 learned_addr learned my addr 172.21.15.112:0/3737727640 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:04.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.218+0000 7f2010c00640 1 --2- 172.21.15.112:0/3737727640 >> v2:172.21.15.137:3300/0 conn(0x7f200c071970 0x7f200c0afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:04.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.218+0000 7f200b400640 1 --2- 172.21.15.112:0/3737727640 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f200c071530 0x7f200c0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:04.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.218+0000 7f200aa00640 1 -- 172.21.15.112:0/3737727640 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1785595990 0 0) 0x7f200c0ceeb0 con 0x7f200c15cc50 2024-09-12T02:47:04.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.218+0000 7f200aa00640 1 -- 172.21.15.112:0/3737727640 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ff0003520 con 0x7f200c15cc50 2024-09-12T02:47:04.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.219+0000 7f200aa00640 1 -- 172.21.15.112:0/3737727640 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4155895130 0 0) 0x7f1ff0003520 con 0x7f200c15cc50 2024-09-12T02:47:04.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.219+0000 7f2010c00640 1 -- 172.21.15.112:0/3737727640 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f200c071530 msgr2=0x7f200c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:04.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.219+0000 7f2010c00640 1 --2- 172.21.15.112:0/3737727640 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f200c071530 0x7f200c0af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:04.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.219+0000 7f2010c00640 1 -- 172.21.15.112:0/3737727640 >> v1:172.21.15.112:6789/0 conn(0x7f200c15cc50 legacy=0x7f200c0732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:04.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.219+0000 7f2010c00640 1 -- 172.21.15.112:0/3737727640 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f200c06e300 con 0x7f200c071970 2024-09-12T02:47:04.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.220+0000 7f2010c00640 1 --2- 172.21.15.112:0/3737727640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f200c071970 0x7f200c0afc60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2004009d90 tx=0x7f200402a550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a1b213eeddd42d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:04.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.220+0000 7f200aa00640 1 -- 172.21.15.112:0/3737727640 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc001670 con 0x7f200c071970 2024-09-12T02:47:04.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.220+0000 7f200aa00640 1 -- 172.21.15.112:0/3737727640 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2004007540 con 0x7f200c071970 2024-09-12T02:47:04.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.220+0000 7f200aa00640 1 -- 172.21.15.112:0/3737727640 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2004007910 con 0x7f200c071970 2024-09-12T02:47:04.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.221+0000 7f2012c00640 1 -- 172.21.15.112:0/3737727640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f200c071970 msgr2=0x7f200c0afc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:04.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.221+0000 7f2012c00640 1 --2- 172.21.15.112:0/3737727640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f200c071970 0x7f200c0afc60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2004009d90 tx=0x7f200402a550 comp rx=0 tx=0).stop 2024-09-12T02:47:04.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.221+0000 7f2012c00640 1 -- 172.21.15.112:0/3737727640 shutdown_connections 2024-09-12T02:47:04.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.221+0000 7f2012c00640 1 --2- 172.21.15.112:0/3737727640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f200c071970 0x7f200c0afc60 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:04.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.221+0000 7f2012c00640 1 --2- 172.21.15.112:0/3737727640 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f200c071530 0x7f200c0af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:04.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.221+0000 7f2012c00640 1 -- 172.21.15.112:0/3737727640 >> 172.21.15.112:0/3737727640 conn(0x7f200c06bbd0 msgr2=0x7f200c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:04.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.221+0000 7f2012c00640 1 -- 172.21.15.112:0/3737727640 shutdown_connections 2024-09-12T02:47:04.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.221+0000 7f2012c00640 1 -- 172.21.15.112:0/3737727640 wait complete. 2024-09-12T02:47:04.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.222+0000 7f2012c00640 1 Processor -- start 2024-09-12T02:47:04.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.222+0000 7f2012c00640 1 -- start start 2024-09-12T02:47:04.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.223+0000 7f2012c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f200c071530 0x7f200c1f2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:04.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.223+0000 7f2012c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f200c071970 0x7f200c1e6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:04.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.223+0000 7f2012c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f200c15cc50 0x7f200c140420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:04.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.223+0000 7f2012c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f200c06f510 con 0x7f200c071530 2024-09-12T02:47:04.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.223+0000 7f2012c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f200c0cf150 con 0x7f200c071970 2024-09-12T02:47:04.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.223+0000 7f2012c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f200c06f690 con 0x7f200c15cc50 2024-09-12T02:47:04.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.224+0000 7f200be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f200c071530 0x7f200c1f2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:04.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.224+0000 7f200be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f200c071530 0x7f200c1f2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48420/0 (socket says 172.21.15.112:48420) 2024-09-12T02:47:04.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.224+0000 7f200be00640 1 -- 172.21.15.112:0/1221274212 learned_addr learned my addr 172.21.15.112:0/1221274212 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:04.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.224+0000 7f200b400640 1 --2- 172.21.15.112:0/1221274212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f200c071970 0x7f200c1e6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:04.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.224+0000 7f2010c00640 1 --2- 172.21.15.112:0/1221274212 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f200c15cc50 0x7f200c140420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:04.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.224+0000 7f200be00640 1 -- 172.21.15.112:0/1221274212 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f200c15cc50 msgr2=0x7f200c140420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:04.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.224+0000 7f200be00640 1 --2- 172.21.15.112:0/1221274212 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f200c15cc50 0x7f200c140420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:04.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.224+0000 7f200be00640 1 -- 172.21.15.112:0/1221274212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f200c071970 msgr2=0x7f200c1e6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:04.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.224+0000 7f200be00640 1 --2- 172.21.15.112:0/1221274212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f200c071970 0x7f200c1e6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:04.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.224+0000 7f200be00640 1 -- 172.21.15.112:0/1221274212 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f200c13e0f0 con 0x7f200c071530 2024-09-12T02:47:04.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.224+0000 7f200b400640 1 --2- 172.21.15.112:0/1221274212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f200c071970 0x7f200c1e6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:04.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.224+0000 7f200be00640 1 --2- 172.21.15.112:0/1221274212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f200c071530 0x7f200c1f2370 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc007fd0 tx=0x7f1ffc00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:04.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.225+0000 7f2003e00640 1 -- 172.21.15.112:0/1221274212 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc017070 con 0x7f200c071530 2024-09-12T02:47:04.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.225+0000 7f2003e00640 1 -- 172.21.15.112:0/1221274212 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ffc005ce0 con 0x7f200c071530 2024-09-12T02:47:04.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.225+0000 7f2003e00640 1 -- 172.21.15.112:0/1221274212 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc007270 con 0x7f200c071530 2024-09-12T02:47:04.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.225+0000 7f2012c00640 1 -- 172.21.15.112:0/1221274212 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f200c1e7a10 con 0x7f200c071530 2024-09-12T02:47:04.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.225+0000 7f2012c00640 1 -- 172.21.15.112:0/1221274212 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f200c13e550 con 0x7f200c071530 2024-09-12T02:47:04.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.226+0000 7f2012c00640 1 -- 172.21.15.112:0/1221274212 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f200c06df60 con 0x7f200c071530 2024-09-12T02:47:04.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.227+0000 7f2003e00640 1 -- 172.21.15.112:0/1221274212 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1ffc01a070 con 0x7f200c071530 2024-09-12T02:47:04.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.227+0000 7f2003e00640 1 --2- 172.21.15.112:0/1221274212 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1fec06be30 0x7f1fec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:04.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.228+0000 7f2003e00640 1 -- 172.21.15.112:0/1221274212 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5738+0+0 (secure 0 0 0) 0x7f1ffc08a190 con 0x7f200c071530 2024-09-12T02:47:04.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.228+0000 7f200b400640 1 --2- 172.21.15.112:0/1221274212 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1fec06be30 0x7f1fec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:04.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.228+0000 7f2003e00640 1 -- 172.21.15.112:0/1221274212 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=109}) -- 0x7f1fec0739c0 con 0x7f200c071530 2024-09-12T02:47:04.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.228+0000 7f200b400640 1 --2- 172.21.15.112:0/1221274212 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1fec06be30 0x7f1fec06e2f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f200c1f6090 tx=0x7f1ff8009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:04.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.232+0000 7f2003e00640 1 -- 172.21.15.112:0/1221274212 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f200c13e0f0 con 0x7f200c071530 2024-09-12T02:47:04.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.408+0000 7f2012c00640 1 -- 172.21.15.112:0/1221274212 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f200c0d1530 con 0x7f200c071530 2024-09-12T02:47:04.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.409+0000 7f2003e00640 1 -- 172.21.15.112:0/1221274212 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v108) ==== 81+0+34566 (secure 0 0 0) 0x7f1ffc0584c0 con 0x7f200c071530 2024-09-12T02:47:04.411 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:04.411 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:47:04.411 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 108, 2024-09-12T02:47:04.411 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:47:04.411 INFO:teuthology.orchestra.run.smithi112.stdout: "created": "2024-09-12T02:41:36.162095+0000", 2024-09-12T02:47:04.411 INFO:teuthology.orchestra.run.smithi112.stdout: "modified": "2024-09-12T02:47:04.165181+0000", 2024-09-12T02:47:04.411 INFO:teuthology.orchestra.run.smithi112.stdout: "last_up_change": "2024-09-12T02:41:42.191169+0000", 2024-09-12T02:47:04.411 INFO:teuthology.orchestra.run.smithi112.stdout: "last_in_change": "2024-09-12T02:41:39.036600+0000", 2024-09-12T02:47:04.411 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:47:04.412 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_num": 5799936, 2024-09-12T02:47:04.412 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_set": [ 2024-09-12T02:47:04.412 INFO:teuthology.orchestra.run.smithi112.stdout: "pglog_hardlimit", 2024-09-12T02:47:04.412 INFO:teuthology.orchestra.run.smithi112.stdout: "purged_snapdirs", 2024-09-12T02:47:04.412 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_deletes", 2024-09-12T02:47:04.412 INFO:teuthology.orchestra.run.smithi112.stdout: "sortbitwise" 2024-09-12T02:47:04.412 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:47:04.412 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_version": 4, 2024-09-12T02:47:04.412 INFO:teuthology.orchestra.run.smithi112.stdout: "full_ratio": 0.69999998807907104, 2024-09-12T02:47:04.412 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-12T02:47:04.412 INFO:teuthology.orchestra.run.smithi112.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-12T02:47:04.413 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_snapshot": "", 2024-09-12T02:47:04.413 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_max": 13, 2024-09-12T02:47:04.413 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd": 8, 2024-09-12T02:47:04.413 INFO:teuthology.orchestra.run.smithi112.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:47:04.413 INFO:teuthology.orchestra.run.smithi112.stdout: "min_compat_client": "luminous", 2024-09-12T02:47:04.413 INFO:teuthology.orchestra.run.smithi112.stdout: "require_osd_release": "squid", 2024-09-12T02:47:04.413 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_crimson": false, 2024-09-12T02:47:04.413 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-12T02:47:04.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.413 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 1, 2024-09-12T02:47:04.413 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": ".mgr", 2024-09-12T02:47:04.413 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:41:43.011599+0000", 2024-09-12T02:47:04.414 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 3, 2024-09-12T02:47:04.414 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full", 2024-09-12T02:47:04.414 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:47:04.414 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:47:04.414 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:47:04.414 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:47:04.414 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:47:04.414 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:47:04.414 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:47:04.414 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:47:04.414 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:47:04.414 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:47:04.414 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:47:04.414 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 1, 2024-09-12T02:47:04.415 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 1, 2024-09-12T02:47:04.415 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 1, 2024-09-12T02:47:04.415 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 1, 2024-09-12T02:47:04.415 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 1, 2024-09-12T02:47:04.415 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:47:04.415 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:47:04.415 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:47:04.415 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:47:04.415 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:47:04.415 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:47:04.415 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:47:04.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.415 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "102", 2024-09-12T02:47:04.415 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:47:04.416 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:47:04.416 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:47:04.416 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:47:04.416 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:47:04.416 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:47:04.416 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:47:04.416 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:47:04.416 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:47:04.416 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:47:04.416 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:47:04.416 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:47:04.416 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:47:04.416 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:47:04.417 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:47:04.417 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:47:04.417 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:47:04.417 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:47:04.417 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:47:04.417 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:47:04.417 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:47:04.417 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:47:04.417 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:47:04.417 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:47:04.417 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:47:04.417 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:47:04.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.417 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:47:04.418 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:47:04.418 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:47:04.418 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:47:04.418 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:47:04.418 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:47:04.418 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:47:04.418 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:47:04.418 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:47:04.418 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:47:04.418 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:47:04.418 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:47:04.418 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_max": 32, 2024-09-12T02:47:04.418 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 1 2024-09-12T02:47:04.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.418 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:47:04.419 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": {} 2024-09-12T02:47:04.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.419 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:47:04.419 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:47:04.419 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 8, 2024-09-12T02:47:04.419 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 8, 2024-09-12T02:47:04.419 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 0.25, 2024-09-12T02:47:04.419 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:47:04.419 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:47:04.419 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:47:04.419 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:47:04.419 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:47:04.419 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.420 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 12, 2024-09-12T02:47:04.420 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:47:04.420 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:46:34.392830+0000", 2024-09-12T02:47:04.420 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 3, 2024-09-12T02:47:04.420 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full", 2024-09-12T02:47:04.420 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:47:04.420 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:47:04.420 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:47:04.420 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:47:04.420 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:47:04.420 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:47:04.420 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:47:04.420 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:47:04.420 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:47:04.421 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:47:04.421 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:47:04.421 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 32, 2024-09-12T02:47:04.421 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 32, 2024-09-12T02:47:04.421 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 32, 2024-09-12T02:47:04.421 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 32, 2024-09-12T02:47:04.421 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 32, 2024-09-12T02:47:04.421 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:47:04.421 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:47:04.421 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:47:04.421 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:47:04.421 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:47:04.421 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:47:04.422 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:47:04.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.422 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "102", 2024-09-12T02:47:04.422 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:47:04.422 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:47:04.422 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:47:04.422 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:47:04.422 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:47:04.422 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:47:04.422 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:47:04.422 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:47:04.422 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:47:04.422 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:47:04.422 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:47:04.422 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:47:04.423 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:47:04.423 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:47:04.423 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:47:04.423 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:47:04.423 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:47:04.423 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:47:04.423 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:47:04.423 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:47:04.423 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:47:04.423 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:47:04.423 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:47:04.423 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:47:04.423 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:47:04.424 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:47:04.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.424 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:47:04.424 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:47:04.424 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:47:04.424 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:47:04.424 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:47:04.424 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:47:04.424 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:47:04.424 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:47:04.424 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:47:04.424 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:47:04.424 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:47:04.425 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:47:04.425 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:47:04.425 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 16, 2024-09-12T02:47:04.425 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_priority": 5 2024-09-12T02:47:04.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.425 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:47:04.425 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:47:04.425 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": "cephfs" 2024-09-12T02:47:04.425 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.425 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:47:04.425 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:47:04.425 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 2, 2024-09-12T02:47:04.425 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 2, 2024-09-12T02:47:04.426 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:47:04.426 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:47:04.426 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:47:04.426 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:47:04.426 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:47:04.426 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:47:04.426 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.426 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 13, 2024-09-12T02:47:04.426 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_data", 2024-09-12T02:47:04.426 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:46:35.615193+0000", 2024-09-12T02:47:04.426 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 3, 2024-09-12T02:47:04.426 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full", 2024-09-12T02:47:04.427 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:47:04.427 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:47:04.427 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:47:04.427 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:47:04.427 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:47:04.427 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:47:04.427 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:47:04.427 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:47:04.427 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:47:04.427 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:47:04.427 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:47:04.427 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 64, 2024-09-12T02:47:04.428 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 64, 2024-09-12T02:47:04.428 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 64, 2024-09-12T02:47:04.428 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 64, 2024-09-12T02:47:04.428 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 64, 2024-09-12T02:47:04.428 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:47:04.428 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:47:04.428 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:47:04.428 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:47:04.428 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:47:04.428 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:47:04.428 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:47:04.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.428 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "102", 2024-09-12T02:47:04.428 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:47:04.429 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:47:04.429 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:47:04.429 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:47:04.429 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:47:04.429 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:47:04.429 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:47:04.429 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:47:04.429 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:47:04.429 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:47:04.429 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:47:04.429 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:47:04.429 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:47:04.429 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:47:04.429 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:47:04.430 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:47:04.430 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:47:04.430 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:47:04.430 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:47:04.430 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:47:04.430 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:47:04.430 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:47:04.430 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:47:04.430 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:47:04.431 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:47:04.431 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:47:04.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.431 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:47:04.431 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:47:04.431 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:47:04.431 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:47:04.431 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:47:04.432 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:47:04.432 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:47:04.432 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:47:04.432 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:47:04.432 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:47:04.432 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:47:04.432 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:47:04.432 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 64, 2024-09-12T02:47:04.432 INFO:teuthology.orchestra.run.smithi112.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:47:04.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.433 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:47:04.433 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:47:04.433 INFO:teuthology.orchestra.run.smithi112.stdout: "data": "cephfs" 2024-09-12T02:47:04.433 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.433 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:47:04.433 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:47:04.433 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.3799999952316284, 2024-09-12T02:47:04.433 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.3799999952316284, 2024-09-12T02:47:04.433 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:47:04.433 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-12T02:47:04.433 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-12T02:47:04.433 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:47:04.434 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:47:04.434 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:47:04.434 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.434 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.434 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:47:04.434 INFO:teuthology.orchestra.run.smithi112.stdout: "osds": [ 2024-09-12T02:47:04.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.434 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:47:04.434 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:47:04.434 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:47:04.434 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:47:04.434 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:47:04.434 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:47:04.434 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:47:04.435 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:47:04.435 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:47:04.435 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:47:04.435 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:47:04.435 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:47:04.435 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:47:04.435 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.435 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.435 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6800", 2024-09-12T02:47:04.435 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:47:04.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.435 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.435 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6801", 2024-09-12T02:47:04.436 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:47:04.436 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.436 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.436 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:47:04.436 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.436 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.436 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6802", 2024-09-12T02:47:04.436 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:47:04.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.436 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.437 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6803", 2024-09-12T02:47:04.437 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:47:04.437 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.437 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.437 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:47:04.437 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.437 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.437 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6806", 2024-09-12T02:47:04.437 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:47:04.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.437 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.438 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6807", 2024-09-12T02:47:04.438 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:47:04.438 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.438 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.438 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:47:04.438 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.438 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.438 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6804", 2024-09-12T02:47:04.439 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:47:04.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.439 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.439 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6805", 2024-09-12T02:47:04.439 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:47:04.439 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.439 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.439 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6801/821571304", 2024-09-12T02:47:04.439 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6803/821571304", 2024-09-12T02:47:04.439 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6807/821571304", 2024-09-12T02:47:04.439 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6805/821571304", 2024-09-12T02:47:04.439 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:47:04.440 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:47:04.440 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:47:04.440 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.440 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:47:04.440 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:47:04.440 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:47:04.440 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:47:04.440 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:47:04.440 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:47:04.440 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:47:04.440 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:47:04.441 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:47:04.441 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:47:04.441 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:47:04.441 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:47:04.441 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:47:04.441 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.441 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.441 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6808", 2024-09-12T02:47:04.441 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:47:04.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.442 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.442 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6809", 2024-09-12T02:47:04.442 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:47:04.442 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.442 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.442 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:47:04.442 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.442 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.443 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6810", 2024-09-12T02:47:04.443 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:47:04.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.443 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.443 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6811", 2024-09-12T02:47:04.443 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:47:04.443 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.443 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.444 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:47:04.444 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.444 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.444 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6814", 2024-09-12T02:47:04.444 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:47:04.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.444 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.444 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6815", 2024-09-12T02:47:04.444 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:47:04.444 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.444 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.445 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:47:04.445 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.445 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.445 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6812", 2024-09-12T02:47:04.445 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:47:04.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.445 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.445 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6813", 2024-09-12T02:47:04.445 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:47:04.445 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.445 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.446 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6809/2642068641", 2024-09-12T02:47:04.446 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6811/2642068641", 2024-09-12T02:47:04.446 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6815/2642068641", 2024-09-12T02:47:04.446 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6813/2642068641", 2024-09-12T02:47:04.446 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:47:04.446 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:47:04.446 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:47:04.446 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.447 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:47:04.447 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:47:04.448 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:47:04.448 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:47:04.448 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:47:04.448 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:47:04.448 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:47:04.448 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:47:04.448 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:47:04.448 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:47:04.448 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:47:04.448 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:47:04.448 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:47:04.448 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.449 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.449 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6816", 2024-09-12T02:47:04.449 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:47:04.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.449 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.449 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6817", 2024-09-12T02:47:04.449 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:47:04.449 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.449 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.450 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:47:04.450 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.450 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.450 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6818", 2024-09-12T02:47:04.450 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:47:04.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.450 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.450 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6819", 2024-09-12T02:47:04.450 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:47:04.450 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.450 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.451 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:47:04.451 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.451 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.451 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6822", 2024-09-12T02:47:04.451 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:47:04.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.451 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.451 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6823", 2024-09-12T02:47:04.451 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:47:04.451 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.452 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.452 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:47:04.452 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.452 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.452 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6820", 2024-09-12T02:47:04.452 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:47:04.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.452 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.453 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6821", 2024-09-12T02:47:04.453 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:47:04.453 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.453 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.453 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6817/3365688807", 2024-09-12T02:47:04.453 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6819/3365688807", 2024-09-12T02:47:04.453 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6823/3365688807", 2024-09-12T02:47:04.453 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6821/3365688807", 2024-09-12T02:47:04.453 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:47:04.453 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:47:04.453 INFO:teuthology.orchestra.run.smithi112.stdout: "full", 2024-09-12T02:47:04.453 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:47:04.453 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.454 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:47:04.454 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:47:04.454 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:47:04.454 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:47:04.454 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:47:04.454 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:47:04.454 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:47:04.454 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:47:04.454 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:47:04.454 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 98, 2024-09-12T02:47:04.454 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:47:04.455 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:47:04.455 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:47:04.455 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.455 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.455 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6824", 2024-09-12T02:47:04.455 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:47:04.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.456 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.456 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6825", 2024-09-12T02:47:04.456 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:47:04.456 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.456 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.457 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:47:04.457 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.457 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.457 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6826", 2024-09-12T02:47:04.457 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:47:04.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.457 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.457 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6827", 2024-09-12T02:47:04.457 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:47:04.458 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.458 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.458 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:47:04.458 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.458 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.458 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6830", 2024-09-12T02:47:04.458 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:47:04.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.458 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.458 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6831", 2024-09-12T02:47:04.458 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:47:04.459 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.459 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.459 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:47:04.459 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.459 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.459 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6828", 2024-09-12T02:47:04.459 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:47:04.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.459 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.459 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6829", 2024-09-12T02:47:04.460 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:47:04.460 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.460 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.460 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6825/231774278", 2024-09-12T02:47:04.460 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6827/231774278", 2024-09-12T02:47:04.460 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6831/231774278", 2024-09-12T02:47:04.460 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6829/231774278", 2024-09-12T02:47:04.460 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:47:04.460 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:47:04.460 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:47:04.460 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.461 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:47:04.461 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:47:04.461 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:47:04.461 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:47:04.461 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:47:04.461 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:47:04.461 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:47:04.461 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:47:04.461 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:47:04.461 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:47:04.461 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:47:04.461 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:47:04.461 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:47:04.461 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.462 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.462 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6800", 2024-09-12T02:47:04.462 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:47:04.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.462 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.462 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6801", 2024-09-12T02:47:04.462 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:47:04.462 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.462 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.462 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:47:04.463 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.463 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.463 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6802", 2024-09-12T02:47:04.463 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:47:04.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.463 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.463 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6803", 2024-09-12T02:47:04.463 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:47:04.463 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.463 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.463 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:47:04.464 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.464 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.464 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6806", 2024-09-12T02:47:04.464 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:47:04.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.464 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.464 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6807", 2024-09-12T02:47:04.464 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:47:04.464 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.464 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.464 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:47:04.465 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.465 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.465 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6804", 2024-09-12T02:47:04.465 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:47:04.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.465 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.465 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6805", 2024-09-12T02:47:04.465 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:47:04.465 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.465 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.465 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6801/3671178153", 2024-09-12T02:47:04.466 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6803/3671178153", 2024-09-12T02:47:04.466 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6807/3671178153", 2024-09-12T02:47:04.466 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6805/3671178153", 2024-09-12T02:47:04.466 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:47:04.466 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:47:04.466 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:47:04.466 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.466 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:47:04.466 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:47:04.466 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:47:04.466 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:47:04.466 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:47:04.467 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:47:04.467 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:47:04.467 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:47:04.467 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:47:04.467 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:47:04.467 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:47:04.467 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:47:04.467 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:47:04.467 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.467 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.467 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6808", 2024-09-12T02:47:04.467 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:47:04.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.468 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.468 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6809", 2024-09-12T02:47:04.468 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:47:04.468 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.468 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.468 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:47:04.468 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.468 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.468 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6810", 2024-09-12T02:47:04.468 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:47:04.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.469 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.469 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6811", 2024-09-12T02:47:04.469 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:47:04.469 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.469 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.469 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:47:04.469 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.469 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.469 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6817", 2024-09-12T02:47:04.469 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:47:04.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.470 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.470 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6819", 2024-09-12T02:47:04.470 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:47:04.470 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.470 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.470 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:47:04.470 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.470 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.470 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6812", 2024-09-12T02:47:04.470 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:47:04.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.471 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.471 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6815", 2024-09-12T02:47:04.471 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:47:04.471 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.471 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.471 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6809/3193706134", 2024-09-12T02:47:04.471 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6811/3193706134", 2024-09-12T02:47:04.471 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6819/3193706134", 2024-09-12T02:47:04.471 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6815/3193706134", 2024-09-12T02:47:04.471 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:47:04.471 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:47:04.471 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:47:04.472 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.472 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:47:04.472 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:47:04.472 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:47:04.472 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:47:04.472 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:47:04.472 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:47:04.472 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:47:04.472 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:47:04.472 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:47:04.472 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:47:04.473 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:47:04.473 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:47:04.473 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:47:04.473 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.473 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.473 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6813", 2024-09-12T02:47:04.473 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:47:04.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.473 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.473 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6814", 2024-09-12T02:47:04.473 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:47:04.473 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.474 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.474 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:47:04.474 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.474 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.474 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6816", 2024-09-12T02:47:04.474 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:47:04.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.474 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.474 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6818", 2024-09-12T02:47:04.474 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:47:04.474 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.475 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.475 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:47:04.475 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.475 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.475 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6822", 2024-09-12T02:47:04.475 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:47:04.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.475 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.475 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6823", 2024-09-12T02:47:04.475 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:47:04.475 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.475 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.476 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:47:04.476 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.476 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.476 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6820", 2024-09-12T02:47:04.476 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:47:04.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.476 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.476 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6821", 2024-09-12T02:47:04.476 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:47:04.477 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.477 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.477 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6814/3738813293", 2024-09-12T02:47:04.477 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6818/3738813293", 2024-09-12T02:47:04.477 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6823/3738813293", 2024-09-12T02:47:04.477 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6821/3738813293", 2024-09-12T02:47:04.477 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:47:04.477 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:47:04.477 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:47:04.477 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.477 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:47:04.478 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:47:04.478 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:47:04.478 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:47:04.478 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:47:04.478 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:47:04.478 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:47:04.478 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:47:04.478 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:47:04.478 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:47:04.478 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:47:04.478 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:47:04.478 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:47:04.478 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.479 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.479 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6824", 2024-09-12T02:47:04.479 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:47:04.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.479 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.479 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6825", 2024-09-12T02:47:04.479 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:47:04.479 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.479 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.479 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:47:04.479 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.480 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.480 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6826", 2024-09-12T02:47:04.480 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:47:04.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.481 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.481 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6827", 2024-09-12T02:47:04.481 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:47:04.481 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.481 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.481 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:47:04.481 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.482 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.482 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6830", 2024-09-12T02:47:04.482 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:47:04.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.482 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.482 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6831", 2024-09-12T02:47:04.482 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:47:04.482 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.482 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.483 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:47:04.483 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:04.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.483 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:04.483 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6828", 2024-09-12T02:47:04.483 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:47:04.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.483 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:04.483 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6829", 2024-09-12T02:47:04.484 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:47:04.484 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.484 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.484 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6825/1421932609", 2024-09-12T02:47:04.484 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6827/1421932609", 2024-09-12T02:47:04.484 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6831/1421932609", 2024-09-12T02:47:04.484 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6829/1421932609", 2024-09-12T02:47:04.484 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:47:04.484 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull", 2024-09-12T02:47:04.484 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:47:04.484 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:47:04.484 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.484 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.485 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:47:04.485 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_xinfo": [ 2024-09-12T02:47:04.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.485 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:47:04.485 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:47:04.485 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:47:04.485 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:47:04.485 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:47:04.485 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:47:04.485 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.220641+0000", 2024-09-12T02:47:04.485 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:47:04.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.485 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:47:04.486 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:47:04.486 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:47:04.486 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:47:04.486 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:47:04.486 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:47:04.486 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312574+0000", 2024-09-12T02:47:04.486 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:47:04.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.486 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:47:04.486 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:47:04.486 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:47:04.486 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:47:04.486 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:47:04.487 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:47:04.487 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.282771+0000", 2024-09-12T02:47:04.487 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:47:04.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.487 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:47:04.487 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:47:04.487 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:47:04.487 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:47:04.487 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:47:04.487 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:47:04.487 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.260478+0000", 2024-09-12T02:47:04.487 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:47:04.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.488 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:47:04.488 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:47:04.488 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:47:04.488 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:47:04.488 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:47:04.488 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:47:04.488 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.273397+0000", 2024-09-12T02:47:04.488 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:47:04.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.488 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:47:04.488 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:47:04.488 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:47:04.489 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:47:04.489 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:47:04.489 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:47:04.489 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312452+0000", 2024-09-12T02:47:04.489 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:47:04.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.489 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:47:04.489 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:47:04.489 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:47:04.489 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:47:04.489 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:47:04.489 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:47:04.489 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.308965+0000", 2024-09-12T02:47:04.489 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:47:04.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.490 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:47:04.490 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:47:04.490 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:47:04.490 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:47:04.490 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:47:04.490 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:47:04.490 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.337842+0000", 2024-09-12T02:47:04.490 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:47:04.490 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.490 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:47:04.490 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap": [], 2024-09-12T02:47:04.490 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_items": [ 2024-09-12T02:47:04.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.491 INFO:teuthology.orchestra.run.smithi112.stdout: "pgid": "13.2a", 2024-09-12T02:47:04.491 INFO:teuthology.orchestra.run.smithi112.stdout: "mappings": [ 2024-09-12T02:47:04.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:04.491 INFO:teuthology.orchestra.run.smithi112.stdout: "from": 1, 2024-09-12T02:47:04.491 INFO:teuthology.orchestra.run.smithi112.stdout: "to": 3 2024-09-12T02:47:04.491 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.491 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:04.491 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.491 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:47:04.491 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_primaries": [], 2024-09-12T02:47:04.491 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_temp": [], 2024-09-12T02:47:04.491 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_temp": [], 2024-09-12T02:47:04.491 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklist": {}, 2024-09-12T02:47:04.491 INFO:teuthology.orchestra.run.smithi112.stdout: "range_blocklist": {}, 2024-09-12T02:47:04.492 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profiles": { 2024-09-12T02:47:04.492 INFO:teuthology.orchestra.run.smithi112.stdout: "default": { 2024-09-12T02:47:04.492 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-failure-domain": "osd", 2024-09-12T02:47:04.492 INFO:teuthology.orchestra.run.smithi112.stdout: "k": "2", 2024-09-12T02:47:04.492 INFO:teuthology.orchestra.run.smithi112.stdout: "m": "1", 2024-09-12T02:47:04.492 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin": "jerasure", 2024-09-12T02:47:04.492 INFO:teuthology.orchestra.run.smithi112.stdout: "technique": "reed_sol_van" 2024-09-12T02:47:04.492 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:04.492 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps_queue": [], 2024-09-12T02:47:04.492 INFO:teuthology.orchestra.run.smithi112.stdout: "new_removed_snaps": [], 2024-09-12T02:47:04.492 INFO:teuthology.orchestra.run.smithi112.stdout: "new_purged_snaps": [], 2024-09-12T02:47:04.492 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_node_flags": {}, 2024-09-12T02:47:04.492 INFO:teuthology.orchestra.run.smithi112.stdout: "device_class_flags": {}, 2024-09-12T02:47:04.493 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode": { 2024-09-12T02:47:04.493 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_enabled": false, 2024-09-12T02:47:04.493 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_bucket_count": 0, 2024-09-12T02:47:04.493 INFO:teuthology.orchestra.run.smithi112.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:47:04.493 INFO:teuthology.orchestra.run.smithi112.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:47:04.493 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_bucket": 0 2024-09-12T02:47:04.493 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:04.493 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:47:04.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.412+0000 7f2012c00640 1 -- 172.21.15.112:0/1221274212 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1fec06be30 msgr2=0x7f1fec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:04.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.412+0000 7f2012c00640 1 --2- 172.21.15.112:0/1221274212 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1fec06be30 0x7f1fec06e2f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f200c1f6090 tx=0x7f1ff8009110 comp rx=0 tx=0).stop 2024-09-12T02:47:04.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.412+0000 7f2012c00640 1 -- 172.21.15.112:0/1221274212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f200c071530 msgr2=0x7f200c1f2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:04.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.412+0000 7f2012c00640 1 --2- 172.21.15.112:0/1221274212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f200c071530 0x7f200c1f2370 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc007fd0 tx=0x7f1ffc00c9b0 comp rx=0 tx=0).stop 2024-09-12T02:47:04.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.412+0000 7f2012c00640 1 -- 172.21.15.112:0/1221274212 shutdown_connections 2024-09-12T02:47:04.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.412+0000 7f2012c00640 1 --2- 172.21.15.112:0/1221274212 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f200c15cc50 0x7f200c140420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:04.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.412+0000 7f2012c00640 1 --2- 172.21.15.112:0/1221274212 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1fec06be30 0x7f1fec06e2f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:04.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.412+0000 7f2012c00640 1 --2- 172.21.15.112:0/1221274212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f200c071970 0x7f200c1e6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:04.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.412+0000 7f2012c00640 1 --2- 172.21.15.112:0/1221274212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f200c071530 0x7f200c1f2370 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:04.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.412+0000 7f2012c00640 1 -- 172.21.15.112:0/1221274212 >> 172.21.15.112:0/1221274212 conn(0x7f200c06bbd0 msgr2=0x7f200c0732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:04.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.412+0000 7f2012c00640 1 -- 172.21.15.112:0/1221274212 shutdown_connections 2024-09-12T02:47:04.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:04.412+0000 7f2012c00640 1 -- 172.21.15.112:0/1221274212 wait complete. 2024-09-12T02:47:04.496 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-12T02:47:09.497 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-12T02:47:09.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.660+0000 7fbc94c00640 1 Processor -- start 2024-09-12T02:47:09.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.660+0000 7fbc94c00640 1 -- start start 2024-09-12T02:47:09.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.662+0000 7fbc94c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbc9006f600 0x7fbc900b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:09.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.662+0000 7fbc94c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc900b4a20 con 0x7fbc9015b9d0 2024-09-12T02:47:09.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.662+0000 7fbc94c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc900b54a0 con 0x7fbc900b45d0 2024-09-12T02:47:09.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.662+0000 7fbc94c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbc900b3af0 con 0x7fbc9006f600 2024-09-12T02:47:09.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.662+0000 7fbc8de00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fbc9015b9d0 0x7fbc9006eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33028/0 (socket says 172.21.15.112:33028) 2024-09-12T02:47:09.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.662+0000 7fbc8de00640 1 -- 172.21.15.112:0/2924716122 learned_addr learned my addr 172.21.15.112:0/2924716122 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:09.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.662+0000 7fbc85400640 1 --2- 172.21.15.112:0/2924716122 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbc9006f600 0x7fbc900b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:09.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.662+0000 7fbc8d400640 1 -- 172.21.15.112:0/2924716122 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1860984490 0 0) 0x7fbc900b4a20 con 0x7fbc9015b9d0 2024-09-12T02:47:09.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.662+0000 7fbc8d400640 1 -- 172.21.15.112:0/2924716122 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc74003520 con 0x7fbc9015b9d0 2024-09-12T02:47:09.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.663+0000 7fbc85400640 1 -- 172.21.15.112:0/2924716122 >> v1:172.21.15.137:6789/0 conn(0x7fbc900b45d0 legacy=0x7fbc900cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:09.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.663+0000 7fbc8d400640 1 -- 172.21.15.112:0/2924716122 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2118694382 0 0) 0x7fbc900b54a0 con 0x7fbc900b45d0 2024-09-12T02:47:09.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.663+0000 7fbc85400640 1 -- 172.21.15.112:0/2924716122 >> v1:172.21.15.112:6789/0 conn(0x7fbc9015b9d0 legacy=0x7fbc9006eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:09.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.663+0000 7fbc85400640 1 -- 172.21.15.112:0/2924716122 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc900b3dd0 con 0x7fbc9006f600 2024-09-12T02:47:09.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.664+0000 7fbc85400640 1 --2- 172.21.15.112:0/2924716122 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbc9006f600 0x7fbc900b4ec0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbc780097c0 tx=0x7fbc7802a160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5ad448cae2cbf4e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:09.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.664+0000 7fbc8d400640 1 -- 172.21.15.112:0/2924716122 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc78037070 con 0x7fbc9006f600 2024-09-12T02:47:09.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.664+0000 7fbc8d400640 1 -- 172.21.15.112:0/2924716122 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc7802abf0 con 0x7fbc9006f600 2024-09-12T02:47:09.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.664+0000 7fbc8d400640 1 -- 172.21.15.112:0/2924716122 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80001670 con 0x7fbc9006f600 2024-09-12T02:47:09.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.665+0000 7fbc94c00640 1 -- 172.21.15.112:0/2924716122 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbc9006f600 msgr2=0x7fbc900b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:09.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.665+0000 7fbc94c00640 1 --2- 172.21.15.112:0/2924716122 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbc9006f600 0x7fbc900b4ec0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbc780097c0 tx=0x7fbc7802a160 comp rx=0 tx=0).stop 2024-09-12T02:47:09.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.665+0000 7fbc94c00640 1 -- 172.21.15.112:0/2924716122 shutdown_connections 2024-09-12T02:47:09.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.665+0000 7fbc94c00640 1 --2- 172.21.15.112:0/2924716122 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbc9006f600 0x7fbc900b4ec0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:09.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.665+0000 7fbc94c00640 1 -- 172.21.15.112:0/2924716122 >> 172.21.15.112:0/2924716122 conn(0x7fbc9006bbd0 msgr2=0x7fbc9006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:09.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.665+0000 7fbc94c00640 1 -- 172.21.15.112:0/2924716122 shutdown_connections 2024-09-12T02:47:09.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.665+0000 7fbc94c00640 1 -- 172.21.15.112:0/2924716122 wait complete. 2024-09-12T02:47:09.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.666+0000 7fbc94c00640 1 Processor -- start 2024-09-12T02:47:09.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.666+0000 7fbc94c00640 1 -- start start 2024-09-12T02:47:09.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.667+0000 7fbc94c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc9006f600 0x7fbc9015e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:09.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.667+0000 7fbc94c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc900b45d0 0x7fbc9015ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:09.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.667+0000 7fbc94c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbc9015b9d0 0x7fbc9014fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:09.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.667+0000 7fbc94c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9015bf30 con 0x7fbc900b45d0 2024-09-12T02:47:09.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.667+0000 7fbc94c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9015bdb0 con 0x7fbc9006f600 2024-09-12T02:47:09.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.667+0000 7fbc94c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbc900728c0 con 0x7fbc9015b9d0 2024-09-12T02:47:09.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.668+0000 7fbc85400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc900b45d0 0x7fbc9015ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:09.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.668+0000 7fbc85400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc900b45d0 0x7fbc9015ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48430/0 (socket says 172.21.15.112:48430) 2024-09-12T02:47:09.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.668+0000 7fbc85400640 1 -- 172.21.15.112:0/3062316294 learned_addr learned my addr 172.21.15.112:0/3062316294 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:09.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.668+0000 7fbc8de00640 1 --2- 172.21.15.112:0/3062316294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc9006f600 0x7fbc9015e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:09.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.668+0000 7fbc8e800640 1 --2- 172.21.15.112:0/3062316294 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbc9015b9d0 0x7fbc9014fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:09.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.668+0000 7fbc85400640 1 -- 172.21.15.112:0/3062316294 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbc9015b9d0 msgr2=0x7fbc9014fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:09.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.668+0000 7fbc85400640 1 --2- 172.21.15.112:0/3062316294 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbc9015b9d0 0x7fbc9014fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:09.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.668+0000 7fbc85400640 1 -- 172.21.15.112:0/3062316294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc9006f600 msgr2=0x7fbc9015e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:09.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.668+0000 7fbc85400640 1 --2- 172.21.15.112:0/3062316294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc9006f600 0x7fbc9015e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:09.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.668+0000 7fbc85400640 1 -- 172.21.15.112:0/3062316294 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc9015b0c0 con 0x7fbc900b45d0 2024-09-12T02:47:09.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.668+0000 7fbc8de00640 1 --2- 172.21.15.112:0/3062316294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc9006f600 0x7fbc9015e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:09.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.669+0000 7fbc85400640 1 --2- 172.21.15.112:0/3062316294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc900b45d0 0x7fbc9015ab80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fbc78035040 tx=0x7fbc780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:09.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.669+0000 7fbc86a00640 1 -- 172.21.15.112:0/3062316294 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc78037040 con 0x7fbc900b45d0 2024-09-12T02:47:09.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.669+0000 7fbc86a00640 1 -- 172.21.15.112:0/3062316294 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc78004020 con 0x7fbc900b45d0 2024-09-12T02:47:09.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.669+0000 7fbc86a00640 1 -- 172.21.15.112:0/3062316294 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc78006db0 con 0x7fbc900b45d0 2024-09-12T02:47:09.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.669+0000 7fbc94c00640 1 -- 172.21.15.112:0/3062316294 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc90150120 con 0x7fbc900b45d0 2024-09-12T02:47:09.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.669+0000 7fbc94c00640 1 -- 172.21.15.112:0/3062316294 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc901594b0 con 0x7fbc900b45d0 2024-09-12T02:47:09.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.670+0000 7fbc94c00640 1 -- 172.21.15.112:0/3062316294 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc90068a30 con 0x7fbc900b45d0 2024-09-12T02:47:09.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.671+0000 7fbc86a00640 1 -- 172.21.15.112:0/3062316294 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc7803a040 con 0x7fbc900b45d0 2024-09-12T02:47:09.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.672+0000 7fbc86a00640 1 --2- 172.21.15.112:0/3062316294 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbc6c06be60 0x7fbc6c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:09.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.672+0000 7fbc86a00640 1 -- 172.21.15.112:0/3062316294 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5738+0+0 (secure 0 0 0) 0x7fbc780ab1f0 con 0x7fbc900b45d0 2024-09-12T02:47:09.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.672+0000 7fbc8de00640 1 --2- 172.21.15.112:0/3062316294 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbc6c06be60 0x7fbc6c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:09.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.672+0000 7fbc8de00640 1 --2- 172.21.15.112:0/3062316294 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbc6c06be60 0x7fbc6c06e320 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbc80007060 tx=0x7fbc80001dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:09.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.676+0000 7fbc86a00640 1 -- 172.21.15.112:0/3062316294 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbc7804b030 con 0x7fbc900b45d0 2024-09-12T02:47:09.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.850+0000 7fbc94c00640 1 -- 172.21.15.112:0/3062316294 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fbc90072c70 con 0x7fbc900b45d0 2024-09-12T02:47:09.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.851+0000 7fbc86a00640 1 -- 172.21.15.112:0/3062316294 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v109) ==== 81+0+34495 (secure 0 0 0) 0x7fbc78042030 con 0x7fbc900b45d0 2024-09-12T02:47:09.853 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:09.853 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:47:09.853 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 109, 2024-09-12T02:47:09.853 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:47:09.853 INFO:teuthology.orchestra.run.smithi112.stdout: "created": "2024-09-12T02:41:36.162095+0000", 2024-09-12T02:47:09.853 INFO:teuthology.orchestra.run.smithi112.stdout: "modified": "2024-09-12T02:47:05.174500+0000", 2024-09-12T02:47:09.853 INFO:teuthology.orchestra.run.smithi112.stdout: "last_up_change": "2024-09-12T02:41:42.191169+0000", 2024-09-12T02:47:09.854 INFO:teuthology.orchestra.run.smithi112.stdout: "last_in_change": "2024-09-12T02:41:39.036600+0000", 2024-09-12T02:47:09.854 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:47:09.854 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_num": 5799936, 2024-09-12T02:47:09.854 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_set": [ 2024-09-12T02:47:09.854 INFO:teuthology.orchestra.run.smithi112.stdout: "pglog_hardlimit", 2024-09-12T02:47:09.854 INFO:teuthology.orchestra.run.smithi112.stdout: "purged_snapdirs", 2024-09-12T02:47:09.854 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_deletes", 2024-09-12T02:47:09.854 INFO:teuthology.orchestra.run.smithi112.stdout: "sortbitwise" 2024-09-12T02:47:09.854 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:47:09.854 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_version": 4, 2024-09-12T02:47:09.854 INFO:teuthology.orchestra.run.smithi112.stdout: "full_ratio": 0.69999998807907104, 2024-09-12T02:47:09.854 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-12T02:47:09.854 INFO:teuthology.orchestra.run.smithi112.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-12T02:47:09.855 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_snapshot": "", 2024-09-12T02:47:09.855 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_max": 13, 2024-09-12T02:47:09.855 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd": 8, 2024-09-12T02:47:09.855 INFO:teuthology.orchestra.run.smithi112.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:47:09.855 INFO:teuthology.orchestra.run.smithi112.stdout: "min_compat_client": "luminous", 2024-09-12T02:47:09.855 INFO:teuthology.orchestra.run.smithi112.stdout: "require_osd_release": "squid", 2024-09-12T02:47:09.855 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_crimson": false, 2024-09-12T02:47:09.855 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-12T02:47:09.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.855 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 1, 2024-09-12T02:47:09.855 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": ".mgr", 2024-09-12T02:47:09.855 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:41:43.011599+0000", 2024-09-12T02:47:09.855 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:47:09.855 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:47:09.856 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:47:09.856 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:47:09.856 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:47:09.856 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:47:09.856 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:47:09.856 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:47:09.856 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:47:09.856 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:47:09.856 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:47:09.856 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:47:09.856 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:47:09.856 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 1, 2024-09-12T02:47:09.856 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 1, 2024-09-12T02:47:09.856 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 1, 2024-09-12T02:47:09.857 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 1, 2024-09-12T02:47:09.857 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 1, 2024-09-12T02:47:09.857 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:47:09.857 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:47:09.857 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:47:09.857 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:47:09.857 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:47:09.857 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:47:09.857 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:47:09.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.857 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "109", 2024-09-12T02:47:09.857 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:47:09.857 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:47:09.858 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:47:09.858 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:47:09.858 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:47:09.858 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:47:09.858 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:47:09.858 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:47:09.858 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:47:09.858 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:47:09.858 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:47:09.858 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:47:09.858 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:47:09.858 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:47:09.858 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:47:09.858 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:47:09.859 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:47:09.859 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:47:09.859 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:47:09.859 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:47:09.859 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:47:09.859 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:47:09.859 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:47:09.859 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:47:09.859 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:47:09.859 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:47:09.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.859 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:47:09.859 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:47:09.859 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:47:09.860 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:47:09.860 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:47:09.860 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:47:09.860 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:47:09.860 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:47:09.860 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:47:09.860 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:47:09.860 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:47:09.860 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:47:09.860 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_max": 32, 2024-09-12T02:47:09.860 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 1 2024-09-12T02:47:09.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.860 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:47:09.860 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": {} 2024-09-12T02:47:09.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.861 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:47:09.861 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:47:09.861 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 8, 2024-09-12T02:47:09.861 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 8, 2024-09-12T02:47:09.861 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 0.25, 2024-09-12T02:47:09.861 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:47:09.861 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:47:09.861 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:47:09.861 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:47:09.861 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:47:09.861 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.862 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 12, 2024-09-12T02:47:09.862 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:47:09.862 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:46:34.392830+0000", 2024-09-12T02:47:09.862 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:47:09.862 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:47:09.862 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:47:09.862 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:47:09.862 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:47:09.862 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:47:09.862 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:47:09.862 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:47:09.862 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:47:09.862 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:47:09.862 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:47:09.863 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:47:09.863 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:47:09.863 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 32, 2024-09-12T02:47:09.863 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 32, 2024-09-12T02:47:09.863 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 32, 2024-09-12T02:47:09.863 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 32, 2024-09-12T02:47:09.863 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 32, 2024-09-12T02:47:09.863 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:47:09.863 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:47:09.863 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:47:09.863 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:47:09.863 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:47:09.863 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:47:09.864 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:47:09.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.864 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "109", 2024-09-12T02:47:09.864 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:47:09.864 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:47:09.864 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:47:09.864 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:47:09.864 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:47:09.864 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:47:09.864 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:47:09.864 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:47:09.864 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:47:09.864 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:47:09.864 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:47:09.865 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:47:09.865 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:47:09.865 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:47:09.865 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:47:09.865 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:47:09.865 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:47:09.865 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:47:09.865 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:47:09.865 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:47:09.865 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:47:09.865 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:47:09.865 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:47:09.865 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:47:09.865 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:47:09.866 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:47:09.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.866 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:47:09.866 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:47:09.866 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:47:09.866 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:47:09.866 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:47:09.866 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:47:09.866 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:47:09.866 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:47:09.866 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:47:09.866 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:47:09.866 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:47:09.867 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:47:09.867 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:47:09.867 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 16, 2024-09-12T02:47:09.867 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_priority": 5 2024-09-12T02:47:09.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.867 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:47:09.867 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:47:09.867 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": "cephfs" 2024-09-12T02:47:09.867 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.867 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:47:09.867 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:47:09.867 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 2, 2024-09-12T02:47:09.867 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 2, 2024-09-12T02:47:09.868 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:47:09.868 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:47:09.868 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:47:09.868 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:47:09.868 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:47:09.868 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:47:09.868 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.868 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 13, 2024-09-12T02:47:09.868 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_data", 2024-09-12T02:47:09.868 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:46:35.615193+0000", 2024-09-12T02:47:09.868 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:47:09.869 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:47:09.869 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:47:09.869 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:47:09.869 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:47:09.869 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:47:09.869 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:47:09.869 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:47:09.869 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:47:09.869 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:47:09.869 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:47:09.869 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:47:09.869 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:47:09.869 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 64, 2024-09-12T02:47:09.869 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 64, 2024-09-12T02:47:09.870 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 64, 2024-09-12T02:47:09.870 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 64, 2024-09-12T02:47:09.870 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 64, 2024-09-12T02:47:09.870 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:47:09.870 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:47:09.870 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:47:09.870 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:47:09.870 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:47:09.870 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:47:09.870 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:47:09.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.870 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "109", 2024-09-12T02:47:09.870 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:47:09.870 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:47:09.871 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:47:09.871 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:47:09.871 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:47:09.871 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:47:09.871 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:47:09.871 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:47:09.871 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:47:09.871 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:47:09.871 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:47:09.871 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:47:09.871 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:47:09.871 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:47:09.871 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:47:09.872 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:47:09.872 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:47:09.872 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:47:09.872 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:47:09.872 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:47:09.872 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:47:09.872 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:47:09.872 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:47:09.872 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:47:09.872 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:47:09.872 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:47:09.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.872 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:47:09.873 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:47:09.873 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:47:09.873 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:47:09.873 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:47:09.873 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:47:09.873 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:47:09.873 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:47:09.873 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:47:09.873 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:47:09.873 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:47:09.873 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:47:09.873 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 64, 2024-09-12T02:47:09.874 INFO:teuthology.orchestra.run.smithi112.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:47:09.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.874 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:47:09.874 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:47:09.874 INFO:teuthology.orchestra.run.smithi112.stdout: "data": "cephfs" 2024-09-12T02:47:09.874 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.874 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:47:09.874 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:47:09.874 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.3799999952316284, 2024-09-12T02:47:09.874 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.3799999952316284, 2024-09-12T02:47:09.874 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:47:09.874 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-12T02:47:09.874 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-12T02:47:09.875 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:47:09.875 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:47:09.875 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:47:09.875 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.875 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.875 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:47:09.875 INFO:teuthology.orchestra.run.smithi112.stdout: "osds": [ 2024-09-12T02:47:09.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.875 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:47:09.875 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:47:09.875 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:47:09.875 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:47:09.875 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:47:09.876 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:47:09.876 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:47:09.876 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:47:09.876 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:47:09.876 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:47:09.876 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:47:09.876 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:47:09.876 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:47:09.876 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.876 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.876 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6800", 2024-09-12T02:47:09.876 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:47:09.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.877 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.877 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6801", 2024-09-12T02:47:09.877 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:47:09.877 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.877 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.877 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:47:09.877 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.877 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.877 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6802", 2024-09-12T02:47:09.877 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:47:09.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.878 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.878 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6803", 2024-09-12T02:47:09.878 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:47:09.878 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.878 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.878 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:47:09.878 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.878 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.878 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6806", 2024-09-12T02:47:09.878 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:47:09.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.878 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.879 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6807", 2024-09-12T02:47:09.879 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:47:09.879 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.879 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.879 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:47:09.879 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.879 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.879 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6804", 2024-09-12T02:47:09.879 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:47:09.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.879 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.880 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6805", 2024-09-12T02:47:09.880 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:47:09.880 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.880 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.880 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6801/821571304", 2024-09-12T02:47:09.880 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6803/821571304", 2024-09-12T02:47:09.880 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6807/821571304", 2024-09-12T02:47:09.880 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6805/821571304", 2024-09-12T02:47:09.880 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:47:09.880 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:47:09.880 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:47:09.880 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.881 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:47:09.881 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:47:09.881 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:47:09.881 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:47:09.881 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:47:09.881 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:47:09.881 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:47:09.881 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:47:09.881 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:47:09.881 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:47:09.882 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:47:09.882 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:47:09.882 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:47:09.882 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.882 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.882 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6808", 2024-09-12T02:47:09.882 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:47:09.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.882 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.882 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6809", 2024-09-12T02:47:09.882 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:47:09.882 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.882 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.883 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:47:09.883 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.883 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.883 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6810", 2024-09-12T02:47:09.883 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:47:09.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.884 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.884 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6811", 2024-09-12T02:47:09.884 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:47:09.884 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.884 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.884 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:47:09.884 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.884 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.885 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6814", 2024-09-12T02:47:09.885 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:47:09.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.885 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.885 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6815", 2024-09-12T02:47:09.885 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:47:09.885 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.885 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.886 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:47:09.886 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.886 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.886 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6812", 2024-09-12T02:47:09.886 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:47:09.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.886 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.886 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6813", 2024-09-12T02:47:09.886 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:47:09.886 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.886 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.887 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6809/2642068641", 2024-09-12T02:47:09.887 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6811/2642068641", 2024-09-12T02:47:09.887 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6815/2642068641", 2024-09-12T02:47:09.887 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6813/2642068641", 2024-09-12T02:47:09.887 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:47:09.887 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:47:09.887 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:47:09.887 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.887 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:47:09.887 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:47:09.887 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:47:09.887 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:47:09.888 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:47:09.888 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:47:09.888 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:47:09.888 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:47:09.888 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:47:09.888 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:47:09.888 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:47:09.888 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:47:09.888 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:47:09.888 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.888 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.888 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6816", 2024-09-12T02:47:09.888 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:47:09.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.889 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.889 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6817", 2024-09-12T02:47:09.889 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:47:09.889 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.889 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.889 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:47:09.889 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.889 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.889 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6818", 2024-09-12T02:47:09.890 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:47:09.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.890 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.890 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6819", 2024-09-12T02:47:09.890 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:47:09.890 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.890 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.890 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:47:09.890 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.890 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.890 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6822", 2024-09-12T02:47:09.891 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:47:09.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.891 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.891 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6823", 2024-09-12T02:47:09.891 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:47:09.891 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.891 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.891 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:47:09.891 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.891 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.892 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6820", 2024-09-12T02:47:09.892 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:47:09.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.892 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.892 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6821", 2024-09-12T02:47:09.892 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:47:09.892 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.892 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.892 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6817/3365688807", 2024-09-12T02:47:09.892 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6819/3365688807", 2024-09-12T02:47:09.892 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6823/3365688807", 2024-09-12T02:47:09.892 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6821/3365688807", 2024-09-12T02:47:09.893 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:47:09.893 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:47:09.893 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:47:09.893 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.893 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:47:09.893 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:47:09.893 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:47:09.893 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:47:09.893 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:47:09.893 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:47:09.893 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:47:09.893 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:47:09.894 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:47:09.894 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 98, 2024-09-12T02:47:09.894 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:47:09.894 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:47:09.894 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:47:09.894 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.894 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.894 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6824", 2024-09-12T02:47:09.894 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:47:09.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.895 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.895 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6825", 2024-09-12T02:47:09.895 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:47:09.895 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.895 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.895 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:47:09.895 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.895 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.895 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6826", 2024-09-12T02:47:09.896 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:47:09.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.896 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.896 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6827", 2024-09-12T02:47:09.896 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:47:09.896 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.896 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.896 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:47:09.896 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.896 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.897 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6830", 2024-09-12T02:47:09.897 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:47:09.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.897 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.897 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6831", 2024-09-12T02:47:09.897 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:47:09.897 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.897 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.897 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:47:09.897 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.898 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.898 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6828", 2024-09-12T02:47:09.898 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:47:09.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.898 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.898 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6829", 2024-09-12T02:47:09.898 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:47:09.898 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.898 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.899 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6825/231774278", 2024-09-12T02:47:09.899 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6827/231774278", 2024-09-12T02:47:09.899 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6831/231774278", 2024-09-12T02:47:09.899 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6829/231774278", 2024-09-12T02:47:09.899 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:47:09.899 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:47:09.899 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:47:09.899 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.900 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:47:09.900 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:47:09.900 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:47:09.900 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:47:09.900 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:47:09.900 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:47:09.901 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:47:09.901 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:47:09.901 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:47:09.901 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:47:09.901 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:47:09.901 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:47:09.901 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:47:09.902 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.902 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.902 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6800", 2024-09-12T02:47:09.902 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:47:09.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.903 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.903 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6801", 2024-09-12T02:47:09.903 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:47:09.903 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.903 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.904 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:47:09.904 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.904 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.904 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6802", 2024-09-12T02:47:09.904 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:47:09.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.905 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.905 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6803", 2024-09-12T02:47:09.905 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:47:09.905 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.905 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.906 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:47:09.906 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.906 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.906 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6806", 2024-09-12T02:47:09.907 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:47:09.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.907 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.907 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6807", 2024-09-12T02:47:09.907 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:47:09.908 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.908 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.908 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:47:09.908 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.909 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.909 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6804", 2024-09-12T02:47:09.909 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:47:09.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.910 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.910 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6805", 2024-09-12T02:47:09.910 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:47:09.910 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.910 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.910 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6801/3671178153", 2024-09-12T02:47:09.911 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6803/3671178153", 2024-09-12T02:47:09.911 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6807/3671178153", 2024-09-12T02:47:09.911 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6805/3671178153", 2024-09-12T02:47:09.911 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:47:09.911 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:47:09.911 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:47:09.912 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.912 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:47:09.912 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:47:09.913 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:47:09.913 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:47:09.913 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:47:09.913 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:47:09.913 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:47:09.913 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:47:09.913 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:47:09.914 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:47:09.914 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:47:09.914 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:47:09.914 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:47:09.914 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.915 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.915 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6808", 2024-09-12T02:47:09.915 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:47:09.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.915 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.916 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6809", 2024-09-12T02:47:09.916 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:47:09.916 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.916 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.917 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:47:09.917 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.917 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.917 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6810", 2024-09-12T02:47:09.917 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:47:09.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.918 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.918 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6811", 2024-09-12T02:47:09.918 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:47:09.918 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.919 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.919 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:47:09.919 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.920 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.920 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6817", 2024-09-12T02:47:09.920 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:47:09.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.920 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.921 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6819", 2024-09-12T02:47:09.921 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:47:09.921 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.921 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.921 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:47:09.921 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.922 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.922 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6812", 2024-09-12T02:47:09.922 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:47:09.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.922 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.922 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6815", 2024-09-12T02:47:09.922 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:47:09.922 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.922 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.922 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6809/3193706134", 2024-09-12T02:47:09.922 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6811/3193706134", 2024-09-12T02:47:09.922 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6819/3193706134", 2024-09-12T02:47:09.923 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6815/3193706134", 2024-09-12T02:47:09.923 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:47:09.923 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:47:09.923 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:47:09.923 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.923 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:47:09.923 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:47:09.923 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:47:09.923 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:47:09.923 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:47:09.923 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:47:09.924 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:47:09.924 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:47:09.924 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:47:09.924 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:47:09.924 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:47:09.924 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:47:09.924 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:47:09.924 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.924 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.924 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6813", 2024-09-12T02:47:09.924 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:47:09.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.924 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.925 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6814", 2024-09-12T02:47:09.925 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:47:09.925 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.925 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.925 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:47:09.925 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.925 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.925 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6816", 2024-09-12T02:47:09.925 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:47:09.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.925 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.926 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6818", 2024-09-12T02:47:09.926 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:47:09.926 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.926 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.926 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:47:09.926 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.926 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.926 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6822", 2024-09-12T02:47:09.926 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:47:09.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.926 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.926 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6823", 2024-09-12T02:47:09.927 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:47:09.927 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.927 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.927 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:47:09.927 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.927 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.927 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6820", 2024-09-12T02:47:09.927 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:47:09.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.927 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.927 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6821", 2024-09-12T02:47:09.927 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:47:09.928 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.928 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.928 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6814/3738813293", 2024-09-12T02:47:09.928 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6818/3738813293", 2024-09-12T02:47:09.928 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6823/3738813293", 2024-09-12T02:47:09.928 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6821/3738813293", 2024-09-12T02:47:09.928 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:47:09.928 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:47:09.928 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:47:09.928 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.929 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:47:09.929 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:47:09.929 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:47:09.929 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:47:09.929 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:47:09.929 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:47:09.929 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:47:09.929 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:47:09.929 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:47:09.929 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:47:09.929 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:47:09.929 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:47:09.929 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:47:09.929 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.930 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.930 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6824", 2024-09-12T02:47:09.930 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:47:09.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.930 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.930 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6825", 2024-09-12T02:47:09.930 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:47:09.930 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.930 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.930 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:47:09.930 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.930 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.931 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6826", 2024-09-12T02:47:09.931 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:47:09.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.931 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.931 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6827", 2024-09-12T02:47:09.931 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:47:09.931 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.931 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.931 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:47:09.931 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.931 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.932 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6830", 2024-09-12T02:47:09.932 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:47:09.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.932 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.932 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6831", 2024-09-12T02:47:09.933 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:47:09.933 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.933 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.934 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:47:09.934 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:09.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.934 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:09.934 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6828", 2024-09-12T02:47:09.934 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:47:09.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.934 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:09.934 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6829", 2024-09-12T02:47:09.934 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:47:09.935 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.935 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.935 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6825/1421932609", 2024-09-12T02:47:09.935 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6827/1421932609", 2024-09-12T02:47:09.935 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6831/1421932609", 2024-09-12T02:47:09.935 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6829/1421932609", 2024-09-12T02:47:09.935 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:47:09.935 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:47:09.935 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:47:09.935 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.935 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.935 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:47:09.935 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_xinfo": [ 2024-09-12T02:47:09.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.936 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:47:09.936 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:47:09.936 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:47:09.936 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:47:09.936 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:47:09.936 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:47:09.936 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.220641+0000", 2024-09-12T02:47:09.936 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:47:09.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.936 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:47:09.936 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:47:09.936 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:47:09.937 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:47:09.937 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:47:09.937 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:47:09.937 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312574+0000", 2024-09-12T02:47:09.937 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:47:09.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.937 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:47:09.937 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:47:09.937 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:47:09.937 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:47:09.937 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:47:09.937 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:47:09.937 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.282771+0000", 2024-09-12T02:47:09.937 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:47:09.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.938 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:47:09.938 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:47:09.938 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:47:09.938 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:47:09.938 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:47:09.938 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:47:09.938 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.260478+0000", 2024-09-12T02:47:09.938 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:47:09.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.938 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:47:09.938 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:47:09.939 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:47:09.939 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:47:09.939 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:47:09.939 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:47:09.939 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.273397+0000", 2024-09-12T02:47:09.939 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:47:09.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.939 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:47:09.939 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:47:09.939 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:47:09.939 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:47:09.939 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:47:09.939 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:47:09.940 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312452+0000", 2024-09-12T02:47:09.940 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:47:09.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.940 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:47:09.940 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:47:09.940 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:47:09.940 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:47:09.940 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:47:09.940 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:47:09.940 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.308965+0000", 2024-09-12T02:47:09.940 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:47:09.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.940 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:47:09.941 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:47:09.941 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:47:09.941 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:47:09.941 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:47:09.941 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:47:09.941 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.337842+0000", 2024-09-12T02:47:09.941 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:47:09.941 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.941 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:47:09.941 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap": [], 2024-09-12T02:47:09.941 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_items": [ 2024-09-12T02:47:09.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.941 INFO:teuthology.orchestra.run.smithi112.stdout: "pgid": "13.2a", 2024-09-12T02:47:09.941 INFO:teuthology.orchestra.run.smithi112.stdout: "mappings": [ 2024-09-12T02:47:09.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:09.942 INFO:teuthology.orchestra.run.smithi112.stdout: "from": 1, 2024-09-12T02:47:09.942 INFO:teuthology.orchestra.run.smithi112.stdout: "to": 3 2024-09-12T02:47:09.942 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.942 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:09.942 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.942 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:47:09.942 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_primaries": [], 2024-09-12T02:47:09.942 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_temp": [], 2024-09-12T02:47:09.942 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_temp": [], 2024-09-12T02:47:09.942 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklist": {}, 2024-09-12T02:47:09.942 INFO:teuthology.orchestra.run.smithi112.stdout: "range_blocklist": {}, 2024-09-12T02:47:09.942 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profiles": { 2024-09-12T02:47:09.942 INFO:teuthology.orchestra.run.smithi112.stdout: "default": { 2024-09-12T02:47:09.943 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-failure-domain": "osd", 2024-09-12T02:47:09.943 INFO:teuthology.orchestra.run.smithi112.stdout: "k": "2", 2024-09-12T02:47:09.943 INFO:teuthology.orchestra.run.smithi112.stdout: "m": "1", 2024-09-12T02:47:09.943 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin": "jerasure", 2024-09-12T02:47:09.943 INFO:teuthology.orchestra.run.smithi112.stdout: "technique": "reed_sol_van" 2024-09-12T02:47:09.943 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:09.943 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps_queue": [], 2024-09-12T02:47:09.943 INFO:teuthology.orchestra.run.smithi112.stdout: "new_removed_snaps": [], 2024-09-12T02:47:09.943 INFO:teuthology.orchestra.run.smithi112.stdout: "new_purged_snaps": [], 2024-09-12T02:47:09.943 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_node_flags": {}, 2024-09-12T02:47:09.943 INFO:teuthology.orchestra.run.smithi112.stdout: "device_class_flags": {}, 2024-09-12T02:47:09.943 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode": { 2024-09-12T02:47:09.943 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_enabled": false, 2024-09-12T02:47:09.943 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_bucket_count": 0, 2024-09-12T02:47:09.944 INFO:teuthology.orchestra.run.smithi112.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:47:09.944 INFO:teuthology.orchestra.run.smithi112.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:47:09.944 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_bucket": 0 2024-09-12T02:47:09.944 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:09.944 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:47:09.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.854+0000 7fbc94c00640 1 -- 172.21.15.112:0/3062316294 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbc6c06be60 msgr2=0x7fbc6c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:09.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.854+0000 7fbc94c00640 1 --2- 172.21.15.112:0/3062316294 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbc6c06be60 0x7fbc6c06e320 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbc80007060 tx=0x7fbc80001dc0 comp rx=0 tx=0).stop 2024-09-12T02:47:09.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.854+0000 7fbc94c00640 1 -- 172.21.15.112:0/3062316294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc900b45d0 msgr2=0x7fbc9015ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:09.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.854+0000 7fbc94c00640 1 --2- 172.21.15.112:0/3062316294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc900b45d0 0x7fbc9015ab80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fbc78035040 tx=0x7fbc780046c0 comp rx=0 tx=0).stop 2024-09-12T02:47:09.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.854+0000 7fbc94c00640 1 -- 172.21.15.112:0/3062316294 shutdown_connections 2024-09-12T02:47:09.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.854+0000 7fbc94c00640 1 --2- 172.21.15.112:0/3062316294 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbc9015b9d0 0x7fbc9014fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:09.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.854+0000 7fbc94c00640 1 --2- 172.21.15.112:0/3062316294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc900b45d0 0x7fbc9015ab80 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:09.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.854+0000 7fbc94c00640 1 --2- 172.21.15.112:0/3062316294 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbc6c06be60 0x7fbc6c06e320 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:09.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.854+0000 7fbc94c00640 1 --2- 172.21.15.112:0/3062316294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc9006f600 0x7fbc9015e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:09.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.854+0000 7fbc94c00640 1 -- 172.21.15.112:0/3062316294 >> 172.21.15.112:0/3062316294 conn(0x7fbc9006bbd0 msgr2=0x7fbc90071710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:09.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.854+0000 7fbc94c00640 1 -- 172.21.15.112:0/3062316294 shutdown_connections 2024-09-12T02:47:09.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:09.854+0000 7fbc94c00640 1 -- 172.21.15.112:0/3062316294 wait complete. 2024-09-12T02:47:09.947 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-12T02:47:09.947 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-12T02:47:10.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.099+0000 7f49c1400640 1 Processor -- start 2024-09-12T02:47:10.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.099+0000 7f49c1400640 1 -- start start 2024-09-12T02:47:10.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.101+0000 7f49c1400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f49bc15b9d0 0x7f49bc0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:10.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.101+0000 7f49c1400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49bc0b54a0 con 0x7f49bc06f600 2024-09-12T02:47:10.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.101+0000 7f49c1400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49bc0b3af0 con 0x7f49bc0b45d0 2024-09-12T02:47:10.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.101+0000 7f49c1400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f49bc0b4a60 con 0x7f49bc15b9d0 2024-09-12T02:47:10.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.101+0000 7f49bb200640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f49bc06f600 0x7f49bc0cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33044/0 (socket says 172.21.15.112:33044) 2024-09-12T02:47:10.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.101+0000 7f49bb200640 1 -- 172.21.15.112:0/838227061 learned_addr learned my addr 172.21.15.112:0/838227061 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:10.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.101+0000 7f49ba800640 1 --2- 172.21.15.112:0/838227061 >> v2:172.21.15.137:3300/0 conn(0x7f49bc15b9d0 0x7f49bc0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:10.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.101+0000 7f49b9e00640 1 -- 172.21.15.112:0/838227061 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2574429992 0 0) 0x7f49bc0b54a0 con 0x7f49bc06f600 2024-09-12T02:47:10.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.101+0000 7f49b9e00640 1 -- 172.21.15.112:0/838227061 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49a0005730 con 0x7f49bc06f600 2024-09-12T02:47:10.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.102+0000 7f49b9e00640 1 -- 172.21.15.112:0/838227061 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2816519254 0 0) 0x7f49bc0b3af0 con 0x7f49bc0b45d0 2024-09-12T02:47:10.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.102+0000 7f49b9e00640 1 -- 172.21.15.112:0/838227061 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49bc0b54a0 con 0x7f49bc0b45d0 2024-09-12T02:47:10.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.102+0000 7f49b9e00640 1 -- 172.21.15.112:0/838227061 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 666983089 0 0) 0x7f49a0005730 con 0x7f49bc06f600 2024-09-12T02:47:10.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.102+0000 7f49ba800640 1 -- 172.21.15.112:0/838227061 >> v1:172.21.15.137:6789/0 conn(0x7f49bc0b45d0 legacy=0x7f49bc06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:10.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.102+0000 7f49ba800640 1 -- 172.21.15.112:0/838227061 >> v1:172.21.15.112:6789/0 conn(0x7f49bc06f600 legacy=0x7f49bc0cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:10.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.102+0000 7f49ba800640 1 -- 172.21.15.112:0/838227061 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49bc0b3dd0 con 0x7f49bc15b9d0 2024-09-12T02:47:10.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.103+0000 7f49ba800640 1 --2- 172.21.15.112:0/838227061 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49bc15b9d0 0x7f49bc0b4ec0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f49ac0097a0 tx=0x7f49ac02a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5a644b7773c7aa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:10.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.103+0000 7f49b9e00640 1 -- 172.21.15.112:0/838227061 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ac037070 con 0x7f49bc15b9d0 2024-09-12T02:47:10.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.103+0000 7f49b9e00640 1 -- 172.21.15.112:0/838227061 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49ac02abc0 con 0x7f49bc15b9d0 2024-09-12T02:47:10.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.103+0000 7f49b9e00640 1 -- 172.21.15.112:0/838227061 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b40019f0 con 0x7f49bc15b9d0 2024-09-12T02:47:10.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.104+0000 7f49c1400640 1 -- 172.21.15.112:0/838227061 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49bc15b9d0 msgr2=0x7f49bc0b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:10.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.104+0000 7f49c1400640 1 --2- 172.21.15.112:0/838227061 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49bc15b9d0 0x7f49bc0b4ec0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f49ac0097a0 tx=0x7f49ac02a130 comp rx=0 tx=0).stop 2024-09-12T02:47:10.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.104+0000 7f49c1400640 1 -- 172.21.15.112:0/838227061 shutdown_connections 2024-09-12T02:47:10.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.104+0000 7f49c1400640 1 --2- 172.21.15.112:0/838227061 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49bc15b9d0 0x7f49bc0b4ec0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:10.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.104+0000 7f49c1400640 1 -- 172.21.15.112:0/838227061 >> 172.21.15.112:0/838227061 conn(0x7f49bc06bbd0 msgr2=0x7f49bc06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:10.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.104+0000 7f49c1400640 1 -- 172.21.15.112:0/838227061 shutdown_connections 2024-09-12T02:47:10.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.104+0000 7f49c1400640 1 -- 172.21.15.112:0/838227061 wait complete. 2024-09-12T02:47:10.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.105+0000 7f49c1400640 1 Processor -- start 2024-09-12T02:47:10.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.106+0000 7f49c1400640 1 -- start start 2024-09-12T02:47:10.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.106+0000 7f49c1400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49bc06f600 0x7f49bc146dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:10.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.106+0000 7f49c1400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49bc0b45d0 0x7f49bc14a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:10.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.106+0000 7f49c1400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49bc15b9d0 0x7f49bc149d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:10.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.106+0000 7f49c1400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f49bc15bf30 con 0x7f49bc15b9d0 2024-09-12T02:47:10.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.107+0000 7f49c1400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f49bc15bdb0 con 0x7f49bc06f600 2024-09-12T02:47:10.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.107+0000 7f49c1400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f49bc0728c0 con 0x7f49bc0b45d0 2024-09-12T02:47:10.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.107+0000 7f49bb200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49bc15b9d0 0x7f49bc149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:10.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.107+0000 7f49bb200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49bc15b9d0 0x7f49bc149d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48432/0 (socket says 172.21.15.112:48432) 2024-09-12T02:47:10.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.107+0000 7f49bb200640 1 -- 172.21.15.112:0/1501204611 learned_addr learned my addr 172.21.15.112:0/1501204611 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:10.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.107+0000 7f49ba800640 1 --2- 172.21.15.112:0/1501204611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49bc06f600 0x7f49bc146dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:10.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.107+0000 7f49b1e00640 1 --2- 172.21.15.112:0/1501204611 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49bc0b45d0 0x7f49bc14a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:10.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.107+0000 7f49bb200640 1 -- 172.21.15.112:0/1501204611 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49bc0b45d0 msgr2=0x7f49bc14a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:10.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.107+0000 7f49bb200640 1 --2- 172.21.15.112:0/1501204611 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49bc0b45d0 0x7f49bc14a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:10.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.107+0000 7f49bb200640 1 -- 172.21.15.112:0/1501204611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49bc06f600 msgr2=0x7f49bc146dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:10.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.107+0000 7f49bb200640 1 --2- 172.21.15.112:0/1501204611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49bc06f600 0x7f49bc146dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:10.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.107+0000 7f49bb200640 1 -- 172.21.15.112:0/1501204611 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49bc147770 con 0x7f49bc15b9d0 2024-09-12T02:47:10.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.107+0000 7f49bb200640 1 --2- 172.21.15.112:0/1501204611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49bc15b9d0 0x7f49bc149d60 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f49b400cc80 tx=0x7f49b400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:10.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.108+0000 7f49b3400640 1 -- 172.21.15.112:0/1501204611 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b4017070 con 0x7f49bc15b9d0 2024-09-12T02:47:10.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.108+0000 7f49b3400640 1 -- 172.21.15.112:0/1501204611 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49b4012400 con 0x7f49bc15b9d0 2024-09-12T02:47:10.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.108+0000 7f49b3400640 1 -- 172.21.15.112:0/1501204611 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b4012830 con 0x7f49bc15b9d0 2024-09-12T02:47:10.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.108+0000 7f49c1400640 1 -- 172.21.15.112:0/1501204611 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49bc147a50 con 0x7f49bc15b9d0 2024-09-12T02:47:10.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.108+0000 7f49c1400640 1 -- 172.21.15.112:0/1501204611 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49bc148010 con 0x7f49bc15b9d0 2024-09-12T02:47:10.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.109+0000 7f49c1400640 1 -- 172.21.15.112:0/1501204611 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49bc072c50 con 0x7f49bc15b9d0 2024-09-12T02:47:10.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.110+0000 7f49b3400640 1 -- 172.21.15.112:0/1501204611 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f49b401a070 con 0x7f49bc15b9d0 2024-09-12T02:47:10.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.110+0000 7f49b3400640 1 --2- 172.21.15.112:0/1501204611 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f499806be60 0x7f499806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:10.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.110+0000 7f49b3400640 1 -- 172.21.15.112:0/1501204611 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5738+0+0 (secure 0 0 0) 0x7f49b408ae50 con 0x7f49bc15b9d0 2024-09-12T02:47:10.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.111+0000 7f49ba800640 1 --2- 172.21.15.112:0/1501204611 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f499806be60 0x7f499806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:10.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.111+0000 7f49ba800640 1 --2- 172.21.15.112:0/1501204611 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f499806be60 0x7f499806e320 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f49ac034000 tx=0x7f49ac02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:10.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.115+0000 7f49b3400640 1 -- 172.21.15.112:0/1501204611 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f49b40590f0 con 0x7f49bc15b9d0 2024-09-12T02:47:10.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.292+0000 7f49c1400640 1 -- 172.21.15.112:0/1501204611 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f49bc06e160 con 0x7f49bc15b9d0 2024-09-12T02:47:10.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.293+0000 7f49b3400640 1 -- 172.21.15.112:0/1501204611 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v109) ==== 81+0+34495 (secure 0 0 0) 0x7f49b405d3f0 con 0x7f49bc15b9d0 2024-09-12T02:47:10.295 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:10.295 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:47:10.295 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 109, 2024-09-12T02:47:10.295 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:47:10.295 INFO:teuthology.orchestra.run.smithi112.stdout: "created": "2024-09-12T02:41:36.162095+0000", 2024-09-12T02:47:10.295 INFO:teuthology.orchestra.run.smithi112.stdout: "modified": "2024-09-12T02:47:05.174500+0000", 2024-09-12T02:47:10.295 INFO:teuthology.orchestra.run.smithi112.stdout: "last_up_change": "2024-09-12T02:41:42.191169+0000", 2024-09-12T02:47:10.295 INFO:teuthology.orchestra.run.smithi112.stdout: "last_in_change": "2024-09-12T02:41:39.036600+0000", 2024-09-12T02:47:10.295 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:47:10.295 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_num": 5799936, 2024-09-12T02:47:10.296 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_set": [ 2024-09-12T02:47:10.296 INFO:teuthology.orchestra.run.smithi112.stdout: "pglog_hardlimit", 2024-09-12T02:47:10.296 INFO:teuthology.orchestra.run.smithi112.stdout: "purged_snapdirs", 2024-09-12T02:47:10.296 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_deletes", 2024-09-12T02:47:10.297 INFO:teuthology.orchestra.run.smithi112.stdout: "sortbitwise" 2024-09-12T02:47:10.297 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:47:10.297 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_version": 4, 2024-09-12T02:47:10.297 INFO:teuthology.orchestra.run.smithi112.stdout: "full_ratio": 0.69999998807907104, 2024-09-12T02:47:10.297 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-12T02:47:10.297 INFO:teuthology.orchestra.run.smithi112.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-12T02:47:10.297 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_snapshot": "", 2024-09-12T02:47:10.297 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_max": 13, 2024-09-12T02:47:10.297 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd": 8, 2024-09-12T02:47:10.297 INFO:teuthology.orchestra.run.smithi112.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:47:10.297 INFO:teuthology.orchestra.run.smithi112.stdout: "min_compat_client": "luminous", 2024-09-12T02:47:10.297 INFO:teuthology.orchestra.run.smithi112.stdout: "require_osd_release": "squid", 2024-09-12T02:47:10.298 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_crimson": false, 2024-09-12T02:47:10.298 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-12T02:47:10.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.298 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 1, 2024-09-12T02:47:10.298 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": ".mgr", 2024-09-12T02:47:10.298 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:41:43.011599+0000", 2024-09-12T02:47:10.298 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:47:10.298 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:47:10.298 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:47:10.298 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:47:10.298 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:47:10.298 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:47:10.299 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:47:10.299 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:47:10.299 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:47:10.299 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:47:10.299 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:47:10.299 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:47:10.299 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:47:10.299 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 1, 2024-09-12T02:47:10.299 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 1, 2024-09-12T02:47:10.299 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 1, 2024-09-12T02:47:10.299 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 1, 2024-09-12T02:47:10.299 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 1, 2024-09-12T02:47:10.299 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:47:10.299 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:47:10.300 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:47:10.300 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:47:10.300 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:47:10.300 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:47:10.300 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:47:10.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.300 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "109", 2024-09-12T02:47:10.300 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:47:10.300 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:47:10.301 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:47:10.301 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:47:10.301 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:47:10.301 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:47:10.301 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:47:10.301 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:47:10.302 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:47:10.302 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:47:10.303 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:47:10.303 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:47:10.303 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:47:10.303 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:47:10.303 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:47:10.304 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:47:10.304 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:47:10.304 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:47:10.305 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:47:10.305 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:47:10.305 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:47:10.305 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:47:10.305 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:47:10.305 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:47:10.306 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:47:10.306 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:47:10.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.306 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:47:10.306 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:47:10.306 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:47:10.307 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:47:10.307 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:47:10.307 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:47:10.307 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:47:10.307 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:47:10.308 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:47:10.308 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:47:10.308 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:47:10.308 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:47:10.308 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_max": 32, 2024-09-12T02:47:10.308 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 1 2024-09-12T02:47:10.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.309 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:47:10.309 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": {} 2024-09-12T02:47:10.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.309 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:47:10.309 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:47:10.310 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 8, 2024-09-12T02:47:10.310 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 8, 2024-09-12T02:47:10.310 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 0.25, 2024-09-12T02:47:10.310 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:47:10.310 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:47:10.310 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:47:10.311 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:47:10.311 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:47:10.311 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.312 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 12, 2024-09-12T02:47:10.312 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:47:10.312 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:46:34.392830+0000", 2024-09-12T02:47:10.312 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:47:10.312 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:47:10.313 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:47:10.313 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:47:10.313 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:47:10.313 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:47:10.313 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:47:10.314 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:47:10.314 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:47:10.314 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:47:10.314 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:47:10.314 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:47:10.314 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:47:10.314 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 32, 2024-09-12T02:47:10.315 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 32, 2024-09-12T02:47:10.315 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 32, 2024-09-12T02:47:10.315 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 32, 2024-09-12T02:47:10.315 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 32, 2024-09-12T02:47:10.315 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:47:10.315 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:47:10.316 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:47:10.316 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:47:10.316 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:47:10.316 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:47:10.316 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:47:10.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.316 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "109", 2024-09-12T02:47:10.317 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:47:10.317 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:47:10.317 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:47:10.317 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:47:10.317 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:47:10.317 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:47:10.317 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:47:10.317 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:47:10.317 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:47:10.317 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:47:10.317 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:47:10.317 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:47:10.317 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:47:10.318 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:47:10.318 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:47:10.318 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:47:10.318 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:47:10.318 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:47:10.318 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:47:10.318 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:47:10.318 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:47:10.318 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:47:10.318 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:47:10.318 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:47:10.318 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:47:10.318 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:47:10.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.319 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:47:10.319 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:47:10.319 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:47:10.319 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:47:10.319 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:47:10.319 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:47:10.319 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:47:10.319 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:47:10.319 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:47:10.319 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:47:10.319 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:47:10.319 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:47:10.320 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:47:10.320 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 16, 2024-09-12T02:47:10.320 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_priority": 5 2024-09-12T02:47:10.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.320 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:47:10.320 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:47:10.320 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": "cephfs" 2024-09-12T02:47:10.320 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.320 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:47:10.320 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:47:10.320 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 2, 2024-09-12T02:47:10.320 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 2, 2024-09-12T02:47:10.321 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:47:10.321 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:47:10.321 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:47:10.321 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:47:10.321 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:47:10.321 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:47:10.321 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.321 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 13, 2024-09-12T02:47:10.321 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_data", 2024-09-12T02:47:10.321 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:46:35.615193+0000", 2024-09-12T02:47:10.321 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:47:10.322 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:47:10.322 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:47:10.322 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:47:10.322 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:47:10.322 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:47:10.322 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:47:10.322 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:47:10.322 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:47:10.322 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:47:10.322 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:47:10.322 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:47:10.322 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:47:10.323 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 64, 2024-09-12T02:47:10.323 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 64, 2024-09-12T02:47:10.323 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 64, 2024-09-12T02:47:10.323 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 64, 2024-09-12T02:47:10.323 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 64, 2024-09-12T02:47:10.323 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:47:10.323 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:47:10.323 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:47:10.323 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:47:10.323 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:47:10.323 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:47:10.323 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:47:10.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.324 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "109", 2024-09-12T02:47:10.324 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:47:10.324 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:47:10.324 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:47:10.324 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:47:10.324 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:47:10.324 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:47:10.324 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:47:10.324 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:47:10.324 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:47:10.324 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:47:10.324 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:47:10.325 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:47:10.325 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:47:10.325 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:47:10.325 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:47:10.325 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:47:10.325 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:47:10.325 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:47:10.325 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:47:10.325 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:47:10.325 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:47:10.325 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:47:10.326 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:47:10.326 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:47:10.326 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:47:10.326 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:47:10.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.326 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:47:10.326 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:47:10.326 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:47:10.326 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:47:10.326 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:47:10.326 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:47:10.327 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:47:10.327 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:47:10.327 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:47:10.327 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:47:10.327 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:47:10.327 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:47:10.327 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 64, 2024-09-12T02:47:10.327 INFO:teuthology.orchestra.run.smithi112.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:47:10.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.327 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:47:10.327 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:47:10.327 INFO:teuthology.orchestra.run.smithi112.stdout: "data": "cephfs" 2024-09-12T02:47:10.328 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.328 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:47:10.328 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:47:10.328 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.3799999952316284, 2024-09-12T02:47:10.328 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.3799999952316284, 2024-09-12T02:47:10.328 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:47:10.328 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-12T02:47:10.328 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-12T02:47:10.328 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:47:10.328 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:47:10.328 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:47:10.328 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.329 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.329 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:47:10.329 INFO:teuthology.orchestra.run.smithi112.stdout: "osds": [ 2024-09-12T02:47:10.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.329 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:47:10.329 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:47:10.329 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:47:10.329 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:47:10.329 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:47:10.329 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:47:10.329 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:47:10.329 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:47:10.330 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:47:10.330 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:47:10.330 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:47:10.330 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:47:10.330 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:47:10.330 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.330 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.330 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6800", 2024-09-12T02:47:10.330 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:47:10.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.330 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.330 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6801", 2024-09-12T02:47:10.331 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:47:10.331 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.331 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.331 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:47:10.331 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.331 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.331 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6802", 2024-09-12T02:47:10.331 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:47:10.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.332 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.332 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6803", 2024-09-12T02:47:10.332 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:47:10.332 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.332 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.332 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:47:10.333 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.333 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.333 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.334 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6806", 2024-09-12T02:47:10.334 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:47:10.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.334 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.334 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6807", 2024-09-12T02:47:10.334 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:47:10.334 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.334 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.334 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:47:10.335 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.335 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.335 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6804", 2024-09-12T02:47:10.335 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:47:10.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.335 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.335 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6805", 2024-09-12T02:47:10.335 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:47:10.335 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.335 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.335 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6801/821571304", 2024-09-12T02:47:10.336 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6803/821571304", 2024-09-12T02:47:10.336 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6807/821571304", 2024-09-12T02:47:10.336 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6805/821571304", 2024-09-12T02:47:10.336 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:47:10.336 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:47:10.336 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:47:10.336 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.336 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:47:10.336 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:47:10.337 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:47:10.337 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:47:10.337 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:47:10.337 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:47:10.337 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:47:10.337 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:47:10.337 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:47:10.337 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:47:10.337 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:47:10.337 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:47:10.337 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:47:10.337 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.337 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.338 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6808", 2024-09-12T02:47:10.338 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:47:10.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.338 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.338 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6809", 2024-09-12T02:47:10.338 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:47:10.338 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.338 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.338 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:47:10.338 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.338 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.339 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6810", 2024-09-12T02:47:10.339 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:47:10.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.339 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.339 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6811", 2024-09-12T02:47:10.339 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:47:10.339 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.339 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.339 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:47:10.339 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.339 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.339 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6814", 2024-09-12T02:47:10.340 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:47:10.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.340 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.340 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6815", 2024-09-12T02:47:10.340 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:47:10.340 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.340 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.340 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:47:10.340 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.340 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.341 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6812", 2024-09-12T02:47:10.341 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:47:10.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.341 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.341 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6813", 2024-09-12T02:47:10.341 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:47:10.341 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.341 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.341 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6809/2642068641", 2024-09-12T02:47:10.341 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6811/2642068641", 2024-09-12T02:47:10.341 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6815/2642068641", 2024-09-12T02:47:10.341 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6813/2642068641", 2024-09-12T02:47:10.342 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:47:10.342 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:47:10.342 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:47:10.342 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.342 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:47:10.342 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:47:10.342 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:47:10.342 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:47:10.342 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:47:10.342 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:47:10.342 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:47:10.342 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:47:10.343 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:47:10.343 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:47:10.343 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:47:10.343 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:47:10.343 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:47:10.343 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.343 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.343 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6816", 2024-09-12T02:47:10.343 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:47:10.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.344 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.344 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6817", 2024-09-12T02:47:10.344 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:47:10.344 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.344 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.344 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:47:10.345 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.345 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.345 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6818", 2024-09-12T02:47:10.345 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:47:10.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.346 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.346 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6819", 2024-09-12T02:47:10.346 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:47:10.346 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.346 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.347 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:47:10.347 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.347 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.347 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6822", 2024-09-12T02:47:10.348 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:47:10.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.348 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.348 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6823", 2024-09-12T02:47:10.348 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:47:10.349 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.349 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.349 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:47:10.349 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.350 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.350 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6820", 2024-09-12T02:47:10.350 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:47:10.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.350 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.351 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6821", 2024-09-12T02:47:10.351 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:47:10.351 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.351 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.352 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6817/3365688807", 2024-09-12T02:47:10.352 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6819/3365688807", 2024-09-12T02:47:10.352 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6823/3365688807", 2024-09-12T02:47:10.352 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6821/3365688807", 2024-09-12T02:47:10.352 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:47:10.352 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:47:10.353 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:47:10.353 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.353 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:47:10.353 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:47:10.354 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:47:10.354 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:47:10.354 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:47:10.354 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:47:10.354 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:47:10.354 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:47:10.355 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:47:10.355 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 98, 2024-09-12T02:47:10.355 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:47:10.355 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:47:10.355 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:47:10.356 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.356 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.356 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6824", 2024-09-12T02:47:10.356 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:47:10.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.357 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.357 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6825", 2024-09-12T02:47:10.357 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:47:10.357 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.358 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.358 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:47:10.358 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.358 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.359 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6826", 2024-09-12T02:47:10.359 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:47:10.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.359 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.359 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6827", 2024-09-12T02:47:10.360 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:47:10.360 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.360 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.360 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:47:10.361 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.361 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.361 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6830", 2024-09-12T02:47:10.361 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:47:10.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.362 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.362 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6831", 2024-09-12T02:47:10.362 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:47:10.362 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.363 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.363 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:47:10.363 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.363 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.364 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6828", 2024-09-12T02:47:10.364 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:47:10.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.364 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.364 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6829", 2024-09-12T02:47:10.365 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:47:10.365 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.365 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.365 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6825/231774278", 2024-09-12T02:47:10.366 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6827/231774278", 2024-09-12T02:47:10.366 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6831/231774278", 2024-09-12T02:47:10.366 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6829/231774278", 2024-09-12T02:47:10.366 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:47:10.366 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:47:10.366 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:47:10.367 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.367 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:47:10.367 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:47:10.368 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:47:10.368 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:47:10.368 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:47:10.368 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:47:10.368 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:47:10.368 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:47:10.369 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:47:10.369 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:47:10.369 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:47:10.369 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:47:10.369 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:47:10.369 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.370 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.370 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6800", 2024-09-12T02:47:10.370 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:47:10.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.371 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.371 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6801", 2024-09-12T02:47:10.371 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:47:10.371 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.371 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.372 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:47:10.372 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.372 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.372 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6802", 2024-09-12T02:47:10.372 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:47:10.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.372 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.372 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6803", 2024-09-12T02:47:10.372 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:47:10.372 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.372 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.373 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:47:10.373 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.373 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.373 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6806", 2024-09-12T02:47:10.373 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:47:10.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.373 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.373 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6807", 2024-09-12T02:47:10.373 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:47:10.373 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.373 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.374 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:47:10.374 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.374 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.374 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6804", 2024-09-12T02:47:10.374 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:47:10.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.374 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.374 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6805", 2024-09-12T02:47:10.374 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:47:10.374 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.374 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.375 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6801/3671178153", 2024-09-12T02:47:10.375 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6803/3671178153", 2024-09-12T02:47:10.375 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6807/3671178153", 2024-09-12T02:47:10.375 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6805/3671178153", 2024-09-12T02:47:10.375 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:47:10.375 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:47:10.375 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:47:10.375 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.375 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:47:10.375 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:47:10.375 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:47:10.376 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:47:10.376 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:47:10.376 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:47:10.376 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:47:10.376 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:47:10.376 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:47:10.376 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:47:10.376 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:47:10.376 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:47:10.376 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:47:10.376 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.377 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.377 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6808", 2024-09-12T02:47:10.377 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:47:10.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.377 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.377 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6809", 2024-09-12T02:47:10.377 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:47:10.377 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.377 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.378 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:47:10.378 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.378 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.378 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6810", 2024-09-12T02:47:10.378 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:47:10.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.378 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.378 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6811", 2024-09-12T02:47:10.378 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:47:10.378 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.378 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.379 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:47:10.379 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.379 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.379 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6817", 2024-09-12T02:47:10.379 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:47:10.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.379 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.379 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6819", 2024-09-12T02:47:10.379 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:47:10.379 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.379 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.380 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:47:10.380 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.380 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.380 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6812", 2024-09-12T02:47:10.380 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:47:10.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.380 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.380 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6815", 2024-09-12T02:47:10.381 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:47:10.381 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.381 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.381 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6809/3193706134", 2024-09-12T02:47:10.381 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6811/3193706134", 2024-09-12T02:47:10.381 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6819/3193706134", 2024-09-12T02:47:10.381 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6815/3193706134", 2024-09-12T02:47:10.381 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:47:10.381 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:47:10.381 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:47:10.381 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.382 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:47:10.382 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:47:10.382 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:47:10.382 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:47:10.382 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:47:10.382 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:47:10.382 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:47:10.382 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:47:10.382 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:47:10.382 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:47:10.382 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:47:10.382 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:47:10.383 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:47:10.383 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.383 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.383 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6813", 2024-09-12T02:47:10.383 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:47:10.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.383 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.383 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6814", 2024-09-12T02:47:10.383 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:47:10.383 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.384 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.384 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:47:10.384 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.384 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.384 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6816", 2024-09-12T02:47:10.384 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:47:10.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.384 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.384 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6818", 2024-09-12T02:47:10.385 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:47:10.385 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.385 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.385 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:47:10.385 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.385 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.385 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6822", 2024-09-12T02:47:10.385 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:47:10.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.385 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.385 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6823", 2024-09-12T02:47:10.385 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:47:10.386 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.386 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.386 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:47:10.386 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.386 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.386 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6820", 2024-09-12T02:47:10.386 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:47:10.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.386 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.386 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6821", 2024-09-12T02:47:10.387 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:47:10.387 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.387 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.387 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6814/3738813293", 2024-09-12T02:47:10.387 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6818/3738813293", 2024-09-12T02:47:10.387 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6823/3738813293", 2024-09-12T02:47:10.387 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6821/3738813293", 2024-09-12T02:47:10.387 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:47:10.387 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:47:10.387 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:47:10.387 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.388 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:47:10.388 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:47:10.388 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:47:10.388 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:47:10.388 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:47:10.388 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:47:10.388 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:47:10.388 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:47:10.388 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:47:10.388 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 95, 2024-09-12T02:47:10.388 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:47:10.388 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:47:10.389 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:47:10.389 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.389 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.389 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6824", 2024-09-12T02:47:10.389 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:47:10.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.389 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.389 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6825", 2024-09-12T02:47:10.389 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:47:10.389 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.389 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.390 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:47:10.390 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.390 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.390 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6826", 2024-09-12T02:47:10.390 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:47:10.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.390 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.390 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6827", 2024-09-12T02:47:10.390 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:47:10.390 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.391 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.391 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:47:10.391 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.391 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.391 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6830", 2024-09-12T02:47:10.391 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:47:10.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.391 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.391 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6831", 2024-09-12T02:47:10.391 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:47:10.391 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.392 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.392 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:47:10.392 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:47:10.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.392 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:47:10.392 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6828", 2024-09-12T02:47:10.392 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:47:10.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.392 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:47:10.392 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6829", 2024-09-12T02:47:10.392 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:47:10.392 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.393 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.393 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6825/1421932609", 2024-09-12T02:47:10.393 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6827/1421932609", 2024-09-12T02:47:10.393 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6831/1421932609", 2024-09-12T02:47:10.393 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6829/1421932609", 2024-09-12T02:47:10.393 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:47:10.393 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:47:10.393 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:47:10.393 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.393 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.393 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:47:10.393 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_xinfo": [ 2024-09-12T02:47:10.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.394 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:47:10.394 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:47:10.394 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:47:10.394 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:47:10.394 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:47:10.394 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:47:10.394 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.220641+0000", 2024-09-12T02:47:10.394 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:47:10.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.394 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:47:10.394 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:47:10.394 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:47:10.395 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:47:10.395 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:47:10.395 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:47:10.395 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312574+0000", 2024-09-12T02:47:10.395 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:47:10.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.395 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:47:10.395 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:47:10.395 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:47:10.395 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:47:10.395 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:47:10.395 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:47:10.395 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.282771+0000", 2024-09-12T02:47:10.395 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:47:10.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.396 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:47:10.396 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:47:10.396 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:47:10.396 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:47:10.396 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:47:10.396 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:47:10.396 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.260478+0000", 2024-09-12T02:47:10.396 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:47:10.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.396 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:47:10.397 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:47:10.397 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:47:10.397 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:47:10.397 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:47:10.397 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:47:10.397 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.273397+0000", 2024-09-12T02:47:10.397 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:47:10.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.397 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:47:10.397 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:47:10.397 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:47:10.397 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:47:10.397 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:47:10.398 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:47:10.398 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312452+0000", 2024-09-12T02:47:10.398 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:47:10.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.398 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:47:10.398 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:47:10.398 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:47:10.398 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:47:10.398 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:47:10.398 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:47:10.398 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.308965+0000", 2024-09-12T02:47:10.398 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:47:10.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.399 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:47:10.399 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:47:10.399 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:47:10.399 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:47:10.399 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:47:10.399 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:47:10.399 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.337842+0000", 2024-09-12T02:47:10.399 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:47:10.399 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.399 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:47:10.399 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap": [], 2024-09-12T02:47:10.399 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_items": [ 2024-09-12T02:47:10.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.400 INFO:teuthology.orchestra.run.smithi112.stdout: "pgid": "13.2a", 2024-09-12T02:47:10.400 INFO:teuthology.orchestra.run.smithi112.stdout: "mappings": [ 2024-09-12T02:47:10.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:10.400 INFO:teuthology.orchestra.run.smithi112.stdout: "from": 1, 2024-09-12T02:47:10.400 INFO:teuthology.orchestra.run.smithi112.stdout: "to": 3 2024-09-12T02:47:10.400 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.400 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:10.400 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.400 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:47:10.400 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_primaries": [], 2024-09-12T02:47:10.400 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_temp": [], 2024-09-12T02:47:10.400 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_temp": [], 2024-09-12T02:47:10.400 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklist": {}, 2024-09-12T02:47:10.400 INFO:teuthology.orchestra.run.smithi112.stdout: "range_blocklist": {}, 2024-09-12T02:47:10.401 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profiles": { 2024-09-12T02:47:10.401 INFO:teuthology.orchestra.run.smithi112.stdout: "default": { 2024-09-12T02:47:10.401 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-failure-domain": "osd", 2024-09-12T02:47:10.401 INFO:teuthology.orchestra.run.smithi112.stdout: "k": "2", 2024-09-12T02:47:10.401 INFO:teuthology.orchestra.run.smithi112.stdout: "m": "1", 2024-09-12T02:47:10.401 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin": "jerasure", 2024-09-12T02:47:10.401 INFO:teuthology.orchestra.run.smithi112.stdout: "technique": "reed_sol_van" 2024-09-12T02:47:10.401 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:10.401 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps_queue": [], 2024-09-12T02:47:10.401 INFO:teuthology.orchestra.run.smithi112.stdout: "new_removed_snaps": [], 2024-09-12T02:47:10.401 INFO:teuthology.orchestra.run.smithi112.stdout: "new_purged_snaps": [], 2024-09-12T02:47:10.402 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_node_flags": {}, 2024-09-12T02:47:10.402 INFO:teuthology.orchestra.run.smithi112.stdout: "device_class_flags": {}, 2024-09-12T02:47:10.402 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode": { 2024-09-12T02:47:10.402 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_enabled": false, 2024-09-12T02:47:10.402 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_bucket_count": 0, 2024-09-12T02:47:10.402 INFO:teuthology.orchestra.run.smithi112.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:47:10.402 INFO:teuthology.orchestra.run.smithi112.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:47:10.402 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_bucket": 0 2024-09-12T02:47:10.402 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:10.402 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:47:10.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.295+0000 7f49c1400640 1 -- 172.21.15.112:0/1501204611 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f499806be60 msgr2=0x7f499806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:10.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.295+0000 7f49c1400640 1 --2- 172.21.15.112:0/1501204611 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f499806be60 0x7f499806e320 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f49ac034000 tx=0x7f49ac02e000 comp rx=0 tx=0).stop 2024-09-12T02:47:10.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.295+0000 7f49c1400640 1 -- 172.21.15.112:0/1501204611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49bc15b9d0 msgr2=0x7f49bc149d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:10.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.295+0000 7f49c1400640 1 --2- 172.21.15.112:0/1501204611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49bc15b9d0 0x7f49bc149d60 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f49b400cc80 tx=0x7f49b400a430 comp rx=0 tx=0).stop 2024-09-12T02:47:10.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.296+0000 7f49c1400640 1 -- 172.21.15.112:0/1501204611 shutdown_connections 2024-09-12T02:47:10.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.296+0000 7f49c1400640 1 --2- 172.21.15.112:0/1501204611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49bc15b9d0 0x7f49bc149d60 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:10.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.296+0000 7f49c1400640 1 --2- 172.21.15.112:0/1501204611 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49bc0b45d0 0x7f49bc14a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:10.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.296+0000 7f49c1400640 1 --2- 172.21.15.112:0/1501204611 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f499806be60 0x7f499806e320 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:10.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.296+0000 7f49c1400640 1 --2- 172.21.15.112:0/1501204611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49bc06f600 0x7f49bc146dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:10.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.296+0000 7f49c1400640 1 -- 172.21.15.112:0/1501204611 >> 172.21.15.112:0/1501204611 conn(0x7f49bc06bbd0 msgr2=0x7f49bc0b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:10.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.296+0000 7f49c1400640 1 -- 172.21.15.112:0/1501204611 shutdown_connections 2024-09-12T02:47:10.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.296+0000 7f49c1400640 1 -- 172.21.15.112:0/1501204611 wait complete. 2024-09-12T02:47:10.406 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:47:10.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.556+0000 7f5e83200640 1 Processor -- start 2024-09-12T02:47:10.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.557+0000 7f5e83200640 1 -- start start 2024-09-12T02:47:10.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.558+0000 7f5e83200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e840d0f30 0x7f5e8406f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:10.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.558+0000 7f5e83200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e840b42c0 con 0x7f5e8406d590 2024-09-12T02:47:10.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.558+0000 7f5e83200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e8415bd80 con 0x7f5e8415b9a0 2024-09-12T02:47:10.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.558+0000 7f5e83200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5e8406de70 con 0x7f5e840d0f30 2024-09-12T02:47:10.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.558+0000 7f5e79400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f5e8406d590 0x7f5e840d0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33046/0 (socket says 172.21.15.112:33046) 2024-09-12T02:47:10.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.558+0000 7f5e79400640 1 -- 172.21.15.112:0/3583215771 learned_addr learned my addr 172.21.15.112:0/3583215771 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:10.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.558+0000 7f5e82800640 1 --2- 172.21.15.112:0/3583215771 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e840d0f30 0x7f5e8406f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:10.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.559+0000 7f5e81400640 1 -- 172.21.15.112:0/3583215771 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1604085456 0 0) 0x7f5e6c001110 con 0x7f5e8406d590 2024-09-12T02:47:10.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.559+0000 7f5e81400640 1 -- 172.21.15.112:0/3583215771 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e68003520 con 0x7f5e8406d590 2024-09-12T02:47:10.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.559+0000 7f5e81400640 1 -- 172.21.15.112:0/3583215771 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3144822277 0 0) 0x7f5e8415bd80 con 0x7f5e8415b9a0 2024-09-12T02:47:10.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.559+0000 7f5e81400640 1 -- 172.21.15.112:0/3583215771 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e6c001110 con 0x7f5e8415b9a0 2024-09-12T02:47:10.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.559+0000 7f5e82800640 1 -- 172.21.15.112:0/3583215771 >> v1:172.21.15.137:6789/0 conn(0x7f5e8415b9a0 legacy=0x7f5e840b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:10.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.559+0000 7f5e82800640 1 -- 172.21.15.112:0/3583215771 >> v1:172.21.15.112:6789/0 conn(0x7f5e8406d590 legacy=0x7f5e840d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:10.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.559+0000 7f5e82800640 1 -- 172.21.15.112:0/3583215771 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e840b5730 con 0x7f5e840d0f30 2024-09-12T02:47:10.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.560+0000 7f5e82800640 1 --2- 172.21.15.112:0/3583215771 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e840d0f30 0x7f5e8406f270 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c009dc0 tx=0x7f5e7c02a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=439536c3e4292aee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:10.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.560+0000 7f5e81400640 1 -- 172.21.15.112:0/3583215771 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c007740 con 0x7f5e840d0f30 2024-09-12T02:47:10.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.560+0000 7f5e81400640 1 -- 172.21.15.112:0/3583215771 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e7c0078e0 con 0x7f5e840d0f30 2024-09-12T02:47:10.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.560+0000 7f5e81400640 1 -- 172.21.15.112:0/3583215771 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c007cb0 con 0x7f5e840d0f30 2024-09-12T02:47:10.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.561+0000 7f5e83200640 1 -- 172.21.15.112:0/3583215771 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e840d0f30 msgr2=0x7f5e8406f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:10.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.561+0000 7f5e83200640 1 --2- 172.21.15.112:0/3583215771 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e840d0f30 0x7f5e8406f270 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c009dc0 tx=0x7f5e7c02a6d0 comp rx=0 tx=0).stop 2024-09-12T02:47:10.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.561+0000 7f5e83200640 1 -- 172.21.15.112:0/3583215771 shutdown_connections 2024-09-12T02:47:10.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.561+0000 7f5e83200640 1 --2- 172.21.15.112:0/3583215771 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e840d0f30 0x7f5e8406f270 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:10.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.561+0000 7f5e83200640 1 -- 172.21.15.112:0/3583215771 >> 172.21.15.112:0/3583215771 conn(0x7f5e8406bbd0 msgr2=0x7f5e8406bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:10.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.561+0000 7f5e83200640 1 -- 172.21.15.112:0/3583215771 shutdown_connections 2024-09-12T02:47:10.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.561+0000 7f5e83200640 1 -- 172.21.15.112:0/3583215771 wait complete. 2024-09-12T02:47:10.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.562+0000 7f5e83200640 1 Processor -- start 2024-09-12T02:47:10.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.563+0000 7f5e83200640 1 -- start start 2024-09-12T02:47:10.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.563+0000 7f5e83200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e8406d590 0x7f5e841e6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:10.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.563+0000 7f5e83200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e840d0f30 0x7f5e84157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:10.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.563+0000 7f5e83200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e8415b9a0 0x7f5e841e4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:10.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.563+0000 7f5e83200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5e840b4820 con 0x7f5e840d0f30 2024-09-12T02:47:10.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.563+0000 7f5e83200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5e840b4540 con 0x7f5e8406d590 2024-09-12T02:47:10.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.563+0000 7f5e83200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5e840b4b00 con 0x7f5e8415b9a0 2024-09-12T02:47:10.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.564+0000 7f5e79400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e840d0f30 0x7f5e84157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:10.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.564+0000 7f5e79400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e840d0f30 0x7f5e84157d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48440/0 (socket says 172.21.15.112:48440) 2024-09-12T02:47:10.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.564+0000 7f5e79400640 1 -- 172.21.15.112:0/3451322908 learned_addr learned my addr 172.21.15.112:0/3451322908 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:10.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.564+0000 7f5e79400640 1 -- 172.21.15.112:0/3451322908 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e8415b9a0 msgr2=0x7f5e841e4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:10.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.564+0000 7f5e81e00640 1 --2- 172.21.15.112:0/3451322908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e8406d590 0x7f5e841e6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:10.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.564+0000 7f5e82800640 1 --2- 172.21.15.112:0/3451322908 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e8415b9a0 0x7f5e841e4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:10.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.564+0000 7f5e79400640 1 --2- 172.21.15.112:0/3451322908 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e8415b9a0 0x7f5e841e4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:10.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.564+0000 7f5e79400640 1 -- 172.21.15.112:0/3451322908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e8406d590 msgr2=0x7f5e841e6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:10.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.564+0000 7f5e79400640 1 --2- 172.21.15.112:0/3451322908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e8406d590 0x7f5e841e6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:10.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.564+0000 7f5e79400640 1 -- 172.21.15.112:0/3451322908 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e841e69e0 con 0x7f5e840d0f30 2024-09-12T02:47:10.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.564+0000 7f5e82800640 1 --2- 172.21.15.112:0/3451322908 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e8415b9a0 0x7f5e841e4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:10.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.564+0000 7f5e81e00640 1 --2- 172.21.15.112:0/3451322908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e8406d590 0x7f5e841e6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:10.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.564+0000 7f5e79400640 1 --2- 172.21.15.112:0/3451322908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e840d0f30 0x7f5e84157d50 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c00c760 tx=0x7f5e6c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:10.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.565+0000 7f5e7aa00640 1 -- 172.21.15.112:0/3451322908 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c017070 con 0x7f5e840d0f30 2024-09-12T02:47:10.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.565+0000 7f5e7aa00640 1 -- 172.21.15.112:0/3451322908 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e6c005ce0 con 0x7f5e840d0f30 2024-09-12T02:47:10.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.565+0000 7f5e83200640 1 -- 172.21.15.112:0/3451322908 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e841e6cc0 con 0x7f5e840d0f30 2024-09-12T02:47:10.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.565+0000 7f5e7aa00640 1 -- 172.21.15.112:0/3451322908 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c007270 con 0x7f5e840d0f30 2024-09-12T02:47:10.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.565+0000 7f5e83200640 1 -- 172.21.15.112:0/3451322908 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e84155420 con 0x7f5e840d0f30 2024-09-12T02:47:10.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.566+0000 7f5e83200640 1 -- 172.21.15.112:0/3451322908 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e84155620 con 0x7f5e840d0f30 2024-09-12T02:47:10.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.567+0000 7f5e7aa00640 1 -- 172.21.15.112:0/3451322908 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5e6c01a070 con 0x7f5e840d0f30 2024-09-12T02:47:10.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.567+0000 7f5e7aa00640 1 --2- 172.21.15.112:0/3451322908 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5e6006be30 0x7f5e6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:10.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.568+0000 7f5e7aa00640 1 -- 172.21.15.112:0/3451322908 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5738+0+0 (secure 0 0 0) 0x7f5e6c08a2f0 con 0x7f5e840d0f30 2024-09-12T02:47:10.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.568+0000 7f5e81e00640 1 --2- 172.21.15.112:0/3451322908 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5e6006be30 0x7f5e6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:10.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.568+0000 7f5e81e00640 1 --2- 172.21.15.112:0/3451322908 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5e6006be30 0x7f5e6006e2f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5e740011e0 tx=0x7f5e74009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:10.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.572+0000 7f5e7aa00640 1 -- 172.21.15.112:0/3451322908 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5e84155620 con 0x7f5e840d0f30 2024-09-12T02:47:10.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.777+0000 7f5e83200640 1 -- 172.21.15.112:0/3451322908 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e8406f270 con 0x7f5e840d0f30 2024-09-12T02:47:10.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.778+0000 7f5e7aa00640 1 -- 172.21.15.112:0/3451322908 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5234 (secure 0 0 0) 0x7f5e840b42c0 con 0x7f5e840d0f30 2024-09-12T02:47:10.779 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:10.779 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":53,"btime":"2024-09-12T02:46:40:250353+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1897464411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1897464411},{"type":"v1","addr":"172.21.15.137:6834","nonce":1897464411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":5785,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3500913266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3500913266},{"type":"v1","addr":"172.21.15.137:6835","nonce":3500913266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":6144,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/611029461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":611029461},{"type":"v1","addr":"172.21.15.112:6836","nonce":611029461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:46:36.623382+0000","modified":"2024-09-12T02:46:39.653409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6150":{"gid":6150,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/1018665478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1018665478},{"type":"v1","addr":"172.21.15.112:6837","nonce":1018665478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6150,"qdb_cluster":[6150]},"id":6}]} 2024-09-12T02:47:10.780 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 53 2024-09-12T02:47:10.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.780+0000 7f5e83200640 1 -- 172.21.15.112:0/3451322908 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5e6006be30 msgr2=0x7f5e6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:10.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.780+0000 7f5e83200640 1 --2- 172.21.15.112:0/3451322908 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5e6006be30 0x7f5e6006e2f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5e740011e0 tx=0x7f5e74009040 comp rx=0 tx=0).stop 2024-09-12T02:47:10.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.780+0000 7f5e83200640 1 -- 172.21.15.112:0/3451322908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e840d0f30 msgr2=0x7f5e84157d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:10.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.780+0000 7f5e83200640 1 --2- 172.21.15.112:0/3451322908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e840d0f30 0x7f5e84157d50 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c00c760 tx=0x7f5e6c00cc20 comp rx=0 tx=0).stop 2024-09-12T02:47:10.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.780+0000 7f5e83200640 1 -- 172.21.15.112:0/3451322908 shutdown_connections 2024-09-12T02:47:10.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.780+0000 7f5e83200640 1 --2- 172.21.15.112:0/3451322908 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e8415b9a0 0x7f5e841e4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:10.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.780+0000 7f5e83200640 1 --2- 172.21.15.112:0/3451322908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e840d0f30 0x7f5e84157d50 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:10.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.780+0000 7f5e83200640 1 --2- 172.21.15.112:0/3451322908 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5e6006be30 0x7f5e6006e2f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:10.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.780+0000 7f5e83200640 1 --2- 172.21.15.112:0/3451322908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e8406d590 0x7f5e841e6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:10.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.780+0000 7f5e83200640 1 -- 172.21.15.112:0/3451322908 >> 172.21.15.112:0/3451322908 conn(0x7f5e8406bbd0 msgr2=0x7f5e840b11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:10.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.780+0000 7f5e83200640 1 -- 172.21.15.112:0/3451322908 shutdown_connections 2024-09-12T02:47:10.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:10.780+0000 7f5e83200640 1 -- 172.21.15.112:0/3451322908 wait complete. 2024-09-12T02:47:10.797 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-12T02:47:10.971 INFO:teuthology.orchestra.run.smithi112.stdout:{"cluster_fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","whoami":0,"id":6150,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":33.727077092999998,"mdsmap_epoch":53,"osdmap_epoch":109,"osdmap_epoch_barrier":104,"uptime":38.281739573999999} 2024-09-12T02:47:10.972 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", "fs_name": "cephfs", "id": 6150, "mdsmap_epoch": 53, "osdmap_epoch": 109, "osdmap_epoch_barrier": 104, "rank_uptime": 33.727077093, "state": "up:active", "uptime": 38.281739574, "want_state": "up:active", "whoami": 0 } 2024-09-12T02:47:10.972 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:47:10.972 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:47:10.972 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:47:11.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:47:11.008 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2024-09-12T02:47:11.432 INFO:teuthology.orchestra.run.smithi112.stderr:50+0 records in 2024-09-12T02:47:11.432 INFO:teuthology.orchestra.run.smithi112.stderr:50+0 records out 2024-09-12T02:47:11.433 INFO:teuthology.orchestra.run.smithi112.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.347858 s, 151 MB/s 2024-09-12T02:47:11.434 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:47:11.434 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:47:11.525 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:47:11.606 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:47:11.606 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:47:11.606 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:47:11.606 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:47:11.642 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:47:11.642 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:47:11.717 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:47:11.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.910+0000 7f3bd7000640 1 Processor -- start 2024-09-12T02:47:11.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.910+0000 7f3bd7000640 1 -- start start 2024-09-12T02:47:11.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.911+0000 7f3bd7000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3bd00d1710 0x7f3bd00d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:11.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.911+0000 7f3bd7000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3bd00b3e00 0x7f3bd00d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:11.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.911+0000 7f3bd7000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bd00d2fb0 con 0x7f3bd00cf7a0 2024-09-12T02:47:11.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.911+0000 7f3bd7000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3bd00d3cb0 con 0x7f3bd00d1710 2024-09-12T02:47:11.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.911+0000 7f3bd7000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3bd00d0b60 con 0x7f3bd00b3e00 2024-09-12T02:47:11.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.911+0000 7f3bd6600640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f3bd00cf7a0 0x7f3bd00cfc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47766/0 (socket says 172.21.15.112:47766) 2024-09-12T02:47:11.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.911+0000 7f3bd6600640 1 -- 172.21.15.112:0/3405696999 learned_addr learned my addr 172.21.15.112:0/3405696999 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:11.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.911+0000 7f3bd5c00640 1 --2- 172.21.15.112:0/3405696999 >> v2:172.21.15.137:3300/0 conn(0x7f3bd00d1710 0x7f3bd00d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:11.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.911+0000 7f3bd5200640 1 --2- 172.21.15.112:0/3405696999 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3bd00b3e00 0x7f3bd00d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:11.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.912+0000 7f3bcfe00640 1 -- 172.21.15.112:0/3405696999 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1272962556 0 0) 0x7f3bd00d2fb0 con 0x7f3bd00cf7a0 2024-09-12T02:47:11.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.912+0000 7f3bcfe00640 1 -- 172.21.15.112:0/3405696999 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bb8003520 con 0x7f3bd00cf7a0 2024-09-12T02:47:11.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.912+0000 7f3bd5200640 1 -- 172.21.15.112:0/3405696999 >> v2:172.21.15.137:3300/0 conn(0x7f3bd00d1710 msgr2=0x7f3bd00d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:11.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.912+0000 7f3bd5200640 1 --2- 172.21.15.112:0/3405696999 >> v2:172.21.15.137:3300/0 conn(0x7f3bd00d1710 0x7f3bd00d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:11.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.912+0000 7f3bd5200640 1 -- 172.21.15.112:0/3405696999 >> v1:172.21.15.112:6789/0 conn(0x7f3bd00cf7a0 legacy=0x7f3bd00cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:11.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.912+0000 7f3bd5200640 1 -- 172.21.15.112:0/3405696999 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd00d2030 con 0x7f3bd00b3e00 2024-09-12T02:47:11.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.912+0000 7f3bd5c00640 1 --2- 172.21.15.112:0/3405696999 >> v2:172.21.15.137:3300/0 conn(0x7f3bd00d1710 0x7f3bd00d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:11.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.913+0000 7f3bd5200640 1 --2- 172.21.15.112:0/3405696999 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3bd00b3e00 0x7f3bd00d1af0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc0097a0 tx=0x7f3bbc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cfca9532baf0c06 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:11.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.913+0000 7f3bcfe00640 1 -- 172.21.15.112:0/3405696999 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc037070 con 0x7f3bd00b3e00 2024-09-12T02:47:11.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.913+0000 7f3bcfe00640 1 -- 172.21.15.112:0/3405696999 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bbc032440 con 0x7f3bd00b3e00 2024-09-12T02:47:11.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.913+0000 7f3bcfe00640 1 -- 172.21.15.112:0/3405696999 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc0327f0 con 0x7f3bd00b3e00 2024-09-12T02:47:11.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.914+0000 7f3bd7000640 1 -- 172.21.15.112:0/3405696999 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3bd00b3e00 msgr2=0x7f3bd00d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:11.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.914+0000 7f3bd7000640 1 --2- 172.21.15.112:0/3405696999 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3bd00b3e00 0x7f3bd00d1af0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc0097a0 tx=0x7f3bbc02a180 comp rx=0 tx=0).stop 2024-09-12T02:47:11.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.914+0000 7f3bd7000640 1 -- 172.21.15.112:0/3405696999 shutdown_connections 2024-09-12T02:47:11.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.914+0000 7f3bd7000640 1 --2- 172.21.15.112:0/3405696999 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3bd00b3e00 0x7f3bd00d1af0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:11.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.914+0000 7f3bd7000640 1 --2- 172.21.15.112:0/3405696999 >> v2:172.21.15.137:3300/0 conn(0x7f3bd00d1710 0x7f3bd00d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:11.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.914+0000 7f3bd7000640 1 -- 172.21.15.112:0/3405696999 >> 172.21.15.112:0/3405696999 conn(0x7f3bd009e030 msgr2=0x7f3bd00d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:11.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.914+0000 7f3bd7000640 1 -- 172.21.15.112:0/3405696999 shutdown_connections 2024-09-12T02:47:11.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.914+0000 7f3bd7000640 1 -- 172.21.15.112:0/3405696999 wait complete. 2024-09-12T02:47:11.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.916+0000 7f3bd7000640 1 Processor -- start 2024-09-12T02:47:11.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.916+0000 7f3bd7000640 1 -- start start 2024-09-12T02:47:11.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.916+0000 7f3bd7000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3bd00b3e00 0x7f3bd00b45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:11.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.916+0000 7f3bd7000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3bd00cf7a0 0x7f3bd01f4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:11.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.917+0000 7f3bd7000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bd00d1710 0x7f3bd01f5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:11.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.917+0000 7f3bd7000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd00d39d0 con 0x7f3bd00d1710 2024-09-12T02:47:11.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.917+0000 7f3bd7000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd00d36f0 con 0x7f3bd00cf7a0 2024-09-12T02:47:11.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.917+0000 7f3bd7000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3bd015f110 con 0x7f3bd00b3e00 2024-09-12T02:47:11.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.917+0000 7f3bd6600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bd00d1710 0x7f3bd01f5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:11.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.917+0000 7f3bd6600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bd00d1710 0x7f3bd01f5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46570/0 (socket says 172.21.15.112:46570) 2024-09-12T02:47:11.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.917+0000 7f3bd6600640 1 -- 172.21.15.112:0/3686890359 learned_addr learned my addr 172.21.15.112:0/3686890359 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:11.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.917+0000 7f3bd5c00640 1 --2- 172.21.15.112:0/3686890359 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3bd00b3e00 0x7f3bd00b45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:11.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.917+0000 7f3bd5200640 1 --2- 172.21.15.112:0/3686890359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3bd00cf7a0 0x7f3bd01f4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:11.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.917+0000 7f3bd6600640 1 -- 172.21.15.112:0/3686890359 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3bd00b3e00 msgr2=0x7f3bd00b45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:11.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.917+0000 7f3bd6600640 1 --2- 172.21.15.112:0/3686890359 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3bd00b3e00 0x7f3bd00b45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:11.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.917+0000 7f3bd6600640 1 -- 172.21.15.112:0/3686890359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3bd00cf7a0 msgr2=0x7f3bd01f4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:11.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.917+0000 7f3bd6600640 1 --2- 172.21.15.112:0/3686890359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3bd00cf7a0 0x7f3bd01f4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:11.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.917+0000 7f3bd6600640 1 -- 172.21.15.112:0/3686890359 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd01f5740 con 0x7f3bd00d1710 2024-09-12T02:47:11.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.917+0000 7f3bd5200640 1 --2- 172.21.15.112:0/3686890359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3bd00cf7a0 0x7f3bd01f4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:11.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.918+0000 7f3bd6600640 1 --2- 172.21.15.112:0/3686890359 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bd00d1710 0x7f3bd01f5200 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f3bc800cb70 tx=0x7f3bc800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:11.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.918+0000 7f3bcd600640 1 -- 172.21.15.112:0/3686890359 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc8017070 con 0x7f3bd00d1710 2024-09-12T02:47:11.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.918+0000 7f3bcd600640 1 -- 172.21.15.112:0/3686890359 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bc800ad40 con 0x7f3bd00d1710 2024-09-12T02:47:11.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.918+0000 7f3bd7000640 1 -- 172.21.15.112:0/3686890359 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd00b7260 con 0x7f3bd00d1710 2024-09-12T02:47:11.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.918+0000 7f3bcd600640 1 -- 172.21.15.112:0/3686890359 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc8012620 con 0x7f3bd00d1710 2024-09-12T02:47:11.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.918+0000 7f3bd7000640 1 -- 172.21.15.112:0/3686890359 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd0160500 con 0x7f3bd00d1710 2024-09-12T02:47:11.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.919+0000 7f3bd7000640 1 -- 172.21.15.112:0/3686890359 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bd00d1af0 con 0x7f3bd00d1710 2024-09-12T02:47:11.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.920+0000 7f3bcd600640 1 -- 172.21.15.112:0/3686890359 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3bc801a070 con 0x7f3bd00d1710 2024-09-12T02:47:11.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.921+0000 7f3bcd600640 1 --2- 172.21.15.112:0/3686890359 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3bb006be60 0x7f3bb006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:11.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.921+0000 7f3bcd600640 1 -- 172.21.15.112:0/3686890359 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5738+0+0 (secure 0 0 0) 0x7f3bc808ac90 con 0x7f3bd00d1710 2024-09-12T02:47:11.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.921+0000 7f3bd5c00640 1 --2- 172.21.15.112:0/3686890359 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3bb006be60 0x7f3bb006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:11.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.922+0000 7f3bd5c00640 1 --2- 172.21.15.112:0/3686890359 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3bb006be60 0x7f3bb006e320 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4009560 tx=0x7f3bc4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:11.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:11.925+0000 7f3bcd600640 1 -- 172.21.15.112:0/3686890359 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3bd01f5740 con 0x7f3bd00d1710 2024-09-12T02:47:12.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.110+0000 7f3bd7000640 1 -- 172.21.15.112:0/3686890359 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3bd006c520 con 0x7f3bd00d1710 2024-09-12T02:47:12.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.110+0000 7f3bcd600640 1 -- 172.21.15.112:0/3686890359 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v109) ==== 80+0+0 (secure 0 0 0) 0x7f3bc8058f30 con 0x7f3bd00d1710 2024-09-12T02:47:12.111 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-12T02:47:12.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.112+0000 7f3bd7000640 1 -- 172.21.15.112:0/3686890359 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3bb006be60 msgr2=0x7f3bb006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:12.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.112+0000 7f3bd7000640 1 --2- 172.21.15.112:0/3686890359 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3bb006be60 0x7f3bb006e320 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4009560 tx=0x7f3bc4009190 comp rx=0 tx=0).stop 2024-09-12T02:47:12.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.112+0000 7f3bd7000640 1 -- 172.21.15.112:0/3686890359 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bd00d1710 msgr2=0x7f3bd01f5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:12.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.112+0000 7f3bd7000640 1 --2- 172.21.15.112:0/3686890359 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bd00d1710 0x7f3bd01f5200 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f3bc800cb70 tx=0x7f3bc800a430 comp rx=0 tx=0).stop 2024-09-12T02:47:12.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.113+0000 7f3bd7000640 1 -- 172.21.15.112:0/3686890359 shutdown_connections 2024-09-12T02:47:12.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.113+0000 7f3bd7000640 1 --2- 172.21.15.112:0/3686890359 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bd00d1710 0x7f3bd01f5200 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.113+0000 7f3bd7000640 1 --2- 172.21.15.112:0/3686890359 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3bb006be60 0x7f3bb006e320 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.113+0000 7f3bd7000640 1 --2- 172.21.15.112:0/3686890359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3bd00cf7a0 0x7f3bd01f4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.113+0000 7f3bd7000640 1 --2- 172.21.15.112:0/3686890359 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3bd00b3e00 0x7f3bd00b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.113+0000 7f3bd7000640 1 -- 172.21.15.112:0/3686890359 >> 172.21.15.112:0/3686890359 conn(0x7f3bd009e030 msgr2=0x7f3bd00b7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:12.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.113+0000 7f3bd7000640 1 -- 172.21.15.112:0/3686890359 shutdown_connections 2024-09-12T02:47:12.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.113+0000 7f3bd7000640 1 -- 172.21.15.112:0/3686890359 wait complete. 2024-09-12T02:47:12.129 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:47:12.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:47:12.130 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T02:47:12.223 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-12T02:47:12.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:47:12.223 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:47:12.268 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:47:12.268 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:47:12.268 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:47:12.304 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:47:12.304 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:47:12.380 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:47:12.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.532+0000 7f6cec000640 1 Processor -- start 2024-09-12T02:47:12.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.532+0000 7f6cec000640 1 -- start start 2024-09-12T02:47:12.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.533+0000 7f6cec000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ce415b9d0 0x7f6ce40b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:12.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.533+0000 7f6cec000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6ce40b45d0 0x7f6ce40728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:12.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.533+0000 7f6cec000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ce406eef0 0x7f6ce406f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:12.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.533+0000 7f6cec000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f6ce40b4a30 con 0x7f6ce406eef0 2024-09-12T02:47:12.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.533+0000 7f6cec000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6ce406f840 con 0x7f6ce40b45d0 2024-09-12T02:47:12.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.533+0000 7f6cec000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6ce40b54a0 con 0x7f6ce415b9d0 2024-09-12T02:47:12.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.534+0000 7f6cea000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ce406eef0 0x7f6ce406f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:12.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.534+0000 7f6cea000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ce406eef0 0x7f6ce406f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46578/0 (socket says 172.21.15.112:46578) 2024-09-12T02:47:12.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.534+0000 7f6cea000640 1 -- 172.21.15.112:0/3802544277 learned_addr learned my addr 172.21.15.112:0/3802544277 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:12.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.534+0000 7f6ce9600640 1 --2- 172.21.15.112:0/3802544277 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ce415b9d0 0x7f6ce40b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:12.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.534+0000 7f6ce8c00640 1 --2- 172.21.15.112:0/3802544277 >> v2:172.21.15.137:3300/0 conn(0x7f6ce40b45d0 0x7f6ce40728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:12.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.534+0000 7f6cea000640 1 -- 172.21.15.112:0/3802544277 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ce415b9d0 msgr2=0x7f6ce40b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:12.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.534+0000 7f6cea000640 1 --2- 172.21.15.112:0/3802544277 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ce415b9d0 0x7f6ce40b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.534+0000 7f6cea000640 1 -- 172.21.15.112:0/3802544277 >> v2:172.21.15.137:3300/0 conn(0x7f6ce40b45d0 msgr2=0x7f6ce40728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:12.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.534+0000 7f6cea000640 1 --2- 172.21.15.112:0/3802544277 >> v2:172.21.15.137:3300/0 conn(0x7f6ce40b45d0 0x7f6ce40728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.534+0000 7f6cea000640 1 -- 172.21.15.112:0/3802544277 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ce40b3af0 con 0x7f6ce406eef0 2024-09-12T02:47:12.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.535+0000 7f6cea000640 1 --2- 172.21.15.112:0/3802544277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce406eef0 0x7f6ce406f300 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6ce406d2e0 tx=0x7f6cdc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd03dba79c99bc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:12.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.535+0000 7f6ce3e00640 1 -- 172.21.15.112:0/3802544277 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc036070 con 0x7f6ce406eef0 2024-09-12T02:47:12.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.535+0000 7f6ce3e00640 1 -- 172.21.15.112:0/3802544277 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cdc031600 con 0x7f6ce406eef0 2024-09-12T02:47:12.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.535+0000 7f6ce3e00640 1 -- 172.21.15.112:0/3802544277 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc0319d0 con 0x7f6ce406eef0 2024-09-12T02:47:12.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.536+0000 7f6cec000640 1 -- 172.21.15.112:0/3802544277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce406eef0 msgr2=0x7f6ce406f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:12.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.536+0000 7f6cec000640 1 --2- 172.21.15.112:0/3802544277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce406eef0 0x7f6ce406f300 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6ce406d2e0 tx=0x7f6cdc02a6a0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.536+0000 7f6cec000640 1 -- 172.21.15.112:0/3802544277 shutdown_connections 2024-09-12T02:47:12.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.536+0000 7f6cec000640 1 --2- 172.21.15.112:0/3802544277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce406eef0 0x7f6ce406f300 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.536+0000 7f6cec000640 1 --2- 172.21.15.112:0/3802544277 >> v2:172.21.15.137:3300/0 conn(0x7f6ce40b45d0 0x7f6ce40728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.536+0000 7f6cec000640 1 --2- 172.21.15.112:0/3802544277 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ce415b9d0 0x7f6ce40b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.536+0000 7f6cec000640 1 -- 172.21.15.112:0/3802544277 >> 172.21.15.112:0/3802544277 conn(0x7f6ce406bbd0 msgr2=0x7f6ce406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:12.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.536+0000 7f6cec000640 1 -- 172.21.15.112:0/3802544277 shutdown_connections 2024-09-12T02:47:12.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.536+0000 7f6cec000640 1 -- 172.21.15.112:0/3802544277 wait complete. 2024-09-12T02:47:12.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.537+0000 7f6cec000640 1 Processor -- start 2024-09-12T02:47:12.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.538+0000 7f6cec000640 1 -- start start 2024-09-12T02:47:12.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.538+0000 7f6cec000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ce406eef0 0x7f6ce4142380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:12.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.538+0000 7f6cec000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce40b45d0 0x7f6ce4157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:12.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.538+0000 7f6cec000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ce415b9d0 0x7f6ce41533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:12.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.538+0000 7f6cec000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce415bdb0 con 0x7f6ce40b45d0 2024-09-12T02:47:12.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.538+0000 7f6cec000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce40b40b0 con 0x7f6ce415b9d0 2024-09-12T02:47:12.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.538+0000 7f6cec000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6ce415bf30 con 0x7f6ce406eef0 2024-09-12T02:47:12.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.539+0000 7f6ce8c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce40b45d0 0x7f6ce4157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:12.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.539+0000 7f6ce8c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce40b45d0 0x7f6ce4157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46588/0 (socket says 172.21.15.112:46588) 2024-09-12T02:47:12.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.539+0000 7f6ce8c00640 1 -- 172.21.15.112:0/631848576 learned_addr learned my addr 172.21.15.112:0/631848576 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:12.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.539+0000 7f6ce9600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ce406eef0 0x7f6ce4142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:12.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.539+0000 7f6cea000640 1 --2- 172.21.15.112:0/631848576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ce415b9d0 0x7f6ce41533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:12.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.539+0000 7f6ce8c00640 1 -- 172.21.15.112:0/631848576 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ce406eef0 msgr2=0x7f6ce4142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:12.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.539+0000 7f6ce8c00640 1 --2- 172.21.15.112:0/631848576 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ce406eef0 0x7f6ce4142380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.539+0000 7f6ce8c00640 1 -- 172.21.15.112:0/631848576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ce415b9d0 msgr2=0x7f6ce41533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:12.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.539+0000 7f6ce8c00640 1 --2- 172.21.15.112:0/631848576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ce415b9d0 0x7f6ce41533f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.539+0000 7f6ce8c00640 1 -- 172.21.15.112:0/631848576 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ce41580a0 con 0x7f6ce40b45d0 2024-09-12T02:47:12.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.539+0000 7f6ce8c00640 1 --2- 172.21.15.112:0/631848576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce40b45d0 0x7f6ce4157770 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f6cd000d800 tx=0x7f6cd000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:12.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.540+0000 7f6ce1600640 1 -- 172.21.15.112:0/631848576 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd000b6c0 con 0x7f6ce40b45d0 2024-09-12T02:47:12.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.540+0000 7f6ce1600640 1 -- 172.21.15.112:0/631848576 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cd0019070 con 0x7f6ce40b45d0 2024-09-12T02:47:12.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.540+0000 7f6ce1600640 1 -- 172.21.15.112:0/631848576 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd000baa0 con 0x7f6ce40b45d0 2024-09-12T02:47:12.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.540+0000 7f6cec000640 1 -- 172.21.15.112:0/631848576 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ce4158380 con 0x7f6ce40b45d0 2024-09-12T02:47:12.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.540+0000 7f6cec000640 1 -- 172.21.15.112:0/631848576 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ce4150d20 con 0x7f6ce40b45d0 2024-09-12T02:47:12.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.541+0000 7f6cec000640 1 -- 172.21.15.112:0/631848576 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ce4068a30 con 0x7f6ce40b45d0 2024-09-12T02:47:12.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.542+0000 7f6ce1600640 1 -- 172.21.15.112:0/631848576 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6cd000bc40 con 0x7f6ce40b45d0 2024-09-12T02:47:12.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.542+0000 7f6ce1600640 1 --2- 172.21.15.112:0/631848576 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6cc406be30 0x7f6cc406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:12.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.542+0000 7f6ce1600640 1 -- 172.21.15.112:0/631848576 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5738+0+0 (secure 0 0 0) 0x7f6cd008b1b0 con 0x7f6ce40b45d0 2024-09-12T02:47:12.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.543+0000 7f6ce9600640 1 --2- 172.21.15.112:0/631848576 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6cc406be30 0x7f6cc406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:12.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.543+0000 7f6ce9600640 1 --2- 172.21.15.112:0/631848576 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6cc406be30 0x7f6cc406e2f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8007920 tx=0x7f6cd8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:12.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.547+0000 7f6ce1600640 1 -- 172.21.15.112:0/631848576 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6cd00594e0 con 0x7f6ce40b45d0 2024-09-12T02:47:12.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.733+0000 7f6cec000640 1 -- 172.21.15.112:0/631848576 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6ce406f300 con 0x7f6ce40b45d0 2024-09-12T02:47:12.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.734+0000 7f6ce1600640 1 -- 172.21.15.112:0/631848576 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v109) ==== 80+0+0 (secure 0 0 0) 0x7f6cd005d7e0 con 0x7f6ce40b45d0 2024-09-12T02:47:12.735 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-12T02:47:12.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.736+0000 7f6cec000640 1 -- 172.21.15.112:0/631848576 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6cc406be30 msgr2=0x7f6cc406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:12.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.736+0000 7f6cec000640 1 --2- 172.21.15.112:0/631848576 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6cc406be30 0x7f6cc406e2f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8007920 tx=0x7f6cd8008040 comp rx=0 tx=0).stop 2024-09-12T02:47:12.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.736+0000 7f6cec000640 1 -- 172.21.15.112:0/631848576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce40b45d0 msgr2=0x7f6ce4157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:12.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.736+0000 7f6cec000640 1 --2- 172.21.15.112:0/631848576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce40b45d0 0x7f6ce4157770 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f6cd000d800 tx=0x7f6cd000dcc0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.736+0000 7f6cec000640 1 -- 172.21.15.112:0/631848576 shutdown_connections 2024-09-12T02:47:12.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.736+0000 7f6cec000640 1 --2- 172.21.15.112:0/631848576 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6cc406be30 0x7f6cc406e2f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.736+0000 7f6cec000640 1 --2- 172.21.15.112:0/631848576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ce415b9d0 0x7f6ce41533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.736+0000 7f6cec000640 1 --2- 172.21.15.112:0/631848576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce40b45d0 0x7f6ce4157770 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.736+0000 7f6cec000640 1 --2- 172.21.15.112:0/631848576 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ce406eef0 0x7f6ce4142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.736+0000 7f6cec000640 1 -- 172.21.15.112:0/631848576 >> 172.21.15.112:0/631848576 conn(0x7f6ce406bbd0 msgr2=0x7f6ce40cedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:12.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.736+0000 7f6cec000640 1 -- 172.21.15.112:0/631848576 shutdown_connections 2024-09-12T02:47:12.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:12.736+0000 7f6cec000640 1 -- 172.21.15.112:0/631848576 wait complete. 2024-09-12T02:47:12.753 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-12T02:47:12.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:47:12.753 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-12T02:47:12.815 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T02:47:12.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:47:12.816 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T02:47:12.852 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:47:12.852 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:47:12.852 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:47:12.887 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:47:12.888 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:47:12.888 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:47:12.888 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:47:12.928 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:47:12.928 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:47:13.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.079+0000 7fbadc600640 1 Processor -- start 2024-09-12T02:47:13.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.079+0000 7fbadc600640 1 -- start start 2024-09-12T02:47:13.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.080+0000 7fbadc600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbad406f600 0x7fbad40b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:13.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.080+0000 7fbadc600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbad40b45d0 0x7fbad40728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:13.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.080+0000 7fbadc600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbad40b4a20 con 0x7fbad415b9d0 2024-09-12T02:47:13.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.080+0000 7fbadc600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fbad40b54a0 con 0x7fbad40b45d0 2024-09-12T02:47:13.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.080+0000 7fbadc600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbad40b3af0 con 0x7fbad406f600 2024-09-12T02:47:13.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.081+0000 7fbad9200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbad406f600 0x7fbad40b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:13.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.081+0000 7fbad9200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbad406f600 0x7fbad40b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:54094/0 (socket says 172.21.15.112:54094) 2024-09-12T02:47:13.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.081+0000 7fbad9200640 1 -- 172.21.15.112:0/234876627 learned_addr learned my addr 172.21.15.112:0/234876627 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:13.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.081+0000 7fbada600640 1 --2- 172.21.15.112:0/234876627 >> v2:172.21.15.137:3300/0 conn(0x7fbad40b45d0 0x7fbad40728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:13.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.081+0000 7fbad9200640 1 -- 172.21.15.112:0/234876627 >> v2:172.21.15.137:3300/0 conn(0x7fbad40b45d0 msgr2=0x7fbad40728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:13.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.081+0000 7fbad9200640 1 --2- 172.21.15.112:0/234876627 >> v2:172.21.15.137:3300/0 conn(0x7fbad40b45d0 0x7fbad40728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.081+0000 7fbad9200640 1 -- 172.21.15.112:0/234876627 >> v1:172.21.15.137:6789/0 conn(0x7fbad415b9d0 legacy=0x7fbad406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:13.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.081+0000 7fbad9200640 1 -- 172.21.15.112:0/234876627 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad40b3dd0 con 0x7fbad406f600 2024-09-12T02:47:13.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.082+0000 7fbad9200640 1 --2- 172.21.15.112:0/234876627 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbad406f600 0x7fbad40b4ec0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009850 tx=0x7fbac002c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9c6c7f5ebcc8174 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:13.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.082+0000 7fbad3e00640 1 -- 172.21.15.112:0/234876627 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac0038070 con 0x7fbad406f600 2024-09-12T02:47:13.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.083+0000 7fbad3e00640 1 -- 172.21.15.112:0/234876627 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac0004230 con 0x7fbad406f600 2024-09-12T02:47:13.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.083+0000 7fbad3e00640 1 -- 172.21.15.112:0/234876627 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac0003610 con 0x7fbad406f600 2024-09-12T02:47:13.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.083+0000 7fbadc600640 1 -- 172.21.15.112:0/234876627 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbad406f600 msgr2=0x7fbad40b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:13.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.083+0000 7fbadc600640 1 --2- 172.21.15.112:0/234876627 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbad406f600 0x7fbad40b4ec0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009850 tx=0x7fbac002c460 comp rx=0 tx=0).stop 2024-09-12T02:47:13.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.083+0000 7fbadc600640 1 -- 172.21.15.112:0/234876627 shutdown_connections 2024-09-12T02:47:13.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.083+0000 7fbadc600640 1 --2- 172.21.15.112:0/234876627 >> v2:172.21.15.137:3300/0 conn(0x7fbad40b45d0 0x7fbad40728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.083+0000 7fbadc600640 1 --2- 172.21.15.112:0/234876627 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbad406f600 0x7fbad40b4ec0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.083+0000 7fbadc600640 1 -- 172.21.15.112:0/234876627 >> 172.21.15.112:0/234876627 conn(0x7fbad406bbd0 msgr2=0x7fbad406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:13.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.083+0000 7fbadc600640 1 -- 172.21.15.112:0/234876627 shutdown_connections 2024-09-12T02:47:13.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.083+0000 7fbadc600640 1 -- 172.21.15.112:0/234876627 wait complete. 2024-09-12T02:47:13.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.085+0000 7fbadc600640 1 Processor -- start 2024-09-12T02:47:13.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.085+0000 7fbadc600640 1 -- start start 2024-09-12T02:47:13.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.086+0000 7fbadc600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbad406f600 0x7fbad41530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:13.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.086+0000 7fbadc600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbad40b45d0 0x7fbad41518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:13.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.086+0000 7fbadc600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbad415b9d0 0x7fbad40cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:13.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.086+0000 7fbadc600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbad415bf30 con 0x7fbad40b45d0 2024-09-12T02:47:13.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.086+0000 7fbadc600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbad415bdb0 con 0x7fbad406f600 2024-09-12T02:47:13.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.086+0000 7fbadc600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbad40cdcd0 con 0x7fbad415b9d0 2024-09-12T02:47:13.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.086+0000 7fbad9200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbad40b45d0 0x7fbad41518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:13.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.086+0000 7fbad9200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbad40b45d0 0x7fbad41518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46594/0 (socket says 172.21.15.112:46594) 2024-09-12T02:47:13.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.086+0000 7fbad9200640 1 -- 172.21.15.112:0/1952507167 learned_addr learned my addr 172.21.15.112:0/1952507167 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:13.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.086+0000 7fbada600640 1 --2- 172.21.15.112:0/1952507167 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbad415b9d0 0x7fbad40cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:13.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.086+0000 7fbad9c00640 1 --2- 172.21.15.112:0/1952507167 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbad406f600 0x7fbad41530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:13.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.086+0000 7fbad9200640 1 -- 172.21.15.112:0/1952507167 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbad415b9d0 msgr2=0x7fbad40cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:13.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.086+0000 7fbad9200640 1 --2- 172.21.15.112:0/1952507167 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbad415b9d0 0x7fbad40cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.086+0000 7fbad9200640 1 -- 172.21.15.112:0/1952507167 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbad406f600 msgr2=0x7fbad41530d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:13.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.086+0000 7fbad9200640 1 --2- 172.21.15.112:0/1952507167 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbad406f600 0x7fbad41530d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.086+0000 7fbad9200640 1 -- 172.21.15.112:0/1952507167 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad4152030 con 0x7fbad40b45d0 2024-09-12T02:47:13.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.087+0000 7fbad9200640 1 --2- 172.21.15.112:0/1952507167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbad40b45d0 0x7fbad41518e0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009970 tx=0x7fbac00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:13.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.087+0000 7fbad1600640 1 -- 172.21.15.112:0/1952507167 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac0038040 con 0x7fbad40b45d0 2024-09-12T02:47:13.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.087+0000 7fbad1600640 1 -- 172.21.15.112:0/1952507167 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac0005e10 con 0x7fbad40b45d0 2024-09-12T02:47:13.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.087+0000 7fbadc600640 1 -- 172.21.15.112:0/1952507167 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbad4152310 con 0x7fbad40b45d0 2024-09-12T02:47:13.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.087+0000 7fbad1600640 1 -- 172.21.15.112:0/1952507167 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac0003a40 con 0x7fbad40b45d0 2024-09-12T02:47:13.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.087+0000 7fbadc600640 1 -- 172.21.15.112:0/1952507167 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbad41528d0 con 0x7fbad40b45d0 2024-09-12T02:47:13.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.088+0000 7fbadc600640 1 -- 172.21.15.112:0/1952507167 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbad406dbc0 con 0x7fbad40b45d0 2024-09-12T02:47:13.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.089+0000 7fbad1600640 1 -- 172.21.15.112:0/1952507167 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbac0043020 con 0x7fbad40b45d0 2024-09-12T02:47:13.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.090+0000 7fbad1600640 1 --2- 172.21.15.112:0/1952507167 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbab406be30 0x7fbab406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:13.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.090+0000 7fbad1600640 1 -- 172.21.15.112:0/1952507167 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5738+0+0 (secure 0 0 0) 0x7fbac00aad60 con 0x7fbad40b45d0 2024-09-12T02:47:13.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.090+0000 7fbad9c00640 1 --2- 172.21.15.112:0/1952507167 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbab406be30 0x7fbab406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:13.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.091+0000 7fbad9c00640 1 --2- 172.21.15.112:0/1952507167 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbab406be30 0x7fbab406e2f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbac8007fd0 tx=0x7fbac8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:13.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.094+0000 7fbad1600640 1 -- 172.21.15.112:0/1952507167 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbac0079650 con 0x7fbad40b45d0 2024-09-12T02:47:13.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.301+0000 7fbadc600640 1 -- 172.21.15.112:0/1952507167 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbad40b11f0 con 0x7fbad40b45d0 2024-09-12T02:47:13.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.302+0000 7fbad1600640 1 -- 172.21.15.112:0/1952507167 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5234 (secure 0 0 0) 0x7fbac0078f50 con 0x7fbad40b45d0 2024-09-12T02:47:13.303 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:13.303 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":53,"btime":"2024-09-12T02:46:40:250353+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1897464411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1897464411},{"type":"v1","addr":"172.21.15.137:6834","nonce":1897464411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":5785,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3500913266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3500913266},{"type":"v1","addr":"172.21.15.137:6835","nonce":3500913266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":6144,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/611029461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":611029461},{"type":"v1","addr":"172.21.15.112:6836","nonce":611029461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:46:36.623382+0000","modified":"2024-09-12T02:46:39.653409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6150":{"gid":6150,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/1018665478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1018665478},{"type":"v1","addr":"172.21.15.112:6837","nonce":1018665478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6150,"qdb_cluster":[6150]},"id":6}]} 2024-09-12T02:47:13.303 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 53 2024-09-12T02:47:13.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.304+0000 7fbadc600640 1 -- 172.21.15.112:0/1952507167 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbab406be30 msgr2=0x7fbab406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:13.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.304+0000 7fbadc600640 1 --2- 172.21.15.112:0/1952507167 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbab406be30 0x7fbab406e2f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbac8007fd0 tx=0x7fbac8009040 comp rx=0 tx=0).stop 2024-09-12T02:47:13.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.304+0000 7fbadc600640 1 -- 172.21.15.112:0/1952507167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbad40b45d0 msgr2=0x7fbad41518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:13.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.304+0000 7fbadc600640 1 --2- 172.21.15.112:0/1952507167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbad40b45d0 0x7fbad41518e0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009970 tx=0x7fbac00046c0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.304+0000 7fbadc600640 1 -- 172.21.15.112:0/1952507167 shutdown_connections 2024-09-12T02:47:13.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.304+0000 7fbadc600640 1 --2- 172.21.15.112:0/1952507167 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbad415b9d0 0x7fbad40cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.304+0000 7fbadc600640 1 --2- 172.21.15.112:0/1952507167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbad40b45d0 0x7fbad41518e0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.304+0000 7fbadc600640 1 --2- 172.21.15.112:0/1952507167 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbab406be30 0x7fbab406e2f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.304+0000 7fbadc600640 1 --2- 172.21.15.112:0/1952507167 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbad406f600 0x7fbad41530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.304+0000 7fbadc600640 1 -- 172.21.15.112:0/1952507167 >> 172.21.15.112:0/1952507167 conn(0x7fbad406bbd0 msgr2=0x7fbad40b56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:13.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.304+0000 7fbadc600640 1 -- 172.21.15.112:0/1952507167 shutdown_connections 2024-09-12T02:47:13.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.304+0000 7fbadc600640 1 -- 172.21.15.112:0/1952507167 wait complete. 2024-09-12T02:47:13.320 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:47:13.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.472+0000 7fce78e00640 1 Processor -- start 2024-09-12T02:47:13.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.472+0000 7fce78e00640 1 -- start start 2024-09-12T02:47:13.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.473+0000 7fce78e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fce741620f0 0x7fce740b5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:13.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.473+0000 7fce78e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fce740afd70 0x7fce7406eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:13.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.473+0000 7fce78e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce740d0820 0x7fce7406f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:13.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.473+0000 7fce78e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fce740b4f80 con 0x7fce741620f0 2024-09-12T02:47:13.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.473+0000 7fce78e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fce741624d0 con 0x7fce740afd70 2024-09-12T02:47:13.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.473+0000 7fce78e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fce740d0de0 con 0x7fce740d0820 2024-09-12T02:47:13.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.474+0000 7fce73400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fce741620f0 0x7fce740b5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:13.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.474+0000 7fce73400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fce741620f0 0x7fce740b5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46602/0 (socket says 172.21.15.112:46602) 2024-09-12T02:47:13.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.474+0000 7fce73400640 1 -- 172.21.15.112:0/994830 learned_addr learned my addr 172.21.15.112:0/994830 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:13.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.474+0000 7fce6aa00640 1 --2- 172.21.15.112:0/994830 >> v2:172.21.15.137:3300/0 conn(0x7fce740afd70 0x7fce7406eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:13.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.474+0000 7fce73e00640 1 --2- 172.21.15.112:0/994830 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce740d0820 0x7fce7406f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:13.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.474+0000 7fce73400640 1 -- 172.21.15.112:0/994830 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce740d0820 msgr2=0x7fce7406f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:13.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.474+0000 7fce73400640 1 --2- 172.21.15.112:0/994830 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce740d0820 0x7fce7406f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.474+0000 7fce73400640 1 -- 172.21.15.112:0/994830 >> v2:172.21.15.137:3300/0 conn(0x7fce740afd70 msgr2=0x7fce7406eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:13.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.474+0000 7fce73400640 1 --2- 172.21.15.112:0/994830 >> v2:172.21.15.137:3300/0 conn(0x7fce740afd70 0x7fce7406eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.474+0000 7fce73400640 1 -- 172.21.15.112:0/994830 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce740d10c0 con 0x7fce741620f0 2024-09-12T02:47:13.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.474+0000 7fce6aa00640 1 --2- 172.21.15.112:0/994830 >> v2:172.21.15.137:3300/0 conn(0x7fce740afd70 0x7fce7406eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:13.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.475+0000 7fce73400640 1 --2- 172.21.15.112:0/994830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce741620f0 0x7fce740b5740 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fce7406d2c0 tx=0x7fce6402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82110fbd53fe9497 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:13.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.475+0000 7fce72a00640 1 -- 172.21.15.112:0/994830 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce64037070 con 0x7fce741620f0 2024-09-12T02:47:13.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.476+0000 7fce72a00640 1 -- 172.21.15.112:0/994830 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce64032440 con 0x7fce741620f0 2024-09-12T02:47:13.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.476+0000 7fce72a00640 1 -- 172.21.15.112:0/994830 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce64032810 con 0x7fce741620f0 2024-09-12T02:47:13.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.476+0000 7fce78e00640 1 -- 172.21.15.112:0/994830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce741620f0 msgr2=0x7fce740b5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:13.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.476+0000 7fce78e00640 1 --2- 172.21.15.112:0/994830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce741620f0 0x7fce740b5740 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fce7406d2c0 tx=0x7fce6402a140 comp rx=0 tx=0).stop 2024-09-12T02:47:13.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.476+0000 7fce78e00640 1 -- 172.21.15.112:0/994830 shutdown_connections 2024-09-12T02:47:13.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.476+0000 7fce78e00640 1 --2- 172.21.15.112:0/994830 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce740d0820 0x7fce7406f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.476+0000 7fce78e00640 1 --2- 172.21.15.112:0/994830 >> v2:172.21.15.137:3300/0 conn(0x7fce740afd70 0x7fce7406eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.476+0000 7fce78e00640 1 --2- 172.21.15.112:0/994830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce741620f0 0x7fce740b5740 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.476+0000 7fce78e00640 1 -- 172.21.15.112:0/994830 >> 172.21.15.112:0/994830 conn(0x7fce7406bbd0 msgr2=0x7fce7406bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:13.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.476+0000 7fce78e00640 1 -- 172.21.15.112:0/994830 shutdown_connections 2024-09-12T02:47:13.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.476+0000 7fce78e00640 1 -- 172.21.15.112:0/994830 wait complete. 2024-09-12T02:47:13.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.478+0000 7fce78e00640 1 Processor -- start 2024-09-12T02:47:13.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.478+0000 7fce78e00640 1 -- start start 2024-09-12T02:47:13.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.479+0000 7fce78e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce740afd70 0x7fce74155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:13.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.479+0000 7fce78e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce740d0820 0x7fce741e7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:13.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.479+0000 7fce78e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce741620f0 0x7fce74152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:13.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.479+0000 7fce78e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fce740d13a0 con 0x7fce741620f0 2024-09-12T02:47:13.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.479+0000 7fce78e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fce740737d0 con 0x7fce740d0820 2024-09-12T02:47:13.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.479+0000 7fce78e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fce740ae8d0 con 0x7fce740afd70 2024-09-12T02:47:13.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.479+0000 7fce73e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce741620f0 0x7fce74152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:13.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.479+0000 7fce73e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce741620f0 0x7fce74152360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46614/0 (socket says 172.21.15.112:46614) 2024-09-12T02:47:13.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.479+0000 7fce73e00640 1 -- 172.21.15.112:0/2787492864 learned_addr learned my addr 172.21.15.112:0/2787492864 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:13.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.479+0000 7fce6aa00640 1 --2- 172.21.15.112:0/2787492864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce740d0820 0x7fce741e7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:13.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.479+0000 7fce73400640 1 --2- 172.21.15.112:0/2787492864 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce740afd70 0x7fce74155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:13.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.480+0000 7fce73e00640 1 -- 172.21.15.112:0/2787492864 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce740afd70 msgr2=0x7fce74155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:13.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.480+0000 7fce73e00640 1 --2- 172.21.15.112:0/2787492864 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce740afd70 0x7fce74155b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.480+0000 7fce73e00640 1 -- 172.21.15.112:0/2787492864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce740d0820 msgr2=0x7fce741e7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:13.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.480+0000 7fce73e00640 1 --2- 172.21.15.112:0/2787492864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce740d0820 0x7fce741e7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.480+0000 7fce73e00640 1 -- 172.21.15.112:0/2787492864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce741e7a90 con 0x7fce741620f0 2024-09-12T02:47:13.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.480+0000 7fce73e00640 1 --2- 172.21.15.112:0/2787492864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce741620f0 0x7fce74152360 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fce6c00efc0 tx=0x7fce6c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:13.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.480+0000 7fce6be00640 1 -- 172.21.15.112:0/2787492864 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c018020 con 0x7fce741620f0 2024-09-12T02:47:13.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.480+0000 7fce6be00640 1 -- 172.21.15.112:0/2787492864 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce6c014480 con 0x7fce741620f0 2024-09-12T02:47:13.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.480+0000 7fce78e00640 1 -- 172.21.15.112:0/2787492864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce741e7d70 con 0x7fce741620f0 2024-09-12T02:47:13.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.480+0000 7fce6be00640 1 -- 172.21.15.112:0/2787492864 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c014870 con 0x7fce741620f0 2024-09-12T02:47:13.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.480+0000 7fce78e00640 1 -- 172.21.15.112:0/2787492864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce741e8330 con 0x7fce741620f0 2024-09-12T02:47:13.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.481+0000 7fce78e00640 1 -- 172.21.15.112:0/2787492864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce740b5740 con 0x7fce741620f0 2024-09-12T02:47:13.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.482+0000 7fce6be00640 1 -- 172.21.15.112:0/2787492864 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce6c005d10 con 0x7fce741620f0 2024-09-12T02:47:13.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.483+0000 7fce6be00640 1 --2- 172.21.15.112:0/2787492864 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fce5006be60 0x7fce5006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:13.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.483+0000 7fce6be00640 1 -- 172.21.15.112:0/2787492864 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5738+0+0 (secure 0 0 0) 0x7fce6c08b7b0 con 0x7fce741620f0 2024-09-12T02:47:13.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.483+0000 7fce73400640 1 --2- 172.21.15.112:0/2787492864 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fce5006be60 0x7fce5006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:13.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.484+0000 7fce73400640 1 --2- 172.21.15.112:0/2787492864 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fce5006be60 0x7fce5006e320 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fce64034000 tx=0x7fce6402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:13.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.487+0000 7fce6be00640 1 -- 172.21.15.112:0/2787492864 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fce6c022070 con 0x7fce741620f0 2024-09-12T02:47:13.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.694+0000 7fce78e00640 1 -- 172.21.15.112:0/2787492864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce74072150 con 0x7fce741620f0 2024-09-12T02:47:13.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.694+0000 7fce6be00640 1 -- 172.21.15.112:0/2787492864 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5234 (secure 0 0 0) 0x7fce6c010040 con 0x7fce741620f0 2024-09-12T02:47:13.695 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:13.696 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":53,"btime":"2024-09-12T02:46:40:250353+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1897464411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1897464411},{"type":"v1","addr":"172.21.15.137:6834","nonce":1897464411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":5785,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3500913266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3500913266},{"type":"v1","addr":"172.21.15.137:6835","nonce":3500913266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":6144,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/611029461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":611029461},{"type":"v1","addr":"172.21.15.112:6836","nonce":611029461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:46:36.623382+0000","modified":"2024-09-12T02:46:39.653409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6150":{"gid":6150,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/1018665478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1018665478},{"type":"v1","addr":"172.21.15.112:6837","nonce":1018665478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6150,"qdb_cluster":[6150]},"id":6}]} 2024-09-12T02:47:13.696 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 53 2024-09-12T02:47:13.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.697+0000 7fce78e00640 1 -- 172.21.15.112:0/2787492864 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fce5006be60 msgr2=0x7fce5006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:13.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.697+0000 7fce78e00640 1 --2- 172.21.15.112:0/2787492864 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fce5006be60 0x7fce5006e320 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fce64034000 tx=0x7fce6402e000 comp rx=0 tx=0).stop 2024-09-12T02:47:13.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.697+0000 7fce78e00640 1 -- 172.21.15.112:0/2787492864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce741620f0 msgr2=0x7fce74152360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:13.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.697+0000 7fce78e00640 1 --2- 172.21.15.112:0/2787492864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce741620f0 0x7fce74152360 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fce6c00efc0 tx=0x7fce6c00c490 comp rx=0 tx=0).stop 2024-09-12T02:47:13.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.697+0000 7fce78e00640 1 -- 172.21.15.112:0/2787492864 shutdown_connections 2024-09-12T02:47:13.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.697+0000 7fce78e00640 1 --2- 172.21.15.112:0/2787492864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce741620f0 0x7fce74152360 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.697+0000 7fce78e00640 1 --2- 172.21.15.112:0/2787492864 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fce5006be60 0x7fce5006e320 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.697+0000 7fce78e00640 1 --2- 172.21.15.112:0/2787492864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce740d0820 0x7fce741e7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.697+0000 7fce78e00640 1 --2- 172.21.15.112:0/2787492864 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce740afd70 0x7fce74155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.697+0000 7fce78e00640 1 -- 172.21.15.112:0/2787492864 >> 172.21.15.112:0/2787492864 conn(0x7fce7406bbd0 msgr2=0x7fce74071430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:13.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.697+0000 7fce78e00640 1 -- 172.21.15.112:0/2787492864 shutdown_connections 2024-09-12T02:47:13.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.697+0000 7fce78e00640 1 -- 172.21.15.112:0/2787492864 wait complete. 2024-09-12T02:47:13.715 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:47:13.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.867+0000 7fe6b2a00640 1 Processor -- start 2024-09-12T02:47:13.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.867+0000 7fe6b2a00640 1 -- start start 2024-09-12T02:47:13.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.868+0000 7fe6b2a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe6ac0b5850 0x7fe6ac06e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:13.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.868+0000 7fe6b2a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6ac06e970 0x7fe6ac164de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:13.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.868+0000 7fe6b2a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ac15b6a0 con 0x7fe6ac06e050 2024-09-12T02:47:13.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.868+0000 7fe6b2a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe6ac0b43b0 con 0x7fe6ac0b5850 2024-09-12T02:47:13.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.868+0000 7fe6b2a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe6ac0b3a80 con 0x7fe6ac06e970 2024-09-12T02:47:13.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.869+0000 7fe6abe00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe6ac06e050 0x7fe6ac0cfff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47770/0 (socket says 172.21.15.112:47770) 2024-09-12T02:47:13.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.869+0000 7fe6abe00640 1 -- 172.21.15.112:0/1212298161 learned_addr learned my addr 172.21.15.112:0/1212298161 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:13.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.869+0000 7fe6a3400640 1 --2- 172.21.15.112:0/1212298161 >> v2:172.21.15.137:3300/0 conn(0x7fe6ac0b5850 0x7fe6ac06e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:13.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.869+0000 7fe6b0a00640 1 --2- 172.21.15.112:0/1212298161 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6ac06e970 0x7fe6ac164de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:13.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.869+0000 7fe6ab400640 1 -- 172.21.15.112:0/1212298161 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1165223482 0 0) 0x7fe6ac15b6a0 con 0x7fe6ac06e050 2024-09-12T02:47:13.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.869+0000 7fe6ab400640 1 -- 172.21.15.112:0/1212298161 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe690005730 con 0x7fe6ac06e050 2024-09-12T02:47:13.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.869+0000 7fe6a3400640 1 -- 172.21.15.112:0/1212298161 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6ac06e970 msgr2=0x7fe6ac164de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:13.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.869+0000 7fe6ab400640 1 -- 172.21.15.112:0/1212298161 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2395156471 0 0) 0x7fe690005730 con 0x7fe6ac06e050 2024-09-12T02:47:13.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.869+0000 7fe6a3400640 1 --2- 172.21.15.112:0/1212298161 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6ac06e970 0x7fe6ac164de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.869+0000 7fe6a3400640 1 -- 172.21.15.112:0/1212298161 >> v1:172.21.15.112:6789/0 conn(0x7fe6ac06e050 legacy=0x7fe6ac0cfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:13.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.869+0000 7fe6a3400640 1 -- 172.21.15.112:0/1212298161 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ac0b3d60 con 0x7fe6ac0b5850 2024-09-12T02:47:13.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.870+0000 7fe6a3400640 1 --2- 172.21.15.112:0/1212298161 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ac0b5850 0x7fe6ac06e430 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe694009790 tx=0x7fe69402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b894018397918508 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:13.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.871+0000 7fe6ab400640 1 -- 172.21.15.112:0/1212298161 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe694037070 con 0x7fe6ac0b5850 2024-09-12T02:47:13.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.871+0000 7fe6ab400640 1 -- 172.21.15.112:0/1212298161 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe69402ab90 con 0x7fe6ac0b5850 2024-09-12T02:47:13.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.871+0000 7fe6ab400640 1 -- 172.21.15.112:0/1212298161 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c001670 con 0x7fe6ac0b5850 2024-09-12T02:47:13.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.871+0000 7fe6b2a00640 1 -- 172.21.15.112:0/1212298161 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ac0b5850 msgr2=0x7fe6ac06e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:13.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.871+0000 7fe6b2a00640 1 --2- 172.21.15.112:0/1212298161 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ac0b5850 0x7fe6ac06e430 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe694009790 tx=0x7fe69402a100 comp rx=0 tx=0).stop 2024-09-12T02:47:13.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.871+0000 7fe6b2a00640 1 -- 172.21.15.112:0/1212298161 shutdown_connections 2024-09-12T02:47:13.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.871+0000 7fe6b2a00640 1 --2- 172.21.15.112:0/1212298161 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6ac06e970 0x7fe6ac164de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.871+0000 7fe6b2a00640 1 --2- 172.21.15.112:0/1212298161 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ac0b5850 0x7fe6ac06e430 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.871+0000 7fe6b2a00640 1 -- 172.21.15.112:0/1212298161 >> 172.21.15.112:0/1212298161 conn(0x7fe6ac06bbd0 msgr2=0x7fe6ac06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:13.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.871+0000 7fe6b2a00640 1 -- 172.21.15.112:0/1212298161 shutdown_connections 2024-09-12T02:47:13.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.872+0000 7fe6b2a00640 1 -- 172.21.15.112:0/1212298161 wait complete. 2024-09-12T02:47:13.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.873+0000 7fe6b2a00640 1 Processor -- start 2024-09-12T02:47:13.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.873+0000 7fe6b2a00640 1 -- start start 2024-09-12T02:47:13.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.874+0000 7fe6b2a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6ac06e050 0x7fe6ac1450a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:13.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.874+0000 7fe6b2a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ac06e970 0x7fe6ac0aec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:13.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.874+0000 7fe6b2a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6ac0b5850 0x7fe6ac0aa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:13.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.874+0000 7fe6b2a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac072170 con 0x7fe6ac0b5850 2024-09-12T02:47:13.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.874+0000 7fe6b2a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac071ff0 con 0x7fe6ac06e970 2024-09-12T02:47:13.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.874+0000 7fe6b2a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe6ac0722f0 con 0x7fe6ac06e050 2024-09-12T02:47:13.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.874+0000 7fe6b0a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6ac0b5850 0x7fe6ac0aa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:13.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.874+0000 7fe6b0a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6ac0b5850 0x7fe6ac0aa4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46618/0 (socket says 172.21.15.112:46618) 2024-09-12T02:47:13.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.874+0000 7fe6b0a00640 1 -- 172.21.15.112:0/4258026376 learned_addr learned my addr 172.21.15.112:0/4258026376 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:13.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.875+0000 7fe6a3400640 1 --2- 172.21.15.112:0/4258026376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ac06e970 0x7fe6ac0aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:13.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.875+0000 7fe6abe00640 1 --2- 172.21.15.112:0/4258026376 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6ac06e050 0x7fe6ac1450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:13.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.875+0000 7fe6b0a00640 1 -- 172.21.15.112:0/4258026376 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6ac06e050 msgr2=0x7fe6ac1450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:13.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.875+0000 7fe6b0a00640 1 --2- 172.21.15.112:0/4258026376 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6ac06e050 0x7fe6ac1450a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.875+0000 7fe6b0a00640 1 -- 172.21.15.112:0/4258026376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ac06e970 msgr2=0x7fe6ac0aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:13.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.875+0000 7fe6b0a00640 1 --2- 172.21.15.112:0/4258026376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ac06e970 0x7fe6ac0aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.875+0000 7fe6b0a00640 1 -- 172.21.15.112:0/4258026376 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ac147e40 con 0x7fe6ac0b5850 2024-09-12T02:47:13.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.875+0000 7fe6abe00640 1 --2- 172.21.15.112:0/4258026376 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6ac06e050 0x7fe6ac1450a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:13.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.875+0000 7fe6b0a00640 1 --2- 172.21.15.112:0/4258026376 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6ac0b5850 0x7fe6ac0aa4c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fe6a400efc0 tx=0x7fe6a400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:13.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.875+0000 7fe6a8c00640 1 -- 172.21.15.112:0/4258026376 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4018020 con 0x7fe6ac0b5850 2024-09-12T02:47:13.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.875+0000 7fe6a8c00640 1 -- 172.21.15.112:0/4258026376 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6a4014480 con 0x7fe6ac0b5850 2024-09-12T02:47:13.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.875+0000 7fe6a8c00640 1 -- 172.21.15.112:0/4258026376 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4009e60 con 0x7fe6ac0b5850 2024-09-12T02:47:13.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.876+0000 7fe6b2a00640 1 -- 172.21.15.112:0/4258026376 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6ac15c6d0 con 0x7fe6ac0b5850 2024-09-12T02:47:13.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.876+0000 7fe6b2a00640 1 -- 172.21.15.112:0/4258026376 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6ac15cc90 con 0x7fe6ac0b5850 2024-09-12T02:47:13.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.876+0000 7fe6b2a00640 1 -- 172.21.15.112:0/4258026376 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6ac068a30 con 0x7fe6ac0b5850 2024-09-12T02:47:13.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.877+0000 7fe6a8c00640 1 -- 172.21.15.112:0/4258026376 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe6a4005d10 con 0x7fe6ac0b5850 2024-09-12T02:47:13.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.878+0000 7fe6a8c00640 1 --2- 172.21.15.112:0/4258026376 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe68806be30 0x7fe68806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:13.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.878+0000 7fe6a8c00640 1 -- 172.21.15.112:0/4258026376 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5738+0+0 (secure 0 0 0) 0x7fe6a408bc70 con 0x7fe6ac0b5850 2024-09-12T02:47:13.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.878+0000 7fe6abe00640 1 --2- 172.21.15.112:0/4258026376 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe68806be30 0x7fe68806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:13.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.879+0000 7fe6abe00640 1 --2- 172.21.15.112:0/4258026376 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe68806be30 0x7fe68806e2f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe69c001eb0 tx=0x7fe69c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:13.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:13.883+0000 7fe6a8c00640 1 -- 172.21.15.112:0/4258026376 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe6a4022030 con 0x7fe6ac0b5850 2024-09-12T02:47:14.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.059+0000 7fe6b2a00640 1 -- 172.21.15.112:0/4258026376 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe6ac06e430 con 0x7fe6ac0b5850 2024-09-12T02:47:14.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.060+0000 7fe6a8c00640 1 -- 172.21.15.112:0/4258026376 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) ==== 74+0+16822 (secure 0 0 0) 0x7fe6a4010040 con 0x7fe6ac0b5850 2024-09-12T02:47:14.061 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:14.061 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":109,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:47:05.174500+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:46:34.392830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-12T02:46:35.615193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.2a","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:47:14.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.063+0000 7fe6b2a00640 1 -- 172.21.15.112:0/4258026376 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe68806be30 msgr2=0x7fe68806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:14.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.063+0000 7fe6b2a00640 1 --2- 172.21.15.112:0/4258026376 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe68806be30 0x7fe68806e2f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe69c001eb0 tx=0x7fe69c009040 comp rx=0 tx=0).stop 2024-09-12T02:47:14.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.063+0000 7fe6b2a00640 1 -- 172.21.15.112:0/4258026376 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6ac0b5850 msgr2=0x7fe6ac0aa4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:14.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.063+0000 7fe6b2a00640 1 --2- 172.21.15.112:0/4258026376 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6ac0b5850 0x7fe6ac0aa4c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fe6a400efc0 tx=0x7fe6a400c490 comp rx=0 tx=0).stop 2024-09-12T02:47:14.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.063+0000 7fe6b2a00640 1 -- 172.21.15.112:0/4258026376 shutdown_connections 2024-09-12T02:47:14.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.063+0000 7fe6b2a00640 1 --2- 172.21.15.112:0/4258026376 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6ac0b5850 0x7fe6ac0aa4c0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.063+0000 7fe6b2a00640 1 --2- 172.21.15.112:0/4258026376 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe68806be30 0x7fe68806e2f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.063+0000 7fe6b2a00640 1 --2- 172.21.15.112:0/4258026376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ac06e970 0x7fe6ac0aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.063+0000 7fe6b2a00640 1 --2- 172.21.15.112:0/4258026376 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6ac06e050 0x7fe6ac1450a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.063+0000 7fe6b2a00640 1 -- 172.21.15.112:0/4258026376 >> 172.21.15.112:0/4258026376 conn(0x7fe6ac06bbd0 msgr2=0x7fe6ac0cd530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:14.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.063+0000 7fe6b2a00640 1 -- 172.21.15.112:0/4258026376 shutdown_connections 2024-09-12T02:47:14.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.063+0000 7fe6b2a00640 1 -- 172.21.15.112:0/4258026376 wait complete. 2024-09-12T02:47:14.080 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:47:14.080 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:47:14.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.232+0000 7f753cc00640 1 Processor -- start 2024-09-12T02:47:14.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.232+0000 7f753cc00640 1 -- start start 2024-09-12T02:47:14.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.234+0000 7f753cc00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f753815b9d0 0x7f75380b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:14.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.234+0000 7f753cc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f75380b45d0 0x7f75380728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:14.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.234+0000 7f753cc00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75380b54a0 con 0x7f753806eef0 2024-09-12T02:47:14.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.234+0000 7f753cc00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f75380b4a60 con 0x7f753815b9d0 2024-09-12T02:47:14.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.234+0000 7f753cc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f75380b3af0 con 0x7f75380b45d0 2024-09-12T02:47:14.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.234+0000 7f7536800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f753806eef0 0x7f75380cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47780/0 (socket says 172.21.15.112:47780) 2024-09-12T02:47:14.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.234+0000 7f7536800640 1 -- 172.21.15.112:0/1456367096 learned_addr learned my addr 172.21.15.112:0/1456367096 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:14.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.234+0000 7f7535e00640 1 --2- 172.21.15.112:0/1456367096 >> v2:172.21.15.137:3300/0 conn(0x7f753815b9d0 0x7f75380b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:14.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.234+0000 7f752d400640 1 --2- 172.21.15.112:0/1456367096 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f75380b45d0 0x7f75380728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:14.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.234+0000 7f7535400640 1 -- 172.21.15.112:0/1456367096 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3280861968 0 0) 0x7f75380b54a0 con 0x7f753806eef0 2024-09-12T02:47:14.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.234+0000 7f7535400640 1 -- 172.21.15.112:0/1456367096 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f751c003520 con 0x7f753806eef0 2024-09-12T02:47:14.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.235+0000 7f7535e00640 1 -- 172.21.15.112:0/1456367096 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f75380b45d0 msgr2=0x7f75380728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:14.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.235+0000 7f7535e00640 1 --2- 172.21.15.112:0/1456367096 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f75380b45d0 0x7f75380728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.235+0000 7f7535e00640 1 -- 172.21.15.112:0/1456367096 >> v1:172.21.15.112:6789/0 conn(0x7f753806eef0 legacy=0x7f75380cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:14.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.235+0000 7f7535e00640 1 -- 172.21.15.112:0/1456367096 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75380b3dd0 con 0x7f753815b9d0 2024-09-12T02:47:14.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.236+0000 7f7535e00640 1 --2- 172.21.15.112:0/1456367096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f753815b9d0 0x7f75380b4ec0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f75280097a0 tx=0x7f752802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff2f879c96266247 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:14.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.236+0000 7f7535400640 1 -- 172.21.15.112:0/1456367096 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7528037070 con 0x7f753815b9d0 2024-09-12T02:47:14.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.236+0000 7f7535400640 1 -- 172.21.15.112:0/1456367096 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7528032440 con 0x7f753815b9d0 2024-09-12T02:47:14.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.236+0000 7f7535400640 1 -- 172.21.15.112:0/1456367096 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7528032810 con 0x7f753815b9d0 2024-09-12T02:47:14.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.236+0000 7f753cc00640 1 -- 172.21.15.112:0/1456367096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f753815b9d0 msgr2=0x7f75380b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:14.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.236+0000 7f753cc00640 1 --2- 172.21.15.112:0/1456367096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f753815b9d0 0x7f75380b4ec0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f75280097a0 tx=0x7f752802a180 comp rx=0 tx=0).stop 2024-09-12T02:47:14.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.237+0000 7f753cc00640 1 -- 172.21.15.112:0/1456367096 shutdown_connections 2024-09-12T02:47:14.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.237+0000 7f753cc00640 1 --2- 172.21.15.112:0/1456367096 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f75380b45d0 0x7f75380728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.237+0000 7f753cc00640 1 --2- 172.21.15.112:0/1456367096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f753815b9d0 0x7f75380b4ec0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.237+0000 7f753cc00640 1 -- 172.21.15.112:0/1456367096 >> 172.21.15.112:0/1456367096 conn(0x7f753806bbd0 msgr2=0x7f753806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:14.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.237+0000 7f753cc00640 1 -- 172.21.15.112:0/1456367096 shutdown_connections 2024-09-12T02:47:14.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.237+0000 7f753cc00640 1 -- 172.21.15.112:0/1456367096 wait complete. 2024-09-12T02:47:14.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.238+0000 7f753cc00640 1 Processor -- start 2024-09-12T02:47:14.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.238+0000 7f753cc00640 1 -- start start 2024-09-12T02:47:14.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.239+0000 7f753cc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f753806eef0 0x7f753815d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:14.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.239+0000 7f753cc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75380b45d0 0x7f7538155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:14.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.239+0000 7f753cc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f753815b9d0 0x7f75381556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:14.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.239+0000 7f753cc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f753815bf30 con 0x7f75380b45d0 2024-09-12T02:47:14.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.239+0000 7f753cc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f753815bdb0 con 0x7f753806eef0 2024-09-12T02:47:14.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.239+0000 7f753cc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f753806f320 con 0x7f753815b9d0 2024-09-12T02:47:14.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.240+0000 7f752d400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75380b45d0 0x7f7538155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:14.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.240+0000 7f752d400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75380b45d0 0x7f7538155180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46632/0 (socket says 172.21.15.112:46632) 2024-09-12T02:47:14.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.240+0000 7f752d400640 1 -- 172.21.15.112:0/3211919020 learned_addr learned my addr 172.21.15.112:0/3211919020 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:14.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.240+0000 7f7535e00640 1 --2- 172.21.15.112:0/3211919020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f753806eef0 0x7f753815d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:14.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.240+0000 7f7536800640 1 --2- 172.21.15.112:0/3211919020 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f753815b9d0 0x7f75381556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:14.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.240+0000 7f7535e00640 1 -- 172.21.15.112:0/3211919020 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f753815b9d0 msgr2=0x7f75381556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:14.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.240+0000 7f7535e00640 1 --2- 172.21.15.112:0/3211919020 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f753815b9d0 0x7f75381556c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.240+0000 7f7535e00640 1 -- 172.21.15.112:0/3211919020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75380b45d0 msgr2=0x7f7538155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:14.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.240+0000 7f7535e00640 1 --2- 172.21.15.112:0/3211919020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75380b45d0 0x7f7538155180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.240+0000 7f7535e00640 1 -- 172.21.15.112:0/3211919020 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f753815c4a0 con 0x7f753806eef0 2024-09-12T02:47:14.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.240+0000 7f752d400640 1 --2- 172.21.15.112:0/3211919020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75380b45d0 0x7f7538155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:14.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.241+0000 7f7535e00640 1 --2- 172.21.15.112:0/3211919020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f753806eef0 0x7f753815d540 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7528031000 tx=0x7f75280046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:14.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.241+0000 7f752ea00640 1 -- 172.21.15.112:0/3211919020 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7528041030 con 0x7f753806eef0 2024-09-12T02:47:14.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.241+0000 7f752ea00640 1 -- 172.21.15.112:0/3211919020 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f752803d4e0 con 0x7f753806eef0 2024-09-12T02:47:14.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.241+0000 7f753cc00640 1 -- 172.21.15.112:0/3211919020 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f753815c780 con 0x7f753806eef0 2024-09-12T02:47:14.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.241+0000 7f752ea00640 1 -- 172.21.15.112:0/3211919020 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7528037040 con 0x7f753806eef0 2024-09-12T02:47:14.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.241+0000 7f753cc00640 1 -- 172.21.15.112:0/3211919020 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f753815cd40 con 0x7f753806eef0 2024-09-12T02:47:14.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.242+0000 7f753cc00640 1 -- 172.21.15.112:0/3211919020 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f753806f700 con 0x7f753806eef0 2024-09-12T02:47:14.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.243+0000 7f752ea00640 1 -- 172.21.15.112:0/3211919020 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f752803d8b0 con 0x7f753806eef0 2024-09-12T02:47:14.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.244+0000 7f752ea00640 1 --2- 172.21.15.112:0/3211919020 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f751406be30 0x7f751406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:14.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.244+0000 7f752ea00640 1 -- 172.21.15.112:0/3211919020 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5738+0+0 (secure 0 0 0) 0x7f75280aaf50 con 0x7f753806eef0 2024-09-12T02:47:14.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.244+0000 7f752d400640 1 --2- 172.21.15.112:0/3211919020 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f751406be30 0x7f751406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:14.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.245+0000 7f752d400640 1 --2- 172.21.15.112:0/3211919020 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f751406be30 0x7f751406e2f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f75380cbd80 tx=0x7f7520009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:14.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.250+0000 7f752ea00640 1 -- 172.21.15.112:0/3211919020 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f752804b020 con 0x7f753806eef0 2024-09-12T02:47:14.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.457+0000 7f753cc00640 1 -- 172.21.15.112:0/3211919020 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7538071c40 con 0x7f753806eef0 2024-09-12T02:47:14.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.458+0000 7f752ea00640 1 -- 172.21.15.112:0/3211919020 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5234 (secure 0 0 0) 0x7f7528079280 con 0x7f753806eef0 2024-09-12T02:47:14.459 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:14.459 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":53,"btime":"2024-09-12T02:46:40:250353+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1897464411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1897464411},{"type":"v1","addr":"172.21.15.137:6834","nonce":1897464411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":5785,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3500913266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3500913266},{"type":"v1","addr":"172.21.15.137:6835","nonce":3500913266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":6144,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/611029461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":611029461},{"type":"v1","addr":"172.21.15.112:6836","nonce":611029461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:46:36.623382+0000","modified":"2024-09-12T02:46:39.653409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6150":{"gid":6150,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/1018665478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1018665478},{"type":"v1","addr":"172.21.15.112:6837","nonce":1018665478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6150,"qdb_cluster":[6150]},"id":6}]} 2024-09-12T02:47:14.460 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 53 2024-09-12T02:47:14.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.460+0000 7f753cc00640 1 -- 172.21.15.112:0/3211919020 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f751406be30 msgr2=0x7f751406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:14.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.460+0000 7f753cc00640 1 --2- 172.21.15.112:0/3211919020 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f751406be30 0x7f751406e2f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f75380cbd80 tx=0x7f7520009110 comp rx=0 tx=0).stop 2024-09-12T02:47:14.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.460+0000 7f753cc00640 1 -- 172.21.15.112:0/3211919020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f753806eef0 msgr2=0x7f753815d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:14.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.460+0000 7f753cc00640 1 --2- 172.21.15.112:0/3211919020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f753806eef0 0x7f753815d540 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7528031000 tx=0x7f75280046c0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.461+0000 7f753cc00640 1 -- 172.21.15.112:0/3211919020 shutdown_connections 2024-09-12T02:47:14.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.461+0000 7f753cc00640 1 --2- 172.21.15.112:0/3211919020 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f753815b9d0 0x7f75381556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.461+0000 7f753cc00640 1 --2- 172.21.15.112:0/3211919020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75380b45d0 0x7f7538155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.461+0000 7f753cc00640 1 --2- 172.21.15.112:0/3211919020 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f751406be30 0x7f751406e2f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.461+0000 7f753cc00640 1 --2- 172.21.15.112:0/3211919020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f753806eef0 0x7f753815d540 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.461+0000 7f753cc00640 1 -- 172.21.15.112:0/3211919020 >> 172.21.15.112:0/3211919020 conn(0x7f753806bbd0 msgr2=0x7f7538072440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:14.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.461+0000 7f753cc00640 1 -- 172.21.15.112:0/3211919020 shutdown_connections 2024-09-12T02:47:14.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.461+0000 7f753cc00640 1 -- 172.21.15.112:0/3211919020 wait complete. 2024-09-12T02:47:14.478 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:47:14.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.630+0000 7fb59f200640 1 Processor -- start 2024-09-12T02:47:14.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.630+0000 7fb59f200640 1 -- start start 2024-09-12T02:47:14.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.631+0000 7fb59f200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5a00d1710 0x7fb5a00d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:14.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.631+0000 7fb59f200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb5a00b3e00 0x7fb5a00d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:14.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.631+0000 7fb59f200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5a00d2fb0 con 0x7fb5a00cf7a0 2024-09-12T02:47:14.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.631+0000 7fb59f200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb5a00d3cb0 con 0x7fb5a00b3e00 2024-09-12T02:47:14.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.631+0000 7fb59f200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb5a00d0b60 con 0x7fb5a00d1710 2024-09-12T02:47:14.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.631+0000 7fb59e800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb5a00cf7a0 0x7fb5a00cfc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47782/0 (socket says 172.21.15.112:47782) 2024-09-12T02:47:14.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.631+0000 7fb59e800640 1 -- 172.21.15.112:0/401571513 learned_addr learned my addr 172.21.15.112:0/401571513 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:14.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.632+0000 7fb59d400640 1 --2- 172.21.15.112:0/401571513 >> v2:172.21.15.137:3300/0 conn(0x7fb5a00b3e00 0x7fb5a00d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:14.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.632+0000 7fb59de00640 1 --2- 172.21.15.112:0/401571513 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5a00d1710 0x7fb5a00d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:14.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.632+0000 7fb59ca00640 1 -- 172.21.15.112:0/401571513 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1103194078 0 0) 0x7fb5a00d2fb0 con 0x7fb5a00cf7a0 2024-09-12T02:47:14.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.632+0000 7fb59ca00640 1 -- 172.21.15.112:0/401571513 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb584003520 con 0x7fb5a00cf7a0 2024-09-12T02:47:14.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.632+0000 7fb59d400640 1 -- 172.21.15.112:0/401571513 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5a00d1710 msgr2=0x7fb5a00d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:14.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.632+0000 7fb59d400640 1 --2- 172.21.15.112:0/401571513 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5a00d1710 0x7fb5a00d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.632+0000 7fb59d400640 1 -- 172.21.15.112:0/401571513 >> v1:172.21.15.112:6789/0 conn(0x7fb5a00cf7a0 legacy=0x7fb5a00cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:14.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.632+0000 7fb59d400640 1 -- 172.21.15.112:0/401571513 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a00d2030 con 0x7fb5a00b3e00 2024-09-12T02:47:14.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.633+0000 7fb59d400640 1 --2- 172.21.15.112:0/401571513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5a00b3e00 0x7fb5a00d1af0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb58c0097a0 tx=0x7fb58c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f93097e0e5c7dbc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:14.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.634+0000 7fb59ca00640 1 -- 172.21.15.112:0/401571513 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb58c037070 con 0x7fb5a00b3e00 2024-09-12T02:47:14.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.634+0000 7fb59ca00640 1 -- 172.21.15.112:0/401571513 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb58c032440 con 0x7fb5a00b3e00 2024-09-12T02:47:14.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.634+0000 7fb59ca00640 1 -- 172.21.15.112:0/401571513 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb58c032810 con 0x7fb5a00b3e00 2024-09-12T02:47:14.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.634+0000 7fb59f200640 1 -- 172.21.15.112:0/401571513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5a00b3e00 msgr2=0x7fb5a00d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:14.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.634+0000 7fb59f200640 1 --2- 172.21.15.112:0/401571513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5a00b3e00 0x7fb5a00d1af0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb58c0097a0 tx=0x7fb58c02a180 comp rx=0 tx=0).stop 2024-09-12T02:47:14.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.634+0000 7fb59f200640 1 -- 172.21.15.112:0/401571513 shutdown_connections 2024-09-12T02:47:14.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.634+0000 7fb59f200640 1 --2- 172.21.15.112:0/401571513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5a00b3e00 0x7fb5a00d1af0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.634+0000 7fb59f200640 1 --2- 172.21.15.112:0/401571513 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5a00d1710 0x7fb5a00d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.634+0000 7fb59f200640 1 -- 172.21.15.112:0/401571513 >> 172.21.15.112:0/401571513 conn(0x7fb5a009e030 msgr2=0x7fb5a00d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:14.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.634+0000 7fb59f200640 1 -- 172.21.15.112:0/401571513 shutdown_connections 2024-09-12T02:47:14.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.634+0000 7fb59f200640 1 -- 172.21.15.112:0/401571513 wait complete. 2024-09-12T02:47:14.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.636+0000 7fb59f200640 1 Processor -- start 2024-09-12T02:47:14.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.636+0000 7fb59f200640 1 -- start start 2024-09-12T02:47:14.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.637+0000 7fb59f200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5a00b3e00 0x7fb5a01616d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:14.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.637+0000 7fb59f200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a00cf7a0 0x7fb5a00b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:14.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.637+0000 7fb59f200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5a00d1710 0x7fb5a00b4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:14.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.637+0000 7fb59f200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a00d39d0 con 0x7fb5a00cf7a0 2024-09-12T02:47:14.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.637+0000 7fb59f200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a00d36f0 con 0x7fb5a00b3e00 2024-09-12T02:47:14.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.637+0000 7fb59f200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb5a015f110 con 0x7fb5a00d1710 2024-09-12T02:47:14.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.637+0000 7fb59d400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a00cf7a0 0x7fb5a00b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:14.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.637+0000 7fb59d400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a00cf7a0 0x7fb5a00b42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46638/0 (socket says 172.21.15.112:46638) 2024-09-12T02:47:14.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.637+0000 7fb59d400640 1 -- 172.21.15.112:0/4195112176 learned_addr learned my addr 172.21.15.112:0/4195112176 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:14.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.637+0000 7fb59de00640 1 --2- 172.21.15.112:0/4195112176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5a00b3e00 0x7fb5a01616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:14.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.637+0000 7fb59e800640 1 --2- 172.21.15.112:0/4195112176 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5a00d1710 0x7fb5a00b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:14.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.637+0000 7fb59d400640 1 -- 172.21.15.112:0/4195112176 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5a00d1710 msgr2=0x7fb5a00b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:14.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.637+0000 7fb59d400640 1 --2- 172.21.15.112:0/4195112176 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5a00d1710 0x7fb5a00b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.638+0000 7fb59d400640 1 -- 172.21.15.112:0/4195112176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5a00b3e00 msgr2=0x7fb5a01616d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:14.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.638+0000 7fb59d400640 1 --2- 172.21.15.112:0/4195112176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5a00b3e00 0x7fb5a01616d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.638+0000 7fb59d400640 1 -- 172.21.15.112:0/4195112176 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a0160630 con 0x7fb5a00cf7a0 2024-09-12T02:47:14.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.638+0000 7fb59de00640 1 --2- 172.21.15.112:0/4195112176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5a00b3e00 0x7fb5a01616d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:14.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.638+0000 7fb59d400640 1 --2- 172.21.15.112:0/4195112176 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a00cf7a0 0x7fb5a00b42e0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fb58c0097a0 tx=0x7fb58c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:14.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.638+0000 7fb596000640 1 -- 172.21.15.112:0/4195112176 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb58c041070 con 0x7fb5a00cf7a0 2024-09-12T02:47:14.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.638+0000 7fb596000640 1 -- 172.21.15.112:0/4195112176 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb58c03c870 con 0x7fb5a00cf7a0 2024-09-12T02:47:14.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.638+0000 7fb596000640 1 -- 172.21.15.112:0/4195112176 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb58c037040 con 0x7fb5a00cf7a0 2024-09-12T02:47:14.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.638+0000 7fb59f200640 1 -- 172.21.15.112:0/4195112176 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a0160910 con 0x7fb5a00cf7a0 2024-09-12T02:47:14.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.638+0000 7fb59f200640 1 -- 172.21.15.112:0/4195112176 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a0160ed0 con 0x7fb5a00cf7a0 2024-09-12T02:47:14.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.639+0000 7fb59f200640 1 -- 172.21.15.112:0/4195112176 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5a00d1af0 con 0x7fb5a00cf7a0 2024-09-12T02:47:14.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.640+0000 7fb596000640 1 -- 172.21.15.112:0/4195112176 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb58c044070 con 0x7fb5a00cf7a0 2024-09-12T02:47:14.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.641+0000 7fb596000640 1 --2- 172.21.15.112:0/4195112176 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb58006be30 0x7fb58006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:14.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.641+0000 7fb596000640 1 -- 172.21.15.112:0/4195112176 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5738+0+0 (secure 0 0 0) 0x7fb58c0ab8f0 con 0x7fb5a00cf7a0 2024-09-12T02:47:14.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.641+0000 7fb59de00640 1 --2- 172.21.15.112:0/4195112176 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb58006be30 0x7fb58006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:14.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.642+0000 7fb59de00640 1 --2- 172.21.15.112:0/4195112176 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb58006be30 0x7fb58006e2f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb590009af0 tx=0x7fb590008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:14.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.645+0000 7fb596000640 1 -- 172.21.15.112:0/4195112176 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb58c07a1e0 con 0x7fb5a00cf7a0 2024-09-12T02:47:14.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.851+0000 7fb59f200640 1 -- 172.21.15.112:0/4195112176 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5a006d810 con 0x7fb5a00cf7a0 2024-09-12T02:47:14.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.851+0000 7fb596000640 1 -- 172.21.15.112:0/4195112176 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5234 (secure 0 0 0) 0x7fb58c079ae0 con 0x7fb5a00cf7a0 2024-09-12T02:47:14.852 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:14.853 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":53,"btime":"2024-09-12T02:46:40:250353+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1897464411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1897464411},{"type":"v1","addr":"172.21.15.137:6834","nonce":1897464411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":5785,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3500913266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3500913266},{"type":"v1","addr":"172.21.15.137:6835","nonce":3500913266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":6144,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/611029461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":611029461},{"type":"v1","addr":"172.21.15.112:6836","nonce":611029461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:46:36.623382+0000","modified":"2024-09-12T02:46:39.653409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6150":{"gid":6150,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/1018665478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":1018665478},{"type":"v1","addr":"172.21.15.112:6837","nonce":1018665478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6150,"qdb_cluster":[6150]},"id":6}]} 2024-09-12T02:47:14.853 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 53 2024-09-12T02:47:14.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.853+0000 7fb59f200640 1 -- 172.21.15.112:0/4195112176 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb58006be30 msgr2=0x7fb58006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:14.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.853+0000 7fb59f200640 1 --2- 172.21.15.112:0/4195112176 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb58006be30 0x7fb58006e2f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb590009af0 tx=0x7fb590008040 comp rx=0 tx=0).stop 2024-09-12T02:47:14.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.853+0000 7fb59f200640 1 -- 172.21.15.112:0/4195112176 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a00cf7a0 msgr2=0x7fb5a00b42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:14.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.853+0000 7fb59f200640 1 --2- 172.21.15.112:0/4195112176 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a00cf7a0 0x7fb5a00b42e0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fb58c0097a0 tx=0x7fb58c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.853+0000 7fb59f200640 1 -- 172.21.15.112:0/4195112176 shutdown_connections 2024-09-12T02:47:14.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.853+0000 7fb59f200640 1 --2- 172.21.15.112:0/4195112176 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5a00d1710 0x7fb5a00b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.853+0000 7fb59f200640 1 --2- 172.21.15.112:0/4195112176 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a00cf7a0 0x7fb5a00b42e0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.853+0000 7fb59f200640 1 --2- 172.21.15.112:0/4195112176 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb58006be30 0x7fb58006e2f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.853+0000 7fb59f200640 1 --2- 172.21.15.112:0/4195112176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5a00b3e00 0x7fb5a01616d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.853+0000 7fb59f200640 1 -- 172.21.15.112:0/4195112176 >> 172.21.15.112:0/4195112176 conn(0x7fb5a009e030 msgr2=0x7fb5a00b7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:14.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.853+0000 7fb59f200640 1 -- 172.21.15.112:0/4195112176 shutdown_connections 2024-09-12T02:47:14.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:14.853+0000 7fb59f200640 1 -- 172.21.15.112:0/4195112176 wait complete. 2024-09-12T02:47:14.870 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:47:15.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.023+0000 7fa529000640 1 Processor -- start 2024-09-12T02:47:15.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.023+0000 7fa529000640 1 -- start start 2024-09-12T02:47:15.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.024+0000 7fa529000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa52406f600 0x7fa5240b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:15.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.024+0000 7fa529000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa5240b45d0 0x7fa5240728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:15.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.024+0000 7fa529000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5240b4a20 con 0x7fa52415b9d0 2024-09-12T02:47:15.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.024+0000 7fa529000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa5240b54a0 con 0x7fa5240b45d0 2024-09-12T02:47:15.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.024+0000 7fa529000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa5240b3af0 con 0x7fa52406f600 2024-09-12T02:47:15.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.024+0000 7fa522800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa5240b45d0 0x7fa5240728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:15.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.024+0000 7fa522800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa5240b45d0 0x7fa5240728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46644/0 (socket says 172.21.15.112:46644) 2024-09-12T02:47:15.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.024+0000 7fa522800640 1 -- 172.21.15.112:0/1902289965 learned_addr learned my addr 172.21.15.112:0/1902289965 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:15.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.024+0000 7fa519400640 1 --2- 172.21.15.112:0/1902289965 >> v2:172.21.15.137:3300/0 conn(0x7fa52406f600 0x7fa5240b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:15.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.025+0000 7fa522800640 1 -- 172.21.15.112:0/1902289965 >> v2:172.21.15.137:3300/0 conn(0x7fa52406f600 msgr2=0x7fa5240b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:15.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.025+0000 7fa522800640 1 --2- 172.21.15.112:0/1902289965 >> v2:172.21.15.137:3300/0 conn(0x7fa52406f600 0x7fa5240b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.025+0000 7fa522800640 1 -- 172.21.15.112:0/1902289965 >> v1:172.21.15.137:6789/0 conn(0x7fa52415b9d0 legacy=0x7fa52406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:15.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.025+0000 7fa522800640 1 -- 172.21.15.112:0/1902289965 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5240b3dd0 con 0x7fa5240b45d0 2024-09-12T02:47:15.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.026+0000 7fa522800640 1 --2- 172.21.15.112:0/1902289965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5240b45d0 0x7fa5240728c0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fa524071200 tx=0x7fa51c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e15abf6a9442f72 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:15.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.026+0000 7fa521400640 1 -- 172.21.15.112:0/1902289965 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51c036070 con 0x7fa5240b45d0 2024-09-12T02:47:15.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.026+0000 7fa521400640 1 -- 172.21.15.112:0/1902289965 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa51c031600 con 0x7fa5240b45d0 2024-09-12T02:47:15.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.026+0000 7fa521400640 1 -- 172.21.15.112:0/1902289965 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51c0319d0 con 0x7fa5240b45d0 2024-09-12T02:47:15.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.026+0000 7fa529000640 1 -- 172.21.15.112:0/1902289965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5240b45d0 msgr2=0x7fa5240728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:15.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.026+0000 7fa529000640 1 --2- 172.21.15.112:0/1902289965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5240b45d0 0x7fa5240728c0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fa524071200 tx=0x7fa51c02a6a0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.026+0000 7fa529000640 1 -- 172.21.15.112:0/1902289965 shutdown_connections 2024-09-12T02:47:15.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.026+0000 7fa529000640 1 --2- 172.21.15.112:0/1902289965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5240b45d0 0x7fa5240728c0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.026+0000 7fa529000640 1 --2- 172.21.15.112:0/1902289965 >> v2:172.21.15.137:3300/0 conn(0x7fa52406f600 0x7fa5240b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.026+0000 7fa529000640 1 -- 172.21.15.112:0/1902289965 >> 172.21.15.112:0/1902289965 conn(0x7fa52406bbd0 msgr2=0x7fa52406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:15.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.027+0000 7fa529000640 1 -- 172.21.15.112:0/1902289965 shutdown_connections 2024-09-12T02:47:15.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.027+0000 7fa529000640 1 -- 172.21.15.112:0/1902289965 wait complete. 2024-09-12T02:47:15.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.028+0000 7fa529000640 1 Processor -- start 2024-09-12T02:47:15.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.028+0000 7fa529000640 1 -- start start 2024-09-12T02:47:15.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.029+0000 7fa529000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa52406f600 0x7fa52414f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:15.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.029+0000 7fa529000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5240b45d0 0x7fa52414f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:15.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.029+0000 7fa529000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa52415b9d0 0x7fa52415d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:15.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.029+0000 7fa529000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa52415bf30 con 0x7fa5240b45d0 2024-09-12T02:47:15.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.029+0000 7fa529000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa52415bdb0 con 0x7fa52406f600 2024-09-12T02:47:15.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.029+0000 7fa529000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa5240cdcd0 con 0x7fa52415b9d0 2024-09-12T02:47:15.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.030+0000 7fa519400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5240b45d0 0x7fa52414f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:15.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.030+0000 7fa519400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5240b45d0 0x7fa52414f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46646/0 (socket says 172.21.15.112:46646) 2024-09-12T02:47:15.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.030+0000 7fa519400640 1 -- 172.21.15.112:0/2605624926 learned_addr learned my addr 172.21.15.112:0/2605624926 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:15.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.030+0000 7fa521e00640 1 --2- 172.21.15.112:0/2605624926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa52406f600 0x7fa52414f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:15.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.030+0000 7fa522800640 1 --2- 172.21.15.112:0/2605624926 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa52415b9d0 0x7fa52415d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:15.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.030+0000 7fa519400640 1 -- 172.21.15.112:0/2605624926 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa52415b9d0 msgr2=0x7fa52415d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:15.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.030+0000 7fa519400640 1 --2- 172.21.15.112:0/2605624926 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa52415b9d0 0x7fa52415d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.030+0000 7fa519400640 1 -- 172.21.15.112:0/2605624926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa52406f600 msgr2=0x7fa52414f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:15.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.030+0000 7fa519400640 1 --2- 172.21.15.112:0/2605624926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa52406f600 0x7fa52414f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.030+0000 7fa519400640 1 -- 172.21.15.112:0/2605624926 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5241553e0 con 0x7fa5240b45d0 2024-09-12T02:47:15.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.030+0000 7fa522800640 1 --2- 172.21.15.112:0/2605624926 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa52415b9d0 0x7fa52415d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:15.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.030+0000 7fa519400640 1 --2- 172.21.15.112:0/2605624926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5240b45d0 0x7fa52414f900 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fa50c00d830 tx=0x7fa50c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:15.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.030+0000 7fa51aa00640 1 -- 172.21.15.112:0/2605624926 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c007e10 con 0x7fa5240b45d0 2024-09-12T02:47:15.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.031+0000 7fa51aa00640 1 -- 172.21.15.112:0/2605624926 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa50c018070 con 0x7fa5240b45d0 2024-09-12T02:47:15.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.031+0000 7fa529000640 1 -- 172.21.15.112:0/2605624926 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5241556c0 con 0x7fa5240b45d0 2024-09-12T02:47:15.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.031+0000 7fa51aa00640 1 -- 172.21.15.112:0/2605624926 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c005dc0 con 0x7fa5240b45d0 2024-09-12T02:47:15.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.031+0000 7fa529000640 1 -- 172.21.15.112:0/2605624926 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa52415d120 con 0x7fa5240b45d0 2024-09-12T02:47:15.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.032+0000 7fa529000640 1 -- 172.21.15.112:0/2605624926 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa524068a30 con 0x7fa5240b45d0 2024-09-12T02:47:15.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.033+0000 7fa51aa00640 1 -- 172.21.15.112:0/2605624926 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa50c00b6c0 con 0x7fa5240b45d0 2024-09-12T02:47:15.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.033+0000 7fa51aa00640 1 --2- 172.21.15.112:0/2605624926 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa50006be60 0x7fa50006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:15.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.034+0000 7fa51aa00640 1 -- 172.21.15.112:0/2605624926 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5738+0+0 (secure 0 0 0) 0x7fa50c08aea0 con 0x7fa5240b45d0 2024-09-12T02:47:15.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.034+0000 7fa521e00640 1 --2- 172.21.15.112:0/2605624926 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa50006be60 0x7fa50006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:15.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.034+0000 7fa521e00640 1 --2- 172.21.15.112:0/2605624926 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa50006be60 0x7fa50006e320 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa52415e2a0 tx=0x7fa514009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:15.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.038+0000 7fa51aa00640 1 -- 172.21.15.112:0/2605624926 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa50c0598c0 con 0x7fa5240b45d0 2024-09-12T02:47:15.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.213+0000 7fa529000640 1 -- 172.21.15.112:0/2605624926 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa52406ed40 con 0x7fa5240b45d0 2024-09-12T02:47:15.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.214+0000 7fa51aa00640 1 -- 172.21.15.112:0/2605624926 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) ==== 74+0+16822 (secure 0 0 0) 0x7fa50c0591c0 con 0x7fa5240b45d0 2024-09-12T02:47:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:15.216 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":109,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:47:05.174500+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:46:34.392830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-12T02:46:35.615193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.2a","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:47:15.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.216+0000 7fa529000640 1 -- 172.21.15.112:0/2605624926 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa50006be60 msgr2=0x7fa50006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:15.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.216+0000 7fa529000640 1 --2- 172.21.15.112:0/2605624926 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa50006be60 0x7fa50006e320 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa52415e2a0 tx=0x7fa514009040 comp rx=0 tx=0).stop 2024-09-12T02:47:15.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.216+0000 7fa529000640 1 -- 172.21.15.112:0/2605624926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5240b45d0 msgr2=0x7fa52414f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:15.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.216+0000 7fa529000640 1 --2- 172.21.15.112:0/2605624926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5240b45d0 0x7fa52414f900 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fa50c00d830 tx=0x7fa50c00dcf0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.216+0000 7fa529000640 1 -- 172.21.15.112:0/2605624926 shutdown_connections 2024-09-12T02:47:15.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.216+0000 7fa529000640 1 --2- 172.21.15.112:0/2605624926 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa52415b9d0 0x7fa52415d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.216+0000 7fa529000640 1 --2- 172.21.15.112:0/2605624926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5240b45d0 0x7fa52414f900 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.216+0000 7fa529000640 1 --2- 172.21.15.112:0/2605624926 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa50006be60 0x7fa50006e320 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.216+0000 7fa529000640 1 --2- 172.21.15.112:0/2605624926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa52406f600 0x7fa52414f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.217+0000 7fa529000640 1 -- 172.21.15.112:0/2605624926 >> 172.21.15.112:0/2605624926 conn(0x7fa52406bbd0 msgr2=0x7fa524158620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:15.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.217+0000 7fa529000640 1 -- 172.21.15.112:0/2605624926 shutdown_connections 2024-09-12T02:47:15.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.217+0000 7fa529000640 1 -- 172.21.15.112:0/2605624926 wait complete. 2024-09-12T02:47:15.233 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:47:15.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.386+0000 7f447ea00640 1 Processor -- start 2024-09-12T02:47:15.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.387+0000 7f447ea00640 1 -- start start 2024-09-12T02:47:15.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.388+0000 7f447ea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44780afe30 0x7f44780cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:15.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.388+0000 7f447ea00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44780ceeb0 con 0x7f4478071530 2024-09-12T02:47:15.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.388+0000 7f447ea00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f447806e300 con 0x7f447815cc50 2024-09-12T02:47:15.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.388+0000 7f447ea00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f447815d030 con 0x7f44780afe30 2024-09-12T02:47:15.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.388+0000 7f4477400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f4478071530 0x7f44780af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47798/0 (socket says 172.21.15.112:47798) 2024-09-12T02:47:15.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.388+0000 7f4477400640 1 -- 172.21.15.112:0/1004555150 learned_addr learned my addr 172.21.15.112:0/1004555150 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:15.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.388+0000 7f447ca00640 1 --2- 172.21.15.112:0/1004555150 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44780afe30 0x7f44780cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:15.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.388+0000 7f4476a00640 1 -- 172.21.15.112:0/1004555150 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 337240834 0 0) 0x7f44780ceeb0 con 0x7f4478071530 2024-09-12T02:47:15.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.388+0000 7f4476a00640 1 -- 172.21.15.112:0/1004555150 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f445c003520 con 0x7f4478071530 2024-09-12T02:47:15.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.389+0000 7f4476a00640 1 -- 172.21.15.112:0/1004555150 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 62811040 0 0) 0x7f447806e300 con 0x7f447815cc50 2024-09-12T02:47:15.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.389+0000 7f4476a00640 1 -- 172.21.15.112:0/1004555150 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44780ceeb0 con 0x7f447815cc50 2024-09-12T02:47:15.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.389+0000 7f447ca00640 1 -- 172.21.15.112:0/1004555150 >> v1:172.21.15.137:6789/0 conn(0x7f447815cc50 legacy=0x7f44780732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:15.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.389+0000 7f4476a00640 1 -- 172.21.15.112:0/1004555150 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3244346774 0 0) 0x7f445c003520 con 0x7f4478071530 2024-09-12T02:47:15.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.389+0000 7f447ca00640 1 -- 172.21.15.112:0/1004555150 >> v1:172.21.15.112:6789/0 conn(0x7f4478071530 legacy=0x7f44780af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:15.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.389+0000 7f447ca00640 1 -- 172.21.15.112:0/1004555150 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f447806e5e0 con 0x7f44780afe30 2024-09-12T02:47:15.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.390+0000 7f447ca00640 1 --2- 172.21.15.112:0/1004555150 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44780afe30 0x7f44780cf950 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f44700097d0 tx=0x7f447002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b1b690f3cb05ef9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:15.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.390+0000 7f4476a00640 1 -- 172.21.15.112:0/1004555150 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4470037070 con 0x7f44780afe30 2024-09-12T02:47:15.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.390+0000 7f4476a00640 1 -- 172.21.15.112:0/1004555150 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f447002ab90 con 0x7f44780afe30 2024-09-12T02:47:15.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.390+0000 7f4476a00640 1 -- 172.21.15.112:0/1004555150 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44640017f0 con 0x7f44780afe30 2024-09-12T02:47:15.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.391+0000 7f447ea00640 1 -- 172.21.15.112:0/1004555150 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44780afe30 msgr2=0x7f44780cf950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:15.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.391+0000 7f447ea00640 1 --2- 172.21.15.112:0/1004555150 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44780afe30 0x7f44780cf950 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f44700097d0 tx=0x7f447002a100 comp rx=0 tx=0).stop 2024-09-12T02:47:15.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.391+0000 7f447ea00640 1 -- 172.21.15.112:0/1004555150 shutdown_connections 2024-09-12T02:47:15.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.391+0000 7f447ea00640 1 --2- 172.21.15.112:0/1004555150 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44780afe30 0x7f44780cf950 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.391+0000 7f447ea00640 1 -- 172.21.15.112:0/1004555150 >> 172.21.15.112:0/1004555150 conn(0x7f447806bbd0 msgr2=0x7f447806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:15.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.391+0000 7f447ea00640 1 -- 172.21.15.112:0/1004555150 shutdown_connections 2024-09-12T02:47:15.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.391+0000 7f447ea00640 1 -- 172.21.15.112:0/1004555150 wait complete. 2024-09-12T02:47:15.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.392+0000 7f447ea00640 1 Processor -- start 2024-09-12T02:47:15.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.393+0000 7f447ea00640 1 -- start start 2024-09-12T02:47:15.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.393+0000 7f447ea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4478071530 0x7f44780aa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:15.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.393+0000 7f447ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44780afe30 0x7f44780aaa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:15.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.393+0000 7f447ea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f447815cc50 0x7f4478144e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:15.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.393+0000 7f447ea00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f447806f510 con 0x7f44780afe30 2024-09-12T02:47:15.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.393+0000 7f447ea00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f44780cf4c0 con 0x7f4478071530 2024-09-12T02:47:15.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.393+0000 7f447ea00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f447806f690 con 0x7f447815cc50 2024-09-12T02:47:15.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.394+0000 7f4477400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44780afe30 0x7f44780aaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:15.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.394+0000 7f4477400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44780afe30 0x7f44780aaa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46654/0 (socket says 172.21.15.112:46654) 2024-09-12T02:47:15.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.394+0000 7f4477400640 1 -- 172.21.15.112:0/1002383926 learned_addr learned my addr 172.21.15.112:0/1002383926 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:15.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.394+0000 7f4477e00640 1 --2- 172.21.15.112:0/1002383926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4478071530 0x7f44780aa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:15.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.394+0000 7f447ca00640 1 --2- 172.21.15.112:0/1002383926 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f447815cc50 0x7f4478144e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:15.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.394+0000 7f4477400640 1 -- 172.21.15.112:0/1002383926 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f447815cc50 msgr2=0x7f4478144e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:15.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.394+0000 7f4477400640 1 --2- 172.21.15.112:0/1002383926 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f447815cc50 0x7f4478144e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.394+0000 7f4477400640 1 -- 172.21.15.112:0/1002383926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4478071530 msgr2=0x7f44780aa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:15.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.394+0000 7f4477400640 1 --2- 172.21.15.112:0/1002383926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4478071530 0x7f44780aa4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.394+0000 7f4477400640 1 -- 172.21.15.112:0/1002383926 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44781440a0 con 0x7f44780afe30 2024-09-12T02:47:15.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.394+0000 7f4477400640 1 --2- 172.21.15.112:0/1002383926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44780afe30 0x7f44780aaa00 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f44640010e0 tx=0x7f446400cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:15.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.395+0000 7f446fe00640 1 -- 172.21.15.112:0/1002383926 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4464017070 con 0x7f44780afe30 2024-09-12T02:47:15.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.395+0000 7f446fe00640 1 -- 172.21.15.112:0/1002383926 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4464007290 con 0x7f44780afe30 2024-09-12T02:47:15.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.395+0000 7f447ea00640 1 -- 172.21.15.112:0/1002383926 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4478144380 con 0x7f44780afe30 2024-09-12T02:47:15.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.395+0000 7f446fe00640 1 -- 172.21.15.112:0/1002383926 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44640057a0 con 0x7f44780afe30 2024-09-12T02:47:15.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.395+0000 7f447ea00640 1 -- 172.21.15.112:0/1002383926 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4478152b20 con 0x7f44780afe30 2024-09-12T02:47:15.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.396+0000 7f447ea00640 1 -- 172.21.15.112:0/1002383926 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4478068a30 con 0x7f44780afe30 2024-09-12T02:47:15.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.397+0000 7f446fe00640 1 -- 172.21.15.112:0/1002383926 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f446401a070 con 0x7f44780afe30 2024-09-12T02:47:15.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.398+0000 7f446fe00640 1 --2- 172.21.15.112:0/1002383926 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f445806be30 0x7f445806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:15.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.398+0000 7f446fe00640 1 -- 172.21.15.112:0/1002383926 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5738+0+0 (secure 0 0 0) 0x7f446408a2f0 con 0x7f44780afe30 2024-09-12T02:47:15.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.398+0000 7f4477e00640 1 --2- 172.21.15.112:0/1002383926 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f445806be30 0x7f445806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:15.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.398+0000 7f4477e00640 1 --2- 172.21.15.112:0/1002383926 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f445806be30 0x7f445806e2f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4468001e00 tx=0x7f4468009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:15.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.402+0000 7f446fe00640 1 -- 172.21.15.112:0/1002383926 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f44640586c0 con 0x7f44780afe30 2024-09-12T02:47:15.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.609+0000 7f447ea00640 1 -- 172.21.15.112:0/1002383926 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4478152de0 con 0x7f44780afe30 2024-09-12T02:47:15.611 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-12T02:47:15.610+0000 7f0216c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:47:15.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.614+0000 7f446fe00640 1 -- 172.21.15.112:0/1002383926 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v54) ==== 161+0+0 (secure 0 0 0) 0x7f446405c9c0 con 0x7f44780afe30 2024-09-12T02:47:15.614 INFO:teuthology.orchestra.run.smithi112.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:47:15.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.616+0000 7f447ea00640 1 -- 172.21.15.112:0/1002383926 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f445806be30 msgr2=0x7f445806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:15.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.616+0000 7f447ea00640 1 --2- 172.21.15.112:0/1002383926 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f445806be30 0x7f445806e2f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4468001e00 tx=0x7f4468009040 comp rx=0 tx=0).stop 2024-09-12T02:47:15.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.616+0000 7f447ea00640 1 -- 172.21.15.112:0/1002383926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44780afe30 msgr2=0x7f44780aaa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:15.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.616+0000 7f447ea00640 1 --2- 172.21.15.112:0/1002383926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44780afe30 0x7f44780aaa00 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f44640010e0 tx=0x7f446400cb30 comp rx=0 tx=0).stop 2024-09-12T02:47:15.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.617+0000 7f447ea00640 1 -- 172.21.15.112:0/1002383926 shutdown_connections 2024-09-12T02:47:15.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.617+0000 7f447ea00640 1 --2- 172.21.15.112:0/1002383926 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f447815cc50 0x7f4478144e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.617+0000 7f447ea00640 1 --2- 172.21.15.112:0/1002383926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44780afe30 0x7f44780aaa00 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.617+0000 7f447ea00640 1 --2- 172.21.15.112:0/1002383926 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f445806be30 0x7f445806e2f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.617+0000 7f447ea00640 1 --2- 172.21.15.112:0/1002383926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4478071530 0x7f44780aa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.617+0000 7f447ea00640 1 -- 172.21.15.112:0/1002383926 >> 172.21.15.112:0/1002383926 conn(0x7f447806bbd0 msgr2=0x7f44780b0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:15.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.618+0000 7f447ea00640 1 -- 172.21.15.112:0/1002383926 shutdown_connections 2024-09-12T02:47:15.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.619+0000 7f447ea00640 1 -- 172.21.15.112:0/1002383926 wait complete. 2024-09-12T02:47:15.636 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T02:47:15.684 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-12T02:47:15.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.792+0000 7f71c7400640 1 Processor -- start 2024-09-12T02:47:15.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.792+0000 7f71c7400640 1 -- start start 2024-09-12T02:47:15.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.793+0000 7f71c7400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f71c015cc50 0x7f71c00732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:15.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.793+0000 7f71c7400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71c00afe30 0x7f71c00cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:15.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.793+0000 7f71c7400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71c0073830 con 0x7f71c0071530 2024-09-12T02:47:15.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.793+0000 7f71c7400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f71c015d030 con 0x7f71c015cc50 2024-09-12T02:47:15.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.793+0000 7f71c7400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f71c00cf4c0 con 0x7f71c00afe30 2024-09-12T02:47:15.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.793+0000 7f71c4a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f71c015cc50 0x7f71c00732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:15.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.794+0000 7f71c4a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f71c015cc50 0x7f71c00732f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46686/0 (socket says 172.21.15.112:46686) 2024-09-12T02:47:15.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.794+0000 7f71c4a00640 1 -- 172.21.15.112:0/649798303 learned_addr learned my addr 172.21.15.112:0/649798303 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:15.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.794+0000 7f71c4a00640 1 -- 172.21.15.112:0/649798303 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71c00afe30 msgr2=0x7f71c00cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:15.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.794+0000 7f71c5400640 1 --2- 172.21.15.112:0/649798303 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71c00afe30 0x7f71c00cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:15.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.794+0000 7f71c4a00640 1 --2- 172.21.15.112:0/649798303 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71c00afe30 0x7f71c00cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.794+0000 7f71c4a00640 1 -- 172.21.15.112:0/649798303 >> v1:172.21.15.137:6789/0 conn(0x7f71c0071530 legacy=0x7f71c00af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:15.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.794+0000 7f71c4a00640 1 -- 172.21.15.112:0/649798303 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c00ceeb0 con 0x7f71c015cc50 2024-09-12T02:47:15.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.794+0000 7f71c5400640 1 --2- 172.21.15.112:0/649798303 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71c00afe30 0x7f71c00cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:15.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.795+0000 7f71c4a00640 1 --2- 172.21.15.112:0/649798303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71c015cc50 0x7f71c00732f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009e50 tx=0x7f71b002a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56690c553baeb073 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:15.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.795+0000 7f71bf400640 1 -- 172.21.15.112:0/649798303 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b0036070 con 0x7f71c015cc50 2024-09-12T02:47:15.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.795+0000 7f71bf400640 1 -- 172.21.15.112:0/649798303 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b0031600 con 0x7f71c015cc50 2024-09-12T02:47:15.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.795+0000 7f71bf400640 1 -- 172.21.15.112:0/649798303 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b00319d0 con 0x7f71c015cc50 2024-09-12T02:47:15.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.796+0000 7f71c7400640 1 -- 172.21.15.112:0/649798303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71c015cc50 msgr2=0x7f71c00732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:15.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.796+0000 7f71c7400640 1 --2- 172.21.15.112:0/649798303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71c015cc50 0x7f71c00732f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009e50 tx=0x7f71b002a630 comp rx=0 tx=0).stop 2024-09-12T02:47:15.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.796+0000 7f71c7400640 1 -- 172.21.15.112:0/649798303 shutdown_connections 2024-09-12T02:47:15.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.796+0000 7f71c7400640 1 --2- 172.21.15.112:0/649798303 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71c00afe30 0x7f71c00cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.796+0000 7f71c7400640 1 --2- 172.21.15.112:0/649798303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71c015cc50 0x7f71c00732f0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.796+0000 7f71c7400640 1 -- 172.21.15.112:0/649798303 >> 172.21.15.112:0/649798303 conn(0x7f71c006bbd0 msgr2=0x7f71c006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:15.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.796+0000 7f71c7400640 1 -- 172.21.15.112:0/649798303 shutdown_connections 2024-09-12T02:47:15.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.796+0000 7f71c7400640 1 -- 172.21.15.112:0/649798303 wait complete. 2024-09-12T02:47:15.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.797+0000 7f71c7400640 1 Processor -- start 2024-09-12T02:47:15.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.798+0000 7f71c7400640 1 -- start start 2024-09-12T02:47:15.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.798+0000 7f71c7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71c0071530 0x7f71c0153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:15.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.798+0000 7f71c7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71c00afe30 0x7f71c015e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:15.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.798+0000 7f71c7400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71c015cc50 0x7f71c0150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:15.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.798+0000 7f71c7400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f71c00cf150 con 0x7f71c0071530 2024-09-12T02:47:15.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.798+0000 7f71c7400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f71c006e5e0 con 0x7f71c00afe30 2024-09-12T02:47:15.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.799+0000 7f71c7400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f71c006f510 con 0x7f71c015cc50 2024-09-12T02:47:15.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.799+0000 7f71c4a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71c0071530 0x7f71c0153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:15.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.799+0000 7f71c4a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71c0071530 0x7f71c0153460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46698/0 (socket says 172.21.15.112:46698) 2024-09-12T02:47:15.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.799+0000 7f71c4a00640 1 -- 172.21.15.112:0/1120183997 learned_addr learned my addr 172.21.15.112:0/1120183997 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.799+0000 7f71bfe00640 1 --2- 172.21.15.112:0/1120183997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71c00afe30 0x7f71c015e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.799+0000 7f71c5400640 1 --2- 172.21.15.112:0/1120183997 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71c015cc50 0x7f71c0150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.799+0000 7f71c4a00640 1 -- 172.21.15.112:0/1120183997 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71c015cc50 msgr2=0x7f71c0150500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.799+0000 7f71c4a00640 1 --2- 172.21.15.112:0/1120183997 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71c015cc50 0x7f71c0150500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.799+0000 7f71c4a00640 1 -- 172.21.15.112:0/1120183997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71c00afe30 msgr2=0x7f71c015e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.799+0000 7f71c4a00640 1 --2- 172.21.15.112:0/1120183997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71c00afe30 0x7f71c015e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.799+0000 7f71c4a00640 1 -- 172.21.15.112:0/1120183997 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c014ea90 con 0x7f71c0071530 2024-09-12T02:47:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.799+0000 7f71bfe00640 1 --2- 172.21.15.112:0/1120183997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71c00afe30 0x7f71c015e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.799+0000 7f71c5400640 1 --2- 172.21.15.112:0/1120183997 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71c015cc50 0x7f71c0150500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.799+0000 7f71c4a00640 1 --2- 172.21.15.112:0/1120183997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71c0071530 0x7f71c0153460 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009e50 tx=0x7f71b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.800+0000 7f71bcc00640 1 -- 172.21.15.112:0/1120183997 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b0041020 con 0x7f71c0071530 2024-09-12T02:47:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.800+0000 7f71bcc00640 1 -- 172.21.15.112:0/1120183997 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b0007800 con 0x7f71c0071530 2024-09-12T02:47:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.800+0000 7f71bcc00640 1 -- 172.21.15.112:0/1120183997 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b0036040 con 0x7f71c0071530 2024-09-12T02:47:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.800+0000 7f71c7400640 1 -- 172.21.15.112:0/1120183997 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71c014f460 con 0x7f71c0071530 2024-09-12T02:47:15.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.800+0000 7f71c7400640 1 -- 172.21.15.112:0/1120183997 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71c014fa20 con 0x7f71c0071530 2024-09-12T02:47:15.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.801+0000 7f71c7400640 1 -- 172.21.15.112:0/1120183997 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71c006df60 con 0x7f71c0071530 2024-09-12T02:47:15.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.802+0000 7f71bcc00640 1 -- 172.21.15.112:0/1120183997 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f71b0044020 con 0x7f71c0071530 2024-09-12T02:47:15.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.802+0000 7f71bcc00640 1 --2- 172.21.15.112:0/1120183997 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f71a006be30 0x7f71a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:15.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.803+0000 7f71bcc00640 1 -- 172.21.15.112:0/1120183997 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5824+0+0 (secure 0 0 0) 0x7f71b00abd50 con 0x7f71c0071530 2024-09-12T02:47:15.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.803+0000 7f71bfe00640 1 --2- 172.21.15.112:0/1120183997 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f71a006be30 0x7f71a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:15.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.803+0000 7f71bfe00640 1 --2- 172.21.15.112:0/1120183997 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f71a006be30 0x7f71a006e2f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f71c01f6610 tx=0x7f71ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:15.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:15.807+0000 7f71bcc00640 1 -- 172.21.15.112:0/1120183997 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f71b004b030 con 0x7f71c0071530 2024-09-12T02:47:16.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.013+0000 7f71c7400640 1 -- 172.21.15.112:0/1120183997 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f71c00af600 con 0x7f71c0071530 2024-09-12T02:47:16.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.617+0000 7f71bcc00640 1 -- 172.21.15.112:0/1120183997 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v55) ==== 104+0+0 (secure 0 0 0) 0x7f71c014ea90 con 0x7f71c0071530 2024-09-12T02:47:16.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.619+0000 7f71c7400640 1 -- 172.21.15.112:0/1120183997 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f71a006be30 msgr2=0x7f71a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:16.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.619+0000 7f71c7400640 1 --2- 172.21.15.112:0/1120183997 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f71a006be30 0x7f71a006e2f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f71c01f6610 tx=0x7f71ac009040 comp rx=0 tx=0).stop 2024-09-12T02:47:16.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.619+0000 7f71c7400640 1 -- 172.21.15.112:0/1120183997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71c0071530 msgr2=0x7f71c0153460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:16.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.619+0000 7f71c7400640 1 --2- 172.21.15.112:0/1120183997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71c0071530 0x7f71c0153460 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009e50 tx=0x7f71b0004a40 comp rx=0 tx=0).stop 2024-09-12T02:47:16.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.619+0000 7f71c7400640 1 -- 172.21.15.112:0/1120183997 shutdown_connections 2024-09-12T02:47:16.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.619+0000 7f71c7400640 1 --2- 172.21.15.112:0/1120183997 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f71c015cc50 0x7f71c0150500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:16.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.619+0000 7f71c7400640 1 --2- 172.21.15.112:0/1120183997 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f71a006be30 0x7f71a006e2f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:16.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.619+0000 7f71c7400640 1 --2- 172.21.15.112:0/1120183997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71c00afe30 0x7f71c015e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:16.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.619+0000 7f71c7400640 1 --2- 172.21.15.112:0/1120183997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71c0071530 0x7f71c0153460 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:16.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.619+0000 7f71c7400640 1 -- 172.21.15.112:0/1120183997 >> 172.21.15.112:0/1120183997 conn(0x7f71c006bbd0 msgr2=0x7f71c00b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:16.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.620+0000 7f71c7400640 1 -- 172.21.15.112:0/1120183997 shutdown_connections 2024-09-12T02:47:16.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.620+0000 7f71c7400640 1 -- 172.21.15.112:0/1120183997 wait complete. 2024-09-12T02:47:16.638 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T02:47:16.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.796+0000 7f1799400640 1 Processor -- start 2024-09-12T02:47:16.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.796+0000 7f1799400640 1 -- start start 2024-09-12T02:47:16.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.797+0000 7f1799400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1794146350 0x7f179406efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:16.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.797+0000 7f1799400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f17940b59a0 0x7f17940cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:16.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.797+0000 7f1799400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17940cdfa0 con 0x7f17940cdb90 2024-09-12T02:47:16.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.797+0000 7f1799400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f17940cf1e0 con 0x7f17940b59a0 2024-09-12T02:47:16.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.797+0000 7f1799400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f179406f810 con 0x7f1794146350 2024-09-12T02:47:16.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.797+0000 7f178be00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f17940b59a0 0x7f17940cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:16.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.797+0000 7f1798a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f17940cdb90 0x7f17941604c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47814/0 (socket says 172.21.15.112:47814) 2024-09-12T02:47:16.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.797+0000 7f1798a00640 1 -- 172.21.15.112:0/3864433246 learned_addr learned my addr 172.21.15.112:0/3864433246 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:16.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.798+0000 7f1793e00640 1 --2- 172.21.15.112:0/3864433246 >> v2:172.21.15.137:3300/0 conn(0x7f1794146350 0x7f179406efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:16.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.798+0000 7f1793400640 1 -- 172.21.15.112:0/3864433246 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2745663961 0 0) 0x7f178c001490 con 0x7f17940cdb90 2024-09-12T02:47:16.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.798+0000 7f1793400640 1 -- 172.21.15.112:0/3864433246 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1778003520 con 0x7f17940cdb90 2024-09-12T02:47:16.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.798+0000 7f178be00640 1 -- 172.21.15.112:0/3864433246 >> v2:172.21.15.137:3300/0 conn(0x7f1794146350 msgr2=0x7f179406efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:16.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.798+0000 7f178be00640 1 --2- 172.21.15.112:0/3864433246 >> v2:172.21.15.137:3300/0 conn(0x7f1794146350 0x7f179406efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:16.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.798+0000 7f178be00640 1 -- 172.21.15.112:0/3864433246 >> v1:172.21.15.112:6789/0 conn(0x7f17940cdb90 legacy=0x7f17941604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:16.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.798+0000 7f178be00640 1 -- 172.21.15.112:0/3864433246 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17940b4e20 con 0x7f17940b59a0 2024-09-12T02:47:16.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.799+0000 7f178be00640 1 --2- 172.21.15.112:0/3864433246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17940b59a0 0x7f17940cd650 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f17940cf360 tx=0x7f177c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b7a5d5e6f28b36e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:16.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.799+0000 7f1793400640 1 -- 172.21.15.112:0/3864433246 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c037070 con 0x7f17940b59a0 2024-09-12T02:47:16.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.799+0000 7f1793400640 1 -- 172.21.15.112:0/3864433246 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f177c02ae50 con 0x7f17940b59a0 2024-09-12T02:47:16.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.799+0000 7f1793400640 1 -- 172.21.15.112:0/3864433246 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c032640 con 0x7f17940b59a0 2024-09-12T02:47:16.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.800+0000 7f1799400640 1 -- 172.21.15.112:0/3864433246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17940b59a0 msgr2=0x7f17940cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:16.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.800+0000 7f1799400640 1 --2- 172.21.15.112:0/3864433246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17940b59a0 0x7f17940cd650 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f17940cf360 tx=0x7f177c02a100 comp rx=0 tx=0).stop 2024-09-12T02:47:16.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.800+0000 7f1799400640 1 -- 172.21.15.112:0/3864433246 shutdown_connections 2024-09-12T02:47:16.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.800+0000 7f1799400640 1 --2- 172.21.15.112:0/3864433246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17940b59a0 0x7f17940cd650 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:16.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.800+0000 7f1799400640 1 --2- 172.21.15.112:0/3864433246 >> v2:172.21.15.137:3300/0 conn(0x7f1794146350 0x7f179406efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:16.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.800+0000 7f1799400640 1 -- 172.21.15.112:0/3864433246 >> 172.21.15.112:0/3864433246 conn(0x7f179406bdb0 msgr2=0x7f179406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:16.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.800+0000 7f1799400640 1 -- 172.21.15.112:0/3864433246 shutdown_connections 2024-09-12T02:47:16.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.800+0000 7f1799400640 1 -- 172.21.15.112:0/3864433246 wait complete. 2024-09-12T02:47:16.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.801+0000 7f1799400640 1 Processor -- start 2024-09-12T02:47:16.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.802+0000 7f1799400640 1 -- start start 2024-09-12T02:47:16.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.802+0000 7f1799400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17940b59a0 0x7f179415c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:16.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.802+0000 7f1799400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17940cdb90 0x7f17940b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:16.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.802+0000 7f1799400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1794146350 0x7f17940b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:16.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.802+0000 7f1799400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f17940ceb90 con 0x7f17940cdb90 2024-09-12T02:47:16.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.802+0000 7f1799400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f17940ce8b0 con 0x7f17940b59a0 2024-09-12T02:47:16.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.802+0000 7f1799400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f17940cee70 con 0x7f1794146350 2024-09-12T02:47:16.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.803+0000 7f178be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17940cdb90 0x7f17940b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:16.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.803+0000 7f178be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17940cdb90 0x7f17940b1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46710/0 (socket says 172.21.15.112:46710) 2024-09-12T02:47:16.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.803+0000 7f178be00640 1 -- 172.21.15.112:0/3603933122 learned_addr learned my addr 172.21.15.112:0/3603933122 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:16.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.803+0000 7f1793e00640 1 --2- 172.21.15.112:0/3603933122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17940b59a0 0x7f179415c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:16.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.803+0000 7f1798a00640 1 --2- 172.21.15.112:0/3603933122 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1794146350 0x7f17940b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:16.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.803+0000 7f178be00640 1 -- 172.21.15.112:0/3603933122 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1794146350 msgr2=0x7f17940b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:16.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.803+0000 7f178be00640 1 --2- 172.21.15.112:0/3603933122 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1794146350 0x7f17940b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:16.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.803+0000 7f178be00640 1 -- 172.21.15.112:0/3603933122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17940b59a0 msgr2=0x7f179415c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:16.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.803+0000 7f178be00640 1 --2- 172.21.15.112:0/3603933122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17940b59a0 0x7f179415c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:16.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.803+0000 7f178be00640 1 -- 172.21.15.112:0/3603933122 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17940addb0 con 0x7f17940cdb90 2024-09-12T02:47:16.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.803+0000 7f1793e00640 1 --2- 172.21.15.112:0/3603933122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17940b59a0 0x7f179415c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:16.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.803+0000 7f1798a00640 1 --2- 172.21.15.112:0/3603933122 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1794146350 0x7f17940b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:16.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.803+0000 7f178be00640 1 --2- 172.21.15.112:0/3603933122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17940cdb90 0x7f17940b1690 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f177c02a140 tx=0x7f177c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:16.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.804+0000 7f1790c00640 1 -- 172.21.15.112:0/3603933122 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c037050 con 0x7f17940cdb90 2024-09-12T02:47:16.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.804+0000 7f1790c00640 1 -- 172.21.15.112:0/3603933122 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f177c043070 con 0x7f17940cdb90 2024-09-12T02:47:16.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.804+0000 7f1799400640 1 -- 172.21.15.112:0/3603933122 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17940ae090 con 0x7f17940cdb90 2024-09-12T02:47:16.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.804+0000 7f1790c00640 1 -- 172.21.15.112:0/3603933122 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c03e670 con 0x7f17940cdb90 2024-09-12T02:47:16.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.804+0000 7f1799400640 1 -- 172.21.15.112:0/3603933122 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17940ae650 con 0x7f17940cdb90 2024-09-12T02:47:16.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.805+0000 7f1799400640 1 -- 172.21.15.112:0/3603933122 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1794068a30 con 0x7f17940cdb90 2024-09-12T02:47:16.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.806+0000 7f1790c00640 1 -- 172.21.15.112:0/3603933122 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f177c03e810 con 0x7f17940cdb90 2024-09-12T02:47:16.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.807+0000 7f1790c00640 1 --2- 172.21.15.112:0/3603933122 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f177006be30 0x7f177006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:16.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.807+0000 7f1790c00640 1 -- 172.21.15.112:0/3603933122 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5824+0+0 (secure 0 0 0) 0x7f177c0ab7e0 con 0x7f17940cdb90 2024-09-12T02:47:16.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.807+0000 7f1793e00640 1 --2- 172.21.15.112:0/3603933122 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f177006be30 0x7f177006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:16.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.807+0000 7f1793e00640 1 --2- 172.21.15.112:0/3603933122 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f177006be30 0x7f177006e2f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1784009af0 tx=0x7f1784008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:16.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.811+0000 7f1790c00640 1 -- 172.21.15.112:0/3603933122 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f177c07a250 con 0x7f17940cdb90 2024-09-12T02:47:16.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:16.985+0000 7f1799400640 1 -- 172.21.15.112:0/3603933122 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f179415da50 con 0x7f17940cdb90 2024-09-12T02:47:17.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.623+0000 7f1790c00640 1 -- 172.21.15.112:0/3603933122 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v111) ==== 181+0+0 (secure 0 0 0) 0x7f177c079b50 con 0x7f17940cdb90 2024-09-12T02:47:17.624 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' removed 2024-09-12T02:47:17.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.625+0000 7f1799400640 1 -- 172.21.15.112:0/3603933122 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f177006be30 msgr2=0x7f177006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:17.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.625+0000 7f1799400640 1 --2- 172.21.15.112:0/3603933122 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f177006be30 0x7f177006e2f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1784009af0 tx=0x7f1784008040 comp rx=0 tx=0).stop 2024-09-12T02:47:17.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.625+0000 7f1799400640 1 -- 172.21.15.112:0/3603933122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17940cdb90 msgr2=0x7f17940b1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:17.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.625+0000 7f1799400640 1 --2- 172.21.15.112:0/3603933122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17940cdb90 0x7f17940b1690 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f177c02a140 tx=0x7f177c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:47:17.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.626+0000 7f1799400640 1 -- 172.21.15.112:0/3603933122 shutdown_connections 2024-09-12T02:47:17.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.626+0000 7f1799400640 1 --2- 172.21.15.112:0/3603933122 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1794146350 0x7f17940b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:17.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.626+0000 7f1799400640 1 --2- 172.21.15.112:0/3603933122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17940cdb90 0x7f17940b1690 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:17.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.626+0000 7f1799400640 1 --2- 172.21.15.112:0/3603933122 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f177006be30 0x7f177006e2f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:17.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.626+0000 7f1799400640 1 --2- 172.21.15.112:0/3603933122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17940b59a0 0x7f179415c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:17.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.626+0000 7f1799400640 1 -- 172.21.15.112:0/3603933122 >> 172.21.15.112:0/3603933122 conn(0x7f179406bdb0 msgr2=0x7f179415cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:17.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.626+0000 7f1799400640 1 -- 172.21.15.112:0/3603933122 shutdown_connections 2024-09-12T02:47:17.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.626+0000 7f1799400640 1 -- 172.21.15.112:0/3603933122 wait complete. 2024-09-12T02:47:17.646 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T02:47:17.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.806+0000 7f6f1c400640 1 Processor -- start 2024-09-12T02:47:17.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.806+0000 7f6f1c400640 1 -- start start 2024-09-12T02:47:17.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.807+0000 7f6f1c400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6f14144890 0x7f6f140b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:17.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.807+0000 7f6f1c400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6f140b4140 0x7f6f140ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:17.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.807+0000 7f6f1c400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f1406eed0 con 0x7f6f141602f0 2024-09-12T02:47:17.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.807+0000 7f6f1c400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f6f1406f170 con 0x7f6f140b4140 2024-09-12T02:47:17.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.807+0000 7f6f1c400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6f1415f810 con 0x7f6f14144890 2024-09-12T02:47:17.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.807+0000 7f6f1a400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6f140b4140 0x7f6f140ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:17.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.807+0000 7f6f1a400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6f140b4140 0x7f6f140ce5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46712/0 (socket says 172.21.15.112:46712) 2024-09-12T02:47:17.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.807+0000 7f6f1a400640 1 -- 172.21.15.112:0/3656397370 learned_addr learned my addr 172.21.15.112:0/3656397370 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:17.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.807+0000 7f6f19a00640 1 --2- 172.21.15.112:0/3656397370 >> v2:172.21.15.137:3300/0 conn(0x7f6f14144890 0x7f6f140b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:17.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.808+0000 7f6f1a400640 1 -- 172.21.15.112:0/3656397370 >> v2:172.21.15.137:3300/0 conn(0x7f6f14144890 msgr2=0x7f6f140b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:17.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.808+0000 7f6f1a400640 1 --2- 172.21.15.112:0/3656397370 >> v2:172.21.15.137:3300/0 conn(0x7f6f14144890 0x7f6f140b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:17.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.808+0000 7f6f1a400640 1 -- 172.21.15.112:0/3656397370 >> v1:172.21.15.137:6789/0 conn(0x7f6f141602f0 legacy=0x7f6f140b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:17.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.808+0000 7f6f1a400640 1 -- 172.21.15.112:0/3656397370 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f1415faf0 con 0x7f6f140b4140 2024-09-12T02:47:17.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.809+0000 7f6f1a400640 1 --2- 172.21.15.112:0/3656397370 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f140b4140 0x7f6f140ce5b0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f6f140688a0 tx=0x7f6f0c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ceae8d09124854 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:17.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.809+0000 7f6f13e00640 1 -- 172.21.15.112:0/3656397370 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c036070 con 0x7f6f140b4140 2024-09-12T02:47:17.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.809+0000 7f6f13e00640 1 -- 172.21.15.112:0/3656397370 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f0c031600 con 0x7f6f140b4140 2024-09-12T02:47:17.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.809+0000 7f6f13e00640 1 -- 172.21.15.112:0/3656397370 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c0319d0 con 0x7f6f140b4140 2024-09-12T02:47:17.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.810+0000 7f6f1c400640 1 -- 172.21.15.112:0/3656397370 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f140b4140 msgr2=0x7f6f140ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:17.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.810+0000 7f6f1c400640 1 --2- 172.21.15.112:0/3656397370 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f140b4140 0x7f6f140ce5b0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f6f140688a0 tx=0x7f6f0c02a730 comp rx=0 tx=0).stop 2024-09-12T02:47:17.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.810+0000 7f6f1c400640 1 -- 172.21.15.112:0/3656397370 shutdown_connections 2024-09-12T02:47:17.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.810+0000 7f6f1c400640 1 --2- 172.21.15.112:0/3656397370 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f140b4140 0x7f6f140ce5b0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:17.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.810+0000 7f6f1c400640 1 --2- 172.21.15.112:0/3656397370 >> v2:172.21.15.137:3300/0 conn(0x7f6f14144890 0x7f6f140b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:17.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.810+0000 7f6f1c400640 1 -- 172.21.15.112:0/3656397370 >> 172.21.15.112:0/3656397370 conn(0x7f6f140b2730 msgr2=0x7f6f140b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:17.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.810+0000 7f6f1c400640 1 -- 172.21.15.112:0/3656397370 shutdown_connections 2024-09-12T02:47:17.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.810+0000 7f6f1c400640 1 -- 172.21.15.112:0/3656397370 wait complete. 2024-09-12T02:47:17.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.811+0000 7f6f1c400640 1 Processor -- start 2024-09-12T02:47:17.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.811+0000 7f6f1c400640 1 -- start start 2024-09-12T02:47:17.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.812+0000 7f6f1c400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f140b4140 0x7f6f14141510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:17.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.812+0000 7f6f1c400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f14144890 0x7f6f14156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:17.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.812+0000 7f6f1c400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f141602f0 0x7f6f14142da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:17.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.812+0000 7f6f1c400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6f14144df0 con 0x7f6f141602f0 2024-09-12T02:47:17.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.812+0000 7f6f1c400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6f14144c70 con 0x7f6f140b4140 2024-09-12T02:47:17.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.812+0000 7f6f1c400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6f140b3290 con 0x7f6f14144890 2024-09-12T02:47:17.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.812+0000 7f6f1a400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f141602f0 0x7f6f14142da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:17.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.813+0000 7f6f1a400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f141602f0 0x7f6f14142da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46716/0 (socket says 172.21.15.112:46716) 2024-09-12T02:47:17.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.813+0000 7f6f1a400640 1 -- 172.21.15.112:0/1069108181 learned_addr learned my addr 172.21.15.112:0/1069108181 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:17.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.813+0000 7f6f19a00640 1 --2- 172.21.15.112:0/1069108181 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f140b4140 0x7f6f14141510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:17.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.813+0000 7f6f19000640 1 --2- 172.21.15.112:0/1069108181 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f14144890 0x7f6f14156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:17.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.813+0000 7f6f1a400640 1 -- 172.21.15.112:0/1069108181 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f14144890 msgr2=0x7f6f14156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:17.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.813+0000 7f6f1a400640 1 --2- 172.21.15.112:0/1069108181 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f14144890 0x7f6f14156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:17.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.813+0000 7f6f1a400640 1 -- 172.21.15.112:0/1069108181 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f140b4140 msgr2=0x7f6f14141510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:17.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.813+0000 7f6f1a400640 1 --2- 172.21.15.112:0/1069108181 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f140b4140 0x7f6f14141510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:17.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.813+0000 7f6f1a400640 1 -- 172.21.15.112:0/1069108181 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f140ae970 con 0x7f6f141602f0 2024-09-12T02:47:17.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.813+0000 7f6f19a00640 1 --2- 172.21.15.112:0/1069108181 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f140b4140 0x7f6f14141510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:17.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.813+0000 7f6f1a400640 1 --2- 172.21.15.112:0/1069108181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f141602f0 0x7f6f14142da0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c034040 tx=0x7f6f0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:17.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.813+0000 7f6f11600640 1 -- 172.21.15.112:0/1069108181 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c036050 con 0x7f6f141602f0 2024-09-12T02:47:17.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.814+0000 7f6f11600640 1 -- 172.21.15.112:0/1069108181 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f0c042070 con 0x7f6f141602f0 2024-09-12T02:47:17.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.814+0000 7f6f11600640 1 -- 172.21.15.112:0/1069108181 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c009510 con 0x7f6f141602f0 2024-09-12T02:47:17.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.814+0000 7f6f1c400640 1 -- 172.21.15.112:0/1069108181 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f140aec50 con 0x7f6f141602f0 2024-09-12T02:47:17.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.814+0000 7f6f1c400640 1 -- 172.21.15.112:0/1069108181 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f140af210 con 0x7f6f141602f0 2024-09-12T02:47:17.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.815+0000 7f6f1c400640 1 -- 172.21.15.112:0/1069108181 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f140b58c0 con 0x7f6f141602f0 2024-09-12T02:47:17.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.815+0000 7f6f11600640 1 -- 172.21.15.112:0/1069108181 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6f0c007bf0 con 0x7f6f141602f0 2024-09-12T02:47:17.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.816+0000 7f6f11600640 1 --2- 172.21.15.112:0/1069108181 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6ef406be30 0x7f6ef406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:17.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.816+0000 7f6f11600640 1 -- 172.21.15.112:0/1069108181 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5386+0+0 (secure 0 0 0) 0x7f6f0c0abbc0 con 0x7f6f141602f0 2024-09-12T02:47:17.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.817+0000 7f6f19a00640 1 --2- 172.21.15.112:0/1069108181 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6ef406be30 0x7f6ef406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:17.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.817+0000 7f6f19a00640 1 --2- 172.21.15.112:0/1069108181 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6ef406be30 0x7f6ef406e2f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6f08006fd0 tx=0x7f6f08008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:17.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.821+0000 7f6f11600640 1 -- 172.21.15.112:0/1069108181 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6f0c07a610 con 0x7f6f141602f0 2024-09-12T02:47:17.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:17.996+0000 7f6f1c400640 1 -- 172.21.15.112:0/1069108181 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6f140af450 con 0x7f6f141602f0 2024-09-12T02:47:18.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.625+0000 7f6f11600640 1 -- 172.21.15.112:0/1069108181 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v112) ==== 169+0+0 (secure 0 0 0) 0x7f6f0c079f10 con 0x7f6f141602f0 2024-09-12T02:47:18.626 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' removed 2024-09-12T02:47:18.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.627+0000 7f6f1c400640 1 -- 172.21.15.112:0/1069108181 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6ef406be30 msgr2=0x7f6ef406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:18.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.627+0000 7f6f1c400640 1 --2- 172.21.15.112:0/1069108181 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6ef406be30 0x7f6ef406e2f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6f08006fd0 tx=0x7f6f08008040 comp rx=0 tx=0).stop 2024-09-12T02:47:18.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.627+0000 7f6f1c400640 1 -- 172.21.15.112:0/1069108181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f141602f0 msgr2=0x7f6f14142da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:18.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.627+0000 7f6f1c400640 1 --2- 172.21.15.112:0/1069108181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f141602f0 0x7f6f14142da0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c034040 tx=0x7f6f0c004a40 comp rx=0 tx=0).stop 2024-09-12T02:47:18.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.627+0000 7f6f1c400640 1 -- 172.21.15.112:0/1069108181 shutdown_connections 2024-09-12T02:47:18.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.627+0000 7f6f1c400640 1 --2- 172.21.15.112:0/1069108181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f141602f0 0x7f6f14142da0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:18.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.627+0000 7f6f1c400640 1 --2- 172.21.15.112:0/1069108181 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f14144890 0x7f6f14156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:18.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.628+0000 7f6f1c400640 1 --2- 172.21.15.112:0/1069108181 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6ef406be30 0x7f6ef406e2f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:18.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.628+0000 7f6f1c400640 1 --2- 172.21.15.112:0/1069108181 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f140b4140 0x7f6f14141510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:18.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.628+0000 7f6f1c400640 1 -- 172.21.15.112:0/1069108181 >> 172.21.15.112:0/1069108181 conn(0x7f6f140b2730 msgr2=0x7f6f14067c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:18.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.628+0000 7f6f1c400640 1 -- 172.21.15.112:0/1069108181 shutdown_connections 2024-09-12T02:47:18.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.628+0000 7f6f1c400640 1 -- 172.21.15.112:0/1069108181 wait complete. 2024-09-12T02:47:18.646 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T02:47:18.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.799+0000 7f8d7c000640 1 Processor -- start 2024-09-12T02:47:18.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.799+0000 7f8d7c000640 1 -- start start 2024-09-12T02:47:18.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.800+0000 7f8d7c000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8d7415cc50 0x7f8d740732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:18.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.800+0000 7f8d7c000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8d74071530 0x7f8d740af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:18.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.800+0000 7f8d7c000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8d74071970 0x7f8d740afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:18.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.800+0000 7f8d7c000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8d7415d030 con 0x7f8d7415cc50 2024-09-12T02:47:18.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.801+0000 7f8d7c000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8d740cf4c0 con 0x7f8d74071970 2024-09-12T02:47:18.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.801+0000 7f8d7c000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8d74073830 con 0x7f8d74071530 2024-09-12T02:47:18.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.801+0000 7f8d79600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8d7415cc50 0x7f8d740732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:18.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.801+0000 7f8d79600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8d7415cc50 0x7f8d740732f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46720/0 (socket says 172.21.15.112:46720) 2024-09-12T02:47:18.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.801+0000 7f8d79600640 1 -- 172.21.15.112:0/1692677073 learned_addr learned my addr 172.21.15.112:0/1692677073 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:18.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.801+0000 7f8d7a000640 1 --2- 172.21.15.112:0/1692677073 >> v2:172.21.15.137:3300/0 conn(0x7f8d74071970 0x7f8d740afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:18.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.801+0000 7f8d78c00640 1 --2- 172.21.15.112:0/1692677073 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8d74071530 0x7f8d740af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:18.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.801+0000 7f8d79600640 1 -- 172.21.15.112:0/1692677073 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8d74071530 msgr2=0x7f8d740af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:18.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.801+0000 7f8d79600640 1 --2- 172.21.15.112:0/1692677073 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8d74071530 0x7f8d740af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:18.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.801+0000 7f8d79600640 1 -- 172.21.15.112:0/1692677073 >> v2:172.21.15.137:3300/0 conn(0x7f8d74071970 msgr2=0x7f8d740afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:18.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.801+0000 7f8d79600640 1 --2- 172.21.15.112:0/1692677073 >> v2:172.21.15.137:3300/0 conn(0x7f8d74071970 0x7f8d740afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:18.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.801+0000 7f8d79600640 1 -- 172.21.15.112:0/1692677073 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d740ceeb0 con 0x7f8d7415cc50 2024-09-12T02:47:18.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.801+0000 7f8d7a000640 1 --2- 172.21.15.112:0/1692677073 >> v2:172.21.15.137:3300/0 conn(0x7f8d74071970 0x7f8d740afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:18.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.802+0000 7f8d79600640 1 --2- 172.21.15.112:0/1692677073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d7415cc50 0x7f8d740732f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f8d740cf430 tx=0x7f8d6802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32402b9c5cde6795 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:18.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.803+0000 7f8d73e00640 1 -- 172.21.15.112:0/1692677073 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d68037070 con 0x7f8d7415cc50 2024-09-12T02:47:18.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.803+0000 7f8d73e00640 1 -- 172.21.15.112:0/1692677073 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d68032440 con 0x7f8d7415cc50 2024-09-12T02:47:18.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.803+0000 7f8d73e00640 1 -- 172.21.15.112:0/1692677073 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d68032810 con 0x7f8d7415cc50 2024-09-12T02:47:18.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.803+0000 7f8d7c000640 1 -- 172.21.15.112:0/1692677073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d7415cc50 msgr2=0x7f8d740732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:18.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.803+0000 7f8d7c000640 1 --2- 172.21.15.112:0/1692677073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d7415cc50 0x7f8d740732f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f8d740cf430 tx=0x7f8d6802a140 comp rx=0 tx=0).stop 2024-09-12T02:47:18.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.803+0000 7f8d7c000640 1 -- 172.21.15.112:0/1692677073 shutdown_connections 2024-09-12T02:47:18.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.803+0000 7f8d7c000640 1 --2- 172.21.15.112:0/1692677073 >> v2:172.21.15.137:3300/0 conn(0x7f8d74071970 0x7f8d740afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:18.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.803+0000 7f8d7c000640 1 --2- 172.21.15.112:0/1692677073 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8d74071530 0x7f8d740af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:18.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.803+0000 7f8d7c000640 1 --2- 172.21.15.112:0/1692677073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d7415cc50 0x7f8d740732f0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:18.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.803+0000 7f8d7c000640 1 -- 172.21.15.112:0/1692677073 >> 172.21.15.112:0/1692677073 conn(0x7f8d7406bbd0 msgr2=0x7f8d7406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:18.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.803+0000 7f8d7c000640 1 -- 172.21.15.112:0/1692677073 shutdown_connections 2024-09-12T02:47:18.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.803+0000 7f8d7c000640 1 -- 172.21.15.112:0/1692677073 wait complete. 2024-09-12T02:47:18.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.805+0000 7f8d7c000640 1 Processor -- start 2024-09-12T02:47:18.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.805+0000 7f8d7c000640 1 -- start start 2024-09-12T02:47:18.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.806+0000 7f8d7c000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d74071530 0x7f8d7414f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:18.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.806+0000 7f8d7c000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d74071970 0x7f8d74152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:18.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.806+0000 7f8d7c000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8d7415cc50 0x7f8d741533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:18.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.806+0000 7f8d7c000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8d740cf150 con 0x7f8d74071530 2024-09-12T02:47:18.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.806+0000 7f8d7c000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7406e5e0 con 0x7f8d74071970 2024-09-12T02:47:18.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.806+0000 7f8d7c000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8d7406f510 con 0x7f8d7415cc50 2024-09-12T02:47:18.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.806+0000 7f8d79600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d74071530 0x7f8d7414f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:18.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.806+0000 7f8d79600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d74071530 0x7f8d7414f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46730/0 (socket says 172.21.15.112:46730) 2024-09-12T02:47:18.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.806+0000 7f8d79600640 1 -- 172.21.15.112:0/1776126879 learned_addr learned my addr 172.21.15.112:0/1776126879 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:18.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.806+0000 7f8d78c00640 1 --2- 172.21.15.112:0/1776126879 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d74071970 0x7f8d74152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:18.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.806+0000 7f8d7a000640 1 --2- 172.21.15.112:0/1776126879 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8d7415cc50 0x7f8d741533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:18.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.807+0000 7f8d79600640 1 -- 172.21.15.112:0/1776126879 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8d7415cc50 msgr2=0x7f8d741533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:18.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.807+0000 7f8d79600640 1 --2- 172.21.15.112:0/1776126879 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8d7415cc50 0x7f8d741533f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:18.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.807+0000 7f8d79600640 1 -- 172.21.15.112:0/1776126879 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d74071970 msgr2=0x7f8d74152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:18.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.807+0000 7f8d79600640 1 --2- 172.21.15.112:0/1776126879 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d74071970 0x7f8d74152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:18.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.807+0000 7f8d79600640 1 -- 172.21.15.112:0/1776126879 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d741f9700 con 0x7f8d74071530 2024-09-12T02:47:18.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.807+0000 7f8d78c00640 1 --2- 172.21.15.112:0/1776126879 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d74071970 0x7f8d74152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:18.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.807+0000 7f8d79600640 1 --2- 172.21.15.112:0/1776126879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d74071530 0x7f8d7414f6e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f8d68000c00 tx=0x7f8d680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:18.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.807+0000 7f8d71600640 1 -- 172.21.15.112:0/1776126879 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d68041020 con 0x7f8d74071530 2024-09-12T02:47:18.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.807+0000 7f8d71600640 1 -- 172.21.15.112:0/1776126879 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d680306c0 con 0x7f8d74071530 2024-09-12T02:47:18.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.807+0000 7f8d71600640 1 -- 172.21.15.112:0/1776126879 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d68037040 con 0x7f8d74071530 2024-09-12T02:47:18.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.807+0000 7f8d7c000640 1 -- 172.21.15.112:0/1776126879 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d74154630 con 0x7f8d74071530 2024-09-12T02:47:18.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.807+0000 7f8d7c000640 1 -- 172.21.15.112:0/1776126879 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d74154bf0 con 0x7f8d74071530 2024-09-12T02:47:18.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.808+0000 7f8d7c000640 1 -- 172.21.15.112:0/1776126879 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d74068a30 con 0x7f8d74071530 2024-09-12T02:47:18.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.809+0000 7f8d71600640 1 -- 172.21.15.112:0/1776126879 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d68044020 con 0x7f8d74071530 2024-09-12T02:47:18.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.810+0000 7f8d71600640 1 --2- 172.21.15.112:0/1776126879 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8d5406be30 0x7f8d5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:18.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.810+0000 7f8d71600640 1 -- 172.21.15.112:0/1776126879 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 4943+0+0 (secure 0 0 0) 0x7f8d680ab440 con 0x7f8d74071530 2024-09-12T02:47:18.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.810+0000 7f8d78c00640 1 --2- 172.21.15.112:0/1776126879 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8d5406be30 0x7f8d5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:18.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.811+0000 7f8d78c00640 1 --2- 172.21.15.112:0/1776126879 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8d5406be30 0x7f8d5406e2f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8d7415c4b0 tx=0x7f8d60008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:18.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.815+0000 7f8d71600640 1 -- 172.21.15.112:0/1776126879 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8d6804b030 con 0x7f8d74071530 2024-09-12T02:47:18.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.988+0000 7f8d7c000640 1 -- 172.21.15.112:0/1776126879 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f8d7406df60 con 0x7f8d74071530 2024-09-12T02:47:18.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.992+0000 7f8d71600640 1 -- 172.21.15.112:0/1776126879 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f8d6807a050 con 0x7f8d74071530 2024-09-12T02:47:18.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.995+0000 7f8d7c000640 1 -- 172.21.15.112:0/1776126879 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8d5406be30 msgr2=0x7f8d5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:18.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.995+0000 7f8d7c000640 1 --2- 172.21.15.112:0/1776126879 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8d5406be30 0x7f8d5406e2f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8d7415c4b0 tx=0x7f8d60008040 comp rx=0 tx=0).stop 2024-09-12T02:47:18.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.995+0000 7f8d7c000640 1 -- 172.21.15.112:0/1776126879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d74071530 msgr2=0x7f8d7414f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:18.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.995+0000 7f8d7c000640 1 --2- 172.21.15.112:0/1776126879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d74071530 0x7f8d7414f6e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f8d68000c00 tx=0x7f8d680046c0 comp rx=0 tx=0).stop 2024-09-12T02:47:18.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.995+0000 7f8d7c000640 1 -- 172.21.15.112:0/1776126879 shutdown_connections 2024-09-12T02:47:18.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.995+0000 7f8d7c000640 1 --2- 172.21.15.112:0/1776126879 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8d7415cc50 0x7f8d741533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:18.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.995+0000 7f8d7c000640 1 --2- 172.21.15.112:0/1776126879 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8d5406be30 0x7f8d5406e2f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:18.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.995+0000 7f8d7c000640 1 --2- 172.21.15.112:0/1776126879 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d74071970 0x7f8d74152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:18.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.995+0000 7f8d7c000640 1 --2- 172.21.15.112:0/1776126879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d74071530 0x7f8d7414f6e0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:18.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.995+0000 7f8d7c000640 1 -- 172.21.15.112:0/1776126879 >> 172.21.15.112:0/1776126879 conn(0x7f8d7406bbd0 msgr2=0x7f8d7406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:18.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.995+0000 7f8d7c000640 1 -- 172.21.15.112:0/1776126879 shutdown_connections 2024-09-12T02:47:18.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:18.995+0000 7f8d7c000640 1 -- 172.21.15.112:0/1776126879 wait complete. 2024-09-12T02:47:19.012 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2024-09-12T02:47:19.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.165+0000 7f1b25400640 1 Processor -- start 2024-09-12T02:47:19.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.165+0000 7f1b25400640 1 -- start start 2024-09-12T02:47:19.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.166+0000 7f1b25400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1b200ce460 0x7f1b200d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:19.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.166+0000 7f1b25400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b2006e990 con 0x7f1b2015a450 2024-09-12T02:47:19.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.166+0000 7f1b25400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b2006ec70 con 0x7f1b2015db60 2024-09-12T02:47:19.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.166+0000 7f1b25400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f1b20071eb0 con 0x7f1b200ce460 2024-09-12T02:47:19.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.167+0000 7f1b1fe00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f1b2015a450 0x7f1b2006e140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47824/0 (socket says 172.21.15.112:47824) 2024-09-12T02:47:19.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.167+0000 7f1b1fe00640 1 -- 172.21.15.112:0/1503639812 learned_addr learned my addr 172.21.15.112:0/1503639812 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:19.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.167+0000 7f1b1f400640 1 --2- 172.21.15.112:0/1503639812 >> v2:172.21.15.112:3300/0 conn(0x7f1b200ce460 0x7f1b200d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:19.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.167+0000 7f1b1f400640 1 -- 172.21.15.112:0/1503639812 >> v1:172.21.15.137:6789/0 conn(0x7f1b2015db60 legacy=0x7f1b20072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:19.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.167+0000 7f1b1f400640 1 -- 172.21.15.112:0/1503639812 >> v1:172.21.15.112:6789/0 conn(0x7f1b2015a450 legacy=0x7f1b2006e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:19.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.167+0000 7f1b1f400640 1 -- 172.21.15.112:0/1503639812 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b20072100 con 0x7f1b200ce460 2024-09-12T02:47:19.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.167+0000 7f1b1ea00640 1 -- 172.21.15.112:0/1503639812 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 608970057 0 0) 0x7f1b2006e990 con 0x7f1b2015a450 2024-09-12T02:47:19.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.168+0000 7f1b1f400640 1 --2- 172.21.15.112:0/1503639812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b200ce460 0x7f1b200d0820 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1b20072030 tx=0x7f1b0c02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54946278e149bf55 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:19.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.168+0000 7f1b1ea00640 1 -- 172.21.15.112:0/1503639812 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c037070 con 0x7f1b200ce460 2024-09-12T02:47:19.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.168+0000 7f1b1ea00640 1 -- 172.21.15.112:0/1503639812 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b0c032640 con 0x7f1b200ce460 2024-09-12T02:47:19.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.168+0000 7f1b1ea00640 1 -- 172.21.15.112:0/1503639812 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c032a10 con 0x7f1b200ce460 2024-09-12T02:47:19.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.169+0000 7f1b25400640 1 -- 172.21.15.112:0/1503639812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b200ce460 msgr2=0x7f1b200d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:19.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.169+0000 7f1b25400640 1 --2- 172.21.15.112:0/1503639812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b200ce460 0x7f1b200d0820 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1b20072030 tx=0x7f1b0c02a2c0 comp rx=0 tx=0).stop 2024-09-12T02:47:19.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.169+0000 7f1b25400640 1 -- 172.21.15.112:0/1503639812 shutdown_connections 2024-09-12T02:47:19.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.169+0000 7f1b25400640 1 --2- 172.21.15.112:0/1503639812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b200ce460 0x7f1b200d0820 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:19.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.169+0000 7f1b25400640 1 -- 172.21.15.112:0/1503639812 >> 172.21.15.112:0/1503639812 conn(0x7f1b2006bbd0 msgr2=0x7f1b2006bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:19.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.169+0000 7f1b25400640 1 -- 172.21.15.112:0/1503639812 shutdown_connections 2024-09-12T02:47:19.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.169+0000 7f1b25400640 1 -- 172.21.15.112:0/1503639812 wait complete. 2024-09-12T02:47:19.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.170+0000 7f1b25400640 1 Processor -- start 2024-09-12T02:47:19.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.171+0000 7f1b25400640 1 -- start start 2024-09-12T02:47:19.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.171+0000 7f1b25400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b200ce460 0x7f1b20153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:19.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.171+0000 7f1b25400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b2015a450 0x7f1b200c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:19.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.171+0000 7f1b25400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b2015db60 0x7f1b200ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:19.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.171+0000 7f1b25400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1b200d0d60 con 0x7f1b200ce460 2024-09-12T02:47:19.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.171+0000 7f1b25400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2015a830 con 0x7f1b2015a450 2024-09-12T02:47:19.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.171+0000 7f1b25400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1b200d0ee0 con 0x7f1b2015db60 2024-09-12T02:47:19.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.172+0000 7f1b1fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b200ce460 0x7f1b20153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:19.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.172+0000 7f1b1fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b200ce460 0x7f1b20153f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46754/0 (socket says 172.21.15.112:46754) 2024-09-12T02:47:19.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.172+0000 7f1b1fe00640 1 -- 172.21.15.112:0/2362937570 learned_addr learned my addr 172.21.15.112:0/2362937570 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:19.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.172+0000 7f1b1f400640 1 --2- 172.21.15.112:0/2362937570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b2015a450 0x7f1b200c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:19.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.172+0000 7f1b24a00640 1 --2- 172.21.15.112:0/2362937570 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b2015db60 0x7f1b200ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:19.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.172+0000 7f1b1fe00640 1 -- 172.21.15.112:0/2362937570 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b2015db60 msgr2=0x7f1b200ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:19.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.172+0000 7f1b1fe00640 1 --2- 172.21.15.112:0/2362937570 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b2015db60 0x7f1b200ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:19.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.172+0000 7f1b1fe00640 1 -- 172.21.15.112:0/2362937570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b2015a450 msgr2=0x7f1b200c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:19.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.172+0000 7f1b1fe00640 1 --2- 172.21.15.112:0/2362937570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b2015a450 0x7f1b200c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:19.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.172+0000 7f1b1fe00640 1 -- 172.21.15.112:0/2362937570 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b200cbf50 con 0x7f1b200ce460 2024-09-12T02:47:19.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.172+0000 7f1b24a00640 1 --2- 172.21.15.112:0/2362937570 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b2015db60 0x7f1b200ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:19.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.173+0000 7f1b1fe00640 1 --2- 172.21.15.112:0/2362937570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b200ce460 0x7f1b20153f40 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f1b1000c4d0 tx=0x7f1b1000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:19.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.173+0000 7f1b17e00640 1 -- 172.21.15.112:0/2362937570 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b10018070 con 0x7f1b200ce460 2024-09-12T02:47:19.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.173+0000 7f1b17e00640 1 -- 172.21.15.112:0/2362937570 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b100074e0 con 0x7f1b200ce460 2024-09-12T02:47:19.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.173+0000 7f1b17e00640 1 -- 172.21.15.112:0/2362937570 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b10004a20 con 0x7f1b200ce460 2024-09-12T02:47:19.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.173+0000 7f1b25400640 1 -- 172.21.15.112:0/2362937570 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b200cc230 con 0x7f1b200ce460 2024-09-12T02:47:19.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.173+0000 7f1b25400640 1 -- 172.21.15.112:0/2362937570 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b20150d00 con 0x7f1b200ce460 2024-09-12T02:47:19.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.174+0000 7f1b25400640 1 -- 172.21.15.112:0/2362937570 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b2015cc90 con 0x7f1b200ce460 2024-09-12T02:47:19.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.175+0000 7f1b17e00640 1 -- 172.21.15.112:0/2362937570 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1b1001b070 con 0x7f1b200ce460 2024-09-12T02:47:19.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.176+0000 7f1b17e00640 1 --2- 172.21.15.112:0/2362937570 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1b0006be30 0x7f1b0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:19.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.176+0000 7f1b17e00640 1 -- 172.21.15.112:0/2362937570 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 4943+0+0 (secure 0 0 0) 0x7f1b10089e60 con 0x7f1b200ce460 2024-09-12T02:47:19.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.176+0000 7f1b1f400640 1 --2- 172.21.15.112:0/2362937570 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1b0006be30 0x7f1b0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:19.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.177+0000 7f1b1f400640 1 --2- 172.21.15.112:0/2362937570 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1b0006be30 0x7f1b0006e2f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c034000 tx=0x7f1b0c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:19.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.180+0000 7f1b17e00640 1 -- 172.21.15.112:0/2362937570 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1b10058420 con 0x7f1b200ce460 2024-09-12T02:47:19.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.422+0000 7f1b25400640 1 -- 172.21.15.112:0/2362937570 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) -- 0x7f1b200d07a0 con 0x7f1b200ce460 2024-09-12T02:47:19.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.627+0000 7f1b17e00640 1 -- 172.21.15.112:0/2362937570 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v281) ==== 137+0+0 (secure 0 0 0) 0x7f1b1005c720 con 0x7f1b200ce460 2024-09-12T02:47:19.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.630+0000 7f1b25400640 1 -- 172.21.15.112:0/2362937570 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1b0006be30 msgr2=0x7f1b0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:19.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.630+0000 7f1b25400640 1 --2- 172.21.15.112:0/2362937570 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1b0006be30 0x7f1b0006e2f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c034000 tx=0x7f1b0c02e000 comp rx=0 tx=0).stop 2024-09-12T02:47:19.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.630+0000 7f1b25400640 1 -- 172.21.15.112:0/2362937570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b200ce460 msgr2=0x7f1b20153f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:19.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.630+0000 7f1b25400640 1 --2- 172.21.15.112:0/2362937570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b200ce460 0x7f1b20153f40 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f1b1000c4d0 tx=0x7f1b1000c990 comp rx=0 tx=0).stop 2024-09-12T02:47:19.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.630+0000 7f1b25400640 1 -- 172.21.15.112:0/2362937570 shutdown_connections 2024-09-12T02:47:19.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.630+0000 7f1b25400640 1 --2- 172.21.15.112:0/2362937570 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b2015db60 0x7f1b200ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:19.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.630+0000 7f1b25400640 1 --2- 172.21.15.112:0/2362937570 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1b0006be30 0x7f1b0006e2f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:19.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.630+0000 7f1b25400640 1 --2- 172.21.15.112:0/2362937570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b2015a450 0x7f1b200c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:19.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.630+0000 7f1b25400640 1 --2- 172.21.15.112:0/2362937570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b200ce460 0x7f1b20153f40 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:19.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.630+0000 7f1b25400640 1 -- 172.21.15.112:0/2362937570 >> 172.21.15.112:0/2362937570 conn(0x7f1b2006bbd0 msgr2=0x7f1b2006d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:19.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.630+0000 7f1b25400640 1 -- 172.21.15.112:0/2362937570 shutdown_connections 2024-09-12T02:47:19.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.630+0000 7f1b25400640 1 -- 172.21.15.112:0/2362937570 wait complete. 2024-09-12T02:47:19.649 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2024-09-12T02:47:19.649 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestQuotaFull) That when an OSD epoch barrier is set on an MDS, subsequently 2024-09-12T02:47:19.649 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestQuotaFull) 2024-09-12T02:47:19.650 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:47:19.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.800+0000 7f2dc1c00640 1 Processor -- start 2024-09-12T02:47:19.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.800+0000 7f2dc1c00640 1 -- start start 2024-09-12T02:47:19.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.801+0000 7f2dc1c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2dbc070bc0 0x7f2dbc0ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:19.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.801+0000 7f2dc1c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dbc06f880 con 0x7f2dbc0cfd30 2024-09-12T02:47:19.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.801+0000 7f2dc1c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dbc06fb20 con 0x7f2dbc15eeb0 2024-09-12T02:47:19.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.801+0000 7f2dc1c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2dbc070730 con 0x7f2dbc070bc0 2024-09-12T02:47:19.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.801+0000 7f2dba000640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2dbc0cfd30 0x7f2dbc166f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47828/0 (socket says 172.21.15.112:47828) 2024-09-12T02:47:19.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.801+0000 7f2dba000640 1 -- 172.21.15.112:0/1358723205 learned_addr learned my addr 172.21.15.112:0/1358723205 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:19.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.802+0000 7f2dbb400640 1 --2- 172.21.15.112:0/1358723205 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2dbc070bc0 0x7f2dbc0ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:19.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.802+0000 7f2db9600640 1 -- 172.21.15.112:0/1358723205 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1513441905 0 0) 0x7f2dbc06f880 con 0x7f2dbc0cfd30 2024-09-12T02:47:19.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.802+0000 7f2db9600640 1 -- 172.21.15.112:0/1358723205 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2da0003520 con 0x7f2dbc0cfd30 2024-09-12T02:47:19.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.802+0000 7f2db9600640 1 -- 172.21.15.112:0/1358723205 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1930229005 0 0) 0x7f2dbc06fb20 con 0x7f2dbc15eeb0 2024-09-12T02:47:19.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.802+0000 7f2db9600640 1 -- 172.21.15.112:0/1358723205 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dbc06f880 con 0x7f2dbc15eeb0 2024-09-12T02:47:19.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.802+0000 7f2dbb400640 1 -- 172.21.15.112:0/1358723205 >> v1:172.21.15.137:6789/0 conn(0x7f2dbc15eeb0 legacy=0x7f2dbc0cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:19.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.802+0000 7f2dbb400640 1 -- 172.21.15.112:0/1358723205 >> v1:172.21.15.112:6789/0 conn(0x7f2dbc0cfd30 legacy=0x7f2dbc166f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:19.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.802+0000 7f2dbb400640 1 -- 172.21.15.112:0/1358723205 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dbc06fe00 con 0x7f2dbc070bc0 2024-09-12T02:47:19.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.803+0000 7f2dbb400640 1 --2- 172.21.15.112:0/1358723205 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2dbc070bc0 0x7f2dbc0ce9b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2db4009dc0 tx=0x7f2db402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6244905d7db34092 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:19.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.804+0000 7f2db9600640 1 -- 172.21.15.112:0/1358723205 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db4007740 con 0x7f2dbc070bc0 2024-09-12T02:47:19.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.804+0000 7f2db9600640 1 -- 172.21.15.112:0/1358723205 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db40078e0 con 0x7f2dbc070bc0 2024-09-12T02:47:19.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.804+0000 7f2db9600640 1 -- 172.21.15.112:0/1358723205 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db4007cb0 con 0x7f2dbc070bc0 2024-09-12T02:47:19.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.804+0000 7f2dc1c00640 1 -- 172.21.15.112:0/1358723205 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2dbc070bc0 msgr2=0x7f2dbc0ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:19.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.804+0000 7f2dc1c00640 1 --2- 172.21.15.112:0/1358723205 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2dbc070bc0 0x7f2dbc0ce9b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2db4009dc0 tx=0x7f2db402a6d0 comp rx=0 tx=0).stop 2024-09-12T02:47:19.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.804+0000 7f2dc1c00640 1 -- 172.21.15.112:0/1358723205 shutdown_connections 2024-09-12T02:47:19.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.804+0000 7f2dc1c00640 1 --2- 172.21.15.112:0/1358723205 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2dbc070bc0 0x7f2dbc0ce9b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:19.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.804+0000 7f2dc1c00640 1 -- 172.21.15.112:0/1358723205 >> 172.21.15.112:0/1358723205 conn(0x7f2dbc0b4720 msgr2=0x7f2dbc0b4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:19.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.804+0000 7f2dc1c00640 1 -- 172.21.15.112:0/1358723205 shutdown_connections 2024-09-12T02:47:19.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.804+0000 7f2dc1c00640 1 -- 172.21.15.112:0/1358723205 wait complete. 2024-09-12T02:47:19.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.806+0000 7f2dc1c00640 1 Processor -- start 2024-09-12T02:47:19.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.806+0000 7f2dc1c00640 1 -- start start 2024-09-12T02:47:19.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.807+0000 7f2dc1c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2dbc070bc0 0x7f2dbc0d3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:19.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.807+0000 7f2dc1c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dbc0cfd30 0x7f2dbc0cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:19.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.807+0000 7f2dc1c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2dbc15eeb0 0x7f2dbc0cac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:19.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.807+0000 7f2dc1c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2dbc15f290 con 0x7f2dbc0cfd30 2024-09-12T02:47:19.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.807+0000 7f2dc1c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2dbc0703c0 con 0x7f2dbc070bc0 2024-09-12T02:47:19.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.807+0000 7f2dc1c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2dbc15f410 con 0x7f2dbc15eeb0 2024-09-12T02:47:19.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.807+0000 7f2dba000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dbc0cfd30 0x7f2dbc0cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:19.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.807+0000 7f2dba000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dbc0cfd30 0x7f2dbc0cc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46766/0 (socket says 172.21.15.112:46766) 2024-09-12T02:47:19.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.807+0000 7f2dba000640 1 -- 172.21.15.112:0/2886539958 learned_addr learned my addr 172.21.15.112:0/2886539958 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:19.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.807+0000 7f2dba000640 1 -- 172.21.15.112:0/2886539958 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2dbc15eeb0 msgr2=0x7f2dbc0cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:19.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.807+0000 7f2dba000640 1 --2- 172.21.15.112:0/2886539958 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2dbc15eeb0 0x7f2dbc0cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:19.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.807+0000 7f2dba000640 1 -- 172.21.15.112:0/2886539958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2dbc070bc0 msgr2=0x7f2dbc0d3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:19.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.807+0000 7f2dba000640 1 --2- 172.21.15.112:0/2886539958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2dbc070bc0 0x7f2dbc0d3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:19.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.807+0000 7f2dba000640 1 -- 172.21.15.112:0/2886539958 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dbc1f4fc0 con 0x7f2dbc0cfd30 2024-09-12T02:47:19.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.808+0000 7f2dba000640 1 --2- 172.21.15.112:0/2886539958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dbc0cfd30 0x7f2dbc0cc710 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f2da800c4d0 tx=0x7f2da800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:19.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.808+0000 7f2db2a00640 1 -- 172.21.15.112:0/2886539958 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da8017070 con 0x7f2dbc0cfd30 2024-09-12T02:47:19.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.808+0000 7f2db2a00640 1 -- 172.21.15.112:0/2886539958 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2da8005ce0 con 0x7f2dbc0cfd30 2024-09-12T02:47:19.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.808+0000 7f2dc1c00640 1 -- 172.21.15.112:0/2886539958 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dbc1f52a0 con 0x7f2dbc0cfd30 2024-09-12T02:47:19.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.808+0000 7f2db2a00640 1 -- 172.21.15.112:0/2886539958 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da8007270 con 0x7f2dbc0cfd30 2024-09-12T02:47:19.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.808+0000 7f2dc1c00640 1 -- 172.21.15.112:0/2886539958 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dbc1f5860 con 0x7f2dbc0cfd30 2024-09-12T02:47:19.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.809+0000 7f2dc1c00640 1 -- 172.21.15.112:0/2886539958 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dbc0763a0 con 0x7f2dbc0cfd30 2024-09-12T02:47:19.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.810+0000 7f2db2a00640 1 -- 172.21.15.112:0/2886539958 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2da801a070 con 0x7f2dbc0cfd30 2024-09-12T02:47:19.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.811+0000 7f2db2a00640 1 --2- 172.21.15.112:0/2886539958 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2d9c06be30 0x7f2d9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:19.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.811+0000 7f2db2a00640 1 -- 172.21.15.112:0/2886539958 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 4943+0+0 (secure 0 0 0) 0x7f2da8089e90 con 0x7f2dbc0cfd30 2024-09-12T02:47:19.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.811+0000 7f2dbaa00640 1 --2- 172.21.15.112:0/2886539958 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2d9c06be30 0x7f2d9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:19.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.812+0000 7f2dbaa00640 1 --2- 172.21.15.112:0/2886539958 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2d9c06be30 0x7f2d9c06e2f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2dac0011e0 tx=0x7f2dac0078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:19.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.815+0000 7f2db2a00640 1 -- 172.21.15.112:0/2886539958 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2da80584f0 con 0x7f2dbc0cfd30 2024-09-12T02:47:19.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.990+0000 7f2dc1c00640 1 -- 172.21.15.112:0/2886539958 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2dbc0ce9b0 con 0x7f2dbc0cfd30 2024-09-12T02:47:19.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.991+0000 7f2db2a00640 1 -- 172.21.15.112:0/2886539958 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) ==== 74+0+13085 (secure 0 0 0) 0x7f2da805c7f0 con 0x7f2dbc0cfd30 2024-09-12T02:47:19.992 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:19.993 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":112,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:47:18.624322+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6837/1018665478":"2024-09-13T02:47:15.611423+0000","172.21.15.112:6835/1018665478":"2024-09-13T02:47:15.611423+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:47:19.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.994+0000 7f2dc1c00640 1 -- 172.21.15.112:0/2886539958 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2d9c06be30 msgr2=0x7f2d9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:19.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.994+0000 7f2dc1c00640 1 --2- 172.21.15.112:0/2886539958 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2d9c06be30 0x7f2d9c06e2f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2dac0011e0 tx=0x7f2dac0078f0 comp rx=0 tx=0).stop 2024-09-12T02:47:19.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.994+0000 7f2dc1c00640 1 -- 172.21.15.112:0/2886539958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dbc0cfd30 msgr2=0x7f2dbc0cc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:19.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.994+0000 7f2dc1c00640 1 --2- 172.21.15.112:0/2886539958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dbc0cfd30 0x7f2dbc0cc710 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f2da800c4d0 tx=0x7f2da800c990 comp rx=0 tx=0).stop 2024-09-12T02:47:19.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.994+0000 7f2dc1c00640 1 -- 172.21.15.112:0/2886539958 shutdown_connections 2024-09-12T02:47:19.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.994+0000 7f2dc1c00640 1 --2- 172.21.15.112:0/2886539958 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2dbc15eeb0 0x7f2dbc0cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:19.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.994+0000 7f2dc1c00640 1 --2- 172.21.15.112:0/2886539958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dbc0cfd30 0x7f2dbc0cc710 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:19.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.994+0000 7f2dc1c00640 1 --2- 172.21.15.112:0/2886539958 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2d9c06be30 0x7f2d9c06e2f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:19.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.994+0000 7f2dc1c00640 1 --2- 172.21.15.112:0/2886539958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2dbc070bc0 0x7f2dbc0d3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:19.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.994+0000 7f2dc1c00640 1 -- 172.21.15.112:0/2886539958 >> 172.21.15.112:0/2886539958 conn(0x7f2dbc0b4720 msgr2=0x7f2dbc0b4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:19.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.994+0000 7f2dc1c00640 1 -- 172.21.15.112:0/2886539958 shutdown_connections 2024-09-12T02:47:19.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:19.994+0000 7f2dc1c00640 1 -- 172.21.15.112:0/2886539958 wait complete. 2024-09-12T02:47:20.011 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:41:43.011599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:47:20.011 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T02:47:20.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.166+0000 7f9de4400640 1 Processor -- start 2024-09-12T02:47:20.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.166+0000 7f9de4400640 1 -- start start 2024-09-12T02:47:20.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.167+0000 7f9de4400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ddc15b9d0 0x7f9ddc0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:20.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.168+0000 7f9de4400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ddc0b54a0 con 0x7f9ddc06f600 2024-09-12T02:47:20.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.168+0000 7f9de4400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ddc0b3af0 con 0x7f9ddc0b45d0 2024-09-12T02:47:20.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.168+0000 7f9de4400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9ddc0b4a30 con 0x7f9ddc15b9d0 2024-09-12T02:47:20.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.168+0000 7f9de2400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f9ddc06f600 0x7f9ddc0cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47838/0 (socket says 172.21.15.112:47838) 2024-09-12T02:47:20.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.168+0000 7f9de2400640 1 -- 172.21.15.112:0/3622527580 learned_addr learned my addr 172.21.15.112:0/3622527580 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:20.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.168+0000 7f9de1a00640 1 --2- 172.21.15.112:0/3622527580 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ddc15b9d0 0x7f9ddc0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:20.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.168+0000 7f9ddbe00640 1 -- 172.21.15.112:0/3622527580 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1766377210 0 0) 0x7f9ddc0b54a0 con 0x7f9ddc06f600 2024-09-12T02:47:20.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.168+0000 7f9ddbe00640 1 -- 172.21.15.112:0/3622527580 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9dc4003520 con 0x7f9ddc06f600 2024-09-12T02:47:20.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.169+0000 7f9ddbe00640 1 -- 172.21.15.112:0/3622527580 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1637486617 0 0) 0x7f9ddc0b3af0 con 0x7f9ddc0b45d0 2024-09-12T02:47:20.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.169+0000 7f9ddbe00640 1 -- 172.21.15.112:0/3622527580 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ddc0b54a0 con 0x7f9ddc0b45d0 2024-09-12T02:47:20.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.169+0000 7f9de1a00640 1 -- 172.21.15.112:0/3622527580 >> v1:172.21.15.137:6789/0 conn(0x7f9ddc0b45d0 legacy=0x7f9ddc06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:20.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.169+0000 7f9de1a00640 1 -- 172.21.15.112:0/3622527580 >> v1:172.21.15.112:6789/0 conn(0x7f9ddc06f600 legacy=0x7f9ddc0cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:20.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.169+0000 7f9de1a00640 1 -- 172.21.15.112:0/3622527580 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ddc0b3dd0 con 0x7f9ddc15b9d0 2024-09-12T02:47:20.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.170+0000 7f9de1a00640 1 --2- 172.21.15.112:0/3622527580 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ddc15b9d0 0x7f9ddc0b4ec0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009dc0 tx=0x7f9dd002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0bd00442dc791b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:20.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.170+0000 7f9ddbe00640 1 -- 172.21.15.112:0/3622527580 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0007740 con 0x7f9ddc15b9d0 2024-09-12T02:47:20.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.170+0000 7f9ddbe00640 1 -- 172.21.15.112:0/3622527580 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dd00078e0 con 0x7f9ddc15b9d0 2024-09-12T02:47:20.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.170+0000 7f9ddbe00640 1 -- 172.21.15.112:0/3622527580 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0007c90 con 0x7f9ddc15b9d0 2024-09-12T02:47:20.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.171+0000 7f9de4400640 1 -- 172.21.15.112:0/3622527580 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ddc15b9d0 msgr2=0x7f9ddc0b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:20.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.171+0000 7f9de4400640 1 --2- 172.21.15.112:0/3622527580 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ddc15b9d0 0x7f9ddc0b4ec0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009dc0 tx=0x7f9dd002a6d0 comp rx=0 tx=0).stop 2024-09-12T02:47:20.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.171+0000 7f9de4400640 1 -- 172.21.15.112:0/3622527580 shutdown_connections 2024-09-12T02:47:20.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.171+0000 7f9de4400640 1 --2- 172.21.15.112:0/3622527580 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ddc15b9d0 0x7f9ddc0b4ec0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:20.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.171+0000 7f9de4400640 1 -- 172.21.15.112:0/3622527580 >> 172.21.15.112:0/3622527580 conn(0x7f9ddc06bbd0 msgr2=0x7f9ddc06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:20.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.171+0000 7f9de4400640 1 -- 172.21.15.112:0/3622527580 shutdown_connections 2024-09-12T02:47:20.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.171+0000 7f9de4400640 1 -- 172.21.15.112:0/3622527580 wait complete. 2024-09-12T02:47:20.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.172+0000 7f9de4400640 1 Processor -- start 2024-09-12T02:47:20.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.172+0000 7f9de4400640 1 -- start start 2024-09-12T02:47:20.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.173+0000 7f9de4400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ddc06f600 0x7f9ddc152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:20.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.173+0000 7f9de4400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ddc0b45d0 0x7f9ddc15c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:20.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.173+0000 7f9de4400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ddc15b9d0 0x7f9ddc15ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:20.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.173+0000 7f9de4400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9ddc15bf30 con 0x7f9ddc06f600 2024-09-12T02:47:20.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.173+0000 7f9de4400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9ddc15bdb0 con 0x7f9ddc0b45d0 2024-09-12T02:47:20.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.173+0000 7f9de4400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9ddc0728c0 con 0x7f9ddc15b9d0 2024-09-12T02:47:20.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.173+0000 7f9de1a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ddc06f600 0x7f9ddc152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:20.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.174+0000 7f9de1a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ddc06f600 0x7f9ddc152680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46770/0 (socket says 172.21.15.112:46770) 2024-09-12T02:47:20.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.174+0000 7f9de1a00640 1 -- 172.21.15.112:0/2394276519 learned_addr learned my addr 172.21.15.112:0/2394276519 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:20.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.174+0000 7f9de1000640 1 --2- 172.21.15.112:0/2394276519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ddc0b45d0 0x7f9ddc15c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:20.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.174+0000 7f9de2400640 1 --2- 172.21.15.112:0/2394276519 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ddc15b9d0 0x7f9ddc15ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:20.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.174+0000 7f9de1a00640 1 -- 172.21.15.112:0/2394276519 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ddc15b9d0 msgr2=0x7f9ddc15ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:20.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.174+0000 7f9de1a00640 1 --2- 172.21.15.112:0/2394276519 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ddc15b9d0 0x7f9ddc15ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:20.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.174+0000 7f9de1a00640 1 -- 172.21.15.112:0/2394276519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ddc0b45d0 msgr2=0x7f9ddc15c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:20.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.174+0000 7f9de1a00640 1 --2- 172.21.15.112:0/2394276519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ddc0b45d0 0x7f9ddc15c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:20.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.174+0000 7f9de1a00640 1 -- 172.21.15.112:0/2394276519 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ddc15ff60 con 0x7f9ddc06f600 2024-09-12T02:47:20.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.174+0000 7f9de1000640 1 --2- 172.21.15.112:0/2394276519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ddc0b45d0 0x7f9ddc15c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:20.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.174+0000 7f9de1a00640 1 --2- 172.21.15.112:0/2394276519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ddc06f600 0x7f9ddc152680 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009ee0 tx=0x7f9dd0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:20.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.174+0000 7f9dd9600640 1 -- 172.21.15.112:0/2394276519 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd003f070 con 0x7f9ddc06f600 2024-09-12T02:47:20.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.175+0000 7f9dd9600640 1 -- 172.21.15.112:0/2394276519 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dd0031c40 con 0x7f9ddc06f600 2024-09-12T02:47:20.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.175+0000 7f9dd9600640 1 -- 172.21.15.112:0/2394276519 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0009450 con 0x7f9ddc06f600 2024-09-12T02:47:20.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.175+0000 7f9de4400640 1 -- 172.21.15.112:0/2394276519 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ddc152bc0 con 0x7f9ddc06f600 2024-09-12T02:47:20.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.175+0000 7f9de4400640 1 -- 172.21.15.112:0/2394276519 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ddc15fc80 con 0x7f9ddc06f600 2024-09-12T02:47:20.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.176+0000 7f9de4400640 1 -- 172.21.15.112:0/2394276519 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ddc068a30 con 0x7f9ddc06f600 2024-09-12T02:47:20.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.177+0000 7f9dd9600640 1 -- 172.21.15.112:0/2394276519 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9dd003b410 con 0x7f9ddc06f600 2024-09-12T02:47:20.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.177+0000 7f9dd9600640 1 --2- 172.21.15.112:0/2394276519 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9dbc06be30 0x7f9dbc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:20.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.177+0000 7f9dd9600640 1 -- 172.21.15.112:0/2394276519 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 4943+0+0 (secure 0 0 0) 0x7f9dd00ac240 con 0x7f9ddc06f600 2024-09-12T02:47:20.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.178+0000 7f9de1000640 1 --2- 172.21.15.112:0/2394276519 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9dbc06be30 0x7f9dbc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:20.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.178+0000 7f9de1000640 1 --2- 172.21.15.112:0/2394276519 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9dbc06be30 0x7f9dbc06e2f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc072620 tx=0x7f9dc8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:20.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.182+0000 7f9dd9600640 1 -- 172.21.15.112:0/2394276519 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9dd007aee0 con 0x7f9ddc06f600 2024-09-12T02:47:20.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.353+0000 7f9de4400640 1 -- 172.21.15.112:0/2394276519 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9ddc06dbc0 con 0x7f9ddc06f600 2024-09-12T02:47:20.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.354+0000 7f9dd9600640 1 -- 172.21.15.112:0/2394276519 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v112) ==== 93+0+10 (secure 0 0 0) 0x7f9dd007a7e0 con 0x7f9ddc06f600 2024-09-12T02:47:20.355 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2024-09-12T02:47:20.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.356+0000 7f9de4400640 1 -- 172.21.15.112:0/2394276519 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9dbc06be30 msgr2=0x7f9dbc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:20.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.356+0000 7f9de4400640 1 --2- 172.21.15.112:0/2394276519 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9dbc06be30 0x7f9dbc06e2f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc072620 tx=0x7f9dc8009040 comp rx=0 tx=0).stop 2024-09-12T02:47:20.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.356+0000 7f9de4400640 1 -- 172.21.15.112:0/2394276519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ddc06f600 msgr2=0x7f9ddc152680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:20.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.356+0000 7f9de4400640 1 --2- 172.21.15.112:0/2394276519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ddc06f600 0x7f9ddc152680 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009ee0 tx=0x7f9dd0004a40 comp rx=0 tx=0).stop 2024-09-12T02:47:20.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.356+0000 7f9de4400640 1 -- 172.21.15.112:0/2394276519 shutdown_connections 2024-09-12T02:47:20.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.356+0000 7f9de4400640 1 --2- 172.21.15.112:0/2394276519 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ddc15b9d0 0x7f9ddc15ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:20.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.356+0000 7f9de4400640 1 --2- 172.21.15.112:0/2394276519 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9dbc06be30 0x7f9dbc06e2f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:20.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.356+0000 7f9de4400640 1 --2- 172.21.15.112:0/2394276519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ddc0b45d0 0x7f9ddc15c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:20.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.356+0000 7f9de4400640 1 --2- 172.21.15.112:0/2394276519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ddc06f600 0x7f9ddc152680 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:20.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.356+0000 7f9de4400640 1 -- 172.21.15.112:0/2394276519 >> 172.21.15.112:0/2394276519 conn(0x7f9ddc06bbd0 msgr2=0x7f9ddc159c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:20.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.356+0000 7f9de4400640 1 -- 172.21.15.112:0/2394276519 shutdown_connections 2024-09-12T02:47:20.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.356+0000 7f9de4400640 1 -- 172.21.15.112:0/2394276519 wait complete. 2024-09-12T02:47:20.373 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2024-09-12T02:47:20.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.524+0000 7fd7c2800640 1 Processor -- start 2024-09-12T02:47:20.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.524+0000 7fd7c2800640 1 -- start start 2024-09-12T02:47:20.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.526+0000 7fd7c2800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd7bc071530 0x7fd7bc0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:20.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.526+0000 7fd7c2800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7bc0719a0 0x7fd7bc0afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:20.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.526+0000 7fd7c2800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7bc0ceeb0 con 0x7fd7bc15cc50 2024-09-12T02:47:20.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.526+0000 7fd7c2800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd7bc15d030 con 0x7fd7bc071530 2024-09-12T02:47:20.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.526+0000 7fd7c2800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd7bc0cf4c0 con 0x7fd7bc0719a0 2024-09-12T02:47:20.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.526+0000 7fd7b2a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd7bc071530 0x7fd7bc0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:20.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.526+0000 7fd7bb400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd7bc15cc50 0x7fd7bc0732f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47854/0 (socket says 172.21.15.112:47854) 2024-09-12T02:47:20.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.526+0000 7fd7bb400640 1 -- 172.21.15.112:0/80962940 learned_addr learned my addr 172.21.15.112:0/80962940 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:20.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.526+0000 7fd7bbe00640 1 --2- 172.21.15.112:0/80962940 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7bc0719a0 0x7fd7bc0afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:20.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.526+0000 7fd7b2a00640 1 -- 172.21.15.112:0/80962940 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7bc0719a0 msgr2=0x7fd7bc0afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:20.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.526+0000 7fd7b2a00640 1 --2- 172.21.15.112:0/80962940 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7bc0719a0 0x7fd7bc0afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:20.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.526+0000 7fd7b2a00640 1 -- 172.21.15.112:0/80962940 >> v1:172.21.15.112:6789/0 conn(0x7fd7bc15cc50 legacy=0x7fd7bc0732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:20.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.526+0000 7fd7b2a00640 1 -- 172.21.15.112:0/80962940 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7bc06e300 con 0x7fd7bc071530 2024-09-12T02:47:20.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.526+0000 7fd7baa00640 1 -- 172.21.15.112:0/80962940 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1783073417 0 0) 0x7fd7bc0ceeb0 con 0x7fd7bc15cc50 2024-09-12T02:47:20.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.527+0000 7fd7b2a00640 1 --2- 172.21.15.112:0/80962940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7bc071530 0x7fd7bc0af720 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc0cf640 tx=0x7fd7a402a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1fcc3da0b4c92e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:20.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.528+0000 7fd7baa00640 1 -- 172.21.15.112:0/80962940 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4037070 con 0x7fd7bc071530 2024-09-12T02:47:20.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.528+0000 7fd7baa00640 1 -- 172.21.15.112:0/80962940 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7a402ae20 con 0x7fd7bc071530 2024-09-12T02:47:20.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.528+0000 7fd7baa00640 1 -- 172.21.15.112:0/80962940 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4032660 con 0x7fd7bc071530 2024-09-12T02:47:20.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.528+0000 7fd7c2800640 1 -- 172.21.15.112:0/80962940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7bc071530 msgr2=0x7fd7bc0af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:20.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.528+0000 7fd7c2800640 1 --2- 172.21.15.112:0/80962940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7bc071530 0x7fd7bc0af720 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc0cf640 tx=0x7fd7a402a0d0 comp rx=0 tx=0).stop 2024-09-12T02:47:20.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.528+0000 7fd7c2800640 1 -- 172.21.15.112:0/80962940 shutdown_connections 2024-09-12T02:47:20.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.528+0000 7fd7c2800640 1 --2- 172.21.15.112:0/80962940 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7bc0719a0 0x7fd7bc0afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:20.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.528+0000 7fd7c2800640 1 --2- 172.21.15.112:0/80962940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7bc071530 0x7fd7bc0af720 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:20.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.528+0000 7fd7c2800640 1 -- 172.21.15.112:0/80962940 >> 172.21.15.112:0/80962940 conn(0x7fd7bc06bbd0 msgr2=0x7fd7bc06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:20.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.528+0000 7fd7c2800640 1 -- 172.21.15.112:0/80962940 shutdown_connections 2024-09-12T02:47:20.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.528+0000 7fd7c2800640 1 -- 172.21.15.112:0/80962940 wait complete. 2024-09-12T02:47:20.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.530+0000 7fd7c2800640 1 Processor -- start 2024-09-12T02:47:20.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.530+0000 7fd7c2800640 1 -- start start 2024-09-12T02:47:20.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.531+0000 7fd7c2800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7bc071530 0x7fd7bc144380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:20.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.531+0000 7fd7c2800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7bc0719a0 0x7fd7bc155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:20.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.531+0000 7fd7c2800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7bc15cc50 0x7fd7bc15f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:20.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.531+0000 7fd7c2800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd7bc06f510 con 0x7fd7bc071530 2024-09-12T02:47:20.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.531+0000 7fd7c2800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd7bc0cf150 con 0x7fd7bc15cc50 2024-09-12T02:47:20.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.531+0000 7fd7c2800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd7bc06f690 con 0x7fd7bc0719a0 2024-09-12T02:47:20.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.531+0000 7fd7bb400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7bc071530 0x7fd7bc144380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:20.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.531+0000 7fd7bb400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7bc071530 0x7fd7bc144380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46778/0 (socket says 172.21.15.112:46778) 2024-09-12T02:47:20.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.531+0000 7fd7bb400640 1 -- 172.21.15.112:0/3835583261 learned_addr learned my addr 172.21.15.112:0/3835583261 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:20.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.532+0000 7fd7bb400640 1 -- 172.21.15.112:0/3835583261 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7bc0719a0 msgr2=0x7fd7bc155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:20.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.532+0000 7fd7bb400640 1 --2- 172.21.15.112:0/3835583261 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7bc0719a0 0x7fd7bc155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:20.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.532+0000 7fd7bb400640 1 -- 172.21.15.112:0/3835583261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7bc15cc50 msgr2=0x7fd7bc15f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:20.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.532+0000 7fd7bb400640 1 --2- 172.21.15.112:0/3835583261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7bc15cc50 0x7fd7bc15f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:20.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.532+0000 7fd7bb400640 1 -- 172.21.15.112:0/3835583261 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7bc156b50 con 0x7fd7bc071530 2024-09-12T02:47:20.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.532+0000 7fd7bb400640 1 --2- 172.21.15.112:0/3835583261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7bc071530 0x7fd7bc144380 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac00c430 tx=0x7fd7ac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:20.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.532+0000 7fd7b3e00640 1 -- 172.21.15.112:0/3835583261 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac0074e0 con 0x7fd7bc071530 2024-09-12T02:47:20.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.532+0000 7fd7b3e00640 1 -- 172.21.15.112:0/3835583261 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7ac0047e0 con 0x7fd7bc071530 2024-09-12T02:47:20.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.532+0000 7fd7b3e00640 1 -- 172.21.15.112:0/3835583261 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac004bd0 con 0x7fd7bc071530 2024-09-12T02:47:20.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.532+0000 7fd7c2800640 1 -- 172.21.15.112:0/3835583261 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7bc156590 con 0x7fd7bc071530 2024-09-12T02:47:20.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.532+0000 7fd7c2800640 1 -- 172.21.15.112:0/3835583261 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7bc15d260 con 0x7fd7bc071530 2024-09-12T02:47:20.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.533+0000 7fd7c2800640 1 -- 172.21.15.112:0/3835583261 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7bc0cdc60 con 0x7fd7bc071530 2024-09-12T02:47:20.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.534+0000 7fd7b3e00640 1 -- 172.21.15.112:0/3835583261 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd7ac011070 con 0x7fd7bc071530 2024-09-12T02:47:20.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.535+0000 7fd7b3e00640 1 --2- 172.21.15.112:0/3835583261 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd79806be30 0x7fd79806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:20.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.535+0000 7fd7b3e00640 1 -- 172.21.15.112:0/3835583261 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 4943+0+0 (secure 0 0 0) 0x7fd7ac08a870 con 0x7fd7bc071530 2024-09-12T02:47:20.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.536+0000 7fd7b2a00640 1 --2- 172.21.15.112:0/3835583261 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd79806be30 0x7fd79806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:20.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.536+0000 7fd7b2a00640 1 --2- 172.21.15.112:0/3835583261 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd79806be30 0x7fd79806e2f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4034000 tx=0x7fd7a402c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:20.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.539+0000 7fd7b3e00640 1 -- 172.21.15.112:0/3835583261 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd7bc0cdc60 con 0x7fd7bc071530 2024-09-12T02:47:20.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:20.777+0000 7fd7c2800640 1 -- 172.21.15.112:0/3835583261 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) -- 0x7fd7bc0730d0 con 0x7fd7bc071530 2024-09-12T02:47:21.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.634+0000 7fd7b3e00640 1 -- 172.21.15.112:0/3835583261 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v283) ==== 131+0+0 (secure 0 0 0) 0x7fd7ac00e280 con 0x7fd7bc071530 2024-09-12T02:47:21.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.637+0000 7fd7c2800640 1 -- 172.21.15.112:0/3835583261 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd79806be30 msgr2=0x7fd79806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:21.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.637+0000 7fd7c2800640 1 --2- 172.21.15.112:0/3835583261 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd79806be30 0x7fd79806e2f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4034000 tx=0x7fd7a402c000 comp rx=0 tx=0).stop 2024-09-12T02:47:21.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.637+0000 7fd7c2800640 1 -- 172.21.15.112:0/3835583261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7bc071530 msgr2=0x7fd7bc144380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:21.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.637+0000 7fd7c2800640 1 --2- 172.21.15.112:0/3835583261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7bc071530 0x7fd7bc144380 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac00c430 tx=0x7fd7ac00c8f0 comp rx=0 tx=0).stop 2024-09-12T02:47:21.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.637+0000 7fd7c2800640 1 -- 172.21.15.112:0/3835583261 shutdown_connections 2024-09-12T02:47:21.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.637+0000 7fd7c2800640 1 --2- 172.21.15.112:0/3835583261 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd79806be30 0x7fd79806e2f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:21.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.637+0000 7fd7c2800640 1 --2- 172.21.15.112:0/3835583261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7bc15cc50 0x7fd7bc15f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:21.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.637+0000 7fd7c2800640 1 --2- 172.21.15.112:0/3835583261 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7bc0719a0 0x7fd7bc155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:21.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.637+0000 7fd7c2800640 1 --2- 172.21.15.112:0/3835583261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7bc071530 0x7fd7bc144380 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:21.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.637+0000 7fd7c2800640 1 -- 172.21.15.112:0/3835583261 >> 172.21.15.112:0/3835583261 conn(0x7fd7bc06bbd0 msgr2=0x7fd7bc159950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:21.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.637+0000 7fd7c2800640 1 -- 172.21.15.112:0/3835583261 shutdown_connections 2024-09-12T02:47:21.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.637+0000 7fd7c2800640 1 -- 172.21.15.112:0/3835583261 wait complete. 2024-09-12T02:47:21.657 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T02:47:21.659 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:47:21.665 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:47:21.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.819+0000 7f5c75e00640 1 Processor -- start 2024-09-12T02:47:21.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.819+0000 7f5c75e00640 1 -- start start 2024-09-12T02:47:21.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.820+0000 7f5c75e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5c701623c0 0x7f5c700d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:21.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.820+0000 7f5c75e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c700b4d30 0x7f5c700d3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:21.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.820+0000 7f5c75e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c701627a0 con 0x7f5c700d0370 2024-09-12T02:47:21.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.820+0000 7f5c75e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f5c700d08e0 con 0x7f5c701623c0 2024-09-12T02:47:21.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.820+0000 7f5c75e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5c700d0bc0 con 0x7f5c700b4d30 2024-09-12T02:47:21.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.820+0000 7f5c67e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f5c700d0370 0x7f5c700b4620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47870/0 (socket says 172.21.15.112:47870) 2024-09-12T02:47:21.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.820+0000 7f5c67e00640 1 -- 172.21.15.112:0/3167635576 learned_addr learned my addr 172.21.15.112:0/3167635576 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:21.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.820+0000 7f5c74a00640 1 --2- 172.21.15.112:0/3167635576 >> v2:172.21.15.137:3300/0 conn(0x7f5c701623c0 0x7f5c700d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:21.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.820+0000 7f5c75400640 1 --2- 172.21.15.112:0/3167635576 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c700b4d30 0x7f5c700d3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:21.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.821+0000 7f5c6fe00640 1 -- 172.21.15.112:0/3167635576 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2497050022 0 0) 0x7f5c701627a0 con 0x7f5c700d0370 2024-09-12T02:47:21.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.821+0000 7f5c6fe00640 1 -- 172.21.15.112:0/3167635576 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c54003520 con 0x7f5c700d0370 2024-09-12T02:47:21.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.821+0000 7f5c75400640 1 -- 172.21.15.112:0/3167635576 >> v2:172.21.15.137:3300/0 conn(0x7f5c701623c0 msgr2=0x7f5c700d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:21.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.821+0000 7f5c75400640 1 --2- 172.21.15.112:0/3167635576 >> v2:172.21.15.137:3300/0 conn(0x7f5c701623c0 0x7f5c700d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:21.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.821+0000 7f5c75400640 1 -- 172.21.15.112:0/3167635576 >> v1:172.21.15.112:6789/0 conn(0x7f5c700d0370 legacy=0x7f5c700b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:21.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.821+0000 7f5c75400640 1 -- 172.21.15.112:0/3167635576 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c700d2930 con 0x7f5c700b4d30 2024-09-12T02:47:21.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.821+0000 7f5c74a00640 1 --2- 172.21.15.112:0/3167635576 >> v2:172.21.15.137:3300/0 conn(0x7f5c701623c0 0x7f5c700d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:21.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.822+0000 7f5c75400640 1 --2- 172.21.15.112:0/3167635576 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c700b4d30 0x7f5c700d3950 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5c68009d90 tx=0x7f5c6802a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d3219fdb3c9b27 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:21.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.822+0000 7f5c6fe00640 1 -- 172.21.15.112:0/3167635576 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c68007740 con 0x7f5c700b4d30 2024-09-12T02:47:21.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.822+0000 7f5c6fe00640 1 -- 172.21.15.112:0/3167635576 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c680078e0 con 0x7f5c700b4d30 2024-09-12T02:47:21.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.822+0000 7f5c6fe00640 1 -- 172.21.15.112:0/3167635576 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c68007cb0 con 0x7f5c700b4d30 2024-09-12T02:47:21.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.823+0000 7f5c75e00640 1 -- 172.21.15.112:0/3167635576 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c700b4d30 msgr2=0x7f5c700d3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:21.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.823+0000 7f5c75e00640 1 --2- 172.21.15.112:0/3167635576 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c700b4d30 0x7f5c700d3950 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5c68009d90 tx=0x7f5c6802a6f0 comp rx=0 tx=0).stop 2024-09-12T02:47:21.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.823+0000 7f5c75e00640 1 -- 172.21.15.112:0/3167635576 shutdown_connections 2024-09-12T02:47:21.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.823+0000 7f5c75e00640 1 --2- 172.21.15.112:0/3167635576 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c700b4d30 0x7f5c700d3950 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:21.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.823+0000 7f5c75e00640 1 --2- 172.21.15.112:0/3167635576 >> v2:172.21.15.137:3300/0 conn(0x7f5c701623c0 0x7f5c700d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:21.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.823+0000 7f5c75e00640 1 -- 172.21.15.112:0/3167635576 >> 172.21.15.112:0/3167635576 conn(0x7f5c700d4cc0 msgr2=0x7f5c700d50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:21.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.823+0000 7f5c75e00640 1 -- 172.21.15.112:0/3167635576 shutdown_connections 2024-09-12T02:47:21.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.823+0000 7f5c75e00640 1 -- 172.21.15.112:0/3167635576 wait complete. 2024-09-12T02:47:21.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.824+0000 7f5c75e00640 1 Processor -- start 2024-09-12T02:47:21.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.825+0000 7f5c75e00640 1 -- start start 2024-09-12T02:47:21.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.825+0000 7f5c75e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c700d0370 0x7f5c701f8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:21.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.825+0000 7f5c75e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c701623c0 0x7f5c70158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:21.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.825+0000 7f5c75e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c701616d0 0x7f5c7015e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:21.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.825+0000 7f5c75e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5c700b6460 con 0x7f5c701616d0 2024-09-12T02:47:21.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.825+0000 7f5c75e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5c700d2ef0 con 0x7f5c701623c0 2024-09-12T02:47:21.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.825+0000 7f5c75e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5c700b65e0 con 0x7f5c700d0370 2024-09-12T02:47:21.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.826+0000 7f5c75400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c701616d0 0x7f5c7015e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:21.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.826+0000 7f5c75400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c701616d0 0x7f5c7015e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46784/0 (socket says 172.21.15.112:46784) 2024-09-12T02:47:21.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.826+0000 7f5c75400640 1 -- 172.21.15.112:0/3148850403 learned_addr learned my addr 172.21.15.112:0/3148850403 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:21.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.826+0000 7f5c74a00640 1 --2- 172.21.15.112:0/3148850403 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c700d0370 0x7f5c701f8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:21.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.826+0000 7f5c67e00640 1 --2- 172.21.15.112:0/3148850403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c701623c0 0x7f5c70158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:21.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.826+0000 7f5c75400640 1 -- 172.21.15.112:0/3148850403 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c700d0370 msgr2=0x7f5c701f8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:21.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.826+0000 7f5c75400640 1 --2- 172.21.15.112:0/3148850403 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c700d0370 0x7f5c701f8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:21.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.826+0000 7f5c75400640 1 -- 172.21.15.112:0/3148850403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c701623c0 msgr2=0x7f5c70158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:21.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.826+0000 7f5c75400640 1 --2- 172.21.15.112:0/3148850403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c701623c0 0x7f5c70158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:21.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.826+0000 7f5c75400640 1 -- 172.21.15.112:0/3148850403 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c700b9530 con 0x7f5c701616d0 2024-09-12T02:47:21.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.826+0000 7f5c75400640 1 --2- 172.21.15.112:0/3148850403 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c701616d0 0x7f5c7015e660 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f5c6802ace0 tx=0x7f5c68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:21.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.827+0000 7f5c6d600640 1 -- 172.21.15.112:0/3148850403 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c68040070 con 0x7f5c701616d0 2024-09-12T02:47:21.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.827+0000 7f5c6d600640 1 -- 172.21.15.112:0/3148850403 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c68031bc0 con 0x7f5c701616d0 2024-09-12T02:47:21.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.827+0000 7f5c75e00640 1 -- 172.21.15.112:0/3148850403 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c70161b90 con 0x7f5c701616d0 2024-09-12T02:47:21.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.827+0000 7f5c6d600640 1 -- 172.21.15.112:0/3148850403 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c68009450 con 0x7f5c701616d0 2024-09-12T02:47:21.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.827+0000 7f5c75e00640 1 -- 172.21.15.112:0/3148850403 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c700b9b20 con 0x7f5c701616d0 2024-09-12T02:47:21.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.828+0000 7f5c75e00640 1 -- 172.21.15.112:0/3148850403 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c7008e7c0 con 0x7f5c701616d0 2024-09-12T02:47:21.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.829+0000 7f5c6d600640 1 -- 172.21.15.112:0/3148850403 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5c68039040 con 0x7f5c701616d0 2024-09-12T02:47:21.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.830+0000 7f5c6d600640 1 --2- 172.21.15.112:0/3148850403 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5c4c06be60 0x7f5c4c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:21.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.830+0000 7f5c6d600640 1 -- 172.21.15.112:0/3148850403 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 4943+0+0 (secure 0 0 0) 0x7f5c680ac2b0 con 0x7f5c701616d0 2024-09-12T02:47:21.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.830+0000 7f5c74a00640 1 --2- 172.21.15.112:0/3148850403 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5c4c06be60 0x7f5c4c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:21.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.830+0000 7f5c74a00640 1 --2- 172.21.15.112:0/3148850403 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5c4c06be60 0x7f5c4c06e320 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5c60009560 tx=0x7f5c60009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:21.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:21.834+0000 7f5c6d600640 1 -- 172.21.15.112:0/3148850403 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5c6807aa20 con 0x7f5c701616d0 2024-09-12T02:47:22.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.007+0000 7f5c75e00640 1 -- 172.21.15.112:0/3148850403 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f5c700b7310 con 0x7f5c701616d0 2024-09-12T02:47:22.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.011+0000 7f5c6d600640 1 -- 172.21.15.112:0/3148850403 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f5c6807ed20 con 0x7f5c701616d0 2024-09-12T02:47:22.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.013+0000 7f5c75e00640 1 -- 172.21.15.112:0/3148850403 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5c4c06be60 msgr2=0x7f5c4c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:22.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.013+0000 7f5c75e00640 1 --2- 172.21.15.112:0/3148850403 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5c4c06be60 0x7f5c4c06e320 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5c60009560 tx=0x7f5c60009190 comp rx=0 tx=0).stop 2024-09-12T02:47:22.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.013+0000 7f5c75e00640 1 -- 172.21.15.112:0/3148850403 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c701616d0 msgr2=0x7f5c7015e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:22.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.013+0000 7f5c75e00640 1 --2- 172.21.15.112:0/3148850403 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c701616d0 0x7f5c7015e660 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f5c6802ace0 tx=0x7f5c68004a40 comp rx=0 tx=0).stop 2024-09-12T02:47:22.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.013+0000 7f5c75e00640 1 -- 172.21.15.112:0/3148850403 shutdown_connections 2024-09-12T02:47:22.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.013+0000 7f5c75e00640 1 --2- 172.21.15.112:0/3148850403 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c701616d0 0x7f5c7015e660 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:22.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.013+0000 7f5c75e00640 1 --2- 172.21.15.112:0/3148850403 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5c4c06be60 0x7f5c4c06e320 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:22.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.013+0000 7f5c75e00640 1 --2- 172.21.15.112:0/3148850403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c701623c0 0x7f5c70158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:22.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.013+0000 7f5c75e00640 1 --2- 172.21.15.112:0/3148850403 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c700d0370 0x7f5c701f8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:22.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.013+0000 7f5c75e00640 1 -- 172.21.15.112:0/3148850403 >> 172.21.15.112:0/3148850403 conn(0x7f5c700d4cc0 msgr2=0x7f5c700d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:22.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.013+0000 7f5c75e00640 1 -- 172.21.15.112:0/3148850403 shutdown_connections 2024-09-12T02:47:22.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.013+0000 7f5c75e00640 1 -- 172.21.15.112:0/3148850403 wait complete. 2024-09-12T02:47:22.030 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:47:22.030 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:47:22.135 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:47:22.224 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:47:22.224 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:47:22.224 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:47:22.259 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:47:22.260 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:47:22.260 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:47:22.296 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:47:22.296 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:47:22.296 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:47:22.334 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:47:22.335 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:47:22.335 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:47:22.373 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:47:22.373 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T02:47:22.373 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:47:22.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.527+0000 7f2e97200640 1 Processor -- start 2024-09-12T02:47:22.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.527+0000 7f2e97200640 1 -- start start 2024-09-12T02:47:22.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.528+0000 7f2e97200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2e9006e3b0 0x7f2e900afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:22.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.529+0000 7f2e97200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e900aedd0 con 0x7f2e9006d8c0 2024-09-12T02:47:22.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.529+0000 7f2e97200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e900af0b0 con 0x7f2e900ae8d0 2024-09-12T02:47:22.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.529+0000 7f2e97200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2e900af390 con 0x7f2e9006e3b0 2024-09-12T02:47:22.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.529+0000 7f2e8fe00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2e9006d8c0 0x7f2e900715a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:37440/0 (socket says 172.21.15.112:37440) 2024-09-12T02:47:22.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.529+0000 7f2e8fe00640 1 -- 172.21.15.112:0/2198766107 learned_addr learned my addr 172.21.15.112:0/2198766107 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:22.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.529+0000 7f2e95200640 1 --2- 172.21.15.112:0/2198766107 >> v2:172.21.15.112:3300/0 conn(0x7f2e9006e3b0 0x7f2e900afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:22.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.529+0000 7f2e8f400640 1 -- 172.21.15.112:0/2198766107 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1593362950 0 0) 0x7f2e900aedd0 con 0x7f2e9006d8c0 2024-09-12T02:47:22.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.529+0000 7f2e8f400640 1 -- 172.21.15.112:0/2198766107 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e74003520 con 0x7f2e9006d8c0 2024-09-12T02:47:22.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.529+0000 7f2e95200640 1 -- 172.21.15.112:0/2198766107 >> v1:172.21.15.137:6789/0 conn(0x7f2e900ae8d0 legacy=0x7f2e9006dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:22.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.529+0000 7f2e95200640 1 -- 172.21.15.112:0/2198766107 >> v1:172.21.15.112:6789/0 conn(0x7f2e9006d8c0 legacy=0x7f2e900715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:22.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.529+0000 7f2e95200640 1 -- 172.21.15.112:0/2198766107 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e900af670 con 0x7f2e9006e3b0 2024-09-12T02:47:22.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.530+0000 7f2e95200640 1 --2- 172.21.15.112:0/2198766107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e9006e3b0 0x7f2e900afe70 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009d90 tx=0x7f2e8802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cda977f52b626f44 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:22.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.531+0000 7f2e8f400640 1 -- 172.21.15.112:0/2198766107 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e88007740 con 0x7f2e9006e3b0 2024-09-12T02:47:22.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.531+0000 7f2e8f400640 1 -- 172.21.15.112:0/2198766107 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e880078e0 con 0x7f2e9006e3b0 2024-09-12T02:47:22.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.531+0000 7f2e8f400640 1 -- 172.21.15.112:0/2198766107 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e88007cb0 con 0x7f2e9006e3b0 2024-09-12T02:47:22.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.531+0000 7f2e97200640 1 -- 172.21.15.112:0/2198766107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e9006e3b0 msgr2=0x7f2e900afe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:22.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.531+0000 7f2e97200640 1 --2- 172.21.15.112:0/2198766107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e9006e3b0 0x7f2e900afe70 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009d90 tx=0x7f2e8802a6f0 comp rx=0 tx=0).stop 2024-09-12T02:47:22.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.531+0000 7f2e97200640 1 -- 172.21.15.112:0/2198766107 shutdown_connections 2024-09-12T02:47:22.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.531+0000 7f2e97200640 1 --2- 172.21.15.112:0/2198766107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e9006e3b0 0x7f2e900afe70 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:22.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.531+0000 7f2e97200640 1 -- 172.21.15.112:0/2198766107 >> 172.21.15.112:0/2198766107 conn(0x7f2e9006bbd0 msgr2=0x7f2e9006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:22.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.531+0000 7f2e97200640 1 -- 172.21.15.112:0/2198766107 shutdown_connections 2024-09-12T02:47:22.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.531+0000 7f2e97200640 1 -- 172.21.15.112:0/2198766107 wait complete. 2024-09-12T02:47:22.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.533+0000 7f2e97200640 1 Processor -- start 2024-09-12T02:47:22.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.533+0000 7f2e97200640 1 -- start start 2024-09-12T02:47:22.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.534+0000 7f2e97200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e9006d8c0 0x7f2e901504d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:22.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.534+0000 7f2e97200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e9006e3b0 0x7f2e9015b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:22.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.534+0000 7f2e97200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e900ae8d0 0x7f2e9015d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:22.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.534+0000 7f2e97200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2e900b3a60 con 0x7f2e9006d8c0 2024-09-12T02:47:22.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.534+0000 7f2e97200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2e900b38e0 con 0x7f2e9006e3b0 2024-09-12T02:47:22.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.534+0000 7f2e97200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2e900b3be0 con 0x7f2e900ae8d0 2024-09-12T02:47:22.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.534+0000 7f2e8fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e9006d8c0 0x7f2e901504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:22.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.534+0000 7f2e8fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e9006d8c0 0x7f2e901504d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37394/0 (socket says 172.21.15.112:37394) 2024-09-12T02:47:22.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.534+0000 7f2e8fe00640 1 -- 172.21.15.112:0/381440282 learned_addr learned my addr 172.21.15.112:0/381440282 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:22.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.534+0000 7f2e87400640 1 --2- 172.21.15.112:0/381440282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e9006e3b0 0x7f2e9015b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:22.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.534+0000 7f2e95200640 1 --2- 172.21.15.112:0/381440282 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e900ae8d0 0x7f2e9015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:22.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.534+0000 7f2e8fe00640 1 -- 172.21.15.112:0/381440282 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e900ae8d0 msgr2=0x7f2e9015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:22.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.534+0000 7f2e8fe00640 1 --2- 172.21.15.112:0/381440282 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e900ae8d0 0x7f2e9015d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:22.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.534+0000 7f2e8fe00640 1 -- 172.21.15.112:0/381440282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e9006e3b0 msgr2=0x7f2e9015b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:22.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.534+0000 7f2e8fe00640 1 --2- 172.21.15.112:0/381440282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e9006e3b0 0x7f2e9015b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:22.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.534+0000 7f2e8fe00640 1 -- 172.21.15.112:0/381440282 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e901594f0 con 0x7f2e9006d8c0 2024-09-12T02:47:22.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.535+0000 7f2e8fe00640 1 --2- 172.21.15.112:0/381440282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e9006d8c0 0x7f2e901504d0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f2e8000c530 tx=0x7f2e8000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:22.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.535+0000 7f2e8cc00640 1 -- 172.21.15.112:0/381440282 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e80017070 con 0x7f2e9006d8c0 2024-09-12T02:47:22.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.535+0000 7f2e8cc00640 1 -- 172.21.15.112:0/381440282 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e80005ce0 con 0x7f2e9006d8c0 2024-09-12T02:47:22.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.535+0000 7f2e97200640 1 -- 172.21.15.112:0/381440282 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e901597d0 con 0x7f2e9006d8c0 2024-09-12T02:47:22.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.535+0000 7f2e8cc00640 1 -- 172.21.15.112:0/381440282 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e800072b0 con 0x7f2e9006d8c0 2024-09-12T02:47:22.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.535+0000 7f2e97200640 1 -- 172.21.15.112:0/381440282 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e90159d90 con 0x7f2e9006d8c0 2024-09-12T02:47:22.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.536+0000 7f2e97200640 1 -- 172.21.15.112:0/381440282 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e90068a30 con 0x7f2e9006d8c0 2024-09-12T02:47:22.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.537+0000 7f2e8cc00640 1 -- 172.21.15.112:0/381440282 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e8001a070 con 0x7f2e9006d8c0 2024-09-12T02:47:22.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.538+0000 7f2e8cc00640 1 --2- 172.21.15.112:0/381440282 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2e6c06be60 0x7f2e6c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:22.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.538+0000 7f2e8cc00640 1 -- 172.21.15.112:0/381440282 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 4943+0+0 (secure 0 0 0) 0x7f2e80089e80 con 0x7f2e9006d8c0 2024-09-12T02:47:22.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.538+0000 7f2e87400640 1 --2- 172.21.15.112:0/381440282 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2e6c06be60 0x7f2e6c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:22.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.539+0000 7f2e87400640 1 --2- 172.21.15.112:0/381440282 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2e6c06be60 0x7f2e6c06e320 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2e900b2120 tx=0x7f2e78009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:22.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.542+0000 7f2e8cc00640 1 -- 172.21.15.112:0/381440282 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e80058590 con 0x7f2e9006d8c0 2024-09-12T02:47:22.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.751+0000 7f2e97200640 1 -- 172.21.15.112:0/381440282 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e9015c430 con 0x7f2e9006d8c0 2024-09-12T02:47:22.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.752+0000 7f2e8cc00640 1 -- 172.21.15.112:0/381440282 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+3917 (secure 0 0 0) 0x7f2e8005c890 con 0x7f2e9006d8c0 2024-09-12T02:47:22.753 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:22.753 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":55,"btime":"2024-09-12T02:47:16:614948+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1897464411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1897464411},{"type":"v1","addr":"172.21.15.137:6834","nonce":1897464411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":5785,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3500913266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":3500913266},{"type":"v1","addr":"172.21.15.137:6835","nonce":3500913266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":6144,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/611029461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":611029461},{"type":"v1","addr":"172.21.15.112:6836","nonce":611029461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6414,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/329988828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":329988828},{"type":"v1","addr":"172.21.15.112:6837","nonce":329988828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[]} 2024-09-12T02:47:22.754 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 55 2024-09-12T02:47:22.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.754+0000 7f2e97200640 1 -- 172.21.15.112:0/381440282 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2e6c06be60 msgr2=0x7f2e6c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:22.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.754+0000 7f2e97200640 1 --2- 172.21.15.112:0/381440282 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2e6c06be60 0x7f2e6c06e320 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2e900b2120 tx=0x7f2e78009040 comp rx=0 tx=0).stop 2024-09-12T02:47:22.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.754+0000 7f2e97200640 1 -- 172.21.15.112:0/381440282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e9006d8c0 msgr2=0x7f2e901504d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:22.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.754+0000 7f2e97200640 1 --2- 172.21.15.112:0/381440282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e9006d8c0 0x7f2e901504d0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f2e8000c530 tx=0x7f2e8000c9f0 comp rx=0 tx=0).stop 2024-09-12T02:47:22.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.754+0000 7f2e97200640 1 -- 172.21.15.112:0/381440282 shutdown_connections 2024-09-12T02:47:22.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.754+0000 7f2e97200640 1 --2- 172.21.15.112:0/381440282 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e900ae8d0 0x7f2e9015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:22.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.754+0000 7f2e97200640 1 --2- 172.21.15.112:0/381440282 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2e6c06be60 0x7f2e6c06e320 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:22.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.754+0000 7f2e97200640 1 --2- 172.21.15.112:0/381440282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e9006e3b0 0x7f2e9015b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:22.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.754+0000 7f2e97200640 1 --2- 172.21.15.112:0/381440282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e9006d8c0 0x7f2e901504d0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:22.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.754+0000 7f2e97200640 1 -- 172.21.15.112:0/381440282 >> 172.21.15.112:0/381440282 conn(0x7f2e9006bbd0 msgr2=0x7f2e9006dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:22.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.754+0000 7f2e97200640 1 -- 172.21.15.112:0/381440282 shutdown_connections 2024-09-12T02:47:22.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.754+0000 7f2e97200640 1 -- 172.21.15.112:0/381440282 wait complete. 2024-09-12T02:47:22.771 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T02:47:22.771 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T02:47:22.771 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T02:47:22.771 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:47:22.772 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T02:47:22.772 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T02:47:22.772 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T02:47:22.772 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:47:22.772 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T02:47:22.772 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T02:47:22.772 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T02:47:22.772 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:47:22.773 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T02:47:22.773 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T02:47:22.773 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T02:47:22.773 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:47:22.785 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T02:47:22.785 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T02:47:22.786 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T02:47:22.786 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T02:47:22.789 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T02:47:22.789 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T02:47:22.790 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T02:47:22.790 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T02:47:22.836 INFO:tasks.ceph.mds.a:Started 2024-09-12T02:47:22.836 INFO:tasks.ceph.mds.b:Started 2024-09-12T02:47:22.836 DEBUG:teuthology.parallel:result is None 2024-09-12T02:47:22.837 DEBUG:teuthology.parallel:result is None 2024-09-12T02:47:22.838 INFO:tasks.ceph.mds.d:Started 2024-09-12T02:47:22.838 DEBUG:teuthology.parallel:result is None 2024-09-12T02:47:22.838 INFO:tasks.ceph.mds.c:Started 2024-09-12T02:47:22.838 DEBUG:teuthology.parallel:result is None 2024-09-12T02:47:22.839 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T02:47:22.964 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-12T02:47:22.965 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2024-09-12T02:47:22.965 INFO:tasks.ceph.mds.d.smithi137.stdout:starting mds.d at 2024-09-12T02:47:22.965 INFO:tasks.ceph.mds.b.smithi137.stdout:starting mds.b at 2024-09-12T02:47:23.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.999+0000 7fa81fe00640 1 Processor -- start 2024-09-12T02:47:23.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:22.999+0000 7fa81fe00640 1 -- start start 2024-09-12T02:47:23.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.000+0000 7fa81fe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa81815b9d0 0x7fa8180b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:23.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.000+0000 7fa81fe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa8180b45d0 0x7fa8180728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:23.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.000+0000 7fa81fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa81806eef0 0x7fa81806f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:23.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.000+0000 7fa81fe00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa8180b4a60 con 0x7fa81815b9d0 2024-09-12T02:47:23.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.001+0000 7fa81fe00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa81806f860 con 0x7fa8180b45d0 2024-09-12T02:47:23.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.001+0000 7fa81fe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa8180b54a0 con 0x7fa81806eef0 2024-09-12T02:47:23.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.001+0000 7fa81d400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa81815b9d0 0x7fa8180b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:23.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.001+0000 7fa81d400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa81815b9d0 0x7fa8180b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37418/0 (socket says 172.21.15.112:37418) 2024-09-12T02:47:23.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.001+0000 7fa81d400640 1 -- 172.21.15.112:0/1067049491 learned_addr learned my addr 172.21.15.112:0/1067049491 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:23.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.001+0000 7fa81de00640 1 --2- 172.21.15.112:0/1067049491 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa81806eef0 0x7fa81806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:23.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.001+0000 7fa81ca00640 1 --2- 172.21.15.112:0/1067049491 >> v2:172.21.15.137:3300/0 conn(0x7fa8180b45d0 0x7fa8180728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:23.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.001+0000 7fa81d400640 1 -- 172.21.15.112:0/1067049491 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa81806eef0 msgr2=0x7fa81806f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:23.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.001+0000 7fa81d400640 1 --2- 172.21.15.112:0/1067049491 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa81806eef0 0x7fa81806f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:23.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.001+0000 7fa81d400640 1 -- 172.21.15.112:0/1067049491 >> v2:172.21.15.137:3300/0 conn(0x7fa8180b45d0 msgr2=0x7fa8180728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:23.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.001+0000 7fa81d400640 1 --2- 172.21.15.112:0/1067049491 >> v2:172.21.15.137:3300/0 conn(0x7fa8180b45d0 0x7fa8180728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:23.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.001+0000 7fa81d400640 1 -- 172.21.15.112:0/1067049491 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8180b3af0 con 0x7fa81815b9d0 2024-09-12T02:47:23.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.002+0000 7fa81d400640 1 --2- 172.21.15.112:0/1067049491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa81815b9d0 0x7fa8180b4ec0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fa818068670 tx=0x7fa80c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ec94811a63a9ba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:23.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.002+0000 7fa817e00640 1 -- 172.21.15.112:0/1067049491 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c037070 con 0x7fa81815b9d0 2024-09-12T02:47:23.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.002+0000 7fa817e00640 1 -- 172.21.15.112:0/1067049491 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa80c032440 con 0x7fa81815b9d0 2024-09-12T02:47:23.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.002+0000 7fa817e00640 1 -- 172.21.15.112:0/1067049491 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c032810 con 0x7fa81815b9d0 2024-09-12T02:47:23.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.003+0000 7fa81fe00640 1 -- 172.21.15.112:0/1067049491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa81815b9d0 msgr2=0x7fa8180b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:23.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.003+0000 7fa81fe00640 1 --2- 172.21.15.112:0/1067049491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa81815b9d0 0x7fa8180b4ec0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fa818068670 tx=0x7fa80c02a210 comp rx=0 tx=0).stop 2024-09-12T02:47:23.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.003+0000 7fa81fe00640 1 -- 172.21.15.112:0/1067049491 shutdown_connections 2024-09-12T02:47:23.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.003+0000 7fa81fe00640 1 --2- 172.21.15.112:0/1067049491 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa81806eef0 0x7fa81806f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:23.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.003+0000 7fa81fe00640 1 --2- 172.21.15.112:0/1067049491 >> v2:172.21.15.137:3300/0 conn(0x7fa8180b45d0 0x7fa8180728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:23.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.003+0000 7fa81fe00640 1 --2- 172.21.15.112:0/1067049491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa81815b9d0 0x7fa8180b4ec0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:23.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.003+0000 7fa81fe00640 1 -- 172.21.15.112:0/1067049491 >> 172.21.15.112:0/1067049491 conn(0x7fa81806bbd0 msgr2=0x7fa81806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:23.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.003+0000 7fa81fe00640 1 -- 172.21.15.112:0/1067049491 shutdown_connections 2024-09-12T02:47:23.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.003+0000 7fa81fe00640 1 -- 172.21.15.112:0/1067049491 wait complete. 2024-09-12T02:47:23.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.005+0000 7fa81fe00640 1 Processor -- start 2024-09-12T02:47:23.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.005+0000 7fa81fe00640 1 -- start start 2024-09-12T02:47:23.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.006+0000 7fa81fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa81806eef0 0x7fa8181583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:23.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.006+0000 7fa81fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8180b45d0 0x7fa818144410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:23.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.006+0000 7fa81fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa81815b9d0 0x7fa8181f0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:23.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.006+0000 7fa81fe00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa81815bdb0 con 0x7fa81806eef0 2024-09-12T02:47:23.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.006+0000 7fa81fe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa8180b40b0 con 0x7fa8180b45d0 2024-09-12T02:47:23.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.006+0000 7fa81fe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa81815bf30 con 0x7fa81815b9d0 2024-09-12T02:47:23.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.006+0000 7fa81d400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa81806eef0 0x7fa8181583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:23.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.006+0000 7fa81d400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa81806eef0 0x7fa8181583a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37434/0 (socket says 172.21.15.112:37434) 2024-09-12T02:47:23.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.006+0000 7fa81d400640 1 -- 172.21.15.112:0/4152998367 learned_addr learned my addr 172.21.15.112:0/4152998367 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:23.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.006+0000 7fa81de00640 1 --2- 172.21.15.112:0/4152998367 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa81815b9d0 0x7fa8181f0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:23.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.006+0000 7fa81ca00640 1 --2- 172.21.15.112:0/4152998367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8180b45d0 0x7fa818144410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:23.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.006+0000 7fa81d400640 1 -- 172.21.15.112:0/4152998367 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa81815b9d0 msgr2=0x7fa8181f0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:23.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.006+0000 7fa81d400640 1 --2- 172.21.15.112:0/4152998367 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa81815b9d0 0x7fa8181f0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:23.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.006+0000 7fa81d400640 1 -- 172.21.15.112:0/4152998367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8180b45d0 msgr2=0x7fa818144410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:23.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.006+0000 7fa81d400640 1 --2- 172.21.15.112:0/4152998367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8180b45d0 0x7fa818144410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:23.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.006+0000 7fa81d400640 1 -- 172.21.15.112:0/4152998367 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa81815d530 con 0x7fa81806eef0 2024-09-12T02:47:23.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.007+0000 7fa81d400640 1 --2- 172.21.15.112:0/4152998367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa81806eef0 0x7fa8181583a0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fa80c02a250 tx=0x7fa80c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:23.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.007+0000 7fa815600640 1 -- 172.21.15.112:0/4152998367 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c03aa90 con 0x7fa81806eef0 2024-09-12T02:47:23.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.007+0000 7fa815600640 1 -- 172.21.15.112:0/4152998367 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa80c03ac30 con 0x7fa81806eef0 2024-09-12T02:47:23.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.007+0000 7fa815600640 1 -- 172.21.15.112:0/4152998367 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c045450 con 0x7fa81806eef0 2024-09-12T02:47:23.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.007+0000 7fa81fe00640 1 -- 172.21.15.112:0/4152998367 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa81815d810 con 0x7fa81806eef0 2024-09-12T02:47:23.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.007+0000 7fa81fe00640 1 -- 172.21.15.112:0/4152998367 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa81815ddd0 con 0x7fa81806eef0 2024-09-12T02:47:23.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.008+0000 7fa81fe00640 1 -- 172.21.15.112:0/4152998367 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa818068a30 con 0x7fa81806eef0 2024-09-12T02:47:23.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.009+0000 7fa815600640 1 -- 172.21.15.112:0/4152998367 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa80c0455f0 con 0x7fa81806eef0 2024-09-12T02:47:23.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.010+0000 7fa815600640 1 --2- 172.21.15.112:0/4152998367 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa7f806be30 0x7fa7f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:23.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.010+0000 7fa815600640 1 -- 172.21.15.112:0/4152998367 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 4943+0+0 (secure 0 0 0) 0x7fa80c0af1d0 con 0x7fa81806eef0 2024-09-12T02:47:23.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.010+0000 7fa81ca00640 1 --2- 172.21.15.112:0/4152998367 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa7f806be30 0x7fa7f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:23.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.011+0000 7fa81ca00640 1 --2- 172.21.15.112:0/4152998367 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa7f806be30 0x7fa7f806e2f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa81814f9f0 tx=0x7fa804008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:23.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.014+0000 7fa815600640 1 -- 172.21.15.112:0/4152998367 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa80c07d700 con 0x7fa81806eef0 2024-09-12T02:47:23.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.198+0000 7fa81fe00640 1 -- 172.21.15.112:0/4152998367 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fa81806f320 con 0x7fa81806eef0 2024-09-12T02:47:23.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.647+0000 7fa815600640 1 -- 172.21.15.112:0/4152998367 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v114) ==== 97+0+0 (secure 0 0 0) 0x7fa80c081a00 con 0x7fa81806eef0 2024-09-12T02:47:23.648 INFO:teuthology.orchestra.run.smithi112.stderr: removed all blocklist entries 2024-09-12T02:47:23.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.650+0000 7fa81fe00640 1 -- 172.21.15.112:0/4152998367 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa7f806be30 msgr2=0x7fa7f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:23.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.650+0000 7fa81fe00640 1 --2- 172.21.15.112:0/4152998367 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa7f806be30 0x7fa7f806e2f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa81814f9f0 tx=0x7fa804008040 comp rx=0 tx=0).stop 2024-09-12T02:47:23.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.650+0000 7fa81fe00640 1 -- 172.21.15.112:0/4152998367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa81806eef0 msgr2=0x7fa8181583a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:23.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.650+0000 7fa81fe00640 1 --2- 172.21.15.112:0/4152998367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa81806eef0 0x7fa8181583a0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fa80c02a250 tx=0x7fa80c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:47:23.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.650+0000 7fa81fe00640 1 -- 172.21.15.112:0/4152998367 shutdown_connections 2024-09-12T02:47:23.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.650+0000 7fa81fe00640 1 --2- 172.21.15.112:0/4152998367 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa81815b9d0 0x7fa8181f0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:23.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.650+0000 7fa81fe00640 1 --2- 172.21.15.112:0/4152998367 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa7f806be30 0x7fa7f806e2f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:23.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.650+0000 7fa81fe00640 1 --2- 172.21.15.112:0/4152998367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8180b45d0 0x7fa818144410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:23.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.650+0000 7fa81fe00640 1 --2- 172.21.15.112:0/4152998367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa81806eef0 0x7fa8181583a0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:23.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.650+0000 7fa81fe00640 1 -- 172.21.15.112:0/4152998367 >> 172.21.15.112:0/4152998367 conn(0x7fa81806bbd0 msgr2=0x7fa81815abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:23.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.650+0000 7fa81fe00640 1 -- 172.21.15.112:0/4152998367 shutdown_connections 2024-09-12T02:47:23.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.650+0000 7fa81fe00640 1 -- 172.21.15.112:0/4152998367 wait complete. 2024-09-12T02:47:23.669 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T02:47:23.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.820+0000 7f9f26200640 1 Processor -- start 2024-09-12T02:47:23.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.820+0000 7f9f26200640 1 -- start start 2024-09-12T02:47:23.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.822+0000 7f9f26200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f200b4ec0 0x7f9f200b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:23.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.822+0000 7f9f26200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f200b54a0 con 0x7f9f2006f600 2024-09-12T02:47:23.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.822+0000 7f9f26200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f200b3af0 con 0x7f9f2015b9d0 2024-09-12T02:47:23.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.822+0000 7f9f26200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9f200b3dd0 con 0x7f9f200b4ec0 2024-09-12T02:47:23.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.822+0000 7f9f16a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f9f2006f600 0x7f9f200cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:37448/0 (socket says 172.21.15.112:37448) 2024-09-12T02:47:23.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.822+0000 7f9f16a00640 1 -- 172.21.15.112:0/3916841177 learned_addr learned my addr 172.21.15.112:0/3916841177 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:23.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.822+0000 7f9f1fe00640 1 --2- 172.21.15.112:0/3916841177 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f200b4ec0 0x7f9f200b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:23.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.822+0000 7f9f1ea00640 1 -- 172.21.15.112:0/3916841177 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2306790509 0 0) 0x7f9f200b54a0 con 0x7f9f2006f600 2024-09-12T02:47:23.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.822+0000 7f9f1ea00640 1 -- 172.21.15.112:0/3916841177 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f04003520 con 0x7f9f2006f600 2024-09-12T02:47:23.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.822+0000 7f9f1ea00640 1 -- 172.21.15.112:0/3916841177 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3650484523 0 0) 0x7f9f200b3af0 con 0x7f9f2015b9d0 2024-09-12T02:47:23.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.823+0000 7f9f1ea00640 1 -- 172.21.15.112:0/3916841177 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f200b54a0 con 0x7f9f2015b9d0 2024-09-12T02:47:23.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.823+0000 7f9f1fe00640 1 -- 172.21.15.112:0/3916841177 >> v1:172.21.15.137:6789/0 conn(0x7f9f2015b9d0 legacy=0x7f9f2006eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:23.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.823+0000 7f9f1fe00640 1 -- 172.21.15.112:0/3916841177 >> v1:172.21.15.112:6789/0 conn(0x7f9f2006f600 legacy=0x7f9f200cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:23.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.823+0000 7f9f1fe00640 1 -- 172.21.15.112:0/3916841177 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f200b40b0 con 0x7f9f200b4ec0 2024-09-12T02:47:23.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.824+0000 7f9f1fe00640 1 --2- 172.21.15.112:0/3916841177 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f200b4ec0 0x7f9f200b45d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9f18009dc0 tx=0x7f9f1802a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e54b3651c492c9b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:23.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.824+0000 7f9f1ea00640 1 -- 172.21.15.112:0/3916841177 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f18007740 con 0x7f9f200b4ec0 2024-09-12T02:47:23.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.824+0000 7f9f1ea00640 1 -- 172.21.15.112:0/3916841177 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f180078e0 con 0x7f9f200b4ec0 2024-09-12T02:47:23.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.824+0000 7f9f1ea00640 1 -- 172.21.15.112:0/3916841177 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f18007cb0 con 0x7f9f200b4ec0 2024-09-12T02:47:23.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.824+0000 7f9f26200640 1 -- 172.21.15.112:0/3916841177 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f200b4ec0 msgr2=0x7f9f200b45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:23.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.824+0000 7f9f26200640 1 --2- 172.21.15.112:0/3916841177 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f200b4ec0 0x7f9f200b45d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9f18009dc0 tx=0x7f9f1802a6d0 comp rx=0 tx=0).stop 2024-09-12T02:47:23.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.825+0000 7f9f26200640 1 -- 172.21.15.112:0/3916841177 shutdown_connections 2024-09-12T02:47:23.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.825+0000 7f9f26200640 1 --2- 172.21.15.112:0/3916841177 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f200b4ec0 0x7f9f200b45d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:23.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.825+0000 7f9f26200640 1 -- 172.21.15.112:0/3916841177 >> 172.21.15.112:0/3916841177 conn(0x7f9f2006bbd0 msgr2=0x7f9f2006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:23.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.825+0000 7f9f26200640 1 -- 172.21.15.112:0/3916841177 shutdown_connections 2024-09-12T02:47:23.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.825+0000 7f9f26200640 1 -- 172.21.15.112:0/3916841177 wait complete. 2024-09-12T02:47:23.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.826+0000 7f9f26200640 1 Processor -- start 2024-09-12T02:47:23.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.826+0000 7f9f26200640 1 -- start start 2024-09-12T02:47:23.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.827+0000 7f9f26200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f2006f600 0x7f9f201f9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:23.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.827+0000 7f9f26200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f200b4ec0 0x7f9f20159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:23.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.827+0000 7f9f26200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f2015b9d0 0x7f9f201411e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:23.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.827+0000 7f9f26200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9f20072a40 con 0x7f9f2015b9d0 2024-09-12T02:47:23.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.827+0000 7f9f26200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9f200728c0 con 0x7f9f200b4ec0 2024-09-12T02:47:23.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.827+0000 7f9f26200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9f20072bc0 con 0x7f9f2006f600 2024-09-12T02:47:23.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.827+0000 7f9f1fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f2015b9d0 0x7f9f201411e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:23.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.827+0000 7f9f1fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f2015b9d0 0x7f9f201411e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37436/0 (socket says 172.21.15.112:37436) 2024-09-12T02:47:23.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.827+0000 7f9f1fe00640 1 -- 172.21.15.112:0/2624653711 learned_addr learned my addr 172.21.15.112:0/2624653711 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:23.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.828+0000 7f9f1f400640 1 --2- 172.21.15.112:0/2624653711 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f2006f600 0x7f9f201f9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:23.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.828+0000 7f9f16a00640 1 --2- 172.21.15.112:0/2624653711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f200b4ec0 0x7f9f20159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:23.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.828+0000 7f9f1fe00640 1 -- 172.21.15.112:0/2624653711 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f2006f600 msgr2=0x7f9f201f9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:23.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.828+0000 7f9f1fe00640 1 --2- 172.21.15.112:0/2624653711 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f2006f600 0x7f9f201f9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:23.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.828+0000 7f9f1fe00640 1 -- 172.21.15.112:0/2624653711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f200b4ec0 msgr2=0x7f9f20159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:23.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.828+0000 7f9f1fe00640 1 --2- 172.21.15.112:0/2624653711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f200b4ec0 0x7f9f20159c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:23.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.828+0000 7f9f1fe00640 1 -- 172.21.15.112:0/2624653711 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2015a650 con 0x7f9f2015b9d0 2024-09-12T02:47:23.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.828+0000 7f9f1fe00640 1 --2- 172.21.15.112:0/2624653711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f2015b9d0 0x7f9f201411e0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f9f18009ee0 tx=0x7f9f18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:23.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.828+0000 7f9f17e00640 1 -- 172.21.15.112:0/2624653711 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f18040070 con 0x7f9f2015b9d0 2024-09-12T02:47:23.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.828+0000 7f9f17e00640 1 -- 172.21.15.112:0/2624653711 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f18031bc0 con 0x7f9f2015b9d0 2024-09-12T02:47:23.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.828+0000 7f9f26200640 1 -- 172.21.15.112:0/2624653711 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f2015a930 con 0x7f9f2015b9d0 2024-09-12T02:47:23.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.828+0000 7f9f17e00640 1 -- 172.21.15.112:0/2624653711 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f18009450 con 0x7f9f2015b9d0 2024-09-12T02:47:23.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.829+0000 7f9f26200640 1 -- 172.21.15.112:0/2624653711 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f2015aef0 con 0x7f9f2015b9d0 2024-09-12T02:47:23.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.830+0000 7f9f26200640 1 -- 172.21.15.112:0/2624653711 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f20068a30 con 0x7f9f2015b9d0 2024-09-12T02:47:23.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.830+0000 7f9f17e00640 1 -- 172.21.15.112:0/2624653711 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9f18039040 con 0x7f9f2015b9d0 2024-09-12T02:47:23.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.831+0000 7f9f17e00640 1 --2- 172.21.15.112:0/2624653711 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9efc06be60 0x7f9efc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:23.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.831+0000 7f9f17e00640 1 -- 172.21.15.112:0/2624653711 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 4857+0+0 (secure 0 0 0) 0x7f9f180ac330 con 0x7f9f2015b9d0 2024-09-12T02:47:23.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.831+0000 7f9f1f400640 1 --2- 172.21.15.112:0/2624653711 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9efc06be60 0x7f9efc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:23.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.832+0000 7f9f1f400640 1 --2- 172.21.15.112:0/2624653711 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9efc06be60 0x7f9efc06e320 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9f201560b0 tx=0x7f9f10009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:23.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:23.835+0000 7f9f17e00640 1 -- 172.21.15.112:0/2624653711 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9f1807af90 con 0x7f9f2015b9d0 2024-09-12T02:47:24.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.070+0000 7f9f26200640 1 -- 172.21.15.112:0/2624653711 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f9f200cd5f0 con 0x7f9f2015b9d0 2024-09-12T02:47:24.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.071+0000 7f9f17e00640 1 -- 172.21.15.112:0/2624653711 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) ==== 80+0+5304 (secure 0 0 0) 0x7f9f1807a890 con 0x7f9f2015b9d0 2024-09-12T02:47:24.072 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:24.072 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:47:24.072 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_dump": [ 2024-09-12T02:47:24.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:24.072 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.a", 2024-09-12T02:47:24.072 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmKE09KRAAtNq70LeeB9ENNxX91m10Fg==", 2024-09-12T02:47:24.072 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:24.072 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:47:24.072 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:47:24.072 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:47:24.072 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:47:24.073 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:24.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:24.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:24.073 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.b", 2024-09-12T02:47:24.073 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmMjYTARAAuIrofOOp9Dbrhkt314mhuw==", 2024-09-12T02:47:24.073 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:24.073 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:47:24.073 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:47:24.073 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:47:24.073 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:47:24.073 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:24.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:24.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:24.073 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.c", 2024-09-12T02:47:24.074 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmLQXzMhAAhk28JuqKhfbZtvRu9SSVrw==", 2024-09-12T02:47:24.074 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:24.074 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:47:24.074 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:47:24.074 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:47:24.074 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:47:24.074 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:24.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:24.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:24.074 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.d", 2024-09-12T02:47:24.074 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmaE7JChAAKlyynYJnHLs87BXyMC0xgA==", 2024-09-12T02:47:24.074 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:24.074 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:47:24.074 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:47:24.074 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:47:24.074 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:47:24.075 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:24.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:24.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:24.075 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.0", 2024-09-12T02:47:24.075 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDXVOJmFXfdIRAA+VpZNU0tEN6vAzR2C7nuLg==", 2024-09-12T02:47:24.076 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:24.076 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:47:24.076 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:47:24.076 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:47:24.076 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:24.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:24.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:24.076 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.1", 2024-09-12T02:47:24.076 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDXVOJmcgHyLBAA/OxfdQ1D+uFzbCnm1dJLxw==", 2024-09-12T02:47:24.076 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:24.076 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:47:24.076 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:47:24.076 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:47:24.077 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:24.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:24.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:24.077 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.2", 2024-09-12T02:47:24.077 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDXVOJm0baUNhAAuInNwHut2Xn0kBmjnJhdqw==", 2024-09-12T02:47:24.077 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:24.078 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:47:24.078 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:47:24.078 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:47:24.078 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:24.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:24.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:24.078 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.3", 2024-09-12T02:47:24.078 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDYVOJmL/O3BBAAZhQ4/70wj/2zEbMcfD4hQA==", 2024-09-12T02:47:24.078 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:24.078 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:47:24.078 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:47:24.078 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:47:24.078 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:24.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:24.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:24.079 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.4", 2024-09-12T02:47:24.079 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmC+sJAxAAUQofpG3g8DlGLQ8wUqtuSg==", 2024-09-12T02:47:24.079 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:24.079 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:47:24.079 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:47:24.079 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:47:24.079 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:24.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:24.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:24.080 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.5", 2024-09-12T02:47:24.080 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmY2OSDhAA2rg1HGjWx7G6IzFi6yQ/jQ==", 2024-09-12T02:47:24.080 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:24.080 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:47:24.080 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:47:24.080 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:47:24.080 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:24.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:24.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:24.081 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.6", 2024-09-12T02:47:24.081 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmydoaGRAAh/ozKewnY+RxiZ4EcOFA7A==", 2024-09-12T02:47:24.081 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:24.081 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:47:24.081 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:47:24.082 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:47:24.082 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:24.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:24.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:24.082 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.7", 2024-09-12T02:47:24.082 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmmB7cIhAAVhtz7OuxYBQgEKGvHdY33g==", 2024-09-12T02:47:24.082 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:24.082 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:47:24.082 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:47:24.082 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:47:24.082 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:24.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:24.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:24.083 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.0", 2024-09-12T02:47:24.083 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmaG86ExAAD0SOlJOsLpoQZlgPJIPaxA==", 2024-09-12T02:47:24.083 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:24.083 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:47:24.084 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow r", 2024-09-12T02:47:24.084 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T02:47:24.084 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:24.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:24.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:24.085 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.1", 2024-09-12T02:47:24.085 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmt7AeIBAAGRSEejG29OpANZqtia7KEw==", 2024-09-12T02:47:24.085 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:24.085 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:47:24.085 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:47:24.085 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:47:24.085 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:47:24.085 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:24.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:24.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:24.086 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.2", 2024-09-12T02:47:24.086 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmcUWtGRAAlV/gS/CDZKHb5bjbmDzjlg==", 2024-09-12T02:47:24.086 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:24.087 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:47:24.087 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:47:24.087 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:47:24.087 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:47:24.087 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:24.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:24.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:24.087 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.3", 2024-09-12T02:47:24.087 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJm2M97JhAAHKJoPBf6TN6Nu8muK6wzaw==", 2024-09-12T02:47:24.088 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:24.088 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:47:24.088 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:47:24.088 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:47:24.088 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:47:24.088 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:24.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:24.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:24.088 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.admin", 2024-09-12T02:47:24.088 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDSVOJmhl82NBAAvkcxnsY5u9lYO12FaRbP1A==", 2024-09-12T02:47:24.088 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:24.088 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-12T02:47:24.088 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:47:24.088 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:47:24.089 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:47:24.089 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:24.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:24.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:24.089 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.x", 2024-09-12T02:47:24.089 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmftawIhAAAKmfx8khERROoZ8BCLukAw==", 2024-09-12T02:47:24.089 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:24.089 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-12T02:47:24.089 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-12T02:47:24.089 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:47:24.089 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:24.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:24.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:24.090 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.y", 2024-09-12T02:47:24.090 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmcxtNGhAAAXWh1fMrVeFSy2hh3p2Rkw==", 2024-09-12T02:47:24.090 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:24.090 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-12T02:47:24.090 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-12T02:47:24.090 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:47:24.090 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:24.090 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:24.090 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:24.090 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:47:24.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.073+0000 7f9f26200640 1 -- 172.21.15.112:0/2624653711 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9efc06be60 msgr2=0x7f9efc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:24.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.073+0000 7f9f26200640 1 --2- 172.21.15.112:0/2624653711 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9efc06be60 0x7f9efc06e320 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9f201560b0 tx=0x7f9f10009040 comp rx=0 tx=0).stop 2024-09-12T02:47:24.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.073+0000 7f9f26200640 1 -- 172.21.15.112:0/2624653711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f2015b9d0 msgr2=0x7f9f201411e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:24.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.073+0000 7f9f26200640 1 --2- 172.21.15.112:0/2624653711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f2015b9d0 0x7f9f201411e0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f9f18009ee0 tx=0x7f9f18004a40 comp rx=0 tx=0).stop 2024-09-12T02:47:24.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.073+0000 7f9f26200640 1 -- 172.21.15.112:0/2624653711 shutdown_connections 2024-09-12T02:47:24.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.073+0000 7f9f26200640 1 --2- 172.21.15.112:0/2624653711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f2015b9d0 0x7f9f201411e0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:24.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.073+0000 7f9f26200640 1 --2- 172.21.15.112:0/2624653711 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9efc06be60 0x7f9efc06e320 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:24.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.073+0000 7f9f26200640 1 --2- 172.21.15.112:0/2624653711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f200b4ec0 0x7f9f20159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:24.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.073+0000 7f9f26200640 1 --2- 172.21.15.112:0/2624653711 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f2006f600 0x7f9f201f9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:24.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.073+0000 7f9f26200640 1 -- 172.21.15.112:0/2624653711 >> 172.21.15.112:0/2624653711 conn(0x7f9f2006bbd0 msgr2=0x7f9f2015f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:24.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.073+0000 7f9f26200640 1 -- 172.21.15.112:0/2624653711 shutdown_connections 2024-09-12T02:47:24.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.073+0000 7f9f26200640 1 -- 172.21.15.112:0/2624653711 wait complete. 2024-09-12T02:47:24.094 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T02:47:24.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.248+0000 7f7efa800640 1 Processor -- start 2024-09-12T02:47:24.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.248+0000 7f7efa800640 1 -- start start 2024-09-12T02:47:24.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.249+0000 7f7efa800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7ef41624b0 0x7f7ef40d2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:24.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.249+0000 7f7efa800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ef40b3ad0 0x7f7ef40d31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:24.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.249+0000 7f7efa800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ef40d3910 con 0x7f7ef40b1a40 2024-09-12T02:47:24.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.249+0000 7f7efa800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7ef40d3ed0 con 0x7f7ef41624b0 2024-09-12T02:47:24.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.249+0000 7f7efa800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7ef40d3bf0 con 0x7f7ef40b3ad0 2024-09-12T02:47:24.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.249+0000 7f7ef9e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f7ef40b1a40 0x7f7ef40b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:37458/0 (socket says 172.21.15.112:37458) 2024-09-12T02:47:24.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.249+0000 7f7ef9e00640 1 -- 172.21.15.112:0/3741216528 learned_addr learned my addr 172.21.15.112:0/3741216528 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:24.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.249+0000 7f7ef9400640 1 --2- 172.21.15.112:0/3741216528 >> v2:172.21.15.137:3300/0 conn(0x7f7ef41624b0 0x7f7ef40d2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:24.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.249+0000 7f7ef8a00640 1 --2- 172.21.15.112:0/3741216528 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ef40b3ad0 0x7f7ef40d31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:24.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.250+0000 7f7ef3e00640 1 -- 172.21.15.112:0/3741216528 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 605362579 0 0) 0x7f7ef40d3910 con 0x7f7ef40b1a40 2024-09-12T02:47:24.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.250+0000 7f7ef3e00640 1 -- 172.21.15.112:0/3741216528 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7edc003520 con 0x7f7ef40b1a40 2024-09-12T02:47:24.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.250+0000 7f7ef9400640 1 -- 172.21.15.112:0/3741216528 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ef40b3ad0 msgr2=0x7f7ef40d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:24.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.250+0000 7f7ef9400640 1 --2- 172.21.15.112:0/3741216528 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ef40b3ad0 0x7f7ef40d31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:24.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.250+0000 7f7ef9400640 1 -- 172.21.15.112:0/3741216528 >> v1:172.21.15.112:6789/0 conn(0x7f7ef40b1a40 legacy=0x7f7ef40b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:24.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.250+0000 7f7ef9400640 1 -- 172.21.15.112:0/3741216528 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef40d1d50 con 0x7f7ef41624b0 2024-09-12T02:47:24.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.251+0000 7f7ef9400640 1 --2- 172.21.15.112:0/3741216528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ef41624b0 0x7f7ef40d2cb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7ee80097a0 tx=0x7f7ee802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80a5de5590ba54b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:24.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.251+0000 7f7ef3e00640 1 -- 172.21.15.112:0/3741216528 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8037070 con 0x7f7ef41624b0 2024-09-12T02:47:24.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.251+0000 7f7ef3e00640 1 -- 172.21.15.112:0/3741216528 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee8032440 con 0x7f7ef41624b0 2024-09-12T02:47:24.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.251+0000 7f7ef3e00640 1 -- 172.21.15.112:0/3741216528 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8032810 con 0x7f7ef41624b0 2024-09-12T02:47:24.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.252+0000 7f7efa800640 1 -- 172.21.15.112:0/3741216528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ef41624b0 msgr2=0x7f7ef40d2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:24.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.252+0000 7f7efa800640 1 --2- 172.21.15.112:0/3741216528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ef41624b0 0x7f7ef40d2cb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7ee80097a0 tx=0x7f7ee802a180 comp rx=0 tx=0).stop 2024-09-12T02:47:24.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.252+0000 7f7efa800640 1 -- 172.21.15.112:0/3741216528 shutdown_connections 2024-09-12T02:47:24.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.252+0000 7f7efa800640 1 --2- 172.21.15.112:0/3741216528 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ef40b3ad0 0x7f7ef40d31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:24.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.252+0000 7f7efa800640 1 --2- 172.21.15.112:0/3741216528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ef41624b0 0x7f7ef40d2cb0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:24.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.252+0000 7f7efa800640 1 -- 172.21.15.112:0/3741216528 >> 172.21.15.112:0/3741216528 conn(0x7f7ef40d4db0 msgr2=0x7f7ef40d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:24.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.252+0000 7f7efa800640 1 -- 172.21.15.112:0/3741216528 shutdown_connections 2024-09-12T02:47:24.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.252+0000 7f7efa800640 1 -- 172.21.15.112:0/3741216528 wait complete. 2024-09-12T02:47:24.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.253+0000 7f7efa800640 1 Processor -- start 2024-09-12T02:47:24.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.254+0000 7f7efa800640 1 -- start start 2024-09-12T02:47:24.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.254+0000 7f7efa800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ef40b1a40 0x7f7ef40cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:24.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.254+0000 7f7efa800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ef40b3ad0 0x7f7ef40b8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:24.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.254+0000 7f7efa800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ef41624b0 0x7f7ef40b9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:24.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.254+0000 7f7efa800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef40d2550 con 0x7f7ef40b3ad0 2024-09-12T02:47:24.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.254+0000 7f7efa800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef40b4120 con 0x7f7ef40b1a40 2024-09-12T02:47:24.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.254+0000 7f7efa800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7ef40b9830 con 0x7f7ef41624b0 2024-09-12T02:47:24.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.255+0000 7f7ef8a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ef40b3ad0 0x7f7ef40b8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:24.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.255+0000 7f7ef8a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ef40b3ad0 0x7f7ef40b8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37438/0 (socket says 172.21.15.112:37438) 2024-09-12T02:47:24.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.255+0000 7f7ef8a00640 1 -- 172.21.15.112:0/2042554157 learned_addr learned my addr 172.21.15.112:0/2042554157 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:24.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.255+0000 7f7ef9400640 1 --2- 172.21.15.112:0/2042554157 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ef40b1a40 0x7f7ef40cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:24.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.255+0000 7f7ef9e00640 1 --2- 172.21.15.112:0/2042554157 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ef41624b0 0x7f7ef40b9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:24.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.255+0000 7f7ef8a00640 1 -- 172.21.15.112:0/2042554157 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ef41624b0 msgr2=0x7f7ef40b9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:24.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.255+0000 7f7ef8a00640 1 --2- 172.21.15.112:0/2042554157 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ef41624b0 0x7f7ef40b9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:24.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.255+0000 7f7ef8a00640 1 -- 172.21.15.112:0/2042554157 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ef40b1a40 msgr2=0x7f7ef40cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:24.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.255+0000 7f7ef8a00640 1 --2- 172.21.15.112:0/2042554157 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ef40b1a40 0x7f7ef40cc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:24.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.255+0000 7f7ef8a00640 1 -- 172.21.15.112:0/2042554157 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef40b9b10 con 0x7f7ef40b3ad0 2024-09-12T02:47:24.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.255+0000 7f7ef9400640 1 --2- 172.21.15.112:0/2042554157 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ef40b1a40 0x7f7ef40cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:24.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.255+0000 7f7ef9e00640 1 --2- 172.21.15.112:0/2042554157 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ef41624b0 0x7f7ef40b9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:24.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.255+0000 7f7ef8a00640 1 --2- 172.21.15.112:0/2042554157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ef40b3ad0 0x7f7ef40b8c50 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000e9b0 tx=0x7f7ee000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:24.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.256+0000 7f7ef1600640 1 -- 172.21.15.112:0/2042554157 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0017070 con 0x7f7ef40b3ad0 2024-09-12T02:47:24.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.256+0000 7f7ef1600640 1 -- 172.21.15.112:0/2042554157 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee000c9a0 con 0x7f7ef40b3ad0 2024-09-12T02:47:24.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.256+0000 7f7ef1600640 1 -- 172.21.15.112:0/2042554157 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee000cd90 con 0x7f7ef40b3ad0 2024-09-12T02:47:24.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.256+0000 7f7efa800640 1 -- 172.21.15.112:0/2042554157 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ef40b9df0 con 0x7f7ef40b3ad0 2024-09-12T02:47:24.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.256+0000 7f7efa800640 1 -- 172.21.15.112:0/2042554157 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ef40ba3b0 con 0x7f7ef40b3ad0 2024-09-12T02:47:24.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.257+0000 7f7efa800640 1 -- 172.21.15.112:0/2042554157 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ef4162890 con 0x7f7ef40b3ad0 2024-09-12T02:47:24.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.258+0000 7f7ef1600640 1 -- 172.21.15.112:0/2042554157 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7ee001a070 con 0x7f7ef40b3ad0 2024-09-12T02:47:24.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.259+0000 7f7ef1600640 1 --2- 172.21.15.112:0/2042554157 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7ed406be60 0x7f7ed406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:24.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.259+0000 7f7ef1600640 1 -- 172.21.15.112:0/2042554157 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 4857+0+0 (secure 0 0 0) 0x7f7ee008adf0 con 0x7f7ef40b3ad0 2024-09-12T02:47:24.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.259+0000 7f7ef9400640 1 --2- 172.21.15.112:0/2042554157 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7ed406be60 0x7f7ed406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:24.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.260+0000 7f7ef9400640 1 --2- 172.21.15.112:0/2042554157 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7ed406be60 0x7f7ed406e320 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8034000 tx=0x7f7ee802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:24.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.263+0000 7f7ef1600640 1 -- 172.21.15.112:0/2042554157 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7ee0059490 con 0x7f7ef40b3ad0 2024-09-12T02:47:24.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.436+0000 7f7efa800640 1 -- 172.21.15.112:0/2042554157 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f7ef40c8680 con 0x7f7ef40b3ad0 2024-09-12T02:47:24.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.436+0000 7f7ef1600640 1 -- 172.21.15.112:0/2042554157 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v116) ==== 84+0+65 (secure 0 0 0) 0x7f7ee005d790 con 0x7f7ef40b3ad0 2024-09-12T02:47:24.437 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:24.437 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2024-09-12T02:47:24.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:24.437 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 1, 2024-09-12T02:47:24.438 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": ".mgr" 2024-09-12T02:47:24.438 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:24.438 INFO:teuthology.orchestra.run.smithi112.stdout:] 2024-09-12T02:47:24.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.438+0000 7f7efa800640 1 -- 172.21.15.112:0/2042554157 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7ed406be60 msgr2=0x7f7ed406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:24.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.438+0000 7f7efa800640 1 --2- 172.21.15.112:0/2042554157 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7ed406be60 0x7f7ed406e320 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8034000 tx=0x7f7ee802e000 comp rx=0 tx=0).stop 2024-09-12T02:47:24.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.438+0000 7f7efa800640 1 -- 172.21.15.112:0/2042554157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ef40b3ad0 msgr2=0x7f7ef40b8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:24.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.438+0000 7f7efa800640 1 --2- 172.21.15.112:0/2042554157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ef40b3ad0 0x7f7ef40b8c50 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000e9b0 tx=0x7f7ee000ee70 comp rx=0 tx=0).stop 2024-09-12T02:47:24.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.438+0000 7f7efa800640 1 -- 172.21.15.112:0/2042554157 shutdown_connections 2024-09-12T02:47:24.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.438+0000 7f7efa800640 1 --2- 172.21.15.112:0/2042554157 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ef41624b0 0x7f7ef40b9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:24.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.438+0000 7f7efa800640 1 --2- 172.21.15.112:0/2042554157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ef40b3ad0 0x7f7ef40b8c50 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:24.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.438+0000 7f7efa800640 1 --2- 172.21.15.112:0/2042554157 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7ed406be60 0x7f7ed406e320 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:24.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.438+0000 7f7efa800640 1 --2- 172.21.15.112:0/2042554157 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ef40b1a40 0x7f7ef40cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:24.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.438+0000 7f7efa800640 1 -- 172.21.15.112:0/2042554157 >> 172.21.15.112:0/2042554157 conn(0x7f7ef40d4db0 msgr2=0x7f7ef40d5710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:24.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.439+0000 7f7efa800640 1 -- 172.21.15.112:0/2042554157 shutdown_connections 2024-09-12T02:47:24.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.439+0000 7f7efa800640 1 -- 172.21.15.112:0/2042554157 wait complete. 2024-09-12T02:47:24.455 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T02:47:24.456 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T02:47:24.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.611+0000 7f456e200640 1 Processor -- start 2024-09-12T02:47:24.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.612+0000 7f456e200640 1 -- start start 2024-09-12T02:47:24.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.613+0000 7f456e200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f45680b4140 0x7f45680b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:24.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.613+0000 7f456e200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45681602f0 0x7f45680ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:24.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.613+0000 7f456e200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f456806eed0 con 0x7f4568144890 2024-09-12T02:47:24.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.613+0000 7f456e200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f456806f170 con 0x7f45680b4140 2024-09-12T02:47:24.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.613+0000 7f456e200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f456815f810 con 0x7f45681602f0 2024-09-12T02:47:24.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.613+0000 7f4567e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45681602f0 0x7f45680ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:24.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.613+0000 7f455ea00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f45680b4140 0x7f45680b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:24.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.613+0000 7f4567400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f4568144890 0x7f45680b3a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.112:35732/0 (socket says 172.21.15.112:35732) 2024-09-12T02:47:24.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.614+0000 7f4567e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45681602f0 0x7f45680ce5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:58176/0 (socket says 172.21.15.112:58176) 2024-09-12T02:47:24.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.614+0000 7f4567400640 1 -- 172.21.15.112:0/372473667 learned_addr learned my addr 172.21.15.112:0/372473667 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:24.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.614+0000 7f455ea00640 1 -- 172.21.15.112:0/372473667 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45681602f0 msgr2=0x7f45680ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:24.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.614+0000 7f455ea00640 1 --2- 172.21.15.112:0/372473667 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45681602f0 0x7f45680ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:24.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.614+0000 7f455ea00640 1 -- 172.21.15.112:0/372473667 >> v1:172.21.15.137:6789/0 conn(0x7f4568144890 legacy=0x7f45680b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:24.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.614+0000 7f455ea00640 1 -- 172.21.15.112:0/372473667 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f456815faf0 con 0x7f45680b4140 2024-09-12T02:47:24.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.615+0000 7f455ea00640 1 --2- 172.21.15.112:0/372473667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45680b4140 0x7f45680b58c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f455000ba40 tx=0x7f455002c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40356ce4662b6e5d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:24.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.615+0000 7f4566a00640 1 -- 172.21.15.112:0/372473667 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4550032750 con 0x7f45680b4140 2024-09-12T02:47:24.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.615+0000 7f4566a00640 1 -- 172.21.15.112:0/372473667 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4550030050 con 0x7f45680b4140 2024-09-12T02:47:24.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.615+0000 7f4566a00640 1 -- 172.21.15.112:0/372473667 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4550032b10 con 0x7f45680b4140 2024-09-12T02:47:24.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.616+0000 7f456e200640 1 -- 172.21.15.112:0/372473667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45680b4140 msgr2=0x7f45680b58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:24.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.616+0000 7f456e200640 1 --2- 172.21.15.112:0/372473667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45680b4140 0x7f45680b58c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f455000ba40 tx=0x7f455002c850 comp rx=0 tx=0).stop 2024-09-12T02:47:24.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.616+0000 7f456e200640 1 -- 172.21.15.112:0/372473667 shutdown_connections 2024-09-12T02:47:24.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.616+0000 7f456e200640 1 --2- 172.21.15.112:0/372473667 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45681602f0 0x7f45680ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:24.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.616+0000 7f456e200640 1 --2- 172.21.15.112:0/372473667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45680b4140 0x7f45680b58c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:24.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.616+0000 7f456e200640 1 -- 172.21.15.112:0/372473667 >> 172.21.15.112:0/372473667 conn(0x7f45680b2730 msgr2=0x7f45680b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:24.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.616+0000 7f456e200640 1 -- 172.21.15.112:0/372473667 shutdown_connections 2024-09-12T02:47:24.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.616+0000 7f456e200640 1 -- 172.21.15.112:0/372473667 wait complete. 2024-09-12T02:47:24.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.618+0000 7f456e200640 1 Processor -- start 2024-09-12T02:47:24.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.618+0000 7f456e200640 1 -- start start 2024-09-12T02:47:24.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.619+0000 7f456e200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45680b4140 0x7f456815d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:24.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.619+0000 7f456e200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4568144890 0x7f45681e5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:24.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.619+0000 7f456e200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45681602f0 0x7f456815e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:24.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.619+0000 7f456e200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4568144df0 con 0x7f45680b4140 2024-09-12T02:47:24.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.619+0000 7f456e200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4568144c70 con 0x7f4568144890 2024-09-12T02:47:24.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.619+0000 7f456e200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f45680b3290 con 0x7f45681602f0 2024-09-12T02:47:24.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.619+0000 7f4567400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45680b4140 0x7f456815d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:24.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.619+0000 7f4567400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45680b4140 0x7f456815d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37448/0 (socket says 172.21.15.112:37448) 2024-09-12T02:47:24.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.619+0000 7f4567400640 1 -- 172.21.15.112:0/93636791 learned_addr learned my addr 172.21.15.112:0/93636791 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:24.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.619+0000 7f455ea00640 1 --2- 172.21.15.112:0/93636791 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4568144890 0x7f45681e5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:24.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.619+0000 7f4567e00640 1 --2- 172.21.15.112:0/93636791 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45681602f0 0x7f456815e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:24.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.619+0000 7f4567400640 1 -- 172.21.15.112:0/93636791 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45681602f0 msgr2=0x7f456815e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:24.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.619+0000 7f4567400640 1 --2- 172.21.15.112:0/93636791 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45681602f0 0x7f456815e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:24.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.619+0000 7f4567400640 1 -- 172.21.15.112:0/93636791 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4568144890 msgr2=0x7f45681e5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:24.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.620+0000 7f4567400640 1 --2- 172.21.15.112:0/93636791 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4568144890 0x7f45681e5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:24.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.620+0000 7f4567400640 1 -- 172.21.15.112:0/93636791 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f456815d860 con 0x7f45680b4140 2024-09-12T02:47:24.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.620+0000 7f4567400640 1 --2- 172.21.15.112:0/93636791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45680b4140 0x7f456815d1d0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f455800c400 tx=0x7f455800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:24.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.620+0000 7f455fe00640 1 -- 172.21.15.112:0/93636791 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4558017070 con 0x7f45680b4140 2024-09-12T02:47:24.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.620+0000 7f455fe00640 1 -- 172.21.15.112:0/93636791 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4558005ce0 con 0x7f45680b4140 2024-09-12T02:47:24.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.620+0000 7f456e200640 1 -- 172.21.15.112:0/93636791 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f456815db40 con 0x7f45680b4140 2024-09-12T02:47:24.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.620+0000 7f455fe00640 1 -- 172.21.15.112:0/93636791 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45580072f0 con 0x7f45680b4140 2024-09-12T02:47:24.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.620+0000 7f456e200640 1 -- 172.21.15.112:0/93636791 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f456815e100 con 0x7f45680b4140 2024-09-12T02:47:24.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.621+0000 7f456e200640 1 -- 172.21.15.112:0/93636791 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45680b58c0 con 0x7f45680b4140 2024-09-12T02:47:24.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.622+0000 7f455fe00640 1 -- 172.21.15.112:0/93636791 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f455801a070 con 0x7f45680b4140 2024-09-12T02:47:24.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.623+0000 7f455fe00640 1 --2- 172.21.15.112:0/93636791 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f454406be30 0x7f454406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:24.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.623+0000 7f455fe00640 1 -- 172.21.15.112:0/93636791 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 4857+0+0 (secure 0 0 0) 0x7f4558089f30 con 0x7f45680b4140 2024-09-12T02:47:24.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.623+0000 7f455ea00640 1 --2- 172.21.15.112:0/93636791 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f454406be30 0x7f454406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:24.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.624+0000 7f455ea00640 1 --2- 172.21.15.112:0/93636791 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f454406be30 0x7f454406e2f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4550037000 tx=0x7f4550032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:24.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.627+0000 7f455fe00640 1 -- 172.21.15.112:0/93636791 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4558058540 con 0x7f45680b4140 2024-09-12T02:47:24.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:24.806+0000 7f456e200640 1 -- 172.21.15.112:0/93636791 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f45680d0c00 con 0x7f45680b4140 2024-09-12T02:47:25.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.656+0000 7f455fe00640 1 -- 172.21.15.112:0/93636791 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v117) ==== 138+0+0 (secure 0 0 0) 0x7f455805c840 con 0x7f45680b4140 2024-09-12T02:47:25.657 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' created 2024-09-12T02:47:25.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.660+0000 7f456e200640 1 -- 172.21.15.112:0/93636791 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f454406be30 msgr2=0x7f454406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:25.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.660+0000 7f456e200640 1 --2- 172.21.15.112:0/93636791 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f454406be30 0x7f454406e2f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4550037000 tx=0x7f4550032000 comp rx=0 tx=0).stop 2024-09-12T02:47:25.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.660+0000 7f456e200640 1 -- 172.21.15.112:0/93636791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45680b4140 msgr2=0x7f456815d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:25.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.660+0000 7f456e200640 1 --2- 172.21.15.112:0/93636791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45680b4140 0x7f456815d1d0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f455800c400 tx=0x7f455800c8c0 comp rx=0 tx=0).stop 2024-09-12T02:47:25.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.660+0000 7f456e200640 1 -- 172.21.15.112:0/93636791 shutdown_connections 2024-09-12T02:47:25.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.660+0000 7f456e200640 1 --2- 172.21.15.112:0/93636791 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45681602f0 0x7f456815e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:25.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.660+0000 7f456e200640 1 --2- 172.21.15.112:0/93636791 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f454406be30 0x7f454406e2f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:25.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.660+0000 7f456e200640 1 --2- 172.21.15.112:0/93636791 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4568144890 0x7f45681e5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:25.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.660+0000 7f456e200640 1 --2- 172.21.15.112:0/93636791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45680b4140 0x7f456815d1d0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:25.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.660+0000 7f456e200640 1 -- 172.21.15.112:0/93636791 >> 172.21.15.112:0/93636791 conn(0x7f45680b2730 msgr2=0x7f45680ae8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:25.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.660+0000 7f456e200640 1 -- 172.21.15.112:0/93636791 shutdown_connections 2024-09-12T02:47:25.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.660+0000 7f456e200640 1 -- 172.21.15.112:0/93636791 wait complete. 2024-09-12T02:47:25.682 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:47:25.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.844+0000 7f3d5be00640 1 Processor -- start 2024-09-12T02:47:25.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.845+0000 7f3d5be00640 1 -- start start 2024-09-12T02:47:25.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.846+0000 7f3d5be00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3d5c06d680 0x7f3d5c06da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:25.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.846+0000 7f3d5be00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d5c0b24d0 con 0x7f3d5c0b7300 2024-09-12T02:47:25.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.846+0000 7f3d5be00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d5c06dfa0 con 0x7f3d5c0b7770 2024-09-12T02:47:25.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.846+0000 7f3d5be00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f3d5c0b2770 con 0x7f3d5c06d680 2024-09-12T02:47:25.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.846+0000 7f3d5aa00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3d5c06d680 0x7f3d5c06da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:25.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.846+0000 7f3d5a000640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f3d5c0b7300 0x7f3d5c0b3530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:37472/0 (socket says 172.21.15.112:37472) 2024-09-12T02:47:25.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.846+0000 7f3d5a000640 1 -- 172.21.15.112:0/1592280748 learned_addr learned my addr 172.21.15.112:0/1592280748 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:25.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.846+0000 7f3d5aa00640 1 -- 172.21.15.112:0/1592280748 >> v1:172.21.15.137:6789/0 conn(0x7f3d5c0b7770 legacy=0x7f3d5c0b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:25.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.847+0000 7f3d5aa00640 1 -- 172.21.15.112:0/1592280748 >> v1:172.21.15.112:6789/0 conn(0x7f3d5c0b7300 legacy=0x7f3d5c0b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:25.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.847+0000 7f3d59600640 1 -- 172.21.15.112:0/1592280748 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2228893202 0 0) 0x7f3d5c0b24d0 con 0x7f3d5c0b7300 2024-09-12T02:47:25.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.847+0000 7f3d5aa00640 1 -- 172.21.15.112:0/1592280748 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d5c0b2a50 con 0x7f3d5c06d680 2024-09-12T02:47:25.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.848+0000 7f3d5aa00640 1 --2- 172.21.15.112:0/1592280748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d5c06d680 0x7f3d5c06da60 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009dc0 tx=0x7f3d4c02a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8064545ff42f9158 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:25.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.848+0000 7f3d59600640 1 -- 172.21.15.112:0/1592280748 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c007740 con 0x7f3d5c06d680 2024-09-12T02:47:25.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.848+0000 7f3d59600640 1 -- 172.21.15.112:0/1592280748 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d4c0078e0 con 0x7f3d5c06d680 2024-09-12T02:47:25.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.848+0000 7f3d59600640 1 -- 172.21.15.112:0/1592280748 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c007cb0 con 0x7f3d5c06d680 2024-09-12T02:47:25.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.848+0000 7f3d5be00640 1 -- 172.21.15.112:0/1592280748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d5c06d680 msgr2=0x7f3d5c06da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:25.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.848+0000 7f3d5be00640 1 --2- 172.21.15.112:0/1592280748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d5c06d680 0x7f3d5c06da60 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009dc0 tx=0x7f3d4c02a6d0 comp rx=0 tx=0).stop 2024-09-12T02:47:25.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.848+0000 7f3d5be00640 1 -- 172.21.15.112:0/1592280748 shutdown_connections 2024-09-12T02:47:25.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.848+0000 7f3d5be00640 1 --2- 172.21.15.112:0/1592280748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d5c06d680 0x7f3d5c06da60 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:25.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.848+0000 7f3d5be00640 1 -- 172.21.15.112:0/1592280748 >> 172.21.15.112:0/1592280748 conn(0x7f3d5c0b7ea0 msgr2=0x7f3d5c0b82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:25.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.849+0000 7f3d5be00640 1 -- 172.21.15.112:0/1592280748 shutdown_connections 2024-09-12T02:47:25.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.849+0000 7f3d5be00640 1 -- 172.21.15.112:0/1592280748 wait complete. 2024-09-12T02:47:25.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.850+0000 7f3d5be00640 1 Processor -- start 2024-09-12T02:47:25.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.850+0000 7f3d5be00640 1 -- start start 2024-09-12T02:47:25.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.851+0000 7f3d5be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d5c06d680 0x7f3d5c151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:25.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.851+0000 7f3d5be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d5c0b7300 0x7f3d5c153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:25.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.851+0000 7f3d5be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d5c0b7770 0x7f3d5c153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:25.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.851+0000 7f3d5be00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5c0b6670 con 0x7f3d5c06d680 2024-09-12T02:47:25.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.851+0000 7f3d5be00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5c0b3010 con 0x7f3d5c0b7300 2024-09-12T02:47:25.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.851+0000 7f3d5be00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3d5c0b4350 con 0x7f3d5c0b7770 2024-09-12T02:47:25.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.851+0000 7f3d5aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d5c06d680 0x7f3d5c151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:25.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.851+0000 7f3d5aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d5c06d680 0x7f3d5c151550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37476/0 (socket says 172.21.15.112:37476) 2024-09-12T02:47:25.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.851+0000 7f3d5aa00640 1 -- 172.21.15.112:0/228229983 learned_addr learned my addr 172.21.15.112:0/228229983 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:25.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.852+0000 7f3d5b400640 1 --2- 172.21.15.112:0/228229983 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d5c0b7770 0x7f3d5c153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:25.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.852+0000 7f3d5a000640 1 --2- 172.21.15.112:0/228229983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d5c0b7300 0x7f3d5c153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:25.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.852+0000 7f3d5aa00640 1 -- 172.21.15.112:0/228229983 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d5c0b7770 msgr2=0x7f3d5c153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:25.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.852+0000 7f3d5aa00640 1 --2- 172.21.15.112:0/228229983 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d5c0b7770 0x7f3d5c153a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:25.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.852+0000 7f3d5aa00640 1 -- 172.21.15.112:0/228229983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d5c0b7300 msgr2=0x7f3d5c153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:25.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.852+0000 7f3d5aa00640 1 --2- 172.21.15.112:0/228229983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d5c0b7300 0x7f3d5c153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:25.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.852+0000 7f3d5aa00640 1 -- 172.21.15.112:0/228229983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d5c0ccaf0 con 0x7f3d5c06d680 2024-09-12T02:47:25.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.852+0000 7f3d5a000640 1 --2- 172.21.15.112:0/228229983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d5c0b7300 0x7f3d5c153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:25.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.852+0000 7f3d5aa00640 1 --2- 172.21.15.112:0/228229983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d5c06d680 0x7f3d5c151550 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009dc0 tx=0x7f3d4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:25.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.852+0000 7f3d52a00640 1 -- 172.21.15.112:0/228229983 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c040070 con 0x7f3d5c06d680 2024-09-12T02:47:25.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.853+0000 7f3d52a00640 1 -- 172.21.15.112:0/228229983 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d4c031d00 con 0x7f3d5c06d680 2024-09-12T02:47:25.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.853+0000 7f3d5be00640 1 -- 172.21.15.112:0/228229983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d5c0ccdd0 con 0x7f3d5c06d680 2024-09-12T02:47:25.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.853+0000 7f3d52a00640 1 -- 172.21.15.112:0/228229983 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c0456a0 con 0x7f3d5c06d680 2024-09-12T02:47:25.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.853+0000 7f3d5be00640 1 -- 172.21.15.112:0/228229983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d5c0cd390 con 0x7f3d5c06d680 2024-09-12T02:47:25.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.854+0000 7f3d5be00640 1 -- 172.21.15.112:0/228229983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d5c0af960 con 0x7f3d5c06d680 2024-09-12T02:47:25.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.855+0000 7f3d52a00640 1 -- 172.21.15.112:0/228229983 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d4c039040 con 0x7f3d5c06d680 2024-09-12T02:47:25.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.856+0000 7f3d52a00640 1 --2- 172.21.15.112:0/228229983 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3d3c06be30 0x7f3d3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:25.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.856+0000 7f3d52a00640 1 -- 172.21.15.112:0/228229983 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5227+0+0 (secure 0 0 0) 0x7f3d4c0ac660 con 0x7f3d5c06d680 2024-09-12T02:47:25.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.856+0000 7f3d5a000640 1 --2- 172.21.15.112:0/228229983 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3d3c06be30 0x7f3d3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:25.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.856+0000 7f3d5a000640 1 --2- 172.21.15.112:0/228229983 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3d3c06be30 0x7f3d3c06e2f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c1f8070 tx=0x7f3d48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:25.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:25.860+0000 7f3d52a00640 1 -- 172.21.15.112:0/228229983 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3d4c07b1f0 con 0x7f3d5c06d680 2024-09-12T02:47:26.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.032+0000 7f3d5be00640 1 -- 172.21.15.112:0/228229983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f3d5c0707b0 con 0x7f3d5c06d680 2024-09-12T02:47:26.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.659+0000 7f3d52a00640 1 -- 172.21.15.112:0/228229983 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v118) ==== 170+0+0 (secure 0 0 0) 0x7f3d4c07aaf0 con 0x7f3d5c06d680 2024-09-12T02:47:26.660 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' created 2024-09-12T02:47:26.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.662+0000 7f3d5be00640 1 -- 172.21.15.112:0/228229983 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3d3c06be30 msgr2=0x7f3d3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:26.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.662+0000 7f3d5be00640 1 --2- 172.21.15.112:0/228229983 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3d3c06be30 0x7f3d3c06e2f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c1f8070 tx=0x7f3d48009040 comp rx=0 tx=0).stop 2024-09-12T02:47:26.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.662+0000 7f3d5be00640 1 -- 172.21.15.112:0/228229983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d5c06d680 msgr2=0x7f3d5c151550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:26.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.662+0000 7f3d5be00640 1 --2- 172.21.15.112:0/228229983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d5c06d680 0x7f3d5c151550 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009dc0 tx=0x7f3d4c004a40 comp rx=0 tx=0).stop 2024-09-12T02:47:26.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.662+0000 7f3d5be00640 1 -- 172.21.15.112:0/228229983 shutdown_connections 2024-09-12T02:47:26.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.662+0000 7f3d5be00640 1 --2- 172.21.15.112:0/228229983 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d5c0b7770 0x7f3d5c153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:26.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.662+0000 7f3d5be00640 1 --2- 172.21.15.112:0/228229983 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3d3c06be30 0x7f3d3c06e2f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:26.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.662+0000 7f3d5be00640 1 --2- 172.21.15.112:0/228229983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d5c0b7300 0x7f3d5c153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:26.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.662+0000 7f3d5be00640 1 --2- 172.21.15.112:0/228229983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d5c06d680 0x7f3d5c151550 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:26.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.662+0000 7f3d5be00640 1 -- 172.21.15.112:0/228229983 >> 172.21.15.112:0/228229983 conn(0x7f3d5c0b7ea0 msgr2=0x7f3d5c070fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:26.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.663+0000 7f3d5be00640 1 -- 172.21.15.112:0/228229983 shutdown_connections 2024-09-12T02:47:26.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.663+0000 7f3d5be00640 1 -- 172.21.15.112:0/228229983 wait complete. 2024-09-12T02:47:26.692 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T02:47:26.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.850+0000 7f8447200640 1 Processor -- start 2024-09-12T02:47:26.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.850+0000 7f8447200640 1 -- start start 2024-09-12T02:47:26.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.851+0000 7f8447200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f844815a450 0x7f844806e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:26.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.851+0000 7f8447200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f84480ce460 0x7f84480d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:26.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.851+0000 7f8447200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f844806e990 con 0x7f844815db60 2024-09-12T02:47:26.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.851+0000 7f8447200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8448071eb0 con 0x7f84480ce460 2024-09-12T02:47:26.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.851+0000 7f8447200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f844806ec70 con 0x7f844815a450 2024-09-12T02:47:26.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.852+0000 7f8446800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f844815db60 0x7f8448160510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:37484/0 (socket says 172.21.15.112:37484) 2024-09-12T02:47:26.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.852+0000 7f8446800640 1 -- 172.21.15.112:0/2690814945 learned_addr learned my addr 172.21.15.112:0/2690814945 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:26.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.852+0000 7f8445e00640 1 --2- 172.21.15.112:0/2690814945 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f844815a450 0x7f844806e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:26.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.852+0000 7f8445400640 1 --2- 172.21.15.112:0/2690814945 >> v2:172.21.15.137:3300/0 conn(0x7f84480ce460 0x7f84480d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:26.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.852+0000 7f8444a00640 1 -- 172.21.15.112:0/2690814945 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 304874061 0 0) 0x7f844806e990 con 0x7f844815db60 2024-09-12T02:47:26.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.852+0000 7f8444a00640 1 -- 172.21.15.112:0/2690814945 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f842c003520 con 0x7f844815db60 2024-09-12T02:47:26.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.852+0000 7f8445400640 1 -- 172.21.15.112:0/2690814945 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f844815a450 msgr2=0x7f844806e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:26.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.852+0000 7f8445400640 1 --2- 172.21.15.112:0/2690814945 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f844815a450 0x7f844806e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:26.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.852+0000 7f8445400640 1 -- 172.21.15.112:0/2690814945 >> v1:172.21.15.112:6789/0 conn(0x7f844815db60 legacy=0x7f8448160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:26.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.852+0000 7f8445400640 1 -- 172.21.15.112:0/2690814945 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8448072100 con 0x7f84480ce460 2024-09-12T02:47:26.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.852+0000 7f8445e00640 1 --2- 172.21.15.112:0/2690814945 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f844815a450 0x7f844806e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:26.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.854+0000 7f8445400640 1 --2- 172.21.15.112:0/2690814945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84480ce460 0x7f84480d0820 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f84340097a0 tx=0x7f843402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bd1f5ea9b89cc20 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:26.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.854+0000 7f8444a00640 1 -- 172.21.15.112:0/2690814945 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8434037070 con 0x7f84480ce460 2024-09-12T02:47:26.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.854+0000 7f8444a00640 1 -- 172.21.15.112:0/2690814945 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8434032440 con 0x7f84480ce460 2024-09-12T02:47:26.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.854+0000 7f8444a00640 1 -- 172.21.15.112:0/2690814945 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8434032810 con 0x7f84480ce460 2024-09-12T02:47:26.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.854+0000 7f8447200640 1 -- 172.21.15.112:0/2690814945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84480ce460 msgr2=0x7f84480d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:26.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.854+0000 7f8447200640 1 --2- 172.21.15.112:0/2690814945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84480ce460 0x7f84480d0820 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f84340097a0 tx=0x7f843402a230 comp rx=0 tx=0).stop 2024-09-12T02:47:26.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.854+0000 7f8447200640 1 -- 172.21.15.112:0/2690814945 shutdown_connections 2024-09-12T02:47:26.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.854+0000 7f8447200640 1 --2- 172.21.15.112:0/2690814945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84480ce460 0x7f84480d0820 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:26.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.854+0000 7f8447200640 1 --2- 172.21.15.112:0/2690814945 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f844815a450 0x7f844806e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:26.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.854+0000 7f8447200640 1 -- 172.21.15.112:0/2690814945 >> 172.21.15.112:0/2690814945 conn(0x7f844806bbd0 msgr2=0x7f844806bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:26.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.855+0000 7f8447200640 1 -- 172.21.15.112:0/2690814945 shutdown_connections 2024-09-12T02:47:26.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.855+0000 7f8447200640 1 -- 172.21.15.112:0/2690814945 wait complete. 2024-09-12T02:47:26.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.856+0000 7f8447200640 1 Processor -- start 2024-09-12T02:47:26.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.856+0000 7f8447200640 1 -- start start 2024-09-12T02:47:26.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.857+0000 7f8447200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84480ce460 0x7f84481507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:26.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.857+0000 7f8447200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f844815a450 0x7f84481f0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:26.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.857+0000 7f8447200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f844815db60 0x7f84481f1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:26.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.857+0000 7f8447200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f844815a830 con 0x7f844815a450 2024-09-12T02:47:26.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.857+0000 7f8447200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f844806e680 con 0x7f84480ce460 2024-09-12T02:47:26.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.857+0000 7f8447200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f84480d0d60 con 0x7f844815db60 2024-09-12T02:47:26.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.857+0000 7f8445400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f844815a450 0x7f84481f0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:26.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.857+0000 7f8445400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f844815a450 0x7f84481f0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37480/0 (socket says 172.21.15.112:37480) 2024-09-12T02:47:26.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.857+0000 7f8445400640 1 -- 172.21.15.112:0/2517445845 learned_addr learned my addr 172.21.15.112:0/2517445845 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:26.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.858+0000 7f8446800640 1 --2- 172.21.15.112:0/2517445845 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f844815db60 0x7f84481f1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:26.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.858+0000 7f8445e00640 1 --2- 172.21.15.112:0/2517445845 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84480ce460 0x7f84481507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:26.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.858+0000 7f8445400640 1 -- 172.21.15.112:0/2517445845 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f844815db60 msgr2=0x7f84481f1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:26.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.858+0000 7f8445400640 1 --2- 172.21.15.112:0/2517445845 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f844815db60 0x7f84481f1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:26.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.858+0000 7f8445400640 1 -- 172.21.15.112:0/2517445845 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84480ce460 msgr2=0x7f84481507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:26.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.858+0000 7f8445400640 1 --2- 172.21.15.112:0/2517445845 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84480ce460 0x7f84481507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:26.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.858+0000 7f8445400640 1 -- 172.21.15.112:0/2517445845 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8448151500 con 0x7f844815a450 2024-09-12T02:47:26.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.858+0000 7f8445400640 1 --2- 172.21.15.112:0/2517445845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f844815a450 0x7f84481f0ae0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f8434035040 tx=0x7f84340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:26.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.858+0000 7f843e000640 1 -- 172.21.15.112:0/2517445845 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8434041030 con 0x7f844815a450 2024-09-12T02:47:26.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.858+0000 7f843e000640 1 -- 172.21.15.112:0/2517445845 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f843403d4e0 con 0x7f844815a450 2024-09-12T02:47:26.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.858+0000 7f8447200640 1 -- 172.21.15.112:0/2517445845 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84481517e0 con 0x7f844815a450 2024-09-12T02:47:26.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.859+0000 7f843e000640 1 -- 172.21.15.112:0/2517445845 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8434037040 con 0x7f844815a450 2024-09-12T02:47:26.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.859+0000 7f8447200640 1 -- 172.21.15.112:0/2517445845 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8448152080 con 0x7f844815a450 2024-09-12T02:47:26.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.860+0000 7f8447200640 1 -- 172.21.15.112:0/2517445845 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8448151bd0 con 0x7f844815a450 2024-09-12T02:47:26.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.862+0000 7f843e000640 1 -- 172.21.15.112:0/2517445845 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8434044070 con 0x7f844815a450 2024-09-12T02:47:26.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.862+0000 7f843e000640 1 --2- 172.21.15.112:0/2517445845 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f842806be30 0x7f842806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:26.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.863+0000 7f843e000640 1 -- 172.21.15.112:0/2517445845 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5609+0+0 (secure 0 0 0) 0x7f84340abce0 con 0x7f844815a450 2024-09-12T02:47:26.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.863+0000 7f8445e00640 1 --2- 172.21.15.112:0/2517445845 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f842806be30 0x7f842806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:26.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.863+0000 7f8445e00640 1 --2- 172.21.15.112:0/2517445845 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f842806be30 0x7f842806e2f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8438009560 tx=0x7f8438008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:26.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:26.866+0000 7f843e000640 1 -- 172.21.15.112:0/2517445845 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f843407a6e0 con 0x7f844815a450 2024-09-12T02:47:27.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.075+0000 7f8447200640 1 -- 172.21.15.112:0/2517445845 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8448157790 con 0x7f844815a450 2024-09-12T02:47:27.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.689+0000 7f843e000640 1 -- 172.21.15.112:0/2517445845 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v58) ==== 174+0+0 (secure 0 0 0) 0x7f8448157790 con 0x7f844815a450 2024-09-12T02:47:27.691 INFO:teuthology.orchestra.run.smithi112.stderr:new fs with metadata pool 14 and data pool 15 2024-09-12T02:47:27.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.698+0000 7f8447200640 1 -- 172.21.15.112:0/2517445845 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f842806be30 msgr2=0x7f842806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:27.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.698+0000 7f8447200640 1 --2- 172.21.15.112:0/2517445845 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f842806be30 0x7f842806e2f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8438009560 tx=0x7f8438008040 comp rx=0 tx=0).stop 2024-09-12T02:47:27.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.698+0000 7f8447200640 1 -- 172.21.15.112:0/2517445845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f844815a450 msgr2=0x7f84481f0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:27.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.698+0000 7f8447200640 1 --2- 172.21.15.112:0/2517445845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f844815a450 0x7f84481f0ae0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f8434035040 tx=0x7f84340046c0 comp rx=0 tx=0).stop 2024-09-12T02:47:27.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.698+0000 7f8447200640 1 -- 172.21.15.112:0/2517445845 shutdown_connections 2024-09-12T02:47:27.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.698+0000 7f8447200640 1 --2- 172.21.15.112:0/2517445845 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f844815db60 0x7f84481f1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:27.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.698+0000 7f8447200640 1 --2- 172.21.15.112:0/2517445845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f844815a450 0x7f84481f0ae0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:27.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.698+0000 7f8447200640 1 --2- 172.21.15.112:0/2517445845 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f842806be30 0x7f842806e2f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:27.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.698+0000 7f8447200640 1 --2- 172.21.15.112:0/2517445845 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84480ce460 0x7f84481507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:27.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.698+0000 7f8447200640 1 -- 172.21.15.112:0/2517445845 >> 172.21.15.112:0/2517445845 conn(0x7f844806bbd0 msgr2=0x7f84481585a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:27.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.700+0000 7f8447200640 1 -- 172.21.15.112:0/2517445845 shutdown_connections 2024-09-12T02:47:27.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.700+0000 7f8447200640 1 -- 172.21.15.112:0/2517445845 wait complete. 2024-09-12T02:47:27.721 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:47:27.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.875+0000 7fb1d7800640 1 Processor -- start 2024-09-12T02:47:27.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.875+0000 7fb1d7800640 1 -- start start 2024-09-12T02:47:27.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.877+0000 7fb1d7800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb1d006f600 0x7fb1d00b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:27.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.877+0000 7fb1d7800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1d00b4a20 con 0x7fb1d00b45d0 2024-09-12T02:47:27.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.877+0000 7fb1d7800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1d00b54a0 con 0x7fb1d015b9d0 2024-09-12T02:47:27.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.877+0000 7fb1d7800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb1d00b3af0 con 0x7fb1d006f600 2024-09-12T02:47:27.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.877+0000 7fb1d5800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb1d00b45d0 0x7fb1d00cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:37494/0 (socket says 172.21.15.112:37494) 2024-09-12T02:47:27.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.877+0000 7fb1d5800640 1 -- 172.21.15.112:0/575198778 learned_addr learned my addr 172.21.15.112:0/575198778 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:27.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.877+0000 7fb1c7e00640 1 --2- 172.21.15.112:0/575198778 >> v2:172.21.15.137:3300/0 conn(0x7fb1d006f600 0x7fb1d00b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:27.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.877+0000 7fb1cfe00640 1 -- 172.21.15.112:0/575198778 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4231235769 0 0) 0x7fb1d00b4a20 con 0x7fb1d00b45d0 2024-09-12T02:47:27.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.877+0000 7fb1cfe00640 1 -- 172.21.15.112:0/575198778 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1b4003520 con 0x7fb1d00b45d0 2024-09-12T02:47:27.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.878+0000 7fb1cfe00640 1 -- 172.21.15.112:0/575198778 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3978389637 0 0) 0x7fb1d00b54a0 con 0x7fb1d015b9d0 2024-09-12T02:47:27.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.878+0000 7fb1cfe00640 1 -- 172.21.15.112:0/575198778 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1d00b4a20 con 0x7fb1d015b9d0 2024-09-12T02:47:27.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.878+0000 7fb1cfe00640 1 -- 172.21.15.112:0/575198778 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2846626409 0 0) 0x7fb1b4003520 con 0x7fb1d00b45d0 2024-09-12T02:47:27.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.878+0000 7fb1cfe00640 1 -- 172.21.15.112:0/575198778 >> v2:172.21.15.137:3300/0 conn(0x7fb1d006f600 msgr2=0x7fb1d00b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:27.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.878+0000 7fb1cfe00640 1 --2- 172.21.15.112:0/575198778 >> v2:172.21.15.137:3300/0 conn(0x7fb1d006f600 0x7fb1d00b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:27.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.878+0000 7fb1cfe00640 1 -- 172.21.15.112:0/575198778 >> v1:172.21.15.137:6789/0 conn(0x7fb1d015b9d0 legacy=0x7fb1d006eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:27.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.878+0000 7fb1cfe00640 1 -- 172.21.15.112:0/575198778 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d00b3dd0 con 0x7fb1d00b45d0 2024-09-12T02:47:27.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.878+0000 7fb1cfe00640 1 -- 172.21.15.112:0/575198778 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7fb1c80019f0 con 0x7fb1d00b45d0 2024-09-12T02:47:27.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.878+0000 7fb1cfe00640 1 -- 172.21.15.112:0/575198778 >> v1:172.21.15.112:6789/0 conn(0x7fb1d00b45d0 legacy=0x7fb1d00cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:27.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.878+0000 7fb1cfe00640 1 --2- 172.21.15.112:0/575198778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1b4003b40 0x7fb1b4003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:27.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.878+0000 7fb1cfe00640 1 --2- 172.21.15.112:0/575198778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1b4004800 0x7fb1b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:27.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.878+0000 7fb1cfe00640 1 --2- 172.21.15.112:0/575198778 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb1b40051c0 0x7fb1b400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:27.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.878+0000 7fb1cfe00640 1 -- 172.21.15.112:0/575198778 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d00b3af0 con 0x7fb1b4004800 2024-09-12T02:47:27.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.878+0000 7fb1cfe00640 1 -- 172.21.15.112:0/575198778 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b400e300 con 0x7fb1b4003b40 2024-09-12T02:47:27.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.878+0000 7fb1cfe00640 1 -- 172.21.15.112:0/575198778 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb1b400e500 con 0x7fb1b40051c0 2024-09-12T02:47:27.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.878+0000 7fb1c7e00640 1 --2- 172.21.15.112:0/575198778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1b4004800 0x7fb1b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:27.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.878+0000 7fb1d4e00640 1 --2- 172.21.15.112:0/575198778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1b4003b40 0x7fb1b4003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:27.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.878+0000 7fb1d5800640 1 --2- 172.21.15.112:0/575198778 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb1b40051c0 0x7fb1b400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:27.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.879+0000 7fb1c7e00640 1 -- 172.21.15.112:0/575198778 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb1b40051c0 msgr2=0x7fb1b400dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:27.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.879+0000 7fb1c7e00640 1 --2- 172.21.15.112:0/575198778 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb1b40051c0 0x7fb1b400dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:27.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.879+0000 7fb1c7e00640 1 -- 172.21.15.112:0/575198778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1b4003b40 msgr2=0x7fb1b4003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:27.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.879+0000 7fb1c7e00640 1 --2- 172.21.15.112:0/575198778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1b4003b40 0x7fb1b4003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:27.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.879+0000 7fb1c7e00640 1 -- 172.21.15.112:0/575198778 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1b4003520 con 0x7fb1b4004800 2024-09-12T02:47:27.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.879+0000 7fb1d5800640 1 -- 172.21.15.112:0/575198778 reap_dead start 2024-09-12T02:47:27.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.880+0000 7fb1c7e00640 1 --2- 172.21.15.112:0/575198778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1b4004800 0x7fb1b4004c80 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fb1d006fff0 tx=0x7fb1b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2476ce02d5c37cec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:27.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.880+0000 7fb1cfe00640 1 -- 172.21.15.112:0/575198778 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b8036070 con 0x7fb1b4004800 2024-09-12T02:47:27.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.880+0000 7fb1cfe00640 1 -- 172.21.15.112:0/575198778 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1b8005990 con 0x7fb1b4004800 2024-09-12T02:47:27.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.880+0000 7fb1cfe00640 1 -- 172.21.15.112:0/575198778 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b8009680 con 0x7fb1b4004800 2024-09-12T02:47:27.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.880+0000 7fb1d7800640 1 -- 172.21.15.112:0/575198778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1b4004800 msgr2=0x7fb1b4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:27.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.880+0000 7fb1d7800640 1 --2- 172.21.15.112:0/575198778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1b4004800 0x7fb1b4004c80 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fb1d006fff0 tx=0x7fb1b4005830 comp rx=0 tx=0).stop 2024-09-12T02:47:27.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.880+0000 7fb1d7800640 1 -- 172.21.15.112:0/575198778 shutdown_connections 2024-09-12T02:47:27.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.880+0000 7fb1d7800640 1 --2- 172.21.15.112:0/575198778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1b4004800 0x7fb1b4004c80 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:27.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.880+0000 7fb1d7800640 1 -- 172.21.15.112:0/575198778 >> 172.21.15.112:0/575198778 conn(0x7fb1d006bbd0 msgr2=0x7fb1d006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:27.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.880+0000 7fb1d7800640 1 -- 172.21.15.112:0/575198778 shutdown_connections 2024-09-12T02:47:27.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.880+0000 7fb1d7800640 1 -- 172.21.15.112:0/575198778 wait complete. 2024-09-12T02:47:27.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.882+0000 7fb1d7800640 1 Processor -- start 2024-09-12T02:47:27.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.882+0000 7fb1d7800640 1 -- start start 2024-09-12T02:47:27.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.883+0000 7fb1d7800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1b4004800 0x7fb1d015a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:27.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.883+0000 7fb1d7800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb1d00afc60 0x7fb1d0153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:27.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.883+0000 7fb1d7800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1d00cc640 0x7fb1d01536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:27.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.883+0000 7fb1d7800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d015bf30 con 0x7fb1b4004800 2024-09-12T02:47:27.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.883+0000 7fb1d7800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d015bdb0 con 0x7fb1d00cc640 2024-09-12T02:47:27.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.883+0000 7fb1d7800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb1d00b4ec0 con 0x7fb1d00afc60 2024-09-12T02:47:27.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.883+0000 7fb1d4e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1b4004800 0x7fb1d015a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:27.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.883+0000 7fb1d4e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1b4004800 0x7fb1d015a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37498/0 (socket says 172.21.15.112:37498) 2024-09-12T02:47:27.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.883+0000 7fb1d4e00640 1 -- 172.21.15.112:0/3003051617 learned_addr learned my addr 172.21.15.112:0/3003051617 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:27.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.883+0000 7fb1c7e00640 1 --2- 172.21.15.112:0/3003051617 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb1d00afc60 0x7fb1d0153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:27.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.883+0000 7fb1d5800640 1 --2- 172.21.15.112:0/3003051617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1d00cc640 0x7fb1d01536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:27.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.884+0000 7fb1d4e00640 1 -- 172.21.15.112:0/3003051617 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb1d00afc60 msgr2=0x7fb1d0153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:27.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.884+0000 7fb1d4e00640 1 --2- 172.21.15.112:0/3003051617 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb1d00afc60 0x7fb1d0153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:27.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.884+0000 7fb1d4e00640 1 -- 172.21.15.112:0/3003051617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1d00cc640 msgr2=0x7fb1d01536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:27.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.884+0000 7fb1d4e00640 1 --2- 172.21.15.112:0/3003051617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1d00cc640 0x7fb1d01536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:27.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.884+0000 7fb1d4e00640 1 -- 172.21.15.112:0/3003051617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d00aeb20 con 0x7fb1b4004800 2024-09-12T02:47:27.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.884+0000 7fb1c7e00640 1 --2- 172.21.15.112:0/3003051617 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb1d00afc60 0x7fb1d0153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:27.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.884+0000 7fb1d4e00640 1 --2- 172.21.15.112:0/3003051617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1b4004800 0x7fb1d015a240 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000f7a0 tx=0x7fb1c000fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:27.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.884+0000 7fb1cd600640 1 -- 172.21.15.112:0/3003051617 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c000fe50 con 0x7fb1b4004800 2024-09-12T02:47:27.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.884+0000 7fb1cd600640 1 -- 172.21.15.112:0/3003051617 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1c0018070 con 0x7fb1b4004800 2024-09-12T02:47:27.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.884+0000 7fb1d7800640 1 -- 172.21.15.112:0/3003051617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1d00aee00 con 0x7fb1b4004800 2024-09-12T02:47:27.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.884+0000 7fb1cd600640 1 -- 172.21.15.112:0/3003051617 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c000d730 con 0x7fb1b4004800 2024-09-12T02:47:27.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.884+0000 7fb1d7800640 1 -- 172.21.15.112:0/3003051617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1d00af3c0 con 0x7fb1b4004800 2024-09-12T02:47:27.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.885+0000 7fb1d7800640 1 -- 172.21.15.112:0/3003051617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1d0068a30 con 0x7fb1b4004800 2024-09-12T02:47:27.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.886+0000 7fb1cd600640 1 -- 172.21.15.112:0/3003051617 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb1c000d8d0 con 0x7fb1b4004800 2024-09-12T02:47:27.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.887+0000 7fb1cd600640 1 --2- 172.21.15.112:0/3003051617 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb1ac06be30 0x7fb1ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:27.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.887+0000 7fb1cd600640 1 -- 172.21.15.112:0/3003051617 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5709+0+0 (secure 0 0 0) 0x7fb1c008add0 con 0x7fb1b4004800 2024-09-12T02:47:27.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.887+0000 7fb1c7e00640 1 --2- 172.21.15.112:0/3003051617 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb1ac06be30 0x7fb1ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:27.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.888+0000 7fb1c7e00640 1 --2- 172.21.15.112:0/3003051617 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb1ac06be30 0x7fb1ac06e2f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8033000 tx=0x7fb1b8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:27.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:27.891+0000 7fb1cd600640 1 -- 172.21.15.112:0/3003051617 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb1c001a310 con 0x7fb1b4004800 2024-09-12T02:47:28.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.067+0000 7fb1d7800640 1 -- 172.21.15.112:0/3003051617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb1d00b51f0 con 0x7fb1b4004800 2024-09-12T02:47:28.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.068+0000 7fb1cd600640 1 -- 172.21.15.112:0/3003051617 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) ==== 74+0+16741 (secure 0 0 0) 0x7fb1c0059770 con 0x7fb1b4004800 2024-09-12T02:47:28.069 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:28.069 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":119,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:47:27.076469+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:47:24.847347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-12T02:47:26.073460+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:47:28.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.070+0000 7fb1d7800640 1 -- 172.21.15.112:0/3003051617 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb1ac06be30 msgr2=0x7fb1ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:28.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.070+0000 7fb1d7800640 1 --2- 172.21.15.112:0/3003051617 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb1ac06be30 0x7fb1ac06e2f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8033000 tx=0x7fb1b8008030 comp rx=0 tx=0).stop 2024-09-12T02:47:28.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.070+0000 7fb1d7800640 1 -- 172.21.15.112:0/3003051617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1b4004800 msgr2=0x7fb1d015a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:28.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.070+0000 7fb1d7800640 1 --2- 172.21.15.112:0/3003051617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1b4004800 0x7fb1d015a240 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000f7a0 tx=0x7fb1c000fc60 comp rx=0 tx=0).stop 2024-09-12T02:47:28.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.070+0000 7fb1d7800640 1 -- 172.21.15.112:0/3003051617 shutdown_connections 2024-09-12T02:47:28.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.070+0000 7fb1d7800640 1 --2- 172.21.15.112:0/3003051617 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb1ac06be30 0x7fb1ac06e2f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.070+0000 7fb1d7800640 1 --2- 172.21.15.112:0/3003051617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1d00cc640 0x7fb1d01536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.070+0000 7fb1d7800640 1 --2- 172.21.15.112:0/3003051617 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb1d00afc60 0x7fb1d0153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.070+0000 7fb1d7800640 1 --2- 172.21.15.112:0/3003051617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1b4004800 0x7fb1d015a240 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.070+0000 7fb1d7800640 1 -- 172.21.15.112:0/3003051617 >> 172.21.15.112:0/3003051617 conn(0x7fb1d006bbd0 msgr2=0x7fb1d006dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:28.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.070+0000 7fb1d7800640 1 -- 172.21.15.112:0/3003051617 shutdown_connections 2024-09-12T02:47:28.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.070+0000 7fb1d7800640 1 -- 172.21.15.112:0/3003051617 wait complete. 2024-09-12T02:47:28.088 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:47:28.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.240+0000 7f4906000640 1 Processor -- start 2024-09-12T02:47:28.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.240+0000 7f4906000640 1 -- start start 2024-09-12T02:47:28.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.241+0000 7f4906000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f490015b9d0 0x7f49000b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:28.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.241+0000 7f4906000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f49000b45d0 0x7f49000728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:28.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.241+0000 7f4906000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49000b54a0 con 0x7f490006eef0 2024-09-12T02:47:28.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.241+0000 7f4906000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f49000b4a30 con 0x7f49000b45d0 2024-09-12T02:47:28.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.241+0000 7f4906000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f49000b3af0 con 0x7f490015b9d0 2024-09-12T02:47:28.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.242+0000 7f48ffe00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f490006eef0 0x7f490006f300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:37506/0 (socket says 172.21.15.112:37506) 2024-09-12T02:47:28.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.242+0000 7f48ffe00640 1 -- 172.21.15.112:0/4293027051 learned_addr learned my addr 172.21.15.112:0/4293027051 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:28.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.242+0000 7f48ff400640 1 --2- 172.21.15.112:0/4293027051 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f490015b9d0 0x7f49000b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:28.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.242+0000 7f48f6a00640 1 --2- 172.21.15.112:0/4293027051 >> v2:172.21.15.137:3300/0 conn(0x7f49000b45d0 0x7f49000728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:28.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.242+0000 7f48fea00640 1 -- 172.21.15.112:0/4293027051 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 127320660 0 0) 0x7f49000b54a0 con 0x7f490006eef0 2024-09-12T02:47:28.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.242+0000 7f48fea00640 1 -- 172.21.15.112:0/4293027051 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48e4003520 con 0x7f490006eef0 2024-09-12T02:47:28.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.242+0000 7f48ff400640 1 -- 172.21.15.112:0/4293027051 >> v2:172.21.15.137:3300/0 conn(0x7f49000b45d0 msgr2=0x7f49000728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:28.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.242+0000 7f48ff400640 1 --2- 172.21.15.112:0/4293027051 >> v2:172.21.15.137:3300/0 conn(0x7f49000b45d0 0x7f49000728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.242+0000 7f48ff400640 1 -- 172.21.15.112:0/4293027051 >> v1:172.21.15.112:6789/0 conn(0x7f490006eef0 legacy=0x7f490006f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:28.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.242+0000 7f48ff400640 1 -- 172.21.15.112:0/4293027051 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49000b3dd0 con 0x7f490015b9d0 2024-09-12T02:47:28.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.242+0000 7f48f6a00640 1 --2- 172.21.15.112:0/4293027051 >> v2:172.21.15.137:3300/0 conn(0x7f49000b45d0 0x7f49000728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:28.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.244+0000 7f48ff400640 1 --2- 172.21.15.112:0/4293027051 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f490015b9d0 0x7f49000b4ec0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f48f00097a0 tx=0x7f48f002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64c7ff4b79751df2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:28.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.244+0000 7f48fea00640 1 -- 172.21.15.112:0/4293027051 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f0037070 con 0x7f490015b9d0 2024-09-12T02:47:28.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.244+0000 7f48fea00640 1 -- 172.21.15.112:0/4293027051 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48f0032440 con 0x7f490015b9d0 2024-09-12T02:47:28.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.244+0000 7f48fea00640 1 -- 172.21.15.112:0/4293027051 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f0032810 con 0x7f490015b9d0 2024-09-12T02:47:28.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.244+0000 7f4906000640 1 -- 172.21.15.112:0/4293027051 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f490015b9d0 msgr2=0x7f49000b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:28.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.244+0000 7f4906000640 1 --2- 172.21.15.112:0/4293027051 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f490015b9d0 0x7f49000b4ec0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f48f00097a0 tx=0x7f48f002a180 comp rx=0 tx=0).stop 2024-09-12T02:47:28.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.244+0000 7f4906000640 1 -- 172.21.15.112:0/4293027051 shutdown_connections 2024-09-12T02:47:28.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.244+0000 7f4906000640 1 --2- 172.21.15.112:0/4293027051 >> v2:172.21.15.137:3300/0 conn(0x7f49000b45d0 0x7f49000728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.244+0000 7f4906000640 1 --2- 172.21.15.112:0/4293027051 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f490015b9d0 0x7f49000b4ec0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.245+0000 7f4906000640 1 -- 172.21.15.112:0/4293027051 >> 172.21.15.112:0/4293027051 conn(0x7f490006bbd0 msgr2=0x7f490006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:28.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.245+0000 7f4906000640 1 -- 172.21.15.112:0/4293027051 shutdown_connections 2024-09-12T02:47:28.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.245+0000 7f4906000640 1 -- 172.21.15.112:0/4293027051 wait complete. 2024-09-12T02:47:28.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.246+0000 7f4906000640 1 Processor -- start 2024-09-12T02:47:28.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.246+0000 7f4906000640 1 -- start start 2024-09-12T02:47:28.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.247+0000 7f4906000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f490006eef0 0x7f49001f5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:28.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.247+0000 7f4906000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49000b45d0 0x7f49001f4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:28.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.247+0000 7f4906000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f490015b9d0 0x7f4900152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:28.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.247+0000 7f4906000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f490015bf30 con 0x7f490006eef0 2024-09-12T02:47:28.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.247+0000 7f4906000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f490015bdb0 con 0x7f490015b9d0 2024-09-12T02:47:28.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.247+0000 7f4906000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f49000cdcd0 con 0x7f49000b45d0 2024-09-12T02:47:28.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.248+0000 7f48ff400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f490006eef0 0x7f49001f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:28.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.248+0000 7f48ff400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f490006eef0 0x7f49001f5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37512/0 (socket says 172.21.15.112:37512) 2024-09-12T02:47:28.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.248+0000 7f48ff400640 1 -- 172.21.15.112:0/3712502110 learned_addr learned my addr 172.21.15.112:0/3712502110 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:28.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.248+0000 7f48f6a00640 1 --2- 172.21.15.112:0/3712502110 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49000b45d0 0x7f49001f4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:28.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.248+0000 7f48ffe00640 1 --2- 172.21.15.112:0/3712502110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f490015b9d0 0x7f4900152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:28.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.248+0000 7f48ff400640 1 -- 172.21.15.112:0/3712502110 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49000b45d0 msgr2=0x7f49001f4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:28.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.248+0000 7f48ff400640 1 --2- 172.21.15.112:0/3712502110 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49000b45d0 0x7f49001f4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.248+0000 7f48ff400640 1 -- 172.21.15.112:0/3712502110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f490015b9d0 msgr2=0x7f4900152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:28.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.248+0000 7f48ff400640 1 --2- 172.21.15.112:0/3712502110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f490015b9d0 0x7f4900152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.248+0000 7f48ff400640 1 -- 172.21.15.112:0/3712502110 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49001f6420 con 0x7f490006eef0 2024-09-12T02:47:28.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.248+0000 7f48ffe00640 1 --2- 172.21.15.112:0/3712502110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f490015b9d0 0x7f4900152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:28.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.248+0000 7f48ff400640 1 --2- 172.21.15.112:0/3712502110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f490006eef0 0x7f49001f5ee0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f48f0035040 tx=0x7f48f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:28.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.249+0000 7f48f7e00640 1 -- 172.21.15.112:0/3712502110 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f0041030 con 0x7f490006eef0 2024-09-12T02:47:28.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.249+0000 7f48f7e00640 1 -- 172.21.15.112:0/3712502110 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48f003d4e0 con 0x7f490006eef0 2024-09-12T02:47:28.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.249+0000 7f48f7e00640 1 -- 172.21.15.112:0/3712502110 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f0037040 con 0x7f490006eef0 2024-09-12T02:47:28.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.249+0000 7f4906000640 1 -- 172.21.15.112:0/3712502110 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4900153a00 con 0x7f490006eef0 2024-09-12T02:47:28.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.249+0000 7f4906000640 1 -- 172.21.15.112:0/3712502110 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49001f56e0 con 0x7f490006eef0 2024-09-12T02:47:28.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.250+0000 7f4906000640 1 -- 172.21.15.112:0/3712502110 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f490006dbc0 con 0x7f490006eef0 2024-09-12T02:47:28.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.251+0000 7f48f7e00640 1 -- 172.21.15.112:0/3712502110 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f48f0044070 con 0x7f490006eef0 2024-09-12T02:47:28.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.252+0000 7f48f7e00640 1 --2- 172.21.15.112:0/3712502110 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f48dc06be30 0x7f48dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:28.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.252+0000 7f48f7e00640 1 -- 172.21.15.112:0/3712502110 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5709+0+0 (secure 0 0 0) 0x7f48f00ab430 con 0x7f490006eef0 2024-09-12T02:47:28.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.252+0000 7f48f6a00640 1 --2- 172.21.15.112:0/3712502110 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f48dc06be30 0x7f48dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:28.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.252+0000 7f48f6a00640 1 --2- 172.21.15.112:0/3712502110 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f48dc06be30 0x7f48dc06e2f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f48e8009500 tx=0x7f48e8009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:28.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.256+0000 7f48f7e00640 1 -- 172.21.15.112:0/3712502110 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f48f0079df0 con 0x7f490006eef0 2024-09-12T02:47:28.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.429+0000 7f4906000640 1 -- 172.21.15.112:0/3712502110 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f490015eef0 con 0x7f490006eef0 2024-09-12T02:47:28.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.430+0000 7f48f7e00640 1 -- 172.21.15.112:0/3712502110 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) ==== 74+0+16741 (secure 0 0 0) 0x7f48f00796f0 con 0x7f490006eef0 2024-09-12T02:47:28.431 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:28.432 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":119,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:47:27.076469+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:47:24.847347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-12T02:47:26.073460+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:47:28.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.433+0000 7f4906000640 1 -- 172.21.15.112:0/3712502110 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f48dc06be30 msgr2=0x7f48dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:28.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.433+0000 7f4906000640 1 --2- 172.21.15.112:0/3712502110 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f48dc06be30 0x7f48dc06e2f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f48e8009500 tx=0x7f48e8009110 comp rx=0 tx=0).stop 2024-09-12T02:47:28.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.433+0000 7f4906000640 1 -- 172.21.15.112:0/3712502110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f490006eef0 msgr2=0x7f49001f5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:28.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.433+0000 7f4906000640 1 --2- 172.21.15.112:0/3712502110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f490006eef0 0x7f49001f5ee0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f48f0035040 tx=0x7f48f00046c0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.433+0000 7f4906000640 1 -- 172.21.15.112:0/3712502110 shutdown_connections 2024-09-12T02:47:28.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.433+0000 7f4906000640 1 --2- 172.21.15.112:0/3712502110 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f48dc06be30 0x7f48dc06e2f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.433+0000 7f4906000640 1 --2- 172.21.15.112:0/3712502110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f490015b9d0 0x7f4900152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.433+0000 7f4906000640 1 --2- 172.21.15.112:0/3712502110 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49000b45d0 0x7f49001f4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.433+0000 7f4906000640 1 --2- 172.21.15.112:0/3712502110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f490006eef0 0x7f49001f5ee0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.433+0000 7f4906000640 1 -- 172.21.15.112:0/3712502110 >> 172.21.15.112:0/3712502110 conn(0x7f490006bbd0 msgr2=0x7f4900159dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:28.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.433+0000 7f4906000640 1 -- 172.21.15.112:0/3712502110 shutdown_connections 2024-09-12T02:47:28.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.433+0000 7f4906000640 1 -- 172.21.15.112:0/3712502110 wait complete. 2024-09-12T02:47:28.450 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T02:47:28.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.603+0000 7f00e7e00640 1 Processor -- start 2024-09-12T02:47:28.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.603+0000 7f00e7e00640 1 -- start start 2024-09-12T02:47:28.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.604+0000 7f00e7e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00e00b5850 0x7f00e006e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:28.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.605+0000 7f00e7e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f00e006e970 0x7f00e0164de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:28.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.605+0000 7f00e7e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00e015b6a0 con 0x7f00e006e050 2024-09-12T02:47:28.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.605+0000 7f00e7e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f00e00b43b0 con 0x7f00e006e970 2024-09-12T02:47:28.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.605+0000 7f00e7e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f00e00b3a80 con 0x7f00e00b5850 2024-09-12T02:47:28.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.605+0000 7f00e5400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f00e006e050 0x7f00e00cfff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:37512/0 (socket says 172.21.15.112:37512) 2024-09-12T02:47:28.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.605+0000 7f00e5400640 1 -- 172.21.15.112:0/2664559464 learned_addr learned my addr 172.21.15.112:0/2664559464 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:28.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.605+0000 7f00e5e00640 1 --2- 172.21.15.112:0/2664559464 >> v2:172.21.15.112:3300/0 conn(0x7f00e006e970 0x7f00e0164de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:28.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.605+0000 7f00e4a00640 1 --2- 172.21.15.112:0/2664559464 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00e00b5850 0x7f00e006e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:28.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.605+0000 7f00e5e00640 1 -- 172.21.15.112:0/2664559464 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00e00b5850 msgr2=0x7f00e006e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:28.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.605+0000 7f00e5e00640 1 --2- 172.21.15.112:0/2664559464 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00e00b5850 0x7f00e006e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.605+0000 7f00e5e00640 1 -- 172.21.15.112:0/2664559464 >> v1:172.21.15.112:6789/0 conn(0x7f00e006e050 legacy=0x7f00e00cfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:28.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.605+0000 7f00dfe00640 1 -- 172.21.15.112:0/2664559464 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2183830874 0 0) 0x7f00e015b6a0 con 0x7f00e006e050 2024-09-12T02:47:28.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.605+0000 7f00e5e00640 1 -- 172.21.15.112:0/2664559464 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e00b3d60 con 0x7f00e006e970 2024-09-12T02:47:28.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.606+0000 7f00e5e00640 1 --2- 172.21.15.112:0/2664559464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00e006e970 0x7f00e0164de0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f00d8009d90 tx=0x7f00d802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b643354e13b71ab1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:28.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.607+0000 7f00dfe00640 1 -- 172.21.15.112:0/2664559464 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d8007740 con 0x7f00e006e970 2024-09-12T02:47:28.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.607+0000 7f00dfe00640 1 -- 172.21.15.112:0/2664559464 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00d80078e0 con 0x7f00e006e970 2024-09-12T02:47:28.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.607+0000 7f00dfe00640 1 -- 172.21.15.112:0/2664559464 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d8007cb0 con 0x7f00e006e970 2024-09-12T02:47:28.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.607+0000 7f00e7e00640 1 -- 172.21.15.112:0/2664559464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00e006e970 msgr2=0x7f00e0164de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:28.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.607+0000 7f00e7e00640 1 --2- 172.21.15.112:0/2664559464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00e006e970 0x7f00e0164de0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f00d8009d90 tx=0x7f00d802a660 comp rx=0 tx=0).stop 2024-09-12T02:47:28.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.607+0000 7f00e7e00640 1 -- 172.21.15.112:0/2664559464 shutdown_connections 2024-09-12T02:47:28.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.607+0000 7f00e7e00640 1 --2- 172.21.15.112:0/2664559464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00e006e970 0x7f00e0164de0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.607+0000 7f00e7e00640 1 --2- 172.21.15.112:0/2664559464 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00e00b5850 0x7f00e006e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.607+0000 7f00e7e00640 1 -- 172.21.15.112:0/2664559464 >> 172.21.15.112:0/2664559464 conn(0x7f00e006bbd0 msgr2=0x7f00e006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:28.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.607+0000 7f00e7e00640 1 -- 172.21.15.112:0/2664559464 shutdown_connections 2024-09-12T02:47:28.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.607+0000 7f00e7e00640 1 -- 172.21.15.112:0/2664559464 wait complete. 2024-09-12T02:47:28.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.609+0000 7f00e7e00640 1 Processor -- start 2024-09-12T02:47:28.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.609+0000 7f00e7e00640 1 -- start start 2024-09-12T02:47:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.610+0000 7f00e7e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00e006e050 0x7f00e014ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.610+0000 7f00e7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00e006e970 0x7f00e00cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.610+0000 7f00e7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00e00b5850 0x7f00e00aaf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.610+0000 7f00e7e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f00e0072170 con 0x7f00e00b5850 2024-09-12T02:47:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.610+0000 7f00e7e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f00e0071ff0 con 0x7f00e006e970 2024-09-12T02:47:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.610+0000 7f00e7e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f00e00722f0 con 0x7f00e006e050 2024-09-12T02:47:28.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.610+0000 7f00e5e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00e00b5850 0x7f00e00aaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:28.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.610+0000 7f00e5e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00e00b5850 0x7f00e00aaf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37538/0 (socket says 172.21.15.112:37538) 2024-09-12T02:47:28.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.610+0000 7f00e5e00640 1 -- 172.21.15.112:0/4229394340 learned_addr learned my addr 172.21.15.112:0/4229394340 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:28.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.610+0000 7f00e5400640 1 --2- 172.21.15.112:0/4229394340 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00e006e050 0x7f00e014ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:28.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.610+0000 7f00e4a00640 1 --2- 172.21.15.112:0/4229394340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00e006e970 0x7f00e00cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:28.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.611+0000 7f00e5e00640 1 -- 172.21.15.112:0/4229394340 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00e006e050 msgr2=0x7f00e014ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:28.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.611+0000 7f00e5e00640 1 --2- 172.21.15.112:0/4229394340 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00e006e050 0x7f00e014ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.611+0000 7f00e5e00640 1 -- 172.21.15.112:0/4229394340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00e006e970 msgr2=0x7f00e00cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:28.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.611+0000 7f00e5e00640 1 --2- 172.21.15.112:0/4229394340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00e006e970 0x7f00e00cfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.611+0000 7f00e5e00640 1 -- 172.21.15.112:0/4229394340 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e014b3a0 con 0x7f00e00b5850 2024-09-12T02:47:28.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.611+0000 7f00e5400640 1 --2- 172.21.15.112:0/4229394340 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00e006e050 0x7f00e014ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:28.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.611+0000 7f00e5e00640 1 --2- 172.21.15.112:0/4229394340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00e00b5850 0x7f00e00aaf30 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f00d802a6a0 tx=0x7f00d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:28.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.611+0000 7f00dd600640 1 -- 172.21.15.112:0/4229394340 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d8040070 con 0x7f00e00b5850 2024-09-12T02:47:28.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.611+0000 7f00dd600640 1 -- 172.21.15.112:0/4229394340 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00d8031bc0 con 0x7f00e00b5850 2024-09-12T02:47:28.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.611+0000 7f00dd600640 1 -- 172.21.15.112:0/4229394340 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d8009450 con 0x7f00e00b5850 2024-09-12T02:47:28.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.611+0000 7f00e7e00640 1 -- 172.21.15.112:0/4229394340 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00e01487b0 con 0x7f00e00b5850 2024-09-12T02:47:28.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.611+0000 7f00e7e00640 1 -- 172.21.15.112:0/4229394340 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00e0148d70 con 0x7f00e00b5850 2024-09-12T02:47:28.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.612+0000 7f00e7e00640 1 -- 172.21.15.112:0/4229394340 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00e006e430 con 0x7f00e00b5850 2024-09-12T02:47:28.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.613+0000 7f00dd600640 1 -- 172.21.15.112:0/4229394340 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f00d8039040 con 0x7f00e00b5850 2024-09-12T02:47:28.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.614+0000 7f00dd600640 1 --2- 172.21.15.112:0/4229394340 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f00c006be60 0x7f00c006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:28.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.614+0000 7f00dd600640 1 -- 172.21.15.112:0/4229394340 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5709+0+0 (secure 0 0 0) 0x7f00d80ac080 con 0x7f00e00b5850 2024-09-12T02:47:28.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.614+0000 7f00e5400640 1 --2- 172.21.15.112:0/4229394340 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f00c006be60 0x7f00c006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:28.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.615+0000 7f00e5400640 1 --2- 172.21.15.112:0/4229394340 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f00c006be60 0x7f00c006e320 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f00d4000f60 tx=0x7f00d4007ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:28.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.618+0000 7f00dd600640 1 -- 172.21.15.112:0/4229394340 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f00d807a340 con 0x7f00e00b5850 2024-09-12T02:47:28.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:28.835+0000 7f00e7e00640 1 -- 172.21.15.112:0/4229394340 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f00e00763b0 con 0x7f00e00b5850 2024-09-12T02:47:29.658 INFO:tasks.ceph.mds.a.smithi112.stderr:2024-09-12T02:47:29.657+0000 7fa082a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:47:29.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.714+0000 7f00dd600640 1 -- 172.21.15.112:0/4229394340 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v61) ==== 118+0+0 (secure 0 0 0) 0x7f00d807e640 con 0x7f00e00b5850 2024-09-12T02:47:29.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.717+0000 7f00e7e00640 1 -- 172.21.15.112:0/4229394340 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f00c006be60 msgr2=0x7f00c006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:29.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.717+0000 7f00e7e00640 1 --2- 172.21.15.112:0/4229394340 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f00c006be60 0x7f00c006e320 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f00d4000f60 tx=0x7f00d4007ca0 comp rx=0 tx=0).stop 2024-09-12T02:47:29.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.717+0000 7f00e7e00640 1 -- 172.21.15.112:0/4229394340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00e00b5850 msgr2=0x7f00e00aaf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:29.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.717+0000 7f00e7e00640 1 --2- 172.21.15.112:0/4229394340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00e00b5850 0x7f00e00aaf30 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f00d802a6a0 tx=0x7f00d8004a40 comp rx=0 tx=0).stop 2024-09-12T02:47:29.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.717+0000 7f00e7e00640 1 -- 172.21.15.112:0/4229394340 shutdown_connections 2024-09-12T02:47:29.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.717+0000 7f00e7e00640 1 --2- 172.21.15.112:0/4229394340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00e00b5850 0x7f00e00aaf30 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:29.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.717+0000 7f00e7e00640 1 --2- 172.21.15.112:0/4229394340 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f00c006be60 0x7f00c006e320 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:29.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.717+0000 7f00e7e00640 1 --2- 172.21.15.112:0/4229394340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00e006e970 0x7f00e00cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:29.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.717+0000 7f00e7e00640 1 --2- 172.21.15.112:0/4229394340 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00e006e050 0x7f00e014ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:29.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.717+0000 7f00e7e00640 1 -- 172.21.15.112:0/4229394340 >> 172.21.15.112:0/4229394340 conn(0x7f00e006bbd0 msgr2=0x7f00e015db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:29.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.717+0000 7f00e7e00640 1 -- 172.21.15.112:0/4229394340 shutdown_connections 2024-09-12T02:47:29.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.717+0000 7f00e7e00640 1 -- 172.21.15.112:0/4229394340 wait complete. 2024-09-12T02:47:29.737 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T02:47:29.737 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T02:47:29.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.896+0000 7ff6ec800640 1 Processor -- start 2024-09-12T02:47:29.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.897+0000 7ff6ec800640 1 -- start start 2024-09-12T02:47:29.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.898+0000 7ff6ec800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff6e415cc50 0x7ff6e40732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:29.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.898+0000 7ff6ec800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff6e4071530 0x7ff6e40af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:29.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.898+0000 7ff6ec800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6e4073830 con 0x7ff6e40719a0 2024-09-12T02:47:29.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.898+0000 7ff6ec800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff6e415d030 con 0x7ff6e4071530 2024-09-12T02:47:29.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.898+0000 7ff6ec800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff6e40cf4c0 con 0x7ff6e415cc50 2024-09-12T02:47:29.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.898+0000 7ff6e9400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff6e4071530 0x7ff6e40af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:29.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.898+0000 7ff6ea800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff6e40719a0 0x7ff6e40cf950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:37514/0 (socket says 172.21.15.112:37514) 2024-09-12T02:47:29.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.898+0000 7ff6ea800640 1 -- 172.21.15.112:0/1391335429 learned_addr learned my addr 172.21.15.112:0/1391335429 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:29.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.898+0000 7ff6e9e00640 1 --2- 172.21.15.112:0/1391335429 >> v2:172.21.15.137:3300/0 conn(0x7ff6e415cc50 0x7ff6e40732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:29.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.898+0000 7ff6e9400640 1 -- 172.21.15.112:0/1391335429 >> v2:172.21.15.137:3300/0 conn(0x7ff6e415cc50 msgr2=0x7ff6e40732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:29.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.898+0000 7ff6e9400640 1 --2- 172.21.15.112:0/1391335429 >> v2:172.21.15.137:3300/0 conn(0x7ff6e415cc50 0x7ff6e40732f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:29.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.899+0000 7ff6e9400640 1 -- 172.21.15.112:0/1391335429 >> v1:172.21.15.112:6789/0 conn(0x7ff6e40719a0 legacy=0x7ff6e40cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:29.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.899+0000 7ff6e8a00640 1 -- 172.21.15.112:0/1391335429 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2314151133 0 0) 0x7ff6e0001490 con 0x7ff6e40719a0 2024-09-12T02:47:29.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.899+0000 7ff6e9400640 1 -- 172.21.15.112:0/1391335429 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e40ceeb0 con 0x7ff6e4071530 2024-09-12T02:47:29.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.900+0000 7ff6e9400640 1 --2- 172.21.15.112:0/1391335429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6e4071530 0x7ff6e40af720 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4070060 tx=0x7ff6d402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66047fbecaad1974 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:29.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.900+0000 7ff6e8a00640 1 -- 172.21.15.112:0/1391335429 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4037070 con 0x7ff6e4071530 2024-09-12T02:47:29.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.900+0000 7ff6e8a00640 1 -- 172.21.15.112:0/1391335429 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6d4032440 con 0x7ff6e4071530 2024-09-12T02:47:29.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.900+0000 7ff6e8a00640 1 -- 172.21.15.112:0/1391335429 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d402ae60 con 0x7ff6e4071530 2024-09-12T02:47:29.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.900+0000 7ff6ec800640 1 -- 172.21.15.112:0/1391335429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6e4071530 msgr2=0x7ff6e40af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:29.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.900+0000 7ff6ec800640 1 --2- 172.21.15.112:0/1391335429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6e4071530 0x7ff6e40af720 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4070060 tx=0x7ff6d402a110 comp rx=0 tx=0).stop 2024-09-12T02:47:29.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.900+0000 7ff6ec800640 1 -- 172.21.15.112:0/1391335429 shutdown_connections 2024-09-12T02:47:29.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.900+0000 7ff6ec800640 1 --2- 172.21.15.112:0/1391335429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6e4071530 0x7ff6e40af720 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:29.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.900+0000 7ff6ec800640 1 --2- 172.21.15.112:0/1391335429 >> v2:172.21.15.137:3300/0 conn(0x7ff6e415cc50 0x7ff6e40732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:29.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.900+0000 7ff6ec800640 1 -- 172.21.15.112:0/1391335429 >> 172.21.15.112:0/1391335429 conn(0x7ff6e406bbd0 msgr2=0x7ff6e406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:29.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.900+0000 7ff6ec800640 1 -- 172.21.15.112:0/1391335429 shutdown_connections 2024-09-12T02:47:29.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.900+0000 7ff6ec800640 1 -- 172.21.15.112:0/1391335429 wait complete. 2024-09-12T02:47:29.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.902+0000 7ff6ec800640 1 Processor -- start 2024-09-12T02:47:29.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.902+0000 7ff6ec800640 1 -- start start 2024-09-12T02:47:29.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.903+0000 7ff6ec800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6e4071530 0x7ff6e41521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:29.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.903+0000 7ff6ec800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6e40719a0 0x7ff6e41f3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:29.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.903+0000 7ff6ec800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6e415cc50 0x7ff6e41f37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:29.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.903+0000 7ff6ec800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e40cf150 con 0x7ff6e40719a0 2024-09-12T02:47:29.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.903+0000 7ff6ec800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e406e5e0 con 0x7ff6e4071530 2024-09-12T02:47:29.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.903+0000 7ff6ec800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff6e406f510 con 0x7ff6e415cc50 2024-09-12T02:47:29.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.903+0000 7ff6e9400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6e40719a0 0x7ff6e41f3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:29.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.903+0000 7ff6e9400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6e40719a0 0x7ff6e41f3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37544/0 (socket says 172.21.15.112:37544) 2024-09-12T02:47:29.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.903+0000 7ff6e9400640 1 -- 172.21.15.112:0/339665620 learned_addr learned my addr 172.21.15.112:0/339665620 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:29.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.904+0000 7ff6ea800640 1 --2- 172.21.15.112:0/339665620 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6e415cc50 0x7ff6e41f37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:29.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.904+0000 7ff6e9400640 1 -- 172.21.15.112:0/339665620 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6e415cc50 msgr2=0x7ff6e41f37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:29.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.904+0000 7ff6e9e00640 1 --2- 172.21.15.112:0/339665620 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6e4071530 0x7ff6e41521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:29.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.904+0000 7ff6e9400640 1 --2- 172.21.15.112:0/339665620 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6e415cc50 0x7ff6e41f37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:29.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.904+0000 7ff6e9400640 1 -- 172.21.15.112:0/339665620 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6e4071530 msgr2=0x7ff6e41521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:29.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.904+0000 7ff6e9400640 1 --2- 172.21.15.112:0/339665620 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6e4071530 0x7ff6e41521e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:29.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.904+0000 7ff6e9400640 1 -- 172.21.15.112:0/339665620 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e4152bc0 con 0x7ff6e40719a0 2024-09-12T02:47:29.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.904+0000 7ff6e9e00640 1 --2- 172.21.15.112:0/339665620 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6e4071530 0x7ff6e41521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:29.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.904+0000 7ff6ea800640 1 --2- 172.21.15.112:0/339665620 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6e415cc50 0x7ff6e41f37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:29.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.904+0000 7ff6e9400640 1 --2- 172.21.15.112:0/339665620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6e40719a0 0x7ff6e41f3290 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4000c00 tx=0x7ff6d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:29.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.904+0000 7ff6de000640 1 -- 172.21.15.112:0/339665620 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4042020 con 0x7ff6e40719a0 2024-09-12T02:47:29.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.904+0000 7ff6de000640 1 -- 172.21.15.112:0/339665620 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6d4038040 con 0x7ff6e40719a0 2024-09-12T02:47:29.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.904+0000 7ff6ec800640 1 -- 172.21.15.112:0/339665620 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6e4152ea0 con 0x7ff6e40719a0 2024-09-12T02:47:29.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.904+0000 7ff6de000640 1 -- 172.21.15.112:0/339665620 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4037050 con 0x7ff6e40719a0 2024-09-12T02:47:29.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.904+0000 7ff6ec800640 1 -- 172.21.15.112:0/339665620 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6e4153460 con 0x7ff6e40719a0 2024-09-12T02:47:29.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.905+0000 7ff6ec800640 1 -- 172.21.15.112:0/339665620 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6e4068a30 con 0x7ff6e40719a0 2024-09-12T02:47:29.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.906+0000 7ff6de000640 1 -- 172.21.15.112:0/339665620 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff6d4005990 con 0x7ff6e40719a0 2024-09-12T02:47:29.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.907+0000 7ff6de000640 1 --2- 172.21.15.112:0/339665620 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff6c806be30 0x7ff6c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:29.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.908+0000 7ff6de000640 1 -- 172.21.15.112:0/339665620 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7ff6d40ab800 con 0x7ff6e40719a0 2024-09-12T02:47:29.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.908+0000 7ff6e9e00640 1 --2- 172.21.15.112:0/339665620 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff6c806be30 0x7ff6c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:29.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.908+0000 7ff6e9e00640 1 --2- 172.21.15.112:0/339665620 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff6c806be30 0x7ff6c806e2f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8006fd0 tx=0x7ff6d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:29.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:29.911+0000 7ff6de000640 1 -- 172.21.15.112:0/339665620 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff6d404c020 con 0x7ff6e40719a0 2024-09-12T02:47:30.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.115+0000 7ff6ec800640 1 -- 172.21.15.112:0/339665620 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff6e406df60 con 0x7ff6e40719a0 2024-09-12T02:47:30.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.716+0000 7ff6de000640 1 -- 172.21.15.112:0/339665620 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v62) ==== 122+0+0 (secure 0 0 0) 0x7ff6d407a1a0 con 0x7ff6e40719a0 2024-09-12T02:47:30.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.719+0000 7ff6ec800640 1 -- 172.21.15.112:0/339665620 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff6c806be30 msgr2=0x7ff6c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:30.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.719+0000 7ff6ec800640 1 --2- 172.21.15.112:0/339665620 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff6c806be30 0x7ff6c806e2f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8006fd0 tx=0x7ff6d8008040 comp rx=0 tx=0).stop 2024-09-12T02:47:30.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.719+0000 7ff6ec800640 1 -- 172.21.15.112:0/339665620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6e40719a0 msgr2=0x7ff6e41f3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:30.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.719+0000 7ff6ec800640 1 --2- 172.21.15.112:0/339665620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6e40719a0 0x7ff6e41f3290 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4000c00 tx=0x7ff6d40046c0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.719+0000 7ff6ec800640 1 -- 172.21.15.112:0/339665620 shutdown_connections 2024-09-12T02:47:30.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.719+0000 7ff6ec800640 1 --2- 172.21.15.112:0/339665620 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6e415cc50 0x7ff6e41f37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.719+0000 7ff6ec800640 1 --2- 172.21.15.112:0/339665620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6e40719a0 0x7ff6e41f3290 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.719+0000 7ff6ec800640 1 --2- 172.21.15.112:0/339665620 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff6c806be30 0x7ff6c806e2f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.719+0000 7ff6ec800640 1 --2- 172.21.15.112:0/339665620 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6e4071530 0x7ff6e41521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.719+0000 7ff6ec800640 1 -- 172.21.15.112:0/339665620 >> 172.21.15.112:0/339665620 conn(0x7ff6e406bbd0 msgr2=0x7ff6e4158ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:30.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.719+0000 7ff6ec800640 1 -- 172.21.15.112:0/339665620 shutdown_connections 2024-09-12T02:47:30.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.719+0000 7ff6ec800640 1 -- 172.21.15.112:0/339665620 wait complete. 2024-09-12T02:47:30.738 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T02:47:30.738 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:47:30.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.891+0000 7f2098600640 1 Processor -- start 2024-09-12T02:47:30.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.892+0000 7f2098600640 1 -- start start 2024-09-12T02:47:30.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.893+0000 7f2098600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f20901624e0 0x7f20900d58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:30.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.893+0000 7f2098600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f20900d0510 0x7f20900d0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:30.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.893+0000 7f2098600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20900cfa70 con 0x7f2090162100 2024-09-12T02:47:30.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.893+0000 7f2098600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f20900b4e20 con 0x7f20900d0510 2024-09-12T02:47:30.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.893+0000 7f2098600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f20900d21d0 con 0x7f20901624e0 2024-09-12T02:47:30.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.893+0000 7f2095200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f20901624e0 0x7f20900d58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:30.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.893+0000 7f2095c00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f2090162100 0x7f20900b4710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.112:35752/0 (socket says 172.21.15.112:35752) 2024-09-12T02:47:30.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.893+0000 7f2095200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f20901624e0 0x7f20900d58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:58308/0 (socket says 172.21.15.112:58308) 2024-09-12T02:47:30.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.893+0000 7f2095c00640 1 -- 172.21.15.112:0/3048833738 learned_addr learned my addr 172.21.15.112:0/3048833738 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:30.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.893+0000 7f2096600640 1 --2- 172.21.15.112:0/3048833738 >> v2:172.21.15.137:3300/0 conn(0x7f20900d0510 0x7f20900d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:30.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.894+0000 7f2095200640 1 -- 172.21.15.112:0/3048833738 >> v2:172.21.15.137:3300/0 conn(0x7f20900d0510 msgr2=0x7f20900d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:30.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.894+0000 7f2095200640 1 --2- 172.21.15.112:0/3048833738 >> v2:172.21.15.137:3300/0 conn(0x7f20900d0510 0x7f20900d0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.894+0000 7f2095200640 1 -- 172.21.15.112:0/3048833738 >> v1:172.21.15.137:6789/0 conn(0x7f2090162100 legacy=0x7f20900b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:30.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.894+0000 7f2095200640 1 -- 172.21.15.112:0/3048833738 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20900d24b0 con 0x7f20901624e0 2024-09-12T02:47:30.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.894+0000 7f2096600640 1 --2- 172.21.15.112:0/3048833738 >> v2:172.21.15.137:3300/0 conn(0x7f20900d0510 0x7f20900d0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:30.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.895+0000 7f2095200640 1 --2- 172.21.15.112:0/3048833738 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f20901624e0 0x7f20900d58d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f207c0097a0 tx=0x7f207c02a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88b11e9a25ddfe45 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:30.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.895+0000 7f208fe00640 1 -- 172.21.15.112:0/3048833738 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c037070 con 0x7f20901624e0 2024-09-12T02:47:30.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.895+0000 7f208fe00640 1 -- 172.21.15.112:0/3048833738 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f207c02ae40 con 0x7f20901624e0 2024-09-12T02:47:30.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.895+0000 7f208fe00640 1 -- 172.21.15.112:0/3048833738 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c032660 con 0x7f20901624e0 2024-09-12T02:47:30.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.895+0000 7f2098600640 1 -- 172.21.15.112:0/3048833738 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f20901624e0 msgr2=0x7f20900d58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:30.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.895+0000 7f2098600640 1 --2- 172.21.15.112:0/3048833738 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f20901624e0 0x7f20900d58d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f207c0097a0 tx=0x7f207c02a0f0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.896+0000 7f2098600640 1 -- 172.21.15.112:0/3048833738 shutdown_connections 2024-09-12T02:47:30.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.896+0000 7f2098600640 1 --2- 172.21.15.112:0/3048833738 >> v2:172.21.15.137:3300/0 conn(0x7f20900d0510 0x7f20900d0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.896+0000 7f2098600640 1 --2- 172.21.15.112:0/3048833738 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f20901624e0 0x7f20900d58d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.896+0000 7f2098600640 1 -- 172.21.15.112:0/3048833738 >> 172.21.15.112:0/3048833738 conn(0x7f20900d4db0 msgr2=0x7f20900d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:30.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.896+0000 7f2098600640 1 -- 172.21.15.112:0/3048833738 shutdown_connections 2024-09-12T02:47:30.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.896+0000 7f2098600640 1 -- 172.21.15.112:0/3048833738 wait complete. 2024-09-12T02:47:30.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.897+0000 7f2098600640 1 Processor -- start 2024-09-12T02:47:30.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.897+0000 7f2098600640 1 -- start start 2024-09-12T02:47:30.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.898+0000 7f2098600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20900d0510 0x7f20900cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:30.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.898+0000 7f2098600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2090162100 0x7f20900b8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:30.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.898+0000 7f2098600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f20901624e0 0x7f209014af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:30.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.898+0000 7f2098600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f20900d0ea0 con 0x7f2090162100 2024-09-12T02:47:30.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.898+0000 7f2098600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f20900cfff0 con 0x7f20900d0510 2024-09-12T02:47:30.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.898+0000 7f2098600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f20900d1df0 con 0x7f20901624e0 2024-09-12T02:47:30.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.898+0000 7f2095200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2090162100 0x7f20900b8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:30.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.898+0000 7f2095200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2090162100 0x7f20900b8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37546/0 (socket says 172.21.15.112:37546) 2024-09-12T02:47:30.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.898+0000 7f2095200640 1 -- 172.21.15.112:0/830959321 learned_addr learned my addr 172.21.15.112:0/830959321 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:30.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.899+0000 7f2095c00640 1 --2- 172.21.15.112:0/830959321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20900d0510 0x7f20900cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:30.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.899+0000 7f2096600640 1 --2- 172.21.15.112:0/830959321 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f20901624e0 0x7f209014af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:30.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.899+0000 7f2095200640 1 -- 172.21.15.112:0/830959321 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f20901624e0 msgr2=0x7f209014af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:30.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.899+0000 7f2095200640 1 --2- 172.21.15.112:0/830959321 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f20901624e0 0x7f209014af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.899+0000 7f2095200640 1 -- 172.21.15.112:0/830959321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20900d0510 msgr2=0x7f20900cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:30.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.899+0000 7f2095200640 1 --2- 172.21.15.112:0/830959321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20900d0510 0x7f20900cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.899+0000 7f2095200640 1 -- 172.21.15.112:0/830959321 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20900b9580 con 0x7f2090162100 2024-09-12T02:47:30.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.899+0000 7f2095200640 1 --2- 172.21.15.112:0/830959321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2090162100 0x7f20900b8c50 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f207c000c00 tx=0x7f207c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:30.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.900+0000 7f208d600640 1 -- 172.21.15.112:0/830959321 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c041070 con 0x7f2090162100 2024-09-12T02:47:30.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.900+0000 7f208d600640 1 -- 172.21.15.112:0/830959321 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f207c03c460 con 0x7f2090162100 2024-09-12T02:47:30.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.900+0000 7f208d600640 1 -- 172.21.15.112:0/830959321 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c037040 con 0x7f2090162100 2024-09-12T02:47:30.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.900+0000 7f2098600640 1 -- 172.21.15.112:0/830959321 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20900b9860 con 0x7f2090162100 2024-09-12T02:47:30.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.900+0000 7f2098600640 1 -- 172.21.15.112:0/830959321 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20900ba100 con 0x7f2090162100 2024-09-12T02:47:30.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.901+0000 7f2098600640 1 -- 172.21.15.112:0/830959321 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20900d0cc0 con 0x7f2090162100 2024-09-12T02:47:30.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.901+0000 7f208d600640 1 -- 172.21.15.112:0/830959321 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f207c044070 con 0x7f2090162100 2024-09-12T02:47:30.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.902+0000 7f208d600640 1 --2- 172.21.15.112:0/830959321 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f207006be30 0x7f207006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:30.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.902+0000 7f208d600640 1 -- 172.21.15.112:0/830959321 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7f207c0ab690 con 0x7f2090162100 2024-09-12T02:47:30.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.903+0000 7f2095c00640 1 --2- 172.21.15.112:0/830959321 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f207006be30 0x7f207006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:30.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.903+0000 7f2095c00640 1 --2- 172.21.15.112:0/830959321 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f207006be30 0x7f207006e2f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f20840012e0 tx=0x7f2084001990 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:30.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:30.907+0000 7f208d600640 1 -- 172.21.15.112:0/830959321 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f20900d0cc0 con 0x7f2090162100 2024-09-12T02:47:31.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.114+0000 7f2098600640 1 -- 172.21.15.112:0/830959321 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20900ba2d0 con 0x7f2090162100 2024-09-12T02:47:31.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.114+0000 7f208d600640 1 -- 172.21.15.112:0/830959321 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5231 (secure 0 0 0) 0x7f207c0798d0 con 0x7f2090162100 2024-09-12T02:47:31.116 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:31.116 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":62,"btime":"2024-09-12T02:47:30:715299+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5612,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/3181313801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3181313801},{"type":"v1","addr":"172.21.15.137:6834","nonce":3181313801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":5615,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2025494075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2025494075},{"type":"v1","addr":"172.21.15.137:6835","nonce":2025494075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6501,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3739674039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3739674039},{"type":"v1","addr":"172.21.15.112:6837","nonce":3739674039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:47:27.076883+0000","modified":"2024-09-12T02:47:30.117205+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6504},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6504":{"gid":6504,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/63450161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":63450161},{"type":"v1","addr":"172.21.15.112:6836","nonce":63450161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6504,"qdb_cluster":[6504]},"id":7}]} 2024-09-12T02:47:31.116 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 62 2024-09-12T02:47:31.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.117+0000 7f2098600640 1 -- 172.21.15.112:0/830959321 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f207006be30 msgr2=0x7f207006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:31.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.117+0000 7f2098600640 1 --2- 172.21.15.112:0/830959321 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f207006be30 0x7f207006e2f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f20840012e0 tx=0x7f2084001990 comp rx=0 tx=0).stop 2024-09-12T02:47:31.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.117+0000 7f2098600640 1 -- 172.21.15.112:0/830959321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2090162100 msgr2=0x7f20900b8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:31.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.117+0000 7f2098600640 1 --2- 172.21.15.112:0/830959321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2090162100 0x7f20900b8c50 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f207c000c00 tx=0x7f207c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.117+0000 7f2098600640 1 -- 172.21.15.112:0/830959321 shutdown_connections 2024-09-12T02:47:31.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.117+0000 7f2098600640 1 --2- 172.21.15.112:0/830959321 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f20901624e0 0x7f209014af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.117+0000 7f2098600640 1 --2- 172.21.15.112:0/830959321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2090162100 0x7f20900b8c50 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.117+0000 7f2098600640 1 --2- 172.21.15.112:0/830959321 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f207006be30 0x7f207006e2f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.117+0000 7f2098600640 1 --2- 172.21.15.112:0/830959321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20900d0510 0x7f20900cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.117+0000 7f2098600640 1 -- 172.21.15.112:0/830959321 >> 172.21.15.112:0/830959321 conn(0x7f20900d4db0 msgr2=0x7f20900b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:31.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.117+0000 7f2098600640 1 -- 172.21.15.112:0/830959321 shutdown_connections 2024-09-12T02:47:31.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.117+0000 7f2098600640 1 -- 172.21.15.112:0/830959321 wait complete. 2024-09-12T02:47:31.133 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:47:31.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.286+0000 7f0474800640 1 Processor -- start 2024-09-12T02:47:31.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.286+0000 7f0474800640 1 -- start start 2024-09-12T02:47:31.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.287+0000 7f0474800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f046c15cc50 0x7f046c0732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:31.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.287+0000 7f0474800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f046c0afe30 0x7f046c0cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:31.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.287+0000 7f0474800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f046c073830 con 0x7f046c071530 2024-09-12T02:47:31.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.287+0000 7f0474800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f046c15d030 con 0x7f046c15cc50 2024-09-12T02:47:31.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.287+0000 7f0474800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f046c0cf4c0 con 0x7f046c0afe30 2024-09-12T02:47:31.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.287+0000 7f0471e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f046c15cc50 0x7f046c0732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:31.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.287+0000 7f0471e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f046c15cc50 0x7f046c0732f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37550/0 (socket says 172.21.15.112:37550) 2024-09-12T02:47:31.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.287+0000 7f0471400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f046c071530 0x7f046c0af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:37530/0 (socket says 172.21.15.112:37530) 2024-09-12T02:47:31.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.287+0000 7f0471e00640 1 -- 172.21.15.112:0/83778525 learned_addr learned my addr 172.21.15.112:0/83778525 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:31.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.288+0000 7f0472800640 1 --2- 172.21.15.112:0/83778525 >> v2:172.21.15.137:3300/0 conn(0x7f046c0afe30 0x7f046c0cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:31.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.288+0000 7f0471e00640 1 -- 172.21.15.112:0/83778525 >> v2:172.21.15.137:3300/0 conn(0x7f046c0afe30 msgr2=0x7f046c0cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:31.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.288+0000 7f0471e00640 1 --2- 172.21.15.112:0/83778525 >> v2:172.21.15.137:3300/0 conn(0x7f046c0afe30 0x7f046c0cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.288+0000 7f0471e00640 1 -- 172.21.15.112:0/83778525 >> v1:172.21.15.112:6789/0 conn(0x7f046c071530 legacy=0x7f046c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:31.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.288+0000 7f0471e00640 1 -- 172.21.15.112:0/83778525 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f046c0ceeb0 con 0x7f046c15cc50 2024-09-12T02:47:31.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.288+0000 7f0472800640 1 --2- 172.21.15.112:0/83778525 >> v2:172.21.15.137:3300/0 conn(0x7f046c0afe30 0x7f046c0cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:31.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.289+0000 7f0471e00640 1 --2- 172.21.15.112:0/83778525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f046c15cc50 0x7f046c0732f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f046c06ffd0 tx=0x7f046002a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93d026a83e2a19b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:31.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.289+0000 7f0470a00640 1 -- 172.21.15.112:0/83778525 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0460037070 con 0x7f046c15cc50 2024-09-12T02:47:31.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.289+0000 7f0470a00640 1 -- 172.21.15.112:0/83778525 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0460032440 con 0x7f046c15cc50 2024-09-12T02:47:31.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.289+0000 7f0470a00640 1 -- 172.21.15.112:0/83778525 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0460032810 con 0x7f046c15cc50 2024-09-12T02:47:31.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.290+0000 7f0474800640 1 -- 172.21.15.112:0/83778525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f046c15cc50 msgr2=0x7f046c0732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:31.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.290+0000 7f0474800640 1 --2- 172.21.15.112:0/83778525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f046c15cc50 0x7f046c0732f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f046c06ffd0 tx=0x7f046002a1f0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.290+0000 7f0474800640 1 -- 172.21.15.112:0/83778525 shutdown_connections 2024-09-12T02:47:31.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.290+0000 7f0474800640 1 --2- 172.21.15.112:0/83778525 >> v2:172.21.15.137:3300/0 conn(0x7f046c0afe30 0x7f046c0cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.290+0000 7f0474800640 1 --2- 172.21.15.112:0/83778525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f046c15cc50 0x7f046c0732f0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.290+0000 7f0474800640 1 -- 172.21.15.112:0/83778525 >> 172.21.15.112:0/83778525 conn(0x7f046c06bbd0 msgr2=0x7f046c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:31.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.290+0000 7f0474800640 1 -- 172.21.15.112:0/83778525 shutdown_connections 2024-09-12T02:47:31.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.290+0000 7f0474800640 1 -- 172.21.15.112:0/83778525 wait complete. 2024-09-12T02:47:31.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.291+0000 7f0474800640 1 Processor -- start 2024-09-12T02:47:31.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.291+0000 7f0474800640 1 -- start start 2024-09-12T02:47:31.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.292+0000 7f0474800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f046c071530 0x7f046c13b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:31.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.292+0000 7f0474800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f046c0afe30 0x7f046c13eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:31.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.292+0000 7f0474800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f046c15cc50 0x7f046c13c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:31.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.292+0000 7f0474800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f046c0cf150 con 0x7f046c0afe30 2024-09-12T02:47:31.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.292+0000 7f0474800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f046c06e5e0 con 0x7f046c15cc50 2024-09-12T02:47:31.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.292+0000 7f0474800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f046c06f510 con 0x7f046c071530 2024-09-12T02:47:31.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.292+0000 7f0471400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f046c0afe30 0x7f046c13eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:31.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.293+0000 7f0471400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f046c0afe30 0x7f046c13eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37566/0 (socket says 172.21.15.112:37566) 2024-09-12T02:47:31.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.293+0000 7f0471400640 1 -- 172.21.15.112:0/2128250751 learned_addr learned my addr 172.21.15.112:0/2128250751 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:31.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.293+0000 7f0472800640 1 --2- 172.21.15.112:0/2128250751 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f046c15cc50 0x7f046c13c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:31.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.293+0000 7f0471e00640 1 --2- 172.21.15.112:0/2128250751 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f046c071530 0x7f046c13b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:31.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.293+0000 7f0471400640 1 -- 172.21.15.112:0/2128250751 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f046c071530 msgr2=0x7f046c13b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:31.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.293+0000 7f0471400640 1 --2- 172.21.15.112:0/2128250751 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f046c071530 0x7f046c13b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.293+0000 7f0471400640 1 -- 172.21.15.112:0/2128250751 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f046c15cc50 msgr2=0x7f046c13c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:31.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.293+0000 7f0471400640 1 --2- 172.21.15.112:0/2128250751 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f046c15cc50 0x7f046c13c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.293+0000 7f0471400640 1 -- 172.21.15.112:0/2128250751 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f046c13bd80 con 0x7f046c0afe30 2024-09-12T02:47:31.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.293+0000 7f0472800640 1 --2- 172.21.15.112:0/2128250751 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f046c15cc50 0x7f046c13c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:31.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.293+0000 7f0471e00640 1 --2- 172.21.15.112:0/2128250751 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f046c071530 0x7f046c13b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:31.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.293+0000 7f0471400640 1 --2- 172.21.15.112:0/2128250751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f046c0afe30 0x7f046c13eae0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f045c007fd0 tx=0x7f045c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:31.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.293+0000 7f0466000640 1 -- 172.21.15.112:0/2128250751 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c017070 con 0x7f046c0afe30 2024-09-12T02:47:31.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.293+0000 7f0466000640 1 -- 172.21.15.112:0/2128250751 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f045c0074e0 con 0x7f046c0afe30 2024-09-12T02:47:31.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.293+0000 7f0466000640 1 -- 172.21.15.112:0/2128250751 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c0059c0 con 0x7f046c0afe30 2024-09-12T02:47:31.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.293+0000 7f0474800640 1 -- 172.21.15.112:0/2128250751 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f046c13f020 con 0x7f046c0afe30 2024-09-12T02:47:31.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.294+0000 7f0474800640 1 -- 172.21.15.112:0/2128250751 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f046c1540a0 con 0x7f046c0afe30 2024-09-12T02:47:31.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.295+0000 7f0474800640 1 -- 172.21.15.112:0/2128250751 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f046c068a30 con 0x7f046c0afe30 2024-09-12T02:47:31.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.295+0000 7f0466000640 1 -- 172.21.15.112:0/2128250751 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f045c01a070 con 0x7f046c0afe30 2024-09-12T02:47:31.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.296+0000 7f0466000640 1 --2- 172.21.15.112:0/2128250751 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f045006be60 0x7f045006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:31.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.296+0000 7f0466000640 1 -- 172.21.15.112:0/2128250751 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7f045c08a240 con 0x7f046c0afe30 2024-09-12T02:47:31.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.297+0000 7f0471e00640 1 --2- 172.21.15.112:0/2128250751 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f045006be60 0x7f045006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:31.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.297+0000 7f0471e00640 1 --2- 172.21.15.112:0/2128250751 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f045006be60 0x7f045006e320 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0460034000 tx=0x7f046002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:31.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.301+0000 7f0466000640 1 -- 172.21.15.112:0/2128250751 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f046c073830 con 0x7f046c0afe30 2024-09-12T02:47:31.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.473+0000 7f0474800640 1 -- 172.21.15.112:0/2128250751 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f046c0b14e0 con 0x7f046c0afe30 2024-09-12T02:47:31.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.474+0000 7f0466000640 1 -- 172.21.15.112:0/2128250751 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) ==== 74+0+16728 (secure 0 0 0) 0x7f045c058be0 con 0x7f046c0afe30 2024-09-12T02:47:31.476 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:31.476 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":120,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:47:28.674556+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:47:24.847347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-12T02:47:26.073460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:47:31.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.478+0000 7f0474800640 1 -- 172.21.15.112:0/2128250751 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f045006be60 msgr2=0x7f045006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:31.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.478+0000 7f0474800640 1 --2- 172.21.15.112:0/2128250751 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f045006be60 0x7f045006e320 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0460034000 tx=0x7f046002e000 comp rx=0 tx=0).stop 2024-09-12T02:47:31.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.478+0000 7f0474800640 1 -- 172.21.15.112:0/2128250751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f046c0afe30 msgr2=0x7f046c13eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:31.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.478+0000 7f0474800640 1 --2- 172.21.15.112:0/2128250751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f046c0afe30 0x7f046c13eae0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f045c007fd0 tx=0x7f045c00c890 comp rx=0 tx=0).stop 2024-09-12T02:47:31.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.478+0000 7f0474800640 1 -- 172.21.15.112:0/2128250751 shutdown_connections 2024-09-12T02:47:31.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.478+0000 7f0474800640 1 --2- 172.21.15.112:0/2128250751 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f045006be60 0x7f045006e320 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.478+0000 7f0474800640 1 --2- 172.21.15.112:0/2128250751 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f046c15cc50 0x7f046c13c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.478+0000 7f0474800640 1 --2- 172.21.15.112:0/2128250751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f046c0afe30 0x7f046c13eae0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.478+0000 7f0474800640 1 --2- 172.21.15.112:0/2128250751 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f046c071530 0x7f046c13b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.478+0000 7f0474800640 1 -- 172.21.15.112:0/2128250751 >> 172.21.15.112:0/2128250751 conn(0x7f046c06bbd0 msgr2=0x7f046c158e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:31.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.478+0000 7f0474800640 1 -- 172.21.15.112:0/2128250751 shutdown_connections 2024-09-12T02:47:31.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.478+0000 7f0474800640 1 -- 172.21.15.112:0/2128250751 wait complete. 2024-09-12T02:47:31.494 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:47:31.494 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:47:31.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.646+0000 7fe257a00640 1 Processor -- start 2024-09-12T02:47:31.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.646+0000 7fe257a00640 1 -- start start 2024-09-12T02:47:31.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.648+0000 7fe257a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe250071530 0x7fe2500af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:31.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.648+0000 7fe257a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe2500719a0 0x7fe2500afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:31.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.648+0000 7fe257a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2500ceeb0 con 0x7fe25015cc50 2024-09-12T02:47:31.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.648+0000 7fe257a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe25015d030 con 0x7fe250071530 2024-09-12T02:47:31.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.648+0000 7fe257a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe2500cf4c0 con 0x7fe2500719a0 2024-09-12T02:47:31.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.648+0000 7fe247e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe250071530 0x7fe2500af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:31.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.648+0000 7fe247e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe250071530 0x7fe2500af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37570/0 (socket says 172.21.15.112:37570) 2024-09-12T02:47:31.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.648+0000 7fe247e00640 1 -- 172.21.15.112:0/3303881734 learned_addr learned my addr 172.21.15.112:0/3303881734 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:31.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.648+0000 7fe255a00640 1 --2- 172.21.15.112:0/3303881734 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe2500719a0 0x7fe2500afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:31.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.648+0000 7fe247e00640 1 -- 172.21.15.112:0/3303881734 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe2500719a0 msgr2=0x7fe2500afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:31.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.648+0000 7fe247e00640 1 --2- 172.21.15.112:0/3303881734 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe2500719a0 0x7fe2500afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.648+0000 7fe247e00640 1 -- 172.21.15.112:0/3303881734 >> v1:172.21.15.137:6789/0 conn(0x7fe25015cc50 legacy=0x7fe2500732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:31.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.648+0000 7fe247e00640 1 -- 172.21.15.112:0/3303881734 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe25006e300 con 0x7fe250071530 2024-09-12T02:47:31.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.649+0000 7fe247e00640 1 --2- 172.21.15.112:0/3303881734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe250071530 0x7fe2500af720 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fe2500cf640 tx=0x7fe23802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f94d72b4b22ddb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:31.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.650+0000 7fe24fe00640 1 -- 172.21.15.112:0/3303881734 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe238004030 con 0x7fe250071530 2024-09-12T02:47:31.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.650+0000 7fe24fe00640 1 -- 172.21.15.112:0/3303881734 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2380041d0 con 0x7fe250071530 2024-09-12T02:47:31.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.650+0000 7fe24fe00640 1 -- 172.21.15.112:0/3303881734 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe238003610 con 0x7fe250071530 2024-09-12T02:47:31.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.650+0000 7fe257a00640 1 -- 172.21.15.112:0/3303881734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe250071530 msgr2=0x7fe2500af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:31.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.650+0000 7fe257a00640 1 --2- 172.21.15.112:0/3303881734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe250071530 0x7fe2500af720 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fe2500cf640 tx=0x7fe23802a1a0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.650+0000 7fe257a00640 1 -- 172.21.15.112:0/3303881734 shutdown_connections 2024-09-12T02:47:31.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.650+0000 7fe257a00640 1 --2- 172.21.15.112:0/3303881734 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe2500719a0 0x7fe2500afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.650+0000 7fe257a00640 1 --2- 172.21.15.112:0/3303881734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe250071530 0x7fe2500af720 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.650+0000 7fe257a00640 1 -- 172.21.15.112:0/3303881734 >> 172.21.15.112:0/3303881734 conn(0x7fe25006bbd0 msgr2=0x7fe25006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:31.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.650+0000 7fe257a00640 1 -- 172.21.15.112:0/3303881734 shutdown_connections 2024-09-12T02:47:31.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.650+0000 7fe257a00640 1 -- 172.21.15.112:0/3303881734 wait complete. 2024-09-12T02:47:31.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.652+0000 7fe257a00640 1 Processor -- start 2024-09-12T02:47:31.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.652+0000 7fe257a00640 1 -- start start 2024-09-12T02:47:31.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.653+0000 7fe257a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe250071530 0x7fe250150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:31.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.653+0000 7fe257a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe2500719a0 0x7fe2501e7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:31.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.653+0000 7fe257a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe25015cc50 0x7fe25015b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:31.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.653+0000 7fe257a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe25006f510 con 0x7fe250071530 2024-09-12T02:47:31.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.653+0000 7fe257a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe2500cf150 con 0x7fe25015cc50 2024-09-12T02:47:31.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.653+0000 7fe257a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe25006f690 con 0x7fe2500719a0 2024-09-12T02:47:31.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.653+0000 7fe255000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe250071530 0x7fe250150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:31.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.653+0000 7fe255000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe250071530 0x7fe250150dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37572/0 (socket says 172.21.15.112:37572) 2024-09-12T02:47:31.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.653+0000 7fe255000640 1 -- 172.21.15.112:0/1817928872 learned_addr learned my addr 172.21.15.112:0/1817928872 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:31.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.654+0000 7fe255000640 1 -- 172.21.15.112:0/1817928872 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe2500719a0 msgr2=0x7fe2501e7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:31.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.654+0000 7fe255000640 1 --2- 172.21.15.112:0/1817928872 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe2500719a0 0x7fe2501e7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.654+0000 7fe255000640 1 -- 172.21.15.112:0/1817928872 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe25015cc50 msgr2=0x7fe25015b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:31.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.654+0000 7fe255000640 1 --2- 172.21.15.112:0/1817928872 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe25015cc50 0x7fe25015b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.654+0000 7fe255000640 1 -- 172.21.15.112:0/1817928872 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe250152a70 con 0x7fe250071530 2024-09-12T02:47:31.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.654+0000 7fe255000640 1 --2- 172.21.15.112:0/1817928872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe250071530 0x7fe250150dd0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fe24000c3f0 tx=0x7fe24000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:31.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.654+0000 7fe24d600640 1 -- 172.21.15.112:0/1817928872 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2400052d0 con 0x7fe250071530 2024-09-12T02:47:31.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.654+0000 7fe24d600640 1 -- 172.21.15.112:0/1817928872 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe240005470 con 0x7fe250071530 2024-09-12T02:47:31.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.654+0000 7fe24d600640 1 -- 172.21.15.112:0/1817928872 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe240007260 con 0x7fe250071530 2024-09-12T02:47:31.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.654+0000 7fe257a00640 1 -- 172.21.15.112:0/1817928872 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe250152d50 con 0x7fe250071530 2024-09-12T02:47:31.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.654+0000 7fe257a00640 1 -- 172.21.15.112:0/1817928872 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe250153310 con 0x7fe250071530 2024-09-12T02:47:31.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.655+0000 7fe257a00640 1 -- 172.21.15.112:0/1817928872 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe250068a30 con 0x7fe250071530 2024-09-12T02:47:31.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.656+0000 7fe24d600640 1 -- 172.21.15.112:0/1817928872 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe240007400 con 0x7fe250071530 2024-09-12T02:47:31.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.657+0000 7fe24d600640 1 --2- 172.21.15.112:0/1817928872 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe22c06be30 0x7fe22c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:31.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.657+0000 7fe24d600640 1 -- 172.21.15.112:0/1817928872 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7fe24008a280 con 0x7fe250071530 2024-09-12T02:47:31.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.657+0000 7fe247e00640 1 --2- 172.21.15.112:0/1817928872 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe22c06be30 0x7fe22c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:31.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.658+0000 7fe247e00640 1 --2- 172.21.15.112:0/1817928872 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe22c06be30 0x7fe22c06e2f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe238033000 tx=0x7fe23802c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:31.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.663+0000 7fe24d600640 1 -- 172.21.15.112:0/1817928872 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe240058c20 con 0x7fe250071530 2024-09-12T02:47:31.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.836+0000 7fe257a00640 1 -- 172.21.15.112:0/1817928872 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe25006df60 con 0x7fe22c06be30 2024-09-12T02:47:31.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.842+0000 7fe24d600640 1 -- 172.21.15.112:0/1817928872 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247921 (secure 0 0 0) 0x7fe25006df60 con 0x7fe22c06be30 2024-09-12T02:47:31.846 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:31.847 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:47:31.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.846+0000 7fe257a00640 1 -- 172.21.15.112:0/1817928872 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe22c06be30 msgr2=0x7fe22c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:31.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.846+0000 7fe257a00640 1 --2- 172.21.15.112:0/1817928872 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe22c06be30 0x7fe22c06e2f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe238033000 tx=0x7fe23802c000 comp rx=0 tx=0).stop 2024-09-12T02:47:31.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.846+0000 7fe257a00640 1 -- 172.21.15.112:0/1817928872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe250071530 msgr2=0x7fe250150dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:31.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.846+0000 7fe257a00640 1 --2- 172.21.15.112:0/1817928872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe250071530 0x7fe250150dd0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fe24000c3f0 tx=0x7fe24000c8b0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.846+0000 7fe257a00640 1 -- 172.21.15.112:0/1817928872 shutdown_connections 2024-09-12T02:47:31.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.846+0000 7fe257a00640 1 --2- 172.21.15.112:0/1817928872 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe22c06be30 0x7fe22c06e2f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.846+0000 7fe257a00640 1 --2- 172.21.15.112:0/1817928872 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe25015cc50 0x7fe25015b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.846+0000 7fe257a00640 1 --2- 172.21.15.112:0/1817928872 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe2500719a0 0x7fe2501e7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.846+0000 7fe257a00640 1 --2- 172.21.15.112:0/1817928872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe250071530 0x7fe250150dd0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.846+0000 7fe257a00640 1 -- 172.21.15.112:0/1817928872 >> 172.21.15.112:0/1817928872 conn(0x7fe25006bbd0 msgr2=0x7fe2500d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:31.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.846+0000 7fe257a00640 1 -- 172.21.15.112:0/1817928872 shutdown_connections 2024-09-12T02:47:31.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:31.846+0000 7fe257a00640 1 -- 172.21.15.112:0/1817928872 wait complete. 2024-09-12T02:47:31.862 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":286,"stamp":"2024-09-12T02:47:31.033273+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":70,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6231,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556268,"statfs":{"total":1600000000,"available":1593619031,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.375070"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.692268+0000","last_change":"2024-09-12T02:47:27.690771+0000","last_active":"2024-09-12T02:47:27.692268+0000","last_peered":"2024-09-12T02:47:27.692268+0000","last_clean":"2024-09-12T02:47:27.692268+0000","last_became_active":"2024-09-12T02:47:27.688477+0000","last_became_peered":"2024-09-12T02:47:27.688477+0000","last_unstale":"2024-09-12T02:47:27.692268+0000","last_undegraded":"2024-09-12T02:47:27.692268+0000","last_fullsized":"2024-09-12T02:47:27.692268+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:06.824312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.694999+0000","last_change":"2024-09-12T02:47:27.692140+0000","last_active":"2024-09-12T02:47:27.694999+0000","last_peered":"2024-09-12T02:47:27.694999+0000","last_clean":"2024-09-12T02:47:27.694999+0000","last_became_active":"2024-09-12T02:47:27.691723+0000","last_became_peered":"2024-09-12T02:47:27.691723+0000","last_unstale":"2024-09-12T02:47:27.694999+0000","last_undegraded":"2024-09-12T02:47:27.694999+0000","last_fullsized":"2024-09-12T02:47:27.694999+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:09.446258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.689782+0000","last_change":"2024-09-12T02:47:27.687061+0000","last_active":"2024-09-12T02:47:27.689782+0000","last_peered":"2024-09-12T02:47:27.689782+0000","last_clean":"2024-09-12T02:47:27.689782+0000","last_became_active":"2024-09-12T02:47:27.686823+0000","last_became_peered":"2024-09-12T02:47:27.686823+0000","last_unstale":"2024-09-12T02:47:27.689782+0000","last_undegraded":"2024-09-12T02:47:27.689782+0000","last_fullsized":"2024-09-12T02:47:27.689782+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:28.888507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.683640+0000","last_change":"2024-09-12T02:47:27.683244+0000","last_active":"2024-09-12T02:47:27.683640+0000","last_peered":"2024-09-12T02:47:27.683640+0000","last_clean":"2024-09-12T02:47:27.683640+0000","last_became_active":"2024-09-12T02:47:27.682923+0000","last_became_peered":"2024-09-12T02:47:27.682923+0000","last_unstale":"2024-09-12T02:47:27.683640+0000","last_undegraded":"2024-09-12T02:47:27.683640+0000","last_fullsized":"2024-09-12T02:47:27.683640+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:36.151018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.686129+0000","last_change":"2024-09-12T02:47:27.685599+0000","last_active":"2024-09-12T02:47:27.686129+0000","last_peered":"2024-09-12T02:47:27.686129+0000","last_clean":"2024-09-12T02:47:27.686129+0000","last_became_active":"2024-09-12T02:47:27.684971+0000","last_became_peered":"2024-09-12T02:47:27.684971+0000","last_unstale":"2024-09-12T02:47:27.686129+0000","last_undegraded":"2024-09-12T02:47:27.686129+0000","last_fullsized":"2024-09-12T02:47:27.686129+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:47.263324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.696103+0000","last_change":"2024-09-12T02:47:27.695854+0000","last_active":"2024-09-12T02:47:27.696103+0000","last_peered":"2024-09-12T02:47:27.696103+0000","last_clean":"2024-09-12T02:47:27.696103+0000","last_became_active":"2024-09-12T02:47:27.695572+0000","last_became_peered":"2024-09-12T02:47:27.695572+0000","last_unstale":"2024-09-12T02:47:27.696103+0000","last_undegraded":"2024-09-12T02:47:27.696103+0000","last_fullsized":"2024-09-12T02:47:27.696103+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:10.441792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.691695+0000","last_change":"2024-09-12T02:47:27.691523+0000","last_active":"2024-09-12T02:47:27.691695+0000","last_peered":"2024-09-12T02:47:27.691695+0000","last_clean":"2024-09-12T02:47:27.691695+0000","last_became_active":"2024-09-12T02:47:27.690829+0000","last_became_peered":"2024-09-12T02:47:27.690829+0000","last_unstale":"2024-09-12T02:47:27.691695+0000","last_undegraded":"2024-09-12T02:47:27.691695+0000","last_fullsized":"2024-09-12T02:47:27.691695+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:29.225131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.695607+0000","last_change":"2024-09-12T02:47:27.694982+0000","last_active":"2024-09-12T02:47:27.695607+0000","last_peered":"2024-09-12T02:47:27.695607+0000","last_clean":"2024-09-12T02:47:27.695607+0000","last_became_active":"2024-09-12T02:47:27.694650+0000","last_became_peered":"2024-09-12T02:47:27.694650+0000","last_unstale":"2024-09-12T02:47:27.695607+0000","last_undegraded":"2024-09-12T02:47:27.695607+0000","last_fullsized":"2024-09-12T02:47:27.695607+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:11.661244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.688747+0000","last_change":"2024-09-12T02:47:27.688494+0000","last_active":"2024-09-12T02:47:27.688747+0000","last_peered":"2024-09-12T02:47:27.688747+0000","last_clean":"2024-09-12T02:47:27.688747+0000","last_became_active":"2024-09-12T02:47:27.688229+0000","last_became_peered":"2024-09-12T02:47:27.688229+0000","last_unstale":"2024-09-12T02:47:27.688747+0000","last_undegraded":"2024-09-12T02:47:27.688747+0000","last_fullsized":"2024-09-12T02:47:27.688747+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:14.653644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.697728+0000","last_change":"2024-09-12T02:47:27.697630+0000","last_active":"2024-09-12T02:47:27.697728+0000","last_peered":"2024-09-12T02:47:27.697728+0000","last_clean":"2024-09-12T02:47:27.697728+0000","last_became_active":"2024-09-12T02:47:27.697058+0000","last_became_peered":"2024-09-12T02:47:27.697058+0000","last_unstale":"2024-09-12T02:47:27.697728+0000","last_undegraded":"2024-09-12T02:47:27.697728+0000","last_fullsized":"2024-09-12T02:47:27.697728+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:52.826179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.695195+0000","last_change":"2024-09-12T02:47:27.694906+0000","last_active":"2024-09-12T02:47:27.695195+0000","last_peered":"2024-09-12T02:47:27.695195+0000","last_clean":"2024-09-12T02:47:27.695195+0000","last_became_active":"2024-09-12T02:47:27.694434+0000","last_became_peered":"2024-09-12T02:47:27.694434+0000","last_unstale":"2024-09-12T02:47:27.695195+0000","last_undegraded":"2024-09-12T02:47:27.695195+0000","last_fullsized":"2024-09-12T02:47:27.695195+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:49.777155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.693973+0000","last_change":"2024-09-12T02:47:27.693644+0000","last_active":"2024-09-12T02:47:27.693973+0000","last_peered":"2024-09-12T02:47:27.693973+0000","last_clean":"2024-09-12T02:47:27.693973+0000","last_became_active":"2024-09-12T02:47:27.693308+0000","last_became_peered":"2024-09-12T02:47:27.693308+0000","last_unstale":"2024-09-12T02:47:27.693973+0000","last_undegraded":"2024-09-12T02:47:27.693973+0000","last_fullsized":"2024-09-12T02:47:27.693973+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:26.195439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.686531+0000","last_change":"2024-09-12T02:47:27.685919+0000","last_active":"2024-09-12T02:47:27.686531+0000","last_peered":"2024-09-12T02:47:27.686531+0000","last_clean":"2024-09-12T02:47:27.686531+0000","last_became_active":"2024-09-12T02:47:27.685518+0000","last_became_peered":"2024-09-12T02:47:27.685518+0000","last_unstale":"2024-09-12T02:47:27.686531+0000","last_undegraded":"2024-09-12T02:47:27.686531+0000","last_fullsized":"2024-09-12T02:47:27.686531+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:17.577268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.683442+0000","last_change":"2024-09-12T02:47:27.682764+0000","last_active":"2024-09-12T02:47:27.683442+0000","last_peered":"2024-09-12T02:47:27.683442+0000","last_clean":"2024-09-12T02:47:27.683442+0000","last_became_active":"2024-09-12T02:47:27.682519+0000","last_became_peered":"2024-09-12T02:47:27.682519+0000","last_unstale":"2024-09-12T02:47:27.683442+0000","last_undegraded":"2024-09-12T02:47:27.683442+0000","last_fullsized":"2024-09-12T02:47:27.683442+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:27.030308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.698650+0000","last_change":"2024-09-12T02:47:27.698469+0000","last_active":"2024-09-12T02:47:27.698650+0000","last_peered":"2024-09-12T02:47:27.698650+0000","last_clean":"2024-09-12T02:47:27.698650+0000","last_became_active":"2024-09-12T02:47:27.697946+0000","last_became_peered":"2024-09-12T02:47:27.697946+0000","last_unstale":"2024-09-12T02:47:27.698650+0000","last_undegraded":"2024-09-12T02:47:27.698650+0000","last_fullsized":"2024-09-12T02:47:27.698650+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:44.509314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.696684+0000","last_change":"2024-09-12T02:47:27.696567+0000","last_active":"2024-09-12T02:47:27.696684+0000","last_peered":"2024-09-12T02:47:27.696684+0000","last_clean":"2024-09-12T02:47:27.696684+0000","last_became_active":"2024-09-12T02:47:27.696332+0000","last_became_peered":"2024-09-12T02:47:27.696332+0000","last_unstale":"2024-09-12T02:47:27.696684+0000","last_undegraded":"2024-09-12T02:47:27.696684+0000","last_fullsized":"2024-09-12T02:47:27.696684+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:42.424469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.690426+0000","last_change":"2024-09-12T02:47:27.690313+0000","last_active":"2024-09-12T02:47:27.690426+0000","last_peered":"2024-09-12T02:47:27.690426+0000","last_clean":"2024-09-12T02:47:27.690426+0000","last_became_active":"2024-09-12T02:47:27.690098+0000","last_became_peered":"2024-09-12T02:47:27.690098+0000","last_unstale":"2024-09-12T02:47:27.690426+0000","last_undegraded":"2024-09-12T02:47:27.690426+0000","last_fullsized":"2024-09-12T02:47:27.690426+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:27.912301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.685882+0000","last_change":"2024-09-12T02:47:27.685728+0000","last_active":"2024-09-12T02:47:27.685882+0000","last_peered":"2024-09-12T02:47:27.685882+0000","last_clean":"2024-09-12T02:47:27.685882+0000","last_became_active":"2024-09-12T02:47:27.685231+0000","last_became_peered":"2024-09-12T02:47:27.685231+0000","last_unstale":"2024-09-12T02:47:27.685882+0000","last_undegraded":"2024-09-12T02:47:27.685882+0000","last_fullsized":"2024-09-12T02:47:27.685882+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:53.170860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.691734+0000","last_change":"2024-09-12T02:47:27.689587+0000","last_active":"2024-09-12T02:47:27.691734+0000","last_peered":"2024-09-12T02:47:27.691734+0000","last_clean":"2024-09-12T02:47:27.691734+0000","last_became_active":"2024-09-12T02:47:27.689286+0000","last_became_peered":"2024-09-12T02:47:27.689286+0000","last_unstale":"2024-09-12T02:47:27.691734+0000","last_undegraded":"2024-09-12T02:47:27.691734+0000","last_fullsized":"2024-09-12T02:47:27.691734+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:24.732479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.692742+0000","last_change":"2024-09-12T02:47:27.690958+0000","last_active":"2024-09-12T02:47:27.692742+0000","last_peered":"2024-09-12T02:47:27.692742+0000","last_clean":"2024-09-12T02:47:27.692742+0000","last_became_active":"2024-09-12T02:47:27.690285+0000","last_became_peered":"2024-09-12T02:47:27.690285+0000","last_unstale":"2024-09-12T02:47:27.692742+0000","last_undegraded":"2024-09-12T02:47:27.692742+0000","last_fullsized":"2024-09-12T02:47:27.692742+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:52.302803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.691718+0000","last_change":"2024-09-12T02:47:27.688880+0000","last_active":"2024-09-12T02:47:27.691718+0000","last_peered":"2024-09-12T02:47:27.691718+0000","last_clean":"2024-09-12T02:47:27.691718+0000","last_became_active":"2024-09-12T02:47:27.687695+0000","last_became_peered":"2024-09-12T02:47:27.687695+0000","last_unstale":"2024-09-12T02:47:27.691718+0000","last_undegraded":"2024-09-12T02:47:27.691718+0000","last_fullsized":"2024-09-12T02:47:27.691718+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:33.101296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.694979+0000","last_change":"2024-09-12T02:47:27.691941+0000","last_active":"2024-09-12T02:47:27.694979+0000","last_peered":"2024-09-12T02:47:27.694979+0000","last_clean":"2024-09-12T02:47:27.694979+0000","last_became_active":"2024-09-12T02:47:27.691373+0000","last_became_peered":"2024-09-12T02:47:27.691373+0000","last_unstale":"2024-09-12T02:47:27.694979+0000","last_undegraded":"2024-09-12T02:47:27.694979+0000","last_fullsized":"2024-09-12T02:47:27.694979+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:20.586292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.695037+0000","last_change":"2024-09-12T02:47:27.693247+0000","last_active":"2024-09-12T02:47:27.695037+0000","last_peered":"2024-09-12T02:47:27.695037+0000","last_clean":"2024-09-12T02:47:27.695037+0000","last_became_active":"2024-09-12T02:47:27.692847+0000","last_became_peered":"2024-09-12T02:47:27.692847+0000","last_unstale":"2024-09-12T02:47:27.695037+0000","last_undegraded":"2024-09-12T02:47:27.695037+0000","last_fullsized":"2024-09-12T02:47:27.695037+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:51.578363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.697599+0000","last_change":"2024-09-12T02:47:27.697467+0000","last_active":"2024-09-12T02:47:27.697599+0000","last_peered":"2024-09-12T02:47:27.697599+0000","last_clean":"2024-09-12T02:47:27.697599+0000","last_became_active":"2024-09-12T02:47:27.697227+0000","last_became_peered":"2024-09-12T02:47:27.697227+0000","last_unstale":"2024-09-12T02:47:27.697599+0000","last_undegraded":"2024-09-12T02:47:27.697599+0000","last_fullsized":"2024-09-12T02:47:27.697599+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:55.095104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.690050+0000","last_change":"2024-09-12T02:47:27.689574+0000","last_active":"2024-09-12T02:47:27.690050+0000","last_peered":"2024-09-12T02:47:27.690050+0000","last_clean":"2024-09-12T02:47:27.690050+0000","last_became_active":"2024-09-12T02:47:27.688370+0000","last_became_peered":"2024-09-12T02:47:27.688370+0000","last_unstale":"2024-09-12T02:47:27.690050+0000","last_undegraded":"2024-09-12T02:47:27.690050+0000","last_fullsized":"2024-09-12T02:47:27.690050+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:33.456417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.695959+0000","last_change":"2024-09-12T02:47:27.695861+0000","last_active":"2024-09-12T02:47:27.695959+0000","last_peered":"2024-09-12T02:47:27.695959+0000","last_clean":"2024-09-12T02:47:27.695959+0000","last_became_active":"2024-09-12T02:47:27.695591+0000","last_became_peered":"2024-09-12T02:47:27.695591+0000","last_unstale":"2024-09-12T02:47:27.695959+0000","last_undegraded":"2024-09-12T02:47:27.695959+0000","last_fullsized":"2024-09-12T02:47:27.695959+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:37.333098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.695620+0000","last_change":"2024-09-12T02:47:27.695497+0000","last_active":"2024-09-12T02:47:27.695620+0000","last_peered":"2024-09-12T02:47:27.695620+0000","last_clean":"2024-09-12T02:47:27.695620+0000","last_became_active":"2024-09-12T02:47:27.695101+0000","last_became_peered":"2024-09-12T02:47:27.695101+0000","last_unstale":"2024-09-12T02:47:27.695620+0000","last_undegraded":"2024-09-12T02:47:27.695620+0000","last_fullsized":"2024-09-12T02:47:27.695620+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:12.478535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.689175+0000","last_change":"2024-09-12T02:47:27.688579+0000","last_active":"2024-09-12T02:47:27.689175+0000","last_peered":"2024-09-12T02:47:27.689175+0000","last_clean":"2024-09-12T02:47:27.689175+0000","last_became_active":"2024-09-12T02:47:27.686281+0000","last_became_peered":"2024-09-12T02:47:27.686281+0000","last_unstale":"2024-09-12T02:47:27.689175+0000","last_undegraded":"2024-09-12T02:47:27.689175+0000","last_fullsized":"2024-09-12T02:47:27.689175+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:02.848564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.695634+0000","last_change":"2024-09-12T02:47:27.695506+0000","last_active":"2024-09-12T02:47:27.695634+0000","last_peered":"2024-09-12T02:47:27.695634+0000","last_clean":"2024-09-12T02:47:27.695634+0000","last_became_active":"2024-09-12T02:47:27.695294+0000","last_became_peered":"2024-09-12T02:47:27.695294+0000","last_unstale":"2024-09-12T02:47:27.695634+0000","last_undegraded":"2024-09-12T02:47:27.695634+0000","last_fullsized":"2024-09-12T02:47:27.695634+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:07.937880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.692721+0000","last_change":"2024-09-12T02:47:27.691981+0000","last_active":"2024-09-12T02:47:27.692721+0000","last_peered":"2024-09-12T02:47:27.692721+0000","last_clean":"2024-09-12T02:47:27.692721+0000","last_became_active":"2024-09-12T02:47:27.691292+0000","last_became_peered":"2024-09-12T02:47:27.691292+0000","last_unstale":"2024-09-12T02:47:27.692721+0000","last_undegraded":"2024-09-12T02:47:27.692721+0000","last_fullsized":"2024-09-12T02:47:27.692721+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:00.450215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.689395+0000","last_change":"2024-09-12T02:47:27.689129+0000","last_active":"2024-09-12T02:47:27.689395+0000","last_peered":"2024-09-12T02:47:27.689395+0000","last_clean":"2024-09-12T02:47:27.689395+0000","last_became_active":"2024-09-12T02:47:27.688861+0000","last_became_peered":"2024-09-12T02:47:27.688861+0000","last_unstale":"2024-09-12T02:47:27.689395+0000","last_undegraded":"2024-09-12T02:47:27.689395+0000","last_fullsized":"2024-09-12T02:47:27.689395+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:25.602183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.697240+0000","last_change":"2024-09-12T02:47:27.694236+0000","last_active":"2024-09-12T02:47:27.697240+0000","last_peered":"2024-09-12T02:47:27.697240+0000","last_clean":"2024-09-12T02:47:27.697240+0000","last_became_active":"2024-09-12T02:47:27.693122+0000","last_became_peered":"2024-09-12T02:47:27.693122+0000","last_unstale":"2024-09-12T02:47:27.697240+0000","last_undegraded":"2024-09-12T02:47:27.697240+0000","last_fullsized":"2024-09-12T02:47:27.697240+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:30.197045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.693551+0000","last_change":"2024-09-12T02:47:27.693213+0000","last_active":"2024-09-12T02:47:27.693551+0000","last_peered":"2024-09-12T02:47:27.693551+0000","last_clean":"2024-09-12T02:47:27.693551+0000","last_became_active":"2024-09-12T02:47:27.692951+0000","last_became_peered":"2024-09-12T02:47:27.692951+0000","last_unstale":"2024-09-12T02:47:27.693551+0000","last_undegraded":"2024-09-12T02:47:27.693551+0000","last_fullsized":"2024-09-12T02:47:27.693551+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:50.668947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"119'4","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.706405+0000","last_change":"2024-09-12T02:47:26.667726+0000","last_active":"2024-09-12T02:47:27.706405+0000","last_peered":"2024-09-12T02:47:27.706405+0000","last_clean":"2024-09-12T02:47:27.706405+0000","last_became_active":"2024-09-12T02:47:26.667500+0000","last_became_peered":"2024-09-12T02:47:26.667500+0000","last_unstale":"2024-09-12T02:47:27.706405+0000","last_undegraded":"2024-09-12T02:47:27.706405+0000","last_fullsized":"2024-09-12T02:47:27.706405+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:20.413750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.685693+0000","last_change":"2024-09-12T02:47:27.684321+0000","last_active":"2024-09-12T02:47:27.685693+0000","last_peered":"2024-09-12T02:47:27.685693+0000","last_clean":"2024-09-12T02:47:27.685693+0000","last_became_active":"2024-09-12T02:47:27.683936+0000","last_became_peered":"2024-09-12T02:47:27.683936+0000","last_unstale":"2024-09-12T02:47:27.685693+0000","last_undegraded":"2024-09-12T02:47:27.685693+0000","last_fullsized":"2024-09-12T02:47:27.685693+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:46.088340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"119'1","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.703525+0000","last_change":"2024-09-12T02:47:26.678064+0000","last_active":"2024-09-12T02:47:27.703525+0000","last_peered":"2024-09-12T02:47:27.703525+0000","last_clean":"2024-09-12T02:47:27.703525+0000","last_became_active":"2024-09-12T02:47:26.677780+0000","last_became_peered":"2024-09-12T02:47:26.677780+0000","last_unstale":"2024-09-12T02:47:27.703525+0000","last_undegraded":"2024-09-12T02:47:27.703525+0000","last_fullsized":"2024-09-12T02:47:27.703525+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:25.040861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.692247+0000","last_change":"2024-09-12T02:47:27.690561+0000","last_active":"2024-09-12T02:47:27.692247+0000","last_peered":"2024-09-12T02:47:27.692247+0000","last_clean":"2024-09-12T02:47:27.692247+0000","last_became_active":"2024-09-12T02:47:27.688178+0000","last_became_peered":"2024-09-12T02:47:27.688178+0000","last_unstale":"2024-09-12T02:47:27.692247+0000","last_undegraded":"2024-09-12T02:47:27.692247+0000","last_fullsized":"2024-09-12T02:47:27.692247+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:03.359996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"119'2","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.707203+0000","last_change":"2024-09-12T02:47:26.675179+0000","last_active":"2024-09-12T02:47:27.707203+0000","last_peered":"2024-09-12T02:47:27.707203+0000","last_clean":"2024-09-12T02:47:27.707203+0000","last_became_active":"2024-09-12T02:47:26.674917+0000","last_became_peered":"2024-09-12T02:47:26.674917+0000","last_unstale":"2024-09-12T02:47:27.707203+0000","last_undegraded":"2024-09-12T02:47:27.707203+0000","last_fullsized":"2024-09-12T02:47:27.707203+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:25.319669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.692763+0000","last_change":"2024-09-12T02:47:27.691173+0000","last_active":"2024-09-12T02:47:27.692763+0000","last_peered":"2024-09-12T02:47:27.692763+0000","last_clean":"2024-09-12T02:47:27.692763+0000","last_became_active":"2024-09-12T02:47:27.690704+0000","last_became_peered":"2024-09-12T02:47:27.690704+0000","last_unstale":"2024-09-12T02:47:27.692763+0000","last_undegraded":"2024-09-12T02:47:27.692763+0000","last_fullsized":"2024-09-12T02:47:27.692763+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:43.490907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"119'2","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.705886+0000","last_change":"2024-09-12T02:47:26.678365+0000","last_active":"2024-09-12T02:47:27.705886+0000","last_peered":"2024-09-12T02:47:27.705886+0000","last_clean":"2024-09-12T02:47:27.705886+0000","last_became_active":"2024-09-12T02:47:26.678133+0000","last_became_peered":"2024-09-12T02:47:26.678133+0000","last_unstale":"2024-09-12T02:47:27.705886+0000","last_undegraded":"2024-09-12T02:47:27.705886+0000","last_fullsized":"2024-09-12T02:47:27.705886+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:08.328762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.691492+0000","last_change":"2024-09-12T02:47:27.691364+0000","last_active":"2024-09-12T02:47:27.691492+0000","last_peered":"2024-09-12T02:47:27.691492+0000","last_clean":"2024-09-12T02:47:27.691492+0000","last_became_active":"2024-09-12T02:47:27.686835+0000","last_became_peered":"2024-09-12T02:47:27.686835+0000","last_unstale":"2024-09-12T02:47:27.691492+0000","last_undegraded":"2024-09-12T02:47:27.691492+0000","last_fullsized":"2024-09-12T02:47:27.691492+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:30.652196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"119'1","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.705267+0000","last_change":"2024-09-12T02:47:26.676638+0000","last_active":"2024-09-12T02:47:27.705267+0000","last_peered":"2024-09-12T02:47:27.705267+0000","last_clean":"2024-09-12T02:47:27.705267+0000","last_became_active":"2024-09-12T02:47:26.676377+0000","last_became_peered":"2024-09-12T02:47:26.676377+0000","last_unstale":"2024-09-12T02:47:27.705267+0000","last_undegraded":"2024-09-12T02:47:27.705267+0000","last_fullsized":"2024-09-12T02:47:27.705267+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:48.160662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.692244+0000","last_change":"2024-09-12T02:47:27.691999+0000","last_active":"2024-09-12T02:47:27.692244+0000","last_peered":"2024-09-12T02:47:27.692244+0000","last_clean":"2024-09-12T02:47:27.692244+0000","last_became_active":"2024-09-12T02:47:27.691230+0000","last_became_peered":"2024-09-12T02:47:27.691230+0000","last_unstale":"2024-09-12T02:47:27.692244+0000","last_undegraded":"2024-09-12T02:47:27.692244+0000","last_fullsized":"2024-09-12T02:47:27.692244+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:49.931509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"119'1","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.706798+0000","last_change":"2024-09-12T02:47:26.674232+0000","last_active":"2024-09-12T02:47:27.706798+0000","last_peered":"2024-09-12T02:47:27.706798+0000","last_clean":"2024-09-12T02:47:27.706798+0000","last_became_active":"2024-09-12T02:47:26.673919+0000","last_became_peered":"2024-09-12T02:47:26.673919+0000","last_unstale":"2024-09-12T02:47:27.706798+0000","last_undegraded":"2024-09-12T02:47:27.706798+0000","last_fullsized":"2024-09-12T02:47:27.706798+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:47.074294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.698382+0000","last_change":"2024-09-12T02:47:27.698251+0000","last_active":"2024-09-12T02:47:27.698382+0000","last_peered":"2024-09-12T02:47:27.698382+0000","last_clean":"2024-09-12T02:47:27.698382+0000","last_became_active":"2024-09-12T02:47:27.696693+0000","last_became_peered":"2024-09-12T02:47:27.696693+0000","last_unstale":"2024-09-12T02:47:27.698382+0000","last_undegraded":"2024-09-12T02:47:27.698382+0000","last_fullsized":"2024-09-12T02:47:27.698382+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:30.782727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.680400+0000","last_change":"2024-09-12T02:47:26.669920+0000","last_active":"2024-09-12T02:47:27.680400+0000","last_peered":"2024-09-12T02:47:27.680400+0000","last_clean":"2024-09-12T02:47:27.680400+0000","last_became_active":"2024-09-12T02:47:26.669678+0000","last_became_peered":"2024-09-12T02:47:26.669678+0000","last_unstale":"2024-09-12T02:47:27.680400+0000","last_undegraded":"2024-09-12T02:47:27.680400+0000","last_fullsized":"2024-09-12T02:47:27.680400+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:29.329393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.689648+0000","last_change":"2024-09-12T02:47:27.689503+0000","last_active":"2024-09-12T02:47:27.689648+0000","last_peered":"2024-09-12T02:47:27.689648+0000","last_clean":"2024-09-12T02:47:27.689648+0000","last_became_active":"2024-09-12T02:47:27.688812+0000","last_became_peered":"2024-09-12T02:47:27.688812+0000","last_unstale":"2024-09-12T02:47:27.689648+0000","last_undegraded":"2024-09-12T02:47:27.689648+0000","last_fullsized":"2024-09-12T02:47:27.689648+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:39.597906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.690433+0000","last_change":"2024-09-12T02:47:26.678105+0000","last_active":"2024-09-12T02:47:27.690433+0000","last_peered":"2024-09-12T02:47:27.690433+0000","last_clean":"2024-09-12T02:47:27.690433+0000","last_became_active":"2024-09-12T02:47:26.677535+0000","last_became_peered":"2024-09-12T02:47:26.677535+0000","last_unstale":"2024-09-12T02:47:27.690433+0000","last_undegraded":"2024-09-12T02:47:27.690433+0000","last_fullsized":"2024-09-12T02:47:27.690433+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:36.025450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.695059+0000","last_change":"2024-09-12T02:47:27.693554+0000","last_active":"2024-09-12T02:47:27.695059+0000","last_peered":"2024-09-12T02:47:27.695059+0000","last_clean":"2024-09-12T02:47:27.695059+0000","last_became_active":"2024-09-12T02:47:27.692441+0000","last_became_peered":"2024-09-12T02:47:27.692441+0000","last_unstale":"2024-09-12T02:47:27.695059+0000","last_undegraded":"2024-09-12T02:47:27.695059+0000","last_fullsized":"2024-09-12T02:47:27.695059+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:12.857158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.686919+0000","last_change":"2024-09-12T02:47:26.677228+0000","last_active":"2024-09-12T02:47:27.686919+0000","last_peered":"2024-09-12T02:47:27.686919+0000","last_clean":"2024-09-12T02:47:27.686919+0000","last_became_active":"2024-09-12T02:47:26.677011+0000","last_became_peered":"2024-09-12T02:47:26.677011+0000","last_unstale":"2024-09-12T02:47:27.686919+0000","last_undegraded":"2024-09-12T02:47:27.686919+0000","last_fullsized":"2024-09-12T02:47:27.686919+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:42.731916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.685430+0000","last_change":"2024-09-12T02:47:27.685114+0000","last_active":"2024-09-12T02:47:27.685430+0000","last_peered":"2024-09-12T02:47:27.685430+0000","last_clean":"2024-09-12T02:47:27.685430+0000","last_became_active":"2024-09-12T02:47:27.684790+0000","last_became_peered":"2024-09-12T02:47:27.684790+0000","last_unstale":"2024-09-12T02:47:27.685430+0000","last_undegraded":"2024-09-12T02:47:27.685430+0000","last_fullsized":"2024-09-12T02:47:27.685430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:33:54.266816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.682307+0000","last_change":"2024-09-12T02:47:26.668679+0000","last_active":"2024-09-12T02:47:27.682307+0000","last_peered":"2024-09-12T02:47:27.682307+0000","last_clean":"2024-09-12T02:47:27.682307+0000","last_became_active":"2024-09-12T02:47:26.668435+0000","last_became_peered":"2024-09-12T02:47:26.668435+0000","last_unstale":"2024-09-12T02:47:27.682307+0000","last_undegraded":"2024-09-12T02:47:27.682307+0000","last_fullsized":"2024-09-12T02:47:27.682307+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:33.606056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.690030+0000","last_change":"2024-09-12T02:47:27.689529+0000","last_active":"2024-09-12T02:47:27.690030+0000","last_peered":"2024-09-12T02:47:27.690030+0000","last_clean":"2024-09-12T02:47:27.690030+0000","last_became_active":"2024-09-12T02:47:27.689048+0000","last_became_peered":"2024-09-12T02:47:27.689048+0000","last_unstale":"2024-09-12T02:47:27.690030+0000","last_undegraded":"2024-09-12T02:47:27.690030+0000","last_fullsized":"2024-09-12T02:47:27.690030+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:36.104509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"119'3","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.705063+0000","last_change":"2024-09-12T02:47:26.675495+0000","last_active":"2024-09-12T02:47:27.705063+0000","last_peered":"2024-09-12T02:47:27.705063+0000","last_clean":"2024-09-12T02:47:27.705063+0000","last_became_active":"2024-09-12T02:47:26.675301+0000","last_became_peered":"2024-09-12T02:47:26.675301+0000","last_unstale":"2024-09-12T02:47:27.705063+0000","last_undegraded":"2024-09-12T02:47:27.705063+0000","last_fullsized":"2024-09-12T02:47:27.705063+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:00.685763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.690286+0000","last_change":"2024-09-12T02:47:27.689597+0000","last_active":"2024-09-12T02:47:27.690286+0000","last_peered":"2024-09-12T02:47:27.690286+0000","last_clean":"2024-09-12T02:47:27.690286+0000","last_became_active":"2024-09-12T02:47:27.689370+0000","last_became_peered":"2024-09-12T02:47:27.689370+0000","last_unstale":"2024-09-12T02:47:27.690286+0000","last_undegraded":"2024-09-12T02:47:27.690286+0000","last_fullsized":"2024-09-12T02:47:27.690286+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:29.801323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"119'6","reported_seq":18,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.708663+0000","last_change":"2024-09-12T02:47:26.673208+0000","last_active":"2024-09-12T02:47:27.708663+0000","last_peered":"2024-09-12T02:47:27.708663+0000","last_clean":"2024-09-12T02:47:27.708663+0000","last_became_active":"2024-09-12T02:47:26.670061+0000","last_became_peered":"2024-09-12T02:47:26.670061+0000","last_unstale":"2024-09-12T02:47:27.708663+0000","last_undegraded":"2024-09-12T02:47:27.708663+0000","last_fullsized":"2024-09-12T02:47:27.708663+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:11.042816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.693991+0000","last_change":"2024-09-12T02:47:27.693233+0000","last_active":"2024-09-12T02:47:27.693991+0000","last_peered":"2024-09-12T02:47:27.693991+0000","last_clean":"2024-09-12T02:47:27.693991+0000","last_became_active":"2024-09-12T02:47:27.692443+0000","last_became_peered":"2024-09-12T02:47:27.692443+0000","last_unstale":"2024-09-12T02:47:27.693991+0000","last_undegraded":"2024-09-12T02:47:27.693991+0000","last_fullsized":"2024-09-12T02:47:27.693991+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:40.517809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"119'2","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.707468+0000","last_change":"2024-09-12T02:47:26.678465+0000","last_active":"2024-09-12T02:47:27.707468+0000","last_peered":"2024-09-12T02:47:27.707468+0000","last_clean":"2024-09-12T02:47:27.707468+0000","last_became_active":"2024-09-12T02:47:26.678250+0000","last_became_peered":"2024-09-12T02:47:26.678250+0000","last_unstale":"2024-09-12T02:47:27.707468+0000","last_undegraded":"2024-09-12T02:47:27.707468+0000","last_fullsized":"2024-09-12T02:47:27.707468+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:53.596286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.697279+0000","last_change":"2024-09-12T02:47:27.694569+0000","last_active":"2024-09-12T02:47:27.697279+0000","last_peered":"2024-09-12T02:47:27.697279+0000","last_clean":"2024-09-12T02:47:27.697279+0000","last_became_active":"2024-09-12T02:47:27.694271+0000","last_became_peered":"2024-09-12T02:47:27.694271+0000","last_unstale":"2024-09-12T02:47:27.697279+0000","last_undegraded":"2024-09-12T02:47:27.697279+0000","last_fullsized":"2024-09-12T02:47:27.697279+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:58.816725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.678816+0000","last_change":"2024-09-12T02:47:26.678931+0000","last_active":"2024-09-12T02:47:27.678816+0000","last_peered":"2024-09-12T02:47:27.678816+0000","last_clean":"2024-09-12T02:47:27.678816+0000","last_became_active":"2024-09-12T02:47:26.678698+0000","last_became_peered":"2024-09-12T02:47:26.678698+0000","last_unstale":"2024-09-12T02:47:27.678816+0000","last_undegraded":"2024-09-12T02:47:27.678816+0000","last_fullsized":"2024-09-12T02:47:27.678816+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:11.044464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.688725+0000","last_change":"2024-09-12T02:47:27.687119+0000","last_active":"2024-09-12T02:47:27.688725+0000","last_peered":"2024-09-12T02:47:27.688725+0000","last_clean":"2024-09-12T02:47:27.688725+0000","last_became_active":"2024-09-12T02:47:27.686885+0000","last_became_peered":"2024-09-12T02:47:27.686885+0000","last_unstale":"2024-09-12T02:47:27.688725+0000","last_undegraded":"2024-09-12T02:47:27.688725+0000","last_fullsized":"2024-09-12T02:47:27.688725+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:55.110333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.684262+0000","last_change":"2024-09-12T02:47:26.668261+0000","last_active":"2024-09-12T02:47:27.684262+0000","last_peered":"2024-09-12T02:47:27.684262+0000","last_clean":"2024-09-12T02:47:27.684262+0000","last_became_active":"2024-09-12T02:47:26.667996+0000","last_became_peered":"2024-09-12T02:47:26.667996+0000","last_unstale":"2024-09-12T02:47:27.684262+0000","last_undegraded":"2024-09-12T02:47:27.684262+0000","last_fullsized":"2024-09-12T02:47:27.684262+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:21.570255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.691791+0000","last_change":"2024-09-12T02:47:27.690467+0000","last_active":"2024-09-12T02:47:27.691791+0000","last_peered":"2024-09-12T02:47:27.691791+0000","last_clean":"2024-09-12T02:47:27.691791+0000","last_became_active":"2024-09-12T02:47:27.689288+0000","last_became_peered":"2024-09-12T02:47:27.689288+0000","last_unstale":"2024-09-12T02:47:27.691791+0000","last_undegraded":"2024-09-12T02:47:27.691791+0000","last_fullsized":"2024-09-12T02:47:27.691791+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:12.225847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"119'8","reported_seq":20,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.708448+0000","last_change":"2024-09-12T02:47:26.678631+0000","last_active":"2024-09-12T02:47:27.708448+0000","last_peered":"2024-09-12T02:47:27.708448+0000","last_clean":"2024-09-12T02:47:27.708448+0000","last_became_active":"2024-09-12T02:47:26.678403+0000","last_became_peered":"2024-09-12T02:47:26.678403+0000","last_unstale":"2024-09-12T02:47:27.708448+0000","last_undegraded":"2024-09-12T02:47:27.708448+0000","last_fullsized":"2024-09-12T02:47:27.708448+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:31.347534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.689500+0000","last_change":"2024-09-12T02:47:27.689305+0000","last_active":"2024-09-12T02:47:27.689500+0000","last_peered":"2024-09-12T02:47:27.689500+0000","last_clean":"2024-09-12T02:47:27.689500+0000","last_became_active":"2024-09-12T02:47:27.687497+0000","last_became_peered":"2024-09-12T02:47:27.687497+0000","last_unstale":"2024-09-12T02:47:27.689500+0000","last_undegraded":"2024-09-12T02:47:27.689500+0000","last_fullsized":"2024-09-12T02:47:27.689500+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:25.106167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"119'2","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.706814+0000","last_change":"2024-09-12T02:47:26.674894+0000","last_active":"2024-09-12T02:47:27.706814+0000","last_peered":"2024-09-12T02:47:27.706814+0000","last_clean":"2024-09-12T02:47:27.706814+0000","last_became_active":"2024-09-12T02:47:26.674514+0000","last_became_peered":"2024-09-12T02:47:26.674514+0000","last_unstale":"2024-09-12T02:47:27.706814+0000","last_undegraded":"2024-09-12T02:47:27.706814+0000","last_fullsized":"2024-09-12T02:47:27.706814+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:42.292386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.691229+0000","last_change":"2024-09-12T02:47:27.691078+0000","last_active":"2024-09-12T02:47:27.691229+0000","last_peered":"2024-09-12T02:47:27.691229+0000","last_clean":"2024-09-12T02:47:27.691229+0000","last_became_active":"2024-09-12T02:47:27.690787+0000","last_became_peered":"2024-09-12T02:47:27.690787+0000","last_unstale":"2024-09-12T02:47:27.691229+0000","last_undegraded":"2024-09-12T02:47:27.691229+0000","last_fullsized":"2024-09-12T02:47:27.691229+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:27.976666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"119'1","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.704855+0000","last_change":"2024-09-12T02:47:26.664687+0000","last_active":"2024-09-12T02:47:27.704855+0000","last_peered":"2024-09-12T02:47:27.704855+0000","last_clean":"2024-09-12T02:47:27.704855+0000","last_became_active":"2024-09-12T02:47:26.664423+0000","last_became_peered":"2024-09-12T02:47:26.664423+0000","last_unstale":"2024-09-12T02:47:27.704855+0000","last_undegraded":"2024-09-12T02:47:27.704855+0000","last_fullsized":"2024-09-12T02:47:27.704855+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:33:50.102994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.695257+0000","last_change":"2024-09-12T02:47:27.695120+0000","last_active":"2024-09-12T02:47:27.695257+0000","last_peered":"2024-09-12T02:47:27.695257+0000","last_clean":"2024-09-12T02:47:27.695257+0000","last_became_active":"2024-09-12T02:47:27.694696+0000","last_became_peered":"2024-09-12T02:47:27.694696+0000","last_unstale":"2024-09-12T02:47:27.695257+0000","last_undegraded":"2024-09-12T02:47:27.695257+0000","last_fullsized":"2024-09-12T02:47:27.695257+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:41.625246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.687622+0000","last_change":"2024-09-12T02:47:26.677819+0000","last_active":"2024-09-12T02:47:27.687622+0000","last_peered":"2024-09-12T02:47:27.687622+0000","last_clean":"2024-09-12T02:47:27.687622+0000","last_became_active":"2024-09-12T02:47:26.674869+0000","last_became_peered":"2024-09-12T02:47:26.674869+0000","last_unstale":"2024-09-12T02:47:27.687622+0000","last_undegraded":"2024-09-12T02:47:27.687622+0000","last_fullsized":"2024-09-12T02:47:27.687622+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:36.110077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.685312+0000","last_change":"2024-09-12T02:47:27.684946+0000","last_active":"2024-09-12T02:47:27.685312+0000","last_peered":"2024-09-12T02:47:27.685312+0000","last_clean":"2024-09-12T02:47:27.685312+0000","last_became_active":"2024-09-12T02:47:27.684579+0000","last_became_peered":"2024-09-12T02:47:27.684579+0000","last_unstale":"2024-09-12T02:47:27.685312+0000","last_undegraded":"2024-09-12T02:47:27.685312+0000","last_fullsized":"2024-09-12T02:47:27.685312+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:14.882590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"119'2","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.706697+0000","last_change":"2024-09-12T02:47:26.681065+0000","last_active":"2024-09-12T02:47:27.706697+0000","last_peered":"2024-09-12T02:47:27.706697+0000","last_clean":"2024-09-12T02:47:27.706697+0000","last_became_active":"2024-09-12T02:47:26.680800+0000","last_became_peered":"2024-09-12T02:47:26.680800+0000","last_unstale":"2024-09-12T02:47:27.706697+0000","last_undegraded":"2024-09-12T02:47:27.706697+0000","last_fullsized":"2024-09-12T02:47:27.706697+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:21.344359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.691807+0000","last_change":"2024-09-12T02:47:27.690522+0000","last_active":"2024-09-12T02:47:27.691807+0000","last_peered":"2024-09-12T02:47:27.691807+0000","last_clean":"2024-09-12T02:47:27.691807+0000","last_became_active":"2024-09-12T02:47:27.690152+0000","last_became_peered":"2024-09-12T02:47:27.690152+0000","last_unstale":"2024-09-12T02:47:27.691807+0000","last_undegraded":"2024-09-12T02:47:27.691807+0000","last_fullsized":"2024-09-12T02:47:27.691807+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:01.749062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.681991+0000","last_change":"2024-09-12T02:47:26.668545+0000","last_active":"2024-09-12T02:47:27.681991+0000","last_peered":"2024-09-12T02:47:27.681991+0000","last_clean":"2024-09-12T02:47:27.681991+0000","last_became_active":"2024-09-12T02:47:26.668291+0000","last_became_peered":"2024-09-12T02:47:26.668291+0000","last_unstale":"2024-09-12T02:47:27.681991+0000","last_undegraded":"2024-09-12T02:47:27.681991+0000","last_fullsized":"2024-09-12T02:47:27.681991+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:41.347586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.691698+0000","last_change":"2024-09-12T02:47:27.688043+0000","last_active":"2024-09-12T02:47:27.691698+0000","last_peered":"2024-09-12T02:47:27.691698+0000","last_clean":"2024-09-12T02:47:27.691698+0000","last_became_active":"2024-09-12T02:47:27.686730+0000","last_became_peered":"2024-09-12T02:47:27.686730+0000","last_unstale":"2024-09-12T02:47:27.691698+0000","last_undegraded":"2024-09-12T02:47:27.691698+0000","last_fullsized":"2024-09-12T02:47:27.691698+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:23.462376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.682410+0000","last_change":"2024-09-12T02:47:26.666835+0000","last_active":"2024-09-12T02:47:27.682410+0000","last_peered":"2024-09-12T02:47:27.682410+0000","last_clean":"2024-09-12T02:47:27.682410+0000","last_became_active":"2024-09-12T02:47:26.666435+0000","last_became_peered":"2024-09-12T02:47:26.666435+0000","last_unstale":"2024-09-12T02:47:27.682410+0000","last_undegraded":"2024-09-12T02:47:27.682410+0000","last_fullsized":"2024-09-12T02:47:27.682410+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:15:08.404781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.697551+0000","last_change":"2024-09-12T02:47:27.697428+0000","last_active":"2024-09-12T02:47:27.697551+0000","last_peered":"2024-09-12T02:47:27.697551+0000","last_clean":"2024-09-12T02:47:27.697551+0000","last_became_active":"2024-09-12T02:47:27.696698+0000","last_became_peered":"2024-09-12T02:47:27.696698+0000","last_unstale":"2024-09-12T02:47:27.697551+0000","last_undegraded":"2024-09-12T02:47:27.697551+0000","last_fullsized":"2024-09-12T02:47:27.697551+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:54.538449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.687117+0000","last_change":"2024-09-12T02:47:26.679601+0000","last_active":"2024-09-12T02:47:27.687117+0000","last_peered":"2024-09-12T02:47:27.687117+0000","last_clean":"2024-09-12T02:47:27.687117+0000","last_became_active":"2024-09-12T02:47:26.679176+0000","last_became_peered":"2024-09-12T02:47:26.679176+0000","last_unstale":"2024-09-12T02:47:27.687117+0000","last_undegraded":"2024-09-12T02:47:27.687117+0000","last_fullsized":"2024-09-12T02:47:27.687117+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:04.018242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.695019+0000","last_change":"2024-09-12T02:47:27.693059+0000","last_active":"2024-09-12T02:47:27.695019+0000","last_peered":"2024-09-12T02:47:27.695019+0000","last_clean":"2024-09-12T02:47:27.695019+0000","last_became_active":"2024-09-12T02:47:27.692210+0000","last_became_peered":"2024-09-12T02:47:27.692210+0000","last_unstale":"2024-09-12T02:47:27.695019+0000","last_undegraded":"2024-09-12T02:47:27.695019+0000","last_fullsized":"2024-09-12T02:47:27.695019+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:45.828133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"119'2","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.703434+0000","last_change":"2024-09-12T02:47:26.667152+0000","last_active":"2024-09-12T02:47:27.703434+0000","last_peered":"2024-09-12T02:47:27.703434+0000","last_clean":"2024-09-12T02:47:27.703434+0000","last_became_active":"2024-09-12T02:47:26.666895+0000","last_became_peered":"2024-09-12T02:47:26.666895+0000","last_unstale":"2024-09-12T02:47:27.703434+0000","last_undegraded":"2024-09-12T02:47:27.703434+0000","last_fullsized":"2024-09-12T02:47:27.703434+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:11.268649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.697298+0000","last_change":"2024-09-12T02:47:27.694722+0000","last_active":"2024-09-12T02:47:27.697298+0000","last_peered":"2024-09-12T02:47:27.697298+0000","last_clean":"2024-09-12T02:47:27.697298+0000","last_became_active":"2024-09-12T02:47:27.694504+0000","last_became_peered":"2024-09-12T02:47:27.694504+0000","last_unstale":"2024-09-12T02:47:27.697298+0000","last_undegraded":"2024-09-12T02:47:27.697298+0000","last_fullsized":"2024-09-12T02:47:27.697298+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:05.302834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.686466+0000","last_change":"2024-09-12T02:47:26.676632+0000","last_active":"2024-09-12T02:47:27.686466+0000","last_peered":"2024-09-12T02:47:27.686466+0000","last_clean":"2024-09-12T02:47:27.686466+0000","last_became_active":"2024-09-12T02:47:26.675659+0000","last_became_peered":"2024-09-12T02:47:26.675659+0000","last_unstale":"2024-09-12T02:47:27.686466+0000","last_undegraded":"2024-09-12T02:47:27.686466+0000","last_fullsized":"2024-09-12T02:47:27.686466+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:24.298219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.697218+0000","last_change":"2024-09-12T02:47:27.693269+0000","last_active":"2024-09-12T02:47:27.697218+0000","last_peered":"2024-09-12T02:47:27.697218+0000","last_clean":"2024-09-12T02:47:27.697218+0000","last_became_active":"2024-09-12T02:47:27.692951+0000","last_became_peered":"2024-09-12T02:47:27.692951+0000","last_unstale":"2024-09-12T02:47:27.697218+0000","last_undegraded":"2024-09-12T02:47:27.697218+0000","last_fullsized":"2024-09-12T02:47:27.697218+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:50.597597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.683701+0000","last_change":"2024-09-12T02:47:26.680696+0000","last_active":"2024-09-12T02:47:27.683701+0000","last_peered":"2024-09-12T02:47:27.683701+0000","last_clean":"2024-09-12T02:47:27.683701+0000","last_became_active":"2024-09-12T02:47:26.680337+0000","last_became_peered":"2024-09-12T02:47:26.680337+0000","last_unstale":"2024-09-12T02:47:27.683701+0000","last_undegraded":"2024-09-12T02:47:27.683701+0000","last_fullsized":"2024-09-12T02:47:27.683701+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:12.732931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.686050+0000","last_change":"2024-09-12T02:47:27.683284+0000","last_active":"2024-09-12T02:47:27.686050+0000","last_peered":"2024-09-12T02:47:27.686050+0000","last_clean":"2024-09-12T02:47:27.686050+0000","last_became_active":"2024-09-12T02:47:27.683042+0000","last_became_peered":"2024-09-12T02:47:27.683042+0000","last_unstale":"2024-09-12T02:47:27.686050+0000","last_undegraded":"2024-09-12T02:47:27.686050+0000","last_fullsized":"2024-09-12T02:47:27.686050+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:06.351070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.681434+0000","last_change":"2024-09-12T02:47:26.672696+0000","last_active":"2024-09-12T02:47:27.681434+0000","last_peered":"2024-09-12T02:47:27.681434+0000","last_clean":"2024-09-12T02:47:27.681434+0000","last_became_active":"2024-09-12T02:47:26.672386+0000","last_became_peered":"2024-09-12T02:47:26.672386+0000","last_unstale":"2024-09-12T02:47:27.681434+0000","last_undegraded":"2024-09-12T02:47:27.681434+0000","last_fullsized":"2024-09-12T02:47:27.681434+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:00.281238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.691774+0000","last_change":"2024-09-12T02:47:27.690279+0000","last_active":"2024-09-12T02:47:27.691774+0000","last_peered":"2024-09-12T02:47:27.691774+0000","last_clean":"2024-09-12T02:47:27.691774+0000","last_became_active":"2024-09-12T02:47:27.688962+0000","last_became_peered":"2024-09-12T02:47:27.688962+0000","last_unstale":"2024-09-12T02:47:27.691774+0000","last_undegraded":"2024-09-12T02:47:27.691774+0000","last_fullsized":"2024-09-12T02:47:27.691774+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:22.903893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.687250+0000","last_change":"2024-09-12T02:47:26.672251+0000","last_active":"2024-09-12T02:47:27.687250+0000","last_peered":"2024-09-12T02:47:27.687250+0000","last_clean":"2024-09-12T02:47:27.687250+0000","last_became_active":"2024-09-12T02:47:26.671988+0000","last_became_peered":"2024-09-12T02:47:26.671988+0000","last_unstale":"2024-09-12T02:47:27.687250+0000","last_undegraded":"2024-09-12T02:47:27.687250+0000","last_fullsized":"2024-09-12T02:47:27.687250+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:29.382665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.692778+0000","last_change":"2024-09-12T02:47:27.692030+0000","last_active":"2024-09-12T02:47:27.692778+0000","last_peered":"2024-09-12T02:47:27.692778+0000","last_clean":"2024-09-12T02:47:27.692778+0000","last_became_active":"2024-09-12T02:47:27.691680+0000","last_became_peered":"2024-09-12T02:47:27.691680+0000","last_unstale":"2024-09-12T02:47:27.692778+0000","last_undegraded":"2024-09-12T02:47:27.692778+0000","last_fullsized":"2024-09-12T02:47:27.692778+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:51.209610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.679688+0000","last_change":"2024-09-12T02:47:26.671377+0000","last_active":"2024-09-12T02:47:27.679688+0000","last_peered":"2024-09-12T02:47:27.679688+0000","last_clean":"2024-09-12T02:47:27.679688+0000","last_became_active":"2024-09-12T02:47:26.670693+0000","last_became_peered":"2024-09-12T02:47:26.670693+0000","last_unstale":"2024-09-12T02:47:27.679688+0000","last_undegraded":"2024-09-12T02:47:27.679688+0000","last_fullsized":"2024-09-12T02:47:27.679688+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:26.386804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.686462+0000","last_change":"2024-09-12T02:47:27.686319+0000","last_active":"2024-09-12T02:47:27.686462+0000","last_peered":"2024-09-12T02:47:27.686462+0000","last_clean":"2024-09-12T02:47:27.686462+0000","last_became_active":"2024-09-12T02:47:27.686049+0000","last_became_peered":"2024-09-12T02:47:27.686049+0000","last_unstale":"2024-09-12T02:47:27.686462+0000","last_undegraded":"2024-09-12T02:47:27.686462+0000","last_fullsized":"2024-09-12T02:47:27.686462+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:30.509262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.683704+0000","last_change":"2024-09-12T02:47:26.670178+0000","last_active":"2024-09-12T02:47:27.683704+0000","last_peered":"2024-09-12T02:47:27.683704+0000","last_clean":"2024-09-12T02:47:27.683704+0000","last_became_active":"2024-09-12T02:47:26.669037+0000","last_became_peered":"2024-09-12T02:47:26.669037+0000","last_unstale":"2024-09-12T02:47:27.683704+0000","last_undegraded":"2024-09-12T02:47:27.683704+0000","last_fullsized":"2024-09-12T02:47:27.683704+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:55.469872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.688112+0000","last_change":"2024-09-12T02:47:27.686551+0000","last_active":"2024-09-12T02:47:27.688112+0000","last_peered":"2024-09-12T02:47:27.688112+0000","last_clean":"2024-09-12T02:47:27.688112+0000","last_became_active":"2024-09-12T02:47:27.685915+0000","last_became_peered":"2024-09-12T02:47:27.685915+0000","last_unstale":"2024-09-12T02:47:27.688112+0000","last_undegraded":"2024-09-12T02:47:27.688112+0000","last_fullsized":"2024-09-12T02:47:27.688112+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:44.608019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.679833+0000","last_change":"2024-09-12T02:47:26.680596+0000","last_active":"2024-09-12T02:47:27.679833+0000","last_peered":"2024-09-12T02:47:27.679833+0000","last_clean":"2024-09-12T02:47:27.679833+0000","last_became_active":"2024-09-12T02:47:26.680396+0000","last_became_peered":"2024-09-12T02:47:26.680396+0000","last_unstale":"2024-09-12T02:47:27.679833+0000","last_undegraded":"2024-09-12T02:47:27.679833+0000","last_fullsized":"2024-09-12T02:47:27.679833+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:37.880148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.685598+0000","last_change":"2024-09-12T02:47:27.685478+0000","last_active":"2024-09-12T02:47:27.685598+0000","last_peered":"2024-09-12T02:47:27.685598+0000","last_clean":"2024-09-12T02:47:27.685598+0000","last_became_active":"2024-09-12T02:47:27.685256+0000","last_became_peered":"2024-09-12T02:47:27.685256+0000","last_unstale":"2024-09-12T02:47:27.685598+0000","last_undegraded":"2024-09-12T02:47:27.685598+0000","last_fullsized":"2024-09-12T02:47:27.685598+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:30.153027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"119'1","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.703737+0000","last_change":"2024-09-12T02:47:26.673843+0000","last_active":"2024-09-12T02:47:27.703737+0000","last_peered":"2024-09-12T02:47:27.703737+0000","last_clean":"2024-09-12T02:47:27.703737+0000","last_became_active":"2024-09-12T02:47:26.673602+0000","last_became_peered":"2024-09-12T02:47:26.673602+0000","last_unstale":"2024-09-12T02:47:27.703737+0000","last_undegraded":"2024-09-12T02:47:27.703737+0000","last_fullsized":"2024-09-12T02:47:27.703737+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:05.116580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":363,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.690681+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:47:27.690681+0000","last_peered":"2024-09-12T02:47:27.690681+0000","last_clean":"2024-09-12T02:47:27.690681+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:47:27.690681+0000","last_undegraded":"2024-09-12T02:47:27.690681+0000","last_fullsized":"2024-09-12T02:47:27.690681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:25.823876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574919,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194104,"statfs":{"total":200000000,"available":198762502,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":639,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194673,"statfs":{"total":200000000,"available":199345443,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194680,"statfs":{"total":200000000,"available":199352870,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574919,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194680,"statfs":{"total":200000000,"available":199352870,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":640,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194672,"statfs":{"total":200000000,"available":199344461,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574919,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194680,"statfs":{"total":200000000,"available":199352870,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194680,"statfs":{"total":200000000,"available":199352870,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574919,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1215,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194096,"statfs":{"total":200000000,"available":198755145,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:47:31.867 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:47:32.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.055+0000 7feaf2e00640 1 Processor -- start 2024-09-12T02:47:32.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.055+0000 7feaf2e00640 1 -- start start 2024-09-12T02:47:32.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.056+0000 7feaf2e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feaec162510 0x7feaec0d58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:32.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.056+0000 7feaf2e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7feaec0b46e0 0x7feaec0b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:32.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.056+0000 7feaf2e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feaec0b5080 0x7feaec0d2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:32.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.056+0000 7feaf2e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7feaec0b5530 con 0x7feaec0b5080 2024-09-12T02:47:32.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.056+0000 7feaf2e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7feaec0b1c30 con 0x7feaec0b46e0 2024-09-12T02:47:32.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.056+0000 7feaf2e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7feaec0b1f10 con 0x7feaec162510 2024-09-12T02:47:32.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.056+0000 7feaf2400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feaec0b5080 0x7feaec0d2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:32.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.056+0000 7feaf2400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feaec0b5080 0x7feaec0d2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59150/0 (socket says 172.21.15.112:59150) 2024-09-12T02:47:32.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.056+0000 7feaf2400640 1 -- 172.21.15.112:0/2981466324 learned_addr learned my addr 172.21.15.112:0/2981466324 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:32.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.056+0000 7feaf1a00640 1 --2- 172.21.15.112:0/2981466324 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feaec162510 0x7feaec0d58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:32.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.056+0000 7feaf1000640 1 --2- 172.21.15.112:0/2981466324 >> v2:172.21.15.137:3300/0 conn(0x7feaec0b46e0 0x7feaec0b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:32.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.057+0000 7feaf2400640 1 -- 172.21.15.112:0/2981466324 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feaec162510 msgr2=0x7feaec0d58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:32.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.057+0000 7feaf2400640 1 --2- 172.21.15.112:0/2981466324 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feaec162510 0x7feaec0d58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:32.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.057+0000 7feaf2400640 1 -- 172.21.15.112:0/2981466324 >> v2:172.21.15.137:3300/0 conn(0x7feaec0b46e0 msgr2=0x7feaec0b4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:32.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.057+0000 7feaf2400640 1 --2- 172.21.15.112:0/2981466324 >> v2:172.21.15.137:3300/0 conn(0x7feaec0b46e0 0x7feaec0b4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:32.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.057+0000 7feaf2400640 1 -- 172.21.15.112:0/2981466324 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaec0b21f0 con 0x7feaec0b5080 2024-09-12T02:47:32.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.057+0000 7feaf1000640 1 --2- 172.21.15.112:0/2981466324 >> v2:172.21.15.137:3300/0 conn(0x7feaec0b46e0 0x7feaec0b4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:32.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.058+0000 7feaf2400640 1 --2- 172.21.15.112:0/2981466324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaec0b5080 0x7feaec0d2cf0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7feaec08d7c0 tx=0x7feae402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4231b3609154593 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:32.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.058+0000 7feaebe00640 1 -- 172.21.15.112:0/2981466324 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae4036070 con 0x7feaec0b5080 2024-09-12T02:47:32.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.058+0000 7feaebe00640 1 -- 172.21.15.112:0/2981466324 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feae4031600 con 0x7feaec0b5080 2024-09-12T02:47:32.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.058+0000 7feaebe00640 1 -- 172.21.15.112:0/2981466324 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae40319d0 con 0x7feaec0b5080 2024-09-12T02:47:32.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.058+0000 7feaf2e00640 1 -- 172.21.15.112:0/2981466324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaec0b5080 msgr2=0x7feaec0d2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:32.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.058+0000 7feaf2e00640 1 --2- 172.21.15.112:0/2981466324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaec0b5080 0x7feaec0d2cf0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7feaec08d7c0 tx=0x7feae402a6a0 comp rx=0 tx=0).stop 2024-09-12T02:47:32.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.059+0000 7feaf2e00640 1 -- 172.21.15.112:0/2981466324 shutdown_connections 2024-09-12T02:47:32.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.059+0000 7feaf2e00640 1 --2- 172.21.15.112:0/2981466324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaec0b5080 0x7feaec0d2cf0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:32.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.059+0000 7feaf2e00640 1 --2- 172.21.15.112:0/2981466324 >> v2:172.21.15.137:3300/0 conn(0x7feaec0b46e0 0x7feaec0b4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:32.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.059+0000 7feaf2e00640 1 --2- 172.21.15.112:0/2981466324 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feaec162510 0x7feaec0d58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:32.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.059+0000 7feaf2e00640 1 -- 172.21.15.112:0/2981466324 >> 172.21.15.112:0/2981466324 conn(0x7feaec0d4d80 msgr2=0x7feaec0d5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:32.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.059+0000 7feaf2e00640 1 -- 172.21.15.112:0/2981466324 shutdown_connections 2024-09-12T02:47:32.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.059+0000 7feaf2e00640 1 -- 172.21.15.112:0/2981466324 wait complete. 2024-09-12T02:47:32.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.060+0000 7feaf2e00640 1 Processor -- start 2024-09-12T02:47:32.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.060+0000 7feaf2e00640 1 -- start start 2024-09-12T02:47:32.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.061+0000 7feaf2e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feaec0b46e0 0x7feaec15ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:32.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.061+0000 7feaf2e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaec0b5080 0x7feaec1f7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:32.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.061+0000 7feaf2e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feaec162510 0x7feaec15be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:32.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.061+0000 7feaf2e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7feaec1628f0 con 0x7feaec0b5080 2024-09-12T02:47:32.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.061+0000 7feaf2e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7feaec0b27b0 con 0x7feaec162510 2024-09-12T02:47:32.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.061+0000 7feaf2e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7feaec0d3230 con 0x7feaec0b46e0 2024-09-12T02:47:32.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.061+0000 7feaf1000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaec0b5080 0x7feaec1f7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:32.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.061+0000 7feaf1000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaec0b5080 0x7feaec1f7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59166/0 (socket says 172.21.15.112:59166) 2024-09-12T02:47:32.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.061+0000 7feaf1000640 1 -- 172.21.15.112:0/4248167260 learned_addr learned my addr 172.21.15.112:0/4248167260 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:32.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.062+0000 7feaf1a00640 1 --2- 172.21.15.112:0/4248167260 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feaec0b46e0 0x7feaec15ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:32.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.062+0000 7feaf1000640 1 -- 172.21.15.112:0/4248167260 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feaec0b46e0 msgr2=0x7feaec15ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:32.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.062+0000 7feaf2400640 1 --2- 172.21.15.112:0/4248167260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feaec162510 0x7feaec15be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:32.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.062+0000 7feaf1000640 1 --2- 172.21.15.112:0/4248167260 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feaec0b46e0 0x7feaec15ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:32.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.062+0000 7feaf1000640 1 -- 172.21.15.112:0/4248167260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feaec162510 msgr2=0x7feaec15be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:32.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.062+0000 7feaf1000640 1 --2- 172.21.15.112:0/4248167260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feaec162510 0x7feaec15be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:32.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.062+0000 7feaf1000640 1 -- 172.21.15.112:0/4248167260 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaec0b9790 con 0x7feaec0b5080 2024-09-12T02:47:32.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.062+0000 7feaf1a00640 1 --2- 172.21.15.112:0/4248167260 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feaec0b46e0 0x7feaec15ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:32.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.062+0000 7feaf2400640 1 --2- 172.21.15.112:0/4248167260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feaec162510 0x7feaec15be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:32.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.062+0000 7feaf1000640 1 --2- 172.21.15.112:0/4248167260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaec0b5080 0x7feaec1f7af0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fead800e810 tx=0x7fead800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:32.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.062+0000 7feae9600640 1 -- 172.21.15.112:0/4248167260 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead8017070 con 0x7feaec0b5080 2024-09-12T02:47:32.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.062+0000 7feae9600640 1 -- 172.21.15.112:0/4248167260 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fead800c6d0 con 0x7feaec0b5080 2024-09-12T02:47:32.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.062+0000 7feaf2e00640 1 -- 172.21.15.112:0/4248167260 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaec0b9a70 con 0x7feaec0b5080 2024-09-12T02:47:32.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.062+0000 7feae9600640 1 -- 172.21.15.112:0/4248167260 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead800f040 con 0x7feaec0b5080 2024-09-12T02:47:32.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.063+0000 7feaf2e00640 1 -- 172.21.15.112:0/4248167260 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaec0ba030 con 0x7feaec0b5080 2024-09-12T02:47:32.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.064+0000 7feaf2e00640 1 -- 172.21.15.112:0/4248167260 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaec0b4b40 con 0x7feaec0b5080 2024-09-12T02:47:32.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.065+0000 7feae9600640 1 -- 172.21.15.112:0/4248167260 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fead801a070 con 0x7feaec0b5080 2024-09-12T02:47:32.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.065+0000 7feae9600640 1 --2- 172.21.15.112:0/4248167260 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7feacc06be30 0x7feacc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:32.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.065+0000 7feae9600640 1 -- 172.21.15.112:0/4248167260 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7fead808ab40 con 0x7feaec0b5080 2024-09-12T02:47:32.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.066+0000 7feaf1a00640 1 --2- 172.21.15.112:0/4248167260 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7feacc06be30 0x7feacc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:32.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.066+0000 7feaf1a00640 1 --2- 172.21.15.112:0/4248167260 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7feacc06be30 0x7feacc06e2f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7feae0006fd0 tx=0x7feae0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:32.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.070+0000 7feae9600640 1 -- 172.21.15.112:0/4248167260 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fead80593c0 con 0x7feaec0b5080 2024-09-12T02:47:32.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.239+0000 7feaf2e00640 1 -- 172.21.15.112:0/4248167260 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feaec0b44c0 con 0x7feacc06be30 2024-09-12T02:47:32.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.245+0000 7feae9600640 1 -- 172.21.15.112:0/4248167260 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247921 (secure 0 0 0) 0x7feaec0b44c0 con 0x7feacc06be30 2024-09-12T02:47:32.248 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:32.249 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:47:32.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.248+0000 7feaf2e00640 1 -- 172.21.15.112:0/4248167260 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7feacc06be30 msgr2=0x7feacc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:32.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.248+0000 7feaf2e00640 1 --2- 172.21.15.112:0/4248167260 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7feacc06be30 0x7feacc06e2f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7feae0006fd0 tx=0x7feae0008040 comp rx=0 tx=0).stop 2024-09-12T02:47:32.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.248+0000 7feaf2e00640 1 -- 172.21.15.112:0/4248167260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaec0b5080 msgr2=0x7feaec1f7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:32.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.248+0000 7feaf2e00640 1 --2- 172.21.15.112:0/4248167260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaec0b5080 0x7feaec1f7af0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fead800e810 tx=0x7fead800ecd0 comp rx=0 tx=0).stop 2024-09-12T02:47:32.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.248+0000 7feaf2e00640 1 -- 172.21.15.112:0/4248167260 shutdown_connections 2024-09-12T02:47:32.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.248+0000 7feaf2e00640 1 --2- 172.21.15.112:0/4248167260 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7feacc06be30 0x7feacc06e2f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:32.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.248+0000 7feaf2e00640 1 --2- 172.21.15.112:0/4248167260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feaec162510 0x7feaec15be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:32.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.248+0000 7feaf2e00640 1 --2- 172.21.15.112:0/4248167260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaec0b5080 0x7feaec1f7af0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:32.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.248+0000 7feaf2e00640 1 --2- 172.21.15.112:0/4248167260 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feaec0b46e0 0x7feaec15ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:32.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.248+0000 7feaf2e00640 1 -- 172.21.15.112:0/4248167260 >> 172.21.15.112:0/4248167260 conn(0x7feaec0d4d80 msgr2=0x7feaec0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:32.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.249+0000 7feaf2e00640 1 -- 172.21.15.112:0/4248167260 shutdown_connections 2024-09-12T02:47:32.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.249+0000 7feaf2e00640 1 -- 172.21.15.112:0/4248167260 wait complete. 2024-09-12T02:47:32.263 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":286,"stamp":"2024-09-12T02:47:31.033273+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":70,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6231,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556268,"statfs":{"total":1600000000,"available":1593619031,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.375070"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.692268+0000","last_change":"2024-09-12T02:47:27.690771+0000","last_active":"2024-09-12T02:47:27.692268+0000","last_peered":"2024-09-12T02:47:27.692268+0000","last_clean":"2024-09-12T02:47:27.692268+0000","last_became_active":"2024-09-12T02:47:27.688477+0000","last_became_peered":"2024-09-12T02:47:27.688477+0000","last_unstale":"2024-09-12T02:47:27.692268+0000","last_undegraded":"2024-09-12T02:47:27.692268+0000","last_fullsized":"2024-09-12T02:47:27.692268+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:06.824312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.694999+0000","last_change":"2024-09-12T02:47:27.692140+0000","last_active":"2024-09-12T02:47:27.694999+0000","last_peered":"2024-09-12T02:47:27.694999+0000","last_clean":"2024-09-12T02:47:27.694999+0000","last_became_active":"2024-09-12T02:47:27.691723+0000","last_became_peered":"2024-09-12T02:47:27.691723+0000","last_unstale":"2024-09-12T02:47:27.694999+0000","last_undegraded":"2024-09-12T02:47:27.694999+0000","last_fullsized":"2024-09-12T02:47:27.694999+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:09.446258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.689782+0000","last_change":"2024-09-12T02:47:27.687061+0000","last_active":"2024-09-12T02:47:27.689782+0000","last_peered":"2024-09-12T02:47:27.689782+0000","last_clean":"2024-09-12T02:47:27.689782+0000","last_became_active":"2024-09-12T02:47:27.686823+0000","last_became_peered":"2024-09-12T02:47:27.686823+0000","last_unstale":"2024-09-12T02:47:27.689782+0000","last_undegraded":"2024-09-12T02:47:27.689782+0000","last_fullsized":"2024-09-12T02:47:27.689782+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:28.888507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.683640+0000","last_change":"2024-09-12T02:47:27.683244+0000","last_active":"2024-09-12T02:47:27.683640+0000","last_peered":"2024-09-12T02:47:27.683640+0000","last_clean":"2024-09-12T02:47:27.683640+0000","last_became_active":"2024-09-12T02:47:27.682923+0000","last_became_peered":"2024-09-12T02:47:27.682923+0000","last_unstale":"2024-09-12T02:47:27.683640+0000","last_undegraded":"2024-09-12T02:47:27.683640+0000","last_fullsized":"2024-09-12T02:47:27.683640+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:36.151018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.686129+0000","last_change":"2024-09-12T02:47:27.685599+0000","last_active":"2024-09-12T02:47:27.686129+0000","last_peered":"2024-09-12T02:47:27.686129+0000","last_clean":"2024-09-12T02:47:27.686129+0000","last_became_active":"2024-09-12T02:47:27.684971+0000","last_became_peered":"2024-09-12T02:47:27.684971+0000","last_unstale":"2024-09-12T02:47:27.686129+0000","last_undegraded":"2024-09-12T02:47:27.686129+0000","last_fullsized":"2024-09-12T02:47:27.686129+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:47.263324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.696103+0000","last_change":"2024-09-12T02:47:27.695854+0000","last_active":"2024-09-12T02:47:27.696103+0000","last_peered":"2024-09-12T02:47:27.696103+0000","last_clean":"2024-09-12T02:47:27.696103+0000","last_became_active":"2024-09-12T02:47:27.695572+0000","last_became_peered":"2024-09-12T02:47:27.695572+0000","last_unstale":"2024-09-12T02:47:27.696103+0000","last_undegraded":"2024-09-12T02:47:27.696103+0000","last_fullsized":"2024-09-12T02:47:27.696103+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:10.441792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.691695+0000","last_change":"2024-09-12T02:47:27.691523+0000","last_active":"2024-09-12T02:47:27.691695+0000","last_peered":"2024-09-12T02:47:27.691695+0000","last_clean":"2024-09-12T02:47:27.691695+0000","last_became_active":"2024-09-12T02:47:27.690829+0000","last_became_peered":"2024-09-12T02:47:27.690829+0000","last_unstale":"2024-09-12T02:47:27.691695+0000","last_undegraded":"2024-09-12T02:47:27.691695+0000","last_fullsized":"2024-09-12T02:47:27.691695+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:29.225131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.695607+0000","last_change":"2024-09-12T02:47:27.694982+0000","last_active":"2024-09-12T02:47:27.695607+0000","last_peered":"2024-09-12T02:47:27.695607+0000","last_clean":"2024-09-12T02:47:27.695607+0000","last_became_active":"2024-09-12T02:47:27.694650+0000","last_became_peered":"2024-09-12T02:47:27.694650+0000","last_unstale":"2024-09-12T02:47:27.695607+0000","last_undegraded":"2024-09-12T02:47:27.695607+0000","last_fullsized":"2024-09-12T02:47:27.695607+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:11.661244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.688747+0000","last_change":"2024-09-12T02:47:27.688494+0000","last_active":"2024-09-12T02:47:27.688747+0000","last_peered":"2024-09-12T02:47:27.688747+0000","last_clean":"2024-09-12T02:47:27.688747+0000","last_became_active":"2024-09-12T02:47:27.688229+0000","last_became_peered":"2024-09-12T02:47:27.688229+0000","last_unstale":"2024-09-12T02:47:27.688747+0000","last_undegraded":"2024-09-12T02:47:27.688747+0000","last_fullsized":"2024-09-12T02:47:27.688747+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:14.653644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.697728+0000","last_change":"2024-09-12T02:47:27.697630+0000","last_active":"2024-09-12T02:47:27.697728+0000","last_peered":"2024-09-12T02:47:27.697728+0000","last_clean":"2024-09-12T02:47:27.697728+0000","last_became_active":"2024-09-12T02:47:27.697058+0000","last_became_peered":"2024-09-12T02:47:27.697058+0000","last_unstale":"2024-09-12T02:47:27.697728+0000","last_undegraded":"2024-09-12T02:47:27.697728+0000","last_fullsized":"2024-09-12T02:47:27.697728+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:52.826179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.695195+0000","last_change":"2024-09-12T02:47:27.694906+0000","last_active":"2024-09-12T02:47:27.695195+0000","last_peered":"2024-09-12T02:47:27.695195+0000","last_clean":"2024-09-12T02:47:27.695195+0000","last_became_active":"2024-09-12T02:47:27.694434+0000","last_became_peered":"2024-09-12T02:47:27.694434+0000","last_unstale":"2024-09-12T02:47:27.695195+0000","last_undegraded":"2024-09-12T02:47:27.695195+0000","last_fullsized":"2024-09-12T02:47:27.695195+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:49.777155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.693973+0000","last_change":"2024-09-12T02:47:27.693644+0000","last_active":"2024-09-12T02:47:27.693973+0000","last_peered":"2024-09-12T02:47:27.693973+0000","last_clean":"2024-09-12T02:47:27.693973+0000","last_became_active":"2024-09-12T02:47:27.693308+0000","last_became_peered":"2024-09-12T02:47:27.693308+0000","last_unstale":"2024-09-12T02:47:27.693973+0000","last_undegraded":"2024-09-12T02:47:27.693973+0000","last_fullsized":"2024-09-12T02:47:27.693973+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:26.195439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.686531+0000","last_change":"2024-09-12T02:47:27.685919+0000","last_active":"2024-09-12T02:47:27.686531+0000","last_peered":"2024-09-12T02:47:27.686531+0000","last_clean":"2024-09-12T02:47:27.686531+0000","last_became_active":"2024-09-12T02:47:27.685518+0000","last_became_peered":"2024-09-12T02:47:27.685518+0000","last_unstale":"2024-09-12T02:47:27.686531+0000","last_undegraded":"2024-09-12T02:47:27.686531+0000","last_fullsized":"2024-09-12T02:47:27.686531+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:17.577268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.683442+0000","last_change":"2024-09-12T02:47:27.682764+0000","last_active":"2024-09-12T02:47:27.683442+0000","last_peered":"2024-09-12T02:47:27.683442+0000","last_clean":"2024-09-12T02:47:27.683442+0000","last_became_active":"2024-09-12T02:47:27.682519+0000","last_became_peered":"2024-09-12T02:47:27.682519+0000","last_unstale":"2024-09-12T02:47:27.683442+0000","last_undegraded":"2024-09-12T02:47:27.683442+0000","last_fullsized":"2024-09-12T02:47:27.683442+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:27.030308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.698650+0000","last_change":"2024-09-12T02:47:27.698469+0000","last_active":"2024-09-12T02:47:27.698650+0000","last_peered":"2024-09-12T02:47:27.698650+0000","last_clean":"2024-09-12T02:47:27.698650+0000","last_became_active":"2024-09-12T02:47:27.697946+0000","last_became_peered":"2024-09-12T02:47:27.697946+0000","last_unstale":"2024-09-12T02:47:27.698650+0000","last_undegraded":"2024-09-12T02:47:27.698650+0000","last_fullsized":"2024-09-12T02:47:27.698650+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:44.509314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.696684+0000","last_change":"2024-09-12T02:47:27.696567+0000","last_active":"2024-09-12T02:47:27.696684+0000","last_peered":"2024-09-12T02:47:27.696684+0000","last_clean":"2024-09-12T02:47:27.696684+0000","last_became_active":"2024-09-12T02:47:27.696332+0000","last_became_peered":"2024-09-12T02:47:27.696332+0000","last_unstale":"2024-09-12T02:47:27.696684+0000","last_undegraded":"2024-09-12T02:47:27.696684+0000","last_fullsized":"2024-09-12T02:47:27.696684+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:42.424469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.690426+0000","last_change":"2024-09-12T02:47:27.690313+0000","last_active":"2024-09-12T02:47:27.690426+0000","last_peered":"2024-09-12T02:47:27.690426+0000","last_clean":"2024-09-12T02:47:27.690426+0000","last_became_active":"2024-09-12T02:47:27.690098+0000","last_became_peered":"2024-09-12T02:47:27.690098+0000","last_unstale":"2024-09-12T02:47:27.690426+0000","last_undegraded":"2024-09-12T02:47:27.690426+0000","last_fullsized":"2024-09-12T02:47:27.690426+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:27.912301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.685882+0000","last_change":"2024-09-12T02:47:27.685728+0000","last_active":"2024-09-12T02:47:27.685882+0000","last_peered":"2024-09-12T02:47:27.685882+0000","last_clean":"2024-09-12T02:47:27.685882+0000","last_became_active":"2024-09-12T02:47:27.685231+0000","last_became_peered":"2024-09-12T02:47:27.685231+0000","last_unstale":"2024-09-12T02:47:27.685882+0000","last_undegraded":"2024-09-12T02:47:27.685882+0000","last_fullsized":"2024-09-12T02:47:27.685882+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:53.170860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.691734+0000","last_change":"2024-09-12T02:47:27.689587+0000","last_active":"2024-09-12T02:47:27.691734+0000","last_peered":"2024-09-12T02:47:27.691734+0000","last_clean":"2024-09-12T02:47:27.691734+0000","last_became_active":"2024-09-12T02:47:27.689286+0000","last_became_peered":"2024-09-12T02:47:27.689286+0000","last_unstale":"2024-09-12T02:47:27.691734+0000","last_undegraded":"2024-09-12T02:47:27.691734+0000","last_fullsized":"2024-09-12T02:47:27.691734+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:24.732479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.692742+0000","last_change":"2024-09-12T02:47:27.690958+0000","last_active":"2024-09-12T02:47:27.692742+0000","last_peered":"2024-09-12T02:47:27.692742+0000","last_clean":"2024-09-12T02:47:27.692742+0000","last_became_active":"2024-09-12T02:47:27.690285+0000","last_became_peered":"2024-09-12T02:47:27.690285+0000","last_unstale":"2024-09-12T02:47:27.692742+0000","last_undegraded":"2024-09-12T02:47:27.692742+0000","last_fullsized":"2024-09-12T02:47:27.692742+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:52.302803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.691718+0000","last_change":"2024-09-12T02:47:27.688880+0000","last_active":"2024-09-12T02:47:27.691718+0000","last_peered":"2024-09-12T02:47:27.691718+0000","last_clean":"2024-09-12T02:47:27.691718+0000","last_became_active":"2024-09-12T02:47:27.687695+0000","last_became_peered":"2024-09-12T02:47:27.687695+0000","last_unstale":"2024-09-12T02:47:27.691718+0000","last_undegraded":"2024-09-12T02:47:27.691718+0000","last_fullsized":"2024-09-12T02:47:27.691718+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:33.101296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.694979+0000","last_change":"2024-09-12T02:47:27.691941+0000","last_active":"2024-09-12T02:47:27.694979+0000","last_peered":"2024-09-12T02:47:27.694979+0000","last_clean":"2024-09-12T02:47:27.694979+0000","last_became_active":"2024-09-12T02:47:27.691373+0000","last_became_peered":"2024-09-12T02:47:27.691373+0000","last_unstale":"2024-09-12T02:47:27.694979+0000","last_undegraded":"2024-09-12T02:47:27.694979+0000","last_fullsized":"2024-09-12T02:47:27.694979+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:20.586292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.695037+0000","last_change":"2024-09-12T02:47:27.693247+0000","last_active":"2024-09-12T02:47:27.695037+0000","last_peered":"2024-09-12T02:47:27.695037+0000","last_clean":"2024-09-12T02:47:27.695037+0000","last_became_active":"2024-09-12T02:47:27.692847+0000","last_became_peered":"2024-09-12T02:47:27.692847+0000","last_unstale":"2024-09-12T02:47:27.695037+0000","last_undegraded":"2024-09-12T02:47:27.695037+0000","last_fullsized":"2024-09-12T02:47:27.695037+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:51.578363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.697599+0000","last_change":"2024-09-12T02:47:27.697467+0000","last_active":"2024-09-12T02:47:27.697599+0000","last_peered":"2024-09-12T02:47:27.697599+0000","last_clean":"2024-09-12T02:47:27.697599+0000","last_became_active":"2024-09-12T02:47:27.697227+0000","last_became_peered":"2024-09-12T02:47:27.697227+0000","last_unstale":"2024-09-12T02:47:27.697599+0000","last_undegraded":"2024-09-12T02:47:27.697599+0000","last_fullsized":"2024-09-12T02:47:27.697599+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:55.095104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.690050+0000","last_change":"2024-09-12T02:47:27.689574+0000","last_active":"2024-09-12T02:47:27.690050+0000","last_peered":"2024-09-12T02:47:27.690050+0000","last_clean":"2024-09-12T02:47:27.690050+0000","last_became_active":"2024-09-12T02:47:27.688370+0000","last_became_peered":"2024-09-12T02:47:27.688370+0000","last_unstale":"2024-09-12T02:47:27.690050+0000","last_undegraded":"2024-09-12T02:47:27.690050+0000","last_fullsized":"2024-09-12T02:47:27.690050+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:33.456417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.695959+0000","last_change":"2024-09-12T02:47:27.695861+0000","last_active":"2024-09-12T02:47:27.695959+0000","last_peered":"2024-09-12T02:47:27.695959+0000","last_clean":"2024-09-12T02:47:27.695959+0000","last_became_active":"2024-09-12T02:47:27.695591+0000","last_became_peered":"2024-09-12T02:47:27.695591+0000","last_unstale":"2024-09-12T02:47:27.695959+0000","last_undegraded":"2024-09-12T02:47:27.695959+0000","last_fullsized":"2024-09-12T02:47:27.695959+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:37.333098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.695620+0000","last_change":"2024-09-12T02:47:27.695497+0000","last_active":"2024-09-12T02:47:27.695620+0000","last_peered":"2024-09-12T02:47:27.695620+0000","last_clean":"2024-09-12T02:47:27.695620+0000","last_became_active":"2024-09-12T02:47:27.695101+0000","last_became_peered":"2024-09-12T02:47:27.695101+0000","last_unstale":"2024-09-12T02:47:27.695620+0000","last_undegraded":"2024-09-12T02:47:27.695620+0000","last_fullsized":"2024-09-12T02:47:27.695620+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:12.478535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.689175+0000","last_change":"2024-09-12T02:47:27.688579+0000","last_active":"2024-09-12T02:47:27.689175+0000","last_peered":"2024-09-12T02:47:27.689175+0000","last_clean":"2024-09-12T02:47:27.689175+0000","last_became_active":"2024-09-12T02:47:27.686281+0000","last_became_peered":"2024-09-12T02:47:27.686281+0000","last_unstale":"2024-09-12T02:47:27.689175+0000","last_undegraded":"2024-09-12T02:47:27.689175+0000","last_fullsized":"2024-09-12T02:47:27.689175+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:02.848564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.695634+0000","last_change":"2024-09-12T02:47:27.695506+0000","last_active":"2024-09-12T02:47:27.695634+0000","last_peered":"2024-09-12T02:47:27.695634+0000","last_clean":"2024-09-12T02:47:27.695634+0000","last_became_active":"2024-09-12T02:47:27.695294+0000","last_became_peered":"2024-09-12T02:47:27.695294+0000","last_unstale":"2024-09-12T02:47:27.695634+0000","last_undegraded":"2024-09-12T02:47:27.695634+0000","last_fullsized":"2024-09-12T02:47:27.695634+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:07.937880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.692721+0000","last_change":"2024-09-12T02:47:27.691981+0000","last_active":"2024-09-12T02:47:27.692721+0000","last_peered":"2024-09-12T02:47:27.692721+0000","last_clean":"2024-09-12T02:47:27.692721+0000","last_became_active":"2024-09-12T02:47:27.691292+0000","last_became_peered":"2024-09-12T02:47:27.691292+0000","last_unstale":"2024-09-12T02:47:27.692721+0000","last_undegraded":"2024-09-12T02:47:27.692721+0000","last_fullsized":"2024-09-12T02:47:27.692721+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:00.450215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.689395+0000","last_change":"2024-09-12T02:47:27.689129+0000","last_active":"2024-09-12T02:47:27.689395+0000","last_peered":"2024-09-12T02:47:27.689395+0000","last_clean":"2024-09-12T02:47:27.689395+0000","last_became_active":"2024-09-12T02:47:27.688861+0000","last_became_peered":"2024-09-12T02:47:27.688861+0000","last_unstale":"2024-09-12T02:47:27.689395+0000","last_undegraded":"2024-09-12T02:47:27.689395+0000","last_fullsized":"2024-09-12T02:47:27.689395+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:25.602183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.697240+0000","last_change":"2024-09-12T02:47:27.694236+0000","last_active":"2024-09-12T02:47:27.697240+0000","last_peered":"2024-09-12T02:47:27.697240+0000","last_clean":"2024-09-12T02:47:27.697240+0000","last_became_active":"2024-09-12T02:47:27.693122+0000","last_became_peered":"2024-09-12T02:47:27.693122+0000","last_unstale":"2024-09-12T02:47:27.697240+0000","last_undegraded":"2024-09-12T02:47:27.697240+0000","last_fullsized":"2024-09-12T02:47:27.697240+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:30.197045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.693551+0000","last_change":"2024-09-12T02:47:27.693213+0000","last_active":"2024-09-12T02:47:27.693551+0000","last_peered":"2024-09-12T02:47:27.693551+0000","last_clean":"2024-09-12T02:47:27.693551+0000","last_became_active":"2024-09-12T02:47:27.692951+0000","last_became_peered":"2024-09-12T02:47:27.692951+0000","last_unstale":"2024-09-12T02:47:27.693551+0000","last_undegraded":"2024-09-12T02:47:27.693551+0000","last_fullsized":"2024-09-12T02:47:27.693551+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:50.668947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"119'4","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.706405+0000","last_change":"2024-09-12T02:47:26.667726+0000","last_active":"2024-09-12T02:47:27.706405+0000","last_peered":"2024-09-12T02:47:27.706405+0000","last_clean":"2024-09-12T02:47:27.706405+0000","last_became_active":"2024-09-12T02:47:26.667500+0000","last_became_peered":"2024-09-12T02:47:26.667500+0000","last_unstale":"2024-09-12T02:47:27.706405+0000","last_undegraded":"2024-09-12T02:47:27.706405+0000","last_fullsized":"2024-09-12T02:47:27.706405+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:20.413750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.685693+0000","last_change":"2024-09-12T02:47:27.684321+0000","last_active":"2024-09-12T02:47:27.685693+0000","last_peered":"2024-09-12T02:47:27.685693+0000","last_clean":"2024-09-12T02:47:27.685693+0000","last_became_active":"2024-09-12T02:47:27.683936+0000","last_became_peered":"2024-09-12T02:47:27.683936+0000","last_unstale":"2024-09-12T02:47:27.685693+0000","last_undegraded":"2024-09-12T02:47:27.685693+0000","last_fullsized":"2024-09-12T02:47:27.685693+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:46.088340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"119'1","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.703525+0000","last_change":"2024-09-12T02:47:26.678064+0000","last_active":"2024-09-12T02:47:27.703525+0000","last_peered":"2024-09-12T02:47:27.703525+0000","last_clean":"2024-09-12T02:47:27.703525+0000","last_became_active":"2024-09-12T02:47:26.677780+0000","last_became_peered":"2024-09-12T02:47:26.677780+0000","last_unstale":"2024-09-12T02:47:27.703525+0000","last_undegraded":"2024-09-12T02:47:27.703525+0000","last_fullsized":"2024-09-12T02:47:27.703525+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:25.040861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.692247+0000","last_change":"2024-09-12T02:47:27.690561+0000","last_active":"2024-09-12T02:47:27.692247+0000","last_peered":"2024-09-12T02:47:27.692247+0000","last_clean":"2024-09-12T02:47:27.692247+0000","last_became_active":"2024-09-12T02:47:27.688178+0000","last_became_peered":"2024-09-12T02:47:27.688178+0000","last_unstale":"2024-09-12T02:47:27.692247+0000","last_undegraded":"2024-09-12T02:47:27.692247+0000","last_fullsized":"2024-09-12T02:47:27.692247+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:03.359996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"119'2","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.707203+0000","last_change":"2024-09-12T02:47:26.675179+0000","last_active":"2024-09-12T02:47:27.707203+0000","last_peered":"2024-09-12T02:47:27.707203+0000","last_clean":"2024-09-12T02:47:27.707203+0000","last_became_active":"2024-09-12T02:47:26.674917+0000","last_became_peered":"2024-09-12T02:47:26.674917+0000","last_unstale":"2024-09-12T02:47:27.707203+0000","last_undegraded":"2024-09-12T02:47:27.707203+0000","last_fullsized":"2024-09-12T02:47:27.707203+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:25.319669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.692763+0000","last_change":"2024-09-12T02:47:27.691173+0000","last_active":"2024-09-12T02:47:27.692763+0000","last_peered":"2024-09-12T02:47:27.692763+0000","last_clean":"2024-09-12T02:47:27.692763+0000","last_became_active":"2024-09-12T02:47:27.690704+0000","last_became_peered":"2024-09-12T02:47:27.690704+0000","last_unstale":"2024-09-12T02:47:27.692763+0000","last_undegraded":"2024-09-12T02:47:27.692763+0000","last_fullsized":"2024-09-12T02:47:27.692763+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:43.490907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"119'2","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.705886+0000","last_change":"2024-09-12T02:47:26.678365+0000","last_active":"2024-09-12T02:47:27.705886+0000","last_peered":"2024-09-12T02:47:27.705886+0000","last_clean":"2024-09-12T02:47:27.705886+0000","last_became_active":"2024-09-12T02:47:26.678133+0000","last_became_peered":"2024-09-12T02:47:26.678133+0000","last_unstale":"2024-09-12T02:47:27.705886+0000","last_undegraded":"2024-09-12T02:47:27.705886+0000","last_fullsized":"2024-09-12T02:47:27.705886+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:08.328762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.691492+0000","last_change":"2024-09-12T02:47:27.691364+0000","last_active":"2024-09-12T02:47:27.691492+0000","last_peered":"2024-09-12T02:47:27.691492+0000","last_clean":"2024-09-12T02:47:27.691492+0000","last_became_active":"2024-09-12T02:47:27.686835+0000","last_became_peered":"2024-09-12T02:47:27.686835+0000","last_unstale":"2024-09-12T02:47:27.691492+0000","last_undegraded":"2024-09-12T02:47:27.691492+0000","last_fullsized":"2024-09-12T02:47:27.691492+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:30.652196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"119'1","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.705267+0000","last_change":"2024-09-12T02:47:26.676638+0000","last_active":"2024-09-12T02:47:27.705267+0000","last_peered":"2024-09-12T02:47:27.705267+0000","last_clean":"2024-09-12T02:47:27.705267+0000","last_became_active":"2024-09-12T02:47:26.676377+0000","last_became_peered":"2024-09-12T02:47:26.676377+0000","last_unstale":"2024-09-12T02:47:27.705267+0000","last_undegraded":"2024-09-12T02:47:27.705267+0000","last_fullsized":"2024-09-12T02:47:27.705267+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:48.160662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.692244+0000","last_change":"2024-09-12T02:47:27.691999+0000","last_active":"2024-09-12T02:47:27.692244+0000","last_peered":"2024-09-12T02:47:27.692244+0000","last_clean":"2024-09-12T02:47:27.692244+0000","last_became_active":"2024-09-12T02:47:27.691230+0000","last_became_peered":"2024-09-12T02:47:27.691230+0000","last_unstale":"2024-09-12T02:47:27.692244+0000","last_undegraded":"2024-09-12T02:47:27.692244+0000","last_fullsized":"2024-09-12T02:47:27.692244+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:49.931509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"119'1","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.706798+0000","last_change":"2024-09-12T02:47:26.674232+0000","last_active":"2024-09-12T02:47:27.706798+0000","last_peered":"2024-09-12T02:47:27.706798+0000","last_clean":"2024-09-12T02:47:27.706798+0000","last_became_active":"2024-09-12T02:47:26.673919+0000","last_became_peered":"2024-09-12T02:47:26.673919+0000","last_unstale":"2024-09-12T02:47:27.706798+0000","last_undegraded":"2024-09-12T02:47:27.706798+0000","last_fullsized":"2024-09-12T02:47:27.706798+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:47.074294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.698382+0000","last_change":"2024-09-12T02:47:27.698251+0000","last_active":"2024-09-12T02:47:27.698382+0000","last_peered":"2024-09-12T02:47:27.698382+0000","last_clean":"2024-09-12T02:47:27.698382+0000","last_became_active":"2024-09-12T02:47:27.696693+0000","last_became_peered":"2024-09-12T02:47:27.696693+0000","last_unstale":"2024-09-12T02:47:27.698382+0000","last_undegraded":"2024-09-12T02:47:27.698382+0000","last_fullsized":"2024-09-12T02:47:27.698382+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:30.782727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.680400+0000","last_change":"2024-09-12T02:47:26.669920+0000","last_active":"2024-09-12T02:47:27.680400+0000","last_peered":"2024-09-12T02:47:27.680400+0000","last_clean":"2024-09-12T02:47:27.680400+0000","last_became_active":"2024-09-12T02:47:26.669678+0000","last_became_peered":"2024-09-12T02:47:26.669678+0000","last_unstale":"2024-09-12T02:47:27.680400+0000","last_undegraded":"2024-09-12T02:47:27.680400+0000","last_fullsized":"2024-09-12T02:47:27.680400+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:29.329393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.689648+0000","last_change":"2024-09-12T02:47:27.689503+0000","last_active":"2024-09-12T02:47:27.689648+0000","last_peered":"2024-09-12T02:47:27.689648+0000","last_clean":"2024-09-12T02:47:27.689648+0000","last_became_active":"2024-09-12T02:47:27.688812+0000","last_became_peered":"2024-09-12T02:47:27.688812+0000","last_unstale":"2024-09-12T02:47:27.689648+0000","last_undegraded":"2024-09-12T02:47:27.689648+0000","last_fullsized":"2024-09-12T02:47:27.689648+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:39.597906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.690433+0000","last_change":"2024-09-12T02:47:26.678105+0000","last_active":"2024-09-12T02:47:27.690433+0000","last_peered":"2024-09-12T02:47:27.690433+0000","last_clean":"2024-09-12T02:47:27.690433+0000","last_became_active":"2024-09-12T02:47:26.677535+0000","last_became_peered":"2024-09-12T02:47:26.677535+0000","last_unstale":"2024-09-12T02:47:27.690433+0000","last_undegraded":"2024-09-12T02:47:27.690433+0000","last_fullsized":"2024-09-12T02:47:27.690433+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:36.025450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.695059+0000","last_change":"2024-09-12T02:47:27.693554+0000","last_active":"2024-09-12T02:47:27.695059+0000","last_peered":"2024-09-12T02:47:27.695059+0000","last_clean":"2024-09-12T02:47:27.695059+0000","last_became_active":"2024-09-12T02:47:27.692441+0000","last_became_peered":"2024-09-12T02:47:27.692441+0000","last_unstale":"2024-09-12T02:47:27.695059+0000","last_undegraded":"2024-09-12T02:47:27.695059+0000","last_fullsized":"2024-09-12T02:47:27.695059+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:12.857158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.686919+0000","last_change":"2024-09-12T02:47:26.677228+0000","last_active":"2024-09-12T02:47:27.686919+0000","last_peered":"2024-09-12T02:47:27.686919+0000","last_clean":"2024-09-12T02:47:27.686919+0000","last_became_active":"2024-09-12T02:47:26.677011+0000","last_became_peered":"2024-09-12T02:47:26.677011+0000","last_unstale":"2024-09-12T02:47:27.686919+0000","last_undegraded":"2024-09-12T02:47:27.686919+0000","last_fullsized":"2024-09-12T02:47:27.686919+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:42.731916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.685430+0000","last_change":"2024-09-12T02:47:27.685114+0000","last_active":"2024-09-12T02:47:27.685430+0000","last_peered":"2024-09-12T02:47:27.685430+0000","last_clean":"2024-09-12T02:47:27.685430+0000","last_became_active":"2024-09-12T02:47:27.684790+0000","last_became_peered":"2024-09-12T02:47:27.684790+0000","last_unstale":"2024-09-12T02:47:27.685430+0000","last_undegraded":"2024-09-12T02:47:27.685430+0000","last_fullsized":"2024-09-12T02:47:27.685430+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:33:54.266816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.682307+0000","last_change":"2024-09-12T02:47:26.668679+0000","last_active":"2024-09-12T02:47:27.682307+0000","last_peered":"2024-09-12T02:47:27.682307+0000","last_clean":"2024-09-12T02:47:27.682307+0000","last_became_active":"2024-09-12T02:47:26.668435+0000","last_became_peered":"2024-09-12T02:47:26.668435+0000","last_unstale":"2024-09-12T02:47:27.682307+0000","last_undegraded":"2024-09-12T02:47:27.682307+0000","last_fullsized":"2024-09-12T02:47:27.682307+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:33.606056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.690030+0000","last_change":"2024-09-12T02:47:27.689529+0000","last_active":"2024-09-12T02:47:27.690030+0000","last_peered":"2024-09-12T02:47:27.690030+0000","last_clean":"2024-09-12T02:47:27.690030+0000","last_became_active":"2024-09-12T02:47:27.689048+0000","last_became_peered":"2024-09-12T02:47:27.689048+0000","last_unstale":"2024-09-12T02:47:27.690030+0000","last_undegraded":"2024-09-12T02:47:27.690030+0000","last_fullsized":"2024-09-12T02:47:27.690030+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:36.104509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"119'3","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.705063+0000","last_change":"2024-09-12T02:47:26.675495+0000","last_active":"2024-09-12T02:47:27.705063+0000","last_peered":"2024-09-12T02:47:27.705063+0000","last_clean":"2024-09-12T02:47:27.705063+0000","last_became_active":"2024-09-12T02:47:26.675301+0000","last_became_peered":"2024-09-12T02:47:26.675301+0000","last_unstale":"2024-09-12T02:47:27.705063+0000","last_undegraded":"2024-09-12T02:47:27.705063+0000","last_fullsized":"2024-09-12T02:47:27.705063+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:00.685763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.690286+0000","last_change":"2024-09-12T02:47:27.689597+0000","last_active":"2024-09-12T02:47:27.690286+0000","last_peered":"2024-09-12T02:47:27.690286+0000","last_clean":"2024-09-12T02:47:27.690286+0000","last_became_active":"2024-09-12T02:47:27.689370+0000","last_became_peered":"2024-09-12T02:47:27.689370+0000","last_unstale":"2024-09-12T02:47:27.690286+0000","last_undegraded":"2024-09-12T02:47:27.690286+0000","last_fullsized":"2024-09-12T02:47:27.690286+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:29.801323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"119'6","reported_seq":18,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.708663+0000","last_change":"2024-09-12T02:47:26.673208+0000","last_active":"2024-09-12T02:47:27.708663+0000","last_peered":"2024-09-12T02:47:27.708663+0000","last_clean":"2024-09-12T02:47:27.708663+0000","last_became_active":"2024-09-12T02:47:26.670061+0000","last_became_peered":"2024-09-12T02:47:26.670061+0000","last_unstale":"2024-09-12T02:47:27.708663+0000","last_undegraded":"2024-09-12T02:47:27.708663+0000","last_fullsized":"2024-09-12T02:47:27.708663+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:11.042816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.693991+0000","last_change":"2024-09-12T02:47:27.693233+0000","last_active":"2024-09-12T02:47:27.693991+0000","last_peered":"2024-09-12T02:47:27.693991+0000","last_clean":"2024-09-12T02:47:27.693991+0000","last_became_active":"2024-09-12T02:47:27.692443+0000","last_became_peered":"2024-09-12T02:47:27.692443+0000","last_unstale":"2024-09-12T02:47:27.693991+0000","last_undegraded":"2024-09-12T02:47:27.693991+0000","last_fullsized":"2024-09-12T02:47:27.693991+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:40.517809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"119'2","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.707468+0000","last_change":"2024-09-12T02:47:26.678465+0000","last_active":"2024-09-12T02:47:27.707468+0000","last_peered":"2024-09-12T02:47:27.707468+0000","last_clean":"2024-09-12T02:47:27.707468+0000","last_became_active":"2024-09-12T02:47:26.678250+0000","last_became_peered":"2024-09-12T02:47:26.678250+0000","last_unstale":"2024-09-12T02:47:27.707468+0000","last_undegraded":"2024-09-12T02:47:27.707468+0000","last_fullsized":"2024-09-12T02:47:27.707468+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:53.596286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.697279+0000","last_change":"2024-09-12T02:47:27.694569+0000","last_active":"2024-09-12T02:47:27.697279+0000","last_peered":"2024-09-12T02:47:27.697279+0000","last_clean":"2024-09-12T02:47:27.697279+0000","last_became_active":"2024-09-12T02:47:27.694271+0000","last_became_peered":"2024-09-12T02:47:27.694271+0000","last_unstale":"2024-09-12T02:47:27.697279+0000","last_undegraded":"2024-09-12T02:47:27.697279+0000","last_fullsized":"2024-09-12T02:47:27.697279+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:58.816725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.678816+0000","last_change":"2024-09-12T02:47:26.678931+0000","last_active":"2024-09-12T02:47:27.678816+0000","last_peered":"2024-09-12T02:47:27.678816+0000","last_clean":"2024-09-12T02:47:27.678816+0000","last_became_active":"2024-09-12T02:47:26.678698+0000","last_became_peered":"2024-09-12T02:47:26.678698+0000","last_unstale":"2024-09-12T02:47:27.678816+0000","last_undegraded":"2024-09-12T02:47:27.678816+0000","last_fullsized":"2024-09-12T02:47:27.678816+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:11.044464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.688725+0000","last_change":"2024-09-12T02:47:27.687119+0000","last_active":"2024-09-12T02:47:27.688725+0000","last_peered":"2024-09-12T02:47:27.688725+0000","last_clean":"2024-09-12T02:47:27.688725+0000","last_became_active":"2024-09-12T02:47:27.686885+0000","last_became_peered":"2024-09-12T02:47:27.686885+0000","last_unstale":"2024-09-12T02:47:27.688725+0000","last_undegraded":"2024-09-12T02:47:27.688725+0000","last_fullsized":"2024-09-12T02:47:27.688725+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:55.110333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.684262+0000","last_change":"2024-09-12T02:47:26.668261+0000","last_active":"2024-09-12T02:47:27.684262+0000","last_peered":"2024-09-12T02:47:27.684262+0000","last_clean":"2024-09-12T02:47:27.684262+0000","last_became_active":"2024-09-12T02:47:26.667996+0000","last_became_peered":"2024-09-12T02:47:26.667996+0000","last_unstale":"2024-09-12T02:47:27.684262+0000","last_undegraded":"2024-09-12T02:47:27.684262+0000","last_fullsized":"2024-09-12T02:47:27.684262+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:21.570255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.691791+0000","last_change":"2024-09-12T02:47:27.690467+0000","last_active":"2024-09-12T02:47:27.691791+0000","last_peered":"2024-09-12T02:47:27.691791+0000","last_clean":"2024-09-12T02:47:27.691791+0000","last_became_active":"2024-09-12T02:47:27.689288+0000","last_became_peered":"2024-09-12T02:47:27.689288+0000","last_unstale":"2024-09-12T02:47:27.691791+0000","last_undegraded":"2024-09-12T02:47:27.691791+0000","last_fullsized":"2024-09-12T02:47:27.691791+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:12.225847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"119'8","reported_seq":20,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.708448+0000","last_change":"2024-09-12T02:47:26.678631+0000","last_active":"2024-09-12T02:47:27.708448+0000","last_peered":"2024-09-12T02:47:27.708448+0000","last_clean":"2024-09-12T02:47:27.708448+0000","last_became_active":"2024-09-12T02:47:26.678403+0000","last_became_peered":"2024-09-12T02:47:26.678403+0000","last_unstale":"2024-09-12T02:47:27.708448+0000","last_undegraded":"2024-09-12T02:47:27.708448+0000","last_fullsized":"2024-09-12T02:47:27.708448+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:31.347534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.689500+0000","last_change":"2024-09-12T02:47:27.689305+0000","last_active":"2024-09-12T02:47:27.689500+0000","last_peered":"2024-09-12T02:47:27.689500+0000","last_clean":"2024-09-12T02:47:27.689500+0000","last_became_active":"2024-09-12T02:47:27.687497+0000","last_became_peered":"2024-09-12T02:47:27.687497+0000","last_unstale":"2024-09-12T02:47:27.689500+0000","last_undegraded":"2024-09-12T02:47:27.689500+0000","last_fullsized":"2024-09-12T02:47:27.689500+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:25.106167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"119'2","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.706814+0000","last_change":"2024-09-12T02:47:26.674894+0000","last_active":"2024-09-12T02:47:27.706814+0000","last_peered":"2024-09-12T02:47:27.706814+0000","last_clean":"2024-09-12T02:47:27.706814+0000","last_became_active":"2024-09-12T02:47:26.674514+0000","last_became_peered":"2024-09-12T02:47:26.674514+0000","last_unstale":"2024-09-12T02:47:27.706814+0000","last_undegraded":"2024-09-12T02:47:27.706814+0000","last_fullsized":"2024-09-12T02:47:27.706814+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:42.292386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.691229+0000","last_change":"2024-09-12T02:47:27.691078+0000","last_active":"2024-09-12T02:47:27.691229+0000","last_peered":"2024-09-12T02:47:27.691229+0000","last_clean":"2024-09-12T02:47:27.691229+0000","last_became_active":"2024-09-12T02:47:27.690787+0000","last_became_peered":"2024-09-12T02:47:27.690787+0000","last_unstale":"2024-09-12T02:47:27.691229+0000","last_undegraded":"2024-09-12T02:47:27.691229+0000","last_fullsized":"2024-09-12T02:47:27.691229+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:27.976666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"119'1","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.704855+0000","last_change":"2024-09-12T02:47:26.664687+0000","last_active":"2024-09-12T02:47:27.704855+0000","last_peered":"2024-09-12T02:47:27.704855+0000","last_clean":"2024-09-12T02:47:27.704855+0000","last_became_active":"2024-09-12T02:47:26.664423+0000","last_became_peered":"2024-09-12T02:47:26.664423+0000","last_unstale":"2024-09-12T02:47:27.704855+0000","last_undegraded":"2024-09-12T02:47:27.704855+0000","last_fullsized":"2024-09-12T02:47:27.704855+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:33:50.102994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.695257+0000","last_change":"2024-09-12T02:47:27.695120+0000","last_active":"2024-09-12T02:47:27.695257+0000","last_peered":"2024-09-12T02:47:27.695257+0000","last_clean":"2024-09-12T02:47:27.695257+0000","last_became_active":"2024-09-12T02:47:27.694696+0000","last_became_peered":"2024-09-12T02:47:27.694696+0000","last_unstale":"2024-09-12T02:47:27.695257+0000","last_undegraded":"2024-09-12T02:47:27.695257+0000","last_fullsized":"2024-09-12T02:47:27.695257+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:41.625246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.687622+0000","last_change":"2024-09-12T02:47:26.677819+0000","last_active":"2024-09-12T02:47:27.687622+0000","last_peered":"2024-09-12T02:47:27.687622+0000","last_clean":"2024-09-12T02:47:27.687622+0000","last_became_active":"2024-09-12T02:47:26.674869+0000","last_became_peered":"2024-09-12T02:47:26.674869+0000","last_unstale":"2024-09-12T02:47:27.687622+0000","last_undegraded":"2024-09-12T02:47:27.687622+0000","last_fullsized":"2024-09-12T02:47:27.687622+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:36.110077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.685312+0000","last_change":"2024-09-12T02:47:27.684946+0000","last_active":"2024-09-12T02:47:27.685312+0000","last_peered":"2024-09-12T02:47:27.685312+0000","last_clean":"2024-09-12T02:47:27.685312+0000","last_became_active":"2024-09-12T02:47:27.684579+0000","last_became_peered":"2024-09-12T02:47:27.684579+0000","last_unstale":"2024-09-12T02:47:27.685312+0000","last_undegraded":"2024-09-12T02:47:27.685312+0000","last_fullsized":"2024-09-12T02:47:27.685312+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:14.882590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"119'2","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.706697+0000","last_change":"2024-09-12T02:47:26.681065+0000","last_active":"2024-09-12T02:47:27.706697+0000","last_peered":"2024-09-12T02:47:27.706697+0000","last_clean":"2024-09-12T02:47:27.706697+0000","last_became_active":"2024-09-12T02:47:26.680800+0000","last_became_peered":"2024-09-12T02:47:26.680800+0000","last_unstale":"2024-09-12T02:47:27.706697+0000","last_undegraded":"2024-09-12T02:47:27.706697+0000","last_fullsized":"2024-09-12T02:47:27.706697+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:21.344359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.691807+0000","last_change":"2024-09-12T02:47:27.690522+0000","last_active":"2024-09-12T02:47:27.691807+0000","last_peered":"2024-09-12T02:47:27.691807+0000","last_clean":"2024-09-12T02:47:27.691807+0000","last_became_active":"2024-09-12T02:47:27.690152+0000","last_became_peered":"2024-09-12T02:47:27.690152+0000","last_unstale":"2024-09-12T02:47:27.691807+0000","last_undegraded":"2024-09-12T02:47:27.691807+0000","last_fullsized":"2024-09-12T02:47:27.691807+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:01.749062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.681991+0000","last_change":"2024-09-12T02:47:26.668545+0000","last_active":"2024-09-12T02:47:27.681991+0000","last_peered":"2024-09-12T02:47:27.681991+0000","last_clean":"2024-09-12T02:47:27.681991+0000","last_became_active":"2024-09-12T02:47:26.668291+0000","last_became_peered":"2024-09-12T02:47:26.668291+0000","last_unstale":"2024-09-12T02:47:27.681991+0000","last_undegraded":"2024-09-12T02:47:27.681991+0000","last_fullsized":"2024-09-12T02:47:27.681991+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:41.347586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.691698+0000","last_change":"2024-09-12T02:47:27.688043+0000","last_active":"2024-09-12T02:47:27.691698+0000","last_peered":"2024-09-12T02:47:27.691698+0000","last_clean":"2024-09-12T02:47:27.691698+0000","last_became_active":"2024-09-12T02:47:27.686730+0000","last_became_peered":"2024-09-12T02:47:27.686730+0000","last_unstale":"2024-09-12T02:47:27.691698+0000","last_undegraded":"2024-09-12T02:47:27.691698+0000","last_fullsized":"2024-09-12T02:47:27.691698+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:23.462376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.682410+0000","last_change":"2024-09-12T02:47:26.666835+0000","last_active":"2024-09-12T02:47:27.682410+0000","last_peered":"2024-09-12T02:47:27.682410+0000","last_clean":"2024-09-12T02:47:27.682410+0000","last_became_active":"2024-09-12T02:47:26.666435+0000","last_became_peered":"2024-09-12T02:47:26.666435+0000","last_unstale":"2024-09-12T02:47:27.682410+0000","last_undegraded":"2024-09-12T02:47:27.682410+0000","last_fullsized":"2024-09-12T02:47:27.682410+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:15:08.404781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.697551+0000","last_change":"2024-09-12T02:47:27.697428+0000","last_active":"2024-09-12T02:47:27.697551+0000","last_peered":"2024-09-12T02:47:27.697551+0000","last_clean":"2024-09-12T02:47:27.697551+0000","last_became_active":"2024-09-12T02:47:27.696698+0000","last_became_peered":"2024-09-12T02:47:27.696698+0000","last_unstale":"2024-09-12T02:47:27.697551+0000","last_undegraded":"2024-09-12T02:47:27.697551+0000","last_fullsized":"2024-09-12T02:47:27.697551+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:54.538449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.687117+0000","last_change":"2024-09-12T02:47:26.679601+0000","last_active":"2024-09-12T02:47:27.687117+0000","last_peered":"2024-09-12T02:47:27.687117+0000","last_clean":"2024-09-12T02:47:27.687117+0000","last_became_active":"2024-09-12T02:47:26.679176+0000","last_became_peered":"2024-09-12T02:47:26.679176+0000","last_unstale":"2024-09-12T02:47:27.687117+0000","last_undegraded":"2024-09-12T02:47:27.687117+0000","last_fullsized":"2024-09-12T02:47:27.687117+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:04.018242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.695019+0000","last_change":"2024-09-12T02:47:27.693059+0000","last_active":"2024-09-12T02:47:27.695019+0000","last_peered":"2024-09-12T02:47:27.695019+0000","last_clean":"2024-09-12T02:47:27.695019+0000","last_became_active":"2024-09-12T02:47:27.692210+0000","last_became_peered":"2024-09-12T02:47:27.692210+0000","last_unstale":"2024-09-12T02:47:27.695019+0000","last_undegraded":"2024-09-12T02:47:27.695019+0000","last_fullsized":"2024-09-12T02:47:27.695019+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:45.828133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"119'2","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.703434+0000","last_change":"2024-09-12T02:47:26.667152+0000","last_active":"2024-09-12T02:47:27.703434+0000","last_peered":"2024-09-12T02:47:27.703434+0000","last_clean":"2024-09-12T02:47:27.703434+0000","last_became_active":"2024-09-12T02:47:26.666895+0000","last_became_peered":"2024-09-12T02:47:26.666895+0000","last_unstale":"2024-09-12T02:47:27.703434+0000","last_undegraded":"2024-09-12T02:47:27.703434+0000","last_fullsized":"2024-09-12T02:47:27.703434+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:11.268649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.697298+0000","last_change":"2024-09-12T02:47:27.694722+0000","last_active":"2024-09-12T02:47:27.697298+0000","last_peered":"2024-09-12T02:47:27.697298+0000","last_clean":"2024-09-12T02:47:27.697298+0000","last_became_active":"2024-09-12T02:47:27.694504+0000","last_became_peered":"2024-09-12T02:47:27.694504+0000","last_unstale":"2024-09-12T02:47:27.697298+0000","last_undegraded":"2024-09-12T02:47:27.697298+0000","last_fullsized":"2024-09-12T02:47:27.697298+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:05.302834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.686466+0000","last_change":"2024-09-12T02:47:26.676632+0000","last_active":"2024-09-12T02:47:27.686466+0000","last_peered":"2024-09-12T02:47:27.686466+0000","last_clean":"2024-09-12T02:47:27.686466+0000","last_became_active":"2024-09-12T02:47:26.675659+0000","last_became_peered":"2024-09-12T02:47:26.675659+0000","last_unstale":"2024-09-12T02:47:27.686466+0000","last_undegraded":"2024-09-12T02:47:27.686466+0000","last_fullsized":"2024-09-12T02:47:27.686466+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:24.298219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.697218+0000","last_change":"2024-09-12T02:47:27.693269+0000","last_active":"2024-09-12T02:47:27.697218+0000","last_peered":"2024-09-12T02:47:27.697218+0000","last_clean":"2024-09-12T02:47:27.697218+0000","last_became_active":"2024-09-12T02:47:27.692951+0000","last_became_peered":"2024-09-12T02:47:27.692951+0000","last_unstale":"2024-09-12T02:47:27.697218+0000","last_undegraded":"2024-09-12T02:47:27.697218+0000","last_fullsized":"2024-09-12T02:47:27.697218+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:50.597597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.683701+0000","last_change":"2024-09-12T02:47:26.680696+0000","last_active":"2024-09-12T02:47:27.683701+0000","last_peered":"2024-09-12T02:47:27.683701+0000","last_clean":"2024-09-12T02:47:27.683701+0000","last_became_active":"2024-09-12T02:47:26.680337+0000","last_became_peered":"2024-09-12T02:47:26.680337+0000","last_unstale":"2024-09-12T02:47:27.683701+0000","last_undegraded":"2024-09-12T02:47:27.683701+0000","last_fullsized":"2024-09-12T02:47:27.683701+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:12.732931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.686050+0000","last_change":"2024-09-12T02:47:27.683284+0000","last_active":"2024-09-12T02:47:27.686050+0000","last_peered":"2024-09-12T02:47:27.686050+0000","last_clean":"2024-09-12T02:47:27.686050+0000","last_became_active":"2024-09-12T02:47:27.683042+0000","last_became_peered":"2024-09-12T02:47:27.683042+0000","last_unstale":"2024-09-12T02:47:27.686050+0000","last_undegraded":"2024-09-12T02:47:27.686050+0000","last_fullsized":"2024-09-12T02:47:27.686050+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:06.351070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.681434+0000","last_change":"2024-09-12T02:47:26.672696+0000","last_active":"2024-09-12T02:47:27.681434+0000","last_peered":"2024-09-12T02:47:27.681434+0000","last_clean":"2024-09-12T02:47:27.681434+0000","last_became_active":"2024-09-12T02:47:26.672386+0000","last_became_peered":"2024-09-12T02:47:26.672386+0000","last_unstale":"2024-09-12T02:47:27.681434+0000","last_undegraded":"2024-09-12T02:47:27.681434+0000","last_fullsized":"2024-09-12T02:47:27.681434+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:00.281238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.691774+0000","last_change":"2024-09-12T02:47:27.690279+0000","last_active":"2024-09-12T02:47:27.691774+0000","last_peered":"2024-09-12T02:47:27.691774+0000","last_clean":"2024-09-12T02:47:27.691774+0000","last_became_active":"2024-09-12T02:47:27.688962+0000","last_became_peered":"2024-09-12T02:47:27.688962+0000","last_unstale":"2024-09-12T02:47:27.691774+0000","last_undegraded":"2024-09-12T02:47:27.691774+0000","last_fullsized":"2024-09-12T02:47:27.691774+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:22.903893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.687250+0000","last_change":"2024-09-12T02:47:26.672251+0000","last_active":"2024-09-12T02:47:27.687250+0000","last_peered":"2024-09-12T02:47:27.687250+0000","last_clean":"2024-09-12T02:47:27.687250+0000","last_became_active":"2024-09-12T02:47:26.671988+0000","last_became_peered":"2024-09-12T02:47:26.671988+0000","last_unstale":"2024-09-12T02:47:27.687250+0000","last_undegraded":"2024-09-12T02:47:27.687250+0000","last_fullsized":"2024-09-12T02:47:27.687250+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:29.382665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.692778+0000","last_change":"2024-09-12T02:47:27.692030+0000","last_active":"2024-09-12T02:47:27.692778+0000","last_peered":"2024-09-12T02:47:27.692778+0000","last_clean":"2024-09-12T02:47:27.692778+0000","last_became_active":"2024-09-12T02:47:27.691680+0000","last_became_peered":"2024-09-12T02:47:27.691680+0000","last_unstale":"2024-09-12T02:47:27.692778+0000","last_undegraded":"2024-09-12T02:47:27.692778+0000","last_fullsized":"2024-09-12T02:47:27.692778+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:51.209610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.679688+0000","last_change":"2024-09-12T02:47:26.671377+0000","last_active":"2024-09-12T02:47:27.679688+0000","last_peered":"2024-09-12T02:47:27.679688+0000","last_clean":"2024-09-12T02:47:27.679688+0000","last_became_active":"2024-09-12T02:47:26.670693+0000","last_became_peered":"2024-09-12T02:47:26.670693+0000","last_unstale":"2024-09-12T02:47:27.679688+0000","last_undegraded":"2024-09-12T02:47:27.679688+0000","last_fullsized":"2024-09-12T02:47:27.679688+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:26.386804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.686462+0000","last_change":"2024-09-12T02:47:27.686319+0000","last_active":"2024-09-12T02:47:27.686462+0000","last_peered":"2024-09-12T02:47:27.686462+0000","last_clean":"2024-09-12T02:47:27.686462+0000","last_became_active":"2024-09-12T02:47:27.686049+0000","last_became_peered":"2024-09-12T02:47:27.686049+0000","last_unstale":"2024-09-12T02:47:27.686462+0000","last_undegraded":"2024-09-12T02:47:27.686462+0000","last_fullsized":"2024-09-12T02:47:27.686462+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:30.509262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.683704+0000","last_change":"2024-09-12T02:47:26.670178+0000","last_active":"2024-09-12T02:47:27.683704+0000","last_peered":"2024-09-12T02:47:27.683704+0000","last_clean":"2024-09-12T02:47:27.683704+0000","last_became_active":"2024-09-12T02:47:26.669037+0000","last_became_peered":"2024-09-12T02:47:26.669037+0000","last_unstale":"2024-09-12T02:47:27.683704+0000","last_undegraded":"2024-09-12T02:47:27.683704+0000","last_fullsized":"2024-09-12T02:47:27.683704+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:55.469872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.688112+0000","last_change":"2024-09-12T02:47:27.686551+0000","last_active":"2024-09-12T02:47:27.688112+0000","last_peered":"2024-09-12T02:47:27.688112+0000","last_clean":"2024-09-12T02:47:27.688112+0000","last_became_active":"2024-09-12T02:47:27.685915+0000","last_became_peered":"2024-09-12T02:47:27.685915+0000","last_unstale":"2024-09-12T02:47:27.688112+0000","last_undegraded":"2024-09-12T02:47:27.688112+0000","last_fullsized":"2024-09-12T02:47:27.688112+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:44.608019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.679833+0000","last_change":"2024-09-12T02:47:26.680596+0000","last_active":"2024-09-12T02:47:27.679833+0000","last_peered":"2024-09-12T02:47:27.679833+0000","last_clean":"2024-09-12T02:47:27.679833+0000","last_became_active":"2024-09-12T02:47:26.680396+0000","last_became_peered":"2024-09-12T02:47:26.680396+0000","last_unstale":"2024-09-12T02:47:27.679833+0000","last_undegraded":"2024-09-12T02:47:27.679833+0000","last_fullsized":"2024-09-12T02:47:27.679833+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:37.880148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.685598+0000","last_change":"2024-09-12T02:47:27.685478+0000","last_active":"2024-09-12T02:47:27.685598+0000","last_peered":"2024-09-12T02:47:27.685598+0000","last_clean":"2024-09-12T02:47:27.685598+0000","last_became_active":"2024-09-12T02:47:27.685256+0000","last_became_peered":"2024-09-12T02:47:27.685256+0000","last_unstale":"2024-09-12T02:47:27.685598+0000","last_undegraded":"2024-09-12T02:47:27.685598+0000","last_fullsized":"2024-09-12T02:47:27.685598+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:26.657631+0000","last_clean_scrub_stamp":"2024-09-12T02:47:26.657631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:30.153027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"119'1","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.703737+0000","last_change":"2024-09-12T02:47:26.673843+0000","last_active":"2024-09-12T02:47:27.703737+0000","last_peered":"2024-09-12T02:47:27.703737+0000","last_clean":"2024-09-12T02:47:27.703737+0000","last_became_active":"2024-09-12T02:47:26.673602+0000","last_became_peered":"2024-09-12T02:47:26.673602+0000","last_unstale":"2024-09-12T02:47:27.703737+0000","last_undegraded":"2024-09-12T02:47:27.703737+0000","last_fullsized":"2024-09-12T02:47:27.703737+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:25.651788+0000","last_clean_scrub_stamp":"2024-09-12T02:47:25.651788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:05.116580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":363,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-12T02:47:27.690681+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:47:27.690681+0000","last_peered":"2024-09-12T02:47:27.690681+0000","last_clean":"2024-09-12T02:47:27.690681+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:47:27.690681+0000","last_undegraded":"2024-09-12T02:47:27.690681+0000","last_fullsized":"2024-09-12T02:47:27.690681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:25.823876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574919,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194104,"statfs":{"total":200000000,"available":198762502,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":639,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194673,"statfs":{"total":200000000,"available":199345443,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194680,"statfs":{"total":200000000,"available":199352870,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574919,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194680,"statfs":{"total":200000000,"available":199352870,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":640,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194672,"statfs":{"total":200000000,"available":199344461,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574919,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194680,"statfs":{"total":200000000,"available":199352870,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194680,"statfs":{"total":200000000,"available":199352870,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574919,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1215,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194096,"statfs":{"total":200000000,"available":198755145,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:47:32.268 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:47:32.268 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T02:47:32.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.463+0000 7f51f7a00640 1 Processor -- start 2024-09-12T02:47:32.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.463+0000 7f51f7a00640 1 -- start start 2024-09-12T02:47:32.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.464+0000 7f51f7a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51f01605e0 0x7f51f0160a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:32.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.464+0000 7f51f7a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51f0160f40 con 0x7f51f01466f0 2024-09-12T02:47:32.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.464+0000 7f51f7a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51f00b3af0 con 0x7f51f0071840 2024-09-12T02:47:32.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.464+0000 7f51f7a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f51f00b3dd0 con 0x7f51f01605e0 2024-09-12T02:47:32.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.465+0000 7f51f5000640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f51f01466f0 0x7f51f00b48b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58298/0 (socket says 172.21.15.112:58298) 2024-09-12T02:47:32.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.465+0000 7f51f5000640 1 -- 172.21.15.112:0/1202719467 learned_addr learned my addr 172.21.15.112:0/1202719467 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:32.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.465+0000 7f51efe00640 1 --2- 172.21.15.112:0/1202719467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51f01605e0 0x7f51f0160a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:32.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.465+0000 7f51ef400640 1 -- 172.21.15.112:0/1202719467 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1943449779 0 0) 0x7f51f0160f40 con 0x7f51f01466f0 2024-09-12T02:47:32.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.465+0000 7f51ef400640 1 -- 172.21.15.112:0/1202719467 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51d8003520 con 0x7f51f01466f0 2024-09-12T02:47:32.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.465+0000 7f51ef400640 1 -- 172.21.15.112:0/1202719467 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3556880860 0 0) 0x7f51f00b3af0 con 0x7f51f0071840 2024-09-12T02:47:32.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.465+0000 7f51ef400640 1 -- 172.21.15.112:0/1202719467 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51f0160f40 con 0x7f51f0071840 2024-09-12T02:47:32.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.465+0000 7f51ef400640 1 -- 172.21.15.112:0/1202719467 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 13196587 0 0) 0x7f51d8003520 con 0x7f51f01466f0 2024-09-12T02:47:32.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.465+0000 7f51ef400640 1 -- 172.21.15.112:0/1202719467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51f01605e0 msgr2=0x7f51f0160a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:32.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.465+0000 7f51ef400640 1 --2- 172.21.15.112:0/1202719467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51f01605e0 0x7f51f0160a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:32.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.465+0000 7f51ef400640 1 -- 172.21.15.112:0/1202719467 >> v1:172.21.15.137:6789/0 conn(0x7f51f0071840 legacy=0x7f51f0071cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:32.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.465+0000 7f51ef400640 1 -- 172.21.15.112:0/1202719467 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f00b40b0 con 0x7f51f01466f0 2024-09-12T02:47:32.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.465+0000 7f51ef400640 1 -- 172.21.15.112:0/1202719467 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f51e4001670 con 0x7f51f01466f0 2024-09-12T02:47:32.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.465+0000 7f51ef400640 1 -- 172.21.15.112:0/1202719467 >> v1:172.21.15.112:6789/0 conn(0x7f51f01466f0 legacy=0x7f51f00b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:32.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.465+0000 7f51ef400640 1 --2- 172.21.15.112:0/1202719467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51d8003b70 0x7f51d8003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:32.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.465+0000 7f51ef400640 1 --2- 172.21.15.112:0/1202719467 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51d8004800 0x7f51d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:32.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.465+0000 7f51ef400640 1 --2- 172.21.15.112:0/1202719467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51d80051c0 0x7f51d800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:32.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.466+0000 7f51ef400640 1 -- 172.21.15.112:0/1202719467 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f51f00b3dd0 con 0x7f51d80051c0 2024-09-12T02:47:32.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.466+0000 7f51ef400640 1 -- 172.21.15.112:0/1202719467 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f51d800c090 con 0x7f51d8004800 2024-09-12T02:47:32.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.466+0000 7f51ef400640 1 -- 172.21.15.112:0/1202719467 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f51d800c290 con 0x7f51d8003b70 2024-09-12T02:47:32.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.466+0000 7f51f5000640 1 --2- 172.21.15.112:0/1202719467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51d8003b70 0x7f51d8003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:32.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.466+0000 7f51efe00640 1 --2- 172.21.15.112:0/1202719467 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51d8004800 0x7f51d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:32.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.466+0000 7f51f5a00640 1 --2- 172.21.15.112:0/1202719467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51d80051c0 0x7f51d800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:32.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.466+0000 7f51f5000640 1 -- 172.21.15.112:0/1202719467 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51d8004800 msgr2=0x7f51d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:32.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.466+0000 7f51f5000640 1 --2- 172.21.15.112:0/1202719467 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51d8004800 0x7f51d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:32.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.466+0000 7f51f5000640 1 -- 172.21.15.112:0/1202719467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51d80051c0 msgr2=0x7f51d800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:32.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.466+0000 7f51f5000640 1 --2- 172.21.15.112:0/1202719467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51d80051c0 0x7f51d800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:32.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.466+0000 7f51f5000640 1 -- 172.21.15.112:0/1202719467 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d8003520 con 0x7f51d8003b70 2024-09-12T02:47:32.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.467+0000 7f51f5000640 1 --2- 172.21.15.112:0/1202719467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51d8003b70 0x7f51d8003f70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f51e4007fd0 tx=0x7f51d8005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b20d77f2dc48c912 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:32.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.468+0000 7f51ef400640 1 -- 172.21.15.112:0/1202719467 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e4007bc0 con 0x7f51d8003b70 2024-09-12T02:47:32.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.468+0000 7f51ef400640 1 -- 172.21.15.112:0/1202719467 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51e4005af0 con 0x7f51d8003b70 2024-09-12T02:47:32.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.468+0000 7f51ef400640 1 -- 172.21.15.112:0/1202719467 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e4007070 con 0x7f51d8003b70 2024-09-12T02:47:32.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.468+0000 7f51f7a00640 1 -- 172.21.15.112:0/1202719467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51d8003b70 msgr2=0x7f51d8003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:32.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.468+0000 7f51f7a00640 1 --2- 172.21.15.112:0/1202719467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51d8003b70 0x7f51d8003f70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f51e4007fd0 tx=0x7f51d8005830 comp rx=0 tx=0).stop 2024-09-12T02:47:32.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.468+0000 7f51f5a00640 1 -- 172.21.15.112:0/1202719467 reap_dead start 2024-09-12T02:47:32.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.468+0000 7f51f7a00640 1 -- 172.21.15.112:0/1202719467 shutdown_connections 2024-09-12T02:47:32.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.468+0000 7f51f7a00640 1 -- 172.21.15.112:0/1202719467 >> 172.21.15.112:0/1202719467 conn(0x7f51f00b28a0 msgr2=0x7f51f00b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:32.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.468+0000 7f51f7a00640 1 -- 172.21.15.112:0/1202719467 shutdown_connections 2024-09-12T02:47:32.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.468+0000 7f51f7a00640 1 -- 172.21.15.112:0/1202719467 wait complete. 2024-09-12T02:47:32.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.470+0000 7f51f7a00640 1 Processor -- start 2024-09-12T02:47:32.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.470+0000 7f51f7a00640 1 -- start start 2024-09-12T02:47:32.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.471+0000 7f51f7a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51d8003b70 0x7f51f01f7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:32.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.471+0000 7f51f7a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51f01f84d0 0x7f51f00ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:32.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.471+0000 7f51f7a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51f00aee10 0x7f51f00cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:32.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.471+0000 7f51f7a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f51f0160b80 con 0x7f51d8003b70 2024-09-12T02:47:32.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.471+0000 7f51f7a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f51f0160a00 con 0x7f51f01f84d0 2024-09-12T02:47:32.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.471+0000 7f51f7a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f51f0160d00 con 0x7f51f00aee10 2024-09-12T02:47:32.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.471+0000 7f51f5000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51d8003b70 0x7f51f01f7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:32.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.471+0000 7f51f5000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51d8003b70 0x7f51f01f7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59184/0 (socket says 172.21.15.112:59184) 2024-09-12T02:47:32.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.471+0000 7f51f5000640 1 -- 172.21.15.112:0/1325358864 learned_addr learned my addr 172.21.15.112:0/1325358864 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:32.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.472+0000 7f51f5000640 1 -- 172.21.15.112:0/1325358864 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51f00aee10 msgr2=0x7f51f00cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:32.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.472+0000 7f51f5000640 1 --2- 172.21.15.112:0/1325358864 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51f00aee10 0x7f51f00cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:32.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.472+0000 7f51f5000640 1 -- 172.21.15.112:0/1325358864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51f01f84d0 msgr2=0x7f51f00ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:32.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.472+0000 7f51f5000640 1 --2- 172.21.15.112:0/1325358864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51f01f84d0 0x7f51f00ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:32.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.472+0000 7f51f5000640 1 -- 172.21.15.112:0/1325358864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f00af4b0 con 0x7f51d8003b70 2024-09-12T02:47:32.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.472+0000 7f51f5000640 1 --2- 172.21.15.112:0/1325358864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51d8003b70 0x7f51f01f7f90 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f51e4007fd0 tx=0x7f51f00b4280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:32.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.472+0000 7f51ecc00640 1 -- 172.21.15.112:0/1325358864 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e4001b20 con 0x7f51d8003b70 2024-09-12T02:47:32.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.472+0000 7f51ecc00640 1 -- 172.21.15.112:0/1325358864 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51e4042070 con 0x7f51d8003b70 2024-09-12T02:47:32.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.472+0000 7f51ecc00640 1 -- 172.21.15.112:0/1325358864 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e4001670 con 0x7f51d8003b70 2024-09-12T02:47:32.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.472+0000 7f51f7a00640 1 -- 172.21.15.112:0/1325358864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51f00af790 con 0x7f51d8003b70 2024-09-12T02:47:32.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.472+0000 7f51f7a00640 1 -- 172.21.15.112:0/1325358864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51f00afd50 con 0x7f51d8003b70 2024-09-12T02:47:32.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.473+0000 7f51f7a00640 1 -- 172.21.15.112:0/1325358864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51f01f88f0 con 0x7f51d8003b70 2024-09-12T02:47:32.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.474+0000 7f51ecc00640 1 -- 172.21.15.112:0/1325358864 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f51e4007270 con 0x7f51d8003b70 2024-09-12T02:47:32.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.475+0000 7f51ecc00640 1 --2- 172.21.15.112:0/1325358864 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f51d006be30 0x7f51d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:32.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.475+0000 7f51ecc00640 1 -- 172.21.15.112:0/1325358864 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7f51e40aaf00 con 0x7f51d8003b70 2024-09-12T02:47:32.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.475+0000 7f51efe00640 1 --2- 172.21.15.112:0/1325358864 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f51d006be30 0x7f51d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:32.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.476+0000 7f51efe00640 1 --2- 172.21.15.112:0/1325358864 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f51d006be30 0x7f51d006e2f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f51dc006a90 tx=0x7f51dc006a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:32.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.479+0000 7f51ecc00640 1 -- 172.21.15.112:0/1325358864 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f51e4007560 con 0x7f51d8003b70 2024-09-12T02:47:32.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.716+0000 7f51f7a00640 1 -- 172.21.15.112:0/1325358864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f51f00b48b0 con 0x7f51d8003b70 2024-09-12T02:47:32.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.719+0000 7f51ecc00640 1 -- 172.21.15.112:0/1325358864 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) ==== 190+0+147 (secure 0 0 0) 0x7f51e4079810 con 0x7f51d8003b70 2024-09-12T02:47:32.719 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-09-12T02:47:32.719 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDUVOJmaG86ExAAD0SOlJOsLpoQZlgPJIPaxA== 2024-09-12T02:47:32.719 INFO:teuthology.orchestra.run.smithi112.stdout: caps mds = "allow" 2024-09-12T02:47:32.719 INFO:teuthology.orchestra.run.smithi112.stdout: caps mon = "allow r" 2024-09-12T02:47:32.720 INFO:teuthology.orchestra.run.smithi112.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T02:47:32.720 INFO:teuthology.orchestra.run.smithi112.stderr:updated caps for client.0 2024-09-12T02:47:32.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.722+0000 7f51f7a00640 1 -- 172.21.15.112:0/1325358864 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f51d006be30 msgr2=0x7f51d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:32.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.722+0000 7f51f7a00640 1 --2- 172.21.15.112:0/1325358864 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f51d006be30 0x7f51d006e2f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f51dc006a90 tx=0x7f51dc006a20 comp rx=0 tx=0).stop 2024-09-12T02:47:32.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.722+0000 7f51f7a00640 1 -- 172.21.15.112:0/1325358864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51d8003b70 msgr2=0x7f51f01f7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:32.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.722+0000 7f51f7a00640 1 --2- 172.21.15.112:0/1325358864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51d8003b70 0x7f51f01f7f90 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f51e4007fd0 tx=0x7f51f00b4280 comp rx=0 tx=0).stop 2024-09-12T02:47:32.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.722+0000 7f51f7a00640 1 -- 172.21.15.112:0/1325358864 shutdown_connections 2024-09-12T02:47:32.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.722+0000 7f51f7a00640 1 --2- 172.21.15.112:0/1325358864 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51f00aee10 0x7f51f00cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:32.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.722+0000 7f51f7a00640 1 --2- 172.21.15.112:0/1325358864 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f51d006be30 0x7f51d006e2f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:32.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.722+0000 7f51f7a00640 1 --2- 172.21.15.112:0/1325358864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51f01f84d0 0x7f51f00ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:32.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.722+0000 7f51f7a00640 1 --2- 172.21.15.112:0/1325358864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51d8003b70 0x7f51f01f7f90 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:32.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.722+0000 7f51f7a00640 1 -- 172.21.15.112:0/1325358864 >> 172.21.15.112:0/1325358864 conn(0x7f51f00b28a0 msgr2=0x7f51f015c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:32.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.722+0000 7f51f7a00640 1 -- 172.21.15.112:0/1325358864 shutdown_connections 2024-09-12T02:47:32.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.722+0000 7f51f7a00640 1 -- 172.21.15.112:0/1325358864 wait complete. 2024-09-12T02:47:32.738 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:47:32.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.891+0000 7f6e8b600640 1 Processor -- start 2024-09-12T02:47:32.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.891+0000 7f6e8b600640 1 -- start start 2024-09-12T02:47:32.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.892+0000 7f6e8b600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6e8406d8c0 0x7f6e840afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:32.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.892+0000 7f6e8b600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6e8406dca0 0x7f6e8406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:32.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.892+0000 7f6e8b600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e840aedd0 con 0x7f6e840ae8d0 2024-09-12T02:47:32.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.892+0000 7f6e8b600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f6e840af0b0 con 0x7f6e8406d8c0 2024-09-12T02:47:32.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.892+0000 7f6e8b600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6e840af390 con 0x7f6e8406dca0 2024-09-12T02:47:32.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.893+0000 7f6e88c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6e8406d8c0 0x7f6e840afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:32.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.893+0000 7f6e88c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6e8406d8c0 0x7f6e840afe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59200/0 (socket says 172.21.15.112:59200) 2024-09-12T02:47:32.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.893+0000 7f6e88c00640 1 -- 172.21.15.112:0/2600935509 learned_addr learned my addr 172.21.15.112:0/2600935509 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:32.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.893+0000 7f6e83e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f6e840ae8d0 0x7f6e840715a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58300/0 (socket says 172.21.15.112:58300) 2024-09-12T02:47:32.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.893+0000 7f6e89600640 1 --2- 172.21.15.112:0/2600935509 >> v2:172.21.15.137:3300/0 conn(0x7f6e8406dca0 0x7f6e8406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:32.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.893+0000 7f6e88c00640 1 -- 172.21.15.112:0/2600935509 >> v2:172.21.15.137:3300/0 conn(0x7f6e8406dca0 msgr2=0x7f6e8406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:32.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.893+0000 7f6e88c00640 1 --2- 172.21.15.112:0/2600935509 >> v2:172.21.15.137:3300/0 conn(0x7f6e8406dca0 0x7f6e8406e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:32.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.893+0000 7f6e88c00640 1 -- 172.21.15.112:0/2600935509 >> v1:172.21.15.112:6789/0 conn(0x7f6e840ae8d0 legacy=0x7f6e840715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:32.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.893+0000 7f6e88c00640 1 -- 172.21.15.112:0/2600935509 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e840af670 con 0x7f6e8406d8c0 2024-09-12T02:47:32.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.893+0000 7f6e83400640 1 -- 172.21.15.112:0/2600935509 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2004175958 0 0) 0x7f6e840aedd0 con 0x7f6e840ae8d0 2024-09-12T02:47:32.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.894+0000 7f6e88c00640 1 --2- 172.21.15.112:0/2600935509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e8406d8c0 0x7f6e840afe70 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f6e840d06c0 tx=0x7f6e7802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e73ffcf796f58562 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:32.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.894+0000 7f6e83400640 1 -- 172.21.15.112:0/2600935509 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e78037070 con 0x7f6e8406d8c0 2024-09-12T02:47:32.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.894+0000 7f6e83400640 1 -- 172.21.15.112:0/2600935509 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e78032440 con 0x7f6e8406d8c0 2024-09-12T02:47:32.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.894+0000 7f6e83400640 1 -- 172.21.15.112:0/2600935509 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e78032810 con 0x7f6e8406d8c0 2024-09-12T02:47:32.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.895+0000 7f6e8b600640 1 -- 172.21.15.112:0/2600935509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e8406d8c0 msgr2=0x7f6e840afe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:32.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.895+0000 7f6e8b600640 1 --2- 172.21.15.112:0/2600935509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e8406d8c0 0x7f6e840afe70 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f6e840d06c0 tx=0x7f6e7802a270 comp rx=0 tx=0).stop 2024-09-12T02:47:32.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.895+0000 7f6e8b600640 1 -- 172.21.15.112:0/2600935509 shutdown_connections 2024-09-12T02:47:32.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.895+0000 7f6e8b600640 1 --2- 172.21.15.112:0/2600935509 >> v2:172.21.15.137:3300/0 conn(0x7f6e8406dca0 0x7f6e8406e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:32.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.895+0000 7f6e8b600640 1 --2- 172.21.15.112:0/2600935509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e8406d8c0 0x7f6e840afe70 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:32.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.895+0000 7f6e8b600640 1 -- 172.21.15.112:0/2600935509 >> 172.21.15.112:0/2600935509 conn(0x7f6e8406bbd0 msgr2=0x7f6e8406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:32.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.895+0000 7f6e8b600640 1 -- 172.21.15.112:0/2600935509 shutdown_connections 2024-09-12T02:47:32.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.895+0000 7f6e8b600640 1 -- 172.21.15.112:0/2600935509 wait complete. 2024-09-12T02:47:32.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.896+0000 7f6e8b600640 1 Processor -- start 2024-09-12T02:47:32.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.897+0000 7f6e8b600640 1 -- start start 2024-09-12T02:47:32.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.897+0000 7f6e8b600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e8406d8c0 0x7f6e840cf290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:32.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.897+0000 7f6e8b600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e8406dca0 0x7f6e8414c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:32.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.897+0000 7f6e8b600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e840ae8d0 0x7f6e84159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:32.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.897+0000 7f6e8b600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6e840b38e0 con 0x7f6e8406dca0 2024-09-12T02:47:32.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.897+0000 7f6e8b600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8406e690 con 0x7f6e8406d8c0 2024-09-12T02:47:32.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.897+0000 7f6e8b600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6e840b3a60 con 0x7f6e840ae8d0 2024-09-12T02:47:32.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.898+0000 7f6e83e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e8406dca0 0x7f6e8414c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:32.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.898+0000 7f6e83e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e8406dca0 0x7f6e8414c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59208/0 (socket says 172.21.15.112:59208) 2024-09-12T02:47:32.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.898+0000 7f6e83e00640 1 -- 172.21.15.112:0/2141493231 learned_addr learned my addr 172.21.15.112:0/2141493231 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:32.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.898+0000 7f6e89600640 1 --2- 172.21.15.112:0/2141493231 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e840ae8d0 0x7f6e84159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:32.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.898+0000 7f6e88c00640 1 --2- 172.21.15.112:0/2141493231 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e8406d8c0 0x7f6e840cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:32.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.898+0000 7f6e83e00640 1 -- 172.21.15.112:0/2141493231 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e840ae8d0 msgr2=0x7f6e84159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:32.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.898+0000 7f6e83e00640 1 --2- 172.21.15.112:0/2141493231 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e840ae8d0 0x7f6e84159310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:32.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.898+0000 7f6e83e00640 1 -- 172.21.15.112:0/2141493231 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e8406d8c0 msgr2=0x7f6e840cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:32.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.898+0000 7f6e83e00640 1 --2- 172.21.15.112:0/2141493231 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e8406d8c0 0x7f6e840cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:32.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.898+0000 7f6e83e00640 1 -- 172.21.15.112:0/2141493231 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e8415a0e0 con 0x7f6e8406dca0 2024-09-12T02:47:32.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.898+0000 7f6e83e00640 1 --2- 172.21.15.112:0/2141493231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e8406dca0 0x7f6e8414c240 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f6e7000c430 tx=0x7f6e7000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:32.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.899+0000 7f6e80c00640 1 -- 172.21.15.112:0/2141493231 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e70017070 con 0x7f6e8406dca0 2024-09-12T02:47:32.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.899+0000 7f6e80c00640 1 -- 172.21.15.112:0/2141493231 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e700074e0 con 0x7f6e8406dca0 2024-09-12T02:47:32.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.899+0000 7f6e80c00640 1 -- 172.21.15.112:0/2141493231 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e700059e0 con 0x7f6e8406dca0 2024-09-12T02:47:32.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.899+0000 7f6e8b600640 1 -- 172.21.15.112:0/2141493231 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e8415a3c0 con 0x7f6e8406dca0 2024-09-12T02:47:32.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.899+0000 7f6e8b600640 1 -- 172.21.15.112:0/2141493231 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e8415a980 con 0x7f6e8406dca0 2024-09-12T02:47:32.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.900+0000 7f6e8b600640 1 -- 172.21.15.112:0/2141493231 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e84068a30 con 0x7f6e8406dca0 2024-09-12T02:47:32.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.901+0000 7f6e80c00640 1 -- 172.21.15.112:0/2141493231 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6e7001a070 con 0x7f6e8406dca0 2024-09-12T02:47:32.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.902+0000 7f6e80c00640 1 --2- 172.21.15.112:0/2141493231 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6e6406be30 0x7f6e6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:32.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.902+0000 7f6e80c00640 1 -- 172.21.15.112:0/2141493231 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7f6e7008a170 con 0x7f6e8406dca0 2024-09-12T02:47:32.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.902+0000 7f6e88c00640 1 --2- 172.21.15.112:0/2141493231 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6e6406be30 0x7f6e6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:32.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.903+0000 7f6e88c00640 1 --2- 172.21.15.112:0/2141493231 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6e6406be30 0x7f6e6406e2f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6e78034000 tx=0x7f6e7802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:32.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:32.906+0000 7f6e80c00640 1 -- 172.21.15.112:0/2141493231 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6e700584c0 con 0x7f6e8406dca0 2024-09-12T02:47:33.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.114+0000 7f6e8b600640 1 -- 172.21.15.112:0/2141493231 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e8415ab50 con 0x7f6e8406dca0 2024-09-12T02:47:33.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.115+0000 7f6e80c00640 1 -- 172.21.15.112:0/2141493231 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5231 (secure 0 0 0) 0x7f6e7005c7c0 con 0x7f6e8406dca0 2024-09-12T02:47:33.115 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:33.115 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":62,"btime":"2024-09-12T02:47:30:715299+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5612,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/3181313801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3181313801},{"type":"v1","addr":"172.21.15.137:6834","nonce":3181313801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":5615,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2025494075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2025494075},{"type":"v1","addr":"172.21.15.137:6835","nonce":2025494075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6501,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3739674039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3739674039},{"type":"v1","addr":"172.21.15.112:6837","nonce":3739674039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:47:27.076883+0000","modified":"2024-09-12T02:47:30.117205+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6504},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6504":{"gid":6504,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/63450161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":63450161},{"type":"v1","addr":"172.21.15.112:6836","nonce":63450161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6504,"qdb_cluster":[6504]},"id":7}]} 2024-09-12T02:47:33.115 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 62 2024-09-12T02:47:33.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.117+0000 7f6e8b600640 1 -- 172.21.15.112:0/2141493231 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6e6406be30 msgr2=0x7f6e6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:33.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.117+0000 7f6e8b600640 1 --2- 172.21.15.112:0/2141493231 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6e6406be30 0x7f6e6406e2f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6e78034000 tx=0x7f6e7802e000 comp rx=0 tx=0).stop 2024-09-12T02:47:33.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.117+0000 7f6e8b600640 1 -- 172.21.15.112:0/2141493231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e8406dca0 msgr2=0x7f6e8414c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:33.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.117+0000 7f6e8b600640 1 --2- 172.21.15.112:0/2141493231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e8406dca0 0x7f6e8414c240 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f6e7000c430 tx=0x7f6e7000c8f0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.117+0000 7f6e8b600640 1 -- 172.21.15.112:0/2141493231 shutdown_connections 2024-09-12T02:47:33.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.117+0000 7f6e8b600640 1 --2- 172.21.15.112:0/2141493231 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e840ae8d0 0x7f6e84159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.117+0000 7f6e8b600640 1 --2- 172.21.15.112:0/2141493231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e8406dca0 0x7f6e8414c240 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.117+0000 7f6e8b600640 1 --2- 172.21.15.112:0/2141493231 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6e6406be30 0x7f6e6406e2f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.117+0000 7f6e8b600640 1 --2- 172.21.15.112:0/2141493231 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e8406d8c0 0x7f6e840cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.117+0000 7f6e8b600640 1 -- 172.21.15.112:0/2141493231 >> 172.21.15.112:0/2141493231 conn(0x7f6e8406bbd0 msgr2=0x7f6e8415b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:33.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.117+0000 7f6e8b600640 1 -- 172.21.15.112:0/2141493231 shutdown_connections 2024-09-12T02:47:33.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.117+0000 7f6e8b600640 1 -- 172.21.15.112:0/2141493231 wait complete. 2024-09-12T02:47:33.537 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 62, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:47:27.076883+0000', 'modified': '2024-09-12T02:47:30.117205+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6504}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6504': {'gid': 6504, 'name': 'a', 'rank': 0, 'incarnation': 58, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.112:6836/63450161', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6834', 'nonce': 63450161}, {'type': 'v1', 'addr': '172.21.15.112:6836', 'nonce': 63450161}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6504, 'qdb_cluster': [6504]} 2024-09-12T02:47:33.538 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:47:33.538 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-12T02:47:33.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.694+0000 7fcdbd800640 1 Processor -- start 2024-09-12T02:47:33.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.694+0000 7fcdbd800640 1 -- start start 2024-09-12T02:47:33.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.695+0000 7fcdbd800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcdb806de00 0x7fcdb80b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.695+0000 7fcdbd800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdb80b6e10 con 0x7fcdb815ef10 2024-09-12T02:47:33.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.695+0000 7fcdbd800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdb80b70f0 con 0x7fcdb80b3ee0 2024-09-12T02:47:33.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.695+0000 7fcdbd800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fcdb815f2f0 con 0x7fcdb806de00 2024-09-12T02:47:33.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.696+0000 7fcdb7400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcdb806de00 0x7fcdb80b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.696+0000 7fcdb7400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcdb806de00 0x7fcdb80b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59224/0 (socket says 172.21.15.112:59224) 2024-09-12T02:47:33.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.696+0000 7fcdb7400640 1 -- 172.21.15.112:0/3373213190 learned_addr learned my addr 172.21.15.112:0/3373213190 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:33.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.696+0000 7fcdb7400640 1 -- 172.21.15.112:0/3373213190 >> v1:172.21.15.137:6789/0 conn(0x7fcdb80b3ee0 legacy=0x7fcdb80b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:33.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.696+0000 7fcdb7400640 1 -- 172.21.15.112:0/3373213190 >> v1:172.21.15.112:6789/0 conn(0x7fcdb815ef10 legacy=0x7fcdb806d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:33.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.696+0000 7fcdb7400640 1 -- 172.21.15.112:0/3373213190 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb80b73d0 con 0x7fcdb806de00 2024-09-12T02:47:33.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.697+0000 7fcdb7400640 1 --2- 172.21.15.112:0/3373213190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdb806de00 0x7fcdb80b24a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fcda4009870 tx=0x7fcda402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56e0638f6fd095b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:33.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.697+0000 7fcdb6a00640 1 -- 172.21.15.112:0/3373213190 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda4037070 con 0x7fcdb806de00 2024-09-12T02:47:33.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.697+0000 7fcdb6a00640 1 -- 172.21.15.112:0/3373213190 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcda4032440 con 0x7fcdb806de00 2024-09-12T02:47:33.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.697+0000 7fcdb6a00640 1 -- 172.21.15.112:0/3373213190 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda4032810 con 0x7fcdb806de00 2024-09-12T02:47:33.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.698+0000 7fcdbd800640 1 -- 172.21.15.112:0/3373213190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdb806de00 msgr2=0x7fcdb80b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:33.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.698+0000 7fcdbd800640 1 --2- 172.21.15.112:0/3373213190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdb806de00 0x7fcdb80b24a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fcda4009870 tx=0x7fcda402a180 comp rx=0 tx=0).stop 2024-09-12T02:47:33.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.698+0000 7fcdbd800640 1 -- 172.21.15.112:0/3373213190 shutdown_connections 2024-09-12T02:47:33.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.698+0000 7fcdbd800640 1 --2- 172.21.15.112:0/3373213190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdb806de00 0x7fcdb80b24a0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.698+0000 7fcdbd800640 1 -- 172.21.15.112:0/3373213190 >> 172.21.15.112:0/3373213190 conn(0x7fcdb80b7ea0 msgr2=0x7fcdb80b82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:33.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.698+0000 7fcdbd800640 1 -- 172.21.15.112:0/3373213190 shutdown_connections 2024-09-12T02:47:33.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.698+0000 7fcdbd800640 1 -- 172.21.15.112:0/3373213190 wait complete. 2024-09-12T02:47:33.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.700+0000 7fcdbd800640 1 Processor -- start 2024-09-12T02:47:33.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.700+0000 7fcdbd800640 1 -- start start 2024-09-12T02:47:33.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.701+0000 7fcdbd800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdb806de00 0x7fcdb8159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.701+0000 7fcdbd800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdb80b3ee0 0x7fcdb8152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.701+0000 7fcdbd800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcdb815ef10 0x7fcdb80ce030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.701+0000 7fcdbd800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb80b0b60 con 0x7fcdb80b3ee0 2024-09-12T02:47:33.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.701+0000 7fcdbd800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb80b09e0 con 0x7fcdb806de00 2024-09-12T02:47:33.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.701+0000 7fcdbd800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fcdb80b0ce0 con 0x7fcdb815ef10 2024-09-12T02:47:33.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.701+0000 7fcdb7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdb80b3ee0 0x7fcdb8152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.701+0000 7fcdb7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdb80b3ee0 0x7fcdb8152420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59230/0 (socket says 172.21.15.112:59230) 2024-09-12T02:47:33.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.701+0000 7fcdb7400640 1 -- 172.21.15.112:0/1963476266 learned_addr learned my addr 172.21.15.112:0/1963476266 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:33.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.701+0000 7fcdb7e00640 1 --2- 172.21.15.112:0/1963476266 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdb806de00 0x7fcdb8159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.701+0000 7fcdbce00640 1 --2- 172.21.15.112:0/1963476266 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcdb815ef10 0x7fcdb80ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.701+0000 7fcdb7400640 1 -- 172.21.15.112:0/1963476266 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcdb815ef10 msgr2=0x7fcdb80ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:33.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.701+0000 7fcdb7400640 1 --2- 172.21.15.112:0/1963476266 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcdb815ef10 0x7fcdb80ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.701+0000 7fcdb7400640 1 -- 172.21.15.112:0/1963476266 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdb806de00 msgr2=0x7fcdb8159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:33.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.701+0000 7fcdb7400640 1 --2- 172.21.15.112:0/1963476266 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdb806de00 0x7fcdb8159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.701+0000 7fcdb7400640 1 -- 172.21.15.112:0/1963476266 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb815a570 con 0x7fcdb80b3ee0 2024-09-12T02:47:33.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.702+0000 7fcdb7400640 1 --2- 172.21.15.112:0/1963476266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdb80b3ee0 0x7fcdb8152420 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fcda4009870 tx=0x7fcda40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:33.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.702+0000 7fcdafe00640 1 -- 172.21.15.112:0/1963476266 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda4041020 con 0x7fcdb80b3ee0 2024-09-12T02:47:33.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.702+0000 7fcdafe00640 1 -- 172.21.15.112:0/1963476266 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcda4030970 con 0x7fcdb80b3ee0 2024-09-12T02:47:33.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.702+0000 7fcdafe00640 1 -- 172.21.15.112:0/1963476266 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda4037040 con 0x7fcdb80b3ee0 2024-09-12T02:47:33.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.702+0000 7fcdbd800640 1 -- 172.21.15.112:0/1963476266 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdb815a850 con 0x7fcdb80b3ee0 2024-09-12T02:47:33.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.702+0000 7fcdbd800640 1 -- 172.21.15.112:0/1963476266 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdb815ae10 con 0x7fcdb80b3ee0 2024-09-12T02:47:33.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.705+0000 7fcdafe00640 1 -- 172.21.15.112:0/1963476266 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcda4044020 con 0x7fcdb80b3ee0 2024-09-12T02:47:33.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.706+0000 7fcdafe00640 1 --2- 172.21.15.112:0/1963476266 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcd9806be30 0x7fcd9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.706+0000 7fcdafe00640 1 -- 172.21.15.112:0/1963476266 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7fcda40ab6e0 con 0x7fcdb80b3ee0 2024-09-12T02:47:33.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.706+0000 7fcdb7e00640 1 --2- 172.21.15.112:0/1963476266 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcd9806be30 0x7fcd9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.706+0000 7fcdc1e0f740 1 Processor -- start 2024-09-12T02:47:33.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.706+0000 7fcdc1e0f740 1 -- start start 2024-09-12T02:47:33.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.706+0000 7fcdb7e00640 1 --2- 172.21.15.112:0/1963476266 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcd9806be30 0x7fcd9806e2f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fcdb81f8560 tx=0x7fcda8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:33.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.707+0000 7fcdc1e0f740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55faa27edea0 0x55faa2833640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.707+0000 7fcdc1e0f740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55faa27eb660 0x55faa27ee280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.707+0000 7fcdc1e0f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faa27ef630 0x55faa27e8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.707+0000 7fcdc1e0f740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55faa274c3b0 con 0x55faa27edea0 2024-09-12T02:47:33.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.707+0000 7fcdc1e0f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55faa2751410 con 0x55faa27ef630 2024-09-12T02:47:33.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.707+0000 7fcdc1e0f740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55faa26f9620 con 0x55faa27eb660 2024-09-12T02:47:33.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.707+0000 7fcdb7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55faa27edea0 0x55faa2833640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.707+0000 7fcdb7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55faa27edea0 0x55faa2833640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59234/0 (socket says 172.21.15.112:59234) 2024-09-12T02:47:33.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.707+0000 7fcdb7e00640 1 -- 172.21.15.112:0/877598761 learned_addr learned my addr 172.21.15.112:0/877598761 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:33.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.708+0000 7fcdb7400640 1 --2- 172.21.15.112:0/877598761 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55faa27eb660 0x55faa27ee280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.708+0000 7fcdbce00640 1 --2- 172.21.15.112:0/877598761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faa27ef630 0x55faa27e8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.708+0000 7fcdb7e00640 1 -- 172.21.15.112:0/877598761 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55faa27eb660 msgr2=0x55faa27ee280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:33.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.708+0000 7fcdb7e00640 1 --2- 172.21.15.112:0/877598761 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55faa27eb660 0x55faa27ee280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.708+0000 7fcdb7e00640 1 -- 172.21.15.112:0/877598761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faa27ef630 msgr2=0x55faa27e8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:33.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.708+0000 7fcdb7e00640 1 --2- 172.21.15.112:0/877598761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faa27ef630 0x55faa27e8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.708+0000 7fcdb7e00640 1 -- 172.21.15.112:0/877598761 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faa24642d0 con 0x55faa27edea0 2024-09-12T02:47:33.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.708+0000 7fcdb7e00640 1 --2- 172.21.15.112:0/877598761 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55faa27edea0 0x55faa2833640 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fcda800f9b0 tx=0x7fcda8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e33d7b34266d06 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:33.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.708+0000 7fcdacc00640 1 -- 172.21.15.112:0/877598761 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda8025070 con 0x55faa27edea0 2024-09-12T02:47:33.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.708+0000 7fcdacc00640 1 -- 172.21.15.112:0/877598761 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcda801b050 con 0x55faa27edea0 2024-09-12T02:47:33.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.708+0000 7fcdacc00640 1 -- 172.21.15.112:0/877598761 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda80013a0 con 0x55faa27edea0 2024-09-12T02:47:33.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.709+0000 7fcdc1e0f740 1 -- 172.21.15.112:0/877598761 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55faa27edea0 msgr2=0x55faa2833640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:33.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.709+0000 7fcdc1e0f740 1 --2- 172.21.15.112:0/877598761 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55faa27edea0 0x55faa2833640 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fcda800f9b0 tx=0x7fcda8012000 comp rx=0 tx=0).stop 2024-09-12T02:47:33.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.709+0000 7fcdc1e0f740 1 -- 172.21.15.112:0/877598761 shutdown_connections 2024-09-12T02:47:33.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.709+0000 7fcdc1e0f740 1 --2- 172.21.15.112:0/877598761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faa27ef630 0x55faa27e8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.709+0000 7fcdc1e0f740 1 --2- 172.21.15.112:0/877598761 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55faa27eb660 0x55faa27ee280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.709+0000 7fcdc1e0f740 1 --2- 172.21.15.112:0/877598761 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55faa27edea0 0x55faa2833640 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.709+0000 7fcdc1e0f740 1 -- 172.21.15.112:0/877598761 >> 172.21.15.112:0/877598761 conn(0x55faa27ea8f0 msgr2=0x55faa2832b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:33.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.709+0000 7fcdc1e0f740 1 -- 172.21.15.112:0/877598761 shutdown_connections 2024-09-12T02:47:33.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.709+0000 7fcdc1e0f740 1 -- 172.21.15.112:0/877598761 wait complete. 2024-09-12T02:47:33.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.710+0000 7fcdc1e0f740 1 -- start start 2024-09-12T02:47:33.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.710+0000 7fcdc1e0f740 1 Processor -- start 2024-09-12T02:47:33.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.711+0000 7fcdc1e0f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faa27edea0 0x55faa27e9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.711+0000 7fcdc1e0f740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55faa27ef630 0x55faa280e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.711+0000 7fcdc1e0f740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55faa280ec80 0x55faa27ec5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.711+0000 7fcdc1e0f740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55faa270c780 con 0x55faa280ec80 2024-09-12T02:47:33.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.711+0000 7fcdc1e0f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55faa274d3d0 con 0x55faa27edea0 2024-09-12T02:47:33.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.711+0000 7fcdc1e0f740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55faa27e9d90 con 0x55faa27ef630 2024-09-12T02:47:33.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.711+0000 7fcdc1e0f740 10 client.0 _ll_register_callbacks cb 0x55faa274a5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:47:33.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.711+0000 7fcdbce00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55faa280ec80 0x55faa27ec5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.711+0000 7fcdbce00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55faa280ec80 0x55faa27ec5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59250/0 (socket says 172.21.15.112:59250) 2024-09-12T02:47:33.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.711+0000 7fcdbce00640 1 -- 172.21.15.112:0/3785839861 learned_addr learned my addr 172.21.15.112:0/3785839861 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:33.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.711+0000 7fcdb7e00640 1 --2- 172.21.15.112:0/3785839861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faa27edea0 0x55faa27e9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.711+0000 7fcdb7400640 1 --2- 172.21.15.112:0/3785839861 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55faa27ef630 0x55faa280e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.712+0000 7fcdbce00640 1 -- 172.21.15.112:0/3785839861 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55faa27ef630 msgr2=0x55faa280e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:33.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.712+0000 7fcdbce00640 1 --2- 172.21.15.112:0/3785839861 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55faa27ef630 0x55faa280e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.712+0000 7fcdbce00640 1 -- 172.21.15.112:0/3785839861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faa27edea0 msgr2=0x55faa27e9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:33.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.712+0000 7fcdbce00640 1 --2- 172.21.15.112:0/3785839861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faa27edea0 0x55faa27e9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.712+0000 7fcdbce00640 1 -- 172.21.15.112:0/3785839861 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55faa252e6b0 con 0x55faa280ec80 2024-09-12T02:47:33.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.712+0000 7fcdbce00640 1 --2- 172.21.15.112:0/3785839861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55faa280ec80 0x55faa27ec5a0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000bef0 tx=0x7fcdb000a7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32fa848aee3e28c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:33.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.712+0000 7fcda1600640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-12T02:47:33.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.712+0000 7fcda1600640 1 -- 172.21.15.112:0/3785839861 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0016410 con 0x55faa280ec80 2024-09-12T02:47:33.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.712+0000 7fcda1600640 1 -- 172.21.15.112:0/3785839861 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7fcdb00165b0 con 0x55faa280ec80 2024-09-12T02:47:33.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.712+0000 7fcdc1e0f740 1 -- 172.21.15.112:0/3785839861 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcda801b050 con 0x55faa280ec80 2024-09-12T02:47:33.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.712+0000 7fcda1600640 1 -- 172.21.15.112:0/3785839861 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fcdb0016840 con 0x55faa280ec80 2024-09-12T02:47:33.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.712+0000 7fcdc1e0f740 10 client.6624 fetch_fsmap learned FSMap version 62 2024-09-12T02:47:33.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.712+0000 7fcdc1e0f740 1 -- 172.21.15.112:0/3785839861 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) -- 0x55faa2843860 con 0x55faa280ec80 2024-09-12T02:47:33.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.713+0000 7fcda1600640 1 -- 172.21.15.112:0/3785839861 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcda801b050 con 0x55faa280ec80 2024-09-12T02:47:33.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.713+0000 7fcda1600640 1 -- 172.21.15.112:0/3785839861 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 62) ==== 3502+0+0 (secure 0 0 0) 0x7fcdb0026080 con 0x55faa280ec80 2024-09-12T02:47:33.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.713+0000 7fcdc1e0f740 10 client.6624 fetch_fsmap finished waiting for FSMap version 62 2024-09-12T02:47:33.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.713+0000 7fcdc1e0f740 10 client.6624 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T02:47:33.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.713+0000 7fcdc1e0f740 20 client.6624 populate_metadata read hostname 'smithi112' 2024-09-12T02:47:33.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.713+0000 7fcdc1e0f740 1 --2- 172.21.15.112:0/3785839861 >> [v2:172.21.15.112:6834/63450161,v1:172.21.15.112:6836/63450161] conn(0x55faa27e7c40 0x55faa27e8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.713+0000 7fcdc1e0f740 4 client.6624 mds_command: new command op to 6504 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:47:33.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.713+0000 7fcdc1e0f740 1 -- 172.21.15.112:0/3785839861 --> [v2:172.21.15.112:6834/63450161,v1:172.21.15.112:6836/63450161] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55faa275eb40 con 0x55faa27e7c40 2024-09-12T02:47:33.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.713+0000 7fcdb7e00640 1 --2- 172.21.15.112:0/3785839861 >> [v2:172.21.15.112:6834/63450161,v1:172.21.15.112:6836/63450161] conn(0x55faa27e7c40 0x55faa27e8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.714+0000 7fcda1600640 10 client.6624 ms_handle_connect on v2:172.21.15.112:6834/63450161 2024-09-12T02:47:33.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.714+0000 7fcdb7e00640 1 --2- 172.21.15.112:0/3785839861 >> [v2:172.21.15.112:6834/63450161,v1:172.21.15.112:6836/63450161] conn(0x55faa27e7c40 0x55faa27e8020 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90447274ba5d12b3 server_cookie=a7cdcbf7d0df555b in_seq=0 out_seq=0 2024-09-12T02:47:33.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.714+0000 7fcda1600640 1 -- 172.21.15.112:0/3785839861 <== mds.0 v2:172.21.15.112:6834/63450161 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55faa275eb40 con 0x55faa27e7c40 2024-09-12T02:47:33.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.714+0000 7fcda1600640 10 client.6624 handle_command_reply: tid=0 2024-09-12T02:47:33.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.714+0000 7fcdc1e0f740 1 client.6624 shutdown 2024-09-12T02:47:33.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.715+0000 7fcdc1e0f740 1 -- 172.21.15.112:0/3785839861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55faa280ec80 msgr2=0x55faa27ec5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:33.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.715+0000 7fcdc1e0f740 1 --2- 172.21.15.112:0/3785839861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55faa280ec80 0x55faa27ec5a0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000bef0 tx=0x7fcdb000a7b0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.715+0000 7fcdc1e0f740 1 -- 172.21.15.112:0/3785839861 shutdown_connections 2024-09-12T02:47:33.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.715+0000 7fcdc1e0f740 1 --2- 172.21.15.112:0/3785839861 >> [v2:172.21.15.112:6834/63450161,v1:172.21.15.112:6836/63450161] conn(0x55faa27e7c40 0x55faa27e8020 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.715+0000 7fcdc1e0f740 1 --2- 172.21.15.112:0/3785839861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55faa280ec80 0x55faa27ec5a0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.715+0000 7fcdc1e0f740 1 --2- 172.21.15.112:0/3785839861 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55faa27ef630 0x55faa280e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.715+0000 7fcda1600640 0 client.6624 ms_handle_reset on v2:172.21.15.112:6834/63450161 2024-09-12T02:47:33.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.715+0000 7fcdc1e0f740 1 --2- 172.21.15.112:0/3785839861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faa27edea0 0x55faa27e9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.715+0000 7fcdc1e0f740 1 -- 172.21.15.112:0/3785839861 >> 172.21.15.112:0/3785839861 conn(0x55faa27eb660 msgr2=0x55faa2832050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:33.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.715+0000 7fcdc1e0f740 1 -- 172.21.15.112:0/3785839861 shutdown_connections 2024-09-12T02:47:33.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.715+0000 7fcdc1e0f740 1 -- 172.21.15.112:0/3785839861 wait complete. 2024-09-12T02:47:33.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.715+0000 7fcdc1e0f740 20 client.6624 trim_cache size 0 max 16384 2024-09-12T02:47:33.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.734+0000 7fcdc1e0f740 1 Processor -- start 2024-09-12T02:47:33.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.734+0000 7fcdc1e0f740 1 -- start start 2024-09-12T02:47:33.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.734+0000 7fcdc1e0f740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55faa27edea0 0x55faa27e8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.735+0000 7fcdc1e0f740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55faa27ef630 0x55faa2856940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.735+0000 7fcdc1e0f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faa280ec80 0x55faa2856e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.735+0000 7fcdc1e0f740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb82013d0 con 0x55faa27ef630 2024-09-12T02:47:33.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.735+0000 7fcdc1e0f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb80cc610 con 0x55faa280ec80 2024-09-12T02:47:33.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.735+0000 7fcdc1e0f740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fcdb80ccc60 con 0x55faa27edea0 2024-09-12T02:47:33.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.735+0000 7fcdb7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55faa27ef630 0x55faa2856940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.735+0000 7fcdb7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55faa27ef630 0x55faa2856940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59256/0 (socket says 172.21.15.112:59256) 2024-09-12T02:47:33.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.735+0000 7fcdb7400640 1 -- 172.21.15.112:0/3565826922 learned_addr learned my addr 172.21.15.112:0/3565826922 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:33.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.735+0000 7fcdbce00640 1 --2- 172.21.15.112:0/3565826922 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faa280ec80 0x55faa2856e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.735+0000 7fcdb7e00640 1 --2- 172.21.15.112:0/3565826922 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55faa27edea0 0x55faa27e8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.735+0000 7fcdb7400640 1 -- 172.21.15.112:0/3565826922 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55faa27edea0 msgr2=0x55faa27e8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:33.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.735+0000 7fcdb7400640 1 --2- 172.21.15.112:0/3565826922 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55faa27edea0 0x55faa27e8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.735+0000 7fcdb7400640 1 -- 172.21.15.112:0/3565826922 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faa280ec80 msgr2=0x55faa2856e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:33.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.735+0000 7fcdb7400640 1 --2- 172.21.15.112:0/3565826922 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faa280ec80 0x55faa2856e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.735+0000 7fcdb7400640 1 -- 172.21.15.112:0/3565826922 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faa28169f0 con 0x55faa27ef630 2024-09-12T02:47:33.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.736+0000 7fcdb7400640 1 --2- 172.21.15.112:0/3565826922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55faa27ef630 0x55faa2856940 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fcda40799d0 tx=0x7fcda4080040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99abbe9fce33636c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:33.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.737+0000 7fcda3e00640 1 -- 172.21.15.112:0/3565826922 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda4079a40 con 0x55faa27ef630 2024-09-12T02:47:33.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.737+0000 7fcda3e00640 1 -- 172.21.15.112:0/3565826922 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcda407dd40 con 0x55faa27ef630 2024-09-12T02:47:33.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.737+0000 7fcda3e00640 1 -- 172.21.15.112:0/3565826922 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda4082570 con 0x55faa27ef630 2024-09-12T02:47:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.737+0000 7fcdc1e0f740 1 -- 172.21.15.112:0/3565826922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55faa27ef630 msgr2=0x55faa2856940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.737+0000 7fcdc1e0f740 1 --2- 172.21.15.112:0/3565826922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55faa27ef630 0x55faa2856940 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fcda40799d0 tx=0x7fcda4080040 comp rx=0 tx=0).stop 2024-09-12T02:47:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.737+0000 7fcdc1e0f740 1 -- 172.21.15.112:0/3565826922 shutdown_connections 2024-09-12T02:47:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.737+0000 7fcdc1e0f740 1 --2- 172.21.15.112:0/3565826922 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faa280ec80 0x55faa2856e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.737+0000 7fcdc1e0f740 1 --2- 172.21.15.112:0/3565826922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55faa27ef630 0x55faa2856940 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.737+0000 7fcdc1e0f740 1 --2- 172.21.15.112:0/3565826922 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55faa27edea0 0x55faa27e8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.737+0000 7fcdc1e0f740 1 -- 172.21.15.112:0/3565826922 >> 172.21.15.112:0/3565826922 conn(0x55faa27eb660 msgr2=0x55faa27e3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.737+0000 7fcdc1e0f740 1 -- 172.21.15.112:0/3565826922 shutdown_connections 2024-09-12T02:47:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.737+0000 7fcdc1e0f740 1 -- 172.21.15.112:0/3565826922 wait complete. 2024-09-12T02:47:33.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.738+0000 7fcdc1e0f740 1 -- start start 2024-09-12T02:47:33.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.738+0000 7fcdc1e0f740 1 Processor -- start 2024-09-12T02:47:33.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.739+0000 7fcdc1e0f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faa27edea0 0x55faa28abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.739+0000 7fcdc1e0f740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55faa27ef630 0x55faa2840e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.739+0000 7fcdc1e0f740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55faa280ec80 0x55faa2841370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.739+0000 7fcdc1e0f740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55faa280d1d0 con 0x55faa27ef630 2024-09-12T02:47:33.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.739+0000 7fcdc1e0f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55faa2843b40 con 0x55faa27edea0 2024-09-12T02:47:33.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.739+0000 7fcdc1e0f740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55faa2846db0 con 0x55faa280ec80 2024-09-12T02:47:33.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.739+0000 7fcdc1e0f740 10 client.0 _ll_register_callbacks cb 0x7fcdb0009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:47:33.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.739+0000 7fcdb7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55faa27ef630 0x55faa2840e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.740+0000 7fcdb7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55faa27ef630 0x55faa2840e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59272/0 (socket says 172.21.15.112:59272) 2024-09-12T02:47:33.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.740+0000 7fcdb7400640 1 -- 172.21.15.112:0/2148120079 learned_addr learned my addr 172.21.15.112:0/2148120079 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:33.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.740+0000 7fcdb7e00640 1 --2- 172.21.15.112:0/2148120079 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faa27edea0 0x55faa28abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.740+0000 7fcdbce00640 1 --2- 172.21.15.112:0/2148120079 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55faa280ec80 0x55faa2841370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.740+0000 7fcdb7400640 1 -- 172.21.15.112:0/2148120079 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55faa280ec80 msgr2=0x55faa2841370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:33.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.740+0000 7fcdb7400640 1 --2- 172.21.15.112:0/2148120079 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55faa280ec80 0x55faa2841370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.740+0000 7fcdb7400640 1 -- 172.21.15.112:0/2148120079 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faa27edea0 msgr2=0x55faa28abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.740+0000 7fcdb7400640 1 --2- 172.21.15.112:0/2148120079 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faa27edea0 0x55faa28abbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.740+0000 7fcdb7400640 1 -- 172.21.15.112:0/2148120079 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55faa28421d0 con 0x55faa27ef630 2024-09-12T02:47:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.740+0000 7fcdb7400640 1 --2- 172.21.15.112:0/2148120079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55faa27ef630 0x55faa2840e30 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fcda4079740 tx=0x7fcda4048070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1faec31096567811 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.740+0000 7fcda1600640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-12T02:47:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.740+0000 7fcda1600640 1 -- 172.21.15.112:0/2148120079 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda4096060 con 0x55faa27ef630 2024-09-12T02:47:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.740+0000 7fcda1600640 1 -- 172.21.15.112:0/2148120079 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7fcda40800b0 con 0x55faa27ef630 2024-09-12T02:47:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.740+0000 7fcdc1e0f740 1 -- 172.21.15.112:0/2148120079 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcda407dd40 con 0x55faa27ef630 2024-09-12T02:47:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.740+0000 7fcda1600640 1 -- 172.21.15.112:0/2148120079 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fcda40a9070 con 0x55faa27ef630 2024-09-12T02:47:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.740+0000 7fcdc1e0f740 10 client.6630 fetch_fsmap learned FSMap version 62 2024-09-12T02:47:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.740+0000 7fcdc1e0f740 1 -- 172.21.15.112:0/2148120079 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) -- 0x55faa28ac0f0 con 0x55faa27ef630 2024-09-12T02:47:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.741+0000 7fcda1600640 1 -- 172.21.15.112:0/2148120079 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcda407dd40 con 0x55faa27ef630 2024-09-12T02:47:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.741+0000 7fcda1600640 1 -- 172.21.15.112:0/2148120079 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 62) ==== 3502+0+0 (secure 0 0 0) 0x7fcda403a030 con 0x55faa27ef630 2024-09-12T02:47:33.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.741+0000 7fcdc1e0f740 10 client.6630 fetch_fsmap finished waiting for FSMap version 62 2024-09-12T02:47:33.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.741+0000 7fcdc1e0f740 10 client.6630 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T02:47:33.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.741+0000 7fcdc1e0f740 20 client.6630 populate_metadata read hostname 'smithi112' 2024-09-12T02:47:33.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.741+0000 7fcdc1e0f740 1 --2- 172.21.15.112:0/2148120079 >> [v2:172.21.15.112:6834/63450161,v1:172.21.15.112:6836/63450161] conn(0x55faa282f5d0 0x55faa282f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.741+0000 7fcdc1e0f740 4 client.6630 mds_command: new command op to 6504 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:47:33.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.741+0000 7fcdc1e0f740 1 -- 172.21.15.112:0/2148120079 --> [v2:172.21.15.112:6834/63450161,v1:172.21.15.112:6836/63450161] -- command(tid 0: {"prefix": "status"}) -- 0x55faa2758e90 con 0x55faa282f5d0 2024-09-12T02:47:33.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.741+0000 7fcdb7e00640 1 --2- 172.21.15.112:0/2148120079 >> [v2:172.21.15.112:6834/63450161,v1:172.21.15.112:6836/63450161] conn(0x55faa282f5d0 0x55faa282f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.741+0000 7fcda1600640 10 client.6630 ms_handle_connect on v2:172.21.15.112:6834/63450161 2024-09-12T02:47:33.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.741+0000 7fcdb7e00640 1 --2- 172.21.15.112:0/2148120079 >> [v2:172.21.15.112:6834/63450161,v1:172.21.15.112:6836/63450161] conn(0x55faa282f5d0 0x55faa282f9b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acd6118200d9540e server_cookie=e21285f8d3ec9d5c in_seq=0 out_seq=0 2024-09-12T02:47:33.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.742+0000 7fcda1600640 1 -- 172.21.15.112:0/2148120079 <== mds.0 v2:172.21.15.112:6834/63450161 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55faa2758e90 con 0x55faa282f5d0 2024-09-12T02:47:33.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.742+0000 7fcda1600640 10 client.6630 handle_command_reply: tid=0 2024-09-12T02:47:33.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.742+0000 7fcdc1e0f740 1 client.6630 shutdown 2024-09-12T02:47:33.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.742+0000 7fcdc1e0f740 1 -- 172.21.15.112:0/2148120079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55faa27ef630 msgr2=0x55faa2840e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:33.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.742+0000 7fcdc1e0f740 1 --2- 172.21.15.112:0/2148120079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55faa27ef630 0x55faa2840e30 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fcda4079740 tx=0x7fcda4048070 comp rx=0 tx=0).stop 2024-09-12T02:47:33.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.742+0000 7fcdc1e0f740 1 -- 172.21.15.112:0/2148120079 shutdown_connections 2024-09-12T02:47:33.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.742+0000 7fcdc1e0f740 1 --2- 172.21.15.112:0/2148120079 >> [v2:172.21.15.112:6834/63450161,v1:172.21.15.112:6836/63450161] conn(0x55faa282f5d0 0x55faa282f9b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.742+0000 7fcdc1e0f740 1 --2- 172.21.15.112:0/2148120079 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55faa280ec80 0x55faa2841370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.742+0000 7fcdc1e0f740 1 --2- 172.21.15.112:0/2148120079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55faa27ef630 0x55faa2840e30 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.742+0000 7fcda1600640 0 client.6630 ms_handle_reset on v2:172.21.15.112:6834/63450161 2024-09-12T02:47:33.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.742+0000 7fcdc1e0f740 1 --2- 172.21.15.112:0/2148120079 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faa27edea0 0x55faa28abbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.742+0000 7fcdc1e0f740 1 -- 172.21.15.112:0/2148120079 >> 172.21.15.112:0/2148120079 conn(0x55faa27eb660 msgr2=0x55faa2836020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:33.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.742+0000 7fcdc1e0f740 1 -- 172.21.15.112:0/2148120079 shutdown_connections 2024-09-12T02:47:33.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.742+0000 7fcdc1e0f740 1 -- 172.21.15.112:0/2148120079 wait complete. 2024-09-12T02:47:33.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.742+0000 7fcdc1e0f740 20 client.6630 trim_cache size 0 max 16384 2024-09-12T02:47:33.747 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:47:33.748 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:47:33.748 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2024-09-12T02:47:33.748 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 6504, 2024-09-12T02:47:33.748 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2024-09-12T02:47:33.748 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2024-09-12T02:47:33.748 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2024-09-12T02:47:33.748 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 6.0502718240000002, 2024-09-12T02:47:33.748 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 62, 2024-09-12T02:47:33.748 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 120, 2024-09-12T02:47:33.748 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 120, 2024-09-12T02:47:33.749 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 10.773499356 2024-09-12T02:47:33.749 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:47:33.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.743+0000 7fcdbd800640 1 -- 172.21.15.112:0/1963476266 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcd9806be30 msgr2=0x7fcd9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:33.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.743+0000 7fcdbd800640 1 --2- 172.21.15.112:0/1963476266 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcd9806be30 0x7fcd9806e2f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fcdb81f8560 tx=0x7fcda8009040 comp rx=0 tx=0).stop 2024-09-12T02:47:33.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.743+0000 7fcdbd800640 1 -- 172.21.15.112:0/1963476266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdb80b3ee0 msgr2=0x7fcdb8152420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:33.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.743+0000 7fcdbd800640 1 --2- 172.21.15.112:0/1963476266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdb80b3ee0 0x7fcdb8152420 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fcda4009870 tx=0x7fcda40046c0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.743+0000 7fcdbd800640 1 -- 172.21.15.112:0/1963476266 shutdown_connections 2024-09-12T02:47:33.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.743+0000 7fcdbd800640 1 --2- 172.21.15.112:0/1963476266 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcdb815ef10 0x7fcdb80ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.743+0000 7fcdbd800640 1 --2- 172.21.15.112:0/1963476266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdb80b3ee0 0x7fcdb8152420 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.743+0000 7fcdbd800640 1 --2- 172.21.15.112:0/1963476266 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcd9806be30 0x7fcd9806e2f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.743+0000 7fcdbd800640 1 --2- 172.21.15.112:0/1963476266 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdb806de00 0x7fcdb8159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.743+0000 7fcdbd800640 1 -- 172.21.15.112:0/1963476266 >> 172.21.15.112:0/1963476266 conn(0x7fcdb80b7ea0 msgr2=0x7fcdb80b21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:33.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.743+0000 7fcdbd800640 1 -- 172.21.15.112:0/1963476266 shutdown_connections 2024-09-12T02:47:33.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.743+0000 7fcdbd800640 1 -- 172.21.15.112:0/1963476266 wait complete. 2024-09-12T02:47:33.758 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:47:33.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.909+0000 7fe240200640 1 Processor -- start 2024-09-12T02:47:33.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.909+0000 7fe240200640 1 -- start start 2024-09-12T02:47:33.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.910+0000 7fe240200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe23806f600 0x7fe2380b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.910+0000 7fe240200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe2380b45d0 0x7fe2380728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.910+0000 7fe240200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2380b4a20 con 0x7fe23815b9d0 2024-09-12T02:47:33.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.910+0000 7fe240200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe2380b54a0 con 0x7fe23806f600 2024-09-12T02:47:33.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.910+0000 7fe240200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe2380b3af0 con 0x7fe2380b45d0 2024-09-12T02:47:33.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.910+0000 7fe23d800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe23815b9d0 0x7fe23806eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58320/0 (socket says 172.21.15.112:58320) 2024-09-12T02:47:33.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.911+0000 7fe23d800640 1 -- 172.21.15.112:0/111118578 learned_addr learned my addr 172.21.15.112:0/111118578 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:33.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.911+0000 7fe23ce00640 1 --2- 172.21.15.112:0/111118578 >> v2:172.21.15.112:3300/0 conn(0x7fe23806f600 0x7fe2380b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.911+0000 7fe23e200640 1 --2- 172.21.15.112:0/111118578 >> v2:172.21.15.137:3300/0 conn(0x7fe2380b45d0 0x7fe2380728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.911+0000 7fe237e00640 1 -- 172.21.15.112:0/111118578 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 717817213 0 0) 0x7fe2380b4a20 con 0x7fe23815b9d0 2024-09-12T02:47:33.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.911+0000 7fe237e00640 1 -- 172.21.15.112:0/111118578 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe220003520 con 0x7fe23815b9d0 2024-09-12T02:47:33.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.911+0000 7fe23ce00640 1 -- 172.21.15.112:0/111118578 >> v2:172.21.15.137:3300/0 conn(0x7fe2380b45d0 msgr2=0x7fe2380728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:33.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.911+0000 7fe23ce00640 1 --2- 172.21.15.112:0/111118578 >> v2:172.21.15.137:3300/0 conn(0x7fe2380b45d0 0x7fe2380728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.911+0000 7fe23ce00640 1 -- 172.21.15.112:0/111118578 >> v1:172.21.15.112:6789/0 conn(0x7fe23815b9d0 legacy=0x7fe23806eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:33.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.911+0000 7fe23ce00640 1 -- 172.21.15.112:0/111118578 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2380b3dd0 con 0x7fe23806f600 2024-09-12T02:47:33.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.912+0000 7fe23ce00640 1 --2- 172.21.15.112:0/111118578 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe23806f600 0x7fe2380b4ec0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fe238073530 tx=0x7fe22402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b09484f50cc076 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:33.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.912+0000 7fe237e00640 1 -- 172.21.15.112:0/111118578 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe224037070 con 0x7fe23806f600 2024-09-12T02:47:33.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.912+0000 7fe237e00640 1 -- 172.21.15.112:0/111118578 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe224032440 con 0x7fe23806f600 2024-09-12T02:47:33.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.912+0000 7fe237e00640 1 -- 172.21.15.112:0/111118578 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22402ae60 con 0x7fe23806f600 2024-09-12T02:47:33.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.913+0000 7fe240200640 1 -- 172.21.15.112:0/111118578 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe23806f600 msgr2=0x7fe2380b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:33.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.913+0000 7fe240200640 1 --2- 172.21.15.112:0/111118578 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe23806f600 0x7fe2380b4ec0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fe238073530 tx=0x7fe22402a110 comp rx=0 tx=0).stop 2024-09-12T02:47:33.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.913+0000 7fe240200640 1 -- 172.21.15.112:0/111118578 shutdown_connections 2024-09-12T02:47:33.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.913+0000 7fe240200640 1 --2- 172.21.15.112:0/111118578 >> v2:172.21.15.137:3300/0 conn(0x7fe2380b45d0 0x7fe2380728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.913+0000 7fe240200640 1 --2- 172.21.15.112:0/111118578 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe23806f600 0x7fe2380b4ec0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.913+0000 7fe240200640 1 -- 172.21.15.112:0/111118578 >> 172.21.15.112:0/111118578 conn(0x7fe23806bbd0 msgr2=0x7fe23806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:33.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.913+0000 7fe240200640 1 -- 172.21.15.112:0/111118578 shutdown_connections 2024-09-12T02:47:33.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.913+0000 7fe240200640 1 -- 172.21.15.112:0/111118578 wait complete. 2024-09-12T02:47:33.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.915+0000 7fe240200640 1 Processor -- start 2024-09-12T02:47:33.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.915+0000 7fe240200640 1 -- start start 2024-09-12T02:47:33.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.916+0000 7fe240200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe23806f600 0x7fe2381f5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.916+0000 7fe240200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2380b45d0 0x7fe2381571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.916+0000 7fe240200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe23815b9d0 0x7fe238154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.916+0000 7fe240200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe23815bf30 con 0x7fe2380b45d0 2024-09-12T02:47:33.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.916+0000 7fe240200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe23815bdb0 con 0x7fe23806f600 2024-09-12T02:47:33.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.916+0000 7fe240200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe2380cdcd0 con 0x7fe23815b9d0 2024-09-12T02:47:33.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.916+0000 7fe23ce00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2380b45d0 0x7fe2381571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.916+0000 7fe23ce00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2380b45d0 0x7fe2381571a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59298/0 (socket says 172.21.15.112:59298) 2024-09-12T02:47:33.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.916+0000 7fe23ce00640 1 -- 172.21.15.112:0/2496218807 learned_addr learned my addr 172.21.15.112:0/2496218807 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:33.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.916+0000 7fe23d800640 1 --2- 172.21.15.112:0/2496218807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe23806f600 0x7fe2381f5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.916+0000 7fe23e200640 1 --2- 172.21.15.112:0/2496218807 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe23815b9d0 0x7fe238154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.916+0000 7fe23ce00640 1 -- 172.21.15.112:0/2496218807 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe23815b9d0 msgr2=0x7fe238154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:33.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.916+0000 7fe23ce00640 1 --2- 172.21.15.112:0/2496218807 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe23815b9d0 0x7fe238154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.916+0000 7fe23ce00640 1 -- 172.21.15.112:0/2496218807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe23806f600 msgr2=0x7fe2381f5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:33.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.916+0000 7fe23ce00640 1 --2- 172.21.15.112:0/2496218807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe23806f600 0x7fe2381f5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.916+0000 7fe23ce00640 1 -- 172.21.15.112:0/2496218807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe238152ba0 con 0x7fe2380b45d0 2024-09-12T02:47:33.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.917+0000 7fe23ce00640 1 --2- 172.21.15.112:0/2496218807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2380b45d0 0x7fe2381571a0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fe22402a150 tx=0x7fe2240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:33.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.917+0000 7fe235600640 1 -- 172.21.15.112:0/2496218807 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe224037040 con 0x7fe2380b45d0 2024-09-12T02:47:33.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.917+0000 7fe235600640 1 -- 172.21.15.112:0/2496218807 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe224005bb0 con 0x7fe2380b45d0 2024-09-12T02:47:33.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.917+0000 7fe235600640 1 -- 172.21.15.112:0/2496218807 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe224006030 con 0x7fe2380b45d0 2024-09-12T02:47:33.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.917+0000 7fe240200640 1 -- 172.21.15.112:0/2496218807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe238152e80 con 0x7fe2380b45d0 2024-09-12T02:47:33.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.917+0000 7fe240200640 1 -- 172.21.15.112:0/2496218807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe238153440 con 0x7fe2380b45d0 2024-09-12T02:47:33.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.918+0000 7fe240200640 1 -- 172.21.15.112:0/2496218807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe238068a30 con 0x7fe2380b45d0 2024-09-12T02:47:33.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.919+0000 7fe235600640 1 -- 172.21.15.112:0/2496218807 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe2240061d0 con 0x7fe2380b45d0 2024-09-12T02:47:33.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.920+0000 7fe235600640 1 --2- 172.21.15.112:0/2496218807 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe21806be30 0x7fe21806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.921+0000 7fe235600640 1 -- 172.21.15.112:0/2496218807 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7fe2240abaf0 con 0x7fe2380b45d0 2024-09-12T02:47:33.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.921+0000 7fe23d800640 1 --2- 172.21.15.112:0/2496218807 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe21806be30 0x7fe21806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.921+0000 7fe23d800640 1 --2- 172.21.15.112:0/2496218807 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe21806be30 0x7fe21806e2f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe22c005880 tx=0x7fe22c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:33.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:33.925+0000 7fe235600640 1 -- 172.21.15.112:0/2496218807 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe22407a410 con 0x7fe2380b45d0 2024-09-12T02:47:34.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:34.130+0000 7fe240200640 1 -- 172.21.15.112:0/2496218807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe2380b5b60 con 0x7fe2380b45d0 2024-09-12T02:47:34.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:34.130+0000 7fe235600640 1 -- 172.21.15.112:0/2496218807 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v62) ==== 53+0+73 (secure 0 0 0) 0x7fe224079d10 con 0x7fe2380b45d0 2024-09-12T02:47:34.130 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:47:34.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:34.132+0000 7fe240200640 1 -- 172.21.15.112:0/2496218807 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe21806be30 msgr2=0x7fe21806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:34.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:34.132+0000 7fe240200640 1 --2- 172.21.15.112:0/2496218807 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe21806be30 0x7fe21806e2f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe22c005880 tx=0x7fe22c009040 comp rx=0 tx=0).stop 2024-09-12T02:47:34.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:34.132+0000 7fe240200640 1 -- 172.21.15.112:0/2496218807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2380b45d0 msgr2=0x7fe2381571a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:34.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:34.132+0000 7fe240200640 1 --2- 172.21.15.112:0/2496218807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2380b45d0 0x7fe2381571a0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fe22402a150 tx=0x7fe2240046c0 comp rx=0 tx=0).stop 2024-09-12T02:47:34.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:34.133+0000 7fe240200640 1 -- 172.21.15.112:0/2496218807 shutdown_connections 2024-09-12T02:47:34.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:34.133+0000 7fe240200640 1 --2- 172.21.15.112:0/2496218807 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe23815b9d0 0x7fe238154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:34.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:34.133+0000 7fe240200640 1 --2- 172.21.15.112:0/2496218807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2380b45d0 0x7fe2381571a0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:34.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:34.133+0000 7fe240200640 1 --2- 172.21.15.112:0/2496218807 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe21806be30 0x7fe21806e2f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:34.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:34.133+0000 7fe240200640 1 --2- 172.21.15.112:0/2496218807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe23806f600 0x7fe2381f5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:34.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:34.133+0000 7fe240200640 1 -- 172.21.15.112:0/2496218807 >> 172.21.15.112:0/2496218807 conn(0x7fe23806bbd0 msgr2=0x7fe2380b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:34.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:34.133+0000 7fe240200640 1 -- 172.21.15.112:0/2496218807 shutdown_connections 2024-09-12T02:47:34.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:34.133+0000 7fe240200640 1 -- 172.21.15.112:0/2496218807 wait complete. 2024-09-12T02:47:34.148 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:47:34.148 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:47:34.148 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-09-12T02:47:34.148 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:47:34.148 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:47:34.148 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:47:34.148 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:47:34.148 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:47:34.148 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:47:34.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:47:34.149 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-09-12T02:47:34.185 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:47:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:47:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:47:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:47:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-12T02:47:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:47:34.185 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:47:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-09-12T02:47:34.185 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-09-12T02:47:34.185 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:47:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-09-12T02:47:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-09-12T02:47:34.186 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:47:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:47:34.186 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:47:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:47:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:47:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42424sec preferred_lft 42424sec 2024-09-12T02:47:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link noprefixroute 2024-09-12T02:47:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:47:34.186 INFO:teuthology.orchestra.run.smithi112.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:47:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 4e:56:d4:fc:33:ba brd ff:ff:ff:ff:ff:ff 2024-09-12T02:47:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:47:34.186 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:47:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::787f:67ff:fe10:c915/64 scope link 2024-09-12T02:47:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:47:34.187 INFO:teuthology.orchestra.run.smithi112.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:47:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 4e:56:d4:fc:33:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:47:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::4c56:d4ff:fefc:33ba/64 scope link 2024-09-12T02:47:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:47:34.187 INFO:teuthology.orchestra.run.smithi112.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:47:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 86:ed:0e:b6:37:5f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:47:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::84ed:eff:feb6:375f/64 scope link 2024-09-12T02:47:34.187 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:47:34.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:47:34.188 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:47:34.279 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-12T02:47:34.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:47:34.283 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-09-12T02:47:34.319 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-09-12T02:47:34.319 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:47:34.319 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:47:34.319 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:47:34.319 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:47:34.320 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:47:34.320 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-12T02:47:34.320 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:47:34.320 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:47:34.320 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:47:34.320 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-12T02:47:34.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:47:34.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:47:34.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:47:34.515 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-12T02:47:34.550 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:47:34.550 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:47:34.550 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:47:34.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:47:34.551 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2024-09-12T02:47:34.646 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:47:34.647 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:47:34.683 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:47:34.684 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:47:34.684 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:47:34.759 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T02:47:34.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:47:34.759 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:47:34.887 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:47:34.887 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:47:34.914 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:47:34.915 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:47:34.915 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-09-12T02:47:34.915 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 0@7c01f3b3-dec2-4449-a33f-f960d7527ea6.cephfs=/ 2024-09-12T02:47:34.915 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.112:3300/172.21.15.137:3300/172.21.15.137:3301" will pass to kernel 2024-09-12T02:47:34.917 INFO:teuthology.orchestra.run.smithi112.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:47:34.917 INFO:teuthology.orchestra.run.smithi112.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:47:34.917 INFO:teuthology.orchestra.run.smithi112.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:47:34.917 INFO:teuthology.orchestra.run.smithi112.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:47:34.917 INFO:teuthology.orchestra.run.smithi112.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:47:34.920 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:47:34.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:47:34.921 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:47:34.976 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:47:35.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:47:35.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:47:35.073 INFO:teuthology.orchestra.run.smithi112.stdout:client5711 2024-09-12T02:47:35.073 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:47:35.073 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:47:35.109 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:47:35.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.300+0000 7f6bb9c00640 1 Processor -- start 2024-09-12T02:47:35.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.300+0000 7f6bb9c00640 1 -- start start 2024-09-12T02:47:35.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.301+0000 7f6bb9c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bb415b9d0 0x7f6bb40b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:35.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.302+0000 7f6bb9c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6bb40b45d0 0x7f6bb40728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:35.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.302+0000 7f6bb9c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bb40b54a0 con 0x7f6bb406eef0 2024-09-12T02:47:35.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.302+0000 7f6bb9c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f6bb40b4a30 con 0x7f6bb40b45d0 2024-09-12T02:47:35.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.302+0000 7f6bb9c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6bb40b3af0 con 0x7f6bb415b9d0 2024-09-12T02:47:35.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.302+0000 7f6bb2000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6bb40b45d0 0x7f6bb40728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:35.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.302+0000 7f6bb2000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6bb40b45d0 0x7f6bb40728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59300/0 (socket says 172.21.15.112:59300) 2024-09-12T02:47:35.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.302+0000 7f6bb2000640 1 -- 172.21.15.112:0/2493297864 learned_addr learned my addr 172.21.15.112:0/2493297864 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:35.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.302+0000 7f6bb2a00640 1 --2- 172.21.15.112:0/2493297864 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bb415b9d0 0x7f6bb40b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:35.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.302+0000 7f6bb2000640 1 -- 172.21.15.112:0/2493297864 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bb415b9d0 msgr2=0x7f6bb40b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:35.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.302+0000 7f6bb2000640 1 --2- 172.21.15.112:0/2493297864 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bb415b9d0 0x7f6bb40b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.302+0000 7f6bb2000640 1 -- 172.21.15.112:0/2493297864 >> v1:172.21.15.137:6789/0 conn(0x7f6bb406eef0 legacy=0x7f6bb406f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:35.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.302+0000 7f6bb2000640 1 -- 172.21.15.112:0/2493297864 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb40b3dd0 con 0x7f6bb40b45d0 2024-09-12T02:47:35.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.302+0000 7f6bb2a00640 1 --2- 172.21.15.112:0/2493297864 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bb415b9d0 0x7f6bb40b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:35.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.303+0000 7f6bb2000640 1 --2- 172.21.15.112:0/2493297864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb40b45d0 0x7f6bb40728c0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009850 tx=0x7f6ba002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=439438a8e1d7e61f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:35.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.304+0000 7f6bb1600640 1 -- 172.21.15.112:0/2493297864 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0004030 con 0x7f6bb40b45d0 2024-09-12T02:47:35.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.304+0000 7f6bb1600640 1 -- 172.21.15.112:0/2493297864 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ba00041d0 con 0x7f6bb40b45d0 2024-09-12T02:47:35.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.304+0000 7f6bb1600640 1 -- 172.21.15.112:0/2493297864 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0003610 con 0x7f6bb40b45d0 2024-09-12T02:47:35.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.304+0000 7f6bb9c00640 1 -- 172.21.15.112:0/2493297864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb40b45d0 msgr2=0x7f6bb40728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:35.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.304+0000 7f6bb9c00640 1 --2- 172.21.15.112:0/2493297864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb40b45d0 0x7f6bb40728c0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009850 tx=0x7f6ba002a1e0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.304+0000 7f6bb9c00640 1 -- 172.21.15.112:0/2493297864 shutdown_connections 2024-09-12T02:47:35.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.304+0000 7f6bb9c00640 1 --2- 172.21.15.112:0/2493297864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb40b45d0 0x7f6bb40728c0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.304+0000 7f6bb9c00640 1 --2- 172.21.15.112:0/2493297864 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bb415b9d0 0x7f6bb40b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.304+0000 7f6bb9c00640 1 -- 172.21.15.112:0/2493297864 >> 172.21.15.112:0/2493297864 conn(0x7f6bb406bbd0 msgr2=0x7f6bb406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:35.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.304+0000 7f6bb9c00640 1 -- 172.21.15.112:0/2493297864 shutdown_connections 2024-09-12T02:47:35.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.304+0000 7f6bb9c00640 1 -- 172.21.15.112:0/2493297864 wait complete. 2024-09-12T02:47:35.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.306+0000 7f6bb9c00640 1 Processor -- start 2024-09-12T02:47:35.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.306+0000 7f6bb9c00640 1 -- start start 2024-09-12T02:47:35.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.307+0000 7f6bb9c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bb406eef0 0x7f6bb4144fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:35.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.307+0000 7f6bb9c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6bb40b45d0 0x7f6bb415df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:35.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.307+0000 7f6bb9c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb415b9d0 0x7f6bb4151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:35.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.307+0000 7f6bb9c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb415bf30 con 0x7f6bb415b9d0 2024-09-12T02:47:35.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.307+0000 7f6bb9c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb415bdb0 con 0x7f6bb40b45d0 2024-09-12T02:47:35.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.307+0000 7f6bb9c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6bb40cdcd0 con 0x7f6bb406eef0 2024-09-12T02:47:35.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.307+0000 7f6bb3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb415b9d0 0x7f6bb4151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:35.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.307+0000 7f6bb3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb415b9d0 0x7f6bb4151ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59306/0 (socket says 172.21.15.112:59306) 2024-09-12T02:47:35.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.307+0000 7f6bb3400640 1 -- 172.21.15.112:0/3268101399 learned_addr learned my addr 172.21.15.112:0/3268101399 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:35.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.307+0000 7f6bb2000640 1 --2- 172.21.15.112:0/3268101399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6bb40b45d0 0x7f6bb415df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:35.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.307+0000 7f6bb2a00640 1 --2- 172.21.15.112:0/3268101399 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bb406eef0 0x7f6bb4144fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:35.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.308+0000 7f6bb3400640 1 -- 172.21.15.112:0/3268101399 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bb406eef0 msgr2=0x7f6bb4144fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:35.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.308+0000 7f6bb3400640 1 --2- 172.21.15.112:0/3268101399 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bb406eef0 0x7f6bb4144fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.308+0000 7f6bb3400640 1 -- 172.21.15.112:0/3268101399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6bb40b45d0 msgr2=0x7f6bb415df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:35.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.308+0000 7f6bb3400640 1 --2- 172.21.15.112:0/3268101399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6bb40b45d0 0x7f6bb415df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.308+0000 7f6bb3400640 1 -- 172.21.15.112:0/3268101399 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb415e950 con 0x7f6bb415b9d0 2024-09-12T02:47:35.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.308+0000 7f6bb3400640 1 --2- 172.21.15.112:0/3268101399 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb415b9d0 0x7f6bb4151ca0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00c780 tx=0x7f6bac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:35.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.308+0000 7f6baaa00640 1 -- 172.21.15.112:0/3268101399 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac004b60 con 0x7f6bb415b9d0 2024-09-12T02:47:35.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.308+0000 7f6baaa00640 1 -- 172.21.15.112:0/3268101399 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bac004d00 con 0x7f6bb415b9d0 2024-09-12T02:47:35.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.308+0000 7f6bb9c00640 1 -- 172.21.15.112:0/3268101399 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bb415c100 con 0x7f6bb415b9d0 2024-09-12T02:47:35.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.308+0000 7f6baaa00640 1 -- 172.21.15.112:0/3268101399 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac00aa90 con 0x7f6bb415b9d0 2024-09-12T02:47:35.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.308+0000 7f6bb9c00640 1 -- 172.21.15.112:0/3268101399 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bb415c6c0 con 0x7f6bb415b9d0 2024-09-12T02:47:35.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.309+0000 7f6bb9c00640 1 -- 172.21.15.112:0/3268101399 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bb4068a30 con 0x7f6bb415b9d0 2024-09-12T02:47:35.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.310+0000 7f6baaa00640 1 -- 172.21.15.112:0/3268101399 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6bac00ac30 con 0x7f6bb415b9d0 2024-09-12T02:47:35.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.311+0000 7f6baaa00640 1 --2- 172.21.15.112:0/3268101399 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6b9406be30 0x7f6b9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:35.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.311+0000 7f6baaa00640 1 -- 172.21.15.112:0/3268101399 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7f6bac08b0a0 con 0x7f6bb415b9d0 2024-09-12T02:47:35.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.311+0000 7f6bb2a00640 1 --2- 172.21.15.112:0/3268101399 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6b9406be30 0x7f6b9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:35.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.312+0000 7f6bb2a00640 1 --2- 172.21.15.112:0/3268101399 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6b9406be30 0x7f6b9406e2f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6ba400aac0 tx=0x7f6ba4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:35.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.316+0000 7f6baaa00640 1 -- 172.21.15.112:0/3268101399 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6bac020070 con 0x7f6bb415b9d0 2024-09-12T02:47:35.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.522+0000 7f6bb9c00640 1 -- 172.21.15.112:0/3268101399 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6bb40ce590 con 0x7f6bb415b9d0 2024-09-12T02:47:35.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.523+0000 7f6baaa00640 1 -- 172.21.15.112:0/3268101399 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v62) ==== 53+0+73 (secure 0 0 0) 0x7f6bac059360 con 0x7f6bb415b9d0 2024-09-12T02:47:35.524 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:47:35.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.525+0000 7f6bb9c00640 1 -- 172.21.15.112:0/3268101399 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6b9406be30 msgr2=0x7f6b9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:35.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.525+0000 7f6bb9c00640 1 --2- 172.21.15.112:0/3268101399 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6b9406be30 0x7f6b9406e2f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6ba400aac0 tx=0x7f6ba4008040 comp rx=0 tx=0).stop 2024-09-12T02:47:35.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.525+0000 7f6bb9c00640 1 -- 172.21.15.112:0/3268101399 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb415b9d0 msgr2=0x7f6bb4151ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:35.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.525+0000 7f6bb9c00640 1 --2- 172.21.15.112:0/3268101399 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb415b9d0 0x7f6bb4151ca0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00c780 tx=0x7f6bac00cc40 comp rx=0 tx=0).stop 2024-09-12T02:47:35.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.525+0000 7f6bb9c00640 1 -- 172.21.15.112:0/3268101399 shutdown_connections 2024-09-12T02:47:35.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.525+0000 7f6bb9c00640 1 --2- 172.21.15.112:0/3268101399 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb415b9d0 0x7f6bb4151ca0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.525+0000 7f6bb9c00640 1 --2- 172.21.15.112:0/3268101399 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6b9406be30 0x7f6b9406e2f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.525+0000 7f6bb9c00640 1 --2- 172.21.15.112:0/3268101399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6bb40b45d0 0x7f6bb415df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.525+0000 7f6bb9c00640 1 --2- 172.21.15.112:0/3268101399 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bb406eef0 0x7f6bb4144fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.525+0000 7f6bb9c00640 1 -- 172.21.15.112:0/3268101399 >> 172.21.15.112:0/3268101399 conn(0x7f6bb406bbd0 msgr2=0x7f6bb40b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:35.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.525+0000 7f6bb9c00640 1 -- 172.21.15.112:0/3268101399 shutdown_connections 2024-09-12T02:47:35.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:35.525+0000 7f6bb9c00640 1 -- 172.21.15.112:0/3268101399 wait complete. 2024-09-12T02:47:35.542 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:47:35.542 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:47:35.542 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-09-12T02:47:35.543 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T02:47:35.543 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T02:47:35.543 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:47:35.543 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:47:35.543 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:47:35.543 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:47:35.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:47:35.544 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-09-12T02:47:35.585 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:47:35.585 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:47:35.585 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:47:35.585 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:47:35.585 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-09-12T02:47:35.585 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:47:35.585 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:47:35.585 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-09-12T02:47:35.585 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-09-12T02:47:35.586 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:47:35.586 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-09-12T02:47:35.586 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-09-12T02:47:35.586 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:47:35.586 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:47:35.586 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:47:35.586 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:47:35.586 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:47:35.586 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42423sec preferred_lft 42423sec 2024-09-12T02:47:35.586 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::ec4:7aff:fe88:8137/64 scope link noprefixroute 2024-09-12T02:47:35.586 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:47:35.586 INFO:teuthology.orchestra.run.smithi137.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:47:35.586 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 62:9a:8e:f1:56:55 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:47:35.586 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:47:35.587 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:47:35.587 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::30c8:13ff:fe15:f79d/64 scope link 2024-09-12T02:47:35.587 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:47:35.587 INFO:teuthology.orchestra.run.smithi137.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:47:35.587 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 62:9a:8e:f1:56:55 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:47:35.587 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::609a:8eff:fef1:5655/64 scope link 2024-09-12T02:47:35.587 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:47:35.587 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:47:35.587 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 96:f4:ca:17:88:2a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T02:47:35.587 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::94f4:caff:fe17:882a/64 scope link 2024-09-12T02:47:35.587 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:47:35.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:47:35.588 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:47:35.682 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-09-12T02:47:35.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:47:35.686 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-09-12T02:47:35.725 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-09-12T02:47:35.725 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:47:35.725 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:47:35.725 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:47:35.725 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:47:35.725 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:47:35.725 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-09-12T02:47:35.725 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:47:35.726 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:47:35.726 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:47:35.726 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-09-12T02:47:35.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:47:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:47:35.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:47:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:47:35.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:47:35.924 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-09-12T02:47:35.960 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T02:47:35.960 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T02:47:35.960 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:47:35.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:47:35.961 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-09-12T02:47:36.057 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:47:36.057 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T02:47:36.092 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:47:36.092 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:47:36.093 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T02:47:36.167 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-12T02:47:36.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:47:36.167 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:47:36.296 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:47:36.296 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:47:36.323 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:47:36.323 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:47:36.323 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-09-12T02:47:36.323 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with new device syntax: 1@7c01f3b3-dec2-4449-a33f-f960d7527ea6.cephfs=/ 2024-09-12T02:47:36.323 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.112:3300/172.21.15.137:3300/172.21.15.137:3301" will pass to kernel 2024-09-12T02:47:36.324 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-12T02:47:36.324 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:47:36.324 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:47:36.324 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:47:36.324 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:47:36.327 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:47:36.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:47:36.328 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T02:47:36.383 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:47:36.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:47:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:47:36.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:47:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:47:36.472 INFO:teuthology.orchestra.run.smithi137.stdout:client6648 2024-09-12T02:47:36.472 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:47:36.472 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:47:36.508 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:47:36.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.667+0000 7f83e1200640 1 Processor -- start 2024-09-12T02:47:36.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.668+0000 7f83e1200640 1 -- start start 2024-09-12T02:47:36.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.669+0000 7f83e1200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83dc15cc50 0x7f83dc0732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:36.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.669+0000 7f83e1200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f83dc0afe30 0x7f83dc0cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:36.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.669+0000 7f83e1200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83dc073830 con 0x7f83dc071530 2024-09-12T02:47:36.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.669+0000 7f83e1200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f83dc15d030 con 0x7f83dc0afe30 2024-09-12T02:47:36.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.669+0000 7f83e1200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f83dc0cf4c0 con 0x7f83dc15cc50 2024-09-12T02:47:36.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.669+0000 7f83da800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f83dc0afe30 0x7f83dc0cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:36.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.669+0000 7f83da800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f83dc0afe30 0x7f83dc0cf950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59318/0 (socket says 172.21.15.112:59318) 2024-09-12T02:47:36.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.669+0000 7f83da800640 1 -- 172.21.15.112:0/1554134197 learned_addr learned my addr 172.21.15.112:0/1554134197 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:36.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.669+0000 7f83d9e00640 1 --2- 172.21.15.112:0/1554134197 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83dc15cc50 0x7f83dc0732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:36.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.670+0000 7f83da800640 1 -- 172.21.15.112:0/1554134197 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83dc15cc50 msgr2=0x7f83dc0732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:36.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.670+0000 7f83da800640 1 --2- 172.21.15.112:0/1554134197 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83dc15cc50 0x7f83dc0732f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.670+0000 7f83da800640 1 -- 172.21.15.112:0/1554134197 >> v1:172.21.15.137:6789/0 conn(0x7f83dc071530 legacy=0x7f83dc0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:36.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.670+0000 7f83da800640 1 -- 172.21.15.112:0/1554134197 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83dc0ceeb0 con 0x7f83dc0afe30 2024-09-12T02:47:36.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.671+0000 7f83da800640 1 --2- 172.21.15.112:0/1554134197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83dc0afe30 0x7f83dc0cf950 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f83d4009e80 tx=0x7f83d402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74574652ca388c93 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:36.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.671+0000 7f83d8a00640 1 -- 172.21.15.112:0/1554134197 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d4036070 con 0x7f83dc0afe30 2024-09-12T02:47:36.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.671+0000 7f83d8a00640 1 -- 172.21.15.112:0/1554134197 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83d4031600 con 0x7f83dc0afe30 2024-09-12T02:47:36.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.671+0000 7f83d8a00640 1 -- 172.21.15.112:0/1554134197 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d40319d0 con 0x7f83dc0afe30 2024-09-12T02:47:36.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.671+0000 7f83e1200640 1 -- 172.21.15.112:0/1554134197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83dc0afe30 msgr2=0x7f83dc0cf950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:36.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.671+0000 7f83e1200640 1 --2- 172.21.15.112:0/1554134197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83dc0afe30 0x7f83dc0cf950 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f83d4009e80 tx=0x7f83d402a6c0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.671+0000 7f83e1200640 1 -- 172.21.15.112:0/1554134197 shutdown_connections 2024-09-12T02:47:36.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.671+0000 7f83e1200640 1 --2- 172.21.15.112:0/1554134197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83dc0afe30 0x7f83dc0cf950 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.671+0000 7f83e1200640 1 --2- 172.21.15.112:0/1554134197 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83dc15cc50 0x7f83dc0732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.671+0000 7f83e1200640 1 -- 172.21.15.112:0/1554134197 >> 172.21.15.112:0/1554134197 conn(0x7f83dc06bbd0 msgr2=0x7f83dc06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:36.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.672+0000 7f83e1200640 1 -- 172.21.15.112:0/1554134197 shutdown_connections 2024-09-12T02:47:36.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.672+0000 7f83e1200640 1 -- 172.21.15.112:0/1554134197 wait complete. 2024-09-12T02:47:36.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.673+0000 7f83e1200640 1 Processor -- start 2024-09-12T02:47:36.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.673+0000 7f83e1200640 1 -- start start 2024-09-12T02:47:36.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.674+0000 7f83e1200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83dc071530 0x7f83dc1f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:36.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.674+0000 7f83e1200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83dc0afe30 0x7f83dc152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:36.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.674+0000 7f83e1200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83dc15cc50 0x7f83dc151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:36.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.674+0000 7f83e1200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f83dc0cf150 con 0x7f83dc071530 2024-09-12T02:47:36.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.674+0000 7f83e1200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f83dc06e5e0 con 0x7f83dc0afe30 2024-09-12T02:47:36.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.674+0000 7f83e1200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f83dc06f510 con 0x7f83dc15cc50 2024-09-12T02:47:36.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.674+0000 7f83d9e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83dc071530 0x7f83dc1f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:36.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.674+0000 7f83d9e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83dc071530 0x7f83dc1f5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59326/0 (socket says 172.21.15.112:59326) 2024-09-12T02:47:36.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.674+0000 7f83d9e00640 1 -- 172.21.15.112:0/85112906 learned_addr learned my addr 172.21.15.112:0/85112906 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:36.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.675+0000 7f83da800640 1 --2- 172.21.15.112:0/85112906 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83dc15cc50 0x7f83dc151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:36.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.675+0000 7f83d9400640 1 --2- 172.21.15.112:0/85112906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83dc0afe30 0x7f83dc152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:36.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.675+0000 7f83d9e00640 1 -- 172.21.15.112:0/85112906 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83dc15cc50 msgr2=0x7f83dc151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:36.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.675+0000 7f83d9e00640 1 --2- 172.21.15.112:0/85112906 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83dc15cc50 0x7f83dc151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.675+0000 7f83d9e00640 1 -- 172.21.15.112:0/85112906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83dc0afe30 msgr2=0x7f83dc152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:36.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.675+0000 7f83d9e00640 1 --2- 172.21.15.112:0/85112906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83dc0afe30 0x7f83dc152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.675+0000 7f83d9e00640 1 -- 172.21.15.112:0/85112906 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83dc1f64a0 con 0x7f83dc071530 2024-09-12T02:47:36.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.675+0000 7f83d9e00640 1 --2- 172.21.15.112:0/85112906 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83dc071530 0x7f83dc1f5f60 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f83cc00e8a0 tx=0x7f83cc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:36.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.675+0000 7f83d2000640 1 -- 172.21.15.112:0/85112906 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83cc017070 con 0x7f83dc071530 2024-09-12T02:47:36.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.675+0000 7f83d2000640 1 -- 172.21.15.112:0/85112906 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83cc00c940 con 0x7f83dc071530 2024-09-12T02:47:36.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.675+0000 7f83d2000640 1 -- 172.21.15.112:0/85112906 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83cc00cd30 con 0x7f83dc071530 2024-09-12T02:47:36.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.675+0000 7f83e1200640 1 -- 172.21.15.112:0/85112906 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83dc154680 con 0x7f83dc071530 2024-09-12T02:47:36.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.676+0000 7f83e1200640 1 -- 172.21.15.112:0/85112906 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83dc154c40 con 0x7f83dc071530 2024-09-12T02:47:36.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.677+0000 7f83e1200640 1 -- 172.21.15.112:0/85112906 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83dc068a30 con 0x7f83dc071530 2024-09-12T02:47:36.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.678+0000 7f83d2000640 1 -- 172.21.15.112:0/85112906 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f83cc01a070 con 0x7f83dc071530 2024-09-12T02:47:36.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.678+0000 7f83d2000640 1 --2- 172.21.15.112:0/85112906 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f83bc06be30 0x7f83bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:36.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.679+0000 7f83d2000640 1 -- 172.21.15.112:0/85112906 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7f83cc08b0a0 con 0x7f83dc071530 2024-09-12T02:47:36.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.679+0000 7f83d9400640 1 --2- 172.21.15.112:0/85112906 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f83bc06be30 0x7f83bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:36.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.679+0000 7f83d9400640 1 --2- 172.21.15.112:0/85112906 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f83bc06be30 0x7f83bc06e2f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f83dc0b5720 tx=0x7f83c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:36.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.683+0000 7f83d2000640 1 -- 172.21.15.112:0/85112906 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f83dc1f64a0 con 0x7f83dc071530 2024-09-12T02:47:36.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.889+0000 7f83e1200640 1 -- 172.21.15.112:0/85112906 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83dc06df60 con 0x7f83dc071530 2024-09-12T02:47:36.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.889+0000 7f83d2000640 1 -- 172.21.15.112:0/85112906 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5231 (secure 0 0 0) 0x7f83cc059360 con 0x7f83dc071530 2024-09-12T02:47:36.890 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:36.891 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":62,"btime":"2024-09-12T02:47:30:715299+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5612,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/3181313801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3181313801},{"type":"v1","addr":"172.21.15.137:6834","nonce":3181313801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":5615,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2025494075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2025494075},{"type":"v1","addr":"172.21.15.137:6835","nonce":2025494075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6501,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3739674039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3739674039},{"type":"v1","addr":"172.21.15.112:6837","nonce":3739674039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:47:27.076883+0000","modified":"2024-09-12T02:47:30.117205+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6504},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6504":{"gid":6504,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/63450161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":63450161},{"type":"v1","addr":"172.21.15.112:6836","nonce":63450161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6504,"qdb_cluster":[6504]},"id":7}]} 2024-09-12T02:47:36.891 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 62 2024-09-12T02:47:36.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.891+0000 7f83e1200640 1 -- 172.21.15.112:0/85112906 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f83bc06be30 msgr2=0x7f83bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:36.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.891+0000 7f83e1200640 1 --2- 172.21.15.112:0/85112906 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f83bc06be30 0x7f83bc06e2f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f83dc0b5720 tx=0x7f83c8009040 comp rx=0 tx=0).stop 2024-09-12T02:47:36.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.891+0000 7f83e1200640 1 -- 172.21.15.112:0/85112906 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83dc071530 msgr2=0x7f83dc1f5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:36.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.891+0000 7f83e1200640 1 --2- 172.21.15.112:0/85112906 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83dc071530 0x7f83dc1f5f60 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f83cc00e8a0 tx=0x7f83cc00ed60 comp rx=0 tx=0).stop 2024-09-12T02:47:36.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.892+0000 7f83e1200640 1 -- 172.21.15.112:0/85112906 shutdown_connections 2024-09-12T02:47:36.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.892+0000 7f83e1200640 1 --2- 172.21.15.112:0/85112906 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83dc15cc50 0x7f83dc151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.892+0000 7f83e1200640 1 --2- 172.21.15.112:0/85112906 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f83bc06be30 0x7f83bc06e2f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.892+0000 7f83e1200640 1 --2- 172.21.15.112:0/85112906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83dc0afe30 0x7f83dc152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.892+0000 7f83e1200640 1 --2- 172.21.15.112:0/85112906 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83dc071530 0x7f83dc1f5f60 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:36.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.892+0000 7f83e1200640 1 -- 172.21.15.112:0/85112906 >> 172.21.15.112:0/85112906 conn(0x7f83dc06bbd0 msgr2=0x7f83dc0cf950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:36.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.892+0000 7f83e1200640 1 -- 172.21.15.112:0/85112906 shutdown_connections 2024-09-12T02:47:36.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:36.892+0000 7f83e1200640 1 -- 172.21.15.112:0/85112906 wait complete. 2024-09-12T02:47:36.909 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-12T02:47:37.081 INFO:teuthology.orchestra.run.smithi112.stdout:{"cluster_fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","whoami":0,"id":6504,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.3775084100000008,"mdsmap_epoch":62,"osdmap_epoch":120,"osdmap_epoch_barrier":120,"uptime":14.100733919} 2024-09-12T02:47:37.082 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", "fs_name": "cephfs", "id": 6504, "mdsmap_epoch": 62, "osdmap_epoch": 120, "osdmap_epoch_barrier": 120, "rank_uptime": 9.37750841, "state": "up:active", "uptime": 14.100733919, "want_state": "up:active", "whoami": 0 } 2024-09-12T02:47:37.082 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2024-09-12T02:47:37.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.236+0000 7f8c78000640 1 Processor -- start 2024-09-12T02:47:37.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.237+0000 7f8c78000640 1 -- start start 2024-09-12T02:47:37.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.238+0000 7f8c78000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8c700b4140 0x7f8c700b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:37.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.238+0000 7f8c78000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8c701602f0 0x7f8c700ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:37.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.238+0000 7f8c78000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c7006eed0 con 0x7f8c70144890 2024-09-12T02:47:37.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.238+0000 7f8c78000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8c7006f170 con 0x7f8c700b4140 2024-09-12T02:47:37.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.238+0000 7f8c78000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8c7015f810 con 0x7f8c701602f0 2024-09-12T02:47:37.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.238+0000 7f8c75600640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8c70144890 0x7f8c700b3a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58336/0 (socket says 172.21.15.112:58336) 2024-09-12T02:47:37.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.238+0000 7f8c75600640 1 -- 172.21.15.112:0/524045937 learned_addr learned my addr 172.21.15.112:0/524045937 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:37.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.238+0000 7f8c74c00640 1 --2- 172.21.15.112:0/524045937 >> v2:172.21.15.112:3300/0 conn(0x7f8c700b4140 0x7f8c700b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:37.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.239+0000 7f8c6fe00640 1 -- 172.21.15.112:0/524045937 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2542248769 0 0) 0x7f8c7006eed0 con 0x7f8c70144890 2024-09-12T02:47:37.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.239+0000 7f8c76000640 1 --2- 172.21.15.112:0/524045937 >> v2:172.21.15.137:3300/0 conn(0x7f8c701602f0 0x7f8c700ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:37.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.239+0000 7f8c6fe00640 1 -- 172.21.15.112:0/524045937 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c58003520 con 0x7f8c70144890 2024-09-12T02:47:37.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.239+0000 7f8c74c00640 1 -- 172.21.15.112:0/524045937 >> v2:172.21.15.137:3300/0 conn(0x7f8c701602f0 msgr2=0x7f8c700ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:37.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.239+0000 7f8c74c00640 1 --2- 172.21.15.112:0/524045937 >> v2:172.21.15.137:3300/0 conn(0x7f8c701602f0 0x7f8c700ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:37.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.239+0000 7f8c74c00640 1 -- 172.21.15.112:0/524045937 >> v1:172.21.15.112:6789/0 conn(0x7f8c70144890 legacy=0x7f8c700b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:37.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.239+0000 7f8c74c00640 1 -- 172.21.15.112:0/524045937 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c7015faf0 con 0x7f8c700b4140 2024-09-12T02:47:37.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.240+0000 7f8c74c00640 1 --2- 172.21.15.112:0/524045937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c700b4140 0x7f8c700b58c0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f8c700b56b0 tx=0x7f8c5c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca752fc27d53b5e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:37.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.240+0000 7f8c6fe00640 1 -- 172.21.15.112:0/524045937 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c037070 con 0x7f8c700b4140 2024-09-12T02:47:37.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.240+0000 7f8c6fe00640 1 -- 172.21.15.112:0/524045937 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c5c032440 con 0x7f8c700b4140 2024-09-12T02:47:37.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.240+0000 7f8c6fe00640 1 -- 172.21.15.112:0/524045937 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c032810 con 0x7f8c700b4140 2024-09-12T02:47:37.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.240+0000 7f8c78000640 1 -- 172.21.15.112:0/524045937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c700b4140 msgr2=0x7f8c700b58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:37.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.240+0000 7f8c78000640 1 --2- 172.21.15.112:0/524045937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c700b4140 0x7f8c700b58c0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f8c700b56b0 tx=0x7f8c5c02a1a0 comp rx=0 tx=0).stop 2024-09-12T02:47:37.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.241+0000 7f8c78000640 1 -- 172.21.15.112:0/524045937 shutdown_connections 2024-09-12T02:47:37.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.241+0000 7f8c78000640 1 --2- 172.21.15.112:0/524045937 >> v2:172.21.15.137:3300/0 conn(0x7f8c701602f0 0x7f8c700ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:37.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.241+0000 7f8c78000640 1 --2- 172.21.15.112:0/524045937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c700b4140 0x7f8c700b58c0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:37.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.241+0000 7f8c78000640 1 -- 172.21.15.112:0/524045937 >> 172.21.15.112:0/524045937 conn(0x7f8c700b2730 msgr2=0x7f8c700b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:37.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.241+0000 7f8c78000640 1 -- 172.21.15.112:0/524045937 shutdown_connections 2024-09-12T02:47:37.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.241+0000 7f8c78000640 1 -- 172.21.15.112:0/524045937 wait complete. 2024-09-12T02:47:37.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.242+0000 7f8c78000640 1 Processor -- start 2024-09-12T02:47:37.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.242+0000 7f8c78000640 1 -- start start 2024-09-12T02:47:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.243+0000 7f8c78000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c700b4140 0x7f8c7015c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.243+0000 7f8c78000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c70144890 0x7f8c70156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.243+0000 7f8c78000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8c701602f0 0x7f8c701433e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.243+0000 7f8c78000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8c70144df0 con 0x7f8c700b4140 2024-09-12T02:47:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.243+0000 7f8c78000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8c70144c70 con 0x7f8c70144890 2024-09-12T02:47:37.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.243+0000 7f8c78000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8c700b3290 con 0x7f8c701602f0 2024-09-12T02:47:37.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.243+0000 7f8c75600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c700b4140 0x7f8c7015c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:37.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.243+0000 7f8c75600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c700b4140 0x7f8c7015c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59340/0 (socket says 172.21.15.112:59340) 2024-09-12T02:47:37.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.243+0000 7f8c75600640 1 -- 172.21.15.112:0/3731904080 learned_addr learned my addr 172.21.15.112:0/3731904080 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:37.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.244+0000 7f8c76000640 1 --2- 172.21.15.112:0/3731904080 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8c701602f0 0x7f8c701433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:37.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.244+0000 7f8c74c00640 1 --2- 172.21.15.112:0/3731904080 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c70144890 0x7f8c70156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:37.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.244+0000 7f8c75600640 1 -- 172.21.15.112:0/3731904080 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8c701602f0 msgr2=0x7f8c701433e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:37.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.244+0000 7f8c75600640 1 --2- 172.21.15.112:0/3731904080 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8c701602f0 0x7f8c701433e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:37.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.244+0000 7f8c75600640 1 -- 172.21.15.112:0/3731904080 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c70144890 msgr2=0x7f8c70156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:37.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.244+0000 7f8c75600640 1 --2- 172.21.15.112:0/3731904080 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c70144890 0x7f8c70156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:37.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.244+0000 7f8c75600640 1 -- 172.21.15.112:0/3731904080 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c70142340 con 0x7f8c700b4140 2024-09-12T02:47:37.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.244+0000 7f8c76000640 1 --2- 172.21.15.112:0/3731904080 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8c701602f0 0x7f8c701433e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.244+0000 7f8c75600640 1 --2- 172.21.15.112:0/3731904080 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c700b4140 0x7f8c7015c600 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f8c64001460 tx=0x7f8c6400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.244+0000 7f8c6d600640 1 -- 172.21.15.112:0/3731904080 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c64017070 con 0x7f8c700b4140 2024-09-12T02:47:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.244+0000 7f8c6d600640 1 -- 172.21.15.112:0/3731904080 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c6400ad00 con 0x7f8c700b4140 2024-09-12T02:47:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.244+0000 7f8c6d600640 1 -- 172.21.15.112:0/3731904080 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c64012640 con 0x7f8c700b4140 2024-09-12T02:47:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.244+0000 7f8c78000640 1 -- 172.21.15.112:0/3731904080 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c70142620 con 0x7f8c700b4140 2024-09-12T02:47:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.245+0000 7f8c78000640 1 -- 172.21.15.112:0/3731904080 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c70142be0 con 0x7f8c700b4140 2024-09-12T02:47:37.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.246+0000 7f8c78000640 1 -- 172.21.15.112:0/3731904080 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c700b58c0 con 0x7f8c700b4140 2024-09-12T02:47:37.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.247+0000 7f8c6d600640 1 -- 172.21.15.112:0/3731904080 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8c6401a070 con 0x7f8c700b4140 2024-09-12T02:47:37.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.247+0000 7f8c6d600640 1 --2- 172.21.15.112:0/3731904080 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8c5006be30 0x7f8c5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:37.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.247+0000 7f8c6d600640 1 -- 172.21.15.112:0/3731904080 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7f8c6408abf0 con 0x7f8c700b4140 2024-09-12T02:47:37.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.248+0000 7f8c74c00640 1 --2- 172.21.15.112:0/3731904080 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8c5006be30 0x7f8c5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:37.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.248+0000 7f8c74c00640 1 --2- 172.21.15.112:0/3731904080 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8c5006be30 0x7f8c5006e2f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c034000 tx=0x7f8c5c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:37.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.252+0000 7f8c6d600640 1 -- 172.21.15.112:0/3731904080 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8c64058f40 con 0x7f8c700b4140 2024-09-12T02:47:37.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.427+0000 7f8c78000640 1 -- 172.21.15.112:0/3731904080 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) -- 0x7f8c7015bee0 con 0x7f8c700b4140 2024-09-12T02:47:37.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.948+0000 7f8c6d600640 1 -- 172.21.15.112:0/3731904080 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v121) ==== 181+0+0 (secure 0 0 0) 0x7f8c6405d240 con 0x7f8c700b4140 2024-09-12T02:47:37.949 INFO:teuthology.orchestra.run.smithi112.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2024-09-12T02:47:37.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.951+0000 7f8c78000640 1 -- 172.21.15.112:0/3731904080 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8c5006be30 msgr2=0x7f8c5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:37.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.951+0000 7f8c78000640 1 --2- 172.21.15.112:0/3731904080 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8c5006be30 0x7f8c5006e2f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c034000 tx=0x7f8c5c02e000 comp rx=0 tx=0).stop 2024-09-12T02:47:37.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.951+0000 7f8c78000640 1 -- 172.21.15.112:0/3731904080 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c700b4140 msgr2=0x7f8c7015c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:37.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.951+0000 7f8c78000640 1 --2- 172.21.15.112:0/3731904080 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c700b4140 0x7f8c7015c600 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f8c64001460 tx=0x7f8c6400a430 comp rx=0 tx=0).stop 2024-09-12T02:47:37.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.951+0000 7f8c78000640 1 -- 172.21.15.112:0/3731904080 shutdown_connections 2024-09-12T02:47:37.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.951+0000 7f8c78000640 1 --2- 172.21.15.112:0/3731904080 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8c701602f0 0x7f8c701433e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:37.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.951+0000 7f8c78000640 1 --2- 172.21.15.112:0/3731904080 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8c5006be30 0x7f8c5006e2f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:37.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.951+0000 7f8c78000640 1 --2- 172.21.15.112:0/3731904080 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c70144890 0x7f8c70156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:37.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.951+0000 7f8c78000640 1 --2- 172.21.15.112:0/3731904080 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c700b4140 0x7f8c7015c600 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:37.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.951+0000 7f8c78000640 1 -- 172.21.15.112:0/3731904080 >> 172.21.15.112:0/3731904080 conn(0x7f8c700b2730 msgr2=0x7f8c700afa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:37.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.952+0000 7f8c78000640 1 -- 172.21.15.112:0/3731904080 shutdown_connections 2024-09-12T02:47:37.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:37.952+0000 7f8c78000640 1 -- 172.21.15.112:0/3731904080 wait complete. 2024-09-12T02:47:37.970 DEBUG:teuthology.orchestra.run.smithi112:> stdin-killer -- python3 -c ' 2024-09-12T02:47:37.971 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-12T02:47:37.971 DEBUG:teuthology.orchestra.run.smithi112:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-12T02:47:37.971 DEBUG:teuthology.orchestra.run.smithi112:> os.fchmod(fd, 0O666) 2024-09-12T02:47:37.971 DEBUG:teuthology.orchestra.run.smithi112:> os.fsync(fd) 2024-09-12T02:47:37.971 DEBUG:teuthology.orchestra.run.smithi112:> os.close(fd) 2024-09-12T02:47:37.971 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-12T02:47:38.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:47:38.092 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:47:38.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:47:38.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:47:38.219 INFO:teuthology.orchestra.run.smithi112.stdout:client5711 2024-09-12T02:47:38.220 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/7c01f3b3-dec2-4449-a33f-f960d7527ea6.client5711/osdmap') 2024-09-12T02:47:38.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:47:38.317 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 120 barrier 120 flags 0x588000 2024-09-12T02:47:38.318 INFO:teuthology.orchestra.run.smithi112.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-12T02:47:38.318 INFO:teuthology.orchestra.run.smithi112.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-12T02:47:38.318 INFO:teuthology.orchestra.run.smithi112.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-12T02:47:38.318 INFO:teuthology.orchestra.run.smithi112.stdout:osd0 (2)172.21.15.112:6800 100% (exists, up) 100% -1 2024-09-12T02:47:38.318 INFO:teuthology.orchestra.run.smithi112.stdout:osd1 (2)172.21.15.112:6808 100% (exists, up) 100% -1 2024-09-12T02:47:38.318 INFO:teuthology.orchestra.run.smithi112.stdout:osd2 (2)172.21.15.112:6816 100% (exists, up) 100% -1 2024-09-12T02:47:38.318 INFO:teuthology.orchestra.run.smithi112.stdout:osd3 (2)172.21.15.112:6824 100% (exists, up) 100% -1 2024-09-12T02:47:38.318 INFO:teuthology.orchestra.run.smithi112.stdout:osd4 (2)172.21.15.137:6800 100% (exists, up) 100% -1 2024-09-12T02:47:38.318 INFO:teuthology.orchestra.run.smithi112.stdout:osd5 (2)172.21.15.137:6808 100% (exists, up) 100% -1 2024-09-12T02:47:38.318 INFO:teuthology.orchestra.run.smithi112.stdout:osd6 (2)172.21.15.137:6813 100% (exists, up) 100% -1 2024-09-12T02:47:38.319 INFO:teuthology.orchestra.run.smithi112.stdout:osd7 (2)172.21.15.137:6824 100% (exists, up) 100% -1 2024-09-12T02:47:38.319 INFO:teuthology.orchestra.run.smithi112.stderr:1+1 records in 2024-09-12T02:47:38.319 INFO:teuthology.orchestra.run.smithi112.stderr:1+1 records out 2024-09-12T02:47:38.319 INFO:teuthology.orchestra.run.smithi112.stderr:803 bytes copied, 6.8504e-05 s, 11.7 MB/s 2024-09-12T02:47:38.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:47:38.329 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2024-09-12T02:47:38.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.480+0000 7f44d8a00640 1 Processor -- start 2024-09-12T02:47:38.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.480+0000 7f44d8a00640 1 -- start start 2024-09-12T02:47:38.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.481+0000 7f44d8a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44d406d8c0 0x7f44d40afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:38.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.481+0000 7f44d8a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f44d40ae8d0 0x7f44d40715a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:38.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.481+0000 7f44d8a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f44d406dca0 0x7f44d406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:38.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.481+0000 7f44d8a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f44d40aedd0 con 0x7f44d40ae8d0 2024-09-12T02:47:38.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.481+0000 7f44d8a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f44d40af0b0 con 0x7f44d406dca0 2024-09-12T02:47:38.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.481+0000 7f44d8a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f44d40af390 con 0x7f44d406d8c0 2024-09-12T02:47:38.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.482+0000 7f44d1400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f44d40ae8d0 0x7f44d40715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:38.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.482+0000 7f44d1400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f44d40ae8d0 0x7f44d40715a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59354/0 (socket says 172.21.15.112:59354) 2024-09-12T02:47:38.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.482+0000 7f44d1400640 1 -- 172.21.15.112:0/1450737918 learned_addr learned my addr 172.21.15.112:0/1450737918 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:38.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.482+0000 7f44d1e00640 1 --2- 172.21.15.112:0/1450737918 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44d406d8c0 0x7f44d40afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:38.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.482+0000 7f44d2800640 1 --2- 172.21.15.112:0/1450737918 >> v2:172.21.15.137:3300/0 conn(0x7f44d406dca0 0x7f44d406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:38.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.482+0000 7f44d1400640 1 -- 172.21.15.112:0/1450737918 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44d406d8c0 msgr2=0x7f44d40afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:38.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.482+0000 7f44d1400640 1 --2- 172.21.15.112:0/1450737918 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44d406d8c0 0x7f44d40afe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.482+0000 7f44d1400640 1 -- 172.21.15.112:0/1450737918 >> v2:172.21.15.137:3300/0 conn(0x7f44d406dca0 msgr2=0x7f44d406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:38.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.482+0000 7f44d1400640 1 --2- 172.21.15.112:0/1450737918 >> v2:172.21.15.137:3300/0 conn(0x7f44d406dca0 0x7f44d406e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.482+0000 7f44d1400640 1 -- 172.21.15.112:0/1450737918 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d40af670 con 0x7f44d40ae8d0 2024-09-12T02:47:38.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.483+0000 7f44d1400640 1 --2- 172.21.15.112:0/1450737918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44d40ae8d0 0x7f44d40715a0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f44d4068690 tx=0x7f44c002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c04c2bfe909e013 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:38.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.483+0000 7f44d0a00640 1 -- 172.21.15.112:0/1450737918 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c0004030 con 0x7f44d40ae8d0 2024-09-12T02:47:38.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.483+0000 7f44d0a00640 1 -- 172.21.15.112:0/1450737918 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c00041d0 con 0x7f44d40ae8d0 2024-09-12T02:47:38.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.483+0000 7f44d0a00640 1 -- 172.21.15.112:0/1450737918 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c0003610 con 0x7f44d40ae8d0 2024-09-12T02:47:38.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.484+0000 7f44d8a00640 1 -- 172.21.15.112:0/1450737918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44d40ae8d0 msgr2=0x7f44d40715a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:38.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.484+0000 7f44d8a00640 1 --2- 172.21.15.112:0/1450737918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44d40ae8d0 0x7f44d40715a0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f44d4068690 tx=0x7f44c002a1c0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.484+0000 7f44d8a00640 1 -- 172.21.15.112:0/1450737918 shutdown_connections 2024-09-12T02:47:38.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.484+0000 7f44d8a00640 1 --2- 172.21.15.112:0/1450737918 >> v2:172.21.15.137:3300/0 conn(0x7f44d406dca0 0x7f44d406e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.484+0000 7f44d8a00640 1 --2- 172.21.15.112:0/1450737918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44d40ae8d0 0x7f44d40715a0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.484+0000 7f44d8a00640 1 --2- 172.21.15.112:0/1450737918 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44d406d8c0 0x7f44d40afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.484+0000 7f44d8a00640 1 -- 172.21.15.112:0/1450737918 >> 172.21.15.112:0/1450737918 conn(0x7f44d406bbd0 msgr2=0x7f44d406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:38.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.484+0000 7f44d8a00640 1 -- 172.21.15.112:0/1450737918 shutdown_connections 2024-09-12T02:47:38.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.484+0000 7f44d8a00640 1 -- 172.21.15.112:0/1450737918 wait complete. 2024-09-12T02:47:38.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.486+0000 7f44d8a00640 1 Processor -- start 2024-09-12T02:47:38.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.486+0000 7f44d8a00640 1 -- start start 2024-09-12T02:47:38.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.487+0000 7f44d8a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44d406d8c0 0x7f44d41483c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:38.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.487+0000 7f44d8a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44d406dca0 0x7f44d40cf300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:38.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.487+0000 7f44d8a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44d40ae8d0 0x7f44d40cf840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:38.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.487+0000 7f44d8a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f44d4071ae0 con 0x7f44d40ae8d0 2024-09-12T02:47:38.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.487+0000 7f44d8a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f44d406e690 con 0x7f44d406dca0 2024-09-12T02:47:38.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.487+0000 7f44d8a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f44d40b38e0 con 0x7f44d406d8c0 2024-09-12T02:47:38.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.487+0000 7f44d2800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44d40ae8d0 0x7f44d40cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:38.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.487+0000 7f44d2800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44d40ae8d0 0x7f44d40cf840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59360/0 (socket says 172.21.15.112:59360) 2024-09-12T02:47:38.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.487+0000 7f44d2800640 1 -- 172.21.15.112:0/1420999472 learned_addr learned my addr 172.21.15.112:0/1420999472 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:38.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.487+0000 7f44d1e00640 1 --2- 172.21.15.112:0/1420999472 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44d406d8c0 0x7f44d41483c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:38.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.487+0000 7f44d1400640 1 --2- 172.21.15.112:0/1420999472 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44d406dca0 0x7f44d40cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:38.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.487+0000 7f44d2800640 1 -- 172.21.15.112:0/1420999472 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44d406d8c0 msgr2=0x7f44d41483c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:38.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.487+0000 7f44d2800640 1 --2- 172.21.15.112:0/1420999472 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44d406d8c0 0x7f44d41483c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.487+0000 7f44d2800640 1 -- 172.21.15.112:0/1420999472 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44d406dca0 msgr2=0x7f44d40cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:38.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.487+0000 7f44d2800640 1 --2- 172.21.15.112:0/1420999472 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44d406dca0 0x7f44d40cf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.487+0000 7f44d2800640 1 -- 172.21.15.112:0/1420999472 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d41e7590 con 0x7f44d40ae8d0 2024-09-12T02:47:38.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.487+0000 7f44d1400640 1 --2- 172.21.15.112:0/1420999472 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44d406dca0 0x7f44d40cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:38.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.488+0000 7f44d2800640 1 --2- 172.21.15.112:0/1420999472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44d40ae8d0 0x7f44d40cf840 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f44cc007e40 tx=0x7f44cc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:38.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.488+0000 7f44ca000640 1 -- 172.21.15.112:0/1420999472 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc014620 con 0x7f44d40ae8d0 2024-09-12T02:47:38.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.488+0000 7f44ca000640 1 -- 172.21.15.112:0/1420999472 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44cc019070 con 0x7f44d40ae8d0 2024-09-12T02:47:38.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.488+0000 7f44d8a00640 1 -- 172.21.15.112:0/1420999472 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44d41e7870 con 0x7f44d40ae8d0 2024-09-12T02:47:38.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.488+0000 7f44ca000640 1 -- 172.21.15.112:0/1420999472 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc014a20 con 0x7f44d40ae8d0 2024-09-12T02:47:38.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.488+0000 7f44d8a00640 1 -- 172.21.15.112:0/1420999472 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44d41e7e30 con 0x7f44d40ae8d0 2024-09-12T02:47:38.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.489+0000 7f44d8a00640 1 -- 172.21.15.112:0/1420999472 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44d4068a30 con 0x7f44d40ae8d0 2024-09-12T02:47:38.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.490+0000 7f44ca000640 1 -- 172.21.15.112:0/1420999472 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f44cc014bc0 con 0x7f44d40ae8d0 2024-09-12T02:47:38.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.491+0000 7f44ca000640 1 --2- 172.21.15.112:0/1420999472 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f44b406be30 0x7f44b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:38.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.491+0000 7f44ca000640 1 -- 172.21.15.112:0/1420999472 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5709+0+0 (secure 0 0 0) 0x7f44cc08b6e0 con 0x7f44d40ae8d0 2024-09-12T02:47:38.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.491+0000 7f44d1e00640 1 --2- 172.21.15.112:0/1420999472 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f44b406be30 0x7f44b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:38.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.492+0000 7f44d1e00640 1 --2- 172.21.15.112:0/1420999472 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f44b406be30 0x7f44b406e2f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f44c4006fd0 tx=0x7f44c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:38.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.495+0000 7f44ca000640 1 -- 172.21.15.112:0/1420999472 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f44cc05a080 con 0x7f44d40ae8d0 2024-09-12T02:47:38.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.679+0000 7f44d8a00640 1 -- 172.21.15.112:0/1420999472 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) -- 0x7f44d4072030 con 0x7f44d40ae8d0 2024-09-12T02:47:38.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.950+0000 7f44ca000640 1 -- 172.21.15.112:0/1420999472 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v122) ==== 93+0+0 (secure 0 0 0) 0x7f44cc059980 con 0x7f44d40ae8d0 2024-09-12T02:47:38.951 INFO:teuthology.orchestra.run.smithi112.stderr:pauserd,pausewr is set 2024-09-12T02:47:38.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.952+0000 7f44d8a00640 1 -- 172.21.15.112:0/1420999472 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f44b406be30 msgr2=0x7f44b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:38.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.952+0000 7f44d8a00640 1 --2- 172.21.15.112:0/1420999472 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f44b406be30 0x7f44b406e2f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f44c4006fd0 tx=0x7f44c4008040 comp rx=0 tx=0).stop 2024-09-12T02:47:38.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.952+0000 7f44d8a00640 1 -- 172.21.15.112:0/1420999472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44d40ae8d0 msgr2=0x7f44d40cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:38.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.952+0000 7f44d8a00640 1 --2- 172.21.15.112:0/1420999472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44d40ae8d0 0x7f44d40cf840 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f44cc007e40 tx=0x7f44cc00e4b0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.953+0000 7f44d8a00640 1 -- 172.21.15.112:0/1420999472 shutdown_connections 2024-09-12T02:47:38.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.953+0000 7f44d8a00640 1 --2- 172.21.15.112:0/1420999472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44d40ae8d0 0x7f44d40cf840 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.953+0000 7f44d8a00640 1 --2- 172.21.15.112:0/1420999472 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f44b406be30 0x7f44b406e2f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.953+0000 7f44d8a00640 1 --2- 172.21.15.112:0/1420999472 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44d406dca0 0x7f44d40cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.953+0000 7f44d8a00640 1 --2- 172.21.15.112:0/1420999472 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f44d406d8c0 0x7f44d41483c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:38.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.953+0000 7f44d8a00640 1 -- 172.21.15.112:0/1420999472 >> 172.21.15.112:0/1420999472 conn(0x7f44d406bbd0 msgr2=0x7f44d40b1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:38.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.953+0000 7f44d8a00640 1 -- 172.21.15.112:0/1420999472 shutdown_connections 2024-09-12T02:47:38.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:38.953+0000 7f44d8a00640 1 -- 172.21.15.112:0/1420999472 wait complete. 2024-09-12T02:47:38.972 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2024-09-12T02:47:39.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.125+0000 7f4f4be00640 1 Processor -- start 2024-09-12T02:47:39.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.125+0000 7f4f4be00640 1 -- start start 2024-09-12T02:47:39.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.126+0000 7f4f4be00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4f4c06dbe0 0x7f4f4c0b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:39.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.126+0000 7f4f4be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4f4c0b69e0 0x7f4f4c0b6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:39.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.126+0000 7f4f4be00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f4c0b0910 con 0x7f4f4c15ed60 2024-09-12T02:47:39.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.126+0000 7f4f4be00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4f4c0b3c10 con 0x7f4f4c06dbe0 2024-09-12T02:47:39.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.126+0000 7f4f4be00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4f4c0b3000 con 0x7f4f4c0b69e0 2024-09-12T02:47:39.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.126+0000 7f4f4a000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4f4c06dbe0 0x7f4f4c0b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:39.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.127+0000 7f4f4a000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4f4c06dbe0 0x7f4f4c0b64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59364/0 (socket says 172.21.15.112:59364) 2024-09-12T02:47:39.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.127+0000 7f4f4a000640 1 -- 172.21.15.112:0/2996474614 learned_addr learned my addr 172.21.15.112:0/2996474614 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:39.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.127+0000 7f4f4a000640 1 -- 172.21.15.112:0/2996474614 >> v2:172.21.15.137:3300/0 conn(0x7f4f4c0b69e0 msgr2=0x7f4f4c0b6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:39.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.127+0000 7f4f4b400640 1 --2- 172.21.15.112:0/2996474614 >> v2:172.21.15.137:3300/0 conn(0x7f4f4c0b69e0 0x7f4f4c0b6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:39.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.127+0000 7f4f4a000640 1 --2- 172.21.15.112:0/2996474614 >> v2:172.21.15.137:3300/0 conn(0x7f4f4c0b69e0 0x7f4f4c0b6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:39.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.127+0000 7f4f4a000640 1 -- 172.21.15.112:0/2996474614 >> v1:172.21.15.137:6789/0 conn(0x7f4f4c15ed60 legacy=0x7f4f4c06d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:39.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.127+0000 7f4f4a000640 1 -- 172.21.15.112:0/2996474614 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f4c0b32e0 con 0x7f4f4c06dbe0 2024-09-12T02:47:39.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.127+0000 7f4f4b400640 1 --2- 172.21.15.112:0/2996474614 >> v2:172.21.15.137:3300/0 conn(0x7f4f4c0b69e0 0x7f4f4c0b6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:39.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.128+0000 7f4f4a000640 1 --2- 172.21.15.112:0/2996474614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f4c06dbe0 0x7f4f4c0b64a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c0729b0 tx=0x7f4f3802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed63982e95ad8e94 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:39.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.128+0000 7f4f49600640 1 -- 172.21.15.112:0/2996474614 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f38037070 con 0x7f4f4c06dbe0 2024-09-12T02:47:39.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.128+0000 7f4f49600640 1 -- 172.21.15.112:0/2996474614 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f38032440 con 0x7f4f4c06dbe0 2024-09-12T02:47:39.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.128+0000 7f4f49600640 1 -- 172.21.15.112:0/2996474614 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f38032810 con 0x7f4f4c06dbe0 2024-09-12T02:47:39.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.129+0000 7f4f4be00640 1 -- 172.21.15.112:0/2996474614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f4c06dbe0 msgr2=0x7f4f4c0b64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:39.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.129+0000 7f4f4be00640 1 --2- 172.21.15.112:0/2996474614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f4c06dbe0 0x7f4f4c0b64a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c0729b0 tx=0x7f4f3802a1a0 comp rx=0 tx=0).stop 2024-09-12T02:47:39.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.129+0000 7f4f4be00640 1 -- 172.21.15.112:0/2996474614 shutdown_connections 2024-09-12T02:47:39.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.129+0000 7f4f4be00640 1 --2- 172.21.15.112:0/2996474614 >> v2:172.21.15.137:3300/0 conn(0x7f4f4c0b69e0 0x7f4f4c0b6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:39.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.129+0000 7f4f4be00640 1 --2- 172.21.15.112:0/2996474614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f4c06dbe0 0x7f4f4c0b64a0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:39.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.129+0000 7f4f4be00640 1 -- 172.21.15.112:0/2996474614 >> 172.21.15.112:0/2996474614 conn(0x7f4f4c0b7e80 msgr2=0x7f4f4c0b8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:39.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.129+0000 7f4f4be00640 1 -- 172.21.15.112:0/2996474614 shutdown_connections 2024-09-12T02:47:39.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.129+0000 7f4f4be00640 1 -- 172.21.15.112:0/2996474614 wait complete. 2024-09-12T02:47:39.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.131+0000 7f4f4be00640 1 Processor -- start 2024-09-12T02:47:39.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.131+0000 7f4f4be00640 1 -- start start 2024-09-12T02:47:39.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.132+0000 7f4f4be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f4c06dbe0 0x7f4f4c160e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:39.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.132+0000 7f4f4be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f4c0b69e0 0x7f4f4c15f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:39.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.132+0000 7f4f4be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f4c15ed60 0x7f4f4c0cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:39.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.132+0000 7f4f4be00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4c06e270 con 0x7f4f4c0b69e0 2024-09-12T02:47:39.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.132+0000 7f4f4be00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4c0b38a0 con 0x7f4f4c06dbe0 2024-09-12T02:47:39.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.132+0000 7f4f4be00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4f4c0b40a0 con 0x7f4f4c15ed60 2024-09-12T02:47:39.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.132+0000 7f4f4a000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f4c0b69e0 0x7f4f4c15f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:39.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.132+0000 7f4f4a000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f4c0b69e0 0x7f4f4c15f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59378/0 (socket says 172.21.15.112:59378) 2024-09-12T02:47:39.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.132+0000 7f4f4a000640 1 -- 172.21.15.112:0/1298485869 learned_addr learned my addr 172.21.15.112:0/1298485869 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:39.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.132+0000 7f4f4aa00640 1 --2- 172.21.15.112:0/1298485869 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f4c06dbe0 0x7f4f4c160e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:39.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.132+0000 7f4f4b400640 1 --2- 172.21.15.112:0/1298485869 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f4c15ed60 0x7f4f4c0cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:39.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.132+0000 7f4f4a000640 1 -- 172.21.15.112:0/1298485869 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f4c15ed60 msgr2=0x7f4f4c0cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:39.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.132+0000 7f4f4a000640 1 --2- 172.21.15.112:0/1298485869 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f4c15ed60 0x7f4f4c0cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:39.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.132+0000 7f4f4a000640 1 -- 172.21.15.112:0/1298485869 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f4c06dbe0 msgr2=0x7f4f4c160e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:39.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.132+0000 7f4f4a000640 1 --2- 172.21.15.112:0/1298485869 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f4c06dbe0 0x7f4f4c160e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:39.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.132+0000 7f4f4a000640 1 -- 172.21.15.112:0/1298485869 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f4c15fdf0 con 0x7f4f4c0b69e0 2024-09-12T02:47:39.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.132+0000 7f4f4a000640 1 --2- 172.21.15.112:0/1298485869 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f4c0b69e0 0x7f4f4c15f350 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f4f3802a1e0 tx=0x7f4f380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:39.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.133+0000 7f4f42a00640 1 -- 172.21.15.112:0/1298485869 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f38037040 con 0x7f4f4c0b69e0 2024-09-12T02:47:39.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.133+0000 7f4f42a00640 1 -- 172.21.15.112:0/1298485869 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f38042070 con 0x7f4f4c0b69e0 2024-09-12T02:47:39.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.133+0000 7f4f4be00640 1 -- 172.21.15.112:0/1298485869 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f4c1600d0 con 0x7f4f4c0b69e0 2024-09-12T02:47:39.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.133+0000 7f4f42a00640 1 -- 172.21.15.112:0/1298485869 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f38030bb0 con 0x7f4f4c0b69e0 2024-09-12T02:47:39.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.133+0000 7f4f4be00640 1 -- 172.21.15.112:0/1298485869 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f4c160690 con 0x7f4f4c0b69e0 2024-09-12T02:47:39.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.134+0000 7f4f4be00640 1 -- 172.21.15.112:0/1298485869 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f4c15f140 con 0x7f4f4c0b69e0 2024-09-12T02:47:39.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.135+0000 7f4f42a00640 1 -- 172.21.15.112:0/1298485869 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4f38047460 con 0x7f4f4c0b69e0 2024-09-12T02:47:39.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.136+0000 7f4f42a00640 1 --2- 172.21.15.112:0/1298485869 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4f2c06be30 0x7f4f2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:39.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.136+0000 7f4f42a00640 1 -- 172.21.15.112:0/1298485869 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5709+0+0 (secure 0 0 0) 0x7f4f380abbb0 con 0x7f4f4c0b69e0 2024-09-12T02:47:39.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.136+0000 7f4f4aa00640 1 --2- 172.21.15.112:0/1298485869 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4f2c06be30 0x7f4f2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:39.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.136+0000 7f4f42a00640 1 -- 172.21.15.112:0/1298485869 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=123+}) -- 0x7f4f2c073960 con 0x7f4f4c0b69e0 2024-09-12T02:47:39.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.137+0000 7f4f4aa00640 1 --2- 172.21.15.112:0/1298485869 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4f2c06be30 0x7f4f2c06e2f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c006fd0 tx=0x7f4f3c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:39.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.140+0000 7f4f42a00640 1 -- 172.21.15.112:0/1298485869 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4f38045360 con 0x7f4f4c0b69e0 2024-09-12T02:47:39.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.321+0000 7f4f4be00640 1 -- 172.21.15.112:0/1298485869 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) -- 0x7f4f4c0708f0 con 0x7f4f4c0b69e0 2024-09-12T02:47:39.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.967+0000 7f4f42a00640 1 -- 172.21.15.112:0/1298485869 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v123) ==== 97+0+0 (secure 0 0 0) 0x7f4f3807a4c0 con 0x7f4f4c0b69e0 2024-09-12T02:47:39.968 INFO:teuthology.orchestra.run.smithi112.stderr:pauserd,pausewr is unset 2024-09-12T02:47:39.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.968+0000 7f4f42a00640 1 -- 172.21.15.112:0/1298485869 <== mon.0 v2:172.21.15.112:3300/0 8 ==== osd_map(123..123 src has 1..123) ==== 288+0+0 (secure 0 0 0) 0x7f4f38077e60 con 0x7f4f4c0b69e0 2024-09-12T02:47:39.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.968+0000 7f4f42a00640 1 -- 172.21.15.112:0/1298485869 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=124}) -- 0x7f4f2c0742d0 con 0x7f4f4c0b69e0 2024-09-12T02:47:39.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.971+0000 7f4f4be00640 1 -- 172.21.15.112:0/1298485869 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4f2c06be30 msgr2=0x7f4f2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:39.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.971+0000 7f4f4be00640 1 --2- 172.21.15.112:0/1298485869 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4f2c06be30 0x7f4f2c06e2f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c006fd0 tx=0x7f4f3c008040 comp rx=0 tx=0).stop 2024-09-12T02:47:39.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.971+0000 7f4f4be00640 1 -- 172.21.15.112:0/1298485869 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f4c0b69e0 msgr2=0x7f4f4c15f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:39.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.971+0000 7f4f4be00640 1 --2- 172.21.15.112:0/1298485869 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f4c0b69e0 0x7f4f4c15f350 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f4f3802a1e0 tx=0x7f4f380046c0 comp rx=0 tx=0).stop 2024-09-12T02:47:39.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.971+0000 7f4f4be00640 1 -- 172.21.15.112:0/1298485869 shutdown_connections 2024-09-12T02:47:39.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.971+0000 7f4f4be00640 1 --2- 172.21.15.112:0/1298485869 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f4c15ed60 0x7f4f4c0cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:39.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.971+0000 7f4f4be00640 1 --2- 172.21.15.112:0/1298485869 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f4c0b69e0 0x7f4f4c15f350 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:39.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.971+0000 7f4f4be00640 1 --2- 172.21.15.112:0/1298485869 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4f2c06be30 0x7f4f2c06e2f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:39.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.971+0000 7f4f4be00640 1 --2- 172.21.15.112:0/1298485869 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f4c06dbe0 0x7f4f4c160e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:39.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.971+0000 7f4f4be00640 1 -- 172.21.15.112:0/1298485869 >> 172.21.15.112:0/1298485869 conn(0x7f4f4c0b7e80 msgr2=0x7f4f4c0b45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:39.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.972+0000 7f4f4be00640 1 -- 172.21.15.112:0/1298485869 shutdown_connections 2024-09-12T02:47:39.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:39.972+0000 7f4f4be00640 1 -- 172.21.15.112:0/1298485869 wait complete. 2024-09-12T02:47:39.990 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:47:40.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.144+0000 7f0210200640 1 Processor -- start 2024-09-12T02:47:40.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.144+0000 7f0210200640 1 -- start start 2024-09-12T02:47:40.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.145+0000 7f0210200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f020815b9d0 0x7f02080b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:40.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.145+0000 7f0210200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02080b45d0 0x7f02080728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:40.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.145+0000 7f0210200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02080b54a0 con 0x7f020806eef0 2024-09-12T02:47:40.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.146+0000 7f0210200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f02080b4a60 con 0x7f020815b9d0 2024-09-12T02:47:40.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.146+0000 7f0210200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f02080b3af0 con 0x7f02080b45d0 2024-09-12T02:47:40.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.146+0000 7f020d800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f020815b9d0 0x7f02080b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:40.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.146+0000 7f020d800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f020815b9d0 0x7f02080b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59394/0 (socket says 172.21.15.112:59394) 2024-09-12T02:47:40.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.146+0000 7f020d800640 1 -- 172.21.15.112:0/2462233967 learned_addr learned my addr 172.21.15.112:0/2462233967 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:40.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.146+0000 7f020ce00640 1 --2- 172.21.15.112:0/2462233967 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02080b45d0 0x7f02080728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:40.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.146+0000 7f020d800640 1 -- 172.21.15.112:0/2462233967 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02080b45d0 msgr2=0x7f02080728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:40.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.146+0000 7f020d800640 1 --2- 172.21.15.112:0/2462233967 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02080b45d0 0x7f02080728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:40.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.146+0000 7f020d800640 1 -- 172.21.15.112:0/2462233967 >> v1:172.21.15.137:6789/0 conn(0x7f020806eef0 legacy=0x7f02080cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:40.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.146+0000 7f020d800640 1 -- 172.21.15.112:0/2462233967 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02080b3dd0 con 0x7f020815b9d0 2024-09-12T02:47:40.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.146+0000 7f020ce00640 1 --2- 172.21.15.112:0/2462233967 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02080b45d0 0x7f02080728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:40.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.147+0000 7f020d800640 1 --2- 172.21.15.112:0/2462233967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f020815b9d0 0x7f02080b4ec0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00bb10 tx=0x7f01fc02c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3982020ea6a303a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:40.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.147+0000 7f0207e00640 1 -- 172.21.15.112:0/2462233967 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01fc032790 con 0x7f020815b9d0 2024-09-12T02:47:40.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.147+0000 7f0207e00640 1 -- 172.21.15.112:0/2462233967 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01fc038070 con 0x7f020815b9d0 2024-09-12T02:47:40.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.147+0000 7f0207e00640 1 -- 172.21.15.112:0/2462233967 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01fc032b50 con 0x7f020815b9d0 2024-09-12T02:47:40.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.148+0000 7f0210200640 1 -- 172.21.15.112:0/2462233967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f020815b9d0 msgr2=0x7f02080b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:40.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.148+0000 7f0210200640 1 --2- 172.21.15.112:0/2462233967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f020815b9d0 0x7f02080b4ec0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00bb10 tx=0x7f01fc02c8d0 comp rx=0 tx=0).stop 2024-09-12T02:47:40.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.148+0000 7f0210200640 1 -- 172.21.15.112:0/2462233967 shutdown_connections 2024-09-12T02:47:40.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.148+0000 7f0210200640 1 --2- 172.21.15.112:0/2462233967 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02080b45d0 0x7f02080728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:40.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.148+0000 7f0210200640 1 --2- 172.21.15.112:0/2462233967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f020815b9d0 0x7f02080b4ec0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:40.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.148+0000 7f0210200640 1 -- 172.21.15.112:0/2462233967 >> 172.21.15.112:0/2462233967 conn(0x7f020806bbd0 msgr2=0x7f020806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:40.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.148+0000 7f0210200640 1 -- 172.21.15.112:0/2462233967 shutdown_connections 2024-09-12T02:47:40.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.148+0000 7f0210200640 1 -- 172.21.15.112:0/2462233967 wait complete. 2024-09-12T02:47:40.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.150+0000 7f0210200640 1 Processor -- start 2024-09-12T02:47:40.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.150+0000 7f0210200640 1 -- start start 2024-09-12T02:47:40.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.151+0000 7f0210200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f020806eef0 0x7f020814f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:40.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.151+0000 7f0210200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02080b45d0 0x7f020815e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:40.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.151+0000 7f0210200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f020815b9d0 0x7f020815eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:40.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.151+0000 7f0210200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f020815bf30 con 0x7f02080b45d0 2024-09-12T02:47:40.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.151+0000 7f0210200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f020815bdb0 con 0x7f020806eef0 2024-09-12T02:47:40.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.151+0000 7f0210200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f020806f320 con 0x7f020815b9d0 2024-09-12T02:47:40.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.151+0000 7f020ce00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02080b45d0 0x7f020815e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:40.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.151+0000 7f020ce00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02080b45d0 0x7f020815e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59402/0 (socket says 172.21.15.112:59402) 2024-09-12T02:47:40.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.151+0000 7f020ce00640 1 -- 172.21.15.112:0/3480018689 learned_addr learned my addr 172.21.15.112:0/3480018689 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:40.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.151+0000 7f020e200640 1 --2- 172.21.15.112:0/3480018689 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f020815b9d0 0x7f020815eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:40.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.151+0000 7f020d800640 1 --2- 172.21.15.112:0/3480018689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f020806eef0 0x7f020814f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:40.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.151+0000 7f020ce00640 1 -- 172.21.15.112:0/3480018689 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f020815b9d0 msgr2=0x7f020815eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:40.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.151+0000 7f020ce00640 1 --2- 172.21.15.112:0/3480018689 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f020815b9d0 0x7f020815eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:40.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.151+0000 7f020ce00640 1 -- 172.21.15.112:0/3480018689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f020806eef0 msgr2=0x7f020814f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:40.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.151+0000 7f020ce00640 1 --2- 172.21.15.112:0/3480018689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f020806eef0 0x7f020814f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:40.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.151+0000 7f020ce00640 1 -- 172.21.15.112:0/3480018689 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02081f9120 con 0x7f02080b45d0 2024-09-12T02:47:40.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.152+0000 7f020ce00640 1 --2- 172.21.15.112:0/3480018689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02080b45d0 0x7f020815e5a0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f01f400c820 tx=0x7f01f400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:40.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.152+0000 7f0205600640 1 -- 172.21.15.112:0/3480018689 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f4005b90 con 0x7f02080b45d0 2024-09-12T02:47:40.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.152+0000 7f0205600640 1 -- 172.21.15.112:0/3480018689 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01f4005d30 con 0x7f02080b45d0 2024-09-12T02:47:40.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.152+0000 7f0210200640 1 -- 172.21.15.112:0/3480018689 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02081f93c0 con 0x7f02080b45d0 2024-09-12T02:47:40.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.152+0000 7f0205600640 1 -- 172.21.15.112:0/3480018689 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f4007a30 con 0x7f02080b45d0 2024-09-12T02:47:40.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.152+0000 7f0210200640 1 -- 172.21.15.112:0/3480018689 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f020814fcb0 con 0x7f02080b45d0 2024-09-12T02:47:40.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.153+0000 7f0210200640 1 -- 172.21.15.112:0/3480018689 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0208068a30 con 0x7f02080b45d0 2024-09-12T02:47:40.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.154+0000 7f0205600640 1 -- 172.21.15.112:0/3480018689 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f01f4007bd0 con 0x7f02080b45d0 2024-09-12T02:47:40.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.155+0000 7f0205600640 1 --2- 172.21.15.112:0/3480018689 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f01e806be30 0x7f01e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:40.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.155+0000 7f0205600640 1 -- 172.21.15.112:0/3480018689 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f01f408afa0 con 0x7f02080b45d0 2024-09-12T02:47:40.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.155+0000 7f020d800640 1 --2- 172.21.15.112:0/3480018689 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f01e806be30 0x7f01e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:40.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.156+0000 7f020d800640 1 --2- 172.21.15.112:0/3480018689 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f01e806be30 0x7f01e806e2f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f01fc037000 tx=0x7f01fc032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:40.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.159+0000 7f0205600640 1 -- 172.21.15.112:0/3480018689 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f01f4015020 con 0x7f02080b45d0 2024-09-12T02:47:40.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.333+0000 7f0210200640 1 -- 172.21.15.112:0/3480018689 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f020806f6b0 con 0x7f02080b45d0 2024-09-12T02:47:40.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.334+0000 7f0205600640 1 -- 172.21.15.112:0/3480018689 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) ==== 74+0+16735 (secure 0 0 0) 0x7f01f40598b0 con 0x7f02080b45d0 2024-09-12T02:47:40.335 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:40.336 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":123,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:47:39.960522+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:47:24.847347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-12T02:47:26.073460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:47:40.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.337+0000 7f0210200640 1 -- 172.21.15.112:0/3480018689 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f01e806be30 msgr2=0x7f01e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:40.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.337+0000 7f0210200640 1 --2- 172.21.15.112:0/3480018689 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f01e806be30 0x7f01e806e2f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f01fc037000 tx=0x7f01fc032000 comp rx=0 tx=0).stop 2024-09-12T02:47:40.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.337+0000 7f0210200640 1 -- 172.21.15.112:0/3480018689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02080b45d0 msgr2=0x7f020815e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:40.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.337+0000 7f0210200640 1 --2- 172.21.15.112:0/3480018689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02080b45d0 0x7f020815e5a0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f01f400c820 tx=0x7f01f400cc20 comp rx=0 tx=0).stop 2024-09-12T02:47:40.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.337+0000 7f0210200640 1 -- 172.21.15.112:0/3480018689 shutdown_connections 2024-09-12T02:47:40.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.337+0000 7f0210200640 1 --2- 172.21.15.112:0/3480018689 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f020815b9d0 0x7f020815eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:40.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.337+0000 7f0210200640 1 --2- 172.21.15.112:0/3480018689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02080b45d0 0x7f020815e5a0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:40.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.337+0000 7f0210200640 1 --2- 172.21.15.112:0/3480018689 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f01e806be30 0x7f01e806e2f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:40.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.337+0000 7f0210200640 1 --2- 172.21.15.112:0/3480018689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f020806eef0 0x7f020814f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:40.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.337+0000 7f0210200640 1 -- 172.21.15.112:0/3480018689 >> 172.21.15.112:0/3480018689 conn(0x7f020806bbd0 msgr2=0x7f02080d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:40.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.337+0000 7f0210200640 1 -- 172.21.15.112:0/3480018689 shutdown_connections 2024-09-12T02:47:40.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.337+0000 7f0210200640 1 -- 172.21.15.112:0/3480018689 wait complete. 2024-09-12T02:47:40.354 DEBUG:teuthology.orchestra.run.smithi112:> stdin-killer -- python3 -c ' 2024-09-12T02:47:40.354 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-12T02:47:40.355 DEBUG:teuthology.orchestra.run.smithi112:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-12T02:47:40.355 DEBUG:teuthology.orchestra.run.smithi112:> os.fchmod(fd, 0O666) 2024-09-12T02:47:40.355 DEBUG:teuthology.orchestra.run.smithi112:> os.fsync(fd) 2024-09-12T02:47:40.355 DEBUG:teuthology.orchestra.run.smithi112:> os.close(fd) 2024-09-12T02:47:40.355 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-12T02:47:40.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:47:40.467 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:47:40.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:47:40.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:47:40.596 INFO:teuthology.orchestra.run.smithi112.stdout:client5711 2024-09-12T02:47:40.596 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/7c01f3b3-dec2-4449-a33f-f960d7527ea6.client5711/osdmap') 2024-09-12T02:47:40.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:47:40.695 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 120 barrier 120 flags 0x588000 2024-09-12T02:47:40.695 INFO:teuthology.orchestra.run.smithi112.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-12T02:47:40.695 INFO:teuthology.orchestra.run.smithi112.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-12T02:47:40.695 INFO:teuthology.orchestra.run.smithi112.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-12T02:47:40.695 INFO:teuthology.orchestra.run.smithi112.stdout:osd0 (2)172.21.15.112:6800 100% (exists, up) 100% -1 2024-09-12T02:47:40.695 INFO:teuthology.orchestra.run.smithi112.stdout:osd1 (2)172.21.15.112:6808 100% (exists, up) 100% -1 2024-09-12T02:47:40.695 INFO:teuthology.orchestra.run.smithi112.stdout:osd2 (2)172.21.15.112:6816 100% (exists, up) 100% -1 2024-09-12T02:47:40.695 INFO:teuthology.orchestra.run.smithi112.stdout:osd3 (2)172.21.15.112:6824 100% (exists, up) 100% -1 2024-09-12T02:47:40.695 INFO:teuthology.orchestra.run.smithi112.stdout:osd4 (2)172.21.15.137:6800 100% (exists, up) 100% -1 2024-09-12T02:47:40.695 INFO:teuthology.orchestra.run.smithi112.stdout:osd5 (2)172.21.15.137:6808 100% (exists, up) 100% -1 2024-09-12T02:47:40.695 INFO:teuthology.orchestra.run.smithi112.stdout:osd6 (2)172.21.15.137:6813 100% (exists, up) 100% -1 2024-09-12T02:47:40.696 INFO:teuthology.orchestra.run.smithi112.stdout:osd7 (2)172.21.15.137:6824 100% (exists, up) 100% -1 2024-09-12T02:47:40.696 INFO:teuthology.orchestra.run.smithi112.stderr:1+1 records in 2024-09-12T02:47:40.696 INFO:teuthology.orchestra.run.smithi112.stderr:1+1 records out 2024-09-12T02:47:40.696 INFO:teuthology.orchestra.run.smithi112.stderr:803 bytes copied, 8.4682e-05 s, 9.5 MB/s 2024-09-12T02:47:40.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:47:40.705 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:47:40.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.858+0000 7ff6a7e00640 1 Processor -- start 2024-09-12T02:47:40.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.858+0000 7ff6a7e00640 1 -- start start 2024-09-12T02:47:40.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.859+0000 7ff6a7e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6a00731c0 0x7ff6a006bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:40.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.859+0000 7ff6a7e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff6a006c110 0x7ff6a00cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:40.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.859+0000 7ff6a7e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6a015a9b0 con 0x7ff6a015a5d0 2024-09-12T02:47:40.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.859+0000 7ff6a7e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff6a013ffa0 con 0x7ff6a006c110 2024-09-12T02:47:40.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.859+0000 7ff6a7e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff6a006c560 con 0x7ff6a00731c0 2024-09-12T02:47:40.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.860+0000 7ff6a5e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff6a006c110 0x7ff6a00cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:40.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.860+0000 7ff6a5400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff6a015a5d0 0x7ff6a01422b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58352/0 (socket says 172.21.15.112:58352) 2024-09-12T02:47:40.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.860+0000 7ff6a5400640 1 -- 172.21.15.112:0/485242481 learned_addr learned my addr 172.21.15.112:0/485242481 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:40.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.860+0000 7ff6a4a00640 1 --2- 172.21.15.112:0/485242481 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6a00731c0 0x7ff6a006bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:40.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.860+0000 7ff6a5e00640 1 -- 172.21.15.112:0/485242481 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6a00731c0 msgr2=0x7ff6a006bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:40.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.860+0000 7ff6a5e00640 1 --2- 172.21.15.112:0/485242481 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6a00731c0 0x7ff6a006bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:40.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.860+0000 7ff6a5e00640 1 -- 172.21.15.112:0/485242481 >> v1:172.21.15.112:6789/0 conn(0x7ff6a015a5d0 legacy=0x7ff6a01422b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:40.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.860+0000 7ff6a5e00640 1 -- 172.21.15.112:0/485242481 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6a00735e0 con 0x7ff6a006c110 2024-09-12T02:47:40.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.861+0000 7ff6a5e00640 1 --2- 172.21.15.112:0/485242481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6a006c110 0x7ff6a00cfff0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7ff698009d90 tx=0x7ff69802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eead4d0fac8c85e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:40.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.861+0000 7ff69fe00640 1 -- 172.21.15.112:0/485242481 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff698007740 con 0x7ff6a006c110 2024-09-12T02:47:40.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.861+0000 7ff69fe00640 1 -- 172.21.15.112:0/485242481 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6980078e0 con 0x7ff6a006c110 2024-09-12T02:47:40.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.861+0000 7ff69fe00640 1 -- 172.21.15.112:0/485242481 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff698007cb0 con 0x7ff6a006c110 2024-09-12T02:47:40.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.862+0000 7ff6a7e00640 1 -- 172.21.15.112:0/485242481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6a006c110 msgr2=0x7ff6a00cfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:40.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.862+0000 7ff6a7e00640 1 --2- 172.21.15.112:0/485242481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6a006c110 0x7ff6a00cfff0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7ff698009d90 tx=0x7ff69802a660 comp rx=0 tx=0).stop 2024-09-12T02:47:40.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.862+0000 7ff6a7e00640 1 -- 172.21.15.112:0/485242481 shutdown_connections 2024-09-12T02:47:40.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.862+0000 7ff6a7e00640 1 --2- 172.21.15.112:0/485242481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6a006c110 0x7ff6a00cfff0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:40.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.862+0000 7ff6a7e00640 1 --2- 172.21.15.112:0/485242481 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6a00731c0 0x7ff6a006bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:40.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.862+0000 7ff6a7e00640 1 -- 172.21.15.112:0/485242481 >> 172.21.15.112:0/485242481 conn(0x7ff6a006cce0 msgr2=0x7ff6a006d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:40.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.862+0000 7ff6a7e00640 1 -- 172.21.15.112:0/485242481 shutdown_connections 2024-09-12T02:47:40.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.862+0000 7ff6a7e00640 1 -- 172.21.15.112:0/485242481 wait complete. 2024-09-12T02:47:40.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.863+0000 7ff6a7e00640 1 Processor -- start 2024-09-12T02:47:40.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.864+0000 7ff6a7e00640 1 -- start start 2024-09-12T02:47:40.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.864+0000 7ff6a7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6a006c110 0x7ff6a0134560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:40.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.864+0000 7ff6a7e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6a00731c0 0x7ff6a0135060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:40.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.864+0000 7ff6a7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6a015a5d0 0x7ff6a00b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:40.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.864+0000 7ff6a7e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a00726e0 con 0x7ff6a015a5d0 2024-09-12T02:47:40.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.864+0000 7ff6a7e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a0143100 con 0x7ff6a006c110 2024-09-12T02:47:40.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.864+0000 7ff6a7e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff6a00729c0 con 0x7ff6a00731c0 2024-09-12T02:47:40.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.865+0000 7ff6a5e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6a015a5d0 0x7ff6a00b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:40.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.865+0000 7ff6a5e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6a015a5d0 0x7ff6a00b4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59424/0 (socket says 172.21.15.112:59424) 2024-09-12T02:47:40.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.865+0000 7ff6a5e00640 1 -- 172.21.15.112:0/3476036637 learned_addr learned my addr 172.21.15.112:0/3476036637 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:40.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.865+0000 7ff6a4a00640 1 --2- 172.21.15.112:0/3476036637 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6a00731c0 0x7ff6a0135060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:40.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.865+0000 7ff6a5400640 1 --2- 172.21.15.112:0/3476036637 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6a006c110 0x7ff6a0134560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:40.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.865+0000 7ff6a5e00640 1 -- 172.21.15.112:0/3476036637 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6a00731c0 msgr2=0x7ff6a0135060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:40.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.865+0000 7ff6a5e00640 1 --2- 172.21.15.112:0/3476036637 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6a00731c0 0x7ff6a0135060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:40.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.865+0000 7ff6a5e00640 1 -- 172.21.15.112:0/3476036637 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6a006c110 msgr2=0x7ff6a0134560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:40.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.865+0000 7ff6a5e00640 1 --2- 172.21.15.112:0/3476036637 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6a006c110 0x7ff6a0134560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:40.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.865+0000 7ff6a5e00640 1 -- 172.21.15.112:0/3476036637 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6a00b5240 con 0x7ff6a015a5d0 2024-09-12T02:47:40.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.865+0000 7ff6a5e00640 1 --2- 172.21.15.112:0/3476036637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6a015a5d0 0x7ff6a00b4ad0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7ff698009eb0 tx=0x7ff698004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:40.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.866+0000 7ff69d600640 1 -- 172.21.15.112:0/3476036637 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff698040070 con 0x7ff6a015a5d0 2024-09-12T02:47:40.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.866+0000 7ff69d600640 1 -- 172.21.15.112:0/3476036637 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff698031bc0 con 0x7ff6a015a5d0 2024-09-12T02:47:40.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.866+0000 7ff69d600640 1 -- 172.21.15.112:0/3476036637 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff698045460 con 0x7ff6a015a5d0 2024-09-12T02:47:40.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.866+0000 7ff6a7e00640 1 -- 172.21.15.112:0/3476036637 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6a00b5520 con 0x7ff6a015a5d0 2024-09-12T02:47:40.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.866+0000 7ff6a7e00640 1 -- 172.21.15.112:0/3476036637 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6a00b5ae0 con 0x7ff6a015a5d0 2024-09-12T02:47:40.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.867+0000 7ff6a7e00640 1 -- 172.21.15.112:0/3476036637 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6a0068a30 con 0x7ff6a015a5d0 2024-09-12T02:47:40.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.868+0000 7ff69d600640 1 -- 172.21.15.112:0/3476036637 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff698039040 con 0x7ff6a015a5d0 2024-09-12T02:47:40.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.868+0000 7ff69d600640 1 --2- 172.21.15.112:0/3476036637 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff68006be30 0x7ff68006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:40.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.869+0000 7ff69d600640 1 -- 172.21.15.112:0/3476036637 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7ff6980ac730 con 0x7ff6a015a5d0 2024-09-12T02:47:40.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.869+0000 7ff6a5400640 1 --2- 172.21.15.112:0/3476036637 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff68006be30 0x7ff68006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:40.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.869+0000 7ff6a5400640 1 --2- 172.21.15.112:0/3476036637 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff68006be30 0x7ff68006e2f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff694007fd0 tx=0x7ff694007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:40.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:40.873+0000 7ff69d600640 1 -- 172.21.15.112:0/3476036637 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff69807a9f0 con 0x7ff6a015a5d0 2024-09-12T02:47:41.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:41.083+0000 7ff6a7e00640 1 -- 172.21.15.112:0/3476036637 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6a00ce720 con 0x7ff6a015a5d0 2024-09-12T02:47:41.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:41.084+0000 7ff69d600640 1 -- 172.21.15.112:0/3476036637 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5231 (secure 0 0 0) 0x7ff69807ecf0 con 0x7ff6a015a5d0 2024-09-12T02:47:41.085 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:41.085 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":62,"btime":"2024-09-12T02:47:30:715299+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5612,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/3181313801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3181313801},{"type":"v1","addr":"172.21.15.137:6834","nonce":3181313801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":5615,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2025494075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2025494075},{"type":"v1","addr":"172.21.15.137:6835","nonce":2025494075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6501,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3739674039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3739674039},{"type":"v1","addr":"172.21.15.112:6837","nonce":3739674039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:47:27.076883+0000","modified":"2024-09-12T02:47:30.117205+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6504},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6504":{"gid":6504,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/63450161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":63450161},{"type":"v1","addr":"172.21.15.112:6836","nonce":63450161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6504,"qdb_cluster":[6504]},"id":7}]} 2024-09-12T02:47:41.085 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 62 2024-09-12T02:47:41.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:41.086+0000 7ff6a7e00640 1 -- 172.21.15.112:0/3476036637 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff68006be30 msgr2=0x7ff68006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:41.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:41.086+0000 7ff6a7e00640 1 --2- 172.21.15.112:0/3476036637 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff68006be30 0x7ff68006e2f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff694007fd0 tx=0x7ff694007e80 comp rx=0 tx=0).stop 2024-09-12T02:47:41.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:41.086+0000 7ff6a7e00640 1 -- 172.21.15.112:0/3476036637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6a015a5d0 msgr2=0x7ff6a00b4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:41.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:41.086+0000 7ff6a7e00640 1 --2- 172.21.15.112:0/3476036637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6a015a5d0 0x7ff6a00b4ad0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7ff698009eb0 tx=0x7ff698004a40 comp rx=0 tx=0).stop 2024-09-12T02:47:41.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:41.086+0000 7ff6a7e00640 1 -- 172.21.15.112:0/3476036637 shutdown_connections 2024-09-12T02:47:41.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:41.086+0000 7ff6a7e00640 1 --2- 172.21.15.112:0/3476036637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6a015a5d0 0x7ff6a00b4ad0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:41.086+0000 7ff6a7e00640 1 --2- 172.21.15.112:0/3476036637 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6a00731c0 0x7ff6a0135060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:41.086+0000 7ff6a7e00640 1 --2- 172.21.15.112:0/3476036637 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff68006be30 0x7ff68006e2f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:41.086+0000 7ff6a7e00640 1 --2- 172.21.15.112:0/3476036637 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6a006c110 0x7ff6a0134560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:41.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:41.086+0000 7ff6a7e00640 1 -- 172.21.15.112:0/3476036637 >> 172.21.15.112:0/3476036637 conn(0x7ff6a006cce0 msgr2=0x7ff6a00d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:41.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:41.087+0000 7ff6a7e00640 1 -- 172.21.15.112:0/3476036637 shutdown_connections 2024-09-12T02:47:41.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:41.087+0000 7ff6a7e00640 1 -- 172.21.15.112:0/3476036637 wait complete. 2024-09-12T02:47:41.104 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json osdmap barrier 123 2024-09-12T02:47:41.276 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2024-09-12T02:47:41.277 DEBUG:teuthology.orchestra.run.smithi112:> stdin-killer -- python3 -c ' 2024-09-12T02:47:41.277 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-12T02:47:41.277 DEBUG:teuthology.orchestra.run.smithi112:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-12T02:47:41.277 DEBUG:teuthology.orchestra.run.smithi112:> os.fchmod(fd, 0O666) 2024-09-12T02:47:41.277 DEBUG:teuthology.orchestra.run.smithi112:> os.fsync(fd) 2024-09-12T02:47:41.277 DEBUG:teuthology.orchestra.run.smithi112:> os.close(fd) 2024-09-12T02:47:41.277 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-12T02:47:41.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:47:41.391 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:47:41.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:47:41.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:47:41.520 INFO:teuthology.orchestra.run.smithi112.stdout:client5711 2024-09-12T02:47:41.521 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/7c01f3b3-dec2-4449-a33f-f960d7527ea6.client5711/osdmap') 2024-09-12T02:47:41.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:47:41.618 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 123 barrier 123 flags 0x588000 2024-09-12T02:47:41.619 INFO:teuthology.orchestra.run.smithi112.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-12T02:47:41.619 INFO:teuthology.orchestra.run.smithi112.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-12T02:47:41.619 INFO:teuthology.orchestra.run.smithi112.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-12T02:47:41.619 INFO:teuthology.orchestra.run.smithi112.stdout:osd0 (2)172.21.15.112:6800 100% (exists, up) 100% -1 2024-09-12T02:47:41.619 INFO:teuthology.orchestra.run.smithi112.stdout:osd1 (2)172.21.15.112:6808 100% (exists, up) 100% -1 2024-09-12T02:47:41.619 INFO:teuthology.orchestra.run.smithi112.stdout:osd2 (2)172.21.15.112:6816 100% (exists, up) 100% -1 2024-09-12T02:47:41.619 INFO:teuthology.orchestra.run.smithi112.stdout:osd3 (2)172.21.15.112:6824 100% (exists, up) 100% -1 2024-09-12T02:47:41.619 INFO:teuthology.orchestra.run.smithi112.stdout:osd4 (2)172.21.15.137:6800 100% (exists, up) 100% -1 2024-09-12T02:47:41.619 INFO:teuthology.orchestra.run.smithi112.stdout:osd5 (2)172.21.15.137:6808 100% (exists, up) 100% -1 2024-09-12T02:47:41.619 INFO:teuthology.orchestra.run.smithi112.stdout:osd6 (2)172.21.15.137:6813 100% (exists, up) 100% -1 2024-09-12T02:47:41.619 INFO:teuthology.orchestra.run.smithi112.stdout:osd7 (2)172.21.15.137:6824 100% (exists, up) 100% -1 2024-09-12T02:47:41.620 INFO:teuthology.orchestra.run.smithi112.stderr:1+1 records in 2024-09-12T02:47:41.620 INFO:teuthology.orchestra.run.smithi112.stderr:1+1 records out 2024-09-12T02:47:41.620 INFO:teuthology.orchestra.run.smithi112.stderr:803 bytes copied, 9.5737e-05 s, 8.4 MB/s 2024-09-12T02:47:41.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:47:41.629 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:47:41.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:47:41.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:47:41.717 INFO:teuthology.orchestra.run.smithi112.stdout:client5711 2024-09-12T02:47:41.718 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/7c01f3b3-dec2-4449-a33f-f960d7527ea6.client5711/osdmap') 2024-09-12T02:47:41.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:47:41.816 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 123 barrier 123 flags 0x588000 2024-09-12T02:47:41.816 INFO:teuthology.orchestra.run.smithi112.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-12T02:47:41.817 INFO:teuthology.orchestra.run.smithi112.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-12T02:47:41.817 INFO:teuthology.orchestra.run.smithi112.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-12T02:47:41.817 INFO:teuthology.orchestra.run.smithi112.stdout:osd0 (2)172.21.15.112:6800 100% (exists, up) 100% -1 2024-09-12T02:47:41.817 INFO:teuthology.orchestra.run.smithi112.stdout:osd1 (2)172.21.15.112:6808 100% (exists, up) 100% -1 2024-09-12T02:47:41.817 INFO:teuthology.orchestra.run.smithi112.stdout:osd2 (2)172.21.15.112:6816 100% (exists, up) 100% -1 2024-09-12T02:47:41.817 INFO:teuthology.orchestra.run.smithi112.stdout:osd3 (2)172.21.15.112:6824 100% (exists, up) 100% -1 2024-09-12T02:47:41.817 INFO:teuthology.orchestra.run.smithi112.stdout:osd4 (2)172.21.15.137:6800 100% (exists, up) 100% -1 2024-09-12T02:47:41.817 INFO:teuthology.orchestra.run.smithi112.stdout:osd5 (2)172.21.15.137:6808 100% (exists, up) 100% -1 2024-09-12T02:47:41.817 INFO:teuthology.orchestra.run.smithi112.stdout:osd6 (2)172.21.15.137:6813 100% (exists, up) 100% -1 2024-09-12T02:47:41.817 INFO:teuthology.orchestra.run.smithi112.stdout:osd7 (2)172.21.15.137:6824 100% (exists, up) 100% -1 2024-09-12T02:47:41.817 INFO:teuthology.orchestra.run.smithi112.stderr:1+1 records in 2024-09-12T02:47:41.818 INFO:teuthology.orchestra.run.smithi112.stderr:1+1 records out 2024-09-12T02:47:41.818 INFO:teuthology.orchestra.run.smithi112.stderr:803 bytes copied, 6.5859e-05 s, 12.2 MB/s 2024-09-12T02:47:41.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:47:41.827 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:47:41.827 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:47:41.827 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:47:41.911 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:47:42.001 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:47:42.001 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:47:42.001 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:47:42.001 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:47:42.038 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:47:42.038 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:47:42.114 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:47:42.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.307+0000 7f9492800640 1 Processor -- start 2024-09-12T02:47:42.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.307+0000 7f9492800640 1 -- start start 2024-09-12T02:47:42.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.309+0000 7f9492800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f948c15a450 0x7f948c06e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:42.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.309+0000 7f9492800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f948c0ce460 0x7f948c0d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:42.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.309+0000 7f9492800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f948c15db60 0x7f948c0d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:42.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.309+0000 7f9492800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f948c071eb0 con 0x7f948c15db60 2024-09-12T02:47:42.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.309+0000 7f9492800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f948c06e990 con 0x7f948c15a450 2024-09-12T02:47:42.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.309+0000 7f9492800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f948c06ec70 con 0x7f948c0ce460 2024-09-12T02:47:42.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.309+0000 7f9491e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f948c15db60 0x7f948c0d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:42.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.309+0000 7f9491e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f948c15db60 0x7f948c0d0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38568/0 (socket says 172.21.15.112:38568) 2024-09-12T02:47:42.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.309+0000 7f9491e00640 1 -- 172.21.15.112:0/2795288630 learned_addr learned my addr 172.21.15.112:0/2795288630 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:42.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.309+0000 7f9491e00640 1 -- 172.21.15.112:0/2795288630 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f948c0ce460 msgr2=0x7f948c0d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:42.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.309+0000 7f9491e00640 1 --2- 172.21.15.112:0/2795288630 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f948c0ce460 0x7f948c0d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:42.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.309+0000 7f9491e00640 1 -- 172.21.15.112:0/2795288630 >> v2:172.21.15.137:3300/0 conn(0x7f948c15a450 msgr2=0x7f948c06e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:42.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.309+0000 7f9491e00640 1 --2- 172.21.15.112:0/2795288630 >> v2:172.21.15.137:3300/0 conn(0x7f948c15a450 0x7f948c06e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:42.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.309+0000 7f9491e00640 1 -- 172.21.15.112:0/2795288630 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f948c072100 con 0x7f948c15db60 2024-09-12T02:47:42.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.310+0000 7f9491e00640 1 --2- 172.21.15.112:0/2795288630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f948c15db60 0x7f948c0d0d60 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f948c068760 tx=0x7f948402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f85435f05ff579e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:42.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.311+0000 7f948be00640 1 -- 172.21.15.112:0/2795288630 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9484036070 con 0x7f948c15db60 2024-09-12T02:47:42.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.311+0000 7f948be00640 1 -- 172.21.15.112:0/2795288630 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9484031600 con 0x7f948c15db60 2024-09-12T02:47:42.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.311+0000 7f948be00640 1 -- 172.21.15.112:0/2795288630 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94840319d0 con 0x7f948c15db60 2024-09-12T02:47:42.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.311+0000 7f9492800640 1 -- 172.21.15.112:0/2795288630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f948c15db60 msgr2=0x7f948c0d0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:42.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.311+0000 7f9492800640 1 --2- 172.21.15.112:0/2795288630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f948c15db60 0x7f948c0d0d60 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f948c068760 tx=0x7f948402a730 comp rx=0 tx=0).stop 2024-09-12T02:47:42.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.311+0000 7f9492800640 1 -- 172.21.15.112:0/2795288630 shutdown_connections 2024-09-12T02:47:42.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.311+0000 7f9492800640 1 --2- 172.21.15.112:0/2795288630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f948c15db60 0x7f948c0d0d60 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:42.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.311+0000 7f9492800640 1 --2- 172.21.15.112:0/2795288630 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f948c0ce460 0x7f948c0d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:42.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.311+0000 7f9492800640 1 --2- 172.21.15.112:0/2795288630 >> v2:172.21.15.137:3300/0 conn(0x7f948c15a450 0x7f948c06e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:42.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.311+0000 7f9492800640 1 -- 172.21.15.112:0/2795288630 >> 172.21.15.112:0/2795288630 conn(0x7f948c06bbd0 msgr2=0x7f948c06bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:42.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.311+0000 7f9492800640 1 -- 172.21.15.112:0/2795288630 shutdown_connections 2024-09-12T02:47:42.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.311+0000 7f9492800640 1 -- 172.21.15.112:0/2795288630 wait complete. 2024-09-12T02:47:42.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.313+0000 7f9492800640 1 Processor -- start 2024-09-12T02:47:42.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.313+0000 7f9492800640 1 -- start start 2024-09-12T02:47:42.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.314+0000 7f9492800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f948c0ce460 0x7f948c1529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:42.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.314+0000 7f9492800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f948c15a450 0x7f948c14fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:42.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.314+0000 7f9492800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f948c15db60 0x7f948c1f55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:42.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.314+0000 7f9492800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f948c15a830 con 0x7f948c0ce460 2024-09-12T02:47:42.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.314+0000 7f9492800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f948c06e680 con 0x7f948c15db60 2024-09-12T02:47:42.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.314+0000 7f9492800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f948c160510 con 0x7f948c15a450 2024-09-12T02:47:42.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.314+0000 7f9491400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f948c0ce460 0x7f948c1529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:42.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.314+0000 7f9491400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f948c0ce460 0x7f948c1529b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38572/0 (socket says 172.21.15.112:38572) 2024-09-12T02:47:42.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.314+0000 7f9491400640 1 -- 172.21.15.112:0/1310020372 learned_addr learned my addr 172.21.15.112:0/1310020372 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:42.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.314+0000 7f9490a00640 1 --2- 172.21.15.112:0/1310020372 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f948c15a450 0x7f948c14fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:42.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.314+0000 7f9491e00640 1 --2- 172.21.15.112:0/1310020372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f948c15db60 0x7f948c1f55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:42.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.314+0000 7f9491400640 1 -- 172.21.15.112:0/1310020372 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f948c15a450 msgr2=0x7f948c14fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:42.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.314+0000 7f9491400640 1 --2- 172.21.15.112:0/1310020372 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f948c15a450 0x7f948c14fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:42.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.314+0000 7f9491400640 1 -- 172.21.15.112:0/1310020372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f948c15db60 msgr2=0x7f948c1f55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:42.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.314+0000 7f9491400640 1 --2- 172.21.15.112:0/1310020372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f948c15db60 0x7f948c1f55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:42.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.314+0000 7f9491400640 1 -- 172.21.15.112:0/1310020372 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f948c1533c0 con 0x7f948c0ce460 2024-09-12T02:47:42.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.315+0000 7f9490a00640 1 --2- 172.21.15.112:0/1310020372 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f948c15a450 0x7f948c14fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:42.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.315+0000 7f9491e00640 1 --2- 172.21.15.112:0/1310020372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f948c15db60 0x7f948c1f55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:42.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.315+0000 7f9491400640 1 --2- 172.21.15.112:0/1310020372 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f948c0ce460 0x7f948c1529b0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f948000b4d0 tx=0x7f948000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:42.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.315+0000 7f9489600640 1 -- 172.21.15.112:0/1310020372 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9480014070 con 0x7f948c0ce460 2024-09-12T02:47:42.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.315+0000 7f9489600640 1 -- 172.21.15.112:0/1310020372 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9480010870 con 0x7f948c0ce460 2024-09-12T02:47:42.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.315+0000 7f9489600640 1 -- 172.21.15.112:0/1310020372 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9480010c60 con 0x7f948c0ce460 2024-09-12T02:47:42.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.315+0000 7f9492800640 1 -- 172.21.15.112:0/1310020372 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f948c1536a0 con 0x7f948c0ce460 2024-09-12T02:47:42.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.315+0000 7f9492800640 1 -- 172.21.15.112:0/1310020372 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f948c1f50b0 con 0x7f948c0ce460 2024-09-12T02:47:42.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.316+0000 7f9492800640 1 -- 172.21.15.112:0/1310020372 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f948c153bc0 con 0x7f948c0ce460 2024-09-12T02:47:42.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.317+0000 7f9489600640 1 -- 172.21.15.112:0/1310020372 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9480017070 con 0x7f948c0ce460 2024-09-12T02:47:42.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.318+0000 7f9489600640 1 --2- 172.21.15.112:0/1310020372 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f946c06be30 0x7f946c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:42.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.318+0000 7f9489600640 1 -- 172.21.15.112:0/1310020372 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f948008ad60 con 0x7f948c0ce460 2024-09-12T02:47:42.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.318+0000 7f9490a00640 1 --2- 172.21.15.112:0/1310020372 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f946c06be30 0x7f946c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:42.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.319+0000 7f9490a00640 1 --2- 172.21.15.112:0/1310020372 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f946c06be30 0x7f946c06e2f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9478006fd0 tx=0x7f9478008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:42.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.322+0000 7f9489600640 1 -- 172.21.15.112:0/1310020372 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9480059670 con 0x7f948c0ce460 2024-09-12T02:47:42.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.507+0000 7f9492800640 1 -- 172.21.15.112:0/1310020372 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f948c06e140 con 0x7f948c0ce460 2024-09-12T02:47:42.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.508+0000 7f9489600640 1 -- 172.21.15.112:0/1310020372 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v123) ==== 80+0+0 (secure 0 0 0) 0x7f9480058f70 con 0x7f948c0ce460 2024-09-12T02:47:42.509 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-12T02:47:42.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.510+0000 7f9492800640 1 -- 172.21.15.112:0/1310020372 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f946c06be30 msgr2=0x7f946c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:42.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.510+0000 7f9492800640 1 --2- 172.21.15.112:0/1310020372 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f946c06be30 0x7f946c06e2f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9478006fd0 tx=0x7f9478008040 comp rx=0 tx=0).stop 2024-09-12T02:47:42.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.510+0000 7f9492800640 1 -- 172.21.15.112:0/1310020372 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f948c0ce460 msgr2=0x7f948c1529b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:42.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.510+0000 7f9492800640 1 --2- 172.21.15.112:0/1310020372 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f948c0ce460 0x7f948c1529b0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f948000b4d0 tx=0x7f948000b990 comp rx=0 tx=0).stop 2024-09-12T02:47:42.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.510+0000 7f9492800640 1 -- 172.21.15.112:0/1310020372 shutdown_connections 2024-09-12T02:47:42.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.510+0000 7f9492800640 1 --2- 172.21.15.112:0/1310020372 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f946c06be30 0x7f946c06e2f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:42.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.510+0000 7f9492800640 1 --2- 172.21.15.112:0/1310020372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f948c15db60 0x7f948c1f55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:42.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.510+0000 7f9492800640 1 --2- 172.21.15.112:0/1310020372 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f948c15a450 0x7f948c14fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:42.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.510+0000 7f9492800640 1 --2- 172.21.15.112:0/1310020372 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f948c0ce460 0x7f948c1529b0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:42.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.510+0000 7f9492800640 1 -- 172.21.15.112:0/1310020372 >> 172.21.15.112:0/1310020372 conn(0x7f948c06bbd0 msgr2=0x7f948c0d0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:42.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.510+0000 7f9492800640 1 -- 172.21.15.112:0/1310020372 shutdown_connections 2024-09-12T02:47:42.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.510+0000 7f9492800640 1 -- 172.21.15.112:0/1310020372 wait complete. 2024-09-12T02:47:42.527 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:47:42.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:47:42.527 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T02:47:42.608 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-12T02:47:42.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:47:42.608 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:47:42.654 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:47:42.693 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:47:42.694 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:47:42.731 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:47:42.732 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:47:42.808 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:47:42.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.961+0000 7feecdc00640 1 Processor -- start 2024-09-12T02:47:42.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.961+0000 7feecdc00640 1 -- start start 2024-09-12T02:47:42.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.962+0000 7feecdc00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7feec815b9d0 0x7feec80b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:42.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.962+0000 7feecdc00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feec80b54a0 con 0x7feec80b45d0 2024-09-12T02:47:42.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.962+0000 7feecdc00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feec80b3af0 con 0x7feec806f600 2024-09-12T02:47:42.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.962+0000 7feecdc00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7feec80b4a60 con 0x7feec815b9d0 2024-09-12T02:47:42.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.963+0000 7feec6000640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7feec80b45d0 0x7feec806eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36388/0 (socket says 172.21.15.112:36388) 2024-09-12T02:47:42.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.963+0000 7feec6000640 1 -- 172.21.15.112:0/1287760719 learned_addr learned my addr 172.21.15.112:0/1287760719 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:42.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.963+0000 7feec6a00640 1 --2- 172.21.15.112:0/1287760719 >> v2:172.21.15.137:3300/0 conn(0x7feec815b9d0 0x7feec80b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:42.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.963+0000 7feec5600640 1 -- 172.21.15.112:0/1287760719 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1611606016 0 0) 0x7feec80b54a0 con 0x7feec80b45d0 2024-09-12T02:47:42.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.963+0000 7feec5600640 1 -- 172.21.15.112:0/1287760719 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feeac005730 con 0x7feec80b45d0 2024-09-12T02:47:42.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.963+0000 7feec5600640 1 -- 172.21.15.112:0/1287760719 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4042011516 0 0) 0x7feec80b3af0 con 0x7feec806f600 2024-09-12T02:47:42.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.963+0000 7feec5600640 1 -- 172.21.15.112:0/1287760719 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feec80b54a0 con 0x7feec806f600 2024-09-12T02:47:42.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.963+0000 7feec6a00640 1 -- 172.21.15.112:0/1287760719 >> v1:172.21.15.137:6789/0 conn(0x7feec806f600 legacy=0x7feec80cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:42.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.963+0000 7feec6a00640 1 -- 172.21.15.112:0/1287760719 >> v1:172.21.15.112:6789/0 conn(0x7feec80b45d0 legacy=0x7feec806eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:42.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.963+0000 7feec6a00640 1 -- 172.21.15.112:0/1287760719 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec80b3dd0 con 0x7feec815b9d0 2024-09-12T02:47:42.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.964+0000 7feec6a00640 1 --2- 172.21.15.112:0/1287760719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feec815b9d0 0x7feec80b4ec0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7feeb80097a0 tx=0x7feeb802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc1234b24e3db344 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:42.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.965+0000 7feec5600640 1 -- 172.21.15.112:0/1287760719 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb8037070 con 0x7feec815b9d0 2024-09-12T02:47:42.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.965+0000 7feec5600640 1 -- 172.21.15.112:0/1287760719 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeb8032440 con 0x7feec815b9d0 2024-09-12T02:47:42.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.965+0000 7feec5600640 1 -- 172.21.15.112:0/1287760719 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb80327f0 con 0x7feec815b9d0 2024-09-12T02:47:42.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.965+0000 7feecdc00640 1 -- 172.21.15.112:0/1287760719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feec815b9d0 msgr2=0x7feec80b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:42.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.965+0000 7feecdc00640 1 --2- 172.21.15.112:0/1287760719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feec815b9d0 0x7feec80b4ec0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7feeb80097a0 tx=0x7feeb802a1a0 comp rx=0 tx=0).stop 2024-09-12T02:47:42.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.965+0000 7feecdc00640 1 -- 172.21.15.112:0/1287760719 shutdown_connections 2024-09-12T02:47:42.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.965+0000 7feecdc00640 1 --2- 172.21.15.112:0/1287760719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feec815b9d0 0x7feec80b4ec0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:42.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.965+0000 7feecdc00640 1 -- 172.21.15.112:0/1287760719 >> 172.21.15.112:0/1287760719 conn(0x7feec806bbd0 msgr2=0x7feec806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:42.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.965+0000 7feecdc00640 1 -- 172.21.15.112:0/1287760719 shutdown_connections 2024-09-12T02:47:42.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.965+0000 7feecdc00640 1 -- 172.21.15.112:0/1287760719 wait complete. 2024-09-12T02:47:42.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.967+0000 7feecdc00640 1 Processor -- start 2024-09-12T02:47:42.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.967+0000 7feecdc00640 1 -- start start 2024-09-12T02:47:42.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.968+0000 7feecdc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feec806f600 0x7feec815d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:42.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.968+0000 7feecdc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feec80b45d0 0x7feec80cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:42.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.968+0000 7feecdc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feec815b9d0 0x7feec80c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:42.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.968+0000 7feecdc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7feec815bf30 con 0x7feec815b9d0 2024-09-12T02:47:42.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.968+0000 7feecdc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7feec815bdb0 con 0x7feec80b45d0 2024-09-12T02:47:42.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.968+0000 7feecdc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7feec80728c0 con 0x7feec806f600 2024-09-12T02:47:42.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.968+0000 7feec7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feec815b9d0 0x7feec80c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:42.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.968+0000 7feec7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feec815b9d0 0x7feec80c8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38588/0 (socket says 172.21.15.112:38588) 2024-09-12T02:47:42.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.968+0000 7feec6a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feec806f600 0x7feec815d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:42.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.968+0000 7feec7400640 1 -- 172.21.15.112:0/883964694 learned_addr learned my addr 172.21.15.112:0/883964694 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:42.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.968+0000 7feec6000640 1 --2- 172.21.15.112:0/883964694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feec80b45d0 0x7feec80cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:42.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.969+0000 7feec7400640 1 -- 172.21.15.112:0/883964694 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feec806f600 msgr2=0x7feec815d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:42.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.969+0000 7feec7400640 1 --2- 172.21.15.112:0/883964694 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feec806f600 0x7feec815d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:42.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.969+0000 7feec7400640 1 -- 172.21.15.112:0/883964694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feec80b45d0 msgr2=0x7feec80cc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:42.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.969+0000 7feec7400640 1 --2- 172.21.15.112:0/883964694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feec80b45d0 0x7feec80cc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:42.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.969+0000 7feec7400640 1 -- 172.21.15.112:0/883964694 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec80c7580 con 0x7feec815b9d0 2024-09-12T02:47:42.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.969+0000 7feec7400640 1 --2- 172.21.15.112:0/883964694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feec815b9d0 0x7feec80c8cf0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7feec000c790 tx=0x7feec000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:42.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.971+0000 7feebea00640 1 -- 172.21.15.112:0/883964694 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec0003b70 con 0x7feec815b9d0 2024-09-12T02:47:42.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.971+0000 7feebea00640 1 -- 172.21.15.112:0/883964694 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feec0003d10 con 0x7feec815b9d0 2024-09-12T02:47:42.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.971+0000 7feecdc00640 1 -- 172.21.15.112:0/883964694 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feec815db50 con 0x7feec815b9d0 2024-09-12T02:47:42.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.971+0000 7feebea00640 1 -- 172.21.15.112:0/883964694 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec000aa50 con 0x7feec815b9d0 2024-09-12T02:47:42.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.971+0000 7feecdc00640 1 -- 172.21.15.112:0/883964694 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feec815e110 con 0x7feec815b9d0 2024-09-12T02:47:42.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.972+0000 7feecdc00640 1 -- 172.21.15.112:0/883964694 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feec8068a30 con 0x7feec815b9d0 2024-09-12T02:47:42.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.973+0000 7feebea00640 1 -- 172.21.15.112:0/883964694 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feec000abf0 con 0x7feec815b9d0 2024-09-12T02:47:42.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.974+0000 7feebea00640 1 --2- 172.21.15.112:0/883964694 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7feea806be30 0x7feea806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:42.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.974+0000 7feebea00640 1 -- 172.21.15.112:0/883964694 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7feec008ac50 con 0x7feec815b9d0 2024-09-12T02:47:42.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.974+0000 7feec6a00640 1 --2- 172.21.15.112:0/883964694 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7feea806be30 0x7feea806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:42.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.975+0000 7feec6a00640 1 --2- 172.21.15.112:0/883964694 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7feea806be30 0x7feea806e2f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7feeb8034000 tx=0x7feeb802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:42.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:42.979+0000 7feebea00640 1 -- 172.21.15.112:0/883964694 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feec0090020 con 0x7feec815b9d0 2024-09-12T02:47:43.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.163+0000 7feecdc00640 1 -- 172.21.15.112:0/883964694 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7feec8072c50 con 0x7feec815b9d0 2024-09-12T02:47:43.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.163+0000 7feebea00640 1 -- 172.21.15.112:0/883964694 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v123) ==== 80+0+0 (secure 0 0 0) 0x7feec0059040 con 0x7feec815b9d0 2024-09-12T02:47:43.164 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-12T02:47:43.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.165+0000 7feecdc00640 1 -- 172.21.15.112:0/883964694 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7feea806be30 msgr2=0x7feea806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:43.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.166+0000 7feecdc00640 1 --2- 172.21.15.112:0/883964694 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7feea806be30 0x7feea806e2f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7feeb8034000 tx=0x7feeb802e000 comp rx=0 tx=0).stop 2024-09-12T02:47:43.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.166+0000 7feecdc00640 1 -- 172.21.15.112:0/883964694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feec815b9d0 msgr2=0x7feec80c8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:43.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.166+0000 7feecdc00640 1 --2- 172.21.15.112:0/883964694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feec815b9d0 0x7feec80c8cf0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7feec000c790 tx=0x7feec000cc50 comp rx=0 tx=0).stop 2024-09-12T02:47:43.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.166+0000 7feecdc00640 1 -- 172.21.15.112:0/883964694 shutdown_connections 2024-09-12T02:47:43.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.166+0000 7feecdc00640 1 --2- 172.21.15.112:0/883964694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feec815b9d0 0x7feec80c8cf0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:43.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.166+0000 7feecdc00640 1 --2- 172.21.15.112:0/883964694 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7feea806be30 0x7feea806e2f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:43.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.166+0000 7feecdc00640 1 --2- 172.21.15.112:0/883964694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feec80b45d0 0x7feec80cc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:43.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.166+0000 7feecdc00640 1 --2- 172.21.15.112:0/883964694 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feec806f600 0x7feec815d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:43.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.166+0000 7feecdc00640 1 -- 172.21.15.112:0/883964694 >> 172.21.15.112:0/883964694 conn(0x7feec806bbd0 msgr2=0x7feec80b06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:43.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.166+0000 7feecdc00640 1 -- 172.21.15.112:0/883964694 shutdown_connections 2024-09-12T02:47:43.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.166+0000 7feecdc00640 1 -- 172.21.15.112:0/883964694 wait complete. 2024-09-12T02:47:43.182 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-12T02:47:43.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:47:43.182 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-12T02:47:43.248 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T02:47:43.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:47:43.248 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T02:47:43.285 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:47:43.285 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:47:43.285 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:47:43.321 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:47:43.321 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:47:43.321 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:47:43.321 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:47:43.360 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:47:43.360 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:47:43.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.512+0000 7f453ae00640 1 Processor -- start 2024-09-12T02:47:43.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.512+0000 7f453ae00640 1 -- start start 2024-09-12T02:47:43.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.514+0000 7f453ae00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f453415b9d0 0x7f45340b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:43.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.514+0000 7f453ae00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f45340b45d0 0x7f45340728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:43.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.514+0000 7f453ae00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f453406eef0 0x7f453406f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:43.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.514+0000 7f453ae00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f45340b4a60 con 0x7f45340b45d0 2024-09-12T02:47:43.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.514+0000 7f453ae00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f453406f860 con 0x7f453415b9d0 2024-09-12T02:47:43.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.514+0000 7f453ae00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f45340b54a0 con 0x7f453406eef0 2024-09-12T02:47:43.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.514+0000 7f4533400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f45340b45d0 0x7f45340728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:43.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.514+0000 7f4533400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f45340b45d0 0x7f45340728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38600/0 (socket says 172.21.15.112:38600) 2024-09-12T02:47:43.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.514+0000 7f4533400640 1 -- 172.21.15.112:0/145160411 learned_addr learned my addr 172.21.15.112:0/145160411 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:43.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.514+0000 7f4533400640 1 -- 172.21.15.112:0/145160411 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f453406eef0 msgr2=0x7f453406f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:43.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.514+0000 7f4533400640 1 --2- 172.21.15.112:0/145160411 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f453406eef0 0x7f453406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:43.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.514+0000 7f4533400640 1 -- 172.21.15.112:0/145160411 >> v2:172.21.15.137:3300/0 conn(0x7f453415b9d0 msgr2=0x7f45340b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:43.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.514+0000 7f4533400640 1 --2- 172.21.15.112:0/145160411 >> v2:172.21.15.137:3300/0 conn(0x7f453415b9d0 0x7f45340b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:43.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.514+0000 7f4533400640 1 -- 172.21.15.112:0/145160411 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45340b3af0 con 0x7f45340b45d0 2024-09-12T02:47:43.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.515+0000 7f4533400640 1 --2- 172.21.15.112:0/145160411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45340b45d0 0x7f45340728c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f453406d230 tx=0x7f452002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5a491b2582f5a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:43.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.516+0000 7f4532a00640 1 -- 172.21.15.112:0/145160411 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4520004030 con 0x7f45340b45d0 2024-09-12T02:47:43.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.516+0000 7f4532a00640 1 -- 172.21.15.112:0/145160411 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45200041d0 con 0x7f45340b45d0 2024-09-12T02:47:43.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.516+0000 7f4532a00640 1 -- 172.21.15.112:0/145160411 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4520003610 con 0x7f45340b45d0 2024-09-12T02:47:43.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.516+0000 7f453ae00640 1 -- 172.21.15.112:0/145160411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45340b45d0 msgr2=0x7f45340728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:43.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.516+0000 7f453ae00640 1 --2- 172.21.15.112:0/145160411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45340b45d0 0x7f45340728c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f453406d230 tx=0x7f452002a1e0 comp rx=0 tx=0).stop 2024-09-12T02:47:43.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.516+0000 7f453ae00640 1 -- 172.21.15.112:0/145160411 shutdown_connections 2024-09-12T02:47:43.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.516+0000 7f453ae00640 1 --2- 172.21.15.112:0/145160411 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f453406eef0 0x7f453406f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:43.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.516+0000 7f453ae00640 1 --2- 172.21.15.112:0/145160411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45340b45d0 0x7f45340728c0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:43.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.516+0000 7f453ae00640 1 --2- 172.21.15.112:0/145160411 >> v2:172.21.15.137:3300/0 conn(0x7f453415b9d0 0x7f45340b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:43.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.516+0000 7f453ae00640 1 -- 172.21.15.112:0/145160411 >> 172.21.15.112:0/145160411 conn(0x7f453406bbd0 msgr2=0x7f453406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:43.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.516+0000 7f453ae00640 1 -- 172.21.15.112:0/145160411 shutdown_connections 2024-09-12T02:47:43.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.516+0000 7f453ae00640 1 -- 172.21.15.112:0/145160411 wait complete. 2024-09-12T02:47:43.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.518+0000 7f453ae00640 1 Processor -- start 2024-09-12T02:47:43.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.518+0000 7f453ae00640 1 -- start start 2024-09-12T02:47:43.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.519+0000 7f453ae00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f453406eef0 0x7f45341f8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:43.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.519+0000 7f453ae00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45340b45d0 0x7f453415c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:43.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.519+0000 7f453ae00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f453415b9d0 0x7f45340cf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:43.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.519+0000 7f453ae00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f453415bdb0 con 0x7f453415b9d0 2024-09-12T02:47:43.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.519+0000 7f453ae00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f45340b40b0 con 0x7f45340b45d0 2024-09-12T02:47:43.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.519+0000 7f453ae00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f453415bf30 con 0x7f453406eef0 2024-09-12T02:47:43.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.519+0000 7f4538e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f453415b9d0 0x7f45340cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:43.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.519+0000 7f4538e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f453415b9d0 0x7f45340cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38604/0 (socket says 172.21.15.112:38604) 2024-09-12T02:47:43.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.519+0000 7f4538e00640 1 -- 172.21.15.112:0/1170687690 learned_addr learned my addr 172.21.15.112:0/1170687690 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:43.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.520+0000 7f4533e00640 1 --2- 172.21.15.112:0/1170687690 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f453406eef0 0x7f45341f8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:43.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.520+0000 7f4533400640 1 --2- 172.21.15.112:0/1170687690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45340b45d0 0x7f453415c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:43.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.520+0000 7f4538e00640 1 -- 172.21.15.112:0/1170687690 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f453406eef0 msgr2=0x7f45341f8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:43.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.520+0000 7f4538e00640 1 --2- 172.21.15.112:0/1170687690 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f453406eef0 0x7f45341f8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:43.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.520+0000 7f4538e00640 1 -- 172.21.15.112:0/1170687690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45340b45d0 msgr2=0x7f453415c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:43.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.520+0000 7f4538e00640 1 --2- 172.21.15.112:0/1170687690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45340b45d0 0x7f453415c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:43.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.520+0000 7f4538e00640 1 -- 172.21.15.112:0/1170687690 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45340cfc60 con 0x7f453415b9d0 2024-09-12T02:47:43.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.520+0000 7f4538e00640 1 --2- 172.21.15.112:0/1170687690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f453415b9d0 0x7f45340cf720 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f452c00b970 tx=0x7f452c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:43.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.520+0000 7f452be00640 1 -- 172.21.15.112:0/1170687690 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452c019070 con 0x7f453415b9d0 2024-09-12T02:47:43.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.520+0000 7f452be00640 1 -- 172.21.15.112:0/1170687690 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f452c00cb60 con 0x7f453415b9d0 2024-09-12T02:47:43.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.520+0000 7f453ae00640 1 -- 172.21.15.112:0/1170687690 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45341f9630 con 0x7f453415b9d0 2024-09-12T02:47:43.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.520+0000 7f452be00640 1 -- 172.21.15.112:0/1170687690 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452c014440 con 0x7f453415b9d0 2024-09-12T02:47:43.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.520+0000 7f453ae00640 1 -- 172.21.15.112:0/1170687690 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45341f9070 con 0x7f453415b9d0 2024-09-12T02:47:43.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.522+0000 7f453ae00640 1 -- 172.21.15.112:0/1170687690 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4534068a30 con 0x7f453415b9d0 2024-09-12T02:47:43.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.522+0000 7f452be00640 1 -- 172.21.15.112:0/1170687690 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f452c01c070 con 0x7f453415b9d0 2024-09-12T02:47:43.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.523+0000 7f452be00640 1 --2- 172.21.15.112:0/1170687690 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f451406be30 0x7f451406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:43.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.523+0000 7f452be00640 1 -- 172.21.15.112:0/1170687690 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f452c08abd0 con 0x7f453415b9d0 2024-09-12T02:47:43.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.524+0000 7f4533e00640 1 --2- 172.21.15.112:0/1170687690 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f451406be30 0x7f451406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:43.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.524+0000 7f4533e00640 1 --2- 172.21.15.112:0/1170687690 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f451406be30 0x7f451406e2f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4534072be0 tx=0x7f4524008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:43.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.527+0000 7f452be00640 1 -- 172.21.15.112:0/1170687690 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f452c059570 con 0x7f453415b9d0 2024-09-12T02:47:43.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.739+0000 7f453ae00640 1 -- 172.21.15.112:0/1170687690 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45340b1f70 con 0x7f453415b9d0 2024-09-12T02:47:43.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.740+0000 7f452be00640 1 -- 172.21.15.112:0/1170687690 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5231 (secure 0 0 0) 0x7f452c058e70 con 0x7f453415b9d0 2024-09-12T02:47:43.741 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:43.741 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":62,"btime":"2024-09-12T02:47:30:715299+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5612,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/3181313801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3181313801},{"type":"v1","addr":"172.21.15.137:6834","nonce":3181313801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":5615,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2025494075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2025494075},{"type":"v1","addr":"172.21.15.137:6835","nonce":2025494075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6501,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3739674039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3739674039},{"type":"v1","addr":"172.21.15.112:6837","nonce":3739674039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:47:27.076883+0000","modified":"2024-09-12T02:47:30.117205+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6504},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6504":{"gid":6504,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/63450161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":63450161},{"type":"v1","addr":"172.21.15.112:6836","nonce":63450161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6504,"qdb_cluster":[6504]},"id":7}]} 2024-09-12T02:47:43.741 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 62 2024-09-12T02:47:43.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.742+0000 7f453ae00640 1 -- 172.21.15.112:0/1170687690 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f451406be30 msgr2=0x7f451406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:43.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.742+0000 7f453ae00640 1 --2- 172.21.15.112:0/1170687690 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f451406be30 0x7f451406e2f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4534072be0 tx=0x7f4524008040 comp rx=0 tx=0).stop 2024-09-12T02:47:43.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.742+0000 7f453ae00640 1 -- 172.21.15.112:0/1170687690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f453415b9d0 msgr2=0x7f45340cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:43.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.742+0000 7f453ae00640 1 --2- 172.21.15.112:0/1170687690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f453415b9d0 0x7f45340cf720 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f452c00b970 tx=0x7f452c00be30 comp rx=0 tx=0).stop 2024-09-12T02:47:43.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.742+0000 7f453ae00640 1 -- 172.21.15.112:0/1170687690 shutdown_connections 2024-09-12T02:47:43.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.742+0000 7f453ae00640 1 --2- 172.21.15.112:0/1170687690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f453415b9d0 0x7f45340cf720 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:43.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.742+0000 7f453ae00640 1 --2- 172.21.15.112:0/1170687690 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f451406be30 0x7f451406e2f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:43.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.742+0000 7f453ae00640 1 --2- 172.21.15.112:0/1170687690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45340b45d0 0x7f453415c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:43.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.742+0000 7f453ae00640 1 --2- 172.21.15.112:0/1170687690 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f453406eef0 0x7f45341f8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:43.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.742+0000 7f453ae00640 1 -- 172.21.15.112:0/1170687690 >> 172.21.15.112:0/1170687690 conn(0x7f453406bbd0 msgr2=0x7f45341581b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:43.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.742+0000 7f453ae00640 1 -- 172.21.15.112:0/1170687690 shutdown_connections 2024-09-12T02:47:43.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.742+0000 7f453ae00640 1 -- 172.21.15.112:0/1170687690 wait complete. 2024-09-12T02:47:43.760 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:47:43.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.912+0000 7f6ec4e00640 1 Processor -- start 2024-09-12T02:47:43.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.912+0000 7f6ec4e00640 1 -- start start 2024-09-12T02:47:43.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.913+0000 7f6ec4e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6ec015ed60 0x7f6ec006d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:43.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.913+0000 7f6ec4e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ec006da10 0x7f6ec00af900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:43.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.913+0000 7f6ec4e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ec00b0960 con 0x7f6ec00afe40 2024-09-12T02:47:43.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.913+0000 7f6ec4e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f6ec006de60 con 0x7f6ec006da10 2024-09-12T02:47:43.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.913+0000 7f6ec4e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6ec00b3c10 con 0x7f6ec015ed60 2024-09-12T02:47:43.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.913+0000 7f6eb6a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ec006da10 0x7f6ec00af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:43.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.913+0000 7f6eb6a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ec006da10 0x7f6ec00af900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38620/0 (socket says 172.21.15.112:38620) 2024-09-12T02:47:43.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.913+0000 7f6eb6a00640 1 -- 172.21.15.112:0/3520959512 learned_addr learned my addr 172.21.15.112:0/3520959512 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:43.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.914+0000 7f6ebf400640 1 --2- 172.21.15.112:0/3520959512 >> v2:172.21.15.137:3300/0 conn(0x7f6ec015ed60 0x7f6ec006d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:43.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.914+0000 7f6eb6a00640 1 -- 172.21.15.112:0/3520959512 >> v2:172.21.15.137:3300/0 conn(0x7f6ec015ed60 msgr2=0x7f6ec006d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:43.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.914+0000 7f6eb6a00640 1 --2- 172.21.15.112:0/3520959512 >> v2:172.21.15.137:3300/0 conn(0x7f6ec015ed60 0x7f6ec006d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:43.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.914+0000 7f6eb6a00640 1 -- 172.21.15.112:0/3520959512 >> v1:172.21.15.112:6789/0 conn(0x7f6ec00afe40 legacy=0x7f6ec00b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:43.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.914+0000 7f6eb6a00640 1 -- 172.21.15.112:0/3520959512 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec00b3000 con 0x7f6ec006da10 2024-09-12T02:47:43.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.914+0000 7f6ebea00640 1 -- 172.21.15.112:0/3520959512 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 32770196 0 0) 0x7f6ec00b0960 con 0x7f6ec00afe40 2024-09-12T02:47:43.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.915+0000 7f6eb6a00640 1 --2- 172.21.15.112:0/3520959512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ec006da10 0x7f6ec00af900 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f6ec00b56b0 tx=0x7f6ea802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c6b7504f3f223b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:43.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.915+0000 7f6ebea00640 1 -- 172.21.15.112:0/3520959512 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8036070 con 0x7f6ec006da10 2024-09-12T02:47:43.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.915+0000 7f6ebea00640 1 -- 172.21.15.112:0/3520959512 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ea8031600 con 0x7f6ec006da10 2024-09-12T02:47:43.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.915+0000 7f6ebea00640 1 -- 172.21.15.112:0/3520959512 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea80319d0 con 0x7f6ec006da10 2024-09-12T02:47:43.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.916+0000 7f6ec4e00640 1 -- 172.21.15.112:0/3520959512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ec006da10 msgr2=0x7f6ec00af900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:43.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.916+0000 7f6ec4e00640 1 --2- 172.21.15.112:0/3520959512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ec006da10 0x7f6ec00af900 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f6ec00b56b0 tx=0x7f6ea802a730 comp rx=0 tx=0).stop 2024-09-12T02:47:43.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.916+0000 7f6ec4e00640 1 -- 172.21.15.112:0/3520959512 shutdown_connections 2024-09-12T02:47:43.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.916+0000 7f6ec4e00640 1 --2- 172.21.15.112:0/3520959512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ec006da10 0x7f6ec00af900 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:43.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.916+0000 7f6ec4e00640 1 --2- 172.21.15.112:0/3520959512 >> v2:172.21.15.137:3300/0 conn(0x7f6ec015ed60 0x7f6ec006d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:43.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.916+0000 7f6ec4e00640 1 -- 172.21.15.112:0/3520959512 >> 172.21.15.112:0/3520959512 conn(0x7f6ec00b7e80 msgr2=0x7f6ec00b8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:43.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.916+0000 7f6ec4e00640 1 -- 172.21.15.112:0/3520959512 shutdown_connections 2024-09-12T02:47:43.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.916+0000 7f6ec4e00640 1 -- 172.21.15.112:0/3520959512 wait complete. 2024-09-12T02:47:43.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.917+0000 7f6ec4e00640 1 Processor -- start 2024-09-12T02:47:43.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.918+0000 7f6ec4e00640 1 -- start start 2024-09-12T02:47:43.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.918+0000 7f6ec4e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ec006da10 0x7f6ec0152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:43.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.918+0000 7f6ec4e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ec00afe40 0x7f6ec0160c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:43.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.919+0000 7f6ec4e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ec015ed60 0x7f6ec0161150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:43.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.919+0000 7f6ec4e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec00b38a0 con 0x7f6ec006da10 2024-09-12T02:47:43.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.919+0000 7f6ec4e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec00b35c0 con 0x7f6ec015ed60 2024-09-12T02:47:43.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.919+0000 7f6ec4e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6ec006e270 con 0x7f6ec00afe40 2024-09-12T02:47:43.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.919+0000 7f6ebf400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ec006da10 0x7f6ec0152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:43.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.919+0000 7f6ebf400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ec006da10 0x7f6ec0152170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38630/0 (socket says 172.21.15.112:38630) 2024-09-12T02:47:43.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.919+0000 7f6ebf400640 1 -- 172.21.15.112:0/2076176514 learned_addr learned my addr 172.21.15.112:0/2076176514 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:43.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.919+0000 7f6eb6a00640 1 --2- 172.21.15.112:0/2076176514 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ec00afe40 0x7f6ec0160c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:43.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.919+0000 7f6ebfe00640 1 --2- 172.21.15.112:0/2076176514 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ec015ed60 0x7f6ec0161150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:43.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.919+0000 7f6ebf400640 1 -- 172.21.15.112:0/2076176514 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ec00afe40 msgr2=0x7f6ec0160c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:43.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.919+0000 7f6ebf400640 1 --2- 172.21.15.112:0/2076176514 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ec00afe40 0x7f6ec0160c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:43.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.919+0000 7f6ebf400640 1 -- 172.21.15.112:0/2076176514 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ec015ed60 msgr2=0x7f6ec0161150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:43.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.919+0000 7f6ebf400640 1 --2- 172.21.15.112:0/2076176514 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ec015ed60 0x7f6ec0161150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:43.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.919+0000 7f6ebf400640 1 -- 172.21.15.112:0/2076176514 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec01f53a0 con 0x7f6ec006da10 2024-09-12T02:47:43.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.919+0000 7f6ebf400640 1 --2- 172.21.15.112:0/2076176514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ec006da10 0x7f6ec0152170 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f6eb000d800 tx=0x7f6eb000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:43.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.920+0000 7f6eb7e00640 1 -- 172.21.15.112:0/2076176514 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb000b6c0 con 0x7f6ec006da10 2024-09-12T02:47:43.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.920+0000 7f6eb7e00640 1 -- 172.21.15.112:0/2076176514 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eb0019070 con 0x7f6ec006da10 2024-09-12T02:47:43.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.920+0000 7f6eb7e00640 1 -- 172.21.15.112:0/2076176514 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb000ba80 con 0x7f6ec006da10 2024-09-12T02:47:43.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.920+0000 7f6ec4e00640 1 -- 172.21.15.112:0/2076176514 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ec01f5680 con 0x7f6ec006da10 2024-09-12T02:47:43.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.920+0000 7f6ec4e00640 1 -- 172.21.15.112:0/2076176514 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ec00cc060 con 0x7f6ec006da10 2024-09-12T02:47:43.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.921+0000 7f6ec4e00640 1 -- 172.21.15.112:0/2076176514 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ec00b40a0 con 0x7f6ec006da10 2024-09-12T02:47:43.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.922+0000 7f6eb7e00640 1 -- 172.21.15.112:0/2076176514 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6eb000bc20 con 0x7f6ec006da10 2024-09-12T02:47:43.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.923+0000 7f6eb7e00640 1 --2- 172.21.15.112:0/2076176514 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6e9c06be30 0x7f6e9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:43.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.923+0000 7f6eb7e00640 1 -- 172.21.15.112:0/2076176514 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f6eb008b3d0 con 0x7f6ec006da10 2024-09-12T02:47:43.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.923+0000 7f6eb6a00640 1 --2- 172.21.15.112:0/2076176514 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6e9c06be30 0x7f6e9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:43.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.924+0000 7f6eb6a00640 1 --2- 172.21.15.112:0/2076176514 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6e9c06be30 0x7f6e9c06e2f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8033000 tx=0x7f6ea8009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:43.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:43.927+0000 7f6eb7e00640 1 -- 172.21.15.112:0/2076176514 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6eb0059ce0 con 0x7f6ec006da10 2024-09-12T02:47:44.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.135+0000 7f6ec4e00640 1 -- 172.21.15.112:0/2076176514 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ec00b70d0 con 0x7f6ec006da10 2024-09-12T02:47:44.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.135+0000 7f6eb7e00640 1 -- 172.21.15.112:0/2076176514 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5231 (secure 0 0 0) 0x7f6eb00595e0 con 0x7f6ec006da10 2024-09-12T02:47:44.136 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:44.136 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":62,"btime":"2024-09-12T02:47:30:715299+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5612,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/3181313801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3181313801},{"type":"v1","addr":"172.21.15.137:6834","nonce":3181313801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":5615,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2025494075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2025494075},{"type":"v1","addr":"172.21.15.137:6835","nonce":2025494075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6501,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3739674039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3739674039},{"type":"v1","addr":"172.21.15.112:6837","nonce":3739674039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:47:27.076883+0000","modified":"2024-09-12T02:47:30.117205+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6504},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6504":{"gid":6504,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/63450161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":63450161},{"type":"v1","addr":"172.21.15.112:6836","nonce":63450161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6504,"qdb_cluster":[6504]},"id":7}]} 2024-09-12T02:47:44.137 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 62 2024-09-12T02:47:44.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.138+0000 7f6ec4e00640 1 -- 172.21.15.112:0/2076176514 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6e9c06be30 msgr2=0x7f6e9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:44.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.138+0000 7f6ec4e00640 1 --2- 172.21.15.112:0/2076176514 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6e9c06be30 0x7f6e9c06e2f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8033000 tx=0x7f6ea8009000 comp rx=0 tx=0).stop 2024-09-12T02:47:44.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.138+0000 7f6ec4e00640 1 -- 172.21.15.112:0/2076176514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ec006da10 msgr2=0x7f6ec0152170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:44.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.138+0000 7f6ec4e00640 1 --2- 172.21.15.112:0/2076176514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ec006da10 0x7f6ec0152170 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f6eb000d800 tx=0x7f6eb000dcc0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.138+0000 7f6ec4e00640 1 -- 172.21.15.112:0/2076176514 shutdown_connections 2024-09-12T02:47:44.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.138+0000 7f6ec4e00640 1 --2- 172.21.15.112:0/2076176514 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6e9c06be30 0x7f6e9c06e2f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.138+0000 7f6ec4e00640 1 --2- 172.21.15.112:0/2076176514 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ec015ed60 0x7f6ec0161150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.138+0000 7f6ec4e00640 1 --2- 172.21.15.112:0/2076176514 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ec00afe40 0x7f6ec0160c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.138+0000 7f6ec4e00640 1 --2- 172.21.15.112:0/2076176514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ec006da10 0x7f6ec0152170 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.138+0000 7f6ec4e00640 1 -- 172.21.15.112:0/2076176514 >> 172.21.15.112:0/2076176514 conn(0x7f6ec00b7e80 msgr2=0x7f6ec00b75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:44.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.138+0000 7f6ec4e00640 1 -- 172.21.15.112:0/2076176514 shutdown_connections 2024-09-12T02:47:44.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.138+0000 7f6ec4e00640 1 -- 172.21.15.112:0/2076176514 wait complete. 2024-09-12T02:47:44.155 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:47:44.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.306+0000 7fd3eca00640 1 Processor -- start 2024-09-12T02:47:44.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.306+0000 7fd3eca00640 1 -- start start 2024-09-12T02:47:44.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.307+0000 7fd3eca00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd3e815a450 0x7fd3e806e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.307+0000 7fd3eca00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd3e80d0f30 0x7fd3e8072900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.307+0000 7fd3eca00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3e806e990 con 0x7fd3e80ce460 2024-09-12T02:47:44.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.307+0000 7fd3eca00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd3e8071eb0 con 0x7fd3e815a450 2024-09-12T02:47:44.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.307+0000 7fd3eca00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd3e806ec70 con 0x7fd3e80d0f30 2024-09-12T02:47:44.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.307+0000 7fd3dea00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd3e80ce460 0x7fd3e80d0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36406/0 (socket says 172.21.15.112:36406) 2024-09-12T02:47:44.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.307+0000 7fd3dea00640 1 -- 172.21.15.112:0/1300643063 learned_addr learned my addr 172.21.15.112:0/1300643063 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:44.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.307+0000 7fd3e7e00640 1 --2- 172.21.15.112:0/1300643063 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd3e80d0f30 0x7fd3e8072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.307+0000 7fd3e7400640 1 --2- 172.21.15.112:0/1300643063 >> v2:172.21.15.137:3300/0 conn(0x7fd3e815a450 0x7fd3e806e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.308+0000 7fd3e6a00640 1 -- 172.21.15.112:0/1300643063 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3108287915 0 0) 0x7fd3e806e990 con 0x7fd3e80ce460 2024-09-12T02:47:44.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.308+0000 7fd3e6a00640 1 -- 172.21.15.112:0/1300643063 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3cc003520 con 0x7fd3e80ce460 2024-09-12T02:47:44.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.308+0000 7fd3e7400640 1 -- 172.21.15.112:0/1300643063 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd3e80d0f30 msgr2=0x7fd3e8072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:44.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.308+0000 7fd3e7400640 1 --2- 172.21.15.112:0/1300643063 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd3e80d0f30 0x7fd3e8072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.308+0000 7fd3e7400640 1 -- 172.21.15.112:0/1300643063 >> v1:172.21.15.112:6789/0 conn(0x7fd3e80ce460 legacy=0x7fd3e80d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:44.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.308+0000 7fd3e7400640 1 -- 172.21.15.112:0/1300643063 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e8072100 con 0x7fd3e815a450 2024-09-12T02:47:44.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.308+0000 7fd3e7e00640 1 --2- 172.21.15.112:0/1300643063 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd3e80d0f30 0x7fd3e8072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:44.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.309+0000 7fd3e7400640 1 --2- 172.21.15.112:0/1300643063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3e815a450 0x7fd3e806e140 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd3d80097a0 tx=0x7fd3d802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7670463bb093a39 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:44.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.309+0000 7fd3e6a00640 1 -- 172.21.15.112:0/1300643063 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8037070 con 0x7fd3e815a450 2024-09-12T02:47:44.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.309+0000 7fd3e6a00640 1 -- 172.21.15.112:0/1300643063 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d8032440 con 0x7fd3e815a450 2024-09-12T02:47:44.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.309+0000 7fd3e6a00640 1 -- 172.21.15.112:0/1300643063 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8032810 con 0x7fd3e815a450 2024-09-12T02:47:44.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.310+0000 7fd3eca00640 1 -- 172.21.15.112:0/1300643063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3e815a450 msgr2=0x7fd3e806e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:44.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.310+0000 7fd3eca00640 1 --2- 172.21.15.112:0/1300643063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3e815a450 0x7fd3e806e140 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd3d80097a0 tx=0x7fd3d802a230 comp rx=0 tx=0).stop 2024-09-12T02:47:44.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.310+0000 7fd3eca00640 1 -- 172.21.15.112:0/1300643063 shutdown_connections 2024-09-12T02:47:44.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.310+0000 7fd3eca00640 1 --2- 172.21.15.112:0/1300643063 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd3e80d0f30 0x7fd3e8072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.310+0000 7fd3eca00640 1 --2- 172.21.15.112:0/1300643063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3e815a450 0x7fd3e806e140 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.310+0000 7fd3eca00640 1 -- 172.21.15.112:0/1300643063 >> 172.21.15.112:0/1300643063 conn(0x7fd3e806bbd0 msgr2=0x7fd3e806bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:44.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.310+0000 7fd3eca00640 1 -- 172.21.15.112:0/1300643063 shutdown_connections 2024-09-12T02:47:44.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.310+0000 7fd3eca00640 1 -- 172.21.15.112:0/1300643063 wait complete. 2024-09-12T02:47:44.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.312+0000 7fd3eca00640 1 Processor -- start 2024-09-12T02:47:44.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.312+0000 7fd3eca00640 1 -- start start 2024-09-12T02:47:44.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.313+0000 7fd3eca00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd3e80ce460 0x7fd3e8140240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.313+0000 7fd3eca00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3e80d0f30 0x7fd3e8154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.313+0000 7fd3eca00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3e815a450 0x7fd3e81566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.313+0000 7fd3eca00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e815a830 con 0x7fd3e80d0f30 2024-09-12T02:47:44.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.313+0000 7fd3eca00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e806e680 con 0x7fd3e815a450 2024-09-12T02:47:44.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.313+0000 7fd3eca00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd3e815db60 con 0x7fd3e80ce460 2024-09-12T02:47:44.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.313+0000 7fd3dea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3e80d0f30 0x7fd3e8154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.313+0000 7fd3e7400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd3e80ce460 0x7fd3e8140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.313+0000 7fd3dea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3e80d0f30 0x7fd3e8154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38636/0 (socket says 172.21.15.112:38636) 2024-09-12T02:47:44.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.313+0000 7fd3e7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3e815a450 0x7fd3e81566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.313+0000 7fd3dea00640 1 -- 172.21.15.112:0/311853222 learned_addr learned my addr 172.21.15.112:0/311853222 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:44.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.313+0000 7fd3dea00640 1 -- 172.21.15.112:0/311853222 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd3e80ce460 msgr2=0x7fd3e8140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:44.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.313+0000 7fd3dea00640 1 --2- 172.21.15.112:0/311853222 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd3e80ce460 0x7fd3e8140240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.313+0000 7fd3dea00640 1 -- 172.21.15.112:0/311853222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3e815a450 msgr2=0x7fd3e81566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:44.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.313+0000 7fd3dea00640 1 --2- 172.21.15.112:0/311853222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3e815a450 0x7fd3e81566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.314+0000 7fd3dea00640 1 -- 172.21.15.112:0/311853222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e81553b0 con 0x7fd3e80d0f30 2024-09-12T02:47:44.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.314+0000 7fd3dea00640 1 --2- 172.21.15.112:0/311853222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3e80d0f30 0x7fd3e8154a10 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fd3d000c430 tx=0x7fd3d000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:44.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.314+0000 7fd3dfe00640 1 -- 172.21.15.112:0/311853222 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0017070 con 0x7fd3e80d0f30 2024-09-12T02:47:44.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.314+0000 7fd3dfe00640 1 -- 172.21.15.112:0/311853222 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d0005ce0 con 0x7fd3e80d0f30 2024-09-12T02:47:44.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.314+0000 7fd3eca00640 1 -- 172.21.15.112:0/311853222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3e8155690 con 0x7fd3e80d0f30 2024-09-12T02:47:44.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.314+0000 7fd3dfe00640 1 -- 172.21.15.112:0/311853222 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0007310 con 0x7fd3e80d0f30 2024-09-12T02:47:44.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.314+0000 7fd3eca00640 1 -- 172.21.15.112:0/311853222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3e8150d00 con 0x7fd3e80d0f30 2024-09-12T02:47:44.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.315+0000 7fd3eca00640 1 -- 172.21.15.112:0/311853222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3e806e140 con 0x7fd3e80d0f30 2024-09-12T02:47:44.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.316+0000 7fd3dfe00640 1 -- 172.21.15.112:0/311853222 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd3d001a070 con 0x7fd3e80d0f30 2024-09-12T02:47:44.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.317+0000 7fd3dfe00640 1 --2- 172.21.15.112:0/311853222 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd3c406be30 0x7fd3c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.317+0000 7fd3dfe00640 1 -- 172.21.15.112:0/311853222 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7fd3d008a1c0 con 0x7fd3e80d0f30 2024-09-12T02:47:44.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.317+0000 7fd3e7400640 1 --2- 172.21.15.112:0/311853222 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd3c406be30 0x7fd3c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.318+0000 7fd3e7400640 1 --2- 172.21.15.112:0/311853222 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd3c406be30 0x7fd3c406e2f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8034000 tx=0x7fd3d802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:44.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.321+0000 7fd3dfe00640 1 -- 172.21.15.112:0/311853222 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd3d0058490 con 0x7fd3e80d0f30 2024-09-12T02:47:44.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.495+0000 7fd3eca00640 1 -- 172.21.15.112:0/311853222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3e80cc9b0 con 0x7fd3e80d0f30 2024-09-12T02:47:44.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.496+0000 7fd3dfe00640 1 -- 172.21.15.112:0/311853222 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) ==== 74+0+16735 (secure 0 0 0) 0x7fd3d005c790 con 0x7fd3e80d0f30 2024-09-12T02:47:44.497 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:44.497 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":123,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:47:39.960522+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:47:24.847347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-12T02:47:26.073460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:47:44.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.498+0000 7fd3eca00640 1 -- 172.21.15.112:0/311853222 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd3c406be30 msgr2=0x7fd3c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:44.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.498+0000 7fd3eca00640 1 --2- 172.21.15.112:0/311853222 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd3c406be30 0x7fd3c406e2f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8034000 tx=0x7fd3d802e000 comp rx=0 tx=0).stop 2024-09-12T02:47:44.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.498+0000 7fd3eca00640 1 -- 172.21.15.112:0/311853222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3e80d0f30 msgr2=0x7fd3e8154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:44.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.498+0000 7fd3eca00640 1 --2- 172.21.15.112:0/311853222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3e80d0f30 0x7fd3e8154a10 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fd3d000c430 tx=0x7fd3d000c830 comp rx=0 tx=0).stop 2024-09-12T02:47:44.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.498+0000 7fd3eca00640 1 -- 172.21.15.112:0/311853222 shutdown_connections 2024-09-12T02:47:44.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.498+0000 7fd3eca00640 1 --2- 172.21.15.112:0/311853222 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd3c406be30 0x7fd3c406e2f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.498+0000 7fd3eca00640 1 --2- 172.21.15.112:0/311853222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3e815a450 0x7fd3e81566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.498+0000 7fd3eca00640 1 --2- 172.21.15.112:0/311853222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3e80d0f30 0x7fd3e8154a10 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.498+0000 7fd3eca00640 1 --2- 172.21.15.112:0/311853222 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd3e80ce460 0x7fd3e8140240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.498+0000 7fd3eca00640 1 -- 172.21.15.112:0/311853222 >> 172.21.15.112:0/311853222 conn(0x7fd3e806bbd0 msgr2=0x7fd3e806c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:44.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.498+0000 7fd3eca00640 1 -- 172.21.15.112:0/311853222 shutdown_connections 2024-09-12T02:47:44.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.498+0000 7fd3eca00640 1 -- 172.21.15.112:0/311853222 wait complete. 2024-09-12T02:47:44.515 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:47:44.515 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:47:44.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.667+0000 7f2e27200640 1 Processor -- start 2024-09-12T02:47:44.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.667+0000 7f2e27200640 1 -- start start 2024-09-12T02:47:44.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.668+0000 7f2e27200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2e20071530 0x7f2e200af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.668+0000 7f2e27200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2e200719a0 0x7f2e200afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.668+0000 7f2e27200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e200ceeb0 con 0x7f2e2015cc50 2024-09-12T02:47:44.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.668+0000 7f2e27200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2e2015d030 con 0x7f2e200719a0 2024-09-12T02:47:44.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.668+0000 7f2e27200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2e200cf4c0 con 0x7f2e20071530 2024-09-12T02:47:44.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.669+0000 7f2e25200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2e200719a0 0x7f2e200afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.669+0000 7f2e25200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2e200719a0 0x7f2e200afc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38650/0 (socket says 172.21.15.112:38650) 2024-09-12T02:47:44.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.669+0000 7f2e25200640 1 -- 172.21.15.112:0/993766087 learned_addr learned my addr 172.21.15.112:0/993766087 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:44.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.669+0000 7f2e1f400640 1 --2- 172.21.15.112:0/993766087 >> v2:172.21.15.137:3300/0 conn(0x7f2e20071530 0x7f2e200af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.669+0000 7f2e25200640 1 -- 172.21.15.112:0/993766087 >> v2:172.21.15.137:3300/0 conn(0x7f2e20071530 msgr2=0x7f2e200af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:44.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.669+0000 7f2e25200640 1 --2- 172.21.15.112:0/993766087 >> v2:172.21.15.137:3300/0 conn(0x7f2e20071530 0x7f2e200af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.669+0000 7f2e25200640 1 -- 172.21.15.112:0/993766087 >> v1:172.21.15.137:6789/0 conn(0x7f2e2015cc50 legacy=0x7f2e200732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:44.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.669+0000 7f2e25200640 1 -- 172.21.15.112:0/993766087 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e2006e300 con 0x7f2e200719a0 2024-09-12T02:47:44.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.669+0000 7f2e1f400640 1 --2- 172.21.15.112:0/993766087 >> v2:172.21.15.137:3300/0 conn(0x7f2e20071530 0x7f2e200af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:44.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.670+0000 7f2e25200640 1 --2- 172.21.15.112:0/993766087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e200719a0 0x7f2e200afc60 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f2e200cf640 tx=0x7f2e1802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b288f6d9b1f1d4f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:44.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.670+0000 7f2e1ea00640 1 -- 172.21.15.112:0/993766087 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e18037070 con 0x7f2e200719a0 2024-09-12T02:47:44.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.670+0000 7f2e1ea00640 1 -- 172.21.15.112:0/993766087 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e18032440 con 0x7f2e200719a0 2024-09-12T02:47:44.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.670+0000 7f2e1ea00640 1 -- 172.21.15.112:0/993766087 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e18032810 con 0x7f2e200719a0 2024-09-12T02:47:44.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.671+0000 7f2e27200640 1 -- 172.21.15.112:0/993766087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e200719a0 msgr2=0x7f2e200afc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:44.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.671+0000 7f2e27200640 1 --2- 172.21.15.112:0/993766087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e200719a0 0x7f2e200afc60 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f2e200cf640 tx=0x7f2e1802a180 comp rx=0 tx=0).stop 2024-09-12T02:47:44.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.671+0000 7f2e27200640 1 -- 172.21.15.112:0/993766087 shutdown_connections 2024-09-12T02:47:44.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.671+0000 7f2e27200640 1 --2- 172.21.15.112:0/993766087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e200719a0 0x7f2e200afc60 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.671+0000 7f2e27200640 1 --2- 172.21.15.112:0/993766087 >> v2:172.21.15.137:3300/0 conn(0x7f2e20071530 0x7f2e200af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.671+0000 7f2e27200640 1 -- 172.21.15.112:0/993766087 >> 172.21.15.112:0/993766087 conn(0x7f2e2006bbd0 msgr2=0x7f2e2006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:44.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.671+0000 7f2e27200640 1 -- 172.21.15.112:0/993766087 shutdown_connections 2024-09-12T02:47:44.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.671+0000 7f2e27200640 1 -- 172.21.15.112:0/993766087 wait complete. 2024-09-12T02:47:44.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.673+0000 7f2e27200640 1 Processor -- start 2024-09-12T02:47:44.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.673+0000 7f2e27200640 1 -- start start 2024-09-12T02:47:44.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.674+0000 7f2e27200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e20071530 0x7f2e201495f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.674+0000 7f2e27200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e200719a0 0x7f2e20152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.674+0000 7f2e27200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e2015cc50 0x7f2e20149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.674+0000 7f2e27200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2006f510 con 0x7f2e20071530 2024-09-12T02:47:44.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.674+0000 7f2e27200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2e200cf150 con 0x7f2e2015cc50 2024-09-12T02:47:44.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.674+0000 7f2e27200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2e2006f690 con 0x7f2e200719a0 2024-09-12T02:47:44.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.674+0000 7f2e1fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e20071530 0x7f2e201495f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.674+0000 7f2e1fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e20071530 0x7f2e201495f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38658/0 (socket says 172.21.15.112:38658) 2024-09-12T02:47:44.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.674+0000 7f2e1fe00640 1 -- 172.21.15.112:0/3384661464 learned_addr learned my addr 172.21.15.112:0/3384661464 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:44.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.674+0000 7f2e1f400640 1 --2- 172.21.15.112:0/3384661464 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e200719a0 0x7f2e20152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.674+0000 7f2e25200640 1 --2- 172.21.15.112:0/3384661464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e2015cc50 0x7f2e20149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.674+0000 7f2e1fe00640 1 -- 172.21.15.112:0/3384661464 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e200719a0 msgr2=0x7f2e20152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:44.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.674+0000 7f2e1fe00640 1 --2- 172.21.15.112:0/3384661464 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e200719a0 0x7f2e20152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.674+0000 7f2e1fe00640 1 -- 172.21.15.112:0/3384661464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e2015cc50 msgr2=0x7f2e20149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:44.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.674+0000 7f2e1fe00640 1 --2- 172.21.15.112:0/3384661464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e2015cc50 0x7f2e20149fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.674+0000 7f2e1fe00640 1 -- 172.21.15.112:0/3384661464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e20150da0 con 0x7f2e20071530 2024-09-12T02:47:44.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.674+0000 7f2e25200640 1 --2- 172.21.15.112:0/3384661464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e2015cc50 0x7f2e20149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:44.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.675+0000 7f2e1fe00640 1 --2- 172.21.15.112:0/3384661464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e20071530 0x7f2e201495f0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f2e1000ba80 tx=0x7f2e1000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:44.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.675+0000 7f2e17e00640 1 -- 172.21.15.112:0/3384661464 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e1000cc00 con 0x7f2e20071530 2024-09-12T02:47:44.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.675+0000 7f2e17e00640 1 -- 172.21.15.112:0/3384661464 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e1000cda0 con 0x7f2e20071530 2024-09-12T02:47:44.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.675+0000 7f2e17e00640 1 -- 172.21.15.112:0/3384661464 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e10003bb0 con 0x7f2e20071530 2024-09-12T02:47:44.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.675+0000 7f2e27200640 1 -- 172.21.15.112:0/3384661464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e20151080 con 0x7f2e20071530 2024-09-12T02:47:44.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.675+0000 7f2e27200640 1 -- 172.21.15.112:0/3384661464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e20151640 con 0x7f2e20071530 2024-09-12T02:47:44.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.676+0000 7f2e27200640 1 -- 172.21.15.112:0/3384661464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e20068a30 con 0x7f2e20071530 2024-09-12T02:47:44.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.677+0000 7f2e17e00640 1 -- 172.21.15.112:0/3384661464 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e10014440 con 0x7f2e20071530 2024-09-12T02:47:44.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.678+0000 7f2e17e00640 1 --2- 172.21.15.112:0/3384661464 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2e0006be30 0x7f2e0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.678+0000 7f2e17e00640 1 -- 172.21.15.112:0/3384661464 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f2e1008add0 con 0x7f2e20071530 2024-09-12T02:47:44.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.678+0000 7f2e1f400640 1 --2- 172.21.15.112:0/3384661464 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2e0006be30 0x7f2e0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.679+0000 7f2e1f400640 1 --2- 172.21.15.112:0/3384661464 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2e0006be30 0x7f2e0006e2f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c006fd0 tx=0x7f2e0c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:44.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.682+0000 7f2e17e00640 1 -- 172.21.15.112:0/3384661464 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e10059770 con 0x7f2e20071530 2024-09-12T02:47:44.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.888+0000 7f2e27200640 1 -- 172.21.15.112:0/3384661464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e200730d0 con 0x7f2e20071530 2024-09-12T02:47:44.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.889+0000 7f2e17e00640 1 -- 172.21.15.112:0/3384661464 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5231 (secure 0 0 0) 0x7f2e10059070 con 0x7f2e20071530 2024-09-12T02:47:44.890 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:44.890 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":62,"btime":"2024-09-12T02:47:30:715299+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5612,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/3181313801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3181313801},{"type":"v1","addr":"172.21.15.137:6834","nonce":3181313801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":5615,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2025494075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2025494075},{"type":"v1","addr":"172.21.15.137:6835","nonce":2025494075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6501,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3739674039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3739674039},{"type":"v1","addr":"172.21.15.112:6837","nonce":3739674039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:47:27.076883+0000","modified":"2024-09-12T02:47:30.117205+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6504},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6504":{"gid":6504,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/63450161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":63450161},{"type":"v1","addr":"172.21.15.112:6836","nonce":63450161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6504,"qdb_cluster":[6504]},"id":7}]} 2024-09-12T02:47:44.891 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 62 2024-09-12T02:47:44.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.891+0000 7f2e27200640 1 -- 172.21.15.112:0/3384661464 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2e0006be30 msgr2=0x7f2e0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:44.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.891+0000 7f2e27200640 1 --2- 172.21.15.112:0/3384661464 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2e0006be30 0x7f2e0006e2f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c006fd0 tx=0x7f2e0c008040 comp rx=0 tx=0).stop 2024-09-12T02:47:44.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.891+0000 7f2e27200640 1 -- 172.21.15.112:0/3384661464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e20071530 msgr2=0x7f2e201495f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:44.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.891+0000 7f2e27200640 1 --2- 172.21.15.112:0/3384661464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e20071530 0x7f2e201495f0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f2e1000ba80 tx=0x7f2e1000bf40 comp rx=0 tx=0).stop 2024-09-12T02:47:44.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.891+0000 7f2e27200640 1 -- 172.21.15.112:0/3384661464 shutdown_connections 2024-09-12T02:47:44.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.891+0000 7f2e27200640 1 --2- 172.21.15.112:0/3384661464 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2e0006be30 0x7f2e0006e2f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.891+0000 7f2e27200640 1 --2- 172.21.15.112:0/3384661464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e2015cc50 0x7f2e20149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.891+0000 7f2e27200640 1 --2- 172.21.15.112:0/3384661464 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e200719a0 0x7f2e20152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.891+0000 7f2e27200640 1 --2- 172.21.15.112:0/3384661464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e20071530 0x7f2e201495f0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.891+0000 7f2e27200640 1 -- 172.21.15.112:0/3384661464 >> 172.21.15.112:0/3384661464 conn(0x7f2e2006bbd0 msgr2=0x7f2e2006e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:44.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.891+0000 7f2e27200640 1 -- 172.21.15.112:0/3384661464 shutdown_connections 2024-09-12T02:47:44.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:44.891+0000 7f2e27200640 1 -- 172.21.15.112:0/3384661464 wait complete. 2024-09-12T02:47:44.908 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:47:45.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.060+0000 7f5cb6200640 1 Processor -- start 2024-09-12T02:47:45.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.060+0000 7f5cb6200640 1 -- start start 2024-09-12T02:47:45.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.061+0000 7f5cb6200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5cb00ae8d0 0x7f5cb00afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:45.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.061+0000 7f5cb6200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cb00aedd0 con 0x7f5cb006dca0 2024-09-12T02:47:45.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.061+0000 7f5cb6200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cb00af0b0 con 0x7f5cb006d8c0 2024-09-12T02:47:45.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.061+0000 7f5cb6200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f5cb00af390 con 0x7f5cb00ae8d0 2024-09-12T02:47:45.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.062+0000 7f5caea00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5cb00ae8d0 0x7f5cb00afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:45.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.062+0000 7f5caea00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5cb00ae8d0 0x7f5cb00afe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38674/0 (socket says 172.21.15.112:38674) 2024-09-12T02:47:45.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.062+0000 7f5caea00640 1 -- 172.21.15.112:0/2925122844 learned_addr learned my addr 172.21.15.112:0/2925122844 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:45.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.062+0000 7f5caea00640 1 -- 172.21.15.112:0/2925122844 >> v1:172.21.15.137:6789/0 conn(0x7f5cb006d8c0 legacy=0x7f5cb00715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:45.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.062+0000 7f5caea00640 1 -- 172.21.15.112:0/2925122844 >> v1:172.21.15.112:6789/0 conn(0x7f5cb006dca0 legacy=0x7f5cb006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:45.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.062+0000 7f5caea00640 1 -- 172.21.15.112:0/2925122844 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cb00af670 con 0x7f5cb00ae8d0 2024-09-12T02:47:45.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.062+0000 7f5cae000640 1 -- 172.21.15.112:0/2925122844 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1788523060 0 0) 0x7f5cb00aedd0 con 0x7f5cb006dca0 2024-09-12T02:47:45.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.063+0000 7f5caea00640 1 --2- 172.21.15.112:0/2925122844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cb00ae8d0 0x7f5cb00afe70 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c009850 tx=0x7f5c9c02a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc36d373b647ceb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:45.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.063+0000 7f5cae000640 1 -- 172.21.15.112:0/2925122844 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c004230 con 0x7f5cb00ae8d0 2024-09-12T02:47:45.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.063+0000 7f5cae000640 1 -- 172.21.15.112:0/2925122844 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c9c0043d0 con 0x7f5cb00ae8d0 2024-09-12T02:47:45.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.063+0000 7f5cae000640 1 -- 172.21.15.112:0/2925122844 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c003810 con 0x7f5cb00ae8d0 2024-09-12T02:47:45.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.064+0000 7f5cb6200640 1 -- 172.21.15.112:0/2925122844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cb00ae8d0 msgr2=0x7f5cb00afe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:45.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.064+0000 7f5cb6200640 1 --2- 172.21.15.112:0/2925122844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cb00ae8d0 0x7f5cb00afe70 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c009850 tx=0x7f5c9c02a2e0 comp rx=0 tx=0).stop 2024-09-12T02:47:45.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.064+0000 7f5cb6200640 1 -- 172.21.15.112:0/2925122844 shutdown_connections 2024-09-12T02:47:45.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.064+0000 7f5cb6200640 1 --2- 172.21.15.112:0/2925122844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cb00ae8d0 0x7f5cb00afe70 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:45.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.064+0000 7f5cb6200640 1 -- 172.21.15.112:0/2925122844 >> 172.21.15.112:0/2925122844 conn(0x7f5cb006bbd0 msgr2=0x7f5cb006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:45.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.064+0000 7f5cb6200640 1 -- 172.21.15.112:0/2925122844 shutdown_connections 2024-09-12T02:47:45.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.064+0000 7f5cb6200640 1 -- 172.21.15.112:0/2925122844 wait complete. 2024-09-12T02:47:45.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.066+0000 7f5cb6200640 1 Processor -- start 2024-09-12T02:47:45.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.066+0000 7f5cb6200640 1 -- start start 2024-09-12T02:47:45.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.067+0000 7f5cb6200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5cb006d8c0 0x7f5cb01f4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:45.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.067+0000 7f5cb6200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cb006dca0 0x7f5cb0150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:45.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.067+0000 7f5cb6200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cb00ae8d0 0x7f5cb0158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:45.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.067+0000 7f5cb6200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb00b3a60 con 0x7f5cb006dca0 2024-09-12T02:47:45.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.067+0000 7f5cb6200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb00b38e0 con 0x7f5cb00ae8d0 2024-09-12T02:47:45.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.067+0000 7f5cb6200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5cb00b3be0 con 0x7f5cb006d8c0 2024-09-12T02:47:45.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.067+0000 7f5caea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cb006dca0 0x7f5cb0150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:45.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.067+0000 7f5caea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cb006dca0 0x7f5cb0150440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38688/0 (socket says 172.21.15.112:38688) 2024-09-12T02:47:45.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.067+0000 7f5caea00640 1 -- 172.21.15.112:0/1527794311 learned_addr learned my addr 172.21.15.112:0/1527794311 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:45.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.067+0000 7f5cafe00640 1 --2- 172.21.15.112:0/1527794311 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cb00ae8d0 0x7f5cb0158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:45.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.067+0000 7f5caea00640 1 -- 172.21.15.112:0/1527794311 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5cb006d8c0 msgr2=0x7f5cb01f4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:45.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.067+0000 7f5caf400640 1 --2- 172.21.15.112:0/1527794311 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5cb006d8c0 0x7f5cb01f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:45.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.067+0000 7f5caea00640 1 --2- 172.21.15.112:0/1527794311 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5cb006d8c0 0x7f5cb01f4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:45.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.067+0000 7f5caea00640 1 -- 172.21.15.112:0/1527794311 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cb00ae8d0 msgr2=0x7f5cb0158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:45.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.067+0000 7f5caea00640 1 --2- 172.21.15.112:0/1527794311 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cb00ae8d0 0x7f5cb0158ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:45.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.067+0000 7f5caea00640 1 -- 172.21.15.112:0/1527794311 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cb0150980 con 0x7f5cb006dca0 2024-09-12T02:47:45.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.067+0000 7f5cafe00640 1 --2- 172.21.15.112:0/1527794311 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cb00ae8d0 0x7f5cb0158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:45.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.067+0000 7f5caf400640 1 --2- 172.21.15.112:0/1527794311 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5cb006d8c0 0x7f5cb01f4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:45.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.068+0000 7f5caea00640 1 --2- 172.21.15.112:0/1527794311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cb006dca0 0x7f5cb0150440 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c034040 tx=0x7f5c9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:45.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.068+0000 7f5ca7400640 1 -- 172.21.15.112:0/1527794311 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c041030 con 0x7f5cb006dca0 2024-09-12T02:47:45.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.068+0000 7f5ca7400640 1 -- 172.21.15.112:0/1527794311 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c9c003c50 con 0x7f5cb006dca0 2024-09-12T02:47:45.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.068+0000 7f5ca7400640 1 -- 172.21.15.112:0/1527794311 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c003e20 con 0x7f5cb006dca0 2024-09-12T02:47:45.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.068+0000 7f5cb6200640 1 -- 172.21.15.112:0/1527794311 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cb01f5400 con 0x7f5cb006dca0 2024-09-12T02:47:45.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.068+0000 7f5cb6200640 1 -- 172.21.15.112:0/1527794311 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cb01f5ca0 con 0x7f5cb006dca0 2024-09-12T02:47:45.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.069+0000 7f5cb6200640 1 -- 172.21.15.112:0/1527794311 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cb0068a30 con 0x7f5cb006dca0 2024-09-12T02:47:45.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.070+0000 7f5ca7400640 1 -- 172.21.15.112:0/1527794311 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5c9c044070 con 0x7f5cb006dca0 2024-09-12T02:47:45.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.071+0000 7f5ca7400640 1 --2- 172.21.15.112:0/1527794311 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5c9006be30 0x7f5c9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:45.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.071+0000 7f5ca7400640 1 -- 172.21.15.112:0/1527794311 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f5c9c0aba90 con 0x7f5cb006dca0 2024-09-12T02:47:45.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.071+0000 7f5caf400640 1 --2- 172.21.15.112:0/1527794311 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5c9006be30 0x7f5c9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:45.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.071+0000 7f5caf400640 1 --2- 172.21.15.112:0/1527794311 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5c9006be30 0x7f5c9006e2f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5cb01f5f00 tx=0x7f5ca0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:45.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.075+0000 7f5ca7400640 1 -- 172.21.15.112:0/1527794311 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5c9c07a3a0 con 0x7f5cb006dca0 2024-09-12T02:47:45.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.285+0000 7f5cb6200640 1 -- 172.21.15.112:0/1527794311 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5cb0068a30 con 0x7f5cb006dca0 2024-09-12T02:47:45.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.286+0000 7f5ca7400640 1 -- 172.21.15.112:0/1527794311 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5231 (secure 0 0 0) 0x7f5c9c079ca0 con 0x7f5cb006dca0 2024-09-12T02:47:45.288 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:45.288 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":62,"btime":"2024-09-12T02:47:30:715299+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5612,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/3181313801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3181313801},{"type":"v1","addr":"172.21.15.137:6834","nonce":3181313801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":5615,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2025494075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2025494075},{"type":"v1","addr":"172.21.15.137:6835","nonce":2025494075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6501,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3739674039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3739674039},{"type":"v1","addr":"172.21.15.112:6837","nonce":3739674039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:47:27.076883+0000","modified":"2024-09-12T02:47:30.117205+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6504},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6504":{"gid":6504,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/63450161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":63450161},{"type":"v1","addr":"172.21.15.112:6836","nonce":63450161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6504,"qdb_cluster":[6504]},"id":7}]} 2024-09-12T02:47:45.289 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 62 2024-09-12T02:47:45.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.288+0000 7f5cb6200640 1 -- 172.21.15.112:0/1527794311 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5c9006be30 msgr2=0x7f5c9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:45.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.288+0000 7f5cb6200640 1 --2- 172.21.15.112:0/1527794311 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5c9006be30 0x7f5c9006e2f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5cb01f5f00 tx=0x7f5ca0009040 comp rx=0 tx=0).stop 2024-09-12T02:47:45.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.288+0000 7f5cb6200640 1 -- 172.21.15.112:0/1527794311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cb006dca0 msgr2=0x7f5cb0150440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:45.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.288+0000 7f5cb6200640 1 --2- 172.21.15.112:0/1527794311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cb006dca0 0x7f5cb0150440 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c034040 tx=0x7f5c9c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:47:45.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.288+0000 7f5cb6200640 1 -- 172.21.15.112:0/1527794311 shutdown_connections 2024-09-12T02:47:45.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.288+0000 7f5cb6200640 1 --2- 172.21.15.112:0/1527794311 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5c9006be30 0x7f5c9006e2f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:45.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.288+0000 7f5cb6200640 1 --2- 172.21.15.112:0/1527794311 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cb00ae8d0 0x7f5cb0158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:45.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.288+0000 7f5cb6200640 1 --2- 172.21.15.112:0/1527794311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cb006dca0 0x7f5cb0150440 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:45.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.288+0000 7f5cb6200640 1 --2- 172.21.15.112:0/1527794311 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5cb006d8c0 0x7f5cb01f4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:45.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.288+0000 7f5cb6200640 1 -- 172.21.15.112:0/1527794311 >> 172.21.15.112:0/1527794311 conn(0x7f5cb006bbd0 msgr2=0x7f5cb006e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:45.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.288+0000 7f5cb6200640 1 -- 172.21.15.112:0/1527794311 shutdown_connections 2024-09-12T02:47:45.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.288+0000 7f5cb6200640 1 -- 172.21.15.112:0/1527794311 wait complete. 2024-09-12T02:47:45.306 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:47:45.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.456+0000 7f1fa3400640 1 Processor -- start 2024-09-12T02:47:45.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.456+0000 7f1fa3400640 1 -- start start 2024-09-12T02:47:45.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.457+0000 7f1fa3400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1f9c071530 0x7f1f9c0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:45.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.457+0000 7f1fa3400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1f9c0719a0 0x7f1f9c0afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:45.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.457+0000 7f1fa3400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f9c0ceeb0 con 0x7f1f9c15cc50 2024-09-12T02:47:45.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.457+0000 7f1fa3400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f1f9c15d030 con 0x7f1f9c071530 2024-09-12T02:47:45.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.457+0000 7f1fa3400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f1f9c0cf4c0 con 0x7f1f9c0719a0 2024-09-12T02:47:45.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.457+0000 7f1f93e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1f9c071530 0x7f1f9c0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:45.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.457+0000 7f1f93e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1f9c071530 0x7f1f9c0af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38704/0 (socket says 172.21.15.112:38704) 2024-09-12T02:47:45.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.457+0000 7f1f93e00640 1 -- 172.21.15.112:0/2819384907 learned_addr learned my addr 172.21.15.112:0/2819384907 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:45.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.458+0000 7f1fa1400640 1 --2- 172.21.15.112:0/2819384907 >> v2:172.21.15.137:3300/0 conn(0x7f1f9c0719a0 0x7f1f9c0afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:45.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.458+0000 7f1f93e00640 1 -- 172.21.15.112:0/2819384907 >> v2:172.21.15.137:3300/0 conn(0x7f1f9c0719a0 msgr2=0x7f1f9c0afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:45.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.458+0000 7f1f93e00640 1 --2- 172.21.15.112:0/2819384907 >> v2:172.21.15.137:3300/0 conn(0x7f1f9c0719a0 0x7f1f9c0afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:45.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.458+0000 7f1f93e00640 1 -- 172.21.15.112:0/2819384907 >> v1:172.21.15.112:6789/0 conn(0x7f1f9c15cc50 legacy=0x7f1f9c0732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:45.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.458+0000 7f1f93e00640 1 -- 172.21.15.112:0/2819384907 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f9c06e300 con 0x7f1f9c071530 2024-09-12T02:47:45.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.459+0000 7f1f93e00640 1 --2- 172.21.15.112:0/2819384907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f9c071530 0x7f1f9c0af720 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0cf640 tx=0x7f1f8402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba87633d32f771d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:45.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.459+0000 7f1f9be00640 1 -- 172.21.15.112:0/2819384907 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f84004030 con 0x7f1f9c071530 2024-09-12T02:47:45.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.459+0000 7f1f9be00640 1 -- 172.21.15.112:0/2819384907 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f840041d0 con 0x7f1f9c071530 2024-09-12T02:47:45.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.459+0000 7f1f9be00640 1 -- 172.21.15.112:0/2819384907 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f84003610 con 0x7f1f9c071530 2024-09-12T02:47:45.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.460+0000 7f1fa3400640 1 -- 172.21.15.112:0/2819384907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f9c071530 msgr2=0x7f1f9c0af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:45.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.460+0000 7f1fa3400640 1 --2- 172.21.15.112:0/2819384907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f9c071530 0x7f1f9c0af720 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0cf640 tx=0x7f1f8402a1c0 comp rx=0 tx=0).stop 2024-09-12T02:47:45.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.460+0000 7f1fa3400640 1 -- 172.21.15.112:0/2819384907 shutdown_connections 2024-09-12T02:47:45.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.460+0000 7f1fa3400640 1 --2- 172.21.15.112:0/2819384907 >> v2:172.21.15.137:3300/0 conn(0x7f1f9c0719a0 0x7f1f9c0afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:45.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.460+0000 7f1fa3400640 1 --2- 172.21.15.112:0/2819384907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f9c071530 0x7f1f9c0af720 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:45.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.460+0000 7f1fa3400640 1 -- 172.21.15.112:0/2819384907 >> 172.21.15.112:0/2819384907 conn(0x7f1f9c06bbd0 msgr2=0x7f1f9c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:45.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.460+0000 7f1fa3400640 1 -- 172.21.15.112:0/2819384907 shutdown_connections 2024-09-12T02:47:45.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.460+0000 7f1fa3400640 1 -- 172.21.15.112:0/2819384907 wait complete. 2024-09-12T02:47:45.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.461+0000 7f1fa3400640 1 Processor -- start 2024-09-12T02:47:45.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.462+0000 7f1fa3400640 1 -- start start 2024-09-12T02:47:45.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.462+0000 7f1fa3400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f9c071530 0x7f1f9c14de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:45.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.462+0000 7f1fa3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f9c0719a0 0x7f1f9c14e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:45.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.462+0000 7f1fa3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f9c15cc50 0x7f1f9c15aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:45.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.463+0000 7f1fa3400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9c06f510 con 0x7f1f9c0719a0 2024-09-12T02:47:45.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.463+0000 7f1fa3400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9c0cf150 con 0x7f1f9c15cc50 2024-09-12T02:47:45.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.463+0000 7f1fa3400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1f9c06f690 con 0x7f1f9c071530 2024-09-12T02:47:45.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.463+0000 7f1f93e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f9c0719a0 0x7f1f9c14e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:45.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.463+0000 7f1f93e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f9c0719a0 0x7f1f9c14e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38706/0 (socket says 172.21.15.112:38706) 2024-09-12T02:47:45.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.463+0000 7f1f93e00640 1 -- 172.21.15.112:0/3396067893 learned_addr learned my addr 172.21.15.112:0/3396067893 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:45.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.463+0000 7f1fa0a00640 1 --2- 172.21.15.112:0/3396067893 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f9c071530 0x7f1f9c14de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:45.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.463+0000 7f1fa1400640 1 --2- 172.21.15.112:0/3396067893 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f9c15cc50 0x7f1f9c15aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:45.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.463+0000 7f1f93e00640 1 -- 172.21.15.112:0/3396067893 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f9c071530 msgr2=0x7f1f9c14de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:45.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.463+0000 7f1f93e00640 1 --2- 172.21.15.112:0/3396067893 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f9c071530 0x7f1f9c14de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:45.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.463+0000 7f1f93e00640 1 -- 172.21.15.112:0/3396067893 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f9c15cc50 msgr2=0x7f1f9c15aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:45.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.463+0000 7f1f93e00640 1 --2- 172.21.15.112:0/3396067893 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f9c15cc50 0x7f1f9c15aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:45.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.463+0000 7f1f93e00640 1 -- 172.21.15.112:0/3396067893 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f9c14ef90 con 0x7f1f9c0719a0 2024-09-12T02:47:45.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.463+0000 7f1f93e00640 1 --2- 172.21.15.112:0/3396067893 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f9c0719a0 0x7f1f9c14e4f0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f1f8402a200 tx=0x7f1f840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:45.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.464+0000 7f1f99600640 1 -- 172.21.15.112:0/3396067893 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f84041020 con 0x7f1f9c0719a0 2024-09-12T02:47:45.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.464+0000 7f1f99600640 1 -- 172.21.15.112:0/3396067893 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f84003c50 con 0x7f1f9c0719a0 2024-09-12T02:47:45.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.464+0000 7f1f99600640 1 -- 172.21.15.112:0/3396067893 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f84004030 con 0x7f1f9c0719a0 2024-09-12T02:47:45.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.464+0000 7f1fa3400640 1 -- 172.21.15.112:0/3396067893 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f9c14f270 con 0x7f1f9c0719a0 2024-09-12T02:47:45.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.464+0000 7f1fa3400640 1 -- 172.21.15.112:0/3396067893 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f9c14f830 con 0x7f1f9c0719a0 2024-09-12T02:47:45.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.465+0000 7f1fa3400640 1 -- 172.21.15.112:0/3396067893 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f9c068a30 con 0x7f1f9c0719a0 2024-09-12T02:47:45.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.466+0000 7f1f99600640 1 -- 172.21.15.112:0/3396067893 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1f84044020 con 0x7f1f9c0719a0 2024-09-12T02:47:45.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.467+0000 7f1f99600640 1 --2- 172.21.15.112:0/3396067893 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1f7806be30 0x7f1f7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:45.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.467+0000 7f1f99600640 1 -- 172.21.15.112:0/3396067893 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f1f840abbd0 con 0x7f1f9c0719a0 2024-09-12T02:47:45.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.467+0000 7f1fa0a00640 1 --2- 172.21.15.112:0/3396067893 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1f7806be30 0x7f1f7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:45.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.468+0000 7f1fa0a00640 1 --2- 172.21.15.112:0/3396067893 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1f7806be30 0x7f1f7806e2f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c007fd0 tx=0x7f1f8c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:45.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.471+0000 7f1f99600640 1 -- 172.21.15.112:0/3396067893 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1f8404b030 con 0x7f1f9c0719a0 2024-09-12T02:47:45.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.644+0000 7f1fa3400640 1 -- 172.21.15.112:0/3396067893 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f9c06df60 con 0x7f1f9c0719a0 2024-09-12T02:47:45.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.646+0000 7f1f99600640 1 -- 172.21.15.112:0/3396067893 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) ==== 74+0+16735 (secure 0 0 0) 0x7f1f8407a4e0 con 0x7f1f9c0719a0 2024-09-12T02:47:45.647 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:45.647 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":123,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:47:39.960522+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:47:24.847347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-12T02:47:26.073460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:47:45.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.648+0000 7f1fa3400640 1 -- 172.21.15.112:0/3396067893 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1f7806be30 msgr2=0x7f1f7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:45.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.648+0000 7f1fa3400640 1 --2- 172.21.15.112:0/3396067893 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1f7806be30 0x7f1f7806e2f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c007fd0 tx=0x7f1f8c009040 comp rx=0 tx=0).stop 2024-09-12T02:47:45.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.648+0000 7f1fa3400640 1 -- 172.21.15.112:0/3396067893 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f9c0719a0 msgr2=0x7f1f9c14e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:45.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.648+0000 7f1fa3400640 1 --2- 172.21.15.112:0/3396067893 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f9c0719a0 0x7f1f9c14e4f0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f1f8402a200 tx=0x7f1f840046c0 comp rx=0 tx=0).stop 2024-09-12T02:47:45.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.648+0000 7f1fa3400640 1 -- 172.21.15.112:0/3396067893 shutdown_connections 2024-09-12T02:47:45.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.648+0000 7f1fa3400640 1 --2- 172.21.15.112:0/3396067893 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1f7806be30 0x7f1f7806e2f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:45.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.648+0000 7f1fa3400640 1 --2- 172.21.15.112:0/3396067893 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f9c15cc50 0x7f1f9c15aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:45.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.648+0000 7f1fa3400640 1 --2- 172.21.15.112:0/3396067893 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f9c0719a0 0x7f1f9c14e4f0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:45.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.648+0000 7f1fa3400640 1 --2- 172.21.15.112:0/3396067893 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f9c071530 0x7f1f9c14de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:45.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.648+0000 7f1fa3400640 1 -- 172.21.15.112:0/3396067893 >> 172.21.15.112:0/3396067893 conn(0x7f1f9c06bbd0 msgr2=0x7f1f9c0b38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:45.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.648+0000 7f1fa3400640 1 -- 172.21.15.112:0/3396067893 shutdown_connections 2024-09-12T02:47:45.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.648+0000 7f1fa3400640 1 -- 172.21.15.112:0/3396067893 wait complete. 2024-09-12T02:47:45.665 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:47:45.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.819+0000 7fb868c00640 1 Processor -- start 2024-09-12T02:47:45.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.819+0000 7fb868c00640 1 -- start start 2024-09-12T02:47:45.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.820+0000 7fb868c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb86415ed60 0x7fb86406d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:45.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.820+0000 7fb868c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb8640b74b0 0x7fb8640b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:45.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.820+0000 7fb868c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8640b3000 con 0x7fb86406da10 2024-09-12T02:47:45.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.820+0000 7fb868c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb86406de60 con 0x7fb8640b74b0 2024-09-12T02:47:45.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.820+0000 7fb868c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb8640b3c10 con 0x7fb86415ed60 2024-09-12T02:47:45.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.820+0000 7fb863e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb8640b74b0 0x7fb8640b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:45.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.821+0000 7fb863e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb8640b74b0 0x7fb8640b78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38720/0 (socket says 172.21.15.112:38720) 2024-09-12T02:47:45.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.821+0000 7fb863e00640 1 -- 172.21.15.112:0/1256433874 learned_addr learned my addr 172.21.15.112:0/1256433874 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:45.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.821+0000 7fb863400640 1 --2- 172.21.15.112:0/1256433874 >> v2:172.21.15.137:3300/0 conn(0x7fb86415ed60 0x7fb86406d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:45.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.821+0000 7fb863e00640 1 -- 172.21.15.112:0/1256433874 >> v2:172.21.15.137:3300/0 conn(0x7fb86415ed60 msgr2=0x7fb86406d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:45.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.821+0000 7fb863e00640 1 --2- 172.21.15.112:0/1256433874 >> v2:172.21.15.137:3300/0 conn(0x7fb86415ed60 0x7fb86406d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:45.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.821+0000 7fb863e00640 1 -- 172.21.15.112:0/1256433874 >> v1:172.21.15.112:6789/0 conn(0x7fb86406da10 legacy=0x7fb8640af900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:45.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.821+0000 7fb863e00640 1 -- 172.21.15.112:0/1256433874 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8640b32e0 con 0x7fb8640b74b0 2024-09-12T02:47:45.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.821+0000 7fb863400640 1 --2- 172.21.15.112:0/1256433874 >> v2:172.21.15.137:3300/0 conn(0x7fb86415ed60 0x7fb86406d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:45.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.822+0000 7fb863e00640 1 --2- 172.21.15.112:0/1256433874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8640b74b0 0x7fb8640b78c0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fb8640b56b0 tx=0x7fb85c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90106e0a0d114c35 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:45.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.822+0000 7fb862a00640 1 -- 172.21.15.112:0/1256433874 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85c037070 con 0x7fb8640b74b0 2024-09-12T02:47:45.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.822+0000 7fb862a00640 1 -- 172.21.15.112:0/1256433874 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb85c032440 con 0x7fb8640b74b0 2024-09-12T02:47:45.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.822+0000 7fb862a00640 1 -- 172.21.15.112:0/1256433874 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85c032810 con 0x7fb8640b74b0 2024-09-12T02:47:45.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.823+0000 7fb868c00640 1 -- 172.21.15.112:0/1256433874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8640b74b0 msgr2=0x7fb8640b78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:45.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.823+0000 7fb868c00640 1 --2- 172.21.15.112:0/1256433874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8640b74b0 0x7fb8640b78c0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fb8640b56b0 tx=0x7fb85c02a270 comp rx=0 tx=0).stop 2024-09-12T02:47:45.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.823+0000 7fb868c00640 1 -- 172.21.15.112:0/1256433874 shutdown_connections 2024-09-12T02:47:45.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.823+0000 7fb868c00640 1 --2- 172.21.15.112:0/1256433874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8640b74b0 0x7fb8640b78c0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:45.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.823+0000 7fb868c00640 1 --2- 172.21.15.112:0/1256433874 >> v2:172.21.15.137:3300/0 conn(0x7fb86415ed60 0x7fb86406d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:45.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.823+0000 7fb868c00640 1 -- 172.21.15.112:0/1256433874 >> 172.21.15.112:0/1256433874 conn(0x7fb8640b7e80 msgr2=0x7fb8640b8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:45.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.823+0000 7fb868c00640 1 -- 172.21.15.112:0/1256433874 shutdown_connections 2024-09-12T02:47:45.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.823+0000 7fb868c00640 1 -- 172.21.15.112:0/1256433874 wait complete. 2024-09-12T02:47:45.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.825+0000 7fb868c00640 1 Processor -- start 2024-09-12T02:47:45.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.825+0000 7fb868c00640 1 -- start start 2024-09-12T02:47:45.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.825+0000 7fb868c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb86406da10 0x7fb864155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:45.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.826+0000 7fb868c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8640b74b0 0x7fb8640cdc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:45.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.826+0000 7fb868c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb86415ed60 0x7fb864154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:45.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.826+0000 7fb868c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb86406e270 con 0x7fb86415ed60 2024-09-12T02:47:45.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.826+0000 7fb868c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb8640b38a0 con 0x7fb86406da10 2024-09-12T02:47:45.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.826+0000 7fb868c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb8640b40a0 con 0x7fb8640b74b0 2024-09-12T02:47:45.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.826+0000 7fb863e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb86415ed60 0x7fb864154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:45.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.826+0000 7fb863e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb86415ed60 0x7fb864154b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38730/0 (socket says 172.21.15.112:38730) 2024-09-12T02:47:45.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.826+0000 7fb863e00640 1 -- 172.21.15.112:0/816206742 learned_addr learned my addr 172.21.15.112:0/816206742 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:45.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.826+0000 7fb863e00640 1 -- 172.21.15.112:0/816206742 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8640b74b0 msgr2=0x7fb8640cdc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:45.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.826+0000 7fb85aa00640 1 --2- 172.21.15.112:0/816206742 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8640b74b0 0x7fb8640cdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:45.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.826+0000 7fb863400640 1 --2- 172.21.15.112:0/816206742 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb86406da10 0x7fb864155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:45.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.826+0000 7fb863e00640 1 --2- 172.21.15.112:0/816206742 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8640b74b0 0x7fb8640cdc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:45.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.826+0000 7fb863e00640 1 -- 172.21.15.112:0/816206742 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb86406da10 msgr2=0x7fb864155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:45.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.826+0000 7fb863e00640 1 --2- 172.21.15.112:0/816206742 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb86406da10 0x7fb864155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:45.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.826+0000 7fb863e00640 1 -- 172.21.15.112:0/816206742 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8640ce1b0 con 0x7fb86415ed60 2024-09-12T02:47:45.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.826+0000 7fb85aa00640 1 --2- 172.21.15.112:0/816206742 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8640b74b0 0x7fb8640cdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:45.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.826+0000 7fb863400640 1 --2- 172.21.15.112:0/816206742 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb86406da10 0x7fb864155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:45.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.827+0000 7fb863e00640 1 --2- 172.21.15.112:0/816206742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb86415ed60 0x7fb864154b30 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fb85c02a2b0 tx=0x7fb85c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:45.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.827+0000 7fb85be00640 1 -- 172.21.15.112:0/816206742 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85c037040 con 0x7fb86415ed60 2024-09-12T02:47:45.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.827+0000 7fb85be00640 1 -- 172.21.15.112:0/816206742 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb85c042070 con 0x7fb86415ed60 2024-09-12T02:47:45.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.827+0000 7fb85be00640 1 -- 172.21.15.112:0/816206742 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85c030920 con 0x7fb86415ed60 2024-09-12T02:47:45.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.827+0000 7fb868c00640 1 -- 172.21.15.112:0/816206742 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8640ce430 con 0x7fb86415ed60 2024-09-12T02:47:45.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.827+0000 7fb868c00640 1 -- 172.21.15.112:0/816206742 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb864152fe0 con 0x7fb86415ed60 2024-09-12T02:47:45.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.828+0000 7fb868c00640 1 -- 172.21.15.112:0/816206742 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8640ce950 con 0x7fb86415ed60 2024-09-12T02:47:45.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.829+0000 7fb85be00640 1 -- 172.21.15.112:0/816206742 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb85c030ac0 con 0x7fb86415ed60 2024-09-12T02:47:45.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.830+0000 7fb85be00640 1 --2- 172.21.15.112:0/816206742 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb84006be30 0x7fb84006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:45.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.830+0000 7fb85be00640 1 -- 172.21.15.112:0/816206742 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7fb85c0ab840 con 0x7fb86415ed60 2024-09-12T02:47:45.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.830+0000 7fb863400640 1 --2- 172.21.15.112:0/816206742 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb84006be30 0x7fb84006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:45.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.831+0000 7fb863400640 1 --2- 172.21.15.112:0/816206742 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb84006be30 0x7fb84006e2f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb854006fd0 tx=0x7fb854008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:45.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:45.835+0000 7fb85be00640 1 -- 172.21.15.112:0/816206742 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb8640ce950 con 0x7fb86415ed60 2024-09-12T02:47:46.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.043+0000 7fb868c00640 1 -- 172.21.15.112:0/816206742 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb86415f140 con 0x7fb86415ed60 2024-09-12T02:47:46.044 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-12T02:47:46.043+0000 7f0216c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:47:46.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.046+0000 7fb85be00640 1 -- 172.21.15.112:0/816206742 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v63) ==== 161+0+0 (secure 0 0 0) 0x7fb8640ce1b0 con 0x7fb86415ed60 2024-09-12T02:47:46.047 INFO:teuthology.orchestra.run.smithi112.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:47:46.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.050+0000 7fb868c00640 1 -- 172.21.15.112:0/816206742 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb84006be30 msgr2=0x7fb84006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:46.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.050+0000 7fb868c00640 1 --2- 172.21.15.112:0/816206742 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb84006be30 0x7fb84006e2f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb854006fd0 tx=0x7fb854008040 comp rx=0 tx=0).stop 2024-09-12T02:47:46.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.050+0000 7fb868c00640 1 -- 172.21.15.112:0/816206742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb86415ed60 msgr2=0x7fb864154b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:46.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.050+0000 7fb868c00640 1 --2- 172.21.15.112:0/816206742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb86415ed60 0x7fb864154b30 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fb85c02a2b0 tx=0x7fb85c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:47:46.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.050+0000 7fb868c00640 1 -- 172.21.15.112:0/816206742 shutdown_connections 2024-09-12T02:47:46.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.050+0000 7fb868c00640 1 --2- 172.21.15.112:0/816206742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb86415ed60 0x7fb864154b30 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:46.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.050+0000 7fb868c00640 1 --2- 172.21.15.112:0/816206742 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8640b74b0 0x7fb8640cdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:46.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.050+0000 7fb868c00640 1 --2- 172.21.15.112:0/816206742 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb84006be30 0x7fb84006e2f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:46.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.050+0000 7fb868c00640 1 --2- 172.21.15.112:0/816206742 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb86406da10 0x7fb864155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:46.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.050+0000 7fb868c00640 1 -- 172.21.15.112:0/816206742 >> 172.21.15.112:0/816206742 conn(0x7fb8640b7e80 msgr2=0x7fb86415be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:46.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.051+0000 7fb868c00640 1 -- 172.21.15.112:0/816206742 shutdown_connections 2024-09-12T02:47:46.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.051+0000 7fb868c00640 1 -- 172.21.15.112:0/816206742 wait complete. 2024-09-12T02:47:46.063 INFO:tasks.ceph.mds.a.smithi112.stderr: -5117> 2024-09-12T02:47:29.657+0000 7fa082a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:47:46.076 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T02:47:46.120 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-12T02:47:46.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.231+0000 7f53c9400640 1 Processor -- start 2024-09-12T02:47:46.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.231+0000 7f53c9400640 1 -- start start 2024-09-12T02:47:46.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.232+0000 7f53c9400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f53c415b9a0 0x7f53c406d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:46.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.232+0000 7f53c9400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f53c40d0820 0x7f53c40d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:46.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.232+0000 7f53c9400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53c40b42c0 con 0x7f53c406f270 2024-09-12T02:47:46.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.232+0000 7f53c9400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f53c406de70 con 0x7f53c415b9a0 2024-09-12T02:47:46.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.232+0000 7f53c9400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f53c415bd80 con 0x7f53c40d0820 2024-09-12T02:47:46.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.233+0000 7f53c3e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f53c415b9a0 0x7f53c406d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:46.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.233+0000 7f53c3e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f53c415b9a0 0x7f53c406d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38760/0 (socket says 172.21.15.112:38760) 2024-09-12T02:47:46.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.233+0000 7f53c3e00640 1 -- 172.21.15.112:0/4215271038 learned_addr learned my addr 172.21.15.112:0/4215271038 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:46.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.233+0000 7f53c8a00640 1 --2- 172.21.15.112:0/4215271038 >> v2:172.21.15.137:3300/0 conn(0x7f53c40d0820 0x7f53c40d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:46.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.233+0000 7f53c3e00640 1 -- 172.21.15.112:0/4215271038 >> v2:172.21.15.137:3300/0 conn(0x7f53c40d0820 msgr2=0x7f53c40d0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:46.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.233+0000 7f53c3e00640 1 --2- 172.21.15.112:0/4215271038 >> v2:172.21.15.137:3300/0 conn(0x7f53c40d0820 0x7f53c40d0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:46.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.233+0000 7f53c3e00640 1 -- 172.21.15.112:0/4215271038 >> v1:172.21.15.137:6789/0 conn(0x7f53c406f270 legacy=0x7f53c40b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:46.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.233+0000 7f53c3e00640 1 -- 172.21.15.112:0/4215271038 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c40b5730 con 0x7f53c415b9a0 2024-09-12T02:47:46.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.233+0000 7f53c8a00640 1 --2- 172.21.15.112:0/4215271038 >> v2:172.21.15.137:3300/0 conn(0x7f53c40d0820 0x7f53c40d0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:46.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.234+0000 7f53c3e00640 1 --2- 172.21.15.112:0/4215271038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53c415b9a0 0x7f53c406d590 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f53c406ead0 tx=0x7f53b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234367f5afaf54ef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:46.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.234+0000 7f53c2a00640 1 -- 172.21.15.112:0/4215271038 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b4037070 con 0x7f53c415b9a0 2024-09-12T02:47:46.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.234+0000 7f53c2a00640 1 -- 172.21.15.112:0/4215271038 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53b4032440 con 0x7f53c415b9a0 2024-09-12T02:47:46.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.234+0000 7f53c2a00640 1 -- 172.21.15.112:0/4215271038 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b4032810 con 0x7f53c415b9a0 2024-09-12T02:47:46.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.235+0000 7f53c9400640 1 -- 172.21.15.112:0/4215271038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53c415b9a0 msgr2=0x7f53c406d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:46.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.235+0000 7f53c9400640 1 --2- 172.21.15.112:0/4215271038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53c415b9a0 0x7f53c406d590 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f53c406ead0 tx=0x7f53b402a270 comp rx=0 tx=0).stop 2024-09-12T02:47:46.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.235+0000 7f53c9400640 1 -- 172.21.15.112:0/4215271038 shutdown_connections 2024-09-12T02:47:46.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.235+0000 7f53c9400640 1 --2- 172.21.15.112:0/4215271038 >> v2:172.21.15.137:3300/0 conn(0x7f53c40d0820 0x7f53c40d0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:46.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.235+0000 7f53c9400640 1 --2- 172.21.15.112:0/4215271038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53c415b9a0 0x7f53c406d590 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:46.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.235+0000 7f53c9400640 1 -- 172.21.15.112:0/4215271038 >> 172.21.15.112:0/4215271038 conn(0x7f53c406bbd0 msgr2=0x7f53c406bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:46.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.235+0000 7f53c9400640 1 -- 172.21.15.112:0/4215271038 shutdown_connections 2024-09-12T02:47:46.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.235+0000 7f53c9400640 1 -- 172.21.15.112:0/4215271038 wait complete. 2024-09-12T02:47:46.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.237+0000 7f53c9400640 1 Processor -- start 2024-09-12T02:47:46.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.237+0000 7f53c9400640 1 -- start start 2024-09-12T02:47:46.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.238+0000 7f53c9400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53c406f270 0x7f53c414f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:46.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.238+0000 7f53c9400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f53c40d0820 0x7f53c40b1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:46.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.238+0000 7f53c9400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53c415b9a0 0x7f53c40b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:46.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.238+0000 7f53c9400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f53c40b4820 con 0x7f53c415b9a0 2024-09-12T02:47:46.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.238+0000 7f53c9400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f53c40b4540 con 0x7f53c406f270 2024-09-12T02:47:46.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.238+0000 7f53c9400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f53c40b4b00 con 0x7f53c40d0820 2024-09-12T02:47:46.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.238+0000 7f53c8a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53c415b9a0 0x7f53c40b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:46.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.238+0000 7f53c3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53c406f270 0x7f53c414f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:46.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.238+0000 7f53c8a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53c415b9a0 0x7f53c40b1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38772/0 (socket says 172.21.15.112:38772) 2024-09-12T02:47:46.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.238+0000 7f53c8a00640 1 -- 172.21.15.112:0/3212041999 learned_addr learned my addr 172.21.15.112:0/3212041999 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:46.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.238+0000 7f53c3400640 1 --2- 172.21.15.112:0/3212041999 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f53c40d0820 0x7f53c40b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:46.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.238+0000 7f53c8a00640 1 -- 172.21.15.112:0/3212041999 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f53c40d0820 msgr2=0x7f53c40b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:46.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.238+0000 7f53c8a00640 1 --2- 172.21.15.112:0/3212041999 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f53c40d0820 0x7f53c40b1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:46.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.238+0000 7f53c8a00640 1 -- 172.21.15.112:0/3212041999 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53c406f270 msgr2=0x7f53c414f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:46.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.238+0000 7f53c8a00640 1 --2- 172.21.15.112:0/3212041999 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53c406f270 0x7f53c414f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:46.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.238+0000 7f53c8a00640 1 -- 172.21.15.112:0/3212041999 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c4151f60 con 0x7f53c415b9a0 2024-09-12T02:47:46.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.238+0000 7f53c3e00640 1 --2- 172.21.15.112:0/3212041999 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53c406f270 0x7f53c414f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:46.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.239+0000 7f53c8a00640 1 --2- 172.21.15.112:0/3212041999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53c415b9a0 0x7f53c40b1d80 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f53bc007ef0 tx=0x7f53bc00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:46.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.239+0000 7f53bbe00640 1 -- 172.21.15.112:0/3212041999 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc01a070 con 0x7f53c415b9a0 2024-09-12T02:47:46.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.239+0000 7f53bbe00640 1 -- 172.21.15.112:0/3212041999 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53bc003b90 con 0x7f53c415b9a0 2024-09-12T02:47:46.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.239+0000 7f53bbe00640 1 -- 172.21.15.112:0/3212041999 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc004030 con 0x7f53c415b9a0 2024-09-12T02:47:46.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.239+0000 7f53c9400640 1 -- 172.21.15.112:0/3212041999 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53c4152240 con 0x7f53c415b9a0 2024-09-12T02:47:46.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.239+0000 7f53c9400640 1 -- 172.21.15.112:0/3212041999 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53c4155f90 con 0x7f53c415b9a0 2024-09-12T02:47:46.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.240+0000 7f53c9400640 1 -- 172.21.15.112:0/3212041999 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53c40b5b50 con 0x7f53c415b9a0 2024-09-12T02:47:46.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.241+0000 7f53bbe00640 1 -- 172.21.15.112:0/3212041999 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f53bc01d070 con 0x7f53c415b9a0 2024-09-12T02:47:46.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.242+0000 7f53bbe00640 1 --2- 172.21.15.112:0/3212041999 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f53a406be60 0x7f53a406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:46.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.242+0000 7f53bbe00640 1 -- 172.21.15.112:0/3212041999 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5795+0+0 (secure 0 0 0) 0x7f53bc08b130 con 0x7f53c415b9a0 2024-09-12T02:47:46.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.243+0000 7f53c3e00640 1 --2- 172.21.15.112:0/3212041999 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f53a406be60 0x7f53a406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:46.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.243+0000 7f53c3e00640 1 --2- 172.21.15.112:0/3212041999 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f53a406be60 0x7f53a406e320 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f53b4034000 tx=0x7f53b402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:46.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.247+0000 7f53bbe00640 1 -- 172.21.15.112:0/3212041999 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f53bc010070 con 0x7f53c415b9a0 2024-09-12T02:47:46.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:46.453+0000 7f53c9400640 1 -- 172.21.15.112:0/3212041999 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f53c40cfd90 con 0x7f53c415b9a0 2024-09-12T02:47:47.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.047+0000 7f53bbe00640 1 -- 172.21.15.112:0/3212041999 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v64) ==== 104+0+0 (secure 0 0 0) 0x7f53bc059390 con 0x7f53c415b9a0 2024-09-12T02:47:47.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.051+0000 7f53c9400640 1 -- 172.21.15.112:0/3212041999 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f53a406be60 msgr2=0x7f53a406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:47.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.051+0000 7f53c9400640 1 --2- 172.21.15.112:0/3212041999 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f53a406be60 0x7f53a406e320 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f53b4034000 tx=0x7f53b402e000 comp rx=0 tx=0).stop 2024-09-12T02:47:47.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.051+0000 7f53c9400640 1 -- 172.21.15.112:0/3212041999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53c415b9a0 msgr2=0x7f53c40b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:47.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.051+0000 7f53c9400640 1 --2- 172.21.15.112:0/3212041999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53c415b9a0 0x7f53c40b1d80 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f53bc007ef0 tx=0x7f53bc00d4a0 comp rx=0 tx=0).stop 2024-09-12T02:47:47.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.051+0000 7f53c9400640 1 -- 172.21.15.112:0/3212041999 shutdown_connections 2024-09-12T02:47:47.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.051+0000 7f53c9400640 1 --2- 172.21.15.112:0/3212041999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53c415b9a0 0x7f53c40b1d80 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:47.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.051+0000 7f53c9400640 1 --2- 172.21.15.112:0/3212041999 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f53c40d0820 0x7f53c40b1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:47.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.051+0000 7f53c9400640 1 --2- 172.21.15.112:0/3212041999 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f53a406be60 0x7f53a406e320 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:47.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.051+0000 7f53c9400640 1 --2- 172.21.15.112:0/3212041999 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53c406f270 0x7f53c414f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:47.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.051+0000 7f53c9400640 1 -- 172.21.15.112:0/3212041999 >> 172.21.15.112:0/3212041999 conn(0x7f53c406bbd0 msgr2=0x7f53c40ccaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:47.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.051+0000 7f53c9400640 1 -- 172.21.15.112:0/3212041999 shutdown_connections 2024-09-12T02:47:47.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.051+0000 7f53c9400640 1 -- 172.21.15.112:0/3212041999 wait complete. 2024-09-12T02:47:47.071 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T02:47:47.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.270+0000 7f2f97800640 1 Processor -- start 2024-09-12T02:47:47.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.270+0000 7f2f97800640 1 -- start start 2024-09-12T02:47:47.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.272+0000 7f2f97800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2f900b3220 0x7f2f9006e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:47.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.272+0000 7f2f97800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f900b3630 con 0x7f2f900d10b0 2024-09-12T02:47:47.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.272+0000 7f2f97800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f900af530 con 0x7f2f900b5820 2024-09-12T02:47:47.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.272+0000 7f2f97800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2f900af2e0 con 0x7f2f900b3220 2024-09-12T02:47:47.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.272+0000 7f2f94e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2f900d10b0 0x7f2f900b3a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36464/0 (socket says 172.21.15.112:36464) 2024-09-12T02:47:47.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.272+0000 7f2f94e00640 1 -- 172.21.15.112:0/487317359 learned_addr learned my addr 172.21.15.112:0/487317359 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:47.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.272+0000 7f2f95800640 1 --2- 172.21.15.112:0/487317359 >> v2:172.21.15.112:3300/0 conn(0x7f2f900b3220 0x7f2f9006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:47.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.272+0000 7f2f95800640 1 -- 172.21.15.112:0/487317359 >> v1:172.21.15.137:6789/0 conn(0x7f2f900b5820 legacy=0x7f2f9006dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:47.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.272+0000 7f2f8fe00640 1 -- 172.21.15.112:0/487317359 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3775763047 0 0) 0x7f2f900b3630 con 0x7f2f900d10b0 2024-09-12T02:47:47.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.272+0000 7f2f95800640 1 -- 172.21.15.112:0/487317359 >> v1:172.21.15.112:6789/0 conn(0x7f2f900d10b0 legacy=0x7f2f900b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:47.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.272+0000 7f2f95800640 1 -- 172.21.15.112:0/487317359 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f900af810 con 0x7f2f900b3220 2024-09-12T02:47:47.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.273+0000 7f2f95800640 1 --2- 172.21.15.112:0/487317359 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f900b3220 0x7f2f9006e890 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f2f88009d90 tx=0x7f2f8802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb6719a0cdee4d7e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:47.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.273+0000 7f2f8fe00640 1 -- 172.21.15.112:0/487317359 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f88007740 con 0x7f2f900b3220 2024-09-12T02:47:47.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.273+0000 7f2f8fe00640 1 -- 172.21.15.112:0/487317359 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f880078e0 con 0x7f2f900b3220 2024-09-12T02:47:47.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.274+0000 7f2f8fe00640 1 -- 172.21.15.112:0/487317359 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f88007cb0 con 0x7f2f900b3220 2024-09-12T02:47:47.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.274+0000 7f2f97800640 1 -- 172.21.15.112:0/487317359 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f900b3220 msgr2=0x7f2f9006e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:47.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.274+0000 7f2f97800640 1 --2- 172.21.15.112:0/487317359 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f900b3220 0x7f2f9006e890 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f2f88009d90 tx=0x7f2f8802a6f0 comp rx=0 tx=0).stop 2024-09-12T02:47:47.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.274+0000 7f2f97800640 1 -- 172.21.15.112:0/487317359 shutdown_connections 2024-09-12T02:47:47.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.274+0000 7f2f97800640 1 --2- 172.21.15.112:0/487317359 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f900b3220 0x7f2f9006e890 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:47.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.274+0000 7f2f97800640 1 -- 172.21.15.112:0/487317359 >> 172.21.15.112:0/487317359 conn(0x7f2f900b2730 msgr2=0x7f2f900b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:47.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.274+0000 7f2f97800640 1 -- 172.21.15.112:0/487317359 shutdown_connections 2024-09-12T02:47:47.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.274+0000 7f2f97800640 1 -- 172.21.15.112:0/487317359 wait complete. 2024-09-12T02:47:47.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.276+0000 7f2f97800640 1 Processor -- start 2024-09-12T02:47:47.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.276+0000 7f2f97800640 1 -- start start 2024-09-12T02:47:47.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.277+0000 7f2f97800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f900b3220 0x7f2f900c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:47.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.277+0000 7f2f97800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f900b5820 0x7f2f901598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:47.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.277+0000 7f2f97800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f900d10b0 0x7f2f900b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:47.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.277+0000 7f2f97800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2f900d1490 con 0x7f2f900d10b0 2024-09-12T02:47:47.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.277+0000 7f2f97800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9006d830 con 0x7f2f900b3220 2024-09-12T02:47:47.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.277+0000 7f2f97800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2f900b4140 con 0x7f2f900b5820 2024-09-12T02:47:47.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.277+0000 7f2f95800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f900d10b0 0x7f2f900b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:47.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.277+0000 7f2f95800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f900d10b0 0x7f2f900b19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38786/0 (socket says 172.21.15.112:38786) 2024-09-12T02:47:47.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.277+0000 7f2f95800640 1 -- 172.21.15.112:0/2701491011 learned_addr learned my addr 172.21.15.112:0/2701491011 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:47.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.277+0000 7f2f94e00640 1 --2- 172.21.15.112:0/2701491011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f900b3220 0x7f2f900c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:47.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.277+0000 7f2f87e00640 1 --2- 172.21.15.112:0/2701491011 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f900b5820 0x7f2f901598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:47.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.278+0000 7f2f95800640 1 -- 172.21.15.112:0/2701491011 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f900b5820 msgr2=0x7f2f901598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:47.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.278+0000 7f2f95800640 1 --2- 172.21.15.112:0/2701491011 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f900b5820 0x7f2f901598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:47.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.278+0000 7f2f95800640 1 -- 172.21.15.112:0/2701491011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f900b3220 msgr2=0x7f2f900c6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:47.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.278+0000 7f2f95800640 1 --2- 172.21.15.112:0/2701491011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f900b3220 0x7f2f900c6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:47.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.278+0000 7f2f95800640 1 -- 172.21.15.112:0/2701491011 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f90159de0 con 0x7f2f900d10b0 2024-09-12T02:47:47.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.278+0000 7f2f94e00640 1 --2- 172.21.15.112:0/2701491011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f900b3220 0x7f2f900c6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:47.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.278+0000 7f2f95800640 1 --2- 172.21.15.112:0/2701491011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f900d10b0 0x7f2f900b19d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f2f88009eb0 tx=0x7f2f88004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:47.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.278+0000 7f2f8d600640 1 -- 172.21.15.112:0/2701491011 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8803f070 con 0x7f2f900d10b0 2024-09-12T02:47:47.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.278+0000 7f2f8d600640 1 -- 172.21.15.112:0/2701491011 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f88031c40 con 0x7f2f900d10b0 2024-09-12T02:47:47.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.278+0000 7f2f8d600640 1 -- 172.21.15.112:0/2701491011 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f88003990 con 0x7f2f900d10b0 2024-09-12T02:47:47.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.278+0000 7f2f97800640 1 -- 172.21.15.112:0/2701491011 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f901f5710 con 0x7f2f900d10b0 2024-09-12T02:47:47.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.278+0000 7f2f97800640 1 -- 172.21.15.112:0/2701491011 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f90158dc0 con 0x7f2f900d10b0 2024-09-12T02:47:47.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.279+0000 7f2f97800640 1 -- 172.21.15.112:0/2701491011 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f900b3a30 con 0x7f2f900d10b0 2024-09-12T02:47:47.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.280+0000 7f2f8d600640 1 -- 172.21.15.112:0/2701491011 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2f88003b30 con 0x7f2f900d10b0 2024-09-12T02:47:47.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.281+0000 7f2f8d600640 1 --2- 172.21.15.112:0/2701491011 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2f6c06be30 0x7f2f6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:47.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.281+0000 7f2f8d600640 1 -- 172.21.15.112:0/2701491011 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5795+0+0 (secure 0 0 0) 0x7f2f880ac1e0 con 0x7f2f900d10b0 2024-09-12T02:47:47.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.281+0000 7f2f94e00640 1 --2- 172.21.15.112:0/2701491011 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2f6c06be30 0x7f2f6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:47.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.282+0000 7f2f94e00640 1 --2- 172.21.15.112:0/2701491011 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2f6c06be30 0x7f2f6c06e2f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2f80000f60 tx=0x7f2f80007c70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:47.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.285+0000 7f2f8d600640 1 -- 172.21.15.112:0/2701491011 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2f8807aa90 con 0x7f2f900d10b0 2024-09-12T02:47:47.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:47.458+0000 7f2f97800640 1 -- 172.21.15.112:0/2701491011 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2f900ce120 con 0x7f2f900d10b0 2024-09-12T02:47:48.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.049+0000 7f2f8d600640 1 -- 172.21.15.112:0/2701491011 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v125) ==== 181+0+0 (secure 0 0 0) 0x7f2f8807a390 con 0x7f2f900d10b0 2024-09-12T02:47:48.050 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' removed 2024-09-12T02:47:48.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.053+0000 7f2f97800640 1 -- 172.21.15.112:0/2701491011 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2f6c06be30 msgr2=0x7f2f6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:48.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.053+0000 7f2f97800640 1 --2- 172.21.15.112:0/2701491011 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2f6c06be30 0x7f2f6c06e2f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2f80000f60 tx=0x7f2f80007c70 comp rx=0 tx=0).stop 2024-09-12T02:47:48.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.053+0000 7f2f97800640 1 -- 172.21.15.112:0/2701491011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f900d10b0 msgr2=0x7f2f900b19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:48.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.053+0000 7f2f97800640 1 --2- 172.21.15.112:0/2701491011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f900d10b0 0x7f2f900b19d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f2f88009eb0 tx=0x7f2f88004a40 comp rx=0 tx=0).stop 2024-09-12T02:47:48.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.053+0000 7f2f97800640 1 -- 172.21.15.112:0/2701491011 shutdown_connections 2024-09-12T02:47:48.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.053+0000 7f2f97800640 1 --2- 172.21.15.112:0/2701491011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f900d10b0 0x7f2f900b19d0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:48.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.053+0000 7f2f97800640 1 --2- 172.21.15.112:0/2701491011 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f900b5820 0x7f2f901598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:48.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.053+0000 7f2f97800640 1 --2- 172.21.15.112:0/2701491011 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2f6c06be30 0x7f2f6c06e2f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:48.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.053+0000 7f2f97800640 1 --2- 172.21.15.112:0/2701491011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f900b3220 0x7f2f900c6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:48.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.054+0000 7f2f97800640 1 -- 172.21.15.112:0/2701491011 >> 172.21.15.112:0/2701491011 conn(0x7f2f900b2730 msgr2=0x7f2f90072bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:48.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.054+0000 7f2f97800640 1 -- 172.21.15.112:0/2701491011 shutdown_connections 2024-09-12T02:47:48.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.054+0000 7f2f97800640 1 -- 172.21.15.112:0/2701491011 wait complete. 2024-09-12T02:47:48.073 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T02:47:48.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.230+0000 7f7f2c000640 1 Processor -- start 2024-09-12T02:47:48.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.231+0000 7f7f2c000640 1 -- start start 2024-09-12T02:47:48.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.232+0000 7f7f2c000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7f240d10b0 0x7f7f240b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:48.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.232+0000 7f7f2c000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7f240b5820 0x7f7f240b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:48.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.232+0000 7f7f2c000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f240b3f70 0x7f7f2406dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:48.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.232+0000 7f7f2c000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f7f240af2e0 con 0x7f7f240b5820 2024-09-12T02:47:48.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.232+0000 7f7f2c000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7f240af530 con 0x7f7f240d10b0 2024-09-12T02:47:48.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.232+0000 7f7f2c000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7f240af810 con 0x7f7f240b3f70 2024-09-12T02:47:48.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.232+0000 7f7f28c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7f240b5820 0x7f7f240b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:48.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.232+0000 7f7f28c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7f240b5820 0x7f7f240b3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38800/0 (socket says 172.21.15.112:38800) 2024-09-12T02:47:48.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.232+0000 7f7f28c00640 1 -- 172.21.15.112:0/719760966 learned_addr learned my addr 172.21.15.112:0/719760966 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:48.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.232+0000 7f7f29600640 1 --2- 172.21.15.112:0/719760966 >> v2:172.21.15.137:3300/0 conn(0x7f7f240d10b0 0x7f7f240b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:48.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.232+0000 7f7f2a000640 1 --2- 172.21.15.112:0/719760966 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f240b3f70 0x7f7f2406dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:48.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.233+0000 7f7f28c00640 1 -- 172.21.15.112:0/719760966 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f240b3f70 msgr2=0x7f7f2406dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:48.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.233+0000 7f7f28c00640 1 --2- 172.21.15.112:0/719760966 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f240b3f70 0x7f7f2406dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:48.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.233+0000 7f7f28c00640 1 -- 172.21.15.112:0/719760966 >> v2:172.21.15.137:3300/0 conn(0x7f7f240d10b0 msgr2=0x7f7f240b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:48.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.233+0000 7f7f28c00640 1 --2- 172.21.15.112:0/719760966 >> v2:172.21.15.137:3300/0 conn(0x7f7f240d10b0 0x7f7f240b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:48.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.233+0000 7f7f28c00640 1 -- 172.21.15.112:0/719760966 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f2406d550 con 0x7f7f240b5820 2024-09-12T02:47:48.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.234+0000 7f7f28c00640 1 --2- 172.21.15.112:0/719760966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f240b5820 0x7f7f240b3a30 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f7f240688a0 tx=0x7f7f1002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=724b18457722522 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:48.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.234+0000 7f7f23e00640 1 -- 172.21.15.112:0/719760966 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f10037070 con 0x7f7f240b5820 2024-09-12T02:47:48.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.234+0000 7f7f23e00640 1 -- 172.21.15.112:0/719760966 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f10032440 con 0x7f7f240b5820 2024-09-12T02:47:48.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.234+0000 7f7f23e00640 1 -- 172.21.15.112:0/719760966 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f10032810 con 0x7f7f240b5820 2024-09-12T02:47:48.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.235+0000 7f7f2c000640 1 -- 172.21.15.112:0/719760966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f240b5820 msgr2=0x7f7f240b3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:48.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.235+0000 7f7f2c000640 1 --2- 172.21.15.112:0/719760966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f240b5820 0x7f7f240b3a30 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f7f240688a0 tx=0x7f7f1002a1e0 comp rx=0 tx=0).stop 2024-09-12T02:47:48.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.235+0000 7f7f2c000640 1 -- 172.21.15.112:0/719760966 shutdown_connections 2024-09-12T02:47:48.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.235+0000 7f7f2c000640 1 --2- 172.21.15.112:0/719760966 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f240b3f70 0x7f7f2406dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:48.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.235+0000 7f7f2c000640 1 --2- 172.21.15.112:0/719760966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f240b5820 0x7f7f240b3a30 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:48.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.235+0000 7f7f2c000640 1 --2- 172.21.15.112:0/719760966 >> v2:172.21.15.137:3300/0 conn(0x7f7f240d10b0 0x7f7f240b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:48.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.235+0000 7f7f2c000640 1 -- 172.21.15.112:0/719760966 >> 172.21.15.112:0/719760966 conn(0x7f7f240b2730 msgr2=0x7f7f240b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:48.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.235+0000 7f7f2c000640 1 -- 172.21.15.112:0/719760966 shutdown_connections 2024-09-12T02:47:48.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.235+0000 7f7f2c000640 1 -- 172.21.15.112:0/719760966 wait complete. 2024-09-12T02:47:48.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.236+0000 7f7f2c000640 1 Processor -- start 2024-09-12T02:47:48.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.237+0000 7f7f2c000640 1 -- start start 2024-09-12T02:47:48.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.237+0000 7f7f2c000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f240b3f70 0x7f7f24156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:48.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.237+0000 7f7f2c000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f240b5820 0x7f7f241586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:48.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.237+0000 7f7f2c000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f240d10b0 0x7f7f2415b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:48.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.237+0000 7f7f2c000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7f2406e270 con 0x7f7f240d10b0 2024-09-12T02:47:48.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.237+0000 7f7f2c000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7f240d1490 con 0x7f7f240b3f70 2024-09-12T02:47:48.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.237+0000 7f7f2c000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7f2406e3f0 con 0x7f7f240b5820 2024-09-12T02:47:48.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.238+0000 7f7f2a000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f240d10b0 0x7f7f2415b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:48.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.238+0000 7f7f2a000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f240d10b0 0x7f7f2415b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38806/0 (socket says 172.21.15.112:38806) 2024-09-12T02:47:48.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.238+0000 7f7f2a000640 1 -- 172.21.15.112:0/2901298503 learned_addr learned my addr 172.21.15.112:0/2901298503 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:48.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.238+0000 7f7f28c00640 1 --2- 172.21.15.112:0/2901298503 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f240b5820 0x7f7f241586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:48.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.238+0000 7f7f29600640 1 --2- 172.21.15.112:0/2901298503 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f240b3f70 0x7f7f24156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:48.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.238+0000 7f7f2a000640 1 -- 172.21.15.112:0/2901298503 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f240b5820 msgr2=0x7f7f241586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:48.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.238+0000 7f7f2a000640 1 --2- 172.21.15.112:0/2901298503 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f240b5820 0x7f7f241586c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:48.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.238+0000 7f7f2a000640 1 -- 172.21.15.112:0/2901298503 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f240b3f70 msgr2=0x7f7f24156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:48.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.238+0000 7f7f2a000640 1 --2- 172.21.15.112:0/2901298503 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f240b3f70 0x7f7f24156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:48.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.238+0000 7f7f2a000640 1 -- 172.21.15.112:0/2901298503 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f24159190 con 0x7f7f240d10b0 2024-09-12T02:47:48.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.238+0000 7f7f28c00640 1 --2- 172.21.15.112:0/2901298503 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f240b5820 0x7f7f241586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:48.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.238+0000 7f7f2a000640 1 --2- 172.21.15.112:0/2901298503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f240d10b0 0x7f7f2415b940 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00eed0 tx=0x7f7f1c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:48.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.239+0000 7f7f21600640 1 -- 172.21.15.112:0/2901298503 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c018020 con 0x7f7f240d10b0 2024-09-12T02:47:48.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.239+0000 7f7f21600640 1 -- 172.21.15.112:0/2901298503 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f1c00bd20 con 0x7f7f240d10b0 2024-09-12T02:47:48.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.239+0000 7f7f21600640 1 -- 172.21.15.112:0/2901298503 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c014640 con 0x7f7f240d10b0 2024-09-12T02:47:48.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.239+0000 7f7f2c000640 1 -- 172.21.15.112:0/2901298503 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f24158c00 con 0x7f7f240d10b0 2024-09-12T02:47:48.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.239+0000 7f7f2c000640 1 -- 172.21.15.112:0/2901298503 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f24159710 con 0x7f7f240d10b0 2024-09-12T02:47:48.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.240+0000 7f7f2c000640 1 -- 172.21.15.112:0/2901298503 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f2406dd30 con 0x7f7f240d10b0 2024-09-12T02:47:48.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.241+0000 7f7f21600640 1 -- 172.21.15.112:0/2901298503 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7f1c005d10 con 0x7f7f240d10b0 2024-09-12T02:47:48.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.242+0000 7f7f21600640 1 --2- 172.21.15.112:0/2901298503 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7f0406be30 0x7f7f0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:48.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.242+0000 7f7f21600640 1 -- 172.21.15.112:0/2901298503 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5357+0+0 (secure 0 0 0) 0x7f7f1c08b2d0 con 0x7f7f240d10b0 2024-09-12T02:47:48.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.242+0000 7f7f29600640 1 --2- 172.21.15.112:0/2901298503 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7f0406be30 0x7f7f0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:48.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.242+0000 7f7f29600640 1 --2- 172.21.15.112:0/2901298503 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7f0406be30 0x7f7f0406e2f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7f18009b40 tx=0x7f7f18009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:48.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.246+0000 7f7f21600640 1 -- 172.21.15.112:0/2901298503 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7f1c022070 con 0x7f7f240d10b0 2024-09-12T02:47:48.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:48.419+0000 7f7f2c000640 1 -- 172.21.15.112:0/2901298503 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7f24073150 con 0x7f7f240d10b0 2024-09-12T02:47:49.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.055+0000 7f7f21600640 1 -- 172.21.15.112:0/2901298503 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v126) ==== 169+0+0 (secure 0 0 0) 0x7f7f1c0596f0 con 0x7f7f240d10b0 2024-09-12T02:47:49.056 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' removed 2024-09-12T02:47:49.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.058+0000 7f7f2c000640 1 -- 172.21.15.112:0/2901298503 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7f0406be30 msgr2=0x7f7f0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:49.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.058+0000 7f7f2c000640 1 --2- 172.21.15.112:0/2901298503 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7f0406be30 0x7f7f0406e2f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7f18009b40 tx=0x7f7f18009190 comp rx=0 tx=0).stop 2024-09-12T02:47:49.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.058+0000 7f7f2c000640 1 -- 172.21.15.112:0/2901298503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f240d10b0 msgr2=0x7f7f2415b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:49.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.058+0000 7f7f2c000640 1 --2- 172.21.15.112:0/2901298503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f240d10b0 0x7f7f2415b940 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00eed0 tx=0x7f7f1c00b480 comp rx=0 tx=0).stop 2024-09-12T02:47:49.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.062+0000 7f7f2c000640 1 -- 172.21.15.112:0/2901298503 shutdown_connections 2024-09-12T02:47:49.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.062+0000 7f7f2c000640 1 --2- 172.21.15.112:0/2901298503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f240d10b0 0x7f7f2415b940 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:49.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.062+0000 7f7f2c000640 1 --2- 172.21.15.112:0/2901298503 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f240b5820 0x7f7f241586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:49.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.062+0000 7f7f2c000640 1 --2- 172.21.15.112:0/2901298503 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7f0406be30 0x7f7f0406e2f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:49.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.062+0000 7f7f2c000640 1 --2- 172.21.15.112:0/2901298503 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f240b3f70 0x7f7f24156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:49.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.062+0000 7f7f2c000640 1 -- 172.21.15.112:0/2901298503 >> 172.21.15.112:0/2901298503 conn(0x7f7f240b2730 msgr2=0x7f7f240723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:49.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.062+0000 7f7f2c000640 1 -- 172.21.15.112:0/2901298503 shutdown_connections 2024-09-12T02:47:49.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.062+0000 7f7f2c000640 1 -- 172.21.15.112:0/2901298503 wait complete. 2024-09-12T02:47:49.080 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T02:47:49.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.235+0000 7fee73a00640 1 Processor -- start 2024-09-12T02:47:49.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.235+0000 7fee73a00640 1 -- start start 2024-09-12T02:47:49.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.237+0000 7fee73a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fee6c071530 0x7fee6c0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:49.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.237+0000 7fee73a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee6c0ceeb0 con 0x7fee6c0719a0 2024-09-12T02:47:49.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.237+0000 7fee73a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee6c06e300 con 0x7fee6c15cc50 2024-09-12T02:47:49.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.237+0000 7fee73a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fee6c15d030 con 0x7fee6c071530 2024-09-12T02:47:49.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.237+0000 7fee63e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fee6c071530 0x7fee6c0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:49.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.237+0000 7fee71a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fee6c0719a0 0x7fee6c0cf950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36472/0 (socket says 172.21.15.112:36472) 2024-09-12T02:47:49.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.237+0000 7fee63e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fee6c071530 0x7fee6c0af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38814/0 (socket says 172.21.15.112:38814) 2024-09-12T02:47:49.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.237+0000 7fee71a00640 1 -- 172.21.15.112:0/2087955520 learned_addr learned my addr 172.21.15.112:0/2087955520 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:49.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.237+0000 7fee63e00640 1 -- 172.21.15.112:0/2087955520 >> v1:172.21.15.137:6789/0 conn(0x7fee6c15cc50 legacy=0x7fee6c0732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:49.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.237+0000 7fee63e00640 1 -- 172.21.15.112:0/2087955520 >> v1:172.21.15.112:6789/0 conn(0x7fee6c0719a0 legacy=0x7fee6c0cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:49.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.237+0000 7fee63e00640 1 -- 172.21.15.112:0/2087955520 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6c06e5e0 con 0x7fee6c071530 2024-09-12T02:47:49.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.237+0000 7fee6be00640 1 -- 172.21.15.112:0/2087955520 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 842897450 0 0) 0x7fee6c0ceeb0 con 0x7fee6c0719a0 2024-09-12T02:47:49.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.239+0000 7fee63e00640 1 --2- 172.21.15.112:0/2087955520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee6c071530 0x7fee6c0af720 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fee54009790 tx=0x7fee5402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=910fad2474241a64 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:49.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.239+0000 7fee6be00640 1 -- 172.21.15.112:0/2087955520 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee54037070 con 0x7fee6c071530 2024-09-12T02:47:49.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.239+0000 7fee6be00640 1 -- 172.21.15.112:0/2087955520 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee54032440 con 0x7fee6c071530 2024-09-12T02:47:49.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.239+0000 7fee6be00640 1 -- 172.21.15.112:0/2087955520 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee54032810 con 0x7fee6c071530 2024-09-12T02:47:49.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.239+0000 7fee73a00640 1 -- 172.21.15.112:0/2087955520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee6c071530 msgr2=0x7fee6c0af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:49.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.239+0000 7fee73a00640 1 --2- 172.21.15.112:0/2087955520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee6c071530 0x7fee6c0af720 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fee54009790 tx=0x7fee5402a180 comp rx=0 tx=0).stop 2024-09-12T02:47:49.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.239+0000 7fee73a00640 1 -- 172.21.15.112:0/2087955520 shutdown_connections 2024-09-12T02:47:49.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.239+0000 7fee73a00640 1 --2- 172.21.15.112:0/2087955520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee6c071530 0x7fee6c0af720 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:49.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.239+0000 7fee73a00640 1 -- 172.21.15.112:0/2087955520 >> 172.21.15.112:0/2087955520 conn(0x7fee6c06bbd0 msgr2=0x7fee6c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:49.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.239+0000 7fee73a00640 1 -- 172.21.15.112:0/2087955520 shutdown_connections 2024-09-12T02:47:49.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.239+0000 7fee73a00640 1 -- 172.21.15.112:0/2087955520 wait complete. 2024-09-12T02:47:49.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.241+0000 7fee73a00640 1 Processor -- start 2024-09-12T02:47:49.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.241+0000 7fee73a00640 1 -- start start 2024-09-12T02:47:49.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.242+0000 7fee73a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee6c071530 0x7fee6c1463a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:49.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.242+0000 7fee73a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fee6c0719a0 0x7fee6c0b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:49.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.242+0000 7fee73a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee6c15cc50 0x7fee6c0ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:49.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.242+0000 7fee73a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c06f510 con 0x7fee6c15cc50 2024-09-12T02:47:49.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.242+0000 7fee73a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c0cf4c0 con 0x7fee6c071530 2024-09-12T02:47:49.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.242+0000 7fee73a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fee6c06f690 con 0x7fee6c0719a0 2024-09-12T02:47:49.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.242+0000 7fee71a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee6c15cc50 0x7fee6c0ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:49.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.242+0000 7fee71a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee6c15cc50 0x7fee6c0ae8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38824/0 (socket says 172.21.15.112:38824) 2024-09-12T02:47:49.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.242+0000 7fee71a00640 1 -- 172.21.15.112:0/2376919954 learned_addr learned my addr 172.21.15.112:0/2376919954 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:49.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.242+0000 7fee71000640 1 --2- 172.21.15.112:0/2376919954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee6c071530 0x7fee6c1463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:49.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.242+0000 7fee63e00640 1 --2- 172.21.15.112:0/2376919954 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fee6c0719a0 0x7fee6c0b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:49.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.243+0000 7fee71a00640 1 -- 172.21.15.112:0/2376919954 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fee6c0719a0 msgr2=0x7fee6c0b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:49.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.243+0000 7fee71a00640 1 --2- 172.21.15.112:0/2376919954 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fee6c0719a0 0x7fee6c0b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:49.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.243+0000 7fee71a00640 1 -- 172.21.15.112:0/2376919954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee6c071530 msgr2=0x7fee6c1463a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:49.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.243+0000 7fee71a00640 1 --2- 172.21.15.112:0/2376919954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee6c071530 0x7fee6c1463a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:49.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.243+0000 7fee71a00640 1 -- 172.21.15.112:0/2376919954 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6c0b4430 con 0x7fee6c15cc50 2024-09-12T02:47:49.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.243+0000 7fee71a00640 1 --2- 172.21.15.112:0/2376919954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee6c15cc50 0x7fee6c0ae8d0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fee6400c780 tx=0x7fee6400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:49.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.243+0000 7fee69600640 1 -- 172.21.15.112:0/2376919954 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee64018070 con 0x7fee6c15cc50 2024-09-12T02:47:49.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.243+0000 7fee69600640 1 -- 172.21.15.112:0/2376919954 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee6400a640 con 0x7fee6c15cc50 2024-09-12T02:47:49.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.243+0000 7fee69600640 1 -- 172.21.15.112:0/2376919954 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6400aab0 con 0x7fee6c15cc50 2024-09-12T02:47:49.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.243+0000 7fee73a00640 1 -- 172.21.15.112:0/2376919954 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee6c0b4710 con 0x7fee6c15cc50 2024-09-12T02:47:49.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.244+0000 7fee73a00640 1 -- 172.21.15.112:0/2376919954 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee6c1468e0 con 0x7fee6c15cc50 2024-09-12T02:47:49.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.245+0000 7fee73a00640 1 -- 172.21.15.112:0/2376919954 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee6c068a30 con 0x7fee6c15cc50 2024-09-12T02:47:49.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.245+0000 7fee69600640 1 -- 172.21.15.112:0/2376919954 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee6401b070 con 0x7fee6c15cc50 2024-09-12T02:47:49.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.247+0000 7fee69600640 1 --2- 172.21.15.112:0/2376919954 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fee4806be30 0x7fee4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:49.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.247+0000 7fee69600640 1 -- 172.21.15.112:0/2376919954 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 4943+0+0 (secure 0 0 0) 0x7fee6408a180 con 0x7fee6c15cc50 2024-09-12T02:47:49.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.247+0000 7fee71000640 1 --2- 172.21.15.112:0/2376919954 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fee4806be30 0x7fee4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:49.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.248+0000 7fee71000640 1 --2- 172.21.15.112:0/2376919954 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fee4806be30 0x7fee4806e2f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fee5c000f60 tx=0x7fee5c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:49.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.251+0000 7fee69600640 1 -- 172.21.15.112:0/2376919954 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fee64058740 con 0x7fee6c15cc50 2024-09-12T02:47:49.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.422+0000 7fee73a00640 1 -- 172.21.15.112:0/2376919954 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fee6c06df60 con 0x7fee6c15cc50 2024-09-12T02:47:49.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.426+0000 7fee69600640 1 -- 172.21.15.112:0/2376919954 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7fee6405ca40 con 0x7fee6c15cc50 2024-09-12T02:47:49.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.428+0000 7fee73a00640 1 -- 172.21.15.112:0/2376919954 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fee4806be30 msgr2=0x7fee4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:49.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.428+0000 7fee73a00640 1 --2- 172.21.15.112:0/2376919954 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fee4806be30 0x7fee4806e2f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fee5c000f60 tx=0x7fee5c009040 comp rx=0 tx=0).stop 2024-09-12T02:47:49.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.428+0000 7fee73a00640 1 -- 172.21.15.112:0/2376919954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee6c15cc50 msgr2=0x7fee6c0ae8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:49.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.428+0000 7fee73a00640 1 --2- 172.21.15.112:0/2376919954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee6c15cc50 0x7fee6c0ae8d0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fee6400c780 tx=0x7fee6400cc40 comp rx=0 tx=0).stop 2024-09-12T02:47:49.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.428+0000 7fee73a00640 1 -- 172.21.15.112:0/2376919954 shutdown_connections 2024-09-12T02:47:49.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.428+0000 7fee73a00640 1 --2- 172.21.15.112:0/2376919954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee6c15cc50 0x7fee6c0ae8d0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:49.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.428+0000 7fee73a00640 1 --2- 172.21.15.112:0/2376919954 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fee6c0719a0 0x7fee6c0b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:49.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.428+0000 7fee73a00640 1 --2- 172.21.15.112:0/2376919954 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fee4806be30 0x7fee4806e2f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:49.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.428+0000 7fee73a00640 1 --2- 172.21.15.112:0/2376919954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee6c071530 0x7fee6c1463a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:49.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.428+0000 7fee73a00640 1 -- 172.21.15.112:0/2376919954 >> 172.21.15.112:0/2376919954 conn(0x7fee6c06bbd0 msgr2=0x7fee6c0732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:49.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.428+0000 7fee73a00640 1 -- 172.21.15.112:0/2376919954 shutdown_connections 2024-09-12T02:47:49.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.428+0000 7fee73a00640 1 -- 172.21.15.112:0/2376919954 wait complete. 2024-09-12T02:47:49.445 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2024-09-12T02:47:49.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.600+0000 7f962d400640 1 Processor -- start 2024-09-12T02:47:49.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.600+0000 7f962d400640 1 -- start start 2024-09-12T02:47:49.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.601+0000 7f962d400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9628164450 0x7f9628166840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:49.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.601+0000 7f962d400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96280d1650 con 0x7f96280d0fa0 2024-09-12T02:47:49.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.601+0000 7f962d400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96280afbe0 con 0x7f962815b0e0 2024-09-12T02:47:49.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.601+0000 7f962d400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f96280d1410 con 0x7f9628164450 2024-09-12T02:47:49.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.601+0000 7f9627400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f96280d0fa0 0x7f9628162d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36474/0 (socket says 172.21.15.112:36474) 2024-09-12T02:47:49.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.602+0000 7f9627400640 1 -- 172.21.15.112:0/166908031 learned_addr learned my addr 172.21.15.112:0/166908031 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:49.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.602+0000 7f962ca00640 1 --2- 172.21.15.112:0/166908031 >> v2:172.21.15.137:3300/0 conn(0x7f9628164450 0x7f9628166840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:49.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.602+0000 7f9626a00640 1 -- 172.21.15.112:0/166908031 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2592057624 0 0) 0x7f96280d1650 con 0x7f96280d0fa0 2024-09-12T02:47:49.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.602+0000 7f9626a00640 1 -- 172.21.15.112:0/166908031 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f960c005730 con 0x7f96280d0fa0 2024-09-12T02:47:49.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.602+0000 7f9626a00640 1 -- 172.21.15.112:0/166908031 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 615903275 0 0) 0x7f96280afbe0 con 0x7f962815b0e0 2024-09-12T02:47:49.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.602+0000 7f9626a00640 1 -- 172.21.15.112:0/166908031 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96280d1650 con 0x7f962815b0e0 2024-09-12T02:47:49.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.602+0000 7f9626a00640 1 -- 172.21.15.112:0/166908031 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1186351758 0 0) 0x7f960c005730 con 0x7f96280d0fa0 2024-09-12T02:47:49.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.602+0000 7f9626a00640 1 -- 172.21.15.112:0/166908031 >> v2:172.21.15.137:3300/0 conn(0x7f9628164450 msgr2=0x7f9628166840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:49.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.602+0000 7f9626a00640 1 --2- 172.21.15.112:0/166908031 >> v2:172.21.15.137:3300/0 conn(0x7f9628164450 0x7f9628166840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:49.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.602+0000 7f9626a00640 1 -- 172.21.15.112:0/166908031 >> v1:172.21.15.137:6789/0 conn(0x7f962815b0e0 legacy=0x7f96280d0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:49.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.602+0000 7f9626a00640 1 -- 172.21.15.112:0/166908031 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96280afec0 con 0x7f96280d0fa0 2024-09-12T02:47:49.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.602+0000 7f9626a00640 1 -- 172.21.15.112:0/166908031 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f9614001670 con 0x7f96280d0fa0 2024-09-12T02:47:49.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.602+0000 7f9626a00640 1 -- 172.21.15.112:0/166908031 >> v1:172.21.15.112:6789/0 conn(0x7f96280d0fa0 legacy=0x7f9628162d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:49.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.602+0000 7f9626a00640 1 --2- 172.21.15.112:0/166908031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f960c005d50 0x7f960c006150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:49.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.602+0000 7f9626a00640 1 --2- 172.21.15.112:0/166908031 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f960c006a10 0x7f960c006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:49.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.602+0000 7f9626a00640 1 --2- 172.21.15.112:0/166908031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f960c0073d0 0x7f960c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:49.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.602+0000 7f9626a00640 1 -- 172.21.15.112:0/166908031 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f96280d1410 con 0x7f960c005d50 2024-09-12T02:47:49.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.602+0000 7f9626a00640 1 -- 172.21.15.112:0/166908031 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f960c00e250 con 0x7f960c0073d0 2024-09-12T02:47:49.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.602+0000 7f9626a00640 1 -- 172.21.15.112:0/166908031 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f960c00e450 con 0x7f960c006a10 2024-09-12T02:47:49.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.603+0000 7f9627e00640 1 --2- 172.21.15.112:0/166908031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f960c005d50 0x7f960c006150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:49.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.603+0000 7f9627400640 1 --2- 172.21.15.112:0/166908031 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f960c006a10 0x7f960c006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:49.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.603+0000 7f962ca00640 1 --2- 172.21.15.112:0/166908031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f960c0073d0 0x7f960c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:49.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.603+0000 7f9627e00640 1 -- 172.21.15.112:0/166908031 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f960c006a10 msgr2=0x7f960c006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:49.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.603+0000 7f9627e00640 1 --2- 172.21.15.112:0/166908031 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f960c006a10 0x7f960c006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:49.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.603+0000 7f9627e00640 1 -- 172.21.15.112:0/166908031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f960c0073d0 msgr2=0x7f960c00dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:49.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.603+0000 7f9627e00640 1 --2- 172.21.15.112:0/166908031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f960c0073d0 0x7f960c00dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:49.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.603+0000 7f9627e00640 1 -- 172.21.15.112:0/166908031 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f960c005730 con 0x7f960c005d50 2024-09-12T02:47:49.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.603+0000 7f962ca00640 1 --2- 172.21.15.112:0/166908031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f960c0073d0 0x7f960c00dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:49.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.603+0000 7f962ca00640 1 -- 172.21.15.112:0/166908031 reap_dead start 2024-09-12T02:47:49.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.604+0000 7f9627e00640 1 --2- 172.21.15.112:0/166908031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f960c005d50 0x7f960c006150 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f96180018d0 tx=0x7f960c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a3ca3c8fd71e91 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:49.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.604+0000 7f9626a00640 1 -- 172.21.15.112:0/166908031 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96180014f0 con 0x7f960c005d50 2024-09-12T02:47:49.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.604+0000 7f9626a00640 1 -- 172.21.15.112:0/166908031 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96180052d0 con 0x7f960c005d50 2024-09-12T02:47:49.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.604+0000 7f9626a00640 1 -- 172.21.15.112:0/166908031 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f961802ac40 con 0x7f960c005d50 2024-09-12T02:47:49.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.605+0000 7f962d400640 1 -- 172.21.15.112:0/166908031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f960c005d50 msgr2=0x7f960c006150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:49.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.605+0000 7f962d400640 1 --2- 172.21.15.112:0/166908031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f960c005d50 0x7f960c006150 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f96180018d0 tx=0x7f960c007a40 comp rx=0 tx=0).stop 2024-09-12T02:47:49.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.605+0000 7f962d400640 1 -- 172.21.15.112:0/166908031 shutdown_connections 2024-09-12T02:47:49.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.605+0000 7f962d400640 1 --2- 172.21.15.112:0/166908031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f960c005d50 0x7f960c006150 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:49.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.605+0000 7f962d400640 1 -- 172.21.15.112:0/166908031 >> 172.21.15.112:0/166908031 conn(0x7f962806bbd0 msgr2=0x7f962806bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:49.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.605+0000 7f962d400640 1 -- 172.21.15.112:0/166908031 shutdown_connections 2024-09-12T02:47:49.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.605+0000 7f962d400640 1 -- 172.21.15.112:0/166908031 wait complete. 2024-09-12T02:47:49.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.607+0000 7f962d400640 1 Processor -- start 2024-09-12T02:47:49.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.607+0000 7f962d400640 1 -- start start 2024-09-12T02:47:49.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.607+0000 7f962d400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f960c005d50 0x7f96280b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:49.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.608+0000 7f962d400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f962814c790 0x7f9628072c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:49.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.608+0000 7f962d400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f962814ce70 0x7f9628155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:49.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.608+0000 7f962d400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f962815b640 con 0x7f962814c790 2024-09-12T02:47:49.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.608+0000 7f962d400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f962815b4c0 con 0x7f962814ce70 2024-09-12T02:47:49.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.608+0000 7f962d400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f96280d0890 con 0x7f960c005d50 2024-09-12T02:47:49.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.608+0000 7f9627400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f962814c790 0x7f9628072c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:49.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.608+0000 7f9627400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f962814c790 0x7f9628072c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38836/0 (socket says 172.21.15.112:38836) 2024-09-12T02:47:49.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.608+0000 7f9627400640 1 -- 172.21.15.112:0/4261982748 learned_addr learned my addr 172.21.15.112:0/4261982748 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:49.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.608+0000 7f9627e00640 1 --2- 172.21.15.112:0/4261982748 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f960c005d50 0x7f96280b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:49.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.608+0000 7f962ca00640 1 --2- 172.21.15.112:0/4261982748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f962814ce70 0x7f9628155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:49.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.608+0000 7f9627400640 1 -- 172.21.15.112:0/4261982748 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f960c005d50 msgr2=0x7f96280b38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:49.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.608+0000 7f9627400640 1 --2- 172.21.15.112:0/4261982748 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f960c005d50 0x7f96280b38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:49.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.608+0000 7f9627400640 1 -- 172.21.15.112:0/4261982748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f962814ce70 msgr2=0x7f9628155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:49.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.608+0000 7f9627400640 1 --2- 172.21.15.112:0/4261982748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f962814ce70 0x7f9628155dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:49.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.608+0000 7f9627400640 1 -- 172.21.15.112:0/4261982748 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96280b3ec0 con 0x7f962814c790 2024-09-12T02:47:49.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.609+0000 7f9627400640 1 --2- 172.21.15.112:0/4261982748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f962814c790 0x7f9628072c30 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f961400e700 tx=0x7f961400eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:49.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.609+0000 7f961fe00640 1 -- 172.21.15.112:0/4261982748 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f961400c620 con 0x7f962814c790 2024-09-12T02:47:49.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.609+0000 7f961fe00640 1 -- 172.21.15.112:0/4261982748 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9614018070 con 0x7f962814c790 2024-09-12T02:47:49.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.609+0000 7f961fe00640 1 -- 172.21.15.112:0/4261982748 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f961400ca20 con 0x7f962814c790 2024-09-12T02:47:49.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.609+0000 7f962d400640 1 -- 172.21.15.112:0/4261982748 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96281545d0 con 0x7f962814c790 2024-09-12T02:47:49.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.609+0000 7f962d400640 1 -- 172.21.15.112:0/4261982748 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9628154b90 con 0x7f962814c790 2024-09-12T02:47:49.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.610+0000 7f962d400640 1 -- 172.21.15.112:0/4261982748 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96280d0c20 con 0x7f962814c790 2024-09-12T02:47:49.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.611+0000 7f961fe00640 1 -- 172.21.15.112:0/4261982748 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f961400cbc0 con 0x7f962814c790 2024-09-12T02:47:49.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.612+0000 7f961fe00640 1 --2- 172.21.15.112:0/4261982748 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f960806be30 0x7f960806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:49.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.612+0000 7f961fe00640 1 -- 172.21.15.112:0/4261982748 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 4943+0+0 (secure 0 0 0) 0x7f961408a850 con 0x7f962814c790 2024-09-12T02:47:49.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.612+0000 7f9627e00640 1 --2- 172.21.15.112:0/4261982748 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f960806be30 0x7f960806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:49.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.612+0000 7f9627e00640 1 --2- 172.21.15.112:0/4261982748 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f960806be30 0x7f960806e2f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9618032000 tx=0x7f9618009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:49.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.616+0000 7f961fe00640 1 -- 172.21.15.112:0/4261982748 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f96140594f0 con 0x7f962814c790 2024-09-12T02:47:49.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:49.851+0000 7f962d400640 1 -- 172.21.15.112:0/4261982748 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) -- 0x7f96280b34b0 con 0x7f962814c790 2024-09-12T02:47:50.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.057+0000 7f961fe00640 1 -- 172.21.15.112:0/4261982748 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v311) ==== 128+0+0 (secure 0 0 0) 0x7f9614058df0 con 0x7f962814c790 2024-09-12T02:47:50.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.060+0000 7f962d400640 1 -- 172.21.15.112:0/4261982748 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f960806be30 msgr2=0x7f960806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:50.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.060+0000 7f962d400640 1 --2- 172.21.15.112:0/4261982748 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f960806be30 0x7f960806e2f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9618032000 tx=0x7f9618009030 comp rx=0 tx=0).stop 2024-09-12T02:47:50.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.060+0000 7f962d400640 1 -- 172.21.15.112:0/4261982748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f962814c790 msgr2=0x7f9628072c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:50.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.060+0000 7f962d400640 1 --2- 172.21.15.112:0/4261982748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f962814c790 0x7f9628072c30 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f961400e700 tx=0x7f961400eb00 comp rx=0 tx=0).stop 2024-09-12T02:47:50.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.060+0000 7f962d400640 1 -- 172.21.15.112:0/4261982748 shutdown_connections 2024-09-12T02:47:50.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.060+0000 7f962d400640 1 --2- 172.21.15.112:0/4261982748 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f960806be30 0x7f960806e2f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.060+0000 7f962d400640 1 --2- 172.21.15.112:0/4261982748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f962814ce70 0x7f9628155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.060+0000 7f962d400640 1 --2- 172.21.15.112:0/4261982748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f962814c790 0x7f9628072c30 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.060+0000 7f962d400640 1 --2- 172.21.15.112:0/4261982748 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f960c005d50 0x7f96280b38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.060+0000 7f962d400640 1 -- 172.21.15.112:0/4261982748 >> 172.21.15.112:0/4261982748 conn(0x7f962806bbd0 msgr2=0x7f96280cf600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:50.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.060+0000 7f962d400640 1 -- 172.21.15.112:0/4261982748 shutdown_connections 2024-09-12T02:47:50.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.060+0000 7f962d400640 1 -- 172.21.15.112:0/4261982748 wait complete. 2024-09-12T02:47:50.077 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2024-09-12T02:47:50.077 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) 2024-09-12T02:47:50.078 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:47:50.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.230+0000 7f33c9000640 1 Processor -- start 2024-09-12T02:47:50.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.230+0000 7f33c9000640 1 -- start start 2024-09-12T02:47:50.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.232+0000 7f33c9000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33c406f600 0x7f33c40b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:50.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.232+0000 7f33c9000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f33c40b45d0 0x7f33c40728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:50.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.232+0000 7f33c9000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33c40b4a20 con 0x7f33c415b9d0 2024-09-12T02:47:50.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.232+0000 7f33c9000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f33c40b54a0 con 0x7f33c40b45d0 2024-09-12T02:47:50.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.232+0000 7f33c9000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f33c40b3af0 con 0x7f33c406f600 2024-09-12T02:47:50.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.232+0000 7f33c1e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f33c415b9d0 0x7f33c406eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36488/0 (socket says 172.21.15.112:36488) 2024-09-12T02:47:50.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.232+0000 7f33c1e00640 1 -- 172.21.15.112:0/2747626077 learned_addr learned my addr 172.21.15.112:0/2747626077 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:50.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.232+0000 7f33b9400640 1 --2- 172.21.15.112:0/2747626077 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33c406f600 0x7f33c40b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:50.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.232+0000 7f33c2800640 1 --2- 172.21.15.112:0/2747626077 >> v2:172.21.15.137:3300/0 conn(0x7f33c40b45d0 0x7f33c40728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:50.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.232+0000 7f33c1400640 1 -- 172.21.15.112:0/2747626077 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2752524299 0 0) 0x7f33c40b4a20 con 0x7f33c415b9d0 2024-09-12T02:47:50.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.232+0000 7f33c1400640 1 -- 172.21.15.112:0/2747626077 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33a8005730 con 0x7f33c415b9d0 2024-09-12T02:47:50.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.233+0000 7f33c1400640 1 -- 172.21.15.112:0/2747626077 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 294660522 0 0) 0x7f33a8005730 con 0x7f33c415b9d0 2024-09-12T02:47:50.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.233+0000 7f33c1400640 1 -- 172.21.15.112:0/2747626077 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33c406f600 msgr2=0x7f33c40b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:50.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.233+0000 7f33c1400640 1 --2- 172.21.15.112:0/2747626077 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33c406f600 0x7f33c40b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.233+0000 7f33c1400640 1 -- 172.21.15.112:0/2747626077 >> v2:172.21.15.137:3300/0 conn(0x7f33c40b45d0 msgr2=0x7f33c40728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:50.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.233+0000 7f33c1400640 1 --2- 172.21.15.112:0/2747626077 >> v2:172.21.15.137:3300/0 conn(0x7f33c40b45d0 0x7f33c40728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.233+0000 7f33c1400640 1 -- 172.21.15.112:0/2747626077 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c40b3dd0 con 0x7f33c415b9d0 2024-09-12T02:47:50.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.233+0000 7f33c1400640 1 -- 172.21.15.112:0/2747626077 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f33b4001670 con 0x7f33c415b9d0 2024-09-12T02:47:50.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.233+0000 7f33c1400640 1 -- 172.21.15.112:0/2747626077 >> v1:172.21.15.112:6789/0 conn(0x7f33c415b9d0 legacy=0x7f33c406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:50.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.233+0000 7f33c1400640 1 --2- 172.21.15.112:0/2747626077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33a8005bc0 0x7f33a8005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:50.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.233+0000 7f33c1400640 1 --2- 172.21.15.112:0/2747626077 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33a8006520 0x7f33a8006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:50.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.233+0000 7f33c1400640 1 --2- 172.21.15.112:0/2747626077 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33a8006f50 0x7f33a80073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:50.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.233+0000 7f33c1400640 1 -- 172.21.15.112:0/2747626077 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f33c40b54a0 con 0x7f33a8005bc0 2024-09-12T02:47:50.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.233+0000 7f33c1400640 1 -- 172.21.15.112:0/2747626077 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f33c40b3af0 con 0x7f33a8006520 2024-09-12T02:47:50.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.233+0000 7f33c1400640 1 -- 172.21.15.112:0/2747626077 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f33a80102e0 con 0x7f33a8006f50 2024-09-12T02:47:50.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.233+0000 7f33b9400640 1 --2- 172.21.15.112:0/2747626077 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33c406f600 0x7f33c40b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:50.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.233+0000 7f33c1e00640 1 --2- 172.21.15.112:0/2747626077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33a8005bc0 0x7f33a8005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:50.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.233+0000 7f33c2800640 1 --2- 172.21.15.112:0/2747626077 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33a8006f50 0x7f33a80073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:50.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.233+0000 7f33b9400640 1 --2- 172.21.15.112:0/2747626077 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33a8006520 0x7f33a8006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:50.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.233+0000 7f33c1e00640 1 -- 172.21.15.112:0/2747626077 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33a8006f50 msgr2=0x7f33a80073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:50.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.233+0000 7f33c1e00640 1 --2- 172.21.15.112:0/2747626077 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33a8006f50 0x7f33a80073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.233+0000 7f33c1e00640 1 -- 172.21.15.112:0/2747626077 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33a8006520 msgr2=0x7f33a8006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:50.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.233+0000 7f33c1e00640 1 --2- 172.21.15.112:0/2747626077 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33a8006520 0x7f33a8006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.233+0000 7f33c1e00640 1 -- 172.21.15.112:0/2747626077 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a8005730 con 0x7f33a8005bc0 2024-09-12T02:47:50.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.234+0000 7f33c1e00640 1 --2- 172.21.15.112:0/2747626077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33a8005bc0 0x7f33a8005fe0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f33b400c290 tx=0x7f33a8007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=225c6e873b47aea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:50.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.235+0000 7f33c1400640 1 -- 172.21.15.112:0/2747626077 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b4007d50 con 0x7f33a8005bc0 2024-09-12T02:47:50.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.235+0000 7f33c1400640 1 -- 172.21.15.112:0/2747626077 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33b4005af0 con 0x7f33a8005bc0 2024-09-12T02:47:50.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.235+0000 7f33c1400640 1 -- 172.21.15.112:0/2747626077 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b4007070 con 0x7f33a8005bc0 2024-09-12T02:47:50.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.235+0000 7f33c9000640 1 -- 172.21.15.112:0/2747626077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33a8005bc0 msgr2=0x7f33a8005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:50.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.235+0000 7f33c9000640 1 --2- 172.21.15.112:0/2747626077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33a8005bc0 0x7f33a8005fe0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f33b400c290 tx=0x7f33a8007a40 comp rx=0 tx=0).stop 2024-09-12T02:47:50.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.235+0000 7f33c2800640 1 -- 172.21.15.112:0/2747626077 reap_dead start 2024-09-12T02:47:50.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.235+0000 7f33c9000640 1 -- 172.21.15.112:0/2747626077 shutdown_connections 2024-09-12T02:47:50.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.235+0000 7f33c9000640 1 -- 172.21.15.112:0/2747626077 >> 172.21.15.112:0/2747626077 conn(0x7f33c406bbd0 msgr2=0x7f33c406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:50.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.235+0000 7f33c9000640 1 -- 172.21.15.112:0/2747626077 shutdown_connections 2024-09-12T02:47:50.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.235+0000 7f33c9000640 1 -- 172.21.15.112:0/2747626077 wait complete. 2024-09-12T02:47:50.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.237+0000 7f33c9000640 1 Processor -- start 2024-09-12T02:47:50.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.237+0000 7f33c9000640 1 -- start start 2024-09-12T02:47:50.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.238+0000 7f33c9000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33a8005bc0 0x7f33c414fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:50.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.238+0000 7f33c9000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33c41446b0 0x7f33c4143fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:50.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.238+0000 7f33c9000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33c4150910 0x7f33c4150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:50.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.238+0000 7f33c9000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f33c415bf30 con 0x7f33c41446b0 2024-09-12T02:47:50.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.238+0000 7f33c9000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f33c415bdb0 con 0x7f33c4150910 2024-09-12T02:47:50.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.238+0000 7f33c9000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f33c40b4ec0 con 0x7f33a8005bc0 2024-09-12T02:47:50.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.238+0000 7f33b9400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33c41446b0 0x7f33c4143fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:50.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.238+0000 7f33b9400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33c41446b0 0x7f33c4143fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38860/0 (socket says 172.21.15.112:38860) 2024-09-12T02:47:50.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.238+0000 7f33b9400640 1 -- 172.21.15.112:0/3590269539 learned_addr learned my addr 172.21.15.112:0/3590269539 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:50.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.238+0000 7f33c1e00640 1 --2- 172.21.15.112:0/3590269539 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33a8005bc0 0x7f33c414fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:50.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.238+0000 7f33c2800640 1 --2- 172.21.15.112:0/3590269539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33c4150910 0x7f33c4150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:50.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.238+0000 7f33b9400640 1 -- 172.21.15.112:0/3590269539 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33a8005bc0 msgr2=0x7f33c414fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:50.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.238+0000 7f33b9400640 1 --2- 172.21.15.112:0/3590269539 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33a8005bc0 0x7f33c414fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.238+0000 7f33b9400640 1 -- 172.21.15.112:0/3590269539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33c4150910 msgr2=0x7f33c4150dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:50.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.238+0000 7f33b9400640 1 --2- 172.21.15.112:0/3590269539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33c4150910 0x7f33c4150dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.239+0000 7f33b9400640 1 -- 172.21.15.112:0/3590269539 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c41f5090 con 0x7f33c41446b0 2024-09-12T02:47:50.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.239+0000 7f33c2800640 1 --2- 172.21.15.112:0/3590269539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33c4150910 0x7f33c4150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:50.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.239+0000 7f33b9400640 1 --2- 172.21.15.112:0/3590269539 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33c41446b0 0x7f33c4143fc0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f33ac011830 tx=0x7f33ac011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:50.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.239+0000 7f33baa00640 1 -- 172.21.15.112:0/3590269539 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac004220 con 0x7f33c41446b0 2024-09-12T02:47:50.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.239+0000 7f33baa00640 1 -- 172.21.15.112:0/3590269539 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33ac0043c0 con 0x7f33c41446b0 2024-09-12T02:47:50.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.239+0000 7f33c9000640 1 -- 172.21.15.112:0/3590269539 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33c4159770 con 0x7f33c41446b0 2024-09-12T02:47:50.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.239+0000 7f33baa00640 1 -- 172.21.15.112:0/3590269539 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac00f9a0 con 0x7f33c41446b0 2024-09-12T02:47:50.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.239+0000 7f33c9000640 1 -- 172.21.15.112:0/3590269539 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33c4152c90 con 0x7f33c41446b0 2024-09-12T02:47:50.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.240+0000 7f33c9000640 1 -- 172.21.15.112:0/3590269539 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33c4068a30 con 0x7f33c41446b0 2024-09-12T02:47:50.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.241+0000 7f33baa00640 1 -- 172.21.15.112:0/3590269539 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f33ac00fd50 con 0x7f33c41446b0 2024-09-12T02:47:50.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.242+0000 7f33baa00640 1 --2- 172.21.15.112:0/3590269539 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f33a006be30 0x7f33a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:50.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.242+0000 7f33baa00640 1 -- 172.21.15.112:0/3590269539 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 4943+0+0 (secure 0 0 0) 0x7f33ac08b480 con 0x7f33c41446b0 2024-09-12T02:47:50.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.242+0000 7f33c1e00640 1 --2- 172.21.15.112:0/3590269539 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f33a006be30 0x7f33a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:50.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.243+0000 7f33c1e00640 1 --2- 172.21.15.112:0/3590269539 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f33a006be30 0x7f33a006e2f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f33b4033000 tx=0x7f33b4009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:50.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.247+0000 7f33baa00640 1 -- 172.21.15.112:0/3590269539 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f33ac019030 con 0x7f33c41446b0 2024-09-12T02:47:50.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.420+0000 7f33c9000640 1 -- 172.21.15.112:0/3590269539 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f33c40728c0 con 0x7f33c41446b0 2024-09-12T02:47:50.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.421+0000 7f33baa00640 1 -- 172.21.15.112:0/3590269539 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) ==== 74+0+13089 (secure 0 0 0) 0x7f33ac05a1c0 con 0x7f33c41446b0 2024-09-12T02:47:50.422 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:50.422 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":126,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:47:49.050852+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6836/63450161":"2024-09-13T02:47:46.044630+0000","172.21.15.112:6834/63450161":"2024-09-13T02:47:46.044630+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:47:50.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.423+0000 7f33c9000640 1 -- 172.21.15.112:0/3590269539 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f33a006be30 msgr2=0x7f33a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:50.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.423+0000 7f33c9000640 1 --2- 172.21.15.112:0/3590269539 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f33a006be30 0x7f33a006e2f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f33b4033000 tx=0x7f33b4009030 comp rx=0 tx=0).stop 2024-09-12T02:47:50.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.423+0000 7f33c9000640 1 -- 172.21.15.112:0/3590269539 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33c41446b0 msgr2=0x7f33c4143fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:50.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.423+0000 7f33c9000640 1 --2- 172.21.15.112:0/3590269539 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33c41446b0 0x7f33c4143fc0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f33ac011830 tx=0x7f33ac011cf0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.423+0000 7f33c9000640 1 -- 172.21.15.112:0/3590269539 shutdown_connections 2024-09-12T02:47:50.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.423+0000 7f33c9000640 1 --2- 172.21.15.112:0/3590269539 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f33a006be30 0x7f33a006e2f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.423+0000 7f33c9000640 1 --2- 172.21.15.112:0/3590269539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33c4150910 0x7f33c4150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.423+0000 7f33c9000640 1 --2- 172.21.15.112:0/3590269539 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33c41446b0 0x7f33c4143fc0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.423+0000 7f33c9000640 1 --2- 172.21.15.112:0/3590269539 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33a8005bc0 0x7f33c414fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.423+0000 7f33c9000640 1 -- 172.21.15.112:0/3590269539 >> 172.21.15.112:0/3590269539 conn(0x7f33c406bbd0 msgr2=0x7f33c4071710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:50.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.423+0000 7f33c9000640 1 -- 172.21.15.112:0/3590269539 shutdown_connections 2024-09-12T02:47:50.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.423+0000 7f33c9000640 1 -- 172.21.15.112:0/3590269539 wait complete. 2024-09-12T02:47:50.440 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:41:43.011599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:47:50.440 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T02:47:50.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.596+0000 7f58f7200640 1 Processor -- start 2024-09-12T02:47:50.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.596+0000 7f58f7200640 1 -- start start 2024-09-12T02:47:50.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.597+0000 7f58f7200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f58f015b9a0 0x7f58f006d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:50.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.597+0000 7f58f7200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f58f006f270 0x7f58f00b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:50.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.597+0000 7f58f7200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58f00b42c0 con 0x7f58f00b5560 2024-09-12T02:47:50.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.597+0000 7f58f7200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f58f006de70 con 0x7f58f006f270 2024-09-12T02:47:50.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.597+0000 7f58f7200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f58f015bd80 con 0x7f58f015b9a0 2024-09-12T02:47:50.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.597+0000 7f58f5400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f58f006f270 0x7f58f00b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:50.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.597+0000 7f58f5400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f58f006f270 0x7f58f00b5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38872/0 (socket says 172.21.15.112:38872) 2024-09-12T02:47:50.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.597+0000 7f58f5400640 1 -- 172.21.15.112:0/1736859816 learned_addr learned my addr 172.21.15.112:0/1736859816 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:50.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.598+0000 7f58f5e00640 1 --2- 172.21.15.112:0/1736859816 >> v2:172.21.15.137:3300/0 conn(0x7f58f015b9a0 0x7f58f006d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:50.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.598+0000 7f58f5400640 1 -- 172.21.15.112:0/1736859816 >> v2:172.21.15.137:3300/0 conn(0x7f58f015b9a0 msgr2=0x7f58f006d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:50.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.598+0000 7f58f5400640 1 --2- 172.21.15.112:0/1736859816 >> v2:172.21.15.137:3300/0 conn(0x7f58f015b9a0 0x7f58f006d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.598+0000 7f58f5400640 1 -- 172.21.15.112:0/1736859816 >> v1:172.21.15.137:6789/0 conn(0x7f58f00b5560 legacy=0x7f58f00d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:50.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.598+0000 7f58f5400640 1 -- 172.21.15.112:0/1736859816 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f006db90 con 0x7f58f006f270 2024-09-12T02:47:50.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.599+0000 7f58f5400640 1 --2- 172.21.15.112:0/1736859816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58f006f270 0x7f58f00b5020 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f58f0070050 tx=0x7f58e002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4db1f32685688c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:50.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.599+0000 7f58f4a00640 1 -- 172.21.15.112:0/1736859816 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e0037070 con 0x7f58f006f270 2024-09-12T02:47:50.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.599+0000 7f58f4a00640 1 -- 172.21.15.112:0/1736859816 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58e0032440 con 0x7f58f006f270 2024-09-12T02:47:50.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.599+0000 7f58f4a00640 1 -- 172.21.15.112:0/1736859816 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e0032810 con 0x7f58f006f270 2024-09-12T02:47:50.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.600+0000 7f58f7200640 1 -- 172.21.15.112:0/1736859816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58f006f270 msgr2=0x7f58f00b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:50.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.600+0000 7f58f7200640 1 --2- 172.21.15.112:0/1736859816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58f006f270 0x7f58f00b5020 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f58f0070050 tx=0x7f58e002a1e0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.600+0000 7f58f7200640 1 -- 172.21.15.112:0/1736859816 shutdown_connections 2024-09-12T02:47:50.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.600+0000 7f58f7200640 1 --2- 172.21.15.112:0/1736859816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58f006f270 0x7f58f00b5020 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.600+0000 7f58f7200640 1 --2- 172.21.15.112:0/1736859816 >> v2:172.21.15.137:3300/0 conn(0x7f58f015b9a0 0x7f58f006d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.600+0000 7f58f7200640 1 -- 172.21.15.112:0/1736859816 >> 172.21.15.112:0/1736859816 conn(0x7f58f006bbd0 msgr2=0x7f58f006bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:50.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.600+0000 7f58f7200640 1 -- 172.21.15.112:0/1736859816 shutdown_connections 2024-09-12T02:47:50.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.600+0000 7f58f7200640 1 -- 172.21.15.112:0/1736859816 wait complete. 2024-09-12T02:47:50.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.601+0000 7f58f7200640 1 Processor -- start 2024-09-12T02:47:50.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.601+0000 7f58f7200640 1 -- start start 2024-09-12T02:47:50.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.602+0000 7f58f7200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58f006f270 0x7f58f0146ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:50.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.602+0000 7f58f7200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58f015b9a0 0x7f58f015bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:50.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.602+0000 7f58f7200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f58f015ea30 0x7f58f015cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:50.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.602+0000 7f58f7200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f58f00b4b00 con 0x7f58f006f270 2024-09-12T02:47:50.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.602+0000 7f58f7200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f58f00b4820 con 0x7f58f015b9a0 2024-09-12T02:47:50.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.602+0000 7f58f7200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f58f00b5b50 con 0x7f58f015ea30 2024-09-12T02:47:50.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.602+0000 7f58f5e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58f006f270 0x7f58f0146ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:50.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.603+0000 7f58f5e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58f006f270 0x7f58f0146ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38888/0 (socket says 172.21.15.112:38888) 2024-09-12T02:47:50.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.603+0000 7f58f5e00640 1 -- 172.21.15.112:0/2835178584 learned_addr learned my addr 172.21.15.112:0/2835178584 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:50.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.603+0000 7f58f5400640 1 --2- 172.21.15.112:0/2835178584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58f015b9a0 0x7f58f015bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:50.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.603+0000 7f58f6800640 1 --2- 172.21.15.112:0/2835178584 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f58f015ea30 0x7f58f015cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:50.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.603+0000 7f58f5e00640 1 -- 172.21.15.112:0/2835178584 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f58f015ea30 msgr2=0x7f58f015cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:50.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.603+0000 7f58f5e00640 1 --2- 172.21.15.112:0/2835178584 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f58f015ea30 0x7f58f015cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.603+0000 7f58f5e00640 1 -- 172.21.15.112:0/2835178584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58f015b9a0 msgr2=0x7f58f015bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:50.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.603+0000 7f58f5e00640 1 --2- 172.21.15.112:0/2835178584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58f015b9a0 0x7f58f015bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.603+0000 7f58f5e00640 1 -- 172.21.15.112:0/2835178584 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f015d990 con 0x7f58f006f270 2024-09-12T02:47:50.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.603+0000 7f58f5e00640 1 --2- 172.21.15.112:0/2835178584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58f006f270 0x7f58f0146ed0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f58e400d5d0 tx=0x7f58e400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:50.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.604+0000 7f58ea000640 1 -- 172.21.15.112:0/2835178584 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e40125f0 con 0x7f58f006f270 2024-09-12T02:47:50.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.604+0000 7f58ea000640 1 -- 172.21.15.112:0/2835178584 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58e4019070 con 0x7f58f006f270 2024-09-12T02:47:50.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.604+0000 7f58ea000640 1 -- 172.21.15.112:0/2835178584 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e40129f0 con 0x7f58f006f270 2024-09-12T02:47:50.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.604+0000 7f58f7200640 1 -- 172.21.15.112:0/2835178584 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58f015dc70 con 0x7f58f006f270 2024-09-12T02:47:50.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.604+0000 7f58f7200640 1 -- 172.21.15.112:0/2835178584 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58f015e230 con 0x7f58f006f270 2024-09-12T02:47:50.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.605+0000 7f58f7200640 1 -- 172.21.15.112:0/2835178584 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58f00b5020 con 0x7f58f006f270 2024-09-12T02:47:50.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.606+0000 7f58ea000640 1 -- 172.21.15.112:0/2835178584 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f58e4012b90 con 0x7f58f006f270 2024-09-12T02:47:50.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.606+0000 7f58ea000640 1 --2- 172.21.15.112:0/2835178584 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f58d406be30 0x7f58d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:50.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.607+0000 7f58ea000640 1 -- 172.21.15.112:0/2835178584 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 4943+0+0 (secure 0 0 0) 0x7f58e408af20 con 0x7f58f006f270 2024-09-12T02:47:50.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.607+0000 7f58f5400640 1 --2- 172.21.15.112:0/2835178584 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f58d406be30 0x7f58d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:50.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.607+0000 7f58f5400640 1 --2- 172.21.15.112:0/2835178584 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f58d406be30 0x7f58d406e2f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f58e0034000 tx=0x7f58e002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:50.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.611+0000 7f58ea000640 1 -- 172.21.15.112:0/2835178584 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f58e40594e0 con 0x7f58f006f270 2024-09-12T02:47:50.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.781+0000 7f58f7200640 1 -- 172.21.15.112:0/2835178584 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f58f0150300 con 0x7f58f006f270 2024-09-12T02:47:50.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.782+0000 7f58ea000640 1 -- 172.21.15.112:0/2835178584 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v126) ==== 93+0+10 (secure 0 0 0) 0x7f58e405d7e0 con 0x7f58f006f270 2024-09-12T02:47:50.783 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2024-09-12T02:47:50.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.784+0000 7f58f7200640 1 -- 172.21.15.112:0/2835178584 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f58d406be30 msgr2=0x7f58d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:50.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.784+0000 7f58f7200640 1 --2- 172.21.15.112:0/2835178584 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f58d406be30 0x7f58d406e2f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f58e0034000 tx=0x7f58e002e000 comp rx=0 tx=0).stop 2024-09-12T02:47:50.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.784+0000 7f58f7200640 1 -- 172.21.15.112:0/2835178584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58f006f270 msgr2=0x7f58f0146ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:50.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.784+0000 7f58f7200640 1 --2- 172.21.15.112:0/2835178584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58f006f270 0x7f58f0146ed0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f58e400d5d0 tx=0x7f58e400da90 comp rx=0 tx=0).stop 2024-09-12T02:47:50.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.784+0000 7f58f7200640 1 -- 172.21.15.112:0/2835178584 shutdown_connections 2024-09-12T02:47:50.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.784+0000 7f58f7200640 1 --2- 172.21.15.112:0/2835178584 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f58f015ea30 0x7f58f015cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.784+0000 7f58f7200640 1 --2- 172.21.15.112:0/2835178584 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f58d406be30 0x7f58d406e2f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.784+0000 7f58f7200640 1 --2- 172.21.15.112:0/2835178584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58f015b9a0 0x7f58f015bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.784+0000 7f58f7200640 1 --2- 172.21.15.112:0/2835178584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58f006f270 0x7f58f0146ed0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.784+0000 7f58f7200640 1 -- 172.21.15.112:0/2835178584 >> 172.21.15.112:0/2835178584 conn(0x7f58f006bbd0 msgr2=0x7f58f0159430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:50.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.784+0000 7f58f7200640 1 -- 172.21.15.112:0/2835178584 shutdown_connections 2024-09-12T02:47:50.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.784+0000 7f58f7200640 1 -- 172.21.15.112:0/2835178584 wait complete. 2024-09-12T02:47:50.801 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2024-09-12T02:47:50.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.953+0000 7f3247e00640 1 Processor -- start 2024-09-12T02:47:50.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.953+0000 7f3247e00640 1 -- start start 2024-09-12T02:47:50.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.954+0000 7f3247e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32480d1710 0x7f32480d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:50.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.954+0000 7f3247e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32480d2fb0 con 0x7f32480b1d70 2024-09-12T02:47:50.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.954+0000 7f3247e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32480d0b60 con 0x7f32480b3e00 2024-09-12T02:47:50.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.954+0000 7f3247e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f32480d3cb0 con 0x7f32480d1710 2024-09-12T02:47:50.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.954+0000 7f3247400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f32480b1d70 0x7f32480b2220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36498/0 (socket says 172.21.15.112:36498) 2024-09-12T02:47:50.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.954+0000 7f3247400640 1 -- 172.21.15.112:0/3791667885 learned_addr learned my addr 172.21.15.112:0/3791667885 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:50.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.955+0000 7f3246a00640 1 --2- 172.21.15.112:0/3791667885 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32480d1710 0x7f32480d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:50.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.955+0000 7f3245600640 1 -- 172.21.15.112:0/3791667885 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3889082859 0 0) 0x7f32480d2fb0 con 0x7f32480b1d70 2024-09-12T02:47:50.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.955+0000 7f3245600640 1 -- 172.21.15.112:0/3791667885 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f322c003520 con 0x7f32480b1d70 2024-09-12T02:47:50.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.955+0000 7f3245600640 1 -- 172.21.15.112:0/3791667885 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4038643151 0 0) 0x7f32480d0b60 con 0x7f32480b3e00 2024-09-12T02:47:50.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.955+0000 7f3245600640 1 -- 172.21.15.112:0/3791667885 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32480d2fb0 con 0x7f32480b3e00 2024-09-12T02:47:50.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.955+0000 7f3245600640 1 -- 172.21.15.112:0/3791667885 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1169000326 0 0) 0x7f322c003520 con 0x7f32480b1d70 2024-09-12T02:47:50.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.955+0000 7f3246a00640 1 -- 172.21.15.112:0/3791667885 >> v1:172.21.15.137:6789/0 conn(0x7f32480b3e00 legacy=0x7f32480d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:50.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.955+0000 7f3246a00640 1 -- 172.21.15.112:0/3791667885 >> v1:172.21.15.112:6789/0 conn(0x7f32480b1d70 legacy=0x7f32480b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:50.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.955+0000 7f3246a00640 1 -- 172.21.15.112:0/3791667885 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32480d3410 con 0x7f32480d1710 2024-09-12T02:47:50.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.956+0000 7f3246a00640 1 --2- 172.21.15.112:0/3791667885 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32480d1710 0x7f32480d28d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f32380097d0 tx=0x7f323802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=439cb0feb9deb104 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:50.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.956+0000 7f3245600640 1 -- 172.21.15.112:0/3791667885 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3238037070 con 0x7f32480d1710 2024-09-12T02:47:50.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.956+0000 7f3245600640 1 -- 172.21.15.112:0/3791667885 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f323802ac30 con 0x7f32480d1710 2024-09-12T02:47:50.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.956+0000 7f3245600640 1 -- 172.21.15.112:0/3791667885 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32400019f0 con 0x7f32480d1710 2024-09-12T02:47:50.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.957+0000 7f3247e00640 1 -- 172.21.15.112:0/3791667885 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32480d1710 msgr2=0x7f32480d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:50.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.957+0000 7f3247e00640 1 --2- 172.21.15.112:0/3791667885 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32480d1710 0x7f32480d28d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f32380097d0 tx=0x7f323802a1a0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.957+0000 7f3247e00640 1 -- 172.21.15.112:0/3791667885 shutdown_connections 2024-09-12T02:47:50.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.957+0000 7f3247e00640 1 --2- 172.21.15.112:0/3791667885 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32480d1710 0x7f32480d28d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.957+0000 7f3247e00640 1 -- 172.21.15.112:0/3791667885 >> 172.21.15.112:0/3791667885 conn(0x7f324809e030 msgr2=0x7f32480d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:50.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.957+0000 7f3247e00640 1 -- 172.21.15.112:0/3791667885 shutdown_connections 2024-09-12T02:47:50.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.957+0000 7f3247e00640 1 -- 172.21.15.112:0/3791667885 wait complete. 2024-09-12T02:47:50.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.959+0000 7f3247e00640 1 Processor -- start 2024-09-12T02:47:50.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.959+0000 7f3247e00640 1 -- start start 2024-09-12T02:47:50.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.960+0000 7f3247e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32480b1d70 0x7f32480cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:50.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.960+0000 7f3247e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32480b3e00 0x7f324814f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:50.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.960+0000 7f3247e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32480d1710 0x7f32480cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:50.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.960+0000 7f3247e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f324815f110 con 0x7f32480b1d70 2024-09-12T02:47:50.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.960+0000 7f3247e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f32480d39d0 con 0x7f32480d1710 2024-09-12T02:47:50.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.960+0000 7f3247e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f324815f290 con 0x7f32480b3e00 2024-09-12T02:47:50.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.960+0000 7f3246a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32480b1d70 0x7f32480cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:50.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.960+0000 7f3246a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32480b1d70 0x7f32480cab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38896/0 (socket says 172.21.15.112:38896) 2024-09-12T02:47:50.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.960+0000 7f3246a00640 1 -- 172.21.15.112:0/1888849110 learned_addr learned my addr 172.21.15.112:0/1888849110 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:50.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.960+0000 7f3246a00640 1 -- 172.21.15.112:0/1888849110 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32480b3e00 msgr2=0x7f324814f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:50.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.960+0000 7f3246a00640 1 --2- 172.21.15.112:0/1888849110 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32480b3e00 0x7f324814f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.960+0000 7f3246a00640 1 -- 172.21.15.112:0/1888849110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32480d1710 msgr2=0x7f32480cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:50.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.960+0000 7f3246a00640 1 --2- 172.21.15.112:0/1888849110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32480d1710 0x7f32480cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.960+0000 7f3246a00640 1 -- 172.21.15.112:0/1888849110 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f324814f680 con 0x7f32480b1d70 2024-09-12T02:47:50.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.961+0000 7f3246a00640 1 --2- 172.21.15.112:0/1888849110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32480b1d70 0x7f32480cab90 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f3238035040 tx=0x7f32380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:50.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.961+0000 7f323ea00640 1 -- 172.21.15.112:0/1888849110 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3238041020 con 0x7f32480b1d70 2024-09-12T02:47:50.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.961+0000 7f323ea00640 1 -- 172.21.15.112:0/1888849110 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f323803d640 con 0x7f32480b1d70 2024-09-12T02:47:50.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.961+0000 7f3247e00640 1 -- 172.21.15.112:0/1888849110 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32481615a0 con 0x7f32480b1d70 2024-09-12T02:47:50.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.961+0000 7f323ea00640 1 -- 172.21.15.112:0/1888849110 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3238037040 con 0x7f32480b1d70 2024-09-12T02:47:50.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.961+0000 7f3247e00640 1 -- 172.21.15.112:0/1888849110 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3248161b60 con 0x7f32480b1d70 2024-09-12T02:47:50.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.962+0000 7f3247e00640 1 -- 172.21.15.112:0/1888849110 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32480d28d0 con 0x7f32480b1d70 2024-09-12T02:47:50.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.963+0000 7f323ea00640 1 -- 172.21.15.112:0/1888849110 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3238044020 con 0x7f32480b1d70 2024-09-12T02:47:50.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.964+0000 7f323ea00640 1 --2- 172.21.15.112:0/1888849110 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f322806be30 0x7f322806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:50.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.965+0000 7f323ea00640 1 -- 172.21.15.112:0/1888849110 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 4943+0+0 (secure 0 0 0) 0x7f32380ab100 con 0x7f32480b1d70 2024-09-12T02:47:50.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.965+0000 7f3246000640 1 --2- 172.21.15.112:0/1888849110 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f322806be30 0x7f322806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:50.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.965+0000 7f3246000640 1 --2- 172.21.15.112:0/1888849110 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f322806be30 0x7f322806e2f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f32340011e0 tx=0x7f32340078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:50.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:50.969+0000 7f323ea00640 1 -- 172.21.15.112:0/1888849110 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f323804b030 con 0x7f32480b1d70 2024-09-12T02:47:51.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:51.209+0000 7f3247e00640 1 -- 172.21.15.112:0/1888849110 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) -- 0x7f32480c86d0 con 0x7f32480b1d70 2024-09-12T02:47:51.765 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:47:51.770 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:47:52.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.064+0000 7f323ea00640 1 -- 172.21.15.112:0/1888849110 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v313) ==== 143+0+0 (secure 0 0 0) 0x7f324814f680 con 0x7f32480b1d70 2024-09-12T02:47:52.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.066+0000 7f3247e00640 1 -- 172.21.15.112:0/1888849110 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f322806be30 msgr2=0x7f322806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:52.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.066+0000 7f3247e00640 1 --2- 172.21.15.112:0/1888849110 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f322806be30 0x7f322806e2f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f32340011e0 tx=0x7f32340078f0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.066+0000 7f3247e00640 1 -- 172.21.15.112:0/1888849110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32480b1d70 msgr2=0x7f32480cab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:52.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.066+0000 7f3247e00640 1 --2- 172.21.15.112:0/1888849110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32480b1d70 0x7f32480cab90 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f3238035040 tx=0x7f32380046c0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.066+0000 7f3247e00640 1 -- 172.21.15.112:0/1888849110 shutdown_connections 2024-09-12T02:47:52.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.067+0000 7f3247e00640 1 --2- 172.21.15.112:0/1888849110 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f322806be30 0x7f322806e2f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.067+0000 7f3247e00640 1 --2- 172.21.15.112:0/1888849110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32480d1710 0x7f32480cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.067+0000 7f3247e00640 1 --2- 172.21.15.112:0/1888849110 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32480b3e00 0x7f324814f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.067+0000 7f3247e00640 1 --2- 172.21.15.112:0/1888849110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32480b1d70 0x7f32480cab90 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.067+0000 7f3247e00640 1 -- 172.21.15.112:0/1888849110 >> 172.21.15.112:0/1888849110 conn(0x7f324809e030 msgr2=0x7f32480b2430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:52.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.067+0000 7f3247e00640 1 -- 172.21.15.112:0/1888849110 shutdown_connections 2024-09-12T02:47:52.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.067+0000 7f3247e00640 1 -- 172.21.15.112:0/1888849110 wait complete. 2024-09-12T02:47:52.084 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T02:47:52.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.238+0000 7f9fd5e00640 1 Processor -- start 2024-09-12T02:47:52.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.238+0000 7f9fd5e00640 1 -- start start 2024-09-12T02:47:52.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.239+0000 7f9fd5e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9fd015eeb0 0x7f9fd00ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:52.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.239+0000 7f9fd5e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9fd0070bc0 0x7f9fd00cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:52.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.239+0000 7f9fd5e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fd006f880 con 0x7f9fd015f290 2024-09-12T02:47:52.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.239+0000 7f9fd5e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f9fd0070730 con 0x7f9fd0070bc0 2024-09-12T02:47:52.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.239+0000 7f9fd5e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f9fd006fb20 con 0x7f9fd015eeb0 2024-09-12T02:47:52.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.239+0000 7f9fce000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9fd0070bc0 0x7f9fd00cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:52.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.239+0000 7f9fce000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9fd0070bc0 0x7f9fd00cd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46546/0 (socket says 172.21.15.112:46546) 2024-09-12T02:47:52.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.239+0000 7f9fce000640 1 -- 172.21.15.112:0/1633644330 learned_addr learned my addr 172.21.15.112:0/1633644330 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:52.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.239+0000 7f9fcf400640 1 --1- 172.21.15.112:0/1633644330 >> v1:172.21.15.112:6789/0 conn(0x7f9fd015f290 0x7f9fd00cf620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52050/0 (socket says 172.21.15.112:52050) 2024-09-12T02:47:52.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.239+0000 7f9fcea00640 1 --2- 172.21.15.112:0/1633644330 >> v2:172.21.15.137:3300/0 conn(0x7f9fd015eeb0 0x7f9fd00ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:52.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.240+0000 7f9fce000640 1 -- 172.21.15.112:0/1633644330 >> v2:172.21.15.137:3300/0 conn(0x7f9fd015eeb0 msgr2=0x7f9fd00ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:52.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.240+0000 7f9fce000640 1 --2- 172.21.15.112:0/1633644330 >> v2:172.21.15.137:3300/0 conn(0x7f9fd015eeb0 0x7f9fd00ce9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.240+0000 7f9fce000640 1 -- 172.21.15.112:0/1633644330 >> v1:172.21.15.112:6789/0 conn(0x7f9fd015f290 legacy=0x7f9fd00cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:52.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.240+0000 7f9fce000640 1 -- 172.21.15.112:0/1633644330 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd006fe00 con 0x7f9fd0070bc0 2024-09-12T02:47:52.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.241+0000 7f9fce000640 1 --2- 172.21.15.112:0/1633644330 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fd0070bc0 0x7f9fd00cd9c0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0072910 tx=0x7f9fbc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7d538ed3fd14a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:52.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.241+0000 7f9fcd600640 1 -- 172.21.15.112:0/1633644330 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc037070 con 0x7f9fd0070bc0 2024-09-12T02:47:52.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.241+0000 7f9fcd600640 1 -- 172.21.15.112:0/1633644330 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fbc032440 con 0x7f9fd0070bc0 2024-09-12T02:47:52.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.241+0000 7f9fcd600640 1 -- 172.21.15.112:0/1633644330 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc032810 con 0x7f9fd0070bc0 2024-09-12T02:47:52.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.241+0000 7f9fd5e00640 1 -- 172.21.15.112:0/1633644330 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fd0070bc0 msgr2=0x7f9fd00cd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:52.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.241+0000 7f9fd5e00640 1 --2- 172.21.15.112:0/1633644330 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fd0070bc0 0x7f9fd00cd9c0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0072910 tx=0x7f9fbc02a270 comp rx=0 tx=0).stop 2024-09-12T02:47:52.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.241+0000 7f9fd5e00640 1 -- 172.21.15.112:0/1633644330 shutdown_connections 2024-09-12T02:47:52.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.241+0000 7f9fd5e00640 1 --2- 172.21.15.112:0/1633644330 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fd0070bc0 0x7f9fd00cd9c0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.241+0000 7f9fd5e00640 1 --2- 172.21.15.112:0/1633644330 >> v2:172.21.15.137:3300/0 conn(0x7f9fd015eeb0 0x7f9fd00ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.241+0000 7f9fd5e00640 1 -- 172.21.15.112:0/1633644330 >> 172.21.15.112:0/1633644330 conn(0x7f9fd00b4720 msgr2=0x7f9fd00b4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:52.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.242+0000 7f9fd5e00640 1 -- 172.21.15.112:0/1633644330 shutdown_connections 2024-09-12T02:47:52.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.242+0000 7f9fd5e00640 1 -- 172.21.15.112:0/1633644330 wait complete. 2024-09-12T02:47:52.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.243+0000 7f9fd5e00640 1 Processor -- start 2024-09-12T02:47:52.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.243+0000 7f9fd5e00640 1 -- start start 2024-09-12T02:47:52.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.244+0000 7f9fd5e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fd0070bc0 0x7f9fd0157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:52.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.244+0000 7f9fd5e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9fd015eeb0 0x7f9fd00d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:52.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.244+0000 7f9fd5e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fd015f290 0x7f9fd00d1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:52.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.244+0000 7f9fd5e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd00cfd30 con 0x7f9fd015f290 2024-09-12T02:47:52.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.244+0000 7f9fd5e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd00703c0 con 0x7f9fd0070bc0 2024-09-12T02:47:52.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.244+0000 7f9fd5e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9fd00cfeb0 con 0x7f9fd015eeb0 2024-09-12T02:47:52.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.244+0000 7f9fcf400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fd015f290 0x7f9fd00d1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:52.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.244+0000 7f9fcf400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fd015f290 0x7f9fd00d1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46552/0 (socket says 172.21.15.112:46552) 2024-09-12T02:47:52.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.244+0000 7f9fcf400640 1 -- 172.21.15.112:0/3791781744 learned_addr learned my addr 172.21.15.112:0/3791781744 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:52.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.245+0000 7f9fcea00640 1 --2- 172.21.15.112:0/3791781744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fd0070bc0 0x7f9fd0157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:52.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.245+0000 7f9fce000640 1 --2- 172.21.15.112:0/3791781744 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9fd015eeb0 0x7f9fd00d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:52.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.245+0000 7f9fcf400640 1 -- 172.21.15.112:0/3791781744 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9fd015eeb0 msgr2=0x7f9fd00d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:52.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.245+0000 7f9fcf400640 1 --2- 172.21.15.112:0/3791781744 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9fd015eeb0 0x7f9fd00d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.245+0000 7f9fcf400640 1 -- 172.21.15.112:0/3791781744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fd0070bc0 msgr2=0x7f9fd0157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:52.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.245+0000 7f9fcf400640 1 --2- 172.21.15.112:0/3791781744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fd0070bc0 0x7f9fd0157280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.245+0000 7f9fcf400640 1 -- 172.21.15.112:0/3791781744 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd00d3b40 con 0x7f9fd015f290 2024-09-12T02:47:52.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.245+0000 7f9fcf400640 1 --2- 172.21.15.112:0/3791781744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fd015f290 0x7f9fd00d1050 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f9fc800c760 tx=0x7f9fc800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:52.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.245+0000 7f9fc7400640 1 -- 172.21.15.112:0/3791781744 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8017070 con 0x7f9fd015f290 2024-09-12T02:47:52.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.245+0000 7f9fc7400640 1 -- 172.21.15.112:0/3791781744 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fc800a640 con 0x7f9fd015f290 2024-09-12T02:47:52.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.245+0000 7f9fc7400640 1 -- 172.21.15.112:0/3791781744 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc800a9f0 con 0x7f9fd015f290 2024-09-12T02:47:52.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.245+0000 7f9fd5e00640 1 -- 172.21.15.112:0/3791781744 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fd00d1680 con 0x7f9fd015f290 2024-09-12T02:47:52.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.246+0000 7f9fd5e00640 1 -- 172.21.15.112:0/3791781744 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fd00d3340 con 0x7f9fd015f290 2024-09-12T02:47:52.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.247+0000 7f9fd5e00640 1 -- 172.21.15.112:0/3791781744 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fd00763a0 con 0x7f9fd015f290 2024-09-12T02:47:52.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.248+0000 7f9fc7400640 1 -- 172.21.15.112:0/3791781744 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9fc801a070 con 0x7f9fd015f290 2024-09-12T02:47:52.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.248+0000 7f9fc7400640 1 --2- 172.21.15.112:0/3791781744 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9fb006be30 0x7f9fb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:52.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.249+0000 7f9fc7400640 1 -- 172.21.15.112:0/3791781744 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 4943+0+0 (secure 0 0 0) 0x7f9fc808a0a0 con 0x7f9fd015f290 2024-09-12T02:47:52.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.249+0000 7f9fcea00640 1 --2- 172.21.15.112:0/3791781744 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9fb006be30 0x7f9fb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:52.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.249+0000 7f9fcea00640 1 --2- 172.21.15.112:0/3791781744 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9fb006be30 0x7f9fb006e2f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0009aa0 tx=0x7f9fc0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:52.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.253+0000 7f9fc7400640 1 -- 172.21.15.112:0/3791781744 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9fc80586f0 con 0x7f9fd015f290 2024-09-12T02:47:52.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.429+0000 7f9fd5e00640 1 -- 172.21.15.112:0/3791781744 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f9fd00cd9c0 con 0x7f9fd015f290 2024-09-12T02:47:52.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.433+0000 7f9fc7400640 1 -- 172.21.15.112:0/3791781744 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7f9fc805c9f0 con 0x7f9fd015f290 2024-09-12T02:47:52.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.435+0000 7f9fd5e00640 1 -- 172.21.15.112:0/3791781744 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9fb006be30 msgr2=0x7f9fb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:52.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.435+0000 7f9fd5e00640 1 --2- 172.21.15.112:0/3791781744 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9fb006be30 0x7f9fb006e2f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0009aa0 tx=0x7f9fc0009190 comp rx=0 tx=0).stop 2024-09-12T02:47:52.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.435+0000 7f9fd5e00640 1 -- 172.21.15.112:0/3791781744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fd015f290 msgr2=0x7f9fd00d1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:52.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.435+0000 7f9fd5e00640 1 --2- 172.21.15.112:0/3791781744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fd015f290 0x7f9fd00d1050 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f9fc800c760 tx=0x7f9fc800cc20 comp rx=0 tx=0).stop 2024-09-12T02:47:52.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.435+0000 7f9fd5e00640 1 -- 172.21.15.112:0/3791781744 shutdown_connections 2024-09-12T02:47:52.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.435+0000 7f9fd5e00640 1 --2- 172.21.15.112:0/3791781744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fd015f290 0x7f9fd00d1050 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.435+0000 7f9fd5e00640 1 --2- 172.21.15.112:0/3791781744 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9fd015eeb0 0x7f9fd00d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.435+0000 7f9fd5e00640 1 --2- 172.21.15.112:0/3791781744 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9fb006be30 0x7f9fb006e2f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.435+0000 7f9fd5e00640 1 --2- 172.21.15.112:0/3791781744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fd0070bc0 0x7f9fd0157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.435+0000 7f9fd5e00640 1 -- 172.21.15.112:0/3791781744 >> 172.21.15.112:0/3791781744 conn(0x7f9fd00b4720 msgr2=0x7f9fd00b0220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:52.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.435+0000 7f9fd5e00640 1 -- 172.21.15.112:0/3791781744 shutdown_connections 2024-09-12T02:47:52.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.435+0000 7f9fd5e00640 1 -- 172.21.15.112:0/3791781744 wait complete. 2024-09-12T02:47:52.452 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:47:52.453 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:47:52.537 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:47:52.637 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:47:52.637 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:47:52.637 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:47:52.672 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:47:52.673 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:47:52.673 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:47:52.711 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:47:52.711 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:47:52.711 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:47:52.747 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:47:52.748 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:47:52.748 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:47:52.787 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:47:52.788 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T02:47:52.788 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:47:52.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.939+0000 7f2abc200640 1 Processor -- start 2024-09-12T02:47:52.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.939+0000 7f2abc200640 1 -- start start 2024-09-12T02:47:52.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.940+0000 7f2abc200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ab40b5850 0x7f2ab406e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:52.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.940+0000 7f2abc200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2ab406e970 0x7f2ab406d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:52.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.940+0000 7f2abc200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ab415b6a0 con 0x7f2ab406e050 2024-09-12T02:47:52.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.940+0000 7f2abc200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2ab40b43b0 con 0x7f2ab406e970 2024-09-12T02:47:52.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.940+0000 7f2abc200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2ab40b3a80 con 0x7f2ab40b5850 2024-09-12T02:47:52.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.941+0000 7f2ab9800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2ab406e050 0x7f2ab40cfff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52064/0 (socket says 172.21.15.112:52064) 2024-09-12T02:47:52.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.941+0000 7f2ab9800640 1 -- 172.21.15.112:0/2722738701 learned_addr learned my addr 172.21.15.112:0/2722738701 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:52.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.941+0000 7f2aba200640 1 --2- 172.21.15.112:0/2722738701 >> v2:172.21.15.112:3300/0 conn(0x7f2ab406e970 0x7f2ab406d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:52.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.941+0000 7f2ab8e00640 1 --2- 172.21.15.112:0/2722738701 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ab40b5850 0x7f2ab406e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:52.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.941+0000 7f2ab3e00640 1 -- 172.21.15.112:0/2722738701 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 481791679 0 0) 0x7f2ab415b6a0 con 0x7f2ab406e050 2024-09-12T02:47:52.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.941+0000 7f2ab3e00640 1 -- 172.21.15.112:0/2722738701 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a9c003520 con 0x7f2ab406e050 2024-09-12T02:47:52.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.941+0000 7f2aba200640 1 -- 172.21.15.112:0/2722738701 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ab40b5850 msgr2=0x7f2ab406e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:52.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.941+0000 7f2aba200640 1 --2- 172.21.15.112:0/2722738701 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ab40b5850 0x7f2ab406e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.941+0000 7f2aba200640 1 -- 172.21.15.112:0/2722738701 >> v1:172.21.15.112:6789/0 conn(0x7f2ab406e050 legacy=0x7f2ab40cfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:52.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.941+0000 7f2aba200640 1 -- 172.21.15.112:0/2722738701 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab40b3d60 con 0x7f2ab406e970 2024-09-12T02:47:52.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.942+0000 7f2aba200640 1 --2- 172.21.15.112:0/2722738701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ab406e970 0x7f2ab406d550 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f2aac009d90 tx=0x7f2aac02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae418e90eaea28d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:52.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.942+0000 7f2ab3e00640 1 -- 172.21.15.112:0/2722738701 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aac007740 con 0x7f2ab406e970 2024-09-12T02:47:52.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.942+0000 7f2ab3e00640 1 -- 172.21.15.112:0/2722738701 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aac0078e0 con 0x7f2ab406e970 2024-09-12T02:47:52.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.942+0000 7f2ab3e00640 1 -- 172.21.15.112:0/2722738701 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aac007cb0 con 0x7f2ab406e970 2024-09-12T02:47:52.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.943+0000 7f2abc200640 1 -- 172.21.15.112:0/2722738701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ab406e970 msgr2=0x7f2ab406d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:52.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.943+0000 7f2abc200640 1 --2- 172.21.15.112:0/2722738701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ab406e970 0x7f2ab406d550 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f2aac009d90 tx=0x7f2aac02a660 comp rx=0 tx=0).stop 2024-09-12T02:47:52.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.943+0000 7f2abc200640 1 -- 172.21.15.112:0/2722738701 shutdown_connections 2024-09-12T02:47:52.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.943+0000 7f2abc200640 1 --2- 172.21.15.112:0/2722738701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ab406e970 0x7f2ab406d550 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.943+0000 7f2abc200640 1 --2- 172.21.15.112:0/2722738701 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ab40b5850 0x7f2ab406e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.943+0000 7f2abc200640 1 -- 172.21.15.112:0/2722738701 >> 172.21.15.112:0/2722738701 conn(0x7f2ab406bbd0 msgr2=0x7f2ab406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:52.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.943+0000 7f2abc200640 1 -- 172.21.15.112:0/2722738701 shutdown_connections 2024-09-12T02:47:52.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.943+0000 7f2abc200640 1 -- 172.21.15.112:0/2722738701 wait complete. 2024-09-12T02:47:52.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.945+0000 7f2abc200640 1 Processor -- start 2024-09-12T02:47:52.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.945+0000 7f2abc200640 1 -- start start 2024-09-12T02:47:52.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.946+0000 7f2abc200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ab406e050 0x7f2ab41f8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:52.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.946+0000 7f2abc200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ab406e970 0x7f2ab415d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:52.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.946+0000 7f2abc200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ab40b5850 0x7f2ab415a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:52.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.946+0000 7f2abc200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab406dc10 con 0x7f2ab40b5850 2024-09-12T02:47:52.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.946+0000 7f2abc200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab406da90 con 0x7f2ab406e970 2024-09-12T02:47:52.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.946+0000 7f2abc200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2ab4071ff0 con 0x7f2ab406e050 2024-09-12T02:47:52.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.946+0000 7f2aba200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ab40b5850 0x7f2ab415a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:52.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.946+0000 7f2aba200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ab40b5850 0x7f2ab415a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46572/0 (socket says 172.21.15.112:46572) 2024-09-12T02:47:52.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.946+0000 7f2aba200640 1 -- 172.21.15.112:0/809920589 learned_addr learned my addr 172.21.15.112:0/809920589 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:52.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.946+0000 7f2ab9800640 1 --2- 172.21.15.112:0/809920589 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ab406e050 0x7f2ab41f8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:52.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.946+0000 7f2ab8e00640 1 --2- 172.21.15.112:0/809920589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ab406e970 0x7f2ab415d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:52.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.947+0000 7f2aba200640 1 -- 172.21.15.112:0/809920589 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ab406e050 msgr2=0x7f2ab41f8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:52.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.947+0000 7f2aba200640 1 --2- 172.21.15.112:0/809920589 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ab406e050 0x7f2ab41f8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.947+0000 7f2aba200640 1 -- 172.21.15.112:0/809920589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ab406e970 msgr2=0x7f2ab415d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:52.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.947+0000 7f2aba200640 1 --2- 172.21.15.112:0/809920589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ab406e970 0x7f2ab415d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.947+0000 7f2aba200640 1 -- 172.21.15.112:0/809920589 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab41f7fe0 con 0x7f2ab40b5850 2024-09-12T02:47:52.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.947+0000 7f2ab9800640 1 --2- 172.21.15.112:0/809920589 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ab406e050 0x7f2ab41f8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:52.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.947+0000 7f2aba200640 1 --2- 172.21.15.112:0/809920589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ab40b5850 0x7f2ab415a390 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f2aac009eb0 tx=0x7f2aac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:52.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.947+0000 7f2ab1600640 1 -- 172.21.15.112:0/809920589 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aac040070 con 0x7f2ab40b5850 2024-09-12T02:47:52.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.947+0000 7f2ab1600640 1 -- 172.21.15.112:0/809920589 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aac031bc0 con 0x7f2ab40b5850 2024-09-12T02:47:52.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.947+0000 7f2ab1600640 1 -- 172.21.15.112:0/809920589 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aac009450 con 0x7f2ab40b5850 2024-09-12T02:47:52.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.947+0000 7f2abc200640 1 -- 172.21.15.112:0/809920589 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ab415ade0 con 0x7f2ab40b5850 2024-09-12T02:47:52.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.947+0000 7f2abc200640 1 -- 172.21.15.112:0/809920589 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ab415b0c0 con 0x7f2ab40b5850 2024-09-12T02:47:52.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.948+0000 7f2abc200640 1 -- 172.21.15.112:0/809920589 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ab4068a30 con 0x7f2ab40b5850 2024-09-12T02:47:52.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.949+0000 7f2ab1600640 1 -- 172.21.15.112:0/809920589 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2aac039040 con 0x7f2ab40b5850 2024-09-12T02:47:52.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.950+0000 7f2ab1600640 1 --2- 172.21.15.112:0/809920589 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2a9406be30 0x7f2a9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:52.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.950+0000 7f2ab1600640 1 -- 172.21.15.112:0/809920589 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 4943+0+0 (secure 0 0 0) 0x7f2aac0abf00 con 0x7f2ab40b5850 2024-09-12T02:47:52.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.950+0000 7f2ab9800640 1 --2- 172.21.15.112:0/809920589 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2a9406be30 0x7f2a9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:52.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.951+0000 7f2ab9800640 1 --2- 172.21.15.112:0/809920589 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2a9406be30 0x7f2a9406e2f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8007fd0 tx=0x7f2aa8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:52.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:52.954+0000 7f2ab1600640 1 -- 172.21.15.112:0/809920589 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2aac07aba0 con 0x7f2ab40b5850 2024-09-12T02:47:53.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.162+0000 7f2abc200640 1 -- 172.21.15.112:0/809920589 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ab40afc20 con 0x7f2ab40b5850 2024-09-12T02:47:53.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.163+0000 7f2ab1600640 1 -- 172.21.15.112:0/809920589 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+3923 (secure 0 0 0) 0x7f2aac07a4a0 con 0x7f2ab40b5850 2024-09-12T02:47:53.164 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:53.164 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":64,"btime":"2024-09-12T02:47:47:047088+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5612,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/3181313801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3181313801},{"type":"v1","addr":"172.21.15.137:6834","nonce":3181313801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":5615,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2025494075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2025494075},{"type":"v1","addr":"172.21.15.137:6835","nonce":2025494075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6501,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3739674039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3739674039},{"type":"v1","addr":"172.21.15.112:6837","nonce":3739674039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6762,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/1971488520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1971488520},{"type":"v1","addr":"172.21.15.112:6836","nonce":1971488520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[]} 2024-09-12T02:47:53.164 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 64 2024-09-12T02:47:53.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.165+0000 7f2abc200640 1 -- 172.21.15.112:0/809920589 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2a9406be30 msgr2=0x7f2a9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:53.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.165+0000 7f2abc200640 1 --2- 172.21.15.112:0/809920589 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2a9406be30 0x7f2a9406e2f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8007fd0 tx=0x7f2aa8009040 comp rx=0 tx=0).stop 2024-09-12T02:47:53.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.165+0000 7f2abc200640 1 -- 172.21.15.112:0/809920589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ab40b5850 msgr2=0x7f2ab415a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:53.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.165+0000 7f2abc200640 1 --2- 172.21.15.112:0/809920589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ab40b5850 0x7f2ab415a390 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f2aac009eb0 tx=0x7f2aac004a40 comp rx=0 tx=0).stop 2024-09-12T02:47:53.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.165+0000 7f2abc200640 1 -- 172.21.15.112:0/809920589 shutdown_connections 2024-09-12T02:47:53.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.165+0000 7f2abc200640 1 --2- 172.21.15.112:0/809920589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ab40b5850 0x7f2ab415a390 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:53.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.165+0000 7f2abc200640 1 --2- 172.21.15.112:0/809920589 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2a9406be30 0x7f2a9406e2f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:53.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.165+0000 7f2abc200640 1 --2- 172.21.15.112:0/809920589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ab406e970 0x7f2ab415d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:53.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.165+0000 7f2abc200640 1 --2- 172.21.15.112:0/809920589 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ab406e050 0x7f2ab41f8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:53.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.165+0000 7f2abc200640 1 -- 172.21.15.112:0/809920589 >> 172.21.15.112:0/809920589 conn(0x7f2ab406bbd0 msgr2=0x7f2ab406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:53.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.165+0000 7f2abc200640 1 -- 172.21.15.112:0/809920589 shutdown_connections 2024-09-12T02:47:53.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.165+0000 7f2abc200640 1 -- 172.21.15.112:0/809920589 wait complete. 2024-09-12T02:47:53.183 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T02:47:53.183 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T02:47:53.184 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T02:47:53.184 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:47:53.184 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T02:47:53.184 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T02:47:53.185 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T02:47:53.185 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:47:53.185 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T02:47:53.185 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T02:47:53.185 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T02:47:53.185 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:47:53.185 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T02:47:53.186 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T02:47:53.186 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T02:47:53.186 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:47:53.199 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T02:47:53.199 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T02:47:53.200 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T02:47:53.200 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T02:47:53.202 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T02:47:53.202 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T02:47:53.203 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T02:47:53.203 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T02:47:53.245 INFO:tasks.ceph.mds.a:Started 2024-09-12T02:47:53.245 DEBUG:teuthology.parallel:result is None 2024-09-12T02:47:53.247 INFO:tasks.ceph.mds.b:Started 2024-09-12T02:47:53.247 DEBUG:teuthology.parallel:result is None 2024-09-12T02:47:53.248 INFO:tasks.ceph.mds.c:Started 2024-09-12T02:47:53.248 DEBUG:teuthology.parallel:result is None 2024-09-12T02:47:53.250 INFO:tasks.ceph.mds.d:Started 2024-09-12T02:47:53.250 DEBUG:teuthology.parallel:result is None 2024-09-12T02:47:53.250 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T02:47:53.373 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-12T02:47:53.376 INFO:tasks.ceph.mds.d.smithi137.stdout:starting mds.d at 2024-09-12T02:47:53.377 INFO:tasks.ceph.mds.b.smithi137.stdout:starting mds.b at 2024-09-12T02:47:53.378 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2024-09-12T02:47:53.378 INFO:tasks.ceph.mds.b.smithi137.stderr:2024-09-12T02:47:53.378+0000 7f4648200640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-09-12T02:47:53.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.414+0000 7f9583200640 1 Processor -- start 2024-09-12T02:47:53.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.414+0000 7f9583200640 1 -- start start 2024-09-12T02:47:53.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.415+0000 7f9583200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f95840b3e00 0x7f95840d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:53.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.415+0000 7f9583200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f95840b1d70 0x7f95840b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:53.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.415+0000 7f9583200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95840d2fb0 con 0x7f95840d1710 2024-09-12T02:47:53.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.415+0000 7f9583200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f95840d3cb0 con 0x7f95840b1d70 2024-09-12T02:47:53.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.415+0000 7f9583200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f95840d0b60 con 0x7f95840b3e00 2024-09-12T02:47:53.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.415+0000 7f9582800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f95840b1d70 0x7f95840b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:53.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.415+0000 7f9582800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f95840b1d70 0x7f95840b2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46620/0 (socket says 172.21.15.112:46620) 2024-09-12T02:47:53.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.415+0000 7f9582800640 1 -- 172.21.15.112:0/7194009 learned_addr learned my addr 172.21.15.112:0/7194009 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:53.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.416+0000 7f9581400640 1 --2- 172.21.15.112:0/7194009 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f95840b3e00 0x7f95840d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:53.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.416+0000 7f9582800640 1 -- 172.21.15.112:0/7194009 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f95840b3e00 msgr2=0x7f95840d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:53.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.416+0000 7f9582800640 1 --2- 172.21.15.112:0/7194009 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f95840b3e00 0x7f95840d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:53.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.416+0000 7f9582800640 1 -- 172.21.15.112:0/7194009 >> v1:172.21.15.137:6789/0 conn(0x7f95840d1710 legacy=0x7f95840d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:53.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.416+0000 7f9582800640 1 -- 172.21.15.112:0/7194009 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95840d3410 con 0x7f95840b1d70 2024-09-12T02:47:53.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.417+0000 7f9582800640 1 --2- 172.21.15.112:0/7194009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95840b1d70 0x7f95840b2200 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f957c009e50 tx=0x7f957c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2405d648e657b2b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:53.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.417+0000 7f9580a00640 1 -- 172.21.15.112:0/7194009 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957c036070 con 0x7f95840b1d70 2024-09-12T02:47:53.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.417+0000 7f9580a00640 1 -- 172.21.15.112:0/7194009 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f957c031600 con 0x7f95840b1d70 2024-09-12T02:47:53.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.417+0000 7f9580a00640 1 -- 172.21.15.112:0/7194009 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957c0319d0 con 0x7f95840b1d70 2024-09-12T02:47:53.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.418+0000 7f9583200640 1 -- 172.21.15.112:0/7194009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95840b1d70 msgr2=0x7f95840b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:53.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.418+0000 7f9583200640 1 --2- 172.21.15.112:0/7194009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95840b1d70 0x7f95840b2200 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f957c009e50 tx=0x7f957c02a710 comp rx=0 tx=0).stop 2024-09-12T02:47:53.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.418+0000 7f9583200640 1 -- 172.21.15.112:0/7194009 shutdown_connections 2024-09-12T02:47:53.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.418+0000 7f9583200640 1 --2- 172.21.15.112:0/7194009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95840b1d70 0x7f95840b2200 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:53.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.418+0000 7f9583200640 1 --2- 172.21.15.112:0/7194009 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f95840b3e00 0x7f95840d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:53.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.418+0000 7f9583200640 1 -- 172.21.15.112:0/7194009 >> 172.21.15.112:0/7194009 conn(0x7f958409e030 msgr2=0x7f95840d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:53.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.418+0000 7f9583200640 1 -- 172.21.15.112:0/7194009 shutdown_connections 2024-09-12T02:47:53.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.418+0000 7f9583200640 1 -- 172.21.15.112:0/7194009 wait complete. 2024-09-12T02:47:53.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.419+0000 7f9583200640 1 Processor -- start 2024-09-12T02:47:53.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.419+0000 7f9583200640 1 -- start start 2024-09-12T02:47:53.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.420+0000 7f9583200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95840b1d70 0x7f95840b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:53.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.420+0000 7f9583200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f95840b3e00 0x7f95840b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:53.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.420+0000 7f9583200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95840d1710 0x7f9584156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:53.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.420+0000 7f9583200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f958415f110 con 0x7f95840b1d70 2024-09-12T02:47:53.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.420+0000 7f9583200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f95840d39d0 con 0x7f95840d1710 2024-09-12T02:47:53.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.420+0000 7f9583200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f958415f290 con 0x7f95840b3e00 2024-09-12T02:47:53.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.420+0000 7f9581e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95840b1d70 0x7f95840b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:53.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.421+0000 7f9581e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95840b1d70 0x7f95840b4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46632/0 (socket says 172.21.15.112:46632) 2024-09-12T02:47:53.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.421+0000 7f9581e00640 1 -- 172.21.15.112:0/3672824876 learned_addr learned my addr 172.21.15.112:0/3672824876 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:53.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.421+0000 7f9581400640 1 --2- 172.21.15.112:0/3672824876 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f95840b3e00 0x7f95840b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:53.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.421+0000 7f9582800640 1 --2- 172.21.15.112:0/3672824876 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95840d1710 0x7f9584156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:53.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.421+0000 7f9581e00640 1 -- 172.21.15.112:0/3672824876 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f95840b3e00 msgr2=0x7f95840b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:53.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.421+0000 7f9581e00640 1 --2- 172.21.15.112:0/3672824876 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f95840b3e00 0x7f95840b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:53.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.421+0000 7f9581e00640 1 -- 172.21.15.112:0/3672824876 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95840d1710 msgr2=0x7f9584156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:53.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.421+0000 7f9581e00640 1 --2- 172.21.15.112:0/3672824876 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95840d1710 0x7f9584156140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:53.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.421+0000 7f9581e00640 1 -- 172.21.15.112:0/3672824876 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95840b5320 con 0x7f95840b1d70 2024-09-12T02:47:53.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.421+0000 7f9581400640 1 --2- 172.21.15.112:0/3672824876 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f95840b3e00 0x7f95840b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:53.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.421+0000 7f9581e00640 1 --2- 172.21.15.112:0/3672824876 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95840b1d70 0x7f95840b4d40 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f957400c3c0 tx=0x7f957400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:53.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.421+0000 7f957a000640 1 -- 172.21.15.112:0/3672824876 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95740052d0 con 0x7f95840b1d70 2024-09-12T02:47:53.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.422+0000 7f957a000640 1 -- 172.21.15.112:0/3672824876 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9574005490 con 0x7f95840b1d70 2024-09-12T02:47:53.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.422+0000 7f9583200640 1 -- 172.21.15.112:0/3672824876 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95840b5600 con 0x7f95840b1d70 2024-09-12T02:47:53.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.422+0000 7f957a000640 1 -- 172.21.15.112:0/3672824876 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9574007260 con 0x7f95840b1d70 2024-09-12T02:47:53.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.422+0000 7f9583200640 1 -- 172.21.15.112:0/3672824876 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95840b5bc0 con 0x7f95840b1d70 2024-09-12T02:47:53.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.423+0000 7f9583200640 1 -- 172.21.15.112:0/3672824876 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95840d28d0 con 0x7f95840b1d70 2024-09-12T02:47:53.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.423+0000 7f957a000640 1 -- 172.21.15.112:0/3672824876 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9574007400 con 0x7f95840b1d70 2024-09-12T02:47:53.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.424+0000 7f957a000640 1 --2- 172.21.15.112:0/3672824876 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f956406be30 0x7f956406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:53.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.424+0000 7f957a000640 1 -- 172.21.15.112:0/3672824876 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 4943+0+0 (secure 0 0 0) 0x7f9574089ff0 con 0x7f95840b1d70 2024-09-12T02:47:53.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.425+0000 7f9581400640 1 --2- 172.21.15.112:0/3672824876 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f956406be30 0x7f956406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:53.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.425+0000 7f9581400640 1 --2- 172.21.15.112:0/3672824876 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f956406be30 0x7f956406e2f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f95840b7ea0 tx=0x7f9570008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:53.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.428+0000 7f957a000640 1 -- 172.21.15.112:0/3672824876 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f95740585f0 con 0x7f95840b1d70 2024-09-12T02:47:53.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:53.616+0000 7f9583200640 1 -- 172.21.15.112:0/3672824876 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f958406d820 con 0x7f95840b1d70 2024-09-12T02:47:54.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.444+0000 7f957a000640 1 -- 172.21.15.112:0/3672824876 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v131) ==== 97+0+0 (secure 0 0 0) 0x7f957405c8f0 con 0x7f95840b1d70 2024-09-12T02:47:54.445 INFO:teuthology.orchestra.run.smithi112.stderr: removed all blocklist entries 2024-09-12T02:47:54.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.446+0000 7f9583200640 1 -- 172.21.15.112:0/3672824876 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f956406be30 msgr2=0x7f956406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:54.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.446+0000 7f9583200640 1 --2- 172.21.15.112:0/3672824876 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f956406be30 0x7f956406e2f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f95840b7ea0 tx=0x7f9570008040 comp rx=0 tx=0).stop 2024-09-12T02:47:54.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.446+0000 7f9583200640 1 -- 172.21.15.112:0/3672824876 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95840b1d70 msgr2=0x7f95840b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:54.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.446+0000 7f9583200640 1 --2- 172.21.15.112:0/3672824876 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95840b1d70 0x7f95840b4d40 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f957400c3c0 tx=0x7f957400c880 comp rx=0 tx=0).stop 2024-09-12T02:47:54.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.447+0000 7f9583200640 1 -- 172.21.15.112:0/3672824876 shutdown_connections 2024-09-12T02:47:54.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.447+0000 7f9583200640 1 --2- 172.21.15.112:0/3672824876 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f956406be30 0x7f956406e2f0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.447+0000 7f9583200640 1 --2- 172.21.15.112:0/3672824876 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95840d1710 0x7f9584156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.447+0000 7f9583200640 1 --2- 172.21.15.112:0/3672824876 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f95840b3e00 0x7f95840b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.447+0000 7f9583200640 1 --2- 172.21.15.112:0/3672824876 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95840b1d70 0x7f95840b4d40 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.447+0000 7f9583200640 1 -- 172.21.15.112:0/3672824876 >> 172.21.15.112:0/3672824876 conn(0x7f958409e030 msgr2=0x7f95840b84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:54.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.447+0000 7f9583200640 1 -- 172.21.15.112:0/3672824876 shutdown_connections 2024-09-12T02:47:54.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.447+0000 7f9583200640 1 -- 172.21.15.112:0/3672824876 wait complete. 2024-09-12T02:47:54.465 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T02:47:54.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.617+0000 7f78efe00640 1 Processor -- start 2024-09-12T02:47:54.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.618+0000 7f78efe00640 1 -- start start 2024-09-12T02:47:54.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.619+0000 7f78efe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f78e815cc50 0x7f78e80732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:54.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.619+0000 7f78efe00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e8073830 con 0x7f78e80afe30 2024-09-12T02:47:54.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.619+0000 7f78efe00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e80ceeb0 con 0x7f78e8071530 2024-09-12T02:47:54.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.619+0000 7f78efe00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f78e815d030 con 0x7f78e815cc50 2024-09-12T02:47:54.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.619+0000 7f78ed400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f78e815cc50 0x7f78e80732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:54.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.619+0000 7f78ed400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f78e815cc50 0x7f78e80732f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46648/0 (socket says 172.21.15.112:46648) 2024-09-12T02:47:54.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.619+0000 7f78ed400640 1 -- 172.21.15.112:0/1619469324 learned_addr learned my addr 172.21.15.112:0/1619469324 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:54.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.619+0000 7f78ed400640 1 -- 172.21.15.112:0/1619469324 >> v1:172.21.15.137:6789/0 conn(0x7f78e8071530 legacy=0x7f78e80af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:54.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.619+0000 7f78ed400640 1 -- 172.21.15.112:0/1619469324 >> v1:172.21.15.112:6789/0 conn(0x7f78e80afe30 legacy=0x7f78e80cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:54.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.620+0000 7f78ed400640 1 -- 172.21.15.112:0/1619469324 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e806e300 con 0x7f78e815cc50 2024-09-12T02:47:54.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.619+0000 7f78e7e00640 1 -- 172.21.15.112:0/1619469324 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3944315531 0 0) 0x7f78e0001490 con 0x7f78e80afe30 2024-09-12T02:47:54.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.620+0000 7f78ed400640 1 --2- 172.21.15.112:0/1619469324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78e815cc50 0x7f78e80732f0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f78dc009870 tx=0x7f78dc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4541c60ead94153 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:54.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.621+0000 7f78e7e00640 1 -- 172.21.15.112:0/1619469324 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78dc037070 con 0x7f78e815cc50 2024-09-12T02:47:54.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.621+0000 7f78e7e00640 1 -- 172.21.15.112:0/1619469324 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78dc032440 con 0x7f78e815cc50 2024-09-12T02:47:54.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.621+0000 7f78e7e00640 1 -- 172.21.15.112:0/1619469324 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78dc032810 con 0x7f78e815cc50 2024-09-12T02:47:54.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.621+0000 7f78efe00640 1 -- 172.21.15.112:0/1619469324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78e815cc50 msgr2=0x7f78e80732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:54.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.621+0000 7f78efe00640 1 --2- 172.21.15.112:0/1619469324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78e815cc50 0x7f78e80732f0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f78dc009870 tx=0x7f78dc02a210 comp rx=0 tx=0).stop 2024-09-12T02:47:54.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.621+0000 7f78efe00640 1 -- 172.21.15.112:0/1619469324 shutdown_connections 2024-09-12T02:47:54.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.621+0000 7f78efe00640 1 --2- 172.21.15.112:0/1619469324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78e815cc50 0x7f78e80732f0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.621+0000 7f78efe00640 1 -- 172.21.15.112:0/1619469324 >> 172.21.15.112:0/1619469324 conn(0x7f78e806bbd0 msgr2=0x7f78e806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:54.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.621+0000 7f78efe00640 1 -- 172.21.15.112:0/1619469324 shutdown_connections 2024-09-12T02:47:54.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.621+0000 7f78efe00640 1 -- 172.21.15.112:0/1619469324 wait complete. 2024-09-12T02:47:54.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.623+0000 7f78efe00640 1 Processor -- start 2024-09-12T02:47:54.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.623+0000 7f78efe00640 1 -- start start 2024-09-12T02:47:54.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.624+0000 7f78efe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78e8071530 0x7f78e814f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:54.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.624+0000 7f78efe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78e80afe30 0x7f78e814f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:54.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.624+0000 7f78efe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78e815cc50 0x7f78e8156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:54.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.624+0000 7f78efe00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f78e80cf150 con 0x7f78e815cc50 2024-09-12T02:47:54.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.624+0000 7f78efe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f78e80cf4c0 con 0x7f78e8071530 2024-09-12T02:47:54.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.624+0000 7f78efe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f78e806f510 con 0x7f78e80afe30 2024-09-12T02:47:54.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.624+0000 7f78ede00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78e815cc50 0x7f78e8156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:54.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.624+0000 7f78ede00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78e815cc50 0x7f78e8156710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46650/0 (socket says 172.21.15.112:46650) 2024-09-12T02:47:54.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.624+0000 7f78ede00640 1 -- 172.21.15.112:0/73731947 learned_addr learned my addr 172.21.15.112:0/73731947 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:54.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.625+0000 7f78eca00640 1 --2- 172.21.15.112:0/73731947 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78e80afe30 0x7f78e814f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:54.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.625+0000 7f78ed400640 1 --2- 172.21.15.112:0/73731947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78e8071530 0x7f78e814f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:54.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.625+0000 7f78ede00640 1 -- 172.21.15.112:0/73731947 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78e80afe30 msgr2=0x7f78e814f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:54.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.625+0000 7f78ede00640 1 --2- 172.21.15.112:0/73731947 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78e80afe30 0x7f78e814f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.625+0000 7f78ede00640 1 -- 172.21.15.112:0/73731947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78e8071530 msgr2=0x7f78e814f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:54.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.625+0000 7f78ede00640 1 --2- 172.21.15.112:0/73731947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78e8071530 0x7f78e814f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.625+0000 7f78ede00640 1 -- 172.21.15.112:0/73731947 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e8155e50 con 0x7f78e815cc50 2024-09-12T02:47:54.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.625+0000 7f78ede00640 1 --2- 172.21.15.112:0/73731947 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78e815cc50 0x7f78e8156710 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f78e0001730 tx=0x7f78e000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:54.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.625+0000 7f78e5600640 1 -- 172.21.15.112:0/73731947 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e0003da0 con 0x7f78e815cc50 2024-09-12T02:47:54.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.625+0000 7f78e5600640 1 -- 172.21.15.112:0/73731947 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78e0005070 con 0x7f78e815cc50 2024-09-12T02:47:54.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.625+0000 7f78efe00640 1 -- 172.21.15.112:0/73731947 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78e81552d0 con 0x7f78e815cc50 2024-09-12T02:47:54.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.625+0000 7f78e5600640 1 -- 172.21.15.112:0/73731947 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e0005460 con 0x7f78e815cc50 2024-09-12T02:47:54.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.625+0000 7f78efe00640 1 -- 172.21.15.112:0/73731947 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78e8155890 con 0x7f78e815cc50 2024-09-12T02:47:54.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.626+0000 7f78efe00640 1 -- 172.21.15.112:0/73731947 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78e8068a30 con 0x7f78e815cc50 2024-09-12T02:47:54.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.627+0000 7f78e5600640 1 -- 172.21.15.112:0/73731947 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f78e0005600 con 0x7f78e815cc50 2024-09-12T02:47:54.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.628+0000 7f78e5600640 1 --2- 172.21.15.112:0/73731947 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f78c806be30 0x7f78c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:54.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.628+0000 7f78e5600640 1 -- 172.21.15.112:0/73731947 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 4857+0+0 (secure 0 0 0) 0x7f78e008aa30 con 0x7f78e815cc50 2024-09-12T02:47:54.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.628+0000 7f78ed400640 1 --2- 172.21.15.112:0/73731947 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f78c806be30 0x7f78c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:54.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.629+0000 7f78ed400640 1 --2- 172.21.15.112:0/73731947 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f78c806be30 0x7f78c806e2f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f78dc034000 tx=0x7f78dc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:54.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.632+0000 7f78e5600640 1 -- 172.21.15.112:0/73731947 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f78e8073830 con 0x7f78e815cc50 2024-09-12T02:47:54.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.870+0000 7f78efe00640 1 -- 172.21.15.112:0/73731947 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f78e80730d0 con 0x7f78e815cc50 2024-09-12T02:47:54.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.870+0000 7f78e5600640 1 -- 172.21.15.112:0/73731947 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) ==== 80+0+5304 (secure 0 0 0) 0x7f78e0059720 con 0x7f78e815cc50 2024-09-12T02:47:54.871 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:54.871 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:47:54.871 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_dump": [ 2024-09-12T02:47:54.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:54.871 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.a", 2024-09-12T02:47:54.872 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmKE09KRAAtNq70LeeB9ENNxX91m10Fg==", 2024-09-12T02:47:54.872 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:54.872 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:47:54.872 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:47:54.872 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:47:54.872 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:47:54.872 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:54.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:54.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:54.872 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.b", 2024-09-12T02:47:54.872 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmMjYTARAAuIrofOOp9Dbrhkt314mhuw==", 2024-09-12T02:47:54.872 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:54.872 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:47:54.873 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:47:54.873 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:47:54.873 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:47:54.873 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:54.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:54.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:54.873 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.c", 2024-09-12T02:47:54.873 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmLQXzMhAAhk28JuqKhfbZtvRu9SSVrw==", 2024-09-12T02:47:54.873 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:54.873 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:47:54.873 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:47:54.873 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:47:54.873 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:47:54.873 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:54.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:54.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:54.874 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.d", 2024-09-12T02:47:54.874 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmaE7JChAAKlyynYJnHLs87BXyMC0xgA==", 2024-09-12T02:47:54.874 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:54.874 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:47:54.874 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:47:54.875 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:47:54.875 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:47:54.875 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:54.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:54.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:54.875 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.0", 2024-09-12T02:47:54.875 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDXVOJmFXfdIRAA+VpZNU0tEN6vAzR2C7nuLg==", 2024-09-12T02:47:54.875 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:54.875 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:47:54.875 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:47:54.875 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:47:54.875 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:54.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:54.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:54.876 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.1", 2024-09-12T02:47:54.876 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDXVOJmcgHyLBAA/OxfdQ1D+uFzbCnm1dJLxw==", 2024-09-12T02:47:54.876 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:54.876 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:47:54.876 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:47:54.877 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:47:54.877 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:54.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:54.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:54.877 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.2", 2024-09-12T02:47:54.877 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDXVOJm0baUNhAAuInNwHut2Xn0kBmjnJhdqw==", 2024-09-12T02:47:54.877 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:54.877 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:47:54.877 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:47:54.877 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:47:54.877 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:54.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:54.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:54.877 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.3", 2024-09-12T02:47:54.878 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDYVOJmL/O3BBAAZhQ4/70wj/2zEbMcfD4hQA==", 2024-09-12T02:47:54.878 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:54.878 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:47:54.878 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:47:54.878 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:47:54.878 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:54.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:54.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:54.878 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.4", 2024-09-12T02:47:54.878 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmC+sJAxAAUQofpG3g8DlGLQ8wUqtuSg==", 2024-09-12T02:47:54.879 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:54.879 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:47:54.879 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:47:54.879 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:47:54.879 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:54.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:54.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:54.879 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.5", 2024-09-12T02:47:54.879 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmY2OSDhAA2rg1HGjWx7G6IzFi6yQ/jQ==", 2024-09-12T02:47:54.879 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:54.879 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:47:54.879 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:47:54.880 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:47:54.880 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:54.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:54.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:54.880 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.6", 2024-09-12T02:47:54.880 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmydoaGRAAh/ozKewnY+RxiZ4EcOFA7A==", 2024-09-12T02:47:54.880 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:54.880 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:47:54.880 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:47:54.880 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:47:54.880 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:54.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:54.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:54.881 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.7", 2024-09-12T02:47:54.881 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmmB7cIhAAVhtz7OuxYBQgEKGvHdY33g==", 2024-09-12T02:47:54.881 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:54.881 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:47:54.881 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:47:54.881 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:47:54.881 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:54.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:54.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:54.881 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.0", 2024-09-12T02:47:54.881 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmaG86ExAAD0SOlJOsLpoQZlgPJIPaxA==", 2024-09-12T02:47:54.881 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:54.882 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:47:54.882 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow r", 2024-09-12T02:47:54.882 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T02:47:54.882 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:54.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:54.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:54.882 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.1", 2024-09-12T02:47:54.882 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmt7AeIBAAGRSEejG29OpANZqtia7KEw==", 2024-09-12T02:47:54.882 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:54.882 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:47:54.882 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:47:54.882 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:47:54.882 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:47:54.882 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:54.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:54.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:54.883 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.2", 2024-09-12T02:47:54.883 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmcUWtGRAAlV/gS/CDZKHb5bjbmDzjlg==", 2024-09-12T02:47:54.883 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:54.883 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:47:54.883 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:47:54.883 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:47:54.883 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:47:54.883 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:54.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:54.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:54.883 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.3", 2024-09-12T02:47:54.883 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJm2M97JhAAHKJoPBf6TN6Nu8muK6wzaw==", 2024-09-12T02:47:54.883 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:54.884 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:47:54.884 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:47:54.884 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:47:54.884 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:47:54.884 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:54.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:54.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:54.884 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.admin", 2024-09-12T02:47:54.884 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDSVOJmhl82NBAAvkcxnsY5u9lYO12FaRbP1A==", 2024-09-12T02:47:54.884 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:54.884 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-12T02:47:54.884 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:47:54.884 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:47:54.884 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:47:54.884 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:54.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:54.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:54.885 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.x", 2024-09-12T02:47:54.885 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmftawIhAAAKmfx8khERROoZ8BCLukAw==", 2024-09-12T02:47:54.885 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:54.885 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-12T02:47:54.885 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-12T02:47:54.885 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:47:54.885 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:54.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:47:54.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:54.885 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.y", 2024-09-12T02:47:54.885 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmcxtNGhAAAXWh1fMrVeFSy2hh3p2Rkw==", 2024-09-12T02:47:54.886 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:47:54.886 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-12T02:47:54.886 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-12T02:47:54.886 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:47:54.886 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:54.886 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:54.886 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:47:54.886 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:47:54.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.872+0000 7f78efe00640 1 -- 172.21.15.112:0/73731947 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f78c806be30 msgr2=0x7f78c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:54.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.872+0000 7f78efe00640 1 --2- 172.21.15.112:0/73731947 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f78c806be30 0x7f78c806e2f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f78dc034000 tx=0x7f78dc02e000 comp rx=0 tx=0).stop 2024-09-12T02:47:54.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.872+0000 7f78efe00640 1 -- 172.21.15.112:0/73731947 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78e815cc50 msgr2=0x7f78e8156710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:54.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.872+0000 7f78efe00640 1 --2- 172.21.15.112:0/73731947 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78e815cc50 0x7f78e8156710 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f78e0001730 tx=0x7f78e000cc50 comp rx=0 tx=0).stop 2024-09-12T02:47:54.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.873+0000 7f78efe00640 1 -- 172.21.15.112:0/73731947 shutdown_connections 2024-09-12T02:47:54.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.873+0000 7f78efe00640 1 --2- 172.21.15.112:0/73731947 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78e815cc50 0x7f78e8156710 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.873+0000 7f78efe00640 1 --2- 172.21.15.112:0/73731947 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78e80afe30 0x7f78e814f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.873+0000 7f78efe00640 1 --2- 172.21.15.112:0/73731947 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f78c806be30 0x7f78c806e2f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.873+0000 7f78efe00640 1 --2- 172.21.15.112:0/73731947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78e8071530 0x7f78e814f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.873+0000 7f78efe00640 1 -- 172.21.15.112:0/73731947 >> 172.21.15.112:0/73731947 conn(0x7f78e806bbd0 msgr2=0x7f78e8157980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:54.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.873+0000 7f78efe00640 1 -- 172.21.15.112:0/73731947 shutdown_connections 2024-09-12T02:47:54.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:54.873+0000 7f78efe00640 1 -- 172.21.15.112:0/73731947 wait complete. 2024-09-12T02:47:54.891 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T02:47:55.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.042+0000 7fa37ec00640 1 Processor -- start 2024-09-12T02:47:55.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.042+0000 7fa37ec00640 1 -- start start 2024-09-12T02:47:55.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.043+0000 7fa37ec00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa378071c40 0x7fa378167780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:55.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.043+0000 7fa37ec00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3780cd480 con 0x7fa3781460a0 2024-09-12T02:47:55.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.044+0000 7fa37ec00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3780cd760 con 0x7fa378145a90 2024-09-12T02:47:55.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.044+0000 7fa37ec00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa378145e70 con 0x7fa378071c40 2024-09-12T02:47:55.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.044+0000 7fa377400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa3781460a0 0x7fa378071530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52080/0 (socket says 172.21.15.112:52080) 2024-09-12T02:47:55.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.044+0000 7fa377400640 1 -- 172.21.15.112:0/524258784 learned_addr learned my addr 172.21.15.112:0/524258784 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:55.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.044+0000 7fa37cc00640 1 --2- 172.21.15.112:0/524258784 >> v2:172.21.15.137:3300/0 conn(0x7fa378071c40 0x7fa378167780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:55.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.044+0000 7fa376a00640 1 -- 172.21.15.112:0/524258784 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2756943121 0 0) 0x7fa3780cd480 con 0x7fa3781460a0 2024-09-12T02:47:55.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.044+0000 7fa376a00640 1 -- 172.21.15.112:0/524258784 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa35c003520 con 0x7fa3781460a0 2024-09-12T02:47:55.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.044+0000 7fa376a00640 1 -- 172.21.15.112:0/524258784 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2396472344 0 0) 0x7fa3780cd760 con 0x7fa378145a90 2024-09-12T02:47:55.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.044+0000 7fa376a00640 1 -- 172.21.15.112:0/524258784 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3780cd480 con 0x7fa378145a90 2024-09-12T02:47:55.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.044+0000 7fa37cc00640 1 -- 172.21.15.112:0/524258784 >> v1:172.21.15.137:6789/0 conn(0x7fa378145a90 legacy=0x7fa3780cffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:55.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.044+0000 7fa37cc00640 1 -- 172.21.15.112:0/524258784 >> v1:172.21.15.112:6789/0 conn(0x7fa3781460a0 legacy=0x7fa378071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:55.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.044+0000 7fa37cc00640 1 -- 172.21.15.112:0/524258784 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3780d06e0 con 0x7fa378071c40 2024-09-12T02:47:55.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.045+0000 7fa37cc00640 1 --2- 172.21.15.112:0/524258784 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa378071c40 0x7fa378167780 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa370009d90 tx=0x7fa37002a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aaefe6492c32a8a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:55.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.046+0000 7fa376a00640 1 -- 172.21.15.112:0/524258784 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa370031600 con 0x7fa378071c40 2024-09-12T02:47:55.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.046+0000 7fa376a00640 1 -- 172.21.15.112:0/524258784 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3700317a0 con 0x7fa378071c40 2024-09-12T02:47:55.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.046+0000 7fa376a00640 1 -- 172.21.15.112:0/524258784 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa370031b50 con 0x7fa378071c40 2024-09-12T02:47:55.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.046+0000 7fa37ec00640 1 -- 172.21.15.112:0/524258784 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa378071c40 msgr2=0x7fa378167780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:55.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.046+0000 7fa37ec00640 1 --2- 172.21.15.112:0/524258784 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa378071c40 0x7fa378167780 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa370009d90 tx=0x7fa37002a5d0 comp rx=0 tx=0).stop 2024-09-12T02:47:55.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.046+0000 7fa37ec00640 1 -- 172.21.15.112:0/524258784 shutdown_connections 2024-09-12T02:47:55.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.046+0000 7fa37ec00640 1 --2- 172.21.15.112:0/524258784 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa378071c40 0x7fa378167780 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:55.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.046+0000 7fa37ec00640 1 -- 172.21.15.112:0/524258784 >> 172.21.15.112:0/524258784 conn(0x7fa3780b26c0 msgr2=0x7fa3780b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:55.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.046+0000 7fa37ec00640 1 -- 172.21.15.112:0/524258784 shutdown_connections 2024-09-12T02:47:55.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.046+0000 7fa37ec00640 1 -- 172.21.15.112:0/524258784 wait complete. 2024-09-12T02:47:55.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.048+0000 7fa37ec00640 1 Processor -- start 2024-09-12T02:47:55.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.048+0000 7fa37ec00640 1 -- start start 2024-09-12T02:47:55.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.049+0000 7fa37ec00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa378145a90 0x7fa3780c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:55.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.049+0000 7fa37ec00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3781460a0 0x7fa3780c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:55.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.049+0000 7fa37ec00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa3780c6b40 0x7fa37815d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:55.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.049+0000 7fa37ec00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa37806f340 con 0x7fa378145a90 2024-09-12T02:47:55.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.049+0000 7fa37ec00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa3780cfb40 con 0x7fa3781460a0 2024-09-12T02:47:55.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.049+0000 7fa37ec00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa37806f4c0 con 0x7fa3780c6b40 2024-09-12T02:47:55.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.049+0000 7fa377e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa378145a90 0x7fa3780c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:55.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.049+0000 7fa377e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa378145a90 0x7fa3780c8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46656/0 (socket says 172.21.15.112:46656) 2024-09-12T02:47:55.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.049+0000 7fa377e00640 1 -- 172.21.15.112:0/2956885182 learned_addr learned my addr 172.21.15.112:0/2956885182 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:55.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.049+0000 7fa37cc00640 1 --2- 172.21.15.112:0/2956885182 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa3780c6b40 0x7fa37815d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:55.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.050+0000 7fa377400640 1 --2- 172.21.15.112:0/2956885182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3781460a0 0x7fa3780c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:55.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.050+0000 7fa377e00640 1 -- 172.21.15.112:0/2956885182 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa3780c6b40 msgr2=0x7fa37815d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:55.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.050+0000 7fa377e00640 1 --2- 172.21.15.112:0/2956885182 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa3780c6b40 0x7fa37815d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:55.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.050+0000 7fa377e00640 1 -- 172.21.15.112:0/2956885182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3781460a0 msgr2=0x7fa3780c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:55.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.050+0000 7fa377e00640 1 --2- 172.21.15.112:0/2956885182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3781460a0 0x7fa3780c6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:55.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.050+0000 7fa377e00640 1 -- 172.21.15.112:0/2956885182 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3780c7970 con 0x7fa378145a90 2024-09-12T02:47:55.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.050+0000 7fa377e00640 1 --2- 172.21.15.112:0/2956885182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa378145a90 0x7fa3780c8f70 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fa36800c3a0 tx=0x7fa36800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:55.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.050+0000 7fa36fe00640 1 -- 172.21.15.112:0/2956885182 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa368017070 con 0x7fa378145a90 2024-09-12T02:47:55.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.050+0000 7fa36fe00640 1 -- 172.21.15.112:0/2956885182 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3680052f0 con 0x7fa378145a90 2024-09-12T02:47:55.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.050+0000 7fa36fe00640 1 -- 172.21.15.112:0/2956885182 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa368003830 con 0x7fa378145a90 2024-09-12T02:47:55.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.050+0000 7fa37ec00640 1 -- 172.21.15.112:0/2956885182 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3780c7c10 con 0x7fa378145a90 2024-09-12T02:47:55.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.051+0000 7fa37ec00640 1 -- 172.21.15.112:0/2956885182 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3780c81d0 con 0x7fa378145a90 2024-09-12T02:47:55.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.052+0000 7fa37ec00640 1 -- 172.21.15.112:0/2956885182 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3780cffd0 con 0x7fa378145a90 2024-09-12T02:47:55.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.052+0000 7fa36fe00640 1 -- 172.21.15.112:0/2956885182 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa36801a070 con 0x7fa378145a90 2024-09-12T02:47:55.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.053+0000 7fa36fe00640 1 --2- 172.21.15.112:0/2956885182 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa35806be30 0x7fa35806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:55.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.053+0000 7fa36fe00640 1 -- 172.21.15.112:0/2956885182 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 4857+0+0 (secure 0 0 0) 0x7fa368089e50 con 0x7fa378145a90 2024-09-12T02:47:55.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.054+0000 7fa377400640 1 --2- 172.21.15.112:0/2956885182 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa35806be30 0x7fa35806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:55.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.054+0000 7fa377400640 1 --2- 172.21.15.112:0/2956885182 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa35806be30 0x7fa35806e2f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa364007fd0 tx=0x7fa364009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:55.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.057+0000 7fa36fe00640 1 -- 172.21.15.112:0/2956885182 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa368058460 con 0x7fa378145a90 2024-09-12T02:47:55.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.231+0000 7fa37ec00640 1 -- 172.21.15.112:0/2956885182 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa37806e640 con 0x7fa378145a90 2024-09-12T02:47:55.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.232+0000 7fa36fe00640 1 -- 172.21.15.112:0/2956885182 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v131) ==== 84+0+65 (secure 0 0 0) 0x7fa36805c760 con 0x7fa378145a90 2024-09-12T02:47:55.233 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:55.233 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2024-09-12T02:47:55.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:47:55.233 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 1, 2024-09-12T02:47:55.233 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": ".mgr" 2024-09-12T02:47:55.233 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:47:55.234 INFO:teuthology.orchestra.run.smithi112.stdout:] 2024-09-12T02:47:55.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.234+0000 7fa37ec00640 1 -- 172.21.15.112:0/2956885182 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa35806be30 msgr2=0x7fa35806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:55.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.234+0000 7fa37ec00640 1 --2- 172.21.15.112:0/2956885182 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa35806be30 0x7fa35806e2f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa364007fd0 tx=0x7fa364009040 comp rx=0 tx=0).stop 2024-09-12T02:47:55.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.234+0000 7fa37ec00640 1 -- 172.21.15.112:0/2956885182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa378145a90 msgr2=0x7fa3780c8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:55.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.234+0000 7fa37ec00640 1 --2- 172.21.15.112:0/2956885182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa378145a90 0x7fa3780c8f70 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fa36800c3a0 tx=0x7fa36800c860 comp rx=0 tx=0).stop 2024-09-12T02:47:55.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.234+0000 7fa37ec00640 1 -- 172.21.15.112:0/2956885182 shutdown_connections 2024-09-12T02:47:55.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.234+0000 7fa37ec00640 1 --2- 172.21.15.112:0/2956885182 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa3780c6b40 0x7fa37815d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:55.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.234+0000 7fa37ec00640 1 --2- 172.21.15.112:0/2956885182 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa35806be30 0x7fa35806e2f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:55.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.234+0000 7fa37ec00640 1 --2- 172.21.15.112:0/2956885182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3781460a0 0x7fa3780c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:55.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.234+0000 7fa37ec00640 1 --2- 172.21.15.112:0/2956885182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa378145a90 0x7fa3780c8f70 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:55.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.234+0000 7fa37ec00640 1 -- 172.21.15.112:0/2956885182 >> 172.21.15.112:0/2956885182 conn(0x7fa3780b26c0 msgr2=0x7fa378160eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:55.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.234+0000 7fa37ec00640 1 -- 172.21.15.112:0/2956885182 shutdown_connections 2024-09-12T02:47:55.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.234+0000 7fa37ec00640 1 -- 172.21.15.112:0/2956885182 wait complete. 2024-09-12T02:47:55.251 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T02:47:55.251 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T02:47:55.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.407+0000 7f99d3200640 1 Processor -- start 2024-09-12T02:47:55.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.407+0000 7f99d3200640 1 -- start start 2024-09-12T02:47:55.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.408+0000 7f99d3200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f99d4145e00 0x7f99d415d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:55.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.409+0000 7f99d3200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99d40d0100 con 0x7f99d40b5a80 2024-09-12T02:47:55.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.409+0000 7f99d3200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99d40d03e0 con 0x7f99d40b31e0 2024-09-12T02:47:55.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.409+0000 7f99d3200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f99d40b4ee0 con 0x7f99d4145e00 2024-09-12T02:47:55.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.409+0000 7f99d2800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f99d40b5a80 0x7f99d406e580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52084/0 (socket says 172.21.15.112:52084) 2024-09-12T02:47:55.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.409+0000 7f99d2800640 1 -- 172.21.15.112:0/1170584389 learned_addr learned my addr 172.21.15.112:0/1170584389 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:55.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.409+0000 7f99d1e00640 1 --2- 172.21.15.112:0/1170584389 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f99d4145e00 0x7f99d415d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:55.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.409+0000 7f99d1400640 1 -- 172.21.15.112:0/1170584389 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1098375703 0 0) 0x7f99d40d0100 con 0x7f99d40b5a80 2024-09-12T02:47:55.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.409+0000 7f99d1400640 1 -- 172.21.15.112:0/1170584389 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99b8003520 con 0x7f99d40b5a80 2024-09-12T02:47:55.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.409+0000 7f99d1400640 1 -- 172.21.15.112:0/1170584389 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4170865305 0 0) 0x7f99d40d03e0 con 0x7f99d40b31e0 2024-09-12T02:47:55.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.409+0000 7f99d1400640 1 -- 172.21.15.112:0/1170584389 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99d40d0100 con 0x7f99d40b31e0 2024-09-12T02:47:55.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.410+0000 7f99d1e00640 1 -- 172.21.15.112:0/1170584389 >> v1:172.21.15.137:6789/0 conn(0x7f99d40b31e0 legacy=0x7f99d40b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:55.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.410+0000 7f99d1e00640 1 -- 172.21.15.112:0/1170584389 >> v1:172.21.15.112:6789/0 conn(0x7f99d40b5a80 legacy=0x7f99d406e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:55.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.410+0000 7f99d1e00640 1 -- 172.21.15.112:0/1170584389 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d40b4b70 con 0x7f99d4145e00 2024-09-12T02:47:55.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.411+0000 7f99d1e00640 1 --2- 172.21.15.112:0/1170584389 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f99d4145e00 0x7f99d415d010 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f99c40097d0 tx=0x7f99c402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a4bb85a393bb16a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:55.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.411+0000 7f99d1400640 1 -- 172.21.15.112:0/1170584389 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c4037070 con 0x7f99d4145e00 2024-09-12T02:47:55.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.411+0000 7f99d1400640 1 -- 172.21.15.112:0/1170584389 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99c4032440 con 0x7f99d4145e00 2024-09-12T02:47:55.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.411+0000 7f99d1400640 1 -- 172.21.15.112:0/1170584389 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c40327f0 con 0x7f99d4145e00 2024-09-12T02:47:55.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.411+0000 7f99d3200640 1 -- 172.21.15.112:0/1170584389 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f99d4145e00 msgr2=0x7f99d415d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:55.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.411+0000 7f99d3200640 1 --2- 172.21.15.112:0/1170584389 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f99d4145e00 0x7f99d415d010 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f99c40097d0 tx=0x7f99c402a210 comp rx=0 tx=0).stop 2024-09-12T02:47:55.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.412+0000 7f99d3200640 1 -- 172.21.15.112:0/1170584389 shutdown_connections 2024-09-12T02:47:55.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.412+0000 7f99d3200640 1 --2- 172.21.15.112:0/1170584389 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f99d4145e00 0x7f99d415d010 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:55.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.412+0000 7f99d3200640 1 -- 172.21.15.112:0/1170584389 >> 172.21.15.112:0/1170584389 conn(0x7f99d40b26c0 msgr2=0x7f99d40b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:55.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.412+0000 7f99d3200640 1 -- 172.21.15.112:0/1170584389 shutdown_connections 2024-09-12T02:47:55.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.412+0000 7f99d3200640 1 -- 172.21.15.112:0/1170584389 wait complete. 2024-09-12T02:47:55.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.413+0000 7f99d3200640 1 Processor -- start 2024-09-12T02:47:55.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.413+0000 7f99d3200640 1 -- start start 2024-09-12T02:47:55.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.414+0000 7f99d3200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f99d40b31e0 0x7f99d413b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:55.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.414+0000 7f99d3200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99d40b5a80 0x7f99d41386c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:55.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.414+0000 7f99d3200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99d4145e00 0x7f99d40ae600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:55.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.414+0000 7f99d3200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f99d406ee10 con 0x7f99d4145e00 2024-09-12T02:47:55.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.414+0000 7f99d3200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f99d406ec90 con 0x7f99d40b5a80 2024-09-12T02:47:55.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.414+0000 7f99d3200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f99d415d550 con 0x7f99d40b31e0 2024-09-12T02:47:55.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.414+0000 7f99d2800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99d4145e00 0x7f99d40ae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:55.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.415+0000 7f99d2800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99d4145e00 0x7f99d40ae600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46658/0 (socket says 172.21.15.112:46658) 2024-09-12T02:47:55.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.415+0000 7f99d2800640 1 -- 172.21.15.112:0/4022643129 learned_addr learned my addr 172.21.15.112:0/4022643129 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:55.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.415+0000 7f99d1e00640 1 --2- 172.21.15.112:0/4022643129 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f99d40b31e0 0x7f99d413b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:55.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.415+0000 7f99c9400640 1 --2- 172.21.15.112:0/4022643129 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99d40b5a80 0x7f99d41386c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:55.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.415+0000 7f99d2800640 1 -- 172.21.15.112:0/4022643129 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f99d40b31e0 msgr2=0x7f99d413b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:55.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.415+0000 7f99d2800640 1 --2- 172.21.15.112:0/4022643129 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f99d40b31e0 0x7f99d413b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:55.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.415+0000 7f99d2800640 1 -- 172.21.15.112:0/4022643129 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99d40b5a80 msgr2=0x7f99d41386c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:55.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.415+0000 7f99d2800640 1 --2- 172.21.15.112:0/4022643129 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99d40b5a80 0x7f99d41386c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:55.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.415+0000 7f99d2800640 1 -- 172.21.15.112:0/4022643129 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d40af730 con 0x7f99d4145e00 2024-09-12T02:47:55.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.415+0000 7f99c9400640 1 --2- 172.21.15.112:0/4022643129 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99d40b5a80 0x7f99d41386c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:55.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.415+0000 7f99d2800640 1 --2- 172.21.15.112:0/4022643129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99d4145e00 0x7f99d40ae600 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f99cc00cba0 tx=0x7f99cc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:55.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.415+0000 7f99caa00640 1 -- 172.21.15.112:0/4022643129 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc017070 con 0x7f99d4145e00 2024-09-12T02:47:55.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.416+0000 7f99caa00640 1 -- 172.21.15.112:0/4022643129 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99cc00ace0 con 0x7f99d4145e00 2024-09-12T02:47:55.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.416+0000 7f99d3200640 1 -- 172.21.15.112:0/4022643129 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99d4138c00 con 0x7f99d4145e00 2024-09-12T02:47:55.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.416+0000 7f99caa00640 1 -- 172.21.15.112:0/4022643129 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc012620 con 0x7f99d4145e00 2024-09-12T02:47:55.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.416+0000 7f99d3200640 1 -- 172.21.15.112:0/4022643129 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99d40af9a0 con 0x7f99d4145e00 2024-09-12T02:47:55.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.417+0000 7f99d3200640 1 -- 172.21.15.112:0/4022643129 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99d4146360 con 0x7f99d4145e00 2024-09-12T02:47:55.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.418+0000 7f99caa00640 1 -- 172.21.15.112:0/4022643129 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f99cc01a070 con 0x7f99d4145e00 2024-09-12T02:47:55.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.418+0000 7f99caa00640 1 --2- 172.21.15.112:0/4022643129 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f99b006be30 0x7f99b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:55.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.419+0000 7f99caa00640 1 -- 172.21.15.112:0/4022643129 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 4857+0+0 (secure 0 0 0) 0x7f99cc08a990 con 0x7f99d4145e00 2024-09-12T02:47:55.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.419+0000 7f99d1e00640 1 --2- 172.21.15.112:0/4022643129 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f99b006be30 0x7f99b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:55.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.419+0000 7f99d1e00640 1 --2- 172.21.15.112:0/4022643129 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f99b006be30 0x7f99b006e2f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f99c4034000 tx=0x7f99c402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:55.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.423+0000 7f99caa00640 1 -- 172.21.15.112:0/4022643129 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f99d4138c00 con 0x7f99d4145e00 2024-09-12T02:47:55.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:55.600+0000 7f99d3200640 1 -- 172.21.15.112:0/4022643129 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f99d415d0b0 con 0x7f99d4145e00 2024-09-12T02:47:56.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.448+0000 7f99caa00640 1 -- 172.21.15.112:0/4022643129 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v132) ==== 138+0+0 (secure 0 0 0) 0x7f99cc058fa0 con 0x7f99d4145e00 2024-09-12T02:47:56.449 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' created 2024-09-12T02:47:56.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.451+0000 7f99d3200640 1 -- 172.21.15.112:0/4022643129 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f99b006be30 msgr2=0x7f99b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:56.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.451+0000 7f99d3200640 1 --2- 172.21.15.112:0/4022643129 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f99b006be30 0x7f99b006e2f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f99c4034000 tx=0x7f99c402e000 comp rx=0 tx=0).stop 2024-09-12T02:47:56.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.451+0000 7f99d3200640 1 -- 172.21.15.112:0/4022643129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99d4145e00 msgr2=0x7f99d40ae600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:56.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.451+0000 7f99d3200640 1 --2- 172.21.15.112:0/4022643129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99d4145e00 0x7f99d40ae600 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f99cc00cba0 tx=0x7f99cc00a430 comp rx=0 tx=0).stop 2024-09-12T02:47:56.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.451+0000 7f99d3200640 1 -- 172.21.15.112:0/4022643129 shutdown_connections 2024-09-12T02:47:56.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.451+0000 7f99d3200640 1 --2- 172.21.15.112:0/4022643129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99d4145e00 0x7f99d40ae600 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.451+0000 7f99d3200640 1 --2- 172.21.15.112:0/4022643129 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f99b006be30 0x7f99b006e2f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.451+0000 7f99d3200640 1 --2- 172.21.15.112:0/4022643129 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99d40b5a80 0x7f99d41386c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.451+0000 7f99d3200640 1 --2- 172.21.15.112:0/4022643129 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f99d40b31e0 0x7f99d413b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.451+0000 7f99d3200640 1 -- 172.21.15.112:0/4022643129 >> 172.21.15.112:0/4022643129 conn(0x7f99d40b26c0 msgr2=0x7f99d40b1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:56.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.451+0000 7f99d3200640 1 -- 172.21.15.112:0/4022643129 shutdown_connections 2024-09-12T02:47:56.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.451+0000 7f99d3200640 1 -- 172.21.15.112:0/4022643129 wait complete. 2024-09-12T02:47:56.473 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:47:56.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.636+0000 7f7f5a200640 1 Processor -- start 2024-09-12T02:47:56.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.636+0000 7f7f5a200640 1 -- start start 2024-09-12T02:47:56.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.637+0000 7f7f5a200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7f540d59e0 0x7f7f540d2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:56.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.637+0000 7f7f5a200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f540d32c0 0x7f7f540b7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:56.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.637+0000 7f7f5a200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f540cf810 con 0x7f7f5415f080 2024-09-12T02:47:56.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.637+0000 7f7f5a200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7f540cfa90 con 0x7f7f540d59e0 2024-09-12T02:47:56.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.637+0000 7f7f5a200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7f540cfd70 con 0x7f7f540d32c0 2024-09-12T02:47:56.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.638+0000 7f7f59800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f540d32c0 0x7f7f540b7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:56.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.638+0000 7f7f53e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7f540d59e0 0x7f7f540d2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:56.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.638+0000 7f7f59800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f540d32c0 0x7f7f540b7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:39912/0 (socket says 172.21.15.112:39912) 2024-09-12T02:47:56.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.638+0000 7f7f59800640 1 -- 172.21.15.112:0/583448593 learned_addr learned my addr 172.21.15.112:0/583448593 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:56.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.638+0000 7f7f59800640 1 -- 172.21.15.112:0/583448593 >> v2:172.21.15.137:3300/0 conn(0x7f7f540d59e0 msgr2=0x7f7f540d2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:56.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.638+0000 7f7f59800640 1 --2- 172.21.15.112:0/583448593 >> v2:172.21.15.137:3300/0 conn(0x7f7f540d59e0 0x7f7f540d2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.638+0000 7f7f59800640 1 -- 172.21.15.112:0/583448593 >> v1:172.21.15.137:6789/0 conn(0x7f7f5415f080 legacy=0x7f7f540d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:56.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.638+0000 7f7f59800640 1 -- 172.21.15.112:0/583448593 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f540d0050 con 0x7f7f540d32c0 2024-09-12T02:47:56.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.639+0000 7f7f59800640 1 --2- 172.21.15.112:0/583448593 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f540d32c0 0x7f7f540b7b50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c009e50 tx=0x7f7f4c02a7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1d00629b94bb7aa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:56.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.639+0000 7f7f53400640 1 -- 172.21.15.112:0/583448593 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c036070 con 0x7f7f540d32c0 2024-09-12T02:47:56.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.639+0000 7f7f53400640 1 -- 172.21.15.112:0/583448593 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f4c031600 con 0x7f7f540d32c0 2024-09-12T02:47:56.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.639+0000 7f7f53400640 1 -- 172.21.15.112:0/583448593 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c0319d0 con 0x7f7f540d32c0 2024-09-12T02:47:56.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.640+0000 7f7f5a200640 1 -- 172.21.15.112:0/583448593 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f540d32c0 msgr2=0x7f7f540b7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:56.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.640+0000 7f7f5a200640 1 --2- 172.21.15.112:0/583448593 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f540d32c0 0x7f7f540b7b50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c009e50 tx=0x7f7f4c02a7a0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.640+0000 7f7f5a200640 1 -- 172.21.15.112:0/583448593 shutdown_connections 2024-09-12T02:47:56.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.640+0000 7f7f5a200640 1 --2- 172.21.15.112:0/583448593 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f540d32c0 0x7f7f540b7b50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.640+0000 7f7f5a200640 1 --2- 172.21.15.112:0/583448593 >> v2:172.21.15.137:3300/0 conn(0x7f7f540d59e0 0x7f7f540d2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.640+0000 7f7f5a200640 1 -- 172.21.15.112:0/583448593 >> 172.21.15.112:0/583448593 conn(0x7f7f540d4d00 msgr2=0x7f7f540d5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:56.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.640+0000 7f7f5a200640 1 -- 172.21.15.112:0/583448593 shutdown_connections 2024-09-12T02:47:56.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.640+0000 7f7f5a200640 1 -- 172.21.15.112:0/583448593 wait complete. 2024-09-12T02:47:56.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.642+0000 7f7f5a200640 1 Processor -- start 2024-09-12T02:47:56.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.642+0000 7f7f5a200640 1 -- start start 2024-09-12T02:47:56.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.643+0000 7f7f5a200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f540d32c0 0x7f7f540b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:56.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.643+0000 7f7f5a200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f540d59e0 0x7f7f540b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:56.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.643+0000 7f7f5a200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f5415f080 0x7f7f5415e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:56.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.643+0000 7f7f5a200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7f540d0b30 con 0x7f7f540d32c0 2024-09-12T02:47:56.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.643+0000 7f7f5a200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7f540d0610 con 0x7f7f5415f080 2024-09-12T02:47:56.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.643+0000 7f7f5a200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7f540b8090 con 0x7f7f540d59e0 2024-09-12T02:47:56.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.643+0000 7f7f58e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f540d32c0 0x7f7f540b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:56.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.643+0000 7f7f58e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f540d32c0 0x7f7f540b2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46662/0 (socket says 172.21.15.112:46662) 2024-09-12T02:47:56.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.643+0000 7f7f58e00640 1 -- 172.21.15.112:0/3884296604 learned_addr learned my addr 172.21.15.112:0/3884296604 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:56.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.643+0000 7f7f53e00640 1 --2- 172.21.15.112:0/3884296604 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f540d59e0 0x7f7f540b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:56.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.643+0000 7f7f59800640 1 --2- 172.21.15.112:0/3884296604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f5415f080 0x7f7f5415e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:56.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.643+0000 7f7f58e00640 1 -- 172.21.15.112:0/3884296604 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f540d59e0 msgr2=0x7f7f540b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:56.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.643+0000 7f7f58e00640 1 --2- 172.21.15.112:0/3884296604 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f540d59e0 0x7f7f540b33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.643+0000 7f7f58e00640 1 -- 172.21.15.112:0/3884296604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f5415f080 msgr2=0x7f7f5415e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:56.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.643+0000 7f7f58e00640 1 --2- 172.21.15.112:0/3884296604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f5415f080 0x7f7f5415e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.643+0000 7f7f58e00640 1 -- 172.21.15.112:0/3884296604 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f540cbf70 con 0x7f7f540d32c0 2024-09-12T02:47:56.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.643+0000 7f7f59800640 1 --2- 172.21.15.112:0/3884296604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f5415f080 0x7f7f5415e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:56.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.644+0000 7f7f58e00640 1 --2- 172.21.15.112:0/3884296604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f540d32c0 0x7f7f540b2d50 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f7f4800c3c0 tx=0x7f7f4800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:56.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.644+0000 7f7f50c00640 1 -- 172.21.15.112:0/3884296604 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f480052d0 con 0x7f7f540d32c0 2024-09-12T02:47:56.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.644+0000 7f7f50c00640 1 -- 172.21.15.112:0/3884296604 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f48005490 con 0x7f7f540d32c0 2024-09-12T02:47:56.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.644+0000 7f7f50c00640 1 -- 172.21.15.112:0/3884296604 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f48007260 con 0x7f7f540d32c0 2024-09-12T02:47:56.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.644+0000 7f7f5a200640 1 -- 172.21.15.112:0/3884296604 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f540b38e0 con 0x7f7f540d32c0 2024-09-12T02:47:56.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.644+0000 7f7f5a200640 1 -- 172.21.15.112:0/3884296604 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f540b3b80 con 0x7f7f540d32c0 2024-09-12T02:47:56.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.645+0000 7f7f5a200640 1 -- 172.21.15.112:0/3884296604 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f540b7b50 con 0x7f7f540d32c0 2024-09-12T02:47:56.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.646+0000 7f7f50c00640 1 -- 172.21.15.112:0/3884296604 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7f48007400 con 0x7f7f540d32c0 2024-09-12T02:47:56.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.648+0000 7f7f50c00640 1 --2- 172.21.15.112:0/3884296604 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7f3406be30 0x7f7f3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:56.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.648+0000 7f7f50c00640 1 -- 172.21.15.112:0/3884296604 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5227+0+0 (secure 0 0 0) 0x7f7f4808a150 con 0x7f7f540d32c0 2024-09-12T02:47:56.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.648+0000 7f7f53e00640 1 --2- 172.21.15.112:0/3884296604 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7f3406be30 0x7f7f3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:56.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.648+0000 7f7f53e00640 1 --2- 172.21.15.112:0/3884296604 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7f3406be30 0x7f7f3406e2f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7f540b3350 tx=0x7f7f40009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:56.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.653+0000 7f7f50c00640 1 -- 172.21.15.112:0/3884296604 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7f540cf810 con 0x7f7f540d32c0 2024-09-12T02:47:56.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:56.825+0000 7f7f5a200640 1 -- 172.21.15.112:0/3884296604 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f7f540d14f0 con 0x7f7f540d32c0 2024-09-12T02:47:57.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.455+0000 7f7f50c00640 1 -- 172.21.15.112:0/3884296604 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v133) ==== 170+0+0 (secure 0 0 0) 0x7f7f480585f0 con 0x7f7f540d32c0 2024-09-12T02:47:57.456 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' created 2024-09-12T02:47:57.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.459+0000 7f7f5a200640 1 -- 172.21.15.112:0/3884296604 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7f3406be30 msgr2=0x7f7f3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:57.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.459+0000 7f7f5a200640 1 --2- 172.21.15.112:0/3884296604 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7f3406be30 0x7f7f3406e2f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7f540b3350 tx=0x7f7f40009190 comp rx=0 tx=0).stop 2024-09-12T02:47:57.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.459+0000 7f7f5a200640 1 -- 172.21.15.112:0/3884296604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f540d32c0 msgr2=0x7f7f540b2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:57.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.459+0000 7f7f5a200640 1 --2- 172.21.15.112:0/3884296604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f540d32c0 0x7f7f540b2d50 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f7f4800c3c0 tx=0x7f7f4800c880 comp rx=0 tx=0).stop 2024-09-12T02:47:57.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.459+0000 7f7f5a200640 1 -- 172.21.15.112:0/3884296604 shutdown_connections 2024-09-12T02:47:57.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.459+0000 7f7f5a200640 1 --2- 172.21.15.112:0/3884296604 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7f3406be30 0x7f7f3406e2f0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:57.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.459+0000 7f7f5a200640 1 --2- 172.21.15.112:0/3884296604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f5415f080 0x7f7f5415e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:57.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.459+0000 7f7f5a200640 1 --2- 172.21.15.112:0/3884296604 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f540d59e0 0x7f7f540b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:57.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.459+0000 7f7f5a200640 1 --2- 172.21.15.112:0/3884296604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f540d32c0 0x7f7f540b2d50 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:57.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.459+0000 7f7f5a200640 1 -- 172.21.15.112:0/3884296604 >> 172.21.15.112:0/3884296604 conn(0x7f7f540d4d00 msgr2=0x7f7f540d1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:57.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.461+0000 7f7f5a200640 1 -- 172.21.15.112:0/3884296604 shutdown_connections 2024-09-12T02:47:57.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.467+0000 7f7f5a200640 1 -- 172.21.15.112:0/3884296604 wait complete. 2024-09-12T02:47:57.491 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T02:47:57.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.645+0000 7f2486800640 1 Processor -- start 2024-09-12T02:47:57.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.645+0000 7f2486800640 1 -- start start 2024-09-12T02:47:57.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.646+0000 7f2486800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f248015b9a0 0x7f248006d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:57.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.646+0000 7f2486800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f248006f270 0x7f24800b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:57.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.646+0000 7f2486800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f24800b5560 0x7f24800d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:57.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.646+0000 7f2486800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f248006de70 con 0x7f24800b5560 2024-09-12T02:47:57.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.646+0000 7f2486800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f248006f690 con 0x7f248006f270 2024-09-12T02:47:57.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.646+0000 7f2486800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f24800b42c0 con 0x7f248015b9a0 2024-09-12T02:47:57.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.646+0000 7f2485e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f24800b5560 0x7f24800d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:57.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.646+0000 7f2485e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f24800b5560 0x7f24800d0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46678/0 (socket says 172.21.15.112:46678) 2024-09-12T02:47:57.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.646+0000 7f2485e00640 1 -- 172.21.15.112:0/788128795 learned_addr learned my addr 172.21.15.112:0/788128795 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:57.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.646+0000 7f2484a00640 1 --2- 172.21.15.112:0/788128795 >> v2:172.21.15.137:3300/0 conn(0x7f248006f270 0x7f24800b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:57.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.646+0000 7f2485400640 1 --2- 172.21.15.112:0/788128795 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f248015b9a0 0x7f248006d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:57.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.647+0000 7f2485e00640 1 -- 172.21.15.112:0/788128795 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f248015b9a0 msgr2=0x7f248006d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:57.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.647+0000 7f2485e00640 1 --2- 172.21.15.112:0/788128795 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f248015b9a0 0x7f248006d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:57.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.647+0000 7f2485e00640 1 -- 172.21.15.112:0/788128795 >> v2:172.21.15.137:3300/0 conn(0x7f248006f270 msgr2=0x7f24800b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:57.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.647+0000 7f2485e00640 1 --2- 172.21.15.112:0/788128795 >> v2:172.21.15.137:3300/0 conn(0x7f248006f270 0x7f24800b5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:57.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.647+0000 7f2485e00640 1 -- 172.21.15.112:0/788128795 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f248015bd80 con 0x7f24800b5560 2024-09-12T02:47:57.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.648+0000 7f2485e00640 1 --2- 172.21.15.112:0/788128795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24800b5560 0x7f24800d0820 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f2478009e50 tx=0x7f247802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b632a76e97b762 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:57.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.648+0000 7f247fe00640 1 -- 172.21.15.112:0/788128795 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2478036070 con 0x7f24800b5560 2024-09-12T02:47:57.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.648+0000 7f247fe00640 1 -- 172.21.15.112:0/788128795 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2478031600 con 0x7f24800b5560 2024-09-12T02:47:57.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.648+0000 7f247fe00640 1 -- 172.21.15.112:0/788128795 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24780319d0 con 0x7f24800b5560 2024-09-12T02:47:57.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.648+0000 7f2486800640 1 -- 172.21.15.112:0/788128795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24800b5560 msgr2=0x7f24800d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:57.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.648+0000 7f2486800640 1 --2- 172.21.15.112:0/788128795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24800b5560 0x7f24800d0820 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f2478009e50 tx=0x7f247802a6c0 comp rx=0 tx=0).stop 2024-09-12T02:47:57.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.649+0000 7f2486800640 1 -- 172.21.15.112:0/788128795 shutdown_connections 2024-09-12T02:47:57.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.649+0000 7f2486800640 1 --2- 172.21.15.112:0/788128795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24800b5560 0x7f24800d0820 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:57.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.649+0000 7f2486800640 1 --2- 172.21.15.112:0/788128795 >> v2:172.21.15.137:3300/0 conn(0x7f248006f270 0x7f24800b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:57.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.649+0000 7f2486800640 1 --2- 172.21.15.112:0/788128795 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f248015b9a0 0x7f248006d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:57.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.649+0000 7f2486800640 1 -- 172.21.15.112:0/788128795 >> 172.21.15.112:0/788128795 conn(0x7f248006bbd0 msgr2=0x7f248006bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:57.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.649+0000 7f2486800640 1 -- 172.21.15.112:0/788128795 shutdown_connections 2024-09-12T02:47:57.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.649+0000 7f2486800640 1 -- 172.21.15.112:0/788128795 wait complete. 2024-09-12T02:47:57.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.650+0000 7f2486800640 1 Processor -- start 2024-09-12T02:47:57.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.650+0000 7f2486800640 1 -- start start 2024-09-12T02:47:57.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.651+0000 7f2486800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f248006f270 0x7f24801f7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:57.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.651+0000 7f2486800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f248015b9a0 0x7f24800723e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:57.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.651+0000 7f2486800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24801f5e10 0x7f2480156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:57.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.651+0000 7f2486800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f24800b4b00 con 0x7f248015b9a0 2024-09-12T02:47:57.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.651+0000 7f2486800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f24800b4820 con 0x7f248006f270 2024-09-12T02:47:57.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.651+0000 7f2486800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f24800b5b50 con 0x7f24801f5e10 2024-09-12T02:47:57.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.652+0000 7f2484a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f248015b9a0 0x7f24800723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:57.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.652+0000 7f2484a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f248015b9a0 0x7f24800723e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46684/0 (socket says 172.21.15.112:46684) 2024-09-12T02:47:57.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.652+0000 7f2484a00640 1 -- 172.21.15.112:0/2693565350 learned_addr learned my addr 172.21.15.112:0/2693565350 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:57.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.652+0000 7f2485400640 1 --2- 172.21.15.112:0/2693565350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f248006f270 0x7f24801f7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:57.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.652+0000 7f2485e00640 1 --2- 172.21.15.112:0/2693565350 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24801f5e10 0x7f2480156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:57.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.652+0000 7f2484a00640 1 -- 172.21.15.112:0/2693565350 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24801f5e10 msgr2=0x7f2480156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:57.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.652+0000 7f2484a00640 1 --2- 172.21.15.112:0/2693565350 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24801f5e10 0x7f2480156930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:57.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.652+0000 7f2484a00640 1 -- 172.21.15.112:0/2693565350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f248006f270 msgr2=0x7f24801f7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:57.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.652+0000 7f2484a00640 1 --2- 172.21.15.112:0/2693565350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f248006f270 0x7f24801f7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:57.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.652+0000 7f2484a00640 1 -- 172.21.15.112:0/2693565350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f248015c0d0 con 0x7f248015b9a0 2024-09-12T02:47:57.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.652+0000 7f2484a00640 1 --2- 172.21.15.112:0/2693565350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f248015b9a0 0x7f24800723e0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f246c00d800 tx=0x7f246c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:57.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.653+0000 7f247d600640 1 -- 172.21.15.112:0/2693565350 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c018030 con 0x7f248015b9a0 2024-09-12T02:47:57.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.653+0000 7f247d600640 1 -- 172.21.15.112:0/2693565350 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f246c004020 con 0x7f248015b9a0 2024-09-12T02:47:57.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.653+0000 7f247d600640 1 -- 172.21.15.112:0/2693565350 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c0041f0 con 0x7f248015b9a0 2024-09-12T02:47:57.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.653+0000 7f2486800640 1 -- 172.21.15.112:0/2693565350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f248015c3b0 con 0x7f248015b9a0 2024-09-12T02:47:57.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.653+0000 7f2486800640 1 -- 172.21.15.112:0/2693565350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2480072920 con 0x7f248015b9a0 2024-09-12T02:47:57.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.654+0000 7f2486800640 1 -- 172.21.15.112:0/2693565350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24800b5020 con 0x7f248015b9a0 2024-09-12T02:47:57.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.655+0000 7f247d600640 1 -- 172.21.15.112:0/2693565350 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f246c01b070 con 0x7f248015b9a0 2024-09-12T02:47:57.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.655+0000 7f247d600640 1 --2- 172.21.15.112:0/2693565350 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f246006be30 0x7f246006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:57.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.656+0000 7f247d600640 1 -- 172.21.15.112:0/2693565350 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5609+0+0 (secure 0 0 0) 0x7f246c08af90 con 0x7f248015b9a0 2024-09-12T02:47:57.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.656+0000 7f2485400640 1 --2- 172.21.15.112:0/2693565350 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f246006be30 0x7f246006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:57.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.656+0000 7f2485400640 1 --2- 172.21.15.112:0/2693565350 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f246006be30 0x7f246006e2f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f24740079a0 tx=0x7f2474008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:57.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.660+0000 7f247d600640 1 -- 172.21.15.112:0/2693565350 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f246c059900 con 0x7f248015b9a0 2024-09-12T02:47:57.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:57.869+0000 7f2486800640 1 -- 172.21.15.112:0/2693565350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f248015a3d0 con 0x7f248015b9a0 2024-09-12T02:47:58.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.457+0000 7f247d600640 1 -- 172.21.15.112:0/2693565350 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v66) ==== 174+0+0 (secure 0 0 0) 0x7f246c059200 con 0x7f248015b9a0 2024-09-12T02:47:58.458 INFO:teuthology.orchestra.run.smithi112.stderr:new fs with metadata pool 16 and data pool 17 2024-09-12T02:47:58.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.461+0000 7f2486800640 1 -- 172.21.15.112:0/2693565350 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f246006be30 msgr2=0x7f246006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:58.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.461+0000 7f2486800640 1 --2- 172.21.15.112:0/2693565350 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f246006be30 0x7f246006e2f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f24740079a0 tx=0x7f2474008040 comp rx=0 tx=0).stop 2024-09-12T02:47:58.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.461+0000 7f2486800640 1 -- 172.21.15.112:0/2693565350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f248015b9a0 msgr2=0x7f24800723e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:58.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.461+0000 7f2486800640 1 --2- 172.21.15.112:0/2693565350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f248015b9a0 0x7f24800723e0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f246c00d800 tx=0x7f246c00dcc0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.461+0000 7f2486800640 1 -- 172.21.15.112:0/2693565350 shutdown_connections 2024-09-12T02:47:58.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.461+0000 7f2486800640 1 --2- 172.21.15.112:0/2693565350 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24801f5e10 0x7f2480156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.461+0000 7f2486800640 1 --2- 172.21.15.112:0/2693565350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f248015b9a0 0x7f24800723e0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.461+0000 7f2486800640 1 --2- 172.21.15.112:0/2693565350 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f246006be30 0x7f246006e2f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.461+0000 7f2486800640 1 --2- 172.21.15.112:0/2693565350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f248006f270 0x7f24801f7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.461+0000 7f2486800640 1 -- 172.21.15.112:0/2693565350 >> 172.21.15.112:0/2693565350 conn(0x7f248006bbd0 msgr2=0x7f2480159370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:58.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.462+0000 7f2486800640 1 -- 172.21.15.112:0/2693565350 shutdown_connections 2024-09-12T02:47:58.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.462+0000 7f2486800640 1 -- 172.21.15.112:0/2693565350 wait complete. 2024-09-12T02:47:58.494 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:47:58.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.652+0000 7fba0fc00640 1 Processor -- start 2024-09-12T02:47:58.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.653+0000 7fba0fc00640 1 -- start start 2024-09-12T02:47:58.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.654+0000 7fba0fc00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fba080afe30 0x7fba080cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:58.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.654+0000 7fba0fc00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba080ceeb0 con 0x7fba08071530 2024-09-12T02:47:58.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.654+0000 7fba0fc00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba0806e300 con 0x7fba0815cc50 2024-09-12T02:47:58.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.654+0000 7fba0fc00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fba0815d030 con 0x7fba080afe30 2024-09-12T02:47:58.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.654+0000 7fb9ffe00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fba08071530 0x7fba080af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52098/0 (socket says 172.21.15.112:52098) 2024-09-12T02:47:58.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.654+0000 7fb9ffe00640 1 -- 172.21.15.112:0/4264946547 learned_addr learned my addr 172.21.15.112:0/4264946547 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:58.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.654+0000 7fba0dc00640 1 --2- 172.21.15.112:0/4264946547 >> v2:172.21.15.137:3300/0 conn(0x7fba080afe30 0x7fba080cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:58.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.655+0000 7fba07e00640 1 -- 172.21.15.112:0/4264946547 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 546781211 0 0) 0x7fba080ceeb0 con 0x7fba08071530 2024-09-12T02:47:58.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.655+0000 7fba07e00640 1 -- 172.21.15.112:0/4264946547 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9ec003520 con 0x7fba08071530 2024-09-12T02:47:58.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.655+0000 7fba07e00640 1 -- 172.21.15.112:0/4264946547 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1711767674 0 0) 0x7fba0806e300 con 0x7fba0815cc50 2024-09-12T02:47:58.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.655+0000 7fba07e00640 1 -- 172.21.15.112:0/4264946547 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba080ceeb0 con 0x7fba0815cc50 2024-09-12T02:47:58.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.655+0000 7fba07e00640 1 -- 172.21.15.112:0/4264946547 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 896867314 0 0) 0x7fb9ec003520 con 0x7fba08071530 2024-09-12T02:47:58.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.655+0000 7fba07e00640 1 -- 172.21.15.112:0/4264946547 >> v2:172.21.15.137:3300/0 conn(0x7fba080afe30 msgr2=0x7fba080cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:58.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.655+0000 7fba07e00640 1 --2- 172.21.15.112:0/4264946547 >> v2:172.21.15.137:3300/0 conn(0x7fba080afe30 0x7fba080cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.655+0000 7fba07e00640 1 -- 172.21.15.112:0/4264946547 >> v1:172.21.15.137:6789/0 conn(0x7fba0815cc50 legacy=0x7fba080732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:58.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.655+0000 7fba07e00640 1 -- 172.21.15.112:0/4264946547 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba0806e5e0 con 0x7fba08071530 2024-09-12T02:47:58.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.655+0000 7fba07e00640 1 -- 172.21.15.112:0/4264946547 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7fb9f00017f0 con 0x7fba08071530 2024-09-12T02:47:58.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.655+0000 7fba07e00640 1 -- 172.21.15.112:0/4264946547 >> v1:172.21.15.112:6789/0 conn(0x7fba08071530 legacy=0x7fba080af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:58.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.655+0000 7fba07e00640 1 --2- 172.21.15.112:0/4264946547 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb9ec003b90 0x7fb9ec003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:58.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.655+0000 7fba07e00640 1 --2- 172.21.15.112:0/4264946547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9ec004800 0x7fb9ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:58.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.655+0000 7fba07e00640 1 --2- 172.21.15.112:0/4264946547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9ec005210 0x7fb9ec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:58.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.655+0000 7fba07e00640 1 -- 172.21.15.112:0/4264946547 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ec00c110 con 0x7fb9ec005210 2024-09-12T02:47:58.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.655+0000 7fba07e00640 1 -- 172.21.15.112:0/4264946547 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ec00c2c0 con 0x7fb9ec004800 2024-09-12T02:47:58.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.655+0000 7fba07e00640 1 -- 172.21.15.112:0/4264946547 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb9ec00c4c0 con 0x7fb9ec003b90 2024-09-12T02:47:58.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.655+0000 7fba0dc00640 1 --2- 172.21.15.112:0/4264946547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9ec005210 0x7fb9ec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:58.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.655+0000 7fba0d200640 1 --2- 172.21.15.112:0/4264946547 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb9ec003b90 0x7fb9ec003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:58.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.655+0000 7fb9ffe00640 1 --2- 172.21.15.112:0/4264946547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9ec004800 0x7fb9ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:58.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.656+0000 7fba0dc00640 1 -- 172.21.15.112:0/4264946547 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb9ec003b90 msgr2=0x7fb9ec003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:58.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.656+0000 7fba0dc00640 1 --2- 172.21.15.112:0/4264946547 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb9ec003b90 0x7fb9ec003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.656+0000 7fba0dc00640 1 -- 172.21.15.112:0/4264946547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9ec004800 msgr2=0x7fb9ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:58.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.656+0000 7fba0dc00640 1 --2- 172.21.15.112:0/4264946547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9ec004800 0x7fb9ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.656+0000 7fba0dc00640 1 -- 172.21.15.112:0/4264946547 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ec003520 con 0x7fb9ec005210 2024-09-12T02:47:58.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.657+0000 7fba0dc00640 1 -- 172.21.15.112:0/4264946547 reap_dead start 2024-09-12T02:47:58.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.657+0000 7fba0dc00640 1 --2- 172.21.15.112:0/4264946547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9ec005210 0x7fb9ec00b9c0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fba00009f90 tx=0x7fb9ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f7da2d204a33ab7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:58.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.657+0000 7fba07e00640 1 -- 172.21.15.112:0/4264946547 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba00035020 con 0x7fb9ec005210 2024-09-12T02:47:58.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.657+0000 7fba07e00640 1 -- 172.21.15.112:0/4264946547 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba00003b90 con 0x7fb9ec005210 2024-09-12T02:47:58.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.657+0000 7fba07e00640 1 -- 172.21.15.112:0/4264946547 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba00009c10 con 0x7fb9ec005210 2024-09-12T02:47:58.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.657+0000 7fba0fc00640 1 -- 172.21.15.112:0/4264946547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9ec005210 msgr2=0x7fb9ec00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:58.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.657+0000 7fba0fc00640 1 --2- 172.21.15.112:0/4264946547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9ec005210 0x7fb9ec00b9c0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fba00009f90 tx=0x7fb9ec005830 comp rx=0 tx=0).stop 2024-09-12T02:47:58.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.658+0000 7fba0fc00640 1 -- 172.21.15.112:0/4264946547 shutdown_connections 2024-09-12T02:47:58.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.658+0000 7fba0fc00640 1 --2- 172.21.15.112:0/4264946547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9ec005210 0x7fb9ec00b9c0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.658+0000 7fba0fc00640 1 -- 172.21.15.112:0/4264946547 >> 172.21.15.112:0/4264946547 conn(0x7fba0806bbd0 msgr2=0x7fba0806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:58.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.658+0000 7fba0fc00640 1 -- 172.21.15.112:0/4264946547 shutdown_connections 2024-09-12T02:47:58.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.658+0000 7fba0fc00640 1 -- 172.21.15.112:0/4264946547 wait complete. 2024-09-12T02:47:58.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.659+0000 7fba0fc00640 1 Processor -- start 2024-09-12T02:47:58.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.659+0000 7fba0fc00640 1 -- start start 2024-09-12T02:47:58.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.660+0000 7fba0fc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9ec005210 0x7fba080b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:58.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.660+0000 7fba0fc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba08142d80 0x7fba081f8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:58.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.660+0000 7fba0fc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba08143200 0x7fba081f88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:58.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.660+0000 7fba0fc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fba0806f510 con 0x7fba08143200 2024-09-12T02:47:58.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.660+0000 7fba0fc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fba080cf4c0 con 0x7fb9ec005210 2024-09-12T02:47:58.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.660+0000 7fba0fc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fba0806f690 con 0x7fba08142d80 2024-09-12T02:47:58.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.660+0000 7fba0dc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba08143200 0x7fba081f88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:58.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.660+0000 7fba0dc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba08143200 0x7fba081f88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46702/0 (socket says 172.21.15.112:46702) 2024-09-12T02:47:58.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.661+0000 7fba0dc00640 1 -- 172.21.15.112:0/980218037 learned_addr learned my addr 172.21.15.112:0/980218037 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:58.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.661+0000 7fba0d200640 1 --2- 172.21.15.112:0/980218037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9ec005210 0x7fba080b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:58.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.661+0000 7fb9ffe00640 1 --2- 172.21.15.112:0/980218037 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba08142d80 0x7fba081f8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:58.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.661+0000 7fba0dc00640 1 -- 172.21.15.112:0/980218037 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba08142d80 msgr2=0x7fba081f8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:58.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.661+0000 7fba0dc00640 1 --2- 172.21.15.112:0/980218037 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba08142d80 0x7fba081f8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.661+0000 7fba0dc00640 1 -- 172.21.15.112:0/980218037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9ec005210 msgr2=0x7fba080b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:58.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.661+0000 7fba0dc00640 1 --2- 172.21.15.112:0/980218037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9ec005210 0x7fba080b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.661+0000 7fba0dc00640 1 -- 172.21.15.112:0/980218037 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba080b4a10 con 0x7fba08143200 2024-09-12T02:47:58.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.661+0000 7fba0dc00640 1 --2- 172.21.15.112:0/980218037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba08143200 0x7fba081f88b0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fba0000e230 tx=0x7fba00009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:58.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.661+0000 7fba05600640 1 -- 172.21.15.112:0/980218037 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba00035070 con 0x7fba08143200 2024-09-12T02:47:58.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.662+0000 7fba05600640 1 -- 172.21.15.112:0/980218037 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba00041070 con 0x7fba08143200 2024-09-12T02:47:58.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.662+0000 7fba05600640 1 -- 172.21.15.112:0/980218037 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba00009c10 con 0x7fba08143200 2024-09-12T02:47:58.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.662+0000 7fba0fc00640 1 -- 172.21.15.112:0/980218037 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba080b4cf0 con 0x7fba08143200 2024-09-12T02:47:58.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.662+0000 7fba0fc00640 1 -- 172.21.15.112:0/980218037 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba080b52b0 con 0x7fba08143200 2024-09-12T02:47:58.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.663+0000 7fba0fc00640 1 -- 172.21.15.112:0/980218037 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba08068a30 con 0x7fba08143200 2024-09-12T02:47:58.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.663+0000 7fba05600640 1 -- 172.21.15.112:0/980218037 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba00005d10 con 0x7fba08143200 2024-09-12T02:47:58.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.664+0000 7fba05600640 1 --2- 172.21.15.112:0/980218037 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb9e406be30 0x7fb9e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:58.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.664+0000 7fba05600640 1 -- 172.21.15.112:0/980218037 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5709+0+0 (secure 0 0 0) 0x7fba000ab9c0 con 0x7fba08143200 2024-09-12T02:47:58.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.665+0000 7fba0d200640 1 --2- 172.21.15.112:0/980218037 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb9e406be30 0x7fb9e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:58.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.665+0000 7fba0d200640 1 --2- 172.21.15.112:0/980218037 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb9e406be30 0x7fb9e406e2f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8000c00 tx=0x7fb9f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:58.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.669+0000 7fba05600640 1 -- 172.21.15.112:0/980218037 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fba00079d10 con 0x7fba08143200 2024-09-12T02:47:58.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.843+0000 7fba0fc00640 1 -- 172.21.15.112:0/980218037 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fba080730d0 con 0x7fba08143200 2024-09-12T02:47:58.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.845+0000 7fba05600640 1 -- 172.21.15.112:0/980218037 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) ==== 74+0+16749 (secure 0 0 0) 0x7fba0007e010 con 0x7fba08143200 2024-09-12T02:47:58.846 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:58.846 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":134,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:47:57.870828+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:47:55.641315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-12T02:47:56.867038+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:47:58.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.847+0000 7fba0fc00640 1 -- 172.21.15.112:0/980218037 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb9e406be30 msgr2=0x7fb9e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:58.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.847+0000 7fba0fc00640 1 --2- 172.21.15.112:0/980218037 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb9e406be30 0x7fb9e406e2f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8000c00 tx=0x7fb9f8009040 comp rx=0 tx=0).stop 2024-09-12T02:47:58.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.847+0000 7fba0fc00640 1 -- 172.21.15.112:0/980218037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba08143200 msgr2=0x7fba081f88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:58.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.847+0000 7fba0fc00640 1 --2- 172.21.15.112:0/980218037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba08143200 0x7fba081f88b0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fba0000e230 tx=0x7fba00009750 comp rx=0 tx=0).stop 2024-09-12T02:47:58.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.847+0000 7fba0fc00640 1 -- 172.21.15.112:0/980218037 shutdown_connections 2024-09-12T02:47:58.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.847+0000 7fba0fc00640 1 --2- 172.21.15.112:0/980218037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba08143200 0x7fba081f88b0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.847+0000 7fba0fc00640 1 --2- 172.21.15.112:0/980218037 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba08142d80 0x7fba081f8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.847+0000 7fba0fc00640 1 --2- 172.21.15.112:0/980218037 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb9e406be30 0x7fb9e406e2f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.847+0000 7fba0fc00640 1 --2- 172.21.15.112:0/980218037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9ec005210 0x7fba080b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.847+0000 7fba0fc00640 1 -- 172.21.15.112:0/980218037 >> 172.21.15.112:0/980218037 conn(0x7fba0806bbd0 msgr2=0x7fba080b0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:58.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.847+0000 7fba0fc00640 1 -- 172.21.15.112:0/980218037 shutdown_connections 2024-09-12T02:47:58.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:58.847+0000 7fba0fc00640 1 -- 172.21.15.112:0/980218037 wait complete. 2024-09-12T02:47:58.864 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:47:59.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.014+0000 7f3ee3000640 1 Processor -- start 2024-09-12T02:47:59.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.014+0000 7f3ee3000640 1 -- start start 2024-09-12T02:47:59.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.015+0000 7f3ee3000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3edc15b9d0 0x7f3edc0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:59.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.015+0000 7f3ee3000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3edc06f600 0x7f3edc0728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:59.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.016+0000 7f3ee3000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3edc0b54a0 con 0x7f3edc0b45d0 2024-09-12T02:47:59.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.016+0000 7f3ee3000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f3edc0b4a30 con 0x7f3edc06f600 2024-09-12T02:47:59.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.016+0000 7f3ee3000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3edc0b3af0 con 0x7f3edc15b9d0 2024-09-12T02:47:59.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.016+0000 7f3ee1000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3edc06f600 0x7f3edc0728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:59.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.016+0000 7f3ee1000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3edc06f600 0x7f3edc0728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46718/0 (socket says 172.21.15.112:46718) 2024-09-12T02:47:59.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.016+0000 7f3ee1000640 1 -- 172.21.15.112:0/2594041826 learned_addr learned my addr 172.21.15.112:0/2594041826 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:59.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.016+0000 7f3edbe00640 1 --2- 172.21.15.112:0/2594041826 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3edc15b9d0 0x7f3edc0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:59.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.016+0000 7f3ee1000640 1 -- 172.21.15.112:0/2594041826 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3edc15b9d0 msgr2=0x7f3edc0b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:59.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.016+0000 7f3ee1000640 1 --2- 172.21.15.112:0/2594041826 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3edc15b9d0 0x7f3edc0b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:59.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.016+0000 7f3ee1000640 1 -- 172.21.15.112:0/2594041826 >> v1:172.21.15.112:6789/0 conn(0x7f3edc0b45d0 legacy=0x7f3edc06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:59.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.016+0000 7f3ee1000640 1 -- 172.21.15.112:0/2594041826 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3edc0b3dd0 con 0x7f3edc06f600 2024-09-12T02:47:59.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.017+0000 7f3ee1000640 1 --2- 172.21.15.112:0/2594041826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3edc06f600 0x7f3edc0728c0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4009e50 tx=0x7f3ed402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=726897bb97e28c4c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:59.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.017+0000 7f3edb400640 1 -- 172.21.15.112:0/2594041826 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4036070 con 0x7f3edc06f600 2024-09-12T02:47:59.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.018+0000 7f3edb400640 1 -- 172.21.15.112:0/2594041826 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed4031600 con 0x7f3edc06f600 2024-09-12T02:47:59.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.018+0000 7f3edb400640 1 -- 172.21.15.112:0/2594041826 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed40319d0 con 0x7f3edc06f600 2024-09-12T02:47:59.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.018+0000 7f3ee3000640 1 -- 172.21.15.112:0/2594041826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3edc06f600 msgr2=0x7f3edc0728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:59.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.018+0000 7f3ee3000640 1 --2- 172.21.15.112:0/2594041826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3edc06f600 0x7f3edc0728c0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4009e50 tx=0x7f3ed402a710 comp rx=0 tx=0).stop 2024-09-12T02:47:59.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.018+0000 7f3ee3000640 1 -- 172.21.15.112:0/2594041826 shutdown_connections 2024-09-12T02:47:59.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.018+0000 7f3ee3000640 1 --2- 172.21.15.112:0/2594041826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3edc06f600 0x7f3edc0728c0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:59.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.018+0000 7f3ee3000640 1 --2- 172.21.15.112:0/2594041826 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3edc15b9d0 0x7f3edc0b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:59.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.018+0000 7f3ee3000640 1 -- 172.21.15.112:0/2594041826 >> 172.21.15.112:0/2594041826 conn(0x7f3edc06bbd0 msgr2=0x7f3edc06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:59.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.018+0000 7f3ee3000640 1 -- 172.21.15.112:0/2594041826 shutdown_connections 2024-09-12T02:47:59.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.018+0000 7f3ee3000640 1 -- 172.21.15.112:0/2594041826 wait complete. 2024-09-12T02:47:59.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.020+0000 7f3ee3000640 1 Processor -- start 2024-09-12T02:47:59.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.020+0000 7f3ee3000640 1 -- start start 2024-09-12T02:47:59.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.021+0000 7f3ee3000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3edc06f600 0x7f3edc151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:59.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.021+0000 7f3ee3000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3edc0b45d0 0x7f3edc155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:59.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.021+0000 7f3ee3000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3edc15b9d0 0x7f3edc152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:59.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.021+0000 7f3ee3000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3edc15bf30 con 0x7f3edc15b9d0 2024-09-12T02:47:59.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.021+0000 7f3ee3000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3edc15bdb0 con 0x7f3edc06f600 2024-09-12T02:47:59.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.021+0000 7f3ee3000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3edc0cdcd0 con 0x7f3edc0b45d0 2024-09-12T02:47:59.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.021+0000 7f3ee1000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3edc15b9d0 0x7f3edc152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:59.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.021+0000 7f3ee1000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3edc15b9d0 0x7f3edc152730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46732/0 (socket says 172.21.15.112:46732) 2024-09-12T02:47:59.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.021+0000 7f3ee1000640 1 -- 172.21.15.112:0/3240980924 learned_addr learned my addr 172.21.15.112:0/3240980924 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:59.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.021+0000 7f3edbe00640 1 --2- 172.21.15.112:0/3240980924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3edc06f600 0x7f3edc151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:59.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.021+0000 7f3ed3400640 1 --2- 172.21.15.112:0/3240980924 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3edc0b45d0 0x7f3edc155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:59.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.022+0000 7f3ee1000640 1 -- 172.21.15.112:0/3240980924 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3edc0b45d0 msgr2=0x7f3edc155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:59.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.022+0000 7f3ee1000640 1 --2- 172.21.15.112:0/3240980924 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3edc0b45d0 0x7f3edc155dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:59.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.022+0000 7f3ee1000640 1 -- 172.21.15.112:0/3240980924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3edc06f600 msgr2=0x7f3edc151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:59.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.022+0000 7f3ee1000640 1 --2- 172.21.15.112:0/3240980924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3edc06f600 0x7f3edc151020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:59.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.022+0000 7f3ee1000640 1 -- 172.21.15.112:0/3240980924 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3edc14ff80 con 0x7f3edc15b9d0 2024-09-12T02:47:59.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.022+0000 7f3ee1000640 1 --2- 172.21.15.112:0/3240980924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3edc15b9d0 0x7f3edc152730 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4034040 tx=0x7f3ed4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:59.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.022+0000 7f3ed8c00640 1 -- 172.21.15.112:0/3240980924 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4036050 con 0x7f3edc15b9d0 2024-09-12T02:47:59.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.022+0000 7f3ed8c00640 1 -- 172.21.15.112:0/3240980924 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed4042070 con 0x7f3edc15b9d0 2024-09-12T02:47:59.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.022+0000 7f3ed8c00640 1 -- 172.21.15.112:0/3240980924 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4009510 con 0x7f3edc15b9d0 2024-09-12T02:47:59.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.022+0000 7f3ee3000640 1 -- 172.21.15.112:0/3240980924 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3edc150260 con 0x7f3edc15b9d0 2024-09-12T02:47:59.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.022+0000 7f3ee3000640 1 -- 172.21.15.112:0/3240980924 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3edc150820 con 0x7f3edc15b9d0 2024-09-12T02:47:59.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.023+0000 7f3ee3000640 1 -- 172.21.15.112:0/3240980924 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3edc068a30 con 0x7f3edc15b9d0 2024-09-12T02:47:59.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.024+0000 7f3ed8c00640 1 -- 172.21.15.112:0/3240980924 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3ed4007bd0 con 0x7f3edc15b9d0 2024-09-12T02:47:59.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.025+0000 7f3ed8c00640 1 --2- 172.21.15.112:0/3240980924 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3eb806be60 0x7f3eb806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:59.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.025+0000 7f3ed8c00640 1 -- 172.21.15.112:0/3240980924 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5709+0+0 (secure 0 0 0) 0x7f3ed40abce0 con 0x7f3edc15b9d0 2024-09-12T02:47:59.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.025+0000 7f3edbe00640 1 --2- 172.21.15.112:0/3240980924 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3eb806be60 0x7f3eb806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:59.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.026+0000 7f3edbe00640 1 --2- 172.21.15.112:0/3240980924 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3eb806be60 0x7f3eb806e320 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc006fd0 tx=0x7f3ecc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:59.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.030+0000 7f3ed8c00640 1 -- 172.21.15.112:0/3240980924 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3ed4045360 con 0x7f3edc15b9d0 2024-09-12T02:47:59.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.203+0000 7f3ee3000640 1 -- 172.21.15.112:0/3240980924 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3edc14ea20 con 0x7f3edc15b9d0 2024-09-12T02:47:59.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.205+0000 7f3ed8c00640 1 -- 172.21.15.112:0/3240980924 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) ==== 74+0+16749 (secure 0 0 0) 0x7f3ed407a680 con 0x7f3edc15b9d0 2024-09-12T02:47:59.206 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:47:59.206 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":134,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:47:57.870828+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:47:55.641315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-12T02:47:56.867038+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:47:59.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.207+0000 7f3ee3000640 1 -- 172.21.15.112:0/3240980924 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3eb806be60 msgr2=0x7f3eb806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:59.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.207+0000 7f3ee3000640 1 --2- 172.21.15.112:0/3240980924 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3eb806be60 0x7f3eb806e320 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc006fd0 tx=0x7f3ecc008040 comp rx=0 tx=0).stop 2024-09-12T02:47:59.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.207+0000 7f3ee3000640 1 -- 172.21.15.112:0/3240980924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3edc15b9d0 msgr2=0x7f3edc152730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:59.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.207+0000 7f3ee3000640 1 --2- 172.21.15.112:0/3240980924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3edc15b9d0 0x7f3edc152730 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4034040 tx=0x7f3ed4004a40 comp rx=0 tx=0).stop 2024-09-12T02:47:59.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.207+0000 7f3ee3000640 1 -- 172.21.15.112:0/3240980924 shutdown_connections 2024-09-12T02:47:59.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.207+0000 7f3ee3000640 1 --2- 172.21.15.112:0/3240980924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3edc15b9d0 0x7f3edc152730 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:59.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.207+0000 7f3ee3000640 1 --2- 172.21.15.112:0/3240980924 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3edc0b45d0 0x7f3edc155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:59.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.207+0000 7f3ee3000640 1 --2- 172.21.15.112:0/3240980924 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3eb806be60 0x7f3eb806e320 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:59.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.207+0000 7f3ee3000640 1 --2- 172.21.15.112:0/3240980924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3edc06f600 0x7f3edc151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:59.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.207+0000 7f3ee3000640 1 -- 172.21.15.112:0/3240980924 >> 172.21.15.112:0/3240980924 conn(0x7f3edc06bbd0 msgr2=0x7f3edc0cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:59.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.207+0000 7f3ee3000640 1 -- 172.21.15.112:0/3240980924 shutdown_connections 2024-09-12T02:47:59.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.207+0000 7f3ee3000640 1 -- 172.21.15.112:0/3240980924 wait complete. 2024-09-12T02:47:59.224 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T02:47:59.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.379+0000 7f12ebc00640 1 Processor -- start 2024-09-12T02:47:59.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.379+0000 7f12ebc00640 1 -- start start 2024-09-12T02:47:59.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.380+0000 7f12ebc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12e415cc50 0x7f12e40732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:59.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.381+0000 7f12ebc00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12e4073830 con 0x7f12e40afe30 2024-09-12T02:47:59.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.381+0000 7f12ebc00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12e40ceeb0 con 0x7f12e4071530 2024-09-12T02:47:59.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.381+0000 7f12ebc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f12e415d030 con 0x7f12e415cc50 2024-09-12T02:47:59.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.381+0000 7f12e9c00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f12e40afe30 0x7f12e40cf950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52118/0 (socket says 172.21.15.112:52118) 2024-09-12T02:47:59.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.381+0000 7f12e9c00640 1 -- 172.21.15.112:0/3553023089 learned_addr learned my addr 172.21.15.112:0/3553023089 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:47:59.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.381+0000 7f12e9200640 1 --2- 172.21.15.112:0/3553023089 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12e415cc50 0x7f12e40732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:59.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.381+0000 7f12e3e00640 1 -- 172.21.15.112:0/3553023089 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 831396765 0 0) 0x7f12dc001490 con 0x7f12e40afe30 2024-09-12T02:47:59.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.381+0000 7f12e3e00640 1 -- 172.21.15.112:0/3553023089 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12c8003520 con 0x7f12e40afe30 2024-09-12T02:47:59.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.381+0000 7f12e9200640 1 -- 172.21.15.112:0/3553023089 >> v1:172.21.15.137:6789/0 conn(0x7f12e4071530 legacy=0x7f12e40af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:59.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.381+0000 7f12e3e00640 1 -- 172.21.15.112:0/3553023089 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3082452554 0 0) 0x7f12e40ceeb0 con 0x7f12e4071530 2024-09-12T02:47:59.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.381+0000 7f12e9200640 1 -- 172.21.15.112:0/3553023089 >> v1:172.21.15.112:6789/0 conn(0x7f12e40afe30 legacy=0x7f12e40cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:59.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.381+0000 7f12e9200640 1 -- 172.21.15.112:0/3553023089 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12e406e300 con 0x7f12e415cc50 2024-09-12T02:47:59.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.383+0000 7f12e9200640 1 --2- 172.21.15.112:0/3553023089 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12e415cc50 0x7f12e40732f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f12d4009800 tx=0x7f12d402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dbb47d94de96e4c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:59.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.383+0000 7f12e3e00640 1 -- 172.21.15.112:0/3553023089 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d4037070 con 0x7f12e415cc50 2024-09-12T02:47:59.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.383+0000 7f12e3e00640 1 -- 172.21.15.112:0/3553023089 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12d4032440 con 0x7f12e415cc50 2024-09-12T02:47:59.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.383+0000 7f12e3e00640 1 -- 172.21.15.112:0/3553023089 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d40327f0 con 0x7f12e415cc50 2024-09-12T02:47:59.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.384+0000 7f12ebc00640 1 -- 172.21.15.112:0/3553023089 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12e415cc50 msgr2=0x7f12e40732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:59.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.384+0000 7f12ebc00640 1 --2- 172.21.15.112:0/3553023089 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12e415cc50 0x7f12e40732f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f12d4009800 tx=0x7f12d402a1a0 comp rx=0 tx=0).stop 2024-09-12T02:47:59.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.384+0000 7f12ebc00640 1 -- 172.21.15.112:0/3553023089 shutdown_connections 2024-09-12T02:47:59.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.384+0000 7f12ebc00640 1 --2- 172.21.15.112:0/3553023089 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12e415cc50 0x7f12e40732f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:59.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.384+0000 7f12ebc00640 1 -- 172.21.15.112:0/3553023089 >> 172.21.15.112:0/3553023089 conn(0x7f12e406bbd0 msgr2=0x7f12e406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:59.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.384+0000 7f12ebc00640 1 -- 172.21.15.112:0/3553023089 shutdown_connections 2024-09-12T02:47:59.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.384+0000 7f12ebc00640 1 -- 172.21.15.112:0/3553023089 wait complete. 2024-09-12T02:47:59.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.385+0000 7f12ebc00640 1 Processor -- start 2024-09-12T02:47:59.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.385+0000 7f12ebc00640 1 -- start start 2024-09-12T02:47:59.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.386+0000 7f12ebc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12e4071530 0x7f12e4150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:59.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.386+0000 7f12ebc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12e40afe30 0x7f12e4143500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:59.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.386+0000 7f12ebc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12e415cc50 0x7f12e41f8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:59.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.386+0000 7f12ebc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f12e40cf150 con 0x7f12e415cc50 2024-09-12T02:47:59.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.386+0000 7f12ebc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f12e40cf4c0 con 0x7f12e40afe30 2024-09-12T02:47:59.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.386+0000 7f12ebc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f12e406f510 con 0x7f12e4071530 2024-09-12T02:47:59.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.386+0000 7f12e9c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12e415cc50 0x7f12e41f8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:59.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.387+0000 7f12e9c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12e415cc50 0x7f12e41f8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46738/0 (socket says 172.21.15.112:46738) 2024-09-12T02:47:59.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.387+0000 7f12e9c00640 1 -- 172.21.15.112:0/3952555458 learned_addr learned my addr 172.21.15.112:0/3952555458 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:47:59.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.387+0000 7f12dbe00640 1 --2- 172.21.15.112:0/3952555458 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12e40afe30 0x7f12e4143500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:59.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.387+0000 7f12e9200640 1 --2- 172.21.15.112:0/3952555458 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12e4071530 0x7f12e4150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:59.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.387+0000 7f12e9c00640 1 -- 172.21.15.112:0/3952555458 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12e4071530 msgr2=0x7f12e4150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:59.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.387+0000 7f12e9c00640 1 --2- 172.21.15.112:0/3952555458 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12e4071530 0x7f12e4150300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:59.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.387+0000 7f12e9c00640 1 -- 172.21.15.112:0/3952555458 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12e40afe30 msgr2=0x7f12e4143500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:59.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.387+0000 7f12e9c00640 1 --2- 172.21.15.112:0/3952555458 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12e40afe30 0x7f12e4143500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:59.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.387+0000 7f12e9c00640 1 -- 172.21.15.112:0/3952555458 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12e4155210 con 0x7f12e415cc50 2024-09-12T02:47:59.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.387+0000 7f12e9c00640 1 --2- 172.21.15.112:0/3952555458 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12e415cc50 0x7f12e41f8470 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f12dc00cb40 tx=0x7f12dc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:59.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.387+0000 7f12e1600640 1 -- 172.21.15.112:0/3952555458 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12dc017070 con 0x7f12e415cc50 2024-09-12T02:47:59.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.388+0000 7f12e1600640 1 -- 172.21.15.112:0/3952555458 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12dc00ac40 con 0x7f12e415cc50 2024-09-12T02:47:59.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.388+0000 7f12e1600640 1 -- 172.21.15.112:0/3952555458 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12dc012400 con 0x7f12e415cc50 2024-09-12T02:47:59.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.388+0000 7f12ebc00640 1 -- 172.21.15.112:0/3952555458 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12e41554d0 con 0x7f12e415cc50 2024-09-12T02:47:59.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.388+0000 7f12ebc00640 1 -- 172.21.15.112:0/3952555458 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12e4153a60 con 0x7f12e415cc50 2024-09-12T02:47:59.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.389+0000 7f12ebc00640 1 -- 172.21.15.112:0/3952555458 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12e406df60 con 0x7f12e415cc50 2024-09-12T02:47:59.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.390+0000 7f12e1600640 1 -- 172.21.15.112:0/3952555458 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f12dc01a070 con 0x7f12e415cc50 2024-09-12T02:47:59.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.390+0000 7f12e1600640 1 --2- 172.21.15.112:0/3952555458 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f12c006be30 0x7f12c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:59.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.391+0000 7f12e1600640 1 -- 172.21.15.112:0/3952555458 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5709+0+0 (secure 0 0 0) 0x7f12dc08abc0 con 0x7f12e415cc50 2024-09-12T02:47:59.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.391+0000 7f12e9200640 1 --2- 172.21.15.112:0/3952555458 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f12c006be30 0x7f12c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:59.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.391+0000 7f12e9200640 1 --2- 172.21.15.112:0/3952555458 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f12c006be30 0x7f12c006e2f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f12d4034000 tx=0x7f12d402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:59.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.395+0000 7f12e1600640 1 -- 172.21.15.112:0/3952555458 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f12e4073830 con 0x7f12e415cc50 2024-09-12T02:47:59.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:47:59.606+0000 7f12ebc00640 1 -- 172.21.15.112:0/3952555458 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f12e40730d0 con 0x7f12e415cc50 2024-09-12T02:48:00.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.487+0000 7f12e1600640 1 -- 172.21.15.112:0/3952555458 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v69) ==== 118+0+0 (secure 0 0 0) 0x7f12dc058e80 con 0x7f12e415cc50 2024-09-12T02:48:00.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.490+0000 7f12ebc00640 1 -- 172.21.15.112:0/3952555458 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f12c006be30 msgr2=0x7f12c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:00.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.490+0000 7f12ebc00640 1 --2- 172.21.15.112:0/3952555458 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f12c006be30 0x7f12c006e2f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f12d4034000 tx=0x7f12d402e000 comp rx=0 tx=0).stop 2024-09-12T02:48:00.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.490+0000 7f12ebc00640 1 -- 172.21.15.112:0/3952555458 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12e415cc50 msgr2=0x7f12e41f8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:00.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.490+0000 7f12ebc00640 1 --2- 172.21.15.112:0/3952555458 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12e415cc50 0x7f12e41f8470 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f12dc00cb40 tx=0x7f12dc00a060 comp rx=0 tx=0).stop 2024-09-12T02:48:00.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.490+0000 7f12ebc00640 1 -- 172.21.15.112:0/3952555458 shutdown_connections 2024-09-12T02:48:00.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.490+0000 7f12ebc00640 1 --2- 172.21.15.112:0/3952555458 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12e415cc50 0x7f12e41f8470 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.490+0000 7f12ebc00640 1 --2- 172.21.15.112:0/3952555458 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f12c006be30 0x7f12c006e2f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.490+0000 7f12ebc00640 1 --2- 172.21.15.112:0/3952555458 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12e40afe30 0x7f12e4143500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.490+0000 7f12ebc00640 1 --2- 172.21.15.112:0/3952555458 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12e4071530 0x7f12e4150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.490+0000 7f12ebc00640 1 -- 172.21.15.112:0/3952555458 >> 172.21.15.112:0/3952555458 conn(0x7f12e406bbd0 msgr2=0x7f12e406d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:00.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.490+0000 7f12ebc00640 1 -- 172.21.15.112:0/3952555458 shutdown_connections 2024-09-12T02:48:00.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.490+0000 7f12ebc00640 1 -- 172.21.15.112:0/3952555458 wait complete. 2024-09-12T02:48:00.510 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T02:48:00.510 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T02:48:00.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.669+0000 7fcbc4e00640 1 Processor -- start 2024-09-12T02:48:00.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.670+0000 7fcbc4e00640 1 -- start start 2024-09-12T02:48:00.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.671+0000 7fcbc4e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcbc0071530 0x7fcbc00af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:00.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.671+0000 7fcbc4e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbc00ceeb0 con 0x7fcbc015cc50 2024-09-12T02:48:00.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.671+0000 7fcbc4e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbc006e300 con 0x7fcbc00719a0 2024-09-12T02:48:00.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.671+0000 7fcbc4e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fcbc015d030 con 0x7fcbc0071530 2024-09-12T02:48:00.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.671+0000 7fcbbde00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fcbc015cc50 0x7fcbc00732f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52126/0 (socket says 172.21.15.112:52126) 2024-09-12T02:48:00.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.671+0000 7fcbbde00640 1 -- 172.21.15.112:0/1876246573 learned_addr learned my addr 172.21.15.112:0/1876246573 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:00.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.671+0000 7fcbb5400640 1 --2- 172.21.15.112:0/1876246573 >> v2:172.21.15.137:3300/0 conn(0x7fcbc0071530 0x7fcbc00af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:00.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.671+0000 7fcbbd400640 1 -- 172.21.15.112:0/1876246573 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3487525798 0 0) 0x7fcbc00ceeb0 con 0x7fcbc015cc50 2024-09-12T02:48:00.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.671+0000 7fcbbd400640 1 -- 172.21.15.112:0/1876246573 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcba4003520 con 0x7fcbc015cc50 2024-09-12T02:48:00.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.672+0000 7fcbbd400640 1 -- 172.21.15.112:0/1876246573 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3908823885 0 0) 0x7fcba4003520 con 0x7fcbc015cc50 2024-09-12T02:48:00.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.672+0000 7fcbb5400640 1 -- 172.21.15.112:0/1876246573 >> v1:172.21.15.137:6789/0 conn(0x7fcbc00719a0 legacy=0x7fcbc00cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:00.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.672+0000 7fcbb5400640 1 -- 172.21.15.112:0/1876246573 >> v1:172.21.15.112:6789/0 conn(0x7fcbc015cc50 legacy=0x7fcbc00732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:00.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.672+0000 7fcbb5400640 1 -- 172.21.15.112:0/1876246573 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbc006e5e0 con 0x7fcbc0071530 2024-09-12T02:48:00.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.673+0000 7fcbb5400640 1 --2- 172.21.15.112:0/1876246573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbc0071530 0x7fcbc00af720 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcba8009790 tx=0x7fcba802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b63f59ef19581437 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:00.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.673+0000 7fcbbd400640 1 -- 172.21.15.112:0/1876246573 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba8037070 con 0x7fcbc0071530 2024-09-12T02:48:00.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.673+0000 7fcbbd400640 1 -- 172.21.15.112:0/1876246573 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcba802aba0 con 0x7fcbc0071530 2024-09-12T02:48:00.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.673+0000 7fcbbd400640 1 -- 172.21.15.112:0/1876246573 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0001670 con 0x7fcbc0071530 2024-09-12T02:48:00.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.674+0000 7fcbc4e00640 1 -- 172.21.15.112:0/1876246573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbc0071530 msgr2=0x7fcbc00af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:00.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.674+0000 7fcbc4e00640 1 --2- 172.21.15.112:0/1876246573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbc0071530 0x7fcbc00af720 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcba8009790 tx=0x7fcba802a110 comp rx=0 tx=0).stop 2024-09-12T02:48:00.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.674+0000 7fcbc4e00640 1 -- 172.21.15.112:0/1876246573 shutdown_connections 2024-09-12T02:48:00.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.674+0000 7fcbc4e00640 1 --2- 172.21.15.112:0/1876246573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbc0071530 0x7fcbc00af720 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.674+0000 7fcbc4e00640 1 -- 172.21.15.112:0/1876246573 >> 172.21.15.112:0/1876246573 conn(0x7fcbc006bbd0 msgr2=0x7fcbc006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:00.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.674+0000 7fcbc4e00640 1 -- 172.21.15.112:0/1876246573 shutdown_connections 2024-09-12T02:48:00.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.674+0000 7fcbc4e00640 1 -- 172.21.15.112:0/1876246573 wait complete. 2024-09-12T02:48:00.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.675+0000 7fcbc4e00640 1 Processor -- start 2024-09-12T02:48:00.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.675+0000 7fcbc4e00640 1 -- start start 2024-09-12T02:48:00.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.676+0000 7fcbc4e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcbc0071530 0x7fcbc00b4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:00.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.676+0000 7fcbc4e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbc00719a0 0x7fcbc0146430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:00.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.676+0000 7fcbc4e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbc015cc50 0x7fcbc01579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:00.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.676+0000 7fcbc4e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc006f510 con 0x7fcbc00719a0 2024-09-12T02:48:00.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.676+0000 7fcbc4e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc00cf4c0 con 0x7fcbc015cc50 2024-09-12T02:48:00.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.676+0000 7fcbc4e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fcbc006f690 con 0x7fcbc0071530 2024-09-12T02:48:00.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.677+0000 7fcbb5400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbc00719a0 0x7fcbc0146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:00.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.677+0000 7fcbb5400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbc00719a0 0x7fcbc0146430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46748/0 (socket says 172.21.15.112:46748) 2024-09-12T02:48:00.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.677+0000 7fcbb5400640 1 -- 172.21.15.112:0/2093607801 learned_addr learned my addr 172.21.15.112:0/2093607801 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:00.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.677+0000 7fcbbde00640 1 --2- 172.21.15.112:0/2093607801 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcbc0071530 0x7fcbc00b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:00.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.677+0000 7fcbbe800640 1 --2- 172.21.15.112:0/2093607801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbc015cc50 0x7fcbc01579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:00.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.677+0000 7fcbb5400640 1 -- 172.21.15.112:0/2093607801 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcbc0071530 msgr2=0x7fcbc00b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:00.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.677+0000 7fcbb5400640 1 --2- 172.21.15.112:0/2093607801 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcbc0071530 0x7fcbc00b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.677+0000 7fcbb5400640 1 -- 172.21.15.112:0/2093607801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbc015cc50 msgr2=0x7fcbc01579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:00.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.677+0000 7fcbb5400640 1 --2- 172.21.15.112:0/2093607801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbc015cc50 0x7fcbc01579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.677+0000 7fcbb5400640 1 -- 172.21.15.112:0/2093607801 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbc0146970 con 0x7fcbc00719a0 2024-09-12T02:48:00.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.677+0000 7fcbbde00640 1 --2- 172.21.15.112:0/2093607801 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcbc0071530 0x7fcbc00b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:00.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.677+0000 7fcbbe800640 1 --2- 172.21.15.112:0/2093607801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbc015cc50 0x7fcbc01579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:00.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.677+0000 7fcbb5400640 1 --2- 172.21.15.112:0/2093607801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbc00719a0 0x7fcbc0146430 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fcba8035040 tx=0x7fcba80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:00.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.678+0000 7fcbb6a00640 1 -- 172.21.15.112:0/2093607801 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba8037040 con 0x7fcbc00719a0 2024-09-12T02:48:00.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.678+0000 7fcbb6a00640 1 -- 172.21.15.112:0/2093607801 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcba8005b90 con 0x7fcbc00719a0 2024-09-12T02:48:00.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.678+0000 7fcbc4e00640 1 -- 172.21.15.112:0/2093607801 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbc00b4720 con 0x7fcbc00719a0 2024-09-12T02:48:00.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.678+0000 7fcbb6a00640 1 -- 172.21.15.112:0/2093607801 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba8006db0 con 0x7fcbc00719a0 2024-09-12T02:48:00.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.678+0000 7fcbc4e00640 1 -- 172.21.15.112:0/2093607801 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbc00b4ce0 con 0x7fcbc00719a0 2024-09-12T02:48:00.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.679+0000 7fcbc4e00640 1 -- 172.21.15.112:0/2093607801 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbc006df60 con 0x7fcbc00719a0 2024-09-12T02:48:00.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.680+0000 7fcbb6a00640 1 -- 172.21.15.112:0/2093607801 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcba8006030 con 0x7fcbc00719a0 2024-09-12T02:48:00.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.681+0000 7fcbb6a00640 1 --2- 172.21.15.112:0/2093607801 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcb9c06be30 0x7fcb9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:00.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.681+0000 7fcbb6a00640 1 -- 172.21.15.112:0/2093607801 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7fcba80abdc0 con 0x7fcbc00719a0 2024-09-12T02:48:00.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.681+0000 7fcbbde00640 1 --2- 172.21.15.112:0/2093607801 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcb9c06be30 0x7fcb9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:00.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.682+0000 7fcbbde00640 1 --2- 172.21.15.112:0/2093607801 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcb9c06be30 0x7fcb9c06e2f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fcbb00011e0 tx=0x7fcbb0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:00.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.685+0000 7fcbb6a00640 1 -- 172.21.15.112:0/2093607801 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcbc0146970 con 0x7fcbc00719a0 2024-09-12T02:48:00.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:00.891+0000 7fcbc4e00640 1 -- 172.21.15.112:0/2093607801 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fcbc00d11b0 con 0x7fcbc00719a0 2024-09-12T02:48:01.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.493+0000 7fcbb6a00640 1 -- 172.21.15.112:0/2093607801 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v70) ==== 122+0+0 (secure 0 0 0) 0x7fcba807a890 con 0x7fcbc00719a0 2024-09-12T02:48:01.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.496+0000 7fcbc4e00640 1 -- 172.21.15.112:0/2093607801 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcb9c06be30 msgr2=0x7fcb9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:01.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.496+0000 7fcbc4e00640 1 --2- 172.21.15.112:0/2093607801 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcb9c06be30 0x7fcb9c06e2f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fcbb00011e0 tx=0x7fcbb0009040 comp rx=0 tx=0).stop 2024-09-12T02:48:01.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.496+0000 7fcbc4e00640 1 -- 172.21.15.112:0/2093607801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbc00719a0 msgr2=0x7fcbc0146430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:01.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.496+0000 7fcbc4e00640 1 --2- 172.21.15.112:0/2093607801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbc00719a0 0x7fcbc0146430 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fcba8035040 tx=0x7fcba80046c0 comp rx=0 tx=0).stop 2024-09-12T02:48:01.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.496+0000 7fcbc4e00640 1 -- 172.21.15.112:0/2093607801 shutdown_connections 2024-09-12T02:48:01.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.496+0000 7fcbc4e00640 1 --2- 172.21.15.112:0/2093607801 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcb9c06be30 0x7fcb9c06e2f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:01.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.496+0000 7fcbc4e00640 1 --2- 172.21.15.112:0/2093607801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbc015cc50 0x7fcbc01579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:01.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.496+0000 7fcbc4e00640 1 --2- 172.21.15.112:0/2093607801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbc00719a0 0x7fcbc0146430 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:01.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.496+0000 7fcbc4e00640 1 --2- 172.21.15.112:0/2093607801 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcbc0071530 0x7fcbc00b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:01.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.496+0000 7fcbc4e00640 1 -- 172.21.15.112:0/2093607801 >> 172.21.15.112:0/2093607801 conn(0x7fcbc006bbd0 msgr2=0x7fcbc00732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:01.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.496+0000 7fcbc4e00640 1 -- 172.21.15.112:0/2093607801 shutdown_connections 2024-09-12T02:48:01.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.496+0000 7fcbc4e00640 1 -- 172.21.15.112:0/2093607801 wait complete. 2024-09-12T02:48:01.513 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T02:48:01.513 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:48:01.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.665+0000 7ff341800640 1 Processor -- start 2024-09-12T02:48:01.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.665+0000 7ff341800640 1 -- start start 2024-09-12T02:48:01.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.666+0000 7ff341800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff33c15a5f0 0x7ff33c0b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:01.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.666+0000 7ff341800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff33c0b2570 con 0x7ff33c0b5ec0 2024-09-12T02:48:01.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.666+0000 7ff341800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff33c0b2850 con 0x7ff33c0b6b30 2024-09-12T02:48:01.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.666+0000 7ff341800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff33c0b2b30 con 0x7ff33c15a5f0 2024-09-12T02:48:01.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.666+0000 7ff33be00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff33c15a5f0 0x7ff33c0b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:01.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.666+0000 7ff33b400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff33c0b5ec0 0x7ff33c0b6420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52138/0 (socket says 172.21.15.112:52138) 2024-09-12T02:48:01.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.666+0000 7ff33be00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff33c15a5f0 0x7ff33c0b5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46756/0 (socket says 172.21.15.112:46756) 2024-09-12T02:48:01.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.666+0000 7ff33b400640 1 -- 172.21.15.112:0/3605874169 learned_addr learned my addr 172.21.15.112:0/3605874169 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:01.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.667+0000 7ff33be00640 1 -- 172.21.15.112:0/3605874169 >> v1:172.21.15.137:6789/0 conn(0x7ff33c0b6b30 legacy=0x7ff33c0b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:01.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.667+0000 7ff33be00640 1 -- 172.21.15.112:0/3605874169 >> v1:172.21.15.112:6789/0 conn(0x7ff33c0b5ec0 legacy=0x7ff33c0b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:01.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.667+0000 7ff33be00640 1 -- 172.21.15.112:0/3605874169 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33c0b2e10 con 0x7ff33c15a5f0 2024-09-12T02:48:01.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.667+0000 7ff33aa00640 1 -- 172.21.15.112:0/3605874169 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1467692310 0 0) 0x7ff33c0b2570 con 0x7ff33c0b5ec0 2024-09-12T02:48:01.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.668+0000 7ff33be00640 1 --2- 172.21.15.112:0/3605874169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff33c15a5f0 0x7ff33c0b5980 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0097a0 tx=0x7ff32c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f57326a8e260f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:01.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.668+0000 7ff33aa00640 1 -- 172.21.15.112:0/3605874169 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c037070 con 0x7ff33c15a5f0 2024-09-12T02:48:01.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.668+0000 7ff33aa00640 1 -- 172.21.15.112:0/3605874169 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff32c02ae50 con 0x7ff33c15a5f0 2024-09-12T02:48:01.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.668+0000 7ff33aa00640 1 -- 172.21.15.112:0/3605874169 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c032660 con 0x7ff33c15a5f0 2024-09-12T02:48:01.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.669+0000 7ff341800640 1 -- 172.21.15.112:0/3605874169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff33c15a5f0 msgr2=0x7ff33c0b5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:01.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.669+0000 7ff341800640 1 --2- 172.21.15.112:0/3605874169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff33c15a5f0 0x7ff33c0b5980 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0097a0 tx=0x7ff32c02a140 comp rx=0 tx=0).stop 2024-09-12T02:48:01.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.669+0000 7ff341800640 1 -- 172.21.15.112:0/3605874169 shutdown_connections 2024-09-12T02:48:01.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.669+0000 7ff341800640 1 --2- 172.21.15.112:0/3605874169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff33c15a5f0 0x7ff33c0b5980 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:01.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.669+0000 7ff341800640 1 -- 172.21.15.112:0/3605874169 >> 172.21.15.112:0/3605874169 conn(0x7ff33c0b7ea0 msgr2=0x7ff33c0b82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:01.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.669+0000 7ff341800640 1 -- 172.21.15.112:0/3605874169 shutdown_connections 2024-09-12T02:48:01.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.669+0000 7ff341800640 1 -- 172.21.15.112:0/3605874169 wait complete. 2024-09-12T02:48:01.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.670+0000 7ff341800640 1 Processor -- start 2024-09-12T02:48:01.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.671+0000 7ff341800640 1 -- start start 2024-09-12T02:48:01.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.671+0000 7ff341800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff33c0b5ec0 0x7ff33c09ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:01.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.671+0000 7ff341800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff33c0b6b30 0x7ff33c1f2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:01.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.671+0000 7ff341800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff33c15a5f0 0x7ff33c0a0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:01.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.671+0000 7ff341800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c15def0 con 0x7ff33c0b6b30 2024-09-12T02:48:01.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.671+0000 7ff341800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c15a9d0 con 0x7ff33c0b5ec0 2024-09-12T02:48:01.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.671+0000 7ff341800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff33c0b0040 con 0x7ff33c15a5f0 2024-09-12T02:48:01.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.672+0000 7ff33b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff33c0b6b30 0x7ff33c1f2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:01.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.672+0000 7ff33b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff33c0b6b30 0x7ff33c1f2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46764/0 (socket says 172.21.15.112:46764) 2024-09-12T02:48:01.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.672+0000 7ff33b400640 1 -- 172.21.15.112:0/514475686 learned_addr learned my addr 172.21.15.112:0/514475686 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:01.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.672+0000 7ff33be00640 1 --2- 172.21.15.112:0/514475686 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff33c0b5ec0 0x7ff33c09ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:01.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.672+0000 7ff340e00640 1 --2- 172.21.15.112:0/514475686 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff33c15a5f0 0x7ff33c0a0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:01.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.672+0000 7ff33b400640 1 -- 172.21.15.112:0/514475686 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff33c15a5f0 msgr2=0x7ff33c0a0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:01.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.672+0000 7ff33b400640 1 --2- 172.21.15.112:0/514475686 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff33c15a5f0 0x7ff33c0a0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:01.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.672+0000 7ff33b400640 1 -- 172.21.15.112:0/514475686 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff33c0b5ec0 msgr2=0x7ff33c09ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:01.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.672+0000 7ff33b400640 1 --2- 172.21.15.112:0/514475686 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff33c0b5ec0 0x7ff33c09ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:01.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.672+0000 7ff33b400640 1 -- 172.21.15.112:0/514475686 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33c1f2760 con 0x7ff33c0b6b30 2024-09-12T02:48:01.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.672+0000 7ff340e00640 1 --2- 172.21.15.112:0/514475686 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff33c15a5f0 0x7ff33c0a0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:01.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.672+0000 7ff33b400640 1 --2- 172.21.15.112:0/514475686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff33c0b6b30 0x7ff33c1f2220 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7ff32800c4d0 tx=0x7ff32800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:01.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.673+0000 7ff333e00640 1 -- 172.21.15.112:0/514475686 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328018070 con 0x7ff33c0b6b30 2024-09-12T02:48:01.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.673+0000 7ff333e00640 1 -- 172.21.15.112:0/514475686 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff328007500 con 0x7ff33c0b6b30 2024-09-12T02:48:01.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.673+0000 7ff333e00640 1 -- 172.21.15.112:0/514475686 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328004a20 con 0x7ff33c0b6b30 2024-09-12T02:48:01.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.673+0000 7ff341800640 1 -- 172.21.15.112:0/514475686 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff33c0a0cd0 con 0x7ff33c0b6b30 2024-09-12T02:48:01.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.673+0000 7ff341800640 1 -- 172.21.15.112:0/514475686 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff33c15e2c0 con 0x7ff33c0b6b30 2024-09-12T02:48:01.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.674+0000 7ff341800640 1 -- 172.21.15.112:0/514475686 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff33c15e0d0 con 0x7ff33c0b6b30 2024-09-12T02:48:01.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.675+0000 7ff333e00640 1 -- 172.21.15.112:0/514475686 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff328004bc0 con 0x7ff33c0b6b30 2024-09-12T02:48:01.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.675+0000 7ff333e00640 1 --2- 172.21.15.112:0/514475686 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff31c06be30 0x7ff31c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:01.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.676+0000 7ff333e00640 1 -- 172.21.15.112:0/514475686 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7ff32808a180 con 0x7ff33c0b6b30 2024-09-12T02:48:01.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.676+0000 7ff33be00640 1 --2- 172.21.15.112:0/514475686 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff31c06be30 0x7ff31c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:01.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.676+0000 7ff33be00640 1 --2- 172.21.15.112:0/514475686 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff31c06be30 0x7ff31c06e2f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff32c034000 tx=0x7ff32c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:01.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.680+0000 7ff333e00640 1 -- 172.21.15.112:0/514475686 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff3280583b0 con 0x7ff33c0b6b30 2024-09-12T02:48:01.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.887+0000 7ff341800640 1 -- 172.21.15.112:0/514475686 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff33c1593d0 con 0x7ff33c0b6b30 2024-09-12T02:48:01.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.888+0000 7ff333e00640 1 -- 172.21.15.112:0/514475686 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+5231 (secure 0 0 0) 0x7ff32805c6b0 con 0x7ff33c0b6b30 2024-09-12T02:48:01.888 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:01.889 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":70,"btime":"2024-09-12T02:48:01:488612+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5816,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1943935405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1943935405},{"type":"v1","addr":"172.21.15.137:6834","nonce":1943935405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6328,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2010766966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2010766966},{"type":"v1","addr":"172.21.15.112:6835","nonce":2010766966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/193655023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":193655023},{"type":"v1","addr":"172.21.15.137:6835","nonce":193655023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:47:57.871200+0000","modified":"2024-09-12T02:48:00.893329+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6861":{"gid":6861,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/134918269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":134918269},{"type":"v1","addr":"172.21.15.112:6837","nonce":134918269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6861,"qdb_cluster":[6861]},"id":8}]} 2024-09-12T02:48:01.889 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 70 2024-09-12T02:48:01.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.890+0000 7ff341800640 1 -- 172.21.15.112:0/514475686 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff31c06be30 msgr2=0x7ff31c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:01.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.890+0000 7ff341800640 1 --2- 172.21.15.112:0/514475686 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff31c06be30 0x7ff31c06e2f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff32c034000 tx=0x7ff32c02e000 comp rx=0 tx=0).stop 2024-09-12T02:48:01.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.890+0000 7ff341800640 1 -- 172.21.15.112:0/514475686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff33c0b6b30 msgr2=0x7ff33c1f2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:01.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.890+0000 7ff341800640 1 --2- 172.21.15.112:0/514475686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff33c0b6b30 0x7ff33c1f2220 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7ff32800c4d0 tx=0x7ff32800c990 comp rx=0 tx=0).stop 2024-09-12T02:48:01.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.890+0000 7ff341800640 1 -- 172.21.15.112:0/514475686 shutdown_connections 2024-09-12T02:48:01.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.890+0000 7ff341800640 1 --2- 172.21.15.112:0/514475686 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff33c15a5f0 0x7ff33c0a0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:01.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.890+0000 7ff341800640 1 --2- 172.21.15.112:0/514475686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff33c0b6b30 0x7ff33c1f2220 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:01.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.890+0000 7ff341800640 1 --2- 172.21.15.112:0/514475686 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff31c06be30 0x7ff31c06e2f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:01.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.890+0000 7ff341800640 1 --2- 172.21.15.112:0/514475686 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff33c0b5ec0 0x7ff33c09ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:01.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.890+0000 7ff341800640 1 -- 172.21.15.112:0/514475686 >> 172.21.15.112:0/514475686 conn(0x7ff33c0b7ea0 msgr2=0x7ff33c0b0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:01.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.890+0000 7ff341800640 1 -- 172.21.15.112:0/514475686 shutdown_connections 2024-09-12T02:48:01.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:01.890+0000 7ff341800640 1 -- 172.21.15.112:0/514475686 wait complete. 2024-09-12T02:48:01.907 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:48:02.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.059+0000 7f993cc00640 1 Processor -- start 2024-09-12T02:48:02.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.059+0000 7f993cc00640 1 -- start start 2024-09-12T02:48:02.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.060+0000 7f993cc00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f99380cfd30 0x7f99380ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.060+0000 7f993cc00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9938070bc0 0x7f99380cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.060+0000 7f993cc00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f993806f880 con 0x7f993815eeb0 2024-09-12T02:48:02.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.060+0000 7f993cc00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f9938070730 con 0x7f9938070bc0 2024-09-12T02:48:02.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.060+0000 7f993cc00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f993806fb20 con 0x7f99380cfd30 2024-09-12T02:48:02.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.060+0000 7f9936800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9938070bc0 0x7f99380cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.060+0000 7f9936800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9938070bc0 0x7f99380cd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34304/0 (socket says 172.21.15.112:34304) 2024-09-12T02:48:02.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.060+0000 7f9936800640 1 -- 172.21.15.112:0/1858898828 learned_addr learned my addr 172.21.15.112:0/1858898828 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:02.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.061+0000 7f9935400640 1 --2- 172.21.15.112:0/1858898828 >> v2:172.21.15.137:3300/0 conn(0x7f99380cfd30 0x7f99380ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.061+0000 7f9936800640 1 -- 172.21.15.112:0/1858898828 >> v2:172.21.15.137:3300/0 conn(0x7f99380cfd30 msgr2=0x7f99380ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:02.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.061+0000 7f9936800640 1 --2- 172.21.15.112:0/1858898828 >> v2:172.21.15.137:3300/0 conn(0x7f99380cfd30 0x7f99380ce9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.061+0000 7f9936800640 1 -- 172.21.15.112:0/1858898828 >> v1:172.21.15.137:6789/0 conn(0x7f993815eeb0 legacy=0x7f99380cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:02.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.061+0000 7f9936800640 1 -- 172.21.15.112:0/1858898828 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f993806fe00 con 0x7f9938070bc0 2024-09-12T02:48:02.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.061+0000 7f9935400640 1 --2- 172.21.15.112:0/1858898828 >> v2:172.21.15.137:3300/0 conn(0x7f99380cfd30 0x7f99380ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:02.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.062+0000 7f9936800640 1 --2- 172.21.15.112:0/1858898828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9938070bc0 0x7f99380cd9c0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f99380d04e0 tx=0x7f993002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ad917d499f3a23c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:02.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.062+0000 7f9934a00640 1 -- 172.21.15.112:0/1858898828 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9930036070 con 0x7f9938070bc0 2024-09-12T02:48:02.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.062+0000 7f9934a00640 1 -- 172.21.15.112:0/1858898828 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9930031600 con 0x7f9938070bc0 2024-09-12T02:48:02.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.062+0000 7f9934a00640 1 -- 172.21.15.112:0/1858898828 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99300319d0 con 0x7f9938070bc0 2024-09-12T02:48:02.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.063+0000 7f993cc00640 1 -- 172.21.15.112:0/1858898828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9938070bc0 msgr2=0x7f99380cd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:02.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.063+0000 7f993cc00640 1 --2- 172.21.15.112:0/1858898828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9938070bc0 0x7f99380cd9c0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f99380d04e0 tx=0x7f993002a6f0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.063+0000 7f993cc00640 1 -- 172.21.15.112:0/1858898828 shutdown_connections 2024-09-12T02:48:02.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.063+0000 7f993cc00640 1 --2- 172.21.15.112:0/1858898828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9938070bc0 0x7f99380cd9c0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.063+0000 7f993cc00640 1 --2- 172.21.15.112:0/1858898828 >> v2:172.21.15.137:3300/0 conn(0x7f99380cfd30 0x7f99380ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.063+0000 7f993cc00640 1 -- 172.21.15.112:0/1858898828 >> 172.21.15.112:0/1858898828 conn(0x7f99380b4720 msgr2=0x7f99380b4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:02.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.063+0000 7f993cc00640 1 -- 172.21.15.112:0/1858898828 shutdown_connections 2024-09-12T02:48:02.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.063+0000 7f993cc00640 1 -- 172.21.15.112:0/1858898828 wait complete. 2024-09-12T02:48:02.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.064+0000 7f993cc00640 1 Processor -- start 2024-09-12T02:48:02.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.065+0000 7f993cc00640 1 -- start start 2024-09-12T02:48:02.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.065+0000 7f993cc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9938070bc0 0x7f99380c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.065+0000 7f993cc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f99380cfd30 0x7f9938157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.065+0000 7f993cc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f993815eeb0 0x7f99380d2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.065+0000 7f993cc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f993815f290 con 0x7f993815eeb0 2024-09-12T02:48:02.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.065+0000 7f993cc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f99380703c0 con 0x7f9938070bc0 2024-09-12T02:48:02.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.065+0000 7f993cc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f993815f410 con 0x7f99380cfd30 2024-09-12T02:48:02.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.066+0000 7f9936800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f993815eeb0 0x7f99380d2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.066+0000 7f9936800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f993815eeb0 0x7f99380d2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34316/0 (socket says 172.21.15.112:34316) 2024-09-12T02:48:02.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.066+0000 7f9935e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9938070bc0 0x7f99380c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.066+0000 7f9936800640 1 -- 172.21.15.112:0/2797862892 learned_addr learned my addr 172.21.15.112:0/2797862892 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:02.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.066+0000 7f9935400640 1 --2- 172.21.15.112:0/2797862892 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f99380cfd30 0x7f9938157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.066+0000 7f9936800640 1 -- 172.21.15.112:0/2797862892 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f99380cfd30 msgr2=0x7f9938157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:02.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.066+0000 7f9936800640 1 --2- 172.21.15.112:0/2797862892 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f99380cfd30 0x7f9938157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.066+0000 7f9936800640 1 -- 172.21.15.112:0/2797862892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9938070bc0 msgr2=0x7f99380c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:02.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.066+0000 7f9936800640 1 --2- 172.21.15.112:0/2797862892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9938070bc0 0x7f99380c8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.066+0000 7f9936800640 1 -- 172.21.15.112:0/2797862892 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99381578c0 con 0x7f993815eeb0 2024-09-12T02:48:02.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.066+0000 7f9936800640 1 --2- 172.21.15.112:0/2797862892 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f993815eeb0 0x7f99380d2570 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f9930034040 tx=0x7f9930004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:02.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.067+0000 7f992e000640 1 -- 172.21.15.112:0/2797862892 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9930036050 con 0x7f993815eeb0 2024-09-12T02:48:02.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.067+0000 7f992e000640 1 -- 172.21.15.112:0/2797862892 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9930042070 con 0x7f993815eeb0 2024-09-12T02:48:02.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.067+0000 7f992e000640 1 -- 172.21.15.112:0/2797862892 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9930009510 con 0x7f993815eeb0 2024-09-12T02:48:02.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.067+0000 7f993cc00640 1 -- 172.21.15.112:0/2797862892 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99380d2da0 con 0x7f993815eeb0 2024-09-12T02:48:02.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.067+0000 7f993cc00640 1 -- 172.21.15.112:0/2797862892 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99380d3360 con 0x7f993815eeb0 2024-09-12T02:48:02.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.068+0000 7f993cc00640 1 -- 172.21.15.112:0/2797862892 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99380763a0 con 0x7f993815eeb0 2024-09-12T02:48:02.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.069+0000 7f992e000640 1 -- 172.21.15.112:0/2797862892 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9930007bf0 con 0x7f993815eeb0 2024-09-12T02:48:02.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.070+0000 7f992e000640 1 --2- 172.21.15.112:0/2797862892 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f991806be30 0x7f991806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.070+0000 7f992e000640 1 -- 172.21.15.112:0/2797862892 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f99300abe40 con 0x7f993815eeb0 2024-09-12T02:48:02.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.070+0000 7f9935e00640 1 --2- 172.21.15.112:0/2797862892 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f991806be30 0x7f991806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.071+0000 7f9935e00640 1 --2- 172.21.15.112:0/2797862892 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f991806be30 0x7f991806e2f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9928006fd0 tx=0x7f9928009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:02.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.074+0000 7f992e000640 1 -- 172.21.15.112:0/2797862892 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f993007a220 con 0x7f993815eeb0 2024-09-12T02:48:02.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.248+0000 7f993cc00640 1 -- 172.21.15.112:0/2797862892 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99380b32b0 con 0x7f993815eeb0 2024-09-12T02:48:02.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.249+0000 7f992e000640 1 -- 172.21.15.112:0/2797862892 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) ==== 74+0+16736 (secure 0 0 0) 0x7f993007e520 con 0x7f993815eeb0 2024-09-12T02:48:02.250 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:02.250 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":135,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:47:59.458305+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:47:55.641315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-12T02:47:56.867038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:48:02.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.251+0000 7f993cc00640 1 -- 172.21.15.112:0/2797862892 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f991806be30 msgr2=0x7f991806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:02.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.251+0000 7f993cc00640 1 --2- 172.21.15.112:0/2797862892 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f991806be30 0x7f991806e2f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9928006fd0 tx=0x7f9928009060 comp rx=0 tx=0).stop 2024-09-12T02:48:02.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.251+0000 7f993cc00640 1 -- 172.21.15.112:0/2797862892 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f993815eeb0 msgr2=0x7f99380d2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:02.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.251+0000 7f993cc00640 1 --2- 172.21.15.112:0/2797862892 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f993815eeb0 0x7f99380d2570 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f9930034040 tx=0x7f9930004a40 comp rx=0 tx=0).stop 2024-09-12T02:48:02.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.251+0000 7f993cc00640 1 -- 172.21.15.112:0/2797862892 shutdown_connections 2024-09-12T02:48:02.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.251+0000 7f993cc00640 1 --2- 172.21.15.112:0/2797862892 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f993815eeb0 0x7f99380d2570 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.251+0000 7f993cc00640 1 --2- 172.21.15.112:0/2797862892 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f99380cfd30 0x7f9938157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.251+0000 7f993cc00640 1 --2- 172.21.15.112:0/2797862892 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f991806be30 0x7f991806e2f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.251+0000 7f993cc00640 1 --2- 172.21.15.112:0/2797862892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9938070bc0 0x7f99380c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.251+0000 7f993cc00640 1 -- 172.21.15.112:0/2797862892 >> 172.21.15.112:0/2797862892 conn(0x7f99380b4720 msgr2=0x7f99380b3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:02.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.251+0000 7f993cc00640 1 -- 172.21.15.112:0/2797862892 shutdown_connections 2024-09-12T02:48:02.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.251+0000 7f993cc00640 1 -- 172.21.15.112:0/2797862892 wait complete. 2024-09-12T02:48:02.268 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:48:02.268 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:48:02.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.419+0000 7f8ed0600640 1 Processor -- start 2024-09-12T02:48:02.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.419+0000 7f8ed0600640 1 -- start start 2024-09-12T02:48:02.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.420+0000 7f8ed0600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8ec815cc50 0x7f8ec80732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.420+0000 7f8ed0600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ec8073830 con 0x7f8ec8071530 2024-09-12T02:48:02.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.421+0000 7f8ed0600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ec80ceeb0 con 0x7f8ec80afe30 2024-09-12T02:48:02.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.421+0000 7f8ed0600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8ec815d030 con 0x7f8ec815cc50 2024-09-12T02:48:02.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.421+0000 7f8ecdc00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8ec815cc50 0x7f8ec80732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.421+0000 7f8ecd200640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8ec8071530 0x7f8ec80af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:40964/0 (socket says 172.21.15.112:40964) 2024-09-12T02:48:02.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.421+0000 7f8ecdc00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8ec815cc50 0x7f8ec80732f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34330/0 (socket says 172.21.15.112:34330) 2024-09-12T02:48:02.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.421+0000 7f8ecd200640 1 -- 172.21.15.112:0/1946007387 learned_addr learned my addr 172.21.15.112:0/1946007387 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:02.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.421+0000 7f8ecdc00640 1 -- 172.21.15.112:0/1946007387 >> v1:172.21.15.137:6789/0 conn(0x7f8ec80afe30 legacy=0x7f8ec80cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:02.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.421+0000 7f8ecdc00640 1 -- 172.21.15.112:0/1946007387 >> v1:172.21.15.112:6789/0 conn(0x7f8ec8071530 legacy=0x7f8ec80af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:02.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.421+0000 7f8ecdc00640 1 -- 172.21.15.112:0/1946007387 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec806e300 con 0x7f8ec815cc50 2024-09-12T02:48:02.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.421+0000 7f8ec7e00640 1 -- 172.21.15.112:0/1946007387 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 163871075 0 0) 0x7f8eb4001290 con 0x7f8ec8071530 2024-09-12T02:48:02.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.422+0000 7f8ecdc00640 1 --2- 172.21.15.112:0/1946007387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ec815cc50 0x7f8ec80732f0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc0097a0 tx=0x7f8ebc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b86fa35673602a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:02.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.422+0000 7f8ec7e00640 1 -- 172.21.15.112:0/1946007387 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc037070 con 0x7f8ec815cc50 2024-09-12T02:48:02.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.423+0000 7f8ec7e00640 1 -- 172.21.15.112:0/1946007387 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ebc032440 con 0x7f8ec815cc50 2024-09-12T02:48:02.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.423+0000 7f8ec7e00640 1 -- 172.21.15.112:0/1946007387 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc032810 con 0x7f8ec815cc50 2024-09-12T02:48:02.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.423+0000 7f8ed0600640 1 -- 172.21.15.112:0/1946007387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ec815cc50 msgr2=0x7f8ec80732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:02.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.423+0000 7f8ed0600640 1 --2- 172.21.15.112:0/1946007387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ec815cc50 0x7f8ec80732f0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc0097a0 tx=0x7f8ebc02a1a0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.423+0000 7f8ed0600640 1 -- 172.21.15.112:0/1946007387 shutdown_connections 2024-09-12T02:48:02.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.423+0000 7f8ed0600640 1 --2- 172.21.15.112:0/1946007387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ec815cc50 0x7f8ec80732f0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.423+0000 7f8ed0600640 1 -- 172.21.15.112:0/1946007387 >> 172.21.15.112:0/1946007387 conn(0x7f8ec806bbd0 msgr2=0x7f8ec806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:02.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.423+0000 7f8ed0600640 1 -- 172.21.15.112:0/1946007387 shutdown_connections 2024-09-12T02:48:02.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.423+0000 7f8ed0600640 1 -- 172.21.15.112:0/1946007387 wait complete. 2024-09-12T02:48:02.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.425+0000 7f8ed0600640 1 Processor -- start 2024-09-12T02:48:02.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.425+0000 7f8ed0600640 1 -- start start 2024-09-12T02:48:02.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.426+0000 7f8ed0600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ec8071530 0x7f8ec814dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.426+0000 7f8ed0600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ec80afe30 0x7f8ec815a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.426+0000 7f8ed0600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ec815cc50 0x7f8ec81ea690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.426+0000 7f8ed0600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec80cf150 con 0x7f8ec815cc50 2024-09-12T02:48:02.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.426+0000 7f8ed0600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec80cf4c0 con 0x7f8ec8071530 2024-09-12T02:48:02.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.426+0000 7f8ed0600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8ec806f510 con 0x7f8ec80afe30 2024-09-12T02:48:02.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.426+0000 7f8ece600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ec815cc50 0x7f8ec81ea690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.426+0000 7f8ece600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ec815cc50 0x7f8ec81ea690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34346/0 (socket says 172.21.15.112:34346) 2024-09-12T02:48:02.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.426+0000 7f8ece600640 1 -- 172.21.15.112:0/2966176894 learned_addr learned my addr 172.21.15.112:0/2966176894 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:02.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.426+0000 7f8ecdc00640 1 --2- 172.21.15.112:0/2966176894 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ec8071530 0x7f8ec814dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.426+0000 7f8ecd200640 1 --2- 172.21.15.112:0/2966176894 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ec80afe30 0x7f8ec815a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.426+0000 7f8ece600640 1 -- 172.21.15.112:0/2966176894 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ec80afe30 msgr2=0x7f8ec815a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:02.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.426+0000 7f8ece600640 1 --2- 172.21.15.112:0/2966176894 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ec80afe30 0x7f8ec815a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.426+0000 7f8ece600640 1 -- 172.21.15.112:0/2966176894 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ec8071530 msgr2=0x7f8ec814dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:02.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.426+0000 7f8ece600640 1 --2- 172.21.15.112:0/2966176894 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ec8071530 0x7f8ec814dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.426+0000 7f8ece600640 1 -- 172.21.15.112:0/2966176894 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec814e100 con 0x7f8ec815cc50 2024-09-12T02:48:02.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.427+0000 7f8ece600640 1 --2- 172.21.15.112:0/2966176894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ec815cc50 0x7f8ec81ea690 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f8ec000c760 tx=0x7f8ec000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:02.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.427+0000 7f8ec5600640 1 -- 172.21.15.112:0/2966176894 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0003b70 con 0x7f8ec815cc50 2024-09-12T02:48:02.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.427+0000 7f8ec5600640 1 -- 172.21.15.112:0/2966176894 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ec0003d10 con 0x7f8ec815cc50 2024-09-12T02:48:02.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.427+0000 7f8ec5600640 1 -- 172.21.15.112:0/2966176894 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec000aa90 con 0x7f8ec815cc50 2024-09-12T02:48:02.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.427+0000 7f8ed0600640 1 -- 172.21.15.112:0/2966176894 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ec81595a0 con 0x7f8ec815cc50 2024-09-12T02:48:02.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.427+0000 7f8ed0600640 1 -- 172.21.15.112:0/2966176894 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ec8159b60 con 0x7f8ec815cc50 2024-09-12T02:48:02.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.428+0000 7f8ed0600640 1 -- 172.21.15.112:0/2966176894 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ec8068a30 con 0x7f8ec815cc50 2024-09-12T02:48:02.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.429+0000 7f8ec5600640 1 -- 172.21.15.112:0/2966176894 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ec000ac30 con 0x7f8ec815cc50 2024-09-12T02:48:02.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.430+0000 7f8ec5600640 1 --2- 172.21.15.112:0/2966176894 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8ea806be30 0x7f8ea806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.430+0000 7f8ec5600640 1 -- 172.21.15.112:0/2966176894 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f8ec008ac40 con 0x7f8ec815cc50 2024-09-12T02:48:02.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.430+0000 7f8ecdc00640 1 --2- 172.21.15.112:0/2966176894 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8ea806be30 0x7f8ea806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.431+0000 7f8ecdc00640 1 --2- 172.21.15.112:0/2966176894 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8ea806be30 0x7f8ea806e2f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc034000 tx=0x7f8ebc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:02.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.434+0000 7f8ec5600640 1 -- 172.21.15.112:0/2966176894 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8ec0058f90 con 0x7f8ec815cc50 2024-09-12T02:48:02.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.606+0000 7f8ed0600640 1 -- 172.21.15.112:0/2966176894 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8ec80730d0 con 0x7f8ea806be30 2024-09-12T02:48:02.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.612+0000 7f8ec5600640 1 -- 172.21.15.112:0/2966176894 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242639 (secure 0 0 0) 0x7f8ec80730d0 con 0x7f8ea806be30 2024-09-12T02:48:02.616 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:02.617 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:48:02.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.616+0000 7f8ed0600640 1 -- 172.21.15.112:0/2966176894 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8ea806be30 msgr2=0x7f8ea806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:02.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.616+0000 7f8ed0600640 1 --2- 172.21.15.112:0/2966176894 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8ea806be30 0x7f8ea806e2f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc034000 tx=0x7f8ebc02e000 comp rx=0 tx=0).stop 2024-09-12T02:48:02.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.616+0000 7f8ed0600640 1 -- 172.21.15.112:0/2966176894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ec815cc50 msgr2=0x7f8ec81ea690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:02.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.616+0000 7f8ed0600640 1 --2- 172.21.15.112:0/2966176894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ec815cc50 0x7f8ec81ea690 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f8ec000c760 tx=0x7f8ec000cc20 comp rx=0 tx=0).stop 2024-09-12T02:48:02.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.616+0000 7f8ed0600640 1 -- 172.21.15.112:0/2966176894 shutdown_connections 2024-09-12T02:48:02.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.616+0000 7f8ed0600640 1 --2- 172.21.15.112:0/2966176894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ec815cc50 0x7f8ec81ea690 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.616+0000 7f8ed0600640 1 --2- 172.21.15.112:0/2966176894 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ec80afe30 0x7f8ec815a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.616+0000 7f8ed0600640 1 --2- 172.21.15.112:0/2966176894 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8ea806be30 0x7f8ea806e2f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.616+0000 7f8ed0600640 1 --2- 172.21.15.112:0/2966176894 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ec8071530 0x7f8ec814dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.616+0000 7f8ed0600640 1 -- 172.21.15.112:0/2966176894 >> 172.21.15.112:0/2966176894 conn(0x7f8ec806bbd0 msgr2=0x7f8ec806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:02.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.616+0000 7f8ed0600640 1 -- 172.21.15.112:0/2966176894 shutdown_connections 2024-09-12T02:48:02.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.616+0000 7f8ed0600640 1 -- 172.21.15.112:0/2966176894 wait complete. 2024-09-12T02:48:02.633 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":316,"stamp":"2024-09-12T02:48:01.038550+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6879,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555620,"statfs":{"total":1600000000,"available":1592955435,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.588564"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.476695+0000","last_change":"2024-09-12T02:47:57.476695+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.476695+0000","last_undegraded":"2024-09-12T02:47:57.476695+0000","last_fullsized":"2024-09-12T02:47:57.476695+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.466421+0000","last_change":"2024-09-12T02:47:57.466421+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.466421+0000","last_undegraded":"2024-09-12T02:47:57.466421+0000","last_fullsized":"2024-09-12T02:47:57.466421+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.461550+0000","last_change":"2024-09-12T02:47:57.461550+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.461550+0000","last_undegraded":"2024-09-12T02:47:57.461550+0000","last_fullsized":"2024-09-12T02:47:57.461550+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.474278+0000","last_change":"2024-09-12T02:47:57.474278+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.474278+0000","last_undegraded":"2024-09-12T02:47:57.474278+0000","last_fullsized":"2024-09-12T02:47:57.474278+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.468796+0000","last_change":"2024-09-12T02:47:57.468796+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.468796+0000","last_undegraded":"2024-09-12T02:47:57.468796+0000","last_fullsized":"2024-09-12T02:47:57.468796+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.465027+0000","last_change":"2024-09-12T02:47:57.465027+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.465027+0000","last_undegraded":"2024-09-12T02:47:57.465027+0000","last_fullsized":"2024-09-12T02:47:57.465027+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.466257+0000","last_change":"2024-09-12T02:47:57.466257+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.466257+0000","last_undegraded":"2024-09-12T02:47:57.466257+0000","last_fullsized":"2024-09-12T02:47:57.466257+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.460844+0000","last_change":"2024-09-12T02:47:57.460844+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.460844+0000","last_undegraded":"2024-09-12T02:47:57.460844+0000","last_fullsized":"2024-09-12T02:47:57.460844+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.473951+0000","last_change":"2024-09-12T02:47:57.473951+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.473951+0000","last_undegraded":"2024-09-12T02:47:57.473951+0000","last_fullsized":"2024-09-12T02:47:57.473951+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.474317+0000","last_change":"2024-09-12T02:47:57.474317+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.474317+0000","last_undegraded":"2024-09-12T02:47:57.474317+0000","last_fullsized":"2024-09-12T02:47:57.474317+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.467556+0000","last_change":"2024-09-12T02:47:57.467556+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.467556+0000","last_undegraded":"2024-09-12T02:47:57.467556+0000","last_fullsized":"2024-09-12T02:47:57.467556+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.474755+0000","last_change":"2024-09-12T02:47:57.474755+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.474755+0000","last_undegraded":"2024-09-12T02:47:57.474755+0000","last_fullsized":"2024-09-12T02:47:57.474755+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.461210+0000","last_change":"2024-09-12T02:47:57.461210+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.461210+0000","last_undegraded":"2024-09-12T02:47:57.461210+0000","last_fullsized":"2024-09-12T02:47:57.461210+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.462394+0000","last_change":"2024-09-12T02:47:57.462394+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.462394+0000","last_undegraded":"2024-09-12T02:47:57.462394+0000","last_fullsized":"2024-09-12T02:47:57.462394+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.464976+0000","last_change":"2024-09-12T02:47:57.464976+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.464976+0000","last_undegraded":"2024-09-12T02:47:57.464976+0000","last_fullsized":"2024-09-12T02:47:57.464976+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.476463+0000","last_change":"2024-09-12T02:47:57.476463+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.476463+0000","last_undegraded":"2024-09-12T02:47:57.476463+0000","last_fullsized":"2024-09-12T02:47:57.476463+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.466143+0000","last_change":"2024-09-12T02:47:57.466143+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.466143+0000","last_undegraded":"2024-09-12T02:47:57.466143+0000","last_fullsized":"2024-09-12T02:47:57.466143+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.459896+0000","last_change":"2024-09-12T02:47:57.459896+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.459896+0000","last_undegraded":"2024-09-12T02:47:57.459896+0000","last_fullsized":"2024-09-12T02:47:57.459896+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.462064+0000","last_change":"2024-09-12T02:47:57.462064+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.462064+0000","last_undegraded":"2024-09-12T02:47:57.462064+0000","last_fullsized":"2024-09-12T02:47:57.462064+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.466052+0000","last_change":"2024-09-12T02:47:57.466052+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.466052+0000","last_undegraded":"2024-09-12T02:47:57.466052+0000","last_fullsized":"2024-09-12T02:47:57.466052+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.466810+0000","last_change":"2024-09-12T02:47:57.466810+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.466810+0000","last_undegraded":"2024-09-12T02:47:57.466810+0000","last_fullsized":"2024-09-12T02:47:57.466810+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.460095+0000","last_change":"2024-09-12T02:47:57.460095+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.460095+0000","last_undegraded":"2024-09-12T02:47:57.460095+0000","last_fullsized":"2024-09-12T02:47:57.460095+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.465283+0000","last_change":"2024-09-12T02:47:57.465283+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.465283+0000","last_undegraded":"2024-09-12T02:47:57.465283+0000","last_fullsized":"2024-09-12T02:47:57.465283+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.460163+0000","last_change":"2024-09-12T02:47:57.460163+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.460163+0000","last_undegraded":"2024-09-12T02:47:57.460163+0000","last_fullsized":"2024-09-12T02:47:57.460163+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.465725+0000","last_change":"2024-09-12T02:47:57.465725+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.465725+0000","last_undegraded":"2024-09-12T02:47:57.465725+0000","last_fullsized":"2024-09-12T02:47:57.465725+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.476236+0000","last_change":"2024-09-12T02:47:57.476236+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.476236+0000","last_undegraded":"2024-09-12T02:47:57.476236+0000","last_fullsized":"2024-09-12T02:47:57.476236+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.465221+0000","last_change":"2024-09-12T02:47:57.465221+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.465221+0000","last_undegraded":"2024-09-12T02:47:57.465221+0000","last_fullsized":"2024-09-12T02:47:57.465221+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.459654+0000","last_change":"2024-09-12T02:47:57.459654+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.459654+0000","last_undegraded":"2024-09-12T02:47:57.459654+0000","last_fullsized":"2024-09-12T02:47:57.459654+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.465247+0000","last_change":"2024-09-12T02:47:57.465247+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.465247+0000","last_undegraded":"2024-09-12T02:47:57.465247+0000","last_fullsized":"2024-09-12T02:47:57.465247+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.467431+0000","last_change":"2024-09-12T02:47:57.467431+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.467431+0000","last_undegraded":"2024-09-12T02:47:57.467431+0000","last_fullsized":"2024-09-12T02:47:57.467431+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.475987+0000","last_change":"2024-09-12T02:47:57.475987+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.475987+0000","last_undegraded":"2024-09-12T02:47:57.475987+0000","last_fullsized":"2024-09-12T02:47:57.475987+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.464714+0000","last_change":"2024-09-12T02:47:57.464714+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.464714+0000","last_undegraded":"2024-09-12T02:47:57.464714+0000","last_fullsized":"2024-09-12T02:47:57.464714+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.465269+0000","last_change":"2024-09-12T02:47:57.465269+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.465269+0000","last_undegraded":"2024-09-12T02:47:57.465269+0000","last_fullsized":"2024-09-12T02:47:57.465269+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.469606+0000","last_change":"2024-09-12T02:47:57.468829+0000","last_active":"2024-09-12T02:47:57.469606+0000","last_peered":"2024-09-12T02:47:57.469606+0000","last_clean":"2024-09-12T02:47:57.469606+0000","last_became_active":"2024-09-12T02:47:57.468528+0000","last_became_peered":"2024-09-12T02:47:57.468528+0000","last_unstale":"2024-09-12T02:47:57.469606+0000","last_undegraded":"2024-09-12T02:47:57.469606+0000","last_fullsized":"2024-09-12T02:47:57.469606+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:15.582742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.459536+0000","last_change":"2024-09-12T02:47:57.459536+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.459536+0000","last_undegraded":"2024-09-12T02:47:57.459536+0000","last_fullsized":"2024-09-12T02:47:57.459536+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.469837+0000","last_change":"2024-09-12T02:47:57.469448+0000","last_active":"2024-09-12T02:47:57.469837+0000","last_peered":"2024-09-12T02:47:57.469837+0000","last_clean":"2024-09-12T02:47:57.469837+0000","last_became_active":"2024-09-12T02:47:57.469225+0000","last_became_peered":"2024-09-12T02:47:57.469225+0000","last_unstale":"2024-09-12T02:47:57.469837+0000","last_undegraded":"2024-09-12T02:47:57.469837+0000","last_fullsized":"2024-09-12T02:47:57.469837+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:30.628451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.464691+0000","last_change":"2024-09-12T02:47:57.464691+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.464691+0000","last_undegraded":"2024-09-12T02:47:57.464691+0000","last_fullsized":"2024-09-12T02:47:57.464691+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.471618+0000","last_change":"2024-09-12T02:47:57.471489+0000","last_active":"2024-09-12T02:47:57.471618+0000","last_peered":"2024-09-12T02:47:57.471618+0000","last_clean":"2024-09-12T02:47:57.471618+0000","last_became_active":"2024-09-12T02:47:57.470912+0000","last_became_peered":"2024-09-12T02:47:57.470912+0000","last_unstale":"2024-09-12T02:47:57.471618+0000","last_undegraded":"2024-09-12T02:47:57.471618+0000","last_fullsized":"2024-09-12T02:47:57.471618+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:43.417055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.463379+0000","last_change":"2024-09-12T02:47:57.463379+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.463379+0000","last_undegraded":"2024-09-12T02:47:57.463379+0000","last_fullsized":"2024-09-12T02:47:57.463379+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.471274+0000","last_change":"2024-09-12T02:47:57.471168+0000","last_active":"2024-09-12T02:47:57.471274+0000","last_peered":"2024-09-12T02:47:57.471274+0000","last_clean":"2024-09-12T02:47:57.471274+0000","last_became_active":"2024-09-12T02:47:57.470929+0000","last_became_peered":"2024-09-12T02:47:57.470929+0000","last_unstale":"2024-09-12T02:47:57.471274+0000","last_undegraded":"2024-09-12T02:47:57.471274+0000","last_fullsized":"2024-09-12T02:47:57.471274+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:44.123734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.474815+0000","last_change":"2024-09-12T02:47:57.474815+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.474815+0000","last_undegraded":"2024-09-12T02:47:57.474815+0000","last_fullsized":"2024-09-12T02:47:57.474815+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.470211+0000","last_change":"2024-09-12T02:47:57.470089+0000","last_active":"2024-09-12T02:47:57.470211+0000","last_peered":"2024-09-12T02:47:57.470211+0000","last_clean":"2024-09-12T02:47:57.470211+0000","last_became_active":"2024-09-12T02:47:57.468952+0000","last_became_peered":"2024-09-12T02:47:57.468952+0000","last_unstale":"2024-09-12T02:47:57.470211+0000","last_undegraded":"2024-09-12T02:47:57.470211+0000","last_fullsized":"2024-09-12T02:47:57.470211+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:06.208924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.465601+0000","last_change":"2024-09-12T02:47:57.465601+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.465601+0000","last_undegraded":"2024-09-12T02:47:57.465601+0000","last_fullsized":"2024-09-12T02:47:57.465601+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.465248+0000","last_change":"2024-09-12T02:47:57.464833+0000","last_active":"2024-09-12T02:47:57.465248+0000","last_peered":"2024-09-12T02:47:57.465248+0000","last_clean":"2024-09-12T02:47:57.465248+0000","last_became_active":"2024-09-12T02:47:57.464435+0000","last_became_peered":"2024-09-12T02:47:57.464435+0000","last_unstale":"2024-09-12T02:47:57.465248+0000","last_undegraded":"2024-09-12T02:47:57.465248+0000","last_fullsized":"2024-09-12T02:47:57.465248+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:16.354223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.474011+0000","last_change":"2024-09-12T02:47:57.474011+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.474011+0000","last_undegraded":"2024-09-12T02:47:57.474011+0000","last_fullsized":"2024-09-12T02:47:57.474011+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.460270+0000","last_change":"2024-09-12T02:47:57.460129+0000","last_active":"2024-09-12T02:47:57.460270+0000","last_peered":"2024-09-12T02:47:57.460270+0000","last_clean":"2024-09-12T02:47:57.460270+0000","last_became_active":"2024-09-12T02:47:57.459834+0000","last_became_peered":"2024-09-12T02:47:57.459834+0000","last_unstale":"2024-09-12T02:47:57.460270+0000","last_undegraded":"2024-09-12T02:47:57.460270+0000","last_fullsized":"2024-09-12T02:47:57.460270+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:13:54.124564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.466979+0000","last_change":"2024-09-12T02:47:57.466979+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.466979+0000","last_undegraded":"2024-09-12T02:47:57.466979+0000","last_fullsized":"2024-09-12T02:47:57.466979+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.466048+0000","last_change":"2024-09-12T02:47:57.464663+0000","last_active":"2024-09-12T02:47:57.466048+0000","last_peered":"2024-09-12T02:47:57.466048+0000","last_clean":"2024-09-12T02:47:57.466048+0000","last_became_active":"2024-09-12T02:47:57.464447+0000","last_became_peered":"2024-09-12T02:47:57.464447+0000","last_unstale":"2024-09-12T02:47:57.466048+0000","last_undegraded":"2024-09-12T02:47:57.466048+0000","last_fullsized":"2024-09-12T02:47:57.466048+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:49.097462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.465851+0000","last_change":"2024-09-12T02:47:57.465851+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.465851+0000","last_undegraded":"2024-09-12T02:47:57.465851+0000","last_fullsized":"2024-09-12T02:47:57.465851+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.472963+0000","last_change":"2024-09-12T02:47:57.472855+0000","last_active":"2024-09-12T02:47:57.472963+0000","last_peered":"2024-09-12T02:47:57.472963+0000","last_clean":"2024-09-12T02:47:57.472963+0000","last_became_active":"2024-09-12T02:47:57.472612+0000","last_became_peered":"2024-09-12T02:47:57.472612+0000","last_unstale":"2024-09-12T02:47:57.472963+0000","last_undegraded":"2024-09-12T02:47:57.472963+0000","last_fullsized":"2024-09-12T02:47:57.472963+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:34.290643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.459095+0000","last_change":"2024-09-12T02:47:57.459095+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.459095+0000","last_undegraded":"2024-09-12T02:47:57.459095+0000","last_fullsized":"2024-09-12T02:47:57.459095+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.461735+0000","last_change":"2024-09-12T02:47:57.461370+0000","last_active":"2024-09-12T02:47:57.461735+0000","last_peered":"2024-09-12T02:47:57.461735+0000","last_clean":"2024-09-12T02:47:57.461735+0000","last_became_active":"2024-09-12T02:47:57.461153+0000","last_became_peered":"2024-09-12T02:47:57.461153+0000","last_unstale":"2024-09-12T02:47:57.461735+0000","last_undegraded":"2024-09-12T02:47:57.461735+0000","last_fullsized":"2024-09-12T02:47:57.461735+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:20:17.409691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.459860+0000","last_change":"2024-09-12T02:47:57.459860+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.459860+0000","last_undegraded":"2024-09-12T02:47:57.459860+0000","last_fullsized":"2024-09-12T02:47:57.459860+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.469665+0000","last_change":"2024-09-12T02:47:57.469395+0000","last_active":"2024-09-12T02:47:57.469665+0000","last_peered":"2024-09-12T02:47:57.469665+0000","last_clean":"2024-09-12T02:47:57.469665+0000","last_became_active":"2024-09-12T02:47:57.469170+0000","last_became_peered":"2024-09-12T02:47:57.469170+0000","last_unstale":"2024-09-12T02:47:57.469665+0000","last_undegraded":"2024-09-12T02:47:57.469665+0000","last_fullsized":"2024-09-12T02:47:57.469665+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:40.922897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.466260+0000","last_change":"2024-09-12T02:47:57.466260+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.466260+0000","last_undegraded":"2024-09-12T02:47:57.466260+0000","last_fullsized":"2024-09-12T02:47:57.466260+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.463858+0000","last_change":"2024-09-12T02:47:57.462911+0000","last_active":"2024-09-12T02:47:57.463858+0000","last_peered":"2024-09-12T02:47:57.463858+0000","last_clean":"2024-09-12T02:47:57.463858+0000","last_became_active":"2024-09-12T02:47:57.462658+0000","last_became_peered":"2024-09-12T02:47:57.462658+0000","last_unstale":"2024-09-12T02:47:57.463858+0000","last_undegraded":"2024-09-12T02:47:57.463858+0000","last_fullsized":"2024-09-12T02:47:57.463858+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:54.723350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.459027+0000","last_change":"2024-09-12T02:47:57.459027+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.459027+0000","last_undegraded":"2024-09-12T02:47:57.459027+0000","last_fullsized":"2024-09-12T02:47:57.459027+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.465903+0000","last_change":"2024-09-12T02:47:57.465729+0000","last_active":"2024-09-12T02:47:57.465903+0000","last_peered":"2024-09-12T02:47:57.465903+0000","last_clean":"2024-09-12T02:47:57.465903+0000","last_became_active":"2024-09-12T02:47:57.465502+0000","last_became_peered":"2024-09-12T02:47:57.465502+0000","last_unstale":"2024-09-12T02:47:57.465903+0000","last_undegraded":"2024-09-12T02:47:57.465903+0000","last_fullsized":"2024-09-12T02:47:57.465903+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:13.969193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.459546+0000","last_change":"2024-09-12T02:47:57.459546+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.459546+0000","last_undegraded":"2024-09-12T02:47:57.459546+0000","last_fullsized":"2024-09-12T02:47:57.459546+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.468771+0000","last_change":"2024-09-12T02:47:57.467217+0000","last_active":"2024-09-12T02:47:57.468771+0000","last_peered":"2024-09-12T02:47:57.468771+0000","last_clean":"2024-09-12T02:47:57.468771+0000","last_became_active":"2024-09-12T02:47:57.466879+0000","last_became_peered":"2024-09-12T02:47:57.466879+0000","last_unstale":"2024-09-12T02:47:57.468771+0000","last_undegraded":"2024-09-12T02:47:57.468771+0000","last_fullsized":"2024-09-12T02:47:57.468771+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:52.134159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.458945+0000","last_change":"2024-09-12T02:47:57.458945+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.458945+0000","last_undegraded":"2024-09-12T02:47:57.458945+0000","last_fullsized":"2024-09-12T02:47:57.458945+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.470418+0000","last_change":"2024-09-12T02:47:57.470285+0000","last_active":"2024-09-12T02:47:57.470418+0000","last_peered":"2024-09-12T02:47:57.470418+0000","last_clean":"2024-09-12T02:47:57.470418+0000","last_became_active":"2024-09-12T02:47:57.469886+0000","last_became_peered":"2024-09-12T02:47:57.469886+0000","last_unstale":"2024-09-12T02:47:57.470418+0000","last_undegraded":"2024-09-12T02:47:57.470418+0000","last_fullsized":"2024-09-12T02:47:57.470418+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:25.856210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.468386+0000","last_change":"2024-09-12T02:47:57.468386+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.468386+0000","last_undegraded":"2024-09-12T02:47:57.468386+0000","last_fullsized":"2024-09-12T02:47:57.468386+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.467184+0000","last_change":"2024-09-12T02:47:57.466554+0000","last_active":"2024-09-12T02:47:57.467184+0000","last_peered":"2024-09-12T02:47:57.467184+0000","last_clean":"2024-09-12T02:47:57.467184+0000","last_became_active":"2024-09-12T02:47:57.466337+0000","last_became_peered":"2024-09-12T02:47:57.466337+0000","last_unstale":"2024-09-12T02:47:57.467184+0000","last_undegraded":"2024-09-12T02:47:57.467184+0000","last_fullsized":"2024-09-12T02:47:57.467184+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:31.242304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.464715+0000","last_change":"2024-09-12T02:47:57.464715+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.464715+0000","last_undegraded":"2024-09-12T02:47:57.464715+0000","last_fullsized":"2024-09-12T02:47:57.464715+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.471598+0000","last_change":"2024-09-12T02:47:57.471259+0000","last_active":"2024-09-12T02:47:57.471598+0000","last_peered":"2024-09-12T02:47:57.471598+0000","last_clean":"2024-09-12T02:47:57.471598+0000","last_became_active":"2024-09-12T02:47:57.470578+0000","last_became_peered":"2024-09-12T02:47:57.470578+0000","last_unstale":"2024-09-12T02:47:57.471598+0000","last_undegraded":"2024-09-12T02:47:57.471598+0000","last_fullsized":"2024-09-12T02:47:57.471598+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:39.353650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.463078+0000","last_change":"2024-09-12T02:47:57.463078+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.463078+0000","last_undegraded":"2024-09-12T02:47:57.463078+0000","last_fullsized":"2024-09-12T02:47:57.463078+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.461896+0000","last_change":"2024-09-12T02:47:57.461685+0000","last_active":"2024-09-12T02:47:57.461896+0000","last_peered":"2024-09-12T02:47:57.461896+0000","last_clean":"2024-09-12T02:47:57.461896+0000","last_became_active":"2024-09-12T02:47:57.461464+0000","last_became_peered":"2024-09-12T02:47:57.461464+0000","last_unstale":"2024-09-12T02:47:57.461896+0000","last_undegraded":"2024-09-12T02:47:57.461896+0000","last_fullsized":"2024-09-12T02:47:57.461896+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:03.929744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.463575+0000","last_change":"2024-09-12T02:47:57.463575+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.463575+0000","last_undegraded":"2024-09-12T02:47:57.463575+0000","last_fullsized":"2024-09-12T02:47:57.463575+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.470622+0000","last_change":"2024-09-12T02:47:57.470460+0000","last_active":"2024-09-12T02:47:57.470622+0000","last_peered":"2024-09-12T02:47:57.470622+0000","last_clean":"2024-09-12T02:47:57.470622+0000","last_became_active":"2024-09-12T02:47:57.469717+0000","last_became_peered":"2024-09-12T02:47:57.469717+0000","last_unstale":"2024-09-12T02:47:57.470622+0000","last_undegraded":"2024-09-12T02:47:57.470622+0000","last_fullsized":"2024-09-12T02:47:57.470622+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:04.620534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.461405+0000","last_change":"2024-09-12T02:47:57.461405+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.461405+0000","last_undegraded":"2024-09-12T02:47:57.461405+0000","last_fullsized":"2024-09-12T02:47:57.461405+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.471172+0000","last_change":"2024-09-12T02:47:57.471049+0000","last_active":"2024-09-12T02:47:57.471172+0000","last_peered":"2024-09-12T02:47:57.471172+0000","last_clean":"2024-09-12T02:47:57.471172+0000","last_became_active":"2024-09-12T02:47:57.470590+0000","last_became_peered":"2024-09-12T02:47:57.470590+0000","last_unstale":"2024-09-12T02:47:57.471172+0000","last_undegraded":"2024-09-12T02:47:57.471172+0000","last_fullsized":"2024-09-12T02:47:57.471172+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:59.215762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.474223+0000","last_change":"2024-09-12T02:47:57.474223+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.474223+0000","last_undegraded":"2024-09-12T02:47:57.474223+0000","last_fullsized":"2024-09-12T02:47:57.474223+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.469670+0000","last_change":"2024-09-12T02:47:57.469255+0000","last_active":"2024-09-12T02:47:57.469670+0000","last_peered":"2024-09-12T02:47:57.469670+0000","last_clean":"2024-09-12T02:47:57.469670+0000","last_became_active":"2024-09-12T02:47:57.468941+0000","last_became_peered":"2024-09-12T02:47:57.468941+0000","last_unstale":"2024-09-12T02:47:57.469670+0000","last_undegraded":"2024-09-12T02:47:57.469670+0000","last_fullsized":"2024-09-12T02:47:57.469670+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:38.759737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.463260+0000","last_change":"2024-09-12T02:47:57.463260+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.463260+0000","last_undegraded":"2024-09-12T02:47:57.463260+0000","last_fullsized":"2024-09-12T02:47:57.463260+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.470554+0000","last_change":"2024-09-12T02:47:57.470430+0000","last_active":"2024-09-12T02:47:57.470554+0000","last_peered":"2024-09-12T02:47:57.470554+0000","last_clean":"2024-09-12T02:47:57.470554+0000","last_became_active":"2024-09-12T02:47:57.470194+0000","last_became_peered":"2024-09-12T02:47:57.470194+0000","last_unstale":"2024-09-12T02:47:57.470554+0000","last_undegraded":"2024-09-12T02:47:57.470554+0000","last_fullsized":"2024-09-12T02:47:57.470554+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:58.910839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.458947+0000","last_change":"2024-09-12T02:47:57.458947+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.458947+0000","last_undegraded":"2024-09-12T02:47:57.458947+0000","last_fullsized":"2024-09-12T02:47:57.458947+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.473379+0000","last_change":"2024-09-12T02:47:57.472550+0000","last_active":"2024-09-12T02:47:57.473379+0000","last_peered":"2024-09-12T02:47:57.473379+0000","last_clean":"2024-09-12T02:47:57.473379+0000","last_became_active":"2024-09-12T02:47:57.472338+0000","last_became_peered":"2024-09-12T02:47:57.472338+0000","last_unstale":"2024-09-12T02:47:57.473379+0000","last_undegraded":"2024-09-12T02:47:57.473379+0000","last_fullsized":"2024-09-12T02:47:57.473379+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:34.101075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.459081+0000","last_change":"2024-09-12T02:47:57.459081+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.459081+0000","last_undegraded":"2024-09-12T02:47:57.459081+0000","last_fullsized":"2024-09-12T02:47:57.459081+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.462662+0000","last_change":"2024-09-12T02:47:57.462356+0000","last_active":"2024-09-12T02:47:57.462662+0000","last_peered":"2024-09-12T02:47:57.462662+0000","last_clean":"2024-09-12T02:47:57.462662+0000","last_became_active":"2024-09-12T02:47:57.461958+0000","last_became_peered":"2024-09-12T02:47:57.461958+0000","last_unstale":"2024-09-12T02:47:57.462662+0000","last_undegraded":"2024-09-12T02:47:57.462662+0000","last_fullsized":"2024-09-12T02:47:57.462662+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:48.667688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.474042+0000","last_change":"2024-09-12T02:47:57.474042+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.474042+0000","last_undegraded":"2024-09-12T02:47:57.474042+0000","last_fullsized":"2024-09-12T02:47:57.474042+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.465143+0000","last_change":"2024-09-12T02:47:57.464602+0000","last_active":"2024-09-12T02:47:57.465143+0000","last_peered":"2024-09-12T02:47:57.465143+0000","last_clean":"2024-09-12T02:47:57.465143+0000","last_became_active":"2024-09-12T02:47:57.464369+0000","last_became_peered":"2024-09-12T02:47:57.464369+0000","last_unstale":"2024-09-12T02:47:57.465143+0000","last_undegraded":"2024-09-12T02:47:57.465143+0000","last_fullsized":"2024-09-12T02:47:57.465143+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:38.141272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.473675+0000","last_change":"2024-09-12T02:47:57.473675+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.473675+0000","last_undegraded":"2024-09-12T02:47:57.473675+0000","last_fullsized":"2024-09-12T02:47:57.473675+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.473398+0000","last_change":"2024-09-12T02:47:57.473286+0000","last_active":"2024-09-12T02:47:57.473398+0000","last_peered":"2024-09-12T02:47:57.473398+0000","last_clean":"2024-09-12T02:47:57.473398+0000","last_became_active":"2024-09-12T02:47:57.472708+0000","last_became_peered":"2024-09-12T02:47:57.472708+0000","last_unstale":"2024-09-12T02:47:57.473398+0000","last_undegraded":"2024-09-12T02:47:57.473398+0000","last_fullsized":"2024-09-12T02:47:57.473398+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:12.522553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.459085+0000","last_change":"2024-09-12T02:47:57.459085+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.459085+0000","last_undegraded":"2024-09-12T02:47:57.459085+0000","last_fullsized":"2024-09-12T02:47:57.459085+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.465227+0000","last_change":"2024-09-12T02:47:57.464547+0000","last_active":"2024-09-12T02:47:57.465227+0000","last_peered":"2024-09-12T02:47:57.465227+0000","last_clean":"2024-09-12T02:47:57.465227+0000","last_became_active":"2024-09-12T02:47:57.464317+0000","last_became_peered":"2024-09-12T02:47:57.464317+0000","last_unstale":"2024-09-12T02:47:57.465227+0000","last_undegraded":"2024-09-12T02:47:57.465227+0000","last_fullsized":"2024-09-12T02:47:57.465227+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:50.823737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.465188+0000","last_change":"2024-09-12T02:47:57.465188+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.465188+0000","last_undegraded":"2024-09-12T02:47:57.465188+0000","last_fullsized":"2024-09-12T02:47:57.465188+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.469623+0000","last_change":"2024-09-12T02:47:57.469200+0000","last_active":"2024-09-12T02:47:57.469623+0000","last_peered":"2024-09-12T02:47:57.469623+0000","last_clean":"2024-09-12T02:47:57.469623+0000","last_became_active":"2024-09-12T02:47:57.468940+0000","last_became_peered":"2024-09-12T02:47:57.468940+0000","last_unstale":"2024-09-12T02:47:57.469623+0000","last_undegraded":"2024-09-12T02:47:57.469623+0000","last_fullsized":"2024-09-12T02:47:57.469623+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:49.689069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.466457+0000","last_change":"2024-09-12T02:47:57.466457+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.466457+0000","last_undegraded":"2024-09-12T02:47:57.466457+0000","last_fullsized":"2024-09-12T02:47:57.466457+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.465346+0000","last_change":"2024-09-12T02:47:57.464715+0000","last_active":"2024-09-12T02:47:57.465346+0000","last_peered":"2024-09-12T02:47:57.465346+0000","last_clean":"2024-09-12T02:47:57.465346+0000","last_became_active":"2024-09-12T02:47:57.464428+0000","last_became_peered":"2024-09-12T02:47:57.464428+0000","last_unstale":"2024-09-12T02:47:57.465346+0000","last_undegraded":"2024-09-12T02:47:57.465346+0000","last_fullsized":"2024-09-12T02:47:57.465346+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:55.175341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.461731+0000","last_change":"2024-09-12T02:47:57.461731+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.461731+0000","last_undegraded":"2024-09-12T02:47:57.461731+0000","last_fullsized":"2024-09-12T02:47:57.461731+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.469649+0000","last_change":"2024-09-12T02:47:57.469237+0000","last_active":"2024-09-12T02:47:57.469649+0000","last_peered":"2024-09-12T02:47:57.469649+0000","last_clean":"2024-09-12T02:47:57.469649+0000","last_became_active":"2024-09-12T02:47:57.468975+0000","last_became_peered":"2024-09-12T02:47:57.468975+0000","last_unstale":"2024-09-12T02:47:57.469649+0000","last_undegraded":"2024-09-12T02:47:57.469649+0000","last_fullsized":"2024-09-12T02:47:57.469649+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:29.149850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.473826+0000","last_change":"2024-09-12T02:47:57.473826+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.473826+0000","last_undegraded":"2024-09-12T02:47:57.473826+0000","last_fullsized":"2024-09-12T02:47:57.473826+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.473604+0000","last_change":"2024-09-12T02:47:57.473483+0000","last_active":"2024-09-12T02:47:57.473604+0000","last_peered":"2024-09-12T02:47:57.473604+0000","last_clean":"2024-09-12T02:47:57.473604+0000","last_became_active":"2024-09-12T02:47:57.473031+0000","last_became_peered":"2024-09-12T02:47:57.473031+0000","last_unstale":"2024-09-12T02:47:57.473604+0000","last_undegraded":"2024-09-12T02:47:57.473604+0000","last_fullsized":"2024-09-12T02:47:57.473604+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:51.598344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.458955+0000","last_change":"2024-09-12T02:47:57.458955+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.458955+0000","last_undegraded":"2024-09-12T02:47:57.458955+0000","last_fullsized":"2024-09-12T02:47:57.458955+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.470382+0000","last_change":"2024-09-12T02:47:57.470279+0000","last_active":"2024-09-12T02:47:57.470382+0000","last_peered":"2024-09-12T02:47:57.470382+0000","last_clean":"2024-09-12T02:47:57.470382+0000","last_became_active":"2024-09-12T02:47:57.469397+0000","last_became_peered":"2024-09-12T02:47:57.469397+0000","last_unstale":"2024-09-12T02:47:57.470382+0000","last_undegraded":"2024-09-12T02:47:57.470382+0000","last_fullsized":"2024-09-12T02:47:57.470382+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:40.936288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":390,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.465041+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:47:57.465041+0000","last_peered":"2024-09-12T02:47:57.465041+0000","last_clean":"2024-09-12T02:47:57.465041+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:47:57.465041+0000","last_undegraded":"2024-09-12T02:47:57.465041+0000","last_fullsized":"2024-09-12T02:47:57.465041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:25.823876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574925,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1293,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194019,"statfs":{"total":200000000,"available":198675869,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574925,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":716,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194595,"statfs":{"total":200000000,"available":199266237,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":716,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194595,"statfs":{"total":200000000,"available":199266237,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":716,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194595,"statfs":{"total":200000000,"available":199266237,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":716,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194595,"statfs":{"total":200000000,"available":199266237,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194602,"statfs":{"total":200000000,"available":199272512,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":716,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194595,"statfs":{"total":200000000,"available":199266237,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574925,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1293,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194019,"statfs":{"total":200000000,"available":198675869,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:48:02.638 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:48:02.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.825+0000 7f42f2800640 1 Processor -- start 2024-09-12T02:48:02.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.825+0000 7f42f2800640 1 -- start start 2024-09-12T02:48:02.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.827+0000 7f42f2800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f42ec06f600 0x7f42ec0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.827+0000 7f42f2800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f42ec0b45d0 0x7f42ec0728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.827+0000 7f42f2800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42ec0b4a20 con 0x7f42ec15b9d0 2024-09-12T02:48:02.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.827+0000 7f42f2800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f42ec0b54a0 con 0x7f42ec06f600 2024-09-12T02:48:02.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.827+0000 7f42f2800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f42ec0b3af0 con 0x7f42ec0b45d0 2024-09-12T02:48:02.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.827+0000 7f42eb400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f42ec15b9d0 0x7f42ec06eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:40968/0 (socket says 172.21.15.112:40968) 2024-09-12T02:48:02.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.827+0000 7f42eb400640 1 -- 172.21.15.112:0/4289239763 learned_addr learned my addr 172.21.15.112:0/4289239763 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:02.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.827+0000 7f42e2a00640 1 --2- 172.21.15.112:0/4289239763 >> v2:172.21.15.112:3300/0 conn(0x7f42ec06f600 0x7f42ec0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.827+0000 7f42ebe00640 1 --2- 172.21.15.112:0/4289239763 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f42ec0b45d0 0x7f42ec0728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.827+0000 7f42e2a00640 1 -- 172.21.15.112:0/4289239763 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f42ec0b45d0 msgr2=0x7f42ec0728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:02.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.827+0000 7f42e2a00640 1 --2- 172.21.15.112:0/4289239763 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f42ec0b45d0 0x7f42ec0728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.827+0000 7f42e2a00640 1 -- 172.21.15.112:0/4289239763 >> v1:172.21.15.112:6789/0 conn(0x7f42ec15b9d0 legacy=0x7f42ec06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:02.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.827+0000 7f42e2a00640 1 -- 172.21.15.112:0/4289239763 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ec0b3dd0 con 0x7f42ec06f600 2024-09-12T02:48:02.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.827+0000 7f42eaa00640 1 -- 172.21.15.112:0/4289239763 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2345429352 0 0) 0x7f42ec0b4a20 con 0x7f42ec15b9d0 2024-09-12T02:48:02.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.828+0000 7f42e2a00640 1 --2- 172.21.15.112:0/4289239763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42ec06f600 0x7f42ec0b4ec0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f42d4009790 tx=0x7f42d402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f31df8ee9f859d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:02.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.829+0000 7f42eaa00640 1 -- 172.21.15.112:0/4289239763 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d4037070 con 0x7f42ec06f600 2024-09-12T02:48:02.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.829+0000 7f42eaa00640 1 -- 172.21.15.112:0/4289239763 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42d4032440 con 0x7f42ec06f600 2024-09-12T02:48:02.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.829+0000 7f42eaa00640 1 -- 172.21.15.112:0/4289239763 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d4032810 con 0x7f42ec06f600 2024-09-12T02:48:02.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.829+0000 7f42f2800640 1 -- 172.21.15.112:0/4289239763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42ec06f600 msgr2=0x7f42ec0b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:02.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.829+0000 7f42f2800640 1 --2- 172.21.15.112:0/4289239763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42ec06f600 0x7f42ec0b4ec0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f42d4009790 tx=0x7f42d402a180 comp rx=0 tx=0).stop 2024-09-12T02:48:02.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.829+0000 7f42f2800640 1 -- 172.21.15.112:0/4289239763 shutdown_connections 2024-09-12T02:48:02.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.829+0000 7f42f2800640 1 --2- 172.21.15.112:0/4289239763 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f42ec0b45d0 0x7f42ec0728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.829+0000 7f42f2800640 1 --2- 172.21.15.112:0/4289239763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42ec06f600 0x7f42ec0b4ec0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.829+0000 7f42f2800640 1 -- 172.21.15.112:0/4289239763 >> 172.21.15.112:0/4289239763 conn(0x7f42ec06bbd0 msgr2=0x7f42ec06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:02.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.829+0000 7f42f2800640 1 -- 172.21.15.112:0/4289239763 shutdown_connections 2024-09-12T02:48:02.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.829+0000 7f42f2800640 1 -- 172.21.15.112:0/4289239763 wait complete. 2024-09-12T02:48:02.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.831+0000 7f42f2800640 1 Processor -- start 2024-09-12T02:48:02.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.831+0000 7f42f2800640 1 -- start start 2024-09-12T02:48:02.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.832+0000 7f42f2800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f42ec06f600 0x7f42ec152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.832+0000 7f42f2800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42ec0b45d0 0x7f42ec15d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.832+0000 7f42f2800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42ec15b9d0 0x7f42ec1f51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.832+0000 7f42f2800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f42ec15bf30 con 0x7f42ec0b45d0 2024-09-12T02:48:02.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.832+0000 7f42f2800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f42ec15bdb0 con 0x7f42ec15b9d0 2024-09-12T02:48:02.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.832+0000 7f42f2800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f42ec0cdcd0 con 0x7f42ec06f600 2024-09-12T02:48:02.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.832+0000 7f42e2a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42ec0b45d0 0x7f42ec15d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.832+0000 7f42e2a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42ec0b45d0 0x7f42ec15d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34356/0 (socket says 172.21.15.112:34356) 2024-09-12T02:48:02.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.832+0000 7f42e2a00640 1 -- 172.21.15.112:0/1726846814 learned_addr learned my addr 172.21.15.112:0/1726846814 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:02.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.832+0000 7f42ebe00640 1 --2- 172.21.15.112:0/1726846814 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42ec15b9d0 0x7f42ec1f51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.832+0000 7f42eb400640 1 --2- 172.21.15.112:0/1726846814 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f42ec06f600 0x7f42ec152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.832+0000 7f42e2a00640 1 -- 172.21.15.112:0/1726846814 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f42ec06f600 msgr2=0x7f42ec152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:02.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.833+0000 7f42e2a00640 1 --2- 172.21.15.112:0/1726846814 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f42ec06f600 0x7f42ec152940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.833+0000 7f42e2a00640 1 -- 172.21.15.112:0/1726846814 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42ec15b9d0 msgr2=0x7f42ec1f51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:02.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.833+0000 7f42e2a00640 1 --2- 172.21.15.112:0/1726846814 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42ec15b9d0 0x7f42ec1f51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.833+0000 7f42e2a00640 1 -- 172.21.15.112:0/1726846814 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ec15ac10 con 0x7f42ec0b45d0 2024-09-12T02:48:02.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.833+0000 7f42ebe00640 1 --2- 172.21.15.112:0/1726846814 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42ec15b9d0 0x7f42ec1f51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:02.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.833+0000 7f42eb400640 1 --2- 172.21.15.112:0/1726846814 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f42ec06f600 0x7f42ec152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:02.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.833+0000 7f42e2a00640 1 --2- 172.21.15.112:0/1726846814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42ec0b45d0 0x7f42ec15d150 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f42d4035040 tx=0x7f42d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:02.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.833+0000 7f42e3e00640 1 -- 172.21.15.112:0/1726846814 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d4037040 con 0x7f42ec0b45d0 2024-09-12T02:48:02.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.833+0000 7f42e3e00640 1 -- 172.21.15.112:0/1726846814 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42d4005bd0 con 0x7f42ec0b45d0 2024-09-12T02:48:02.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.833+0000 7f42f2800640 1 -- 172.21.15.112:0/1726846814 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42ec1f5930 con 0x7f42ec0b45d0 2024-09-12T02:48:02.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.833+0000 7f42e3e00640 1 -- 172.21.15.112:0/1726846814 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d4030770 con 0x7f42ec0b45d0 2024-09-12T02:48:02.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.833+0000 7f42f2800640 1 -- 172.21.15.112:0/1726846814 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42ec1f5ef0 con 0x7f42ec0b45d0 2024-09-12T02:48:02.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.834+0000 7f42f2800640 1 -- 172.21.15.112:0/1726846814 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42ec068a30 con 0x7f42ec0b45d0 2024-09-12T02:48:02.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.835+0000 7f42e3e00640 1 -- 172.21.15.112:0/1726846814 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f42d4030910 con 0x7f42ec0b45d0 2024-09-12T02:48:02.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.836+0000 7f42e3e00640 1 --2- 172.21.15.112:0/1726846814 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f42c806be30 0x7f42c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.836+0000 7f42e3e00640 1 -- 172.21.15.112:0/1726846814 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f42d40ab940 con 0x7f42ec0b45d0 2024-09-12T02:48:02.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.836+0000 7f42eb400640 1 --2- 172.21.15.112:0/1726846814 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f42c806be30 0x7f42c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.837+0000 7f42eb400640 1 --2- 172.21.15.112:0/1726846814 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f42c806be30 0x7f42c806e2f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f42dc000f60 tx=0x7f42dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:02.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:02.840+0000 7f42e3e00640 1 -- 172.21.15.112:0/1726846814 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f42d4032e20 con 0x7f42ec0b45d0 2024-09-12T02:48:03.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.011+0000 7f42f2800640 1 -- 172.21.15.112:0/1726846814 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f42ec0725a0 con 0x7f42c806be30 2024-09-12T02:48:03.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.017+0000 7f42e3e00640 1 -- 172.21.15.112:0/1726846814 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242639 (secure 0 0 0) 0x7f42ec0725a0 con 0x7f42c806be30 2024-09-12T02:48:03.021 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:03.022 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:48:03.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.021+0000 7f42f2800640 1 -- 172.21.15.112:0/1726846814 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f42c806be30 msgr2=0x7f42c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:03.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.021+0000 7f42f2800640 1 --2- 172.21.15.112:0/1726846814 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f42c806be30 0x7f42c806e2f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f42dc000f60 tx=0x7f42dc009040 comp rx=0 tx=0).stop 2024-09-12T02:48:03.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.021+0000 7f42f2800640 1 -- 172.21.15.112:0/1726846814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42ec0b45d0 msgr2=0x7f42ec15d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:03.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.021+0000 7f42f2800640 1 --2- 172.21.15.112:0/1726846814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42ec0b45d0 0x7f42ec15d150 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f42d4035040 tx=0x7f42d40046c0 comp rx=0 tx=0).stop 2024-09-12T02:48:03.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.021+0000 7f42f2800640 1 -- 172.21.15.112:0/1726846814 shutdown_connections 2024-09-12T02:48:03.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.021+0000 7f42f2800640 1 --2- 172.21.15.112:0/1726846814 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f42c806be30 0x7f42c806e2f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:03.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.021+0000 7f42f2800640 1 --2- 172.21.15.112:0/1726846814 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42ec15b9d0 0x7f42ec1f51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:03.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.021+0000 7f42f2800640 1 --2- 172.21.15.112:0/1726846814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42ec0b45d0 0x7f42ec15d150 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:03.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.021+0000 7f42f2800640 1 --2- 172.21.15.112:0/1726846814 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f42ec06f600 0x7f42ec152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:03.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.021+0000 7f42f2800640 1 -- 172.21.15.112:0/1726846814 >> 172.21.15.112:0/1726846814 conn(0x7f42ec06bbd0 msgr2=0x7f42ec0ccbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:03.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.021+0000 7f42f2800640 1 -- 172.21.15.112:0/1726846814 shutdown_connections 2024-09-12T02:48:03.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.021+0000 7f42f2800640 1 -- 172.21.15.112:0/1726846814 wait complete. 2024-09-12T02:48:03.038 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":316,"stamp":"2024-09-12T02:48:01.038550+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6879,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555620,"statfs":{"total":1600000000,"available":1592955435,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.588564"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.476695+0000","last_change":"2024-09-12T02:47:57.476695+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.476695+0000","last_undegraded":"2024-09-12T02:47:57.476695+0000","last_fullsized":"2024-09-12T02:47:57.476695+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.466421+0000","last_change":"2024-09-12T02:47:57.466421+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.466421+0000","last_undegraded":"2024-09-12T02:47:57.466421+0000","last_fullsized":"2024-09-12T02:47:57.466421+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.461550+0000","last_change":"2024-09-12T02:47:57.461550+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.461550+0000","last_undegraded":"2024-09-12T02:47:57.461550+0000","last_fullsized":"2024-09-12T02:47:57.461550+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.474278+0000","last_change":"2024-09-12T02:47:57.474278+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.474278+0000","last_undegraded":"2024-09-12T02:47:57.474278+0000","last_fullsized":"2024-09-12T02:47:57.474278+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.468796+0000","last_change":"2024-09-12T02:47:57.468796+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.468796+0000","last_undegraded":"2024-09-12T02:47:57.468796+0000","last_fullsized":"2024-09-12T02:47:57.468796+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.465027+0000","last_change":"2024-09-12T02:47:57.465027+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.465027+0000","last_undegraded":"2024-09-12T02:47:57.465027+0000","last_fullsized":"2024-09-12T02:47:57.465027+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.466257+0000","last_change":"2024-09-12T02:47:57.466257+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.466257+0000","last_undegraded":"2024-09-12T02:47:57.466257+0000","last_fullsized":"2024-09-12T02:47:57.466257+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.460844+0000","last_change":"2024-09-12T02:47:57.460844+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.460844+0000","last_undegraded":"2024-09-12T02:47:57.460844+0000","last_fullsized":"2024-09-12T02:47:57.460844+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.473951+0000","last_change":"2024-09-12T02:47:57.473951+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.473951+0000","last_undegraded":"2024-09-12T02:47:57.473951+0000","last_fullsized":"2024-09-12T02:47:57.473951+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.474317+0000","last_change":"2024-09-12T02:47:57.474317+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.474317+0000","last_undegraded":"2024-09-12T02:47:57.474317+0000","last_fullsized":"2024-09-12T02:47:57.474317+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.467556+0000","last_change":"2024-09-12T02:47:57.467556+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.467556+0000","last_undegraded":"2024-09-12T02:47:57.467556+0000","last_fullsized":"2024-09-12T02:47:57.467556+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.474755+0000","last_change":"2024-09-12T02:47:57.474755+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.474755+0000","last_undegraded":"2024-09-12T02:47:57.474755+0000","last_fullsized":"2024-09-12T02:47:57.474755+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.461210+0000","last_change":"2024-09-12T02:47:57.461210+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.461210+0000","last_undegraded":"2024-09-12T02:47:57.461210+0000","last_fullsized":"2024-09-12T02:47:57.461210+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.462394+0000","last_change":"2024-09-12T02:47:57.462394+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.462394+0000","last_undegraded":"2024-09-12T02:47:57.462394+0000","last_fullsized":"2024-09-12T02:47:57.462394+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.464976+0000","last_change":"2024-09-12T02:47:57.464976+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.464976+0000","last_undegraded":"2024-09-12T02:47:57.464976+0000","last_fullsized":"2024-09-12T02:47:57.464976+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.476463+0000","last_change":"2024-09-12T02:47:57.476463+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.476463+0000","last_undegraded":"2024-09-12T02:47:57.476463+0000","last_fullsized":"2024-09-12T02:47:57.476463+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.466143+0000","last_change":"2024-09-12T02:47:57.466143+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.466143+0000","last_undegraded":"2024-09-12T02:47:57.466143+0000","last_fullsized":"2024-09-12T02:47:57.466143+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.459896+0000","last_change":"2024-09-12T02:47:57.459896+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.459896+0000","last_undegraded":"2024-09-12T02:47:57.459896+0000","last_fullsized":"2024-09-12T02:47:57.459896+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.462064+0000","last_change":"2024-09-12T02:47:57.462064+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.462064+0000","last_undegraded":"2024-09-12T02:47:57.462064+0000","last_fullsized":"2024-09-12T02:47:57.462064+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.466052+0000","last_change":"2024-09-12T02:47:57.466052+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.466052+0000","last_undegraded":"2024-09-12T02:47:57.466052+0000","last_fullsized":"2024-09-12T02:47:57.466052+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.466810+0000","last_change":"2024-09-12T02:47:57.466810+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.466810+0000","last_undegraded":"2024-09-12T02:47:57.466810+0000","last_fullsized":"2024-09-12T02:47:57.466810+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.460095+0000","last_change":"2024-09-12T02:47:57.460095+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.460095+0000","last_undegraded":"2024-09-12T02:47:57.460095+0000","last_fullsized":"2024-09-12T02:47:57.460095+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.465283+0000","last_change":"2024-09-12T02:47:57.465283+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.465283+0000","last_undegraded":"2024-09-12T02:47:57.465283+0000","last_fullsized":"2024-09-12T02:47:57.465283+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.460163+0000","last_change":"2024-09-12T02:47:57.460163+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.460163+0000","last_undegraded":"2024-09-12T02:47:57.460163+0000","last_fullsized":"2024-09-12T02:47:57.460163+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.465725+0000","last_change":"2024-09-12T02:47:57.465725+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.465725+0000","last_undegraded":"2024-09-12T02:47:57.465725+0000","last_fullsized":"2024-09-12T02:47:57.465725+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.476236+0000","last_change":"2024-09-12T02:47:57.476236+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.476236+0000","last_undegraded":"2024-09-12T02:47:57.476236+0000","last_fullsized":"2024-09-12T02:47:57.476236+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.465221+0000","last_change":"2024-09-12T02:47:57.465221+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.465221+0000","last_undegraded":"2024-09-12T02:47:57.465221+0000","last_fullsized":"2024-09-12T02:47:57.465221+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.459654+0000","last_change":"2024-09-12T02:47:57.459654+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.459654+0000","last_undegraded":"2024-09-12T02:47:57.459654+0000","last_fullsized":"2024-09-12T02:47:57.459654+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.465247+0000","last_change":"2024-09-12T02:47:57.465247+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.465247+0000","last_undegraded":"2024-09-12T02:47:57.465247+0000","last_fullsized":"2024-09-12T02:47:57.465247+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.467431+0000","last_change":"2024-09-12T02:47:57.467431+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.467431+0000","last_undegraded":"2024-09-12T02:47:57.467431+0000","last_fullsized":"2024-09-12T02:47:57.467431+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.475987+0000","last_change":"2024-09-12T02:47:57.475987+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.475987+0000","last_undegraded":"2024-09-12T02:47:57.475987+0000","last_fullsized":"2024-09-12T02:47:57.475987+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.464714+0000","last_change":"2024-09-12T02:47:57.464714+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.464714+0000","last_undegraded":"2024-09-12T02:47:57.464714+0000","last_fullsized":"2024-09-12T02:47:57.464714+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.465269+0000","last_change":"2024-09-12T02:47:57.465269+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.465269+0000","last_undegraded":"2024-09-12T02:47:57.465269+0000","last_fullsized":"2024-09-12T02:47:57.465269+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.469606+0000","last_change":"2024-09-12T02:47:57.468829+0000","last_active":"2024-09-12T02:47:57.469606+0000","last_peered":"2024-09-12T02:47:57.469606+0000","last_clean":"2024-09-12T02:47:57.469606+0000","last_became_active":"2024-09-12T02:47:57.468528+0000","last_became_peered":"2024-09-12T02:47:57.468528+0000","last_unstale":"2024-09-12T02:47:57.469606+0000","last_undegraded":"2024-09-12T02:47:57.469606+0000","last_fullsized":"2024-09-12T02:47:57.469606+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:15.582742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.459536+0000","last_change":"2024-09-12T02:47:57.459536+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.459536+0000","last_undegraded":"2024-09-12T02:47:57.459536+0000","last_fullsized":"2024-09-12T02:47:57.459536+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.469837+0000","last_change":"2024-09-12T02:47:57.469448+0000","last_active":"2024-09-12T02:47:57.469837+0000","last_peered":"2024-09-12T02:47:57.469837+0000","last_clean":"2024-09-12T02:47:57.469837+0000","last_became_active":"2024-09-12T02:47:57.469225+0000","last_became_peered":"2024-09-12T02:47:57.469225+0000","last_unstale":"2024-09-12T02:47:57.469837+0000","last_undegraded":"2024-09-12T02:47:57.469837+0000","last_fullsized":"2024-09-12T02:47:57.469837+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:30.628451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.464691+0000","last_change":"2024-09-12T02:47:57.464691+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.464691+0000","last_undegraded":"2024-09-12T02:47:57.464691+0000","last_fullsized":"2024-09-12T02:47:57.464691+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.471618+0000","last_change":"2024-09-12T02:47:57.471489+0000","last_active":"2024-09-12T02:47:57.471618+0000","last_peered":"2024-09-12T02:47:57.471618+0000","last_clean":"2024-09-12T02:47:57.471618+0000","last_became_active":"2024-09-12T02:47:57.470912+0000","last_became_peered":"2024-09-12T02:47:57.470912+0000","last_unstale":"2024-09-12T02:47:57.471618+0000","last_undegraded":"2024-09-12T02:47:57.471618+0000","last_fullsized":"2024-09-12T02:47:57.471618+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:43.417055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.463379+0000","last_change":"2024-09-12T02:47:57.463379+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.463379+0000","last_undegraded":"2024-09-12T02:47:57.463379+0000","last_fullsized":"2024-09-12T02:47:57.463379+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.471274+0000","last_change":"2024-09-12T02:47:57.471168+0000","last_active":"2024-09-12T02:47:57.471274+0000","last_peered":"2024-09-12T02:47:57.471274+0000","last_clean":"2024-09-12T02:47:57.471274+0000","last_became_active":"2024-09-12T02:47:57.470929+0000","last_became_peered":"2024-09-12T02:47:57.470929+0000","last_unstale":"2024-09-12T02:47:57.471274+0000","last_undegraded":"2024-09-12T02:47:57.471274+0000","last_fullsized":"2024-09-12T02:47:57.471274+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:44.123734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.474815+0000","last_change":"2024-09-12T02:47:57.474815+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.474815+0000","last_undegraded":"2024-09-12T02:47:57.474815+0000","last_fullsized":"2024-09-12T02:47:57.474815+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.470211+0000","last_change":"2024-09-12T02:47:57.470089+0000","last_active":"2024-09-12T02:47:57.470211+0000","last_peered":"2024-09-12T02:47:57.470211+0000","last_clean":"2024-09-12T02:47:57.470211+0000","last_became_active":"2024-09-12T02:47:57.468952+0000","last_became_peered":"2024-09-12T02:47:57.468952+0000","last_unstale":"2024-09-12T02:47:57.470211+0000","last_undegraded":"2024-09-12T02:47:57.470211+0000","last_fullsized":"2024-09-12T02:47:57.470211+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:06.208924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.465601+0000","last_change":"2024-09-12T02:47:57.465601+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.465601+0000","last_undegraded":"2024-09-12T02:47:57.465601+0000","last_fullsized":"2024-09-12T02:47:57.465601+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.465248+0000","last_change":"2024-09-12T02:47:57.464833+0000","last_active":"2024-09-12T02:47:57.465248+0000","last_peered":"2024-09-12T02:47:57.465248+0000","last_clean":"2024-09-12T02:47:57.465248+0000","last_became_active":"2024-09-12T02:47:57.464435+0000","last_became_peered":"2024-09-12T02:47:57.464435+0000","last_unstale":"2024-09-12T02:47:57.465248+0000","last_undegraded":"2024-09-12T02:47:57.465248+0000","last_fullsized":"2024-09-12T02:47:57.465248+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:16.354223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.474011+0000","last_change":"2024-09-12T02:47:57.474011+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.474011+0000","last_undegraded":"2024-09-12T02:47:57.474011+0000","last_fullsized":"2024-09-12T02:47:57.474011+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.460270+0000","last_change":"2024-09-12T02:47:57.460129+0000","last_active":"2024-09-12T02:47:57.460270+0000","last_peered":"2024-09-12T02:47:57.460270+0000","last_clean":"2024-09-12T02:47:57.460270+0000","last_became_active":"2024-09-12T02:47:57.459834+0000","last_became_peered":"2024-09-12T02:47:57.459834+0000","last_unstale":"2024-09-12T02:47:57.460270+0000","last_undegraded":"2024-09-12T02:47:57.460270+0000","last_fullsized":"2024-09-12T02:47:57.460270+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:13:54.124564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.466979+0000","last_change":"2024-09-12T02:47:57.466979+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.466979+0000","last_undegraded":"2024-09-12T02:47:57.466979+0000","last_fullsized":"2024-09-12T02:47:57.466979+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.466048+0000","last_change":"2024-09-12T02:47:57.464663+0000","last_active":"2024-09-12T02:47:57.466048+0000","last_peered":"2024-09-12T02:47:57.466048+0000","last_clean":"2024-09-12T02:47:57.466048+0000","last_became_active":"2024-09-12T02:47:57.464447+0000","last_became_peered":"2024-09-12T02:47:57.464447+0000","last_unstale":"2024-09-12T02:47:57.466048+0000","last_undegraded":"2024-09-12T02:47:57.466048+0000","last_fullsized":"2024-09-12T02:47:57.466048+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:49.097462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.465851+0000","last_change":"2024-09-12T02:47:57.465851+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.465851+0000","last_undegraded":"2024-09-12T02:47:57.465851+0000","last_fullsized":"2024-09-12T02:47:57.465851+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.472963+0000","last_change":"2024-09-12T02:47:57.472855+0000","last_active":"2024-09-12T02:47:57.472963+0000","last_peered":"2024-09-12T02:47:57.472963+0000","last_clean":"2024-09-12T02:47:57.472963+0000","last_became_active":"2024-09-12T02:47:57.472612+0000","last_became_peered":"2024-09-12T02:47:57.472612+0000","last_unstale":"2024-09-12T02:47:57.472963+0000","last_undegraded":"2024-09-12T02:47:57.472963+0000","last_fullsized":"2024-09-12T02:47:57.472963+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:34.290643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.459095+0000","last_change":"2024-09-12T02:47:57.459095+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.459095+0000","last_undegraded":"2024-09-12T02:47:57.459095+0000","last_fullsized":"2024-09-12T02:47:57.459095+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.461735+0000","last_change":"2024-09-12T02:47:57.461370+0000","last_active":"2024-09-12T02:47:57.461735+0000","last_peered":"2024-09-12T02:47:57.461735+0000","last_clean":"2024-09-12T02:47:57.461735+0000","last_became_active":"2024-09-12T02:47:57.461153+0000","last_became_peered":"2024-09-12T02:47:57.461153+0000","last_unstale":"2024-09-12T02:47:57.461735+0000","last_undegraded":"2024-09-12T02:47:57.461735+0000","last_fullsized":"2024-09-12T02:47:57.461735+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:20:17.409691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.459860+0000","last_change":"2024-09-12T02:47:57.459860+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.459860+0000","last_undegraded":"2024-09-12T02:47:57.459860+0000","last_fullsized":"2024-09-12T02:47:57.459860+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.469665+0000","last_change":"2024-09-12T02:47:57.469395+0000","last_active":"2024-09-12T02:47:57.469665+0000","last_peered":"2024-09-12T02:47:57.469665+0000","last_clean":"2024-09-12T02:47:57.469665+0000","last_became_active":"2024-09-12T02:47:57.469170+0000","last_became_peered":"2024-09-12T02:47:57.469170+0000","last_unstale":"2024-09-12T02:47:57.469665+0000","last_undegraded":"2024-09-12T02:47:57.469665+0000","last_fullsized":"2024-09-12T02:47:57.469665+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:40.922897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.466260+0000","last_change":"2024-09-12T02:47:57.466260+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.466260+0000","last_undegraded":"2024-09-12T02:47:57.466260+0000","last_fullsized":"2024-09-12T02:47:57.466260+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.463858+0000","last_change":"2024-09-12T02:47:57.462911+0000","last_active":"2024-09-12T02:47:57.463858+0000","last_peered":"2024-09-12T02:47:57.463858+0000","last_clean":"2024-09-12T02:47:57.463858+0000","last_became_active":"2024-09-12T02:47:57.462658+0000","last_became_peered":"2024-09-12T02:47:57.462658+0000","last_unstale":"2024-09-12T02:47:57.463858+0000","last_undegraded":"2024-09-12T02:47:57.463858+0000","last_fullsized":"2024-09-12T02:47:57.463858+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:54.723350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.459027+0000","last_change":"2024-09-12T02:47:57.459027+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.459027+0000","last_undegraded":"2024-09-12T02:47:57.459027+0000","last_fullsized":"2024-09-12T02:47:57.459027+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.465903+0000","last_change":"2024-09-12T02:47:57.465729+0000","last_active":"2024-09-12T02:47:57.465903+0000","last_peered":"2024-09-12T02:47:57.465903+0000","last_clean":"2024-09-12T02:47:57.465903+0000","last_became_active":"2024-09-12T02:47:57.465502+0000","last_became_peered":"2024-09-12T02:47:57.465502+0000","last_unstale":"2024-09-12T02:47:57.465903+0000","last_undegraded":"2024-09-12T02:47:57.465903+0000","last_fullsized":"2024-09-12T02:47:57.465903+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:13.969193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.459546+0000","last_change":"2024-09-12T02:47:57.459546+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.459546+0000","last_undegraded":"2024-09-12T02:47:57.459546+0000","last_fullsized":"2024-09-12T02:47:57.459546+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.468771+0000","last_change":"2024-09-12T02:47:57.467217+0000","last_active":"2024-09-12T02:47:57.468771+0000","last_peered":"2024-09-12T02:47:57.468771+0000","last_clean":"2024-09-12T02:47:57.468771+0000","last_became_active":"2024-09-12T02:47:57.466879+0000","last_became_peered":"2024-09-12T02:47:57.466879+0000","last_unstale":"2024-09-12T02:47:57.468771+0000","last_undegraded":"2024-09-12T02:47:57.468771+0000","last_fullsized":"2024-09-12T02:47:57.468771+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:52.134159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.458945+0000","last_change":"2024-09-12T02:47:57.458945+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.458945+0000","last_undegraded":"2024-09-12T02:47:57.458945+0000","last_fullsized":"2024-09-12T02:47:57.458945+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.470418+0000","last_change":"2024-09-12T02:47:57.470285+0000","last_active":"2024-09-12T02:47:57.470418+0000","last_peered":"2024-09-12T02:47:57.470418+0000","last_clean":"2024-09-12T02:47:57.470418+0000","last_became_active":"2024-09-12T02:47:57.469886+0000","last_became_peered":"2024-09-12T02:47:57.469886+0000","last_unstale":"2024-09-12T02:47:57.470418+0000","last_undegraded":"2024-09-12T02:47:57.470418+0000","last_fullsized":"2024-09-12T02:47:57.470418+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:25.856210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.468386+0000","last_change":"2024-09-12T02:47:57.468386+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.468386+0000","last_undegraded":"2024-09-12T02:47:57.468386+0000","last_fullsized":"2024-09-12T02:47:57.468386+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.467184+0000","last_change":"2024-09-12T02:47:57.466554+0000","last_active":"2024-09-12T02:47:57.467184+0000","last_peered":"2024-09-12T02:47:57.467184+0000","last_clean":"2024-09-12T02:47:57.467184+0000","last_became_active":"2024-09-12T02:47:57.466337+0000","last_became_peered":"2024-09-12T02:47:57.466337+0000","last_unstale":"2024-09-12T02:47:57.467184+0000","last_undegraded":"2024-09-12T02:47:57.467184+0000","last_fullsized":"2024-09-12T02:47:57.467184+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:31.242304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.464715+0000","last_change":"2024-09-12T02:47:57.464715+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.464715+0000","last_undegraded":"2024-09-12T02:47:57.464715+0000","last_fullsized":"2024-09-12T02:47:57.464715+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.471598+0000","last_change":"2024-09-12T02:47:57.471259+0000","last_active":"2024-09-12T02:47:57.471598+0000","last_peered":"2024-09-12T02:47:57.471598+0000","last_clean":"2024-09-12T02:47:57.471598+0000","last_became_active":"2024-09-12T02:47:57.470578+0000","last_became_peered":"2024-09-12T02:47:57.470578+0000","last_unstale":"2024-09-12T02:47:57.471598+0000","last_undegraded":"2024-09-12T02:47:57.471598+0000","last_fullsized":"2024-09-12T02:47:57.471598+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:39.353650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.463078+0000","last_change":"2024-09-12T02:47:57.463078+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.463078+0000","last_undegraded":"2024-09-12T02:47:57.463078+0000","last_fullsized":"2024-09-12T02:47:57.463078+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.461896+0000","last_change":"2024-09-12T02:47:57.461685+0000","last_active":"2024-09-12T02:47:57.461896+0000","last_peered":"2024-09-12T02:47:57.461896+0000","last_clean":"2024-09-12T02:47:57.461896+0000","last_became_active":"2024-09-12T02:47:57.461464+0000","last_became_peered":"2024-09-12T02:47:57.461464+0000","last_unstale":"2024-09-12T02:47:57.461896+0000","last_undegraded":"2024-09-12T02:47:57.461896+0000","last_fullsized":"2024-09-12T02:47:57.461896+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:03.929744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.463575+0000","last_change":"2024-09-12T02:47:57.463575+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.463575+0000","last_undegraded":"2024-09-12T02:47:57.463575+0000","last_fullsized":"2024-09-12T02:47:57.463575+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.470622+0000","last_change":"2024-09-12T02:47:57.470460+0000","last_active":"2024-09-12T02:47:57.470622+0000","last_peered":"2024-09-12T02:47:57.470622+0000","last_clean":"2024-09-12T02:47:57.470622+0000","last_became_active":"2024-09-12T02:47:57.469717+0000","last_became_peered":"2024-09-12T02:47:57.469717+0000","last_unstale":"2024-09-12T02:47:57.470622+0000","last_undegraded":"2024-09-12T02:47:57.470622+0000","last_fullsized":"2024-09-12T02:47:57.470622+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:04.620534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.461405+0000","last_change":"2024-09-12T02:47:57.461405+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.461405+0000","last_undegraded":"2024-09-12T02:47:57.461405+0000","last_fullsized":"2024-09-12T02:47:57.461405+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.471172+0000","last_change":"2024-09-12T02:47:57.471049+0000","last_active":"2024-09-12T02:47:57.471172+0000","last_peered":"2024-09-12T02:47:57.471172+0000","last_clean":"2024-09-12T02:47:57.471172+0000","last_became_active":"2024-09-12T02:47:57.470590+0000","last_became_peered":"2024-09-12T02:47:57.470590+0000","last_unstale":"2024-09-12T02:47:57.471172+0000","last_undegraded":"2024-09-12T02:47:57.471172+0000","last_fullsized":"2024-09-12T02:47:57.471172+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:59.215762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.474223+0000","last_change":"2024-09-12T02:47:57.474223+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.474223+0000","last_undegraded":"2024-09-12T02:47:57.474223+0000","last_fullsized":"2024-09-12T02:47:57.474223+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.469670+0000","last_change":"2024-09-12T02:47:57.469255+0000","last_active":"2024-09-12T02:47:57.469670+0000","last_peered":"2024-09-12T02:47:57.469670+0000","last_clean":"2024-09-12T02:47:57.469670+0000","last_became_active":"2024-09-12T02:47:57.468941+0000","last_became_peered":"2024-09-12T02:47:57.468941+0000","last_unstale":"2024-09-12T02:47:57.469670+0000","last_undegraded":"2024-09-12T02:47:57.469670+0000","last_fullsized":"2024-09-12T02:47:57.469670+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:38.759737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.463260+0000","last_change":"2024-09-12T02:47:57.463260+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.463260+0000","last_undegraded":"2024-09-12T02:47:57.463260+0000","last_fullsized":"2024-09-12T02:47:57.463260+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.470554+0000","last_change":"2024-09-12T02:47:57.470430+0000","last_active":"2024-09-12T02:47:57.470554+0000","last_peered":"2024-09-12T02:47:57.470554+0000","last_clean":"2024-09-12T02:47:57.470554+0000","last_became_active":"2024-09-12T02:47:57.470194+0000","last_became_peered":"2024-09-12T02:47:57.470194+0000","last_unstale":"2024-09-12T02:47:57.470554+0000","last_undegraded":"2024-09-12T02:47:57.470554+0000","last_fullsized":"2024-09-12T02:47:57.470554+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:58.910839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.458947+0000","last_change":"2024-09-12T02:47:57.458947+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.458947+0000","last_undegraded":"2024-09-12T02:47:57.458947+0000","last_fullsized":"2024-09-12T02:47:57.458947+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.473379+0000","last_change":"2024-09-12T02:47:57.472550+0000","last_active":"2024-09-12T02:47:57.473379+0000","last_peered":"2024-09-12T02:47:57.473379+0000","last_clean":"2024-09-12T02:47:57.473379+0000","last_became_active":"2024-09-12T02:47:57.472338+0000","last_became_peered":"2024-09-12T02:47:57.472338+0000","last_unstale":"2024-09-12T02:47:57.473379+0000","last_undegraded":"2024-09-12T02:47:57.473379+0000","last_fullsized":"2024-09-12T02:47:57.473379+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:34.101075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.459081+0000","last_change":"2024-09-12T02:47:57.459081+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.459081+0000","last_undegraded":"2024-09-12T02:47:57.459081+0000","last_fullsized":"2024-09-12T02:47:57.459081+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.462662+0000","last_change":"2024-09-12T02:47:57.462356+0000","last_active":"2024-09-12T02:47:57.462662+0000","last_peered":"2024-09-12T02:47:57.462662+0000","last_clean":"2024-09-12T02:47:57.462662+0000","last_became_active":"2024-09-12T02:47:57.461958+0000","last_became_peered":"2024-09-12T02:47:57.461958+0000","last_unstale":"2024-09-12T02:47:57.462662+0000","last_undegraded":"2024-09-12T02:47:57.462662+0000","last_fullsized":"2024-09-12T02:47:57.462662+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:48.667688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.474042+0000","last_change":"2024-09-12T02:47:57.474042+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.474042+0000","last_undegraded":"2024-09-12T02:47:57.474042+0000","last_fullsized":"2024-09-12T02:47:57.474042+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.465143+0000","last_change":"2024-09-12T02:47:57.464602+0000","last_active":"2024-09-12T02:47:57.465143+0000","last_peered":"2024-09-12T02:47:57.465143+0000","last_clean":"2024-09-12T02:47:57.465143+0000","last_became_active":"2024-09-12T02:47:57.464369+0000","last_became_peered":"2024-09-12T02:47:57.464369+0000","last_unstale":"2024-09-12T02:47:57.465143+0000","last_undegraded":"2024-09-12T02:47:57.465143+0000","last_fullsized":"2024-09-12T02:47:57.465143+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:38.141272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.473675+0000","last_change":"2024-09-12T02:47:57.473675+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.473675+0000","last_undegraded":"2024-09-12T02:47:57.473675+0000","last_fullsized":"2024-09-12T02:47:57.473675+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.473398+0000","last_change":"2024-09-12T02:47:57.473286+0000","last_active":"2024-09-12T02:47:57.473398+0000","last_peered":"2024-09-12T02:47:57.473398+0000","last_clean":"2024-09-12T02:47:57.473398+0000","last_became_active":"2024-09-12T02:47:57.472708+0000","last_became_peered":"2024-09-12T02:47:57.472708+0000","last_unstale":"2024-09-12T02:47:57.473398+0000","last_undegraded":"2024-09-12T02:47:57.473398+0000","last_fullsized":"2024-09-12T02:47:57.473398+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:12.522553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.459085+0000","last_change":"2024-09-12T02:47:57.459085+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.459085+0000","last_undegraded":"2024-09-12T02:47:57.459085+0000","last_fullsized":"2024-09-12T02:47:57.459085+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.465227+0000","last_change":"2024-09-12T02:47:57.464547+0000","last_active":"2024-09-12T02:47:57.465227+0000","last_peered":"2024-09-12T02:47:57.465227+0000","last_clean":"2024-09-12T02:47:57.465227+0000","last_became_active":"2024-09-12T02:47:57.464317+0000","last_became_peered":"2024-09-12T02:47:57.464317+0000","last_unstale":"2024-09-12T02:47:57.465227+0000","last_undegraded":"2024-09-12T02:47:57.465227+0000","last_fullsized":"2024-09-12T02:47:57.465227+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:50.823737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.465188+0000","last_change":"2024-09-12T02:47:57.465188+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.465188+0000","last_undegraded":"2024-09-12T02:47:57.465188+0000","last_fullsized":"2024-09-12T02:47:57.465188+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.469623+0000","last_change":"2024-09-12T02:47:57.469200+0000","last_active":"2024-09-12T02:47:57.469623+0000","last_peered":"2024-09-12T02:47:57.469623+0000","last_clean":"2024-09-12T02:47:57.469623+0000","last_became_active":"2024-09-12T02:47:57.468940+0000","last_became_peered":"2024-09-12T02:47:57.468940+0000","last_unstale":"2024-09-12T02:47:57.469623+0000","last_undegraded":"2024-09-12T02:47:57.469623+0000","last_fullsized":"2024-09-12T02:47:57.469623+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:49.689069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.466457+0000","last_change":"2024-09-12T02:47:57.466457+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.466457+0000","last_undegraded":"2024-09-12T02:47:57.466457+0000","last_fullsized":"2024-09-12T02:47:57.466457+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.465346+0000","last_change":"2024-09-12T02:47:57.464715+0000","last_active":"2024-09-12T02:47:57.465346+0000","last_peered":"2024-09-12T02:47:57.465346+0000","last_clean":"2024-09-12T02:47:57.465346+0000","last_became_active":"2024-09-12T02:47:57.464428+0000","last_became_peered":"2024-09-12T02:47:57.464428+0000","last_unstale":"2024-09-12T02:47:57.465346+0000","last_undegraded":"2024-09-12T02:47:57.465346+0000","last_fullsized":"2024-09-12T02:47:57.465346+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:55.175341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.461731+0000","last_change":"2024-09-12T02:47:57.461731+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.461731+0000","last_undegraded":"2024-09-12T02:47:57.461731+0000","last_fullsized":"2024-09-12T02:47:57.461731+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.469649+0000","last_change":"2024-09-12T02:47:57.469237+0000","last_active":"2024-09-12T02:47:57.469649+0000","last_peered":"2024-09-12T02:47:57.469649+0000","last_clean":"2024-09-12T02:47:57.469649+0000","last_became_active":"2024-09-12T02:47:57.468975+0000","last_became_peered":"2024-09-12T02:47:57.468975+0000","last_unstale":"2024-09-12T02:47:57.469649+0000","last_undegraded":"2024-09-12T02:47:57.469649+0000","last_fullsized":"2024-09-12T02:47:57.469649+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:29.149850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.473826+0000","last_change":"2024-09-12T02:47:57.473826+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.473826+0000","last_undegraded":"2024-09-12T02:47:57.473826+0000","last_fullsized":"2024-09-12T02:47:57.473826+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.473604+0000","last_change":"2024-09-12T02:47:57.473483+0000","last_active":"2024-09-12T02:47:57.473604+0000","last_peered":"2024-09-12T02:47:57.473604+0000","last_clean":"2024-09-12T02:47:57.473604+0000","last_became_active":"2024-09-12T02:47:57.473031+0000","last_became_peered":"2024-09-12T02:47:57.473031+0000","last_unstale":"2024-09-12T02:47:57.473604+0000","last_undegraded":"2024-09-12T02:47:57.473604+0000","last_fullsized":"2024-09-12T02:47:57.473604+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:51.598344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-12T02:47:57.458955+0000","last_change":"2024-09-12T02:47:57.458955+0000","last_active":"2024-09-12T02:47:57.449790+0000","last_peered":"2024-09-12T02:47:57.449790+0000","last_clean":"2024-09-12T02:47:57.449790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:47:57.458955+0000","last_undegraded":"2024-09-12T02:47:57.458955+0000","last_fullsized":"2024-09-12T02:47:57.458955+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.470382+0000","last_change":"2024-09-12T02:47:57.470279+0000","last_active":"2024-09-12T02:47:57.470382+0000","last_peered":"2024-09-12T02:47:57.470382+0000","last_clean":"2024-09-12T02:47:57.470382+0000","last_became_active":"2024-09-12T02:47:57.469397+0000","last_became_peered":"2024-09-12T02:47:57.469397+0000","last_unstale":"2024-09-12T02:47:57.470382+0000","last_undegraded":"2024-09-12T02:47:57.470382+0000","last_fullsized":"2024-09-12T02:47:57.470382+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:40.936288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":390,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-12T02:47:57.465041+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:47:57.465041+0000","last_peered":"2024-09-12T02:47:57.465041+0000","last_clean":"2024-09-12T02:47:57.465041+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:47:57.465041+0000","last_undegraded":"2024-09-12T02:47:57.465041+0000","last_fullsized":"2024-09-12T02:47:57.465041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:25.823876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574925,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1293,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194019,"statfs":{"total":200000000,"available":198675869,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574925,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":716,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194595,"statfs":{"total":200000000,"available":199266237,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":716,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194595,"statfs":{"total":200000000,"available":199266237,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":716,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194595,"statfs":{"total":200000000,"available":199266237,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":716,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194595,"statfs":{"total":200000000,"available":199266237,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194602,"statfs":{"total":200000000,"available":199272512,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":716,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194595,"statfs":{"total":200000000,"available":199266237,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574925,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1293,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194019,"statfs":{"total":200000000,"available":198675869,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:48:03.043 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:48:03.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.231+0000 7f040a800640 1 Processor -- start 2024-09-12T02:48:03.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.231+0000 7f040a800640 1 -- start start 2024-09-12T02:48:03.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.232+0000 7f040a800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0404161c40 0x7f040415f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:03.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.232+0000 7f040a800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f04040b4180 0x7f040415fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:03.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.232+0000 7f040a800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0404073ab0 con 0x7f040415f3b0 2024-09-12T02:48:03.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.232+0000 7f040a800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f04041607a0 con 0x7f0404161c40 2024-09-12T02:48:03.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.232+0000 7f040a800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0404160210 con 0x7f04040b4180 2024-09-12T02:48:03.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.232+0000 7f0408a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0404161c40 0x7f040415f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:03.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.232+0000 7f0408a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0404161c40 0x7f040415f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34358/0 (socket says 172.21.15.112:34358) 2024-09-12T02:48:03.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.232+0000 7f0408a00640 1 -- 172.21.15.112:0/624243696 learned_addr learned my addr 172.21.15.112:0/624243696 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:03.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.232+0000 7f0408a00640 1 -- 172.21.15.112:0/624243696 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f04040b4180 msgr2=0x7f040415fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:03.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.232+0000 7f0408a00640 1 --2- 172.21.15.112:0/624243696 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f04040b4180 0x7f040415fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:03.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.233+0000 7f0408a00640 1 -- 172.21.15.112:0/624243696 >> v1:172.21.15.137:6789/0 conn(0x7f040415f3b0 legacy=0x7f04040732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:03.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.233+0000 7f0408a00640 1 -- 172.21.15.112:0/624243696 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0404073d90 con 0x7f0404161c40 2024-09-12T02:48:03.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.233+0000 7f0408a00640 1 --2- 172.21.15.112:0/624243696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0404161c40 0x7f040415f790 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f03f0009870 tx=0x7f03f002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86d640a49d41b7f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:03.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.234+0000 7f0403e00640 1 -- 172.21.15.112:0/624243696 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f0037070 con 0x7f0404161c40 2024-09-12T02:48:03.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.234+0000 7f0403e00640 1 -- 172.21.15.112:0/624243696 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03f0032440 con 0x7f0404161c40 2024-09-12T02:48:03.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.234+0000 7f0403e00640 1 -- 172.21.15.112:0/624243696 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f0032810 con 0x7f0404161c40 2024-09-12T02:48:03.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.234+0000 7f040a800640 1 -- 172.21.15.112:0/624243696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0404161c40 msgr2=0x7f040415f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:03.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.234+0000 7f040a800640 1 --2- 172.21.15.112:0/624243696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0404161c40 0x7f040415f790 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f03f0009870 tx=0x7f03f002a180 comp rx=0 tx=0).stop 2024-09-12T02:48:03.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.234+0000 7f040a800640 1 -- 172.21.15.112:0/624243696 shutdown_connections 2024-09-12T02:48:03.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.234+0000 7f040a800640 1 --2- 172.21.15.112:0/624243696 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f04040b4180 0x7f040415fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:03.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.234+0000 7f040a800640 1 --2- 172.21.15.112:0/624243696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0404161c40 0x7f040415f790 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:03.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.234+0000 7f040a800640 1 -- 172.21.15.112:0/624243696 >> 172.21.15.112:0/624243696 conn(0x7f0404072420 msgr2=0x7f04040b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:03.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.234+0000 7f040a800640 1 -- 172.21.15.112:0/624243696 shutdown_connections 2024-09-12T02:48:03.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.235+0000 7f040a800640 1 -- 172.21.15.112:0/624243696 wait complete. 2024-09-12T02:48:03.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.236+0000 7f040a800640 1 Processor -- start 2024-09-12T02:48:03.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.236+0000 7f040a800640 1 -- start start 2024-09-12T02:48:03.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.237+0000 7f040a800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04040b4180 0x7f040415e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:03.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.237+0000 7f040a800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f040415f3b0 0x7f04040b12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:03.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.237+0000 7f040a800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0404161c40 0x7f04040af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:03.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.237+0000 7f040a800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0404168ae0 con 0x7f0404161c40 2024-09-12T02:48:03.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.237+0000 7f040a800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0404168960 con 0x7f04040b4180 2024-09-12T02:48:03.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.237+0000 7f040a800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0404168c60 con 0x7f040415f3b0 2024-09-12T02:48:03.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.237+0000 7f0409e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0404161c40 0x7f04040af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:03.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.237+0000 7f0409e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0404161c40 0x7f04040af8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34372/0 (socket says 172.21.15.112:34372) 2024-09-12T02:48:03.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.237+0000 7f0409e00640 1 -- 172.21.15.112:0/571814272 learned_addr learned my addr 172.21.15.112:0/571814272 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:03.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.237+0000 7f0408a00640 1 --2- 172.21.15.112:0/571814272 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f040415f3b0 0x7f04040b12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:03.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.237+0000 7f0409400640 1 --2- 172.21.15.112:0/571814272 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04040b4180 0x7f040415e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:03.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.238+0000 7f0409e00640 1 -- 172.21.15.112:0/571814272 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f040415f3b0 msgr2=0x7f04040b12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:03.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.238+0000 7f0409e00640 1 --2- 172.21.15.112:0/571814272 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f040415f3b0 0x7f04040b12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:03.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.238+0000 7f0409e00640 1 -- 172.21.15.112:0/571814272 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04040b4180 msgr2=0x7f040415e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:03.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.238+0000 7f0409e00640 1 --2- 172.21.15.112:0/571814272 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04040b4180 0x7f040415e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:03.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.238+0000 7f0409e00640 1 -- 172.21.15.112:0/571814272 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f040415ee80 con 0x7f0404161c40 2024-09-12T02:48:03.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.238+0000 7f0409400640 1 --2- 172.21.15.112:0/571814272 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04040b4180 0x7f040415e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:03.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.238+0000 7f0409e00640 1 --2- 172.21.15.112:0/571814272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0404161c40 0x7f04040af8f0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00b970 tx=0x7f03fc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:03.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.238+0000 7f0401600640 1 -- 172.21.15.112:0/571814272 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc019070 con 0x7f0404161c40 2024-09-12T02:48:03.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.238+0000 7f0401600640 1 -- 172.21.15.112:0/571814272 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03fc00cb60 con 0x7f0404161c40 2024-09-12T02:48:03.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.238+0000 7f040a800640 1 -- 172.21.15.112:0/571814272 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04040aeb30 con 0x7f0404161c40 2024-09-12T02:48:03.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.238+0000 7f0401600640 1 -- 172.21.15.112:0/571814272 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc014440 con 0x7f0404161c40 2024-09-12T02:48:03.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.238+0000 7f040a800640 1 -- 172.21.15.112:0/571814272 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04040af0f0 con 0x7f0404161c40 2024-09-12T02:48:03.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.239+0000 7f040a800640 1 -- 172.21.15.112:0/571814272 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04040732d0 con 0x7f0404161c40 2024-09-12T02:48:03.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.240+0000 7f0401600640 1 -- 172.21.15.112:0/571814272 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f03fc01c070 con 0x7f0404161c40 2024-09-12T02:48:03.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.241+0000 7f0401600640 1 --2- 172.21.15.112:0/571814272 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f03e406be60 0x7f03e406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:03.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.241+0000 7f0401600640 1 -- 172.21.15.112:0/571814272 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f03fc08ab90 con 0x7f0404161c40 2024-09-12T02:48:03.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.241+0000 7f0409400640 1 --2- 172.21.15.112:0/571814272 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f03e406be60 0x7f03e406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:03.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.242+0000 7f0409400640 1 --2- 172.21.15.112:0/571814272 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f03e406be60 0x7f03e406e320 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f040415bcf0 tx=0x7f03f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:03.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.245+0000 7f0401600640 1 -- 172.21.15.112:0/571814272 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f03fc058e50 con 0x7f0404161c40 2024-09-12T02:48:03.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.414+0000 7f040a800640 1 -- 172.21.15.112:0/571814272 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0404158ab0 con 0x7f03e406be60 2024-09-12T02:48:03.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.420+0000 7f0401600640 1 -- 172.21.15.112:0/571814272 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247993 (secure 0 0 0) 0x7f0404158ab0 con 0x7f03e406be60 2024-09-12T02:48:03.425 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:03.426 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:48:03.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.424+0000 7f040a800640 1 -- 172.21.15.112:0/571814272 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f03e406be60 msgr2=0x7f03e406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:03.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.424+0000 7f040a800640 1 --2- 172.21.15.112:0/571814272 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f03e406be60 0x7f03e406e320 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f040415bcf0 tx=0x7f03f8009040 comp rx=0 tx=0).stop 2024-09-12T02:48:03.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.424+0000 7f040a800640 1 -- 172.21.15.112:0/571814272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0404161c40 msgr2=0x7f04040af8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:03.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.424+0000 7f040a800640 1 --2- 172.21.15.112:0/571814272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0404161c40 0x7f04040af8f0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00b970 tx=0x7f03fc00be30 comp rx=0 tx=0).stop 2024-09-12T02:48:03.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.424+0000 7f040a800640 1 -- 172.21.15.112:0/571814272 shutdown_connections 2024-09-12T02:48:03.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.424+0000 7f040a800640 1 --2- 172.21.15.112:0/571814272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0404161c40 0x7f04040af8f0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:03.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.424+0000 7f040a800640 1 --2- 172.21.15.112:0/571814272 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f040415f3b0 0x7f04040b12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:03.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.424+0000 7f040a800640 1 --2- 172.21.15.112:0/571814272 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f03e406be60 0x7f03e406e320 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:03.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.424+0000 7f040a800640 1 --2- 172.21.15.112:0/571814272 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04040b4180 0x7f040415e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:03.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.424+0000 7f040a800640 1 -- 172.21.15.112:0/571814272 >> 172.21.15.112:0/571814272 conn(0x7f0404072420 msgr2=0x7f040406f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:03.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.424+0000 7f040a800640 1 -- 172.21.15.112:0/571814272 shutdown_connections 2024-09-12T02:48:03.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.424+0000 7f040a800640 1 -- 172.21.15.112:0/571814272 wait complete. 2024-09-12T02:48:03.443 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2024-09-12T02:48:03.038965+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6992,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555507,"statfs":{"total":1600000000,"available":1592839740,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001108"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657251+0000","last_change":"2024-09-12T02:47:58.492135+0000","last_active":"2024-09-12T02:47:59.657251+0000","last_peered":"2024-09-12T02:47:59.657251+0000","last_clean":"2024-09-12T02:47:59.657251+0000","last_became_active":"2024-09-12T02:47:58.491680+0000","last_became_peered":"2024-09-12T02:47:58.491680+0000","last_unstale":"2024-09-12T02:47:59.657251+0000","last_undegraded":"2024-09-12T02:47:59.657251+0000","last_fullsized":"2024-09-12T02:47:59.657251+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:26.430586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658165+0000","last_change":"2024-09-12T02:47:58.477458+0000","last_active":"2024-09-12T02:47:59.658165+0000","last_peered":"2024-09-12T02:47:59.658165+0000","last_clean":"2024-09-12T02:47:59.658165+0000","last_became_active":"2024-09-12T02:47:58.476214+0000","last_became_peered":"2024-09-12T02:47:58.476214+0000","last_unstale":"2024-09-12T02:47:59.658165+0000","last_undegraded":"2024-09-12T02:47:59.658165+0000","last_fullsized":"2024-09-12T02:47:59.658165+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:54.320063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657896+0000","last_change":"2024-09-12T02:47:58.468795+0000","last_active":"2024-09-12T02:47:59.657896+0000","last_peered":"2024-09-12T02:47:59.657896+0000","last_clean":"2024-09-12T02:47:59.657896+0000","last_became_active":"2024-09-12T02:47:58.468454+0000","last_became_peered":"2024-09-12T02:47:58.468454+0000","last_unstale":"2024-09-12T02:47:59.657896+0000","last_undegraded":"2024-09-12T02:47:59.657896+0000","last_fullsized":"2024-09-12T02:47:59.657896+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:17.276167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657230+0000","last_change":"2024-09-12T02:47:58.491774+0000","last_active":"2024-09-12T02:47:59.657230+0000","last_peered":"2024-09-12T02:47:59.657230+0000","last_clean":"2024-09-12T02:47:59.657230+0000","last_became_active":"2024-09-12T02:47:58.491423+0000","last_became_peered":"2024-09-12T02:47:58.491423+0000","last_unstale":"2024-09-12T02:47:59.657230+0000","last_undegraded":"2024-09-12T02:47:59.657230+0000","last_fullsized":"2024-09-12T02:47:59.657230+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:19:21.593656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657006+0000","last_change":"2024-09-12T02:47:58.478400+0000","last_active":"2024-09-12T02:47:59.657006+0000","last_peered":"2024-09-12T02:47:59.657006+0000","last_clean":"2024-09-12T02:47:59.657006+0000","last_became_active":"2024-09-12T02:47:58.478019+0000","last_became_peered":"2024-09-12T02:47:58.478019+0000","last_unstale":"2024-09-12T02:47:59.657006+0000","last_undegraded":"2024-09-12T02:47:59.657006+0000","last_fullsized":"2024-09-12T02:47:59.657006+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:58.214916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.463737+0000","last_change":"2024-09-12T02:47:58.477253+0000","last_active":"2024-09-12T02:47:59.463737+0000","last_peered":"2024-09-12T02:47:59.463737+0000","last_clean":"2024-09-12T02:47:59.463737+0000","last_became_active":"2024-09-12T02:47:58.477009+0000","last_became_peered":"2024-09-12T02:47:58.477009+0000","last_unstale":"2024-09-12T02:47:59.463737+0000","last_undegraded":"2024-09-12T02:47:59.463737+0000","last_fullsized":"2024-09-12T02:47:59.463737+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:45.176382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657891+0000","last_change":"2024-09-12T02:47:58.477989+0000","last_active":"2024-09-12T02:47:59.657891+0000","last_peered":"2024-09-12T02:47:59.657891+0000","last_clean":"2024-09-12T02:47:59.657891+0000","last_became_active":"2024-09-12T02:47:58.475236+0000","last_became_peered":"2024-09-12T02:47:58.475236+0000","last_unstale":"2024-09-12T02:47:59.657891+0000","last_undegraded":"2024-09-12T02:47:59.657891+0000","last_fullsized":"2024-09-12T02:47:59.657891+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:40.211187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658254+0000","last_change":"2024-09-12T02:47:58.475403+0000","last_active":"2024-09-12T02:47:59.658254+0000","last_peered":"2024-09-12T02:47:59.658254+0000","last_clean":"2024-09-12T02:47:59.658254+0000","last_became_active":"2024-09-12T02:47:58.473895+0000","last_became_peered":"2024-09-12T02:47:58.473895+0000","last_unstale":"2024-09-12T02:47:59.658254+0000","last_undegraded":"2024-09-12T02:47:59.658254+0000","last_fullsized":"2024-09-12T02:47:59.658254+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:57.448789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657370+0000","last_change":"2024-09-12T02:47:58.494247+0000","last_active":"2024-09-12T02:47:59.657370+0000","last_peered":"2024-09-12T02:47:59.657370+0000","last_clean":"2024-09-12T02:47:59.657370+0000","last_became_active":"2024-09-12T02:47:58.493866+0000","last_became_peered":"2024-09-12T02:47:58.493866+0000","last_unstale":"2024-09-12T02:47:59.657370+0000","last_undegraded":"2024-09-12T02:47:59.657370+0000","last_fullsized":"2024-09-12T02:47:59.657370+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:19.869905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657495+0000","last_change":"2024-09-12T02:47:58.487407+0000","last_active":"2024-09-12T02:47:59.657495+0000","last_peered":"2024-09-12T02:47:59.657495+0000","last_clean":"2024-09-12T02:47:59.657495+0000","last_became_active":"2024-09-12T02:47:58.487130+0000","last_became_peered":"2024-09-12T02:47:58.487130+0000","last_unstale":"2024-09-12T02:47:59.657495+0000","last_undegraded":"2024-09-12T02:47:59.657495+0000","last_fullsized":"2024-09-12T02:47:59.657495+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:56.734899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658956+0000","last_change":"2024-09-12T02:47:58.477375+0000","last_active":"2024-09-12T02:47:59.658956+0000","last_peered":"2024-09-12T02:47:59.658956+0000","last_clean":"2024-09-12T02:47:59.658956+0000","last_became_active":"2024-09-12T02:47:58.477129+0000","last_became_peered":"2024-09-12T02:47:58.477129+0000","last_unstale":"2024-09-12T02:47:59.658956+0000","last_undegraded":"2024-09-12T02:47:59.658956+0000","last_fullsized":"2024-09-12T02:47:59.658956+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:56.155548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657840+0000","last_change":"2024-09-12T02:47:58.487917+0000","last_active":"2024-09-12T02:47:59.657840+0000","last_peered":"2024-09-12T02:47:59.657840+0000","last_clean":"2024-09-12T02:47:59.657840+0000","last_became_active":"2024-09-12T02:47:58.487209+0000","last_became_peered":"2024-09-12T02:47:58.487209+0000","last_unstale":"2024-09-12T02:47:59.657840+0000","last_undegraded":"2024-09-12T02:47:59.657840+0000","last_fullsized":"2024-09-12T02:47:59.657840+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:57.757944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658051+0000","last_change":"2024-09-12T02:47:58.470300+0000","last_active":"2024-09-12T02:47:59.658051+0000","last_peered":"2024-09-12T02:47:59.658051+0000","last_clean":"2024-09-12T02:47:59.658051+0000","last_became_active":"2024-09-12T02:47:58.470038+0000","last_became_peered":"2024-09-12T02:47:58.470038+0000","last_unstale":"2024-09-12T02:47:59.658051+0000","last_undegraded":"2024-09-12T02:47:59.658051+0000","last_fullsized":"2024-09-12T02:47:59.658051+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:48.667360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657677+0000","last_change":"2024-09-12T02:47:58.476633+0000","last_active":"2024-09-12T02:47:59.657677+0000","last_peered":"2024-09-12T02:47:59.657677+0000","last_clean":"2024-09-12T02:47:59.657677+0000","last_became_active":"2024-09-12T02:47:58.474938+0000","last_became_peered":"2024-09-12T02:47:58.474938+0000","last_unstale":"2024-09-12T02:47:59.657677+0000","last_undegraded":"2024-09-12T02:47:59.657677+0000","last_fullsized":"2024-09-12T02:47:59.657677+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:00.907949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.463868+0000","last_change":"2024-09-12T02:47:58.483802+0000","last_active":"2024-09-12T02:47:59.463868+0000","last_peered":"2024-09-12T02:47:59.463868+0000","last_clean":"2024-09-12T02:47:59.463868+0000","last_became_active":"2024-09-12T02:47:58.483459+0000","last_became_peered":"2024-09-12T02:47:58.483459+0000","last_unstale":"2024-09-12T02:47:59.463868+0000","last_undegraded":"2024-09-12T02:47:59.463868+0000","last_fullsized":"2024-09-12T02:47:59.463868+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:26.223275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657372+0000","last_change":"2024-09-12T02:47:58.491943+0000","last_active":"2024-09-12T02:47:59.657372+0000","last_peered":"2024-09-12T02:47:59.657372+0000","last_clean":"2024-09-12T02:47:59.657372+0000","last_became_active":"2024-09-12T02:47:58.491252+0000","last_became_peered":"2024-09-12T02:47:58.491252+0000","last_unstale":"2024-09-12T02:47:59.657372+0000","last_undegraded":"2024-09-12T02:47:59.657372+0000","last_fullsized":"2024-09-12T02:47:59.657372+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:19.080926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658301+0000","last_change":"2024-09-12T02:47:58.476466+0000","last_active":"2024-09-12T02:47:59.658301+0000","last_peered":"2024-09-12T02:47:59.658301+0000","last_clean":"2024-09-12T02:47:59.658301+0000","last_became_active":"2024-09-12T02:47:58.475872+0000","last_became_peered":"2024-09-12T02:47:58.475872+0000","last_unstale":"2024-09-12T02:47:59.658301+0000","last_undegraded":"2024-09-12T02:47:59.658301+0000","last_fullsized":"2024-09-12T02:47:59.658301+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:32.305254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462073+0000","last_change":"2024-09-12T02:47:58.473684+0000","last_active":"2024-09-12T02:47:59.462073+0000","last_peered":"2024-09-12T02:47:59.462073+0000","last_clean":"2024-09-12T02:47:59.462073+0000","last_became_active":"2024-09-12T02:47:58.473456+0000","last_became_peered":"2024-09-12T02:47:58.473456+0000","last_unstale":"2024-09-12T02:47:59.462073+0000","last_undegraded":"2024-09-12T02:47:59.462073+0000","last_fullsized":"2024-09-12T02:47:59.462073+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:16.638630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657817+0000","last_change":"2024-09-12T02:47:58.471241+0000","last_active":"2024-09-12T02:47:59.657817+0000","last_peered":"2024-09-12T02:47:59.657817+0000","last_clean":"2024-09-12T02:47:59.657817+0000","last_became_active":"2024-09-12T02:47:58.470755+0000","last_became_peered":"2024-09-12T02:47:58.470755+0000","last_unstale":"2024-09-12T02:47:59.657817+0000","last_undegraded":"2024-09-12T02:47:59.657817+0000","last_fullsized":"2024-09-12T02:47:59.657817+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:41.369531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658589+0000","last_change":"2024-09-12T02:47:58.476172+0000","last_active":"2024-09-12T02:47:59.658589+0000","last_peered":"2024-09-12T02:47:59.658589+0000","last_clean":"2024-09-12T02:47:59.658589+0000","last_became_active":"2024-09-12T02:47:58.475844+0000","last_became_peered":"2024-09-12T02:47:58.475844+0000","last_unstale":"2024-09-12T02:47:59.658589+0000","last_undegraded":"2024-09-12T02:47:59.658589+0000","last_fullsized":"2024-09-12T02:47:59.658589+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:12.229793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.659190+0000","last_change":"2024-09-12T02:47:58.468109+0000","last_active":"2024-09-12T02:47:59.659190+0000","last_peered":"2024-09-12T02:47:59.659190+0000","last_clean":"2024-09-12T02:47:59.659190+0000","last_became_active":"2024-09-12T02:47:58.467834+0000","last_became_peered":"2024-09-12T02:47:58.467834+0000","last_unstale":"2024-09-12T02:47:59.659190+0000","last_undegraded":"2024-09-12T02:47:59.659190+0000","last_fullsized":"2024-09-12T02:47:59.659190+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:17.345970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462039+0000","last_change":"2024-09-12T02:47:58.475375+0000","last_active":"2024-09-12T02:47:59.462039+0000","last_peered":"2024-09-12T02:47:59.462039+0000","last_clean":"2024-09-12T02:47:59.462039+0000","last_became_active":"2024-09-12T02:47:58.475184+0000","last_became_peered":"2024-09-12T02:47:58.475184+0000","last_unstale":"2024-09-12T02:47:59.462039+0000","last_undegraded":"2024-09-12T02:47:59.462039+0000","last_fullsized":"2024-09-12T02:47:59.462039+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:38.989320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658949+0000","last_change":"2024-09-12T02:47:58.465999+0000","last_active":"2024-09-12T02:47:59.658949+0000","last_peered":"2024-09-12T02:47:59.658949+0000","last_clean":"2024-09-12T02:47:59.658949+0000","last_became_active":"2024-09-12T02:47:58.465741+0000","last_became_peered":"2024-09-12T02:47:58.465741+0000","last_unstale":"2024-09-12T02:47:59.658949+0000","last_undegraded":"2024-09-12T02:47:59.658949+0000","last_fullsized":"2024-09-12T02:47:59.658949+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:12.715626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462091+0000","last_change":"2024-09-12T02:47:58.464286+0000","last_active":"2024-09-12T02:47:59.462091+0000","last_peered":"2024-09-12T02:47:59.462091+0000","last_clean":"2024-09-12T02:47:59.462091+0000","last_became_active":"2024-09-12T02:47:58.464025+0000","last_became_peered":"2024-09-12T02:47:58.464025+0000","last_unstale":"2024-09-12T02:47:59.462091+0000","last_undegraded":"2024-09-12T02:47:59.462091+0000","last_fullsized":"2024-09-12T02:47:59.462091+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:29.052988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658761+0000","last_change":"2024-09-12T02:47:58.471241+0000","last_active":"2024-09-12T02:47:59.658761+0000","last_peered":"2024-09-12T02:47:59.658761+0000","last_clean":"2024-09-12T02:47:59.658761+0000","last_became_active":"2024-09-12T02:47:58.471008+0000","last_became_peered":"2024-09-12T02:47:58.471008+0000","last_unstale":"2024-09-12T02:47:59.658761+0000","last_undegraded":"2024-09-12T02:47:59.658761+0000","last_fullsized":"2024-09-12T02:47:59.658761+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:12.683296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657504+0000","last_change":"2024-09-12T02:47:58.484925+0000","last_active":"2024-09-12T02:47:59.657504+0000","last_peered":"2024-09-12T02:47:59.657504+0000","last_clean":"2024-09-12T02:47:59.657504+0000","last_became_active":"2024-09-12T02:47:58.484536+0000","last_became_peered":"2024-09-12T02:47:58.484536+0000","last_unstale":"2024-09-12T02:47:59.657504+0000","last_undegraded":"2024-09-12T02:47:59.657504+0000","last_fullsized":"2024-09-12T02:47:59.657504+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:09.731850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.463578+0000","last_change":"2024-09-12T02:47:58.489826+0000","last_active":"2024-09-12T02:47:59.463578+0000","last_peered":"2024-09-12T02:47:59.463578+0000","last_clean":"2024-09-12T02:47:59.463578+0000","last_became_active":"2024-09-12T02:47:58.489596+0000","last_became_peered":"2024-09-12T02:47:58.489596+0000","last_unstale":"2024-09-12T02:47:59.463578+0000","last_undegraded":"2024-09-12T02:47:59.463578+0000","last_fullsized":"2024-09-12T02:47:59.463578+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:11.166299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462035+0000","last_change":"2024-09-12T02:47:58.480214+0000","last_active":"2024-09-12T02:47:59.462035+0000","last_peered":"2024-09-12T02:47:59.462035+0000","last_clean":"2024-09-12T02:47:59.462035+0000","last_became_active":"2024-09-12T02:47:58.479967+0000","last_became_peered":"2024-09-12T02:47:58.479967+0000","last_unstale":"2024-09-12T02:47:59.462035+0000","last_undegraded":"2024-09-12T02:47:59.462035+0000","last_fullsized":"2024-09-12T02:47:59.462035+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:56.675644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657667+0000","last_change":"2024-09-12T02:47:58.470114+0000","last_active":"2024-09-12T02:47:59.657667+0000","last_peered":"2024-09-12T02:47:59.657667+0000","last_clean":"2024-09-12T02:47:59.657667+0000","last_became_active":"2024-09-12T02:47:58.469753+0000","last_became_peered":"2024-09-12T02:47:58.469753+0000","last_unstale":"2024-09-12T02:47:59.657667+0000","last_undegraded":"2024-09-12T02:47:59.657667+0000","last_fullsized":"2024-09-12T02:47:59.657667+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:53:23.482151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657354+0000","last_change":"2024-09-12T02:47:58.479009+0000","last_active":"2024-09-12T02:47:59.657354+0000","last_peered":"2024-09-12T02:47:59.657354+0000","last_clean":"2024-09-12T02:47:59.657354+0000","last_became_active":"2024-09-12T02:47:58.478705+0000","last_became_peered":"2024-09-12T02:47:58.478705+0000","last_unstale":"2024-09-12T02:47:59.657354+0000","last_undegraded":"2024-09-12T02:47:59.657354+0000","last_fullsized":"2024-09-12T02:47:59.657354+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:49.893384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657634+0000","last_change":"2024-09-12T02:47:58.484752+0000","last_active":"2024-09-12T02:47:59.657634+0000","last_peered":"2024-09-12T02:47:59.657634+0000","last_clean":"2024-09-12T02:47:59.657634+0000","last_became_active":"2024-09-12T02:47:58.484214+0000","last_became_peered":"2024-09-12T02:47:58.484214+0000","last_unstale":"2024-09-12T02:47:59.657634+0000","last_undegraded":"2024-09-12T02:47:59.657634+0000","last_fullsized":"2024-09-12T02:47:59.657634+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:21.654771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.463764+0000","last_change":"2024-09-12T02:47:58.472823+0000","last_active":"2024-09-12T02:47:59.463764+0000","last_peered":"2024-09-12T02:47:59.463764+0000","last_clean":"2024-09-12T02:47:59.463764+0000","last_became_active":"2024-09-12T02:47:58.472589+0000","last_became_peered":"2024-09-12T02:47:58.472589+0000","last_unstale":"2024-09-12T02:47:59.463764+0000","last_undegraded":"2024-09-12T02:47:59.463764+0000","last_fullsized":"2024-09-12T02:47:59.463764+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:40.224279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.463489+0000","last_change":"2024-09-12T02:47:58.470585+0000","last_active":"2024-09-12T02:47:59.463489+0000","last_peered":"2024-09-12T02:47:59.463489+0000","last_clean":"2024-09-12T02:47:59.463489+0000","last_became_active":"2024-09-12T02:47:58.469471+0000","last_became_peered":"2024-09-12T02:47:58.469471+0000","last_unstale":"2024-09-12T02:47:59.463489+0000","last_undegraded":"2024-09-12T02:47:59.463489+0000","last_fullsized":"2024-09-12T02:47:59.463489+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:52.390760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"134'4","reported_seq":18,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657434+0000","last_change":"2024-09-12T02:47:57.468829+0000","last_active":"2024-09-12T02:47:59.657434+0000","last_peered":"2024-09-12T02:47:59.657434+0000","last_clean":"2024-09-12T02:47:59.657434+0000","last_became_active":"2024-09-12T02:47:57.468528+0000","last_became_peered":"2024-09-12T02:47:57.468528+0000","last_unstale":"2024-09-12T02:47:59.657434+0000","last_undegraded":"2024-09-12T02:47:59.657434+0000","last_fullsized":"2024-09-12T02:47:59.657434+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:47.803523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462273+0000","last_change":"2024-09-12T02:47:58.478037+0000","last_active":"2024-09-12T02:47:59.462273+0000","last_peered":"2024-09-12T02:47:59.462273+0000","last_clean":"2024-09-12T02:47:59.462273+0000","last_became_active":"2024-09-12T02:47:58.477793+0000","last_became_peered":"2024-09-12T02:47:58.477793+0000","last_unstale":"2024-09-12T02:47:59.462273+0000","last_undegraded":"2024-09-12T02:47:59.462273+0000","last_fullsized":"2024-09-12T02:47:59.462273+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:06.691112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"134'1","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658192+0000","last_change":"2024-09-12T02:47:57.469448+0000","last_active":"2024-09-12T02:47:59.658192+0000","last_peered":"2024-09-12T02:47:59.658192+0000","last_clean":"2024-09-12T02:47:59.658192+0000","last_became_active":"2024-09-12T02:47:57.469225+0000","last_became_peered":"2024-09-12T02:47:57.469225+0000","last_unstale":"2024-09-12T02:47:59.658192+0000","last_undegraded":"2024-09-12T02:47:59.658192+0000","last_fullsized":"2024-09-12T02:47:59.658192+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:41.674158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.463895+0000","last_change":"2024-09-12T02:47:58.485832+0000","last_active":"2024-09-12T02:47:59.463895+0000","last_peered":"2024-09-12T02:47:59.463895+0000","last_clean":"2024-09-12T02:47:59.463895+0000","last_became_active":"2024-09-12T02:47:58.479353+0000","last_became_peered":"2024-09-12T02:47:58.479353+0000","last_unstale":"2024-09-12T02:47:59.463895+0000","last_undegraded":"2024-09-12T02:47:59.463895+0000","last_fullsized":"2024-09-12T02:47:59.463895+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:33.434145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"134'2","reported_seq":16,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657452+0000","last_change":"2024-09-12T02:47:57.471489+0000","last_active":"2024-09-12T02:47:59.657452+0000","last_peered":"2024-09-12T02:47:59.657452+0000","last_clean":"2024-09-12T02:47:59.657452+0000","last_became_active":"2024-09-12T02:47:57.470912+0000","last_became_peered":"2024-09-12T02:47:57.470912+0000","last_unstale":"2024-09-12T02:47:59.657452+0000","last_undegraded":"2024-09-12T02:47:59.657452+0000","last_fullsized":"2024-09-12T02:47:59.657452+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:18.855629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658664+0000","last_change":"2024-09-12T02:47:58.474352+0000","last_active":"2024-09-12T02:47:59.658664+0000","last_peered":"2024-09-12T02:47:59.658664+0000","last_clean":"2024-09-12T02:47:59.658664+0000","last_became_active":"2024-09-12T02:47:58.474057+0000","last_became_peered":"2024-09-12T02:47:58.474057+0000","last_unstale":"2024-09-12T02:47:59.658664+0000","last_undegraded":"2024-09-12T02:47:59.658664+0000","last_fullsized":"2024-09-12T02:47:59.658664+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:09.373910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"134'2","reported_seq":16,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657102+0000","last_change":"2024-09-12T02:47:57.471168+0000","last_active":"2024-09-12T02:47:59.657102+0000","last_peered":"2024-09-12T02:47:59.657102+0000","last_clean":"2024-09-12T02:47:59.657102+0000","last_became_active":"2024-09-12T02:47:57.470929+0000","last_became_peered":"2024-09-12T02:47:57.470929+0000","last_unstale":"2024-09-12T02:47:59.657102+0000","last_undegraded":"2024-09-12T02:47:59.657102+0000","last_fullsized":"2024-09-12T02:47:59.657102+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:58.228885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657339+0000","last_change":"2024-09-12T02:47:58.486735+0000","last_active":"2024-09-12T02:47:59.657339+0000","last_peered":"2024-09-12T02:47:59.657339+0000","last_clean":"2024-09-12T02:47:59.657339+0000","last_became_active":"2024-09-12T02:47:58.484411+0000","last_became_peered":"2024-09-12T02:47:58.484411+0000","last_unstale":"2024-09-12T02:47:59.657339+0000","last_undegraded":"2024-09-12T02:47:59.657339+0000","last_fullsized":"2024-09-12T02:47:59.657339+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:18.861217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"134'1","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657716+0000","last_change":"2024-09-12T02:47:57.470089+0000","last_active":"2024-09-12T02:47:59.657716+0000","last_peered":"2024-09-12T02:47:59.657716+0000","last_clean":"2024-09-12T02:47:59.657716+0000","last_became_active":"2024-09-12T02:47:57.468952+0000","last_became_peered":"2024-09-12T02:47:57.468952+0000","last_unstale":"2024-09-12T02:47:59.657716+0000","last_undegraded":"2024-09-12T02:47:59.657716+0000","last_fullsized":"2024-09-12T02:47:59.657716+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:08.373552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658441+0000","last_change":"2024-09-12T02:47:58.485250+0000","last_active":"2024-09-12T02:47:59.658441+0000","last_peered":"2024-09-12T02:47:59.658441+0000","last_clean":"2024-09-12T02:47:59.658441+0000","last_became_active":"2024-09-12T02:47:58.485093+0000","last_became_peered":"2024-09-12T02:47:58.485093+0000","last_unstale":"2024-09-12T02:47:59.658441+0000","last_undegraded":"2024-09-12T02:47:59.658441+0000","last_fullsized":"2024-09-12T02:47:59.658441+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:12.195892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"134'1","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462285+0000","last_change":"2024-09-12T02:47:57.464833+0000","last_active":"2024-09-12T02:47:59.462285+0000","last_peered":"2024-09-12T02:47:59.462285+0000","last_clean":"2024-09-12T02:47:59.462285+0000","last_became_active":"2024-09-12T02:47:57.464435+0000","last_became_peered":"2024-09-12T02:47:57.464435+0000","last_unstale":"2024-09-12T02:47:59.462285+0000","last_undegraded":"2024-09-12T02:47:59.462285+0000","last_fullsized":"2024-09-12T02:47:59.462285+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:53.327488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657641+0000","last_change":"2024-09-12T02:47:58.493422+0000","last_active":"2024-09-12T02:47:59.657641+0000","last_peered":"2024-09-12T02:47:59.657641+0000","last_clean":"2024-09-12T02:47:59.657641+0000","last_became_active":"2024-09-12T02:47:58.491683+0000","last_became_peered":"2024-09-12T02:47:58.491683+0000","last_unstale":"2024-09-12T02:47:59.657641+0000","last_undegraded":"2024-09-12T02:47:59.657641+0000","last_fullsized":"2024-09-12T02:47:59.657641+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:59.496942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657910+0000","last_change":"2024-09-12T02:47:57.460129+0000","last_active":"2024-09-12T02:47:59.657910+0000","last_peered":"2024-09-12T02:47:59.657910+0000","last_clean":"2024-09-12T02:47:59.657910+0000","last_became_active":"2024-09-12T02:47:57.459834+0000","last_became_peered":"2024-09-12T02:47:57.459834+0000","last_unstale":"2024-09-12T02:47:59.657910+0000","last_undegraded":"2024-09-12T02:47:59.657910+0000","last_fullsized":"2024-09-12T02:47:59.657910+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:30.593173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657319+0000","last_change":"2024-09-12T02:47:58.478421+0000","last_active":"2024-09-12T02:47:59.657319+0000","last_peered":"2024-09-12T02:47:59.657319+0000","last_clean":"2024-09-12T02:47:59.657319+0000","last_became_active":"2024-09-12T02:47:58.478146+0000","last_became_peered":"2024-09-12T02:47:58.478146+0000","last_unstale":"2024-09-12T02:47:59.657319+0000","last_undegraded":"2024-09-12T02:47:59.657319+0000","last_fullsized":"2024-09-12T02:47:59.657319+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:00.922266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657919+0000","last_change":"2024-09-12T02:47:57.464663+0000","last_active":"2024-09-12T02:47:59.657919+0000","last_peered":"2024-09-12T02:47:59.657919+0000","last_clean":"2024-09-12T02:47:59.657919+0000","last_became_active":"2024-09-12T02:47:57.464447+0000","last_became_peered":"2024-09-12T02:47:57.464447+0000","last_unstale":"2024-09-12T02:47:59.657919+0000","last_undegraded":"2024-09-12T02:47:59.657919+0000","last_fullsized":"2024-09-12T02:47:59.657919+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:21.366974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657614+0000","last_change":"2024-09-12T02:47:58.471405+0000","last_active":"2024-09-12T02:47:59.657614+0000","last_peered":"2024-09-12T02:47:59.657614+0000","last_clean":"2024-09-12T02:47:59.657614+0000","last_became_active":"2024-09-12T02:47:58.471173+0000","last_became_peered":"2024-09-12T02:47:58.471173+0000","last_unstale":"2024-09-12T02:47:59.657614+0000","last_undegraded":"2024-09-12T02:47:59.657614+0000","last_fullsized":"2024-09-12T02:47:59.657614+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:56.640889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657203+0000","last_change":"2024-09-12T02:47:57.472855+0000","last_active":"2024-09-12T02:47:59.657203+0000","last_peered":"2024-09-12T02:47:59.657203+0000","last_clean":"2024-09-12T02:47:59.657203+0000","last_became_active":"2024-09-12T02:47:57.472612+0000","last_became_peered":"2024-09-12T02:47:57.472612+0000","last_unstale":"2024-09-12T02:47:59.657203+0000","last_undegraded":"2024-09-12T02:47:59.657203+0000","last_fullsized":"2024-09-12T02:47:59.657203+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:01.919748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462517+0000","last_change":"2024-09-12T02:47:58.488331+0000","last_active":"2024-09-12T02:47:59.462517+0000","last_peered":"2024-09-12T02:47:59.462517+0000","last_clean":"2024-09-12T02:47:59.462517+0000","last_became_active":"2024-09-12T02:47:58.487984+0000","last_became_peered":"2024-09-12T02:47:58.487984+0000","last_unstale":"2024-09-12T02:47:59.462517+0000","last_undegraded":"2024-09-12T02:47:59.462517+0000","last_fullsized":"2024-09-12T02:47:59.462517+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:53:04.404665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462328+0000","last_change":"2024-09-12T02:47:57.461370+0000","last_active":"2024-09-12T02:47:59.462328+0000","last_peered":"2024-09-12T02:47:59.462328+0000","last_clean":"2024-09-12T02:47:59.462328+0000","last_became_active":"2024-09-12T02:47:57.461153+0000","last_became_peered":"2024-09-12T02:47:57.461153+0000","last_unstale":"2024-09-12T02:47:59.462328+0000","last_undegraded":"2024-09-12T02:47:59.462328+0000","last_fullsized":"2024-09-12T02:47:59.462328+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:54.948833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462187+0000","last_change":"2024-09-12T02:47:58.466934+0000","last_active":"2024-09-12T02:47:59.462187+0000","last_peered":"2024-09-12T02:47:59.462187+0000","last_clean":"2024-09-12T02:47:59.462187+0000","last_became_active":"2024-09-12T02:47:58.465938+0000","last_became_peered":"2024-09-12T02:47:58.465938+0000","last_unstale":"2024-09-12T02:47:59.462187+0000","last_undegraded":"2024-09-12T02:47:59.462187+0000","last_fullsized":"2024-09-12T02:47:59.462187+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:50.087258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"134'3","reported_seq":17,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657635+0000","last_change":"2024-09-12T02:47:57.469395+0000","last_active":"2024-09-12T02:47:59.657635+0000","last_peered":"2024-09-12T02:47:59.657635+0000","last_clean":"2024-09-12T02:47:59.657635+0000","last_became_active":"2024-09-12T02:47:57.469170+0000","last_became_peered":"2024-09-12T02:47:57.469170+0000","last_unstale":"2024-09-12T02:47:59.657635+0000","last_undegraded":"2024-09-12T02:47:59.657635+0000","last_fullsized":"2024-09-12T02:47:59.657635+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:15.633103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657243+0000","last_change":"2024-09-12T02:47:58.469912+0000","last_active":"2024-09-12T02:47:59.657243+0000","last_peered":"2024-09-12T02:47:59.657243+0000","last_clean":"2024-09-12T02:47:59.657243+0000","last_became_active":"2024-09-12T02:47:58.469662+0000","last_became_peered":"2024-09-12T02:47:58.469662+0000","last_unstale":"2024-09-12T02:47:59.657243+0000","last_undegraded":"2024-09-12T02:47:59.657243+0000","last_fullsized":"2024-09-12T02:47:59.657243+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:04.770245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"134'6","reported_seq":20,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657525+0000","last_change":"2024-09-12T02:47:57.462911+0000","last_active":"2024-09-12T02:47:59.657525+0000","last_peered":"2024-09-12T02:47:59.657525+0000","last_clean":"2024-09-12T02:47:59.657525+0000","last_became_active":"2024-09-12T02:47:57.462658+0000","last_became_peered":"2024-09-12T02:47:57.462658+0000","last_unstale":"2024-09-12T02:47:59.657525+0000","last_undegraded":"2024-09-12T02:47:59.657525+0000","last_fullsized":"2024-09-12T02:47:59.657525+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:30.117038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462327+0000","last_change":"2024-09-12T02:47:58.474314+0000","last_active":"2024-09-12T02:47:59.462327+0000","last_peered":"2024-09-12T02:47:59.462327+0000","last_clean":"2024-09-12T02:47:59.462327+0000","last_became_active":"2024-09-12T02:47:58.470908+0000","last_became_peered":"2024-09-12T02:47:58.470908+0000","last_unstale":"2024-09-12T02:47:59.462327+0000","last_undegraded":"2024-09-12T02:47:59.462327+0000","last_fullsized":"2024-09-12T02:47:59.462327+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:52.392958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"134'2","reported_seq":16,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.464003+0000","last_change":"2024-09-12T02:47:57.465729+0000","last_active":"2024-09-12T02:47:59.464003+0000","last_peered":"2024-09-12T02:47:59.464003+0000","last_clean":"2024-09-12T02:47:59.464003+0000","last_became_active":"2024-09-12T02:47:57.465502+0000","last_became_peered":"2024-09-12T02:47:57.465502+0000","last_unstale":"2024-09-12T02:47:59.464003+0000","last_undegraded":"2024-09-12T02:47:59.464003+0000","last_fullsized":"2024-09-12T02:47:59.464003+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:54.210973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462558+0000","last_change":"2024-09-12T02:47:58.464174+0000","last_active":"2024-09-12T02:47:59.462558+0000","last_peered":"2024-09-12T02:47:59.462558+0000","last_clean":"2024-09-12T02:47:59.462558+0000","last_became_active":"2024-09-12T02:47:58.463913+0000","last_became_peered":"2024-09-12T02:47:58.463913+0000","last_unstale":"2024-09-12T02:47:59.462558+0000","last_undegraded":"2024-09-12T02:47:59.462558+0000","last_fullsized":"2024-09-12T02:47:59.462558+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:01.950187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462617+0000","last_change":"2024-09-12T02:47:57.467217+0000","last_active":"2024-09-12T02:47:59.462617+0000","last_peered":"2024-09-12T02:47:59.462617+0000","last_clean":"2024-09-12T02:47:59.462617+0000","last_became_active":"2024-09-12T02:47:57.466879+0000","last_became_peered":"2024-09-12T02:47:57.466879+0000","last_unstale":"2024-09-12T02:47:59.462617+0000","last_undegraded":"2024-09-12T02:47:59.462617+0000","last_fullsized":"2024-09-12T02:47:59.462617+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:53.641332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462232+0000","last_change":"2024-09-12T02:47:58.466536+0000","last_active":"2024-09-12T02:47:59.462232+0000","last_peered":"2024-09-12T02:47:59.462232+0000","last_clean":"2024-09-12T02:47:59.462232+0000","last_became_active":"2024-09-12T02:47:58.466245+0000","last_became_peered":"2024-09-12T02:47:58.466245+0000","last_unstale":"2024-09-12T02:47:59.462232+0000","last_undegraded":"2024-09-12T02:47:59.462232+0000","last_fullsized":"2024-09-12T02:47:59.462232+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:14.125248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"134'8","reported_seq":22,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657097+0000","last_change":"2024-09-12T02:47:57.470285+0000","last_active":"2024-09-12T02:47:59.657097+0000","last_peered":"2024-09-12T02:47:59.657097+0000","last_clean":"2024-09-12T02:47:59.657097+0000","last_became_active":"2024-09-12T02:47:57.469886+0000","last_became_peered":"2024-09-12T02:47:57.469886+0000","last_unstale":"2024-09-12T02:47:59.657097+0000","last_undegraded":"2024-09-12T02:47:59.657097+0000","last_fullsized":"2024-09-12T02:47:59.657097+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:38.797454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657187+0000","last_change":"2024-09-12T02:47:58.489660+0000","last_active":"2024-09-12T02:47:59.657187+0000","last_peered":"2024-09-12T02:47:59.657187+0000","last_clean":"2024-09-12T02:47:59.657187+0000","last_became_active":"2024-09-12T02:47:58.489459+0000","last_became_peered":"2024-09-12T02:47:58.489459+0000","last_unstale":"2024-09-12T02:47:59.657187+0000","last_undegraded":"2024-09-12T02:47:59.657187+0000","last_fullsized":"2024-09-12T02:47:59.657187+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:54.181380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"134'1","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657618+0000","last_change":"2024-09-12T02:47:57.466554+0000","last_active":"2024-09-12T02:47:59.657618+0000","last_peered":"2024-09-12T02:47:59.657618+0000","last_clean":"2024-09-12T02:47:59.657618+0000","last_became_active":"2024-09-12T02:47:57.466337+0000","last_became_peered":"2024-09-12T02:47:57.466337+0000","last_unstale":"2024-09-12T02:47:59.657618+0000","last_undegraded":"2024-09-12T02:47:59.657618+0000","last_fullsized":"2024-09-12T02:47:59.657618+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:08.072830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.463640+0000","last_change":"2024-09-12T02:47:58.489228+0000","last_active":"2024-09-12T02:47:59.463640+0000","last_peered":"2024-09-12T02:47:59.463640+0000","last_clean":"2024-09-12T02:47:59.463640+0000","last_became_active":"2024-09-12T02:47:58.488974+0000","last_became_peered":"2024-09-12T02:47:58.488974+0000","last_unstale":"2024-09-12T02:47:59.463640+0000","last_undegraded":"2024-09-12T02:47:59.463640+0000","last_fullsized":"2024-09-12T02:47:59.463640+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:19.842369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"134'2","reported_seq":16,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657544+0000","last_change":"2024-09-12T02:47:57.471259+0000","last_active":"2024-09-12T02:47:59.657544+0000","last_peered":"2024-09-12T02:47:59.657544+0000","last_clean":"2024-09-12T02:47:59.657544+0000","last_became_active":"2024-09-12T02:47:57.470578+0000","last_became_peered":"2024-09-12T02:47:57.470578+0000","last_unstale":"2024-09-12T02:47:59.657544+0000","last_undegraded":"2024-09-12T02:47:59.657544+0000","last_fullsized":"2024-09-12T02:47:59.657544+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:13.205170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658142+0000","last_change":"2024-09-12T02:47:58.487419+0000","last_active":"2024-09-12T02:47:59.658142+0000","last_peered":"2024-09-12T02:47:59.658142+0000","last_clean":"2024-09-12T02:47:59.658142+0000","last_became_active":"2024-09-12T02:47:58.487154+0000","last_became_peered":"2024-09-12T02:47:58.487154+0000","last_unstale":"2024-09-12T02:47:59.658142+0000","last_undegraded":"2024-09-12T02:47:59.658142+0000","last_fullsized":"2024-09-12T02:47:59.658142+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:19.637662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"134'1","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462711+0000","last_change":"2024-09-12T02:47:57.461685+0000","last_active":"2024-09-12T02:47:59.462711+0000","last_peered":"2024-09-12T02:47:59.462711+0000","last_clean":"2024-09-12T02:47:59.462711+0000","last_became_active":"2024-09-12T02:47:57.461464+0000","last_became_peered":"2024-09-12T02:47:57.461464+0000","last_unstale":"2024-09-12T02:47:59.462711+0000","last_undegraded":"2024-09-12T02:47:59.462711+0000","last_fullsized":"2024-09-12T02:47:59.462711+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:56.601521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658428+0000","last_change":"2024-09-12T02:47:58.471958+0000","last_active":"2024-09-12T02:47:59.658428+0000","last_peered":"2024-09-12T02:47:59.658428+0000","last_clean":"2024-09-12T02:47:59.658428+0000","last_became_active":"2024-09-12T02:47:58.471631+0000","last_became_peered":"2024-09-12T02:47:58.471631+0000","last_unstale":"2024-09-12T02:47:59.658428+0000","last_undegraded":"2024-09-12T02:47:59.658428+0000","last_fullsized":"2024-09-12T02:47:59.658428+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:44.863409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658082+0000","last_change":"2024-09-12T02:47:57.470460+0000","last_active":"2024-09-12T02:47:59.658082+0000","last_peered":"2024-09-12T02:47:59.658082+0000","last_clean":"2024-09-12T02:47:59.658082+0000","last_became_active":"2024-09-12T02:47:57.469717+0000","last_became_peered":"2024-09-12T02:47:57.469717+0000","last_unstale":"2024-09-12T02:47:59.658082+0000","last_undegraded":"2024-09-12T02:47:59.658082+0000","last_fullsized":"2024-09-12T02:47:59.658082+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:17.020019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658106+0000","last_change":"2024-09-12T02:47:58.471037+0000","last_active":"2024-09-12T02:47:59.658106+0000","last_peered":"2024-09-12T02:47:59.658106+0000","last_clean":"2024-09-12T02:47:59.658106+0000","last_became_active":"2024-09-12T02:47:58.468784+0000","last_became_peered":"2024-09-12T02:47:58.468784+0000","last_unstale":"2024-09-12T02:47:59.658106+0000","last_undegraded":"2024-09-12T02:47:59.658106+0000","last_fullsized":"2024-09-12T02:47:59.658106+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:19.165896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"134'2","reported_seq":16,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.463686+0000","last_change":"2024-09-12T02:47:57.471049+0000","last_active":"2024-09-12T02:47:59.463686+0000","last_peered":"2024-09-12T02:47:59.463686+0000","last_clean":"2024-09-12T02:47:59.463686+0000","last_became_active":"2024-09-12T02:47:57.470590+0000","last_became_peered":"2024-09-12T02:47:57.470590+0000","last_unstale":"2024-09-12T02:47:59.463686+0000","last_undegraded":"2024-09-12T02:47:59.463686+0000","last_fullsized":"2024-09-12T02:47:59.463686+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:50.671578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657508+0000","last_change":"2024-09-12T02:47:58.479325+0000","last_active":"2024-09-12T02:47:59.657508+0000","last_peered":"2024-09-12T02:47:59.657508+0000","last_clean":"2024-09-12T02:47:59.657508+0000","last_became_active":"2024-09-12T02:47:58.478875+0000","last_became_peered":"2024-09-12T02:47:58.478875+0000","last_unstale":"2024-09-12T02:47:59.657508+0000","last_undegraded":"2024-09-12T02:47:59.657508+0000","last_fullsized":"2024-09-12T02:47:59.657508+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:04.345700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657009+0000","last_change":"2024-09-12T02:47:57.469255+0000","last_active":"2024-09-12T02:47:59.657009+0000","last_peered":"2024-09-12T02:47:59.657009+0000","last_clean":"2024-09-12T02:47:59.657009+0000","last_became_active":"2024-09-12T02:47:57.468941+0000","last_became_peered":"2024-09-12T02:47:57.468941+0000","last_unstale":"2024-09-12T02:47:59.657009+0000","last_undegraded":"2024-09-12T02:47:59.657009+0000","last_fullsized":"2024-09-12T02:47:59.657009+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:48.881697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658589+0000","last_change":"2024-09-12T02:47:58.474149+0000","last_active":"2024-09-12T02:47:59.658589+0000","last_peered":"2024-09-12T02:47:59.658589+0000","last_clean":"2024-09-12T02:47:59.658589+0000","last_became_active":"2024-09-12T02:47:58.473882+0000","last_became_peered":"2024-09-12T02:47:58.473882+0000","last_unstale":"2024-09-12T02:47:59.658589+0000","last_undegraded":"2024-09-12T02:47:59.658589+0000","last_fullsized":"2024-09-12T02:47:59.658589+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:17.412911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.464107+0000","last_change":"2024-09-12T02:47:57.470430+0000","last_active":"2024-09-12T02:47:59.464107+0000","last_peered":"2024-09-12T02:47:59.464107+0000","last_clean":"2024-09-12T02:47:59.464107+0000","last_became_active":"2024-09-12T02:47:57.470194+0000","last_became_peered":"2024-09-12T02:47:57.470194+0000","last_unstale":"2024-09-12T02:47:59.464107+0000","last_undegraded":"2024-09-12T02:47:59.464107+0000","last_fullsized":"2024-09-12T02:47:59.464107+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:11.236614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462628+0000","last_change":"2024-09-12T02:47:58.487861+0000","last_active":"2024-09-12T02:47:59.462628+0000","last_peered":"2024-09-12T02:47:59.462628+0000","last_clean":"2024-09-12T02:47:59.462628+0000","last_became_active":"2024-09-12T02:47:58.487641+0000","last_became_peered":"2024-09-12T02:47:58.487641+0000","last_unstale":"2024-09-12T02:47:59.462628+0000","last_undegraded":"2024-09-12T02:47:59.462628+0000","last_fullsized":"2024-09-12T02:47:59.462628+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:07.702840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658025+0000","last_change":"2024-09-12T02:47:57.472550+0000","last_active":"2024-09-12T02:47:59.658025+0000","last_peered":"2024-09-12T02:47:59.658025+0000","last_clean":"2024-09-12T02:47:59.658025+0000","last_became_active":"2024-09-12T02:47:57.472338+0000","last_became_peered":"2024-09-12T02:47:57.472338+0000","last_unstale":"2024-09-12T02:47:59.658025+0000","last_undegraded":"2024-09-12T02:47:59.658025+0000","last_fullsized":"2024-09-12T02:47:59.658025+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:54.708104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462510+0000","last_change":"2024-09-12T02:47:58.487842+0000","last_active":"2024-09-12T02:47:59.462510+0000","last_peered":"2024-09-12T02:47:59.462510+0000","last_clean":"2024-09-12T02:47:59.462510+0000","last_became_active":"2024-09-12T02:47:58.487603+0000","last_became_peered":"2024-09-12T02:47:58.487603+0000","last_unstale":"2024-09-12T02:47:59.462510+0000","last_undegraded":"2024-09-12T02:47:59.462510+0000","last_fullsized":"2024-09-12T02:47:59.462510+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:27.828313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"134'2","reported_seq":16,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462503+0000","last_change":"2024-09-12T02:47:57.462356+0000","last_active":"2024-09-12T02:47:59.462503+0000","last_peered":"2024-09-12T02:47:59.462503+0000","last_clean":"2024-09-12T02:47:59.462503+0000","last_became_active":"2024-09-12T02:47:57.461958+0000","last_became_peered":"2024-09-12T02:47:57.461958+0000","last_unstale":"2024-09-12T02:47:59.462503+0000","last_undegraded":"2024-09-12T02:47:59.462503+0000","last_fullsized":"2024-09-12T02:47:59.462503+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:34.205886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657967+0000","last_change":"2024-09-12T02:47:58.487736+0000","last_active":"2024-09-12T02:47:59.657967+0000","last_peered":"2024-09-12T02:47:59.657967+0000","last_clean":"2024-09-12T02:47:59.657967+0000","last_became_active":"2024-09-12T02:47:58.486888+0000","last_became_peered":"2024-09-12T02:47:58.486888+0000","last_unstale":"2024-09-12T02:47:59.657967+0000","last_undegraded":"2024-09-12T02:47:59.657967+0000","last_fullsized":"2024-09-12T02:47:59.657967+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:51.874146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"135'1","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462626+0000","last_change":"2024-09-12T02:47:57.464602+0000","last_active":"2024-09-12T02:47:59.462626+0000","last_peered":"2024-09-12T02:47:59.462626+0000","last_clean":"2024-09-12T02:47:59.462626+0000","last_became_active":"2024-09-12T02:47:57.464369+0000","last_became_peered":"2024-09-12T02:47:57.464369+0000","last_unstale":"2024-09-12T02:47:59.462626+0000","last_undegraded":"2024-09-12T02:47:59.462626+0000","last_fullsized":"2024-09-12T02:47:59.462626+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:55.756238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657836+0000","last_change":"2024-09-12T02:47:58.492167+0000","last_active":"2024-09-12T02:47:59.657836+0000","last_peered":"2024-09-12T02:47:59.657836+0000","last_clean":"2024-09-12T02:47:59.657836+0000","last_became_active":"2024-09-12T02:47:58.491345+0000","last_became_peered":"2024-09-12T02:47:58.491345+0000","last_unstale":"2024-09-12T02:47:59.657836+0000","last_undegraded":"2024-09-12T02:47:59.657836+0000","last_fullsized":"2024-09-12T02:47:59.657836+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:28.917871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657713+0000","last_change":"2024-09-12T02:47:57.473286+0000","last_active":"2024-09-12T02:47:59.657713+0000","last_peered":"2024-09-12T02:47:59.657713+0000","last_clean":"2024-09-12T02:47:59.657713+0000","last_became_active":"2024-09-12T02:47:57.472708+0000","last_became_peered":"2024-09-12T02:47:57.472708+0000","last_unstale":"2024-09-12T02:47:59.657713+0000","last_undegraded":"2024-09-12T02:47:59.657713+0000","last_fullsized":"2024-09-12T02:47:59.657713+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:49.455512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462501+0000","last_change":"2024-09-12T02:47:58.487845+0000","last_active":"2024-09-12T02:47:59.462501+0000","last_peered":"2024-09-12T02:47:59.462501+0000","last_clean":"2024-09-12T02:47:59.462501+0000","last_became_active":"2024-09-12T02:47:58.487581+0000","last_became_peered":"2024-09-12T02:47:58.487581+0000","last_unstale":"2024-09-12T02:47:59.462501+0000","last_undegraded":"2024-09-12T02:47:59.462501+0000","last_fullsized":"2024-09-12T02:47:59.462501+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:24.328260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462671+0000","last_change":"2024-09-12T02:47:57.464547+0000","last_active":"2024-09-12T02:47:59.462671+0000","last_peered":"2024-09-12T02:47:59.462671+0000","last_clean":"2024-09-12T02:47:59.462671+0000","last_became_active":"2024-09-12T02:47:57.464317+0000","last_became_peered":"2024-09-12T02:47:57.464317+0000","last_unstale":"2024-09-12T02:47:59.462671+0000","last_undegraded":"2024-09-12T02:47:59.462671+0000","last_fullsized":"2024-09-12T02:47:59.462671+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:02.527867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658591+0000","last_change":"2024-09-12T02:47:58.469467+0000","last_active":"2024-09-12T02:47:59.658591+0000","last_peered":"2024-09-12T02:47:59.658591+0000","last_clean":"2024-09-12T02:47:59.658591+0000","last_became_active":"2024-09-12T02:47:58.469215+0000","last_became_peered":"2024-09-12T02:47:58.469215+0000","last_unstale":"2024-09-12T02:47:59.658591+0000","last_undegraded":"2024-09-12T02:47:59.658591+0000","last_fullsized":"2024-09-12T02:47:59.658591+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:04.003708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657898+0000","last_change":"2024-09-12T02:47:57.469200+0000","last_active":"2024-09-12T02:47:59.657898+0000","last_peered":"2024-09-12T02:47:59.657898+0000","last_clean":"2024-09-12T02:47:59.657898+0000","last_became_active":"2024-09-12T02:47:57.468940+0000","last_became_peered":"2024-09-12T02:47:57.468940+0000","last_unstale":"2024-09-12T02:47:59.657898+0000","last_undegraded":"2024-09-12T02:47:59.657898+0000","last_fullsized":"2024-09-12T02:47:59.657898+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:30.009340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.659103+0000","last_change":"2024-09-12T02:47:58.473673+0000","last_active":"2024-09-12T02:47:59.659103+0000","last_peered":"2024-09-12T02:47:59.659103+0000","last_clean":"2024-09-12T02:47:59.659103+0000","last_became_active":"2024-09-12T02:47:58.473007+0000","last_became_peered":"2024-09-12T02:47:58.473007+0000","last_unstale":"2024-09-12T02:47:59.659103+0000","last_undegraded":"2024-09-12T02:47:59.659103+0000","last_fullsized":"2024-09-12T02:47:59.659103+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:29.811277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658780+0000","last_change":"2024-09-12T02:47:57.464715+0000","last_active":"2024-09-12T02:47:59.658780+0000","last_peered":"2024-09-12T02:47:59.658780+0000","last_clean":"2024-09-12T02:47:59.658780+0000","last_became_active":"2024-09-12T02:47:57.464428+0000","last_became_peered":"2024-09-12T02:47:57.464428+0000","last_unstale":"2024-09-12T02:47:59.658780+0000","last_undegraded":"2024-09-12T02:47:59.658780+0000","last_fullsized":"2024-09-12T02:47:59.658780+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:18.676523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657964+0000","last_change":"2024-09-12T02:47:58.476378+0000","last_active":"2024-09-12T02:47:59.657964+0000","last_peered":"2024-09-12T02:47:59.657964+0000","last_clean":"2024-09-12T02:47:59.657964+0000","last_became_active":"2024-09-12T02:47:58.474575+0000","last_became_peered":"2024-09-12T02:47:58.474575+0000","last_unstale":"2024-09-12T02:47:59.657964+0000","last_undegraded":"2024-09-12T02:47:59.657964+0000","last_fullsized":"2024-09-12T02:47:59.657964+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:56.896387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657200+0000","last_change":"2024-09-12T02:47:57.469237+0000","last_active":"2024-09-12T02:47:59.657200+0000","last_peered":"2024-09-12T02:47:59.657200+0000","last_clean":"2024-09-12T02:47:59.657200+0000","last_became_active":"2024-09-12T02:47:57.468975+0000","last_became_peered":"2024-09-12T02:47:57.468975+0000","last_unstale":"2024-09-12T02:47:59.657200+0000","last_undegraded":"2024-09-12T02:47:59.657200+0000","last_fullsized":"2024-09-12T02:47:59.657200+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:40.513369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657426+0000","last_change":"2024-09-12T02:47:58.491418+0000","last_active":"2024-09-12T02:47:59.657426+0000","last_peered":"2024-09-12T02:47:59.657426+0000","last_clean":"2024-09-12T02:47:59.657426+0000","last_became_active":"2024-09-12T02:47:58.488892+0000","last_became_peered":"2024-09-12T02:47:58.488892+0000","last_unstale":"2024-09-12T02:47:59.657426+0000","last_undegraded":"2024-09-12T02:47:59.657426+0000","last_fullsized":"2024-09-12T02:47:59.657426+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:53.656398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657793+0000","last_change":"2024-09-12T02:47:57.473483+0000","last_active":"2024-09-12T02:47:59.657793+0000","last_peered":"2024-09-12T02:47:59.657793+0000","last_clean":"2024-09-12T02:47:59.657793+0000","last_became_active":"2024-09-12T02:47:57.473031+0000","last_became_peered":"2024-09-12T02:47:57.473031+0000","last_unstale":"2024-09-12T02:47:59.657793+0000","last_undegraded":"2024-09-12T02:47:59.657793+0000","last_fullsized":"2024-09-12T02:47:59.657793+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:12:42.070116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462198+0000","last_change":"2024-09-12T02:47:58.464242+0000","last_active":"2024-09-12T02:47:59.462198+0000","last_peered":"2024-09-12T02:47:59.462198+0000","last_clean":"2024-09-12T02:47:59.462198+0000","last_became_active":"2024-09-12T02:47:58.463947+0000","last_became_peered":"2024-09-12T02:47:58.463947+0000","last_unstale":"2024-09-12T02:47:59.462198+0000","last_undegraded":"2024-09-12T02:47:59.462198+0000","last_fullsized":"2024-09-12T02:47:59.462198+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:16.716165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657995+0000","last_change":"2024-09-12T02:47:57.470279+0000","last_active":"2024-09-12T02:47:59.657995+0000","last_peered":"2024-09-12T02:47:59.657995+0000","last_clean":"2024-09-12T02:47:59.657995+0000","last_became_active":"2024-09-12T02:47:57.469397+0000","last_became_peered":"2024-09-12T02:47:57.469397+0000","last_unstale":"2024-09-12T02:47:59.657995+0000","last_undegraded":"2024-09-12T02:47:59.657995+0000","last_fullsized":"2024-09-12T02:47:59.657995+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:16.471310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":394,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658306+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:47:59.658306+0000","last_peered":"2024-09-12T02:47:59.658306+0000","last_clean":"2024-09-12T02:47:59.658306+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:47:59.658306+0000","last_undegraded":"2024-09-12T02:47:59.658306+0000","last_fullsized":"2024-09-12T02:47:59.658306+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:25.823876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1306,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194006,"statfs":{"total":200000000,"available":198662178,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574926,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":729,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194583,"statfs":{"total":200000000,"available":199253092,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":729,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194582,"statfs":{"total":200000000,"available":199252558,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":729,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194583,"statfs":{"total":200000000,"available":199253162,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":730,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194581,"statfs":{"total":200000000,"available":199251480,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":729,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194583,"statfs":{"total":200000000,"available":199253162,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":729,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194583,"statfs":{"total":200000000,"available":199253038,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1307,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194004,"statfs":{"total":200000000,"available":198661070,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:48:03.517 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T02:48:03.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.668+0000 7f2668c00640 1 Processor -- start 2024-09-12T02:48:03.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.668+0000 7f2668c00640 1 -- start start 2024-09-12T02:48:03.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.669+0000 7f2668c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f26640b3e00 0x7f26640d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:03.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.669+0000 7f2668c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f26640b1d70 0x7f26640b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:03.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.669+0000 7f2668c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26640d2fb0 con 0x7f26640d1710 2024-09-12T02:48:03.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.669+0000 7f2668c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f26640d3cb0 con 0x7f26640b3e00 2024-09-12T02:48:03.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.669+0000 7f2668c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f26640d0b60 con 0x7f26640b1d70 2024-09-12T02:48:03.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.669+0000 7f265aa00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f26640b3e00 0x7f26640d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:03.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.669+0000 7f2663400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f26640d1710 0x7f26640d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:40980/0 (socket says 172.21.15.112:40980) 2024-09-12T02:48:03.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.669+0000 7f2663400640 1 -- 172.21.15.112:0/364485444 learned_addr learned my addr 172.21.15.112:0/364485444 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:03.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.670+0000 7f2663e00640 1 --2- 172.21.15.112:0/364485444 >> v2:172.21.15.137:3300/0 conn(0x7f26640b1d70 0x7f26640b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:03.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.670+0000 7f265aa00640 1 -- 172.21.15.112:0/364485444 >> v2:172.21.15.137:3300/0 conn(0x7f26640b1d70 msgr2=0x7f26640b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:03.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.670+0000 7f265aa00640 1 --2- 172.21.15.112:0/364485444 >> v2:172.21.15.137:3300/0 conn(0x7f26640b1d70 0x7f26640b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:03.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.670+0000 7f265aa00640 1 -- 172.21.15.112:0/364485444 >> v1:172.21.15.112:6789/0 conn(0x7f26640d1710 legacy=0x7f26640d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:03.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.670+0000 7f265aa00640 1 -- 172.21.15.112:0/364485444 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26640d3410 con 0x7f26640b3e00 2024-09-12T02:48:03.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.670+0000 7f2662a00640 1 -- 172.21.15.112:0/364485444 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3117105817 0 0) 0x7f26640d2fb0 con 0x7f26640d1710 2024-09-12T02:48:03.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.671+0000 7f265aa00640 1 --2- 172.21.15.112:0/364485444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26640b3e00 0x7f26640d28d0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f266408ef20 tx=0x7f264c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdbf4f98df0bb0c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:03.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.671+0000 7f2662a00640 1 -- 172.21.15.112:0/364485444 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264c037070 con 0x7f26640b3e00 2024-09-12T02:48:03.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.671+0000 7f2662a00640 1 -- 172.21.15.112:0/364485444 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f264c032440 con 0x7f26640b3e00 2024-09-12T02:48:03.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.671+0000 7f2662a00640 1 -- 172.21.15.112:0/364485444 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264c032810 con 0x7f26640b3e00 2024-09-12T02:48:03.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.672+0000 7f2668c00640 1 -- 172.21.15.112:0/364485444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26640b3e00 msgr2=0x7f26640d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:03.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.672+0000 7f2668c00640 1 --2- 172.21.15.112:0/364485444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26640b3e00 0x7f26640d28d0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f266408ef20 tx=0x7f264c02a1a0 comp rx=0 tx=0).stop 2024-09-12T02:48:03.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.672+0000 7f2668c00640 1 -- 172.21.15.112:0/364485444 shutdown_connections 2024-09-12T02:48:03.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.672+0000 7f2668c00640 1 --2- 172.21.15.112:0/364485444 >> v2:172.21.15.137:3300/0 conn(0x7f26640b1d70 0x7f26640b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:03.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.672+0000 7f2668c00640 1 --2- 172.21.15.112:0/364485444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26640b3e00 0x7f26640d28d0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:03.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.672+0000 7f2668c00640 1 -- 172.21.15.112:0/364485444 >> 172.21.15.112:0/364485444 conn(0x7f266409e030 msgr2=0x7f26640d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:03.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.672+0000 7f2668c00640 1 -- 172.21.15.112:0/364485444 shutdown_connections 2024-09-12T02:48:03.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.672+0000 7f2668c00640 1 -- 172.21.15.112:0/364485444 wait complete. 2024-09-12T02:48:03.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.673+0000 7f2668c00640 1 Processor -- start 2024-09-12T02:48:03.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.673+0000 7f2668c00640 1 -- start start 2024-09-12T02:48:03.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.674+0000 7f2668c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26640b1d70 0x7f26641582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:03.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.674+0000 7f2668c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26640b3e00 0x7f26641604e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:03.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.674+0000 7f2668c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26640d1710 0x7f26640ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:03.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.674+0000 7f2668c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f266415f110 con 0x7f26640b3e00 2024-09-12T02:48:03.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.674+0000 7f2668c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f26640d39d0 con 0x7f26640b1d70 2024-09-12T02:48:03.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.674+0000 7f2668c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f266415f290 con 0x7f26640d1710 2024-09-12T02:48:03.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.675+0000 7f265aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26640b3e00 0x7f26641604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:03.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.675+0000 7f265aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26640b3e00 0x7f26641604e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34394/0 (socket says 172.21.15.112:34394) 2024-09-12T02:48:03.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.675+0000 7f265aa00640 1 -- 172.21.15.112:0/1226198418 learned_addr learned my addr 172.21.15.112:0/1226198418 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:03.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.675+0000 7f2663400640 1 --2- 172.21.15.112:0/1226198418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26640b1d70 0x7f26641582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:03.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.675+0000 7f2663e00640 1 --2- 172.21.15.112:0/1226198418 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26640d1710 0x7f26640ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:03.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.675+0000 7f265aa00640 1 -- 172.21.15.112:0/1226198418 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26640d1710 msgr2=0x7f26640ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:03.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.675+0000 7f265aa00640 1 --2- 172.21.15.112:0/1226198418 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26640d1710 0x7f26640ca6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:03.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.675+0000 7f265aa00640 1 -- 172.21.15.112:0/1226198418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26640b1d70 msgr2=0x7f26641582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:03.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.675+0000 7f265aa00640 1 --2- 172.21.15.112:0/1226198418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26640b1d70 0x7f26641582d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:03.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.675+0000 7f265aa00640 1 -- 172.21.15.112:0/1226198418 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2664158810 con 0x7f26640b3e00 2024-09-12T02:48:03.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.675+0000 7f265aa00640 1 --2- 172.21.15.112:0/1226198418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26640b3e00 0x7f26641604e0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f264c000c00 tx=0x7f264c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:03.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.675+0000 7f265be00640 1 -- 172.21.15.112:0/1226198418 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264c037040 con 0x7f26640b3e00 2024-09-12T02:48:03.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.676+0000 7f265be00640 1 -- 172.21.15.112:0/1226198418 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f264c042070 con 0x7f26640b3e00 2024-09-12T02:48:03.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.676+0000 7f265be00640 1 -- 172.21.15.112:0/1226198418 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264c030960 con 0x7f26640b3e00 2024-09-12T02:48:03.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.676+0000 7f2668c00640 1 -- 172.21.15.112:0/1226198418 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26640c95f0 con 0x7f26640b3e00 2024-09-12T02:48:03.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.676+0000 7f2668c00640 1 -- 172.21.15.112:0/1226198418 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26640b7eb0 con 0x7f26640b3e00 2024-09-12T02:48:03.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.677+0000 7f2668c00640 1 -- 172.21.15.112:0/1226198418 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26640b2d40 con 0x7f26640b3e00 2024-09-12T02:48:03.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.678+0000 7f265be00640 1 -- 172.21.15.112:0/1226198418 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f264c030b00 con 0x7f26640b3e00 2024-09-12T02:48:03.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.678+0000 7f265be00640 1 --2- 172.21.15.112:0/1226198418 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f264006be60 0x7f264006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:03.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.679+0000 7f265be00640 1 -- 172.21.15.112:0/1226198418 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f264c0ab7e0 con 0x7f26640b3e00 2024-09-12T02:48:03.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.679+0000 7f2663400640 1 --2- 172.21.15.112:0/1226198418 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f264006be60 0x7f264006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:03.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.679+0000 7f2663400640 1 --2- 172.21.15.112:0/1226198418 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f264006be60 0x7f264006e320 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2654000f60 tx=0x7f2654007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:03.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.683+0000 7f265be00640 1 -- 172.21.15.112:0/1226198418 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f26640b2d40 con 0x7f26640b3e00 2024-09-12T02:48:03.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.917+0000 7f2668c00640 1 -- 172.21.15.112:0/1226198418 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f26640cba90 con 0x7f26640b3e00 2024-09-12T02:48:03.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.918+0000 7f265be00640 1 -- 172.21.15.112:0/1226198418 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1469 (secure 0 0 0) 0x7f264c045360 con 0x7f26640b3e00 2024-09-12T02:48:03.919 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:03.919 INFO:teuthology.orchestra.run.smithi112.stdout:{"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":387,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":135,"num_osds":8,"num_up_osds":8,"osd_up_since":1726108902,"num_in_osds":8,"osd_in_since":1726108899,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":7160260,"bytes_avail":1592839740,"bytes_total":1600000000,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":70,"btime":"2024-09-12T02:48:01:488612+0000","id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":6861}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-09-12T02:47:47.036194+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T02:48:03.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.920+0000 7f2668c00640 1 -- 172.21.15.112:0/1226198418 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f264006be60 msgr2=0x7f264006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:03.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.920+0000 7f2668c00640 1 --2- 172.21.15.112:0/1226198418 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f264006be60 0x7f264006e320 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2654000f60 tx=0x7f2654007c00 comp rx=0 tx=0).stop 2024-09-12T02:48:03.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.920+0000 7f2668c00640 1 -- 172.21.15.112:0/1226198418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26640b3e00 msgr2=0x7f26641604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:03.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.920+0000 7f2668c00640 1 --2- 172.21.15.112:0/1226198418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26640b3e00 0x7f26641604e0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f264c000c00 tx=0x7f264c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:48:03.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.920+0000 7f2668c00640 1 -- 172.21.15.112:0/1226198418 shutdown_connections 2024-09-12T02:48:03.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.920+0000 7f2668c00640 1 --2- 172.21.15.112:0/1226198418 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26640d1710 0x7f26640ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:03.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.920+0000 7f2668c00640 1 --2- 172.21.15.112:0/1226198418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26640b3e00 0x7f26641604e0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:03.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.920+0000 7f2668c00640 1 --2- 172.21.15.112:0/1226198418 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f264006be60 0x7f264006e320 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:03.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.920+0000 7f2668c00640 1 --2- 172.21.15.112:0/1226198418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26640b1d70 0x7f26641582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:03.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.920+0000 7f2668c00640 1 -- 172.21.15.112:0/1226198418 >> 172.21.15.112:0/1226198418 conn(0x7f266409e030 msgr2=0x7f26640b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:03.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.920+0000 7f2668c00640 1 -- 172.21.15.112:0/1226198418 shutdown_connections 2024-09-12T02:48:03.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:03.920+0000 7f2668c00640 1 -- 172.21.15.112:0/1226198418 wait complete. 2024-09-12T02:48:03.937 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T02:48:03.938 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:48:04.079 INFO:tasks.ceph.mds.c.smithi112.stderr:2024-09-12T02:48:04.078+0000 7f601f600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:48:04.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.090+0000 7f058e200640 1 Processor -- start 2024-09-12T02:48:04.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.090+0000 7f058e200640 1 -- start start 2024-09-12T02:48:04.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.091+0000 7f058e200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0588071530 0x7f05880af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:04.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.091+0000 7f058e200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05880ceeb0 con 0x7f058815cc50 2024-09-12T02:48:04.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.091+0000 7f058e200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f058806e300 con 0x7f0588071970 2024-09-12T02:48:04.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.091+0000 7f058e200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f058815d030 con 0x7f0588071530 2024-09-12T02:48:04.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.092+0000 7f0587400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f058815cc50 0x7f05880732f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:40996/0 (socket says 172.21.15.112:40996) 2024-09-12T02:48:04.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.092+0000 7f0587400640 1 -- 172.21.15.112:0/1684865164 learned_addr learned my addr 172.21.15.112:0/1684865164 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:04.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.092+0000 7f057ea00640 1 --2- 172.21.15.112:0/1684865164 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0588071530 0x7f05880af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:04.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.092+0000 7f0586a00640 1 -- 172.21.15.112:0/1684865164 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2688661880 0 0) 0x7f05880ceeb0 con 0x7f058815cc50 2024-09-12T02:48:04.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.092+0000 7f0586a00640 1 -- 172.21.15.112:0/1684865164 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f056c003520 con 0x7f058815cc50 2024-09-12T02:48:04.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.092+0000 7f057ea00640 1 -- 172.21.15.112:0/1684865164 >> v1:172.21.15.137:6789/0 conn(0x7f0588071970 legacy=0x7f05880cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:04.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.092+0000 7f0586a00640 1 -- 172.21.15.112:0/1684865164 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 663556059 0 0) 0x7f056c003520 con 0x7f058815cc50 2024-09-12T02:48:04.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.092+0000 7f057ea00640 1 -- 172.21.15.112:0/1684865164 >> v1:172.21.15.112:6789/0 conn(0x7f058815cc50 legacy=0x7f05880732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:04.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.092+0000 7f057ea00640 1 -- 172.21.15.112:0/1684865164 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f058806e5e0 con 0x7f0588071530 2024-09-12T02:48:04.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.094+0000 7f057ea00640 1 --2- 172.21.15.112:0/1684865164 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0588071530 0x7f05880af720 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0570009740 tx=0x7f0570029f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60694c91c0a041b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:04.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.094+0000 7f0586a00640 1 -- 172.21.15.112:0/1684865164 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0570037070 con 0x7f0588071530 2024-09-12T02:48:04.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.094+0000 7f0586a00640 1 -- 172.21.15.112:0/1684865164 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f057002aa20 con 0x7f0588071530 2024-09-12T02:48:04.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.094+0000 7f0586a00640 1 -- 172.21.15.112:0/1684865164 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0578001670 con 0x7f0588071530 2024-09-12T02:48:04.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.094+0000 7f058e200640 1 -- 172.21.15.112:0/1684865164 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0588071530 msgr2=0x7f05880af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:04.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.094+0000 7f058e200640 1 --2- 172.21.15.112:0/1684865164 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0588071530 0x7f05880af720 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0570009740 tx=0x7f0570029f90 comp rx=0 tx=0).stop 2024-09-12T02:48:04.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.094+0000 7f058e200640 1 -- 172.21.15.112:0/1684865164 shutdown_connections 2024-09-12T02:48:04.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.094+0000 7f058e200640 1 --2- 172.21.15.112:0/1684865164 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0588071530 0x7f05880af720 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:04.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.094+0000 7f058e200640 1 -- 172.21.15.112:0/1684865164 >> 172.21.15.112:0/1684865164 conn(0x7f058806bbd0 msgr2=0x7f058806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:04.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.095+0000 7f058e200640 1 -- 172.21.15.112:0/1684865164 shutdown_connections 2024-09-12T02:48:04.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.095+0000 7f058e200640 1 -- 172.21.15.112:0/1684865164 wait complete. 2024-09-12T02:48:04.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.096+0000 7f058e200640 1 Processor -- start 2024-09-12T02:48:04.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.096+0000 7f058e200640 1 -- start start 2024-09-12T02:48:04.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.097+0000 7f058e200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0588071530 0x7f05881420c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:04.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.097+0000 7f058e200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0588071970 0x7f0588154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:04.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.097+0000 7f058e200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f058815cc50 0x7f0588142880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:04.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.097+0000 7f058e200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f058806f510 con 0x7f0588071970 2024-09-12T02:48:04.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.097+0000 7f058e200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f05880cf4c0 con 0x7f058815cc50 2024-09-12T02:48:04.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.097+0000 7f058e200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f058806f690 con 0x7f0588071530 2024-09-12T02:48:04.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.097+0000 7f057ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0588071970 0x7f0588154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:04.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.097+0000 7f057ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0588071970 0x7f0588154da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34400/0 (socket says 172.21.15.112:34400) 2024-09-12T02:48:04.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.097+0000 7f057ea00640 1 -- 172.21.15.112:0/3521181712 learned_addr learned my addr 172.21.15.112:0/3521181712 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:04.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.098+0000 7f0587e00640 1 --2- 172.21.15.112:0/3521181712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f058815cc50 0x7f0588142880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:04.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.098+0000 7f0587400640 1 --2- 172.21.15.112:0/3521181712 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0588071530 0x7f05881420c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:04.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.098+0000 7f057ea00640 1 -- 172.21.15.112:0/3521181712 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0588071530 msgr2=0x7f05881420c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:04.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.098+0000 7f057ea00640 1 --2- 172.21.15.112:0/3521181712 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0588071530 0x7f05881420c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:04.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.098+0000 7f057ea00640 1 -- 172.21.15.112:0/3521181712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f058815cc50 msgr2=0x7f0588142880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:04.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.098+0000 7f057ea00640 1 --2- 172.21.15.112:0/3521181712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f058815cc50 0x7f0588142880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:04.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.098+0000 7f057ea00640 1 -- 172.21.15.112:0/3521181712 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05880b3b80 con 0x7f0588071970 2024-09-12T02:48:04.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.098+0000 7f057ea00640 1 --2- 172.21.15.112:0/3521181712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0588071970 0x7f0588154da0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f0570000c00 tx=0x7f05700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:04.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.098+0000 7f057fe00640 1 -- 172.21.15.112:0/3521181712 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0570037040 con 0x7f0588071970 2024-09-12T02:48:04.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.099+0000 7f057fe00640 1 -- 172.21.15.112:0/3521181712 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0570032d40 con 0x7f0588071970 2024-09-12T02:48:04.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.099+0000 7f057fe00640 1 -- 172.21.15.112:0/3521181712 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0570005bd0 con 0x7f0588071970 2024-09-12T02:48:04.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.099+0000 7f058e200640 1 -- 172.21.15.112:0/3521181712 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05880b3e60 con 0x7f0588071970 2024-09-12T02:48:04.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.099+0000 7f058e200640 1 -- 172.21.15.112:0/3521181712 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05880b4420 con 0x7f0588071970 2024-09-12T02:48:04.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.100+0000 7f058e200640 1 -- 172.21.15.112:0/3521181712 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0588068a30 con 0x7f0588071970 2024-09-12T02:48:04.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.101+0000 7f057fe00640 1 -- 172.21.15.112:0/3521181712 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f057003a040 con 0x7f0588071970 2024-09-12T02:48:04.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.101+0000 7f057fe00640 1 --2- 172.21.15.112:0/3521181712 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f056406be30 0x7f056406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:04.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.102+0000 7f057fe00640 1 -- 172.21.15.112:0/3521181712 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f05700ab590 con 0x7f0588071970 2024-09-12T02:48:04.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.102+0000 7f0587400640 1 --2- 172.21.15.112:0/3521181712 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f056406be30 0x7f056406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:04.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.102+0000 7f0587400640 1 --2- 172.21.15.112:0/3521181712 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f056406be30 0x7f056406e2f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f05880b0f20 tx=0x7f0578001ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:04.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.106+0000 7f057fe00640 1 -- 172.21.15.112:0/3521181712 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0570079fc0 con 0x7f0588071970 2024-09-12T02:48:04.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.275+0000 7f058e200640 1 -- 172.21.15.112:0/3521181712 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f058806dff0 con 0x7f056406be30 2024-09-12T02:48:04.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.280+0000 7f057fe00640 1 -- 172.21.15.112:0/3521181712 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247993 (secure 0 0 0) 0x7f058806dff0 con 0x7f056406be30 2024-09-12T02:48:04.285 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:04.286 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:48:04.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.284+0000 7f058e200640 1 -- 172.21.15.112:0/3521181712 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f056406be30 msgr2=0x7f056406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:04.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.284+0000 7f058e200640 1 --2- 172.21.15.112:0/3521181712 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f056406be30 0x7f056406e2f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f05880b0f20 tx=0x7f0578001ba0 comp rx=0 tx=0).stop 2024-09-12T02:48:04.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.284+0000 7f058e200640 1 -- 172.21.15.112:0/3521181712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0588071970 msgr2=0x7f0588154da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:04.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.284+0000 7f058e200640 1 --2- 172.21.15.112:0/3521181712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0588071970 0x7f0588154da0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f0570000c00 tx=0x7f05700046c0 comp rx=0 tx=0).stop 2024-09-12T02:48:04.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.285+0000 7f058e200640 1 -- 172.21.15.112:0/3521181712 shutdown_connections 2024-09-12T02:48:04.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.285+0000 7f058e200640 1 --2- 172.21.15.112:0/3521181712 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f056406be30 0x7f056406e2f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:04.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.285+0000 7f058e200640 1 --2- 172.21.15.112:0/3521181712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f058815cc50 0x7f0588142880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:04.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.285+0000 7f058e200640 1 --2- 172.21.15.112:0/3521181712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0588071970 0x7f0588154da0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:04.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.285+0000 7f058e200640 1 --2- 172.21.15.112:0/3521181712 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0588071530 0x7f05881420c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:04.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.285+0000 7f058e200640 1 -- 172.21.15.112:0/3521181712 >> 172.21.15.112:0/3521181712 conn(0x7f058806bbd0 msgr2=0x7f058806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:04.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.285+0000 7f058e200640 1 -- 172.21.15.112:0/3521181712 shutdown_connections 2024-09-12T02:48:04.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:04.285+0000 7f058e200640 1 -- 172.21.15.112:0/3521181712 wait complete. 2024-09-12T02:48:04.301 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2024-09-12T02:48:03.038965+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6992,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555507,"statfs":{"total":1600000000,"available":1592839740,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001108"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657251+0000","last_change":"2024-09-12T02:47:58.492135+0000","last_active":"2024-09-12T02:47:59.657251+0000","last_peered":"2024-09-12T02:47:59.657251+0000","last_clean":"2024-09-12T02:47:59.657251+0000","last_became_active":"2024-09-12T02:47:58.491680+0000","last_became_peered":"2024-09-12T02:47:58.491680+0000","last_unstale":"2024-09-12T02:47:59.657251+0000","last_undegraded":"2024-09-12T02:47:59.657251+0000","last_fullsized":"2024-09-12T02:47:59.657251+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:26.430586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658165+0000","last_change":"2024-09-12T02:47:58.477458+0000","last_active":"2024-09-12T02:47:59.658165+0000","last_peered":"2024-09-12T02:47:59.658165+0000","last_clean":"2024-09-12T02:47:59.658165+0000","last_became_active":"2024-09-12T02:47:58.476214+0000","last_became_peered":"2024-09-12T02:47:58.476214+0000","last_unstale":"2024-09-12T02:47:59.658165+0000","last_undegraded":"2024-09-12T02:47:59.658165+0000","last_fullsized":"2024-09-12T02:47:59.658165+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:54.320063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657896+0000","last_change":"2024-09-12T02:47:58.468795+0000","last_active":"2024-09-12T02:47:59.657896+0000","last_peered":"2024-09-12T02:47:59.657896+0000","last_clean":"2024-09-12T02:47:59.657896+0000","last_became_active":"2024-09-12T02:47:58.468454+0000","last_became_peered":"2024-09-12T02:47:58.468454+0000","last_unstale":"2024-09-12T02:47:59.657896+0000","last_undegraded":"2024-09-12T02:47:59.657896+0000","last_fullsized":"2024-09-12T02:47:59.657896+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:17.276167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657230+0000","last_change":"2024-09-12T02:47:58.491774+0000","last_active":"2024-09-12T02:47:59.657230+0000","last_peered":"2024-09-12T02:47:59.657230+0000","last_clean":"2024-09-12T02:47:59.657230+0000","last_became_active":"2024-09-12T02:47:58.491423+0000","last_became_peered":"2024-09-12T02:47:58.491423+0000","last_unstale":"2024-09-12T02:47:59.657230+0000","last_undegraded":"2024-09-12T02:47:59.657230+0000","last_fullsized":"2024-09-12T02:47:59.657230+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:19:21.593656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657006+0000","last_change":"2024-09-12T02:47:58.478400+0000","last_active":"2024-09-12T02:47:59.657006+0000","last_peered":"2024-09-12T02:47:59.657006+0000","last_clean":"2024-09-12T02:47:59.657006+0000","last_became_active":"2024-09-12T02:47:58.478019+0000","last_became_peered":"2024-09-12T02:47:58.478019+0000","last_unstale":"2024-09-12T02:47:59.657006+0000","last_undegraded":"2024-09-12T02:47:59.657006+0000","last_fullsized":"2024-09-12T02:47:59.657006+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:58.214916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.463737+0000","last_change":"2024-09-12T02:47:58.477253+0000","last_active":"2024-09-12T02:47:59.463737+0000","last_peered":"2024-09-12T02:47:59.463737+0000","last_clean":"2024-09-12T02:47:59.463737+0000","last_became_active":"2024-09-12T02:47:58.477009+0000","last_became_peered":"2024-09-12T02:47:58.477009+0000","last_unstale":"2024-09-12T02:47:59.463737+0000","last_undegraded":"2024-09-12T02:47:59.463737+0000","last_fullsized":"2024-09-12T02:47:59.463737+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:45.176382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657891+0000","last_change":"2024-09-12T02:47:58.477989+0000","last_active":"2024-09-12T02:47:59.657891+0000","last_peered":"2024-09-12T02:47:59.657891+0000","last_clean":"2024-09-12T02:47:59.657891+0000","last_became_active":"2024-09-12T02:47:58.475236+0000","last_became_peered":"2024-09-12T02:47:58.475236+0000","last_unstale":"2024-09-12T02:47:59.657891+0000","last_undegraded":"2024-09-12T02:47:59.657891+0000","last_fullsized":"2024-09-12T02:47:59.657891+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:40.211187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658254+0000","last_change":"2024-09-12T02:47:58.475403+0000","last_active":"2024-09-12T02:47:59.658254+0000","last_peered":"2024-09-12T02:47:59.658254+0000","last_clean":"2024-09-12T02:47:59.658254+0000","last_became_active":"2024-09-12T02:47:58.473895+0000","last_became_peered":"2024-09-12T02:47:58.473895+0000","last_unstale":"2024-09-12T02:47:59.658254+0000","last_undegraded":"2024-09-12T02:47:59.658254+0000","last_fullsized":"2024-09-12T02:47:59.658254+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:57.448789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657370+0000","last_change":"2024-09-12T02:47:58.494247+0000","last_active":"2024-09-12T02:47:59.657370+0000","last_peered":"2024-09-12T02:47:59.657370+0000","last_clean":"2024-09-12T02:47:59.657370+0000","last_became_active":"2024-09-12T02:47:58.493866+0000","last_became_peered":"2024-09-12T02:47:58.493866+0000","last_unstale":"2024-09-12T02:47:59.657370+0000","last_undegraded":"2024-09-12T02:47:59.657370+0000","last_fullsized":"2024-09-12T02:47:59.657370+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:19.869905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657495+0000","last_change":"2024-09-12T02:47:58.487407+0000","last_active":"2024-09-12T02:47:59.657495+0000","last_peered":"2024-09-12T02:47:59.657495+0000","last_clean":"2024-09-12T02:47:59.657495+0000","last_became_active":"2024-09-12T02:47:58.487130+0000","last_became_peered":"2024-09-12T02:47:58.487130+0000","last_unstale":"2024-09-12T02:47:59.657495+0000","last_undegraded":"2024-09-12T02:47:59.657495+0000","last_fullsized":"2024-09-12T02:47:59.657495+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:56.734899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658956+0000","last_change":"2024-09-12T02:47:58.477375+0000","last_active":"2024-09-12T02:47:59.658956+0000","last_peered":"2024-09-12T02:47:59.658956+0000","last_clean":"2024-09-12T02:47:59.658956+0000","last_became_active":"2024-09-12T02:47:58.477129+0000","last_became_peered":"2024-09-12T02:47:58.477129+0000","last_unstale":"2024-09-12T02:47:59.658956+0000","last_undegraded":"2024-09-12T02:47:59.658956+0000","last_fullsized":"2024-09-12T02:47:59.658956+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:56.155548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657840+0000","last_change":"2024-09-12T02:47:58.487917+0000","last_active":"2024-09-12T02:47:59.657840+0000","last_peered":"2024-09-12T02:47:59.657840+0000","last_clean":"2024-09-12T02:47:59.657840+0000","last_became_active":"2024-09-12T02:47:58.487209+0000","last_became_peered":"2024-09-12T02:47:58.487209+0000","last_unstale":"2024-09-12T02:47:59.657840+0000","last_undegraded":"2024-09-12T02:47:59.657840+0000","last_fullsized":"2024-09-12T02:47:59.657840+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:57.757944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658051+0000","last_change":"2024-09-12T02:47:58.470300+0000","last_active":"2024-09-12T02:47:59.658051+0000","last_peered":"2024-09-12T02:47:59.658051+0000","last_clean":"2024-09-12T02:47:59.658051+0000","last_became_active":"2024-09-12T02:47:58.470038+0000","last_became_peered":"2024-09-12T02:47:58.470038+0000","last_unstale":"2024-09-12T02:47:59.658051+0000","last_undegraded":"2024-09-12T02:47:59.658051+0000","last_fullsized":"2024-09-12T02:47:59.658051+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:48.667360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657677+0000","last_change":"2024-09-12T02:47:58.476633+0000","last_active":"2024-09-12T02:47:59.657677+0000","last_peered":"2024-09-12T02:47:59.657677+0000","last_clean":"2024-09-12T02:47:59.657677+0000","last_became_active":"2024-09-12T02:47:58.474938+0000","last_became_peered":"2024-09-12T02:47:58.474938+0000","last_unstale":"2024-09-12T02:47:59.657677+0000","last_undegraded":"2024-09-12T02:47:59.657677+0000","last_fullsized":"2024-09-12T02:47:59.657677+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:00.907949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.463868+0000","last_change":"2024-09-12T02:47:58.483802+0000","last_active":"2024-09-12T02:47:59.463868+0000","last_peered":"2024-09-12T02:47:59.463868+0000","last_clean":"2024-09-12T02:47:59.463868+0000","last_became_active":"2024-09-12T02:47:58.483459+0000","last_became_peered":"2024-09-12T02:47:58.483459+0000","last_unstale":"2024-09-12T02:47:59.463868+0000","last_undegraded":"2024-09-12T02:47:59.463868+0000","last_fullsized":"2024-09-12T02:47:59.463868+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:26.223275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657372+0000","last_change":"2024-09-12T02:47:58.491943+0000","last_active":"2024-09-12T02:47:59.657372+0000","last_peered":"2024-09-12T02:47:59.657372+0000","last_clean":"2024-09-12T02:47:59.657372+0000","last_became_active":"2024-09-12T02:47:58.491252+0000","last_became_peered":"2024-09-12T02:47:58.491252+0000","last_unstale":"2024-09-12T02:47:59.657372+0000","last_undegraded":"2024-09-12T02:47:59.657372+0000","last_fullsized":"2024-09-12T02:47:59.657372+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:19.080926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658301+0000","last_change":"2024-09-12T02:47:58.476466+0000","last_active":"2024-09-12T02:47:59.658301+0000","last_peered":"2024-09-12T02:47:59.658301+0000","last_clean":"2024-09-12T02:47:59.658301+0000","last_became_active":"2024-09-12T02:47:58.475872+0000","last_became_peered":"2024-09-12T02:47:58.475872+0000","last_unstale":"2024-09-12T02:47:59.658301+0000","last_undegraded":"2024-09-12T02:47:59.658301+0000","last_fullsized":"2024-09-12T02:47:59.658301+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:32.305254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462073+0000","last_change":"2024-09-12T02:47:58.473684+0000","last_active":"2024-09-12T02:47:59.462073+0000","last_peered":"2024-09-12T02:47:59.462073+0000","last_clean":"2024-09-12T02:47:59.462073+0000","last_became_active":"2024-09-12T02:47:58.473456+0000","last_became_peered":"2024-09-12T02:47:58.473456+0000","last_unstale":"2024-09-12T02:47:59.462073+0000","last_undegraded":"2024-09-12T02:47:59.462073+0000","last_fullsized":"2024-09-12T02:47:59.462073+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:16.638630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657817+0000","last_change":"2024-09-12T02:47:58.471241+0000","last_active":"2024-09-12T02:47:59.657817+0000","last_peered":"2024-09-12T02:47:59.657817+0000","last_clean":"2024-09-12T02:47:59.657817+0000","last_became_active":"2024-09-12T02:47:58.470755+0000","last_became_peered":"2024-09-12T02:47:58.470755+0000","last_unstale":"2024-09-12T02:47:59.657817+0000","last_undegraded":"2024-09-12T02:47:59.657817+0000","last_fullsized":"2024-09-12T02:47:59.657817+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:41.369531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658589+0000","last_change":"2024-09-12T02:47:58.476172+0000","last_active":"2024-09-12T02:47:59.658589+0000","last_peered":"2024-09-12T02:47:59.658589+0000","last_clean":"2024-09-12T02:47:59.658589+0000","last_became_active":"2024-09-12T02:47:58.475844+0000","last_became_peered":"2024-09-12T02:47:58.475844+0000","last_unstale":"2024-09-12T02:47:59.658589+0000","last_undegraded":"2024-09-12T02:47:59.658589+0000","last_fullsized":"2024-09-12T02:47:59.658589+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:12.229793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.659190+0000","last_change":"2024-09-12T02:47:58.468109+0000","last_active":"2024-09-12T02:47:59.659190+0000","last_peered":"2024-09-12T02:47:59.659190+0000","last_clean":"2024-09-12T02:47:59.659190+0000","last_became_active":"2024-09-12T02:47:58.467834+0000","last_became_peered":"2024-09-12T02:47:58.467834+0000","last_unstale":"2024-09-12T02:47:59.659190+0000","last_undegraded":"2024-09-12T02:47:59.659190+0000","last_fullsized":"2024-09-12T02:47:59.659190+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:17.345970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462039+0000","last_change":"2024-09-12T02:47:58.475375+0000","last_active":"2024-09-12T02:47:59.462039+0000","last_peered":"2024-09-12T02:47:59.462039+0000","last_clean":"2024-09-12T02:47:59.462039+0000","last_became_active":"2024-09-12T02:47:58.475184+0000","last_became_peered":"2024-09-12T02:47:58.475184+0000","last_unstale":"2024-09-12T02:47:59.462039+0000","last_undegraded":"2024-09-12T02:47:59.462039+0000","last_fullsized":"2024-09-12T02:47:59.462039+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:38.989320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658949+0000","last_change":"2024-09-12T02:47:58.465999+0000","last_active":"2024-09-12T02:47:59.658949+0000","last_peered":"2024-09-12T02:47:59.658949+0000","last_clean":"2024-09-12T02:47:59.658949+0000","last_became_active":"2024-09-12T02:47:58.465741+0000","last_became_peered":"2024-09-12T02:47:58.465741+0000","last_unstale":"2024-09-12T02:47:59.658949+0000","last_undegraded":"2024-09-12T02:47:59.658949+0000","last_fullsized":"2024-09-12T02:47:59.658949+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:12.715626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462091+0000","last_change":"2024-09-12T02:47:58.464286+0000","last_active":"2024-09-12T02:47:59.462091+0000","last_peered":"2024-09-12T02:47:59.462091+0000","last_clean":"2024-09-12T02:47:59.462091+0000","last_became_active":"2024-09-12T02:47:58.464025+0000","last_became_peered":"2024-09-12T02:47:58.464025+0000","last_unstale":"2024-09-12T02:47:59.462091+0000","last_undegraded":"2024-09-12T02:47:59.462091+0000","last_fullsized":"2024-09-12T02:47:59.462091+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:29.052988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658761+0000","last_change":"2024-09-12T02:47:58.471241+0000","last_active":"2024-09-12T02:47:59.658761+0000","last_peered":"2024-09-12T02:47:59.658761+0000","last_clean":"2024-09-12T02:47:59.658761+0000","last_became_active":"2024-09-12T02:47:58.471008+0000","last_became_peered":"2024-09-12T02:47:58.471008+0000","last_unstale":"2024-09-12T02:47:59.658761+0000","last_undegraded":"2024-09-12T02:47:59.658761+0000","last_fullsized":"2024-09-12T02:47:59.658761+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:12.683296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657504+0000","last_change":"2024-09-12T02:47:58.484925+0000","last_active":"2024-09-12T02:47:59.657504+0000","last_peered":"2024-09-12T02:47:59.657504+0000","last_clean":"2024-09-12T02:47:59.657504+0000","last_became_active":"2024-09-12T02:47:58.484536+0000","last_became_peered":"2024-09-12T02:47:58.484536+0000","last_unstale":"2024-09-12T02:47:59.657504+0000","last_undegraded":"2024-09-12T02:47:59.657504+0000","last_fullsized":"2024-09-12T02:47:59.657504+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:09.731850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.463578+0000","last_change":"2024-09-12T02:47:58.489826+0000","last_active":"2024-09-12T02:47:59.463578+0000","last_peered":"2024-09-12T02:47:59.463578+0000","last_clean":"2024-09-12T02:47:59.463578+0000","last_became_active":"2024-09-12T02:47:58.489596+0000","last_became_peered":"2024-09-12T02:47:58.489596+0000","last_unstale":"2024-09-12T02:47:59.463578+0000","last_undegraded":"2024-09-12T02:47:59.463578+0000","last_fullsized":"2024-09-12T02:47:59.463578+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:11.166299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462035+0000","last_change":"2024-09-12T02:47:58.480214+0000","last_active":"2024-09-12T02:47:59.462035+0000","last_peered":"2024-09-12T02:47:59.462035+0000","last_clean":"2024-09-12T02:47:59.462035+0000","last_became_active":"2024-09-12T02:47:58.479967+0000","last_became_peered":"2024-09-12T02:47:58.479967+0000","last_unstale":"2024-09-12T02:47:59.462035+0000","last_undegraded":"2024-09-12T02:47:59.462035+0000","last_fullsized":"2024-09-12T02:47:59.462035+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:56.675644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657667+0000","last_change":"2024-09-12T02:47:58.470114+0000","last_active":"2024-09-12T02:47:59.657667+0000","last_peered":"2024-09-12T02:47:59.657667+0000","last_clean":"2024-09-12T02:47:59.657667+0000","last_became_active":"2024-09-12T02:47:58.469753+0000","last_became_peered":"2024-09-12T02:47:58.469753+0000","last_unstale":"2024-09-12T02:47:59.657667+0000","last_undegraded":"2024-09-12T02:47:59.657667+0000","last_fullsized":"2024-09-12T02:47:59.657667+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:53:23.482151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657354+0000","last_change":"2024-09-12T02:47:58.479009+0000","last_active":"2024-09-12T02:47:59.657354+0000","last_peered":"2024-09-12T02:47:59.657354+0000","last_clean":"2024-09-12T02:47:59.657354+0000","last_became_active":"2024-09-12T02:47:58.478705+0000","last_became_peered":"2024-09-12T02:47:58.478705+0000","last_unstale":"2024-09-12T02:47:59.657354+0000","last_undegraded":"2024-09-12T02:47:59.657354+0000","last_fullsized":"2024-09-12T02:47:59.657354+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:49.893384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657634+0000","last_change":"2024-09-12T02:47:58.484752+0000","last_active":"2024-09-12T02:47:59.657634+0000","last_peered":"2024-09-12T02:47:59.657634+0000","last_clean":"2024-09-12T02:47:59.657634+0000","last_became_active":"2024-09-12T02:47:58.484214+0000","last_became_peered":"2024-09-12T02:47:58.484214+0000","last_unstale":"2024-09-12T02:47:59.657634+0000","last_undegraded":"2024-09-12T02:47:59.657634+0000","last_fullsized":"2024-09-12T02:47:59.657634+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:21.654771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.463764+0000","last_change":"2024-09-12T02:47:58.472823+0000","last_active":"2024-09-12T02:47:59.463764+0000","last_peered":"2024-09-12T02:47:59.463764+0000","last_clean":"2024-09-12T02:47:59.463764+0000","last_became_active":"2024-09-12T02:47:58.472589+0000","last_became_peered":"2024-09-12T02:47:58.472589+0000","last_unstale":"2024-09-12T02:47:59.463764+0000","last_undegraded":"2024-09-12T02:47:59.463764+0000","last_fullsized":"2024-09-12T02:47:59.463764+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:40.224279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.463489+0000","last_change":"2024-09-12T02:47:58.470585+0000","last_active":"2024-09-12T02:47:59.463489+0000","last_peered":"2024-09-12T02:47:59.463489+0000","last_clean":"2024-09-12T02:47:59.463489+0000","last_became_active":"2024-09-12T02:47:58.469471+0000","last_became_peered":"2024-09-12T02:47:58.469471+0000","last_unstale":"2024-09-12T02:47:59.463489+0000","last_undegraded":"2024-09-12T02:47:59.463489+0000","last_fullsized":"2024-09-12T02:47:59.463489+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:52.390760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"134'4","reported_seq":18,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657434+0000","last_change":"2024-09-12T02:47:57.468829+0000","last_active":"2024-09-12T02:47:59.657434+0000","last_peered":"2024-09-12T02:47:59.657434+0000","last_clean":"2024-09-12T02:47:59.657434+0000","last_became_active":"2024-09-12T02:47:57.468528+0000","last_became_peered":"2024-09-12T02:47:57.468528+0000","last_unstale":"2024-09-12T02:47:59.657434+0000","last_undegraded":"2024-09-12T02:47:59.657434+0000","last_fullsized":"2024-09-12T02:47:59.657434+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:47.803523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462273+0000","last_change":"2024-09-12T02:47:58.478037+0000","last_active":"2024-09-12T02:47:59.462273+0000","last_peered":"2024-09-12T02:47:59.462273+0000","last_clean":"2024-09-12T02:47:59.462273+0000","last_became_active":"2024-09-12T02:47:58.477793+0000","last_became_peered":"2024-09-12T02:47:58.477793+0000","last_unstale":"2024-09-12T02:47:59.462273+0000","last_undegraded":"2024-09-12T02:47:59.462273+0000","last_fullsized":"2024-09-12T02:47:59.462273+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:06.691112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"134'1","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658192+0000","last_change":"2024-09-12T02:47:57.469448+0000","last_active":"2024-09-12T02:47:59.658192+0000","last_peered":"2024-09-12T02:47:59.658192+0000","last_clean":"2024-09-12T02:47:59.658192+0000","last_became_active":"2024-09-12T02:47:57.469225+0000","last_became_peered":"2024-09-12T02:47:57.469225+0000","last_unstale":"2024-09-12T02:47:59.658192+0000","last_undegraded":"2024-09-12T02:47:59.658192+0000","last_fullsized":"2024-09-12T02:47:59.658192+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:41.674158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.463895+0000","last_change":"2024-09-12T02:47:58.485832+0000","last_active":"2024-09-12T02:47:59.463895+0000","last_peered":"2024-09-12T02:47:59.463895+0000","last_clean":"2024-09-12T02:47:59.463895+0000","last_became_active":"2024-09-12T02:47:58.479353+0000","last_became_peered":"2024-09-12T02:47:58.479353+0000","last_unstale":"2024-09-12T02:47:59.463895+0000","last_undegraded":"2024-09-12T02:47:59.463895+0000","last_fullsized":"2024-09-12T02:47:59.463895+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:33.434145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"134'2","reported_seq":16,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657452+0000","last_change":"2024-09-12T02:47:57.471489+0000","last_active":"2024-09-12T02:47:59.657452+0000","last_peered":"2024-09-12T02:47:59.657452+0000","last_clean":"2024-09-12T02:47:59.657452+0000","last_became_active":"2024-09-12T02:47:57.470912+0000","last_became_peered":"2024-09-12T02:47:57.470912+0000","last_unstale":"2024-09-12T02:47:59.657452+0000","last_undegraded":"2024-09-12T02:47:59.657452+0000","last_fullsized":"2024-09-12T02:47:59.657452+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:18.855629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658664+0000","last_change":"2024-09-12T02:47:58.474352+0000","last_active":"2024-09-12T02:47:59.658664+0000","last_peered":"2024-09-12T02:47:59.658664+0000","last_clean":"2024-09-12T02:47:59.658664+0000","last_became_active":"2024-09-12T02:47:58.474057+0000","last_became_peered":"2024-09-12T02:47:58.474057+0000","last_unstale":"2024-09-12T02:47:59.658664+0000","last_undegraded":"2024-09-12T02:47:59.658664+0000","last_fullsized":"2024-09-12T02:47:59.658664+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:09.373910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"134'2","reported_seq":16,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657102+0000","last_change":"2024-09-12T02:47:57.471168+0000","last_active":"2024-09-12T02:47:59.657102+0000","last_peered":"2024-09-12T02:47:59.657102+0000","last_clean":"2024-09-12T02:47:59.657102+0000","last_became_active":"2024-09-12T02:47:57.470929+0000","last_became_peered":"2024-09-12T02:47:57.470929+0000","last_unstale":"2024-09-12T02:47:59.657102+0000","last_undegraded":"2024-09-12T02:47:59.657102+0000","last_fullsized":"2024-09-12T02:47:59.657102+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:58.228885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657339+0000","last_change":"2024-09-12T02:47:58.486735+0000","last_active":"2024-09-12T02:47:59.657339+0000","last_peered":"2024-09-12T02:47:59.657339+0000","last_clean":"2024-09-12T02:47:59.657339+0000","last_became_active":"2024-09-12T02:47:58.484411+0000","last_became_peered":"2024-09-12T02:47:58.484411+0000","last_unstale":"2024-09-12T02:47:59.657339+0000","last_undegraded":"2024-09-12T02:47:59.657339+0000","last_fullsized":"2024-09-12T02:47:59.657339+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:18.861217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"134'1","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657716+0000","last_change":"2024-09-12T02:47:57.470089+0000","last_active":"2024-09-12T02:47:59.657716+0000","last_peered":"2024-09-12T02:47:59.657716+0000","last_clean":"2024-09-12T02:47:59.657716+0000","last_became_active":"2024-09-12T02:47:57.468952+0000","last_became_peered":"2024-09-12T02:47:57.468952+0000","last_unstale":"2024-09-12T02:47:59.657716+0000","last_undegraded":"2024-09-12T02:47:59.657716+0000","last_fullsized":"2024-09-12T02:47:59.657716+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:08.373552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658441+0000","last_change":"2024-09-12T02:47:58.485250+0000","last_active":"2024-09-12T02:47:59.658441+0000","last_peered":"2024-09-12T02:47:59.658441+0000","last_clean":"2024-09-12T02:47:59.658441+0000","last_became_active":"2024-09-12T02:47:58.485093+0000","last_became_peered":"2024-09-12T02:47:58.485093+0000","last_unstale":"2024-09-12T02:47:59.658441+0000","last_undegraded":"2024-09-12T02:47:59.658441+0000","last_fullsized":"2024-09-12T02:47:59.658441+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:12.195892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"134'1","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462285+0000","last_change":"2024-09-12T02:47:57.464833+0000","last_active":"2024-09-12T02:47:59.462285+0000","last_peered":"2024-09-12T02:47:59.462285+0000","last_clean":"2024-09-12T02:47:59.462285+0000","last_became_active":"2024-09-12T02:47:57.464435+0000","last_became_peered":"2024-09-12T02:47:57.464435+0000","last_unstale":"2024-09-12T02:47:59.462285+0000","last_undegraded":"2024-09-12T02:47:59.462285+0000","last_fullsized":"2024-09-12T02:47:59.462285+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:53.327488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657641+0000","last_change":"2024-09-12T02:47:58.493422+0000","last_active":"2024-09-12T02:47:59.657641+0000","last_peered":"2024-09-12T02:47:59.657641+0000","last_clean":"2024-09-12T02:47:59.657641+0000","last_became_active":"2024-09-12T02:47:58.491683+0000","last_became_peered":"2024-09-12T02:47:58.491683+0000","last_unstale":"2024-09-12T02:47:59.657641+0000","last_undegraded":"2024-09-12T02:47:59.657641+0000","last_fullsized":"2024-09-12T02:47:59.657641+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:59.496942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657910+0000","last_change":"2024-09-12T02:47:57.460129+0000","last_active":"2024-09-12T02:47:59.657910+0000","last_peered":"2024-09-12T02:47:59.657910+0000","last_clean":"2024-09-12T02:47:59.657910+0000","last_became_active":"2024-09-12T02:47:57.459834+0000","last_became_peered":"2024-09-12T02:47:57.459834+0000","last_unstale":"2024-09-12T02:47:59.657910+0000","last_undegraded":"2024-09-12T02:47:59.657910+0000","last_fullsized":"2024-09-12T02:47:59.657910+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:30.593173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657319+0000","last_change":"2024-09-12T02:47:58.478421+0000","last_active":"2024-09-12T02:47:59.657319+0000","last_peered":"2024-09-12T02:47:59.657319+0000","last_clean":"2024-09-12T02:47:59.657319+0000","last_became_active":"2024-09-12T02:47:58.478146+0000","last_became_peered":"2024-09-12T02:47:58.478146+0000","last_unstale":"2024-09-12T02:47:59.657319+0000","last_undegraded":"2024-09-12T02:47:59.657319+0000","last_fullsized":"2024-09-12T02:47:59.657319+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:00.922266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657919+0000","last_change":"2024-09-12T02:47:57.464663+0000","last_active":"2024-09-12T02:47:59.657919+0000","last_peered":"2024-09-12T02:47:59.657919+0000","last_clean":"2024-09-12T02:47:59.657919+0000","last_became_active":"2024-09-12T02:47:57.464447+0000","last_became_peered":"2024-09-12T02:47:57.464447+0000","last_unstale":"2024-09-12T02:47:59.657919+0000","last_undegraded":"2024-09-12T02:47:59.657919+0000","last_fullsized":"2024-09-12T02:47:59.657919+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:21.366974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657614+0000","last_change":"2024-09-12T02:47:58.471405+0000","last_active":"2024-09-12T02:47:59.657614+0000","last_peered":"2024-09-12T02:47:59.657614+0000","last_clean":"2024-09-12T02:47:59.657614+0000","last_became_active":"2024-09-12T02:47:58.471173+0000","last_became_peered":"2024-09-12T02:47:58.471173+0000","last_unstale":"2024-09-12T02:47:59.657614+0000","last_undegraded":"2024-09-12T02:47:59.657614+0000","last_fullsized":"2024-09-12T02:47:59.657614+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:56.640889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657203+0000","last_change":"2024-09-12T02:47:57.472855+0000","last_active":"2024-09-12T02:47:59.657203+0000","last_peered":"2024-09-12T02:47:59.657203+0000","last_clean":"2024-09-12T02:47:59.657203+0000","last_became_active":"2024-09-12T02:47:57.472612+0000","last_became_peered":"2024-09-12T02:47:57.472612+0000","last_unstale":"2024-09-12T02:47:59.657203+0000","last_undegraded":"2024-09-12T02:47:59.657203+0000","last_fullsized":"2024-09-12T02:47:59.657203+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:01.919748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462517+0000","last_change":"2024-09-12T02:47:58.488331+0000","last_active":"2024-09-12T02:47:59.462517+0000","last_peered":"2024-09-12T02:47:59.462517+0000","last_clean":"2024-09-12T02:47:59.462517+0000","last_became_active":"2024-09-12T02:47:58.487984+0000","last_became_peered":"2024-09-12T02:47:58.487984+0000","last_unstale":"2024-09-12T02:47:59.462517+0000","last_undegraded":"2024-09-12T02:47:59.462517+0000","last_fullsized":"2024-09-12T02:47:59.462517+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:53:04.404665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462328+0000","last_change":"2024-09-12T02:47:57.461370+0000","last_active":"2024-09-12T02:47:59.462328+0000","last_peered":"2024-09-12T02:47:59.462328+0000","last_clean":"2024-09-12T02:47:59.462328+0000","last_became_active":"2024-09-12T02:47:57.461153+0000","last_became_peered":"2024-09-12T02:47:57.461153+0000","last_unstale":"2024-09-12T02:47:59.462328+0000","last_undegraded":"2024-09-12T02:47:59.462328+0000","last_fullsized":"2024-09-12T02:47:59.462328+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:54.948833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462187+0000","last_change":"2024-09-12T02:47:58.466934+0000","last_active":"2024-09-12T02:47:59.462187+0000","last_peered":"2024-09-12T02:47:59.462187+0000","last_clean":"2024-09-12T02:47:59.462187+0000","last_became_active":"2024-09-12T02:47:58.465938+0000","last_became_peered":"2024-09-12T02:47:58.465938+0000","last_unstale":"2024-09-12T02:47:59.462187+0000","last_undegraded":"2024-09-12T02:47:59.462187+0000","last_fullsized":"2024-09-12T02:47:59.462187+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:50.087258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"134'3","reported_seq":17,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657635+0000","last_change":"2024-09-12T02:47:57.469395+0000","last_active":"2024-09-12T02:47:59.657635+0000","last_peered":"2024-09-12T02:47:59.657635+0000","last_clean":"2024-09-12T02:47:59.657635+0000","last_became_active":"2024-09-12T02:47:57.469170+0000","last_became_peered":"2024-09-12T02:47:57.469170+0000","last_unstale":"2024-09-12T02:47:59.657635+0000","last_undegraded":"2024-09-12T02:47:59.657635+0000","last_fullsized":"2024-09-12T02:47:59.657635+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:15.633103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657243+0000","last_change":"2024-09-12T02:47:58.469912+0000","last_active":"2024-09-12T02:47:59.657243+0000","last_peered":"2024-09-12T02:47:59.657243+0000","last_clean":"2024-09-12T02:47:59.657243+0000","last_became_active":"2024-09-12T02:47:58.469662+0000","last_became_peered":"2024-09-12T02:47:58.469662+0000","last_unstale":"2024-09-12T02:47:59.657243+0000","last_undegraded":"2024-09-12T02:47:59.657243+0000","last_fullsized":"2024-09-12T02:47:59.657243+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:04.770245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"134'6","reported_seq":20,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657525+0000","last_change":"2024-09-12T02:47:57.462911+0000","last_active":"2024-09-12T02:47:59.657525+0000","last_peered":"2024-09-12T02:47:59.657525+0000","last_clean":"2024-09-12T02:47:59.657525+0000","last_became_active":"2024-09-12T02:47:57.462658+0000","last_became_peered":"2024-09-12T02:47:57.462658+0000","last_unstale":"2024-09-12T02:47:59.657525+0000","last_undegraded":"2024-09-12T02:47:59.657525+0000","last_fullsized":"2024-09-12T02:47:59.657525+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:30.117038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462327+0000","last_change":"2024-09-12T02:47:58.474314+0000","last_active":"2024-09-12T02:47:59.462327+0000","last_peered":"2024-09-12T02:47:59.462327+0000","last_clean":"2024-09-12T02:47:59.462327+0000","last_became_active":"2024-09-12T02:47:58.470908+0000","last_became_peered":"2024-09-12T02:47:58.470908+0000","last_unstale":"2024-09-12T02:47:59.462327+0000","last_undegraded":"2024-09-12T02:47:59.462327+0000","last_fullsized":"2024-09-12T02:47:59.462327+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:52.392958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"134'2","reported_seq":16,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.464003+0000","last_change":"2024-09-12T02:47:57.465729+0000","last_active":"2024-09-12T02:47:59.464003+0000","last_peered":"2024-09-12T02:47:59.464003+0000","last_clean":"2024-09-12T02:47:59.464003+0000","last_became_active":"2024-09-12T02:47:57.465502+0000","last_became_peered":"2024-09-12T02:47:57.465502+0000","last_unstale":"2024-09-12T02:47:59.464003+0000","last_undegraded":"2024-09-12T02:47:59.464003+0000","last_fullsized":"2024-09-12T02:47:59.464003+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:54.210973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462558+0000","last_change":"2024-09-12T02:47:58.464174+0000","last_active":"2024-09-12T02:47:59.462558+0000","last_peered":"2024-09-12T02:47:59.462558+0000","last_clean":"2024-09-12T02:47:59.462558+0000","last_became_active":"2024-09-12T02:47:58.463913+0000","last_became_peered":"2024-09-12T02:47:58.463913+0000","last_unstale":"2024-09-12T02:47:59.462558+0000","last_undegraded":"2024-09-12T02:47:59.462558+0000","last_fullsized":"2024-09-12T02:47:59.462558+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:01.950187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462617+0000","last_change":"2024-09-12T02:47:57.467217+0000","last_active":"2024-09-12T02:47:59.462617+0000","last_peered":"2024-09-12T02:47:59.462617+0000","last_clean":"2024-09-12T02:47:59.462617+0000","last_became_active":"2024-09-12T02:47:57.466879+0000","last_became_peered":"2024-09-12T02:47:57.466879+0000","last_unstale":"2024-09-12T02:47:59.462617+0000","last_undegraded":"2024-09-12T02:47:59.462617+0000","last_fullsized":"2024-09-12T02:47:59.462617+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:53.641332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462232+0000","last_change":"2024-09-12T02:47:58.466536+0000","last_active":"2024-09-12T02:47:59.462232+0000","last_peered":"2024-09-12T02:47:59.462232+0000","last_clean":"2024-09-12T02:47:59.462232+0000","last_became_active":"2024-09-12T02:47:58.466245+0000","last_became_peered":"2024-09-12T02:47:58.466245+0000","last_unstale":"2024-09-12T02:47:59.462232+0000","last_undegraded":"2024-09-12T02:47:59.462232+0000","last_fullsized":"2024-09-12T02:47:59.462232+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:14.125248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"134'8","reported_seq":22,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657097+0000","last_change":"2024-09-12T02:47:57.470285+0000","last_active":"2024-09-12T02:47:59.657097+0000","last_peered":"2024-09-12T02:47:59.657097+0000","last_clean":"2024-09-12T02:47:59.657097+0000","last_became_active":"2024-09-12T02:47:57.469886+0000","last_became_peered":"2024-09-12T02:47:57.469886+0000","last_unstale":"2024-09-12T02:47:59.657097+0000","last_undegraded":"2024-09-12T02:47:59.657097+0000","last_fullsized":"2024-09-12T02:47:59.657097+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:38.797454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657187+0000","last_change":"2024-09-12T02:47:58.489660+0000","last_active":"2024-09-12T02:47:59.657187+0000","last_peered":"2024-09-12T02:47:59.657187+0000","last_clean":"2024-09-12T02:47:59.657187+0000","last_became_active":"2024-09-12T02:47:58.489459+0000","last_became_peered":"2024-09-12T02:47:58.489459+0000","last_unstale":"2024-09-12T02:47:59.657187+0000","last_undegraded":"2024-09-12T02:47:59.657187+0000","last_fullsized":"2024-09-12T02:47:59.657187+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:54.181380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"134'1","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657618+0000","last_change":"2024-09-12T02:47:57.466554+0000","last_active":"2024-09-12T02:47:59.657618+0000","last_peered":"2024-09-12T02:47:59.657618+0000","last_clean":"2024-09-12T02:47:59.657618+0000","last_became_active":"2024-09-12T02:47:57.466337+0000","last_became_peered":"2024-09-12T02:47:57.466337+0000","last_unstale":"2024-09-12T02:47:59.657618+0000","last_undegraded":"2024-09-12T02:47:59.657618+0000","last_fullsized":"2024-09-12T02:47:59.657618+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:08.072830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.463640+0000","last_change":"2024-09-12T02:47:58.489228+0000","last_active":"2024-09-12T02:47:59.463640+0000","last_peered":"2024-09-12T02:47:59.463640+0000","last_clean":"2024-09-12T02:47:59.463640+0000","last_became_active":"2024-09-12T02:47:58.488974+0000","last_became_peered":"2024-09-12T02:47:58.488974+0000","last_unstale":"2024-09-12T02:47:59.463640+0000","last_undegraded":"2024-09-12T02:47:59.463640+0000","last_fullsized":"2024-09-12T02:47:59.463640+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:19.842369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"134'2","reported_seq":16,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657544+0000","last_change":"2024-09-12T02:47:57.471259+0000","last_active":"2024-09-12T02:47:59.657544+0000","last_peered":"2024-09-12T02:47:59.657544+0000","last_clean":"2024-09-12T02:47:59.657544+0000","last_became_active":"2024-09-12T02:47:57.470578+0000","last_became_peered":"2024-09-12T02:47:57.470578+0000","last_unstale":"2024-09-12T02:47:59.657544+0000","last_undegraded":"2024-09-12T02:47:59.657544+0000","last_fullsized":"2024-09-12T02:47:59.657544+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:13.205170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658142+0000","last_change":"2024-09-12T02:47:58.487419+0000","last_active":"2024-09-12T02:47:59.658142+0000","last_peered":"2024-09-12T02:47:59.658142+0000","last_clean":"2024-09-12T02:47:59.658142+0000","last_became_active":"2024-09-12T02:47:58.487154+0000","last_became_peered":"2024-09-12T02:47:58.487154+0000","last_unstale":"2024-09-12T02:47:59.658142+0000","last_undegraded":"2024-09-12T02:47:59.658142+0000","last_fullsized":"2024-09-12T02:47:59.658142+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:19.637662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"134'1","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462711+0000","last_change":"2024-09-12T02:47:57.461685+0000","last_active":"2024-09-12T02:47:59.462711+0000","last_peered":"2024-09-12T02:47:59.462711+0000","last_clean":"2024-09-12T02:47:59.462711+0000","last_became_active":"2024-09-12T02:47:57.461464+0000","last_became_peered":"2024-09-12T02:47:57.461464+0000","last_unstale":"2024-09-12T02:47:59.462711+0000","last_undegraded":"2024-09-12T02:47:59.462711+0000","last_fullsized":"2024-09-12T02:47:59.462711+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:56.601521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658428+0000","last_change":"2024-09-12T02:47:58.471958+0000","last_active":"2024-09-12T02:47:59.658428+0000","last_peered":"2024-09-12T02:47:59.658428+0000","last_clean":"2024-09-12T02:47:59.658428+0000","last_became_active":"2024-09-12T02:47:58.471631+0000","last_became_peered":"2024-09-12T02:47:58.471631+0000","last_unstale":"2024-09-12T02:47:59.658428+0000","last_undegraded":"2024-09-12T02:47:59.658428+0000","last_fullsized":"2024-09-12T02:47:59.658428+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:44.863409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658082+0000","last_change":"2024-09-12T02:47:57.470460+0000","last_active":"2024-09-12T02:47:59.658082+0000","last_peered":"2024-09-12T02:47:59.658082+0000","last_clean":"2024-09-12T02:47:59.658082+0000","last_became_active":"2024-09-12T02:47:57.469717+0000","last_became_peered":"2024-09-12T02:47:57.469717+0000","last_unstale":"2024-09-12T02:47:59.658082+0000","last_undegraded":"2024-09-12T02:47:59.658082+0000","last_fullsized":"2024-09-12T02:47:59.658082+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:17.020019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658106+0000","last_change":"2024-09-12T02:47:58.471037+0000","last_active":"2024-09-12T02:47:59.658106+0000","last_peered":"2024-09-12T02:47:59.658106+0000","last_clean":"2024-09-12T02:47:59.658106+0000","last_became_active":"2024-09-12T02:47:58.468784+0000","last_became_peered":"2024-09-12T02:47:58.468784+0000","last_unstale":"2024-09-12T02:47:59.658106+0000","last_undegraded":"2024-09-12T02:47:59.658106+0000","last_fullsized":"2024-09-12T02:47:59.658106+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:19.165896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"134'2","reported_seq":16,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.463686+0000","last_change":"2024-09-12T02:47:57.471049+0000","last_active":"2024-09-12T02:47:59.463686+0000","last_peered":"2024-09-12T02:47:59.463686+0000","last_clean":"2024-09-12T02:47:59.463686+0000","last_became_active":"2024-09-12T02:47:57.470590+0000","last_became_peered":"2024-09-12T02:47:57.470590+0000","last_unstale":"2024-09-12T02:47:59.463686+0000","last_undegraded":"2024-09-12T02:47:59.463686+0000","last_fullsized":"2024-09-12T02:47:59.463686+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:50.671578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657508+0000","last_change":"2024-09-12T02:47:58.479325+0000","last_active":"2024-09-12T02:47:59.657508+0000","last_peered":"2024-09-12T02:47:59.657508+0000","last_clean":"2024-09-12T02:47:59.657508+0000","last_became_active":"2024-09-12T02:47:58.478875+0000","last_became_peered":"2024-09-12T02:47:58.478875+0000","last_unstale":"2024-09-12T02:47:59.657508+0000","last_undegraded":"2024-09-12T02:47:59.657508+0000","last_fullsized":"2024-09-12T02:47:59.657508+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:04.345700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657009+0000","last_change":"2024-09-12T02:47:57.469255+0000","last_active":"2024-09-12T02:47:59.657009+0000","last_peered":"2024-09-12T02:47:59.657009+0000","last_clean":"2024-09-12T02:47:59.657009+0000","last_became_active":"2024-09-12T02:47:57.468941+0000","last_became_peered":"2024-09-12T02:47:57.468941+0000","last_unstale":"2024-09-12T02:47:59.657009+0000","last_undegraded":"2024-09-12T02:47:59.657009+0000","last_fullsized":"2024-09-12T02:47:59.657009+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:48.881697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658589+0000","last_change":"2024-09-12T02:47:58.474149+0000","last_active":"2024-09-12T02:47:59.658589+0000","last_peered":"2024-09-12T02:47:59.658589+0000","last_clean":"2024-09-12T02:47:59.658589+0000","last_became_active":"2024-09-12T02:47:58.473882+0000","last_became_peered":"2024-09-12T02:47:58.473882+0000","last_unstale":"2024-09-12T02:47:59.658589+0000","last_undegraded":"2024-09-12T02:47:59.658589+0000","last_fullsized":"2024-09-12T02:47:59.658589+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:17.412911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.464107+0000","last_change":"2024-09-12T02:47:57.470430+0000","last_active":"2024-09-12T02:47:59.464107+0000","last_peered":"2024-09-12T02:47:59.464107+0000","last_clean":"2024-09-12T02:47:59.464107+0000","last_became_active":"2024-09-12T02:47:57.470194+0000","last_became_peered":"2024-09-12T02:47:57.470194+0000","last_unstale":"2024-09-12T02:47:59.464107+0000","last_undegraded":"2024-09-12T02:47:59.464107+0000","last_fullsized":"2024-09-12T02:47:59.464107+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:11.236614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462628+0000","last_change":"2024-09-12T02:47:58.487861+0000","last_active":"2024-09-12T02:47:59.462628+0000","last_peered":"2024-09-12T02:47:59.462628+0000","last_clean":"2024-09-12T02:47:59.462628+0000","last_became_active":"2024-09-12T02:47:58.487641+0000","last_became_peered":"2024-09-12T02:47:58.487641+0000","last_unstale":"2024-09-12T02:47:59.462628+0000","last_undegraded":"2024-09-12T02:47:59.462628+0000","last_fullsized":"2024-09-12T02:47:59.462628+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:07.702840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658025+0000","last_change":"2024-09-12T02:47:57.472550+0000","last_active":"2024-09-12T02:47:59.658025+0000","last_peered":"2024-09-12T02:47:59.658025+0000","last_clean":"2024-09-12T02:47:59.658025+0000","last_became_active":"2024-09-12T02:47:57.472338+0000","last_became_peered":"2024-09-12T02:47:57.472338+0000","last_unstale":"2024-09-12T02:47:59.658025+0000","last_undegraded":"2024-09-12T02:47:59.658025+0000","last_fullsized":"2024-09-12T02:47:59.658025+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:54.708104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462510+0000","last_change":"2024-09-12T02:47:58.487842+0000","last_active":"2024-09-12T02:47:59.462510+0000","last_peered":"2024-09-12T02:47:59.462510+0000","last_clean":"2024-09-12T02:47:59.462510+0000","last_became_active":"2024-09-12T02:47:58.487603+0000","last_became_peered":"2024-09-12T02:47:58.487603+0000","last_unstale":"2024-09-12T02:47:59.462510+0000","last_undegraded":"2024-09-12T02:47:59.462510+0000","last_fullsized":"2024-09-12T02:47:59.462510+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:27.828313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"134'2","reported_seq":16,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462503+0000","last_change":"2024-09-12T02:47:57.462356+0000","last_active":"2024-09-12T02:47:59.462503+0000","last_peered":"2024-09-12T02:47:59.462503+0000","last_clean":"2024-09-12T02:47:59.462503+0000","last_became_active":"2024-09-12T02:47:57.461958+0000","last_became_peered":"2024-09-12T02:47:57.461958+0000","last_unstale":"2024-09-12T02:47:59.462503+0000","last_undegraded":"2024-09-12T02:47:59.462503+0000","last_fullsized":"2024-09-12T02:47:59.462503+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:34.205886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657967+0000","last_change":"2024-09-12T02:47:58.487736+0000","last_active":"2024-09-12T02:47:59.657967+0000","last_peered":"2024-09-12T02:47:59.657967+0000","last_clean":"2024-09-12T02:47:59.657967+0000","last_became_active":"2024-09-12T02:47:58.486888+0000","last_became_peered":"2024-09-12T02:47:58.486888+0000","last_unstale":"2024-09-12T02:47:59.657967+0000","last_undegraded":"2024-09-12T02:47:59.657967+0000","last_fullsized":"2024-09-12T02:47:59.657967+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:51.874146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"135'1","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462626+0000","last_change":"2024-09-12T02:47:57.464602+0000","last_active":"2024-09-12T02:47:59.462626+0000","last_peered":"2024-09-12T02:47:59.462626+0000","last_clean":"2024-09-12T02:47:59.462626+0000","last_became_active":"2024-09-12T02:47:57.464369+0000","last_became_peered":"2024-09-12T02:47:57.464369+0000","last_unstale":"2024-09-12T02:47:59.462626+0000","last_undegraded":"2024-09-12T02:47:59.462626+0000","last_fullsized":"2024-09-12T02:47:59.462626+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:55.756238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657836+0000","last_change":"2024-09-12T02:47:58.492167+0000","last_active":"2024-09-12T02:47:59.657836+0000","last_peered":"2024-09-12T02:47:59.657836+0000","last_clean":"2024-09-12T02:47:59.657836+0000","last_became_active":"2024-09-12T02:47:58.491345+0000","last_became_peered":"2024-09-12T02:47:58.491345+0000","last_unstale":"2024-09-12T02:47:59.657836+0000","last_undegraded":"2024-09-12T02:47:59.657836+0000","last_fullsized":"2024-09-12T02:47:59.657836+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:28.917871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657713+0000","last_change":"2024-09-12T02:47:57.473286+0000","last_active":"2024-09-12T02:47:59.657713+0000","last_peered":"2024-09-12T02:47:59.657713+0000","last_clean":"2024-09-12T02:47:59.657713+0000","last_became_active":"2024-09-12T02:47:57.472708+0000","last_became_peered":"2024-09-12T02:47:57.472708+0000","last_unstale":"2024-09-12T02:47:59.657713+0000","last_undegraded":"2024-09-12T02:47:59.657713+0000","last_fullsized":"2024-09-12T02:47:59.657713+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:49.455512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462501+0000","last_change":"2024-09-12T02:47:58.487845+0000","last_active":"2024-09-12T02:47:59.462501+0000","last_peered":"2024-09-12T02:47:59.462501+0000","last_clean":"2024-09-12T02:47:59.462501+0000","last_became_active":"2024-09-12T02:47:58.487581+0000","last_became_peered":"2024-09-12T02:47:58.487581+0000","last_unstale":"2024-09-12T02:47:59.462501+0000","last_undegraded":"2024-09-12T02:47:59.462501+0000","last_fullsized":"2024-09-12T02:47:59.462501+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:24.328260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462671+0000","last_change":"2024-09-12T02:47:57.464547+0000","last_active":"2024-09-12T02:47:59.462671+0000","last_peered":"2024-09-12T02:47:59.462671+0000","last_clean":"2024-09-12T02:47:59.462671+0000","last_became_active":"2024-09-12T02:47:57.464317+0000","last_became_peered":"2024-09-12T02:47:57.464317+0000","last_unstale":"2024-09-12T02:47:59.462671+0000","last_undegraded":"2024-09-12T02:47:59.462671+0000","last_fullsized":"2024-09-12T02:47:59.462671+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:02.527867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658591+0000","last_change":"2024-09-12T02:47:58.469467+0000","last_active":"2024-09-12T02:47:59.658591+0000","last_peered":"2024-09-12T02:47:59.658591+0000","last_clean":"2024-09-12T02:47:59.658591+0000","last_became_active":"2024-09-12T02:47:58.469215+0000","last_became_peered":"2024-09-12T02:47:58.469215+0000","last_unstale":"2024-09-12T02:47:59.658591+0000","last_undegraded":"2024-09-12T02:47:59.658591+0000","last_fullsized":"2024-09-12T02:47:59.658591+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:04.003708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657898+0000","last_change":"2024-09-12T02:47:57.469200+0000","last_active":"2024-09-12T02:47:59.657898+0000","last_peered":"2024-09-12T02:47:59.657898+0000","last_clean":"2024-09-12T02:47:59.657898+0000","last_became_active":"2024-09-12T02:47:57.468940+0000","last_became_peered":"2024-09-12T02:47:57.468940+0000","last_unstale":"2024-09-12T02:47:59.657898+0000","last_undegraded":"2024-09-12T02:47:59.657898+0000","last_fullsized":"2024-09-12T02:47:59.657898+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:30.009340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.659103+0000","last_change":"2024-09-12T02:47:58.473673+0000","last_active":"2024-09-12T02:47:59.659103+0000","last_peered":"2024-09-12T02:47:59.659103+0000","last_clean":"2024-09-12T02:47:59.659103+0000","last_became_active":"2024-09-12T02:47:58.473007+0000","last_became_peered":"2024-09-12T02:47:58.473007+0000","last_unstale":"2024-09-12T02:47:59.659103+0000","last_undegraded":"2024-09-12T02:47:59.659103+0000","last_fullsized":"2024-09-12T02:47:59.659103+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:29.811277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658780+0000","last_change":"2024-09-12T02:47:57.464715+0000","last_active":"2024-09-12T02:47:59.658780+0000","last_peered":"2024-09-12T02:47:59.658780+0000","last_clean":"2024-09-12T02:47:59.658780+0000","last_became_active":"2024-09-12T02:47:57.464428+0000","last_became_peered":"2024-09-12T02:47:57.464428+0000","last_unstale":"2024-09-12T02:47:59.658780+0000","last_undegraded":"2024-09-12T02:47:59.658780+0000","last_fullsized":"2024-09-12T02:47:59.658780+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:18.676523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657964+0000","last_change":"2024-09-12T02:47:58.476378+0000","last_active":"2024-09-12T02:47:59.657964+0000","last_peered":"2024-09-12T02:47:59.657964+0000","last_clean":"2024-09-12T02:47:59.657964+0000","last_became_active":"2024-09-12T02:47:58.474575+0000","last_became_peered":"2024-09-12T02:47:58.474575+0000","last_unstale":"2024-09-12T02:47:59.657964+0000","last_undegraded":"2024-09-12T02:47:59.657964+0000","last_fullsized":"2024-09-12T02:47:59.657964+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:56.896387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657200+0000","last_change":"2024-09-12T02:47:57.469237+0000","last_active":"2024-09-12T02:47:59.657200+0000","last_peered":"2024-09-12T02:47:59.657200+0000","last_clean":"2024-09-12T02:47:59.657200+0000","last_became_active":"2024-09-12T02:47:57.468975+0000","last_became_peered":"2024-09-12T02:47:57.468975+0000","last_unstale":"2024-09-12T02:47:59.657200+0000","last_undegraded":"2024-09-12T02:47:59.657200+0000","last_fullsized":"2024-09-12T02:47:59.657200+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:40.513369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657426+0000","last_change":"2024-09-12T02:47:58.491418+0000","last_active":"2024-09-12T02:47:59.657426+0000","last_peered":"2024-09-12T02:47:59.657426+0000","last_clean":"2024-09-12T02:47:59.657426+0000","last_became_active":"2024-09-12T02:47:58.488892+0000","last_became_peered":"2024-09-12T02:47:58.488892+0000","last_unstale":"2024-09-12T02:47:59.657426+0000","last_undegraded":"2024-09-12T02:47:59.657426+0000","last_fullsized":"2024-09-12T02:47:59.657426+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:53.656398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657793+0000","last_change":"2024-09-12T02:47:57.473483+0000","last_active":"2024-09-12T02:47:59.657793+0000","last_peered":"2024-09-12T02:47:59.657793+0000","last_clean":"2024-09-12T02:47:59.657793+0000","last_became_active":"2024-09-12T02:47:57.473031+0000","last_became_peered":"2024-09-12T02:47:57.473031+0000","last_unstale":"2024-09-12T02:47:59.657793+0000","last_undegraded":"2024-09-12T02:47:59.657793+0000","last_fullsized":"2024-09-12T02:47:59.657793+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:12:42.070116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462198+0000","last_change":"2024-09-12T02:47:58.464242+0000","last_active":"2024-09-12T02:47:59.462198+0000","last_peered":"2024-09-12T02:47:59.462198+0000","last_clean":"2024-09-12T02:47:59.462198+0000","last_became_active":"2024-09-12T02:47:58.463947+0000","last_became_peered":"2024-09-12T02:47:58.463947+0000","last_unstale":"2024-09-12T02:47:59.462198+0000","last_undegraded":"2024-09-12T02:47:59.462198+0000","last_fullsized":"2024-09-12T02:47:59.462198+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:16.716165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657995+0000","last_change":"2024-09-12T02:47:57.470279+0000","last_active":"2024-09-12T02:47:59.657995+0000","last_peered":"2024-09-12T02:47:59.657995+0000","last_clean":"2024-09-12T02:47:59.657995+0000","last_became_active":"2024-09-12T02:47:57.469397+0000","last_became_peered":"2024-09-12T02:47:57.469397+0000","last_unstale":"2024-09-12T02:47:59.657995+0000","last_undegraded":"2024-09-12T02:47:59.657995+0000","last_fullsized":"2024-09-12T02:47:59.657995+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:16.471310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":394,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658306+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:47:59.658306+0000","last_peered":"2024-09-12T02:47:59.658306+0000","last_clean":"2024-09-12T02:47:59.658306+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:47:59.658306+0000","last_undegraded":"2024-09-12T02:47:59.658306+0000","last_fullsized":"2024-09-12T02:47:59.658306+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:25.823876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1306,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194006,"statfs":{"total":200000000,"available":198662178,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574926,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":729,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194583,"statfs":{"total":200000000,"available":199253092,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":729,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194582,"statfs":{"total":200000000,"available":199252558,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":729,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194583,"statfs":{"total":200000000,"available":199253162,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":730,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194581,"statfs":{"total":200000000,"available":199251480,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":729,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194583,"statfs":{"total":200000000,"available":199253162,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":729,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194583,"statfs":{"total":200000000,"available":199253038,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1307,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194004,"statfs":{"total":200000000,"available":198661070,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:48:07.306 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:48:07.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.468+0000 7fd2b1000640 1 Processor -- start 2024-09-12T02:48:07.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.468+0000 7fd2b1000640 1 -- start start 2024-09-12T02:48:07.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.469+0000 7fd2b1000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd2ac15f3b0 0x7fd2ac0732d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:07.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.469+0000 7fd2b1000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd2ac161c40 0x7fd2ac168960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:07.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.469+0000 7fd2b1000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2ac073810 con 0x7fd2ac0b4180 2024-09-12T02:48:07.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.469+0000 7fd2b1000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd2ac1607a0 con 0x7fd2ac15f3b0 2024-09-12T02:48:07.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.469+0000 7fd2b1000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd2ac073ab0 con 0x7fd2ac161c40 2024-09-12T02:48:07.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.469+0000 7fd2ab400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd2ac15f3b0 0x7fd2ac0732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:07.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.469+0000 7fd2ab400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd2ac15f3b0 0x7fd2ac0732d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34416/0 (socket says 172.21.15.112:34416) 2024-09-12T02:48:07.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.469+0000 7fd2ab400640 1 -- 172.21.15.112:0/780210450 learned_addr learned my addr 172.21.15.112:0/780210450 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:07.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.470+0000 7fd2abe00640 1 --2- 172.21.15.112:0/780210450 >> v2:172.21.15.137:3300/0 conn(0x7fd2ac161c40 0x7fd2ac168960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:07.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.470+0000 7fd2ab400640 1 -- 172.21.15.112:0/780210450 >> v2:172.21.15.137:3300/0 conn(0x7fd2ac161c40 msgr2=0x7fd2ac168960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:07.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.470+0000 7fd2ab400640 1 --2- 172.21.15.112:0/780210450 >> v2:172.21.15.137:3300/0 conn(0x7fd2ac161c40 0x7fd2ac168960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:07.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.470+0000 7fd2ab400640 1 -- 172.21.15.112:0/780210450 >> v1:172.21.15.137:6789/0 conn(0x7fd2ac0b4180 legacy=0x7fd2ac15f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:07.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.470+0000 7fd2ab400640 1 -- 172.21.15.112:0/780210450 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ac073d90 con 0x7fd2ac15f3b0 2024-09-12T02:48:07.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.471+0000 7fd2ab400640 1 --2- 172.21.15.112:0/780210450 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2ac15f3b0 0x7fd2ac0732d0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac0739e0 tx=0x7fd29c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d18b429255559d47 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:07.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.471+0000 7fd2aaa00640 1 -- 172.21.15.112:0/780210450 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c037070 con 0x7fd2ac15f3b0 2024-09-12T02:48:07.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.471+0000 7fd2aaa00640 1 -- 172.21.15.112:0/780210450 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd29c032440 con 0x7fd2ac15f3b0 2024-09-12T02:48:07.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.471+0000 7fd2aaa00640 1 -- 172.21.15.112:0/780210450 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c032810 con 0x7fd2ac15f3b0 2024-09-12T02:48:07.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.472+0000 7fd2b1000640 1 -- 172.21.15.112:0/780210450 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2ac15f3b0 msgr2=0x7fd2ac0732d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:07.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.472+0000 7fd2b1000640 1 --2- 172.21.15.112:0/780210450 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2ac15f3b0 0x7fd2ac0732d0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac0739e0 tx=0x7fd29c02a1e0 comp rx=0 tx=0).stop 2024-09-12T02:48:07.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.472+0000 7fd2b1000640 1 -- 172.21.15.112:0/780210450 shutdown_connections 2024-09-12T02:48:07.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.472+0000 7fd2b1000640 1 --2- 172.21.15.112:0/780210450 >> v2:172.21.15.137:3300/0 conn(0x7fd2ac161c40 0x7fd2ac168960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:07.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.472+0000 7fd2b1000640 1 --2- 172.21.15.112:0/780210450 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2ac15f3b0 0x7fd2ac0732d0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:07.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.472+0000 7fd2b1000640 1 -- 172.21.15.112:0/780210450 >> 172.21.15.112:0/780210450 conn(0x7fd2ac072420 msgr2=0x7fd2ac0b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:07.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.472+0000 7fd2b1000640 1 -- 172.21.15.112:0/780210450 shutdown_connections 2024-09-12T02:48:07.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.472+0000 7fd2b1000640 1 -- 172.21.15.112:0/780210450 wait complete. 2024-09-12T02:48:07.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.473+0000 7fd2b1000640 1 Processor -- start 2024-09-12T02:48:07.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.474+0000 7fd2b1000640 1 -- start start 2024-09-12T02:48:07.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.474+0000 7fd2b1000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2ac0b4180 0x7fd2ac147250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:07.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.474+0000 7fd2b1000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2ac15f3b0 0x7fd2ac144620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:07.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.475+0000 7fd2b1000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2ac161c40 0x7fd2ac1554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:07.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.475+0000 7fd2b1000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ac160020 con 0x7fd2ac161c40 2024-09-12T02:48:07.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.475+0000 7fd2b1000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ac15fea0 con 0x7fd2ac0b4180 2024-09-12T02:48:07.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.475+0000 7fd2b1000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd2ac1601a0 con 0x7fd2ac15f3b0 2024-09-12T02:48:07.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.475+0000 7fd2abe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2ac161c40 0x7fd2ac1554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:07.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.475+0000 7fd2abe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2ac161c40 0x7fd2ac1554b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34420/0 (socket says 172.21.15.112:34420) 2024-09-12T02:48:07.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.475+0000 7fd2abe00640 1 -- 172.21.15.112:0/1924421606 learned_addr learned my addr 172.21.15.112:0/1924421606 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:07.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.475+0000 7fd2ab400640 1 --2- 172.21.15.112:0/1924421606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2ac0b4180 0x7fd2ac147250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:07.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.475+0000 7fd2a2a00640 1 --2- 172.21.15.112:0/1924421606 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2ac15f3b0 0x7fd2ac144620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:07.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.475+0000 7fd2abe00640 1 -- 172.21.15.112:0/1924421606 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2ac15f3b0 msgr2=0x7fd2ac144620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:07.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.475+0000 7fd2abe00640 1 --2- 172.21.15.112:0/1924421606 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2ac15f3b0 0x7fd2ac144620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:07.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.475+0000 7fd2abe00640 1 -- 172.21.15.112:0/1924421606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2ac0b4180 msgr2=0x7fd2ac147250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:07.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.475+0000 7fd2abe00640 1 --2- 172.21.15.112:0/1924421606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2ac0b4180 0x7fd2ac147250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:07.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.475+0000 7fd2abe00640 1 -- 172.21.15.112:0/1924421606 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ac144b60 con 0x7fd2ac161c40 2024-09-12T02:48:07.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.476+0000 7fd2abe00640 1 --2- 172.21.15.112:0/1924421606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2ac161c40 0x7fd2ac1554b0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4007e60 tx=0x7fd2a400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:07.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.476+0000 7fd2a3e00640 1 -- 172.21.15.112:0/1924421606 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4014420 con 0x7fd2ac161c40 2024-09-12T02:48:07.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.476+0000 7fd2a3e00640 1 -- 172.21.15.112:0/1924421606 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a4019070 con 0x7fd2ac161c40 2024-09-12T02:48:07.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.476+0000 7fd2a3e00640 1 -- 172.21.15.112:0/1924421606 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4014820 con 0x7fd2ac161c40 2024-09-12T02:48:07.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.476+0000 7fd2b1000640 1 -- 172.21.15.112:0/1924421606 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2ac144de0 con 0x7fd2ac161c40 2024-09-12T02:48:07.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.476+0000 7fd2b1000640 1 -- 172.21.15.112:0/1924421606 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2ac1453a0 con 0x7fd2ac161c40 2024-09-12T02:48:07.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.477+0000 7fd2b1000640 1 -- 172.21.15.112:0/1924421606 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2ac0732d0 con 0x7fd2ac161c40 2024-09-12T02:48:07.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.478+0000 7fd2a3e00640 1 -- 172.21.15.112:0/1924421606 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd2a40149c0 con 0x7fd2ac161c40 2024-09-12T02:48:07.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.479+0000 7fd2a3e00640 1 --2- 172.21.15.112:0/1924421606 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd28806be80 0x7fd28806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:07.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.479+0000 7fd2a3e00640 1 -- 172.21.15.112:0/1924421606 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7fd2a408b590 con 0x7fd2ac161c40 2024-09-12T02:48:07.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.479+0000 7fd2ab400640 1 --2- 172.21.15.112:0/1924421606 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd28806be80 0x7fd28806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:07.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.480+0000 7fd2ab400640 1 --2- 172.21.15.112:0/1924421606 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd28806be80 0x7fd28806e340 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd29c034000 tx=0x7fd29c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:07.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.484+0000 7fd2a3e00640 1 -- 172.21.15.112:0/1924421606 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd2ac144b60 con 0x7fd2ac161c40 2024-09-12T02:48:07.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.652+0000 7fd2b1000640 1 -- 172.21.15.112:0/1924421606 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd2ac15d9c0 con 0x7fd28806be80 2024-09-12T02:48:07.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.658+0000 7fd2a3e00640 1 -- 172.21.15.112:0/1924421606 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247993 (secure 0 0 0) 0x7fd2ac15d9c0 con 0x7fd28806be80 2024-09-12T02:48:07.662 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:07.663 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:48:07.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.662+0000 7fd2b1000640 1 -- 172.21.15.112:0/1924421606 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd28806be80 msgr2=0x7fd28806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:07.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.662+0000 7fd2b1000640 1 --2- 172.21.15.112:0/1924421606 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd28806be80 0x7fd28806e340 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd29c034000 tx=0x7fd29c02e000 comp rx=0 tx=0).stop 2024-09-12T02:48:07.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.662+0000 7fd2b1000640 1 -- 172.21.15.112:0/1924421606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2ac161c40 msgr2=0x7fd2ac1554b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:07.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.662+0000 7fd2b1000640 1 --2- 172.21.15.112:0/1924421606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2ac161c40 0x7fd2ac1554b0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4007e60 tx=0x7fd2a400e4b0 comp rx=0 tx=0).stop 2024-09-12T02:48:07.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.662+0000 7fd2b1000640 1 -- 172.21.15.112:0/1924421606 shutdown_connections 2024-09-12T02:48:07.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.662+0000 7fd2b1000640 1 --2- 172.21.15.112:0/1924421606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2ac161c40 0x7fd2ac1554b0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:07.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.662+0000 7fd2b1000640 1 --2- 172.21.15.112:0/1924421606 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2ac15f3b0 0x7fd2ac144620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:07.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.662+0000 7fd2b1000640 1 --2- 172.21.15.112:0/1924421606 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd28806be80 0x7fd28806e340 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:07.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.662+0000 7fd2b1000640 1 --2- 172.21.15.112:0/1924421606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2ac0b4180 0x7fd2ac147250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:07.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.662+0000 7fd2b1000640 1 -- 172.21.15.112:0/1924421606 >> 172.21.15.112:0/1924421606 conn(0x7fd2ac072420 msgr2=0x7fd2ac0b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:07.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.662+0000 7fd2b1000640 1 -- 172.21.15.112:0/1924421606 shutdown_connections 2024-09-12T02:48:07.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.662+0000 7fd2b1000640 1 -- 172.21.15.112:0/1924421606 wait complete. 2024-09-12T02:48:07.679 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":319,"stamp":"2024-09-12T02:48:07.040319+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6992,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555507,"statfs":{"total":1600000000,"available":1592839740,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.577660"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657251+0000","last_change":"2024-09-12T02:47:58.492135+0000","last_active":"2024-09-12T02:47:59.657251+0000","last_peered":"2024-09-12T02:47:59.657251+0000","last_clean":"2024-09-12T02:47:59.657251+0000","last_became_active":"2024-09-12T02:47:58.491680+0000","last_became_peered":"2024-09-12T02:47:58.491680+0000","last_unstale":"2024-09-12T02:47:59.657251+0000","last_undegraded":"2024-09-12T02:47:59.657251+0000","last_fullsized":"2024-09-12T02:47:59.657251+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:26.430586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658165+0000","last_change":"2024-09-12T02:47:58.477458+0000","last_active":"2024-09-12T02:47:59.658165+0000","last_peered":"2024-09-12T02:47:59.658165+0000","last_clean":"2024-09-12T02:47:59.658165+0000","last_became_active":"2024-09-12T02:47:58.476214+0000","last_became_peered":"2024-09-12T02:47:58.476214+0000","last_unstale":"2024-09-12T02:47:59.658165+0000","last_undegraded":"2024-09-12T02:47:59.658165+0000","last_fullsized":"2024-09-12T02:47:59.658165+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:54.320063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657896+0000","last_change":"2024-09-12T02:47:58.468795+0000","last_active":"2024-09-12T02:47:59.657896+0000","last_peered":"2024-09-12T02:47:59.657896+0000","last_clean":"2024-09-12T02:47:59.657896+0000","last_became_active":"2024-09-12T02:47:58.468454+0000","last_became_peered":"2024-09-12T02:47:58.468454+0000","last_unstale":"2024-09-12T02:47:59.657896+0000","last_undegraded":"2024-09-12T02:47:59.657896+0000","last_fullsized":"2024-09-12T02:47:59.657896+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:17.276167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657230+0000","last_change":"2024-09-12T02:47:58.491774+0000","last_active":"2024-09-12T02:47:59.657230+0000","last_peered":"2024-09-12T02:47:59.657230+0000","last_clean":"2024-09-12T02:47:59.657230+0000","last_became_active":"2024-09-12T02:47:58.491423+0000","last_became_peered":"2024-09-12T02:47:58.491423+0000","last_unstale":"2024-09-12T02:47:59.657230+0000","last_undegraded":"2024-09-12T02:47:59.657230+0000","last_fullsized":"2024-09-12T02:47:59.657230+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:19:21.593656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657006+0000","last_change":"2024-09-12T02:47:58.478400+0000","last_active":"2024-09-12T02:47:59.657006+0000","last_peered":"2024-09-12T02:47:59.657006+0000","last_clean":"2024-09-12T02:47:59.657006+0000","last_became_active":"2024-09-12T02:47:58.478019+0000","last_became_peered":"2024-09-12T02:47:58.478019+0000","last_unstale":"2024-09-12T02:47:59.657006+0000","last_undegraded":"2024-09-12T02:47:59.657006+0000","last_fullsized":"2024-09-12T02:47:59.657006+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:58.214916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.463737+0000","last_change":"2024-09-12T02:47:58.477253+0000","last_active":"2024-09-12T02:47:59.463737+0000","last_peered":"2024-09-12T02:47:59.463737+0000","last_clean":"2024-09-12T02:47:59.463737+0000","last_became_active":"2024-09-12T02:47:58.477009+0000","last_became_peered":"2024-09-12T02:47:58.477009+0000","last_unstale":"2024-09-12T02:47:59.463737+0000","last_undegraded":"2024-09-12T02:47:59.463737+0000","last_fullsized":"2024-09-12T02:47:59.463737+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:45.176382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657891+0000","last_change":"2024-09-12T02:47:58.477989+0000","last_active":"2024-09-12T02:47:59.657891+0000","last_peered":"2024-09-12T02:47:59.657891+0000","last_clean":"2024-09-12T02:47:59.657891+0000","last_became_active":"2024-09-12T02:47:58.475236+0000","last_became_peered":"2024-09-12T02:47:58.475236+0000","last_unstale":"2024-09-12T02:47:59.657891+0000","last_undegraded":"2024-09-12T02:47:59.657891+0000","last_fullsized":"2024-09-12T02:47:59.657891+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:40.211187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658254+0000","last_change":"2024-09-12T02:47:58.475403+0000","last_active":"2024-09-12T02:47:59.658254+0000","last_peered":"2024-09-12T02:47:59.658254+0000","last_clean":"2024-09-12T02:47:59.658254+0000","last_became_active":"2024-09-12T02:47:58.473895+0000","last_became_peered":"2024-09-12T02:47:58.473895+0000","last_unstale":"2024-09-12T02:47:59.658254+0000","last_undegraded":"2024-09-12T02:47:59.658254+0000","last_fullsized":"2024-09-12T02:47:59.658254+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:57.448789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657370+0000","last_change":"2024-09-12T02:47:58.494247+0000","last_active":"2024-09-12T02:47:59.657370+0000","last_peered":"2024-09-12T02:47:59.657370+0000","last_clean":"2024-09-12T02:47:59.657370+0000","last_became_active":"2024-09-12T02:47:58.493866+0000","last_became_peered":"2024-09-12T02:47:58.493866+0000","last_unstale":"2024-09-12T02:47:59.657370+0000","last_undegraded":"2024-09-12T02:47:59.657370+0000","last_fullsized":"2024-09-12T02:47:59.657370+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:19.869905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657495+0000","last_change":"2024-09-12T02:47:58.487407+0000","last_active":"2024-09-12T02:47:59.657495+0000","last_peered":"2024-09-12T02:47:59.657495+0000","last_clean":"2024-09-12T02:47:59.657495+0000","last_became_active":"2024-09-12T02:47:58.487130+0000","last_became_peered":"2024-09-12T02:47:58.487130+0000","last_unstale":"2024-09-12T02:47:59.657495+0000","last_undegraded":"2024-09-12T02:47:59.657495+0000","last_fullsized":"2024-09-12T02:47:59.657495+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:56.734899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658956+0000","last_change":"2024-09-12T02:47:58.477375+0000","last_active":"2024-09-12T02:47:59.658956+0000","last_peered":"2024-09-12T02:47:59.658956+0000","last_clean":"2024-09-12T02:47:59.658956+0000","last_became_active":"2024-09-12T02:47:58.477129+0000","last_became_peered":"2024-09-12T02:47:58.477129+0000","last_unstale":"2024-09-12T02:47:59.658956+0000","last_undegraded":"2024-09-12T02:47:59.658956+0000","last_fullsized":"2024-09-12T02:47:59.658956+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:56.155548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657840+0000","last_change":"2024-09-12T02:47:58.487917+0000","last_active":"2024-09-12T02:47:59.657840+0000","last_peered":"2024-09-12T02:47:59.657840+0000","last_clean":"2024-09-12T02:47:59.657840+0000","last_became_active":"2024-09-12T02:47:58.487209+0000","last_became_peered":"2024-09-12T02:47:58.487209+0000","last_unstale":"2024-09-12T02:47:59.657840+0000","last_undegraded":"2024-09-12T02:47:59.657840+0000","last_fullsized":"2024-09-12T02:47:59.657840+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:57.757944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658051+0000","last_change":"2024-09-12T02:47:58.470300+0000","last_active":"2024-09-12T02:47:59.658051+0000","last_peered":"2024-09-12T02:47:59.658051+0000","last_clean":"2024-09-12T02:47:59.658051+0000","last_became_active":"2024-09-12T02:47:58.470038+0000","last_became_peered":"2024-09-12T02:47:58.470038+0000","last_unstale":"2024-09-12T02:47:59.658051+0000","last_undegraded":"2024-09-12T02:47:59.658051+0000","last_fullsized":"2024-09-12T02:47:59.658051+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:48.667360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657677+0000","last_change":"2024-09-12T02:47:58.476633+0000","last_active":"2024-09-12T02:47:59.657677+0000","last_peered":"2024-09-12T02:47:59.657677+0000","last_clean":"2024-09-12T02:47:59.657677+0000","last_became_active":"2024-09-12T02:47:58.474938+0000","last_became_peered":"2024-09-12T02:47:58.474938+0000","last_unstale":"2024-09-12T02:47:59.657677+0000","last_undegraded":"2024-09-12T02:47:59.657677+0000","last_fullsized":"2024-09-12T02:47:59.657677+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:00.907949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.463868+0000","last_change":"2024-09-12T02:47:58.483802+0000","last_active":"2024-09-12T02:47:59.463868+0000","last_peered":"2024-09-12T02:47:59.463868+0000","last_clean":"2024-09-12T02:47:59.463868+0000","last_became_active":"2024-09-12T02:47:58.483459+0000","last_became_peered":"2024-09-12T02:47:58.483459+0000","last_unstale":"2024-09-12T02:47:59.463868+0000","last_undegraded":"2024-09-12T02:47:59.463868+0000","last_fullsized":"2024-09-12T02:47:59.463868+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:26.223275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657372+0000","last_change":"2024-09-12T02:47:58.491943+0000","last_active":"2024-09-12T02:47:59.657372+0000","last_peered":"2024-09-12T02:47:59.657372+0000","last_clean":"2024-09-12T02:47:59.657372+0000","last_became_active":"2024-09-12T02:47:58.491252+0000","last_became_peered":"2024-09-12T02:47:58.491252+0000","last_unstale":"2024-09-12T02:47:59.657372+0000","last_undegraded":"2024-09-12T02:47:59.657372+0000","last_fullsized":"2024-09-12T02:47:59.657372+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:19.080926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658301+0000","last_change":"2024-09-12T02:47:58.476466+0000","last_active":"2024-09-12T02:47:59.658301+0000","last_peered":"2024-09-12T02:47:59.658301+0000","last_clean":"2024-09-12T02:47:59.658301+0000","last_became_active":"2024-09-12T02:47:58.475872+0000","last_became_peered":"2024-09-12T02:47:58.475872+0000","last_unstale":"2024-09-12T02:47:59.658301+0000","last_undegraded":"2024-09-12T02:47:59.658301+0000","last_fullsized":"2024-09-12T02:47:59.658301+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:32.305254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462073+0000","last_change":"2024-09-12T02:47:58.473684+0000","last_active":"2024-09-12T02:47:59.462073+0000","last_peered":"2024-09-12T02:47:59.462073+0000","last_clean":"2024-09-12T02:47:59.462073+0000","last_became_active":"2024-09-12T02:47:58.473456+0000","last_became_peered":"2024-09-12T02:47:58.473456+0000","last_unstale":"2024-09-12T02:47:59.462073+0000","last_undegraded":"2024-09-12T02:47:59.462073+0000","last_fullsized":"2024-09-12T02:47:59.462073+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:16.638630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657817+0000","last_change":"2024-09-12T02:47:58.471241+0000","last_active":"2024-09-12T02:47:59.657817+0000","last_peered":"2024-09-12T02:47:59.657817+0000","last_clean":"2024-09-12T02:47:59.657817+0000","last_became_active":"2024-09-12T02:47:58.470755+0000","last_became_peered":"2024-09-12T02:47:58.470755+0000","last_unstale":"2024-09-12T02:47:59.657817+0000","last_undegraded":"2024-09-12T02:47:59.657817+0000","last_fullsized":"2024-09-12T02:47:59.657817+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:41.369531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658589+0000","last_change":"2024-09-12T02:47:58.476172+0000","last_active":"2024-09-12T02:47:59.658589+0000","last_peered":"2024-09-12T02:47:59.658589+0000","last_clean":"2024-09-12T02:47:59.658589+0000","last_became_active":"2024-09-12T02:47:58.475844+0000","last_became_peered":"2024-09-12T02:47:58.475844+0000","last_unstale":"2024-09-12T02:47:59.658589+0000","last_undegraded":"2024-09-12T02:47:59.658589+0000","last_fullsized":"2024-09-12T02:47:59.658589+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:12.229793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.659190+0000","last_change":"2024-09-12T02:47:58.468109+0000","last_active":"2024-09-12T02:47:59.659190+0000","last_peered":"2024-09-12T02:47:59.659190+0000","last_clean":"2024-09-12T02:47:59.659190+0000","last_became_active":"2024-09-12T02:47:58.467834+0000","last_became_peered":"2024-09-12T02:47:58.467834+0000","last_unstale":"2024-09-12T02:47:59.659190+0000","last_undegraded":"2024-09-12T02:47:59.659190+0000","last_fullsized":"2024-09-12T02:47:59.659190+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:17.345970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462039+0000","last_change":"2024-09-12T02:47:58.475375+0000","last_active":"2024-09-12T02:47:59.462039+0000","last_peered":"2024-09-12T02:47:59.462039+0000","last_clean":"2024-09-12T02:47:59.462039+0000","last_became_active":"2024-09-12T02:47:58.475184+0000","last_became_peered":"2024-09-12T02:47:58.475184+0000","last_unstale":"2024-09-12T02:47:59.462039+0000","last_undegraded":"2024-09-12T02:47:59.462039+0000","last_fullsized":"2024-09-12T02:47:59.462039+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:38.989320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658949+0000","last_change":"2024-09-12T02:47:58.465999+0000","last_active":"2024-09-12T02:47:59.658949+0000","last_peered":"2024-09-12T02:47:59.658949+0000","last_clean":"2024-09-12T02:47:59.658949+0000","last_became_active":"2024-09-12T02:47:58.465741+0000","last_became_peered":"2024-09-12T02:47:58.465741+0000","last_unstale":"2024-09-12T02:47:59.658949+0000","last_undegraded":"2024-09-12T02:47:59.658949+0000","last_fullsized":"2024-09-12T02:47:59.658949+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:12.715626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462091+0000","last_change":"2024-09-12T02:47:58.464286+0000","last_active":"2024-09-12T02:47:59.462091+0000","last_peered":"2024-09-12T02:47:59.462091+0000","last_clean":"2024-09-12T02:47:59.462091+0000","last_became_active":"2024-09-12T02:47:58.464025+0000","last_became_peered":"2024-09-12T02:47:58.464025+0000","last_unstale":"2024-09-12T02:47:59.462091+0000","last_undegraded":"2024-09-12T02:47:59.462091+0000","last_fullsized":"2024-09-12T02:47:59.462091+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:29.052988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658761+0000","last_change":"2024-09-12T02:47:58.471241+0000","last_active":"2024-09-12T02:47:59.658761+0000","last_peered":"2024-09-12T02:47:59.658761+0000","last_clean":"2024-09-12T02:47:59.658761+0000","last_became_active":"2024-09-12T02:47:58.471008+0000","last_became_peered":"2024-09-12T02:47:58.471008+0000","last_unstale":"2024-09-12T02:47:59.658761+0000","last_undegraded":"2024-09-12T02:47:59.658761+0000","last_fullsized":"2024-09-12T02:47:59.658761+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:12.683296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657504+0000","last_change":"2024-09-12T02:47:58.484925+0000","last_active":"2024-09-12T02:47:59.657504+0000","last_peered":"2024-09-12T02:47:59.657504+0000","last_clean":"2024-09-12T02:47:59.657504+0000","last_became_active":"2024-09-12T02:47:58.484536+0000","last_became_peered":"2024-09-12T02:47:58.484536+0000","last_unstale":"2024-09-12T02:47:59.657504+0000","last_undegraded":"2024-09-12T02:47:59.657504+0000","last_fullsized":"2024-09-12T02:47:59.657504+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:09.731850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.463578+0000","last_change":"2024-09-12T02:47:58.489826+0000","last_active":"2024-09-12T02:47:59.463578+0000","last_peered":"2024-09-12T02:47:59.463578+0000","last_clean":"2024-09-12T02:47:59.463578+0000","last_became_active":"2024-09-12T02:47:58.489596+0000","last_became_peered":"2024-09-12T02:47:58.489596+0000","last_unstale":"2024-09-12T02:47:59.463578+0000","last_undegraded":"2024-09-12T02:47:59.463578+0000","last_fullsized":"2024-09-12T02:47:59.463578+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:11.166299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462035+0000","last_change":"2024-09-12T02:47:58.480214+0000","last_active":"2024-09-12T02:47:59.462035+0000","last_peered":"2024-09-12T02:47:59.462035+0000","last_clean":"2024-09-12T02:47:59.462035+0000","last_became_active":"2024-09-12T02:47:58.479967+0000","last_became_peered":"2024-09-12T02:47:58.479967+0000","last_unstale":"2024-09-12T02:47:59.462035+0000","last_undegraded":"2024-09-12T02:47:59.462035+0000","last_fullsized":"2024-09-12T02:47:59.462035+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:56.675644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657667+0000","last_change":"2024-09-12T02:47:58.470114+0000","last_active":"2024-09-12T02:47:59.657667+0000","last_peered":"2024-09-12T02:47:59.657667+0000","last_clean":"2024-09-12T02:47:59.657667+0000","last_became_active":"2024-09-12T02:47:58.469753+0000","last_became_peered":"2024-09-12T02:47:58.469753+0000","last_unstale":"2024-09-12T02:47:59.657667+0000","last_undegraded":"2024-09-12T02:47:59.657667+0000","last_fullsized":"2024-09-12T02:47:59.657667+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:53:23.482151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657354+0000","last_change":"2024-09-12T02:47:58.479009+0000","last_active":"2024-09-12T02:47:59.657354+0000","last_peered":"2024-09-12T02:47:59.657354+0000","last_clean":"2024-09-12T02:47:59.657354+0000","last_became_active":"2024-09-12T02:47:58.478705+0000","last_became_peered":"2024-09-12T02:47:58.478705+0000","last_unstale":"2024-09-12T02:47:59.657354+0000","last_undegraded":"2024-09-12T02:47:59.657354+0000","last_fullsized":"2024-09-12T02:47:59.657354+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:49.893384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657634+0000","last_change":"2024-09-12T02:47:58.484752+0000","last_active":"2024-09-12T02:47:59.657634+0000","last_peered":"2024-09-12T02:47:59.657634+0000","last_clean":"2024-09-12T02:47:59.657634+0000","last_became_active":"2024-09-12T02:47:58.484214+0000","last_became_peered":"2024-09-12T02:47:58.484214+0000","last_unstale":"2024-09-12T02:47:59.657634+0000","last_undegraded":"2024-09-12T02:47:59.657634+0000","last_fullsized":"2024-09-12T02:47:59.657634+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:21.654771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.463764+0000","last_change":"2024-09-12T02:47:58.472823+0000","last_active":"2024-09-12T02:47:59.463764+0000","last_peered":"2024-09-12T02:47:59.463764+0000","last_clean":"2024-09-12T02:47:59.463764+0000","last_became_active":"2024-09-12T02:47:58.472589+0000","last_became_peered":"2024-09-12T02:47:58.472589+0000","last_unstale":"2024-09-12T02:47:59.463764+0000","last_undegraded":"2024-09-12T02:47:59.463764+0000","last_fullsized":"2024-09-12T02:47:59.463764+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:40.224279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.463489+0000","last_change":"2024-09-12T02:47:58.470585+0000","last_active":"2024-09-12T02:47:59.463489+0000","last_peered":"2024-09-12T02:47:59.463489+0000","last_clean":"2024-09-12T02:47:59.463489+0000","last_became_active":"2024-09-12T02:47:58.469471+0000","last_became_peered":"2024-09-12T02:47:58.469471+0000","last_unstale":"2024-09-12T02:47:59.463489+0000","last_undegraded":"2024-09-12T02:47:59.463489+0000","last_fullsized":"2024-09-12T02:47:59.463489+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:52.390760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"134'4","reported_seq":18,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657434+0000","last_change":"2024-09-12T02:47:57.468829+0000","last_active":"2024-09-12T02:47:59.657434+0000","last_peered":"2024-09-12T02:47:59.657434+0000","last_clean":"2024-09-12T02:47:59.657434+0000","last_became_active":"2024-09-12T02:47:57.468528+0000","last_became_peered":"2024-09-12T02:47:57.468528+0000","last_unstale":"2024-09-12T02:47:59.657434+0000","last_undegraded":"2024-09-12T02:47:59.657434+0000","last_fullsized":"2024-09-12T02:47:59.657434+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:47.803523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462273+0000","last_change":"2024-09-12T02:47:58.478037+0000","last_active":"2024-09-12T02:47:59.462273+0000","last_peered":"2024-09-12T02:47:59.462273+0000","last_clean":"2024-09-12T02:47:59.462273+0000","last_became_active":"2024-09-12T02:47:58.477793+0000","last_became_peered":"2024-09-12T02:47:58.477793+0000","last_unstale":"2024-09-12T02:47:59.462273+0000","last_undegraded":"2024-09-12T02:47:59.462273+0000","last_fullsized":"2024-09-12T02:47:59.462273+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:06.691112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"134'1","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658192+0000","last_change":"2024-09-12T02:47:57.469448+0000","last_active":"2024-09-12T02:47:59.658192+0000","last_peered":"2024-09-12T02:47:59.658192+0000","last_clean":"2024-09-12T02:47:59.658192+0000","last_became_active":"2024-09-12T02:47:57.469225+0000","last_became_peered":"2024-09-12T02:47:57.469225+0000","last_unstale":"2024-09-12T02:47:59.658192+0000","last_undegraded":"2024-09-12T02:47:59.658192+0000","last_fullsized":"2024-09-12T02:47:59.658192+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:41.674158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.463895+0000","last_change":"2024-09-12T02:47:58.485832+0000","last_active":"2024-09-12T02:47:59.463895+0000","last_peered":"2024-09-12T02:47:59.463895+0000","last_clean":"2024-09-12T02:47:59.463895+0000","last_became_active":"2024-09-12T02:47:58.479353+0000","last_became_peered":"2024-09-12T02:47:58.479353+0000","last_unstale":"2024-09-12T02:47:59.463895+0000","last_undegraded":"2024-09-12T02:47:59.463895+0000","last_fullsized":"2024-09-12T02:47:59.463895+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:33.434145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"134'2","reported_seq":16,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657452+0000","last_change":"2024-09-12T02:47:57.471489+0000","last_active":"2024-09-12T02:47:59.657452+0000","last_peered":"2024-09-12T02:47:59.657452+0000","last_clean":"2024-09-12T02:47:59.657452+0000","last_became_active":"2024-09-12T02:47:57.470912+0000","last_became_peered":"2024-09-12T02:47:57.470912+0000","last_unstale":"2024-09-12T02:47:59.657452+0000","last_undegraded":"2024-09-12T02:47:59.657452+0000","last_fullsized":"2024-09-12T02:47:59.657452+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:18.855629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658664+0000","last_change":"2024-09-12T02:47:58.474352+0000","last_active":"2024-09-12T02:47:59.658664+0000","last_peered":"2024-09-12T02:47:59.658664+0000","last_clean":"2024-09-12T02:47:59.658664+0000","last_became_active":"2024-09-12T02:47:58.474057+0000","last_became_peered":"2024-09-12T02:47:58.474057+0000","last_unstale":"2024-09-12T02:47:59.658664+0000","last_undegraded":"2024-09-12T02:47:59.658664+0000","last_fullsized":"2024-09-12T02:47:59.658664+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:09.373910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"134'2","reported_seq":16,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657102+0000","last_change":"2024-09-12T02:47:57.471168+0000","last_active":"2024-09-12T02:47:59.657102+0000","last_peered":"2024-09-12T02:47:59.657102+0000","last_clean":"2024-09-12T02:47:59.657102+0000","last_became_active":"2024-09-12T02:47:57.470929+0000","last_became_peered":"2024-09-12T02:47:57.470929+0000","last_unstale":"2024-09-12T02:47:59.657102+0000","last_undegraded":"2024-09-12T02:47:59.657102+0000","last_fullsized":"2024-09-12T02:47:59.657102+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:58.228885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657339+0000","last_change":"2024-09-12T02:47:58.486735+0000","last_active":"2024-09-12T02:47:59.657339+0000","last_peered":"2024-09-12T02:47:59.657339+0000","last_clean":"2024-09-12T02:47:59.657339+0000","last_became_active":"2024-09-12T02:47:58.484411+0000","last_became_peered":"2024-09-12T02:47:58.484411+0000","last_unstale":"2024-09-12T02:47:59.657339+0000","last_undegraded":"2024-09-12T02:47:59.657339+0000","last_fullsized":"2024-09-12T02:47:59.657339+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:18.861217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"134'1","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657716+0000","last_change":"2024-09-12T02:47:57.470089+0000","last_active":"2024-09-12T02:47:59.657716+0000","last_peered":"2024-09-12T02:47:59.657716+0000","last_clean":"2024-09-12T02:47:59.657716+0000","last_became_active":"2024-09-12T02:47:57.468952+0000","last_became_peered":"2024-09-12T02:47:57.468952+0000","last_unstale":"2024-09-12T02:47:59.657716+0000","last_undegraded":"2024-09-12T02:47:59.657716+0000","last_fullsized":"2024-09-12T02:47:59.657716+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:08.373552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658441+0000","last_change":"2024-09-12T02:47:58.485250+0000","last_active":"2024-09-12T02:47:59.658441+0000","last_peered":"2024-09-12T02:47:59.658441+0000","last_clean":"2024-09-12T02:47:59.658441+0000","last_became_active":"2024-09-12T02:47:58.485093+0000","last_became_peered":"2024-09-12T02:47:58.485093+0000","last_unstale":"2024-09-12T02:47:59.658441+0000","last_undegraded":"2024-09-12T02:47:59.658441+0000","last_fullsized":"2024-09-12T02:47:59.658441+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:12.195892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"134'1","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462285+0000","last_change":"2024-09-12T02:47:57.464833+0000","last_active":"2024-09-12T02:47:59.462285+0000","last_peered":"2024-09-12T02:47:59.462285+0000","last_clean":"2024-09-12T02:47:59.462285+0000","last_became_active":"2024-09-12T02:47:57.464435+0000","last_became_peered":"2024-09-12T02:47:57.464435+0000","last_unstale":"2024-09-12T02:47:59.462285+0000","last_undegraded":"2024-09-12T02:47:59.462285+0000","last_fullsized":"2024-09-12T02:47:59.462285+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:53.327488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657641+0000","last_change":"2024-09-12T02:47:58.493422+0000","last_active":"2024-09-12T02:47:59.657641+0000","last_peered":"2024-09-12T02:47:59.657641+0000","last_clean":"2024-09-12T02:47:59.657641+0000","last_became_active":"2024-09-12T02:47:58.491683+0000","last_became_peered":"2024-09-12T02:47:58.491683+0000","last_unstale":"2024-09-12T02:47:59.657641+0000","last_undegraded":"2024-09-12T02:47:59.657641+0000","last_fullsized":"2024-09-12T02:47:59.657641+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:59.496942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657910+0000","last_change":"2024-09-12T02:47:57.460129+0000","last_active":"2024-09-12T02:47:59.657910+0000","last_peered":"2024-09-12T02:47:59.657910+0000","last_clean":"2024-09-12T02:47:59.657910+0000","last_became_active":"2024-09-12T02:47:57.459834+0000","last_became_peered":"2024-09-12T02:47:57.459834+0000","last_unstale":"2024-09-12T02:47:59.657910+0000","last_undegraded":"2024-09-12T02:47:59.657910+0000","last_fullsized":"2024-09-12T02:47:59.657910+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:30.593173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657319+0000","last_change":"2024-09-12T02:47:58.478421+0000","last_active":"2024-09-12T02:47:59.657319+0000","last_peered":"2024-09-12T02:47:59.657319+0000","last_clean":"2024-09-12T02:47:59.657319+0000","last_became_active":"2024-09-12T02:47:58.478146+0000","last_became_peered":"2024-09-12T02:47:58.478146+0000","last_unstale":"2024-09-12T02:47:59.657319+0000","last_undegraded":"2024-09-12T02:47:59.657319+0000","last_fullsized":"2024-09-12T02:47:59.657319+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:00.922266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657919+0000","last_change":"2024-09-12T02:47:57.464663+0000","last_active":"2024-09-12T02:47:59.657919+0000","last_peered":"2024-09-12T02:47:59.657919+0000","last_clean":"2024-09-12T02:47:59.657919+0000","last_became_active":"2024-09-12T02:47:57.464447+0000","last_became_peered":"2024-09-12T02:47:57.464447+0000","last_unstale":"2024-09-12T02:47:59.657919+0000","last_undegraded":"2024-09-12T02:47:59.657919+0000","last_fullsized":"2024-09-12T02:47:59.657919+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:21.366974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657614+0000","last_change":"2024-09-12T02:47:58.471405+0000","last_active":"2024-09-12T02:47:59.657614+0000","last_peered":"2024-09-12T02:47:59.657614+0000","last_clean":"2024-09-12T02:47:59.657614+0000","last_became_active":"2024-09-12T02:47:58.471173+0000","last_became_peered":"2024-09-12T02:47:58.471173+0000","last_unstale":"2024-09-12T02:47:59.657614+0000","last_undegraded":"2024-09-12T02:47:59.657614+0000","last_fullsized":"2024-09-12T02:47:59.657614+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:56.640889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657203+0000","last_change":"2024-09-12T02:47:57.472855+0000","last_active":"2024-09-12T02:47:59.657203+0000","last_peered":"2024-09-12T02:47:59.657203+0000","last_clean":"2024-09-12T02:47:59.657203+0000","last_became_active":"2024-09-12T02:47:57.472612+0000","last_became_peered":"2024-09-12T02:47:57.472612+0000","last_unstale":"2024-09-12T02:47:59.657203+0000","last_undegraded":"2024-09-12T02:47:59.657203+0000","last_fullsized":"2024-09-12T02:47:59.657203+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:01.919748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462517+0000","last_change":"2024-09-12T02:47:58.488331+0000","last_active":"2024-09-12T02:47:59.462517+0000","last_peered":"2024-09-12T02:47:59.462517+0000","last_clean":"2024-09-12T02:47:59.462517+0000","last_became_active":"2024-09-12T02:47:58.487984+0000","last_became_peered":"2024-09-12T02:47:58.487984+0000","last_unstale":"2024-09-12T02:47:59.462517+0000","last_undegraded":"2024-09-12T02:47:59.462517+0000","last_fullsized":"2024-09-12T02:47:59.462517+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:53:04.404665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462328+0000","last_change":"2024-09-12T02:47:57.461370+0000","last_active":"2024-09-12T02:47:59.462328+0000","last_peered":"2024-09-12T02:47:59.462328+0000","last_clean":"2024-09-12T02:47:59.462328+0000","last_became_active":"2024-09-12T02:47:57.461153+0000","last_became_peered":"2024-09-12T02:47:57.461153+0000","last_unstale":"2024-09-12T02:47:59.462328+0000","last_undegraded":"2024-09-12T02:47:59.462328+0000","last_fullsized":"2024-09-12T02:47:59.462328+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:54.948833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462187+0000","last_change":"2024-09-12T02:47:58.466934+0000","last_active":"2024-09-12T02:47:59.462187+0000","last_peered":"2024-09-12T02:47:59.462187+0000","last_clean":"2024-09-12T02:47:59.462187+0000","last_became_active":"2024-09-12T02:47:58.465938+0000","last_became_peered":"2024-09-12T02:47:58.465938+0000","last_unstale":"2024-09-12T02:47:59.462187+0000","last_undegraded":"2024-09-12T02:47:59.462187+0000","last_fullsized":"2024-09-12T02:47:59.462187+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:50.087258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"134'3","reported_seq":17,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657635+0000","last_change":"2024-09-12T02:47:57.469395+0000","last_active":"2024-09-12T02:47:59.657635+0000","last_peered":"2024-09-12T02:47:59.657635+0000","last_clean":"2024-09-12T02:47:59.657635+0000","last_became_active":"2024-09-12T02:47:57.469170+0000","last_became_peered":"2024-09-12T02:47:57.469170+0000","last_unstale":"2024-09-12T02:47:59.657635+0000","last_undegraded":"2024-09-12T02:47:59.657635+0000","last_fullsized":"2024-09-12T02:47:59.657635+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:15.633103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657243+0000","last_change":"2024-09-12T02:47:58.469912+0000","last_active":"2024-09-12T02:47:59.657243+0000","last_peered":"2024-09-12T02:47:59.657243+0000","last_clean":"2024-09-12T02:47:59.657243+0000","last_became_active":"2024-09-12T02:47:58.469662+0000","last_became_peered":"2024-09-12T02:47:58.469662+0000","last_unstale":"2024-09-12T02:47:59.657243+0000","last_undegraded":"2024-09-12T02:47:59.657243+0000","last_fullsized":"2024-09-12T02:47:59.657243+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:04.770245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"134'6","reported_seq":20,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657525+0000","last_change":"2024-09-12T02:47:57.462911+0000","last_active":"2024-09-12T02:47:59.657525+0000","last_peered":"2024-09-12T02:47:59.657525+0000","last_clean":"2024-09-12T02:47:59.657525+0000","last_became_active":"2024-09-12T02:47:57.462658+0000","last_became_peered":"2024-09-12T02:47:57.462658+0000","last_unstale":"2024-09-12T02:47:59.657525+0000","last_undegraded":"2024-09-12T02:47:59.657525+0000","last_fullsized":"2024-09-12T02:47:59.657525+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:30.117038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462327+0000","last_change":"2024-09-12T02:47:58.474314+0000","last_active":"2024-09-12T02:47:59.462327+0000","last_peered":"2024-09-12T02:47:59.462327+0000","last_clean":"2024-09-12T02:47:59.462327+0000","last_became_active":"2024-09-12T02:47:58.470908+0000","last_became_peered":"2024-09-12T02:47:58.470908+0000","last_unstale":"2024-09-12T02:47:59.462327+0000","last_undegraded":"2024-09-12T02:47:59.462327+0000","last_fullsized":"2024-09-12T02:47:59.462327+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:52.392958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"134'2","reported_seq":16,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.464003+0000","last_change":"2024-09-12T02:47:57.465729+0000","last_active":"2024-09-12T02:47:59.464003+0000","last_peered":"2024-09-12T02:47:59.464003+0000","last_clean":"2024-09-12T02:47:59.464003+0000","last_became_active":"2024-09-12T02:47:57.465502+0000","last_became_peered":"2024-09-12T02:47:57.465502+0000","last_unstale":"2024-09-12T02:47:59.464003+0000","last_undegraded":"2024-09-12T02:47:59.464003+0000","last_fullsized":"2024-09-12T02:47:59.464003+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:54.210973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462558+0000","last_change":"2024-09-12T02:47:58.464174+0000","last_active":"2024-09-12T02:47:59.462558+0000","last_peered":"2024-09-12T02:47:59.462558+0000","last_clean":"2024-09-12T02:47:59.462558+0000","last_became_active":"2024-09-12T02:47:58.463913+0000","last_became_peered":"2024-09-12T02:47:58.463913+0000","last_unstale":"2024-09-12T02:47:59.462558+0000","last_undegraded":"2024-09-12T02:47:59.462558+0000","last_fullsized":"2024-09-12T02:47:59.462558+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:01.950187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462617+0000","last_change":"2024-09-12T02:47:57.467217+0000","last_active":"2024-09-12T02:47:59.462617+0000","last_peered":"2024-09-12T02:47:59.462617+0000","last_clean":"2024-09-12T02:47:59.462617+0000","last_became_active":"2024-09-12T02:47:57.466879+0000","last_became_peered":"2024-09-12T02:47:57.466879+0000","last_unstale":"2024-09-12T02:47:59.462617+0000","last_undegraded":"2024-09-12T02:47:59.462617+0000","last_fullsized":"2024-09-12T02:47:59.462617+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:53.641332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462232+0000","last_change":"2024-09-12T02:47:58.466536+0000","last_active":"2024-09-12T02:47:59.462232+0000","last_peered":"2024-09-12T02:47:59.462232+0000","last_clean":"2024-09-12T02:47:59.462232+0000","last_became_active":"2024-09-12T02:47:58.466245+0000","last_became_peered":"2024-09-12T02:47:58.466245+0000","last_unstale":"2024-09-12T02:47:59.462232+0000","last_undegraded":"2024-09-12T02:47:59.462232+0000","last_fullsized":"2024-09-12T02:47:59.462232+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:14.125248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"134'8","reported_seq":22,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657097+0000","last_change":"2024-09-12T02:47:57.470285+0000","last_active":"2024-09-12T02:47:59.657097+0000","last_peered":"2024-09-12T02:47:59.657097+0000","last_clean":"2024-09-12T02:47:59.657097+0000","last_became_active":"2024-09-12T02:47:57.469886+0000","last_became_peered":"2024-09-12T02:47:57.469886+0000","last_unstale":"2024-09-12T02:47:59.657097+0000","last_undegraded":"2024-09-12T02:47:59.657097+0000","last_fullsized":"2024-09-12T02:47:59.657097+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:38.797454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657187+0000","last_change":"2024-09-12T02:47:58.489660+0000","last_active":"2024-09-12T02:47:59.657187+0000","last_peered":"2024-09-12T02:47:59.657187+0000","last_clean":"2024-09-12T02:47:59.657187+0000","last_became_active":"2024-09-12T02:47:58.489459+0000","last_became_peered":"2024-09-12T02:47:58.489459+0000","last_unstale":"2024-09-12T02:47:59.657187+0000","last_undegraded":"2024-09-12T02:47:59.657187+0000","last_fullsized":"2024-09-12T02:47:59.657187+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:54.181380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"134'1","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657618+0000","last_change":"2024-09-12T02:47:57.466554+0000","last_active":"2024-09-12T02:47:59.657618+0000","last_peered":"2024-09-12T02:47:59.657618+0000","last_clean":"2024-09-12T02:47:59.657618+0000","last_became_active":"2024-09-12T02:47:57.466337+0000","last_became_peered":"2024-09-12T02:47:57.466337+0000","last_unstale":"2024-09-12T02:47:59.657618+0000","last_undegraded":"2024-09-12T02:47:59.657618+0000","last_fullsized":"2024-09-12T02:47:59.657618+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:08.072830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.463640+0000","last_change":"2024-09-12T02:47:58.489228+0000","last_active":"2024-09-12T02:47:59.463640+0000","last_peered":"2024-09-12T02:47:59.463640+0000","last_clean":"2024-09-12T02:47:59.463640+0000","last_became_active":"2024-09-12T02:47:58.488974+0000","last_became_peered":"2024-09-12T02:47:58.488974+0000","last_unstale":"2024-09-12T02:47:59.463640+0000","last_undegraded":"2024-09-12T02:47:59.463640+0000","last_fullsized":"2024-09-12T02:47:59.463640+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:19.842369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"134'2","reported_seq":16,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657544+0000","last_change":"2024-09-12T02:47:57.471259+0000","last_active":"2024-09-12T02:47:59.657544+0000","last_peered":"2024-09-12T02:47:59.657544+0000","last_clean":"2024-09-12T02:47:59.657544+0000","last_became_active":"2024-09-12T02:47:57.470578+0000","last_became_peered":"2024-09-12T02:47:57.470578+0000","last_unstale":"2024-09-12T02:47:59.657544+0000","last_undegraded":"2024-09-12T02:47:59.657544+0000","last_fullsized":"2024-09-12T02:47:59.657544+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:13.205170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658142+0000","last_change":"2024-09-12T02:47:58.487419+0000","last_active":"2024-09-12T02:47:59.658142+0000","last_peered":"2024-09-12T02:47:59.658142+0000","last_clean":"2024-09-12T02:47:59.658142+0000","last_became_active":"2024-09-12T02:47:58.487154+0000","last_became_peered":"2024-09-12T02:47:58.487154+0000","last_unstale":"2024-09-12T02:47:59.658142+0000","last_undegraded":"2024-09-12T02:47:59.658142+0000","last_fullsized":"2024-09-12T02:47:59.658142+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:19.637662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"134'1","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462711+0000","last_change":"2024-09-12T02:47:57.461685+0000","last_active":"2024-09-12T02:47:59.462711+0000","last_peered":"2024-09-12T02:47:59.462711+0000","last_clean":"2024-09-12T02:47:59.462711+0000","last_became_active":"2024-09-12T02:47:57.461464+0000","last_became_peered":"2024-09-12T02:47:57.461464+0000","last_unstale":"2024-09-12T02:47:59.462711+0000","last_undegraded":"2024-09-12T02:47:59.462711+0000","last_fullsized":"2024-09-12T02:47:59.462711+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:56.601521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658428+0000","last_change":"2024-09-12T02:47:58.471958+0000","last_active":"2024-09-12T02:47:59.658428+0000","last_peered":"2024-09-12T02:47:59.658428+0000","last_clean":"2024-09-12T02:47:59.658428+0000","last_became_active":"2024-09-12T02:47:58.471631+0000","last_became_peered":"2024-09-12T02:47:58.471631+0000","last_unstale":"2024-09-12T02:47:59.658428+0000","last_undegraded":"2024-09-12T02:47:59.658428+0000","last_fullsized":"2024-09-12T02:47:59.658428+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:44.863409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658082+0000","last_change":"2024-09-12T02:47:57.470460+0000","last_active":"2024-09-12T02:47:59.658082+0000","last_peered":"2024-09-12T02:47:59.658082+0000","last_clean":"2024-09-12T02:47:59.658082+0000","last_became_active":"2024-09-12T02:47:57.469717+0000","last_became_peered":"2024-09-12T02:47:57.469717+0000","last_unstale":"2024-09-12T02:47:59.658082+0000","last_undegraded":"2024-09-12T02:47:59.658082+0000","last_fullsized":"2024-09-12T02:47:59.658082+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:17.020019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658106+0000","last_change":"2024-09-12T02:47:58.471037+0000","last_active":"2024-09-12T02:47:59.658106+0000","last_peered":"2024-09-12T02:47:59.658106+0000","last_clean":"2024-09-12T02:47:59.658106+0000","last_became_active":"2024-09-12T02:47:58.468784+0000","last_became_peered":"2024-09-12T02:47:58.468784+0000","last_unstale":"2024-09-12T02:47:59.658106+0000","last_undegraded":"2024-09-12T02:47:59.658106+0000","last_fullsized":"2024-09-12T02:47:59.658106+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:19.165896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"134'2","reported_seq":16,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.463686+0000","last_change":"2024-09-12T02:47:57.471049+0000","last_active":"2024-09-12T02:47:59.463686+0000","last_peered":"2024-09-12T02:47:59.463686+0000","last_clean":"2024-09-12T02:47:59.463686+0000","last_became_active":"2024-09-12T02:47:57.470590+0000","last_became_peered":"2024-09-12T02:47:57.470590+0000","last_unstale":"2024-09-12T02:47:59.463686+0000","last_undegraded":"2024-09-12T02:47:59.463686+0000","last_fullsized":"2024-09-12T02:47:59.463686+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:50.671578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657508+0000","last_change":"2024-09-12T02:47:58.479325+0000","last_active":"2024-09-12T02:47:59.657508+0000","last_peered":"2024-09-12T02:47:59.657508+0000","last_clean":"2024-09-12T02:47:59.657508+0000","last_became_active":"2024-09-12T02:47:58.478875+0000","last_became_peered":"2024-09-12T02:47:58.478875+0000","last_unstale":"2024-09-12T02:47:59.657508+0000","last_undegraded":"2024-09-12T02:47:59.657508+0000","last_fullsized":"2024-09-12T02:47:59.657508+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:04.345700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657009+0000","last_change":"2024-09-12T02:47:57.469255+0000","last_active":"2024-09-12T02:47:59.657009+0000","last_peered":"2024-09-12T02:47:59.657009+0000","last_clean":"2024-09-12T02:47:59.657009+0000","last_became_active":"2024-09-12T02:47:57.468941+0000","last_became_peered":"2024-09-12T02:47:57.468941+0000","last_unstale":"2024-09-12T02:47:59.657009+0000","last_undegraded":"2024-09-12T02:47:59.657009+0000","last_fullsized":"2024-09-12T02:47:59.657009+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:48.881697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658589+0000","last_change":"2024-09-12T02:47:58.474149+0000","last_active":"2024-09-12T02:47:59.658589+0000","last_peered":"2024-09-12T02:47:59.658589+0000","last_clean":"2024-09-12T02:47:59.658589+0000","last_became_active":"2024-09-12T02:47:58.473882+0000","last_became_peered":"2024-09-12T02:47:58.473882+0000","last_unstale":"2024-09-12T02:47:59.658589+0000","last_undegraded":"2024-09-12T02:47:59.658589+0000","last_fullsized":"2024-09-12T02:47:59.658589+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:17.412911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.464107+0000","last_change":"2024-09-12T02:47:57.470430+0000","last_active":"2024-09-12T02:47:59.464107+0000","last_peered":"2024-09-12T02:47:59.464107+0000","last_clean":"2024-09-12T02:47:59.464107+0000","last_became_active":"2024-09-12T02:47:57.470194+0000","last_became_peered":"2024-09-12T02:47:57.470194+0000","last_unstale":"2024-09-12T02:47:59.464107+0000","last_undegraded":"2024-09-12T02:47:59.464107+0000","last_fullsized":"2024-09-12T02:47:59.464107+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:11.236614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462628+0000","last_change":"2024-09-12T02:47:58.487861+0000","last_active":"2024-09-12T02:47:59.462628+0000","last_peered":"2024-09-12T02:47:59.462628+0000","last_clean":"2024-09-12T02:47:59.462628+0000","last_became_active":"2024-09-12T02:47:58.487641+0000","last_became_peered":"2024-09-12T02:47:58.487641+0000","last_unstale":"2024-09-12T02:47:59.462628+0000","last_undegraded":"2024-09-12T02:47:59.462628+0000","last_fullsized":"2024-09-12T02:47:59.462628+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:07.702840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658025+0000","last_change":"2024-09-12T02:47:57.472550+0000","last_active":"2024-09-12T02:47:59.658025+0000","last_peered":"2024-09-12T02:47:59.658025+0000","last_clean":"2024-09-12T02:47:59.658025+0000","last_became_active":"2024-09-12T02:47:57.472338+0000","last_became_peered":"2024-09-12T02:47:57.472338+0000","last_unstale":"2024-09-12T02:47:59.658025+0000","last_undegraded":"2024-09-12T02:47:59.658025+0000","last_fullsized":"2024-09-12T02:47:59.658025+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:54.708104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462510+0000","last_change":"2024-09-12T02:47:58.487842+0000","last_active":"2024-09-12T02:47:59.462510+0000","last_peered":"2024-09-12T02:47:59.462510+0000","last_clean":"2024-09-12T02:47:59.462510+0000","last_became_active":"2024-09-12T02:47:58.487603+0000","last_became_peered":"2024-09-12T02:47:58.487603+0000","last_unstale":"2024-09-12T02:47:59.462510+0000","last_undegraded":"2024-09-12T02:47:59.462510+0000","last_fullsized":"2024-09-12T02:47:59.462510+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:27.828313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"134'2","reported_seq":16,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462503+0000","last_change":"2024-09-12T02:47:57.462356+0000","last_active":"2024-09-12T02:47:59.462503+0000","last_peered":"2024-09-12T02:47:59.462503+0000","last_clean":"2024-09-12T02:47:59.462503+0000","last_became_active":"2024-09-12T02:47:57.461958+0000","last_became_peered":"2024-09-12T02:47:57.461958+0000","last_unstale":"2024-09-12T02:47:59.462503+0000","last_undegraded":"2024-09-12T02:47:59.462503+0000","last_fullsized":"2024-09-12T02:47:59.462503+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:34.205886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657967+0000","last_change":"2024-09-12T02:47:58.487736+0000","last_active":"2024-09-12T02:47:59.657967+0000","last_peered":"2024-09-12T02:47:59.657967+0000","last_clean":"2024-09-12T02:47:59.657967+0000","last_became_active":"2024-09-12T02:47:58.486888+0000","last_became_peered":"2024-09-12T02:47:58.486888+0000","last_unstale":"2024-09-12T02:47:59.657967+0000","last_undegraded":"2024-09-12T02:47:59.657967+0000","last_fullsized":"2024-09-12T02:47:59.657967+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:51.874146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"135'1","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462626+0000","last_change":"2024-09-12T02:47:57.464602+0000","last_active":"2024-09-12T02:47:59.462626+0000","last_peered":"2024-09-12T02:47:59.462626+0000","last_clean":"2024-09-12T02:47:59.462626+0000","last_became_active":"2024-09-12T02:47:57.464369+0000","last_became_peered":"2024-09-12T02:47:57.464369+0000","last_unstale":"2024-09-12T02:47:59.462626+0000","last_undegraded":"2024-09-12T02:47:59.462626+0000","last_fullsized":"2024-09-12T02:47:59.462626+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:55.756238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657836+0000","last_change":"2024-09-12T02:47:58.492167+0000","last_active":"2024-09-12T02:47:59.657836+0000","last_peered":"2024-09-12T02:47:59.657836+0000","last_clean":"2024-09-12T02:47:59.657836+0000","last_became_active":"2024-09-12T02:47:58.491345+0000","last_became_peered":"2024-09-12T02:47:58.491345+0000","last_unstale":"2024-09-12T02:47:59.657836+0000","last_undegraded":"2024-09-12T02:47:59.657836+0000","last_fullsized":"2024-09-12T02:47:59.657836+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:28.917871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657713+0000","last_change":"2024-09-12T02:47:57.473286+0000","last_active":"2024-09-12T02:47:59.657713+0000","last_peered":"2024-09-12T02:47:59.657713+0000","last_clean":"2024-09-12T02:47:59.657713+0000","last_became_active":"2024-09-12T02:47:57.472708+0000","last_became_peered":"2024-09-12T02:47:57.472708+0000","last_unstale":"2024-09-12T02:47:59.657713+0000","last_undegraded":"2024-09-12T02:47:59.657713+0000","last_fullsized":"2024-09-12T02:47:59.657713+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:49.455512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462501+0000","last_change":"2024-09-12T02:47:58.487845+0000","last_active":"2024-09-12T02:47:59.462501+0000","last_peered":"2024-09-12T02:47:59.462501+0000","last_clean":"2024-09-12T02:47:59.462501+0000","last_became_active":"2024-09-12T02:47:58.487581+0000","last_became_peered":"2024-09-12T02:47:58.487581+0000","last_unstale":"2024-09-12T02:47:59.462501+0000","last_undegraded":"2024-09-12T02:47:59.462501+0000","last_fullsized":"2024-09-12T02:47:59.462501+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:24.328260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462671+0000","last_change":"2024-09-12T02:47:57.464547+0000","last_active":"2024-09-12T02:47:59.462671+0000","last_peered":"2024-09-12T02:47:59.462671+0000","last_clean":"2024-09-12T02:47:59.462671+0000","last_became_active":"2024-09-12T02:47:57.464317+0000","last_became_peered":"2024-09-12T02:47:57.464317+0000","last_unstale":"2024-09-12T02:47:59.462671+0000","last_undegraded":"2024-09-12T02:47:59.462671+0000","last_fullsized":"2024-09-12T02:47:59.462671+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:02.527867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658591+0000","last_change":"2024-09-12T02:47:58.469467+0000","last_active":"2024-09-12T02:47:59.658591+0000","last_peered":"2024-09-12T02:47:59.658591+0000","last_clean":"2024-09-12T02:47:59.658591+0000","last_became_active":"2024-09-12T02:47:58.469215+0000","last_became_peered":"2024-09-12T02:47:58.469215+0000","last_unstale":"2024-09-12T02:47:59.658591+0000","last_undegraded":"2024-09-12T02:47:59.658591+0000","last_fullsized":"2024-09-12T02:47:59.658591+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:04.003708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657898+0000","last_change":"2024-09-12T02:47:57.469200+0000","last_active":"2024-09-12T02:47:59.657898+0000","last_peered":"2024-09-12T02:47:59.657898+0000","last_clean":"2024-09-12T02:47:59.657898+0000","last_became_active":"2024-09-12T02:47:57.468940+0000","last_became_peered":"2024-09-12T02:47:57.468940+0000","last_unstale":"2024-09-12T02:47:59.657898+0000","last_undegraded":"2024-09-12T02:47:59.657898+0000","last_fullsized":"2024-09-12T02:47:59.657898+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:30.009340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.659103+0000","last_change":"2024-09-12T02:47:58.473673+0000","last_active":"2024-09-12T02:47:59.659103+0000","last_peered":"2024-09-12T02:47:59.659103+0000","last_clean":"2024-09-12T02:47:59.659103+0000","last_became_active":"2024-09-12T02:47:58.473007+0000","last_became_peered":"2024-09-12T02:47:58.473007+0000","last_unstale":"2024-09-12T02:47:59.659103+0000","last_undegraded":"2024-09-12T02:47:59.659103+0000","last_fullsized":"2024-09-12T02:47:59.659103+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:29.811277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658780+0000","last_change":"2024-09-12T02:47:57.464715+0000","last_active":"2024-09-12T02:47:59.658780+0000","last_peered":"2024-09-12T02:47:59.658780+0000","last_clean":"2024-09-12T02:47:59.658780+0000","last_became_active":"2024-09-12T02:47:57.464428+0000","last_became_peered":"2024-09-12T02:47:57.464428+0000","last_unstale":"2024-09-12T02:47:59.658780+0000","last_undegraded":"2024-09-12T02:47:59.658780+0000","last_fullsized":"2024-09-12T02:47:59.658780+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:18.676523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657964+0000","last_change":"2024-09-12T02:47:58.476378+0000","last_active":"2024-09-12T02:47:59.657964+0000","last_peered":"2024-09-12T02:47:59.657964+0000","last_clean":"2024-09-12T02:47:59.657964+0000","last_became_active":"2024-09-12T02:47:58.474575+0000","last_became_peered":"2024-09-12T02:47:58.474575+0000","last_unstale":"2024-09-12T02:47:59.657964+0000","last_undegraded":"2024-09-12T02:47:59.657964+0000","last_fullsized":"2024-09-12T02:47:59.657964+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:56.896387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657200+0000","last_change":"2024-09-12T02:47:57.469237+0000","last_active":"2024-09-12T02:47:59.657200+0000","last_peered":"2024-09-12T02:47:59.657200+0000","last_clean":"2024-09-12T02:47:59.657200+0000","last_became_active":"2024-09-12T02:47:57.468975+0000","last_became_peered":"2024-09-12T02:47:57.468975+0000","last_unstale":"2024-09-12T02:47:59.657200+0000","last_undegraded":"2024-09-12T02:47:59.657200+0000","last_fullsized":"2024-09-12T02:47:59.657200+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:40.513369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657426+0000","last_change":"2024-09-12T02:47:58.491418+0000","last_active":"2024-09-12T02:47:59.657426+0000","last_peered":"2024-09-12T02:47:59.657426+0000","last_clean":"2024-09-12T02:47:59.657426+0000","last_became_active":"2024-09-12T02:47:58.488892+0000","last_became_peered":"2024-09-12T02:47:58.488892+0000","last_unstale":"2024-09-12T02:47:59.657426+0000","last_undegraded":"2024-09-12T02:47:59.657426+0000","last_fullsized":"2024-09-12T02:47:59.657426+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:53.656398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657793+0000","last_change":"2024-09-12T02:47:57.473483+0000","last_active":"2024-09-12T02:47:59.657793+0000","last_peered":"2024-09-12T02:47:59.657793+0000","last_clean":"2024-09-12T02:47:59.657793+0000","last_became_active":"2024-09-12T02:47:57.473031+0000","last_became_peered":"2024-09-12T02:47:57.473031+0000","last_unstale":"2024-09-12T02:47:59.657793+0000","last_undegraded":"2024-09-12T02:47:59.657793+0000","last_fullsized":"2024-09-12T02:47:59.657793+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:12:42.070116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.462198+0000","last_change":"2024-09-12T02:47:58.464242+0000","last_active":"2024-09-12T02:47:59.462198+0000","last_peered":"2024-09-12T02:47:59.462198+0000","last_clean":"2024-09-12T02:47:59.462198+0000","last_became_active":"2024-09-12T02:47:58.463947+0000","last_became_peered":"2024-09-12T02:47:58.463947+0000","last_unstale":"2024-09-12T02:47:59.462198+0000","last_undegraded":"2024-09-12T02:47:59.462198+0000","last_fullsized":"2024-09-12T02:47:59.462198+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:57.449790+0000","last_clean_scrub_stamp":"2024-09-12T02:47:57.449790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:16.716165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.657995+0000","last_change":"2024-09-12T02:47:57.470279+0000","last_active":"2024-09-12T02:47:59.657995+0000","last_peered":"2024-09-12T02:47:59.657995+0000","last_clean":"2024-09-12T02:47:59.657995+0000","last_became_active":"2024-09-12T02:47:57.469397+0000","last_became_peered":"2024-09-12T02:47:57.469397+0000","last_unstale":"2024-09-12T02:47:59.657995+0000","last_undegraded":"2024-09-12T02:47:59.657995+0000","last_fullsized":"2024-09-12T02:47:59.657995+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:47:56.447102+0000","last_clean_scrub_stamp":"2024-09-12T02:47:56.447102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:16.471310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":394,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-12T02:47:59.658306+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:47:59.658306+0000","last_peered":"2024-09-12T02:47:59.658306+0000","last_clean":"2024-09-12T02:47:59.658306+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:47:59.658306+0000","last_undegraded":"2024-09-12T02:47:59.658306+0000","last_fullsized":"2024-09-12T02:47:59.658306+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:25.823876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1306,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194006,"statfs":{"total":200000000,"available":198662178,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574926,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":729,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194583,"statfs":{"total":200000000,"available":199253092,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":729,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194582,"statfs":{"total":200000000,"available":199252558,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":729,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194583,"statfs":{"total":200000000,"available":199253162,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":730,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194581,"statfs":{"total":200000000,"available":199251480,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":729,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194583,"statfs":{"total":200000000,"available":199253162,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":729,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194583,"statfs":{"total":200000000,"available":199253038,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1307,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194004,"statfs":{"total":200000000,"available":198661070,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:48:07.683 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:48:07.683 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T02:48:07.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.879+0000 7f50e8a00640 1 Processor -- start 2024-09-12T02:48:07.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.879+0000 7f50e8a00640 1 -- start start 2024-09-12T02:48:07.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.880+0000 7f50e8a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f50e4145440 0x7f50e415fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:07.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.880+0000 7f50e8a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f50e4160260 0x7f50e40d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:07.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.880+0000 7f50e8a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50e415f540 con 0x7f50e4144d00 2024-09-12T02:48:07.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.880+0000 7f50e8a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f50e415c830 con 0x7f50e4145440 2024-09-12T02:48:07.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.880+0000 7f50e8a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f50e415cb10 con 0x7f50e4160260 2024-09-12T02:48:07.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.881+0000 7f50e1400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f50e4145440 0x7f50e415fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:07.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.881+0000 7f50e1400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f50e4145440 0x7f50e415fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34428/0 (socket says 172.21.15.112:34428) 2024-09-12T02:48:07.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.881+0000 7f50e1400640 1 -- 172.21.15.112:0/1180539802 learned_addr learned my addr 172.21.15.112:0/1180539802 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:07.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.881+0000 7f50e2800640 1 --2- 172.21.15.112:0/1180539802 >> v2:172.21.15.137:3300/0 conn(0x7f50e4160260 0x7f50e40d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:07.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.881+0000 7f50e1400640 1 -- 172.21.15.112:0/1180539802 >> v2:172.21.15.137:3300/0 conn(0x7f50e4160260 msgr2=0x7f50e40d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:07.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.881+0000 7f50e1400640 1 --2- 172.21.15.112:0/1180539802 >> v2:172.21.15.137:3300/0 conn(0x7f50e4160260 0x7f50e40d0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:07.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.881+0000 7f50e1400640 1 -- 172.21.15.112:0/1180539802 >> v1:172.21.15.137:6789/0 conn(0x7f50e4144d00 legacy=0x7f50e415bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:07.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.881+0000 7f50e1400640 1 -- 172.21.15.112:0/1180539802 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e415cdf0 con 0x7f50e4145440 2024-09-12T02:48:07.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.882+0000 7f50e1400640 1 --2- 172.21.15.112:0/1180539802 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50e4145440 0x7f50e415fd20 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f50e406de80 tx=0x7f50d002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6dab1aa0424c604 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:07.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.882+0000 7f50e0a00640 1 -- 172.21.15.112:0/1180539802 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d0037070 con 0x7f50e4145440 2024-09-12T02:48:07.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.883+0000 7f50e0a00640 1 -- 172.21.15.112:0/1180539802 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50d0032440 con 0x7f50e4145440 2024-09-12T02:48:07.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.883+0000 7f50e0a00640 1 -- 172.21.15.112:0/1180539802 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d0032810 con 0x7f50e4145440 2024-09-12T02:48:07.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.883+0000 7f50e8a00640 1 -- 172.21.15.112:0/1180539802 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50e4145440 msgr2=0x7f50e415fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:07.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.883+0000 7f50e8a00640 1 --2- 172.21.15.112:0/1180539802 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50e4145440 0x7f50e415fd20 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f50e406de80 tx=0x7f50d002a1a0 comp rx=0 tx=0).stop 2024-09-12T02:48:07.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.883+0000 7f50e8a00640 1 -- 172.21.15.112:0/1180539802 shutdown_connections 2024-09-12T02:48:07.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.883+0000 7f50e8a00640 1 --2- 172.21.15.112:0/1180539802 >> v2:172.21.15.137:3300/0 conn(0x7f50e4160260 0x7f50e40d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:07.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.883+0000 7f50e8a00640 1 --2- 172.21.15.112:0/1180539802 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50e4145440 0x7f50e415fd20 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:07.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.883+0000 7f50e8a00640 1 -- 172.21.15.112:0/1180539802 >> 172.21.15.112:0/1180539802 conn(0x7f50e40b28a0 msgr2=0x7f50e40b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:07.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.883+0000 7f50e8a00640 1 -- 172.21.15.112:0/1180539802 shutdown_connections 2024-09-12T02:48:07.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.883+0000 7f50e8a00640 1 -- 172.21.15.112:0/1180539802 wait complete. 2024-09-12T02:48:07.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.885+0000 7f50e8a00640 1 Processor -- start 2024-09-12T02:48:07.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.885+0000 7f50e8a00640 1 -- start start 2024-09-12T02:48:07.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.886+0000 7f50e8a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e4144d00 0x7f50e413f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:07.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.886+0000 7f50e8a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50e4145440 0x7f50e413c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:07.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.886+0000 7f50e8a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50e4160260 0x7f50e415a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:07.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.886+0000 7f50e8a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f50e4145260 con 0x7f50e4160260 2024-09-12T02:48:07.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.886+0000 7f50e8a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f50e41450e0 con 0x7f50e4144d00 2024-09-12T02:48:07.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.886+0000 7f50e8a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f50e40d0ec0 con 0x7f50e4145440 2024-09-12T02:48:07.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.886+0000 7f50e2800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50e4160260 0x7f50e415a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:07.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.886+0000 7f50e2800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50e4160260 0x7f50e415a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34434/0 (socket says 172.21.15.112:34434) 2024-09-12T02:48:07.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.886+0000 7f50e2800640 1 -- 172.21.15.112:0/3551557497 learned_addr learned my addr 172.21.15.112:0/3551557497 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:07.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.886+0000 7f50e1e00640 1 --2- 172.21.15.112:0/3551557497 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e4144d00 0x7f50e413f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:07.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.886+0000 7f50e1400640 1 --2- 172.21.15.112:0/3551557497 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50e4145440 0x7f50e413c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:07.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.887+0000 7f50e2800640 1 -- 172.21.15.112:0/3551557497 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50e4145440 msgr2=0x7f50e413c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:07.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.887+0000 7f50e2800640 1 --2- 172.21.15.112:0/3551557497 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50e4145440 0x7f50e413c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:07.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.887+0000 7f50e2800640 1 -- 172.21.15.112:0/3551557497 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e4144d00 msgr2=0x7f50e413f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:07.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.887+0000 7f50e2800640 1 --2- 172.21.15.112:0/3551557497 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e4144d00 0x7f50e413f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:07.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.887+0000 7f50e2800640 1 -- 172.21.15.112:0/3551557497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e413c890 con 0x7f50e4160260 2024-09-12T02:48:07.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.887+0000 7f50e1400640 1 --2- 172.21.15.112:0/3551557497 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50e4145440 0x7f50e413c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:07.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.887+0000 7f50e2800640 1 --2- 172.21.15.112:0/3551557497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50e4160260 0x7f50e415a530 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00d830 tx=0x7f50dc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:07.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.887+0000 7f50da000640 1 -- 172.21.15.112:0/3551557497 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc00b6c0 con 0x7f50e4160260 2024-09-12T02:48:07.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.887+0000 7f50da000640 1 -- 172.21.15.112:0/3551557497 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50dc019070 con 0x7f50e4160260 2024-09-12T02:48:07.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.887+0000 7f50da000640 1 -- 172.21.15.112:0/3551557497 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc00bac0 con 0x7f50e4160260 2024-09-12T02:48:07.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.887+0000 7f50e8a00640 1 -- 172.21.15.112:0/3551557497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50e413f7f0 con 0x7f50e4160260 2024-09-12T02:48:07.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.887+0000 7f50e8a00640 1 -- 172.21.15.112:0/3551557497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e413fdb0 con 0x7f50e4160260 2024-09-12T02:48:07.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.888+0000 7f50e8a00640 1 -- 172.21.15.112:0/3551557497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50e40d1250 con 0x7f50e4160260 2024-09-12T02:48:07.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.889+0000 7f50da000640 1 -- 172.21.15.112:0/3551557497 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f50dc01e460 con 0x7f50e4160260 2024-09-12T02:48:07.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.890+0000 7f50da000640 1 --2- 172.21.15.112:0/3551557497 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f50c406be30 0x7f50c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:07.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.891+0000 7f50da000640 1 -- 172.21.15.112:0/3551557497 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f50dc08b4e0 con 0x7f50e4160260 2024-09-12T02:48:07.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.891+0000 7f50e1e00640 1 --2- 172.21.15.112:0/3551557497 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f50c406be30 0x7f50c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:07.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.891+0000 7f50e1e00640 1 --2- 172.21.15.112:0/3551557497 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f50c406be30 0x7f50c406e2f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f50e4144020 tx=0x7f50d400d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:07.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:07.895+0000 7f50da000640 1 -- 172.21.15.112:0/3551557497 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f50dc059df0 con 0x7f50e4160260 2024-09-12T02:48:08.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.133+0000 7f50e8a00640 1 -- 172.21.15.112:0/3551557497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f50e40cce90 con 0x7f50e4160260 2024-09-12T02:48:08.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.135+0000 7f50da000640 1 -- 172.21.15.112:0/3551557497 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) ==== 190+0+147 (secure 0 0 0) 0x7f50dc0596f0 con 0x7f50e4160260 2024-09-12T02:48:08.136 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-09-12T02:48:08.136 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDUVOJmaG86ExAAD0SOlJOsLpoQZlgPJIPaxA== 2024-09-12T02:48:08.136 INFO:teuthology.orchestra.run.smithi112.stdout: caps mds = "allow" 2024-09-12T02:48:08.136 INFO:teuthology.orchestra.run.smithi112.stdout: caps mon = "allow r" 2024-09-12T02:48:08.137 INFO:teuthology.orchestra.run.smithi112.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T02:48:08.137 INFO:teuthology.orchestra.run.smithi112.stderr:updated caps for client.0 2024-09-12T02:48:08.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.138+0000 7f50e8a00640 1 -- 172.21.15.112:0/3551557497 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f50c406be30 msgr2=0x7f50c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:08.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.138+0000 7f50e8a00640 1 --2- 172.21.15.112:0/3551557497 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f50c406be30 0x7f50c406e2f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f50e4144020 tx=0x7f50d400d040 comp rx=0 tx=0).stop 2024-09-12T02:48:08.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.138+0000 7f50e8a00640 1 -- 172.21.15.112:0/3551557497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50e4160260 msgr2=0x7f50e415a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:08.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.138+0000 7f50e8a00640 1 --2- 172.21.15.112:0/3551557497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50e4160260 0x7f50e415a530 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00d830 tx=0x7f50dc00dcf0 comp rx=0 tx=0).stop 2024-09-12T02:48:08.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.138+0000 7f50e8a00640 1 -- 172.21.15.112:0/3551557497 shutdown_connections 2024-09-12T02:48:08.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.138+0000 7f50e8a00640 1 --2- 172.21.15.112:0/3551557497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50e4160260 0x7f50e415a530 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:08.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.138+0000 7f50e8a00640 1 --2- 172.21.15.112:0/3551557497 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50e4145440 0x7f50e413c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:08.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.138+0000 7f50e8a00640 1 --2- 172.21.15.112:0/3551557497 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f50c406be30 0x7f50c406e2f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:08.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.138+0000 7f50e8a00640 1 --2- 172.21.15.112:0/3551557497 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e4144d00 0x7f50e413f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:08.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.138+0000 7f50e8a00640 1 -- 172.21.15.112:0/3551557497 >> 172.21.15.112:0/3551557497 conn(0x7f50e40b28a0 msgr2=0x7f50e4071650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:08.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.138+0000 7f50e8a00640 1 -- 172.21.15.112:0/3551557497 shutdown_connections 2024-09-12T02:48:08.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.138+0000 7f50e8a00640 1 -- 172.21.15.112:0/3551557497 wait complete. 2024-09-12T02:48:08.154 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:48:08.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.305+0000 7f6f52800640 1 Processor -- start 2024-09-12T02:48:08.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.305+0000 7f6f52800640 1 -- start start 2024-09-12T02:48:08.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.307+0000 7f6f52800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6f4c15b9a0 0x7f6f4c06d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:08.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.307+0000 7f6f52800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f4c06f270 0x7f6f4c0b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:08.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.307+0000 7f6f52800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f4c0b42c0 con 0x7f6f4c0b5560 2024-09-12T02:48:08.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.307+0000 7f6f52800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6f4c06de70 con 0x7f6f4c15b9a0 2024-09-12T02:48:08.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.307+0000 7f6f52800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6f4c06f690 con 0x7f6f4c06f270 2024-09-12T02:48:08.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.307+0000 7f6f51e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f6f4c0b5560 0x7f6f4c0d0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:41012/0 (socket says 172.21.15.112:41012) 2024-09-12T02:48:08.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.307+0000 7f6f51e00640 1 -- 172.21.15.112:0/562363062 learned_addr learned my addr 172.21.15.112:0/562363062 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:08.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.307+0000 7f6f51400640 1 --2- 172.21.15.112:0/562363062 >> v2:172.21.15.137:3300/0 conn(0x7f6f4c15b9a0 0x7f6f4c06d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:08.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.307+0000 7f6f50a00640 1 --2- 172.21.15.112:0/562363062 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f4c06f270 0x7f6f4c0b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:08.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.307+0000 7f6f4be00640 1 -- 172.21.15.112:0/562363062 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3811569125 0 0) 0x7f6f44001490 con 0x7f6f4c0b5560 2024-09-12T02:48:08.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.308+0000 7f6f4be00640 1 -- 172.21.15.112:0/562363062 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f34003520 con 0x7f6f4c0b5560 2024-09-12T02:48:08.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.308+0000 7f6f50a00640 1 -- 172.21.15.112:0/562363062 >> v2:172.21.15.137:3300/0 conn(0x7f6f4c15b9a0 msgr2=0x7f6f4c06d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:08.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.308+0000 7f6f50a00640 1 --2- 172.21.15.112:0/562363062 >> v2:172.21.15.137:3300/0 conn(0x7f6f4c15b9a0 0x7f6f4c06d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:08.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.308+0000 7f6f50a00640 1 -- 172.21.15.112:0/562363062 >> v1:172.21.15.112:6789/0 conn(0x7f6f4c0b5560 legacy=0x7f6f4c0d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:08.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.308+0000 7f6f50a00640 1 -- 172.21.15.112:0/562363062 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f4c15bd80 con 0x7f6f4c06f270 2024-09-12T02:48:08.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.309+0000 7f6f50a00640 1 --2- 172.21.15.112:0/562363062 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f4c06f270 0x7f6f4c0b5020 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6f380097a0 tx=0x7f6f3802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b80b5e29047afcd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:08.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.309+0000 7f6f4be00640 1 -- 172.21.15.112:0/562363062 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f38037070 con 0x7f6f4c06f270 2024-09-12T02:48:08.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.309+0000 7f6f4be00640 1 -- 172.21.15.112:0/562363062 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f38032440 con 0x7f6f4c06f270 2024-09-12T02:48:08.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.309+0000 7f6f4be00640 1 -- 172.21.15.112:0/562363062 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f380327f0 con 0x7f6f4c06f270 2024-09-12T02:48:08.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.309+0000 7f6f52800640 1 -- 172.21.15.112:0/562363062 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f4c06f270 msgr2=0x7f6f4c0b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:08.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.309+0000 7f6f52800640 1 --2- 172.21.15.112:0/562363062 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f4c06f270 0x7f6f4c0b5020 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6f380097a0 tx=0x7f6f3802a180 comp rx=0 tx=0).stop 2024-09-12T02:48:08.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.310+0000 7f6f52800640 1 -- 172.21.15.112:0/562363062 shutdown_connections 2024-09-12T02:48:08.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.310+0000 7f6f52800640 1 --2- 172.21.15.112:0/562363062 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f4c06f270 0x7f6f4c0b5020 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:08.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.310+0000 7f6f52800640 1 --2- 172.21.15.112:0/562363062 >> v2:172.21.15.137:3300/0 conn(0x7f6f4c15b9a0 0x7f6f4c06d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:08.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.310+0000 7f6f52800640 1 -- 172.21.15.112:0/562363062 >> 172.21.15.112:0/562363062 conn(0x7f6f4c06bbd0 msgr2=0x7f6f4c06bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:08.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.310+0000 7f6f52800640 1 -- 172.21.15.112:0/562363062 shutdown_connections 2024-09-12T02:48:08.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.310+0000 7f6f52800640 1 -- 172.21.15.112:0/562363062 wait complete. 2024-09-12T02:48:08.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.311+0000 7f6f52800640 1 Processor -- start 2024-09-12T02:48:08.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.311+0000 7f6f52800640 1 -- start start 2024-09-12T02:48:08.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.312+0000 7f6f52800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f4c06f270 0x7f6f4c154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:08.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.312+0000 7f6f52800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f4c15b9a0 0x7f6f4c15bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:08.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.312+0000 7f6f52800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f4c1f7fb0 0x7f6f4c0b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:08.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.312+0000 7f6f52800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6f4c0b4b00 con 0x7f6f4c06f270 2024-09-12T02:48:08.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.312+0000 7f6f52800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6f4c0b4820 con 0x7f6f4c15b9a0 2024-09-12T02:48:08.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.312+0000 7f6f52800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6f4c0b5b50 con 0x7f6f4c1f7fb0 2024-09-12T02:48:08.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.312+0000 7f6f51400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f4c06f270 0x7f6f4c154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:08.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.312+0000 7f6f51400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f4c06f270 0x7f6f4c154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34444/0 (socket says 172.21.15.112:34444) 2024-09-12T02:48:08.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.313+0000 7f6f51400640 1 -- 172.21.15.112:0/2880713819 learned_addr learned my addr 172.21.15.112:0/2880713819 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:08.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.313+0000 7f6f50a00640 1 --2- 172.21.15.112:0/2880713819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f4c15b9a0 0x7f6f4c15bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:08.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.313+0000 7f6f51e00640 1 --2- 172.21.15.112:0/2880713819 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f4c1f7fb0 0x7f6f4c0b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:08.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.313+0000 7f6f51400640 1 -- 172.21.15.112:0/2880713819 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f4c1f7fb0 msgr2=0x7f6f4c0b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:08.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.313+0000 7f6f51400640 1 --2- 172.21.15.112:0/2880713819 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f4c1f7fb0 0x7f6f4c0b1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:08.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.313+0000 7f6f51400640 1 -- 172.21.15.112:0/2880713819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f4c15b9a0 msgr2=0x7f6f4c15bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:08.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.313+0000 7f6f51400640 1 --2- 172.21.15.112:0/2880713819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f4c15b9a0 0x7f6f4c15bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:08.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.313+0000 7f6f51400640 1 -- 172.21.15.112:0/2880713819 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f4c1f8440 con 0x7f6f4c06f270 2024-09-12T02:48:08.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.313+0000 7f6f50a00640 1 --2- 172.21.15.112:0/2880713819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f4c15b9a0 0x7f6f4c15bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:08.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.313+0000 7f6f51400640 1 --2- 172.21.15.112:0/2880713819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f4c06f270 0x7f6f4c154b10 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f6f4000e8a0 tx=0x7f6f4000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:08.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.313+0000 7f6f49600640 1 -- 172.21.15.112:0/2880713819 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f40017070 con 0x7f6f4c06f270 2024-09-12T02:48:08.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.313+0000 7f6f49600640 1 -- 172.21.15.112:0/2880713819 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f4000c940 con 0x7f6f4c06f270 2024-09-12T02:48:08.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.313+0000 7f6f49600640 1 -- 172.21.15.112:0/2880713819 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4000cd30 con 0x7f6f4c06f270 2024-09-12T02:48:08.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.313+0000 7f6f52800640 1 -- 172.21.15.112:0/2880713819 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f4c1f8720 con 0x7f6f4c06f270 2024-09-12T02:48:08.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.314+0000 7f6f52800640 1 -- 172.21.15.112:0/2880713819 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f4c1f8ce0 con 0x7f6f4c06f270 2024-09-12T02:48:08.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.315+0000 7f6f52800640 1 -- 172.21.15.112:0/2880713819 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f4c0b5020 con 0x7f6f4c06f270 2024-09-12T02:48:08.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.316+0000 7f6f49600640 1 -- 172.21.15.112:0/2880713819 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6f4001a070 con 0x7f6f4c06f270 2024-09-12T02:48:08.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.316+0000 7f6f49600640 1 --2- 172.21.15.112:0/2880713819 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6f2c06be30 0x7f6f2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:08.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.316+0000 7f6f49600640 1 -- 172.21.15.112:0/2880713819 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f6f4008adc0 con 0x7f6f4c06f270 2024-09-12T02:48:08.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.317+0000 7f6f50a00640 1 --2- 172.21.15.112:0/2880713819 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6f2c06be30 0x7f6f2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:08.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.317+0000 7f6f50a00640 1 --2- 172.21.15.112:0/2880713819 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6f2c06be30 0x7f6f2c06e2f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6f38034000 tx=0x7f6f3802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:08.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.321+0000 7f6f49600640 1 -- 172.21.15.112:0/2880713819 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6f400596d0 con 0x7f6f4c06f270 2024-09-12T02:48:08.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.527+0000 7f6f52800640 1 -- 172.21.15.112:0/2880713819 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f4c0763b0 con 0x7f6f4c06f270 2024-09-12T02:48:08.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.527+0000 7f6f49600640 1 -- 172.21.15.112:0/2880713819 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+5231 (secure 0 0 0) 0x7f6f40058fd0 con 0x7f6f4c06f270 2024-09-12T02:48:08.528 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:08.529 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":70,"btime":"2024-09-12T02:48:01:488612+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5816,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1943935405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1943935405},{"type":"v1","addr":"172.21.15.137:6834","nonce":1943935405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6328,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2010766966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2010766966},{"type":"v1","addr":"172.21.15.112:6835","nonce":2010766966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/193655023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":193655023},{"type":"v1","addr":"172.21.15.137:6835","nonce":193655023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:47:57.871200+0000","modified":"2024-09-12T02:48:00.893329+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6861":{"gid":6861,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/134918269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":134918269},{"type":"v1","addr":"172.21.15.112:6837","nonce":134918269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6861,"qdb_cluster":[6861]},"id":8}]} 2024-09-12T02:48:08.529 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 70 2024-09-12T02:48:08.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.530+0000 7f6f52800640 1 -- 172.21.15.112:0/2880713819 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6f2c06be30 msgr2=0x7f6f2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:08.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.530+0000 7f6f52800640 1 --2- 172.21.15.112:0/2880713819 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6f2c06be30 0x7f6f2c06e2f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6f38034000 tx=0x7f6f3802e000 comp rx=0 tx=0).stop 2024-09-12T02:48:08.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.530+0000 7f6f52800640 1 -- 172.21.15.112:0/2880713819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f4c06f270 msgr2=0x7f6f4c154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:08.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.530+0000 7f6f52800640 1 --2- 172.21.15.112:0/2880713819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f4c06f270 0x7f6f4c154b10 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f6f4000e8a0 tx=0x7f6f4000ed60 comp rx=0 tx=0).stop 2024-09-12T02:48:08.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.530+0000 7f6f52800640 1 -- 172.21.15.112:0/2880713819 shutdown_connections 2024-09-12T02:48:08.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.530+0000 7f6f52800640 1 --2- 172.21.15.112:0/2880713819 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f4c1f7fb0 0x7f6f4c0b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:08.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.530+0000 7f6f52800640 1 --2- 172.21.15.112:0/2880713819 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6f2c06be30 0x7f6f2c06e2f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:08.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.530+0000 7f6f52800640 1 --2- 172.21.15.112:0/2880713819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f4c15b9a0 0x7f6f4c15bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:08.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.530+0000 7f6f52800640 1 --2- 172.21.15.112:0/2880713819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f4c06f270 0x7f6f4c154b10 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:08.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.530+0000 7f6f52800640 1 -- 172.21.15.112:0/2880713819 >> 172.21.15.112:0/2880713819 conn(0x7f6f4c06bbd0 msgr2=0x7f6f4c1595b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:08.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.530+0000 7f6f52800640 1 -- 172.21.15.112:0/2880713819 shutdown_connections 2024-09-12T02:48:08.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:08.530+0000 7f6f52800640 1 -- 172.21.15.112:0/2880713819 wait complete. 2024-09-12T02:48:08.949 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:47:57.871200+0000', 'modified': '2024-09-12T02:48:00.893329+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6861}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6861': {'gid': 6861, 'name': 'c', 'rank': 0, 'incarnation': 66, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.112:6837/134918269', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6836', 'nonce': 134918269}, {'type': 'v1', 'addr': '172.21.15.112:6837', 'nonce': 134918269}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6861, 'qdb_cluster': [6861]} 2024-09-12T02:48:08.950 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:48:08.950 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-12T02:48:09.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.106+0000 7fe001600640 1 Processor -- start 2024-09-12T02:48:09.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.106+0000 7fe001600640 1 -- start start 2024-09-12T02:48:09.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.107+0000 7fe001600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdffc15b9d0 0x7fdffc0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:09.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.108+0000 7fe001600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdffc0b45d0 0x7fdffc0728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:09.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.108+0000 7fe001600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdffc06eef0 0x7fdffc06f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:09.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.108+0000 7fe001600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fdffc0b4a30 con 0x7fdffc06eef0 2024-09-12T02:48:09.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.108+0000 7fe001600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fdffc06f840 con 0x7fdffc0b45d0 2024-09-12T02:48:09.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.108+0000 7fe001600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdffc0b54a0 con 0x7fdffc15b9d0 2024-09-12T02:48:09.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.108+0000 7fdffb400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdffc06eef0 0x7fdffc06f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:09.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.108+0000 7fdffb400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdffc06eef0 0x7fdffc06f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34448/0 (socket says 172.21.15.112:34448) 2024-09-12T02:48:09.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.108+0000 7fdffb400640 1 -- 172.21.15.112:0/439469583 learned_addr learned my addr 172.21.15.112:0/439469583 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:09.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.108+0000 7fdffa000640 1 --2- 172.21.15.112:0/439469583 >> v2:172.21.15.137:3300/0 conn(0x7fdffc0b45d0 0x7fdffc0728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:09.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.108+0000 7fdffaa00640 1 --2- 172.21.15.112:0/439469583 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdffc15b9d0 0x7fdffc0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:09.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.108+0000 7fdffb400640 1 -- 172.21.15.112:0/439469583 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdffc15b9d0 msgr2=0x7fdffc0b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:09.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.108+0000 7fdffb400640 1 --2- 172.21.15.112:0/439469583 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdffc15b9d0 0x7fdffc0b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.108+0000 7fdffb400640 1 -- 172.21.15.112:0/439469583 >> v2:172.21.15.137:3300/0 conn(0x7fdffc0b45d0 msgr2=0x7fdffc0728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:09.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.108+0000 7fdffb400640 1 --2- 172.21.15.112:0/439469583 >> v2:172.21.15.137:3300/0 conn(0x7fdffc0b45d0 0x7fdffc0728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.108+0000 7fdffb400640 1 -- 172.21.15.112:0/439469583 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdffc0b3af0 con 0x7fdffc06eef0 2024-09-12T02:48:09.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.109+0000 7fdffb400640 1 --2- 172.21.15.112:0/439469583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdffc06eef0 0x7fdffc06f300 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fdffc06d2e0 tx=0x7fdff402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0da44bcd0485ed3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:09.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.110+0000 7fdff9600640 1 -- 172.21.15.112:0/439469583 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff4036070 con 0x7fdffc06eef0 2024-09-12T02:48:09.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.110+0000 7fdff9600640 1 -- 172.21.15.112:0/439469583 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdff4031600 con 0x7fdffc06eef0 2024-09-12T02:48:09.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.110+0000 7fdff9600640 1 -- 172.21.15.112:0/439469583 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff40319d0 con 0x7fdffc06eef0 2024-09-12T02:48:09.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.110+0000 7fe001600640 1 -- 172.21.15.112:0/439469583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdffc06eef0 msgr2=0x7fdffc06f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:09.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.110+0000 7fe001600640 1 --2- 172.21.15.112:0/439469583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdffc06eef0 0x7fdffc06f300 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fdffc06d2e0 tx=0x7fdff402a6a0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.110+0000 7fe001600640 1 -- 172.21.15.112:0/439469583 shutdown_connections 2024-09-12T02:48:09.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.110+0000 7fe001600640 1 --2- 172.21.15.112:0/439469583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdffc06eef0 0x7fdffc06f300 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.110+0000 7fe001600640 1 --2- 172.21.15.112:0/439469583 >> v2:172.21.15.137:3300/0 conn(0x7fdffc0b45d0 0x7fdffc0728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.110+0000 7fe001600640 1 --2- 172.21.15.112:0/439469583 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdffc15b9d0 0x7fdffc0b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.110+0000 7fe001600640 1 -- 172.21.15.112:0/439469583 >> 172.21.15.112:0/439469583 conn(0x7fdffc06bbd0 msgr2=0x7fdffc06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:09.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.110+0000 7fe001600640 1 -- 172.21.15.112:0/439469583 shutdown_connections 2024-09-12T02:48:09.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.110+0000 7fe001600640 1 -- 172.21.15.112:0/439469583 wait complete. 2024-09-12T02:48:09.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.112+0000 7fe001600640 1 Processor -- start 2024-09-12T02:48:09.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.112+0000 7fe001600640 1 -- start start 2024-09-12T02:48:09.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.113+0000 7fe001600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdffc06eef0 0x7fdffc142380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:09.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.113+0000 7fe001600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdffc0b45d0 0x7fdffc157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:09.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.113+0000 7fe001600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdffc15b9d0 0x7fdffc1533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:09.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.113+0000 7fe001600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdffc15bdb0 con 0x7fdffc0b45d0 2024-09-12T02:48:09.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.113+0000 7fe001600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdffc0b40b0 con 0x7fdffc15b9d0 2024-09-12T02:48:09.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.113+0000 7fe001600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdffc15bf30 con 0x7fdffc06eef0 2024-09-12T02:48:09.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.113+0000 7fdffa000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdffc0b45d0 0x7fdffc157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:09.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.113+0000 7fdffa000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdffc0b45d0 0x7fdffc157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34460/0 (socket says 172.21.15.112:34460) 2024-09-12T02:48:09.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.113+0000 7fdffa000640 1 -- 172.21.15.112:0/2222136002 learned_addr learned my addr 172.21.15.112:0/2222136002 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:09.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.113+0000 7fdffaa00640 1 --2- 172.21.15.112:0/2222136002 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdffc06eef0 0x7fdffc142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:09.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.113+0000 7fdffb400640 1 --2- 172.21.15.112:0/2222136002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdffc15b9d0 0x7fdffc1533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:09.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.114+0000 7fdffa000640 1 -- 172.21.15.112:0/2222136002 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdffc06eef0 msgr2=0x7fdffc142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:09.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.114+0000 7fdffa000640 1 --2- 172.21.15.112:0/2222136002 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdffc06eef0 0x7fdffc142380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.114+0000 7fdffa000640 1 -- 172.21.15.112:0/2222136002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdffc15b9d0 msgr2=0x7fdffc1533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:09.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.114+0000 7fdffa000640 1 --2- 172.21.15.112:0/2222136002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdffc15b9d0 0x7fdffc1533f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.114+0000 7fdffa000640 1 -- 172.21.15.112:0/2222136002 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdffc1580a0 con 0x7fdffc0b45d0 2024-09-12T02:48:09.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.114+0000 7fdffa000640 1 --2- 172.21.15.112:0/2222136002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdffc0b45d0 0x7fdffc157770 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800e900 tx=0x7fdfe800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:09.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.114+0000 7fdff2a00640 1 -- 172.21.15.112:0/2222136002 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8017070 con 0x7fdffc0b45d0 2024-09-12T02:48:09.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.114+0000 7fdff2a00640 1 -- 172.21.15.112:0/2222136002 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfe800ca00 con 0x7fdffc0b45d0 2024-09-12T02:48:09.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.114+0000 7fdff2a00640 1 -- 172.21.15.112:0/2222136002 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe800cdb0 con 0x7fdffc0b45d0 2024-09-12T02:48:09.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.114+0000 7fe001600640 1 -- 172.21.15.112:0/2222136002 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdffc158380 con 0x7fdffc0b45d0 2024-09-12T02:48:09.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.114+0000 7fe001600640 1 -- 172.21.15.112:0/2222136002 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdffc150d20 con 0x7fdffc0b45d0 2024-09-12T02:48:09.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.116+0000 7fdff2a00640 1 -- 172.21.15.112:0/2222136002 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdfe801a070 con 0x7fdffc0b45d0 2024-09-12T02:48:09.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.117+0000 7fdff2a00640 1 --2- 172.21.15.112:0/2222136002 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdfdc06be30 0x7fdfdc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:09.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.117+0000 7fdff2a00640 1 -- 172.21.15.112:0/2222136002 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7fdfe808b1f0 con 0x7fdffc0b45d0 2024-09-12T02:48:09.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.117+0000 7fdffaa00640 1 --2- 172.21.15.112:0/2222136002 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdfdc06be30 0x7fdfdc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:09.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.118+0000 7fe004607740 1 Processor -- start 2024-09-12T02:48:09.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.118+0000 7fdffaa00640 1 --2- 172.21.15.112:0/2222136002 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdfdc06be30 0x7fdfdc06e2f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009a20 tx=0x7fdfec009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:09.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.118+0000 7fe004607740 1 -- start start 2024-09-12T02:48:09.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.119+0000 7fe004607740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x557e8d866cf0 0x557e8d8ac490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:09.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.119+0000 7fe004607740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e8d8644b0 0x557e8d8670d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:09.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.119+0000 7fe004607740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e8d868480 0x557e8d861570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:09.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.119+0000 7fe004607740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557e8d7c53b0 con 0x557e8d8644b0 2024-09-12T02:48:09.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.119+0000 7fe004607740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557e8d7ca410 con 0x557e8d868480 2024-09-12T02:48:09.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.119+0000 7fe004607740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x557e8d772620 con 0x557e8d866cf0 2024-09-12T02:48:09.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.119+0000 7fdffa000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e8d8644b0 0x557e8d8670d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:09.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.119+0000 7fdffa000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e8d8644b0 0x557e8d8670d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34472/0 (socket says 172.21.15.112:34472) 2024-09-12T02:48:09.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.119+0000 7fdffa000640 1 -- 172.21.15.112:0/1812618217 learned_addr learned my addr 172.21.15.112:0/1812618217 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:09.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.119+0000 7fdffaa00640 1 --2- 172.21.15.112:0/1812618217 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x557e8d866cf0 0x557e8d8ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:09.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.119+0000 7fdffb400640 1 --2- 172.21.15.112:0/1812618217 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e8d868480 0x557e8d861570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:09.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.120+0000 7fdffa000640 1 -- 172.21.15.112:0/1812618217 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x557e8d866cf0 msgr2=0x557e8d8ac490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:09.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.120+0000 7fdffa000640 1 --2- 172.21.15.112:0/1812618217 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x557e8d866cf0 0x557e8d8ac490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.120+0000 7fdffa000640 1 -- 172.21.15.112:0/1812618217 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e8d868480 msgr2=0x557e8d861570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:09.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.120+0000 7fdffa000640 1 --2- 172.21.15.112:0/1812618217 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e8d868480 0x557e8d861570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.120+0000 7fdffa000640 1 -- 172.21.15.112:0/1812618217 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e8d4dd2d0 con 0x557e8d8644b0 2024-09-12T02:48:09.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.120+0000 7fdffa000640 1 --2- 172.21.15.112:0/1812618217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e8d8644b0 0x557e8d8670d0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8089680 tx=0x7fdfe8058f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1079855cf2971c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:09.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.120+0000 7fdfe7000640 1 -- 172.21.15.112:0/1812618217 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8021040 con 0x557e8d8644b0 2024-09-12T02:48:09.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.120+0000 7fdfe7000640 1 -- 172.21.15.112:0/1812618217 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfe8057840 con 0x557e8d8644b0 2024-09-12T02:48:09.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.120+0000 7fdfe7000640 1 -- 172.21.15.112:0/1812618217 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe80711c0 con 0x557e8d8644b0 2024-09-12T02:48:09.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.121+0000 7fe004607740 1 -- 172.21.15.112:0/1812618217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e8d8644b0 msgr2=0x557e8d8670d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:09.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.121+0000 7fe004607740 1 --2- 172.21.15.112:0/1812618217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e8d8644b0 0x557e8d8670d0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8089680 tx=0x7fdfe8058f60 comp rx=0 tx=0).stop 2024-09-12T02:48:09.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.121+0000 7fe004607740 1 -- 172.21.15.112:0/1812618217 shutdown_connections 2024-09-12T02:48:09.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.121+0000 7fe004607740 1 --2- 172.21.15.112:0/1812618217 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e8d868480 0x557e8d861570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.121+0000 7fe004607740 1 --2- 172.21.15.112:0/1812618217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e8d8644b0 0x557e8d8670d0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.121+0000 7fe004607740 1 --2- 172.21.15.112:0/1812618217 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x557e8d866cf0 0x557e8d8ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.121+0000 7fe004607740 1 -- 172.21.15.112:0/1812618217 >> 172.21.15.112:0/1812618217 conn(0x557e8d863740 msgr2=0x557e8d8ab960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:09.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.121+0000 7fe004607740 1 -- 172.21.15.112:0/1812618217 shutdown_connections 2024-09-12T02:48:09.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.121+0000 7fe004607740 1 -- 172.21.15.112:0/1812618217 wait complete. 2024-09-12T02:48:09.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.121+0000 7fe004607740 1 -- start start 2024-09-12T02:48:09.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.122+0000 7fe004607740 1 Processor -- start 2024-09-12T02:48:09.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.123+0000 7fe004607740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e8d866cf0 0x557e8d891330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:09.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.123+0000 7fe004607740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e8d868480 0x557e8d8bf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:09.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.123+0000 7fe004607740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x557e8d8bfd40 0x557e8d88a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:09.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.123+0000 7fe004607740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557e8d785780 con 0x557e8d868480 2024-09-12T02:48:09.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.123+0000 7fe004607740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557e8d7c63d0 con 0x557e8d866cf0 2024-09-12T02:48:09.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.123+0000 7fe004607740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x557e8d862be0 con 0x557e8d8bfd40 2024-09-12T02:48:09.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.123+0000 7fe004607740 10 client.0 _ll_register_callbacks cb 0x557e8d7c35d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:09.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.123+0000 7fdffa000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e8d868480 0x557e8d8bf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:09.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.123+0000 7fdffa000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e8d868480 0x557e8d8bf800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34478/0 (socket says 172.21.15.112:34478) 2024-09-12T02:48:09.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.123+0000 7fdffa000640 1 -- 172.21.15.112:0/3448978337 learned_addr learned my addr 172.21.15.112:0/3448978337 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:09.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.123+0000 7fdffaa00640 1 --2- 172.21.15.112:0/3448978337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e8d866cf0 0x557e8d891330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:09.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.123+0000 7fdffb400640 1 --2- 172.21.15.112:0/3448978337 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x557e8d8bfd40 0x557e8d88a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:09.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.123+0000 7fdffa000640 1 -- 172.21.15.112:0/3448978337 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x557e8d8bfd40 msgr2=0x557e8d88a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:09.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.123+0000 7fdffa000640 1 --2- 172.21.15.112:0/3448978337 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x557e8d8bfd40 0x557e8d88a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.123+0000 7fdffa000640 1 -- 172.21.15.112:0/3448978337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e8d866cf0 msgr2=0x557e8d891330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:09.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.123+0000 7fdffa000640 1 --2- 172.21.15.112:0/3448978337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e8d866cf0 0x557e8d891330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.123+0000 7fdffa000640 1 -- 172.21.15.112:0/3448978337 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e8d5a76b0 con 0x557e8d868480 2024-09-12T02:48:09.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.123+0000 7fdffb400640 1 --2- 172.21.15.112:0/3448978337 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x557e8d8bfd40 0x557e8d88a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:09.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.124+0000 7fdffa000640 1 --2- 172.21.15.112:0/3448978337 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e8d868480 0x557e8d8bf800 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800e8d0 tx=0x7fdfe800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7993600b8ec16ac6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:09.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.124+0000 7fdfdb400640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-12T02:48:09.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.124+0000 7fdfdb400640 1 -- 172.21.15.112:0/3448978337 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8021040 con 0x557e8d868480 2024-09-12T02:48:09.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.124+0000 7fdfdb400640 1 -- 172.21.15.112:0/3448978337 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7fdfe8078300 con 0x557e8d868480 2024-09-12T02:48:09.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.124+0000 7fe004607740 1 -- 172.21.15.112:0/3448978337 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfe8057840 con 0x557e8d868480 2024-09-12T02:48:09.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.124+0000 7fdfdb400640 1 -- 172.21.15.112:0/3448978337 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7fdfe807e050 con 0x557e8d868480 2024-09-12T02:48:09.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.124+0000 7fe004607740 10 client.7008 fetch_fsmap learned FSMap version 70 2024-09-12T02:48:09.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.124+0000 7fe004607740 1 -- 172.21.15.112:0/3448978337 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) -- 0x557e8d88fb30 con 0x557e8d868480 2024-09-12T02:48:09.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.124+0000 7fdfdb400640 1 -- 172.21.15.112:0/3448978337 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfe8057840 con 0x557e8d868480 2024-09-12T02:48:09.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.124+0000 7fdfdb400640 1 -- 172.21.15.112:0/3448978337 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 70) ==== 3502+0+0 (secure 0 0 0) 0x7fdfe8081020 con 0x557e8d868480 2024-09-12T02:48:09.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.124+0000 7fe004607740 10 client.7008 fetch_fsmap finished waiting for FSMap version 70 2024-09-12T02:48:09.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.124+0000 7fe004607740 10 client.7008 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:48:09.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.124+0000 7fe004607740 20 client.7008 populate_metadata read hostname 'smithi112' 2024-09-12T02:48:09.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.124+0000 7fe004607740 1 --2- 172.21.15.112:0/3448978337 >> [v2:172.21.15.112:6836/134918269,v1:172.21.15.112:6837/134918269] conn(0x557e8d879e60 0x557e8d87a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:09.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.124+0000 7fe004607740 4 client.7008 mds_command: new command op to 6861 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:48:09.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.124+0000 7fe004607740 1 -- 172.21.15.112:0/3448978337 --> [v2:172.21.15.112:6836/134918269,v1:172.21.15.112:6837/134918269] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e8d7d7b40 con 0x557e8d879e60 2024-09-12T02:48:09.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.125+0000 7fdffaa00640 1 --2- 172.21.15.112:0/3448978337 >> [v2:172.21.15.112:6836/134918269,v1:172.21.15.112:6837/134918269] conn(0x557e8d879e60 0x557e8d87a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:09.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.125+0000 7fdffaa00640 1 --2- 172.21.15.112:0/3448978337 >> [v2:172.21.15.112:6836/134918269,v1:172.21.15.112:6837/134918269] conn(0x557e8d879e60 0x557e8d87a240 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5af909d7bc0ad83 server_cookie=73708ff078336bad in_seq=0 out_seq=0 2024-09-12T02:48:09.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.125+0000 7fdfdb400640 10 client.7008 ms_handle_connect on v2:172.21.15.112:6836/134918269 2024-09-12T02:48:09.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.126+0000 7fdfdb400640 1 -- 172.21.15.112:0/3448978337 <== mds.0 v2:172.21.15.112:6836/134918269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557e8d7d7b40 con 0x557e8d879e60 2024-09-12T02:48:09.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.126+0000 7fdfdb400640 10 client.7008 handle_command_reply: tid=0 2024-09-12T02:48:09.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.126+0000 7fe004607740 1 client.7008 shutdown 2024-09-12T02:48:09.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.126+0000 7fe004607740 1 -- 172.21.15.112:0/3448978337 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e8d868480 msgr2=0x557e8d8bf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:09.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.126+0000 7fe004607740 1 --2- 172.21.15.112:0/3448978337 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e8d868480 0x557e8d8bf800 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800e8d0 tx=0x7fdfe800cf50 comp rx=0 tx=0).stop 2024-09-12T02:48:09.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.126+0000 7fe004607740 1 -- 172.21.15.112:0/3448978337 shutdown_connections 2024-09-12T02:48:09.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.126+0000 7fe004607740 1 --2- 172.21.15.112:0/3448978337 >> [v2:172.21.15.112:6836/134918269,v1:172.21.15.112:6837/134918269] conn(0x557e8d879e60 0x557e8d87a240 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.126+0000 7fe004607740 1 --2- 172.21.15.112:0/3448978337 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x557e8d8bfd40 0x557e8d88a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.126+0000 7fe004607740 1 --2- 172.21.15.112:0/3448978337 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e8d868480 0x557e8d8bf800 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.126+0000 7fe004607740 1 --2- 172.21.15.112:0/3448978337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e8d866cf0 0x557e8d891330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.126+0000 7fdfdb400640 0 client.7008 ms_handle_reset on v2:172.21.15.112:6836/134918269 2024-09-12T02:48:09.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.126+0000 7fe004607740 1 -- 172.21.15.112:0/3448978337 >> 172.21.15.112:0/3448978337 conn(0x557e8d8644b0 msgr2=0x557e8d8aaf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:09.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.126+0000 7fe004607740 1 -- 172.21.15.112:0/3448978337 shutdown_connections 2024-09-12T02:48:09.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.126+0000 7fe004607740 1 -- 172.21.15.112:0/3448978337 wait complete. 2024-09-12T02:48:09.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.127+0000 7fe004607740 20 client.7008 trim_cache size 0 max 16384 2024-09-12T02:48:09.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.145+0000 7fe004607740 1 Processor -- start 2024-09-12T02:48:09.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.145+0000 7fe004607740 1 -- start start 2024-09-12T02:48:09.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.146+0000 7fe004607740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x557e8d866cf0 0x557e8d891b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:09.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.146+0000 7fe004607740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e8d868480 0x557e8d892040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:09.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.146+0000 7fe004607740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e8d8bfd40 0x557e8d87c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:09.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.146+0000 7fe004607740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdffc1fbd50 con 0x557e8d8bfd40 2024-09-12T02:48:09.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.146+0000 7fe004607740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdffc1fb1b0 con 0x557e8d868480 2024-09-12T02:48:09.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.146+0000 7fe004607740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdffc1fb700 con 0x557e8d866cf0 2024-09-12T02:48:09.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.147+0000 7fdffb400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e8d8bfd40 0x557e8d87c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:09.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.147+0000 7fdffb400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e8d8bfd40 0x557e8d87c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34494/0 (socket says 172.21.15.112:34494) 2024-09-12T02:48:09.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.147+0000 7fdffb400640 1 -- 172.21.15.112:0/560313594 learned_addr learned my addr 172.21.15.112:0/560313594 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:09.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.147+0000 7fdffa000640 1 --2- 172.21.15.112:0/560313594 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e8d868480 0x557e8d892040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:09.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.147+0000 7fdffaa00640 1 --2- 172.21.15.112:0/560313594 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x557e8d866cf0 0x557e8d891b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:09.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.147+0000 7fdffb400640 1 -- 172.21.15.112:0/560313594 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x557e8d866cf0 msgr2=0x557e8d891b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:09.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.147+0000 7fdffb400640 1 --2- 172.21.15.112:0/560313594 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x557e8d866cf0 0x557e8d891b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.147+0000 7fdffb400640 1 -- 172.21.15.112:0/560313594 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e8d868480 msgr2=0x557e8d892040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:09.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.147+0000 7fdffb400640 1 --2- 172.21.15.112:0/560313594 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e8d868480 0x557e8d892040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.147+0000 7fdffb400640 1 -- 172.21.15.112:0/560313594 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e8d862a40 con 0x557e8d8bfd40 2024-09-12T02:48:09.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.147+0000 7fdffb400640 1 --2- 172.21.15.112:0/560313594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e8d8bfd40 0x557e8d87c250 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fdff4009f40 tx=0x7fdff402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bffa9c9ebcad75b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:09.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.148+0000 7fdfe6600640 1 -- 172.21.15.112:0/560313594 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff4036040 con 0x557e8d8bfd40 2024-09-12T02:48:09.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.148+0000 7fdfe6600640 1 -- 172.21.15.112:0/560313594 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdff4037040 con 0x557e8d8bfd40 2024-09-12T02:48:09.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.148+0000 7fdfe6600640 1 -- 172.21.15.112:0/560313594 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff4048880 con 0x557e8d8bfd40 2024-09-12T02:48:09.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.148+0000 7fe004607740 1 -- 172.21.15.112:0/560313594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e8d8bfd40 msgr2=0x557e8d87c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:09.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.148+0000 7fe004607740 1 --2- 172.21.15.112:0/560313594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e8d8bfd40 0x557e8d87c250 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fdff4009f40 tx=0x7fdff402e000 comp rx=0 tx=0).stop 2024-09-12T02:48:09.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.148+0000 7fe004607740 1 -- 172.21.15.112:0/560313594 shutdown_connections 2024-09-12T02:48:09.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.148+0000 7fe004607740 1 --2- 172.21.15.112:0/560313594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e8d8bfd40 0x557e8d87c250 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.148+0000 7fe004607740 1 --2- 172.21.15.112:0/560313594 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e8d868480 0x557e8d892040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.148+0000 7fe004607740 1 --2- 172.21.15.112:0/560313594 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x557e8d866cf0 0x557e8d891b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.148+0000 7fe004607740 1 -- 172.21.15.112:0/560313594 >> 172.21.15.112:0/560313594 conn(0x557e8d8644b0 msgr2=0x557e8d891050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:09.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.148+0000 7fe004607740 1 -- 172.21.15.112:0/560313594 shutdown_connections 2024-09-12T02:48:09.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.148+0000 7fe004607740 1 -- 172.21.15.112:0/560313594 wait complete. 2024-09-12T02:48:09.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.149+0000 7fe004607740 1 -- start start 2024-09-12T02:48:09.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.149+0000 7fe004607740 1 Processor -- start 2024-09-12T02:48:09.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.150+0000 7fe004607740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e8d866cf0 0x557e8d891a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:09.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.150+0000 7fe004607740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x557e8d868480 0x557e8d8c2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:09.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.150+0000 7fe004607740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e8d8bfd40 0x557e8d929a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:09.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.150+0000 7fe004607740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557e8d785780 con 0x557e8d866cf0 2024-09-12T02:48:09.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.150+0000 7fe004607740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557e8d7c63d0 con 0x557e8d8bfd40 2024-09-12T02:48:09.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.150+0000 7fe004607740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x557e8d88af10 con 0x557e8d868480 2024-09-12T02:48:09.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.150+0000 7fe004607740 10 client.0 _ll_register_callbacks cb 0x7fdfe8059080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:09.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.150+0000 7fdffaa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e8d866cf0 0x557e8d891a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:09.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.150+0000 7fdffaa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e8d866cf0 0x557e8d891a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34504/0 (socket says 172.21.15.112:34504) 2024-09-12T02:48:09.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.150+0000 7fdffaa00640 1 -- 172.21.15.112:0/1984659598 learned_addr learned my addr 172.21.15.112:0/1984659598 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:09.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.150+0000 7fdffa000640 1 --2- 172.21.15.112:0/1984659598 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x557e8d868480 0x557e8d8c2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:09.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.150+0000 7fdffb400640 1 --2- 172.21.15.112:0/1984659598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e8d8bfd40 0x557e8d929a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:09.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.151+0000 7fdffaa00640 1 -- 172.21.15.112:0/1984659598 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x557e8d868480 msgr2=0x557e8d8c2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:09.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.151+0000 7fdffaa00640 1 --2- 172.21.15.112:0/1984659598 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x557e8d868480 0x557e8d8c2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.151+0000 7fdffaa00640 1 -- 172.21.15.112:0/1984659598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e8d8bfd40 msgr2=0x557e8d929a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:09.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.151+0000 7fdffaa00640 1 --2- 172.21.15.112:0/1984659598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e8d8bfd40 0x557e8d929a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.151+0000 7fdffaa00640 1 -- 172.21.15.112:0/1984659598 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e8d88dbb0 con 0x557e8d866cf0 2024-09-12T02:48:09.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.151+0000 7fdffb400640 1 --2- 172.21.15.112:0/1984659598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e8d8bfd40 0x557e8d929a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:09.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.151+0000 7fdffaa00640 1 --2- 172.21.15.112:0/1984659598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e8d866cf0 0x557e8d891a00 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x557e8d862900 tx=0x7fdfec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16569de947d87a90 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:09.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.151+0000 7fdfdb400640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-12T02:48:09.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.151+0000 7fdfdb400640 1 -- 172.21.15.112:0/1984659598 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfec031060 con 0x557e8d866cf0 2024-09-12T02:48:09.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.151+0000 7fdfdb400640 1 -- 172.21.15.112:0/1984659598 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7fdfec00f040 con 0x557e8d866cf0 2024-09-12T02:48:09.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.151+0000 7fe004607740 1 -- 172.21.15.112:0/1984659598 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdff4037040 con 0x557e8d866cf0 2024-09-12T02:48:09.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.151+0000 7fdfdb400640 1 -- 172.21.15.112:0/1984659598 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7fdfec037050 con 0x557e8d866cf0 2024-09-12T02:48:09.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.151+0000 7fe004607740 10 client.7014 fetch_fsmap learned FSMap version 70 2024-09-12T02:48:09.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.151+0000 7fe004607740 1 -- 172.21.15.112:0/1984659598 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) -- 0x557e8d8c3e50 con 0x557e8d866cf0 2024-09-12T02:48:09.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.152+0000 7fdfdb400640 1 -- 172.21.15.112:0/1984659598 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdff4037040 con 0x557e8d866cf0 2024-09-12T02:48:09.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.152+0000 7fdfdb400640 1 -- 172.21.15.112:0/1984659598 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 70) ==== 3502+0+0 (secure 0 0 0) 0x7fdfec03a020 con 0x557e8d866cf0 2024-09-12T02:48:09.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.152+0000 7fe004607740 10 client.7014 fetch_fsmap finished waiting for FSMap version 70 2024-09-12T02:48:09.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.152+0000 7fe004607740 10 client.7014 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:48:09.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.152+0000 7fe004607740 20 client.7014 populate_metadata read hostname 'smithi112' 2024-09-12T02:48:09.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.152+0000 7fe004607740 1 --2- 172.21.15.112:0/1984659598 >> [v2:172.21.15.112:6836/134918269,v1:172.21.15.112:6837/134918269] conn(0x557e8d929f70 0x557e8d877a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:09.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.152+0000 7fe004607740 4 client.7014 mds_command: new command op to 6861 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:48:09.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.152+0000 7fe004607740 1 -- 172.21.15.112:0/1984659598 --> [v2:172.21.15.112:6836/134918269,v1:172.21.15.112:6837/134918269] -- command(tid 0: {"prefix": "status"}) -- 0x557e8d87d5b0 con 0x557e8d929f70 2024-09-12T02:48:09.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.152+0000 7fdffa000640 1 --2- 172.21.15.112:0/1984659598 >> [v2:172.21.15.112:6836/134918269,v1:172.21.15.112:6837/134918269] conn(0x557e8d929f70 0x557e8d877a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:09.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.153+0000 7fdffa000640 1 --2- 172.21.15.112:0/1984659598 >> [v2:172.21.15.112:6836/134918269,v1:172.21.15.112:6837/134918269] conn(0x557e8d929f70 0x557e8d877a20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1414b4df668afd5b server_cookie=19105bc19daf2771 in_seq=0 out_seq=0 2024-09-12T02:48:09.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.153+0000 7fdfdb400640 10 client.7014 ms_handle_connect on v2:172.21.15.112:6836/134918269 2024-09-12T02:48:09.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.153+0000 7fdfdb400640 1 -- 172.21.15.112:0/1984659598 <== mds.0 v2:172.21.15.112:6836/134918269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x557e8d87d5b0 con 0x557e8d929f70 2024-09-12T02:48:09.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.153+0000 7fdfdb400640 10 client.7014 handle_command_reply: tid=0 2024-09-12T02:48:09.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.153+0000 7fe004607740 1 client.7014 shutdown 2024-09-12T02:48:09.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.153+0000 7fe004607740 1 -- 172.21.15.112:0/1984659598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e8d866cf0 msgr2=0x557e8d891a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:09.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.153+0000 7fe004607740 1 --2- 172.21.15.112:0/1984659598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e8d866cf0 0x557e8d891a00 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x557e8d862900 tx=0x7fdfec004730 comp rx=0 tx=0).stop 2024-09-12T02:48:09.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.153+0000 7fe004607740 1 -- 172.21.15.112:0/1984659598 shutdown_connections 2024-09-12T02:48:09.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.153+0000 7fe004607740 1 --2- 172.21.15.112:0/1984659598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e8d8bfd40 0x557e8d929a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.153+0000 7fe004607740 1 --2- 172.21.15.112:0/1984659598 >> [v2:172.21.15.112:6836/134918269,v1:172.21.15.112:6837/134918269] conn(0x557e8d929f70 0x557e8d877a20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.153+0000 7fe004607740 1 --2- 172.21.15.112:0/1984659598 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x557e8d868480 0x557e8d8c2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.153+0000 7fe004607740 1 --2- 172.21.15.112:0/1984659598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e8d866cf0 0x557e8d891a00 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.153+0000 7fdfdb400640 0 client.7014 ms_handle_reset on v2:172.21.15.112:6836/134918269 2024-09-12T02:48:09.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.153+0000 7fe004607740 1 -- 172.21.15.112:0/1984659598 >> 172.21.15.112:0/1984659598 conn(0x557e8d8644b0 msgr2=0x557e8d8abe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:09.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.153+0000 7fe004607740 1 -- 172.21.15.112:0/1984659598 shutdown_connections 2024-09-12T02:48:09.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.153+0000 7fe004607740 1 -- 172.21.15.112:0/1984659598 wait complete. 2024-09-12T02:48:09.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.153+0000 7fe004607740 20 client.7014 trim_cache size 0 max 16384 2024-09-12T02:48:09.158 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:48:09.159 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:48:09.159 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2024-09-12T02:48:09.159 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 6861, 2024-09-12T02:48:09.159 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2024-09-12T02:48:09.159 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2024-09-12T02:48:09.159 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2024-09-12T02:48:09.159 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 10.694969457999999, 2024-09-12T02:48:09.159 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 70, 2024-09-12T02:48:09.159 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 135, 2024-09-12T02:48:09.159 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 135, 2024-09-12T02:48:09.159 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 15.770587817999999 2024-09-12T02:48:09.159 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:48:09.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.154+0000 7fe001600640 1 -- 172.21.15.112:0/2222136002 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdfdc06be30 msgr2=0x7fdfdc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:09.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.154+0000 7fe001600640 1 --2- 172.21.15.112:0/2222136002 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdfdc06be30 0x7fdfdc06e2f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009a20 tx=0x7fdfec009190 comp rx=0 tx=0).stop 2024-09-12T02:48:09.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.154+0000 7fe001600640 1 -- 172.21.15.112:0/2222136002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdffc0b45d0 msgr2=0x7fdffc157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:09.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.154+0000 7fe001600640 1 --2- 172.21.15.112:0/2222136002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdffc0b45d0 0x7fdffc157770 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800e900 tx=0x7fdfe800edc0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.154+0000 7fe001600640 1 -- 172.21.15.112:0/2222136002 shutdown_connections 2024-09-12T02:48:09.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.154+0000 7fe001600640 1 --2- 172.21.15.112:0/2222136002 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdfdc06be30 0x7fdfdc06e2f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.154+0000 7fe001600640 1 --2- 172.21.15.112:0/2222136002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdffc15b9d0 0x7fdffc1533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.154+0000 7fe001600640 1 --2- 172.21.15.112:0/2222136002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdffc0b45d0 0x7fdffc157770 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.154+0000 7fe001600640 1 --2- 172.21.15.112:0/2222136002 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdffc06eef0 0x7fdffc142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.154+0000 7fe001600640 1 -- 172.21.15.112:0/2222136002 >> 172.21.15.112:0/2222136002 conn(0x7fdffc06bbd0 msgr2=0x7fdffc0cedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:09.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.154+0000 7fe001600640 1 -- 172.21.15.112:0/2222136002 shutdown_connections 2024-09-12T02:48:09.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.154+0000 7fe001600640 1 -- 172.21.15.112:0/2222136002 wait complete. 2024-09-12T02:48:09.170 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:48:09.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.323+0000 7f457d800640 1 Processor -- start 2024-09-12T02:48:09.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.323+0000 7f457d800640 1 -- start start 2024-09-12T02:48:09.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.323+0000 7f457d800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f45780d1630 0x7f45780d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:09.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.323+0000 7f457d800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45780d5840 0x7f45780d28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:09.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.323+0000 7f457d800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45780b5c30 con 0x7f4578161f70 2024-09-12T02:48:09.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.323+0000 7f457d800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f45780b61f0 con 0x7f45780d1630 2024-09-12T02:48:09.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.323+0000 7f457d800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f45780b5f10 con 0x7f45780d5840 2024-09-12T02:48:09.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.323+0000 7f457ce00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f4578161f70 0x7f45780cf790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:41020/0 (socket says 172.21.15.112:41020) 2024-09-12T02:48:09.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.323+0000 7f457ce00640 1 -- 172.21.15.112:0/2717891841 learned_addr learned my addr 172.21.15.112:0/2717891841 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:09.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.324+0000 7f4577e00640 1 --2- 172.21.15.112:0/2717891841 >> v2:172.21.15.137:3300/0 conn(0x7f45780d1630 0x7f45780d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:09.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.324+0000 7f456f400640 1 --2- 172.21.15.112:0/2717891841 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45780d5840 0x7f45780d28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:09.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.324+0000 7f4577400640 1 -- 172.21.15.112:0/2717891841 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1009299781 0 0) 0x7f45780b5c30 con 0x7f4578161f70 2024-09-12T02:48:09.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.324+0000 7f4577400640 1 -- 172.21.15.112:0/2717891841 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f455c003520 con 0x7f4578161f70 2024-09-12T02:48:09.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.324+0000 7f456f400640 1 -- 172.21.15.112:0/2717891841 >> v2:172.21.15.137:3300/0 conn(0x7f45780d1630 msgr2=0x7f45780d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:09.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.324+0000 7f456f400640 1 --2- 172.21.15.112:0/2717891841 >> v2:172.21.15.137:3300/0 conn(0x7f45780d1630 0x7f45780d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.324+0000 7f456f400640 1 -- 172.21.15.112:0/2717891841 >> v1:172.21.15.112:6789/0 conn(0x7f4578161f70 legacy=0x7f45780cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:09.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.324+0000 7f4577400640 1 -- 172.21.15.112:0/2717891841 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1991249175 0 0) 0x7f455c003520 con 0x7f4578161f70 2024-09-12T02:48:09.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.324+0000 7f456f400640 1 -- 172.21.15.112:0/2717891841 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45780d2090 con 0x7f45780d5840 2024-09-12T02:48:09.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.325+0000 7f456f400640 1 --2- 172.21.15.112:0/2717891841 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45780d5840 0x7f45780d28f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f45600097a0 tx=0x7f456002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a79bc11ea6db276e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:09.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.326+0000 7f4577400640 1 -- 172.21.15.112:0/2717891841 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4560037070 con 0x7f45780d5840 2024-09-12T02:48:09.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.326+0000 7f4577400640 1 -- 172.21.15.112:0/2717891841 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4560032440 con 0x7f45780d5840 2024-09-12T02:48:09.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.326+0000 7f4577400640 1 -- 172.21.15.112:0/2717891841 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4560032810 con 0x7f45780d5840 2024-09-12T02:48:09.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.326+0000 7f457d800640 1 -- 172.21.15.112:0/2717891841 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45780d5840 msgr2=0x7f45780d28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:09.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.326+0000 7f457d800640 1 --2- 172.21.15.112:0/2717891841 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45780d5840 0x7f45780d28f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f45600097a0 tx=0x7f456002a180 comp rx=0 tx=0).stop 2024-09-12T02:48:09.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.326+0000 7f457d800640 1 -- 172.21.15.112:0/2717891841 shutdown_connections 2024-09-12T02:48:09.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.326+0000 7f457d800640 1 --2- 172.21.15.112:0/2717891841 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f45780d5840 0x7f45780d28f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.326+0000 7f457d800640 1 --2- 172.21.15.112:0/2717891841 >> v2:172.21.15.137:3300/0 conn(0x7f45780d1630 0x7f45780d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.326+0000 7f457d800640 1 -- 172.21.15.112:0/2717891841 >> 172.21.15.112:0/2717891841 conn(0x7f45780d4d20 msgr2=0x7f45780d5130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:09.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.326+0000 7f457d800640 1 -- 172.21.15.112:0/2717891841 shutdown_connections 2024-09-12T02:48:09.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.326+0000 7f457d800640 1 -- 172.21.15.112:0/2717891841 wait complete. 2024-09-12T02:48:09.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.328+0000 7f457d800640 1 Processor -- start 2024-09-12T02:48:09.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.328+0000 7f457d800640 1 -- start start 2024-09-12T02:48:09.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.329+0000 7f457d800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45780d1630 0x7f45780b8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:09.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.329+0000 7f457d800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45780d5840 0x7f45781532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:09.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.329+0000 7f457d800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4578161f70 0x7f45781f7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:09.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.329+0000 7f457d800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f45780d25b0 con 0x7f45780d5840 2024-09-12T02:48:09.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.329+0000 7f457d800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f45780b8b80 con 0x7f45780d1630 2024-09-12T02:48:09.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.329+0000 7f457d800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f45781623e0 con 0x7f4578161f70 2024-09-12T02:48:09.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.329+0000 7f456f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45780d5840 0x7f45781532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:09.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.329+0000 7f456f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45780d5840 0x7f45781532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34512/0 (socket says 172.21.15.112:34512) 2024-09-12T02:48:09.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.329+0000 7f456f400640 1 -- 172.21.15.112:0/3648244810 learned_addr learned my addr 172.21.15.112:0/3648244810 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:09.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.329+0000 7f456f400640 1 -- 172.21.15.112:0/3648244810 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4578161f70 msgr2=0x7f45781f7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:09.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.329+0000 7f456f400640 1 --2- 172.21.15.112:0/3648244810 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4578161f70 0x7f45781f7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.329+0000 7f456f400640 1 -- 172.21.15.112:0/3648244810 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45780d1630 msgr2=0x7f45780b8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:09.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.329+0000 7f456f400640 1 --2- 172.21.15.112:0/3648244810 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45780d1630 0x7f45780b8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.329+0000 7f456f400640 1 -- 172.21.15.112:0/3648244810 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45781537e0 con 0x7f45780d5840 2024-09-12T02:48:09.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.330+0000 7f456f400640 1 --2- 172.21.15.112:0/3648244810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45780d5840 0x7f45781532a0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f4560035040 tx=0x7f45600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:09.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.330+0000 7f4574c00640 1 -- 172.21.15.112:0/3648244810 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4560041030 con 0x7f45780d5840 2024-09-12T02:48:09.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.330+0000 7f4574c00640 1 -- 172.21.15.112:0/3648244810 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f456003d4e0 con 0x7f45780d5840 2024-09-12T02:48:09.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.330+0000 7f457d800640 1 -- 172.21.15.112:0/3648244810 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45780ccee0 con 0x7f45780d5840 2024-09-12T02:48:09.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.330+0000 7f4574c00640 1 -- 172.21.15.112:0/3648244810 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4560037040 con 0x7f45780d5840 2024-09-12T02:48:09.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.330+0000 7f457d800640 1 -- 172.21.15.112:0/3648244810 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45780cd180 con 0x7f45780d5840 2024-09-12T02:48:09.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.331+0000 7f457d800640 1 -- 172.21.15.112:0/3648244810 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45781627c0 con 0x7f45780d5840 2024-09-12T02:48:09.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.332+0000 7f4574c00640 1 -- 172.21.15.112:0/3648244810 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4560044070 con 0x7f45780d5840 2024-09-12T02:48:09.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.333+0000 7f4574c00640 1 --2- 172.21.15.112:0/3648244810 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f455406be30 0x7f455406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:09.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.333+0000 7f4574c00640 1 -- 172.21.15.112:0/3648244810 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f45600ab570 con 0x7f45780d5840 2024-09-12T02:48:09.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.333+0000 7f4577e00640 1 --2- 172.21.15.112:0/3648244810 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f455406be30 0x7f455406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:09.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.334+0000 7f4577e00640 1 --2- 172.21.15.112:0/3648244810 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f455406be30 0x7f455406e2f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4568006a90 tx=0x7f4568006a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:09.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.338+0000 7f4574c00640 1 -- 172.21.15.112:0/3648244810 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f45781537e0 con 0x7f45780d5840 2024-09-12T02:48:09.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.549+0000 7f457d800640 1 -- 172.21.15.112:0/3648244810 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f45780d3dc0 con 0x7f45780d5840 2024-09-12T02:48:09.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.549+0000 7f4574c00640 1 -- 172.21.15.112:0/3648244810 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v70) ==== 53+0+73 (secure 0 0 0) 0x7f4560079e90 con 0x7f45780d5840 2024-09-12T02:48:09.550 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:48:09.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.551+0000 7f457d800640 1 -- 172.21.15.112:0/3648244810 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f455406be30 msgr2=0x7f455406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:09.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.551+0000 7f457d800640 1 --2- 172.21.15.112:0/3648244810 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f455406be30 0x7f455406e2f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4568006a90 tx=0x7f4568006a20 comp rx=0 tx=0).stop 2024-09-12T02:48:09.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.551+0000 7f457d800640 1 -- 172.21.15.112:0/3648244810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45780d5840 msgr2=0x7f45781532a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:09.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.551+0000 7f457d800640 1 --2- 172.21.15.112:0/3648244810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45780d5840 0x7f45781532a0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f4560035040 tx=0x7f45600046c0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.551+0000 7f457d800640 1 -- 172.21.15.112:0/3648244810 shutdown_connections 2024-09-12T02:48:09.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.551+0000 7f457d800640 1 --2- 172.21.15.112:0/3648244810 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4578161f70 0x7f45781f7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.551+0000 7f457d800640 1 --2- 172.21.15.112:0/3648244810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45780d5840 0x7f45781532a0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.551+0000 7f457d800640 1 --2- 172.21.15.112:0/3648244810 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f455406be30 0x7f455406e2f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.551+0000 7f457d800640 1 --2- 172.21.15.112:0/3648244810 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45780d1630 0x7f45780b8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:09.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.551+0000 7f457d800640 1 -- 172.21.15.112:0/3648244810 >> 172.21.15.112:0/3648244810 conn(0x7f45780d4d20 msgr2=0x7f457806ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:09.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.551+0000 7f457d800640 1 -- 172.21.15.112:0/3648244810 shutdown_connections 2024-09-12T02:48:09.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09.551+0000 7f457d800640 1 -- 172.21.15.112:0/3648244810 wait complete. 2024-09-12T02:48:09.569 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:48:09.569 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:48:09.569 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-09-12T02:48:09.569 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:48:09.569 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:48:09.569 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:48:09.569 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:48:09.570 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:48:09.570 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:48:09.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:09.570 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-09-12T02:48:09.605 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:48:09.606 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:48:09.606 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:48:09.606 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:09.606 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-12T02:48:09.606 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:09.606 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:48:09.606 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-09-12T02:48:09.606 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-09-12T02:48:09.606 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:48:09.606 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-09-12T02:48:09.606 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-09-12T02:48:09.606 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:48:09.606 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:48:09.607 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:48:09.607 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:48:09.607 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:48:09.607 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42389sec preferred_lft 42389sec 2024-09-12T02:48:09.607 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link noprefixroute 2024-09-12T02:48:09.607 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:09.607 INFO:teuthology.orchestra.run.smithi112.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:48:09.607 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 4e:56:d4:fc:33:ba brd ff:ff:ff:ff:ff:ff 2024-09-12T02:48:09.607 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:48:09.607 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:09.607 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::787f:67ff:fe10:c915/64 scope link 2024-09-12T02:48:09.607 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:09.607 INFO:teuthology.orchestra.run.smithi112.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:48:09.607 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 4e:56:d4:fc:33:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:48:09.608 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::4c56:d4ff:fefc:33ba/64 scope link 2024-09-12T02:48:09.608 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:09.608 INFO:teuthology.orchestra.run.smithi112.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:48:09.608 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 86:ed:0e:b6:37:5f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:48:09.608 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::84ed:eff:feb6:375f/64 scope link 2024-09-12T02:48:09.608 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:09.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:09.608 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:48:09.698 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-12T02:48:09.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:09.701 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-09-12T02:48:09.737 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-09-12T02:48:09.737 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:48:09.737 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:48:09.737 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:48:09.737 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:48:09.737 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:48:09.738 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-12T02:48:09.738 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:48:09.738 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:48:09.738 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:48:09.738 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-12T02:48:09.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:48:09.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:48:09.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:09.933 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-12T02:48:09.968 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:48:09.968 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:48:09.968 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:48:09.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:09.968 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2024-09-12T02:48:10.065 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:48:10.065 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:48:10.100 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:48:10.100 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:48:10.101 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:48:10.175 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T02:48:10.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:10.175 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:48:10.303 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:48:10.303 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:48:10.330 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:48:10.330 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:48:10.330 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-09-12T02:48:10.330 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 0@7c01f3b3-dec2-4449-a33f-f960d7527ea6.cephfs=/ 2024-09-12T02:48:10.330 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.112:3300/172.21.15.137:3300/172.21.15.137:3301" will pass to kernel 2024-09-12T02:48:10.332 INFO:teuthology.orchestra.run.smithi112.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:48:10.332 INFO:teuthology.orchestra.run.smithi112.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:48:10.332 INFO:teuthology.orchestra.run.smithi112.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:48:10.333 INFO:teuthology.orchestra.run.smithi112.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:48:10.333 INFO:teuthology.orchestra.run.smithi112.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:48:10.335 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:48:10.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:10.336 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:48:10.391 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:48:10.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:48:10.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:48:10.486 INFO:teuthology.orchestra.run.smithi112.stdout:client6472 2024-09-12T02:48:10.487 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:48:10.487 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:48:10.523 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:48:10.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.714+0000 7ff48dc00640 1 Processor -- start 2024-09-12T02:48:10.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.714+0000 7ff48dc00640 1 -- start start 2024-09-12T02:48:10.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.715+0000 7ff48dc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff48815b9d0 0x7ff4880b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:10.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.715+0000 7ff48dc00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff4880b45d0 0x7ff4880728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:10.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.715+0000 7ff48dc00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff48806eef0 0x7ff48806f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:10.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.715+0000 7ff48dc00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff4880b4a30 con 0x7ff48806eef0 2024-09-12T02:48:10.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.715+0000 7ff48dc00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff48806f840 con 0x7ff4880b45d0 2024-09-12T02:48:10.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.715+0000 7ff48dc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff4880b54a0 con 0x7ff48815b9d0 2024-09-12T02:48:10.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.715+0000 7ff487400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff48806eef0 0x7ff48806f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:10.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.715+0000 7ff487400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff48806eef0 0x7ff48806f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34520/0 (socket says 172.21.15.112:34520) 2024-09-12T02:48:10.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.715+0000 7ff487400640 1 -- 172.21.15.112:0/3287730163 learned_addr learned my addr 172.21.15.112:0/3287730163 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:10.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.716+0000 7ff486a00640 1 --2- 172.21.15.112:0/3287730163 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff48815b9d0 0x7ff4880b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:10.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.716+0000 7ff486000640 1 --2- 172.21.15.112:0/3287730163 >> v2:172.21.15.137:3300/0 conn(0x7ff4880b45d0 0x7ff4880728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:10.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.716+0000 7ff487400640 1 -- 172.21.15.112:0/3287730163 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff48815b9d0 msgr2=0x7ff4880b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:10.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.716+0000 7ff487400640 1 --2- 172.21.15.112:0/3287730163 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff48815b9d0 0x7ff4880b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:10.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.716+0000 7ff487400640 1 -- 172.21.15.112:0/3287730163 >> v2:172.21.15.137:3300/0 conn(0x7ff4880b45d0 msgr2=0x7ff4880728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:10.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.716+0000 7ff487400640 1 --2- 172.21.15.112:0/3287730163 >> v2:172.21.15.137:3300/0 conn(0x7ff4880b45d0 0x7ff4880728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:10.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.716+0000 7ff487400640 1 -- 172.21.15.112:0/3287730163 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4880b3af0 con 0x7ff48806eef0 2024-09-12T02:48:10.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.716+0000 7ff486000640 1 --2- 172.21.15.112:0/3287730163 >> v2:172.21.15.137:3300/0 conn(0x7ff4880b45d0 0x7ff4880728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:10.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.716+0000 7ff486a00640 1 --2- 172.21.15.112:0/3287730163 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff48815b9d0 0x7ff4880b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:10.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.717+0000 7ff487400640 1 --2- 172.21.15.112:0/3287730163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff48806eef0 0x7ff48806f300 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7ff48806d2e0 tx=0x7ff48002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b8f6167164aded0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:10.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.717+0000 7ff485600640 1 -- 172.21.15.112:0/3287730163 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff480036070 con 0x7ff48806eef0 2024-09-12T02:48:10.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.717+0000 7ff485600640 1 -- 172.21.15.112:0/3287730163 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff480031600 con 0x7ff48806eef0 2024-09-12T02:48:10.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.717+0000 7ff485600640 1 -- 172.21.15.112:0/3287730163 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4800319d0 con 0x7ff48806eef0 2024-09-12T02:48:10.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.718+0000 7ff48dc00640 1 -- 172.21.15.112:0/3287730163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff48806eef0 msgr2=0x7ff48806f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:10.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.718+0000 7ff48dc00640 1 --2- 172.21.15.112:0/3287730163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff48806eef0 0x7ff48806f300 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7ff48806d2e0 tx=0x7ff48002a6a0 comp rx=0 tx=0).stop 2024-09-12T02:48:10.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.718+0000 7ff48dc00640 1 -- 172.21.15.112:0/3287730163 shutdown_connections 2024-09-12T02:48:10.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.718+0000 7ff48dc00640 1 --2- 172.21.15.112:0/3287730163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff48806eef0 0x7ff48806f300 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:10.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.718+0000 7ff48dc00640 1 --2- 172.21.15.112:0/3287730163 >> v2:172.21.15.137:3300/0 conn(0x7ff4880b45d0 0x7ff4880728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:10.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.718+0000 7ff48dc00640 1 --2- 172.21.15.112:0/3287730163 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff48815b9d0 0x7ff4880b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:10.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.718+0000 7ff48dc00640 1 -- 172.21.15.112:0/3287730163 >> 172.21.15.112:0/3287730163 conn(0x7ff48806bbd0 msgr2=0x7ff48806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:10.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.718+0000 7ff48dc00640 1 -- 172.21.15.112:0/3287730163 shutdown_connections 2024-09-12T02:48:10.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.718+0000 7ff48dc00640 1 -- 172.21.15.112:0/3287730163 wait complete. 2024-09-12T02:48:10.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.719+0000 7ff48dc00640 1 Processor -- start 2024-09-12T02:48:10.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.720+0000 7ff48dc00640 1 -- start start 2024-09-12T02:48:10.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.720+0000 7ff48dc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff48806eef0 0x7ff488149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:10.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.720+0000 7ff48dc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4880b45d0 0x7ff48814c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:10.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.720+0000 7ff48dc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff48815b9d0 0x7ff48814da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:10.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.720+0000 7ff48dc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff48815bdb0 con 0x7ff48806eef0 2024-09-12T02:48:10.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.720+0000 7ff48dc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff4880b40b0 con 0x7ff4880b45d0 2024-09-12T02:48:10.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.720+0000 7ff48dc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff48815bf30 con 0x7ff48815b9d0 2024-09-12T02:48:10.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.721+0000 7ff486a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff48806eef0 0x7ff488149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:10.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.721+0000 7ff486a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff48806eef0 0x7ff488149ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34530/0 (socket says 172.21.15.112:34530) 2024-09-12T02:48:10.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.721+0000 7ff486a00640 1 -- 172.21.15.112:0/3897053301 learned_addr learned my addr 172.21.15.112:0/3897053301 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:10.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.721+0000 7ff487400640 1 --2- 172.21.15.112:0/3897053301 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff48815b9d0 0x7ff48814da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:10.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.721+0000 7ff486000640 1 --2- 172.21.15.112:0/3897053301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4880b45d0 0x7ff48814c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:10.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.721+0000 7ff486a00640 1 -- 172.21.15.112:0/3897053301 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff48815b9d0 msgr2=0x7ff48814da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:10.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.721+0000 7ff486a00640 1 --2- 172.21.15.112:0/3897053301 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff48815b9d0 0x7ff48814da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:10.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.721+0000 7ff486a00640 1 -- 172.21.15.112:0/3897053301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4880b45d0 msgr2=0x7ff48814c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:10.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.721+0000 7ff486a00640 1 --2- 172.21.15.112:0/3897053301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4880b45d0 0x7ff48814c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:10.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.721+0000 7ff486a00640 1 -- 172.21.15.112:0/3897053301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff48814c5f0 con 0x7ff48806eef0 2024-09-12T02:48:10.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.721+0000 7ff487400640 1 --2- 172.21.15.112:0/3897053301 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff48815b9d0 0x7ff48814da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:10.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.721+0000 7ff486000640 1 --2- 172.21.15.112:0/3897053301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4880b45d0 0x7ff48814c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:10.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.721+0000 7ff486a00640 1 --2- 172.21.15.112:0/3897053301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff48806eef0 0x7ff488149ad0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7ff47800c7f0 tx=0x7ff47800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:10.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.722+0000 7ff47ea00640 1 -- 172.21.15.112:0/3897053301 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff478015070 con 0x7ff48806eef0 2024-09-12T02:48:10.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.722+0000 7ff47ea00640 1 -- 172.21.15.112:0/3897053301 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff478007820 con 0x7ff48806eef0 2024-09-12T02:48:10.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.722+0000 7ff47ea00640 1 -- 172.21.15.112:0/3897053301 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff478007bd0 con 0x7ff48806eef0 2024-09-12T02:48:10.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.722+0000 7ff48dc00640 1 -- 172.21.15.112:0/3897053301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff488155270 con 0x7ff48806eef0 2024-09-12T02:48:10.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.722+0000 7ff48dc00640 1 -- 172.21.15.112:0/3897053301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff488155830 con 0x7ff48806eef0 2024-09-12T02:48:10.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.723+0000 7ff48dc00640 1 -- 172.21.15.112:0/3897053301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff488068a30 con 0x7ff48806eef0 2024-09-12T02:48:10.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.724+0000 7ff47ea00640 1 -- 172.21.15.112:0/3897053301 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff478018070 con 0x7ff48806eef0 2024-09-12T02:48:10.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.725+0000 7ff47ea00640 1 --2- 172.21.15.112:0/3897053301 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff46806be30 0x7ff46806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:10.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.725+0000 7ff47ea00640 1 -- 172.21.15.112:0/3897053301 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7ff47808aec0 con 0x7ff48806eef0 2024-09-12T02:48:10.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.725+0000 7ff486000640 1 --2- 172.21.15.112:0/3897053301 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff46806be30 0x7ff46806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:10.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.725+0000 7ff486000640 1 --2- 172.21.15.112:0/3897053301 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff46806be30 0x7ff46806e2f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff488154da0 tx=0x7ff474008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:10.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.729+0000 7ff47ea00640 1 -- 172.21.15.112:0/3897053301 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff48814c5f0 con 0x7ff48806eef0 2024-09-12T02:48:10.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.935+0000 7ff48dc00640 1 -- 172.21.15.112:0/3897053301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff48806f300 con 0x7ff48806eef0 2024-09-12T02:48:10.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.936+0000 7ff47ea00640 1 -- 172.21.15.112:0/3897053301 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v70) ==== 53+0+73 (secure 0 0 0) 0x7ff478059860 con 0x7ff48806eef0 2024-09-12T02:48:10.936 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:48:10.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.938+0000 7ff48dc00640 1 -- 172.21.15.112:0/3897053301 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff46806be30 msgr2=0x7ff46806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:10.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.938+0000 7ff48dc00640 1 --2- 172.21.15.112:0/3897053301 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff46806be30 0x7ff46806e2f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff488154da0 tx=0x7ff474008040 comp rx=0 tx=0).stop 2024-09-12T02:48:10.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.938+0000 7ff48dc00640 1 -- 172.21.15.112:0/3897053301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff48806eef0 msgr2=0x7ff488149ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:10.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.938+0000 7ff48dc00640 1 --2- 172.21.15.112:0/3897053301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff48806eef0 0x7ff488149ad0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7ff47800c7f0 tx=0x7ff47800ccb0 comp rx=0 tx=0).stop 2024-09-12T02:48:10.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.938+0000 7ff48dc00640 1 -- 172.21.15.112:0/3897053301 shutdown_connections 2024-09-12T02:48:10.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.938+0000 7ff48dc00640 1 --2- 172.21.15.112:0/3897053301 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff48815b9d0 0x7ff48814da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:10.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.938+0000 7ff48dc00640 1 --2- 172.21.15.112:0/3897053301 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff46806be30 0x7ff46806e2f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:10.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.938+0000 7ff48dc00640 1 --2- 172.21.15.112:0/3897053301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4880b45d0 0x7ff48814c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:10.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.938+0000 7ff48dc00640 1 --2- 172.21.15.112:0/3897053301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff48806eef0 0x7ff488149ad0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:10.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.938+0000 7ff48dc00640 1 -- 172.21.15.112:0/3897053301 >> 172.21.15.112:0/3897053301 conn(0x7ff48806bbd0 msgr2=0x7ff4880cdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:10.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.938+0000 7ff48dc00640 1 -- 172.21.15.112:0/3897053301 shutdown_connections 2024-09-12T02:48:10.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:10.938+0000 7ff48dc00640 1 -- 172.21.15.112:0/3897053301 wait complete. 2024-09-12T02:48:10.954 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:48:10.954 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:48:10.954 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-09-12T02:48:10.954 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T02:48:10.954 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T02:48:10.954 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:48:10.954 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:48:10.954 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:48:10.954 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:48:10.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:10.955 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-09-12T02:48:10.995 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:48:10.995 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:48:10.995 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:48:10.995 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:10.995 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-09-12T02:48:10.995 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:10.995 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:48:10.995 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-09-12T02:48:10.995 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-09-12T02:48:10.996 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:48:10.996 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-09-12T02:48:10.996 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-09-12T02:48:10.996 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:48:10.996 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:48:10.996 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:48:10.996 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:48:10.996 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:48:10.996 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42388sec preferred_lft 42388sec 2024-09-12T02:48:10.996 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::ec4:7aff:fe88:8137/64 scope link noprefixroute 2024-09-12T02:48:10.996 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:10.996 INFO:teuthology.orchestra.run.smithi137.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:48:10.996 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 62:9a:8e:f1:56:55 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:48:10.997 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:48:10.997 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:10.997 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::30c8:13ff:fe15:f79d/64 scope link 2024-09-12T02:48:10.997 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:10.997 INFO:teuthology.orchestra.run.smithi137.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:48:10.997 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 62:9a:8e:f1:56:55 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:48:10.997 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::609a:8eff:fef1:5655/64 scope link 2024-09-12T02:48:10.997 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:10.997 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:48:10.997 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 96:f4:ca:17:88:2a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T02:48:10.997 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::94f4:caff:fe17:882a/64 scope link 2024-09-12T02:48:10.997 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:10.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:10.998 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:48:11.096 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-09-12T02:48:11.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:11.099 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-09-12T02:48:11.136 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-09-12T02:48:11.136 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:48:11.136 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:48:11.136 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:48:11.137 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:48:11.137 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:48:11.137 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-09-12T02:48:11.137 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:48:11.137 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:48:11.137 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:48:11.137 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-09-12T02:48:11.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:48:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:48:11.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:48:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:48:11.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:11.336 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-09-12T02:48:11.371 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T02:48:11.371 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T02:48:11.371 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:48:11.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:11.372 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-09-12T02:48:11.468 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:48:11.468 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T02:48:11.503 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:48:11.503 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:48:11.504 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T02:48:11.579 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-12T02:48:11.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:11.579 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:48:11.707 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:48:11.707 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:48:11.733 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:48:11.734 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:48:11.734 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-09-12T02:48:11.734 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with new device syntax: 1@7c01f3b3-dec2-4449-a33f-f960d7527ea6.cephfs=/ 2024-09-12T02:48:11.734 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.112:3300/172.21.15.137:3300/172.21.15.137:3301" will pass to kernel 2024-09-12T02:48:11.736 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-12T02:48:11.736 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:48:11.736 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:48:11.736 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:48:11.736 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:48:11.739 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:48:11.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:11.739 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T02:48:11.794 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:48:11.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:48:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:48:11.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:48:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:48:11.883 INFO:teuthology.orchestra.run.smithi137.stdout:client7029 2024-09-12T02:48:11.884 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:48:11.884 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:48:11.920 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:48:12.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.080+0000 7fbe89600640 1 Processor -- start 2024-09-12T02:48:12.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.080+0000 7fbe89600640 1 -- start start 2024-09-12T02:48:12.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.081+0000 7fbe89600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe8406d8c0 0x7fbe840afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:12.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.081+0000 7fbe89600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbe840ae8d0 0x7fbe840715a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:12.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.082+0000 7fbe89600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe840aedd0 con 0x7fbe8406dca0 2024-09-12T02:48:12.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.082+0000 7fbe89600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fbe840af0b0 con 0x7fbe840ae8d0 2024-09-12T02:48:12.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.082+0000 7fbe89600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbe840af390 con 0x7fbe8406d8c0 2024-09-12T02:48:12.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.082+0000 7fbe7a000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbe840ae8d0 0x7fbe840715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:12.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.082+0000 7fbe7a000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbe840ae8d0 0x7fbe840715a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41512/0 (socket says 172.21.15.112:41512) 2024-09-12T02:48:12.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.082+0000 7fbe83400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fbe8406dca0 0x7fbe8406e150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51974/0 (socket says 172.21.15.112:51974) 2024-09-12T02:48:12.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.082+0000 7fbe7a000640 1 -- 172.21.15.112:0/3468954224 learned_addr learned my addr 172.21.15.112:0/3468954224 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:12.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.082+0000 7fbe82a00640 1 --2- 172.21.15.112:0/3468954224 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe8406d8c0 0x7fbe840afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:12.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.082+0000 7fbe7a000640 1 -- 172.21.15.112:0/3468954224 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe8406d8c0 msgr2=0x7fbe840afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:12.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.082+0000 7fbe7a000640 1 --2- 172.21.15.112:0/3468954224 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe8406d8c0 0x7fbe840afe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:12.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.082+0000 7fbe7a000640 1 -- 172.21.15.112:0/3468954224 >> v1:172.21.15.112:6789/0 conn(0x7fbe8406dca0 legacy=0x7fbe8406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:12.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.082+0000 7fbe7a000640 1 -- 172.21.15.112:0/3468954224 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe840af670 con 0x7fbe840ae8d0 2024-09-12T02:48:12.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.083+0000 7fbe7a000640 1 --2- 172.21.15.112:0/3468954224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe840ae8d0 0x7fbe840715a0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c009850 tx=0x7fbe6c02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abee157287ce8825 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:12.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.084+0000 7fbe82000640 1 -- 172.21.15.112:0/3468954224 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c004030 con 0x7fbe840ae8d0 2024-09-12T02:48:12.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.084+0000 7fbe82000640 1 -- 172.21.15.112:0/3468954224 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe6c0041d0 con 0x7fbe840ae8d0 2024-09-12T02:48:12.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.084+0000 7fbe82000640 1 -- 172.21.15.112:0/3468954224 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c003610 con 0x7fbe840ae8d0 2024-09-12T02:48:12.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.084+0000 7fbe89600640 1 -- 172.21.15.112:0/3468954224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe840ae8d0 msgr2=0x7fbe840715a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:12.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.084+0000 7fbe89600640 1 --2- 172.21.15.112:0/3468954224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe840ae8d0 0x7fbe840715a0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c009850 tx=0x7fbe6c02a250 comp rx=0 tx=0).stop 2024-09-12T02:48:12.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.084+0000 7fbe89600640 1 -- 172.21.15.112:0/3468954224 shutdown_connections 2024-09-12T02:48:12.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.084+0000 7fbe89600640 1 --2- 172.21.15.112:0/3468954224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe840ae8d0 0x7fbe840715a0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:12.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.084+0000 7fbe89600640 1 --2- 172.21.15.112:0/3468954224 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe8406d8c0 0x7fbe840afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:12.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.084+0000 7fbe89600640 1 -- 172.21.15.112:0/3468954224 >> 172.21.15.112:0/3468954224 conn(0x7fbe8406bbd0 msgr2=0x7fbe8406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:12.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.084+0000 7fbe89600640 1 -- 172.21.15.112:0/3468954224 shutdown_connections 2024-09-12T02:48:12.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.084+0000 7fbe89600640 1 -- 172.21.15.112:0/3468954224 wait complete. 2024-09-12T02:48:12.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.086+0000 7fbe89600640 1 Processor -- start 2024-09-12T02:48:12.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.086+0000 7fbe89600640 1 -- start start 2024-09-12T02:48:12.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.087+0000 7fbe89600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe8406d8c0 0x7fbe8414b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:12.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.087+0000 7fbe89600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe8406dca0 0x7fbe84159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:12.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.087+0000 7fbe89600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe840ae8d0 0x7fbe840cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:12.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.087+0000 7fbe89600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbe840b38e0 con 0x7fbe8406d8c0 2024-09-12T02:48:12.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.087+0000 7fbe89600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbe84071ae0 con 0x7fbe8406dca0 2024-09-12T02:48:12.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.087+0000 7fbe89600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbe840b3a60 con 0x7fbe840ae8d0 2024-09-12T02:48:12.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.087+0000 7fbe82a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe8406d8c0 0x7fbe8414b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:12.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.087+0000 7fbe82a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe8406d8c0 0x7fbe8414b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41524/0 (socket says 172.21.15.112:41524) 2024-09-12T02:48:12.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.087+0000 7fbe82a00640 1 -- 172.21.15.112:0/1752570454 learned_addr learned my addr 172.21.15.112:0/1752570454 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:12.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.088+0000 7fbe82a00640 1 -- 172.21.15.112:0/1752570454 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe840ae8d0 msgr2=0x7fbe840cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:12.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.088+0000 7fbe82a00640 1 --2- 172.21.15.112:0/1752570454 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe840ae8d0 0x7fbe840cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:12.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.088+0000 7fbe82a00640 1 -- 172.21.15.112:0/1752570454 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe8406dca0 msgr2=0x7fbe84159d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:12.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.088+0000 7fbe82a00640 1 --2- 172.21.15.112:0/1752570454 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe8406dca0 0x7fbe84159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:12.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.088+0000 7fbe82a00640 1 -- 172.21.15.112:0/1752570454 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe8415a860 con 0x7fbe8406d8c0 2024-09-12T02:48:12.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.088+0000 7fbe82a00640 1 --2- 172.21.15.112:0/1752570454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe8406d8c0 0x7fbe8414b5f0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400e9b0 tx=0x7fbe7400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:12.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.088+0000 7fbe7b400640 1 -- 172.21.15.112:0/1752570454 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe74017070 con 0x7fbe8406d8c0 2024-09-12T02:48:12.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.088+0000 7fbe7b400640 1 -- 172.21.15.112:0/1752570454 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe7400c9a0 con 0x7fbe8406d8c0 2024-09-12T02:48:12.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.088+0000 7fbe7b400640 1 -- 172.21.15.112:0/1752570454 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7400cd90 con 0x7fbe8406d8c0 2024-09-12T02:48:12.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.088+0000 7fbe89600640 1 -- 172.21.15.112:0/1752570454 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe8415ab40 con 0x7fbe8406d8c0 2024-09-12T02:48:12.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.088+0000 7fbe89600640 1 -- 172.21.15.112:0/1752570454 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe841f5850 con 0x7fbe8406d8c0 2024-09-12T02:48:12.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.089+0000 7fbe89600640 1 -- 172.21.15.112:0/1752570454 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe840afe70 con 0x7fbe8406d8c0 2024-09-12T02:48:12.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.090+0000 7fbe7b400640 1 -- 172.21.15.112:0/1752570454 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbe7401a070 con 0x7fbe8406d8c0 2024-09-12T02:48:12.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.091+0000 7fbe7b400640 1 --2- 172.21.15.112:0/1752570454 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbe6006be30 0x7fbe6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:12.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.091+0000 7fbe7b400640 1 -- 172.21.15.112:0/1752570454 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7fbe7408b270 con 0x7fbe8406d8c0 2024-09-12T02:48:12.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.091+0000 7fbe7a000640 1 --2- 172.21.15.112:0/1752570454 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbe6006be30 0x7fbe6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:12.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.092+0000 7fbe7a000640 1 --2- 172.21.15.112:0/1752570454 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbe6006be30 0x7fbe6006e2f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c033000 tx=0x7fbe6c02c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:12.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.096+0000 7fbe7b400640 1 -- 172.21.15.112:0/1752570454 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe74059c10 con 0x7fbe8406d8c0 2024-09-12T02:48:12.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.305+0000 7fbe89600640 1 -- 172.21.15.112:0/1752570454 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe840cd2b0 con 0x7fbe8406d8c0 2024-09-12T02:48:12.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.306+0000 7fbe7b400640 1 -- 172.21.15.112:0/1752570454 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+5231 (secure 0 0 0) 0x7fbe74059510 con 0x7fbe8406d8c0 2024-09-12T02:48:12.306 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:12.306 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":70,"btime":"2024-09-12T02:48:01:488612+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5816,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1943935405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1943935405},{"type":"v1","addr":"172.21.15.137:6834","nonce":1943935405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6328,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2010766966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2010766966},{"type":"v1","addr":"172.21.15.112:6835","nonce":2010766966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/193655023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":193655023},{"type":"v1","addr":"172.21.15.137:6835","nonce":193655023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:47:57.871200+0000","modified":"2024-09-12T02:48:00.893329+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6861":{"gid":6861,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/134918269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":134918269},{"type":"v1","addr":"172.21.15.112:6837","nonce":134918269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6861,"qdb_cluster":[6861]},"id":8}]} 2024-09-12T02:48:12.306 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 70 2024-09-12T02:48:12.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.308+0000 7fbe89600640 1 -- 172.21.15.112:0/1752570454 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbe6006be30 msgr2=0x7fbe6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:12.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.308+0000 7fbe89600640 1 --2- 172.21.15.112:0/1752570454 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbe6006be30 0x7fbe6006e2f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c033000 tx=0x7fbe6c02c000 comp rx=0 tx=0).stop 2024-09-12T02:48:12.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.308+0000 7fbe89600640 1 -- 172.21.15.112:0/1752570454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe8406d8c0 msgr2=0x7fbe8414b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:12.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.308+0000 7fbe89600640 1 --2- 172.21.15.112:0/1752570454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe8406d8c0 0x7fbe8414b5f0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400e9b0 tx=0x7fbe7400ee70 comp rx=0 tx=0).stop 2024-09-12T02:48:12.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.308+0000 7fbe89600640 1 -- 172.21.15.112:0/1752570454 shutdown_connections 2024-09-12T02:48:12.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.308+0000 7fbe89600640 1 --2- 172.21.15.112:0/1752570454 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe840ae8d0 0x7fbe840cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:12.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.308+0000 7fbe89600640 1 --2- 172.21.15.112:0/1752570454 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbe6006be30 0x7fbe6006e2f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:12.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.308+0000 7fbe89600640 1 --2- 172.21.15.112:0/1752570454 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe8406dca0 0x7fbe84159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:12.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.308+0000 7fbe89600640 1 --2- 172.21.15.112:0/1752570454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe8406d8c0 0x7fbe8414b5f0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:12.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.308+0000 7fbe89600640 1 -- 172.21.15.112:0/1752570454 >> 172.21.15.112:0/1752570454 conn(0x7fbe8406bbd0 msgr2=0x7fbe840b5410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:12.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.308+0000 7fbe89600640 1 -- 172.21.15.112:0/1752570454 shutdown_connections 2024-09-12T02:48:12.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.308+0000 7fbe89600640 1 -- 172.21.15.112:0/1752570454 wait complete. 2024-09-12T02:48:12.324 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-12T02:48:12.495 INFO:teuthology.orchestra.run.smithi112.stdout:{"cluster_fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","whoami":0,"id":6861,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":14.024661843000001,"mdsmap_epoch":70,"osdmap_epoch":135,"osdmap_epoch_barrier":135,"uptime":19.100280289000001} 2024-09-12T02:48:12.496 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", "fs_name": "cephfs", "id": 6861, "mdsmap_epoch": 70, "osdmap_epoch": 135, "osdmap_epoch_barrier": 135, "rank_uptime": 14.024661843, "state": "up:active", "uptime": 19.100280289, "want_state": "up:active", "whoami": 0 } 2024-09-12T02:48:12.496 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2024-09-12T02:48:12.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.654+0000 7fe04be00640 1 Processor -- start 2024-09-12T02:48:12.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.654+0000 7fe04be00640 1 -- start start 2024-09-12T02:48:12.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.655+0000 7fe04be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe04c15eae0 0x7fe04c0b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:12.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.655+0000 7fe04be00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe04c0d3240 0x7fe04c0d36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:12.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.655+0000 7fe04be00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe04c0d2f40 con 0x7fe04c15eec0 2024-09-12T02:48:12.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.655+0000 7fe04be00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe04c0d2660 con 0x7fe04c0d3240 2024-09-12T02:48:12.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.655+0000 7fe04be00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe04c0cf770 con 0x7fe04c15eae0 2024-09-12T02:48:12.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.655+0000 7fe04b400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe04c0d3240 0x7fe04c0d36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:12.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.655+0000 7fe04b400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe04c0d3240 0x7fe04c0d36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41534/0 (socket says 172.21.15.112:41534) 2024-09-12T02:48:12.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.655+0000 7fe04b400640 1 -- 172.21.15.112:0/1925609718 learned_addr learned my addr 172.21.15.112:0/1925609718 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:12.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.656+0000 7fe04aa00640 1 --2- 172.21.15.112:0/1925609718 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe04c15eae0 0x7fe04c0b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:12.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.656+0000 7fe04b400640 1 -- 172.21.15.112:0/1925609718 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe04c15eae0 msgr2=0x7fe04c0b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:12.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.656+0000 7fe04b400640 1 --2- 172.21.15.112:0/1925609718 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe04c15eae0 0x7fe04c0b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:12.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.656+0000 7fe04b400640 1 -- 172.21.15.112:0/1925609718 >> v1:172.21.15.137:6789/0 conn(0x7fe04c15eec0 legacy=0x7fe04c0d2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:12.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.656+0000 7fe04b400640 1 -- 172.21.15.112:0/1925609718 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe04c0d1dc0 con 0x7fe04c0d3240 2024-09-12T02:48:12.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.656+0000 7fe04aa00640 1 --2- 172.21.15.112:0/1925609718 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe04c15eae0 0x7fe04c0b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:12.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.657+0000 7fe04b400640 1 --2- 172.21.15.112:0/1925609718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe04c0d3240 0x7fe04c0d36c0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fe044009e50 tx=0x7fe04402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6637703e6a781ea9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:12.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.657+0000 7fe049600640 1 -- 172.21.15.112:0/1925609718 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe044036070 con 0x7fe04c0d3240 2024-09-12T02:48:12.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.657+0000 7fe049600640 1 -- 172.21.15.112:0/1925609718 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe044031600 con 0x7fe04c0d3240 2024-09-12T02:48:12.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.657+0000 7fe049600640 1 -- 172.21.15.112:0/1925609718 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0440319d0 con 0x7fe04c0d3240 2024-09-12T02:48:12.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.658+0000 7fe04be00640 1 -- 172.21.15.112:0/1925609718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe04c0d3240 msgr2=0x7fe04c0d36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:12.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.658+0000 7fe04be00640 1 --2- 172.21.15.112:0/1925609718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe04c0d3240 0x7fe04c0d36c0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fe044009e50 tx=0x7fe04402a710 comp rx=0 tx=0).stop 2024-09-12T02:48:12.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.658+0000 7fe04be00640 1 -- 172.21.15.112:0/1925609718 shutdown_connections 2024-09-12T02:48:12.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.658+0000 7fe04be00640 1 --2- 172.21.15.112:0/1925609718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe04c0d3240 0x7fe04c0d36c0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:12.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.658+0000 7fe04be00640 1 --2- 172.21.15.112:0/1925609718 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe04c15eae0 0x7fe04c0b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:12.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.658+0000 7fe04be00640 1 -- 172.21.15.112:0/1925609718 >> 172.21.15.112:0/1925609718 conn(0x7fe04c09df90 msgr2=0x7fe04c0d4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:12.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.658+0000 7fe04be00640 1 -- 172.21.15.112:0/1925609718 shutdown_connections 2024-09-12T02:48:12.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.658+0000 7fe04be00640 1 -- 172.21.15.112:0/1925609718 wait complete. 2024-09-12T02:48:12.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.659+0000 7fe04be00640 1 Processor -- start 2024-09-12T02:48:12.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.659+0000 7fe04be00640 1 -- start start 2024-09-12T02:48:12.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.660+0000 7fe04be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe04c0d3240 0x7fe04c15f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:12.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.660+0000 7fe04be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe04c15eae0 0x7fe04c1f47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:12.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.660+0000 7fe04be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe04c15eec0 0x7fe04c0cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:12.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.660+0000 7fe04be00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c0b3eb0 con 0x7fe04c15eec0 2024-09-12T02:48:12.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.660+0000 7fe04be00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c0d2380 con 0x7fe04c0d3240 2024-09-12T02:48:12.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.660+0000 7fe04be00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe04c0b4030 con 0x7fe04c15eae0 2024-09-12T02:48:12.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.660+0000 7fe04b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe04c15eec0 0x7fe04c0cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:12.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.660+0000 7fe04b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe04c15eec0 0x7fe04c0cc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41538/0 (socket says 172.21.15.112:41538) 2024-09-12T02:48:12.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.660+0000 7fe04b400640 1 -- 172.21.15.112:0/45228175 learned_addr learned my addr 172.21.15.112:0/45228175 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:12.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.660+0000 7fe04aa00640 1 --2- 172.21.15.112:0/45228175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe04c0d3240 0x7fe04c15f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:12.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.660+0000 7fe04a000640 1 --2- 172.21.15.112:0/45228175 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe04c15eae0 0x7fe04c1f47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:12.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.660+0000 7fe04b400640 1 -- 172.21.15.112:0/45228175 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe04c15eae0 msgr2=0x7fe04c1f47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:12.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.660+0000 7fe04b400640 1 --2- 172.21.15.112:0/45228175 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe04c15eae0 0x7fe04c1f47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:12.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.660+0000 7fe04b400640 1 -- 172.21.15.112:0/45228175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe04c0d3240 msgr2=0x7fe04c15f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:12.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.660+0000 7fe04b400640 1 --2- 172.21.15.112:0/45228175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe04c0d3240 0x7fe04c15f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:12.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.660+0000 7fe04b400640 1 -- 172.21.15.112:0/45228175 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe04c161e30 con 0x7fe04c15eec0 2024-09-12T02:48:12.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.660+0000 7fe04b400640 1 --2- 172.21.15.112:0/45228175 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe04c15eec0 0x7fe04c0cc190 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fe044009f70 tx=0x7fe044004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:12.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.660+0000 7fe042a00640 1 -- 172.21.15.112:0/45228175 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04403f020 con 0x7fe04c15eec0 2024-09-12T02:48:12.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.661+0000 7fe042a00640 1 -- 172.21.15.112:0/45228175 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe044037040 con 0x7fe04c15eec0 2024-09-12T02:48:12.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.661+0000 7fe042a00640 1 -- 172.21.15.112:0/45228175 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe044036070 con 0x7fe04c15eec0 2024-09-12T02:48:12.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.661+0000 7fe04be00640 1 -- 172.21.15.112:0/45228175 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe04c162110 con 0x7fe04c15eec0 2024-09-12T02:48:12.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.661+0000 7fe04be00640 1 -- 172.21.15.112:0/45228175 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe04c1587d0 con 0x7fe04c15eec0 2024-09-12T02:48:12.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.662+0000 7fe04be00640 1 -- 172.21.15.112:0/45228175 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe04c0b18f0 con 0x7fe04c15eec0 2024-09-12T02:48:12.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.663+0000 7fe042a00640 1 -- 172.21.15.112:0/45228175 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe044042020 con 0x7fe04c15eec0 2024-09-12T02:48:12.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.664+0000 7fe042a00640 1 --2- 172.21.15.112:0/45228175 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe02c06be30 0x7fe02c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:12.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.664+0000 7fe042a00640 1 -- 172.21.15.112:0/45228175 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7fe0440ab1e0 con 0x7fe04c15eec0 2024-09-12T02:48:12.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.664+0000 7fe04aa00640 1 --2- 172.21.15.112:0/45228175 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe02c06be30 0x7fe02c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:12.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.664+0000 7fe04aa00640 1 --2- 172.21.15.112:0/45228175 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe02c06be30 0x7fe02c06e2f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe03c006fd0 tx=0x7fe03c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:12.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.668+0000 7fe042a00640 1 -- 172.21.15.112:0/45228175 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe044049030 con 0x7fe04c15eec0 2024-09-12T02:48:12.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:12.841+0000 7fe04be00640 1 -- 172.21.15.112:0/45228175 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) -- 0x7fe04c08ea30 con 0x7fe04c15eec0 2024-09-12T02:48:13.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.151+0000 7fe042a00640 1 -- 172.21.15.112:0/45228175 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v136) ==== 181+0+0 (secure 0 0 0) 0x7fe044079540 con 0x7fe04c15eec0 2024-09-12T02:48:13.152 INFO:teuthology.orchestra.run.smithi112.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2024-09-12T02:48:13.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.154+0000 7fe04be00640 1 -- 172.21.15.112:0/45228175 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe02c06be30 msgr2=0x7fe02c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:13.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.154+0000 7fe04be00640 1 --2- 172.21.15.112:0/45228175 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe02c06be30 0x7fe02c06e2f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe03c006fd0 tx=0x7fe03c008040 comp rx=0 tx=0).stop 2024-09-12T02:48:13.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.154+0000 7fe04be00640 1 -- 172.21.15.112:0/45228175 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe04c15eec0 msgr2=0x7fe04c0cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:13.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.154+0000 7fe04be00640 1 --2- 172.21.15.112:0/45228175 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe04c15eec0 0x7fe04c0cc190 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fe044009f70 tx=0x7fe044004a40 comp rx=0 tx=0).stop 2024-09-12T02:48:13.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.154+0000 7fe04be00640 1 -- 172.21.15.112:0/45228175 shutdown_connections 2024-09-12T02:48:13.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.154+0000 7fe04be00640 1 --2- 172.21.15.112:0/45228175 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe04c15eec0 0x7fe04c0cc190 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:13.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.154+0000 7fe04be00640 1 --2- 172.21.15.112:0/45228175 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe04c15eae0 0x7fe04c1f47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:13.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.154+0000 7fe04be00640 1 --2- 172.21.15.112:0/45228175 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe02c06be30 0x7fe02c06e2f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:13.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.154+0000 7fe04be00640 1 --2- 172.21.15.112:0/45228175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe04c0d3240 0x7fe04c15f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:13.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.154+0000 7fe04be00640 1 -- 172.21.15.112:0/45228175 >> 172.21.15.112:0/45228175 conn(0x7fe04c09df90 msgr2=0x7fe04c0d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:13.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.154+0000 7fe04be00640 1 -- 172.21.15.112:0/45228175 shutdown_connections 2024-09-12T02:48:13.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.154+0000 7fe04be00640 1 -- 172.21.15.112:0/45228175 wait complete. 2024-09-12T02:48:13.172 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-12T02:48:13.340 INFO:teuthology.orchestra.run.smithi112.stdout:{"osd_mon_report_interval":"5"} 2024-09-12T02:48:13.340 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-12T02:48:13.340 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2024-09-12T02:48:13.341 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:48:13.341 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:48:13.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:13.376 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2024-09-12T02:48:13.588 INFO:teuthology.orchestra.run.smithi112.stderr:16+0 records in 2024-09-12T02:48:13.588 INFO:teuthology.orchestra.run.smithi112.stderr:16+0 records out 2024-09-12T02:48:13.589 INFO:teuthology.orchestra.run.smithi112.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.132571 s, 127 MB/s 2024-09-12T02:48:13.590 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:48:13.590 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:48:13.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:13.625 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2024-09-12T02:48:13.835 INFO:teuthology.orchestra.run.smithi112.stderr:17+0 records in 2024-09-12T02:48:13.836 INFO:teuthology.orchestra.run.smithi112.stderr:17+0 records out 2024-09-12T02:48:13.836 INFO:teuthology.orchestra.run.smithi112.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.132759 s, 134 MB/s 2024-09-12T02:48:13.837 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2024-09-12T02:48:13.837 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-12T02:48:13.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.990+0000 7fcacda00640 1 Processor -- start 2024-09-12T02:48:13.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.990+0000 7fcacda00640 1 -- start start 2024-09-12T02:48:13.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.991+0000 7fcacda00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcac8071530 0x7fcac80af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:13.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.991+0000 7fcacda00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcac80719a0 0x7fcac80afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:13.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.991+0000 7fcacda00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcac80ceeb0 con 0x7fcac815cc50 2024-09-12T02:48:13.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.991+0000 7fcacda00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fcac815d030 con 0x7fcac8071530 2024-09-12T02:48:13.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.991+0000 7fcacda00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fcac80cf4c0 con 0x7fcac80719a0 2024-09-12T02:48:13.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.992+0000 7fcabe000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcac8071530 0x7fcac80af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:13.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.992+0000 7fcabe000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcac8071530 0x7fcac80af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41540/0 (socket says 172.21.15.112:41540) 2024-09-12T02:48:13.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.992+0000 7fcabe000640 1 -- 172.21.15.112:0/872754631 learned_addr learned my addr 172.21.15.112:0/872754631 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:13.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.992+0000 7fcac6a00640 1 --1- 172.21.15.112:0/872754631 >> v1:172.21.15.112:6789/0 conn(0x7fcac815cc50 0x7fcac80732f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51980/0 (socket says 172.21.15.112:51980) 2024-09-12T02:48:13.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.992+0000 7fcac7400640 1 --2- 172.21.15.112:0/872754631 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcac80719a0 0x7fcac80afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:13.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.992+0000 7fcabe000640 1 -- 172.21.15.112:0/872754631 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcac80719a0 msgr2=0x7fcac80afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:13.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.992+0000 7fcabe000640 1 --2- 172.21.15.112:0/872754631 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcac80719a0 0x7fcac80afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:13.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.992+0000 7fcabe000640 1 -- 172.21.15.112:0/872754631 >> v1:172.21.15.112:6789/0 conn(0x7fcac815cc50 legacy=0x7fcac80732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:13.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.992+0000 7fcabe000640 1 -- 172.21.15.112:0/872754631 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac806e300 con 0x7fcac8071530 2024-09-12T02:48:13.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.993+0000 7fcabe000640 1 --2- 172.21.15.112:0/872754631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcac8071530 0x7fcac80af720 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fcac80cf640 tx=0x7fcab002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a6ea806c3fa90fa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:13.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.993+0000 7fcac6000640 1 -- 172.21.15.112:0/872754631 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab0004030 con 0x7fcac8071530 2024-09-12T02:48:13.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.994+0000 7fcac6000640 1 -- 172.21.15.112:0/872754631 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcab00041d0 con 0x7fcac8071530 2024-09-12T02:48:13.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.994+0000 7fcac6000640 1 -- 172.21.15.112:0/872754631 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab0003610 con 0x7fcac8071530 2024-09-12T02:48:13.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.994+0000 7fcacda00640 1 -- 172.21.15.112:0/872754631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcac8071530 msgr2=0x7fcac80af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:13.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.994+0000 7fcacda00640 1 --2- 172.21.15.112:0/872754631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcac8071530 0x7fcac80af720 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fcac80cf640 tx=0x7fcab002a1a0 comp rx=0 tx=0).stop 2024-09-12T02:48:13.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.994+0000 7fcacda00640 1 -- 172.21.15.112:0/872754631 shutdown_connections 2024-09-12T02:48:13.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.994+0000 7fcacda00640 1 --2- 172.21.15.112:0/872754631 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcac80719a0 0x7fcac80afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:13.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.994+0000 7fcacda00640 1 --2- 172.21.15.112:0/872754631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcac8071530 0x7fcac80af720 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:13.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.994+0000 7fcacda00640 1 -- 172.21.15.112:0/872754631 >> 172.21.15.112:0/872754631 conn(0x7fcac806bbd0 msgr2=0x7fcac806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:13.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.994+0000 7fcacda00640 1 -- 172.21.15.112:0/872754631 shutdown_connections 2024-09-12T02:48:13.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.994+0000 7fcacda00640 1 -- 172.21.15.112:0/872754631 wait complete. 2024-09-12T02:48:14.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.996+0000 7fcacda00640 1 Processor -- start 2024-09-12T02:48:14.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.996+0000 7fcacda00640 1 -- start start 2024-09-12T02:48:14.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.997+0000 7fcacda00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcac8071530 0x7fcac8157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:14.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.997+0000 7fcacda00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcac80719a0 0x7fcac81581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:14.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.997+0000 7fcacda00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcac815cc50 0x7fcac81530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:14.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.997+0000 7fcacda00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcac806f510 con 0x7fcac8071530 2024-09-12T02:48:14.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.997+0000 7fcacda00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcac80cf150 con 0x7fcac815cc50 2024-09-12T02:48:14.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.997+0000 7fcacda00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fcac806f690 con 0x7fcac80719a0 2024-09-12T02:48:14.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.997+0000 7fcac6a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcac8071530 0x7fcac8157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:14.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.997+0000 7fcac6a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcac8071530 0x7fcac8157ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41542/0 (socket says 172.21.15.112:41542) 2024-09-12T02:48:14.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.997+0000 7fcac6a00640 1 -- 172.21.15.112:0/3002948822 learned_addr learned my addr 172.21.15.112:0/3002948822 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:14.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.997+0000 7fcabe000640 1 --2- 172.21.15.112:0/3002948822 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcac80719a0 0x7fcac81581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:14.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.997+0000 7fcac7400640 1 --2- 172.21.15.112:0/3002948822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcac815cc50 0x7fcac81530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:14.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.997+0000 7fcac6a00640 1 -- 172.21.15.112:0/3002948822 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcac80719a0 msgr2=0x7fcac81581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:14.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.997+0000 7fcac6a00640 1 --2- 172.21.15.112:0/3002948822 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcac80719a0 0x7fcac81581e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:14.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.997+0000 7fcac6a00640 1 -- 172.21.15.112:0/3002948822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcac815cc50 msgr2=0x7fcac81530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:14.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.997+0000 7fcac6a00640 1 --2- 172.21.15.112:0/3002948822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcac815cc50 0x7fcac81530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:14.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.997+0000 7fcac6a00640 1 -- 172.21.15.112:0/3002948822 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac8144490 con 0x7fcac8071530 2024-09-12T02:48:14.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.997+0000 7fcabe000640 1 --2- 172.21.15.112:0/3002948822 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcac80719a0 0x7fcac81581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:14.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.997+0000 7fcac7400640 1 --2- 172.21.15.112:0/3002948822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcac815cc50 0x7fcac81530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:14.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.998+0000 7fcac6a00640 1 --2- 172.21.15.112:0/3002948822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcac8071530 0x7fcac8157ca0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fcab800c3c0 tx=0x7fcab800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:14.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.998+0000 7fcabf400640 1 -- 172.21.15.112:0/3002948822 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab80074e0 con 0x7fcac8071530 2024-09-12T02:48:14.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.998+0000 7fcabf400640 1 -- 172.21.15.112:0/3002948822 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcab8007680 con 0x7fcac8071530 2024-09-12T02:48:14.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.998+0000 7fcabf400640 1 -- 172.21.15.112:0/3002948822 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab8004a00 con 0x7fcac8071530 2024-09-12T02:48:14.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.998+0000 7fcacda00640 1 -- 172.21.15.112:0/3002948822 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcac8144770 con 0x7fcac8071530 2024-09-12T02:48:14.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.998+0000 7fcacda00640 1 -- 172.21.15.112:0/3002948822 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcac815d260 con 0x7fcac8071530 2024-09-12T02:48:14.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:13.999+0000 7fcacda00640 1 -- 172.21.15.112:0/3002948822 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcac806df60 con 0x7fcac8071530 2024-09-12T02:48:14.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:14.000+0000 7fcabf400640 1 -- 172.21.15.112:0/3002948822 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcab801a020 con 0x7fcac8071530 2024-09-12T02:48:14.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:14.001+0000 7fcabf400640 1 --2- 172.21.15.112:0/3002948822 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcaa406be30 0x7fcaa406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:14.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:14.001+0000 7fcabf400640 1 -- 172.21.15.112:0/3002948822 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7fcab808a5e0 con 0x7fcac8071530 2024-09-12T02:48:14.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:14.001+0000 7fcabe000640 1 --2- 172.21.15.112:0/3002948822 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcaa406be30 0x7fcaa406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:14.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:14.002+0000 7fcabe000640 1 --2- 172.21.15.112:0/3002948822 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcaa406be30 0x7fcaa406e2f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fcab0033000 tx=0x7fcab002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:14.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:14.005+0000 7fcabf400640 1 -- 172.21.15.112:0/3002948822 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcab8058f90 con 0x7fcac8071530 2024-09-12T02:48:14.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:14.182+0000 7fcacda00640 1 -- 172.21.15.112:0/3002948822 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fcac806ef60 con 0x7fcac8071530 2024-09-12T02:48:14.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:14.184+0000 7fcabf400640 1 -- 172.21.15.112:0/3002948822 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v136) ==== 81+0+34274 (secure 0 0 0) 0x7fcab8058890 con 0x7fcac8071530 2024-09-12T02:48:14.185 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:14.185 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:48:14.185 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 136, 2024-09-12T02:48:14.185 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:48:14.185 INFO:teuthology.orchestra.run.smithi112.stdout: "created": "2024-09-12T02:41:36.162095+0000", 2024-09-12T02:48:14.186 INFO:teuthology.orchestra.run.smithi112.stdout: "modified": "2024-09-12T02:48:13.146650+0000", 2024-09-12T02:48:14.186 INFO:teuthology.orchestra.run.smithi112.stdout: "last_up_change": "2024-09-12T02:41:42.191169+0000", 2024-09-12T02:48:14.186 INFO:teuthology.orchestra.run.smithi112.stdout: "last_in_change": "2024-09-12T02:41:39.036600+0000", 2024-09-12T02:48:14.186 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:48:14.186 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_num": 5799936, 2024-09-12T02:48:14.186 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_set": [ 2024-09-12T02:48:14.186 INFO:teuthology.orchestra.run.smithi112.stdout: "pglog_hardlimit", 2024-09-12T02:48:14.186 INFO:teuthology.orchestra.run.smithi112.stdout: "purged_snapdirs", 2024-09-12T02:48:14.186 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_deletes", 2024-09-12T02:48:14.186 INFO:teuthology.orchestra.run.smithi112.stdout: "sortbitwise" 2024-09-12T02:48:14.186 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:48:14.186 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_version": 4, 2024-09-12T02:48:14.186 INFO:teuthology.orchestra.run.smithi112.stdout: "full_ratio": 0.69999998807907104, 2024-09-12T02:48:14.186 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-12T02:48:14.187 INFO:teuthology.orchestra.run.smithi112.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-12T02:48:14.187 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_snapshot": "", 2024-09-12T02:48:14.187 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_max": 17, 2024-09-12T02:48:14.187 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd": 8, 2024-09-12T02:48:14.187 INFO:teuthology.orchestra.run.smithi112.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:48:14.187 INFO:teuthology.orchestra.run.smithi112.stdout: "min_compat_client": "jewel", 2024-09-12T02:48:14.187 INFO:teuthology.orchestra.run.smithi112.stdout: "require_osd_release": "squid", 2024-09-12T02:48:14.187 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_crimson": false, 2024-09-12T02:48:14.187 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-12T02:48:14.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.187 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 1, 2024-09-12T02:48:14.187 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": ".mgr", 2024-09-12T02:48:14.187 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:41:43.011599+0000", 2024-09-12T02:48:14.187 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:48:14.188 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:48:14.188 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:48:14.188 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:48:14.188 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:48:14.188 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:48:14.188 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:48:14.188 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:48:14.188 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:48:14.188 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:48:14.188 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:48:14.188 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:48:14.188 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:48:14.188 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 1, 2024-09-12T02:48:14.189 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 1, 2024-09-12T02:48:14.189 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 1, 2024-09-12T02:48:14.189 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 1, 2024-09-12T02:48:14.189 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 1, 2024-09-12T02:48:14.189 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:48:14.189 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:48:14.189 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:48:14.189 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:48:14.189 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:48:14.189 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:48:14.189 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:48:14.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.189 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "109", 2024-09-12T02:48:14.189 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:48:14.190 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:48:14.190 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:48:14.190 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:48:14.190 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:48:14.190 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:48:14.190 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:48:14.190 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:48:14.190 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:48:14.190 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:48:14.190 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:48:14.190 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:48:14.190 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:48:14.190 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:48:14.190 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:48:14.191 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:48:14.191 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:48:14.191 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:48:14.191 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:48:14.191 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:48:14.191 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:48:14.191 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:48:14.191 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:48:14.191 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:48:14.191 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:48:14.191 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:48:14.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.191 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:48:14.191 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:48:14.192 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:48:14.192 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:48:14.192 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:48:14.192 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:48:14.192 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:48:14.192 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:48:14.192 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:48:14.192 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:48:14.192 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:48:14.192 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:48:14.192 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_max": 32, 2024-09-12T02:48:14.192 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 1 2024-09-12T02:48:14.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.192 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:48:14.193 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": {} 2024-09-12T02:48:14.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.193 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:48:14.193 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:48:14.193 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 8, 2024-09-12T02:48:14.193 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 8, 2024-09-12T02:48:14.193 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 0.25, 2024-09-12T02:48:14.193 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:48:14.193 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:48:14.193 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:48:14.193 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:48:14.193 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:48:14.193 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.194 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 16, 2024-09-12T02:48:14.194 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:48:14.194 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:47:55.641315+0000", 2024-09-12T02:48:14.194 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:48:14.194 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:48:14.194 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:48:14.194 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:48:14.194 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:48:14.194 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:48:14.194 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:48:14.194 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:48:14.195 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:48:14.195 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:48:14.195 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:48:14.195 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:48:14.195 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:48:14.195 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 32, 2024-09-12T02:48:14.195 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 32, 2024-09-12T02:48:14.195 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 32, 2024-09-12T02:48:14.195 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 32, 2024-09-12T02:48:14.195 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 32, 2024-09-12T02:48:14.195 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:48:14.195 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:48:14.195 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:48:14.195 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:48:14.196 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:48:14.196 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:48:14.196 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:48:14.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.196 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "134", 2024-09-12T02:48:14.196 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:48:14.196 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:48:14.196 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:48:14.196 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:48:14.196 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:48:14.196 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:48:14.196 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:48:14.196 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:48:14.196 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:48:14.197 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:48:14.197 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:48:14.197 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:48:14.197 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:48:14.197 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:48:14.197 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:48:14.197 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:48:14.197 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:48:14.197 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:48:14.197 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:48:14.197 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:48:14.197 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:48:14.197 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:48:14.197 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:48:14.198 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:48:14.198 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:48:14.198 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:48:14.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.198 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:48:14.198 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:48:14.198 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:48:14.198 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:48:14.198 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:48:14.198 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:48:14.198 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:48:14.198 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:48:14.198 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:48:14.198 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:48:14.199 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:48:14.199 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:48:14.199 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:48:14.199 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 16, 2024-09-12T02:48:14.199 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_priority": 5 2024-09-12T02:48:14.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.199 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:48:14.199 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:48:14.199 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": "cephfs" 2024-09-12T02:48:14.199 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.199 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:48:14.199 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:48:14.199 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.75, 2024-09-12T02:48:14.199 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.75, 2024-09-12T02:48:14.200 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:48:14.200 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.75, 2024-09-12T02:48:14.200 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.75, 2024-09-12T02:48:14.200 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:48:14.200 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:48:14.200 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:48:14.200 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.200 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 17, 2024-09-12T02:48:14.200 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_data", 2024-09-12T02:48:14.200 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:47:56.867038+0000", 2024-09-12T02:48:14.200 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:48:14.200 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:48:14.201 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:48:14.201 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:48:14.201 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:48:14.201 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:48:14.201 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:48:14.201 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:48:14.201 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:48:14.201 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:48:14.201 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:48:14.201 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:48:14.201 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:48:14.201 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 64, 2024-09-12T02:48:14.201 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 64, 2024-09-12T02:48:14.201 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 64, 2024-09-12T02:48:14.202 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 64, 2024-09-12T02:48:14.202 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 64, 2024-09-12T02:48:14.202 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:48:14.202 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:48:14.202 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:48:14.202 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:48:14.202 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:48:14.202 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:48:14.202 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:48:14.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.202 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "136", 2024-09-12T02:48:14.202 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:48:14.202 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:48:14.203 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:48:14.203 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:48:14.203 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:48:14.203 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:48:14.203 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:48:14.203 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:48:14.203 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:48:14.203 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 33554432, 2024-09-12T02:48:14.203 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:48:14.203 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:48:14.203 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:48:14.203 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:48:14.203 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:48:14.204 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:48:14.204 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:48:14.204 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:48:14.204 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:48:14.204 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:48:14.204 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:48:14.204 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:48:14.204 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:48:14.204 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:48:14.204 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:48:14.204 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:48:14.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.204 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:48:14.204 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:48:14.205 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:48:14.205 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:48:14.205 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:48:14.205 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:48:14.205 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:48:14.205 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:48:14.205 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:48:14.205 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:48:14.205 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:48:14.205 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:48:14.205 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 64, 2024-09-12T02:48:14.205 INFO:teuthology.orchestra.run.smithi112.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:48:14.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.205 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:48:14.206 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:48:14.206 INFO:teuthology.orchestra.run.smithi112.stdout: "data": "cephfs" 2024-09-12T02:48:14.206 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.206 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:48:14.206 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:48:14.206 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.75, 2024-09-12T02:48:14.206 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.75, 2024-09-12T02:48:14.206 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:48:14.206 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.75, 2024-09-12T02:48:14.206 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.75, 2024-09-12T02:48:14.206 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:48:14.206 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:48:14.207 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:48:14.207 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.207 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.207 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:48:14.207 INFO:teuthology.orchestra.run.smithi112.stdout: "osds": [ 2024-09-12T02:48:14.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.207 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:48:14.207 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:14.207 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:14.207 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:14.207 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:14.207 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:14.207 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:14.207 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:14.208 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:14.208 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:14.208 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:14.208 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:14.208 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:14.208 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.208 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.208 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6800", 2024-09-12T02:48:14.208 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:14.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.208 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.209 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6801", 2024-09-12T02:48:14.209 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:14.209 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.209 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.209 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:14.209 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.209 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.209 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6802", 2024-09-12T02:48:14.209 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:14.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.210 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.210 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6803", 2024-09-12T02:48:14.210 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:14.210 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.210 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.210 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:14.210 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.210 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.210 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6806", 2024-09-12T02:48:14.210 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:14.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.211 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.211 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6807", 2024-09-12T02:48:14.211 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:14.211 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.211 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.211 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:14.211 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.211 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.211 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6804", 2024-09-12T02:48:14.211 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:14.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.212 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.212 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6805", 2024-09-12T02:48:14.212 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:14.212 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.212 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.212 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6801/821571304", 2024-09-12T02:48:14.212 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6803/821571304", 2024-09-12T02:48:14.212 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6807/821571304", 2024-09-12T02:48:14.212 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6805/821571304", 2024-09-12T02:48:14.212 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:14.212 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:14.212 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:14.212 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.213 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:48:14.213 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:14.213 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:14.213 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:14.213 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:14.213 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:14.213 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:14.213 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:14.213 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:14.213 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:14.213 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:14.213 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:14.214 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:14.214 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.214 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.214 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6808", 2024-09-12T02:48:14.214 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:14.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.214 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.214 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6809", 2024-09-12T02:48:14.214 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:14.214 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.214 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.215 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:14.215 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.215 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.215 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6810", 2024-09-12T02:48:14.215 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:14.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.215 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.215 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6811", 2024-09-12T02:48:14.215 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:14.215 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.215 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.216 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:14.216 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.216 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.216 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6814", 2024-09-12T02:48:14.216 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:14.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.216 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.216 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6815", 2024-09-12T02:48:14.216 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:14.216 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.216 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.217 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:14.217 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.217 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.217 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6812", 2024-09-12T02:48:14.217 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:14.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.217 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.217 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6813", 2024-09-12T02:48:14.217 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:14.217 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.217 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.218 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6809/2642068641", 2024-09-12T02:48:14.218 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6811/2642068641", 2024-09-12T02:48:14.218 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6815/2642068641", 2024-09-12T02:48:14.218 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6813/2642068641", 2024-09-12T02:48:14.218 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:14.218 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:14.218 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:14.218 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.218 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:48:14.218 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:14.218 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:14.218 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:14.219 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:14.219 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:14.219 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:14.219 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:14.219 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:14.219 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:14.219 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:14.219 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:14.219 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:14.219 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.219 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.219 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6816", 2024-09-12T02:48:14.219 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:14.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.220 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.220 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6817", 2024-09-12T02:48:14.220 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:14.220 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.220 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.220 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:14.220 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.220 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.220 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6818", 2024-09-12T02:48:14.221 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:14.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.221 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.221 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6819", 2024-09-12T02:48:14.221 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:14.221 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.221 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.221 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:14.222 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.222 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.222 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6822", 2024-09-12T02:48:14.222 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:14.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.222 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.222 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6823", 2024-09-12T02:48:14.222 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:14.222 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.222 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.223 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:14.223 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.223 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.223 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6820", 2024-09-12T02:48:14.223 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:14.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.223 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.223 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6821", 2024-09-12T02:48:14.223 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:14.223 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.223 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.224 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6817/3365688807", 2024-09-12T02:48:14.224 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6819/3365688807", 2024-09-12T02:48:14.224 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6823/3365688807", 2024-09-12T02:48:14.224 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6821/3365688807", 2024-09-12T02:48:14.224 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:14.224 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:14.224 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:14.224 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.224 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:48:14.224 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:14.224 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:14.225 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:14.225 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:14.225 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:14.225 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:14.225 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:14.225 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:14.225 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:14.225 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:14.225 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:14.225 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:14.225 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.225 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.225 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6824", 2024-09-12T02:48:14.226 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:14.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.226 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.226 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6825", 2024-09-12T02:48:14.226 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:14.226 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.226 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.226 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:14.226 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.226 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.226 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6826", 2024-09-12T02:48:14.227 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:14.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.227 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.227 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6827", 2024-09-12T02:48:14.227 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:14.227 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.227 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.227 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:14.227 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.227 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.227 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6830", 2024-09-12T02:48:14.228 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:14.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.228 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.228 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6831", 2024-09-12T02:48:14.228 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:14.228 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.228 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.228 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:14.228 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.228 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.228 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6828", 2024-09-12T02:48:14.229 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:14.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.229 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.229 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6829", 2024-09-12T02:48:14.229 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:14.229 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.229 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.229 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6825/231774278", 2024-09-12T02:48:14.229 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6827/231774278", 2024-09-12T02:48:14.229 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6831/231774278", 2024-09-12T02:48:14.229 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6829/231774278", 2024-09-12T02:48:14.229 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:14.229 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:14.230 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:14.230 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.230 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:48:14.230 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:14.230 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:14.230 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:14.230 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:14.230 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:14.230 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:14.230 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:14.230 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:14.230 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:14.231 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:14.231 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:14.231 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:14.231 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.231 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.231 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6800", 2024-09-12T02:48:14.231 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:14.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.231 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.231 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6801", 2024-09-12T02:48:14.231 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:14.231 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.232 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.232 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:14.232 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.232 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.232 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6802", 2024-09-12T02:48:14.232 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:14.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.232 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.232 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6803", 2024-09-12T02:48:14.232 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:14.232 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.233 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.233 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:14.233 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.233 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.233 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6806", 2024-09-12T02:48:14.233 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:14.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.233 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.233 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6807", 2024-09-12T02:48:14.233 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:14.233 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.233 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.234 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:14.234 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.234 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.234 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6804", 2024-09-12T02:48:14.234 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:14.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.234 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.234 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6805", 2024-09-12T02:48:14.234 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:14.234 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.234 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.235 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6801/3671178153", 2024-09-12T02:48:14.235 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6803/3671178153", 2024-09-12T02:48:14.235 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6807/3671178153", 2024-09-12T02:48:14.235 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6805/3671178153", 2024-09-12T02:48:14.235 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:14.235 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:14.235 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:14.235 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.235 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:48:14.235 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:14.235 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:14.235 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:14.236 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:14.236 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:14.236 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:14.236 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:14.236 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:14.236 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:14.236 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:14.236 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:14.236 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:14.236 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.236 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.236 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6808", 2024-09-12T02:48:14.236 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:14.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.237 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.237 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6809", 2024-09-12T02:48:14.237 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:14.237 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.237 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.237 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:14.237 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.238 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.238 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6810", 2024-09-12T02:48:14.238 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:14.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.238 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.238 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6811", 2024-09-12T02:48:14.238 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:14.238 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.238 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.238 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:14.238 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.239 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.239 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6817", 2024-09-12T02:48:14.239 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:14.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.239 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.239 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6819", 2024-09-12T02:48:14.239 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:14.239 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.239 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.239 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:14.239 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.240 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.240 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6812", 2024-09-12T02:48:14.240 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:14.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.240 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.240 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6815", 2024-09-12T02:48:14.240 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:14.240 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.240 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.240 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6809/3193706134", 2024-09-12T02:48:14.241 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6811/3193706134", 2024-09-12T02:48:14.241 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6819/3193706134", 2024-09-12T02:48:14.241 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6815/3193706134", 2024-09-12T02:48:14.241 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:14.241 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:14.241 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:14.241 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.241 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:48:14.241 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:14.241 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:14.241 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:14.241 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:14.242 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:14.242 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:14.242 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:14.242 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:14.242 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:14.242 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:14.242 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:14.242 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:14.242 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.242 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.242 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6813", 2024-09-12T02:48:14.242 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:14.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.243 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.243 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6814", 2024-09-12T02:48:14.243 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:14.243 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.243 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.243 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:14.243 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.243 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.243 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6816", 2024-09-12T02:48:14.243 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:14.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.244 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.244 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6818", 2024-09-12T02:48:14.244 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:14.244 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.244 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.244 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:14.244 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.244 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.244 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6822", 2024-09-12T02:48:14.244 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:14.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.245 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.245 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6823", 2024-09-12T02:48:14.245 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:14.245 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.245 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.245 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:14.245 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.245 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.245 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6820", 2024-09-12T02:48:14.245 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:14.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.246 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.246 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6821", 2024-09-12T02:48:14.246 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:14.246 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.246 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.246 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6814/3738813293", 2024-09-12T02:48:14.246 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6818/3738813293", 2024-09-12T02:48:14.246 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6823/3738813293", 2024-09-12T02:48:14.246 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6821/3738813293", 2024-09-12T02:48:14.246 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:14.246 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:14.247 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:14.247 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.247 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:48:14.247 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:14.247 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:14.247 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:14.247 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:14.247 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:14.247 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:14.247 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:14.247 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:14.247 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:14.247 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:14.248 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:14.248 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:14.248 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.248 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.248 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6824", 2024-09-12T02:48:14.248 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:14.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.248 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.248 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6825", 2024-09-12T02:48:14.248 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:14.248 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.249 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.249 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:14.249 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.249 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.249 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6826", 2024-09-12T02:48:14.249 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:14.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.249 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.249 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6827", 2024-09-12T02:48:14.249 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:14.249 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.250 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.250 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:14.250 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.250 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.250 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6830", 2024-09-12T02:48:14.250 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:14.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.250 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.250 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6831", 2024-09-12T02:48:14.250 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:14.250 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.251 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.251 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:14.251 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:14.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.251 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:14.251 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6828", 2024-09-12T02:48:14.251 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:14.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.251 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:14.251 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6829", 2024-09-12T02:48:14.251 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:14.251 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.252 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.252 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6825/1421932609", 2024-09-12T02:48:14.252 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6827/1421932609", 2024-09-12T02:48:14.252 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6831/1421932609", 2024-09-12T02:48:14.252 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6829/1421932609", 2024-09-12T02:48:14.252 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:14.252 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:14.252 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:14.252 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:14.252 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.252 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:48:14.252 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_xinfo": [ 2024-09-12T02:48:14.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.253 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:48:14.253 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:14.253 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:14.253 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:14.253 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:14.253 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:14.253 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.220641+0000", 2024-09-12T02:48:14.253 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:14.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.253 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:48:14.253 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:14.253 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:14.254 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:14.254 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:14.254 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:14.254 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312574+0000", 2024-09-12T02:48:14.254 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:14.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.254 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:48:14.254 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:14.254 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:14.254 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:14.254 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:14.254 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:14.254 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.282771+0000", 2024-09-12T02:48:14.255 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:14.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.255 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:48:14.255 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:14.255 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:14.255 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:14.255 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:14.255 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:14.255 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.260478+0000", 2024-09-12T02:48:14.255 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:14.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.255 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:48:14.256 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:14.256 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:14.256 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:14.256 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:14.256 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:14.256 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.273397+0000", 2024-09-12T02:48:14.256 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:14.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.256 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:48:14.256 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:14.256 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:14.256 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:14.256 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:14.257 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:14.257 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312452+0000", 2024-09-12T02:48:14.257 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:14.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.257 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:48:14.257 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:14.257 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:14.257 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:14.257 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:14.257 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:14.257 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.308965+0000", 2024-09-12T02:48:14.257 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:14.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:14.258 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:48:14.258 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:14.258 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:14.258 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:14.258 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:14.258 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:14.258 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.337842+0000", 2024-09-12T02:48:14.258 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:14.258 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.258 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:48:14.258 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap": [], 2024-09-12T02:48:14.258 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_items": [], 2024-09-12T02:48:14.258 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_primaries": [], 2024-09-12T02:48:14.259 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_temp": [], 2024-09-12T02:48:14.259 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_temp": [], 2024-09-12T02:48:14.259 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklist": {}, 2024-09-12T02:48:14.259 INFO:teuthology.orchestra.run.smithi112.stdout: "range_blocklist": {}, 2024-09-12T02:48:14.259 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profiles": { 2024-09-12T02:48:14.259 INFO:teuthology.orchestra.run.smithi112.stdout: "default": { 2024-09-12T02:48:14.259 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-failure-domain": "osd", 2024-09-12T02:48:14.259 INFO:teuthology.orchestra.run.smithi112.stdout: "k": "2", 2024-09-12T02:48:14.259 INFO:teuthology.orchestra.run.smithi112.stdout: "m": "1", 2024-09-12T02:48:14.259 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin": "jerasure", 2024-09-12T02:48:14.259 INFO:teuthology.orchestra.run.smithi112.stdout: "technique": "reed_sol_van" 2024-09-12T02:48:14.259 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:14.259 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps_queue": [], 2024-09-12T02:48:14.260 INFO:teuthology.orchestra.run.smithi112.stdout: "new_removed_snaps": [], 2024-09-12T02:48:14.260 INFO:teuthology.orchestra.run.smithi112.stdout: "new_purged_snaps": [], 2024-09-12T02:48:14.260 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_node_flags": {}, 2024-09-12T02:48:14.260 INFO:teuthology.orchestra.run.smithi112.stdout: "device_class_flags": {}, 2024-09-12T02:48:14.260 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode": { 2024-09-12T02:48:14.260 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_enabled": false, 2024-09-12T02:48:14.260 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_bucket_count": 0, 2024-09-12T02:48:14.260 INFO:teuthology.orchestra.run.smithi112.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:48:14.260 INFO:teuthology.orchestra.run.smithi112.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:48:14.260 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_bucket": 0 2024-09-12T02:48:14.260 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:14.260 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:48:14.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:14.186+0000 7fcacda00640 1 -- 172.21.15.112:0/3002948822 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcaa406be30 msgr2=0x7fcaa406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:14.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:14.186+0000 7fcacda00640 1 --2- 172.21.15.112:0/3002948822 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcaa406be30 0x7fcaa406e2f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fcab0033000 tx=0x7fcab002e000 comp rx=0 tx=0).stop 2024-09-12T02:48:14.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:14.186+0000 7fcacda00640 1 -- 172.21.15.112:0/3002948822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcac8071530 msgr2=0x7fcac8157ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:14.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:14.186+0000 7fcacda00640 1 --2- 172.21.15.112:0/3002948822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcac8071530 0x7fcac8157ca0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fcab800c3c0 tx=0x7fcab800c880 comp rx=0 tx=0).stop 2024-09-12T02:48:14.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:14.186+0000 7fcacda00640 1 -- 172.21.15.112:0/3002948822 shutdown_connections 2024-09-12T02:48:14.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:14.186+0000 7fcacda00640 1 --2- 172.21.15.112:0/3002948822 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcaa406be30 0x7fcaa406e2f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:14.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:14.186+0000 7fcacda00640 1 --2- 172.21.15.112:0/3002948822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcac815cc50 0x7fcac81530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:14.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:14.186+0000 7fcacda00640 1 --2- 172.21.15.112:0/3002948822 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcac80719a0 0x7fcac81581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:14.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:14.186+0000 7fcacda00640 1 --2- 172.21.15.112:0/3002948822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcac8071530 0x7fcac8157ca0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:14.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:14.186+0000 7fcacda00640 1 -- 172.21.15.112:0/3002948822 >> 172.21.15.112:0/3002948822 conn(0x7fcac806bbd0 msgr2=0x7fcac815bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:14.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:14.186+0000 7fcacda00640 1 -- 172.21.15.112:0/3002948822 shutdown_connections 2024-09-12T02:48:14.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:14.186+0000 7fcacda00640 1 -- 172.21.15.112:0/3002948822 wait complete. 2024-09-12T02:48:14.263 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-12T02:48:19.265 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-12T02:48:19.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.426+0000 7f43ef200640 1 Processor -- start 2024-09-12T02:48:19.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.426+0000 7f43ef200640 1 -- start start 2024-09-12T02:48:19.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.427+0000 7f43ef200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f43f00d1710 0x7f43f00d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:19.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.427+0000 7f43ef200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f43f00b3e00 0x7f43f00d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:19.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.427+0000 7f43ef200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43f00d2fb0 con 0x7f43f00cf7a0 2024-09-12T02:48:19.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.427+0000 7f43ef200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f43f00d3cb0 con 0x7f43f00b3e00 2024-09-12T02:48:19.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.427+0000 7f43ef200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f43f00d0b60 con 0x7f43f00d1710 2024-09-12T02:48:19.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.427+0000 7f43ed400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f43f00b3e00 0x7f43f00d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:19.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.427+0000 7f43ed400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f43f00b3e00 0x7f43f00d1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41552/0 (socket says 172.21.15.112:41552) 2024-09-12T02:48:19.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.427+0000 7f43ed400640 1 -- 172.21.15.112:0/734899428 learned_addr learned my addr 172.21.15.112:0/734899428 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:19.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.428+0000 7f43ede00640 1 --2- 172.21.15.112:0/734899428 >> v2:172.21.15.137:3300/0 conn(0x7f43f00d1710 0x7f43f00d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:19.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.428+0000 7f43ed400640 1 -- 172.21.15.112:0/734899428 >> v2:172.21.15.137:3300/0 conn(0x7f43f00d1710 msgr2=0x7f43f00d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:19.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.428+0000 7f43ed400640 1 --2- 172.21.15.112:0/734899428 >> v2:172.21.15.137:3300/0 conn(0x7f43f00d1710 0x7f43f00d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.428+0000 7f43ed400640 1 -- 172.21.15.112:0/734899428 >> v1:172.21.15.137:6789/0 conn(0x7f43f00cf7a0 legacy=0x7f43f00cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:19.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.428+0000 7f43ed400640 1 -- 172.21.15.112:0/734899428 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f00d2030 con 0x7f43f00b3e00 2024-09-12T02:48:19.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.429+0000 7f43ed400640 1 --2- 172.21.15.112:0/734899428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43f00b3e00 0x7f43f00d1af0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f43f008dd50 tx=0x7f43dc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b2e90a32fad62b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:19.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.429+0000 7f43eca00640 1 -- 172.21.15.112:0/734899428 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43dc037070 con 0x7f43f00b3e00 2024-09-12T02:48:19.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.429+0000 7f43eca00640 1 -- 172.21.15.112:0/734899428 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43dc032440 con 0x7f43f00b3e00 2024-09-12T02:48:19.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.429+0000 7f43eca00640 1 -- 172.21.15.112:0/734899428 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43dc032810 con 0x7f43f00b3e00 2024-09-12T02:48:19.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.430+0000 7f43ef200640 1 -- 172.21.15.112:0/734899428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43f00b3e00 msgr2=0x7f43f00d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:19.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.430+0000 7f43ef200640 1 --2- 172.21.15.112:0/734899428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43f00b3e00 0x7f43f00d1af0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f43f008dd50 tx=0x7f43dc02a270 comp rx=0 tx=0).stop 2024-09-12T02:48:19.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.430+0000 7f43ef200640 1 -- 172.21.15.112:0/734899428 shutdown_connections 2024-09-12T02:48:19.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.430+0000 7f43ef200640 1 --2- 172.21.15.112:0/734899428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43f00b3e00 0x7f43f00d1af0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.430+0000 7f43ef200640 1 --2- 172.21.15.112:0/734899428 >> v2:172.21.15.137:3300/0 conn(0x7f43f00d1710 0x7f43f00d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.430+0000 7f43ef200640 1 -- 172.21.15.112:0/734899428 >> 172.21.15.112:0/734899428 conn(0x7f43f009e030 msgr2=0x7f43f00d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:19.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.430+0000 7f43ef200640 1 -- 172.21.15.112:0/734899428 shutdown_connections 2024-09-12T02:48:19.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.430+0000 7f43ef200640 1 -- 172.21.15.112:0/734899428 wait complete. 2024-09-12T02:48:19.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.431+0000 7f43ef200640 1 Processor -- start 2024-09-12T02:48:19.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.432+0000 7f43ef200640 1 -- start start 2024-09-12T02:48:19.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.432+0000 7f43ef200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43f00b3e00 0x7f43f01f47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:19.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.432+0000 7f43ef200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43f00cf7a0 0x7f43f014ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:19.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.432+0000 7f43ef200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43f00d1710 0x7f43f014bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:19.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.432+0000 7f43ef200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f43f00d39d0 con 0x7f43f00d1710 2024-09-12T02:48:19.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.432+0000 7f43ef200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f43f00d36f0 con 0x7f43f00b3e00 2024-09-12T02:48:19.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.432+0000 7f43ef200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f43f015f110 con 0x7f43f00cf7a0 2024-09-12T02:48:19.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.433+0000 7f43ee800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43f00d1710 0x7f43f014bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:19.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.433+0000 7f43ede00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43f00b3e00 0x7f43f01f47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:19.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.433+0000 7f43ee800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43f00d1710 0x7f43f014bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41566/0 (socket says 172.21.15.112:41566) 2024-09-12T02:48:19.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.433+0000 7f43ee800640 1 -- 172.21.15.112:0/648481441 learned_addr learned my addr 172.21.15.112:0/648481441 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:19.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.433+0000 7f43ed400640 1 --2- 172.21.15.112:0/648481441 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43f00cf7a0 0x7f43f014ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:19.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.433+0000 7f43ee800640 1 -- 172.21.15.112:0/648481441 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43f00cf7a0 msgr2=0x7f43f014ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:19.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.433+0000 7f43ee800640 1 --2- 172.21.15.112:0/648481441 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43f00cf7a0 0x7f43f014ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.433+0000 7f43ee800640 1 -- 172.21.15.112:0/648481441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43f00b3e00 msgr2=0x7f43f01f47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:19.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.433+0000 7f43ee800640 1 --2- 172.21.15.112:0/648481441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43f00b3e00 0x7f43f01f47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.433+0000 7f43ee800640 1 -- 172.21.15.112:0/648481441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f014f4c0 con 0x7f43f00d1710 2024-09-12T02:48:19.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.433+0000 7f43ee800640 1 --2- 172.21.15.112:0/648481441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43f00d1710 0x7f43f014bcc0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f43e8001eb0 tx=0x7f43e800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:19.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.434+0000 7f43e6000640 1 -- 172.21.15.112:0/648481441 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e8017070 con 0x7f43f00d1710 2024-09-12T02:48:19.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.434+0000 7f43e6000640 1 -- 172.21.15.112:0/648481441 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e80052d0 con 0x7f43f00d1710 2024-09-12T02:48:19.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.434+0000 7f43ef200640 1 -- 172.21.15.112:0/648481441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43f014c200 con 0x7f43f00d1710 2024-09-12T02:48:19.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.434+0000 7f43e6000640 1 -- 172.21.15.112:0/648481441 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e8003810 con 0x7f43f00d1710 2024-09-12T02:48:19.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.434+0000 7f43ef200640 1 -- 172.21.15.112:0/648481441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43f01f5110 con 0x7f43f00d1710 2024-09-12T02:48:19.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.435+0000 7f43ef200640 1 -- 172.21.15.112:0/648481441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43f00d1af0 con 0x7f43f00d1710 2024-09-12T02:48:19.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.436+0000 7f43e6000640 1 -- 172.21.15.112:0/648481441 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f43e801a070 con 0x7f43f00d1710 2024-09-12T02:48:19.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.437+0000 7f43e6000640 1 --2- 172.21.15.112:0/648481441 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f43d006be60 0x7f43d006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:19.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.437+0000 7f43e6000640 1 -- 172.21.15.112:0/648481441 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f43e808a180 con 0x7f43f00d1710 2024-09-12T02:48:19.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.437+0000 7f43ede00640 1 --2- 172.21.15.112:0/648481441 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f43d006be60 0x7f43d006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:19.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.437+0000 7f43ede00640 1 --2- 172.21.15.112:0/648481441 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f43d006be60 0x7f43d006e320 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f43f01f23b0 tx=0x7f43e00098d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:19.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.441+0000 7f43e6000640 1 -- 172.21.15.112:0/648481441 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f43f014c200 con 0x7f43f00d1710 2024-09-12T02:48:19.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.616+0000 7f43ef200640 1 -- 172.21.15.112:0/648481441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f43f006cfc0 con 0x7f43f00d1710 2024-09-12T02:48:19.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.617+0000 7f43e6000640 1 -- 172.21.15.112:0/648481441 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v136) ==== 81+0+34274 (secure 0 0 0) 0x7f43f014f4c0 con 0x7f43f00d1710 2024-09-12T02:48:19.618 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:19.619 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:48:19.619 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 136, 2024-09-12T02:48:19.619 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:48:19.619 INFO:teuthology.orchestra.run.smithi112.stdout: "created": "2024-09-12T02:41:36.162095+0000", 2024-09-12T02:48:19.619 INFO:teuthology.orchestra.run.smithi112.stdout: "modified": "2024-09-12T02:48:13.146650+0000", 2024-09-12T02:48:19.619 INFO:teuthology.orchestra.run.smithi112.stdout: "last_up_change": "2024-09-12T02:41:42.191169+0000", 2024-09-12T02:48:19.619 INFO:teuthology.orchestra.run.smithi112.stdout: "last_in_change": "2024-09-12T02:41:39.036600+0000", 2024-09-12T02:48:19.619 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:48:19.619 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_num": 5799936, 2024-09-12T02:48:19.619 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_set": [ 2024-09-12T02:48:19.619 INFO:teuthology.orchestra.run.smithi112.stdout: "pglog_hardlimit", 2024-09-12T02:48:19.619 INFO:teuthology.orchestra.run.smithi112.stdout: "purged_snapdirs", 2024-09-12T02:48:19.619 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_deletes", 2024-09-12T02:48:19.619 INFO:teuthology.orchestra.run.smithi112.stdout: "sortbitwise" 2024-09-12T02:48:19.620 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:48:19.620 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_version": 4, 2024-09-12T02:48:19.620 INFO:teuthology.orchestra.run.smithi112.stdout: "full_ratio": 0.69999998807907104, 2024-09-12T02:48:19.620 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-12T02:48:19.620 INFO:teuthology.orchestra.run.smithi112.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-12T02:48:19.620 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_snapshot": "", 2024-09-12T02:48:19.620 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_max": 17, 2024-09-12T02:48:19.620 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd": 8, 2024-09-12T02:48:19.620 INFO:teuthology.orchestra.run.smithi112.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:48:19.620 INFO:teuthology.orchestra.run.smithi112.stdout: "min_compat_client": "jewel", 2024-09-12T02:48:19.620 INFO:teuthology.orchestra.run.smithi112.stdout: "require_osd_release": "squid", 2024-09-12T02:48:19.620 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_crimson": false, 2024-09-12T02:48:19.620 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-12T02:48:19.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.621 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 1, 2024-09-12T02:48:19.621 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": ".mgr", 2024-09-12T02:48:19.621 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:41:43.011599+0000", 2024-09-12T02:48:19.621 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:48:19.621 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:48:19.621 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:48:19.621 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:48:19.621 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:48:19.621 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:48:19.621 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:48:19.622 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:48:19.622 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:48:19.622 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:48:19.622 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:48:19.622 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:48:19.622 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:48:19.622 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 1, 2024-09-12T02:48:19.622 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 1, 2024-09-12T02:48:19.622 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 1, 2024-09-12T02:48:19.622 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 1, 2024-09-12T02:48:19.622 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 1, 2024-09-12T02:48:19.622 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:48:19.622 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:48:19.622 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:48:19.623 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:48:19.623 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:48:19.623 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:48:19.623 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:48:19.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.623 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "109", 2024-09-12T02:48:19.623 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:48:19.623 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:48:19.623 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:48:19.623 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:48:19.623 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:48:19.623 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:48:19.623 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:48:19.624 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:48:19.624 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:48:19.624 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:48:19.624 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:48:19.624 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:48:19.624 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:48:19.624 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:48:19.624 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:48:19.624 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:48:19.624 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:48:19.624 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:48:19.624 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:48:19.624 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:48:19.625 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:48:19.625 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:48:19.625 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:48:19.625 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:48:19.625 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:48:19.625 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:48:19.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.625 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:48:19.625 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:48:19.625 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:48:19.625 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:48:19.625 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:48:19.625 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:48:19.625 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:48:19.626 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:48:19.626 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:48:19.626 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:48:19.626 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:48:19.626 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:48:19.626 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_max": 32, 2024-09-12T02:48:19.626 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 1 2024-09-12T02:48:19.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.626 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:48:19.626 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": {} 2024-09-12T02:48:19.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.626 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:48:19.626 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:48:19.626 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 8, 2024-09-12T02:48:19.627 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 8, 2024-09-12T02:48:19.627 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 0.25, 2024-09-12T02:48:19.627 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:48:19.627 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:48:19.627 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:48:19.627 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:48:19.627 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:48:19.627 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.627 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.627 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 16, 2024-09-12T02:48:19.627 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:48:19.627 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:47:55.641315+0000", 2024-09-12T02:48:19.628 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:48:19.628 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:48:19.628 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:48:19.628 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:48:19.628 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:48:19.628 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:48:19.628 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:48:19.628 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:48:19.628 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:48:19.628 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:48:19.628 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:48:19.628 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:48:19.628 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:48:19.628 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 32, 2024-09-12T02:48:19.629 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 32, 2024-09-12T02:48:19.629 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 32, 2024-09-12T02:48:19.629 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 32, 2024-09-12T02:48:19.629 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 32, 2024-09-12T02:48:19.629 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:48:19.629 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:48:19.629 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:48:19.629 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:48:19.629 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:48:19.629 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:48:19.629 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:48:19.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.629 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "134", 2024-09-12T02:48:19.630 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:48:19.630 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:48:19.630 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:48:19.630 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:48:19.630 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:48:19.630 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:48:19.630 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:48:19.630 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:48:19.630 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:48:19.630 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:48:19.630 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:48:19.630 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:48:19.630 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:48:19.630 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:48:19.631 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:48:19.631 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:48:19.631 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:48:19.631 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:48:19.631 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:48:19.631 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:48:19.631 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:48:19.631 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:48:19.631 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:48:19.631 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:48:19.631 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:48:19.631 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:48:19.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.631 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:48:19.632 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:48:19.632 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:48:19.632 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:48:19.632 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:48:19.632 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:48:19.633 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:48:19.633 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:48:19.633 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:48:19.633 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:48:19.633 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:48:19.633 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:48:19.633 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:48:19.633 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 16, 2024-09-12T02:48:19.633 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_priority": 5 2024-09-12T02:48:19.633 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.634 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:48:19.634 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:48:19.634 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": "cephfs" 2024-09-12T02:48:19.634 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.634 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:48:19.634 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:48:19.634 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.75, 2024-09-12T02:48:19.634 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.75, 2024-09-12T02:48:19.634 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:48:19.634 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.75, 2024-09-12T02:48:19.634 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.75, 2024-09-12T02:48:19.634 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:48:19.635 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:48:19.635 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:48:19.635 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.635 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 17, 2024-09-12T02:48:19.635 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_data", 2024-09-12T02:48:19.635 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:47:56.867038+0000", 2024-09-12T02:48:19.635 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:48:19.635 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:48:19.635 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:48:19.635 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:48:19.635 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:48:19.635 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:48:19.636 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:48:19.636 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:48:19.636 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:48:19.636 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:48:19.636 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:48:19.636 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:48:19.636 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:48:19.636 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 64, 2024-09-12T02:48:19.636 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 64, 2024-09-12T02:48:19.636 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 64, 2024-09-12T02:48:19.636 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 64, 2024-09-12T02:48:19.637 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 64, 2024-09-12T02:48:19.637 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:48:19.637 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:48:19.637 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:48:19.637 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:48:19.637 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:48:19.637 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:48:19.637 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:48:19.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.637 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "136", 2024-09-12T02:48:19.637 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:48:19.637 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:48:19.638 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:48:19.638 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:48:19.638 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:48:19.638 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:48:19.639 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:48:19.639 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:48:19.639 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:48:19.640 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 33554432, 2024-09-12T02:48:19.640 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:48:19.640 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:48:19.640 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:48:19.640 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:48:19.640 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:48:19.640 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:48:19.640 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:48:19.640 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:48:19.641 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:48:19.641 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:48:19.641 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:48:19.641 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:48:19.641 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:48:19.642 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:48:19.642 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:48:19.642 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:48:19.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.642 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:48:19.642 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:48:19.642 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:48:19.642 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:48:19.643 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:48:19.643 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:48:19.643 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:48:19.643 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:48:19.643 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:48:19.643 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:48:19.643 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:48:19.643 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:48:19.643 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 64, 2024-09-12T02:48:19.644 INFO:teuthology.orchestra.run.smithi112.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:48:19.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.644 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:48:19.644 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:48:19.644 INFO:teuthology.orchestra.run.smithi112.stdout: "data": "cephfs" 2024-09-12T02:48:19.644 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.644 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:48:19.644 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:48:19.645 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.75, 2024-09-12T02:48:19.645 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.75, 2024-09-12T02:48:19.645 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:48:19.645 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.75, 2024-09-12T02:48:19.645 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.75, 2024-09-12T02:48:19.645 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:48:19.646 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:48:19.646 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:48:19.646 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.646 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.646 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:48:19.646 INFO:teuthology.orchestra.run.smithi112.stdout: "osds": [ 2024-09-12T02:48:19.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.647 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:48:19.647 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:19.647 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:19.647 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:19.647 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:19.648 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:19.648 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:19.648 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:19.648 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:19.648 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:19.648 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:19.649 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:19.649 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:19.649 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.649 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.649 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6800", 2024-09-12T02:48:19.650 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:19.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.650 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.650 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6801", 2024-09-12T02:48:19.650 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:19.651 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.651 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.651 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:19.651 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.652 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.652 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6802", 2024-09-12T02:48:19.652 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:19.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.653 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.653 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6803", 2024-09-12T02:48:19.653 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:19.653 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.653 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.654 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:19.654 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.654 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.654 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6806", 2024-09-12T02:48:19.655 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:19.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.655 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.655 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6807", 2024-09-12T02:48:19.655 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:19.656 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.656 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.656 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:19.656 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.656 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.656 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6804", 2024-09-12T02:48:19.656 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:19.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.656 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.656 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6805", 2024-09-12T02:48:19.656 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:19.657 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.657 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.657 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6801/821571304", 2024-09-12T02:48:19.657 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6803/821571304", 2024-09-12T02:48:19.657 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6807/821571304", 2024-09-12T02:48:19.657 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6805/821571304", 2024-09-12T02:48:19.657 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:19.657 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:19.657 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:19.657 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.657 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:48:19.658 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:19.658 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:19.658 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:19.658 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:19.658 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:19.658 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:19.658 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:19.658 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:19.658 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:19.658 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:19.658 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:19.658 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:19.658 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.659 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.659 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6808", 2024-09-12T02:48:19.659 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:19.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.659 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.659 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6809", 2024-09-12T02:48:19.659 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:19.659 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.659 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.659 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:19.659 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.659 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.660 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6810", 2024-09-12T02:48:19.660 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:19.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.660 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.660 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6811", 2024-09-12T02:48:19.660 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:19.660 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.660 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.660 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:19.660 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.660 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.661 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6814", 2024-09-12T02:48:19.661 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:19.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.661 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.661 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6815", 2024-09-12T02:48:19.661 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:19.661 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.661 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.661 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:19.661 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.661 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.662 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6812", 2024-09-12T02:48:19.662 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:19.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.662 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.662 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6813", 2024-09-12T02:48:19.662 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:19.662 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.662 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.662 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6809/2642068641", 2024-09-12T02:48:19.662 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6811/2642068641", 2024-09-12T02:48:19.662 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6815/2642068641", 2024-09-12T02:48:19.662 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6813/2642068641", 2024-09-12T02:48:19.663 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:19.663 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:19.663 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:19.663 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.663 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:48:19.663 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:19.663 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:19.663 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:19.663 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:19.663 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:19.663 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:19.663 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:19.663 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:19.664 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:19.664 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:19.664 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:19.664 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:19.664 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.664 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.664 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6816", 2024-09-12T02:48:19.664 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:19.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.664 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.664 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6817", 2024-09-12T02:48:19.664 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:19.665 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.665 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.665 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:19.665 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.665 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.665 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6818", 2024-09-12T02:48:19.665 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:19.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.665 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.665 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6819", 2024-09-12T02:48:19.665 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:19.666 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.666 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.666 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:19.666 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.666 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.666 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6822", 2024-09-12T02:48:19.666 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:19.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.666 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.666 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6823", 2024-09-12T02:48:19.666 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:19.667 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.667 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.667 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:19.667 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.667 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.667 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6820", 2024-09-12T02:48:19.667 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:19.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.667 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.667 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6821", 2024-09-12T02:48:19.667 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:19.668 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.668 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.668 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6817/3365688807", 2024-09-12T02:48:19.668 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6819/3365688807", 2024-09-12T02:48:19.668 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6823/3365688807", 2024-09-12T02:48:19.668 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6821/3365688807", 2024-09-12T02:48:19.668 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:19.668 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:19.668 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:19.668 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.669 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:48:19.669 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:19.669 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:19.669 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:19.669 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:19.669 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:19.669 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:19.669 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:19.669 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:19.669 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:19.669 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:19.669 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:19.669 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:19.669 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.670 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.670 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6824", 2024-09-12T02:48:19.670 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:19.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.670 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.670 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6825", 2024-09-12T02:48:19.670 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:19.670 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.670 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.670 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:19.670 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.671 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.671 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6826", 2024-09-12T02:48:19.671 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:19.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.671 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.671 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6827", 2024-09-12T02:48:19.671 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:19.671 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.671 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.671 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:19.671 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.671 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.672 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6830", 2024-09-12T02:48:19.672 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:19.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.672 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.672 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6831", 2024-09-12T02:48:19.672 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:19.672 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.672 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.672 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:19.672 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.672 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.673 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6828", 2024-09-12T02:48:19.673 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:19.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.673 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.673 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6829", 2024-09-12T02:48:19.673 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:19.673 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.673 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.673 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6825/231774278", 2024-09-12T02:48:19.673 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6827/231774278", 2024-09-12T02:48:19.673 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6831/231774278", 2024-09-12T02:48:19.673 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6829/231774278", 2024-09-12T02:48:19.673 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:19.674 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:19.674 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:19.674 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.674 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:48:19.674 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:19.674 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:19.674 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:19.674 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:19.674 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:19.674 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:19.674 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:19.674 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:19.675 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:19.675 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:19.675 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:19.675 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:19.675 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.675 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.675 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6800", 2024-09-12T02:48:19.675 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:19.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.675 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.675 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6801", 2024-09-12T02:48:19.675 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:19.675 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.676 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.676 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:19.676 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.676 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.676 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6802", 2024-09-12T02:48:19.676 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:19.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.676 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.676 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6803", 2024-09-12T02:48:19.676 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:19.676 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.677 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.677 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:19.677 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.677 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.677 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6806", 2024-09-12T02:48:19.677 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:19.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.677 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.677 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6807", 2024-09-12T02:48:19.677 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:19.677 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.678 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.678 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:19.678 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.678 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.678 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6804", 2024-09-12T02:48:19.678 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:19.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.678 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.678 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6805", 2024-09-12T02:48:19.678 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:19.678 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.678 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.679 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6801/3671178153", 2024-09-12T02:48:19.679 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6803/3671178153", 2024-09-12T02:48:19.679 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6807/3671178153", 2024-09-12T02:48:19.679 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6805/3671178153", 2024-09-12T02:48:19.679 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:19.679 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:19.679 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:19.679 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.679 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:48:19.679 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:19.679 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:19.680 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:19.680 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:19.680 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:19.680 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:19.680 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:19.680 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:19.680 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:19.680 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:19.680 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:19.680 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:19.680 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.680 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.680 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6808", 2024-09-12T02:48:19.681 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:19.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.681 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.681 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6809", 2024-09-12T02:48:19.681 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:19.681 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.681 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.681 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:19.681 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.681 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.681 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6810", 2024-09-12T02:48:19.682 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:19.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.682 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.682 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6811", 2024-09-12T02:48:19.682 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:19.682 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.682 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.682 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:19.682 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.682 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.683 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6817", 2024-09-12T02:48:19.683 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:19.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.683 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.683 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6819", 2024-09-12T02:48:19.683 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:19.683 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.683 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.683 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:19.683 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.683 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.683 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6812", 2024-09-12T02:48:19.684 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:19.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.684 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.684 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6815", 2024-09-12T02:48:19.684 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:19.684 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.684 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.684 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6809/3193706134", 2024-09-12T02:48:19.684 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6811/3193706134", 2024-09-12T02:48:19.684 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6819/3193706134", 2024-09-12T02:48:19.684 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6815/3193706134", 2024-09-12T02:48:19.685 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:19.685 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:19.685 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:19.685 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.685 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:48:19.685 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:19.685 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:19.685 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:19.685 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:19.685 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:19.685 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:19.685 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:19.685 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:19.686 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:19.686 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:19.686 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:19.686 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:19.686 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.686 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.686 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6813", 2024-09-12T02:48:19.686 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:19.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.686 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.686 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6814", 2024-09-12T02:48:19.686 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:19.687 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.687 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.687 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:19.687 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.687 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.687 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6816", 2024-09-12T02:48:19.687 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:19.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.687 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.687 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6818", 2024-09-12T02:48:19.687 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:19.687 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.688 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.688 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:19.688 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.688 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.688 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6822", 2024-09-12T02:48:19.688 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:19.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.688 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.688 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6823", 2024-09-12T02:48:19.688 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:19.689 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.689 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.689 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:19.689 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.689 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.689 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6820", 2024-09-12T02:48:19.689 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:19.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.689 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.689 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6821", 2024-09-12T02:48:19.689 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:19.689 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.690 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.690 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6814/3738813293", 2024-09-12T02:48:19.690 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6818/3738813293", 2024-09-12T02:48:19.690 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6823/3738813293", 2024-09-12T02:48:19.690 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6821/3738813293", 2024-09-12T02:48:19.690 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:19.690 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:19.690 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:19.690 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.690 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:48:19.690 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:19.691 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:19.691 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:19.691 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:19.691 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:19.691 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:19.691 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:19.691 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:19.691 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:19.691 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:19.691 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:19.691 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:19.691 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.691 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.691 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6824", 2024-09-12T02:48:19.692 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:19.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.692 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.692 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6825", 2024-09-12T02:48:19.692 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:19.692 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.692 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.692 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:19.692 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.692 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.692 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6826", 2024-09-12T02:48:19.693 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:19.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.693 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.693 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6827", 2024-09-12T02:48:19.693 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:19.693 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.693 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.693 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:19.693 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.693 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.693 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6830", 2024-09-12T02:48:19.694 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:19.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.694 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.694 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6831", 2024-09-12T02:48:19.694 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:19.694 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.694 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.694 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:19.694 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:19.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.694 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:19.694 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6828", 2024-09-12T02:48:19.695 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:19.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.695 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:19.695 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6829", 2024-09-12T02:48:19.695 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:19.695 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.695 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.695 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6825/1421932609", 2024-09-12T02:48:19.695 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6827/1421932609", 2024-09-12T02:48:19.695 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6831/1421932609", 2024-09-12T02:48:19.695 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6829/1421932609", 2024-09-12T02:48:19.695 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:19.695 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:19.696 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:19.696 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:19.696 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.696 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:48:19.696 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_xinfo": [ 2024-09-12T02:48:19.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.696 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:48:19.696 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:19.696 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:19.696 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:19.696 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:19.696 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:19.696 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.220641+0000", 2024-09-12T02:48:19.696 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:19.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.697 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:48:19.697 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:19.697 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:19.697 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:19.697 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:19.697 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:19.697 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312574+0000", 2024-09-12T02:48:19.697 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:19.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.697 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:48:19.697 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:19.697 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:19.698 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:19.698 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:19.698 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:19.698 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.282771+0000", 2024-09-12T02:48:19.698 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:19.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.698 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:48:19.698 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:19.698 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:19.698 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:19.698 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:19.698 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:19.698 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.260478+0000", 2024-09-12T02:48:19.699 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:19.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.699 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:48:19.699 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:19.699 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:19.699 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:19.699 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:19.699 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:19.700 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.273397+0000", 2024-09-12T02:48:19.700 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:19.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.700 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:48:19.700 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:19.700 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:19.700 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:19.700 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:19.700 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:19.700 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312452+0000", 2024-09-12T02:48:19.700 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:19.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.701 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:48:19.701 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:19.701 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:19.701 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:19.701 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:19.701 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:19.701 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.308965+0000", 2024-09-12T02:48:19.701 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:19.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:19.701 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:48:19.701 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:19.701 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:19.701 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:19.702 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:19.702 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:19.702 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.337842+0000", 2024-09-12T02:48:19.702 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:19.702 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.702 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:48:19.702 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap": [], 2024-09-12T02:48:19.702 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_items": [], 2024-09-12T02:48:19.702 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_primaries": [], 2024-09-12T02:48:19.702 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_temp": [], 2024-09-12T02:48:19.702 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_temp": [], 2024-09-12T02:48:19.702 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklist": {}, 2024-09-12T02:48:19.702 INFO:teuthology.orchestra.run.smithi112.stdout: "range_blocklist": {}, 2024-09-12T02:48:19.702 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profiles": { 2024-09-12T02:48:19.702 INFO:teuthology.orchestra.run.smithi112.stdout: "default": { 2024-09-12T02:48:19.703 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-failure-domain": "osd", 2024-09-12T02:48:19.703 INFO:teuthology.orchestra.run.smithi112.stdout: "k": "2", 2024-09-12T02:48:19.703 INFO:teuthology.orchestra.run.smithi112.stdout: "m": "1", 2024-09-12T02:48:19.703 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin": "jerasure", 2024-09-12T02:48:19.703 INFO:teuthology.orchestra.run.smithi112.stdout: "technique": "reed_sol_van" 2024-09-12T02:48:19.703 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:19.703 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps_queue": [], 2024-09-12T02:48:19.703 INFO:teuthology.orchestra.run.smithi112.stdout: "new_removed_snaps": [], 2024-09-12T02:48:19.703 INFO:teuthology.orchestra.run.smithi112.stdout: "new_purged_snaps": [], 2024-09-12T02:48:19.703 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_node_flags": {}, 2024-09-12T02:48:19.703 INFO:teuthology.orchestra.run.smithi112.stdout: "device_class_flags": {}, 2024-09-12T02:48:19.703 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode": { 2024-09-12T02:48:19.703 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_enabled": false, 2024-09-12T02:48:19.704 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_bucket_count": 0, 2024-09-12T02:48:19.704 INFO:teuthology.orchestra.run.smithi112.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:48:19.704 INFO:teuthology.orchestra.run.smithi112.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:48:19.704 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_bucket": 0 2024-09-12T02:48:19.704 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:19.704 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:48:19.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.619+0000 7f43ef200640 1 -- 172.21.15.112:0/648481441 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f43d006be60 msgr2=0x7f43d006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:19.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.619+0000 7f43ef200640 1 --2- 172.21.15.112:0/648481441 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f43d006be60 0x7f43d006e320 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f43f01f23b0 tx=0x7f43e00098d0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.619+0000 7f43ef200640 1 -- 172.21.15.112:0/648481441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43f00d1710 msgr2=0x7f43f014bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:19.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.619+0000 7f43ef200640 1 --2- 172.21.15.112:0/648481441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43f00d1710 0x7f43f014bcc0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f43e8001eb0 tx=0x7f43e800c890 comp rx=0 tx=0).stop 2024-09-12T02:48:19.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.619+0000 7f43ef200640 1 -- 172.21.15.112:0/648481441 shutdown_connections 2024-09-12T02:48:19.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.619+0000 7f43ef200640 1 --2- 172.21.15.112:0/648481441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43f00d1710 0x7f43f014bcc0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.619+0000 7f43ef200640 1 --2- 172.21.15.112:0/648481441 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43f00cf7a0 0x7f43f014ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.619+0000 7f43ef200640 1 --2- 172.21.15.112:0/648481441 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f43d006be60 0x7f43d006e320 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.619+0000 7f43ef200640 1 --2- 172.21.15.112:0/648481441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43f00b3e00 0x7f43f01f47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.619+0000 7f43ef200640 1 -- 172.21.15.112:0/648481441 >> 172.21.15.112:0/648481441 conn(0x7f43f009e030 msgr2=0x7f43f00b7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:19.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.619+0000 7f43ef200640 1 -- 172.21.15.112:0/648481441 shutdown_connections 2024-09-12T02:48:19.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:19.619+0000 7f43ef200640 1 -- 172.21.15.112:0/648481441 wait complete. 2024-09-12T02:48:19.707 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-12T02:48:21.871 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:48:21.876 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:48:24.708 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-12T02:48:24.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.870+0000 7f85a4e00640 1 Processor -- start 2024-09-12T02:48:24.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.870+0000 7f85a4e00640 1 -- start start 2024-09-12T02:48:24.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.871+0000 7f85a4e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f85a015eeb0 0x7f85a00ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:24.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.871+0000 7f85a4e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f85a0070bc0 0x7f85a00cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:24.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.871+0000 7f85a4e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85a006f880 con 0x7f85a015f290 2024-09-12T02:48:24.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.871+0000 7f85a4e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f85a0070730 con 0x7f85a015eeb0 2024-09-12T02:48:24.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.871+0000 7f85a4e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f85a006fb20 con 0x7f85a0070bc0 2024-09-12T02:48:24.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.871+0000 7f859de00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f85a015eeb0 0x7f85a00ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:24.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.871+0000 7f859de00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f85a015eeb0 0x7f85a00ce9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43996/0 (socket says 172.21.15.112:43996) 2024-09-12T02:48:24.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.871+0000 7f859de00640 1 -- 172.21.15.112:0/3974313236 learned_addr learned my addr 172.21.15.112:0/3974313236 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:24.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.872+0000 7f859d400640 1 --2- 172.21.15.112:0/3974313236 >> v2:172.21.15.137:3300/0 conn(0x7f85a0070bc0 0x7f85a00cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:24.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.872+0000 7f859de00640 1 -- 172.21.15.112:0/3974313236 >> v2:172.21.15.137:3300/0 conn(0x7f85a0070bc0 msgr2=0x7f85a00cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:24.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.872+0000 7f859de00640 1 --2- 172.21.15.112:0/3974313236 >> v2:172.21.15.137:3300/0 conn(0x7f85a0070bc0 0x7f85a00cd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:24.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.872+0000 7f859de00640 1 -- 172.21.15.112:0/3974313236 >> v1:172.21.15.112:6789/0 conn(0x7f85a015f290 legacy=0x7f85a00cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:24.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.872+0000 7f859de00640 1 -- 172.21.15.112:0/3974313236 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85a006fe00 con 0x7f85a015eeb0 2024-09-12T02:48:24.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.872+0000 7f859d400640 1 --2- 172.21.15.112:0/3974313236 >> v2:172.21.15.137:3300/0 conn(0x7f85a0070bc0 0x7f85a00cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:24.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.872+0000 7f859ca00640 1 -- 172.21.15.112:0/3974313236 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2112383429 0 0) 0x7f85a006f880 con 0x7f85a015f290 2024-09-12T02:48:24.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.873+0000 7f859de00640 1 --2- 172.21.15.112:0/3974313236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85a015eeb0 0x7f85a00ce9b0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f85a00d04e0 tx=0x7f859002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf94e19cb07fb227 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:24.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.873+0000 7f859ca00640 1 -- 172.21.15.112:0/3974313236 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8590037070 con 0x7f85a015eeb0 2024-09-12T02:48:24.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.873+0000 7f859ca00640 1 -- 172.21.15.112:0/3974313236 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8590032440 con 0x7f85a015eeb0 2024-09-12T02:48:24.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.873+0000 7f859ca00640 1 -- 172.21.15.112:0/3974313236 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8590032810 con 0x7f85a015eeb0 2024-09-12T02:48:24.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.874+0000 7f85a4e00640 1 -- 172.21.15.112:0/3974313236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85a015eeb0 msgr2=0x7f85a00ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:24.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.874+0000 7f85a4e00640 1 --2- 172.21.15.112:0/3974313236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85a015eeb0 0x7f85a00ce9b0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f85a00d04e0 tx=0x7f859002a270 comp rx=0 tx=0).stop 2024-09-12T02:48:24.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.874+0000 7f85a4e00640 1 -- 172.21.15.112:0/3974313236 shutdown_connections 2024-09-12T02:48:24.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.874+0000 7f85a4e00640 1 --2- 172.21.15.112:0/3974313236 >> v2:172.21.15.137:3300/0 conn(0x7f85a0070bc0 0x7f85a00cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:24.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.874+0000 7f85a4e00640 1 --2- 172.21.15.112:0/3974313236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85a015eeb0 0x7f85a00ce9b0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:24.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.874+0000 7f85a4e00640 1 -- 172.21.15.112:0/3974313236 >> 172.21.15.112:0/3974313236 conn(0x7f85a00b4720 msgr2=0x7f85a00b4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:24.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.874+0000 7f85a4e00640 1 -- 172.21.15.112:0/3974313236 shutdown_connections 2024-09-12T02:48:24.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.874+0000 7f85a4e00640 1 -- 172.21.15.112:0/3974313236 wait complete. 2024-09-12T02:48:24.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.875+0000 7f85a4e00640 1 Processor -- start 2024-09-12T02:48:24.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.876+0000 7f85a4e00640 1 -- start start 2024-09-12T02:48:24.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.876+0000 7f85a4e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85a0070bc0 0x7f85a01f4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:24.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.876+0000 7f85a4e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85a015eeb0 0x7f85a00c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:24.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.876+0000 7f85a4e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85a015f290 0x7f85a015c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:24.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.876+0000 7f85a4e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f85a00cfd30 con 0x7f85a0070bc0 2024-09-12T02:48:24.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.876+0000 7f85a4e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f85a00703c0 con 0x7f85a015eeb0 2024-09-12T02:48:24.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.876+0000 7f85a4e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f85a00cfeb0 con 0x7f85a015f290 2024-09-12T02:48:24.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.877+0000 7f859de00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85a0070bc0 0x7f85a01f4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:24.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.877+0000 7f859de00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85a0070bc0 0x7f85a01f4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44010/0 (socket says 172.21.15.112:44010) 2024-09-12T02:48:24.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.877+0000 7f859de00640 1 -- 172.21.15.112:0/4037498146 learned_addr learned my addr 172.21.15.112:0/4037498146 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:24.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.877+0000 7f859d400640 1 --2- 172.21.15.112:0/4037498146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85a015eeb0 0x7f85a00c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:24.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.877+0000 7f859e800640 1 --2- 172.21.15.112:0/4037498146 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85a015f290 0x7f85a015c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:24.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.877+0000 7f859de00640 1 -- 172.21.15.112:0/4037498146 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85a015f290 msgr2=0x7f85a015c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:24.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.877+0000 7f859de00640 1 --2- 172.21.15.112:0/4037498146 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85a015f290 0x7f85a015c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:24.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.877+0000 7f859de00640 1 -- 172.21.15.112:0/4037498146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85a015eeb0 msgr2=0x7f85a00c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:24.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.877+0000 7f859de00640 1 --2- 172.21.15.112:0/4037498146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85a015eeb0 0x7f85a00c7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:24.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.877+0000 7f859de00640 1 -- 172.21.15.112:0/4037498146 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85a00d0c40 con 0x7f85a0070bc0 2024-09-12T02:48:24.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.877+0000 7f859e800640 1 --2- 172.21.15.112:0/4037498146 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85a015f290 0x7f85a015c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:24.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.877+0000 7f859de00640 1 --2- 172.21.15.112:0/4037498146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85a0070bc0 0x7f85a01f4b30 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f8590000c00 tx=0x7f85900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:24.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.877+0000 7f8596000640 1 -- 172.21.15.112:0/4037498146 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8590041020 con 0x7f85a0070bc0 2024-09-12T02:48:24.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.878+0000 7f8596000640 1 -- 172.21.15.112:0/4037498146 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85900306c0 con 0x7f85a0070bc0 2024-09-12T02:48:24.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.878+0000 7f8596000640 1 -- 172.21.15.112:0/4037498146 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8590037040 con 0x7f85a0070bc0 2024-09-12T02:48:24.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.878+0000 7f85a4e00640 1 -- 172.21.15.112:0/4037498146 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85a00d0f20 con 0x7f85a0070bc0 2024-09-12T02:48:24.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.878+0000 7f85a4e00640 1 -- 172.21.15.112:0/4037498146 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85a00d14e0 con 0x7f85a0070bc0 2024-09-12T02:48:24.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.879+0000 7f85a4e00640 1 -- 172.21.15.112:0/4037498146 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85a00763a0 con 0x7f85a0070bc0 2024-09-12T02:48:24.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.879+0000 7f8596000640 1 -- 172.21.15.112:0/4037498146 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8590044020 con 0x7f85a0070bc0 2024-09-12T02:48:24.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.881+0000 7f8596000640 1 --2- 172.21.15.112:0/4037498146 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f858006be30 0x7f858006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:24.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.881+0000 7f8596000640 1 -- 172.21.15.112:0/4037498146 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5709+0+0 (secure 0 0 0) 0x7f85900ab6b0 con 0x7f85a0070bc0 2024-09-12T02:48:24.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.881+0000 7f859d400640 1 --2- 172.21.15.112:0/4037498146 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f858006be30 0x7f858006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:24.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.881+0000 7f8596000640 1 -- 172.21.15.112:0/4037498146 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=138}) -- 0x7f8580073960 con 0x7f85a0070bc0 2024-09-12T02:48:24.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.882+0000 7f859d400640 1 --2- 172.21.15.112:0/4037498146 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f858006be30 0x7f858006e2f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f85a00c9b60 tx=0x7f858c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:24.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:24.886+0000 7f8596000640 1 -- 172.21.15.112:0/4037498146 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f859004b030 con 0x7f85a0070bc0 2024-09-12T02:48:25.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.059+0000 7f85a4e00640 1 -- 172.21.15.112:0/4037498146 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f85a00cd9c0 con 0x7f85a0070bc0 2024-09-12T02:48:25.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.060+0000 7f8596000640 1 -- 172.21.15.112:0/4037498146 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v137) ==== 81+0+34293 (secure 0 0 0) 0x7f859007a050 con 0x7f85a0070bc0 2024-09-12T02:48:25.062 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:25.062 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:48:25.062 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 137, 2024-09-12T02:48:25.062 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:48:25.062 INFO:teuthology.orchestra.run.smithi112.stdout: "created": "2024-09-12T02:41:36.162095+0000", 2024-09-12T02:48:25.062 INFO:teuthology.orchestra.run.smithi112.stdout: "modified": "2024-09-12T02:48:21.003800+0000", 2024-09-12T02:48:25.062 INFO:teuthology.orchestra.run.smithi112.stdout: "last_up_change": "2024-09-12T02:41:42.191169+0000", 2024-09-12T02:48:25.062 INFO:teuthology.orchestra.run.smithi112.stdout: "last_in_change": "2024-09-12T02:41:39.036600+0000", 2024-09-12T02:48:25.062 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:48:25.063 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_num": 5799936, 2024-09-12T02:48:25.063 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_set": [ 2024-09-12T02:48:25.063 INFO:teuthology.orchestra.run.smithi112.stdout: "pglog_hardlimit", 2024-09-12T02:48:25.063 INFO:teuthology.orchestra.run.smithi112.stdout: "purged_snapdirs", 2024-09-12T02:48:25.063 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_deletes", 2024-09-12T02:48:25.063 INFO:teuthology.orchestra.run.smithi112.stdout: "sortbitwise" 2024-09-12T02:48:25.063 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:48:25.063 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_version": 4, 2024-09-12T02:48:25.063 INFO:teuthology.orchestra.run.smithi112.stdout: "full_ratio": 0.69999998807907104, 2024-09-12T02:48:25.063 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-12T02:48:25.063 INFO:teuthology.orchestra.run.smithi112.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-12T02:48:25.063 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_snapshot": "", 2024-09-12T02:48:25.063 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_max": 17, 2024-09-12T02:48:25.063 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd": 8, 2024-09-12T02:48:25.064 INFO:teuthology.orchestra.run.smithi112.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:48:25.064 INFO:teuthology.orchestra.run.smithi112.stdout: "min_compat_client": "jewel", 2024-09-12T02:48:25.064 INFO:teuthology.orchestra.run.smithi112.stdout: "require_osd_release": "squid", 2024-09-12T02:48:25.064 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_crimson": false, 2024-09-12T02:48:25.064 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-12T02:48:25.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.064 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 1, 2024-09-12T02:48:25.064 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": ".mgr", 2024-09-12T02:48:25.064 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:41:43.011599+0000", 2024-09-12T02:48:25.064 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:48:25.064 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:48:25.064 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:48:25.064 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:48:25.065 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:48:25.065 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:48:25.065 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:48:25.065 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:48:25.065 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:48:25.065 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:48:25.065 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:48:25.065 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:48:25.065 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:48:25.065 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 1, 2024-09-12T02:48:25.065 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 1, 2024-09-12T02:48:25.065 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 1, 2024-09-12T02:48:25.065 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 1, 2024-09-12T02:48:25.066 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 1, 2024-09-12T02:48:25.066 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:48:25.066 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:48:25.066 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:48:25.066 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:48:25.066 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:48:25.066 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:48:25.066 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:48:25.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.066 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "109", 2024-09-12T02:48:25.066 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:48:25.066 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:48:25.066 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:48:25.066 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:48:25.067 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:48:25.067 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:48:25.067 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:48:25.067 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:48:25.067 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:48:25.067 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:48:25.067 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:48:25.067 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:48:25.067 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:48:25.067 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:48:25.067 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:48:25.067 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:48:25.067 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:48:25.067 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:48:25.068 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:48:25.068 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:48:25.068 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:48:25.068 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:48:25.068 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:48:25.068 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:48:25.068 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:48:25.068 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:48:25.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.068 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:48:25.068 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:48:25.068 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:48:25.068 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:48:25.069 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:48:25.069 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:48:25.069 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:48:25.069 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:48:25.069 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:48:25.069 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:48:25.069 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:48:25.069 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:48:25.069 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_max": 32, 2024-09-12T02:48:25.069 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 1 2024-09-12T02:48:25.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.069 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:48:25.069 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": {} 2024-09-12T02:48:25.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.070 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:48:25.070 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:48:25.070 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 8, 2024-09-12T02:48:25.070 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 8, 2024-09-12T02:48:25.070 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 0.25, 2024-09-12T02:48:25.070 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:48:25.070 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:48:25.070 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:48:25.070 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:48:25.070 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:48:25.070 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.071 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 16, 2024-09-12T02:48:25.071 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:48:25.071 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:47:55.641315+0000", 2024-09-12T02:48:25.071 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:48:25.071 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:48:25.071 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:48:25.071 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:48:25.071 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:48:25.071 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:48:25.071 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:48:25.071 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:48:25.071 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:48:25.071 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:48:25.071 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:48:25.072 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:48:25.072 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:48:25.072 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 32, 2024-09-12T02:48:25.072 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 32, 2024-09-12T02:48:25.072 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 32, 2024-09-12T02:48:25.072 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 32, 2024-09-12T02:48:25.072 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 32, 2024-09-12T02:48:25.072 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:48:25.072 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:48:25.072 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:48:25.072 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:48:25.072 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:48:25.072 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:48:25.072 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:48:25.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.073 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "134", 2024-09-12T02:48:25.073 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:48:25.073 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:48:25.073 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:48:25.073 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:48:25.073 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:48:25.073 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:48:25.073 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:48:25.073 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:48:25.073 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:48:25.073 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:48:25.073 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:48:25.074 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:48:25.074 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:48:25.074 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:48:25.074 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:48:25.074 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:48:25.074 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:48:25.074 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:48:25.074 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:48:25.074 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:48:25.074 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:48:25.074 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:48:25.074 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:48:25.074 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:48:25.074 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:48:25.074 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:48:25.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.075 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:48:25.075 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:48:25.075 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:48:25.075 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:48:25.075 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:48:25.075 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:48:25.075 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:48:25.075 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:48:25.075 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:48:25.075 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:48:25.075 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:48:25.075 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:48:25.075 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:48:25.076 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 16, 2024-09-12T02:48:25.076 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_priority": 5 2024-09-12T02:48:25.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.076 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:48:25.076 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:48:25.076 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": "cephfs" 2024-09-12T02:48:25.076 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.076 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:48:25.076 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:48:25.076 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.75, 2024-09-12T02:48:25.076 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.75, 2024-09-12T02:48:25.076 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:48:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.75, 2024-09-12T02:48:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.75, 2024-09-12T02:48:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:48:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:48:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:48:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 17, 2024-09-12T02:48:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_data", 2024-09-12T02:48:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:47:56.867038+0000", 2024-09-12T02:48:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1027, 2024-09-12T02:48:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-12T02:48:25.077 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:48:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:48:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:48:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:48:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:48:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:48:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:48:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:48:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:48:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:48:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:48:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 64, 2024-09-12T02:48:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 64, 2024-09-12T02:48:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 64, 2024-09-12T02:48:25.078 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 64, 2024-09-12T02:48:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 64, 2024-09-12T02:48:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:48:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:48:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:48:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:48:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:48:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:48:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:48:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "137", 2024-09-12T02:48:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:48:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:48:25.079 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:48:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:48:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:48:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:48:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:48:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:48:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:48:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 33554432, 2024-09-12T02:48:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:48:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:48:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:48:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:48:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:48:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:48:25.080 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:48:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:48:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:48:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:48:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:48:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:48:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:48:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:48:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:48:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:48:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:48:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:48:25.081 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:48:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:48:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:48:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:48:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:48:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:48:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:48:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:48:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:48:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:48:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 64, 2024-09-12T02:48:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:48:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.082 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:48:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:48:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: "data": "cephfs" 2024-09-12T02:48:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:48:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:48:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.75, 2024-09-12T02:48:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.75, 2024-09-12T02:48:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:48:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.75, 2024-09-12T02:48:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.75, 2024-09-12T02:48:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:48:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:48:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:48:25.083 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:48:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: "osds": [ 2024-09-12T02:48:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:48:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:25.084 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6800", 2024-09-12T02:48:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6801", 2024-09-12T02:48:25.085 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6802", 2024-09-12T02:48:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6803", 2024-09-12T02:48:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6806", 2024-09-12T02:48:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6807", 2024-09-12T02:48:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6804", 2024-09-12T02:48:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6805", 2024-09-12T02:48:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6801/821571304", 2024-09-12T02:48:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6803/821571304", 2024-09-12T02:48:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6807/821571304", 2024-09-12T02:48:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6805/821571304", 2024-09-12T02:48:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:25.089 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:48:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:25.090 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6808", 2024-09-12T02:48:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6809", 2024-09-12T02:48:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.091 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6810", 2024-09-12T02:48:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6811", 2024-09-12T02:48:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.092 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6814", 2024-09-12T02:48:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6815", 2024-09-12T02:48:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.093 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6812", 2024-09-12T02:48:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6813", 2024-09-12T02:48:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.094 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6809/2642068641", 2024-09-12T02:48:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6811/2642068641", 2024-09-12T02:48:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6815/2642068641", 2024-09-12T02:48:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6813/2642068641", 2024-09-12T02:48:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:48:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:25.095 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.096 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6816", 2024-09-12T02:48:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6817", 2024-09-12T02:48:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.097 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6818", 2024-09-12T02:48:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6819", 2024-09-12T02:48:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.098 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6822", 2024-09-12T02:48:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6823", 2024-09-12T02:48:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6820", 2024-09-12T02:48:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6821", 2024-09-12T02:48:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6817/3365688807", 2024-09-12T02:48:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6819/3365688807", 2024-09-12T02:48:25.100 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6823/3365688807", 2024-09-12T02:48:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6821/3365688807", 2024-09-12T02:48:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:48:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:25.101 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6824", 2024-09-12T02:48:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6825", 2024-09-12T02:48:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6826", 2024-09-12T02:48:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.103 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6827", 2024-09-12T02:48:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6830", 2024-09-12T02:48:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.104 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6831", 2024-09-12T02:48:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6828", 2024-09-12T02:48:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.105 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6829", 2024-09-12T02:48:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6825/231774278", 2024-09-12T02:48:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6827/231774278", 2024-09-12T02:48:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6831/231774278", 2024-09-12T02:48:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6829/231774278", 2024-09-12T02:48:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:48:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:25.107 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6800", 2024-09-12T02:48:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6801", 2024-09-12T02:48:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.108 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6802", 2024-09-12T02:48:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6803", 2024-09-12T02:48:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.109 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6806", 2024-09-12T02:48:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6807", 2024-09-12T02:48:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.110 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6804", 2024-09-12T02:48:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6805", 2024-09-12T02:48:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.111 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6801/3671178153", 2024-09-12T02:48:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6803/3671178153", 2024-09-12T02:48:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6807/3671178153", 2024-09-12T02:48:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6805/3671178153", 2024-09-12T02:48:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:48:25.112 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:25.113 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:25.113 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:25.113 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:25.113 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:25.113 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:25.113 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:25.113 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:25.113 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:25.113 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:25.113 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:25.113 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:25.113 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.113 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.113 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6808", 2024-09-12T02:48:25.114 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:25.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.114 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.114 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6809", 2024-09-12T02:48:25.114 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:25.114 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.114 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.114 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:25.114 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.114 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.114 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6810", 2024-09-12T02:48:25.115 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:25.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.115 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.115 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6811", 2024-09-12T02:48:25.115 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:25.115 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.115 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.115 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:25.115 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.115 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.115 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6817", 2024-09-12T02:48:25.116 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:25.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.116 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.116 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6819", 2024-09-12T02:48:25.116 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:25.116 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.116 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.116 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:25.116 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.116 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.116 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6812", 2024-09-12T02:48:25.117 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:25.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.117 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.117 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6815", 2024-09-12T02:48:25.117 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:25.117 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.117 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.117 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6809/3193706134", 2024-09-12T02:48:25.117 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6811/3193706134", 2024-09-12T02:48:25.117 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6819/3193706134", 2024-09-12T02:48:25.117 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6815/3193706134", 2024-09-12T02:48:25.117 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:25.118 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:25.118 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:25.118 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.118 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:48:25.118 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:25.118 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:25.118 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:25.118 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:25.118 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:25.118 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:25.118 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:25.118 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:25.118 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:25.119 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:25.119 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:25.119 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:25.119 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.119 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.119 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6813", 2024-09-12T02:48:25.119 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:25.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.119 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.119 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6814", 2024-09-12T02:48:25.119 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:25.119 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.120 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.120 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:25.120 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.120 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.120 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6816", 2024-09-12T02:48:25.120 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:25.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.120 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.120 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6818", 2024-09-12T02:48:25.120 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:25.121 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.121 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.121 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:25.121 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.121 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.121 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6822", 2024-09-12T02:48:25.121 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:25.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.121 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.121 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6823", 2024-09-12T02:48:25.121 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:25.121 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.122 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.122 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:25.122 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.122 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.122 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6820", 2024-09-12T02:48:25.122 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:25.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.122 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.122 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6821", 2024-09-12T02:48:25.122 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:25.122 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.123 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.123 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6814/3738813293", 2024-09-12T02:48:25.123 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6818/3738813293", 2024-09-12T02:48:25.123 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6823/3738813293", 2024-09-12T02:48:25.123 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6821/3738813293", 2024-09-12T02:48:25.123 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:25.123 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:25.123 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:25.123 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.123 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:48:25.123 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:25.124 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:25.124 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:25.124 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:25.124 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:25.124 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:25.124 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:25.124 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:25.124 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:25.124 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:25.124 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:25.124 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:25.124 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.124 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.125 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6824", 2024-09-12T02:48:25.125 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:25.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.125 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.125 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6825", 2024-09-12T02:48:25.125 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:25.125 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.125 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.125 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:25.125 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.125 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.126 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6826", 2024-09-12T02:48:25.126 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:25.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.126 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.126 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6827", 2024-09-12T02:48:25.126 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:25.126 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.126 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.126 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:25.126 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.126 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.127 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6830", 2024-09-12T02:48:25.127 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:25.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.127 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.127 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6831", 2024-09-12T02:48:25.127 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:25.127 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.127 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.127 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:25.127 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.127 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.127 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6828", 2024-09-12T02:48:25.128 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:25.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.128 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.128 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6829", 2024-09-12T02:48:25.128 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:25.128 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.128 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.128 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6825/1421932609", 2024-09-12T02:48:25.128 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6827/1421932609", 2024-09-12T02:48:25.128 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6831/1421932609", 2024-09-12T02:48:25.128 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6829/1421932609", 2024-09-12T02:48:25.128 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:25.129 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:25.129 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:25.129 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.129 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.129 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:48:25.129 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_xinfo": [ 2024-09-12T02:48:25.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.129 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:48:25.129 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:25.129 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:25.129 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:25.129 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:25.129 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:25.129 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.220641+0000", 2024-09-12T02:48:25.130 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:25.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.130 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:48:25.130 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:25.130 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:25.130 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:25.130 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:25.130 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:25.130 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312574+0000", 2024-09-12T02:48:25.130 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:25.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.130 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:48:25.131 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:25.131 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:25.131 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:25.131 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:25.131 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:25.131 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.282771+0000", 2024-09-12T02:48:25.131 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:25.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.131 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:48:25.131 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:25.131 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:25.131 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:25.131 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:25.132 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:25.132 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.260478+0000", 2024-09-12T02:48:25.132 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:25.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.132 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:48:25.132 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:25.132 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:25.132 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:25.132 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:25.132 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:25.132 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.273397+0000", 2024-09-12T02:48:25.132 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:25.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.133 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:48:25.133 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:25.133 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:25.133 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:25.133 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:25.133 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:25.133 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312452+0000", 2024-09-12T02:48:25.133 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:25.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.133 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:48:25.133 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:25.133 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:25.134 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:25.134 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:25.134 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:25.134 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.308965+0000", 2024-09-12T02:48:25.134 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:25.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.134 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:48:25.134 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:25.134 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:25.134 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:25.134 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:25.134 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:25.134 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.337842+0000", 2024-09-12T02:48:25.135 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:25.135 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.135 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:48:25.135 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap": [], 2024-09-12T02:48:25.135 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_items": [], 2024-09-12T02:48:25.135 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_primaries": [], 2024-09-12T02:48:25.135 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_temp": [], 2024-09-12T02:48:25.135 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_temp": [], 2024-09-12T02:48:25.135 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklist": {}, 2024-09-12T02:48:25.135 INFO:teuthology.orchestra.run.smithi112.stdout: "range_blocklist": {}, 2024-09-12T02:48:25.135 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profiles": { 2024-09-12T02:48:25.135 INFO:teuthology.orchestra.run.smithi112.stdout: "default": { 2024-09-12T02:48:25.135 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-failure-domain": "osd", 2024-09-12T02:48:25.135 INFO:teuthology.orchestra.run.smithi112.stdout: "k": "2", 2024-09-12T02:48:25.135 INFO:teuthology.orchestra.run.smithi112.stdout: "m": "1", 2024-09-12T02:48:25.136 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin": "jerasure", 2024-09-12T02:48:25.136 INFO:teuthology.orchestra.run.smithi112.stdout: "technique": "reed_sol_van" 2024-09-12T02:48:25.136 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.136 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps_queue": [], 2024-09-12T02:48:25.136 INFO:teuthology.orchestra.run.smithi112.stdout: "new_removed_snaps": [], 2024-09-12T02:48:25.136 INFO:teuthology.orchestra.run.smithi112.stdout: "new_purged_snaps": [], 2024-09-12T02:48:25.136 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_node_flags": {}, 2024-09-12T02:48:25.136 INFO:teuthology.orchestra.run.smithi112.stdout: "device_class_flags": {}, 2024-09-12T02:48:25.136 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode": { 2024-09-12T02:48:25.136 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_enabled": false, 2024-09-12T02:48:25.136 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_bucket_count": 0, 2024-09-12T02:48:25.136 INFO:teuthology.orchestra.run.smithi112.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:48:25.136 INFO:teuthology.orchestra.run.smithi112.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:48:25.137 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_bucket": 0 2024-09-12T02:48:25.137 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.137 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:48:25.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.063+0000 7f85a4e00640 1 -- 172.21.15.112:0/4037498146 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f858006be30 msgr2=0x7f858006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:25.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.063+0000 7f85a4e00640 1 --2- 172.21.15.112:0/4037498146 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f858006be30 0x7f858006e2f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f85a00c9b60 tx=0x7f858c008040 comp rx=0 tx=0).stop 2024-09-12T02:48:25.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.063+0000 7f85a4e00640 1 -- 172.21.15.112:0/4037498146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85a0070bc0 msgr2=0x7f85a01f4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:25.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.063+0000 7f85a4e00640 1 --2- 172.21.15.112:0/4037498146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85a0070bc0 0x7f85a01f4b30 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f8590000c00 tx=0x7f85900046c0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.063+0000 7f85a4e00640 1 -- 172.21.15.112:0/4037498146 shutdown_connections 2024-09-12T02:48:25.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.063+0000 7f85a4e00640 1 --2- 172.21.15.112:0/4037498146 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85a015f290 0x7f85a015c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.063+0000 7f85a4e00640 1 --2- 172.21.15.112:0/4037498146 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f858006be30 0x7f858006e2f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.063+0000 7f85a4e00640 1 --2- 172.21.15.112:0/4037498146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85a015eeb0 0x7f85a00c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.063+0000 7f85a4e00640 1 --2- 172.21.15.112:0/4037498146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85a0070bc0 0x7f85a01f4b30 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.063+0000 7f85a4e00640 1 -- 172.21.15.112:0/4037498146 >> 172.21.15.112:0/4037498146 conn(0x7f85a00b4720 msgr2=0x7f85a00afdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:25.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.063+0000 7f85a4e00640 1 -- 172.21.15.112:0/4037498146 shutdown_connections 2024-09-12T02:48:25.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.063+0000 7f85a4e00640 1 -- 172.21.15.112:0/4037498146 wait complete. 2024-09-12T02:48:25.140 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-12T02:48:25.140 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:48:25.140 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:48:25.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:25.176 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2024-09-12T02:48:25.558 INFO:teuthology.orchestra.run.smithi112.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2024-09-12T02:48:25.558 INFO:teuthology.orchestra.run.smithi112.stderr:50+0 records in 2024-09-12T02:48:25.558 INFO:teuthology.orchestra.run.smithi112.stderr:50+0 records out 2024-09-12T02:48:25.558 INFO:teuthology.orchestra.run.smithi112.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.304053 s, 172 MB/s 2024-09-12T02:48:25.559 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:48:25.560 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-12T02:48:25.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.711+0000 7fc53c800640 1 Processor -- start 2024-09-12T02:48:25.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.711+0000 7fc53c800640 1 -- start start 2024-09-12T02:48:25.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.713+0000 7fc53c800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc534071530 0x7fc5340af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:25.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.713+0000 7fc53c800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc534071970 0x7fc5340afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:25.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.713+0000 7fc53c800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5340ceeb0 con 0x7fc53415cc50 2024-09-12T02:48:25.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.713+0000 7fc53c800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc53415d030 con 0x7fc534071970 2024-09-12T02:48:25.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.713+0000 7fc53c800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc5340cf4c0 con 0x7fc534071530 2024-09-12T02:48:25.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.713+0000 7fc53a800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc534071970 0x7fc5340afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:25.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.713+0000 7fc53a800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc534071970 0x7fc5340afc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44020/0 (socket says 172.21.15.112:44020) 2024-09-12T02:48:25.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.713+0000 7fc53a800640 1 -- 172.21.15.112:0/1165219446 learned_addr learned my addr 172.21.15.112:0/1165219446 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:25.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.713+0000 7fc53a800640 1 -- 172.21.15.112:0/1165219446 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc534071530 msgr2=0x7fc5340af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:25.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.713+0000 7fc53a800640 1 --2- 172.21.15.112:0/1165219446 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc534071530 0x7fc5340af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.713+0000 7fc53a800640 1 -- 172.21.15.112:0/1165219446 >> v1:172.21.15.137:6789/0 conn(0x7fc53415cc50 legacy=0x7fc5340732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:25.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.713+0000 7fc53a800640 1 -- 172.21.15.112:0/1165219446 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc53406e300 con 0x7fc534071970 2024-09-12T02:48:25.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.714+0000 7fc53a800640 1 --2- 172.21.15.112:0/1165219446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc534071970 0x7fc5340afc60 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fc530009e50 tx=0x7fc53002a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461454cd2946b8bd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:25.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.714+0000 7fc538a00640 1 -- 172.21.15.112:0/1165219446 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc530036070 con 0x7fc534071970 2024-09-12T02:48:25.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.715+0000 7fc538a00640 1 -- 172.21.15.112:0/1165219446 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc530031600 con 0x7fc534071970 2024-09-12T02:48:25.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.715+0000 7fc538a00640 1 -- 172.21.15.112:0/1165219446 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5300319d0 con 0x7fc534071970 2024-09-12T02:48:25.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.715+0000 7fc53c800640 1 -- 172.21.15.112:0/1165219446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc534071970 msgr2=0x7fc5340afc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:25.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.715+0000 7fc53c800640 1 --2- 172.21.15.112:0/1165219446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc534071970 0x7fc5340afc60 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fc530009e50 tx=0x7fc53002a640 comp rx=0 tx=0).stop 2024-09-12T02:48:25.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.715+0000 7fc53c800640 1 -- 172.21.15.112:0/1165219446 shutdown_connections 2024-09-12T02:48:25.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.715+0000 7fc53c800640 1 --2- 172.21.15.112:0/1165219446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc534071970 0x7fc5340afc60 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.715+0000 7fc53c800640 1 --2- 172.21.15.112:0/1165219446 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc534071530 0x7fc5340af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.715+0000 7fc53c800640 1 -- 172.21.15.112:0/1165219446 >> 172.21.15.112:0/1165219446 conn(0x7fc53406bbd0 msgr2=0x7fc53406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:25.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.715+0000 7fc53c800640 1 -- 172.21.15.112:0/1165219446 shutdown_connections 2024-09-12T02:48:25.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.715+0000 7fc53c800640 1 -- 172.21.15.112:0/1165219446 wait complete. 2024-09-12T02:48:25.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.717+0000 7fc53c800640 1 Processor -- start 2024-09-12T02:48:25.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.717+0000 7fc53c800640 1 -- start start 2024-09-12T02:48:25.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.718+0000 7fc53c800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc534071530 0x7fc534152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:25.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.718+0000 7fc53c800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc534071970 0x7fc5341f6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:25.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.718+0000 7fc53c800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc53415cc50 0x7fc5341f6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:25.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.718+0000 7fc53c800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc53406f510 con 0x7fc534071530 2024-09-12T02:48:25.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.718+0000 7fc53c800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc5340cf150 con 0x7fc534071970 2024-09-12T02:48:25.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.718+0000 7fc53c800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc53406f690 con 0x7fc53415cc50 2024-09-12T02:48:25.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.718+0000 7fc539e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc534071530 0x7fc534152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:25.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.718+0000 7fc539e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc534071530 0x7fc534152270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44032/0 (socket says 172.21.15.112:44032) 2024-09-12T02:48:25.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.718+0000 7fc539e00640 1 -- 172.21.15.112:0/3459788531 learned_addr learned my addr 172.21.15.112:0/3459788531 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:25.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.718+0000 7fc539400640 1 --2- 172.21.15.112:0/3459788531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc534071970 0x7fc5341f6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:25.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.718+0000 7fc53a800640 1 --2- 172.21.15.112:0/3459788531 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc53415cc50 0x7fc5341f6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:25.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.718+0000 7fc539e00640 1 -- 172.21.15.112:0/3459788531 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc53415cc50 msgr2=0x7fc5341f6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:25.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.718+0000 7fc539e00640 1 --2- 172.21.15.112:0/3459788531 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc53415cc50 0x7fc5341f6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.718+0000 7fc539e00640 1 -- 172.21.15.112:0/3459788531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc534071970 msgr2=0x7fc5341f6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:25.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.718+0000 7fc539e00640 1 --2- 172.21.15.112:0/3459788531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc534071970 0x7fc5341f6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.718+0000 7fc539e00640 1 -- 172.21.15.112:0/3459788531 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5341527b0 con 0x7fc534071530 2024-09-12T02:48:25.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.719+0000 7fc539e00640 1 --2- 172.21.15.112:0/3459788531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc534071530 0x7fc534152270 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fc52800b3e0 tx=0x7fc52800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:25.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.719+0000 7fc52e000640 1 -- 172.21.15.112:0/3459788531 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc528015020 con 0x7fc534071530 2024-09-12T02:48:25.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.719+0000 7fc52e000640 1 -- 172.21.15.112:0/3459788531 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc528011850 con 0x7fc534071530 2024-09-12T02:48:25.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.719+0000 7fc52e000640 1 -- 172.21.15.112:0/3459788531 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc528011c40 con 0x7fc534071530 2024-09-12T02:48:25.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.719+0000 7fc53c800640 1 -- 172.21.15.112:0/3459788531 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc534152a50 con 0x7fc534071530 2024-09-12T02:48:25.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.719+0000 7fc53c800640 1 -- 172.21.15.112:0/3459788531 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc534153010 con 0x7fc534071530 2024-09-12T02:48:25.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.720+0000 7fc53c800640 1 -- 172.21.15.112:0/3459788531 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc53406df60 con 0x7fc534071530 2024-09-12T02:48:25.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.721+0000 7fc52e000640 1 -- 172.21.15.112:0/3459788531 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc528018020 con 0x7fc534071530 2024-09-12T02:48:25.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.722+0000 7fc52e000640 1 --2- 172.21.15.112:0/3459788531 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc51806be30 0x7fc51806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:25.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.722+0000 7fc52e000640 1 -- 172.21.15.112:0/3459788531 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5709+0+0 (secure 0 0 0) 0x7fc52808ad80 con 0x7fc534071530 2024-09-12T02:48:25.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.723+0000 7fc539400640 1 --2- 172.21.15.112:0/3459788531 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc51806be30 0x7fc51806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:25.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.723+0000 7fc52e000640 1 -- 172.21.15.112:0/3459788531 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=138}) -- 0x7fc5180739c0 con 0x7fc534071530 2024-09-12T02:48:25.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.723+0000 7fc539400640 1 --2- 172.21.15.112:0/3459788531 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc51806be30 0x7fc51806e2f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc524006fd0 tx=0x7fc524008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:25.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.727+0000 7fc52e000640 1 -- 172.21.15.112:0/3459788531 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc52801f020 con 0x7fc534071530 2024-09-12T02:48:25.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.899+0000 7fc53c800640 1 -- 172.21.15.112:0/3459788531 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fc53415b660 con 0x7fc534071530 2024-09-12T02:48:25.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.901+0000 7fc52e000640 1 -- 172.21.15.112:0/3459788531 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v137) ==== 81+0+34293 (secure 0 0 0) 0x7fc5280172c0 con 0x7fc534071530 2024-09-12T02:48:25.902 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:25.902 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:48:25.902 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 137, 2024-09-12T02:48:25.902 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:48:25.902 INFO:teuthology.orchestra.run.smithi112.stdout: "created": "2024-09-12T02:41:36.162095+0000", 2024-09-12T02:48:25.902 INFO:teuthology.orchestra.run.smithi112.stdout: "modified": "2024-09-12T02:48:21.003800+0000", 2024-09-12T02:48:25.903 INFO:teuthology.orchestra.run.smithi112.stdout: "last_up_change": "2024-09-12T02:41:42.191169+0000", 2024-09-12T02:48:25.903 INFO:teuthology.orchestra.run.smithi112.stdout: "last_in_change": "2024-09-12T02:41:39.036600+0000", 2024-09-12T02:48:25.903 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:48:25.903 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_num": 5799936, 2024-09-12T02:48:25.903 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_set": [ 2024-09-12T02:48:25.903 INFO:teuthology.orchestra.run.smithi112.stdout: "pglog_hardlimit", 2024-09-12T02:48:25.903 INFO:teuthology.orchestra.run.smithi112.stdout: "purged_snapdirs", 2024-09-12T02:48:25.903 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_deletes", 2024-09-12T02:48:25.903 INFO:teuthology.orchestra.run.smithi112.stdout: "sortbitwise" 2024-09-12T02:48:25.903 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:48:25.903 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_version": 4, 2024-09-12T02:48:25.904 INFO:teuthology.orchestra.run.smithi112.stdout: "full_ratio": 0.69999998807907104, 2024-09-12T02:48:25.904 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-12T02:48:25.904 INFO:teuthology.orchestra.run.smithi112.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-12T02:48:25.904 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_snapshot": "", 2024-09-12T02:48:25.904 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_max": 17, 2024-09-12T02:48:25.904 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd": 8, 2024-09-12T02:48:25.904 INFO:teuthology.orchestra.run.smithi112.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:48:25.904 INFO:teuthology.orchestra.run.smithi112.stdout: "min_compat_client": "jewel", 2024-09-12T02:48:25.904 INFO:teuthology.orchestra.run.smithi112.stdout: "require_osd_release": "squid", 2024-09-12T02:48:25.904 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_crimson": false, 2024-09-12T02:48:25.904 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-12T02:48:25.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.905 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 1, 2024-09-12T02:48:25.905 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": ".mgr", 2024-09-12T02:48:25.905 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:41:43.011599+0000", 2024-09-12T02:48:25.905 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:48:25.905 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:48:25.905 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:48:25.905 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:48:25.905 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:48:25.905 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:48:25.905 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:48:25.905 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:48:25.905 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:48:25.906 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:48:25.906 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:48:25.906 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:48:25.906 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:48:25.906 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 1, 2024-09-12T02:48:25.906 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 1, 2024-09-12T02:48:25.906 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 1, 2024-09-12T02:48:25.906 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 1, 2024-09-12T02:48:25.906 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 1, 2024-09-12T02:48:25.906 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:48:25.907 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:48:25.907 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:48:25.907 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:48:25.907 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:48:25.907 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:48:25.907 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:48:25.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.907 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "109", 2024-09-12T02:48:25.907 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:48:25.907 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:48:25.907 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:48:25.908 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:48:25.908 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:48:25.908 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:48:25.908 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:48:25.908 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:48:25.908 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:48:25.908 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:48:25.908 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:48:25.908 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:48:25.908 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:48:25.908 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:48:25.909 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:48:25.909 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:48:25.909 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:48:25.909 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:48:25.909 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:48:25.909 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:48:25.909 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:48:25.909 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:48:25.909 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:48:25.909 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:48:25.909 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:48:25.910 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:48:25.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.910 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:48:25.910 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:48:25.910 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:48:25.910 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:48:25.910 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:48:25.910 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:48:25.910 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:48:25.910 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:48:25.910 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:48:25.911 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:48:25.911 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:48:25.911 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:48:25.911 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_max": 32, 2024-09-12T02:48:25.911 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 1 2024-09-12T02:48:25.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.911 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:48:25.911 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": {} 2024-09-12T02:48:25.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.911 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:48:25.911 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:48:25.912 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 8, 2024-09-12T02:48:25.912 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 8, 2024-09-12T02:48:25.912 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 0.25, 2024-09-12T02:48:25.912 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:48:25.912 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:48:25.912 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:48:25.912 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:48:25.912 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:48:25.912 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.912 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 16, 2024-09-12T02:48:25.913 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:48:25.913 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:47:55.641315+0000", 2024-09-12T02:48:25.913 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:48:25.913 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:48:25.913 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:48:25.913 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:48:25.913 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:48:25.913 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:48:25.913 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:48:25.913 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:48:25.913 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:48:25.914 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:48:25.914 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:48:25.914 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:48:25.914 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:48:25.914 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 32, 2024-09-12T02:48:25.914 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 32, 2024-09-12T02:48:25.914 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 32, 2024-09-12T02:48:25.914 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 32, 2024-09-12T02:48:25.914 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 32, 2024-09-12T02:48:25.914 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:48:25.914 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:48:25.914 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:48:25.915 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:48:25.915 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:48:25.915 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:48:25.915 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:48:25.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.915 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "134", 2024-09-12T02:48:25.915 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:48:25.915 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:48:25.915 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:48:25.915 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:48:25.915 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:48:25.916 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:48:25.916 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:48:25.916 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:48:25.916 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:48:25.916 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:48:25.916 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:48:25.916 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:48:25.916 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:48:25.916 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:48:25.916 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:48:25.916 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:48:25.917 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:48:25.917 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:48:25.917 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:48:25.917 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:48:25.917 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:48:25.917 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:48:25.917 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:48:25.917 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:48:25.917 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:48:25.917 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:48:25.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.917 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:48:25.917 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:48:25.918 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:48:25.918 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:48:25.918 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:48:25.918 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:48:25.918 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:48:25.918 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:48:25.918 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:48:25.918 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:48:25.918 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:48:25.918 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:48:25.918 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:48:25.918 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 16, 2024-09-12T02:48:25.919 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_priority": 5 2024-09-12T02:48:25.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.919 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:48:25.919 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:48:25.919 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": "cephfs" 2024-09-12T02:48:25.919 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.919 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:48:25.919 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:48:25.919 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.75, 2024-09-12T02:48:25.919 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.75, 2024-09-12T02:48:25.919 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:48:25.919 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.75, 2024-09-12T02:48:25.920 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.75, 2024-09-12T02:48:25.920 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:48:25.920 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:48:25.920 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:48:25.920 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.920 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 17, 2024-09-12T02:48:25.921 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_data", 2024-09-12T02:48:25.921 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:47:56.867038+0000", 2024-09-12T02:48:25.921 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1027, 2024-09-12T02:48:25.921 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-12T02:48:25.921 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:48:25.921 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:48:25.921 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:48:25.921 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:48:25.921 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:48:25.921 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:48:25.921 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:48:25.922 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:48:25.922 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:48:25.922 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:48:25.922 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:48:25.922 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 64, 2024-09-12T02:48:25.922 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 64, 2024-09-12T02:48:25.922 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 64, 2024-09-12T02:48:25.922 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 64, 2024-09-12T02:48:25.922 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 64, 2024-09-12T02:48:25.922 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:48:25.922 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:48:25.923 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:48:25.923 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:48:25.923 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:48:25.923 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:48:25.923 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:48:25.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.923 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "137", 2024-09-12T02:48:25.923 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:48:25.923 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:48:25.923 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:48:25.924 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:48:25.924 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:48:25.924 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:48:25.924 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:48:25.924 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:48:25.924 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:48:25.924 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 33554432, 2024-09-12T02:48:25.924 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:48:25.924 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:48:25.924 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:48:25.924 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:48:25.925 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:48:25.925 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:48:25.925 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:48:25.925 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:48:25.925 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:48:25.925 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:48:25.925 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:48:25.925 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:48:25.925 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:48:25.925 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:48:25.925 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:48:25.926 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:48:25.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.926 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:48:25.926 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:48:25.926 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:48:25.926 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:48:25.926 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:48:25.926 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:48:25.926 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:48:25.926 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:48:25.926 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:48:25.927 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:48:25.927 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:48:25.927 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:48:25.927 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 64, 2024-09-12T02:48:25.927 INFO:teuthology.orchestra.run.smithi112.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:48:25.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.927 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:48:25.927 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:48:25.927 INFO:teuthology.orchestra.run.smithi112.stdout: "data": "cephfs" 2024-09-12T02:48:25.927 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.928 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:48:25.928 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:48:25.928 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.75, 2024-09-12T02:48:25.928 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.75, 2024-09-12T02:48:25.928 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:48:25.928 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.75, 2024-09-12T02:48:25.928 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.75, 2024-09-12T02:48:25.928 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:48:25.928 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:48:25.929 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:48:25.929 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.929 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.929 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:48:25.929 INFO:teuthology.orchestra.run.smithi112.stdout: "osds": [ 2024-09-12T02:48:25.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.929 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:48:25.929 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:25.930 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:25.930 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:25.930 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:25.930 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:25.930 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:25.930 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:25.930 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:25.930 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:25.930 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:25.930 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:25.930 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:25.931 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.931 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.931 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6800", 2024-09-12T02:48:25.931 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:25.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.931 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.932 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6801", 2024-09-12T02:48:25.932 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:25.932 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.932 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.932 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:25.932 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.932 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.933 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6802", 2024-09-12T02:48:25.933 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:25.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.933 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.933 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6803", 2024-09-12T02:48:25.933 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:25.933 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.933 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.934 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:25.934 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.934 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.934 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6806", 2024-09-12T02:48:25.934 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:25.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.934 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.934 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6807", 2024-09-12T02:48:25.934 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:25.935 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.935 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.935 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:25.935 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.935 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.935 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6804", 2024-09-12T02:48:25.935 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:25.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.936 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.936 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6805", 2024-09-12T02:48:25.936 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:25.936 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.936 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.936 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6801/821571304", 2024-09-12T02:48:25.936 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6803/821571304", 2024-09-12T02:48:25.936 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6807/821571304", 2024-09-12T02:48:25.936 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6805/821571304", 2024-09-12T02:48:25.936 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:25.937 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:25.937 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:25.937 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.937 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:48:25.937 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:25.937 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:25.937 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:25.937 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:25.937 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:25.938 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:25.938 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:25.938 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:25.938 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:25.938 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:25.938 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:25.938 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:25.938 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.938 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.938 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6808", 2024-09-12T02:48:25.938 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:25.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.939 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.939 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6809", 2024-09-12T02:48:25.939 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:25.939 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.939 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.939 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:25.939 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.939 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.940 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6810", 2024-09-12T02:48:25.940 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:25.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.940 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.940 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6811", 2024-09-12T02:48:25.940 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:25.940 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.940 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.940 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:25.940 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.941 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.941 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6814", 2024-09-12T02:48:25.941 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:25.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.941 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.941 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6815", 2024-09-12T02:48:25.941 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:25.941 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.941 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.942 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:25.942 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.942 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.942 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6812", 2024-09-12T02:48:25.942 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:25.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.942 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.942 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6813", 2024-09-12T02:48:25.942 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:25.942 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.943 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.943 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6809/2642068641", 2024-09-12T02:48:25.943 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6811/2642068641", 2024-09-12T02:48:25.943 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6815/2642068641", 2024-09-12T02:48:25.943 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6813/2642068641", 2024-09-12T02:48:25.943 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:25.943 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:25.943 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:25.943 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.943 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:48:25.944 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:25.944 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:25.944 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:25.944 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:25.944 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:25.944 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:25.944 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:25.944 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:25.944 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:25.944 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:25.944 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:25.944 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:25.945 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.945 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.945 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6816", 2024-09-12T02:48:25.945 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:25.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.945 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.945 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6817", 2024-09-12T02:48:25.945 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:25.945 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.946 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.946 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:25.946 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.946 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.946 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6818", 2024-09-12T02:48:25.946 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:25.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.946 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.947 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6819", 2024-09-12T02:48:25.947 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:25.947 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.947 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.947 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:25.947 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.947 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.947 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6822", 2024-09-12T02:48:25.947 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:25.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.948 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.948 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6823", 2024-09-12T02:48:25.948 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:25.948 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.948 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.948 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:25.949 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.949 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.949 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6820", 2024-09-12T02:48:25.949 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:25.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.949 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.949 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6821", 2024-09-12T02:48:25.949 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:25.949 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.950 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.950 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6817/3365688807", 2024-09-12T02:48:25.950 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6819/3365688807", 2024-09-12T02:48:25.950 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6823/3365688807", 2024-09-12T02:48:25.950 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6821/3365688807", 2024-09-12T02:48:25.950 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:25.950 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:25.950 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:25.950 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.951 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:48:25.951 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:25.951 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:25.951 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:25.951 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:25.951 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:25.951 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:25.951 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:25.951 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:25.952 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:25.952 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:25.952 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:25.952 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:25.952 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.952 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.952 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6824", 2024-09-12T02:48:25.952 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:25.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.953 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.953 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6825", 2024-09-12T02:48:25.953 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:25.953 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.953 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.953 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:25.953 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.953 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.953 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6826", 2024-09-12T02:48:25.954 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:25.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.954 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.954 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6827", 2024-09-12T02:48:25.954 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:25.954 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.954 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.954 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:25.954 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.955 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.955 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6830", 2024-09-12T02:48:25.955 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:25.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.955 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.955 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6831", 2024-09-12T02:48:25.955 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:25.956 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.956 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.956 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:25.956 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.956 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.956 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6828", 2024-09-12T02:48:25.956 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:25.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.957 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.957 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.957 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6829", 2024-09-12T02:48:25.957 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:25.957 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.957 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.957 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6825/231774278", 2024-09-12T02:48:25.957 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6827/231774278", 2024-09-12T02:48:25.958 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6831/231774278", 2024-09-12T02:48:25.958 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6829/231774278", 2024-09-12T02:48:25.958 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:25.958 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:25.958 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:25.958 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.958 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:48:25.958 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:25.959 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:25.959 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:25.959 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:25.959 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:25.959 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:25.959 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:25.959 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:25.959 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:25.959 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:25.960 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:25.960 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:25.960 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.960 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.960 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6800", 2024-09-12T02:48:25.960 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:25.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.961 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.961 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6801", 2024-09-12T02:48:25.961 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:25.961 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.961 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.961 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:25.961 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.961 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.962 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6802", 2024-09-12T02:48:25.962 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:25.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.962 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.962 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6803", 2024-09-12T02:48:25.962 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:25.962 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.962 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.962 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:25.963 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.963 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.963 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.963 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6806", 2024-09-12T02:48:25.963 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:25.963 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.963 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.963 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.963 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6807", 2024-09-12T02:48:25.963 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:25.963 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.964 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.964 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.964 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:25.964 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.964 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.964 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.964 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6804", 2024-09-12T02:48:25.964 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:25.964 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.964 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.964 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.964 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6805", 2024-09-12T02:48:25.965 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:25.965 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.965 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.965 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6801/3671178153", 2024-09-12T02:48:25.965 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6803/3671178153", 2024-09-12T02:48:25.965 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6807/3671178153", 2024-09-12T02:48:25.965 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6805/3671178153", 2024-09-12T02:48:25.965 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:25.965 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:25.965 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:25.965 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.966 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.966 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:48:25.966 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:25.966 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:25.966 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:25.966 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:25.966 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:25.966 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:25.966 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:25.966 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:25.966 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:25.967 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:25.967 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:25.967 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:25.967 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.967 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.967 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6808", 2024-09-12T02:48:25.967 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:25.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.967 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.967 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6809", 2024-09-12T02:48:25.968 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:25.968 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.968 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.968 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:25.968 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.968 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.968 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6810", 2024-09-12T02:48:25.968 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:25.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.969 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.969 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6811", 2024-09-12T02:48:25.969 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:25.969 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.969 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.969 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:25.969 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.969 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.969 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6817", 2024-09-12T02:48:25.970 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:25.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.970 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.970 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6819", 2024-09-12T02:48:25.970 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:25.970 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.970 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.970 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:25.970 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.971 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.971 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6812", 2024-09-12T02:48:25.971 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:25.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.971 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.971 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6815", 2024-09-12T02:48:25.971 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:25.971 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.971 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.972 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6809/3193706134", 2024-09-12T02:48:25.972 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6811/3193706134", 2024-09-12T02:48:25.972 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6819/3193706134", 2024-09-12T02:48:25.972 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6815/3193706134", 2024-09-12T02:48:25.972 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:25.972 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:25.972 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:25.972 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.972 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.972 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:48:25.973 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:25.973 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:25.973 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:25.973 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:25.973 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:25.973 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:25.973 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:25.973 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:25.973 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:25.973 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:25.973 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:25.973 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:25.973 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.974 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.974 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6813", 2024-09-12T02:48:25.974 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:25.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.974 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.974 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6814", 2024-09-12T02:48:25.974 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:25.974 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.974 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.975 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:25.975 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.975 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.975 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.975 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6816", 2024-09-12T02:48:25.975 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:25.975 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.975 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.975 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.975 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6818", 2024-09-12T02:48:25.975 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:25.975 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.976 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.976 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:25.976 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.976 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.976 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6822", 2024-09-12T02:48:25.976 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:25.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.976 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.977 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6823", 2024-09-12T02:48:25.977 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:25.977 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.977 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.977 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:25.977 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.977 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.977 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6820", 2024-09-12T02:48:25.977 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:25.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.978 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.978 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.978 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6821", 2024-09-12T02:48:25.978 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:25.978 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.978 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.978 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.978 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6814/3738813293", 2024-09-12T02:48:25.978 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6818/3738813293", 2024-09-12T02:48:25.978 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6823/3738813293", 2024-09-12T02:48:25.978 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6821/3738813293", 2024-09-12T02:48:25.978 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:25.979 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:25.979 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:25.979 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.979 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:48:25.979 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:25.979 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:25.979 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:25.979 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:25.979 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:25.979 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:25.980 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:25.980 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:25.980 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:25.980 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:25.980 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:25.980 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:25.980 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.980 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.980 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6824", 2024-09-12T02:48:25.980 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:25.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.981 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.981 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6825", 2024-09-12T02:48:25.981 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:25.981 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.981 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.981 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:25.981 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.981 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.982 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6826", 2024-09-12T02:48:25.982 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:25.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.982 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.982 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6827", 2024-09-12T02:48:25.982 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:25.982 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.982 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.982 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:25.982 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.983 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.983 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6830", 2024-09-12T02:48:25.983 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:25.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.983 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.983 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6831", 2024-09-12T02:48:25.983 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:25.983 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.983 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.984 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:25.984 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:25.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.984 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:25.984 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6828", 2024-09-12T02:48:25.984 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:25.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.984 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:25.984 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6829", 2024-09-12T02:48:25.984 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:25.985 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.985 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.985 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6825/1421932609", 2024-09-12T02:48:25.985 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6827/1421932609", 2024-09-12T02:48:25.985 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6831/1421932609", 2024-09-12T02:48:25.985 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6829/1421932609", 2024-09-12T02:48:25.985 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:25.985 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:25.985 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:25.985 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:25.985 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.986 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:48:25.986 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_xinfo": [ 2024-09-12T02:48:25.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.986 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:48:25.986 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:25.986 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:25.986 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:25.986 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:25.986 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:25.986 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.220641+0000", 2024-09-12T02:48:25.986 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:25.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.987 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:48:25.987 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:25.987 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:25.987 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:25.987 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:25.987 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:25.987 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312574+0000", 2024-09-12T02:48:25.987 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:25.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.988 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:48:25.988 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:25.988 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:25.988 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:25.988 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:25.988 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:25.988 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.282771+0000", 2024-09-12T02:48:25.988 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:25.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.988 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:48:25.989 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:25.989 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:25.989 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:25.989 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:25.989 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:25.989 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.260478+0000", 2024-09-12T02:48:25.989 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:25.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.989 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:48:25.990 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:25.990 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:25.990 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:25.990 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:25.990 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:25.990 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.273397+0000", 2024-09-12T02:48:25.990 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:25.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.990 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:48:25.990 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:25.990 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:25.991 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:25.991 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:25.991 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:25.991 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312452+0000", 2024-09-12T02:48:25.991 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:25.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.991 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:48:25.991 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:25.991 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:25.991 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:25.992 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:25.992 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:25.992 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.308965+0000", 2024-09-12T02:48:25.992 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:25.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:25.992 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:48:25.992 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:25.992 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:25.992 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:25.992 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:25.993 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:25.993 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.337842+0000", 2024-09-12T02:48:25.993 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:25.993 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.993 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:48:25.993 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap": [], 2024-09-12T02:48:25.993 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_items": [], 2024-09-12T02:48:25.993 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_primaries": [], 2024-09-12T02:48:25.993 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_temp": [], 2024-09-12T02:48:25.993 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_temp": [], 2024-09-12T02:48:25.993 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklist": {}, 2024-09-12T02:48:25.993 INFO:teuthology.orchestra.run.smithi112.stdout: "range_blocklist": {}, 2024-09-12T02:48:25.994 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profiles": { 2024-09-12T02:48:25.994 INFO:teuthology.orchestra.run.smithi112.stdout: "default": { 2024-09-12T02:48:25.994 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-failure-domain": "osd", 2024-09-12T02:48:25.994 INFO:teuthology.orchestra.run.smithi112.stdout: "k": "2", 2024-09-12T02:48:25.994 INFO:teuthology.orchestra.run.smithi112.stdout: "m": "1", 2024-09-12T02:48:25.994 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin": "jerasure", 2024-09-12T02:48:25.994 INFO:teuthology.orchestra.run.smithi112.stdout: "technique": "reed_sol_van" 2024-09-12T02:48:25.994 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:25.994 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps_queue": [], 2024-09-12T02:48:25.994 INFO:teuthology.orchestra.run.smithi112.stdout: "new_removed_snaps": [], 2024-09-12T02:48:25.995 INFO:teuthology.orchestra.run.smithi112.stdout: "new_purged_snaps": [], 2024-09-12T02:48:25.995 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_node_flags": {}, 2024-09-12T02:48:25.995 INFO:teuthology.orchestra.run.smithi112.stdout: "device_class_flags": {}, 2024-09-12T02:48:25.995 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode": { 2024-09-12T02:48:25.995 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_enabled": false, 2024-09-12T02:48:25.995 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_bucket_count": 0, 2024-09-12T02:48:25.995 INFO:teuthology.orchestra.run.smithi112.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:48:25.995 INFO:teuthology.orchestra.run.smithi112.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:48:25.995 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_bucket": 0 2024-09-12T02:48:25.995 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:25.995 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:48:25.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.903+0000 7fc53c800640 1 -- 172.21.15.112:0/3459788531 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc51806be30 msgr2=0x7fc51806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:25.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.903+0000 7fc53c800640 1 --2- 172.21.15.112:0/3459788531 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc51806be30 0x7fc51806e2f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc524006fd0 tx=0x7fc524008040 comp rx=0 tx=0).stop 2024-09-12T02:48:25.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.903+0000 7fc53c800640 1 -- 172.21.15.112:0/3459788531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc534071530 msgr2=0x7fc534152270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:25.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.903+0000 7fc53c800640 1 --2- 172.21.15.112:0/3459788531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc534071530 0x7fc534152270 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fc52800b3e0 tx=0x7fc52800b8a0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.903+0000 7fc53c800640 1 -- 172.21.15.112:0/3459788531 shutdown_connections 2024-09-12T02:48:25.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.903+0000 7fc53c800640 1 --2- 172.21.15.112:0/3459788531 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc53415cc50 0x7fc5341f6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.903+0000 7fc53c800640 1 --2- 172.21.15.112:0/3459788531 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc51806be30 0x7fc51806e2f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.903+0000 7fc53c800640 1 --2- 172.21.15.112:0/3459788531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc534071970 0x7fc5341f6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.903+0000 7fc53c800640 1 --2- 172.21.15.112:0/3459788531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc534071530 0x7fc534152270 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.903+0000 7fc53c800640 1 -- 172.21.15.112:0/3459788531 >> 172.21.15.112:0/3459788531 conn(0x7fc53406bbd0 msgr2=0x7fc5340cf950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:25.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.903+0000 7fc53c800640 1 -- 172.21.15.112:0/3459788531 shutdown_connections 2024-09-12T02:48:25.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:25.903+0000 7fc53c800640 1 -- 172.21.15.112:0/3459788531 wait complete. 2024-09-12T02:48:25.999 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:48:26.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.150+0000 7f10abe00640 1 Processor -- start 2024-09-12T02:48:26.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.151+0000 7f10abe00640 1 -- start start 2024-09-12T02:48:26.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.152+0000 7f10abe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f10ac0ce460 0x7f10ac0d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.152+0000 7f10abe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10ac15db60 0x7f10ac0d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.152+0000 7f10abe00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10ac06e990 con 0x7f10ac15a450 2024-09-12T02:48:26.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.152+0000 7f10abe00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f10ac071eb0 con 0x7f10ac0ce460 2024-09-12T02:48:26.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.152+0000 7f10abe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f10ac06ec70 con 0x7f10ac15db60 2024-09-12T02:48:26.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.152+0000 7f10aaa00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f10ac15a450 0x7f10ac06e140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:53122/0 (socket says 172.21.15.112:53122) 2024-09-12T02:48:26.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.152+0000 7f10aaa00640 1 -- 172.21.15.112:0/3050992455 learned_addr learned my addr 172.21.15.112:0/3050992455 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:26.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.152+0000 7f10a2000640 1 --2- 172.21.15.112:0/3050992455 >> v2:172.21.15.137:3300/0 conn(0x7f10ac0ce460 0x7f10ac0d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.152+0000 7f10ab400640 1 --2- 172.21.15.112:0/3050992455 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10ac15db60 0x7f10ac0d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.152+0000 7f10aa000640 1 -- 172.21.15.112:0/3050992455 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3879183864 0 0) 0x7f10ac06e990 con 0x7f10ac15a450 2024-09-12T02:48:26.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.153+0000 7f10aa000640 1 -- 172.21.15.112:0/3050992455 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1090003520 con 0x7f10ac15a450 2024-09-12T02:48:26.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.153+0000 7f10aa000640 1 -- 172.21.15.112:0/3050992455 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 517624970 0 0) 0x7f1090003520 con 0x7f10ac15a450 2024-09-12T02:48:26.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.153+0000 7f10aa000640 1 -- 172.21.15.112:0/3050992455 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10ac15db60 msgr2=0x7f10ac0d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:26.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.153+0000 7f10aa000640 1 --2- 172.21.15.112:0/3050992455 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10ac15db60 0x7f10ac0d0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.153+0000 7f10aa000640 1 -- 172.21.15.112:0/3050992455 >> v2:172.21.15.137:3300/0 conn(0x7f10ac0ce460 msgr2=0x7f10ac0d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:26.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.153+0000 7f10aa000640 1 --2- 172.21.15.112:0/3050992455 >> v2:172.21.15.137:3300/0 conn(0x7f10ac0ce460 0x7f10ac0d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.153+0000 7f10aa000640 1 -- 172.21.15.112:0/3050992455 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10ac072100 con 0x7f10ac15a450 2024-09-12T02:48:26.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.153+0000 7f10aa000640 1 -- 172.21.15.112:0/3050992455 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f109c001670 con 0x7f10ac15a450 2024-09-12T02:48:26.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.153+0000 7f10aa000640 1 -- 172.21.15.112:0/3050992455 >> v1:172.21.15.112:6789/0 conn(0x7f10ac15a450 legacy=0x7f10ac06e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:26.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.153+0000 7f10aa000640 1 --2- 172.21.15.112:0/3050992455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10900039b0 0x7f1090003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.153+0000 7f10aa000640 1 --2- 172.21.15.112:0/3050992455 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10ac15db60 0x7f1090004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.153+0000 7f10aa000640 1 --2- 172.21.15.112:0/3050992455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1090004d40 0x7f10900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.153+0000 7f10aa000640 1 -- 172.21.15.112:0/3050992455 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f10ac071eb0 con 0x7f10900039b0 2024-09-12T02:48:26.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.153+0000 7f10aa000640 1 -- 172.21.15.112:0/3050992455 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f10ac06ec70 con 0x7f1090004d40 2024-09-12T02:48:26.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.153+0000 7f10aa000640 1 -- 172.21.15.112:0/3050992455 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f109000b9f0 con 0x7f10ac15db60 2024-09-12T02:48:26.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.153+0000 7f10aaa00640 1 --2- 172.21.15.112:0/3050992455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10900039b0 0x7f1090003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.153+0000 7f10ab400640 1 --2- 172.21.15.112:0/3050992455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1090004d40 0x7f10900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.153+0000 7f10a2000640 1 --2- 172.21.15.112:0/3050992455 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10ac15db60 0x7f1090004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.154+0000 7f10aaa00640 1 -- 172.21.15.112:0/3050992455 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10ac15db60 msgr2=0x7f1090004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:26.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.154+0000 7f10aaa00640 1 --2- 172.21.15.112:0/3050992455 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10ac15db60 0x7f1090004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.154+0000 7f10aaa00640 1 -- 172.21.15.112:0/3050992455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1090004d40 msgr2=0x7f10900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:26.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.154+0000 7f10aaa00640 1 --2- 172.21.15.112:0/3050992455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1090004d40 0x7f10900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.154+0000 7f10aaa00640 1 -- 172.21.15.112:0/3050992455 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1090003520 con 0x7f10900039b0 2024-09-12T02:48:26.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.154+0000 7f10ab400640 1 --2- 172.21.15.112:0/3050992455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1090004d40 0x7f10900051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:26.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.155+0000 7f10aaa00640 1 --2- 172.21.15.112:0/3050992455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10900039b0 0x7f1090003dd0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f109c00c160 tx=0x7f1090005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0a11d4c20984fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:26.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.155+0000 7f10aa000640 1 -- 172.21.15.112:0/3050992455 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c007c80 con 0x7f10900039b0 2024-09-12T02:48:26.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.155+0000 7f10aa000640 1 -- 172.21.15.112:0/3050992455 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f109c005ad0 con 0x7f10900039b0 2024-09-12T02:48:26.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.155+0000 7f10aa000640 1 -- 172.21.15.112:0/3050992455 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c007070 con 0x7f10900039b0 2024-09-12T02:48:26.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.155+0000 7f10abe00640 1 -- 172.21.15.112:0/3050992455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10900039b0 msgr2=0x7f1090003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:26.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.155+0000 7f10abe00640 1 --2- 172.21.15.112:0/3050992455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10900039b0 0x7f1090003dd0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f109c00c160 tx=0x7f1090005830 comp rx=0 tx=0).stop 2024-09-12T02:48:26.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.155+0000 7f10ab400640 1 -- 172.21.15.112:0/3050992455 reap_dead start 2024-09-12T02:48:26.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.155+0000 7f10abe00640 1 -- 172.21.15.112:0/3050992455 shutdown_connections 2024-09-12T02:48:26.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.155+0000 7f10abe00640 1 -- 172.21.15.112:0/3050992455 >> 172.21.15.112:0/3050992455 conn(0x7f10ac06bbd0 msgr2=0x7f10ac06bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:26.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.155+0000 7f10abe00640 1 -- 172.21.15.112:0/3050992455 shutdown_connections 2024-09-12T02:48:26.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.156+0000 7f10abe00640 1 -- 172.21.15.112:0/3050992455 wait complete. 2024-09-12T02:48:26.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.157+0000 7f10abe00640 1 Processor -- start 2024-09-12T02:48:26.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.157+0000 7f10abe00640 1 -- start start 2024-09-12T02:48:26.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.158+0000 7f10abe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10900039b0 0x7f10ac15b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.158+0000 7f10abe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10ac152ca0 0x7f10ac0b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.158+0000 7f10abe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10ac156220 0x7f10ac150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.158+0000 7f10abe00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f10ac0d0d60 con 0x7f10ac152ca0 2024-09-12T02:48:26.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.158+0000 7f10abe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f10ac15a830 con 0x7f10ac156220 2024-09-12T02:48:26.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.158+0000 7f10abe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f10ac0d0ee0 con 0x7f10900039b0 2024-09-12T02:48:26.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.158+0000 7f10a2000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10ac152ca0 0x7f10ac0b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.158+0000 7f10a2000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10ac152ca0 0x7f10ac0b4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44058/0 (socket says 172.21.15.112:44058) 2024-09-12T02:48:26.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.158+0000 7f10aaa00640 1 --2- 172.21.15.112:0/851296677 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10900039b0 0x7f10ac15b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.158+0000 7f10a2000640 1 -- 172.21.15.112:0/851296677 learned_addr learned my addr 172.21.15.112:0/851296677 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:26.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.159+0000 7f10ab400640 1 --2- 172.21.15.112:0/851296677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10ac156220 0x7f10ac150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.159+0000 7f10a2000640 1 -- 172.21.15.112:0/851296677 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10900039b0 msgr2=0x7f10ac15b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:26.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.159+0000 7f10a2000640 1 --2- 172.21.15.112:0/851296677 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10900039b0 0x7f10ac15b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.159+0000 7f10a2000640 1 -- 172.21.15.112:0/851296677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10ac156220 msgr2=0x7f10ac150e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:26.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.159+0000 7f10a2000640 1 --2- 172.21.15.112:0/851296677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10ac156220 0x7f10ac150e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.159+0000 7f10a2000640 1 -- 172.21.15.112:0/851296677 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10ac1531a0 con 0x7f10ac152ca0 2024-09-12T02:48:26.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.159+0000 7f10a2000640 1 --2- 172.21.15.112:0/851296677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10ac152ca0 0x7f10ac0b4ca0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f10940116d0 tx=0x7f1094011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:26.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.159+0000 7f10a3e00640 1 -- 172.21.15.112:0/851296677 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109400f9c0 con 0x7f10ac152ca0 2024-09-12T02:48:26.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.159+0000 7f10a3e00640 1 -- 172.21.15.112:0/851296677 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f109400fb60 con 0x7f10ac152ca0 2024-09-12T02:48:26.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.159+0000 7f10abe00640 1 -- 172.21.15.112:0/851296677 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10ac153480 con 0x7f10ac152ca0 2024-09-12T02:48:26.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.159+0000 7f10a3e00640 1 -- 172.21.15.112:0/851296677 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1094015460 con 0x7f10ac152ca0 2024-09-12T02:48:26.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.160+0000 7f10abe00640 1 -- 172.21.15.112:0/851296677 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10ac153a40 con 0x7f10ac152ca0 2024-09-12T02:48:26.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.161+0000 7f10abe00640 1 -- 172.21.15.112:0/851296677 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10ac0cd2f0 con 0x7f10ac152ca0 2024-09-12T02:48:26.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.162+0000 7f10a3e00640 1 -- 172.21.15.112:0/851296677 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1094015600 con 0x7f10ac152ca0 2024-09-12T02:48:26.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.162+0000 7f10a3e00640 1 --2- 172.21.15.112:0/851296677 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f108806be30 0x7f108806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.162+0000 7f10a3e00640 1 -- 172.21.15.112:0/851296677 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5709+0+0 (secure 0 0 0) 0x7f109408b710 con 0x7f10ac152ca0 2024-09-12T02:48:26.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.163+0000 7f10a3e00640 1 -- 172.21.15.112:0/851296677 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=138}) -- 0x7f1088073960 con 0x7f10ac152ca0 2024-09-12T02:48:26.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.163+0000 7f10aaa00640 1 --2- 172.21.15.112:0/851296677 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f108806be30 0x7f108806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.163+0000 7f10aaa00640 1 --2- 172.21.15.112:0/851296677 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f108806be30 0x7f108806e2f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f109c00c160 tx=0x7f109c034040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:26.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.167+0000 7f10a3e00640 1 -- 172.21.15.112:0/851296677 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1094019030 con 0x7f10ac152ca0 2024-09-12T02:48:26.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.377+0000 7f10abe00640 1 -- 172.21.15.112:0/851296677 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10ac0ce110 con 0x7f10ac152ca0 2024-09-12T02:48:26.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.377+0000 7f10a3e00640 1 -- 172.21.15.112:0/851296677 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+5231 (secure 0 0 0) 0x7f1094059a10 con 0x7f10ac152ca0 2024-09-12T02:48:26.378 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:26.378 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":70,"btime":"2024-09-12T02:48:01:488612+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5816,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1943935405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1943935405},{"type":"v1","addr":"172.21.15.137:6834","nonce":1943935405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6328,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2010766966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2010766966},{"type":"v1","addr":"172.21.15.112:6835","nonce":2010766966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/193655023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":193655023},{"type":"v1","addr":"172.21.15.137:6835","nonce":193655023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:47:57.871200+0000","modified":"2024-09-12T02:48:00.893329+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6861":{"gid":6861,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/134918269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":134918269},{"type":"v1","addr":"172.21.15.112:6837","nonce":134918269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6861,"qdb_cluster":[6861]},"id":8}]} 2024-09-12T02:48:26.379 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 70 2024-09-12T02:48:26.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.379+0000 7f10abe00640 1 -- 172.21.15.112:0/851296677 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f108806be30 msgr2=0x7f108806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:26.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.379+0000 7f10abe00640 1 --2- 172.21.15.112:0/851296677 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f108806be30 0x7f108806e2f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f109c00c160 tx=0x7f109c034040 comp rx=0 tx=0).stop 2024-09-12T02:48:26.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.379+0000 7f10abe00640 1 -- 172.21.15.112:0/851296677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10ac152ca0 msgr2=0x7f10ac0b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:26.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.379+0000 7f10abe00640 1 --2- 172.21.15.112:0/851296677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10ac152ca0 0x7f10ac0b4ca0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f10940116d0 tx=0x7f1094011b90 comp rx=0 tx=0).stop 2024-09-12T02:48:26.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.379+0000 7f10abe00640 1 -- 172.21.15.112:0/851296677 shutdown_connections 2024-09-12T02:48:26.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.379+0000 7f10abe00640 1 --2- 172.21.15.112:0/851296677 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f108806be30 0x7f108806e2f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.379+0000 7f10abe00640 1 --2- 172.21.15.112:0/851296677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10ac156220 0x7f10ac150e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.379+0000 7f10abe00640 1 --2- 172.21.15.112:0/851296677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10ac152ca0 0x7f10ac0b4ca0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.379+0000 7f10abe00640 1 --2- 172.21.15.112:0/851296677 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10900039b0 0x7f10ac15b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.379+0000 7f10abe00640 1 -- 172.21.15.112:0/851296677 >> 172.21.15.112:0/851296677 conn(0x7f10ac06bbd0 msgr2=0x7f10ac0ce840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:26.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.380+0000 7f10abe00640 1 -- 172.21.15.112:0/851296677 shutdown_connections 2024-09-12T02:48:26.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.380+0000 7f10abe00640 1 -- 172.21.15.112:0/851296677 wait complete. 2024-09-12T02:48:26.396 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-12T02:48:26.569 INFO:teuthology.orchestra.run.smithi112.stdout:{"cluster_fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","whoami":0,"id":6861,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":28.098570369000001,"mdsmap_epoch":70,"osdmap_epoch":137,"osdmap_epoch_barrier":137,"uptime":33.174190918999997} 2024-09-12T02:48:26.570 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", "fs_name": "cephfs", "id": 6861, "mdsmap_epoch": 70, "osdmap_epoch": 137, "osdmap_epoch_barrier": 137, "rank_uptime": 28.098570369, "state": "up:active", "uptime": 33.174190919, "want_state": "up:active", "whoami": 0 } 2024-09-12T02:48:26.570 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:48:26.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:26.570 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2024-09-12T02:48:26.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:26.609 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2024-09-12T02:48:26.691 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-12T02:48:26.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.883+0000 7f70f1200640 1 Processor -- start 2024-09-12T02:48:26.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.883+0000 7f70f1200640 1 -- start start 2024-09-12T02:48:26.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.884+0000 7f70f1200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f70ec070bc0 0x7f70ec0ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.884+0000 7f70f1200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70ec06f880 con 0x7f70ec15eeb0 2024-09-12T02:48:26.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.884+0000 7f70f1200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70ec06fb20 con 0x7f70ec0cfd30 2024-09-12T02:48:26.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.884+0000 7f70f1200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f70ec070730 con 0x7f70ec070bc0 2024-09-12T02:48:26.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.884+0000 7f70e9e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f70ec15eeb0 0x7f70ec0cf620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:53136/0 (socket says 172.21.15.112:53136) 2024-09-12T02:48:26.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.884+0000 7f70e9e00640 1 -- 172.21.15.112:0/1967677345 learned_addr learned my addr 172.21.15.112:0/1967677345 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:26.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.884+0000 7f70ea800640 1 --2- 172.21.15.112:0/1967677345 >> v2:172.21.15.112:3300/0 conn(0x7f70ec070bc0 0x7f70ec0ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.885+0000 7f70ea800640 1 -- 172.21.15.112:0/1967677345 >> v1:172.21.15.137:6789/0 conn(0x7f70ec0cfd30 legacy=0x7f70ec166f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:26.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.885+0000 7f70ea800640 1 -- 172.21.15.112:0/1967677345 >> v1:172.21.15.112:6789/0 conn(0x7f70ec15eeb0 legacy=0x7f70ec0cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:26.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.885+0000 7f70ea800640 1 -- 172.21.15.112:0/1967677345 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70ec06fe00 con 0x7f70ec070bc0 2024-09-12T02:48:26.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.886+0000 7f70ea800640 1 --2- 172.21.15.112:0/1967677345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70ec070bc0 0x7f70ec0ce9b0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f70e4009d90 tx=0x7f70e402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4face1928270c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:26.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.886+0000 7f70e8a00640 1 -- 172.21.15.112:0/1967677345 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e4007740 con 0x7f70ec070bc0 2024-09-12T02:48:26.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.886+0000 7f70e8a00640 1 -- 172.21.15.112:0/1967677345 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e40078e0 con 0x7f70ec070bc0 2024-09-12T02:48:26.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.886+0000 7f70e8a00640 1 -- 172.21.15.112:0/1967677345 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e4007cb0 con 0x7f70ec070bc0 2024-09-12T02:48:26.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.887+0000 7f70f1200640 1 -- 172.21.15.112:0/1967677345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70ec070bc0 msgr2=0x7f70ec0ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:26.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.887+0000 7f70f1200640 1 --2- 172.21.15.112:0/1967677345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70ec070bc0 0x7f70ec0ce9b0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f70e4009d90 tx=0x7f70e402a6a0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.887+0000 7f70f1200640 1 -- 172.21.15.112:0/1967677345 shutdown_connections 2024-09-12T02:48:26.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.887+0000 7f70f1200640 1 --2- 172.21.15.112:0/1967677345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70ec070bc0 0x7f70ec0ce9b0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.887+0000 7f70f1200640 1 -- 172.21.15.112:0/1967677345 >> 172.21.15.112:0/1967677345 conn(0x7f70ec0b4720 msgr2=0x7f70ec0b4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:26.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.887+0000 7f70f1200640 1 -- 172.21.15.112:0/1967677345 shutdown_connections 2024-09-12T02:48:26.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.887+0000 7f70f1200640 1 -- 172.21.15.112:0/1967677345 wait complete. 2024-09-12T02:48:26.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.888+0000 7f70f1200640 1 Processor -- start 2024-09-12T02:48:26.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.888+0000 7f70f1200640 1 -- start start 2024-09-12T02:48:26.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.889+0000 7f70f1200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70ec070bc0 0x7f70ec0d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.889+0000 7f70f1200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70ec0cfd30 0x7f70ec0c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.889+0000 7f70f1200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70ec15eeb0 0x7f70ec0c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.889+0000 7f70f1200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f70ec15f290 con 0x7f70ec15eeb0 2024-09-12T02:48:26.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.889+0000 7f70f1200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f70ec0703c0 con 0x7f70ec0cfd30 2024-09-12T02:48:26.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.889+0000 7f70f1200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f70ec15f410 con 0x7f70ec070bc0 2024-09-12T02:48:26.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.889+0000 7f70ea800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70ec15eeb0 0x7f70ec0c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.890+0000 7f70ea800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70ec15eeb0 0x7f70ec0c83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44062/0 (socket says 172.21.15.112:44062) 2024-09-12T02:48:26.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.890+0000 7f70ea800640 1 -- 172.21.15.112:0/4199093528 learned_addr learned my addr 172.21.15.112:0/4199093528 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:26.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.890+0000 7f70e9e00640 1 --2- 172.21.15.112:0/4199093528 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70ec070bc0 0x7f70ec0d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.890+0000 7f70e9400640 1 --2- 172.21.15.112:0/4199093528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70ec0cfd30 0x7f70ec0c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.890+0000 7f70ea800640 1 -- 172.21.15.112:0/4199093528 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70ec070bc0 msgr2=0x7f70ec0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:26.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.890+0000 7f70ea800640 1 --2- 172.21.15.112:0/4199093528 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70ec070bc0 0x7f70ec0d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.890+0000 7f70ea800640 1 -- 172.21.15.112:0/4199093528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70ec0cfd30 msgr2=0x7f70ec0c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:26.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.890+0000 7f70ea800640 1 --2- 172.21.15.112:0/4199093528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70ec0cfd30 0x7f70ec0c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.890+0000 7f70ea800640 1 -- 172.21.15.112:0/4199093528 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70ec1e6740 con 0x7f70ec15eeb0 2024-09-12T02:48:26.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.890+0000 7f70ea800640 1 --2- 172.21.15.112:0/4199093528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70ec15eeb0 0x7f70ec0c83b0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f70e4009d90 tx=0x7f70e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:26.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.890+0000 7f70e2000640 1 -- 172.21.15.112:0/4199093528 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e403f070 con 0x7f70ec15eeb0 2024-09-12T02:48:26.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.890+0000 7f70e2000640 1 -- 172.21.15.112:0/4199093528 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e4031c90 con 0x7f70ec15eeb0 2024-09-12T02:48:26.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.890+0000 7f70e2000640 1 -- 172.21.15.112:0/4199093528 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e4043630 con 0x7f70ec15eeb0 2024-09-12T02:48:26.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.890+0000 7f70f1200640 1 -- 172.21.15.112:0/4199093528 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70ec1e6a20 con 0x7f70ec15eeb0 2024-09-12T02:48:26.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.891+0000 7f70f1200640 1 -- 172.21.15.112:0/4199093528 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70ec1e6fe0 con 0x7f70ec15eeb0 2024-09-12T02:48:26.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.891+0000 7f70f1200640 1 -- 172.21.15.112:0/4199093528 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70ec0763a0 con 0x7f70ec15eeb0 2024-09-12T02:48:26.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.892+0000 7f70e2000640 1 -- 172.21.15.112:0/4199093528 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f70e403b410 con 0x7f70ec15eeb0 2024-09-12T02:48:26.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.893+0000 7f70e2000640 1 --2- 172.21.15.112:0/4199093528 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f70cc06be30 0x7f70cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:26.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.893+0000 7f70e2000640 1 -- 172.21.15.112:0/4199093528 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5709+0+0 (secure 0 0 0) 0x7f70e40ac4a0 con 0x7f70ec15eeb0 2024-09-12T02:48:26.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.893+0000 7f70e9e00640 1 --2- 172.21.15.112:0/4199093528 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f70cc06be30 0x7f70cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:26.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.894+0000 7f70e2000640 1 -- 172.21.15.112:0/4199093528 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=138}) -- 0x7f70cc073960 con 0x7f70ec15eeb0 2024-09-12T02:48:26.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.894+0000 7f70e9e00640 1 --2- 172.21.15.112:0/4199093528 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f70cc06be30 0x7f70cc06e2f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f70dc000f60 tx=0x7f70dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:26.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:26.898+0000 7f70e2000640 1 -- 172.21.15.112:0/4199093528 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f70e407af00 con 0x7f70ec15eeb0 2024-09-12T02:48:27.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:27.073+0000 7f70f1200640 1 -- 172.21.15.112:0/4199093528 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f70ec0ce9b0 con 0x7f70ec15eeb0 2024-09-12T02:48:27.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:27.074+0000 7f70e2000640 1 -- 172.21.15.112:0/4199093528 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v137) ==== 81+0+34293 (secure 0 0 0) 0x7f70e407a800 con 0x7f70ec15eeb0 2024-09-12T02:48:27.076 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:27.076 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:48:27.076 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 137, 2024-09-12T02:48:27.076 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:48:27.076 INFO:teuthology.orchestra.run.smithi112.stdout: "created": "2024-09-12T02:41:36.162095+0000", 2024-09-12T02:48:27.076 INFO:teuthology.orchestra.run.smithi112.stdout: "modified": "2024-09-12T02:48:21.003800+0000", 2024-09-12T02:48:27.076 INFO:teuthology.orchestra.run.smithi112.stdout: "last_up_change": "2024-09-12T02:41:42.191169+0000", 2024-09-12T02:48:27.076 INFO:teuthology.orchestra.run.smithi112.stdout: "last_in_change": "2024-09-12T02:41:39.036600+0000", 2024-09-12T02:48:27.076 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:48:27.076 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_num": 5799936, 2024-09-12T02:48:27.076 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_set": [ 2024-09-12T02:48:27.076 INFO:teuthology.orchestra.run.smithi112.stdout: "pglog_hardlimit", 2024-09-12T02:48:27.076 INFO:teuthology.orchestra.run.smithi112.stdout: "purged_snapdirs", 2024-09-12T02:48:27.077 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_deletes", 2024-09-12T02:48:27.077 INFO:teuthology.orchestra.run.smithi112.stdout: "sortbitwise" 2024-09-12T02:48:27.077 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:48:27.077 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_version": 4, 2024-09-12T02:48:27.077 INFO:teuthology.orchestra.run.smithi112.stdout: "full_ratio": 0.69999998807907104, 2024-09-12T02:48:27.077 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-12T02:48:27.077 INFO:teuthology.orchestra.run.smithi112.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-12T02:48:27.077 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_snapshot": "", 2024-09-12T02:48:27.077 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_max": 17, 2024-09-12T02:48:27.077 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd": 8, 2024-09-12T02:48:27.077 INFO:teuthology.orchestra.run.smithi112.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:48:27.077 INFO:teuthology.orchestra.run.smithi112.stdout: "min_compat_client": "jewel", 2024-09-12T02:48:27.077 INFO:teuthology.orchestra.run.smithi112.stdout: "require_osd_release": "squid", 2024-09-12T02:48:27.078 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_crimson": false, 2024-09-12T02:48:27.078 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-12T02:48:27.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.078 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 1, 2024-09-12T02:48:27.078 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": ".mgr", 2024-09-12T02:48:27.078 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:41:43.011599+0000", 2024-09-12T02:48:27.078 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:48:27.078 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:48:27.078 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:48:27.078 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:48:27.078 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:48:27.078 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:48:27.078 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:48:27.078 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:48:27.078 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:48:27.079 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:48:27.079 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:48:27.079 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:48:27.079 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:48:27.079 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 1, 2024-09-12T02:48:27.079 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 1, 2024-09-12T02:48:27.079 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 1, 2024-09-12T02:48:27.079 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 1, 2024-09-12T02:48:27.079 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 1, 2024-09-12T02:48:27.079 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:48:27.079 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:48:27.079 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:48:27.079 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:48:27.080 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:48:27.080 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:48:27.080 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:48:27.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.080 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "109", 2024-09-12T02:48:27.080 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:48:27.080 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:48:27.080 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:48:27.080 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:48:27.080 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:48:27.080 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:48:27.080 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:48:27.080 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:48:27.080 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:48:27.081 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:48:27.081 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:48:27.081 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:48:27.081 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:48:27.081 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:48:27.081 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:48:27.081 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:48:27.081 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:48:27.081 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:48:27.081 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:48:27.081 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:48:27.081 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:48:27.081 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:48:27.081 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:48:27.082 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:48:27.082 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:48:27.082 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:48:27.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.082 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:48:27.082 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:48:27.082 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:48:27.082 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:48:27.082 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:48:27.082 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:48:27.082 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:48:27.082 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:48:27.082 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:48:27.082 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:48:27.083 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:48:27.083 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:48:27.083 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_max": 32, 2024-09-12T02:48:27.083 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 1 2024-09-12T02:48:27.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.083 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:48:27.083 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": {} 2024-09-12T02:48:27.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.083 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:48:27.083 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:48:27.083 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 8, 2024-09-12T02:48:27.083 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 8, 2024-09-12T02:48:27.083 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 0.25, 2024-09-12T02:48:27.083 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:48:27.084 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:48:27.084 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:48:27.084 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:48:27.084 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:48:27.084 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.084 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 16, 2024-09-12T02:48:27.085 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:48:27.085 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:47:55.641315+0000", 2024-09-12T02:48:27.085 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:48:27.085 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:48:27.085 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:48:27.085 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:48:27.085 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:48:27.085 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:48:27.085 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:48:27.085 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:48:27.085 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:48:27.085 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:48:27.085 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:48:27.086 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:48:27.086 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:48:27.086 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 32, 2024-09-12T02:48:27.086 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 32, 2024-09-12T02:48:27.086 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 32, 2024-09-12T02:48:27.086 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 32, 2024-09-12T02:48:27.086 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 32, 2024-09-12T02:48:27.086 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:48:27.086 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:48:27.086 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:48:27.086 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:48:27.086 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:48:27.086 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:48:27.086 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:48:27.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.087 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "134", 2024-09-12T02:48:27.087 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:48:27.087 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:48:27.087 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:48:27.087 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:48:27.087 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:48:27.087 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:48:27.087 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:48:27.087 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:48:27.087 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:48:27.087 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:48:27.087 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:48:27.087 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:48:27.088 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:48:27.088 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:48:27.088 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:48:27.088 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:48:27.088 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:48:27.088 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:48:27.088 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:48:27.088 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:48:27.088 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:48:27.088 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:48:27.088 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:48:27.088 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:48:27.088 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:48:27.088 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:48:27.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.089 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:48:27.089 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:48:27.089 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:48:27.089 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:48:27.089 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:48:27.089 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:48:27.089 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:48:27.089 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:48:27.089 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:48:27.089 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:48:27.089 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:48:27.089 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:48:27.089 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:48:27.090 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 16, 2024-09-12T02:48:27.090 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_priority": 5 2024-09-12T02:48:27.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.090 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:48:27.090 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:48:27.090 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": "cephfs" 2024-09-12T02:48:27.090 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.090 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:48:27.090 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:48:27.090 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.75, 2024-09-12T02:48:27.090 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.75, 2024-09-12T02:48:27.090 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:48:27.090 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.75, 2024-09-12T02:48:27.091 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.75, 2024-09-12T02:48:27.091 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:48:27.091 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:48:27.091 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:48:27.091 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.091 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 17, 2024-09-12T02:48:27.091 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_data", 2024-09-12T02:48:27.091 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:47:56.867038+0000", 2024-09-12T02:48:27.091 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1027, 2024-09-12T02:48:27.091 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-12T02:48:27.091 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:48:27.091 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:48:27.092 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:48:27.092 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:48:27.092 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:48:27.092 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:48:27.092 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:48:27.092 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:48:27.092 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:48:27.092 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:48:27.092 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:48:27.092 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 64, 2024-09-12T02:48:27.092 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 64, 2024-09-12T02:48:27.092 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 64, 2024-09-12T02:48:27.092 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 64, 2024-09-12T02:48:27.092 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 64, 2024-09-12T02:48:27.093 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:48:27.093 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:48:27.093 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:48:27.093 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:48:27.093 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:48:27.093 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:48:27.093 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:48:27.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.093 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "137", 2024-09-12T02:48:27.093 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:48:27.093 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:48:27.093 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:48:27.093 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:48:27.094 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:48:27.094 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:48:27.094 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:48:27.094 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:48:27.094 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:48:27.094 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 33554432, 2024-09-12T02:48:27.094 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:48:27.094 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:48:27.094 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:48:27.095 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:48:27.095 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:48:27.095 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:48:27.095 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:48:27.095 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:48:27.095 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:48:27.095 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:48:27.095 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:48:27.095 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:48:27.095 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:48:27.095 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:48:27.095 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:48:27.095 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:48:27.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.096 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:48:27.096 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:48:27.096 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:48:27.096 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:48:27.096 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:48:27.096 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:48:27.096 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:48:27.096 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:48:27.096 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:48:27.096 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:48:27.096 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:48:27.096 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:48:27.096 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 64, 2024-09-12T02:48:27.097 INFO:teuthology.orchestra.run.smithi112.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:48:27.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.097 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:48:27.097 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:48:27.097 INFO:teuthology.orchestra.run.smithi112.stdout: "data": "cephfs" 2024-09-12T02:48:27.097 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.097 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:48:27.097 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:48:27.097 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.75, 2024-09-12T02:48:27.097 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.75, 2024-09-12T02:48:27.097 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:48:27.097 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.75, 2024-09-12T02:48:27.098 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.75, 2024-09-12T02:48:27.098 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:48:27.098 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:48:27.098 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:48:27.098 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.098 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.098 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:48:27.098 INFO:teuthology.orchestra.run.smithi112.stdout: "osds": [ 2024-09-12T02:48:27.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.098 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:48:27.098 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:27.098 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:27.098 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:27.098 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:27.098 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:27.099 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:27.099 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:27.100 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:27.100 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:27.100 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:27.100 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:27.100 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:27.100 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.100 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.100 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6800", 2024-09-12T02:48:27.100 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:27.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.100 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.100 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6801", 2024-09-12T02:48:27.101 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:27.101 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.101 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.101 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:27.101 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.101 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.101 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6802", 2024-09-12T02:48:27.101 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:27.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.102 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.102 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6803", 2024-09-12T02:48:27.102 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:27.102 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.102 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.102 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:27.102 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.102 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.102 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6806", 2024-09-12T02:48:27.103 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:27.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.103 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.103 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6807", 2024-09-12T02:48:27.103 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:27.103 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.103 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.103 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:27.103 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.103 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.103 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6804", 2024-09-12T02:48:27.104 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:27.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.104 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.104 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6805", 2024-09-12T02:48:27.104 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:27.104 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.104 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.104 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6801/821571304", 2024-09-12T02:48:27.104 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6803/821571304", 2024-09-12T02:48:27.104 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6807/821571304", 2024-09-12T02:48:27.104 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6805/821571304", 2024-09-12T02:48:27.104 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:27.105 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:27.105 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:27.105 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.105 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:48:27.105 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:27.105 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:27.105 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:27.105 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:27.105 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:27.105 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:27.105 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:27.105 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:27.105 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:27.106 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:27.106 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:27.106 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:27.106 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.106 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.106 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6808", 2024-09-12T02:48:27.106 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:27.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.107 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.107 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6809", 2024-09-12T02:48:27.107 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:27.107 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.107 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.107 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:27.107 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.107 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.107 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6810", 2024-09-12T02:48:27.108 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:27.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.108 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.108 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6811", 2024-09-12T02:48:27.108 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:27.108 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.108 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.109 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:27.109 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.109 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.109 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6814", 2024-09-12T02:48:27.109 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:27.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.109 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.109 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6815", 2024-09-12T02:48:27.109 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:27.110 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.110 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.110 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:27.110 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.110 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.110 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6812", 2024-09-12T02:48:27.110 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:27.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.111 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.111 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6813", 2024-09-12T02:48:27.111 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:27.111 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.111 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.111 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6809/2642068641", 2024-09-12T02:48:27.111 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6811/2642068641", 2024-09-12T02:48:27.111 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6815/2642068641", 2024-09-12T02:48:27.111 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6813/2642068641", 2024-09-12T02:48:27.111 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:27.111 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:27.111 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:27.112 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.112 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:48:27.113 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:27.113 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:27.113 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:27.113 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:27.113 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:27.113 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:27.113 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:27.113 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:27.113 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:27.113 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:27.113 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:27.113 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:27.113 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.114 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.114 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6816", 2024-09-12T02:48:27.114 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:27.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.114 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.114 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6817", 2024-09-12T02:48:27.115 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:27.115 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.115 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.115 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:27.115 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.115 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.115 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6818", 2024-09-12T02:48:27.116 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:27.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.116 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.116 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6819", 2024-09-12T02:48:27.116 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:27.116 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.116 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.117 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:27.117 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.117 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.117 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6822", 2024-09-12T02:48:27.117 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:27.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.117 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.117 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6823", 2024-09-12T02:48:27.117 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:27.117 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.118 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.118 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:27.118 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.118 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.118 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6820", 2024-09-12T02:48:27.118 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:27.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.119 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.119 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6821", 2024-09-12T02:48:27.119 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:27.119 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.119 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.119 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6817/3365688807", 2024-09-12T02:48:27.119 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6819/3365688807", 2024-09-12T02:48:27.119 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6823/3365688807", 2024-09-12T02:48:27.120 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6821/3365688807", 2024-09-12T02:48:27.120 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:27.120 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:27.120 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:27.120 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.121 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:48:27.121 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:27.121 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:27.121 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:27.121 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:27.121 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:27.121 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:27.121 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:27.121 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:27.122 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:27.122 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:27.122 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:27.122 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:27.122 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.122 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.122 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6824", 2024-09-12T02:48:27.122 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:27.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.123 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.123 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6825", 2024-09-12T02:48:27.123 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:27.123 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.123 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.123 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:27.123 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.123 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.124 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6826", 2024-09-12T02:48:27.124 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:27.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.124 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.124 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6827", 2024-09-12T02:48:27.124 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:27.124 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.124 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.124 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:27.125 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.125 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.125 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6830", 2024-09-12T02:48:27.125 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:27.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.125 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.126 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6831", 2024-09-12T02:48:27.126 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:27.126 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.126 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.126 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:27.126 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.127 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.127 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6828", 2024-09-12T02:48:27.127 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:27.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.128 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.128 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6829", 2024-09-12T02:48:27.128 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:27.128 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.128 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.129 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6825/231774278", 2024-09-12T02:48:27.129 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6827/231774278", 2024-09-12T02:48:27.129 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6831/231774278", 2024-09-12T02:48:27.129 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6829/231774278", 2024-09-12T02:48:27.129 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:27.129 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:27.129 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:27.129 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.129 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:48:27.130 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:27.130 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:27.130 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:27.130 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:27.130 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:27.130 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:27.130 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:27.130 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:27.130 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:27.130 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:27.131 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:27.131 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:27.131 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.131 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.131 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6800", 2024-09-12T02:48:27.131 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:27.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.131 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.131 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6801", 2024-09-12T02:48:27.131 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:27.131 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.132 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.132 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:27.132 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.132 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.132 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6802", 2024-09-12T02:48:27.132 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:27.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.132 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.132 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6803", 2024-09-12T02:48:27.132 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:27.132 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6806", 2024-09-12T02:48:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6807", 2024-09-12T02:48:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.134 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.134 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:27.134 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.134 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.134 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6804", 2024-09-12T02:48:27.134 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:27.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.134 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.134 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6805", 2024-09-12T02:48:27.134 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:27.134 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.135 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.135 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6801/3671178153", 2024-09-12T02:48:27.135 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6803/3671178153", 2024-09-12T02:48:27.135 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6807/3671178153", 2024-09-12T02:48:27.135 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6805/3671178153", 2024-09-12T02:48:27.135 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:27.135 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:27.135 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:27.135 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.135 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:48:27.135 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:27.136 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:27.136 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:27.136 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:27.136 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:27.136 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:27.136 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:27.136 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:27.136 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:27.136 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:27.137 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:27.137 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:27.137 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.137 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.137 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6808", 2024-09-12T02:48:27.137 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:27.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.137 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.137 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6809", 2024-09-12T02:48:27.138 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:27.138 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.138 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.138 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:27.138 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.138 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.138 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6810", 2024-09-12T02:48:27.138 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:27.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.138 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.138 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6811", 2024-09-12T02:48:27.139 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:27.139 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.139 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.139 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:27.139 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.139 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.139 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6817", 2024-09-12T02:48:27.139 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:27.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.139 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.139 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6819", 2024-09-12T02:48:27.140 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:27.140 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.140 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.140 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:27.140 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.140 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.140 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6812", 2024-09-12T02:48:27.140 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:27.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.141 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.141 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6815", 2024-09-12T02:48:27.141 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:27.141 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.141 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.141 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6809/3193706134", 2024-09-12T02:48:27.141 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6811/3193706134", 2024-09-12T02:48:27.141 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6819/3193706134", 2024-09-12T02:48:27.141 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6815/3193706134", 2024-09-12T02:48:27.141 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:27.142 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:27.142 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:27.142 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.142 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:48:27.142 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:27.142 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:27.142 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:27.142 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:27.142 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:27.142 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:27.142 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:27.143 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:27.143 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:27.143 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:27.143 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:27.143 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:27.143 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.143 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.143 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6813", 2024-09-12T02:48:27.143 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:27.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.143 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.143 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6814", 2024-09-12T02:48:27.144 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:27.144 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.144 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.144 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:27.144 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.144 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.144 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6816", 2024-09-12T02:48:27.144 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:27.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.144 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.145 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6818", 2024-09-12T02:48:27.145 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:27.145 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.145 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.145 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:27.146 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.146 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.146 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6822", 2024-09-12T02:48:27.146 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:27.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.147 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.147 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6823", 2024-09-12T02:48:27.147 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:27.147 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.148 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.148 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:27.148 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.148 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.148 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6820", 2024-09-12T02:48:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6821", 2024-09-12T02:48:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6814/3738813293", 2024-09-12T02:48:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6818/3738813293", 2024-09-12T02:48:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6823/3738813293", 2024-09-12T02:48:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6821/3738813293", 2024-09-12T02:48:27.150 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:27.150 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:27.150 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:27.150 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.150 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:48:27.150 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:27.150 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:27.150 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:27.150 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:27.150 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:27.150 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:27.150 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:27.150 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:27.151 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:27.151 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:27.151 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:27.151 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:27.151 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.151 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.151 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6824", 2024-09-12T02:48:27.151 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:27.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.151 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.151 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6825", 2024-09-12T02:48:27.152 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:27.152 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.152 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.152 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:27.152 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.152 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.152 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6826", 2024-09-12T02:48:27.152 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:27.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.152 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.152 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6827", 2024-09-12T02:48:27.153 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:27.153 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.153 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.153 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:27.153 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.153 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.153 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6830", 2024-09-12T02:48:27.153 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:27.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.153 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.153 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6831", 2024-09-12T02:48:27.154 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:27.154 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.154 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.154 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:27.154 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:27.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.154 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:27.154 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6828", 2024-09-12T02:48:27.154 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:27.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.154 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:27.155 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6829", 2024-09-12T02:48:27.155 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:27.155 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.155 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.155 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6825/1421932609", 2024-09-12T02:48:27.155 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6827/1421932609", 2024-09-12T02:48:27.155 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6831/1421932609", 2024-09-12T02:48:27.155 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6829/1421932609", 2024-09-12T02:48:27.155 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:27.155 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:27.155 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:27.155 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:27.155 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.156 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:48:27.156 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_xinfo": [ 2024-09-12T02:48:27.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.156 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:48:27.156 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:27.156 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:27.156 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:27.156 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:27.156 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:27.156 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.220641+0000", 2024-09-12T02:48:27.156 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:27.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.157 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:48:27.157 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:27.157 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:27.157 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:27.157 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:27.157 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:27.157 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312574+0000", 2024-09-12T02:48:27.157 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:27.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.157 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:48:27.157 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:27.158 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:27.158 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:27.158 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:27.158 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:27.158 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.282771+0000", 2024-09-12T02:48:27.158 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:27.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.158 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:48:27.158 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:27.158 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:27.158 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:27.158 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:27.158 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:27.159 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.260478+0000", 2024-09-12T02:48:27.159 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:27.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.159 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:48:27.159 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:27.159 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:27.159 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:27.159 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:27.159 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:27.159 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.273397+0000", 2024-09-12T02:48:27.159 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:27.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.160 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:48:27.160 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:27.160 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:27.160 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:27.160 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:27.160 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:27.160 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312452+0000", 2024-09-12T02:48:27.160 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:27.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.160 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:48:27.160 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:27.160 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:27.161 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:27.161 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:27.161 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:27.161 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.308965+0000", 2024-09-12T02:48:27.161 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:27.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:27.161 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:48:27.161 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:27.161 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:27.161 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:27.161 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:27.161 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:27.161 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.337842+0000", 2024-09-12T02:48:27.162 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:27.162 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.162 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:48:27.162 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap": [], 2024-09-12T02:48:27.162 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_items": [], 2024-09-12T02:48:27.162 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_primaries": [], 2024-09-12T02:48:27.162 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_temp": [], 2024-09-12T02:48:27.162 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_temp": [], 2024-09-12T02:48:27.162 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklist": {}, 2024-09-12T02:48:27.162 INFO:teuthology.orchestra.run.smithi112.stdout: "range_blocklist": {}, 2024-09-12T02:48:27.162 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profiles": { 2024-09-12T02:48:27.162 INFO:teuthology.orchestra.run.smithi112.stdout: "default": { 2024-09-12T02:48:27.162 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-failure-domain": "osd", 2024-09-12T02:48:27.162 INFO:teuthology.orchestra.run.smithi112.stdout: "k": "2", 2024-09-12T02:48:27.162 INFO:teuthology.orchestra.run.smithi112.stdout: "m": "1", 2024-09-12T02:48:27.163 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin": "jerasure", 2024-09-12T02:48:27.163 INFO:teuthology.orchestra.run.smithi112.stdout: "technique": "reed_sol_van" 2024-09-12T02:48:27.163 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:27.163 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps_queue": [], 2024-09-12T02:48:27.163 INFO:teuthology.orchestra.run.smithi112.stdout: "new_removed_snaps": [], 2024-09-12T02:48:27.163 INFO:teuthology.orchestra.run.smithi112.stdout: "new_purged_snaps": [], 2024-09-12T02:48:27.163 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_node_flags": {}, 2024-09-12T02:48:27.163 INFO:teuthology.orchestra.run.smithi112.stdout: "device_class_flags": {}, 2024-09-12T02:48:27.163 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode": { 2024-09-12T02:48:27.163 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_enabled": false, 2024-09-12T02:48:27.163 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_bucket_count": 0, 2024-09-12T02:48:27.163 INFO:teuthology.orchestra.run.smithi112.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:48:27.163 INFO:teuthology.orchestra.run.smithi112.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:48:27.164 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_bucket": 0 2024-09-12T02:48:27.164 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:27.164 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:48:27.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:27.077+0000 7f70f1200640 1 -- 172.21.15.112:0/4199093528 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f70cc06be30 msgr2=0x7f70cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:27.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:27.077+0000 7f70f1200640 1 --2- 172.21.15.112:0/4199093528 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f70cc06be30 0x7f70cc06e2f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f70dc000f60 tx=0x7f70dc009040 comp rx=0 tx=0).stop 2024-09-12T02:48:27.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:27.077+0000 7f70f1200640 1 -- 172.21.15.112:0/4199093528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70ec15eeb0 msgr2=0x7f70ec0c83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:27.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:27.077+0000 7f70f1200640 1 --2- 172.21.15.112:0/4199093528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70ec15eeb0 0x7f70ec0c83b0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f70e4009d90 tx=0x7f70e4004a40 comp rx=0 tx=0).stop 2024-09-12T02:48:27.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:27.077+0000 7f70f1200640 1 -- 172.21.15.112:0/4199093528 shutdown_connections 2024-09-12T02:48:27.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:27.077+0000 7f70f1200640 1 --2- 172.21.15.112:0/4199093528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70ec15eeb0 0x7f70ec0c83b0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:27.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:27.077+0000 7f70f1200640 1 --2- 172.21.15.112:0/4199093528 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f70cc06be30 0x7f70cc06e2f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:27.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:27.077+0000 7f70f1200640 1 --2- 172.21.15.112:0/4199093528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70ec0cfd30 0x7f70ec0c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:27.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:27.077+0000 7f70f1200640 1 --2- 172.21.15.112:0/4199093528 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70ec070bc0 0x7f70ec0d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:27.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:27.077+0000 7f70f1200640 1 -- 172.21.15.112:0/4199093528 >> 172.21.15.112:0/4199093528 conn(0x7f70ec0b4720 msgr2=0x7f70ec0b3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:27.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:27.077+0000 7f70f1200640 1 -- 172.21.15.112:0/4199093528 shutdown_connections 2024-09-12T02:48:27.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:27.077+0000 7f70f1200640 1 -- 172.21.15.112:0/4199093528 wait complete. 2024-09-12T02:48:27.167 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-12T02:48:32.168 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-12T02:48:32.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.330+0000 7faa78e00640 1 Processor -- start 2024-09-12T02:48:32.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.330+0000 7faa78e00640 1 -- start start 2024-09-12T02:48:32.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.331+0000 7faa78e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7faa7406f600 0x7faa740b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:32.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.331+0000 7faa78e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa740b4a20 con 0x7faa7415b9d0 2024-09-12T02:48:32.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.331+0000 7faa78e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa740b54a0 con 0x7faa740b45d0 2024-09-12T02:48:32.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.331+0000 7faa78e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7faa740b3af0 con 0x7faa7406f600 2024-09-12T02:48:32.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.332+0000 7faa71e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7faa7415b9d0 0x7faa7406eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:43946/0 (socket says 172.21.15.112:43946) 2024-09-12T02:48:32.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.332+0000 7faa71e00640 1 -- 172.21.15.112:0/1474453262 learned_addr learned my addr 172.21.15.112:0/1474453262 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:32.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.332+0000 7faa69400640 1 --2- 172.21.15.112:0/1474453262 >> v2:172.21.15.112:3300/0 conn(0x7faa7406f600 0x7faa740b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:32.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.332+0000 7faa71400640 1 -- 172.21.15.112:0/1474453262 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 786830728 0 0) 0x7faa740b4a20 con 0x7faa7415b9d0 2024-09-12T02:48:32.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.332+0000 7faa71400640 1 -- 172.21.15.112:0/1474453262 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa58003520 con 0x7faa7415b9d0 2024-09-12T02:48:32.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.332+0000 7faa69400640 1 -- 172.21.15.112:0/1474453262 >> v1:172.21.15.137:6789/0 conn(0x7faa740b45d0 legacy=0x7faa740cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:32.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.332+0000 7faa69400640 1 -- 172.21.15.112:0/1474453262 >> v1:172.21.15.112:6789/0 conn(0x7faa7415b9d0 legacy=0x7faa7406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:32.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.332+0000 7faa69400640 1 -- 172.21.15.112:0/1474453262 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa740b3dd0 con 0x7faa7406f600 2024-09-12T02:48:32.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.333+0000 7faa69400640 1 --2- 172.21.15.112:0/1474453262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa7406f600 0x7faa740b4ec0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7faa5c009790 tx=0x7faa5c02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa75b2f0a09adfb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:32.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.333+0000 7faa71400640 1 -- 172.21.15.112:0/1474453262 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5c037070 con 0x7faa7406f600 2024-09-12T02:48:32.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.333+0000 7faa71400640 1 -- 172.21.15.112:0/1474453262 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa5c02ae40 con 0x7faa7406f600 2024-09-12T02:48:32.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.333+0000 7faa71400640 1 -- 172.21.15.112:0/1474453262 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5c032660 con 0x7faa7406f600 2024-09-12T02:48:32.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.334+0000 7faa78e00640 1 -- 172.21.15.112:0/1474453262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa7406f600 msgr2=0x7faa740b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:32.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.334+0000 7faa78e00640 1 --2- 172.21.15.112:0/1474453262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa7406f600 0x7faa740b4ec0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7faa5c009790 tx=0x7faa5c02a130 comp rx=0 tx=0).stop 2024-09-12T02:48:32.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.334+0000 7faa78e00640 1 -- 172.21.15.112:0/1474453262 shutdown_connections 2024-09-12T02:48:32.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.334+0000 7faa78e00640 1 --2- 172.21.15.112:0/1474453262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa7406f600 0x7faa740b4ec0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.334+0000 7faa78e00640 1 -- 172.21.15.112:0/1474453262 >> 172.21.15.112:0/1474453262 conn(0x7faa7406bbd0 msgr2=0x7faa7406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:32.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.334+0000 7faa78e00640 1 -- 172.21.15.112:0/1474453262 shutdown_connections 2024-09-12T02:48:32.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.334+0000 7faa78e00640 1 -- 172.21.15.112:0/1474453262 wait complete. 2024-09-12T02:48:32.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.336+0000 7faa78e00640 1 Processor -- start 2024-09-12T02:48:32.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.336+0000 7faa78e00640 1 -- start start 2024-09-12T02:48:32.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.337+0000 7faa78e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa7406f600 0x7faa7415eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:32.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.337+0000 7faa78e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa740b45d0 0x7faa7415fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:32.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.337+0000 7faa78e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa7415b9d0 0x7faa74160070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:32.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.337+0000 7faa78e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faa7415bf30 con 0x7faa7406f600 2024-09-12T02:48:32.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.337+0000 7faa78e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faa7415bdb0 con 0x7faa7415b9d0 2024-09-12T02:48:32.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.337+0000 7faa78e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7faa740728c0 con 0x7faa740b45d0 2024-09-12T02:48:32.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.337+0000 7faa71e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa7406f600 0x7faa7415eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:32.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.337+0000 7faa71e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa7406f600 0x7faa7415eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58524/0 (socket says 172.21.15.112:58524) 2024-09-12T02:48:32.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.337+0000 7faa71e00640 1 -- 172.21.15.112:0/772515767 learned_addr learned my addr 172.21.15.112:0/772515767 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:32.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.337+0000 7faa69400640 1 --2- 172.21.15.112:0/772515767 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa740b45d0 0x7faa7415fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:32.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.337+0000 7faa72800640 1 --2- 172.21.15.112:0/772515767 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa7415b9d0 0x7faa74160070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:32.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.337+0000 7faa71e00640 1 -- 172.21.15.112:0/772515767 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa740b45d0 msgr2=0x7faa7415fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:32.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.337+0000 7faa71e00640 1 --2- 172.21.15.112:0/772515767 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa740b45d0 0x7faa7415fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.338+0000 7faa71e00640 1 -- 172.21.15.112:0/772515767 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa7415b9d0 msgr2=0x7faa74160070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:32.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.338+0000 7faa71e00640 1 --2- 172.21.15.112:0/772515767 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa7415b9d0 0x7faa74160070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.338+0000 7faa71e00640 1 -- 172.21.15.112:0/772515767 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa74167da0 con 0x7faa7406f600 2024-09-12T02:48:32.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.338+0000 7faa71e00640 1 --2- 172.21.15.112:0/772515767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa7406f600 0x7faa7415eab0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7faa6400c390 tx=0x7faa6400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:32.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.338+0000 7faa6aa00640 1 -- 172.21.15.112:0/772515767 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa64017070 con 0x7faa7406f600 2024-09-12T02:48:32.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.338+0000 7faa6aa00640 1 -- 172.21.15.112:0/772515767 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa64005ce0 con 0x7faa7406f600 2024-09-12T02:48:32.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.338+0000 7faa6aa00640 1 -- 172.21.15.112:0/772515767 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa640072f0 con 0x7faa7406f600 2024-09-12T02:48:32.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.338+0000 7faa78e00640 1 -- 172.21.15.112:0/772515767 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa74168080 con 0x7faa7406f600 2024-09-12T02:48:32.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.338+0000 7faa78e00640 1 -- 172.21.15.112:0/772515767 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa74168640 con 0x7faa7406f600 2024-09-12T02:48:32.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.339+0000 7faa78e00640 1 -- 172.21.15.112:0/772515767 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa74068a30 con 0x7faa7406f600 2024-09-12T02:48:32.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.340+0000 7faa6aa00640 1 -- 172.21.15.112:0/772515767 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa6401a070 con 0x7faa7406f600 2024-09-12T02:48:32.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.341+0000 7faa6aa00640 1 --2- 172.21.15.112:0/772515767 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7faa5006be30 0x7faa5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:32.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.341+0000 7faa6aa00640 1 -- 172.21.15.112:0/772515767 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7faa6408a270 con 0x7faa7406f600 2024-09-12T02:48:32.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.341+0000 7faa69400640 1 --2- 172.21.15.112:0/772515767 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7faa5006be30 0x7faa5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:32.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.342+0000 7faa69400640 1 --2- 172.21.15.112:0/772515767 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7faa5006be30 0x7faa5006e2f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7faa5c034000 tx=0x7faa5c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:32.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.346+0000 7faa6aa00640 1 -- 172.21.15.112:0/772515767 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faa64058c10 con 0x7faa7406f600 2024-09-12T02:48:32.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.522+0000 7faa78e00640 1 -- 172.21.15.112:0/772515767 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7faa74072c50 con 0x7faa7406f600 2024-09-12T02:48:32.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.523+0000 7faa6aa00640 1 -- 172.21.15.112:0/772515767 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v138) ==== 81+0+34274 (secure 0 0 0) 0x7faa64058510 con 0x7faa7406f600 2024-09-12T02:48:32.526 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:32.526 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:48:32.526 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 138, 2024-09-12T02:48:32.526 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:48:32.526 INFO:teuthology.orchestra.run.smithi112.stdout: "created": "2024-09-12T02:41:36.162095+0000", 2024-09-12T02:48:32.526 INFO:teuthology.orchestra.run.smithi112.stdout: "modified": "2024-09-12T02:48:31.006261+0000", 2024-09-12T02:48:32.526 INFO:teuthology.orchestra.run.smithi112.stdout: "last_up_change": "2024-09-12T02:41:42.191169+0000", 2024-09-12T02:48:32.526 INFO:teuthology.orchestra.run.smithi112.stdout: "last_in_change": "2024-09-12T02:41:39.036600+0000", 2024-09-12T02:48:32.527 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:48:32.527 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_num": 5799936, 2024-09-12T02:48:32.527 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_set": [ 2024-09-12T02:48:32.527 INFO:teuthology.orchestra.run.smithi112.stdout: "pglog_hardlimit", 2024-09-12T02:48:32.527 INFO:teuthology.orchestra.run.smithi112.stdout: "purged_snapdirs", 2024-09-12T02:48:32.527 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_deletes", 2024-09-12T02:48:32.527 INFO:teuthology.orchestra.run.smithi112.stdout: "sortbitwise" 2024-09-12T02:48:32.527 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:48:32.527 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_version": 4, 2024-09-12T02:48:32.527 INFO:teuthology.orchestra.run.smithi112.stdout: "full_ratio": 0.69999998807907104, 2024-09-12T02:48:32.527 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-12T02:48:32.527 INFO:teuthology.orchestra.run.smithi112.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-12T02:48:32.527 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_snapshot": "", 2024-09-12T02:48:32.527 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_max": 17, 2024-09-12T02:48:32.528 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd": 8, 2024-09-12T02:48:32.528 INFO:teuthology.orchestra.run.smithi112.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:48:32.528 INFO:teuthology.orchestra.run.smithi112.stdout: "min_compat_client": "jewel", 2024-09-12T02:48:32.528 INFO:teuthology.orchestra.run.smithi112.stdout: "require_osd_release": "squid", 2024-09-12T02:48:32.528 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_crimson": false, 2024-09-12T02:48:32.528 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-12T02:48:32.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.528 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 1, 2024-09-12T02:48:32.528 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": ".mgr", 2024-09-12T02:48:32.528 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:41:43.011599+0000", 2024-09-12T02:48:32.528 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:48:32.528 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:48:32.528 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:48:32.529 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:48:32.529 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:48:32.529 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:48:32.529 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:48:32.529 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:48:32.529 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:48:32.529 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:48:32.529 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:48:32.529 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:48:32.529 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:48:32.529 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 1, 2024-09-12T02:48:32.529 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 1, 2024-09-12T02:48:32.529 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 1, 2024-09-12T02:48:32.529 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 1, 2024-09-12T02:48:32.530 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 1, 2024-09-12T02:48:32.530 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:48:32.530 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:48:32.530 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:48:32.530 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:48:32.530 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:48:32.530 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:48:32.530 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:48:32.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.530 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "109", 2024-09-12T02:48:32.530 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:48:32.530 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:48:32.530 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:48:32.531 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:48:32.531 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:48:32.531 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:48:32.531 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:48:32.531 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:48:32.531 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:48:32.531 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:48:32.531 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:48:32.531 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:48:32.531 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:48:32.531 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:48:32.531 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:48:32.531 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:48:32.532 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:48:32.532 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:48:32.532 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:48:32.532 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:48:32.532 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:48:32.532 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:48:32.532 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:48:32.532 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:48:32.532 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:48:32.532 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:48:32.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.532 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:48:32.532 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:48:32.533 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:48:32.533 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:48:32.533 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:48:32.533 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:48:32.533 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:48:32.533 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:48:32.533 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:48:32.533 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:48:32.533 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:48:32.533 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:48:32.533 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_max": 32, 2024-09-12T02:48:32.533 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 1 2024-09-12T02:48:32.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.533 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:48:32.534 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": {} 2024-09-12T02:48:32.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.534 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:48:32.534 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:48:32.534 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 8, 2024-09-12T02:48:32.534 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 8, 2024-09-12T02:48:32.534 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 0.25, 2024-09-12T02:48:32.534 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:48:32.534 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:48:32.535 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:48:32.535 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:48:32.535 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:48:32.535 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.535 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 16, 2024-09-12T02:48:32.535 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:48:32.536 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:47:55.641315+0000", 2024-09-12T02:48:32.536 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:48:32.536 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:48:32.536 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:48:32.536 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:48:32.536 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:48:32.537 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:48:32.537 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:48:32.537 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:48:32.537 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:48:32.537 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:48:32.537 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:48:32.537 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:48:32.537 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:48:32.537 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 32, 2024-09-12T02:48:32.537 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 32, 2024-09-12T02:48:32.537 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 32, 2024-09-12T02:48:32.537 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 32, 2024-09-12T02:48:32.537 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 32, 2024-09-12T02:48:32.538 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:48:32.538 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:48:32.538 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:48:32.538 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:48:32.538 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:48:32.538 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:48:32.538 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:48:32.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.538 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "134", 2024-09-12T02:48:32.538 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:48:32.538 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:48:32.538 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:48:32.538 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:48:32.538 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:48:32.539 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:48:32.539 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:48:32.539 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:48:32.539 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:48:32.539 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:48:32.539 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:48:32.539 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:48:32.539 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:48:32.539 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:48:32.539 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:48:32.539 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:48:32.539 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:48:32.539 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:48:32.539 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:48:32.540 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:48:32.540 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:48:32.540 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:48:32.540 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:48:32.540 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:48:32.540 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:48:32.540 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:48:32.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.540 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:48:32.540 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:48:32.540 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:48:32.540 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:48:32.540 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:48:32.540 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:48:32.541 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:48:32.541 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:48:32.541 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:48:32.541 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:48:32.541 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:48:32.541 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:48:32.541 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:48:32.541 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 16, 2024-09-12T02:48:32.541 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_priority": 5 2024-09-12T02:48:32.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.541 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:48:32.541 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:48:32.541 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": "cephfs" 2024-09-12T02:48:32.542 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.542 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:48:32.542 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:48:32.542 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.75, 2024-09-12T02:48:32.542 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.75, 2024-09-12T02:48:32.542 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:48:32.542 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.75, 2024-09-12T02:48:32.542 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.75, 2024-09-12T02:48:32.542 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:48:32.542 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:48:32.542 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:48:32.542 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.543 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 17, 2024-09-12T02:48:32.543 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_data", 2024-09-12T02:48:32.543 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:47:56.867038+0000", 2024-09-12T02:48:32.543 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:48:32.543 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:48:32.543 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:48:32.543 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:48:32.543 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:48:32.543 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:48:32.543 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:48:32.543 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:48:32.543 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:48:32.543 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:48:32.544 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:48:32.544 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:48:32.544 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:48:32.544 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 64, 2024-09-12T02:48:32.544 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 64, 2024-09-12T02:48:32.544 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 64, 2024-09-12T02:48:32.544 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 64, 2024-09-12T02:48:32.544 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 64, 2024-09-12T02:48:32.544 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:48:32.544 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:48:32.544 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:48:32.544 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:48:32.544 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:48:32.545 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:48:32.545 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:48:32.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.545 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "138", 2024-09-12T02:48:32.545 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:48:32.545 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:48:32.545 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:48:32.545 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:48:32.545 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:48:32.545 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:48:32.545 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:48:32.545 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:48:32.545 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:48:32.545 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 33554432, 2024-09-12T02:48:32.546 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:48:32.546 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:48:32.546 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:48:32.546 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:48:32.546 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:48:32.546 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:48:32.546 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:48:32.546 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:48:32.546 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:48:32.546 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:48:32.547 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:48:32.547 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:48:32.547 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:48:32.547 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:48:32.547 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:48:32.547 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:48:32.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.547 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:48:32.547 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:48:32.547 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:48:32.547 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:48:32.547 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:48:32.547 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:48:32.548 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:48:32.548 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:48:32.548 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:48:32.548 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:48:32.548 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:48:32.548 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:48:32.548 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 64, 2024-09-12T02:48:32.548 INFO:teuthology.orchestra.run.smithi112.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:48:32.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.548 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:48:32.548 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:48:32.548 INFO:teuthology.orchestra.run.smithi112.stdout: "data": "cephfs" 2024-09-12T02:48:32.548 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.549 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:48:32.549 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:48:32.549 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.75, 2024-09-12T02:48:32.549 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.75, 2024-09-12T02:48:32.549 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:48:32.549 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.75, 2024-09-12T02:48:32.549 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.75, 2024-09-12T02:48:32.549 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:48:32.549 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:48:32.549 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:48:32.549 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.549 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.549 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:48:32.550 INFO:teuthology.orchestra.run.smithi112.stdout: "osds": [ 2024-09-12T02:48:32.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.550 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:48:32.550 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:32.550 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:32.550 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:32.550 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:32.550 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:32.550 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:32.550 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:32.550 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:32.550 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:32.550 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:32.550 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:32.551 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:32.551 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.551 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.551 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6800", 2024-09-12T02:48:32.551 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:32.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.551 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.551 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6801", 2024-09-12T02:48:32.551 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:32.551 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.551 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.552 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:32.552 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.552 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.552 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6802", 2024-09-12T02:48:32.552 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:32.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.553 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.553 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6803", 2024-09-12T02:48:32.553 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:32.553 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.553 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.553 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:32.553 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.553 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.553 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6806", 2024-09-12T02:48:32.554 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:32.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.554 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.554 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6807", 2024-09-12T02:48:32.554 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:32.554 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.554 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.554 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:32.554 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.554 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.555 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6804", 2024-09-12T02:48:32.555 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:32.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.555 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.555 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6805", 2024-09-12T02:48:32.555 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:32.555 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.555 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.555 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6801/821571304", 2024-09-12T02:48:32.556 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6803/821571304", 2024-09-12T02:48:32.556 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6807/821571304", 2024-09-12T02:48:32.556 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6805/821571304", 2024-09-12T02:48:32.556 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:32.556 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:32.556 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:32.556 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.556 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:48:32.556 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:32.556 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:32.556 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:32.556 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:32.557 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:32.557 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:32.557 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:32.557 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:32.557 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:32.557 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:32.557 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:32.557 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:32.557 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.557 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.557 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6808", 2024-09-12T02:48:32.557 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:32.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.558 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.558 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6809", 2024-09-12T02:48:32.558 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:32.558 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.558 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.558 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:32.558 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.558 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.558 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6810", 2024-09-12T02:48:32.558 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:32.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.559 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.559 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6811", 2024-09-12T02:48:32.559 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:32.559 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.559 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.559 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:32.559 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.559 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.559 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6814", 2024-09-12T02:48:32.559 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:32.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.560 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.560 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6815", 2024-09-12T02:48:32.560 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:32.560 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.560 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.560 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:32.560 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.560 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.560 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6812", 2024-09-12T02:48:32.560 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:32.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.561 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.561 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6813", 2024-09-12T02:48:32.561 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:32.561 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.561 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.561 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6809/2642068641", 2024-09-12T02:48:32.561 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6811/2642068641", 2024-09-12T02:48:32.561 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6815/2642068641", 2024-09-12T02:48:32.561 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6813/2642068641", 2024-09-12T02:48:32.561 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:32.561 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:32.562 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:32.562 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.562 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:48:32.562 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:32.562 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:32.562 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:32.562 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:32.562 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:32.562 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:32.562 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:32.562 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:32.562 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:32.563 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:32.563 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:32.563 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:32.563 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.563 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.563 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6816", 2024-09-12T02:48:32.563 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:32.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.563 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.563 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6817", 2024-09-12T02:48:32.563 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:32.563 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.564 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.564 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:32.564 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.564 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.564 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6818", 2024-09-12T02:48:32.564 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:32.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.564 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.564 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6819", 2024-09-12T02:48:32.564 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:32.565 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.565 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.565 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:32.565 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.565 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.565 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6822", 2024-09-12T02:48:32.565 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:32.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.565 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.565 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6823", 2024-09-12T02:48:32.566 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:32.566 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.566 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.566 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:32.566 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.566 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.566 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6820", 2024-09-12T02:48:32.566 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:32.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.566 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.566 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6821", 2024-09-12T02:48:32.567 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:32.567 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.567 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.567 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6817/3365688807", 2024-09-12T02:48:32.567 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6819/3365688807", 2024-09-12T02:48:32.567 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6823/3365688807", 2024-09-12T02:48:32.567 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6821/3365688807", 2024-09-12T02:48:32.567 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:32.567 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:32.567 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:32.567 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.568 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:48:32.568 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:32.568 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:32.568 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:32.568 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:32.568 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:32.568 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:32.568 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:32.568 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:32.568 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:32.568 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:32.568 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:32.568 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:32.568 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.569 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.569 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6824", 2024-09-12T02:48:32.569 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:32.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.569 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.569 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6825", 2024-09-12T02:48:32.569 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:32.569 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.570 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.570 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:32.570 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.570 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.570 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6826", 2024-09-12T02:48:32.570 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:32.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.570 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.570 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6827", 2024-09-12T02:48:32.570 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:32.570 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.571 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.571 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:32.571 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.571 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.571 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6830", 2024-09-12T02:48:32.571 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:32.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.571 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.571 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6831", 2024-09-12T02:48:32.571 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:32.571 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.572 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.572 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:32.572 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.572 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.572 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6828", 2024-09-12T02:48:32.572 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:32.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.572 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.572 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6829", 2024-09-12T02:48:32.572 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:32.573 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.573 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.573 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6825/231774278", 2024-09-12T02:48:32.573 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6827/231774278", 2024-09-12T02:48:32.573 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6831/231774278", 2024-09-12T02:48:32.573 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6829/231774278", 2024-09-12T02:48:32.573 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:32.573 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:32.573 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:32.573 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.573 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:48:32.574 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:32.574 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:32.574 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:32.574 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:32.574 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:32.574 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:32.574 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:32.574 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:32.574 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:32.574 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:32.574 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:32.574 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:32.574 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.575 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.575 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6800", 2024-09-12T02:48:32.575 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:32.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.575 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.575 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6801", 2024-09-12T02:48:32.575 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:32.575 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.575 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.575 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:32.575 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.576 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.576 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6802", 2024-09-12T02:48:32.576 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:32.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.576 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.576 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6803", 2024-09-12T02:48:32.576 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:32.576 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.576 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.576 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:32.576 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.577 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.577 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6806", 2024-09-12T02:48:32.577 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:32.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.577 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.577 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6807", 2024-09-12T02:48:32.577 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:32.577 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.577 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.577 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:32.578 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.578 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.578 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6804", 2024-09-12T02:48:32.578 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:32.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.578 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.578 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6805", 2024-09-12T02:48:32.578 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:32.579 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.579 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.579 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6801/3671178153", 2024-09-12T02:48:32.579 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6803/3671178153", 2024-09-12T02:48:32.579 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6807/3671178153", 2024-09-12T02:48:32.579 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6805/3671178153", 2024-09-12T02:48:32.579 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:32.579 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:32.579 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:32.579 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.580 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:48:32.580 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:32.580 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:32.580 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:32.580 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:32.580 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:32.580 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:32.580 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:32.580 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:32.580 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:32.580 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:32.580 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:32.580 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:32.581 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.581 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.581 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6808", 2024-09-12T02:48:32.581 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:32.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.581 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.581 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6809", 2024-09-12T02:48:32.581 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:32.581 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.581 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.581 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:32.582 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.582 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.582 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6810", 2024-09-12T02:48:32.582 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:32.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.582 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.582 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6811", 2024-09-12T02:48:32.582 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:32.582 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.582 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.583 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:32.583 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.583 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.583 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6817", 2024-09-12T02:48:32.583 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:32.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.583 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.583 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6819", 2024-09-12T02:48:32.583 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:32.583 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.583 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.584 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:32.584 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.584 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.584 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6812", 2024-09-12T02:48:32.584 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:32.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.584 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.584 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6815", 2024-09-12T02:48:32.584 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:32.584 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.585 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.585 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6809/3193706134", 2024-09-12T02:48:32.585 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6811/3193706134", 2024-09-12T02:48:32.585 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6819/3193706134", 2024-09-12T02:48:32.585 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6815/3193706134", 2024-09-12T02:48:32.585 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:32.585 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:32.585 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:32.585 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.585 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:48:32.585 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:32.586 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:32.586 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:32.586 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:32.586 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:32.586 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:32.586 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:32.586 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:32.586 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:32.586 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:32.586 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:32.586 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:32.587 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.587 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.587 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6813", 2024-09-12T02:48:32.587 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:32.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.587 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.587 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6814", 2024-09-12T02:48:32.587 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:32.587 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.587 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.588 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:32.588 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.588 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.588 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6816", 2024-09-12T02:48:32.588 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:32.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.588 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.588 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6818", 2024-09-12T02:48:32.589 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:32.589 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.589 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.589 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:32.589 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.589 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.589 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6822", 2024-09-12T02:48:32.589 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:32.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.590 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.590 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6823", 2024-09-12T02:48:32.590 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:32.590 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.590 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.590 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:32.590 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.590 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.590 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6820", 2024-09-12T02:48:32.590 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:32.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.591 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.591 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6821", 2024-09-12T02:48:32.591 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:32.591 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.591 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.591 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6814/3738813293", 2024-09-12T02:48:32.591 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6818/3738813293", 2024-09-12T02:48:32.591 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6823/3738813293", 2024-09-12T02:48:32.591 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6821/3738813293", 2024-09-12T02:48:32.591 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:32.591 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:32.591 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:32.591 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.592 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:48:32.592 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:32.592 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:32.592 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:32.592 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:32.592 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:32.592 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:32.592 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:32.592 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:32.592 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:32.592 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:32.592 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:32.593 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:32.593 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.593 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.593 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6824", 2024-09-12T02:48:32.593 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:32.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.593 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.593 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6825", 2024-09-12T02:48:32.593 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:32.593 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.593 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.594 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:32.594 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.594 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.594 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6826", 2024-09-12T02:48:32.594 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:32.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.594 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.594 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6827", 2024-09-12T02:48:32.594 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:32.594 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.594 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.595 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:32.595 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.595 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.595 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6830", 2024-09-12T02:48:32.595 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:32.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.595 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.596 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6831", 2024-09-12T02:48:32.596 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:32.596 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.596 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.596 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:32.596 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.596 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.596 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6828", 2024-09-12T02:48:32.596 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:32.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.597 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.597 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6829", 2024-09-12T02:48:32.597 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:32.597 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.597 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.597 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6825/1421932609", 2024-09-12T02:48:32.597 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6827/1421932609", 2024-09-12T02:48:32.597 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6831/1421932609", 2024-09-12T02:48:32.597 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6829/1421932609", 2024-09-12T02:48:32.597 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:32.597 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:32.597 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:32.597 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.598 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.598 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:48:32.598 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_xinfo": [ 2024-09-12T02:48:32.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.598 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:48:32.598 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:32.598 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:32.598 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:32.598 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:32.598 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:32.598 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.220641+0000", 2024-09-12T02:48:32.598 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:32.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.599 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:48:32.599 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:32.599 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:32.599 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:32.599 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:32.599 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:32.599 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312574+0000", 2024-09-12T02:48:32.599 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:32.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.599 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:48:32.599 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:32.599 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:32.600 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:32.600 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:32.600 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:32.600 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.282771+0000", 2024-09-12T02:48:32.600 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:32.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.600 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:48:32.600 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:32.600 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:32.601 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:32.601 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:32.601 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:32.601 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.260478+0000", 2024-09-12T02:48:32.601 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:32.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.601 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:48:32.601 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:32.601 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:32.601 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:32.602 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:32.602 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:32.602 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.273397+0000", 2024-09-12T02:48:32.602 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:32.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.602 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:48:32.602 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:32.602 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:32.602 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:32.602 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:32.602 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:32.602 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312452+0000", 2024-09-12T02:48:32.603 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:32.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.603 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:48:32.603 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:32.603 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:32.603 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:32.603 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:32.603 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:32.603 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.308965+0000", 2024-09-12T02:48:32.603 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:32.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.603 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:48:32.604 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:32.604 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:32.605 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:32.605 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:32.605 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:32.605 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.337842+0000", 2024-09-12T02:48:32.605 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:32.605 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.605 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:48:32.605 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap": [], 2024-09-12T02:48:32.605 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_items": [], 2024-09-12T02:48:32.605 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_primaries": [], 2024-09-12T02:48:32.605 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_temp": [], 2024-09-12T02:48:32.605 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_temp": [], 2024-09-12T02:48:32.605 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklist": {}, 2024-09-12T02:48:32.606 INFO:teuthology.orchestra.run.smithi112.stdout: "range_blocklist": {}, 2024-09-12T02:48:32.606 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profiles": { 2024-09-12T02:48:32.606 INFO:teuthology.orchestra.run.smithi112.stdout: "default": { 2024-09-12T02:48:32.606 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-failure-domain": "osd", 2024-09-12T02:48:32.606 INFO:teuthology.orchestra.run.smithi112.stdout: "k": "2", 2024-09-12T02:48:32.606 INFO:teuthology.orchestra.run.smithi112.stdout: "m": "1", 2024-09-12T02:48:32.606 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin": "jerasure", 2024-09-12T02:48:32.606 INFO:teuthology.orchestra.run.smithi112.stdout: "technique": "reed_sol_van" 2024-09-12T02:48:32.606 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.606 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps_queue": [], 2024-09-12T02:48:32.606 INFO:teuthology.orchestra.run.smithi112.stdout: "new_removed_snaps": [], 2024-09-12T02:48:32.606 INFO:teuthology.orchestra.run.smithi112.stdout: "new_purged_snaps": [], 2024-09-12T02:48:32.606 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_node_flags": {}, 2024-09-12T02:48:32.607 INFO:teuthology.orchestra.run.smithi112.stdout: "device_class_flags": {}, 2024-09-12T02:48:32.607 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode": { 2024-09-12T02:48:32.607 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_enabled": false, 2024-09-12T02:48:32.607 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_bucket_count": 0, 2024-09-12T02:48:32.607 INFO:teuthology.orchestra.run.smithi112.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:48:32.607 INFO:teuthology.orchestra.run.smithi112.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:48:32.607 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_bucket": 0 2024-09-12T02:48:32.607 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.607 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:48:32.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.525+0000 7faa78e00640 1 -- 172.21.15.112:0/772515767 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7faa5006be30 msgr2=0x7faa5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:32.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.526+0000 7faa78e00640 1 --2- 172.21.15.112:0/772515767 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7faa5006be30 0x7faa5006e2f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7faa5c034000 tx=0x7faa5c02e000 comp rx=0 tx=0).stop 2024-09-12T02:48:32.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.526+0000 7faa78e00640 1 -- 172.21.15.112:0/772515767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa7406f600 msgr2=0x7faa7415eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:32.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.526+0000 7faa78e00640 1 --2- 172.21.15.112:0/772515767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa7406f600 0x7faa7415eab0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7faa6400c390 tx=0x7faa6400c850 comp rx=0 tx=0).stop 2024-09-12T02:48:32.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.526+0000 7faa78e00640 1 -- 172.21.15.112:0/772515767 shutdown_connections 2024-09-12T02:48:32.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.526+0000 7faa78e00640 1 --2- 172.21.15.112:0/772515767 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7faa5006be30 0x7faa5006e2f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.526+0000 7faa78e00640 1 --2- 172.21.15.112:0/772515767 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa7415b9d0 0x7faa74160070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.526+0000 7faa78e00640 1 --2- 172.21.15.112:0/772515767 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa740b45d0 0x7faa7415fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.526+0000 7faa78e00640 1 --2- 172.21.15.112:0/772515767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa7406f600 0x7faa7415eab0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.526+0000 7faa78e00640 1 -- 172.21.15.112:0/772515767 >> 172.21.15.112:0/772515767 conn(0x7faa7406bbd0 msgr2=0x7faa74166e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:32.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.526+0000 7faa78e00640 1 -- 172.21.15.112:0/772515767 shutdown_connections 2024-09-12T02:48:32.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.526+0000 7faa78e00640 1 -- 172.21.15.112:0/772515767 wait complete. 2024-09-12T02:48:32.610 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-12T02:48:32.610 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-12T02:48:32.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.762+0000 7fd067800640 1 Processor -- start 2024-09-12T02:48:32.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.762+0000 7fd067800640 1 -- start start 2024-09-12T02:48:32.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.763+0000 7fd067800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd06006e050 0x7fd0600cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:32.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.764+0000 7fd067800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd060071ff0 0x7fd06006e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:32.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.764+0000 7fd067800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd06015b6a0 con 0x7fd06006e970 2024-09-12T02:48:32.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.764+0000 7fd067800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd0600b43b0 con 0x7fd06006e050 2024-09-12T02:48:32.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.764+0000 7fd067800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd0600b3a80 con 0x7fd060071ff0 2024-09-12T02:48:32.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.764+0000 7fd065800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd06006e970 0x7fd0600b4840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:43954/0 (socket says 172.21.15.112:43954) 2024-09-12T02:48:32.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.764+0000 7fd065800640 1 -- 172.21.15.112:0/3688824253 learned_addr learned my addr 172.21.15.112:0/3688824253 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:32.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.764+0000 7fd064e00640 1 --2- 172.21.15.112:0/3688824253 >> v2:172.21.15.137:3300/0 conn(0x7fd06006e050 0x7fd0600cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:32.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.764+0000 7fd057e00640 1 --2- 172.21.15.112:0/3688824253 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd060071ff0 0x7fd06006e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:32.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.764+0000 7fd05fe00640 1 -- 172.21.15.112:0/3688824253 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4262186149 0 0) 0x7fd06015b6a0 con 0x7fd06006e970 2024-09-12T02:48:32.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.764+0000 7fd05fe00640 1 -- 172.21.15.112:0/3688824253 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd044003520 con 0x7fd06006e970 2024-09-12T02:48:32.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.765+0000 7fd064e00640 1 -- 172.21.15.112:0/3688824253 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd060071ff0 msgr2=0x7fd06006e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:32.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.765+0000 7fd064e00640 1 --2- 172.21.15.112:0/3688824253 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd060071ff0 0x7fd06006e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.765+0000 7fd064e00640 1 -- 172.21.15.112:0/3688824253 >> v1:172.21.15.112:6789/0 conn(0x7fd06006e970 legacy=0x7fd0600b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:32.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.765+0000 7fd064e00640 1 -- 172.21.15.112:0/3688824253 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0600b3d60 con 0x7fd06006e050 2024-09-12T02:48:32.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.765+0000 7fd057e00640 1 --2- 172.21.15.112:0/3688824253 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd060071ff0 0x7fd06006e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:32.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.766+0000 7fd064e00640 1 --2- 172.21.15.112:0/3688824253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd06006e050 0x7fd0600cfff0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd0500097a0 tx=0x7fd05002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6adf8df1ca43522d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:32.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.766+0000 7fd05fe00640 1 -- 172.21.15.112:0/3688824253 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd050037070 con 0x7fd06006e050 2024-09-12T02:48:32.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.766+0000 7fd05fe00640 1 -- 172.21.15.112:0/3688824253 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd050032440 con 0x7fd06006e050 2024-09-12T02:48:32.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.766+0000 7fd05fe00640 1 -- 172.21.15.112:0/3688824253 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd050032810 con 0x7fd06006e050 2024-09-12T02:48:32.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.766+0000 7fd067800640 1 -- 172.21.15.112:0/3688824253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd06006e050 msgr2=0x7fd0600cfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:32.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.766+0000 7fd067800640 1 --2- 172.21.15.112:0/3688824253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd06006e050 0x7fd0600cfff0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd0500097a0 tx=0x7fd05002a180 comp rx=0 tx=0).stop 2024-09-12T02:48:32.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.767+0000 7fd067800640 1 -- 172.21.15.112:0/3688824253 shutdown_connections 2024-09-12T02:48:32.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.767+0000 7fd067800640 1 --2- 172.21.15.112:0/3688824253 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd060071ff0 0x7fd06006e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.767+0000 7fd067800640 1 --2- 172.21.15.112:0/3688824253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd06006e050 0x7fd0600cfff0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.767+0000 7fd067800640 1 -- 172.21.15.112:0/3688824253 >> 172.21.15.112:0/3688824253 conn(0x7fd06006bbd0 msgr2=0x7fd06006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:32.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.767+0000 7fd067800640 1 -- 172.21.15.112:0/3688824253 shutdown_connections 2024-09-12T02:48:32.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.767+0000 7fd067800640 1 -- 172.21.15.112:0/3688824253 wait complete. 2024-09-12T02:48:32.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.768+0000 7fd067800640 1 Processor -- start 2024-09-12T02:48:32.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.768+0000 7fd067800640 1 -- start start 2024-09-12T02:48:32.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.769+0000 7fd067800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd06006e050 0x7fd0600ce390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:32.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.769+0000 7fd067800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd06006e970 0x7fd0600c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:32.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.769+0000 7fd067800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd060071ff0 0x7fd0600c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:32.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.769+0000 7fd067800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd06006d550 con 0x7fd06006e970 2024-09-12T02:48:32.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.769+0000 7fd067800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd0600d0530 con 0x7fd060071ff0 2024-09-12T02:48:32.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.769+0000 7fd067800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd06006d6d0 con 0x7fd06006e050 2024-09-12T02:48:32.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.770+0000 7fd057e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd06006e970 0x7fd0600c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:32.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.770+0000 7fd057e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd06006e970 0x7fd0600c68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58528/0 (socket says 172.21.15.112:58528) 2024-09-12T02:48:32.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.770+0000 7fd057e00640 1 -- 172.21.15.112:0/3501350240 learned_addr learned my addr 172.21.15.112:0/3501350240 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:32.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.770+0000 7fd065800640 1 --2- 172.21.15.112:0/3501350240 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd060071ff0 0x7fd0600c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:32.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.770+0000 7fd064e00640 1 --2- 172.21.15.112:0/3501350240 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd06006e050 0x7fd0600ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:32.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.770+0000 7fd057e00640 1 -- 172.21.15.112:0/3501350240 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd06006e050 msgr2=0x7fd0600ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:32.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.770+0000 7fd057e00640 1 --2- 172.21.15.112:0/3501350240 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd06006e050 0x7fd0600ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.770+0000 7fd057e00640 1 -- 172.21.15.112:0/3501350240 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd060071ff0 msgr2=0x7fd0600c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:32.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.770+0000 7fd057e00640 1 --2- 172.21.15.112:0/3501350240 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd060071ff0 0x7fd0600c8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.770+0000 7fd057e00640 1 -- 172.21.15.112:0/3501350240 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd06015d030 con 0x7fd06006e970 2024-09-12T02:48:32.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.770+0000 7fd057e00640 1 --2- 172.21.15.112:0/3501350240 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd06006e970 0x7fd0600c68a0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fd04800e900 tx=0x7fd04800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:32.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.770+0000 7fd05d600640 1 -- 172.21.15.112:0/3501350240 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04800ca00 con 0x7fd06006e970 2024-09-12T02:48:32.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.771+0000 7fd05d600640 1 -- 172.21.15.112:0/3501350240 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd04800cba0 con 0x7fd06006e970 2024-09-12T02:48:32.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.771+0000 7fd05d600640 1 -- 172.21.15.112:0/3501350240 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048005990 con 0x7fd06006e970 2024-09-12T02:48:32.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.771+0000 7fd067800640 1 -- 172.21.15.112:0/3501350240 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd06015d310 con 0x7fd06006e970 2024-09-12T02:48:32.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.771+0000 7fd067800640 1 -- 172.21.15.112:0/3501350240 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd06014d180 con 0x7fd06006e970 2024-09-12T02:48:32.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.772+0000 7fd067800640 1 -- 172.21.15.112:0/3501350240 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd060068a30 con 0x7fd06006e970 2024-09-12T02:48:32.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.772+0000 7fd05d600640 1 -- 172.21.15.112:0/3501350240 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd048005b30 con 0x7fd06006e970 2024-09-12T02:48:32.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.773+0000 7fd05d600640 1 --2- 172.21.15.112:0/3501350240 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd03c06be30 0x7fd03c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:32.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.773+0000 7fd05d600640 1 -- 172.21.15.112:0/3501350240 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7fd04808b250 con 0x7fd06006e970 2024-09-12T02:48:32.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.774+0000 7fd064e00640 1 --2- 172.21.15.112:0/3501350240 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd03c06be30 0x7fd03c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:32.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.774+0000 7fd064e00640 1 --2- 172.21.15.112:0/3501350240 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd03c06be30 0x7fd03c06e2f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd050034000 tx=0x7fd05002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:32.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.778+0000 7fd05d600640 1 -- 172.21.15.112:0/3501350240 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd048017020 con 0x7fd06006e970 2024-09-12T02:48:32.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.949+0000 7fd067800640 1 -- 172.21.15.112:0/3501350240 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fd06014e390 con 0x7fd06006e970 2024-09-12T02:48:32.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.951+0000 7fd05d600640 1 -- 172.21.15.112:0/3501350240 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v138) ==== 81+0+34274 (secure 0 0 0) 0x7fd048059510 con 0x7fd06006e970 2024-09-12T02:48:32.952 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:32.952 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:48:32.952 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 138, 2024-09-12T02:48:32.952 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:48:32.953 INFO:teuthology.orchestra.run.smithi112.stdout: "created": "2024-09-12T02:41:36.162095+0000", 2024-09-12T02:48:32.953 INFO:teuthology.orchestra.run.smithi112.stdout: "modified": "2024-09-12T02:48:31.006261+0000", 2024-09-12T02:48:32.953 INFO:teuthology.orchestra.run.smithi112.stdout: "last_up_change": "2024-09-12T02:41:42.191169+0000", 2024-09-12T02:48:32.953 INFO:teuthology.orchestra.run.smithi112.stdout: "last_in_change": "2024-09-12T02:41:39.036600+0000", 2024-09-12T02:48:32.953 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:48:32.953 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_num": 5799936, 2024-09-12T02:48:32.953 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_set": [ 2024-09-12T02:48:32.953 INFO:teuthology.orchestra.run.smithi112.stdout: "pglog_hardlimit", 2024-09-12T02:48:32.953 INFO:teuthology.orchestra.run.smithi112.stdout: "purged_snapdirs", 2024-09-12T02:48:32.953 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_deletes", 2024-09-12T02:48:32.953 INFO:teuthology.orchestra.run.smithi112.stdout: "sortbitwise" 2024-09-12T02:48:32.953 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:48:32.953 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_version": 4, 2024-09-12T02:48:32.954 INFO:teuthology.orchestra.run.smithi112.stdout: "full_ratio": 0.69999998807907104, 2024-09-12T02:48:32.954 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-12T02:48:32.954 INFO:teuthology.orchestra.run.smithi112.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-12T02:48:32.954 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_snapshot": "", 2024-09-12T02:48:32.954 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_max": 17, 2024-09-12T02:48:32.954 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd": 8, 2024-09-12T02:48:32.954 INFO:teuthology.orchestra.run.smithi112.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:48:32.954 INFO:teuthology.orchestra.run.smithi112.stdout: "min_compat_client": "jewel", 2024-09-12T02:48:32.954 INFO:teuthology.orchestra.run.smithi112.stdout: "require_osd_release": "squid", 2024-09-12T02:48:32.954 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_crimson": false, 2024-09-12T02:48:32.954 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-12T02:48:32.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.954 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 1, 2024-09-12T02:48:32.955 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": ".mgr", 2024-09-12T02:48:32.955 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:41:43.011599+0000", 2024-09-12T02:48:32.955 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:48:32.955 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:48:32.955 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:48:32.955 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:48:32.955 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:48:32.955 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:48:32.955 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:48:32.955 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:48:32.955 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:48:32.955 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:48:32.955 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:48:32.956 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:48:32.956 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:48:32.956 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 1, 2024-09-12T02:48:32.956 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 1, 2024-09-12T02:48:32.956 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 1, 2024-09-12T02:48:32.956 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 1, 2024-09-12T02:48:32.956 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 1, 2024-09-12T02:48:32.956 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:48:32.956 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:48:32.956 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:48:32.956 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:48:32.956 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:48:32.956 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:48:32.957 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:48:32.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.957 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "109", 2024-09-12T02:48:32.957 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:48:32.957 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:48:32.957 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:48:32.957 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:48:32.957 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:48:32.957 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:48:32.957 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:48:32.957 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:48:32.957 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:48:32.958 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:48:32.958 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:48:32.958 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:48:32.958 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:48:32.958 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:48:32.958 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:48:32.958 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:48:32.958 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:48:32.958 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:48:32.958 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:48:32.958 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:48:32.958 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:48:32.958 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:48:32.958 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:48:32.959 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:48:32.959 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:48:32.959 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:48:32.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.959 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:48:32.959 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:48:32.959 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:48:32.959 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:48:32.959 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:48:32.959 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:48:32.959 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:48:32.959 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:48:32.959 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:48:32.959 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:48:32.960 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:48:32.960 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:48:32.960 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_max": 32, 2024-09-12T02:48:32.960 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 1 2024-09-12T02:48:32.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.960 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:48:32.960 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": {} 2024-09-12T02:48:32.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.960 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:48:32.960 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:48:32.960 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 8, 2024-09-12T02:48:32.960 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 8, 2024-09-12T02:48:32.960 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 0.25, 2024-09-12T02:48:32.961 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:48:32.961 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:48:32.961 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:48:32.961 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:48:32.961 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:48:32.961 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.961 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 16, 2024-09-12T02:48:32.961 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:48:32.961 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:47:55.641315+0000", 2024-09-12T02:48:32.961 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:48:32.961 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:48:32.961 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:48:32.962 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:48:32.962 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:48:32.962 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:48:32.962 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:48:32.962 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:48:32.962 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:48:32.962 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:48:32.962 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:48:32.962 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:48:32.962 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:48:32.962 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 32, 2024-09-12T02:48:32.962 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 32, 2024-09-12T02:48:32.962 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 32, 2024-09-12T02:48:32.962 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 32, 2024-09-12T02:48:32.963 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 32, 2024-09-12T02:48:32.963 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:48:32.963 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:48:32.963 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:48:32.963 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:48:32.963 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:48:32.963 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:48:32.963 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:48:32.963 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.963 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "134", 2024-09-12T02:48:32.963 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:48:32.963 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:48:32.963 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:48:32.964 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:48:32.964 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:48:32.964 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:48:32.964 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:48:32.964 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:48:32.964 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:48:32.964 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:48:32.964 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:48:32.964 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:48:32.964 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:48:32.964 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:48:32.964 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:48:32.964 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:48:32.964 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:48:32.965 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:48:32.965 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:48:32.965 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:48:32.965 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:48:32.965 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:48:32.965 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:48:32.965 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:48:32.965 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:48:32.965 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:48:32.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.965 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:48:32.965 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:48:32.965 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:48:32.965 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:48:32.966 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:48:32.966 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:48:32.966 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:48:32.966 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:48:32.966 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:48:32.966 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:48:32.966 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:48:32.966 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:48:32.966 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:48:32.966 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 16, 2024-09-12T02:48:32.966 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_priority": 5 2024-09-12T02:48:32.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.966 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:48:32.966 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:48:32.967 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": "cephfs" 2024-09-12T02:48:32.967 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.967 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:48:32.967 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:48:32.967 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.75, 2024-09-12T02:48:32.967 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.75, 2024-09-12T02:48:32.967 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:48:32.967 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.75, 2024-09-12T02:48:32.967 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.75, 2024-09-12T02:48:32.967 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:48:32.967 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:48:32.967 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:48:32.967 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.968 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 17, 2024-09-12T02:48:32.968 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_data", 2024-09-12T02:48:32.968 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:47:56.867038+0000", 2024-09-12T02:48:32.968 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:48:32.968 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:48:32.968 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:48:32.968 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:48:32.968 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:48:32.968 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:48:32.968 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:48:32.968 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:48:32.968 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:48:32.969 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:48:32.969 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:48:32.969 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:48:32.969 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:48:32.969 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 64, 2024-09-12T02:48:32.969 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 64, 2024-09-12T02:48:32.969 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 64, 2024-09-12T02:48:32.969 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 64, 2024-09-12T02:48:32.969 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 64, 2024-09-12T02:48:32.969 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:48:32.969 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:48:32.969 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:48:32.969 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:48:32.969 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:48:32.970 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:48:32.970 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:48:32.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.970 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "138", 2024-09-12T02:48:32.970 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:48:32.970 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:48:32.970 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:48:32.970 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:48:32.970 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:48:32.970 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:48:32.970 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:48:32.970 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:48:32.970 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:48:32.971 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 33554432, 2024-09-12T02:48:32.971 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:48:32.971 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:48:32.971 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:48:32.971 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:48:32.971 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:48:32.971 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:48:32.971 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:48:32.971 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:48:32.971 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:48:32.971 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:48:32.971 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:48:32.971 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:48:32.971 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:48:32.972 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:48:32.972 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:48:32.972 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:48:32.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.972 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:48:32.972 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:48:32.972 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:48:32.972 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:48:32.972 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:48:32.972 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:48:32.972 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:48:32.972 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:48:32.972 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:48:32.973 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:48:32.973 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:48:32.973 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:48:32.973 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 64, 2024-09-12T02:48:32.973 INFO:teuthology.orchestra.run.smithi112.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:48:32.973 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.973 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:48:32.973 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:48:32.973 INFO:teuthology.orchestra.run.smithi112.stdout: "data": "cephfs" 2024-09-12T02:48:32.973 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.973 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.973 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:48:32.973 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:48:32.974 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.75, 2024-09-12T02:48:32.974 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.75, 2024-09-12T02:48:32.974 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:48:32.974 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.75, 2024-09-12T02:48:32.974 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.75, 2024-09-12T02:48:32.974 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:48:32.974 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:48:32.974 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:48:32.974 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.974 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.974 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:48:32.974 INFO:teuthology.orchestra.run.smithi112.stdout: "osds": [ 2024-09-12T02:48:32.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.974 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:48:32.975 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:32.975 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:32.975 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:32.975 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:32.975 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:32.975 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:32.975 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:32.975 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:32.975 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:32.975 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:32.975 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:32.975 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:32.975 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.975 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.976 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.976 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6800", 2024-09-12T02:48:32.976 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:32.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.976 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.976 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6801", 2024-09-12T02:48:32.976 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:32.976 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.976 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.976 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:32.976 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.977 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.977 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6802", 2024-09-12T02:48:32.977 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:32.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.977 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.977 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6803", 2024-09-12T02:48:32.977 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:32.977 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.977 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.977 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:32.977 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.978 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.978 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.978 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6806", 2024-09-12T02:48:32.978 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:32.978 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.978 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.978 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.978 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6807", 2024-09-12T02:48:32.978 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:32.978 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.978 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.978 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.978 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:32.978 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.979 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.979 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6804", 2024-09-12T02:48:32.979 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:32.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.979 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.979 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6805", 2024-09-12T02:48:32.979 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:48:32.979 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.979 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.979 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6801/821571304", 2024-09-12T02:48:32.980 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6803/821571304", 2024-09-12T02:48:32.980 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6807/821571304", 2024-09-12T02:48:32.980 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6805/821571304", 2024-09-12T02:48:32.980 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:32.980 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:32.980 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:32.980 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.980 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:48:32.980 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:32.980 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:32.980 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:32.980 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:32.981 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:32.981 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:32.981 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:32.981 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:32.981 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:32.981 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:32.981 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:32.981 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:32.981 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.981 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.981 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6808", 2024-09-12T02:48:32.981 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:32.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.982 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.982 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6809", 2024-09-12T02:48:32.982 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:32.982 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.982 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.982 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:32.982 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.982 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.982 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6810", 2024-09-12T02:48:32.982 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:32.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.983 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.983 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6811", 2024-09-12T02:48:32.983 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:32.983 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.983 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.983 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:32.983 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.983 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.983 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6814", 2024-09-12T02:48:32.983 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:32.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.984 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.984 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6815", 2024-09-12T02:48:32.984 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:32.984 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.984 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.984 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:32.984 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.984 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.984 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6812", 2024-09-12T02:48:32.985 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:32.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.985 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.985 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6813", 2024-09-12T02:48:32.985 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:48:32.985 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.985 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.985 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6809/2642068641", 2024-09-12T02:48:32.985 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6811/2642068641", 2024-09-12T02:48:32.985 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6815/2642068641", 2024-09-12T02:48:32.985 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6813/2642068641", 2024-09-12T02:48:32.986 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:32.986 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:32.986 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:32.986 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.986 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:48:32.986 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:32.986 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:32.986 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:32.986 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:32.986 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:32.986 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:32.987 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:32.987 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:32.987 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:32.987 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:32.987 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:32.987 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:32.987 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.987 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.987 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6816", 2024-09-12T02:48:32.987 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:32.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.987 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.988 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6817", 2024-09-12T02:48:32.988 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:32.988 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.988 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.988 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:32.988 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.988 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.988 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6818", 2024-09-12T02:48:32.988 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:32.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.989 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.989 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6819", 2024-09-12T02:48:32.989 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:32.989 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.989 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.989 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:32.989 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.989 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.989 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6822", 2024-09-12T02:48:32.989 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:32.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.990 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.990 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6823", 2024-09-12T02:48:32.990 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:32.990 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.990 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.990 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:32.990 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.990 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.990 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6820", 2024-09-12T02:48:32.991 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:32.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.991 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.991 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6821", 2024-09-12T02:48:32.991 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:48:32.991 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.991 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.991 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6817/3365688807", 2024-09-12T02:48:32.991 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6819/3365688807", 2024-09-12T02:48:32.991 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6823/3365688807", 2024-09-12T02:48:32.991 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6821/3365688807", 2024-09-12T02:48:32.991 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:32.992 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:32.992 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:32.992 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.992 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:48:32.992 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:32.992 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:32.992 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:32.992 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:32.992 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:32.992 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:32.992 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:32.993 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:32.993 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:32.993 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:32.993 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:32.993 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:32.993 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.993 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.993 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6824", 2024-09-12T02:48:32.993 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:32.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.993 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.994 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6825", 2024-09-12T02:48:32.994 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:32.994 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.994 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.994 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:32.994 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.994 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.994 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6826", 2024-09-12T02:48:32.994 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:32.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.994 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.995 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6827", 2024-09-12T02:48:32.995 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:32.995 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.995 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.995 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:32.995 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.995 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.995 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6830", 2024-09-12T02:48:32.995 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:32.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.995 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.996 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6831", 2024-09-12T02:48:32.996 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:32.996 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.996 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.996 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:32.996 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.996 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.996 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6828", 2024-09-12T02:48:32.996 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:32.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.996 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.997 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6829", 2024-09-12T02:48:32.997 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:48:32.997 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.997 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.997 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6825/231774278", 2024-09-12T02:48:32.997 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6827/231774278", 2024-09-12T02:48:32.997 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6831/231774278", 2024-09-12T02:48:32.997 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6829/231774278", 2024-09-12T02:48:32.997 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:32.997 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:32.997 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:32.997 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.998 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.998 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:48:32.998 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:32.998 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:32.998 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:32.998 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:32.998 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:32.998 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:32.998 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:32.998 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:32.998 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:32.998 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:32.998 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:32.998 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:32.999 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:32.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.999 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:32.999 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6800", 2024-09-12T02:48:32.999 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:32.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:32.999 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:32.999 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6801", 2024-09-12T02:48:32.999 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:32.999 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:32.999 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:32.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:32.999 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:33.000 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:33.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.000 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:33.000 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6802", 2024-09-12T02:48:33.000 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:33.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.000 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:33.000 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6803", 2024-09-12T02:48:33.000 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:33.000 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:33.000 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:33.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.000 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:33.001 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:33.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.001 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:33.001 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6806", 2024-09-12T02:48:33.001 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:33.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.001 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:33.001 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6807", 2024-09-12T02:48:33.001 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:33.001 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:33.001 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:33.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.002 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:33.002 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:33.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.002 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:33.002 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6804", 2024-09-12T02:48:33.002 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:33.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.002 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:33.002 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6805", 2024-09-12T02:48:33.002 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:48:33.002 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:33.002 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:33.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.003 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6801/3671178153", 2024-09-12T02:48:33.003 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6803/3671178153", 2024-09-12T02:48:33.003 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6807/3671178153", 2024-09-12T02:48:33.003 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6805/3671178153", 2024-09-12T02:48:33.003 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:33.003 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:33.003 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:33.003 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:33.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.003 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:48:33.003 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:33.003 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:33.003 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:33.004 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:33.004 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:33.004 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:33.004 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:33.004 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:33.004 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:33.004 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:33.004 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:33.004 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:33.004 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:33.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.004 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:33.004 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6808", 2024-09-12T02:48:33.005 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:33.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.005 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:33.005 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6809", 2024-09-12T02:48:33.005 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:33.005 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:33.005 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:33.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.005 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:33.005 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:33.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.005 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:33.005 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6810", 2024-09-12T02:48:33.006 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:33.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.006 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:33.006 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6811", 2024-09-12T02:48:33.006 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:33.006 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:33.006 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:33.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.006 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:33.006 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:33.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.006 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:33.007 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6817", 2024-09-12T02:48:33.007 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:33.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.007 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:33.007 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6819", 2024-09-12T02:48:33.007 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:33.007 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:33.007 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:33.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.007 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:33.007 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:33.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.007 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:33.008 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6812", 2024-09-12T02:48:33.008 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:33.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.008 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:33.008 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6815", 2024-09-12T02:48:33.008 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:48:33.008 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:33.008 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:33.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.008 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6809/3193706134", 2024-09-12T02:48:33.008 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6811/3193706134", 2024-09-12T02:48:33.008 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6819/3193706134", 2024-09-12T02:48:33.009 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6815/3193706134", 2024-09-12T02:48:33.009 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:33.009 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:33.009 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:33.009 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:33.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.009 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:48:33.009 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:33.009 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:33.009 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:33.009 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:33.009 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:33.009 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:33.010 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:33.010 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:33.010 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:33.010 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:33.010 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:33.010 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:33.010 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:33.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.010 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:33.010 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6813", 2024-09-12T02:48:33.010 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:33.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.010 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:33.011 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6814", 2024-09-12T02:48:33.011 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:33.011 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:33.011 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:33.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.011 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:33.011 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:33.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.011 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:33.011 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6816", 2024-09-12T02:48:33.011 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:33.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.011 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:33.012 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6818", 2024-09-12T02:48:33.012 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:33.012 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:33.012 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:33.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.012 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:33.012 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:33.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.012 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:33.012 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6822", 2024-09-12T02:48:33.012 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:33.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.013 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:33.013 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6823", 2024-09-12T02:48:33.013 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:33.013 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:33.013 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:33.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.013 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:33.013 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:33.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.013 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:33.013 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6820", 2024-09-12T02:48:33.013 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:33.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.014 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:33.014 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6821", 2024-09-12T02:48:33.014 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:48:33.014 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:33.014 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:33.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.014 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6814/3738813293", 2024-09-12T02:48:33.014 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6818/3738813293", 2024-09-12T02:48:33.014 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6823/3738813293", 2024-09-12T02:48:33.014 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6821/3738813293", 2024-09-12T02:48:33.014 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:33.014 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:33.014 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:33.015 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:33.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.015 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:48:33.015 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:48:33.015 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:48:33.015 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:48:33.015 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:48:33.015 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:48:33.015 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:48:33.015 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:48:33.016 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:48:33.016 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 133, 2024-09-12T02:48:33.016 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:48:33.016 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:48:33.016 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:48:33.016 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:33.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.016 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:33.016 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6824", 2024-09-12T02:48:33.016 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:33.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.017 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:33.017 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6825", 2024-09-12T02:48:33.017 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:33.017 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:33.017 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:33.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.017 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:48:33.017 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:33.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.018 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:33.018 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6826", 2024-09-12T02:48:33.018 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:33.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.018 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:33.018 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6827", 2024-09-12T02:48:33.018 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:33.018 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:33.018 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:33.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.018 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:48:33.018 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:33.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.019 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:33.019 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6830", 2024-09-12T02:48:33.019 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:33.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.019 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:33.019 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6831", 2024-09-12T02:48:33.019 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:33.019 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:33.019 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:33.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.019 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:48:33.019 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:48:33.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.020 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:48:33.020 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6828", 2024-09-12T02:48:33.020 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:33.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.020 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:48:33.020 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6829", 2024-09-12T02:48:33.020 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:48:33.020 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:33.020 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:33.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.021 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6825/1421932609", 2024-09-12T02:48:33.021 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6827/1421932609", 2024-09-12T02:48:33.021 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6831/1421932609", 2024-09-12T02:48:33.021 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6829/1421932609", 2024-09-12T02:48:33.021 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:48:33.021 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:48:33.021 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:48:33.021 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:33.021 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:33.021 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:48:33.021 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_xinfo": [ 2024-09-12T02:48:33.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.021 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:48:33.022 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:33.022 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:33.022 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:33.022 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:33.022 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:33.022 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.220641+0000", 2024-09-12T02:48:33.022 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:33.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.022 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:48:33.022 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:33.022 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:33.022 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:33.022 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:33.023 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:33.023 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312574+0000", 2024-09-12T02:48:33.023 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:33.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.023 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:48:33.023 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:33.023 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:33.023 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:33.023 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:33.023 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:33.023 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.282771+0000", 2024-09-12T02:48:33.023 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:33.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.024 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:48:33.024 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:33.024 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:33.024 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:33.024 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:33.024 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:33.024 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.260478+0000", 2024-09-12T02:48:33.024 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:33.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.024 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:48:33.024 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:33.024 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:33.025 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:33.025 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:33.025 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:33.025 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.273397+0000", 2024-09-12T02:48:33.025 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:33.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.025 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:48:33.025 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:33.025 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:33.025 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:33.025 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:33.025 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:33.026 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312452+0000", 2024-09-12T02:48:33.026 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:33.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.026 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:48:33.026 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:33.026 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:33.026 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:33.026 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:33.026 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:33.026 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.308965+0000", 2024-09-12T02:48:33.026 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:33.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:33.027 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:48:33.027 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:48:33.027 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:48:33.027 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:48:33.027 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:48:33.027 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:48:33.027 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.337842+0000", 2024-09-12T02:48:33.027 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:48:33.027 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:33.027 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:48:33.027 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap": [], 2024-09-12T02:48:33.027 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_items": [], 2024-09-12T02:48:33.027 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_primaries": [], 2024-09-12T02:48:33.027 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_temp": [], 2024-09-12T02:48:33.028 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_temp": [], 2024-09-12T02:48:33.028 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklist": {}, 2024-09-12T02:48:33.028 INFO:teuthology.orchestra.run.smithi112.stdout: "range_blocklist": {}, 2024-09-12T02:48:33.028 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profiles": { 2024-09-12T02:48:33.028 INFO:teuthology.orchestra.run.smithi112.stdout: "default": { 2024-09-12T02:48:33.028 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-failure-domain": "osd", 2024-09-12T02:48:33.028 INFO:teuthology.orchestra.run.smithi112.stdout: "k": "2", 2024-09-12T02:48:33.028 INFO:teuthology.orchestra.run.smithi112.stdout: "m": "1", 2024-09-12T02:48:33.028 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin": "jerasure", 2024-09-12T02:48:33.028 INFO:teuthology.orchestra.run.smithi112.stdout: "technique": "reed_sol_van" 2024-09-12T02:48:33.028 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:33.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:33.028 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps_queue": [], 2024-09-12T02:48:33.028 INFO:teuthology.orchestra.run.smithi112.stdout: "new_removed_snaps": [], 2024-09-12T02:48:33.029 INFO:teuthology.orchestra.run.smithi112.stdout: "new_purged_snaps": [], 2024-09-12T02:48:33.029 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_node_flags": {}, 2024-09-12T02:48:33.029 INFO:teuthology.orchestra.run.smithi112.stdout: "device_class_flags": {}, 2024-09-12T02:48:33.029 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode": { 2024-09-12T02:48:33.029 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_enabled": false, 2024-09-12T02:48:33.029 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_bucket_count": 0, 2024-09-12T02:48:33.029 INFO:teuthology.orchestra.run.smithi112.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:48:33.029 INFO:teuthology.orchestra.run.smithi112.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:48:33.029 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_bucket": 0 2024-09-12T02:48:33.029 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:33.029 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:48:33.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.953+0000 7fd067800640 1 -- 172.21.15.112:0/3501350240 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd03c06be30 msgr2=0x7fd03c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:33.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.953+0000 7fd067800640 1 --2- 172.21.15.112:0/3501350240 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd03c06be30 0x7fd03c06e2f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd050034000 tx=0x7fd05002e000 comp rx=0 tx=0).stop 2024-09-12T02:48:33.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.953+0000 7fd067800640 1 -- 172.21.15.112:0/3501350240 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd06006e970 msgr2=0x7fd0600c68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:33.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.953+0000 7fd067800640 1 --2- 172.21.15.112:0/3501350240 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd06006e970 0x7fd0600c68a0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fd04800e900 tx=0x7fd04800edc0 comp rx=0 tx=0).stop 2024-09-12T02:48:33.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.953+0000 7fd067800640 1 -- 172.21.15.112:0/3501350240 shutdown_connections 2024-09-12T02:48:33.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.953+0000 7fd067800640 1 --2- 172.21.15.112:0/3501350240 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd03c06be30 0x7fd03c06e2f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:33.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.953+0000 7fd067800640 1 --2- 172.21.15.112:0/3501350240 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd060071ff0 0x7fd0600c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:33.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.953+0000 7fd067800640 1 --2- 172.21.15.112:0/3501350240 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd06006e970 0x7fd0600c68a0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:33.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.953+0000 7fd067800640 1 --2- 172.21.15.112:0/3501350240 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd06006e050 0x7fd0600ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:33.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.953+0000 7fd067800640 1 -- 172.21.15.112:0/3501350240 >> 172.21.15.112:0/3501350240 conn(0x7fd06006bbd0 msgr2=0x7fd0600cd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:33.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.953+0000 7fd067800640 1 -- 172.21.15.112:0/3501350240 shutdown_connections 2024-09-12T02:48:33.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:32.953+0000 7fd067800640 1 -- 172.21.15.112:0/3501350240 wait complete. 2024-09-12T02:48:33.033 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:48:33.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.183+0000 7f57b6800640 1 Processor -- start 2024-09-12T02:48:33.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.183+0000 7f57b6800640 1 -- start start 2024-09-12T02:48:33.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.184+0000 7f57b6800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f57b00afe30 0x7f57b00cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:33.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.185+0000 7f57b6800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57b00ceeb0 con 0x7f57b0071530 2024-09-12T02:48:33.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.185+0000 7f57b6800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57b006e300 con 0x7f57b015cc50 2024-09-12T02:48:33.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.185+0000 7f57b6800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f57b015d030 con 0x7f57b00afe30 2024-09-12T02:48:33.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.185+0000 7f57a7e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f57b0071530 0x7f57b00af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:43960/0 (socket says 172.21.15.112:43960) 2024-09-12T02:48:33.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.185+0000 7f57a7e00640 1 -- 172.21.15.112:0/2691941299 learned_addr learned my addr 172.21.15.112:0/2691941299 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:33.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.185+0000 7f57afe00640 1 --2- 172.21.15.112:0/2691941299 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f57b00afe30 0x7f57b00cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:33.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.185+0000 7f57aea00640 1 -- 172.21.15.112:0/2691941299 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2362313757 0 0) 0x7f57b00ceeb0 con 0x7f57b0071530 2024-09-12T02:48:33.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.185+0000 7f57aea00640 1 -- 172.21.15.112:0/2691941299 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5794003520 con 0x7f57b0071530 2024-09-12T02:48:33.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.185+0000 7f57aea00640 1 -- 172.21.15.112:0/2691941299 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 327022012 0 0) 0x7f57b006e300 con 0x7f57b015cc50 2024-09-12T02:48:33.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.185+0000 7f57aea00640 1 -- 172.21.15.112:0/2691941299 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57b00ceeb0 con 0x7f57b015cc50 2024-09-12T02:48:33.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.186+0000 7f57aea00640 1 -- 172.21.15.112:0/2691941299 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2892473470 0 0) 0x7f5794003520 con 0x7f57b0071530 2024-09-12T02:48:33.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.186+0000 7f57aea00640 1 -- 172.21.15.112:0/2691941299 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f57b00afe30 msgr2=0x7f57b00cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:33.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.186+0000 7f57aea00640 1 --2- 172.21.15.112:0/2691941299 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f57b00afe30 0x7f57b00cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:33.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.186+0000 7f57aea00640 1 -- 172.21.15.112:0/2691941299 >> v1:172.21.15.137:6789/0 conn(0x7f57b015cc50 legacy=0x7f57b00732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:33.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.186+0000 7f57aea00640 1 -- 172.21.15.112:0/2691941299 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b006e5e0 con 0x7f57b0071530 2024-09-12T02:48:33.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.186+0000 7f57aea00640 1 -- 172.21.15.112:0/2691941299 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f57980017f0 con 0x7f57b0071530 2024-09-12T02:48:33.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.186+0000 7f57aea00640 1 -- 172.21.15.112:0/2691941299 >> v1:172.21.15.112:6789/0 conn(0x7f57b0071530 legacy=0x7f57b00af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:33.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.186+0000 7f57aea00640 1 --2- 172.21.15.112:0/2691941299 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5794003b70 0x7f5794003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:33.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.186+0000 7f57aea00640 1 --2- 172.21.15.112:0/2691941299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5794004800 0x7f5794004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:33.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.186+0000 7f57aea00640 1 --2- 172.21.15.112:0/2691941299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f57940051c0 0x7f579400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:33.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.186+0000 7f57aea00640 1 -- 172.21.15.112:0/2691941299 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f579400c000 con 0x7f5794004800 2024-09-12T02:48:33.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.186+0000 7f57aea00640 1 -- 172.21.15.112:0/2691941299 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f579400c1b0 con 0x7f57940051c0 2024-09-12T02:48:33.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.186+0000 7f57aea00640 1 -- 172.21.15.112:0/2691941299 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f579400c3b0 con 0x7f5794003b70 2024-09-12T02:48:33.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.186+0000 7f57a7e00640 1 --2- 172.21.15.112:0/2691941299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5794004800 0x7f5794004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:33.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.186+0000 7f57af400640 1 --2- 172.21.15.112:0/2691941299 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5794003b70 0x7f5794003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:33.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.186+0000 7f57afe00640 1 --2- 172.21.15.112:0/2691941299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f57940051c0 0x7f579400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:33.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.186+0000 7f57a7e00640 1 -- 172.21.15.112:0/2691941299 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5794003b70 msgr2=0x7f5794003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:33.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.186+0000 7f57a7e00640 1 --2- 172.21.15.112:0/2691941299 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5794003b70 0x7f5794003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:33.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.186+0000 7f57a7e00640 1 -- 172.21.15.112:0/2691941299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f57940051c0 msgr2=0x7f579400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:33.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.186+0000 7f57a7e00640 1 --2- 172.21.15.112:0/2691941299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f57940051c0 0x7f579400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:33.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.186+0000 7f57a7e00640 1 -- 172.21.15.112:0/2691941299 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5794003520 con 0x7f5794004800 2024-09-12T02:48:33.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.187+0000 7f57a7e00640 1 --2- 172.21.15.112:0/2691941299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5794004800 0x7f5794004c80 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f579800c190 tx=0x7f5794005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=881e854ff70cd04b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:33.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.188+0000 7f57aea00640 1 -- 172.21.15.112:0/2691941299 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5798007c80 con 0x7f5794004800 2024-09-12T02:48:33.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.188+0000 7f57aea00640 1 -- 172.21.15.112:0/2691941299 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5798007270 con 0x7f5794004800 2024-09-12T02:48:33.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.188+0000 7f57aea00640 1 -- 172.21.15.112:0/2691941299 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57980057a0 con 0x7f5794004800 2024-09-12T02:48:33.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.188+0000 7f57b6800640 1 -- 172.21.15.112:0/2691941299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5794004800 msgr2=0x7f5794004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:33.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.188+0000 7f57b6800640 1 --2- 172.21.15.112:0/2691941299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5794004800 0x7f5794004c80 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f579800c190 tx=0x7f5794005830 comp rx=0 tx=0).stop 2024-09-12T02:48:33.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.188+0000 7f57afe00640 1 -- 172.21.15.112:0/2691941299 reap_dead start 2024-09-12T02:48:33.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.188+0000 7f57b6800640 1 -- 172.21.15.112:0/2691941299 shutdown_connections 2024-09-12T02:48:33.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.188+0000 7f57b6800640 1 -- 172.21.15.112:0/2691941299 >> 172.21.15.112:0/2691941299 conn(0x7f57b006bbd0 msgr2=0x7f57b006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:33.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.188+0000 7f57b6800640 1 -- 172.21.15.112:0/2691941299 shutdown_connections 2024-09-12T02:48:33.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.188+0000 7f57b6800640 1 -- 172.21.15.112:0/2691941299 wait complete. 2024-09-12T02:48:33.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.190+0000 7f57b6800640 1 Processor -- start 2024-09-12T02:48:33.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.190+0000 7f57b6800640 1 -- start start 2024-09-12T02:48:33.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.191+0000 7f57b6800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5794004800 0x7f57b0156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:33.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.191+0000 7f57b6800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f57b0155560 0x7f57b013fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:33.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.191+0000 7f57b6800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f57b0140020 0x7f57b01406a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:33.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.191+0000 7f57b6800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f57b006f510 con 0x7f5794004800 2024-09-12T02:48:33.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.191+0000 7f57b6800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f57b00cf4c0 con 0x7f57b0140020 2024-09-12T02:48:33.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.191+0000 7f57b6800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f57b006f690 con 0x7f57b0155560 2024-09-12T02:48:33.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.191+0000 7f57af400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5794004800 0x7f57b0156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:33.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.191+0000 7f57af400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5794004800 0x7f57b0156aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58532/0 (socket says 172.21.15.112:58532) 2024-09-12T02:48:33.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.191+0000 7f57af400640 1 -- 172.21.15.112:0/2206280354 learned_addr learned my addr 172.21.15.112:0/2206280354 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:33.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.192+0000 7f57af400640 1 -- 172.21.15.112:0/2206280354 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f57b0155560 msgr2=0x7f57b013fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:33.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.192+0000 7f57af400640 1 --2- 172.21.15.112:0/2206280354 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f57b0155560 0x7f57b013fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:33.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.192+0000 7f57af400640 1 -- 172.21.15.112:0/2206280354 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f57b0140020 msgr2=0x7f57b01406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:33.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.192+0000 7f57af400640 1 --2- 172.21.15.112:0/2206280354 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f57b0140020 0x7f57b01406a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:33.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.192+0000 7f57af400640 1 -- 172.21.15.112:0/2206280354 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b01413a0 con 0x7f5794004800 2024-09-12T02:48:33.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.192+0000 7f57af400640 1 --2- 172.21.15.112:0/2206280354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5794004800 0x7f57b0156aa0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f57a000f7a0 tx=0x7f57a000fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:33.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.192+0000 7f57a7400640 1 -- 172.21.15.112:0/2206280354 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a001a070 con 0x7f5794004800 2024-09-12T02:48:33.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.192+0000 7f57a7400640 1 -- 172.21.15.112:0/2206280354 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57a000fe50 con 0x7f5794004800 2024-09-12T02:48:33.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.192+0000 7f57b6800640 1 -- 172.21.15.112:0/2206280354 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57b0155a00 con 0x7f5794004800 2024-09-12T02:48:33.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.192+0000 7f57a7400640 1 -- 172.21.15.112:0/2206280354 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a0007050 con 0x7f5794004800 2024-09-12T02:48:33.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.192+0000 7f57b6800640 1 -- 172.21.15.112:0/2206280354 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57b0155fc0 con 0x7f5794004800 2024-09-12T02:48:33.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.193+0000 7f57b6800640 1 -- 172.21.15.112:0/2206280354 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57b0068a30 con 0x7f5794004800 2024-09-12T02:48:33.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.194+0000 7f57a7400640 1 -- 172.21.15.112:0/2206280354 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f57a001d070 con 0x7f5794004800 2024-09-12T02:48:33.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.195+0000 7f57a7400640 1 --2- 172.21.15.112:0/2206280354 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f578c06be30 0x7f578c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:33.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.195+0000 7f57a7400640 1 -- 172.21.15.112:0/2206280354 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7f57a008a650 con 0x7f5794004800 2024-09-12T02:48:33.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.195+0000 7f57a7e00640 1 --2- 172.21.15.112:0/2206280354 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f578c06be30 0x7f578c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:33.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.196+0000 7f57a7e00640 1 --2- 172.21.15.112:0/2206280354 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f578c06be30 0x7f578c06e2f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5798032000 tx=0x7f579802c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:33.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.199+0000 7f57a7400640 1 -- 172.21.15.112:0/2206280354 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f57a0058f60 con 0x7f5794004800 2024-09-12T02:48:33.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.408+0000 7f57b6800640 1 -- 172.21.15.112:0/2206280354 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57b00730d0 con 0x7f5794004800 2024-09-12T02:48:33.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.409+0000 7f57a7400640 1 -- 172.21.15.112:0/2206280354 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+5231 (secure 0 0 0) 0x7f57a0058860 con 0x7f5794004800 2024-09-12T02:48:33.410 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:33.410 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":70,"btime":"2024-09-12T02:48:01:488612+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5816,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1943935405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1943935405},{"type":"v1","addr":"172.21.15.137:6834","nonce":1943935405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6328,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2010766966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2010766966},{"type":"v1","addr":"172.21.15.112:6835","nonce":2010766966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/193655023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":193655023},{"type":"v1","addr":"172.21.15.137:6835","nonce":193655023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:47:57.871200+0000","modified":"2024-09-12T02:48:00.893329+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6861":{"gid":6861,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/134918269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":134918269},{"type":"v1","addr":"172.21.15.112:6837","nonce":134918269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6861,"qdb_cluster":[6861]},"id":8}]} 2024-09-12T02:48:33.410 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 70 2024-09-12T02:48:33.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.411+0000 7f57b6800640 1 -- 172.21.15.112:0/2206280354 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f578c06be30 msgr2=0x7f578c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:33.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.411+0000 7f57b6800640 1 --2- 172.21.15.112:0/2206280354 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f578c06be30 0x7f578c06e2f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5798032000 tx=0x7f579802c000 comp rx=0 tx=0).stop 2024-09-12T02:48:33.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.411+0000 7f57b6800640 1 -- 172.21.15.112:0/2206280354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5794004800 msgr2=0x7f57b0156aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:33.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.411+0000 7f57b6800640 1 --2- 172.21.15.112:0/2206280354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5794004800 0x7f57b0156aa0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f57a000f7a0 tx=0x7f57a000fc60 comp rx=0 tx=0).stop 2024-09-12T02:48:33.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.411+0000 7f57b6800640 1 -- 172.21.15.112:0/2206280354 shutdown_connections 2024-09-12T02:48:33.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.411+0000 7f57b6800640 1 --2- 172.21.15.112:0/2206280354 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f578c06be30 0x7f578c06e2f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:33.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.411+0000 7f57b6800640 1 --2- 172.21.15.112:0/2206280354 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f57b0140020 0x7f57b01406a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:33.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.411+0000 7f57b6800640 1 --2- 172.21.15.112:0/2206280354 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f57b0155560 0x7f57b013fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:33.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.411+0000 7f57b6800640 1 --2- 172.21.15.112:0/2206280354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5794004800 0x7f57b0156aa0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:33.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.411+0000 7f57b6800640 1 -- 172.21.15.112:0/2206280354 >> 172.21.15.112:0/2206280354 conn(0x7f57b006bbd0 msgr2=0x7f57b00cf850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:33.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.411+0000 7f57b6800640 1 -- 172.21.15.112:0/2206280354 shutdown_connections 2024-09-12T02:48:33.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:33.411+0000 7f57b6800640 1 -- 172.21.15.112:0/2206280354 wait complete. 2024-09-12T02:48:33.427 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-12T02:48:33.601 INFO:teuthology.orchestra.run.smithi112.stdout:{"cluster_fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","whoami":0,"id":6861,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":35.130001172999997,"mdsmap_epoch":70,"osdmap_epoch":138,"osdmap_epoch_barrier":137,"uptime":40.205622024999997} 2024-09-12T02:48:33.601 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", "fs_name": "cephfs", "id": 6861, "mdsmap_epoch": 70, "osdmap_epoch": 138, "osdmap_epoch_barrier": 137, "rank_uptime": 35.130001173, "state": "up:active", "uptime": 40.205622025, "want_state": "up:active", "whoami": 0 } 2024-09-12T02:48:33.602 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:48:33.602 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:48:33.602 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:48:33.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:33.637 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2024-09-12T02:48:34.112 INFO:teuthology.orchestra.run.smithi112.stderr:50+0 records in 2024-09-12T02:48:34.113 INFO:teuthology.orchestra.run.smithi112.stderr:50+0 records out 2024-09-12T02:48:34.113 INFO:teuthology.orchestra.run.smithi112.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.398249 s, 132 MB/s 2024-09-12T02:48:34.114 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:48:34.114 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:48:34.201 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:48:34.291 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:48:34.292 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:48:34.292 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:48:34.292 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:48:34.327 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:48:34.328 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:48:34.403 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:48:34.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.595+0000 7f5cae000640 1 Processor -- start 2024-09-12T02:48:34.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.595+0000 7f5cae000640 1 -- start start 2024-09-12T02:48:34.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.596+0000 7f5cae000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ca815cc50 0x7f5ca80732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:34.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.596+0000 7f5cae000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5ca8071530 0x7f5ca80af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:34.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.596+0000 7f5cae000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ca8073830 con 0x7f5ca8071970 2024-09-12T02:48:34.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.596+0000 7f5cae000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f5ca815d030 con 0x7f5ca8071530 2024-09-12T02:48:34.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.596+0000 7f5cae000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5ca80cf4c0 con 0x7f5ca815cc50 2024-09-12T02:48:34.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.597+0000 7f5c9ea00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5ca8071530 0x7f5ca80af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:34.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.597+0000 7f5c9ea00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5ca8071530 0x7f5ca80af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58540/0 (socket says 172.21.15.112:58540) 2024-09-12T02:48:34.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.597+0000 7f5c9ea00640 1 -- 172.21.15.112:0/2134843452 learned_addr learned my addr 172.21.15.112:0/2134843452 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:34.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.597+0000 7f5ca7400640 1 --2- 172.21.15.112:0/2134843452 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ca815cc50 0x7f5ca80732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:34.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.597+0000 7f5c9ea00640 1 -- 172.21.15.112:0/2134843452 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ca815cc50 msgr2=0x7f5ca80732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:34.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.597+0000 7f5c9ea00640 1 --2- 172.21.15.112:0/2134843452 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ca815cc50 0x7f5ca80732f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.597+0000 7f5c9ea00640 1 -- 172.21.15.112:0/2134843452 >> v1:172.21.15.137:6789/0 conn(0x7f5ca8071970 legacy=0x7f5ca80cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:34.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.597+0000 7f5c9ea00640 1 -- 172.21.15.112:0/2134843452 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca80ceeb0 con 0x7f5ca8071530 2024-09-12T02:48:34.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.597+0000 7f5ca7400640 1 --2- 172.21.15.112:0/2134843452 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ca815cc50 0x7f5ca80732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:34.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.598+0000 7f5c9ea00640 1 --2- 172.21.15.112:0/2134843452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ca8071530 0x7f5ca80af720 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009850 tx=0x7f5c9002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4797a7ac4ca4cbc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:34.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.598+0000 7f5ca6a00640 1 -- 172.21.15.112:0/2134843452 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c90004030 con 0x7f5ca8071530 2024-09-12T02:48:34.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.598+0000 7f5ca6a00640 1 -- 172.21.15.112:0/2134843452 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c900041d0 con 0x7f5ca8071530 2024-09-12T02:48:34.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.598+0000 7f5ca6a00640 1 -- 172.21.15.112:0/2134843452 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c90003610 con 0x7f5ca8071530 2024-09-12T02:48:34.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.599+0000 7f5cae000640 1 -- 172.21.15.112:0/2134843452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ca8071530 msgr2=0x7f5ca80af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:34.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.599+0000 7f5cae000640 1 --2- 172.21.15.112:0/2134843452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ca8071530 0x7f5ca80af720 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009850 tx=0x7f5c9002a1a0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.599+0000 7f5cae000640 1 -- 172.21.15.112:0/2134843452 shutdown_connections 2024-09-12T02:48:34.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.599+0000 7f5cae000640 1 --2- 172.21.15.112:0/2134843452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ca8071530 0x7f5ca80af720 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.599+0000 7f5cae000640 1 --2- 172.21.15.112:0/2134843452 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ca815cc50 0x7f5ca80732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.599+0000 7f5cae000640 1 -- 172.21.15.112:0/2134843452 >> 172.21.15.112:0/2134843452 conn(0x7f5ca806bbd0 msgr2=0x7f5ca806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:34.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.599+0000 7f5cae000640 1 -- 172.21.15.112:0/2134843452 shutdown_connections 2024-09-12T02:48:34.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.599+0000 7f5cae000640 1 -- 172.21.15.112:0/2134843452 wait complete. 2024-09-12T02:48:34.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.601+0000 7f5cae000640 1 Processor -- start 2024-09-12T02:48:34.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.601+0000 7f5cae000640 1 -- start start 2024-09-12T02:48:34.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.602+0000 7f5cae000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ca8071530 0x7f5ca81e69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:34.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.602+0000 7f5cae000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ca8071970 0x7f5ca81410b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:34.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.602+0000 7f5cae000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ca815cc50 0x7f5ca81438c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:34.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.602+0000 7f5cae000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca80cf150 con 0x7f5ca8071970 2024-09-12T02:48:34.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.602+0000 7f5cae000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca806e5e0 con 0x7f5ca815cc50 2024-09-12T02:48:34.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.602+0000 7f5cae000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5ca806f510 con 0x7f5ca8071530 2024-09-12T02:48:34.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.602+0000 7f5c9ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ca8071970 0x7f5ca81410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:34.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.602+0000 7f5c9ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ca8071970 0x7f5ca81410b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58548/0 (socket says 172.21.15.112:58548) 2024-09-12T02:48:34.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.602+0000 7f5c9ea00640 1 -- 172.21.15.112:0/3926381219 learned_addr learned my addr 172.21.15.112:0/3926381219 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:34.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.602+0000 7f5ca7400640 1 --2- 172.21.15.112:0/3926381219 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ca8071530 0x7f5ca81e69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:34.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.602+0000 7f5ca7e00640 1 --2- 172.21.15.112:0/3926381219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ca815cc50 0x7f5ca81438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:34.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.602+0000 7f5c9ea00640 1 -- 172.21.15.112:0/3926381219 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ca8071530 msgr2=0x7f5ca81e69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:34.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.602+0000 7f5c9ea00640 1 --2- 172.21.15.112:0/3926381219 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ca8071530 0x7f5ca81e69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.602+0000 7f5c9ea00640 1 -- 172.21.15.112:0/3926381219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ca815cc50 msgr2=0x7f5ca81438c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:34.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.602+0000 7f5c9ea00640 1 --2- 172.21.15.112:0/3926381219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ca815cc50 0x7f5ca81438c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.602+0000 7f5c9ea00640 1 -- 172.21.15.112:0/3926381219 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca8144110 con 0x7f5ca8071970 2024-09-12T02:48:34.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.603+0000 7f5c9ea00640 1 --2- 172.21.15.112:0/3926381219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ca8071970 0x7f5ca81410b0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f5c9002a1e0 tx=0x7f5c900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:34.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.603+0000 7f5c9fe00640 1 -- 172.21.15.112:0/3926381219 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c90041020 con 0x7f5ca8071970 2024-09-12T02:48:34.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.603+0000 7f5c9fe00640 1 -- 172.21.15.112:0/3926381219 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c90003c50 con 0x7f5ca8071970 2024-09-12T02:48:34.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.603+0000 7f5c9fe00640 1 -- 172.21.15.112:0/3926381219 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c90004030 con 0x7f5ca8071970 2024-09-12T02:48:34.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.603+0000 7f5cae000640 1 -- 172.21.15.112:0/3926381219 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca81443f0 con 0x7f5ca8071970 2024-09-12T02:48:34.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.603+0000 7f5cae000640 1 -- 172.21.15.112:0/3926381219 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca8143e00 con 0x7f5ca8071970 2024-09-12T02:48:34.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.604+0000 7f5cae000640 1 -- 172.21.15.112:0/3926381219 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ca8068a30 con 0x7f5ca8071970 2024-09-12T02:48:34.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.605+0000 7f5c9fe00640 1 -- 172.21.15.112:0/3926381219 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5c90044020 con 0x7f5ca8071970 2024-09-12T02:48:34.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.606+0000 7f5c9fe00640 1 --2- 172.21.15.112:0/3926381219 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5c8406be30 0x7f5c8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:34.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.606+0000 7f5c9fe00640 1 -- 172.21.15.112:0/3926381219 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7f5c900ab860 con 0x7f5ca8071970 2024-09-12T02:48:34.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.606+0000 7f5ca7400640 1 --2- 172.21.15.112:0/3926381219 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5c8406be30 0x7f5c8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:34.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.606+0000 7f5ca7400640 1 --2- 172.21.15.112:0/3926381219 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5c8406be30 0x7f5c8406e2f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5c98006fd0 tx=0x7f5c98008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:34.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.610+0000 7f5c9fe00640 1 -- 172.21.15.112:0/3926381219 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5c9004b030 con 0x7f5ca8071970 2024-09-12T02:48:34.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.793+0000 7f5cae000640 1 -- 172.21.15.112:0/3926381219 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5ca80730d0 con 0x7f5ca8071970 2024-09-12T02:48:34.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.794+0000 7f5c9fe00640 1 -- 172.21.15.112:0/3926381219 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v138) ==== 80+0+0 (secure 0 0 0) 0x7f5c90079bb0 con 0x7f5ca8071970 2024-09-12T02:48:34.795 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-12T02:48:34.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.796+0000 7f5cae000640 1 -- 172.21.15.112:0/3926381219 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5c8406be30 msgr2=0x7f5c8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:34.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.796+0000 7f5cae000640 1 --2- 172.21.15.112:0/3926381219 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5c8406be30 0x7f5c8406e2f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5c98006fd0 tx=0x7f5c98008040 comp rx=0 tx=0).stop 2024-09-12T02:48:34.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.796+0000 7f5cae000640 1 -- 172.21.15.112:0/3926381219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ca8071970 msgr2=0x7f5ca81410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:34.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.796+0000 7f5cae000640 1 --2- 172.21.15.112:0/3926381219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ca8071970 0x7f5ca81410b0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f5c9002a1e0 tx=0x7f5c900046c0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.796+0000 7f5cae000640 1 -- 172.21.15.112:0/3926381219 shutdown_connections 2024-09-12T02:48:34.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.796+0000 7f5cae000640 1 --2- 172.21.15.112:0/3926381219 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5c8406be30 0x7f5c8406e2f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.796+0000 7f5cae000640 1 --2- 172.21.15.112:0/3926381219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ca815cc50 0x7f5ca81438c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.796+0000 7f5cae000640 1 --2- 172.21.15.112:0/3926381219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ca8071970 0x7f5ca81410b0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.796+0000 7f5cae000640 1 --2- 172.21.15.112:0/3926381219 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ca8071530 0x7f5ca81e69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.796+0000 7f5cae000640 1 -- 172.21.15.112:0/3926381219 >> 172.21.15.112:0/3926381219 conn(0x7f5ca806bbd0 msgr2=0x7f5ca8157a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:34.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.796+0000 7f5cae000640 1 -- 172.21.15.112:0/3926381219 shutdown_connections 2024-09-12T02:48:34.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:34.796+0000 7f5cae000640 1 -- 172.21.15.112:0/3926381219 wait complete. 2024-09-12T02:48:34.813 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:48:34.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:34.813 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T02:48:34.916 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-12T02:48:34.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:34.917 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:48:34.956 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:48:34.956 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:48:34.956 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:48:34.993 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:48:34.993 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:48:35.070 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:48:35.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.225+0000 7f7475c00640 1 Processor -- start 2024-09-12T02:48:35.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.225+0000 7f7475c00640 1 -- start start 2024-09-12T02:48:35.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.226+0000 7f7475c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f74701625a0 0x7f74700d2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:35.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.226+0000 7f7475c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f74700b3b50 0x7f74700d3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:35.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.226+0000 7f7475c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f74700b1aa0 0x7f74700b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:35.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.226+0000 7f7475c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f74700d3b90 con 0x7f74700b1aa0 2024-09-12T02:48:35.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.226+0000 7f7475c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f74700d1d40 con 0x7f74701625a0 2024-09-12T02:48:35.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.226+0000 7f7475c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f74700d2020 con 0x7f74700b3b50 2024-09-12T02:48:35.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.226+0000 7f7475200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f74700b1aa0 0x7f74700b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:35.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.226+0000 7f7475200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f74700b1aa0 0x7f74700b1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58552/0 (socket says 172.21.15.112:58552) 2024-09-12T02:48:35.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.226+0000 7f7475200640 1 -- 172.21.15.112:0/3955781655 learned_addr learned my addr 172.21.15.112:0/3955781655 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:35.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.226+0000 7f746fe00640 1 --2- 172.21.15.112:0/3955781655 >> v2:172.21.15.137:3300/0 conn(0x7f74701625a0 0x7f74700d2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:35.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.226+0000 7f7467400640 1 --2- 172.21.15.112:0/3955781655 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f74700b3b50 0x7f74700d3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:35.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.227+0000 7f7475200640 1 -- 172.21.15.112:0/3955781655 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f74700b3b50 msgr2=0x7f74700d3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:35.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.227+0000 7f7475200640 1 --2- 172.21.15.112:0/3955781655 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f74700b3b50 0x7f74700d3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:35.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.227+0000 7f7475200640 1 -- 172.21.15.112:0/3955781655 >> v2:172.21.15.137:3300/0 conn(0x7f74701625a0 msgr2=0x7f74700d2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:35.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.227+0000 7f7475200640 1 --2- 172.21.15.112:0/3955781655 >> v2:172.21.15.137:3300/0 conn(0x7f74701625a0 0x7f74700d2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:35.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.227+0000 7f7475200640 1 -- 172.21.15.112:0/3955781655 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74700d2300 con 0x7f74700b1aa0 2024-09-12T02:48:35.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.228+0000 7f7475200640 1 --2- 172.21.15.112:0/3955781655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74700b1aa0 0x7f74700b1f30 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f747008d800 tx=0x7f746802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e780ff2dedfaecd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:35.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.228+0000 7f746f400640 1 -- 172.21.15.112:0/3955781655 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7468036070 con 0x7f74700b1aa0 2024-09-12T02:48:35.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.228+0000 7f746f400640 1 -- 172.21.15.112:0/3955781655 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7468031600 con 0x7f74700b1aa0 2024-09-12T02:48:35.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.228+0000 7f746f400640 1 -- 172.21.15.112:0/3955781655 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74680319d0 con 0x7f74700b1aa0 2024-09-12T02:48:35.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.228+0000 7f7475c00640 1 -- 172.21.15.112:0/3955781655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74700b1aa0 msgr2=0x7f74700b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:35.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.228+0000 7f7475c00640 1 --2- 172.21.15.112:0/3955781655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74700b1aa0 0x7f74700b1f30 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f747008d800 tx=0x7f746802a610 comp rx=0 tx=0).stop 2024-09-12T02:48:35.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.228+0000 7f7475c00640 1 -- 172.21.15.112:0/3955781655 shutdown_connections 2024-09-12T02:48:35.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.228+0000 7f7475c00640 1 --2- 172.21.15.112:0/3955781655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74700b1aa0 0x7f74700b1f30 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:35.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.228+0000 7f7475c00640 1 --2- 172.21.15.112:0/3955781655 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f74700b3b50 0x7f74700d3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:35.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.228+0000 7f7475c00640 1 --2- 172.21.15.112:0/3955781655 >> v2:172.21.15.137:3300/0 conn(0x7f74701625a0 0x7f74700d2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:35.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.228+0000 7f7475c00640 1 -- 172.21.15.112:0/3955781655 >> 172.21.15.112:0/3955781655 conn(0x7f74700d4e10 msgr2=0x7f74700d5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:35.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.229+0000 7f7475c00640 1 -- 172.21.15.112:0/3955781655 shutdown_connections 2024-09-12T02:48:35.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.229+0000 7f7475c00640 1 -- 172.21.15.112:0/3955781655 wait complete. 2024-09-12T02:48:35.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.230+0000 7f7475c00640 1 Processor -- start 2024-09-12T02:48:35.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.230+0000 7f7475c00640 1 -- start start 2024-09-12T02:48:35.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.231+0000 7f7475c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f74700b1aa0 0x7f74701f4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:35.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.231+0000 7f7475c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74700b3b50 0x7f74700ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:35.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.231+0000 7f7475c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74701625a0 0x7f74700ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:35.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.231+0000 7f7475c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7470162b00 con 0x7f74701625a0 2024-09-12T02:48:35.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.231+0000 7f7475c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7470162980 con 0x7f74700b3b50 2024-09-12T02:48:35.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.231+0000 7f7475c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f74700d3790 con 0x7f74700b1aa0 2024-09-12T02:48:35.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.231+0000 7f7475200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74701625a0 0x7f74700ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:35.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.231+0000 7f746fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f74700b1aa0 0x7f74701f4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:35.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.231+0000 7f7475200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74701625a0 0x7f74700ca340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58558/0 (socket says 172.21.15.112:58558) 2024-09-12T02:48:35.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.231+0000 7f7475200640 1 -- 172.21.15.112:0/4015346936 learned_addr learned my addr 172.21.15.112:0/4015346936 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:35.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.231+0000 7f7467400640 1 --2- 172.21.15.112:0/4015346936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74700b3b50 0x7f74700ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:35.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.232+0000 7f746fe00640 1 -- 172.21.15.112:0/4015346936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74700b3b50 msgr2=0x7f74700ce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:35.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.232+0000 7f746fe00640 1 --2- 172.21.15.112:0/4015346936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74700b3b50 0x7f74700ce2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:35.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.232+0000 7f746fe00640 1 -- 172.21.15.112:0/4015346936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74701625a0 msgr2=0x7f74700ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:35.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.232+0000 7f746fe00640 1 --2- 172.21.15.112:0/4015346936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74701625a0 0x7f74700ca340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:35.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.232+0000 7f746fe00640 1 -- 172.21.15.112:0/4015346936 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74701f81b0 con 0x7f74700b1aa0 2024-09-12T02:48:35.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.232+0000 7f7475200640 1 --2- 172.21.15.112:0/4015346936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74701625a0 0x7f74700ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:35.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.232+0000 7f746fe00640 1 --2- 172.21.15.112:0/4015346936 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f74700b1aa0 0x7f74701f4970 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f746000e850 tx=0x7f746000ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:35.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.232+0000 7f746cc00640 1 -- 172.21.15.112:0/4015346936 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7460017070 con 0x7f74700b1aa0 2024-09-12T02:48:35.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.232+0000 7f746cc00640 1 -- 172.21.15.112:0/4015346936 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f746000c940 con 0x7f74700b1aa0 2024-09-12T02:48:35.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.232+0000 7f7475c00640 1 -- 172.21.15.112:0/4015346936 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74701f8490 con 0x7f74700b1aa0 2024-09-12T02:48:35.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.232+0000 7f746cc00640 1 -- 172.21.15.112:0/4015346936 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746000cd10 con 0x7f74700b1aa0 2024-09-12T02:48:35.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.233+0000 7f7475c00640 1 -- 172.21.15.112:0/4015346936 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f74701f8a50 con 0x7f74700b1aa0 2024-09-12T02:48:35.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.234+0000 7f7475c00640 1 -- 172.21.15.112:0/4015346936 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74700d2d10 con 0x7f74700b1aa0 2024-09-12T02:48:35.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.234+0000 7f746cc00640 1 -- 172.21.15.112:0/4015346936 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f746001a070 con 0x7f74700b1aa0 2024-09-12T02:48:35.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.235+0000 7f746cc00640 1 --2- 172.21.15.112:0/4015346936 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f744c06be30 0x7f744c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:35.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.235+0000 7f746cc00640 1 -- 172.21.15.112:0/4015346936 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7f746008b110 con 0x7f74700b1aa0 2024-09-12T02:48:35.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.236+0000 7f7467400640 1 --2- 172.21.15.112:0/4015346936 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f744c06be30 0x7f744c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:35.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.236+0000 7f7467400640 1 --2- 172.21.15.112:0/4015346936 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f744c06be30 0x7f744c06e2f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f74700b76c0 tx=0x7f7458009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:35.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.241+0000 7f746cc00640 1 -- 172.21.15.112:0/4015346936 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7460059460 con 0x7f74700b1aa0 2024-09-12T02:48:35.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.428+0000 7f7475c00640 1 -- 172.21.15.112:0/4015346936 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f74700d0f30 con 0x7f74700b1aa0 2024-09-12T02:48:35.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.429+0000 7f746cc00640 1 -- 172.21.15.112:0/4015346936 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v138) ==== 80+0+0 (secure 0 0 0) 0x7f746005d760 con 0x7f74700b1aa0 2024-09-12T02:48:35.430 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-12T02:48:35.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.431+0000 7f7475c00640 1 -- 172.21.15.112:0/4015346936 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f744c06be30 msgr2=0x7f744c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:35.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.431+0000 7f7475c00640 1 --2- 172.21.15.112:0/4015346936 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f744c06be30 0x7f744c06e2f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f74700b76c0 tx=0x7f7458009190 comp rx=0 tx=0).stop 2024-09-12T02:48:35.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.431+0000 7f7475c00640 1 -- 172.21.15.112:0/4015346936 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f74700b1aa0 msgr2=0x7f74701f4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:35.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.431+0000 7f7475c00640 1 --2- 172.21.15.112:0/4015346936 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f74700b1aa0 0x7f74701f4970 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f746000e850 tx=0x7f746000ed10 comp rx=0 tx=0).stop 2024-09-12T02:48:35.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.431+0000 7f7475c00640 1 -- 172.21.15.112:0/4015346936 shutdown_connections 2024-09-12T02:48:35.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.431+0000 7f7475c00640 1 --2- 172.21.15.112:0/4015346936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74701625a0 0x7f74700ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:35.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.431+0000 7f7475c00640 1 --2- 172.21.15.112:0/4015346936 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f744c06be30 0x7f744c06e2f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:35.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.431+0000 7f7475c00640 1 --2- 172.21.15.112:0/4015346936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74700b3b50 0x7f74700ce2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:35.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.431+0000 7f7475c00640 1 --2- 172.21.15.112:0/4015346936 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f74700b1aa0 0x7f74701f4970 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:35.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.431+0000 7f7475c00640 1 -- 172.21.15.112:0/4015346936 >> 172.21.15.112:0/4015346936 conn(0x7f74700d4e10 msgr2=0x7f74700d4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:35.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.431+0000 7f7475c00640 1 -- 172.21.15.112:0/4015346936 shutdown_connections 2024-09-12T02:48:35.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.431+0000 7f7475c00640 1 -- 172.21.15.112:0/4015346936 wait complete. 2024-09-12T02:48:35.447 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-12T02:48:35.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:35.448 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-12T02:48:35.511 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T02:48:35.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:35.512 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T02:48:35.548 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:48:35.549 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:48:35.549 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:48:35.590 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:48:35.590 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:48:35.590 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:48:35.590 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:48:35.626 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:48:35.626 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:48:35.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.780+0000 7fc82b200640 1 Processor -- start 2024-09-12T02:48:35.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.780+0000 7fc82b200640 1 -- start start 2024-09-12T02:48:35.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.781+0000 7fc82b200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc82c0d28d0 0x7fc82c0b2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:35.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.781+0000 7fc82b200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc82c0d2fb0 con 0x7fc82c0d1710 2024-09-12T02:48:35.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.781+0000 7fc82b200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc82c0d0b60 con 0x7fc82c0b3e00 2024-09-12T02:48:35.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.781+0000 7fc82b200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc82c0d3cb0 con 0x7fc82c0d28d0 2024-09-12T02:48:35.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.781+0000 7fc829e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc82c0d1710 0x7fc82c0d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:43974/0 (socket says 172.21.15.112:43974) 2024-09-12T02:48:35.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.781+0000 7fc829e00640 1 -- 172.21.15.112:0/2215271217 learned_addr learned my addr 172.21.15.112:0/2215271217 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:35.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.782+0000 7fc82a800640 1 --2- 172.21.15.112:0/2215271217 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc82c0d28d0 0x7fc82c0b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:35.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.782+0000 7fc828a00640 1 -- 172.21.15.112:0/2215271217 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1949878214 0 0) 0x7fc82c0d2fb0 con 0x7fc82c0d1710 2024-09-12T02:48:35.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.782+0000 7fc828a00640 1 -- 172.21.15.112:0/2215271217 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc810003520 con 0x7fc82c0d1710 2024-09-12T02:48:35.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.782+0000 7fc828a00640 1 -- 172.21.15.112:0/2215271217 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2964038886 0 0) 0x7fc82c0d0b60 con 0x7fc82c0b3e00 2024-09-12T02:48:35.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.782+0000 7fc828a00640 1 -- 172.21.15.112:0/2215271217 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc82c0d2fb0 con 0x7fc82c0b3e00 2024-09-12T02:48:35.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.782+0000 7fc82a800640 1 -- 172.21.15.112:0/2215271217 >> v1:172.21.15.137:6789/0 conn(0x7fc82c0b3e00 legacy=0x7fc82c0b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:35.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.782+0000 7fc82a800640 1 -- 172.21.15.112:0/2215271217 >> v1:172.21.15.112:6789/0 conn(0x7fc82c0d1710 legacy=0x7fc82c0d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:35.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.782+0000 7fc82a800640 1 -- 172.21.15.112:0/2215271217 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc82c0d3410 con 0x7fc82c0d28d0 2024-09-12T02:48:35.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.783+0000 7fc82a800640 1 --2- 172.21.15.112:0/2215271217 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc82c0d28d0 0x7fc82c0b2480 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc824009dc0 tx=0x7fc82402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0f7d8131b3984eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:35.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.783+0000 7fc828a00640 1 -- 172.21.15.112:0/2215271217 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc824007740 con 0x7fc82c0d28d0 2024-09-12T02:48:35.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.783+0000 7fc828a00640 1 -- 172.21.15.112:0/2215271217 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8240078e0 con 0x7fc82c0d28d0 2024-09-12T02:48:35.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.783+0000 7fc828a00640 1 -- 172.21.15.112:0/2215271217 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc824007cb0 con 0x7fc82c0d28d0 2024-09-12T02:48:35.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.784+0000 7fc82b200640 1 -- 172.21.15.112:0/2215271217 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc82c0d28d0 msgr2=0x7fc82c0b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:35.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.784+0000 7fc82b200640 1 --2- 172.21.15.112:0/2215271217 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc82c0d28d0 0x7fc82c0b2480 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc824009dc0 tx=0x7fc82402a6d0 comp rx=0 tx=0).stop 2024-09-12T02:48:35.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.784+0000 7fc82b200640 1 -- 172.21.15.112:0/2215271217 shutdown_connections 2024-09-12T02:48:35.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.784+0000 7fc82b200640 1 --2- 172.21.15.112:0/2215271217 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc82c0d28d0 0x7fc82c0b2480 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:35.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.784+0000 7fc82b200640 1 -- 172.21.15.112:0/2215271217 >> 172.21.15.112:0/2215271217 conn(0x7fc82c09e030 msgr2=0x7fc82c0d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:35.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.784+0000 7fc82b200640 1 -- 172.21.15.112:0/2215271217 shutdown_connections 2024-09-12T02:48:35.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.784+0000 7fc82b200640 1 -- 172.21.15.112:0/2215271217 wait complete. 2024-09-12T02:48:35.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.786+0000 7fc82b200640 1 Processor -- start 2024-09-12T02:48:35.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.786+0000 7fc82b200640 1 -- start start 2024-09-12T02:48:35.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.787+0000 7fc82b200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc82c0b3e00 0x7fc82c1f4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:35.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.787+0000 7fc82b200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc82c0d1710 0x7fc82c0ce450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:35.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.787+0000 7fc82b200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc82c0d28d0 0x7fc82c161ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:35.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.787+0000 7fc82b200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc82c0d39d0 con 0x7fc82c0d28d0 2024-09-12T02:48:35.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.787+0000 7fc82b200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc82c0d2d60 con 0x7fc82c0d1710 2024-09-12T02:48:35.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.787+0000 7fc82b200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc82c15f110 con 0x7fc82c0b3e00 2024-09-12T02:48:35.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.787+0000 7fc82a800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc82c0d28d0 0x7fc82c161ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:35.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.787+0000 7fc82a800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc82c0d28d0 0x7fc82c161ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58566/0 (socket says 172.21.15.112:58566) 2024-09-12T02:48:35.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.787+0000 7fc82a800640 1 -- 172.21.15.112:0/722818382 learned_addr learned my addr 172.21.15.112:0/722818382 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:35.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.788+0000 7fc829e00640 1 --2- 172.21.15.112:0/722818382 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc82c0b3e00 0x7fc82c1f4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:35.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.788+0000 7fc829400640 1 --2- 172.21.15.112:0/722818382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc82c0d1710 0x7fc82c0ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:35.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.788+0000 7fc82a800640 1 -- 172.21.15.112:0/722818382 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc82c0b3e00 msgr2=0x7fc82c1f4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:35.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.788+0000 7fc82a800640 1 --2- 172.21.15.112:0/722818382 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc82c0b3e00 0x7fc82c1f4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:35.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.788+0000 7fc82a800640 1 -- 172.21.15.112:0/722818382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc82c0d1710 msgr2=0x7fc82c0ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:35.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.788+0000 7fc82a800640 1 --2- 172.21.15.112:0/722818382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc82c0d1710 0x7fc82c0ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:35.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.788+0000 7fc82a800640 1 -- 172.21.15.112:0/722818382 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc82c0b8d30 con 0x7fc82c0d28d0 2024-09-12T02:48:35.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.788+0000 7fc829400640 1 --2- 172.21.15.112:0/722818382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc82c0d1710 0x7fc82c0ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:35.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.788+0000 7fc82a800640 1 --2- 172.21.15.112:0/722818382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc82c0d28d0 0x7fc82c161ac0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fc824009eb0 tx=0x7fc824004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:35.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.788+0000 7fc822000640 1 -- 172.21.15.112:0/722818382 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82403f070 con 0x7fc82c0d28d0 2024-09-12T02:48:35.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.788+0000 7fc822000640 1 -- 172.21.15.112:0/722818382 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc824031b70 con 0x7fc82c0d28d0 2024-09-12T02:48:35.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.788+0000 7fc82b200640 1 -- 172.21.15.112:0/722818382 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc82c0b9010 con 0x7fc82c0d28d0 2024-09-12T02:48:35.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.789+0000 7fc822000640 1 -- 172.21.15.112:0/722818382 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc824009450 con 0x7fc82c0d28d0 2024-09-12T02:48:35.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.789+0000 7fc82b200640 1 -- 172.21.15.112:0/722818382 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc82c0b95d0 con 0x7fc82c0d28d0 2024-09-12T02:48:35.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.790+0000 7fc82b200640 1 -- 172.21.15.112:0/722818382 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc82c0d1af0 con 0x7fc82c0d28d0 2024-09-12T02:48:35.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.790+0000 7fc822000640 1 -- 172.21.15.112:0/722818382 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc82403b410 con 0x7fc82c0d28d0 2024-09-12T02:48:35.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.791+0000 7fc822000640 1 --2- 172.21.15.112:0/722818382 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc80c06be30 0x7fc80c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:35.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.791+0000 7fc822000640 1 -- 172.21.15.112:0/722818382 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7fc8240ac4f0 con 0x7fc82c0d28d0 2024-09-12T02:48:35.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.791+0000 7fc829e00640 1 --2- 172.21.15.112:0/722818382 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc80c06be30 0x7fc80c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:35.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.792+0000 7fc829e00640 1 --2- 172.21.15.112:0/722818382 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc80c06be30 0x7fc80c06e2f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc81c000f60 tx=0x7fc81c007d70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:35.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:35.795+0000 7fc822000640 1 -- 172.21.15.112:0/722818382 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc82407ae00 con 0x7fc82c0d28d0 2024-09-12T02:48:36.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.004+0000 7fc82b200640 1 -- 172.21.15.112:0/722818382 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc82c0d0860 con 0x7fc82c0d28d0 2024-09-12T02:48:36.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.004+0000 7fc822000640 1 -- 172.21.15.112:0/722818382 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+5231 (secure 0 0 0) 0x7fc82407a700 con 0x7fc82c0d28d0 2024-09-12T02:48:36.005 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:36.006 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":70,"btime":"2024-09-12T02:48:01:488612+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5816,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1943935405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1943935405},{"type":"v1","addr":"172.21.15.137:6834","nonce":1943935405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6328,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2010766966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2010766966},{"type":"v1","addr":"172.21.15.112:6835","nonce":2010766966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/193655023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":193655023},{"type":"v1","addr":"172.21.15.137:6835","nonce":193655023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:47:57.871200+0000","modified":"2024-09-12T02:48:00.893329+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6861":{"gid":6861,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/134918269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":134918269},{"type":"v1","addr":"172.21.15.112:6837","nonce":134918269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6861,"qdb_cluster":[6861]},"id":8}]} 2024-09-12T02:48:36.006 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 70 2024-09-12T02:48:36.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.006+0000 7fc82b200640 1 -- 172.21.15.112:0/722818382 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc80c06be30 msgr2=0x7fc80c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:36.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.006+0000 7fc82b200640 1 --2- 172.21.15.112:0/722818382 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc80c06be30 0x7fc80c06e2f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc81c000f60 tx=0x7fc81c007d70 comp rx=0 tx=0).stop 2024-09-12T02:48:36.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.006+0000 7fc82b200640 1 -- 172.21.15.112:0/722818382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc82c0d28d0 msgr2=0x7fc82c161ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:36.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.006+0000 7fc82b200640 1 --2- 172.21.15.112:0/722818382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc82c0d28d0 0x7fc82c161ac0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fc824009eb0 tx=0x7fc824004a40 comp rx=0 tx=0).stop 2024-09-12T02:48:36.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.007+0000 7fc82b200640 1 -- 172.21.15.112:0/722818382 shutdown_connections 2024-09-12T02:48:36.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.007+0000 7fc82b200640 1 --2- 172.21.15.112:0/722818382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc82c0d28d0 0x7fc82c161ac0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:36.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.007+0000 7fc82b200640 1 --2- 172.21.15.112:0/722818382 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc80c06be30 0x7fc80c06e2f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:36.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.007+0000 7fc82b200640 1 --2- 172.21.15.112:0/722818382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc82c0d1710 0x7fc82c0ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:36.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.007+0000 7fc82b200640 1 --2- 172.21.15.112:0/722818382 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc82c0b3e00 0x7fc82c1f4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:36.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.007+0000 7fc82b200640 1 -- 172.21.15.112:0/722818382 >> 172.21.15.112:0/722818382 conn(0x7fc82c09e030 msgr2=0x7fc82c06cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:36.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.007+0000 7fc82b200640 1 -- 172.21.15.112:0/722818382 shutdown_connections 2024-09-12T02:48:36.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.007+0000 7fc82b200640 1 -- 172.21.15.112:0/722818382 wait complete. 2024-09-12T02:48:36.024 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:48:36.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.175+0000 7ff0a0e00640 1 Processor -- start 2024-09-12T02:48:36.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.175+0000 7ff0a0e00640 1 -- start start 2024-09-12T02:48:36.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.176+0000 7ff0a0e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff09c15b9d0 0x7ff09c0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:36.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.177+0000 7ff0a0e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff09c0b54a0 con 0x7ff09c0b45d0 2024-09-12T02:48:36.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.177+0000 7ff0a0e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff09c0b3af0 con 0x7ff09c06f600 2024-09-12T02:48:36.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.177+0000 7ff0a0e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff09c0b4a30 con 0x7ff09c15b9d0 2024-09-12T02:48:36.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.177+0000 7ff099400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff09c0b45d0 0x7ff09c06eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:43984/0 (socket says 172.21.15.112:43984) 2024-09-12T02:48:36.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.177+0000 7ff099400640 1 -- 172.21.15.112:0/2800803001 learned_addr learned my addr 172.21.15.112:0/2800803001 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:36.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.177+0000 7ff099e00640 1 --2- 172.21.15.112:0/2800803001 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff09c15b9d0 0x7ff09c0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:36.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.177+0000 7ff098a00640 1 -- 172.21.15.112:0/2800803001 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2610288852 0 0) 0x7ff09c0b54a0 con 0x7ff09c0b45d0 2024-09-12T02:48:36.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.177+0000 7ff098a00640 1 -- 172.21.15.112:0/2800803001 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff080003520 con 0x7ff09c0b45d0 2024-09-12T02:48:36.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.177+0000 7ff098a00640 1 -- 172.21.15.112:0/2800803001 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1928549279 0 0) 0x7ff09c0b3af0 con 0x7ff09c06f600 2024-09-12T02:48:36.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.177+0000 7ff098a00640 1 -- 172.21.15.112:0/2800803001 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff09c0b54a0 con 0x7ff09c06f600 2024-09-12T02:48:36.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.177+0000 7ff099e00640 1 -- 172.21.15.112:0/2800803001 >> v1:172.21.15.137:6789/0 conn(0x7ff09c06f600 legacy=0x7ff09c0cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:36.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.177+0000 7ff099e00640 1 -- 172.21.15.112:0/2800803001 >> v1:172.21.15.112:6789/0 conn(0x7ff09c0b45d0 legacy=0x7ff09c06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:36.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.177+0000 7ff099e00640 1 -- 172.21.15.112:0/2800803001 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09c0b3dd0 con 0x7ff09c15b9d0 2024-09-12T02:48:36.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.178+0000 7ff099e00640 1 --2- 172.21.15.112:0/2800803001 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff09c15b9d0 0x7ff09c0b4ec0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009dc0 tx=0x7ff08c02a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99956bb4db512a67 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:36.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.179+0000 7ff098a00640 1 -- 172.21.15.112:0/2800803001 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08c007740 con 0x7ff09c15b9d0 2024-09-12T02:48:36.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.179+0000 7ff098a00640 1 -- 172.21.15.112:0/2800803001 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff08c0078e0 con 0x7ff09c15b9d0 2024-09-12T02:48:36.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.179+0000 7ff098a00640 1 -- 172.21.15.112:0/2800803001 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08c007c90 con 0x7ff09c15b9d0 2024-09-12T02:48:36.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.179+0000 7ff0a0e00640 1 -- 172.21.15.112:0/2800803001 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff09c15b9d0 msgr2=0x7ff09c0b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:36.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.179+0000 7ff0a0e00640 1 --2- 172.21.15.112:0/2800803001 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff09c15b9d0 0x7ff09c0b4ec0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009dc0 tx=0x7ff08c02a6d0 comp rx=0 tx=0).stop 2024-09-12T02:48:36.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.180+0000 7ff0a0e00640 1 -- 172.21.15.112:0/2800803001 shutdown_connections 2024-09-12T02:48:36.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.180+0000 7ff0a0e00640 1 --2- 172.21.15.112:0/2800803001 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff09c15b9d0 0x7ff09c0b4ec0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:36.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.180+0000 7ff0a0e00640 1 -- 172.21.15.112:0/2800803001 >> 172.21.15.112:0/2800803001 conn(0x7ff09c06bbd0 msgr2=0x7ff09c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:36.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.180+0000 7ff0a0e00640 1 -- 172.21.15.112:0/2800803001 shutdown_connections 2024-09-12T02:48:36.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.180+0000 7ff0a0e00640 1 -- 172.21.15.112:0/2800803001 wait complete. 2024-09-12T02:48:36.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.181+0000 7ff0a0e00640 1 Processor -- start 2024-09-12T02:48:36.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.181+0000 7ff0a0e00640 1 -- start start 2024-09-12T02:48:36.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.182+0000 7ff0a0e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff09c06f600 0x7ff09c15fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:36.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.182+0000 7ff0a0e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff09c0b45d0 0x7ff09c151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:36.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.182+0000 7ff0a0e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff09c15b9d0 0x7ff09c1597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:36.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.182+0000 7ff0a0e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff09c15bf30 con 0x7ff09c15b9d0 2024-09-12T02:48:36.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.182+0000 7ff0a0e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff09c15bdb0 con 0x7ff09c0b45d0 2024-09-12T02:48:36.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.182+0000 7ff0a0e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff09c0728c0 con 0x7ff09c06f600 2024-09-12T02:48:36.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.183+0000 7ff09a800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff09c15b9d0 0x7ff09c1597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:36.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.183+0000 7ff099400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff09c0b45d0 0x7ff09c151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:36.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.183+0000 7ff09a800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff09c15b9d0 0x7ff09c1597f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58574/0 (socket says 172.21.15.112:58574) 2024-09-12T02:48:36.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.183+0000 7ff09a800640 1 -- 172.21.15.112:0/3621051960 learned_addr learned my addr 172.21.15.112:0/3621051960 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:36.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.183+0000 7ff099e00640 1 --2- 172.21.15.112:0/3621051960 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff09c06f600 0x7ff09c15fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:36.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.183+0000 7ff099400640 1 -- 172.21.15.112:0/3621051960 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff09c06f600 msgr2=0x7ff09c15fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:36.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.183+0000 7ff099400640 1 --2- 172.21.15.112:0/3621051960 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff09c06f600 0x7ff09c15fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:36.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.183+0000 7ff099400640 1 -- 172.21.15.112:0/3621051960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff09c15b9d0 msgr2=0x7ff09c1597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:36.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.183+0000 7ff099400640 1 --2- 172.21.15.112:0/3621051960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff09c15b9d0 0x7ff09c1597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:36.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.183+0000 7ff099400640 1 -- 172.21.15.112:0/3621051960 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09c1559e0 con 0x7ff09c0b45d0 2024-09-12T02:48:36.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.183+0000 7ff09a800640 1 --2- 172.21.15.112:0/3621051960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff09c15b9d0 0x7ff09c1597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:36.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.183+0000 7ff099400640 1 --2- 172.21.15.112:0/3621051960 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff09c0b45d0 0x7ff09c151550 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff088001260 tx=0x7ff08800cb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:36.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.183+0000 7ff092000640 1 -- 172.21.15.112:0/3621051960 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff088017070 con 0x7ff09c0b45d0 2024-09-12T02:48:36.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.184+0000 7ff092000640 1 -- 172.21.15.112:0/3621051960 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff088007270 con 0x7ff09c0b45d0 2024-09-12T02:48:36.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.184+0000 7ff092000640 1 -- 172.21.15.112:0/3621051960 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff088001d40 con 0x7ff09c0b45d0 2024-09-12T02:48:36.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.184+0000 7ff0a0e00640 1 -- 172.21.15.112:0/3621051960 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff09c154e60 con 0x7ff09c0b45d0 2024-09-12T02:48:36.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.184+0000 7ff0a0e00640 1 -- 172.21.15.112:0/3621051960 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff09c155420 con 0x7ff09c0b45d0 2024-09-12T02:48:36.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.185+0000 7ff0a0e00640 1 -- 172.21.15.112:0/3621051960 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff09c068a30 con 0x7ff09c0b45d0 2024-09-12T02:48:36.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.186+0000 7ff092000640 1 -- 172.21.15.112:0/3621051960 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff08801a070 con 0x7ff09c0b45d0 2024-09-12T02:48:36.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.186+0000 7ff092000640 1 --2- 172.21.15.112:0/3621051960 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff07c06be30 0x7ff07c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:36.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.187+0000 7ff092000640 1 -- 172.21.15.112:0/3621051960 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7ff08808a0d0 con 0x7ff09c0b45d0 2024-09-12T02:48:36.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.187+0000 7ff099e00640 1 --2- 172.21.15.112:0/3621051960 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff07c06be30 0x7ff07c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:36.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.187+0000 7ff099e00640 1 --2- 172.21.15.112:0/3621051960 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff07c06be30 0x7ff07c06e2f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff08c034000 tx=0x7ff08c02f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:36.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.192+0000 7ff092000640 1 -- 172.21.15.112:0/3621051960 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff088058420 con 0x7ff09c0b45d0 2024-09-12T02:48:36.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.401+0000 7ff0a0e00640 1 -- 172.21.15.112:0/3621051960 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff09c069270 con 0x7ff09c0b45d0 2024-09-12T02:48:36.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.402+0000 7ff092000640 1 -- 172.21.15.112:0/3621051960 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+5231 (secure 0 0 0) 0x7ff08805c720 con 0x7ff09c0b45d0 2024-09-12T02:48:36.403 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:36.403 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":70,"btime":"2024-09-12T02:48:01:488612+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5816,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1943935405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1943935405},{"type":"v1","addr":"172.21.15.137:6834","nonce":1943935405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6328,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2010766966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2010766966},{"type":"v1","addr":"172.21.15.112:6835","nonce":2010766966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/193655023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":193655023},{"type":"v1","addr":"172.21.15.137:6835","nonce":193655023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:47:57.871200+0000","modified":"2024-09-12T02:48:00.893329+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6861":{"gid":6861,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/134918269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":134918269},{"type":"v1","addr":"172.21.15.112:6837","nonce":134918269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6861,"qdb_cluster":[6861]},"id":8}]} 2024-09-12T02:48:36.404 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 70 2024-09-12T02:48:36.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.404+0000 7ff0a0e00640 1 -- 172.21.15.112:0/3621051960 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff07c06be30 msgr2=0x7ff07c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:36.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.404+0000 7ff0a0e00640 1 --2- 172.21.15.112:0/3621051960 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff07c06be30 0x7ff07c06e2f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff08c034000 tx=0x7ff08c02f000 comp rx=0 tx=0).stop 2024-09-12T02:48:36.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.404+0000 7ff0a0e00640 1 -- 172.21.15.112:0/3621051960 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff09c0b45d0 msgr2=0x7ff09c151550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:36.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.404+0000 7ff0a0e00640 1 --2- 172.21.15.112:0/3621051960 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff09c0b45d0 0x7ff09c151550 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff088001260 tx=0x7ff08800cb90 comp rx=0 tx=0).stop 2024-09-12T02:48:36.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.404+0000 7ff0a0e00640 1 -- 172.21.15.112:0/3621051960 shutdown_connections 2024-09-12T02:48:36.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.404+0000 7ff0a0e00640 1 --2- 172.21.15.112:0/3621051960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff09c15b9d0 0x7ff09c1597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:36.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.404+0000 7ff0a0e00640 1 --2- 172.21.15.112:0/3621051960 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff07c06be30 0x7ff07c06e2f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:36.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.404+0000 7ff0a0e00640 1 --2- 172.21.15.112:0/3621051960 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff09c0b45d0 0x7ff09c151550 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:36.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.404+0000 7ff0a0e00640 1 --2- 172.21.15.112:0/3621051960 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff09c06f600 0x7ff09c15fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:36.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.404+0000 7ff0a0e00640 1 -- 172.21.15.112:0/3621051960 >> 172.21.15.112:0/3621051960 conn(0x7ff09c06bbd0 msgr2=0x7ff09c1533f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:36.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.404+0000 7ff0a0e00640 1 -- 172.21.15.112:0/3621051960 shutdown_connections 2024-09-12T02:48:36.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.405+0000 7ff0a0e00640 1 -- 172.21.15.112:0/3621051960 wait complete. 2024-09-12T02:48:36.422 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:48:36.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.572+0000 7f85ece00640 1 Processor -- start 2024-09-12T02:48:36.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.572+0000 7f85ece00640 1 -- start start 2024-09-12T02:48:36.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.574+0000 7f85ece00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f85e815cc50 0x7f85e80732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:36.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.574+0000 7f85ece00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f85e8071530 0x7f85e80af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:36.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.574+0000 7f85ece00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85e8073830 con 0x7f85e80719a0 2024-09-12T02:48:36.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.574+0000 7f85ece00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f85e815d030 con 0x7f85e8071530 2024-09-12T02:48:36.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.574+0000 7f85ece00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f85e80cf4c0 con 0x7f85e815cc50 2024-09-12T02:48:36.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.574+0000 7f85dd400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f85e8071530 0x7f85e80af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:36.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.574+0000 7f85e6800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f85e80719a0 0x7f85e80cf950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:43994/0 (socket says 172.21.15.112:43994) 2024-09-12T02:48:36.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.574+0000 7f85e6800640 1 -- 172.21.15.112:0/2244192263 learned_addr learned my addr 172.21.15.112:0/2244192263 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:36.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.574+0000 7f85e5e00640 1 --2- 172.21.15.112:0/2244192263 >> v2:172.21.15.137:3300/0 conn(0x7f85e815cc50 0x7f85e80732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:36.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.574+0000 7f85dd400640 1 -- 172.21.15.112:0/2244192263 >> v2:172.21.15.137:3300/0 conn(0x7f85e815cc50 msgr2=0x7f85e80732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:36.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.574+0000 7f85dd400640 1 --2- 172.21.15.112:0/2244192263 >> v2:172.21.15.137:3300/0 conn(0x7f85e815cc50 0x7f85e80732f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:36.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.574+0000 7f85dd400640 1 -- 172.21.15.112:0/2244192263 >> v1:172.21.15.112:6789/0 conn(0x7f85e80719a0 legacy=0x7f85e80cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:36.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.574+0000 7f85e5400640 1 -- 172.21.15.112:0/2244192263 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 483070172 0 0) 0x7f85e0001490 con 0x7f85e80719a0 2024-09-12T02:48:36.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.575+0000 7f85dd400640 1 -- 172.21.15.112:0/2244192263 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e80ceeb0 con 0x7f85e8071530 2024-09-12T02:48:36.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.575+0000 7f85e5e00640 1 --2- 172.21.15.112:0/2244192263 >> v2:172.21.15.137:3300/0 conn(0x7f85e815cc50 0x7f85e80732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:36.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.575+0000 7f85dd400640 1 --2- 172.21.15.112:0/2244192263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85e8071530 0x7f85e80af720 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f85e8070060 tx=0x7f85d002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cdb0984cd322b79 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:36.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.576+0000 7f85e5400640 1 -- 172.21.15.112:0/2244192263 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d0037070 con 0x7f85e8071530 2024-09-12T02:48:36.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.576+0000 7f85e5400640 1 -- 172.21.15.112:0/2244192263 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85d002ae50 con 0x7f85e8071530 2024-09-12T02:48:36.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.576+0000 7f85e5400640 1 -- 172.21.15.112:0/2244192263 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d0032660 con 0x7f85e8071530 2024-09-12T02:48:36.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.576+0000 7f85ece00640 1 -- 172.21.15.112:0/2244192263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85e8071530 msgr2=0x7f85e80af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:36.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.576+0000 7f85ece00640 1 --2- 172.21.15.112:0/2244192263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85e8071530 0x7f85e80af720 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f85e8070060 tx=0x7f85d002a100 comp rx=0 tx=0).stop 2024-09-12T02:48:36.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.576+0000 7f85ece00640 1 -- 172.21.15.112:0/2244192263 shutdown_connections 2024-09-12T02:48:36.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.576+0000 7f85ece00640 1 --2- 172.21.15.112:0/2244192263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85e8071530 0x7f85e80af720 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:36.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.576+0000 7f85ece00640 1 --2- 172.21.15.112:0/2244192263 >> v2:172.21.15.137:3300/0 conn(0x7f85e815cc50 0x7f85e80732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:36.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.576+0000 7f85ece00640 1 -- 172.21.15.112:0/2244192263 >> 172.21.15.112:0/2244192263 conn(0x7f85e806bbd0 msgr2=0x7f85e806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:36.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.576+0000 7f85ece00640 1 -- 172.21.15.112:0/2244192263 shutdown_connections 2024-09-12T02:48:36.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.576+0000 7f85ece00640 1 -- 172.21.15.112:0/2244192263 wait complete. 2024-09-12T02:48:36.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.578+0000 7f85ece00640 1 Processor -- start 2024-09-12T02:48:36.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.578+0000 7f85ece00640 1 -- start start 2024-09-12T02:48:36.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.579+0000 7f85ece00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85e8071530 0x7f85e814ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:36.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.579+0000 7f85ece00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85e80719a0 0x7f85e81569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:36.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.579+0000 7f85ece00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85e815cc50 0x7f85e8156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:36.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.579+0000 7f85ece00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f85e80cf150 con 0x7f85e80719a0 2024-09-12T02:48:36.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.579+0000 7f85ece00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f85e806e5e0 con 0x7f85e815cc50 2024-09-12T02:48:36.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.579+0000 7f85ece00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f85e806f510 con 0x7f85e8071530 2024-09-12T02:48:36.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.579+0000 7f85dd400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85e80719a0 0x7f85e81569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:36.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.579+0000 7f85dd400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85e80719a0 0x7f85e81569c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58596/0 (socket says 172.21.15.112:58596) 2024-09-12T02:48:36.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.579+0000 7f85dd400640 1 -- 172.21.15.112:0/3473846673 learned_addr learned my addr 172.21.15.112:0/3473846673 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:36.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.579+0000 7f85dd400640 1 -- 172.21.15.112:0/3473846673 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85e8071530 msgr2=0x7f85e814ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:36.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.579+0000 7f85e5e00640 1 --2- 172.21.15.112:0/3473846673 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85e8071530 0x7f85e814ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:36.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.579+0000 7f85e6800640 1 --2- 172.21.15.112:0/3473846673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85e815cc50 0x7f85e8156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:36.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.580+0000 7f85dd400640 1 --2- 172.21.15.112:0/3473846673 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85e8071530 0x7f85e814ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:36.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.580+0000 7f85dd400640 1 -- 172.21.15.112:0/3473846673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85e815cc50 msgr2=0x7f85e8156f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:36.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.580+0000 7f85dd400640 1 --2- 172.21.15.112:0/3473846673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85e815cc50 0x7f85e8156f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:36.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.580+0000 7f85dd400640 1 -- 172.21.15.112:0/3473846673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e8152490 con 0x7f85e80719a0 2024-09-12T02:48:36.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.580+0000 7f85e6800640 1 --2- 172.21.15.112:0/3473846673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85e815cc50 0x7f85e8156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:36.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.580+0000 7f85e5e00640 1 --2- 172.21.15.112:0/3473846673 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85e8071530 0x7f85e814ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:36.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.580+0000 7f85dd400640 1 --2- 172.21.15.112:0/3473846673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85e80719a0 0x7f85e81569c0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f85d0000c00 tx=0x7f85d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:36.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.580+0000 7f85dea00640 1 -- 172.21.15.112:0/3473846673 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d0041070 con 0x7f85e80719a0 2024-09-12T02:48:36.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.580+0000 7f85dea00640 1 -- 172.21.15.112:0/3473846673 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85d003c670 con 0x7f85e80719a0 2024-09-12T02:48:36.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.580+0000 7f85dea00640 1 -- 172.21.15.112:0/3473846673 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d0037040 con 0x7f85e80719a0 2024-09-12T02:48:36.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.580+0000 7f85ece00640 1 -- 172.21.15.112:0/3473846673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85e8152770 con 0x7f85e80719a0 2024-09-12T02:48:36.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.580+0000 7f85ece00640 1 -- 172.21.15.112:0/3473846673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85e8152d30 con 0x7f85e80719a0 2024-09-12T02:48:36.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.581+0000 7f85ece00640 1 -- 172.21.15.112:0/3473846673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85e806df60 con 0x7f85e80719a0 2024-09-12T02:48:36.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.582+0000 7f85dea00640 1 -- 172.21.15.112:0/3473846673 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f85d0044070 con 0x7f85e80719a0 2024-09-12T02:48:36.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.583+0000 7f85dea00640 1 --2- 172.21.15.112:0/3473846673 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f85c406be60 0x7f85c406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:36.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.583+0000 7f85dea00640 1 -- 172.21.15.112:0/3473846673 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7f85d00ab710 con 0x7f85e80719a0 2024-09-12T02:48:36.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.583+0000 7f85e5e00640 1 --2- 172.21.15.112:0/3473846673 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f85c406be60 0x7f85c406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:36.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.584+0000 7f85e5e00640 1 --2- 172.21.15.112:0/3473846673 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f85c406be60 0x7f85c406e320 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f85d8006fd0 tx=0x7f85d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:36.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.588+0000 7f85dea00640 1 -- 172.21.15.112:0/3473846673 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f85d007a020 con 0x7f85e80719a0 2024-09-12T02:48:36.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.763+0000 7f85ece00640 1 -- 172.21.15.112:0/3473846673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f85e81581b0 con 0x7f85e80719a0 2024-09-12T02:48:36.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.764+0000 7f85dea00640 1 -- 172.21.15.112:0/3473846673 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) ==== 74+0+16743 (secure 0 0 0) 0x7f85d0079920 con 0x7f85e80719a0 2024-09-12T02:48:36.765 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:36.766 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":138,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:48:31.006261+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:47:55.641315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-12T02:47:56.867038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:48:36.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.766+0000 7f85ece00640 1 -- 172.21.15.112:0/3473846673 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f85c406be60 msgr2=0x7f85c406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:36.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.766+0000 7f85ece00640 1 --2- 172.21.15.112:0/3473846673 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f85c406be60 0x7f85c406e320 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f85d8006fd0 tx=0x7f85d8008040 comp rx=0 tx=0).stop 2024-09-12T02:48:36.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.766+0000 7f85ece00640 1 -- 172.21.15.112:0/3473846673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85e80719a0 msgr2=0x7f85e81569c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:36.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.766+0000 7f85ece00640 1 --2- 172.21.15.112:0/3473846673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85e80719a0 0x7f85e81569c0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f85d0000c00 tx=0x7f85d00046c0 comp rx=0 tx=0).stop 2024-09-12T02:48:36.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.767+0000 7f85ece00640 1 -- 172.21.15.112:0/3473846673 shutdown_connections 2024-09-12T02:48:36.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.767+0000 7f85ece00640 1 --2- 172.21.15.112:0/3473846673 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f85c406be60 0x7f85c406e320 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:36.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.767+0000 7f85ece00640 1 --2- 172.21.15.112:0/3473846673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85e815cc50 0x7f85e8156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:36.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.767+0000 7f85ece00640 1 --2- 172.21.15.112:0/3473846673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85e80719a0 0x7f85e81569c0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:36.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.767+0000 7f85ece00640 1 --2- 172.21.15.112:0/3473846673 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85e8071530 0x7f85e814ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:36.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.767+0000 7f85ece00640 1 -- 172.21.15.112:0/3473846673 >> 172.21.15.112:0/3473846673 conn(0x7f85e806bbd0 msgr2=0x7f85e806e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:36.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.767+0000 7f85ece00640 1 -- 172.21.15.112:0/3473846673 shutdown_connections 2024-09-12T02:48:36.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.767+0000 7f85ece00640 1 -- 172.21.15.112:0/3473846673 wait complete. 2024-09-12T02:48:36.784 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:48:36.785 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:48:36.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.935+0000 7fbbae200640 1 Processor -- start 2024-09-12T02:48:36.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.935+0000 7fbbae200640 1 -- start start 2024-09-12T02:48:36.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.937+0000 7fbbae200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbba806f600 0x7fbba80b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:36.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.937+0000 7fbbae200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbba80b4a20 con 0x7fbba80b45d0 2024-09-12T02:48:36.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.937+0000 7fbbae200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbba80b54a0 con 0x7fbba815b9d0 2024-09-12T02:48:36.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.937+0000 7fbbae200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbba80b3af0 con 0x7fbba806f600 2024-09-12T02:48:36.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.937+0000 7fbba7e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fbba80b45d0 0x7fbba80cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:44000/0 (socket says 172.21.15.112:44000) 2024-09-12T02:48:36.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.937+0000 7fbba7e00640 1 -- 172.21.15.112:0/3897931629 learned_addr learned my addr 172.21.15.112:0/3897931629 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:36.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.937+0000 7fbba6a00640 1 --2- 172.21.15.112:0/3897931629 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbba806f600 0x7fbba80b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:36.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.937+0000 7fbba6000640 1 -- 172.21.15.112:0/3897931629 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 483043457 0 0) 0x7fbba80b4a20 con 0x7fbba80b45d0 2024-09-12T02:48:36.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.937+0000 7fbba6000640 1 -- 172.21.15.112:0/3897931629 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb8c005730 con 0x7fbba80b45d0 2024-09-12T02:48:36.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.938+0000 7fbba6000640 1 -- 172.21.15.112:0/3897931629 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1229989395 0 0) 0x7fbba80b54a0 con 0x7fbba815b9d0 2024-09-12T02:48:36.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.938+0000 7fbba6000640 1 -- 172.21.15.112:0/3897931629 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbba80b4a20 con 0x7fbba815b9d0 2024-09-12T02:48:36.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.938+0000 7fbba6000640 1 -- 172.21.15.112:0/3897931629 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 304336474 0 0) 0x7fbb8c005730 con 0x7fbba80b45d0 2024-09-12T02:48:36.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.938+0000 7fbba6a00640 1 -- 172.21.15.112:0/3897931629 >> v1:172.21.15.137:6789/0 conn(0x7fbba815b9d0 legacy=0x7fbba806eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:36.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.938+0000 7fbba6a00640 1 -- 172.21.15.112:0/3897931629 >> v1:172.21.15.112:6789/0 conn(0x7fbba80b45d0 legacy=0x7fbba80cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:36.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.938+0000 7fbba6a00640 1 -- 172.21.15.112:0/3897931629 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba80b3dd0 con 0x7fbba806f600 2024-09-12T02:48:36.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.939+0000 7fbba6a00640 1 --2- 172.21.15.112:0/3897931629 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbba806f600 0x7fbba80b4ec0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbb940097c0 tx=0x7fbb9402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efba6d6331e10fa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:36.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.939+0000 7fbba6000640 1 -- 172.21.15.112:0/3897931629 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb94037070 con 0x7fbba806f600 2024-09-12T02:48:36.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.939+0000 7fbba6000640 1 -- 172.21.15.112:0/3897931629 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb9402ac10 con 0x7fbba806f600 2024-09-12T02:48:36.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.939+0000 7fbba6000640 1 -- 172.21.15.112:0/3897931629 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba00019f0 con 0x7fbba806f600 2024-09-12T02:48:36.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.940+0000 7fbbae200640 1 -- 172.21.15.112:0/3897931629 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbba806f600 msgr2=0x7fbba80b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:36.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.940+0000 7fbbae200640 1 --2- 172.21.15.112:0/3897931629 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbba806f600 0x7fbba80b4ec0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbb940097c0 tx=0x7fbb9402a180 comp rx=0 tx=0).stop 2024-09-12T02:48:36.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.940+0000 7fbbae200640 1 -- 172.21.15.112:0/3897931629 shutdown_connections 2024-09-12T02:48:36.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.940+0000 7fbbae200640 1 --2- 172.21.15.112:0/3897931629 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbba806f600 0x7fbba80b4ec0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:36.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.940+0000 7fbbae200640 1 -- 172.21.15.112:0/3897931629 >> 172.21.15.112:0/3897931629 conn(0x7fbba806bbd0 msgr2=0x7fbba806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:36.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.940+0000 7fbbae200640 1 -- 172.21.15.112:0/3897931629 shutdown_connections 2024-09-12T02:48:36.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.940+0000 7fbbae200640 1 -- 172.21.15.112:0/3897931629 wait complete. 2024-09-12T02:48:36.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.941+0000 7fbbae200640 1 Processor -- start 2024-09-12T02:48:36.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.941+0000 7fbbae200640 1 -- start start 2024-09-12T02:48:36.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.942+0000 7fbbae200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbba806f600 0x7fbba80ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:36.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.942+0000 7fbbae200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbba80b45d0 0x7fbba815a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:36.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.942+0000 7fbbae200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbba815b9d0 0x7fbba8143200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:36.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.942+0000 7fbbae200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbba815bf30 con 0x7fbba815b9d0 2024-09-12T02:48:36.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.942+0000 7fbbae200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbba815bdb0 con 0x7fbba80b45d0 2024-09-12T02:48:36.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.942+0000 7fbbae200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbba80728c0 con 0x7fbba806f600 2024-09-12T02:48:36.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.942+0000 7fbba7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbba815b9d0 0x7fbba8143200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:36.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.943+0000 7fbba7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbba815b9d0 0x7fbba8143200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58602/0 (socket says 172.21.15.112:58602) 2024-09-12T02:48:36.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.943+0000 7fbba7e00640 1 -- 172.21.15.112:0/767707918 learned_addr learned my addr 172.21.15.112:0/767707918 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:36.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.943+0000 7fbba6a00640 1 --2- 172.21.15.112:0/767707918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbba80b45d0 0x7fbba815a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:36.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.943+0000 7fbba7400640 1 --2- 172.21.15.112:0/767707918 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbba806f600 0x7fbba80ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:36.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.943+0000 7fbba7e00640 1 -- 172.21.15.112:0/767707918 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbba806f600 msgr2=0x7fbba80ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:36.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.943+0000 7fbba7e00640 1 --2- 172.21.15.112:0/767707918 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbba806f600 0x7fbba80ccd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:36.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.943+0000 7fbba7e00640 1 -- 172.21.15.112:0/767707918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbba80b45d0 msgr2=0x7fbba815a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:36.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.943+0000 7fbba7e00640 1 --2- 172.21.15.112:0/767707918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbba80b45d0 0x7fbba815a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:36.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.943+0000 7fbba7e00640 1 -- 172.21.15.112:0/767707918 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba8159060 con 0x7fbba815b9d0 2024-09-12T02:48:36.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.943+0000 7fbba7e00640 1 --2- 172.21.15.112:0/767707918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbba815b9d0 0x7fbba8143200 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fbba0001350 tx=0x7fbba000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:36.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.944+0000 7fbb9f400640 1 -- 172.21.15.112:0/767707918 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba0017070 con 0x7fbba815b9d0 2024-09-12T02:48:36.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.944+0000 7fbb9f400640 1 -- 172.21.15.112:0/767707918 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba0012400 con 0x7fbba815b9d0 2024-09-12T02:48:36.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.944+0000 7fbb9f400640 1 -- 172.21.15.112:0/767707918 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba0012830 con 0x7fbba815b9d0 2024-09-12T02:48:36.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.944+0000 7fbbae200640 1 -- 172.21.15.112:0/767707918 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbba8145b40 con 0x7fbba815b9d0 2024-09-12T02:48:36.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.944+0000 7fbbae200640 1 -- 172.21.15.112:0/767707918 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbba81595b0 con 0x7fbba815b9d0 2024-09-12T02:48:36.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.945+0000 7fbbae200640 1 -- 172.21.15.112:0/767707918 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbba8068a30 con 0x7fbba815b9d0 2024-09-12T02:48:36.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.946+0000 7fbb9f400640 1 -- 172.21.15.112:0/767707918 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbba001a070 con 0x7fbba815b9d0 2024-09-12T02:48:36.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.946+0000 7fbb9f400640 1 --2- 172.21.15.112:0/767707918 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbb8806be30 0x7fbb8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:36.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.946+0000 7fbb9f400640 1 -- 172.21.15.112:0/767707918 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7fbba008ad90 con 0x7fbba815b9d0 2024-09-12T02:48:36.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.947+0000 7fbba7400640 1 --2- 172.21.15.112:0/767707918 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbb8806be30 0x7fbb8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:36.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.947+0000 7fbba7400640 1 --2- 172.21.15.112:0/767707918 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbb8806be30 0x7fbb8806e2f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fbb980011e0 tx=0x7fbb98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:36.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:36.951+0000 7fbb9f400640 1 -- 172.21.15.112:0/767707918 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbba00590e0 con 0x7fbba815b9d0 2024-09-12T02:48:37.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.156+0000 7fbbae200640 1 -- 172.21.15.112:0/767707918 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbba806d670 con 0x7fbba815b9d0 2024-09-12T02:48:37.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.157+0000 7fbb9f400640 1 -- 172.21.15.112:0/767707918 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+5231 (secure 0 0 0) 0x7fbba806d670 con 0x7fbba815b9d0 2024-09-12T02:48:37.158 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:37.158 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":70,"btime":"2024-09-12T02:48:01:488612+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5816,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1943935405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1943935405},{"type":"v1","addr":"172.21.15.137:6834","nonce":1943935405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6328,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2010766966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2010766966},{"type":"v1","addr":"172.21.15.112:6835","nonce":2010766966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/193655023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":193655023},{"type":"v1","addr":"172.21.15.137:6835","nonce":193655023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:47:57.871200+0000","modified":"2024-09-12T02:48:00.893329+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6861":{"gid":6861,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/134918269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":134918269},{"type":"v1","addr":"172.21.15.112:6837","nonce":134918269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6861,"qdb_cluster":[6861]},"id":8}]} 2024-09-12T02:48:37.158 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 70 2024-09-12T02:48:37.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.159+0000 7fbbae200640 1 -- 172.21.15.112:0/767707918 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbb8806be30 msgr2=0x7fbb8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:37.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.159+0000 7fbbae200640 1 --2- 172.21.15.112:0/767707918 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbb8806be30 0x7fbb8806e2f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fbb980011e0 tx=0x7fbb98009040 comp rx=0 tx=0).stop 2024-09-12T02:48:37.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.159+0000 7fbbae200640 1 -- 172.21.15.112:0/767707918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbba815b9d0 msgr2=0x7fbba8143200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:37.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.159+0000 7fbbae200640 1 --2- 172.21.15.112:0/767707918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbba815b9d0 0x7fbba8143200 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fbba0001350 tx=0x7fbba000cf90 comp rx=0 tx=0).stop 2024-09-12T02:48:37.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.159+0000 7fbbae200640 1 -- 172.21.15.112:0/767707918 shutdown_connections 2024-09-12T02:48:37.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.159+0000 7fbbae200640 1 --2- 172.21.15.112:0/767707918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbba815b9d0 0x7fbba8143200 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:37.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.159+0000 7fbbae200640 1 --2- 172.21.15.112:0/767707918 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbb8806be30 0x7fbb8806e2f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:37.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.159+0000 7fbbae200640 1 --2- 172.21.15.112:0/767707918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbba80b45d0 0x7fbba815a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:37.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.159+0000 7fbbae200640 1 --2- 172.21.15.112:0/767707918 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbba806f600 0x7fbba80ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:37.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.159+0000 7fbbae200640 1 -- 172.21.15.112:0/767707918 >> 172.21.15.112:0/767707918 conn(0x7fbba806bbd0 msgr2=0x7fbba81568e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:37.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.159+0000 7fbbae200640 1 -- 172.21.15.112:0/767707918 shutdown_connections 2024-09-12T02:48:37.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.159+0000 7fbbae200640 1 -- 172.21.15.112:0/767707918 wait complete. 2024-09-12T02:48:37.176 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:48:37.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.327+0000 7f32b7c00640 1 Processor -- start 2024-09-12T02:48:37.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.327+0000 7f32b7c00640 1 -- start start 2024-09-12T02:48:37.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.328+0000 7f32b7c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f32b00b4ec0 0x7f32b00b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:37.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.329+0000 7f32b7c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32b00b54a0 con 0x7f32b006f600 2024-09-12T02:48:37.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.329+0000 7f32b7c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32b00b3af0 con 0x7f32b015b9d0 2024-09-12T02:48:37.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.329+0000 7f32b7c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f32b00b3dd0 con 0x7f32b00b4ec0 2024-09-12T02:48:37.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.329+0000 7f32b5c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f32b00b4ec0 0x7f32b00b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:37.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.329+0000 7f32b5c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f32b00b4ec0 0x7f32b00b45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58614/0 (socket says 172.21.15.112:58614) 2024-09-12T02:48:37.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.329+0000 7f32b5c00640 1 -- 172.21.15.112:0/3562794258 learned_addr learned my addr 172.21.15.112:0/3562794258 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:37.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.329+0000 7f32a7e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f32b006f600 0x7f32b00cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:44010/0 (socket says 172.21.15.112:44010) 2024-09-12T02:48:37.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.329+0000 7f32b5c00640 1 -- 172.21.15.112:0/3562794258 >> v1:172.21.15.137:6789/0 conn(0x7f32b015b9d0 legacy=0x7f32b006eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:37.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.329+0000 7f32b5c00640 1 -- 172.21.15.112:0/3562794258 >> v1:172.21.15.112:6789/0 conn(0x7f32b006f600 legacy=0x7f32b00cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:37.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.329+0000 7f32b5c00640 1 -- 172.21.15.112:0/3562794258 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b00b40b0 con 0x7f32b00b4ec0 2024-09-12T02:48:37.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.330+0000 7f32b5c00640 1 --2- 172.21.15.112:0/3562794258 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b00b4ec0 0x7f32b00b45d0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f32a8009e50 tx=0x7f32a802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf12f5ed6f567056 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:37.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.330+0000 7f32afe00640 1 -- 172.21.15.112:0/3562794258 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a8036070 con 0x7f32b00b4ec0 2024-09-12T02:48:37.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.330+0000 7f32afe00640 1 -- 172.21.15.112:0/3562794258 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32a8031600 con 0x7f32b00b4ec0 2024-09-12T02:48:37.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.331+0000 7f32afe00640 1 -- 172.21.15.112:0/3562794258 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a80319d0 con 0x7f32b00b4ec0 2024-09-12T02:48:37.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.331+0000 7f32b7c00640 1 -- 172.21.15.112:0/3562794258 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b00b4ec0 msgr2=0x7f32b00b45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:37.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.331+0000 7f32b7c00640 1 --2- 172.21.15.112:0/3562794258 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b00b4ec0 0x7f32b00b45d0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f32a8009e50 tx=0x7f32a802a730 comp rx=0 tx=0).stop 2024-09-12T02:48:37.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.331+0000 7f32b7c00640 1 -- 172.21.15.112:0/3562794258 shutdown_connections 2024-09-12T02:48:37.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.331+0000 7f32b7c00640 1 --2- 172.21.15.112:0/3562794258 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b00b4ec0 0x7f32b00b45d0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:37.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.331+0000 7f32b7c00640 1 -- 172.21.15.112:0/3562794258 >> 172.21.15.112:0/3562794258 conn(0x7f32b006bbd0 msgr2=0x7f32b006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:37.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.331+0000 7f32b7c00640 1 -- 172.21.15.112:0/3562794258 shutdown_connections 2024-09-12T02:48:37.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.331+0000 7f32b7c00640 1 -- 172.21.15.112:0/3562794258 wait complete. 2024-09-12T02:48:37.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.333+0000 7f32b7c00640 1 Processor -- start 2024-09-12T02:48:37.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.333+0000 7f32b7c00640 1 -- start start 2024-09-12T02:48:37.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.334+0000 7f32b7c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b006f600 0x7f32b014fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:37.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.334+0000 7f32b7c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32b00b4ec0 0x7f32b015ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:37.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.334+0000 7f32b7c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32b015b9d0 0x7f32b0151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:37.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.334+0000 7f32b7c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f32b0072a40 con 0x7f32b006f600 2024-09-12T02:48:37.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.334+0000 7f32b7c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f32b00728c0 con 0x7f32b015b9d0 2024-09-12T02:48:37.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.334+0000 7f32b7c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f32b0072bc0 con 0x7f32b00b4ec0 2024-09-12T02:48:37.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.334+0000 7f32b5200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b006f600 0x7f32b014fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:37.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.334+0000 7f32b5200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b006f600 0x7f32b014fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58616/0 (socket says 172.21.15.112:58616) 2024-09-12T02:48:37.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.334+0000 7f32b5200640 1 -- 172.21.15.112:0/3548136543 learned_addr learned my addr 172.21.15.112:0/3548136543 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:37.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.334+0000 7f32b5200640 1 -- 172.21.15.112:0/3548136543 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32b00b4ec0 msgr2=0x7f32b015ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:37.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.334+0000 7f32b5200640 1 --2- 172.21.15.112:0/3548136543 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32b00b4ec0 0x7f32b015ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:37.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.334+0000 7f32b5200640 1 -- 172.21.15.112:0/3548136543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32b015b9d0 msgr2=0x7f32b0151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:37.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.334+0000 7f32b5200640 1 --2- 172.21.15.112:0/3548136543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32b015b9d0 0x7f32b0151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:37.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.334+0000 7f32b5200640 1 -- 172.21.15.112:0/3548136543 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b0154e60 con 0x7f32b006f600 2024-09-12T02:48:37.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.335+0000 7f32b5200640 1 --2- 172.21.15.112:0/3548136543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b006f600 0x7f32b014fe50 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f32a000c400 tx=0x7f32a000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:37.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.335+0000 7f32ad600640 1 -- 172.21.15.112:0/3548136543 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a0017070 con 0x7f32b006f600 2024-09-12T02:48:37.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.335+0000 7f32ad600640 1 -- 172.21.15.112:0/3548136543 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32a00052d0 con 0x7f32b006f600 2024-09-12T02:48:37.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.335+0000 7f32ad600640 1 -- 172.21.15.112:0/3548136543 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a0003830 con 0x7f32b006f600 2024-09-12T02:48:37.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.335+0000 7f32b7c00640 1 -- 172.21.15.112:0/3548136543 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b0150460 con 0x7f32b006f600 2024-09-12T02:48:37.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.335+0000 7f32b7c00640 1 -- 172.21.15.112:0/3548136543 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b0150a20 con 0x7f32b006f600 2024-09-12T02:48:37.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.336+0000 7f32b7c00640 1 -- 172.21.15.112:0/3548136543 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32b0068a30 con 0x7f32b006f600 2024-09-12T02:48:37.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.337+0000 7f32ad600640 1 -- 172.21.15.112:0/3548136543 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f32a001a070 con 0x7f32b006f600 2024-09-12T02:48:37.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.338+0000 7f32ad600640 1 --2- 172.21.15.112:0/3548136543 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f328c06be60 0x7f328c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:37.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.338+0000 7f32ad600640 1 -- 172.21.15.112:0/3548136543 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7f32a008a230 con 0x7f32b006f600 2024-09-12T02:48:37.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.338+0000 7f32a7e00640 1 --2- 172.21.15.112:0/3548136543 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f328c06be60 0x7f328c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:37.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.339+0000 7f32a7e00640 1 --2- 172.21.15.112:0/3548136543 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f328c06be60 0x7f328c06e320 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3298001020 tx=0x7f3298007930 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:37.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.342+0000 7f32ad600640 1 -- 172.21.15.112:0/3548136543 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f32a0058b40 con 0x7f32b006f600 2024-09-12T02:48:37.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.552+0000 7f32b7c00640 1 -- 172.21.15.112:0/3548136543 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32b00b45d0 con 0x7f32b006f600 2024-09-12T02:48:37.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.553+0000 7f32ad600640 1 -- 172.21.15.112:0/3548136543 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+5231 (secure 0 0 0) 0x7f32a0058440 con 0x7f32b006f600 2024-09-12T02:48:37.554 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:37.554 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":70,"btime":"2024-09-12T02:48:01:488612+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5816,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1943935405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1943935405},{"type":"v1","addr":"172.21.15.137:6834","nonce":1943935405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6328,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2010766966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2010766966},{"type":"v1","addr":"172.21.15.112:6835","nonce":2010766966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/193655023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":193655023},{"type":"v1","addr":"172.21.15.137:6835","nonce":193655023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:47:57.871200+0000","modified":"2024-09-12T02:48:00.893329+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6861":{"gid":6861,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/134918269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":134918269},{"type":"v1","addr":"172.21.15.112:6837","nonce":134918269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6861,"qdb_cluster":[6861]},"id":8}]} 2024-09-12T02:48:37.554 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 70 2024-09-12T02:48:37.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.555+0000 7f32b7c00640 1 -- 172.21.15.112:0/3548136543 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f328c06be60 msgr2=0x7f328c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:37.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.555+0000 7f32b7c00640 1 --2- 172.21.15.112:0/3548136543 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f328c06be60 0x7f328c06e320 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3298001020 tx=0x7f3298007930 comp rx=0 tx=0).stop 2024-09-12T02:48:37.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.555+0000 7f32b7c00640 1 -- 172.21.15.112:0/3548136543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b006f600 msgr2=0x7f32b014fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:37.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.555+0000 7f32b7c00640 1 --2- 172.21.15.112:0/3548136543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b006f600 0x7f32b014fe50 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f32a000c400 tx=0x7f32a000c8c0 comp rx=0 tx=0).stop 2024-09-12T02:48:37.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.555+0000 7f32b7c00640 1 -- 172.21.15.112:0/3548136543 shutdown_connections 2024-09-12T02:48:37.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.555+0000 7f32b7c00640 1 --2- 172.21.15.112:0/3548136543 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f328c06be60 0x7f328c06e320 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:37.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.555+0000 7f32b7c00640 1 --2- 172.21.15.112:0/3548136543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32b015b9d0 0x7f32b0151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:37.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.555+0000 7f32b7c00640 1 --2- 172.21.15.112:0/3548136543 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32b00b4ec0 0x7f32b015ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:37.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.555+0000 7f32b7c00640 1 --2- 172.21.15.112:0/3548136543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b006f600 0x7f32b014fe50 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:37.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.555+0000 7f32b7c00640 1 -- 172.21.15.112:0/3548136543 >> 172.21.15.112:0/3548136543 conn(0x7f32b006bbd0 msgr2=0x7f32b00afb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:37.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.555+0000 7f32b7c00640 1 -- 172.21.15.112:0/3548136543 shutdown_connections 2024-09-12T02:48:37.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.555+0000 7f32b7c00640 1 -- 172.21.15.112:0/3548136543 wait complete. 2024-09-12T02:48:37.572 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:48:37.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.725+0000 7f701f200640 1 Processor -- start 2024-09-12T02:48:37.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.725+0000 7f701f200640 1 -- start start 2024-09-12T02:48:37.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.726+0000 7f701f200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70200d1710 0x7f70200d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:37.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.726+0000 7f701f200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f70200b1d70 0x7f70200b2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:37.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.726+0000 7f701f200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70200d2fb0 con 0x7f70200b3e00 2024-09-12T02:48:37.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.726+0000 7f701f200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f70200d3cb0 con 0x7f70200b1d70 2024-09-12T02:48:37.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.726+0000 7f701f200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f70200d0b60 con 0x7f70200d1710 2024-09-12T02:48:37.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.727+0000 7f701e800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f70200b1d70 0x7f70200b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:37.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.727+0000 7f701de00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70200d1710 0x7f70200d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:37.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.727+0000 7f701de00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70200d1710 0x7f70200d28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:56212/0 (socket says 172.21.15.112:56212) 2024-09-12T02:48:37.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.727+0000 7f701d400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f70200b3e00 0x7f70200d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.112:37316/0 (socket says 172.21.15.112:37316) 2024-09-12T02:48:37.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.727+0000 7f701de00640 1 -- 172.21.15.112:0/537620647 learned_addr learned my addr 172.21.15.112:0/537620647 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:37.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.727+0000 7f701de00640 1 -- 172.21.15.112:0/537620647 >> v2:172.21.15.137:3300/0 conn(0x7f70200b1d70 msgr2=0x7f70200b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:37.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.727+0000 7f701de00640 1 --2- 172.21.15.112:0/537620647 >> v2:172.21.15.137:3300/0 conn(0x7f70200b1d70 0x7f70200b2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:37.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.727+0000 7f701de00640 1 -- 172.21.15.112:0/537620647 >> v1:172.21.15.137:6789/0 conn(0x7f70200b3e00 legacy=0x7f70200d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:37.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.727+0000 7f701de00640 1 -- 172.21.15.112:0/537620647 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70200d3410 con 0x7f70200d1710 2024-09-12T02:48:37.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.727+0000 7f701e800640 1 --2- 172.21.15.112:0/537620647 >> v2:172.21.15.137:3300/0 conn(0x7f70200b1d70 0x7f70200b2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:37.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.728+0000 7f701de00640 1 --2- 172.21.15.112:0/537620647 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70200d1710 0x7f70200d28d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7010009870 tx=0x7f701002a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3bd78612961d8b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:37.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.729+0000 7f701ca00640 1 -- 172.21.15.112:0/537620647 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7010037070 con 0x7f70200d1710 2024-09-12T02:48:37.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.729+0000 7f701ca00640 1 -- 172.21.15.112:0/537620647 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7010032440 con 0x7f70200d1710 2024-09-12T02:48:37.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.729+0000 7f701ca00640 1 -- 172.21.15.112:0/537620647 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7010032810 con 0x7f70200d1710 2024-09-12T02:48:37.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.729+0000 7f701f200640 1 -- 172.21.15.112:0/537620647 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70200d1710 msgr2=0x7f70200d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:37.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.729+0000 7f701f200640 1 --2- 172.21.15.112:0/537620647 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70200d1710 0x7f70200d28d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7010009870 tx=0x7f701002a250 comp rx=0 tx=0).stop 2024-09-12T02:48:37.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.729+0000 7f701f200640 1 -- 172.21.15.112:0/537620647 shutdown_connections 2024-09-12T02:48:37.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.729+0000 7f701f200640 1 --2- 172.21.15.112:0/537620647 >> v2:172.21.15.137:3300/0 conn(0x7f70200b1d70 0x7f70200b2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:37.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.729+0000 7f701f200640 1 --2- 172.21.15.112:0/537620647 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70200d1710 0x7f70200d28d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:37.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.729+0000 7f701f200640 1 -- 172.21.15.112:0/537620647 >> 172.21.15.112:0/537620647 conn(0x7f702009e030 msgr2=0x7f70200d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:37.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.729+0000 7f701f200640 1 -- 172.21.15.112:0/537620647 shutdown_connections 2024-09-12T02:48:37.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.729+0000 7f701f200640 1 -- 172.21.15.112:0/537620647 wait complete. 2024-09-12T02:48:37.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.731+0000 7f701f200640 1 Processor -- start 2024-09-12T02:48:37.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.731+0000 7f701f200640 1 -- start start 2024-09-12T02:48:37.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.732+0000 7f701f200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70200b1d70 0x7f70200b7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:37.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.732+0000 7f701f200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70200b3e00 0x7f70201561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:37.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.732+0000 7f701f200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70200d1710 0x7f70200b9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:37.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.732+0000 7f701f200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f702015f110 con 0x7f70200d1710 2024-09-12T02:48:37.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.732+0000 7f701f200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f70200d39d0 con 0x7f70200b3e00 2024-09-12T02:48:37.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.732+0000 7f701f200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f702015f290 con 0x7f70200b1d70 2024-09-12T02:48:37.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.732+0000 7f701e800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70200d1710 0x7f70200b9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:37.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.732+0000 7f701e800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70200d1710 0x7f70200b9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58632/0 (socket says 172.21.15.112:58632) 2024-09-12T02:48:37.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.732+0000 7f701e800640 1 -- 172.21.15.112:0/1468721155 learned_addr learned my addr 172.21.15.112:0/1468721155 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:37.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.732+0000 7f701de00640 1 --2- 172.21.15.112:0/1468721155 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70200b1d70 0x7f70200b7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:37.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.732+0000 7f701d400640 1 --2- 172.21.15.112:0/1468721155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70200b3e00 0x7f70201561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:37.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.733+0000 7f701e800640 1 -- 172.21.15.112:0/1468721155 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70200b1d70 msgr2=0x7f70200b7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:37.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.733+0000 7f701e800640 1 --2- 172.21.15.112:0/1468721155 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70200b1d70 0x7f70200b7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:37.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.733+0000 7f701e800640 1 -- 172.21.15.112:0/1468721155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70200b3e00 msgr2=0x7f70201561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:37.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.733+0000 7f701e800640 1 --2- 172.21.15.112:0/1468721155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70200b3e00 0x7f70201561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:37.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.733+0000 7f701e800640 1 -- 172.21.15.112:0/1468721155 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70201566f0 con 0x7f70200d1710 2024-09-12T02:48:37.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.733+0000 7f701e800640 1 --2- 172.21.15.112:0/1468721155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70200d1710 0x7f70200b9600 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f701800efc0 tx=0x7f7018009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:37.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.733+0000 7f7016000640 1 -- 172.21.15.112:0/1468721155 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7018018030 con 0x7f70200d1710 2024-09-12T02:48:37.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.733+0000 7f7016000640 1 -- 172.21.15.112:0/1468721155 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f701800cde0 con 0x7f70200d1710 2024-09-12T02:48:37.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.733+0000 7f701f200640 1 -- 172.21.15.112:0/1468721155 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70200b9b40 con 0x7f70200d1710 2024-09-12T02:48:37.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.733+0000 7f7016000640 1 -- 172.21.15.112:0/1468721155 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7018003bb0 con 0x7f70200d1710 2024-09-12T02:48:37.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.733+0000 7f701f200640 1 -- 172.21.15.112:0/1468721155 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70200b83f0 con 0x7f70200d1710 2024-09-12T02:48:37.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.734+0000 7f701f200640 1 -- 172.21.15.112:0/1468721155 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70200d28d0 con 0x7f70200d1710 2024-09-12T02:48:37.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.735+0000 7f7016000640 1 -- 172.21.15.112:0/1468721155 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7018005d10 con 0x7f70200d1710 2024-09-12T02:48:37.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.736+0000 7f7016000640 1 --2- 172.21.15.112:0/1468721155 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f700006be30 0x7f700006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:37.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.736+0000 7f7016000640 1 -- 172.21.15.112:0/1468721155 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7f701808b820 con 0x7f70200d1710 2024-09-12T02:48:37.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.736+0000 7f701de00640 1 --2- 172.21.15.112:0/1468721155 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f700006be30 0x7f700006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:37.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.737+0000 7f701de00640 1 --2- 172.21.15.112:0/1468721155 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f700006be30 0x7f700006e2f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7010034000 tx=0x7f701002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:37.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.740+0000 7f7016000640 1 -- 172.21.15.112:0/1468721155 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7018022070 con 0x7f70200d1710 2024-09-12T02:48:37.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.915+0000 7f701f200640 1 -- 172.21.15.112:0/1468721155 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f702015f410 con 0x7f70200d1710 2024-09-12T02:48:37.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.917+0000 7f7016000640 1 -- 172.21.15.112:0/1468721155 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) ==== 74+0+16743 (secure 0 0 0) 0x7f70201566f0 con 0x7f70200d1710 2024-09-12T02:48:37.918 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:37.918 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":138,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:48:31.006261+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:47:55.641315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-12T02:47:56.867038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:48:37.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.919+0000 7f701f200640 1 -- 172.21.15.112:0/1468721155 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f700006be30 msgr2=0x7f700006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:37.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.919+0000 7f701f200640 1 --2- 172.21.15.112:0/1468721155 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f700006be30 0x7f700006e2f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7010034000 tx=0x7f701002e000 comp rx=0 tx=0).stop 2024-09-12T02:48:37.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.919+0000 7f701f200640 1 -- 172.21.15.112:0/1468721155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70200d1710 msgr2=0x7f70200b9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:37.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.919+0000 7f701f200640 1 --2- 172.21.15.112:0/1468721155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70200d1710 0x7f70200b9600 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f701800efc0 tx=0x7f7018009f90 comp rx=0 tx=0).stop 2024-09-12T02:48:37.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.919+0000 7f701f200640 1 -- 172.21.15.112:0/1468721155 shutdown_connections 2024-09-12T02:48:37.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.919+0000 7f701f200640 1 --2- 172.21.15.112:0/1468721155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70200d1710 0x7f70200b9600 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:37.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.919+0000 7f701f200640 1 --2- 172.21.15.112:0/1468721155 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f700006be30 0x7f700006e2f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:37.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.919+0000 7f701f200640 1 --2- 172.21.15.112:0/1468721155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70200b3e00 0x7f70201561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:37.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.919+0000 7f701f200640 1 --2- 172.21.15.112:0/1468721155 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70200b1d70 0x7f70200b7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:37.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.919+0000 7f701f200640 1 -- 172.21.15.112:0/1468721155 >> 172.21.15.112:0/1468721155 conn(0x7f702009e030 msgr2=0x7f702006d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:37.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.919+0000 7f701f200640 1 -- 172.21.15.112:0/1468721155 shutdown_connections 2024-09-12T02:48:37.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:37.919+0000 7f701f200640 1 -- 172.21.15.112:0/1468721155 wait complete. 2024-09-12T02:48:37.936 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:48:38.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.088+0000 7f26f9a00640 1 Processor -- start 2024-09-12T02:48:38.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.088+0000 7f26f9a00640 1 -- start start 2024-09-12T02:48:38.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.089+0000 7f26f9a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f26f41623c0 0x7f26f40d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:38.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.089+0000 7f26f9a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26f40b4d30 0x7f26f40d3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:38.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.090+0000 7f26f9a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26f41627a0 con 0x7f26f40d0370 2024-09-12T02:48:38.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.090+0000 7f26f9a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f26f40d08e0 con 0x7f26f41623c0 2024-09-12T02:48:38.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.090+0000 7f26f9a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f26f40d0bc0 con 0x7f26f40b4d30 2024-09-12T02:48:38.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.090+0000 7f26f3e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f26f41623c0 0x7f26f40d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:38.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.090+0000 7f26f3e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f26f41623c0 0x7f26f40d3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58638/0 (socket says 172.21.15.112:58638) 2024-09-12T02:48:38.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.090+0000 7f26f3e00640 1 -- 172.21.15.112:0/3594293904 learned_addr learned my addr 172.21.15.112:0/3594293904 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:38.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.090+0000 7f26f9000640 1 --2- 172.21.15.112:0/3594293904 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26f40b4d30 0x7f26f40d3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:38.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.090+0000 7f26f3e00640 1 -- 172.21.15.112:0/3594293904 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26f40b4d30 msgr2=0x7f26f40d3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:38.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.090+0000 7f26f3e00640 1 --2- 172.21.15.112:0/3594293904 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26f40b4d30 0x7f26f40d3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:38.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.090+0000 7f26f3e00640 1 -- 172.21.15.112:0/3594293904 >> v1:172.21.15.137:6789/0 conn(0x7f26f40d0370 legacy=0x7f26f40b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:38.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.090+0000 7f26f3e00640 1 -- 172.21.15.112:0/3594293904 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f40d2930 con 0x7f26f41623c0 2024-09-12T02:48:38.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.091+0000 7f26f3e00640 1 --2- 172.21.15.112:0/3594293904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26f41623c0 0x7f26f40d3410 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f26e4009870 tx=0x7f26e402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e425282ff651ea08 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:38.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.091+0000 7f26f2a00640 1 -- 172.21.15.112:0/3594293904 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e4037070 con 0x7f26f41623c0 2024-09-12T02:48:38.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.092+0000 7f26f2a00640 1 -- 172.21.15.112:0/3594293904 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e4032440 con 0x7f26f41623c0 2024-09-12T02:48:38.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.092+0000 7f26f2a00640 1 -- 172.21.15.112:0/3594293904 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e4032810 con 0x7f26f41623c0 2024-09-12T02:48:38.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.092+0000 7f26f9a00640 1 -- 172.21.15.112:0/3594293904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26f41623c0 msgr2=0x7f26f40d3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:38.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.092+0000 7f26f9a00640 1 --2- 172.21.15.112:0/3594293904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26f41623c0 0x7f26f40d3410 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f26e4009870 tx=0x7f26e402a2a0 comp rx=0 tx=0).stop 2024-09-12T02:48:38.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.092+0000 7f26f9a00640 1 -- 172.21.15.112:0/3594293904 shutdown_connections 2024-09-12T02:48:38.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.092+0000 7f26f9a00640 1 --2- 172.21.15.112:0/3594293904 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26f40b4d30 0x7f26f40d3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:38.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.092+0000 7f26f9a00640 1 --2- 172.21.15.112:0/3594293904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26f41623c0 0x7f26f40d3410 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:38.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.092+0000 7f26f9a00640 1 -- 172.21.15.112:0/3594293904 >> 172.21.15.112:0/3594293904 conn(0x7f26f40d4cc0 msgr2=0x7f26f40d50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:38.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.092+0000 7f26f9a00640 1 -- 172.21.15.112:0/3594293904 shutdown_connections 2024-09-12T02:48:38.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.092+0000 7f26f9a00640 1 -- 172.21.15.112:0/3594293904 wait complete. 2024-09-12T02:48:38.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.094+0000 7f26f9a00640 1 Processor -- start 2024-09-12T02:48:38.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.094+0000 7f26f9a00640 1 -- start start 2024-09-12T02:48:38.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.095+0000 7f26f9a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26f40d0370 0x7f26f41572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:38.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.095+0000 7f26f9a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26f41623c0 0x7f26f415fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:38.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.095+0000 7f26f9a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26f40cb260 0x7f26f40c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:38.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.095+0000 7f26f9a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f26f40b6460 con 0x7f26f41623c0 2024-09-12T02:48:38.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.095+0000 7f26f9a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f26f40d2ef0 con 0x7f26f40d0370 2024-09-12T02:48:38.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.095+0000 7f26f9a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f26f40b65e0 con 0x7f26f40cb260 2024-09-12T02:48:38.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.095+0000 7f26f3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26f41623c0 0x7f26f415fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:38.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.095+0000 7f26f3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26f41623c0 0x7f26f415fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58650/0 (socket says 172.21.15.112:58650) 2024-09-12T02:48:38.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.095+0000 7f26f3400640 1 -- 172.21.15.112:0/276483928 learned_addr learned my addr 172.21.15.112:0/276483928 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:38.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.095+0000 7f26f9000640 1 --2- 172.21.15.112:0/276483928 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26f40cb260 0x7f26f40c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:38.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.095+0000 7f26f3e00640 1 --2- 172.21.15.112:0/276483928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26f40d0370 0x7f26f41572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:38.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.095+0000 7f26f3400640 1 -- 172.21.15.112:0/276483928 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26f40cb260 msgr2=0x7f26f40c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:38.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.095+0000 7f26f3400640 1 --2- 172.21.15.112:0/276483928 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26f40cb260 0x7f26f40c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:38.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.095+0000 7f26f3400640 1 -- 172.21.15.112:0/276483928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26f40d0370 msgr2=0x7f26f41572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:38.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.095+0000 7f26f3400640 1 --2- 172.21.15.112:0/276483928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26f40d0370 0x7f26f41572f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:38.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.095+0000 7f26f3400640 1 -- 172.21.15.112:0/276483928 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f415ffd0 con 0x7f26f41623c0 2024-09-12T02:48:38.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.095+0000 7f26f3e00640 1 --2- 172.21.15.112:0/276483928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26f40d0370 0x7f26f41572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:38.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.096+0000 7f26f3400640 1 --2- 172.21.15.112:0/276483928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26f41623c0 0x7f26f415fa90 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f26e000c430 tx=0x7f26e000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:38.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.096+0000 7f26ebe00640 1 -- 172.21.15.112:0/276483928 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e0011790 con 0x7f26f41623c0 2024-09-12T02:48:38.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.096+0000 7f26ebe00640 1 -- 172.21.15.112:0/276483928 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e0017070 con 0x7f26f41623c0 2024-09-12T02:48:38.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.096+0000 7f26ebe00640 1 -- 172.21.15.112:0/276483928 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e0011bb0 con 0x7f26f41623c0 2024-09-12T02:48:38.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.096+0000 7f26f9a00640 1 -- 172.21.15.112:0/276483928 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26f415e9f0 con 0x7f26f41623c0 2024-09-12T02:48:38.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.096+0000 7f26f9a00640 1 -- 172.21.15.112:0/276483928 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f415efb0 con 0x7f26f41623c0 2024-09-12T02:48:38.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.097+0000 7f26f9a00640 1 -- 172.21.15.112:0/276483928 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26f40d57e0 con 0x7f26f41623c0 2024-09-12T02:48:38.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.098+0000 7f26ebe00640 1 -- 172.21.15.112:0/276483928 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f26e001c460 con 0x7f26f41623c0 2024-09-12T02:48:38.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.099+0000 7f26ebe00640 1 --2- 172.21.15.112:0/276483928 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f26d406be30 0x7f26d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:38.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.099+0000 7f26ebe00640 1 -- 172.21.15.112:0/276483928 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7f26e008ad50 con 0x7f26f41623c0 2024-09-12T02:48:38.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.099+0000 7f26f3e00640 1 --2- 172.21.15.112:0/276483928 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f26d406be30 0x7f26d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:38.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.100+0000 7f26f3e00640 1 --2- 172.21.15.112:0/276483928 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f26d406be30 0x7f26d406e2f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f26e4034000 tx=0x7f26e402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:38.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.103+0000 7f26ebe00640 1 -- 172.21.15.112:0/276483928 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f26e00596f0 con 0x7f26f41623c0 2024-09-12T02:48:38.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.314+0000 7f26f9a00640 1 -- 172.21.15.112:0/276483928 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f26f40d38f0 con 0x7f26f41623c0 2024-09-12T02:48:38.315 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-12T02:48:38.314+0000 7f0216c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:48:38.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.316+0000 7f26ebe00640 1 -- 172.21.15.112:0/276483928 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v71) ==== 161+0+0 (secure 0 0 0) 0x7f26e0058ff0 con 0x7f26f41623c0 2024-09-12T02:48:38.317 INFO:teuthology.orchestra.run.smithi112.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:48:38.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.319+0000 7f26f9a00640 1 -- 172.21.15.112:0/276483928 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f26d406be30 msgr2=0x7f26d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:38.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.319+0000 7f26f9a00640 1 --2- 172.21.15.112:0/276483928 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f26d406be30 0x7f26d406e2f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f26e4034000 tx=0x7f26e402e000 comp rx=0 tx=0).stop 2024-09-12T02:48:38.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.319+0000 7f26f9a00640 1 -- 172.21.15.112:0/276483928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26f41623c0 msgr2=0x7f26f415fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:38.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.319+0000 7f26f9a00640 1 --2- 172.21.15.112:0/276483928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26f41623c0 0x7f26f415fa90 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f26e000c430 tx=0x7f26e000c8f0 comp rx=0 tx=0).stop 2024-09-12T02:48:38.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.319+0000 7f26f9a00640 1 -- 172.21.15.112:0/276483928 shutdown_connections 2024-09-12T02:48:38.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.319+0000 7f26f9a00640 1 --2- 172.21.15.112:0/276483928 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f26f40cb260 0x7f26f40c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:38.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.319+0000 7f26f9a00640 1 --2- 172.21.15.112:0/276483928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26f41623c0 0x7f26f415fa90 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:38.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.319+0000 7f26f9a00640 1 --2- 172.21.15.112:0/276483928 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f26d406be30 0x7f26d406e2f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:38.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.319+0000 7f26f9a00640 1 --2- 172.21.15.112:0/276483928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26f40d0370 0x7f26f41572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:38.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.319+0000 7f26f9a00640 1 -- 172.21.15.112:0/276483928 >> 172.21.15.112:0/276483928 conn(0x7f26f40d4cc0 msgr2=0x7f26f4162ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:38.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.320+0000 7f26f9a00640 1 -- 172.21.15.112:0/276483928 shutdown_connections 2024-09-12T02:48:38.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.320+0000 7f26f9a00640 1 -- 172.21.15.112:0/276483928 wait complete. 2024-09-12T02:48:38.334 INFO:tasks.ceph.mds.c.smithi112.stderr: -9445> 2024-09-12T02:48:04.078+0000 7f601f600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:48:38.343 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T02:48:38.395 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2024-09-12T02:48:38.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.504+0000 7f4f83800640 1 Processor -- start 2024-09-12T02:48:38.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.505+0000 7f4f83800640 1 -- start start 2024-09-12T02:48:38.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.506+0000 7f4f83800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4f7c15b9d0 0x7f4f7c0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:38.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.506+0000 7f4f83800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f7c0b45d0 0x7f4f7c0728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:38.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.506+0000 7f4f83800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f7c0b54a0 con 0x7f4f7c06eef0 2024-09-12T02:48:38.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.506+0000 7f4f83800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4f7c0b4a60 con 0x7f4f7c15b9d0 2024-09-12T02:48:38.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.506+0000 7f4f83800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4f7c0b3af0 con 0x7f4f7c0b45d0 2024-09-12T02:48:38.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.506+0000 7f4f81800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f4f7c06eef0 0x7f4f7c0cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:44032/0 (socket says 172.21.15.112:44032) 2024-09-12T02:48:38.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.506+0000 7f4f81800640 1 -- 172.21.15.112:0/3025037940 learned_addr learned my addr 172.21.15.112:0/3025037940 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:38.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.506+0000 7f4f73e00640 1 --2- 172.21.15.112:0/3025037940 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f7c0b45d0 0x7f4f7c0728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:38.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.506+0000 7f4f80e00640 1 --2- 172.21.15.112:0/3025037940 >> v2:172.21.15.137:3300/0 conn(0x7f4f7c15b9d0 0x7f4f7c0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:38.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.507+0000 7f4f7be00640 1 -- 172.21.15.112:0/3025037940 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1076649169 0 0) 0x7f4f7c0b54a0 con 0x7f4f7c06eef0 2024-09-12T02:48:38.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.507+0000 7f4f7be00640 1 -- 172.21.15.112:0/3025037940 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f60003520 con 0x7f4f7c06eef0 2024-09-12T02:48:38.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.507+0000 7f4f73e00640 1 -- 172.21.15.112:0/3025037940 >> v2:172.21.15.137:3300/0 conn(0x7f4f7c15b9d0 msgr2=0x7f4f7c0b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:38.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.507+0000 7f4f73e00640 1 --2- 172.21.15.112:0/3025037940 >> v2:172.21.15.137:3300/0 conn(0x7f4f7c15b9d0 0x7f4f7c0b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:38.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.507+0000 7f4f73e00640 1 -- 172.21.15.112:0/3025037940 >> v1:172.21.15.112:6789/0 conn(0x7f4f7c06eef0 legacy=0x7f4f7c0cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:38.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.507+0000 7f4f73e00640 1 -- 172.21.15.112:0/3025037940 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f7c0b3dd0 con 0x7f4f7c0b45d0 2024-09-12T02:48:38.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.508+0000 7f4f73e00640 1 --2- 172.21.15.112:0/3025037940 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f7c0b45d0 0x7f4f7c0728c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4f64009790 tx=0x7f4f6402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1ae85ddcaf661af server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:38.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.508+0000 7f4f7be00640 1 -- 172.21.15.112:0/3025037940 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f64037070 con 0x7f4f7c0b45d0 2024-09-12T02:48:38.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.508+0000 7f4f7be00640 1 -- 172.21.15.112:0/3025037940 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f64032440 con 0x7f4f7c0b45d0 2024-09-12T02:48:38.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.508+0000 7f4f7be00640 1 -- 172.21.15.112:0/3025037940 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f640327f0 con 0x7f4f7c0b45d0 2024-09-12T02:48:38.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.509+0000 7f4f83800640 1 -- 172.21.15.112:0/3025037940 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f7c0b45d0 msgr2=0x7f4f7c0728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:38.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.509+0000 7f4f83800640 1 --2- 172.21.15.112:0/3025037940 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f7c0b45d0 0x7f4f7c0728c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4f64009790 tx=0x7f4f6402a180 comp rx=0 tx=0).stop 2024-09-12T02:48:38.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.509+0000 7f4f83800640 1 -- 172.21.15.112:0/3025037940 shutdown_connections 2024-09-12T02:48:38.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.509+0000 7f4f83800640 1 --2- 172.21.15.112:0/3025037940 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f7c0b45d0 0x7f4f7c0728c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:38.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.509+0000 7f4f83800640 1 --2- 172.21.15.112:0/3025037940 >> v2:172.21.15.137:3300/0 conn(0x7f4f7c15b9d0 0x7f4f7c0b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:38.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.509+0000 7f4f83800640 1 -- 172.21.15.112:0/3025037940 >> 172.21.15.112:0/3025037940 conn(0x7f4f7c06bbd0 msgr2=0x7f4f7c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:38.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.509+0000 7f4f83800640 1 -- 172.21.15.112:0/3025037940 shutdown_connections 2024-09-12T02:48:38.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.509+0000 7f4f83800640 1 -- 172.21.15.112:0/3025037940 wait complete. 2024-09-12T02:48:38.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.510+0000 7f4f83800640 1 Processor -- start 2024-09-12T02:48:38.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.511+0000 7f4f83800640 1 -- start start 2024-09-12T02:48:38.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.511+0000 7f4f83800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f7c06eef0 0x7f4f7c155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:38.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.511+0000 7f4f83800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f7c0b45d0 0x7f4f7c0afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:38.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.511+0000 7f4f83800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f7c15b9d0 0x7f4f7c15e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:38.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.511+0000 7f4f83800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c15bf30 con 0x7f4f7c06eef0 2024-09-12T02:48:38.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.512+0000 7f4f83800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c15bdb0 con 0x7f4f7c0b45d0 2024-09-12T02:48:38.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.512+0000 7f4f83800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4f7c06f320 con 0x7f4f7c15b9d0 2024-09-12T02:48:38.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.512+0000 7f4f80e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f7c06eef0 0x7f4f7c155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:38.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.512+0000 7f4f80e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f7c06eef0 0x7f4f7c155d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58676/0 (socket says 172.21.15.112:58676) 2024-09-12T02:48:38.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.512+0000 7f4f80e00640 1 -- 172.21.15.112:0/35782108 learned_addr learned my addr 172.21.15.112:0/35782108 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:38.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.512+0000 7f4f73e00640 1 --2- 172.21.15.112:0/35782108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f7c0b45d0 0x7f4f7c0afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:38.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.512+0000 7f4f81800640 1 --2- 172.21.15.112:0/35782108 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f7c15b9d0 0x7f4f7c15e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:38.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.512+0000 7f4f80e00640 1 -- 172.21.15.112:0/35782108 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f7c15b9d0 msgr2=0x7f4f7c15e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:38.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.512+0000 7f4f80e00640 1 --2- 172.21.15.112:0/35782108 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f7c15b9d0 0x7f4f7c15e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:38.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.512+0000 7f4f80e00640 1 -- 172.21.15.112:0/35782108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f7c0b45d0 msgr2=0x7f4f7c0afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:38.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.512+0000 7f4f80e00640 1 --2- 172.21.15.112:0/35782108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f7c0b45d0 0x7f4f7c0afc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:38.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.512+0000 7f4f80e00640 1 -- 172.21.15.112:0/35782108 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f7c154c60 con 0x7f4f7c06eef0 2024-09-12T02:48:38.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.512+0000 7f4f80e00640 1 --2- 172.21.15.112:0/35782108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f7c06eef0 0x7f4f7c155d00 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00e8a0 tx=0x7f4f6c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:38.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.513+0000 7f4f79600640 1 -- 172.21.15.112:0/35782108 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c017070 con 0x7f4f7c06eef0 2024-09-12T02:48:38.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.513+0000 7f4f79600640 1 -- 172.21.15.112:0/35782108 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f6c00c940 con 0x7f4f7c06eef0 2024-09-12T02:48:38.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.513+0000 7f4f83800640 1 -- 172.21.15.112:0/35782108 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f7c154f40 con 0x7f4f7c06eef0 2024-09-12T02:48:38.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.513+0000 7f4f79600640 1 -- 172.21.15.112:0/35782108 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c00cd30 con 0x7f4f7c06eef0 2024-09-12T02:48:38.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.513+0000 7f4f83800640 1 -- 172.21.15.112:0/35782108 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f7c155500 con 0x7f4f7c06eef0 2024-09-12T02:48:38.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.514+0000 7f4f83800640 1 -- 172.21.15.112:0/35782108 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f7c068a30 con 0x7f4f7c06eef0 2024-09-12T02:48:38.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.515+0000 7f4f79600640 1 -- 172.21.15.112:0/35782108 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4f6c01a070 con 0x7f4f7c06eef0 2024-09-12T02:48:38.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.516+0000 7f4f79600640 1 --2- 172.21.15.112:0/35782108 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4f5806be30 0x7f4f5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:38.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.516+0000 7f4f79600640 1 -- 172.21.15.112:0/35782108 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5795+0+0 (secure 0 0 0) 0x7f4f6c08afd0 con 0x7f4f7c06eef0 2024-09-12T02:48:38.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.516+0000 7f4f73e00640 1 --2- 172.21.15.112:0/35782108 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4f5806be30 0x7f4f5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:38.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.517+0000 7f4f73e00640 1 --2- 172.21.15.112:0/35782108 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4f5806be30 0x7f4f5806e2f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4f64034000 tx=0x7f4f6402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:38.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.520+0000 7f4f79600640 1 -- 172.21.15.112:0/35782108 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4f6c059360 con 0x7f4f7c06eef0 2024-09-12T02:48:38.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:38.726+0000 7f4f83800640 1 -- 172.21.15.112:0/35782108 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f4f7c155940 con 0x7f4f7c06eef0 2024-09-12T02:48:39.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.322+0000 7f4f79600640 1 -- 172.21.15.112:0/35782108 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v72) ==== 104+0+0 (secure 0 0 0) 0x7f4f6c05d660 con 0x7f4f7c06eef0 2024-09-12T02:48:39.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.325+0000 7f4f83800640 1 -- 172.21.15.112:0/35782108 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4f5806be30 msgr2=0x7f4f5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:39.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.325+0000 7f4f83800640 1 --2- 172.21.15.112:0/35782108 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4f5806be30 0x7f4f5806e2f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4f64034000 tx=0x7f4f6402e000 comp rx=0 tx=0).stop 2024-09-12T02:48:39.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.325+0000 7f4f83800640 1 -- 172.21.15.112:0/35782108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f7c06eef0 msgr2=0x7f4f7c155d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:39.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.325+0000 7f4f83800640 1 --2- 172.21.15.112:0/35782108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f7c06eef0 0x7f4f7c155d00 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00e8a0 tx=0x7f4f6c00ed60 comp rx=0 tx=0).stop 2024-09-12T02:48:39.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.326+0000 7f4f83800640 1 -- 172.21.15.112:0/35782108 shutdown_connections 2024-09-12T02:48:39.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.326+0000 7f4f83800640 1 --2- 172.21.15.112:0/35782108 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f7c15b9d0 0x7f4f7c15e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:39.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.326+0000 7f4f83800640 1 --2- 172.21.15.112:0/35782108 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4f5806be30 0x7f4f5806e2f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:39.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.326+0000 7f4f83800640 1 --2- 172.21.15.112:0/35782108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f7c0b45d0 0x7f4f7c0afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:39.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.326+0000 7f4f83800640 1 --2- 172.21.15.112:0/35782108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f7c06eef0 0x7f4f7c155d00 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:39.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.326+0000 7f4f83800640 1 -- 172.21.15.112:0/35782108 >> 172.21.15.112:0/35782108 conn(0x7f4f7c06bbd0 msgr2=0x7f4f7c0b54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:39.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.326+0000 7f4f83800640 1 -- 172.21.15.112:0/35782108 shutdown_connections 2024-09-12T02:48:39.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.326+0000 7f4f83800640 1 -- 172.21.15.112:0/35782108 wait complete. 2024-09-12T02:48:39.343 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T02:48:39.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.501+0000 7f34e0200640 1 Processor -- start 2024-09-12T02:48:39.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.501+0000 7f34e0200640 1 -- start start 2024-09-12T02:48:39.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.502+0000 7f34e0200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f34d8144890 0x7f34d80b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:39.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.502+0000 7f34e0200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34d80b4140 0x7f34d80ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:39.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.503+0000 7f34e0200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34d806eed0 con 0x7f34d81602f0 2024-09-12T02:48:39.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.503+0000 7f34e0200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f34d806f170 con 0x7f34d8144890 2024-09-12T02:48:39.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.503+0000 7f34e0200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f34d815f810 con 0x7f34d80b4140 2024-09-12T02:48:39.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.503+0000 7f34dd800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f34d8144890 0x7f34d80b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:39.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.503+0000 7f34dd800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f34d8144890 0x7f34d80b58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58686/0 (socket says 172.21.15.112:58686) 2024-09-12T02:48:39.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.503+0000 7f34dd800640 1 -- 172.21.15.112:0/2819150460 learned_addr learned my addr 172.21.15.112:0/2819150460 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:39.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.503+0000 7f34de200640 1 --2- 172.21.15.112:0/2819150460 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34d80b4140 0x7f34d80ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:39.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.503+0000 7f34dd800640 1 -- 172.21.15.112:0/2819150460 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34d80b4140 msgr2=0x7f34d80ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:39.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.503+0000 7f34dd800640 1 --2- 172.21.15.112:0/2819150460 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34d80b4140 0x7f34d80ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:39.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.503+0000 7f34dd800640 1 -- 172.21.15.112:0/2819150460 >> v1:172.21.15.137:6789/0 conn(0x7f34d81602f0 legacy=0x7f34d80b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:39.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.503+0000 7f34dd800640 1 -- 172.21.15.112:0/2819150460 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d815faf0 con 0x7f34d8144890 2024-09-12T02:48:39.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.504+0000 7f34dd800640 1 --2- 172.21.15.112:0/2819150460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d8144890 0x7f34d80b58c0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f34cc009870 tx=0x7f34cc02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a37e3c80ddc696 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:39.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.504+0000 7f34d7e00640 1 -- 172.21.15.112:0/2819150460 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc037070 con 0x7f34d8144890 2024-09-12T02:48:39.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.504+0000 7f34d7e00640 1 -- 172.21.15.112:0/2819150460 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34cc032440 con 0x7f34d8144890 2024-09-12T02:48:39.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.504+0000 7f34d7e00640 1 -- 172.21.15.112:0/2819150460 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc032810 con 0x7f34d8144890 2024-09-12T02:48:39.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.505+0000 7f34e0200640 1 -- 172.21.15.112:0/2819150460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d8144890 msgr2=0x7f34d80b58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:39.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.505+0000 7f34e0200640 1 --2- 172.21.15.112:0/2819150460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d8144890 0x7f34d80b58c0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f34cc009870 tx=0x7f34cc02a250 comp rx=0 tx=0).stop 2024-09-12T02:48:39.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.505+0000 7f34e0200640 1 -- 172.21.15.112:0/2819150460 shutdown_connections 2024-09-12T02:48:39.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.505+0000 7f34e0200640 1 --2- 172.21.15.112:0/2819150460 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34d80b4140 0x7f34d80ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:39.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.505+0000 7f34e0200640 1 --2- 172.21.15.112:0/2819150460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d8144890 0x7f34d80b58c0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:39.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.505+0000 7f34e0200640 1 -- 172.21.15.112:0/2819150460 >> 172.21.15.112:0/2819150460 conn(0x7f34d80b2730 msgr2=0x7f34d80b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:39.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.505+0000 7f34e0200640 1 -- 172.21.15.112:0/2819150460 shutdown_connections 2024-09-12T02:48:39.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.505+0000 7f34e0200640 1 -- 172.21.15.112:0/2819150460 wait complete. 2024-09-12T02:48:39.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.507+0000 7f34e0200640 1 Processor -- start 2024-09-12T02:48:39.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.507+0000 7f34e0200640 1 -- start start 2024-09-12T02:48:39.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.508+0000 7f34e0200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34d80b4140 0x7f34d81426b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:39.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.508+0000 7f34e0200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34d8144890 0x7f34d8153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:39.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.508+0000 7f34e0200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d81602f0 0x7f34d81431b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:39.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.508+0000 7f34e0200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f34d8144df0 con 0x7f34d81602f0 2024-09-12T02:48:39.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.508+0000 7f34e0200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f34d8144c70 con 0x7f34d8144890 2024-09-12T02:48:39.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.508+0000 7f34e0200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f34d80b3290 con 0x7f34d80b4140 2024-09-12T02:48:39.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.508+0000 7f34de200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d81602f0 0x7f34d81431b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:39.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.508+0000 7f34de200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d81602f0 0x7f34d81431b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58700/0 (socket says 172.21.15.112:58700) 2024-09-12T02:48:39.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.508+0000 7f34de200640 1 -- 172.21.15.112:0/2910568089 learned_addr learned my addr 172.21.15.112:0/2910568089 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:39.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.508+0000 7f34dd800640 1 --2- 172.21.15.112:0/2910568089 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34d80b4140 0x7f34d81426b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:39.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.508+0000 7f34dce00640 1 --2- 172.21.15.112:0/2910568089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34d8144890 0x7f34d8153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:39.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.508+0000 7f34de200640 1 -- 172.21.15.112:0/2910568089 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34d80b4140 msgr2=0x7f34d81426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:39.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.508+0000 7f34de200640 1 --2- 172.21.15.112:0/2910568089 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34d80b4140 0x7f34d81426b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:39.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.508+0000 7f34de200640 1 -- 172.21.15.112:0/2910568089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34d8144890 msgr2=0x7f34d8153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:39.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.508+0000 7f34de200640 1 --2- 172.21.15.112:0/2910568089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34d8144890 0x7f34d8153410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:39.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.508+0000 7f34de200640 1 -- 172.21.15.112:0/2910568089 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d8153d70 con 0x7f34d81602f0 2024-09-12T02:48:39.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.508+0000 7f34dce00640 1 --2- 172.21.15.112:0/2910568089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34d8144890 0x7f34d8153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:39.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.509+0000 7f34de200640 1 --2- 172.21.15.112:0/2910568089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d81602f0 0x7f34d81431b0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f34d0007e40 tx=0x7f34d000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:39.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.509+0000 7f34d5600640 1 -- 172.21.15.112:0/2910568089 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d0014620 con 0x7f34d81602f0 2024-09-12T02:48:39.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.509+0000 7f34d5600640 1 -- 172.21.15.112:0/2910568089 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d0019070 con 0x7f34d81602f0 2024-09-12T02:48:39.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.509+0000 7f34d5600640 1 -- 172.21.15.112:0/2910568089 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d0014a20 con 0x7f34d81602f0 2024-09-12T02:48:39.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.509+0000 7f34e0200640 1 -- 172.21.15.112:0/2910568089 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34d8154050 con 0x7f34d81602f0 2024-09-12T02:48:39.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.509+0000 7f34e0200640 1 -- 172.21.15.112:0/2910568089 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34d8151480 con 0x7f34d81602f0 2024-09-12T02:48:39.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.510+0000 7f34e0200640 1 -- 172.21.15.112:0/2910568089 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34d80b58c0 con 0x7f34d81602f0 2024-09-12T02:48:39.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.511+0000 7f34d5600640 1 -- 172.21.15.112:0/2910568089 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f34d0014bc0 con 0x7f34d81602f0 2024-09-12T02:48:39.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.512+0000 7f34d5600640 1 --2- 172.21.15.112:0/2910568089 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f34b806be30 0x7f34b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:39.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.512+0000 7f34d5600640 1 -- 172.21.15.112:0/2910568089 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5795+0+0 (secure 0 0 0) 0x7f34d008b830 con 0x7f34d81602f0 2024-09-12T02:48:39.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.512+0000 7f34dd800640 1 --2- 172.21.15.112:0/2910568089 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f34b806be30 0x7f34b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:39.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.512+0000 7f34dd800640 1 --2- 172.21.15.112:0/2910568089 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f34b806be30 0x7f34b806e2f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f34cc034000 tx=0x7f34cc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:39.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.516+0000 7f34d5600640 1 -- 172.21.15.112:0/2910568089 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f34d005a0e0 con 0x7f34d81602f0 2024-09-12T02:48:39.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:39.689+0000 7f34e0200640 1 -- 172.21.15.112:0/2910568089 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f34d8068f60 con 0x7f34d81602f0 2024-09-12T02:48:40.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.324+0000 7f34d5600640 1 -- 172.21.15.112:0/2910568089 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v140) ==== 181+0+0 (secure 0 0 0) 0x7f34d00599e0 con 0x7f34d81602f0 2024-09-12T02:48:40.325 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' removed 2024-09-12T02:48:40.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.327+0000 7f34e0200640 1 -- 172.21.15.112:0/2910568089 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f34b806be30 msgr2=0x7f34b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:40.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.327+0000 7f34e0200640 1 --2- 172.21.15.112:0/2910568089 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f34b806be30 0x7f34b806e2f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f34cc034000 tx=0x7f34cc02e000 comp rx=0 tx=0).stop 2024-09-12T02:48:40.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.327+0000 7f34e0200640 1 -- 172.21.15.112:0/2910568089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d81602f0 msgr2=0x7f34d81431b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:40.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.327+0000 7f34e0200640 1 --2- 172.21.15.112:0/2910568089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d81602f0 0x7f34d81431b0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f34d0007e40 tx=0x7f34d000e4b0 comp rx=0 tx=0).stop 2024-09-12T02:48:40.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.327+0000 7f34e0200640 1 -- 172.21.15.112:0/2910568089 shutdown_connections 2024-09-12T02:48:40.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.327+0000 7f34e0200640 1 --2- 172.21.15.112:0/2910568089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d81602f0 0x7f34d81431b0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:40.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.327+0000 7f34e0200640 1 --2- 172.21.15.112:0/2910568089 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f34b806be30 0x7f34b806e2f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:40.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.327+0000 7f34e0200640 1 --2- 172.21.15.112:0/2910568089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34d8144890 0x7f34d8153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:40.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.327+0000 7f34e0200640 1 --2- 172.21.15.112:0/2910568089 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34d80b4140 0x7f34d81426b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:40.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.328+0000 7f34e0200640 1 -- 172.21.15.112:0/2910568089 >> 172.21.15.112:0/2910568089 conn(0x7f34d80b2730 msgr2=0x7f34d80ae990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:40.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.328+0000 7f34e0200640 1 -- 172.21.15.112:0/2910568089 shutdown_connections 2024-09-12T02:48:40.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.328+0000 7f34e0200640 1 -- 172.21.15.112:0/2910568089 wait complete. 2024-09-12T02:48:40.348 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T02:48:40.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.507+0000 7f999d600640 1 Processor -- start 2024-09-12T02:48:40.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.507+0000 7f999d600640 1 -- start start 2024-09-12T02:48:40.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.508+0000 7f999d600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9998157190 0x7f99980b5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:40.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.508+0000 7f999d600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f999815d110 0x7f999806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:40.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.508+0000 7f999d600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f999806d8f0 con 0x7f99980d0970 2024-09-12T02:48:40.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.508+0000 7f999d600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f99980720b0 con 0x7f9998157190 2024-09-12T02:48:40.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.508+0000 7f999d600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f999815d880 con 0x7f999815d110 2024-09-12T02:48:40.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.508+0000 7f9996a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9998157190 0x7f99980b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:40.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.508+0000 7f9996a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9998157190 0x7f99980b5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58716/0 (socket says 172.21.15.112:58716) 2024-09-12T02:48:40.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.508+0000 7f9996a00640 1 -- 172.21.15.112:0/1464070157 learned_addr learned my addr 172.21.15.112:0/1464070157 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:40.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.509+0000 7f9996a00640 1 -- 172.21.15.112:0/1464070157 >> v2:172.21.15.137:3300/0 conn(0x7f999815d110 msgr2=0x7f999806d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:40.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.509+0000 7f998e000640 1 --2- 172.21.15.112:0/1464070157 >> v2:172.21.15.137:3300/0 conn(0x7f999815d110 0x7f999806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:40.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.509+0000 7f9996a00640 1 --2- 172.21.15.112:0/1464070157 >> v2:172.21.15.137:3300/0 conn(0x7f999815d110 0x7f999806d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:40.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.509+0000 7f9996a00640 1 -- 172.21.15.112:0/1464070157 >> v1:172.21.15.137:6789/0 conn(0x7f99980d0970 legacy=0x7f99980d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:40.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.509+0000 7f9996a00640 1 -- 172.21.15.112:0/1464070157 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f999815db60 con 0x7f9998157190 2024-09-12T02:48:40.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.509+0000 7f998e000640 1 --2- 172.21.15.112:0/1464070157 >> v2:172.21.15.137:3300/0 conn(0x7f999815d110 0x7f999806d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:40.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.510+0000 7f9996a00640 1 --2- 172.21.15.112:0/1464070157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9998157190 0x7f99980b5190 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f99980d1ac0 tx=0x7f998802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44073e705f0ca8c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:40.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.510+0000 7f9996000640 1 -- 172.21.15.112:0/1464070157 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9988037070 con 0x7f9998157190 2024-09-12T02:48:40.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.510+0000 7f9996000640 1 -- 172.21.15.112:0/1464070157 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9988032440 con 0x7f9998157190 2024-09-12T02:48:40.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.510+0000 7f9996000640 1 -- 172.21.15.112:0/1464070157 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9988032810 con 0x7f9998157190 2024-09-12T02:48:40.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.510+0000 7f999d600640 1 -- 172.21.15.112:0/1464070157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9998157190 msgr2=0x7f99980b5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:40.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.510+0000 7f999d600640 1 --2- 172.21.15.112:0/1464070157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9998157190 0x7f99980b5190 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f99980d1ac0 tx=0x7f998802a230 comp rx=0 tx=0).stop 2024-09-12T02:48:40.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.511+0000 7f999d600640 1 -- 172.21.15.112:0/1464070157 shutdown_connections 2024-09-12T02:48:40.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.511+0000 7f999d600640 1 --2- 172.21.15.112:0/1464070157 >> v2:172.21.15.137:3300/0 conn(0x7f999815d110 0x7f999806d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:40.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.511+0000 7f999d600640 1 --2- 172.21.15.112:0/1464070157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9998157190 0x7f99980b5190 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:40.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.511+0000 7f999d600640 1 -- 172.21.15.112:0/1464070157 >> 172.21.15.112:0/1464070157 conn(0x7f99980b2730 msgr2=0x7f99980b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:40.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.511+0000 7f999d600640 1 -- 172.21.15.112:0/1464070157 shutdown_connections 2024-09-12T02:48:40.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.511+0000 7f999d600640 1 -- 172.21.15.112:0/1464070157 wait complete. 2024-09-12T02:48:40.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.512+0000 7f999d600640 1 Processor -- start 2024-09-12T02:48:40.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.512+0000 7f999d600640 1 -- start start 2024-09-12T02:48:40.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.513+0000 7f999d600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99980d0970 0x7f999815c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:40.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.513+0000 7f999d600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9998157190 0x7f999814f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:40.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.513+0000 7f999d600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f999815d110 0x7f9998157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:40.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.513+0000 7f999d600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f999815d5a0 con 0x7f9998157190 2024-09-12T02:48:40.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.513+0000 7f999d600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9998072350 con 0x7f99980d0970 2024-09-12T02:48:40.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.513+0000 7f999d600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9998157570 con 0x7f999815d110 2024-09-12T02:48:40.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.513+0000 7f998e000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9998157190 0x7f999814f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:40.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.513+0000 7f998e000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9998157190 0x7f999814f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58726/0 (socket says 172.21.15.112:58726) 2024-09-12T02:48:40.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.513+0000 7f998e000640 1 -- 172.21.15.112:0/348935926 learned_addr learned my addr 172.21.15.112:0/348935926 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:40.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.514+0000 7f998e000640 1 -- 172.21.15.112:0/348935926 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f999815d110 msgr2=0x7f9998157750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:40.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.514+0000 7f998e000640 1 --2- 172.21.15.112:0/348935926 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f999815d110 0x7f9998157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:40.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.514+0000 7f9996a00640 1 --2- 172.21.15.112:0/348935926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99980d0970 0x7f999815c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:40.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.514+0000 7f998e000640 1 -- 172.21.15.112:0/348935926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99980d0970 msgr2=0x7f999815c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:40.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.514+0000 7f998e000640 1 --2- 172.21.15.112:0/348935926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99980d0970 0x7f999815c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:40.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.514+0000 7f998e000640 1 -- 172.21.15.112:0/348935926 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9998157c90 con 0x7f9998157190 2024-09-12T02:48:40.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.514+0000 7f998e000640 1 --2- 172.21.15.112:0/348935926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9998157190 0x7f999814f780 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f998000c7f0 tx=0x7f998000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:40.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.514+0000 7f998f400640 1 -- 172.21.15.112:0/348935926 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9980015070 con 0x7f9998157190 2024-09-12T02:48:40.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.514+0000 7f998f400640 1 -- 172.21.15.112:0/348935926 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9980007820 con 0x7f9998157190 2024-09-12T02:48:40.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.514+0000 7f998f400640 1 -- 172.21.15.112:0/348935926 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9980007bd0 con 0x7f9998157190 2024-09-12T02:48:40.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.514+0000 7f999d600640 1 -- 172.21.15.112:0/348935926 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9998157f30 con 0x7f9998157190 2024-09-12T02:48:40.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.514+0000 7f999d600640 1 -- 172.21.15.112:0/348935926 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99981584f0 con 0x7f9998157190 2024-09-12T02:48:40.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.515+0000 7f999d600640 1 -- 172.21.15.112:0/348935926 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f999806e5b0 con 0x7f9998157190 2024-09-12T02:48:40.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.516+0000 7f998f400640 1 -- 172.21.15.112:0/348935926 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9980018070 con 0x7f9998157190 2024-09-12T02:48:40.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.517+0000 7f998f400640 1 --2- 172.21.15.112:0/348935926 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f997406be30 0x7f997406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:40.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.517+0000 7f998f400640 1 -- 172.21.15.112:0/348935926 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5357+0+0 (secure 0 0 0) 0x7f998008adf0 con 0x7f9998157190 2024-09-12T02:48:40.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.518+0000 7f9996a00640 1 --2- 172.21.15.112:0/348935926 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f997406be30 0x7f997406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:40.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.518+0000 7f9996a00640 1 --2- 172.21.15.112:0/348935926 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f997406be30 0x7f997406e2f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9988034000 tx=0x7f998802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:40.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.522+0000 7f998f400640 1 -- 172.21.15.112:0/348935926 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f99800598f0 con 0x7f9998157190 2024-09-12T02:48:40.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:40.697+0000 7f999d600640 1 -- 172.21.15.112:0/348935926 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f999806e2d0 con 0x7f9998157190 2024-09-12T02:48:41.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.009+0000 7f998f400640 1 -- 172.21.15.112:0/348935926 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v141) ==== 169+0+0 (secure 0 0 0) 0x7f99800591f0 con 0x7f9998157190 2024-09-12T02:48:41.010 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' removed 2024-09-12T02:48:41.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.014+0000 7f999d600640 1 -- 172.21.15.112:0/348935926 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f997406be30 msgr2=0x7f997406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:41.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.014+0000 7f999d600640 1 --2- 172.21.15.112:0/348935926 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f997406be30 0x7f997406e2f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9988034000 tx=0x7f998802e000 comp rx=0 tx=0).stop 2024-09-12T02:48:41.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.014+0000 7f999d600640 1 -- 172.21.15.112:0/348935926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9998157190 msgr2=0x7f999814f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:41.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.014+0000 7f999d600640 1 --2- 172.21.15.112:0/348935926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9998157190 0x7f999814f780 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f998000c7f0 tx=0x7f998000ccb0 comp rx=0 tx=0).stop 2024-09-12T02:48:41.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.014+0000 7f999d600640 1 -- 172.21.15.112:0/348935926 shutdown_connections 2024-09-12T02:48:41.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.014+0000 7f999d600640 1 --2- 172.21.15.112:0/348935926 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f999815d110 0x7f9998157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:41.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.014+0000 7f999d600640 1 --2- 172.21.15.112:0/348935926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9998157190 0x7f999814f780 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:41.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.014+0000 7f999d600640 1 --2- 172.21.15.112:0/348935926 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f997406be30 0x7f997406e2f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:41.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.014+0000 7f999d600640 1 --2- 172.21.15.112:0/348935926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99980d0970 0x7f999815c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:41.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.014+0000 7f999d600640 1 -- 172.21.15.112:0/348935926 >> 172.21.15.112:0/348935926 conn(0x7f99980b2730 msgr2=0x7f99980cde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:41.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.015+0000 7f999d600640 1 -- 172.21.15.112:0/348935926 shutdown_connections 2024-09-12T02:48:41.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.015+0000 7f999d600640 1 -- 172.21.15.112:0/348935926 wait complete. 2024-09-12T02:48:41.033 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T02:48:41.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.191+0000 7f192c600640 1 Processor -- start 2024-09-12T02:48:41.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.191+0000 7f192c600640 1 -- start start 2024-09-12T02:48:41.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.193+0000 7f192c600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f192415cc50 0x7f19240732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:41.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.193+0000 7f192c600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19240afe30 0x7f19240cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:41.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.193+0000 7f192c600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1924073830 con 0x7f1924071530 2024-09-12T02:48:41.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.193+0000 7f192c600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f192415d030 con 0x7f192415cc50 2024-09-12T02:48:41.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.193+0000 7f192c600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f19240cf4c0 con 0x7f19240afe30 2024-09-12T02:48:41.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.193+0000 7f1929200640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f1924071530 0x7f19240af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:44044/0 (socket says 172.21.15.112:44044) 2024-09-12T02:48:41.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.193+0000 7f1929200640 1 -- 172.21.15.112:0/1443742536 learned_addr learned my addr 172.21.15.112:0/1443742536 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:41.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.193+0000 7f1929c00640 1 --2- 172.21.15.112:0/1443742536 >> v2:172.21.15.137:3300/0 conn(0x7f192415cc50 0x7f19240732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:41.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.193+0000 7f192a600640 1 --2- 172.21.15.112:0/1443742536 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19240afe30 0x7f19240cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:41.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.193+0000 7f1923e00640 1 -- 172.21.15.112:0/1443742536 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1642782933 0 0) 0x7f1910001290 con 0x7f1924071530 2024-09-12T02:48:41.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.193+0000 7f1923e00640 1 -- 172.21.15.112:0/1443742536 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f190c003520 con 0x7f1924071530 2024-09-12T02:48:41.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.194+0000 7f1923e00640 1 -- 172.21.15.112:0/1443742536 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2375662932 0 0) 0x7f190c003520 con 0x7f1924071530 2024-09-12T02:48:41.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.194+0000 7f1923e00640 1 -- 172.21.15.112:0/1443742536 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19240afe30 msgr2=0x7f19240cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:41.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.194+0000 7f1923e00640 1 --2- 172.21.15.112:0/1443742536 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19240afe30 0x7f19240cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:41.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.194+0000 7f1923e00640 1 -- 172.21.15.112:0/1443742536 >> v2:172.21.15.137:3300/0 conn(0x7f192415cc50 msgr2=0x7f19240732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:41.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.194+0000 7f1923e00640 1 --2- 172.21.15.112:0/1443742536 >> v2:172.21.15.137:3300/0 conn(0x7f192415cc50 0x7f19240732f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:41.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.194+0000 7f1923e00640 1 -- 172.21.15.112:0/1443742536 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19240ceeb0 con 0x7f1924071530 2024-09-12T02:48:41.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.194+0000 7f1923e00640 1 -- 172.21.15.112:0/1443742536 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f19100019c0 con 0x7f1924071530 2024-09-12T02:48:41.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.194+0000 7f1923e00640 1 -- 172.21.15.112:0/1443742536 >> v1:172.21.15.112:6789/0 conn(0x7f1924071530 legacy=0x7f19240af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:41.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.194+0000 7f1923e00640 1 --2- 172.21.15.112:0/1443742536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f190c0039b0 0x7f190c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:41.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.194+0000 7f1923e00640 1 --2- 172.21.15.112:0/1443742536 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19240afe30 0x7f190c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:41.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.194+0000 7f1923e00640 1 --2- 172.21.15.112:0/1443742536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f190c004d40 0x7f190c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:41.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.194+0000 7f1923e00640 1 -- 172.21.15.112:0/1443742536 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f19240cf4c0 con 0x7f190c004d40 2024-09-12T02:48:41.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.194+0000 7f1923e00640 1 -- 172.21.15.112:0/1443742536 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f190c00b9c0 con 0x7f190c0039b0 2024-09-12T02:48:41.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.194+0000 7f1923e00640 1 -- 172.21.15.112:0/1443742536 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f190c00bb70 con 0x7f19240afe30 2024-09-12T02:48:41.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.194+0000 7f192a600640 1 --2- 172.21.15.112:0/1443742536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f190c004d40 0x7f190c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:41.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.194+0000 7f1929200640 1 --2- 172.21.15.112:0/1443742536 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19240afe30 0x7f190c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:41.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.194+0000 7f1929c00640 1 --2- 172.21.15.112:0/1443742536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f190c0039b0 0x7f190c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:41.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.195+0000 7f192a600640 1 -- 172.21.15.112:0/1443742536 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19240afe30 msgr2=0x7f190c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:41.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.195+0000 7f192a600640 1 --2- 172.21.15.112:0/1443742536 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19240afe30 0x7f190c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:41.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.195+0000 7f192a600640 1 -- 172.21.15.112:0/1443742536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f190c0039b0 msgr2=0x7f190c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:41.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.195+0000 7f192a600640 1 --2- 172.21.15.112:0/1443742536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f190c0039b0 0x7f190c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:41.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.195+0000 7f192a600640 1 -- 172.21.15.112:0/1443742536 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f190c003520 con 0x7f190c004d40 2024-09-12T02:48:41.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.196+0000 7f192a600640 1 --2- 172.21.15.112:0/1443742536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f190c004d40 0x7f190c0051c0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f19240710c0 tx=0x7f190c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f3648118cbc9c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:41.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.196+0000 7f1923e00640 1 -- 172.21.15.112:0/1443742536 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c037070 con 0x7f190c004d40 2024-09-12T02:48:41.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.196+0000 7f1923e00640 1 -- 172.21.15.112:0/1443742536 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f191c02e050 con 0x7f190c004d40 2024-09-12T02:48:41.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.196+0000 7f1923e00640 1 -- 172.21.15.112:0/1443742536 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c009c10 con 0x7f190c004d40 2024-09-12T02:48:41.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.196+0000 7f192c600640 1 -- 172.21.15.112:0/1443742536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f190c004d40 msgr2=0x7f190c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:41.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.196+0000 7f192c600640 1 --2- 172.21.15.112:0/1443742536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f190c004d40 0x7f190c0051c0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f19240710c0 tx=0x7f190c005830 comp rx=0 tx=0).stop 2024-09-12T02:48:41.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.196+0000 7f192a600640 1 -- 172.21.15.112:0/1443742536 reap_dead start 2024-09-12T02:48:41.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.197+0000 7f192c600640 1 -- 172.21.15.112:0/1443742536 shutdown_connections 2024-09-12T02:48:41.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.197+0000 7f192c600640 1 -- 172.21.15.112:0/1443742536 >> 172.21.15.112:0/1443742536 conn(0x7f192406bbd0 msgr2=0x7f192406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:41.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.197+0000 7f192c600640 1 -- 172.21.15.112:0/1443742536 shutdown_connections 2024-09-12T02:48:41.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.197+0000 7f192c600640 1 -- 172.21.15.112:0/1443742536 wait complete. 2024-09-12T02:48:41.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.198+0000 7f192c600640 1 Processor -- start 2024-09-12T02:48:41.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.198+0000 7f192c600640 1 -- start start 2024-09-12T02:48:41.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.199+0000 7f192c600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f190c004d40 0x7f19241f7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:41.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.199+0000 7f192c600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19240ad280 0x7f19240ad700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:41.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.199+0000 7f192c600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19241f5230 0x7f19241f56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:41.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.199+0000 7f192c600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f19240cf150 con 0x7f19241f5230 2024-09-12T02:48:41.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.199+0000 7f192c600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f192406e5e0 con 0x7f19240ad280 2024-09-12T02:48:41.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.199+0000 7f192c600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f192406f510 con 0x7f190c004d40 2024-09-12T02:48:41.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.199+0000 7f192a600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19241f5230 0x7f19241f56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:41.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.199+0000 7f192a600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19241f5230 0x7f19241f56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58734/0 (socket says 172.21.15.112:58734) 2024-09-12T02:48:41.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.200+0000 7f192a600640 1 -- 172.21.15.112:0/3274700257 learned_addr learned my addr 172.21.15.112:0/3274700257 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:41.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.200+0000 7f1929c00640 1 --2- 172.21.15.112:0/3274700257 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f190c004d40 0x7f19241f7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:41.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.200+0000 7f1929200640 1 --2- 172.21.15.112:0/3274700257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19240ad280 0x7f19240ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:41.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.200+0000 7f192a600640 1 -- 172.21.15.112:0/3274700257 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f190c004d40 msgr2=0x7f19241f7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:41.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.200+0000 7f192a600640 1 --2- 172.21.15.112:0/3274700257 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f190c004d40 0x7f19241f7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:41.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.200+0000 7f192a600640 1 -- 172.21.15.112:0/3274700257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19240ad280 msgr2=0x7f19240ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:41.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.200+0000 7f192a600640 1 --2- 172.21.15.112:0/3274700257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19240ad280 0x7f19240ad700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:41.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.200+0000 7f192a600640 1 -- 172.21.15.112:0/3274700257 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1924155080 con 0x7f19241f5230 2024-09-12T02:48:41.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.200+0000 7f192a600640 1 --2- 172.21.15.112:0/3274700257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19241f5230 0x7f19241f56e0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f191c002230 tx=0x7f191c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:41.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.200+0000 7f1921600640 1 -- 172.21.15.112:0/3274700257 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c037040 con 0x7f19241f5230 2024-09-12T02:48:41.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.200+0000 7f1921600640 1 -- 172.21.15.112:0/3274700257 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f191c033df0 con 0x7f19241f5230 2024-09-12T02:48:41.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.200+0000 7f1921600640 1 -- 172.21.15.112:0/3274700257 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c009c10 con 0x7f19241f5230 2024-09-12T02:48:41.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.200+0000 7f192c600640 1 -- 172.21.15.112:0/3274700257 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f192415ae90 con 0x7f19241f5230 2024-09-12T02:48:41.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.201+0000 7f192c600640 1 -- 172.21.15.112:0/3274700257 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f192415b450 con 0x7f19241f5230 2024-09-12T02:48:41.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.202+0000 7f192c600640 1 -- 172.21.15.112:0/3274700257 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1924068a30 con 0x7f19241f5230 2024-09-12T02:48:41.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.202+0000 7f1921600640 1 -- 172.21.15.112:0/3274700257 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f191c046030 con 0x7f19241f5230 2024-09-12T02:48:41.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.204+0000 7f1921600640 1 --2- 172.21.15.112:0/3274700257 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f190406be30 0x7f190406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:41.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.204+0000 7f1921600640 1 -- 172.21.15.112:0/3274700257 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 4943+0+0 (secure 0 0 0) 0x7f191c0ab3c0 con 0x7f19241f5230 2024-09-12T02:48:41.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.204+0000 7f1929c00640 1 --2- 172.21.15.112:0/3274700257 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f190406be30 0x7f190406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:41.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.205+0000 7f1929c00640 1 --2- 172.21.15.112:0/3274700257 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f190406be30 0x7f190406e2f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f19241554d0 tx=0x7f1918008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:41.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.208+0000 7f1921600640 1 -- 172.21.15.112:0/3274700257 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f191c04d020 con 0x7f19241f5230 2024-09-12T02:48:41.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.384+0000 7f192c600640 1 -- 172.21.15.112:0/3274700257 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f192406df60 con 0x7f19241f5230 2024-09-12T02:48:41.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.388+0000 7f1921600640 1 -- 172.21.15.112:0/3274700257 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) ==== 104+0+0 (secure 0 0 0) 0x7f1924155080 con 0x7f19241f5230 2024-09-12T02:48:41.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.390+0000 7f192c600640 1 -- 172.21.15.112:0/3274700257 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f190406be30 msgr2=0x7f190406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:41.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.390+0000 7f192c600640 1 --2- 172.21.15.112:0/3274700257 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f190406be30 0x7f190406e2f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f19241554d0 tx=0x7f1918008040 comp rx=0 tx=0).stop 2024-09-12T02:48:41.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.390+0000 7f192c600640 1 -- 172.21.15.112:0/3274700257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19241f5230 msgr2=0x7f19241f56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:41.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.390+0000 7f192c600640 1 --2- 172.21.15.112:0/3274700257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19241f5230 0x7f19241f56e0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f191c002230 tx=0x7f191c009750 comp rx=0 tx=0).stop 2024-09-12T02:48:41.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.390+0000 7f192c600640 1 -- 172.21.15.112:0/3274700257 shutdown_connections 2024-09-12T02:48:41.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.390+0000 7f192c600640 1 --2- 172.21.15.112:0/3274700257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19241f5230 0x7f19241f56e0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:41.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.390+0000 7f192c600640 1 --2- 172.21.15.112:0/3274700257 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f190406be30 0x7f190406e2f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:41.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.390+0000 7f192c600640 1 --2- 172.21.15.112:0/3274700257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19240ad280 0x7f19240ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:41.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.390+0000 7f192c600640 1 --2- 172.21.15.112:0/3274700257 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f190c004d40 0x7f19241f7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:41.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.390+0000 7f192c600640 1 -- 172.21.15.112:0/3274700257 >> 172.21.15.112:0/3274700257 conn(0x7f192406bbd0 msgr2=0x7f192406d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:41.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.390+0000 7f192c600640 1 -- 172.21.15.112:0/3274700257 shutdown_connections 2024-09-12T02:48:41.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.390+0000 7f192c600640 1 -- 172.21.15.112:0/3274700257 wait complete. 2024-09-12T02:48:41.411 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2024-09-12T02:48:41.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.565+0000 7f7b08a00640 1 Processor -- start 2024-09-12T02:48:41.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.565+0000 7f7b08a00640 1 -- start start 2024-09-12T02:48:41.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.566+0000 7f7b08a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7b04071530 0x7f7b040af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:41.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.567+0000 7f7b08a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b040719a0 0x7f7b040afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:41.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.567+0000 7f7b08a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b040ceeb0 con 0x7f7b0415cc50 2024-09-12T02:48:41.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.567+0000 7f7b08a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7b0415d030 con 0x7f7b04071530 2024-09-12T02:48:41.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.567+0000 7f7b08a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7b040cf4c0 con 0x7f7b040719a0 2024-09-12T02:48:41.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.567+0000 7f7b01e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f7b0415cc50 0x7f7b040732f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:44058/0 (socket says 172.21.15.112:44058) 2024-09-12T02:48:41.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.567+0000 7f7b01e00640 1 -- 172.21.15.112:0/1507210597 learned_addr learned my addr 172.21.15.112:0/1507210597 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:41.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.567+0000 7f7b02800640 1 --2- 172.21.15.112:0/1507210597 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b040719a0 0x7f7b040afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:41.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.567+0000 7f7b01400640 1 --2- 172.21.15.112:0/1507210597 >> v2:172.21.15.137:3300/0 conn(0x7f7b04071530 0x7f7b040af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:41.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.567+0000 7f7b00a00640 1 -- 172.21.15.112:0/1507210597 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 486179486 0 0) 0x7f7b040ceeb0 con 0x7f7b0415cc50 2024-09-12T02:48:41.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.567+0000 7f7b00a00640 1 -- 172.21.15.112:0/1507210597 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ae8003520 con 0x7f7b0415cc50 2024-09-12T02:48:41.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.568+0000 7f7b02800640 1 -- 172.21.15.112:0/1507210597 >> v2:172.21.15.137:3300/0 conn(0x7f7b04071530 msgr2=0x7f7b040af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:41.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.568+0000 7f7b02800640 1 --2- 172.21.15.112:0/1507210597 >> v2:172.21.15.137:3300/0 conn(0x7f7b04071530 0x7f7b040af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:41.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.568+0000 7f7b02800640 1 -- 172.21.15.112:0/1507210597 >> v1:172.21.15.112:6789/0 conn(0x7f7b0415cc50 legacy=0x7f7b040732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:41.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.568+0000 7f7b02800640 1 -- 172.21.15.112:0/1507210597 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b0406e300 con 0x7f7b040719a0 2024-09-12T02:48:41.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.568+0000 7f7b01400640 1 --2- 172.21.15.112:0/1507210597 >> v2:172.21.15.137:3300/0 conn(0x7f7b04071530 0x7f7b040af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:41.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.569+0000 7f7b02800640 1 --2- 172.21.15.112:0/1507210597 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b040719a0 0x7f7b040afc60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7b040cf640 tx=0x7f7afc02a5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97338dd4967d2390 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:41.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.569+0000 7f7b00a00640 1 -- 172.21.15.112:0/1507210597 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7afc007740 con 0x7f7b040719a0 2024-09-12T02:48:41.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.569+0000 7f7b00a00640 1 -- 172.21.15.112:0/1507210597 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7afc0078e0 con 0x7f7b040719a0 2024-09-12T02:48:41.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.569+0000 7f7b00a00640 1 -- 172.21.15.112:0/1507210597 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7afc007cb0 con 0x7f7b040719a0 2024-09-12T02:48:41.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.570+0000 7f7b08a00640 1 -- 172.21.15.112:0/1507210597 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b040719a0 msgr2=0x7f7b040afc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:41.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.570+0000 7f7b08a00640 1 --2- 172.21.15.112:0/1507210597 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b040719a0 0x7f7b040afc60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7b040cf640 tx=0x7f7afc02a5b0 comp rx=0 tx=0).stop 2024-09-12T02:48:41.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.570+0000 7f7b08a00640 1 -- 172.21.15.112:0/1507210597 shutdown_connections 2024-09-12T02:48:41.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.570+0000 7f7b08a00640 1 --2- 172.21.15.112:0/1507210597 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b040719a0 0x7f7b040afc60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:41.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.570+0000 7f7b08a00640 1 --2- 172.21.15.112:0/1507210597 >> v2:172.21.15.137:3300/0 conn(0x7f7b04071530 0x7f7b040af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:41.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.570+0000 7f7b08a00640 1 -- 172.21.15.112:0/1507210597 >> 172.21.15.112:0/1507210597 conn(0x7f7b0406bbd0 msgr2=0x7f7b0406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:41.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.570+0000 7f7b08a00640 1 -- 172.21.15.112:0/1507210597 shutdown_connections 2024-09-12T02:48:41.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.570+0000 7f7b08a00640 1 -- 172.21.15.112:0/1507210597 wait complete. 2024-09-12T02:48:41.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.572+0000 7f7b08a00640 1 Processor -- start 2024-09-12T02:48:41.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.572+0000 7f7b08a00640 1 -- start start 2024-09-12T02:48:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.573+0000 7f7b08a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b04071530 0x7f7b04144510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.573+0000 7f7b08a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b040719a0 0x7f7b0414e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.573+0000 7f7b08a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b0415cc50 0x7f7b0414ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.573+0000 7f7b08a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7b0406f510 con 0x7f7b0415cc50 2024-09-12T02:48:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.573+0000 7f7b08a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7b040cf150 con 0x7f7b040719a0 2024-09-12T02:48:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.573+0000 7f7b08a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7b0406f690 con 0x7f7b04071530 2024-09-12T02:48:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.573+0000 7f7b02800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b0415cc50 0x7f7b0414ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.573+0000 7f7b02800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b0415cc50 0x7f7b0414ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58742/0 (socket says 172.21.15.112:58742) 2024-09-12T02:48:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.573+0000 7f7b02800640 1 -- 172.21.15.112:0/538465927 learned_addr learned my addr 172.21.15.112:0/538465927 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.573+0000 7f7b01e00640 1 --2- 172.21.15.112:0/538465927 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b04071530 0x7f7b04144510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:41.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.573+0000 7f7b01400640 1 --2- 172.21.15.112:0/538465927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b040719a0 0x7f7b0414e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:41.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.574+0000 7f7b02800640 1 -- 172.21.15.112:0/538465927 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b04071530 msgr2=0x7f7b04144510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:41.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.574+0000 7f7b02800640 1 --2- 172.21.15.112:0/538465927 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b04071530 0x7f7b04144510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:41.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.574+0000 7f7b02800640 1 -- 172.21.15.112:0/538465927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b040719a0 msgr2=0x7f7b0414e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:41.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.574+0000 7f7b02800640 1 --2- 172.21.15.112:0/538465927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b040719a0 0x7f7b0414e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:41.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.574+0000 7f7b02800640 1 -- 172.21.15.112:0/538465927 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b0414d8b0 con 0x7f7b0415cc50 2024-09-12T02:48:41.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.574+0000 7f7b02800640 1 --2- 172.21.15.112:0/538465927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b0415cc50 0x7f7b0414ced0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f7afc009e50 tx=0x7f7afc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:41.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.574+0000 7f7afa000640 1 -- 172.21.15.112:0/538465927 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7afc040070 con 0x7f7b0415cc50 2024-09-12T02:48:41.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.574+0000 7f7afa000640 1 -- 172.21.15.112:0/538465927 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7afc031bf0 con 0x7f7b0415cc50 2024-09-12T02:48:41.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.574+0000 7f7b08a00640 1 -- 172.21.15.112:0/538465927 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b0414db90 con 0x7f7b0415cc50 2024-09-12T02:48:41.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.574+0000 7f7afa000640 1 -- 172.21.15.112:0/538465927 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7afc009450 con 0x7f7b0415cc50 2024-09-12T02:48:41.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.574+0000 7f7b08a00640 1 -- 172.21.15.112:0/538465927 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b0414e150 con 0x7f7b0415cc50 2024-09-12T02:48:41.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.575+0000 7f7b08a00640 1 -- 172.21.15.112:0/538465927 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b04068a30 con 0x7f7b0415cc50 2024-09-12T02:48:41.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.576+0000 7f7afa000640 1 -- 172.21.15.112:0/538465927 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7afc039040 con 0x7f7b0415cc50 2024-09-12T02:48:41.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.577+0000 7f7afa000640 1 --2- 172.21.15.112:0/538465927 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7ae406be30 0x7f7ae406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:41.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.577+0000 7f7afa000640 1 -- 172.21.15.112:0/538465927 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 4943+0+0 (secure 0 0 0) 0x7f7afc0ac1a0 con 0x7f7b0415cc50 2024-09-12T02:48:41.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.577+0000 7f7b01e00640 1 --2- 172.21.15.112:0/538465927 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7ae406be30 0x7f7ae406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:41.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.578+0000 7f7b01e00640 1 --2- 172.21.15.112:0/538465927 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7ae406be30 0x7f7ae406e2f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7af4005880 tx=0x7f7af4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:41.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.581+0000 7f7afa000640 1 -- 172.21.15.112:0/538465927 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7afc07a890 con 0x7f7b0415cc50 2024-09-12T02:48:41.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:41.820+0000 7f7b08a00640 1 -- 172.21.15.112:0/538465927 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) -- 0x7f7b040730d0 con 0x7f7b0415cc50 2024-09-12T02:48:42.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.329+0000 7f7afa000640 1 -- 172.21.15.112:0/538465927 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v357) ==== 140+0+0 (secure 0 0 0) 0x7f7afc07eb90 con 0x7f7b0415cc50 2024-09-12T02:48:42.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.331+0000 7f7b08a00640 1 -- 172.21.15.112:0/538465927 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7ae406be30 msgr2=0x7f7ae406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:42.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.331+0000 7f7b08a00640 1 --2- 172.21.15.112:0/538465927 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7ae406be30 0x7f7ae406e2f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7af4005880 tx=0x7f7af4009040 comp rx=0 tx=0).stop 2024-09-12T02:48:42.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.331+0000 7f7b08a00640 1 -- 172.21.15.112:0/538465927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b0415cc50 msgr2=0x7f7b0414ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:42.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.331+0000 7f7b08a00640 1 --2- 172.21.15.112:0/538465927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b0415cc50 0x7f7b0414ced0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f7afc009e50 tx=0x7f7afc004a40 comp rx=0 tx=0).stop 2024-09-12T02:48:42.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.331+0000 7f7b08a00640 1 -- 172.21.15.112:0/538465927 shutdown_connections 2024-09-12T02:48:42.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.331+0000 7f7b08a00640 1 --2- 172.21.15.112:0/538465927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b0415cc50 0x7f7b0414ced0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:42.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.331+0000 7f7b08a00640 1 --2- 172.21.15.112:0/538465927 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7ae406be30 0x7f7ae406e2f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:42.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.331+0000 7f7b08a00640 1 --2- 172.21.15.112:0/538465927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b040719a0 0x7f7b0414e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:42.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.331+0000 7f7b08a00640 1 --2- 172.21.15.112:0/538465927 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b04071530 0x7f7b04144510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:42.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.331+0000 7f7b08a00640 1 -- 172.21.15.112:0/538465927 >> 172.21.15.112:0/538465927 conn(0x7f7b0406bbd0 msgr2=0x7f7b04157640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:42.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.332+0000 7f7b08a00640 1 -- 172.21.15.112:0/538465927 shutdown_connections 2024-09-12T02:48:42.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.332+0000 7f7b08a00640 1 -- 172.21.15.112:0/538465927 wait complete. 2024-09-12T02:48:42.350 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2024-09-12T02:48:42.351 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) 2024-09-12T02:48:42.351 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:48:42.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.503+0000 7f24f0a00640 1 Processor -- start 2024-09-12T02:48:42.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.503+0000 7f24f0a00640 1 -- start start 2024-09-12T02:48:42.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.504+0000 7f24f0a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24ec0d28d0 0x7f24ec0b2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:42.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.504+0000 7f24f0a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24ec0d2fb0 con 0x7f24ec0b3e00 2024-09-12T02:48:42.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.504+0000 7f24f0a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24ec0d0b60 con 0x7f24ec0d1710 2024-09-12T02:48:42.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.504+0000 7f24f0a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f24ec0d3cb0 con 0x7f24ec0d28d0 2024-09-12T02:48:42.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.504+0000 7f24eaa00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f24ec0b3e00 0x7f24ec0b1d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48314/0 (socket says 172.21.15.112:48314) 2024-09-12T02:48:42.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.504+0000 7f24eaa00640 1 -- 172.21.15.112:0/4283426674 learned_addr learned my addr 172.21.15.112:0/4283426674 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:42.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.504+0000 7f24ebe00640 1 --2- 172.21.15.112:0/4283426674 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24ec0d28d0 0x7f24ec0b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:42.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.505+0000 7f24ea000640 1 -- 172.21.15.112:0/4283426674 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2725083240 0 0) 0x7f24ec0d2fb0 con 0x7f24ec0b3e00 2024-09-12T02:48:42.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.505+0000 7f24ea000640 1 -- 172.21.15.112:0/4283426674 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24d0003520 con 0x7f24ec0b3e00 2024-09-12T02:48:42.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.505+0000 7f24ea000640 1 -- 172.21.15.112:0/4283426674 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4172679690 0 0) 0x7f24ec0d0b60 con 0x7f24ec0d1710 2024-09-12T02:48:42.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.505+0000 7f24ea000640 1 -- 172.21.15.112:0/4283426674 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24ec0d2fb0 con 0x7f24ec0d1710 2024-09-12T02:48:42.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.505+0000 7f24ebe00640 1 -- 172.21.15.112:0/4283426674 >> v1:172.21.15.137:6789/0 conn(0x7f24ec0d1710 legacy=0x7f24ec0d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:42.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.505+0000 7f24ebe00640 1 -- 172.21.15.112:0/4283426674 >> v1:172.21.15.112:6789/0 conn(0x7f24ec0b3e00 legacy=0x7f24ec0b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:42.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.505+0000 7f24ebe00640 1 -- 172.21.15.112:0/4283426674 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24ec0d3410 con 0x7f24ec0d28d0 2024-09-12T02:48:42.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.506+0000 7f24ebe00640 1 --2- 172.21.15.112:0/4283426674 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24ec0d28d0 0x7f24ec0b2480 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f24e4009dc0 tx=0x7f24e402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5f13aeda8e5ecae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:42.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.506+0000 7f24ea000640 1 -- 172.21.15.112:0/4283426674 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e4007740 con 0x7f24ec0d28d0 2024-09-12T02:48:42.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.506+0000 7f24ea000640 1 -- 172.21.15.112:0/4283426674 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e40078e0 con 0x7f24ec0d28d0 2024-09-12T02:48:42.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.506+0000 7f24ea000640 1 -- 172.21.15.112:0/4283426674 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e4007cb0 con 0x7f24ec0d28d0 2024-09-12T02:48:42.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.507+0000 7f24f0a00640 1 -- 172.21.15.112:0/4283426674 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24ec0d28d0 msgr2=0x7f24ec0b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:42.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.507+0000 7f24f0a00640 1 --2- 172.21.15.112:0/4283426674 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24ec0d28d0 0x7f24ec0b2480 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f24e4009dc0 tx=0x7f24e402a6d0 comp rx=0 tx=0).stop 2024-09-12T02:48:42.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.507+0000 7f24f0a00640 1 -- 172.21.15.112:0/4283426674 shutdown_connections 2024-09-12T02:48:42.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.507+0000 7f24f0a00640 1 --2- 172.21.15.112:0/4283426674 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24ec0d28d0 0x7f24ec0b2480 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:42.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.507+0000 7f24f0a00640 1 -- 172.21.15.112:0/4283426674 >> 172.21.15.112:0/4283426674 conn(0x7f24ec09e030 msgr2=0x7f24ec0d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:42.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.507+0000 7f24f0a00640 1 -- 172.21.15.112:0/4283426674 shutdown_connections 2024-09-12T02:48:42.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.507+0000 7f24f0a00640 1 -- 172.21.15.112:0/4283426674 wait complete. 2024-09-12T02:48:42.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.509+0000 7f24f0a00640 1 Processor -- start 2024-09-12T02:48:42.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.509+0000 7f24f0a00640 1 -- start start 2024-09-12T02:48:42.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.510+0000 7f24f0a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24ec0b3e00 0x7f24ec0cce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:42.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.510+0000 7f24f0a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24ec0d1710 0x7f24ec0c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:42.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.510+0000 7f24f0a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24ec0d28d0 0x7f24ec0c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:42.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.510+0000 7f24f0a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec0d39d0 con 0x7f24ec0b3e00 2024-09-12T02:48:42.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.510+0000 7f24f0a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec0d2d60 con 0x7f24ec0d1710 2024-09-12T02:48:42.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.510+0000 7f24f0a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f24ec15f110 con 0x7f24ec0d28d0 2024-09-12T02:48:42.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.510+0000 7f24eb400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24ec0b3e00 0x7f24ec0cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:42.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.510+0000 7f24eb400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24ec0b3e00 0x7f24ec0cce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38634/0 (socket says 172.21.15.112:38634) 2024-09-12T02:48:42.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.510+0000 7f24eb400640 1 -- 172.21.15.112:0/2231891979 learned_addr learned my addr 172.21.15.112:0/2231891979 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:42.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.510+0000 7f24ebe00640 1 --2- 172.21.15.112:0/2231891979 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24ec0d28d0 0x7f24ec0c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:42.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.510+0000 7f24eaa00640 1 --2- 172.21.15.112:0/2231891979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24ec0d1710 0x7f24ec0c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:42.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.510+0000 7f24eb400640 1 -- 172.21.15.112:0/2231891979 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24ec0d28d0 msgr2=0x7f24ec0c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:42.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.510+0000 7f24eb400640 1 --2- 172.21.15.112:0/2231891979 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24ec0d28d0 0x7f24ec0c8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:42.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.510+0000 7f24eb400640 1 -- 172.21.15.112:0/2231891979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24ec0d1710 msgr2=0x7f24ec0c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:42.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.510+0000 7f24eb400640 1 --2- 172.21.15.112:0/2231891979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24ec0d1710 0x7f24ec0c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:42.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.510+0000 7f24eb400640 1 -- 172.21.15.112:0/2231891979 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24ec0cd8e0 con 0x7f24ec0b3e00 2024-09-12T02:48:42.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.510+0000 7f24eaa00640 1 --2- 172.21.15.112:0/2231891979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24ec0d1710 0x7f24ec0c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:42.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.510+0000 7f24ebe00640 1 --2- 172.21.15.112:0/2231891979 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24ec0d28d0 0x7f24ec0c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:42.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.511+0000 7f24eb400640 1 --2- 172.21.15.112:0/2231891979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24ec0b3e00 0x7f24ec0cce20 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f24dc00c500 tx=0x7f24dc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:42.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.511+0000 7f24e3400640 1 -- 172.21.15.112:0/2231891979 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24dc0052d0 con 0x7f24ec0b3e00 2024-09-12T02:48:42.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.511+0000 7f24e3400640 1 -- 172.21.15.112:0/2231891979 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24dc005490 con 0x7f24ec0b3e00 2024-09-12T02:48:42.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.511+0000 7f24e3400640 1 -- 172.21.15.112:0/2231891979 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24dc012870 con 0x7f24ec0b3e00 2024-09-12T02:48:42.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.511+0000 7f24f0a00640 1 -- 172.21.15.112:0/2231891979 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24ec0cdbc0 con 0x7f24ec0b3e00 2024-09-12T02:48:42.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.511+0000 7f24f0a00640 1 -- 172.21.15.112:0/2231891979 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24ec0ce180 con 0x7f24ec0b3e00 2024-09-12T02:48:42.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.512+0000 7f24f0a00640 1 -- 172.21.15.112:0/2231891979 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24ec0ce4b0 con 0x7f24ec0b3e00 2024-09-12T02:48:42.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.513+0000 7f24e3400640 1 -- 172.21.15.112:0/2231891979 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f24dc012a10 con 0x7f24ec0b3e00 2024-09-12T02:48:42.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.514+0000 7f24e3400640 1 --2- 172.21.15.112:0/2231891979 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f24cc06be30 0x7f24cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:42.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.514+0000 7f24e3400640 1 -- 172.21.15.112:0/2231891979 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 4943+0+0 (secure 0 0 0) 0x7f24dc08a9a0 con 0x7f24ec0b3e00 2024-09-12T02:48:42.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.514+0000 7f24eaa00640 1 --2- 172.21.15.112:0/2231891979 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f24cc06be30 0x7f24cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:42.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.515+0000 7f24eaa00640 1 --2- 172.21.15.112:0/2231891979 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f24cc06be30 0x7f24cc06e2f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f24ec0bad50 tx=0x7f24d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:42.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.518+0000 7f24e3400640 1 -- 172.21.15.112:0/2231891979 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f24dc0595c0 con 0x7f24ec0b3e00 2024-09-12T02:48:42.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.691+0000 7f24f0a00640 1 -- 172.21.15.112:0/2231891979 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f24ec0d1af0 con 0x7f24ec0b3e00 2024-09-12T02:48:42.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.692+0000 7f24e3400640 1 -- 172.21.15.112:0/2231891979 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) ==== 74+0+13091 (secure 0 0 0) 0x7f24dc058ec0 con 0x7f24ec0b3e00 2024-09-12T02:48:42.693 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:42.693 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":141,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:48:41.008464+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6837/134918269":"2024-09-13T02:48:38.315454+0000","172.21.15.112:6836/134918269":"2024-09-13T02:48:38.315454+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:48:42.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.694+0000 7f24f0a00640 1 -- 172.21.15.112:0/2231891979 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f24cc06be30 msgr2=0x7f24cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:42.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.694+0000 7f24f0a00640 1 --2- 172.21.15.112:0/2231891979 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f24cc06be30 0x7f24cc06e2f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f24ec0bad50 tx=0x7f24d8009040 comp rx=0 tx=0).stop 2024-09-12T02:48:42.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.694+0000 7f24f0a00640 1 -- 172.21.15.112:0/2231891979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24ec0b3e00 msgr2=0x7f24ec0cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:42.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.694+0000 7f24f0a00640 1 --2- 172.21.15.112:0/2231891979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24ec0b3e00 0x7f24ec0cce20 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f24dc00c500 tx=0x7f24dc00c9c0 comp rx=0 tx=0).stop 2024-09-12T02:48:42.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.694+0000 7f24f0a00640 1 -- 172.21.15.112:0/2231891979 shutdown_connections 2024-09-12T02:48:42.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.694+0000 7f24f0a00640 1 --2- 172.21.15.112:0/2231891979 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24ec0d28d0 0x7f24ec0c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:42.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.694+0000 7f24f0a00640 1 --2- 172.21.15.112:0/2231891979 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f24cc06be30 0x7f24cc06e2f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:42.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.694+0000 7f24f0a00640 1 --2- 172.21.15.112:0/2231891979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24ec0d1710 0x7f24ec0c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:42.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.694+0000 7f24f0a00640 1 --2- 172.21.15.112:0/2231891979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24ec0b3e00 0x7f24ec0cce20 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:42.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.694+0000 7f24f0a00640 1 -- 172.21.15.112:0/2231891979 >> 172.21.15.112:0/2231891979 conn(0x7f24ec09e030 msgr2=0x7f24ec0b8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:42.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.694+0000 7f24f0a00640 1 -- 172.21.15.112:0/2231891979 shutdown_connections 2024-09-12T02:48:42.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.694+0000 7f24f0a00640 1 -- 172.21.15.112:0/2231891979 wait complete. 2024-09-12T02:48:42.711 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:41:43.011599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:48:42.711 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T02:48:42.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.868+0000 7f8b4ee00640 1 Processor -- start 2024-09-12T02:48:42.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.868+0000 7f8b4ee00640 1 -- start start 2024-09-12T02:48:42.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.869+0000 7f8b4ee00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8b480d28d0 0x7f8b480b2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:42.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.869+0000 7f8b4ee00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b480d2fb0 con 0x7f8b480d1710 2024-09-12T02:48:42.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.869+0000 7f8b4ee00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b480d0b60 con 0x7f8b480b3e00 2024-09-12T02:48:42.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.869+0000 7f8b4ee00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8b480d3cb0 con 0x7f8b480d28d0 2024-09-12T02:48:42.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.870+0000 7f8b4da00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8b480d1710 0x7f8b480d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48326/0 (socket says 172.21.15.112:48326) 2024-09-12T02:48:42.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.870+0000 7f8b4da00640 1 -- 172.21.15.112:0/2969329894 learned_addr learned my addr 172.21.15.112:0/2969329894 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:42.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.870+0000 7f8b4e400640 1 --2- 172.21.15.112:0/2969329894 >> v2:172.21.15.112:3300/0 conn(0x7f8b480d28d0 0x7f8b480b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:42.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.870+0000 7f8b47e00640 1 -- 172.21.15.112:0/2969329894 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3612402994 0 0) 0x7f8b480d2fb0 con 0x7f8b480d1710 2024-09-12T02:48:42.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.870+0000 7f8b47e00640 1 -- 172.21.15.112:0/2969329894 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b30003520 con 0x7f8b480d1710 2024-09-12T02:48:42.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.870+0000 7f8b4e400640 1 -- 172.21.15.112:0/2969329894 >> v1:172.21.15.137:6789/0 conn(0x7f8b480b3e00 legacy=0x7f8b480b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:42.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.870+0000 7f8b4e400640 1 -- 172.21.15.112:0/2969329894 >> v1:172.21.15.112:6789/0 conn(0x7f8b480d1710 legacy=0x7f8b480d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:42.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.870+0000 7f8b4e400640 1 -- 172.21.15.112:0/2969329894 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b480d3410 con 0x7f8b480d28d0 2024-09-12T02:48:42.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.871+0000 7f8b4e400640 1 --2- 172.21.15.112:0/2969329894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b480d28d0 0x7f8b480b2480 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f8b40009d90 tx=0x7f8b4002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98872e7843dd8055 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:42.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.871+0000 7f8b47e00640 1 -- 172.21.15.112:0/2969329894 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b40007740 con 0x7f8b480d28d0 2024-09-12T02:48:42.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.871+0000 7f8b47e00640 1 -- 172.21.15.112:0/2969329894 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b400078e0 con 0x7f8b480d28d0 2024-09-12T02:48:42.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.871+0000 7f8b47e00640 1 -- 172.21.15.112:0/2969329894 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b40007cb0 con 0x7f8b480d28d0 2024-09-12T02:48:42.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.872+0000 7f8b4ee00640 1 -- 172.21.15.112:0/2969329894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b480d28d0 msgr2=0x7f8b480b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:42.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.872+0000 7f8b4ee00640 1 --2- 172.21.15.112:0/2969329894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b480d28d0 0x7f8b480b2480 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f8b40009d90 tx=0x7f8b4002a6f0 comp rx=0 tx=0).stop 2024-09-12T02:48:42.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.872+0000 7f8b4ee00640 1 -- 172.21.15.112:0/2969329894 shutdown_connections 2024-09-12T02:48:42.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.872+0000 7f8b4ee00640 1 --2- 172.21.15.112:0/2969329894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b480d28d0 0x7f8b480b2480 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:42.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.872+0000 7f8b4ee00640 1 -- 172.21.15.112:0/2969329894 >> 172.21.15.112:0/2969329894 conn(0x7f8b4809e030 msgr2=0x7f8b480d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:42.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.872+0000 7f8b4ee00640 1 -- 172.21.15.112:0/2969329894 shutdown_connections 2024-09-12T02:48:42.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.872+0000 7f8b4ee00640 1 -- 172.21.15.112:0/2969329894 wait complete. 2024-09-12T02:48:42.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.874+0000 7f8b4ee00640 1 Processor -- start 2024-09-12T02:48:42.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.874+0000 7f8b4ee00640 1 -- start start 2024-09-12T02:48:42.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.875+0000 7f8b4ee00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b480b3e00 0x7f8b480cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:42.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.875+0000 7f8b4ee00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b480d1710 0x7f8b480cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:42.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.875+0000 7f8b4ee00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8b480d28d0 0x7f8b48156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:42.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.875+0000 7f8b4ee00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8b480d39d0 con 0x7f8b480b3e00 2024-09-12T02:48:42.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.875+0000 7f8b4ee00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8b480d2d60 con 0x7f8b480d1710 2024-09-12T02:48:42.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.875+0000 7f8b4ee00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8b4815f110 con 0x7f8b480d28d0 2024-09-12T02:48:42.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.875+0000 7f8b4da00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b480b3e00 0x7f8b480cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:42.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.875+0000 7f8b4da00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b480b3e00 0x7f8b480cbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38652/0 (socket says 172.21.15.112:38652) 2024-09-12T02:48:42.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.875+0000 7f8b4da00640 1 -- 172.21.15.112:0/2131158261 learned_addr learned my addr 172.21.15.112:0/2131158261 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:42.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.875+0000 7f8b4d000640 1 --2- 172.21.15.112:0/2131158261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b480d1710 0x7f8b480cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:42.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.875+0000 7f8b4e400640 1 --2- 172.21.15.112:0/2131158261 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8b480d28d0 0x7f8b48156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:42.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.875+0000 7f8b4da00640 1 -- 172.21.15.112:0/2131158261 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8b480d28d0 msgr2=0x7f8b48156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:42.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.875+0000 7f8b4da00640 1 --2- 172.21.15.112:0/2131158261 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8b480d28d0 0x7f8b48156800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:42.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.875+0000 7f8b4da00640 1 -- 172.21.15.112:0/2131158261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b480d1710 msgr2=0x7f8b480cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:42.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.875+0000 7f8b4da00640 1 --2- 172.21.15.112:0/2131158261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b480d1710 0x7f8b480cd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:42.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.875+0000 7f8b4da00640 1 -- 172.21.15.112:0/2131158261 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b48157870 con 0x7f8b480b3e00 2024-09-12T02:48:42.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.875+0000 7f8b4d000640 1 --2- 172.21.15.112:0/2131158261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b480d1710 0x7f8b480cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:42.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.875+0000 7f8b4e400640 1 --2- 172.21.15.112:0/2131158261 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8b480d28d0 0x7f8b48156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:42.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.876+0000 7f8b4da00640 1 --2- 172.21.15.112:0/2131158261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b480b3e00 0x7f8b480cbdd0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c00c530 tx=0x7f8b3c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:42.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.876+0000 7f8b45600640 1 -- 172.21.15.112:0/2131158261 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c017070 con 0x7f8b480b3e00 2024-09-12T02:48:42.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.876+0000 7f8b45600640 1 -- 172.21.15.112:0/2131158261 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b3c005ce0 con 0x7f8b480b3e00 2024-09-12T02:48:42.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.876+0000 7f8b45600640 1 -- 172.21.15.112:0/2131158261 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c0072b0 con 0x7f8b480b3e00 2024-09-12T02:48:42.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.876+0000 7f8b4ee00640 1 -- 172.21.15.112:0/2131158261 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b480cc440 con 0x7f8b480b3e00 2024-09-12T02:48:42.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.876+0000 7f8b4ee00640 1 -- 172.21.15.112:0/2131158261 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b480cca00 con 0x7f8b480b3e00 2024-09-12T02:48:42.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.877+0000 7f8b4ee00640 1 -- 172.21.15.112:0/2131158261 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b480d1af0 con 0x7f8b480b3e00 2024-09-12T02:48:42.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.878+0000 7f8b45600640 1 -- 172.21.15.112:0/2131158261 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8b3c01a070 con 0x7f8b480b3e00 2024-09-12T02:48:42.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.879+0000 7f8b45600640 1 --2- 172.21.15.112:0/2131158261 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8b2806be60 0x7f8b2806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:42.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.879+0000 7f8b45600640 1 -- 172.21.15.112:0/2131158261 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 4943+0+0 (secure 0 0 0) 0x7f8b3c089f30 con 0x7f8b480b3e00 2024-09-12T02:48:42.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.879+0000 7f8b4d000640 1 --2- 172.21.15.112:0/2131158261 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8b2806be60 0x7f8b2806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:42.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.880+0000 7f8b4d000640 1 --2- 172.21.15.112:0/2131158261 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8b2806be60 0x7f8b2806e320 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8b480b26a0 tx=0x7f8b34009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:42.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:42.883+0000 7f8b45600640 1 -- 172.21.15.112:0/2131158261 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8b3c058c90 con 0x7f8b480b3e00 2024-09-12T02:48:43.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.056+0000 7f8b4ee00640 1 -- 172.21.15.112:0/2131158261 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8b480cf130 con 0x7f8b480b3e00 2024-09-12T02:48:43.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.056+0000 7f8b45600640 1 -- 172.21.15.112:0/2131158261 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v141) ==== 93+0+10 (secure 0 0 0) 0x7f8b3c058590 con 0x7f8b480b3e00 2024-09-12T02:48:43.057 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2024-09-12T02:48:43.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.059+0000 7f8b4ee00640 1 -- 172.21.15.112:0/2131158261 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8b2806be60 msgr2=0x7f8b2806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:43.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.059+0000 7f8b4ee00640 1 --2- 172.21.15.112:0/2131158261 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8b2806be60 0x7f8b2806e320 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8b480b26a0 tx=0x7f8b34009040 comp rx=0 tx=0).stop 2024-09-12T02:48:43.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.059+0000 7f8b4ee00640 1 -- 172.21.15.112:0/2131158261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b480b3e00 msgr2=0x7f8b480cbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:43.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.059+0000 7f8b4ee00640 1 --2- 172.21.15.112:0/2131158261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b480b3e00 0x7f8b480cbdd0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c00c530 tx=0x7f8b3c00c9f0 comp rx=0 tx=0).stop 2024-09-12T02:48:43.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.059+0000 7f8b4ee00640 1 -- 172.21.15.112:0/2131158261 shutdown_connections 2024-09-12T02:48:43.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.059+0000 7f8b4ee00640 1 --2- 172.21.15.112:0/2131158261 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8b480d28d0 0x7f8b48156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:43.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.059+0000 7f8b4ee00640 1 --2- 172.21.15.112:0/2131158261 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8b2806be60 0x7f8b2806e320 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:43.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.059+0000 7f8b4ee00640 1 --2- 172.21.15.112:0/2131158261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b480d1710 0x7f8b480cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:43.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.059+0000 7f8b4ee00640 1 --2- 172.21.15.112:0/2131158261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b480b3e00 0x7f8b480cbdd0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:43.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.059+0000 7f8b4ee00640 1 -- 172.21.15.112:0/2131158261 >> 172.21.15.112:0/2131158261 conn(0x7f8b4809e030 msgr2=0x7f8b4806d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:43.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.059+0000 7f8b4ee00640 1 -- 172.21.15.112:0/2131158261 shutdown_connections 2024-09-12T02:48:43.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.059+0000 7f8b4ee00640 1 -- 172.21.15.112:0/2131158261 wait complete. 2024-09-12T02:48:43.075 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2024-09-12T02:48:43.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.225+0000 7f609de00640 1 Processor -- start 2024-09-12T02:48:43.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.226+0000 7f609de00640 1 -- start start 2024-09-12T02:48:43.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.227+0000 7f609de00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f609815b9d0 0x7f60980b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:43.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.227+0000 7f609de00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f60980b45d0 0x7f60980728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:43.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.227+0000 7f609de00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f609806eef0 0x7f609806f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:43.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.227+0000 7f609de00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f60980b4a60 con 0x7f609806eef0 2024-09-12T02:48:43.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.227+0000 7f609de00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f609806f860 con 0x7f609815b9d0 2024-09-12T02:48:43.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.227+0000 7f609de00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f60980b54a0 con 0x7f60980b45d0 2024-09-12T02:48:43.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.227+0000 7f6097400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f609806eef0 0x7f609806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:43.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.227+0000 7f6097400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f609806eef0 0x7f609806f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38664/0 (socket says 172.21.15.112:38664) 2024-09-12T02:48:43.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.227+0000 7f6097400640 1 -- 172.21.15.112:0/2714165755 learned_addr learned my addr 172.21.15.112:0/2714165755 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:43.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.227+0000 7f6096000640 1 --2- 172.21.15.112:0/2714165755 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f60980b45d0 0x7f60980728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:43.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.227+0000 7f6096a00640 1 --2- 172.21.15.112:0/2714165755 >> v2:172.21.15.137:3300/0 conn(0x7f609815b9d0 0x7f60980b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:43.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.228+0000 7f6097400640 1 -- 172.21.15.112:0/2714165755 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f60980b45d0 msgr2=0x7f60980728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:43.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.228+0000 7f6097400640 1 --2- 172.21.15.112:0/2714165755 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f60980b45d0 0x7f60980728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:43.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.228+0000 7f6097400640 1 -- 172.21.15.112:0/2714165755 >> v2:172.21.15.137:3300/0 conn(0x7f609815b9d0 msgr2=0x7f60980b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:43.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.228+0000 7f6097400640 1 --2- 172.21.15.112:0/2714165755 >> v2:172.21.15.137:3300/0 conn(0x7f609815b9d0 0x7f60980b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:43.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.228+0000 7f6097400640 1 -- 172.21.15.112:0/2714165755 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60980b3af0 con 0x7f609806eef0 2024-09-12T02:48:43.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.228+0000 7f6096a00640 1 --2- 172.21.15.112:0/2714165755 >> v2:172.21.15.137:3300/0 conn(0x7f609815b9d0 0x7f60980b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:43.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.229+0000 7f6097400640 1 --2- 172.21.15.112:0/2714165755 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f609806eef0 0x7f609806f320 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f609806d230 tx=0x7f609002c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242a6226a47abb06 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:43.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.229+0000 7f6095600640 1 -- 172.21.15.112:0/2714165755 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609000b2e0 con 0x7f609806eef0 2024-09-12T02:48:43.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.229+0000 7f6095600640 1 -- 172.21.15.112:0/2714165755 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6090009600 con 0x7f609806eef0 2024-09-12T02:48:43.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.229+0000 7f6095600640 1 -- 172.21.15.112:0/2714165755 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609000b480 con 0x7f609806eef0 2024-09-12T02:48:43.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.230+0000 7f609de00640 1 -- 172.21.15.112:0/2714165755 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f609806eef0 msgr2=0x7f609806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:43.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.230+0000 7f609de00640 1 --2- 172.21.15.112:0/2714165755 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f609806eef0 0x7f609806f320 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f609806d230 tx=0x7f609002c8e0 comp rx=0 tx=0).stop 2024-09-12T02:48:43.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.230+0000 7f609de00640 1 -- 172.21.15.112:0/2714165755 shutdown_connections 2024-09-12T02:48:43.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.230+0000 7f609de00640 1 --2- 172.21.15.112:0/2714165755 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f609806eef0 0x7f609806f320 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:43.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.230+0000 7f609de00640 1 --2- 172.21.15.112:0/2714165755 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f60980b45d0 0x7f60980728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:43.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.230+0000 7f609de00640 1 --2- 172.21.15.112:0/2714165755 >> v2:172.21.15.137:3300/0 conn(0x7f609815b9d0 0x7f60980b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:43.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.230+0000 7f609de00640 1 -- 172.21.15.112:0/2714165755 >> 172.21.15.112:0/2714165755 conn(0x7f609806bbd0 msgr2=0x7f609806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:43.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.230+0000 7f609de00640 1 -- 172.21.15.112:0/2714165755 shutdown_connections 2024-09-12T02:48:43.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.230+0000 7f609de00640 1 -- 172.21.15.112:0/2714165755 wait complete. 2024-09-12T02:48:43.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.231+0000 7f609de00640 1 Processor -- start 2024-09-12T02:48:43.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.232+0000 7f609de00640 1 -- start start 2024-09-12T02:48:43.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.232+0000 7f609de00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f609806eef0 0x7f609815a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:43.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.232+0000 7f609de00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60980b45d0 0x7f60981f5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:43.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.232+0000 7f609de00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f609815b9d0 0x7f60981f6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:43.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.232+0000 7f609de00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f609815bdb0 con 0x7f60980b45d0 2024-09-12T02:48:43.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.232+0000 7f609de00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f60980b40b0 con 0x7f609806eef0 2024-09-12T02:48:43.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.232+0000 7f609de00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f609815bf30 con 0x7f609815b9d0 2024-09-12T02:48:43.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.233+0000 7f6096000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60980b45d0 0x7f60981f5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:43.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.233+0000 7f6096000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60980b45d0 0x7f60981f5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38676/0 (socket says 172.21.15.112:38676) 2024-09-12T02:48:43.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.233+0000 7f6096000640 1 -- 172.21.15.112:0/1091487263 learned_addr learned my addr 172.21.15.112:0/1091487263 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:43.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.233+0000 7f6096a00640 1 --2- 172.21.15.112:0/1091487263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f609806eef0 0x7f609815a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:43.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.233+0000 7f6097400640 1 --2- 172.21.15.112:0/1091487263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f609815b9d0 0x7f60981f6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:43.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.233+0000 7f6096000640 1 -- 172.21.15.112:0/1091487263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f609815b9d0 msgr2=0x7f60981f6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:43.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.233+0000 7f6096000640 1 --2- 172.21.15.112:0/1091487263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f609815b9d0 0x7f60981f6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:43.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.233+0000 7f6096000640 1 -- 172.21.15.112:0/1091487263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f609806eef0 msgr2=0x7f609815a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:43.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.233+0000 7f6096000640 1 --2- 172.21.15.112:0/1091487263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f609806eef0 0x7f609815a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:43.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.233+0000 7f6096000640 1 -- 172.21.15.112:0/1091487263 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6098145f70 con 0x7f60980b45d0 2024-09-12T02:48:43.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.233+0000 7f6096000640 1 --2- 172.21.15.112:0/1091487263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60980b45d0 0x7f60981f5b50 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f608400e900 tx=0x7f608400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:43.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.234+0000 7f608f400640 1 -- 172.21.15.112:0/1091487263 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6084017070 con 0x7f60980b45d0 2024-09-12T02:48:43.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.234+0000 7f608f400640 1 -- 172.21.15.112:0/1091487263 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f608400ca00 con 0x7f60980b45d0 2024-09-12T02:48:43.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.234+0000 7f608f400640 1 -- 172.21.15.112:0/1091487263 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608400cdb0 con 0x7f60980b45d0 2024-09-12T02:48:43.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.234+0000 7f609de00640 1 -- 172.21.15.112:0/1091487263 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6098146250 con 0x7f60980b45d0 2024-09-12T02:48:43.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.234+0000 7f609de00640 1 -- 172.21.15.112:0/1091487263 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6098146810 con 0x7f60980b45d0 2024-09-12T02:48:43.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.235+0000 7f609de00640 1 -- 172.21.15.112:0/1091487263 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6098068a30 con 0x7f60980b45d0 2024-09-12T02:48:43.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.236+0000 7f608f400640 1 -- 172.21.15.112:0/1091487263 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f608401a070 con 0x7f60980b45d0 2024-09-12T02:48:43.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.236+0000 7f608f400640 1 --2- 172.21.15.112:0/1091487263 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f607806be30 0x7f607806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:43.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.237+0000 7f608f400640 1 -- 172.21.15.112:0/1091487263 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 4943+0+0 (secure 0 0 0) 0x7f608408af50 con 0x7f60980b45d0 2024-09-12T02:48:43.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.237+0000 7f6096a00640 1 --2- 172.21.15.112:0/1091487263 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f607806be30 0x7f607806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:43.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.237+0000 7f6096a00640 1 --2- 172.21.15.112:0/1091487263 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f607806be30 0x7f607806e2f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6088006e80 tx=0x7f6088008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:43.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.241+0000 7f608f400640 1 -- 172.21.15.112:0/1091487263 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6084059510 con 0x7f60980b45d0 2024-09-12T02:48:43.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:43.484+0000 7f609de00640 1 -- 172.21.15.112:0/1091487263 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) -- 0x7f609806f320 con 0x7f60980b45d0 2024-09-12T02:48:44.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.337+0000 7f608f400640 1 -- 172.21.15.112:0/1091487263 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v359) ==== 135+0+0 (secure 0 0 0) 0x7f608405d810 con 0x7f60980b45d0 2024-09-12T02:48:44.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.340+0000 7f609de00640 1 -- 172.21.15.112:0/1091487263 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f607806be30 msgr2=0x7f607806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:44.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.340+0000 7f609de00640 1 --2- 172.21.15.112:0/1091487263 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f607806be30 0x7f607806e2f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6088006e80 tx=0x7f6088008040 comp rx=0 tx=0).stop 2024-09-12T02:48:44.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.340+0000 7f609de00640 1 -- 172.21.15.112:0/1091487263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60980b45d0 msgr2=0x7f60981f5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:44.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.340+0000 7f609de00640 1 --2- 172.21.15.112:0/1091487263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60980b45d0 0x7f60981f5b50 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f608400e900 tx=0x7f608400edc0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.340+0000 7f609de00640 1 -- 172.21.15.112:0/1091487263 shutdown_connections 2024-09-12T02:48:44.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.340+0000 7f609de00640 1 --2- 172.21.15.112:0/1091487263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f609815b9d0 0x7f60981f6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.340+0000 7f609de00640 1 --2- 172.21.15.112:0/1091487263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60980b45d0 0x7f60981f5b50 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.340+0000 7f609de00640 1 --2- 172.21.15.112:0/1091487263 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f607806be30 0x7f607806e2f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.340+0000 7f609de00640 1 --2- 172.21.15.112:0/1091487263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f609806eef0 0x7f609815a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.340+0000 7f609de00640 1 -- 172.21.15.112:0/1091487263 >> 172.21.15.112:0/1091487263 conn(0x7f609806bbd0 msgr2=0x7f60980af440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:44.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.340+0000 7f609de00640 1 -- 172.21.15.112:0/1091487263 shutdown_connections 2024-09-12T02:48:44.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.341+0000 7f609de00640 1 -- 172.21.15.112:0/1091487263 wait complete. 2024-09-12T02:48:44.360 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T02:48:44.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.516+0000 7fd1fa800640 1 Processor -- start 2024-09-12T02:48:44.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.517+0000 7fd1fa800640 1 -- start start 2024-09-12T02:48:44.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.518+0000 7fd1fa800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1f415cc50 0x7fd1f40732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:44.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.518+0000 7fd1fa800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd1f4071530 0x7fd1f40af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:44.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.518+0000 7fd1fa800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd1f4071970 0x7fd1f40afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:44.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.518+0000 7fd1fa800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd1f415d030 con 0x7fd1f4071530 2024-09-12T02:48:44.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.518+0000 7fd1fa800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd1f40cf4c0 con 0x7fd1f4071970 2024-09-12T02:48:44.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.518+0000 7fd1fa800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd1f4073830 con 0x7fd1f415cc50 2024-09-12T02:48:44.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.518+0000 7fd1f2a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd1f4071530 0x7fd1f40af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:44.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.518+0000 7fd1f2a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd1f4071530 0x7fd1f40af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38684/0 (socket says 172.21.15.112:38684) 2024-09-12T02:48:44.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.518+0000 7fd1f2a00640 1 -- 172.21.15.112:0/4035920283 learned_addr learned my addr 172.21.15.112:0/4035920283 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:44.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.518+0000 7fd1f3400640 1 --2- 172.21.15.112:0/4035920283 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1f415cc50 0x7fd1f40732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:44.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.518+0000 7fd1f3e00640 1 --2- 172.21.15.112:0/4035920283 >> v2:172.21.15.137:3300/0 conn(0x7fd1f4071970 0x7fd1f40afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:44.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.518+0000 7fd1f2a00640 1 -- 172.21.15.112:0/4035920283 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1f415cc50 msgr2=0x7fd1f40732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:44.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.518+0000 7fd1f2a00640 1 --2- 172.21.15.112:0/4035920283 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1f415cc50 0x7fd1f40732f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.518+0000 7fd1f2a00640 1 -- 172.21.15.112:0/4035920283 >> v2:172.21.15.137:3300/0 conn(0x7fd1f4071970 msgr2=0x7fd1f40afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:44.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.518+0000 7fd1f2a00640 1 --2- 172.21.15.112:0/4035920283 >> v2:172.21.15.137:3300/0 conn(0x7fd1f4071970 0x7fd1f40afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.518+0000 7fd1f2a00640 1 -- 172.21.15.112:0/4035920283 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1f40ceeb0 con 0x7fd1f4071530 2024-09-12T02:48:44.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.519+0000 7fd1f2a00640 1 --2- 172.21.15.112:0/4035920283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1f4071530 0x7fd1f40af720 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fd1f40cf430 tx=0x7fd1e002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323b7828f3ae6dad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:44.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.520+0000 7fd1f2000640 1 -- 172.21.15.112:0/4035920283 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0004030 con 0x7fd1f4071530 2024-09-12T02:48:44.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.520+0000 7fd1f2000640 1 -- 172.21.15.112:0/4035920283 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1e00041d0 con 0x7fd1f4071530 2024-09-12T02:48:44.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.520+0000 7fd1f2000640 1 -- 172.21.15.112:0/4035920283 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0003610 con 0x7fd1f4071530 2024-09-12T02:48:44.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.520+0000 7fd1fa800640 1 -- 172.21.15.112:0/4035920283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1f4071530 msgr2=0x7fd1f40af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:44.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.520+0000 7fd1fa800640 1 --2- 172.21.15.112:0/4035920283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1f4071530 0x7fd1f40af720 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fd1f40cf430 tx=0x7fd1e002a130 comp rx=0 tx=0).stop 2024-09-12T02:48:44.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.520+0000 7fd1fa800640 1 -- 172.21.15.112:0/4035920283 shutdown_connections 2024-09-12T02:48:44.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.520+0000 7fd1fa800640 1 --2- 172.21.15.112:0/4035920283 >> v2:172.21.15.137:3300/0 conn(0x7fd1f4071970 0x7fd1f40afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.520+0000 7fd1fa800640 1 --2- 172.21.15.112:0/4035920283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1f4071530 0x7fd1f40af720 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.520+0000 7fd1fa800640 1 --2- 172.21.15.112:0/4035920283 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1f415cc50 0x7fd1f40732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.520+0000 7fd1fa800640 1 -- 172.21.15.112:0/4035920283 >> 172.21.15.112:0/4035920283 conn(0x7fd1f406bbd0 msgr2=0x7fd1f406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:44.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.520+0000 7fd1fa800640 1 -- 172.21.15.112:0/4035920283 shutdown_connections 2024-09-12T02:48:44.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.520+0000 7fd1fa800640 1 -- 172.21.15.112:0/4035920283 wait complete. 2024-09-12T02:48:44.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.522+0000 7fd1fa800640 1 Processor -- start 2024-09-12T02:48:44.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.522+0000 7fd1fa800640 1 -- start start 2024-09-12T02:48:44.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.523+0000 7fd1fa800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1f4071530 0x7fd1f41f5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:44.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.523+0000 7fd1fa800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1f4071970 0x7fd1f4152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:44.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.523+0000 7fd1fa800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1f415cc50 0x7fd1f414e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:44.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.523+0000 7fd1fa800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f40cf150 con 0x7fd1f415cc50 2024-09-12T02:48:44.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.523+0000 7fd1fa800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f406e5e0 con 0x7fd1f4071970 2024-09-12T02:48:44.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.523+0000 7fd1fa800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd1f406f510 con 0x7fd1f4071530 2024-09-12T02:48:44.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.523+0000 7fd1f3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1f415cc50 0x7fd1f414e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:44.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.523+0000 7fd1f3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1f415cc50 0x7fd1f414e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38698/0 (socket says 172.21.15.112:38698) 2024-09-12T02:48:44.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.523+0000 7fd1f3e00640 1 -- 172.21.15.112:0/1647685606 learned_addr learned my addr 172.21.15.112:0/1647685606 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:44.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.523+0000 7fd1f2a00640 1 --2- 172.21.15.112:0/1647685606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1f4071970 0x7fd1f4152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:44.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.523+0000 7fd1f3400640 1 --2- 172.21.15.112:0/1647685606 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1f4071530 0x7fd1f41f5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:44.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.524+0000 7fd1f3e00640 1 -- 172.21.15.112:0/1647685606 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1f4071530 msgr2=0x7fd1f41f5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:44.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.524+0000 7fd1f3e00640 1 --2- 172.21.15.112:0/1647685606 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1f4071530 0x7fd1f41f5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.524+0000 7fd1f3e00640 1 -- 172.21.15.112:0/1647685606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1f4071970 msgr2=0x7fd1f4152450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:44.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.524+0000 7fd1f3e00640 1 --2- 172.21.15.112:0/1647685606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1f4071970 0x7fd1f4152450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.524+0000 7fd1f3e00640 1 -- 172.21.15.112:0/1647685606 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1f41f62d0 con 0x7fd1f415cc50 2024-09-12T02:48:44.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.524+0000 7fd1f3e00640 1 --2- 172.21.15.112:0/1647685606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1f415cc50 0x7fd1f414e0f0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec007d60 tx=0x7fd1ec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:44.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.524+0000 7fd1eb400640 1 -- 172.21.15.112:0/1647685606 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec014420 con 0x7fd1f415cc50 2024-09-12T02:48:44.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.524+0000 7fd1eb400640 1 -- 172.21.15.112:0/1647685606 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1ec019070 con 0x7fd1f415cc50 2024-09-12T02:48:44.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.524+0000 7fd1eb400640 1 -- 172.21.15.112:0/1647685606 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec014820 con 0x7fd1f415cc50 2024-09-12T02:48:44.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.524+0000 7fd1fa800640 1 -- 172.21.15.112:0/1647685606 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1f41547c0 con 0x7fd1f415cc50 2024-09-12T02:48:44.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.524+0000 7fd1fa800640 1 -- 172.21.15.112:0/1647685606 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1f4155060 con 0x7fd1f415cc50 2024-09-12T02:48:44.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.526+0000 7fd1fa800640 1 -- 172.21.15.112:0/1647685606 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1f4068a30 con 0x7fd1f415cc50 2024-09-12T02:48:44.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.526+0000 7fd1eb400640 1 -- 172.21.15.112:0/1647685606 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd1ec0149c0 con 0x7fd1f415cc50 2024-09-12T02:48:44.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.527+0000 7fd1eb400640 1 --2- 172.21.15.112:0/1647685606 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd1d406be60 0x7fd1d406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:44.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.527+0000 7fd1eb400640 1 -- 172.21.15.112:0/1647685606 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 4943+0+0 (secure 0 0 0) 0x7fd1ec08b120 con 0x7fd1f415cc50 2024-09-12T02:48:44.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.527+0000 7fd1f3400640 1 --2- 172.21.15.112:0/1647685606 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd1d406be60 0x7fd1d406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:44.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.528+0000 7fd1f3400640 1 --2- 172.21.15.112:0/1647685606 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd1d406be60 0x7fd1d406e320 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd1f40b0170 tx=0x7fd1e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:44.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.532+0000 7fd1eb400640 1 -- 172.21.15.112:0/1647685606 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd1f41f62d0 con 0x7fd1f415cc50 2024-09-12T02:48:44.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.703+0000 7fd1fa800640 1 -- 172.21.15.112:0/1647685606 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd1f40730d0 con 0x7fd1f415cc50 2024-09-12T02:48:44.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.708+0000 7fd1eb400640 1 -- 172.21.15.112:0/1647685606 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7fd1ec059810 con 0x7fd1f415cc50 2024-09-12T02:48:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.710+0000 7fd1fa800640 1 -- 172.21.15.112:0/1647685606 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd1d406be60 msgr2=0x7fd1d406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.710+0000 7fd1fa800640 1 --2- 172.21.15.112:0/1647685606 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd1d406be60 0x7fd1d406e320 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd1f40b0170 tx=0x7fd1e4008040 comp rx=0 tx=0).stop 2024-09-12T02:48:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.710+0000 7fd1fa800640 1 -- 172.21.15.112:0/1647685606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1f415cc50 msgr2=0x7fd1f414e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.710+0000 7fd1fa800640 1 --2- 172.21.15.112:0/1647685606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1f415cc50 0x7fd1f414e0f0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec007d60 tx=0x7fd1ec00e4b0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.711+0000 7fd1fa800640 1 -- 172.21.15.112:0/1647685606 shutdown_connections 2024-09-12T02:48:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.711+0000 7fd1fa800640 1 --2- 172.21.15.112:0/1647685606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1f415cc50 0x7fd1f414e0f0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.711+0000 7fd1fa800640 1 --2- 172.21.15.112:0/1647685606 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd1d406be60 0x7fd1d406e320 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.711+0000 7fd1fa800640 1 --2- 172.21.15.112:0/1647685606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1f4071970 0x7fd1f4152450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.711+0000 7fd1fa800640 1 --2- 172.21.15.112:0/1647685606 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1f4071530 0x7fd1f41f5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.711+0000 7fd1fa800640 1 -- 172.21.15.112:0/1647685606 >> 172.21.15.112:0/1647685606 conn(0x7fd1f406bbd0 msgr2=0x7fd1f4158ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.711+0000 7fd1fa800640 1 -- 172.21.15.112:0/1647685606 shutdown_connections 2024-09-12T02:48:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:44.711+0000 7fd1fa800640 1 -- 172.21.15.112:0/1647685606 wait complete. 2024-09-12T02:48:44.727 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:48:44.727 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:48:44.819 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:48:44.905 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:48:44.922 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:48:44.923 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:48:44.971 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:48:44.971 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:48:44.971 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:48:45.021 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:48:45.022 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:48:45.022 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:48:45.080 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:48:45.080 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:48:45.080 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:48:45.153 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:48:45.153 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T02:48:45.153 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:48:45.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.315+0000 7fe663000640 1 Processor -- start 2024-09-12T02:48:45.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.315+0000 7fe663000640 1 -- start start 2024-09-12T02:48:45.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.316+0000 7fe663000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe65c15b9a0 0x7fe65c06d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:45.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.316+0000 7fe663000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe65c06f270 0x7fe65c0b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:45.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.316+0000 7fe663000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe65c0b5560 0x7fe65c0d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:45.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.316+0000 7fe663000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe65c06de70 con 0x7fe65c0b5560 2024-09-12T02:48:45.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.316+0000 7fe663000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe65c06f690 con 0x7fe65c06f270 2024-09-12T02:48:45.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.316+0000 7fe663000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe65c0b42c0 con 0x7fe65c15b9a0 2024-09-12T02:48:45.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.316+0000 7fe662600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe65c0b5560 0x7fe65c0d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:45.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.316+0000 7fe662600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe65c0b5560 0x7fe65c0d0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38708/0 (socket says 172.21.15.112:38708) 2024-09-12T02:48:45.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.316+0000 7fe662600640 1 -- 172.21.15.112:0/909965689 learned_addr learned my addr 172.21.15.112:0/909965689 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:45.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.316+0000 7fe661200640 1 --2- 172.21.15.112:0/909965689 >> v2:172.21.15.137:3300/0 conn(0x7fe65c06f270 0x7fe65c0b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:45.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.316+0000 7fe661c00640 1 --2- 172.21.15.112:0/909965689 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe65c15b9a0 0x7fe65c06d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:45.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.317+0000 7fe662600640 1 -- 172.21.15.112:0/909965689 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe65c15b9a0 msgr2=0x7fe65c06d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:45.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.317+0000 7fe662600640 1 --2- 172.21.15.112:0/909965689 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe65c15b9a0 0x7fe65c06d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.317+0000 7fe662600640 1 -- 172.21.15.112:0/909965689 >> v2:172.21.15.137:3300/0 conn(0x7fe65c06f270 msgr2=0x7fe65c0b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:45.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.317+0000 7fe662600640 1 --2- 172.21.15.112:0/909965689 >> v2:172.21.15.137:3300/0 conn(0x7fe65c06f270 0x7fe65c0b5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.317+0000 7fe662600640 1 -- 172.21.15.112:0/909965689 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe65c15bd80 con 0x7fe65c0b5560 2024-09-12T02:48:45.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.317+0000 7fe662600640 1 --2- 172.21.15.112:0/909965689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe65c0b5560 0x7fe65c0d0820 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fe654009e50 tx=0x7fe65402a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54822251052ebbb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:45.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.318+0000 7fe65be00640 1 -- 172.21.15.112:0/909965689 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe654036070 con 0x7fe65c0b5560 2024-09-12T02:48:45.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.318+0000 7fe65be00640 1 -- 172.21.15.112:0/909965689 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe654031600 con 0x7fe65c0b5560 2024-09-12T02:48:45.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.318+0000 7fe65be00640 1 -- 172.21.15.112:0/909965689 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6540319d0 con 0x7fe65c0b5560 2024-09-12T02:48:45.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.318+0000 7fe663000640 1 -- 172.21.15.112:0/909965689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe65c0b5560 msgr2=0x7fe65c0d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:45.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.318+0000 7fe663000640 1 --2- 172.21.15.112:0/909965689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe65c0b5560 0x7fe65c0d0820 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fe654009e50 tx=0x7fe65402a6d0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.318+0000 7fe663000640 1 -- 172.21.15.112:0/909965689 shutdown_connections 2024-09-12T02:48:45.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.318+0000 7fe663000640 1 --2- 172.21.15.112:0/909965689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe65c0b5560 0x7fe65c0d0820 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.318+0000 7fe663000640 1 --2- 172.21.15.112:0/909965689 >> v2:172.21.15.137:3300/0 conn(0x7fe65c06f270 0x7fe65c0b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.318+0000 7fe663000640 1 --2- 172.21.15.112:0/909965689 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe65c15b9a0 0x7fe65c06d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.318+0000 7fe663000640 1 -- 172.21.15.112:0/909965689 >> 172.21.15.112:0/909965689 conn(0x7fe65c06bbd0 msgr2=0x7fe65c06bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:45.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.319+0000 7fe663000640 1 -- 172.21.15.112:0/909965689 shutdown_connections 2024-09-12T02:48:45.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.319+0000 7fe663000640 1 -- 172.21.15.112:0/909965689 wait complete. 2024-09-12T02:48:45.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.320+0000 7fe663000640 1 Processor -- start 2024-09-12T02:48:45.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.320+0000 7fe663000640 1 -- start start 2024-09-12T02:48:45.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.321+0000 7fe663000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe65c06f270 0x7fe65c148eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:45.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.321+0000 7fe663000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe65c15b9a0 0x7fe65c150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:45.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.321+0000 7fe663000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe65c1494f0 0x7fe65c156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:45.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.321+0000 7fe663000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c0b4b00 con 0x7fe65c06f270 2024-09-12T02:48:45.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.321+0000 7fe663000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c0b4820 con 0x7fe65c15b9a0 2024-09-12T02:48:45.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.321+0000 7fe663000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe65c0b5b50 con 0x7fe65c1494f0 2024-09-12T02:48:45.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.321+0000 7fe661c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe65c06f270 0x7fe65c148eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:45.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.322+0000 7fe661c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe65c06f270 0x7fe65c148eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38716/0 (socket says 172.21.15.112:38716) 2024-09-12T02:48:45.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.322+0000 7fe661c00640 1 -- 172.21.15.112:0/698120623 learned_addr learned my addr 172.21.15.112:0/698120623 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:45.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.322+0000 7fe662600640 1 --2- 172.21.15.112:0/698120623 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe65c1494f0 0x7fe65c156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:45.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.322+0000 7fe661200640 1 --2- 172.21.15.112:0/698120623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe65c15b9a0 0x7fe65c150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:45.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.322+0000 7fe661c00640 1 -- 172.21.15.112:0/698120623 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe65c1494f0 msgr2=0x7fe65c156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:45.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.322+0000 7fe661c00640 1 --2- 172.21.15.112:0/698120623 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe65c1494f0 0x7fe65c156930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.322+0000 7fe661c00640 1 -- 172.21.15.112:0/698120623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe65c15b9a0 msgr2=0x7fe65c150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:45.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.322+0000 7fe661c00640 1 --2- 172.21.15.112:0/698120623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe65c15b9a0 0x7fe65c150280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.322+0000 7fe661c00640 1 -- 172.21.15.112:0/698120623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe65c14fb00 con 0x7fe65c06f270 2024-09-12T02:48:45.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.322+0000 7fe661200640 1 --2- 172.21.15.112:0/698120623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe65c15b9a0 0x7fe65c150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:45.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.322+0000 7fe661c00640 1 --2- 172.21.15.112:0/698120623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe65c06f270 0x7fe65c148eb0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fe65000d650 tx=0x7fe65000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:45.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.322+0000 7fe659600640 1 -- 172.21.15.112:0/698120623 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65000b6c0 con 0x7fe65c06f270 2024-09-12T02:48:45.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.322+0000 7fe659600640 1 -- 172.21.15.112:0/698120623 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe650019070 con 0x7fe65c06f270 2024-09-12T02:48:45.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.322+0000 7fe663000640 1 -- 172.21.15.112:0/698120623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe65c14f540 con 0x7fe65c06f270 2024-09-12T02:48:45.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.322+0000 7fe659600640 1 -- 172.21.15.112:0/698120623 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65000baa0 con 0x7fe65c06f270 2024-09-12T02:48:45.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.323+0000 7fe663000640 1 -- 172.21.15.112:0/698120623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe65c147020 con 0x7fe65c06f270 2024-09-12T02:48:45.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.323+0000 7fe663000640 1 -- 172.21.15.112:0/698120623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe65c1507c0 con 0x7fe65c06f270 2024-09-12T02:48:45.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.324+0000 7fe659600640 1 -- 172.21.15.112:0/698120623 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe65000bc40 con 0x7fe65c06f270 2024-09-12T02:48:45.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.325+0000 7fe659600640 1 --2- 172.21.15.112:0/698120623 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe63c06be60 0x7fe63c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:45.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.325+0000 7fe659600640 1 -- 172.21.15.112:0/698120623 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 4943+0+0 (secure 0 0 0) 0x7fe65008aeb0 con 0x7fe65c06f270 2024-09-12T02:48:45.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.325+0000 7fe661200640 1 --2- 172.21.15.112:0/698120623 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe63c06be60 0x7fe63c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:45.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.326+0000 7fe661200640 1 --2- 172.21.15.112:0/698120623 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe63c06be60 0x7fe63c06e320 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0725e0 tx=0x7fe648008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:45.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.330+0000 7fe659600640 1 -- 172.21.15.112:0/698120623 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe650059ac0 con 0x7fe65c06f270 2024-09-12T02:48:45.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.537+0000 7fe663000640 1 -- 172.21.15.112:0/698120623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe65c0b5020 con 0x7fe65c06f270 2024-09-12T02:48:45.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.538+0000 7fe659600640 1 -- 172.21.15.112:0/698120623 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+3920 (secure 0 0 0) 0x7fe6500593c0 con 0x7fe65c06f270 2024-09-12T02:48:45.539 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:45.539 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":72,"btime":"2024-09-12T02:48:39:318212+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5816,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1943935405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1943935405},{"type":"v1","addr":"172.21.15.137:6834","nonce":1943935405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6328,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2010766966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2010766966},{"type":"v1","addr":"172.21.15.112:6835","nonce":2010766966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/193655023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":193655023},{"type":"v1","addr":"172.21.15.137:6835","nonce":193655023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7176,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3528061793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3528061793},{"type":"v1","addr":"172.21.15.112:6837","nonce":3528061793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[]} 2024-09-12T02:48:45.540 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 72 2024-09-12T02:48:45.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.540+0000 7fe663000640 1 -- 172.21.15.112:0/698120623 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe63c06be60 msgr2=0x7fe63c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:45.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.540+0000 7fe663000640 1 --2- 172.21.15.112:0/698120623 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe63c06be60 0x7fe63c06e320 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0725e0 tx=0x7fe648008040 comp rx=0 tx=0).stop 2024-09-12T02:48:45.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.540+0000 7fe663000640 1 -- 172.21.15.112:0/698120623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe65c06f270 msgr2=0x7fe65c148eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:45.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.541+0000 7fe663000640 1 --2- 172.21.15.112:0/698120623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe65c06f270 0x7fe65c148eb0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fe65000d650 tx=0x7fe65000db10 comp rx=0 tx=0).stop 2024-09-12T02:48:45.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.541+0000 7fe663000640 1 -- 172.21.15.112:0/698120623 shutdown_connections 2024-09-12T02:48:45.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.541+0000 7fe663000640 1 --2- 172.21.15.112:0/698120623 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe65c1494f0 0x7fe65c156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.541+0000 7fe663000640 1 --2- 172.21.15.112:0/698120623 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe63c06be60 0x7fe63c06e320 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.541+0000 7fe663000640 1 --2- 172.21.15.112:0/698120623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe65c15b9a0 0x7fe65c150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.541+0000 7fe663000640 1 --2- 172.21.15.112:0/698120623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe65c06f270 0x7fe65c148eb0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.541+0000 7fe663000640 1 -- 172.21.15.112:0/698120623 >> 172.21.15.112:0/698120623 conn(0x7fe65c06bbd0 msgr2=0x7fe65c159370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:45.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.541+0000 7fe663000640 1 -- 172.21.15.112:0/698120623 shutdown_connections 2024-09-12T02:48:45.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.541+0000 7fe663000640 1 -- 172.21.15.112:0/698120623 wait complete. 2024-09-12T02:48:45.559 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T02:48:45.559 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T02:48:45.559 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T02:48:45.559 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:48:45.559 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T02:48:45.560 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T02:48:45.560 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T02:48:45.560 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:48:45.560 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T02:48:45.561 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T02:48:45.561 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T02:48:45.561 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:48:45.561 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T02:48:45.561 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T02:48:45.561 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T02:48:45.562 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:48:45.575 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T02:48:45.575 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T02:48:45.576 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T02:48:45.576 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T02:48:45.578 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T02:48:45.579 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T02:48:45.579 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T02:48:45.579 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T02:48:45.620 INFO:tasks.ceph.mds.a:Started 2024-09-12T02:48:45.621 DEBUG:teuthology.parallel:result is None 2024-09-12T02:48:45.622 INFO:tasks.ceph.mds.c:Started 2024-09-12T02:48:45.622 DEBUG:teuthology.parallel:result is None 2024-09-12T02:48:45.623 INFO:tasks.ceph.mds.d:Started 2024-09-12T02:48:45.623 DEBUG:teuthology.parallel:result is None 2024-09-12T02:48:45.625 INFO:tasks.ceph.mds.b:Started 2024-09-12T02:48:45.625 DEBUG:teuthology.parallel:result is None 2024-09-12T02:48:45.625 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T02:48:45.752 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-12T02:48:45.752 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2024-09-12T02:48:45.759 INFO:tasks.ceph.mds.d.smithi137.stdout:starting mds.d at 2024-09-12T02:48:45.759 INFO:tasks.ceph.mds.b.smithi137.stdout:starting mds.b at 2024-09-12T02:48:45.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.786+0000 7f641fe00640 1 Processor -- start 2024-09-12T02:48:45.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.787+0000 7f641fe00640 1 -- start start 2024-09-12T02:48:45.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.788+0000 7f641fe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f64180b3bb0 0x7f64180d33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:45.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.788+0000 7f641fe00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64180d3ac0 con 0x7f64180b2a50 2024-09-12T02:48:45.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.788+0000 7f641fe00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64180d1d00 con 0x7f64181626d0 2024-09-12T02:48:45.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.788+0000 7f641fe00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f64180d1fe0 con 0x7f64180b3bb0 2024-09-12T02:48:45.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.788+0000 7f641ca00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f64180b2a50 0x7f64180cfa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48348/0 (socket says 172.21.15.112:48348) 2024-09-12T02:48:45.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.788+0000 7f641ca00640 1 -- 172.21.15.112:0/3062878573 learned_addr learned my addr 172.21.15.112:0/3062878573 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:45.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.788+0000 7f641d400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f64181626d0 0x7f64180d2cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.112:46982/0 (socket says 172.21.15.112:46982) 2024-09-12T02:48:45.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.788+0000 7f641de00640 1 --2- 172.21.15.112:0/3062878573 >> v2:172.21.15.112:3300/0 conn(0x7f64180b3bb0 0x7f64180d33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:45.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.788+0000 7f6417e00640 1 -- 172.21.15.112:0/3062878573 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3983534080 0 0) 0x7f64180d1d00 con 0x7f64181626d0 2024-09-12T02:48:45.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.789+0000 7f6417e00640 1 -- 172.21.15.112:0/3062878573 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6400003520 con 0x7f64181626d0 2024-09-12T02:48:45.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.789+0000 7f6417e00640 1 -- 172.21.15.112:0/3062878573 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 837931988 0 0) 0x7f64180d3ac0 con 0x7f64180b2a50 2024-09-12T02:48:45.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.789+0000 7f6417e00640 1 -- 172.21.15.112:0/3062878573 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64180d1d00 con 0x7f64180b2a50 2024-09-12T02:48:45.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.789+0000 7f641de00640 1 -- 172.21.15.112:0/3062878573 >> v1:172.21.15.137:6789/0 conn(0x7f64181626d0 legacy=0x7f64180d2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:45.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.789+0000 7f641de00640 1 -- 172.21.15.112:0/3062878573 >> v1:172.21.15.112:6789/0 conn(0x7f64180b2a50 legacy=0x7f64180cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:45.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.789+0000 7f641de00640 1 -- 172.21.15.112:0/3062878573 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64180d22c0 con 0x7f64180b3bb0 2024-09-12T02:48:45.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.790+0000 7f641de00640 1 --2- 172.21.15.112:0/3062878573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64180b3bb0 0x7f64180d33c0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f6410009d90 tx=0x7f641002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7314b654dd7d701 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:45.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.790+0000 7f6417e00640 1 -- 172.21.15.112:0/3062878573 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6410007740 con 0x7f64180b3bb0 2024-09-12T02:48:45.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.790+0000 7f6417e00640 1 -- 172.21.15.112:0/3062878573 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64100078e0 con 0x7f64180b3bb0 2024-09-12T02:48:45.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.790+0000 7f6417e00640 1 -- 172.21.15.112:0/3062878573 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6410007cb0 con 0x7f64180b3bb0 2024-09-12T02:48:45.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.791+0000 7f641fe00640 1 -- 172.21.15.112:0/3062878573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64180b3bb0 msgr2=0x7f64180d33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:45.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.791+0000 7f641fe00640 1 --2- 172.21.15.112:0/3062878573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64180b3bb0 0x7f64180d33c0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f6410009d90 tx=0x7f641002a6f0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.791+0000 7f641fe00640 1 -- 172.21.15.112:0/3062878573 shutdown_connections 2024-09-12T02:48:45.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.791+0000 7f641fe00640 1 --2- 172.21.15.112:0/3062878573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64180b3bb0 0x7f64180d33c0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.791+0000 7f641fe00640 1 -- 172.21.15.112:0/3062878573 >> 172.21.15.112:0/3062878573 conn(0x7f64180d4db0 msgr2=0x7f64180d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:45.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.791+0000 7f641fe00640 1 -- 172.21.15.112:0/3062878573 shutdown_connections 2024-09-12T02:48:45.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.791+0000 7f641fe00640 1 -- 172.21.15.112:0/3062878573 wait complete. 2024-09-12T02:48:45.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.792+0000 7f641fe00640 1 Processor -- start 2024-09-12T02:48:45.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.792+0000 7f641fe00640 1 -- start start 2024-09-12T02:48:45.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.793+0000 7f641fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64180b2a50 0x7f64180b94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:45.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.793+0000 7f641fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64180b3bb0 0x7f64180cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:45.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.793+0000 7f641fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f64181626d0 0x7f64180c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:45.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.793+0000 7f641fe00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f64180d3f20 con 0x7f64180b2a50 2024-09-12T02:48:45.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.793+0000 7f641fe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f64180d3da0 con 0x7f64180b3bb0 2024-09-12T02:48:45.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.793+0000 7f641fe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f64180d0180 con 0x7f64181626d0 2024-09-12T02:48:45.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.794+0000 7f641ca00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64180b3bb0 0x7f64180cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:45.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.794+0000 7f641de00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f64181626d0 0x7f64180c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:45.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.794+0000 7f641d400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64180b2a50 0x7f64180b94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:45.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.794+0000 7f641de00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f64181626d0 0x7f64180c92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:38594/0 (socket says 172.21.15.112:38594) 2024-09-12T02:48:45.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.794+0000 7f641de00640 1 -- 172.21.15.112:0/1421309402 learned_addr learned my addr 172.21.15.112:0/1421309402 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:45.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.794+0000 7f641ca00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64180b3bb0 0x7f64180cbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:56970/0 (socket says 172.21.15.112:56970) 2024-09-12T02:48:45.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.794+0000 7f641d400640 1 -- 172.21.15.112:0/1421309402 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f64181626d0 msgr2=0x7f64180c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:45.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.794+0000 7f641d400640 1 --2- 172.21.15.112:0/1421309402 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f64181626d0 0x7f64180c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.794+0000 7f641d400640 1 -- 172.21.15.112:0/1421309402 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64180b3bb0 msgr2=0x7f64180cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:45.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.794+0000 7f641d400640 1 --2- 172.21.15.112:0/1421309402 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64180b3bb0 0x7f64180cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.794+0000 7f641d400640 1 -- 172.21.15.112:0/1421309402 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64180c9a70 con 0x7f64180b2a50 2024-09-12T02:48:45.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.794+0000 7f641d400640 1 --2- 172.21.15.112:0/1421309402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64180b2a50 0x7f64180b94a0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f640c00c390 tx=0x7f640c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:45.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.795+0000 7f6415600640 1 -- 172.21.15.112:0/1421309402 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640c0074e0 con 0x7f64180b2a50 2024-09-12T02:48:45.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.795+0000 7f6415600640 1 -- 172.21.15.112:0/1421309402 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f640c007680 con 0x7f64180b2a50 2024-09-12T02:48:45.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.795+0000 7f6415600640 1 -- 172.21.15.112:0/1421309402 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640c004a20 con 0x7f64180b2a50 2024-09-12T02:48:45.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.795+0000 7f641fe00640 1 -- 172.21.15.112:0/1421309402 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64180c9d50 con 0x7f64180b2a50 2024-09-12T02:48:45.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.795+0000 7f641fe00640 1 -- 172.21.15.112:0/1421309402 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64180ca310 con 0x7f64180b2a50 2024-09-12T02:48:45.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.796+0000 7f641fe00640 1 -- 172.21.15.112:0/1421309402 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64180cfa70 con 0x7f64180b2a50 2024-09-12T02:48:45.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.797+0000 7f6415600640 1 -- 172.21.15.112:0/1421309402 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f640c01a020 con 0x7f64180b2a50 2024-09-12T02:48:45.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.798+0000 7f6415600640 1 --2- 172.21.15.112:0/1421309402 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f63f806be30 0x7f63f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:45.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.798+0000 7f6415600640 1 -- 172.21.15.112:0/1421309402 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 4943+0+0 (secure 0 0 0) 0x7f640c08a2b0 con 0x7f64180b2a50 2024-09-12T02:48:45.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.798+0000 7f641ca00640 1 --2- 172.21.15.112:0/1421309402 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f63f806be30 0x7f63f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:45.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.798+0000 7f641ca00640 1 --2- 172.21.15.112:0/1421309402 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f63f806be30 0x7f63f806e2f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6418161eb0 tx=0x7f6404009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:45.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.802+0000 7f6415600640 1 -- 172.21.15.112:0/1421309402 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f640c058870 con 0x7f64180b2a50 2024-09-12T02:48:45.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:45.984+0000 7f641fe00640 1 -- 172.21.15.112:0/1421309402 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f6418068440 con 0x7f64180b2a50 2024-09-12T02:48:47.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.364+0000 7f6415600640 1 -- 172.21.15.112:0/1421309402 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v146) ==== 97+0+0 (secure 0 0 0) 0x7f640c05cb70 con 0x7f64180b2a50 2024-09-12T02:48:47.365 INFO:teuthology.orchestra.run.smithi112.stderr: removed all blocklist entries 2024-09-12T02:48:47.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.367+0000 7f641fe00640 1 -- 172.21.15.112:0/1421309402 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f63f806be30 msgr2=0x7f63f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:47.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.367+0000 7f641fe00640 1 --2- 172.21.15.112:0/1421309402 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f63f806be30 0x7f63f806e2f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6418161eb0 tx=0x7f6404009040 comp rx=0 tx=0).stop 2024-09-12T02:48:47.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.367+0000 7f641fe00640 1 -- 172.21.15.112:0/1421309402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64180b2a50 msgr2=0x7f64180b94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:47.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.367+0000 7f641fe00640 1 --2- 172.21.15.112:0/1421309402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64180b2a50 0x7f64180b94a0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f640c00c390 tx=0x7f640c00c850 comp rx=0 tx=0).stop 2024-09-12T02:48:47.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.367+0000 7f641fe00640 1 -- 172.21.15.112:0/1421309402 shutdown_connections 2024-09-12T02:48:47.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.367+0000 7f641fe00640 1 --2- 172.21.15.112:0/1421309402 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f64181626d0 0x7f64180c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:47.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.367+0000 7f641fe00640 1 --2- 172.21.15.112:0/1421309402 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f63f806be30 0x7f63f806e2f0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:47.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.367+0000 7f641fe00640 1 --2- 172.21.15.112:0/1421309402 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64180b3bb0 0x7f64180cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:47.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.367+0000 7f641fe00640 1 --2- 172.21.15.112:0/1421309402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64180b2a50 0x7f64180b94a0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:47.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.367+0000 7f641fe00640 1 -- 172.21.15.112:0/1421309402 >> 172.21.15.112:0/1421309402 conn(0x7f64180d4db0 msgr2=0x7f64180d0670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:47.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.367+0000 7f641fe00640 1 -- 172.21.15.112:0/1421309402 shutdown_connections 2024-09-12T02:48:47.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.367+0000 7f641fe00640 1 -- 172.21.15.112:0/1421309402 wait complete. 2024-09-12T02:48:47.388 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T02:48:47.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.543+0000 7fdc91200640 1 Processor -- start 2024-09-12T02:48:47.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.543+0000 7fdc91200640 1 -- start start 2024-09-12T02:48:47.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.545+0000 7fdc91200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdc8c0ae8d0 0x7fdc8c0afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:47.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.545+0000 7fdc91200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdc8c06dca0 0x7fdc8c06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:47.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.545+0000 7fdc91200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc8c0aedd0 con 0x7fdc8c06d8c0 2024-09-12T02:48:47.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.545+0000 7fdc91200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fdc8c0af0b0 con 0x7fdc8c06dca0 2024-09-12T02:48:47.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.545+0000 7fdc91200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fdc8c0af390 con 0x7fdc8c0ae8d0 2024-09-12T02:48:47.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.545+0000 7fdc8a800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdc8c06dca0 0x7fdc8c06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:47.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.545+0000 7fdc8a800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdc8c06dca0 0x7fdc8c06e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38758/0 (socket says 172.21.15.112:38758) 2024-09-12T02:48:47.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.545+0000 7fdc8a800640 1 -- 172.21.15.112:0/2512439683 learned_addr learned my addr 172.21.15.112:0/2512439683 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:47.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.545+0000 7fdc89400640 1 --2- 172.21.15.112:0/2512439683 >> v2:172.21.15.137:3300/0 conn(0x7fdc8c0ae8d0 0x7fdc8c0afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:47.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.545+0000 7fdc8a800640 1 -- 172.21.15.112:0/2512439683 >> v2:172.21.15.137:3300/0 conn(0x7fdc8c0ae8d0 msgr2=0x7fdc8c0afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:47.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.545+0000 7fdc8a800640 1 --2- 172.21.15.112:0/2512439683 >> v2:172.21.15.137:3300/0 conn(0x7fdc8c0ae8d0 0x7fdc8c0afe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:47.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.545+0000 7fdc8a800640 1 -- 172.21.15.112:0/2512439683 >> v1:172.21.15.137:6789/0 conn(0x7fdc8c06d8c0 legacy=0x7fdc8c0715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:47.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.545+0000 7fdc8a800640 1 -- 172.21.15.112:0/2512439683 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc8c0af670 con 0x7fdc8c06dca0 2024-09-12T02:48:47.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.545+0000 7fdc89400640 1 --2- 172.21.15.112:0/2512439683 >> v2:172.21.15.137:3300/0 conn(0x7fdc8c0ae8d0 0x7fdc8c0afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:47.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.546+0000 7fdc8a800640 1 --2- 172.21.15.112:0/2512439683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc8c06dca0 0x7fdc8c06e150 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c06fa40 tx=0x7fdc8402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3a8d095d19f91d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:47.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.547+0000 7fdc88a00640 1 -- 172.21.15.112:0/2512439683 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc84036070 con 0x7fdc8c06dca0 2024-09-12T02:48:47.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.547+0000 7fdc88a00640 1 -- 172.21.15.112:0/2512439683 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc84031600 con 0x7fdc8c06dca0 2024-09-12T02:48:47.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.547+0000 7fdc88a00640 1 -- 172.21.15.112:0/2512439683 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc840319d0 con 0x7fdc8c06dca0 2024-09-12T02:48:47.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.547+0000 7fdc91200640 1 -- 172.21.15.112:0/2512439683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc8c06dca0 msgr2=0x7fdc8c06e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:47.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.547+0000 7fdc91200640 1 --2- 172.21.15.112:0/2512439683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc8c06dca0 0x7fdc8c06e150 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c06fa40 tx=0x7fdc8402a6f0 comp rx=0 tx=0).stop 2024-09-12T02:48:47.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.547+0000 7fdc91200640 1 -- 172.21.15.112:0/2512439683 shutdown_connections 2024-09-12T02:48:47.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.547+0000 7fdc91200640 1 --2- 172.21.15.112:0/2512439683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc8c06dca0 0x7fdc8c06e150 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:47.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.547+0000 7fdc91200640 1 --2- 172.21.15.112:0/2512439683 >> v2:172.21.15.137:3300/0 conn(0x7fdc8c0ae8d0 0x7fdc8c0afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:47.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.547+0000 7fdc91200640 1 -- 172.21.15.112:0/2512439683 >> 172.21.15.112:0/2512439683 conn(0x7fdc8c06bbd0 msgr2=0x7fdc8c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:47.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.547+0000 7fdc91200640 1 -- 172.21.15.112:0/2512439683 shutdown_connections 2024-09-12T02:48:47.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.547+0000 7fdc91200640 1 -- 172.21.15.112:0/2512439683 wait complete. 2024-09-12T02:48:47.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.549+0000 7fdc91200640 1 Processor -- start 2024-09-12T02:48:47.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.549+0000 7fdc91200640 1 -- start start 2024-09-12T02:48:47.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.550+0000 7fdc91200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdc8c06d8c0 0x7fdc8c1f6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:47.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.550+0000 7fdc91200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc8c06dca0 0x7fdc8c1f80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:47.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.550+0000 7fdc91200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc8c0ae8d0 0x7fdc8c1f5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:47.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.550+0000 7fdc91200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8c0b38e0 con 0x7fdc8c06dca0 2024-09-12T02:48:47.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.550+0000 7fdc91200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8c06e690 con 0x7fdc8c0ae8d0 2024-09-12T02:48:47.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.550+0000 7fdc91200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdc8c0b3a60 con 0x7fdc8c06d8c0 2024-09-12T02:48:47.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.550+0000 7fdc89400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc8c06dca0 0x7fdc8c1f80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:47.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.550+0000 7fdc89400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc8c06dca0 0x7fdc8c1f80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38768/0 (socket says 172.21.15.112:38768) 2024-09-12T02:48:47.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.550+0000 7fdc89400640 1 -- 172.21.15.112:0/4084484224 learned_addr learned my addr 172.21.15.112:0/4084484224 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:47.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.550+0000 7fdc89e00640 1 --2- 172.21.15.112:0/4084484224 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdc8c06d8c0 0x7fdc8c1f6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:47.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.550+0000 7fdc8a800640 1 --2- 172.21.15.112:0/4084484224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc8c0ae8d0 0x7fdc8c1f5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:47.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.551+0000 7fdc89400640 1 -- 172.21.15.112:0/4084484224 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdc8c06d8c0 msgr2=0x7fdc8c1f6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:47.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.551+0000 7fdc89400640 1 --2- 172.21.15.112:0/4084484224 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdc8c06d8c0 0x7fdc8c1f6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:47.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.551+0000 7fdc89400640 1 -- 172.21.15.112:0/4084484224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc8c0ae8d0 msgr2=0x7fdc8c1f5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:47.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.551+0000 7fdc89400640 1 --2- 172.21.15.112:0/4084484224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc8c0ae8d0 0x7fdc8c1f5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:47.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.551+0000 7fdc89400640 1 -- 172.21.15.112:0/4084484224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc8c160290 con 0x7fdc8c06dca0 2024-09-12T02:48:47.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.551+0000 7fdc8a800640 1 --2- 172.21.15.112:0/4084484224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc8c0ae8d0 0x7fdc8c1f5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:47.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.551+0000 7fdc89400640 1 --2- 172.21.15.112:0/4084484224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc8c06dca0 0x7fdc8c1f80f0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fdc7800d800 tx=0x7fdc7800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:47.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.551+0000 7fdc82000640 1 -- 172.21.15.112:0/4084484224 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc78018020 con 0x7fdc8c06dca0 2024-09-12T02:48:47.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.551+0000 7fdc82000640 1 -- 172.21.15.112:0/4084484224 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc78004030 con 0x7fdc8c06dca0 2024-09-12T02:48:47.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.551+0000 7fdc82000640 1 -- 172.21.15.112:0/4084484224 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc78004420 con 0x7fdc8c06dca0 2024-09-12T02:48:47.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.551+0000 7fdc91200640 1 -- 172.21.15.112:0/4084484224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc8c15f680 con 0x7fdc8c06dca0 2024-09-12T02:48:47.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.551+0000 7fdc91200640 1 -- 172.21.15.112:0/4084484224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc8c15fc40 con 0x7fdc8c06dca0 2024-09-12T02:48:47.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.552+0000 7fdc91200640 1 -- 172.21.15.112:0/4084484224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc8c068a30 con 0x7fdc8c06dca0 2024-09-12T02:48:47.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.553+0000 7fdc82000640 1 -- 172.21.15.112:0/4084484224 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdc78005990 con 0x7fdc8c06dca0 2024-09-12T02:48:47.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.554+0000 7fdc82000640 1 --2- 172.21.15.112:0/4084484224 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdc6c06be30 0x7fdc6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:47.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.554+0000 7fdc82000640 1 -- 172.21.15.112:0/4084484224 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 4857+0+0 (secure 0 0 0) 0x7fdc7808ab80 con 0x7fdc8c06dca0 2024-09-12T02:48:47.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.555+0000 7fdc89e00640 1 --2- 172.21.15.112:0/4084484224 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdc6c06be30 0x7fdc6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:47.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.555+0000 7fdc89e00640 1 --2- 172.21.15.112:0/4084484224 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdc6c06be30 0x7fdc6c06e2f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c1536a0 tx=0x7fdc7c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:47.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.558+0000 7fdc82000640 1 -- 172.21.15.112:0/4084484224 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc78022020 con 0x7fdc8c06dca0 2024-09-12T02:48:47.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.792+0000 7fdc91200640 1 -- 172.21.15.112:0/4084484224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fdc8c06e150 con 0x7fdc8c06dca0 2024-09-12T02:48:47.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.793+0000 7fdc82000640 1 -- 172.21.15.112:0/4084484224 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) ==== 80+0+5304 (secure 0 0 0) 0x7fdc78059910 con 0x7fdc8c06dca0 2024-09-12T02:48:47.794 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:47.794 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:48:47.794 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_dump": [ 2024-09-12T02:48:47.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:47.794 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.a", 2024-09-12T02:48:47.794 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmKE09KRAAtNq70LeeB9ENNxX91m10Fg==", 2024-09-12T02:48:47.794 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:48:47.794 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:48:47.794 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:48:47.794 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:48:47.795 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:48:47.795 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:47.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:47.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:47.795 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.b", 2024-09-12T02:48:47.795 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmMjYTARAAuIrofOOp9Dbrhkt314mhuw==", 2024-09-12T02:48:47.795 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:48:47.795 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:48:47.795 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:48:47.795 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:48:47.795 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:48:47.795 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:47.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:47.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:47.796 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.c", 2024-09-12T02:48:47.796 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmLQXzMhAAhk28JuqKhfbZtvRu9SSVrw==", 2024-09-12T02:48:47.796 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:48:47.796 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:48:47.796 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:48:47.796 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:48:47.796 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:48:47.796 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:47.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:47.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:47.796 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.d", 2024-09-12T02:48:47.796 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmaE7JChAAKlyynYJnHLs87BXyMC0xgA==", 2024-09-12T02:48:47.797 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:48:47.797 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:48:47.797 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:48:47.797 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:48:47.797 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:48:47.797 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:47.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:47.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:47.797 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.0", 2024-09-12T02:48:47.797 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDXVOJmFXfdIRAA+VpZNU0tEN6vAzR2C7nuLg==", 2024-09-12T02:48:47.797 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:48:47.797 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:48:47.797 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:48:47.797 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:48:47.798 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:47.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:47.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:47.798 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.1", 2024-09-12T02:48:47.798 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDXVOJmcgHyLBAA/OxfdQ1D+uFzbCnm1dJLxw==", 2024-09-12T02:48:47.798 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:48:47.798 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:48:47.798 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:48:47.798 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:48:47.798 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:47.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:47.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:47.798 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.2", 2024-09-12T02:48:47.798 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDXVOJm0baUNhAAuInNwHut2Xn0kBmjnJhdqw==", 2024-09-12T02:48:47.799 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:48:47.799 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:48:47.799 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:48:47.799 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:48:47.799 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:47.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:47.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:47.799 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.3", 2024-09-12T02:48:47.799 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDYVOJmL/O3BBAAZhQ4/70wj/2zEbMcfD4hQA==", 2024-09-12T02:48:47.799 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:48:47.799 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:48:47.799 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:48:47.799 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:48:47.799 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:47.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:47.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:47.800 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.4", 2024-09-12T02:48:47.800 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmC+sJAxAAUQofpG3g8DlGLQ8wUqtuSg==", 2024-09-12T02:48:47.800 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:48:47.800 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:48:47.800 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:48:47.800 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:48:47.800 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:47.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:47.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:47.800 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.5", 2024-09-12T02:48:47.800 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmY2OSDhAA2rg1HGjWx7G6IzFi6yQ/jQ==", 2024-09-12T02:48:47.800 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:48:47.800 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:48:47.801 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:48:47.801 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:48:47.801 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:47.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:47.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:47.801 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.6", 2024-09-12T02:48:47.801 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmydoaGRAAh/ozKewnY+RxiZ4EcOFA7A==", 2024-09-12T02:48:47.801 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:48:47.801 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:48:47.801 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:48:47.801 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:48:47.801 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:47.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:47.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:47.802 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.7", 2024-09-12T02:48:47.802 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmmB7cIhAAVhtz7OuxYBQgEKGvHdY33g==", 2024-09-12T02:48:47.802 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:48:47.802 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:48:47.802 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:48:47.802 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:48:47.802 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:47.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:47.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:47.802 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.0", 2024-09-12T02:48:47.802 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmaG86ExAAD0SOlJOsLpoQZlgPJIPaxA==", 2024-09-12T02:48:47.802 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:48:47.802 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:48:47.803 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow r", 2024-09-12T02:48:47.803 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T02:48:47.803 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:47.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:47.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:47.803 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.1", 2024-09-12T02:48:47.803 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmt7AeIBAAGRSEejG29OpANZqtia7KEw==", 2024-09-12T02:48:47.803 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:48:47.803 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:48:47.803 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:48:47.803 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:48:47.803 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:48:47.803 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:47.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:47.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:47.804 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.2", 2024-09-12T02:48:47.804 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmcUWtGRAAlV/gS/CDZKHb5bjbmDzjlg==", 2024-09-12T02:48:47.804 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:48:47.804 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:48:47.804 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:48:47.804 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:48:47.804 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:48:47.804 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:47.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:47.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:47.804 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.3", 2024-09-12T02:48:47.804 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJm2M97JhAAHKJoPBf6TN6Nu8muK6wzaw==", 2024-09-12T02:48:47.805 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:48:47.805 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:48:47.805 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:48:47.805 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:48:47.805 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:48:47.805 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:47.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:47.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:47.805 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.admin", 2024-09-12T02:48:47.805 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDSVOJmhl82NBAAvkcxnsY5u9lYO12FaRbP1A==", 2024-09-12T02:48:47.805 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:48:47.805 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-12T02:48:47.805 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:48:47.805 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:48:47.806 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:48:47.806 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:47.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:47.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:47.806 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.x", 2024-09-12T02:48:47.806 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmftawIhAAAKmfx8khERROoZ8BCLukAw==", 2024-09-12T02:48:47.806 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:48:47.806 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-12T02:48:47.806 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-12T02:48:47.806 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:48:47.806 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:47.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:48:47.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:47.806 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.y", 2024-09-12T02:48:47.807 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmcxtNGhAAAXWh1fMrVeFSy2hh3p2Rkw==", 2024-09-12T02:48:47.807 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:48:47.807 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-12T02:48:47.807 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-12T02:48:47.807 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:48:47.807 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:47.807 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:47.807 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:48:47.807 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:48:47.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.795+0000 7fdc91200640 1 -- 172.21.15.112:0/4084484224 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdc6c06be30 msgr2=0x7fdc6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:47.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.795+0000 7fdc91200640 1 --2- 172.21.15.112:0/4084484224 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdc6c06be30 0x7fdc6c06e2f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c1536a0 tx=0x7fdc7c009040 comp rx=0 tx=0).stop 2024-09-12T02:48:47.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.795+0000 7fdc91200640 1 -- 172.21.15.112:0/4084484224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc8c06dca0 msgr2=0x7fdc8c1f80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:47.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.795+0000 7fdc91200640 1 --2- 172.21.15.112:0/4084484224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc8c06dca0 0x7fdc8c1f80f0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fdc7800d800 tx=0x7fdc7800dcc0 comp rx=0 tx=0).stop 2024-09-12T02:48:47.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.795+0000 7fdc91200640 1 -- 172.21.15.112:0/4084484224 shutdown_connections 2024-09-12T02:48:47.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.795+0000 7fdc91200640 1 --2- 172.21.15.112:0/4084484224 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdc6c06be30 0x7fdc6c06e2f0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:47.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.795+0000 7fdc91200640 1 --2- 172.21.15.112:0/4084484224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc8c0ae8d0 0x7fdc8c1f5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:47.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.795+0000 7fdc91200640 1 --2- 172.21.15.112:0/4084484224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc8c06dca0 0x7fdc8c1f80f0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:47.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.795+0000 7fdc91200640 1 --2- 172.21.15.112:0/4084484224 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdc8c06d8c0 0x7fdc8c1f6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:47.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.795+0000 7fdc91200640 1 -- 172.21.15.112:0/4084484224 >> 172.21.15.112:0/4084484224 conn(0x7fdc8c06bbd0 msgr2=0x7fdc8c155140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:47.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.795+0000 7fdc91200640 1 -- 172.21.15.112:0/4084484224 shutdown_connections 2024-09-12T02:48:47.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.795+0000 7fdc91200640 1 -- 172.21.15.112:0/4084484224 wait complete. 2024-09-12T02:48:47.812 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T02:48:47.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.965+0000 7fb174200640 1 Processor -- start 2024-09-12T02:48:47.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.965+0000 7fb174200640 1 -- start start 2024-09-12T02:48:47.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.966+0000 7fb174200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb16c072c80 0x7fb16c0cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:47.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.966+0000 7fb174200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb16c15bf40 con 0x7fb16c15bb60 2024-09-12T02:48:47.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.966+0000 7fb174200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb16c0cdfd0 con 0x7fb16c06f4f0 2024-09-12T02:48:47.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.966+0000 7fb174200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb16c06da70 con 0x7fb16c072c80 2024-09-12T02:48:47.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.967+0000 7fb171800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb16c15bb60 0x7fb16c06ede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48350/0 (socket says 172.21.15.112:48350) 2024-09-12T02:48:47.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.967+0000 7fb171800640 1 -- 172.21.15.112:0/1641739473 learned_addr learned my addr 172.21.15.112:0/1641739473 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:47.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.967+0000 7fb172200640 1 --2- 172.21.15.112:0/1641739473 >> v2:172.21.15.112:3300/0 conn(0x7fb16c072c80 0x7fb16c0cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:47.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.967+0000 7fb16be00640 1 -- 172.21.15.112:0/1641739473 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2261525241 0 0) 0x7fb16c15bf40 con 0x7fb16c15bb60 2024-09-12T02:48:47.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.967+0000 7fb172200640 1 -- 172.21.15.112:0/1641739473 >> v1:172.21.15.137:6789/0 conn(0x7fb16c06f4f0 legacy=0x7fb16c0ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:47.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.967+0000 7fb172200640 1 -- 172.21.15.112:0/1641739473 >> v1:172.21.15.112:6789/0 conn(0x7fb16c15bb60 legacy=0x7fb16c06ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:47.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.967+0000 7fb172200640 1 -- 172.21.15.112:0/1641739473 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb16c0ce2b0 con 0x7fb16c072c80 2024-09-12T02:48:47.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.968+0000 7fb172200640 1 --2- 172.21.15.112:0/1641739473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb16c072c80 0x7fb16c0cf4a0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fb164009d90 tx=0x7fb16402c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a597d92512056abe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:47.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.968+0000 7fb16be00640 1 -- 172.21.15.112:0/1641739473 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb164032770 con 0x7fb16c072c80 2024-09-12T02:48:47.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.968+0000 7fb16be00640 1 -- 172.21.15.112:0/1641739473 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb164038070 con 0x7fb16c072c80 2024-09-12T02:48:47.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.968+0000 7fb16be00640 1 -- 172.21.15.112:0/1641739473 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb164032b30 con 0x7fb16c072c80 2024-09-12T02:48:47.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.969+0000 7fb174200640 1 -- 172.21.15.112:0/1641739473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb16c072c80 msgr2=0x7fb16c0cf4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:47.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.969+0000 7fb174200640 1 --2- 172.21.15.112:0/1641739473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb16c072c80 0x7fb16c0cf4a0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fb164009d90 tx=0x7fb16402c8b0 comp rx=0 tx=0).stop 2024-09-12T02:48:47.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.969+0000 7fb174200640 1 -- 172.21.15.112:0/1641739473 shutdown_connections 2024-09-12T02:48:47.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.969+0000 7fb174200640 1 --2- 172.21.15.112:0/1641739473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb16c072c80 0x7fb16c0cf4a0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:47.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.969+0000 7fb174200640 1 -- 172.21.15.112:0/1641739473 >> 172.21.15.112:0/1641739473 conn(0x7fb16c0b26c0 msgr2=0x7fb16c0b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:47.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.969+0000 7fb174200640 1 -- 172.21.15.112:0/1641739473 shutdown_connections 2024-09-12T02:48:47.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.969+0000 7fb174200640 1 -- 172.21.15.112:0/1641739473 wait complete. 2024-09-12T02:48:47.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.971+0000 7fb174200640 1 Processor -- start 2024-09-12T02:48:47.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.971+0000 7fb174200640 1 -- start start 2024-09-12T02:48:47.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.972+0000 7fb174200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb16c06f4f0 0x7fb16c0cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:47.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.972+0000 7fb174200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb16c072c80 0x7fb16c14d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:47.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.972+0000 7fb174200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb16c15bb60 0x7fb16c14be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:47.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.972+0000 7fb174200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c06d600 con 0x7fb16c06f4f0 2024-09-12T02:48:47.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.972+0000 7fb174200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c0ce870 con 0x7fb16c15bb60 2024-09-12T02:48:47.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.972+0000 7fb174200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb16c06d780 con 0x7fb16c072c80 2024-09-12T02:48:47.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.972+0000 7fb171800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb16c06f4f0 0x7fb16c0cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:47.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.972+0000 7fb171800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb16c06f4f0 0x7fb16c0cfa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38780/0 (socket says 172.21.15.112:38780) 2024-09-12T02:48:47.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.972+0000 7fb171800640 1 -- 172.21.15.112:0/2506611214 learned_addr learned my addr 172.21.15.112:0/2506611214 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:47.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.972+0000 7fb170e00640 1 --2- 172.21.15.112:0/2506611214 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb16c072c80 0x7fb16c14d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:47.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.972+0000 7fb172200640 1 --2- 172.21.15.112:0/2506611214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb16c15bb60 0x7fb16c14be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:47.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.972+0000 7fb171800640 1 -- 172.21.15.112:0/2506611214 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb16c072c80 msgr2=0x7fb16c14d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:47.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.972+0000 7fb171800640 1 --2- 172.21.15.112:0/2506611214 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb16c072c80 0x7fb16c14d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:47.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.972+0000 7fb171800640 1 -- 172.21.15.112:0/2506611214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb16c15bb60 msgr2=0x7fb16c14be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:47.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.972+0000 7fb171800640 1 --2- 172.21.15.112:0/2506611214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb16c15bb60 0x7fb16c14be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:47.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.972+0000 7fb171800640 1 -- 172.21.15.112:0/2506611214 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb16c15cb70 con 0x7fb16c06f4f0 2024-09-12T02:48:47.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.972+0000 7fb170e00640 1 --2- 172.21.15.112:0/2506611214 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb16c072c80 0x7fb16c14d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:47.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.972+0000 7fb172200640 1 --2- 172.21.15.112:0/2506611214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb16c15bb60 0x7fb16c14be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:47.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.973+0000 7fb171800640 1 --2- 172.21.15.112:0/2506611214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb16c06f4f0 0x7fb16c0cfa60 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fb16000c430 tx=0x7fb16000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:47.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.973+0000 7fb169600640 1 -- 172.21.15.112:0/2506611214 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1600074e0 con 0x7fb16c06f4f0 2024-09-12T02:48:47.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.973+0000 7fb169600640 1 -- 172.21.15.112:0/2506611214 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1600047e0 con 0x7fb16c06f4f0 2024-09-12T02:48:47.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.973+0000 7fb174200640 1 -- 172.21.15.112:0/2506611214 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb16c15ce50 con 0x7fb16c06f4f0 2024-09-12T02:48:47.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.973+0000 7fb169600640 1 -- 172.21.15.112:0/2506611214 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb160004bd0 con 0x7fb16c06f4f0 2024-09-12T02:48:47.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.973+0000 7fb174200640 1 -- 172.21.15.112:0/2506611214 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb16c15d410 con 0x7fb16c06f4f0 2024-09-12T02:48:47.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.974+0000 7fb174200640 1 -- 172.21.15.112:0/2506611214 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb16c068a30 con 0x7fb16c06f4f0 2024-09-12T02:48:47.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.975+0000 7fb169600640 1 -- 172.21.15.112:0/2506611214 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb160011070 con 0x7fb16c06f4f0 2024-09-12T02:48:47.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.976+0000 7fb169600640 1 --2- 172.21.15.112:0/2506611214 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb14c06be60 0x7fb14c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:47.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.976+0000 7fb169600640 1 -- 172.21.15.112:0/2506611214 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 4857+0+0 (secure 0 0 0) 0x7fb16008a790 con 0x7fb16c06f4f0 2024-09-12T02:48:47.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.976+0000 7fb170e00640 1 --2- 172.21.15.112:0/2506611214 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb14c06be60 0x7fb14c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:47.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.977+0000 7fb170e00640 1 --2- 172.21.15.112:0/2506611214 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb14c06be60 0x7fb14c06e320 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb16c15a380 tx=0x7fb158009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:47.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:47.980+0000 7fb169600640 1 -- 172.21.15.112:0/2506611214 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb160059480 con 0x7fb16c06f4f0 2024-09-12T02:48:48.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.155+0000 7fb174200640 1 -- 172.21.15.112:0/2506611214 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb16c0b56a0 con 0x7fb16c06f4f0 2024-09-12T02:48:48.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.156+0000 7fb169600640 1 -- 172.21.15.112:0/2506611214 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v146) ==== 84+0+65 (secure 0 0 0) 0x7fb160058d80 con 0x7fb16c06f4f0 2024-09-12T02:48:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:48.156 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2024-09-12T02:48:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:48:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 1, 2024-09-12T02:48:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": ".mgr" 2024-09-12T02:48:48.156 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:48:48.156 INFO:teuthology.orchestra.run.smithi112.stdout:] 2024-09-12T02:48:48.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.158+0000 7fb174200640 1 -- 172.21.15.112:0/2506611214 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb14c06be60 msgr2=0x7fb14c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:48.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.158+0000 7fb174200640 1 --2- 172.21.15.112:0/2506611214 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb14c06be60 0x7fb14c06e320 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb16c15a380 tx=0x7fb158009040 comp rx=0 tx=0).stop 2024-09-12T02:48:48.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.158+0000 7fb174200640 1 -- 172.21.15.112:0/2506611214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb16c06f4f0 msgr2=0x7fb16c0cfa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:48.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.158+0000 7fb174200640 1 --2- 172.21.15.112:0/2506611214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb16c06f4f0 0x7fb16c0cfa60 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fb16000c430 tx=0x7fb16000c8f0 comp rx=0 tx=0).stop 2024-09-12T02:48:48.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.158+0000 7fb174200640 1 -- 172.21.15.112:0/2506611214 shutdown_connections 2024-09-12T02:48:48.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.158+0000 7fb174200640 1 --2- 172.21.15.112:0/2506611214 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb14c06be60 0x7fb14c06e320 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:48.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.158+0000 7fb174200640 1 --2- 172.21.15.112:0/2506611214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb16c15bb60 0x7fb16c14be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:48.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.158+0000 7fb174200640 1 --2- 172.21.15.112:0/2506611214 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb16c072c80 0x7fb16c14d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:48.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.158+0000 7fb174200640 1 --2- 172.21.15.112:0/2506611214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb16c06f4f0 0x7fb16c0cfa60 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:48.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.158+0000 7fb174200640 1 -- 172.21.15.112:0/2506611214 >> 172.21.15.112:0/2506611214 conn(0x7fb16c0b26c0 msgr2=0x7fb16c158f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:48.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.158+0000 7fb174200640 1 -- 172.21.15.112:0/2506611214 shutdown_connections 2024-09-12T02:48:48.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.158+0000 7fb174200640 1 -- 172.21.15.112:0/2506611214 wait complete. 2024-09-12T02:48:48.174 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T02:48:48.175 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T02:48:48.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.333+0000 7fa16ca00640 1 Processor -- start 2024-09-12T02:48:48.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.334+0000 7fa16ca00640 1 -- start start 2024-09-12T02:48:48.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.335+0000 7fa16ca00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa168144890 0x7fa1680b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:48.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.335+0000 7fa16ca00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa16806eed0 con 0x7fa1680b4140 2024-09-12T02:48:48.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.335+0000 7fa16ca00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa16806f170 con 0x7fa1681602f0 2024-09-12T02:48:48.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.335+0000 7fa16ca00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa16815f810 con 0x7fa168144890 2024-09-12T02:48:48.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.335+0000 7fa166800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa1680b4140 0x7fa1680ce5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48360/0 (socket says 172.21.15.112:48360) 2024-09-12T02:48:48.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.335+0000 7fa166800640 1 -- 172.21.15.112:0/221153764 learned_addr learned my addr 172.21.15.112:0/221153764 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:48.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.335+0000 7fa165e00640 1 --2- 172.21.15.112:0/221153764 >> v2:172.21.15.137:3300/0 conn(0x7fa168144890 0x7fa1680b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:48.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.336+0000 7fa165400640 1 -- 172.21.15.112:0/221153764 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 667149688 0 0) 0x7fa16806eed0 con 0x7fa1680b4140 2024-09-12T02:48:48.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.336+0000 7fa165400640 1 -- 172.21.15.112:0/221153764 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa14c003520 con 0x7fa1680b4140 2024-09-12T02:48:48.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.336+0000 7fa165e00640 1 -- 172.21.15.112:0/221153764 >> v1:172.21.15.137:6789/0 conn(0x7fa1681602f0 legacy=0x7fa1680b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:48.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.336+0000 7fa165e00640 1 -- 172.21.15.112:0/221153764 >> v1:172.21.15.112:6789/0 conn(0x7fa1680b4140 legacy=0x7fa1680ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:48.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.336+0000 7fa165400640 1 -- 172.21.15.112:0/221153764 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4194842341 0 0) 0x7fa14c003520 con 0x7fa1680b4140 2024-09-12T02:48:48.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.336+0000 7fa165e00640 1 -- 172.21.15.112:0/221153764 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa16815faf0 con 0x7fa168144890 2024-09-12T02:48:48.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.337+0000 7fa165e00640 1 --2- 172.21.15.112:0/221153764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa168144890 0x7fa1680b58c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa1580097a0 tx=0x7fa15802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32f48d94df24e3a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:48.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.337+0000 7fa165400640 1 -- 172.21.15.112:0/221153764 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa158037070 con 0x7fa168144890 2024-09-12T02:48:48.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.337+0000 7fa165400640 1 -- 172.21.15.112:0/221153764 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa158032440 con 0x7fa168144890 2024-09-12T02:48:48.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.337+0000 7fa165400640 1 -- 172.21.15.112:0/221153764 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1580327f0 con 0x7fa168144890 2024-09-12T02:48:48.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.338+0000 7fa16ca00640 1 -- 172.21.15.112:0/221153764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa168144890 msgr2=0x7fa1680b58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:48.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.338+0000 7fa16ca00640 1 --2- 172.21.15.112:0/221153764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa168144890 0x7fa1680b58c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa1580097a0 tx=0x7fa15802a230 comp rx=0 tx=0).stop 2024-09-12T02:48:48.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.338+0000 7fa16ca00640 1 -- 172.21.15.112:0/221153764 shutdown_connections 2024-09-12T02:48:48.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.338+0000 7fa16ca00640 1 --2- 172.21.15.112:0/221153764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa168144890 0x7fa1680b58c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:48.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.338+0000 7fa16ca00640 1 -- 172.21.15.112:0/221153764 >> 172.21.15.112:0/221153764 conn(0x7fa1680b2730 msgr2=0x7fa1680b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:48.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.338+0000 7fa16ca00640 1 -- 172.21.15.112:0/221153764 shutdown_connections 2024-09-12T02:48:48.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.338+0000 7fa16ca00640 1 -- 172.21.15.112:0/221153764 wait complete. 2024-09-12T02:48:48.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.339+0000 7fa16ca00640 1 Processor -- start 2024-09-12T02:48:48.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.340+0000 7fa16ca00640 1 -- start start 2024-09-12T02:48:48.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.340+0000 7fa16ca00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1680b4140 0x7fa1680cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:48.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.341+0000 7fa16ca00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa168144890 0x7fa16813c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:48.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.341+0000 7fa16ca00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa1681602f0 0x7fa168141db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:48.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.341+0000 7fa16ca00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa168144df0 con 0x7fa168144890 2024-09-12T02:48:48.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.341+0000 7fa16ca00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa168144c70 con 0x7fa1680b4140 2024-09-12T02:48:48.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.341+0000 7fa16ca00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa1680b3290 con 0x7fa1681602f0 2024-09-12T02:48:48.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.341+0000 7fa15fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa168144890 0x7fa16813c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:48.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.341+0000 7fa15fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa168144890 0x7fa16813c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38788/0 (socket says 172.21.15.112:38788) 2024-09-12T02:48:48.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.341+0000 7fa15fe00640 1 -- 172.21.15.112:0/1268419167 learned_addr learned my addr 172.21.15.112:0/1268419167 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:48.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.341+0000 7fa166800640 1 --2- 172.21.15.112:0/1268419167 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa1681602f0 0x7fa168141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:48.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.341+0000 7fa165e00640 1 --2- 172.21.15.112:0/1268419167 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1680b4140 0x7fa1680cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:48.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.341+0000 7fa15fe00640 1 -- 172.21.15.112:0/1268419167 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa1681602f0 msgr2=0x7fa168141db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:48.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.341+0000 7fa15fe00640 1 --2- 172.21.15.112:0/1268419167 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa1681602f0 0x7fa168141db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:48.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.341+0000 7fa15fe00640 1 -- 172.21.15.112:0/1268419167 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1680b4140 msgr2=0x7fa1680cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:48.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.341+0000 7fa15fe00640 1 --2- 172.21.15.112:0/1268419167 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1680b4140 0x7fa1680cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:48.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.341+0000 7fa15fe00640 1 -- 172.21.15.112:0/1268419167 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa16815efb0 con 0x7fa168144890 2024-09-12T02:48:48.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.342+0000 7fa15fe00640 1 --2- 172.21.15.112:0/1268419167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa168144890 0x7fa16813c3c0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fa15000c3f0 tx=0x7fa15000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:48.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.342+0000 7fa15e000640 1 -- 172.21.15.112:0/1268419167 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa150017070 con 0x7fa168144890 2024-09-12T02:48:48.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.342+0000 7fa15e000640 1 -- 172.21.15.112:0/1268419167 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1500052f0 con 0x7fa168144890 2024-09-12T02:48:48.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.342+0000 7fa16ca00640 1 -- 172.21.15.112:0/1268419167 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1680cc570 con 0x7fa168144890 2024-09-12T02:48:48.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.342+0000 7fa15e000640 1 -- 172.21.15.112:0/1268419167 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa150003830 con 0x7fa168144890 2024-09-12T02:48:48.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.342+0000 7fa16ca00640 1 -- 172.21.15.112:0/1268419167 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1680cabd0 con 0x7fa168144890 2024-09-12T02:48:48.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.343+0000 7fa16ca00640 1 -- 172.21.15.112:0/1268419167 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1680b58c0 con 0x7fa168144890 2024-09-12T02:48:48.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.344+0000 7fa15e000640 1 -- 172.21.15.112:0/1268419167 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa15001a070 con 0x7fa168144890 2024-09-12T02:48:48.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.345+0000 7fa15e000640 1 --2- 172.21.15.112:0/1268419167 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa14406be30 0x7fa14406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:48.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.345+0000 7fa15e000640 1 -- 172.21.15.112:0/1268419167 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 4857+0+0 (secure 0 0 0) 0x7fa150089db0 con 0x7fa168144890 2024-09-12T02:48:48.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.346+0000 7fa165e00640 1 --2- 172.21.15.112:0/1268419167 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa14406be30 0x7fa14406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:48.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.346+0000 7fa165e00640 1 --2- 172.21.15.112:0/1268419167 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa14406be30 0x7fa14406e2f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa158034000 tx=0x7fa15802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:48.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.350+0000 7fa15e000640 1 -- 172.21.15.112:0/1268419167 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa15008e070 con 0x7fa168144890 2024-09-12T02:48:48.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:48.524+0000 7fa16ca00640 1 -- 172.21.15.112:0/1268419167 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fa16806e340 con 0x7fa168144890 2024-09-12T02:48:49.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.374+0000 7fa15e000640 1 -- 172.21.15.112:0/1268419167 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v147) ==== 138+0+0 (secure 0 0 0) 0x7fa150058450 con 0x7fa168144890 2024-09-12T02:48:49.375 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' created 2024-09-12T02:48:49.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.377+0000 7fa16ca00640 1 -- 172.21.15.112:0/1268419167 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa14406be30 msgr2=0x7fa14406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:49.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.377+0000 7fa16ca00640 1 --2- 172.21.15.112:0/1268419167 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa14406be30 0x7fa14406e2f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa158034000 tx=0x7fa15802e000 comp rx=0 tx=0).stop 2024-09-12T02:48:49.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.377+0000 7fa16ca00640 1 -- 172.21.15.112:0/1268419167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa168144890 msgr2=0x7fa16813c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:49.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.377+0000 7fa16ca00640 1 --2- 172.21.15.112:0/1268419167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa168144890 0x7fa16813c3c0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fa15000c3f0 tx=0x7fa15000c8b0 comp rx=0 tx=0).stop 2024-09-12T02:48:49.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.378+0000 7fa16ca00640 1 -- 172.21.15.112:0/1268419167 shutdown_connections 2024-09-12T02:48:49.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.378+0000 7fa16ca00640 1 --2- 172.21.15.112:0/1268419167 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa1681602f0 0x7fa168141db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:49.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.378+0000 7fa16ca00640 1 --2- 172.21.15.112:0/1268419167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa168144890 0x7fa16813c3c0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:49.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.378+0000 7fa16ca00640 1 --2- 172.21.15.112:0/1268419167 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa14406be30 0x7fa14406e2f0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:49.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.378+0000 7fa16ca00640 1 --2- 172.21.15.112:0/1268419167 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1680b4140 0x7fa1680cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:49.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.378+0000 7fa16ca00640 1 -- 172.21.15.112:0/1268419167 >> 172.21.15.112:0/1268419167 conn(0x7fa1680b2730 msgr2=0x7fa1680b0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:49.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.378+0000 7fa16ca00640 1 -- 172.21.15.112:0/1268419167 shutdown_connections 2024-09-12T02:48:49.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.378+0000 7fa16ca00640 1 -- 172.21.15.112:0/1268419167 wait complete. 2024-09-12T02:48:49.398 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:48:49.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.561+0000 7f98ab200640 1 Processor -- start 2024-09-12T02:48:49.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.561+0000 7f98ab200640 1 -- start start 2024-09-12T02:48:49.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.562+0000 7f98ab200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98ac1465b0 0x7f98ac0b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:49.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.562+0000 7f98ab200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f98ac0b3f00 0x7f98ac0b5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:49.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.562+0000 7f98ab200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f98ac0b5ab0 0x7f98ac160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:49.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.562+0000 7f98ab200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f98ac0b5f20 con 0x7f98ac0b5ab0 2024-09-12T02:48:49.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.562+0000 7f98ab200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f98ac0b4480 con 0x7f98ac0b3f00 2024-09-12T02:48:49.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.562+0000 7f98ab200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f98ac0b4760 con 0x7f98ac1465b0 2024-09-12T02:48:49.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.562+0000 7f98aa800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f98ac0b5ab0 0x7f98ac160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:49.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.562+0000 7f98aa800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f98ac0b5ab0 0x7f98ac160540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38796/0 (socket says 172.21.15.112:38796) 2024-09-12T02:48:49.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.562+0000 7f98aa800640 1 -- 172.21.15.112:0/2155533960 learned_addr learned my addr 172.21.15.112:0/2155533960 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:49.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.562+0000 7f98a9e00640 1 --2- 172.21.15.112:0/2155533960 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98ac1465b0 0x7f98ac0b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:49.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.562+0000 7f98a9400640 1 --2- 172.21.15.112:0/2155533960 >> v2:172.21.15.137:3300/0 conn(0x7f98ac0b3f00 0x7f98ac0b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:49.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.563+0000 7f98aa800640 1 -- 172.21.15.112:0/2155533960 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98ac1465b0 msgr2=0x7f98ac0b39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:49.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.563+0000 7f98aa800640 1 --2- 172.21.15.112:0/2155533960 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98ac1465b0 0x7f98ac0b39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:49.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.563+0000 7f98aa800640 1 -- 172.21.15.112:0/2155533960 >> v2:172.21.15.137:3300/0 conn(0x7f98ac0b3f00 msgr2=0x7f98ac0b5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:49.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.563+0000 7f98aa800640 1 --2- 172.21.15.112:0/2155533960 >> v2:172.21.15.137:3300/0 conn(0x7f98ac0b3f00 0x7f98ac0b5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:49.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.563+0000 7f98aa800640 1 -- 172.21.15.112:0/2155533960 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98ac0b4a40 con 0x7f98ac0b5ab0 2024-09-12T02:48:49.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.564+0000 7f98aa800640 1 --2- 172.21.15.112:0/2155533960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98ac0b5ab0 0x7f98ac160540 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f98ac0686e0 tx=0x7f98a402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e767c1c4fc2c63a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:49.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.564+0000 7f98a8a00640 1 -- 172.21.15.112:0/2155533960 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a4037070 con 0x7f98ac0b5ab0 2024-09-12T02:48:49.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.564+0000 7f98a8a00640 1 -- 172.21.15.112:0/2155533960 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98a4032440 con 0x7f98ac0b5ab0 2024-09-12T02:48:49.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.564+0000 7f98a8a00640 1 -- 172.21.15.112:0/2155533960 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a4032810 con 0x7f98ac0b5ab0 2024-09-12T02:48:49.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.564+0000 7f98ab200640 1 -- 172.21.15.112:0/2155533960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98ac0b5ab0 msgr2=0x7f98ac160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:49.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.564+0000 7f98ab200640 1 --2- 172.21.15.112:0/2155533960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98ac0b5ab0 0x7f98ac160540 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f98ac0686e0 tx=0x7f98a402a1e0 comp rx=0 tx=0).stop 2024-09-12T02:48:49.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.564+0000 7f98ab200640 1 -- 172.21.15.112:0/2155533960 shutdown_connections 2024-09-12T02:48:49.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.564+0000 7f98ab200640 1 --2- 172.21.15.112:0/2155533960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98ac0b5ab0 0x7f98ac160540 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:49.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.564+0000 7f98ab200640 1 --2- 172.21.15.112:0/2155533960 >> v2:172.21.15.137:3300/0 conn(0x7f98ac0b3f00 0x7f98ac0b5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:49.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.564+0000 7f98ab200640 1 --2- 172.21.15.112:0/2155533960 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98ac1465b0 0x7f98ac0b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:49.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.564+0000 7f98ab200640 1 -- 172.21.15.112:0/2155533960 >> 172.21.15.112:0/2155533960 conn(0x7f98ac0b26c0 msgr2=0x7f98ac0b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:49.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.565+0000 7f98ab200640 1 -- 172.21.15.112:0/2155533960 shutdown_connections 2024-09-12T02:48:49.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.565+0000 7f98ab200640 1 -- 172.21.15.112:0/2155533960 wait complete. 2024-09-12T02:48:49.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.566+0000 7f98ab200640 1 Processor -- start 2024-09-12T02:48:49.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.566+0000 7f98ab200640 1 -- start start 2024-09-12T02:48:49.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.567+0000 7f98ab200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98ac0b3f00 0x7f98ac0cf220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:49.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.567+0000 7f98ab200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98ac0b5ab0 0x7f98ac0af900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:49.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.567+0000 7f98ab200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98ac1465b0 0x7f98ac0d0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:49.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.567+0000 7f98ab200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f98ac0cd5d0 con 0x7f98ac0b3f00 2024-09-12T02:48:49.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.567+0000 7f98ab200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f98ac0b4d20 con 0x7f98ac1465b0 2024-09-12T02:48:49.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.567+0000 7f98ab200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f98ac160a80 con 0x7f98ac0b5ab0 2024-09-12T02:48:49.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.567+0000 7f98a9e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98ac0b3f00 0x7f98ac0cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:49.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.567+0000 7f98a9e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98ac0b3f00 0x7f98ac0cf220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38810/0 (socket says 172.21.15.112:38810) 2024-09-12T02:48:49.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.567+0000 7f98a9e00640 1 -- 172.21.15.112:0/2273967453 learned_addr learned my addr 172.21.15.112:0/2273967453 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:49.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.568+0000 7f98aa800640 1 --2- 172.21.15.112:0/2273967453 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98ac1465b0 0x7f98ac0d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:49.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.568+0000 7f98a9400640 1 --2- 172.21.15.112:0/2273967453 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98ac0b5ab0 0x7f98ac0af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:49.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.568+0000 7f98a9e00640 1 -- 172.21.15.112:0/2273967453 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98ac0b5ab0 msgr2=0x7f98ac0af900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:49.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.568+0000 7f98a9e00640 1 --2- 172.21.15.112:0/2273967453 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98ac0b5ab0 0x7f98ac0af900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:49.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.568+0000 7f98a9e00640 1 -- 172.21.15.112:0/2273967453 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98ac1465b0 msgr2=0x7f98ac0d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:49.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.568+0000 7f98a9e00640 1 --2- 172.21.15.112:0/2273967453 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98ac1465b0 0x7f98ac0d0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:49.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.568+0000 7f98a9e00640 1 -- 172.21.15.112:0/2273967453 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98ac1f49f0 con 0x7f98ac0b3f00 2024-09-12T02:48:49.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.568+0000 7f98a9e00640 1 --2- 172.21.15.112:0/2273967453 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98ac0b3f00 0x7f98ac0cf220 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f989c009d10 tx=0x7f989c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:49.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.568+0000 7f98a2000640 1 -- 172.21.15.112:0/2273967453 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989c018020 con 0x7f98ac0b3f00 2024-09-12T02:48:49.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.568+0000 7f98a2000640 1 -- 172.21.15.112:0/2273967453 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f989c014480 con 0x7f98ac0b3f00 2024-09-12T02:48:49.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.568+0000 7f98a2000640 1 -- 172.21.15.112:0/2273967453 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989c014830 con 0x7f98ac0b3f00 2024-09-12T02:48:49.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.568+0000 7f98ab200640 1 -- 172.21.15.112:0/2273967453 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98ac1f4cd0 con 0x7f98ac0b3f00 2024-09-12T02:48:49.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.569+0000 7f98ab200640 1 -- 172.21.15.112:0/2273967453 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98ac1f5290 con 0x7f98ac0b3f00 2024-09-12T02:48:49.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.570+0000 7f98ab200640 1 -- 172.21.15.112:0/2273967453 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98ac160540 con 0x7f98ac0b3f00 2024-09-12T02:48:49.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.570+0000 7f98a2000640 1 -- 172.21.15.112:0/2273967453 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f989c005d10 con 0x7f98ac0b3f00 2024-09-12T02:48:49.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.571+0000 7f98a2000640 1 --2- 172.21.15.112:0/2273967453 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f988c06be30 0x7f988c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:49.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.571+0000 7f98a2000640 1 -- 172.21.15.112:0/2273967453 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5227+0+0 (secure 0 0 0) 0x7f989c08b770 con 0x7f98ac0b3f00 2024-09-12T02:48:49.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.572+0000 7f98a9400640 1 --2- 172.21.15.112:0/2273967453 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f988c06be30 0x7f988c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:49.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.572+0000 7f98a9400640 1 --2- 172.21.15.112:0/2273967453 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f988c06be30 0x7f988c06e2f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f98ac0af140 tx=0x7f9898008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:49.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.576+0000 7f98a2000640 1 -- 172.21.15.112:0/2273967453 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f989c022070 con 0x7f98ac0b3f00 2024-09-12T02:48:49.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:49.748+0000 7f98ab200640 1 -- 172.21.15.112:0/2273967453 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f98ac0aebb0 con 0x7f98ac0b3f00 2024-09-12T02:48:50.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.378+0000 7f98a2000640 1 -- 172.21.15.112:0/2273967453 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v148) ==== 170+0+0 (secure 0 0 0) 0x7f989c010040 con 0x7f98ac0b3f00 2024-09-12T02:48:50.378 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' created 2024-09-12T02:48:50.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.381+0000 7f98ab200640 1 -- 172.21.15.112:0/2273967453 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f988c06be30 msgr2=0x7f988c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:50.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.381+0000 7f98ab200640 1 --2- 172.21.15.112:0/2273967453 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f988c06be30 0x7f988c06e2f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f98ac0af140 tx=0x7f9898008040 comp rx=0 tx=0).stop 2024-09-12T02:48:50.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.381+0000 7f98ab200640 1 -- 172.21.15.112:0/2273967453 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98ac0b3f00 msgr2=0x7f98ac0cf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:50.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.381+0000 7f98ab200640 1 --2- 172.21.15.112:0/2273967453 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98ac0b3f00 0x7f98ac0cf220 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f989c009d10 tx=0x7f989c00c490 comp rx=0 tx=0).stop 2024-09-12T02:48:50.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.382+0000 7f98ab200640 1 -- 172.21.15.112:0/2273967453 shutdown_connections 2024-09-12T02:48:50.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.382+0000 7f98ab200640 1 --2- 172.21.15.112:0/2273967453 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f988c06be30 0x7f988c06e2f0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.382+0000 7f98ab200640 1 --2- 172.21.15.112:0/2273967453 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98ac1465b0 0x7f98ac0d0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.382+0000 7f98ab200640 1 --2- 172.21.15.112:0/2273967453 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98ac0b5ab0 0x7f98ac0af900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.382+0000 7f98ab200640 1 --2- 172.21.15.112:0/2273967453 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98ac0b3f00 0x7f98ac0cf220 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.382+0000 7f98ab200640 1 -- 172.21.15.112:0/2273967453 >> 172.21.15.112:0/2273967453 conn(0x7f98ac0b26c0 msgr2=0x7f98ac0b1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:50.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.382+0000 7f98ab200640 1 -- 172.21.15.112:0/2273967453 shutdown_connections 2024-09-12T02:48:50.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.383+0000 7f98ab200640 1 -- 172.21.15.112:0/2273967453 wait complete. 2024-09-12T02:48:50.411 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T02:48:50.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.571+0000 7faf90c00640 1 Processor -- start 2024-09-12T02:48:50.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.571+0000 7faf90c00640 1 -- start start 2024-09-12T02:48:50.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.572+0000 7faf90c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7faf8c0b3e00 0x7faf8c0d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:50.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.572+0000 7faf90c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7faf8c0b1d70 0x7faf8c0b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:50.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.572+0000 7faf90c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf8c0d2fb0 con 0x7faf8c0d1710 2024-09-12T02:48:50.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.572+0000 7faf90c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7faf8c0d3cb0 con 0x7faf8c0b3e00 2024-09-12T02:48:50.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.572+0000 7faf90c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7faf8c0d0b60 con 0x7faf8c0b1d70 2024-09-12T02:48:50.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.572+0000 7faf8aa00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7faf8c0b3e00 0x7faf8c0d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:50.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.572+0000 7faf8aa00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7faf8c0b3e00 0x7faf8c0d28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38818/0 (socket says 172.21.15.112:38818) 2024-09-12T02:48:50.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.572+0000 7faf8aa00640 1 -- 172.21.15.112:0/2846715674 learned_addr learned my addr 172.21.15.112:0/2846715674 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:50.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.573+0000 7faf8be00640 1 --2- 172.21.15.112:0/2846715674 >> v2:172.21.15.137:3300/0 conn(0x7faf8c0b1d70 0x7faf8c0b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:50.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.573+0000 7faf8aa00640 1 -- 172.21.15.112:0/2846715674 >> v2:172.21.15.137:3300/0 conn(0x7faf8c0b1d70 msgr2=0x7faf8c0b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:50.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.573+0000 7faf8aa00640 1 --2- 172.21.15.112:0/2846715674 >> v2:172.21.15.137:3300/0 conn(0x7faf8c0b1d70 0x7faf8c0b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.573+0000 7faf8aa00640 1 -- 172.21.15.112:0/2846715674 >> v1:172.21.15.137:6789/0 conn(0x7faf8c0d1710 legacy=0x7faf8c0d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:50.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.573+0000 7faf8aa00640 1 -- 172.21.15.112:0/2846715674 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf8c0d3410 con 0x7faf8c0b3e00 2024-09-12T02:48:50.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.574+0000 7faf8aa00640 1 --2- 172.21.15.112:0/2846715674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf8c0b3e00 0x7faf8c0d28d0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7faf8c08ef20 tx=0x7faf7802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f5a77edfb872f43 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:50.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.574+0000 7faf8a000640 1 -- 172.21.15.112:0/2846715674 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf78037070 con 0x7faf8c0b3e00 2024-09-12T02:48:50.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.574+0000 7faf8a000640 1 -- 172.21.15.112:0/2846715674 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf78032440 con 0x7faf8c0b3e00 2024-09-12T02:48:50.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.574+0000 7faf8a000640 1 -- 172.21.15.112:0/2846715674 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf78032810 con 0x7faf8c0b3e00 2024-09-12T02:48:50.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.575+0000 7faf90c00640 1 -- 172.21.15.112:0/2846715674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf8c0b3e00 msgr2=0x7faf8c0d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:50.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.575+0000 7faf90c00640 1 --2- 172.21.15.112:0/2846715674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf8c0b3e00 0x7faf8c0d28d0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7faf8c08ef20 tx=0x7faf7802a270 comp rx=0 tx=0).stop 2024-09-12T02:48:50.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.575+0000 7faf90c00640 1 -- 172.21.15.112:0/2846715674 shutdown_connections 2024-09-12T02:48:50.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.575+0000 7faf90c00640 1 --2- 172.21.15.112:0/2846715674 >> v2:172.21.15.137:3300/0 conn(0x7faf8c0b1d70 0x7faf8c0b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.575+0000 7faf90c00640 1 --2- 172.21.15.112:0/2846715674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf8c0b3e00 0x7faf8c0d28d0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.575+0000 7faf90c00640 1 -- 172.21.15.112:0/2846715674 >> 172.21.15.112:0/2846715674 conn(0x7faf8c09e030 msgr2=0x7faf8c0d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:50.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.575+0000 7faf90c00640 1 -- 172.21.15.112:0/2846715674 shutdown_connections 2024-09-12T02:48:50.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.575+0000 7faf90c00640 1 -- 172.21.15.112:0/2846715674 wait complete. 2024-09-12T02:48:50.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.577+0000 7faf90c00640 1 Processor -- start 2024-09-12T02:48:50.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.577+0000 7faf90c00640 1 -- start start 2024-09-12T02:48:50.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.578+0000 7faf90c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf8c0b1d70 0x7faf8c158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:50.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.578+0000 7faf90c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faf8c0b3e00 0x7faf8c0b8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:50.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.578+0000 7faf90c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf8c0d1710 0x7faf8c161da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:50.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.578+0000 7faf90c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c15f110 con 0x7faf8c0b1d70 2024-09-12T02:48:50.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.578+0000 7faf90c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c0d39d0 con 0x7faf8c0d1710 2024-09-12T02:48:50.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.578+0000 7faf90c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7faf8c15f290 con 0x7faf8c0b3e00 2024-09-12T02:48:50.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.578+0000 7faf8b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf8c0b1d70 0x7faf8c158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:50.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.578+0000 7faf8b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf8c0b1d70 0x7faf8c158160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38830/0 (socket says 172.21.15.112:38830) 2024-09-12T02:48:50.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.578+0000 7faf8b400640 1 -- 172.21.15.112:0/3685814968 learned_addr learned my addr 172.21.15.112:0/3685814968 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:50.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.578+0000 7faf8be00640 1 --2- 172.21.15.112:0/3685814968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf8c0d1710 0x7faf8c161da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:50.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.578+0000 7faf8aa00640 1 --2- 172.21.15.112:0/3685814968 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faf8c0b3e00 0x7faf8c0b8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:50.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.578+0000 7faf8b400640 1 -- 172.21.15.112:0/3685814968 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faf8c0b3e00 msgr2=0x7faf8c0b8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:50.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.578+0000 7faf8b400640 1 --2- 172.21.15.112:0/3685814968 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faf8c0b3e00 0x7faf8c0b8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.578+0000 7faf8b400640 1 -- 172.21.15.112:0/3685814968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf8c0d1710 msgr2=0x7faf8c161da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:50.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.578+0000 7faf8b400640 1 --2- 172.21.15.112:0/3685814968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf8c0d1710 0x7faf8c161da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:50.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.578+0000 7faf8b400640 1 -- 172.21.15.112:0/3685814968 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf8c0cd070 con 0x7faf8c0b1d70 2024-09-12T02:48:50.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.579+0000 7faf8b400640 1 --2- 172.21.15.112:0/3685814968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf8c0b1d70 0x7faf8c158160 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00c3c0 tx=0x7faf7c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:50.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.579+0000 7faf83400640 1 -- 172.21.15.112:0/3685814968 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c0052d0 con 0x7faf8c0b1d70 2024-09-12T02:48:50.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.579+0000 7faf83400640 1 -- 172.21.15.112:0/3685814968 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf7c005490 con 0x7faf8c0b1d70 2024-09-12T02:48:50.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.579+0000 7faf90c00640 1 -- 172.21.15.112:0/3685814968 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf8c0cd350 con 0x7faf8c0b1d70 2024-09-12T02:48:50.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.579+0000 7faf83400640 1 -- 172.21.15.112:0/3685814968 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c007260 con 0x7faf8c0b1d70 2024-09-12T02:48:50.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.579+0000 7faf90c00640 1 -- 172.21.15.112:0/3685814968 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf8c0cd910 con 0x7faf8c0b1d70 2024-09-12T02:48:50.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.580+0000 7faf90c00640 1 -- 172.21.15.112:0/3685814968 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf8c073ea0 con 0x7faf8c0b1d70 2024-09-12T02:48:50.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.581+0000 7faf83400640 1 -- 172.21.15.112:0/3685814968 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faf7c007400 con 0x7faf8c0b1d70 2024-09-12T02:48:50.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.582+0000 7faf83400640 1 --2- 172.21.15.112:0/3685814968 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7faf6c06be30 0x7faf6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:50.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.583+0000 7faf83400640 1 -- 172.21.15.112:0/3685814968 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 5609+0+0 (secure 0 0 0) 0x7faf7c08a220 con 0x7faf8c0b1d70 2024-09-12T02:48:50.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.583+0000 7faf8aa00640 1 --2- 172.21.15.112:0/3685814968 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7faf6c06be30 0x7faf6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:50.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.583+0000 7faf8aa00640 1 --2- 172.21.15.112:0/3685814968 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7faf6c06be30 0x7faf6c06e2f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7faf78034000 tx=0x7faf7802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:50.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.587+0000 7faf83400640 1 -- 172.21.15.112:0/3685814968 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faf8c073ea0 con 0x7faf8c0b1d70 2024-09-12T02:48:50.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:50.791+0000 7faf90c00640 1 -- 172.21.15.112:0/3685814968 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7faf8c0d2060 con 0x7faf8c0b1d70 2024-09-12T02:48:51.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.403+0000 7faf83400640 1 -- 172.21.15.112:0/3685814968 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v74) ==== 174+0+0 (secure 0 0 0) 0x7faf8c0d2060 con 0x7faf8c0b1d70 2024-09-12T02:48:51.408 INFO:teuthology.orchestra.run.smithi112.stderr:new fs with metadata pool 18 and data pool 19 2024-09-12T02:48:51.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.411+0000 7faf90c00640 1 -- 172.21.15.112:0/3685814968 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7faf6c06be30 msgr2=0x7faf6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:51.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.411+0000 7faf90c00640 1 --2- 172.21.15.112:0/3685814968 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7faf6c06be30 0x7faf6c06e2f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7faf78034000 tx=0x7faf7802e000 comp rx=0 tx=0).stop 2024-09-12T02:48:51.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.411+0000 7faf90c00640 1 -- 172.21.15.112:0/3685814968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf8c0b1d70 msgr2=0x7faf8c158160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:51.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.411+0000 7faf90c00640 1 --2- 172.21.15.112:0/3685814968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf8c0b1d70 0x7faf8c158160 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00c3c0 tx=0x7faf7c00c880 comp rx=0 tx=0).stop 2024-09-12T02:48:51.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.413+0000 7faf90c00640 1 -- 172.21.15.112:0/3685814968 shutdown_connections 2024-09-12T02:48:51.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.413+0000 7faf90c00640 1 --2- 172.21.15.112:0/3685814968 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7faf6c06be30 0x7faf6c06e2f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:51.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.413+0000 7faf90c00640 1 --2- 172.21.15.112:0/3685814968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf8c0d1710 0x7faf8c161da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:51.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.413+0000 7faf90c00640 1 --2- 172.21.15.112:0/3685814968 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faf8c0b3e00 0x7faf8c0b8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:51.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.413+0000 7faf90c00640 1 --2- 172.21.15.112:0/3685814968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf8c0b1d70 0x7faf8c158160 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:51.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.413+0000 7faf90c00640 1 -- 172.21.15.112:0/3685814968 >> 172.21.15.112:0/3685814968 conn(0x7faf8c09e030 msgr2=0x7faf8c0cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:51.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.413+0000 7faf90c00640 1 -- 172.21.15.112:0/3685814968 shutdown_connections 2024-09-12T02:48:51.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.413+0000 7faf90c00640 1 -- 172.21.15.112:0/3685814968 wait complete. 2024-09-12T02:48:51.434 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:48:51.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.587+0000 7f8dcc800640 1 Processor -- start 2024-09-12T02:48:51.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.588+0000 7f8dcc800640 1 -- start start 2024-09-12T02:48:51.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.589+0000 7f8dcc800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8dc40b4ec0 0x7f8dc40b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:51.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.589+0000 7f8dcc800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dc40b54a0 con 0x7f8dc406f600 2024-09-12T02:48:51.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.589+0000 7f8dcc800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dc40b3af0 con 0x7f8dc415b9d0 2024-09-12T02:48:51.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.589+0000 7f8dcc800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8dc40b3dd0 con 0x7f8dc40b4ec0 2024-09-12T02:48:51.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.589+0000 7f8dca800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8dc40b4ec0 0x7f8dc40b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:51.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.589+0000 7f8dc9400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8dc406f600 0x7f8dc40cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48376/0 (socket says 172.21.15.112:48376) 2024-09-12T02:48:51.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.589+0000 7f8dc9400640 1 -- 172.21.15.112:0/2989289172 learned_addr learned my addr 172.21.15.112:0/2989289172 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:51.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.590+0000 7f8dca800640 1 -- 172.21.15.112:0/2989289172 >> v1:172.21.15.137:6789/0 conn(0x7f8dc415b9d0 legacy=0x7f8dc406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:51.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.590+0000 7f8dca800640 1 -- 172.21.15.112:0/2989289172 >> v1:172.21.15.112:6789/0 conn(0x7f8dc406f600 legacy=0x7f8dc40cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:51.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.590+0000 7f8dca800640 1 -- 172.21.15.112:0/2989289172 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc40b40b0 con 0x7f8dc40b4ec0 2024-09-12T02:48:51.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.591+0000 7f8dca800640 1 --2- 172.21.15.112:0/2989289172 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dc40b4ec0 0x7f8dc40b45d0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0009d90 tx=0x7f8dc002c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bf8d19e89326a50 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:51.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.591+0000 7f8dc8a00640 1 -- 172.21.15.112:0/2989289172 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc0032770 con 0x7f8dc40b4ec0 2024-09-12T02:48:51.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.591+0000 7f8dc8a00640 1 -- 172.21.15.112:0/2989289172 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dc0038070 con 0x7f8dc40b4ec0 2024-09-12T02:48:51.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.591+0000 7f8dc8a00640 1 -- 172.21.15.112:0/2989289172 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc0032b30 con 0x7f8dc40b4ec0 2024-09-12T02:48:51.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.591+0000 7f8dcc800640 1 -- 172.21.15.112:0/2989289172 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dc40b4ec0 msgr2=0x7f8dc40b45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:51.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.591+0000 7f8dcc800640 1 --2- 172.21.15.112:0/2989289172 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dc40b4ec0 0x7f8dc40b45d0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0009d90 tx=0x7f8dc002c870 comp rx=0 tx=0).stop 2024-09-12T02:48:51.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.591+0000 7f8dcc800640 1 -- 172.21.15.112:0/2989289172 shutdown_connections 2024-09-12T02:48:51.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.591+0000 7f8dcc800640 1 --2- 172.21.15.112:0/2989289172 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dc40b4ec0 0x7f8dc40b45d0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:51.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.591+0000 7f8dcc800640 1 -- 172.21.15.112:0/2989289172 >> 172.21.15.112:0/2989289172 conn(0x7f8dc406bbd0 msgr2=0x7f8dc406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:51.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.592+0000 7f8dcc800640 1 -- 172.21.15.112:0/2989289172 shutdown_connections 2024-09-12T02:48:51.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.592+0000 7f8dcc800640 1 -- 172.21.15.112:0/2989289172 wait complete. 2024-09-12T02:48:51.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.593+0000 7f8dcc800640 1 Processor -- start 2024-09-12T02:48:51.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.593+0000 7f8dcc800640 1 -- start start 2024-09-12T02:48:51.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.594+0000 7f8dcc800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8dc406f600 0x7f8dc4156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:51.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.594+0000 7f8dcc800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dc40b4ec0 0x7f8dc4154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:51.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.594+0000 7f8dcc800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8dc415b9d0 0x7f8dc4151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:51.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.594+0000 7f8dcc800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc4072a40 con 0x7f8dc40b4ec0 2024-09-12T02:48:51.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.594+0000 7f8dcc800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc40728c0 con 0x7f8dc415b9d0 2024-09-12T02:48:51.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.594+0000 7f8dcc800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8dc4072bc0 con 0x7f8dc406f600 2024-09-12T02:48:51.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.594+0000 7f8dc9400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dc40b4ec0 0x7f8dc4154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:51.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.594+0000 7f8dc9400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dc40b4ec0 0x7f8dc4154d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38852/0 (socket says 172.21.15.112:38852) 2024-09-12T02:48:51.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.594+0000 7f8dc9400640 1 -- 172.21.15.112:0/1356190810 learned_addr learned my addr 172.21.15.112:0/1356190810 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:51.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.595+0000 7f8dca800640 1 --2- 172.21.15.112:0/1356190810 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8dc415b9d0 0x7f8dc4151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:51.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.595+0000 7f8dc9e00640 1 --2- 172.21.15.112:0/1356190810 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8dc406f600 0x7f8dc4156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:51.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.595+0000 7f8dc9400640 1 -- 172.21.15.112:0/1356190810 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8dc406f600 msgr2=0x7f8dc4156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:51.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.595+0000 7f8dc9400640 1 --2- 172.21.15.112:0/1356190810 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8dc406f600 0x7f8dc4156e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:51.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.595+0000 7f8dc9400640 1 -- 172.21.15.112:0/1356190810 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8dc415b9d0 msgr2=0x7f8dc4151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:51.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.595+0000 7f8dc9400640 1 --2- 172.21.15.112:0/1356190810 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8dc415b9d0 0x7f8dc4151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:51.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.595+0000 7f8dc9400640 1 -- 172.21.15.112:0/1356190810 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc4157520 con 0x7f8dc40b4ec0 2024-09-12T02:48:51.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.595+0000 7f8dc9400640 1 --2- 172.21.15.112:0/1356190810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dc40b4ec0 0x7f8dc4154d60 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f8db400c400 tx=0x7f8db400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:51.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.595+0000 7f8dbe000640 1 -- 172.21.15.112:0/1356190810 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db4017070 con 0x7f8dc40b4ec0 2024-09-12T02:48:51.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.595+0000 7f8dbe000640 1 -- 172.21.15.112:0/1356190810 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8db40074e0 con 0x7f8dc40b4ec0 2024-09-12T02:48:51.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.595+0000 7f8dbe000640 1 -- 172.21.15.112:0/1356190810 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db40059c0 con 0x7f8dc40b4ec0 2024-09-12T02:48:51.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.595+0000 7f8dcc800640 1 -- 172.21.15.112:0/1356190810 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dc4157800 con 0x7f8dc40b4ec0 2024-09-12T02:48:51.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.596+0000 7f8dcc800640 1 -- 172.21.15.112:0/1356190810 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dc4157dc0 con 0x7f8dc40b4ec0 2024-09-12T02:48:51.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.597+0000 7f8dcc800640 1 -- 172.21.15.112:0/1356190810 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dc4068a30 con 0x7f8dc40b4ec0 2024-09-12T02:48:51.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.597+0000 7f8dbe000640 1 -- 172.21.15.112:0/1356190810 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8db401a070 con 0x7f8dc40b4ec0 2024-09-12T02:48:51.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.598+0000 7f8dbe000640 1 --2- 172.21.15.112:0/1356190810 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8da806be30 0x7f8da806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:51.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.598+0000 7f8dbe000640 1 -- 172.21.15.112:0/1356190810 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5709+0+0 (secure 0 0 0) 0x7f8db408a160 con 0x7f8dc40b4ec0 2024-09-12T02:48:51.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.598+0000 7f8dc9e00640 1 --2- 172.21.15.112:0/1356190810 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8da806be30 0x7f8da806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:51.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.599+0000 7f8dc9e00640 1 --2- 172.21.15.112:0/1356190810 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8da806be30 0x7f8da806e2f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8db8007fd0 tx=0x7f8db8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:51.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.603+0000 7f8dbe000640 1 -- 172.21.15.112:0/1356190810 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8db40585f0 con 0x7f8dc40b4ec0 2024-09-12T02:48:51.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.777+0000 7f8dcc800640 1 -- 172.21.15.112:0/1356190810 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8dc40b45d0 con 0x7f8dc40b4ec0 2024-09-12T02:48:51.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.778+0000 7f8dbe000640 1 -- 172.21.15.112:0/1356190810 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) ==== 74+0+16801 (secure 0 0 0) 0x7f8db405c8f0 con 0x7f8dc40b4ec0 2024-09-12T02:48:51.779 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:51.779 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":149,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:48:50.793492+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:48:48.563948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-12T02:48:49.789395+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:48:51.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.780+0000 7f8dcc800640 1 -- 172.21.15.112:0/1356190810 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8da806be30 msgr2=0x7f8da806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:51.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.780+0000 7f8dcc800640 1 --2- 172.21.15.112:0/1356190810 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8da806be30 0x7f8da806e2f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8db8007fd0 tx=0x7f8db8009040 comp rx=0 tx=0).stop 2024-09-12T02:48:51.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.780+0000 7f8dcc800640 1 -- 172.21.15.112:0/1356190810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dc40b4ec0 msgr2=0x7f8dc4154d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:51.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.780+0000 7f8dcc800640 1 --2- 172.21.15.112:0/1356190810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dc40b4ec0 0x7f8dc4154d60 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f8db400c400 tx=0x7f8db400c8c0 comp rx=0 tx=0).stop 2024-09-12T02:48:51.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.780+0000 7f8dcc800640 1 -- 172.21.15.112:0/1356190810 shutdown_connections 2024-09-12T02:48:51.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.780+0000 7f8dcc800640 1 --2- 172.21.15.112:0/1356190810 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8da806be30 0x7f8da806e2f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:51.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.780+0000 7f8dcc800640 1 --2- 172.21.15.112:0/1356190810 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8dc415b9d0 0x7f8dc4151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:51.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.780+0000 7f8dcc800640 1 --2- 172.21.15.112:0/1356190810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dc40b4ec0 0x7f8dc4154d60 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:51.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.780+0000 7f8dcc800640 1 --2- 172.21.15.112:0/1356190810 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8dc406f600 0x7f8dc4156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:51.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.780+0000 7f8dcc800640 1 -- 172.21.15.112:0/1356190810 >> 172.21.15.112:0/1356190810 conn(0x7f8dc406bbd0 msgr2=0x7f8dc40af7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:51.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.780+0000 7f8dcc800640 1 -- 172.21.15.112:0/1356190810 shutdown_connections 2024-09-12T02:48:51.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.780+0000 7f8dcc800640 1 -- 172.21.15.112:0/1356190810 wait complete. 2024-09-12T02:48:51.797 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:48:51.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.947+0000 7fb32ac00640 1 Processor -- start 2024-09-12T02:48:51.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.947+0000 7fb32ac00640 1 -- start start 2024-09-12T02:48:51.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.948+0000 7fb32ac00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb32406f600 0x7fb3240b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:51.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.949+0000 7fb32ac00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb3240b45d0 0x7fb3240728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:51.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.949+0000 7fb32ac00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3240b4a20 con 0x7fb32415b9d0 2024-09-12T02:48:51.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.949+0000 7fb32ac00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb3240b54a0 con 0x7fb3240b45d0 2024-09-12T02:48:51.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.949+0000 7fb32ac00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb3240b3af0 con 0x7fb32406f600 2024-09-12T02:48:51.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.949+0000 7fb328c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb3240b45d0 0x7fb3240728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:51.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.949+0000 7fb323400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb32406f600 0x7fb3240b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:51.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.949+0000 7fb328c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb3240b45d0 0x7fb3240728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:58510/0 (socket says 172.21.15.112:58510) 2024-09-12T02:48:51.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.949+0000 7fb328c00640 1 -- 172.21.15.112:0/3995950486 learned_addr learned my addr 172.21.15.112:0/3995950486 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:51.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.950+0000 7fb328c00640 1 -- 172.21.15.112:0/3995950486 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb32406f600 msgr2=0x7fb3240b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:51.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.950+0000 7fb328c00640 1 --2- 172.21.15.112:0/3995950486 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb32406f600 0x7fb3240b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:51.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.950+0000 7fb328c00640 1 -- 172.21.15.112:0/3995950486 >> v1:172.21.15.137:6789/0 conn(0x7fb32415b9d0 legacy=0x7fb32406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:51.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.950+0000 7fb328c00640 1 -- 172.21.15.112:0/3995950486 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3240b3dd0 con 0x7fb3240b45d0 2024-09-12T02:48:51.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.951+0000 7fb328c00640 1 --2- 172.21.15.112:0/3995950486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3240b45d0 0x7fb3240728c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb31c00d150 tx=0x7fb31c02c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=866514ce12dfc2f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:51.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.951+0000 7fb322a00640 1 -- 172.21.15.112:0/3995950486 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31c009600 con 0x7fb3240b45d0 2024-09-12T02:48:51.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.951+0000 7fb322a00640 1 -- 172.21.15.112:0/3995950486 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb31c037070 con 0x7fb3240b45d0 2024-09-12T02:48:51.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.951+0000 7fb322a00640 1 -- 172.21.15.112:0/3995950486 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0099c0 con 0x7fb3240b45d0 2024-09-12T02:48:51.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.952+0000 7fb32ac00640 1 -- 172.21.15.112:0/3995950486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3240b45d0 msgr2=0x7fb3240728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:51.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.952+0000 7fb32ac00640 1 --2- 172.21.15.112:0/3995950486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3240b45d0 0x7fb3240728c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb31c00d150 tx=0x7fb31c02c930 comp rx=0 tx=0).stop 2024-09-12T02:48:51.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.952+0000 7fb32ac00640 1 -- 172.21.15.112:0/3995950486 shutdown_connections 2024-09-12T02:48:51.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.952+0000 7fb32ac00640 1 --2- 172.21.15.112:0/3995950486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3240b45d0 0x7fb3240728c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:51.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.952+0000 7fb32ac00640 1 --2- 172.21.15.112:0/3995950486 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb32406f600 0x7fb3240b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:51.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.952+0000 7fb32ac00640 1 -- 172.21.15.112:0/3995950486 >> 172.21.15.112:0/3995950486 conn(0x7fb32406bbd0 msgr2=0x7fb32406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:51.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.952+0000 7fb32ac00640 1 -- 172.21.15.112:0/3995950486 shutdown_connections 2024-09-12T02:48:51.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.952+0000 7fb32ac00640 1 -- 172.21.15.112:0/3995950486 wait complete. 2024-09-12T02:48:51.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.953+0000 7fb32ac00640 1 Processor -- start 2024-09-12T02:48:51.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.953+0000 7fb32ac00640 1 -- start start 2024-09-12T02:48:51.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.954+0000 7fb32ac00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb32406f600 0x7fb32415ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:51.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.954+0000 7fb32ac00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3240b45d0 0x7fb324153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:51.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.954+0000 7fb32ac00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb32415b9d0 0x7fb3241f4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:51.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.954+0000 7fb32ac00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb32415bf30 con 0x7fb32415b9d0 2024-09-12T02:48:51.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.954+0000 7fb32ac00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb32415bdb0 con 0x7fb32406f600 2024-09-12T02:48:51.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.954+0000 7fb32ac00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb3240cdcd0 con 0x7fb3240b45d0 2024-09-12T02:48:51.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.955+0000 7fb328c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb32415b9d0 0x7fb3241f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:51.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.955+0000 7fb328c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb32415b9d0 0x7fb3241f4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39678/0 (socket says 172.21.15.112:39678) 2024-09-12T02:48:51.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.955+0000 7fb328c00640 1 -- 172.21.15.112:0/2968178341 learned_addr learned my addr 172.21.15.112:0/2968178341 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:51.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.955+0000 7fb323e00640 1 --2- 172.21.15.112:0/2968178341 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb32406f600 0x7fb32415ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:51.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.955+0000 7fb323400640 1 --2- 172.21.15.112:0/2968178341 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3240b45d0 0x7fb324153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:51.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.955+0000 7fb328c00640 1 -- 172.21.15.112:0/2968178341 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3240b45d0 msgr2=0x7fb324153720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:51.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.955+0000 7fb328c00640 1 --2- 172.21.15.112:0/2968178341 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3240b45d0 0x7fb324153720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:51.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.955+0000 7fb328c00640 1 -- 172.21.15.112:0/2968178341 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb32406f600 msgr2=0x7fb32415ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:51.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.955+0000 7fb328c00640 1 --2- 172.21.15.112:0/2968178341 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb32406f600 0x7fb32415ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:51.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.955+0000 7fb328c00640 1 -- 172.21.15.112:0/2968178341 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb324154090 con 0x7fb32415b9d0 2024-09-12T02:48:51.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.955+0000 7fb328c00640 1 --2- 172.21.15.112:0/2968178341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb32415b9d0 0x7fb3241f4bf0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fb31c034040 tx=0x7fb31c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:51.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.956+0000 7fb31be00640 1 -- 172.21.15.112:0/2968178341 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31c009dc0 con 0x7fb32415b9d0 2024-09-12T02:48:51.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.956+0000 7fb31be00640 1 -- 172.21.15.112:0/2968178341 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb31c032420 con 0x7fb32415b9d0 2024-09-12T02:48:51.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.956+0000 7fb31be00640 1 -- 172.21.15.112:0/2968178341 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31c032810 con 0x7fb32415b9d0 2024-09-12T02:48:51.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.956+0000 7fb32ac00640 1 -- 172.21.15.112:0/2968178341 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb324154370 con 0x7fb32415b9d0 2024-09-12T02:48:51.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.956+0000 7fb32ac00640 1 -- 172.21.15.112:0/2968178341 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb32415d5d0 con 0x7fb32415b9d0 2024-09-12T02:48:51.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.957+0000 7fb32ac00640 1 -- 172.21.15.112:0/2968178341 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb324068a30 con 0x7fb32415b9d0 2024-09-12T02:48:51.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.958+0000 7fb31be00640 1 -- 172.21.15.112:0/2968178341 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb31c005d10 con 0x7fb32415b9d0 2024-09-12T02:48:51.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.959+0000 7fb31be00640 1 --2- 172.21.15.112:0/2968178341 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb30406be60 0x7fb30406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:51.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.959+0000 7fb31be00640 1 -- 172.21.15.112:0/2968178341 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5709+0+0 (secure 0 0 0) 0x7fb31c0abc40 con 0x7fb32415b9d0 2024-09-12T02:48:51.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.960+0000 7fb323e00640 1 --2- 172.21.15.112:0/2968178341 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb30406be60 0x7fb30406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:51.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.960+0000 7fb323e00640 1 --2- 172.21.15.112:0/2968178341 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb30406be60 0x7fb30406e320 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb3140016e0 tx=0x7fb314009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:51.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:51.964+0000 7fb31be00640 1 -- 172.21.15.112:0/2968178341 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb31c079f00 con 0x7fb32415b9d0 2024-09-12T02:48:51.969 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:48:51.973 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:48:52.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.148+0000 7fb32ac00640 1 -- 172.21.15.112:0/2968178341 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb3240af520 con 0x7fb32415b9d0 2024-09-12T02:48:52.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.150+0000 7fb31be00640 1 -- 172.21.15.112:0/2968178341 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) ==== 74+0+16801 (secure 0 0 0) 0x7fb31c07e200 con 0x7fb32415b9d0 2024-09-12T02:48:52.151 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:52.151 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":149,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:48:50.793492+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:48:48.563948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-12T02:48:49.789395+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:48:52.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.152+0000 7fb32ac00640 1 -- 172.21.15.112:0/2968178341 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb30406be60 msgr2=0x7fb30406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:52.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.152+0000 7fb32ac00640 1 --2- 172.21.15.112:0/2968178341 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb30406be60 0x7fb30406e320 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb3140016e0 tx=0x7fb314009040 comp rx=0 tx=0).stop 2024-09-12T02:48:52.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.152+0000 7fb32ac00640 1 -- 172.21.15.112:0/2968178341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb32415b9d0 msgr2=0x7fb3241f4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:52.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.152+0000 7fb32ac00640 1 --2- 172.21.15.112:0/2968178341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb32415b9d0 0x7fb3241f4bf0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fb31c034040 tx=0x7fb31c004a40 comp rx=0 tx=0).stop 2024-09-12T02:48:52.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.152+0000 7fb32ac00640 1 -- 172.21.15.112:0/2968178341 shutdown_connections 2024-09-12T02:48:52.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.152+0000 7fb32ac00640 1 --2- 172.21.15.112:0/2968178341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb32415b9d0 0x7fb3241f4bf0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:52.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.152+0000 7fb32ac00640 1 --2- 172.21.15.112:0/2968178341 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3240b45d0 0x7fb324153720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:52.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.152+0000 7fb32ac00640 1 --2- 172.21.15.112:0/2968178341 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb30406be60 0x7fb30406e320 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:52.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.152+0000 7fb32ac00640 1 --2- 172.21.15.112:0/2968178341 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb32406f600 0x7fb32415ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:52.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.152+0000 7fb32ac00640 1 -- 172.21.15.112:0/2968178341 >> 172.21.15.112:0/2968178341 conn(0x7fb32406bbd0 msgr2=0x7fb3240727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:52.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.152+0000 7fb32ac00640 1 -- 172.21.15.112:0/2968178341 shutdown_connections 2024-09-12T02:48:52.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.152+0000 7fb32ac00640 1 -- 172.21.15.112:0/2968178341 wait complete. 2024-09-12T02:48:52.169 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T02:48:52.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.363+0000 7f6485e00640 1 Processor -- start 2024-09-12T02:48:52.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.363+0000 7f6485e00640 1 -- start start 2024-09-12T02:48:52.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.364+0000 7f6485e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f648015b9d0 0x7f64800b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:52.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.365+0000 7f6485e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f64800b45d0 0x7f64800728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:52.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.365+0000 7f6485e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f648006eef0 0x7f648006f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:52.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.365+0000 7f6485e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f64800b4a60 con 0x7f648015b9d0 2024-09-12T02:48:52.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.365+0000 7f6485e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f648006f860 con 0x7f64800b45d0 2024-09-12T02:48:52.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.365+0000 7f6485e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f64800b54a0 con 0x7f648006eef0 2024-09-12T02:48:52.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.365+0000 7f647ea00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f648015b9d0 0x7f64800b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:52.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.365+0000 7f647ea00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f648015b9d0 0x7f64800b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39682/0 (socket says 172.21.15.112:39682) 2024-09-12T02:48:52.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.365+0000 7f647ea00640 1 -- 172.21.15.112:0/3552049034 learned_addr learned my addr 172.21.15.112:0/3552049034 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:52.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.365+0000 7f647ea00640 1 -- 172.21.15.112:0/3552049034 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f648006eef0 msgr2=0x7f648006f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:52.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.365+0000 7f647f400640 1 --2- 172.21.15.112:0/3552049034 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f648006eef0 0x7f648006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:52.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.365+0000 7f6476000640 1 --2- 172.21.15.112:0/3552049034 >> v2:172.21.15.137:3300/0 conn(0x7f64800b45d0 0x7f64800728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:52.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.365+0000 7f647ea00640 1 --2- 172.21.15.112:0/3552049034 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f648006eef0 0x7f648006f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:52.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.365+0000 7f647ea00640 1 -- 172.21.15.112:0/3552049034 >> v2:172.21.15.137:3300/0 conn(0x7f64800b45d0 msgr2=0x7f64800728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:52.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.365+0000 7f647ea00640 1 --2- 172.21.15.112:0/3552049034 >> v2:172.21.15.137:3300/0 conn(0x7f64800b45d0 0x7f64800728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:52.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.365+0000 7f647ea00640 1 -- 172.21.15.112:0/3552049034 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64800b3af0 con 0x7f648015b9d0 2024-09-12T02:48:52.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.365+0000 7f6476000640 1 --2- 172.21.15.112:0/3552049034 >> v2:172.21.15.137:3300/0 conn(0x7f64800b45d0 0x7f64800728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:52.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.365+0000 7f647f400640 1 --2- 172.21.15.112:0/3552049034 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f648006eef0 0x7f648006f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:52.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.366+0000 7f647ea00640 1 --2- 172.21.15.112:0/3552049034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f648015b9d0 0x7f64800b4ec0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f6480068670 tx=0x7f647002c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4bc38116f1bdfba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:52.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.366+0000 7f647e000640 1 -- 172.21.15.112:0/3552049034 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6470038070 con 0x7f648015b9d0 2024-09-12T02:48:52.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.367+0000 7f647e000640 1 -- 172.21.15.112:0/3552049034 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6470031710 con 0x7f648015b9d0 2024-09-12T02:48:52.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.367+0000 7f647e000640 1 -- 172.21.15.112:0/3552049034 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6470031ae0 con 0x7f648015b9d0 2024-09-12T02:48:52.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.367+0000 7f6485e00640 1 -- 172.21.15.112:0/3552049034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f648015b9d0 msgr2=0x7f64800b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:52.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.367+0000 7f6485e00640 1 --2- 172.21.15.112:0/3552049034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f648015b9d0 0x7f64800b4ec0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f6480068670 tx=0x7f647002c420 comp rx=0 tx=0).stop 2024-09-12T02:48:52.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.367+0000 7f6485e00640 1 -- 172.21.15.112:0/3552049034 shutdown_connections 2024-09-12T02:48:52.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.367+0000 7f6485e00640 1 --2- 172.21.15.112:0/3552049034 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f648006eef0 0x7f648006f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:52.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.367+0000 7f6485e00640 1 --2- 172.21.15.112:0/3552049034 >> v2:172.21.15.137:3300/0 conn(0x7f64800b45d0 0x7f64800728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:52.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.367+0000 7f6485e00640 1 --2- 172.21.15.112:0/3552049034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f648015b9d0 0x7f64800b4ec0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:52.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.367+0000 7f6485e00640 1 -- 172.21.15.112:0/3552049034 >> 172.21.15.112:0/3552049034 conn(0x7f648006bbd0 msgr2=0x7f648006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:52.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.367+0000 7f6485e00640 1 -- 172.21.15.112:0/3552049034 shutdown_connections 2024-09-12T02:48:52.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.367+0000 7f6485e00640 1 -- 172.21.15.112:0/3552049034 wait complete. 2024-09-12T02:48:52.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.369+0000 7f6485e00640 1 Processor -- start 2024-09-12T02:48:52.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.369+0000 7f6485e00640 1 -- start start 2024-09-12T02:48:52.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.370+0000 7f6485e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f648006eef0 0x7f64800cf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:52.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.370+0000 7f6485e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f64800b45d0 0x7f648015e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:52.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.370+0000 7f6485e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f648015b9d0 0x7f648015eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:52.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.370+0000 7f6485e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f648015bdb0 con 0x7f648015b9d0 2024-09-12T02:48:52.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.370+0000 7f6485e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f64800b40b0 con 0x7f648006eef0 2024-09-12T02:48:52.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.370+0000 7f6485e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f648015bf30 con 0x7f64800b45d0 2024-09-12T02:48:52.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.370+0000 7f647f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f648015b9d0 0x7f648015eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:52.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.370+0000 7f647f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f648015b9d0 0x7f648015eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39692/0 (socket says 172.21.15.112:39692) 2024-09-12T02:48:52.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.370+0000 7f647f400640 1 -- 172.21.15.112:0/3122541528 learned_addr learned my addr 172.21.15.112:0/3122541528 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:52.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.370+0000 7f647ea00640 1 --2- 172.21.15.112:0/3122541528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f648006eef0 0x7f64800cf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:52.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.370+0000 7f6476000640 1 --2- 172.21.15.112:0/3122541528 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f64800b45d0 0x7f648015e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:52.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.371+0000 7f647f400640 1 -- 172.21.15.112:0/3122541528 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f64800b45d0 msgr2=0x7f648015e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:52.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.371+0000 7f647f400640 1 --2- 172.21.15.112:0/3122541528 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f64800b45d0 0x7f648015e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:52.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.371+0000 7f647f400640 1 -- 172.21.15.112:0/3122541528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f648006eef0 msgr2=0x7f64800cf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:52.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.371+0000 7f647f400640 1 --2- 172.21.15.112:0/3122541528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f648006eef0 0x7f64800cf3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:52.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.371+0000 7f647f400640 1 -- 172.21.15.112:0/3122541528 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64800af420 con 0x7f648015b9d0 2024-09-12T02:48:52.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.371+0000 7f647f400640 1 --2- 172.21.15.112:0/3122541528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f648015b9d0 0x7f648015eb60 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f647800cef0 tx=0x7f647800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:52.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.371+0000 7f6477e00640 1 -- 172.21.15.112:0/3122541528 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647801a070 con 0x7f648015b9d0 2024-09-12T02:48:52.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.371+0000 7f6477e00640 1 -- 172.21.15.112:0/3122541528 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f647800d860 con 0x7f648015b9d0 2024-09-12T02:48:52.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.371+0000 7f6485e00640 1 -- 172.21.15.112:0/3122541528 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64800af700 con 0x7f648015b9d0 2024-09-12T02:48:52.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.371+0000 7f6477e00640 1 -- 172.21.15.112:0/3122541528 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647800dc50 con 0x7f648015b9d0 2024-09-12T02:48:52.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.371+0000 7f6485e00640 1 -- 172.21.15.112:0/3122541528 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64800b01e0 con 0x7f648015b9d0 2024-09-12T02:48:52.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.372+0000 7f6485e00640 1 -- 172.21.15.112:0/3122541528 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6480068a30 con 0x7f648015b9d0 2024-09-12T02:48:52.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.373+0000 7f6477e00640 1 -- 172.21.15.112:0/3122541528 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f647801d070 con 0x7f648015b9d0 2024-09-12T02:48:52.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.374+0000 7f6477e00640 1 --2- 172.21.15.112:0/3122541528 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f645c06be30 0x7f645c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:52.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.374+0000 7f6477e00640 1 -- 172.21.15.112:0/3122541528 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5709+0+0 (secure 0 0 0) 0x7f647808b730 con 0x7f648015b9d0 2024-09-12T02:48:52.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.374+0000 7f647ea00640 1 --2- 172.21.15.112:0/3122541528 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f645c06be30 0x7f645c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:52.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.375+0000 7f647ea00640 1 --2- 172.21.15.112:0/3122541528 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f645c06be30 0x7f645c06e2f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6470035000 tx=0x7f6470008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:52.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.379+0000 7f6477e00640 1 -- 172.21.15.112:0/3122541528 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6478059ab0 con 0x7f648015b9d0 2024-09-12T02:48:52.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:52.594+0000 7f6485e00640 1 -- 172.21.15.112:0/3122541528 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f648006f320 con 0x7f648015b9d0 2024-09-12T02:48:53.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.419+0000 7f6477e00640 1 -- 172.21.15.112:0/3122541528 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v77) ==== 118+0+0 (secure 0 0 0) 0x7f647805ddb0 con 0x7f648015b9d0 2024-09-12T02:48:53.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.423+0000 7f6485e00640 1 -- 172.21.15.112:0/3122541528 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f645c06be30 msgr2=0x7f645c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:53.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.423+0000 7f6485e00640 1 --2- 172.21.15.112:0/3122541528 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f645c06be30 0x7f645c06e2f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6470035000 tx=0x7f6470008030 comp rx=0 tx=0).stop 2024-09-12T02:48:53.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.423+0000 7f6485e00640 1 -- 172.21.15.112:0/3122541528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f648015b9d0 msgr2=0x7f648015eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:53.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.423+0000 7f6485e00640 1 --2- 172.21.15.112:0/3122541528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f648015b9d0 0x7f648015eb60 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f647800cef0 tx=0x7f647800a710 comp rx=0 tx=0).stop 2024-09-12T02:48:53.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.423+0000 7f6485e00640 1 -- 172.21.15.112:0/3122541528 shutdown_connections 2024-09-12T02:48:53.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.423+0000 7f6485e00640 1 --2- 172.21.15.112:0/3122541528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f648015b9d0 0x7f648015eb60 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:53.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.423+0000 7f6485e00640 1 --2- 172.21.15.112:0/3122541528 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f64800b45d0 0x7f648015e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:53.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.423+0000 7f6485e00640 1 --2- 172.21.15.112:0/3122541528 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f645c06be30 0x7f645c06e2f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:53.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.423+0000 7f6485e00640 1 --2- 172.21.15.112:0/3122541528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f648006eef0 0x7f64800cf3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:53.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.423+0000 7f6485e00640 1 -- 172.21.15.112:0/3122541528 >> 172.21.15.112:0/3122541528 conn(0x7f648006bbd0 msgr2=0x7f64800b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:53.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.423+0000 7f6485e00640 1 -- 172.21.15.112:0/3122541528 shutdown_connections 2024-09-12T02:48:53.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.423+0000 7f6485e00640 1 -- 172.21.15.112:0/3122541528 wait complete. 2024-09-12T02:48:53.443 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T02:48:53.443 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T02:48:53.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.601+0000 7f4348800640 1 Processor -- start 2024-09-12T02:48:53.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.602+0000 7f4348800640 1 -- start start 2024-09-12T02:48:53.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.603+0000 7f4348800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f434015cc50 0x7f43400732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:53.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.603+0000 7f4348800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4340071530 0x7f43400af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:53.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.603+0000 7f4348800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4340073830 con 0x7f43400719a0 2024-09-12T02:48:53.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.603+0000 7f4348800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f434015d030 con 0x7f434015cc50 2024-09-12T02:48:53.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.603+0000 7f4348800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f43400cf4c0 con 0x7f4340071530 2024-09-12T02:48:53.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.603+0000 7f4345e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f434015cc50 0x7f43400732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:53.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.603+0000 7f4345e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f434015cc50 0x7f43400732f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39694/0 (socket says 172.21.15.112:39694) 2024-09-12T02:48:53.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.603+0000 7f4345e00640 1 -- 172.21.15.112:0/1632301655 learned_addr learned my addr 172.21.15.112:0/1632301655 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:53.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.603+0000 7f4345400640 1 --2- 172.21.15.112:0/1632301655 >> v2:172.21.15.137:3300/0 conn(0x7f4340071530 0x7f43400af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:53.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.604+0000 7f4345e00640 1 -- 172.21.15.112:0/1632301655 >> v2:172.21.15.137:3300/0 conn(0x7f4340071530 msgr2=0x7f43400af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:53.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.604+0000 7f4345e00640 1 --2- 172.21.15.112:0/1632301655 >> v2:172.21.15.137:3300/0 conn(0x7f4340071530 0x7f43400af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:53.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.604+0000 7f4345e00640 1 -- 172.21.15.112:0/1632301655 >> v1:172.21.15.137:6789/0 conn(0x7f43400719a0 legacy=0x7f43400cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:53.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.604+0000 7f4345e00640 1 -- 172.21.15.112:0/1632301655 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43400ceeb0 con 0x7f434015cc50 2024-09-12T02:48:53.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.605+0000 7f4345e00640 1 --2- 172.21.15.112:0/1632301655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f434015cc50 0x7f43400732f0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f434006fa40 tx=0x7f433402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6822bfc5e25b4e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:53.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.605+0000 7f4344a00640 1 -- 172.21.15.112:0/1632301655 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4334037070 con 0x7f434015cc50 2024-09-12T02:48:53.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.605+0000 7f4344a00640 1 -- 172.21.15.112:0/1632301655 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4334032440 con 0x7f434015cc50 2024-09-12T02:48:53.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.605+0000 7f4344a00640 1 -- 172.21.15.112:0/1632301655 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4334032810 con 0x7f434015cc50 2024-09-12T02:48:53.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.605+0000 7f4348800640 1 -- 172.21.15.112:0/1632301655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f434015cc50 msgr2=0x7f43400732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:53.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.605+0000 7f4348800640 1 --2- 172.21.15.112:0/1632301655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f434015cc50 0x7f43400732f0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f434006fa40 tx=0x7f433402a1e0 comp rx=0 tx=0).stop 2024-09-12T02:48:53.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.605+0000 7f4348800640 1 -- 172.21.15.112:0/1632301655 shutdown_connections 2024-09-12T02:48:53.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.605+0000 7f4348800640 1 --2- 172.21.15.112:0/1632301655 >> v2:172.21.15.137:3300/0 conn(0x7f4340071530 0x7f43400af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:53.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.605+0000 7f4348800640 1 --2- 172.21.15.112:0/1632301655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f434015cc50 0x7f43400732f0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:53.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.605+0000 7f4348800640 1 -- 172.21.15.112:0/1632301655 >> 172.21.15.112:0/1632301655 conn(0x7f434006bbd0 msgr2=0x7f434006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:53.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.606+0000 7f4348800640 1 -- 172.21.15.112:0/1632301655 shutdown_connections 2024-09-12T02:48:53.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.606+0000 7f4348800640 1 -- 172.21.15.112:0/1632301655 wait complete. 2024-09-12T02:48:53.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.607+0000 7f4348800640 1 Processor -- start 2024-09-12T02:48:53.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.607+0000 7f4348800640 1 -- start start 2024-09-12T02:48:53.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.608+0000 7f4348800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4340071530 0x7f43401506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:53.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.608+0000 7f4348800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43400719a0 0x7f4340150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:53.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.608+0000 7f4348800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f434015cc50 0x7f4340155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:53.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.608+0000 7f4348800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f43400cf150 con 0x7f434015cc50 2024-09-12T02:48:53.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.608+0000 7f4348800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f434006e5e0 con 0x7f43400719a0 2024-09-12T02:48:53.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.608+0000 7f4348800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f434006f510 con 0x7f4340071530 2024-09-12T02:48:53.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.609+0000 7f4346800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f434015cc50 0x7f4340155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:53.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.609+0000 7f4346800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f434015cc50 0x7f4340155540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39708/0 (socket says 172.21.15.112:39708) 2024-09-12T02:48:53.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.609+0000 7f4346800640 1 -- 172.21.15.112:0/3918931097 learned_addr learned my addr 172.21.15.112:0/3918931097 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:53.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.609+0000 7f4345e00640 1 --2- 172.21.15.112:0/3918931097 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4340071530 0x7f43401506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:53.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.609+0000 7f4345400640 1 --2- 172.21.15.112:0/3918931097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43400719a0 0x7f4340150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:53.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.609+0000 7f4346800640 1 -- 172.21.15.112:0/3918931097 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4340071530 msgr2=0x7f43401506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:53.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.609+0000 7f4346800640 1 --2- 172.21.15.112:0/3918931097 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4340071530 0x7f43401506d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:53.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.609+0000 7f4346800640 1 -- 172.21.15.112:0/3918931097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43400719a0 msgr2=0x7f4340150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:53.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.609+0000 7f4346800640 1 --2- 172.21.15.112:0/3918931097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43400719a0 0x7f4340150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:53.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.609+0000 7f4346800640 1 -- 172.21.15.112:0/3918931097 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4340152690 con 0x7f434015cc50 2024-09-12T02:48:53.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.609+0000 7f4346800640 1 --2- 172.21.15.112:0/3918931097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f434015cc50 0x7f4340155540 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f433c00c760 tx=0x7f433c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:53.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.609+0000 7f433a000640 1 -- 172.21.15.112:0/3918931097 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433c003b70 con 0x7f434015cc50 2024-09-12T02:48:53.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.609+0000 7f433a000640 1 -- 172.21.15.112:0/3918931097 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f433c003d10 con 0x7f434015cc50 2024-09-12T02:48:53.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.609+0000 7f433a000640 1 -- 172.21.15.112:0/3918931097 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433c00aa90 con 0x7f434015cc50 2024-09-12T02:48:53.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.609+0000 7f4348800640 1 -- 172.21.15.112:0/3918931097 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43401515f0 con 0x7f434015cc50 2024-09-12T02:48:53.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.610+0000 7f4348800640 1 -- 172.21.15.112:0/3918931097 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4340151bb0 con 0x7f434015cc50 2024-09-12T02:48:53.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.611+0000 7f4348800640 1 -- 172.21.15.112:0/3918931097 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f434006df60 con 0x7f434015cc50 2024-09-12T02:48:53.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.612+0000 7f433a000640 1 -- 172.21.15.112:0/3918931097 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f433c00ac30 con 0x7f434015cc50 2024-09-12T02:48:53.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.612+0000 7f433a000640 1 --2- 172.21.15.112:0/3918931097 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f432406be30 0x7f432406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:53.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.613+0000 7f433a000640 1 -- 172.21.15.112:0/3918931097 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 5709+0+0 (secure 0 0 0) 0x7f433c08ac40 con 0x7f434015cc50 2024-09-12T02:48:53.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.613+0000 7f4345e00640 1 --2- 172.21.15.112:0/3918931097 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f432406be30 0x7f432406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:53.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.613+0000 7f4345e00640 1 --2- 172.21.15.112:0/3918931097 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f432406be30 0x7f432406e2f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4334034000 tx=0x7f433402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:53.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.617+0000 7f433a000640 1 -- 172.21.15.112:0/3918931097 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4340073830 con 0x7f434015cc50 2024-09-12T02:48:53.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:53.824+0000 7f4348800640 1 -- 172.21.15.112:0/3918931097 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f43400730d0 con 0x7f434015cc50 2024-09-12T02:48:54.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.422+0000 7f433a000640 1 -- 172.21.15.112:0/3918931097 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v78) ==== 122+0+0 (secure 0 0 0) 0x7f433c058f90 con 0x7f434015cc50 2024-09-12T02:48:54.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.425+0000 7f4348800640 1 -- 172.21.15.112:0/3918931097 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f432406be30 msgr2=0x7f432406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:54.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.425+0000 7f4348800640 1 --2- 172.21.15.112:0/3918931097 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f432406be30 0x7f432406e2f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4334034000 tx=0x7f433402e000 comp rx=0 tx=0).stop 2024-09-12T02:48:54.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.425+0000 7f4348800640 1 -- 172.21.15.112:0/3918931097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f434015cc50 msgr2=0x7f4340155540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:54.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.425+0000 7f4348800640 1 --2- 172.21.15.112:0/3918931097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f434015cc50 0x7f4340155540 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f433c00c760 tx=0x7f433c00cc20 comp rx=0 tx=0).stop 2024-09-12T02:48:54.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.425+0000 7f4348800640 1 -- 172.21.15.112:0/3918931097 shutdown_connections 2024-09-12T02:48:54.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.425+0000 7f4348800640 1 --2- 172.21.15.112:0/3918931097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f434015cc50 0x7f4340155540 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:54.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.425+0000 7f4348800640 1 --2- 172.21.15.112:0/3918931097 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f432406be30 0x7f432406e2f0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:54.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.425+0000 7f4348800640 1 --2- 172.21.15.112:0/3918931097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43400719a0 0x7f4340150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:54.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.425+0000 7f4348800640 1 --2- 172.21.15.112:0/3918931097 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4340071530 0x7f43401506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:54.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.425+0000 7f4348800640 1 -- 172.21.15.112:0/3918931097 >> 172.21.15.112:0/3918931097 conn(0x7f434006bbd0 msgr2=0x7f43400b18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:54.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.426+0000 7f4348800640 1 -- 172.21.15.112:0/3918931097 shutdown_connections 2024-09-12T02:48:54.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.426+0000 7f4348800640 1 -- 172.21.15.112:0/3918931097 wait complete. 2024-09-12T02:48:54.444 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T02:48:54.444 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:48:54.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.595+0000 7f6ddf800640 1 Processor -- start 2024-09-12T02:48:54.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.595+0000 7f6ddf800640 1 -- start start 2024-09-12T02:48:54.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.596+0000 7f6ddf800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6dd815cc50 0x7f6dd80732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:54.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.596+0000 7f6ddf800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6dd80afe30 0x7f6dd80cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:54.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.596+0000 7f6ddf800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dd8073830 con 0x7f6dd8071530 2024-09-12T02:48:54.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.596+0000 7f6ddf800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f6dd815d030 con 0x7f6dd815cc50 2024-09-12T02:48:54.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.596+0000 7f6ddf800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6dd80cf4c0 con 0x7f6dd80afe30 2024-09-12T02:48:54.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.597+0000 7f6ddce00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6dd815cc50 0x7f6dd80732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:54.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.597+0000 7f6ddce00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6dd815cc50 0x7f6dd80732f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39720/0 (socket says 172.21.15.112:39720) 2024-09-12T02:48:54.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.597+0000 7f6ddce00640 1 -- 172.21.15.112:0/2040067295 learned_addr learned my addr 172.21.15.112:0/2040067295 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:54.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.597+0000 7f6ddd800640 1 --2- 172.21.15.112:0/2040067295 >> v2:172.21.15.137:3300/0 conn(0x7f6dd80afe30 0x7f6dd80cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:54.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.597+0000 7f6ddce00640 1 -- 172.21.15.112:0/2040067295 >> v2:172.21.15.137:3300/0 conn(0x7f6dd80afe30 msgr2=0x7f6dd80cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:54.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.597+0000 7f6ddce00640 1 --2- 172.21.15.112:0/2040067295 >> v2:172.21.15.137:3300/0 conn(0x7f6dd80afe30 0x7f6dd80cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:54.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.597+0000 7f6ddce00640 1 -- 172.21.15.112:0/2040067295 >> v1:172.21.15.137:6789/0 conn(0x7f6dd8071530 legacy=0x7f6dd80af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:54.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.597+0000 7f6ddce00640 1 -- 172.21.15.112:0/2040067295 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd80ceeb0 con 0x7f6dd815cc50 2024-09-12T02:48:54.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.598+0000 7f6ddce00640 1 --2- 172.21.15.112:0/2040067295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6dd815cc50 0x7f6dd80732f0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f6dd806ffd0 tx=0x7f6dcc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e591b259ebe22a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:54.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.598+0000 7f6dd7400640 1 -- 172.21.15.112:0/2040067295 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc037070 con 0x7f6dd815cc50 2024-09-12T02:48:54.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.598+0000 7f6dd7400640 1 -- 172.21.15.112:0/2040067295 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dcc032440 con 0x7f6dd815cc50 2024-09-12T02:48:54.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.598+0000 7f6dd7400640 1 -- 172.21.15.112:0/2040067295 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc032810 con 0x7f6dd815cc50 2024-09-12T02:48:54.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.599+0000 7f6ddf800640 1 -- 172.21.15.112:0/2040067295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6dd815cc50 msgr2=0x7f6dd80732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:54.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.599+0000 7f6ddf800640 1 --2- 172.21.15.112:0/2040067295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6dd815cc50 0x7f6dd80732f0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f6dd806ffd0 tx=0x7f6dcc02a1e0 comp rx=0 tx=0).stop 2024-09-12T02:48:54.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.599+0000 7f6ddf800640 1 -- 172.21.15.112:0/2040067295 shutdown_connections 2024-09-12T02:48:54.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.599+0000 7f6ddf800640 1 --2- 172.21.15.112:0/2040067295 >> v2:172.21.15.137:3300/0 conn(0x7f6dd80afe30 0x7f6dd80cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:54.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.599+0000 7f6ddf800640 1 --2- 172.21.15.112:0/2040067295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6dd815cc50 0x7f6dd80732f0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:54.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.599+0000 7f6ddf800640 1 -- 172.21.15.112:0/2040067295 >> 172.21.15.112:0/2040067295 conn(0x7f6dd806bbd0 msgr2=0x7f6dd806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:54.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.599+0000 7f6ddf800640 1 -- 172.21.15.112:0/2040067295 shutdown_connections 2024-09-12T02:48:54.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.599+0000 7f6ddf800640 1 -- 172.21.15.112:0/2040067295 wait complete. 2024-09-12T02:48:54.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.601+0000 7f6ddf800640 1 Processor -- start 2024-09-12T02:48:54.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.601+0000 7f6ddf800640 1 -- start start 2024-09-12T02:48:54.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.602+0000 7f6ddf800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6dd8071530 0x7f6dd81488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:54.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.602+0000 7f6ddf800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dd80afe30 0x7f6dd8148e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:54.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.602+0000 7f6ddf800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6dd815cc50 0x7f6dd8145480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:54.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.602+0000 7f6ddf800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd80cf150 con 0x7f6dd815cc50 2024-09-12T02:48:54.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.602+0000 7f6ddf800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd806e5e0 con 0x7f6dd80afe30 2024-09-12T02:48:54.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.602+0000 7f6ddf800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6dd806f510 con 0x7f6dd8071530 2024-09-12T02:48:54.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.602+0000 7f6ddd800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6dd815cc50 0x7f6dd8145480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:54.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.602+0000 7f6ddce00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6dd8071530 0x7f6dd81488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:54.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.602+0000 7f6dd7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dd80afe30 0x7f6dd8148e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:54.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.602+0000 7f6ddd800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6dd815cc50 0x7f6dd8145480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39732/0 (socket says 172.21.15.112:39732) 2024-09-12T02:48:54.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.602+0000 7f6ddce00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6dd8071530 0x7f6dd81488c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:36740/0 (socket says 172.21.15.112:36740) 2024-09-12T02:48:54.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.602+0000 7f6ddd800640 1 -- 172.21.15.112:0/3159397125 learned_addr learned my addr 172.21.15.112:0/3159397125 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:54.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.602+0000 7f6ddd800640 1 -- 172.21.15.112:0/3159397125 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6dd8071530 msgr2=0x7f6dd81488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:54.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.602+0000 7f6ddd800640 1 --2- 172.21.15.112:0/3159397125 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6dd8071530 0x7f6dd81488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:54.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.602+0000 7f6ddd800640 1 -- 172.21.15.112:0/3159397125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dd80afe30 msgr2=0x7f6dd8148e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:54.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.602+0000 7f6ddd800640 1 --2- 172.21.15.112:0/3159397125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dd80afe30 0x7f6dd8148e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:54.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.602+0000 7f6ddd800640 1 -- 172.21.15.112:0/3159397125 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd81542e0 con 0x7f6dd815cc50 2024-09-12T02:48:54.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.603+0000 7f6ddd800640 1 --2- 172.21.15.112:0/3159397125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6dd815cc50 0x7f6dd8145480 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0007e30 tx=0x7f6dd000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:54.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.603+0000 7f6dd4c00640 1 -- 172.21.15.112:0/3159397125 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0014620 con 0x7f6dd815cc50 2024-09-12T02:48:54.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.603+0000 7f6dd4c00640 1 -- 172.21.15.112:0/3159397125 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dd0019070 con 0x7f6dd815cc50 2024-09-12T02:48:54.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.603+0000 7f6dd4c00640 1 -- 172.21.15.112:0/3159397125 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0014a00 con 0x7f6dd815cc50 2024-09-12T02:48:54.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.603+0000 7f6ddf800640 1 -- 172.21.15.112:0/3159397125 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dd8143180 con 0x7f6dd815cc50 2024-09-12T02:48:54.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.603+0000 7f6ddf800640 1 -- 172.21.15.112:0/3159397125 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dd8143740 con 0x7f6dd815cc50 2024-09-12T02:48:54.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.604+0000 7f6ddf800640 1 -- 172.21.15.112:0/3159397125 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dd8068a30 con 0x7f6dd815cc50 2024-09-12T02:48:54.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.605+0000 7f6dd4c00640 1 -- 172.21.15.112:0/3159397125 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6dd0014ba0 con 0x7f6dd815cc50 2024-09-12T02:48:54.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.606+0000 7f6dd4c00640 1 --2- 172.21.15.112:0/3159397125 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6db806be60 0x7f6db806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:54.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.606+0000 7f6dd4c00640 1 -- 172.21.15.112:0/3159397125 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 5709+0+0 (secure 0 0 0) 0x7f6dd008b6a0 con 0x7f6dd815cc50 2024-09-12T02:48:54.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.606+0000 7f6ddce00640 1 --2- 172.21.15.112:0/3159397125 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6db806be60 0x7f6db806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:54.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.607+0000 7f6ddce00640 1 --2- 172.21.15.112:0/3159397125 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6db806be60 0x7f6db806e320 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc034000 tx=0x7f6dcc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:54.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.610+0000 7f6dd4c00640 1 -- 172.21.15.112:0/3159397125 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6dd0059960 con 0x7f6dd815cc50 2024-09-12T02:48:54.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.815+0000 7f6ddf800640 1 -- 172.21.15.112:0/3159397125 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6dd80730d0 con 0x7f6dd815cc50 2024-09-12T02:48:54.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.815+0000 7f6dd4c00640 1 -- 172.21.15.112:0/3159397125 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) ==== 94+0+5234 (secure 0 0 0) 0x7f6dd005dc60 con 0x7f6dd815cc50 2024-09-12T02:48:54.817 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:54.817 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":78,"btime":"2024-09-12T02:48:54:420600+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6074,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/984843624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":984843624},{"type":"v1","addr":"172.21.15.112:6836","nonce":984843624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3470369780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3470369780},{"type":"v1","addr":"172.21.15.112:6837","nonce":3470369780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/3190674567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3190674567},{"type":"v1","addr":"172.21.15.137:6834","nonce":3190674567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:48:50.793801+0000","modified":"2024-09-12T02:48:53.825952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7257":{"gid":7257,"name":"b","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/1000067194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1000067194},{"type":"v1","addr":"172.21.15.137:6835","nonce":1000067194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7257,"qdb_cluster":[7257]},"id":9}]} 2024-09-12T02:48:54.817 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 78 2024-09-12T02:48:54.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.818+0000 7f6ddf800640 1 -- 172.21.15.112:0/3159397125 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6db806be60 msgr2=0x7f6db806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:54.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.818+0000 7f6ddf800640 1 --2- 172.21.15.112:0/3159397125 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6db806be60 0x7f6db806e320 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc034000 tx=0x7f6dcc02e000 comp rx=0 tx=0).stop 2024-09-12T02:48:54.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.818+0000 7f6ddf800640 1 -- 172.21.15.112:0/3159397125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6dd815cc50 msgr2=0x7f6dd8145480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:54.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.818+0000 7f6ddf800640 1 --2- 172.21.15.112:0/3159397125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6dd815cc50 0x7f6dd8145480 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0007e30 tx=0x7f6dd000e4b0 comp rx=0 tx=0).stop 2024-09-12T02:48:54.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.818+0000 7f6ddf800640 1 -- 172.21.15.112:0/3159397125 shutdown_connections 2024-09-12T02:48:54.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.818+0000 7f6ddf800640 1 --2- 172.21.15.112:0/3159397125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6dd815cc50 0x7f6dd8145480 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:54.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.818+0000 7f6ddf800640 1 --2- 172.21.15.112:0/3159397125 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6db806be60 0x7f6db806e320 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:54.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.818+0000 7f6ddf800640 1 --2- 172.21.15.112:0/3159397125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dd80afe30 0x7f6dd8148e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:54.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.818+0000 7f6ddf800640 1 --2- 172.21.15.112:0/3159397125 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6dd8071530 0x7f6dd81488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:54.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.818+0000 7f6ddf800640 1 -- 172.21.15.112:0/3159397125 >> 172.21.15.112:0/3159397125 conn(0x7f6dd806bbd0 msgr2=0x7f6dd80b0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:54.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.818+0000 7f6ddf800640 1 -- 172.21.15.112:0/3159397125 shutdown_connections 2024-09-12T02:48:54.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.818+0000 7f6ddf800640 1 -- 172.21.15.112:0/3159397125 wait complete. 2024-09-12T02:48:54.834 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:48:54.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.985+0000 7fd0d5600640 1 Processor -- start 2024-09-12T02:48:54.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.985+0000 7fd0d5600640 1 -- start start 2024-09-12T02:48:54.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.987+0000 7fd0d5600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd0d006d8c0 0x7fd0d00afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:54.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.987+0000 7fd0d5600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd0d006dca0 0x7fd0d006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:54.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.987+0000 7fd0d5600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0d00aedd0 con 0x7fd0d00ae8d0 2024-09-12T02:48:54.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.987+0000 7fd0d5600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd0d00af0b0 con 0x7fd0d006dca0 2024-09-12T02:48:54.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.987+0000 7fd0d5600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd0d00af390 con 0x7fd0d006d8c0 2024-09-12T02:48:54.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.987+0000 7fd0cf400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd0d006dca0 0x7fd0d006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:54.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.987+0000 7fd0ce000640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd0d00ae8d0 0x7fd0d00715a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33632/0 (socket says 172.21.15.112:33632) 2024-09-12T02:48:54.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.987+0000 7fd0ce000640 1 -- 172.21.15.112:0/3130331817 learned_addr learned my addr 172.21.15.112:0/3130331817 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:54.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.987+0000 7fd0cea00640 1 --2- 172.21.15.112:0/3130331817 >> v2:172.21.15.137:3300/0 conn(0x7fd0d006d8c0 0x7fd0d00afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:54.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.987+0000 7fd0cf400640 1 -- 172.21.15.112:0/3130331817 >> v2:172.21.15.137:3300/0 conn(0x7fd0d006d8c0 msgr2=0x7fd0d00afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:54.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.987+0000 7fd0cf400640 1 --2- 172.21.15.112:0/3130331817 >> v2:172.21.15.137:3300/0 conn(0x7fd0d006d8c0 0x7fd0d00afe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:54.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.987+0000 7fd0cf400640 1 -- 172.21.15.112:0/3130331817 >> v1:172.21.15.112:6789/0 conn(0x7fd0d00ae8d0 legacy=0x7fd0d00715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:54.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.988+0000 7fd0cf400640 1 -- 172.21.15.112:0/3130331817 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d00af670 con 0x7fd0d006dca0 2024-09-12T02:48:54.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.988+0000 7fd0cea00640 1 --2- 172.21.15.112:0/3130331817 >> v2:172.21.15.137:3300/0 conn(0x7fd0d006d8c0 0x7fd0d00afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:54.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.987+0000 7fd0cd600640 1 -- 172.21.15.112:0/3130331817 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 142400748 0 0) 0x7fd0d00aedd0 con 0x7fd0d00ae8d0 2024-09-12T02:48:54.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.988+0000 7fd0cf400640 1 --2- 172.21.15.112:0/3130331817 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0d006dca0 0x7fd0d006e150 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fd0d006d230 tx=0x7fd0c802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a0a19a95222183 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:54.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.989+0000 7fd0cd600640 1 -- 172.21.15.112:0/3130331817 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8037070 con 0x7fd0d006dca0 2024-09-12T02:48:54.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.989+0000 7fd0cd600640 1 -- 172.21.15.112:0/3130331817 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0c8032440 con 0x7fd0d006dca0 2024-09-12T02:48:54.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.989+0000 7fd0cd600640 1 -- 172.21.15.112:0/3130331817 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8032810 con 0x7fd0d006dca0 2024-09-12T02:48:54.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.989+0000 7fd0d5600640 1 -- 172.21.15.112:0/3130331817 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0d006dca0 msgr2=0x7fd0d006e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:54.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.989+0000 7fd0d5600640 1 --2- 172.21.15.112:0/3130331817 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0d006dca0 0x7fd0d006e150 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fd0d006d230 tx=0x7fd0c802a1a0 comp rx=0 tx=0).stop 2024-09-12T02:48:54.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.989+0000 7fd0d5600640 1 -- 172.21.15.112:0/3130331817 shutdown_connections 2024-09-12T02:48:54.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.989+0000 7fd0d5600640 1 --2- 172.21.15.112:0/3130331817 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0d006dca0 0x7fd0d006e150 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:54.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.989+0000 7fd0d5600640 1 --2- 172.21.15.112:0/3130331817 >> v2:172.21.15.137:3300/0 conn(0x7fd0d006d8c0 0x7fd0d00afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:54.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.989+0000 7fd0d5600640 1 -- 172.21.15.112:0/3130331817 >> 172.21.15.112:0/3130331817 conn(0x7fd0d006bbd0 msgr2=0x7fd0d006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:54.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.989+0000 7fd0d5600640 1 -- 172.21.15.112:0/3130331817 shutdown_connections 2024-09-12T02:48:54.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.989+0000 7fd0d5600640 1 -- 172.21.15.112:0/3130331817 wait complete. 2024-09-12T02:48:54.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.991+0000 7fd0d5600640 1 Processor -- start 2024-09-12T02:48:54.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.991+0000 7fd0d5600640 1 -- start start 2024-09-12T02:48:54.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.992+0000 7fd0d5600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0d006d8c0 0x7fd0d014df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:54.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.992+0000 7fd0d5600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0d006dca0 0x7fd0d00c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:54.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.992+0000 7fd0d5600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd0d00ae8d0 0x7fd0d00cc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:54.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.992+0000 7fd0d5600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d00b38e0 con 0x7fd0d006d8c0 2024-09-12T02:48:54.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.992+0000 7fd0d5600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d006e690 con 0x7fd0d006dca0 2024-09-12T02:48:54.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.992+0000 7fd0d5600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd0d00b3a60 con 0x7fd0d00ae8d0 2024-09-12T02:48:54.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.992+0000 7fd0cea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0d006d8c0 0x7fd0d014df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:54.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.992+0000 7fd0cea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0d006d8c0 0x7fd0d014df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39740/0 (socket says 172.21.15.112:39740) 2024-09-12T02:48:54.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.992+0000 7fd0cea00640 1 -- 172.21.15.112:0/2350173742 learned_addr learned my addr 172.21.15.112:0/2350173742 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:54.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.993+0000 7fd0ce000640 1 --2- 172.21.15.112:0/2350173742 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0d006dca0 0x7fd0d00c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:54.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.993+0000 7fd0cea00640 1 -- 172.21.15.112:0/2350173742 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd0d00ae8d0 msgr2=0x7fd0d00cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:54.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.993+0000 7fd0cf400640 1 --2- 172.21.15.112:0/2350173742 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd0d00ae8d0 0x7fd0d00cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:54.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.993+0000 7fd0cea00640 1 --2- 172.21.15.112:0/2350173742 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd0d00ae8d0 0x7fd0d00cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:54.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.993+0000 7fd0cea00640 1 -- 172.21.15.112:0/2350173742 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0d006dca0 msgr2=0x7fd0d00c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:54.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.993+0000 7fd0cea00640 1 --2- 172.21.15.112:0/2350173742 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0d006dca0 0x7fd0d00c5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:54.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.993+0000 7fd0cea00640 1 -- 172.21.15.112:0/2350173742 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d00c5d90 con 0x7fd0d006d8c0 2024-09-12T02:48:54.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.993+0000 7fd0ce000640 1 --2- 172.21.15.112:0/2350173742 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0d006dca0 0x7fd0d00c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:54.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.993+0000 7fd0cf400640 1 --2- 172.21.15.112:0/2350173742 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd0d00ae8d0 0x7fd0d00cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:54.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.993+0000 7fd0cea00640 1 --2- 172.21.15.112:0/2350173742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0d006d8c0 0x7fd0d014df60 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0009fc0 tx=0x7fd0c000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:54.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.993+0000 7fd0c6a00640 1 -- 172.21.15.112:0/2350173742 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c001a070 con 0x7fd0d006d8c0 2024-09-12T02:48:54.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.993+0000 7fd0c6a00640 1 -- 172.21.15.112:0/2350173742 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0c0003bb0 con 0x7fd0d006d8c0 2024-09-12T02:48:54.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.993+0000 7fd0d5600640 1 -- 172.21.15.112:0/2350173742 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0d00c6040 con 0x7fd0d006d8c0 2024-09-12T02:48:54.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.993+0000 7fd0c6a00640 1 -- 172.21.15.112:0/2350173742 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c0004030 con 0x7fd0d006d8c0 2024-09-12T02:48:54.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.993+0000 7fd0d5600640 1 -- 172.21.15.112:0/2350173742 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0d00c6600 con 0x7fd0d006d8c0 2024-09-12T02:48:54.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.994+0000 7fd0d5600640 1 -- 172.21.15.112:0/2350173742 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0d0068a30 con 0x7fd0d006d8c0 2024-09-12T02:48:54.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.995+0000 7fd0c6a00640 1 -- 172.21.15.112:0/2350173742 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd0c0005d10 con 0x7fd0d006d8c0 2024-09-12T02:48:54.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.996+0000 7fd0c6a00640 1 --2- 172.21.15.112:0/2350173742 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd0b006be60 0x7fd0b006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:54.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.996+0000 7fd0c6a00640 1 -- 172.21.15.112:0/2350173742 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 5709+0+0 (secure 0 0 0) 0x7fd0c008b680 con 0x7fd0d006d8c0 2024-09-12T02:48:54.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.997+0000 7fd0ce000640 1 --2- 172.21.15.112:0/2350173742 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd0b006be60 0x7fd0b006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:54.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:54.997+0000 7fd0ce000640 1 --2- 172.21.15.112:0/2350173742 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd0b006be60 0x7fd0b006e320 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd0d01f8000 tx=0x7fd0bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:55.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.000+0000 7fd0c6a00640 1 -- 172.21.15.112:0/2350173742 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd0c0010070 con 0x7fd0d006d8c0 2024-09-12T02:48:55.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.174+0000 7fd0d5600640 1 -- 172.21.15.112:0/2350173742 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd0d00afe70 con 0x7fd0d006d8c0 2024-09-12T02:48:55.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.175+0000 7fd0c6a00640 1 -- 172.21.15.112:0/2350173742 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) ==== 74+0+16788 (secure 0 0 0) 0x7fd0c0059b50 con 0x7fd0d006d8c0 2024-09-12T02:48:55.176 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:55.176 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":150,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:48:52.394327+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:48:48.563948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-12T02:48:49.789395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:48:55.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.177+0000 7fd0d5600640 1 -- 172.21.15.112:0/2350173742 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd0b006be60 msgr2=0x7fd0b006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:55.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.177+0000 7fd0d5600640 1 --2- 172.21.15.112:0/2350173742 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd0b006be60 0x7fd0b006e320 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd0d01f8000 tx=0x7fd0bc009040 comp rx=0 tx=0).stop 2024-09-12T02:48:55.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.177+0000 7fd0d5600640 1 -- 172.21.15.112:0/2350173742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0d006d8c0 msgr2=0x7fd0d014df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:55.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.177+0000 7fd0d5600640 1 --2- 172.21.15.112:0/2350173742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0d006d8c0 0x7fd0d014df60 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0009fc0 tx=0x7fd0c000d560 comp rx=0 tx=0).stop 2024-09-12T02:48:55.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.177+0000 7fd0d5600640 1 -- 172.21.15.112:0/2350173742 shutdown_connections 2024-09-12T02:48:55.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.177+0000 7fd0d5600640 1 --2- 172.21.15.112:0/2350173742 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd0d00ae8d0 0x7fd0d00cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:55.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.177+0000 7fd0d5600640 1 --2- 172.21.15.112:0/2350173742 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd0b006be60 0x7fd0b006e320 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:55.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.177+0000 7fd0d5600640 1 --2- 172.21.15.112:0/2350173742 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0d006dca0 0x7fd0d00c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:55.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.177+0000 7fd0d5600640 1 --2- 172.21.15.112:0/2350173742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0d006d8c0 0x7fd0d014df60 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:55.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.177+0000 7fd0d5600640 1 -- 172.21.15.112:0/2350173742 >> 172.21.15.112:0/2350173742 conn(0x7fd0d006bbd0 msgr2=0x7fd0d00b3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:55.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.177+0000 7fd0d5600640 1 -- 172.21.15.112:0/2350173742 shutdown_connections 2024-09-12T02:48:55.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.177+0000 7fd0d5600640 1 -- 172.21.15.112:0/2350173742 wait complete. 2024-09-12T02:48:55.194 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:48:55.194 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:48:55.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.346+0000 7f2d4f600640 1 Processor -- start 2024-09-12T02:48:55.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.346+0000 7f2d4f600640 1 -- start start 2024-09-12T02:48:55.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.347+0000 7f2d4f600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2d4815cc50 0x7f2d480732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:55.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.347+0000 7f2d4f600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2d480afe30 0x7f2d480cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:55.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.347+0000 7f2d4f600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d48073830 con 0x7f2d48071530 2024-09-12T02:48:55.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.348+0000 7f2d4f600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2d4815d030 con 0x7f2d480afe30 2024-09-12T02:48:55.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.348+0000 7f2d4f600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2d480cf4c0 con 0x7f2d4815cc50 2024-09-12T02:48:55.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.348+0000 7f2d4d600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2d480afe30 0x7f2d480cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:55.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.348+0000 7f2d3fe00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2d48071530 0x7f2d480af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33646/0 (socket says 172.21.15.112:33646) 2024-09-12T02:48:55.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.348+0000 7f2d3fe00640 1 -- 172.21.15.112:0/3248136877 learned_addr learned my addr 172.21.15.112:0/3248136877 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:55.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.348+0000 7f2d4cc00640 1 --2- 172.21.15.112:0/3248136877 >> v2:172.21.15.137:3300/0 conn(0x7f2d4815cc50 0x7f2d480732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:55.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.348+0000 7f2d4d600640 1 -- 172.21.15.112:0/3248136877 >> v2:172.21.15.137:3300/0 conn(0x7f2d4815cc50 msgr2=0x7f2d480732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:55.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.348+0000 7f2d4d600640 1 --2- 172.21.15.112:0/3248136877 >> v2:172.21.15.137:3300/0 conn(0x7f2d4815cc50 0x7f2d480732f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:55.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.348+0000 7f2d4d600640 1 -- 172.21.15.112:0/3248136877 >> v1:172.21.15.112:6789/0 conn(0x7f2d48071530 legacy=0x7f2d480af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:55.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.348+0000 7f2d4d600640 1 -- 172.21.15.112:0/3248136877 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d480ceeb0 con 0x7f2d480afe30 2024-09-12T02:48:55.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.348+0000 7f2d47e00640 1 -- 172.21.15.112:0/3248136877 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3324294788 0 0) 0x7f2d30001290 con 0x7f2d48071530 2024-09-12T02:48:55.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.349+0000 7f2d4d600640 1 --2- 172.21.15.112:0/3248136877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d480afe30 0x7f2d480cf950 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f2d48070060 tx=0x7f2d4002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d2816969163035 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:55.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.350+0000 7f2d47e00640 1 -- 172.21.15.112:0/3248136877 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d40007740 con 0x7f2d480afe30 2024-09-12T02:48:55.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.350+0000 7f2d47e00640 1 -- 172.21.15.112:0/3248136877 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d400078e0 con 0x7f2d480afe30 2024-09-12T02:48:55.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.350+0000 7f2d47e00640 1 -- 172.21.15.112:0/3248136877 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d40007cb0 con 0x7f2d480afe30 2024-09-12T02:48:55.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.350+0000 7f2d4f600640 1 -- 172.21.15.112:0/3248136877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d480afe30 msgr2=0x7f2d480cf950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:55.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.350+0000 7f2d4f600640 1 --2- 172.21.15.112:0/3248136877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d480afe30 0x7f2d480cf950 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f2d48070060 tx=0x7f2d4002a5f0 comp rx=0 tx=0).stop 2024-09-12T02:48:55.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.350+0000 7f2d4f600640 1 -- 172.21.15.112:0/3248136877 shutdown_connections 2024-09-12T02:48:55.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.350+0000 7f2d4f600640 1 --2- 172.21.15.112:0/3248136877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d480afe30 0x7f2d480cf950 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:55.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.350+0000 7f2d4f600640 1 --2- 172.21.15.112:0/3248136877 >> v2:172.21.15.137:3300/0 conn(0x7f2d4815cc50 0x7f2d480732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:55.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.350+0000 7f2d4f600640 1 -- 172.21.15.112:0/3248136877 >> 172.21.15.112:0/3248136877 conn(0x7f2d4806bbd0 msgr2=0x7f2d4806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:55.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.350+0000 7f2d4f600640 1 -- 172.21.15.112:0/3248136877 shutdown_connections 2024-09-12T02:48:55.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.350+0000 7f2d4f600640 1 -- 172.21.15.112:0/3248136877 wait complete. 2024-09-12T02:48:55.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.352+0000 7f2d4f600640 1 Processor -- start 2024-09-12T02:48:55.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.352+0000 7f2d4f600640 1 -- start start 2024-09-12T02:48:55.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.353+0000 7f2d4f600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d48071530 0x7f2d4813f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:55.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.353+0000 7f2d4f600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d480afe30 0x7f2d4814ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:55.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.353+0000 7f2d4f600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d4815cc50 0x7f2d4814f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:55.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.353+0000 7f2d4f600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2d480cf150 con 0x7f2d480afe30 2024-09-12T02:48:55.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.353+0000 7f2d4f600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4806e5e0 con 0x7f2d48071530 2024-09-12T02:48:55.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.353+0000 7f2d4f600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2d4806f510 con 0x7f2d4815cc50 2024-09-12T02:48:55.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.353+0000 7f2d3fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d480afe30 0x7f2d4814ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:55.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.353+0000 7f2d3fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d480afe30 0x7f2d4814ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39758/0 (socket says 172.21.15.112:39758) 2024-09-12T02:48:55.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.353+0000 7f2d3fe00640 1 -- 172.21.15.112:0/3360408064 learned_addr learned my addr 172.21.15.112:0/3360408064 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:55.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.353+0000 7f2d4cc00640 1 --2- 172.21.15.112:0/3360408064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d48071530 0x7f2d4813f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:55.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.354+0000 7f2d4d600640 1 --2- 172.21.15.112:0/3360408064 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d4815cc50 0x7f2d4814f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:55.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.354+0000 7f2d3fe00640 1 -- 172.21.15.112:0/3360408064 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d4815cc50 msgr2=0x7f2d4814f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:55.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.354+0000 7f2d3fe00640 1 --2- 172.21.15.112:0/3360408064 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d4815cc50 0x7f2d4814f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:55.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.354+0000 7f2d3fe00640 1 -- 172.21.15.112:0/3360408064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d48071530 msgr2=0x7f2d4813f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:55.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.354+0000 7f2d3fe00640 1 --2- 172.21.15.112:0/3360408064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d48071530 0x7f2d4813f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:55.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.354+0000 7f2d3fe00640 1 -- 172.21.15.112:0/3360408064 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d480b47a0 con 0x7f2d480afe30 2024-09-12T02:48:55.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.354+0000 7f2d4cc00640 1 --2- 172.21.15.112:0/3360408064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d48071530 0x7f2d4813f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:55.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.354+0000 7f2d3fe00640 1 --2- 172.21.15.112:0/3360408064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d480afe30 0x7f2d4814ecf0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f2d3000c4d0 tx=0x7f2d3000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:55.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.354+0000 7f2d45600640 1 -- 172.21.15.112:0/3360408064 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d30007480 con 0x7f2d480afe30 2024-09-12T02:48:55.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.354+0000 7f2d45600640 1 -- 172.21.15.112:0/3360408064 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d30007620 con 0x7f2d480afe30 2024-09-12T02:48:55.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.354+0000 7f2d45600640 1 -- 172.21.15.112:0/3360408064 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d300059c0 con 0x7f2d480afe30 2024-09-12T02:48:55.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.354+0000 7f2d4f600640 1 -- 172.21.15.112:0/3360408064 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d480b4a80 con 0x7f2d480afe30 2024-09-12T02:48:55.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.354+0000 7f2d4f600640 1 -- 172.21.15.112:0/3360408064 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d480b5040 con 0x7f2d480afe30 2024-09-12T02:48:55.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.355+0000 7f2d4f600640 1 -- 172.21.15.112:0/3360408064 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d48068a30 con 0x7f2d480afe30 2024-09-12T02:48:55.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.356+0000 7f2d45600640 1 -- 172.21.15.112:0/3360408064 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2d30005b60 con 0x7f2d480afe30 2024-09-12T02:48:55.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.357+0000 7f2d45600640 1 --2- 172.21.15.112:0/3360408064 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2d2406be30 0x7f2d2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:55.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.358+0000 7f2d45600640 1 -- 172.21.15.112:0/3360408064 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 5709+0+0 (secure 0 0 0) 0x7f2d3008ab10 con 0x7f2d480afe30 2024-09-12T02:48:55.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.358+0000 7f2d4cc00640 1 --2- 172.21.15.112:0/3360408064 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2d2406be30 0x7f2d2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:55.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.358+0000 7f2d4cc00640 1 --2- 172.21.15.112:0/3360408064 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2d2406be30 0x7f2d2406e2f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2d38009af0 tx=0x7f2d38008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:55.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.362+0000 7f2d45600640 1 -- 172.21.15.112:0/3360408064 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2d48073830 con 0x7f2d480afe30 2024-09-12T02:48:55.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.536+0000 7f2d4f600640 1 -- 172.21.15.112:0/3360408064 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2d4815c340 con 0x7f2d2406be30 2024-09-12T02:48:55.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.541+0000 7f2d45600640 1 -- 172.21.15.112:0/3360408064 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247991 (secure 0 0 0) 0x7f2d4815c340 con 0x7f2d2406be30 2024-09-12T02:48:55.545 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:55.547 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:48:55.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.545+0000 7f2d4f600640 1 -- 172.21.15.112:0/3360408064 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2d2406be30 msgr2=0x7f2d2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:55.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.545+0000 7f2d4f600640 1 --2- 172.21.15.112:0/3360408064 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2d2406be30 0x7f2d2406e2f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2d38009af0 tx=0x7f2d38008040 comp rx=0 tx=0).stop 2024-09-12T02:48:55.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.545+0000 7f2d4f600640 1 -- 172.21.15.112:0/3360408064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d480afe30 msgr2=0x7f2d4814ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:55.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.545+0000 7f2d4f600640 1 --2- 172.21.15.112:0/3360408064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d480afe30 0x7f2d4814ecf0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f2d3000c4d0 tx=0x7f2d3000c990 comp rx=0 tx=0).stop 2024-09-12T02:48:55.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.545+0000 7f2d4f600640 1 -- 172.21.15.112:0/3360408064 shutdown_connections 2024-09-12T02:48:55.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.545+0000 7f2d4f600640 1 --2- 172.21.15.112:0/3360408064 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d4815cc50 0x7f2d4814f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:55.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.545+0000 7f2d4f600640 1 --2- 172.21.15.112:0/3360408064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d480afe30 0x7f2d4814ecf0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:55.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.545+0000 7f2d4f600640 1 --2- 172.21.15.112:0/3360408064 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2d2406be30 0x7f2d2406e2f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:55.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.545+0000 7f2d4f600640 1 --2- 172.21.15.112:0/3360408064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d48071530 0x7f2d4813f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:55.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.545+0000 7f2d4f600640 1 -- 172.21.15.112:0/3360408064 >> 172.21.15.112:0/3360408064 conn(0x7f2d4806bbd0 msgr2=0x7f2d4806e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:55.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.545+0000 7f2d4f600640 1 -- 172.21.15.112:0/3360408064 shutdown_connections 2024-09-12T02:48:55.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.545+0000 7f2d4f600640 1 -- 172.21.15.112:0/3360408064 wait complete. 2024-09-12T02:48:55.561 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":358,"stamp":"2024-09-12T02:48:55.051428+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":138,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7666,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554833,"statfs":{"total":1600000000,"available":1592149892,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.673245"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445733+0000","last_change":"2024-09-12T02:48:51.412653+0000","last_active":"2024-09-12T02:48:52.445733+0000","last_peered":"2024-09-12T02:48:52.445733+0000","last_clean":"2024-09-12T02:48:52.445733+0000","last_became_active":"2024-09-12T02:48:51.412293+0000","last_became_peered":"2024-09-12T02:48:51.412293+0000","last_unstale":"2024-09-12T02:48:52.445733+0000","last_undegraded":"2024-09-12T02:48:52.445733+0000","last_fullsized":"2024-09-12T02:48:52.445733+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:13.198039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445819+0000","last_change":"2024-09-12T02:48:51.413659+0000","last_active":"2024-09-12T02:48:52.445819+0000","last_peered":"2024-09-12T02:48:52.445819+0000","last_clean":"2024-09-12T02:48:52.445819+0000","last_became_active":"2024-09-12T02:48:51.413411+0000","last_became_peered":"2024-09-12T02:48:51.413411+0000","last_unstale":"2024-09-12T02:48:52.445819+0000","last_undegraded":"2024-09-12T02:48:52.445819+0000","last_fullsized":"2024-09-12T02:48:52.445819+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:55.596617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.399079+0000","last_change":"2024-09-12T02:48:51.403370+0000","last_active":"2024-09-12T02:48:52.399079+0000","last_peered":"2024-09-12T02:48:52.399079+0000","last_clean":"2024-09-12T02:48:52.399079+0000","last_became_active":"2024-09-12T02:48:51.402501+0000","last_became_peered":"2024-09-12T02:48:51.402501+0000","last_unstale":"2024-09-12T02:48:52.399079+0000","last_undegraded":"2024-09-12T02:48:52.399079+0000","last_fullsized":"2024-09-12T02:48:52.399079+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:16.037608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445297+0000","last_change":"2024-09-12T02:48:51.413690+0000","last_active":"2024-09-12T02:48:52.445297+0000","last_peered":"2024-09-12T02:48:52.445297+0000","last_clean":"2024-09-12T02:48:52.445297+0000","last_became_active":"2024-09-12T02:48:51.413524+0000","last_became_peered":"2024-09-12T02:48:51.413524+0000","last_unstale":"2024-09-12T02:48:52.445297+0000","last_undegraded":"2024-09-12T02:48:52.445297+0000","last_fullsized":"2024-09-12T02:48:52.445297+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:43.707251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.417897+0000","last_change":"2024-09-12T02:48:51.416088+0000","last_active":"2024-09-12T02:48:52.417897+0000","last_peered":"2024-09-12T02:48:52.417897+0000","last_clean":"2024-09-12T02:48:52.417897+0000","last_became_active":"2024-09-12T02:48:51.414460+0000","last_became_peered":"2024-09-12T02:48:51.414460+0000","last_unstale":"2024-09-12T02:48:52.417897+0000","last_undegraded":"2024-09-12T02:48:52.417897+0000","last_fullsized":"2024-09-12T02:48:52.417897+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:49.390879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.419359+0000","last_change":"2024-09-12T02:48:51.410803+0000","last_active":"2024-09-12T02:48:52.419359+0000","last_peered":"2024-09-12T02:48:52.419359+0000","last_clean":"2024-09-12T02:48:52.419359+0000","last_became_active":"2024-09-12T02:48:51.410536+0000","last_became_peered":"2024-09-12T02:48:51.410536+0000","last_unstale":"2024-09-12T02:48:52.419359+0000","last_undegraded":"2024-09-12T02:48:52.419359+0000","last_fullsized":"2024-09-12T02:48:52.419359+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:36.025109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.419432+0000","last_change":"2024-09-12T02:48:51.407741+0000","last_active":"2024-09-12T02:48:52.419432+0000","last_peered":"2024-09-12T02:48:52.419432+0000","last_clean":"2024-09-12T02:48:52.419432+0000","last_became_active":"2024-09-12T02:48:51.406826+0000","last_became_peered":"2024-09-12T02:48:51.406826+0000","last_unstale":"2024-09-12T02:48:52.419432+0000","last_undegraded":"2024-09-12T02:48:52.419432+0000","last_fullsized":"2024-09-12T02:48:52.419432+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:59.923654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.399194+0000","last_change":"2024-09-12T02:48:51.405741+0000","last_active":"2024-09-12T02:48:52.399194+0000","last_peered":"2024-09-12T02:48:52.399194+0000","last_clean":"2024-09-12T02:48:52.399194+0000","last_became_active":"2024-09-12T02:48:51.403647+0000","last_became_peered":"2024-09-12T02:48:51.403647+0000","last_unstale":"2024-09-12T02:48:52.399194+0000","last_undegraded":"2024-09-12T02:48:52.399194+0000","last_fullsized":"2024-09-12T02:48:52.399194+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:46.116912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.399075+0000","last_change":"2024-09-12T02:48:51.403489+0000","last_active":"2024-09-12T02:48:52.399075+0000","last_peered":"2024-09-12T02:48:52.399075+0000","last_clean":"2024-09-12T02:48:52.399075+0000","last_became_active":"2024-09-12T02:48:51.403179+0000","last_became_peered":"2024-09-12T02:48:51.403179+0000","last_unstale":"2024-09-12T02:48:52.399075+0000","last_undegraded":"2024-09-12T02:48:52.399075+0000","last_fullsized":"2024-09-12T02:48:52.399075+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:08.513961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.446142+0000","last_change":"2024-09-12T02:48:51.410199+0000","last_active":"2024-09-12T02:48:52.446142+0000","last_peered":"2024-09-12T02:48:52.446142+0000","last_clean":"2024-09-12T02:48:52.446142+0000","last_became_active":"2024-09-12T02:48:51.409991+0000","last_became_peered":"2024-09-12T02:48:51.409991+0000","last_unstale":"2024-09-12T02:48:52.446142+0000","last_undegraded":"2024-09-12T02:48:52.446142+0000","last_fullsized":"2024-09-12T02:48:52.446142+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:48.792984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.446561+0000","last_change":"2024-09-12T02:48:51.411269+0000","last_active":"2024-09-12T02:48:52.446561+0000","last_peered":"2024-09-12T02:48:52.446561+0000","last_clean":"2024-09-12T02:48:52.446561+0000","last_became_active":"2024-09-12T02:48:51.410816+0000","last_became_peered":"2024-09-12T02:48:51.410816+0000","last_unstale":"2024-09-12T02:48:52.446561+0000","last_undegraded":"2024-09-12T02:48:52.446561+0000","last_fullsized":"2024-09-12T02:48:52.446561+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:50.476539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.399358+0000","last_change":"2024-09-12T02:48:51.404463+0000","last_active":"2024-09-12T02:48:52.399358+0000","last_peered":"2024-09-12T02:48:52.399358+0000","last_clean":"2024-09-12T02:48:52.399358+0000","last_became_active":"2024-09-12T02:48:51.403962+0000","last_became_peered":"2024-09-12T02:48:51.403962+0000","last_unstale":"2024-09-12T02:48:52.399358+0000","last_undegraded":"2024-09-12T02:48:52.399358+0000","last_fullsized":"2024-09-12T02:48:52.399358+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:53.700220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445346+0000","last_change":"2024-09-12T02:48:51.412063+0000","last_active":"2024-09-12T02:48:52.445346+0000","last_peered":"2024-09-12T02:48:52.445346+0000","last_clean":"2024-09-12T02:48:52.445346+0000","last_became_active":"2024-09-12T02:48:51.410385+0000","last_became_peered":"2024-09-12T02:48:51.410385+0000","last_unstale":"2024-09-12T02:48:52.445346+0000","last_undegraded":"2024-09-12T02:48:52.445346+0000","last_fullsized":"2024-09-12T02:48:52.445346+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:34.169918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445364+0000","last_change":"2024-09-12T02:48:51.408201+0000","last_active":"2024-09-12T02:48:52.445364+0000","last_peered":"2024-09-12T02:48:52.445364+0000","last_clean":"2024-09-12T02:48:52.445364+0000","last_became_active":"2024-09-12T02:48:51.407957+0000","last_became_peered":"2024-09-12T02:48:51.407957+0000","last_unstale":"2024-09-12T02:48:52.445364+0000","last_undegraded":"2024-09-12T02:48:52.445364+0000","last_fullsized":"2024-09-12T02:48:52.445364+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:24.989560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.446057+0000","last_change":"2024-09-12T02:48:51.411805+0000","last_active":"2024-09-12T02:48:52.446057+0000","last_peered":"2024-09-12T02:48:52.446057+0000","last_clean":"2024-09-12T02:48:52.446057+0000","last_became_active":"2024-09-12T02:48:51.409989+0000","last_became_peered":"2024-09-12T02:48:51.409989+0000","last_unstale":"2024-09-12T02:48:52.446057+0000","last_undegraded":"2024-09-12T02:48:52.446057+0000","last_fullsized":"2024-09-12T02:48:52.446057+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:22.954274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398723+0000","last_change":"2024-09-12T02:48:51.409783+0000","last_active":"2024-09-12T02:48:52.398723+0000","last_peered":"2024-09-12T02:48:52.398723+0000","last_clean":"2024-09-12T02:48:52.398723+0000","last_became_active":"2024-09-12T02:48:51.408197+0000","last_became_peered":"2024-09-12T02:48:51.408197+0000","last_unstale":"2024-09-12T02:48:52.398723+0000","last_undegraded":"2024-09-12T02:48:52.398723+0000","last_fullsized":"2024-09-12T02:48:52.398723+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:52.001781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.419683+0000","last_change":"2024-09-12T02:48:51.410724+0000","last_active":"2024-09-12T02:48:52.419683+0000","last_peered":"2024-09-12T02:48:52.419683+0000","last_clean":"2024-09-12T02:48:52.419683+0000","last_became_active":"2024-09-12T02:48:51.409949+0000","last_became_peered":"2024-09-12T02:48:51.409949+0000","last_unstale":"2024-09-12T02:48:52.419683+0000","last_undegraded":"2024-09-12T02:48:52.419683+0000","last_fullsized":"2024-09-12T02:48:52.419683+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:59.376270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398685+0000","last_change":"2024-09-12T02:48:51.403361+0000","last_active":"2024-09-12T02:48:52.398685+0000","last_peered":"2024-09-12T02:48:52.398685+0000","last_clean":"2024-09-12T02:48:52.398685+0000","last_became_active":"2024-09-12T02:48:51.402481+0000","last_became_peered":"2024-09-12T02:48:51.402481+0000","last_unstale":"2024-09-12T02:48:52.398685+0000","last_undegraded":"2024-09-12T02:48:52.398685+0000","last_fullsized":"2024-09-12T02:48:52.398685+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:23.844839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445171+0000","last_change":"2024-09-12T02:48:51.403785+0000","last_active":"2024-09-12T02:48:52.445171+0000","last_peered":"2024-09-12T02:48:52.445171+0000","last_clean":"2024-09-12T02:48:52.445171+0000","last_became_active":"2024-09-12T02:48:51.403551+0000","last_became_peered":"2024-09-12T02:48:51.403551+0000","last_unstale":"2024-09-12T02:48:52.445171+0000","last_undegraded":"2024-09-12T02:48:52.445171+0000","last_fullsized":"2024-09-12T02:48:52.445171+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:39.567470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398620+0000","last_change":"2024-09-12T02:48:51.403954+0000","last_active":"2024-09-12T02:48:52.398620+0000","last_peered":"2024-09-12T02:48:52.398620+0000","last_clean":"2024-09-12T02:48:52.398620+0000","last_became_active":"2024-09-12T02:48:51.403725+0000","last_became_peered":"2024-09-12T02:48:51.403725+0000","last_unstale":"2024-09-12T02:48:52.398620+0000","last_undegraded":"2024-09-12T02:48:52.398620+0000","last_fullsized":"2024-09-12T02:48:52.398620+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:33.456489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.417992+0000","last_change":"2024-09-12T02:48:51.414535+0000","last_active":"2024-09-12T02:48:52.417992+0000","last_peered":"2024-09-12T02:48:52.417992+0000","last_clean":"2024-09-12T02:48:52.417992+0000","last_became_active":"2024-09-12T02:48:51.414274+0000","last_became_peered":"2024-09-12T02:48:51.414274+0000","last_unstale":"2024-09-12T02:48:52.417992+0000","last_undegraded":"2024-09-12T02:48:52.417992+0000","last_fullsized":"2024-09-12T02:48:52.417992+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:48.891343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445346+0000","last_change":"2024-09-12T02:48:51.411731+0000","last_active":"2024-09-12T02:48:52.445346+0000","last_peered":"2024-09-12T02:48:52.445346+0000","last_clean":"2024-09-12T02:48:52.445346+0000","last_became_active":"2024-09-12T02:48:51.411463+0000","last_became_peered":"2024-09-12T02:48:51.411463+0000","last_unstale":"2024-09-12T02:48:52.445346+0000","last_undegraded":"2024-09-12T02:48:52.445346+0000","last_fullsized":"2024-09-12T02:48:52.445346+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:15.404721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.399399+0000","last_change":"2024-09-12T02:48:51.407159+0000","last_active":"2024-09-12T02:48:52.399399+0000","last_peered":"2024-09-12T02:48:52.399399+0000","last_clean":"2024-09-12T02:48:52.399399+0000","last_became_active":"2024-09-12T02:48:51.405184+0000","last_became_peered":"2024-09-12T02:48:51.405184+0000","last_unstale":"2024-09-12T02:48:52.399399+0000","last_undegraded":"2024-09-12T02:48:52.399399+0000","last_fullsized":"2024-09-12T02:48:52.399399+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:07.560089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445327+0000","last_change":"2024-09-12T02:48:51.405290+0000","last_active":"2024-09-12T02:48:52.445327+0000","last_peered":"2024-09-12T02:48:52.445327+0000","last_clean":"2024-09-12T02:48:52.445327+0000","last_became_active":"2024-09-12T02:48:51.404991+0000","last_became_peered":"2024-09-12T02:48:51.404991+0000","last_unstale":"2024-09-12T02:48:52.445327+0000","last_undegraded":"2024-09-12T02:48:52.445327+0000","last_fullsized":"2024-09-12T02:48:52.445327+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:03.916731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.446009+0000","last_change":"2024-09-12T02:48:51.414275+0000","last_active":"2024-09-12T02:48:52.446009+0000","last_peered":"2024-09-12T02:48:52.446009+0000","last_clean":"2024-09-12T02:48:52.446009+0000","last_became_active":"2024-09-12T02:48:51.413589+0000","last_became_peered":"2024-09-12T02:48:51.413589+0000","last_unstale":"2024-09-12T02:48:52.446009+0000","last_undegraded":"2024-09-12T02:48:52.446009+0000","last_fullsized":"2024-09-12T02:48:52.446009+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:46.636679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398806+0000","last_change":"2024-09-12T02:48:51.410014+0000","last_active":"2024-09-12T02:48:52.398806+0000","last_peered":"2024-09-12T02:48:52.398806+0000","last_clean":"2024-09-12T02:48:52.398806+0000","last_became_active":"2024-09-12T02:48:51.409527+0000","last_became_peered":"2024-09-12T02:48:51.409527+0000","last_unstale":"2024-09-12T02:48:52.398806+0000","last_undegraded":"2024-09-12T02:48:52.398806+0000","last_fullsized":"2024-09-12T02:48:52.398806+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:36.077579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445199+0000","last_change":"2024-09-12T02:48:51.408446+0000","last_active":"2024-09-12T02:48:52.445199+0000","last_peered":"2024-09-12T02:48:52.445199+0000","last_clean":"2024-09-12T02:48:52.445199+0000","last_became_active":"2024-09-12T02:48:51.407889+0000","last_became_peered":"2024-09-12T02:48:51.407889+0000","last_unstale":"2024-09-12T02:48:52.445199+0000","last_undegraded":"2024-09-12T02:48:52.445199+0000","last_fullsized":"2024-09-12T02:48:52.445199+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:24.259059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398110+0000","last_change":"2024-09-12T02:48:51.400473+0000","last_active":"2024-09-12T02:48:52.398110+0000","last_peered":"2024-09-12T02:48:52.398110+0000","last_clean":"2024-09-12T02:48:52.398110+0000","last_became_active":"2024-09-12T02:48:51.400170+0000","last_became_peered":"2024-09-12T02:48:51.400170+0000","last_unstale":"2024-09-12T02:48:52.398110+0000","last_undegraded":"2024-09-12T02:48:52.398110+0000","last_fullsized":"2024-09-12T02:48:52.398110+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:18.633804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445619+0000","last_change":"2024-09-12T02:48:51.405361+0000","last_active":"2024-09-12T02:48:52.445619+0000","last_peered":"2024-09-12T02:48:52.445619+0000","last_clean":"2024-09-12T02:48:52.445619+0000","last_became_active":"2024-09-12T02:48:51.405134+0000","last_became_peered":"2024-09-12T02:48:51.405134+0000","last_unstale":"2024-09-12T02:48:52.445619+0000","last_undegraded":"2024-09-12T02:48:52.445619+0000","last_fullsized":"2024-09-12T02:48:52.445619+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:26.805214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.446198+0000","last_change":"2024-09-12T02:48:51.411628+0000","last_active":"2024-09-12T02:48:52.446198+0000","last_peered":"2024-09-12T02:48:52.446198+0000","last_clean":"2024-09-12T02:48:52.446198+0000","last_became_active":"2024-09-12T02:48:51.409564+0000","last_became_peered":"2024-09-12T02:48:51.409564+0000","last_unstale":"2024-09-12T02:48:52.446198+0000","last_undegraded":"2024-09-12T02:48:52.446198+0000","last_fullsized":"2024-09-12T02:48:52.446198+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:57.579809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.417503+0000","last_change":"2024-09-12T02:48:51.417857+0000","last_active":"2024-09-12T02:48:52.417503+0000","last_peered":"2024-09-12T02:48:52.417503+0000","last_clean":"2024-09-12T02:48:52.417503+0000","last_became_active":"2024-09-12T02:48:51.417171+0000","last_became_peered":"2024-09-12T02:48:51.417171+0000","last_unstale":"2024-09-12T02:48:52.417503+0000","last_undegraded":"2024-09-12T02:48:52.417503+0000","last_fullsized":"2024-09-12T02:48:52.417503+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:17.598419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.419566+0000","last_change":"2024-09-12T02:48:51.408787+0000","last_active":"2024-09-12T02:48:52.419566+0000","last_peered":"2024-09-12T02:48:52.419566+0000","last_clean":"2024-09-12T02:48:52.419566+0000","last_became_active":"2024-09-12T02:48:51.407137+0000","last_became_peered":"2024-09-12T02:48:51.407137+0000","last_unstale":"2024-09-12T02:48:52.419566+0000","last_undegraded":"2024-09-12T02:48:52.419566+0000","last_fullsized":"2024-09-12T02:48:52.419566+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:35.495376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398536+0000","last_change":"2024-09-12T02:48:51.402334+0000","last_active":"2024-09-12T02:48:52.398536+0000","last_peered":"2024-09-12T02:48:52.398536+0000","last_clean":"2024-09-12T02:48:52.398536+0000","last_became_active":"2024-09-12T02:48:51.402098+0000","last_became_peered":"2024-09-12T02:48:51.402098+0000","last_unstale":"2024-09-12T02:48:52.398536+0000","last_undegraded":"2024-09-12T02:48:52.398536+0000","last_fullsized":"2024-09-12T02:48:52.398536+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:47.128352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"149'4","reported_seq":18,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.417720+0000","last_change":"2024-09-12T02:48:50.397021+0000","last_active":"2024-09-12T02:48:52.417720+0000","last_peered":"2024-09-12T02:48:52.417720+0000","last_clean":"2024-09-12T02:48:52.417720+0000","last_became_active":"2024-09-12T02:48:50.396422+0000","last_became_peered":"2024-09-12T02:48:50.396422+0000","last_unstale":"2024-09-12T02:48:52.417720+0000","last_undegraded":"2024-09-12T02:48:52.417720+0000","last_fullsized":"2024-09-12T02:48:52.417720+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:24:06.913962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.399546+0000","last_change":"2024-09-12T02:48:51.405473+0000","last_active":"2024-09-12T02:48:52.399546+0000","last_peered":"2024-09-12T02:48:52.399546+0000","last_clean":"2024-09-12T02:48:52.399546+0000","last_became_active":"2024-09-12T02:48:51.402954+0000","last_became_peered":"2024-09-12T02:48:51.402954+0000","last_unstale":"2024-09-12T02:48:52.399546+0000","last_undegraded":"2024-09-12T02:48:52.399546+0000","last_fullsized":"2024-09-12T02:48:52.399546+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:36.080669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"149'1","reported_seq":15,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398101+0000","last_change":"2024-09-12T02:48:50.391273+0000","last_active":"2024-09-12T02:48:52.398101+0000","last_peered":"2024-09-12T02:48:52.398101+0000","last_clean":"2024-09-12T02:48:52.398101+0000","last_became_active":"2024-09-12T02:48:50.391006+0000","last_became_peered":"2024-09-12T02:48:50.391006+0000","last_unstale":"2024-09-12T02:48:52.398101+0000","last_undegraded":"2024-09-12T02:48:52.398101+0000","last_fullsized":"2024-09-12T02:48:52.398101+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:10.697097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.417712+0000","last_change":"2024-09-12T02:48:51.416652+0000","last_active":"2024-09-12T02:48:52.417712+0000","last_peered":"2024-09-12T02:48:52.417712+0000","last_clean":"2024-09-12T02:48:52.417712+0000","last_became_active":"2024-09-12T02:48:51.415038+0000","last_became_peered":"2024-09-12T02:48:51.415038+0000","last_unstale":"2024-09-12T02:48:52.417712+0000","last_undegraded":"2024-09-12T02:48:52.417712+0000","last_fullsized":"2024-09-12T02:48:52.417712+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:32.018337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"149'2","reported_seq":16,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445024+0000","last_change":"2024-09-12T02:48:50.398627+0000","last_active":"2024-09-12T02:48:52.445024+0000","last_peered":"2024-09-12T02:48:52.445024+0000","last_clean":"2024-09-12T02:48:52.445024+0000","last_became_active":"2024-09-12T02:48:50.398279+0000","last_became_peered":"2024-09-12T02:48:50.398279+0000","last_unstale":"2024-09-12T02:48:52.445024+0000","last_undegraded":"2024-09-12T02:48:52.445024+0000","last_fullsized":"2024-09-12T02:48:52.445024+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:12.241225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.418085+0000","last_change":"2024-09-12T02:48:51.416598+0000","last_active":"2024-09-12T02:48:52.418085+0000","last_peered":"2024-09-12T02:48:52.418085+0000","last_clean":"2024-09-12T02:48:52.418085+0000","last_became_active":"2024-09-12T02:48:51.415653+0000","last_became_peered":"2024-09-12T02:48:51.415653+0000","last_unstale":"2024-09-12T02:48:52.418085+0000","last_undegraded":"2024-09-12T02:48:52.418085+0000","last_fullsized":"2024-09-12T02:48:52.418085+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:46.780837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"149'2","reported_seq":16,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445905+0000","last_change":"2024-09-12T02:48:50.397456+0000","last_active":"2024-09-12T02:48:52.445905+0000","last_peered":"2024-09-12T02:48:52.445905+0000","last_clean":"2024-09-12T02:48:52.445905+0000","last_became_active":"2024-09-12T02:48:50.397004+0000","last_became_peered":"2024-09-12T02:48:50.397004+0000","last_unstale":"2024-09-12T02:48:52.445905+0000","last_undegraded":"2024-09-12T02:48:52.445905+0000","last_fullsized":"2024-09-12T02:48:52.445905+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:16:10.308139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398829+0000","last_change":"2024-09-12T02:48:51.403536+0000","last_active":"2024-09-12T02:48:52.398829+0000","last_peered":"2024-09-12T02:48:52.398829+0000","last_clean":"2024-09-12T02:48:52.398829+0000","last_became_active":"2024-09-12T02:48:51.402986+0000","last_became_peered":"2024-09-12T02:48:51.402986+0000","last_unstale":"2024-09-12T02:48:52.398829+0000","last_undegraded":"2024-09-12T02:48:52.398829+0000","last_fullsized":"2024-09-12T02:48:52.398829+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:55.222345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"149'1","reported_seq":15,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445931+0000","last_change":"2024-09-12T02:48:50.389167+0000","last_active":"2024-09-12T02:48:52.445931+0000","last_peered":"2024-09-12T02:48:52.445931+0000","last_clean":"2024-09-12T02:48:52.445931+0000","last_became_active":"2024-09-12T02:48:50.388911+0000","last_became_peered":"2024-09-12T02:48:50.388911+0000","last_unstale":"2024-09-12T02:48:52.445931+0000","last_undegraded":"2024-09-12T02:48:52.445931+0000","last_fullsized":"2024-09-12T02:48:52.445931+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:57.692743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.419778+0000","last_change":"2024-09-12T02:48:51.410948+0000","last_active":"2024-09-12T02:48:52.419778+0000","last_peered":"2024-09-12T02:48:52.419778+0000","last_clean":"2024-09-12T02:48:52.419778+0000","last_became_active":"2024-09-12T02:48:51.410290+0000","last_became_peered":"2024-09-12T02:48:51.410290+0000","last_unstale":"2024-09-12T02:48:52.419778+0000","last_undegraded":"2024-09-12T02:48:52.419778+0000","last_fullsized":"2024-09-12T02:48:52.419778+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:35.728526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"149'1","reported_seq":15,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398919+0000","last_change":"2024-09-12T02:48:50.386906+0000","last_active":"2024-09-12T02:48:52.398919+0000","last_peered":"2024-09-12T02:48:52.398919+0000","last_clean":"2024-09-12T02:48:52.398919+0000","last_became_active":"2024-09-12T02:48:50.386523+0000","last_became_peered":"2024-09-12T02:48:50.386523+0000","last_unstale":"2024-09-12T02:48:52.398919+0000","last_undegraded":"2024-09-12T02:48:52.398919+0000","last_fullsized":"2024-09-12T02:48:52.398919+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:22.745048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.399456+0000","last_change":"2024-09-12T02:48:51.400140+0000","last_active":"2024-09-12T02:48:52.399456+0000","last_peered":"2024-09-12T02:48:52.399456+0000","last_clean":"2024-09-12T02:48:52.399456+0000","last_became_active":"2024-09-12T02:48:51.399850+0000","last_became_peered":"2024-09-12T02:48:51.399850+0000","last_unstale":"2024-09-12T02:48:52.399456+0000","last_undegraded":"2024-09-12T02:48:52.399456+0000","last_fullsized":"2024-09-12T02:48:52.399456+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:38.530846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.419305+0000","last_change":"2024-09-12T02:48:50.394096+0000","last_active":"2024-09-12T02:48:52.419305+0000","last_peered":"2024-09-12T02:48:52.419305+0000","last_clean":"2024-09-12T02:48:52.419305+0000","last_became_active":"2024-09-12T02:48:50.393779+0000","last_became_peered":"2024-09-12T02:48:50.393779+0000","last_unstale":"2024-09-12T02:48:52.419305+0000","last_undegraded":"2024-09-12T02:48:52.419305+0000","last_fullsized":"2024-09-12T02:48:52.419305+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:38.007389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445493+0000","last_change":"2024-09-12T02:48:51.405324+0000","last_active":"2024-09-12T02:48:52.445493+0000","last_peered":"2024-09-12T02:48:52.445493+0000","last_clean":"2024-09-12T02:48:52.445493+0000","last_became_active":"2024-09-12T02:48:51.405085+0000","last_became_peered":"2024-09-12T02:48:51.405085+0000","last_unstale":"2024-09-12T02:48:52.445493+0000","last_undegraded":"2024-09-12T02:48:52.445493+0000","last_fullsized":"2024-09-12T02:48:52.445493+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:25.654907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.446424+0000","last_change":"2024-09-12T02:48:50.387640+0000","last_active":"2024-09-12T02:48:52.446424+0000","last_peered":"2024-09-12T02:48:52.446424+0000","last_clean":"2024-09-12T02:48:52.446424+0000","last_became_active":"2024-09-12T02:48:50.387353+0000","last_became_peered":"2024-09-12T02:48:50.387353+0000","last_unstale":"2024-09-12T02:48:52.446424+0000","last_undegraded":"2024-09-12T02:48:52.446424+0000","last_fullsized":"2024-09-12T02:48:52.446424+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:49.439152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.446403+0000","last_change":"2024-09-12T02:48:51.409026+0000","last_active":"2024-09-12T02:48:52.446403+0000","last_peered":"2024-09-12T02:48:52.446403+0000","last_clean":"2024-09-12T02:48:52.446403+0000","last_became_active":"2024-09-12T02:48:51.408217+0000","last_became_peered":"2024-09-12T02:48:51.408217+0000","last_unstale":"2024-09-12T02:48:52.446403+0000","last_undegraded":"2024-09-12T02:48:52.446403+0000","last_fullsized":"2024-09-12T02:48:52.446403+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:06.197945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398247+0000","last_change":"2024-09-12T02:48:50.386802+0000","last_active":"2024-09-12T02:48:52.398247+0000","last_peered":"2024-09-12T02:48:52.398247+0000","last_clean":"2024-09-12T02:48:52.398247+0000","last_became_active":"2024-09-12T02:48:50.386433+0000","last_became_peered":"2024-09-12T02:48:50.386433+0000","last_unstale":"2024-09-12T02:48:52.398247+0000","last_undegraded":"2024-09-12T02:48:52.398247+0000","last_fullsized":"2024-09-12T02:48:52.398247+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:52.315259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.397955+0000","last_change":"2024-09-12T02:48:51.399564+0000","last_active":"2024-09-12T02:48:52.397955+0000","last_peered":"2024-09-12T02:48:52.397955+0000","last_clean":"2024-09-12T02:48:52.397955+0000","last_became_active":"2024-09-12T02:48:51.399327+0000","last_became_peered":"2024-09-12T02:48:51.399327+0000","last_unstale":"2024-09-12T02:48:52.397955+0000","last_undegraded":"2024-09-12T02:48:52.397955+0000","last_fullsized":"2024-09-12T02:48:52.397955+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:44.256704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398684+0000","last_change":"2024-09-12T02:48:50.388047+0000","last_active":"2024-09-12T02:48:52.398684+0000","last_peered":"2024-09-12T02:48:52.398684+0000","last_clean":"2024-09-12T02:48:52.398684+0000","last_became_active":"2024-09-12T02:48:50.385976+0000","last_became_peered":"2024-09-12T02:48:50.385976+0000","last_unstale":"2024-09-12T02:48:52.398684+0000","last_undegraded":"2024-09-12T02:48:52.398684+0000","last_fullsized":"2024-09-12T02:48:52.398684+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:46.521401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.417477+0000","last_change":"2024-09-12T02:48:51.412978+0000","last_active":"2024-09-12T02:48:52.417477+0000","last_peered":"2024-09-12T02:48:52.417477+0000","last_clean":"2024-09-12T02:48:52.417477+0000","last_became_active":"2024-09-12T02:48:51.412719+0000","last_became_peered":"2024-09-12T02:48:51.412719+0000","last_unstale":"2024-09-12T02:48:52.417477+0000","last_undegraded":"2024-09-12T02:48:52.417477+0000","last_fullsized":"2024-09-12T02:48:52.417477+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:46.758423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"149'3","reported_seq":17,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398236+0000","last_change":"2024-09-12T02:48:50.386147+0000","last_active":"2024-09-12T02:48:52.398236+0000","last_peered":"2024-09-12T02:48:52.398236+0000","last_clean":"2024-09-12T02:48:52.398236+0000","last_became_active":"2024-09-12T02:48:50.385478+0000","last_became_peered":"2024-09-12T02:48:50.385478+0000","last_unstale":"2024-09-12T02:48:52.398236+0000","last_undegraded":"2024-09-12T02:48:52.398236+0000","last_fullsized":"2024-09-12T02:48:52.398236+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:57.252779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.417584+0000","last_change":"2024-09-12T02:48:51.411755+0000","last_active":"2024-09-12T02:48:52.417584+0000","last_peered":"2024-09-12T02:48:52.417584+0000","last_clean":"2024-09-12T02:48:52.417584+0000","last_became_active":"2024-09-12T02:48:51.411254+0000","last_became_peered":"2024-09-12T02:48:51.411254+0000","last_unstale":"2024-09-12T02:48:52.417584+0000","last_undegraded":"2024-09-12T02:48:52.417584+0000","last_fullsized":"2024-09-12T02:48:52.417584+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:09.027027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"149'6","reported_seq":20,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.399288+0000","last_change":"2024-09-12T02:48:50.393624+0000","last_active":"2024-09-12T02:48:52.399288+0000","last_peered":"2024-09-12T02:48:52.399288+0000","last_clean":"2024-09-12T02:48:52.399288+0000","last_became_active":"2024-09-12T02:48:50.393366+0000","last_became_peered":"2024-09-12T02:48:50.393366+0000","last_unstale":"2024-09-12T02:48:52.399288+0000","last_undegraded":"2024-09-12T02:48:52.399288+0000","last_fullsized":"2024-09-12T02:48:52.399288+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:45.179275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.446390+0000","last_change":"2024-09-12T02:48:51.405647+0000","last_active":"2024-09-12T02:48:52.446390+0000","last_peered":"2024-09-12T02:48:52.446390+0000","last_clean":"2024-09-12T02:48:52.446390+0000","last_became_active":"2024-09-12T02:48:51.405314+0000","last_became_peered":"2024-09-12T02:48:51.405314+0000","last_unstale":"2024-09-12T02:48:52.446390+0000","last_undegraded":"2024-09-12T02:48:52.446390+0000","last_fullsized":"2024-09-12T02:48:52.446390+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:53.976358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445933+0000","last_change":"2024-09-12T02:48:50.383689+0000","last_active":"2024-09-12T02:48:52.445933+0000","last_peered":"2024-09-12T02:48:52.445933+0000","last_clean":"2024-09-12T02:48:52.445933+0000","last_became_active":"2024-09-12T02:48:50.383394+0000","last_became_peered":"2024-09-12T02:48:50.383394+0000","last_unstale":"2024-09-12T02:48:52.445933+0000","last_undegraded":"2024-09-12T02:48:52.445933+0000","last_fullsized":"2024-09-12T02:48:52.445933+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:32.382561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445554+0000","last_change":"2024-09-12T02:48:51.408742+0000","last_active":"2024-09-12T02:48:52.445554+0000","last_peered":"2024-09-12T02:48:52.445554+0000","last_clean":"2024-09-12T02:48:52.445554+0000","last_became_active":"2024-09-12T02:48:51.408534+0000","last_became_peered":"2024-09-12T02:48:51.408534+0000","last_unstale":"2024-09-12T02:48:52.445554+0000","last_undegraded":"2024-09-12T02:48:52.445554+0000","last_fullsized":"2024-09-12T02:48:52.445554+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:48.884652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.446029+0000","last_change":"2024-09-12T02:48:50.394139+0000","last_active":"2024-09-12T02:48:52.446029+0000","last_peered":"2024-09-12T02:48:52.446029+0000","last_clean":"2024-09-12T02:48:52.446029+0000","last_became_active":"2024-09-12T02:48:50.393883+0000","last_became_peered":"2024-09-12T02:48:50.393883+0000","last_unstale":"2024-09-12T02:48:52.446029+0000","last_undegraded":"2024-09-12T02:48:52.446029+0000","last_fullsized":"2024-09-12T02:48:52.446029+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:15.762104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.399552+0000","last_change":"2024-09-12T02:48:51.404202+0000","last_active":"2024-09-12T02:48:52.399552+0000","last_peered":"2024-09-12T02:48:52.399552+0000","last_clean":"2024-09-12T02:48:52.399552+0000","last_became_active":"2024-09-12T02:48:51.403635+0000","last_became_peered":"2024-09-12T02:48:51.403635+0000","last_unstale":"2024-09-12T02:48:52.399552+0000","last_undegraded":"2024-09-12T02:48:52.399552+0000","last_fullsized":"2024-09-12T02:48:52.399552+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:59.237029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"149'8","reported_seq":22,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.399650+0000","last_change":"2024-09-12T02:48:50.384021+0000","last_active":"2024-09-12T02:48:52.399650+0000","last_peered":"2024-09-12T02:48:52.399650+0000","last_clean":"2024-09-12T02:48:52.399650+0000","last_became_active":"2024-09-12T02:48:50.383625+0000","last_became_peered":"2024-09-12T02:48:50.383625+0000","last_unstale":"2024-09-12T02:48:52.399650+0000","last_undegraded":"2024-09-12T02:48:52.399650+0000","last_fullsized":"2024-09-12T02:48:52.399650+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:43:53.399662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.399623+0000","last_change":"2024-09-12T02:48:51.405517+0000","last_active":"2024-09-12T02:48:52.399623+0000","last_peered":"2024-09-12T02:48:52.399623+0000","last_clean":"2024-09-12T02:48:52.399623+0000","last_became_active":"2024-09-12T02:48:51.403862+0000","last_became_peered":"2024-09-12T02:48:51.403862+0000","last_unstale":"2024-09-12T02:48:52.399623+0000","last_undegraded":"2024-09-12T02:48:52.399623+0000","last_fullsized":"2024-09-12T02:48:52.399623+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:30.253916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"149'1","reported_seq":15,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398232+0000","last_change":"2024-09-12T02:48:50.393859+0000","last_active":"2024-09-12T02:48:52.398232+0000","last_peered":"2024-09-12T02:48:52.398232+0000","last_clean":"2024-09-12T02:48:52.398232+0000","last_became_active":"2024-09-12T02:48:50.393634+0000","last_became_peered":"2024-09-12T02:48:50.393634+0000","last_unstale":"2024-09-12T02:48:52.398232+0000","last_undegraded":"2024-09-12T02:48:52.398232+0000","last_fullsized":"2024-09-12T02:48:52.398232+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:34.886672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.397963+0000","last_change":"2024-09-12T02:48:51.403960+0000","last_active":"2024-09-12T02:48:52.397963+0000","last_peered":"2024-09-12T02:48:52.397963+0000","last_clean":"2024-09-12T02:48:52.397963+0000","last_became_active":"2024-09-12T02:48:51.403543+0000","last_became_peered":"2024-09-12T02:48:51.403543+0000","last_unstale":"2024-09-12T02:48:52.397963+0000","last_undegraded":"2024-09-12T02:48:52.397963+0000","last_fullsized":"2024-09-12T02:48:52.397963+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:37.469238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"149'2","reported_seq":16,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445099+0000","last_change":"2024-09-12T02:48:50.396724+0000","last_active":"2024-09-12T02:48:52.445099+0000","last_peered":"2024-09-12T02:48:52.445099+0000","last_clean":"2024-09-12T02:48:52.445099+0000","last_became_active":"2024-09-12T02:48:50.393984+0000","last_became_peered":"2024-09-12T02:48:50.393984+0000","last_unstale":"2024-09-12T02:48:52.445099+0000","last_undegraded":"2024-09-12T02:48:52.445099+0000","last_fullsized":"2024-09-12T02:48:52.445099+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:10.502036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398592+0000","last_change":"2024-09-12T02:48:51.408728+0000","last_active":"2024-09-12T02:48:52.398592+0000","last_peered":"2024-09-12T02:48:52.398592+0000","last_clean":"2024-09-12T02:48:52.398592+0000","last_became_active":"2024-09-12T02:48:51.408506+0000","last_became_peered":"2024-09-12T02:48:51.408506+0000","last_unstale":"2024-09-12T02:48:52.398592+0000","last_undegraded":"2024-09-12T02:48:52.398592+0000","last_fullsized":"2024-09-12T02:48:52.398592+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:26.941969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"149'1","reported_seq":15,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.419603+0000","last_change":"2024-09-12T02:48:50.385458+0000","last_active":"2024-09-12T02:48:52.419603+0000","last_peered":"2024-09-12T02:48:52.419603+0000","last_clean":"2024-09-12T02:48:52.419603+0000","last_became_active":"2024-09-12T02:48:50.385161+0000","last_became_peered":"2024-09-12T02:48:50.385161+0000","last_unstale":"2024-09-12T02:48:52.419603+0000","last_undegraded":"2024-09-12T02:48:52.419603+0000","last_fullsized":"2024-09-12T02:48:52.419603+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:17.070730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.446033+0000","last_change":"2024-09-12T02:48:51.409016+0000","last_active":"2024-09-12T02:48:52.446033+0000","last_peered":"2024-09-12T02:48:52.446033+0000","last_clean":"2024-09-12T02:48:52.446033+0000","last_became_active":"2024-09-12T02:48:51.406502+0000","last_became_peered":"2024-09-12T02:48:51.406502+0000","last_unstale":"2024-09-12T02:48:52.446033+0000","last_undegraded":"2024-09-12T02:48:52.446033+0000","last_fullsized":"2024-09-12T02:48:52.446033+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:59.201654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398035+0000","last_change":"2024-09-12T02:48:50.392908+0000","last_active":"2024-09-12T02:48:52.398035+0000","last_peered":"2024-09-12T02:48:52.398035+0000","last_clean":"2024-09-12T02:48:52.398035+0000","last_became_active":"2024-09-12T02:48:50.392658+0000","last_became_peered":"2024-09-12T02:48:50.392658+0000","last_unstale":"2024-09-12T02:48:52.398035+0000","last_undegraded":"2024-09-12T02:48:52.398035+0000","last_fullsized":"2024-09-12T02:48:52.398035+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:32.837760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445431+0000","last_change":"2024-09-12T02:48:51.411139+0000","last_active":"2024-09-12T02:48:52.445431+0000","last_peered":"2024-09-12T02:48:52.445431+0000","last_clean":"2024-09-12T02:48:52.445431+0000","last_became_active":"2024-09-12T02:48:51.410905+0000","last_became_peered":"2024-09-12T02:48:51.410905+0000","last_unstale":"2024-09-12T02:48:52.445431+0000","last_undegraded":"2024-09-12T02:48:52.445431+0000","last_fullsized":"2024-09-12T02:48:52.445431+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:38.902122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"149'2","reported_seq":16,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398373+0000","last_change":"2024-09-12T02:48:50.386742+0000","last_active":"2024-09-12T02:48:52.398373+0000","last_peered":"2024-09-12T02:48:52.398373+0000","last_clean":"2024-09-12T02:48:52.398373+0000","last_became_active":"2024-09-12T02:48:50.386466+0000","last_became_peered":"2024-09-12T02:48:50.386466+0000","last_unstale":"2024-09-12T02:48:52.398373+0000","last_undegraded":"2024-09-12T02:48:52.398373+0000","last_fullsized":"2024-09-12T02:48:52.398373+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:54.717021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.419282+0000","last_change":"2024-09-12T02:48:51.405538+0000","last_active":"2024-09-12T02:48:52.419282+0000","last_peered":"2024-09-12T02:48:52.419282+0000","last_clean":"2024-09-12T02:48:52.419282+0000","last_became_active":"2024-09-12T02:48:51.405137+0000","last_became_peered":"2024-09-12T02:48:51.405137+0000","last_unstale":"2024-09-12T02:48:52.419282+0000","last_undegraded":"2024-09-12T02:48:52.419282+0000","last_fullsized":"2024-09-12T02:48:52.419282+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:19.469200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398760+0000","last_change":"2024-09-12T02:48:50.384642+0000","last_active":"2024-09-12T02:48:52.398760+0000","last_peered":"2024-09-12T02:48:52.398760+0000","last_clean":"2024-09-12T02:48:52.398760+0000","last_became_active":"2024-09-12T02:48:50.384408+0000","last_became_peered":"2024-09-12T02:48:50.384408+0000","last_unstale":"2024-09-12T02:48:52.398760+0000","last_undegraded":"2024-09-12T02:48:52.398760+0000","last_fullsized":"2024-09-12T02:48:52.398760+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:00.951217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445815+0000","last_change":"2024-09-12T02:48:51.406710+0000","last_active":"2024-09-12T02:48:52.445815+0000","last_peered":"2024-09-12T02:48:52.445815+0000","last_clean":"2024-09-12T02:48:52.445815+0000","last_became_active":"2024-09-12T02:48:51.406183+0000","last_became_peered":"2024-09-12T02:48:51.406183+0000","last_unstale":"2024-09-12T02:48:52.445815+0000","last_undegraded":"2024-09-12T02:48:52.445815+0000","last_fullsized":"2024-09-12T02:48:52.445815+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:23.087911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398721+0000","last_change":"2024-09-12T02:48:50.385737+0000","last_active":"2024-09-12T02:48:52.398721+0000","last_peered":"2024-09-12T02:48:52.398721+0000","last_clean":"2024-09-12T02:48:52.398721+0000","last_became_active":"2024-09-12T02:48:50.384881+0000","last_became_peered":"2024-09-12T02:48:50.384881+0000","last_unstale":"2024-09-12T02:48:52.398721+0000","last_undegraded":"2024-09-12T02:48:52.398721+0000","last_fullsized":"2024-09-12T02:48:52.398721+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:27.782581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.417727+0000","last_change":"2024-09-12T02:48:51.416326+0000","last_active":"2024-09-12T02:48:52.417727+0000","last_peered":"2024-09-12T02:48:52.417727+0000","last_clean":"2024-09-12T02:48:52.417727+0000","last_became_active":"2024-09-12T02:48:51.414825+0000","last_became_peered":"2024-09-12T02:48:51.414825+0000","last_unstale":"2024-09-12T02:48:52.417727+0000","last_undegraded":"2024-09-12T02:48:52.417727+0000","last_fullsized":"2024-09-12T02:48:52.417727+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:12.133309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.446778+0000","last_change":"2024-09-12T02:48:50.388608+0000","last_active":"2024-09-12T02:48:52.446778+0000","last_peered":"2024-09-12T02:48:52.446778+0000","last_clean":"2024-09-12T02:48:52.446778+0000","last_became_active":"2024-09-12T02:48:50.387983+0000","last_became_peered":"2024-09-12T02:48:50.387983+0000","last_unstale":"2024-09-12T02:48:52.446778+0000","last_undegraded":"2024-09-12T02:48:52.446778+0000","last_fullsized":"2024-09-12T02:48:52.446778+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:01.985939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.419387+0000","last_change":"2024-09-12T02:48:51.405359+0000","last_active":"2024-09-12T02:48:52.419387+0000","last_peered":"2024-09-12T02:48:52.419387+0000","last_clean":"2024-09-12T02:48:52.419387+0000","last_became_active":"2024-09-12T02:48:51.404399+0000","last_became_peered":"2024-09-12T02:48:51.404399+0000","last_unstale":"2024-09-12T02:48:52.419387+0000","last_undegraded":"2024-09-12T02:48:52.419387+0000","last_fullsized":"2024-09-12T02:48:52.419387+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:24.354463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"149'2","reported_seq":16,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.446530+0000","last_change":"2024-09-12T02:48:50.386428+0000","last_active":"2024-09-12T02:48:52.446530+0000","last_peered":"2024-09-12T02:48:52.446530+0000","last_clean":"2024-09-12T02:48:52.446530+0000","last_became_active":"2024-09-12T02:48:50.386136+0000","last_became_peered":"2024-09-12T02:48:50.386136+0000","last_unstale":"2024-09-12T02:48:52.446530+0000","last_undegraded":"2024-09-12T02:48:52.446530+0000","last_fullsized":"2024-09-12T02:48:52.446530+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:44:52.787612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.446258+0000","last_change":"2024-09-12T02:48:51.409246+0000","last_active":"2024-09-12T02:48:52.446258+0000","last_peered":"2024-09-12T02:48:52.446258+0000","last_clean":"2024-09-12T02:48:52.446258+0000","last_became_active":"2024-09-12T02:48:51.408773+0000","last_became_peered":"2024-09-12T02:48:51.408773+0000","last_unstale":"2024-09-12T02:48:52.446258+0000","last_undegraded":"2024-09-12T02:48:52.446258+0000","last_fullsized":"2024-09-12T02:48:52.446258+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:35.132670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"150'1","reported_seq":15,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.418885+0000","last_change":"2024-09-12T02:48:50.397206+0000","last_active":"2024-09-12T02:48:52.418885+0000","last_peered":"2024-09-12T02:48:52.418885+0000","last_clean":"2024-09-12T02:48:52.418885+0000","last_became_active":"2024-09-12T02:48:50.396776+0000","last_became_peered":"2024-09-12T02:48:50.396776+0000","last_unstale":"2024-09-12T02:48:52.418885+0000","last_undegraded":"2024-09-12T02:48:52.418885+0000","last_fullsized":"2024-09-12T02:48:52.418885+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:48.080240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.446339+0000","last_change":"2024-09-12T02:48:51.414482+0000","last_active":"2024-09-12T02:48:52.446339+0000","last_peered":"2024-09-12T02:48:52.446339+0000","last_clean":"2024-09-12T02:48:52.446339+0000","last_became_active":"2024-09-12T02:48:51.413922+0000","last_became_peered":"2024-09-12T02:48:51.413922+0000","last_unstale":"2024-09-12T02:48:52.446339+0000","last_undegraded":"2024-09-12T02:48:52.446339+0000","last_fullsized":"2024-09-12T02:48:52.446339+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:25.917508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445574+0000","last_change":"2024-09-12T02:48:50.388496+0000","last_active":"2024-09-12T02:48:52.445574+0000","last_peered":"2024-09-12T02:48:52.445574+0000","last_clean":"2024-09-12T02:48:52.445574+0000","last_became_active":"2024-09-12T02:48:50.387711+0000","last_became_peered":"2024-09-12T02:48:50.387711+0000","last_unstale":"2024-09-12T02:48:52.445574+0000","last_undegraded":"2024-09-12T02:48:52.445574+0000","last_fullsized":"2024-09-12T02:48:52.445574+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:36.665302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.419157+0000","last_change":"2024-09-12T02:48:51.410287+0000","last_active":"2024-09-12T02:48:52.419157+0000","last_peered":"2024-09-12T02:48:52.419157+0000","last_clean":"2024-09-12T02:48:52.419157+0000","last_became_active":"2024-09-12T02:48:51.410054+0000","last_became_peered":"2024-09-12T02:48:51.410054+0000","last_unstale":"2024-09-12T02:48:52.419157+0000","last_undegraded":"2024-09-12T02:48:52.419157+0000","last_fullsized":"2024-09-12T02:48:52.419157+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:17:38.501130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445180+0000","last_change":"2024-09-12T02:48:50.397343+0000","last_active":"2024-09-12T02:48:52.445180+0000","last_peered":"2024-09-12T02:48:52.445180+0000","last_clean":"2024-09-12T02:48:52.445180+0000","last_became_active":"2024-09-12T02:48:50.394886+0000","last_became_peered":"2024-09-12T02:48:50.394886+0000","last_unstale":"2024-09-12T02:48:52.445180+0000","last_undegraded":"2024-09-12T02:48:52.445180+0000","last_fullsized":"2024-09-12T02:48:52.445180+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:57.059133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.417480+0000","last_change":"2024-09-12T02:48:51.415337+0000","last_active":"2024-09-12T02:48:52.417480+0000","last_peered":"2024-09-12T02:48:52.417480+0000","last_clean":"2024-09-12T02:48:52.417480+0000","last_became_active":"2024-09-12T02:48:51.415087+0000","last_became_peered":"2024-09-12T02:48:51.415087+0000","last_unstale":"2024-09-12T02:48:52.417480+0000","last_undegraded":"2024-09-12T02:48:52.417480+0000","last_fullsized":"2024-09-12T02:48:52.417480+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:16.175781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.446126+0000","last_change":"2024-09-12T02:48:50.393440+0000","last_active":"2024-09-12T02:48:52.446126+0000","last_peered":"2024-09-12T02:48:52.446126+0000","last_clean":"2024-09-12T02:48:52.446126+0000","last_became_active":"2024-09-12T02:48:50.393120+0000","last_became_peered":"2024-09-12T02:48:50.393120+0000","last_unstale":"2024-09-12T02:48:52.446126+0000","last_undegraded":"2024-09-12T02:48:52.446126+0000","last_fullsized":"2024-09-12T02:48:52.446126+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:40.147675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398138+0000","last_change":"2024-09-12T02:48:51.408672+0000","last_active":"2024-09-12T02:48:52.398138+0000","last_peered":"2024-09-12T02:48:52.398138+0000","last_clean":"2024-09-12T02:48:52.398138+0000","last_became_active":"2024-09-12T02:48:51.408443+0000","last_became_peered":"2024-09-12T02:48:51.408443+0000","last_unstale":"2024-09-12T02:48:52.398138+0000","last_undegraded":"2024-09-12T02:48:52.398138+0000","last_fullsized":"2024-09-12T02:48:52.398138+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:23.335912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.417700+0000","last_change":"2024-09-12T02:48:50.398713+0000","last_active":"2024-09-12T02:48:52.417700+0000","last_peered":"2024-09-12T02:48:52.417700+0000","last_clean":"2024-09-12T02:48:52.417700+0000","last_became_active":"2024-09-12T02:48:50.398499+0000","last_became_peered":"2024-09-12T02:48:50.398499+0000","last_unstale":"2024-09-12T02:48:52.417700+0000","last_undegraded":"2024-09-12T02:48:52.417700+0000","last_fullsized":"2024-09-12T02:48:52.417700+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:27.383780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398672+0000","last_change":"2024-09-12T02:48:51.400720+0000","last_active":"2024-09-12T02:48:52.398672+0000","last_peered":"2024-09-12T02:48:52.398672+0000","last_clean":"2024-09-12T02:48:52.398672+0000","last_became_active":"2024-09-12T02:48:51.400467+0000","last_became_peered":"2024-09-12T02:48:51.400467+0000","last_unstale":"2024-09-12T02:48:52.398672+0000","last_undegraded":"2024-09-12T02:48:52.398672+0000","last_fullsized":"2024-09-12T02:48:52.398672+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:54.020042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.399004+0000","last_change":"2024-09-12T02:48:50.385509+0000","last_active":"2024-09-12T02:48:52.399004+0000","last_peered":"2024-09-12T02:48:52.399004+0000","last_clean":"2024-09-12T02:48:52.399004+0000","last_became_active":"2024-09-12T02:48:50.385177+0000","last_became_peered":"2024-09-12T02:48:50.385177+0000","last_unstale":"2024-09-12T02:48:52.399004+0000","last_undegraded":"2024-09-12T02:48:52.399004+0000","last_fullsized":"2024-09-12T02:48:52.399004+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:17.586853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445687+0000","last_change":"2024-09-12T02:48:51.412557+0000","last_active":"2024-09-12T02:48:52.445687+0000","last_peered":"2024-09-12T02:48:52.445687+0000","last_clean":"2024-09-12T02:48:52.445687+0000","last_became_active":"2024-09-12T02:48:51.411738+0000","last_became_peered":"2024-09-12T02:48:51.411738+0000","last_unstale":"2024-09-12T02:48:52.445687+0000","last_undegraded":"2024-09-12T02:48:52.445687+0000","last_fullsized":"2024-09-12T02:48:52.445687+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:58.098980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445483+0000","last_change":"2024-09-12T02:48:50.391689+0000","last_active":"2024-09-12T02:48:52.445483+0000","last_peered":"2024-09-12T02:48:52.445483+0000","last_clean":"2024-09-12T02:48:52.445483+0000","last_became_active":"2024-09-12T02:48:50.390695+0000","last_became_peered":"2024-09-12T02:48:50.390695+0000","last_unstale":"2024-09-12T02:48:52.445483+0000","last_undegraded":"2024-09-12T02:48:52.445483+0000","last_fullsized":"2024-09-12T02:48:52.445483+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:10.646176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.417876+0000","last_change":"2024-09-12T02:48:51.418110+0000","last_active":"2024-09-12T02:48:52.417876+0000","last_peered":"2024-09-12T02:48:52.417876+0000","last_clean":"2024-09-12T02:48:52.417876+0000","last_became_active":"2024-09-12T02:48:51.417515+0000","last_became_peered":"2024-09-12T02:48:51.417515+0000","last_unstale":"2024-09-12T02:48:52.417876+0000","last_undegraded":"2024-09-12T02:48:52.417876+0000","last_fullsized":"2024-09-12T02:48:52.417876+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:19.641688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"149'2","reported_seq":16,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.418192+0000","last_change":"2024-09-12T02:48:50.397683+0000","last_active":"2024-09-12T02:48:52.418192+0000","last_peered":"2024-09-12T02:48:52.418192+0000","last_clean":"2024-09-12T02:48:52.418192+0000","last_became_active":"2024-09-12T02:48:50.397439+0000","last_became_peered":"2024-09-12T02:48:50.397439+0000","last_unstale":"2024-09-12T02:48:52.418192+0000","last_undegraded":"2024-09-12T02:48:52.418192+0000","last_fullsized":"2024-09-12T02:48:52.418192+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:10.559329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":421,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.417787+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:48:52.417787+0000","last_peered":"2024-09-12T02:48:52.417787+0000","last_clean":"2024-09-12T02:48:52.417787+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:48:52.417787+0000","last_undegraded":"2024-09-12T02:48:52.417787+0000","last_fullsized":"2024-09-12T02:48:52.417787+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:25.823876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574936,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1393,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193918,"statfs":{"total":200000000,"available":198572738,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574936,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":810,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194501,"statfs":{"total":200000000,"available":199170044,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574936,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":815,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194497,"statfs":{"total":200000000,"available":199165244,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574936,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":815,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194497,"statfs":{"total":200000000,"available":199165286,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574936,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":815,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194497,"statfs":{"total":200000000,"available":199165196,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574936,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":815,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194496,"statfs":{"total":200000000,"available":199164740,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":808,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194503,"statfs":{"total":200000000,"available":199171656,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574936,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1391,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193920,"statfs":{"total":200000000,"available":198574988,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:48:55.566 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:48:55.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.755+0000 7ff256e00640 1 Processor -- start 2024-09-12T02:48:55.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.755+0000 7ff256e00640 1 -- start start 2024-09-12T02:48:55.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.756+0000 7ff256e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2500d1710 0x7ff2500d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:55.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.756+0000 7ff256e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff2500b3e00 0x7ff2500d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:55.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.756+0000 7ff256e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff2500cf7a0 0x7ff2500cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:55.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.756+0000 7ff256e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff2500d3cb0 con 0x7ff2500b3e00 2024-09-12T02:48:55.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.756+0000 7ff256e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff2500d2fb0 con 0x7ff2500cf7a0 2024-09-12T02:48:55.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.756+0000 7ff256e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff2500d0b60 con 0x7ff2500d1710 2024-09-12T02:48:55.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.756+0000 7ff255000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff2500b3e00 0x7ff2500d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:55.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.756+0000 7ff255000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff2500b3e00 0x7ff2500d1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39770/0 (socket says 172.21.15.112:39770) 2024-09-12T02:48:55.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.756+0000 7ff255000640 1 -- 172.21.15.112:0/1192390463 learned_addr learned my addr 172.21.15.112:0/1192390463 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:55.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.757+0000 7ff256400640 1 --2- 172.21.15.112:0/1192390463 >> v2:172.21.15.137:3300/0 conn(0x7ff2500cf7a0 0x7ff2500cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:55.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.757+0000 7ff255a00640 1 --2- 172.21.15.112:0/1192390463 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2500d1710 0x7ff2500d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:55.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.757+0000 7ff255000640 1 -- 172.21.15.112:0/1192390463 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2500d1710 msgr2=0x7ff2500d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:55.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.757+0000 7ff255000640 1 --2- 172.21.15.112:0/1192390463 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2500d1710 0x7ff2500d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:55.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.757+0000 7ff255000640 1 -- 172.21.15.112:0/1192390463 >> v2:172.21.15.137:3300/0 conn(0x7ff2500cf7a0 msgr2=0x7ff2500cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:55.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.757+0000 7ff255000640 1 --2- 172.21.15.112:0/1192390463 >> v2:172.21.15.137:3300/0 conn(0x7ff2500cf7a0 0x7ff2500cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:55.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.757+0000 7ff255000640 1 -- 172.21.15.112:0/1192390463 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2500d2030 con 0x7ff2500b3e00 2024-09-12T02:48:55.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.757+0000 7ff255a00640 1 --2- 172.21.15.112:0/1192390463 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2500d1710 0x7ff2500d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:55.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.757+0000 7ff256400640 1 --2- 172.21.15.112:0/1192390463 >> v2:172.21.15.137:3300/0 conn(0x7ff2500cf7a0 0x7ff2500cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:55.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.758+0000 7ff255000640 1 --2- 172.21.15.112:0/1192390463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2500b3e00 0x7ff2500d1af0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7ff25008e040 tx=0x7ff23c02a1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b647f26a81db5a73 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:55.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.758+0000 7ff24fe00640 1 -- 172.21.15.112:0/1192390463 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23c037070 con 0x7ff2500b3e00 2024-09-12T02:48:55.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.758+0000 7ff24fe00640 1 -- 172.21.15.112:0/1192390463 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff23c032440 con 0x7ff2500b3e00 2024-09-12T02:48:55.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.758+0000 7ff24fe00640 1 -- 172.21.15.112:0/1192390463 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23c032810 con 0x7ff2500b3e00 2024-09-12T02:48:55.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.759+0000 7ff256e00640 1 -- 172.21.15.112:0/1192390463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2500b3e00 msgr2=0x7ff2500d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:55.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.759+0000 7ff256e00640 1 --2- 172.21.15.112:0/1192390463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2500b3e00 0x7ff2500d1af0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7ff25008e040 tx=0x7ff23c02a1d0 comp rx=0 tx=0).stop 2024-09-12T02:48:55.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.759+0000 7ff256e00640 1 -- 172.21.15.112:0/1192390463 shutdown_connections 2024-09-12T02:48:55.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.759+0000 7ff256e00640 1 --2- 172.21.15.112:0/1192390463 >> v2:172.21.15.137:3300/0 conn(0x7ff2500cf7a0 0x7ff2500cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:55.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.759+0000 7ff256e00640 1 --2- 172.21.15.112:0/1192390463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2500b3e00 0x7ff2500d1af0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:55.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.759+0000 7ff256e00640 1 --2- 172.21.15.112:0/1192390463 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2500d1710 0x7ff2500d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:55.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.759+0000 7ff256e00640 1 -- 172.21.15.112:0/1192390463 >> 172.21.15.112:0/1192390463 conn(0x7ff25009e030 msgr2=0x7ff2500d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:55.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.759+0000 7ff256e00640 1 -- 172.21.15.112:0/1192390463 shutdown_connections 2024-09-12T02:48:55.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.759+0000 7ff256e00640 1 -- 172.21.15.112:0/1192390463 wait complete. 2024-09-12T02:48:55.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.760+0000 7ff256e00640 1 Processor -- start 2024-09-12T02:48:55.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.761+0000 7ff256e00640 1 -- start start 2024-09-12T02:48:55.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.761+0000 7ff256e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2500b3e00 0x7ff2501582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:55.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.761+0000 7ff256e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2500cf7a0 0x7ff25015fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:55.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.761+0000 7ff256e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2500d1710 0x7ff25015b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:55.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.762+0000 7ff256e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff2500d39d0 con 0x7ff2500d1710 2024-09-12T02:48:55.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.762+0000 7ff256e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff2500d36f0 con 0x7ff2500b3e00 2024-09-12T02:48:55.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.762+0000 7ff256e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff25015f110 con 0x7ff2500cf7a0 2024-09-12T02:48:55.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.762+0000 7ff256400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2500d1710 0x7ff25015b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:55.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.762+0000 7ff256400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2500d1710 0x7ff25015b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39786/0 (socket says 172.21.15.112:39786) 2024-09-12T02:48:55.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.762+0000 7ff256400640 1 -- 172.21.15.112:0/1205715446 learned_addr learned my addr 172.21.15.112:0/1205715446 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:55.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.762+0000 7ff255a00640 1 --2- 172.21.15.112:0/1205715446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2500b3e00 0x7ff2501582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:55.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.762+0000 7ff255000640 1 --2- 172.21.15.112:0/1205715446 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2500cf7a0 0x7ff25015fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:55.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.762+0000 7ff256400640 1 -- 172.21.15.112:0/1205715446 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2500cf7a0 msgr2=0x7ff25015fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:55.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.762+0000 7ff256400640 1 --2- 172.21.15.112:0/1205715446 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2500cf7a0 0x7ff25015fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:55.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.762+0000 7ff256400640 1 -- 172.21.15.112:0/1205715446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2500b3e00 msgr2=0x7ff2501582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:55.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.762+0000 7ff256400640 1 --2- 172.21.15.112:0/1205715446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2500b3e00 0x7ff2501582d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:55.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.762+0000 7ff256400640 1 -- 172.21.15.112:0/1205715446 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2500b5590 con 0x7ff2500d1710 2024-09-12T02:48:55.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.762+0000 7ff255a00640 1 --2- 172.21.15.112:0/1205715446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2500b3e00 0x7ff2501582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:55.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.762+0000 7ff256400640 1 --2- 172.21.15.112:0/1205715446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2500d1710 0x7ff25015b330 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7ff24800cef0 tx=0x7ff24800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:55.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.763+0000 7ff24d600640 1 -- 172.21.15.112:0/1205715446 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24801a070 con 0x7ff2500d1710 2024-09-12T02:48:55.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.763+0000 7ff24d600640 1 -- 172.21.15.112:0/1205715446 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff24800d840 con 0x7ff2500d1710 2024-09-12T02:48:55.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.763+0000 7ff24d600640 1 -- 172.21.15.112:0/1205715446 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24800dc30 con 0x7ff2500d1710 2024-09-12T02:48:55.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.763+0000 7ff256e00640 1 -- 172.21.15.112:0/1205715446 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff250161ce0 con 0x7ff2500d1710 2024-09-12T02:48:55.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.763+0000 7ff256e00640 1 -- 172.21.15.112:0/1205715446 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2501622a0 con 0x7ff2500d1710 2024-09-12T02:48:55.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.764+0000 7ff256e00640 1 -- 172.21.15.112:0/1205715446 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2500b5760 con 0x7ff2500d1710 2024-09-12T02:48:55.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.765+0000 7ff24d600640 1 -- 172.21.15.112:0/1205715446 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff24801d070 con 0x7ff2500d1710 2024-09-12T02:48:55.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.766+0000 7ff24d600640 1 --2- 172.21.15.112:0/1205715446 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff23006be30 0x7ff23006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:55.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.766+0000 7ff24d600640 1 -- 172.21.15.112:0/1205715446 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 5709+0+0 (secure 0 0 0) 0x7ff24808b5e0 con 0x7ff2500d1710 2024-09-12T02:48:55.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.766+0000 7ff255a00640 1 --2- 172.21.15.112:0/1205715446 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff23006be30 0x7ff23006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:55.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.767+0000 7ff255a00640 1 --2- 172.21.15.112:0/1205715446 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff23006be30 0x7ff23006e2f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff24400a990 tx=0x7ff244008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:55.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.770+0000 7ff24d600640 1 -- 172.21.15.112:0/1205715446 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff248059930 con 0x7ff2500d1710 2024-09-12T02:48:55.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.942+0000 7ff256e00640 1 -- 172.21.15.112:0/1205715446 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff2500d1af0 con 0x7ff23006be30 2024-09-12T02:48:55.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.948+0000 7ff24d600640 1 -- 172.21.15.112:0/1205715446 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247991 (secure 0 0 0) 0x7ff2500d1af0 con 0x7ff23006be30 2024-09-12T02:48:55.951 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:55.953 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:48:55.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.951+0000 7ff256e00640 1 -- 172.21.15.112:0/1205715446 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff23006be30 msgr2=0x7ff23006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:55.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.951+0000 7ff256e00640 1 --2- 172.21.15.112:0/1205715446 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff23006be30 0x7ff23006e2f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff24400a990 tx=0x7ff244008040 comp rx=0 tx=0).stop 2024-09-12T02:48:55.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.951+0000 7ff256e00640 1 -- 172.21.15.112:0/1205715446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2500d1710 msgr2=0x7ff25015b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:55.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.951+0000 7ff256e00640 1 --2- 172.21.15.112:0/1205715446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2500d1710 0x7ff25015b330 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7ff24800cef0 tx=0x7ff24800a710 comp rx=0 tx=0).stop 2024-09-12T02:48:55.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.951+0000 7ff256e00640 1 -- 172.21.15.112:0/1205715446 shutdown_connections 2024-09-12T02:48:55.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.951+0000 7ff256e00640 1 --2- 172.21.15.112:0/1205715446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2500d1710 0x7ff25015b330 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:55.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.951+0000 7ff256e00640 1 --2- 172.21.15.112:0/1205715446 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2500cf7a0 0x7ff25015fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:55.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.951+0000 7ff256e00640 1 --2- 172.21.15.112:0/1205715446 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff23006be30 0x7ff23006e2f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:55.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.951+0000 7ff256e00640 1 --2- 172.21.15.112:0/1205715446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2500b3e00 0x7ff2501582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:55.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.951+0000 7ff256e00640 1 -- 172.21.15.112:0/1205715446 >> 172.21.15.112:0/1205715446 conn(0x7ff25009e030 msgr2=0x7ff2500b7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:55.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.951+0000 7ff256e00640 1 -- 172.21.15.112:0/1205715446 shutdown_connections 2024-09-12T02:48:55.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:55.951+0000 7ff256e00640 1 -- 172.21.15.112:0/1205715446 wait complete. 2024-09-12T02:48:55.968 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":358,"stamp":"2024-09-12T02:48:55.051428+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":138,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7666,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554833,"statfs":{"total":1600000000,"available":1592149892,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.673245"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445733+0000","last_change":"2024-09-12T02:48:51.412653+0000","last_active":"2024-09-12T02:48:52.445733+0000","last_peered":"2024-09-12T02:48:52.445733+0000","last_clean":"2024-09-12T02:48:52.445733+0000","last_became_active":"2024-09-12T02:48:51.412293+0000","last_became_peered":"2024-09-12T02:48:51.412293+0000","last_unstale":"2024-09-12T02:48:52.445733+0000","last_undegraded":"2024-09-12T02:48:52.445733+0000","last_fullsized":"2024-09-12T02:48:52.445733+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:13.198039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445819+0000","last_change":"2024-09-12T02:48:51.413659+0000","last_active":"2024-09-12T02:48:52.445819+0000","last_peered":"2024-09-12T02:48:52.445819+0000","last_clean":"2024-09-12T02:48:52.445819+0000","last_became_active":"2024-09-12T02:48:51.413411+0000","last_became_peered":"2024-09-12T02:48:51.413411+0000","last_unstale":"2024-09-12T02:48:52.445819+0000","last_undegraded":"2024-09-12T02:48:52.445819+0000","last_fullsized":"2024-09-12T02:48:52.445819+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:55.596617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.399079+0000","last_change":"2024-09-12T02:48:51.403370+0000","last_active":"2024-09-12T02:48:52.399079+0000","last_peered":"2024-09-12T02:48:52.399079+0000","last_clean":"2024-09-12T02:48:52.399079+0000","last_became_active":"2024-09-12T02:48:51.402501+0000","last_became_peered":"2024-09-12T02:48:51.402501+0000","last_unstale":"2024-09-12T02:48:52.399079+0000","last_undegraded":"2024-09-12T02:48:52.399079+0000","last_fullsized":"2024-09-12T02:48:52.399079+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:16.037608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445297+0000","last_change":"2024-09-12T02:48:51.413690+0000","last_active":"2024-09-12T02:48:52.445297+0000","last_peered":"2024-09-12T02:48:52.445297+0000","last_clean":"2024-09-12T02:48:52.445297+0000","last_became_active":"2024-09-12T02:48:51.413524+0000","last_became_peered":"2024-09-12T02:48:51.413524+0000","last_unstale":"2024-09-12T02:48:52.445297+0000","last_undegraded":"2024-09-12T02:48:52.445297+0000","last_fullsized":"2024-09-12T02:48:52.445297+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:43.707251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.417897+0000","last_change":"2024-09-12T02:48:51.416088+0000","last_active":"2024-09-12T02:48:52.417897+0000","last_peered":"2024-09-12T02:48:52.417897+0000","last_clean":"2024-09-12T02:48:52.417897+0000","last_became_active":"2024-09-12T02:48:51.414460+0000","last_became_peered":"2024-09-12T02:48:51.414460+0000","last_unstale":"2024-09-12T02:48:52.417897+0000","last_undegraded":"2024-09-12T02:48:52.417897+0000","last_fullsized":"2024-09-12T02:48:52.417897+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:49.390879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.419359+0000","last_change":"2024-09-12T02:48:51.410803+0000","last_active":"2024-09-12T02:48:52.419359+0000","last_peered":"2024-09-12T02:48:52.419359+0000","last_clean":"2024-09-12T02:48:52.419359+0000","last_became_active":"2024-09-12T02:48:51.410536+0000","last_became_peered":"2024-09-12T02:48:51.410536+0000","last_unstale":"2024-09-12T02:48:52.419359+0000","last_undegraded":"2024-09-12T02:48:52.419359+0000","last_fullsized":"2024-09-12T02:48:52.419359+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:36.025109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.419432+0000","last_change":"2024-09-12T02:48:51.407741+0000","last_active":"2024-09-12T02:48:52.419432+0000","last_peered":"2024-09-12T02:48:52.419432+0000","last_clean":"2024-09-12T02:48:52.419432+0000","last_became_active":"2024-09-12T02:48:51.406826+0000","last_became_peered":"2024-09-12T02:48:51.406826+0000","last_unstale":"2024-09-12T02:48:52.419432+0000","last_undegraded":"2024-09-12T02:48:52.419432+0000","last_fullsized":"2024-09-12T02:48:52.419432+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:59.923654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.399194+0000","last_change":"2024-09-12T02:48:51.405741+0000","last_active":"2024-09-12T02:48:52.399194+0000","last_peered":"2024-09-12T02:48:52.399194+0000","last_clean":"2024-09-12T02:48:52.399194+0000","last_became_active":"2024-09-12T02:48:51.403647+0000","last_became_peered":"2024-09-12T02:48:51.403647+0000","last_unstale":"2024-09-12T02:48:52.399194+0000","last_undegraded":"2024-09-12T02:48:52.399194+0000","last_fullsized":"2024-09-12T02:48:52.399194+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:46.116912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.399075+0000","last_change":"2024-09-12T02:48:51.403489+0000","last_active":"2024-09-12T02:48:52.399075+0000","last_peered":"2024-09-12T02:48:52.399075+0000","last_clean":"2024-09-12T02:48:52.399075+0000","last_became_active":"2024-09-12T02:48:51.403179+0000","last_became_peered":"2024-09-12T02:48:51.403179+0000","last_unstale":"2024-09-12T02:48:52.399075+0000","last_undegraded":"2024-09-12T02:48:52.399075+0000","last_fullsized":"2024-09-12T02:48:52.399075+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:08.513961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.446142+0000","last_change":"2024-09-12T02:48:51.410199+0000","last_active":"2024-09-12T02:48:52.446142+0000","last_peered":"2024-09-12T02:48:52.446142+0000","last_clean":"2024-09-12T02:48:52.446142+0000","last_became_active":"2024-09-12T02:48:51.409991+0000","last_became_peered":"2024-09-12T02:48:51.409991+0000","last_unstale":"2024-09-12T02:48:52.446142+0000","last_undegraded":"2024-09-12T02:48:52.446142+0000","last_fullsized":"2024-09-12T02:48:52.446142+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:48.792984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.446561+0000","last_change":"2024-09-12T02:48:51.411269+0000","last_active":"2024-09-12T02:48:52.446561+0000","last_peered":"2024-09-12T02:48:52.446561+0000","last_clean":"2024-09-12T02:48:52.446561+0000","last_became_active":"2024-09-12T02:48:51.410816+0000","last_became_peered":"2024-09-12T02:48:51.410816+0000","last_unstale":"2024-09-12T02:48:52.446561+0000","last_undegraded":"2024-09-12T02:48:52.446561+0000","last_fullsized":"2024-09-12T02:48:52.446561+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:50.476539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.399358+0000","last_change":"2024-09-12T02:48:51.404463+0000","last_active":"2024-09-12T02:48:52.399358+0000","last_peered":"2024-09-12T02:48:52.399358+0000","last_clean":"2024-09-12T02:48:52.399358+0000","last_became_active":"2024-09-12T02:48:51.403962+0000","last_became_peered":"2024-09-12T02:48:51.403962+0000","last_unstale":"2024-09-12T02:48:52.399358+0000","last_undegraded":"2024-09-12T02:48:52.399358+0000","last_fullsized":"2024-09-12T02:48:52.399358+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:53.700220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445346+0000","last_change":"2024-09-12T02:48:51.412063+0000","last_active":"2024-09-12T02:48:52.445346+0000","last_peered":"2024-09-12T02:48:52.445346+0000","last_clean":"2024-09-12T02:48:52.445346+0000","last_became_active":"2024-09-12T02:48:51.410385+0000","last_became_peered":"2024-09-12T02:48:51.410385+0000","last_unstale":"2024-09-12T02:48:52.445346+0000","last_undegraded":"2024-09-12T02:48:52.445346+0000","last_fullsized":"2024-09-12T02:48:52.445346+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:34.169918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445364+0000","last_change":"2024-09-12T02:48:51.408201+0000","last_active":"2024-09-12T02:48:52.445364+0000","last_peered":"2024-09-12T02:48:52.445364+0000","last_clean":"2024-09-12T02:48:52.445364+0000","last_became_active":"2024-09-12T02:48:51.407957+0000","last_became_peered":"2024-09-12T02:48:51.407957+0000","last_unstale":"2024-09-12T02:48:52.445364+0000","last_undegraded":"2024-09-12T02:48:52.445364+0000","last_fullsized":"2024-09-12T02:48:52.445364+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:24.989560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.446057+0000","last_change":"2024-09-12T02:48:51.411805+0000","last_active":"2024-09-12T02:48:52.446057+0000","last_peered":"2024-09-12T02:48:52.446057+0000","last_clean":"2024-09-12T02:48:52.446057+0000","last_became_active":"2024-09-12T02:48:51.409989+0000","last_became_peered":"2024-09-12T02:48:51.409989+0000","last_unstale":"2024-09-12T02:48:52.446057+0000","last_undegraded":"2024-09-12T02:48:52.446057+0000","last_fullsized":"2024-09-12T02:48:52.446057+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:22.954274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398723+0000","last_change":"2024-09-12T02:48:51.409783+0000","last_active":"2024-09-12T02:48:52.398723+0000","last_peered":"2024-09-12T02:48:52.398723+0000","last_clean":"2024-09-12T02:48:52.398723+0000","last_became_active":"2024-09-12T02:48:51.408197+0000","last_became_peered":"2024-09-12T02:48:51.408197+0000","last_unstale":"2024-09-12T02:48:52.398723+0000","last_undegraded":"2024-09-12T02:48:52.398723+0000","last_fullsized":"2024-09-12T02:48:52.398723+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:52.001781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.419683+0000","last_change":"2024-09-12T02:48:51.410724+0000","last_active":"2024-09-12T02:48:52.419683+0000","last_peered":"2024-09-12T02:48:52.419683+0000","last_clean":"2024-09-12T02:48:52.419683+0000","last_became_active":"2024-09-12T02:48:51.409949+0000","last_became_peered":"2024-09-12T02:48:51.409949+0000","last_unstale":"2024-09-12T02:48:52.419683+0000","last_undegraded":"2024-09-12T02:48:52.419683+0000","last_fullsized":"2024-09-12T02:48:52.419683+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:59.376270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398685+0000","last_change":"2024-09-12T02:48:51.403361+0000","last_active":"2024-09-12T02:48:52.398685+0000","last_peered":"2024-09-12T02:48:52.398685+0000","last_clean":"2024-09-12T02:48:52.398685+0000","last_became_active":"2024-09-12T02:48:51.402481+0000","last_became_peered":"2024-09-12T02:48:51.402481+0000","last_unstale":"2024-09-12T02:48:52.398685+0000","last_undegraded":"2024-09-12T02:48:52.398685+0000","last_fullsized":"2024-09-12T02:48:52.398685+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:23.844839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445171+0000","last_change":"2024-09-12T02:48:51.403785+0000","last_active":"2024-09-12T02:48:52.445171+0000","last_peered":"2024-09-12T02:48:52.445171+0000","last_clean":"2024-09-12T02:48:52.445171+0000","last_became_active":"2024-09-12T02:48:51.403551+0000","last_became_peered":"2024-09-12T02:48:51.403551+0000","last_unstale":"2024-09-12T02:48:52.445171+0000","last_undegraded":"2024-09-12T02:48:52.445171+0000","last_fullsized":"2024-09-12T02:48:52.445171+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:39.567470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398620+0000","last_change":"2024-09-12T02:48:51.403954+0000","last_active":"2024-09-12T02:48:52.398620+0000","last_peered":"2024-09-12T02:48:52.398620+0000","last_clean":"2024-09-12T02:48:52.398620+0000","last_became_active":"2024-09-12T02:48:51.403725+0000","last_became_peered":"2024-09-12T02:48:51.403725+0000","last_unstale":"2024-09-12T02:48:52.398620+0000","last_undegraded":"2024-09-12T02:48:52.398620+0000","last_fullsized":"2024-09-12T02:48:52.398620+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:33.456489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.417992+0000","last_change":"2024-09-12T02:48:51.414535+0000","last_active":"2024-09-12T02:48:52.417992+0000","last_peered":"2024-09-12T02:48:52.417992+0000","last_clean":"2024-09-12T02:48:52.417992+0000","last_became_active":"2024-09-12T02:48:51.414274+0000","last_became_peered":"2024-09-12T02:48:51.414274+0000","last_unstale":"2024-09-12T02:48:52.417992+0000","last_undegraded":"2024-09-12T02:48:52.417992+0000","last_fullsized":"2024-09-12T02:48:52.417992+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:48.891343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445346+0000","last_change":"2024-09-12T02:48:51.411731+0000","last_active":"2024-09-12T02:48:52.445346+0000","last_peered":"2024-09-12T02:48:52.445346+0000","last_clean":"2024-09-12T02:48:52.445346+0000","last_became_active":"2024-09-12T02:48:51.411463+0000","last_became_peered":"2024-09-12T02:48:51.411463+0000","last_unstale":"2024-09-12T02:48:52.445346+0000","last_undegraded":"2024-09-12T02:48:52.445346+0000","last_fullsized":"2024-09-12T02:48:52.445346+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:15.404721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.399399+0000","last_change":"2024-09-12T02:48:51.407159+0000","last_active":"2024-09-12T02:48:52.399399+0000","last_peered":"2024-09-12T02:48:52.399399+0000","last_clean":"2024-09-12T02:48:52.399399+0000","last_became_active":"2024-09-12T02:48:51.405184+0000","last_became_peered":"2024-09-12T02:48:51.405184+0000","last_unstale":"2024-09-12T02:48:52.399399+0000","last_undegraded":"2024-09-12T02:48:52.399399+0000","last_fullsized":"2024-09-12T02:48:52.399399+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:07.560089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445327+0000","last_change":"2024-09-12T02:48:51.405290+0000","last_active":"2024-09-12T02:48:52.445327+0000","last_peered":"2024-09-12T02:48:52.445327+0000","last_clean":"2024-09-12T02:48:52.445327+0000","last_became_active":"2024-09-12T02:48:51.404991+0000","last_became_peered":"2024-09-12T02:48:51.404991+0000","last_unstale":"2024-09-12T02:48:52.445327+0000","last_undegraded":"2024-09-12T02:48:52.445327+0000","last_fullsized":"2024-09-12T02:48:52.445327+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:03.916731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.446009+0000","last_change":"2024-09-12T02:48:51.414275+0000","last_active":"2024-09-12T02:48:52.446009+0000","last_peered":"2024-09-12T02:48:52.446009+0000","last_clean":"2024-09-12T02:48:52.446009+0000","last_became_active":"2024-09-12T02:48:51.413589+0000","last_became_peered":"2024-09-12T02:48:51.413589+0000","last_unstale":"2024-09-12T02:48:52.446009+0000","last_undegraded":"2024-09-12T02:48:52.446009+0000","last_fullsized":"2024-09-12T02:48:52.446009+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:46.636679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398806+0000","last_change":"2024-09-12T02:48:51.410014+0000","last_active":"2024-09-12T02:48:52.398806+0000","last_peered":"2024-09-12T02:48:52.398806+0000","last_clean":"2024-09-12T02:48:52.398806+0000","last_became_active":"2024-09-12T02:48:51.409527+0000","last_became_peered":"2024-09-12T02:48:51.409527+0000","last_unstale":"2024-09-12T02:48:52.398806+0000","last_undegraded":"2024-09-12T02:48:52.398806+0000","last_fullsized":"2024-09-12T02:48:52.398806+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:36.077579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445199+0000","last_change":"2024-09-12T02:48:51.408446+0000","last_active":"2024-09-12T02:48:52.445199+0000","last_peered":"2024-09-12T02:48:52.445199+0000","last_clean":"2024-09-12T02:48:52.445199+0000","last_became_active":"2024-09-12T02:48:51.407889+0000","last_became_peered":"2024-09-12T02:48:51.407889+0000","last_unstale":"2024-09-12T02:48:52.445199+0000","last_undegraded":"2024-09-12T02:48:52.445199+0000","last_fullsized":"2024-09-12T02:48:52.445199+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:24.259059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398110+0000","last_change":"2024-09-12T02:48:51.400473+0000","last_active":"2024-09-12T02:48:52.398110+0000","last_peered":"2024-09-12T02:48:52.398110+0000","last_clean":"2024-09-12T02:48:52.398110+0000","last_became_active":"2024-09-12T02:48:51.400170+0000","last_became_peered":"2024-09-12T02:48:51.400170+0000","last_unstale":"2024-09-12T02:48:52.398110+0000","last_undegraded":"2024-09-12T02:48:52.398110+0000","last_fullsized":"2024-09-12T02:48:52.398110+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:18.633804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445619+0000","last_change":"2024-09-12T02:48:51.405361+0000","last_active":"2024-09-12T02:48:52.445619+0000","last_peered":"2024-09-12T02:48:52.445619+0000","last_clean":"2024-09-12T02:48:52.445619+0000","last_became_active":"2024-09-12T02:48:51.405134+0000","last_became_peered":"2024-09-12T02:48:51.405134+0000","last_unstale":"2024-09-12T02:48:52.445619+0000","last_undegraded":"2024-09-12T02:48:52.445619+0000","last_fullsized":"2024-09-12T02:48:52.445619+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:26.805214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.446198+0000","last_change":"2024-09-12T02:48:51.411628+0000","last_active":"2024-09-12T02:48:52.446198+0000","last_peered":"2024-09-12T02:48:52.446198+0000","last_clean":"2024-09-12T02:48:52.446198+0000","last_became_active":"2024-09-12T02:48:51.409564+0000","last_became_peered":"2024-09-12T02:48:51.409564+0000","last_unstale":"2024-09-12T02:48:52.446198+0000","last_undegraded":"2024-09-12T02:48:52.446198+0000","last_fullsized":"2024-09-12T02:48:52.446198+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:57.579809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.417503+0000","last_change":"2024-09-12T02:48:51.417857+0000","last_active":"2024-09-12T02:48:52.417503+0000","last_peered":"2024-09-12T02:48:52.417503+0000","last_clean":"2024-09-12T02:48:52.417503+0000","last_became_active":"2024-09-12T02:48:51.417171+0000","last_became_peered":"2024-09-12T02:48:51.417171+0000","last_unstale":"2024-09-12T02:48:52.417503+0000","last_undegraded":"2024-09-12T02:48:52.417503+0000","last_fullsized":"2024-09-12T02:48:52.417503+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:17.598419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.419566+0000","last_change":"2024-09-12T02:48:51.408787+0000","last_active":"2024-09-12T02:48:52.419566+0000","last_peered":"2024-09-12T02:48:52.419566+0000","last_clean":"2024-09-12T02:48:52.419566+0000","last_became_active":"2024-09-12T02:48:51.407137+0000","last_became_peered":"2024-09-12T02:48:51.407137+0000","last_unstale":"2024-09-12T02:48:52.419566+0000","last_undegraded":"2024-09-12T02:48:52.419566+0000","last_fullsized":"2024-09-12T02:48:52.419566+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:35.495376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398536+0000","last_change":"2024-09-12T02:48:51.402334+0000","last_active":"2024-09-12T02:48:52.398536+0000","last_peered":"2024-09-12T02:48:52.398536+0000","last_clean":"2024-09-12T02:48:52.398536+0000","last_became_active":"2024-09-12T02:48:51.402098+0000","last_became_peered":"2024-09-12T02:48:51.402098+0000","last_unstale":"2024-09-12T02:48:52.398536+0000","last_undegraded":"2024-09-12T02:48:52.398536+0000","last_fullsized":"2024-09-12T02:48:52.398536+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:47.128352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"149'4","reported_seq":18,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.417720+0000","last_change":"2024-09-12T02:48:50.397021+0000","last_active":"2024-09-12T02:48:52.417720+0000","last_peered":"2024-09-12T02:48:52.417720+0000","last_clean":"2024-09-12T02:48:52.417720+0000","last_became_active":"2024-09-12T02:48:50.396422+0000","last_became_peered":"2024-09-12T02:48:50.396422+0000","last_unstale":"2024-09-12T02:48:52.417720+0000","last_undegraded":"2024-09-12T02:48:52.417720+0000","last_fullsized":"2024-09-12T02:48:52.417720+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:24:06.913962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.399546+0000","last_change":"2024-09-12T02:48:51.405473+0000","last_active":"2024-09-12T02:48:52.399546+0000","last_peered":"2024-09-12T02:48:52.399546+0000","last_clean":"2024-09-12T02:48:52.399546+0000","last_became_active":"2024-09-12T02:48:51.402954+0000","last_became_peered":"2024-09-12T02:48:51.402954+0000","last_unstale":"2024-09-12T02:48:52.399546+0000","last_undegraded":"2024-09-12T02:48:52.399546+0000","last_fullsized":"2024-09-12T02:48:52.399546+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:36.080669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"149'1","reported_seq":15,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398101+0000","last_change":"2024-09-12T02:48:50.391273+0000","last_active":"2024-09-12T02:48:52.398101+0000","last_peered":"2024-09-12T02:48:52.398101+0000","last_clean":"2024-09-12T02:48:52.398101+0000","last_became_active":"2024-09-12T02:48:50.391006+0000","last_became_peered":"2024-09-12T02:48:50.391006+0000","last_unstale":"2024-09-12T02:48:52.398101+0000","last_undegraded":"2024-09-12T02:48:52.398101+0000","last_fullsized":"2024-09-12T02:48:52.398101+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:10.697097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.417712+0000","last_change":"2024-09-12T02:48:51.416652+0000","last_active":"2024-09-12T02:48:52.417712+0000","last_peered":"2024-09-12T02:48:52.417712+0000","last_clean":"2024-09-12T02:48:52.417712+0000","last_became_active":"2024-09-12T02:48:51.415038+0000","last_became_peered":"2024-09-12T02:48:51.415038+0000","last_unstale":"2024-09-12T02:48:52.417712+0000","last_undegraded":"2024-09-12T02:48:52.417712+0000","last_fullsized":"2024-09-12T02:48:52.417712+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:32.018337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"149'2","reported_seq":16,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445024+0000","last_change":"2024-09-12T02:48:50.398627+0000","last_active":"2024-09-12T02:48:52.445024+0000","last_peered":"2024-09-12T02:48:52.445024+0000","last_clean":"2024-09-12T02:48:52.445024+0000","last_became_active":"2024-09-12T02:48:50.398279+0000","last_became_peered":"2024-09-12T02:48:50.398279+0000","last_unstale":"2024-09-12T02:48:52.445024+0000","last_undegraded":"2024-09-12T02:48:52.445024+0000","last_fullsized":"2024-09-12T02:48:52.445024+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:12.241225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.418085+0000","last_change":"2024-09-12T02:48:51.416598+0000","last_active":"2024-09-12T02:48:52.418085+0000","last_peered":"2024-09-12T02:48:52.418085+0000","last_clean":"2024-09-12T02:48:52.418085+0000","last_became_active":"2024-09-12T02:48:51.415653+0000","last_became_peered":"2024-09-12T02:48:51.415653+0000","last_unstale":"2024-09-12T02:48:52.418085+0000","last_undegraded":"2024-09-12T02:48:52.418085+0000","last_fullsized":"2024-09-12T02:48:52.418085+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:46.780837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"149'2","reported_seq":16,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445905+0000","last_change":"2024-09-12T02:48:50.397456+0000","last_active":"2024-09-12T02:48:52.445905+0000","last_peered":"2024-09-12T02:48:52.445905+0000","last_clean":"2024-09-12T02:48:52.445905+0000","last_became_active":"2024-09-12T02:48:50.397004+0000","last_became_peered":"2024-09-12T02:48:50.397004+0000","last_unstale":"2024-09-12T02:48:52.445905+0000","last_undegraded":"2024-09-12T02:48:52.445905+0000","last_fullsized":"2024-09-12T02:48:52.445905+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:16:10.308139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398829+0000","last_change":"2024-09-12T02:48:51.403536+0000","last_active":"2024-09-12T02:48:52.398829+0000","last_peered":"2024-09-12T02:48:52.398829+0000","last_clean":"2024-09-12T02:48:52.398829+0000","last_became_active":"2024-09-12T02:48:51.402986+0000","last_became_peered":"2024-09-12T02:48:51.402986+0000","last_unstale":"2024-09-12T02:48:52.398829+0000","last_undegraded":"2024-09-12T02:48:52.398829+0000","last_fullsized":"2024-09-12T02:48:52.398829+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:55.222345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"149'1","reported_seq":15,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445931+0000","last_change":"2024-09-12T02:48:50.389167+0000","last_active":"2024-09-12T02:48:52.445931+0000","last_peered":"2024-09-12T02:48:52.445931+0000","last_clean":"2024-09-12T02:48:52.445931+0000","last_became_active":"2024-09-12T02:48:50.388911+0000","last_became_peered":"2024-09-12T02:48:50.388911+0000","last_unstale":"2024-09-12T02:48:52.445931+0000","last_undegraded":"2024-09-12T02:48:52.445931+0000","last_fullsized":"2024-09-12T02:48:52.445931+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:57.692743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.419778+0000","last_change":"2024-09-12T02:48:51.410948+0000","last_active":"2024-09-12T02:48:52.419778+0000","last_peered":"2024-09-12T02:48:52.419778+0000","last_clean":"2024-09-12T02:48:52.419778+0000","last_became_active":"2024-09-12T02:48:51.410290+0000","last_became_peered":"2024-09-12T02:48:51.410290+0000","last_unstale":"2024-09-12T02:48:52.419778+0000","last_undegraded":"2024-09-12T02:48:52.419778+0000","last_fullsized":"2024-09-12T02:48:52.419778+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:35.728526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"149'1","reported_seq":15,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398919+0000","last_change":"2024-09-12T02:48:50.386906+0000","last_active":"2024-09-12T02:48:52.398919+0000","last_peered":"2024-09-12T02:48:52.398919+0000","last_clean":"2024-09-12T02:48:52.398919+0000","last_became_active":"2024-09-12T02:48:50.386523+0000","last_became_peered":"2024-09-12T02:48:50.386523+0000","last_unstale":"2024-09-12T02:48:52.398919+0000","last_undegraded":"2024-09-12T02:48:52.398919+0000","last_fullsized":"2024-09-12T02:48:52.398919+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:22.745048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.399456+0000","last_change":"2024-09-12T02:48:51.400140+0000","last_active":"2024-09-12T02:48:52.399456+0000","last_peered":"2024-09-12T02:48:52.399456+0000","last_clean":"2024-09-12T02:48:52.399456+0000","last_became_active":"2024-09-12T02:48:51.399850+0000","last_became_peered":"2024-09-12T02:48:51.399850+0000","last_unstale":"2024-09-12T02:48:52.399456+0000","last_undegraded":"2024-09-12T02:48:52.399456+0000","last_fullsized":"2024-09-12T02:48:52.399456+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:38.530846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.419305+0000","last_change":"2024-09-12T02:48:50.394096+0000","last_active":"2024-09-12T02:48:52.419305+0000","last_peered":"2024-09-12T02:48:52.419305+0000","last_clean":"2024-09-12T02:48:52.419305+0000","last_became_active":"2024-09-12T02:48:50.393779+0000","last_became_peered":"2024-09-12T02:48:50.393779+0000","last_unstale":"2024-09-12T02:48:52.419305+0000","last_undegraded":"2024-09-12T02:48:52.419305+0000","last_fullsized":"2024-09-12T02:48:52.419305+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:38.007389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445493+0000","last_change":"2024-09-12T02:48:51.405324+0000","last_active":"2024-09-12T02:48:52.445493+0000","last_peered":"2024-09-12T02:48:52.445493+0000","last_clean":"2024-09-12T02:48:52.445493+0000","last_became_active":"2024-09-12T02:48:51.405085+0000","last_became_peered":"2024-09-12T02:48:51.405085+0000","last_unstale":"2024-09-12T02:48:52.445493+0000","last_undegraded":"2024-09-12T02:48:52.445493+0000","last_fullsized":"2024-09-12T02:48:52.445493+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:25.654907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.446424+0000","last_change":"2024-09-12T02:48:50.387640+0000","last_active":"2024-09-12T02:48:52.446424+0000","last_peered":"2024-09-12T02:48:52.446424+0000","last_clean":"2024-09-12T02:48:52.446424+0000","last_became_active":"2024-09-12T02:48:50.387353+0000","last_became_peered":"2024-09-12T02:48:50.387353+0000","last_unstale":"2024-09-12T02:48:52.446424+0000","last_undegraded":"2024-09-12T02:48:52.446424+0000","last_fullsized":"2024-09-12T02:48:52.446424+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:49.439152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.446403+0000","last_change":"2024-09-12T02:48:51.409026+0000","last_active":"2024-09-12T02:48:52.446403+0000","last_peered":"2024-09-12T02:48:52.446403+0000","last_clean":"2024-09-12T02:48:52.446403+0000","last_became_active":"2024-09-12T02:48:51.408217+0000","last_became_peered":"2024-09-12T02:48:51.408217+0000","last_unstale":"2024-09-12T02:48:52.446403+0000","last_undegraded":"2024-09-12T02:48:52.446403+0000","last_fullsized":"2024-09-12T02:48:52.446403+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:06.197945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398247+0000","last_change":"2024-09-12T02:48:50.386802+0000","last_active":"2024-09-12T02:48:52.398247+0000","last_peered":"2024-09-12T02:48:52.398247+0000","last_clean":"2024-09-12T02:48:52.398247+0000","last_became_active":"2024-09-12T02:48:50.386433+0000","last_became_peered":"2024-09-12T02:48:50.386433+0000","last_unstale":"2024-09-12T02:48:52.398247+0000","last_undegraded":"2024-09-12T02:48:52.398247+0000","last_fullsized":"2024-09-12T02:48:52.398247+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:52.315259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.397955+0000","last_change":"2024-09-12T02:48:51.399564+0000","last_active":"2024-09-12T02:48:52.397955+0000","last_peered":"2024-09-12T02:48:52.397955+0000","last_clean":"2024-09-12T02:48:52.397955+0000","last_became_active":"2024-09-12T02:48:51.399327+0000","last_became_peered":"2024-09-12T02:48:51.399327+0000","last_unstale":"2024-09-12T02:48:52.397955+0000","last_undegraded":"2024-09-12T02:48:52.397955+0000","last_fullsized":"2024-09-12T02:48:52.397955+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:44.256704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398684+0000","last_change":"2024-09-12T02:48:50.388047+0000","last_active":"2024-09-12T02:48:52.398684+0000","last_peered":"2024-09-12T02:48:52.398684+0000","last_clean":"2024-09-12T02:48:52.398684+0000","last_became_active":"2024-09-12T02:48:50.385976+0000","last_became_peered":"2024-09-12T02:48:50.385976+0000","last_unstale":"2024-09-12T02:48:52.398684+0000","last_undegraded":"2024-09-12T02:48:52.398684+0000","last_fullsized":"2024-09-12T02:48:52.398684+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:46.521401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.417477+0000","last_change":"2024-09-12T02:48:51.412978+0000","last_active":"2024-09-12T02:48:52.417477+0000","last_peered":"2024-09-12T02:48:52.417477+0000","last_clean":"2024-09-12T02:48:52.417477+0000","last_became_active":"2024-09-12T02:48:51.412719+0000","last_became_peered":"2024-09-12T02:48:51.412719+0000","last_unstale":"2024-09-12T02:48:52.417477+0000","last_undegraded":"2024-09-12T02:48:52.417477+0000","last_fullsized":"2024-09-12T02:48:52.417477+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:46.758423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"149'3","reported_seq":17,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398236+0000","last_change":"2024-09-12T02:48:50.386147+0000","last_active":"2024-09-12T02:48:52.398236+0000","last_peered":"2024-09-12T02:48:52.398236+0000","last_clean":"2024-09-12T02:48:52.398236+0000","last_became_active":"2024-09-12T02:48:50.385478+0000","last_became_peered":"2024-09-12T02:48:50.385478+0000","last_unstale":"2024-09-12T02:48:52.398236+0000","last_undegraded":"2024-09-12T02:48:52.398236+0000","last_fullsized":"2024-09-12T02:48:52.398236+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:57.252779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.417584+0000","last_change":"2024-09-12T02:48:51.411755+0000","last_active":"2024-09-12T02:48:52.417584+0000","last_peered":"2024-09-12T02:48:52.417584+0000","last_clean":"2024-09-12T02:48:52.417584+0000","last_became_active":"2024-09-12T02:48:51.411254+0000","last_became_peered":"2024-09-12T02:48:51.411254+0000","last_unstale":"2024-09-12T02:48:52.417584+0000","last_undegraded":"2024-09-12T02:48:52.417584+0000","last_fullsized":"2024-09-12T02:48:52.417584+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:09.027027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"149'6","reported_seq":20,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.399288+0000","last_change":"2024-09-12T02:48:50.393624+0000","last_active":"2024-09-12T02:48:52.399288+0000","last_peered":"2024-09-12T02:48:52.399288+0000","last_clean":"2024-09-12T02:48:52.399288+0000","last_became_active":"2024-09-12T02:48:50.393366+0000","last_became_peered":"2024-09-12T02:48:50.393366+0000","last_unstale":"2024-09-12T02:48:52.399288+0000","last_undegraded":"2024-09-12T02:48:52.399288+0000","last_fullsized":"2024-09-12T02:48:52.399288+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:45.179275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.446390+0000","last_change":"2024-09-12T02:48:51.405647+0000","last_active":"2024-09-12T02:48:52.446390+0000","last_peered":"2024-09-12T02:48:52.446390+0000","last_clean":"2024-09-12T02:48:52.446390+0000","last_became_active":"2024-09-12T02:48:51.405314+0000","last_became_peered":"2024-09-12T02:48:51.405314+0000","last_unstale":"2024-09-12T02:48:52.446390+0000","last_undegraded":"2024-09-12T02:48:52.446390+0000","last_fullsized":"2024-09-12T02:48:52.446390+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:53.976358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445933+0000","last_change":"2024-09-12T02:48:50.383689+0000","last_active":"2024-09-12T02:48:52.445933+0000","last_peered":"2024-09-12T02:48:52.445933+0000","last_clean":"2024-09-12T02:48:52.445933+0000","last_became_active":"2024-09-12T02:48:50.383394+0000","last_became_peered":"2024-09-12T02:48:50.383394+0000","last_unstale":"2024-09-12T02:48:52.445933+0000","last_undegraded":"2024-09-12T02:48:52.445933+0000","last_fullsized":"2024-09-12T02:48:52.445933+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:32.382561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445554+0000","last_change":"2024-09-12T02:48:51.408742+0000","last_active":"2024-09-12T02:48:52.445554+0000","last_peered":"2024-09-12T02:48:52.445554+0000","last_clean":"2024-09-12T02:48:52.445554+0000","last_became_active":"2024-09-12T02:48:51.408534+0000","last_became_peered":"2024-09-12T02:48:51.408534+0000","last_unstale":"2024-09-12T02:48:52.445554+0000","last_undegraded":"2024-09-12T02:48:52.445554+0000","last_fullsized":"2024-09-12T02:48:52.445554+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:48.884652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.446029+0000","last_change":"2024-09-12T02:48:50.394139+0000","last_active":"2024-09-12T02:48:52.446029+0000","last_peered":"2024-09-12T02:48:52.446029+0000","last_clean":"2024-09-12T02:48:52.446029+0000","last_became_active":"2024-09-12T02:48:50.393883+0000","last_became_peered":"2024-09-12T02:48:50.393883+0000","last_unstale":"2024-09-12T02:48:52.446029+0000","last_undegraded":"2024-09-12T02:48:52.446029+0000","last_fullsized":"2024-09-12T02:48:52.446029+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:15.762104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.399552+0000","last_change":"2024-09-12T02:48:51.404202+0000","last_active":"2024-09-12T02:48:52.399552+0000","last_peered":"2024-09-12T02:48:52.399552+0000","last_clean":"2024-09-12T02:48:52.399552+0000","last_became_active":"2024-09-12T02:48:51.403635+0000","last_became_peered":"2024-09-12T02:48:51.403635+0000","last_unstale":"2024-09-12T02:48:52.399552+0000","last_undegraded":"2024-09-12T02:48:52.399552+0000","last_fullsized":"2024-09-12T02:48:52.399552+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:59.237029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"149'8","reported_seq":22,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.399650+0000","last_change":"2024-09-12T02:48:50.384021+0000","last_active":"2024-09-12T02:48:52.399650+0000","last_peered":"2024-09-12T02:48:52.399650+0000","last_clean":"2024-09-12T02:48:52.399650+0000","last_became_active":"2024-09-12T02:48:50.383625+0000","last_became_peered":"2024-09-12T02:48:50.383625+0000","last_unstale":"2024-09-12T02:48:52.399650+0000","last_undegraded":"2024-09-12T02:48:52.399650+0000","last_fullsized":"2024-09-12T02:48:52.399650+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:43:53.399662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.399623+0000","last_change":"2024-09-12T02:48:51.405517+0000","last_active":"2024-09-12T02:48:52.399623+0000","last_peered":"2024-09-12T02:48:52.399623+0000","last_clean":"2024-09-12T02:48:52.399623+0000","last_became_active":"2024-09-12T02:48:51.403862+0000","last_became_peered":"2024-09-12T02:48:51.403862+0000","last_unstale":"2024-09-12T02:48:52.399623+0000","last_undegraded":"2024-09-12T02:48:52.399623+0000","last_fullsized":"2024-09-12T02:48:52.399623+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:30.253916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"149'1","reported_seq":15,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398232+0000","last_change":"2024-09-12T02:48:50.393859+0000","last_active":"2024-09-12T02:48:52.398232+0000","last_peered":"2024-09-12T02:48:52.398232+0000","last_clean":"2024-09-12T02:48:52.398232+0000","last_became_active":"2024-09-12T02:48:50.393634+0000","last_became_peered":"2024-09-12T02:48:50.393634+0000","last_unstale":"2024-09-12T02:48:52.398232+0000","last_undegraded":"2024-09-12T02:48:52.398232+0000","last_fullsized":"2024-09-12T02:48:52.398232+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:34.886672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.397963+0000","last_change":"2024-09-12T02:48:51.403960+0000","last_active":"2024-09-12T02:48:52.397963+0000","last_peered":"2024-09-12T02:48:52.397963+0000","last_clean":"2024-09-12T02:48:52.397963+0000","last_became_active":"2024-09-12T02:48:51.403543+0000","last_became_peered":"2024-09-12T02:48:51.403543+0000","last_unstale":"2024-09-12T02:48:52.397963+0000","last_undegraded":"2024-09-12T02:48:52.397963+0000","last_fullsized":"2024-09-12T02:48:52.397963+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:37.469238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"149'2","reported_seq":16,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445099+0000","last_change":"2024-09-12T02:48:50.396724+0000","last_active":"2024-09-12T02:48:52.445099+0000","last_peered":"2024-09-12T02:48:52.445099+0000","last_clean":"2024-09-12T02:48:52.445099+0000","last_became_active":"2024-09-12T02:48:50.393984+0000","last_became_peered":"2024-09-12T02:48:50.393984+0000","last_unstale":"2024-09-12T02:48:52.445099+0000","last_undegraded":"2024-09-12T02:48:52.445099+0000","last_fullsized":"2024-09-12T02:48:52.445099+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:10.502036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398592+0000","last_change":"2024-09-12T02:48:51.408728+0000","last_active":"2024-09-12T02:48:52.398592+0000","last_peered":"2024-09-12T02:48:52.398592+0000","last_clean":"2024-09-12T02:48:52.398592+0000","last_became_active":"2024-09-12T02:48:51.408506+0000","last_became_peered":"2024-09-12T02:48:51.408506+0000","last_unstale":"2024-09-12T02:48:52.398592+0000","last_undegraded":"2024-09-12T02:48:52.398592+0000","last_fullsized":"2024-09-12T02:48:52.398592+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:26.941969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"149'1","reported_seq":15,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.419603+0000","last_change":"2024-09-12T02:48:50.385458+0000","last_active":"2024-09-12T02:48:52.419603+0000","last_peered":"2024-09-12T02:48:52.419603+0000","last_clean":"2024-09-12T02:48:52.419603+0000","last_became_active":"2024-09-12T02:48:50.385161+0000","last_became_peered":"2024-09-12T02:48:50.385161+0000","last_unstale":"2024-09-12T02:48:52.419603+0000","last_undegraded":"2024-09-12T02:48:52.419603+0000","last_fullsized":"2024-09-12T02:48:52.419603+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:17.070730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.446033+0000","last_change":"2024-09-12T02:48:51.409016+0000","last_active":"2024-09-12T02:48:52.446033+0000","last_peered":"2024-09-12T02:48:52.446033+0000","last_clean":"2024-09-12T02:48:52.446033+0000","last_became_active":"2024-09-12T02:48:51.406502+0000","last_became_peered":"2024-09-12T02:48:51.406502+0000","last_unstale":"2024-09-12T02:48:52.446033+0000","last_undegraded":"2024-09-12T02:48:52.446033+0000","last_fullsized":"2024-09-12T02:48:52.446033+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:59.201654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398035+0000","last_change":"2024-09-12T02:48:50.392908+0000","last_active":"2024-09-12T02:48:52.398035+0000","last_peered":"2024-09-12T02:48:52.398035+0000","last_clean":"2024-09-12T02:48:52.398035+0000","last_became_active":"2024-09-12T02:48:50.392658+0000","last_became_peered":"2024-09-12T02:48:50.392658+0000","last_unstale":"2024-09-12T02:48:52.398035+0000","last_undegraded":"2024-09-12T02:48:52.398035+0000","last_fullsized":"2024-09-12T02:48:52.398035+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:32.837760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445431+0000","last_change":"2024-09-12T02:48:51.411139+0000","last_active":"2024-09-12T02:48:52.445431+0000","last_peered":"2024-09-12T02:48:52.445431+0000","last_clean":"2024-09-12T02:48:52.445431+0000","last_became_active":"2024-09-12T02:48:51.410905+0000","last_became_peered":"2024-09-12T02:48:51.410905+0000","last_unstale":"2024-09-12T02:48:52.445431+0000","last_undegraded":"2024-09-12T02:48:52.445431+0000","last_fullsized":"2024-09-12T02:48:52.445431+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:38.902122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"149'2","reported_seq":16,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398373+0000","last_change":"2024-09-12T02:48:50.386742+0000","last_active":"2024-09-12T02:48:52.398373+0000","last_peered":"2024-09-12T02:48:52.398373+0000","last_clean":"2024-09-12T02:48:52.398373+0000","last_became_active":"2024-09-12T02:48:50.386466+0000","last_became_peered":"2024-09-12T02:48:50.386466+0000","last_unstale":"2024-09-12T02:48:52.398373+0000","last_undegraded":"2024-09-12T02:48:52.398373+0000","last_fullsized":"2024-09-12T02:48:52.398373+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:54.717021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.419282+0000","last_change":"2024-09-12T02:48:51.405538+0000","last_active":"2024-09-12T02:48:52.419282+0000","last_peered":"2024-09-12T02:48:52.419282+0000","last_clean":"2024-09-12T02:48:52.419282+0000","last_became_active":"2024-09-12T02:48:51.405137+0000","last_became_peered":"2024-09-12T02:48:51.405137+0000","last_unstale":"2024-09-12T02:48:52.419282+0000","last_undegraded":"2024-09-12T02:48:52.419282+0000","last_fullsized":"2024-09-12T02:48:52.419282+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:19.469200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398760+0000","last_change":"2024-09-12T02:48:50.384642+0000","last_active":"2024-09-12T02:48:52.398760+0000","last_peered":"2024-09-12T02:48:52.398760+0000","last_clean":"2024-09-12T02:48:52.398760+0000","last_became_active":"2024-09-12T02:48:50.384408+0000","last_became_peered":"2024-09-12T02:48:50.384408+0000","last_unstale":"2024-09-12T02:48:52.398760+0000","last_undegraded":"2024-09-12T02:48:52.398760+0000","last_fullsized":"2024-09-12T02:48:52.398760+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:00.951217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445815+0000","last_change":"2024-09-12T02:48:51.406710+0000","last_active":"2024-09-12T02:48:52.445815+0000","last_peered":"2024-09-12T02:48:52.445815+0000","last_clean":"2024-09-12T02:48:52.445815+0000","last_became_active":"2024-09-12T02:48:51.406183+0000","last_became_peered":"2024-09-12T02:48:51.406183+0000","last_unstale":"2024-09-12T02:48:52.445815+0000","last_undegraded":"2024-09-12T02:48:52.445815+0000","last_fullsized":"2024-09-12T02:48:52.445815+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:23.087911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398721+0000","last_change":"2024-09-12T02:48:50.385737+0000","last_active":"2024-09-12T02:48:52.398721+0000","last_peered":"2024-09-12T02:48:52.398721+0000","last_clean":"2024-09-12T02:48:52.398721+0000","last_became_active":"2024-09-12T02:48:50.384881+0000","last_became_peered":"2024-09-12T02:48:50.384881+0000","last_unstale":"2024-09-12T02:48:52.398721+0000","last_undegraded":"2024-09-12T02:48:52.398721+0000","last_fullsized":"2024-09-12T02:48:52.398721+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:27.782581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.417727+0000","last_change":"2024-09-12T02:48:51.416326+0000","last_active":"2024-09-12T02:48:52.417727+0000","last_peered":"2024-09-12T02:48:52.417727+0000","last_clean":"2024-09-12T02:48:52.417727+0000","last_became_active":"2024-09-12T02:48:51.414825+0000","last_became_peered":"2024-09-12T02:48:51.414825+0000","last_unstale":"2024-09-12T02:48:52.417727+0000","last_undegraded":"2024-09-12T02:48:52.417727+0000","last_fullsized":"2024-09-12T02:48:52.417727+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:12.133309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.446778+0000","last_change":"2024-09-12T02:48:50.388608+0000","last_active":"2024-09-12T02:48:52.446778+0000","last_peered":"2024-09-12T02:48:52.446778+0000","last_clean":"2024-09-12T02:48:52.446778+0000","last_became_active":"2024-09-12T02:48:50.387983+0000","last_became_peered":"2024-09-12T02:48:50.387983+0000","last_unstale":"2024-09-12T02:48:52.446778+0000","last_undegraded":"2024-09-12T02:48:52.446778+0000","last_fullsized":"2024-09-12T02:48:52.446778+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:01.985939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.419387+0000","last_change":"2024-09-12T02:48:51.405359+0000","last_active":"2024-09-12T02:48:52.419387+0000","last_peered":"2024-09-12T02:48:52.419387+0000","last_clean":"2024-09-12T02:48:52.419387+0000","last_became_active":"2024-09-12T02:48:51.404399+0000","last_became_peered":"2024-09-12T02:48:51.404399+0000","last_unstale":"2024-09-12T02:48:52.419387+0000","last_undegraded":"2024-09-12T02:48:52.419387+0000","last_fullsized":"2024-09-12T02:48:52.419387+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:24.354463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"149'2","reported_seq":16,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.446530+0000","last_change":"2024-09-12T02:48:50.386428+0000","last_active":"2024-09-12T02:48:52.446530+0000","last_peered":"2024-09-12T02:48:52.446530+0000","last_clean":"2024-09-12T02:48:52.446530+0000","last_became_active":"2024-09-12T02:48:50.386136+0000","last_became_peered":"2024-09-12T02:48:50.386136+0000","last_unstale":"2024-09-12T02:48:52.446530+0000","last_undegraded":"2024-09-12T02:48:52.446530+0000","last_fullsized":"2024-09-12T02:48:52.446530+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:44:52.787612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.446258+0000","last_change":"2024-09-12T02:48:51.409246+0000","last_active":"2024-09-12T02:48:52.446258+0000","last_peered":"2024-09-12T02:48:52.446258+0000","last_clean":"2024-09-12T02:48:52.446258+0000","last_became_active":"2024-09-12T02:48:51.408773+0000","last_became_peered":"2024-09-12T02:48:51.408773+0000","last_unstale":"2024-09-12T02:48:52.446258+0000","last_undegraded":"2024-09-12T02:48:52.446258+0000","last_fullsized":"2024-09-12T02:48:52.446258+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:35.132670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"150'1","reported_seq":15,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.418885+0000","last_change":"2024-09-12T02:48:50.397206+0000","last_active":"2024-09-12T02:48:52.418885+0000","last_peered":"2024-09-12T02:48:52.418885+0000","last_clean":"2024-09-12T02:48:52.418885+0000","last_became_active":"2024-09-12T02:48:50.396776+0000","last_became_peered":"2024-09-12T02:48:50.396776+0000","last_unstale":"2024-09-12T02:48:52.418885+0000","last_undegraded":"2024-09-12T02:48:52.418885+0000","last_fullsized":"2024-09-12T02:48:52.418885+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:48.080240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.446339+0000","last_change":"2024-09-12T02:48:51.414482+0000","last_active":"2024-09-12T02:48:52.446339+0000","last_peered":"2024-09-12T02:48:52.446339+0000","last_clean":"2024-09-12T02:48:52.446339+0000","last_became_active":"2024-09-12T02:48:51.413922+0000","last_became_peered":"2024-09-12T02:48:51.413922+0000","last_unstale":"2024-09-12T02:48:52.446339+0000","last_undegraded":"2024-09-12T02:48:52.446339+0000","last_fullsized":"2024-09-12T02:48:52.446339+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:25.917508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445574+0000","last_change":"2024-09-12T02:48:50.388496+0000","last_active":"2024-09-12T02:48:52.445574+0000","last_peered":"2024-09-12T02:48:52.445574+0000","last_clean":"2024-09-12T02:48:52.445574+0000","last_became_active":"2024-09-12T02:48:50.387711+0000","last_became_peered":"2024-09-12T02:48:50.387711+0000","last_unstale":"2024-09-12T02:48:52.445574+0000","last_undegraded":"2024-09-12T02:48:52.445574+0000","last_fullsized":"2024-09-12T02:48:52.445574+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:36.665302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.419157+0000","last_change":"2024-09-12T02:48:51.410287+0000","last_active":"2024-09-12T02:48:52.419157+0000","last_peered":"2024-09-12T02:48:52.419157+0000","last_clean":"2024-09-12T02:48:52.419157+0000","last_became_active":"2024-09-12T02:48:51.410054+0000","last_became_peered":"2024-09-12T02:48:51.410054+0000","last_unstale":"2024-09-12T02:48:52.419157+0000","last_undegraded":"2024-09-12T02:48:52.419157+0000","last_fullsized":"2024-09-12T02:48:52.419157+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:17:38.501130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445180+0000","last_change":"2024-09-12T02:48:50.397343+0000","last_active":"2024-09-12T02:48:52.445180+0000","last_peered":"2024-09-12T02:48:52.445180+0000","last_clean":"2024-09-12T02:48:52.445180+0000","last_became_active":"2024-09-12T02:48:50.394886+0000","last_became_peered":"2024-09-12T02:48:50.394886+0000","last_unstale":"2024-09-12T02:48:52.445180+0000","last_undegraded":"2024-09-12T02:48:52.445180+0000","last_fullsized":"2024-09-12T02:48:52.445180+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:57.059133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.417480+0000","last_change":"2024-09-12T02:48:51.415337+0000","last_active":"2024-09-12T02:48:52.417480+0000","last_peered":"2024-09-12T02:48:52.417480+0000","last_clean":"2024-09-12T02:48:52.417480+0000","last_became_active":"2024-09-12T02:48:51.415087+0000","last_became_peered":"2024-09-12T02:48:51.415087+0000","last_unstale":"2024-09-12T02:48:52.417480+0000","last_undegraded":"2024-09-12T02:48:52.417480+0000","last_fullsized":"2024-09-12T02:48:52.417480+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:16.175781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.446126+0000","last_change":"2024-09-12T02:48:50.393440+0000","last_active":"2024-09-12T02:48:52.446126+0000","last_peered":"2024-09-12T02:48:52.446126+0000","last_clean":"2024-09-12T02:48:52.446126+0000","last_became_active":"2024-09-12T02:48:50.393120+0000","last_became_peered":"2024-09-12T02:48:50.393120+0000","last_unstale":"2024-09-12T02:48:52.446126+0000","last_undegraded":"2024-09-12T02:48:52.446126+0000","last_fullsized":"2024-09-12T02:48:52.446126+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:40.147675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398138+0000","last_change":"2024-09-12T02:48:51.408672+0000","last_active":"2024-09-12T02:48:52.398138+0000","last_peered":"2024-09-12T02:48:52.398138+0000","last_clean":"2024-09-12T02:48:52.398138+0000","last_became_active":"2024-09-12T02:48:51.408443+0000","last_became_peered":"2024-09-12T02:48:51.408443+0000","last_unstale":"2024-09-12T02:48:52.398138+0000","last_undegraded":"2024-09-12T02:48:52.398138+0000","last_fullsized":"2024-09-12T02:48:52.398138+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:23.335912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.417700+0000","last_change":"2024-09-12T02:48:50.398713+0000","last_active":"2024-09-12T02:48:52.417700+0000","last_peered":"2024-09-12T02:48:52.417700+0000","last_clean":"2024-09-12T02:48:52.417700+0000","last_became_active":"2024-09-12T02:48:50.398499+0000","last_became_peered":"2024-09-12T02:48:50.398499+0000","last_unstale":"2024-09-12T02:48:52.417700+0000","last_undegraded":"2024-09-12T02:48:52.417700+0000","last_fullsized":"2024-09-12T02:48:52.417700+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:27.383780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.398672+0000","last_change":"2024-09-12T02:48:51.400720+0000","last_active":"2024-09-12T02:48:52.398672+0000","last_peered":"2024-09-12T02:48:52.398672+0000","last_clean":"2024-09-12T02:48:52.398672+0000","last_became_active":"2024-09-12T02:48:51.400467+0000","last_became_peered":"2024-09-12T02:48:51.400467+0000","last_unstale":"2024-09-12T02:48:52.398672+0000","last_undegraded":"2024-09-12T02:48:52.398672+0000","last_fullsized":"2024-09-12T02:48:52.398672+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:54.020042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.399004+0000","last_change":"2024-09-12T02:48:50.385509+0000","last_active":"2024-09-12T02:48:52.399004+0000","last_peered":"2024-09-12T02:48:52.399004+0000","last_clean":"2024-09-12T02:48:52.399004+0000","last_became_active":"2024-09-12T02:48:50.385177+0000","last_became_peered":"2024-09-12T02:48:50.385177+0000","last_unstale":"2024-09-12T02:48:52.399004+0000","last_undegraded":"2024-09-12T02:48:52.399004+0000","last_fullsized":"2024-09-12T02:48:52.399004+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:17.586853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445687+0000","last_change":"2024-09-12T02:48:51.412557+0000","last_active":"2024-09-12T02:48:52.445687+0000","last_peered":"2024-09-12T02:48:52.445687+0000","last_clean":"2024-09-12T02:48:52.445687+0000","last_became_active":"2024-09-12T02:48:51.411738+0000","last_became_peered":"2024-09-12T02:48:51.411738+0000","last_unstale":"2024-09-12T02:48:52.445687+0000","last_undegraded":"2024-09-12T02:48:52.445687+0000","last_fullsized":"2024-09-12T02:48:52.445687+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:58.098980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.445483+0000","last_change":"2024-09-12T02:48:50.391689+0000","last_active":"2024-09-12T02:48:52.445483+0000","last_peered":"2024-09-12T02:48:52.445483+0000","last_clean":"2024-09-12T02:48:52.445483+0000","last_became_active":"2024-09-12T02:48:50.390695+0000","last_became_peered":"2024-09-12T02:48:50.390695+0000","last_unstale":"2024-09-12T02:48:52.445483+0000","last_undegraded":"2024-09-12T02:48:52.445483+0000","last_fullsized":"2024-09-12T02:48:52.445483+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:10.646176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.417876+0000","last_change":"2024-09-12T02:48:51.418110+0000","last_active":"2024-09-12T02:48:52.417876+0000","last_peered":"2024-09-12T02:48:52.417876+0000","last_clean":"2024-09-12T02:48:52.417876+0000","last_became_active":"2024-09-12T02:48:51.417515+0000","last_became_peered":"2024-09-12T02:48:51.417515+0000","last_unstale":"2024-09-12T02:48:52.417876+0000","last_undegraded":"2024-09-12T02:48:52.417876+0000","last_fullsized":"2024-09-12T02:48:52.417876+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:50.374784+0000","last_clean_scrub_stamp":"2024-09-12T02:48:50.374784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:19.641688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"149'2","reported_seq":16,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.418192+0000","last_change":"2024-09-12T02:48:50.397683+0000","last_active":"2024-09-12T02:48:52.418192+0000","last_peered":"2024-09-12T02:48:52.418192+0000","last_clean":"2024-09-12T02:48:52.418192+0000","last_became_active":"2024-09-12T02:48:50.397439+0000","last_became_peered":"2024-09-12T02:48:50.397439+0000","last_unstale":"2024-09-12T02:48:52.418192+0000","last_undegraded":"2024-09-12T02:48:52.418192+0000","last_fullsized":"2024-09-12T02:48:52.418192+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:48:49.367017+0000","last_clean_scrub_stamp":"2024-09-12T02:48:49.367017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:10.559329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":421,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-12T02:48:52.417787+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:48:52.417787+0000","last_peered":"2024-09-12T02:48:52.417787+0000","last_clean":"2024-09-12T02:48:52.417787+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:48:52.417787+0000","last_undegraded":"2024-09-12T02:48:52.417787+0000","last_fullsized":"2024-09-12T02:48:52.417787+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:25.823876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574936,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1393,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193918,"statfs":{"total":200000000,"available":198572738,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574936,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":810,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194501,"statfs":{"total":200000000,"available":199170044,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574936,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":815,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194497,"statfs":{"total":200000000,"available":199165244,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574936,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":815,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194497,"statfs":{"total":200000000,"available":199165286,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574936,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":815,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194497,"statfs":{"total":200000000,"available":199165196,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574936,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":815,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194496,"statfs":{"total":200000000,"available":199164740,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":808,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194503,"statfs":{"total":200000000,"available":199171656,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574936,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1391,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193920,"statfs":{"total":200000000,"available":198574988,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:48:55.972 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:48:55.972 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T02:48:56.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.167+0000 7fee62600640 1 Processor -- start 2024-09-12T02:48:56.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.167+0000 7fee62600640 1 -- start start 2024-09-12T02:48:56.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.168+0000 7fee62600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fee5c1466f0 0x7fee5c0b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:56.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.168+0000 7fee62600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fee5c071840 0x7fee5c071cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:56.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.168+0000 7fee62600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee5c0b3af0 con 0x7fee5c1605e0 2024-09-12T02:48:56.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.169+0000 7fee62600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fee5c0b3dd0 con 0x7fee5c071840 2024-09-12T02:48:56.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.169+0000 7fee62600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fee5c0b40b0 con 0x7fee5c1466f0 2024-09-12T02:48:56.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.169+0000 7fee5be00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fee5c071840 0x7fee5c071cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:56.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.169+0000 7fee53e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fee5c1605e0 0x7fee5c160a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33650/0 (socket says 172.21.15.112:33650) 2024-09-12T02:48:56.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.169+0000 7fee53e00640 1 -- 172.21.15.112:0/4018843377 learned_addr learned my addr 172.21.15.112:0/4018843377 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:56.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.169+0000 7fee5b400640 1 --2- 172.21.15.112:0/4018843377 >> v2:172.21.15.137:3300/0 conn(0x7fee5c1466f0 0x7fee5c0b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:56.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.169+0000 7fee5be00640 1 -- 172.21.15.112:0/4018843377 >> v2:172.21.15.137:3300/0 conn(0x7fee5c1466f0 msgr2=0x7fee5c0b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:56.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.169+0000 7fee5be00640 1 --2- 172.21.15.112:0/4018843377 >> v2:172.21.15.137:3300/0 conn(0x7fee5c1466f0 0x7fee5c0b48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:56.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.169+0000 7fee5be00640 1 -- 172.21.15.112:0/4018843377 >> v1:172.21.15.112:6789/0 conn(0x7fee5c1605e0 legacy=0x7fee5c160a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:56.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.169+0000 7fee5be00640 1 -- 172.21.15.112:0/4018843377 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee5c0b4390 con 0x7fee5c071840 2024-09-12T02:48:56.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.169+0000 7fee5aa00640 1 -- 172.21.15.112:0/4018843377 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2858151396 0 0) 0x7fee5c0b3af0 con 0x7fee5c1605e0 2024-09-12T02:48:56.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.170+0000 7fee5be00640 1 --2- 172.21.15.112:0/4018843377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee5c071840 0x7fee5c071cd0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fee5c072d80 tx=0x7fee5402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c20d8b77064b8cf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:56.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.170+0000 7fee5aa00640 1 -- 172.21.15.112:0/4018843377 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee54007740 con 0x7fee5c071840 2024-09-12T02:48:56.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.170+0000 7fee5aa00640 1 -- 172.21.15.112:0/4018843377 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee540078e0 con 0x7fee5c071840 2024-09-12T02:48:56.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.170+0000 7fee5aa00640 1 -- 172.21.15.112:0/4018843377 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee54007cb0 con 0x7fee5c071840 2024-09-12T02:48:56.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.171+0000 7fee62600640 1 -- 172.21.15.112:0/4018843377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee5c071840 msgr2=0x7fee5c071cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:56.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.171+0000 7fee62600640 1 --2- 172.21.15.112:0/4018843377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee5c071840 0x7fee5c071cd0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fee5c072d80 tx=0x7fee5402a5f0 comp rx=0 tx=0).stop 2024-09-12T02:48:56.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.171+0000 7fee62600640 1 -- 172.21.15.112:0/4018843377 shutdown_connections 2024-09-12T02:48:56.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.171+0000 7fee62600640 1 --2- 172.21.15.112:0/4018843377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee5c071840 0x7fee5c071cd0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:56.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.171+0000 7fee62600640 1 --2- 172.21.15.112:0/4018843377 >> v2:172.21.15.137:3300/0 conn(0x7fee5c1466f0 0x7fee5c0b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:56.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.171+0000 7fee62600640 1 -- 172.21.15.112:0/4018843377 >> 172.21.15.112:0/4018843377 conn(0x7fee5c0b28a0 msgr2=0x7fee5c0b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:56.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.171+0000 7fee62600640 1 -- 172.21.15.112:0/4018843377 shutdown_connections 2024-09-12T02:48:56.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.171+0000 7fee62600640 1 -- 172.21.15.112:0/4018843377 wait complete. 2024-09-12T02:48:56.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.173+0000 7fee62600640 1 Processor -- start 2024-09-12T02:48:56.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.173+0000 7fee62600640 1 -- start start 2024-09-12T02:48:56.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.174+0000 7fee62600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee5c071840 0x7fee5c157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:56.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.174+0000 7fee62600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee5c1466f0 0x7fee5c13dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:56.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.174+0000 7fee62600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fee5c1605e0 0x7fee5c159e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:56.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.174+0000 7fee62600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c072390 con 0x7fee5c071840 2024-09-12T02:48:56.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.174+0000 7fee62600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c072210 con 0x7fee5c1466f0 2024-09-12T02:48:56.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.174+0000 7fee62600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fee5c15e1b0 con 0x7fee5c1605e0 2024-09-12T02:48:56.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.174+0000 7fee5b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee5c071840 0x7fee5c157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:56.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.174+0000 7fee5b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee5c071840 0x7fee5c157790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39804/0 (socket says 172.21.15.112:39804) 2024-09-12T02:48:56.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.174+0000 7fee5b400640 1 -- 172.21.15.112:0/3617689202 learned_addr learned my addr 172.21.15.112:0/3617689202 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:56.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.175+0000 7fee5b400640 1 -- 172.21.15.112:0/3617689202 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fee5c1605e0 msgr2=0x7fee5c159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:56.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.175+0000 7fee5b400640 1 --2- 172.21.15.112:0/3617689202 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fee5c1605e0 0x7fee5c159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:56.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.175+0000 7fee5b400640 1 -- 172.21.15.112:0/3617689202 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee5c1466f0 msgr2=0x7fee5c13dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:56.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.175+0000 7fee53e00640 1 --2- 172.21.15.112:0/3617689202 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee5c1466f0 0x7fee5c13dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:56.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.175+0000 7fee5b400640 1 --2- 172.21.15.112:0/3617689202 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee5c1466f0 0x7fee5c13dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:56.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.175+0000 7fee5b400640 1 -- 172.21.15.112:0/3617689202 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee5c13e210 con 0x7fee5c071840 2024-09-12T02:48:56.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.175+0000 7fee53e00640 1 --2- 172.21.15.112:0/3617689202 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee5c1466f0 0x7fee5c13dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:48:56.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.175+0000 7fee5b400640 1 --2- 172.21.15.112:0/3617689202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee5c071840 0x7fee5c157790 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fee4c00e9b0 tx=0x7fee4c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:56.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.175+0000 7fee53400640 1 -- 172.21.15.112:0/3617689202 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4c017070 con 0x7fee5c071840 2024-09-12T02:48:56.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.175+0000 7fee53400640 1 -- 172.21.15.112:0/3617689202 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee4c00c9a0 con 0x7fee5c071840 2024-09-12T02:48:56.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.175+0000 7fee53400640 1 -- 172.21.15.112:0/3617689202 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4c00cd90 con 0x7fee5c071840 2024-09-12T02:48:56.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.175+0000 7fee62600640 1 -- 172.21.15.112:0/3617689202 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee5c15ad90 con 0x7fee5c071840 2024-09-12T02:48:56.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.175+0000 7fee62600640 1 -- 172.21.15.112:0/3617689202 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee5c15b350 con 0x7fee5c071840 2024-09-12T02:48:56.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.176+0000 7fee62600640 1 -- 172.21.15.112:0/3617689202 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee5c071cd0 con 0x7fee5c071840 2024-09-12T02:48:56.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.177+0000 7fee53400640 1 -- 172.21.15.112:0/3617689202 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee4c01a070 con 0x7fee5c071840 2024-09-12T02:48:56.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.178+0000 7fee53400640 1 --2- 172.21.15.112:0/3617689202 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fee3806be30 0x7fee3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:56.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.178+0000 7fee53400640 1 -- 172.21.15.112:0/3617689202 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 5709+0+0 (secure 0 0 0) 0x7fee4c08b300 con 0x7fee5c071840 2024-09-12T02:48:56.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.178+0000 7fee53e00640 1 --2- 172.21.15.112:0/3617689202 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fee3806be30 0x7fee3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:56.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.179+0000 7fee53e00640 1 --2- 172.21.15.112:0/3617689202 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fee3806be30 0x7fee3806e2f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fee5c06f1f0 tx=0x7fee44009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:56.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.182+0000 7fee53400640 1 -- 172.21.15.112:0/3617689202 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fee4c059c10 con 0x7fee5c071840 2024-09-12T02:48:56.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.417+0000 7fee62600640 1 -- 172.21.15.112:0/3617689202 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fee5c15f170 con 0x7fee5c071840 2024-09-12T02:48:56.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.420+0000 7fee53400640 1 -- 172.21.15.112:0/3617689202 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) ==== 190+0+147 (secure 0 0 0) 0x7fee4c059510 con 0x7fee5c071840 2024-09-12T02:48:56.421 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-09-12T02:48:56.421 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDUVOJmaG86ExAAD0SOlJOsLpoQZlgPJIPaxA== 2024-09-12T02:48:56.422 INFO:teuthology.orchestra.run.smithi112.stdout: caps mds = "allow" 2024-09-12T02:48:56.422 INFO:teuthology.orchestra.run.smithi112.stdout: caps mon = "allow r" 2024-09-12T02:48:56.422 INFO:teuthology.orchestra.run.smithi112.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T02:48:56.422 INFO:teuthology.orchestra.run.smithi112.stderr:updated caps for client.0 2024-09-12T02:48:56.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.423+0000 7fee62600640 1 -- 172.21.15.112:0/3617689202 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fee3806be30 msgr2=0x7fee3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:56.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.423+0000 7fee62600640 1 --2- 172.21.15.112:0/3617689202 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fee3806be30 0x7fee3806e2f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fee5c06f1f0 tx=0x7fee44009040 comp rx=0 tx=0).stop 2024-09-12T02:48:56.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.423+0000 7fee62600640 1 -- 172.21.15.112:0/3617689202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee5c071840 msgr2=0x7fee5c157790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:56.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.423+0000 7fee62600640 1 --2- 172.21.15.112:0/3617689202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee5c071840 0x7fee5c157790 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fee4c00e9b0 tx=0x7fee4c00ee70 comp rx=0 tx=0).stop 2024-09-12T02:48:56.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.423+0000 7fee62600640 1 -- 172.21.15.112:0/3617689202 shutdown_connections 2024-09-12T02:48:56.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.423+0000 7fee62600640 1 --2- 172.21.15.112:0/3617689202 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fee5c1605e0 0x7fee5c159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:56.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.423+0000 7fee62600640 1 --2- 172.21.15.112:0/3617689202 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fee3806be30 0x7fee3806e2f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:56.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.423+0000 7fee62600640 1 --2- 172.21.15.112:0/3617689202 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee5c1466f0 0x7fee5c13dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:56.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.423+0000 7fee62600640 1 --2- 172.21.15.112:0/3617689202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee5c071840 0x7fee5c157790 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:56.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.423+0000 7fee62600640 1 -- 172.21.15.112:0/3617689202 >> 172.21.15.112:0/3617689202 conn(0x7fee5c0b28a0 msgr2=0x7fee5c0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:56.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.423+0000 7fee62600640 1 -- 172.21.15.112:0/3617689202 shutdown_connections 2024-09-12T02:48:56.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.423+0000 7fee62600640 1 -- 172.21.15.112:0/3617689202 wait complete. 2024-09-12T02:48:56.443 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:48:56.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.593+0000 7f897b200640 1 Processor -- start 2024-09-12T02:48:56.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.594+0000 7f897b200640 1 -- start start 2024-09-12T02:48:56.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.595+0000 7f897b200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f897415b9d0 0x7f89740b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:56.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.595+0000 7f897b200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f897406f600 0x7f89740728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:56.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.595+0000 7f897b200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89740b54a0 con 0x7f89740b45d0 2024-09-12T02:48:56.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.595+0000 7f897b200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f89740b4a60 con 0x7f897415b9d0 2024-09-12T02:48:56.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.595+0000 7f897b200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f89740b3af0 con 0x7f897406f600 2024-09-12T02:48:56.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.595+0000 7f8979200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f897406f600 0x7f89740728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:56.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.595+0000 7f8973e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f897415b9d0 0x7f89740b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:56.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.595+0000 7f8979200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f897406f600 0x7f89740728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:36780/0 (socket says 172.21.15.112:36780) 2024-09-12T02:48:56.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.595+0000 7f8973e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f897415b9d0 0x7f89740b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:58626/0 (socket says 172.21.15.112:58626) 2024-09-12T02:48:56.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.596+0000 7f8979200640 1 -- 172.21.15.112:0/1361025545 learned_addr learned my addr 172.21.15.112:0/1361025545 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:56.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.596+0000 7f8979200640 1 -- 172.21.15.112:0/1361025545 >> v2:172.21.15.137:3300/0 conn(0x7f897415b9d0 msgr2=0x7f89740b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:56.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.596+0000 7f8979200640 1 --2- 172.21.15.112:0/1361025545 >> v2:172.21.15.137:3300/0 conn(0x7f897415b9d0 0x7f89740b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:56.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.596+0000 7f8979200640 1 -- 172.21.15.112:0/1361025545 >> v1:172.21.15.137:6789/0 conn(0x7f89740b45d0 legacy=0x7f897406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:56.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.596+0000 7f8979200640 1 -- 172.21.15.112:0/1361025545 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89740b3dd0 con 0x7f897406f600 2024-09-12T02:48:56.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.596+0000 7f8973e00640 1 --2- 172.21.15.112:0/1361025545 >> v2:172.21.15.137:3300/0 conn(0x7f897415b9d0 0x7f89740b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:56.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.597+0000 7f8979200640 1 --2- 172.21.15.112:0/1361025545 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f897406f600 0x7f89740728c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f896c009e50 tx=0x7f896c02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46d465b22970cab4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:56.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.597+0000 7f8973400640 1 -- 172.21.15.112:0/1361025545 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c036070 con 0x7f897406f600 2024-09-12T02:48:56.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.597+0000 7f8973400640 1 -- 172.21.15.112:0/1361025545 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f896c031600 con 0x7f897406f600 2024-09-12T02:48:56.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.597+0000 7f8973400640 1 -- 172.21.15.112:0/1361025545 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c0319d0 con 0x7f897406f600 2024-09-12T02:48:56.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.598+0000 7f897b200640 1 -- 172.21.15.112:0/1361025545 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f897406f600 msgr2=0x7f89740728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:56.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.598+0000 7f897b200640 1 --2- 172.21.15.112:0/1361025545 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f897406f600 0x7f89740728c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f896c009e50 tx=0x7f896c02a710 comp rx=0 tx=0).stop 2024-09-12T02:48:56.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.598+0000 7f897b200640 1 -- 172.21.15.112:0/1361025545 shutdown_connections 2024-09-12T02:48:56.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.598+0000 7f897b200640 1 --2- 172.21.15.112:0/1361025545 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f897406f600 0x7f89740728c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:56.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.598+0000 7f897b200640 1 --2- 172.21.15.112:0/1361025545 >> v2:172.21.15.137:3300/0 conn(0x7f897415b9d0 0x7f89740b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:56.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.598+0000 7f897b200640 1 -- 172.21.15.112:0/1361025545 >> 172.21.15.112:0/1361025545 conn(0x7f897406bbd0 msgr2=0x7f897406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:56.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.598+0000 7f897b200640 1 -- 172.21.15.112:0/1361025545 shutdown_connections 2024-09-12T02:48:56.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.598+0000 7f897b200640 1 -- 172.21.15.112:0/1361025545 wait complete. 2024-09-12T02:48:56.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.600+0000 7f897b200640 1 Processor -- start 2024-09-12T02:48:56.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.600+0000 7f897b200640 1 -- start start 2024-09-12T02:48:56.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.600+0000 7f897b200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f897406f600 0x7f897415ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:56.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.600+0000 7f897b200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89740b45d0 0x7f89740b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:56.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.600+0000 7f897b200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f897415b9d0 0x7f89740b17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:56.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.601+0000 7f897b200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f897415bf30 con 0x7f89740b45d0 2024-09-12T02:48:56.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.601+0000 7f897b200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f897415bdb0 con 0x7f897415b9d0 2024-09-12T02:48:56.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.601+0000 7f897b200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f89740cdcd0 con 0x7f897406f600 2024-09-12T02:48:56.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.601+0000 7f896b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89740b45d0 0x7f89740b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:56.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.601+0000 7f896b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89740b45d0 0x7f89740b12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39818/0 (socket says 172.21.15.112:39818) 2024-09-12T02:48:56.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.601+0000 7f896b400640 1 -- 172.21.15.112:0/1385014856 learned_addr learned my addr 172.21.15.112:0/1385014856 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:56.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.601+0000 7f8973e00640 1 --2- 172.21.15.112:0/1385014856 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f897406f600 0x7f897415ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:56.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.601+0000 7f8979200640 1 --2- 172.21.15.112:0/1385014856 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f897415b9d0 0x7f89740b17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:56.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.601+0000 7f896b400640 1 -- 172.21.15.112:0/1385014856 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f897406f600 msgr2=0x7f897415ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:56.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.601+0000 7f896b400640 1 --2- 172.21.15.112:0/1385014856 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f897406f600 0x7f897415ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:56.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.601+0000 7f896b400640 1 -- 172.21.15.112:0/1385014856 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f897415b9d0 msgr2=0x7f89740b17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:56.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.601+0000 7f896b400640 1 --2- 172.21.15.112:0/1385014856 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f897415b9d0 0x7f89740b17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:56.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.601+0000 7f896b400640 1 -- 172.21.15.112:0/1385014856 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f897415b0c0 con 0x7f89740b45d0 2024-09-12T02:48:56.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.602+0000 7f896b400640 1 --2- 172.21.15.112:0/1385014856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89740b45d0 0x7f89740b12a0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f895c00c400 tx=0x7f895c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:56.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.602+0000 7f8970c00640 1 -- 172.21.15.112:0/1385014856 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c0052d0 con 0x7f89740b45d0 2024-09-12T02:48:56.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.602+0000 7f8970c00640 1 -- 172.21.15.112:0/1385014856 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f895c0054b0 con 0x7f89740b45d0 2024-09-12T02:48:56.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.602+0000 7f897b200640 1 -- 172.21.15.112:0/1385014856 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89741f4b90 con 0x7f89740b45d0 2024-09-12T02:48:56.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.602+0000 7f8970c00640 1 -- 172.21.15.112:0/1385014856 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c006a40 con 0x7f89740b45d0 2024-09-12T02:48:56.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.602+0000 7f897b200640 1 -- 172.21.15.112:0/1385014856 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89741f5150 con 0x7f89740b45d0 2024-09-12T02:48:56.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.603+0000 7f897b200640 1 -- 172.21.15.112:0/1385014856 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8974068a30 con 0x7f89740b45d0 2024-09-12T02:48:56.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.604+0000 7f8970c00640 1 -- 172.21.15.112:0/1385014856 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f895c006be0 con 0x7f89740b45d0 2024-09-12T02:48:56.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.605+0000 7f8970c00640 1 --2- 172.21.15.112:0/1385014856 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f895006be30 0x7f895006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:56.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.605+0000 7f8970c00640 1 -- 172.21.15.112:0/1385014856 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 5709+0+0 (secure 0 0 0) 0x7f895c08a280 con 0x7f89740b45d0 2024-09-12T02:48:56.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.605+0000 7f8973e00640 1 --2- 172.21.15.112:0/1385014856 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f895006be30 0x7f895006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:56.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.606+0000 7f8973e00640 1 --2- 172.21.15.112:0/1385014856 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f895006be30 0x7f895006e2f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8964009560 tx=0x7f8964009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:56.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.609+0000 7f8970c00640 1 -- 172.21.15.112:0/1385014856 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f895c0585d0 con 0x7f89740b45d0 2024-09-12T02:48:56.721 INFO:tasks.ceph.mds.b.smithi137.stderr:2024-09-12T02:48:56.720+0000 7f710bc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:48:56.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.815+0000 7f897b200640 1 -- 172.21.15.112:0/1385014856 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8974158490 con 0x7f89740b45d0 2024-09-12T02:48:56.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.816+0000 7f8970c00640 1 -- 172.21.15.112:0/1385014856 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) ==== 94+0+5234 (secure 0 0 0) 0x7f895c05c8d0 con 0x7f89740b45d0 2024-09-12T02:48:56.817 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:48:56.817 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":78,"btime":"2024-09-12T02:48:54:420600+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6074,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/984843624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":984843624},{"type":"v1","addr":"172.21.15.112:6836","nonce":984843624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3470369780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3470369780},{"type":"v1","addr":"172.21.15.112:6837","nonce":3470369780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/3190674567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3190674567},{"type":"v1","addr":"172.21.15.137:6834","nonce":3190674567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:48:50.793801+0000","modified":"2024-09-12T02:48:53.825952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7257":{"gid":7257,"name":"b","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/1000067194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1000067194},{"type":"v1","addr":"172.21.15.137:6835","nonce":1000067194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7257,"qdb_cluster":[7257]},"id":9}]} 2024-09-12T02:48:56.817 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 78 2024-09-12T02:48:56.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.818+0000 7f897b200640 1 -- 172.21.15.112:0/1385014856 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f895006be30 msgr2=0x7f895006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:56.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.818+0000 7f897b200640 1 --2- 172.21.15.112:0/1385014856 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f895006be30 0x7f895006e2f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8964009560 tx=0x7f8964009190 comp rx=0 tx=0).stop 2024-09-12T02:48:56.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.818+0000 7f897b200640 1 -- 172.21.15.112:0/1385014856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89740b45d0 msgr2=0x7f89740b12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:56.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.818+0000 7f897b200640 1 --2- 172.21.15.112:0/1385014856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89740b45d0 0x7f89740b12a0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f895c00c400 tx=0x7f895c00c8c0 comp rx=0 tx=0).stop 2024-09-12T02:48:56.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.818+0000 7f897b200640 1 -- 172.21.15.112:0/1385014856 shutdown_connections 2024-09-12T02:48:56.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.818+0000 7f897b200640 1 --2- 172.21.15.112:0/1385014856 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f895006be30 0x7f895006e2f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:56.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.818+0000 7f897b200640 1 --2- 172.21.15.112:0/1385014856 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f897415b9d0 0x7f89740b17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:56.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.818+0000 7f897b200640 1 --2- 172.21.15.112:0/1385014856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89740b45d0 0x7f89740b12a0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:56.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.818+0000 7f897b200640 1 --2- 172.21.15.112:0/1385014856 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f897406f600 0x7f897415ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:56.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.818+0000 7f897b200640 1 -- 172.21.15.112:0/1385014856 >> 172.21.15.112:0/1385014856 conn(0x7f897406bbd0 msgr2=0x7f89740722d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:56.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.818+0000 7f897b200640 1 -- 172.21.15.112:0/1385014856 shutdown_connections 2024-09-12T02:48:56.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:56.818+0000 7f897b200640 1 -- 172.21.15.112:0/1385014856 wait complete. 2024-09-12T02:48:57.237 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 78, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:48:50.793801+0000', 'modified': '2024-09-12T02:48:53.825952+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7257}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7257': {'gid': 7257, 'name': 'b', 'rank': 0, 'incarnation': 74, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.137:6835/1000067194', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6833', 'nonce': 1000067194}, {'type': 'v1', 'addr': '172.21.15.137:6835', 'nonce': 1000067194}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7257, 'qdb_cluster': [7257]} 2024-09-12T02:48:57.237 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:48:57.237 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-12T02:48:57.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.391+0000 7f7310a00640 1 Processor -- start 2024-09-12T02:48:57.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.392+0000 7f7310a00640 1 -- start start 2024-09-12T02:48:57.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.393+0000 7f7310a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f730c15ef10 0x7f730c06d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:57.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.393+0000 7f7310a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f730c06e040 con 0x7f730c06dc30 2024-09-12T02:48:57.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.393+0000 7f7310a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f730c0b6e10 con 0x7f730c0b3ee0 2024-09-12T02:48:57.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.393+0000 7f7310a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f730c0b3bc0 con 0x7f730c15ef10 2024-09-12T02:48:57.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.393+0000 7f730a800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f730c15ef10 0x7f730c06d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:57.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.393+0000 7f730b200640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f730c06dc30 0x7f730c0b34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33656/0 (socket says 172.21.15.112:33656) 2024-09-12T02:48:57.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.393+0000 7f730b200640 1 -- 172.21.15.112:0/679323202 learned_addr learned my addr 172.21.15.112:0/679323202 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:57.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.394+0000 7f730a800640 1 -- 172.21.15.112:0/679323202 >> v1:172.21.15.137:6789/0 conn(0x7f730c0b3ee0 legacy=0x7f730c0af9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:57.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.394+0000 7f730a800640 1 -- 172.21.15.112:0/679323202 >> v1:172.21.15.112:6789/0 conn(0x7f730c06dc30 legacy=0x7f730c0b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:57.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.394+0000 7f730a800640 1 -- 172.21.15.112:0/679323202 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730c0b70f0 con 0x7f730c15ef10 2024-09-12T02:48:57.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.395+0000 7f730a800640 1 --2- 172.21.15.112:0/679323202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f730c15ef10 0x7f730c06d6f0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0097a0 tx=0x7f72fc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458aa91c0e9f8406 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:57.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.395+0000 7f7309e00640 1 -- 172.21.15.112:0/679323202 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72fc037070 con 0x7f730c15ef10 2024-09-12T02:48:57.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.395+0000 7f7309e00640 1 -- 172.21.15.112:0/679323202 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72fc032440 con 0x7f730c15ef10 2024-09-12T02:48:57.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.395+0000 7f7309e00640 1 -- 172.21.15.112:0/679323202 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72fc02ae60 con 0x7f730c15ef10 2024-09-12T02:48:57.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.395+0000 7f7310a00640 1 -- 172.21.15.112:0/679323202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f730c15ef10 msgr2=0x7f730c06d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:57.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.395+0000 7f7310a00640 1 --2- 172.21.15.112:0/679323202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f730c15ef10 0x7f730c06d6f0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0097a0 tx=0x7f72fc02a110 comp rx=0 tx=0).stop 2024-09-12T02:48:57.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.395+0000 7f7310a00640 1 -- 172.21.15.112:0/679323202 shutdown_connections 2024-09-12T02:48:57.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.395+0000 7f7310a00640 1 --2- 172.21.15.112:0/679323202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f730c15ef10 0x7f730c06d6f0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.395+0000 7f7310a00640 1 -- 172.21.15.112:0/679323202 >> 172.21.15.112:0/679323202 conn(0x7f730c0b7ea0 msgr2=0x7f730c0b82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:57.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.396+0000 7f7310a00640 1 -- 172.21.15.112:0/679323202 shutdown_connections 2024-09-12T02:48:57.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.396+0000 7f7310a00640 1 -- 172.21.15.112:0/679323202 wait complete. 2024-09-12T02:48:57.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.397+0000 7f7310a00640 1 Processor -- start 2024-09-12T02:48:57.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.397+0000 7f7310a00640 1 -- start start 2024-09-12T02:48:57.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.398+0000 7f7310a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f730c06dc30 0x7f730c1ea9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:57.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.398+0000 7f7310a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f730c0b3ee0 0x7f730c09ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:57.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.398+0000 7f7310a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f730c15ef10 0x7f730c0a04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:57.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.398+0000 7f7310a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f730c0b76b0 con 0x7f730c06dc30 2024-09-12T02:48:57.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.398+0000 7f7310a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f730c15f2f0 con 0x7f730c0b3ee0 2024-09-12T02:48:57.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.398+0000 7f7310a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f730c0b00e0 con 0x7f730c15ef10 2024-09-12T02:48:57.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.398+0000 7f730a800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f730c06dc30 0x7f730c1ea9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:57.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.398+0000 7f730a800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f730c06dc30 0x7f730c1ea9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39826/0 (socket says 172.21.15.112:39826) 2024-09-12T02:48:57.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.398+0000 7f730a800640 1 -- 172.21.15.112:0/356839460 learned_addr learned my addr 172.21.15.112:0/356839460 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:57.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.399+0000 7f7301e00640 1 --2- 172.21.15.112:0/356839460 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f730c0b3ee0 0x7f730c09ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:57.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.399+0000 7f730b200640 1 --2- 172.21.15.112:0/356839460 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f730c15ef10 0x7f730c0a04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:57.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.399+0000 7f730a800640 1 -- 172.21.15.112:0/356839460 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f730c15ef10 msgr2=0x7f730c0a04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:57.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.399+0000 7f730a800640 1 --2- 172.21.15.112:0/356839460 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f730c15ef10 0x7f730c0a04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.399+0000 7f730a800640 1 -- 172.21.15.112:0/356839460 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f730c0b3ee0 msgr2=0x7f730c09ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:57.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.399+0000 7f730a800640 1 --2- 172.21.15.112:0/356839460 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f730c0b3ee0 0x7f730c09ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.399+0000 7f730a800640 1 -- 172.21.15.112:0/356839460 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730c1e7d30 con 0x7f730c06dc30 2024-09-12T02:48:57.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.399+0000 7f7301e00640 1 --2- 172.21.15.112:0/356839460 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f730c0b3ee0 0x7f730c09ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:57.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.399+0000 7f730a800640 1 --2- 172.21.15.112:0/356839460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f730c06dc30 0x7f730c1ea9c0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0098c0 tx=0x7f72fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:57.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.399+0000 7f7303400640 1 -- 172.21.15.112:0/356839460 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72fc037040 con 0x7f730c06dc30 2024-09-12T02:48:57.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.399+0000 7f7303400640 1 -- 172.21.15.112:0/356839460 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72fc030770 con 0x7f730c06dc30 2024-09-12T02:48:57.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.399+0000 7f7303400640 1 -- 172.21.15.112:0/356839460 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72fc030b40 con 0x7f730c06dc30 2024-09-12T02:48:57.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.399+0000 7f7310a00640 1 -- 172.21.15.112:0/356839460 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f730c161ce0 con 0x7f730c06dc30 2024-09-12T02:48:57.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.400+0000 7f7310a00640 1 -- 172.21.15.112:0/356839460 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f730c14a560 con 0x7f730c06dc30 2024-09-12T02:48:57.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.401+0000 7f7303400640 1 -- 172.21.15.112:0/356839460 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f72fc044020 con 0x7f730c06dc30 2024-09-12T02:48:57.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.403+0000 7f7303400640 1 --2- 172.21.15.112:0/356839460 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f72e806be30 0x7f72e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:57.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.403+0000 7f7303400640 1 -- 172.21.15.112:0/356839460 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 5709+0+0 (secure 0 0 0) 0x7f72fc0ab4b0 con 0x7f730c06dc30 2024-09-12T02:48:57.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.403+0000 7f7301e00640 1 --2- 172.21.15.112:0/356839460 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f72e806be30 0x7f72e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:57.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.404+0000 7f7314296740 1 Processor -- start 2024-09-12T02:48:57.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.404+0000 7f7314296740 1 -- start start 2024-09-12T02:48:57.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.404+0000 7f7301e00640 1 --2- 172.21.15.112:0/356839460 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f72e806be30 0x7f72e806e2f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f730c15e390 tx=0x7f72f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:57.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.404+0000 7f7314296740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56452cc5eea0 0x56452cca4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:57.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.405+0000 7f7314296740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56452cc5c660 0x56452cc5f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:57.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.405+0000 7f7314296740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56452cc60630 0x56452cc59720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:57.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.405+0000 7f7314296740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56452cbbd3b0 con 0x56452cc60630 2024-09-12T02:48:57.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.405+0000 7f7314296740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56452cbc2410 con 0x56452cc5eea0 2024-09-12T02:48:57.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.405+0000 7f7314296740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x56452cb6a620 con 0x56452cc5c660 2024-09-12T02:48:57.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.405+0000 7f730b200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56452cc60630 0x56452cc59720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:57.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.405+0000 7f730b200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56452cc60630 0x56452cc59720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39834/0 (socket says 172.21.15.112:39834) 2024-09-12T02:48:57.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.405+0000 7f730b200640 1 -- 172.21.15.112:0/2528904740 learned_addr learned my addr 172.21.15.112:0/2528904740 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:57.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.405+0000 7f7301e00640 1 --2- 172.21.15.112:0/2528904740 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56452cc5c660 0x56452cc5f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:57.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.405+0000 7f730a800640 1 --2- 172.21.15.112:0/2528904740 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56452cc5eea0 0x56452cca4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:57.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.405+0000 7f730b200640 1 -- 172.21.15.112:0/2528904740 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56452cc5c660 msgr2=0x56452cc5f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:57.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.405+0000 7f730b200640 1 --2- 172.21.15.112:0/2528904740 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56452cc5c660 0x56452cc5f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.405+0000 7f730b200640 1 -- 172.21.15.112:0/2528904740 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56452cc5eea0 msgr2=0x56452cca4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:57.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.405+0000 7f730b200640 1 --2- 172.21.15.112:0/2528904740 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56452cc5eea0 0x56452cca4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.405+0000 7f730b200640 1 -- 172.21.15.112:0/2528904740 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56452c8d52d0 con 0x56452cc60630 2024-09-12T02:48:57.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.406+0000 7f730b200640 1 --2- 172.21.15.112:0/2528904740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56452cc60630 0x56452cc59720 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f7304002050 tx=0x7f730400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda3e330eea53300 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:57.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.406+0000 7f72fb000640 1 -- 172.21.15.112:0/2528904740 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7304019070 con 0x56452cc60630 2024-09-12T02:48:57.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.406+0000 7f72fb000640 1 -- 172.21.15.112:0/2528904740 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f730400ee50 con 0x56452cc60630 2024-09-12T02:48:57.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.406+0000 7f72fb000640 1 -- 172.21.15.112:0/2528904740 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7304014680 con 0x56452cc60630 2024-09-12T02:48:57.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.406+0000 7f7314296740 1 -- 172.21.15.112:0/2528904740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56452cc60630 msgr2=0x56452cc59720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:57.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.406+0000 7f7314296740 1 --2- 172.21.15.112:0/2528904740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56452cc60630 0x56452cc59720 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f7304002050 tx=0x7f730400e530 comp rx=0 tx=0).stop 2024-09-12T02:48:57.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.406+0000 7f7314296740 1 -- 172.21.15.112:0/2528904740 shutdown_connections 2024-09-12T02:48:57.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.406+0000 7f7314296740 1 --2- 172.21.15.112:0/2528904740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56452cc60630 0x56452cc59720 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.406+0000 7f7314296740 1 --2- 172.21.15.112:0/2528904740 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56452cc5c660 0x56452cc5f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.406+0000 7f7314296740 1 --2- 172.21.15.112:0/2528904740 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56452cc5eea0 0x56452cca4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.407+0000 7f7314296740 1 -- 172.21.15.112:0/2528904740 >> 172.21.15.112:0/2528904740 conn(0x56452cc5b8f0 msgr2=0x56452cca3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:57.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.407+0000 7f7314296740 1 -- 172.21.15.112:0/2528904740 shutdown_connections 2024-09-12T02:48:57.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.407+0000 7f7314296740 1 -- 172.21.15.112:0/2528904740 wait complete. 2024-09-12T02:48:57.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.407+0000 7f7314296740 1 -- start start 2024-09-12T02:48:57.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.407+0000 7f7314296740 1 Processor -- start 2024-09-12T02:48:57.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.408+0000 7f7314296740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56452cc5eea0 0x56452cc7fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:57.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.408+0000 7f7314296740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56452cc60630 0x56452cc597f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:57.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.408+0000 7f7314296740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56452cc59d30 0x56452cc88b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:57.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.408+0000 7f7314296740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56452cb7d780 con 0x56452cc59d30 2024-09-12T02:48:57.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.408+0000 7f7314296740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56452cbbe3d0 con 0x56452cc60630 2024-09-12T02:48:57.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.408+0000 7f7314296740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x56452cc5ad90 con 0x56452cc5eea0 2024-09-12T02:48:57.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.408+0000 7f7314296740 10 client.0 _ll_register_callbacks cb 0x56452cbbb5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:57.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.409+0000 7f730b200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56452cc59d30 0x56452cc88b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:57.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.409+0000 7f730b200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56452cc59d30 0x56452cc88b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39844/0 (socket says 172.21.15.112:39844) 2024-09-12T02:48:57.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.409+0000 7f7301e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56452cc60630 0x56452cc597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:57.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.409+0000 7f730b200640 1 -- 172.21.15.112:0/1291562737 learned_addr learned my addr 172.21.15.112:0/1291562737 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:57.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.409+0000 7f730a800640 1 --2- 172.21.15.112:0/1291562737 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56452cc5eea0 0x56452cc7fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:57.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.409+0000 7f730b200640 1 -- 172.21.15.112:0/1291562737 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56452cc5eea0 msgr2=0x56452cc7fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:57.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.409+0000 7f730b200640 1 --2- 172.21.15.112:0/1291562737 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56452cc5eea0 0x56452cc7fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.409+0000 7f730b200640 1 -- 172.21.15.112:0/1291562737 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56452cc60630 msgr2=0x56452cc597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:57.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.409+0000 7f730b200640 1 --2- 172.21.15.112:0/1291562737 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56452cc60630 0x56452cc597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.409+0000 7f730b200640 1 -- 172.21.15.112:0/1291562737 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56452c99f6b0 con 0x56452cc59d30 2024-09-12T02:48:57.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.409+0000 7f7301e00640 1 --2- 172.21.15.112:0/1291562737 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56452cc60630 0x56452cc597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:57.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.409+0000 7f730b200640 1 --2- 172.21.15.112:0/1291562737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56452cc59d30 0x56452cc88b70 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f7304005c00 tx=0x7f7304001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55d0ab86964fe97 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:57.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.409+0000 7f72ef400640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-12T02:48:57.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.410+0000 7f72ef400640 1 -- 172.21.15.112:0/1291562737 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7304024020 con 0x56452cc59d30 2024-09-12T02:48:57.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.410+0000 7f7314296740 1 -- 172.21.15.112:0/1291562737 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f730400ee50 con 0x56452cc59d30 2024-09-12T02:48:57.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.410+0000 7f72ef400640 1 -- 172.21.15.112:0/1291562737 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(150..150 src has 1..150) ==== 5709+0+0 (secure 0 0 0) 0x7f7304014c40 con 0x56452cc59d30 2024-09-12T02:48:57.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.410+0000 7f72ef400640 1 -- 172.21.15.112:0/1291562737 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f730402e050 con 0x56452cc59d30 2024-09-12T02:48:57.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.410+0000 7f7314296740 10 client.7380 fetch_fsmap learned FSMap version 78 2024-09-12T02:48:57.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.410+0000 7f7314296740 1 -- 172.21.15.112:0/1291562737 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) -- 0x56452cc803e0 con 0x56452cc59d30 2024-09-12T02:48:57.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.410+0000 7f72ef400640 1 -- 172.21.15.112:0/1291562737 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f730400ee50 con 0x56452cc59d30 2024-09-12T02:48:57.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.410+0000 7f72ef400640 1 -- 172.21.15.112:0/1291562737 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 78) ==== 3502+0+0 (secure 0 0 0) 0x7f7304031020 con 0x56452cc59d30 2024-09-12T02:48:57.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.410+0000 7f7314296740 10 client.7380 fetch_fsmap finished waiting for FSMap version 78 2024-09-12T02:48:57.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.410+0000 7f7314296740 10 client.7380 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:48:57.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.410+0000 7f7314296740 20 client.7380 populate_metadata read hostname 'smithi112' 2024-09-12T02:48:57.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.410+0000 7f7314296740 1 --2- 172.21.15.112:0/1291562737 >> [v2:172.21.15.137:6833/1000067194,v1:172.21.15.137:6835/1000067194] conn(0x56452cc7cf40 0x56452ccc1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:57.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.410+0000 7f7314296740 4 client.7380 mds_command: new command op to 7257 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:48:57.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.410+0000 7f7314296740 1 -- 172.21.15.112:0/1291562737 --> [v2:172.21.15.137:6833/1000067194,v1:172.21.15.137:6835/1000067194] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56452cbcfb40 con 0x56452cc7cf40 2024-09-12T02:48:57.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.411+0000 7f730a800640 1 --2- 172.21.15.112:0/1291562737 >> [v2:172.21.15.137:6833/1000067194,v1:172.21.15.137:6835/1000067194] conn(0x56452cc7cf40 0x56452ccc1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:57.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.411+0000 7f730a800640 1 --2- 172.21.15.112:0/1291562737 >> [v2:172.21.15.137:6833/1000067194,v1:172.21.15.137:6835/1000067194] conn(0x56452cc7cf40 0x56452ccc1900 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=962570350f3ff3e0 server_cookie=a0fdeafd78a81675 in_seq=0 out_seq=0 2024-09-12T02:48:57.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.411+0000 7f72ef400640 10 client.7380 ms_handle_connect on v2:172.21.15.137:6833/1000067194 2024-09-12T02:48:57.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.412+0000 7f72ef400640 1 -- 172.21.15.112:0/1291562737 <== mds.0 v2:172.21.15.137:6833/1000067194 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56452cbcfb40 con 0x56452cc7cf40 2024-09-12T02:48:57.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.412+0000 7f72ef400640 10 client.7380 handle_command_reply: tid=0 2024-09-12T02:48:57.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.413+0000 7f7314296740 1 client.7380 shutdown 2024-09-12T02:48:57.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.413+0000 7f7314296740 1 -- 172.21.15.112:0/1291562737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56452cc59d30 msgr2=0x56452cc88b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:57.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.413+0000 7f7314296740 1 --2- 172.21.15.112:0/1291562737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56452cc59d30 0x56452cc88b70 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f7304005c00 tx=0x7f7304001250 comp rx=0 tx=0).stop 2024-09-12T02:48:57.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.413+0000 7f7314296740 1 -- 172.21.15.112:0/1291562737 shutdown_connections 2024-09-12T02:48:57.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.413+0000 7f7314296740 1 --2- 172.21.15.112:0/1291562737 >> [v2:172.21.15.137:6833/1000067194,v1:172.21.15.137:6835/1000067194] conn(0x56452cc7cf40 0x56452ccc1900 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.413+0000 7f7314296740 1 --2- 172.21.15.112:0/1291562737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56452cc59d30 0x56452cc88b70 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.413+0000 7f7314296740 1 --2- 172.21.15.112:0/1291562737 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56452cc60630 0x56452cc597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.413+0000 7f72ef400640 0 client.7380 ms_handle_reset on v2:172.21.15.137:6833/1000067194 2024-09-12T02:48:57.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.413+0000 7f7314296740 1 --2- 172.21.15.112:0/1291562737 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56452cc5eea0 0x56452cc7fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.413+0000 7f7314296740 1 -- 172.21.15.112:0/1291562737 >> 172.21.15.112:0/1291562737 conn(0x56452cc5c660 msgr2=0x56452cca30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:57.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.413+0000 7f7314296740 1 -- 172.21.15.112:0/1291562737 shutdown_connections 2024-09-12T02:48:57.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.413+0000 7f7314296740 1 -- 172.21.15.112:0/1291562737 wait complete. 2024-09-12T02:48:57.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.413+0000 7f7314296740 20 client.7380 trim_cache size 0 max 16384 2024-09-12T02:48:57.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.431+0000 7f7314296740 1 Processor -- start 2024-09-12T02:48:57.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.432+0000 7f7314296740 1 -- start start 2024-09-12T02:48:57.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.432+0000 7f7314296740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56452cc5eea0 0x56452cca1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:57.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.432+0000 7f7314296740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56452cc60630 0x56452cca30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:57.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.432+0000 7f7314296740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56452cca22c0 0x56452cca3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:57.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.432+0000 7f7314296740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f730c2002c0 con 0x56452cc5eea0 2024-09-12T02:48:57.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.432+0000 7f7314296740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f730c14cec0 con 0x56452cca22c0 2024-09-12T02:48:57.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.432+0000 7f7314296740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f730c14baf0 con 0x56452cc60630 2024-09-12T02:48:57.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.433+0000 7f730a800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56452cc5eea0 0x56452cca1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:57.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.433+0000 7f730a800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56452cc5eea0 0x56452cca1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39856/0 (socket says 172.21.15.112:39856) 2024-09-12T02:48:57.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.433+0000 7f730a800640 1 -- 172.21.15.112:0/3252950945 learned_addr learned my addr 172.21.15.112:0/3252950945 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:57.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.433+0000 7f730b200640 1 --2- 172.21.15.112:0/3252950945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56452cca22c0 0x56452cca3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:57.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.433+0000 7f7301e00640 1 --2- 172.21.15.112:0/3252950945 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56452cc60630 0x56452cca30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:57.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.433+0000 7f730a800640 1 -- 172.21.15.112:0/3252950945 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56452cc60630 msgr2=0x56452cca30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:57.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.433+0000 7f730a800640 1 --2- 172.21.15.112:0/3252950945 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56452cc60630 0x56452cca30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.433+0000 7f730a800640 1 -- 172.21.15.112:0/3252950945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56452cca22c0 msgr2=0x56452cca3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:57.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.433+0000 7f730a800640 1 --2- 172.21.15.112:0/3252950945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56452cca22c0 0x56452cca3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.433+0000 7f730a800640 1 -- 172.21.15.112:0/3252950945 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56452cca6db0 con 0x56452cc5eea0 2024-09-12T02:48:57.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.433+0000 7f7301e00640 1 --2- 172.21.15.112:0/3252950945 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56452cc60630 0x56452cca30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:57.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.433+0000 7f730b200640 1 --2- 172.21.15.112:0/3252950945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56452cca22c0 0x56452cca3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:57.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.433+0000 7f730a800640 1 --2- 172.21.15.112:0/3252950945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56452cc5eea0 0x56452cca1d80 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f72fc079650 tx=0x7f72fc0a9810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=730cd653d364ae8a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:57.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.435+0000 7f72fa600640 1 -- 172.21.15.112:0/3252950945 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72fc07da70 con 0x56452cc5eea0 2024-09-12T02:48:57.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.435+0000 7f72fa600640 1 -- 172.21.15.112:0/3252950945 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72fc091070 con 0x56452cc5eea0 2024-09-12T02:48:57.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.435+0000 7f72fa600640 1 -- 172.21.15.112:0/3252950945 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72fc0822a0 con 0x56452cc5eea0 2024-09-12T02:48:57.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.436+0000 7f7314296740 1 -- 172.21.15.112:0/3252950945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56452cc5eea0 msgr2=0x56452cca1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:57.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.436+0000 7f7314296740 1 --2- 172.21.15.112:0/3252950945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56452cc5eea0 0x56452cca1d80 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f72fc079650 tx=0x7f72fc0a9810 comp rx=0 tx=0).stop 2024-09-12T02:48:57.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.436+0000 7f7314296740 1 -- 172.21.15.112:0/3252950945 shutdown_connections 2024-09-12T02:48:57.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.436+0000 7f7314296740 1 --2- 172.21.15.112:0/3252950945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56452cca22c0 0x56452cca3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.436+0000 7f7314296740 1 --2- 172.21.15.112:0/3252950945 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56452cc60630 0x56452cca30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.436+0000 7f7314296740 1 --2- 172.21.15.112:0/3252950945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56452cc5eea0 0x56452cca1d80 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.436+0000 7f7314296740 1 -- 172.21.15.112:0/3252950945 >> 172.21.15.112:0/3252950945 conn(0x56452cc5c660 msgr2=0x56452cc881c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:57.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.436+0000 7f7314296740 1 -- 172.21.15.112:0/3252950945 shutdown_connections 2024-09-12T02:48:57.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.436+0000 7f7314296740 1 -- 172.21.15.112:0/3252950945 wait complete. 2024-09-12T02:48:57.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.436+0000 7f7314296740 1 -- start start 2024-09-12T02:48:57.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.437+0000 7f7314296740 1 Processor -- start 2024-09-12T02:48:57.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.437+0000 7f7314296740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56452cc5eea0 0x56452cc589d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:57.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.437+0000 7f7314296740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56452cc60630 0x56452cca3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:57.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.437+0000 7f7314296740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56452cca22c0 0x56452cd16d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:57.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.437+0000 7f7314296740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56452cc7cdc0 con 0x56452cca22c0 2024-09-12T02:48:57.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.437+0000 7f7314296740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56452cc890b0 con 0x56452cc60630 2024-09-12T02:48:57.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.437+0000 7f7314296740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x56452cc7d410 con 0x56452cc5eea0 2024-09-12T02:48:57.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.438+0000 7f7314296740 10 client.0 _ll_register_callbacks cb 0x7f7304017070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:57.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.438+0000 7f730b200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56452cca22c0 0x56452cd16d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:57.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.438+0000 7f730b200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56452cca22c0 0x56452cd16d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39870/0 (socket says 172.21.15.112:39870) 2024-09-12T02:48:57.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.438+0000 7f730b200640 1 -- 172.21.15.112:0/3322764900 learned_addr learned my addr 172.21.15.112:0/3322764900 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:57.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.438+0000 7f730a800640 1 --2- 172.21.15.112:0/3322764900 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56452cc5eea0 0x56452cc589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:57.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.438+0000 7f7301e00640 1 --2- 172.21.15.112:0/3322764900 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56452cc60630 0x56452cca3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:57.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.438+0000 7f730b200640 1 -- 172.21.15.112:0/3322764900 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56452cc5eea0 msgr2=0x56452cc589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:57.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.438+0000 7f730b200640 1 --2- 172.21.15.112:0/3322764900 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56452cc5eea0 0x56452cc589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.438+0000 7f730b200640 1 -- 172.21.15.112:0/3322764900 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56452cc60630 msgr2=0x56452cca3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:57.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.438+0000 7f730b200640 1 --2- 172.21.15.112:0/3322764900 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56452cc60630 0x56452cca3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.438+0000 7f730b200640 1 -- 172.21.15.112:0/3322764900 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56452cca45e0 con 0x56452cca22c0 2024-09-12T02:48:57.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.439+0000 7f730b200640 1 --2- 172.21.15.112:0/3322764900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56452cca22c0 0x56452cd16d60 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x56452cca1780 tx=0x7f7304009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987f65c645ea66d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:57.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.439+0000 7f72ef400640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-12T02:48:57.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.441+0000 7f72ef400640 1 -- 172.21.15.112:0/3322764900 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7304024030 con 0x56452cca22c0 2024-09-12T02:48:57.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.441+0000 7f72ef400640 1 -- 172.21.15.112:0/3322764900 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(150..150 src has 1..150) ==== 5709+0+0 (secure 0 0 0) 0x7f7304020890 con 0x56452cca22c0 2024-09-12T02:48:57.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.441+0000 7f7314296740 1 -- 172.21.15.112:0/3322764900 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72fc091070 con 0x56452cca22c0 2024-09-12T02:48:57.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.441+0000 7f72ef400640 1 -- 172.21.15.112:0/3322764900 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f730403f050 con 0x56452cca22c0 2024-09-12T02:48:57.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.441+0000 7f7314296740 10 client.7386 fetch_fsmap learned FSMap version 78 2024-09-12T02:48:57.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.441+0000 7f7314296740 1 -- 172.21.15.112:0/3322764900 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) -- 0x56452ccb3930 con 0x56452cca22c0 2024-09-12T02:48:57.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.442+0000 7f72ef400640 1 -- 172.21.15.112:0/3322764900 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72fc091070 con 0x56452cca22c0 2024-09-12T02:48:57.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.442+0000 7f72ef400640 1 -- 172.21.15.112:0/3322764900 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 78) ==== 3502+0+0 (secure 0 0 0) 0x7f7304042020 con 0x56452cca22c0 2024-09-12T02:48:57.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.442+0000 7f7314296740 10 client.7386 fetch_fsmap finished waiting for FSMap version 78 2024-09-12T02:48:57.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.442+0000 7f7314296740 10 client.7386 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:48:57.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.442+0000 7f7314296740 20 client.7386 populate_metadata read hostname 'smithi112' 2024-09-12T02:48:57.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.442+0000 7f7314296740 1 --2- 172.21.15.112:0/3322764900 >> [v2:172.21.15.137:6833/1000067194,v1:172.21.15.137:6835/1000067194] conn(0x56452cd22550 0x56452cd22930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:57.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.442+0000 7f7314296740 4 client.7386 mds_command: new command op to 7257 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:48:57.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.442+0000 7f7314296740 1 -- 172.21.15.112:0/3322764900 --> [v2:172.21.15.137:6833/1000067194,v1:172.21.15.137:6835/1000067194] -- command(tid 0: {"prefix": "status"}) -- 0x56452cca6af0 con 0x56452cd22550 2024-09-12T02:48:57.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.442+0000 7f730a800640 1 --2- 172.21.15.112:0/3322764900 >> [v2:172.21.15.137:6833/1000067194,v1:172.21.15.137:6835/1000067194] conn(0x56452cd22550 0x56452cd22930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:57.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.443+0000 7f72ef400640 10 client.7386 ms_handle_connect on v2:172.21.15.137:6833/1000067194 2024-09-12T02:48:57.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.443+0000 7f730a800640 1 --2- 172.21.15.112:0/3322764900 >> [v2:172.21.15.137:6833/1000067194,v1:172.21.15.137:6835/1000067194] conn(0x56452cd22550 0x56452cd22930 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65c514b3c4918705 server_cookie=e87d547fd67b6bf7 in_seq=0 out_seq=0 2024-09-12T02:48:57.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.443+0000 7f72ef400640 1 -- 172.21.15.112:0/3322764900 <== mds.0 v2:172.21.15.137:6833/1000067194 1 ==== command_reply(tid 0: 0 ) ==== 8+0+320 (crc 0 0 0) 0x56452cca6af0 con 0x56452cd22550 2024-09-12T02:48:57.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.443+0000 7f72ef400640 10 client.7386 handle_command_reply: tid=0 2024-09-12T02:48:57.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.443+0000 7f7314296740 1 client.7386 shutdown 2024-09-12T02:48:57.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.443+0000 7f7314296740 1 -- 172.21.15.112:0/3322764900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56452cca22c0 msgr2=0x56452cd16d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:57.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.443+0000 7f7314296740 1 --2- 172.21.15.112:0/3322764900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56452cca22c0 0x56452cd16d60 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x56452cca1780 tx=0x7f7304009040 comp rx=0 tx=0).stop 2024-09-12T02:48:57.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.443+0000 7f7314296740 1 -- 172.21.15.112:0/3322764900 shutdown_connections 2024-09-12T02:48:57.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.443+0000 7f7314296740 1 --2- 172.21.15.112:0/3322764900 >> [v2:172.21.15.137:6833/1000067194,v1:172.21.15.137:6835/1000067194] conn(0x56452cd22550 0x56452cd22930 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.443+0000 7f7314296740 1 --2- 172.21.15.112:0/3322764900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56452cca22c0 0x56452cd16d60 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.443+0000 7f7314296740 1 --2- 172.21.15.112:0/3322764900 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56452cc60630 0x56452cca3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.443+0000 7f7314296740 1 --2- 172.21.15.112:0/3322764900 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56452cc5eea0 0x56452cc589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.443+0000 7f72ef400640 0 client.7386 ms_handle_reset on v2:172.21.15.137:6833/1000067194 2024-09-12T02:48:57.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.443+0000 7f7314296740 1 -- 172.21.15.112:0/3322764900 >> 172.21.15.112:0/3322764900 conn(0x56452cc5c660 msgr2=0x56452cc82840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:57.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.444+0000 7f7314296740 1 -- 172.21.15.112:0/3322764900 shutdown_connections 2024-09-12T02:48:57.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.444+0000 7f7314296740 1 -- 172.21.15.112:0/3322764900 wait complete. 2024-09-12T02:48:57.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.444+0000 7f7314296740 20 client.7386 trim_cache size 0 max 16384 2024-09-12T02:48:57.448 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:48:57.448 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:48:57.448 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2024-09-12T02:48:57.448 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 7257, 2024-09-12T02:48:57.448 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2024-09-12T02:48:57.448 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2024-09-12T02:48:57.448 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2024-09-12T02:48:57.448 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 6.037480886, 2024-09-12T02:48:57.448 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 78, 2024-09-12T02:48:57.449 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 150, 2024-09-12T02:48:57.449 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 150, 2024-09-12T02:48:57.449 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 11.681383535 2024-09-12T02:48:57.449 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:48:57.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.444+0000 7f7310a00640 1 -- 172.21.15.112:0/356839460 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f72e806be30 msgr2=0x7f72e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:57.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.444+0000 7f7310a00640 1 --2- 172.21.15.112:0/356839460 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f72e806be30 0x7f72e806e2f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f730c15e390 tx=0x7f72f4009040 comp rx=0 tx=0).stop 2024-09-12T02:48:57.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.444+0000 7f7310a00640 1 -- 172.21.15.112:0/356839460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f730c06dc30 msgr2=0x7f730c1ea9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:57.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.444+0000 7f7310a00640 1 --2- 172.21.15.112:0/356839460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f730c06dc30 0x7f730c1ea9c0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0098c0 tx=0x7f72fc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.444+0000 7f7310a00640 1 -- 172.21.15.112:0/356839460 shutdown_connections 2024-09-12T02:48:57.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.444+0000 7f7310a00640 1 --2- 172.21.15.112:0/356839460 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f730c15ef10 0x7f730c0a04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.444+0000 7f7310a00640 1 --2- 172.21.15.112:0/356839460 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f72e806be30 0x7f72e806e2f0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.444+0000 7f7310a00640 1 --2- 172.21.15.112:0/356839460 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f730c0b3ee0 0x7f730c09ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.444+0000 7f7310a00640 1 --2- 172.21.15.112:0/356839460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f730c06dc30 0x7f730c1ea9c0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.444+0000 7f7310a00640 1 -- 172.21.15.112:0/356839460 >> 172.21.15.112:0/356839460 conn(0x7f730c0b7ea0 msgr2=0x7f730c0cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:57.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.445+0000 7f7310a00640 1 -- 172.21.15.112:0/356839460 shutdown_connections 2024-09-12T02:48:57.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.445+0000 7f7310a00640 1 -- 172.21.15.112:0/356839460 wait complete. 2024-09-12T02:48:57.461 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:48:57.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.612+0000 7f4222800640 1 Processor -- start 2024-09-12T02:48:57.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.612+0000 7f4222800640 1 -- start start 2024-09-12T02:48:57.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.613+0000 7f4222800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f421c0d28d0 0x7f421c0b2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:57.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.613+0000 7f4222800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f421c0d2fb0 con 0x7f421c0b3e00 2024-09-12T02:48:57.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.613+0000 7f4222800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f421c0d0b60 con 0x7f421c0d1710 2024-09-12T02:48:57.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.613+0000 7f4222800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f421c0d3cb0 con 0x7f421c0d28d0 2024-09-12T02:48:57.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.613+0000 7f4220a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f421c0b3e00 0x7f421c0b1d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33668/0 (socket says 172.21.15.112:33668) 2024-09-12T02:48:57.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.613+0000 7f4220a00640 1 -- 172.21.15.112:0/3898815411 learned_addr learned my addr 172.21.15.112:0/3898815411 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:48:57.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.614+0000 7f4221e00640 1 --2- 172.21.15.112:0/3898815411 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f421c0d28d0 0x7f421c0b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:57.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.614+0000 7f421be00640 1 -- 172.21.15.112:0/3898815411 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1307381035 0 0) 0x7f421c0d2fb0 con 0x7f421c0b3e00 2024-09-12T02:48:57.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.614+0000 7f421be00640 1 -- 172.21.15.112:0/3898815411 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4204003520 con 0x7f421c0b3e00 2024-09-12T02:48:57.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.614+0000 7f421be00640 1 -- 172.21.15.112:0/3898815411 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1217293528 0 0) 0x7f421c0d0b60 con 0x7f421c0d1710 2024-09-12T02:48:57.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.614+0000 7f421be00640 1 -- 172.21.15.112:0/3898815411 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f421c0d2fb0 con 0x7f421c0d1710 2024-09-12T02:48:57.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.614+0000 7f4221e00640 1 -- 172.21.15.112:0/3898815411 >> v1:172.21.15.137:6789/0 conn(0x7f421c0d1710 legacy=0x7f421c0d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:57.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.614+0000 7f4221e00640 1 -- 172.21.15.112:0/3898815411 >> v1:172.21.15.112:6789/0 conn(0x7f421c0b3e00 legacy=0x7f421c0b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:57.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.614+0000 7f4221e00640 1 -- 172.21.15.112:0/3898815411 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f421c0d3410 con 0x7f421c0d28d0 2024-09-12T02:48:57.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.615+0000 7f4221e00640 1 --2- 172.21.15.112:0/3898815411 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f421c0d28d0 0x7f421c0b2480 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4214009dc0 tx=0x7f421402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59e89255001d2e64 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:57.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.616+0000 7f421be00640 1 -- 172.21.15.112:0/3898815411 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4214007740 con 0x7f421c0d28d0 2024-09-12T02:48:57.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.616+0000 7f421be00640 1 -- 172.21.15.112:0/3898815411 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42140078e0 con 0x7f421c0d28d0 2024-09-12T02:48:57.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.616+0000 7f421be00640 1 -- 172.21.15.112:0/3898815411 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4214007cb0 con 0x7f421c0d28d0 2024-09-12T02:48:57.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.616+0000 7f4222800640 1 -- 172.21.15.112:0/3898815411 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f421c0d28d0 msgr2=0x7f421c0b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:57.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.616+0000 7f4222800640 1 --2- 172.21.15.112:0/3898815411 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f421c0d28d0 0x7f421c0b2480 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4214009dc0 tx=0x7f421402a6d0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.616+0000 7f4222800640 1 -- 172.21.15.112:0/3898815411 shutdown_connections 2024-09-12T02:48:57.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.616+0000 7f4222800640 1 --2- 172.21.15.112:0/3898815411 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f421c0d28d0 0x7f421c0b2480 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.616+0000 7f4222800640 1 -- 172.21.15.112:0/3898815411 >> 172.21.15.112:0/3898815411 conn(0x7f421c09e030 msgr2=0x7f421c0d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:57.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.616+0000 7f4222800640 1 -- 172.21.15.112:0/3898815411 shutdown_connections 2024-09-12T02:48:57.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.616+0000 7f4222800640 1 -- 172.21.15.112:0/3898815411 wait complete. 2024-09-12T02:48:57.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.618+0000 7f4222800640 1 Processor -- start 2024-09-12T02:48:57.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.618+0000 7f4222800640 1 -- start start 2024-09-12T02:48:57.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.619+0000 7f4222800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f421c0b3e00 0x7f421c0cce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:57.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.619+0000 7f4222800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f421c0d1710 0x7f421c0c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:57.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.619+0000 7f4222800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f421c0d28d0 0x7f421c0c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:57.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.619+0000 7f4222800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f421c0d39d0 con 0x7f421c0b3e00 2024-09-12T02:48:57.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.619+0000 7f4222800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f421c0d2d60 con 0x7f421c0d1710 2024-09-12T02:48:57.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.619+0000 7f4222800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f421c15f110 con 0x7f421c0d28d0 2024-09-12T02:48:57.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.619+0000 7f4221400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f421c0b3e00 0x7f421c0cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:57.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.619+0000 7f4221400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f421c0b3e00 0x7f421c0cce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39886/0 (socket says 172.21.15.112:39886) 2024-09-12T02:48:57.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.619+0000 7f4221400640 1 -- 172.21.15.112:0/621097066 learned_addr learned my addr 172.21.15.112:0/621097066 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:57.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.619+0000 7f4221e00640 1 --2- 172.21.15.112:0/621097066 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f421c0d28d0 0x7f421c0c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:57.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.619+0000 7f4220a00640 1 --2- 172.21.15.112:0/621097066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f421c0d1710 0x7f421c0c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:57.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.620+0000 7f4221400640 1 -- 172.21.15.112:0/621097066 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f421c0d28d0 msgr2=0x7f421c0c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:57.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.620+0000 7f4221400640 1 --2- 172.21.15.112:0/621097066 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f421c0d28d0 0x7f421c0c8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.620+0000 7f4221400640 1 -- 172.21.15.112:0/621097066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f421c0d1710 msgr2=0x7f421c0c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:57.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.620+0000 7f4221400640 1 --2- 172.21.15.112:0/621097066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f421c0d1710 0x7f421c0c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.620+0000 7f4221400640 1 -- 172.21.15.112:0/621097066 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f421c0cd8e0 con 0x7f421c0b3e00 2024-09-12T02:48:57.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.620+0000 7f4221e00640 1 --2- 172.21.15.112:0/621097066 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f421c0d28d0 0x7f421c0c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:57.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.620+0000 7f4221400640 1 --2- 172.21.15.112:0/621097066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f421c0b3e00 0x7f421c0cce20 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f421000c500 tx=0x7f421000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:57.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.620+0000 7f4219600640 1 -- 172.21.15.112:0/621097066 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42100052d0 con 0x7f421c0b3e00 2024-09-12T02:48:57.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.620+0000 7f4219600640 1 -- 172.21.15.112:0/621097066 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4210005490 con 0x7f421c0b3e00 2024-09-12T02:48:57.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.620+0000 7f4219600640 1 -- 172.21.15.112:0/621097066 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4210012870 con 0x7f421c0b3e00 2024-09-12T02:48:57.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.620+0000 7f4222800640 1 -- 172.21.15.112:0/621097066 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f421c0cdbc0 con 0x7f421c0b3e00 2024-09-12T02:48:57.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.620+0000 7f4222800640 1 -- 172.21.15.112:0/621097066 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f421c0ce180 con 0x7f421c0b3e00 2024-09-12T02:48:57.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.621+0000 7f4222800640 1 -- 172.21.15.112:0/621097066 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f421c0d1af0 con 0x7f421c0b3e00 2024-09-12T02:48:57.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.622+0000 7f4219600640 1 -- 172.21.15.112:0/621097066 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4210012a10 con 0x7f421c0b3e00 2024-09-12T02:48:57.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.623+0000 7f4219600640 1 --2- 172.21.15.112:0/621097066 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f41fc06be30 0x7f41fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:57.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.623+0000 7f4219600640 1 -- 172.21.15.112:0/621097066 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 5709+0+0 (secure 0 0 0) 0x7f421008ac40 con 0x7f421c0b3e00 2024-09-12T02:48:57.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.623+0000 7f4220a00640 1 --2- 172.21.15.112:0/621097066 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f41fc06be30 0x7f41fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:57.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.624+0000 7f4220a00640 1 --2- 172.21.15.112:0/621097066 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f41fc06be30 0x7f41fc06e2f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f421c0bad50 tx=0x7f4208009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:57.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.627+0000 7f4219600640 1 -- 172.21.15.112:0/621097066 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4210059560 con 0x7f421c0b3e00 2024-09-12T02:48:57.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.834+0000 7f4222800640 1 -- 172.21.15.112:0/621097066 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f421c0baaa0 con 0x7f421c0b3e00 2024-09-12T02:48:57.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.834+0000 7f4219600640 1 -- 172.21.15.112:0/621097066 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v78) ==== 53+0+73 (secure 0 0 0) 0x7f4210058e60 con 0x7f421c0b3e00 2024-09-12T02:48:57.835 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:48:57.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.836+0000 7f4222800640 1 -- 172.21.15.112:0/621097066 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f41fc06be30 msgr2=0x7f41fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:57.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.836+0000 7f4222800640 1 --2- 172.21.15.112:0/621097066 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f41fc06be30 0x7f41fc06e2f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f421c0bad50 tx=0x7f4208009040 comp rx=0 tx=0).stop 2024-09-12T02:48:57.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.836+0000 7f4222800640 1 -- 172.21.15.112:0/621097066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f421c0b3e00 msgr2=0x7f421c0cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:57.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.836+0000 7f4222800640 1 --2- 172.21.15.112:0/621097066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f421c0b3e00 0x7f421c0cce20 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f421000c500 tx=0x7f421000c9c0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.836+0000 7f4222800640 1 -- 172.21.15.112:0/621097066 shutdown_connections 2024-09-12T02:48:57.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.836+0000 7f4222800640 1 --2- 172.21.15.112:0/621097066 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f421c0d28d0 0x7f421c0c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.836+0000 7f4222800640 1 --2- 172.21.15.112:0/621097066 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f41fc06be30 0x7f41fc06e2f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.836+0000 7f4222800640 1 --2- 172.21.15.112:0/621097066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f421c0d1710 0x7f421c0c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.836+0000 7f4222800640 1 --2- 172.21.15.112:0/621097066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f421c0b3e00 0x7f421c0cce20 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:57.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.836+0000 7f4222800640 1 -- 172.21.15.112:0/621097066 >> 172.21.15.112:0/621097066 conn(0x7f421c09e030 msgr2=0x7f421c0b8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:57.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.837+0000 7f4222800640 1 -- 172.21.15.112:0/621097066 shutdown_connections 2024-09-12T02:48:57.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:57.837+0000 7f4222800640 1 -- 172.21.15.112:0/621097066 wait complete. 2024-09-12T02:48:57.853 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:48:57.853 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:48:57.853 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-09-12T02:48:57.853 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:48:57.853 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:48:57.853 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:48:57.853 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:48:57.853 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:48:57.853 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:48:57.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:57.854 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-09-12T02:48:57.889 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:48:57.892 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:48:57.892 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:48:57.892 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:57.892 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-12T02:48:57.892 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:57.892 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:48:57.892 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-09-12T02:48:57.892 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-09-12T02:48:57.892 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:48:57.892 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-09-12T02:48:57.893 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-09-12T02:48:57.893 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:48:57.893 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:48:57.893 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:48:57.893 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:48:57.893 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:48:57.893 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42341sec preferred_lft 42341sec 2024-09-12T02:48:57.893 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link noprefixroute 2024-09-12T02:48:57.893 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:57.893 INFO:teuthology.orchestra.run.smithi112.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:48:57.893 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 4e:56:d4:fc:33:ba brd ff:ff:ff:ff:ff:ff 2024-09-12T02:48:57.893 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:48:57.893 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:57.894 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::787f:67ff:fe10:c915/64 scope link 2024-09-12T02:48:57.894 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:57.894 INFO:teuthology.orchestra.run.smithi112.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:48:57.894 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 4e:56:d4:fc:33:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:48:57.894 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::4c56:d4ff:fefc:33ba/64 scope link 2024-09-12T02:48:57.894 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:57.894 INFO:teuthology.orchestra.run.smithi112.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:48:57.894 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 86:ed:0e:b6:37:5f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:48:57.894 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::84ed:eff:feb6:375f/64 scope link 2024-09-12T02:48:57.894 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:57.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:57.895 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:48:57.982 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-12T02:48:57.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:57.985 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-09-12T02:48:58.021 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-09-12T02:48:58.021 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:48:58.021 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:48:58.021 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:48:58.021 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:48:58.022 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:48:58.022 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-12T02:48:58.022 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:48:58.022 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:48:58.022 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:48:58.022 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-12T02:48:58.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:48:58.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:48:58.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:58.217 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-12T02:48:58.252 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:48:58.252 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:48:58.253 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:48:58.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:58.253 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2024-09-12T02:48:58.348 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:48:58.348 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:48:58.383 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:48:58.383 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:48:58.383 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:48:58.458 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T02:48:58.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:58.459 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:48:58.587 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:48:58.587 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:48:58.613 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:48:58.614 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:48:58.614 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-09-12T02:48:58.614 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 0@7c01f3b3-dec2-4449-a33f-f960d7527ea6.cephfs=/ 2024-09-12T02:48:58.614 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.112:3300/172.21.15.137:3300/172.21.15.137:3301" will pass to kernel 2024-09-12T02:48:58.615 INFO:teuthology.orchestra.run.smithi112.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:48:58.615 INFO:teuthology.orchestra.run.smithi112.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:48:58.615 INFO:teuthology.orchestra.run.smithi112.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:48:58.615 INFO:teuthology.orchestra.run.smithi112.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:48:58.615 INFO:teuthology.orchestra.run.smithi112.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:48:58.618 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:48:58.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:58.619 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:48:58.675 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:48:58.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:48:58.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:48:58.775 INFO:teuthology.orchestra.run.smithi112.stdout:client6155 2024-09-12T02:48:58.775 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:48:58.776 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:48:58.811 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:48:59.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.002+0000 7fe25d000640 1 Processor -- start 2024-09-12T02:48:59.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.003+0000 7fe25d000640 1 -- start start 2024-09-12T02:48:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.004+0000 7fe25d000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe25806f600 0x7fe2580b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.004+0000 7fe25d000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe2580b45d0 0x7fe2580728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.004+0000 7fe25d000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2580b4a20 con 0x7fe25815b9d0 2024-09-12T02:48:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.004+0000 7fe25d000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe2580b54a0 con 0x7fe2580b45d0 2024-09-12T02:48:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.004+0000 7fe25d000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe2580b3af0 con 0x7fe25806f600 2024-09-12T02:48:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.004+0000 7fe256800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe2580b45d0 0x7fe2580728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.004+0000 7fe256800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe2580b45d0 0x7fe2580728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39888/0 (socket says 172.21.15.112:39888) 2024-09-12T02:48:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.004+0000 7fe256800640 1 -- 172.21.15.112:0/4024253406 learned_addr learned my addr 172.21.15.112:0/4024253406 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.004+0000 7fe24d400640 1 --2- 172.21.15.112:0/4024253406 >> v2:172.21.15.137:3300/0 conn(0x7fe25806f600 0x7fe2580b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:59.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.004+0000 7fe256800640 1 -- 172.21.15.112:0/4024253406 >> v2:172.21.15.137:3300/0 conn(0x7fe25806f600 msgr2=0x7fe2580b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:59.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.004+0000 7fe256800640 1 --2- 172.21.15.112:0/4024253406 >> v2:172.21.15.137:3300/0 conn(0x7fe25806f600 0x7fe2580b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:59.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.004+0000 7fe256800640 1 -- 172.21.15.112:0/4024253406 >> v1:172.21.15.137:6789/0 conn(0x7fe25815b9d0 legacy=0x7fe25806eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:59.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.004+0000 7fe256800640 1 -- 172.21.15.112:0/4024253406 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2580b3dd0 con 0x7fe2580b45d0 2024-09-12T02:48:59.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.005+0000 7fe256800640 1 --2- 172.21.15.112:0/4024253406 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2580b45d0 0x7fe2580728c0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fe258071200 tx=0x7fe25002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5305be11f017915 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:59.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.006+0000 7fe255400640 1 -- 172.21.15.112:0/4024253406 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe250036070 con 0x7fe2580b45d0 2024-09-12T02:48:59.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.006+0000 7fe255400640 1 -- 172.21.15.112:0/4024253406 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe250031600 con 0x7fe2580b45d0 2024-09-12T02:48:59.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.006+0000 7fe255400640 1 -- 172.21.15.112:0/4024253406 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2500319d0 con 0x7fe2580b45d0 2024-09-12T02:48:59.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.006+0000 7fe25d000640 1 -- 172.21.15.112:0/4024253406 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2580b45d0 msgr2=0x7fe2580728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:59.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.006+0000 7fe25d000640 1 --2- 172.21.15.112:0/4024253406 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2580b45d0 0x7fe2580728c0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fe258071200 tx=0x7fe25002a6a0 comp rx=0 tx=0).stop 2024-09-12T02:48:59.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.006+0000 7fe25d000640 1 -- 172.21.15.112:0/4024253406 shutdown_connections 2024-09-12T02:48:59.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.006+0000 7fe25d000640 1 --2- 172.21.15.112:0/4024253406 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2580b45d0 0x7fe2580728c0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:59.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.006+0000 7fe25d000640 1 --2- 172.21.15.112:0/4024253406 >> v2:172.21.15.137:3300/0 conn(0x7fe25806f600 0x7fe2580b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:59.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.006+0000 7fe25d000640 1 -- 172.21.15.112:0/4024253406 >> 172.21.15.112:0/4024253406 conn(0x7fe25806bbd0 msgr2=0x7fe25806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:59.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.006+0000 7fe25d000640 1 -- 172.21.15.112:0/4024253406 shutdown_connections 2024-09-12T02:48:59.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.006+0000 7fe25d000640 1 -- 172.21.15.112:0/4024253406 wait complete. 2024-09-12T02:48:59.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.008+0000 7fe25d000640 1 Processor -- start 2024-09-12T02:48:59.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.008+0000 7fe25d000640 1 -- start start 2024-09-12T02:48:59.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.009+0000 7fe25d000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe25806f600 0x7fe2581473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:59.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.009+0000 7fe25d000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe2580b45d0 0x7fe258153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:59.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.009+0000 7fe25d000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe25815b9d0 0x7fe2580cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:59.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.009+0000 7fe25d000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe25815bf30 con 0x7fe25815b9d0 2024-09-12T02:48:59.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.009+0000 7fe25d000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe25815bdb0 con 0x7fe25806f600 2024-09-12T02:48:59.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.009+0000 7fe25d000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe2580cdcd0 con 0x7fe2580b45d0 2024-09-12T02:48:59.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.009+0000 7fe256800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe25815b9d0 0x7fe2580cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:59.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.009+0000 7fe256800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe25815b9d0 0x7fe2580cecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39898/0 (socket says 172.21.15.112:39898) 2024-09-12T02:48:59.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.009+0000 7fe256800640 1 -- 172.21.15.112:0/886199020 learned_addr learned my addr 172.21.15.112:0/886199020 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:48:59.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.010+0000 7fe24d400640 1 --2- 172.21.15.112:0/886199020 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe2580b45d0 0x7fe258153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:59.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.010+0000 7fe255e00640 1 --2- 172.21.15.112:0/886199020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe25806f600 0x7fe2581473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:59.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.010+0000 7fe256800640 1 -- 172.21.15.112:0/886199020 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe2580b45d0 msgr2=0x7fe258153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:59.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.010+0000 7fe256800640 1 --2- 172.21.15.112:0/886199020 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe2580b45d0 0x7fe258153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:59.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.010+0000 7fe256800640 1 -- 172.21.15.112:0/886199020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe25806f600 msgr2=0x7fe2581473b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:59.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.010+0000 7fe256800640 1 --2- 172.21.15.112:0/886199020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe25806f600 0x7fe2581473b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:59.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.010+0000 7fe256800640 1 -- 172.21.15.112:0/886199020 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe258153b70 con 0x7fe25815b9d0 2024-09-12T02:48:59.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.010+0000 7fe256800640 1 --2- 172.21.15.112:0/886199020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe25815b9d0 0x7fe2580cecf0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fe25002ac90 tx=0x7fe250004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:59.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.010+0000 7fe24ea00640 1 -- 172.21.15.112:0/886199020 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25003f020 con 0x7fe25815b9d0 2024-09-12T02:48:59.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.010+0000 7fe24ea00640 1 -- 172.21.15.112:0/886199020 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe250037040 con 0x7fe25815b9d0 2024-09-12T02:48:59.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.010+0000 7fe24ea00640 1 -- 172.21.15.112:0/886199020 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe250036070 con 0x7fe25815b9d0 2024-09-12T02:48:59.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.010+0000 7fe25d000640 1 -- 172.21.15.112:0/886199020 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe25815db00 con 0x7fe25815b9d0 2024-09-12T02:48:59.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.010+0000 7fe25d000640 1 -- 172.21.15.112:0/886199020 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe25815e0c0 con 0x7fe25815b9d0 2024-09-12T02:48:59.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.011+0000 7fe25d000640 1 -- 172.21.15.112:0/886199020 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe258068a30 con 0x7fe25815b9d0 2024-09-12T02:48:59.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.012+0000 7fe24ea00640 1 -- 172.21.15.112:0/886199020 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe250042020 con 0x7fe25815b9d0 2024-09-12T02:48:59.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.013+0000 7fe24ea00640 1 --2- 172.21.15.112:0/886199020 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe23406be60 0x7fe23406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:59.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.013+0000 7fe24ea00640 1 -- 172.21.15.112:0/886199020 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 5709+0+0 (secure 0 0 0) 0x7fe2500ab670 con 0x7fe25815b9d0 2024-09-12T02:48:59.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.014+0000 7fe255e00640 1 --2- 172.21.15.112:0/886199020 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe23406be60 0x7fe23406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:59.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.014+0000 7fe255e00640 1 --2- 172.21.15.112:0/886199020 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe23406be60 0x7fe23406e320 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe248000f60 tx=0x7fe248009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:59.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.018+0000 7fe24ea00640 1 -- 172.21.15.112:0/886199020 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe250049020 con 0x7fe25815b9d0 2024-09-12T02:48:59.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.224+0000 7fe25d000640 1 -- 172.21.15.112:0/886199020 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe2580ce4f0 con 0x7fe25815b9d0 2024-09-12T02:48:59.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.224+0000 7fe24ea00640 1 -- 172.21.15.112:0/886199020 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v78) ==== 53+0+73 (secure 0 0 0) 0x7fe250079f80 con 0x7fe25815b9d0 2024-09-12T02:48:59.226 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:48:59.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.226+0000 7fe25d000640 1 -- 172.21.15.112:0/886199020 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe23406be60 msgr2=0x7fe23406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:59.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.226+0000 7fe25d000640 1 --2- 172.21.15.112:0/886199020 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe23406be60 0x7fe23406e320 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe248000f60 tx=0x7fe248009040 comp rx=0 tx=0).stop 2024-09-12T02:48:59.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.227+0000 7fe25d000640 1 -- 172.21.15.112:0/886199020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe25815b9d0 msgr2=0x7fe2580cecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:59.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.227+0000 7fe25d000640 1 --2- 172.21.15.112:0/886199020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe25815b9d0 0x7fe2580cecf0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fe25002ac90 tx=0x7fe250004a40 comp rx=0 tx=0).stop 2024-09-12T02:48:59.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.227+0000 7fe25d000640 1 -- 172.21.15.112:0/886199020 shutdown_connections 2024-09-12T02:48:59.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.227+0000 7fe25d000640 1 --2- 172.21.15.112:0/886199020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe25815b9d0 0x7fe2580cecf0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:59.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.227+0000 7fe25d000640 1 --2- 172.21.15.112:0/886199020 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe2580b45d0 0x7fe258153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:59.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.227+0000 7fe25d000640 1 --2- 172.21.15.112:0/886199020 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe23406be60 0x7fe23406e320 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:59.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.227+0000 7fe25d000640 1 --2- 172.21.15.112:0/886199020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe25806f600 0x7fe2581473b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:59.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.227+0000 7fe25d000640 1 -- 172.21.15.112:0/886199020 >> 172.21.15.112:0/886199020 conn(0x7fe25806bbd0 msgr2=0x7fe2580ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:59.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.227+0000 7fe25d000640 1 -- 172.21.15.112:0/886199020 shutdown_connections 2024-09-12T02:48:59.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:48:59.227+0000 7fe25d000640 1 -- 172.21.15.112:0/886199020 wait complete. 2024-09-12T02:48:59.244 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:48:59.244 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:48:59.244 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-09-12T02:48:59.244 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T02:48:59.244 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T02:48:59.245 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:48:59.245 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:48:59.245 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:48:59.245 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:48:59.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:59.246 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-09-12T02:48:59.287 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:48:59.287 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:48:59.287 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:48:59.287 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:59.287 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-09-12T02:48:59.287 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:59.287 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:48:59.287 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-09-12T02:48:59.288 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-09-12T02:48:59.288 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:48:59.288 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-09-12T02:48:59.288 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-09-12T02:48:59.288 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:48:59.288 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:48:59.288 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:48:59.288 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:48:59.288 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:48:59.288 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42339sec preferred_lft 42339sec 2024-09-12T02:48:59.288 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::ec4:7aff:fe88:8137/64 scope link noprefixroute 2024-09-12T02:48:59.288 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:59.288 INFO:teuthology.orchestra.run.smithi137.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:48:59.289 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 62:9a:8e:f1:56:55 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:48:59.289 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:48:59.289 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:59.289 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::30c8:13ff:fe15:f79d/64 scope link 2024-09-12T02:48:59.289 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:59.289 INFO:teuthology.orchestra.run.smithi137.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:48:59.289 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 62:9a:8e:f1:56:55 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:48:59.289 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::609a:8eff:fef1:5655/64 scope link 2024-09-12T02:48:59.289 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:59.289 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:48:59.289 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 96:f4:ca:17:88:2a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T02:48:59.289 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::94f4:caff:fe17:882a/64 scope link 2024-09-12T02:48:59.289 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:59.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:59.290 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:48:59.386 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-09-12T02:48:59.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:59.389 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-09-12T02:48:59.429 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-09-12T02:48:59.429 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:48:59.429 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:48:59.429 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:48:59.429 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:48:59.430 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:48:59.430 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-09-12T02:48:59.430 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:48:59.430 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:48:59.430 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:48:59.430 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-09-12T02:48:59.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:48:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:48:59.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:48:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:48:59.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:59.627 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-09-12T02:48:59.663 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T02:48:59.664 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T02:48:59.664 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:48:59.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:59.664 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-09-12T02:48:59.760 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:48:59.760 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T02:48:59.796 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:48:59.796 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:48:59.796 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T02:48:59.871 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-12T02:48:59.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:59.871 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:49:00.000 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:49:00.000 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:49:00.026 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:49:00.026 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:49:00.026 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-09-12T02:49:00.027 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with new device syntax: 1@7c01f3b3-dec2-4449-a33f-f960d7527ea6.cephfs=/ 2024-09-12T02:49:00.027 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.112:3300/172.21.15.137:3300/172.21.15.137:3301" will pass to kernel 2024-09-12T02:49:00.028 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-12T02:49:00.028 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:49:00.028 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:49:00.028 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:49:00.028 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:49:00.031 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:49:00.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:49:00.032 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T02:49:00.087 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:49:00.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:49:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:49:00.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:49:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:49:00.176 INFO:teuthology.orchestra.run.smithi137.stdout:client7401 2024-09-12T02:49:00.177 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:49:00.177 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:49:00.212 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:49:00.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.372+0000 7f9f13600640 1 Processor -- start 2024-09-12T02:49:00.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.373+0000 7f9f13600640 1 -- start start 2024-09-12T02:49:00.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.374+0000 7f9f13600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9f0c06d8c0 0x7f9f0c0afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:00.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.374+0000 7f9f13600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f0c0ae8d0 0x7f9f0c0715a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:00.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.374+0000 7f9f13600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9f0c06dca0 0x7f9f0c06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:00.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.374+0000 7f9f13600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f9f0c0aedd0 con 0x7f9f0c06dca0 2024-09-12T02:49:00.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.374+0000 7f9f13600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f9f0c0af0b0 con 0x7f9f0c06d8c0 2024-09-12T02:49:00.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.374+0000 7f9f13600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9f0c0af390 con 0x7f9f0c0ae8d0 2024-09-12T02:49:00.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.374+0000 7f9f11600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9f0c06dca0 0x7f9f0c06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:00.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.374+0000 7f9f11600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9f0c06dca0 0x7f9f0c06e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39900/0 (socket says 172.21.15.112:39900) 2024-09-12T02:49:00.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.374+0000 7f9f11600640 1 -- 172.21.15.112:0/703719555 learned_addr learned my addr 172.21.15.112:0/703719555 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:49:00.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.374+0000 7f9f10c00640 1 --2- 172.21.15.112:0/703719555 >> v2:172.21.15.137:3300/0 conn(0x7f9f0c06d8c0 0x7f9f0c0afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:00.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.374+0000 7f9f03e00640 1 --2- 172.21.15.112:0/703719555 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f0c0ae8d0 0x7f9f0c0715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:00.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.374+0000 7f9f11600640 1 -- 172.21.15.112:0/703719555 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f0c0ae8d0 msgr2=0x7f9f0c0715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:00.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.374+0000 7f9f11600640 1 --2- 172.21.15.112:0/703719555 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f0c0ae8d0 0x7f9f0c0715a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.374+0000 7f9f11600640 1 -- 172.21.15.112:0/703719555 >> v2:172.21.15.137:3300/0 conn(0x7f9f0c06d8c0 msgr2=0x7f9f0c0afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:00.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.374+0000 7f9f11600640 1 --2- 172.21.15.112:0/703719555 >> v2:172.21.15.137:3300/0 conn(0x7f9f0c06d8c0 0x7f9f0c0afe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.374+0000 7f9f11600640 1 -- 172.21.15.112:0/703719555 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f0c0af670 con 0x7f9f0c06dca0 2024-09-12T02:49:00.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.374+0000 7f9f10c00640 1 --2- 172.21.15.112:0/703719555 >> v2:172.21.15.137:3300/0 conn(0x7f9f0c06d8c0 0x7f9f0c0afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:49:00.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.375+0000 7f9f11600640 1 --2- 172.21.15.112:0/703719555 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f0c06dca0 0x7f9f0c06e150 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c06d230 tx=0x7f9f0402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96fb060a98a984f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:00.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.376+0000 7f9f0be00640 1 -- 172.21.15.112:0/703719555 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f04036070 con 0x7f9f0c06dca0 2024-09-12T02:49:00.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.376+0000 7f9f0be00640 1 -- 172.21.15.112:0/703719555 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f04031600 con 0x7f9f0c06dca0 2024-09-12T02:49:00.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.376+0000 7f9f0be00640 1 -- 172.21.15.112:0/703719555 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f040319d0 con 0x7f9f0c06dca0 2024-09-12T02:49:00.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.376+0000 7f9f13600640 1 -- 172.21.15.112:0/703719555 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f0c06dca0 msgr2=0x7f9f0c06e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:00.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.376+0000 7f9f13600640 1 --2- 172.21.15.112:0/703719555 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f0c06dca0 0x7f9f0c06e150 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c06d230 tx=0x7f9f0402a6a0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.376+0000 7f9f13600640 1 -- 172.21.15.112:0/703719555 shutdown_connections 2024-09-12T02:49:00.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.376+0000 7f9f13600640 1 --2- 172.21.15.112:0/703719555 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f0c06dca0 0x7f9f0c06e150 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.376+0000 7f9f13600640 1 --2- 172.21.15.112:0/703719555 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f0c0ae8d0 0x7f9f0c0715a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.376+0000 7f9f13600640 1 --2- 172.21.15.112:0/703719555 >> v2:172.21.15.137:3300/0 conn(0x7f9f0c06d8c0 0x7f9f0c0afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.376+0000 7f9f13600640 1 -- 172.21.15.112:0/703719555 >> 172.21.15.112:0/703719555 conn(0x7f9f0c06bbd0 msgr2=0x7f9f0c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:00.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.376+0000 7f9f13600640 1 -- 172.21.15.112:0/703719555 shutdown_connections 2024-09-12T02:49:00.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.376+0000 7f9f13600640 1 -- 172.21.15.112:0/703719555 wait complete. 2024-09-12T02:49:00.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.378+0000 7f9f13600640 1 Processor -- start 2024-09-12T02:49:00.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.378+0000 7f9f13600640 1 -- start start 2024-09-12T02:49:00.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.379+0000 7f9f13600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f0c06d8c0 0x7f9f0c155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:00.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.379+0000 7f9f13600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f0c06dca0 0x7f9f0c159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:00.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.379+0000 7f9f13600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f0c0ae8d0 0x7f9f0c159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:00.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.379+0000 7f9f13600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c071ae0 con 0x7f9f0c06d8c0 2024-09-12T02:49:00.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.379+0000 7f9f13600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c06e690 con 0x7f9f0c06dca0 2024-09-12T02:49:00.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.379+0000 7f9f13600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9f0c0b38e0 con 0x7f9f0c0ae8d0 2024-09-12T02:49:00.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.379+0000 7f9f10c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f0c06d8c0 0x7f9f0c155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:00.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.379+0000 7f9f10c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f0c06d8c0 0x7f9f0c155130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39916/0 (socket says 172.21.15.112:39916) 2024-09-12T02:49:00.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.379+0000 7f9f10c00640 1 -- 172.21.15.112:0/1357143880 learned_addr learned my addr 172.21.15.112:0/1357143880 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:49:00.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.379+0000 7f9f11600640 1 --2- 172.21.15.112:0/1357143880 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f0c0ae8d0 0x7f9f0c159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:00.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.379+0000 7f9f03e00640 1 --2- 172.21.15.112:0/1357143880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f0c06dca0 0x7f9f0c159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:00.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.380+0000 7f9f10c00640 1 -- 172.21.15.112:0/1357143880 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f0c0ae8d0 msgr2=0x7f9f0c159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:00.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.380+0000 7f9f10c00640 1 --2- 172.21.15.112:0/1357143880 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f0c0ae8d0 0x7f9f0c159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.380+0000 7f9f10c00640 1 -- 172.21.15.112:0/1357143880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f0c06dca0 msgr2=0x7f9f0c159350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:00.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.380+0000 7f9f10c00640 1 --2- 172.21.15.112:0/1357143880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f0c06dca0 0x7f9f0c159350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.380+0000 7f9f10c00640 1 -- 172.21.15.112:0/1357143880 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f0c161420 con 0x7f9f0c06d8c0 2024-09-12T02:49:00.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.380+0000 7f9f10c00640 1 --2- 172.21.15.112:0/1357143880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f0c06d8c0 0x7f9f0c155130 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f9efc00e810 tx=0x7f9efc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:00.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.380+0000 7f9f09600640 1 -- 172.21.15.112:0/1357143880 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9efc00f040 con 0x7f9f0c06d8c0 2024-09-12T02:49:00.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.380+0000 7f9f09600640 1 -- 172.21.15.112:0/1357143880 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9efc004030 con 0x7f9f0c06d8c0 2024-09-12T02:49:00.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.380+0000 7f9f13600640 1 -- 172.21.15.112:0/1357143880 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f0c161700 con 0x7f9f0c06d8c0 2024-09-12T02:49:00.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.380+0000 7f9f09600640 1 -- 172.21.15.112:0/1357143880 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9efc004400 con 0x7f9f0c06d8c0 2024-09-12T02:49:00.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.380+0000 7f9f13600640 1 -- 172.21.15.112:0/1357143880 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f0c161fa0 con 0x7f9f0c06d8c0 2024-09-12T02:49:00.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.381+0000 7f9f13600640 1 -- 172.21.15.112:0/1357143880 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f0c161af0 con 0x7f9f0c06d8c0 2024-09-12T02:49:00.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.382+0000 7f9f09600640 1 -- 172.21.15.112:0/1357143880 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9efc00c6d0 con 0x7f9f0c06d8c0 2024-09-12T02:49:00.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.383+0000 7f9f09600640 1 --2- 172.21.15.112:0/1357143880 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9ee806be60 0x7f9ee806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:00.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.384+0000 7f9f09600640 1 -- 172.21.15.112:0/1357143880 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 5709+0+0 (secure 0 0 0) 0x7f9efc08ac40 con 0x7f9f0c06d8c0 2024-09-12T02:49:00.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.384+0000 7f9f03e00640 1 --2- 172.21.15.112:0/1357143880 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9ee806be60 0x7f9ee806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:00.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.384+0000 7f9f03e00640 1 --2- 172.21.15.112:0/1357143880 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9ee806be60 0x7f9ee806e320 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c15c530 tx=0x7f9ef4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:00.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.388+0000 7f9f09600640 1 -- 172.21.15.112:0/1357143880 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9efc017020 con 0x7f9f0c06d8c0 2024-09-12T02:49:00.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.592+0000 7f9f13600640 1 -- 172.21.15.112:0/1357143880 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f0c0689f0 con 0x7f9f0c06d8c0 2024-09-12T02:49:00.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.593+0000 7f9f09600640 1 -- 172.21.15.112:0/1357143880 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) ==== 94+0+5234 (secure 0 0 0) 0x7f9efc0594c0 con 0x7f9f0c06d8c0 2024-09-12T02:49:00.594 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:49:00.595 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":78,"btime":"2024-09-12T02:48:54:420600+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6074,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/984843624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":984843624},{"type":"v1","addr":"172.21.15.112:6836","nonce":984843624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3470369780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3470369780},{"type":"v1","addr":"172.21.15.112:6837","nonce":3470369780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/3190674567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3190674567},{"type":"v1","addr":"172.21.15.137:6834","nonce":3190674567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:48:50.793801+0000","modified":"2024-09-12T02:48:53.825952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7257":{"gid":7257,"name":"b","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/1000067194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1000067194},{"type":"v1","addr":"172.21.15.137:6835","nonce":1000067194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7257,"qdb_cluster":[7257]},"id":9}]} 2024-09-12T02:49:00.595 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 78 2024-09-12T02:49:00.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.595+0000 7f9f13600640 1 -- 172.21.15.112:0/1357143880 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9ee806be60 msgr2=0x7f9ee806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:00.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.595+0000 7f9f13600640 1 --2- 172.21.15.112:0/1357143880 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9ee806be60 0x7f9ee806e320 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c15c530 tx=0x7f9ef4008040 comp rx=0 tx=0).stop 2024-09-12T02:49:00.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.595+0000 7f9f13600640 1 -- 172.21.15.112:0/1357143880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f0c06d8c0 msgr2=0x7f9f0c155130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:00.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.595+0000 7f9f13600640 1 --2- 172.21.15.112:0/1357143880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f0c06d8c0 0x7f9f0c155130 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f9efc00e810 tx=0x7f9efc00ecd0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.595+0000 7f9f13600640 1 -- 172.21.15.112:0/1357143880 shutdown_connections 2024-09-12T02:49:00.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.595+0000 7f9f13600640 1 --2- 172.21.15.112:0/1357143880 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f0c0ae8d0 0x7f9f0c159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.595+0000 7f9f13600640 1 --2- 172.21.15.112:0/1357143880 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9ee806be60 0x7f9ee806e320 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.595+0000 7f9f13600640 1 --2- 172.21.15.112:0/1357143880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f0c06dca0 0x7f9f0c159350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.595+0000 7f9f13600640 1 --2- 172.21.15.112:0/1357143880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f0c06d8c0 0x7f9f0c155130 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.596+0000 7f9f13600640 1 -- 172.21.15.112:0/1357143880 >> 172.21.15.112:0/1357143880 conn(0x7f9f0c06bbd0 msgr2=0x7f9f0c0b0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:00.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.596+0000 7f9f13600640 1 -- 172.21.15.112:0/1357143880 shutdown_connections 2024-09-12T02:49:00.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.596+0000 7f9f13600640 1 -- 172.21.15.112:0/1357143880 wait complete. 2024-09-12T02:49:00.613 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2024-09-12T02:49:00.788 INFO:teuthology.orchestra.run.smithi137.stdout:{"cluster_fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","whoami":0,"id":7257,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.3684966949999993,"mdsmap_epoch":78,"osdmap_epoch":150,"osdmap_epoch_barrier":150,"uptime":15.012394308999999} 2024-09-12T02:49:00.788 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", "fs_name": "cephfs", "id": 7257, "mdsmap_epoch": 78, "osdmap_epoch": 150, "osdmap_epoch_barrier": 150, "rank_uptime": 9.368496695, "state": "up:active", "uptime": 15.012394309, "want_state": "up:active", "whoami": 0 } 2024-09-12T02:49:00.788 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2024-09-12T02:49:00.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.944+0000 7f5e32200640 1 Processor -- start 2024-09-12T02:49:00.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.944+0000 7f5e32200640 1 -- start start 2024-09-12T02:49:00.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.945+0000 7f5e32200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5e2c0d10b0 0x7f5e2c0b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:00.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.945+0000 7f5e32200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e2c0b5820 0x7f5e2c0b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:00.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.946+0000 7f5e32200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e2c0af530 con 0x7f5e2c0b3f70 2024-09-12T02:49:00.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.946+0000 7f5e32200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f5e2c0af2e0 con 0x7f5e2c0d10b0 2024-09-12T02:49:00.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.946+0000 7f5e32200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5e2c0af810 con 0x7f5e2c0b5820 2024-09-12T02:49:00.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.946+0000 7f5e2be00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f5e2c0b3f70 0x7f5e2c06dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33678/0 (socket says 172.21.15.112:33678) 2024-09-12T02:49:00.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.946+0000 7f5e2be00640 1 -- 172.21.15.112:0/610507164 learned_addr learned my addr 172.21.15.112:0/610507164 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:49:00.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.946+0000 7f5e2aa00640 1 --2- 172.21.15.112:0/610507164 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e2c0b5820 0x7f5e2c0b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:00.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.946+0000 7f5e2b400640 1 --2- 172.21.15.112:0/610507164 >> v2:172.21.15.137:3300/0 conn(0x7f5e2c0d10b0 0x7f5e2c0b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:00.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.946+0000 7f5e2a000640 1 -- 172.21.15.112:0/610507164 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 313624552 0 0) 0x7f5e2c0af530 con 0x7f5e2c0b3f70 2024-09-12T02:49:00.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.946+0000 7f5e2a000640 1 -- 172.21.15.112:0/610507164 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e10003520 con 0x7f5e2c0b3f70 2024-09-12T02:49:00.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.947+0000 7f5e2a000640 1 -- 172.21.15.112:0/610507164 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3510157985 0 0) 0x7f5e10003520 con 0x7f5e2c0b3f70 2024-09-12T02:49:00.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.947+0000 7f5e2b400640 1 -- 172.21.15.112:0/610507164 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e2c0b5820 msgr2=0x7f5e2c0b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:00.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.947+0000 7f5e2b400640 1 --2- 172.21.15.112:0/610507164 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e2c0b5820 0x7f5e2c0b3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.947+0000 7f5e2b400640 1 -- 172.21.15.112:0/610507164 >> v1:172.21.15.112:6789/0 conn(0x7f5e2c0b3f70 legacy=0x7f5e2c06dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:00.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.947+0000 7f5e2b400640 1 -- 172.21.15.112:0/610507164 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e2c06d550 con 0x7f5e2c0d10b0 2024-09-12T02:49:00.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.947+0000 7f5e2aa00640 1 --2- 172.21.15.112:0/610507164 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e2c0b5820 0x7f5e2c0b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:00.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.948+0000 7f5e2b400640 1 --2- 172.21.15.112:0/610507164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e2c0d10b0 0x7f5e2c0b3220 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c0097a0 tx=0x7f5e1c02a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bb09c7d6123e005 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:00.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.948+0000 7f5e2a000640 1 -- 172.21.15.112:0/610507164 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c037070 con 0x7f5e2c0d10b0 2024-09-12T02:49:00.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.948+0000 7f5e2a000640 1 -- 172.21.15.112:0/610507164 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e1c02aba0 con 0x7f5e2c0d10b0 2024-09-12T02:49:00.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.948+0000 7f5e2a000640 1 -- 172.21.15.112:0/610507164 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e240019f0 con 0x7f5e2c0d10b0 2024-09-12T02:49:00.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.949+0000 7f5e32200640 1 -- 172.21.15.112:0/610507164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e2c0d10b0 msgr2=0x7f5e2c0b3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:00.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.949+0000 7f5e32200640 1 --2- 172.21.15.112:0/610507164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e2c0d10b0 0x7f5e2c0b3220 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c0097a0 tx=0x7f5e1c02a110 comp rx=0 tx=0).stop 2024-09-12T02:49:00.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.949+0000 7f5e32200640 1 -- 172.21.15.112:0/610507164 shutdown_connections 2024-09-12T02:49:00.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.949+0000 7f5e32200640 1 --2- 172.21.15.112:0/610507164 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e2c0b5820 0x7f5e2c0b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.949+0000 7f5e32200640 1 --2- 172.21.15.112:0/610507164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e2c0d10b0 0x7f5e2c0b3220 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.949+0000 7f5e32200640 1 -- 172.21.15.112:0/610507164 >> 172.21.15.112:0/610507164 conn(0x7f5e2c0b2730 msgr2=0x7f5e2c0b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:00.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.949+0000 7f5e32200640 1 -- 172.21.15.112:0/610507164 shutdown_connections 2024-09-12T02:49:00.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.949+0000 7f5e32200640 1 -- 172.21.15.112:0/610507164 wait complete. 2024-09-12T02:49:00.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.951+0000 7f5e32200640 1 Processor -- start 2024-09-12T02:49:00.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.951+0000 7f5e32200640 1 -- start start 2024-09-12T02:49:00.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.951+0000 7f5e32200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e2c0b3f70 0x7f5e2c1f4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:00.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.952+0000 7f5e32200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e2c0b5820 0x7f5e2c1f8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:00.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.952+0000 7f5e32200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e2c0d10b0 0x7f5e2c1f8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:00.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.952+0000 7f5e32200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2c06e440 con 0x7f5e2c0b5820 2024-09-12T02:49:00.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.952+0000 7f5e32200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2c0d1490 con 0x7f5e2c0b3f70 2024-09-12T02:49:00.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.952+0000 7f5e32200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5e2c06e5c0 con 0x7f5e2c0d10b0 2024-09-12T02:49:00.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.952+0000 7f5e2aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e2c0b5820 0x7f5e2c1f8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:00.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.952+0000 7f5e2aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e2c0b5820 0x7f5e2c1f8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39926/0 (socket says 172.21.15.112:39926) 2024-09-12T02:49:00.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.952+0000 7f5e2aa00640 1 -- 172.21.15.112:0/3389951939 learned_addr learned my addr 172.21.15.112:0/3389951939 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:49:00.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.952+0000 7f5e2b400640 1 --2- 172.21.15.112:0/3389951939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e2c0b3f70 0x7f5e2c1f4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:00.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.952+0000 7f5e2be00640 1 --2- 172.21.15.112:0/3389951939 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e2c0d10b0 0x7f5e2c1f8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:00.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.952+0000 7f5e2aa00640 1 -- 172.21.15.112:0/3389951939 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e2c0d10b0 msgr2=0x7f5e2c1f8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:00.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.952+0000 7f5e2aa00640 1 --2- 172.21.15.112:0/3389951939 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e2c0d10b0 0x7f5e2c1f8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.952+0000 7f5e2aa00640 1 -- 172.21.15.112:0/3389951939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e2c0b3f70 msgr2=0x7f5e2c1f4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:00.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.952+0000 7f5e2aa00640 1 --2- 172.21.15.112:0/3389951939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e2c0b3f70 0x7f5e2c1f4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.952+0000 7f5e2aa00640 1 -- 172.21.15.112:0/3389951939 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e2c160de0 con 0x7f5e2c0b5820 2024-09-12T02:49:00.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.952+0000 7f5e2b400640 1 --2- 172.21.15.112:0/3389951939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e2c0b3f70 0x7f5e2c1f4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:00.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.953+0000 7f5e2aa00640 1 --2- 172.21.15.112:0/3389951939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e2c0b5820 0x7f5e2c1f8030 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f5e1800ebe0 tx=0x7f5e1800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:00.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.953+0000 7f5e23400640 1 -- 172.21.15.112:0/3389951939 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e18017070 con 0x7f5e2c0b5820 2024-09-12T02:49:00.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.953+0000 7f5e23400640 1 -- 172.21.15.112:0/3389951939 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e1800cc30 con 0x7f5e2c0b5820 2024-09-12T02:49:00.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.953+0000 7f5e23400640 1 -- 172.21.15.112:0/3389951939 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e18013470 con 0x7f5e2c0b5820 2024-09-12T02:49:00.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.953+0000 7f5e32200640 1 -- 172.21.15.112:0/3389951939 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e2c1610c0 con 0x7f5e2c0b5820 2024-09-12T02:49:00.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.953+0000 7f5e32200640 1 -- 172.21.15.112:0/3389951939 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e2c1593f0 con 0x7f5e2c0b5820 2024-09-12T02:49:00.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.954+0000 7f5e32200640 1 -- 172.21.15.112:0/3389951939 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e2c0b3a30 con 0x7f5e2c0b5820 2024-09-12T02:49:00.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.955+0000 7f5e23400640 1 -- 172.21.15.112:0/3389951939 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5e1801a070 con 0x7f5e2c0b5820 2024-09-12T02:49:00.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.956+0000 7f5e23400640 1 --2- 172.21.15.112:0/3389951939 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5e0c06be30 0x7f5e0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:00.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.956+0000 7f5e23400640 1 -- 172.21.15.112:0/3389951939 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 5709+0+0 (secure 0 0 0) 0x7f5e1808b140 con 0x7f5e2c0b5820 2024-09-12T02:49:00.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.956+0000 7f5e2b400640 1 --2- 172.21.15.112:0/3389951939 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5e0c06be30 0x7f5e0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:00.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.956+0000 7f5e2b400640 1 --2- 172.21.15.112:0/3389951939 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5e0c06be30 0x7f5e0c06e2f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c034000 tx=0x7f5e1c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:00.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:00.960+0000 7f5e23400640 1 -- 172.21.15.112:0/3389951939 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5e18059400 con 0x7f5e2c0b5820 2024-09-12T02:49:01.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:01.134+0000 7f5e32200640 1 -- 172.21.15.112:0/3389951939 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) -- 0x7f5e2c0b0020 con 0x7f5e2c0b5820 2024-09-12T02:49:01.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:01.651+0000 7f5e23400640 1 -- 172.21.15.112:0/3389951939 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v151) ==== 181+0+0 (secure 0 0 0) 0x7f5e1805d700 con 0x7f5e2c0b5820 2024-09-12T02:49:01.652 INFO:teuthology.orchestra.run.smithi112.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2024-09-12T02:49:01.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:01.654+0000 7f5e32200640 1 -- 172.21.15.112:0/3389951939 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5e0c06be30 msgr2=0x7f5e0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:01.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:01.654+0000 7f5e32200640 1 --2- 172.21.15.112:0/3389951939 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5e0c06be30 0x7f5e0c06e2f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c034000 tx=0x7f5e1c02e000 comp rx=0 tx=0).stop 2024-09-12T02:49:01.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:01.654+0000 7f5e32200640 1 -- 172.21.15.112:0/3389951939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e2c0b5820 msgr2=0x7f5e2c1f8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:01.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:01.654+0000 7f5e32200640 1 --2- 172.21.15.112:0/3389951939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e2c0b5820 0x7f5e2c1f8030 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f5e1800ebe0 tx=0x7f5e1800c520 comp rx=0 tx=0).stop 2024-09-12T02:49:01.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:01.654+0000 7f5e32200640 1 -- 172.21.15.112:0/3389951939 shutdown_connections 2024-09-12T02:49:01.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:01.654+0000 7f5e32200640 1 --2- 172.21.15.112:0/3389951939 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e2c0d10b0 0x7f5e2c1f8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:01.654+0000 7f5e32200640 1 --2- 172.21.15.112:0/3389951939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e2c0b5820 0x7f5e2c1f8030 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:01.654+0000 7f5e32200640 1 --2- 172.21.15.112:0/3389951939 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5e0c06be30 0x7f5e0c06e2f0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:01.654+0000 7f5e32200640 1 --2- 172.21.15.112:0/3389951939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e2c0b3f70 0x7f5e2c1f4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:01.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:01.654+0000 7f5e32200640 1 -- 172.21.15.112:0/3389951939 >> 172.21.15.112:0/3389951939 conn(0x7f5e2c0b2730 msgr2=0x7f5e2c0ae8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:01.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:01.654+0000 7f5e32200640 1 -- 172.21.15.112:0/3389951939 shutdown_connections 2024-09-12T02:49:01.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:49:01.654+0000 7f5e32200640 1 -- 172.21.15.112:0/3389951939 wait complete. 2024-09-12T02:49:01.673 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-12T02:49:01.842 INFO:teuthology.orchestra.run.smithi112.stdout:{"osd_mon_report_interval":"5"} 2024-09-12T02:49:01.843 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-12T02:49:01.843 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2024-09-12T02:49:02.002 INFO:teuthology.orchestra.run.smithi112.stdout:{"mon_tick_interval":"5"} 2024-09-12T02:49:02.003 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2024-09-12T02:49:02.003 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2024-09-12T02:49:02.003 DEBUG:teuthology.orchestra.run.smithi112:> stdin-killer -- python3 -c ' 2024-09-12T02:49:02.003 DEBUG:teuthology.orchestra.run.smithi112:> import time 2024-09-12T02:49:02.003 DEBUG:teuthology.orchestra.run.smithi112:> import datetime 2024-09-12T02:49:02.003 DEBUG:teuthology.orchestra.run.smithi112:> import subprocess 2024-09-12T02:49:02.003 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-12T02:49:02.003 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:49:02.004 DEBUG:teuthology.orchestra.run.smithi112:> # Write some buffered data through before going full, all should be well 2024-09-12T02:49:02.004 DEBUG:teuthology.orchestra.run.smithi112:> print("writing some data through which we expect to succeed") 2024-09-12T02:49:02.004 DEBUG:teuthology.orchestra.run.smithi112:> bytes = 0 2024-09-12T02:49:02.004 DEBUG:teuthology.orchestra.run.smithi112:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2024-09-12T02:49:02.004 DEBUG:teuthology.orchestra.run.smithi112:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2024-09-12T02:49:02.004 DEBUG:teuthology.orchestra.run.smithi112:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2024-09-12T02:49:02.004 DEBUG:teuthology.orchestra.run.smithi112:> os.fsync(f) 2024-09-12T02:49:02.004 DEBUG:teuthology.orchestra.run.smithi112:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2024-09-12T02:49:02.004 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:49:02.004 DEBUG:teuthology.orchestra.run.smithi112:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2024-09-12T02:49:02.004 DEBUG:teuthology.orchestra.run.smithi112:> # writing until we see an error from fsync. As long as we'"'"'re doing 2024-09-12T02:49:02.004 DEBUG:teuthology.orchestra.run.smithi112:> # buffered IO, the error should always only appear from fsync and not 2024-09-12T02:49:02.004 DEBUG:teuthology.orchestra.run.smithi112:> # from write 2024-09-12T02:49:02.004 DEBUG:teuthology.orchestra.run.smithi112:> full = False 2024-09-12T02:49:02.004 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:49:02.005 DEBUG:teuthology.orchestra.run.smithi112:> for n in range(0, int(32 * 0.9)): 2024-09-12T02:49:02.005 DEBUG:teuthology.orchestra.run.smithi112:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-12T02:49:02.005 DEBUG:teuthology.orchestra.run.smithi112:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2024-09-12T02:49:02.005 DEBUG:teuthology.orchestra.run.smithi112:> print("done writing {0} bytes".format(bytes)) 2024-09-12T02:49:02.005 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:49:02.005 DEBUG:teuthology.orchestra.run.smithi112:> # OK, now we should sneak in under the full condition 2024-09-12T02:49:02.005 DEBUG:teuthology.orchestra.run.smithi112:> # due to the time it takes the OSDs to report to the 2024-09-12T02:49:02.005 DEBUG:teuthology.orchestra.run.smithi112:> # mons, and get a successful fsync on our full-making data 2024-09-12T02:49:02.005 DEBUG:teuthology.orchestra.run.smithi112:> os.fsync(f) 2024-09-12T02:49:02.005 DEBUG:teuthology.orchestra.run.smithi112:> print("successfully fsync'"'"'ed prior to getting full state reported") 2024-09-12T02:49:02.005 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:49:02.005 DEBUG:teuthology.orchestra.run.smithi112:> # buffered write, add more dirty data to the buffer 2024-09-12T02:49:02.005 DEBUG:teuthology.orchestra.run.smithi112:> print("starting buffered write") 2024-09-12T02:49:02.005 DEBUG:teuthology.orchestra.run.smithi112:> try: 2024-09-12T02:49:02.005 DEBUG:teuthology.orchestra.run.smithi112:> for n in range(0, int(32 * 0.2)): 2024-09-12T02:49:02.006 DEBUG:teuthology.orchestra.run.smithi112:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-12T02:49:02.006 DEBUG:teuthology.orchestra.run.smithi112:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2024-09-12T02:49:02.006 DEBUG:teuthology.orchestra.run.smithi112:> time.sleep(15.0) 2024-09-12T02:49:02.006 DEBUG:teuthology.orchestra.run.smithi112:> except OSError: 2024-09-12T02:49:02.006 DEBUG:teuthology.orchestra.run.smithi112:> pass; 2024-09-12T02:49:02.006 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:49:02.006 DEBUG:teuthology.orchestra.run.smithi112:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2024-09-12T02:49:02.006 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:49:02.006 DEBUG:teuthology.orchestra.run.smithi112:> # Wait long enough for a background flush that should fail 2024-09-12T02:49:02.006 DEBUG:teuthology.orchestra.run.smithi112:> time.sleep(30) 2024-09-12T02:49:02.006 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:49:02.006 DEBUG:teuthology.orchestra.run.smithi112:> if False: 2024-09-12T02:49:02.006 DEBUG:teuthology.orchestra.run.smithi112:> # ...and check that the failed background flush is reflected in fclose 2024-09-12T02:49:02.006 DEBUG:teuthology.orchestra.run.smithi112:> try: 2024-09-12T02:49:02.007 DEBUG:teuthology.orchestra.run.smithi112:> os.close(f) 2024-09-12T02:49:02.007 DEBUG:teuthology.orchestra.run.smithi112:> except OSError: 2024-09-12T02:49:02.007 DEBUG:teuthology.orchestra.run.smithi112:> print("close() returned an error as expected") 2024-09-12T02:49:02.007 DEBUG:teuthology.orchestra.run.smithi112:> else: 2024-09-12T02:49:02.007 DEBUG:teuthology.orchestra.run.smithi112:> raise RuntimeError("close() failed to raise error") 2024-09-12T02:49:02.007 DEBUG:teuthology.orchestra.run.smithi112:> else: 2024-09-12T02:49:02.007 DEBUG:teuthology.orchestra.run.smithi112:> # The kernel cephfs client does not raise errors on fclose 2024-09-12T02:49:02.007 DEBUG:teuthology.orchestra.run.smithi112:> os.close(f) 2024-09-12T02:49:02.007 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:49:02.007 DEBUG:teuthology.orchestra.run.smithi112:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2024-09-12T02:49:02.007 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-12T02:49:22.127 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:49:22.133 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:49:52.228 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:49:52.234 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:50:22.337 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:50:22.343 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:50:52.452 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:50:52.457 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:51:06.017 INFO:teuthology.orchestra.run.smithi112.stdout:writing some data through which we expect to succeed 2024-09-12T02:51:06.017 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed data successfully, will now attempt to fill fs 2024-09-12T02:51:06.018 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 1572864 bytes via buffered write, may repeat 2024-09-12T02:51:06.018 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 2621440 bytes via buffered write, may repeat 2024-09-12T02:51:06.018 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 3670016 bytes via buffered write, may repeat 2024-09-12T02:51:06.018 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 4718592 bytes via buffered write, may repeat 2024-09-12T02:51:06.018 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 5767168 bytes via buffered write, may repeat 2024-09-12T02:51:06.018 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 6815744 bytes via buffered write, may repeat 2024-09-12T02:51:06.018 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 7864320 bytes via buffered write, may repeat 2024-09-12T02:51:06.018 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 8912896 bytes via buffered write, may repeat 2024-09-12T02:51:06.018 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 9961472 bytes via buffered write, may repeat 2024-09-12T02:51:06.018 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 11010048 bytes via buffered write, may repeat 2024-09-12T02:51:06.018 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 12058624 bytes via buffered write, may repeat 2024-09-12T02:51:06.018 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 13107200 bytes via buffered write, may repeat 2024-09-12T02:51:06.018 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 14155776 bytes via buffered write, may repeat 2024-09-12T02:51:06.019 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 15204352 bytes via buffered write, may repeat 2024-09-12T02:51:06.019 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 16252928 bytes via buffered write, may repeat 2024-09-12T02:51:06.019 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 17301504 bytes via buffered write, may repeat 2024-09-12T02:51:06.019 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 18350080 bytes via buffered write, may repeat 2024-09-12T02:51:06.019 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 19398656 bytes via buffered write, may repeat 2024-09-12T02:51:06.019 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 20447232 bytes via buffered write, may repeat 2024-09-12T02:51:06.019 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 21495808 bytes via buffered write, may repeat 2024-09-12T02:51:06.019 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 22544384 bytes via buffered write, may repeat 2024-09-12T02:51:06.019 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 23592960 bytes via buffered write, may repeat 2024-09-12T02:51:06.019 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 24641536 bytes via buffered write, may repeat 2024-09-12T02:51:06.019 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 25690112 bytes via buffered write, may repeat 2024-09-12T02:51:06.019 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 26738688 bytes via buffered write, may repeat 2024-09-12T02:51:06.019 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 27787264 bytes via buffered write, may repeat 2024-09-12T02:51:06.019 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 28835840 bytes via buffered write, may repeat 2024-09-12T02:51:06.020 INFO:teuthology.orchestra.run.smithi112.stdout:wrote 29884416 bytes via buffered write, may repeat 2024-09-12T02:51:06.020 INFO:teuthology.orchestra.run.smithi112.stdout:done writing 29884416 bytes 2024-09-12T02:51:06.020 INFO:teuthology.orchestra.run.smithi112.stdout:successfully fsync'ed prior to getting full state reported 2024-09-12T02:51:06.020 INFO:teuthology.orchestra.run.smithi112.stdout:starting buffered write 2024-09-12T02:51:06.020 INFO:teuthology.orchestra.run.smithi112.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-12T02:51:06.020 INFO:teuthology.orchestra.run.smithi112.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-12T02:51:06.020 INFO:teuthology.orchestra.run.smithi112.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-12T02:51:06.020 INFO:teuthology.orchestra.run.smithi112.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-12T02:51:06.020 INFO:teuthology.orchestra.run.smithi112.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-12T02:51:06.020 INFO:teuthology.orchestra.run.smithi112.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-12T02:51:06.020 INFO:teuthology.orchestra.run.smithi112.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2024-09-12T02:51:06.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:51:06.034 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:51:06.034 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:51:06.128 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:51:06.218 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:51:06.218 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:51:06.219 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:51:06.219 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:51:06.256 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:51:06.256 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:51:06.332 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:51:06.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.526+0000 7effd5c00640 1 Processor -- start 2024-09-12T02:51:06.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.526+0000 7effd5c00640 1 -- start start 2024-09-12T02:51:06.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.528+0000 7effd5c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7effd006d8c0 0x7effd00afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:06.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.528+0000 7effd5c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7effd00ae8d0 0x7effd00715a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:06.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.528+0000 7effd5c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effd00aedd0 con 0x7effd006dca0 2024-09-12T02:51:06.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.528+0000 7effd5c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7effd00af0b0 con 0x7effd00ae8d0 2024-09-12T02:51:06.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.528+0000 7effd5c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7effd00af390 con 0x7effd006d8c0 2024-09-12T02:51:06.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.528+0000 7effc6000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7effd00ae8d0 0x7effd00715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:06.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.528+0000 7effcf400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7effd006dca0 0x7effd006e150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38042/0 (socket says 172.21.15.112:38042) 2024-09-12T02:51:06.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.528+0000 7effcf400640 1 -- 172.21.15.112:0/2375628602 learned_addr learned my addr 172.21.15.112:0/2375628602 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:51:06.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.528+0000 7effcea00640 1 --2- 172.21.15.112:0/2375628602 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7effd006d8c0 0x7effd00afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:06.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.528+0000 7effc6000640 1 -- 172.21.15.112:0/2375628602 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7effd006d8c0 msgr2=0x7effd00afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:06.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.528+0000 7effc6000640 1 --2- 172.21.15.112:0/2375628602 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7effd006d8c0 0x7effd00afe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:06.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.528+0000 7effc6000640 1 -- 172.21.15.112:0/2375628602 >> v1:172.21.15.112:6789/0 conn(0x7effd006dca0 legacy=0x7effd006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:06.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.528+0000 7effc6000640 1 -- 172.21.15.112:0/2375628602 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd00af670 con 0x7effd00ae8d0 2024-09-12T02:51:06.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.528+0000 7effcea00640 1 --2- 172.21.15.112:0/2375628602 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7effd006d8c0 0x7effd00afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:51:06.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.528+0000 7effce000640 1 -- 172.21.15.112:0/2375628602 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3738029471 0 0) 0x7effd00aedd0 con 0x7effd006dca0 2024-09-12T02:51:06.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.529+0000 7effc6000640 1 --2- 172.21.15.112:0/2375628602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effd00ae8d0 0x7effd00715a0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7effb8009790 tx=0x7effb802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea415cce2965fff8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:06.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.530+0000 7effce000640 1 -- 172.21.15.112:0/2375628602 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb8037070 con 0x7effd00ae8d0 2024-09-12T02:51:06.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.530+0000 7effce000640 1 -- 172.21.15.112:0/2375628602 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effb8032440 con 0x7effd00ae8d0 2024-09-12T02:51:06.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.530+0000 7effce000640 1 -- 172.21.15.112:0/2375628602 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb8032810 con 0x7effd00ae8d0 2024-09-12T02:51:06.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.530+0000 7effd5c00640 1 -- 172.21.15.112:0/2375628602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effd00ae8d0 msgr2=0x7effd00715a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:06.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.530+0000 7effd5c00640 1 --2- 172.21.15.112:0/2375628602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effd00ae8d0 0x7effd00715a0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7effb8009790 tx=0x7effb802a180 comp rx=0 tx=0).stop 2024-09-12T02:51:06.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.530+0000 7effd5c00640 1 -- 172.21.15.112:0/2375628602 shutdown_connections 2024-09-12T02:51:06.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.530+0000 7effd5c00640 1 --2- 172.21.15.112:0/2375628602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effd00ae8d0 0x7effd00715a0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:06.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.530+0000 7effd5c00640 1 --2- 172.21.15.112:0/2375628602 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7effd006d8c0 0x7effd00afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:06.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.530+0000 7effd5c00640 1 -- 172.21.15.112:0/2375628602 >> 172.21.15.112:0/2375628602 conn(0x7effd006bbd0 msgr2=0x7effd006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:06.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.530+0000 7effd5c00640 1 -- 172.21.15.112:0/2375628602 shutdown_connections 2024-09-12T02:51:06.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.530+0000 7effd5c00640 1 -- 172.21.15.112:0/2375628602 wait complete. 2024-09-12T02:51:06.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.532+0000 7effd5c00640 1 Processor -- start 2024-09-12T02:51:06.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.532+0000 7effd5c00640 1 -- start start 2024-09-12T02:51:06.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.533+0000 7effd5c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effd006d8c0 0x7effd00cf280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:06.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.533+0000 7effd5c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effd006dca0 0x7effd014c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:06.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.533+0000 7effd5c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7effd00ae8d0 0x7effd00cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:06.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.533+0000 7effd5c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7effd00b38e0 con 0x7effd006dca0 2024-09-12T02:51:06.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.533+0000 7effd5c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7effd0071ae0 con 0x7effd006d8c0 2024-09-12T02:51:06.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.533+0000 7effd5c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7effd00b3a60 con 0x7effd00ae8d0 2024-09-12T02:51:06.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.533+0000 7effc6000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effd006dca0 0x7effd014c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:06.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.533+0000 7effc6000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effd006dca0 0x7effd014c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42680/0 (socket says 172.21.15.112:42680) 2024-09-12T02:51:06.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.533+0000 7effc6000640 1 -- 172.21.15.112:0/3546508795 learned_addr learned my addr 172.21.15.112:0/3546508795 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:06.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.533+0000 7effcea00640 1 --2- 172.21.15.112:0/3546508795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effd006d8c0 0x7effd00cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:06.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.534+0000 7effcf400640 1 --2- 172.21.15.112:0/3546508795 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7effd00ae8d0 0x7effd00cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:06.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.534+0000 7effc6000640 1 -- 172.21.15.112:0/3546508795 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7effd00ae8d0 msgr2=0x7effd00cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:06.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.534+0000 7effc6000640 1 --2- 172.21.15.112:0/3546508795 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7effd00ae8d0 0x7effd00cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:06.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.534+0000 7effc6000640 1 -- 172.21.15.112:0/3546508795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effd006d8c0 msgr2=0x7effd00cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:06.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.534+0000 7effc6000640 1 --2- 172.21.15.112:0/3546508795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effd006d8c0 0x7effd00cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:06.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.534+0000 7effc6000640 1 -- 172.21.15.112:0/3546508795 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd014c8a0 con 0x7effd006dca0 2024-09-12T02:51:06.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.534+0000 7effc6000640 1 --2- 172.21.15.112:0/3546508795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effd006dca0 0x7effd014c360 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7effb8035040 tx=0x7effb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:06.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.534+0000 7effc7400640 1 -- 172.21.15.112:0/3546508795 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb8042020 con 0x7effd006dca0 2024-09-12T02:51:06.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.534+0000 7effc7400640 1 -- 172.21.15.112:0/3546508795 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effb8038040 con 0x7effd006dca0 2024-09-12T02:51:06.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.534+0000 7effc7400640 1 -- 172.21.15.112:0/3546508795 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb8037050 con 0x7effd006dca0 2024-09-12T02:51:06.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.535+0000 7effd5c00640 1 -- 172.21.15.112:0/3546508795 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effd00cf860 con 0x7effd006dca0 2024-09-12T02:51:06.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.535+0000 7effd5c00640 1 -- 172.21.15.112:0/3546508795 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effd00cfe20 con 0x7effd006dca0 2024-09-12T02:51:06.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.536+0000 7effd5c00640 1 -- 172.21.15.112:0/3546508795 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effd0068a30 con 0x7effd006dca0 2024-09-12T02:51:06.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.536+0000 7effc7400640 1 -- 172.21.15.112:0/3546508795 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7effb8005990 con 0x7effd006dca0 2024-09-12T02:51:06.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.537+0000 7effc7400640 1 --2- 172.21.15.112:0/3546508795 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7effac06be30 0x7effac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:06.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.537+0000 7effc7400640 1 -- 172.21.15.112:0/3546508795 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5767+0+0 (secure 0 0 0) 0x7effb80ab590 con 0x7effd006dca0 2024-09-12T02:51:06.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.538+0000 7effcea00640 1 --2- 172.21.15.112:0/3546508795 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7effac06be30 0x7effac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:06.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.538+0000 7effc7400640 1 -- 172.21.15.112:0/3546508795 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=155}) -- 0x7effac073a20 con 0x7effd006dca0 2024-09-12T02:51:06.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.538+0000 7effcea00640 1 --2- 172.21.15.112:0/3546508795 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7effac06be30 0x7effac06e2f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7effc0006fd0 tx=0x7effc0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:06.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.542+0000 7effc7400640 1 -- 172.21.15.112:0/3546508795 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7effb804c020 con 0x7effd006dca0 2024-09-12T02:51:06.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.723+0000 7effd5c00640 1 -- 172.21.15.112:0/3546508795 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7effd00b4a10 con 0x7effd006dca0 2024-09-12T02:51:06.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.723+0000 7effc7400640 1 -- 172.21.15.112:0/3546508795 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v154) ==== 80+0+0 (secure 0 0 0) 0x7effb80798a0 con 0x7effd006dca0 2024-09-12T02:51:06.725 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-12T02:51:06.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.725+0000 7effd5c00640 1 -- 172.21.15.112:0/3546508795 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7effac06be30 msgr2=0x7effac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:06.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.725+0000 7effd5c00640 1 --2- 172.21.15.112:0/3546508795 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7effac06be30 0x7effac06e2f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7effc0006fd0 tx=0x7effc0008040 comp rx=0 tx=0).stop 2024-09-12T02:51:06.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.725+0000 7effd5c00640 1 -- 172.21.15.112:0/3546508795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effd006dca0 msgr2=0x7effd014c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:06.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.725+0000 7effd5c00640 1 --2- 172.21.15.112:0/3546508795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effd006dca0 0x7effd014c360 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7effb8035040 tx=0x7effb80046c0 comp rx=0 tx=0).stop 2024-09-12T02:51:06.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.726+0000 7effd5c00640 1 -- 172.21.15.112:0/3546508795 shutdown_connections 2024-09-12T02:51:06.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.726+0000 7effd5c00640 1 --2- 172.21.15.112:0/3546508795 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7effd00ae8d0 0x7effd00cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:06.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.726+0000 7effd5c00640 1 --2- 172.21.15.112:0/3546508795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effd006dca0 0x7effd014c360 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:06.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.726+0000 7effd5c00640 1 --2- 172.21.15.112:0/3546508795 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7effac06be30 0x7effac06e2f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:06.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.726+0000 7effd5c00640 1 --2- 172.21.15.112:0/3546508795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effd006d8c0 0x7effd00cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:06.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.726+0000 7effd5c00640 1 -- 172.21.15.112:0/3546508795 >> 172.21.15.112:0/3546508795 conn(0x7effd006bbd0 msgr2=0x7effd00b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:06.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.726+0000 7effd5c00640 1 -- 172.21.15.112:0/3546508795 shutdown_connections 2024-09-12T02:51:06.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:06.726+0000 7effd5c00640 1 -- 172.21.15.112:0/3546508795 wait complete. 2024-09-12T02:51:06.742 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:51:06.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:51:06.742 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T02:51:06.805 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-12T02:51:06.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:51:06.806 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:51:06.841 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:51:06.842 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:51:06.842 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:51:06.882 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:51:06.883 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:51:06.961 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:51:07.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.114+0000 7f72f0e00640 1 Processor -- start 2024-09-12T02:51:07.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.114+0000 7f72f0e00640 1 -- start start 2024-09-12T02:51:07.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.116+0000 7f72f0e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f72ec0b4ec0 0x7f72ec0b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:07.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.116+0000 7f72f0e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72ec0b54a0 con 0x7f72ec15b9d0 2024-09-12T02:51:07.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.116+0000 7f72f0e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72ec0b3af0 con 0x7f72ec06f600 2024-09-12T02:51:07.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.116+0000 7f72f0e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f72ec0b3dd0 con 0x7f72ec0b4ec0 2024-09-12T02:51:07.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.116+0000 7f72ea800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f72ec0b4ec0 0x7f72ec0b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:07.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.116+0000 7f72ea800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f72ec0b4ec0 0x7f72ec0b45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42696/0 (socket says 172.21.15.112:42696) 2024-09-12T02:51:07.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.116+0000 7f72ea800640 1 -- 172.21.15.112:0/3490257382 learned_addr learned my addr 172.21.15.112:0/3490257382 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:07.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.116+0000 7f72ea800640 1 -- 172.21.15.112:0/3490257382 >> v1:172.21.15.137:6789/0 conn(0x7f72ec06f600 legacy=0x7f72ec0cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:07.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.116+0000 7f72ea800640 1 -- 172.21.15.112:0/3490257382 >> v1:172.21.15.112:6789/0 conn(0x7f72ec15b9d0 legacy=0x7f72ec06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:07.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.116+0000 7f72ea800640 1 -- 172.21.15.112:0/3490257382 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72ec0b40b0 con 0x7f72ec0b4ec0 2024-09-12T02:51:07.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.117+0000 7f72ea800640 1 --2- 172.21.15.112:0/3490257382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72ec0b4ec0 0x7f72ec0b45d0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f72e4009e50 tx=0x7f72e402c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d4730b304a3806 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:07.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.118+0000 7f72e9400640 1 -- 172.21.15.112:0/3490257382 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e40333f0 con 0x7f72ec0b4ec0 2024-09-12T02:51:07.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.118+0000 7f72e9400640 1 -- 172.21.15.112:0/3490257382 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e4033590 con 0x7f72ec0b4ec0 2024-09-12T02:51:07.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.118+0000 7f72e9400640 1 -- 172.21.15.112:0/3490257382 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e4033960 con 0x7f72ec0b4ec0 2024-09-12T02:51:07.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.118+0000 7f72f0e00640 1 -- 172.21.15.112:0/3490257382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72ec0b4ec0 msgr2=0x7f72ec0b45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:07.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.118+0000 7f72f0e00640 1 --2- 172.21.15.112:0/3490257382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72ec0b4ec0 0x7f72ec0b45d0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f72e4009e50 tx=0x7f72e402c8e0 comp rx=0 tx=0).stop 2024-09-12T02:51:07.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.118+0000 7f72f0e00640 1 -- 172.21.15.112:0/3490257382 shutdown_connections 2024-09-12T02:51:07.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.118+0000 7f72f0e00640 1 --2- 172.21.15.112:0/3490257382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72ec0b4ec0 0x7f72ec0b45d0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:07.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.118+0000 7f72f0e00640 1 -- 172.21.15.112:0/3490257382 >> 172.21.15.112:0/3490257382 conn(0x7f72ec06bbd0 msgr2=0x7f72ec06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:07.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.118+0000 7f72f0e00640 1 -- 172.21.15.112:0/3490257382 shutdown_connections 2024-09-12T02:51:07.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.118+0000 7f72f0e00640 1 -- 172.21.15.112:0/3490257382 wait complete. 2024-09-12T02:51:07.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.120+0000 7f72f0e00640 1 Processor -- start 2024-09-12T02:51:07.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.120+0000 7f72f0e00640 1 -- start start 2024-09-12T02:51:07.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.121+0000 7f72f0e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72ec06f600 0x7f72ec151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:07.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.121+0000 7f72f0e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72ec0b4ec0 0x7f72ec15a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:07.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.121+0000 7f72f0e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72ec15b9d0 0x7f72ec15a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:07.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.121+0000 7f72f0e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f72ec072a40 con 0x7f72ec0b4ec0 2024-09-12T02:51:07.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.121+0000 7f72f0e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f72ec0728c0 con 0x7f72ec15b9d0 2024-09-12T02:51:07.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.121+0000 7f72f0e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f72ec072bc0 con 0x7f72ec06f600 2024-09-12T02:51:07.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.121+0000 7f72e1400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72ec0b4ec0 0x7f72ec15a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:07.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.121+0000 7f72e1400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72ec0b4ec0 0x7f72ec15a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42710/0 (socket says 172.21.15.112:42710) 2024-09-12T02:51:07.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.121+0000 7f72e1400640 1 -- 172.21.15.112:0/1591917609 learned_addr learned my addr 172.21.15.112:0/1591917609 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:07.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.122+0000 7f72ea800640 1 --2- 172.21.15.112:0/1591917609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72ec15b9d0 0x7f72ec15a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:07.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.122+0000 7f72e1400640 1 -- 172.21.15.112:0/1591917609 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72ec06f600 msgr2=0x7f72ec151550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:07.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.122+0000 7f72e9e00640 1 --2- 172.21.15.112:0/1591917609 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72ec06f600 0x7f72ec151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:07.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.122+0000 7f72e1400640 1 --2- 172.21.15.112:0/1591917609 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72ec06f600 0x7f72ec151550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:07.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.122+0000 7f72e1400640 1 -- 172.21.15.112:0/1591917609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72ec15b9d0 msgr2=0x7f72ec15a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:07.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.122+0000 7f72e1400640 1 --2- 172.21.15.112:0/1591917609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72ec15b9d0 0x7f72ec15a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:07.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.122+0000 7f72e1400640 1 -- 172.21.15.112:0/1591917609 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72ec151a90 con 0x7f72ec0b4ec0 2024-09-12T02:51:07.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.122+0000 7f72ea800640 1 --2- 172.21.15.112:0/1591917609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72ec15b9d0 0x7f72ec15a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:51:07.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.122+0000 7f72e9e00640 1 --2- 172.21.15.112:0/1591917609 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72ec06f600 0x7f72ec151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:51:07.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.122+0000 7f72e1400640 1 --2- 172.21.15.112:0/1591917609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72ec0b4ec0 0x7f72ec15a380 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f72d400c3f0 tx=0x7f72d400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:07.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.122+0000 7f72e2a00640 1 -- 172.21.15.112:0/1591917609 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d4006820 con 0x7f72ec0b4ec0 2024-09-12T02:51:07.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.122+0000 7f72e2a00640 1 -- 172.21.15.112:0/1591917609 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72d40069c0 con 0x7f72ec0b4ec0 2024-09-12T02:51:07.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.122+0000 7f72e2a00640 1 -- 172.21.15.112:0/1591917609 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d4006dd0 con 0x7f72ec0b4ec0 2024-09-12T02:51:07.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.122+0000 7f72f0e00640 1 -- 172.21.15.112:0/1591917609 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72ec15ed20 con 0x7f72ec0b4ec0 2024-09-12T02:51:07.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.123+0000 7f72f0e00640 1 -- 172.21.15.112:0/1591917609 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72ec1f5960 con 0x7f72ec0b4ec0 2024-09-12T02:51:07.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.123+0000 7f72f0e00640 1 -- 172.21.15.112:0/1591917609 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72ec068a30 con 0x7f72ec0b4ec0 2024-09-12T02:51:07.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.124+0000 7f72e2a00640 1 -- 172.21.15.112:0/1591917609 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f72d4019030 con 0x7f72ec0b4ec0 2024-09-12T02:51:07.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.125+0000 7f72e2a00640 1 --2- 172.21.15.112:0/1591917609 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f72c806be30 0x7f72c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:07.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.125+0000 7f72e2a00640 1 -- 172.21.15.112:0/1591917609 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5767+0+0 (secure 0 0 0) 0x7f72d408a5a0 con 0x7f72ec0b4ec0 2024-09-12T02:51:07.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.126+0000 7f72e9e00640 1 --2- 172.21.15.112:0/1591917609 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f72c806be30 0x7f72c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:07.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.126+0000 7f72e2a00640 1 -- 172.21.15.112:0/1591917609 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=155}) -- 0x7f72c8073a20 con 0x7f72ec0b4ec0 2024-09-12T02:51:07.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.126+0000 7f72e9e00640 1 --2- 172.21.15.112:0/1591917609 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f72c806be30 0x7f72c806e2f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0691f0 tx=0x7f72dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:07.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.129+0000 7f72e2a00640 1 -- 172.21.15.112:0/1591917609 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f72d4020020 con 0x7f72ec0b4ec0 2024-09-12T02:51:07.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.315+0000 7f72f0e00640 1 -- 172.21.15.112:0/1591917609 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f72ec06dbc0 con 0x7f72ec0b4ec0 2024-09-12T02:51:07.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.316+0000 7f72e2a00640 1 -- 172.21.15.112:0/1591917609 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v154) ==== 80+0+0 (secure 0 0 0) 0x7f72ec151a90 con 0x7f72ec0b4ec0 2024-09-12T02:51:07.317 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-12T02:51:07.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.318+0000 7f72f0e00640 1 -- 172.21.15.112:0/1591917609 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f72c806be30 msgr2=0x7f72c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:07.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.318+0000 7f72f0e00640 1 --2- 172.21.15.112:0/1591917609 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f72c806be30 0x7f72c806e2f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0691f0 tx=0x7f72dc009040 comp rx=0 tx=0).stop 2024-09-12T02:51:07.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.318+0000 7f72f0e00640 1 -- 172.21.15.112:0/1591917609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72ec0b4ec0 msgr2=0x7f72ec15a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:07.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.318+0000 7f72f0e00640 1 --2- 172.21.15.112:0/1591917609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72ec0b4ec0 0x7f72ec15a380 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f72d400c3f0 tx=0x7f72d400c8b0 comp rx=0 tx=0).stop 2024-09-12T02:51:07.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.318+0000 7f72f0e00640 1 -- 172.21.15.112:0/1591917609 shutdown_connections 2024-09-12T02:51:07.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.318+0000 7f72f0e00640 1 --2- 172.21.15.112:0/1591917609 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f72c806be30 0x7f72c806e2f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:07.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.318+0000 7f72f0e00640 1 --2- 172.21.15.112:0/1591917609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72ec15b9d0 0x7f72ec15a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:07.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.318+0000 7f72f0e00640 1 --2- 172.21.15.112:0/1591917609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72ec0b4ec0 0x7f72ec15a380 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:07.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.318+0000 7f72f0e00640 1 --2- 172.21.15.112:0/1591917609 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72ec06f600 0x7f72ec151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:07.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.318+0000 7f72f0e00640 1 -- 172.21.15.112:0/1591917609 >> 172.21.15.112:0/1591917609 conn(0x7f72ec06bbd0 msgr2=0x7f72ec0afbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:07.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.318+0000 7f72f0e00640 1 -- 172.21.15.112:0/1591917609 shutdown_connections 2024-09-12T02:51:07.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.318+0000 7f72f0e00640 1 -- 172.21.15.112:0/1591917609 wait complete. 2024-09-12T02:51:07.335 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-12T02:51:07.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:51:07.335 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-12T02:51:07.402 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T02:51:07.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:51:07.403 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T02:51:07.442 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:51:07.442 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:51:07.442 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:51:07.478 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:51:07.478 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:51:07.479 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:51:07.479 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:51:07.518 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:51:07.518 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:51:07.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.675+0000 7fd6b3800640 1 Processor -- start 2024-09-12T02:51:07.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.676+0000 7fd6b3800640 1 -- start start 2024-09-12T02:51:07.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.677+0000 7fd6b3800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd6ac06e050 0x7fd6ac0cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:07.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.677+0000 7fd6b3800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6ac0b5850 0x7fd6ac164de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:07.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.677+0000 7fd6b3800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6ac15b6a0 con 0x7fd6ac071ff0 2024-09-12T02:51:07.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.677+0000 7fd6b3800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd6ac0b43b0 con 0x7fd6ac06e050 2024-09-12T02:51:07.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.677+0000 7fd6b3800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd6ac0b3a80 con 0x7fd6ac0b5850 2024-09-12T02:51:07.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.677+0000 7fd6b0e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd6ac06e050 0x7fd6ac0cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:07.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.677+0000 7fd6b0e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd6ac06e050 0x7fd6ac0cfff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42712/0 (socket says 172.21.15.112:42712) 2024-09-12T02:51:07.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.677+0000 7fd6b0e00640 1 -- 172.21.15.112:0/1327188524 learned_addr learned my addr 172.21.15.112:0/1327188524 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:07.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.677+0000 7fd6b1800640 1 --2- 172.21.15.112:0/1327188524 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6ac0b5850 0x7fd6ac164de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:07.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.677+0000 7fd6b0e00640 1 -- 172.21.15.112:0/1327188524 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6ac0b5850 msgr2=0x7fd6ac164de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:07.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.677+0000 7fd6b0e00640 1 --2- 172.21.15.112:0/1327188524 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6ac0b5850 0x7fd6ac164de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:07.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.677+0000 7fd6b0e00640 1 -- 172.21.15.112:0/1327188524 >> v1:172.21.15.137:6789/0 conn(0x7fd6ac071ff0 legacy=0x7fd6ac06e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:07.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.677+0000 7fd6b0e00640 1 -- 172.21.15.112:0/1327188524 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6ac0b3d60 con 0x7fd6ac06e050 2024-09-12T02:51:07.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.678+0000 7fd6b0e00640 1 --2- 172.21.15.112:0/1327188524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6ac06e050 0x7fd6ac0cfff0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00bb00 tx=0x7fd69c02c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cba2a59719019 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:07.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.679+0000 7fd6abe00640 1 -- 172.21.15.112:0/1327188524 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c03a070 con 0x7fd6ac06e050 2024-09-12T02:51:07.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.679+0000 7fd6abe00640 1 -- 172.21.15.112:0/1327188524 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd69c032480 con 0x7fd6ac06e050 2024-09-12T02:51:07.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.679+0000 7fd6abe00640 1 -- 172.21.15.112:0/1327188524 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c032850 con 0x7fd6ac06e050 2024-09-12T02:51:07.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.679+0000 7fd6b3800640 1 -- 172.21.15.112:0/1327188524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6ac06e050 msgr2=0x7fd6ac0cfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:07.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.679+0000 7fd6b3800640 1 --2- 172.21.15.112:0/1327188524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6ac06e050 0x7fd6ac0cfff0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00bb00 tx=0x7fd69c02c6e0 comp rx=0 tx=0).stop 2024-09-12T02:51:07.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.679+0000 7fd6b3800640 1 -- 172.21.15.112:0/1327188524 shutdown_connections 2024-09-12T02:51:07.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.679+0000 7fd6b3800640 1 --2- 172.21.15.112:0/1327188524 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6ac0b5850 0x7fd6ac164de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:07.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.679+0000 7fd6b3800640 1 --2- 172.21.15.112:0/1327188524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6ac06e050 0x7fd6ac0cfff0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:07.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.679+0000 7fd6b3800640 1 -- 172.21.15.112:0/1327188524 >> 172.21.15.112:0/1327188524 conn(0x7fd6ac06bbd0 msgr2=0x7fd6ac06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:07.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.679+0000 7fd6b3800640 1 -- 172.21.15.112:0/1327188524 shutdown_connections 2024-09-12T02:51:07.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.679+0000 7fd6b3800640 1 -- 172.21.15.112:0/1327188524 wait complete. 2024-09-12T02:51:07.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.681+0000 7fd6b3800640 1 Processor -- start 2024-09-12T02:51:07.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.681+0000 7fd6b3800640 1 -- start start 2024-09-12T02:51:07.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.682+0000 7fd6b3800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6ac06e050 0x7fd6ac1f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:07.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.682+0000 7fd6b3800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6ac071ff0 0x7fd6ac0c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:07.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.682+0000 7fd6b3800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6ac0b5850 0x7fd6ac1f4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:07.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.682+0000 7fd6b3800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ac06eb40 con 0x7fd6ac06e050 2024-09-12T02:51:07.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.682+0000 7fd6b3800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ac0d0530 con 0x7fd6ac0b5850 2024-09-12T02:51:07.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.682+0000 7fd6b3800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd6ac06d550 con 0x7fd6ac071ff0 2024-09-12T02:51:07.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.682+0000 7fd6b0e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6ac06e050 0x7fd6ac1f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:07.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.682+0000 7fd6b0e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6ac06e050 0x7fd6ac1f22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42726/0 (socket says 172.21.15.112:42726) 2024-09-12T02:51:07.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.682+0000 7fd6b0e00640 1 -- 172.21.15.112:0/2540277912 learned_addr learned my addr 172.21.15.112:0/2540277912 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:07.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.683+0000 7fd6a3e00640 1 --2- 172.21.15.112:0/2540277912 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6ac071ff0 0x7fd6ac0c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:07.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.683+0000 7fd6b1800640 1 --2- 172.21.15.112:0/2540277912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6ac0b5850 0x7fd6ac1f4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:07.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.683+0000 7fd6b0e00640 1 -- 172.21.15.112:0/2540277912 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6ac071ff0 msgr2=0x7fd6ac0c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:07.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.683+0000 7fd6b0e00640 1 --2- 172.21.15.112:0/2540277912 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6ac071ff0 0x7fd6ac0c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:07.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.683+0000 7fd6b0e00640 1 -- 172.21.15.112:0/2540277912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6ac0b5850 msgr2=0x7fd6ac1f4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:07.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.683+0000 7fd6b0e00640 1 --2- 172.21.15.112:0/2540277912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6ac0b5850 0x7fd6ac1f4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:07.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.683+0000 7fd6b0e00640 1 -- 172.21.15.112:0/2540277912 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6ac1f5480 con 0x7fd6ac06e050 2024-09-12T02:51:07.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.683+0000 7fd6b0e00640 1 --2- 172.21.15.112:0/2540277912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6ac06e050 0x7fd6ac1f22f0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00bc20 tx=0x7fd69c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:07.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.683+0000 7fd6a9600640 1 -- 172.21.15.112:0/2540277912 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c03a070 con 0x7fd6ac06e050 2024-09-12T02:51:07.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.684+0000 7fd6a9600640 1 -- 172.21.15.112:0/2540277912 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd69c035820 con 0x7fd6ac06e050 2024-09-12T02:51:07.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.684+0000 7fd6a9600640 1 -- 172.21.15.112:0/2540277912 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c035c10 con 0x7fd6ac06e050 2024-09-12T02:51:07.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.684+0000 7fd6b3800640 1 -- 172.21.15.112:0/2540277912 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6ac1f5760 con 0x7fd6ac06e050 2024-09-12T02:51:07.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.684+0000 7fd6b3800640 1 -- 172.21.15.112:0/2540277912 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6ac15cb30 con 0x7fd6ac06e050 2024-09-12T02:51:07.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.685+0000 7fd6b3800640 1 -- 172.21.15.112:0/2540277912 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6ac06d910 con 0x7fd6ac06e050 2024-09-12T02:51:07.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.685+0000 7fd6a9600640 1 -- 172.21.15.112:0/2540277912 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd69c047060 con 0x7fd6ac06e050 2024-09-12T02:51:07.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.686+0000 7fd6a9600640 1 --2- 172.21.15.112:0/2540277912 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd68806be30 0x7fd68806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:07.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.686+0000 7fd6a9600640 1 -- 172.21.15.112:0/2540277912 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5767+0+0 (secure 0 0 0) 0x7fd69c0aaf50 con 0x7fd6ac06e050 2024-09-12T02:51:07.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.686+0000 7fd6a9600640 1 -- 172.21.15.112:0/2540277912 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=155}) -- 0x7fd688073a20 con 0x7fd6ac06e050 2024-09-12T02:51:07.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.686+0000 7fd6a3e00640 1 --2- 172.21.15.112:0/2540277912 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd68806be30 0x7fd68806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:07.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.687+0000 7fd6a3e00640 1 --2- 172.21.15.112:0/2540277912 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd68806be30 0x7fd68806e2f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac0afb50 tx=0x7fd694009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:07.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.690+0000 7fd6a9600640 1 -- 172.21.15.112:0/2540277912 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd69c0791d0 con 0x7fd6ac06e050 2024-09-12T02:51:07.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.896+0000 7fd6b3800640 1 -- 172.21.15.112:0/2540277912 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6ac0ceb80 con 0x7fd6ac06e050 2024-09-12T02:51:07.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.896+0000 7fd6a9600640 1 -- 172.21.15.112:0/2540277912 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) ==== 94+0+5234 (secure 0 0 0) 0x7fd69c07d4d0 con 0x7fd6ac06e050 2024-09-12T02:51:07.897 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:51:07.897 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":78,"btime":"2024-09-12T02:48:54:420600+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6074,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/984843624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":984843624},{"type":"v1","addr":"172.21.15.112:6836","nonce":984843624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3470369780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3470369780},{"type":"v1","addr":"172.21.15.112:6837","nonce":3470369780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/3190674567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3190674567},{"type":"v1","addr":"172.21.15.137:6834","nonce":3190674567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:48:50.793801+0000","modified":"2024-09-12T02:48:53.825952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7257":{"gid":7257,"name":"b","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/1000067194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1000067194},{"type":"v1","addr":"172.21.15.137:6835","nonce":1000067194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7257,"qdb_cluster":[7257]},"id":9}]} 2024-09-12T02:51:07.898 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 78 2024-09-12T02:51:07.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.898+0000 7fd6b3800640 1 -- 172.21.15.112:0/2540277912 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd68806be30 msgr2=0x7fd68806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:07.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.898+0000 7fd6b3800640 1 --2- 172.21.15.112:0/2540277912 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd68806be30 0x7fd68806e2f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac0afb50 tx=0x7fd694009040 comp rx=0 tx=0).stop 2024-09-12T02:51:07.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.898+0000 7fd6b3800640 1 -- 172.21.15.112:0/2540277912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6ac06e050 msgr2=0x7fd6ac1f22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:07.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.898+0000 7fd6b3800640 1 --2- 172.21.15.112:0/2540277912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6ac06e050 0x7fd6ac1f22f0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00bc20 tx=0x7fd69c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:51:07.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.898+0000 7fd6b3800640 1 -- 172.21.15.112:0/2540277912 shutdown_connections 2024-09-12T02:51:07.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.898+0000 7fd6b3800640 1 --2- 172.21.15.112:0/2540277912 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd68806be30 0x7fd68806e2f0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:07.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.898+0000 7fd6b3800640 1 --2- 172.21.15.112:0/2540277912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6ac0b5850 0x7fd6ac1f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:07.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.898+0000 7fd6b3800640 1 --2- 172.21.15.112:0/2540277912 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd6ac071ff0 0x7fd6ac0c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:07.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.898+0000 7fd6b3800640 1 --2- 172.21.15.112:0/2540277912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6ac06e050 0x7fd6ac1f22f0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:07.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.898+0000 7fd6b3800640 1 -- 172.21.15.112:0/2540277912 >> 172.21.15.112:0/2540277912 conn(0x7fd6ac06bbd0 msgr2=0x7fd6ac0cf380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:07.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.899+0000 7fd6b3800640 1 -- 172.21.15.112:0/2540277912 shutdown_connections 2024-09-12T02:51:07.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:07.899+0000 7fd6b3800640 1 -- 172.21.15.112:0/2540277912 wait complete. 2024-09-12T02:51:07.916 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:51:08.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.066+0000 7fd9c9c00640 1 Processor -- start 2024-09-12T02:51:08.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.066+0000 7fd9c9c00640 1 -- start start 2024-09-12T02:51:08.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.067+0000 7fd9c9c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9c415b9a0 0x7fd9c406d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:08.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.067+0000 7fd9c9c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd9c406f270 0x7fd9c40b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:08.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.068+0000 7fd9c9c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9c40b42c0 con 0x7fd9c40b5560 2024-09-12T02:51:08.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.068+0000 7fd9c9c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd9c406de70 con 0x7fd9c406f270 2024-09-12T02:51:08.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.068+0000 7fd9c9c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd9c406f690 con 0x7fd9c415b9a0 2024-09-12T02:51:08.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.068+0000 7fd9bb400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd9c406f270 0x7fd9c40b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:08.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.068+0000 7fd9c3e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9c415b9a0 0x7fd9c406d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:08.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.068+0000 7fd9bb400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd9c406f270 0x7fd9c40b5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:35248/0 (socket says 172.21.15.112:35248) 2024-09-12T02:51:08.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.068+0000 7fd9bb400640 1 -- 172.21.15.112:0/1857412465 learned_addr learned my addr 172.21.15.112:0/1857412465 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:08.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.068+0000 7fd9c9200640 1 --1- 172.21.15.112:0/1857412465 >> v1:172.21.15.137:6789/0 conn(0x7fd9c40b5560 0x7fd9c40d0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.112:34768/0 (socket says 172.21.15.112:34768) 2024-09-12T02:51:08.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.068+0000 7fd9bb400640 1 -- 172.21.15.112:0/1857412465 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9c415b9a0 msgr2=0x7fd9c406d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:08.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.068+0000 7fd9bb400640 1 --2- 172.21.15.112:0/1857412465 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9c415b9a0 0x7fd9c406d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:08.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.068+0000 7fd9bb400640 1 -- 172.21.15.112:0/1857412465 >> v1:172.21.15.137:6789/0 conn(0x7fd9c40b5560 legacy=0x7fd9c40d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:08.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.068+0000 7fd9bb400640 1 -- 172.21.15.112:0/1857412465 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c415bd80 con 0x7fd9c406f270 2024-09-12T02:51:08.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.069+0000 7fd9bb400640 1 --2- 172.21.15.112:0/1857412465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9c406f270 0x7fd9c40b5020 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac00bb40 tx=0x7fd9ac02c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8af127dd9155196 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:08.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.070+0000 7fd9c3400640 1 -- 172.21.15.112:0/1857412465 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac036020 con 0x7fd9c406f270 2024-09-12T02:51:08.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.070+0000 7fd9c3400640 1 -- 172.21.15.112:0/1857412465 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9ac032810 con 0x7fd9c406f270 2024-09-12T02:51:08.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.070+0000 7fd9c3400640 1 -- 172.21.15.112:0/1857412465 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac032be0 con 0x7fd9c406f270 2024-09-12T02:51:08.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.070+0000 7fd9c9c00640 1 -- 172.21.15.112:0/1857412465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9c406f270 msgr2=0x7fd9c40b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:08.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.070+0000 7fd9c9c00640 1 --2- 172.21.15.112:0/1857412465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9c406f270 0x7fd9c40b5020 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac00bb40 tx=0x7fd9ac02c950 comp rx=0 tx=0).stop 2024-09-12T02:51:08.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.070+0000 7fd9c9c00640 1 -- 172.21.15.112:0/1857412465 shutdown_connections 2024-09-12T02:51:08.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.070+0000 7fd9c9c00640 1 --2- 172.21.15.112:0/1857412465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9c406f270 0x7fd9c40b5020 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:08.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.070+0000 7fd9c9c00640 1 --2- 172.21.15.112:0/1857412465 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9c415b9a0 0x7fd9c406d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:08.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.070+0000 7fd9c9c00640 1 -- 172.21.15.112:0/1857412465 >> 172.21.15.112:0/1857412465 conn(0x7fd9c406bbd0 msgr2=0x7fd9c406bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:08.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.070+0000 7fd9c9c00640 1 -- 172.21.15.112:0/1857412465 shutdown_connections 2024-09-12T02:51:08.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.071+0000 7fd9c9c00640 1 -- 172.21.15.112:0/1857412465 wait complete. 2024-09-12T02:51:08.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.072+0000 7fd9c9c00640 1 Processor -- start 2024-09-12T02:51:08.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.072+0000 7fd9c9c00640 1 -- start start 2024-09-12T02:51:08.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.073+0000 7fd9c9c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9c406f270 0x7fd9c4155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:08.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.073+0000 7fd9c9c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9c415b9a0 0x7fd9c41507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:08.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.073+0000 7fd9c9c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9c415cd40 0x7fd9c4154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:08.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.073+0000 7fd9c9c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c40b4b00 con 0x7fd9c406f270 2024-09-12T02:51:08.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.073+0000 7fd9c9c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c40b4820 con 0x7fd9c415cd40 2024-09-12T02:51:08.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.073+0000 7fd9c9c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd9c40b5b50 con 0x7fd9c415b9a0 2024-09-12T02:51:08.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.073+0000 7fd9c3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9c406f270 0x7fd9c4155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:08.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.073+0000 7fd9c3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9c406f270 0x7fd9c4155730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42740/0 (socket says 172.21.15.112:42740) 2024-09-12T02:51:08.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.073+0000 7fd9c3e00640 1 -- 172.21.15.112:0/2764604458 learned_addr learned my addr 172.21.15.112:0/2764604458 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:08.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.073+0000 7fd9bb400640 1 --2- 172.21.15.112:0/2764604458 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9c415b9a0 0x7fd9c41507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:08.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.073+0000 7fd9c9200640 1 --2- 172.21.15.112:0/2764604458 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9c415cd40 0x7fd9c4154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:08.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.074+0000 7fd9c3e00640 1 -- 172.21.15.112:0/2764604458 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9c415b9a0 msgr2=0x7fd9c41507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:08.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.074+0000 7fd9c3e00640 1 --2- 172.21.15.112:0/2764604458 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9c415b9a0 0x7fd9c41507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:08.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.074+0000 7fd9c3e00640 1 -- 172.21.15.112:0/2764604458 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9c415cd40 msgr2=0x7fd9c4154390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:08.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.074+0000 7fd9c3e00640 1 --2- 172.21.15.112:0/2764604458 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9c415cd40 0x7fd9c4154390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:08.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.074+0000 7fd9c3e00640 1 -- 172.21.15.112:0/2764604458 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c4155f60 con 0x7fd9c406f270 2024-09-12T02:51:08.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.074+0000 7fd9c9200640 1 --2- 172.21.15.112:0/2764604458 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9c415cd40 0x7fd9c4154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:51:08.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.074+0000 7fd9c3e00640 1 --2- 172.21.15.112:0/2764604458 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9c406f270 0x7fd9c4155730 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fd9b400e870 tx=0x7fd9b400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:08.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.074+0000 7fd9c0c00640 1 -- 172.21.15.112:0/2764604458 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4017070 con 0x7fd9c406f270 2024-09-12T02:51:08.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.074+0000 7fd9c0c00640 1 -- 172.21.15.112:0/2764604458 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9b400c940 con 0x7fd9c406f270 2024-09-12T02:51:08.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.074+0000 7fd9c0c00640 1 -- 172.21.15.112:0/2764604458 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b400cd30 con 0x7fd9c406f270 2024-09-12T02:51:08.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.074+0000 7fd9c9c00640 1 -- 172.21.15.112:0/2764604458 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9c4156240 con 0x7fd9c406f270 2024-09-12T02:51:08.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.075+0000 7fd9c9c00640 1 -- 172.21.15.112:0/2764604458 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9c4156800 con 0x7fd9c406f270 2024-09-12T02:51:08.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.075+0000 7fd9c9c00640 1 -- 172.21.15.112:0/2764604458 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9c40b5020 con 0x7fd9c406f270 2024-09-12T02:51:08.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.076+0000 7fd9c0c00640 1 -- 172.21.15.112:0/2764604458 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd9b401a070 con 0x7fd9c406f270 2024-09-12T02:51:08.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.077+0000 7fd9c0c00640 1 --2- 172.21.15.112:0/2764604458 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd9a006be30 0x7fd9a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:08.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.077+0000 7fd9c0c00640 1 -- 172.21.15.112:0/2764604458 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5767+0+0 (secure 0 0 0) 0x7fd9b408b070 con 0x7fd9c406f270 2024-09-12T02:51:08.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.077+0000 7fd9bb400640 1 --2- 172.21.15.112:0/2764604458 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd9a006be30 0x7fd9a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:08.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.078+0000 7fd9c0c00640 1 -- 172.21.15.112:0/2764604458 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=155}) -- 0x7fd9a0073a20 con 0x7fd9c406f270 2024-09-12T02:51:08.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.078+0000 7fd9bb400640 1 --2- 172.21.15.112:0/2764604458 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd9a006be30 0x7fd9a006e2f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac037000 tx=0x7fd9ac03d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:08.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.081+0000 7fd9c0c00640 1 -- 172.21.15.112:0/2764604458 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd9b4059380 con 0x7fd9c406f270 2024-09-12T02:51:08.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.293+0000 7fd9c9c00640 1 -- 172.21.15.112:0/2764604458 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9c406e890 con 0x7fd9c406f270 2024-09-12T02:51:08.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.294+0000 7fd9c0c00640 1 -- 172.21.15.112:0/2764604458 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) ==== 94+0+5234 (secure 0 0 0) 0x7fd9b405d680 con 0x7fd9c406f270 2024-09-12T02:51:08.295 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:51:08.295 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":78,"btime":"2024-09-12T02:48:54:420600+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6074,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/984843624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":984843624},{"type":"v1","addr":"172.21.15.112:6836","nonce":984843624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3470369780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3470369780},{"type":"v1","addr":"172.21.15.112:6837","nonce":3470369780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/3190674567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3190674567},{"type":"v1","addr":"172.21.15.137:6834","nonce":3190674567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:48:50.793801+0000","modified":"2024-09-12T02:48:53.825952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7257":{"gid":7257,"name":"b","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/1000067194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1000067194},{"type":"v1","addr":"172.21.15.137:6835","nonce":1000067194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7257,"qdb_cluster":[7257]},"id":9}]} 2024-09-12T02:51:08.295 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 78 2024-09-12T02:51:08.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.296+0000 7fd9c9c00640 1 -- 172.21.15.112:0/2764604458 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd9a006be30 msgr2=0x7fd9a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:08.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.296+0000 7fd9c9c00640 1 --2- 172.21.15.112:0/2764604458 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd9a006be30 0x7fd9a006e2f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac037000 tx=0x7fd9ac03d040 comp rx=0 tx=0).stop 2024-09-12T02:51:08.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.296+0000 7fd9c9c00640 1 -- 172.21.15.112:0/2764604458 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9c406f270 msgr2=0x7fd9c4155730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:08.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.296+0000 7fd9c9c00640 1 --2- 172.21.15.112:0/2764604458 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9c406f270 0x7fd9c4155730 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fd9b400e870 tx=0x7fd9b400ed30 comp rx=0 tx=0).stop 2024-09-12T02:51:08.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.297+0000 7fd9c9c00640 1 -- 172.21.15.112:0/2764604458 shutdown_connections 2024-09-12T02:51:08.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.297+0000 7fd9c9c00640 1 --2- 172.21.15.112:0/2764604458 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd9a006be30 0x7fd9a006e2f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:08.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.297+0000 7fd9c9c00640 1 --2- 172.21.15.112:0/2764604458 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9c415cd40 0x7fd9c4154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:08.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.297+0000 7fd9c9c00640 1 --2- 172.21.15.112:0/2764604458 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9c415b9a0 0x7fd9c41507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:08.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.297+0000 7fd9c9c00640 1 --2- 172.21.15.112:0/2764604458 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9c406f270 0x7fd9c4155730 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:08.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.297+0000 7fd9c9c00640 1 -- 172.21.15.112:0/2764604458 >> 172.21.15.112:0/2764604458 conn(0x7fd9c406bbd0 msgr2=0x7fd9c40ce400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:08.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.297+0000 7fd9c9c00640 1 -- 172.21.15.112:0/2764604458 shutdown_connections 2024-09-12T02:51:08.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.297+0000 7fd9c9c00640 1 -- 172.21.15.112:0/2764604458 wait complete. 2024-09-12T02:51:08.313 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:51:08.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.464+0000 7f08b3800640 1 Processor -- start 2024-09-12T02:51:08.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.464+0000 7f08b3800640 1 -- start start 2024-09-12T02:51:08.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.465+0000 7f08b3800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f08ac15b9d0 0x7f08ac0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:08.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.465+0000 7f08b3800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f08ac06f600 0x7f08ac0728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:08.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.465+0000 7f08b3800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08ac0b54a0 con 0x7f08ac0b45d0 2024-09-12T02:51:08.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.465+0000 7f08b3800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f08ac0b4a60 con 0x7f08ac15b9d0 2024-09-12T02:51:08.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.465+0000 7f08b3800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f08ac0b3af0 con 0x7f08ac06f600 2024-09-12T02:51:08.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.466+0000 7f08b0e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f08ac15b9d0 0x7f08ac0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:08.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.466+0000 7f08b0e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f08ac15b9d0 0x7f08ac0b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42754/0 (socket says 172.21.15.112:42754) 2024-09-12T02:51:08.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.466+0000 7f08b0e00640 1 -- 172.21.15.112:0/3261493870 learned_addr learned my addr 172.21.15.112:0/3261493870 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:08.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.466+0000 7f08b1800640 1 --2- 172.21.15.112:0/3261493870 >> v2:172.21.15.137:3300/0 conn(0x7f08ac06f600 0x7f08ac0728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:08.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.466+0000 7f08b0e00640 1 -- 172.21.15.112:0/3261493870 >> v2:172.21.15.137:3300/0 conn(0x7f08ac06f600 msgr2=0x7f08ac0728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:08.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.466+0000 7f08b0e00640 1 --2- 172.21.15.112:0/3261493870 >> v2:172.21.15.137:3300/0 conn(0x7f08ac06f600 0x7f08ac0728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:08.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.466+0000 7f08b0e00640 1 -- 172.21.15.112:0/3261493870 >> v1:172.21.15.137:6789/0 conn(0x7f08ac0b45d0 legacy=0x7f08ac06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:08.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.466+0000 7f08b0e00640 1 -- 172.21.15.112:0/3261493870 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08ac0b3dd0 con 0x7f08ac15b9d0 2024-09-12T02:51:08.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.467+0000 7f08b0e00640 1 --2- 172.21.15.112:0/3261493870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08ac15b9d0 0x7f08ac0b4ec0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f08ac072f80 tx=0x7f089c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c8f9e979facb36c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:08.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.468+0000 7f08abe00640 1 -- 172.21.15.112:0/3261493870 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c037070 con 0x7f08ac15b9d0 2024-09-12T02:51:08.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.468+0000 7f08abe00640 1 -- 172.21.15.112:0/3261493870 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f089c032440 con 0x7f08ac15b9d0 2024-09-12T02:51:08.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.468+0000 7f08abe00640 1 -- 172.21.15.112:0/3261493870 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c032810 con 0x7f08ac15b9d0 2024-09-12T02:51:08.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.468+0000 7f08b3800640 1 -- 172.21.15.112:0/3261493870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08ac15b9d0 msgr2=0x7f08ac0b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:08.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.468+0000 7f08b3800640 1 --2- 172.21.15.112:0/3261493870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08ac15b9d0 0x7f08ac0b4ec0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f08ac072f80 tx=0x7f089c02a1a0 comp rx=0 tx=0).stop 2024-09-12T02:51:08.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.468+0000 7f08b3800640 1 -- 172.21.15.112:0/3261493870 shutdown_connections 2024-09-12T02:51:08.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.468+0000 7f08b3800640 1 --2- 172.21.15.112:0/3261493870 >> v2:172.21.15.137:3300/0 conn(0x7f08ac06f600 0x7f08ac0728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:08.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.468+0000 7f08b3800640 1 --2- 172.21.15.112:0/3261493870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08ac15b9d0 0x7f08ac0b4ec0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:08.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.468+0000 7f08b3800640 1 -- 172.21.15.112:0/3261493870 >> 172.21.15.112:0/3261493870 conn(0x7f08ac06bbd0 msgr2=0x7f08ac06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:08.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.468+0000 7f08b3800640 1 -- 172.21.15.112:0/3261493870 shutdown_connections 2024-09-12T02:51:08.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.468+0000 7f08b3800640 1 -- 172.21.15.112:0/3261493870 wait complete. 2024-09-12T02:51:08.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.470+0000 7f08b3800640 1 Processor -- start 2024-09-12T02:51:08.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.470+0000 7f08b3800640 1 -- start start 2024-09-12T02:51:08.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.471+0000 7f08b3800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08ac06f600 0x7f08ac15e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:08.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.471+0000 7f08b3800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08ac0b45d0 0x7f08ac15eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:08.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.471+0000 7f08b3800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08ac15b9d0 0x7f08ac151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:08.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.471+0000 7f08b3800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f08ac15bf30 con 0x7f08ac06f600 2024-09-12T02:51:08.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.471+0000 7f08b3800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f08ac15bdb0 con 0x7f08ac0b45d0 2024-09-12T02:51:08.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.471+0000 7f08b3800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f08ac0cdcd0 con 0x7f08ac15b9d0 2024-09-12T02:51:08.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.471+0000 7f08b0e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08ac06f600 0x7f08ac15e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:08.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.471+0000 7f08b0e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08ac06f600 0x7f08ac15e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42756/0 (socket says 172.21.15.112:42756) 2024-09-12T02:51:08.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.471+0000 7f08b0e00640 1 -- 172.21.15.112:0/3779616649 learned_addr learned my addr 172.21.15.112:0/3779616649 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:08.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.472+0000 7f08a3e00640 1 --2- 172.21.15.112:0/3779616649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08ac0b45d0 0x7f08ac15eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:08.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.472+0000 7f08b1800640 1 --2- 172.21.15.112:0/3779616649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08ac15b9d0 0x7f08ac151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:08.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.472+0000 7f08b0e00640 1 -- 172.21.15.112:0/3779616649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08ac15b9d0 msgr2=0x7f08ac151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:08.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.472+0000 7f08b0e00640 1 --2- 172.21.15.112:0/3779616649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08ac15b9d0 0x7f08ac151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:08.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.472+0000 7f08b0e00640 1 -- 172.21.15.112:0/3779616649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08ac0b45d0 msgr2=0x7f08ac15eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:08.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.472+0000 7f08b0e00640 1 --2- 172.21.15.112:0/3779616649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08ac0b45d0 0x7f08ac15eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:08.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.472+0000 7f08b0e00640 1 -- 172.21.15.112:0/3779616649 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08ac1509b0 con 0x7f08ac06f600 2024-09-12T02:51:08.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.472+0000 7f08b0e00640 1 --2- 172.21.15.112:0/3779616649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08ac06f600 0x7f08ac15e5f0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f089c000c00 tx=0x7f089c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:08.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.472+0000 7f08a9600640 1 -- 172.21.15.112:0/3779616649 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c041020 con 0x7f08ac06f600 2024-09-12T02:51:08.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.472+0000 7f08a9600640 1 -- 172.21.15.112:0/3779616649 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f089c0306c0 con 0x7f08ac06f600 2024-09-12T02:51:08.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.472+0000 7f08a9600640 1 -- 172.21.15.112:0/3779616649 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c037040 con 0x7f08ac06f600 2024-09-12T02:51:08.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.472+0000 7f08b3800640 1 -- 172.21.15.112:0/3779616649 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08ac150c90 con 0x7f08ac06f600 2024-09-12T02:51:08.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.472+0000 7f08b3800640 1 -- 172.21.15.112:0/3779616649 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08ac151250 con 0x7f08ac06f600 2024-09-12T02:51:08.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.473+0000 7f08b3800640 1 -- 172.21.15.112:0/3779616649 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08ac068a30 con 0x7f08ac06f600 2024-09-12T02:51:08.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.474+0000 7f08a9600640 1 -- 172.21.15.112:0/3779616649 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f089c044020 con 0x7f08ac06f600 2024-09-12T02:51:08.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.476+0000 7f08a9600640 1 --2- 172.21.15.112:0/3779616649 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f088806be30 0x7f088806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:08.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.476+0000 7f08a9600640 1 -- 172.21.15.112:0/3779616649 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5767+0+0 (secure 0 0 0) 0x7f089c0ab780 con 0x7f08ac06f600 2024-09-12T02:51:08.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.476+0000 7f08a3e00640 1 --2- 172.21.15.112:0/3779616649 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f088806be30 0x7f088806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:08.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.476+0000 7f08a9600640 1 -- 172.21.15.112:0/3779616649 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=155}) -- 0x7f0888073a20 con 0x7f08ac06f600 2024-09-12T02:51:08.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.476+0000 7f08a3e00640 1 --2- 172.21.15.112:0/3779616649 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f088806be30 0x7f088806e2f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f08ac1517b0 tx=0x7f0894009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:08.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.480+0000 7f08a9600640 1 -- 172.21.15.112:0/3779616649 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f089c04b030 con 0x7f08ac06f600 2024-09-12T02:51:08.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.652+0000 7f08b3800640 1 -- 172.21.15.112:0/3779616649 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f08ac06dbc0 con 0x7f08ac06f600 2024-09-12T02:51:08.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.653+0000 7f08a9600640 1 -- 172.21.15.112:0/3779616649 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) ==== 74+0+16911 (secure 0 0 0) 0x7f089c07a050 con 0x7f08ac06f600 2024-09-12T02:51:08.654 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:51:08.655 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":154,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:50:26.032322+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:48:48.563948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-12T02:48:49.789395+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.3","mappings":[{"from":2,"to":0}]},{"pgid":"19.1f","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:51:08.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.655+0000 7f08b3800640 1 -- 172.21.15.112:0/3779616649 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f088806be30 msgr2=0x7f088806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:08.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.655+0000 7f08b3800640 1 --2- 172.21.15.112:0/3779616649 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f088806be30 0x7f088806e2f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f08ac1517b0 tx=0x7f0894009040 comp rx=0 tx=0).stop 2024-09-12T02:51:08.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.655+0000 7f08b3800640 1 -- 172.21.15.112:0/3779616649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08ac06f600 msgr2=0x7f08ac15e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:08.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.655+0000 7f08b3800640 1 --2- 172.21.15.112:0/3779616649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08ac06f600 0x7f08ac15e5f0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f089c000c00 tx=0x7f089c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:51:08.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.656+0000 7f08b3800640 1 -- 172.21.15.112:0/3779616649 shutdown_connections 2024-09-12T02:51:08.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.656+0000 7f08b3800640 1 --2- 172.21.15.112:0/3779616649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08ac15b9d0 0x7f08ac151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:08.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.656+0000 7f08b3800640 1 --2- 172.21.15.112:0/3779616649 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f088806be30 0x7f088806e2f0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:08.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.656+0000 7f08b3800640 1 --2- 172.21.15.112:0/3779616649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08ac0b45d0 0x7f08ac15eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:08.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.656+0000 7f08b3800640 1 --2- 172.21.15.112:0/3779616649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08ac06f600 0x7f08ac15e5f0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:08.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.656+0000 7f08b3800640 1 -- 172.21.15.112:0/3779616649 >> 172.21.15.112:0/3779616649 conn(0x7f08ac06bbd0 msgr2=0x7f08ac15f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:08.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.656+0000 7f08b3800640 1 -- 172.21.15.112:0/3779616649 shutdown_connections 2024-09-12T02:51:08.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.656+0000 7f08b3800640 1 -- 172.21.15.112:0/3779616649 wait complete. 2024-09-12T02:51:08.673 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:51:08.673 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:51:08.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.825+0000 7fa779c00640 1 Processor -- start 2024-09-12T02:51:08.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.826+0000 7fa779c00640 1 -- start start 2024-09-12T02:51:08.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.827+0000 7fa779c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa77415cc50 0x7fa7740732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:08.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.827+0000 7fa779c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa7740afe30 0x7fa7740cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:08.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.827+0000 7fa779c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa774073830 con 0x7fa774071530 2024-09-12T02:51:08.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.827+0000 7fa779c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa77415d030 con 0x7fa77415cc50 2024-09-12T02:51:08.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.827+0000 7fa779c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa7740cf4c0 con 0x7fa7740afe30 2024-09-12T02:51:08.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.827+0000 7fa772a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa77415cc50 0x7fa7740732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:08.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.827+0000 7fa772a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa77415cc50 0x7fa7740732f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42770/0 (socket says 172.21.15.112:42770) 2024-09-12T02:51:08.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.827+0000 7fa772a00640 1 -- 172.21.15.112:0/2727275078 learned_addr learned my addr 172.21.15.112:0/2727275078 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:08.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.827+0000 7fa773400640 1 --2- 172.21.15.112:0/2727275078 >> v2:172.21.15.137:3300/0 conn(0x7fa7740afe30 0x7fa7740cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:08.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.827+0000 7fa772a00640 1 -- 172.21.15.112:0/2727275078 >> v2:172.21.15.137:3300/0 conn(0x7fa7740afe30 msgr2=0x7fa7740cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:08.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.827+0000 7fa772a00640 1 --2- 172.21.15.112:0/2727275078 >> v2:172.21.15.137:3300/0 conn(0x7fa7740afe30 0x7fa7740cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:08.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.827+0000 7fa772a00640 1 -- 172.21.15.112:0/2727275078 >> v1:172.21.15.137:6789/0 conn(0x7fa774071530 legacy=0x7fa7740af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:08.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.827+0000 7fa772a00640 1 -- 172.21.15.112:0/2727275078 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7740ceeb0 con 0x7fa77415cc50 2024-09-12T02:51:08.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.827+0000 7fa773400640 1 --2- 172.21.15.112:0/2727275078 >> v2:172.21.15.137:3300/0 conn(0x7fa7740afe30 0x7fa7740cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:51:08.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.828+0000 7fa772a00640 1 --2- 172.21.15.112:0/2727275078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa77415cc50 0x7fa7740732f0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fa77406ffd0 tx=0x7fa76402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a9c7369a049ac20 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:08.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.829+0000 7fa772000640 1 -- 172.21.15.112:0/2727275078 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa764037070 con 0x7fa77415cc50 2024-09-12T02:51:08.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.829+0000 7fa772000640 1 -- 172.21.15.112:0/2727275078 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa764032440 con 0x7fa77415cc50 2024-09-12T02:51:08.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.829+0000 7fa772000640 1 -- 172.21.15.112:0/2727275078 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa764032810 con 0x7fa77415cc50 2024-09-12T02:51:08.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.829+0000 7fa779c00640 1 -- 172.21.15.112:0/2727275078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa77415cc50 msgr2=0x7fa7740732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:08.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.829+0000 7fa779c00640 1 --2- 172.21.15.112:0/2727275078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa77415cc50 0x7fa7740732f0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fa77406ffd0 tx=0x7fa76402a1a0 comp rx=0 tx=0).stop 2024-09-12T02:51:08.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.829+0000 7fa779c00640 1 -- 172.21.15.112:0/2727275078 shutdown_connections 2024-09-12T02:51:08.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.829+0000 7fa779c00640 1 --2- 172.21.15.112:0/2727275078 >> v2:172.21.15.137:3300/0 conn(0x7fa7740afe30 0x7fa7740cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:08.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.829+0000 7fa779c00640 1 --2- 172.21.15.112:0/2727275078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa77415cc50 0x7fa7740732f0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:08.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.829+0000 7fa779c00640 1 -- 172.21.15.112:0/2727275078 >> 172.21.15.112:0/2727275078 conn(0x7fa77406bbd0 msgr2=0x7fa77406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:08.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.829+0000 7fa779c00640 1 -- 172.21.15.112:0/2727275078 shutdown_connections 2024-09-12T02:51:08.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.829+0000 7fa779c00640 1 -- 172.21.15.112:0/2727275078 wait complete. 2024-09-12T02:51:08.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.831+0000 7fa779c00640 1 Processor -- start 2024-09-12T02:51:08.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.831+0000 7fa779c00640 1 -- start start 2024-09-12T02:51:08.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.832+0000 7fa779c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa774071530 0x7fa77414e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:08.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.832+0000 7fa779c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7740afe30 0x7fa774154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:08.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.832+0000 7fa779c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa77415cc50 0x7fa77415b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:08.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.832+0000 7fa779c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa7740cf150 con 0x7fa7740afe30 2024-09-12T02:51:08.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.832+0000 7fa779c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa77406e5e0 con 0x7fa774071530 2024-09-12T02:51:08.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.832+0000 7fa779c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa77406f510 con 0x7fa77415cc50 2024-09-12T02:51:08.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.832+0000 7fa76a000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7740afe30 0x7fa774154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:08.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.832+0000 7fa76a000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7740afe30 0x7fa774154af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42786/0 (socket says 172.21.15.112:42786) 2024-09-12T02:51:08.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.832+0000 7fa76a000640 1 -- 172.21.15.112:0/3206284234 learned_addr learned my addr 172.21.15.112:0/3206284234 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:08.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.833+0000 7fa773400640 1 --2- 172.21.15.112:0/3206284234 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa77415cc50 0x7fa77415b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:08.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.833+0000 7fa772a00640 1 --2- 172.21.15.112:0/3206284234 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa774071530 0x7fa77414e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:08.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.833+0000 7fa76a000640 1 -- 172.21.15.112:0/3206284234 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa77415cc50 msgr2=0x7fa77415b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:08.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.833+0000 7fa76a000640 1 --2- 172.21.15.112:0/3206284234 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa77415cc50 0x7fa77415b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:08.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.833+0000 7fa76a000640 1 -- 172.21.15.112:0/3206284234 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa774071530 msgr2=0x7fa77414e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:08.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.833+0000 7fa76a000640 1 --2- 172.21.15.112:0/3206284234 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa774071530 0x7fa77414e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:08.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.833+0000 7fa76a000640 1 -- 172.21.15.112:0/3206284234 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa77414eaf0 con 0x7fa7740afe30 2024-09-12T02:51:08.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.833+0000 7fa772a00640 1 --2- 172.21.15.112:0/3206284234 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa774071530 0x7fa77414e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:51:08.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.833+0000 7fa76a000640 1 --2- 172.21.15.112:0/3206284234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7740afe30 0x7fa774154af0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00c450 tx=0x7fa75c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:08.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.833+0000 7fa76b400640 1 -- 172.21.15.112:0/3206284234 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c011790 con 0x7fa7740afe30 2024-09-12T02:51:08.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.833+0000 7fa76b400640 1 -- 172.21.15.112:0/3206284234 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa75c017070 con 0x7fa7740afe30 2024-09-12T02:51:08.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.833+0000 7fa76b400640 1 -- 172.21.15.112:0/3206284234 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c011b70 con 0x7fa7740afe30 2024-09-12T02:51:08.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.833+0000 7fa779c00640 1 -- 172.21.15.112:0/3206284234 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7741554f0 con 0x7fa7740afe30 2024-09-12T02:51:08.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.834+0000 7fa779c00640 1 -- 172.21.15.112:0/3206284234 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7741f88d0 con 0x7fa7740afe30 2024-09-12T02:51:08.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.835+0000 7fa779c00640 1 -- 172.21.15.112:0/3206284234 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa77406df60 con 0x7fa7740afe30 2024-09-12T02:51:08.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.836+0000 7fa76b400640 1 -- 172.21.15.112:0/3206284234 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa75c011d10 con 0x7fa7740afe30 2024-09-12T02:51:08.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.837+0000 7fa76b400640 1 --2- 172.21.15.112:0/3206284234 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa75006be30 0x7fa75006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:08.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.837+0000 7fa76b400640 1 -- 172.21.15.112:0/3206284234 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5767+0+0 (secure 0 0 0) 0x7fa75c08aae0 con 0x7fa7740afe30 2024-09-12T02:51:08.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.837+0000 7fa772a00640 1 --2- 172.21.15.112:0/3206284234 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa75006be30 0x7fa75006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:08.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.837+0000 7fa76b400640 1 -- 172.21.15.112:0/3206284234 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=155}) -- 0x7fa750073a20 con 0x7fa7740afe30 2024-09-12T02:51:08.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.838+0000 7fa772a00640 1 --2- 172.21.15.112:0/3206284234 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa75006be30 0x7fa75006e2f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa764034000 tx=0x7fa76402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:08.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:08.841+0000 7fa76b400640 1 -- 172.21.15.112:0/3206284234 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa77414eaf0 con 0x7fa7740afe30 2024-09-12T02:51:09.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.048+0000 7fa779c00640 1 -- 172.21.15.112:0/3206284234 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7740b13f0 con 0x7fa7740afe30 2024-09-12T02:51:09.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.048+0000 7fa76b400640 1 -- 172.21.15.112:0/3206284234 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) ==== 94+0+5234 (secure 0 0 0) 0x7fa75c0593b0 con 0x7fa7740afe30 2024-09-12T02:51:09.049 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:51:09.050 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":78,"btime":"2024-09-12T02:48:54:420600+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6074,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/984843624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":984843624},{"type":"v1","addr":"172.21.15.112:6836","nonce":984843624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3470369780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3470369780},{"type":"v1","addr":"172.21.15.112:6837","nonce":3470369780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/3190674567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3190674567},{"type":"v1","addr":"172.21.15.137:6834","nonce":3190674567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:48:50.793801+0000","modified":"2024-09-12T02:48:53.825952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7257":{"gid":7257,"name":"b","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/1000067194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1000067194},{"type":"v1","addr":"172.21.15.137:6835","nonce":1000067194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7257,"qdb_cluster":[7257]},"id":9}]} 2024-09-12T02:51:09.050 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 78 2024-09-12T02:51:09.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.050+0000 7fa779c00640 1 -- 172.21.15.112:0/3206284234 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa75006be30 msgr2=0x7fa75006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:09.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.050+0000 7fa779c00640 1 --2- 172.21.15.112:0/3206284234 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa75006be30 0x7fa75006e2f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa764034000 tx=0x7fa76402e000 comp rx=0 tx=0).stop 2024-09-12T02:51:09.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.050+0000 7fa779c00640 1 -- 172.21.15.112:0/3206284234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7740afe30 msgr2=0x7fa774154af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:09.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.050+0000 7fa779c00640 1 --2- 172.21.15.112:0/3206284234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7740afe30 0x7fa774154af0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00c450 tx=0x7fa75c00c910 comp rx=0 tx=0).stop 2024-09-12T02:51:09.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.050+0000 7fa779c00640 1 -- 172.21.15.112:0/3206284234 shutdown_connections 2024-09-12T02:51:09.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.050+0000 7fa779c00640 1 --2- 172.21.15.112:0/3206284234 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa77415cc50 0x7fa77415b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.050+0000 7fa779c00640 1 --2- 172.21.15.112:0/3206284234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7740afe30 0x7fa774154af0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.050+0000 7fa779c00640 1 --2- 172.21.15.112:0/3206284234 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa75006be30 0x7fa75006e2f0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.050+0000 7fa779c00640 1 --2- 172.21.15.112:0/3206284234 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa774071530 0x7fa77414e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.050+0000 7fa779c00640 1 -- 172.21.15.112:0/3206284234 >> 172.21.15.112:0/3206284234 conn(0x7fa77406bbd0 msgr2=0x7fa7740b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:09.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.050+0000 7fa779c00640 1 -- 172.21.15.112:0/3206284234 shutdown_connections 2024-09-12T02:51:09.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.051+0000 7fa779c00640 1 -- 172.21.15.112:0/3206284234 wait complete. 2024-09-12T02:51:09.067 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:51:09.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.217+0000 7f80e7e00640 1 Processor -- start 2024-09-12T02:51:09.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.217+0000 7f80e7e00640 1 -- start start 2024-09-12T02:51:09.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.218+0000 7f80e7e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f80e80d28d0 0x7f80e80b2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.218+0000 7f80e7e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80e80d2fb0 con 0x7f80e80b3e00 2024-09-12T02:51:09.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.218+0000 7f80e7e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80e80d0b60 con 0x7f80e80d1710 2024-09-12T02:51:09.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.218+0000 7f80e7e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f80e80d3cb0 con 0x7f80e80d28d0 2024-09-12T02:51:09.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.218+0000 7f80dfe00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f80e80b3e00 0x7f80e80b1d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38056/0 (socket says 172.21.15.112:38056) 2024-09-12T02:51:09.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.218+0000 7f80dfe00640 1 -- 172.21.15.112:0/324844708 learned_addr learned my addr 172.21.15.112:0/324844708 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:51:09.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.219+0000 7f80e7400640 1 --2- 172.21.15.112:0/324844708 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f80e80d28d0 0x7f80e80b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.219+0000 7f80e6000640 1 -- 172.21.15.112:0/324844708 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 907811506 0 0) 0x7f80e80d2fb0 con 0x7f80e80b3e00 2024-09-12T02:51:09.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.219+0000 7f80e6000640 1 -- 172.21.15.112:0/324844708 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80cc003520 con 0x7f80e80b3e00 2024-09-12T02:51:09.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.219+0000 7f80e6000640 1 -- 172.21.15.112:0/324844708 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1131879548 0 0) 0x7f80e80d0b60 con 0x7f80e80d1710 2024-09-12T02:51:09.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.219+0000 7f80e6000640 1 -- 172.21.15.112:0/324844708 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80e80d2fb0 con 0x7f80e80d1710 2024-09-12T02:51:09.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.219+0000 7f80e6000640 1 -- 172.21.15.112:0/324844708 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 200411910 0 0) 0x7f80cc003520 con 0x7f80e80b3e00 2024-09-12T02:51:09.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.219+0000 7f80e6000640 1 -- 172.21.15.112:0/324844708 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f80e80d28d0 msgr2=0x7f80e80b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:09.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.219+0000 7f80e6000640 1 --2- 172.21.15.112:0/324844708 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f80e80d28d0 0x7f80e80b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.219+0000 7f80e6000640 1 -- 172.21.15.112:0/324844708 >> v1:172.21.15.137:6789/0 conn(0x7f80e80d1710 legacy=0x7f80e80d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:09.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.219+0000 7f80e6000640 1 -- 172.21.15.112:0/324844708 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e80d3410 con 0x7f80e80b3e00 2024-09-12T02:51:09.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.219+0000 7f80e6000640 1 -- 172.21.15.112:0/324844708 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f80d0001670 con 0x7f80e80b3e00 2024-09-12T02:51:09.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.219+0000 7f80e6000640 1 -- 172.21.15.112:0/324844708 >> v1:172.21.15.112:6789/0 conn(0x7f80e80b3e00 legacy=0x7f80e80b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:09.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.219+0000 7f80e6000640 1 --2- 172.21.15.112:0/324844708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80cc003b70 0x7f80cc003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.219+0000 7f80e6000640 1 --2- 172.21.15.112:0/324844708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80cc004800 0x7f80cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.219+0000 7f80e6000640 1 --2- 172.21.15.112:0/324844708 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f80e80d28d0 0x7f80cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.219+0000 7f80e6000640 1 -- 172.21.15.112:0/324844708 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f80e80d3cb0 con 0x7f80cc004800 2024-09-12T02:51:09.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.219+0000 7f80e6000640 1 -- 172.21.15.112:0/324844708 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f80cc00baa0 con 0x7f80cc003b70 2024-09-12T02:51:09.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.219+0000 7f80e6000640 1 -- 172.21.15.112:0/324844708 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f80cc00bca0 con 0x7f80e80d28d0 2024-09-12T02:51:09.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.219+0000 7f80dfe00640 1 --2- 172.21.15.112:0/324844708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80cc004800 0x7f80cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.220+0000 7f80e6a00640 1 --2- 172.21.15.112:0/324844708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80cc003b70 0x7f80cc003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.220+0000 7f80e7400640 1 --2- 172.21.15.112:0/324844708 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f80e80d28d0 0x7f80cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.220+0000 7f80dfe00640 1 -- 172.21.15.112:0/324844708 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f80e80d28d0 msgr2=0x7f80cc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:09.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.220+0000 7f80dfe00640 1 --2- 172.21.15.112:0/324844708 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f80e80d28d0 0x7f80cc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.220+0000 7f80dfe00640 1 -- 172.21.15.112:0/324844708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80cc003b70 msgr2=0x7f80cc003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:09.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.220+0000 7f80dfe00640 1 --2- 172.21.15.112:0/324844708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80cc003b70 0x7f80cc003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.220+0000 7f80dfe00640 1 -- 172.21.15.112:0/324844708 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80cc003520 con 0x7f80cc004800 2024-09-12T02:51:09.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.221+0000 7f80dfe00640 1 --2- 172.21.15.112:0/324844708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80cc004800 0x7f80cc004c80 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f80d0007fb0 tx=0x7f80cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=755cf1697c6885a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:09.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.221+0000 7f80e6000640 1 -- 172.21.15.112:0/324844708 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d0007c00 con 0x7f80cc004800 2024-09-12T02:51:09.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.221+0000 7f80e6000640 1 -- 172.21.15.112:0/324844708 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80d0005af0 con 0x7f80cc004800 2024-09-12T02:51:09.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.221+0000 7f80e6000640 1 -- 172.21.15.112:0/324844708 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d0007070 con 0x7f80cc004800 2024-09-12T02:51:09.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.222+0000 7f80e7e00640 1 -- 172.21.15.112:0/324844708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80cc004800 msgr2=0x7f80cc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:09.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.222+0000 7f80e7e00640 1 --2- 172.21.15.112:0/324844708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80cc004800 0x7f80cc004c80 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f80d0007fb0 tx=0x7f80cc005830 comp rx=0 tx=0).stop 2024-09-12T02:51:09.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.222+0000 7f80e7400640 1 -- 172.21.15.112:0/324844708 reap_dead start 2024-09-12T02:51:09.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.222+0000 7f80e7e00640 1 -- 172.21.15.112:0/324844708 shutdown_connections 2024-09-12T02:51:09.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.222+0000 7f80e7e00640 1 -- 172.21.15.112:0/324844708 >> 172.21.15.112:0/324844708 conn(0x7f80e809e030 msgr2=0x7f80e80d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:09.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.222+0000 7f80e7e00640 1 -- 172.21.15.112:0/324844708 shutdown_connections 2024-09-12T02:51:09.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.222+0000 7f80e7e00640 1 -- 172.21.15.112:0/324844708 wait complete. 2024-09-12T02:51:09.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.224+0000 7f80e7e00640 1 Processor -- start 2024-09-12T02:51:09.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.224+0000 7f80e7e00640 1 -- start start 2024-09-12T02:51:09.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.225+0000 7f80e7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80cc004800 0x7f80e80b83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.225+0000 7f80e7e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f80e80b9b20 0x7f80e81481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.225+0000 7f80e7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80e8148730 0x7f80e81f7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.225+0000 7f80e7e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f80e80d39d0 con 0x7f80cc004800 2024-09-12T02:51:09.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.225+0000 7f80e7e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f80e80d2d60 con 0x7f80e8148730 2024-09-12T02:51:09.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.225+0000 7f80e7e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f80e815f110 con 0x7f80e80b9b20 2024-09-12T02:51:09.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.225+0000 7f80e6a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80cc004800 0x7f80e80b83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.225+0000 7f80e6a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80cc004800 0x7f80e80b83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42792/0 (socket says 172.21.15.112:42792) 2024-09-12T02:51:09.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.225+0000 7f80e6a00640 1 -- 172.21.15.112:0/3116521875 learned_addr learned my addr 172.21.15.112:0/3116521875 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:09.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.225+0000 7f80e7400640 1 --2- 172.21.15.112:0/3116521875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80e8148730 0x7f80e81f7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.225+0000 7f80dfe00640 1 --2- 172.21.15.112:0/3116521875 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f80e80b9b20 0x7f80e81481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.225+0000 7f80e6a00640 1 -- 172.21.15.112:0/3116521875 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f80e80b9b20 msgr2=0x7f80e81481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:09.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.225+0000 7f80e6a00640 1 --2- 172.21.15.112:0/3116521875 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f80e80b9b20 0x7f80e81481f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.225+0000 7f80e6a00640 1 -- 172.21.15.112:0/3116521875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80e8148730 msgr2=0x7f80e81f7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:09.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.225+0000 7f80e6a00640 1 --2- 172.21.15.112:0/3116521875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80e8148730 0x7f80e81f7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.225+0000 7f80e6a00640 1 -- 172.21.15.112:0/3116521875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e80b8a80 con 0x7f80cc004800 2024-09-12T02:51:09.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.225+0000 7f80e7400640 1 --2- 172.21.15.112:0/3116521875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80e8148730 0x7f80e81f7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:51:09.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.225+0000 7f80dfe00640 1 --2- 172.21.15.112:0/3116521875 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f80e80b9b20 0x7f80e81481f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:51:09.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.225+0000 7f80e6a00640 1 --2- 172.21.15.112:0/3116521875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80cc004800 0x7f80e80b83f0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f80d800f6f0 tx=0x7f80d800fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:09.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.226+0000 7f80dea00640 1 -- 172.21.15.112:0/3116521875 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d801a070 con 0x7f80cc004800 2024-09-12T02:51:09.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.226+0000 7f80dea00640 1 -- 172.21.15.112:0/3116521875 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80d8005110 con 0x7f80cc004800 2024-09-12T02:51:09.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.226+0000 7f80dea00640 1 -- 172.21.15.112:0/3116521875 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d8007050 con 0x7f80cc004800 2024-09-12T02:51:09.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.226+0000 7f80e7e00640 1 -- 172.21.15.112:0/3116521875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80e80b8d60 con 0x7f80cc004800 2024-09-12T02:51:09.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.226+0000 7f80e7e00640 1 -- 172.21.15.112:0/3116521875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80e80b9320 con 0x7f80cc004800 2024-09-12T02:51:09.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.227+0000 7f80e7e00640 1 -- 172.21.15.112:0/3116521875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80e80d1af0 con 0x7f80cc004800 2024-09-12T02:51:09.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.228+0000 7f80dea00640 1 -- 172.21.15.112:0/3116521875 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f80d801d070 con 0x7f80cc004800 2024-09-12T02:51:09.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.229+0000 7f80dea00640 1 --2- 172.21.15.112:0/3116521875 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f80c406be60 0x7f80c406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.229+0000 7f80dea00640 1 -- 172.21.15.112:0/3116521875 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5767+0+0 (secure 0 0 0) 0x7f80d808a820 con 0x7f80cc004800 2024-09-12T02:51:09.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.229+0000 7f80dfe00640 1 --2- 172.21.15.112:0/3116521875 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f80c406be60 0x7f80c406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.229+0000 7f80dea00640 1 -- 172.21.15.112:0/3116521875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=155}) -- 0x7f80c4073a50 con 0x7f80cc004800 2024-09-12T02:51:09.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.230+0000 7f80dfe00640 1 --2- 172.21.15.112:0/3116521875 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f80c406be60 0x7f80c406e320 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f80d0032000 tx=0x7f80d002d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:09.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.233+0000 7f80dea00640 1 -- 172.21.15.112:0/3116521875 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f80d8059100 con 0x7f80cc004800 2024-09-12T02:51:09.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.442+0000 7f80e7e00640 1 -- 172.21.15.112:0/3116521875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80e80b3590 con 0x7f80cc004800 2024-09-12T02:51:09.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.442+0000 7f80dea00640 1 -- 172.21.15.112:0/3116521875 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) ==== 94+0+5234 (secure 0 0 0) 0x7f80d8058a00 con 0x7f80cc004800 2024-09-12T02:51:09.443 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:51:09.443 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":78,"btime":"2024-09-12T02:48:54:420600+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6074,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/984843624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":984843624},{"type":"v1","addr":"172.21.15.112:6836","nonce":984843624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3470369780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3470369780},{"type":"v1","addr":"172.21.15.112:6837","nonce":3470369780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/3190674567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3190674567},{"type":"v1","addr":"172.21.15.137:6834","nonce":3190674567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:48:50.793801+0000","modified":"2024-09-12T02:48:53.825952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7257":{"gid":7257,"name":"b","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/1000067194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1000067194},{"type":"v1","addr":"172.21.15.137:6835","nonce":1000067194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7257,"qdb_cluster":[7257]},"id":9}]} 2024-09-12T02:51:09.444 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 78 2024-09-12T02:51:09.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.444+0000 7f80e7e00640 1 -- 172.21.15.112:0/3116521875 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f80c406be60 msgr2=0x7f80c406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:09.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.444+0000 7f80e7e00640 1 --2- 172.21.15.112:0/3116521875 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f80c406be60 0x7f80c406e320 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f80d0032000 tx=0x7f80d002d000 comp rx=0 tx=0).stop 2024-09-12T02:51:09.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.444+0000 7f80e7e00640 1 -- 172.21.15.112:0/3116521875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80cc004800 msgr2=0x7f80e80b83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:09.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.444+0000 7f80e7e00640 1 --2- 172.21.15.112:0/3116521875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80cc004800 0x7f80e80b83f0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f80d800f6f0 tx=0x7f80d800fbb0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.444+0000 7f80e7e00640 1 -- 172.21.15.112:0/3116521875 shutdown_connections 2024-09-12T02:51:09.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.444+0000 7f80e7e00640 1 --2- 172.21.15.112:0/3116521875 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f80c406be60 0x7f80c406e320 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.444+0000 7f80e7e00640 1 --2- 172.21.15.112:0/3116521875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80e8148730 0x7f80e81f7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.444+0000 7f80e7e00640 1 --2- 172.21.15.112:0/3116521875 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f80e80b9b20 0x7f80e81481f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.444+0000 7f80e7e00640 1 --2- 172.21.15.112:0/3116521875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80cc004800 0x7f80e80b83f0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.444+0000 7f80e7e00640 1 -- 172.21.15.112:0/3116521875 >> 172.21.15.112:0/3116521875 conn(0x7f80e809e030 msgr2=0x7f80e80b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:09.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.445+0000 7f80e7e00640 1 -- 172.21.15.112:0/3116521875 shutdown_connections 2024-09-12T02:51:09.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.445+0000 7f80e7e00640 1 -- 172.21.15.112:0/3116521875 wait complete. 2024-09-12T02:51:09.462 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:51:09.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.614+0000 7f727ce00640 1 Processor -- start 2024-09-12T02:51:09.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.614+0000 7f727ce00640 1 -- start start 2024-09-12T02:51:09.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.615+0000 7f727ce00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f72780b3e00 0x7f72780d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.615+0000 7f727ce00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f72780b1d70 0x7f72780b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.615+0000 7f727ce00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72780d2fb0 con 0x7f72780d1710 2024-09-12T02:51:09.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.615+0000 7f727ce00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f72780d3cb0 con 0x7f72780b1d70 2024-09-12T02:51:09.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.615+0000 7f727ce00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f72780d0b60 con 0x7f72780b3e00 2024-09-12T02:51:09.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.615+0000 7f7277e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f72780b1d70 0x7f72780b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.615+0000 7f7277e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f72780b1d70 0x7f72780b2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42808/0 (socket says 172.21.15.112:42808) 2024-09-12T02:51:09.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.615+0000 7f7277e00640 1 -- 172.21.15.112:0/4048564558 learned_addr learned my addr 172.21.15.112:0/4048564558 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:09.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.616+0000 7f726fe00640 1 --2- 172.21.15.112:0/4048564558 >> v2:172.21.15.137:3300/0 conn(0x7f72780b3e00 0x7f72780d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.616+0000 7f7277e00640 1 -- 172.21.15.112:0/4048564558 >> v2:172.21.15.137:3300/0 conn(0x7f72780b3e00 msgr2=0x7f72780d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:09.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.616+0000 7f7277e00640 1 --2- 172.21.15.112:0/4048564558 >> v2:172.21.15.137:3300/0 conn(0x7f72780b3e00 0x7f72780d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.616+0000 7f7277e00640 1 -- 172.21.15.112:0/4048564558 >> v1:172.21.15.137:6789/0 conn(0x7f72780d1710 legacy=0x7f72780d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:09.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.616+0000 7f7277e00640 1 -- 172.21.15.112:0/4048564558 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72780d3410 con 0x7f72780b1d70 2024-09-12T02:51:09.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.616+0000 7f726fe00640 1 --2- 172.21.15.112:0/4048564558 >> v2:172.21.15.137:3300/0 conn(0x7f72780b3e00 0x7f72780d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:51:09.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.617+0000 7f7277e00640 1 --2- 172.21.15.112:0/4048564558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72780b1d70 0x7f72780b2200 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f72780d1190 tx=0x7f727002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33fe5e7e320a00f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:09.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.617+0000 7f7276a00640 1 -- 172.21.15.112:0/4048564558 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7270036070 con 0x7f72780b1d70 2024-09-12T02:51:09.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.617+0000 7f7276a00640 1 -- 172.21.15.112:0/4048564558 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7270031600 con 0x7f72780b1d70 2024-09-12T02:51:09.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.617+0000 7f7276a00640 1 -- 172.21.15.112:0/4048564558 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72700319d0 con 0x7f72780b1d70 2024-09-12T02:51:09.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.618+0000 7f727ce00640 1 -- 172.21.15.112:0/4048564558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72780b1d70 msgr2=0x7f72780b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:09.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.618+0000 7f727ce00640 1 --2- 172.21.15.112:0/4048564558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72780b1d70 0x7f72780b2200 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f72780d1190 tx=0x7f727002a6f0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.618+0000 7f727ce00640 1 -- 172.21.15.112:0/4048564558 shutdown_connections 2024-09-12T02:51:09.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.618+0000 7f727ce00640 1 --2- 172.21.15.112:0/4048564558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72780b1d70 0x7f72780b2200 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.618+0000 7f727ce00640 1 --2- 172.21.15.112:0/4048564558 >> v2:172.21.15.137:3300/0 conn(0x7f72780b3e00 0x7f72780d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.618+0000 7f727ce00640 1 -- 172.21.15.112:0/4048564558 >> 172.21.15.112:0/4048564558 conn(0x7f727809e030 msgr2=0x7f72780d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:09.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.618+0000 7f727ce00640 1 -- 172.21.15.112:0/4048564558 shutdown_connections 2024-09-12T02:51:09.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.618+0000 7f727ce00640 1 -- 172.21.15.112:0/4048564558 wait complete. 2024-09-12T02:51:09.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.619+0000 7f727ce00640 1 Processor -- start 2024-09-12T02:51:09.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.619+0000 7f727ce00640 1 -- start start 2024-09-12T02:51:09.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.620+0000 7f727ce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72780b1d70 0x7f72781f5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.620+0000 7f727ce00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72780b3e00 0x7f7278157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.620+0000 7f727ce00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72780d1710 0x7f72780caf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.620+0000 7f727ce00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f727815f110 con 0x7f72780b3e00 2024-09-12T02:51:09.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.620+0000 7f727ce00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f72780d39d0 con 0x7f72780b1d70 2024-09-12T02:51:09.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.620+0000 7f727ce00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f727815f290 con 0x7f72780d1710 2024-09-12T02:51:09.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.621+0000 7f726fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72780b3e00 0x7f7278157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.621+0000 7f726fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72780b3e00 0x7f7278157ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42810/0 (socket says 172.21.15.112:42810) 2024-09-12T02:51:09.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.621+0000 7f726fe00640 1 -- 172.21.15.112:0/4168056289 learned_addr learned my addr 172.21.15.112:0/4168056289 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:09.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.621+0000 7f7277400640 1 --2- 172.21.15.112:0/4168056289 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72780b1d70 0x7f72781f5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.621+0000 7f7277e00640 1 --2- 172.21.15.112:0/4168056289 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72780d1710 0x7f72780caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.621+0000 7f726fe00640 1 -- 172.21.15.112:0/4168056289 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72780d1710 msgr2=0x7f72780caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:09.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.621+0000 7f726fe00640 1 --2- 172.21.15.112:0/4168056289 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72780d1710 0x7f72780caf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.621+0000 7f726fe00640 1 -- 172.21.15.112:0/4168056289 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72780b1d70 msgr2=0x7f72781f5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:09.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.621+0000 7f726fe00640 1 --2- 172.21.15.112:0/4168056289 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72780b1d70 0x7f72781f5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.621+0000 7f726fe00640 1 -- 172.21.15.112:0/4168056289 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72780b6a20 con 0x7f72780b3e00 2024-09-12T02:51:09.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.621+0000 7f726fe00640 1 --2- 172.21.15.112:0/4168056289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72780b3e00 0x7f7278157ac0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f726000c820 tx=0x7f726000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:09.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.621+0000 7f726f400640 1 -- 172.21.15.112:0/4168056289 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7260015070 con 0x7f72780b3e00 2024-09-12T02:51:09.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.622+0000 7f726f400640 1 -- 172.21.15.112:0/4168056289 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7260007a30 con 0x7f72780b3e00 2024-09-12T02:51:09.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.622+0000 7f727ce00640 1 -- 172.21.15.112:0/4168056289 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72780b6d00 con 0x7f72780b3e00 2024-09-12T02:51:09.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.622+0000 7f726f400640 1 -- 172.21.15.112:0/4168056289 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7260007e00 con 0x7f72780b3e00 2024-09-12T02:51:09.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.622+0000 7f727ce00640 1 -- 172.21.15.112:0/4168056289 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72780b72c0 con 0x7f72780b3e00 2024-09-12T02:51:09.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.623+0000 7f727ce00640 1 -- 172.21.15.112:0/4168056289 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72780d28d0 con 0x7f72780b3e00 2024-09-12T02:51:09.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.624+0000 7f726f400640 1 -- 172.21.15.112:0/4168056289 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7260018070 con 0x7f72780b3e00 2024-09-12T02:51:09.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.625+0000 7f726f400640 1 --2- 172.21.15.112:0/4168056289 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f725406be60 0x7f725406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.625+0000 7f726f400640 1 -- 172.21.15.112:0/4168056289 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5767+0+0 (secure 0 0 0) 0x7f726008aee0 con 0x7f72780b3e00 2024-09-12T02:51:09.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.625+0000 7f7277400640 1 --2- 172.21.15.112:0/4168056289 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f725406be60 0x7f725406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.625+0000 7f726f400640 1 -- 172.21.15.112:0/4168056289 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=155}) -- 0x7f7254073ab0 con 0x7f72780b3e00 2024-09-12T02:51:09.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.626+0000 7f7277400640 1 --2- 172.21.15.112:0/4168056289 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f725406be60 0x7f725406e320 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7268006fd0 tx=0x7f7268008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:09.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.629+0000 7f726f400640 1 -- 172.21.15.112:0/4168056289 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f72600597b0 con 0x7f72780b3e00 2024-09-12T02:51:09.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.804+0000 7f727ce00640 1 -- 172.21.15.112:0/4168056289 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72780b3000 con 0x7f72780b3e00 2024-09-12T02:51:09.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.805+0000 7f726f400640 1 -- 172.21.15.112:0/4168056289 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) ==== 74+0+16911 (secure 0 0 0) 0x7f72600590b0 con 0x7f72780b3e00 2024-09-12T02:51:09.806 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:51:09.806 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":154,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:50:26.032322+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:48:48.563948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-12T02:48:49.789395+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.3","mappings":[{"from":2,"to":0}]},{"pgid":"19.1f","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:51:09.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.807+0000 7f727ce00640 1 -- 172.21.15.112:0/4168056289 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f725406be60 msgr2=0x7f725406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:09.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.807+0000 7f727ce00640 1 --2- 172.21.15.112:0/4168056289 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f725406be60 0x7f725406e320 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7268006fd0 tx=0x7f7268008040 comp rx=0 tx=0).stop 2024-09-12T02:51:09.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.807+0000 7f727ce00640 1 -- 172.21.15.112:0/4168056289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72780b3e00 msgr2=0x7f7278157ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:09.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.807+0000 7f727ce00640 1 --2- 172.21.15.112:0/4168056289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72780b3e00 0x7f7278157ac0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f726000c820 tx=0x7f726000cc20 comp rx=0 tx=0).stop 2024-09-12T02:51:09.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.808+0000 7f727ce00640 1 -- 172.21.15.112:0/4168056289 shutdown_connections 2024-09-12T02:51:09.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.808+0000 7f727ce00640 1 --2- 172.21.15.112:0/4168056289 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72780d1710 0x7f72780caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.808+0000 7f727ce00640 1 --2- 172.21.15.112:0/4168056289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72780b3e00 0x7f7278157ac0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.808+0000 7f727ce00640 1 --2- 172.21.15.112:0/4168056289 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f725406be60 0x7f725406e320 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.808+0000 7f727ce00640 1 --2- 172.21.15.112:0/4168056289 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72780b1d70 0x7f72781f5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.808+0000 7f727ce00640 1 -- 172.21.15.112:0/4168056289 >> 172.21.15.112:0/4168056289 conn(0x7f727809e030 msgr2=0x7f72780b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:09.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.808+0000 7f727ce00640 1 -- 172.21.15.112:0/4168056289 shutdown_connections 2024-09-12T02:51:09.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.808+0000 7f727ce00640 1 -- 172.21.15.112:0/4168056289 wait complete. 2024-09-12T02:51:09.824 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:51:09.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.978+0000 7f456be00640 1 Processor -- start 2024-09-12T02:51:09.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.978+0000 7f456be00640 1 -- start start 2024-09-12T02:51:09.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.979+0000 7f456be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f456c0d1710 0x7f456c0d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.979+0000 7f456be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f456c0b1d70 0x7f456c0b2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.979+0000 7f456be00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f456c0d2fb0 con 0x7f456c0b3e00 2024-09-12T02:51:09.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.979+0000 7f456be00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f456c0d3cb0 con 0x7f456c0b1d70 2024-09-12T02:51:09.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.979+0000 7f456be00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f456c0d0b60 con 0x7f456c0d1710 2024-09-12T02:51:09.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.980+0000 7f456aa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f456c0d1710 0x7f456c0d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.980+0000 7f456b400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f456c0b1d70 0x7f456c0b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.980+0000 7f456a000640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f456c0b3e00 0x7f456c0d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.112:34812/0 (socket says 172.21.15.112:34812) 2024-09-12T02:51:09.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.980+0000 7f456a000640 1 -- 172.21.15.112:0/4267779416 learned_addr learned my addr 172.21.15.112:0/4267779416 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:51:09.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.980+0000 7f456b400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f456c0b1d70 0x7f456c0b2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:35354/0 (socket says 172.21.15.112:35354) 2024-09-12T02:51:09.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.980+0000 7f4569600640 1 -- 172.21.15.112:0/4267779416 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3332309779 0 0) 0x7f456c0d2fb0 con 0x7f456c0b3e00 2024-09-12T02:51:09.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.980+0000 7f4569600640 1 -- 172.21.15.112:0/4267779416 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4550003520 con 0x7f456c0b3e00 2024-09-12T02:51:09.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.980+0000 7f456b400640 1 -- 172.21.15.112:0/4267779416 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f456c0d1710 msgr2=0x7f456c0d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:09.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.980+0000 7f456b400640 1 --2- 172.21.15.112:0/4267779416 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f456c0d1710 0x7f456c0d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.980+0000 7f456b400640 1 -- 172.21.15.112:0/4267779416 >> v1:172.21.15.137:6789/0 conn(0x7f456c0b3e00 legacy=0x7f456c0d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:09.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.980+0000 7f456b400640 1 -- 172.21.15.112:0/4267779416 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f456c0d3410 con 0x7f456c0b1d70 2024-09-12T02:51:09.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.980+0000 7f456aa00640 1 --2- 172.21.15.112:0/4267779416 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f456c0d1710 0x7f456c0d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:51:09.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.981+0000 7f456b400640 1 --2- 172.21.15.112:0/4267779416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f456c0b1d70 0x7f456c0b2220 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4564009d90 tx=0x7f456402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c7ad456d62aa77c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:09.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.982+0000 7f4569600640 1 -- 172.21.15.112:0/4267779416 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4564007740 con 0x7f456c0b1d70 2024-09-12T02:51:09.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.982+0000 7f4569600640 1 -- 172.21.15.112:0/4267779416 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45640078e0 con 0x7f456c0b1d70 2024-09-12T02:51:09.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.982+0000 7f4569600640 1 -- 172.21.15.112:0/4267779416 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4564007cb0 con 0x7f456c0b1d70 2024-09-12T02:51:09.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.982+0000 7f456be00640 1 -- 172.21.15.112:0/4267779416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f456c0b1d70 msgr2=0x7f456c0b2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:09.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.982+0000 7f456be00640 1 --2- 172.21.15.112:0/4267779416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f456c0b1d70 0x7f456c0b2220 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4564009d90 tx=0x7f456402a660 comp rx=0 tx=0).stop 2024-09-12T02:51:09.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.982+0000 7f456be00640 1 -- 172.21.15.112:0/4267779416 shutdown_connections 2024-09-12T02:51:09.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.982+0000 7f456be00640 1 --2- 172.21.15.112:0/4267779416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f456c0b1d70 0x7f456c0b2220 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.982+0000 7f456be00640 1 --2- 172.21.15.112:0/4267779416 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f456c0d1710 0x7f456c0d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.982+0000 7f456be00640 1 -- 172.21.15.112:0/4267779416 >> 172.21.15.112:0/4267779416 conn(0x7f456c09e030 msgr2=0x7f456c0d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:09.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.982+0000 7f456be00640 1 -- 172.21.15.112:0/4267779416 shutdown_connections 2024-09-12T02:51:09.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.982+0000 7f456be00640 1 -- 172.21.15.112:0/4267779416 wait complete. 2024-09-12T02:51:09.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.984+0000 7f456be00640 1 Processor -- start 2024-09-12T02:51:09.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.984+0000 7f456be00640 1 -- start start 2024-09-12T02:51:09.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.985+0000 7f456be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f456c0b1d70 0x7f456c1f5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.985+0000 7f456be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f456c0b3e00 0x7f456c15dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.985+0000 7f456be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f456c0d1710 0x7f456c161c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.985+0000 7f456be00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f456c15f110 con 0x7f456c0d1710 2024-09-12T02:51:09.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.985+0000 7f456be00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f456c0d39d0 con 0x7f456c0b3e00 2024-09-12T02:51:09.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.985+0000 7f456be00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f456c15f290 con 0x7f456c0b1d70 2024-09-12T02:51:09.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.985+0000 7f456b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f456c0d1710 0x7f456c161c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.985+0000 7f456b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f456c0d1710 0x7f456c161c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42820/0 (socket says 172.21.15.112:42820) 2024-09-12T02:51:09.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.985+0000 7f456b400640 1 -- 172.21.15.112:0/1372603189 learned_addr learned my addr 172.21.15.112:0/1372603189 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:09.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.985+0000 7f456a000640 1 --2- 172.21.15.112:0/1372603189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f456c0b3e00 0x7f456c15dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.985+0000 7f456aa00640 1 --2- 172.21.15.112:0/1372603189 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f456c0b1d70 0x7f456c1f5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.986+0000 7f456b400640 1 -- 172.21.15.112:0/1372603189 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f456c0b1d70 msgr2=0x7f456c1f5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:09.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.986+0000 7f456b400640 1 --2- 172.21.15.112:0/1372603189 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f456c0b1d70 0x7f456c1f5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.986+0000 7f456b400640 1 -- 172.21.15.112:0/1372603189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f456c0b3e00 msgr2=0x7f456c15dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:09.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.986+0000 7f456b400640 1 --2- 172.21.15.112:0/1372603189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f456c0b3e00 0x7f456c15dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:09.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.986+0000 7f456b400640 1 -- 172.21.15.112:0/1372603189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f456c0c9d50 con 0x7f456c0d1710 2024-09-12T02:51:09.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.986+0000 7f456b400640 1 --2- 172.21.15.112:0/1372603189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f456c0d1710 0x7f456c161c10 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f456402ac50 tx=0x7f4564004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:09.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.986+0000 7f4562a00640 1 -- 172.21.15.112:0/1372603189 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4564040070 con 0x7f456c0d1710 2024-09-12T02:51:09.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.986+0000 7f4562a00640 1 -- 172.21.15.112:0/1372603189 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4564031bc0 con 0x7f456c0d1710 2024-09-12T02:51:09.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.986+0000 7f456be00640 1 -- 172.21.15.112:0/1372603189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f456c0ca030 con 0x7f456c0d1710 2024-09-12T02:51:09.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.986+0000 7f4562a00640 1 -- 172.21.15.112:0/1372603189 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4564009450 con 0x7f456c0d1710 2024-09-12T02:51:09.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.986+0000 7f456be00640 1 -- 172.21.15.112:0/1372603189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f456c0ca5f0 con 0x7f456c0d1710 2024-09-12T02:51:09.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.987+0000 7f456be00640 1 -- 172.21.15.112:0/1372603189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f456c0d28d0 con 0x7f456c0d1710 2024-09-12T02:51:09.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.988+0000 7f4562a00640 1 -- 172.21.15.112:0/1372603189 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4564039040 con 0x7f456c0d1710 2024-09-12T02:51:09.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.990+0000 7f4562a00640 1 --2- 172.21.15.112:0/1372603189 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f454c06be30 0x7f454c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:09.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.990+0000 7f4562a00640 1 -- 172.21.15.112:0/1372603189 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5767+0+0 (secure 0 0 0) 0x7f45640ac670 con 0x7f456c0d1710 2024-09-12T02:51:09.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.990+0000 7f456aa00640 1 --2- 172.21.15.112:0/1372603189 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f454c06be30 0x7f454c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:09.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.990+0000 7f4562a00640 1 -- 172.21.15.112:0/1372603189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=155}) -- 0x7f454c073a20 con 0x7f456c0d1710 2024-09-12T02:51:09.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.991+0000 7f456aa00640 1 --2- 172.21.15.112:0/1372603189 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f454c06be30 0x7f454c06e2f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f455c009560 tx=0x7f455c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:09.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:09.994+0000 7f4562a00640 1 -- 172.21.15.112:0/1372603189 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f456407aaa0 con 0x7f456c0d1710 2024-09-12T02:51:10.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.200+0000 7f456be00640 1 -- 172.21.15.112:0/1372603189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f456c0caa80 con 0x7f456c0d1710 2024-09-12T02:51:10.202 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-12T02:51:10.201+0000 7f0216c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:51:10.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.203+0000 7f4562a00640 1 -- 172.21.15.112:0/1372603189 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v79) ==== 161+0+0 (secure 0 0 0) 0x7f456407eda0 con 0x7f456c0d1710 2024-09-12T02:51:10.204 INFO:teuthology.orchestra.run.smithi112.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:51:10.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.203+0000 7f4562a00640 1 -- 172.21.15.112:0/1372603189 <== mon.0 v2:172.21.15.112:3300/0 8 ==== osd_map(155..155 src has 1..155) ==== 374+0+0 (secure 0 0 0) 0x7f45640e0d50 con 0x7f456c0d1710 2024-09-12T02:51:10.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.204+0000 7f4562a00640 1 -- 172.21.15.112:0/1372603189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=156}) -- 0x7f454c074400 con 0x7f456c0d1710 2024-09-12T02:51:10.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.206+0000 7f456be00640 1 -- 172.21.15.112:0/1372603189 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f454c06be30 msgr2=0x7f454c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:10.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.206+0000 7f456be00640 1 --2- 172.21.15.112:0/1372603189 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f454c06be30 0x7f454c06e2f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f455c009560 tx=0x7f455c009190 comp rx=0 tx=0).stop 2024-09-12T02:51:10.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.206+0000 7f456be00640 1 -- 172.21.15.112:0/1372603189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f456c0d1710 msgr2=0x7f456c161c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:10.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.206+0000 7f456be00640 1 --2- 172.21.15.112:0/1372603189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f456c0d1710 0x7f456c161c10 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f456402ac50 tx=0x7f4564004a40 comp rx=0 tx=0).stop 2024-09-12T02:51:10.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.207+0000 7f456be00640 1 -- 172.21.15.112:0/1372603189 shutdown_connections 2024-09-12T02:51:10.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.207+0000 7f456be00640 1 --2- 172.21.15.112:0/1372603189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f456c0d1710 0x7f456c161c10 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:10.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.207+0000 7f456be00640 1 --2- 172.21.15.112:0/1372603189 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f454c06be30 0x7f454c06e2f0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:10.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.207+0000 7f456be00640 1 --2- 172.21.15.112:0/1372603189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f456c0b3e00 0x7f456c15dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:10.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.207+0000 7f456be00640 1 --2- 172.21.15.112:0/1372603189 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f456c0b1d70 0x7f456c1f5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:10.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.207+0000 7f456be00640 1 -- 172.21.15.112:0/1372603189 >> 172.21.15.112:0/1372603189 conn(0x7f456c09e030 msgr2=0x7f456c06d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:10.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.207+0000 7f456be00640 1 -- 172.21.15.112:0/1372603189 shutdown_connections 2024-09-12T02:51:10.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.207+0000 7f456be00640 1 -- 172.21.15.112:0/1372603189 wait complete. 2024-09-12T02:51:10.224 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T02:51:10.273 INFO:tasks.ceph.mds.b.smithi137.stdout:starting mds.b at 2024-09-12T02:51:10.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.379+0000 7fb6b1000640 1 Processor -- start 2024-09-12T02:51:10.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.380+0000 7fb6b1000640 1 -- start start 2024-09-12T02:51:10.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.381+0000 7fb6b1000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6ac071530 0x7fb6ac0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:10.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.381+0000 7fb6b1000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6ac0ceeb0 con 0x7fb6ac071970 2024-09-12T02:51:10.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.381+0000 7fb6b1000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6ac06e300 con 0x7fb6ac15cc50 2024-09-12T02:51:10.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.381+0000 7fb6b1000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb6ac15d030 con 0x7fb6ac071530 2024-09-12T02:51:10.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.381+0000 7fb6aa800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb6ac071970 0x7fb6ac0cf950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38060/0 (socket says 172.21.15.112:38060) 2024-09-12T02:51:10.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.381+0000 7fb6aa800640 1 -- 172.21.15.112:0/3303214288 learned_addr learned my addr 172.21.15.112:0/3303214288 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:51:10.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.381+0000 7fb6a9400640 1 --2- 172.21.15.112:0/3303214288 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6ac071530 0x7fb6ac0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:10.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.381+0000 7fb6a8a00640 1 -- 172.21.15.112:0/3303214288 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1349456612 0 0) 0x7fb6ac0ceeb0 con 0x7fb6ac071970 2024-09-12T02:51:10.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.382+0000 7fb6a8a00640 1 -- 172.21.15.112:0/3303214288 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb690003520 con 0x7fb6ac071970 2024-09-12T02:51:10.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.382+0000 7fb6a8a00640 1 -- 172.21.15.112:0/3303214288 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3231241658 0 0) 0x7fb6ac06e300 con 0x7fb6ac15cc50 2024-09-12T02:51:10.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.382+0000 7fb6a8a00640 1 -- 172.21.15.112:0/3303214288 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6ac0ceeb0 con 0x7fb6ac15cc50 2024-09-12T02:51:10.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.382+0000 7fb6a9400640 1 -- 172.21.15.112:0/3303214288 >> v1:172.21.15.137:6789/0 conn(0x7fb6ac15cc50 legacy=0x7fb6ac0732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:10.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.382+0000 7fb6a9400640 1 -- 172.21.15.112:0/3303214288 >> v1:172.21.15.112:6789/0 conn(0x7fb6ac071970 legacy=0x7fb6ac0cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:10.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.382+0000 7fb6a9400640 1 -- 172.21.15.112:0/3303214288 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6ac06e5e0 con 0x7fb6ac071530 2024-09-12T02:51:10.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.383+0000 7fb6a9400640 1 --2- 172.21.15.112:0/3303214288 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6ac071530 0x7fb6ac0af720 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb6980097c0 tx=0x7fb69802a160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c56afdaad0c5570 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:10.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.383+0000 7fb6a8a00640 1 -- 172.21.15.112:0/3303214288 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb698037070 con 0x7fb6ac071530 2024-09-12T02:51:10.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.383+0000 7fb6a8a00640 1 -- 172.21.15.112:0/3303214288 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb698032440 con 0x7fb6ac071530 2024-09-12T02:51:10.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.383+0000 7fb6a8a00640 1 -- 172.21.15.112:0/3303214288 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb698032810 con 0x7fb6ac071530 2024-09-12T02:51:10.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.384+0000 7fb6b1000640 1 -- 172.21.15.112:0/3303214288 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6ac071530 msgr2=0x7fb6ac0af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:10.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.384+0000 7fb6b1000640 1 --2- 172.21.15.112:0/3303214288 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6ac071530 0x7fb6ac0af720 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb6980097c0 tx=0x7fb69802a160 comp rx=0 tx=0).stop 2024-09-12T02:51:10.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.384+0000 7fb6b1000640 1 -- 172.21.15.112:0/3303214288 shutdown_connections 2024-09-12T02:51:10.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.384+0000 7fb6b1000640 1 --2- 172.21.15.112:0/3303214288 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6ac071530 0x7fb6ac0af720 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:10.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.384+0000 7fb6b1000640 1 -- 172.21.15.112:0/3303214288 >> 172.21.15.112:0/3303214288 conn(0x7fb6ac06bbd0 msgr2=0x7fb6ac06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:10.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.384+0000 7fb6b1000640 1 -- 172.21.15.112:0/3303214288 shutdown_connections 2024-09-12T02:51:10.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.384+0000 7fb6b1000640 1 -- 172.21.15.112:0/3303214288 wait complete. 2024-09-12T02:51:10.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.385+0000 7fb6b1000640 1 Processor -- start 2024-09-12T02:51:10.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.385+0000 7fb6b1000640 1 -- start start 2024-09-12T02:51:10.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.386+0000 7fb6b1000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6ac071530 0x7fb6ac1551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:10.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.386+0000 7fb6b1000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6ac071970 0x7fb6ac141d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:10.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.386+0000 7fb6b1000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6ac15cc50 0x7fb6ac158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:10.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.386+0000 7fb6b1000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb6ac06f510 con 0x7fb6ac15cc50 2024-09-12T02:51:10.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.386+0000 7fb6b1000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb6ac0cf4c0 con 0x7fb6ac071970 2024-09-12T02:51:10.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.386+0000 7fb6b1000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb6ac06f690 con 0x7fb6ac071530 2024-09-12T02:51:10.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.387+0000 7fb6aa800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6ac15cc50 0x7fb6ac158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:10.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.387+0000 7fb6aa800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6ac15cc50 0x7fb6ac158f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42830/0 (socket says 172.21.15.112:42830) 2024-09-12T02:51:10.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.387+0000 7fb6aa800640 1 -- 172.21.15.112:0/1685780617 learned_addr learned my addr 172.21.15.112:0/1685780617 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:10.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.387+0000 7fb6a9e00640 1 --2- 172.21.15.112:0/1685780617 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6ac071530 0x7fb6ac1551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:10.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.387+0000 7fb6a9400640 1 --2- 172.21.15.112:0/1685780617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6ac071970 0x7fb6ac141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:10.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.387+0000 7fb6aa800640 1 -- 172.21.15.112:0/1685780617 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6ac071530 msgr2=0x7fb6ac1551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:10.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.387+0000 7fb6aa800640 1 --2- 172.21.15.112:0/1685780617 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6ac071530 0x7fb6ac1551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:10.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.387+0000 7fb6aa800640 1 -- 172.21.15.112:0/1685780617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6ac071970 msgr2=0x7fb6ac141d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:10.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.387+0000 7fb6aa800640 1 --2- 172.21.15.112:0/1685780617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6ac071970 0x7fb6ac141d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:10.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.387+0000 7fb6aa800640 1 -- 172.21.15.112:0/1685780617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6ac155700 con 0x7fb6ac15cc50 2024-09-12T02:51:10.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.387+0000 7fb6a9e00640 1 --2- 172.21.15.112:0/1685780617 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6ac071530 0x7fb6ac1551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:51:10.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.387+0000 7fb6a9400640 1 --2- 172.21.15.112:0/1685780617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6ac071970 0x7fb6ac141d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:51:10.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.387+0000 7fb6aa800640 1 --2- 172.21.15.112:0/1685780617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6ac15cc50 0x7fb6ac158f80 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400cba0 tx=0x7fb6a400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:10.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.387+0000 7fb6a2000640 1 -- 172.21.15.112:0/1685780617 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a4017070 con 0x7fb6ac15cc50 2024-09-12T02:51:10.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.387+0000 7fb6a2000640 1 -- 172.21.15.112:0/1685780617 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a400ac40 con 0x7fb6ac15cc50 2024-09-12T02:51:10.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.387+0000 7fb6a2000640 1 -- 172.21.15.112:0/1685780617 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a4012400 con 0x7fb6ac15cc50 2024-09-12T02:51:10.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.387+0000 7fb6b1000640 1 -- 172.21.15.112:0/1685780617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6ac142290 con 0x7fb6ac15cc50 2024-09-12T02:51:10.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.388+0000 7fb6b1000640 1 -- 172.21.15.112:0/1685780617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6ac155cb0 con 0x7fb6ac15cc50 2024-09-12T02:51:10.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.389+0000 7fb6b1000640 1 -- 172.21.15.112:0/1685780617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6ac06df60 con 0x7fb6ac15cc50 2024-09-12T02:51:10.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.390+0000 7fb6a2000640 1 -- 172.21.15.112:0/1685780617 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb6a401a070 con 0x7fb6ac15cc50 2024-09-12T02:51:10.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.391+0000 7fb6a2000640 1 --2- 172.21.15.112:0/1685780617 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb68c06be30 0x7fb68c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:10.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.391+0000 7fb6a2000640 1 -- 172.21.15.112:0/1685780617 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5853+0+0 (secure 0 0 0) 0x7fb6a408acd0 con 0x7fb6ac15cc50 2024-09-12T02:51:10.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.391+0000 7fb6a9e00640 1 --2- 172.21.15.112:0/1685780617 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb68c06be30 0x7fb68c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:10.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.391+0000 7fb6a2000640 1 -- 172.21.15.112:0/1685780617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=156}) -- 0x7fb68c073b30 con 0x7fb6ac15cc50 2024-09-12T02:51:10.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.392+0000 7fb6a9e00640 1 --2- 172.21.15.112:0/1685780617 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb68c06be30 0x7fb68c06e2f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb69c001670 tx=0x7fb69c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:10.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.395+0000 7fb6a2000640 1 -- 172.21.15.112:0/1685780617 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb6a40595f0 con 0x7fb6ac15cc50 2024-09-12T02:51:10.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:10.604+0000 7fb6b1000640 1 -- 172.21.15.112:0/1685780617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fb6ac0b5800 con 0x7fb6ac15cc50 2024-09-12T02:51:11.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.042+0000 7fb6a2000640 1 -- 172.21.15.112:0/1685780617 <== mon.0 v2:172.21.15.112:3300/0 7 ==== osd_map(156..156 src has 1..156) ==== 679+0+0 (secure 0 0 0) 0x7fb6a4089280 con 0x7fb6ac15cc50 2024-09-12T02:51:11.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.042+0000 7fb6a2000640 1 -- 172.21.15.112:0/1685780617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=157}) -- 0x7fb68c0746a0 con 0x7fb6ac15cc50 2024-09-12T02:51:11.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.205+0000 7fb6a2000640 1 -- 172.21.15.112:0/1685780617 <== mon.0 v2:172.21.15.112:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v80) ==== 104+0+0 (secure 0 0 0) 0x7fb6a4058ef0 con 0x7fb6ac15cc50 2024-09-12T02:51:11.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.207+0000 7fb6b1000640 1 -- 172.21.15.112:0/1685780617 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb68c06be30 msgr2=0x7fb68c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:11.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.208+0000 7fb6b1000640 1 --2- 172.21.15.112:0/1685780617 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb68c06be30 0x7fb68c06e2f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb69c001670 tx=0x7fb69c009040 comp rx=0 tx=0).stop 2024-09-12T02:51:11.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.208+0000 7fb6b1000640 1 -- 172.21.15.112:0/1685780617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6ac15cc50 msgr2=0x7fb6ac158f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:11.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.208+0000 7fb6b1000640 1 --2- 172.21.15.112:0/1685780617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6ac15cc50 0x7fb6ac158f80 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400cba0 tx=0x7fb6a400a060 comp rx=0 tx=0).stop 2024-09-12T02:51:11.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.208+0000 7fb6b1000640 1 -- 172.21.15.112:0/1685780617 shutdown_connections 2024-09-12T02:51:11.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.208+0000 7fb6b1000640 1 --2- 172.21.15.112:0/1685780617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6ac15cc50 0x7fb6ac158f80 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:11.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.208+0000 7fb6b1000640 1 --2- 172.21.15.112:0/1685780617 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb68c06be30 0x7fb68c06e2f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:11.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.208+0000 7fb6b1000640 1 --2- 172.21.15.112:0/1685780617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6ac071970 0x7fb6ac141d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:11.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.208+0000 7fb6b1000640 1 --2- 172.21.15.112:0/1685780617 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6ac071530 0x7fb6ac1551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:11.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.208+0000 7fb6b1000640 1 -- 172.21.15.112:0/1685780617 >> 172.21.15.112:0/1685780617 conn(0x7fb6ac06bbd0 msgr2=0x7fb6ac1576f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:11.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.208+0000 7fb6b1000640 1 -- 172.21.15.112:0/1685780617 shutdown_connections 2024-09-12T02:51:11.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.208+0000 7fb6b1000640 1 -- 172.21.15.112:0/1685780617 wait complete. 2024-09-12T02:51:11.227 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T02:51:11.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.386+0000 7f1f92e00640 1 Processor -- start 2024-09-12T02:51:11.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.386+0000 7f1f92e00640 1 -- start start 2024-09-12T02:51:11.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.387+0000 7f1f92e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f8c0b4140 0x7f1f8c0b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:11.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.387+0000 7f1f92e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1f8c1602f0 0x7f1f8c0ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:11.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.387+0000 7f1f92e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f8c06eed0 con 0x7f1f8c144890 2024-09-12T02:51:11.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.387+0000 7f1f92e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f1f8c06f170 con 0x7f1f8c1602f0 2024-09-12T02:51:11.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.387+0000 7f1f92e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1f8c15f810 con 0x7f1f8c0b4140 2024-09-12T02:51:11.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.388+0000 7f1f8be00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f1f8c144890 0x7f1f8c0b3a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38070/0 (socket says 172.21.15.112:38070) 2024-09-12T02:51:11.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.388+0000 7f1f8be00640 1 -- 172.21.15.112:0/456253251 learned_addr learned my addr 172.21.15.112:0/456253251 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:51:11.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.388+0000 7f1f90e00640 1 --2- 172.21.15.112:0/456253251 >> v2:172.21.15.112:3300/0 conn(0x7f1f8c1602f0 0x7f1f8c0ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:11.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.388+0000 7f1f8b400640 1 --2- 172.21.15.112:0/456253251 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f8c0b4140 0x7f1f8c0b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:11.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.388+0000 7f1f8aa00640 1 -- 172.21.15.112:0/456253251 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1663860333 0 0) 0x7f1f8c06eed0 con 0x7f1f8c144890 2024-09-12T02:51:11.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.388+0000 7f1f8aa00640 1 -- 172.21.15.112:0/456253251 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f70003520 con 0x7f1f8c144890 2024-09-12T02:51:11.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.388+0000 7f1f90e00640 1 -- 172.21.15.112:0/456253251 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f8c0b4140 msgr2=0x7f1f8c0b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:11.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.388+0000 7f1f90e00640 1 --2- 172.21.15.112:0/456253251 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f8c0b4140 0x7f1f8c0b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:11.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.388+0000 7f1f90e00640 1 -- 172.21.15.112:0/456253251 >> v1:172.21.15.112:6789/0 conn(0x7f1f8c144890 legacy=0x7f1f8c0b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:11.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.388+0000 7f1f90e00640 1 -- 172.21.15.112:0/456253251 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f8c15faf0 con 0x7f1f8c1602f0 2024-09-12T02:51:11.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.389+0000 7f1f90e00640 1 --2- 172.21.15.112:0/456253251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f8c1602f0 0x7f1f8c0ce5b0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f1f84009d90 tx=0x7f1f8402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6948bd91a809f4cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:11.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.389+0000 7f1f8aa00640 1 -- 172.21.15.112:0/456253251 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f84007740 con 0x7f1f8c1602f0 2024-09-12T02:51:11.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.390+0000 7f1f8aa00640 1 -- 172.21.15.112:0/456253251 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f840078e0 con 0x7f1f8c1602f0 2024-09-12T02:51:11.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.390+0000 7f1f8aa00640 1 -- 172.21.15.112:0/456253251 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f84007c90 con 0x7f1f8c1602f0 2024-09-12T02:51:11.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.390+0000 7f1f92e00640 1 -- 172.21.15.112:0/456253251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f8c1602f0 msgr2=0x7f1f8c0ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:11.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.390+0000 7f1f92e00640 1 --2- 172.21.15.112:0/456253251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f8c1602f0 0x7f1f8c0ce5b0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f1f84009d90 tx=0x7f1f8402a660 comp rx=0 tx=0).stop 2024-09-12T02:51:11.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.390+0000 7f1f92e00640 1 -- 172.21.15.112:0/456253251 shutdown_connections 2024-09-12T02:51:11.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.390+0000 7f1f92e00640 1 --2- 172.21.15.112:0/456253251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f8c1602f0 0x7f1f8c0ce5b0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:11.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.390+0000 7f1f92e00640 1 --2- 172.21.15.112:0/456253251 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f8c0b4140 0x7f1f8c0b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:11.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.390+0000 7f1f92e00640 1 -- 172.21.15.112:0/456253251 >> 172.21.15.112:0/456253251 conn(0x7f1f8c0b2730 msgr2=0x7f1f8c0b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:11.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.390+0000 7f1f92e00640 1 -- 172.21.15.112:0/456253251 shutdown_connections 2024-09-12T02:51:11.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.390+0000 7f1f92e00640 1 -- 172.21.15.112:0/456253251 wait complete. 2024-09-12T02:51:11.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.392+0000 7f1f92e00640 1 Processor -- start 2024-09-12T02:51:11.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.392+0000 7f1f92e00640 1 -- start start 2024-09-12T02:51:11.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.393+0000 7f1f92e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f8c0b4140 0x7f1f8c0ad710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:11.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.393+0000 7f1f92e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f8c144890 0x7f1f8c0aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:11.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.393+0000 7f1f92e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f8c1602f0 0x7f1f8c0c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:11.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.393+0000 7f1f92e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8c144df0 con 0x7f1f8c1602f0 2024-09-12T02:51:11.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.393+0000 7f1f92e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8c144c70 con 0x7f1f8c144890 2024-09-12T02:51:11.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.393+0000 7f1f92e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1f8c0b3290 con 0x7f1f8c0b4140 2024-09-12T02:51:11.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.393+0000 7f1f90e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f8c1602f0 0x7f1f8c0c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:11.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.393+0000 7f1f90e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f8c1602f0 0x7f1f8c0c5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42844/0 (socket says 172.21.15.112:42844) 2024-09-12T02:51:11.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.393+0000 7f1f90e00640 1 -- 172.21.15.112:0/2032292112 learned_addr learned my addr 172.21.15.112:0/2032292112 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:11.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.393+0000 7f1f8be00640 1 --2- 172.21.15.112:0/2032292112 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f8c0b4140 0x7f1f8c0ad710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:11.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.393+0000 7f1f8b400640 1 --2- 172.21.15.112:0/2032292112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f8c144890 0x7f1f8c0aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:11.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.393+0000 7f1f90e00640 1 -- 172.21.15.112:0/2032292112 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f8c0b4140 msgr2=0x7f1f8c0ad710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:11.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.393+0000 7f1f90e00640 1 --2- 172.21.15.112:0/2032292112 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f8c0b4140 0x7f1f8c0ad710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:11.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.393+0000 7f1f90e00640 1 -- 172.21.15.112:0/2032292112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f8c144890 msgr2=0x7f1f8c0aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:11.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.393+0000 7f1f90e00640 1 --2- 172.21.15.112:0/2032292112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f8c144890 0x7f1f8c0aeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:11.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.393+0000 7f1f90e00640 1 -- 172.21.15.112:0/2032292112 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f8c0ade20 con 0x7f1f8c1602f0 2024-09-12T02:51:11.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.393+0000 7f1f8be00640 1 --2- 172.21.15.112:0/2032292112 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f8c0b4140 0x7f1f8c0ad710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:51:11.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.393+0000 7f1f8b400640 1 --2- 172.21.15.112:0/2032292112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f8c144890 0x7f1f8c0aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:51:11.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.394+0000 7f1f90e00640 1 --2- 172.21.15.112:0/2032292112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f8c1602f0 0x7f1f8c0c5bd0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f1f84009eb0 tx=0x7f1f84004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:11.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.394+0000 7f1f83e00640 1 -- 172.21.15.112:0/2032292112 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8403f070 con 0x7f1f8c1602f0 2024-09-12T02:51:11.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.394+0000 7f1f83e00640 1 -- 172.21.15.112:0/2032292112 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f84031c60 con 0x7f1f8c1602f0 2024-09-12T02:51:11.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.394+0000 7f1f83e00640 1 -- 172.21.15.112:0/2032292112 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f84009450 con 0x7f1f8c1602f0 2024-09-12T02:51:11.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.394+0000 7f1f92e00640 1 -- 172.21.15.112:0/2032292112 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f8c0ae100 con 0x7f1f8c1602f0 2024-09-12T02:51:11.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.394+0000 7f1f92e00640 1 -- 172.21.15.112:0/2032292112 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f8c0ae6c0 con 0x7f1f8c1602f0 2024-09-12T02:51:11.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.395+0000 7f1f92e00640 1 -- 172.21.15.112:0/2032292112 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f8c0b58c0 con 0x7f1f8c1602f0 2024-09-12T02:51:11.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.396+0000 7f1f83e00640 1 -- 172.21.15.112:0/2032292112 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1f8403b410 con 0x7f1f8c1602f0 2024-09-12T02:51:11.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.397+0000 7f1f83e00640 1 --2- 172.21.15.112:0/2032292112 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1f6c06be30 0x7f1f6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:11.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.397+0000 7f1f83e00640 1 -- 172.21.15.112:0/2032292112 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5853+0+0 (secure 0 0 0) 0x7f1f840ac2d0 con 0x7f1f8c1602f0 2024-09-12T02:51:11.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.397+0000 7f1f8be00640 1 --2- 172.21.15.112:0/2032292112 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1f6c06be30 0x7f1f6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:11.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.398+0000 7f1f8be00640 1 --2- 172.21.15.112:0/2032292112 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1f6c06be30 0x7f1f6c06e2f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c007fd0 tx=0x7f1f7c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:11.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.401+0000 7f1f83e00640 1 -- 172.21.15.112:0/2032292112 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1f84038320 con 0x7f1f8c1602f0 2024-09-12T02:51:11.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:11.573+0000 7f1f92e00640 1 -- 172.21.15.112:0/2032292112 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1f8c0b0500 con 0x7f1f8c1602f0 2024-09-12T02:51:12.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.291+0000 7f1f83e00640 1 -- 172.21.15.112:0/2032292112 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v157) ==== 181+0+0 (secure 0 0 0) 0x7f1f8407abe0 con 0x7f1f8c1602f0 2024-09-12T02:51:12.292 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' removed 2024-09-12T02:51:12.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.295+0000 7f1f92e00640 1 -- 172.21.15.112:0/2032292112 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1f6c06be30 msgr2=0x7f1f6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:12.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.295+0000 7f1f92e00640 1 --2- 172.21.15.112:0/2032292112 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1f6c06be30 0x7f1f6c06e2f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c007fd0 tx=0x7f1f7c009040 comp rx=0 tx=0).stop 2024-09-12T02:51:12.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.295+0000 7f1f92e00640 1 -- 172.21.15.112:0/2032292112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f8c1602f0 msgr2=0x7f1f8c0c5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:12.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.295+0000 7f1f92e00640 1 --2- 172.21.15.112:0/2032292112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f8c1602f0 0x7f1f8c0c5bd0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f1f84009eb0 tx=0x7f1f84004a40 comp rx=0 tx=0).stop 2024-09-12T02:51:12.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.296+0000 7f1f92e00640 1 -- 172.21.15.112:0/2032292112 shutdown_connections 2024-09-12T02:51:12.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.296+0000 7f1f92e00640 1 --2- 172.21.15.112:0/2032292112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f8c1602f0 0x7f1f8c0c5bd0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:12.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.296+0000 7f1f92e00640 1 --2- 172.21.15.112:0/2032292112 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1f6c06be30 0x7f1f6c06e2f0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:12.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.296+0000 7f1f92e00640 1 --2- 172.21.15.112:0/2032292112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f8c144890 0x7f1f8c0aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:12.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.296+0000 7f1f92e00640 1 --2- 172.21.15.112:0/2032292112 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f8c0b4140 0x7f1f8c0ad710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:12.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.296+0000 7f1f92e00640 1 -- 172.21.15.112:0/2032292112 >> 172.21.15.112:0/2032292112 conn(0x7f1f8c0b2730 msgr2=0x7f1f8c06dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:12.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.297+0000 7f1f92e00640 1 -- 172.21.15.112:0/2032292112 shutdown_connections 2024-09-12T02:51:12.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.297+0000 7f1f92e00640 1 -- 172.21.15.112:0/2032292112 wait complete. 2024-09-12T02:51:12.317 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T02:51:12.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.475+0000 7fb511c00640 1 Processor -- start 2024-09-12T02:51:12.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.475+0000 7fb511c00640 1 -- start start 2024-09-12T02:51:12.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.477+0000 7fb511c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb50c145e00 0x7fb50c15d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:12.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.477+0000 7fb511c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb50c0b31e0 0x7fb50c0b5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:12.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.477+0000 7fb511c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb50c15d550 0x7fb50c0b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:12.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.477+0000 7fb511c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb50c0b4ee0 con 0x7fb50c15d550 2024-09-12T02:51:12.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.477+0000 7fb511c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb50c0d0100 con 0x7fb50c0b31e0 2024-09-12T02:51:12.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.477+0000 7fb511c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb50c0d03e0 con 0x7fb50c145e00 2024-09-12T02:51:12.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.477+0000 7fb511200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb50c15d550 0x7fb50c0b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:12.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.477+0000 7fb511200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb50c15d550 0x7fb50c0b58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42186/0 (socket says 172.21.15.112:42186) 2024-09-12T02:51:12.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.477+0000 7fb511200640 1 -- 172.21.15.112:0/935169514 learned_addr learned my addr 172.21.15.112:0/935169514 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:12.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.477+0000 7fb50be00640 1 --2- 172.21.15.112:0/935169514 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb50c145e00 0x7fb50c15d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:12.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.477+0000 7fb50b400640 1 --2- 172.21.15.112:0/935169514 >> v2:172.21.15.137:3300/0 conn(0x7fb50c0b31e0 0x7fb50c0b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:12.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.477+0000 7fb511200640 1 -- 172.21.15.112:0/935169514 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb50c145e00 msgr2=0x7fb50c15d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:12.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.477+0000 7fb511200640 1 --2- 172.21.15.112:0/935169514 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb50c145e00 0x7fb50c15d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:12.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.477+0000 7fb511200640 1 -- 172.21.15.112:0/935169514 >> v2:172.21.15.137:3300/0 conn(0x7fb50c0b31e0 msgr2=0x7fb50c0b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:12.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.477+0000 7fb511200640 1 --2- 172.21.15.112:0/935169514 >> v2:172.21.15.137:3300/0 conn(0x7fb50c0b31e0 0x7fb50c0b5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:12.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.477+0000 7fb511200640 1 -- 172.21.15.112:0/935169514 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb50c0b4b70 con 0x7fb50c15d550 2024-09-12T02:51:12.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.478+0000 7fb511200640 1 --2- 172.21.15.112:0/935169514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb50c15d550 0x7fb50c0b58b0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fb504009e50 tx=0x7fb50402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5cf3ba6f9706a8b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:12.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.479+0000 7fb50aa00640 1 -- 172.21.15.112:0/935169514 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb504036070 con 0x7fb50c15d550 2024-09-12T02:51:12.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.479+0000 7fb50aa00640 1 -- 172.21.15.112:0/935169514 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb504031600 con 0x7fb50c15d550 2024-09-12T02:51:12.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.479+0000 7fb50aa00640 1 -- 172.21.15.112:0/935169514 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5040319d0 con 0x7fb50c15d550 2024-09-12T02:51:12.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.479+0000 7fb511c00640 1 -- 172.21.15.112:0/935169514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb50c15d550 msgr2=0x7fb50c0b58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:12.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.479+0000 7fb511c00640 1 --2- 172.21.15.112:0/935169514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb50c15d550 0x7fb50c0b58b0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fb504009e50 tx=0x7fb50402a6c0 comp rx=0 tx=0).stop 2024-09-12T02:51:12.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.479+0000 7fb511c00640 1 -- 172.21.15.112:0/935169514 shutdown_connections 2024-09-12T02:51:12.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.479+0000 7fb511c00640 1 --2- 172.21.15.112:0/935169514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb50c15d550 0x7fb50c0b58b0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:12.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.479+0000 7fb511c00640 1 --2- 172.21.15.112:0/935169514 >> v2:172.21.15.137:3300/0 conn(0x7fb50c0b31e0 0x7fb50c0b5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:12.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.479+0000 7fb511c00640 1 --2- 172.21.15.112:0/935169514 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb50c145e00 0x7fb50c15d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:12.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.479+0000 7fb511c00640 1 -- 172.21.15.112:0/935169514 >> 172.21.15.112:0/935169514 conn(0x7fb50c0b26c0 msgr2=0x7fb50c0b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:12.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.479+0000 7fb511c00640 1 -- 172.21.15.112:0/935169514 shutdown_connections 2024-09-12T02:51:12.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.480+0000 7fb511c00640 1 -- 172.21.15.112:0/935169514 wait complete. 2024-09-12T02:51:12.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.481+0000 7fb511c00640 1 Processor -- start 2024-09-12T02:51:12.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.481+0000 7fb511c00640 1 -- start start 2024-09-12T02:51:12.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.482+0000 7fb511c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb50c0b31e0 0x7fb50c1449a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:12.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.482+0000 7fb511c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb50c145e00 0x7fb50c1f54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:12.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.482+0000 7fb511c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb50c15d550 0x7fb50c1f43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:12.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.482+0000 7fb511c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb50c1464e0 con 0x7fb50c15d550 2024-09-12T02:51:12.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.482+0000 7fb511c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb50c146360 con 0x7fb50c145e00 2024-09-12T02:51:12.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.482+0000 7fb511c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb50c146660 con 0x7fb50c0b31e0 2024-09-12T02:51:12.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.482+0000 7fb511200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb50c15d550 0x7fb50c1f43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:12.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.483+0000 7fb50be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb50c0b31e0 0x7fb50c1449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:12.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.483+0000 7fb50b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb50c145e00 0x7fb50c1f54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:12.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.483+0000 7fb50be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb50c0b31e0 0x7fb50c1449a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:34970/0 (socket says 172.21.15.112:34970) 2024-09-12T02:51:12.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.483+0000 7fb50be00640 1 -- 172.21.15.112:0/1334197442 learned_addr learned my addr 172.21.15.112:0/1334197442 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:12.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.483+0000 7fb511200640 1 --2- 172.21.15.112:0/1334197442 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb50c15d550 0x7fb50c1f43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42188/0 (socket says 172.21.15.112:42188) 2024-09-12T02:51:12.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.483+0000 7fb511200640 1 -- 172.21.15.112:0/1334197442 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb50c0b31e0 msgr2=0x7fb50c1449a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:12.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.483+0000 7fb511200640 1 --2- 172.21.15.112:0/1334197442 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb50c0b31e0 0x7fb50c1449a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:12.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.483+0000 7fb511200640 1 -- 172.21.15.112:0/1334197442 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb50c145e00 msgr2=0x7fb50c1f54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:12.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.483+0000 7fb511200640 1 --2- 172.21.15.112:0/1334197442 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb50c145e00 0x7fb50c1f54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:12.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.483+0000 7fb511200640 1 -- 172.21.15.112:0/1334197442 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb50c144ee0 con 0x7fb50c15d550 2024-09-12T02:51:12.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.483+0000 7fb511200640 1 --2- 172.21.15.112:0/1334197442 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb50c15d550 0x7fb50c1f43f0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fb504030000 tx=0x7fb504004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:12.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.483+0000 7fb503e00640 1 -- 172.21.15.112:0/1334197442 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb504041020 con 0x7fb50c15d550 2024-09-12T02:51:12.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.484+0000 7fb503e00640 1 -- 172.21.15.112:0/1334197442 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5040077a0 con 0x7fb50c15d550 2024-09-12T02:51:12.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.484+0000 7fb503e00640 1 -- 172.21.15.112:0/1334197442 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb504036040 con 0x7fb50c15d550 2024-09-12T02:51:12.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.484+0000 7fb511c00640 1 -- 172.21.15.112:0/1334197442 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb50c0c7150 con 0x7fb50c15d550 2024-09-12T02:51:12.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.484+0000 7fb511c00640 1 -- 172.21.15.112:0/1334197442 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb50c071990 con 0x7fb50c15d550 2024-09-12T02:51:12.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.485+0000 7fb511c00640 1 -- 172.21.15.112:0/1334197442 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb50c15d010 con 0x7fb50c15d550 2024-09-12T02:51:12.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.486+0000 7fb503e00640 1 -- 172.21.15.112:0/1334197442 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb504044020 con 0x7fb50c15d550 2024-09-12T02:51:12.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.487+0000 7fb503e00640 1 --2- 172.21.15.112:0/1334197442 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb4ec06be30 0x7fb4ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:12.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.487+0000 7fb503e00640 1 -- 172.21.15.112:0/1334197442 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5415+0+0 (secure 0 0 0) 0x7fb5040abc60 con 0x7fb50c15d550 2024-09-12T02:51:12.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.488+0000 7fb50be00640 1 --2- 172.21.15.112:0/1334197442 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb4ec06be30 0x7fb4ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:12.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.488+0000 7fb50be00640 1 --2- 172.21.15.112:0/1334197442 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb4ec06be30 0x7fb4ec06e2f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb50c1f7920 tx=0x7fb4fc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:12.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.491+0000 7fb503e00640 1 -- 172.21.15.112:0/1334197442 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb50404b030 con 0x7fb50c15d550 2024-09-12T02:51:12.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:12.661+0000 7fb511c00640 1 -- 172.21.15.112:0/1334197442 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb50c0763b0 con 0x7fb50c15d550 2024-09-12T02:51:13.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.306+0000 7fb503e00640 1 -- 172.21.15.112:0/1334197442 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v158) ==== 169+0+0 (secure 0 0 0) 0x7fb50407a1e0 con 0x7fb50c15d550 2024-09-12T02:51:13.307 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' removed 2024-09-12T02:51:13.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.310+0000 7fb511c00640 1 -- 172.21.15.112:0/1334197442 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb4ec06be30 msgr2=0x7fb4ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:13.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.310+0000 7fb511c00640 1 --2- 172.21.15.112:0/1334197442 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb4ec06be30 0x7fb4ec06e2f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb50c1f7920 tx=0x7fb4fc009190 comp rx=0 tx=0).stop 2024-09-12T02:51:13.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.310+0000 7fb511c00640 1 -- 172.21.15.112:0/1334197442 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb50c15d550 msgr2=0x7fb50c1f43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:13.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.310+0000 7fb511c00640 1 --2- 172.21.15.112:0/1334197442 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb50c15d550 0x7fb50c1f43f0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fb504030000 tx=0x7fb504004a40 comp rx=0 tx=0).stop 2024-09-12T02:51:13.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.310+0000 7fb511c00640 1 -- 172.21.15.112:0/1334197442 shutdown_connections 2024-09-12T02:51:13.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.310+0000 7fb511c00640 1 --2- 172.21.15.112:0/1334197442 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb50c15d550 0x7fb50c1f43f0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:13.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.310+0000 7fb511c00640 1 --2- 172.21.15.112:0/1334197442 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb4ec06be30 0x7fb4ec06e2f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:13.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.310+0000 7fb511c00640 1 --2- 172.21.15.112:0/1334197442 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb50c145e00 0x7fb50c1f54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:13.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.310+0000 7fb511c00640 1 --2- 172.21.15.112:0/1334197442 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb50c0b31e0 0x7fb50c1449a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:13.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.311+0000 7fb511c00640 1 -- 172.21.15.112:0/1334197442 >> 172.21.15.112:0/1334197442 conn(0x7fb50c0b26c0 msgr2=0x7fb50c0b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:13.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.311+0000 7fb511c00640 1 -- 172.21.15.112:0/1334197442 shutdown_connections 2024-09-12T02:51:13.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.311+0000 7fb511c00640 1 -- 172.21.15.112:0/1334197442 wait complete. 2024-09-12T02:51:13.330 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T02:51:13.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.487+0000 7ff405200640 1 Processor -- start 2024-09-12T02:51:13.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.487+0000 7ff405200640 1 -- start start 2024-09-12T02:51:13.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.488+0000 7ff405200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff4000d28d0 0x7ff4000b2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:13.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.488+0000 7ff405200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4000d2fb0 con 0x7ff4000d1710 2024-09-12T02:51:13.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.488+0000 7ff405200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4000d0b60 con 0x7ff4000b3e00 2024-09-12T02:51:13.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.488+0000 7ff405200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff4000d3cb0 con 0x7ff4000d28d0 2024-09-12T02:51:13.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.488+0000 7ff3ff400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff4000d1710 0x7ff4000d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58678/0 (socket says 172.21.15.112:58678) 2024-09-12T02:51:13.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.489+0000 7ff3ff400640 1 -- 172.21.15.112:0/3974116699 learned_addr learned my addr 172.21.15.112:0/3974116699 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:51:13.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.489+0000 7ff3fea00640 1 -- 172.21.15.112:0/3974116699 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2569652778 0 0) 0x7ff4000d2fb0 con 0x7ff4000d1710 2024-09-12T02:51:13.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.489+0000 7ff3ffe00640 1 --2- 172.21.15.112:0/3974116699 >> v2:172.21.15.137:3300/0 conn(0x7ff4000d28d0 0x7ff4000b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:13.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.489+0000 7ff3fea00640 1 -- 172.21.15.112:0/3974116699 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3e4003520 con 0x7ff4000d1710 2024-09-12T02:51:13.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.489+0000 7ff3fea00640 1 -- 172.21.15.112:0/3974116699 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 656661790 0 0) 0x7ff3e4003520 con 0x7ff4000d1710 2024-09-12T02:51:13.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.489+0000 7ff3fea00640 1 -- 172.21.15.112:0/3974116699 >> v2:172.21.15.137:3300/0 conn(0x7ff4000d28d0 msgr2=0x7ff4000b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:13.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.489+0000 7ff3fea00640 1 --2- 172.21.15.112:0/3974116699 >> v2:172.21.15.137:3300/0 conn(0x7ff4000d28d0 0x7ff4000b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:13.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.489+0000 7ff3fea00640 1 -- 172.21.15.112:0/3974116699 >> v1:172.21.15.137:6789/0 conn(0x7ff4000b3e00 legacy=0x7ff4000b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:13.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.489+0000 7ff3fea00640 1 -- 172.21.15.112:0/3974116699 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4000d3410 con 0x7ff4000d1710 2024-09-12T02:51:13.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.489+0000 7ff3fea00640 1 -- 172.21.15.112:0/3974116699 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7ff3f0001670 con 0x7ff4000d1710 2024-09-12T02:51:13.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.489+0000 7ff3fea00640 1 -- 172.21.15.112:0/3974116699 >> v1:172.21.15.112:6789/0 conn(0x7ff4000d1710 legacy=0x7ff4000d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:13.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.489+0000 7ff3fea00640 1 --2- 172.21.15.112:0/3974116699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3e4003a00 0x7ff3e4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:13.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.489+0000 7ff3fea00640 1 --2- 172.21.15.112:0/3974116699 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3e4004800 0x7ff3e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:13.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.489+0000 7ff3fea00640 1 --2- 172.21.15.112:0/3974116699 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3e40051c0 0x7ff3e400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:13.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.489+0000 7ff3fea00640 1 -- 172.21.15.112:0/3974116699 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff4000d3cb0 con 0x7ff3e4003a00 2024-09-12T02:51:13.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.489+0000 7ff3fea00640 1 -- 172.21.15.112:0/3974116699 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e400c0c0 con 0x7ff3e4004800 2024-09-12T02:51:13.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.489+0000 7ff3fea00640 1 -- 172.21.15.112:0/3974116699 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff3e400c2c0 con 0x7ff3e40051c0 2024-09-12T02:51:13.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.490+0000 7ff3ff400640 1 --2- 172.21.15.112:0/3974116699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3e4003a00 0x7ff3e4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:13.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.490+0000 7ff3f7e00640 1 --2- 172.21.15.112:0/3974116699 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3e4004800 0x7ff3e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:13.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.490+0000 7ff3ffe00640 1 --2- 172.21.15.112:0/3974116699 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3e40051c0 0x7ff3e400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:13.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.490+0000 7ff3ff400640 1 -- 172.21.15.112:0/3974116699 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3e40051c0 msgr2=0x7ff3e400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:13.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.490+0000 7ff3ff400640 1 --2- 172.21.15.112:0/3974116699 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff3e40051c0 0x7ff3e400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:13.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.490+0000 7ff3ff400640 1 -- 172.21.15.112:0/3974116699 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3e4004800 msgr2=0x7ff3e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:13.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.490+0000 7ff3ff400640 1 --2- 172.21.15.112:0/3974116699 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3e4004800 0x7ff3e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:13.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.490+0000 7ff3ff400640 1 -- 172.21.15.112:0/3974116699 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e4003520 con 0x7ff3e4003a00 2024-09-12T02:51:13.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.490+0000 7ff3ffe00640 1 -- 172.21.15.112:0/3974116699 reap_dead start 2024-09-12T02:51:13.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.491+0000 7ff3ff400640 1 --2- 172.21.15.112:0/3974116699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3e4003a00 0x7ff3e4003e20 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7ff3f000c190 tx=0x7ff3e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88dc391840e220dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:13.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.491+0000 7ff3fea00640 1 -- 172.21.15.112:0/3974116699 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0007c60 con 0x7ff3e4003a00 2024-09-12T02:51:13.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.491+0000 7ff3fea00640 1 -- 172.21.15.112:0/3974116699 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3f0005ad0 con 0x7ff3e4003a00 2024-09-12T02:51:13.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.491+0000 7ff3fea00640 1 -- 172.21.15.112:0/3974116699 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0007070 con 0x7ff3e4003a00 2024-09-12T02:51:13.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.492+0000 7ff405200640 1 -- 172.21.15.112:0/3974116699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3e4003a00 msgr2=0x7ff3e4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:13.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.492+0000 7ff405200640 1 --2- 172.21.15.112:0/3974116699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3e4003a00 0x7ff3e4003e20 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7ff3f000c190 tx=0x7ff3e4005830 comp rx=0 tx=0).stop 2024-09-12T02:51:13.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.492+0000 7ff405200640 1 -- 172.21.15.112:0/3974116699 shutdown_connections 2024-09-12T02:51:13.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.492+0000 7ff405200640 1 --2- 172.21.15.112:0/3974116699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3e4003a00 0x7ff3e4003e20 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:13.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.492+0000 7ff405200640 1 -- 172.21.15.112:0/3974116699 >> 172.21.15.112:0/3974116699 conn(0x7ff40009e030 msgr2=0x7ff4000d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:13.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.492+0000 7ff405200640 1 -- 172.21.15.112:0/3974116699 shutdown_connections 2024-09-12T02:51:13.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.492+0000 7ff405200640 1 -- 172.21.15.112:0/3974116699 wait complete. 2024-09-12T02:51:13.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.494+0000 7ff405200640 1 Processor -- start 2024-09-12T02:51:13.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.494+0000 7ff405200640 1 -- start start 2024-09-12T02:51:13.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.494+0000 7ff405200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3e4003a00 0x7ff4000c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:13.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.494+0000 7ff405200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4000b85a0 0x7ff4001581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:13.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.495+0000 7ff405200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4001615f0 0x7ff4000ce680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:13.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.495+0000 7ff405200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff4000d39d0 con 0x7ff3e4003a00 2024-09-12T02:51:13.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.495+0000 7ff405200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff4000d2d60 con 0x7ff4000b85a0 2024-09-12T02:51:13.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.495+0000 7ff405200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff40015f110 con 0x7ff4001615f0 2024-09-12T02:51:13.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.495+0000 7ff3ff400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3e4003a00 0x7ff4000c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:13.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.495+0000 7ff3ff400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3e4003a00 0x7ff4000c95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42202/0 (socket says 172.21.15.112:42202) 2024-09-12T02:51:13.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.495+0000 7ff3ff400640 1 -- 172.21.15.112:0/3219764398 learned_addr learned my addr 172.21.15.112:0/3219764398 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:13.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.495+0000 7ff3ff400640 1 -- 172.21.15.112:0/3219764398 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4001615f0 msgr2=0x7ff4000ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:13.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.495+0000 7ff3ff400640 1 --2- 172.21.15.112:0/3219764398 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4001615f0 0x7ff4000ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:13.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.495+0000 7ff3ff400640 1 -- 172.21.15.112:0/3219764398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4000b85a0 msgr2=0x7ff4001581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:13.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.495+0000 7ff3ff400640 1 --2- 172.21.15.112:0/3219764398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4000b85a0 0x7ff4001581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:13.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.495+0000 7ff3ff400640 1 -- 172.21.15.112:0/3219764398 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4001601a0 con 0x7ff3e4003a00 2024-09-12T02:51:13.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.495+0000 7ff3ff400640 1 --2- 172.21.15.112:0/3219764398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3e4003a00 0x7ff4000c95e0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7ff3f000c190 tx=0x7ff3f0001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:13.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.496+0000 7ff3f7400640 1 -- 172.21.15.112:0/3219764398 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f003f070 con 0x7ff3e4003a00 2024-09-12T02:51:13.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.496+0000 7ff3f7400640 1 -- 172.21.15.112:0/3219764398 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3f0001470 con 0x7ff3e4003a00 2024-09-12T02:51:13.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.496+0000 7ff3f7400640 1 -- 172.21.15.112:0/3219764398 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0005930 con 0x7ff3e4003a00 2024-09-12T02:51:13.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.496+0000 7ff405200640 1 -- 172.21.15.112:0/3219764398 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff400162470 con 0x7ff3e4003a00 2024-09-12T02:51:13.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.496+0000 7ff405200640 1 -- 172.21.15.112:0/3219764398 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff400161eb0 con 0x7ff3e4003a00 2024-09-12T02:51:13.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.497+0000 7ff405200640 1 -- 172.21.15.112:0/3219764398 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4000d1af0 con 0x7ff3e4003a00 2024-09-12T02:51:13.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.498+0000 7ff3f7400640 1 -- 172.21.15.112:0/3219764398 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff3f0042070 con 0x7ff3e4003a00 2024-09-12T02:51:13.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.499+0000 7ff3f7400640 1 --2- 172.21.15.112:0/3219764398 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff3dc06be30 0x7ff3dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:13.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.499+0000 7ff3f7400640 1 -- 172.21.15.112:0/3219764398 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 4943+0+0 (secure 0 0 0) 0x7ff3f00aa810 con 0x7ff3e4003a00 2024-09-12T02:51:13.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.499+0000 7ff3f7e00640 1 --2- 172.21.15.112:0/3219764398 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff3dc06be30 0x7ff3dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:13.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.499+0000 7ff3f7e00640 1 --2- 172.21.15.112:0/3219764398 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff3dc06be30 0x7ff3dc06e2f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8000c00 tx=0x7ff3e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:13.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.503+0000 7ff3f7400640 1 -- 172.21.15.112:0/3219764398 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff3f0049030 con 0x7ff3e4003a00 2024-09-12T02:51:13.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.675+0000 7ff405200640 1 -- 172.21.15.112:0/3219764398 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7ff4000b27f0 con 0x7ff3e4003a00 2024-09-12T02:51:13.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.679+0000 7ff3f7400640 1 -- 172.21.15.112:0/3219764398 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7ff3f00794c0 con 0x7ff3e4003a00 2024-09-12T02:51:13.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.681+0000 7ff405200640 1 -- 172.21.15.112:0/3219764398 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff3dc06be30 msgr2=0x7ff3dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:13.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.681+0000 7ff405200640 1 --2- 172.21.15.112:0/3219764398 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff3dc06be30 0x7ff3dc06e2f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8000c00 tx=0x7ff3e8009040 comp rx=0 tx=0).stop 2024-09-12T02:51:13.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.681+0000 7ff405200640 1 -- 172.21.15.112:0/3219764398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3e4003a00 msgr2=0x7ff4000c95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:13.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.681+0000 7ff405200640 1 --2- 172.21.15.112:0/3219764398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3e4003a00 0x7ff4000c95e0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7ff3f000c190 tx=0x7ff3f0001970 comp rx=0 tx=0).stop 2024-09-12T02:51:13.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.682+0000 7ff405200640 1 -- 172.21.15.112:0/3219764398 shutdown_connections 2024-09-12T02:51:13.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.682+0000 7ff405200640 1 --2- 172.21.15.112:0/3219764398 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4001615f0 0x7ff4000ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:13.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.682+0000 7ff405200640 1 --2- 172.21.15.112:0/3219764398 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff3dc06be30 0x7ff3dc06e2f0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:13.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.682+0000 7ff405200640 1 --2- 172.21.15.112:0/3219764398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4000b85a0 0x7ff4001581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:13.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.682+0000 7ff405200640 1 --2- 172.21.15.112:0/3219764398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3e4003a00 0x7ff4000c95e0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:13.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.682+0000 7ff405200640 1 -- 172.21.15.112:0/3219764398 >> 172.21.15.112:0/3219764398 conn(0x7ff40009e030 msgr2=0x7ff4000d4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:13.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.682+0000 7ff405200640 1 -- 172.21.15.112:0/3219764398 shutdown_connections 2024-09-12T02:51:13.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.682+0000 7ff405200640 1 -- 172.21.15.112:0/3219764398 wait complete. 2024-09-12T02:51:13.701 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2024-09-12T02:51:13.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.853+0000 7fb62c400640 1 Processor -- start 2024-09-12T02:51:13.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.853+0000 7fb62c400640 1 -- start start 2024-09-12T02:51:13.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.854+0000 7fb62c400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb62415b9d0 0x7fb6240b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:13.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.854+0000 7fb62c400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb62406f600 0x7fb6240728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:13.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.854+0000 7fb62c400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6240b54a0 con 0x7fb6240b45d0 2024-09-12T02:51:13.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.854+0000 7fb62c400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb6240b4a60 con 0x7fb62415b9d0 2024-09-12T02:51:13.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.854+0000 7fb62c400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb6240b3af0 con 0x7fb62406f600 2024-09-12T02:51:13.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.854+0000 7fb629a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb62415b9d0 0x7fb6240b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:13.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.854+0000 7fb629a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb62415b9d0 0x7fb6240b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42210/0 (socket says 172.21.15.112:42210) 2024-09-12T02:51:13.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.854+0000 7fb629a00640 1 -- 172.21.15.112:0/2111717847 learned_addr learned my addr 172.21.15.112:0/2111717847 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:13.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.854+0000 7fb62a400640 1 --2- 172.21.15.112:0/2111717847 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb62406f600 0x7fb6240728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:13.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.855+0000 7fb629a00640 1 -- 172.21.15.112:0/2111717847 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb62406f600 msgr2=0x7fb6240728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:13.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.855+0000 7fb629a00640 1 --2- 172.21.15.112:0/2111717847 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb62406f600 0x7fb6240728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:13.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.855+0000 7fb629a00640 1 -- 172.21.15.112:0/2111717847 >> v1:172.21.15.137:6789/0 conn(0x7fb6240b45d0 legacy=0x7fb62406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:13.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.855+0000 7fb629a00640 1 -- 172.21.15.112:0/2111717847 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6240b3dd0 con 0x7fb62415b9d0 2024-09-12T02:51:13.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.856+0000 7fb629a00640 1 --2- 172.21.15.112:0/2111717847 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb62415b9d0 0x7fb6240b4ec0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fb618009870 tx=0x7fb61802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98390b54314beb9d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:13.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.856+0000 7fb623e00640 1 -- 172.21.15.112:0/2111717847 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb618037070 con 0x7fb62415b9d0 2024-09-12T02:51:13.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.856+0000 7fb623e00640 1 -- 172.21.15.112:0/2111717847 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb618032440 con 0x7fb62415b9d0 2024-09-12T02:51:13.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.856+0000 7fb623e00640 1 -- 172.21.15.112:0/2111717847 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb618032810 con 0x7fb62415b9d0 2024-09-12T02:51:13.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.856+0000 7fb62c400640 1 -- 172.21.15.112:0/2111717847 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb62415b9d0 msgr2=0x7fb6240b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:13.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.856+0000 7fb62c400640 1 --2- 172.21.15.112:0/2111717847 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb62415b9d0 0x7fb6240b4ec0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fb618009870 tx=0x7fb61802a250 comp rx=0 tx=0).stop 2024-09-12T02:51:13.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.856+0000 7fb62c400640 1 -- 172.21.15.112:0/2111717847 shutdown_connections 2024-09-12T02:51:13.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.856+0000 7fb62c400640 1 --2- 172.21.15.112:0/2111717847 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb62406f600 0x7fb6240728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:13.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.856+0000 7fb62c400640 1 --2- 172.21.15.112:0/2111717847 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb62415b9d0 0x7fb6240b4ec0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:13.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.856+0000 7fb62c400640 1 -- 172.21.15.112:0/2111717847 >> 172.21.15.112:0/2111717847 conn(0x7fb62406bbd0 msgr2=0x7fb62406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:13.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.857+0000 7fb62c400640 1 -- 172.21.15.112:0/2111717847 shutdown_connections 2024-09-12T02:51:13.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.857+0000 7fb62c400640 1 -- 172.21.15.112:0/2111717847 wait complete. 2024-09-12T02:51:13.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.858+0000 7fb62c400640 1 Processor -- start 2024-09-12T02:51:13.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.858+0000 7fb62c400640 1 -- start start 2024-09-12T02:51:13.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.859+0000 7fb62c400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb62406f600 0x7fb6241f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:13.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.859+0000 7fb62c400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6240b45d0 0x7fb6241532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:13.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.859+0000 7fb62c400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb62415b9d0 0x7fb6240aa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:13.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.859+0000 7fb62c400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb62415bf30 con 0x7fb62415b9d0 2024-09-12T02:51:13.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.859+0000 7fb62c400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb62415bdb0 con 0x7fb6240b45d0 2024-09-12T02:51:13.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.859+0000 7fb62c400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb6240cdcd0 con 0x7fb62406f600 2024-09-12T02:51:13.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.859+0000 7fb62a400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb62415b9d0 0x7fb6240aa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:13.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.859+0000 7fb62a400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb62415b9d0 0x7fb6240aa4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42224/0 (socket says 172.21.15.112:42224) 2024-09-12T02:51:13.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.859+0000 7fb62a400640 1 -- 172.21.15.112:0/2566135093 learned_addr learned my addr 172.21.15.112:0/2566135093 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:13.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.859+0000 7fb629000640 1 --2- 172.21.15.112:0/2566135093 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6240b45d0 0x7fb6241532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:13.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.860+0000 7fb629a00640 1 --2- 172.21.15.112:0/2566135093 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb62406f600 0x7fb6241f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:13.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.860+0000 7fb62a400640 1 -- 172.21.15.112:0/2566135093 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb62406f600 msgr2=0x7fb6241f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:13.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.860+0000 7fb62a400640 1 --2- 172.21.15.112:0/2566135093 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb62406f600 0x7fb6241f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:13.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.860+0000 7fb62a400640 1 -- 172.21.15.112:0/2566135093 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6240b45d0 msgr2=0x7fb6241532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:13.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.860+0000 7fb62a400640 1 --2- 172.21.15.112:0/2566135093 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6240b45d0 0x7fb6241532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:13.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.860+0000 7fb62a400640 1 -- 172.21.15.112:0/2566135093 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb624153d30 con 0x7fb62415b9d0 2024-09-12T02:51:13.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.860+0000 7fb62a400640 1 --2- 172.21.15.112:0/2566135093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb62415b9d0 0x7fb6240aa4c0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fb61c007e60 tx=0x7fb61c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:13.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.860+0000 7fb621600640 1 -- 172.21.15.112:0/2566135093 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61c014620 con 0x7fb62415b9d0 2024-09-12T02:51:13.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.860+0000 7fb621600640 1 -- 172.21.15.112:0/2566135093 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb61c019070 con 0x7fb62415b9d0 2024-09-12T02:51:13.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.860+0000 7fb621600640 1 -- 172.21.15.112:0/2566135093 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61c014a00 con 0x7fb62415b9d0 2024-09-12T02:51:13.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.860+0000 7fb62c400640 1 -- 172.21.15.112:0/2566135093 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb624154010 con 0x7fb62415b9d0 2024-09-12T02:51:13.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.861+0000 7fb62c400640 1 -- 172.21.15.112:0/2566135093 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6241545d0 con 0x7fb62415b9d0 2024-09-12T02:51:13.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.862+0000 7fb62c400640 1 -- 172.21.15.112:0/2566135093 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb624068a30 con 0x7fb62415b9d0 2024-09-12T02:51:13.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.863+0000 7fb621600640 1 -- 172.21.15.112:0/2566135093 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb61c014ba0 con 0x7fb62415b9d0 2024-09-12T02:51:13.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.864+0000 7fb621600640 1 --2- 172.21.15.112:0/2566135093 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb60406be30 0x7fb60406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:13.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.864+0000 7fb621600640 1 -- 172.21.15.112:0/2566135093 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 4943+0+0 (secure 0 0 0) 0x7fb61c08b360 con 0x7fb62415b9d0 2024-09-12T02:51:13.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.864+0000 7fb629a00640 1 --2- 172.21.15.112:0/2566135093 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb60406be30 0x7fb60406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:13.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.864+0000 7fb629a00640 1 --2- 172.21.15.112:0/2566135093 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb60406be30 0x7fb60406e2f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb618034000 tx=0x7fb61802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:13.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:13.868+0000 7fb621600640 1 -- 172.21.15.112:0/2566135093 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb61c0599b0 con 0x7fb62415b9d0 2024-09-12T02:51:14.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.104+0000 7fb62c400640 1 -- 172.21.15.112:0/2566135093 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) -- 0x7fb62406dbc0 con 0x7fb62415b9d0 2024-09-12T02:51:14.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.307+0000 7fb621600640 1 -- 172.21.15.112:0/2566135093 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v449) ==== 132+0+0 (secure 0 0 0) 0x7fb61c05dcb0 con 0x7fb62415b9d0 2024-09-12T02:51:14.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.310+0000 7fb62c400640 1 -- 172.21.15.112:0/2566135093 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb60406be30 msgr2=0x7fb60406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:14.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.310+0000 7fb62c400640 1 --2- 172.21.15.112:0/2566135093 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb60406be30 0x7fb60406e2f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb618034000 tx=0x7fb61802e000 comp rx=0 tx=0).stop 2024-09-12T02:51:14.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.310+0000 7fb62c400640 1 -- 172.21.15.112:0/2566135093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb62415b9d0 msgr2=0x7fb6240aa4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:14.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.310+0000 7fb62c400640 1 --2- 172.21.15.112:0/2566135093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb62415b9d0 0x7fb6240aa4c0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fb61c007e60 tx=0x7fb61c00e4b0 comp rx=0 tx=0).stop 2024-09-12T02:51:14.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.310+0000 7fb62c400640 1 -- 172.21.15.112:0/2566135093 shutdown_connections 2024-09-12T02:51:14.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.310+0000 7fb62c400640 1 --2- 172.21.15.112:0/2566135093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb62415b9d0 0x7fb6240aa4c0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:14.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.310+0000 7fb62c400640 1 --2- 172.21.15.112:0/2566135093 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb60406be30 0x7fb60406e2f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:14.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.310+0000 7fb62c400640 1 --2- 172.21.15.112:0/2566135093 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6240b45d0 0x7fb6241532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:14.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.310+0000 7fb62c400640 1 --2- 172.21.15.112:0/2566135093 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb62406f600 0x7fb6241f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:14.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.310+0000 7fb62c400640 1 -- 172.21.15.112:0/2566135093 >> 172.21.15.112:0/2566135093 conn(0x7fb62406bbd0 msgr2=0x7fb6240d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:14.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.310+0000 7fb62c400640 1 -- 172.21.15.112:0/2566135093 shutdown_connections 2024-09-12T02:51:14.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.310+0000 7fb62c400640 1 -- 172.21.15.112:0/2566135093 wait complete. 2024-09-12T02:51:14.327 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) ... ok 2024-09-12T02:51:14.328 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) That when the full flag is encountered during asynchronous 2024-09-12T02:51:14.328 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) 2024-09-12T02:51:14.329 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:51:14.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.480+0000 7f7331000640 1 Processor -- start 2024-09-12T02:51:14.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.480+0000 7f7331000640 1 -- start start 2024-09-12T02:51:14.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.481+0000 7f7331000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f732c15b9d0 0x7f732c0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:14.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.482+0000 7f7331000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f732c0b54a0 con 0x7f732c06f600 2024-09-12T02:51:14.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.482+0000 7f7331000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f732c0b3af0 con 0x7f732c0b45d0 2024-09-12T02:51:14.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.482+0000 7f7331000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f732c0b4a60 con 0x7f732c15b9d0 2024-09-12T02:51:14.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.482+0000 7f732a800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f732c06f600 0x7f732c0cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58694/0 (socket says 172.21.15.112:58694) 2024-09-12T02:51:14.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.482+0000 7f732a800640 1 -- 172.21.15.112:0/248329562 learned_addr learned my addr 172.21.15.112:0/248329562 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:51:14.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.482+0000 7f7329e00640 1 --2- 172.21.15.112:0/248329562 >> v2:172.21.15.137:3300/0 conn(0x7f732c15b9d0 0x7f732c0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:14.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.482+0000 7f7329400640 1 -- 172.21.15.112:0/248329562 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1965543998 0 0) 0x7f732c0b54a0 con 0x7f732c06f600 2024-09-12T02:51:14.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.482+0000 7f7329400640 1 -- 172.21.15.112:0/248329562 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7310003520 con 0x7f732c06f600 2024-09-12T02:51:14.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.483+0000 7f7329400640 1 -- 172.21.15.112:0/248329562 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1862140971 0 0) 0x7f732c0b3af0 con 0x7f732c0b45d0 2024-09-12T02:51:14.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.483+0000 7f7329400640 1 -- 172.21.15.112:0/248329562 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f732c0b54a0 con 0x7f732c0b45d0 2024-09-12T02:51:14.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.483+0000 7f7329400640 1 -- 172.21.15.112:0/248329562 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2628551717 0 0) 0x7f7310003520 con 0x7f732c06f600 2024-09-12T02:51:14.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.483+0000 7f7329400640 1 -- 172.21.15.112:0/248329562 >> v2:172.21.15.137:3300/0 conn(0x7f732c15b9d0 msgr2=0x7f732c0b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:14.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.483+0000 7f7329400640 1 --2- 172.21.15.112:0/248329562 >> v2:172.21.15.137:3300/0 conn(0x7f732c15b9d0 0x7f732c0b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:14.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.483+0000 7f7329400640 1 -- 172.21.15.112:0/248329562 >> v1:172.21.15.137:6789/0 conn(0x7f732c0b45d0 legacy=0x7f732c06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:14.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.483+0000 7f7329400640 1 -- 172.21.15.112:0/248329562 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f732c0b3dd0 con 0x7f732c06f600 2024-09-12T02:51:14.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.483+0000 7f7329400640 1 -- 172.21.15.112:0/248329562 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f73240019f0 con 0x7f732c06f600 2024-09-12T02:51:14.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.483+0000 7f7329400640 1 -- 172.21.15.112:0/248329562 >> v1:172.21.15.112:6789/0 conn(0x7f732c06f600 legacy=0x7f732c0cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:14.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.483+0000 7f7329400640 1 --2- 172.21.15.112:0/248329562 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7310003b40 0x7f7310003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:14.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.483+0000 7f7329400640 1 --2- 172.21.15.112:0/248329562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7310004800 0x7f7310004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:14.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.483+0000 7f7329400640 1 --2- 172.21.15.112:0/248329562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73100051c0 0x7f731000dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:14.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.483+0000 7f7329400640 1 -- 172.21.15.112:0/248329562 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f731000e2a0 con 0x7f73100051c0 2024-09-12T02:51:14.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.483+0000 7f7329400640 1 -- 172.21.15.112:0/248329562 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f731000e420 con 0x7f7310004800 2024-09-12T02:51:14.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.483+0000 7f7329400640 1 -- 172.21.15.112:0/248329562 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f731000e620 con 0x7f7310003b40 2024-09-12T02:51:14.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.483+0000 7f732a800640 1 --2- 172.21.15.112:0/248329562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73100051c0 0x7f731000dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:14.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.483+0000 7f7329e00640 1 --2- 172.21.15.112:0/248329562 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7310003b40 0x7f7310003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:14.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.483+0000 7f7321400640 1 --2- 172.21.15.112:0/248329562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7310004800 0x7f7310004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:14.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.483+0000 7f732a800640 1 -- 172.21.15.112:0/248329562 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7310003b40 msgr2=0x7f7310003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:14.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.483+0000 7f732a800640 1 --2- 172.21.15.112:0/248329562 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7310003b40 0x7f7310003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:14.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.484+0000 7f732a800640 1 -- 172.21.15.112:0/248329562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7310004800 msgr2=0x7f7310004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:14.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.484+0000 7f732a800640 1 --2- 172.21.15.112:0/248329562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7310004800 0x7f7310004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:14.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.484+0000 7f732a800640 1 -- 172.21.15.112:0/248329562 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f732c0b3dd0 con 0x7f73100051c0 2024-09-12T02:51:14.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.485+0000 7f732a800640 1 -- 172.21.15.112:0/248329562 reap_dead start 2024-09-12T02:51:14.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.485+0000 7f732a800640 1 --2- 172.21.15.112:0/248329562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73100051c0 0x7f731000dbd0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f732400a970 tx=0x7f7310005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf490a10eb849d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:14.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.485+0000 7f7329400640 1 -- 172.21.15.112:0/248329562 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f732400a540 con 0x7f73100051c0 2024-09-12T02:51:14.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.485+0000 7f7329400640 1 -- 172.21.15.112:0/248329562 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f732402f070 con 0x7f73100051c0 2024-09-12T02:51:14.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.485+0000 7f7329400640 1 -- 172.21.15.112:0/248329562 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f732402bd90 con 0x7f73100051c0 2024-09-12T02:51:14.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.486+0000 7f7331000640 1 -- 172.21.15.112:0/248329562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73100051c0 msgr2=0x7f731000dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:14.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.486+0000 7f7331000640 1 --2- 172.21.15.112:0/248329562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73100051c0 0x7f731000dbd0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f732400a970 tx=0x7f7310005830 comp rx=0 tx=0).stop 2024-09-12T02:51:14.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.486+0000 7f7331000640 1 -- 172.21.15.112:0/248329562 shutdown_connections 2024-09-12T02:51:14.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.486+0000 7f7331000640 1 --2- 172.21.15.112:0/248329562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73100051c0 0x7f731000dbd0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:14.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.486+0000 7f7331000640 1 -- 172.21.15.112:0/248329562 >> 172.21.15.112:0/248329562 conn(0x7f732c06bbd0 msgr2=0x7f732c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:14.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.486+0000 7f7331000640 1 -- 172.21.15.112:0/248329562 shutdown_connections 2024-09-12T02:51:14.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.486+0000 7f7331000640 1 -- 172.21.15.112:0/248329562 wait complete. 2024-09-12T02:51:14.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.487+0000 7f7331000640 1 Processor -- start 2024-09-12T02:51:14.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.488+0000 7f7331000640 1 -- start start 2024-09-12T02:51:14.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.488+0000 7f7331000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73100051c0 0x7f732c15eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:14.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.488+0000 7f7331000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f732c14b820 0x7f732c1543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:14.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.488+0000 7f7331000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f732c154920 0x7f732c15a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:14.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.488+0000 7f7331000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f732c15bf30 con 0x7f73100051c0 2024-09-12T02:51:14.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.488+0000 7f7331000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f732c15bdb0 con 0x7f732c14b820 2024-09-12T02:51:14.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.488+0000 7f7331000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f732c0b4ec0 con 0x7f732c154920 2024-09-12T02:51:14.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.489+0000 7f7329e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73100051c0 0x7f732c15eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:14.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.489+0000 7f7329e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73100051c0 0x7f732c15eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42242/0 (socket says 172.21.15.112:42242) 2024-09-12T02:51:14.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.489+0000 7f7329e00640 1 -- 172.21.15.112:0/4091200262 learned_addr learned my addr 172.21.15.112:0/4091200262 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:14.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.489+0000 7f7321400640 1 --2- 172.21.15.112:0/4091200262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f732c14b820 0x7f732c1543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:14.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.489+0000 7f7329e00640 1 -- 172.21.15.112:0/4091200262 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f732c154920 msgr2=0x7f732c15a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:14.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.489+0000 7f7329e00640 1 --2- 172.21.15.112:0/4091200262 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f732c154920 0x7f732c15a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:14.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.489+0000 7f7329e00640 1 -- 172.21.15.112:0/4091200262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f732c14b820 msgr2=0x7f732c1543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:14.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.489+0000 7f7329e00640 1 --2- 172.21.15.112:0/4091200262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f732c14b820 0x7f732c1543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:14.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.489+0000 7f7329e00640 1 -- 172.21.15.112:0/4091200262 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f732c14b5c0 con 0x7f73100051c0 2024-09-12T02:51:14.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.489+0000 7f7321400640 1 --2- 172.21.15.112:0/4091200262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f732c14b820 0x7f732c1543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:51:14.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.489+0000 7f7329e00640 1 --2- 172.21.15.112:0/4091200262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73100051c0 0x7f732c15eec0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f731c011910 tx=0x7f731c011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:14.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.490+0000 7f7322a00640 1 -- 172.21.15.112:0/4091200262 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731c00faf0 con 0x7f73100051c0 2024-09-12T02:51:14.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.490+0000 7f7322a00640 1 -- 172.21.15.112:0/4091200262 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f731c00fc90 con 0x7f73100051c0 2024-09-12T02:51:14.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.490+0000 7f7331000640 1 -- 172.21.15.112:0/4091200262 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f732c154de0 con 0x7f73100051c0 2024-09-12T02:51:14.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.490+0000 7f7322a00640 1 -- 172.21.15.112:0/4091200262 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731c014440 con 0x7f73100051c0 2024-09-12T02:51:14.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.490+0000 7f7331000640 1 -- 172.21.15.112:0/4091200262 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f732c1553a0 con 0x7f73100051c0 2024-09-12T02:51:14.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.491+0000 7f7331000640 1 -- 172.21.15.112:0/4091200262 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f732c068a30 con 0x7f73100051c0 2024-09-12T02:51:14.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.492+0000 7f7322a00640 1 -- 172.21.15.112:0/4091200262 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f731c012040 con 0x7f73100051c0 2024-09-12T02:51:14.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.493+0000 7f7322a00640 1 --2- 172.21.15.112:0/4091200262 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f730806be30 0x7f730806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:14.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.493+0000 7f7322a00640 1 -- 172.21.15.112:0/4091200262 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 4943+0+0 (secure 0 0 0) 0x7f731c08b190 con 0x7f73100051c0 2024-09-12T02:51:14.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.493+0000 7f7321400640 1 --2- 172.21.15.112:0/4091200262 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f730806be30 0x7f730806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:14.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.494+0000 7f7321400640 1 --2- 172.21.15.112:0/4091200262 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f730806be30 0x7f730806e2f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7314000c00 tx=0x7f7314009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:14.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.497+0000 7f7322a00640 1 -- 172.21.15.112:0/4091200262 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f731c019030 con 0x7f73100051c0 2024-09-12T02:51:14.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.671+0000 7f7331000640 1 -- 172.21.15.112:0/4091200262 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f732c0cd5f0 con 0x7f73100051c0 2024-09-12T02:51:14.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.672+0000 7f7322a00640 1 -- 172.21.15.112:0/4091200262 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) ==== 74+0+13093 (secure 0 0 0) 0x7f731c059e50 con 0x7f73100051c0 2024-09-12T02:51:14.673 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:51:14.673 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":158,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:51:13.302425+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6835/1000067194":"2024-09-13T02:51:10.202376+0000","172.21.15.137:6833/1000067194":"2024-09-13T02:51:10.202376+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:51:14.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.674+0000 7f7331000640 1 -- 172.21.15.112:0/4091200262 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f730806be30 msgr2=0x7f730806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:14.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.674+0000 7f7331000640 1 --2- 172.21.15.112:0/4091200262 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f730806be30 0x7f730806e2f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7314000c00 tx=0x7f7314009040 comp rx=0 tx=0).stop 2024-09-12T02:51:14.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.674+0000 7f7331000640 1 -- 172.21.15.112:0/4091200262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73100051c0 msgr2=0x7f732c15eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:14.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.674+0000 7f7331000640 1 --2- 172.21.15.112:0/4091200262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73100051c0 0x7f732c15eec0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f731c011910 tx=0x7f731c011dd0 comp rx=0 tx=0).stop 2024-09-12T02:51:14.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.674+0000 7f7331000640 1 -- 172.21.15.112:0/4091200262 shutdown_connections 2024-09-12T02:51:14.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.674+0000 7f7331000640 1 --2- 172.21.15.112:0/4091200262 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f732c154920 0x7f732c15a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:14.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.674+0000 7f7331000640 1 --2- 172.21.15.112:0/4091200262 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f730806be30 0x7f730806e2f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:14.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.674+0000 7f7331000640 1 --2- 172.21.15.112:0/4091200262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f732c14b820 0x7f732c1543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:14.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.674+0000 7f7331000640 1 --2- 172.21.15.112:0/4091200262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73100051c0 0x7f732c15eec0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:14.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.674+0000 7f7331000640 1 -- 172.21.15.112:0/4091200262 >> 172.21.15.112:0/4091200262 conn(0x7f732c06bbd0 msgr2=0x7f732c0b0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:14.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.674+0000 7f7331000640 1 -- 172.21.15.112:0/4091200262 shutdown_connections 2024-09-12T02:51:14.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.674+0000 7f7331000640 1 -- 172.21.15.112:0/4091200262 wait complete. 2024-09-12T02:51:14.690 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:41:43.011599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:51:14.691 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T02:51:14.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.845+0000 7f18d5200640 1 Processor -- start 2024-09-12T02:51:14.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.846+0000 7f18d5200640 1 -- start start 2024-09-12T02:51:14.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.847+0000 7f18d5200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f18d0071530 0x7f18d00af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:14.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.847+0000 7f18d5200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f18d00719a0 0x7f18d00afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:14.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.847+0000 7f18d5200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18d00ceeb0 con 0x7f18d015cc50 2024-09-12T02:51:14.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.847+0000 7f18d5200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f18d015d030 con 0x7f18d00719a0 2024-09-12T02:51:14.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.847+0000 7f18d5200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f18d00cf4c0 con 0x7f18d0071530 2024-09-12T02:51:14.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.847+0000 7f18ce800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f18d00719a0 0x7f18d00afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:14.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.847+0000 7f18ce800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f18d00719a0 0x7f18d00afc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42252/0 (socket says 172.21.15.112:42252) 2024-09-12T02:51:14.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.847+0000 7f18ce800640 1 -- 172.21.15.112:0/71734840 learned_addr learned my addr 172.21.15.112:0/71734840 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:14.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.847+0000 7f18c5400640 1 --2- 172.21.15.112:0/71734840 >> v2:172.21.15.137:3300/0 conn(0x7f18d0071530 0x7f18d00af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:14.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.847+0000 7f18ce800640 1 -- 172.21.15.112:0/71734840 >> v2:172.21.15.137:3300/0 conn(0x7f18d0071530 msgr2=0x7f18d00af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:14.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.848+0000 7f18ce800640 1 --2- 172.21.15.112:0/71734840 >> v2:172.21.15.137:3300/0 conn(0x7f18d0071530 0x7f18d00af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:14.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.848+0000 7f18ce800640 1 -- 172.21.15.112:0/71734840 >> v1:172.21.15.137:6789/0 conn(0x7f18d015cc50 legacy=0x7f18d00732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:14.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.848+0000 7f18ce800640 1 -- 172.21.15.112:0/71734840 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d006e300 con 0x7f18d00719a0 2024-09-12T02:51:14.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.848+0000 7f18c5400640 1 --2- 172.21.15.112:0/71734840 >> v2:172.21.15.137:3300/0 conn(0x7f18d0071530 0x7f18d00af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:51:14.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.849+0000 7f18ce800640 1 --2- 172.21.15.112:0/71734840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18d00719a0 0x7f18d00afc60 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f18d00cf640 tx=0x7f18c802a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b5b02c85abcbb5a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:14.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.849+0000 7f18cd400640 1 -- 172.21.15.112:0/71734840 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c8036070 con 0x7f18d00719a0 2024-09-12T02:51:14.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.849+0000 7f18cd400640 1 -- 172.21.15.112:0/71734840 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c8031600 con 0x7f18d00719a0 2024-09-12T02:51:14.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.849+0000 7f18cd400640 1 -- 172.21.15.112:0/71734840 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c80319d0 con 0x7f18d00719a0 2024-09-12T02:51:14.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.849+0000 7f18d5200640 1 -- 172.21.15.112:0/71734840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18d00719a0 msgr2=0x7f18d00afc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:14.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.849+0000 7f18d5200640 1 --2- 172.21.15.112:0/71734840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18d00719a0 0x7f18d00afc60 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f18d00cf640 tx=0x7f18c802a640 comp rx=0 tx=0).stop 2024-09-12T02:51:14.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.849+0000 7f18d5200640 1 -- 172.21.15.112:0/71734840 shutdown_connections 2024-09-12T02:51:14.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.849+0000 7f18d5200640 1 --2- 172.21.15.112:0/71734840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18d00719a0 0x7f18d00afc60 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:14.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.849+0000 7f18d5200640 1 --2- 172.21.15.112:0/71734840 >> v2:172.21.15.137:3300/0 conn(0x7f18d0071530 0x7f18d00af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:14.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.849+0000 7f18d5200640 1 -- 172.21.15.112:0/71734840 >> 172.21.15.112:0/71734840 conn(0x7f18d006bbd0 msgr2=0x7f18d006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:14.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.850+0000 7f18d5200640 1 -- 172.21.15.112:0/71734840 shutdown_connections 2024-09-12T02:51:14.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.850+0000 7f18d5200640 1 -- 172.21.15.112:0/71734840 wait complete. 2024-09-12T02:51:14.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.851+0000 7f18d5200640 1 Processor -- start 2024-09-12T02:51:14.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.851+0000 7f18d5200640 1 -- start start 2024-09-12T02:51:14.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.852+0000 7f18d5200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18d0071530 0x7f18d00b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:14.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.852+0000 7f18d5200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18d00719a0 0x7f18d0150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:14.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.852+0000 7f18d5200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18d015cc50 0x7f18d01f5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:14.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.852+0000 7f18d5200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f18d006f510 con 0x7f18d015cc50 2024-09-12T02:51:14.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.852+0000 7f18d5200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f18d00cf150 con 0x7f18d0071530 2024-09-12T02:51:14.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.852+0000 7f18d5200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f18d006f690 con 0x7f18d00719a0 2024-09-12T02:51:14.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.852+0000 7f18ce800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18d015cc50 0x7f18d01f5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:14.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.852+0000 7f18ce800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18d015cc50 0x7f18d01f5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42264/0 (socket says 172.21.15.112:42264) 2024-09-12T02:51:14.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.852+0000 7f18ce800640 1 -- 172.21.15.112:0/2293383622 learned_addr learned my addr 172.21.15.112:0/2293383622 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:14.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.853+0000 7f18ce800640 1 -- 172.21.15.112:0/2293383622 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18d00719a0 msgr2=0x7f18d0150760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:14.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.853+0000 7f18ce800640 1 --2- 172.21.15.112:0/2293383622 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18d00719a0 0x7f18d0150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:14.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.853+0000 7f18ce800640 1 -- 172.21.15.112:0/2293383622 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18d0071530 msgr2=0x7f18d00b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:14.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.853+0000 7f18cde00640 1 --2- 172.21.15.112:0/2293383622 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18d0071530 0x7f18d00b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:14.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.853+0000 7f18ce800640 1 --2- 172.21.15.112:0/2293383622 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18d0071530 0x7f18d00b4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:14.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.853+0000 7f18ce800640 1 -- 172.21.15.112:0/2293383622 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d00b4b70 con 0x7f18d015cc50 2024-09-12T02:51:14.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.853+0000 7f18cde00640 1 --2- 172.21.15.112:0/2293383622 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18d0071530 0x7f18d00b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:51:14.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.853+0000 7f18ce800640 1 --2- 172.21.15.112:0/2293383622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18d015cc50 0x7f18d01f5c90 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f18c8009f10 tx=0x7f18c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:14.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.853+0000 7f18c6a00640 1 -- 172.21.15.112:0/2293383622 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c8036050 con 0x7f18d015cc50 2024-09-12T02:51:14.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.853+0000 7f18c6a00640 1 -- 172.21.15.112:0/2293383622 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c8042070 con 0x7f18d015cc50 2024-09-12T02:51:14.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.853+0000 7f18c6a00640 1 -- 172.21.15.112:0/2293383622 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c8009510 con 0x7f18d015cc50 2024-09-12T02:51:14.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.853+0000 7f18d5200640 1 -- 172.21.15.112:0/2293383622 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18d01e53d0 con 0x7f18d015cc50 2024-09-12T02:51:14.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.854+0000 7f18d5200640 1 -- 172.21.15.112:0/2293383622 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18d01e5990 con 0x7f18d015cc50 2024-09-12T02:51:14.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.855+0000 7f18d5200640 1 -- 172.21.15.112:0/2293383622 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18d0068a30 con 0x7f18d015cc50 2024-09-12T02:51:14.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.855+0000 7f18c6a00640 1 -- 172.21.15.112:0/2293383622 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f18c8007bb0 con 0x7f18d015cc50 2024-09-12T02:51:14.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.856+0000 7f18c6a00640 1 --2- 172.21.15.112:0/2293383622 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f18ac06be30 0x7f18ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:14.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.856+0000 7f18c6a00640 1 -- 172.21.15.112:0/2293383622 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 4943+0+0 (secure 0 0 0) 0x7f18c80abc40 con 0x7f18d015cc50 2024-09-12T02:51:14.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.856+0000 7f18cde00640 1 --2- 172.21.15.112:0/2293383622 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f18ac06be30 0x7f18ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:14.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.857+0000 7f18cde00640 1 --2- 172.21.15.112:0/2293383622 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f18ac06be30 0x7f18ac06e2f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f18c000a830 tx=0x7f18c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:14.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:14.861+0000 7f18c6a00640 1 -- 172.21.15.112:0/2293383622 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f18c802ae20 con 0x7f18d015cc50 2024-09-12T02:51:15.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.033+0000 7f18d5200640 1 -- 172.21.15.112:0/2293383622 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f18d00696d0 con 0x7f18d015cc50 2024-09-12T02:51:15.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.033+0000 7f18c6a00640 1 -- 172.21.15.112:0/2293383622 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v158) ==== 93+0+10 (secure 0 0 0) 0x7f18d00696d0 con 0x7f18d015cc50 2024-09-12T02:51:15.035 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2024-09-12T02:51:15.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.035+0000 7f18d5200640 1 -- 172.21.15.112:0/2293383622 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f18ac06be30 msgr2=0x7f18ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:15.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.035+0000 7f18d5200640 1 --2- 172.21.15.112:0/2293383622 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f18ac06be30 0x7f18ac06e2f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f18c000a830 tx=0x7f18c0008040 comp rx=0 tx=0).stop 2024-09-12T02:51:15.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.035+0000 7f18d5200640 1 -- 172.21.15.112:0/2293383622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18d015cc50 msgr2=0x7f18d01f5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:15.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.035+0000 7f18d5200640 1 --2- 172.21.15.112:0/2293383622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18d015cc50 0x7f18d01f5c90 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f18c8009f10 tx=0x7f18c8004a40 comp rx=0 tx=0).stop 2024-09-12T02:51:15.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.035+0000 7f18d5200640 1 -- 172.21.15.112:0/2293383622 shutdown_connections 2024-09-12T02:51:15.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.035+0000 7f18d5200640 1 --2- 172.21.15.112:0/2293383622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18d015cc50 0x7f18d01f5c90 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:15.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.035+0000 7f18d5200640 1 --2- 172.21.15.112:0/2293383622 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18d00719a0 0x7f18d0150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:15.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.035+0000 7f18d5200640 1 --2- 172.21.15.112:0/2293383622 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f18ac06be30 0x7f18ac06e2f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:15.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.035+0000 7f18d5200640 1 --2- 172.21.15.112:0/2293383622 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18d0071530 0x7f18d00b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:15.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.035+0000 7f18d5200640 1 -- 172.21.15.112:0/2293383622 >> 172.21.15.112:0/2293383622 conn(0x7f18d006bbd0 msgr2=0x7f18d00732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:15.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.036+0000 7f18d5200640 1 -- 172.21.15.112:0/2293383622 shutdown_connections 2024-09-12T02:51:15.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.036+0000 7f18d5200640 1 -- 172.21.15.112:0/2293383622 wait complete. 2024-09-12T02:51:15.053 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2024-09-12T02:51:15.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.204+0000 7f3e66000640 1 Processor -- start 2024-09-12T02:51:15.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.205+0000 7f3e66000640 1 -- start start 2024-09-12T02:51:15.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.206+0000 7f3e66000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3e6015b9d0 0x7f3e600b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:15.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.206+0000 7f3e66000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3e6006f600 0x7f3e600728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:15.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.206+0000 7f3e66000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e600b54a0 con 0x7f3e600b45d0 2024-09-12T02:51:15.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.206+0000 7f3e66000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f3e600b4a60 con 0x7f3e6006f600 2024-09-12T02:51:15.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.206+0000 7f3e66000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3e600b3af0 con 0x7f3e6015b9d0 2024-09-12T02:51:15.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.206+0000 7f3e56a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f3e600b45d0 0x7f3e6006eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58700/0 (socket says 172.21.15.112:58700) 2024-09-12T02:51:15.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.206+0000 7f3e56a00640 1 -- 172.21.15.112:0/1196802610 learned_addr learned my addr 172.21.15.112:0/1196802610 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:51:15.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.206+0000 7f3e5fe00640 1 --2- 172.21.15.112:0/1196802610 >> v2:172.21.15.112:3300/0 conn(0x7f3e6006f600 0x7f3e600728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:15.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.206+0000 7f3e5f400640 1 --2- 172.21.15.112:0/1196802610 >> v2:172.21.15.137:3300/0 conn(0x7f3e6015b9d0 0x7f3e600b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:15.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.207+0000 7f3e5ea00640 1 -- 172.21.15.112:0/1196802610 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 232122102 0 0) 0x7f3e600b54a0 con 0x7f3e600b45d0 2024-09-12T02:51:15.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.207+0000 7f3e5ea00640 1 -- 172.21.15.112:0/1196802610 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e44005730 con 0x7f3e600b45d0 2024-09-12T02:51:15.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.207+0000 7f3e5fe00640 1 -- 172.21.15.112:0/1196802610 >> v2:172.21.15.137:3300/0 conn(0x7f3e6015b9d0 msgr2=0x7f3e600b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:15.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.207+0000 7f3e5fe00640 1 --2- 172.21.15.112:0/1196802610 >> v2:172.21.15.137:3300/0 conn(0x7f3e6015b9d0 0x7f3e600b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:15.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.207+0000 7f3e5fe00640 1 -- 172.21.15.112:0/1196802610 >> v1:172.21.15.112:6789/0 conn(0x7f3e600b45d0 legacy=0x7f3e6006eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:15.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.207+0000 7f3e5fe00640 1 -- 172.21.15.112:0/1196802610 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e600b3dd0 con 0x7f3e6006f600 2024-09-12T02:51:15.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.208+0000 7f3e5fe00640 1 --2- 172.21.15.112:0/1196802610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e6006f600 0x7f3e600728c0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f3e6006d230 tx=0x7f3e5802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e74c1266c96b8484 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:15.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.208+0000 7f3e5ea00640 1 -- 172.21.15.112:0/1196802610 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e58007740 con 0x7f3e6006f600 2024-09-12T02:51:15.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.208+0000 7f3e5ea00640 1 -- 172.21.15.112:0/1196802610 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e580078e0 con 0x7f3e6006f600 2024-09-12T02:51:15.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.208+0000 7f3e5ea00640 1 -- 172.21.15.112:0/1196802610 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e58007c90 con 0x7f3e6006f600 2024-09-12T02:51:15.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.208+0000 7f3e66000640 1 -- 172.21.15.112:0/1196802610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e6006f600 msgr2=0x7f3e600728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:15.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.208+0000 7f3e66000640 1 --2- 172.21.15.112:0/1196802610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e6006f600 0x7f3e600728c0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f3e6006d230 tx=0x7f3e5802a5f0 comp rx=0 tx=0).stop 2024-09-12T02:51:15.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.209+0000 7f3e66000640 1 -- 172.21.15.112:0/1196802610 shutdown_connections 2024-09-12T02:51:15.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.209+0000 7f3e66000640 1 --2- 172.21.15.112:0/1196802610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e6006f600 0x7f3e600728c0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:15.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.209+0000 7f3e66000640 1 --2- 172.21.15.112:0/1196802610 >> v2:172.21.15.137:3300/0 conn(0x7f3e6015b9d0 0x7f3e600b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:15.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.209+0000 7f3e66000640 1 -- 172.21.15.112:0/1196802610 >> 172.21.15.112:0/1196802610 conn(0x7f3e6006bbd0 msgr2=0x7f3e6006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:15.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.209+0000 7f3e66000640 1 -- 172.21.15.112:0/1196802610 shutdown_connections 2024-09-12T02:51:15.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.209+0000 7f3e66000640 1 -- 172.21.15.112:0/1196802610 wait complete. 2024-09-12T02:51:15.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.210+0000 7f3e66000640 1 Processor -- start 2024-09-12T02:51:15.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.210+0000 7f3e66000640 1 -- start start 2024-09-12T02:51:15.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.211+0000 7f3e66000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e6006f600 0x7f3e6015a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:15.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.211+0000 7f3e66000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e600b45d0 0x7f3e6015c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:15.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.211+0000 7f3e66000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e6015b9d0 0x7f3e600b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:15.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.211+0000 7f3e66000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6015bf30 con 0x7f3e6006f600 2024-09-12T02:51:15.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.211+0000 7f3e66000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6015bdb0 con 0x7f3e600b45d0 2024-09-12T02:51:15.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.211+0000 7f3e66000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3e600cdcd0 con 0x7f3e6015b9d0 2024-09-12T02:51:15.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.211+0000 7f3e5f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e6006f600 0x7f3e6015a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:15.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.211+0000 7f3e5f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e6006f600 0x7f3e6015a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42270/0 (socket says 172.21.15.112:42270) 2024-09-12T02:51:15.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.211+0000 7f3e5f400640 1 -- 172.21.15.112:0/130503327 learned_addr learned my addr 172.21.15.112:0/130503327 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:15.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.212+0000 7f3e56a00640 1 --2- 172.21.15.112:0/130503327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e600b45d0 0x7f3e6015c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:15.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.212+0000 7f3e5fe00640 1 --2- 172.21.15.112:0/130503327 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e6015b9d0 0x7f3e600b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:15.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.212+0000 7f3e5f400640 1 -- 172.21.15.112:0/130503327 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e6015b9d0 msgr2=0x7f3e600b0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:15.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.212+0000 7f3e5f400640 1 --2- 172.21.15.112:0/130503327 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e6015b9d0 0x7f3e600b0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:15.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.212+0000 7f3e5f400640 1 -- 172.21.15.112:0/130503327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e600b45d0 msgr2=0x7f3e6015c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:15.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.212+0000 7f3e5f400640 1 --2- 172.21.15.112:0/130503327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e600b45d0 0x7f3e6015c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:15.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.212+0000 7f3e5f400640 1 -- 172.21.15.112:0/130503327 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e6015d2f0 con 0x7f3e6006f600 2024-09-12T02:51:15.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.212+0000 7f3e5fe00640 1 --2- 172.21.15.112:0/130503327 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e6015b9d0 0x7f3e600b0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:51:15.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.212+0000 7f3e5f400640 1 --2- 172.21.15.112:0/130503327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e6006f600 0x7f3e6015a9a0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000e870 tx=0x7f3e5000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:15.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.212+0000 7f3e57e00640 1 -- 172.21.15.112:0/130503327 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e50017070 con 0x7f3e6006f600 2024-09-12T02:51:15.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.212+0000 7f3e57e00640 1 -- 172.21.15.112:0/130503327 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e5000c940 con 0x7f3e6006f600 2024-09-12T02:51:15.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.212+0000 7f3e57e00640 1 -- 172.21.15.112:0/130503327 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5000cd30 con 0x7f3e6006f600 2024-09-12T02:51:15.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.212+0000 7f3e66000640 1 -- 172.21.15.112:0/130503327 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e601f55e0 con 0x7f3e6006f600 2024-09-12T02:51:15.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.213+0000 7f3e66000640 1 -- 172.21.15.112:0/130503327 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e601f52d0 con 0x7f3e6006f600 2024-09-12T02:51:15.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.214+0000 7f3e66000640 1 -- 172.21.15.112:0/130503327 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e60068a30 con 0x7f3e6006f600 2024-09-12T02:51:15.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.215+0000 7f3e57e00640 1 -- 172.21.15.112:0/130503327 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e5001a070 con 0x7f3e6006f600 2024-09-12T02:51:15.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.215+0000 7f3e57e00640 1 --2- 172.21.15.112:0/130503327 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3e3c06be30 0x7f3e3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:15.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.215+0000 7f3e57e00640 1 -- 172.21.15.112:0/130503327 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 4943+0+0 (secure 0 0 0) 0x7f3e5008aa20 con 0x7f3e6006f600 2024-09-12T02:51:15.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.216+0000 7f3e56a00640 1 --2- 172.21.15.112:0/130503327 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3e3c06be30 0x7f3e3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:15.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.216+0000 7f3e56a00640 1 --2- 172.21.15.112:0/130503327 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3e3c06be30 0x7f3e3c06e2f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3e60072d20 tx=0x7f3e48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:15.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.220+0000 7f3e57e00640 1 -- 172.21.15.112:0/130503327 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3e500596c0 con 0x7f3e6006f600 2024-09-12T02:51:15.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:15.462+0000 7f3e66000640 1 -- 172.21.15.112:0/130503327 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) -- 0x7f3e600b21f0 con 0x7f3e6006f600 2024-09-12T02:51:16.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.315+0000 7f3e57e00640 1 -- 172.21.15.112:0/130503327 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v451) ==== 134+0+0 (secure 0 0 0) 0x7f3e50058fc0 con 0x7f3e6006f600 2024-09-12T02:51:16.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.319+0000 7f3e66000640 1 -- 172.21.15.112:0/130503327 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3e3c06be30 msgr2=0x7f3e3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:16.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.319+0000 7f3e66000640 1 --2- 172.21.15.112:0/130503327 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3e3c06be30 0x7f3e3c06e2f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3e60072d20 tx=0x7f3e48009040 comp rx=0 tx=0).stop 2024-09-12T02:51:16.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.319+0000 7f3e66000640 1 -- 172.21.15.112:0/130503327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e6006f600 msgr2=0x7f3e6015a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:16.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.319+0000 7f3e66000640 1 --2- 172.21.15.112:0/130503327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e6006f600 0x7f3e6015a9a0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000e870 tx=0x7f3e5000ed30 comp rx=0 tx=0).stop 2024-09-12T02:51:16.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.319+0000 7f3e66000640 1 -- 172.21.15.112:0/130503327 shutdown_connections 2024-09-12T02:51:16.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.319+0000 7f3e66000640 1 --2- 172.21.15.112:0/130503327 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e6015b9d0 0x7f3e600b0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:16.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.319+0000 7f3e66000640 1 --2- 172.21.15.112:0/130503327 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3e3c06be30 0x7f3e3c06e2f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:16.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.319+0000 7f3e66000640 1 --2- 172.21.15.112:0/130503327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e600b45d0 0x7f3e6015c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:16.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.319+0000 7f3e66000640 1 --2- 172.21.15.112:0/130503327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e6006f600 0x7f3e6015a9a0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:16.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.319+0000 7f3e66000640 1 -- 172.21.15.112:0/130503327 >> 172.21.15.112:0/130503327 conn(0x7f3e6006bbd0 msgr2=0x7f3e60158220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:16.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.320+0000 7f3e66000640 1 -- 172.21.15.112:0/130503327 shutdown_connections 2024-09-12T02:51:16.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.320+0000 7f3e66000640 1 -- 172.21.15.112:0/130503327 wait complete. 2024-09-12T02:51:16.339 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T02:51:16.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.498+0000 7f4669400640 1 Processor -- start 2024-09-12T02:51:16.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.498+0000 7f4669400640 1 -- start start 2024-09-12T02:51:16.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.499+0000 7f4669400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f46640d1710 0x7f46640d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:16.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.499+0000 7f4669400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46640b1d70 0x7f46640b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:16.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.499+0000 7f4669400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46640d2fb0 con 0x7f46640b3e00 2024-09-12T02:51:16.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.499+0000 7f4669400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f46640d3cb0 con 0x7f46640d1710 2024-09-12T02:51:16.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.499+0000 7f4669400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f46640d0b60 con 0x7f46640b1d70 2024-09-12T02:51:16.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.500+0000 7f465b400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f46640b3e00 0x7f46640d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58708/0 (socket says 172.21.15.112:58708) 2024-09-12T02:51:16.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.500+0000 7f465b400640 1 -- 172.21.15.112:0/4022133277 learned_addr learned my addr 172.21.15.112:0/4022133277 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:51:16.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.500+0000 7f4668a00640 1 --2- 172.21.15.112:0/4022133277 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46640b1d70 0x7f46640b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:16.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.500+0000 7f4663e00640 1 --2- 172.21.15.112:0/4022133277 >> v2:172.21.15.137:3300/0 conn(0x7f46640d1710 0x7f46640d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:16.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.500+0000 7f4663400640 1 -- 172.21.15.112:0/4022133277 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2478667719 0 0) 0x7f46640d2fb0 con 0x7f46640b3e00 2024-09-12T02:51:16.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.500+0000 7f4663400640 1 -- 172.21.15.112:0/4022133277 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4648003520 con 0x7f46640b3e00 2024-09-12T02:51:16.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.500+0000 7f4668a00640 1 -- 172.21.15.112:0/4022133277 >> v2:172.21.15.137:3300/0 conn(0x7f46640d1710 msgr2=0x7f46640d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:16.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.500+0000 7f4668a00640 1 --2- 172.21.15.112:0/4022133277 >> v2:172.21.15.137:3300/0 conn(0x7f46640d1710 0x7f46640d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:16.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.500+0000 7f4668a00640 1 -- 172.21.15.112:0/4022133277 >> v1:172.21.15.112:6789/0 conn(0x7f46640b3e00 legacy=0x7f46640d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:16.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.500+0000 7f4668a00640 1 -- 172.21.15.112:0/4022133277 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46640d3410 con 0x7f46640b1d70 2024-09-12T02:51:16.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.502+0000 7f4668a00640 1 --2- 172.21.15.112:0/4022133277 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46640b1d70 0x7f46640b2200 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f465c009d90 tx=0x7f465c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dd4bbaafb882746 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:16.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.502+0000 7f4663400640 1 -- 172.21.15.112:0/4022133277 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c007740 con 0x7f46640b1d70 2024-09-12T02:51:16.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.502+0000 7f4663400640 1 -- 172.21.15.112:0/4022133277 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f465c0078e0 con 0x7f46640b1d70 2024-09-12T02:51:16.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.502+0000 7f4663400640 1 -- 172.21.15.112:0/4022133277 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c007cb0 con 0x7f46640b1d70 2024-09-12T02:51:16.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.502+0000 7f4669400640 1 -- 172.21.15.112:0/4022133277 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46640b1d70 msgr2=0x7f46640b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:16.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.502+0000 7f4669400640 1 --2- 172.21.15.112:0/4022133277 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46640b1d70 0x7f46640b2200 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f465c009d90 tx=0x7f465c02a660 comp rx=0 tx=0).stop 2024-09-12T02:51:16.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.502+0000 7f4669400640 1 -- 172.21.15.112:0/4022133277 shutdown_connections 2024-09-12T02:51:16.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.502+0000 7f4669400640 1 --2- 172.21.15.112:0/4022133277 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46640b1d70 0x7f46640b2200 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:16.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.502+0000 7f4669400640 1 --2- 172.21.15.112:0/4022133277 >> v2:172.21.15.137:3300/0 conn(0x7f46640d1710 0x7f46640d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:16.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.502+0000 7f4669400640 1 -- 172.21.15.112:0/4022133277 >> 172.21.15.112:0/4022133277 conn(0x7f466409e030 msgr2=0x7f46640d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:16.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.502+0000 7f4669400640 1 -- 172.21.15.112:0/4022133277 shutdown_connections 2024-09-12T02:51:16.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.503+0000 7f4669400640 1 -- 172.21.15.112:0/4022133277 wait complete. 2024-09-12T02:51:16.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.504+0000 7f4669400640 1 Processor -- start 2024-09-12T02:51:16.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.504+0000 7f4669400640 1 -- start start 2024-09-12T02:51:16.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.505+0000 7f4669400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46640b1d70 0x7f46640cd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:16.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.505+0000 7f4669400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46640b3e00 0x7f46640c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.505+0000 7f4669400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46640d1710 0x7f46640c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.505+0000 7f4669400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f466415f110 con 0x7f46640b1d70 2024-09-12T02:51:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.505+0000 7f4669400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f46640d39d0 con 0x7f46640b3e00 2024-09-12T02:51:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.505+0000 7f4669400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f466415f290 con 0x7f46640d1710 2024-09-12T02:51:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.505+0000 7f4663e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46640b1d70 0x7f46640cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.505+0000 7f4663e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46640b1d70 0x7f46640cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42286/0 (socket says 172.21.15.112:42286) 2024-09-12T02:51:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.505+0000 7f4663e00640 1 -- 172.21.15.112:0/3557367963 learned_addr learned my addr 172.21.15.112:0/3557367963 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.506+0000 7f465b400640 1 --2- 172.21.15.112:0/3557367963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46640b3e00 0x7f46640c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.506+0000 7f4668a00640 1 --2- 172.21.15.112:0/3557367963 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46640d1710 0x7f46640c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.506+0000 7f4663e00640 1 -- 172.21.15.112:0/3557367963 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46640d1710 msgr2=0x7f46640c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.506+0000 7f4663e00640 1 --2- 172.21.15.112:0/3557367963 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46640d1710 0x7f46640c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.506+0000 7f4663e00640 1 -- 172.21.15.112:0/3557367963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46640b3e00 msgr2=0x7f46640c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:16.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.506+0000 7f4663e00640 1 --2- 172.21.15.112:0/3557367963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46640b3e00 0x7f46640c9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:16.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.506+0000 7f4663e00640 1 -- 172.21.15.112:0/3557367963 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46640cde50 con 0x7f46640b1d70 2024-09-12T02:51:16.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.506+0000 7f465b400640 1 --2- 172.21.15.112:0/3557367963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46640b3e00 0x7f46640c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:51:16.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.506+0000 7f4663e00640 1 --2- 172.21.15.112:0/3557367963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46640b1d70 0x7f46640cd370 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f465400e8a0 tx=0x7f465400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:16.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.506+0000 7f4660c00640 1 -- 172.21.15.112:0/3557367963 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4654017070 con 0x7f46640b1d70 2024-09-12T02:51:16.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.506+0000 7f4660c00640 1 -- 172.21.15.112:0/3557367963 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f465400c940 con 0x7f46640b1d70 2024-09-12T02:51:16.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.506+0000 7f4660c00640 1 -- 172.21.15.112:0/3557367963 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465400cd30 con 0x7f46640b1d70 2024-09-12T02:51:16.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.506+0000 7f4669400640 1 -- 172.21.15.112:0/3557367963 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46640ce190 con 0x7f46640b1d70 2024-09-12T02:51:16.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.507+0000 7f4669400640 1 -- 172.21.15.112:0/3557367963 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46640ce9d0 con 0x7f46640b1d70 2024-09-12T02:51:16.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.508+0000 7f4669400640 1 -- 172.21.15.112:0/3557367963 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46640d28d0 con 0x7f46640b1d70 2024-09-12T02:51:16.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.508+0000 7f4660c00640 1 -- 172.21.15.112:0/3557367963 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f465401a070 con 0x7f46640b1d70 2024-09-12T02:51:16.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.509+0000 7f4660c00640 1 --2- 172.21.15.112:0/3557367963 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f464006be30 0x7f464006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:16.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.509+0000 7f4660c00640 1 -- 172.21.15.112:0/3557367963 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 4943+0+0 (secure 0 0 0) 0x7f465408ab10 con 0x7f46640b1d70 2024-09-12T02:51:16.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.510+0000 7f465b400640 1 --2- 172.21.15.112:0/3557367963 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f464006be30 0x7f464006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:16.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.510+0000 7f465b400640 1 --2- 172.21.15.112:0/3557367963 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f464006be30 0x7f464006e2f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f464c007fd0 tx=0x7f464c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:16.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.514+0000 7f4660c00640 1 -- 172.21.15.112:0/3557367963 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f46640ce190 con 0x7f46640b1d70 2024-09-12T02:51:16.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.685+0000 7f4669400640 1 -- 172.21.15.112:0/3557367963 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f46640ba770 con 0x7f46640b1d70 2024-09-12T02:51:16.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.689+0000 7f4660c00640 1 -- 172.21.15.112:0/3557367963 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f4654059720 con 0x7f46640b1d70 2024-09-12T02:51:16.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.691+0000 7f4669400640 1 -- 172.21.15.112:0/3557367963 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f464006be30 msgr2=0x7f464006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:16.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.691+0000 7f4669400640 1 --2- 172.21.15.112:0/3557367963 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f464006be30 0x7f464006e2f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f464c007fd0 tx=0x7f464c009040 comp rx=0 tx=0).stop 2024-09-12T02:51:16.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.691+0000 7f4669400640 1 -- 172.21.15.112:0/3557367963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46640b1d70 msgr2=0x7f46640cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:16.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.691+0000 7f4669400640 1 --2- 172.21.15.112:0/3557367963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46640b1d70 0x7f46640cd370 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f465400e8a0 tx=0x7f465400ed60 comp rx=0 tx=0).stop 2024-09-12T02:51:16.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.692+0000 7f4669400640 1 -- 172.21.15.112:0/3557367963 shutdown_connections 2024-09-12T02:51:16.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.692+0000 7f4669400640 1 --2- 172.21.15.112:0/3557367963 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46640d1710 0x7f46640c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:16.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.692+0000 7f4669400640 1 --2- 172.21.15.112:0/3557367963 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f464006be30 0x7f464006e2f0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:16.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.692+0000 7f4669400640 1 --2- 172.21.15.112:0/3557367963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46640b3e00 0x7f46640c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:16.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.692+0000 7f4669400640 1 --2- 172.21.15.112:0/3557367963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46640b1d70 0x7f46640cd370 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:16.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.692+0000 7f4669400640 1 -- 172.21.15.112:0/3557367963 >> 172.21.15.112:0/3557367963 conn(0x7f466409e030 msgr2=0x7f46640b8340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:16.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.692+0000 7f4669400640 1 -- 172.21.15.112:0/3557367963 shutdown_connections 2024-09-12T02:51:16.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:16.692+0000 7f4669400640 1 -- 172.21.15.112:0/3557367963 wait complete. 2024-09-12T02:51:16.709 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:51:16.709 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:51:16.798 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:51:16.882 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:51:16.882 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:51:16.882 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:51:16.917 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:51:16.918 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:51:16.918 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:51:16.955 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:51:16.955 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:51:16.955 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:51:16.992 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:51:16.992 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:51:16.993 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:51:17.031 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:51:17.031 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T02:51:17.032 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:51:17.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.182+0000 7fb7f1000640 1 Processor -- start 2024-09-12T02:51:17.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.182+0000 7fb7f1000640 1 -- start start 2024-09-12T02:51:17.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.183+0000 7fb7f1000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb7ec15cc50 0x7fb7ec0732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.183+0000 7fb7f1000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb7ec071530 0x7fb7ec0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.183+0000 7fb7f1000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb7ec0719a0 0x7fb7ec0afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.183+0000 7fb7f1000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb7ec15d030 con 0x7fb7ec15cc50 2024-09-12T02:51:17.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.183+0000 7fb7f1000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb7ec0cf4c0 con 0x7fb7ec071530 2024-09-12T02:51:17.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.183+0000 7fb7f1000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb7ec073830 con 0x7fb7ec0719a0 2024-09-12T02:51:17.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.184+0000 7fb7e9e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb7ec15cc50 0x7fb7ec0732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.184+0000 7fb7e9400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb7ec071530 0x7fb7ec0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.184+0000 7fb7ea800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb7ec0719a0 0x7fb7ec0afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.184+0000 7fb7e9400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb7ec071530 0x7fb7ec0af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:52738/0 (socket says 172.21.15.112:52738) 2024-09-12T02:51:17.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.184+0000 7fb7e9400640 1 -- 172.21.15.112:0/2591153084 learned_addr learned my addr 172.21.15.112:0/2591153084 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:17.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.184+0000 7fb7ea800640 1 -- 172.21.15.112:0/2591153084 >> v2:172.21.15.137:3300/0 conn(0x7fb7ec071530 msgr2=0x7fb7ec0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:17.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.184+0000 7fb7ea800640 1 --2- 172.21.15.112:0/2591153084 >> v2:172.21.15.137:3300/0 conn(0x7fb7ec071530 0x7fb7ec0af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.184+0000 7fb7ea800640 1 -- 172.21.15.112:0/2591153084 >> v2:172.21.15.112:3300/0 conn(0x7fb7ec15cc50 msgr2=0x7fb7ec0732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:17.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.184+0000 7fb7ea800640 1 --2- 172.21.15.112:0/2591153084 >> v2:172.21.15.112:3300/0 conn(0x7fb7ec15cc50 0x7fb7ec0732f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.184+0000 7fb7ea800640 1 -- 172.21.15.112:0/2591153084 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7ec0ceeb0 con 0x7fb7ec0719a0 2024-09-12T02:51:17.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.184+0000 7fb7e9400640 1 --2- 172.21.15.112:0/2591153084 >> v2:172.21.15.137:3300/0 conn(0x7fb7ec071530 0x7fb7ec0af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:51:17.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.184+0000 7fb7e9e00640 1 --2- 172.21.15.112:0/2591153084 >> v2:172.21.15.112:3300/0 conn(0x7fb7ec15cc50 0x7fb7ec0732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:51:17.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.185+0000 7fb7ea800640 1 --2- 172.21.15.112:0/2591153084 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb7ec0719a0 0x7fb7ec0afc60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec06fa40 tx=0x7fb7e402a540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9789fbd7e9c4bb6c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:17.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.186+0000 7fb7e8a00640 1 -- 172.21.15.112:0/2591153084 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4007740 con 0x7fb7ec0719a0 2024-09-12T02:51:17.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.186+0000 7fb7e8a00640 1 -- 172.21.15.112:0/2591153084 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e40078e0 con 0x7fb7ec0719a0 2024-09-12T02:51:17.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.186+0000 7fb7e8a00640 1 -- 172.21.15.112:0/2591153084 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4007cb0 con 0x7fb7ec0719a0 2024-09-12T02:51:17.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.186+0000 7fb7f1000640 1 -- 172.21.15.112:0/2591153084 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb7ec0719a0 msgr2=0x7fb7ec0afc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:17.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.186+0000 7fb7f1000640 1 --2- 172.21.15.112:0/2591153084 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb7ec0719a0 0x7fb7ec0afc60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec06fa40 tx=0x7fb7e402a540 comp rx=0 tx=0).stop 2024-09-12T02:51:17.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.187+0000 7fb7f1000640 1 -- 172.21.15.112:0/2591153084 shutdown_connections 2024-09-12T02:51:17.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.187+0000 7fb7f1000640 1 --2- 172.21.15.112:0/2591153084 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb7ec0719a0 0x7fb7ec0afc60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.187+0000 7fb7f1000640 1 --2- 172.21.15.112:0/2591153084 >> v2:172.21.15.137:3300/0 conn(0x7fb7ec071530 0x7fb7ec0af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.187+0000 7fb7f1000640 1 --2- 172.21.15.112:0/2591153084 >> v2:172.21.15.112:3300/0 conn(0x7fb7ec15cc50 0x7fb7ec0732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.187+0000 7fb7f1000640 1 -- 172.21.15.112:0/2591153084 >> 172.21.15.112:0/2591153084 conn(0x7fb7ec06bbd0 msgr2=0x7fb7ec06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:17.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.187+0000 7fb7f1000640 1 -- 172.21.15.112:0/2591153084 shutdown_connections 2024-09-12T02:51:17.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.187+0000 7fb7f1000640 1 -- 172.21.15.112:0/2591153084 wait complete. 2024-09-12T02:51:17.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.188+0000 7fb7f1000640 1 Processor -- start 2024-09-12T02:51:17.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.188+0000 7fb7f1000640 1 -- start start 2024-09-12T02:51:17.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.189+0000 7fb7f1000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7ec071530 0x7fb7ec0b4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.189+0000 7fb7f1000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7ec0719a0 0x7fb7ec1f4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.189+0000 7fb7f1000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb7ec15cc50 0x7fb7ec0ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.189+0000 7fb7f1000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ec0cf150 con 0x7fb7ec071530 2024-09-12T02:51:17.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.189+0000 7fb7f1000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ec06e5e0 con 0x7fb7ec0719a0 2024-09-12T02:51:17.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.189+0000 7fb7f1000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb7ec06f510 con 0x7fb7ec15cc50 2024-09-12T02:51:17.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.190+0000 7fb7e9e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7ec071530 0x7fb7ec0b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.190+0000 7fb7e9e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7ec071530 0x7fb7ec0b4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42304/0 (socket says 172.21.15.112:42304) 2024-09-12T02:51:17.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.190+0000 7fb7e9e00640 1 -- 172.21.15.112:0/1343590389 learned_addr learned my addr 172.21.15.112:0/1343590389 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:17.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.190+0000 7fb7ea800640 1 --2- 172.21.15.112:0/1343590389 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb7ec15cc50 0x7fb7ec0ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.190+0000 7fb7e9400640 1 --2- 172.21.15.112:0/1343590389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7ec0719a0 0x7fb7ec1f4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.190+0000 7fb7e9e00640 1 -- 172.21.15.112:0/1343590389 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb7ec15cc50 msgr2=0x7fb7ec0ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:17.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.190+0000 7fb7e9e00640 1 --2- 172.21.15.112:0/1343590389 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb7ec15cc50 0x7fb7ec0ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.190+0000 7fb7e9e00640 1 -- 172.21.15.112:0/1343590389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7ec0719a0 msgr2=0x7fb7ec1f4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:17.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.190+0000 7fb7e9e00640 1 --2- 172.21.15.112:0/1343590389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7ec0719a0 0x7fb7ec1f4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.190+0000 7fb7e9e00640 1 -- 172.21.15.112:0/1343590389 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7ec1f9020 con 0x7fb7ec071530 2024-09-12T02:51:17.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.190+0000 7fb7e9e00640 1 --2- 172.21.15.112:0/1343590389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7ec071530 0x7fb7ec0b4560 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc00ec10 tx=0x7fb7dc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:17.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.191+0000 7fb7e2000640 1 -- 172.21.15.112:0/1343590389 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc017070 con 0x7fb7ec071530 2024-09-12T02:51:17.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.191+0000 7fb7e2000640 1 -- 172.21.15.112:0/1343590389 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7dc00cc30 con 0x7fb7ec071530 2024-09-12T02:51:17.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.191+0000 7fb7e2000640 1 -- 172.21.15.112:0/1343590389 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc013470 con 0x7fb7ec071530 2024-09-12T02:51:17.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.191+0000 7fb7f1000640 1 -- 172.21.15.112:0/1343590389 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7ec1f9300 con 0x7fb7ec071530 2024-09-12T02:51:17.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.191+0000 7fb7f1000640 1 -- 172.21.15.112:0/1343590389 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7ec0b3d60 con 0x7fb7ec071530 2024-09-12T02:51:17.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.192+0000 7fb7f1000640 1 -- 172.21.15.112:0/1343590389 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7ec068a30 con 0x7fb7ec071530 2024-09-12T02:51:17.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.193+0000 7fb7e2000640 1 -- 172.21.15.112:0/1343590389 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb7dc01a070 con 0x7fb7ec071530 2024-09-12T02:51:17.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.193+0000 7fb7e2000640 1 --2- 172.21.15.112:0/1343590389 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb7cc06be30 0x7fb7cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.194+0000 7fb7e2000640 1 -- 172.21.15.112:0/1343590389 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 4943+0+0 (secure 0 0 0) 0x7fb7dc08ae50 con 0x7fb7ec071530 2024-09-12T02:51:17.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.194+0000 7fb7e9400640 1 --2- 172.21.15.112:0/1343590389 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb7cc06be30 0x7fb7cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.194+0000 7fb7e9400640 1 --2- 172.21.15.112:0/1343590389 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb7cc06be30 0x7fb7cc06e2f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb7d80095c0 tx=0x7fb7d8009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:17.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.198+0000 7fb7e2000640 1 -- 172.21.15.112:0/1343590389 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb7dc059410 con 0x7fb7ec071530 2024-09-12T02:51:17.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.407+0000 7fb7f1000640 1 -- 172.21.15.112:0/1343590389 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb7ec0730d0 con 0x7fb7ec071530 2024-09-12T02:51:17.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.407+0000 7fb7e2000640 1 -- 172.21.15.112:0/1343590389 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) ==== 94+0+3917 (secure 0 0 0) 0x7fb7dc05d710 con 0x7fb7ec071530 2024-09-12T02:51:17.408 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:51:17.409 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":80,"btime":"2024-09-12T02:51:11:204303+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6074,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/984843624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":984843624},{"type":"v1","addr":"172.21.15.112:6836","nonce":984843624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3470369780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3470369780},{"type":"v1","addr":"172.21.15.112:6837","nonce":3470369780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/3190674567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3190674567},{"type":"v1","addr":"172.21.15.137:6834","nonce":3190674567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6841,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/633937776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":633937776},{"type":"v1","addr":"172.21.15.137:6835","nonce":633937776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[]} 2024-09-12T02:51:17.409 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 80 2024-09-12T02:51:17.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.410+0000 7fb7f1000640 1 -- 172.21.15.112:0/1343590389 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb7cc06be30 msgr2=0x7fb7cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:17.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.410+0000 7fb7f1000640 1 --2- 172.21.15.112:0/1343590389 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb7cc06be30 0x7fb7cc06e2f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb7d80095c0 tx=0x7fb7d8009210 comp rx=0 tx=0).stop 2024-09-12T02:51:17.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.410+0000 7fb7f1000640 1 -- 172.21.15.112:0/1343590389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7ec071530 msgr2=0x7fb7ec0b4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:17.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.410+0000 7fb7f1000640 1 --2- 172.21.15.112:0/1343590389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7ec071530 0x7fb7ec0b4560 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc00ec10 tx=0x7fb7dc00c520 comp rx=0 tx=0).stop 2024-09-12T02:51:17.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.410+0000 7fb7f1000640 1 -- 172.21.15.112:0/1343590389 shutdown_connections 2024-09-12T02:51:17.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.410+0000 7fb7f1000640 1 --2- 172.21.15.112:0/1343590389 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb7ec15cc50 0x7fb7ec0ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.410+0000 7fb7f1000640 1 --2- 172.21.15.112:0/1343590389 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb7cc06be30 0x7fb7cc06e2f0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.410+0000 7fb7f1000640 1 --2- 172.21.15.112:0/1343590389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7ec0719a0 0x7fb7ec1f4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.410+0000 7fb7f1000640 1 --2- 172.21.15.112:0/1343590389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7ec071530 0x7fb7ec0b4560 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.410+0000 7fb7f1000640 1 -- 172.21.15.112:0/1343590389 >> 172.21.15.112:0/1343590389 conn(0x7fb7ec06bbd0 msgr2=0x7fb7ec159920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:17.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.410+0000 7fb7f1000640 1 -- 172.21.15.112:0/1343590389 shutdown_connections 2024-09-12T02:51:17.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.410+0000 7fb7f1000640 1 -- 172.21.15.112:0/1343590389 wait complete. 2024-09-12T02:51:17.426 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T02:51:17.426 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T02:51:17.427 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T02:51:17.427 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:51:17.427 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T02:51:17.427 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T02:51:17.427 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T02:51:17.427 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:51:17.427 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T02:51:17.428 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T02:51:17.428 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T02:51:17.428 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:51:17.428 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T02:51:17.428 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T02:51:17.428 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T02:51:17.429 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:51:17.443 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T02:51:17.443 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T02:51:17.444 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T02:51:17.444 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T02:51:17.445 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T02:51:17.445 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T02:51:17.446 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T02:51:17.446 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T02:51:17.488 INFO:tasks.ceph.mds.a:Started 2024-09-12T02:51:17.488 DEBUG:teuthology.parallel:result is None 2024-09-12T02:51:17.490 INFO:tasks.ceph.mds.c:Started 2024-09-12T02:51:17.490 DEBUG:teuthology.parallel:result is None 2024-09-12T02:51:17.491 INFO:tasks.ceph.mds.b:Started 2024-09-12T02:51:17.491 DEBUG:teuthology.parallel:result is None 2024-09-12T02:51:17.493 INFO:tasks.ceph.mds.d:Started 2024-09-12T02:51:17.493 DEBUG:teuthology.parallel:result is None 2024-09-12T02:51:17.493 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T02:51:17.618 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-12T02:51:17.619 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2024-09-12T02:51:17.620 INFO:tasks.ceph.mds.d.smithi137.stdout:starting mds.d at 2024-09-12T02:51:17.621 INFO:tasks.ceph.mds.b.smithi137.stdout:starting mds.b at 2024-09-12T02:51:17.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.653+0000 7f7657a00640 1 Processor -- start 2024-09-12T02:51:17.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.654+0000 7f7657a00640 1 -- start start 2024-09-12T02:51:17.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.655+0000 7f7657a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7650161010 0x7f7650166df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.655+0000 7f7657a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7650167330 0x7f7650165080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.655+0000 7f7657a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7650072370 con 0x7f7650160c30 2024-09-12T02:51:17.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.655+0000 7f7657a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f76501677a0 con 0x7f7650167330 2024-09-12T02:51:17.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.655+0000 7f7657a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7650072110 con 0x7f7650161010 2024-09-12T02:51:17.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.655+0000 7f7655a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7650167330 0x7f7650165080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.655+0000 7f7655a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7650167330 0x7f7650165080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42350/0 (socket says 172.21.15.112:42350) 2024-09-12T02:51:17.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.655+0000 7f764fe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7650161010 0x7f7650166df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.655+0000 7f7655a00640 1 -- 172.21.15.112:0/2986750157 learned_addr learned my addr 172.21.15.112:0/2986750157 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:17.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.656+0000 7f764fe00640 1 -- 172.21.15.112:0/2986750157 >> v2:172.21.15.112:3300/0 conn(0x7f7650167330 msgr2=0x7f7650165080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:17.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.656+0000 7f764fe00640 1 --2- 172.21.15.112:0/2986750157 >> v2:172.21.15.112:3300/0 conn(0x7f7650167330 0x7f7650165080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.656+0000 7f764fe00640 1 -- 172.21.15.112:0/2986750157 >> v1:172.21.15.137:6789/0 conn(0x7f7650160c30 legacy=0x7f7650071a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:17.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.656+0000 7f764fe00640 1 -- 172.21.15.112:0/2986750157 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7650072650 con 0x7f7650161010 2024-09-12T02:51:17.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.657+0000 7f764fe00640 1 --2- 172.21.15.112:0/2986750157 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7650161010 0x7f7650166df0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7650073d60 tx=0x7f763c02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bd31e7d53a1c971 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:17.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.657+0000 7f764f400640 1 -- 172.21.15.112:0/2986750157 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c037070 con 0x7f7650161010 2024-09-12T02:51:17.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.657+0000 7f764f400640 1 -- 172.21.15.112:0/2986750157 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f763c02ae50 con 0x7f7650161010 2024-09-12T02:51:17.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.657+0000 7f764f400640 1 -- 172.21.15.112:0/2986750157 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c032660 con 0x7f7650161010 2024-09-12T02:51:17.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.657+0000 7f7657a00640 1 -- 172.21.15.112:0/2986750157 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7650161010 msgr2=0x7f7650166df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:17.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.657+0000 7f7657a00640 1 --2- 172.21.15.112:0/2986750157 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7650161010 0x7f7650166df0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7650073d60 tx=0x7f763c02a100 comp rx=0 tx=0).stop 2024-09-12T02:51:17.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.658+0000 7f7657a00640 1 -- 172.21.15.112:0/2986750157 shutdown_connections 2024-09-12T02:51:17.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.658+0000 7f7657a00640 1 --2- 172.21.15.112:0/2986750157 >> v2:172.21.15.112:3300/0 conn(0x7f7650167330 0x7f7650165080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.658+0000 7f7657a00640 1 --2- 172.21.15.112:0/2986750157 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7650161010 0x7f7650166df0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.658+0000 7f7657a00640 1 -- 172.21.15.112:0/2986750157 >> 172.21.15.112:0/2986750157 conn(0x7f765006bbd0 msgr2=0x7f765006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:17.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.658+0000 7f7657a00640 1 -- 172.21.15.112:0/2986750157 shutdown_connections 2024-09-12T02:51:17.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.658+0000 7f7657a00640 1 -- 172.21.15.112:0/2986750157 wait complete. 2024-09-12T02:51:17.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.659+0000 7f7657a00640 1 Processor -- start 2024-09-12T02:51:17.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.659+0000 7f7657a00640 1 -- start start 2024-09-12T02:51:17.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.660+0000 7f7657a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7650160c30 0x7f76501fc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.660+0000 7f7657a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7650161010 0x7f765015c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.660+0000 7f7657a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7650167330 0x7f76500b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.660+0000 7f7657a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f765006f680 con 0x7f7650167330 2024-09-12T02:51:17.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.660+0000 7f7657a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7650164b60 con 0x7f7650161010 2024-09-12T02:51:17.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.660+0000 7f7657a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f765006f800 con 0x7f7650160c30 2024-09-12T02:51:17.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.661+0000 7f7655a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7650167330 0x7f76500b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.661+0000 7f7655a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7650167330 0x7f76500b3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42352/0 (socket says 172.21.15.112:42352) 2024-09-12T02:51:17.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.661+0000 7f7655a00640 1 -- 172.21.15.112:0/825476685 learned_addr learned my addr 172.21.15.112:0/825476685 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:17.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.661+0000 7f764fe00640 1 --2- 172.21.15.112:0/825476685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7650161010 0x7f765015c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.661+0000 7f7655000640 1 --2- 172.21.15.112:0/825476685 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7650160c30 0x7f76501fc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.661+0000 7f7655a00640 1 -- 172.21.15.112:0/825476685 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7650160c30 msgr2=0x7f76501fc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:17.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.661+0000 7f7655a00640 1 --2- 172.21.15.112:0/825476685 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7650160c30 0x7f76501fc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.661+0000 7f7655a00640 1 -- 172.21.15.112:0/825476685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7650161010 msgr2=0x7f765015c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:17.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.661+0000 7f7655a00640 1 --2- 172.21.15.112:0/825476685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7650161010 0x7f765015c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.661+0000 7f7655a00640 1 -- 172.21.15.112:0/825476685 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76500cd430 con 0x7f7650167330 2024-09-12T02:51:17.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.661+0000 7f7655a00640 1 --2- 172.21.15.112:0/825476685 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7650167330 0x7f76500b3e80 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f764800efc0 tx=0x7f764800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:17.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.661+0000 7f764cc00640 1 -- 172.21.15.112:0/825476685 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764800cd20 con 0x7f7650167330 2024-09-12T02:51:17.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.662+0000 7f764cc00640 1 -- 172.21.15.112:0/825476685 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7648003990 con 0x7f7650167330 2024-09-12T02:51:17.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.662+0000 7f764cc00640 1 -- 172.21.15.112:0/825476685 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7648003d80 con 0x7f7650167330 2024-09-12T02:51:17.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.662+0000 7f7657a00640 1 -- 172.21.15.112:0/825476685 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76500cd710 con 0x7f7650167330 2024-09-12T02:51:17.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.662+0000 7f7657a00640 1 -- 172.21.15.112:0/825476685 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76500cdcd0 con 0x7f7650167330 2024-09-12T02:51:17.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.663+0000 7f7657a00640 1 -- 172.21.15.112:0/825476685 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7650166df0 con 0x7f7650167330 2024-09-12T02:51:17.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.663+0000 7f764cc00640 1 -- 172.21.15.112:0/825476685 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7648012050 con 0x7f7650167330 2024-09-12T02:51:17.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.664+0000 7f764cc00640 1 --2- 172.21.15.112:0/825476685 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f763006be30 0x7f763006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.664+0000 7f764cc00640 1 -- 172.21.15.112:0/825476685 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 4943+0+0 (secure 0 0 0) 0x7f764808aeb0 con 0x7f7650167330 2024-09-12T02:51:17.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.665+0000 7f7655000640 1 --2- 172.21.15.112:0/825476685 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f763006be30 0x7f763006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.665+0000 7f7655000640 1 --2- 172.21.15.112:0/825476685 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f763006be30 0x7f763006e2f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7644001780 tx=0x7f7644009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:17.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.668+0000 7f764cc00640 1 -- 172.21.15.112:0/825476685 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7648010040 con 0x7f7650167330 2024-09-12T02:51:17.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:17.853+0000 7f7657a00640 1 -- 172.21.15.112:0/825476685 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f765006db80 con 0x7f7650167330 2024-09-12T02:51:18.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.706+0000 7f764cc00640 1 -- 172.21.15.112:0/825476685 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v163) ==== 97+0+0 (secure 0 0 0) 0x7f7648059500 con 0x7f7650167330 2024-09-12T02:51:18.706 INFO:teuthology.orchestra.run.smithi112.stderr: removed all blocklist entries 2024-09-12T02:51:18.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.708+0000 7f7657a00640 1 -- 172.21.15.112:0/825476685 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f763006be30 msgr2=0x7f763006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:18.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.708+0000 7f7657a00640 1 --2- 172.21.15.112:0/825476685 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f763006be30 0x7f763006e2f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7644001780 tx=0x7f7644009040 comp rx=0 tx=0).stop 2024-09-12T02:51:18.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.708+0000 7f7657a00640 1 -- 172.21.15.112:0/825476685 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7650167330 msgr2=0x7f76500b3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:18.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.708+0000 7f7657a00640 1 --2- 172.21.15.112:0/825476685 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7650167330 0x7f76500b3e80 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f764800efc0 tx=0x7f764800c490 comp rx=0 tx=0).stop 2024-09-12T02:51:18.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.708+0000 7f7657a00640 1 -- 172.21.15.112:0/825476685 shutdown_connections 2024-09-12T02:51:18.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.708+0000 7f7657a00640 1 --2- 172.21.15.112:0/825476685 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7650167330 0x7f76500b3e80 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:18.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.708+0000 7f7657a00640 1 --2- 172.21.15.112:0/825476685 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f763006be30 0x7f763006e2f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:18.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.708+0000 7f7657a00640 1 --2- 172.21.15.112:0/825476685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7650161010 0x7f765015c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:18.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.708+0000 7f7657a00640 1 --2- 172.21.15.112:0/825476685 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7650160c30 0x7f76501fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:18.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.708+0000 7f7657a00640 1 -- 172.21.15.112:0/825476685 >> 172.21.15.112:0/825476685 conn(0x7f765006bbd0 msgr2=0x7f765015eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:18.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.708+0000 7f7657a00640 1 -- 172.21.15.112:0/825476685 shutdown_connections 2024-09-12T02:51:18.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.708+0000 7f7657a00640 1 -- 172.21.15.112:0/825476685 wait complete. 2024-09-12T02:51:18.729 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T02:51:18.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.885+0000 7f6f4f200640 1 Processor -- start 2024-09-12T02:51:18.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.885+0000 7f6f4f200640 1 -- start start 2024-09-12T02:51:18.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.886+0000 7f6f4f200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f4815cc50 0x7f6f480732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:18.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.886+0000 7f6f4f200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6f48071530 0x7f6f480af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:18.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.886+0000 7f6f4f200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6f48071970 0x7f6f480afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:18.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.886+0000 7f6f4f200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f6f4815d030 con 0x7f6f48071530 2024-09-12T02:51:18.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.886+0000 7f6f4f200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6f480cf4c0 con 0x7f6f48071970 2024-09-12T02:51:18.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.886+0000 7f6f4f200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6f48073830 con 0x7f6f4815cc50 2024-09-12T02:51:18.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.887+0000 7f6f47400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6f48071530 0x7f6f480af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:18.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.887+0000 7f6f47400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6f48071530 0x7f6f480af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42362/0 (socket says 172.21.15.112:42362) 2024-09-12T02:51:18.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.887+0000 7f6f47400640 1 -- 172.21.15.112:0/4110697008 learned_addr learned my addr 172.21.15.112:0/4110697008 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:18.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.887+0000 7f6f47e00640 1 --2- 172.21.15.112:0/4110697008 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f4815cc50 0x7f6f480732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:18.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.887+0000 7f6f47400640 1 -- 172.21.15.112:0/4110697008 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f4815cc50 msgr2=0x7f6f480732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:18.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.887+0000 7f6f47400640 1 --2- 172.21.15.112:0/4110697008 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f4815cc50 0x7f6f480732f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:18.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.887+0000 7f6f47400640 1 -- 172.21.15.112:0/4110697008 >> v2:172.21.15.137:3300/0 conn(0x7f6f48071970 msgr2=0x7f6f480afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:18.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.887+0000 7f6f4d200640 1 --2- 172.21.15.112:0/4110697008 >> v2:172.21.15.137:3300/0 conn(0x7f6f48071970 0x7f6f480afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:18.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.887+0000 7f6f47400640 1 --2- 172.21.15.112:0/4110697008 >> v2:172.21.15.137:3300/0 conn(0x7f6f48071970 0x7f6f480afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:18.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.887+0000 7f6f47400640 1 -- 172.21.15.112:0/4110697008 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f480ceeb0 con 0x7f6f48071530 2024-09-12T02:51:18.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.887+0000 7f6f47e00640 1 --2- 172.21.15.112:0/4110697008 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f4815cc50 0x7f6f480732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:51:18.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.887+0000 7f6f4d200640 1 --2- 172.21.15.112:0/4110697008 >> v2:172.21.15.137:3300/0 conn(0x7f6f48071970 0x7f6f480afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:51:18.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.888+0000 7f6f47400640 1 --2- 172.21.15.112:0/4110697008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f48071530 0x7f6f480af720 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f6f480cf430 tx=0x7f6f3402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ee11c375eb867a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:18.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.888+0000 7f6f46a00640 1 -- 172.21.15.112:0/4110697008 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f34037070 con 0x7f6f48071530 2024-09-12T02:51:18.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.888+0000 7f6f46a00640 1 -- 172.21.15.112:0/4110697008 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f34032440 con 0x7f6f48071530 2024-09-12T02:51:18.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.888+0000 7f6f46a00640 1 -- 172.21.15.112:0/4110697008 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f34032810 con 0x7f6f48071530 2024-09-12T02:51:18.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.889+0000 7f6f4f200640 1 -- 172.21.15.112:0/4110697008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f48071530 msgr2=0x7f6f480af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:18.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.889+0000 7f6f4f200640 1 --2- 172.21.15.112:0/4110697008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f48071530 0x7f6f480af720 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f6f480cf430 tx=0x7f6f3402a140 comp rx=0 tx=0).stop 2024-09-12T02:51:18.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.889+0000 7f6f4f200640 1 -- 172.21.15.112:0/4110697008 shutdown_connections 2024-09-12T02:51:18.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.889+0000 7f6f4f200640 1 --2- 172.21.15.112:0/4110697008 >> v2:172.21.15.137:3300/0 conn(0x7f6f48071970 0x7f6f480afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:18.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.889+0000 7f6f4f200640 1 --2- 172.21.15.112:0/4110697008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f48071530 0x7f6f480af720 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:18.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.889+0000 7f6f4f200640 1 --2- 172.21.15.112:0/4110697008 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f4815cc50 0x7f6f480732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:18.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.889+0000 7f6f4f200640 1 -- 172.21.15.112:0/4110697008 >> 172.21.15.112:0/4110697008 conn(0x7f6f4806bbd0 msgr2=0x7f6f4806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:18.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.889+0000 7f6f4f200640 1 -- 172.21.15.112:0/4110697008 shutdown_connections 2024-09-12T02:51:18.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.889+0000 7f6f4f200640 1 -- 172.21.15.112:0/4110697008 wait complete. 2024-09-12T02:51:18.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.891+0000 7f6f4f200640 1 Processor -- start 2024-09-12T02:51:18.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.891+0000 7f6f4f200640 1 -- start start 2024-09-12T02:51:18.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.892+0000 7f6f4f200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f48071530 0x7f6f4814d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:18.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.892+0000 7f6f4f200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f48071970 0x7f6f48152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:18.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.892+0000 7f6f4f200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f4815cc50 0x7f6f481538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:18.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.892+0000 7f6f4f200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6f480cf150 con 0x7f6f48071970 2024-09-12T02:51:18.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.892+0000 7f6f4f200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6f4806e5e0 con 0x7f6f48071530 2024-09-12T02:51:18.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.892+0000 7f6f4f200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6f4806f510 con 0x7f6f4815cc50 2024-09-12T02:51:18.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.892+0000 7f6f47400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f48071970 0x7f6f48152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:18.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.892+0000 7f6f47400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f48071970 0x7f6f48152fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42378/0 (socket says 172.21.15.112:42378) 2024-09-12T02:51:18.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.892+0000 7f6f47400640 1 -- 172.21.15.112:0/3955491464 learned_addr learned my addr 172.21.15.112:0/3955491464 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:18.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.892+0000 7f6f47e00640 1 --2- 172.21.15.112:0/3955491464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f48071530 0x7f6f4814d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:18.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.892+0000 7f6f4d200640 1 --2- 172.21.15.112:0/3955491464 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f4815cc50 0x7f6f481538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:18.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.892+0000 7f6f47400640 1 -- 172.21.15.112:0/3955491464 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f4815cc50 msgr2=0x7f6f481538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:18.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.892+0000 7f6f47400640 1 --2- 172.21.15.112:0/3955491464 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f4815cc50 0x7f6f481538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:18.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.892+0000 7f6f47400640 1 -- 172.21.15.112:0/3955491464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f48071530 msgr2=0x7f6f4814d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:18.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.892+0000 7f6f47400640 1 --2- 172.21.15.112:0/3955491464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f48071530 0x7f6f4814d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:18.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.892+0000 7f6f47400640 1 -- 172.21.15.112:0/3955491464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f481542a0 con 0x7f6f48071970 2024-09-12T02:51:18.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.892+0000 7f6f4d200640 1 --2- 172.21.15.112:0/3955491464 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f4815cc50 0x7f6f481538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:51:18.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.893+0000 7f6f47400640 1 --2- 172.21.15.112:0/3955491464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f48071970 0x7f6f48152fa0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f6f3402a180 tx=0x7f6f340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:18.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.893+0000 7f6f3fe00640 1 -- 172.21.15.112:0/3955491464 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f34037040 con 0x7f6f48071970 2024-09-12T02:51:18.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.893+0000 7f6f3fe00640 1 -- 172.21.15.112:0/3955491464 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f34042070 con 0x7f6f48071970 2024-09-12T02:51:18.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.893+0000 7f6f3fe00640 1 -- 172.21.15.112:0/3955491464 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f34030bb0 con 0x7f6f48071970 2024-09-12T02:51:18.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.893+0000 7f6f4f200640 1 -- 172.21.15.112:0/3955491464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f481521e0 con 0x7f6f48071970 2024-09-12T02:51:18.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.893+0000 7f6f4f200640 1 -- 172.21.15.112:0/3955491464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f481527a0 con 0x7f6f48071970 2024-09-12T02:51:18.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.894+0000 7f6f4f200640 1 -- 172.21.15.112:0/3955491464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f48068a30 con 0x7f6f48071970 2024-09-12T02:51:18.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.895+0000 7f6f3fe00640 1 -- 172.21.15.112:0/3955491464 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6f34047460 con 0x7f6f48071970 2024-09-12T02:51:18.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.896+0000 7f6f3fe00640 1 --2- 172.21.15.112:0/3955491464 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6f2806be30 0x7f6f2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:18.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.896+0000 7f6f3fe00640 1 -- 172.21.15.112:0/3955491464 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 4857+0+0 (secure 0 0 0) 0x7f6f340ab6c0 con 0x7f6f48071970 2024-09-12T02:51:18.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.897+0000 7f6f47e00640 1 --2- 172.21.15.112:0/3955491464 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6f2806be30 0x7f6f2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:18.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.897+0000 7f6f47e00640 1 --2- 172.21.15.112:0/3955491464 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6f2806be30 0x7f6f2806e2f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6f3800aac0 tx=0x7f6f38008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:18.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:18.901+0000 7f6f3fe00640 1 -- 172.21.15.112:0/3955491464 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6f3407a3b0 con 0x7f6f48071970 2024-09-12T02:51:19.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.134+0000 7f6f4f200640 1 -- 172.21.15.112:0/3955491464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f6f4806df60 con 0x7f6f48071970 2024-09-12T02:51:19.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.134+0000 7f6f3fe00640 1 -- 172.21.15.112:0/3955491464 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) ==== 80+0+5304 (secure 0 0 0) 0x7f6f34079cb0 con 0x7f6f48071970 2024-09-12T02:51:19.135 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:51:19.135 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:51:19.135 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_dump": [ 2024-09-12T02:51:19.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:51:19.136 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.a", 2024-09-12T02:51:19.136 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmKE09KRAAtNq70LeeB9ENNxX91m10Fg==", 2024-09-12T02:51:19.136 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:51:19.136 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:51:19.136 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:51:19.136 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:51:19.136 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:51:19.136 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:51:19.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:51:19.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:51:19.136 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.b", 2024-09-12T02:51:19.136 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmMjYTARAAuIrofOOp9Dbrhkt314mhuw==", 2024-09-12T02:51:19.136 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:51:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:51:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:51:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:51:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:51:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:51:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:51:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:51:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.c", 2024-09-12T02:51:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmLQXzMhAAhk28JuqKhfbZtvRu9SSVrw==", 2024-09-12T02:51:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:51:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:51:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:51:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:51:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:51:19.137 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:51:19.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:51:19.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:51:19.138 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.d", 2024-09-12T02:51:19.138 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmaE7JChAAKlyynYJnHLs87BXyMC0xgA==", 2024-09-12T02:51:19.138 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:51:19.138 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:51:19.138 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:51:19.138 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:51:19.138 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:51:19.138 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:51:19.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:51:19.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:51:19.138 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.0", 2024-09-12T02:51:19.138 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDXVOJmFXfdIRAA+VpZNU0tEN6vAzR2C7nuLg==", 2024-09-12T02:51:19.139 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:51:19.139 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:51:19.139 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:51:19.139 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:51:19.139 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:51:19.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:51:19.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:51:19.139 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.1", 2024-09-12T02:51:19.139 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDXVOJmcgHyLBAA/OxfdQ1D+uFzbCnm1dJLxw==", 2024-09-12T02:51:19.139 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:51:19.139 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:51:19.139 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:51:19.139 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:51:19.139 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:51:19.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:51:19.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:51:19.140 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.2", 2024-09-12T02:51:19.140 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDXVOJm0baUNhAAuInNwHut2Xn0kBmjnJhdqw==", 2024-09-12T02:51:19.140 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:51:19.140 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:51:19.140 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:51:19.141 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:51:19.141 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:51:19.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:51:19.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:51:19.141 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.3", 2024-09-12T02:51:19.141 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDYVOJmL/O3BBAAZhQ4/70wj/2zEbMcfD4hQA==", 2024-09-12T02:51:19.141 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:51:19.141 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:51:19.141 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:51:19.141 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:51:19.141 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:51:19.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:51:19.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:51:19.141 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.4", 2024-09-12T02:51:19.142 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmC+sJAxAAUQofpG3g8DlGLQ8wUqtuSg==", 2024-09-12T02:51:19.142 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:51:19.142 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:51:19.142 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:51:19.142 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:51:19.142 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:51:19.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:51:19.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:51:19.142 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.5", 2024-09-12T02:51:19.142 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmY2OSDhAA2rg1HGjWx7G6IzFi6yQ/jQ==", 2024-09-12T02:51:19.142 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:51:19.142 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:51:19.142 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:51:19.142 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:51:19.143 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:51:19.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:51:19.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:51:19.143 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.6", 2024-09-12T02:51:19.143 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmydoaGRAAh/ozKewnY+RxiZ4EcOFA7A==", 2024-09-12T02:51:19.143 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:51:19.143 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:51:19.143 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:51:19.143 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:51:19.143 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:51:19.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:51:19.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:51:19.143 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.7", 2024-09-12T02:51:19.143 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmmB7cIhAAVhtz7OuxYBQgEKGvHdY33g==", 2024-09-12T02:51:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:51:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:51:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:51:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:51:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:51:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:51:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:51:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.0", 2024-09-12T02:51:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmaG86ExAAD0SOlJOsLpoQZlgPJIPaxA==", 2024-09-12T02:51:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:51:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:51:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow r", 2024-09-12T02:51:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T02:51:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:51:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:51:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:51:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.1", 2024-09-12T02:51:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmt7AeIBAAGRSEejG29OpANZqtia7KEw==", 2024-09-12T02:51:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:51:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:51:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:51:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:51:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:51:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:51:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:51:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:51:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.2", 2024-09-12T02:51:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmcUWtGRAAlV/gS/CDZKHb5bjbmDzjlg==", 2024-09-12T02:51:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:51:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:51:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:51:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:51:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:51:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:51:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:51:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:51:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.3", 2024-09-12T02:51:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJm2M97JhAAHKJoPBf6TN6Nu8muK6wzaw==", 2024-09-12T02:51:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:51:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:51:19.146 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:51:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:51:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:51:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:51:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:51:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:51:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.admin", 2024-09-12T02:51:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDSVOJmhl82NBAAvkcxnsY5u9lYO12FaRbP1A==", 2024-09-12T02:51:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:51:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-12T02:51:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:51:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:51:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:51:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:51:19.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:51:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:51:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.x", 2024-09-12T02:51:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmftawIhAAAKmfx8khERROoZ8BCLukAw==", 2024-09-12T02:51:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:51:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-12T02:51:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-12T02:51:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:51:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:51:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:51:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:51:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.y", 2024-09-12T02:51:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmcxtNGhAAAXWh1fMrVeFSy2hh3p2Rkw==", 2024-09-12T02:51:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:51:19.148 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-12T02:51:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-12T02:51:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:51:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:51:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:51:19.149 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:51:19.149 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:51:19.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.136+0000 7f6f4f200640 1 -- 172.21.15.112:0/3955491464 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6f2806be30 msgr2=0x7f6f2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:19.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.136+0000 7f6f4f200640 1 --2- 172.21.15.112:0/3955491464 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6f2806be30 0x7f6f2806e2f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6f3800aac0 tx=0x7f6f38008040 comp rx=0 tx=0).stop 2024-09-12T02:51:19.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.136+0000 7f6f4f200640 1 -- 172.21.15.112:0/3955491464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f48071970 msgr2=0x7f6f48152fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:19.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.136+0000 7f6f4f200640 1 --2- 172.21.15.112:0/3955491464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f48071970 0x7f6f48152fa0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f6f3402a180 tx=0x7f6f340046c0 comp rx=0 tx=0).stop 2024-09-12T02:51:19.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.136+0000 7f6f4f200640 1 -- 172.21.15.112:0/3955491464 shutdown_connections 2024-09-12T02:51:19.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.136+0000 7f6f4f200640 1 --2- 172.21.15.112:0/3955491464 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f4815cc50 0x7f6f481538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:19.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.136+0000 7f6f4f200640 1 --2- 172.21.15.112:0/3955491464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f48071970 0x7f6f48152fa0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:19.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.136+0000 7f6f4f200640 1 --2- 172.21.15.112:0/3955491464 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6f2806be30 0x7f6f2806e2f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:19.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.136+0000 7f6f4f200640 1 --2- 172.21.15.112:0/3955491464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f48071530 0x7f6f4814d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:19.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.136+0000 7f6f4f200640 1 -- 172.21.15.112:0/3955491464 >> 172.21.15.112:0/3955491464 conn(0x7f6f4806bbd0 msgr2=0x7f6f48158ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:19.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.137+0000 7f6f4f200640 1 -- 172.21.15.112:0/3955491464 shutdown_connections 2024-09-12T02:51:19.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.137+0000 7f6f4f200640 1 -- 172.21.15.112:0/3955491464 wait complete. 2024-09-12T02:51:19.154 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T02:51:19.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.306+0000 7f0689a00640 1 Processor -- start 2024-09-12T02:51:19.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.306+0000 7f0689a00640 1 -- start start 2024-09-12T02:51:19.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.307+0000 7f0689a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f06840d33c0 0x7f06840cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:19.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.307+0000 7f0689a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f06840b3ad0 0x7f06840cff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:19.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.307+0000 7f0689a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06840d3910 con 0x7f06841624b0 2024-09-12T02:51:19.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.307+0000 7f0689a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f06840d3ed0 con 0x7f06840b3ad0 2024-09-12T02:51:19.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.307+0000 7f0689a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f06840b2a50 con 0x7f06840d33c0 2024-09-12T02:51:19.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.308+0000 7f0683e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f06841624b0 0x7f06840d2cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58714/0 (socket says 172.21.15.112:58714) 2024-09-12T02:51:19.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.308+0000 7f0683e00640 1 -- 172.21.15.112:0/629349717 learned_addr learned my addr 172.21.15.112:0/629349717 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:51:19.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.308+0000 7f0689000640 1 --2- 172.21.15.112:0/629349717 >> v2:172.21.15.112:3300/0 conn(0x7f06840b3ad0 0x7f06840cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:19.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.308+0000 7f067b400640 1 --2- 172.21.15.112:0/629349717 >> v2:172.21.15.137:3300/0 conn(0x7f06840d33c0 0x7f06840cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:19.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.308+0000 7f0689000640 1 -- 172.21.15.112:0/629349717 >> v2:172.21.15.137:3300/0 conn(0x7f06840d33c0 msgr2=0x7f06840cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:19.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.308+0000 7f0689000640 1 --2- 172.21.15.112:0/629349717 >> v2:172.21.15.137:3300/0 conn(0x7f06840d33c0 0x7f06840cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:19.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.308+0000 7f0689000640 1 -- 172.21.15.112:0/629349717 >> v1:172.21.15.112:6789/0 conn(0x7f06841624b0 legacy=0x7f06840d2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:19.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.308+0000 7f0689000640 1 -- 172.21.15.112:0/629349717 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06840d3bf0 con 0x7f06840b3ad0 2024-09-12T02:51:19.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.308+0000 7f0683400640 1 -- 172.21.15.112:0/629349717 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2513194530 0 0) 0x7f06840d3910 con 0x7f06841624b0 2024-09-12T02:51:19.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.309+0000 7f0689000640 1 --2- 172.21.15.112:0/629349717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06840b3ad0 0x7f06840cff00 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f067c009d90 tx=0x7f067c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316b49e9afd68ffc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:19.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.309+0000 7f0683400640 1 -- 172.21.15.112:0/629349717 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067c007740 con 0x7f06840b3ad0 2024-09-12T02:51:19.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.309+0000 7f0683400640 1 -- 172.21.15.112:0/629349717 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f067c0078e0 con 0x7f06840b3ad0 2024-09-12T02:51:19.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.309+0000 7f0683400640 1 -- 172.21.15.112:0/629349717 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067c007cb0 con 0x7f06840b3ad0 2024-09-12T02:51:19.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.310+0000 7f0689a00640 1 -- 172.21.15.112:0/629349717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06840b3ad0 msgr2=0x7f06840cff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:19.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.310+0000 7f0689a00640 1 --2- 172.21.15.112:0/629349717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06840b3ad0 0x7f06840cff00 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f067c009d90 tx=0x7f067c02a6a0 comp rx=0 tx=0).stop 2024-09-12T02:51:19.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.310+0000 7f0689a00640 1 -- 172.21.15.112:0/629349717 shutdown_connections 2024-09-12T02:51:19.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.310+0000 7f0689a00640 1 --2- 172.21.15.112:0/629349717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06840b3ad0 0x7f06840cff00 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:19.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.310+0000 7f0689a00640 1 --2- 172.21.15.112:0/629349717 >> v2:172.21.15.137:3300/0 conn(0x7f06840d33c0 0x7f06840cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:19.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.310+0000 7f0689a00640 1 -- 172.21.15.112:0/629349717 >> 172.21.15.112:0/629349717 conn(0x7f06840d4db0 msgr2=0x7f06840d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:19.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.310+0000 7f0689a00640 1 -- 172.21.15.112:0/629349717 shutdown_connections 2024-09-12T02:51:19.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.310+0000 7f0689a00640 1 -- 172.21.15.112:0/629349717 wait complete. 2024-09-12T02:51:19.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.312+0000 7f0689a00640 1 Processor -- start 2024-09-12T02:51:19.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.312+0000 7f0689a00640 1 -- start start 2024-09-12T02:51:19.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.312+0000 7f0689a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06840b3ad0 0x7f06840cb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:19.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.312+0000 7f0689a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06840d33c0 0x7f0684156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:19.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.312+0000 7f0689a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06841624b0 0x7f06840b9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:19.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.312+0000 7f0689a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f06840d2550 con 0x7f06840d33c0 2024-09-12T02:51:19.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.312+0000 7f0689a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f06840d2030 con 0x7f06841624b0 2024-09-12T02:51:19.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.312+0000 7f0689a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f06840c9770 con 0x7f06840b3ad0 2024-09-12T02:51:19.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.313+0000 7f067b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06840d33c0 0x7f0684156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:19.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.313+0000 7f067b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06840d33c0 0x7f0684156bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42396/0 (socket says 172.21.15.112:42396) 2024-09-12T02:51:19.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.313+0000 7f067b400640 1 -- 172.21.15.112:0/2926697768 learned_addr learned my addr 172.21.15.112:0/2926697768 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:19.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.313+0000 7f0683e00640 1 --2- 172.21.15.112:0/2926697768 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06840b3ad0 0x7f06840cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:19.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.313+0000 7f0689000640 1 --2- 172.21.15.112:0/2926697768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06841624b0 0x7f06840b9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:19.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.313+0000 7f067b400640 1 -- 172.21.15.112:0/2926697768 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06840b3ad0 msgr2=0x7f06840cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:19.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.313+0000 7f067b400640 1 --2- 172.21.15.112:0/2926697768 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06840b3ad0 0x7f06840cb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:19.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.313+0000 7f067b400640 1 -- 172.21.15.112:0/2926697768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06841624b0 msgr2=0x7f06840b9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:19.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.313+0000 7f067b400640 1 --2- 172.21.15.112:0/2926697768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06841624b0 0x7f06840b9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:19.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.313+0000 7f067b400640 1 -- 172.21.15.112:0/2926697768 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06840b5ce0 con 0x7f06840d33c0 2024-09-12T02:51:19.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.314+0000 7f067b400640 1 --2- 172.21.15.112:0/2926697768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06840d33c0 0x7f0684156bb0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f066c00e9b0 tx=0x7f066c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:19.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.314+0000 7f0680c00640 1 -- 172.21.15.112:0/2926697768 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066c017070 con 0x7f06840d33c0 2024-09-12T02:51:19.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.314+0000 7f0680c00640 1 -- 172.21.15.112:0/2926697768 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f066c00c9a0 con 0x7f06840d33c0 2024-09-12T02:51:19.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.314+0000 7f0680c00640 1 -- 172.21.15.112:0/2926697768 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066c00cd90 con 0x7f06840d33c0 2024-09-12T02:51:19.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.314+0000 7f0689a00640 1 -- 172.21.15.112:0/2926697768 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06840b5fc0 con 0x7f06840d33c0 2024-09-12T02:51:19.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.314+0000 7f0689a00640 1 -- 172.21.15.112:0/2926697768 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06840b6580 con 0x7f06840d33c0 2024-09-12T02:51:19.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.315+0000 7f0689a00640 1 -- 172.21.15.112:0/2926697768 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06840b4120 con 0x7f06840d33c0 2024-09-12T02:51:19.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.316+0000 7f0680c00640 1 -- 172.21.15.112:0/2926697768 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f066c01a070 con 0x7f06840d33c0 2024-09-12T02:51:19.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.317+0000 7f0680c00640 1 --2- 172.21.15.112:0/2926697768 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f066006be30 0x7f066006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:19.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.317+0000 7f0680c00640 1 -- 172.21.15.112:0/2926697768 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 4857+0+0 (secure 0 0 0) 0x7f066c08ae70 con 0x7f06840d33c0 2024-09-12T02:51:19.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.317+0000 7f0683e00640 1 --2- 172.21.15.112:0/2926697768 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f066006be30 0x7f066006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:19.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.317+0000 7f0683e00640 1 --2- 172.21.15.112:0/2926697768 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f066006be30 0x7f066006e2f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0674007fd0 tx=0x7f0674007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:19.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.321+0000 7f0680c00640 1 -- 172.21.15.112:0/2926697768 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f066c059510 con 0x7f06840d33c0 2024-09-12T02:51:19.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.497+0000 7f0689a00640 1 -- 172.21.15.112:0/2926697768 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f06840cb830 con 0x7f06840d33c0 2024-09-12T02:51:19.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.497+0000 7f0680c00640 1 -- 172.21.15.112:0/2926697768 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v163) ==== 84+0+65 (secure 0 0 0) 0x7f066c05d810 con 0x7f06840d33c0 2024-09-12T02:51:19.498 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:51:19.498 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2024-09-12T02:51:19.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:51:19.498 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 1, 2024-09-12T02:51:19.498 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": ".mgr" 2024-09-12T02:51:19.499 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:51:19.499 INFO:teuthology.orchestra.run.smithi112.stdout:] 2024-09-12T02:51:19.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.499+0000 7f0689a00640 1 -- 172.21.15.112:0/2926697768 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f066006be30 msgr2=0x7f066006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:19.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.499+0000 7f0689a00640 1 --2- 172.21.15.112:0/2926697768 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f066006be30 0x7f066006e2f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0674007fd0 tx=0x7f0674007de0 comp rx=0 tx=0).stop 2024-09-12T02:51:19.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.499+0000 7f0689a00640 1 -- 172.21.15.112:0/2926697768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06840d33c0 msgr2=0x7f0684156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:19.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.499+0000 7f0689a00640 1 --2- 172.21.15.112:0/2926697768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06840d33c0 0x7f0684156bb0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f066c00e9b0 tx=0x7f066c00ee70 comp rx=0 tx=0).stop 2024-09-12T02:51:19.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.499+0000 7f0689a00640 1 -- 172.21.15.112:0/2926697768 shutdown_connections 2024-09-12T02:51:19.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.499+0000 7f0689a00640 1 --2- 172.21.15.112:0/2926697768 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f066006be30 0x7f066006e2f0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:19.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.499+0000 7f0689a00640 1 --2- 172.21.15.112:0/2926697768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06841624b0 0x7f06840b9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:19.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.499+0000 7f0689a00640 1 --2- 172.21.15.112:0/2926697768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06840d33c0 0x7f0684156bb0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:19.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.499+0000 7f0689a00640 1 --2- 172.21.15.112:0/2926697768 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06840b3ad0 0x7f06840cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:19.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.499+0000 7f0689a00640 1 -- 172.21.15.112:0/2926697768 >> 172.21.15.112:0/2926697768 conn(0x7f06840d4db0 msgr2=0x7f06840d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:19.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.500+0000 7f0689a00640 1 -- 172.21.15.112:0/2926697768 shutdown_connections 2024-09-12T02:51:19.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.500+0000 7f0689a00640 1 -- 172.21.15.112:0/2926697768 wait complete. 2024-09-12T02:51:19.516 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T02:51:19.516 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T02:51:19.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.672+0000 7f9358c00640 1 Processor -- start 2024-09-12T02:51:19.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.673+0000 7f9358c00640 1 -- start start 2024-09-12T02:51:19.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.674+0000 7f9358c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9354144890 0x7f93540b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:19.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.674+0000 7f9358c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f93540b4140 0x7f93540ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:19.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.674+0000 7f9358c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f935406eed0 con 0x7f93541602f0 2024-09-12T02:51:19.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.674+0000 7f9358c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f935406f170 con 0x7f93540b4140 2024-09-12T02:51:19.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.674+0000 7f9358c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f935415f810 con 0x7f9354144890 2024-09-12T02:51:19.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.674+0000 7f9351400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f93541602f0 0x7f93540b3a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58730/0 (socket says 172.21.15.112:58730) 2024-09-12T02:51:19.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.674+0000 7f9351400640 1 -- 172.21.15.112:0/2139810943 learned_addr learned my addr 172.21.15.112:0/2139810943 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:51:19.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.674+0000 7f9351e00640 1 --2- 172.21.15.112:0/2139810943 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9354144890 0x7f93540b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:19.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.674+0000 7f9352800640 1 --2- 172.21.15.112:0/2139810943 >> v2:172.21.15.137:3300/0 conn(0x7f93540b4140 0x7f93540ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:19.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.675+0000 7f9350a00640 1 -- 172.21.15.112:0/2139810943 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1155226336 0 0) 0x7f935406eed0 con 0x7f93541602f0 2024-09-12T02:51:19.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.675+0000 7f9350a00640 1 -- 172.21.15.112:0/2139810943 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9338003520 con 0x7f93541602f0 2024-09-12T02:51:19.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.675+0000 7f9351e00640 1 -- 172.21.15.112:0/2139810943 >> v2:172.21.15.137:3300/0 conn(0x7f93540b4140 msgr2=0x7f93540ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:19.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.675+0000 7f9351e00640 1 --2- 172.21.15.112:0/2139810943 >> v2:172.21.15.137:3300/0 conn(0x7f93540b4140 0x7f93540ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:19.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.675+0000 7f9351e00640 1 -- 172.21.15.112:0/2139810943 >> v1:172.21.15.112:6789/0 conn(0x7f93541602f0 legacy=0x7f93540b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:19.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.675+0000 7f9351e00640 1 -- 172.21.15.112:0/2139810943 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f935415faf0 con 0x7f9354144890 2024-09-12T02:51:19.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.676+0000 7f9351e00640 1 --2- 172.21.15.112:0/2139810943 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9354144890 0x7f93540b58c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f93440097a0 tx=0x7f934402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dad51bae4ec7bce6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:19.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.676+0000 7f9350a00640 1 -- 172.21.15.112:0/2139810943 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9344037070 con 0x7f9354144890 2024-09-12T02:51:19.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.676+0000 7f9350a00640 1 -- 172.21.15.112:0/2139810943 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9344032440 con 0x7f9354144890 2024-09-12T02:51:19.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.676+0000 7f9350a00640 1 -- 172.21.15.112:0/2139810943 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9344032810 con 0x7f9354144890 2024-09-12T02:51:19.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.676+0000 7f9358c00640 1 -- 172.21.15.112:0/2139810943 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9354144890 msgr2=0x7f93540b58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:19.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.677+0000 7f9358c00640 1 --2- 172.21.15.112:0/2139810943 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9354144890 0x7f93540b58c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f93440097a0 tx=0x7f934402a180 comp rx=0 tx=0).stop 2024-09-12T02:51:19.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.677+0000 7f9358c00640 1 -- 172.21.15.112:0/2139810943 shutdown_connections 2024-09-12T02:51:19.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.677+0000 7f9358c00640 1 --2- 172.21.15.112:0/2139810943 >> v2:172.21.15.137:3300/0 conn(0x7f93540b4140 0x7f93540ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:19.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.677+0000 7f9358c00640 1 --2- 172.21.15.112:0/2139810943 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9354144890 0x7f93540b58c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:19.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.677+0000 7f9358c00640 1 -- 172.21.15.112:0/2139810943 >> 172.21.15.112:0/2139810943 conn(0x7f93540b2730 msgr2=0x7f93540b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:19.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.677+0000 7f9358c00640 1 -- 172.21.15.112:0/2139810943 shutdown_connections 2024-09-12T02:51:19.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.677+0000 7f9358c00640 1 -- 172.21.15.112:0/2139810943 wait complete. 2024-09-12T02:51:19.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.678+0000 7f9358c00640 1 Processor -- start 2024-09-12T02:51:19.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.678+0000 7f9358c00640 1 -- start start 2024-09-12T02:51:19.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.679+0000 7f9358c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93540b4140 0x7f9354137820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:19.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.679+0000 7f9358c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9354144890 0x7f9354134f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:19.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.679+0000 7f9358c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93541602f0 0x7f9354071d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:19.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.679+0000 7f9358c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9354144df0 con 0x7f93541602f0 2024-09-12T02:51:19.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.679+0000 7f9358c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9354144c70 con 0x7f9354144890 2024-09-12T02:51:19.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.679+0000 7f9358c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f93540b3290 con 0x7f93540b4140 2024-09-12T02:51:19.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.680+0000 7f9352800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93541602f0 0x7f9354071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:19.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.680+0000 7f9352800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93541602f0 0x7f9354071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42400/0 (socket says 172.21.15.112:42400) 2024-09-12T02:51:19.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.680+0000 7f9352800640 1 -- 172.21.15.112:0/1096853558 learned_addr learned my addr 172.21.15.112:0/1096853558 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:19.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.680+0000 7f9351e00640 1 --2- 172.21.15.112:0/1096853558 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93540b4140 0x7f9354137820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:19.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.680+0000 7f9351400640 1 --2- 172.21.15.112:0/1096853558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9354144890 0x7f9354134f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:19.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.680+0000 7f9352800640 1 -- 172.21.15.112:0/1096853558 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93540b4140 msgr2=0x7f9354137820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:19.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.680+0000 7f9352800640 1 --2- 172.21.15.112:0/1096853558 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93540b4140 0x7f9354137820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:19.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.680+0000 7f9352800640 1 -- 172.21.15.112:0/1096853558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9354144890 msgr2=0x7f9354134f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:19.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.680+0000 7f9352800640 1 --2- 172.21.15.112:0/1096853558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9354144890 0x7f9354134f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:19.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.680+0000 7f9352800640 1 -- 172.21.15.112:0/1096853558 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9354135820 con 0x7f93541602f0 2024-09-12T02:51:19.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.680+0000 7f9351e00640 1 --2- 172.21.15.112:0/1096853558 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93540b4140 0x7f9354137820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:51:19.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.680+0000 7f9352800640 1 --2- 172.21.15.112:0/1096853558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93541602f0 0x7f9354071d00 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f934c00efc0 tx=0x7f934c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:19.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.680+0000 7f934a000640 1 -- 172.21.15.112:0/1096853558 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934c018020 con 0x7f93541602f0 2024-09-12T02:51:19.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.681+0000 7f934a000640 1 -- 172.21.15.112:0/1096853558 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f934c014480 con 0x7f93541602f0 2024-09-12T02:51:19.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.681+0000 7f934a000640 1 -- 172.21.15.112:0/1096853558 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934c014870 con 0x7f93541602f0 2024-09-12T02:51:19.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.681+0000 7f9358c00640 1 -- 172.21.15.112:0/1096853558 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9354135b00 con 0x7f93541602f0 2024-09-12T02:51:19.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.681+0000 7f9358c00640 1 -- 172.21.15.112:0/1096853558 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93541360c0 con 0x7f93541602f0 2024-09-12T02:51:19.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.682+0000 7f9358c00640 1 -- 172.21.15.112:0/1096853558 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93540b58c0 con 0x7f93541602f0 2024-09-12T02:51:19.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.682+0000 7f934a000640 1 -- 172.21.15.112:0/1096853558 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f934c01b020 con 0x7f93541602f0 2024-09-12T02:51:19.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.684+0000 7f934a000640 1 --2- 172.21.15.112:0/1096853558 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f933406be60 0x7f933406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:19.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.684+0000 7f934a000640 1 -- 172.21.15.112:0/1096853558 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 4857+0+0 (secure 0 0 0) 0x7f934c08baa0 con 0x7f93541602f0 2024-09-12T02:51:19.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.684+0000 7f9351e00640 1 --2- 172.21.15.112:0/1096853558 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f933406be60 0x7f933406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:19.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.685+0000 7f9351e00640 1 --2- 172.21.15.112:0/1096853558 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f933406be60 0x7f933406e320 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9344034000 tx=0x7f934402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:19.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.688+0000 7f934a000640 1 -- 172.21.15.112:0/1096853558 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f934c022020 con 0x7f93541602f0 2024-09-12T02:51:19.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:19.861+0000 7f9358c00640 1 -- 172.21.15.112:0/1096853558 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f93540b2450 con 0x7f93541602f0 2024-09-12T02:51:20.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.713+0000 7f934a000640 1 -- 172.21.15.112:0/1096853558 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v164) ==== 138+0+0 (secure 0 0 0) 0x7f934c010040 con 0x7f93541602f0 2024-09-12T02:51:20.714 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' created 2024-09-12T02:51:20.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.717+0000 7f9358c00640 1 -- 172.21.15.112:0/1096853558 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f933406be60 msgr2=0x7f933406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:20.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.717+0000 7f9358c00640 1 --2- 172.21.15.112:0/1096853558 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f933406be60 0x7f933406e320 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9344034000 tx=0x7f934402e000 comp rx=0 tx=0).stop 2024-09-12T02:51:20.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.717+0000 7f9358c00640 1 -- 172.21.15.112:0/1096853558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93541602f0 msgr2=0x7f9354071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:20.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.717+0000 7f9358c00640 1 --2- 172.21.15.112:0/1096853558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93541602f0 0x7f9354071d00 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f934c00efc0 tx=0x7f934c00c490 comp rx=0 tx=0).stop 2024-09-12T02:51:20.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.717+0000 7f9358c00640 1 -- 172.21.15.112:0/1096853558 shutdown_connections 2024-09-12T02:51:20.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.717+0000 7f9358c00640 1 --2- 172.21.15.112:0/1096853558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93541602f0 0x7f9354071d00 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:20.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.717+0000 7f9358c00640 1 --2- 172.21.15.112:0/1096853558 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f933406be60 0x7f933406e320 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:20.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.717+0000 7f9358c00640 1 --2- 172.21.15.112:0/1096853558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9354144890 0x7f9354134f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:20.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.717+0000 7f9358c00640 1 --2- 172.21.15.112:0/1096853558 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93540b4140 0x7f9354137820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:20.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.717+0000 7f9358c00640 1 -- 172.21.15.112:0/1096853558 >> 172.21.15.112:0/1096853558 conn(0x7f93540b2730 msgr2=0x7f9354072b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:20.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.717+0000 7f9358c00640 1 -- 172.21.15.112:0/1096853558 shutdown_connections 2024-09-12T02:51:20.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.717+0000 7f9358c00640 1 -- 172.21.15.112:0/1096853558 wait complete. 2024-09-12T02:51:20.737 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:51:20.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.898+0000 7fd8bd800640 1 Processor -- start 2024-09-12T02:51:20.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.898+0000 7fd8bd800640 1 -- start start 2024-09-12T02:51:20.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.900+0000 7fd8bd800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd8b81465b0 0x7fd8b80b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:20.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.900+0000 7fd8bd800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8b80b4480 con 0x7fd8b80b5c80 2024-09-12T02:51:20.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.900+0000 7fd8bd800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8b80b4760 con 0x7fd8b80b3f00 2024-09-12T02:51:20.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.900+0000 7fd8bd800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd8b80b4a40 con 0x7fd8b81465b0 2024-09-12T02:51:20.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.900+0000 7fd8bce00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd8b80b5c80 0x7fd8b80cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58746/0 (socket says 172.21.15.112:58746) 2024-09-12T02:51:20.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.900+0000 7fd8bce00640 1 -- 172.21.15.112:0/1829555680 learned_addr learned my addr 172.21.15.112:0/1829555680 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:51:20.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.900+0000 7fd8b7e00640 1 --2- 172.21.15.112:0/1829555680 >> v2:172.21.15.137:3300/0 conn(0x7fd8b81465b0 0x7fd8b80b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:20.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.900+0000 7fd8b6a00640 1 -- 172.21.15.112:0/1829555680 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1882980932 0 0) 0x7fd8b80b4480 con 0x7fd8b80b5c80 2024-09-12T02:51:20.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.900+0000 7fd8b6a00640 1 -- 172.21.15.112:0/1829555680 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd89c003520 con 0x7fd8b80b5c80 2024-09-12T02:51:20.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.901+0000 7fd8b6a00640 1 -- 172.21.15.112:0/1829555680 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2564790932 0 0) 0x7fd8b80b4760 con 0x7fd8b80b3f00 2024-09-12T02:51:20.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.901+0000 7fd8b6a00640 1 -- 172.21.15.112:0/1829555680 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8b80b4480 con 0x7fd8b80b3f00 2024-09-12T02:51:20.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.901+0000 7fd8b6a00640 1 -- 172.21.15.112:0/1829555680 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2484782759 0 0) 0x7fd89c003520 con 0x7fd8b80b5c80 2024-09-12T02:51:20.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.901+0000 7fd8b6a00640 1 -- 172.21.15.112:0/1829555680 >> v2:172.21.15.137:3300/0 conn(0x7fd8b81465b0 msgr2=0x7fd8b80b39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:20.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.901+0000 7fd8b6a00640 1 --2- 172.21.15.112:0/1829555680 >> v2:172.21.15.137:3300/0 conn(0x7fd8b81465b0 0x7fd8b80b39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:20.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.901+0000 7fd8b6a00640 1 -- 172.21.15.112:0/1829555680 >> v1:172.21.15.137:6789/0 conn(0x7fd8b80b3f00 legacy=0x7fd8b80b5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:20.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.901+0000 7fd8b6a00640 1 -- 172.21.15.112:0/1829555680 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8b80ceeb0 con 0x7fd8b80b5c80 2024-09-12T02:51:20.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.901+0000 7fd8b6a00640 1 -- 172.21.15.112:0/1829555680 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7fd8b0001670 con 0x7fd8b80b5c80 2024-09-12T02:51:20.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.901+0000 7fd8b6a00640 1 -- 172.21.15.112:0/1829555680 >> v1:172.21.15.112:6789/0 conn(0x7fd8b80b5c80 legacy=0x7fd8b80cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:20.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.901+0000 7fd8b6a00640 1 --2- 172.21.15.112:0/1829555680 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd89c003b90 0x7fd89c003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:20.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.901+0000 7fd8b6a00640 1 --2- 172.21.15.112:0/1829555680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd89c004800 0x7fd89c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:20.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.901+0000 7fd8b6a00640 1 --2- 172.21.15.112:0/1829555680 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd89c005210 0x7fd89c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:20.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.901+0000 7fd8b6a00640 1 -- 172.21.15.112:0/1829555680 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b80b4a40 con 0x7fd89c004800 2024-09-12T02:51:20.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.901+0000 7fd8b6a00640 1 -- 172.21.15.112:0/1829555680 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd89c00c140 con 0x7fd89c003b90 2024-09-12T02:51:20.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.901+0000 7fd8b6a00640 1 -- 172.21.15.112:0/1829555680 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd89c00c340 con 0x7fd89c005210 2024-09-12T02:51:20.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.901+0000 7fd8b7400640 1 --2- 172.21.15.112:0/1829555680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd89c004800 0x7fd89c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:20.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.901+0000 7fd8bce00640 1 --2- 172.21.15.112:0/1829555680 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd89c005210 0x7fd89c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:20.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.901+0000 7fd8b7e00640 1 --2- 172.21.15.112:0/1829555680 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd89c003b90 0x7fd89c003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:20.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.902+0000 7fd8b7400640 1 -- 172.21.15.112:0/1829555680 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd89c005210 msgr2=0x7fd89c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:20.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.902+0000 7fd8b7400640 1 --2- 172.21.15.112:0/1829555680 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd89c005210 0x7fd89c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:20.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.902+0000 7fd8b7400640 1 -- 172.21.15.112:0/1829555680 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd89c003b90 msgr2=0x7fd89c003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:20.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.902+0000 7fd8b7400640 1 --2- 172.21.15.112:0/1829555680 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd89c003b90 0x7fd89c003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:20.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.902+0000 7fd8b7400640 1 -- 172.21.15.112:0/1829555680 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd89c003520 con 0x7fd89c004800 2024-09-12T02:51:20.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.902+0000 7fd8bce00640 1 -- 172.21.15.112:0/1829555680 reap_dead start 2024-09-12T02:51:20.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.902+0000 7fd8b7400640 1 --2- 172.21.15.112:0/1829555680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd89c004800 0x7fd89c004c80 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fd8a40018d0 tx=0x7fd89c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e467ff4f3dc0e96 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:20.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.903+0000 7fd8b6a00640 1 -- 172.21.15.112:0/1829555680 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a40014f0 con 0x7fd89c004800 2024-09-12T02:51:20.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.903+0000 7fd8b6a00640 1 -- 172.21.15.112:0/1829555680 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8a40052d0 con 0x7fd89c004800 2024-09-12T02:51:20.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.903+0000 7fd8b6a00640 1 -- 172.21.15.112:0/1829555680 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a402ac40 con 0x7fd89c004800 2024-09-12T02:51:20.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.903+0000 7fd8bd800640 1 -- 172.21.15.112:0/1829555680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd89c004800 msgr2=0x7fd89c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:20.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.903+0000 7fd8bd800640 1 --2- 172.21.15.112:0/1829555680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd89c004800 0x7fd89c004c80 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fd8a40018d0 tx=0x7fd89c005830 comp rx=0 tx=0).stop 2024-09-12T02:51:20.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.903+0000 7fd8bd800640 1 -- 172.21.15.112:0/1829555680 shutdown_connections 2024-09-12T02:51:20.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.903+0000 7fd8bd800640 1 --2- 172.21.15.112:0/1829555680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd89c004800 0x7fd89c004c80 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:20.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.903+0000 7fd8bd800640 1 -- 172.21.15.112:0/1829555680 >> 172.21.15.112:0/1829555680 conn(0x7fd8b80b26c0 msgr2=0x7fd8b80b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:20.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.903+0000 7fd8bd800640 1 -- 172.21.15.112:0/1829555680 shutdown_connections 2024-09-12T02:51:20.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.903+0000 7fd8bd800640 1 -- 172.21.15.112:0/1829555680 wait complete. 2024-09-12T02:51:20.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.905+0000 7fd8bd800640 1 Processor -- start 2024-09-12T02:51:20.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.905+0000 7fd8bd800640 1 -- start start 2024-09-12T02:51:20.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.906+0000 7fd8bd800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd89c004800 0x7fd8b8137350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:20.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.906+0000 7fd8bd800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8b8142260 0x7fd8b815f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:20.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.906+0000 7fd8bd800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8b81426c0 0x7fd8b815f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:20.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.906+0000 7fd8bd800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b80b39c0 con 0x7fd8b81426c0 2024-09-12T02:51:20.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.906+0000 7fd8bd800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b80cd5d0 con 0x7fd8b8142260 2024-09-12T02:51:20.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.906+0000 7fd8bd800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd8b80b3b40 con 0x7fd89c004800 2024-09-12T02:51:20.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.906+0000 7fd8bce00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8b81426c0 0x7fd8b815f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:20.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.906+0000 7fd8bce00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8b81426c0 0x7fd8b815f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42428/0 (socket says 172.21.15.112:42428) 2024-09-12T02:51:20.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.906+0000 7fd8bce00640 1 -- 172.21.15.112:0/3181880565 learned_addr learned my addr 172.21.15.112:0/3181880565 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:20.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.907+0000 7fd8b7400640 1 --2- 172.21.15.112:0/3181880565 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8b8142260 0x7fd8b815f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:20.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.907+0000 7fd8b7e00640 1 --2- 172.21.15.112:0/3181880565 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd89c004800 0x7fd8b8137350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:20.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.907+0000 7fd8bce00640 1 -- 172.21.15.112:0/3181880565 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd89c004800 msgr2=0x7fd8b8137350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:20.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.907+0000 7fd8bce00640 1 --2- 172.21.15.112:0/3181880565 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd89c004800 0x7fd8b8137350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:20.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.907+0000 7fd8bce00640 1 -- 172.21.15.112:0/3181880565 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8b8142260 msgr2=0x7fd8b815f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:20.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.907+0000 7fd8bce00640 1 --2- 172.21.15.112:0/3181880565 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8b8142260 0x7fd8b815f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:20.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.907+0000 7fd8bce00640 1 -- 172.21.15.112:0/3181880565 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8b80b24d0 con 0x7fd8b81426c0 2024-09-12T02:51:20.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.907+0000 7fd8b7400640 1 --2- 172.21.15.112:0/3181880565 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8b8142260 0x7fd8b815f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:51:20.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.907+0000 7fd8bce00640 1 --2- 172.21.15.112:0/3181880565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8b81426c0 0x7fd8b815f6d0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fd8b815cf50 tx=0x7fd8b0007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:20.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.907+0000 7fd8afe00640 1 -- 172.21.15.112:0/3181880565 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b000f700 con 0x7fd8b81426c0 2024-09-12T02:51:20.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.907+0000 7fd8afe00640 1 -- 172.21.15.112:0/3181880565 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8b0018070 con 0x7fd8b81426c0 2024-09-12T02:51:20.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.907+0000 7fd8afe00640 1 -- 172.21.15.112:0/3181880565 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b000fac0 con 0x7fd8b81426c0 2024-09-12T02:51:20.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.907+0000 7fd8bd800640 1 -- 172.21.15.112:0/3181880565 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8b8140d00 con 0x7fd8b81426c0 2024-09-12T02:51:20.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.907+0000 7fd8bd800640 1 -- 172.21.15.112:0/3181880565 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8b8140fa0 con 0x7fd8b81426c0 2024-09-12T02:51:20.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.909+0000 7fd8bd800640 1 -- 172.21.15.112:0/3181880565 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8b8068a30 con 0x7fd8b81426c0 2024-09-12T02:51:20.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.910+0000 7fd8afe00640 1 -- 172.21.15.112:0/3181880565 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd8b000fc60 con 0x7fd8b81426c0 2024-09-12T02:51:20.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.910+0000 7fd8afe00640 1 --2- 172.21.15.112:0/3181880565 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd89806be30 0x7fd89806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:20.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.911+0000 7fd8afe00640 1 -- 172.21.15.112:0/3181880565 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(164..164 src has 1..164) ==== 5227+0+0 (secure 0 0 0) 0x7fd8b008a850 con 0x7fd8b81426c0 2024-09-12T02:51:20.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.911+0000 7fd8b7e00640 1 --2- 172.21.15.112:0/3181880565 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd89806be30 0x7fd89806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:20.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.911+0000 7fd8b7e00640 1 --2- 172.21.15.112:0/3181880565 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd89806be30 0x7fd89806e2f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fd8a80132b0 tx=0x7fd8a800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:20.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:20.916+0000 7fd8afe00640 1 -- 172.21.15.112:0/3181880565 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd8b0058d80 con 0x7fd8b81426c0 2024-09-12T02:51:21.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.088+0000 7fd8bd800640 1 -- 172.21.15.112:0/3181880565 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fd8b80b5570 con 0x7fd8b81426c0 2024-09-12T02:51:21.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.725+0000 7fd8afe00640 1 -- 172.21.15.112:0/3181880565 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v165) ==== 170+0+0 (secure 0 0 0) 0x7fd8b005d080 con 0x7fd8b81426c0 2024-09-12T02:51:21.725 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' created 2024-09-12T02:51:21.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.729+0000 7fd8bd800640 1 -- 172.21.15.112:0/3181880565 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd89806be30 msgr2=0x7fd89806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:21.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.729+0000 7fd8bd800640 1 --2- 172.21.15.112:0/3181880565 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd89806be30 0x7fd89806e2f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fd8a80132b0 tx=0x7fd8a800b040 comp rx=0 tx=0).stop 2024-09-12T02:51:21.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.729+0000 7fd8bd800640 1 -- 172.21.15.112:0/3181880565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8b81426c0 msgr2=0x7fd8b815f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:21.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.729+0000 7fd8bd800640 1 --2- 172.21.15.112:0/3181880565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8b81426c0 0x7fd8b815f6d0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fd8b815cf50 tx=0x7fd8b0007430 comp rx=0 tx=0).stop 2024-09-12T02:51:21.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.731+0000 7fd8bd800640 1 -- 172.21.15.112:0/3181880565 shutdown_connections 2024-09-12T02:51:21.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.731+0000 7fd8bd800640 1 --2- 172.21.15.112:0/3181880565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8b81426c0 0x7fd8b815f6d0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.731+0000 7fd8bd800640 1 --2- 172.21.15.112:0/3181880565 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd89806be30 0x7fd89806e2f0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.731+0000 7fd8bd800640 1 --2- 172.21.15.112:0/3181880565 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8b8142260 0x7fd8b815f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.731+0000 7fd8bd800640 1 --2- 172.21.15.112:0/3181880565 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd89c004800 0x7fd8b8137350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.731+0000 7fd8bd800640 1 -- 172.21.15.112:0/3181880565 >> 172.21.15.112:0/3181880565 conn(0x7fd8b80b26c0 msgr2=0x7fd8b8072df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:21.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.731+0000 7fd8bd800640 1 -- 172.21.15.112:0/3181880565 shutdown_connections 2024-09-12T02:51:21.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.732+0000 7fd8bd800640 1 -- 172.21.15.112:0/3181880565 wait complete. 2024-09-12T02:51:21.757 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T02:51:21.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.913+0000 7f24b3200640 1 Processor -- start 2024-09-12T02:51:21.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.913+0000 7f24b3200640 1 -- start start 2024-09-12T02:51:21.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.915+0000 7f24b3200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24ac15b9d0 0x7f24ac0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:21.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.915+0000 7f24b3200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f24ac06f600 0x7f24ac0728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:21.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.915+0000 7f24b3200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24ac0b54a0 con 0x7f24ac0b45d0 2024-09-12T02:51:21.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.915+0000 7f24b3200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f24ac0b4a30 con 0x7f24ac06f600 2024-09-12T02:51:21.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.915+0000 7f24b3200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f24ac0b3af0 con 0x7f24ac15b9d0 2024-09-12T02:51:21.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.915+0000 7f24abe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24ac15b9d0 0x7f24ac0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:21.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.915+0000 7f24a3400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f24ac0b45d0 0x7f24ac06eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.112:43940/0 (socket says 172.21.15.112:43940) 2024-09-12T02:51:21.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.915+0000 7f24a3400640 1 -- 172.21.15.112:0/2014250037 learned_addr learned my addr 172.21.15.112:0/2014250037 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:51:21.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.915+0000 7f24b1200640 1 --2- 172.21.15.112:0/2014250037 >> v2:172.21.15.137:3300/0 conn(0x7f24ac06f600 0x7f24ac0728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:21.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.916+0000 7f24abe00640 1 -- 172.21.15.112:0/2014250037 >> v2:172.21.15.137:3300/0 conn(0x7f24ac06f600 msgr2=0x7f24ac0728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:21.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.916+0000 7f24abe00640 1 --2- 172.21.15.112:0/2014250037 >> v2:172.21.15.137:3300/0 conn(0x7f24ac06f600 0x7f24ac0728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.916+0000 7f24abe00640 1 -- 172.21.15.112:0/2014250037 >> v1:172.21.15.137:6789/0 conn(0x7f24ac0b45d0 legacy=0x7f24ac06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:21.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.916+0000 7f24abe00640 1 -- 172.21.15.112:0/2014250037 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24ac0b3dd0 con 0x7f24ac15b9d0 2024-09-12T02:51:21.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.916+0000 7f24b1200640 1 --2- 172.21.15.112:0/2014250037 >> v2:172.21.15.137:3300/0 conn(0x7f24ac06f600 0x7f24ac0728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:51:21.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.916+0000 7f24ab400640 1 -- 172.21.15.112:0/2014250037 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 473328301 0 0) 0x7f24ac0b54a0 con 0x7f24ac0b45d0 2024-09-12T02:51:21.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.917+0000 7f24abe00640 1 --2- 172.21.15.112:0/2014250037 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24ac15b9d0 0x7f24ac0b4ec0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f249c0097a0 tx=0x7f249c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad802fd23f8907dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:21.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.917+0000 7f24ab400640 1 -- 172.21.15.112:0/2014250037 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c037070 con 0x7f24ac15b9d0 2024-09-12T02:51:21.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.917+0000 7f24ab400640 1 -- 172.21.15.112:0/2014250037 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f249c032440 con 0x7f24ac15b9d0 2024-09-12T02:51:21.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.917+0000 7f24ab400640 1 -- 172.21.15.112:0/2014250037 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c032810 con 0x7f24ac15b9d0 2024-09-12T02:51:21.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.918+0000 7f24b3200640 1 -- 172.21.15.112:0/2014250037 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24ac15b9d0 msgr2=0x7f24ac0b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:21.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.918+0000 7f24b3200640 1 --2- 172.21.15.112:0/2014250037 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24ac15b9d0 0x7f24ac0b4ec0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f249c0097a0 tx=0x7f249c02a180 comp rx=0 tx=0).stop 2024-09-12T02:51:21.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.918+0000 7f24b3200640 1 -- 172.21.15.112:0/2014250037 shutdown_connections 2024-09-12T02:51:21.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.918+0000 7f24b3200640 1 --2- 172.21.15.112:0/2014250037 >> v2:172.21.15.137:3300/0 conn(0x7f24ac06f600 0x7f24ac0728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.918+0000 7f24b3200640 1 --2- 172.21.15.112:0/2014250037 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24ac15b9d0 0x7f24ac0b4ec0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.918+0000 7f24b3200640 1 -- 172.21.15.112:0/2014250037 >> 172.21.15.112:0/2014250037 conn(0x7f24ac06bbd0 msgr2=0x7f24ac06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:21.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.918+0000 7f24b3200640 1 -- 172.21.15.112:0/2014250037 shutdown_connections 2024-09-12T02:51:21.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.918+0000 7f24b3200640 1 -- 172.21.15.112:0/2014250037 wait complete. 2024-09-12T02:51:21.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.919+0000 7f24b3200640 1 Processor -- start 2024-09-12T02:51:21.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.920+0000 7f24b3200640 1 -- start start 2024-09-12T02:51:21.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.921+0000 7f24b3200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24ac06f600 0x7f24ac164f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:21.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.921+0000 7f24b3200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24ac0b45d0 0x7f24ac155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:21.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.921+0000 7f24b3200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24ac15b9d0 0x7f24ac1463c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:21.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.921+0000 7f24b3200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac15bf30 con 0x7f24ac06f600 2024-09-12T02:51:21.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.921+0000 7f24b3200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac15bdb0 con 0x7f24ac0b45d0 2024-09-12T02:51:21.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.921+0000 7f24b3200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f24ac0cdcd0 con 0x7f24ac15b9d0 2024-09-12T02:51:21.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.921+0000 7f24abe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24ac06f600 0x7f24ac164f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:21.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.921+0000 7f24abe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24ac06f600 0x7f24ac164f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36682/0 (socket says 172.21.15.112:36682) 2024-09-12T02:51:21.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.921+0000 7f24abe00640 1 -- 172.21.15.112:0/3602472443 learned_addr learned my addr 172.21.15.112:0/3602472443 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:21.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.921+0000 7f24a3400640 1 --2- 172.21.15.112:0/3602472443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24ac0b45d0 0x7f24ac155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:21.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.921+0000 7f24b1200640 1 --2- 172.21.15.112:0/3602472443 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24ac15b9d0 0x7f24ac1463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:21.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.921+0000 7f24abe00640 1 -- 172.21.15.112:0/3602472443 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24ac15b9d0 msgr2=0x7f24ac1463c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:21.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.921+0000 7f24abe00640 1 --2- 172.21.15.112:0/3602472443 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24ac15b9d0 0x7f24ac1463c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.921+0000 7f24abe00640 1 -- 172.21.15.112:0/3602472443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24ac0b45d0 msgr2=0x7f24ac155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:21.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.921+0000 7f24abe00640 1 --2- 172.21.15.112:0/3602472443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24ac0b45d0 0x7f24ac155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:21.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.921+0000 7f24abe00640 1 -- 172.21.15.112:0/3602472443 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24ac155690 con 0x7f24ac06f600 2024-09-12T02:51:21.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.921+0000 7f24a3400640 1 --2- 172.21.15.112:0/3602472443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24ac0b45d0 0x7f24ac155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:51:21.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.921+0000 7f24b1200640 1 --2- 172.21.15.112:0/3602472443 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24ac15b9d0 0x7f24ac1463c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:51:21.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.922+0000 7f24abe00640 1 --2- 172.21.15.112:0/3602472443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24ac06f600 0x7f24ac164f40 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f249c0098c0 tx=0x7f249c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:21.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.922+0000 7f24a8c00640 1 -- 172.21.15.112:0/3602472443 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c037040 con 0x7f24ac06f600 2024-09-12T02:51:21.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.922+0000 7f24b3200640 1 -- 172.21.15.112:0/3602472443 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24ac155960 con 0x7f24ac06f600 2024-09-12T02:51:21.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.922+0000 7f24a8c00640 1 -- 172.21.15.112:0/3602472443 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f249c042070 con 0x7f24ac06f600 2024-09-12T02:51:21.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.922+0000 7f24a8c00640 1 -- 172.21.15.112:0/3602472443 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c030940 con 0x7f24ac06f600 2024-09-12T02:51:21.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.922+0000 7f24b3200640 1 -- 172.21.15.112:0/3602472443 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24ac166df0 con 0x7f24ac06f600 2024-09-12T02:51:21.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.923+0000 7f24b3200640 1 -- 172.21.15.112:0/3602472443 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24ac157fa0 con 0x7f24ac06f600 2024-09-12T02:51:21.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.924+0000 7f24a8c00640 1 -- 172.21.15.112:0/3602472443 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f249c030ae0 con 0x7f24ac06f600 2024-09-12T02:51:21.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.925+0000 7f24a8c00640 1 --2- 172.21.15.112:0/3602472443 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f248806be30 0x7f248806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:21.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.925+0000 7f24a8c00640 1 -- 172.21.15.112:0/3602472443 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5609+0+0 (secure 0 0 0) 0x7f249c0ab830 con 0x7f24ac06f600 2024-09-12T02:51:21.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.925+0000 7f24a3400640 1 --2- 172.21.15.112:0/3602472443 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f248806be30 0x7f248806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:21.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.926+0000 7f24a3400640 1 --2- 172.21.15.112:0/3602472443 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f248806be30 0x7f248806e2f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f24ac1f85e0 tx=0x7f2494009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:21.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:21.930+0000 7f24a8c00640 1 -- 172.21.15.112:0/3602472443 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f249c045360 con 0x7f24ac06f600 2024-09-12T02:51:22.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.138+0000 7f24b3200640 1 -- 172.21.15.112:0/3602472443 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f24ac1671c0 con 0x7f24ac06f600 2024-09-12T02:51:22.561 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:51:22.565 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:51:22.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.726+0000 7f24a8c00640 1 -- 172.21.15.112:0/3602472443 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v82) ==== 174+0+0 (secure 0 0 0) 0x7f249c07a120 con 0x7f24ac06f600 2024-09-12T02:51:22.727 INFO:teuthology.orchestra.run.smithi112.stderr:new fs with metadata pool 20 and data pool 21 2024-09-12T02:51:22.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.729+0000 7f24b3200640 1 -- 172.21.15.112:0/3602472443 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f248806be30 msgr2=0x7f248806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:22.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.729+0000 7f24b3200640 1 --2- 172.21.15.112:0/3602472443 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f248806be30 0x7f248806e2f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f24ac1f85e0 tx=0x7f2494009040 comp rx=0 tx=0).stop 2024-09-12T02:51:22.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.729+0000 7f24b3200640 1 -- 172.21.15.112:0/3602472443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24ac06f600 msgr2=0x7f24ac164f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:22.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.729+0000 7f24b3200640 1 --2- 172.21.15.112:0/3602472443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24ac06f600 0x7f24ac164f40 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f249c0098c0 tx=0x7f249c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:51:22.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.730+0000 7f24b3200640 1 -- 172.21.15.112:0/3602472443 shutdown_connections 2024-09-12T02:51:22.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.730+0000 7f24b3200640 1 --2- 172.21.15.112:0/3602472443 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24ac15b9d0 0x7f24ac1463c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:22.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.730+0000 7f24b3200640 1 --2- 172.21.15.112:0/3602472443 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f248806be30 0x7f248806e2f0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:22.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.730+0000 7f24b3200640 1 --2- 172.21.15.112:0/3602472443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24ac0b45d0 0x7f24ac155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:22.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.730+0000 7f24b3200640 1 --2- 172.21.15.112:0/3602472443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24ac06f600 0x7f24ac164f40 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:22.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.730+0000 7f24b3200640 1 -- 172.21.15.112:0/3602472443 >> 172.21.15.112:0/3602472443 conn(0x7f24ac06bbd0 msgr2=0x7f24ac0cf970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:22.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.730+0000 7f24b3200640 1 -- 172.21.15.112:0/3602472443 shutdown_connections 2024-09-12T02:51:22.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.731+0000 7f24b3200640 1 -- 172.21.15.112:0/3602472443 wait complete. 2024-09-12T02:51:22.760 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:51:22.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.911+0000 7f979cc00640 1 Processor -- start 2024-09-12T02:51:22.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.911+0000 7f979cc00640 1 -- start start 2024-09-12T02:51:22.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.912+0000 7f979cc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97980d1710 0x7f97980d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:22.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.912+0000 7f979cc00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97980d2fb0 con 0x7f97980b3e00 2024-09-12T02:51:22.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.912+0000 7f979cc00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97980d0b60 con 0x7f97980b1d70 2024-09-12T02:51:22.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.912+0000 7f979cc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f97980d3cb0 con 0x7f97980d1710 2024-09-12T02:51:22.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.912+0000 7f9796a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f97980b3e00 0x7f97980d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52170/0 (socket says 172.21.15.112:52170) 2024-09-12T02:51:22.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.912+0000 7f9796a00640 1 -- 172.21.15.112:0/3955211547 learned_addr learned my addr 172.21.15.112:0/3955211547 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:51:22.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.912+0000 7f9797400640 1 --2- 172.21.15.112:0/3955211547 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97980d1710 0x7f97980d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:22.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.913+0000 7f9796000640 1 -- 172.21.15.112:0/3955211547 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1922144137 0 0) 0x7f97980d2fb0 con 0x7f97980b3e00 2024-09-12T02:51:22.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.913+0000 7f9796000640 1 -- 172.21.15.112:0/3955211547 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f977c003520 con 0x7f97980b3e00 2024-09-12T02:51:22.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.913+0000 7f9796000640 1 -- 172.21.15.112:0/3955211547 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1664901316 0 0) 0x7f97980d0b60 con 0x7f97980b1d70 2024-09-12T02:51:22.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.913+0000 7f9797400640 1 -- 172.21.15.112:0/3955211547 >> v1:172.21.15.137:6789/0 conn(0x7f97980b1d70 legacy=0x7f97980b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:22.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.913+0000 7f9797400640 1 -- 172.21.15.112:0/3955211547 >> v1:172.21.15.112:6789/0 conn(0x7f97980b3e00 legacy=0x7f97980d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:22.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.913+0000 7f9797400640 1 -- 172.21.15.112:0/3955211547 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97980d3410 con 0x7f97980d1710 2024-09-12T02:51:22.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.914+0000 7f9797400640 1 --2- 172.21.15.112:0/3955211547 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97980d1710 0x7f97980d28d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f97880097d0 tx=0x7f978802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f57ee62ce695c7c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:22.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.914+0000 7f9796000640 1 -- 172.21.15.112:0/3955211547 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9788037070 con 0x7f97980d1710 2024-09-12T02:51:22.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.914+0000 7f9796000640 1 -- 172.21.15.112:0/3955211547 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9788032440 con 0x7f97980d1710 2024-09-12T02:51:22.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.914+0000 7f9796000640 1 -- 172.21.15.112:0/3955211547 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97880327f0 con 0x7f97980d1710 2024-09-12T02:51:22.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.915+0000 7f979cc00640 1 -- 172.21.15.112:0/3955211547 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97980d1710 msgr2=0x7f97980d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:22.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.915+0000 7f979cc00640 1 --2- 172.21.15.112:0/3955211547 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97980d1710 0x7f97980d28d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f97880097d0 tx=0x7f978802a210 comp rx=0 tx=0).stop 2024-09-12T02:51:22.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.915+0000 7f979cc00640 1 -- 172.21.15.112:0/3955211547 shutdown_connections 2024-09-12T02:51:22.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.915+0000 7f979cc00640 1 --2- 172.21.15.112:0/3955211547 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97980d1710 0x7f97980d28d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:22.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.915+0000 7f979cc00640 1 -- 172.21.15.112:0/3955211547 >> 172.21.15.112:0/3955211547 conn(0x7f979809e030 msgr2=0x7f97980d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:22.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.915+0000 7f979cc00640 1 -- 172.21.15.112:0/3955211547 shutdown_connections 2024-09-12T02:51:22.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.915+0000 7f979cc00640 1 -- 172.21.15.112:0/3955211547 wait complete. 2024-09-12T02:51:22.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.916+0000 7f979cc00640 1 Processor -- start 2024-09-12T02:51:22.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.917+0000 7f979cc00640 1 -- start start 2024-09-12T02:51:22.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.917+0000 7f979cc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97980b1d70 0x7f97980ba3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:22.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.918+0000 7f979cc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97980b3e00 0x7f9798152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:22.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.918+0000 7f979cc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97980d1710 0x7f97980d4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:22.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.918+0000 7f979cc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f979815f110 con 0x7f97980d1710 2024-09-12T02:51:22.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.918+0000 7f979cc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f97980d39d0 con 0x7f97980b1d70 2024-09-12T02:51:22.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.918+0000 7f979cc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f979815f290 con 0x7f97980b3e00 2024-09-12T02:51:22.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.918+0000 7f9797e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97980d1710 0x7f97980d4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:22.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.918+0000 7f9797400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97980b1d70 0x7f97980ba3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:22.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.918+0000 7f9797e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97980d1710 0x7f97980d4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36690/0 (socket says 172.21.15.112:36690) 2024-09-12T02:51:22.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.918+0000 7f9797e00640 1 -- 172.21.15.112:0/4265699186 learned_addr learned my addr 172.21.15.112:0/4265699186 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:22.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.918+0000 7f9796a00640 1 --2- 172.21.15.112:0/4265699186 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97980b3e00 0x7f9798152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:22.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.918+0000 7f9797e00640 1 -- 172.21.15.112:0/4265699186 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97980b3e00 msgr2=0x7f9798152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:22.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.918+0000 7f9797e00640 1 --2- 172.21.15.112:0/4265699186 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97980b3e00 0x7f9798152040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:22.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.918+0000 7f9797e00640 1 -- 172.21.15.112:0/4265699186 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97980b1d70 msgr2=0x7f97980ba3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:22.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.918+0000 7f9797e00640 1 --2- 172.21.15.112:0/4265699186 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97980b1d70 0x7f97980ba3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:22.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.918+0000 7f9797e00640 1 -- 172.21.15.112:0/4265699186 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f979815b830 con 0x7f97980d1710 2024-09-12T02:51:22.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.919+0000 7f9797e00640 1 --2- 172.21.15.112:0/4265699186 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97980d1710 0x7f97980d4d00 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f979000c760 tx=0x7f979000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:22.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.919+0000 7f978f400640 1 -- 172.21.15.112:0/4265699186 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9790003da0 con 0x7f97980d1710 2024-09-12T02:51:22.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.919+0000 7f978f400640 1 -- 172.21.15.112:0/4265699186 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9790005070 con 0x7f97980d1710 2024-09-12T02:51:22.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.919+0000 7f979cc00640 1 -- 172.21.15.112:0/4265699186 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97980baac0 con 0x7f97980d1710 2024-09-12T02:51:22.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.919+0000 7f978f400640 1 -- 172.21.15.112:0/4265699186 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9790005460 con 0x7f97980d1710 2024-09-12T02:51:22.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.919+0000 7f979cc00640 1 -- 172.21.15.112:0/4265699186 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97980ce180 con 0x7f97980d1710 2024-09-12T02:51:22.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.920+0000 7f979cc00640 1 -- 172.21.15.112:0/4265699186 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97980d28d0 con 0x7f97980d1710 2024-09-12T02:51:22.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.921+0000 7f978f400640 1 -- 172.21.15.112:0/4265699186 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9790005600 con 0x7f97980d1710 2024-09-12T02:51:22.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.922+0000 7f978f400640 1 --2- 172.21.15.112:0/4265699186 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f977806be30 0x7f977806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:22.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.922+0000 7f978f400640 1 -- 172.21.15.112:0/4265699186 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7f979008ad00 con 0x7f97980d1710 2024-09-12T02:51:22.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.922+0000 7f9797400640 1 --2- 172.21.15.112:0/4265699186 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f977806be30 0x7f977806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:22.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.922+0000 7f9797400640 1 --2- 172.21.15.112:0/4265699186 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f977806be30 0x7f977806e2f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9788034000 tx=0x7f978802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:22.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:22.926+0000 7f978f400640 1 -- 172.21.15.112:0/4265699186 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9790058fc0 con 0x7f97980d1710 2024-09-12T02:51:23.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.102+0000 7f979cc00640 1 -- 172.21.15.112:0/4265699186 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f979815e8c0 con 0x7f97980d1710 2024-09-12T02:51:23.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.103+0000 7f978f400640 1 -- 172.21.15.112:0/4265699186 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) ==== 74+0+16801 (secure 0 0 0) 0x7f979005d2c0 con 0x7f97980d1710 2024-09-12T02:51:23.105 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:51:23.105 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":166,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:51:22.139405+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:51:19.902565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-12T02:51:21.129561+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:51:23.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.106+0000 7f979cc00640 1 -- 172.21.15.112:0/4265699186 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f977806be30 msgr2=0x7f977806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:23.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.106+0000 7f979cc00640 1 --2- 172.21.15.112:0/4265699186 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f977806be30 0x7f977806e2f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9788034000 tx=0x7f978802e000 comp rx=0 tx=0).stop 2024-09-12T02:51:23.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.106+0000 7f979cc00640 1 -- 172.21.15.112:0/4265699186 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97980d1710 msgr2=0x7f97980d4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:23.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.106+0000 7f979cc00640 1 --2- 172.21.15.112:0/4265699186 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97980d1710 0x7f97980d4d00 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f979000c760 tx=0x7f979000cc20 comp rx=0 tx=0).stop 2024-09-12T02:51:23.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.106+0000 7f979cc00640 1 -- 172.21.15.112:0/4265699186 shutdown_connections 2024-09-12T02:51:23.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.106+0000 7f979cc00640 1 --2- 172.21.15.112:0/4265699186 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97980d1710 0x7f97980d4d00 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.106+0000 7f979cc00640 1 --2- 172.21.15.112:0/4265699186 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97980b3e00 0x7f9798152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.106+0000 7f979cc00640 1 --2- 172.21.15.112:0/4265699186 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f977806be30 0x7f977806e2f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.106+0000 7f979cc00640 1 --2- 172.21.15.112:0/4265699186 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97980b1d70 0x7f97980ba3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.106+0000 7f979cc00640 1 -- 172.21.15.112:0/4265699186 >> 172.21.15.112:0/4265699186 conn(0x7f979809e030 msgr2=0x7f979806cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:23.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.106+0000 7f979cc00640 1 -- 172.21.15.112:0/4265699186 shutdown_connections 2024-09-12T02:51:23.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.106+0000 7f979cc00640 1 -- 172.21.15.112:0/4265699186 wait complete. 2024-09-12T02:51:23.122 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:51:23.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.272+0000 7f2659e00640 1 Processor -- start 2024-09-12T02:51:23.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.272+0000 7f2659e00640 1 -- start start 2024-09-12T02:51:23.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.274+0000 7f2659e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f265415b9d0 0x7f26540b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:23.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.274+0000 7f2659e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f26540b45d0 0x7f26540728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:23.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.274+0000 7f2659e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26540b54a0 con 0x7f265406eef0 2024-09-12T02:51:23.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.274+0000 7f2659e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f26540b4a60 con 0x7f265415b9d0 2024-09-12T02:51:23.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.274+0000 7f2659e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f26540b3af0 con 0x7f26540b45d0 2024-09-12T02:51:23.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.274+0000 7f2652a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f265415b9d0 0x7f26540b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:23.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.274+0000 7f2652a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f265415b9d0 0x7f26540b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36692/0 (socket says 172.21.15.112:36692) 2024-09-12T02:51:23.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.274+0000 7f2652a00640 1 -- 172.21.15.112:0/537966841 learned_addr learned my addr 172.21.15.112:0/537966841 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:23.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.274+0000 7f264a000640 1 --2- 172.21.15.112:0/537966841 >> v2:172.21.15.137:3300/0 conn(0x7f26540b45d0 0x7f26540728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:23.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.274+0000 7f2652a00640 1 -- 172.21.15.112:0/537966841 >> v2:172.21.15.137:3300/0 conn(0x7f26540b45d0 msgr2=0x7f26540728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:23.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.274+0000 7f2652a00640 1 --2- 172.21.15.112:0/537966841 >> v2:172.21.15.137:3300/0 conn(0x7f26540b45d0 0x7f26540728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.274+0000 7f2652a00640 1 -- 172.21.15.112:0/537966841 >> v1:172.21.15.137:6789/0 conn(0x7f265406eef0 legacy=0x7f265406f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:23.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.275+0000 7f2652a00640 1 -- 172.21.15.112:0/537966841 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26540b3dd0 con 0x7f265415b9d0 2024-09-12T02:51:23.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.276+0000 7f2652a00640 1 --2- 172.21.15.112:0/537966841 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f265415b9d0 0x7f26540b4ec0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f2654068670 tx=0x7f264402c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d44a2a135111ddd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:23.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.276+0000 7f2652000640 1 -- 172.21.15.112:0/537966841 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2644033640 con 0x7f265415b9d0 2024-09-12T02:51:23.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.276+0000 7f2652000640 1 -- 172.21.15.112:0/537966841 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2644038070 con 0x7f265415b9d0 2024-09-12T02:51:23.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.276+0000 7f2652000640 1 -- 172.21.15.112:0/537966841 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2644033a00 con 0x7f265415b9d0 2024-09-12T02:51:23.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.276+0000 7f2659e00640 1 -- 172.21.15.112:0/537966841 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f265415b9d0 msgr2=0x7f26540b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:23.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.276+0000 7f2659e00640 1 --2- 172.21.15.112:0/537966841 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f265415b9d0 0x7f26540b4ec0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f2654068670 tx=0x7f264402c8b0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.276+0000 7f2659e00640 1 -- 172.21.15.112:0/537966841 shutdown_connections 2024-09-12T02:51:23.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.276+0000 7f2659e00640 1 --2- 172.21.15.112:0/537966841 >> v2:172.21.15.137:3300/0 conn(0x7f26540b45d0 0x7f26540728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.276+0000 7f2659e00640 1 --2- 172.21.15.112:0/537966841 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f265415b9d0 0x7f26540b4ec0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.276+0000 7f2659e00640 1 -- 172.21.15.112:0/537966841 >> 172.21.15.112:0/537966841 conn(0x7f265406bbd0 msgr2=0x7f265406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:23.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.277+0000 7f2659e00640 1 -- 172.21.15.112:0/537966841 shutdown_connections 2024-09-12T02:51:23.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.277+0000 7f2659e00640 1 -- 172.21.15.112:0/537966841 wait complete. 2024-09-12T02:51:23.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.278+0000 7f2659e00640 1 Processor -- start 2024-09-12T02:51:23.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.278+0000 7f2659e00640 1 -- start start 2024-09-12T02:51:23.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.279+0000 7f2659e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f265406eef0 0x7f2654071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:23.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.279+0000 7f2659e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26540b45d0 0x7f2654072380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:23.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.279+0000 7f2659e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f265415b9d0 0x7f2654147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:23.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.279+0000 7f2659e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f265415bf30 con 0x7f26540b45d0 2024-09-12T02:51:23.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.279+0000 7f2659e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f265415bdb0 con 0x7f265415b9d0 2024-09-12T02:51:23.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.279+0000 7f2659e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f26540cdcd0 con 0x7f265406eef0 2024-09-12T02:51:23.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.279+0000 7f264a000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26540b45d0 0x7f2654072380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:23.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.280+0000 7f264a000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26540b45d0 0x7f2654072380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36704/0 (socket says 172.21.15.112:36704) 2024-09-12T02:51:23.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.280+0000 7f264a000640 1 -- 172.21.15.112:0/3009011189 learned_addr learned my addr 172.21.15.112:0/3009011189 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:23.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.280+0000 7f2652a00640 1 --2- 172.21.15.112:0/3009011189 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f265406eef0 0x7f2654071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:23.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.280+0000 7f2653400640 1 --2- 172.21.15.112:0/3009011189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f265415b9d0 0x7f2654147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:23.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.280+0000 7f264a000640 1 -- 172.21.15.112:0/3009011189 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f265406eef0 msgr2=0x7f2654071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:23.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.280+0000 7f264a000640 1 --2- 172.21.15.112:0/3009011189 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f265406eef0 0x7f2654071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.280+0000 7f264a000640 1 -- 172.21.15.112:0/3009011189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f265415b9d0 msgr2=0x7f2654147fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:23.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.280+0000 7f264a000640 1 --2- 172.21.15.112:0/3009011189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f265415b9d0 0x7f2654147fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.280+0000 7f264a000640 1 -- 172.21.15.112:0/3009011189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2654151df0 con 0x7f26540b45d0 2024-09-12T02:51:23.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.280+0000 7f264a000640 1 --2- 172.21.15.112:0/3009011189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26540b45d0 0x7f2654072380 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f263c00d800 tx=0x7f263c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:23.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.281+0000 7f264be00640 1 -- 172.21.15.112:0/3009011189 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c00b6c0 con 0x7f26540b45d0 2024-09-12T02:51:23.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.281+0000 7f264be00640 1 -- 172.21.15.112:0/3009011189 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f263c019070 con 0x7f26540b45d0 2024-09-12T02:51:23.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.281+0000 7f264be00640 1 -- 172.21.15.112:0/3009011189 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c00baa0 con 0x7f26540b45d0 2024-09-12T02:51:23.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.281+0000 7f2659e00640 1 -- 172.21.15.112:0/3009011189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2654152340 con 0x7f26540b45d0 2024-09-12T02:51:23.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.281+0000 7f2659e00640 1 -- 172.21.15.112:0/3009011189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2654152900 con 0x7f26540b45d0 2024-09-12T02:51:23.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.282+0000 7f2659e00640 1 -- 172.21.15.112:0/3009011189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2654068a30 con 0x7f26540b45d0 2024-09-12T02:51:23.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.283+0000 7f264be00640 1 -- 172.21.15.112:0/3009011189 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f263c00bc40 con 0x7f26540b45d0 2024-09-12T02:51:23.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.284+0000 7f264be00640 1 --2- 172.21.15.112:0/3009011189 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f263006be30 0x7f263006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:23.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.284+0000 7f264be00640 1 -- 172.21.15.112:0/3009011189 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7f263c08b190 con 0x7f26540b45d0 2024-09-12T02:51:23.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.284+0000 7f2652a00640 1 --2- 172.21.15.112:0/3009011189 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f263006be30 0x7f263006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:23.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.285+0000 7f2652a00640 1 --2- 172.21.15.112:0/3009011189 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f263006be30 0x7f263006e2f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2644037000 tx=0x7f2644032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:23.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.288+0000 7f264be00640 1 -- 172.21.15.112:0/3009011189 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f263c0594e0 con 0x7f26540b45d0 2024-09-12T02:51:23.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.461+0000 7f2659e00640 1 -- 172.21.15.112:0/3009011189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f265406dbc0 con 0x7f26540b45d0 2024-09-12T02:51:23.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.462+0000 7f264be00640 1 -- 172.21.15.112:0/3009011189 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) ==== 74+0+16801 (secure 0 0 0) 0x7f263c05d7e0 con 0x7f26540b45d0 2024-09-12T02:51:23.463 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:51:23.463 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":166,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:51:22.139405+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:51:19.902565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-12T02:51:21.129561+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:51:23.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.464+0000 7f2659e00640 1 -- 172.21.15.112:0/3009011189 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f263006be30 msgr2=0x7f263006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:23.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.464+0000 7f2659e00640 1 --2- 172.21.15.112:0/3009011189 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f263006be30 0x7f263006e2f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2644037000 tx=0x7f2644032000 comp rx=0 tx=0).stop 2024-09-12T02:51:23.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.464+0000 7f2659e00640 1 -- 172.21.15.112:0/3009011189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26540b45d0 msgr2=0x7f2654072380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:23.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.464+0000 7f2659e00640 1 --2- 172.21.15.112:0/3009011189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26540b45d0 0x7f2654072380 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f263c00d800 tx=0x7f263c00dcc0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.464+0000 7f2659e00640 1 -- 172.21.15.112:0/3009011189 shutdown_connections 2024-09-12T02:51:23.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.464+0000 7f2659e00640 1 --2- 172.21.15.112:0/3009011189 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f263006be30 0x7f263006e2f0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.464+0000 7f2659e00640 1 --2- 172.21.15.112:0/3009011189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f265415b9d0 0x7f2654147fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.464+0000 7f2659e00640 1 --2- 172.21.15.112:0/3009011189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26540b45d0 0x7f2654072380 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.464+0000 7f2659e00640 1 --2- 172.21.15.112:0/3009011189 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f265406eef0 0x7f2654071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.464+0000 7f2659e00640 1 -- 172.21.15.112:0/3009011189 >> 172.21.15.112:0/3009011189 conn(0x7f265406bbd0 msgr2=0x7f26540b0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:23.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.464+0000 7f2659e00640 1 -- 172.21.15.112:0/3009011189 shutdown_connections 2024-09-12T02:51:23.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.465+0000 7f2659e00640 1 -- 172.21.15.112:0/3009011189 wait complete. 2024-09-12T02:51:23.481 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T02:51:23.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.637+0000 7fd165400640 1 Processor -- start 2024-09-12T02:51:23.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.637+0000 7fd165400640 1 -- start start 2024-09-12T02:51:23.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.638+0000 7fd165400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd16006f600 0x7fd1600b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:23.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.638+0000 7fd165400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd1600b45d0 0x7fd1600728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:23.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.638+0000 7fd165400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1600b4a20 con 0x7fd16015b9d0 2024-09-12T02:51:23.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.638+0000 7fd165400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd1600b54a0 con 0x7fd1600b45d0 2024-09-12T02:51:23.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.638+0000 7fd165400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd1600b3af0 con 0x7fd16006f600 2024-09-12T02:51:23.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.638+0000 7fd15f200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd1600b45d0 0x7fd1600728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:23.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.638+0000 7fd15f200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd1600b45d0 0x7fd1600728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36718/0 (socket says 172.21.15.112:36718) 2024-09-12T02:51:23.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.638+0000 7fd15f200640 1 -- 172.21.15.112:0/2600196410 learned_addr learned my addr 172.21.15.112:0/2600196410 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:23.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.639+0000 7fd155e00640 1 --2- 172.21.15.112:0/2600196410 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd16006f600 0x7fd1600b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:23.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.639+0000 7fd15f200640 1 -- 172.21.15.112:0/2600196410 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd16006f600 msgr2=0x7fd1600b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:23.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.639+0000 7fd15f200640 1 --2- 172.21.15.112:0/2600196410 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd16006f600 0x7fd1600b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.639+0000 7fd15f200640 1 -- 172.21.15.112:0/2600196410 >> v1:172.21.15.137:6789/0 conn(0x7fd16015b9d0 legacy=0x7fd16006eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:23.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.639+0000 7fd15f200640 1 -- 172.21.15.112:0/2600196410 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1600b3dd0 con 0x7fd1600b45d0 2024-09-12T02:51:23.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.640+0000 7fd15f200640 1 --2- 172.21.15.112:0/2600196410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1600b45d0 0x7fd1600728c0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fd158009e50 tx=0x7fd15802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9c3c9b7830ecb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:23.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.640+0000 7fd15de00640 1 -- 172.21.15.112:0/2600196410 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd158036070 con 0x7fd1600b45d0 2024-09-12T02:51:23.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.640+0000 7fd15de00640 1 -- 172.21.15.112:0/2600196410 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd158031600 con 0x7fd1600b45d0 2024-09-12T02:51:23.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.640+0000 7fd15de00640 1 -- 172.21.15.112:0/2600196410 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1580319d0 con 0x7fd1600b45d0 2024-09-12T02:51:23.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.641+0000 7fd165400640 1 -- 172.21.15.112:0/2600196410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1600b45d0 msgr2=0x7fd1600728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:23.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.641+0000 7fd165400640 1 --2- 172.21.15.112:0/2600196410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1600b45d0 0x7fd1600728c0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fd158009e50 tx=0x7fd15802a710 comp rx=0 tx=0).stop 2024-09-12T02:51:23.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.641+0000 7fd165400640 1 -- 172.21.15.112:0/2600196410 shutdown_connections 2024-09-12T02:51:23.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.641+0000 7fd165400640 1 --2- 172.21.15.112:0/2600196410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1600b45d0 0x7fd1600728c0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.641+0000 7fd165400640 1 --2- 172.21.15.112:0/2600196410 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd16006f600 0x7fd1600b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.641+0000 7fd165400640 1 -- 172.21.15.112:0/2600196410 >> 172.21.15.112:0/2600196410 conn(0x7fd16006bbd0 msgr2=0x7fd16006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:23.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.641+0000 7fd165400640 1 -- 172.21.15.112:0/2600196410 shutdown_connections 2024-09-12T02:51:23.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.641+0000 7fd165400640 1 -- 172.21.15.112:0/2600196410 wait complete. 2024-09-12T02:51:23.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.643+0000 7fd165400640 1 Processor -- start 2024-09-12T02:51:23.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.643+0000 7fd165400640 1 -- start start 2024-09-12T02:51:23.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.643+0000 7fd165400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd16006f600 0x7fd160151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:23.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.643+0000 7fd165400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1600b45d0 0x7fd16015db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:23.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.643+0000 7fd165400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd16015b9d0 0x7fd1600ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:23.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.644+0000 7fd165400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd16015bf30 con 0x7fd16006f600 2024-09-12T02:51:23.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.644+0000 7fd165400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd16015bdb0 con 0x7fd1600b45d0 2024-09-12T02:51:23.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.644+0000 7fd165400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd1600cdcd0 con 0x7fd16015b9d0 2024-09-12T02:51:23.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.644+0000 7fd15e800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd16006f600 0x7fd160151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:23.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.644+0000 7fd15e800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd16006f600 0x7fd160151120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36724/0 (socket says 172.21.15.112:36724) 2024-09-12T02:51:23.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.644+0000 7fd15e800640 1 -- 172.21.15.112:0/1796928794 learned_addr learned my addr 172.21.15.112:0/1796928794 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:23.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.644+0000 7fd155e00640 1 --2- 172.21.15.112:0/1796928794 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1600b45d0 0x7fd16015db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:23.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.644+0000 7fd15f200640 1 --2- 172.21.15.112:0/1796928794 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd16015b9d0 0x7fd1600ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:23.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.644+0000 7fd15e800640 1 -- 172.21.15.112:0/1796928794 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd16015b9d0 msgr2=0x7fd1600ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:23.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.644+0000 7fd15e800640 1 --2- 172.21.15.112:0/1796928794 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd16015b9d0 0x7fd1600ccbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.644+0000 7fd15e800640 1 -- 172.21.15.112:0/1796928794 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1600b45d0 msgr2=0x7fd16015db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:23.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.644+0000 7fd15e800640 1 --2- 172.21.15.112:0/1796928794 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1600b45d0 0x7fd16015db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:23.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.644+0000 7fd15e800640 1 -- 172.21.15.112:0/1796928794 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd160151660 con 0x7fd16006f600 2024-09-12T02:51:23.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.644+0000 7fd155e00640 1 --2- 172.21.15.112:0/1796928794 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1600b45d0 0x7fd16015db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:51:23.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.644+0000 7fd15f200640 1 --2- 172.21.15.112:0/1796928794 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd16015b9d0 0x7fd1600ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:51:23.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.644+0000 7fd15e800640 1 --2- 172.21.15.112:0/1796928794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd16006f600 0x7fd160151120 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fd15000c3c0 tx=0x7fd15000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:23.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.645+0000 7fd157400640 1 -- 172.21.15.112:0/1796928794 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1500052d0 con 0x7fd16006f600 2024-09-12T02:51:23.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.645+0000 7fd157400640 1 -- 172.21.15.112:0/1796928794 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd150005490 con 0x7fd16006f600 2024-09-12T02:51:23.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.645+0000 7fd157400640 1 -- 172.21.15.112:0/1796928794 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd150007260 con 0x7fd16006f600 2024-09-12T02:51:23.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.645+0000 7fd165400640 1 -- 172.21.15.112:0/1796928794 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd16015e600 con 0x7fd16006f600 2024-09-12T02:51:23.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.645+0000 7fd165400640 1 -- 172.21.15.112:0/1796928794 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd16015ebc0 con 0x7fd16006f600 2024-09-12T02:51:23.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.646+0000 7fd165400640 1 -- 172.21.15.112:0/1796928794 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd160068a30 con 0x7fd16006f600 2024-09-12T02:51:23.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.647+0000 7fd157400640 1 -- 172.21.15.112:0/1796928794 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd150007400 con 0x7fd16006f600 2024-09-12T02:51:23.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.647+0000 7fd157400640 1 --2- 172.21.15.112:0/1796928794 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd13c06be30 0x7fd13c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:23.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.648+0000 7fd157400640 1 -- 172.21.15.112:0/1796928794 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7fd15008a340 con 0x7fd16006f600 2024-09-12T02:51:23.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.648+0000 7fd155e00640 1 --2- 172.21.15.112:0/1796928794 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd13c06be30 0x7fd13c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:23.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.648+0000 7fd155e00640 1 --2- 172.21.15.112:0/1796928794 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd13c06be30 0x7fd13c06e2f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd1600cd7a0 tx=0x7fd148008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:23.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.652+0000 7fd157400640 1 -- 172.21.15.112:0/1796928794 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd150058cf0 con 0x7fd16006f600 2024-09-12T02:51:23.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:23.864+0000 7fd165400640 1 -- 172.21.15.112:0/1796928794 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd1600b0f80 con 0x7fd16006f600 2024-09-12T02:51:24.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.752+0000 7fd157400640 1 -- 172.21.15.112:0/1796928794 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v85) ==== 118+0+0 (secure 0 0 0) 0x7fd1500585f0 con 0x7fd16006f600 2024-09-12T02:51:24.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.755+0000 7fd165400640 1 -- 172.21.15.112:0/1796928794 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd13c06be30 msgr2=0x7fd13c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:24.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.755+0000 7fd165400640 1 --2- 172.21.15.112:0/1796928794 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd13c06be30 0x7fd13c06e2f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd1600cd7a0 tx=0x7fd148008040 comp rx=0 tx=0).stop 2024-09-12T02:51:24.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.755+0000 7fd165400640 1 -- 172.21.15.112:0/1796928794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd16006f600 msgr2=0x7fd160151120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:24.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.755+0000 7fd165400640 1 --2- 172.21.15.112:0/1796928794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd16006f600 0x7fd160151120 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fd15000c3c0 tx=0x7fd15000c880 comp rx=0 tx=0).stop 2024-09-12T02:51:24.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.755+0000 7fd165400640 1 -- 172.21.15.112:0/1796928794 shutdown_connections 2024-09-12T02:51:24.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.755+0000 7fd165400640 1 --2- 172.21.15.112:0/1796928794 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd16015b9d0 0x7fd1600ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:24.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.755+0000 7fd165400640 1 --2- 172.21.15.112:0/1796928794 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd13c06be30 0x7fd13c06e2f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:24.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.755+0000 7fd165400640 1 --2- 172.21.15.112:0/1796928794 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1600b45d0 0x7fd16015db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:24.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.755+0000 7fd165400640 1 --2- 172.21.15.112:0/1796928794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd16006f600 0x7fd160151120 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:24.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.755+0000 7fd165400640 1 -- 172.21.15.112:0/1796928794 >> 172.21.15.112:0/1796928794 conn(0x7fd16006bbd0 msgr2=0x7fd1600720b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:24.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.755+0000 7fd165400640 1 -- 172.21.15.112:0/1796928794 shutdown_connections 2024-09-12T02:51:24.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.755+0000 7fd165400640 1 -- 172.21.15.112:0/1796928794 wait complete. 2024-09-12T02:51:24.773 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T02:51:24.773 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T02:51:24.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.930+0000 7fdb1b200640 1 Processor -- start 2024-09-12T02:51:24.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.930+0000 7fdb1b200640 1 -- start start 2024-09-12T02:51:24.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.931+0000 7fdb1b200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdb1415eeb0 0x7fdb140ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:24.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.931+0000 7fdb1b200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb14070bc0 0x7fdb140cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:24.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.931+0000 7fdb1b200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdb1415f290 0x7fdb140cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:24.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.931+0000 7fdb1b200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fdb14070730 con 0x7fdb1415eeb0 2024-09-12T02:51:24.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.931+0000 7fdb1b200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fdb1406f880 con 0x7fdb1415f290 2024-09-12T02:51:24.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.931+0000 7fdb1b200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdb1406fb20 con 0x7fdb14070bc0 2024-09-12T02:51:24.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.931+0000 7fdb13e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdb1415eeb0 0x7fdb140ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:24.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.931+0000 7fdb13e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdb1415eeb0 0x7fdb140ce9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36730/0 (socket says 172.21.15.112:36730) 2024-09-12T02:51:24.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.931+0000 7fdb13e00640 1 -- 172.21.15.112:0/3605122756 learned_addr learned my addr 172.21.15.112:0/3605122756 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:24.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.932+0000 7fdb0be00640 1 --2- 172.21.15.112:0/3605122756 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb14070bc0 0x7fdb140cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:24.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.932+0000 7fdb19200640 1 --2- 172.21.15.112:0/3605122756 >> v2:172.21.15.137:3300/0 conn(0x7fdb1415f290 0x7fdb140cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:24.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.932+0000 7fdb13e00640 1 -- 172.21.15.112:0/3605122756 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb14070bc0 msgr2=0x7fdb140cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:24.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.932+0000 7fdb13e00640 1 --2- 172.21.15.112:0/3605122756 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb14070bc0 0x7fdb140cd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:24.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.932+0000 7fdb13e00640 1 -- 172.21.15.112:0/3605122756 >> v2:172.21.15.137:3300/0 conn(0x7fdb1415f290 msgr2=0x7fdb140cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:24.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.932+0000 7fdb13e00640 1 --2- 172.21.15.112:0/3605122756 >> v2:172.21.15.137:3300/0 conn(0x7fdb1415f290 0x7fdb140cf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:24.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.932+0000 7fdb13e00640 1 -- 172.21.15.112:0/3605122756 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb1406fe00 con 0x7fdb1415eeb0 2024-09-12T02:51:24.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.933+0000 7fdb13e00640 1 --2- 172.21.15.112:0/3605122756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb1415eeb0 0x7fdb140ce9b0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fdb14073770 tx=0x7fdb0402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f35f82ec3d7450 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:24.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.933+0000 7fdb13400640 1 -- 172.21.15.112:0/3605122756 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb04037070 con 0x7fdb1415eeb0 2024-09-12T02:51:24.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.933+0000 7fdb13400640 1 -- 172.21.15.112:0/3605122756 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb04032440 con 0x7fdb1415eeb0 2024-09-12T02:51:24.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.933+0000 7fdb13400640 1 -- 172.21.15.112:0/3605122756 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb04032810 con 0x7fdb1415eeb0 2024-09-12T02:51:24.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.934+0000 7fdb1b200640 1 -- 172.21.15.112:0/3605122756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb1415eeb0 msgr2=0x7fdb140ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:24.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.934+0000 7fdb1b200640 1 --2- 172.21.15.112:0/3605122756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb1415eeb0 0x7fdb140ce9b0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fdb14073770 tx=0x7fdb0402a1e0 comp rx=0 tx=0).stop 2024-09-12T02:51:24.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.934+0000 7fdb1b200640 1 -- 172.21.15.112:0/3605122756 shutdown_connections 2024-09-12T02:51:24.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.934+0000 7fdb1b200640 1 --2- 172.21.15.112:0/3605122756 >> v2:172.21.15.137:3300/0 conn(0x7fdb1415f290 0x7fdb140cf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:24.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.934+0000 7fdb1b200640 1 --2- 172.21.15.112:0/3605122756 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb14070bc0 0x7fdb140cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:24.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.934+0000 7fdb1b200640 1 --2- 172.21.15.112:0/3605122756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb1415eeb0 0x7fdb140ce9b0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:24.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.934+0000 7fdb1b200640 1 -- 172.21.15.112:0/3605122756 >> 172.21.15.112:0/3605122756 conn(0x7fdb140b4720 msgr2=0x7fdb140b4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:24.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.934+0000 7fdb1b200640 1 -- 172.21.15.112:0/3605122756 shutdown_connections 2024-09-12T02:51:24.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.934+0000 7fdb1b200640 1 -- 172.21.15.112:0/3605122756 wait complete. 2024-09-12T02:51:24.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.935+0000 7fdb1b200640 1 Processor -- start 2024-09-12T02:51:24.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.935+0000 7fdb1b200640 1 -- start start 2024-09-12T02:51:24.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.936+0000 7fdb1b200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb14070bc0 0x7fdb140b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:24.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.936+0000 7fdb1b200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb1415eeb0 0x7fdb14154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:24.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.936+0000 7fdb1b200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb1415f290 0x7fdb140cc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:24.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.936+0000 7fdb1b200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdb140cfb60 con 0x7fdb1415f290 2024-09-12T02:51:24.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.936+0000 7fdb1b200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdb140703c0 con 0x7fdb14070bc0 2024-09-12T02:51:24.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.936+0000 7fdb1b200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdb140cfce0 con 0x7fdb1415eeb0 2024-09-12T02:51:24.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.937+0000 7fdb19200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb1415f290 0x7fdb140cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:24.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.937+0000 7fdb19200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb1415f290 0x7fdb140cc030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36732/0 (socket says 172.21.15.112:36732) 2024-09-12T02:51:24.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.937+0000 7fdb19200640 1 -- 172.21.15.112:0/2766748388 learned_addr learned my addr 172.21.15.112:0/2766748388 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:24.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.937+0000 7fdb13e00640 1 --2- 172.21.15.112:0/2766748388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb14070bc0 0x7fdb140b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:24.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.937+0000 7fdb0be00640 1 --2- 172.21.15.112:0/2766748388 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb1415eeb0 0x7fdb14154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:24.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.937+0000 7fdb19200640 1 -- 172.21.15.112:0/2766748388 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb1415eeb0 msgr2=0x7fdb14154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:24.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.937+0000 7fdb19200640 1 --2- 172.21.15.112:0/2766748388 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb1415eeb0 0x7fdb14154140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:24.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.937+0000 7fdb19200640 1 -- 172.21.15.112:0/2766748388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb14070bc0 msgr2=0x7fdb140b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:24.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.937+0000 7fdb19200640 1 --2- 172.21.15.112:0/2766748388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb14070bc0 0x7fdb140b39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:24.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.937+0000 7fdb19200640 1 -- 172.21.15.112:0/2766748388 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb140cb870 con 0x7fdb1415f290 2024-09-12T02:51:24.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.937+0000 7fdb19200640 1 --2- 172.21.15.112:0/2766748388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb1415f290 0x7fdb140cc030 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c007d40 tx=0x7fdb0c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:24.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.938+0000 7fdb10c00640 1 -- 172.21.15.112:0/2766748388 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c014420 con 0x7fdb1415f290 2024-09-12T02:51:24.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.938+0000 7fdb10c00640 1 -- 172.21.15.112:0/2766748388 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb0c019070 con 0x7fdb1415f290 2024-09-12T02:51:24.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.938+0000 7fdb10c00640 1 -- 172.21.15.112:0/2766748388 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c014820 con 0x7fdb1415f290 2024-09-12T02:51:24.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.938+0000 7fdb1b200640 1 -- 172.21.15.112:0/2766748388 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb140d0cb0 con 0x7fdb1415f290 2024-09-12T02:51:24.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.938+0000 7fdb1b200640 1 -- 172.21.15.112:0/2766748388 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb140cbb10 con 0x7fdb1415f290 2024-09-12T02:51:24.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.939+0000 7fdb1b200640 1 -- 172.21.15.112:0/2766748388 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb140763a0 con 0x7fdb1415f290 2024-09-12T02:51:24.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.940+0000 7fdb10c00640 1 -- 172.21.15.112:0/2766748388 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb0c0149c0 con 0x7fdb1415f290 2024-09-12T02:51:24.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.940+0000 7fdb10c00640 1 --2- 172.21.15.112:0/2766748388 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdaf006be30 0x7fdaf006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:24.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.941+0000 7fdb10c00640 1 -- 172.21.15.112:0/2766748388 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7fdb0c08b480 con 0x7fdb1415f290 2024-09-12T02:51:24.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.941+0000 7fdb13e00640 1 --2- 172.21.15.112:0/2766748388 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdaf006be30 0x7fdaf006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:24.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.941+0000 7fdb13e00640 1 --2- 172.21.15.112:0/2766748388 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdaf006be30 0x7fdaf006e2f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fdb04034000 tx=0x7fdb0402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:24.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:24.944+0000 7fdb10c00640 1 -- 172.21.15.112:0/2766748388 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdb0c0597d0 con 0x7fdb1415f290 2024-09-12T02:51:25.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.150+0000 7fdb1b200640 1 -- 172.21.15.112:0/2766748388 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fdb140cf620 con 0x7fdb1415f290 2024-09-12T02:51:25.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.757+0000 7fdb10c00640 1 -- 172.21.15.112:0/2766748388 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v86) ==== 122+0+0 (secure 0 0 0) 0x7fdb0c05dad0 con 0x7fdb1415f290 2024-09-12T02:51:25.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.760+0000 7fdb1b200640 1 -- 172.21.15.112:0/2766748388 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdaf006be30 msgr2=0x7fdaf006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:25.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.760+0000 7fdb1b200640 1 --2- 172.21.15.112:0/2766748388 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdaf006be30 0x7fdaf006e2f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fdb04034000 tx=0x7fdb0402e000 comp rx=0 tx=0).stop 2024-09-12T02:51:25.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.760+0000 7fdb1b200640 1 -- 172.21.15.112:0/2766748388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb1415f290 msgr2=0x7fdb140cc030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:25.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.760+0000 7fdb1b200640 1 --2- 172.21.15.112:0/2766748388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb1415f290 0x7fdb140cc030 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c007d40 tx=0x7fdb0c00e4b0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.760+0000 7fdb1b200640 1 -- 172.21.15.112:0/2766748388 shutdown_connections 2024-09-12T02:51:25.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.760+0000 7fdb1b200640 1 --2- 172.21.15.112:0/2766748388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb1415f290 0x7fdb140cc030 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.760+0000 7fdb1b200640 1 --2- 172.21.15.112:0/2766748388 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb1415eeb0 0x7fdb14154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.760+0000 7fdb1b200640 1 --2- 172.21.15.112:0/2766748388 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdaf006be30 0x7fdaf006e2f0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.760+0000 7fdb1b200640 1 --2- 172.21.15.112:0/2766748388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb14070bc0 0x7fdb140b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.760+0000 7fdb1b200640 1 -- 172.21.15.112:0/2766748388 >> 172.21.15.112:0/2766748388 conn(0x7fdb140b4720 msgr2=0x7fdb140afd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:25.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.760+0000 7fdb1b200640 1 -- 172.21.15.112:0/2766748388 shutdown_connections 2024-09-12T02:51:25.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.760+0000 7fdb1b200640 1 -- 172.21.15.112:0/2766748388 wait complete. 2024-09-12T02:51:25.778 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T02:51:25.778 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:51:25.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.930+0000 7f603da00640 1 Processor -- start 2024-09-12T02:51:25.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.930+0000 7f603da00640 1 -- start start 2024-09-12T02:51:25.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.932+0000 7f603da00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f60380afe30 0x7f60380cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:25.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.932+0000 7f603da00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60380ceeb0 con 0x7f6038071530 2024-09-12T02:51:25.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.932+0000 7f603da00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f603806e300 con 0x7f603815cc50 2024-09-12T02:51:25.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.932+0000 7f603da00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f603815d030 con 0x7f60380afe30 2024-09-12T02:51:25.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.932+0000 7f6036000640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f6038071530 0x7f60380af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52180/0 (socket says 172.21.15.112:52180) 2024-09-12T02:51:25.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.932+0000 7f6036000640 1 -- 172.21.15.112:0/744178067 learned_addr learned my addr 172.21.15.112:0/744178067 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:51:25.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.932+0000 7f6035600640 1 -- 172.21.15.112:0/744178067 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1932600328 0 0) 0x7f60380ceeb0 con 0x7f6038071530 2024-09-12T02:51:25.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.932+0000 7f6035600640 1 -- 172.21.15.112:0/744178067 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f601c003520 con 0x7f6038071530 2024-09-12T02:51:25.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.932+0000 7f6037400640 1 --2- 172.21.15.112:0/744178067 >> v2:172.21.15.137:3300/0 conn(0x7f60380afe30 0x7f60380cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:25.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.933+0000 7f6035600640 1 -- 172.21.15.112:0/744178067 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1950988001 0 0) 0x7f601c003520 con 0x7f6038071530 2024-09-12T02:51:25.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.933+0000 7f6035600640 1 -- 172.21.15.112:0/744178067 >> v2:172.21.15.137:3300/0 conn(0x7f60380afe30 msgr2=0x7f60380cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:25.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.933+0000 7f6035600640 1 --2- 172.21.15.112:0/744178067 >> v2:172.21.15.137:3300/0 conn(0x7f60380afe30 0x7f60380cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.933+0000 7f6035600640 1 -- 172.21.15.112:0/744178067 >> v1:172.21.15.137:6789/0 conn(0x7f603815cc50 legacy=0x7f60380732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:25.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.933+0000 7f6035600640 1 -- 172.21.15.112:0/744178067 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f603806e5e0 con 0x7f6038071530 2024-09-12T02:51:25.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.933+0000 7f6035600640 1 -- 172.21.15.112:0/744178067 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f60240017f0 con 0x7f6038071530 2024-09-12T02:51:25.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.933+0000 7f6035600640 1 -- 172.21.15.112:0/744178067 >> v1:172.21.15.112:6789/0 conn(0x7f6038071530 legacy=0x7f60380af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:25.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.933+0000 7f6035600640 1 --2- 172.21.15.112:0/744178067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f601c003a00 0x7f601c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:25.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.933+0000 7f6035600640 1 --2- 172.21.15.112:0/744178067 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f601c004800 0x7f601c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:25.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.933+0000 7f6035600640 1 --2- 172.21.15.112:0/744178067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f601c0052e0 0x7f601c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:25.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.933+0000 7f6035600640 1 -- 172.21.15.112:0/744178067 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f601c00c1d0 con 0x7f601c0052e0 2024-09-12T02:51:25.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.933+0000 7f6035600640 1 -- 172.21.15.112:0/744178067 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f601c00c380 con 0x7f601c003a00 2024-09-12T02:51:25.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.933+0000 7f6035600640 1 -- 172.21.15.112:0/744178067 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f601c00c580 con 0x7f601c004800 2024-09-12T02:51:25.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.933+0000 7f6037400640 1 --2- 172.21.15.112:0/744178067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f601c0052e0 0x7f601c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:25.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.933+0000 7f6036000640 1 --2- 172.21.15.112:0/744178067 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f601c004800 0x7f601c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:25.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.933+0000 7f6036a00640 1 --2- 172.21.15.112:0/744178067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f601c003a00 0x7f601c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:25.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.933+0000 7f6037400640 1 -- 172.21.15.112:0/744178067 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f601c004800 msgr2=0x7f601c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:25.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.933+0000 7f6037400640 1 --2- 172.21.15.112:0/744178067 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f601c004800 0x7f601c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.933+0000 7f6037400640 1 -- 172.21.15.112:0/744178067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f601c003a00 msgr2=0x7f601c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:25.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.933+0000 7f6037400640 1 --2- 172.21.15.112:0/744178067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f601c003a00 0x7f601c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.934+0000 7f6037400640 1 -- 172.21.15.112:0/744178067 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f601c003520 con 0x7f601c0052e0 2024-09-12T02:51:25.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.934+0000 7f6037400640 1 -- 172.21.15.112:0/744178067 reap_dead start 2024-09-12T02:51:25.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.934+0000 7f6037400640 1 --2- 172.21.15.112:0/744178067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f601c0052e0 0x7f601c00b9c0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f603000ba00 tx=0x7f601c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ced63bdb6bfeef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:25.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.935+0000 7f6035600640 1 -- 172.21.15.112:0/744178067 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6030030070 con 0x7f601c0052e0 2024-09-12T02:51:25.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.935+0000 7f6035600640 1 -- 172.21.15.112:0/744178067 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f603002ade0 con 0x7f601c0052e0 2024-09-12T02:51:25.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.935+0000 7f6035600640 1 -- 172.21.15.112:0/744178067 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603000b600 con 0x7f601c0052e0 2024-09-12T02:51:25.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.935+0000 7f603da00640 1 -- 172.21.15.112:0/744178067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f601c0052e0 msgr2=0x7f601c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:25.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.935+0000 7f603da00640 1 --2- 172.21.15.112:0/744178067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f601c0052e0 0x7f601c00b9c0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f603000ba00 tx=0x7f601c005830 comp rx=0 tx=0).stop 2024-09-12T02:51:25.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.935+0000 7f603da00640 1 -- 172.21.15.112:0/744178067 shutdown_connections 2024-09-12T02:51:25.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.935+0000 7f603da00640 1 --2- 172.21.15.112:0/744178067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f601c0052e0 0x7f601c00b9c0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.935+0000 7f603da00640 1 -- 172.21.15.112:0/744178067 >> 172.21.15.112:0/744178067 conn(0x7f603806bbd0 msgr2=0x7f603806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:25.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.935+0000 7f603da00640 1 -- 172.21.15.112:0/744178067 shutdown_connections 2024-09-12T02:51:25.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.935+0000 7f603da00640 1 -- 172.21.15.112:0/744178067 wait complete. 2024-09-12T02:51:25.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.937+0000 7f603da00640 1 Processor -- start 2024-09-12T02:51:25.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.937+0000 7f603da00640 1 -- start start 2024-09-12T02:51:25.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.938+0000 7f603da00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f601c0052e0 0x7f6038153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:25.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.938+0000 7f603da00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6038157b20 0x7f6038157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:25.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.938+0000 7f603da00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f60381e8280 0x7f60381e8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:25.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.938+0000 7f603da00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f603806f510 con 0x7f6038157b20 2024-09-12T02:51:25.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.938+0000 7f603da00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f60380cf4c0 con 0x7f601c0052e0 2024-09-12T02:51:25.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.938+0000 7f603da00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f603806f690 con 0x7f60381e8280 2024-09-12T02:51:25.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.938+0000 7f6036000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6038157b20 0x7f6038157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:25.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.938+0000 7f6036000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6038157b20 0x7f6038157fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36742/0 (socket says 172.21.15.112:36742) 2024-09-12T02:51:25.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.938+0000 7f6036000640 1 -- 172.21.15.112:0/2369561459 learned_addr learned my addr 172.21.15.112:0/2369561459 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:25.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.938+0000 7f6036a00640 1 --2- 172.21.15.112:0/2369561459 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f601c0052e0 0x7f6038153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:25.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.938+0000 7f6037400640 1 --2- 172.21.15.112:0/2369561459 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f60381e8280 0x7f60381e8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:25.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.939+0000 7f6036000640 1 -- 172.21.15.112:0/2369561459 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f60381e8280 msgr2=0x7f60381e8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:25.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.939+0000 7f6036000640 1 --2- 172.21.15.112:0/2369561459 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f60381e8280 0x7f60381e8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.939+0000 7f6036000640 1 -- 172.21.15.112:0/2369561459 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f601c0052e0 msgr2=0x7f6038153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:25.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.939+0000 7f6036000640 1 --2- 172.21.15.112:0/2369561459 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f601c0052e0 0x7f6038153500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:25.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.939+0000 7f6036000640 1 -- 172.21.15.112:0/2369561459 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60381e8e60 con 0x7f6038157b20 2024-09-12T02:51:25.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.939+0000 7f6036000640 1 --2- 172.21.15.112:0/2369561459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6038157b20 0x7f6038157fa0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f602400f7f0 tx=0x7f602400fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:25.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.939+0000 7f602ea00640 1 -- 172.21.15.112:0/2369561459 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602400fe40 con 0x7f6038157b20 2024-09-12T02:51:25.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.939+0000 7f602ea00640 1 -- 172.21.15.112:0/2369561459 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6024018070 con 0x7f6038157b20 2024-09-12T02:51:25.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.939+0000 7f603da00640 1 -- 172.21.15.112:0/2369561459 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60380af320 con 0x7f6038157b20 2024-09-12T02:51:25.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.939+0000 7f602ea00640 1 -- 172.21.15.112:0/2369561459 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6024007520 con 0x7f6038157b20 2024-09-12T02:51:25.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.939+0000 7f603da00640 1 -- 172.21.15.112:0/2369561459 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f603815a170 con 0x7f6038157b20 2024-09-12T02:51:25.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.940+0000 7f603da00640 1 -- 172.21.15.112:0/2369561459 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6038068a30 con 0x7f6038157b20 2024-09-12T02:51:25.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.941+0000 7f602ea00640 1 -- 172.21.15.112:0/2369561459 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f60240057a0 con 0x7f6038157b20 2024-09-12T02:51:25.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.942+0000 7f602ea00640 1 --2- 172.21.15.112:0/2369561459 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f601806be30 0x7f601806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:25.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.942+0000 7f602ea00640 1 -- 172.21.15.112:0/2369561459 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f602408ad90 con 0x7f6038157b20 2024-09-12T02:51:25.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.942+0000 7f6036a00640 1 --2- 172.21.15.112:0/2369561459 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f601806be30 0x7f601806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:25.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.943+0000 7f6036a00640 1 --2- 172.21.15.112:0/2369561459 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f601806be30 0x7f601806e2f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6028000f80 tx=0x7f6028009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:25.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:25.947+0000 7f602ea00640 1 -- 172.21.15.112:0/2369561459 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6024059110 con 0x7f6038157b20 2024-09-12T02:51:26.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.153+0000 7f603da00640 1 -- 172.21.15.112:0/2369561459 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f603806df60 con 0x7f6038157b20 2024-09-12T02:51:26.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.154+0000 7f602ea00640 1 -- 172.21.15.112:0/2369561459 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5236 (secure 0 0 0) 0x7f602405d410 con 0x7f6038157b20 2024-09-12T02:51:26.155 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:51:26.155 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":86,"btime":"2024-09-12T02:51:25:753588+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/1180447882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1180447882},{"type":"v1","addr":"172.21.15.112:6836","nonce":1180447882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":6916,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2975519871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2975519871},{"type":"v1","addr":"172.21.15.137:6835","nonce":2975519871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7554,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2629863369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2629863369},{"type":"v1","addr":"172.21.15.112:6837","nonce":2629863369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:51:22.139735+0000","modified":"2024-09-12T02:51:25.151523+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7560},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7560":{"gid":7560,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6834/245886809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":245886809},{"type":"v1","addr":"172.21.15.137:6834","nonce":245886809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7560,"qdb_cluster":[7560]},"id":10}]} 2024-09-12T02:51:26.155 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 86 2024-09-12T02:51:26.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.156+0000 7f603da00640 1 -- 172.21.15.112:0/2369561459 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f601806be30 msgr2=0x7f601806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:26.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.156+0000 7f603da00640 1 --2- 172.21.15.112:0/2369561459 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f601806be30 0x7f601806e2f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6028000f80 tx=0x7f6028009040 comp rx=0 tx=0).stop 2024-09-12T02:51:26.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.156+0000 7f603da00640 1 -- 172.21.15.112:0/2369561459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6038157b20 msgr2=0x7f6038157fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:26.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.156+0000 7f603da00640 1 --2- 172.21.15.112:0/2369561459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6038157b20 0x7f6038157fa0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f602400f7f0 tx=0x7f602400fbf0 comp rx=0 tx=0).stop 2024-09-12T02:51:26.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.156+0000 7f603da00640 1 -- 172.21.15.112:0/2369561459 shutdown_connections 2024-09-12T02:51:26.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.156+0000 7f603da00640 1 --2- 172.21.15.112:0/2369561459 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f60381e8280 0x7f60381e8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:26.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.156+0000 7f603da00640 1 --2- 172.21.15.112:0/2369561459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6038157b20 0x7f6038157fa0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:26.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.156+0000 7f603da00640 1 --2- 172.21.15.112:0/2369561459 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f601806be30 0x7f601806e2f0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:26.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.156+0000 7f603da00640 1 --2- 172.21.15.112:0/2369561459 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f601c0052e0 0x7f6038153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:26.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.156+0000 7f603da00640 1 -- 172.21.15.112:0/2369561459 >> 172.21.15.112:0/2369561459 conn(0x7f603806bbd0 msgr2=0x7f60380b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:26.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.156+0000 7f603da00640 1 -- 172.21.15.112:0/2369561459 shutdown_connections 2024-09-12T02:51:26.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.156+0000 7f603da00640 1 -- 172.21.15.112:0/2369561459 wait complete. 2024-09-12T02:51:26.173 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:51:26.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.325+0000 7f0d39000640 1 Processor -- start 2024-09-12T02:51:26.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.325+0000 7f0d39000640 1 -- start start 2024-09-12T02:51:26.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.326+0000 7f0d39000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d3415b9d0 0x7f0d340b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:26.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.326+0000 7f0d39000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0d340b45d0 0x7f0d340728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:26.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.327+0000 7f0d39000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d340b54a0 con 0x7f0d3406eef0 2024-09-12T02:51:26.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.327+0000 7f0d39000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f0d340b4a30 con 0x7f0d340b45d0 2024-09-12T02:51:26.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.327+0000 7f0d39000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0d340b3af0 con 0x7f0d3415b9d0 2024-09-12T02:51:26.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.327+0000 7f0d32800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f0d3406eef0 0x7f0d3406f300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52192/0 (socket says 172.21.15.112:52192) 2024-09-12T02:51:26.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.327+0000 7f0d32800640 1 -- 172.21.15.112:0/1668835683 learned_addr learned my addr 172.21.15.112:0/1668835683 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:51:26.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.327+0000 7f0d31e00640 1 --2- 172.21.15.112:0/1668835683 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d3415b9d0 0x7f0d340b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:26.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.327+0000 7f0d29400640 1 --2- 172.21.15.112:0/1668835683 >> v2:172.21.15.137:3300/0 conn(0x7f0d340b45d0 0x7f0d340728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:26.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.327+0000 7f0d31400640 1 -- 172.21.15.112:0/1668835683 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1749455859 0 0) 0x7f0d340b54a0 con 0x7f0d3406eef0 2024-09-12T02:51:26.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.327+0000 7f0d31400640 1 -- 172.21.15.112:0/1668835683 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d18005730 con 0x7f0d3406eef0 2024-09-12T02:51:26.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.327+0000 7f0d31e00640 1 -- 172.21.15.112:0/1668835683 >> v2:172.21.15.137:3300/0 conn(0x7f0d340b45d0 msgr2=0x7f0d340728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:26.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.327+0000 7f0d31e00640 1 --2- 172.21.15.112:0/1668835683 >> v2:172.21.15.137:3300/0 conn(0x7f0d340b45d0 0x7f0d340728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:26.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.327+0000 7f0d31e00640 1 -- 172.21.15.112:0/1668835683 >> v1:172.21.15.112:6789/0 conn(0x7f0d3406eef0 legacy=0x7f0d3406f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:26.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.327+0000 7f0d31e00640 1 -- 172.21.15.112:0/1668835683 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d340b3dd0 con 0x7f0d3415b9d0 2024-09-12T02:51:26.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.329+0000 7f0d31e00640 1 --2- 172.21.15.112:0/1668835683 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d3415b9d0 0x7f0d340b4ec0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0d240097a0 tx=0x7f0d2402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20a365910c3533b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:26.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.329+0000 7f0d31400640 1 -- 172.21.15.112:0/1668835683 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d24037070 con 0x7f0d3415b9d0 2024-09-12T02:51:26.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.329+0000 7f0d31400640 1 -- 172.21.15.112:0/1668835683 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d24032440 con 0x7f0d3415b9d0 2024-09-12T02:51:26.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.329+0000 7f0d31400640 1 -- 172.21.15.112:0/1668835683 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d240327f0 con 0x7f0d3415b9d0 2024-09-12T02:51:26.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.329+0000 7f0d39000640 1 -- 172.21.15.112:0/1668835683 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d3415b9d0 msgr2=0x7f0d340b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:26.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.329+0000 7f0d39000640 1 --2- 172.21.15.112:0/1668835683 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d3415b9d0 0x7f0d340b4ec0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0d240097a0 tx=0x7f0d2402a180 comp rx=0 tx=0).stop 2024-09-12T02:51:26.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.329+0000 7f0d39000640 1 -- 172.21.15.112:0/1668835683 shutdown_connections 2024-09-12T02:51:26.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.329+0000 7f0d39000640 1 --2- 172.21.15.112:0/1668835683 >> v2:172.21.15.137:3300/0 conn(0x7f0d340b45d0 0x7f0d340728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:26.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.329+0000 7f0d39000640 1 --2- 172.21.15.112:0/1668835683 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d3415b9d0 0x7f0d340b4ec0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:26.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.329+0000 7f0d39000640 1 -- 172.21.15.112:0/1668835683 >> 172.21.15.112:0/1668835683 conn(0x7f0d3406bbd0 msgr2=0x7f0d3406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:26.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.329+0000 7f0d39000640 1 -- 172.21.15.112:0/1668835683 shutdown_connections 2024-09-12T02:51:26.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.330+0000 7f0d39000640 1 -- 172.21.15.112:0/1668835683 wait complete. 2024-09-12T02:51:26.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.331+0000 7f0d39000640 1 Processor -- start 2024-09-12T02:51:26.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.331+0000 7f0d39000640 1 -- start start 2024-09-12T02:51:26.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.332+0000 7f0d39000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d3406eef0 0x7f0d3415a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:26.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.332+0000 7f0d39000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d340b45d0 0x7f0d340ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:26.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.332+0000 7f0d39000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d3415b9d0 0x7f0d34159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:26.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.332+0000 7f0d39000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3415bf30 con 0x7f0d3415b9d0 2024-09-12T02:51:26.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.332+0000 7f0d39000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3415bdb0 con 0x7f0d3406eef0 2024-09-12T02:51:26.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.332+0000 7f0d39000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0d340cdcd0 con 0x7f0d340b45d0 2024-09-12T02:51:26.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.332+0000 7f0d32800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d3415b9d0 0x7f0d34159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:26.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.332+0000 7f0d32800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d3415b9d0 0x7f0d34159690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36754/0 (socket says 172.21.15.112:36754) 2024-09-12T02:51:26.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.332+0000 7f0d32800640 1 -- 172.21.15.112:0/784494736 learned_addr learned my addr 172.21.15.112:0/784494736 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:26.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.333+0000 7f0d31e00640 1 --2- 172.21.15.112:0/784494736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d3406eef0 0x7f0d3415a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:26.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.333+0000 7f0d29400640 1 --2- 172.21.15.112:0/784494736 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d340b45d0 0x7f0d340ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:26.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.333+0000 7f0d32800640 1 -- 172.21.15.112:0/784494736 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d340b45d0 msgr2=0x7f0d340ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:26.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.333+0000 7f0d32800640 1 --2- 172.21.15.112:0/784494736 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d340b45d0 0x7f0d340ccd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:26.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.333+0000 7f0d32800640 1 -- 172.21.15.112:0/784494736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d3406eef0 msgr2=0x7f0d3415a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:26.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.333+0000 7f0d32800640 1 --2- 172.21.15.112:0/784494736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d3406eef0 0x7f0d3415a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:26.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.333+0000 7f0d32800640 1 -- 172.21.15.112:0/784494736 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d34158fc0 con 0x7f0d3415b9d0 2024-09-12T02:51:26.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.333+0000 7f0d32800640 1 --2- 172.21.15.112:0/784494736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d3415b9d0 0x7f0d34159690 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00cb40 tx=0x7f0d2c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:26.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.333+0000 7f0d2aa00640 1 -- 172.21.15.112:0/784494736 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c017070 con 0x7f0d3415b9d0 2024-09-12T02:51:26.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.333+0000 7f0d2aa00640 1 -- 172.21.15.112:0/784494736 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2c00aca0 con 0x7f0d3415b9d0 2024-09-12T02:51:26.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.333+0000 7f0d39000640 1 -- 172.21.15.112:0/784494736 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d34158ce0 con 0x7f0d3415b9d0 2024-09-12T02:51:26.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.333+0000 7f0d2aa00640 1 -- 172.21.15.112:0/784494736 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c012620 con 0x7f0d3415b9d0 2024-09-12T02:51:26.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.334+0000 7f0d39000640 1 -- 172.21.15.112:0/784494736 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d3415c430 con 0x7f0d3415b9d0 2024-09-12T02:51:26.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.334+0000 7f0d39000640 1 -- 172.21.15.112:0/784494736 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d3406dbc0 con 0x7f0d3415b9d0 2024-09-12T02:51:26.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.335+0000 7f0d2aa00640 1 -- 172.21.15.112:0/784494736 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0d2c01a070 con 0x7f0d3415b9d0 2024-09-12T02:51:26.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.336+0000 7f0d2aa00640 1 --2- 172.21.15.112:0/784494736 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0d1006be30 0x7f0d1006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:26.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.336+0000 7f0d2aa00640 1 -- 172.21.15.112:0/784494736 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f0d2c08ad20 con 0x7f0d3415b9d0 2024-09-12T02:51:26.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.336+0000 7f0d31e00640 1 --2- 172.21.15.112:0/784494736 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0d1006be30 0x7f0d1006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:26.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.337+0000 7f0d31e00640 1 --2- 172.21.15.112:0/784494736 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0d1006be30 0x7f0d1006e2f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0d24034000 tx=0x7f0d2402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:26.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.341+0000 7f0d2aa00640 1 -- 172.21.15.112:0/784494736 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0d2c059630 con 0x7f0d3415b9d0 2024-09-12T02:51:26.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.517+0000 7f0d39000640 1 -- 172.21.15.112:0/784494736 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d340b5a00 con 0x7f0d3415b9d0 2024-09-12T02:51:26.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.518+0000 7f0d2aa00640 1 -- 172.21.15.112:0/784494736 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) ==== 74+0+16788 (secure 0 0 0) 0x7f0d2c058f30 con 0x7f0d3415b9d0 2024-09-12T02:51:26.519 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:51:26.519 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":167,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:51:23.727103+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:51:19.902565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-12T02:51:21.129561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:51:26.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.520+0000 7f0d39000640 1 -- 172.21.15.112:0/784494736 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0d1006be30 msgr2=0x7f0d1006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:26.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.520+0000 7f0d39000640 1 --2- 172.21.15.112:0/784494736 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0d1006be30 0x7f0d1006e2f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0d24034000 tx=0x7f0d2402e000 comp rx=0 tx=0).stop 2024-09-12T02:51:26.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.521+0000 7f0d39000640 1 -- 172.21.15.112:0/784494736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d3415b9d0 msgr2=0x7f0d34159690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:26.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.521+0000 7f0d39000640 1 --2- 172.21.15.112:0/784494736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d3415b9d0 0x7f0d34159690 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00cb40 tx=0x7f0d2c00a060 comp rx=0 tx=0).stop 2024-09-12T02:51:26.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.521+0000 7f0d39000640 1 -- 172.21.15.112:0/784494736 shutdown_connections 2024-09-12T02:51:26.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.521+0000 7f0d39000640 1 --2- 172.21.15.112:0/784494736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d3415b9d0 0x7f0d34159690 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:26.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.521+0000 7f0d39000640 1 --2- 172.21.15.112:0/784494736 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d340b45d0 0x7f0d340ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:26.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.521+0000 7f0d39000640 1 --2- 172.21.15.112:0/784494736 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0d1006be30 0x7f0d1006e2f0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:26.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.521+0000 7f0d39000640 1 --2- 172.21.15.112:0/784494736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d3406eef0 0x7f0d3415a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:26.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.521+0000 7f0d39000640 1 -- 172.21.15.112:0/784494736 >> 172.21.15.112:0/784494736 conn(0x7f0d3406bbd0 msgr2=0x7f0d340afa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:26.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.521+0000 7f0d39000640 1 -- 172.21.15.112:0/784494736 shutdown_connections 2024-09-12T02:51:26.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.521+0000 7f0d39000640 1 -- 172.21.15.112:0/784494736 wait complete. 2024-09-12T02:51:26.538 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:51:26.538 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:51:26.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.690+0000 7f120e800640 1 Processor -- start 2024-09-12T02:51:26.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.690+0000 7f120e800640 1 -- start start 2024-09-12T02:51:26.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.691+0000 7f120e800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f120806e3b0 0x7f12080afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:26.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.691+0000 7f120e800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12080aedd0 con 0x7f12080ae8d0 2024-09-12T02:51:26.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.691+0000 7f120e800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12080af0b0 con 0x7f120806d8c0 2024-09-12T02:51:26.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.691+0000 7f120e800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f12080af390 con 0x7f120806e3b0 2024-09-12T02:51:26.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.692+0000 7f11fea00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f12080ae8d0 0x7f120806dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52202/0 (socket says 172.21.15.112:52202) 2024-09-12T02:51:26.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.692+0000 7f11fea00640 1 -- 172.21.15.112:0/1263684288 learned_addr learned my addr 172.21.15.112:0/1263684288 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:51:26.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.692+0000 7f1207e00640 1 --2- 172.21.15.112:0/1263684288 >> v2:172.21.15.137:3300/0 conn(0x7f120806e3b0 0x7f12080afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:26.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.692+0000 7f1206a00640 1 -- 172.21.15.112:0/1263684288 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2681404314 0 0) 0x7f12080aedd0 con 0x7f12080ae8d0 2024-09-12T02:51:26.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.692+0000 7f1206a00640 1 -- 172.21.15.112:0/1263684288 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11ec003520 con 0x7f12080ae8d0 2024-09-12T02:51:26.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.692+0000 7f1206a00640 1 -- 172.21.15.112:0/1263684288 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2972530191 0 0) 0x7f12080af0b0 con 0x7f120806d8c0 2024-09-12T02:51:26.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.692+0000 7f1206a00640 1 -- 172.21.15.112:0/1263684288 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12080aedd0 con 0x7f120806d8c0 2024-09-12T02:51:26.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.692+0000 7f1206a00640 1 -- 172.21.15.112:0/1263684288 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 840392984 0 0) 0x7f11ec003520 con 0x7f12080ae8d0 2024-09-12T02:51:26.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.692+0000 7f1207e00640 1 -- 172.21.15.112:0/1263684288 >> v1:172.21.15.137:6789/0 conn(0x7f120806d8c0 legacy=0x7f12080715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:26.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.693+0000 7f1207e00640 1 -- 172.21.15.112:0/1263684288 >> v1:172.21.15.112:6789/0 conn(0x7f12080ae8d0 legacy=0x7f120806dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:26.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.693+0000 7f1207e00640 1 -- 172.21.15.112:0/1263684288 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12080af670 con 0x7f120806e3b0 2024-09-12T02:51:26.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.694+0000 7f1207e00640 1 --2- 172.21.15.112:0/1263684288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f120806e3b0 0x7f12080afe70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1200009d90 tx=0x7f120002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=860dc616cc5b1b0d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:26.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.694+0000 7f1206a00640 1 -- 172.21.15.112:0/1263684288 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1200007740 con 0x7f120806e3b0 2024-09-12T02:51:26.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.694+0000 7f1206a00640 1 -- 172.21.15.112:0/1263684288 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12000078e0 con 0x7f120806e3b0 2024-09-12T02:51:26.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.694+0000 7f1206a00640 1 -- 172.21.15.112:0/1263684288 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1200007cb0 con 0x7f120806e3b0 2024-09-12T02:51:26.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.694+0000 7f120e800640 1 -- 172.21.15.112:0/1263684288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f120806e3b0 msgr2=0x7f12080afe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:26.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.694+0000 7f120e800640 1 --2- 172.21.15.112:0/1263684288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f120806e3b0 0x7f12080afe70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1200009d90 tx=0x7f120002a6f0 comp rx=0 tx=0).stop 2024-09-12T02:51:26.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.694+0000 7f120e800640 1 -- 172.21.15.112:0/1263684288 shutdown_connections 2024-09-12T02:51:26.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.694+0000 7f120e800640 1 --2- 172.21.15.112:0/1263684288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f120806e3b0 0x7f12080afe70 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:26.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.694+0000 7f120e800640 1 -- 172.21.15.112:0/1263684288 >> 172.21.15.112:0/1263684288 conn(0x7f120806bbd0 msgr2=0x7f120806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:26.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.695+0000 7f120e800640 1 -- 172.21.15.112:0/1263684288 shutdown_connections 2024-09-12T02:51:26.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.695+0000 7f120e800640 1 -- 172.21.15.112:0/1263684288 wait complete. 2024-09-12T02:51:26.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.696+0000 7f120e800640 1 Processor -- start 2024-09-12T02:51:26.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.696+0000 7f120e800640 1 -- start start 2024-09-12T02:51:26.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.697+0000 7f120e800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f120806d8c0 0x7f1208146370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:26.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.697+0000 7f120e800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f120806e3b0 0x7f12080ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:26.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.697+0000 7f120e800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12080ae8d0 0x7f1208148400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:26.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.697+0000 7f120e800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f12080b3a60 con 0x7f12080ae8d0 2024-09-12T02:51:26.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.697+0000 7f120e800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f12080b38e0 con 0x7f120806d8c0 2024-09-12T02:51:26.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.697+0000 7f120e800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f12080b3be0 con 0x7f120806e3b0 2024-09-12T02:51:26.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.697+0000 7f1207e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12080ae8d0 0x7f1208148400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:26.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.697+0000 7f1207e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12080ae8d0 0x7f1208148400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36766/0 (socket says 172.21.15.112:36766) 2024-09-12T02:51:26.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.697+0000 7f1207e00640 1 -- 172.21.15.112:0/687678373 learned_addr learned my addr 172.21.15.112:0/687678373 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:26.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.698+0000 7f1207400640 1 --2- 172.21.15.112:0/687678373 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f120806d8c0 0x7f1208146370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:26.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.698+0000 7f11fea00640 1 --2- 172.21.15.112:0/687678373 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f120806e3b0 0x7f12080ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:26.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.698+0000 7f1207e00640 1 -- 172.21.15.112:0/687678373 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f120806e3b0 msgr2=0x7f12080ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:26.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.698+0000 7f1207e00640 1 --2- 172.21.15.112:0/687678373 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f120806e3b0 0x7f12080ccc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:26.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.698+0000 7f1207e00640 1 -- 172.21.15.112:0/687678373 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f120806d8c0 msgr2=0x7f1208146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:26.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.698+0000 7f1207e00640 1 --2- 172.21.15.112:0/687678373 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f120806d8c0 0x7f1208146370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:26.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.698+0000 7f1207e00640 1 -- 172.21.15.112:0/687678373 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1208156ee0 con 0x7f12080ae8d0 2024-09-12T02:51:26.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.698+0000 7f1207400640 1 --2- 172.21.15.112:0/687678373 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f120806d8c0 0x7f1208146370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:51:26.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.698+0000 7f11fea00640 1 --2- 172.21.15.112:0/687678373 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f120806e3b0 0x7f12080ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:51:26.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.698+0000 7f1207e00640 1 --2- 172.21.15.112:0/687678373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12080ae8d0 0x7f1208148400 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f120002ace0 tx=0x7f1200004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:26.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.698+0000 7f11ffe00640 1 -- 172.21.15.112:0/687678373 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1200040070 con 0x7f12080ae8d0 2024-09-12T02:51:26.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.699+0000 7f120e800640 1 -- 172.21.15.112:0/687678373 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12081571c0 con 0x7f12080ae8d0 2024-09-12T02:51:26.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.699+0000 7f11ffe00640 1 -- 172.21.15.112:0/687678373 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1200031bc0 con 0x7f12080ae8d0 2024-09-12T02:51:26.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.699+0000 7f11ffe00640 1 -- 172.21.15.112:0/687678373 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1200009450 con 0x7f12080ae8d0 2024-09-12T02:51:26.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.699+0000 7f120e800640 1 -- 172.21.15.112:0/687678373 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1208157780 con 0x7f12080ae8d0 2024-09-12T02:51:26.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.700+0000 7f120e800640 1 -- 172.21.15.112:0/687678373 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1208068a30 con 0x7f12080ae8d0 2024-09-12T02:51:26.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.701+0000 7f11ffe00640 1 -- 172.21.15.112:0/687678373 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1200039040 con 0x7f12080ae8d0 2024-09-12T02:51:26.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.702+0000 7f11ffe00640 1 --2- 172.21.15.112:0/687678373 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f11e406be30 0x7f11e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:26.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.702+0000 7f11ffe00640 1 -- 172.21.15.112:0/687678373 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f12000abcc0 con 0x7f12080ae8d0 2024-09-12T02:51:26.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.702+0000 7f1207400640 1 --2- 172.21.15.112:0/687678373 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f11e406be30 0x7f11e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:26.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.703+0000 7f1207400640 1 --2- 172.21.15.112:0/687678373 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f11e406be30 0x7f11e406e2f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f11f80011e0 tx=0x7f11f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:26.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.706+0000 7f11ffe00640 1 -- 172.21.15.112:0/687678373 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f12000b2080 con 0x7f12080ae8d0 2024-09-12T02:51:26.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.880+0000 7f120e800640 1 -- 172.21.15.112:0/687678373 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f12080cd580 con 0x7f11e406be30 2024-09-12T02:51:26.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.886+0000 7f11ffe00640 1 -- 172.21.15.112:0/687678373 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247921 (secure 0 0 0) 0x7f12080cd580 con 0x7f11e406be30 2024-09-12T02:51:26.890 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:51:26.891 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:51:26.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.890+0000 7f120e800640 1 -- 172.21.15.112:0/687678373 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f11e406be30 msgr2=0x7f11e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:26.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.890+0000 7f120e800640 1 --2- 172.21.15.112:0/687678373 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f11e406be30 0x7f11e406e2f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f11f80011e0 tx=0x7f11f8009040 comp rx=0 tx=0).stop 2024-09-12T02:51:26.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.890+0000 7f120e800640 1 -- 172.21.15.112:0/687678373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12080ae8d0 msgr2=0x7f1208148400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:26.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.890+0000 7f120e800640 1 --2- 172.21.15.112:0/687678373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12080ae8d0 0x7f1208148400 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f120002ace0 tx=0x7f1200004a40 comp rx=0 tx=0).stop 2024-09-12T02:51:26.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.890+0000 7f120e800640 1 -- 172.21.15.112:0/687678373 shutdown_connections 2024-09-12T02:51:26.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.890+0000 7f120e800640 1 --2- 172.21.15.112:0/687678373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12080ae8d0 0x7f1208148400 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:26.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.890+0000 7f120e800640 1 --2- 172.21.15.112:0/687678373 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f120806e3b0 0x7f12080ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:26.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.890+0000 7f120e800640 1 --2- 172.21.15.112:0/687678373 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f11e406be30 0x7f11e406e2f0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:26.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.890+0000 7f120e800640 1 --2- 172.21.15.112:0/687678373 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f120806d8c0 0x7f1208146370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:26.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.890+0000 7f120e800640 1 -- 172.21.15.112:0/687678373 >> 172.21.15.112:0/687678373 conn(0x7f120806bbd0 msgr2=0x7f12080b0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:26.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.890+0000 7f120e800640 1 -- 172.21.15.112:0/687678373 shutdown_connections 2024-09-12T02:51:26.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:26.890+0000 7f120e800640 1 -- 172.21.15.112:0/687678373 wait complete. 2024-09-12T02:51:26.906 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":450,"stamp":"2024-09-12T02:51:25.090996+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":68,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8366,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554133,"statfs":{"total":1600000000,"available":1591432628,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.374188"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.748980+0000","last_change":"2024-09-12T02:51:22.748754+0000","last_active":"2024-09-12T02:51:22.748980+0000","last_peered":"2024-09-12T02:51:22.748980+0000","last_clean":"2024-09-12T02:51:22.748980+0000","last_became_active":"2024-09-12T02:51:22.748331+0000","last_became_peered":"2024-09-12T02:51:22.748331+0000","last_unstale":"2024-09-12T02:51:22.748980+0000","last_undegraded":"2024-09-12T02:51:22.748980+0000","last_fullsized":"2024-09-12T02:51:22.748980+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:11.448332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.734962+0000","last_change":"2024-09-12T02:51:22.734857+0000","last_active":"2024-09-12T02:51:22.734962+0000","last_peered":"2024-09-12T02:51:22.734962+0000","last_clean":"2024-09-12T02:51:22.734962+0000","last_became_active":"2024-09-12T02:51:22.734648+0000","last_became_peered":"2024-09-12T02:51:22.734648+0000","last_unstale":"2024-09-12T02:51:22.734962+0000","last_undegraded":"2024-09-12T02:51:22.734962+0000","last_fullsized":"2024-09-12T02:51:22.734962+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:12.798153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.738674+0000","last_change":"2024-09-12T02:51:22.738245+0000","last_active":"2024-09-12T02:51:22.738674+0000","last_peered":"2024-09-12T02:51:22.738674+0000","last_clean":"2024-09-12T02:51:22.738674+0000","last_became_active":"2024-09-12T02:51:22.737728+0000","last_became_peered":"2024-09-12T02:51:22.737728+0000","last_unstale":"2024-09-12T02:51:22.738674+0000","last_undegraded":"2024-09-12T02:51:22.738674+0000","last_fullsized":"2024-09-12T02:51:22.738674+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:30:54.572304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.744211+0000","last_change":"2024-09-12T02:51:22.743609+0000","last_active":"2024-09-12T02:51:22.744211+0000","last_peered":"2024-09-12T02:51:22.744211+0000","last_clean":"2024-09-12T02:51:22.744211+0000","last_became_active":"2024-09-12T02:51:22.742435+0000","last_became_peered":"2024-09-12T02:51:22.742435+0000","last_unstale":"2024-09-12T02:51:22.744211+0000","last_undegraded":"2024-09-12T02:51:22.744211+0000","last_fullsized":"2024-09-12T02:51:22.744211+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:15.762010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.750209+0000","last_change":"2024-09-12T02:51:22.748621+0000","last_active":"2024-09-12T02:51:22.750209+0000","last_peered":"2024-09-12T02:51:22.750209+0000","last_clean":"2024-09-12T02:51:22.750209+0000","last_became_active":"2024-09-12T02:51:22.748336+0000","last_became_peered":"2024-09-12T02:51:22.748336+0000","last_unstale":"2024-09-12T02:51:22.750209+0000","last_undegraded":"2024-09-12T02:51:22.750209+0000","last_fullsized":"2024-09-12T02:51:22.750209+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:25.769640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.747484+0000","last_change":"2024-09-12T02:51:22.747203+0000","last_active":"2024-09-12T02:51:22.747484+0000","last_peered":"2024-09-12T02:51:22.747484+0000","last_clean":"2024-09-12T02:51:22.747484+0000","last_became_active":"2024-09-12T02:51:22.746806+0000","last_became_peered":"2024-09-12T02:51:22.746806+0000","last_unstale":"2024-09-12T02:51:22.747484+0000","last_undegraded":"2024-09-12T02:51:22.747484+0000","last_fullsized":"2024-09-12T02:51:22.747484+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:35.356768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.745331+0000","last_change":"2024-09-12T02:51:22.745220+0000","last_active":"2024-09-12T02:51:22.745331+0000","last_peered":"2024-09-12T02:51:22.745331+0000","last_clean":"2024-09-12T02:51:22.745331+0000","last_became_active":"2024-09-12T02:51:22.744918+0000","last_became_peered":"2024-09-12T02:51:22.744918+0000","last_unstale":"2024-09-12T02:51:22.745331+0000","last_undegraded":"2024-09-12T02:51:22.745331+0000","last_fullsized":"2024-09-12T02:51:22.745331+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:00:26.490627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.739393+0000","last_change":"2024-09-12T02:51:22.739223+0000","last_active":"2024-09-12T02:51:22.739393+0000","last_peered":"2024-09-12T02:51:22.739393+0000","last_clean":"2024-09-12T02:51:22.739393+0000","last_became_active":"2024-09-12T02:51:22.738801+0000","last_became_peered":"2024-09-12T02:51:22.738801+0000","last_unstale":"2024-09-12T02:51:22.739393+0000","last_undegraded":"2024-09-12T02:51:22.739393+0000","last_fullsized":"2024-09-12T02:51:22.739393+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:26.591079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.737813+0000","last_change":"2024-09-12T02:51:22.736883+0000","last_active":"2024-09-12T02:51:22.737813+0000","last_peered":"2024-09-12T02:51:22.737813+0000","last_clean":"2024-09-12T02:51:22.737813+0000","last_became_active":"2024-09-12T02:51:22.736633+0000","last_became_peered":"2024-09-12T02:51:22.736633+0000","last_unstale":"2024-09-12T02:51:22.737813+0000","last_undegraded":"2024-09-12T02:51:22.737813+0000","last_fullsized":"2024-09-12T02:51:22.737813+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:53.078427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.753394+0000","last_change":"2024-09-12T02:51:22.751191+0000","last_active":"2024-09-12T02:51:22.753394+0000","last_peered":"2024-09-12T02:51:22.753394+0000","last_clean":"2024-09-12T02:51:22.753394+0000","last_became_active":"2024-09-12T02:51:22.747693+0000","last_became_peered":"2024-09-12T02:51:22.747693+0000","last_unstale":"2024-09-12T02:51:22.753394+0000","last_undegraded":"2024-09-12T02:51:22.753394+0000","last_fullsized":"2024-09-12T02:51:22.753394+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:05.032019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.739760+0000","last_change":"2024-09-12T02:51:22.739659+0000","last_active":"2024-09-12T02:51:22.739760+0000","last_peered":"2024-09-12T02:51:22.739760+0000","last_clean":"2024-09-12T02:51:22.739760+0000","last_became_active":"2024-09-12T02:51:22.739423+0000","last_became_peered":"2024-09-12T02:51:22.739423+0000","last_unstale":"2024-09-12T02:51:22.739760+0000","last_undegraded":"2024-09-12T02:51:22.739760+0000","last_fullsized":"2024-09-12T02:51:22.739760+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:10.643902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.753413+0000","last_change":"2024-09-12T02:51:22.752859+0000","last_active":"2024-09-12T02:51:22.753413+0000","last_peered":"2024-09-12T02:51:22.753413+0000","last_clean":"2024-09-12T02:51:22.753413+0000","last_became_active":"2024-09-12T02:51:22.752621+0000","last_became_peered":"2024-09-12T02:51:22.752621+0000","last_unstale":"2024-09-12T02:51:22.753413+0000","last_undegraded":"2024-09-12T02:51:22.753413+0000","last_fullsized":"2024-09-12T02:51:22.753413+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:10:33.544285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.753940+0000","last_change":"2024-09-12T02:51:22.751776+0000","last_active":"2024-09-12T02:51:22.753940+0000","last_peered":"2024-09-12T02:51:22.753940+0000","last_clean":"2024-09-12T02:51:22.753940+0000","last_became_active":"2024-09-12T02:51:22.751169+0000","last_became_peered":"2024-09-12T02:51:22.751169+0000","last_unstale":"2024-09-12T02:51:22.753940+0000","last_undegraded":"2024-09-12T02:51:22.753940+0000","last_fullsized":"2024-09-12T02:51:22.753940+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:35.239134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.751518+0000","last_change":"2024-09-12T02:51:22.750972+0000","last_active":"2024-09-12T02:51:22.751518+0000","last_peered":"2024-09-12T02:51:22.751518+0000","last_clean":"2024-09-12T02:51:22.751518+0000","last_became_active":"2024-09-12T02:51:22.750462+0000","last_became_peered":"2024-09-12T02:51:22.750462+0000","last_unstale":"2024-09-12T02:51:22.751518+0000","last_undegraded":"2024-09-12T02:51:22.751518+0000","last_fullsized":"2024-09-12T02:51:22.751518+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:59.725781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.742578+0000","last_change":"2024-09-12T02:51:22.741319+0000","last_active":"2024-09-12T02:51:22.742578+0000","last_peered":"2024-09-12T02:51:22.742578+0000","last_clean":"2024-09-12T02:51:22.742578+0000","last_became_active":"2024-09-12T02:51:22.741030+0000","last_became_peered":"2024-09-12T02:51:22.741030+0000","last_unstale":"2024-09-12T02:51:22.742578+0000","last_undegraded":"2024-09-12T02:51:22.742578+0000","last_fullsized":"2024-09-12T02:51:22.742578+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:31.268255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.741505+0000","last_change":"2024-09-12T02:51:22.741323+0000","last_active":"2024-09-12T02:51:22.741505+0000","last_peered":"2024-09-12T02:51:22.741505+0000","last_clean":"2024-09-12T02:51:22.741505+0000","last_became_active":"2024-09-12T02:51:22.740977+0000","last_became_peered":"2024-09-12T02:51:22.740977+0000","last_unstale":"2024-09-12T02:51:22.741505+0000","last_undegraded":"2024-09-12T02:51:22.741505+0000","last_fullsized":"2024-09-12T02:51:22.741505+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:32.649565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.750190+0000","last_change":"2024-09-12T02:51:22.748779+0000","last_active":"2024-09-12T02:51:22.750190+0000","last_peered":"2024-09-12T02:51:22.750190+0000","last_clean":"2024-09-12T02:51:22.750190+0000","last_became_active":"2024-09-12T02:51:22.748510+0000","last_became_peered":"2024-09-12T02:51:22.748510+0000","last_unstale":"2024-09-12T02:51:22.750190+0000","last_undegraded":"2024-09-12T02:51:22.750190+0000","last_fullsized":"2024-09-12T02:51:22.750190+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:12.671091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.738654+0000","last_change":"2024-09-12T02:51:22.738033+0000","last_active":"2024-09-12T02:51:22.738654+0000","last_peered":"2024-09-12T02:51:22.738654+0000","last_clean":"2024-09-12T02:51:22.738654+0000","last_became_active":"2024-09-12T02:51:22.737420+0000","last_became_peered":"2024-09-12T02:51:22.737420+0000","last_unstale":"2024-09-12T02:51:22.738654+0000","last_undegraded":"2024-09-12T02:51:22.738654+0000","last_fullsized":"2024-09-12T02:51:22.738654+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:40.817571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.741450+0000","last_change":"2024-09-12T02:51:22.740565+0000","last_active":"2024-09-12T02:51:22.741450+0000","last_peered":"2024-09-12T02:51:22.741450+0000","last_clean":"2024-09-12T02:51:22.741450+0000","last_became_active":"2024-09-12T02:51:22.740364+0000","last_became_peered":"2024-09-12T02:51:22.740364+0000","last_unstale":"2024-09-12T02:51:22.741450+0000","last_undegraded":"2024-09-12T02:51:22.741450+0000","last_fullsized":"2024-09-12T02:51:22.741450+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:53.424130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.739749+0000","last_change":"2024-09-12T02:51:22.739592+0000","last_active":"2024-09-12T02:51:22.739749+0000","last_peered":"2024-09-12T02:51:22.739749+0000","last_clean":"2024-09-12T02:51:22.739749+0000","last_became_active":"2024-09-12T02:51:22.737488+0000","last_became_peered":"2024-09-12T02:51:22.737488+0000","last_unstale":"2024-09-12T02:51:22.739749+0000","last_undegraded":"2024-09-12T02:51:22.739749+0000","last_fullsized":"2024-09-12T02:51:22.739749+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:11.808511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.753314+0000","last_change":"2024-09-12T02:51:22.748203+0000","last_active":"2024-09-12T02:51:22.753314+0000","last_peered":"2024-09-12T02:51:22.753314+0000","last_clean":"2024-09-12T02:51:22.753314+0000","last_became_active":"2024-09-12T02:51:22.746891+0000","last_became_peered":"2024-09-12T02:51:22.746891+0000","last_unstale":"2024-09-12T02:51:22.753314+0000","last_undegraded":"2024-09-12T02:51:22.753314+0000","last_fullsized":"2024-09-12T02:51:22.753314+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:55.603814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.746342+0000","last_change":"2024-09-12T02:51:22.745374+0000","last_active":"2024-09-12T02:51:22.746342+0000","last_peered":"2024-09-12T02:51:22.746342+0000","last_clean":"2024-09-12T02:51:22.746342+0000","last_became_active":"2024-09-12T02:51:22.745070+0000","last_became_peered":"2024-09-12T02:51:22.745070+0000","last_unstale":"2024-09-12T02:51:22.746342+0000","last_undegraded":"2024-09-12T02:51:22.746342+0000","last_fullsized":"2024-09-12T02:51:22.746342+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:25.227276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.743860+0000","last_change":"2024-09-12T02:51:22.741384+0000","last_active":"2024-09-12T02:51:22.743860+0000","last_peered":"2024-09-12T02:51:22.743860+0000","last_clean":"2024-09-12T02:51:22.743860+0000","last_became_active":"2024-09-12T02:51:22.741084+0000","last_became_peered":"2024-09-12T02:51:22.741084+0000","last_unstale":"2024-09-12T02:51:22.743860+0000","last_undegraded":"2024-09-12T02:51:22.743860+0000","last_fullsized":"2024-09-12T02:51:22.743860+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:09.071201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.750207+0000","last_change":"2024-09-12T02:51:22.748828+0000","last_active":"2024-09-12T02:51:22.750207+0000","last_peered":"2024-09-12T02:51:22.750207+0000","last_clean":"2024-09-12T02:51:22.750207+0000","last_became_active":"2024-09-12T02:51:22.746773+0000","last_became_peered":"2024-09-12T02:51:22.746773+0000","last_unstale":"2024-09-12T02:51:22.750207+0000","last_undegraded":"2024-09-12T02:51:22.750207+0000","last_fullsized":"2024-09-12T02:51:22.750207+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:36.011290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.739715+0000","last_change":"2024-09-12T02:51:22.737706+0000","last_active":"2024-09-12T02:51:22.739715+0000","last_peered":"2024-09-12T02:51:22.739715+0000","last_clean":"2024-09-12T02:51:22.739715+0000","last_became_active":"2024-09-12T02:51:22.737150+0000","last_became_peered":"2024-09-12T02:51:22.737150+0000","last_unstale":"2024-09-12T02:51:22.739715+0000","last_undegraded":"2024-09-12T02:51:22.739715+0000","last_fullsized":"2024-09-12T02:51:22.739715+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:17.917911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.742434+0000","last_change":"2024-09-12T02:51:22.742214+0000","last_active":"2024-09-12T02:51:22.742434+0000","last_peered":"2024-09-12T02:51:22.742434+0000","last_clean":"2024-09-12T02:51:22.742434+0000","last_became_active":"2024-09-12T02:51:22.741941+0000","last_became_peered":"2024-09-12T02:51:22.741941+0000","last_unstale":"2024-09-12T02:51:22.742434+0000","last_undegraded":"2024-09-12T02:51:22.742434+0000","last_fullsized":"2024-09-12T02:51:22.742434+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:36.598670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.736887+0000","last_change":"2024-09-12T02:51:22.734272+0000","last_active":"2024-09-12T02:51:22.736887+0000","last_peered":"2024-09-12T02:51:22.736887+0000","last_clean":"2024-09-12T02:51:22.736887+0000","last_became_active":"2024-09-12T02:51:22.734043+0000","last_became_peered":"2024-09-12T02:51:22.734043+0000","last_unstale":"2024-09-12T02:51:22.736887+0000","last_undegraded":"2024-09-12T02:51:22.736887+0000","last_fullsized":"2024-09-12T02:51:22.736887+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:36.906391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.741483+0000","last_change":"2024-09-12T02:51:22.741262+0000","last_active":"2024-09-12T02:51:22.741483+0000","last_peered":"2024-09-12T02:51:22.741483+0000","last_clean":"2024-09-12T02:51:22.741483+0000","last_became_active":"2024-09-12T02:51:22.741035+0000","last_became_peered":"2024-09-12T02:51:22.741035+0000","last_unstale":"2024-09-12T02:51:22.741483+0000","last_undegraded":"2024-09-12T02:51:22.741483+0000","last_fullsized":"2024-09-12T02:51:22.741483+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:52.169330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.738392+0000","last_change":"2024-09-12T02:51:22.738210+0000","last_active":"2024-09-12T02:51:22.738392+0000","last_peered":"2024-09-12T02:51:22.738392+0000","last_clean":"2024-09-12T02:51:22.738392+0000","last_became_active":"2024-09-12T02:51:22.737826+0000","last_became_peered":"2024-09-12T02:51:22.737826+0000","last_unstale":"2024-09-12T02:51:22.738392+0000","last_undegraded":"2024-09-12T02:51:22.738392+0000","last_fullsized":"2024-09-12T02:51:22.738392+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:04.860419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.745321+0000","last_change":"2024-09-12T02:51:22.744873+0000","last_active":"2024-09-12T02:51:22.745321+0000","last_peered":"2024-09-12T02:51:22.745321+0000","last_clean":"2024-09-12T02:51:22.745321+0000","last_became_active":"2024-09-12T02:51:22.742528+0000","last_became_peered":"2024-09-12T02:51:22.742528+0000","last_unstale":"2024-09-12T02:51:22.745321+0000","last_undegraded":"2024-09-12T02:51:22.745321+0000","last_fullsized":"2024-09-12T02:51:22.745321+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:21:29.592487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.737779+0000","last_change":"2024-09-12T02:51:22.735858+0000","last_active":"2024-09-12T02:51:22.737779+0000","last_peered":"2024-09-12T02:51:22.737779+0000","last_clean":"2024-09-12T02:51:22.737779+0000","last_became_active":"2024-09-12T02:51:22.735619+0000","last_became_peered":"2024-09-12T02:51:22.735619+0000","last_unstale":"2024-09-12T02:51:22.737779+0000","last_undegraded":"2024-09-12T02:51:22.737779+0000","last_fullsized":"2024-09-12T02:51:22.737779+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:18.896403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.739890+0000","last_change":"2024-09-12T02:51:22.739331+0000","last_active":"2024-09-12T02:51:22.739890+0000","last_peered":"2024-09-12T02:51:22.739890+0000","last_clean":"2024-09-12T02:51:22.739890+0000","last_became_active":"2024-09-12T02:51:22.738940+0000","last_became_peered":"2024-09-12T02:51:22.738940+0000","last_unstale":"2024-09-12T02:51:22.739890+0000","last_undegraded":"2024-09-12T02:51:22.739890+0000","last_fullsized":"2024-09-12T02:51:22.739890+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:01.774549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.750223+0000","last_change":"2024-09-12T02:51:22.749400+0000","last_active":"2024-09-12T02:51:22.750223+0000","last_peered":"2024-09-12T02:51:22.750223+0000","last_clean":"2024-09-12T02:51:22.750223+0000","last_became_active":"2024-09-12T02:51:22.749157+0000","last_became_peered":"2024-09-12T02:51:22.749157+0000","last_unstale":"2024-09-12T02:51:22.750223+0000","last_undegraded":"2024-09-12T02:51:22.750223+0000","last_fullsized":"2024-09-12T02:51:22.750223+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:44.250345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"166'4","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.755164+0000","last_change":"2024-09-12T02:51:21.742354+0000","last_active":"2024-09-12T02:51:22.755164+0000","last_peered":"2024-09-12T02:51:22.755164+0000","last_clean":"2024-09-12T02:51:22.755164+0000","last_became_active":"2024-09-12T02:51:21.742094+0000","last_became_peered":"2024-09-12T02:51:21.742094+0000","last_unstale":"2024-09-12T02:51:22.755164+0000","last_undegraded":"2024-09-12T02:51:22.755164+0000","last_fullsized":"2024-09-12T02:51:22.755164+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:53.030653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.737758+0000","last_change":"2024-09-12T02:51:22.735774+0000","last_active":"2024-09-12T02:51:22.737758+0000","last_peered":"2024-09-12T02:51:22.737758+0000","last_clean":"2024-09-12T02:51:22.737758+0000","last_became_active":"2024-09-12T02:51:22.735256+0000","last_became_peered":"2024-09-12T02:51:22.735256+0000","last_unstale":"2024-09-12T02:51:22.737758+0000","last_undegraded":"2024-09-12T02:51:22.737758+0000","last_fullsized":"2024-09-12T02:51:22.737758+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:47.969280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"166'1","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.756354+0000","last_change":"2024-09-12T02:51:21.743439+0000","last_active":"2024-09-12T02:51:22.756354+0000","last_peered":"2024-09-12T02:51:22.756354+0000","last_clean":"2024-09-12T02:51:22.756354+0000","last_became_active":"2024-09-12T02:51:21.742966+0000","last_became_peered":"2024-09-12T02:51:21.742966+0000","last_unstale":"2024-09-12T02:51:22.756354+0000","last_undegraded":"2024-09-12T02:51:22.756354+0000","last_fullsized":"2024-09-12T02:51:22.756354+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:30.836636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.748959+0000","last_change":"2024-09-12T02:51:22.748541+0000","last_active":"2024-09-12T02:51:22.748959+0000","last_peered":"2024-09-12T02:51:22.748959+0000","last_clean":"2024-09-12T02:51:22.748959+0000","last_became_active":"2024-09-12T02:51:22.747922+0000","last_became_peered":"2024-09-12T02:51:22.747922+0000","last_unstale":"2024-09-12T02:51:22.748959+0000","last_undegraded":"2024-09-12T02:51:22.748959+0000","last_fullsized":"2024-09-12T02:51:22.748959+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:13.457839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"166'2","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.751971+0000","last_change":"2024-09-12T02:51:21.734775+0000","last_active":"2024-09-12T02:51:22.751971+0000","last_peered":"2024-09-12T02:51:22.751971+0000","last_clean":"2024-09-12T02:51:22.751971+0000","last_became_active":"2024-09-12T02:51:21.734558+0000","last_became_peered":"2024-09-12T02:51:21.734558+0000","last_unstale":"2024-09-12T02:51:22.751971+0000","last_undegraded":"2024-09-12T02:51:22.751971+0000","last_fullsized":"2024-09-12T02:51:22.751971+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:03.097639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.754024+0000","last_change":"2024-09-12T02:51:22.753151+0000","last_active":"2024-09-12T02:51:22.754024+0000","last_peered":"2024-09-12T02:51:22.754024+0000","last_clean":"2024-09-12T02:51:22.754024+0000","last_became_active":"2024-09-12T02:51:22.752754+0000","last_became_peered":"2024-09-12T02:51:22.752754+0000","last_unstale":"2024-09-12T02:51:22.754024+0000","last_undegraded":"2024-09-12T02:51:22.754024+0000","last_fullsized":"2024-09-12T02:51:22.754024+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:15.100008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"166'2","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.752030+0000","last_change":"2024-09-12T02:51:21.738570+0000","last_active":"2024-09-12T02:51:22.752030+0000","last_peered":"2024-09-12T02:51:22.752030+0000","last_clean":"2024-09-12T02:51:22.752030+0000","last_became_active":"2024-09-12T02:51:21.738237+0000","last_became_peered":"2024-09-12T02:51:21.738237+0000","last_unstale":"2024-09-12T02:51:22.752030+0000","last_undegraded":"2024-09-12T02:51:22.752030+0000","last_fullsized":"2024-09-12T02:51:22.752030+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:38.793426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.738122+0000","last_change":"2024-09-12T02:51:22.737878+0000","last_active":"2024-09-12T02:51:22.738122+0000","last_peered":"2024-09-12T02:51:22.738122+0000","last_clean":"2024-09-12T02:51:22.738122+0000","last_became_active":"2024-09-12T02:51:22.735541+0000","last_became_peered":"2024-09-12T02:51:22.735541+0000","last_unstale":"2024-09-12T02:51:22.738122+0000","last_undegraded":"2024-09-12T02:51:22.738122+0000","last_fullsized":"2024-09-12T02:51:22.738122+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:23.945369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"166'1","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.754104+0000","last_change":"2024-09-12T02:51:21.744912+0000","last_active":"2024-09-12T02:51:22.754104+0000","last_peered":"2024-09-12T02:51:22.754104+0000","last_clean":"2024-09-12T02:51:22.754104+0000","last_became_active":"2024-09-12T02:51:21.744676+0000","last_became_peered":"2024-09-12T02:51:21.744676+0000","last_unstale":"2024-09-12T02:51:22.754104+0000","last_undegraded":"2024-09-12T02:51:22.754104+0000","last_fullsized":"2024-09-12T02:51:22.754104+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:04.662459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.753008+0000","last_change":"2024-09-12T02:51:22.752853+0000","last_active":"2024-09-12T02:51:22.753008+0000","last_peered":"2024-09-12T02:51:22.753008+0000","last_clean":"2024-09-12T02:51:22.753008+0000","last_became_active":"2024-09-12T02:51:22.752544+0000","last_became_peered":"2024-09-12T02:51:22.752544+0000","last_unstale":"2024-09-12T02:51:22.753008+0000","last_undegraded":"2024-09-12T02:51:22.753008+0000","last_fullsized":"2024-09-12T02:51:22.753008+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:28.973669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"166'1","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.755591+0000","last_change":"2024-09-12T02:51:21.740404+0000","last_active":"2024-09-12T02:51:22.755591+0000","last_peered":"2024-09-12T02:51:22.755591+0000","last_clean":"2024-09-12T02:51:22.755591+0000","last_became_active":"2024-09-12T02:51:21.740179+0000","last_became_peered":"2024-09-12T02:51:21.740179+0000","last_unstale":"2024-09-12T02:51:22.755591+0000","last_undegraded":"2024-09-12T02:51:22.755591+0000","last_fullsized":"2024-09-12T02:51:22.755591+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:12.209372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.734785+0000","last_change":"2024-09-12T02:51:22.734510+0000","last_active":"2024-09-12T02:51:22.734785+0000","last_peered":"2024-09-12T02:51:22.734785+0000","last_clean":"2024-09-12T02:51:22.734785+0000","last_became_active":"2024-09-12T02:51:22.734264+0000","last_became_peered":"2024-09-12T02:51:22.734264+0000","last_unstale":"2024-09-12T02:51:22.734785+0000","last_undegraded":"2024-09-12T02:51:22.734785+0000","last_fullsized":"2024-09-12T02:51:22.734785+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:49.592751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.730009+0000","last_change":"2024-09-12T02:51:21.742116+0000","last_active":"2024-09-12T02:51:22.730009+0000","last_peered":"2024-09-12T02:51:22.730009+0000","last_clean":"2024-09-12T02:51:22.730009+0000","last_became_active":"2024-09-12T02:51:21.741848+0000","last_became_peered":"2024-09-12T02:51:21.741848+0000","last_unstale":"2024-09-12T02:51:22.730009+0000","last_undegraded":"2024-09-12T02:51:22.730009+0000","last_fullsized":"2024-09-12T02:51:22.730009+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:17.913672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.737198+0000","last_change":"2024-09-12T02:51:22.737071+0000","last_active":"2024-09-12T02:51:22.737198+0000","last_peered":"2024-09-12T02:51:22.737198+0000","last_clean":"2024-09-12T02:51:22.737198+0000","last_became_active":"2024-09-12T02:51:22.736828+0000","last_became_peered":"2024-09-12T02:51:22.736828+0000","last_unstale":"2024-09-12T02:51:22.737198+0000","last_undegraded":"2024-09-12T02:51:22.737198+0000","last_fullsized":"2024-09-12T02:51:22.737198+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:54.950490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.741216+0000","last_change":"2024-09-12T02:51:21.743164+0000","last_active":"2024-09-12T02:51:22.741216+0000","last_peered":"2024-09-12T02:51:22.741216+0000","last_clean":"2024-09-12T02:51:22.741216+0000","last_became_active":"2024-09-12T02:51:21.742813+0000","last_became_peered":"2024-09-12T02:51:21.742813+0000","last_unstale":"2024-09-12T02:51:22.741216+0000","last_undegraded":"2024-09-12T02:51:22.741216+0000","last_fullsized":"2024-09-12T02:51:22.741216+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:30.944009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.742614+0000","last_change":"2024-09-12T02:51:22.740587+0000","last_active":"2024-09-12T02:51:22.742614+0000","last_peered":"2024-09-12T02:51:22.742614+0000","last_clean":"2024-09-12T02:51:22.742614+0000","last_became_active":"2024-09-12T02:51:22.740270+0000","last_became_peered":"2024-09-12T02:51:22.740270+0000","last_unstale":"2024-09-12T02:51:22.742614+0000","last_undegraded":"2024-09-12T02:51:22.742614+0000","last_fullsized":"2024-09-12T02:51:22.742614+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:27.957464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.730668+0000","last_change":"2024-09-12T02:51:21.739041+0000","last_active":"2024-09-12T02:51:22.730668+0000","last_peered":"2024-09-12T02:51:22.730668+0000","last_clean":"2024-09-12T02:51:22.730668+0000","last_became_active":"2024-09-12T02:51:21.738820+0000","last_became_peered":"2024-09-12T02:51:21.738820+0000","last_unstale":"2024-09-12T02:51:22.730668+0000","last_undegraded":"2024-09-12T02:51:22.730668+0000","last_fullsized":"2024-09-12T02:51:22.730668+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:16.030919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.746513+0000","last_change":"2024-09-12T02:51:22.745529+0000","last_active":"2024-09-12T02:51:22.746513+0000","last_peered":"2024-09-12T02:51:22.746513+0000","last_clean":"2024-09-12T02:51:22.746513+0000","last_became_active":"2024-09-12T02:51:22.745254+0000","last_became_peered":"2024-09-12T02:51:22.745254+0000","last_unstale":"2024-09-12T02:51:22.746513+0000","last_undegraded":"2024-09-12T02:51:22.746513+0000","last_fullsized":"2024-09-12T02:51:22.746513+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:45.449379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.736966+0000","last_change":"2024-09-12T02:51:21.743351+0000","last_active":"2024-09-12T02:51:22.736966+0000","last_peered":"2024-09-12T02:51:22.736966+0000","last_clean":"2024-09-12T02:51:22.736966+0000","last_became_active":"2024-09-12T02:51:21.742742+0000","last_became_peered":"2024-09-12T02:51:21.742742+0000","last_unstale":"2024-09-12T02:51:22.736966+0000","last_undegraded":"2024-09-12T02:51:22.736966+0000","last_fullsized":"2024-09-12T02:51:22.736966+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:14.574850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.736932+0000","last_change":"2024-09-12T02:51:22.736786+0000","last_active":"2024-09-12T02:51:22.736932+0000","last_peered":"2024-09-12T02:51:22.736932+0000","last_clean":"2024-09-12T02:51:22.736932+0000","last_became_active":"2024-09-12T02:51:22.736573+0000","last_became_peered":"2024-09-12T02:51:22.736573+0000","last_unstale":"2024-09-12T02:51:22.736932+0000","last_undegraded":"2024-09-12T02:51:22.736932+0000","last_fullsized":"2024-09-12T02:51:22.736932+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:59.408393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"166'6","reported_seq":18,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.756614+0000","last_change":"2024-09-12T02:51:21.733087+0000","last_active":"2024-09-12T02:51:22.756614+0000","last_peered":"2024-09-12T02:51:22.756614+0000","last_clean":"2024-09-12T02:51:22.756614+0000","last_became_active":"2024-09-12T02:51:21.732848+0000","last_became_peered":"2024-09-12T02:51:21.732848+0000","last_unstale":"2024-09-12T02:51:22.756614+0000","last_undegraded":"2024-09-12T02:51:22.756614+0000","last_fullsized":"2024-09-12T02:51:22.756614+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:40.623330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.748659+0000","last_change":"2024-09-12T02:51:22.748035+0000","last_active":"2024-09-12T02:51:22.748659+0000","last_peered":"2024-09-12T02:51:22.748659+0000","last_clean":"2024-09-12T02:51:22.748659+0000","last_became_active":"2024-09-12T02:51:22.747567+0000","last_became_peered":"2024-09-12T02:51:22.747567+0000","last_unstale":"2024-09-12T02:51:22.748659+0000","last_undegraded":"2024-09-12T02:51:22.748659+0000","last_fullsized":"2024-09-12T02:51:22.748659+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:09.212624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"166'2","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.755258+0000","last_change":"2024-09-12T02:51:21.737603+0000","last_active":"2024-09-12T02:51:22.755258+0000","last_peered":"2024-09-12T02:51:22.755258+0000","last_clean":"2024-09-12T02:51:22.755258+0000","last_became_active":"2024-09-12T02:51:21.737350+0000","last_became_peered":"2024-09-12T02:51:21.737350+0000","last_unstale":"2024-09-12T02:51:22.755258+0000","last_undegraded":"2024-09-12T02:51:22.755258+0000","last_fullsized":"2024-09-12T02:51:22.755258+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:43.341728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.737796+0000","last_change":"2024-09-12T02:51:22.736738+0000","last_active":"2024-09-12T02:51:22.737796+0000","last_peered":"2024-09-12T02:51:22.737796+0000","last_clean":"2024-09-12T02:51:22.737796+0000","last_became_active":"2024-09-12T02:51:22.736542+0000","last_became_peered":"2024-09-12T02:51:22.736542+0000","last_unstale":"2024-09-12T02:51:22.737796+0000","last_undegraded":"2024-09-12T02:51:22.737796+0000","last_fullsized":"2024-09-12T02:51:22.737796+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:06.426446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.732118+0000","last_change":"2024-09-12T02:51:21.738275+0000","last_active":"2024-09-12T02:51:22.732118+0000","last_peered":"2024-09-12T02:51:22.732118+0000","last_clean":"2024-09-12T02:51:22.732118+0000","last_became_active":"2024-09-12T02:51:21.737252+0000","last_became_peered":"2024-09-12T02:51:21.737252+0000","last_unstale":"2024-09-12T02:51:22.732118+0000","last_undegraded":"2024-09-12T02:51:22.732118+0000","last_fullsized":"2024-09-12T02:51:22.732118+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:18.594108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.753913+0000","last_change":"2024-09-12T02:51:22.751595+0000","last_active":"2024-09-12T02:51:22.753913+0000","last_peered":"2024-09-12T02:51:22.753913+0000","last_clean":"2024-09-12T02:51:22.753913+0000","last_became_active":"2024-09-12T02:51:22.750869+0000","last_became_peered":"2024-09-12T02:51:22.750869+0000","last_unstale":"2024-09-12T02:51:22.753913+0000","last_undegraded":"2024-09-12T02:51:22.753913+0000","last_fullsized":"2024-09-12T02:51:22.753913+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:44.770738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.732611+0000","last_change":"2024-09-12T02:51:21.735079+0000","last_active":"2024-09-12T02:51:22.732611+0000","last_peered":"2024-09-12T02:51:22.732611+0000","last_clean":"2024-09-12T02:51:22.732611+0000","last_became_active":"2024-09-12T02:51:21.734844+0000","last_became_peered":"2024-09-12T02:51:21.734844+0000","last_unstale":"2024-09-12T02:51:22.732611+0000","last_undegraded":"2024-09-12T02:51:22.732611+0000","last_fullsized":"2024-09-12T02:51:22.732611+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:35.447583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.734008+0000","last_change":"2024-09-12T02:51:22.733866+0000","last_active":"2024-09-12T02:51:22.734008+0000","last_peered":"2024-09-12T02:51:22.734008+0000","last_clean":"2024-09-12T02:51:22.734008+0000","last_became_active":"2024-09-12T02:51:22.733591+0000","last_became_peered":"2024-09-12T02:51:22.733591+0000","last_unstale":"2024-09-12T02:51:22.734008+0000","last_undegraded":"2024-09-12T02:51:22.734008+0000","last_fullsized":"2024-09-12T02:51:22.734008+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:44.102074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"166'8","reported_seq":20,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.754319+0000","last_change":"2024-09-12T02:51:21.740295+0000","last_active":"2024-09-12T02:51:22.754319+0000","last_peered":"2024-09-12T02:51:22.754319+0000","last_clean":"2024-09-12T02:51:22.754319+0000","last_became_active":"2024-09-12T02:51:21.740028+0000","last_became_peered":"2024-09-12T02:51:21.740028+0000","last_unstale":"2024-09-12T02:51:22.754319+0000","last_undegraded":"2024-09-12T02:51:22.754319+0000","last_fullsized":"2024-09-12T02:51:22.754319+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:42.167339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.753293+0000","last_change":"2024-09-12T02:51:22.747977+0000","last_active":"2024-09-12T02:51:22.753293+0000","last_peered":"2024-09-12T02:51:22.753293+0000","last_clean":"2024-09-12T02:51:22.753293+0000","last_became_active":"2024-09-12T02:51:22.747398+0000","last_became_peered":"2024-09-12T02:51:22.747398+0000","last_unstale":"2024-09-12T02:51:22.753293+0000","last_undegraded":"2024-09-12T02:51:22.753293+0000","last_fullsized":"2024-09-12T02:51:22.753293+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:00.631907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"166'1","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.749716+0000","last_change":"2024-09-12T02:51:21.733015+0000","last_active":"2024-09-12T02:51:22.749716+0000","last_peered":"2024-09-12T02:51:22.749716+0000","last_clean":"2024-09-12T02:51:22.749716+0000","last_became_active":"2024-09-12T02:51:21.732765+0000","last_became_peered":"2024-09-12T02:51:21.732765+0000","last_unstale":"2024-09-12T02:51:22.749716+0000","last_undegraded":"2024-09-12T02:51:22.749716+0000","last_fullsized":"2024-09-12T02:51:22.749716+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:24:19.441869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.740824+0000","last_change":"2024-09-12T02:51:22.740391+0000","last_active":"2024-09-12T02:51:22.740824+0000","last_peered":"2024-09-12T02:51:22.740824+0000","last_clean":"2024-09-12T02:51:22.740824+0000","last_became_active":"2024-09-12T02:51:22.740101+0000","last_became_peered":"2024-09-12T02:51:22.740101+0000","last_unstale":"2024-09-12T02:51:22.740824+0000","last_undegraded":"2024-09-12T02:51:22.740824+0000","last_fullsized":"2024-09-12T02:51:22.740824+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:36.989673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"166'2","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.756638+0000","last_change":"2024-09-12T02:51:21.733787+0000","last_active":"2024-09-12T02:51:22.756638+0000","last_peered":"2024-09-12T02:51:22.756638+0000","last_clean":"2024-09-12T02:51:22.756638+0000","last_became_active":"2024-09-12T02:51:21.733554+0000","last_became_peered":"2024-09-12T02:51:21.733554+0000","last_unstale":"2024-09-12T02:51:22.756638+0000","last_undegraded":"2024-09-12T02:51:22.756638+0000","last_fullsized":"2024-09-12T02:51:22.756638+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:18.803641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.750439+0000","last_change":"2024-09-12T02:51:22.750098+0000","last_active":"2024-09-12T02:51:22.750439+0000","last_peered":"2024-09-12T02:51:22.750439+0000","last_clean":"2024-09-12T02:51:22.750439+0000","last_became_active":"2024-09-12T02:51:22.749339+0000","last_became_peered":"2024-09-12T02:51:22.749339+0000","last_unstale":"2024-09-12T02:51:22.750439+0000","last_undegraded":"2024-09-12T02:51:22.750439+0000","last_fullsized":"2024-09-12T02:51:22.750439+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:59.069522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"166'1","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.754170+0000","last_change":"2024-09-12T02:51:21.743230+0000","last_active":"2024-09-12T02:51:22.754170+0000","last_peered":"2024-09-12T02:51:22.754170+0000","last_clean":"2024-09-12T02:51:22.754170+0000","last_became_active":"2024-09-12T02:51:21.743003+0000","last_became_peered":"2024-09-12T02:51:21.743003+0000","last_unstale":"2024-09-12T02:51:22.754170+0000","last_undegraded":"2024-09-12T02:51:22.754170+0000","last_fullsized":"2024-09-12T02:51:22.754170+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:43.408794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.747466+0000","last_change":"2024-09-12T02:51:22.747028+0000","last_active":"2024-09-12T02:51:22.747466+0000","last_peered":"2024-09-12T02:51:22.747466+0000","last_clean":"2024-09-12T02:51:22.747466+0000","last_became_active":"2024-09-12T02:51:22.746492+0000","last_became_peered":"2024-09-12T02:51:22.746492+0000","last_unstale":"2024-09-12T02:51:22.747466+0000","last_undegraded":"2024-09-12T02:51:22.747466+0000","last_fullsized":"2024-09-12T02:51:22.747466+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:56.147361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.729536+0000","last_change":"2024-09-12T02:51:21.735473+0000","last_active":"2024-09-12T02:51:22.729536+0000","last_peered":"2024-09-12T02:51:22.729536+0000","last_clean":"2024-09-12T02:51:22.729536+0000","last_became_active":"2024-09-12T02:51:21.735261+0000","last_became_peered":"2024-09-12T02:51:21.735261+0000","last_unstale":"2024-09-12T02:51:22.729536+0000","last_undegraded":"2024-09-12T02:51:22.729536+0000","last_fullsized":"2024-09-12T02:51:22.729536+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:00.942387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.744184+0000","last_change":"2024-09-12T02:51:22.743309+0000","last_active":"2024-09-12T02:51:22.744184+0000","last_peered":"2024-09-12T02:51:22.744184+0000","last_clean":"2024-09-12T02:51:22.744184+0000","last_became_active":"2024-09-12T02:51:22.741965+0000","last_became_peered":"2024-09-12T02:51:22.741965+0000","last_unstale":"2024-09-12T02:51:22.744184+0000","last_undegraded":"2024-09-12T02:51:22.744184+0000","last_fullsized":"2024-09-12T02:51:22.744184+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:44.188170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"166'2","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.752798+0000","last_change":"2024-09-12T02:51:21.734112+0000","last_active":"2024-09-12T02:51:22.752798+0000","last_peered":"2024-09-12T02:51:22.752798+0000","last_clean":"2024-09-12T02:51:22.752798+0000","last_became_active":"2024-09-12T02:51:21.733575+0000","last_became_peered":"2024-09-12T02:51:21.733575+0000","last_unstale":"2024-09-12T02:51:22.752798+0000","last_undegraded":"2024-09-12T02:51:22.752798+0000","last_fullsized":"2024-09-12T02:51:22.752798+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:33:12.350357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.742837+0000","last_change":"2024-09-12T02:51:22.742509+0000","last_active":"2024-09-12T02:51:22.742837+0000","last_peered":"2024-09-12T02:51:22.742837+0000","last_clean":"2024-09-12T02:51:22.742837+0000","last_became_active":"2024-09-12T02:51:22.742156+0000","last_became_peered":"2024-09-12T02:51:22.742156+0000","last_unstale":"2024-09-12T02:51:22.742837+0000","last_undegraded":"2024-09-12T02:51:22.742837+0000","last_fullsized":"2024-09-12T02:51:22.742837+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:13:28.713422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.737655+0000","last_change":"2024-09-12T02:51:21.743773+0000","last_active":"2024-09-12T02:51:22.737655+0000","last_peered":"2024-09-12T02:51:22.737655+0000","last_clean":"2024-09-12T02:51:22.737655+0000","last_became_active":"2024-09-12T02:51:21.743517+0000","last_became_peered":"2024-09-12T02:51:21.743517+0000","last_unstale":"2024-09-12T02:51:22.737655+0000","last_undegraded":"2024-09-12T02:51:22.737655+0000","last_fullsized":"2024-09-12T02:51:22.737655+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:47.084317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.747569+0000","last_change":"2024-09-12T02:51:22.747281+0000","last_active":"2024-09-12T02:51:22.747569+0000","last_peered":"2024-09-12T02:51:22.747569+0000","last_clean":"2024-09-12T02:51:22.747569+0000","last_became_active":"2024-09-12T02:51:22.746406+0000","last_became_peered":"2024-09-12T02:51:22.746406+0000","last_unstale":"2024-09-12T02:51:22.747569+0000","last_undegraded":"2024-09-12T02:51:22.747569+0000","last_fullsized":"2024-09-12T02:51:22.747569+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:56.773389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.739683+0000","last_change":"2024-09-12T02:51:21.742382+0000","last_active":"2024-09-12T02:51:22.739683+0000","last_peered":"2024-09-12T02:51:22.739683+0000","last_clean":"2024-09-12T02:51:22.739683+0000","last_became_active":"2024-09-12T02:51:21.742105+0000","last_became_peered":"2024-09-12T02:51:21.742105+0000","last_unstale":"2024-09-12T02:51:22.739683+0000","last_undegraded":"2024-09-12T02:51:22.739683+0000","last_fullsized":"2024-09-12T02:51:22.739683+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:44.315012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.745313+0000","last_change":"2024-09-12T02:51:22.745218+0000","last_active":"2024-09-12T02:51:22.745313+0000","last_peered":"2024-09-12T02:51:22.745313+0000","last_clean":"2024-09-12T02:51:22.745313+0000","last_became_active":"2024-09-12T02:51:22.744961+0000","last_became_peered":"2024-09-12T02:51:22.744961+0000","last_unstale":"2024-09-12T02:51:22.745313+0000","last_undegraded":"2024-09-12T02:51:22.745313+0000","last_fullsized":"2024-09-12T02:51:22.745313+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:38.107877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.732269+0000","last_change":"2024-09-12T02:51:21.735391+0000","last_active":"2024-09-12T02:51:22.732269+0000","last_peered":"2024-09-12T02:51:22.732269+0000","last_clean":"2024-09-12T02:51:22.732269+0000","last_became_active":"2024-09-12T02:51:21.735150+0000","last_became_peered":"2024-09-12T02:51:21.735150+0000","last_unstale":"2024-09-12T02:51:22.732269+0000","last_undegraded":"2024-09-12T02:51:22.732269+0000","last_fullsized":"2024-09-12T02:51:22.732269+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:51.367441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.753895+0000","last_change":"2024-09-12T02:51:22.751415+0000","last_active":"2024-09-12T02:51:22.753895+0000","last_peered":"2024-09-12T02:51:22.753895+0000","last_clean":"2024-09-12T02:51:22.753895+0000","last_became_active":"2024-09-12T02:51:22.750331+0000","last_became_peered":"2024-09-12T02:51:22.750331+0000","last_unstale":"2024-09-12T02:51:22.753895+0000","last_undegraded":"2024-09-12T02:51:22.753895+0000","last_fullsized":"2024-09-12T02:51:22.753895+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:00.985948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"166'2","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.753917+0000","last_change":"2024-09-12T02:51:21.744981+0000","last_active":"2024-09-12T02:51:22.753917+0000","last_peered":"2024-09-12T02:51:22.753917+0000","last_clean":"2024-09-12T02:51:22.753917+0000","last_became_active":"2024-09-12T02:51:21.744399+0000","last_became_peered":"2024-09-12T02:51:21.744399+0000","last_unstale":"2024-09-12T02:51:22.753917+0000","last_undegraded":"2024-09-12T02:51:22.753917+0000","last_fullsized":"2024-09-12T02:51:22.753917+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:47.474752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.749993+0000","last_change":"2024-09-12T02:51:22.749864+0000","last_active":"2024-09-12T02:51:22.749993+0000","last_peered":"2024-09-12T02:51:22.749993+0000","last_clean":"2024-09-12T02:51:22.749993+0000","last_became_active":"2024-09-12T02:51:22.748120+0000","last_became_peered":"2024-09-12T02:51:22.748120+0000","last_unstale":"2024-09-12T02:51:22.749993+0000","last_undegraded":"2024-09-12T02:51:22.749993+0000","last_fullsized":"2024-09-12T02:51:22.749993+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:02:05.188825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.734926+0000","last_change":"2024-09-12T02:51:21.742260+0000","last_active":"2024-09-12T02:51:22.734926+0000","last_peered":"2024-09-12T02:51:22.734926+0000","last_clean":"2024-09-12T02:51:22.734926+0000","last_became_active":"2024-09-12T02:51:21.742005+0000","last_became_peered":"2024-09-12T02:51:21.742005+0000","last_unstale":"2024-09-12T02:51:22.734926+0000","last_undegraded":"2024-09-12T02:51:22.734926+0000","last_fullsized":"2024-09-12T02:51:22.734926+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:39.836642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.743896+0000","last_change":"2024-09-12T02:51:22.742956+0000","last_active":"2024-09-12T02:51:22.743896+0000","last_peered":"2024-09-12T02:51:22.743896+0000","last_clean":"2024-09-12T02:51:22.743896+0000","last_became_active":"2024-09-12T02:51:22.742683+0000","last_became_peered":"2024-09-12T02:51:22.742683+0000","last_unstale":"2024-09-12T02:51:22.743896+0000","last_undegraded":"2024-09-12T02:51:22.743896+0000","last_fullsized":"2024-09-12T02:51:22.743896+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:41.001812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.734380+0000","last_change":"2024-09-12T02:51:21.739875+0000","last_active":"2024-09-12T02:51:22.734380+0000","last_peered":"2024-09-12T02:51:22.734380+0000","last_clean":"2024-09-12T02:51:22.734380+0000","last_became_active":"2024-09-12T02:51:21.738887+0000","last_became_peered":"2024-09-12T02:51:21.738887+0000","last_unstale":"2024-09-12T02:51:22.734380+0000","last_undegraded":"2024-09-12T02:51:22.734380+0000","last_fullsized":"2024-09-12T02:51:22.734380+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:15:08.067753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.745425+0000","last_change":"2024-09-12T02:51:22.745312+0000","last_active":"2024-09-12T02:51:22.745425+0000","last_peered":"2024-09-12T02:51:22.745425+0000","last_clean":"2024-09-12T02:51:22.745425+0000","last_became_active":"2024-09-12T02:51:22.744218+0000","last_became_peered":"2024-09-12T02:51:22.744218+0000","last_unstale":"2024-09-12T02:51:22.745425+0000","last_undegraded":"2024-09-12T02:51:22.745425+0000","last_fullsized":"2024-09-12T02:51:22.745425+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:38.573915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.733094+0000","last_change":"2024-09-12T02:51:21.738717+0000","last_active":"2024-09-12T02:51:22.733094+0000","last_peered":"2024-09-12T02:51:22.733094+0000","last_clean":"2024-09-12T02:51:22.733094+0000","last_became_active":"2024-09-12T02:51:21.738397+0000","last_became_peered":"2024-09-12T02:51:21.738397+0000","last_unstale":"2024-09-12T02:51:22.733094+0000","last_undegraded":"2024-09-12T02:51:22.733094+0000","last_fullsized":"2024-09-12T02:51:22.733094+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:24.230127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.745138+0000","last_change":"2024-09-12T02:51:22.744989+0000","last_active":"2024-09-12T02:51:22.745138+0000","last_peered":"2024-09-12T02:51:22.745138+0000","last_clean":"2024-09-12T02:51:22.745138+0000","last_became_active":"2024-09-12T02:51:22.744759+0000","last_became_peered":"2024-09-12T02:51:22.744759+0000","last_unstale":"2024-09-12T02:51:22.745138+0000","last_undegraded":"2024-09-12T02:51:22.745138+0000","last_fullsized":"2024-09-12T02:51:22.745138+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:37.346007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.732888+0000","last_change":"2024-09-12T02:51:21.732325+0000","last_active":"2024-09-12T02:51:22.732888+0000","last_peered":"2024-09-12T02:51:22.732888+0000","last_clean":"2024-09-12T02:51:22.732888+0000","last_became_active":"2024-09-12T02:51:21.732084+0000","last_became_peered":"2024-09-12T02:51:21.732084+0000","last_unstale":"2024-09-12T02:51:22.732888+0000","last_undegraded":"2024-09-12T02:51:22.732888+0000","last_fullsized":"2024-09-12T02:51:22.732888+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:27.555314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.742633+0000","last_change":"2024-09-12T02:51:22.742312+0000","last_active":"2024-09-12T02:51:22.742633+0000","last_peered":"2024-09-12T02:51:22.742633+0000","last_clean":"2024-09-12T02:51:22.742633+0000","last_became_active":"2024-09-12T02:51:22.742079+0000","last_became_peered":"2024-09-12T02:51:22.742079+0000","last_unstale":"2024-09-12T02:51:22.742633+0000","last_undegraded":"2024-09-12T02:51:22.742633+0000","last_fullsized":"2024-09-12T02:51:22.742633+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:34.624088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.743967+0000","last_change":"2024-09-12T02:51:21.745202+0000","last_active":"2024-09-12T02:51:22.743967+0000","last_peered":"2024-09-12T02:51:22.743967+0000","last_clean":"2024-09-12T02:51:22.743967+0000","last_became_active":"2024-09-12T02:51:21.744714+0000","last_became_peered":"2024-09-12T02:51:21.744714+0000","last_unstale":"2024-09-12T02:51:22.743967+0000","last_undegraded":"2024-09-12T02:51:22.743967+0000","last_fullsized":"2024-09-12T02:51:22.743967+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:34.143958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.750167+0000","last_change":"2024-09-12T02:51:22.747085+0000","last_active":"2024-09-12T02:51:22.750167+0000","last_peered":"2024-09-12T02:51:22.750167+0000","last_clean":"2024-09-12T02:51:22.750167+0000","last_became_active":"2024-09-12T02:51:22.742897+0000","last_became_peered":"2024-09-12T02:51:22.742897+0000","last_unstale":"2024-09-12T02:51:22.750167+0000","last_undegraded":"2024-09-12T02:51:22.750167+0000","last_fullsized":"2024-09-12T02:51:22.750167+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:50.707814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.730550+0000","last_change":"2024-09-12T02:51:21.738403+0000","last_active":"2024-09-12T02:51:22.730550+0000","last_peered":"2024-09-12T02:51:22.730550+0000","last_clean":"2024-09-12T02:51:22.730550+0000","last_became_active":"2024-09-12T02:51:21.737999+0000","last_became_peered":"2024-09-12T02:51:21.737999+0000","last_unstale":"2024-09-12T02:51:22.730550+0000","last_undegraded":"2024-09-12T02:51:22.730550+0000","last_fullsized":"2024-09-12T02:51:22.730550+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:23.754402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.753868+0000","last_change":"2024-09-12T02:51:22.750589+0000","last_active":"2024-09-12T02:51:22.753868+0000","last_peered":"2024-09-12T02:51:22.753868+0000","last_clean":"2024-09-12T02:51:22.753868+0000","last_became_active":"2024-09-12T02:51:22.744415+0000","last_became_peered":"2024-09-12T02:51:22.744415+0000","last_unstale":"2024-09-12T02:51:22.753868+0000","last_undegraded":"2024-09-12T02:51:22.753868+0000","last_fullsized":"2024-09-12T02:51:22.753868+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:59.718482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.730255+0000","last_change":"2024-09-12T02:51:21.743198+0000","last_active":"2024-09-12T02:51:22.730255+0000","last_peered":"2024-09-12T02:51:22.730255+0000","last_clean":"2024-09-12T02:51:22.730255+0000","last_became_active":"2024-09-12T02:51:21.742644+0000","last_became_peered":"2024-09-12T02:51:21.742644+0000","last_unstale":"2024-09-12T02:51:22.730255+0000","last_undegraded":"2024-09-12T02:51:22.730255+0000","last_fullsized":"2024-09-12T02:51:22.730255+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:18.462881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.743943+0000","last_change":"2024-09-12T02:51:22.743615+0000","last_active":"2024-09-12T02:51:22.743943+0000","last_peered":"2024-09-12T02:51:22.743943+0000","last_clean":"2024-09-12T02:51:22.743943+0000","last_became_active":"2024-09-12T02:51:22.743408+0000","last_became_peered":"2024-09-12T02:51:22.743408+0000","last_unstale":"2024-09-12T02:51:22.743943+0000","last_undegraded":"2024-09-12T02:51:22.743943+0000","last_fullsized":"2024-09-12T02:51:22.743943+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:53.928430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"166'3","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.755851+0000","last_change":"2024-09-12T02:51:21.735657+0000","last_active":"2024-09-12T02:51:22.755851+0000","last_peered":"2024-09-12T02:51:22.755851+0000","last_clean":"2024-09-12T02:51:22.755851+0000","last_became_active":"2024-09-12T02:51:21.734801+0000","last_became_peered":"2024-09-12T02:51:21.734801+0000","last_unstale":"2024-09-12T02:51:22.755851+0000","last_undegraded":"2024-09-12T02:51:22.755851+0000","last_fullsized":"2024-09-12T02:51:22.755851+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:03.307507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":450,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.737762+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:51:22.737762+0000","last_peered":"2024-09-12T02:51:22.737762+0000","last_clean":"2024-09-12T02:51:22.737762+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:51:22.737762+0000","last_undegraded":"2024-09-12T02:51:22.737762+0000","last_fullsized":"2024-09-12T02:51:22.737762+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:25.823876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574966,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1483,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193828,"statfs":{"total":200000000,"available":198480861,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":899,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194412,"statfs":{"total":200000000,"available":199078656,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":899,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194412,"statfs":{"total":200000000,"available":199078656,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574966,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":899,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194412,"statfs":{"total":200000000,"available":199078656,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574966,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":899,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194412,"statfs":{"total":200000000,"available":199078656,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574966,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":908,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194404,"statfs":{"total":200000000,"available":199070199,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574966,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":899,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194412,"statfs":{"total":200000000,"available":199078656,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574966,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1476,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193836,"statfs":{"total":200000000,"available":198488288,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:51:26.911 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:51:27.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.099+0000 7f4a21c00640 1 Processor -- start 2024-09-12T02:51:27.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.099+0000 7f4a21c00640 1 -- start start 2024-09-12T02:51:27.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.100+0000 7f4a21c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a1c0d28d0 0x7f4a1c0b2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:27.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.100+0000 7f4a21c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a1c0d2fb0 con 0x7f4a1c0b3e00 2024-09-12T02:51:27.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.100+0000 7f4a21c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a1c0d0b60 con 0x7f4a1c0d1710 2024-09-12T02:51:27.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.100+0000 7f4a21c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4a1c0d3cb0 con 0x7f4a1c0d28d0 2024-09-12T02:51:27.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.100+0000 7f4a1b400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f4a1c0b3e00 0x7f4a1c0b1d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52212/0 (socket says 172.21.15.112:52212) 2024-09-12T02:51:27.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.100+0000 7f4a1b400640 1 -- 172.21.15.112:0/2893980711 learned_addr learned my addr 172.21.15.112:0/2893980711 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:51:27.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.101+0000 7f4a21200640 1 --2- 172.21.15.112:0/2893980711 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a1c0d28d0 0x7f4a1c0b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:27.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.101+0000 7f4a1aa00640 1 -- 172.21.15.112:0/2893980711 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2728751920 0 0) 0x7f4a1c0d2fb0 con 0x7f4a1c0b3e00 2024-09-12T02:51:27.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.101+0000 7f4a1aa00640 1 -- 172.21.15.112:0/2893980711 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a00003520 con 0x7f4a1c0b3e00 2024-09-12T02:51:27.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.101+0000 7f4a1aa00640 1 -- 172.21.15.112:0/2893980711 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2145942109 0 0) 0x7f4a1c0d0b60 con 0x7f4a1c0d1710 2024-09-12T02:51:27.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.101+0000 7f4a1aa00640 1 -- 172.21.15.112:0/2893980711 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a1c0d2fb0 con 0x7f4a1c0d1710 2024-09-12T02:51:27.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.101+0000 7f4a1aa00640 1 -- 172.21.15.112:0/2893980711 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4142339254 0 0) 0x7f4a00003520 con 0x7f4a1c0b3e00 2024-09-12T02:51:27.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.101+0000 7f4a21200640 1 -- 172.21.15.112:0/2893980711 >> v1:172.21.15.137:6789/0 conn(0x7f4a1c0d1710 legacy=0x7f4a1c0d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:27.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.101+0000 7f4a21200640 1 -- 172.21.15.112:0/2893980711 >> v1:172.21.15.112:6789/0 conn(0x7f4a1c0b3e00 legacy=0x7f4a1c0b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:27.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.101+0000 7f4a21200640 1 -- 172.21.15.112:0/2893980711 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a1c0d3410 con 0x7f4a1c0d28d0 2024-09-12T02:51:27.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.102+0000 7f4a21200640 1 --2- 172.21.15.112:0/2893980711 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a1c0d28d0 0x7f4a1c0b2480 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4a14009dc0 tx=0x7f4a1402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5044be56617dc3e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:27.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.103+0000 7f4a1aa00640 1 -- 172.21.15.112:0/2893980711 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a08001670 con 0x7f4a1c0d28d0 2024-09-12T02:51:27.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.103+0000 7f4a1aa00640 1 -- 172.21.15.112:0/2893980711 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a14007540 con 0x7f4a1c0d28d0 2024-09-12T02:51:27.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.103+0000 7f4a1aa00640 1 -- 172.21.15.112:0/2893980711 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a140078f0 con 0x7f4a1c0d28d0 2024-09-12T02:51:27.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.103+0000 7f4a21c00640 1 -- 172.21.15.112:0/2893980711 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a1c0d28d0 msgr2=0x7f4a1c0b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:27.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.103+0000 7f4a21c00640 1 --2- 172.21.15.112:0/2893980711 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a1c0d28d0 0x7f4a1c0b2480 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4a14009dc0 tx=0x7f4a1402a660 comp rx=0 tx=0).stop 2024-09-12T02:51:27.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.103+0000 7f4a21c00640 1 -- 172.21.15.112:0/2893980711 shutdown_connections 2024-09-12T02:51:27.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.103+0000 7f4a21c00640 1 --2- 172.21.15.112:0/2893980711 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a1c0d28d0 0x7f4a1c0b2480 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:27.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.103+0000 7f4a21c00640 1 -- 172.21.15.112:0/2893980711 >> 172.21.15.112:0/2893980711 conn(0x7f4a1c09e030 msgr2=0x7f4a1c0d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:27.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.103+0000 7f4a21c00640 1 -- 172.21.15.112:0/2893980711 shutdown_connections 2024-09-12T02:51:27.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.103+0000 7f4a21c00640 1 -- 172.21.15.112:0/2893980711 wait complete. 2024-09-12T02:51:27.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.105+0000 7f4a21c00640 1 Processor -- start 2024-09-12T02:51:27.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.105+0000 7f4a21c00640 1 -- start start 2024-09-12T02:51:27.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.106+0000 7f4a21c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a1c0b3e00 0x7f4a1c146c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:27.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.106+0000 7f4a21c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a1c0d1710 0x7f4a1c1f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:27.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.106+0000 7f4a21c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a1c0d28d0 0x7f4a1c147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:27.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.106+0000 7f4a21c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c0d39d0 con 0x7f4a1c0b3e00 2024-09-12T02:51:27.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.106+0000 7f4a21c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c0d2d60 con 0x7f4a1c0d1710 2024-09-12T02:51:27.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.106+0000 7f4a21c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4a1c15f110 con 0x7f4a1c0d28d0 2024-09-12T02:51:27.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.106+0000 7f4a1be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a1c0b3e00 0x7f4a1c146c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:27.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.106+0000 7f4a1be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a1c0b3e00 0x7f4a1c146c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36770/0 (socket says 172.21.15.112:36770) 2024-09-12T02:51:27.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.106+0000 7f4a1be00640 1 -- 172.21.15.112:0/4258227779 learned_addr learned my addr 172.21.15.112:0/4258227779 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:27.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.106+0000 7f4a21200640 1 --2- 172.21.15.112:0/4258227779 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a1c0d28d0 0x7f4a1c147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:27.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.106+0000 7f4a1b400640 1 --2- 172.21.15.112:0/4258227779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a1c0d1710 0x7f4a1c1f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:27.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.107+0000 7f4a1be00640 1 -- 172.21.15.112:0/4258227779 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a1c0d28d0 msgr2=0x7f4a1c147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:27.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.107+0000 7f4a1be00640 1 --2- 172.21.15.112:0/4258227779 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a1c0d28d0 0x7f4a1c147320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:27.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.107+0000 7f4a1be00640 1 -- 172.21.15.112:0/4258227779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a1c0d1710 msgr2=0x7f4a1c1f55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:27.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.107+0000 7f4a1be00640 1 --2- 172.21.15.112:0/4258227779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a1c0d1710 0x7f4a1c1f55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:27.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.107+0000 7f4a1be00640 1 -- 172.21.15.112:0/4258227779 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a1c1f5b30 con 0x7f4a1c0b3e00 2024-09-12T02:51:27.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.107+0000 7f4a1b400640 1 --2- 172.21.15.112:0/4258227779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a1c0d1710 0x7f4a1c1f55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:51:27.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.107+0000 7f4a1be00640 1 --2- 172.21.15.112:0/4258227779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a1c0b3e00 0x7f4a1c146c70 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c00c530 tx=0x7f4a0c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:27.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.107+0000 7f4a13e00640 1 -- 172.21.15.112:0/4258227779 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c0052d0 con 0x7f4a1c0b3e00 2024-09-12T02:51:27.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.107+0000 7f4a13e00640 1 -- 172.21.15.112:0/4258227779 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a0c005490 con 0x7f4a1c0b3e00 2024-09-12T02:51:27.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.107+0000 7f4a13e00640 1 -- 172.21.15.112:0/4258227779 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c012870 con 0x7f4a1c0b3e00 2024-09-12T02:51:27.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.107+0000 7f4a21c00640 1 -- 172.21.15.112:0/4258227779 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a1c0b4660 con 0x7f4a1c0b3e00 2024-09-12T02:51:27.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.107+0000 7f4a21c00640 1 -- 172.21.15.112:0/4258227779 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a1c0b4c20 con 0x7f4a1c0b3e00 2024-09-12T02:51:27.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.108+0000 7f4a21c00640 1 -- 172.21.15.112:0/4258227779 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a1c0b5230 con 0x7f4a1c0b3e00 2024-09-12T02:51:27.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.109+0000 7f4a13e00640 1 -- 172.21.15.112:0/4258227779 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4a0c012a10 con 0x7f4a1c0b3e00 2024-09-12T02:51:27.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.110+0000 7f4a13e00640 1 --2- 172.21.15.112:0/4258227779 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f49fc06be30 0x7f49fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:27.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.110+0000 7f4a13e00640 1 -- 172.21.15.112:0/4258227779 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f4a0c08aa90 con 0x7f4a1c0b3e00 2024-09-12T02:51:27.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.110+0000 7f4a1b400640 1 --2- 172.21.15.112:0/4258227779 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f49fc06be30 0x7f49fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:27.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.111+0000 7f4a1b400640 1 --2- 172.21.15.112:0/4258227779 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f49fc06be30 0x7f49fc06e2f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c068f90 tx=0x7f4a08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:27.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.114+0000 7f4a13e00640 1 -- 172.21.15.112:0/4258227779 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4a1c1f5b30 con 0x7f4a1c0b3e00 2024-09-12T02:51:27.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.285+0000 7f4a21c00640 1 -- 172.21.15.112:0/4258227779 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4a1c0d1af0 con 0x7f49fc06be30 2024-09-12T02:51:27.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.291+0000 7f4a13e00640 1 -- 172.21.15.112:0/4258227779 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247921 (secure 0 0 0) 0x7f4a1c0d1af0 con 0x7f49fc06be30 2024-09-12T02:51:27.295 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:51:27.296 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:51:27.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.294+0000 7f4a21c00640 1 -- 172.21.15.112:0/4258227779 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f49fc06be30 msgr2=0x7f49fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:27.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.294+0000 7f4a21c00640 1 --2- 172.21.15.112:0/4258227779 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f49fc06be30 0x7f49fc06e2f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c068f90 tx=0x7f4a08009040 comp rx=0 tx=0).stop 2024-09-12T02:51:27.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.295+0000 7f4a21c00640 1 -- 172.21.15.112:0/4258227779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a1c0b3e00 msgr2=0x7f4a1c146c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:27.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.295+0000 7f4a21c00640 1 --2- 172.21.15.112:0/4258227779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a1c0b3e00 0x7f4a1c146c70 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c00c530 tx=0x7f4a0c00c9f0 comp rx=0 tx=0).stop 2024-09-12T02:51:27.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.295+0000 7f4a21c00640 1 -- 172.21.15.112:0/4258227779 shutdown_connections 2024-09-12T02:51:27.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.295+0000 7f4a21c00640 1 --2- 172.21.15.112:0/4258227779 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a1c0d28d0 0x7f4a1c147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:27.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.295+0000 7f4a21c00640 1 --2- 172.21.15.112:0/4258227779 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f49fc06be30 0x7f49fc06e2f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:27.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.295+0000 7f4a21c00640 1 --2- 172.21.15.112:0/4258227779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a1c0d1710 0x7f4a1c1f55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:27.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.295+0000 7f4a21c00640 1 --2- 172.21.15.112:0/4258227779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a1c0b3e00 0x7f4a1c146c70 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:27.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.295+0000 7f4a21c00640 1 -- 172.21.15.112:0/4258227779 >> 172.21.15.112:0/4258227779 conn(0x7f4a1c09e030 msgr2=0x7f4a1c0b2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:27.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.295+0000 7f4a21c00640 1 -- 172.21.15.112:0/4258227779 shutdown_connections 2024-09-12T02:51:27.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.295+0000 7f4a21c00640 1 -- 172.21.15.112:0/4258227779 wait complete. 2024-09-12T02:51:27.311 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":451,"stamp":"2024-09-12T02:51:27.091293+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":68,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8366,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554133,"statfs":{"total":1600000000,"available":1591432628,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001023"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.748980+0000","last_change":"2024-09-12T02:51:22.748754+0000","last_active":"2024-09-12T02:51:22.748980+0000","last_peered":"2024-09-12T02:51:22.748980+0000","last_clean":"2024-09-12T02:51:22.748980+0000","last_became_active":"2024-09-12T02:51:22.748331+0000","last_became_peered":"2024-09-12T02:51:22.748331+0000","last_unstale":"2024-09-12T02:51:22.748980+0000","last_undegraded":"2024-09-12T02:51:22.748980+0000","last_fullsized":"2024-09-12T02:51:22.748980+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:11.448332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.734962+0000","last_change":"2024-09-12T02:51:22.734857+0000","last_active":"2024-09-12T02:51:22.734962+0000","last_peered":"2024-09-12T02:51:22.734962+0000","last_clean":"2024-09-12T02:51:22.734962+0000","last_became_active":"2024-09-12T02:51:22.734648+0000","last_became_peered":"2024-09-12T02:51:22.734648+0000","last_unstale":"2024-09-12T02:51:22.734962+0000","last_undegraded":"2024-09-12T02:51:22.734962+0000","last_fullsized":"2024-09-12T02:51:22.734962+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:12.798153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.738674+0000","last_change":"2024-09-12T02:51:22.738245+0000","last_active":"2024-09-12T02:51:22.738674+0000","last_peered":"2024-09-12T02:51:22.738674+0000","last_clean":"2024-09-12T02:51:22.738674+0000","last_became_active":"2024-09-12T02:51:22.737728+0000","last_became_peered":"2024-09-12T02:51:22.737728+0000","last_unstale":"2024-09-12T02:51:22.738674+0000","last_undegraded":"2024-09-12T02:51:22.738674+0000","last_fullsized":"2024-09-12T02:51:22.738674+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:30:54.572304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.744211+0000","last_change":"2024-09-12T02:51:22.743609+0000","last_active":"2024-09-12T02:51:22.744211+0000","last_peered":"2024-09-12T02:51:22.744211+0000","last_clean":"2024-09-12T02:51:22.744211+0000","last_became_active":"2024-09-12T02:51:22.742435+0000","last_became_peered":"2024-09-12T02:51:22.742435+0000","last_unstale":"2024-09-12T02:51:22.744211+0000","last_undegraded":"2024-09-12T02:51:22.744211+0000","last_fullsized":"2024-09-12T02:51:22.744211+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:15.762010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.750209+0000","last_change":"2024-09-12T02:51:22.748621+0000","last_active":"2024-09-12T02:51:22.750209+0000","last_peered":"2024-09-12T02:51:22.750209+0000","last_clean":"2024-09-12T02:51:22.750209+0000","last_became_active":"2024-09-12T02:51:22.748336+0000","last_became_peered":"2024-09-12T02:51:22.748336+0000","last_unstale":"2024-09-12T02:51:22.750209+0000","last_undegraded":"2024-09-12T02:51:22.750209+0000","last_fullsized":"2024-09-12T02:51:22.750209+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:25.769640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.747484+0000","last_change":"2024-09-12T02:51:22.747203+0000","last_active":"2024-09-12T02:51:22.747484+0000","last_peered":"2024-09-12T02:51:22.747484+0000","last_clean":"2024-09-12T02:51:22.747484+0000","last_became_active":"2024-09-12T02:51:22.746806+0000","last_became_peered":"2024-09-12T02:51:22.746806+0000","last_unstale":"2024-09-12T02:51:22.747484+0000","last_undegraded":"2024-09-12T02:51:22.747484+0000","last_fullsized":"2024-09-12T02:51:22.747484+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:35.356768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.745331+0000","last_change":"2024-09-12T02:51:22.745220+0000","last_active":"2024-09-12T02:51:22.745331+0000","last_peered":"2024-09-12T02:51:22.745331+0000","last_clean":"2024-09-12T02:51:22.745331+0000","last_became_active":"2024-09-12T02:51:22.744918+0000","last_became_peered":"2024-09-12T02:51:22.744918+0000","last_unstale":"2024-09-12T02:51:22.745331+0000","last_undegraded":"2024-09-12T02:51:22.745331+0000","last_fullsized":"2024-09-12T02:51:22.745331+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:00:26.490627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.739393+0000","last_change":"2024-09-12T02:51:22.739223+0000","last_active":"2024-09-12T02:51:22.739393+0000","last_peered":"2024-09-12T02:51:22.739393+0000","last_clean":"2024-09-12T02:51:22.739393+0000","last_became_active":"2024-09-12T02:51:22.738801+0000","last_became_peered":"2024-09-12T02:51:22.738801+0000","last_unstale":"2024-09-12T02:51:22.739393+0000","last_undegraded":"2024-09-12T02:51:22.739393+0000","last_fullsized":"2024-09-12T02:51:22.739393+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:26.591079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.737813+0000","last_change":"2024-09-12T02:51:22.736883+0000","last_active":"2024-09-12T02:51:22.737813+0000","last_peered":"2024-09-12T02:51:22.737813+0000","last_clean":"2024-09-12T02:51:22.737813+0000","last_became_active":"2024-09-12T02:51:22.736633+0000","last_became_peered":"2024-09-12T02:51:22.736633+0000","last_unstale":"2024-09-12T02:51:22.737813+0000","last_undegraded":"2024-09-12T02:51:22.737813+0000","last_fullsized":"2024-09-12T02:51:22.737813+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:53.078427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.753394+0000","last_change":"2024-09-12T02:51:22.751191+0000","last_active":"2024-09-12T02:51:22.753394+0000","last_peered":"2024-09-12T02:51:22.753394+0000","last_clean":"2024-09-12T02:51:22.753394+0000","last_became_active":"2024-09-12T02:51:22.747693+0000","last_became_peered":"2024-09-12T02:51:22.747693+0000","last_unstale":"2024-09-12T02:51:22.753394+0000","last_undegraded":"2024-09-12T02:51:22.753394+0000","last_fullsized":"2024-09-12T02:51:22.753394+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:05.032019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.739760+0000","last_change":"2024-09-12T02:51:22.739659+0000","last_active":"2024-09-12T02:51:22.739760+0000","last_peered":"2024-09-12T02:51:22.739760+0000","last_clean":"2024-09-12T02:51:22.739760+0000","last_became_active":"2024-09-12T02:51:22.739423+0000","last_became_peered":"2024-09-12T02:51:22.739423+0000","last_unstale":"2024-09-12T02:51:22.739760+0000","last_undegraded":"2024-09-12T02:51:22.739760+0000","last_fullsized":"2024-09-12T02:51:22.739760+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:10.643902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.753413+0000","last_change":"2024-09-12T02:51:22.752859+0000","last_active":"2024-09-12T02:51:22.753413+0000","last_peered":"2024-09-12T02:51:22.753413+0000","last_clean":"2024-09-12T02:51:22.753413+0000","last_became_active":"2024-09-12T02:51:22.752621+0000","last_became_peered":"2024-09-12T02:51:22.752621+0000","last_unstale":"2024-09-12T02:51:22.753413+0000","last_undegraded":"2024-09-12T02:51:22.753413+0000","last_fullsized":"2024-09-12T02:51:22.753413+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:10:33.544285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.753940+0000","last_change":"2024-09-12T02:51:22.751776+0000","last_active":"2024-09-12T02:51:22.753940+0000","last_peered":"2024-09-12T02:51:22.753940+0000","last_clean":"2024-09-12T02:51:22.753940+0000","last_became_active":"2024-09-12T02:51:22.751169+0000","last_became_peered":"2024-09-12T02:51:22.751169+0000","last_unstale":"2024-09-12T02:51:22.753940+0000","last_undegraded":"2024-09-12T02:51:22.753940+0000","last_fullsized":"2024-09-12T02:51:22.753940+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:35.239134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.751518+0000","last_change":"2024-09-12T02:51:22.750972+0000","last_active":"2024-09-12T02:51:22.751518+0000","last_peered":"2024-09-12T02:51:22.751518+0000","last_clean":"2024-09-12T02:51:22.751518+0000","last_became_active":"2024-09-12T02:51:22.750462+0000","last_became_peered":"2024-09-12T02:51:22.750462+0000","last_unstale":"2024-09-12T02:51:22.751518+0000","last_undegraded":"2024-09-12T02:51:22.751518+0000","last_fullsized":"2024-09-12T02:51:22.751518+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:59.725781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.742578+0000","last_change":"2024-09-12T02:51:22.741319+0000","last_active":"2024-09-12T02:51:22.742578+0000","last_peered":"2024-09-12T02:51:22.742578+0000","last_clean":"2024-09-12T02:51:22.742578+0000","last_became_active":"2024-09-12T02:51:22.741030+0000","last_became_peered":"2024-09-12T02:51:22.741030+0000","last_unstale":"2024-09-12T02:51:22.742578+0000","last_undegraded":"2024-09-12T02:51:22.742578+0000","last_fullsized":"2024-09-12T02:51:22.742578+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:31.268255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.741505+0000","last_change":"2024-09-12T02:51:22.741323+0000","last_active":"2024-09-12T02:51:22.741505+0000","last_peered":"2024-09-12T02:51:22.741505+0000","last_clean":"2024-09-12T02:51:22.741505+0000","last_became_active":"2024-09-12T02:51:22.740977+0000","last_became_peered":"2024-09-12T02:51:22.740977+0000","last_unstale":"2024-09-12T02:51:22.741505+0000","last_undegraded":"2024-09-12T02:51:22.741505+0000","last_fullsized":"2024-09-12T02:51:22.741505+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:32.649565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.750190+0000","last_change":"2024-09-12T02:51:22.748779+0000","last_active":"2024-09-12T02:51:22.750190+0000","last_peered":"2024-09-12T02:51:22.750190+0000","last_clean":"2024-09-12T02:51:22.750190+0000","last_became_active":"2024-09-12T02:51:22.748510+0000","last_became_peered":"2024-09-12T02:51:22.748510+0000","last_unstale":"2024-09-12T02:51:22.750190+0000","last_undegraded":"2024-09-12T02:51:22.750190+0000","last_fullsized":"2024-09-12T02:51:22.750190+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:12.671091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.738654+0000","last_change":"2024-09-12T02:51:22.738033+0000","last_active":"2024-09-12T02:51:22.738654+0000","last_peered":"2024-09-12T02:51:22.738654+0000","last_clean":"2024-09-12T02:51:22.738654+0000","last_became_active":"2024-09-12T02:51:22.737420+0000","last_became_peered":"2024-09-12T02:51:22.737420+0000","last_unstale":"2024-09-12T02:51:22.738654+0000","last_undegraded":"2024-09-12T02:51:22.738654+0000","last_fullsized":"2024-09-12T02:51:22.738654+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:40.817571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.741450+0000","last_change":"2024-09-12T02:51:22.740565+0000","last_active":"2024-09-12T02:51:22.741450+0000","last_peered":"2024-09-12T02:51:22.741450+0000","last_clean":"2024-09-12T02:51:22.741450+0000","last_became_active":"2024-09-12T02:51:22.740364+0000","last_became_peered":"2024-09-12T02:51:22.740364+0000","last_unstale":"2024-09-12T02:51:22.741450+0000","last_undegraded":"2024-09-12T02:51:22.741450+0000","last_fullsized":"2024-09-12T02:51:22.741450+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:53.424130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.739749+0000","last_change":"2024-09-12T02:51:22.739592+0000","last_active":"2024-09-12T02:51:22.739749+0000","last_peered":"2024-09-12T02:51:22.739749+0000","last_clean":"2024-09-12T02:51:22.739749+0000","last_became_active":"2024-09-12T02:51:22.737488+0000","last_became_peered":"2024-09-12T02:51:22.737488+0000","last_unstale":"2024-09-12T02:51:22.739749+0000","last_undegraded":"2024-09-12T02:51:22.739749+0000","last_fullsized":"2024-09-12T02:51:22.739749+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:11.808511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.753314+0000","last_change":"2024-09-12T02:51:22.748203+0000","last_active":"2024-09-12T02:51:22.753314+0000","last_peered":"2024-09-12T02:51:22.753314+0000","last_clean":"2024-09-12T02:51:22.753314+0000","last_became_active":"2024-09-12T02:51:22.746891+0000","last_became_peered":"2024-09-12T02:51:22.746891+0000","last_unstale":"2024-09-12T02:51:22.753314+0000","last_undegraded":"2024-09-12T02:51:22.753314+0000","last_fullsized":"2024-09-12T02:51:22.753314+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:55.603814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.746342+0000","last_change":"2024-09-12T02:51:22.745374+0000","last_active":"2024-09-12T02:51:22.746342+0000","last_peered":"2024-09-12T02:51:22.746342+0000","last_clean":"2024-09-12T02:51:22.746342+0000","last_became_active":"2024-09-12T02:51:22.745070+0000","last_became_peered":"2024-09-12T02:51:22.745070+0000","last_unstale":"2024-09-12T02:51:22.746342+0000","last_undegraded":"2024-09-12T02:51:22.746342+0000","last_fullsized":"2024-09-12T02:51:22.746342+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:25.227276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.743860+0000","last_change":"2024-09-12T02:51:22.741384+0000","last_active":"2024-09-12T02:51:22.743860+0000","last_peered":"2024-09-12T02:51:22.743860+0000","last_clean":"2024-09-12T02:51:22.743860+0000","last_became_active":"2024-09-12T02:51:22.741084+0000","last_became_peered":"2024-09-12T02:51:22.741084+0000","last_unstale":"2024-09-12T02:51:22.743860+0000","last_undegraded":"2024-09-12T02:51:22.743860+0000","last_fullsized":"2024-09-12T02:51:22.743860+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:09.071201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.750207+0000","last_change":"2024-09-12T02:51:22.748828+0000","last_active":"2024-09-12T02:51:22.750207+0000","last_peered":"2024-09-12T02:51:22.750207+0000","last_clean":"2024-09-12T02:51:22.750207+0000","last_became_active":"2024-09-12T02:51:22.746773+0000","last_became_peered":"2024-09-12T02:51:22.746773+0000","last_unstale":"2024-09-12T02:51:22.750207+0000","last_undegraded":"2024-09-12T02:51:22.750207+0000","last_fullsized":"2024-09-12T02:51:22.750207+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:36.011290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.739715+0000","last_change":"2024-09-12T02:51:22.737706+0000","last_active":"2024-09-12T02:51:22.739715+0000","last_peered":"2024-09-12T02:51:22.739715+0000","last_clean":"2024-09-12T02:51:22.739715+0000","last_became_active":"2024-09-12T02:51:22.737150+0000","last_became_peered":"2024-09-12T02:51:22.737150+0000","last_unstale":"2024-09-12T02:51:22.739715+0000","last_undegraded":"2024-09-12T02:51:22.739715+0000","last_fullsized":"2024-09-12T02:51:22.739715+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:17.917911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.742434+0000","last_change":"2024-09-12T02:51:22.742214+0000","last_active":"2024-09-12T02:51:22.742434+0000","last_peered":"2024-09-12T02:51:22.742434+0000","last_clean":"2024-09-12T02:51:22.742434+0000","last_became_active":"2024-09-12T02:51:22.741941+0000","last_became_peered":"2024-09-12T02:51:22.741941+0000","last_unstale":"2024-09-12T02:51:22.742434+0000","last_undegraded":"2024-09-12T02:51:22.742434+0000","last_fullsized":"2024-09-12T02:51:22.742434+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:36.598670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.736887+0000","last_change":"2024-09-12T02:51:22.734272+0000","last_active":"2024-09-12T02:51:22.736887+0000","last_peered":"2024-09-12T02:51:22.736887+0000","last_clean":"2024-09-12T02:51:22.736887+0000","last_became_active":"2024-09-12T02:51:22.734043+0000","last_became_peered":"2024-09-12T02:51:22.734043+0000","last_unstale":"2024-09-12T02:51:22.736887+0000","last_undegraded":"2024-09-12T02:51:22.736887+0000","last_fullsized":"2024-09-12T02:51:22.736887+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:36.906391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.741483+0000","last_change":"2024-09-12T02:51:22.741262+0000","last_active":"2024-09-12T02:51:22.741483+0000","last_peered":"2024-09-12T02:51:22.741483+0000","last_clean":"2024-09-12T02:51:22.741483+0000","last_became_active":"2024-09-12T02:51:22.741035+0000","last_became_peered":"2024-09-12T02:51:22.741035+0000","last_unstale":"2024-09-12T02:51:22.741483+0000","last_undegraded":"2024-09-12T02:51:22.741483+0000","last_fullsized":"2024-09-12T02:51:22.741483+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:52.169330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.738392+0000","last_change":"2024-09-12T02:51:22.738210+0000","last_active":"2024-09-12T02:51:22.738392+0000","last_peered":"2024-09-12T02:51:22.738392+0000","last_clean":"2024-09-12T02:51:22.738392+0000","last_became_active":"2024-09-12T02:51:22.737826+0000","last_became_peered":"2024-09-12T02:51:22.737826+0000","last_unstale":"2024-09-12T02:51:22.738392+0000","last_undegraded":"2024-09-12T02:51:22.738392+0000","last_fullsized":"2024-09-12T02:51:22.738392+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:04.860419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.745321+0000","last_change":"2024-09-12T02:51:22.744873+0000","last_active":"2024-09-12T02:51:22.745321+0000","last_peered":"2024-09-12T02:51:22.745321+0000","last_clean":"2024-09-12T02:51:22.745321+0000","last_became_active":"2024-09-12T02:51:22.742528+0000","last_became_peered":"2024-09-12T02:51:22.742528+0000","last_unstale":"2024-09-12T02:51:22.745321+0000","last_undegraded":"2024-09-12T02:51:22.745321+0000","last_fullsized":"2024-09-12T02:51:22.745321+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:21:29.592487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.737779+0000","last_change":"2024-09-12T02:51:22.735858+0000","last_active":"2024-09-12T02:51:22.737779+0000","last_peered":"2024-09-12T02:51:22.737779+0000","last_clean":"2024-09-12T02:51:22.737779+0000","last_became_active":"2024-09-12T02:51:22.735619+0000","last_became_peered":"2024-09-12T02:51:22.735619+0000","last_unstale":"2024-09-12T02:51:22.737779+0000","last_undegraded":"2024-09-12T02:51:22.737779+0000","last_fullsized":"2024-09-12T02:51:22.737779+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:18.896403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.739890+0000","last_change":"2024-09-12T02:51:22.739331+0000","last_active":"2024-09-12T02:51:22.739890+0000","last_peered":"2024-09-12T02:51:22.739890+0000","last_clean":"2024-09-12T02:51:22.739890+0000","last_became_active":"2024-09-12T02:51:22.738940+0000","last_became_peered":"2024-09-12T02:51:22.738940+0000","last_unstale":"2024-09-12T02:51:22.739890+0000","last_undegraded":"2024-09-12T02:51:22.739890+0000","last_fullsized":"2024-09-12T02:51:22.739890+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:01.774549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.750223+0000","last_change":"2024-09-12T02:51:22.749400+0000","last_active":"2024-09-12T02:51:22.750223+0000","last_peered":"2024-09-12T02:51:22.750223+0000","last_clean":"2024-09-12T02:51:22.750223+0000","last_became_active":"2024-09-12T02:51:22.749157+0000","last_became_peered":"2024-09-12T02:51:22.749157+0000","last_unstale":"2024-09-12T02:51:22.750223+0000","last_undegraded":"2024-09-12T02:51:22.750223+0000","last_fullsized":"2024-09-12T02:51:22.750223+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:44.250345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"166'4","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.755164+0000","last_change":"2024-09-12T02:51:21.742354+0000","last_active":"2024-09-12T02:51:22.755164+0000","last_peered":"2024-09-12T02:51:22.755164+0000","last_clean":"2024-09-12T02:51:22.755164+0000","last_became_active":"2024-09-12T02:51:21.742094+0000","last_became_peered":"2024-09-12T02:51:21.742094+0000","last_unstale":"2024-09-12T02:51:22.755164+0000","last_undegraded":"2024-09-12T02:51:22.755164+0000","last_fullsized":"2024-09-12T02:51:22.755164+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:53.030653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.737758+0000","last_change":"2024-09-12T02:51:22.735774+0000","last_active":"2024-09-12T02:51:22.737758+0000","last_peered":"2024-09-12T02:51:22.737758+0000","last_clean":"2024-09-12T02:51:22.737758+0000","last_became_active":"2024-09-12T02:51:22.735256+0000","last_became_peered":"2024-09-12T02:51:22.735256+0000","last_unstale":"2024-09-12T02:51:22.737758+0000","last_undegraded":"2024-09-12T02:51:22.737758+0000","last_fullsized":"2024-09-12T02:51:22.737758+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:47.969280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"166'1","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.756354+0000","last_change":"2024-09-12T02:51:21.743439+0000","last_active":"2024-09-12T02:51:22.756354+0000","last_peered":"2024-09-12T02:51:22.756354+0000","last_clean":"2024-09-12T02:51:22.756354+0000","last_became_active":"2024-09-12T02:51:21.742966+0000","last_became_peered":"2024-09-12T02:51:21.742966+0000","last_unstale":"2024-09-12T02:51:22.756354+0000","last_undegraded":"2024-09-12T02:51:22.756354+0000","last_fullsized":"2024-09-12T02:51:22.756354+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:30.836636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.748959+0000","last_change":"2024-09-12T02:51:22.748541+0000","last_active":"2024-09-12T02:51:22.748959+0000","last_peered":"2024-09-12T02:51:22.748959+0000","last_clean":"2024-09-12T02:51:22.748959+0000","last_became_active":"2024-09-12T02:51:22.747922+0000","last_became_peered":"2024-09-12T02:51:22.747922+0000","last_unstale":"2024-09-12T02:51:22.748959+0000","last_undegraded":"2024-09-12T02:51:22.748959+0000","last_fullsized":"2024-09-12T02:51:22.748959+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:13.457839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"166'2","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.751971+0000","last_change":"2024-09-12T02:51:21.734775+0000","last_active":"2024-09-12T02:51:22.751971+0000","last_peered":"2024-09-12T02:51:22.751971+0000","last_clean":"2024-09-12T02:51:22.751971+0000","last_became_active":"2024-09-12T02:51:21.734558+0000","last_became_peered":"2024-09-12T02:51:21.734558+0000","last_unstale":"2024-09-12T02:51:22.751971+0000","last_undegraded":"2024-09-12T02:51:22.751971+0000","last_fullsized":"2024-09-12T02:51:22.751971+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:03.097639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.754024+0000","last_change":"2024-09-12T02:51:22.753151+0000","last_active":"2024-09-12T02:51:22.754024+0000","last_peered":"2024-09-12T02:51:22.754024+0000","last_clean":"2024-09-12T02:51:22.754024+0000","last_became_active":"2024-09-12T02:51:22.752754+0000","last_became_peered":"2024-09-12T02:51:22.752754+0000","last_unstale":"2024-09-12T02:51:22.754024+0000","last_undegraded":"2024-09-12T02:51:22.754024+0000","last_fullsized":"2024-09-12T02:51:22.754024+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:15.100008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"166'2","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.752030+0000","last_change":"2024-09-12T02:51:21.738570+0000","last_active":"2024-09-12T02:51:22.752030+0000","last_peered":"2024-09-12T02:51:22.752030+0000","last_clean":"2024-09-12T02:51:22.752030+0000","last_became_active":"2024-09-12T02:51:21.738237+0000","last_became_peered":"2024-09-12T02:51:21.738237+0000","last_unstale":"2024-09-12T02:51:22.752030+0000","last_undegraded":"2024-09-12T02:51:22.752030+0000","last_fullsized":"2024-09-12T02:51:22.752030+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:38.793426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.738122+0000","last_change":"2024-09-12T02:51:22.737878+0000","last_active":"2024-09-12T02:51:22.738122+0000","last_peered":"2024-09-12T02:51:22.738122+0000","last_clean":"2024-09-12T02:51:22.738122+0000","last_became_active":"2024-09-12T02:51:22.735541+0000","last_became_peered":"2024-09-12T02:51:22.735541+0000","last_unstale":"2024-09-12T02:51:22.738122+0000","last_undegraded":"2024-09-12T02:51:22.738122+0000","last_fullsized":"2024-09-12T02:51:22.738122+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:23.945369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"166'1","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.754104+0000","last_change":"2024-09-12T02:51:21.744912+0000","last_active":"2024-09-12T02:51:22.754104+0000","last_peered":"2024-09-12T02:51:22.754104+0000","last_clean":"2024-09-12T02:51:22.754104+0000","last_became_active":"2024-09-12T02:51:21.744676+0000","last_became_peered":"2024-09-12T02:51:21.744676+0000","last_unstale":"2024-09-12T02:51:22.754104+0000","last_undegraded":"2024-09-12T02:51:22.754104+0000","last_fullsized":"2024-09-12T02:51:22.754104+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:04.662459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.753008+0000","last_change":"2024-09-12T02:51:22.752853+0000","last_active":"2024-09-12T02:51:22.753008+0000","last_peered":"2024-09-12T02:51:22.753008+0000","last_clean":"2024-09-12T02:51:22.753008+0000","last_became_active":"2024-09-12T02:51:22.752544+0000","last_became_peered":"2024-09-12T02:51:22.752544+0000","last_unstale":"2024-09-12T02:51:22.753008+0000","last_undegraded":"2024-09-12T02:51:22.753008+0000","last_fullsized":"2024-09-12T02:51:22.753008+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:28.973669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"166'1","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.755591+0000","last_change":"2024-09-12T02:51:21.740404+0000","last_active":"2024-09-12T02:51:22.755591+0000","last_peered":"2024-09-12T02:51:22.755591+0000","last_clean":"2024-09-12T02:51:22.755591+0000","last_became_active":"2024-09-12T02:51:21.740179+0000","last_became_peered":"2024-09-12T02:51:21.740179+0000","last_unstale":"2024-09-12T02:51:22.755591+0000","last_undegraded":"2024-09-12T02:51:22.755591+0000","last_fullsized":"2024-09-12T02:51:22.755591+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:12.209372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.734785+0000","last_change":"2024-09-12T02:51:22.734510+0000","last_active":"2024-09-12T02:51:22.734785+0000","last_peered":"2024-09-12T02:51:22.734785+0000","last_clean":"2024-09-12T02:51:22.734785+0000","last_became_active":"2024-09-12T02:51:22.734264+0000","last_became_peered":"2024-09-12T02:51:22.734264+0000","last_unstale":"2024-09-12T02:51:22.734785+0000","last_undegraded":"2024-09-12T02:51:22.734785+0000","last_fullsized":"2024-09-12T02:51:22.734785+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:49.592751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.730009+0000","last_change":"2024-09-12T02:51:21.742116+0000","last_active":"2024-09-12T02:51:22.730009+0000","last_peered":"2024-09-12T02:51:22.730009+0000","last_clean":"2024-09-12T02:51:22.730009+0000","last_became_active":"2024-09-12T02:51:21.741848+0000","last_became_peered":"2024-09-12T02:51:21.741848+0000","last_unstale":"2024-09-12T02:51:22.730009+0000","last_undegraded":"2024-09-12T02:51:22.730009+0000","last_fullsized":"2024-09-12T02:51:22.730009+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:17.913672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.737198+0000","last_change":"2024-09-12T02:51:22.737071+0000","last_active":"2024-09-12T02:51:22.737198+0000","last_peered":"2024-09-12T02:51:22.737198+0000","last_clean":"2024-09-12T02:51:22.737198+0000","last_became_active":"2024-09-12T02:51:22.736828+0000","last_became_peered":"2024-09-12T02:51:22.736828+0000","last_unstale":"2024-09-12T02:51:22.737198+0000","last_undegraded":"2024-09-12T02:51:22.737198+0000","last_fullsized":"2024-09-12T02:51:22.737198+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:54.950490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.741216+0000","last_change":"2024-09-12T02:51:21.743164+0000","last_active":"2024-09-12T02:51:22.741216+0000","last_peered":"2024-09-12T02:51:22.741216+0000","last_clean":"2024-09-12T02:51:22.741216+0000","last_became_active":"2024-09-12T02:51:21.742813+0000","last_became_peered":"2024-09-12T02:51:21.742813+0000","last_unstale":"2024-09-12T02:51:22.741216+0000","last_undegraded":"2024-09-12T02:51:22.741216+0000","last_fullsized":"2024-09-12T02:51:22.741216+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:30.944009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.742614+0000","last_change":"2024-09-12T02:51:22.740587+0000","last_active":"2024-09-12T02:51:22.742614+0000","last_peered":"2024-09-12T02:51:22.742614+0000","last_clean":"2024-09-12T02:51:22.742614+0000","last_became_active":"2024-09-12T02:51:22.740270+0000","last_became_peered":"2024-09-12T02:51:22.740270+0000","last_unstale":"2024-09-12T02:51:22.742614+0000","last_undegraded":"2024-09-12T02:51:22.742614+0000","last_fullsized":"2024-09-12T02:51:22.742614+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:27.957464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.730668+0000","last_change":"2024-09-12T02:51:21.739041+0000","last_active":"2024-09-12T02:51:22.730668+0000","last_peered":"2024-09-12T02:51:22.730668+0000","last_clean":"2024-09-12T02:51:22.730668+0000","last_became_active":"2024-09-12T02:51:21.738820+0000","last_became_peered":"2024-09-12T02:51:21.738820+0000","last_unstale":"2024-09-12T02:51:22.730668+0000","last_undegraded":"2024-09-12T02:51:22.730668+0000","last_fullsized":"2024-09-12T02:51:22.730668+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:16.030919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.746513+0000","last_change":"2024-09-12T02:51:22.745529+0000","last_active":"2024-09-12T02:51:22.746513+0000","last_peered":"2024-09-12T02:51:22.746513+0000","last_clean":"2024-09-12T02:51:22.746513+0000","last_became_active":"2024-09-12T02:51:22.745254+0000","last_became_peered":"2024-09-12T02:51:22.745254+0000","last_unstale":"2024-09-12T02:51:22.746513+0000","last_undegraded":"2024-09-12T02:51:22.746513+0000","last_fullsized":"2024-09-12T02:51:22.746513+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:45.449379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.736966+0000","last_change":"2024-09-12T02:51:21.743351+0000","last_active":"2024-09-12T02:51:22.736966+0000","last_peered":"2024-09-12T02:51:22.736966+0000","last_clean":"2024-09-12T02:51:22.736966+0000","last_became_active":"2024-09-12T02:51:21.742742+0000","last_became_peered":"2024-09-12T02:51:21.742742+0000","last_unstale":"2024-09-12T02:51:22.736966+0000","last_undegraded":"2024-09-12T02:51:22.736966+0000","last_fullsized":"2024-09-12T02:51:22.736966+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:14.574850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.736932+0000","last_change":"2024-09-12T02:51:22.736786+0000","last_active":"2024-09-12T02:51:22.736932+0000","last_peered":"2024-09-12T02:51:22.736932+0000","last_clean":"2024-09-12T02:51:22.736932+0000","last_became_active":"2024-09-12T02:51:22.736573+0000","last_became_peered":"2024-09-12T02:51:22.736573+0000","last_unstale":"2024-09-12T02:51:22.736932+0000","last_undegraded":"2024-09-12T02:51:22.736932+0000","last_fullsized":"2024-09-12T02:51:22.736932+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:59.408393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"166'6","reported_seq":18,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.756614+0000","last_change":"2024-09-12T02:51:21.733087+0000","last_active":"2024-09-12T02:51:22.756614+0000","last_peered":"2024-09-12T02:51:22.756614+0000","last_clean":"2024-09-12T02:51:22.756614+0000","last_became_active":"2024-09-12T02:51:21.732848+0000","last_became_peered":"2024-09-12T02:51:21.732848+0000","last_unstale":"2024-09-12T02:51:22.756614+0000","last_undegraded":"2024-09-12T02:51:22.756614+0000","last_fullsized":"2024-09-12T02:51:22.756614+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:40.623330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.748659+0000","last_change":"2024-09-12T02:51:22.748035+0000","last_active":"2024-09-12T02:51:22.748659+0000","last_peered":"2024-09-12T02:51:22.748659+0000","last_clean":"2024-09-12T02:51:22.748659+0000","last_became_active":"2024-09-12T02:51:22.747567+0000","last_became_peered":"2024-09-12T02:51:22.747567+0000","last_unstale":"2024-09-12T02:51:22.748659+0000","last_undegraded":"2024-09-12T02:51:22.748659+0000","last_fullsized":"2024-09-12T02:51:22.748659+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:09.212624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"166'2","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.755258+0000","last_change":"2024-09-12T02:51:21.737603+0000","last_active":"2024-09-12T02:51:22.755258+0000","last_peered":"2024-09-12T02:51:22.755258+0000","last_clean":"2024-09-12T02:51:22.755258+0000","last_became_active":"2024-09-12T02:51:21.737350+0000","last_became_peered":"2024-09-12T02:51:21.737350+0000","last_unstale":"2024-09-12T02:51:22.755258+0000","last_undegraded":"2024-09-12T02:51:22.755258+0000","last_fullsized":"2024-09-12T02:51:22.755258+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:43.341728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.737796+0000","last_change":"2024-09-12T02:51:22.736738+0000","last_active":"2024-09-12T02:51:22.737796+0000","last_peered":"2024-09-12T02:51:22.737796+0000","last_clean":"2024-09-12T02:51:22.737796+0000","last_became_active":"2024-09-12T02:51:22.736542+0000","last_became_peered":"2024-09-12T02:51:22.736542+0000","last_unstale":"2024-09-12T02:51:22.737796+0000","last_undegraded":"2024-09-12T02:51:22.737796+0000","last_fullsized":"2024-09-12T02:51:22.737796+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:06.426446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.732118+0000","last_change":"2024-09-12T02:51:21.738275+0000","last_active":"2024-09-12T02:51:22.732118+0000","last_peered":"2024-09-12T02:51:22.732118+0000","last_clean":"2024-09-12T02:51:22.732118+0000","last_became_active":"2024-09-12T02:51:21.737252+0000","last_became_peered":"2024-09-12T02:51:21.737252+0000","last_unstale":"2024-09-12T02:51:22.732118+0000","last_undegraded":"2024-09-12T02:51:22.732118+0000","last_fullsized":"2024-09-12T02:51:22.732118+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:18.594108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.753913+0000","last_change":"2024-09-12T02:51:22.751595+0000","last_active":"2024-09-12T02:51:22.753913+0000","last_peered":"2024-09-12T02:51:22.753913+0000","last_clean":"2024-09-12T02:51:22.753913+0000","last_became_active":"2024-09-12T02:51:22.750869+0000","last_became_peered":"2024-09-12T02:51:22.750869+0000","last_unstale":"2024-09-12T02:51:22.753913+0000","last_undegraded":"2024-09-12T02:51:22.753913+0000","last_fullsized":"2024-09-12T02:51:22.753913+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:44.770738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.732611+0000","last_change":"2024-09-12T02:51:21.735079+0000","last_active":"2024-09-12T02:51:22.732611+0000","last_peered":"2024-09-12T02:51:22.732611+0000","last_clean":"2024-09-12T02:51:22.732611+0000","last_became_active":"2024-09-12T02:51:21.734844+0000","last_became_peered":"2024-09-12T02:51:21.734844+0000","last_unstale":"2024-09-12T02:51:22.732611+0000","last_undegraded":"2024-09-12T02:51:22.732611+0000","last_fullsized":"2024-09-12T02:51:22.732611+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:35.447583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.734008+0000","last_change":"2024-09-12T02:51:22.733866+0000","last_active":"2024-09-12T02:51:22.734008+0000","last_peered":"2024-09-12T02:51:22.734008+0000","last_clean":"2024-09-12T02:51:22.734008+0000","last_became_active":"2024-09-12T02:51:22.733591+0000","last_became_peered":"2024-09-12T02:51:22.733591+0000","last_unstale":"2024-09-12T02:51:22.734008+0000","last_undegraded":"2024-09-12T02:51:22.734008+0000","last_fullsized":"2024-09-12T02:51:22.734008+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:44.102074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"166'8","reported_seq":20,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.754319+0000","last_change":"2024-09-12T02:51:21.740295+0000","last_active":"2024-09-12T02:51:22.754319+0000","last_peered":"2024-09-12T02:51:22.754319+0000","last_clean":"2024-09-12T02:51:22.754319+0000","last_became_active":"2024-09-12T02:51:21.740028+0000","last_became_peered":"2024-09-12T02:51:21.740028+0000","last_unstale":"2024-09-12T02:51:22.754319+0000","last_undegraded":"2024-09-12T02:51:22.754319+0000","last_fullsized":"2024-09-12T02:51:22.754319+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:42.167339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.753293+0000","last_change":"2024-09-12T02:51:22.747977+0000","last_active":"2024-09-12T02:51:22.753293+0000","last_peered":"2024-09-12T02:51:22.753293+0000","last_clean":"2024-09-12T02:51:22.753293+0000","last_became_active":"2024-09-12T02:51:22.747398+0000","last_became_peered":"2024-09-12T02:51:22.747398+0000","last_unstale":"2024-09-12T02:51:22.753293+0000","last_undegraded":"2024-09-12T02:51:22.753293+0000","last_fullsized":"2024-09-12T02:51:22.753293+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:00.631907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"166'1","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.749716+0000","last_change":"2024-09-12T02:51:21.733015+0000","last_active":"2024-09-12T02:51:22.749716+0000","last_peered":"2024-09-12T02:51:22.749716+0000","last_clean":"2024-09-12T02:51:22.749716+0000","last_became_active":"2024-09-12T02:51:21.732765+0000","last_became_peered":"2024-09-12T02:51:21.732765+0000","last_unstale":"2024-09-12T02:51:22.749716+0000","last_undegraded":"2024-09-12T02:51:22.749716+0000","last_fullsized":"2024-09-12T02:51:22.749716+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:24:19.441869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.740824+0000","last_change":"2024-09-12T02:51:22.740391+0000","last_active":"2024-09-12T02:51:22.740824+0000","last_peered":"2024-09-12T02:51:22.740824+0000","last_clean":"2024-09-12T02:51:22.740824+0000","last_became_active":"2024-09-12T02:51:22.740101+0000","last_became_peered":"2024-09-12T02:51:22.740101+0000","last_unstale":"2024-09-12T02:51:22.740824+0000","last_undegraded":"2024-09-12T02:51:22.740824+0000","last_fullsized":"2024-09-12T02:51:22.740824+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:36.989673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"166'2","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.756638+0000","last_change":"2024-09-12T02:51:21.733787+0000","last_active":"2024-09-12T02:51:22.756638+0000","last_peered":"2024-09-12T02:51:22.756638+0000","last_clean":"2024-09-12T02:51:22.756638+0000","last_became_active":"2024-09-12T02:51:21.733554+0000","last_became_peered":"2024-09-12T02:51:21.733554+0000","last_unstale":"2024-09-12T02:51:22.756638+0000","last_undegraded":"2024-09-12T02:51:22.756638+0000","last_fullsized":"2024-09-12T02:51:22.756638+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:18.803641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.750439+0000","last_change":"2024-09-12T02:51:22.750098+0000","last_active":"2024-09-12T02:51:22.750439+0000","last_peered":"2024-09-12T02:51:22.750439+0000","last_clean":"2024-09-12T02:51:22.750439+0000","last_became_active":"2024-09-12T02:51:22.749339+0000","last_became_peered":"2024-09-12T02:51:22.749339+0000","last_unstale":"2024-09-12T02:51:22.750439+0000","last_undegraded":"2024-09-12T02:51:22.750439+0000","last_fullsized":"2024-09-12T02:51:22.750439+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:59.069522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"166'1","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.754170+0000","last_change":"2024-09-12T02:51:21.743230+0000","last_active":"2024-09-12T02:51:22.754170+0000","last_peered":"2024-09-12T02:51:22.754170+0000","last_clean":"2024-09-12T02:51:22.754170+0000","last_became_active":"2024-09-12T02:51:21.743003+0000","last_became_peered":"2024-09-12T02:51:21.743003+0000","last_unstale":"2024-09-12T02:51:22.754170+0000","last_undegraded":"2024-09-12T02:51:22.754170+0000","last_fullsized":"2024-09-12T02:51:22.754170+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:43.408794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.747466+0000","last_change":"2024-09-12T02:51:22.747028+0000","last_active":"2024-09-12T02:51:22.747466+0000","last_peered":"2024-09-12T02:51:22.747466+0000","last_clean":"2024-09-12T02:51:22.747466+0000","last_became_active":"2024-09-12T02:51:22.746492+0000","last_became_peered":"2024-09-12T02:51:22.746492+0000","last_unstale":"2024-09-12T02:51:22.747466+0000","last_undegraded":"2024-09-12T02:51:22.747466+0000","last_fullsized":"2024-09-12T02:51:22.747466+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:56.147361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.729536+0000","last_change":"2024-09-12T02:51:21.735473+0000","last_active":"2024-09-12T02:51:22.729536+0000","last_peered":"2024-09-12T02:51:22.729536+0000","last_clean":"2024-09-12T02:51:22.729536+0000","last_became_active":"2024-09-12T02:51:21.735261+0000","last_became_peered":"2024-09-12T02:51:21.735261+0000","last_unstale":"2024-09-12T02:51:22.729536+0000","last_undegraded":"2024-09-12T02:51:22.729536+0000","last_fullsized":"2024-09-12T02:51:22.729536+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:00.942387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.744184+0000","last_change":"2024-09-12T02:51:22.743309+0000","last_active":"2024-09-12T02:51:22.744184+0000","last_peered":"2024-09-12T02:51:22.744184+0000","last_clean":"2024-09-12T02:51:22.744184+0000","last_became_active":"2024-09-12T02:51:22.741965+0000","last_became_peered":"2024-09-12T02:51:22.741965+0000","last_unstale":"2024-09-12T02:51:22.744184+0000","last_undegraded":"2024-09-12T02:51:22.744184+0000","last_fullsized":"2024-09-12T02:51:22.744184+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:44.188170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"166'2","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.752798+0000","last_change":"2024-09-12T02:51:21.734112+0000","last_active":"2024-09-12T02:51:22.752798+0000","last_peered":"2024-09-12T02:51:22.752798+0000","last_clean":"2024-09-12T02:51:22.752798+0000","last_became_active":"2024-09-12T02:51:21.733575+0000","last_became_peered":"2024-09-12T02:51:21.733575+0000","last_unstale":"2024-09-12T02:51:22.752798+0000","last_undegraded":"2024-09-12T02:51:22.752798+0000","last_fullsized":"2024-09-12T02:51:22.752798+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:33:12.350357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.742837+0000","last_change":"2024-09-12T02:51:22.742509+0000","last_active":"2024-09-12T02:51:22.742837+0000","last_peered":"2024-09-12T02:51:22.742837+0000","last_clean":"2024-09-12T02:51:22.742837+0000","last_became_active":"2024-09-12T02:51:22.742156+0000","last_became_peered":"2024-09-12T02:51:22.742156+0000","last_unstale":"2024-09-12T02:51:22.742837+0000","last_undegraded":"2024-09-12T02:51:22.742837+0000","last_fullsized":"2024-09-12T02:51:22.742837+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:13:28.713422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.737655+0000","last_change":"2024-09-12T02:51:21.743773+0000","last_active":"2024-09-12T02:51:22.737655+0000","last_peered":"2024-09-12T02:51:22.737655+0000","last_clean":"2024-09-12T02:51:22.737655+0000","last_became_active":"2024-09-12T02:51:21.743517+0000","last_became_peered":"2024-09-12T02:51:21.743517+0000","last_unstale":"2024-09-12T02:51:22.737655+0000","last_undegraded":"2024-09-12T02:51:22.737655+0000","last_fullsized":"2024-09-12T02:51:22.737655+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:47.084317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.747569+0000","last_change":"2024-09-12T02:51:22.747281+0000","last_active":"2024-09-12T02:51:22.747569+0000","last_peered":"2024-09-12T02:51:22.747569+0000","last_clean":"2024-09-12T02:51:22.747569+0000","last_became_active":"2024-09-12T02:51:22.746406+0000","last_became_peered":"2024-09-12T02:51:22.746406+0000","last_unstale":"2024-09-12T02:51:22.747569+0000","last_undegraded":"2024-09-12T02:51:22.747569+0000","last_fullsized":"2024-09-12T02:51:22.747569+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:56.773389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.739683+0000","last_change":"2024-09-12T02:51:21.742382+0000","last_active":"2024-09-12T02:51:22.739683+0000","last_peered":"2024-09-12T02:51:22.739683+0000","last_clean":"2024-09-12T02:51:22.739683+0000","last_became_active":"2024-09-12T02:51:21.742105+0000","last_became_peered":"2024-09-12T02:51:21.742105+0000","last_unstale":"2024-09-12T02:51:22.739683+0000","last_undegraded":"2024-09-12T02:51:22.739683+0000","last_fullsized":"2024-09-12T02:51:22.739683+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:44.315012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.745313+0000","last_change":"2024-09-12T02:51:22.745218+0000","last_active":"2024-09-12T02:51:22.745313+0000","last_peered":"2024-09-12T02:51:22.745313+0000","last_clean":"2024-09-12T02:51:22.745313+0000","last_became_active":"2024-09-12T02:51:22.744961+0000","last_became_peered":"2024-09-12T02:51:22.744961+0000","last_unstale":"2024-09-12T02:51:22.745313+0000","last_undegraded":"2024-09-12T02:51:22.745313+0000","last_fullsized":"2024-09-12T02:51:22.745313+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:38.107877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.732269+0000","last_change":"2024-09-12T02:51:21.735391+0000","last_active":"2024-09-12T02:51:22.732269+0000","last_peered":"2024-09-12T02:51:22.732269+0000","last_clean":"2024-09-12T02:51:22.732269+0000","last_became_active":"2024-09-12T02:51:21.735150+0000","last_became_peered":"2024-09-12T02:51:21.735150+0000","last_unstale":"2024-09-12T02:51:22.732269+0000","last_undegraded":"2024-09-12T02:51:22.732269+0000","last_fullsized":"2024-09-12T02:51:22.732269+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:51.367441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.753895+0000","last_change":"2024-09-12T02:51:22.751415+0000","last_active":"2024-09-12T02:51:22.753895+0000","last_peered":"2024-09-12T02:51:22.753895+0000","last_clean":"2024-09-12T02:51:22.753895+0000","last_became_active":"2024-09-12T02:51:22.750331+0000","last_became_peered":"2024-09-12T02:51:22.750331+0000","last_unstale":"2024-09-12T02:51:22.753895+0000","last_undegraded":"2024-09-12T02:51:22.753895+0000","last_fullsized":"2024-09-12T02:51:22.753895+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:00.985948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"166'2","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.753917+0000","last_change":"2024-09-12T02:51:21.744981+0000","last_active":"2024-09-12T02:51:22.753917+0000","last_peered":"2024-09-12T02:51:22.753917+0000","last_clean":"2024-09-12T02:51:22.753917+0000","last_became_active":"2024-09-12T02:51:21.744399+0000","last_became_peered":"2024-09-12T02:51:21.744399+0000","last_unstale":"2024-09-12T02:51:22.753917+0000","last_undegraded":"2024-09-12T02:51:22.753917+0000","last_fullsized":"2024-09-12T02:51:22.753917+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:47.474752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.749993+0000","last_change":"2024-09-12T02:51:22.749864+0000","last_active":"2024-09-12T02:51:22.749993+0000","last_peered":"2024-09-12T02:51:22.749993+0000","last_clean":"2024-09-12T02:51:22.749993+0000","last_became_active":"2024-09-12T02:51:22.748120+0000","last_became_peered":"2024-09-12T02:51:22.748120+0000","last_unstale":"2024-09-12T02:51:22.749993+0000","last_undegraded":"2024-09-12T02:51:22.749993+0000","last_fullsized":"2024-09-12T02:51:22.749993+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:02:05.188825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.734926+0000","last_change":"2024-09-12T02:51:21.742260+0000","last_active":"2024-09-12T02:51:22.734926+0000","last_peered":"2024-09-12T02:51:22.734926+0000","last_clean":"2024-09-12T02:51:22.734926+0000","last_became_active":"2024-09-12T02:51:21.742005+0000","last_became_peered":"2024-09-12T02:51:21.742005+0000","last_unstale":"2024-09-12T02:51:22.734926+0000","last_undegraded":"2024-09-12T02:51:22.734926+0000","last_fullsized":"2024-09-12T02:51:22.734926+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:39.836642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.743896+0000","last_change":"2024-09-12T02:51:22.742956+0000","last_active":"2024-09-12T02:51:22.743896+0000","last_peered":"2024-09-12T02:51:22.743896+0000","last_clean":"2024-09-12T02:51:22.743896+0000","last_became_active":"2024-09-12T02:51:22.742683+0000","last_became_peered":"2024-09-12T02:51:22.742683+0000","last_unstale":"2024-09-12T02:51:22.743896+0000","last_undegraded":"2024-09-12T02:51:22.743896+0000","last_fullsized":"2024-09-12T02:51:22.743896+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:41.001812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.734380+0000","last_change":"2024-09-12T02:51:21.739875+0000","last_active":"2024-09-12T02:51:22.734380+0000","last_peered":"2024-09-12T02:51:22.734380+0000","last_clean":"2024-09-12T02:51:22.734380+0000","last_became_active":"2024-09-12T02:51:21.738887+0000","last_became_peered":"2024-09-12T02:51:21.738887+0000","last_unstale":"2024-09-12T02:51:22.734380+0000","last_undegraded":"2024-09-12T02:51:22.734380+0000","last_fullsized":"2024-09-12T02:51:22.734380+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:15:08.067753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.745425+0000","last_change":"2024-09-12T02:51:22.745312+0000","last_active":"2024-09-12T02:51:22.745425+0000","last_peered":"2024-09-12T02:51:22.745425+0000","last_clean":"2024-09-12T02:51:22.745425+0000","last_became_active":"2024-09-12T02:51:22.744218+0000","last_became_peered":"2024-09-12T02:51:22.744218+0000","last_unstale":"2024-09-12T02:51:22.745425+0000","last_undegraded":"2024-09-12T02:51:22.745425+0000","last_fullsized":"2024-09-12T02:51:22.745425+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:38.573915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.733094+0000","last_change":"2024-09-12T02:51:21.738717+0000","last_active":"2024-09-12T02:51:22.733094+0000","last_peered":"2024-09-12T02:51:22.733094+0000","last_clean":"2024-09-12T02:51:22.733094+0000","last_became_active":"2024-09-12T02:51:21.738397+0000","last_became_peered":"2024-09-12T02:51:21.738397+0000","last_unstale":"2024-09-12T02:51:22.733094+0000","last_undegraded":"2024-09-12T02:51:22.733094+0000","last_fullsized":"2024-09-12T02:51:22.733094+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:24.230127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.745138+0000","last_change":"2024-09-12T02:51:22.744989+0000","last_active":"2024-09-12T02:51:22.745138+0000","last_peered":"2024-09-12T02:51:22.745138+0000","last_clean":"2024-09-12T02:51:22.745138+0000","last_became_active":"2024-09-12T02:51:22.744759+0000","last_became_peered":"2024-09-12T02:51:22.744759+0000","last_unstale":"2024-09-12T02:51:22.745138+0000","last_undegraded":"2024-09-12T02:51:22.745138+0000","last_fullsized":"2024-09-12T02:51:22.745138+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:37.346007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.732888+0000","last_change":"2024-09-12T02:51:21.732325+0000","last_active":"2024-09-12T02:51:22.732888+0000","last_peered":"2024-09-12T02:51:22.732888+0000","last_clean":"2024-09-12T02:51:22.732888+0000","last_became_active":"2024-09-12T02:51:21.732084+0000","last_became_peered":"2024-09-12T02:51:21.732084+0000","last_unstale":"2024-09-12T02:51:22.732888+0000","last_undegraded":"2024-09-12T02:51:22.732888+0000","last_fullsized":"2024-09-12T02:51:22.732888+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:27.555314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.742633+0000","last_change":"2024-09-12T02:51:22.742312+0000","last_active":"2024-09-12T02:51:22.742633+0000","last_peered":"2024-09-12T02:51:22.742633+0000","last_clean":"2024-09-12T02:51:22.742633+0000","last_became_active":"2024-09-12T02:51:22.742079+0000","last_became_peered":"2024-09-12T02:51:22.742079+0000","last_unstale":"2024-09-12T02:51:22.742633+0000","last_undegraded":"2024-09-12T02:51:22.742633+0000","last_fullsized":"2024-09-12T02:51:22.742633+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:34.624088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.743967+0000","last_change":"2024-09-12T02:51:21.745202+0000","last_active":"2024-09-12T02:51:22.743967+0000","last_peered":"2024-09-12T02:51:22.743967+0000","last_clean":"2024-09-12T02:51:22.743967+0000","last_became_active":"2024-09-12T02:51:21.744714+0000","last_became_peered":"2024-09-12T02:51:21.744714+0000","last_unstale":"2024-09-12T02:51:22.743967+0000","last_undegraded":"2024-09-12T02:51:22.743967+0000","last_fullsized":"2024-09-12T02:51:22.743967+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:34.143958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.750167+0000","last_change":"2024-09-12T02:51:22.747085+0000","last_active":"2024-09-12T02:51:22.750167+0000","last_peered":"2024-09-12T02:51:22.750167+0000","last_clean":"2024-09-12T02:51:22.750167+0000","last_became_active":"2024-09-12T02:51:22.742897+0000","last_became_peered":"2024-09-12T02:51:22.742897+0000","last_unstale":"2024-09-12T02:51:22.750167+0000","last_undegraded":"2024-09-12T02:51:22.750167+0000","last_fullsized":"2024-09-12T02:51:22.750167+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:50.707814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.730550+0000","last_change":"2024-09-12T02:51:21.738403+0000","last_active":"2024-09-12T02:51:22.730550+0000","last_peered":"2024-09-12T02:51:22.730550+0000","last_clean":"2024-09-12T02:51:22.730550+0000","last_became_active":"2024-09-12T02:51:21.737999+0000","last_became_peered":"2024-09-12T02:51:21.737999+0000","last_unstale":"2024-09-12T02:51:22.730550+0000","last_undegraded":"2024-09-12T02:51:22.730550+0000","last_fullsized":"2024-09-12T02:51:22.730550+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:23.754402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.753868+0000","last_change":"2024-09-12T02:51:22.750589+0000","last_active":"2024-09-12T02:51:22.753868+0000","last_peered":"2024-09-12T02:51:22.753868+0000","last_clean":"2024-09-12T02:51:22.753868+0000","last_became_active":"2024-09-12T02:51:22.744415+0000","last_became_peered":"2024-09-12T02:51:22.744415+0000","last_unstale":"2024-09-12T02:51:22.753868+0000","last_undegraded":"2024-09-12T02:51:22.753868+0000","last_fullsized":"2024-09-12T02:51:22.753868+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:59.718482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.730255+0000","last_change":"2024-09-12T02:51:21.743198+0000","last_active":"2024-09-12T02:51:22.730255+0000","last_peered":"2024-09-12T02:51:22.730255+0000","last_clean":"2024-09-12T02:51:22.730255+0000","last_became_active":"2024-09-12T02:51:21.742644+0000","last_became_peered":"2024-09-12T02:51:21.742644+0000","last_unstale":"2024-09-12T02:51:22.730255+0000","last_undegraded":"2024-09-12T02:51:22.730255+0000","last_fullsized":"2024-09-12T02:51:22.730255+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:18.462881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.743943+0000","last_change":"2024-09-12T02:51:22.743615+0000","last_active":"2024-09-12T02:51:22.743943+0000","last_peered":"2024-09-12T02:51:22.743943+0000","last_clean":"2024-09-12T02:51:22.743943+0000","last_became_active":"2024-09-12T02:51:22.743408+0000","last_became_peered":"2024-09-12T02:51:22.743408+0000","last_unstale":"2024-09-12T02:51:22.743943+0000","last_undegraded":"2024-09-12T02:51:22.743943+0000","last_fullsized":"2024-09-12T02:51:22.743943+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:21.714170+0000","last_clean_scrub_stamp":"2024-09-12T02:51:21.714170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:53.928430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"166'3","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.755851+0000","last_change":"2024-09-12T02:51:21.735657+0000","last_active":"2024-09-12T02:51:22.755851+0000","last_peered":"2024-09-12T02:51:22.755851+0000","last_clean":"2024-09-12T02:51:22.755851+0000","last_became_active":"2024-09-12T02:51:21.734801+0000","last_became_peered":"2024-09-12T02:51:21.734801+0000","last_unstale":"2024-09-12T02:51:22.755851+0000","last_undegraded":"2024-09-12T02:51:22.755851+0000","last_fullsized":"2024-09-12T02:51:22.755851+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:51:20.709862+0000","last_clean_scrub_stamp":"2024-09-12T02:51:20.709862+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:03.307507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":450,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-12T02:51:22.737762+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:51:22.737762+0000","last_peered":"2024-09-12T02:51:22.737762+0000","last_clean":"2024-09-12T02:51:22.737762+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:51:22.737762+0000","last_undegraded":"2024-09-12T02:51:22.737762+0000","last_fullsized":"2024-09-12T02:51:22.737762+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:25.823876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574966,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1483,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193828,"statfs":{"total":200000000,"available":198480861,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":899,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194412,"statfs":{"total":200000000,"available":199078656,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":899,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194412,"statfs":{"total":200000000,"available":199078656,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574966,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":899,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194412,"statfs":{"total":200000000,"available":199078656,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574966,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":899,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194412,"statfs":{"total":200000000,"available":199078656,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574966,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":908,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194404,"statfs":{"total":200000000,"available":199070199,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574966,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":899,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194412,"statfs":{"total":200000000,"available":199078656,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574966,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1476,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193836,"statfs":{"total":200000000,"available":198488288,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:51:27.315 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:51:27.315 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T02:51:27.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.511+0000 7f49b8c00640 1 Processor -- start 2024-09-12T02:51:27.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.511+0000 7f49b8c00640 1 -- start start 2024-09-12T02:51:27.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.512+0000 7f49b8c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f49b41466f0 0x7f49b40b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:27.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.512+0000 7f49b8c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49b4071840 0x7f49b4071cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:27.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.512+0000 7f49b8c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49b40b3af0 con 0x7f49b41605e0 2024-09-12T02:51:27.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.512+0000 7f49b8c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f49b40b3dd0 con 0x7f49b41466f0 2024-09-12T02:51:27.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.512+0000 7f49b8c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f49b40b40b0 con 0x7f49b4071840 2024-09-12T02:51:27.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.513+0000 7f49b1e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f49b41466f0 0x7f49b40b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:27.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.513+0000 7f49b1400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f49b41605e0 0x7f49b4160a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.112:44002/0 (socket says 172.21.15.112:44002) 2024-09-12T02:51:27.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.513+0000 7f49b1400640 1 -- 172.21.15.112:0/3108043324 learned_addr learned my addr 172.21.15.112:0/3108043324 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:51:27.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.513+0000 7f49b2800640 1 --2- 172.21.15.112:0/3108043324 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49b4071840 0x7f49b4071cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:27.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.513+0000 7f49b1e00640 1 -- 172.21.15.112:0/3108043324 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49b4071840 msgr2=0x7f49b4071cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:27.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.513+0000 7f49b1e00640 1 --2- 172.21.15.112:0/3108043324 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49b4071840 0x7f49b4071cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:27.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.513+0000 7f49b1e00640 1 -- 172.21.15.112:0/3108043324 >> v1:172.21.15.137:6789/0 conn(0x7f49b41605e0 legacy=0x7f49b4160a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:27.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.513+0000 7f49b1e00640 1 -- 172.21.15.112:0/3108043324 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49b40b4390 con 0x7f49b41466f0 2024-09-12T02:51:27.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.514+0000 7f49b1e00640 1 --2- 172.21.15.112:0/3108043324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49b41466f0 0x7f49b40b48b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f49a40097a0 tx=0x7f49a402a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0af9635aca23283 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:27.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.515+0000 7f49b0a00640 1 -- 172.21.15.112:0/3108043324 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a4037070 con 0x7f49b41466f0 2024-09-12T02:51:27.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.515+0000 7f49b0a00640 1 -- 172.21.15.112:0/3108043324 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49a402ae40 con 0x7f49b41466f0 2024-09-12T02:51:27.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.515+0000 7f49b0a00640 1 -- 172.21.15.112:0/3108043324 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a4032660 con 0x7f49b41466f0 2024-09-12T02:51:27.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.515+0000 7f49b8c00640 1 -- 172.21.15.112:0/3108043324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49b41466f0 msgr2=0x7f49b40b48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:27.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.515+0000 7f49b8c00640 1 --2- 172.21.15.112:0/3108043324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49b41466f0 0x7f49b40b48b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f49a40097a0 tx=0x7f49a402a0f0 comp rx=0 tx=0).stop 2024-09-12T02:51:27.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.516+0000 7f49b8c00640 1 -- 172.21.15.112:0/3108043324 shutdown_connections 2024-09-12T02:51:27.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.516+0000 7f49b8c00640 1 --2- 172.21.15.112:0/3108043324 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49b4071840 0x7f49b4071cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:27.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.516+0000 7f49b8c00640 1 --2- 172.21.15.112:0/3108043324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49b41466f0 0x7f49b40b48b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:27.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.516+0000 7f49b8c00640 1 -- 172.21.15.112:0/3108043324 >> 172.21.15.112:0/3108043324 conn(0x7f49b40b28a0 msgr2=0x7f49b40b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:27.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.516+0000 7f49b8c00640 1 -- 172.21.15.112:0/3108043324 shutdown_connections 2024-09-12T02:51:27.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.516+0000 7f49b8c00640 1 -- 172.21.15.112:0/3108043324 wait complete. 2024-09-12T02:51:27.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.517+0000 7f49b8c00640 1 Processor -- start 2024-09-12T02:51:27.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.517+0000 7f49b8c00640 1 -- start start 2024-09-12T02:51:27.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.518+0000 7f49b8c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49b4071840 0x7f49b415cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:27.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.518+0000 7f49b8c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49b41466f0 0x7f49b413bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:27.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.518+0000 7f49b8c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49b41605e0 0x7f49b413c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:27.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.518+0000 7f49b8c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f49b4072390 con 0x7f49b41605e0 2024-09-12T02:51:27.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.518+0000 7f49b8c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f49b4072210 con 0x7f49b4071840 2024-09-12T02:51:27.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.518+0000 7f49b8c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f49b415e1b0 con 0x7f49b41466f0 2024-09-12T02:51:27.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.519+0000 7f49b2800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49b41605e0 0x7f49b413c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:27.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.519+0000 7f49b2800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49b41605e0 0x7f49b413c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36780/0 (socket says 172.21.15.112:36780) 2024-09-12T02:51:27.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.519+0000 7f49b2800640 1 -- 172.21.15.112:0/1489301633 learned_addr learned my addr 172.21.15.112:0/1489301633 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:27.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.519+0000 7f49b1e00640 1 --2- 172.21.15.112:0/1489301633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49b4071840 0x7f49b415cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:27.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.519+0000 7f49b1400640 1 --2- 172.21.15.112:0/1489301633 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49b41466f0 0x7f49b413bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:27.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.519+0000 7f49b2800640 1 -- 172.21.15.112:0/1489301633 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49b41466f0 msgr2=0x7f49b413bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:27.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.519+0000 7f49b2800640 1 --2- 172.21.15.112:0/1489301633 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49b41466f0 0x7f49b413bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:27.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.519+0000 7f49b2800640 1 -- 172.21.15.112:0/1489301633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49b4071840 msgr2=0x7f49b415cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:27.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.519+0000 7f49b2800640 1 --2- 172.21.15.112:0/1489301633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49b4071840 0x7f49b415cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:27.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.519+0000 7f49b2800640 1 -- 172.21.15.112:0/1489301633 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49b413d3b0 con 0x7f49b41605e0 2024-09-12T02:51:27.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.519+0000 7f49b2800640 1 --2- 172.21.15.112:0/1489301633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49b41605e0 0x7f49b413c4b0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f49ac00efc0 tx=0x7f49ac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:27.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.520+0000 7f49aa000640 1 -- 172.21.15.112:0/1489301633 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ac018020 con 0x7f49b41605e0 2024-09-12T02:51:27.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.520+0000 7f49aa000640 1 -- 172.21.15.112:0/1489301633 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49ac014480 con 0x7f49b41605e0 2024-09-12T02:51:27.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.520+0000 7f49aa000640 1 -- 172.21.15.112:0/1489301633 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ac014870 con 0x7f49b41605e0 2024-09-12T02:51:27.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.520+0000 7f49b8c00640 1 -- 172.21.15.112:0/1489301633 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49b413cb10 con 0x7f49b41605e0 2024-09-12T02:51:27.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.520+0000 7f49b8c00640 1 -- 172.21.15.112:0/1489301633 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49b413d0d0 con 0x7f49b41605e0 2024-09-12T02:51:27.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.521+0000 7f49b8c00640 1 -- 172.21.15.112:0/1489301633 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49b4071cd0 con 0x7f49b41605e0 2024-09-12T02:51:27.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.522+0000 7f49aa000640 1 -- 172.21.15.112:0/1489301633 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f49ac005d10 con 0x7f49b41605e0 2024-09-12T02:51:27.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.523+0000 7f49aa000640 1 --2- 172.21.15.112:0/1489301633 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f499406be30 0x7f499406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:27.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.523+0000 7f49aa000640 1 -- 172.21.15.112:0/1489301633 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f49ac08b870 con 0x7f49b41605e0 2024-09-12T02:51:27.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.523+0000 7f49b1e00640 1 --2- 172.21.15.112:0/1489301633 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f499406be30 0x7f499406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:27.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.524+0000 7f49b1e00640 1 --2- 172.21.15.112:0/1489301633 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f499406be30 0x7f499406e2f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f49a4034000 tx=0x7f49a402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:27.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.527+0000 7f49aa000640 1 -- 172.21.15.112:0/1489301633 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f49ac022070 con 0x7f49b41605e0 2024-09-12T02:51:27.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.770+0000 7f49b8c00640 1 -- 172.21.15.112:0/1489301633 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f49b40b2fc0 con 0x7f49b41605e0 2024-09-12T02:51:27.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.773+0000 7f49aa000640 1 -- 172.21.15.112:0/1489301633 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) ==== 190+0+147 (secure 0 0 0) 0x7f49ac010040 con 0x7f49b41605e0 2024-09-12T02:51:27.774 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-09-12T02:51:27.774 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDUVOJmaG86ExAAD0SOlJOsLpoQZlgPJIPaxA== 2024-09-12T02:51:27.774 INFO:teuthology.orchestra.run.smithi112.stdout: caps mds = "allow" 2024-09-12T02:51:27.775 INFO:teuthology.orchestra.run.smithi112.stdout: caps mon = "allow r" 2024-09-12T02:51:27.775 INFO:teuthology.orchestra.run.smithi112.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T02:51:27.775 INFO:teuthology.orchestra.run.smithi112.stderr:updated caps for client.0 2024-09-12T02:51:27.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.776+0000 7f49b8c00640 1 -- 172.21.15.112:0/1489301633 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f499406be30 msgr2=0x7f499406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:27.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.776+0000 7f49b8c00640 1 --2- 172.21.15.112:0/1489301633 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f499406be30 0x7f499406e2f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f49a4034000 tx=0x7f49a402e000 comp rx=0 tx=0).stop 2024-09-12T02:51:27.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.776+0000 7f49b8c00640 1 -- 172.21.15.112:0/1489301633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49b41605e0 msgr2=0x7f49b413c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:27.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.776+0000 7f49b8c00640 1 --2- 172.21.15.112:0/1489301633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49b41605e0 0x7f49b413c4b0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f49ac00efc0 tx=0x7f49ac00c490 comp rx=0 tx=0).stop 2024-09-12T02:51:27.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.776+0000 7f49b8c00640 1 -- 172.21.15.112:0/1489301633 shutdown_connections 2024-09-12T02:51:27.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.776+0000 7f49b8c00640 1 --2- 172.21.15.112:0/1489301633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49b41605e0 0x7f49b413c4b0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:27.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.776+0000 7f49b8c00640 1 --2- 172.21.15.112:0/1489301633 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49b41466f0 0x7f49b413bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:27.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.776+0000 7f49b8c00640 1 --2- 172.21.15.112:0/1489301633 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f499406be30 0x7f499406e2f0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:27.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.776+0000 7f49b8c00640 1 --2- 172.21.15.112:0/1489301633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49b4071840 0x7f49b415cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:27.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.776+0000 7f49b8c00640 1 -- 172.21.15.112:0/1489301633 >> 172.21.15.112:0/1489301633 conn(0x7f49b40b28a0 msgr2=0x7f49b4140a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:27.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.776+0000 7f49b8c00640 1 -- 172.21.15.112:0/1489301633 shutdown_connections 2024-09-12T02:51:27.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.776+0000 7f49b8c00640 1 -- 172.21.15.112:0/1489301633 wait complete. 2024-09-12T02:51:27.792 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:51:27.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.943+0000 7f9d53200640 1 Processor -- start 2024-09-12T02:51:27.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.943+0000 7f9d53200640 1 -- start start 2024-09-12T02:51:27.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.944+0000 7f9d53200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9d5415a450 0x7f9d5406e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:27.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.944+0000 7f9d53200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d5406e990 con 0x7f9d540ce460 2024-09-12T02:51:27.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.944+0000 7f9d53200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d5406ec70 con 0x7f9d540d0f30 2024-09-12T02:51:27.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.944+0000 7f9d53200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f9d54071eb0 con 0x7f9d5415a450 2024-09-12T02:51:27.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.944+0000 7f9d51e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9d5415a450 0x7f9d5406e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:27.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.944+0000 7f9d51e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9d5415a450 0x7f9d5406e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36782/0 (socket says 172.21.15.112:36782) 2024-09-12T02:51:27.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.944+0000 7f9d51e00640 1 -- 172.21.15.112:0/3228067800 learned_addr learned my addr 172.21.15.112:0/3228067800 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:27.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.944+0000 7f9d51400640 1 --1- 172.21.15.112:0/3228067800 >> v1:172.21.15.112:6789/0 conn(0x7f9d540ce460 0x7f9d540d0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52224/0 (socket says 172.21.15.112:52224) 2024-09-12T02:51:27.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.945+0000 7f9d51e00640 1 -- 172.21.15.112:0/3228067800 >> v1:172.21.15.137:6789/0 conn(0x7f9d540d0f30 legacy=0x7f9d54072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:27.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.945+0000 7f9d51e00640 1 -- 172.21.15.112:0/3228067800 >> v1:172.21.15.112:6789/0 conn(0x7f9d540ce460 legacy=0x7f9d540d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:27.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.945+0000 7f9d51e00640 1 -- 172.21.15.112:0/3228067800 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d54072100 con 0x7f9d5415a450 2024-09-12T02:51:27.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.946+0000 7f9d51e00640 1 --2- 172.21.15.112:0/3228067800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d5415a450 0x7f9d5406e140 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f9d44009e50 tx=0x7f9d4402a7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c5a26a8d3d80696 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:27.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.946+0000 7f9d50a00640 1 -- 172.21.15.112:0/3228067800 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d44036070 con 0x7f9d5415a450 2024-09-12T02:51:27.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.946+0000 7f9d50a00640 1 -- 172.21.15.112:0/3228067800 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d44031600 con 0x7f9d5415a450 2024-09-12T02:51:27.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.946+0000 7f9d50a00640 1 -- 172.21.15.112:0/3228067800 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d440319d0 con 0x7f9d5415a450 2024-09-12T02:51:27.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.946+0000 7f9d53200640 1 -- 172.21.15.112:0/3228067800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d5415a450 msgr2=0x7f9d5406e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:27.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.946+0000 7f9d53200640 1 --2- 172.21.15.112:0/3228067800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d5415a450 0x7f9d5406e140 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f9d44009e50 tx=0x7f9d4402a7f0 comp rx=0 tx=0).stop 2024-09-12T02:51:27.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.946+0000 7f9d53200640 1 -- 172.21.15.112:0/3228067800 shutdown_connections 2024-09-12T02:51:27.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.946+0000 7f9d53200640 1 --2- 172.21.15.112:0/3228067800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d5415a450 0x7f9d5406e140 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:27.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.946+0000 7f9d53200640 1 -- 172.21.15.112:0/3228067800 >> 172.21.15.112:0/3228067800 conn(0x7f9d5406bbd0 msgr2=0x7f9d5406bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:27.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.947+0000 7f9d53200640 1 -- 172.21.15.112:0/3228067800 shutdown_connections 2024-09-12T02:51:27.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.947+0000 7f9d53200640 1 -- 172.21.15.112:0/3228067800 wait complete. 2024-09-12T02:51:27.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.948+0000 7f9d53200640 1 Processor -- start 2024-09-12T02:51:27.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.948+0000 7f9d53200640 1 -- start start 2024-09-12T02:51:27.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.949+0000 7f9d53200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d540ce460 0x7f9d54150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:27.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.949+0000 7f9d53200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d540d0f30 0x7f9d541f51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:27.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.949+0000 7f9d53200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9d5415a450 0x7f9d541e6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:27.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.949+0000 7f9d53200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5415a830 con 0x7f9d540ce460 2024-09-12T02:51:27.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.949+0000 7f9d53200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5406e680 con 0x7f9d540d0f30 2024-09-12T02:51:27.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.949+0000 7f9d53200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9d5415db60 con 0x7f9d5415a450 2024-09-12T02:51:27.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.949+0000 7f9d51e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d540ce460 0x7f9d54150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:27.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.949+0000 7f9d51e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d540ce460 0x7f9d54150110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36786/0 (socket says 172.21.15.112:36786) 2024-09-12T02:51:27.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.949+0000 7f9d51e00640 1 -- 172.21.15.112:0/3334569990 learned_addr learned my addr 172.21.15.112:0/3334569990 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:27.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.950+0000 7f9d51e00640 1 -- 172.21.15.112:0/3334569990 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9d5415a450 msgr2=0x7f9d541e6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:27.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.950+0000 7f9d51e00640 1 --2- 172.21.15.112:0/3334569990 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9d5415a450 0x7f9d541e6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:27.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.950+0000 7f9d51e00640 1 -- 172.21.15.112:0/3334569990 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d540d0f30 msgr2=0x7f9d541f51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:27.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.950+0000 7f9d51e00640 1 --2- 172.21.15.112:0/3334569990 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d540d0f30 0x7f9d541f51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:27.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.950+0000 7f9d51e00640 1 -- 172.21.15.112:0/3334569990 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d541f5ba0 con 0x7f9d540ce460 2024-09-12T02:51:27.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.950+0000 7f9d51e00640 1 --2- 172.21.15.112:0/3334569990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d540ce460 0x7f9d54150110 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f9d44034040 tx=0x7f9d44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:27.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.950+0000 7f9d4a000640 1 -- 172.21.15.112:0/3334569990 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4403f070 con 0x7f9d540ce460 2024-09-12T02:51:27.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.950+0000 7f9d4a000640 1 -- 172.21.15.112:0/3334569990 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d4403b690 con 0x7f9d540ce460 2024-09-12T02:51:27.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.950+0000 7f9d53200640 1 -- 172.21.15.112:0/3334569990 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d541f5e80 con 0x7f9d540ce460 2024-09-12T02:51:27.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.950+0000 7f9d4a000640 1 -- 172.21.15.112:0/3334569990 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d44036040 con 0x7f9d540ce460 2024-09-12T02:51:27.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.950+0000 7f9d53200640 1 -- 172.21.15.112:0/3334569990 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d541e66a0 con 0x7f9d540ce460 2024-09-12T02:51:27.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.952+0000 7f9d53200640 1 -- 172.21.15.112:0/3334569990 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d5406f360 con 0x7f9d540ce460 2024-09-12T02:51:27.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.952+0000 7f9d4a000640 1 -- 172.21.15.112:0/3334569990 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9d44042070 con 0x7f9d540ce460 2024-09-12T02:51:27.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.953+0000 7f9d4a000640 1 --2- 172.21.15.112:0/3334569990 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9d3406be30 0x7f9d3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:27.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.953+0000 7f9d4a000640 1 -- 172.21.15.112:0/3334569990 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f9d440ab840 con 0x7f9d540ce460 2024-09-12T02:51:27.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.953+0000 7f9d51400640 1 --2- 172.21.15.112:0/3334569990 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9d3406be30 0x7f9d3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:27.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.954+0000 7f9d51400640 1 --2- 172.21.15.112:0/3334569990 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9d3406be30 0x7f9d3406e2f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9d40000f60 tx=0x7f9d40007a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:27.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:27.957+0000 7f9d4a000640 1 -- 172.21.15.112:0/3334569990 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9d5406f360 con 0x7f9d540ce460 2024-09-12T02:51:28.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.165+0000 7f9d53200640 1 -- 172.21.15.112:0/3334569990 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d5406e140 con 0x7f9d540ce460 2024-09-12T02:51:28.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.166+0000 7f9d4a000640 1 -- 172.21.15.112:0/3334569990 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5236 (secure 0 0 0) 0x7f9d4407a150 con 0x7f9d540ce460 2024-09-12T02:51:28.167 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:51:28.167 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":86,"btime":"2024-09-12T02:51:25:753588+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/1180447882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1180447882},{"type":"v1","addr":"172.21.15.112:6836","nonce":1180447882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":6916,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2975519871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2975519871},{"type":"v1","addr":"172.21.15.137:6835","nonce":2975519871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7554,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2629863369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2629863369},{"type":"v1","addr":"172.21.15.112:6837","nonce":2629863369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:51:22.139735+0000","modified":"2024-09-12T02:51:25.151523+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7560},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7560":{"gid":7560,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6834/245886809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":245886809},{"type":"v1","addr":"172.21.15.137:6834","nonce":245886809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7560,"qdb_cluster":[7560]},"id":10}]} 2024-09-12T02:51:28.167 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 86 2024-09-12T02:51:28.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.168+0000 7f9d53200640 1 -- 172.21.15.112:0/3334569990 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9d3406be30 msgr2=0x7f9d3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:28.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.168+0000 7f9d53200640 1 --2- 172.21.15.112:0/3334569990 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9d3406be30 0x7f9d3406e2f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9d40000f60 tx=0x7f9d40007a00 comp rx=0 tx=0).stop 2024-09-12T02:51:28.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.168+0000 7f9d53200640 1 -- 172.21.15.112:0/3334569990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d540ce460 msgr2=0x7f9d54150110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:28.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.168+0000 7f9d53200640 1 --2- 172.21.15.112:0/3334569990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d540ce460 0x7f9d54150110 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f9d44034040 tx=0x7f9d44004a40 comp rx=0 tx=0).stop 2024-09-12T02:51:28.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.168+0000 7f9d53200640 1 -- 172.21.15.112:0/3334569990 shutdown_connections 2024-09-12T02:51:28.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.168+0000 7f9d53200640 1 --2- 172.21.15.112:0/3334569990 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9d5415a450 0x7f9d541e6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.168+0000 7f9d53200640 1 --2- 172.21.15.112:0/3334569990 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9d3406be30 0x7f9d3406e2f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.168+0000 7f9d53200640 1 --2- 172.21.15.112:0/3334569990 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d540d0f30 0x7f9d541f51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.168+0000 7f9d53200640 1 --2- 172.21.15.112:0/3334569990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d540ce460 0x7f9d54150110 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.168+0000 7f9d53200640 1 -- 172.21.15.112:0/3334569990 >> 172.21.15.112:0/3334569990 conn(0x7f9d5406bbd0 msgr2=0x7f9d540d0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:28.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.168+0000 7f9d53200640 1 -- 172.21.15.112:0/3334569990 shutdown_connections 2024-09-12T02:51:28.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.168+0000 7f9d53200640 1 -- 172.21.15.112:0/3334569990 wait complete. 2024-09-12T02:51:28.330 INFO:tasks.ceph.mds.b.smithi137.stderr:2024-09-12T02:51:28.329+0000 7f8914e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:51:28.587 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 86, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:51:22.139735+0000', 'modified': '2024-09-12T02:51:25.151523+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7560}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7560': {'gid': 7560, 'name': 'b', 'rank': 0, 'incarnation': 82, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.137:6834/245886809', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6833', 'nonce': 245886809}, {'type': 'v1', 'addr': '172.21.15.137:6834', 'nonce': 245886809}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7560, 'qdb_cluster': [7560]} 2024-09-12T02:51:28.587 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:51:28.588 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-12T02:51:28.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.743+0000 7f0815600640 1 Processor -- start 2024-09-12T02:51:28.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.744+0000 7f0815600640 1 -- start start 2024-09-12T02:51:28.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.745+0000 7f0815600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f081015b9d0 0x7f08100b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.745+0000 7f0815600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f081006f600 0x7f08100728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.745+0000 7f0815600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08100b54a0 con 0x7f08100b45d0 2024-09-12T02:51:28.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.745+0000 7f0815600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f08100b4a30 con 0x7f081006f600 2024-09-12T02:51:28.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.745+0000 7f0815600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f08100b3af0 con 0x7f081015b9d0 2024-09-12T02:51:28.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.745+0000 7f080f400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f081006f600 0x7f08100728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.745+0000 7f080f400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f081006f600 0x7f08100728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36788/0 (socket says 172.21.15.112:36788) 2024-09-12T02:51:28.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.745+0000 7f080f400640 1 -- 172.21.15.112:0/4164419350 learned_addr learned my addr 172.21.15.112:0/4164419350 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:28.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.745+0000 7f0807e00640 1 --1- 172.21.15.112:0/4164419350 >> v1:172.21.15.137:6789/0 conn(0x7f08100b45d0 0x7f081006eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.112:44020/0 (socket says 172.21.15.112:44020) 2024-09-12T02:51:28.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.745+0000 7f080ea00640 1 --2- 172.21.15.112:0/4164419350 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f081015b9d0 0x7f08100b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.746+0000 7f080f400640 1 -- 172.21.15.112:0/4164419350 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f081015b9d0 msgr2=0x7f08100b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:28.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.746+0000 7f080f400640 1 --2- 172.21.15.112:0/4164419350 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f081015b9d0 0x7f08100b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.746+0000 7f080f400640 1 -- 172.21.15.112:0/4164419350 >> v1:172.21.15.137:6789/0 conn(0x7f08100b45d0 legacy=0x7f081006eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:28.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.746+0000 7f080e000640 1 -- 172.21.15.112:0/4164419350 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3950295703 0 0) 0x7f08100b54a0 con 0x7f08100b45d0 2024-09-12T02:51:28.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.746+0000 7f080f400640 1 -- 172.21.15.112:0/4164419350 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08100b3dd0 con 0x7f081006f600 2024-09-12T02:51:28.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.747+0000 7f080f400640 1 --2- 172.21.15.112:0/4164419350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f081006f600 0x7f08100728c0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f080800d150 tx=0x7f080802c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd34b3b0a9335a07 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:28.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.747+0000 7f080e000640 1 -- 172.21.15.112:0/4164419350 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0808009600 con 0x7f081006f600 2024-09-12T02:51:28.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.747+0000 7f080e000640 1 -- 172.21.15.112:0/4164419350 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0808037070 con 0x7f081006f600 2024-09-12T02:51:28.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.747+0000 7f080e000640 1 -- 172.21.15.112:0/4164419350 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08080099c0 con 0x7f081006f600 2024-09-12T02:51:28.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.747+0000 7f0815600640 1 -- 172.21.15.112:0/4164419350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f081006f600 msgr2=0x7f08100728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:28.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.747+0000 7f0815600640 1 --2- 172.21.15.112:0/4164419350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f081006f600 0x7f08100728c0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f080800d150 tx=0x7f080802c930 comp rx=0 tx=0).stop 2024-09-12T02:51:28.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.747+0000 7f0815600640 1 -- 172.21.15.112:0/4164419350 shutdown_connections 2024-09-12T02:51:28.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.747+0000 7f0815600640 1 --2- 172.21.15.112:0/4164419350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f081006f600 0x7f08100728c0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.747+0000 7f0815600640 1 --2- 172.21.15.112:0/4164419350 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f081015b9d0 0x7f08100b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.747+0000 7f0815600640 1 -- 172.21.15.112:0/4164419350 >> 172.21.15.112:0/4164419350 conn(0x7f081006bbd0 msgr2=0x7f081006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:28.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.748+0000 7f0815600640 1 -- 172.21.15.112:0/4164419350 shutdown_connections 2024-09-12T02:51:28.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.748+0000 7f0815600640 1 -- 172.21.15.112:0/4164419350 wait complete. 2024-09-12T02:51:28.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.749+0000 7f0815600640 1 Processor -- start 2024-09-12T02:51:28.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.749+0000 7f0815600640 1 -- start start 2024-09-12T02:51:28.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.750+0000 7f0815600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f081006f600 0x7f0810142360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.750+0000 7f0815600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08100b45d0 0x7f0810158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.750+0000 7f0815600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f081015b9d0 0x7f081006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.750+0000 7f0815600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f081015bf30 con 0x7f081015b9d0 2024-09-12T02:51:28.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.750+0000 7f0815600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f081015bdb0 con 0x7f081006f600 2024-09-12T02:51:28.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.750+0000 7f0815600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f08100cdcd0 con 0x7f08100b45d0 2024-09-12T02:51:28.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.750+0000 7f080f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f081015b9d0 0x7f081006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.750+0000 7f080f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f081015b9d0 0x7f081006e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36792/0 (socket says 172.21.15.112:36792) 2024-09-12T02:51:28.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.750+0000 7f080f400640 1 -- 172.21.15.112:0/859685608 learned_addr learned my addr 172.21.15.112:0/859685608 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:28.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.751+0000 7f080ea00640 1 --2- 172.21.15.112:0/859685608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f081006f600 0x7f0810142360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.751+0000 7f0807e00640 1 --2- 172.21.15.112:0/859685608 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08100b45d0 0x7f0810158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.751+0000 7f080f400640 1 -- 172.21.15.112:0/859685608 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08100b45d0 msgr2=0x7f0810158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:28.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.751+0000 7f080f400640 1 --2- 172.21.15.112:0/859685608 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08100b45d0 0x7f0810158fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.751+0000 7f080f400640 1 -- 172.21.15.112:0/859685608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f081006f600 msgr2=0x7f0810142360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:28.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.751+0000 7f080f400640 1 --2- 172.21.15.112:0/859685608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f081006f600 0x7f0810142360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.751+0000 7f080f400640 1 -- 172.21.15.112:0/859685608 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0810159fd0 con 0x7f081015b9d0 2024-09-12T02:51:28.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.751+0000 7f080f400640 1 --2- 172.21.15.112:0/859685608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f081015b9d0 0x7f081006e370 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f0808034040 tx=0x7f0808004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:28.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.751+0000 7f0806a00640 1 -- 172.21.15.112:0/859685608 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0808009e20 con 0x7f081015b9d0 2024-09-12T02:51:28.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.751+0000 7f0806a00640 1 -- 172.21.15.112:0/859685608 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0808046430 con 0x7f081015b9d0 2024-09-12T02:51:28.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.751+0000 7f0806a00640 1 -- 172.21.15.112:0/859685608 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0808046820 con 0x7f081015b9d0 2024-09-12T02:51:28.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.752+0000 7f0815600640 1 -- 172.21.15.112:0/859685608 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0810159a10 con 0x7f081015b9d0 2024-09-12T02:51:28.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.752+0000 7f0815600640 1 -- 172.21.15.112:0/859685608 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f081015c1a0 con 0x7f081015b9d0 2024-09-12T02:51:28.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.754+0000 7f0806a00640 1 -- 172.21.15.112:0/859685608 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f08080469c0 con 0x7f081015b9d0 2024-09-12T02:51:28.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.754+0000 7f0806a00640 1 --2- 172.21.15.112:0/859685608 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f07ec06be30 0x7f07ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.755+0000 7f0806a00640 1 -- 172.21.15.112:0/859685608 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f08080ad950 con 0x7f081015b9d0 2024-09-12T02:51:28.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.755+0000 7f080ea00640 1 --2- 172.21.15.112:0/859685608 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f07ec06be30 0x7f07ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.755+0000 7f08183d6740 1 Processor -- start 2024-09-12T02:51:28.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.755+0000 7f08183d6740 1 -- start start 2024-09-12T02:51:28.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.755+0000 7f080ea00640 1 --2- 172.21.15.112:0/859685608 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f07ec06be30 0x7f07ec06e2f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0800009aa0 tx=0x7f0800009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:28.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.756+0000 7f08183d6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55907a316cf0 0x55907a35c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.756+0000 7f08183d6740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55907a3144b0 0x55907a3170d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.756+0000 7f08183d6740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55907a318480 0x55907a311570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.756+0000 7f08183d6740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55907a2753b0 con 0x55907a3144b0 2024-09-12T02:51:28.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.756+0000 7f08183d6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55907a27a410 con 0x55907a316cf0 2024-09-12T02:51:28.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.756+0000 7f08183d6740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55907a222620 con 0x55907a318480 2024-09-12T02:51:28.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.756+0000 7f0807e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55907a3144b0 0x55907a3170d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.756+0000 7f0807e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55907a3144b0 0x55907a3170d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36798/0 (socket says 172.21.15.112:36798) 2024-09-12T02:51:28.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.756+0000 7f0807e00640 1 -- 172.21.15.112:0/2109576436 learned_addr learned my addr 172.21.15.112:0/2109576436 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:28.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.757+0000 7f080f400640 1 --2- 172.21.15.112:0/2109576436 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55907a318480 0x55907a311570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.757+0000 7f080ea00640 1 --2- 172.21.15.112:0/2109576436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55907a316cf0 0x55907a35c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.757+0000 7f0807e00640 1 -- 172.21.15.112:0/2109576436 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55907a318480 msgr2=0x55907a311570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:28.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.757+0000 7f0807e00640 1 --2- 172.21.15.112:0/2109576436 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55907a318480 0x55907a311570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.757+0000 7f0807e00640 1 -- 172.21.15.112:0/2109576436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55907a316cf0 msgr2=0x55907a35c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:28.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.757+0000 7f0807e00640 1 --2- 172.21.15.112:0/2109576436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55907a316cf0 0x55907a35c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.757+0000 7f0807e00640 1 -- 172.21.15.112:0/2109576436 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559079f8d2d0 con 0x55907a3144b0 2024-09-12T02:51:28.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.757+0000 7f080ea00640 1 --2- 172.21.15.112:0/2109576436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55907a316cf0 0x55907a35c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:51:28.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.757+0000 7f0807e00640 1 --2- 172.21.15.112:0/2109576436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55907a3144b0 0x55907a3170d0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f07f8004ee0 tx=0x7f07f8007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f38a2978992c7247 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:28.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.757+0000 7f07ff000640 1 -- 172.21.15.112:0/2109576436 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f8007680 con 0x55907a3144b0 2024-09-12T02:51:28.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.757+0000 7f07ff000640 1 -- 172.21.15.112:0/2109576436 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f8001ac0 con 0x55907a3144b0 2024-09-12T02:51:28.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.757+0000 7f07ff000640 1 -- 172.21.15.112:0/2109576436 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f8001c90 con 0x55907a3144b0 2024-09-12T02:51:28.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.758+0000 7f08183d6740 1 -- 172.21.15.112:0/2109576436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55907a3144b0 msgr2=0x55907a3170d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:28.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.758+0000 7f08183d6740 1 --2- 172.21.15.112:0/2109576436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55907a3144b0 0x55907a3170d0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f07f8004ee0 tx=0x7f07f8007430 comp rx=0 tx=0).stop 2024-09-12T02:51:28.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.758+0000 7f08183d6740 1 -- 172.21.15.112:0/2109576436 shutdown_connections 2024-09-12T02:51:28.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.758+0000 7f08183d6740 1 --2- 172.21.15.112:0/2109576436 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55907a318480 0x55907a311570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.758+0000 7f08183d6740 1 --2- 172.21.15.112:0/2109576436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55907a3144b0 0x55907a3170d0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.758+0000 7f08183d6740 1 --2- 172.21.15.112:0/2109576436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55907a316cf0 0x55907a35c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.758+0000 7f08183d6740 1 -- 172.21.15.112:0/2109576436 >> 172.21.15.112:0/2109576436 conn(0x55907a313740 msgr2=0x55907a35b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:28.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.758+0000 7f08183d6740 1 -- 172.21.15.112:0/2109576436 shutdown_connections 2024-09-12T02:51:28.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.758+0000 7f08183d6740 1 -- 172.21.15.112:0/2109576436 wait complete. 2024-09-12T02:51:28.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.759+0000 7f08183d6740 1 -- start start 2024-09-12T02:51:28.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.759+0000 7f08183d6740 1 Processor -- start 2024-09-12T02:51:28.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.760+0000 7f08183d6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55907a316cf0 0x55907a33e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.760+0000 7f08183d6740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55907a318480 0x55907a341440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.760+0000 7f08183d6740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55907a33b670 0x55907a356cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.760+0000 7f08183d6740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55907a235780 con 0x55907a318480 2024-09-12T02:51:28.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.760+0000 7f08183d6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55907a2763d0 con 0x55907a316cf0 2024-09-12T02:51:28.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.760+0000 7f08183d6740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55907a312be0 con 0x55907a33b670 2024-09-12T02:51:28.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.760+0000 7f08183d6740 10 client.0 _ll_register_callbacks cb 0x55907a2735d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:51:28.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.760+0000 7f0807e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55907a318480 0x55907a341440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.760+0000 7f0807e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55907a318480 0x55907a341440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36810/0 (socket says 172.21.15.112:36810) 2024-09-12T02:51:28.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.760+0000 7f0807e00640 1 -- 172.21.15.112:0/2378594224 learned_addr learned my addr 172.21.15.112:0/2378594224 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:28.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.760+0000 7f080f400640 1 --2- 172.21.15.112:0/2378594224 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55907a33b670 0x55907a356cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.760+0000 7f080ea00640 1 --2- 172.21.15.112:0/2378594224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55907a316cf0 0x55907a33e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.760+0000 7f0807e00640 1 -- 172.21.15.112:0/2378594224 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55907a33b670 msgr2=0x55907a356cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:28.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.760+0000 7f0807e00640 1 --2- 172.21.15.112:0/2378594224 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55907a33b670 0x55907a356cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.760+0000 7f0807e00640 1 -- 172.21.15.112:0/2378594224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55907a316cf0 msgr2=0x55907a33e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:28.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.760+0000 7f0807e00640 1 --2- 172.21.15.112:0/2378594224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55907a316cf0 0x55907a33e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.760+0000 7f0807e00640 1 -- 172.21.15.112:0/2378594224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55907a0576b0 con 0x55907a318480 2024-09-12T02:51:28.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.761+0000 7f0807e00640 1 --2- 172.21.15.112:0/2378594224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55907a318480 0x55907a341440 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f07f8007fd0 tx=0x7f07f8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a18cfa3cd6cffde3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:28.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.761+0000 7f07f3400640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-12T02:51:28.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.761+0000 7f07f3400640 1 -- 172.21.15.112:0/2378594224 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f8022070 con 0x55907a318480 2024-09-12T02:51:28.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.761+0000 7f07f3400640 1 -- 172.21.15.112:0/2378594224 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f07f8013c50 con 0x55907a318480 2024-09-12T02:51:28.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.761+0000 7f08183d6740 1 -- 172.21.15.112:0/2378594224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07f8001ac0 con 0x55907a318480 2024-09-12T02:51:28.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.761+0000 7f07f3400640 1 -- 172.21.15.112:0/2378594224 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f07f802c050 con 0x55907a318480 2024-09-12T02:51:28.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.761+0000 7f08183d6740 10 client.7671 fetch_fsmap learned FSMap version 86 2024-09-12T02:51:28.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.761+0000 7f08183d6740 1 -- 172.21.15.112:0/2378594224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) -- 0x55907a3564c0 con 0x55907a318480 2024-09-12T02:51:28.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.761+0000 7f07f3400640 1 -- 172.21.15.112:0/2378594224 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f8001ac0 con 0x55907a318480 2024-09-12T02:51:28.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.762+0000 7f07f3400640 1 -- 172.21.15.112:0/2378594224 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 86) ==== 3502+0+0 (secure 0 0 0) 0x7f07f802f020 con 0x55907a318480 2024-09-12T02:51:28.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.762+0000 7f08183d6740 10 client.7671 fetch_fsmap finished waiting for FSMap version 86 2024-09-12T02:51:28.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.762+0000 7f08183d6740 10 client.7671 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:51:28.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.762+0000 7f08183d6740 20 client.7671 populate_metadata read hostname 'smithi112' 2024-09-12T02:51:28.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.762+0000 7f08183d6740 1 --2- 172.21.15.112:0/2378594224 >> [v2:172.21.15.137:6833/245886809,v1:172.21.15.137:6834/245886809] conn(0x55907a36ee10 0x55907a36be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.762+0000 7f08183d6740 4 client.7671 mds_command: new command op to 7560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:51:28.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.762+0000 7f08183d6740 1 -- 172.21.15.112:0/2378594224 --> [v2:172.21.15.137:6833/245886809,v1:172.21.15.137:6834/245886809] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55907a287b40 con 0x55907a36ee10 2024-09-12T02:51:28.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.762+0000 7f080ea00640 1 --2- 172.21.15.112:0/2378594224 >> [v2:172.21.15.137:6833/245886809,v1:172.21.15.137:6834/245886809] conn(0x55907a36ee10 0x55907a36be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.763+0000 7f080ea00640 1 --2- 172.21.15.112:0/2378594224 >> [v2:172.21.15.137:6833/245886809,v1:172.21.15.137:6834/245886809] conn(0x55907a36ee10 0x55907a36be10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aad0bda53164fd19 server_cookie=92b11e1d899e2f0a in_seq=0 out_seq=0 2024-09-12T02:51:28.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.763+0000 7f07f3400640 10 client.7671 ms_handle_connect on v2:172.21.15.137:6833/245886809 2024-09-12T02:51:28.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.764+0000 7f07f3400640 1 -- 172.21.15.112:0/2378594224 <== mds.0 v2:172.21.15.137:6833/245886809 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55907a287b40 con 0x55907a36ee10 2024-09-12T02:51:28.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.764+0000 7f07f3400640 10 client.7671 handle_command_reply: tid=0 2024-09-12T02:51:28.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.764+0000 7f08183d6740 1 client.7671 shutdown 2024-09-12T02:51:28.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.764+0000 7f08183d6740 1 -- 172.21.15.112:0/2378594224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55907a318480 msgr2=0x55907a341440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:28.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.764+0000 7f08183d6740 1 --2- 172.21.15.112:0/2378594224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55907a318480 0x55907a341440 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f07f8007fd0 tx=0x7f07f8000ed0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.764+0000 7f08183d6740 1 -- 172.21.15.112:0/2378594224 shutdown_connections 2024-09-12T02:51:28.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.764+0000 7f08183d6740 1 --2- 172.21.15.112:0/2378594224 >> [v2:172.21.15.137:6833/245886809,v1:172.21.15.137:6834/245886809] conn(0x55907a36ee10 0x55907a36be10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.764+0000 7f08183d6740 1 --2- 172.21.15.112:0/2378594224 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55907a33b670 0x55907a356cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.764+0000 7f08183d6740 1 --2- 172.21.15.112:0/2378594224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55907a318480 0x55907a341440 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.764+0000 7f08183d6740 1 --2- 172.21.15.112:0/2378594224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55907a316cf0 0x55907a33e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.764+0000 7f07f3400640 0 client.7671 ms_handle_reset on v2:172.21.15.137:6833/245886809 2024-09-12T02:51:28.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.764+0000 7f08183d6740 1 -- 172.21.15.112:0/2378594224 >> 172.21.15.112:0/2378594224 conn(0x55907a3144b0 msgr2=0x55907a3599e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:28.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.764+0000 7f08183d6740 1 -- 172.21.15.112:0/2378594224 shutdown_connections 2024-09-12T02:51:28.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.764+0000 7f08183d6740 1 -- 172.21.15.112:0/2378594224 wait complete. 2024-09-12T02:51:28.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.764+0000 7f08183d6740 20 client.7671 trim_cache size 0 max 16384 2024-09-12T02:51:28.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.784+0000 7f08183d6740 1 Processor -- start 2024-09-12T02:51:28.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.785+0000 7f08183d6740 1 -- start start 2024-09-12T02:51:28.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.785+0000 7f08183d6740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55907a316cf0 0x55907a36bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.785+0000 7f08183d6740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55907a318480 0x55907a354b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.785+0000 7f08183d6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55907a33b670 0x55907a355070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.785+0000 7f08183d6740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f08101fbd50 con 0x55907a318480 2024-09-12T02:51:28.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.785+0000 7f08183d6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f08101f5000 con 0x55907a33b670 2024-09-12T02:51:28.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.785+0000 7f08183d6740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f08101fb850 con 0x55907a316cf0 2024-09-12T02:51:28.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.786+0000 7f0807e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55907a318480 0x55907a354b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.786+0000 7f0807e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55907a318480 0x55907a354b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36820/0 (socket says 172.21.15.112:36820) 2024-09-12T02:51:28.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.786+0000 7f0807e00640 1 -- 172.21.15.112:0/3190203769 learned_addr learned my addr 172.21.15.112:0/3190203769 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:28.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.786+0000 7f0807e00640 1 -- 172.21.15.112:0/3190203769 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55907a316cf0 msgr2=0x55907a36bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:28.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.786+0000 7f0807e00640 1 --2- 172.21.15.112:0/3190203769 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55907a316cf0 0x55907a36bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.786+0000 7f0807e00640 1 -- 172.21.15.112:0/3190203769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55907a33b670 msgr2=0x55907a355070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:28.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.786+0000 7f0807e00640 1 --2- 172.21.15.112:0/3190203769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55907a33b670 0x55907a355070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.786+0000 7f0807e00640 1 -- 172.21.15.112:0/3190203769 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55907a33b4a0 con 0x55907a318480 2024-09-12T02:51:28.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.786+0000 7f0807e00640 1 --2- 172.21.15.112:0/3190203769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55907a318480 0x55907a354b30 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f07f8016000 tx=0x7f07f801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d220ecd816ba6677 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:28.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.786+0000 7f07fe600640 1 -- 172.21.15.112:0/3190203769 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f8022040 con 0x55907a318480 2024-09-12T02:51:28.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.786+0000 7f07fe600640 1 -- 172.21.15.112:0/3190203769 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f8013ab0 con 0x55907a318480 2024-09-12T02:51:28.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.786+0000 7f07fe600640 1 -- 172.21.15.112:0/3190203769 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f8013c60 con 0x55907a318480 2024-09-12T02:51:28.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.787+0000 7f08183d6740 1 -- 172.21.15.112:0/3190203769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55907a318480 msgr2=0x55907a354b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:28.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.787+0000 7f08183d6740 1 --2- 172.21.15.112:0/3190203769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55907a318480 0x55907a354b30 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f07f8016000 tx=0x7f07f801a000 comp rx=0 tx=0).stop 2024-09-12T02:51:28.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.787+0000 7f08183d6740 1 -- 172.21.15.112:0/3190203769 shutdown_connections 2024-09-12T02:51:28.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.787+0000 7f08183d6740 1 --2- 172.21.15.112:0/3190203769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55907a33b670 0x55907a355070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.787+0000 7f08183d6740 1 --2- 172.21.15.112:0/3190203769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55907a318480 0x55907a354b30 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.787+0000 7f08183d6740 1 --2- 172.21.15.112:0/3190203769 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55907a316cf0 0x55907a36bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.787+0000 7f08183d6740 1 -- 172.21.15.112:0/3190203769 >> 172.21.15.112:0/3190203769 conn(0x55907a3144b0 msgr2=0x55907a35d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:28.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.787+0000 7f08183d6740 1 -- 172.21.15.112:0/3190203769 shutdown_connections 2024-09-12T02:51:28.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.787+0000 7f08183d6740 1 -- 172.21.15.112:0/3190203769 wait complete. 2024-09-12T02:51:28.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.788+0000 7f08183d6740 1 -- start start 2024-09-12T02:51:28.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.788+0000 7f08183d6740 1 Processor -- start 2024-09-12T02:51:28.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.789+0000 7f08183d6740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55907a316cf0 0x55907a33faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.789+0000 7f08183d6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55907a318480 0x55907a35b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.789+0000 7f08183d6740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55907a33b670 0x55907a3da5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.789+0000 7f08183d6740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55907a33c210 con 0x55907a316cf0 2024-09-12T02:51:28.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.789+0000 7f08183d6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55907a33edc0 con 0x55907a318480 2024-09-12T02:51:28.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.789+0000 7f08183d6740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55907a36f200 con 0x55907a33b670 2024-09-12T02:51:28.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.789+0000 7f08183d6740 10 client.0 _ll_register_callbacks cb 0x7f07f8004d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:51:28.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.789+0000 7f080ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55907a316cf0 0x55907a33faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.789+0000 7f080ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55907a316cf0 0x55907a33faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36830/0 (socket says 172.21.15.112:36830) 2024-09-12T02:51:28.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.789+0000 7f080ea00640 1 -- 172.21.15.112:0/974564801 learned_addr learned my addr 172.21.15.112:0/974564801 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:28.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.790+0000 7f0807e00640 1 --2- 172.21.15.112:0/974564801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55907a318480 0x55907a35b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.790+0000 7f080f400640 1 --2- 172.21.15.112:0/974564801 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55907a33b670 0x55907a3da5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.790+0000 7f080ea00640 1 -- 172.21.15.112:0/974564801 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55907a33b670 msgr2=0x55907a3da5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:28.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.790+0000 7f080ea00640 1 --2- 172.21.15.112:0/974564801 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55907a33b670 0x55907a3da5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.790+0000 7f080ea00640 1 -- 172.21.15.112:0/974564801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55907a318480 msgr2=0x55907a35b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:28.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.790+0000 7f080ea00640 1 --2- 172.21.15.112:0/974564801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55907a318480 0x55907a35b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.790+0000 7f080ea00640 1 -- 172.21.15.112:0/974564801 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55907a341710 con 0x55907a316cf0 2024-09-12T02:51:28.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.790+0000 7f080ea00640 1 --2- 172.21.15.112:0/974564801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55907a316cf0 0x55907a33faa0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x55907a3403e0 tx=0x7f08000041a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f2e54417885b76 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:28.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.790+0000 7f07f3400640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-12T02:51:28.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.790+0000 7f07f3400640 1 -- 172.21.15.112:0/974564801 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080001e040 con 0x55907a316cf0 2024-09-12T02:51:28.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.790+0000 7f07f3400640 1 -- 172.21.15.112:0/974564801 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f08000039a0 con 0x55907a316cf0 2024-09-12T02:51:28.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.790+0000 7f08183d6740 1 -- 172.21.15.112:0/974564801 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07f8013ab0 con 0x55907a316cf0 2024-09-12T02:51:28.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.791+0000 7f07f3400640 1 -- 172.21.15.112:0/974564801 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f0800037050 con 0x55907a316cf0 2024-09-12T02:51:28.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.791+0000 7f08183d6740 10 client.7677 fetch_fsmap learned FSMap version 86 2024-09-12T02:51:28.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.791+0000 7f08183d6740 1 -- 172.21.15.112:0/974564801 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) -- 0x55907a33ffe0 con 0x55907a316cf0 2024-09-12T02:51:28.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.791+0000 7f07f3400640 1 -- 172.21.15.112:0/974564801 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f8013ab0 con 0x55907a316cf0 2024-09-12T02:51:28.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.791+0000 7f07f3400640 1 -- 172.21.15.112:0/974564801 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 86) ==== 3502+0+0 (secure 0 0 0) 0x7f080003a020 con 0x55907a316cf0 2024-09-12T02:51:28.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.791+0000 7f08183d6740 10 client.7677 fetch_fsmap finished waiting for FSMap version 86 2024-09-12T02:51:28.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.791+0000 7f08183d6740 10 client.7677 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:51:28.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.791+0000 7f08183d6740 20 client.7677 populate_metadata read hostname 'smithi112' 2024-09-12T02:51:28.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.791+0000 7f08183d6740 1 --2- 172.21.15.112:0/974564801 >> [v2:172.21.15.137:6833/245886809,v1:172.21.15.137:6834/245886809] conn(0x55907a310580 0x55907a310960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.791+0000 7f08183d6740 4 client.7677 mds_command: new command op to 7560 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:51:28.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.791+0000 7f08183d6740 1 -- 172.21.15.112:0/974564801 --> [v2:172.21.15.137:6833/245886809,v1:172.21.15.137:6834/245886809] -- command(tid 0: {"prefix": "status"}) -- 0x55907a281e90 con 0x55907a310580 2024-09-12T02:51:28.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.791+0000 7f0807e00640 1 --2- 172.21.15.112:0/974564801 >> [v2:172.21.15.137:6833/245886809,v1:172.21.15.137:6834/245886809] conn(0x55907a310580 0x55907a310960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.792+0000 7f0807e00640 1 --2- 172.21.15.112:0/974564801 >> [v2:172.21.15.137:6833/245886809,v1:172.21.15.137:6834/245886809] conn(0x55907a310580 0x55907a310960 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d355e6b40be6354c server_cookie=30cf0be10eee4767 in_seq=0 out_seq=0 2024-09-12T02:51:28.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.792+0000 7f07f3400640 10 client.7677 ms_handle_connect on v2:172.21.15.137:6833/245886809 2024-09-12T02:51:28.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.792+0000 7f07f3400640 1 -- 172.21.15.112:0/974564801 <== mds.0 v2:172.21.15.137:6833/245886809 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55907a281e90 con 0x55907a310580 2024-09-12T02:51:28.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.792+0000 7f07f3400640 10 client.7677 handle_command_reply: tid=0 2024-09-12T02:51:28.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.792+0000 7f08183d6740 1 client.7677 shutdown 2024-09-12T02:51:28.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.792+0000 7f08183d6740 1 -- 172.21.15.112:0/974564801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55907a316cf0 msgr2=0x55907a33faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:28.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.792+0000 7f08183d6740 1 --2- 172.21.15.112:0/974564801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55907a316cf0 0x55907a33faa0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x55907a3403e0 tx=0x7f08000041a0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.793+0000 7f08183d6740 1 -- 172.21.15.112:0/974564801 shutdown_connections 2024-09-12T02:51:28.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.793+0000 7f08183d6740 1 --2- 172.21.15.112:0/974564801 >> [v2:172.21.15.137:6833/245886809,v1:172.21.15.137:6834/245886809] conn(0x55907a310580 0x55907a310960 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.793+0000 7f08183d6740 1 --2- 172.21.15.112:0/974564801 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55907a33b670 0x55907a3da5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.793+0000 7f08183d6740 1 --2- 172.21.15.112:0/974564801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55907a318480 0x55907a35b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.793+0000 7f08183d6740 1 --2- 172.21.15.112:0/974564801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55907a316cf0 0x55907a33faa0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.793+0000 7f08183d6740 1 -- 172.21.15.112:0/974564801 >> 172.21.15.112:0/974564801 conn(0x55907a3144b0 msgr2=0x55907a341aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:28.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.793+0000 7f07f3400640 0 client.7677 ms_handle_reset on v2:172.21.15.137:6833/245886809 2024-09-12T02:51:28.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.793+0000 7f08183d6740 1 -- 172.21.15.112:0/974564801 shutdown_connections 2024-09-12T02:51:28.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.793+0000 7f08183d6740 1 -- 172.21.15.112:0/974564801 wait complete. 2024-09-12T02:51:28.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.793+0000 7f08183d6740 20 client.7677 trim_cache size 0 max 16384 2024-09-12T02:51:28.797 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:51:28.798 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:51:28.798 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2024-09-12T02:51:28.798 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 7560, 2024-09-12T02:51:28.798 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2024-09-12T02:51:28.798 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2024-09-12T02:51:28.798 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2024-09-12T02:51:28.798 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 6.0656558079999998, 2024-09-12T02:51:28.798 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 86, 2024-09-12T02:51:28.798 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 167, 2024-09-12T02:51:28.798 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 167, 2024-09-12T02:51:28.798 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 11.168980661999999 2024-09-12T02:51:28.798 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:51:28.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.793+0000 7f0815600640 1 -- 172.21.15.112:0/859685608 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f07ec06be30 msgr2=0x7f07ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:28.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.793+0000 7f0815600640 1 --2- 172.21.15.112:0/859685608 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f07ec06be30 0x7f07ec06e2f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0800009aa0 tx=0x7f0800009190 comp rx=0 tx=0).stop 2024-09-12T02:51:28.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.793+0000 7f0815600640 1 -- 172.21.15.112:0/859685608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f081015b9d0 msgr2=0x7f081006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:28.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.793+0000 7f0815600640 1 --2- 172.21.15.112:0/859685608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f081015b9d0 0x7f081006e370 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f0808034040 tx=0x7f0808004a40 comp rx=0 tx=0).stop 2024-09-12T02:51:28.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.794+0000 7f0815600640 1 -- 172.21.15.112:0/859685608 shutdown_connections 2024-09-12T02:51:28.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.794+0000 7f0815600640 1 --2- 172.21.15.112:0/859685608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f081015b9d0 0x7f081006e370 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.794+0000 7f0815600640 1 --2- 172.21.15.112:0/859685608 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08100b45d0 0x7f0810158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.794+0000 7f0815600640 1 --2- 172.21.15.112:0/859685608 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f07ec06be30 0x7f07ec06e2f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.794+0000 7f0815600640 1 --2- 172.21.15.112:0/859685608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f081006f600 0x7f0810142360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.794+0000 7f0815600640 1 -- 172.21.15.112:0/859685608 >> 172.21.15.112:0/859685608 conn(0x7f081006bbd0 msgr2=0x7f08100ce060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:28.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.794+0000 7f0815600640 1 -- 172.21.15.112:0/859685608 shutdown_connections 2024-09-12T02:51:28.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.794+0000 7f0815600640 1 -- 172.21.15.112:0/859685608 wait complete. 2024-09-12T02:51:28.809 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:51:28.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.961+0000 7f5129000640 1 Processor -- start 2024-09-12T02:51:28.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.961+0000 7f5129000640 1 -- start start 2024-09-12T02:51:28.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.962+0000 7f5129000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5124071530 0x7f51240af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.962+0000 7f5129000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51240ceeb0 con 0x7f5124071970 2024-09-12T02:51:28.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.962+0000 7f5129000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f512406e300 con 0x7f512415cc50 2024-09-12T02:51:28.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.962+0000 7f5129000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f512415d030 con 0x7f5124071530 2024-09-12T02:51:28.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.962+0000 7f5122800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f5124071970 0x7f51240cf950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52240/0 (socket says 172.21.15.112:52240) 2024-09-12T02:51:28.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.962+0000 7f5122800640 1 -- 172.21.15.112:0/325259215 learned_addr learned my addr 172.21.15.112:0/325259215 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:51:28.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.963+0000 7f5121400640 1 --2- 172.21.15.112:0/325259215 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5124071530 0x7f51240af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.963+0000 7f5120a00640 1 -- 172.21.15.112:0/325259215 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 39737227 0 0) 0x7f51240ceeb0 con 0x7f5124071970 2024-09-12T02:51:28.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.963+0000 7f5120a00640 1 -- 172.21.15.112:0/325259215 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5108003520 con 0x7f5124071970 2024-09-12T02:51:28.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.963+0000 7f5121400640 1 -- 172.21.15.112:0/325259215 >> v1:172.21.15.137:6789/0 conn(0x7f512415cc50 legacy=0x7f51240732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:28.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.963+0000 7f5120a00640 1 -- 172.21.15.112:0/325259215 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 489417485 0 0) 0x7f512406e300 con 0x7f512415cc50 2024-09-12T02:51:28.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.963+0000 7f5121400640 1 -- 172.21.15.112:0/325259215 >> v1:172.21.15.112:6789/0 conn(0x7f5124071970 legacy=0x7f51240cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:28.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.963+0000 7f5121400640 1 -- 172.21.15.112:0/325259215 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f512406e5e0 con 0x7f5124071530 2024-09-12T02:51:28.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.964+0000 7f5121400640 1 --2- 172.21.15.112:0/325259215 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5124071530 0x7f51240af720 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f51100097c0 tx=0x7f511002a160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bfc6052dc3f0169 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:28.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.965+0000 7f5120a00640 1 -- 172.21.15.112:0/325259215 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5110037070 con 0x7f5124071530 2024-09-12T02:51:28.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.965+0000 7f5120a00640 1 -- 172.21.15.112:0/325259215 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5110032440 con 0x7f5124071530 2024-09-12T02:51:28.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.965+0000 7f5120a00640 1 -- 172.21.15.112:0/325259215 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5110032810 con 0x7f5124071530 2024-09-12T02:51:28.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.965+0000 7f5129000640 1 -- 172.21.15.112:0/325259215 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5124071530 msgr2=0x7f51240af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:28.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.965+0000 7f5129000640 1 --2- 172.21.15.112:0/325259215 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5124071530 0x7f51240af720 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f51100097c0 tx=0x7f511002a160 comp rx=0 tx=0).stop 2024-09-12T02:51:28.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.965+0000 7f5129000640 1 -- 172.21.15.112:0/325259215 shutdown_connections 2024-09-12T02:51:28.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.965+0000 7f5129000640 1 --2- 172.21.15.112:0/325259215 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5124071530 0x7f51240af720 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.965+0000 7f5129000640 1 -- 172.21.15.112:0/325259215 >> 172.21.15.112:0/325259215 conn(0x7f512406bbd0 msgr2=0x7f512406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:28.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.965+0000 7f5129000640 1 -- 172.21.15.112:0/325259215 shutdown_connections 2024-09-12T02:51:28.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.965+0000 7f5129000640 1 -- 172.21.15.112:0/325259215 wait complete. 2024-09-12T02:51:28.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.967+0000 7f5129000640 1 Processor -- start 2024-09-12T02:51:28.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.967+0000 7f5129000640 1 -- start start 2024-09-12T02:51:28.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.968+0000 7f5129000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5124071530 0x7f512415eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.968+0000 7f5129000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5124071970 0x7f5124144e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.968+0000 7f5129000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f512415cc50 0x7f512414f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.968+0000 7f5129000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f512406f510 con 0x7f5124071970 2024-09-12T02:51:28.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.968+0000 7f5129000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f51240cf4c0 con 0x7f512415cc50 2024-09-12T02:51:28.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.968+0000 7f5129000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f512406f690 con 0x7f5124071530 2024-09-12T02:51:28.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.968+0000 7f5121400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5124071970 0x7f5124144e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.968+0000 7f5121400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5124071970 0x7f5124144e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36844/0 (socket says 172.21.15.112:36844) 2024-09-12T02:51:28.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.968+0000 7f5121400640 1 -- 172.21.15.112:0/887655177 learned_addr learned my addr 172.21.15.112:0/887655177 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:28.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.968+0000 7f5122800640 1 --2- 172.21.15.112:0/887655177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f512415cc50 0x7f512414f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.968+0000 7f5121e00640 1 --2- 172.21.15.112:0/887655177 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5124071530 0x7f512415eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.969+0000 7f5121400640 1 -- 172.21.15.112:0/887655177 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5124071530 msgr2=0x7f512415eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:28.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.969+0000 7f5121400640 1 --2- 172.21.15.112:0/887655177 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5124071530 0x7f512415eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.969+0000 7f5121400640 1 -- 172.21.15.112:0/887655177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f512415cc50 msgr2=0x7f512414f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:28.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.969+0000 7f5121400640 1 --2- 172.21.15.112:0/887655177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f512415cc50 0x7f512414f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:28.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.969+0000 7f5121400640 1 -- 172.21.15.112:0/887655177 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5124146880 con 0x7f5124071970 2024-09-12T02:51:28.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.969+0000 7f5121400640 1 --2- 172.21.15.112:0/887655177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5124071970 0x7f5124144e80 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f5110035040 tx=0x7f51100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:28.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.969+0000 7f511a000640 1 -- 172.21.15.112:0/887655177 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5110041070 con 0x7f5124071970 2024-09-12T02:51:28.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.969+0000 7f511a000640 1 -- 172.21.15.112:0/887655177 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5110005b90 con 0x7f5124071970 2024-09-12T02:51:28.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.969+0000 7f5129000640 1 -- 172.21.15.112:0/887655177 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f512415de10 con 0x7f5124071970 2024-09-12T02:51:28.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.969+0000 7f511a000640 1 -- 172.21.15.112:0/887655177 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5110037040 con 0x7f5124071970 2024-09-12T02:51:28.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.969+0000 7f5129000640 1 -- 172.21.15.112:0/887655177 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f512415e3d0 con 0x7f5124071970 2024-09-12T02:51:28.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.970+0000 7f5129000640 1 -- 172.21.15.112:0/887655177 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5124152860 con 0x7f5124071970 2024-09-12T02:51:28.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.971+0000 7f511a000640 1 -- 172.21.15.112:0/887655177 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f511003a070 con 0x7f5124071970 2024-09-12T02:51:28.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.972+0000 7f511a000640 1 --2- 172.21.15.112:0/887655177 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f510406be30 0x7f510406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:28.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.972+0000 7f511a000640 1 -- 172.21.15.112:0/887655177 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f51100ab500 con 0x7f5124071970 2024-09-12T02:51:28.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.973+0000 7f5121e00640 1 --2- 172.21.15.112:0/887655177 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f510406be30 0x7f510406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:28.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.973+0000 7f5121e00640 1 --2- 172.21.15.112:0/887655177 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f510406be30 0x7f510406e2f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5114000f60 tx=0x7f5114009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:28.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:28.977+0000 7f511a000640 1 -- 172.21.15.112:0/887655177 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5124152860 con 0x7f5124071970 2024-09-12T02:51:29.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:29.183+0000 7f5129000640 1 -- 172.21.15.112:0/887655177 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f51240730d0 con 0x7f5124071970 2024-09-12T02:51:29.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:29.184+0000 7f511a000640 1 -- 172.21.15.112:0/887655177 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v86) ==== 53+0+73 (secure 0 0 0) 0x7f51100797c0 con 0x7f5124071970 2024-09-12T02:51:29.185 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:51:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:29.186+0000 7f5129000640 1 -- 172.21.15.112:0/887655177 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f510406be30 msgr2=0x7f510406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:29.186+0000 7f5129000640 1 --2- 172.21.15.112:0/887655177 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f510406be30 0x7f510406e2f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5114000f60 tx=0x7f5114009040 comp rx=0 tx=0).stop 2024-09-12T02:51:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:29.186+0000 7f5129000640 1 -- 172.21.15.112:0/887655177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5124071970 msgr2=0x7f5124144e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:29.186+0000 7f5129000640 1 --2- 172.21.15.112:0/887655177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5124071970 0x7f5124144e80 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f5110035040 tx=0x7f51100046c0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:29.186+0000 7f5129000640 1 -- 172.21.15.112:0/887655177 shutdown_connections 2024-09-12T02:51:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:29.186+0000 7f5129000640 1 --2- 172.21.15.112:0/887655177 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f510406be30 0x7f510406e2f0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:29.186+0000 7f5129000640 1 --2- 172.21.15.112:0/887655177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f512415cc50 0x7f512414f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:29.186+0000 7f5129000640 1 --2- 172.21.15.112:0/887655177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5124071970 0x7f5124144e80 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:29.186+0000 7f5129000640 1 --2- 172.21.15.112:0/887655177 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5124071530 0x7f512415eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:29.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:29.186+0000 7f5129000640 1 -- 172.21.15.112:0/887655177 >> 172.21.15.112:0/887655177 conn(0x7f512406bbd0 msgr2=0x7f51240b55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:29.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:29.186+0000 7f5129000640 1 -- 172.21.15.112:0/887655177 shutdown_connections 2024-09-12T02:51:29.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:29.186+0000 7f5129000640 1 -- 172.21.15.112:0/887655177 wait complete. 2024-09-12T02:51:29.202 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:51:29.202 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:51:29.202 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-09-12T02:51:29.202 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:51:29.202 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:51:29.202 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:51:29.202 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:51:29.202 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:51:29.202 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:51:29.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:51:29.203 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-09-12T02:51:29.239 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:51:29.239 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:51:29.239 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:51:29.239 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:51:29.239 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-12T02:51:29.239 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:51:29.239 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:51:29.239 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-09-12T02:51:29.239 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-09-12T02:51:29.239 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:51:29.239 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-09-12T02:51:29.239 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-09-12T02:51:29.240 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:51:29.240 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:51:29.240 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:51:29.240 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:51:29.240 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:51:29.240 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42189sec preferred_lft 42189sec 2024-09-12T02:51:29.240 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link noprefixroute 2024-09-12T02:51:29.240 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:51:29.240 INFO:teuthology.orchestra.run.smithi112.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:51:29.240 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 4e:56:d4:fc:33:ba brd ff:ff:ff:ff:ff:ff 2024-09-12T02:51:29.240 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:51:29.240 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:51:29.241 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::787f:67ff:fe10:c915/64 scope link 2024-09-12T02:51:29.241 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:51:29.241 INFO:teuthology.orchestra.run.smithi112.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:51:29.241 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 4e:56:d4:fc:33:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:51:29.241 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::4c56:d4ff:fefc:33ba/64 scope link 2024-09-12T02:51:29.241 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:51:29.241 INFO:teuthology.orchestra.run.smithi112.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:51:29.241 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 86:ed:0e:b6:37:5f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:51:29.241 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::84ed:eff:feb6:375f/64 scope link 2024-09-12T02:51:29.241 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:51:29.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:51:29.242 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:51:29.332 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-12T02:51:29.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:51:29.335 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-09-12T02:51:29.371 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-09-12T02:51:29.371 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:51:29.372 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:51:29.372 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:51:29.372 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:51:29.372 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:51:29.372 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-12T02:51:29.372 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:51:29.372 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:51:29.372 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:51:29.372 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-12T02:51:29.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:51:29.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:51:29.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:51:29.567 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-12T02:51:29.602 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:51:29.602 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:51:29.602 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:51:29.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:51:29.603 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2024-09-12T02:51:29.698 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:51:29.699 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:51:29.734 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:51:29.734 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:51:29.734 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:51:29.808 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T02:51:29.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:51:29.808 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:51:29.937 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:51:29.937 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:51:29.964 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:51:29.964 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:51:29.964 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-09-12T02:51:29.964 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 0@7c01f3b3-dec2-4449-a33f-f960d7527ea6.cephfs=/ 2024-09-12T02:51:29.964 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.112:3300/172.21.15.137:3300/172.21.15.137:3301" will pass to kernel 2024-09-12T02:51:29.965 INFO:teuthology.orchestra.run.smithi112.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:51:29.965 INFO:teuthology.orchestra.run.smithi112.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:51:29.966 INFO:teuthology.orchestra.run.smithi112.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:51:29.966 INFO:teuthology.orchestra.run.smithi112.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:51:29.966 INFO:teuthology.orchestra.run.smithi112.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:51:29.969 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:51:29.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:51:29.969 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:51:30.025 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:51:30.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:51:30.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:51:30.125 INFO:teuthology.orchestra.run.smithi112.stdout:client6353 2024-09-12T02:51:30.125 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:51:30.125 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:51:30.160 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:51:30.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.353+0000 7fbf24800640 1 Processor -- start 2024-09-12T02:51:30.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.353+0000 7fbf24800640 1 -- start start 2024-09-12T02:51:30.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.354+0000 7fbf24800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbf1c15cc50 0x7fbf1c0732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:30.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.354+0000 7fbf24800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf1c0afe30 0x7fbf1c0cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:30.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.354+0000 7fbf24800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf1c073830 con 0x7fbf1c071530 2024-09-12T02:51:30.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.354+0000 7fbf24800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fbf1c15d030 con 0x7fbf1c15cc50 2024-09-12T02:51:30.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.354+0000 7fbf24800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbf1c0cf4c0 con 0x7fbf1c0afe30 2024-09-12T02:51:30.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.355+0000 7fbf21e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbf1c15cc50 0x7fbf1c0732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:30.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.355+0000 7fbf21400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fbf1c071530 0x7fbf1c0af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52250/0 (socket says 172.21.15.112:52250) 2024-09-12T02:51:30.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.355+0000 7fbf21400640 1 -- 172.21.15.112:0/3958329429 learned_addr learned my addr 172.21.15.112:0/3958329429 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:51:30.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.355+0000 7fbf22800640 1 --2- 172.21.15.112:0/3958329429 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf1c0afe30 0x7fbf1c0cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:30.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.355+0000 7fbf20a00640 1 -- 172.21.15.112:0/3958329429 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2520954658 0 0) 0x7fbf0c001290 con 0x7fbf1c071530 2024-09-12T02:51:30.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.355+0000 7fbf20a00640 1 -- 172.21.15.112:0/3958329429 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf04003520 con 0x7fbf1c071530 2024-09-12T02:51:30.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.355+0000 7fbf21e00640 1 -- 172.21.15.112:0/3958329429 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf1c0afe30 msgr2=0x7fbf1c0cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:30.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.355+0000 7fbf21e00640 1 --2- 172.21.15.112:0/3958329429 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf1c0afe30 0x7fbf1c0cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:30.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.355+0000 7fbf21e00640 1 -- 172.21.15.112:0/3958329429 >> v1:172.21.15.112:6789/0 conn(0x7fbf1c071530 legacy=0x7fbf1c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:30.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.355+0000 7fbf21e00640 1 -- 172.21.15.112:0/3958329429 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf1c0ceeb0 con 0x7fbf1c15cc50 2024-09-12T02:51:30.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.356+0000 7fbf21e00640 1 --2- 172.21.15.112:0/3958329429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf1c15cc50 0x7fbf1c0732f0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fbf100097a0 tx=0x7fbf1002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=744db759e34bcd8f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:30.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.356+0000 7fbf20a00640 1 -- 172.21.15.112:0/3958329429 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf10037070 con 0x7fbf1c15cc50 2024-09-12T02:51:30.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.356+0000 7fbf20a00640 1 -- 172.21.15.112:0/3958329429 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf1002ae50 con 0x7fbf1c15cc50 2024-09-12T02:51:30.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.356+0000 7fbf20a00640 1 -- 172.21.15.112:0/3958329429 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf10032660 con 0x7fbf1c15cc50 2024-09-12T02:51:30.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.357+0000 7fbf24800640 1 -- 172.21.15.112:0/3958329429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf1c15cc50 msgr2=0x7fbf1c0732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:30.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.357+0000 7fbf24800640 1 --2- 172.21.15.112:0/3958329429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf1c15cc50 0x7fbf1c0732f0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fbf100097a0 tx=0x7fbf1002a100 comp rx=0 tx=0).stop 2024-09-12T02:51:30.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.357+0000 7fbf24800640 1 -- 172.21.15.112:0/3958329429 shutdown_connections 2024-09-12T02:51:30.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.357+0000 7fbf24800640 1 --2- 172.21.15.112:0/3958329429 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf1c0afe30 0x7fbf1c0cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:30.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.357+0000 7fbf24800640 1 --2- 172.21.15.112:0/3958329429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf1c15cc50 0x7fbf1c0732f0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:30.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.357+0000 7fbf24800640 1 -- 172.21.15.112:0/3958329429 >> 172.21.15.112:0/3958329429 conn(0x7fbf1c06bbd0 msgr2=0x7fbf1c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:30.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.357+0000 7fbf24800640 1 -- 172.21.15.112:0/3958329429 shutdown_connections 2024-09-12T02:51:30.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.357+0000 7fbf24800640 1 -- 172.21.15.112:0/3958329429 wait complete. 2024-09-12T02:51:30.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.359+0000 7fbf24800640 1 Processor -- start 2024-09-12T02:51:30.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.359+0000 7fbf24800640 1 -- start start 2024-09-12T02:51:30.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.359+0000 7fbf24800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf1c071530 0x7fbf1c160000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:30.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.359+0000 7fbf24800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf1c0afe30 0x7fbf1c160540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:30.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.359+0000 7fbf24800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf1c15cc50 0x7fbf1c160a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:30.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.359+0000 7fbf24800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1c0cf150 con 0x7fbf1c15cc50 2024-09-12T02:51:30.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.359+0000 7fbf24800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1c06e5e0 con 0x7fbf1c0afe30 2024-09-12T02:51:30.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.359+0000 7fbf24800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbf1c06f510 con 0x7fbf1c071530 2024-09-12T02:51:30.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.360+0000 7fbf22800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf1c15cc50 0x7fbf1c160a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:30.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.360+0000 7fbf22800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf1c15cc50 0x7fbf1c160a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36856/0 (socket says 172.21.15.112:36856) 2024-09-12T02:51:30.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.360+0000 7fbf22800640 1 -- 172.21.15.112:0/1140755374 learned_addr learned my addr 172.21.15.112:0/1140755374 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:30.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.360+0000 7fbf21e00640 1 --2- 172.21.15.112:0/1140755374 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf1c071530 0x7fbf1c160000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:30.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.360+0000 7fbf21400640 1 --2- 172.21.15.112:0/1140755374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf1c0afe30 0x7fbf1c160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:30.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.360+0000 7fbf22800640 1 -- 172.21.15.112:0/1140755374 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf1c071530 msgr2=0x7fbf1c160000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:30.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.360+0000 7fbf22800640 1 --2- 172.21.15.112:0/1140755374 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf1c071530 0x7fbf1c160000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:30.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.360+0000 7fbf22800640 1 -- 172.21.15.112:0/1140755374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf1c0afe30 msgr2=0x7fbf1c160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:30.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.360+0000 7fbf22800640 1 --2- 172.21.15.112:0/1140755374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf1c0afe30 0x7fbf1c160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:30.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.360+0000 7fbf22800640 1 -- 172.21.15.112:0/1140755374 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf1c15ef60 con 0x7fbf1c15cc50 2024-09-12T02:51:30.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.360+0000 7fbf21400640 1 --2- 172.21.15.112:0/1140755374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf1c0afe30 0x7fbf1c160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:51:30.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.360+0000 7fbf22800640 1 --2- 172.21.15.112:0/1140755374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf1c15cc50 0x7fbf1c160a80 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fbf18007de0 tx=0x7fbf1800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:30.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.361+0000 7fbf16000640 1 -- 172.21.15.112:0/1140755374 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf18014620 con 0x7fbf1c15cc50 2024-09-12T02:51:30.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.361+0000 7fbf16000640 1 -- 172.21.15.112:0/1140755374 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf18019070 con 0x7fbf1c15cc50 2024-09-12T02:51:30.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.361+0000 7fbf24800640 1 -- 172.21.15.112:0/1140755374 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf1c15f240 con 0x7fbf1c15cc50 2024-09-12T02:51:30.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.361+0000 7fbf16000640 1 -- 172.21.15.112:0/1140755374 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf18014a20 con 0x7fbf1c15cc50 2024-09-12T02:51:30.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.361+0000 7fbf24800640 1 -- 172.21.15.112:0/1140755374 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf1c15f800 con 0x7fbf1c15cc50 2024-09-12T02:51:30.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.362+0000 7fbf24800640 1 -- 172.21.15.112:0/1140755374 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf1c068a30 con 0x7fbf1c15cc50 2024-09-12T02:51:30.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.363+0000 7fbf16000640 1 -- 172.21.15.112:0/1140755374 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbf18014bc0 con 0x7fbf1c15cc50 2024-09-12T02:51:30.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.364+0000 7fbf16000640 1 --2- 172.21.15.112:0/1140755374 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbf0006be30 0x7fbf0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:30.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.364+0000 7fbf16000640 1 -- 172.21.15.112:0/1140755374 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7fbf1808b790 con 0x7fbf1c15cc50 2024-09-12T02:51:30.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.364+0000 7fbf21e00640 1 --2- 172.21.15.112:0/1140755374 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbf0006be30 0x7fbf0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:30.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.364+0000 7fbf21e00640 1 --2- 172.21.15.112:0/1140755374 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbf0006be30 0x7fbf0006e2f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbf10034000 tx=0x7fbf1002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:30.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.368+0000 7fbf16000640 1 -- 172.21.15.112:0/1140755374 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbf1805a0a0 con 0x7fbf1c15cc50 2024-09-12T02:51:30.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.575+0000 7fbf24800640 1 -- 172.21.15.112:0/1140755374 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbf1c0b1680 con 0x7fbf1c15cc50 2024-09-12T02:51:30.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.575+0000 7fbf16000640 1 -- 172.21.15.112:0/1140755374 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v86) ==== 53+0+73 (secure 0 0 0) 0x7fbf180599a0 con 0x7fbf1c15cc50 2024-09-12T02:51:30.577 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:51:30.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.578+0000 7fbf24800640 1 -- 172.21.15.112:0/1140755374 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbf0006be30 msgr2=0x7fbf0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:30.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.578+0000 7fbf24800640 1 --2- 172.21.15.112:0/1140755374 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbf0006be30 0x7fbf0006e2f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbf10034000 tx=0x7fbf1002e000 comp rx=0 tx=0).stop 2024-09-12T02:51:30.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.578+0000 7fbf24800640 1 -- 172.21.15.112:0/1140755374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf1c15cc50 msgr2=0x7fbf1c160a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:30.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.578+0000 7fbf24800640 1 --2- 172.21.15.112:0/1140755374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf1c15cc50 0x7fbf1c160a80 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fbf18007de0 tx=0x7fbf1800e4b0 comp rx=0 tx=0).stop 2024-09-12T02:51:30.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.578+0000 7fbf24800640 1 -- 172.21.15.112:0/1140755374 shutdown_connections 2024-09-12T02:51:30.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.578+0000 7fbf24800640 1 --2- 172.21.15.112:0/1140755374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf1c15cc50 0x7fbf1c160a80 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:30.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.578+0000 7fbf24800640 1 --2- 172.21.15.112:0/1140755374 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbf0006be30 0x7fbf0006e2f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:30.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.578+0000 7fbf24800640 1 --2- 172.21.15.112:0/1140755374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf1c0afe30 0x7fbf1c160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:30.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.578+0000 7fbf24800640 1 --2- 172.21.15.112:0/1140755374 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf1c071530 0x7fbf1c160000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:30.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.578+0000 7fbf24800640 1 -- 172.21.15.112:0/1140755374 >> 172.21.15.112:0/1140755374 conn(0x7fbf1c06bbd0 msgr2=0x7fbf1c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:30.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.578+0000 7fbf24800640 1 -- 172.21.15.112:0/1140755374 shutdown_connections 2024-09-12T02:51:30.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:30.578+0000 7fbf24800640 1 -- 172.21.15.112:0/1140755374 wait complete. 2024-09-12T02:51:30.594 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:51:30.594 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:51:30.594 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-09-12T02:51:30.594 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T02:51:30.594 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T02:51:30.594 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:51:30.594 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:51:30.594 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:51:30.595 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:51:30.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:51:30.595 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-09-12T02:51:30.635 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:51:30.635 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:51:30.635 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:51:30.635 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:51:30.635 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-09-12T02:51:30.635 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:51:30.635 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:51:30.635 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-09-12T02:51:30.635 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-09-12T02:51:30.636 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:51:30.636 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-09-12T02:51:30.636 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-09-12T02:51:30.636 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:51:30.636 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:51:30.636 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:51:30.636 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:51:30.636 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:51:30.636 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42188sec preferred_lft 42188sec 2024-09-12T02:51:30.636 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::ec4:7aff:fe88:8137/64 scope link noprefixroute 2024-09-12T02:51:30.636 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:51:30.637 INFO:teuthology.orchestra.run.smithi137.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:51:30.637 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 62:9a:8e:f1:56:55 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:51:30.637 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:51:30.637 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:51:30.637 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::30c8:13ff:fe15:f79d/64 scope link 2024-09-12T02:51:30.637 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:51:30.637 INFO:teuthology.orchestra.run.smithi137.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:51:30.637 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 62:9a:8e:f1:56:55 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:51:30.637 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::609a:8eff:fef1:5655/64 scope link 2024-09-12T02:51:30.637 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:51:30.637 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:51:30.637 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 96:f4:ca:17:88:2a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T02:51:30.638 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::94f4:caff:fe17:882a/64 scope link 2024-09-12T02:51:30.638 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:51:30.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:51:30.639 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:51:30.736 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-09-12T02:51:30.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:51:30.739 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-09-12T02:51:30.778 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-09-12T02:51:30.778 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:51:30.778 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:51:30.778 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:51:30.778 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:51:30.778 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:51:30.779 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-09-12T02:51:30.779 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:51:30.779 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:51:30.779 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:51:30.779 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-09-12T02:51:30.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:51:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:51:30.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:51:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:51:30.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:51:30.975 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-09-12T02:51:31.011 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T02:51:31.011 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T02:51:31.011 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:51:31.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:51:31.011 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-09-12T02:51:31.108 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:51:31.108 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T02:51:31.143 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:51:31.144 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:51:31.144 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T02:51:31.219 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-12T02:51:31.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:51:31.219 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:51:31.347 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:51:31.347 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:51:31.375 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:51:31.375 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:51:31.375 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-09-12T02:51:31.375 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with new device syntax: 1@7c01f3b3-dec2-4449-a33f-f960d7527ea6.cephfs=/ 2024-09-12T02:51:31.375 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.112:3300/172.21.15.137:3300/172.21.15.137:3301" will pass to kernel 2024-09-12T02:51:31.377 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-12T02:51:31.377 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:51:31.377 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:51:31.377 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:51:31.378 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:51:31.380 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:51:31.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:51:31.381 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T02:51:31.672 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:51:31.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:51:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:51:31.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:51:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:51:31.796 INFO:teuthology.orchestra.run.smithi137.stdout:client6362 2024-09-12T02:51:31.797 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:51:31.797 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:51:31.860 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:51:32.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.031+0000 7fb577000640 1 Processor -- start 2024-09-12T02:51:32.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.031+0000 7fb577000640 1 -- start start 2024-09-12T02:51:32.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.032+0000 7fb577000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb57006f600 0x7fb5700b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:32.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.032+0000 7fb577000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb5700b45d0 0x7fb5700728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:32.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.032+0000 7fb577000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5700b4a20 con 0x7fb57015b9d0 2024-09-12T02:51:32.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.033+0000 7fb577000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb5700b54a0 con 0x7fb5700b45d0 2024-09-12T02:51:32.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.033+0000 7fb577000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb5700b3af0 con 0x7fb57006f600 2024-09-12T02:51:32.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.033+0000 7fb575000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb5700b45d0 0x7fb5700728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:32.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.033+0000 7fb56fe00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb57015b9d0 0x7fb57006eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45474/0 (socket says 172.21.15.112:45474) 2024-09-12T02:51:32.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.033+0000 7fb56fe00640 1 -- 172.21.15.112:0/602359981 learned_addr learned my addr 172.21.15.112:0/602359981 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:51:32.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.033+0000 7fb567400640 1 --2- 172.21.15.112:0/602359981 >> v2:172.21.15.137:3300/0 conn(0x7fb57006f600 0x7fb5700b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:32.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.033+0000 7fb575000640 1 -- 172.21.15.112:0/602359981 >> v2:172.21.15.137:3300/0 conn(0x7fb57006f600 msgr2=0x7fb5700b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:32.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.033+0000 7fb575000640 1 --2- 172.21.15.112:0/602359981 >> v2:172.21.15.137:3300/0 conn(0x7fb57006f600 0x7fb5700b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:32.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.033+0000 7fb575000640 1 -- 172.21.15.112:0/602359981 >> v1:172.21.15.112:6789/0 conn(0x7fb57015b9d0 legacy=0x7fb57006eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:32.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.033+0000 7fb575000640 1 -- 172.21.15.112:0/602359981 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5700b3dd0 con 0x7fb5700b45d0 2024-09-12T02:51:32.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.033+0000 7fb56f400640 1 -- 172.21.15.112:0/602359981 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 649271629 0 0) 0x7fb5700b4a20 con 0x7fb57015b9d0 2024-09-12T02:51:32.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.034+0000 7fb575000640 1 --2- 172.21.15.112:0/602359981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5700b45d0 0x7fb5700728c0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fb570071200 tx=0x7fb56802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee6a8d9f717d225 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:32.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.034+0000 7fb56f400640 1 -- 172.21.15.112:0/602359981 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb568007740 con 0x7fb5700b45d0 2024-09-12T02:51:32.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.034+0000 7fb56f400640 1 -- 172.21.15.112:0/602359981 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5680078e0 con 0x7fb5700b45d0 2024-09-12T02:51:32.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.034+0000 7fb56f400640 1 -- 172.21.15.112:0/602359981 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb568007cb0 con 0x7fb5700b45d0 2024-09-12T02:51:32.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.035+0000 7fb577000640 1 -- 172.21.15.112:0/602359981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5700b45d0 msgr2=0x7fb5700728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:32.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.035+0000 7fb577000640 1 --2- 172.21.15.112:0/602359981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5700b45d0 0x7fb5700728c0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fb570071200 tx=0x7fb56802a5f0 comp rx=0 tx=0).stop 2024-09-12T02:51:32.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.035+0000 7fb577000640 1 -- 172.21.15.112:0/602359981 shutdown_connections 2024-09-12T02:51:32.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.035+0000 7fb577000640 1 --2- 172.21.15.112:0/602359981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5700b45d0 0x7fb5700728c0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:32.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.035+0000 7fb577000640 1 --2- 172.21.15.112:0/602359981 >> v2:172.21.15.137:3300/0 conn(0x7fb57006f600 0x7fb5700b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:32.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.035+0000 7fb577000640 1 -- 172.21.15.112:0/602359981 >> 172.21.15.112:0/602359981 conn(0x7fb57006bbd0 msgr2=0x7fb57006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:32.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.035+0000 7fb577000640 1 -- 172.21.15.112:0/602359981 shutdown_connections 2024-09-12T02:51:32.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.035+0000 7fb577000640 1 -- 172.21.15.112:0/602359981 wait complete. 2024-09-12T02:51:32.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.037+0000 7fb577000640 1 Processor -- start 2024-09-12T02:51:32.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.037+0000 7fb577000640 1 -- start start 2024-09-12T02:51:32.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.038+0000 7fb577000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb57006f600 0x7fb5701587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:32.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.038+0000 7fb577000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5700b45d0 0x7fb57015aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:32.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.038+0000 7fb577000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb57015b9d0 0x7fb570150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:32.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.038+0000 7fb577000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb57015bf30 con 0x7fb5700b45d0 2024-09-12T02:51:32.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.038+0000 7fb577000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb57015bdb0 con 0x7fb57015b9d0 2024-09-12T02:51:32.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.038+0000 7fb577000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb5700cdcd0 con 0x7fb57006f600 2024-09-12T02:51:32.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.038+0000 7fb567400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5700b45d0 0x7fb57015aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:32.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.038+0000 7fb567400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5700b45d0 0x7fb57015aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54446/0 (socket says 172.21.15.112:54446) 2024-09-12T02:51:32.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.038+0000 7fb56fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb57006f600 0x7fb5701587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:32.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.038+0000 7fb567400640 1 -- 172.21.15.112:0/1643455865 learned_addr learned my addr 172.21.15.112:0/1643455865 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:32.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.038+0000 7fb575000640 1 --2- 172.21.15.112:0/1643455865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb57015b9d0 0x7fb570150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:32.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.038+0000 7fb567400640 1 -- 172.21.15.112:0/1643455865 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb57006f600 msgr2=0x7fb5701587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:32.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.038+0000 7fb567400640 1 --2- 172.21.15.112:0/1643455865 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb57006f600 0x7fb5701587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:32.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.038+0000 7fb567400640 1 -- 172.21.15.112:0/1643455865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb57015b9d0 msgr2=0x7fb570150630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:32.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.038+0000 7fb567400640 1 --2- 172.21.15.112:0/1643455865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb57015b9d0 0x7fb570150630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:32.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.038+0000 7fb567400640 1 -- 172.21.15.112:0/1643455865 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb57015d660 con 0x7fb5700b45d0 2024-09-12T02:51:32.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.039+0000 7fb567400640 1 --2- 172.21.15.112:0/1643455865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5700b45d0 0x7fb57015aaa0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fb55800e910 tx=0x7fb55800edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:32.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.039+0000 7fb56cc00640 1 -- 172.21.15.112:0/1643455865 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb558017070 con 0x7fb5700b45d0 2024-09-12T02:51:32.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.039+0000 7fb56cc00640 1 -- 172.21.15.112:0/1643455865 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb55800ca00 con 0x7fb5700b45d0 2024-09-12T02:51:32.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.039+0000 7fb577000640 1 -- 172.21.15.112:0/1643455865 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb57015d940 con 0x7fb5700b45d0 2024-09-12T02:51:32.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.039+0000 7fb56cc00640 1 -- 172.21.15.112:0/1643455865 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55800cdb0 con 0x7fb5700b45d0 2024-09-12T02:51:32.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.039+0000 7fb577000640 1 -- 172.21.15.112:0/1643455865 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb57015df00 con 0x7fb5700b45d0 2024-09-12T02:51:32.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.040+0000 7fb577000640 1 -- 172.21.15.112:0/1643455865 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb570068a30 con 0x7fb5700b45d0 2024-09-12T02:51:32.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.041+0000 7fb56cc00640 1 -- 172.21.15.112:0/1643455865 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb55801a070 con 0x7fb5700b45d0 2024-09-12T02:51:32.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.042+0000 7fb56cc00640 1 --2- 172.21.15.112:0/1643455865 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb54c06be30 0x7fb54c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:32.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.042+0000 7fb56cc00640 1 -- 172.21.15.112:0/1643455865 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7fb55808b180 con 0x7fb5700b45d0 2024-09-12T02:51:32.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.042+0000 7fb56fe00640 1 --2- 172.21.15.112:0/1643455865 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb54c06be30 0x7fb54c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:32.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.043+0000 7fb56fe00640 1 --2- 172.21.15.112:0/1643455865 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb54c06be30 0x7fb54c06e2f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb560007fd0 tx=0x7fb560007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:32.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.047+0000 7fb56cc00640 1 -- 172.21.15.112:0/1643455865 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb5580594d0 con 0x7fb5700b45d0 2024-09-12T02:51:32.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.253+0000 7fb577000640 1 -- 172.21.15.112:0/1643455865 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb57015d3c0 con 0x7fb5700b45d0 2024-09-12T02:51:32.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.253+0000 7fb56cc00640 1 -- 172.21.15.112:0/1643455865 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5236 (secure 0 0 0) 0x7fb55805d7d0 con 0x7fb5700b45d0 2024-09-12T02:51:32.254 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:51:32.255 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":86,"btime":"2024-09-12T02:51:25:753588+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/1180447882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1180447882},{"type":"v1","addr":"172.21.15.112:6836","nonce":1180447882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":6916,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2975519871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2975519871},{"type":"v1","addr":"172.21.15.137:6835","nonce":2975519871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7554,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2629863369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2629863369},{"type":"v1","addr":"172.21.15.112:6837","nonce":2629863369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:51:22.139735+0000","modified":"2024-09-12T02:51:25.151523+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7560},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7560":{"gid":7560,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6834/245886809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":245886809},{"type":"v1","addr":"172.21.15.137:6834","nonce":245886809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7560,"qdb_cluster":[7560]},"id":10}]} 2024-09-12T02:51:32.255 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 86 2024-09-12T02:51:32.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.255+0000 7fb577000640 1 -- 172.21.15.112:0/1643455865 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb54c06be30 msgr2=0x7fb54c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:32.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.255+0000 7fb577000640 1 --2- 172.21.15.112:0/1643455865 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb54c06be30 0x7fb54c06e2f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb560007fd0 tx=0x7fb560007de0 comp rx=0 tx=0).stop 2024-09-12T02:51:32.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.255+0000 7fb577000640 1 -- 172.21.15.112:0/1643455865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5700b45d0 msgr2=0x7fb57015aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:32.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.255+0000 7fb577000640 1 --2- 172.21.15.112:0/1643455865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5700b45d0 0x7fb57015aaa0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fb55800e910 tx=0x7fb55800edd0 comp rx=0 tx=0).stop 2024-09-12T02:51:32.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.255+0000 7fb577000640 1 -- 172.21.15.112:0/1643455865 shutdown_connections 2024-09-12T02:51:32.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.255+0000 7fb577000640 1 --2- 172.21.15.112:0/1643455865 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb54c06be30 0x7fb54c06e2f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:32.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.255+0000 7fb577000640 1 --2- 172.21.15.112:0/1643455865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb57015b9d0 0x7fb570150630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:32.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.255+0000 7fb577000640 1 --2- 172.21.15.112:0/1643455865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5700b45d0 0x7fb57015aaa0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:32.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.255+0000 7fb577000640 1 --2- 172.21.15.112:0/1643455865 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb57006f600 0x7fb5701587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:32.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.255+0000 7fb577000640 1 -- 172.21.15.112:0/1643455865 >> 172.21.15.112:0/1643455865 conn(0x7fb57006bbd0 msgr2=0x7fb5700af560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:32.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.256+0000 7fb577000640 1 -- 172.21.15.112:0/1643455865 shutdown_connections 2024-09-12T02:51:32.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.256+0000 7fb577000640 1 -- 172.21.15.112:0/1643455865 wait complete. 2024-09-12T02:51:32.278 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2024-09-12T02:51:32.455 INFO:teuthology.orchestra.run.smithi137.stdout:{"cluster_fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","whoami":0,"id":7560,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.7148907609999995,"mdsmap_epoch":86,"osdmap_epoch":167,"osdmap_epoch_barrier":167,"uptime":14.818213487} 2024-09-12T02:51:32.455 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", "fs_name": "cephfs", "id": 7560, "mdsmap_epoch": 86, "osdmap_epoch": 167, "osdmap_epoch_barrier": 167, "rank_uptime": 9.714890761, "state": "up:active", "uptime": 14.818213487, "want_state": "up:active", "whoami": 0 } 2024-09-12T02:51:32.455 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2024-09-12T02:51:32.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.612+0000 7f9e36200640 1 Processor -- start 2024-09-12T02:51:32.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.612+0000 7f9e36200640 1 -- start start 2024-09-12T02:51:32.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.614+0000 7f9e36200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e3015cbf0 0x7f9e3006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:32.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.614+0000 7f9e36200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9e30071650 0x7f9e3015d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:32.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.614+0000 7f9e36200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e300d14a0 con 0x7f9e30071210 2024-09-12T02:51:32.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.614+0000 7f9e36200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f9e300d06a0 con 0x7f9e30071650 2024-09-12T02:51:32.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.614+0000 7f9e36200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9e300cf200 con 0x7f9e3015cbf0 2024-09-12T02:51:32.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.614+0000 7f9e35800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9e30071650 0x7f9e3015d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:32.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.614+0000 7f9e35800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9e30071650 0x7f9e3015d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54462/0 (socket says 172.21.15.112:54462) 2024-09-12T02:51:32.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.614+0000 7f9e35800640 1 -- 172.21.15.112:0/1383106394 learned_addr learned my addr 172.21.15.112:0/1383106394 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:32.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.614+0000 7f9e34e00640 1 --2- 172.21.15.112:0/1383106394 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e3015cbf0 0x7f9e3006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:32.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.614+0000 7f9e35800640 1 -- 172.21.15.112:0/1383106394 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e3015cbf0 msgr2=0x7f9e3006fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:32.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.614+0000 7f9e35800640 1 --2- 172.21.15.112:0/1383106394 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e3015cbf0 0x7f9e3006fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:32.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.614+0000 7f9e35800640 1 -- 172.21.15.112:0/1383106394 >> v1:172.21.15.112:6789/0 conn(0x7f9e30071210 legacy=0x7f9e3015cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:32.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.614+0000 7f9e35800640 1 -- 172.21.15.112:0/1383106394 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e300d1740 con 0x7f9e30071650 2024-09-12T02:51:32.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.615+0000 7f9e35800640 1 --2- 172.21.15.112:0/1383106394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e30071650 0x7f9e3015d6e0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f9e28009e50 tx=0x7f9e2802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=502819c2b0c7528a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:32.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.616+0000 7f9e2fe00640 1 -- 172.21.15.112:0/1383106394 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e28036070 con 0x7f9e30071650 2024-09-12T02:51:32.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.616+0000 7f9e2fe00640 1 -- 172.21.15.112:0/1383106394 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e28031600 con 0x7f9e30071650 2024-09-12T02:51:32.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.616+0000 7f9e2fe00640 1 -- 172.21.15.112:0/1383106394 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e280319d0 con 0x7f9e30071650 2024-09-12T02:51:32.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.616+0000 7f9e36200640 1 -- 172.21.15.112:0/1383106394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e30071650 msgr2=0x7f9e3015d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:32.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.616+0000 7f9e36200640 1 --2- 172.21.15.112:0/1383106394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e30071650 0x7f9e3015d6e0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f9e28009e50 tx=0x7f9e2802a680 comp rx=0 tx=0).stop 2024-09-12T02:51:32.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.616+0000 7f9e36200640 1 -- 172.21.15.112:0/1383106394 shutdown_connections 2024-09-12T02:51:32.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.616+0000 7f9e36200640 1 --2- 172.21.15.112:0/1383106394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e30071650 0x7f9e3015d6e0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:32.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.616+0000 7f9e36200640 1 --2- 172.21.15.112:0/1383106394 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e3015cbf0 0x7f9e3006fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:32.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.616+0000 7f9e36200640 1 -- 172.21.15.112:0/1383106394 >> 172.21.15.112:0/1383106394 conn(0x7f9e3009ba60 msgr2=0x7f9e3009be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:32.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.616+0000 7f9e36200640 1 -- 172.21.15.112:0/1383106394 shutdown_connections 2024-09-12T02:51:32.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.616+0000 7f9e36200640 1 -- 172.21.15.112:0/1383106394 wait complete. 2024-09-12T02:51:32.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.618+0000 7f9e36200640 1 Processor -- start 2024-09-12T02:51:32.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.618+0000 7f9e36200640 1 -- start start 2024-09-12T02:51:32.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.619+0000 7f9e36200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e30071210 0x7f9e30151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:32.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.619+0000 7f9e36200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e30071650 0x7f9e30153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:32.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.619+0000 7f9e36200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e3015cbf0 0x7f9e30154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:32.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.619+0000 7f9e36200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9e300d1d00 con 0x7f9e3015cbf0 2024-09-12T02:51:32.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.619+0000 7f9e36200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9e300d2130 con 0x7f9e30071650 2024-09-12T02:51:32.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.619+0000 7f9e36200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9e300cf670 con 0x7f9e30071210 2024-09-12T02:51:32.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.619+0000 7f9e35800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e3015cbf0 0x7f9e30154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:32.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.619+0000 7f9e35800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e3015cbf0 0x7f9e30154220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54464/0 (socket says 172.21.15.112:54464) 2024-09-12T02:51:32.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.619+0000 7f9e35800640 1 -- 172.21.15.112:0/4202990428 learned_addr learned my addr 172.21.15.112:0/4202990428 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:51:32.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.619+0000 7f9e34e00640 1 --2- 172.21.15.112:0/4202990428 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e30071210 0x7f9e30151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:32.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.619+0000 7f9e27e00640 1 --2- 172.21.15.112:0/4202990428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e30071650 0x7f9e30153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:32.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.619+0000 7f9e35800640 1 -- 172.21.15.112:0/4202990428 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e30071210 msgr2=0x7f9e30151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:32.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.619+0000 7f9e35800640 1 --2- 172.21.15.112:0/4202990428 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e30071210 0x7f9e30151ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:32.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.619+0000 7f9e35800640 1 -- 172.21.15.112:0/4202990428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e30071650 msgr2=0x7f9e30153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:32.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.619+0000 7f9e35800640 1 --2- 172.21.15.112:0/4202990428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e30071650 0x7f9e30153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:32.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.619+0000 7f9e35800640 1 -- 172.21.15.112:0/4202990428 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e3009cbb0 con 0x7f9e3015cbf0 2024-09-12T02:51:32.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.619+0000 7f9e27e00640 1 --2- 172.21.15.112:0/4202990428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e30071650 0x7f9e30153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:51:32.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.620+0000 7f9e35800640 1 --2- 172.21.15.112:0/4202990428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e3015cbf0 0x7f9e30154220 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f9e28034040 tx=0x7f9e28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:32.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.620+0000 7f9e2d600640 1 -- 172.21.15.112:0/4202990428 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e28041020 con 0x7f9e3015cbf0 2024-09-12T02:51:32.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.620+0000 7f9e2d600640 1 -- 172.21.15.112:0/4202990428 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e280077a0 con 0x7f9e3015cbf0 2024-09-12T02:51:32.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.620+0000 7f9e2d600640 1 -- 172.21.15.112:0/4202990428 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e28036040 con 0x7f9e3015cbf0 2024-09-12T02:51:32.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.620+0000 7f9e36200640 1 -- 172.21.15.112:0/4202990428 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e3009ce90 con 0x7f9e3015cbf0 2024-09-12T02:51:32.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.620+0000 7f9e36200640 1 -- 172.21.15.112:0/4202990428 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e30152430 con 0x7f9e3015cbf0 2024-09-12T02:51:32.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.621+0000 7f9e36200640 1 -- 172.21.15.112:0/4202990428 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e3006fa10 con 0x7f9e3015cbf0 2024-09-12T02:51:32.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.622+0000 7f9e2d600640 1 -- 172.21.15.112:0/4202990428 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e28044020 con 0x7f9e3015cbf0 2024-09-12T02:51:32.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.623+0000 7f9e2d600640 1 --2- 172.21.15.112:0/4202990428 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9e0c06be30 0x7f9e0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:32.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.623+0000 7f9e2d600640 1 -- 172.21.15.112:0/4202990428 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f9e280ab9a0 con 0x7f9e3015cbf0 2024-09-12T02:51:32.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.623+0000 7f9e34e00640 1 --2- 172.21.15.112:0/4202990428 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9e0c06be30 0x7f9e0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:32.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.624+0000 7f9e34e00640 1 --2- 172.21.15.112:0/4202990428 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9e0c06be30 0x7f9e0c06e2f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9e300b5080 tx=0x7f9e20009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:32.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.627+0000 7f9e2d600640 1 -- 172.21.15.112:0/4202990428 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9e2804b030 con 0x7f9e3015cbf0 2024-09-12T02:51:32.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:32.802+0000 7f9e36200640 1 -- 172.21.15.112:0/4202990428 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) -- 0x7f9e3015e960 con 0x7f9e3015cbf0 2024-09-12T02:51:33.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:33.787+0000 7f9e2d600640 1 -- 172.21.15.112:0/4202990428 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v168) ==== 181+0+0 (secure 0 0 0) 0x7f9e2807a3e0 con 0x7f9e3015cbf0 2024-09-12T02:51:33.788 INFO:teuthology.orchestra.run.smithi112.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2024-09-12T02:51:33.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:33.791+0000 7f9e36200640 1 -- 172.21.15.112:0/4202990428 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9e0c06be30 msgr2=0x7f9e0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:33.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:33.791+0000 7f9e36200640 1 --2- 172.21.15.112:0/4202990428 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9e0c06be30 0x7f9e0c06e2f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9e300b5080 tx=0x7f9e20009190 comp rx=0 tx=0).stop 2024-09-12T02:51:33.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:33.791+0000 7f9e36200640 1 -- 172.21.15.112:0/4202990428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e3015cbf0 msgr2=0x7f9e30154220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:33.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:33.791+0000 7f9e36200640 1 --2- 172.21.15.112:0/4202990428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e3015cbf0 0x7f9e30154220 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f9e28034040 tx=0x7f9e28004a40 comp rx=0 tx=0).stop 2024-09-12T02:51:33.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:33.791+0000 7f9e36200640 1 -- 172.21.15.112:0/4202990428 shutdown_connections 2024-09-12T02:51:33.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:33.791+0000 7f9e36200640 1 --2- 172.21.15.112:0/4202990428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e3015cbf0 0x7f9e30154220 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:33.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:33.791+0000 7f9e36200640 1 --2- 172.21.15.112:0/4202990428 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9e0c06be30 0x7f9e0c06e2f0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:33.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:33.791+0000 7f9e36200640 1 --2- 172.21.15.112:0/4202990428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e30071650 0x7f9e30153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:33.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:33.791+0000 7f9e36200640 1 --2- 172.21.15.112:0/4202990428 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e30071210 0x7f9e30151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:33.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:33.791+0000 7f9e36200640 1 -- 172.21.15.112:0/4202990428 >> 172.21.15.112:0/4202990428 conn(0x7f9e3009ba60 msgr2=0x7f9e3015cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:33.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:33.791+0000 7f9e36200640 1 -- 172.21.15.112:0/4202990428 shutdown_connections 2024-09-12T02:51:33.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:51:33.791+0000 7f9e36200640 1 -- 172.21.15.112:0/4202990428 wait complete. 2024-09-12T02:51:33.810 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-12T02:51:33.983 INFO:teuthology.orchestra.run.smithi112.stdout:{"osd_mon_report_interval":"5"} 2024-09-12T02:51:33.984 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-12T02:51:33.984 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2024-09-12T02:51:34.144 INFO:teuthology.orchestra.run.smithi112.stdout:{"mon_tick_interval":"5"} 2024-09-12T02:51:34.145 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2024-09-12T02:51:34.145 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2024-09-12T02:51:34.145 DEBUG:teuthology.orchestra.run.smithi112:> stdin-killer -- python3 -c ' 2024-09-12T02:51:34.145 DEBUG:teuthology.orchestra.run.smithi112:> import time 2024-09-12T02:51:34.145 DEBUG:teuthology.orchestra.run.smithi112:> import datetime 2024-09-12T02:51:34.146 DEBUG:teuthology.orchestra.run.smithi112:> import subprocess 2024-09-12T02:51:34.146 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-12T02:51:34.146 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:51:34.146 DEBUG:teuthology.orchestra.run.smithi112:> # Write some buffered data through before going full, all should be well 2024-09-12T02:51:34.146 DEBUG:teuthology.orchestra.run.smithi112:> print("writing some data through which we expect to succeed") 2024-09-12T02:51:34.146 DEBUG:teuthology.orchestra.run.smithi112:> bytes = 0 2024-09-12T02:51:34.146 DEBUG:teuthology.orchestra.run.smithi112:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2024-09-12T02:51:34.146 DEBUG:teuthology.orchestra.run.smithi112:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2024-09-12T02:51:34.146 DEBUG:teuthology.orchestra.run.smithi112:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2024-09-12T02:51:34.146 DEBUG:teuthology.orchestra.run.smithi112:> os.fsync(f) 2024-09-12T02:51:34.146 DEBUG:teuthology.orchestra.run.smithi112:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2024-09-12T02:51:34.146 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:51:34.146 DEBUG:teuthology.orchestra.run.smithi112:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2024-09-12T02:51:34.146 DEBUG:teuthology.orchestra.run.smithi112:> # writing until we see an error from fsync. As long as we'"'"'re doing 2024-09-12T02:51:34.147 DEBUG:teuthology.orchestra.run.smithi112:> # buffered IO, the error should always only appear from fsync and not 2024-09-12T02:51:34.147 DEBUG:teuthology.orchestra.run.smithi112:> # from write 2024-09-12T02:51:34.147 DEBUG:teuthology.orchestra.run.smithi112:> full = False 2024-09-12T02:51:34.147 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:51:34.147 DEBUG:teuthology.orchestra.run.smithi112:> for n in range(0, int(32 * 1.1)): 2024-09-12T02:51:34.147 DEBUG:teuthology.orchestra.run.smithi112:> try: 2024-09-12T02:51:34.147 DEBUG:teuthology.orchestra.run.smithi112:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-12T02:51:34.147 DEBUG:teuthology.orchestra.run.smithi112:> print("wrote bytes via buffered write, moving on to fsync") 2024-09-12T02:51:34.147 DEBUG:teuthology.orchestra.run.smithi112:> except OSError as e: 2024-09-12T02:51:34.147 DEBUG:teuthology.orchestra.run.smithi112:> if False: 2024-09-12T02:51:34.147 DEBUG:teuthology.orchestra.run.smithi112:> print("Unexpected error %s from write() instead of fsync()" % e) 2024-09-12T02:51:34.147 DEBUG:teuthology.orchestra.run.smithi112:> raise 2024-09-12T02:51:34.147 DEBUG:teuthology.orchestra.run.smithi112:> else: 2024-09-12T02:51:34.148 DEBUG:teuthology.orchestra.run.smithi112:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-12T02:51:34.148 DEBUG:teuthology.orchestra.run.smithi112:> full = True 2024-09-12T02:51:34.148 DEBUG:teuthology.orchestra.run.smithi112:> break 2024-09-12T02:51:34.148 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:51:34.148 DEBUG:teuthology.orchestra.run.smithi112:> try: 2024-09-12T02:51:34.148 DEBUG:teuthology.orchestra.run.smithi112:> os.fsync(f) 2024-09-12T02:51:34.148 DEBUG:teuthology.orchestra.run.smithi112:> print("fsync'"'"'ed successfully") 2024-09-12T02:51:34.148 DEBUG:teuthology.orchestra.run.smithi112:> except OSError as e: 2024-09-12T02:51:34.148 DEBUG:teuthology.orchestra.run.smithi112:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-12T02:51:34.148 DEBUG:teuthology.orchestra.run.smithi112:> full = True 2024-09-12T02:51:34.148 DEBUG:teuthology.orchestra.run.smithi112:> break 2024-09-12T02:51:34.148 DEBUG:teuthology.orchestra.run.smithi112:> else: 2024-09-12T02:51:34.148 DEBUG:teuthology.orchestra.run.smithi112:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-12T02:51:34.148 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:51:34.149 DEBUG:teuthology.orchestra.run.smithi112:> if n > 32 * 0.9: 2024-09-12T02:51:34.149 DEBUG:teuthology.orchestra.run.smithi112:> # Be cautious in the last region where we expect to hit 2024-09-12T02:51:34.149 DEBUG:teuthology.orchestra.run.smithi112:> # the full condition, so that we don'"'"'t overshoot too dramatically 2024-09-12T02:51:34.149 DEBUG:teuthology.orchestra.run.smithi112:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2024-09-12T02:51:34.149 DEBUG:teuthology.orchestra.run.smithi112:> time.sleep(15.0) 2024-09-12T02:51:34.149 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:51:34.149 DEBUG:teuthology.orchestra.run.smithi112:> if not full: 2024-09-12T02:51:34.149 DEBUG:teuthology.orchestra.run.smithi112:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2024-09-12T02:51:34.149 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:51:34.149 DEBUG:teuthology.orchestra.run.smithi112:> # close() should not raise an error because we already caught it in 2024-09-12T02:51:34.149 DEBUG:teuthology.orchestra.run.smithi112:> # fsync. There shouldn'"'"'t have been any more writeback errors 2024-09-12T02:51:34.149 DEBUG:teuthology.orchestra.run.smithi112:> # since then because all IOs got cancelled on the full flag. 2024-09-12T02:51:34.149 DEBUG:teuthology.orchestra.run.smithi112:> print("calling close") 2024-09-12T02:51:34.149 DEBUG:teuthology.orchestra.run.smithi112:> os.close(f) 2024-09-12T02:51:34.150 DEBUG:teuthology.orchestra.run.smithi112:> print("close() did not raise error") 2024-09-12T02:51:34.150 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-12T02:51:34.150 DEBUG:teuthology.orchestra.run.smithi112:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2024-09-12T02:51:34.150 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-12T02:51:52.688 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:51:52.694 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:52:22.802 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:52:22.807 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:52:37.979 INFO:teuthology.orchestra.run.smithi112.stdout:writing some data through which we expect to succeed 2024-09-12T02:52:37.980 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed data successfully, will now attempt to fill fs 2024-09-12T02:52:37.980 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.980 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.980 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 1.00 MB 2024-09-12T02:52:37.980 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.980 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.980 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 2.00 MB 2024-09-12T02:52:37.980 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.980 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.980 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 3.00 MB 2024-09-12T02:52:37.981 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.981 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.981 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 4.00 MB 2024-09-12T02:52:37.981 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.981 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.981 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 5.00 MB 2024-09-12T02:52:37.981 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.981 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.981 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 6.00 MB 2024-09-12T02:52:37.981 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.981 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.981 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 7.00 MB 2024-09-12T02:52:37.981 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.981 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.982 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 8.00 MB 2024-09-12T02:52:37.982 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.982 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.982 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 9.00 MB 2024-09-12T02:52:37.982 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.982 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.982 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 10.00 MB 2024-09-12T02:52:37.982 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.982 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.982 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 11.00 MB 2024-09-12T02:52:37.982 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.982 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.982 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 12.00 MB 2024-09-12T02:52:37.983 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.983 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.983 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 13.00 MB 2024-09-12T02:52:37.983 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.983 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.983 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 14.00 MB 2024-09-12T02:52:37.983 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.983 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.983 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 15.00 MB 2024-09-12T02:52:37.983 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.983 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.983 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 16.00 MB 2024-09-12T02:52:37.983 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.983 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.984 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 17.00 MB 2024-09-12T02:52:37.984 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.984 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.984 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 18.00 MB 2024-09-12T02:52:37.984 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.984 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.984 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 19.00 MB 2024-09-12T02:52:37.984 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.984 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.984 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 20.00 MB 2024-09-12T02:52:37.984 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.984 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.984 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 21.00 MB 2024-09-12T02:52:37.985 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.985 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.985 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 22.00 MB 2024-09-12T02:52:37.985 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.985 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.985 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 23.00 MB 2024-09-12T02:52:37.985 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.985 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.985 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 24.00 MB 2024-09-12T02:52:37.985 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.985 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.985 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 25.00 MB 2024-09-12T02:52:37.985 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.986 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.986 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 26.00 MB 2024-09-12T02:52:37.986 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.986 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.986 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 27.00 MB 2024-09-12T02:52:37.986 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.986 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.986 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 28.00 MB 2024-09-12T02:52:37.986 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.986 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.986 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 29.00 MB 2024-09-12T02:52:37.986 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.986 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.987 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 30.00 MB 2024-09-12T02:52:37.987 INFO:teuthology.orchestra.run.smithi112.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-12T02:52:37.987 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.987 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.987 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 31.00 MB 2024-09-12T02:52:37.987 INFO:teuthology.orchestra.run.smithi112.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-12T02:52:37.987 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.987 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.987 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 32.00 MB 2024-09-12T02:52:37.987 INFO:teuthology.orchestra.run.smithi112.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-12T02:52:37.987 INFO:teuthology.orchestra.run.smithi112.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-12T02:52:37.987 INFO:teuthology.orchestra.run.smithi112.stdout:fsync'ed successfully 2024-09-12T02:52:37.987 INFO:teuthology.orchestra.run.smithi112.stdout:Not full yet after 33.00 MB 2024-09-12T02:52:37.988 INFO:teuthology.orchestra.run.smithi112.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-12T02:52:37.988 INFO:teuthology.orchestra.run.smithi112.stdout:Reached fullness after 33.00 MB 2024-09-12T02:52:37.988 INFO:teuthology.orchestra.run.smithi112.stdout:calling close 2024-09-12T02:52:37.988 INFO:teuthology.orchestra.run.smithi112.stdout:close() did not raise error 2024-09-12T02:52:37.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:52:37.996 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:52:37.996 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:52:38.100 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:52:38.199 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:52:38.199 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:52:38.199 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:52:38.200 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:52:38.236 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:52:38.236 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:52:38.315 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:52:38.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.509+0000 7fa2b3e00640 1 Processor -- start 2024-09-12T02:52:38.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.509+0000 7fa2b3e00640 1 -- start start 2024-09-12T02:52:38.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.511+0000 7fa2b3e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa2b41620f0 0x7fa2b40b5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:38.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.511+0000 7fa2b3e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2b406f4b0 0x7fa2b40ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:38.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.511+0000 7fa2b3e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2b40b4f80 con 0x7fa2b40afd70 2024-09-12T02:52:38.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.511+0000 7fa2b3e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa2b41624d0 con 0x7fa2b41620f0 2024-09-12T02:52:38.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.511+0000 7fa2b3e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa2b40d0de0 con 0x7fa2b406f4b0 2024-09-12T02:52:38.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.511+0000 7fa2aa000640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa2b40afd70 0x7fa2b406eda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:57046/0 (socket says 172.21.15.112:57046) 2024-09-12T02:52:38.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.511+0000 7fa2aa000640 1 -- 172.21.15.112:0/2311885135 learned_addr learned my addr 172.21.15.112:0/2311885135 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:52:38.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.511+0000 7fa2b2000640 1 -- 172.21.15.112:0/2311885135 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 862488908 0 0) 0x7fa2b40b4f80 con 0x7fa2b40afd70 2024-09-12T02:52:38.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.511+0000 7fa2b2a00640 1 --2- 172.21.15.112:0/2311885135 >> v2:172.21.15.137:3300/0 conn(0x7fa2b41620f0 0x7fa2b40b5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:38.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.511+0000 7fa2b2000640 1 -- 172.21.15.112:0/2311885135 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa298003520 con 0x7fa2b40afd70 2024-09-12T02:52:38.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.511+0000 7fa2b3400640 1 --2- 172.21.15.112:0/2311885135 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2b406f4b0 0x7fa2b40ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:38.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.512+0000 7fa2b2000640 1 -- 172.21.15.112:0/2311885135 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2636024457 0 0) 0x7fa298003520 con 0x7fa2b40afd70 2024-09-12T02:52:38.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.512+0000 7fa2b2000640 1 -- 172.21.15.112:0/2311885135 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2b406f4b0 msgr2=0x7fa2b40ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:38.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.512+0000 7fa2b2000640 1 --2- 172.21.15.112:0/2311885135 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2b406f4b0 0x7fa2b40ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:38.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.512+0000 7fa2b2000640 1 -- 172.21.15.112:0/2311885135 >> v2:172.21.15.137:3300/0 conn(0x7fa2b41620f0 msgr2=0x7fa2b40b5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:38.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.512+0000 7fa2b2000640 1 --2- 172.21.15.112:0/2311885135 >> v2:172.21.15.137:3300/0 conn(0x7fa2b41620f0 0x7fa2b40b5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:38.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.512+0000 7fa2b2000640 1 -- 172.21.15.112:0/2311885135 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b40d10c0 con 0x7fa2b40afd70 2024-09-12T02:52:38.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.512+0000 7fa2b2000640 1 -- 172.21.15.112:0/2311885135 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7fa29c001690 con 0x7fa2b40afd70 2024-09-12T02:52:38.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.512+0000 7fa2b2000640 1 -- 172.21.15.112:0/2311885135 >> v1:172.21.15.112:6789/0 conn(0x7fa2b40afd70 legacy=0x7fa2b406eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:38.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.512+0000 7fa2b2000640 1 --2- 172.21.15.112:0/2311885135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2980039b0 0x7fa298003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:38.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.512+0000 7fa2b2000640 1 --2- 172.21.15.112:0/2311885135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa298004800 0x7fa298004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:38.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.512+0000 7fa2b2000640 1 --2- 172.21.15.112:0/2311885135 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2b406f4b0 0x7fa2980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:38.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.512+0000 7fa2b2000640 1 -- 172.21.15.112:0/2311885135 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b41624d0 con 0x7fa2980039b0 2024-09-12T02:52:38.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.512+0000 7fa2b2000640 1 -- 172.21.15.112:0/2311885135 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b40d0de0 con 0x7fa298004800 2024-09-12T02:52:38.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.512+0000 7fa2b2000640 1 -- 172.21.15.112:0/2311885135 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa29800ba10 con 0x7fa2b406f4b0 2024-09-12T02:52:38.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.512+0000 7fa2b2a00640 1 --2- 172.21.15.112:0/2311885135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2980039b0 0x7fa298003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:38.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.512+0000 7fa2aa000640 1 --2- 172.21.15.112:0/2311885135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa298004800 0x7fa298004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:38.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.512+0000 7fa2b3400640 1 --2- 172.21.15.112:0/2311885135 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2b406f4b0 0x7fa2980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:38.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.512+0000 7fa2b2a00640 1 -- 172.21.15.112:0/2311885135 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2b406f4b0 msgr2=0x7fa2980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:38.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.512+0000 7fa2b2a00640 1 --2- 172.21.15.112:0/2311885135 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2b406f4b0 0x7fa2980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:38.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.512+0000 7fa2b2a00640 1 -- 172.21.15.112:0/2311885135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa298004800 msgr2=0x7fa298004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:38.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.512+0000 7fa2b2a00640 1 --2- 172.21.15.112:0/2311885135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa298004800 0x7fa298004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:38.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.512+0000 7fa2b2a00640 1 -- 172.21.15.112:0/2311885135 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa298003520 con 0x7fa2980039b0 2024-09-12T02:52:38.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.513+0000 7fa2b2a00640 1 --2- 172.21.15.112:0/2311885135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2980039b0 0x7fa298003dd0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4009af0 tx=0x7fa298005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7a5bd1785e83c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:38.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.514+0000 7fa2b2000640 1 -- 172.21.15.112:0/2311885135 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4036070 con 0x7fa2980039b0 2024-09-12T02:52:38.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.514+0000 7fa2b2000640 1 -- 172.21.15.112:0/2311885135 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2a4031400 con 0x7fa2980039b0 2024-09-12T02:52:38.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.514+0000 7fa2b2000640 1 -- 172.21.15.112:0/2311885135 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4009690 con 0x7fa2980039b0 2024-09-12T02:52:38.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.514+0000 7fa2b3e00640 1 -- 172.21.15.112:0/2311885135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2980039b0 msgr2=0x7fa298003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:38.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.514+0000 7fa2b3e00640 1 --2- 172.21.15.112:0/2311885135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2980039b0 0x7fa298003dd0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4009af0 tx=0x7fa298005830 comp rx=0 tx=0).stop 2024-09-12T02:52:38.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.514+0000 7fa2b3400640 1 -- 172.21.15.112:0/2311885135 reap_dead start 2024-09-12T02:52:38.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.514+0000 7fa2b3e00640 1 -- 172.21.15.112:0/2311885135 shutdown_connections 2024-09-12T02:52:38.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.514+0000 7fa2b3e00640 1 -- 172.21.15.112:0/2311885135 >> 172.21.15.112:0/2311885135 conn(0x7fa2b406bbd0 msgr2=0x7fa2b406bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:38.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.514+0000 7fa2b3e00640 1 -- 172.21.15.112:0/2311885135 shutdown_connections 2024-09-12T02:52:38.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.514+0000 7fa2b3e00640 1 -- 172.21.15.112:0/2311885135 wait complete. 2024-09-12T02:52:38.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.516+0000 7fa2b3e00640 1 Processor -- start 2024-09-12T02:52:38.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.516+0000 7fa2b3e00640 1 -- start start 2024-09-12T02:52:38.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.517+0000 7fa2b3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2980039b0 0x7fa2b4158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:38.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.517+0000 7fa2b3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2b41560d0 0x7fa2b4159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:38.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.517+0000 7fa2b3e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2b41543a0 0x7fa2b4154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:38.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.517+0000 7fa2b3e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b40d13a0 con 0x7fa2b41560d0 2024-09-12T02:52:38.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.517+0000 7fa2b3e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b40737d0 con 0x7fa2980039b0 2024-09-12T02:52:38.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.517+0000 7fa2b3e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa2b40d0820 con 0x7fa2b41543a0 2024-09-12T02:52:38.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.517+0000 7fa2aa000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2b41560d0 0x7fa2b4159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:38.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.517+0000 7fa2aa000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2b41560d0 0x7fa2b4159130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44462/0 (socket says 172.21.15.112:44462) 2024-09-12T02:52:38.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.517+0000 7fa2aa000640 1 -- 172.21.15.112:0/278031640 learned_addr learned my addr 172.21.15.112:0/278031640 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:38.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.518+0000 7fa2aa000640 1 -- 172.21.15.112:0/278031640 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2b41543a0 msgr2=0x7fa2b4154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:38.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.518+0000 7fa2aa000640 1 --2- 172.21.15.112:0/278031640 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2b41543a0 0x7fa2b4154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:38.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.518+0000 7fa2aa000640 1 -- 172.21.15.112:0/278031640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2980039b0 msgr2=0x7fa2b4158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:38.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.518+0000 7fa2aa000640 1 --2- 172.21.15.112:0/278031640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2980039b0 0x7fa2b4158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:38.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.518+0000 7fa2aa000640 1 -- 172.21.15.112:0/278031640 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b4154d60 con 0x7fa2b41560d0 2024-09-12T02:52:38.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.518+0000 7fa2aa000640 1 --2- 172.21.15.112:0/278031640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2b41560d0 0x7fa2b4159130 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fa29c007340 tx=0x7fa29c007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:38.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.518+0000 7fa2ab400640 1 -- 172.21.15.112:0/278031640 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29c00f940 con 0x7fa2b41560d0 2024-09-12T02:52:38.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.518+0000 7fa2ab400640 1 -- 172.21.15.112:0/278031640 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa29c018070 con 0x7fa2b41560d0 2024-09-12T02:52:38.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.518+0000 7fa2ab400640 1 -- 172.21.15.112:0/278031640 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29c00fd40 con 0x7fa2b41560d0 2024-09-12T02:52:38.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.518+0000 7fa2b3e00640 1 -- 172.21.15.112:0/278031640 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2b4156620 con 0x7fa2b41560d0 2024-09-12T02:52:38.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.518+0000 7fa2b3e00640 1 -- 172.21.15.112:0/278031640 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2b4156be0 con 0x7fa2b41560d0 2024-09-12T02:52:38.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.519+0000 7fa2b3e00640 1 -- 172.21.15.112:0/278031640 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2b415f890 con 0x7fa2b41560d0 2024-09-12T02:52:38.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.520+0000 7fa2ab400640 1 -- 172.21.15.112:0/278031640 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa29c01d460 con 0x7fa2b41560d0 2024-09-12T02:52:38.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.521+0000 7fa2ab400640 1 --2- 172.21.15.112:0/278031640 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa29006be30 0x7fa29006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:38.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.521+0000 7fa2ab400640 1 -- 172.21.15.112:0/278031640 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5738+0+0 (secure 0 0 0) 0x7fa29c08afc0 con 0x7fa2b41560d0 2024-09-12T02:52:38.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.521+0000 7fa2b2a00640 1 --2- 172.21.15.112:0/278031640 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa29006be30 0x7fa29006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:38.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.521+0000 7fa2ab400640 1 -- 172.21.15.112:0/278031640 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=172}) -- 0x7fa2900739c0 con 0x7fa2b41560d0 2024-09-12T02:52:38.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.522+0000 7fa2b2a00640 1 --2- 172.21.15.112:0/278031640 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa29006be30 0x7fa29006e2f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4033000 tx=0x7fa2a402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:38.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.525+0000 7fa2ab400640 1 -- 172.21.15.112:0/278031640 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa2b4154d60 con 0x7fa2b41560d0 2024-09-12T02:52:38.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.706+0000 7fa2b3e00640 1 -- 172.21.15.112:0/278031640 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa2b40b5740 con 0x7fa2b41560d0 2024-09-12T02:52:38.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.707+0000 7fa2ab400640 1 -- 172.21.15.112:0/278031640 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v171) ==== 80+0+0 (secure 0 0 0) 0x7fa29c059970 con 0x7fa2b41560d0 2024-09-12T02:52:38.708 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-12T02:52:38.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.709+0000 7fa2b3e00640 1 -- 172.21.15.112:0/278031640 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa29006be30 msgr2=0x7fa29006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:38.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.709+0000 7fa2b3e00640 1 --2- 172.21.15.112:0/278031640 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa29006be30 0x7fa29006e2f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4033000 tx=0x7fa2a402e000 comp rx=0 tx=0).stop 2024-09-12T02:52:38.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.709+0000 7fa2b3e00640 1 -- 172.21.15.112:0/278031640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2b41560d0 msgr2=0x7fa2b4159130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:38.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.709+0000 7fa2b3e00640 1 --2- 172.21.15.112:0/278031640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2b41560d0 0x7fa2b4159130 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fa29c007340 tx=0x7fa29c007800 comp rx=0 tx=0).stop 2024-09-12T02:52:38.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.709+0000 7fa2b3e00640 1 -- 172.21.15.112:0/278031640 shutdown_connections 2024-09-12T02:52:38.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.709+0000 7fa2b3e00640 1 --2- 172.21.15.112:0/278031640 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2b41543a0 0x7fa2b4154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:38.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.709+0000 7fa2b3e00640 1 --2- 172.21.15.112:0/278031640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2b41560d0 0x7fa2b4159130 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:38.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.709+0000 7fa2b3e00640 1 --2- 172.21.15.112:0/278031640 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa29006be30 0x7fa29006e2f0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:38.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.709+0000 7fa2b3e00640 1 --2- 172.21.15.112:0/278031640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2980039b0 0x7fa2b4158640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:38.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.709+0000 7fa2b3e00640 1 -- 172.21.15.112:0/278031640 >> 172.21.15.112:0/278031640 conn(0x7fa2b406bbd0 msgr2=0x7fa2b406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:38.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.709+0000 7fa2b3e00640 1 -- 172.21.15.112:0/278031640 shutdown_connections 2024-09-12T02:52:38.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:38.709+0000 7fa2b3e00640 1 -- 172.21.15.112:0/278031640 wait complete. 2024-09-12T02:52:38.726 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:52:38.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:52:38.727 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T02:52:38.790 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-12T02:52:38.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:52:38.790 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:52:38.830 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:52:38.830 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:52:38.830 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:52:38.870 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:52:38.870 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:52:38.947 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:52:39.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.100+0000 7efca2600640 1 Processor -- start 2024-09-12T02:52:39.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.100+0000 7efca2600640 1 -- start start 2024-09-12T02:52:39.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.101+0000 7efca2600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc9c06e3b0 0x7efc9c0afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:39.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.101+0000 7efca2600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc9c0aedd0 con 0x7efc9c06d8c0 2024-09-12T02:52:39.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.101+0000 7efca2600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc9c0af0b0 con 0x7efc9c0ae8d0 2024-09-12T02:52:39.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.101+0000 7efca2600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7efc9c0af390 con 0x7efc9c06e3b0 2024-09-12T02:52:39.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.101+0000 7efc9b400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7efc9c06d8c0 0x7efc9c0715a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:57060/0 (socket says 172.21.15.112:57060) 2024-09-12T02:52:39.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.101+0000 7efc9b400640 1 -- 172.21.15.112:0/46692729 learned_addr learned my addr 172.21.15.112:0/46692729 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:52:39.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.102+0000 7efc9be00640 1 --2- 172.21.15.112:0/46692729 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc9c06e3b0 0x7efc9c0afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:39.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.102+0000 7efc9a000640 1 -- 172.21.15.112:0/46692729 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4077871953 0 0) 0x7efc9c0aedd0 con 0x7efc9c06d8c0 2024-09-12T02:52:39.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.102+0000 7efc9a000640 1 -- 172.21.15.112:0/46692729 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc80003520 con 0x7efc9c06d8c0 2024-09-12T02:52:39.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.102+0000 7efc9a000640 1 -- 172.21.15.112:0/46692729 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 667906675 0 0) 0x7efc9c0af0b0 con 0x7efc9c0ae8d0 2024-09-12T02:52:39.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.102+0000 7efc9a000640 1 -- 172.21.15.112:0/46692729 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc9c0aedd0 con 0x7efc9c0ae8d0 2024-09-12T02:52:39.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.102+0000 7efc9be00640 1 -- 172.21.15.112:0/46692729 >> v1:172.21.15.137:6789/0 conn(0x7efc9c0ae8d0 legacy=0x7efc9c06dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:39.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.102+0000 7efc9be00640 1 -- 172.21.15.112:0/46692729 >> v1:172.21.15.112:6789/0 conn(0x7efc9c06d8c0 legacy=0x7efc9c0715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:39.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.102+0000 7efc9be00640 1 -- 172.21.15.112:0/46692729 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc9c0af670 con 0x7efc9c06e3b0 2024-09-12T02:52:39.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.103+0000 7efc9be00640 1 --2- 172.21.15.112:0/46692729 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc9c06e3b0 0x7efc9c0afe70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efc94009dc0 tx=0x7efc9402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df4855028e6c9164 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:39.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.103+0000 7efc9a000640 1 -- 172.21.15.112:0/46692729 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc94007740 con 0x7efc9c06e3b0 2024-09-12T02:52:39.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.104+0000 7efc9a000640 1 -- 172.21.15.112:0/46692729 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc940078e0 con 0x7efc9c06e3b0 2024-09-12T02:52:39.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.104+0000 7efc9a000640 1 -- 172.21.15.112:0/46692729 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc94007c90 con 0x7efc9c06e3b0 2024-09-12T02:52:39.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.104+0000 7efca2600640 1 -- 172.21.15.112:0/46692729 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc9c06e3b0 msgr2=0x7efc9c0afe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:39.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.104+0000 7efca2600640 1 --2- 172.21.15.112:0/46692729 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc9c06e3b0 0x7efc9c0afe70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efc94009dc0 tx=0x7efc9402a6d0 comp rx=0 tx=0).stop 2024-09-12T02:52:39.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.104+0000 7efca2600640 1 -- 172.21.15.112:0/46692729 shutdown_connections 2024-09-12T02:52:39.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.104+0000 7efca2600640 1 --2- 172.21.15.112:0/46692729 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc9c06e3b0 0x7efc9c0afe70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:39.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.104+0000 7efca2600640 1 -- 172.21.15.112:0/46692729 >> 172.21.15.112:0/46692729 conn(0x7efc9c06bbd0 msgr2=0x7efc9c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:39.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.104+0000 7efca2600640 1 -- 172.21.15.112:0/46692729 shutdown_connections 2024-09-12T02:52:39.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.104+0000 7efca2600640 1 -- 172.21.15.112:0/46692729 wait complete. 2024-09-12T02:52:39.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.106+0000 7efca2600640 1 Processor -- start 2024-09-12T02:52:39.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.106+0000 7efca2600640 1 -- start start 2024-09-12T02:52:39.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.107+0000 7efca2600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc9c06d8c0 0x7efc9c1529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:39.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.107+0000 7efca2600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc9c06e3b0 0x7efc9c0cfef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:39.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.107+0000 7efca2600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc9c0ae8d0 0x7efc9c1544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:39.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.107+0000 7efca2600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efc9c0b3a60 con 0x7efc9c0ae8d0 2024-09-12T02:52:39.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.107+0000 7efca2600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efc9c0b38e0 con 0x7efc9c06e3b0 2024-09-12T02:52:39.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.107+0000 7efca2600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7efc9c0b3be0 con 0x7efc9c06d8c0 2024-09-12T02:52:39.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.107+0000 7efc9be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc9c0ae8d0 0x7efc9c1544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:39.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.107+0000 7efc9be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc9c0ae8d0 0x7efc9c1544e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44476/0 (socket says 172.21.15.112:44476) 2024-09-12T02:52:39.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.107+0000 7efc9be00640 1 -- 172.21.15.112:0/1636777165 learned_addr learned my addr 172.21.15.112:0/1636777165 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:39.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.107+0000 7efc9b400640 1 --2- 172.21.15.112:0/1636777165 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc9c06d8c0 0x7efc9c1529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:39.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.108+0000 7efc9aa00640 1 --2- 172.21.15.112:0/1636777165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc9c06e3b0 0x7efc9c0cfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:39.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.108+0000 7efc9be00640 1 -- 172.21.15.112:0/1636777165 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc9c06d8c0 msgr2=0x7efc9c1529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:39.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.108+0000 7efc9be00640 1 --2- 172.21.15.112:0/1636777165 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc9c06d8c0 0x7efc9c1529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:39.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.108+0000 7efc9be00640 1 -- 172.21.15.112:0/1636777165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc9c06e3b0 msgr2=0x7efc9c0cfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:39.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.108+0000 7efc9be00640 1 --2- 172.21.15.112:0/1636777165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc9c06e3b0 0x7efc9c0cfef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:39.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.108+0000 7efc9be00640 1 -- 172.21.15.112:0/1636777165 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc9c162190 con 0x7efc9c0ae8d0 2024-09-12T02:52:39.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.108+0000 7efc9b400640 1 --2- 172.21.15.112:0/1636777165 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc9c06d8c0 0x7efc9c1529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:52:39.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.108+0000 7efc9be00640 1 --2- 172.21.15.112:0/1636777165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc9c0ae8d0 0x7efc9c1544e0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7efc9402acc0 tx=0x7efc94004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:39.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.108+0000 7efc93400640 1 -- 172.21.15.112:0/1636777165 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc94009450 con 0x7efc9c0ae8d0 2024-09-12T02:52:39.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.108+0000 7efc93400640 1 -- 172.21.15.112:0/1636777165 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc94004240 con 0x7efc9c0ae8d0 2024-09-12T02:52:39.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.108+0000 7efc93400640 1 -- 172.21.15.112:0/1636777165 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc94004610 con 0x7efc9c0ae8d0 2024-09-12T02:52:39.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.108+0000 7efca2600640 1 -- 172.21.15.112:0/1636777165 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc9c162470 con 0x7efc9c0ae8d0 2024-09-12T02:52:39.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.108+0000 7efca2600640 1 -- 172.21.15.112:0/1636777165 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc9c0ce010 con 0x7efc9c0ae8d0 2024-09-12T02:52:39.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.109+0000 7efca2600640 1 -- 172.21.15.112:0/1636777165 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc9c068a30 con 0x7efc9c0ae8d0 2024-09-12T02:52:39.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.110+0000 7efc93400640 1 -- 172.21.15.112:0/1636777165 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efc94039040 con 0x7efc9c0ae8d0 2024-09-12T02:52:39.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.112+0000 7efc93400640 1 --2- 172.21.15.112:0/1636777165 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efc7c06be30 0x7efc7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:39.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.112+0000 7efc93400640 1 -- 172.21.15.112:0/1636777165 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5738+0+0 (secure 0 0 0) 0x7efc940ac510 con 0x7efc9c0ae8d0 2024-09-12T02:52:39.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.112+0000 7efc9b400640 1 --2- 172.21.15.112:0/1636777165 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efc7c06be30 0x7efc7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:39.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.112+0000 7efc93400640 1 -- 172.21.15.112:0/1636777165 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=172}) -- 0x7efc7c0739c0 con 0x7efc9c0ae8d0 2024-09-12T02:52:39.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.112+0000 7efc9b400640 1 --2- 172.21.15.112:0/1636777165 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efc7c06be30 0x7efc7c06e2f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7efc8c007fd0 tx=0x7efc8c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:39.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.116+0000 7efc93400640 1 -- 172.21.15.112:0/1636777165 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efc94040030 con 0x7efc9c0ae8d0 2024-09-12T02:52:39.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.301+0000 7efca2600640 1 -- 172.21.15.112:0/1636777165 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7efc9c072240 con 0x7efc9c0ae8d0 2024-09-12T02:52:39.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.301+0000 7efc93400640 1 -- 172.21.15.112:0/1636777165 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v171) ==== 80+0+0 (secure 0 0 0) 0x7efc9407ae00 con 0x7efc9c0ae8d0 2024-09-12T02:52:39.302 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-12T02:52:39.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.303+0000 7efca2600640 1 -- 172.21.15.112:0/1636777165 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efc7c06be30 msgr2=0x7efc7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:39.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.303+0000 7efca2600640 1 --2- 172.21.15.112:0/1636777165 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efc7c06be30 0x7efc7c06e2f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7efc8c007fd0 tx=0x7efc8c009040 comp rx=0 tx=0).stop 2024-09-12T02:52:39.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.304+0000 7efca2600640 1 -- 172.21.15.112:0/1636777165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc9c0ae8d0 msgr2=0x7efc9c1544e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:39.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.304+0000 7efca2600640 1 --2- 172.21.15.112:0/1636777165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc9c0ae8d0 0x7efc9c1544e0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7efc9402acc0 tx=0x7efc94004a40 comp rx=0 tx=0).stop 2024-09-12T02:52:39.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.304+0000 7efca2600640 1 -- 172.21.15.112:0/1636777165 shutdown_connections 2024-09-12T02:52:39.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.304+0000 7efca2600640 1 --2- 172.21.15.112:0/1636777165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc9c0ae8d0 0x7efc9c1544e0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:39.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.304+0000 7efca2600640 1 --2- 172.21.15.112:0/1636777165 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7efc7c06be30 0x7efc7c06e2f0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:39.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.304+0000 7efca2600640 1 --2- 172.21.15.112:0/1636777165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc9c06e3b0 0x7efc9c0cfef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:39.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.304+0000 7efca2600640 1 --2- 172.21.15.112:0/1636777165 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc9c06d8c0 0x7efc9c1529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:39.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.304+0000 7efca2600640 1 -- 172.21.15.112:0/1636777165 >> 172.21.15.112:0/1636777165 conn(0x7efc9c06bbd0 msgr2=0x7efc9c0b0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:39.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.304+0000 7efca2600640 1 -- 172.21.15.112:0/1636777165 shutdown_connections 2024-09-12T02:52:39.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.304+0000 7efca2600640 1 -- 172.21.15.112:0/1636777165 wait complete. 2024-09-12T02:52:39.321 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-12T02:52:39.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:52:39.321 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-12T02:52:39.386 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T02:52:39.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:52:39.387 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T02:52:39.423 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:52:39.424 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:52:39.424 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:52:39.459 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:52:39.459 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:52:39.459 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:52:39.459 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:52:39.499 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:52:39.499 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:52:39.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.651+0000 7ff5c7200640 1 Processor -- start 2024-09-12T02:52:39.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.651+0000 7ff5c7200640 1 -- start start 2024-09-12T02:52:39.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.652+0000 7ff5c7200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff5c815f3b0 0x7ff5c80732d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:39.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.652+0000 7ff5c7200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5c8161c40 0x7ff5c8168960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:39.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.652+0000 7ff5c7200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5c8073810 con 0x7ff5c80b4180 2024-09-12T02:52:39.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.652+0000 7ff5c7200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff5c81607a0 con 0x7ff5c815f3b0 2024-09-12T02:52:39.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.652+0000 7ff5c7200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff5c8073ab0 con 0x7ff5c8161c40 2024-09-12T02:52:39.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.652+0000 7ff5c5400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff5c80b4180 0x7ff5c815f790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:57068/0 (socket says 172.21.15.112:57068) 2024-09-12T02:52:39.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.652+0000 7ff5c5400640 1 -- 172.21.15.112:0/2190766908 learned_addr learned my addr 172.21.15.112:0/2190766908 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:52:39.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.652+0000 7ff5c5e00640 1 --2- 172.21.15.112:0/2190766908 >> v2:172.21.15.137:3300/0 conn(0x7ff5c815f3b0 0x7ff5c80732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:39.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.653+0000 7ff5c6800640 1 --2- 172.21.15.112:0/2190766908 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5c8161c40 0x7ff5c8168960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:39.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.653+0000 7ff5c4a00640 1 -- 172.21.15.112:0/2190766908 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1111863886 0 0) 0x7ff5c8073810 con 0x7ff5c80b4180 2024-09-12T02:52:39.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.653+0000 7ff5c4a00640 1 -- 172.21.15.112:0/2190766908 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5ac003520 con 0x7ff5c80b4180 2024-09-12T02:52:39.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.653+0000 7ff5c5e00640 1 -- 172.21.15.112:0/2190766908 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5c8161c40 msgr2=0x7ff5c8168960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:39.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.653+0000 7ff5c5e00640 1 --2- 172.21.15.112:0/2190766908 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5c8161c40 0x7ff5c8168960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:39.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.653+0000 7ff5c5e00640 1 -- 172.21.15.112:0/2190766908 >> v1:172.21.15.112:6789/0 conn(0x7ff5c80b4180 legacy=0x7ff5c815f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:39.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.653+0000 7ff5c5e00640 1 -- 172.21.15.112:0/2190766908 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5c8073d90 con 0x7ff5c815f3b0 2024-09-12T02:52:39.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.654+0000 7ff5c5e00640 1 --2- 172.21.15.112:0/2190766908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5c815f3b0 0x7ff5c80732d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8160920 tx=0x7ff5b802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b73dd9331e08aae4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:39.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.654+0000 7ff5c4a00640 1 -- 172.21.15.112:0/2190766908 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8037070 con 0x7ff5c815f3b0 2024-09-12T02:52:39.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.654+0000 7ff5c4a00640 1 -- 172.21.15.112:0/2190766908 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5b802ae50 con 0x7ff5c815f3b0 2024-09-12T02:52:39.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.654+0000 7ff5c4a00640 1 -- 172.21.15.112:0/2190766908 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8032640 con 0x7ff5c815f3b0 2024-09-12T02:52:39.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.655+0000 7ff5c7200640 1 -- 172.21.15.112:0/2190766908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5c815f3b0 msgr2=0x7ff5c80732d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:39.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.655+0000 7ff5c7200640 1 --2- 172.21.15.112:0/2190766908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5c815f3b0 0x7ff5c80732d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8160920 tx=0x7ff5b802a100 comp rx=0 tx=0).stop 2024-09-12T02:52:39.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.655+0000 7ff5c7200640 1 -- 172.21.15.112:0/2190766908 shutdown_connections 2024-09-12T02:52:39.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.655+0000 7ff5c7200640 1 --2- 172.21.15.112:0/2190766908 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5c8161c40 0x7ff5c8168960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:39.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.655+0000 7ff5c7200640 1 --2- 172.21.15.112:0/2190766908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5c815f3b0 0x7ff5c80732d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:39.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.655+0000 7ff5c7200640 1 -- 172.21.15.112:0/2190766908 >> 172.21.15.112:0/2190766908 conn(0x7ff5c8072420 msgr2=0x7ff5c80b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:39.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.655+0000 7ff5c7200640 1 -- 172.21.15.112:0/2190766908 shutdown_connections 2024-09-12T02:52:39.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.655+0000 7ff5c7200640 1 -- 172.21.15.112:0/2190766908 wait complete. 2024-09-12T02:52:39.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.657+0000 7ff5c7200640 1 Processor -- start 2024-09-12T02:52:39.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.657+0000 7ff5c7200640 1 -- start start 2024-09-12T02:52:39.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.658+0000 7ff5c7200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5c80b4180 0x7ff5c8153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:39.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.658+0000 7ff5c7200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5c815f3b0 0x7ff5c809e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:39.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.658+0000 7ff5c7200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5c8161c40 0x7ff5c809e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:39.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.658+0000 7ff5c7200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c8160020 con 0x7ff5c815f3b0 2024-09-12T02:52:39.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.658+0000 7ff5c7200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c815fea0 con 0x7ff5c8161c40 2024-09-12T02:52:39.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.658+0000 7ff5c7200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff5c81601a0 con 0x7ff5c80b4180 2024-09-12T02:52:39.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.658+0000 7ff5c5400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5c815f3b0 0x7ff5c809e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:39.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.658+0000 7ff5c5400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5c815f3b0 0x7ff5c809e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44480/0 (socket says 172.21.15.112:44480) 2024-09-12T02:52:39.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.658+0000 7ff5c5400640 1 -- 172.21.15.112:0/694980278 learned_addr learned my addr 172.21.15.112:0/694980278 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:39.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.658+0000 7ff5c5e00640 1 --2- 172.21.15.112:0/694980278 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5c80b4180 0x7ff5c8153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:39.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.658+0000 7ff5c6800640 1 --2- 172.21.15.112:0/694980278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5c8161c40 0x7ff5c809e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:39.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.658+0000 7ff5c5400640 1 -- 172.21.15.112:0/694980278 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5c80b4180 msgr2=0x7ff5c8153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:39.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.658+0000 7ff5c5400640 1 --2- 172.21.15.112:0/694980278 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5c80b4180 0x7ff5c8153280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:39.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.658+0000 7ff5c5400640 1 -- 172.21.15.112:0/694980278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5c8161c40 msgr2=0x7ff5c809e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:39.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.658+0000 7ff5c5400640 1 --2- 172.21.15.112:0/694980278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5c8161c40 0x7ff5c809e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:39.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.658+0000 7ff5c5400640 1 -- 172.21.15.112:0/694980278 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5c809d0c0 con 0x7ff5c815f3b0 2024-09-12T02:52:39.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.659+0000 7ff5c5400640 1 --2- 172.21.15.112:0/694980278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5c815f3b0 0x7ff5c809e490 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7ff5b400c390 tx=0x7ff5b400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:39.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.659+0000 7ff5be000640 1 -- 172.21.15.112:0/694980278 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4017070 con 0x7ff5c815f3b0 2024-09-12T02:52:39.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.659+0000 7ff5be000640 1 -- 172.21.15.112:0/694980278 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5b4005ce0 con 0x7ff5c815f3b0 2024-09-12T02:52:39.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.659+0000 7ff5c7200640 1 -- 172.21.15.112:0/694980278 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5c809d3a0 con 0x7ff5c815f3b0 2024-09-12T02:52:39.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.659+0000 7ff5be000640 1 -- 172.21.15.112:0/694980278 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b40072f0 con 0x7ff5c815f3b0 2024-09-12T02:52:39.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.659+0000 7ff5c7200640 1 -- 172.21.15.112:0/694980278 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5c809d960 con 0x7ff5c815f3b0 2024-09-12T02:52:39.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.660+0000 7ff5c7200640 1 -- 172.21.15.112:0/694980278 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5c80694f0 con 0x7ff5c815f3b0 2024-09-12T02:52:39.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.661+0000 7ff5be000640 1 -- 172.21.15.112:0/694980278 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff5b401a070 con 0x7ff5c815f3b0 2024-09-12T02:52:39.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.662+0000 7ff5be000640 1 --2- 172.21.15.112:0/694980278 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff5a806be30 0x7ff5a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:39.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.662+0000 7ff5be000640 1 -- 172.21.15.112:0/694980278 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5738+0+0 (secure 0 0 0) 0x7ff5b408a1e0 con 0x7ff5c815f3b0 2024-09-12T02:52:39.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.662+0000 7ff5be000640 1 -- 172.21.15.112:0/694980278 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=172}) -- 0x7ff5a80739c0 con 0x7ff5c815f3b0 2024-09-12T02:52:39.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.663+0000 7ff5c5e00640 1 --2- 172.21.15.112:0/694980278 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff5a806be30 0x7ff5a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:39.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.663+0000 7ff5c5e00640 1 --2- 172.21.15.112:0/694980278 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff5a806be30 0x7ff5a806e2f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8034000 tx=0x7ff5b802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:39.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.666+0000 7ff5be000640 1 -- 172.21.15.112:0/694980278 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff5c80694f0 con 0x7ff5c815f3b0 2024-09-12T02:52:39.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.875+0000 7ff5c7200640 1 -- 172.21.15.112:0/694980278 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5c80732d0 con 0x7ff5c815f3b0 2024-09-12T02:52:39.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.875+0000 7ff5be000640 1 -- 172.21.15.112:0/694980278 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5236 (secure 0 0 0) 0x7ff5b4058510 con 0x7ff5c815f3b0 2024-09-12T02:52:39.876 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:52:39.876 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":86,"btime":"2024-09-12T02:51:25:753588+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/1180447882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1180447882},{"type":"v1","addr":"172.21.15.112:6836","nonce":1180447882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":6916,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2975519871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2975519871},{"type":"v1","addr":"172.21.15.137:6835","nonce":2975519871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7554,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2629863369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2629863369},{"type":"v1","addr":"172.21.15.112:6837","nonce":2629863369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:51:22.139735+0000","modified":"2024-09-12T02:51:25.151523+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7560},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7560":{"gid":7560,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6834/245886809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":245886809},{"type":"v1","addr":"172.21.15.137:6834","nonce":245886809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7560,"qdb_cluster":[7560]},"id":10}]} 2024-09-12T02:52:39.877 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 86 2024-09-12T02:52:39.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.877+0000 7ff5c7200640 1 -- 172.21.15.112:0/694980278 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff5a806be30 msgr2=0x7ff5a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:39.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.877+0000 7ff5c7200640 1 --2- 172.21.15.112:0/694980278 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff5a806be30 0x7ff5a806e2f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8034000 tx=0x7ff5b802e000 comp rx=0 tx=0).stop 2024-09-12T02:52:39.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.877+0000 7ff5c7200640 1 -- 172.21.15.112:0/694980278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5c815f3b0 msgr2=0x7ff5c809e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:39.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.877+0000 7ff5c7200640 1 --2- 172.21.15.112:0/694980278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5c815f3b0 0x7ff5c809e490 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7ff5b400c390 tx=0x7ff5b400c850 comp rx=0 tx=0).stop 2024-09-12T02:52:39.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.877+0000 7ff5c7200640 1 -- 172.21.15.112:0/694980278 shutdown_connections 2024-09-12T02:52:39.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.877+0000 7ff5c7200640 1 --2- 172.21.15.112:0/694980278 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff5a806be30 0x7ff5a806e2f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:39.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.877+0000 7ff5c7200640 1 --2- 172.21.15.112:0/694980278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5c8161c40 0x7ff5c809e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:39.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.877+0000 7ff5c7200640 1 --2- 172.21.15.112:0/694980278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5c815f3b0 0x7ff5c809e490 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:39.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.877+0000 7ff5c7200640 1 --2- 172.21.15.112:0/694980278 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff5c80b4180 0x7ff5c8153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:39.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.877+0000 7ff5c7200640 1 -- 172.21.15.112:0/694980278 >> 172.21.15.112:0/694980278 conn(0x7ff5c8072420 msgr2=0x7ff5c809b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:39.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.878+0000 7ff5c7200640 1 -- 172.21.15.112:0/694980278 shutdown_connections 2024-09-12T02:52:39.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:39.878+0000 7ff5c7200640 1 -- 172.21.15.112:0/694980278 wait complete. 2024-09-12T02:52:39.894 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:52:40.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.045+0000 7fc30f600640 1 Processor -- start 2024-09-12T02:52:40.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.045+0000 7fc30f600640 1 -- start start 2024-09-12T02:52:40.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.046+0000 7fc30f600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc3080ae8d0 0x7fc3080afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:40.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.046+0000 7fc30f600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc30806dca0 0x7fc30806e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:40.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.047+0000 7fc30f600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3080aedd0 con 0x7fc30806d8c0 2024-09-12T02:52:40.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.047+0000 7fc30f600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc3080af0b0 con 0x7fc30806dca0 2024-09-12T02:52:40.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.047+0000 7fc30f600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc3080af390 con 0x7fc3080ae8d0 2024-09-12T02:52:40.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.047+0000 7fc30cc00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc30806d8c0 0x7fc3080715a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:57084/0 (socket says 172.21.15.112:57084) 2024-09-12T02:52:40.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.047+0000 7fc30cc00640 1 -- 172.21.15.112:0/1781456557 learned_addr learned my addr 172.21.15.112:0/1781456557 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:52:40.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.047+0000 7fc30d600640 1 --2- 172.21.15.112:0/1781456557 >> v2:172.21.15.112:3300/0 conn(0x7fc30806dca0 0x7fc30806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:40.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.047+0000 7fc2ffe00640 1 --2- 172.21.15.112:0/1781456557 >> v2:172.21.15.137:3300/0 conn(0x7fc3080ae8d0 0x7fc3080afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:40.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.047+0000 7fc307e00640 1 -- 172.21.15.112:0/1781456557 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2400600386 0 0) 0x7fc3080aedd0 con 0x7fc30806d8c0 2024-09-12T02:52:40.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.047+0000 7fc307e00640 1 -- 172.21.15.112:0/1781456557 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2ec003520 con 0x7fc30806d8c0 2024-09-12T02:52:40.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.047+0000 7fc30d600640 1 -- 172.21.15.112:0/1781456557 >> v2:172.21.15.137:3300/0 conn(0x7fc3080ae8d0 msgr2=0x7fc3080afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:40.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.047+0000 7fc30d600640 1 --2- 172.21.15.112:0/1781456557 >> v2:172.21.15.137:3300/0 conn(0x7fc3080ae8d0 0x7fc3080afe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:40.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.047+0000 7fc30d600640 1 -- 172.21.15.112:0/1781456557 >> v1:172.21.15.112:6789/0 conn(0x7fc30806d8c0 legacy=0x7fc3080715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:40.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.047+0000 7fc30d600640 1 -- 172.21.15.112:0/1781456557 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3080af670 con 0x7fc30806dca0 2024-09-12T02:52:40.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.048+0000 7fc30d600640 1 --2- 172.21.15.112:0/1781456557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc30806dca0 0x7fc30806e150 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fc30806fa40 tx=0x7fc30002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb53c34e0347ec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:40.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.049+0000 7fc307e00640 1 -- 172.21.15.112:0/1781456557 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc300007740 con 0x7fc30806dca0 2024-09-12T02:52:40.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.049+0000 7fc307e00640 1 -- 172.21.15.112:0/1781456557 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3000078e0 con 0x7fc30806dca0 2024-09-12T02:52:40.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.049+0000 7fc307e00640 1 -- 172.21.15.112:0/1781456557 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc300007cb0 con 0x7fc30806dca0 2024-09-12T02:52:40.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.049+0000 7fc30f600640 1 -- 172.21.15.112:0/1781456557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc30806dca0 msgr2=0x7fc30806e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:40.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.049+0000 7fc30f600640 1 --2- 172.21.15.112:0/1781456557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc30806dca0 0x7fc30806e150 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fc30806fa40 tx=0x7fc30002a680 comp rx=0 tx=0).stop 2024-09-12T02:52:40.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.049+0000 7fc30f600640 1 -- 172.21.15.112:0/1781456557 shutdown_connections 2024-09-12T02:52:40.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.049+0000 7fc30f600640 1 --2- 172.21.15.112:0/1781456557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc30806dca0 0x7fc30806e150 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:40.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.049+0000 7fc30f600640 1 --2- 172.21.15.112:0/1781456557 >> v2:172.21.15.137:3300/0 conn(0x7fc3080ae8d0 0x7fc3080afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:40.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.049+0000 7fc30f600640 1 -- 172.21.15.112:0/1781456557 >> 172.21.15.112:0/1781456557 conn(0x7fc30806bbd0 msgr2=0x7fc30806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:40.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.049+0000 7fc30f600640 1 -- 172.21.15.112:0/1781456557 shutdown_connections 2024-09-12T02:52:40.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.049+0000 7fc30f600640 1 -- 172.21.15.112:0/1781456557 wait complete. 2024-09-12T02:52:40.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.051+0000 7fc30f600640 1 Processor -- start 2024-09-12T02:52:40.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.051+0000 7fc30f600640 1 -- start start 2024-09-12T02:52:40.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.052+0000 7fc30f600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc30806d8c0 0x7fc308143b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:40.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.052+0000 7fc30f600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc30806dca0 0x7fc308160330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:40.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.052+0000 7fc30f600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3080ae8d0 0x7fc308160870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:40.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.052+0000 7fc30f600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc3080b38e0 con 0x7fc30806d8c0 2024-09-12T02:52:40.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.052+0000 7fc30f600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc30806e690 con 0x7fc30806dca0 2024-09-12T02:52:40.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.052+0000 7fc30f600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc3080b3a60 con 0x7fc3080ae8d0 2024-09-12T02:52:40.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.052+0000 7fc30cc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc30806d8c0 0x7fc308143b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:40.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.052+0000 7fc30cc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc30806d8c0 0x7fc308143b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44494/0 (socket says 172.21.15.112:44494) 2024-09-12T02:52:40.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.052+0000 7fc30cc00640 1 -- 172.21.15.112:0/3645423325 learned_addr learned my addr 172.21.15.112:0/3645423325 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:40.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.053+0000 7fc2ffe00640 1 --2- 172.21.15.112:0/3645423325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc30806dca0 0x7fc308160330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:40.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.053+0000 7fc30d600640 1 --2- 172.21.15.112:0/3645423325 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3080ae8d0 0x7fc308160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:40.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.053+0000 7fc30cc00640 1 -- 172.21.15.112:0/3645423325 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3080ae8d0 msgr2=0x7fc308160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:40.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.053+0000 7fc30cc00640 1 --2- 172.21.15.112:0/3645423325 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3080ae8d0 0x7fc308160870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:40.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.053+0000 7fc30cc00640 1 -- 172.21.15.112:0/3645423325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc30806dca0 msgr2=0x7fc308160330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:40.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.053+0000 7fc30cc00640 1 --2- 172.21.15.112:0/3645423325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc30806dca0 0x7fc308160330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:40.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.053+0000 7fc30cc00640 1 -- 172.21.15.112:0/3645423325 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3080cd8e0 con 0x7fc30806d8c0 2024-09-12T02:52:40.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.053+0000 7fc30d600640 1 --2- 172.21.15.112:0/3645423325 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3080ae8d0 0x7fc308160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:52:40.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.053+0000 7fc30cc00640 1 --2- 172.21.15.112:0/3645423325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc30806d8c0 0x7fc308143b20 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fc2f800c430 tx=0x7fc2f800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:40.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.053+0000 7fc305600640 1 -- 172.21.15.112:0/3645423325 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8017070 con 0x7fc30806d8c0 2024-09-12T02:52:40.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.053+0000 7fc305600640 1 -- 172.21.15.112:0/3645423325 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f8005ce0 con 0x7fc30806d8c0 2024-09-12T02:52:40.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.053+0000 7fc305600640 1 -- 172.21.15.112:0/3645423325 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f80072f0 con 0x7fc30806d8c0 2024-09-12T02:52:40.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.053+0000 7fc30f600640 1 -- 172.21.15.112:0/3645423325 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc308144460 con 0x7fc30806d8c0 2024-09-12T02:52:40.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.053+0000 7fc30f600640 1 -- 172.21.15.112:0/3645423325 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc308144a20 con 0x7fc30806d8c0 2024-09-12T02:52:40.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.054+0000 7fc30f600640 1 -- 172.21.15.112:0/3645423325 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc30806e150 con 0x7fc30806d8c0 2024-09-12T02:52:40.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.055+0000 7fc305600640 1 -- 172.21.15.112:0/3645423325 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc2f801a070 con 0x7fc30806d8c0 2024-09-12T02:52:40.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.056+0000 7fc305600640 1 --2- 172.21.15.112:0/3645423325 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc2e406be30 0x7fc2e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:40.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.056+0000 7fc305600640 1 -- 172.21.15.112:0/3645423325 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5738+0+0 (secure 0 0 0) 0x7fc2f808a370 con 0x7fc30806d8c0 2024-09-12T02:52:40.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.056+0000 7fc305600640 1 -- 172.21.15.112:0/3645423325 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=172}) -- 0x7fc2e40739c0 con 0x7fc30806d8c0 2024-09-12T02:52:40.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.056+0000 7fc2ffe00640 1 --2- 172.21.15.112:0/3645423325 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc2e406be30 0x7fc2e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:40.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.057+0000 7fc2ffe00640 1 --2- 172.21.15.112:0/3645423325 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc2e406be30 0x7fc2e406e2f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc308069290 tx=0x7fc2f0009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:40.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.060+0000 7fc305600640 1 -- 172.21.15.112:0/3645423325 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc2f8058610 con 0x7fc30806d8c0 2024-09-12T02:52:40.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.267+0000 7fc30f600640 1 -- 172.21.15.112:0/3645423325 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc30815b660 con 0x7fc30806d8c0 2024-09-12T02:52:40.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.268+0000 7fc305600640 1 -- 172.21.15.112:0/3645423325 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5236 (secure 0 0 0) 0x7fc2f805c910 con 0x7fc30806d8c0 2024-09-12T02:52:40.269 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:52:40.269 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":86,"btime":"2024-09-12T02:51:25:753588+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/1180447882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1180447882},{"type":"v1","addr":"172.21.15.112:6836","nonce":1180447882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":6916,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2975519871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2975519871},{"type":"v1","addr":"172.21.15.137:6835","nonce":2975519871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7554,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2629863369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2629863369},{"type":"v1","addr":"172.21.15.112:6837","nonce":2629863369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:51:22.139735+0000","modified":"2024-09-12T02:51:25.151523+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7560},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7560":{"gid":7560,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6834/245886809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":245886809},{"type":"v1","addr":"172.21.15.137:6834","nonce":245886809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7560,"qdb_cluster":[7560]},"id":10}]} 2024-09-12T02:52:40.269 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 86 2024-09-12T02:52:40.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.270+0000 7fc30f600640 1 -- 172.21.15.112:0/3645423325 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc2e406be30 msgr2=0x7fc2e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:40.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.270+0000 7fc30f600640 1 --2- 172.21.15.112:0/3645423325 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc2e406be30 0x7fc2e406e2f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc308069290 tx=0x7fc2f0009110 comp rx=0 tx=0).stop 2024-09-12T02:52:40.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.270+0000 7fc30f600640 1 -- 172.21.15.112:0/3645423325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc30806d8c0 msgr2=0x7fc308143b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:40.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.270+0000 7fc30f600640 1 --2- 172.21.15.112:0/3645423325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc30806d8c0 0x7fc308143b20 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fc2f800c430 tx=0x7fc2f800c8f0 comp rx=0 tx=0).stop 2024-09-12T02:52:40.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.270+0000 7fc30f600640 1 -- 172.21.15.112:0/3645423325 shutdown_connections 2024-09-12T02:52:40.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.270+0000 7fc30f600640 1 --2- 172.21.15.112:0/3645423325 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc3080ae8d0 0x7fc308160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:40.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.270+0000 7fc30f600640 1 --2- 172.21.15.112:0/3645423325 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc2e406be30 0x7fc2e406e2f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:40.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.270+0000 7fc30f600640 1 --2- 172.21.15.112:0/3645423325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc30806dca0 0x7fc308160330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:40.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.270+0000 7fc30f600640 1 --2- 172.21.15.112:0/3645423325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc30806d8c0 0x7fc308143b20 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:40.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.270+0000 7fc30f600640 1 -- 172.21.15.112:0/3645423325 >> 172.21.15.112:0/3645423325 conn(0x7fc30806bbd0 msgr2=0x7fc30815dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:40.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.270+0000 7fc30f600640 1 -- 172.21.15.112:0/3645423325 shutdown_connections 2024-09-12T02:52:40.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.270+0000 7fc30f600640 1 -- 172.21.15.112:0/3645423325 wait complete. 2024-09-12T02:52:40.287 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:52:40.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.439+0000 7f98dcc00640 1 Processor -- start 2024-09-12T02:52:40.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.439+0000 7f98dcc00640 1 -- start start 2024-09-12T02:52:40.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.440+0000 7f98dcc00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f98d806f600 0x7f98d80b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:40.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.440+0000 7f98dcc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98d80b45d0 0x7f98d80728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:40.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.440+0000 7f98dcc00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98d80b4a20 con 0x7f98d815b9d0 2024-09-12T02:52:40.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.440+0000 7f98dcc00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f98d80b54a0 con 0x7f98d806f600 2024-09-12T02:52:40.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.440+0000 7f98dcc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f98d80b3af0 con 0x7f98d80b45d0 2024-09-12T02:52:40.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.440+0000 7f98d5e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f98d815b9d0 0x7f98d806eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:57090/0 (socket says 172.21.15.112:57090) 2024-09-12T02:52:40.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.440+0000 7f98d5e00640 1 -- 172.21.15.112:0/152974645 learned_addr learned my addr 172.21.15.112:0/152974645 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:52:40.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.440+0000 7f98d5400640 1 --2- 172.21.15.112:0/152974645 >> v2:172.21.15.137:3300/0 conn(0x7f98d806f600 0x7f98d80b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:40.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.440+0000 7f98d6800640 1 --2- 172.21.15.112:0/152974645 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98d80b45d0 0x7f98d80728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:40.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.441+0000 7f98d4a00640 1 -- 172.21.15.112:0/152974645 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2184006977 0 0) 0x7f98d80b4a20 con 0x7f98d815b9d0 2024-09-12T02:52:40.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.441+0000 7f98d5400640 1 -- 172.21.15.112:0/152974645 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98d80b45d0 msgr2=0x7f98d80728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:40.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.441+0000 7f98d5400640 1 --2- 172.21.15.112:0/152974645 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98d80b45d0 0x7f98d80728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:40.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.441+0000 7f98d5400640 1 -- 172.21.15.112:0/152974645 >> v1:172.21.15.112:6789/0 conn(0x7f98d815b9d0 legacy=0x7f98d806eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:40.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.441+0000 7f98d5400640 1 -- 172.21.15.112:0/152974645 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98d80b3dd0 con 0x7f98d806f600 2024-09-12T02:52:40.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.442+0000 7f98d5400640 1 --2- 172.21.15.112:0/152974645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98d806f600 0x7f98d80b4ec0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f98c4009790 tx=0x7f98c402c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6acbbd6b2112050 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:40.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.442+0000 7f98d4a00640 1 -- 172.21.15.112:0/152974645 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c4039070 con 0x7f98d806f600 2024-09-12T02:52:40.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.442+0000 7f98d4a00640 1 -- 172.21.15.112:0/152974645 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98c4034640 con 0x7f98d806f600 2024-09-12T02:52:40.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.442+0000 7f98d4a00640 1 -- 172.21.15.112:0/152974645 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c4034a10 con 0x7f98d806f600 2024-09-12T02:52:40.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.443+0000 7f98dcc00640 1 -- 172.21.15.112:0/152974645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98d806f600 msgr2=0x7f98d80b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:40.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.443+0000 7f98dcc00640 1 --2- 172.21.15.112:0/152974645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98d806f600 0x7f98d80b4ec0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f98c4009790 tx=0x7f98c402c390 comp rx=0 tx=0).stop 2024-09-12T02:52:40.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.443+0000 7f98dcc00640 1 -- 172.21.15.112:0/152974645 shutdown_connections 2024-09-12T02:52:40.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.443+0000 7f98dcc00640 1 --2- 172.21.15.112:0/152974645 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98d80b45d0 0x7f98d80728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:40.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.443+0000 7f98dcc00640 1 --2- 172.21.15.112:0/152974645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98d806f600 0x7f98d80b4ec0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:40.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.443+0000 7f98dcc00640 1 -- 172.21.15.112:0/152974645 >> 172.21.15.112:0/152974645 conn(0x7f98d806bbd0 msgr2=0x7f98d806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:40.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.443+0000 7f98dcc00640 1 -- 172.21.15.112:0/152974645 shutdown_connections 2024-09-12T02:52:40.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.443+0000 7f98dcc00640 1 -- 172.21.15.112:0/152974645 wait complete. 2024-09-12T02:52:40.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.444+0000 7f98dcc00640 1 Processor -- start 2024-09-12T02:52:40.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.445+0000 7f98dcc00640 1 -- start start 2024-09-12T02:52:40.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.445+0000 7f98dcc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98d806f600 0x7f98d814f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:40.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.445+0000 7f98dcc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98d80b45d0 0x7f98d815e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:40.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.445+0000 7f98dcc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98d815b9d0 0x7f98d815a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:40.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.445+0000 7f98dcc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f98d815bf30 con 0x7f98d815b9d0 2024-09-12T02:52:40.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.445+0000 7f98dcc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f98d815bdb0 con 0x7f98d806f600 2024-09-12T02:52:40.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.445+0000 7f98dcc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f98d80cdcd0 con 0x7f98d80b45d0 2024-09-12T02:52:40.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.446+0000 7f98d6800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98d815b9d0 0x7f98d815a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:40.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.446+0000 7f98d5e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98d806f600 0x7f98d814f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:40.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.446+0000 7f98d6800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98d815b9d0 0x7f98d815a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44508/0 (socket says 172.21.15.112:44508) 2024-09-12T02:52:40.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.446+0000 7f98d6800640 1 -- 172.21.15.112:0/2887122801 learned_addr learned my addr 172.21.15.112:0/2887122801 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:40.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.446+0000 7f98d5400640 1 --2- 172.21.15.112:0/2887122801 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98d80b45d0 0x7f98d815e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:40.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.446+0000 7f98d6800640 1 -- 172.21.15.112:0/2887122801 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98d80b45d0 msgr2=0x7f98d815e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:40.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.446+0000 7f98d6800640 1 --2- 172.21.15.112:0/2887122801 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98d80b45d0 0x7f98d815e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:40.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.446+0000 7f98d6800640 1 -- 172.21.15.112:0/2887122801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98d806f600 msgr2=0x7f98d814f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:40.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.446+0000 7f98d6800640 1 --2- 172.21.15.112:0/2887122801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98d806f600 0x7f98d814f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:40.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.446+0000 7f98d6800640 1 -- 172.21.15.112:0/2887122801 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98d815f030 con 0x7f98d815b9d0 2024-09-12T02:52:40.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.446+0000 7f98d5e00640 1 --2- 172.21.15.112:0/2887122801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98d806f600 0x7f98d814f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:52:40.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.447+0000 7f98d6800640 1 --2- 172.21.15.112:0/2887122801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98d815b9d0 0x7f98d815a010 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f98d000efc0 tx=0x7f98d000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:40.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.447+0000 7f98ce000640 1 -- 172.21.15.112:0/2887122801 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d0018020 con 0x7f98d815b9d0 2024-09-12T02:52:40.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.447+0000 7f98ce000640 1 -- 172.21.15.112:0/2887122801 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d0014480 con 0x7f98d815b9d0 2024-09-12T02:52:40.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.447+0000 7f98dcc00640 1 -- 172.21.15.112:0/2887122801 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98d815c100 con 0x7f98d815b9d0 2024-09-12T02:52:40.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.447+0000 7f98ce000640 1 -- 172.21.15.112:0/2887122801 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d0014870 con 0x7f98d815b9d0 2024-09-12T02:52:40.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.447+0000 7f98dcc00640 1 -- 172.21.15.112:0/2887122801 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98d815c6c0 con 0x7f98d815b9d0 2024-09-12T02:52:40.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.448+0000 7f98dcc00640 1 -- 172.21.15.112:0/2887122801 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98d8068a30 con 0x7f98d815b9d0 2024-09-12T02:52:40.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.449+0000 7f98ce000640 1 -- 172.21.15.112:0/2887122801 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f98d0005d10 con 0x7f98d815b9d0 2024-09-12T02:52:40.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.450+0000 7f98ce000640 1 --2- 172.21.15.112:0/2887122801 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f98b806be60 0x7f98b806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:40.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.450+0000 7f98ce000640 1 -- 172.21.15.112:0/2887122801 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5738+0+0 (secure 0 0 0) 0x7f98d008b8e0 con 0x7f98d815b9d0 2024-09-12T02:52:40.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.450+0000 7f98d5e00640 1 --2- 172.21.15.112:0/2887122801 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f98b806be60 0x7f98b806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:40.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.451+0000 7f98ce000640 1 -- 172.21.15.112:0/2887122801 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=172}) -- 0x7f98b80739f0 con 0x7f98d815b9d0 2024-09-12T02:52:40.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.451+0000 7f98d5e00640 1 --2- 172.21.15.112:0/2887122801 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f98b806be60 0x7f98b806e320 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f98c8007fd0 tx=0x7f98c8007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:40.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.455+0000 7f98ce000640 1 -- 172.21.15.112:0/2887122801 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f98d0022070 con 0x7f98d815b9d0 2024-09-12T02:52:40.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.630+0000 7f98dcc00640 1 -- 172.21.15.112:0/2887122801 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f98d8071840 con 0x7f98d815b9d0 2024-09-12T02:52:40.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.632+0000 7f98ce000640 1 -- 172.21.15.112:0/2887122801 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v171) ==== 74+0+16863 (secure 0 0 0) 0x7f98d0010040 con 0x7f98d815b9d0 2024-09-12T02:52:40.633 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:52:40.633 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":171,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:52:11.053620+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:51:19.902565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-12T02:51:21.129561+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.8","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:52:40.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.634+0000 7f98dcc00640 1 -- 172.21.15.112:0/2887122801 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f98b806be60 msgr2=0x7f98b806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:40.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.634+0000 7f98dcc00640 1 --2- 172.21.15.112:0/2887122801 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f98b806be60 0x7f98b806e320 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f98c8007fd0 tx=0x7f98c8007de0 comp rx=0 tx=0).stop 2024-09-12T02:52:40.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.634+0000 7f98dcc00640 1 -- 172.21.15.112:0/2887122801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98d815b9d0 msgr2=0x7f98d815a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:40.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.634+0000 7f98dcc00640 1 --2- 172.21.15.112:0/2887122801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98d815b9d0 0x7f98d815a010 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f98d000efc0 tx=0x7f98d000c490 comp rx=0 tx=0).stop 2024-09-12T02:52:40.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.634+0000 7f98dcc00640 1 -- 172.21.15.112:0/2887122801 shutdown_connections 2024-09-12T02:52:40.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.634+0000 7f98dcc00640 1 --2- 172.21.15.112:0/2887122801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98d815b9d0 0x7f98d815a010 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:40.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.634+0000 7f98dcc00640 1 --2- 172.21.15.112:0/2887122801 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98d80b45d0 0x7f98d815e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:40.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.634+0000 7f98dcc00640 1 --2- 172.21.15.112:0/2887122801 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f98b806be60 0x7f98b806e320 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:40.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.634+0000 7f98dcc00640 1 --2- 172.21.15.112:0/2887122801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98d806f600 0x7f98d814f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:40.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.634+0000 7f98dcc00640 1 -- 172.21.15.112:0/2887122801 >> 172.21.15.112:0/2887122801 conn(0x7f98d806bbd0 msgr2=0x7f98d80ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:40.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.634+0000 7f98dcc00640 1 -- 172.21.15.112:0/2887122801 shutdown_connections 2024-09-12T02:52:40.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.634+0000 7f98dcc00640 1 -- 172.21.15.112:0/2887122801 wait complete. 2024-09-12T02:52:40.651 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:52:40.651 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:52:40.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.802+0000 7f3edf200640 1 Processor -- start 2024-09-12T02:52:40.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.802+0000 7f3edf200640 1 -- start start 2024-09-12T02:52:40.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.804+0000 7f3edf200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3ed80b4ec0 0x7f3ed80b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:40.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.804+0000 7f3edf200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ed80b54a0 con 0x7f3ed806f600 2024-09-12T02:52:40.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.804+0000 7f3edf200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ed80b3af0 con 0x7f3ed815b9d0 2024-09-12T02:52:40.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.804+0000 7f3edf200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3ed80b3dd0 con 0x7f3ed80b4ec0 2024-09-12T02:52:40.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.804+0000 7f3ecf400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f3ed806f600 0x7f3ed80cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:57100/0 (socket says 172.21.15.112:57100) 2024-09-12T02:52:40.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.804+0000 7f3ecf400640 1 -- 172.21.15.112:0/1840457273 learned_addr learned my addr 172.21.15.112:0/1840457273 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:52:40.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.804+0000 7f3edd200640 1 --2- 172.21.15.112:0/1840457273 >> v2:172.21.15.137:3300/0 conn(0x7f3ed80b4ec0 0x7f3ed80b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:40.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.804+0000 7f3ed7400640 1 -- 172.21.15.112:0/1840457273 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2821008271 0 0) 0x7f3ed80b54a0 con 0x7f3ed806f600 2024-09-12T02:52:40.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.805+0000 7f3ed7400640 1 -- 172.21.15.112:0/1840457273 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ebc003520 con 0x7f3ed806f600 2024-09-12T02:52:40.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.805+0000 7f3ed7400640 1 -- 172.21.15.112:0/1840457273 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1531466497 0 0) 0x7f3ed80b3af0 con 0x7f3ed815b9d0 2024-09-12T02:52:40.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.805+0000 7f3ed7400640 1 -- 172.21.15.112:0/1840457273 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ed80b54a0 con 0x7f3ed815b9d0 2024-09-12T02:52:40.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.805+0000 7f3edd200640 1 -- 172.21.15.112:0/1840457273 >> v1:172.21.15.137:6789/0 conn(0x7f3ed815b9d0 legacy=0x7f3ed806eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:40.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.805+0000 7f3edd200640 1 -- 172.21.15.112:0/1840457273 >> v1:172.21.15.112:6789/0 conn(0x7f3ed806f600 legacy=0x7f3ed80cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:40.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.805+0000 7f3ed7400640 1 -- 172.21.15.112:0/1840457273 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2878626615 0 0) 0x7f3ebc003520 con 0x7f3ed806f600 2024-09-12T02:52:40.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.805+0000 7f3edd200640 1 -- 172.21.15.112:0/1840457273 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed80b40b0 con 0x7f3ed80b4ec0 2024-09-12T02:52:40.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.806+0000 7f3edd200640 1 --2- 172.21.15.112:0/1840457273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ed80b4ec0 0x7f3ed80b45d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0009d90 tx=0x7f3ed002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd3b65f2d85a44a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:40.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.806+0000 7f3ed7400640 1 -- 172.21.15.112:0/1840457273 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0007740 con 0x7f3ed80b4ec0 2024-09-12T02:52:40.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.806+0000 7f3ed7400640 1 -- 172.21.15.112:0/1840457273 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed00078e0 con 0x7f3ed80b4ec0 2024-09-12T02:52:40.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.806+0000 7f3ed7400640 1 -- 172.21.15.112:0/1840457273 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0007cb0 con 0x7f3ed80b4ec0 2024-09-12T02:52:40.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.807+0000 7f3edf200640 1 -- 172.21.15.112:0/1840457273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ed80b4ec0 msgr2=0x7f3ed80b45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:40.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.807+0000 7f3edf200640 1 --2- 172.21.15.112:0/1840457273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ed80b4ec0 0x7f3ed80b45d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0009d90 tx=0x7f3ed002a660 comp rx=0 tx=0).stop 2024-09-12T02:52:40.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.807+0000 7f3edf200640 1 -- 172.21.15.112:0/1840457273 shutdown_connections 2024-09-12T02:52:40.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.807+0000 7f3edf200640 1 --2- 172.21.15.112:0/1840457273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ed80b4ec0 0x7f3ed80b45d0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:40.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.807+0000 7f3edf200640 1 -- 172.21.15.112:0/1840457273 >> 172.21.15.112:0/1840457273 conn(0x7f3ed806bbd0 msgr2=0x7f3ed806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:40.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.807+0000 7f3edf200640 1 -- 172.21.15.112:0/1840457273 shutdown_connections 2024-09-12T02:52:40.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.807+0000 7f3edf200640 1 -- 172.21.15.112:0/1840457273 wait complete. 2024-09-12T02:52:40.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.808+0000 7f3edf200640 1 Processor -- start 2024-09-12T02:52:40.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.808+0000 7f3edf200640 1 -- start start 2024-09-12T02:52:40.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.809+0000 7f3edf200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3ed806f600 0x7f3ed81551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:40.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.809+0000 7f3edf200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ed80b4ec0 0x7f3ed80ce770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:40.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.809+0000 7f3edf200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ed815b9d0 0x7f3ed8149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:40.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.809+0000 7f3edf200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed8072a40 con 0x7f3ed815b9d0 2024-09-12T02:52:40.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.809+0000 7f3edf200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed80728c0 con 0x7f3ed80b4ec0 2024-09-12T02:52:40.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.809+0000 7f3edf200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3ed8072bc0 con 0x7f3ed806f600 2024-09-12T02:52:40.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.809+0000 7f3edd200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ed815b9d0 0x7f3ed8149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:40.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.810+0000 7f3edd200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ed815b9d0 0x7f3ed8149fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44514/0 (socket says 172.21.15.112:44514) 2024-09-12T02:52:40.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.810+0000 7f3edd200640 1 -- 172.21.15.112:0/1040544436 learned_addr learned my addr 172.21.15.112:0/1040544436 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:40.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.810+0000 7f3ecf400640 1 --2- 172.21.15.112:0/1040544436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ed80b4ec0 0x7f3ed80ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:40.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.810+0000 7f3ed7e00640 1 --2- 172.21.15.112:0/1040544436 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3ed806f600 0x7f3ed81551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:40.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.810+0000 7f3edd200640 1 -- 172.21.15.112:0/1040544436 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3ed806f600 msgr2=0x7f3ed81551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:40.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.810+0000 7f3edd200640 1 --2- 172.21.15.112:0/1040544436 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3ed806f600 0x7f3ed81551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:40.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.810+0000 7f3edd200640 1 -- 172.21.15.112:0/1040544436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ed80b4ec0 msgr2=0x7f3ed80ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:40.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.810+0000 7f3edd200640 1 --2- 172.21.15.112:0/1040544436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ed80b4ec0 0x7f3ed80ce770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:40.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.810+0000 7f3edd200640 1 -- 172.21.15.112:0/1040544436 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed815c160 con 0x7f3ed815b9d0 2024-09-12T02:52:40.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.810+0000 7f3edd200640 1 --2- 172.21.15.112:0/1040544436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ed815b9d0 0x7f3ed8149fd0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0009eb0 tx=0x7f3ed0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:40.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.811+0000 7f3ed4c00640 1 -- 172.21.15.112:0/1040544436 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0040070 con 0x7f3ed815b9d0 2024-09-12T02:52:40.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.811+0000 7f3ed4c00640 1 -- 172.21.15.112:0/1040544436 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed0031b40 con 0x7f3ed815b9d0 2024-09-12T02:52:40.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.811+0000 7f3ed4c00640 1 -- 172.21.15.112:0/1040544436 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0009450 con 0x7f3ed815b9d0 2024-09-12T02:52:40.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.811+0000 7f3edf200640 1 -- 172.21.15.112:0/1040544436 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ed815c440 con 0x7f3ed815b9d0 2024-09-12T02:52:40.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.811+0000 7f3edf200640 1 -- 172.21.15.112:0/1040544436 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ed815ca00 con 0x7f3ed815b9d0 2024-09-12T02:52:40.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.812+0000 7f3edf200640 1 -- 172.21.15.112:0/1040544436 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ed80b45d0 con 0x7f3ed815b9d0 2024-09-12T02:52:40.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.813+0000 7f3ed4c00640 1 -- 172.21.15.112:0/1040544436 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3ed0039040 con 0x7f3ed815b9d0 2024-09-12T02:52:40.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.813+0000 7f3ed4c00640 1 --2- 172.21.15.112:0/1040544436 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3eb406be30 0x7f3eb406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:40.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.814+0000 7f3ed4c00640 1 -- 172.21.15.112:0/1040544436 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5738+0+0 (secure 0 0 0) 0x7f3ed00ac140 con 0x7f3ed815b9d0 2024-09-12T02:52:40.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.814+0000 7f3ed4c00640 1 -- 172.21.15.112:0/1040544436 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=172}) -- 0x7f3eb40739c0 con 0x7f3ed815b9d0 2024-09-12T02:52:40.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.814+0000 7f3ed7e00640 1 --2- 172.21.15.112:0/1040544436 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3eb406be30 0x7f3eb406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:40.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.814+0000 7f3ed7e00640 1 --2- 172.21.15.112:0/1040544436 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3eb406be30 0x7f3eb406e2f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3ec80011e0 tx=0x7f3ec8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:40.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:40.818+0000 7f3ed4c00640 1 -- 172.21.15.112:0/1040544436 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3ed007a480 con 0x7f3ed815b9d0 2024-09-12T02:52:41.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.025+0000 7f3edf200640 1 -- 172.21.15.112:0/1040544436 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ed806f2a0 con 0x7f3ed815b9d0 2024-09-12T02:52:41.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.025+0000 7f3ed4c00640 1 -- 172.21.15.112:0/1040544436 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5236 (secure 0 0 0) 0x7f3ed007e780 con 0x7f3ed815b9d0 2024-09-12T02:52:41.026 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:52:41.026 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":86,"btime":"2024-09-12T02:51:25:753588+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/1180447882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1180447882},{"type":"v1","addr":"172.21.15.112:6836","nonce":1180447882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":6916,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2975519871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2975519871},{"type":"v1","addr":"172.21.15.137:6835","nonce":2975519871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7554,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2629863369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2629863369},{"type":"v1","addr":"172.21.15.112:6837","nonce":2629863369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:51:22.139735+0000","modified":"2024-09-12T02:51:25.151523+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7560},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7560":{"gid":7560,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6834/245886809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":245886809},{"type":"v1","addr":"172.21.15.137:6834","nonce":245886809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7560,"qdb_cluster":[7560]},"id":10}]} 2024-09-12T02:52:41.026 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 86 2024-09-12T02:52:41.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.027+0000 7f3edf200640 1 -- 172.21.15.112:0/1040544436 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3eb406be30 msgr2=0x7f3eb406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:41.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.027+0000 7f3edf200640 1 --2- 172.21.15.112:0/1040544436 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3eb406be30 0x7f3eb406e2f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3ec80011e0 tx=0x7f3ec8009040 comp rx=0 tx=0).stop 2024-09-12T02:52:41.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.027+0000 7f3edf200640 1 -- 172.21.15.112:0/1040544436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ed815b9d0 msgr2=0x7f3ed8149fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:41.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.027+0000 7f3edf200640 1 --2- 172.21.15.112:0/1040544436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ed815b9d0 0x7f3ed8149fd0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0009eb0 tx=0x7f3ed0004a40 comp rx=0 tx=0).stop 2024-09-12T02:52:41.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.027+0000 7f3edf200640 1 -- 172.21.15.112:0/1040544436 shutdown_connections 2024-09-12T02:52:41.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.027+0000 7f3edf200640 1 --2- 172.21.15.112:0/1040544436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ed815b9d0 0x7f3ed8149fd0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.027+0000 7f3edf200640 1 --2- 172.21.15.112:0/1040544436 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3eb406be30 0x7f3eb406e2f0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.027+0000 7f3edf200640 1 --2- 172.21.15.112:0/1040544436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ed80b4ec0 0x7f3ed80ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.027+0000 7f3edf200640 1 --2- 172.21.15.112:0/1040544436 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3ed806f600 0x7f3ed81551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.028+0000 7f3edf200640 1 -- 172.21.15.112:0/1040544436 >> 172.21.15.112:0/1040544436 conn(0x7f3ed806bbd0 msgr2=0x7f3ed80af6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:41.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.028+0000 7f3edf200640 1 -- 172.21.15.112:0/1040544436 shutdown_connections 2024-09-12T02:52:41.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.028+0000 7f3edf200640 1 -- 172.21.15.112:0/1040544436 wait complete. 2024-09-12T02:52:41.044 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:52:41.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.195+0000 7fcf6a400640 1 Processor -- start 2024-09-12T02:52:41.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.195+0000 7fcf6a400640 1 -- start start 2024-09-12T02:52:41.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.196+0000 7fcf6a400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcf6415b9d0 0x7fcf640b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:41.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.197+0000 7fcf6a400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcf6406f600 0x7fcf640728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:41.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.197+0000 7fcf6a400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf640b54a0 con 0x7fcf640b45d0 2024-09-12T02:52:41.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.197+0000 7fcf6a400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fcf640b4a30 con 0x7fcf6406f600 2024-09-12T02:52:41.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.197+0000 7fcf6a400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fcf640b3af0 con 0x7fcf6415b9d0 2024-09-12T02:52:41.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.197+0000 7fcf63e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcf6406f600 0x7fcf640728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:41.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.197+0000 7fcf63400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcf6415b9d0 0x7fcf640b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:41.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.197+0000 7fcf63e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcf6406f600 0x7fcf640728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44518/0 (socket says 172.21.15.112:44518) 2024-09-12T02:52:41.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.197+0000 7fcf63400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcf6415b9d0 0x7fcf640b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:48276/0 (socket says 172.21.15.112:48276) 2024-09-12T02:52:41.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.197+0000 7fcf63e00640 1 -- 172.21.15.112:0/874705451 learned_addr learned my addr 172.21.15.112:0/874705451 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:41.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.197+0000 7fcf63e00640 1 -- 172.21.15.112:0/874705451 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcf6415b9d0 msgr2=0x7fcf640b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:41.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.197+0000 7fcf63e00640 1 --2- 172.21.15.112:0/874705451 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcf6415b9d0 0x7fcf640b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.197+0000 7fcf63e00640 1 -- 172.21.15.112:0/874705451 >> v1:172.21.15.137:6789/0 conn(0x7fcf640b45d0 legacy=0x7fcf6406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:41.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.197+0000 7fcf63e00640 1 -- 172.21.15.112:0/874705451 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf640b3dd0 con 0x7fcf6406f600 2024-09-12T02:52:41.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.198+0000 7fcf63e00640 1 --2- 172.21.15.112:0/874705451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf6406f600 0x7fcf640728c0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c009e50 tx=0x7fcf5c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7693c4bfe466e160 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:41.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.199+0000 7fcf62a00640 1 -- 172.21.15.112:0/874705451 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c036070 con 0x7fcf6406f600 2024-09-12T02:52:41.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.199+0000 7fcf62a00640 1 -- 172.21.15.112:0/874705451 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf5c031600 con 0x7fcf6406f600 2024-09-12T02:52:41.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.199+0000 7fcf62a00640 1 -- 172.21.15.112:0/874705451 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c0319d0 con 0x7fcf6406f600 2024-09-12T02:52:41.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.199+0000 7fcf6a400640 1 -- 172.21.15.112:0/874705451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf6406f600 msgr2=0x7fcf640728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:41.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.199+0000 7fcf6a400640 1 --2- 172.21.15.112:0/874705451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf6406f600 0x7fcf640728c0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c009e50 tx=0x7fcf5c02a710 comp rx=0 tx=0).stop 2024-09-12T02:52:41.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.199+0000 7fcf6a400640 1 -- 172.21.15.112:0/874705451 shutdown_connections 2024-09-12T02:52:41.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.199+0000 7fcf6a400640 1 --2- 172.21.15.112:0/874705451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf6406f600 0x7fcf640728c0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.199+0000 7fcf6a400640 1 --2- 172.21.15.112:0/874705451 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcf6415b9d0 0x7fcf640b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.199+0000 7fcf6a400640 1 -- 172.21.15.112:0/874705451 >> 172.21.15.112:0/874705451 conn(0x7fcf6406bbd0 msgr2=0x7fcf6406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:41.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.199+0000 7fcf6a400640 1 -- 172.21.15.112:0/874705451 shutdown_connections 2024-09-12T02:52:41.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.199+0000 7fcf6a400640 1 -- 172.21.15.112:0/874705451 wait complete. 2024-09-12T02:52:41.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.201+0000 7fcf6a400640 1 Processor -- start 2024-09-12T02:52:41.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.201+0000 7fcf6a400640 1 -- start start 2024-09-12T02:52:41.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.202+0000 7fcf6a400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf6406f600 0x7fcf6406e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:41.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.202+0000 7fcf6a400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcf640b45d0 0x7fcf641512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:41.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.202+0000 7fcf6a400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf6415b9d0 0x7fcf6415cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:41.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.202+0000 7fcf6a400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6415bf30 con 0x7fcf6406f600 2024-09-12T02:52:41.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.202+0000 7fcf6a400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6415bdb0 con 0x7fcf6415b9d0 2024-09-12T02:52:41.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.202+0000 7fcf6a400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fcf640cdcd0 con 0x7fcf640b45d0 2024-09-12T02:52:41.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.202+0000 7fcf63400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf6406f600 0x7fcf6406e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:41.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.202+0000 7fcf63400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf6406f600 0x7fcf6406e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44532/0 (socket says 172.21.15.112:44532) 2024-09-12T02:52:41.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.202+0000 7fcf63400640 1 -- 172.21.15.112:0/1850681829 learned_addr learned my addr 172.21.15.112:0/1850681829 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:41.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.202+0000 7fcf63400640 1 -- 172.21.15.112:0/1850681829 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcf640b45d0 msgr2=0x7fcf641512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:41.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.202+0000 7fcf63400640 1 --2- 172.21.15.112:0/1850681829 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcf640b45d0 0x7fcf641512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.202+0000 7fcf63400640 1 -- 172.21.15.112:0/1850681829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf6415b9d0 msgr2=0x7fcf6415cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:41.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.202+0000 7fcf63400640 1 --2- 172.21.15.112:0/1850681829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf6415b9d0 0x7fcf6415cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.202+0000 7fcf63400640 1 -- 172.21.15.112:0/1850681829 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf6415ef20 con 0x7fcf6406f600 2024-09-12T02:52:41.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.203+0000 7fcf63400640 1 --2- 172.21.15.112:0/1850681829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf6406f600 0x7fcf6406e7c0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400e870 tx=0x7fcf5400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:41.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.203+0000 7fcf5be00640 1 -- 172.21.15.112:0/1850681829 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf54017070 con 0x7fcf6406f600 2024-09-12T02:52:41.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.203+0000 7fcf5be00640 1 -- 172.21.15.112:0/1850681829 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf5400c940 con 0x7fcf6406f600 2024-09-12T02:52:41.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.203+0000 7fcf5be00640 1 -- 172.21.15.112:0/1850681829 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5400cd30 con 0x7fcf6406f600 2024-09-12T02:52:41.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.203+0000 7fcf6a400640 1 -- 172.21.15.112:0/1850681829 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf6415c2a0 con 0x7fcf6406f600 2024-09-12T02:52:41.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.203+0000 7fcf6a400640 1 -- 172.21.15.112:0/1850681829 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf6415c860 con 0x7fcf6406f600 2024-09-12T02:52:41.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.204+0000 7fcf6a400640 1 -- 172.21.15.112:0/1850681829 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf64068a30 con 0x7fcf6406f600 2024-09-12T02:52:41.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.205+0000 7fcf5be00640 1 -- 172.21.15.112:0/1850681829 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcf5401a070 con 0x7fcf6406f600 2024-09-12T02:52:41.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.207+0000 7fcf5be00640 1 --2- 172.21.15.112:0/1850681829 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcf4006be30 0x7fcf4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:41.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.207+0000 7fcf5be00640 1 -- 172.21.15.112:0/1850681829 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5738+0+0 (secure 0 0 0) 0x7fcf5408b190 con 0x7fcf6406f600 2024-09-12T02:52:41.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.207+0000 7fcf5aa00640 1 --2- 172.21.15.112:0/1850681829 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcf4006be30 0x7fcf4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:41.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.207+0000 7fcf5be00640 1 -- 172.21.15.112:0/1850681829 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=172}) -- 0x7fcf400739c0 con 0x7fcf6406f600 2024-09-12T02:52:41.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.207+0000 7fcf5aa00640 1 --2- 172.21.15.112:0/1850681829 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcf4006be30 0x7fcf4006e2f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c000fb0 tx=0x7fcf4c0079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:41.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.212+0000 7fcf5be00640 1 -- 172.21.15.112:0/1850681829 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcf54059a80 con 0x7fcf6406f600 2024-09-12T02:52:41.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.420+0000 7fcf6a400640 1 -- 172.21.15.112:0/1850681829 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcf6406dbc0 con 0x7fcf6406f600 2024-09-12T02:52:41.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.420+0000 7fcf5be00640 1 -- 172.21.15.112:0/1850681829 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5236 (secure 0 0 0) 0x7fcf54059380 con 0x7fcf6406f600 2024-09-12T02:52:41.422 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:52:41.422 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":86,"btime":"2024-09-12T02:51:25:753588+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/1180447882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1180447882},{"type":"v1","addr":"172.21.15.112:6836","nonce":1180447882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":6916,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2975519871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2975519871},{"type":"v1","addr":"172.21.15.137:6835","nonce":2975519871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7554,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2629863369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2629863369},{"type":"v1","addr":"172.21.15.112:6837","nonce":2629863369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:51:22.139735+0000","modified":"2024-09-12T02:51:25.151523+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7560},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7560":{"gid":7560,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6834/245886809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":245886809},{"type":"v1","addr":"172.21.15.137:6834","nonce":245886809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7560,"qdb_cluster":[7560]},"id":10}]} 2024-09-12T02:52:41.422 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 86 2024-09-12T02:52:41.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.422+0000 7fcf6a400640 1 -- 172.21.15.112:0/1850681829 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcf4006be30 msgr2=0x7fcf4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:41.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.422+0000 7fcf6a400640 1 --2- 172.21.15.112:0/1850681829 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcf4006be30 0x7fcf4006e2f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c000fb0 tx=0x7fcf4c0079c0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.422+0000 7fcf6a400640 1 -- 172.21.15.112:0/1850681829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf6406f600 msgr2=0x7fcf6406e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:41.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.422+0000 7fcf6a400640 1 --2- 172.21.15.112:0/1850681829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf6406f600 0x7fcf6406e7c0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400e870 tx=0x7fcf5400ed30 comp rx=0 tx=0).stop 2024-09-12T02:52:41.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.423+0000 7fcf6a400640 1 -- 172.21.15.112:0/1850681829 shutdown_connections 2024-09-12T02:52:41.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.423+0000 7fcf6a400640 1 --2- 172.21.15.112:0/1850681829 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcf4006be30 0x7fcf4006e2f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.423+0000 7fcf6a400640 1 --2- 172.21.15.112:0/1850681829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf6415b9d0 0x7fcf6415cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.423+0000 7fcf6a400640 1 --2- 172.21.15.112:0/1850681829 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcf640b45d0 0x7fcf641512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.423+0000 7fcf6a400640 1 --2- 172.21.15.112:0/1850681829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf6406f600 0x7fcf6406e7c0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.423+0000 7fcf6a400640 1 -- 172.21.15.112:0/1850681829 >> 172.21.15.112:0/1850681829 conn(0x7fcf6406bbd0 msgr2=0x7fcf640cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:41.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.423+0000 7fcf6a400640 1 -- 172.21.15.112:0/1850681829 shutdown_connections 2024-09-12T02:52:41.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.423+0000 7fcf6a400640 1 -- 172.21.15.112:0/1850681829 wait complete. 2024-09-12T02:52:41.439 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:52:41.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.591+0000 7f905b400640 1 Processor -- start 2024-09-12T02:52:41.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.591+0000 7f905b400640 1 -- start start 2024-09-12T02:52:41.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.593+0000 7f905b400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9054071530 0x7f90540af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:41.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.593+0000 7f905b400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f90540719a0 0x7f90540afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:41.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.593+0000 7f905b400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90540ceeb0 con 0x7f905415cc50 2024-09-12T02:52:41.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.593+0000 7f905b400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f905415d030 con 0x7f90540719a0 2024-09-12T02:52:41.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.593+0000 7f905b400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f90540cf4c0 con 0x7f9054071530 2024-09-12T02:52:41.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.593+0000 7f9059400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f90540719a0 0x7f90540afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:41.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.593+0000 7f9059400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f90540719a0 0x7f90540afc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44536/0 (socket says 172.21.15.112:44536) 2024-09-12T02:52:41.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.593+0000 7f9059400640 1 -- 172.21.15.112:0/167915385 learned_addr learned my addr 172.21.15.112:0/167915385 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:41.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.593+0000 7f904be00640 1 --2- 172.21.15.112:0/167915385 >> v2:172.21.15.137:3300/0 conn(0x7f9054071530 0x7f90540af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:41.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.593+0000 7f9059400640 1 -- 172.21.15.112:0/167915385 >> v2:172.21.15.137:3300/0 conn(0x7f9054071530 msgr2=0x7f90540af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:41.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.593+0000 7f9059400640 1 --2- 172.21.15.112:0/167915385 >> v2:172.21.15.137:3300/0 conn(0x7f9054071530 0x7f90540af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.593+0000 7f9059400640 1 -- 172.21.15.112:0/167915385 >> v1:172.21.15.137:6789/0 conn(0x7f905415cc50 legacy=0x7f90540732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:41.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.593+0000 7f9059400640 1 -- 172.21.15.112:0/167915385 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f905406e300 con 0x7f90540719a0 2024-09-12T02:52:41.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.594+0000 7f9059400640 1 --2- 172.21.15.112:0/167915385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90540719a0 0x7f90540afc60 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f90540cf640 tx=0x7f904c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5edbe2f9f0f0637 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:41.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.595+0000 7f9053e00640 1 -- 172.21.15.112:0/167915385 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c036070 con 0x7f90540719a0 2024-09-12T02:52:41.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.595+0000 7f9053e00640 1 -- 172.21.15.112:0/167915385 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f904c031600 con 0x7f90540719a0 2024-09-12T02:52:41.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.595+0000 7f9053e00640 1 -- 172.21.15.112:0/167915385 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c0319d0 con 0x7f90540719a0 2024-09-12T02:52:41.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.595+0000 7f905b400640 1 -- 172.21.15.112:0/167915385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90540719a0 msgr2=0x7f90540afc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:41.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.595+0000 7f905b400640 1 --2- 172.21.15.112:0/167915385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90540719a0 0x7f90540afc60 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f90540cf640 tx=0x7f904c02a6a0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.595+0000 7f905b400640 1 -- 172.21.15.112:0/167915385 shutdown_connections 2024-09-12T02:52:41.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.595+0000 7f905b400640 1 --2- 172.21.15.112:0/167915385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90540719a0 0x7f90540afc60 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.595+0000 7f905b400640 1 --2- 172.21.15.112:0/167915385 >> v2:172.21.15.137:3300/0 conn(0x7f9054071530 0x7f90540af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.595+0000 7f905b400640 1 -- 172.21.15.112:0/167915385 >> 172.21.15.112:0/167915385 conn(0x7f905406bbd0 msgr2=0x7f905406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:41.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.595+0000 7f905b400640 1 -- 172.21.15.112:0/167915385 shutdown_connections 2024-09-12T02:52:41.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.595+0000 7f905b400640 1 -- 172.21.15.112:0/167915385 wait complete. 2024-09-12T02:52:41.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.597+0000 7f905b400640 1 Processor -- start 2024-09-12T02:52:41.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.597+0000 7f905b400640 1 -- start start 2024-09-12T02:52:41.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.598+0000 7f905b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9054071530 0x7f9054148320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:41.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.598+0000 7f905b400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90540719a0 0x7f90541531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:41.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.598+0000 7f905b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f905415cc50 0x7f90540ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:41.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.598+0000 7f905b400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f905406f510 con 0x7f9054071530 2024-09-12T02:52:41.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.598+0000 7f905b400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f90540cf150 con 0x7f905415cc50 2024-09-12T02:52:41.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.598+0000 7f905b400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f905406f690 con 0x7f90540719a0 2024-09-12T02:52:41.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.598+0000 7f9058a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9054071530 0x7f9054148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:41.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.598+0000 7f9058a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9054071530 0x7f9054148320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44540/0 (socket says 172.21.15.112:44540) 2024-09-12T02:52:41.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.598+0000 7f9058a00640 1 -- 172.21.15.112:0/1731733912 learned_addr learned my addr 172.21.15.112:0/1731733912 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:41.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.599+0000 7f904be00640 1 --2- 172.21.15.112:0/1731733912 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90540719a0 0x7f90541531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:41.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.599+0000 7f9059400640 1 --2- 172.21.15.112:0/1731733912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f905415cc50 0x7f90540ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:41.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.599+0000 7f9058a00640 1 -- 172.21.15.112:0/1731733912 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90540719a0 msgr2=0x7f90541531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:41.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.599+0000 7f9058a00640 1 --2- 172.21.15.112:0/1731733912 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90540719a0 0x7f90541531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.599+0000 7f9058a00640 1 -- 172.21.15.112:0/1731733912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f905415cc50 msgr2=0x7f90540ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:41.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.599+0000 7f9058a00640 1 --2- 172.21.15.112:0/1731733912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f905415cc50 0x7f90540ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.599+0000 7f9058a00640 1 -- 172.21.15.112:0/1731733912 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9054156520 con 0x7f9054071530 2024-09-12T02:52:41.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.599+0000 7f904be00640 1 --2- 172.21.15.112:0/1731733912 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90540719a0 0x7f90541531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:52:41.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.599+0000 7f9058a00640 1 --2- 172.21.15.112:0/1731733912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9054071530 0x7f9054148320 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f904400c3f0 tx=0x7f904400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:41.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.599+0000 7f9051600640 1 -- 172.21.15.112:0/1731733912 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90440052d0 con 0x7f9054071530 2024-09-12T02:52:41.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.599+0000 7f9051600640 1 -- 172.21.15.112:0/1731733912 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9044005490 con 0x7f9054071530 2024-09-12T02:52:41.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.599+0000 7f9051600640 1 -- 172.21.15.112:0/1731733912 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9044007260 con 0x7f9054071530 2024-09-12T02:52:41.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.599+0000 7f905b400640 1 -- 172.21.15.112:0/1731733912 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90541559a0 con 0x7f9054071530 2024-09-12T02:52:41.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.600+0000 7f905b400640 1 -- 172.21.15.112:0/1731733912 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9054155f60 con 0x7f9054071530 2024-09-12T02:52:41.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.601+0000 7f905b400640 1 -- 172.21.15.112:0/1731733912 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90540cdf10 con 0x7f9054071530 2024-09-12T02:52:41.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.602+0000 7f9051600640 1 -- 172.21.15.112:0/1731733912 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9044007400 con 0x7f9054071530 2024-09-12T02:52:41.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.603+0000 7f9051600640 1 --2- 172.21.15.112:0/1731733912 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f903006be30 0x7f903006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:41.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.603+0000 7f9051600640 1 -- 172.21.15.112:0/1731733912 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5738+0+0 (secure 0 0 0) 0x7f904408a380 con 0x7f9054071530 2024-09-12T02:52:41.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.603+0000 7f904be00640 1 --2- 172.21.15.112:0/1731733912 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f903006be30 0x7f903006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:41.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.603+0000 7f9051600640 1 -- 172.21.15.112:0/1731733912 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=172}) -- 0x7f90300739c0 con 0x7f9054071530 2024-09-12T02:52:41.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.604+0000 7f904be00640 1 --2- 172.21.15.112:0/1731733912 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f903006be30 0x7f903006e2f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f90540b17e0 tx=0x7f903c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:41.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.607+0000 7f9051600640 1 -- 172.21.15.112:0/1731733912 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f90540cdf10 con 0x7f9054071530 2024-09-12T02:52:41.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.784+0000 7f905b400640 1 -- 172.21.15.112:0/1731733912 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f90540737f0 con 0x7f9054071530 2024-09-12T02:52:41.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.785+0000 7f9051600640 1 -- 172.21.15.112:0/1731733912 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v171) ==== 74+0+16863 (secure 0 0 0) 0x7f9044058c70 con 0x7f9054071530 2024-09-12T02:52:41.786 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:52:41.787 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":171,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:52:11.053620+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:51:19.902565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-12T02:51:21.129561+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.8","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:52:41.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.787+0000 7f905b400640 1 -- 172.21.15.112:0/1731733912 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f903006be30 msgr2=0x7f903006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:41.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.787+0000 7f905b400640 1 --2- 172.21.15.112:0/1731733912 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f903006be30 0x7f903006e2f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f90540b17e0 tx=0x7f903c008040 comp rx=0 tx=0).stop 2024-09-12T02:52:41.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.787+0000 7f905b400640 1 -- 172.21.15.112:0/1731733912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9054071530 msgr2=0x7f9054148320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:41.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.787+0000 7f905b400640 1 --2- 172.21.15.112:0/1731733912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9054071530 0x7f9054148320 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f904400c3f0 tx=0x7f904400c8b0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.788+0000 7f905b400640 1 -- 172.21.15.112:0/1731733912 shutdown_connections 2024-09-12T02:52:41.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.788+0000 7f905b400640 1 --2- 172.21.15.112:0/1731733912 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f903006be30 0x7f903006e2f0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.788+0000 7f905b400640 1 --2- 172.21.15.112:0/1731733912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f905415cc50 0x7f90540ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.788+0000 7f905b400640 1 --2- 172.21.15.112:0/1731733912 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90540719a0 0x7f90541531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.788+0000 7f905b400640 1 --2- 172.21.15.112:0/1731733912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9054071530 0x7f9054148320 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.788+0000 7f905b400640 1 -- 172.21.15.112:0/1731733912 >> 172.21.15.112:0/1731733912 conn(0x7f905406bbd0 msgr2=0x7f905406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:41.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.788+0000 7f905b400640 1 -- 172.21.15.112:0/1731733912 shutdown_connections 2024-09-12T02:52:41.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.788+0000 7f905b400640 1 -- 172.21.15.112:0/1731733912 wait complete. 2024-09-12T02:52:41.805 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:52:41.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.958+0000 7feab7000640 1 Processor -- start 2024-09-12T02:52:41.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.958+0000 7feab7000640 1 -- start start 2024-09-12T02:52:41.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.959+0000 7feab7000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feab015b9a0 0x7feab006d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:41.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.959+0000 7feab7000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7feab006f270 0x7feab00b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:41.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.959+0000 7feab7000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feab00b5560 0x7feab00d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:41.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.959+0000 7feab7000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7feab006de70 con 0x7feab00b5560 2024-09-12T02:52:41.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.959+0000 7feab7000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7feab006f690 con 0x7feab006f270 2024-09-12T02:52:41.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.959+0000 7feab7000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7feab00b42c0 con 0x7feab015b9a0 2024-09-12T02:52:41.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.959+0000 7feab6600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feab00b5560 0x7feab00d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:41.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.959+0000 7feab6600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feab00b5560 0x7feab00d0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42110/0 (socket says 172.21.15.112:42110) 2024-09-12T02:52:41.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.959+0000 7feab6600640 1 -- 172.21.15.112:0/1254755331 learned_addr learned my addr 172.21.15.112:0/1254755331 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:41.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.960+0000 7feab5c00640 1 --2- 172.21.15.112:0/1254755331 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feab015b9a0 0x7feab006d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:41.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.960+0000 7feab5200640 1 --2- 172.21.15.112:0/1254755331 >> v2:172.21.15.137:3300/0 conn(0x7feab006f270 0x7feab00b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:41.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.960+0000 7feab6600640 1 -- 172.21.15.112:0/1254755331 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feab015b9a0 msgr2=0x7feab006d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:41.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.960+0000 7feab6600640 1 --2- 172.21.15.112:0/1254755331 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feab015b9a0 0x7feab006d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.960+0000 7feab6600640 1 -- 172.21.15.112:0/1254755331 >> v2:172.21.15.137:3300/0 conn(0x7feab006f270 msgr2=0x7feab00b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:41.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.960+0000 7feab6600640 1 --2- 172.21.15.112:0/1254755331 >> v2:172.21.15.137:3300/0 conn(0x7feab006f270 0x7feab00b5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.960+0000 7feab6600640 1 -- 172.21.15.112:0/1254755331 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab015bd80 con 0x7feab00b5560 2024-09-12T02:52:41.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.961+0000 7feab6600640 1 --2- 172.21.15.112:0/1254755331 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feab00b5560 0x7feab00d0820 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7feaa8009e50 tx=0x7feaa802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e547affdf7789d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:41.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.961+0000 7feaafe00640 1 -- 172.21.15.112:0/1254755331 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa8036070 con 0x7feab00b5560 2024-09-12T02:52:41.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.961+0000 7feaafe00640 1 -- 172.21.15.112:0/1254755331 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaa8031600 con 0x7feab00b5560 2024-09-12T02:52:41.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.961+0000 7feaafe00640 1 -- 172.21.15.112:0/1254755331 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa80319d0 con 0x7feab00b5560 2024-09-12T02:52:41.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.962+0000 7feab7000640 1 -- 172.21.15.112:0/1254755331 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feab00b5560 msgr2=0x7feab00d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:41.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.962+0000 7feab7000640 1 --2- 172.21.15.112:0/1254755331 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feab00b5560 0x7feab00d0820 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7feaa8009e50 tx=0x7feaa802a6c0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.962+0000 7feab7000640 1 -- 172.21.15.112:0/1254755331 shutdown_connections 2024-09-12T02:52:41.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.962+0000 7feab7000640 1 --2- 172.21.15.112:0/1254755331 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feab00b5560 0x7feab00d0820 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.962+0000 7feab7000640 1 --2- 172.21.15.112:0/1254755331 >> v2:172.21.15.137:3300/0 conn(0x7feab006f270 0x7feab00b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.962+0000 7feab7000640 1 --2- 172.21.15.112:0/1254755331 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feab015b9a0 0x7feab006d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.962+0000 7feab7000640 1 -- 172.21.15.112:0/1254755331 >> 172.21.15.112:0/1254755331 conn(0x7feab006bbd0 msgr2=0x7feab006bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:41.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.962+0000 7feab7000640 1 -- 172.21.15.112:0/1254755331 shutdown_connections 2024-09-12T02:52:41.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.962+0000 7feab7000640 1 -- 172.21.15.112:0/1254755331 wait complete. 2024-09-12T02:52:41.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.963+0000 7feab7000640 1 Processor -- start 2024-09-12T02:52:41.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.964+0000 7feab7000640 1 -- start start 2024-09-12T02:52:41.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.964+0000 7feab7000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feab006f270 0x7feab01483a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:41.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.964+0000 7feab7000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feab015b9a0 0x7feab00ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:41.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.964+0000 7feab7000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feab00b1cc0 0x7feab00ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:41.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.964+0000 7feab7000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7feab00b4b00 con 0x7feab006f270 2024-09-12T02:52:41.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.964+0000 7feab7000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7feab00b4820 con 0x7feab015b9a0 2024-09-12T02:52:41.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.964+0000 7feab7000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7feab00b5b50 con 0x7feab00b1cc0 2024-09-12T02:52:41.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.965+0000 7feab5c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feab006f270 0x7feab01483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:41.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.965+0000 7feab5c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feab006f270 0x7feab01483a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42122/0 (socket says 172.21.15.112:42122) 2024-09-12T02:52:41.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.965+0000 7feab5c00640 1 -- 172.21.15.112:0/2423346291 learned_addr learned my addr 172.21.15.112:0/2423346291 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:41.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.965+0000 7feab5200640 1 --2- 172.21.15.112:0/2423346291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feab015b9a0 0x7feab00ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:41.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.965+0000 7feab6600640 1 --2- 172.21.15.112:0/2423346291 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feab00b1cc0 0x7feab00ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:41.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.965+0000 7feab5c00640 1 -- 172.21.15.112:0/2423346291 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feab00b1cc0 msgr2=0x7feab00ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:41.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.965+0000 7feab5c00640 1 --2- 172.21.15.112:0/2423346291 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feab00b1cc0 0x7feab00ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.965+0000 7feab5c00640 1 -- 172.21.15.112:0/2423346291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feab015b9a0 msgr2=0x7feab00ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:41.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.965+0000 7feab5c00640 1 --2- 172.21.15.112:0/2423346291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feab015b9a0 0x7feab00ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:41.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.965+0000 7feab5c00640 1 -- 172.21.15.112:0/2423346291 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab0152ba0 con 0x7feab006f270 2024-09-12T02:52:41.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.965+0000 7feab5c00640 1 --2- 172.21.15.112:0/2423346291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feab006f270 0x7feab01483a0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7feaa400d5f0 tx=0x7feaa400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:41.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.966+0000 7feaad600640 1 -- 172.21.15.112:0/2423346291 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa40125f0 con 0x7feab006f270 2024-09-12T02:52:41.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.966+0000 7feaad600640 1 -- 172.21.15.112:0/2423346291 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaa4019070 con 0x7feab006f270 2024-09-12T02:52:41.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.966+0000 7feaad600640 1 -- 172.21.15.112:0/2423346291 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa40129d0 con 0x7feab006f270 2024-09-12T02:52:41.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.966+0000 7feab7000640 1 -- 172.21.15.112:0/2423346291 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feab0152e80 con 0x7feab006f270 2024-09-12T02:52:41.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.966+0000 7feab7000640 1 -- 172.21.15.112:0/2423346291 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feab0153440 con 0x7feab006f270 2024-09-12T02:52:41.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.967+0000 7feab7000640 1 -- 172.21.15.112:0/2423346291 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feab00b5020 con 0x7feab006f270 2024-09-12T02:52:41.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.968+0000 7feaad600640 1 -- 172.21.15.112:0/2423346291 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feaa4012b70 con 0x7feab006f270 2024-09-12T02:52:41.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.968+0000 7feaad600640 1 --2- 172.21.15.112:0/2423346291 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fea9006be30 0x7fea9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:41.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.969+0000 7feaad600640 1 -- 172.21.15.112:0/2423346291 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5738+0+0 (secure 0 0 0) 0x7feaa408b1b0 con 0x7feab006f270 2024-09-12T02:52:41.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.969+0000 7feaad600640 1 -- 172.21.15.112:0/2423346291 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=172}) -- 0x7fea900739c0 con 0x7feab006f270 2024-09-12T02:52:41.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.969+0000 7feab5200640 1 --2- 172.21.15.112:0/2423346291 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fea9006be30 0x7fea9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:41.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.969+0000 7feab5200640 1 --2- 172.21.15.112:0/2423346291 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fea9006be30 0x7fea9006e2f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7feab00b25b0 tx=0x7fea9c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:41.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:41.973+0000 7feaad600640 1 -- 172.21.15.112:0/2423346291 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feaa4059450 con 0x7feab006f270 2024-09-12T02:52:42.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.180+0000 7feab7000640 1 -- 172.21.15.112:0/2423346291 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7feab00af500 con 0x7feab006f270 2024-09-12T02:52:42.181 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-12T02:52:42.181+0000 7f0216c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:52:42.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.183+0000 7feaad600640 1 -- 172.21.15.112:0/2423346291 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v87) ==== 161+0+0 (secure 0 0 0) 0x7feaa405d750 con 0x7feab006f270 2024-09-12T02:52:42.184 INFO:teuthology.orchestra.run.smithi112.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:52:42.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.183+0000 7feaad600640 1 -- 172.21.15.112:0/2423346291 <== mon.0 v2:172.21.15.112:3300/0 8 ==== osd_map(172..172 src has 1..172) ==== 374+0+0 (secure 0 0 0) 0x7feaa40bfd50 con 0x7feab006f270 2024-09-12T02:52:42.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.183+0000 7feaad600640 1 -- 172.21.15.112:0/2423346291 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=173}) -- 0x7fea90074400 con 0x7feab006f270 2024-09-12T02:52:42.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.187+0000 7feab7000640 1 -- 172.21.15.112:0/2423346291 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fea9006be30 msgr2=0x7fea9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:42.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.187+0000 7feab7000640 1 --2- 172.21.15.112:0/2423346291 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fea9006be30 0x7fea9006e2f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7feab00b25b0 tx=0x7fea9c008040 comp rx=0 tx=0).stop 2024-09-12T02:52:42.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.187+0000 7feab7000640 1 -- 172.21.15.112:0/2423346291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feab006f270 msgr2=0x7feab01483a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:42.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.187+0000 7feab7000640 1 --2- 172.21.15.112:0/2423346291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feab006f270 0x7feab01483a0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7feaa400d5f0 tx=0x7feaa400dab0 comp rx=0 tx=0).stop 2024-09-12T02:52:42.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.187+0000 7feab7000640 1 -- 172.21.15.112:0/2423346291 shutdown_connections 2024-09-12T02:52:42.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.187+0000 7feab7000640 1 --2- 172.21.15.112:0/2423346291 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feab00b1cc0 0x7feab00ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:42.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.187+0000 7feab7000640 1 --2- 172.21.15.112:0/2423346291 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fea9006be30 0x7fea9006e2f0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:42.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.187+0000 7feab7000640 1 --2- 172.21.15.112:0/2423346291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feab015b9a0 0x7feab00ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:42.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.187+0000 7feab7000640 1 --2- 172.21.15.112:0/2423346291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feab006f270 0x7feab01483a0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:42.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.187+0000 7feab7000640 1 -- 172.21.15.112:0/2423346291 >> 172.21.15.112:0/2423346291 conn(0x7feab006bbd0 msgr2=0x7feab00afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:42.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.187+0000 7feab7000640 1 -- 172.21.15.112:0/2423346291 shutdown_connections 2024-09-12T02:52:42.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.187+0000 7feab7000640 1 -- 172.21.15.112:0/2423346291 wait complete. 2024-09-12T02:52:42.204 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T02:52:42.253 INFO:tasks.ceph.mds.b.smithi137.stdout:starting mds.b at 2024-09-12T02:52:42.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.360+0000 7f03ff200640 1 Processor -- start 2024-09-12T02:52:42.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.360+0000 7f03ff200640 1 -- start start 2024-09-12T02:52:42.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.361+0000 7f03ff200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f040015a450 0x7f040006e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:42.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.362+0000 7f03ff200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f04000ce460 0x7f04000d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:42.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.362+0000 7f03ff200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f040015db60 0x7f04000d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:42.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.362+0000 7f03ff200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f0400071eb0 con 0x7f04000ce460 2024-09-12T02:52:42.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.362+0000 7f03ff200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f040006e990 con 0x7f040015db60 2024-09-12T02:52:42.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.362+0000 7f03ff200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f040006ec70 con 0x7f040015a450 2024-09-12T02:52:42.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.362+0000 7f03f5400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f04000ce460 0x7f04000d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:42.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.362+0000 7f03f5400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f04000ce460 0x7f04000d0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42128/0 (socket says 172.21.15.112:42128) 2024-09-12T02:52:42.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.362+0000 7f03f5400640 1 -- 172.21.15.112:0/3814102581 learned_addr learned my addr 172.21.15.112:0/3814102581 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:42.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.362+0000 7f03fe800640 1 --2- 172.21.15.112:0/3814102581 >> v2:172.21.15.137:3300/0 conn(0x7f040015db60 0x7f04000d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:42.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.362+0000 7f03fde00640 1 --2- 172.21.15.112:0/3814102581 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f040015a450 0x7f040006e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:42.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.362+0000 7f03f5400640 1 -- 172.21.15.112:0/3814102581 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f040015a450 msgr2=0x7f040006e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:42.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.362+0000 7f03f5400640 1 --2- 172.21.15.112:0/3814102581 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f040015a450 0x7f040006e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:42.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.362+0000 7f03f5400640 1 -- 172.21.15.112:0/3814102581 >> v2:172.21.15.137:3300/0 conn(0x7f040015db60 msgr2=0x7f04000d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:42.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.362+0000 7f03f5400640 1 --2- 172.21.15.112:0/3814102581 >> v2:172.21.15.137:3300/0 conn(0x7f040015db60 0x7f04000d0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:42.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.362+0000 7f03f5400640 1 -- 172.21.15.112:0/3814102581 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0400072100 con 0x7f04000ce460 2024-09-12T02:52:42.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.363+0000 7f03f5400640 1 --2- 172.21.15.112:0/3814102581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04000ce460 0x7f04000d0820 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f04000b3970 tx=0x7f03e802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acfbf417eebf9591 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:42.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.364+0000 7f03fd400640 1 -- 172.21.15.112:0/3814102581 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e8037070 con 0x7f04000ce460 2024-09-12T02:52:42.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.364+0000 7f03fd400640 1 -- 172.21.15.112:0/3814102581 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03e8032440 con 0x7f04000ce460 2024-09-12T02:52:42.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.364+0000 7f03fd400640 1 -- 172.21.15.112:0/3814102581 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e8032810 con 0x7f04000ce460 2024-09-12T02:52:42.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.364+0000 7f03ff200640 1 -- 172.21.15.112:0/3814102581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04000ce460 msgr2=0x7f04000d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:42.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.364+0000 7f03ff200640 1 --2- 172.21.15.112:0/3814102581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04000ce460 0x7f04000d0820 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f04000b3970 tx=0x7f03e802a270 comp rx=0 tx=0).stop 2024-09-12T02:52:42.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.364+0000 7f03ff200640 1 -- 172.21.15.112:0/3814102581 shutdown_connections 2024-09-12T02:52:42.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.364+0000 7f03ff200640 1 --2- 172.21.15.112:0/3814102581 >> v2:172.21.15.137:3300/0 conn(0x7f040015db60 0x7f04000d0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:42.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.364+0000 7f03ff200640 1 --2- 172.21.15.112:0/3814102581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04000ce460 0x7f04000d0820 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:42.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.364+0000 7f03ff200640 1 --2- 172.21.15.112:0/3814102581 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f040015a450 0x7f040006e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:42.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.364+0000 7f03ff200640 1 -- 172.21.15.112:0/3814102581 >> 172.21.15.112:0/3814102581 conn(0x7f040006bbd0 msgr2=0x7f040006bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:42.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.364+0000 7f03ff200640 1 -- 172.21.15.112:0/3814102581 shutdown_connections 2024-09-12T02:52:42.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.364+0000 7f03ff200640 1 -- 172.21.15.112:0/3814102581 wait complete. 2024-09-12T02:52:42.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.366+0000 7f03ff200640 1 Processor -- start 2024-09-12T02:52:42.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.366+0000 7f03ff200640 1 -- start start 2024-09-12T02:52:42.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.367+0000 7f03ff200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04000ce460 0x7f0400145400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:42.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.367+0000 7f03ff200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f040015a450 0x7f040015c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:42.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.367+0000 7f03ff200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f040015db60 0x7f0400153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:42.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.367+0000 7f03ff200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f040015a830 con 0x7f04000ce460 2024-09-12T02:52:42.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.367+0000 7f03ff200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f040006e680 con 0x7f040015a450 2024-09-12T02:52:42.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.367+0000 7f03ff200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0400160510 con 0x7f040015db60 2024-09-12T02:52:42.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.367+0000 7f03fde00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04000ce460 0x7f0400145400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:42.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.367+0000 7f03fde00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04000ce460 0x7f0400145400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42130/0 (socket says 172.21.15.112:42130) 2024-09-12T02:52:42.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.367+0000 7f03fde00640 1 -- 172.21.15.112:0/622242569 learned_addr learned my addr 172.21.15.112:0/622242569 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:42.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.367+0000 7f03f5400640 1 --2- 172.21.15.112:0/622242569 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f040015a450 0x7f040015c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:42.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.367+0000 7f03fe800640 1 --2- 172.21.15.112:0/622242569 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f040015db60 0x7f0400153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:42.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.367+0000 7f03fde00640 1 -- 172.21.15.112:0/622242569 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f040015db60 msgr2=0x7f0400153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:42.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.368+0000 7f03fde00640 1 --2- 172.21.15.112:0/622242569 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f040015db60 0x7f0400153de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:42.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.368+0000 7f03fde00640 1 -- 172.21.15.112:0/622242569 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f040015a450 msgr2=0x7f040015c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:42.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.368+0000 7f03fde00640 1 --2- 172.21.15.112:0/622242569 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f040015a450 0x7f040015c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:42.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.368+0000 7f03fde00640 1 -- 172.21.15.112:0/622242569 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04000ca9b0 con 0x7f04000ce460 2024-09-12T02:52:42.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.368+0000 7f03fde00640 1 --2- 172.21.15.112:0/622242569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04000ce460 0x7f0400145400 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f03f000e8c0 tx=0x7f03f000ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:42.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.368+0000 7f03f6a00640 1 -- 172.21.15.112:0/622242569 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f0017070 con 0x7f04000ce460 2024-09-12T02:52:42.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.368+0000 7f03f6a00640 1 -- 172.21.15.112:0/622242569 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03f000c940 con 0x7f04000ce460 2024-09-12T02:52:42.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.368+0000 7f03f6a00640 1 -- 172.21.15.112:0/622242569 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f000cd10 con 0x7f04000ce460 2024-09-12T02:52:42.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.368+0000 7f03ff200640 1 -- 172.21.15.112:0/622242569 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04000cac90 con 0x7f04000ce460 2024-09-12T02:52:42.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.368+0000 7f03ff200640 1 -- 172.21.15.112:0/622242569 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f040015bc00 con 0x7f04000ce460 2024-09-12T02:52:42.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.369+0000 7f03ff200640 1 -- 172.21.15.112:0/622242569 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f040006e140 con 0x7f04000ce460 2024-09-12T02:52:42.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.370+0000 7f03f6a00640 1 -- 172.21.15.112:0/622242569 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f03f001a070 con 0x7f04000ce460 2024-09-12T02:52:42.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.371+0000 7f03f6a00640 1 --2- 172.21.15.112:0/622242569 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f03dc06be60 0x7f03dc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:42.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.371+0000 7f03f6a00640 1 -- 172.21.15.112:0/622242569 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(172..172 src has 1..172) ==== 5824+0+0 (secure 0 0 0) 0x7f03f008b1c0 con 0x7f04000ce460 2024-09-12T02:52:42.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.371+0000 7f03f5400640 1 --2- 172.21.15.112:0/622242569 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f03dc06be60 0x7f03dc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:42.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.371+0000 7f03f6a00640 1 -- 172.21.15.112:0/622242569 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=173}) -- 0x7f03dc073b00 con 0x7f04000ce460 2024-09-12T02:52:42.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.372+0000 7f03f5400640 1 --2- 172.21.15.112:0/622242569 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f03dc06be60 0x7f03dc06e320 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f03e8034000 tx=0x7f03e802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:42.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.375+0000 7f03f6a00640 1 -- 172.21.15.112:0/622242569 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f03f0059430 con 0x7f04000ce460 2024-09-12T02:52:42.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:42.581+0000 7f03ff200640 1 -- 172.21.15.112:0/622242569 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f04000b3b80 con 0x7f04000ce460 2024-09-12T02:52:43.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.184+0000 7f03f6a00640 1 -- 172.21.15.112:0/622242569 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v88) ==== 104+0+0 (secure 0 0 0) 0x7f03f005d730 con 0x7f04000ce460 2024-09-12T02:52:43.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.187+0000 7f03ff200640 1 -- 172.21.15.112:0/622242569 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f03dc06be60 msgr2=0x7f03dc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:43.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.187+0000 7f03ff200640 1 --2- 172.21.15.112:0/622242569 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f03dc06be60 0x7f03dc06e320 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f03e8034000 tx=0x7f03e802e000 comp rx=0 tx=0).stop 2024-09-12T02:52:43.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.187+0000 7f03ff200640 1 -- 172.21.15.112:0/622242569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04000ce460 msgr2=0x7f0400145400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:43.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.187+0000 7f03ff200640 1 --2- 172.21.15.112:0/622242569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04000ce460 0x7f0400145400 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f03f000e8c0 tx=0x7f03f000ed80 comp rx=0 tx=0).stop 2024-09-12T02:52:43.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.187+0000 7f03ff200640 1 -- 172.21.15.112:0/622242569 shutdown_connections 2024-09-12T02:52:43.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.187+0000 7f03ff200640 1 --2- 172.21.15.112:0/622242569 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f040015db60 0x7f0400153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:43.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.187+0000 7f03ff200640 1 --2- 172.21.15.112:0/622242569 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f03dc06be60 0x7f03dc06e320 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:43.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.187+0000 7f03ff200640 1 --2- 172.21.15.112:0/622242569 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f040015a450 0x7f040015c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:43.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.187+0000 7f03ff200640 1 --2- 172.21.15.112:0/622242569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04000ce460 0x7f0400145400 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:43.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.187+0000 7f03ff200640 1 -- 172.21.15.112:0/622242569 >> 172.21.15.112:0/622242569 conn(0x7f040006bbd0 msgr2=0x7f040015f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:43.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.187+0000 7f03ff200640 1 -- 172.21.15.112:0/622242569 shutdown_connections 2024-09-12T02:52:43.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.187+0000 7f03ff200640 1 -- 172.21.15.112:0/622242569 wait complete. 2024-09-12T02:52:43.205 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T02:52:43.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.365+0000 7fc157e00640 1 Processor -- start 2024-09-12T02:52:43.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.365+0000 7fc157e00640 1 -- start start 2024-09-12T02:52:43.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.366+0000 7fc157e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1581633b0 0x7fc1580d13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:43.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.366+0000 7fc157e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc1580d56c0 0x7fc1580d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:43.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.366+0000 7fc157e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc1580b81f0 0x7fc1580b8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:43.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.367+0000 7fc157e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc1580d34d0 con 0x7fc1580d56c0 2024-09-12T02:52:43.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.367+0000 7fc157e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc1580d37b0 con 0x7fc1580b81f0 2024-09-12T02:52:43.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.367+0000 7fc157e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc1580d3a90 con 0x7fc1581633b0 2024-09-12T02:52:43.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.367+0000 7fc14e000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc1580d56c0 0x7fc1580d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:43.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.367+0000 7fc14e000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc1580d56c0 0x7fc1580d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42140/0 (socket says 172.21.15.112:42140) 2024-09-12T02:52:43.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.367+0000 7fc14e000640 1 -- 172.21.15.112:0/1889639321 learned_addr learned my addr 172.21.15.112:0/1889639321 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:43.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.367+0000 7fc157400640 1 --2- 172.21.15.112:0/1889639321 >> v2:172.21.15.137:3300/0 conn(0x7fc1580b81f0 0x7fc1580b8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:43.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.367+0000 7fc156a00640 1 --2- 172.21.15.112:0/1889639321 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1581633b0 0x7fc1580d13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:43.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.367+0000 7fc14e000640 1 -- 172.21.15.112:0/1889639321 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1581633b0 msgr2=0x7fc1580d13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:43.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.367+0000 7fc14e000640 1 --2- 172.21.15.112:0/1889639321 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1581633b0 0x7fc1580d13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:43.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.367+0000 7fc14e000640 1 -- 172.21.15.112:0/1889639321 >> v2:172.21.15.137:3300/0 conn(0x7fc1580b81f0 msgr2=0x7fc1580b8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:43.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.367+0000 7fc14e000640 1 --2- 172.21.15.112:0/1889639321 >> v2:172.21.15.137:3300/0 conn(0x7fc1580b81f0 0x7fc1580b8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:43.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.367+0000 7fc14e000640 1 -- 172.21.15.112:0/1889639321 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1580b79f0 con 0x7fc1580d56c0 2024-09-12T02:52:43.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.368+0000 7fc14e000640 1 --2- 172.21.15.112:0/1889639321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1580d56c0 0x7fc1580d1920 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fc1580c84e0 tx=0x7fc14002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dffbe99aa75f4e0c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:43.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.368+0000 7fc156000640 1 -- 172.21.15.112:0/1889639321 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc140037070 con 0x7fc1580d56c0 2024-09-12T02:52:43.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.368+0000 7fc156000640 1 -- 172.21.15.112:0/1889639321 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc140032440 con 0x7fc1580d56c0 2024-09-12T02:52:43.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.369+0000 7fc156000640 1 -- 172.21.15.112:0/1889639321 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc140032810 con 0x7fc1580d56c0 2024-09-12T02:52:43.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.369+0000 7fc157e00640 1 -- 172.21.15.112:0/1889639321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1580d56c0 msgr2=0x7fc1580d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:43.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.369+0000 7fc157e00640 1 --2- 172.21.15.112:0/1889639321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1580d56c0 0x7fc1580d1920 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fc1580c84e0 tx=0x7fc14002a140 comp rx=0 tx=0).stop 2024-09-12T02:52:43.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.369+0000 7fc157e00640 1 -- 172.21.15.112:0/1889639321 shutdown_connections 2024-09-12T02:52:43.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.369+0000 7fc157e00640 1 --2- 172.21.15.112:0/1889639321 >> v2:172.21.15.137:3300/0 conn(0x7fc1580b81f0 0x7fc1580b8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:43.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.369+0000 7fc157e00640 1 --2- 172.21.15.112:0/1889639321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1580d56c0 0x7fc1580d1920 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:43.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.369+0000 7fc157e00640 1 --2- 172.21.15.112:0/1889639321 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1581633b0 0x7fc1580d13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:43.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.369+0000 7fc157e00640 1 -- 172.21.15.112:0/1889639321 >> 172.21.15.112:0/1889639321 conn(0x7fc1580d4ba0 msgr2=0x7fc1580d4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:43.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.369+0000 7fc157e00640 1 -- 172.21.15.112:0/1889639321 shutdown_connections 2024-09-12T02:52:43.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.369+0000 7fc157e00640 1 -- 172.21.15.112:0/1889639321 wait complete. 2024-09-12T02:52:43.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.371+0000 7fc157e00640 1 Processor -- start 2024-09-12T02:52:43.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.371+0000 7fc157e00640 1 -- start start 2024-09-12T02:52:43.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.372+0000 7fc157e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1580b81f0 0x7fc1580c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:43.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.372+0000 7fc157e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1580d56c0 0x7fc1580a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:43.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.372+0000 7fc157e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1581633b0 0x7fc1580cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:43.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.372+0000 7fc157e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc158163790 con 0x7fc1581633b0 2024-09-12T02:52:43.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.372+0000 7fc157e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc1580d3180 con 0x7fc1580d56c0 2024-09-12T02:52:43.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.372+0000 7fc157e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc158163910 con 0x7fc1580b81f0 2024-09-12T02:52:43.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.372+0000 7fc157400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1581633b0 0x7fc1580cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:43.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.372+0000 7fc157400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1581633b0 0x7fc1580cbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42154/0 (socket says 172.21.15.112:42154) 2024-09-12T02:52:43.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.372+0000 7fc157400640 1 -- 172.21.15.112:0/1476119194 learned_addr learned my addr 172.21.15.112:0/1476119194 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:43.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.372+0000 7fc157400640 1 -- 172.21.15.112:0/1476119194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1580b81f0 msgr2=0x7fc1580c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:43.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.372+0000 7fc157400640 1 --2- 172.21.15.112:0/1476119194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1580b81f0 0x7fc1580c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:43.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.372+0000 7fc157400640 1 -- 172.21.15.112:0/1476119194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1580d56c0 msgr2=0x7fc1580a1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:43.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.372+0000 7fc157400640 1 --2- 172.21.15.112:0/1476119194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1580d56c0 0x7fc1580a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:43.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.372+0000 7fc157400640 1 -- 172.21.15.112:0/1476119194 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1580ca420 con 0x7fc1581633b0 2024-09-12T02:52:43.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.373+0000 7fc157400640 1 --2- 172.21.15.112:0/1476119194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1581633b0 0x7fc1580cbc70 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fc15000eed0 tx=0x7fc15000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:43.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.373+0000 7fc14f400640 1 -- 172.21.15.112:0/1476119194 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150018020 con 0x7fc1581633b0 2024-09-12T02:52:43.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.373+0000 7fc14f400640 1 -- 172.21.15.112:0/1476119194 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc15000bd20 con 0x7fc1581633b0 2024-09-12T02:52:43.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.373+0000 7fc14f400640 1 -- 172.21.15.112:0/1476119194 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150014640 con 0x7fc1581633b0 2024-09-12T02:52:43.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.373+0000 7fc157e00640 1 -- 172.21.15.112:0/1476119194 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1580ca700 con 0x7fc1581633b0 2024-09-12T02:52:43.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.373+0000 7fc157e00640 1 -- 172.21.15.112:0/1476119194 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc15814ecc0 con 0x7fc1581633b0 2024-09-12T02:52:43.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.374+0000 7fc157e00640 1 -- 172.21.15.112:0/1476119194 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1580d13e0 con 0x7fc1581633b0 2024-09-12T02:52:43.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.375+0000 7fc14f400640 1 -- 172.21.15.112:0/1476119194 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc150005d10 con 0x7fc1581633b0 2024-09-12T02:52:43.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.376+0000 7fc14f400640 1 --2- 172.21.15.112:0/1476119194 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc13406be30 0x7fc13406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:43.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.377+0000 7fc14f400640 1 -- 172.21.15.112:0/1476119194 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(172..172 src has 1..172) ==== 5824+0+0 (secure 0 0 0) 0x7fc15008b5b0 con 0x7fc1581633b0 2024-09-12T02:52:43.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.377+0000 7fc156a00640 1 --2- 172.21.15.112:0/1476119194 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc13406be30 0x7fc13406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:43.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.377+0000 7fc14f400640 1 -- 172.21.15.112:0/1476119194 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=173}) -- 0x7fc134073ac0 con 0x7fc1581633b0 2024-09-12T02:52:43.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.377+0000 7fc156a00640 1 --2- 172.21.15.112:0/1476119194 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc13406be30 0x7fc13406e2f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc148006fd0 tx=0x7fc148008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:43.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.381+0000 7fc14f400640 1 -- 172.21.15.112:0/1476119194 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc150022070 con 0x7fc1581633b0 2024-09-12T02:52:43.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:43.552+0000 7fc157e00640 1 -- 172.21.15.112:0/1476119194 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc1580cac20 con 0x7fc1581633b0 2024-09-12T02:52:44.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.307+0000 7fc14f400640 1 -- 172.21.15.112:0/1476119194 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v173) ==== 181+0+0 (secure 0 0 0) 0x7fc150059e70 con 0x7fc1581633b0 2024-09-12T02:52:44.308 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' removed 2024-09-12T02:52:44.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.307+0000 7fc14f400640 1 -- 172.21.15.112:0/1476119194 <== mon.0 v2:172.21.15.112:3300/0 8 ==== osd_map(173..173 src has 1..173) ==== 296+0+0 (secure 0 0 0) 0x7fc1500bfd50 con 0x7fc1581633b0 2024-09-12T02:52:44.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.307+0000 7fc14f400640 1 -- 172.21.15.112:0/1476119194 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=174}) -- 0x7fc134071ef0 con 0x7fc1581633b0 2024-09-12T02:52:44.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.311+0000 7fc157e00640 1 -- 172.21.15.112:0/1476119194 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc13406be30 msgr2=0x7fc13406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:44.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.311+0000 7fc157e00640 1 --2- 172.21.15.112:0/1476119194 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc13406be30 0x7fc13406e2f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc148006fd0 tx=0x7fc148008040 comp rx=0 tx=0).stop 2024-09-12T02:52:44.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.311+0000 7fc157e00640 1 -- 172.21.15.112:0/1476119194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1581633b0 msgr2=0x7fc1580cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:44.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.311+0000 7fc157e00640 1 --2- 172.21.15.112:0/1476119194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1581633b0 0x7fc1580cbc70 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fc15000eed0 tx=0x7fc15000b480 comp rx=0 tx=0).stop 2024-09-12T02:52:44.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.315+0000 7fc157e00640 1 -- 172.21.15.112:0/1476119194 shutdown_connections 2024-09-12T02:52:44.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.315+0000 7fc157e00640 1 --2- 172.21.15.112:0/1476119194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1581633b0 0x7fc1580cbc70 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:44.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.315+0000 7fc157e00640 1 --2- 172.21.15.112:0/1476119194 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc13406be30 0x7fc13406e2f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:44.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.315+0000 7fc157e00640 1 --2- 172.21.15.112:0/1476119194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1580d56c0 0x7fc1580a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:44.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.315+0000 7fc157e00640 1 --2- 172.21.15.112:0/1476119194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1580b81f0 0x7fc1580c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:44.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.315+0000 7fc157e00640 1 -- 172.21.15.112:0/1476119194 >> 172.21.15.112:0/1476119194 conn(0x7fc1580d4ba0 msgr2=0x7fc15806d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:44.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.315+0000 7fc157e00640 1 -- 172.21.15.112:0/1476119194 shutdown_connections 2024-09-12T02:52:44.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.315+0000 7fc157e00640 1 -- 172.21.15.112:0/1476119194 wait complete. 2024-09-12T02:52:44.333 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T02:52:44.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.489+0000 7fdd7e000640 1 Processor -- start 2024-09-12T02:52:44.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.489+0000 7fdd7e000640 1 -- start start 2024-09-12T02:52:44.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.490+0000 7fdd7e000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdd78157190 0x7fdd780b5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:44.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.490+0000 7fdd7e000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdd7815d110 0x7fdd7806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:44.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.490+0000 7fdd7e000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdd780d0970 0x7fdd780d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:44.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.490+0000 7fdd7e000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fdd780d1300 con 0x7fdd78157190 2024-09-12T02:52:44.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.490+0000 7fdd7e000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fdd7806d8f0 con 0x7fdd780d0970 2024-09-12T02:52:44.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.490+0000 7fdd7e000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdd780720b0 con 0x7fdd7815d110 2024-09-12T02:52:44.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.491+0000 7fdd77400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdd78157190 0x7fdd780b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:44.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.491+0000 7fdd77400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdd78157190 0x7fdd780b5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42166/0 (socket says 172.21.15.112:42166) 2024-09-12T02:52:44.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.491+0000 7fdd77400640 1 -- 172.21.15.112:0/2790506066 learned_addr learned my addr 172.21.15.112:0/2790506066 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:44.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.491+0000 7fdd77e00640 1 --2- 172.21.15.112:0/2790506066 >> v2:172.21.15.137:3300/0 conn(0x7fdd780d0970 0x7fdd780d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:44.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.491+0000 7fdd6ea00640 1 --2- 172.21.15.112:0/2790506066 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdd7815d110 0x7fdd7806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:44.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.491+0000 7fdd77400640 1 -- 172.21.15.112:0/2790506066 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdd7815d110 msgr2=0x7fdd7806d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:44.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.491+0000 7fdd77400640 1 --2- 172.21.15.112:0/2790506066 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdd7815d110 0x7fdd7806d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:44.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.491+0000 7fdd77400640 1 -- 172.21.15.112:0/2790506066 >> v2:172.21.15.137:3300/0 conn(0x7fdd780d0970 msgr2=0x7fdd780d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:44.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.491+0000 7fdd77400640 1 --2- 172.21.15.112:0/2790506066 >> v2:172.21.15.137:3300/0 conn(0x7fdd780d0970 0x7fdd780d0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:44.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.491+0000 7fdd77400640 1 -- 172.21.15.112:0/2790506066 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd7815d880 con 0x7fdd78157190 2024-09-12T02:52:44.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.492+0000 7fdd77400640 1 --2- 172.21.15.112:0/2790506066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd78157190 0x7fdd780b5190 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fdd78074300 tx=0x7fdd6802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97f808b3da60ad3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:44.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.492+0000 7fdd76a00640 1 -- 172.21.15.112:0/2790506066 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd68037070 con 0x7fdd78157190 2024-09-12T02:52:44.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.493+0000 7fdd76a00640 1 -- 172.21.15.112:0/2790506066 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd68032440 con 0x7fdd78157190 2024-09-12T02:52:44.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.493+0000 7fdd76a00640 1 -- 172.21.15.112:0/2790506066 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd68032810 con 0x7fdd78157190 2024-09-12T02:52:44.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.493+0000 7fdd7e000640 1 -- 172.21.15.112:0/2790506066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd78157190 msgr2=0x7fdd780b5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:44.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.493+0000 7fdd7e000640 1 --2- 172.21.15.112:0/2790506066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd78157190 0x7fdd780b5190 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fdd78074300 tx=0x7fdd6802a1e0 comp rx=0 tx=0).stop 2024-09-12T02:52:44.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.493+0000 7fdd7e000640 1 -- 172.21.15.112:0/2790506066 shutdown_connections 2024-09-12T02:52:44.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.493+0000 7fdd7e000640 1 --2- 172.21.15.112:0/2790506066 >> v2:172.21.15.137:3300/0 conn(0x7fdd780d0970 0x7fdd780d0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:44.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.493+0000 7fdd7e000640 1 --2- 172.21.15.112:0/2790506066 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdd7815d110 0x7fdd7806d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:44.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.493+0000 7fdd7e000640 1 --2- 172.21.15.112:0/2790506066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd78157190 0x7fdd780b5190 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:44.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.493+0000 7fdd7e000640 1 -- 172.21.15.112:0/2790506066 >> 172.21.15.112:0/2790506066 conn(0x7fdd780b2730 msgr2=0x7fdd780b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:44.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.493+0000 7fdd7e000640 1 -- 172.21.15.112:0/2790506066 shutdown_connections 2024-09-12T02:52:44.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.493+0000 7fdd7e000640 1 -- 172.21.15.112:0/2790506066 wait complete. 2024-09-12T02:52:44.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.495+0000 7fdd7e000640 1 Processor -- start 2024-09-12T02:52:44.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.495+0000 7fdd7e000640 1 -- start start 2024-09-12T02:52:44.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.496+0000 7fdd7e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd780d0970 0x7fdd78155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:44.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.496+0000 7fdd7e000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdd78157190 0x7fdd7814eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:44.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.496+0000 7fdd7e000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd7815d110 0x7fdd7814a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:44.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.496+0000 7fdd7e000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdd78072350 con 0x7fdd7815d110 2024-09-12T02:52:44.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.496+0000 7fdd7e000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdd7815de40 con 0x7fdd780d0970 2024-09-12T02:52:44.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.496+0000 7fdd7e000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdd7815d5a0 con 0x7fdd78157190 2024-09-12T02:52:44.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.496+0000 7fdd77e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd7815d110 0x7fdd7814a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:44.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.496+0000 7fdd77e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd7815d110 0x7fdd7814a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42176/0 (socket says 172.21.15.112:42176) 2024-09-12T02:52:44.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.496+0000 7fdd77e00640 1 -- 172.21.15.112:0/90800073 learned_addr learned my addr 172.21.15.112:0/90800073 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:44.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.496+0000 7fdd77400640 1 --2- 172.21.15.112:0/90800073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd780d0970 0x7fdd78155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:44.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.496+0000 7fdd6ea00640 1 --2- 172.21.15.112:0/90800073 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdd78157190 0x7fdd7814eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:44.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.496+0000 7fdd77e00640 1 -- 172.21.15.112:0/90800073 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdd78157190 msgr2=0x7fdd7814eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:44.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.496+0000 7fdd77e00640 1 --2- 172.21.15.112:0/90800073 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdd78157190 0x7fdd7814eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:44.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.496+0000 7fdd77e00640 1 -- 172.21.15.112:0/90800073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd780d0970 msgr2=0x7fdd78155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:44.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.496+0000 7fdd77e00640 1 --2- 172.21.15.112:0/90800073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd780d0970 0x7fdd78155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:44.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.496+0000 7fdd77e00640 1 -- 172.21.15.112:0/90800073 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd7814ad30 con 0x7fdd7815d110 2024-09-12T02:52:44.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.497+0000 7fdd77e00640 1 --2- 172.21.15.112:0/90800073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd7815d110 0x7fdd7814a170 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fdd70007e60 tx=0x7fdd7000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:44.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.497+0000 7fdd6fe00640 1 -- 172.21.15.112:0/90800073 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd70014620 con 0x7fdd7815d110 2024-09-12T02:52:44.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.497+0000 7fdd6fe00640 1 -- 172.21.15.112:0/90800073 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd70019070 con 0x7fdd7815d110 2024-09-12T02:52:44.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.497+0000 7fdd7e000640 1 -- 172.21.15.112:0/90800073 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd7814f180 con 0x7fdd7815d110 2024-09-12T02:52:44.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.497+0000 7fdd6fe00640 1 -- 172.21.15.112:0/90800073 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd70014a20 con 0x7fdd7815d110 2024-09-12T02:52:44.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.497+0000 7fdd7e000640 1 -- 172.21.15.112:0/90800073 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd7814f910 con 0x7fdd7815d110 2024-09-12T02:52:44.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.498+0000 7fdd7e000640 1 -- 172.21.15.112:0/90800073 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd78157570 con 0x7fdd7815d110 2024-09-12T02:52:44.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.499+0000 7fdd6fe00640 1 -- 172.21.15.112:0/90800073 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdd70014bc0 con 0x7fdd7815d110 2024-09-12T02:52:44.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.500+0000 7fdd6fe00640 1 --2- 172.21.15.112:0/90800073 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdd5406be30 0x7fdd5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:44.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.500+0000 7fdd6fe00640 1 -- 172.21.15.112:0/90800073 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 5386+0+0 (secure 0 0 0) 0x7fdd7008b430 con 0x7fdd7815d110 2024-09-12T02:52:44.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.500+0000 7fdd77400640 1 --2- 172.21.15.112:0/90800073 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdd5406be30 0x7fdd5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:44.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.500+0000 7fdd6fe00640 1 -- 172.21.15.112:0/90800073 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=174}) -- 0x7fdd54072cc0 con 0x7fdd7815d110 2024-09-12T02:52:44.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.501+0000 7fdd77400640 1 --2- 172.21.15.112:0/90800073 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdd5406be30 0x7fdd5406e2f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fdd68034000 tx=0x7fdd6802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:44.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.504+0000 7fdd6fe00640 1 -- 172.21.15.112:0/90800073 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdd7814ad30 con 0x7fdd7815d110 2024-09-12T02:52:44.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:44.677+0000 7fdd7e000640 1 -- 172.21.15.112:0/90800073 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdd78156660 con 0x7fdd7815d110 2024-09-12T02:52:45.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.313+0000 7fdd6fe00640 1 -- 172.21.15.112:0/90800073 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v174) ==== 169+0+0 (secure 0 0 0) 0x7fdd70059fb0 con 0x7fdd7815d110 2024-09-12T02:52:45.314 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' removed 2024-09-12T02:52:45.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.313+0000 7fdd6fe00640 1 -- 172.21.15.112:0/90800073 <== mon.0 v2:172.21.15.112:3300/0 8 ==== osd_map(174..174 src has 1..174) ==== 313+0+0 (secure 0 0 0) 0x7fdd700bfd50 con 0x7fdd7815d110 2024-09-12T02:52:45.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.313+0000 7fdd6fe00640 1 -- 172.21.15.112:0/90800073 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=175}) -- 0x7fdd54071a50 con 0x7fdd7815d110 2024-09-12T02:52:45.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.319+0000 7fdd7e000640 1 -- 172.21.15.112:0/90800073 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdd5406be30 msgr2=0x7fdd5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:45.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.319+0000 7fdd7e000640 1 --2- 172.21.15.112:0/90800073 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdd5406be30 0x7fdd5406e2f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fdd68034000 tx=0x7fdd6802e000 comp rx=0 tx=0).stop 2024-09-12T02:52:45.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.319+0000 7fdd7e000640 1 -- 172.21.15.112:0/90800073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd7815d110 msgr2=0x7fdd7814a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:45.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.319+0000 7fdd7e000640 1 --2- 172.21.15.112:0/90800073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd7815d110 0x7fdd7814a170 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fdd70007e60 tx=0x7fdd7000e4b0 comp rx=0 tx=0).stop 2024-09-12T02:52:45.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.321+0000 7fdd7e000640 1 -- 172.21.15.112:0/90800073 shutdown_connections 2024-09-12T02:52:45.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.321+0000 7fdd7e000640 1 --2- 172.21.15.112:0/90800073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd7815d110 0x7fdd7814a170 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:45.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.321+0000 7fdd7e000640 1 --2- 172.21.15.112:0/90800073 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdd78157190 0x7fdd7814eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:45.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.321+0000 7fdd7e000640 1 --2- 172.21.15.112:0/90800073 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdd5406be30 0x7fdd5406e2f0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:45.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.321+0000 7fdd7e000640 1 --2- 172.21.15.112:0/90800073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd780d0970 0x7fdd78155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:45.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.321+0000 7fdd7e000640 1 -- 172.21.15.112:0/90800073 >> 172.21.15.112:0/90800073 conn(0x7fdd780b2730 msgr2=0x7fdd781555f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:45.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.322+0000 7fdd7e000640 1 -- 172.21.15.112:0/90800073 shutdown_connections 2024-09-12T02:52:45.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.322+0000 7fdd7e000640 1 -- 172.21.15.112:0/90800073 wait complete. 2024-09-12T02:52:45.343 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T02:52:45.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.498+0000 7f93c3e00640 1 Processor -- start 2024-09-12T02:52:45.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.498+0000 7f93c3e00640 1 -- start start 2024-09-12T02:52:45.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.499+0000 7f93c3e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93c40d1710 0x7f93c40d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:45.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.499+0000 7f93c3e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93c40d2fb0 con 0x7f93c40b1d70 2024-09-12T02:52:45.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.499+0000 7f93c3e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93c40d0b60 con 0x7f93c40b3e00 2024-09-12T02:52:45.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.499+0000 7f93c3e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f93c40d3cb0 con 0x7f93c40d1710 2024-09-12T02:52:45.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.499+0000 7f93c3400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f93c40b1d70 0x7f93c40b2220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45172/0 (socket says 172.21.15.112:45172) 2024-09-12T02:52:45.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.500+0000 7f93c3400640 1 -- 172.21.15.112:0/1778822066 learned_addr learned my addr 172.21.15.112:0/1778822066 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:52:45.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.500+0000 7f93c2a00640 1 --2- 172.21.15.112:0/1778822066 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93c40d1710 0x7f93c40d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:45.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.500+0000 7f93c1600640 1 -- 172.21.15.112:0/1778822066 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2205348528 0 0) 0x7f93c40d2fb0 con 0x7f93c40b1d70 2024-09-12T02:52:45.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.500+0000 7f93c1600640 1 -- 172.21.15.112:0/1778822066 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93a8003520 con 0x7f93c40b1d70 2024-09-12T02:52:45.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.500+0000 7f93c1600640 1 -- 172.21.15.112:0/1778822066 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 550870386 0 0) 0x7f93c40d0b60 con 0x7f93c40b3e00 2024-09-12T02:52:45.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.500+0000 7f93c1600640 1 -- 172.21.15.112:0/1778822066 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93c40d2fb0 con 0x7f93c40b3e00 2024-09-12T02:52:45.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.500+0000 7f93c2a00640 1 -- 172.21.15.112:0/1778822066 >> v1:172.21.15.137:6789/0 conn(0x7f93c40b3e00 legacy=0x7f93c40d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:45.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.500+0000 7f93c2a00640 1 -- 172.21.15.112:0/1778822066 >> v1:172.21.15.112:6789/0 conn(0x7f93c40b1d70 legacy=0x7f93c40b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:45.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.500+0000 7f93c2a00640 1 -- 172.21.15.112:0/1778822066 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93c40d3410 con 0x7f93c40d1710 2024-09-12T02:52:45.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.501+0000 7f93c2a00640 1 --2- 172.21.15.112:0/1778822066 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93c40d1710 0x7f93c40d28d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f93b40097d0 tx=0x7f93b402a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15ecae2b738af337 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:45.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.502+0000 7f93c1600640 1 -- 172.21.15.112:0/1778822066 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b4037070 con 0x7f93c40d1710 2024-09-12T02:52:45.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.502+0000 7f93c1600640 1 -- 172.21.15.112:0/1778822066 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93b4032440 con 0x7f93c40d1710 2024-09-12T02:52:45.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.502+0000 7f93c1600640 1 -- 172.21.15.112:0/1778822066 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b4032810 con 0x7f93c40d1710 2024-09-12T02:52:45.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.502+0000 7f93c3e00640 1 -- 172.21.15.112:0/1778822066 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93c40d1710 msgr2=0x7f93c40d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:45.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.502+0000 7f93c3e00640 1 --2- 172.21.15.112:0/1778822066 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93c40d1710 0x7f93c40d28d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f93b40097d0 tx=0x7f93b402a200 comp rx=0 tx=0).stop 2024-09-12T02:52:45.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.502+0000 7f93c3e00640 1 -- 172.21.15.112:0/1778822066 shutdown_connections 2024-09-12T02:52:45.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.502+0000 7f93c3e00640 1 --2- 172.21.15.112:0/1778822066 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93c40d1710 0x7f93c40d28d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:45.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.502+0000 7f93c3e00640 1 -- 172.21.15.112:0/1778822066 >> 172.21.15.112:0/1778822066 conn(0x7f93c409e030 msgr2=0x7f93c40d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:45.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.502+0000 7f93c3e00640 1 -- 172.21.15.112:0/1778822066 shutdown_connections 2024-09-12T02:52:45.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.503+0000 7f93c3e00640 1 -- 172.21.15.112:0/1778822066 wait complete. 2024-09-12T02:52:45.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.504+0000 7f93c3e00640 1 Processor -- start 2024-09-12T02:52:45.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.504+0000 7f93c3e00640 1 -- start start 2024-09-12T02:52:45.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.505+0000 7f93c3e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93c40b1d70 0x7f93c4160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:45.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.505+0000 7f93c3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93c40b3e00 0x7f93c415f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:45.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.505+0000 7f93c3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93c40d1710 0x7f93c4151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:45.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.505+0000 7f93c3e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f93c415f110 con 0x7f93c40d1710 2024-09-12T02:52:45.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.505+0000 7f93c3e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f93c40d39d0 con 0x7f93c40b3e00 2024-09-12T02:52:45.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.505+0000 7f93c3e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f93c415f290 con 0x7f93c40b1d70 2024-09-12T02:52:45.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.505+0000 7f93c3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93c40d1710 0x7f93c4151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:45.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.506+0000 7f93c3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93c40d1710 0x7f93c4151030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42180/0 (socket says 172.21.15.112:42180) 2024-09-12T02:52:45.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.506+0000 7f93c3400640 1 -- 172.21.15.112:0/3857640875 learned_addr learned my addr 172.21.15.112:0/3857640875 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:45.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.506+0000 7f93c2a00640 1 --2- 172.21.15.112:0/3857640875 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93c40b1d70 0x7f93c4160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:45.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.506+0000 7f93c2000640 1 --2- 172.21.15.112:0/3857640875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93c40b3e00 0x7f93c415f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:45.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.506+0000 7f93c3400640 1 -- 172.21.15.112:0/3857640875 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93c40b1d70 msgr2=0x7f93c4160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:45.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.506+0000 7f93c3400640 1 --2- 172.21.15.112:0/3857640875 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93c40b1d70 0x7f93c4160bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:45.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.506+0000 7f93c3400640 1 -- 172.21.15.112:0/3857640875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93c40b3e00 msgr2=0x7f93c415f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:45.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.506+0000 7f93c3400640 1 --2- 172.21.15.112:0/3857640875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93c40b3e00 0x7f93c415f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:45.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.506+0000 7f93c3400640 1 -- 172.21.15.112:0/3857640875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93c415fb10 con 0x7f93c40d1710 2024-09-12T02:52:45.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.506+0000 7f93c3400640 1 --2- 172.21.15.112:0/3857640875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93c40d1710 0x7f93c4151030 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f93bc00cb40 tx=0x7f93bc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:45.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.506+0000 7f93baa00640 1 -- 172.21.15.112:0/3857640875 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc017070 con 0x7f93c40d1710 2024-09-12T02:52:45.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.507+0000 7f93baa00640 1 -- 172.21.15.112:0/3857640875 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93bc00aca0 con 0x7f93c40d1710 2024-09-12T02:52:45.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.507+0000 7f93baa00640 1 -- 172.21.15.112:0/3857640875 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc012600 con 0x7f93c40d1710 2024-09-12T02:52:45.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.507+0000 7f93c3e00640 1 -- 172.21.15.112:0/3857640875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93c415fdf0 con 0x7f93c40d1710 2024-09-12T02:52:45.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.507+0000 7f93c3e00640 1 -- 172.21.15.112:0/3857640875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93c41603b0 con 0x7f93c40d1710 2024-09-12T02:52:45.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.508+0000 7f93c3e00640 1 -- 172.21.15.112:0/3857640875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93c40d28d0 con 0x7f93c40d1710 2024-09-12T02:52:45.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.508+0000 7f93baa00640 1 -- 172.21.15.112:0/3857640875 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f93bc01a070 con 0x7f93c40d1710 2024-09-12T02:52:45.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.509+0000 7f93baa00640 1 --2- 172.21.15.112:0/3857640875 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f93a406be30 0x7f93a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:45.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.509+0000 7f93baa00640 1 -- 172.21.15.112:0/3857640875 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 4943+0+0 (secure 0 0 0) 0x7f93bc08a8c0 con 0x7f93c40d1710 2024-09-12T02:52:45.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.510+0000 7f93c2a00640 1 --2- 172.21.15.112:0/3857640875 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f93a406be30 0x7f93a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:45.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.510+0000 7f93c2a00640 1 --2- 172.21.15.112:0/3857640875 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f93a406be30 0x7f93a406e2f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f93b4034000 tx=0x7f93b402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:45.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.514+0000 7f93baa00640 1 -- 172.21.15.112:0/3857640875 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f93bc058f10 con 0x7f93c40d1710 2024-09-12T02:52:45.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.687+0000 7f93c3e00640 1 -- 172.21.15.112:0/3857640875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f93c40b3270 con 0x7f93c40d1710 2024-09-12T02:52:45.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.691+0000 7f93baa00640 1 -- 172.21.15.112:0/3857640875 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7f93bc05d210 con 0x7f93c40d1710 2024-09-12T02:52:45.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.694+0000 7f93c3e00640 1 -- 172.21.15.112:0/3857640875 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f93a406be30 msgr2=0x7f93a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:45.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.694+0000 7f93c3e00640 1 --2- 172.21.15.112:0/3857640875 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f93a406be30 0x7f93a406e2f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f93b4034000 tx=0x7f93b402e000 comp rx=0 tx=0).stop 2024-09-12T02:52:45.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.694+0000 7f93c3e00640 1 -- 172.21.15.112:0/3857640875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93c40d1710 msgr2=0x7f93c4151030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:45.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.694+0000 7f93c3e00640 1 --2- 172.21.15.112:0/3857640875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93c40d1710 0x7f93c4151030 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f93bc00cb40 tx=0x7f93bc00a060 comp rx=0 tx=0).stop 2024-09-12T02:52:45.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.694+0000 7f93c3e00640 1 -- 172.21.15.112:0/3857640875 shutdown_connections 2024-09-12T02:52:45.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.694+0000 7f93c3e00640 1 --2- 172.21.15.112:0/3857640875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93c40d1710 0x7f93c4151030 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:45.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.694+0000 7f93c3e00640 1 --2- 172.21.15.112:0/3857640875 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f93a406be30 0x7f93a406e2f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:45.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.694+0000 7f93c3e00640 1 --2- 172.21.15.112:0/3857640875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93c40b3e00 0x7f93c415f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:45.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.694+0000 7f93c3e00640 1 --2- 172.21.15.112:0/3857640875 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93c40b1d70 0x7f93c4160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:45.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.694+0000 7f93c3e00640 1 -- 172.21.15.112:0/3857640875 >> 172.21.15.112:0/3857640875 conn(0x7f93c409e030 msgr2=0x7f93c406d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:45.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.694+0000 7f93c3e00640 1 -- 172.21.15.112:0/3857640875 shutdown_connections 2024-09-12T02:52:45.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.694+0000 7f93c3e00640 1 -- 172.21.15.112:0/3857640875 wait complete. 2024-09-12T02:52:45.711 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2024-09-12T02:52:45.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.863+0000 7fddc5e00640 1 Processor -- start 2024-09-12T02:52:45.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.863+0000 7fddc5e00640 1 -- start start 2024-09-12T02:52:45.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.864+0000 7fddc5e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fddc0147dd0 0x7fddc0072460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:45.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.864+0000 7fddc5e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fddc006eae0 0x7fddc00cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:45.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.864+0000 7fddc5e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddc006f3a0 con 0x7fddc006ef20 2024-09-12T02:52:45.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.864+0000 7fddc5e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fddc01481b0 con 0x7fddc0147dd0 2024-09-12T02:52:45.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.864+0000 7fddc5e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fddc006ffb0 con 0x7fddc006eae0 2024-09-12T02:52:45.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.864+0000 7fddbea00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fddc0147dd0 0x7fddc0072460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:45.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.864+0000 7fddbea00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fddc0147dd0 0x7fddc0072460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42184/0 (socket says 172.21.15.112:42184) 2024-09-12T02:52:45.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.864+0000 7fddbea00640 1 -- 172.21.15.112:0/2364225537 learned_addr learned my addr 172.21.15.112:0/2364225537 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:45.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.865+0000 7fddb6000640 1 --2- 172.21.15.112:0/2364225537 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fddc006eae0 0x7fddc00cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:45.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.865+0000 7fddbea00640 1 -- 172.21.15.112:0/2364225537 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fddc006eae0 msgr2=0x7fddc00cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:45.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.865+0000 7fddbea00640 1 --2- 172.21.15.112:0/2364225537 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fddc006eae0 0x7fddc00cfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:45.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.865+0000 7fddbea00640 1 -- 172.21.15.112:0/2364225537 >> v1:172.21.15.137:6789/0 conn(0x7fddc006ef20 legacy=0x7fddc0072c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:45.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.865+0000 7fddbea00640 1 -- 172.21.15.112:0/2364225537 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc006f680 con 0x7fddc0147dd0 2024-09-12T02:52:45.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.865+0000 7fddb6000640 1 --2- 172.21.15.112:0/2364225537 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fddc006eae0 0x7fddc00cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:52:45.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.866+0000 7fddbea00640 1 --2- 172.21.15.112:0/2364225537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddc0147dd0 0x7fddc0072460 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fddb0009870 tx=0x7fddb002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68edb22876e1ed15 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:45.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.866+0000 7fddbe000640 1 -- 172.21.15.112:0/2364225537 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb0037070 con 0x7fddc0147dd0 2024-09-12T02:52:45.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.866+0000 7fddbe000640 1 -- 172.21.15.112:0/2364225537 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddb0032440 con 0x7fddc0147dd0 2024-09-12T02:52:45.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.866+0000 7fddbe000640 1 -- 172.21.15.112:0/2364225537 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb0032810 con 0x7fddc0147dd0 2024-09-12T02:52:45.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.867+0000 7fddc5e00640 1 -- 172.21.15.112:0/2364225537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddc0147dd0 msgr2=0x7fddc0072460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:45.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.867+0000 7fddc5e00640 1 --2- 172.21.15.112:0/2364225537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddc0147dd0 0x7fddc0072460 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fddb0009870 tx=0x7fddb002a210 comp rx=0 tx=0).stop 2024-09-12T02:52:45.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.867+0000 7fddc5e00640 1 -- 172.21.15.112:0/2364225537 shutdown_connections 2024-09-12T02:52:45.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.867+0000 7fddc5e00640 1 --2- 172.21.15.112:0/2364225537 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fddc006eae0 0x7fddc00cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:45.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.867+0000 7fddc5e00640 1 --2- 172.21.15.112:0/2364225537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddc0147dd0 0x7fddc0072460 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:45.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.867+0000 7fddc5e00640 1 -- 172.21.15.112:0/2364225537 >> 172.21.15.112:0/2364225537 conn(0x7fddc00cd930 msgr2=0x7fddc00cdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:45.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.867+0000 7fddc5e00640 1 -- 172.21.15.112:0/2364225537 shutdown_connections 2024-09-12T02:52:45.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.867+0000 7fddc5e00640 1 -- 172.21.15.112:0/2364225537 wait complete. 2024-09-12T02:52:45.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.869+0000 7fddc5e00640 1 Processor -- start 2024-09-12T02:52:45.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.869+0000 7fddc5e00640 1 -- start start 2024-09-12T02:52:45.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.870+0000 7fddc5e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fddc006eae0 0x7fddc015f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:45.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.870+0000 7fddc5e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fddc006ef20 0x7fddc0161870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:45.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.870+0000 7fddc5e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddc0147dd0 0x7fddc0161db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:45.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.870+0000 7fddc5e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fddc00af8e0 con 0x7fddc0147dd0 2024-09-12T02:52:45.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.870+0000 7fddc5e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fddc006fc40 con 0x7fddc006ef20 2024-09-12T02:52:45.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.870+0000 7fddc5e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fddc00afa60 con 0x7fddc006eae0 2024-09-12T02:52:45.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.870+0000 7fddbf400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddc0147dd0 0x7fddc0161db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:45.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.870+0000 7fddbea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fddc006eae0 0x7fddc015f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:45.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.870+0000 7fddbf400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddc0147dd0 0x7fddc0161db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42198/0 (socket says 172.21.15.112:42198) 2024-09-12T02:52:45.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.870+0000 7fddbf400640 1 -- 172.21.15.112:0/247819201 learned_addr learned my addr 172.21.15.112:0/247819201 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:45.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.870+0000 7fddb6000640 1 --2- 172.21.15.112:0/247819201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fddc006ef20 0x7fddc0161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:45.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.870+0000 7fddbf400640 1 -- 172.21.15.112:0/247819201 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fddc006eae0 msgr2=0x7fddc015f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:45.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.870+0000 7fddbf400640 1 --2- 172.21.15.112:0/247819201 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fddc006eae0 0x7fddc015f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:45.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.870+0000 7fddbf400640 1 -- 172.21.15.112:0/247819201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fddc006ef20 msgr2=0x7fddc0161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:45.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.870+0000 7fddbf400640 1 --2- 172.21.15.112:0/247819201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fddc006ef20 0x7fddc0161870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:45.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.870+0000 7fddbf400640 1 -- 172.21.15.112:0/247819201 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc015fcb0 con 0x7fddc0147dd0 2024-09-12T02:52:45.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.871+0000 7fddbf400640 1 --2- 172.21.15.112:0/247819201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddc0147dd0 0x7fddc0161db0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fddb800c730 tx=0x7fddb800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:45.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.871+0000 7fddb7e00640 1 -- 172.21.15.112:0/247819201 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb8016020 con 0x7fddc0147dd0 2024-09-12T02:52:45.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.871+0000 7fddb7e00640 1 -- 172.21.15.112:0/247819201 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddb800aa50 con 0x7fddc0147dd0 2024-09-12T02:52:45.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.871+0000 7fddb7e00640 1 -- 172.21.15.112:0/247819201 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb800ce40 con 0x7fddc0147dd0 2024-09-12T02:52:45.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.871+0000 7fddc5e00640 1 -- 172.21.15.112:0/247819201 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddc013ea50 con 0x7fddc0147dd0 2024-09-12T02:52:45.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.871+0000 7fddc5e00640 1 -- 172.21.15.112:0/247819201 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddc015ff70 con 0x7fddc0147dd0 2024-09-12T02:52:45.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.872+0000 7fddc5e00640 1 -- 172.21.15.112:0/247819201 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddc0072460 con 0x7fddc0147dd0 2024-09-12T02:52:45.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.873+0000 7fddb7e00640 1 -- 172.21.15.112:0/247819201 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fddb8019020 con 0x7fddc0147dd0 2024-09-12T02:52:45.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.874+0000 7fddb7e00640 1 --2- 172.21.15.112:0/247819201 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdd9c06be30 0x7fdd9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:45.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.874+0000 7fddb7e00640 1 -- 172.21.15.112:0/247819201 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 4943+0+0 (secure 0 0 0) 0x7fddb808aa60 con 0x7fddc0147dd0 2024-09-12T02:52:45.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.874+0000 7fddbea00640 1 --2- 172.21.15.112:0/247819201 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdd9c06be30 0x7fdd9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:45.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.875+0000 7fddbea00640 1 --2- 172.21.15.112:0/247819201 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdd9c06be30 0x7fdd9c06e2f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fddb0034000 tx=0x7fddb002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:45.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:45.878+0000 7fddb7e00640 1 -- 172.21.15.112:0/247819201 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fddb8020030 con 0x7fddc0147dd0 2024-09-12T02:52:46.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.115+0000 7fddc5e00640 1 -- 172.21.15.112:0/247819201 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) -- 0x7fddc00b1da0 con 0x7fddc0147dd0 2024-09-12T02:52:46.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.315+0000 7fddb7e00640 1 -- 172.21.15.112:0/247819201 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v512) ==== 131+0+0 (secure 0 0 0) 0x7fddb8059020 con 0x7fddc0147dd0 2024-09-12T02:52:46.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.317+0000 7fddc5e00640 1 -- 172.21.15.112:0/247819201 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdd9c06be30 msgr2=0x7fdd9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:46.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.317+0000 7fddc5e00640 1 --2- 172.21.15.112:0/247819201 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdd9c06be30 0x7fdd9c06e2f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fddb0034000 tx=0x7fddb002e000 comp rx=0 tx=0).stop 2024-09-12T02:52:46.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.317+0000 7fddc5e00640 1 -- 172.21.15.112:0/247819201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddc0147dd0 msgr2=0x7fddc0161db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:46.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.317+0000 7fddc5e00640 1 --2- 172.21.15.112:0/247819201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddc0147dd0 0x7fddc0161db0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fddb800c730 tx=0x7fddb800cbf0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.318+0000 7fddc5e00640 1 -- 172.21.15.112:0/247819201 shutdown_connections 2024-09-12T02:52:46.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.318+0000 7fddc5e00640 1 --2- 172.21.15.112:0/247819201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddc0147dd0 0x7fddc0161db0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.318+0000 7fddc5e00640 1 --2- 172.21.15.112:0/247819201 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdd9c06be30 0x7fdd9c06e2f0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.318+0000 7fddc5e00640 1 --2- 172.21.15.112:0/247819201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fddc006ef20 0x7fddc0161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.318+0000 7fddc5e00640 1 --2- 172.21.15.112:0/247819201 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fddc006eae0 0x7fddc015f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.318+0000 7fddc5e00640 1 -- 172.21.15.112:0/247819201 >> 172.21.15.112:0/247819201 conn(0x7fddc00cd930 msgr2=0x7fddc00afc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:46.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.318+0000 7fddc5e00640 1 -- 172.21.15.112:0/247819201 shutdown_connections 2024-09-12T02:52:46.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.318+0000 7fddc5e00640 1 -- 172.21.15.112:0/247819201 wait complete. 2024-09-12T02:52:46.335 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2024-09-12T02:52:46.335 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) 2024-09-12T02:52:46.335 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:52:46.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.488+0000 7fdee4400640 1 Processor -- start 2024-09-12T02:52:46.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.488+0000 7fdee4400640 1 -- start start 2024-09-12T02:52:46.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.489+0000 7fdee4400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdedc0b3bb0 0x7fdedc0d33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.489+0000 7fdee4400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdedc0d3ac0 con 0x7fdedc1626d0 2024-09-12T02:52:46.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.489+0000 7fdee4400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdedc0d1d00 con 0x7fdedc0b2a50 2024-09-12T02:52:46.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.489+0000 7fdee4400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdedc0d1fe0 con 0x7fdedc0b3bb0 2024-09-12T02:52:46.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.489+0000 7fdee1a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fdedc1626d0 0x7fdedc0d2cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45182/0 (socket says 172.21.15.112:45182) 2024-09-12T02:52:46.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.489+0000 7fdee1a00640 1 -- 172.21.15.112:0/2606761395 learned_addr learned my addr 172.21.15.112:0/2606761395 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:52:46.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.490+0000 7fdee2400640 1 --2- 172.21.15.112:0/2606761395 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdedc0b3bb0 0x7fdedc0d33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:46.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.490+0000 7fdedbe00640 1 -- 172.21.15.112:0/2606761395 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2966509847 0 0) 0x7fdedc0d3ac0 con 0x7fdedc1626d0 2024-09-12T02:52:46.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.490+0000 7fdedbe00640 1 -- 172.21.15.112:0/2606761395 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdec4003520 con 0x7fdedc1626d0 2024-09-12T02:52:46.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.490+0000 7fdedbe00640 1 -- 172.21.15.112:0/2606761395 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 87416284 0 0) 0x7fdedc0d1d00 con 0x7fdedc0b2a50 2024-09-12T02:52:46.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.490+0000 7fdedbe00640 1 -- 172.21.15.112:0/2606761395 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdedc0d3ac0 con 0x7fdedc0b2a50 2024-09-12T02:52:46.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.490+0000 7fdedbe00640 1 -- 172.21.15.112:0/2606761395 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2670730079 0 0) 0x7fdec4003520 con 0x7fdedc1626d0 2024-09-12T02:52:46.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.490+0000 7fdedbe00640 1 -- 172.21.15.112:0/2606761395 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdedc0b3bb0 msgr2=0x7fdedc0d33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:46.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.490+0000 7fdedbe00640 1 --2- 172.21.15.112:0/2606761395 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdedc0b3bb0 0x7fdedc0d33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.490+0000 7fdedbe00640 1 -- 172.21.15.112:0/2606761395 >> v1:172.21.15.137:6789/0 conn(0x7fdedc0b2a50 legacy=0x7fdedc0cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:46.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.490+0000 7fdedbe00640 1 -- 172.21.15.112:0/2606761395 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdedc0d22c0 con 0x7fdedc1626d0 2024-09-12T02:52:46.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.490+0000 7fdedbe00640 1 -- 172.21.15.112:0/2606761395 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7fded0001670 con 0x7fdedc1626d0 2024-09-12T02:52:46.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.490+0000 7fdee2400640 1 --2- 172.21.15.112:0/2606761395 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdedc0b3bb0 0x7fdedc0d33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:52:46.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.490+0000 7fdedbe00640 1 -- 172.21.15.112:0/2606761395 >> v1:172.21.15.112:6789/0 conn(0x7fdedc1626d0 legacy=0x7fdedc0d2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:46.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.490+0000 7fdedbe00640 1 --2- 172.21.15.112:0/2606761395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdec4003b70 0x7fdec4003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.490+0000 7fdedbe00640 1 --2- 172.21.15.112:0/2606761395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec4004800 0x7fdec4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.490+0000 7fdedbe00640 1 --2- 172.21.15.112:0/2606761395 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdedc0b3bb0 0x7fdec40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.490+0000 7fdedbe00640 1 -- 172.21.15.112:0/2606761395 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc0d1fe0 con 0x7fdec4004800 2024-09-12T02:52:46.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.490+0000 7fdedbe00640 1 -- 172.21.15.112:0/2606761395 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdec400b9f0 con 0x7fdec4003b70 2024-09-12T02:52:46.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.490+0000 7fdedbe00640 1 -- 172.21.15.112:0/2606761395 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdec400bbf0 con 0x7fdedc0b3bb0 2024-09-12T02:52:46.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.491+0000 7fdee1000640 1 --2- 172.21.15.112:0/2606761395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec4004800 0x7fdec4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:46.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.491+0000 7fdee1a00640 1 --2- 172.21.15.112:0/2606761395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdec4003b70 0x7fdec4003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:46.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.491+0000 7fdee2400640 1 --2- 172.21.15.112:0/2606761395 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdedc0b3bb0 0x7fdec40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:46.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.491+0000 7fdee1000640 1 -- 172.21.15.112:0/2606761395 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdedc0b3bb0 msgr2=0x7fdec40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:46.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.491+0000 7fdee1000640 1 --2- 172.21.15.112:0/2606761395 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdedc0b3bb0 0x7fdec40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.491+0000 7fdee1000640 1 -- 172.21.15.112:0/2606761395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdec4003b70 msgr2=0x7fdec4003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:46.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.491+0000 7fdee1000640 1 --2- 172.21.15.112:0/2606761395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdec4003b70 0x7fdec4003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.491+0000 7fdee1000640 1 -- 172.21.15.112:0/2606761395 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec4003520 con 0x7fdec4004800 2024-09-12T02:52:46.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.492+0000 7fdee1000640 1 --2- 172.21.15.112:0/2606761395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec4004800 0x7fdec4004c80 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fdec80018a0 tx=0x7fdec4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c19f485a7a201af server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:46.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.492+0000 7fdedbe00640 1 -- 172.21.15.112:0/2606761395 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec80014f0 con 0x7fdec4004800 2024-09-12T02:52:46.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.492+0000 7fdedbe00640 1 -- 172.21.15.112:0/2606761395 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec80052d0 con 0x7fdec4004800 2024-09-12T02:52:46.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.492+0000 7fdedbe00640 1 -- 172.21.15.112:0/2606761395 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec802ac40 con 0x7fdec4004800 2024-09-12T02:52:46.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.493+0000 7fdee4400640 1 -- 172.21.15.112:0/2606761395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec4004800 msgr2=0x7fdec4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:46.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.493+0000 7fdee4400640 1 --2- 172.21.15.112:0/2606761395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec4004800 0x7fdec4004c80 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fdec80018a0 tx=0x7fdec4005830 comp rx=0 tx=0).stop 2024-09-12T02:52:46.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.493+0000 7fdee2400640 1 -- 172.21.15.112:0/2606761395 reap_dead start 2024-09-12T02:52:46.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.493+0000 7fdee4400640 1 -- 172.21.15.112:0/2606761395 shutdown_connections 2024-09-12T02:52:46.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.493+0000 7fdee4400640 1 -- 172.21.15.112:0/2606761395 >> 172.21.15.112:0/2606761395 conn(0x7fdedc0d4db0 msgr2=0x7fdedc0d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:46.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.493+0000 7fdee4400640 1 -- 172.21.15.112:0/2606761395 shutdown_connections 2024-09-12T02:52:46.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.493+0000 7fdee4400640 1 -- 172.21.15.112:0/2606761395 wait complete. 2024-09-12T02:52:46.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.495+0000 7fdee4400640 1 Processor -- start 2024-09-12T02:52:46.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.495+0000 7fdee4400640 1 -- start start 2024-09-12T02:52:46.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.496+0000 7fdee4400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec4004800 0x7fdedc0b9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.496+0000 7fdee4400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdedc0ceab0 0x7fdedc1f5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.496+0000 7fdee4400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdedc1f81f0 0x7fdedc1f8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.496+0000 7fdee4400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc0d3f20 con 0x7fdec4004800 2024-09-12T02:52:46.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.496+0000 7fdee4400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc0d3da0 con 0x7fdedc1f81f0 2024-09-12T02:52:46.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.496+0000 7fdee4400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdedc0d33c0 con 0x7fdedc0ceab0 2024-09-12T02:52:46.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.496+0000 7fdee1a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec4004800 0x7fdedc0b9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:46.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.496+0000 7fdee1a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec4004800 0x7fdedc0b9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42216/0 (socket says 172.21.15.112:42216) 2024-09-12T02:52:46.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.496+0000 7fdee1a00640 1 -- 172.21.15.112:0/3324521807 learned_addr learned my addr 172.21.15.112:0/3324521807 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:46.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.496+0000 7fdee1a00640 1 -- 172.21.15.112:0/3324521807 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdedc0ceab0 msgr2=0x7fdedc1f5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:46.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.496+0000 7fdee1a00640 1 --2- 172.21.15.112:0/3324521807 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdedc0ceab0 0x7fdedc1f5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.496+0000 7fdee1a00640 1 -- 172.21.15.112:0/3324521807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdedc1f81f0 msgr2=0x7fdedc1f8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:46.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.496+0000 7fdee1a00640 1 --2- 172.21.15.112:0/3324521807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdedc1f81f0 0x7fdedc1f8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.496+0000 7fdee1a00640 1 -- 172.21.15.112:0/3324521807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdedc0ba080 con 0x7fdec4004800 2024-09-12T02:52:46.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.497+0000 7fdee1a00640 1 --2- 172.21.15.112:0/3324521807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec4004800 0x7fdedc0b9830 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fded0007370 tx=0x7fded0007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:46.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.497+0000 7fded9600640 1 -- 172.21.15.112:0/3324521807 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded001a070 con 0x7fdec4004800 2024-09-12T02:52:46.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.497+0000 7fded9600640 1 -- 172.21.15.112:0/3324521807 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fded000f860 con 0x7fdec4004800 2024-09-12T02:52:46.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.497+0000 7fded9600640 1 -- 172.21.15.112:0/3324521807 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded000fc50 con 0x7fdec4004800 2024-09-12T02:52:46.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.497+0000 7fdee4400640 1 -- 172.21.15.112:0/3324521807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdedc0cbf20 con 0x7fdec4004800 2024-09-12T02:52:46.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.497+0000 7fdee4400640 1 -- 172.21.15.112:0/3324521807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdedc0cc4e0 con 0x7fdec4004800 2024-09-12T02:52:46.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.498+0000 7fdee4400640 1 -- 172.21.15.112:0/3324521807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdedc0d3780 con 0x7fdec4004800 2024-09-12T02:52:46.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.499+0000 7fded9600640 1 -- 172.21.15.112:0/3324521807 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fded001d360 con 0x7fdec4004800 2024-09-12T02:52:46.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.500+0000 7fded9600640 1 --2- 172.21.15.112:0/3324521807 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdebc06be60 0x7fdebc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.500+0000 7fded9600640 1 -- 172.21.15.112:0/3324521807 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 4943+0+0 (secure 0 0 0) 0x7fded008a420 con 0x7fdec4004800 2024-09-12T02:52:46.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.500+0000 7fdee1000640 1 --2- 172.21.15.112:0/3324521807 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdebc06be60 0x7fdebc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:46.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.501+0000 7fdee1000640 1 --2- 172.21.15.112:0/3324521807 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdebc06be60 0x7fdebc06e320 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fdec8032000 tx=0x7fdec802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:46.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.504+0000 7fded9600640 1 -- 172.21.15.112:0/3324521807 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fded0059030 con 0x7fdec4004800 2024-09-12T02:52:46.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.676+0000 7fdee4400640 1 -- 172.21.15.112:0/3324521807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdedc0d5640 con 0x7fdec4004800 2024-09-12T02:52:46.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.676+0000 7fded9600640 1 -- 172.21.15.112:0/3324521807 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) ==== 74+0+13091 (secure 0 0 0) 0x7fded0058930 con 0x7fdec4004800 2024-09-12T02:52:46.678 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:52:46.678 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":174,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:52:45.309056+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6834/245886809":"2024-09-13T02:52:42.181872+0000","172.21.15.137:6833/245886809":"2024-09-13T02:52:42.181872+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:52:46.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.679+0000 7fdee4400640 1 -- 172.21.15.112:0/3324521807 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdebc06be60 msgr2=0x7fdebc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:46.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.679+0000 7fdee4400640 1 --2- 172.21.15.112:0/3324521807 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdebc06be60 0x7fdebc06e320 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fdec8032000 tx=0x7fdec802e000 comp rx=0 tx=0).stop 2024-09-12T02:52:46.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.679+0000 7fdee4400640 1 -- 172.21.15.112:0/3324521807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec4004800 msgr2=0x7fdedc0b9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:46.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.679+0000 7fdee4400640 1 --2- 172.21.15.112:0/3324521807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec4004800 0x7fdedc0b9830 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fded0007370 tx=0x7fded0007830 comp rx=0 tx=0).stop 2024-09-12T02:52:46.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.679+0000 7fdee4400640 1 -- 172.21.15.112:0/3324521807 shutdown_connections 2024-09-12T02:52:46.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.679+0000 7fdee4400640 1 --2- 172.21.15.112:0/3324521807 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdebc06be60 0x7fdebc06e320 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.679+0000 7fdee4400640 1 --2- 172.21.15.112:0/3324521807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdedc1f81f0 0x7fdedc1f8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.679+0000 7fdee4400640 1 --2- 172.21.15.112:0/3324521807 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdedc0ceab0 0x7fdedc1f5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.679+0000 7fdee4400640 1 --2- 172.21.15.112:0/3324521807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec4004800 0x7fdedc0b9830 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.679+0000 7fdee4400640 1 -- 172.21.15.112:0/3324521807 >> 172.21.15.112:0/3324521807 conn(0x7fdedc0d4db0 msgr2=0x7fdedc06d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:46.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.679+0000 7fdee4400640 1 -- 172.21.15.112:0/3324521807 shutdown_connections 2024-09-12T02:52:46.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.679+0000 7fdee4400640 1 -- 172.21.15.112:0/3324521807 wait complete. 2024-09-12T02:52:46.695 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:41:43.011599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:52:46.695 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T02:52:46.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.849+0000 7fbfda200640 1 Processor -- start 2024-09-12T02:52:46.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.850+0000 7fbfda200640 1 -- start start 2024-09-12T02:52:46.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.851+0000 7fbfda200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbfd415b9d0 0x7fbfd40b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.851+0000 7fbfda200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfd40b54a0 con 0x7fbfd406f600 2024-09-12T02:52:46.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.851+0000 7fbfda200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfd40b3af0 con 0x7fbfd40b45d0 2024-09-12T02:52:46.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.851+0000 7fbfda200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fbfd40b4a60 con 0x7fbfd415b9d0 2024-09-12T02:52:46.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.851+0000 7fbfd3400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbfd415b9d0 0x7fbfd40b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:46.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.851+0000 7fbfd3400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbfd415b9d0 0x7fbfd40b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42228/0 (socket says 172.21.15.112:42228) 2024-09-12T02:52:46.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.851+0000 7fbfd3400640 1 -- 172.21.15.112:0/3476485646 learned_addr learned my addr 172.21.15.112:0/3476485646 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:46.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.851+0000 7fbfd3e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fbfd406f600 0x7fbfd40cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45184/0 (socket says 172.21.15.112:45184) 2024-09-12T02:52:46.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.851+0000 7fbfd3400640 1 -- 172.21.15.112:0/3476485646 >> v1:172.21.15.137:6789/0 conn(0x7fbfd40b45d0 legacy=0x7fbfd406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:46.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.852+0000 7fbfd3400640 1 -- 172.21.15.112:0/3476485646 >> v1:172.21.15.112:6789/0 conn(0x7fbfd406f600 legacy=0x7fbfd40cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:46.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.852+0000 7fbfd3400640 1 -- 172.21.15.112:0/3476485646 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd40b3dd0 con 0x7fbfd415b9d0 2024-09-12T02:52:46.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.852+0000 7fbfd2a00640 1 -- 172.21.15.112:0/3476485646 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 639091531 0 0) 0x7fbfd40b54a0 con 0x7fbfd406f600 2024-09-12T02:52:46.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.853+0000 7fbfd3400640 1 --2- 172.21.15.112:0/3476485646 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfd415b9d0 0x7fbfd40b4ec0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fbfc400bb10 tx=0x7fbfc402c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c5193b32e42aa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:46.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.853+0000 7fbfd2a00640 1 -- 172.21.15.112:0/3476485646 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4036020 con 0x7fbfd415b9d0 2024-09-12T02:52:46.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.853+0000 7fbfd2a00640 1 -- 172.21.15.112:0/3476485646 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfc4032640 con 0x7fbfd415b9d0 2024-09-12T02:52:46.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.853+0000 7fbfd2a00640 1 -- 172.21.15.112:0/3476485646 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4032a10 con 0x7fbfd415b9d0 2024-09-12T02:52:46.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.853+0000 7fbfda200640 1 -- 172.21.15.112:0/3476485646 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfd415b9d0 msgr2=0x7fbfd40b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:46.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.853+0000 7fbfda200640 1 --2- 172.21.15.112:0/3476485646 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfd415b9d0 0x7fbfd40b4ec0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fbfc400bb10 tx=0x7fbfc402c940 comp rx=0 tx=0).stop 2024-09-12T02:52:46.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.853+0000 7fbfda200640 1 -- 172.21.15.112:0/3476485646 shutdown_connections 2024-09-12T02:52:46.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.853+0000 7fbfda200640 1 --2- 172.21.15.112:0/3476485646 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfd415b9d0 0x7fbfd40b4ec0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.853+0000 7fbfda200640 1 -- 172.21.15.112:0/3476485646 >> 172.21.15.112:0/3476485646 conn(0x7fbfd406bbd0 msgr2=0x7fbfd406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:46.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.853+0000 7fbfda200640 1 -- 172.21.15.112:0/3476485646 shutdown_connections 2024-09-12T02:52:46.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.853+0000 7fbfda200640 1 -- 172.21.15.112:0/3476485646 wait complete. 2024-09-12T02:52:46.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.855+0000 7fbfda200640 1 Processor -- start 2024-09-12T02:52:46.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.855+0000 7fbfda200640 1 -- start start 2024-09-12T02:52:46.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.856+0000 7fbfda200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfd406f600 0x7fbfd41ead20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.856+0000 7fbfda200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfd40b45d0 0x7fbfd415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.856+0000 7fbfda200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbfd415b9d0 0x7fbfd415c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.856+0000 7fbfda200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd415bf30 con 0x7fbfd40b45d0 2024-09-12T02:52:46.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.856+0000 7fbfda200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd415bdb0 con 0x7fbfd406f600 2024-09-12T02:52:46.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.856+0000 7fbfda200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbfd40728c0 con 0x7fbfd415b9d0 2024-09-12T02:52:46.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.856+0000 7fbfcaa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfd40b45d0 0x7fbfd415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:46.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.856+0000 7fbfcaa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfd40b45d0 0x7fbfd415c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42238/0 (socket says 172.21.15.112:42238) 2024-09-12T02:52:46.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.856+0000 7fbfcaa00640 1 -- 172.21.15.112:0/2354039379 learned_addr learned my addr 172.21.15.112:0/2354039379 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:46.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.856+0000 7fbfd3400640 1 --2- 172.21.15.112:0/2354039379 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfd406f600 0x7fbfd41ead20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:46.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.857+0000 7fbfd3e00640 1 --2- 172.21.15.112:0/2354039379 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbfd415b9d0 0x7fbfd415c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:46.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.857+0000 7fbfcaa00640 1 -- 172.21.15.112:0/2354039379 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbfd415b9d0 msgr2=0x7fbfd415c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:46.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.857+0000 7fbfcaa00640 1 --2- 172.21.15.112:0/2354039379 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbfd415b9d0 0x7fbfd415c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.857+0000 7fbfcaa00640 1 -- 172.21.15.112:0/2354039379 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfd406f600 msgr2=0x7fbfd41ead20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:46.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.857+0000 7fbfcaa00640 1 --2- 172.21.15.112:0/2354039379 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfd406f600 0x7fbfd41ead20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:46.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.857+0000 7fbfcaa00640 1 -- 172.21.15.112:0/2354039379 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd41574b0 con 0x7fbfd40b45d0 2024-09-12T02:52:46.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.857+0000 7fbfd3e00640 1 --2- 172.21.15.112:0/2354039379 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbfd415b9d0 0x7fbfd415c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:52:46.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.857+0000 7fbfcaa00640 1 --2- 172.21.15.112:0/2354039379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfd40b45d0 0x7fbfd415c0b0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00c450 tx=0x7fbfbc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:46.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.857+0000 7fbfcbe00640 1 -- 172.21.15.112:0/2354039379 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc0052d0 con 0x7fbfd40b45d0 2024-09-12T02:52:46.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.857+0000 7fbfcbe00640 1 -- 172.21.15.112:0/2354039379 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfbc005490 con 0x7fbfd40b45d0 2024-09-12T02:52:46.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.857+0000 7fbfcbe00640 1 -- 172.21.15.112:0/2354039379 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc003880 con 0x7fbfd40b45d0 2024-09-12T02:52:46.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.857+0000 7fbfda200640 1 -- 172.21.15.112:0/2354039379 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfd4157790 con 0x7fbfd40b45d0 2024-09-12T02:52:46.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.858+0000 7fbfda200640 1 -- 172.21.15.112:0/2354039379 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfd4157d50 con 0x7fbfd40b45d0 2024-09-12T02:52:46.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.859+0000 7fbfda200640 1 -- 172.21.15.112:0/2354039379 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfd4068a30 con 0x7fbfd40b45d0 2024-09-12T02:52:46.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.859+0000 7fbfcbe00640 1 -- 172.21.15.112:0/2354039379 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbfbc003a20 con 0x7fbfd40b45d0 2024-09-12T02:52:46.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.860+0000 7fbfcbe00640 1 --2- 172.21.15.112:0/2354039379 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbfb006be30 0x7fbfb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:46.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.860+0000 7fbfcbe00640 1 -- 172.21.15.112:0/2354039379 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 4943+0+0 (secure 0 0 0) 0x7fbfbc08a700 con 0x7fbfd40b45d0 2024-09-12T02:52:46.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.860+0000 7fbfd3400640 1 --2- 172.21.15.112:0/2354039379 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbfb006be30 0x7fbfb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:46.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.861+0000 7fbfd3400640 1 --2- 172.21.15.112:0/2354039379 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbfb006be30 0x7fbfb006e2f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4037000 tx=0x7fbfc4032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:46.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:46.865+0000 7fbfcbe00640 1 -- 172.21.15.112:0/2354039379 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbfbc0593a0 con 0x7fbfd40b45d0 2024-09-12T02:52:47.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.037+0000 7fbfda200640 1 -- 172.21.15.112:0/2354039379 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbfd4072c50 con 0x7fbfd40b45d0 2024-09-12T02:52:47.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.037+0000 7fbfcbe00640 1 -- 172.21.15.112:0/2354039379 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v174) ==== 93+0+10 (secure 0 0 0) 0x7fbfbc058ca0 con 0x7fbfd40b45d0 2024-09-12T02:52:47.038 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2024-09-12T02:52:47.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.039+0000 7fbfda200640 1 -- 172.21.15.112:0/2354039379 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbfb006be30 msgr2=0x7fbfb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:47.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.039+0000 7fbfda200640 1 --2- 172.21.15.112:0/2354039379 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbfb006be30 0x7fbfb006e2f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4037000 tx=0x7fbfc4032000 comp rx=0 tx=0).stop 2024-09-12T02:52:47.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.039+0000 7fbfda200640 1 -- 172.21.15.112:0/2354039379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfd40b45d0 msgr2=0x7fbfd415c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:47.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.039+0000 7fbfda200640 1 --2- 172.21.15.112:0/2354039379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfd40b45d0 0x7fbfd415c0b0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00c450 tx=0x7fbfbc00c910 comp rx=0 tx=0).stop 2024-09-12T02:52:47.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.039+0000 7fbfda200640 1 -- 172.21.15.112:0/2354039379 shutdown_connections 2024-09-12T02:52:47.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.039+0000 7fbfda200640 1 --2- 172.21.15.112:0/2354039379 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbfd415b9d0 0x7fbfd415c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:47.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.039+0000 7fbfda200640 1 --2- 172.21.15.112:0/2354039379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfd40b45d0 0x7fbfd415c0b0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:47.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.039+0000 7fbfda200640 1 --2- 172.21.15.112:0/2354039379 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbfb006be30 0x7fbfb006e2f0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:47.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.039+0000 7fbfda200640 1 --2- 172.21.15.112:0/2354039379 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfd406f600 0x7fbfd41ead20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:47.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.039+0000 7fbfda200640 1 -- 172.21.15.112:0/2354039379 >> 172.21.15.112:0/2354039379 conn(0x7fbfd406bbd0 msgr2=0x7fbfd4156800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:47.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.039+0000 7fbfda200640 1 -- 172.21.15.112:0/2354039379 shutdown_connections 2024-09-12T02:52:47.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.039+0000 7fbfda200640 1 -- 172.21.15.112:0/2354039379 wait complete. 2024-09-12T02:52:47.056 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2024-09-12T02:52:47.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.208+0000 7f4c13400640 1 Processor -- start 2024-09-12T02:52:47.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.208+0000 7f4c13400640 1 -- start start 2024-09-12T02:52:47.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.209+0000 7f4c13400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c0c0b3bb0 0x7f4c0c0d33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:47.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.209+0000 7f4c13400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c0c0d3ac0 con 0x7f4c0c1626d0 2024-09-12T02:52:47.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.209+0000 7f4c13400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c0c0d1d00 con 0x7f4c0c0b2a50 2024-09-12T02:52:47.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.209+0000 7f4c13400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4c0c0d1fe0 con 0x7f4c0c0b3bb0 2024-09-12T02:52:47.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.209+0000 7f4c10a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f4c0c1626d0 0x7f4c0c0d2cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45186/0 (socket says 172.21.15.112:45186) 2024-09-12T02:52:47.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.209+0000 7f4c10a00640 1 -- 172.21.15.112:0/3956140736 learned_addr learned my addr 172.21.15.112:0/3956140736 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:52:47.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.210+0000 7f4c11400640 1 --2- 172.21.15.112:0/3956140736 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c0c0b3bb0 0x7f4c0c0d33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:47.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.210+0000 7f4c0b400640 1 -- 172.21.15.112:0/3956140736 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3642602620 0 0) 0x7f4c0c0d3ac0 con 0x7f4c0c1626d0 2024-09-12T02:52:47.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.210+0000 7f4c0b400640 1 -- 172.21.15.112:0/3956140736 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bf4003520 con 0x7f4c0c1626d0 2024-09-12T02:52:47.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.210+0000 7f4c0b400640 1 -- 172.21.15.112:0/3956140736 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3024797081 0 0) 0x7f4c0c0d1d00 con 0x7f4c0c0b2a50 2024-09-12T02:52:47.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.210+0000 7f4c0b400640 1 -- 172.21.15.112:0/3956140736 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c0c0d3ac0 con 0x7f4c0c0b2a50 2024-09-12T02:52:47.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.210+0000 7f4c0b400640 1 -- 172.21.15.112:0/3956140736 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1883596390 0 0) 0x7f4bf4003520 con 0x7f4c0c1626d0 2024-09-12T02:52:47.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.210+0000 7f4c0b400640 1 -- 172.21.15.112:0/3956140736 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c0c0b3bb0 msgr2=0x7f4c0c0d33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:47.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.210+0000 7f4c0b400640 1 --2- 172.21.15.112:0/3956140736 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c0c0b3bb0 0x7f4c0c0d33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:47.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.210+0000 7f4c0b400640 1 -- 172.21.15.112:0/3956140736 >> v1:172.21.15.137:6789/0 conn(0x7f4c0c0b2a50 legacy=0x7f4c0c0cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:47.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.210+0000 7f4c0b400640 1 -- 172.21.15.112:0/3956140736 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c0c0d22c0 con 0x7f4c0c1626d0 2024-09-12T02:52:47.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.210+0000 7f4c0b400640 1 -- 172.21.15.112:0/3956140736 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f4c00001670 con 0x7f4c0c1626d0 2024-09-12T02:52:47.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.210+0000 7f4c0b400640 1 -- 172.21.15.112:0/3956140736 >> v1:172.21.15.112:6789/0 conn(0x7f4c0c1626d0 legacy=0x7f4c0c0d2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:47.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.210+0000 7f4c0b400640 1 --2- 172.21.15.112:0/3956140736 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c0c0b3bb0 0x7f4bf4003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:47.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.210+0000 7f4c0b400640 1 --2- 172.21.15.112:0/3956140736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bf4004120 0x7f4bf4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:47.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.210+0000 7f4c0b400640 1 --2- 172.21.15.112:0/3956140736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bf4004d40 0x7f4bf40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:47.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.210+0000 7f4c0b400640 1 -- 172.21.15.112:0/3956140736 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0c0d1fe0 con 0x7f4bf4004120 2024-09-12T02:52:47.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.210+0000 7f4c0b400640 1 -- 172.21.15.112:0/3956140736 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf400bb00 con 0x7f4bf4004d40 2024-09-12T02:52:47.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.210+0000 7f4c0b400640 1 -- 172.21.15.112:0/3956140736 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4bf400bd00 con 0x7f4c0c0b3bb0 2024-09-12T02:52:47.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.210+0000 7f4c0be00640 1 --2- 172.21.15.112:0/3956140736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bf4004120 0x7f4bf4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:47.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.211+0000 7f4c10a00640 1 --2- 172.21.15.112:0/3956140736 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c0c0b3bb0 0x7f4bf4003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:47.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.211+0000 7f4c11400640 1 --2- 172.21.15.112:0/3956140736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bf4004d40 0x7f4bf40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:47.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.211+0000 7f4c0be00640 1 -- 172.21.15.112:0/3956140736 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c0c0b3bb0 msgr2=0x7f4bf4003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:47.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.211+0000 7f4c0be00640 1 --2- 172.21.15.112:0/3956140736 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4c0c0b3bb0 0x7f4bf4003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:47.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.211+0000 7f4c0be00640 1 -- 172.21.15.112:0/3956140736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bf4004d40 msgr2=0x7f4bf40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:47.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.211+0000 7f4c0be00640 1 --2- 172.21.15.112:0/3956140736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bf4004d40 0x7f4bf40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:47.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.211+0000 7f4c0be00640 1 -- 172.21.15.112:0/3956140736 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bf4003520 con 0x7f4bf4004120 2024-09-12T02:52:47.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.212+0000 7f4c0be00640 1 --2- 172.21.15.112:0/3956140736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bf4004120 0x7f4bf4004800 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f4bf80018d0 tx=0x7f4bf4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f4660a10ddffc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:47.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.212+0000 7f4c0b400640 1 -- 172.21.15.112:0/3956140736 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf80014f0 con 0x7f4bf4004120 2024-09-12T02:52:47.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.212+0000 7f4c0b400640 1 -- 172.21.15.112:0/3956140736 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf80052d0 con 0x7f4bf4004120 2024-09-12T02:52:47.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.212+0000 7f4c0b400640 1 -- 172.21.15.112:0/3956140736 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf802abe0 con 0x7f4bf4004120 2024-09-12T02:52:47.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.212+0000 7f4c13400640 1 -- 172.21.15.112:0/3956140736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bf4004120 msgr2=0x7f4bf4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:47.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.213+0000 7f4c13400640 1 --2- 172.21.15.112:0/3956140736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bf4004120 0x7f4bf4004800 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f4bf80018d0 tx=0x7f4bf4005830 comp rx=0 tx=0).stop 2024-09-12T02:52:47.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.213+0000 7f4c11400640 1 -- 172.21.15.112:0/3956140736 reap_dead start 2024-09-12T02:52:47.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.213+0000 7f4c13400640 1 -- 172.21.15.112:0/3956140736 shutdown_connections 2024-09-12T02:52:47.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.213+0000 7f4c13400640 1 -- 172.21.15.112:0/3956140736 >> 172.21.15.112:0/3956140736 conn(0x7f4c0c0d4db0 msgr2=0x7f4c0c0d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:47.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.213+0000 7f4c13400640 1 -- 172.21.15.112:0/3956140736 shutdown_connections 2024-09-12T02:52:47.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.213+0000 7f4c13400640 1 -- 172.21.15.112:0/3956140736 wait complete. 2024-09-12T02:52:47.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.214+0000 7f4c13400640 1 Processor -- start 2024-09-12T02:52:47.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.214+0000 7f4c13400640 1 -- start start 2024-09-12T02:52:47.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.215+0000 7f4c13400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4bf4004120 0x7f4c0c156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:47.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.215+0000 7f4c13400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c0c0ba110 0x7f4c0c0b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:47.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.215+0000 7f4c13400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c0c15c790 0x7f4c0c0b6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:47.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.215+0000 7f4c13400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0c0d3f20 con 0x7f4c0c0ba110 2024-09-12T02:52:47.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.215+0000 7f4c13400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0c0d3da0 con 0x7f4c0c15c790 2024-09-12T02:52:47.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.215+0000 7f4c13400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4c0c0d33c0 con 0x7f4bf4004120 2024-09-12T02:52:47.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.216+0000 7f4c0be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c0c0ba110 0x7f4c0c0b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:47.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.216+0000 7f4c0be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c0c0ba110 0x7f4c0c0b6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42250/0 (socket says 172.21.15.112:42250) 2024-09-12T02:52:47.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.216+0000 7f4c0be00640 1 -- 172.21.15.112:0/445302053 learned_addr learned my addr 172.21.15.112:0/445302053 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:47.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.216+0000 7f4c11400640 1 --2- 172.21.15.112:0/445302053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c0c15c790 0x7f4c0c0b6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:47.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.216+0000 7f4c10a00640 1 --2- 172.21.15.112:0/445302053 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4bf4004120 0x7f4c0c156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:47.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.216+0000 7f4c0be00640 1 -- 172.21.15.112:0/445302053 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4bf4004120 msgr2=0x7f4c0c156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:47.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.216+0000 7f4c0be00640 1 --2- 172.21.15.112:0/445302053 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4bf4004120 0x7f4c0c156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:47.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.216+0000 7f4c0be00640 1 -- 172.21.15.112:0/445302053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c0c15c790 msgr2=0x7f4c0c0b6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:47.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.216+0000 7f4c0be00640 1 --2- 172.21.15.112:0/445302053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c0c15c790 0x7f4c0c0b6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:47.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.216+0000 7f4c0be00640 1 -- 172.21.15.112:0/445302053 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c0c156ac0 con 0x7f4c0c0ba110 2024-09-12T02:52:47.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.216+0000 7f4c10a00640 1 --2- 172.21.15.112:0/445302053 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4bf4004120 0x7f4c0c156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:52:47.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.216+0000 7f4c0be00640 1 --2- 172.21.15.112:0/445302053 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c0c0ba110 0x7f4c0c0b6a90 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8000c00 tx=0x7f4bf80012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:47.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.217+0000 7f4c08c00640 1 -- 172.21.15.112:0/445302053 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8037040 con 0x7f4c0c0ba110 2024-09-12T02:52:47.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.217+0000 7f4c08c00640 1 -- 172.21.15.112:0/445302053 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf802be50 con 0x7f4c0c0ba110 2024-09-12T02:52:47.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.217+0000 7f4c08c00640 1 -- 172.21.15.112:0/445302053 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf80014f0 con 0x7f4c0c0ba110 2024-09-12T02:52:47.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.217+0000 7f4c13400640 1 -- 172.21.15.112:0/445302053 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c0c0b4630 con 0x7f4c0c0ba110 2024-09-12T02:52:47.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.217+0000 7f4c13400640 1 -- 172.21.15.112:0/445302053 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c0c0cbfb0 con 0x7f4c0c0ba110 2024-09-12T02:52:47.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.218+0000 7f4c13400640 1 -- 172.21.15.112:0/445302053 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c0c0d3750 con 0x7f4c0c0ba110 2024-09-12T02:52:47.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.219+0000 7f4c08c00640 1 -- 172.21.15.112:0/445302053 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4bf8044020 con 0x7f4c0c0ba110 2024-09-12T02:52:47.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.219+0000 7f4c08c00640 1 --2- 172.21.15.112:0/445302053 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4bec06be30 0x7f4bec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:47.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.220+0000 7f4c08c00640 1 -- 172.21.15.112:0/445302053 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 4943+0+0 (secure 0 0 0) 0x7f4bf80aa8e0 con 0x7f4c0c0ba110 2024-09-12T02:52:47.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.220+0000 7f4c10a00640 1 --2- 172.21.15.112:0/445302053 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4bec06be30 0x7f4bec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:47.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.220+0000 7f4c10a00640 1 --2- 172.21.15.112:0/445302053 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4bec06be30 0x7f4bec06e2f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c0d2e20 tx=0x7f4c00009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:47.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.224+0000 7f4c08c00640 1 -- 172.21.15.112:0/445302053 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4c0c156ac0 con 0x7f4c0c0ba110 2024-09-12T02:52:47.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:47.463+0000 7f4c13400640 1 -- 172.21.15.112:0/445302053 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) -- 0x7f4c0c0d5570 con 0x7f4c0c0ba110 2024-09-12T02:52:48.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.322+0000 7f4c08c00640 1 -- 172.21.15.112:0/445302053 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v514) ==== 138+0+0 (secure 0 0 0) 0x7f4bf80796b0 con 0x7f4c0c0ba110 2024-09-12T02:52:48.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.325+0000 7f4c13400640 1 -- 172.21.15.112:0/445302053 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4bec06be30 msgr2=0x7f4bec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:48.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.325+0000 7f4c13400640 1 --2- 172.21.15.112:0/445302053 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4bec06be30 0x7f4bec06e2f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c0d2e20 tx=0x7f4c00009040 comp rx=0 tx=0).stop 2024-09-12T02:52:48.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.325+0000 7f4c13400640 1 -- 172.21.15.112:0/445302053 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c0c0ba110 msgr2=0x7f4c0c0b6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:48.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.325+0000 7f4c13400640 1 --2- 172.21.15.112:0/445302053 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c0c0ba110 0x7f4c0c0b6a90 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8000c00 tx=0x7f4bf80012d0 comp rx=0 tx=0).stop 2024-09-12T02:52:48.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.325+0000 7f4c13400640 1 -- 172.21.15.112:0/445302053 shutdown_connections 2024-09-12T02:52:48.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.325+0000 7f4c13400640 1 --2- 172.21.15.112:0/445302053 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4bec06be30 0x7f4bec06e2f0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:48.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.325+0000 7f4c13400640 1 --2- 172.21.15.112:0/445302053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c0c15c790 0x7f4c0c0b6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:48.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.325+0000 7f4c13400640 1 --2- 172.21.15.112:0/445302053 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c0c0ba110 0x7f4c0c0b6a90 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:48.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.325+0000 7f4c13400640 1 --2- 172.21.15.112:0/445302053 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4bf4004120 0x7f4c0c156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:48.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.325+0000 7f4c13400640 1 -- 172.21.15.112:0/445302053 >> 172.21.15.112:0/445302053 conn(0x7f4c0c0d4db0 msgr2=0x7f4c0c0cfa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:48.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.325+0000 7f4c13400640 1 -- 172.21.15.112:0/445302053 shutdown_connections 2024-09-12T02:52:48.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.325+0000 7f4c13400640 1 -- 172.21.15.112:0/445302053 wait complete. 2024-09-12T02:52:48.343 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T02:52:48.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.498+0000 7f326e800640 1 Processor -- start 2024-09-12T02:52:48.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.498+0000 7f326e800640 1 -- start start 2024-09-12T02:52:48.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.499+0000 7f326e800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f32680b3e00 0x7f32680d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:48.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.499+0000 7f326e800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32680b1d70 0x7f32680b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:48.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.499+0000 7f326e800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32680d2fb0 con 0x7f32680d1710 2024-09-12T02:52:48.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.499+0000 7f326e800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f32680d3cb0 con 0x7f32680b3e00 2024-09-12T02:52:48.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.499+0000 7f326e800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f32680d0b60 con 0x7f32680b1d70 2024-09-12T02:52:48.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.499+0000 7f326ca00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f32680b3e00 0x7f32680d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:48.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.499+0000 7f326ca00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f32680b3e00 0x7f32680d28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42256/0 (socket says 172.21.15.112:42256) 2024-09-12T02:52:48.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.499+0000 7f326d400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f32680d1710 0x7f32680d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45190/0 (socket says 172.21.15.112:45190) 2024-09-12T02:52:48.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.499+0000 7f326ca00640 1 -- 172.21.15.112:0/2684825188 learned_addr learned my addr 172.21.15.112:0/2684825188 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:48.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.500+0000 7f326ca00640 1 -- 172.21.15.112:0/2684825188 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32680b1d70 msgr2=0x7f32680b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:48.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.500+0000 7f326ca00640 1 --2- 172.21.15.112:0/2684825188 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32680b1d70 0x7f32680b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:48.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.500+0000 7f326ca00640 1 -- 172.21.15.112:0/2684825188 >> v1:172.21.15.112:6789/0 conn(0x7f32680d1710 legacy=0x7f32680d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:48.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.500+0000 7f326ca00640 1 -- 172.21.15.112:0/2684825188 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32680d3410 con 0x7f32680b3e00 2024-09-12T02:52:48.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.501+0000 7f326ca00640 1 --2- 172.21.15.112:0/2684825188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32680b3e00 0x7f32680d28d0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f3254009870 tx=0x7f325402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a492765a84e93ba9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:48.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.501+0000 7f3267e00640 1 -- 172.21.15.112:0/2684825188 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3254037070 con 0x7f32680b3e00 2024-09-12T02:52:48.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.501+0000 7f3267e00640 1 -- 172.21.15.112:0/2684825188 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3254032440 con 0x7f32680b3e00 2024-09-12T02:52:48.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.501+0000 7f3267e00640 1 -- 172.21.15.112:0/2684825188 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3254032810 con 0x7f32680b3e00 2024-09-12T02:52:48.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.502+0000 7f326e800640 1 -- 172.21.15.112:0/2684825188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32680b3e00 msgr2=0x7f32680d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:48.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.502+0000 7f326e800640 1 --2- 172.21.15.112:0/2684825188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32680b3e00 0x7f32680d28d0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f3254009870 tx=0x7f325402a250 comp rx=0 tx=0).stop 2024-09-12T02:52:48.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.502+0000 7f326e800640 1 -- 172.21.15.112:0/2684825188 shutdown_connections 2024-09-12T02:52:48.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.502+0000 7f326e800640 1 --2- 172.21.15.112:0/2684825188 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32680b1d70 0x7f32680b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:48.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.502+0000 7f326e800640 1 --2- 172.21.15.112:0/2684825188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32680b3e00 0x7f32680d28d0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:48.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.502+0000 7f326e800640 1 -- 172.21.15.112:0/2684825188 >> 172.21.15.112:0/2684825188 conn(0x7f326809e030 msgr2=0x7f32680d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:48.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.502+0000 7f326e800640 1 -- 172.21.15.112:0/2684825188 shutdown_connections 2024-09-12T02:52:48.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.502+0000 7f326e800640 1 -- 172.21.15.112:0/2684825188 wait complete. 2024-09-12T02:52:48.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.503+0000 7f326e800640 1 Processor -- start 2024-09-12T02:52:48.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.504+0000 7f326e800640 1 -- start start 2024-09-12T02:52:48.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.504+0000 7f326e800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32680b1d70 0x7f32681565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:48.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.504+0000 7f326e800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32680b3e00 0x7f32680cda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:48.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.504+0000 7f326e800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32680d1710 0x7f32680cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:48.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.504+0000 7f326e800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f326815f110 con 0x7f32680d1710 2024-09-12T02:52:48.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.504+0000 7f326e800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f32680d39d0 con 0x7f32680b3e00 2024-09-12T02:52:48.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.504+0000 7f326e800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f326815f290 con 0x7f32680b1d70 2024-09-12T02:52:48.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.505+0000 7f326de00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32680d1710 0x7f32680cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:48.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.505+0000 7f326de00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32680d1710 0x7f32680cdf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42270/0 (socket says 172.21.15.112:42270) 2024-09-12T02:52:48.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.505+0000 7f326de00640 1 -- 172.21.15.112:0/4089715355 learned_addr learned my addr 172.21.15.112:0/4089715355 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:48.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.505+0000 7f326d400640 1 --2- 172.21.15.112:0/4089715355 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32680b1d70 0x7f32681565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:48.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.505+0000 7f326ca00640 1 --2- 172.21.15.112:0/4089715355 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32680b3e00 0x7f32680cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:48.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.505+0000 7f326de00640 1 -- 172.21.15.112:0/4089715355 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32680b1d70 msgr2=0x7f32681565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:48.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.505+0000 7f326de00640 1 --2- 172.21.15.112:0/4089715355 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32680b1d70 0x7f32681565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:48.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.505+0000 7f326de00640 1 -- 172.21.15.112:0/4089715355 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32680b3e00 msgr2=0x7f32680cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:48.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.505+0000 7f326de00640 1 --2- 172.21.15.112:0/4089715355 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32680b3e00 0x7f32680cda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:48.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.505+0000 7f326de00640 1 -- 172.21.15.112:0/4089715355 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3268156b10 con 0x7f32680d1710 2024-09-12T02:52:48.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.505+0000 7f326de00640 1 --2- 172.21.15.112:0/4089715355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32680d1710 0x7f32680cdf40 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f326000b9a0 tx=0x7f326000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:48.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.506+0000 7f3265600640 1 -- 172.21.15.112:0/4089715355 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3260019070 con 0x7f32680d1710 2024-09-12T02:52:48.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.506+0000 7f3265600640 1 -- 172.21.15.112:0/4089715355 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f326000cbc0 con 0x7f32680d1710 2024-09-12T02:52:48.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.506+0000 7f3265600640 1 -- 172.21.15.112:0/4089715355 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3260014440 con 0x7f32680d1710 2024-09-12T02:52:48.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.506+0000 7f326e800640 1 -- 172.21.15.112:0/4089715355 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32681600c0 con 0x7f32680d1710 2024-09-12T02:52:48.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.506+0000 7f326e800640 1 -- 172.21.15.112:0/4089715355 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3268160680 con 0x7f32680d1710 2024-09-12T02:52:48.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.507+0000 7f326e800640 1 -- 172.21.15.112:0/4089715355 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32680d28d0 con 0x7f32680d1710 2024-09-12T02:52:48.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.508+0000 7f3265600640 1 -- 172.21.15.112:0/4089715355 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f326001c070 con 0x7f32680d1710 2024-09-12T02:52:48.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.509+0000 7f3265600640 1 --2- 172.21.15.112:0/4089715355 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f324806be30 0x7f324806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:48.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.509+0000 7f3265600640 1 -- 172.21.15.112:0/4089715355 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 4943+0+0 (secure 0 0 0) 0x7f326008a950 con 0x7f32680d1710 2024-09-12T02:52:48.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.509+0000 7f326d400640 1 --2- 172.21.15.112:0/4089715355 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f324806be30 0x7f324806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:48.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.510+0000 7f326d400640 1 --2- 172.21.15.112:0/4089715355 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f324806be30 0x7f324806e2f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f325c007fd0 tx=0x7f325c007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:48.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.513+0000 7f3265600640 1 -- 172.21.15.112:0/4089715355 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3260058e80 con 0x7f32680d1710 2024-09-12T02:52:48.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.686+0000 7f326e800640 1 -- 172.21.15.112:0/4089715355 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f3268162600 con 0x7f32680d1710 2024-09-12T02:52:48.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.690+0000 7f3265600640 1 -- 172.21.15.112:0/4089715355 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7f326005d180 con 0x7f32680d1710 2024-09-12T02:52:48.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.693+0000 7f326e800640 1 -- 172.21.15.112:0/4089715355 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f324806be30 msgr2=0x7f324806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:48.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.693+0000 7f326e800640 1 --2- 172.21.15.112:0/4089715355 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f324806be30 0x7f324806e2f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f325c007fd0 tx=0x7f325c007e80 comp rx=0 tx=0).stop 2024-09-12T02:52:48.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.693+0000 7f326e800640 1 -- 172.21.15.112:0/4089715355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32680d1710 msgr2=0x7f32680cdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:48.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.693+0000 7f326e800640 1 --2- 172.21.15.112:0/4089715355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32680d1710 0x7f32680cdf40 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f326000b9a0 tx=0x7f326000be60 comp rx=0 tx=0).stop 2024-09-12T02:52:48.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.693+0000 7f326e800640 1 -- 172.21.15.112:0/4089715355 shutdown_connections 2024-09-12T02:52:48.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.693+0000 7f326e800640 1 --2- 172.21.15.112:0/4089715355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32680d1710 0x7f32680cdf40 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:48.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.693+0000 7f326e800640 1 --2- 172.21.15.112:0/4089715355 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f324806be30 0x7f324806e2f0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:48.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.693+0000 7f326e800640 1 --2- 172.21.15.112:0/4089715355 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32680b3e00 0x7f32680cda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:48.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.693+0000 7f326e800640 1 --2- 172.21.15.112:0/4089715355 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32680b1d70 0x7f32681565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:48.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.693+0000 7f326e800640 1 -- 172.21.15.112:0/4089715355 >> 172.21.15.112:0/4089715355 conn(0x7f326809e030 msgr2=0x7f3268158360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:48.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.693+0000 7f326e800640 1 -- 172.21.15.112:0/4089715355 shutdown_connections 2024-09-12T02:52:48.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:48.693+0000 7f326e800640 1 -- 172.21.15.112:0/4089715355 wait complete. 2024-09-12T02:52:48.710 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:52:48.711 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:52:48.792 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:52:48.903 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:52:48.904 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:52:48.904 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:52:48.940 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:52:48.940 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:52:48.940 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:52:48.981 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:52:48.981 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:52:48.981 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:52:49.015 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:52:49.016 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:52:49.016 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:52:49.057 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:52:49.057 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T02:52:49.058 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:52:49.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.209+0000 7fb827200640 1 Processor -- start 2024-09-12T02:52:49.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.209+0000 7fb827200640 1 -- start start 2024-09-12T02:52:49.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.210+0000 7fb827200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8281620f0 0x7fb8280b5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:49.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.210+0000 7fb827200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb8280afd70 0x7fb82806eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:49.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.210+0000 7fb827200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8280b4f80 con 0x7fb8280d0820 2024-09-12T02:52:49.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.210+0000 7fb827200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb8281624d0 con 0x7fb8280afd70 2024-09-12T02:52:49.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.210+0000 7fb827200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb8280d0de0 con 0x7fb8281620f0 2024-09-12T02:52:49.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.211+0000 7fb825400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb8280afd70 0x7fb82806eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:49.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.211+0000 7fb825e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8281620f0 0x7fb8280b5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:49.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.211+0000 7fb826800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fb8280d0820 0x7fb8280ae8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.112:60600/0 (socket says 172.21.15.112:60600) 2024-09-12T02:52:49.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.211+0000 7fb825400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb8280afd70 0x7fb82806eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:43842/0 (socket says 172.21.15.112:43842) 2024-09-12T02:52:49.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.211+0000 7fb826800640 1 -- 172.21.15.112:0/2461838907 learned_addr learned my addr 172.21.15.112:0/2461838907 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:52:49.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.211+0000 7fb825400640 1 -- 172.21.15.112:0/2461838907 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8281620f0 msgr2=0x7fb8280b5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:49.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.211+0000 7fb825400640 1 --2- 172.21.15.112:0/2461838907 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8281620f0 0x7fb8280b5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:49.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.211+0000 7fb825400640 1 -- 172.21.15.112:0/2461838907 >> v1:172.21.15.137:6789/0 conn(0x7fb8280d0820 legacy=0x7fb8280ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:49.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.211+0000 7fb825400640 1 -- 172.21.15.112:0/2461838907 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8280d10c0 con 0x7fb8280afd70 2024-09-12T02:52:49.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.211+0000 7fb825e00640 1 --2- 172.21.15.112:0/2461838907 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8281620f0 0x7fb8280b5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:52:49.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.212+0000 7fb825400640 1 --2- 172.21.15.112:0/2461838907 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8280afd70 0x7fb82806eda0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb8140097a0 tx=0x7fb81402a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17dff8d3831281c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:49.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.212+0000 7fb824a00640 1 -- 172.21.15.112:0/2461838907 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb814037070 con 0x7fb8280afd70 2024-09-12T02:52:49.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.212+0000 7fb824a00640 1 -- 172.21.15.112:0/2461838907 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb81402adb0 con 0x7fb8280afd70 2024-09-12T02:52:49.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.212+0000 7fb824a00640 1 -- 172.21.15.112:0/2461838907 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb814032660 con 0x7fb8280afd70 2024-09-12T02:52:49.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.213+0000 7fb827200640 1 -- 172.21.15.112:0/2461838907 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8280afd70 msgr2=0x7fb82806eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:49.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.213+0000 7fb827200640 1 --2- 172.21.15.112:0/2461838907 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8280afd70 0x7fb82806eda0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb8140097a0 tx=0x7fb81402a060 comp rx=0 tx=0).stop 2024-09-12T02:52:49.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.213+0000 7fb827200640 1 -- 172.21.15.112:0/2461838907 shutdown_connections 2024-09-12T02:52:49.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.213+0000 7fb827200640 1 --2- 172.21.15.112:0/2461838907 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8280afd70 0x7fb82806eda0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:49.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.213+0000 7fb827200640 1 --2- 172.21.15.112:0/2461838907 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8281620f0 0x7fb8280b5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:49.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.213+0000 7fb827200640 1 -- 172.21.15.112:0/2461838907 >> 172.21.15.112:0/2461838907 conn(0x7fb82806bbd0 msgr2=0x7fb82806bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:49.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.213+0000 7fb827200640 1 -- 172.21.15.112:0/2461838907 shutdown_connections 2024-09-12T02:52:49.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.213+0000 7fb827200640 1 -- 172.21.15.112:0/2461838907 wait complete. 2024-09-12T02:52:49.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.215+0000 7fb827200640 1 Processor -- start 2024-09-12T02:52:49.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.215+0000 7fb827200640 1 -- start start 2024-09-12T02:52:49.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.216+0000 7fb827200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8280afd70 0x7fb82814dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:49.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.216+0000 7fb827200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8280d0820 0x7fb8281f4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:49.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.216+0000 7fb827200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8281620f0 0x7fb8280b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:49.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.216+0000 7fb827200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb8280d13a0 con 0x7fb8280d0820 2024-09-12T02:52:49.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.216+0000 7fb827200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb8280737d0 con 0x7fb8280afd70 2024-09-12T02:52:49.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.216+0000 7fb827200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb82806f2e0 con 0x7fb8281620f0 2024-09-12T02:52:49.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.216+0000 7fb825400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8280d0820 0x7fb8281f4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:49.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.216+0000 7fb825400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8280d0820 0x7fb8281f4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42272/0 (socket says 172.21.15.112:42272) 2024-09-12T02:52:49.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.216+0000 7fb825400640 1 -- 172.21.15.112:0/3111144557 learned_addr learned my addr 172.21.15.112:0/3111144557 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:49.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.216+0000 7fb825e00640 1 --2- 172.21.15.112:0/3111144557 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8280afd70 0x7fb82814dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:49.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.216+0000 7fb826800640 1 --2- 172.21.15.112:0/3111144557 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8281620f0 0x7fb8280b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:49.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.217+0000 7fb825400640 1 -- 172.21.15.112:0/3111144557 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8281620f0 msgr2=0x7fb8280b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:49.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.217+0000 7fb825400640 1 --2- 172.21.15.112:0/3111144557 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8281620f0 0x7fb8280b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:49.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.217+0000 7fb825400640 1 -- 172.21.15.112:0/3111144557 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8280afd70 msgr2=0x7fb82814dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:49.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.217+0000 7fb825400640 1 --2- 172.21.15.112:0/3111144557 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8280afd70 0x7fb82814dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:49.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.217+0000 7fb825400640 1 -- 172.21.15.112:0/3111144557 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8281f52a0 con 0x7fb8280d0820 2024-09-12T02:52:49.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.217+0000 7fb825400640 1 --2- 172.21.15.112:0/3111144557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8280d0820 0x7fb8281f4980 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fb81402a0a0 tx=0x7fb8140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:49.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.217+0000 7fb81e000640 1 -- 172.21.15.112:0/3111144557 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb814041070 con 0x7fb8280d0820 2024-09-12T02:52:49.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.217+0000 7fb81e000640 1 -- 172.21.15.112:0/3111144557 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb81403c660 con 0x7fb8280d0820 2024-09-12T02:52:49.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.217+0000 7fb81e000640 1 -- 172.21.15.112:0/3111144557 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb814037040 con 0x7fb8280d0820 2024-09-12T02:52:49.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.217+0000 7fb827200640 1 -- 172.21.15.112:0/3111144557 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8281f5580 con 0x7fb8280d0820 2024-09-12T02:52:49.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.218+0000 7fb827200640 1 -- 172.21.15.112:0/3111144557 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb82815f6e0 con 0x7fb8280d0820 2024-09-12T02:52:49.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.219+0000 7fb827200640 1 -- 172.21.15.112:0/3111144557 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb82806eda0 con 0x7fb8280d0820 2024-09-12T02:52:49.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.219+0000 7fb81e000640 1 -- 172.21.15.112:0/3111144557 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb814044070 con 0x7fb8280d0820 2024-09-12T02:52:49.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.221+0000 7fb81e000640 1 --2- 172.21.15.112:0/3111144557 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb80806be30 0x7fb80806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:49.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.221+0000 7fb81e000640 1 -- 172.21.15.112:0/3111144557 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 4943+0+0 (secure 0 0 0) 0x7fb8140ab1d0 con 0x7fb8280d0820 2024-09-12T02:52:49.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.221+0000 7fb825e00640 1 --2- 172.21.15.112:0/3111144557 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb80806be30 0x7fb80806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:49.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.222+0000 7fb825e00640 1 --2- 172.21.15.112:0/3111144557 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb80806be30 0x7fb80806e2f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb818009560 tx=0x7fb818009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:49.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.225+0000 7fb81e000640 1 -- 172.21.15.112:0/3111144557 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb814079820 con 0x7fb8280d0820 2024-09-12T02:52:49.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.435+0000 7fb827200640 1 -- 172.21.15.112:0/3111144557 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8280b5a50 con 0x7fb8280d0820 2024-09-12T02:52:49.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.435+0000 7fb81e000640 1 -- 172.21.15.112:0/3111144557 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) ==== 94+0+3920 (secure 0 0 0) 0x7fb81407db20 con 0x7fb8280d0820 2024-09-12T02:52:49.436 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:52:49.436 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":88,"btime":"2024-09-12T02:52:43:184194+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/1180447882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1180447882},{"type":"v1","addr":"172.21.15.112:6836","nonce":1180447882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":6916,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2975519871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2975519871},{"type":"v1","addr":"172.21.15.137:6835","nonce":2975519871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/590628280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":590628280},{"type":"v1","addr":"172.21.15.137:6834","nonce":590628280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88},{"gid":7554,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2629863369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2629863369},{"type":"v1","addr":"172.21.15.112:6837","nonce":2629863369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[]} 2024-09-12T02:52:49.437 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 88 2024-09-12T02:52:49.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.437+0000 7fb827200640 1 -- 172.21.15.112:0/3111144557 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb80806be30 msgr2=0x7fb80806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:49.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.437+0000 7fb827200640 1 --2- 172.21.15.112:0/3111144557 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb80806be30 0x7fb80806e2f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb818009560 tx=0x7fb818009190 comp rx=0 tx=0).stop 2024-09-12T02:52:49.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.437+0000 7fb827200640 1 -- 172.21.15.112:0/3111144557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8280d0820 msgr2=0x7fb8281f4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:49.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.437+0000 7fb827200640 1 --2- 172.21.15.112:0/3111144557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8280d0820 0x7fb8281f4980 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fb81402a0a0 tx=0x7fb8140046c0 comp rx=0 tx=0).stop 2024-09-12T02:52:49.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.437+0000 7fb827200640 1 -- 172.21.15.112:0/3111144557 shutdown_connections 2024-09-12T02:52:49.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.437+0000 7fb827200640 1 --2- 172.21.15.112:0/3111144557 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8281620f0 0x7fb8280b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:49.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.437+0000 7fb827200640 1 --2- 172.21.15.112:0/3111144557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8280d0820 0x7fb8281f4980 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:49.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.437+0000 7fb827200640 1 --2- 172.21.15.112:0/3111144557 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb80806be30 0x7fb80806e2f0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:49.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.437+0000 7fb827200640 1 --2- 172.21.15.112:0/3111144557 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8280afd70 0x7fb82814dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:49.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.437+0000 7fb827200640 1 -- 172.21.15.112:0/3111144557 >> 172.21.15.112:0/3111144557 conn(0x7fb82806bbd0 msgr2=0x7fb82814ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:49.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.437+0000 7fb827200640 1 -- 172.21.15.112:0/3111144557 shutdown_connections 2024-09-12T02:52:49.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.438+0000 7fb827200640 1 -- 172.21.15.112:0/3111144557 wait complete. 2024-09-12T02:52:49.454 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T02:52:49.454 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T02:52:49.454 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T02:52:49.454 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:52:49.454 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T02:52:49.455 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T02:52:49.455 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T02:52:49.455 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:52:49.455 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T02:52:49.455 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T02:52:49.455 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T02:52:49.455 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:52:49.456 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T02:52:49.456 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T02:52:49.456 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T02:52:49.456 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:52:49.468 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T02:52:49.468 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T02:52:49.469 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T02:52:49.470 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T02:52:49.471 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T02:52:49.471 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T02:52:49.472 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T02:52:49.472 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T02:52:49.513 INFO:tasks.ceph.mds.a:Started 2024-09-12T02:52:49.514 DEBUG:teuthology.parallel:result is None 2024-09-12T02:52:49.516 INFO:tasks.ceph.mds.c:Started 2024-09-12T02:52:49.516 DEBUG:teuthology.parallel:result is None 2024-09-12T02:52:49.518 INFO:tasks.ceph.mds.b:Started 2024-09-12T02:52:49.518 DEBUG:teuthology.parallel:result is None 2024-09-12T02:52:49.520 INFO:tasks.ceph.mds.d:Started 2024-09-12T02:52:49.520 DEBUG:teuthology.parallel:result is None 2024-09-12T02:52:49.520 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T02:52:49.645 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-12T02:52:49.645 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2024-09-12T02:52:49.648 INFO:tasks.ceph.mds.b.smithi137.stdout:starting mds.b at 2024-09-12T02:52:49.649 INFO:tasks.ceph.mds.d.smithi137.stdout:starting mds.d at 2024-09-12T02:52:49.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.681+0000 7f47a2200640 1 Processor -- start 2024-09-12T02:52:49.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.681+0000 7f47a2200640 1 -- start start 2024-09-12T02:52:49.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.683+0000 7f47a2200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f479c06e3b0 0x7f479c0afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:49.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.683+0000 7f47a2200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f479c0aedd0 con 0x7f479c0ae8d0 2024-09-12T02:52:49.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.683+0000 7f47a2200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f479c0af0b0 con 0x7f479c06d8c0 2024-09-12T02:52:49.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.683+0000 7f47a2200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f479c0af390 con 0x7f479c06e3b0 2024-09-12T02:52:49.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.683+0000 7f4792a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f479c0ae8d0 0x7f479c06dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45220/0 (socket says 172.21.15.112:45220) 2024-09-12T02:52:49.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.683+0000 7f4792a00640 1 -- 172.21.15.112:0/2804502091 learned_addr learned my addr 172.21.15.112:0/2804502091 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:52:49.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.683+0000 7f479be00640 1 --2- 172.21.15.112:0/2804502091 >> v2:172.21.15.137:3300/0 conn(0x7f479c06e3b0 0x7f479c0afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:49.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.683+0000 7f479aa00640 1 -- 172.21.15.112:0/2804502091 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 683731302 0 0) 0x7f479c0aedd0 con 0x7f479c0ae8d0 2024-09-12T02:52:49.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.683+0000 7f479aa00640 1 -- 172.21.15.112:0/2804502091 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4780003520 con 0x7f479c0ae8d0 2024-09-12T02:52:49.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.684+0000 7f479aa00640 1 -- 172.21.15.112:0/2804502091 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3157262375 0 0) 0x7f479c0af0b0 con 0x7f479c06d8c0 2024-09-12T02:52:49.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.684+0000 7f479aa00640 1 -- 172.21.15.112:0/2804502091 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f479c0aedd0 con 0x7f479c06d8c0 2024-09-12T02:52:49.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.684+0000 7f479be00640 1 -- 172.21.15.112:0/2804502091 >> v1:172.21.15.137:6789/0 conn(0x7f479c06d8c0 legacy=0x7f479c0715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:49.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.684+0000 7f479aa00640 1 -- 172.21.15.112:0/2804502091 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3220543996 0 0) 0x7f4780003520 con 0x7f479c0ae8d0 2024-09-12T02:52:49.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.684+0000 7f479be00640 1 -- 172.21.15.112:0/2804502091 >> v1:172.21.15.112:6789/0 conn(0x7f479c0ae8d0 legacy=0x7f479c06dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:49.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.684+0000 7f479be00640 1 -- 172.21.15.112:0/2804502091 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f479c0af670 con 0x7f479c06e3b0 2024-09-12T02:52:49.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.685+0000 7f479be00640 1 --2- 172.21.15.112:0/2804502091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f479c06e3b0 0x7f479c0afe70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4794009d90 tx=0x7f479402a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c795e26b6443fab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:49.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.685+0000 7f479aa00640 1 -- 172.21.15.112:0/2804502091 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47840017f0 con 0x7f479c06e3b0 2024-09-12T02:52:49.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.685+0000 7f479aa00640 1 -- 172.21.15.112:0/2804502091 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4794007540 con 0x7f479c06e3b0 2024-09-12T02:52:49.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.685+0000 7f479aa00640 1 -- 172.21.15.112:0/2804502091 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4794007910 con 0x7f479c06e3b0 2024-09-12T02:52:49.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.686+0000 7f47a2200640 1 -- 172.21.15.112:0/2804502091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f479c06e3b0 msgr2=0x7f479c0afe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:49.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.686+0000 7f47a2200640 1 --2- 172.21.15.112:0/2804502091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f479c06e3b0 0x7f479c0afe70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4794009d90 tx=0x7f479402a680 comp rx=0 tx=0).stop 2024-09-12T02:52:49.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.686+0000 7f47a2200640 1 -- 172.21.15.112:0/2804502091 shutdown_connections 2024-09-12T02:52:49.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.686+0000 7f47a2200640 1 --2- 172.21.15.112:0/2804502091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f479c06e3b0 0x7f479c0afe70 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:49.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.686+0000 7f47a2200640 1 -- 172.21.15.112:0/2804502091 >> 172.21.15.112:0/2804502091 conn(0x7f479c06bbd0 msgr2=0x7f479c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:49.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.686+0000 7f47a2200640 1 -- 172.21.15.112:0/2804502091 shutdown_connections 2024-09-12T02:52:49.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.686+0000 7f47a2200640 1 -- 172.21.15.112:0/2804502091 wait complete. 2024-09-12T02:52:49.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.687+0000 7f47a2200640 1 Processor -- start 2024-09-12T02:52:49.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.688+0000 7f47a2200640 1 -- start start 2024-09-12T02:52:49.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.688+0000 7f47a2200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f479c06d8c0 0x7f479c1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:49.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.688+0000 7f47a2200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f479c06e3b0 0x7f479c154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:49.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.688+0000 7f47a2200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f479c0ae8d0 0x7f479c15b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:49.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.688+0000 7f47a2200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f479c0b3a60 con 0x7f479c06d8c0 2024-09-12T02:52:49.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.688+0000 7f47a2200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f479c0b38e0 con 0x7f479c06e3b0 2024-09-12T02:52:49.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.688+0000 7f47a2200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f479c0b3be0 con 0x7f479c0ae8d0 2024-09-12T02:52:49.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.689+0000 7f479b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f479c06d8c0 0x7f479c1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:49.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.689+0000 7f479b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f479c06d8c0 0x7f479c1585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42306/0 (socket says 172.21.15.112:42306) 2024-09-12T02:52:49.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.689+0000 7f479b400640 1 -- 172.21.15.112:0/3817070889 learned_addr learned my addr 172.21.15.112:0/3817070889 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:49.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.689+0000 7f479be00640 1 --2- 172.21.15.112:0/3817070889 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f479c0ae8d0 0x7f479c15b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:49.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.689+0000 7f4792a00640 1 --2- 172.21.15.112:0/3817070889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f479c06e3b0 0x7f479c154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:49.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.689+0000 7f479b400640 1 -- 172.21.15.112:0/3817070889 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f479c0ae8d0 msgr2=0x7f479c15b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:49.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.689+0000 7f479b400640 1 --2- 172.21.15.112:0/3817070889 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f479c0ae8d0 0x7f479c15b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:49.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.689+0000 7f479b400640 1 -- 172.21.15.112:0/3817070889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f479c06e3b0 msgr2=0x7f479c154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:49.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.689+0000 7f479b400640 1 --2- 172.21.15.112:0/3817070889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f479c06e3b0 0x7f479c154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:49.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.689+0000 7f479b400640 1 -- 172.21.15.112:0/3817070889 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f479c161940 con 0x7f479c06d8c0 2024-09-12T02:52:49.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.689+0000 7f479b400640 1 --2- 172.21.15.112:0/3817070889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f479c06d8c0 0x7f479c1585f0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f478c00c490 tx=0x7f478c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:49.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.690+0000 7f4793e00640 1 -- 172.21.15.112:0/3817070889 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f478c0052d0 con 0x7f479c06d8c0 2024-09-12T02:52:49.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.690+0000 7f4793e00640 1 -- 172.21.15.112:0/3817070889 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f478c005470 con 0x7f479c06d8c0 2024-09-12T02:52:49.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.690+0000 7f47a2200640 1 -- 172.21.15.112:0/3817070889 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f479c161c20 con 0x7f479c06d8c0 2024-09-12T02:52:49.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.690+0000 7f4793e00640 1 -- 172.21.15.112:0/3817070889 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f478c012850 con 0x7f479c06d8c0 2024-09-12T02:52:49.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.690+0000 7f47a2200640 1 -- 172.21.15.112:0/3817070889 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f479c1621e0 con 0x7f479c06d8c0 2024-09-12T02:52:49.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.691+0000 7f47a2200640 1 -- 172.21.15.112:0/3817070889 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f479c068a30 con 0x7f479c06d8c0 2024-09-12T02:52:49.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.692+0000 7f4793e00640 1 -- 172.21.15.112:0/3817070889 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f478c0129f0 con 0x7f479c06d8c0 2024-09-12T02:52:49.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.693+0000 7f4793e00640 1 --2- 172.21.15.112:0/3817070889 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f477806be30 0x7f477806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:49.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.694+0000 7f4792a00640 1 --2- 172.21.15.112:0/3817070889 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f477806be30 0x7f477806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:49.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.694+0000 7f4793e00640 1 -- 172.21.15.112:0/3817070889 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 4943+0+0 (secure 0 0 0) 0x7f478c056e80 con 0x7f479c06d8c0 2024-09-12T02:52:49.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.694+0000 7f4792a00640 1 --2- 172.21.15.112:0/3817070889 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f477806be30 0x7f477806e2f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f479c0ccbc0 tx=0x7f4784009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:49.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.699+0000 7f4793e00640 1 -- 172.21.15.112:0/3817070889 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f478c0594e0 con 0x7f479c06d8c0 2024-09-12T02:52:49.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:49.885+0000 7f47a2200640 1 -- 172.21.15.112:0/3817070889 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f479c0afe70 con 0x7f479c06d8c0 2024-09-12T02:52:50.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.717+0000 7f4793e00640 1 -- 172.21.15.112:0/3817070889 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v179) ==== 97+0+0 (secure 0 0 0) 0x7f478c058de0 con 0x7f479c06d8c0 2024-09-12T02:52:50.718 INFO:teuthology.orchestra.run.smithi112.stderr: removed all blocklist entries 2024-09-12T02:52:50.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.720+0000 7f47a2200640 1 -- 172.21.15.112:0/3817070889 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f477806be30 msgr2=0x7f477806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:50.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.720+0000 7f47a2200640 1 --2- 172.21.15.112:0/3817070889 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f477806be30 0x7f477806e2f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f479c0ccbc0 tx=0x7f4784009040 comp rx=0 tx=0).stop 2024-09-12T02:52:50.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.720+0000 7f47a2200640 1 -- 172.21.15.112:0/3817070889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f479c06d8c0 msgr2=0x7f479c1585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:50.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.720+0000 7f47a2200640 1 --2- 172.21.15.112:0/3817070889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f479c06d8c0 0x7f479c1585f0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f478c00c490 tx=0x7f478c00c950 comp rx=0 tx=0).stop 2024-09-12T02:52:50.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.720+0000 7f47a2200640 1 -- 172.21.15.112:0/3817070889 shutdown_connections 2024-09-12T02:52:50.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.720+0000 7f47a2200640 1 --2- 172.21.15.112:0/3817070889 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f479c0ae8d0 0x7f479c15b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.720+0000 7f47a2200640 1 --2- 172.21.15.112:0/3817070889 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f477806be30 0x7f477806e2f0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.720+0000 7f47a2200640 1 --2- 172.21.15.112:0/3817070889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f479c06e3b0 0x7f479c154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.720+0000 7f47a2200640 1 --2- 172.21.15.112:0/3817070889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f479c06d8c0 0x7f479c1585f0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.720+0000 7f47a2200640 1 -- 172.21.15.112:0/3817070889 >> 172.21.15.112:0/3817070889 conn(0x7f479c06bbd0 msgr2=0x7f479c0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:50.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.720+0000 7f47a2200640 1 -- 172.21.15.112:0/3817070889 shutdown_connections 2024-09-12T02:52:50.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.720+0000 7f47a2200640 1 -- 172.21.15.112:0/3817070889 wait complete. 2024-09-12T02:52:50.740 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T02:52:50.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.894+0000 7f10ba400640 1 Processor -- start 2024-09-12T02:52:50.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.894+0000 7f10ba400640 1 -- start start 2024-09-12T02:52:50.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.896+0000 7f10ba400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f10b40b5850 0x7f10b406e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:50.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.896+0000 7f10ba400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10b406e970 0x7f10b4164de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:50.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.896+0000 7f10ba400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10b415b6a0 con 0x7f10b406e050 2024-09-12T02:52:50.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.896+0000 7f10ba400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f10b40b43b0 con 0x7f10b40b5850 2024-09-12T02:52:50.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.896+0000 7f10ba400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f10b40b3a80 con 0x7f10b406e970 2024-09-12T02:52:50.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.896+0000 7f10aaa00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f10b40b5850 0x7f10b406e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:50.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.896+0000 7f10b3e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10b406e970 0x7f10b4164de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:50.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.896+0000 7f10aaa00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f10b40b5850 0x7f10b406e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:43902/0 (socket says 172.21.15.112:43902) 2024-09-12T02:52:50.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.896+0000 7f10aaa00640 1 -- 172.21.15.112:0/930515614 learned_addr learned my addr 172.21.15.112:0/930515614 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:50.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.897+0000 7f10b3e00640 1 -- 172.21.15.112:0/930515614 >> v2:172.21.15.137:3300/0 conn(0x7f10b40b5850 msgr2=0x7f10b406e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:50.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.897+0000 7f10b3e00640 1 --2- 172.21.15.112:0/930515614 >> v2:172.21.15.137:3300/0 conn(0x7f10b40b5850 0x7f10b406e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.897+0000 7f10b3e00640 1 -- 172.21.15.112:0/930515614 >> v1:172.21.15.137:6789/0 conn(0x7f10b406e050 legacy=0x7f10b40cfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:50.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.897+0000 7f10b3e00640 1 -- 172.21.15.112:0/930515614 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b40b3d60 con 0x7f10b406e970 2024-09-12T02:52:50.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.897+0000 7f10aaa00640 1 --2- 172.21.15.112:0/930515614 >> v2:172.21.15.137:3300/0 conn(0x7f10b40b5850 0x7f10b406e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:52:50.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.898+0000 7f10b3e00640 1 --2- 172.21.15.112:0/930515614 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10b406e970 0x7f10b4164de0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009d90 tx=0x7f10ac02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac3387fba57dbf06 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:50.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.898+0000 7f10b2a00640 1 -- 172.21.15.112:0/930515614 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ac007740 con 0x7f10b406e970 2024-09-12T02:52:50.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.898+0000 7f10b2a00640 1 -- 172.21.15.112:0/930515614 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10ac0078e0 con 0x7f10b406e970 2024-09-12T02:52:50.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.898+0000 7f10b2a00640 1 -- 172.21.15.112:0/930515614 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ac007cb0 con 0x7f10b406e970 2024-09-12T02:52:50.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.899+0000 7f10ba400640 1 -- 172.21.15.112:0/930515614 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10b406e970 msgr2=0x7f10b4164de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:50.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.899+0000 7f10ba400640 1 --2- 172.21.15.112:0/930515614 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10b406e970 0x7f10b4164de0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009d90 tx=0x7f10ac02a660 comp rx=0 tx=0).stop 2024-09-12T02:52:50.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.899+0000 7f10ba400640 1 -- 172.21.15.112:0/930515614 shutdown_connections 2024-09-12T02:52:50.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.899+0000 7f10ba400640 1 --2- 172.21.15.112:0/930515614 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10b406e970 0x7f10b4164de0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.899+0000 7f10ba400640 1 --2- 172.21.15.112:0/930515614 >> v2:172.21.15.137:3300/0 conn(0x7f10b40b5850 0x7f10b406e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.899+0000 7f10ba400640 1 -- 172.21.15.112:0/930515614 >> 172.21.15.112:0/930515614 conn(0x7f10b406bbd0 msgr2=0x7f10b406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:50.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.899+0000 7f10ba400640 1 -- 172.21.15.112:0/930515614 shutdown_connections 2024-09-12T02:52:50.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.899+0000 7f10ba400640 1 -- 172.21.15.112:0/930515614 wait complete. 2024-09-12T02:52:50.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.901+0000 7f10ba400640 1 Processor -- start 2024-09-12T02:52:50.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.901+0000 7f10ba400640 1 -- start start 2024-09-12T02:52:50.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.902+0000 7f10ba400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10b406e050 0x7f10b415c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:50.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.902+0000 7f10ba400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10b406e970 0x7f10b4147f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:50.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.902+0000 7f10ba400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10b40b5850 0x7f10b40ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:50.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.902+0000 7f10ba400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f10b4072170 con 0x7f10b40b5850 2024-09-12T02:52:50.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.902+0000 7f10ba400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f10b4071ff0 con 0x7f10b406e970 2024-09-12T02:52:50.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.902+0000 7f10ba400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f10b40722f0 con 0x7f10b406e050 2024-09-12T02:52:50.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.902+0000 7f10b3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10b40b5850 0x7f10b40ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:50.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.902+0000 7f10b3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10b40b5850 0x7f10b40ae8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42318/0 (socket says 172.21.15.112:42318) 2024-09-12T02:52:50.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.902+0000 7f10b3e00640 1 -- 172.21.15.112:0/3844741419 learned_addr learned my addr 172.21.15.112:0/3844741419 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:50.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.902+0000 7f10b3400640 1 --2- 172.21.15.112:0/3844741419 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10b406e050 0x7f10b415c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:50.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.902+0000 7f10aaa00640 1 --2- 172.21.15.112:0/3844741419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10b406e970 0x7f10b4147f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:50.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.902+0000 7f10b3e00640 1 -- 172.21.15.112:0/3844741419 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10b406e050 msgr2=0x7f10b415c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:50.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.902+0000 7f10b3e00640 1 --2- 172.21.15.112:0/3844741419 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10b406e050 0x7f10b415c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.902+0000 7f10b3e00640 1 -- 172.21.15.112:0/3844741419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10b406e970 msgr2=0x7f10b4147f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:50.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.902+0000 7f10b3e00640 1 --2- 172.21.15.112:0/3844741419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10b406e970 0x7f10b4147f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:50.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.902+0000 7f10b3e00640 1 -- 172.21.15.112:0/3844741419 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b4150680 con 0x7f10b40b5850 2024-09-12T02:52:50.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.903+0000 7f10b3e00640 1 --2- 172.21.15.112:0/3844741419 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10b40b5850 0x7f10b40ae8d0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009eb0 tx=0x7f10ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:50.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.903+0000 7f10abe00640 1 -- 172.21.15.112:0/3844741419 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ac040070 con 0x7f10b40b5850 2024-09-12T02:52:50.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.903+0000 7f10abe00640 1 -- 172.21.15.112:0/3844741419 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10ac031bc0 con 0x7f10b40b5850 2024-09-12T02:52:50.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.903+0000 7f10ba400640 1 -- 172.21.15.112:0/3844741419 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b4150960 con 0x7f10b40b5850 2024-09-12T02:52:50.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.903+0000 7f10abe00640 1 -- 172.21.15.112:0/3844741419 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ac009450 con 0x7f10b40b5850 2024-09-12T02:52:50.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.903+0000 7f10ba400640 1 -- 172.21.15.112:0/3844741419 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b4150f20 con 0x7f10b40b5850 2024-09-12T02:52:50.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.904+0000 7f10ba400640 1 -- 172.21.15.112:0/3844741419 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10b406e430 con 0x7f10b40b5850 2024-09-12T02:52:50.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.905+0000 7f10abe00640 1 -- 172.21.15.112:0/3844741419 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f10ac039040 con 0x7f10b40b5850 2024-09-12T02:52:50.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.906+0000 7f10abe00640 1 --2- 172.21.15.112:0/3844741419 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f109006be30 0x7f109006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:50.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.906+0000 7f10abe00640 1 -- 172.21.15.112:0/3844741419 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 4857+0+0 (secure 0 0 0) 0x7f10ac0ac2d0 con 0x7f10b40b5850 2024-09-12T02:52:50.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.907+0000 7f10b3400640 1 --2- 172.21.15.112:0/3844741419 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f109006be30 0x7f109006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:50.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.907+0000 7f10b3400640 1 --2- 172.21.15.112:0/3844741419 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f109006be30 0x7f109006e2f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f10b40d0940 tx=0x7f10a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:50.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:50.911+0000 7f10abe00640 1 -- 172.21.15.112:0/3844741419 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f10ac07a8e0 con 0x7f10b40b5850 2024-09-12T02:52:51.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.143+0000 7f10ba400640 1 -- 172.21.15.112:0/3844741419 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f10b414f0c0 con 0x7f10b40b5850 2024-09-12T02:52:51.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.144+0000 7f10abe00640 1 -- 172.21.15.112:0/3844741419 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) ==== 80+0+5304 (secure 0 0 0) 0x7f10ac07ebe0 con 0x7f10b40b5850 2024-09-12T02:52:51.145 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:52:51.145 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:52:51.145 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_dump": [ 2024-09-12T02:52:51.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:52:51.145 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.a", 2024-09-12T02:52:51.145 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmKE09KRAAtNq70LeeB9ENNxX91m10Fg==", 2024-09-12T02:52:51.145 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:52:51.145 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:52:51.145 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:52:51.145 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:52:51.145 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:52:51.146 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:52:51.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:52:51.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:52:51.146 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.b", 2024-09-12T02:52:51.146 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmMjYTARAAuIrofOOp9Dbrhkt314mhuw==", 2024-09-12T02:52:51.146 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:52:51.146 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:52:51.146 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:52:51.146 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:52:51.146 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:52:51.146 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:52:51.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:52:51.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:52:51.146 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.c", 2024-09-12T02:52:51.146 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmLQXzMhAAhk28JuqKhfbZtvRu9SSVrw==", 2024-09-12T02:52:51.147 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:52:51.147 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:52:51.147 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:52:51.147 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:52:51.147 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:52:51.147 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:52:51.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:52:51.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:52:51.147 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.d", 2024-09-12T02:52:51.147 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmaE7JChAAKlyynYJnHLs87BXyMC0xgA==", 2024-09-12T02:52:51.147 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:52:51.147 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:52:51.147 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:52:51.147 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:52:51.147 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:52:51.148 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:52:51.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:52:51.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:52:51.148 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.0", 2024-09-12T02:52:51.148 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDXVOJmFXfdIRAA+VpZNU0tEN6vAzR2C7nuLg==", 2024-09-12T02:52:51.148 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:52:51.148 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:52:51.148 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:52:51.148 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:52:51.148 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:52:51.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:52:51.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:52:51.148 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.1", 2024-09-12T02:52:51.149 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDXVOJmcgHyLBAA/OxfdQ1D+uFzbCnm1dJLxw==", 2024-09-12T02:52:51.149 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:52:51.149 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:52:51.149 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:52:51.149 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:52:51.149 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:52:51.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:52:51.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:52:51.149 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.2", 2024-09-12T02:52:51.149 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDXVOJm0baUNhAAuInNwHut2Xn0kBmjnJhdqw==", 2024-09-12T02:52:51.149 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:52:51.149 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:52:51.149 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:52:51.149 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:52:51.150 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:52:51.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:52:51.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:52:51.150 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.3", 2024-09-12T02:52:51.150 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDYVOJmL/O3BBAAZhQ4/70wj/2zEbMcfD4hQA==", 2024-09-12T02:52:51.150 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:52:51.150 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:52:51.150 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:52:51.150 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:52:51.150 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:52:51.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:52:51.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:52:51.150 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.4", 2024-09-12T02:52:51.150 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmC+sJAxAAUQofpG3g8DlGLQ8wUqtuSg==", 2024-09-12T02:52:51.151 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:52:51.151 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:52:51.151 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:52:51.151 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:52:51.151 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:52:51.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:52:51.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:52:51.151 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.5", 2024-09-12T02:52:51.151 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmY2OSDhAA2rg1HGjWx7G6IzFi6yQ/jQ==", 2024-09-12T02:52:51.151 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:52:51.151 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:52:51.151 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:52:51.151 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:52:51.151 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:52:51.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:52:51.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:52:51.152 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.6", 2024-09-12T02:52:51.152 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmydoaGRAAh/ozKewnY+RxiZ4EcOFA7A==", 2024-09-12T02:52:51.152 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:52:51.152 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:52:51.152 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:52:51.152 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:52:51.152 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:52:51.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:52:51.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:52:51.152 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.7", 2024-09-12T02:52:51.152 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDbVOJmmB7cIhAAVhtz7OuxYBQgEKGvHdY33g==", 2024-09-12T02:52:51.152 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:52:51.152 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-12T02:52:51.153 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-12T02:52:51.153 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:52:51.153 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:52:51.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:52:51.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:52:51.153 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.0", 2024-09-12T02:52:51.153 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmaG86ExAAD0SOlJOsLpoQZlgPJIPaxA==", 2024-09-12T02:52:51.153 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:52:51.153 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:52:51.153 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow r", 2024-09-12T02:52:51.153 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T02:52:51.153 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:52:51.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:52:51.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:52:51.154 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.1", 2024-09-12T02:52:51.154 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmt7AeIBAAGRSEejG29OpANZqtia7KEw==", 2024-09-12T02:52:51.154 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:52:51.154 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:52:51.154 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:52:51.154 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:52:51.154 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:52:51.154 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:52:51.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:52:51.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:52:51.154 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.2", 2024-09-12T02:52:51.154 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJmcUWtGRAAlV/gS/CDZKHb5bjbmDzjlg==", 2024-09-12T02:52:51.154 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:52:51.154 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:52:51.154 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:52:51.155 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:52:51.155 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:52:51.155 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:52:51.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:52:51.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:52:51.155 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.3", 2024-09-12T02:52:51.155 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDUVOJm2M97JhAAHKJoPBf6TN6Nu8muK6wzaw==", 2024-09-12T02:52:51.155 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:52:51.155 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-12T02:52:51.155 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-12T02:52:51.155 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-12T02:52:51.155 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-12T02:52:51.155 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:52:51.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:52:51.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:52:51.156 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.admin", 2024-09-12T02:52:51.156 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDSVOJmhl82NBAAvkcxnsY5u9lYO12FaRbP1A==", 2024-09-12T02:52:51.156 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:52:51.156 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-12T02:52:51.156 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-12T02:52:51.156 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-12T02:52:51.156 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:52:51.156 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:52:51.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:52:51.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:52:51.156 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.x", 2024-09-12T02:52:51.156 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmftawIhAAAKmfx8khERROoZ8BCLukAw==", 2024-09-12T02:52:51.156 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:52:51.157 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-12T02:52:51.157 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-12T02:52:51.157 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:52:51.157 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:52:51.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:52:51.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:52:51.157 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.y", 2024-09-12T02:52:51.157 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQDTVOJmcxtNGhAAAXWh1fMrVeFSy2hh3p2Rkw==", 2024-09-12T02:52:51.157 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-12T02:52:51.157 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-12T02:52:51.157 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-12T02:52:51.157 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-12T02:52:51.157 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:52:51.157 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:52:51.158 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:52:51.158 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:52:51.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.146+0000 7f10ba400640 1 -- 172.21.15.112:0/3844741419 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f109006be30 msgr2=0x7f109006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:51.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.146+0000 7f10ba400640 1 --2- 172.21.15.112:0/3844741419 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f109006be30 0x7f109006e2f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f10b40d0940 tx=0x7f10a4009040 comp rx=0 tx=0).stop 2024-09-12T02:52:51.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.146+0000 7f10ba400640 1 -- 172.21.15.112:0/3844741419 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10b40b5850 msgr2=0x7f10b40ae8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:51.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.146+0000 7f10ba400640 1 --2- 172.21.15.112:0/3844741419 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10b40b5850 0x7f10b40ae8d0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009eb0 tx=0x7f10ac004a40 comp rx=0 tx=0).stop 2024-09-12T02:52:51.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.146+0000 7f10ba400640 1 -- 172.21.15.112:0/3844741419 shutdown_connections 2024-09-12T02:52:51.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.146+0000 7f10ba400640 1 --2- 172.21.15.112:0/3844741419 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10b40b5850 0x7f10b40ae8d0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.146+0000 7f10ba400640 1 --2- 172.21.15.112:0/3844741419 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f109006be30 0x7f109006e2f0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.146+0000 7f10ba400640 1 --2- 172.21.15.112:0/3844741419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10b406e970 0x7f10b4147f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.146+0000 7f10ba400640 1 --2- 172.21.15.112:0/3844741419 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10b406e050 0x7f10b415c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.146+0000 7f10ba400640 1 -- 172.21.15.112:0/3844741419 >> 172.21.15.112:0/3844741419 conn(0x7f10b406bbd0 msgr2=0x7f10b40cd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:51.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.146+0000 7f10ba400640 1 -- 172.21.15.112:0/3844741419 shutdown_connections 2024-09-12T02:52:51.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.146+0000 7f10ba400640 1 -- 172.21.15.112:0/3844741419 wait complete. 2024-09-12T02:52:51.163 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T02:52:51.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.314+0000 7f6e6e200640 1 Processor -- start 2024-09-12T02:52:51.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.314+0000 7f6e6e200640 1 -- start start 2024-09-12T02:52:51.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.316+0000 7f6e6e200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e68145a90 0x7f6e680cffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.316+0000 7f6e6e200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6e681460a0 0x7f6e68071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.316+0000 7f6e6e200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e680cd480 con 0x7f6e680d0510 2024-09-12T02:52:51.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.316+0000 7f6e6e200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6e68145e70 con 0x7f6e681460a0 2024-09-12T02:52:51.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.316+0000 7f6e6e200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6e680cfb40 con 0x7f6e68145a90 2024-09-12T02:52:51.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.316+0000 7f6e5ea00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6e681460a0 0x7f6e68071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:51.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.316+0000 7f6e67400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e68145a90 0x7f6e680cffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:51.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.316+0000 7f6e5ea00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6e681460a0 0x7f6e68071530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:43918/0 (socket says 172.21.15.112:43918) 2024-09-12T02:52:51.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.316+0000 7f6e5ea00640 1 -- 172.21.15.112:0/3277945451 learned_addr learned my addr 172.21.15.112:0/3277945451 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:51.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.317+0000 7f6e67400640 1 -- 172.21.15.112:0/3277945451 >> v2:172.21.15.137:3300/0 conn(0x7f6e681460a0 msgr2=0x7f6e68071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:51.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.317+0000 7f6e67400640 1 --2- 172.21.15.112:0/3277945451 >> v2:172.21.15.137:3300/0 conn(0x7f6e681460a0 0x7f6e68071530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.317+0000 7f6e67400640 1 -- 172.21.15.112:0/3277945451 >> v1:172.21.15.137:6789/0 conn(0x7f6e680d0510 legacy=0x7f6e6806d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:51.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.317+0000 7f6e67400640 1 -- 172.21.15.112:0/3277945451 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e680cd760 con 0x7f6e68145a90 2024-09-12T02:52:51.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.317+0000 7f6e5ea00640 1 --2- 172.21.15.112:0/3277945451 >> v2:172.21.15.137:3300/0 conn(0x7f6e681460a0 0x7f6e68071530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:52:51.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.318+0000 7f6e67400640 1 --2- 172.21.15.112:0/3277945451 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e68145a90 0x7f6e680cffd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6e580097a0 tx=0x7f6e5802a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b140bbc35cd47d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:51.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.318+0000 7f6e66a00640 1 -- 172.21.15.112:0/3277945451 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e58037070 con 0x7f6e68145a90 2024-09-12T02:52:51.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.318+0000 7f6e66a00640 1 -- 172.21.15.112:0/3277945451 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e5802adb0 con 0x7f6e68145a90 2024-09-12T02:52:51.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.318+0000 7f6e66a00640 1 -- 172.21.15.112:0/3277945451 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e58032660 con 0x7f6e68145a90 2024-09-12T02:52:51.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.318+0000 7f6e6e200640 1 -- 172.21.15.112:0/3277945451 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e68145a90 msgr2=0x7f6e680cffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:51.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.318+0000 7f6e6e200640 1 --2- 172.21.15.112:0/3277945451 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e68145a90 0x7f6e680cffd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6e580097a0 tx=0x7f6e5802a060 comp rx=0 tx=0).stop 2024-09-12T02:52:51.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.319+0000 7f6e6e200640 1 -- 172.21.15.112:0/3277945451 shutdown_connections 2024-09-12T02:52:51.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.319+0000 7f6e6e200640 1 --2- 172.21.15.112:0/3277945451 >> v2:172.21.15.137:3300/0 conn(0x7f6e681460a0 0x7f6e68071530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.319+0000 7f6e6e200640 1 --2- 172.21.15.112:0/3277945451 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e68145a90 0x7f6e680cffd0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.319+0000 7f6e6e200640 1 -- 172.21.15.112:0/3277945451 >> 172.21.15.112:0/3277945451 conn(0x7f6e680b26c0 msgr2=0x7f6e680b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:51.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.319+0000 7f6e6e200640 1 -- 172.21.15.112:0/3277945451 shutdown_connections 2024-09-12T02:52:51.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.319+0000 7f6e6e200640 1 -- 172.21.15.112:0/3277945451 wait complete. 2024-09-12T02:52:51.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.320+0000 7f6e6e200640 1 Processor -- start 2024-09-12T02:52:51.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.320+0000 7f6e6e200640 1 -- start start 2024-09-12T02:52:51.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.321+0000 7f6e6e200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e680d0510 0x7f6e681413f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.321+0000 7f6e6e200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e68145a90 0x7f6e680ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.321+0000 7f6e6e200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e681460a0 0x7f6e680aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.321+0000 7f6e6e200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6806f4c0 con 0x7f6e681460a0 2024-09-12T02:52:51.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.321+0000 7f6e6e200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6806f340 con 0x7f6e68145a90 2024-09-12T02:52:51.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.321+0000 7f6e6e200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6e68071a70 con 0x7f6e680d0510 2024-09-12T02:52:51.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.321+0000 7f6e67e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e681460a0 0x7f6e680aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:51.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.322+0000 7f6e67e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e681460a0 0x7f6e680aee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42324/0 (socket says 172.21.15.112:42324) 2024-09-12T02:52:51.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.322+0000 7f6e67e00640 1 -- 172.21.15.112:0/658243831 learned_addr learned my addr 172.21.15.112:0/658243831 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:51.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.322+0000 7f6e5ea00640 1 --2- 172.21.15.112:0/658243831 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e68145a90 0x7f6e680ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:51.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.322+0000 7f6e67400640 1 --2- 172.21.15.112:0/658243831 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e680d0510 0x7f6e681413f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:51.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.322+0000 7f6e67e00640 1 -- 172.21.15.112:0/658243831 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e680d0510 msgr2=0x7f6e681413f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:51.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.322+0000 7f6e67e00640 1 --2- 172.21.15.112:0/658243831 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e680d0510 0x7f6e681413f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.322+0000 7f6e67e00640 1 -- 172.21.15.112:0/658243831 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e68145a90 msgr2=0x7f6e680ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:51.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.322+0000 7f6e67e00640 1 --2- 172.21.15.112:0/658243831 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e68145a90 0x7f6e680ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.322+0000 7f6e67e00640 1 -- 172.21.15.112:0/658243831 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e680af470 con 0x7f6e681460a0 2024-09-12T02:52:51.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.322+0000 7f6e5ea00640 1 --2- 172.21.15.112:0/658243831 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e68145a90 0x7f6e680ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:52:51.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.322+0000 7f6e67e00640 1 --2- 172.21.15.112:0/658243831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e681460a0 0x7f6e680aee10 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000c7a0 tx=0x7f6e6000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:51.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.322+0000 7f6e5fe00640 1 -- 172.21.15.112:0/658243831 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e60003b70 con 0x7f6e681460a0 2024-09-12T02:52:51.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.322+0000 7f6e5fe00640 1 -- 172.21.15.112:0/658243831 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e60003d30 con 0x7f6e681460a0 2024-09-12T02:52:51.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.322+0000 7f6e5fe00640 1 -- 172.21.15.112:0/658243831 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6000aa90 con 0x7f6e681460a0 2024-09-12T02:52:51.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.322+0000 7f6e6e200640 1 -- 172.21.15.112:0/658243831 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e680af750 con 0x7f6e681460a0 2024-09-12T02:52:51.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.323+0000 7f6e6e200640 1 -- 172.21.15.112:0/658243831 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e680afd10 con 0x7f6e681460a0 2024-09-12T02:52:51.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.324+0000 7f6e6e200640 1 -- 172.21.15.112:0/658243831 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e680732d0 con 0x7f6e681460a0 2024-09-12T02:52:51.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.325+0000 7f6e5fe00640 1 -- 172.21.15.112:0/658243831 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6e6000ac30 con 0x7f6e681460a0 2024-09-12T02:52:51.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.325+0000 7f6e5fe00640 1 --2- 172.21.15.112:0/658243831 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6e4406be30 0x7f6e4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.326+0000 7f6e5fe00640 1 -- 172.21.15.112:0/658243831 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 4857+0+0 (secure 0 0 0) 0x7f6e6008ab00 con 0x7f6e681460a0 2024-09-12T02:52:51.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.326+0000 7f6e67400640 1 --2- 172.21.15.112:0/658243831 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6e4406be30 0x7f6e4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:51.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.326+0000 7f6e67400640 1 --2- 172.21.15.112:0/658243831 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6e4406be30 0x7f6e4406e2f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6e58034000 tx=0x7f6e5802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:51.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.330+0000 7f6e5fe00640 1 -- 172.21.15.112:0/658243831 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6e600596d0 con 0x7f6e681460a0 2024-09-12T02:52:51.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.506+0000 7f6e6e200640 1 -- 172.21.15.112:0/658243831 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f6e680b14c0 con 0x7f6e681460a0 2024-09-12T02:52:51.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.506+0000 7f6e5fe00640 1 -- 172.21.15.112:0/658243831 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v179) ==== 84+0+65 (secure 0 0 0) 0x7f6e6008ae20 con 0x7f6e681460a0 2024-09-12T02:52:51.508 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:52:51.508 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2024-09-12T02:52:51.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:52:51.508 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 1, 2024-09-12T02:52:51.508 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": ".mgr" 2024-09-12T02:52:51.508 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:52:51.508 INFO:teuthology.orchestra.run.smithi112.stdout:] 2024-09-12T02:52:51.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.508+0000 7f6e6e200640 1 -- 172.21.15.112:0/658243831 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6e4406be30 msgr2=0x7f6e4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:51.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.508+0000 7f6e6e200640 1 --2- 172.21.15.112:0/658243831 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6e4406be30 0x7f6e4406e2f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6e58034000 tx=0x7f6e5802e000 comp rx=0 tx=0).stop 2024-09-12T02:52:51.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.508+0000 7f6e6e200640 1 -- 172.21.15.112:0/658243831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e681460a0 msgr2=0x7f6e680aee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:51.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.508+0000 7f6e6e200640 1 --2- 172.21.15.112:0/658243831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e681460a0 0x7f6e680aee10 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000c7a0 tx=0x7f6e6000cc60 comp rx=0 tx=0).stop 2024-09-12T02:52:51.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.509+0000 7f6e6e200640 1 -- 172.21.15.112:0/658243831 shutdown_connections 2024-09-12T02:52:51.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.509+0000 7f6e6e200640 1 --2- 172.21.15.112:0/658243831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e681460a0 0x7f6e680aee10 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.509+0000 7f6e6e200640 1 --2- 172.21.15.112:0/658243831 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6e4406be30 0x7f6e4406e2f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.509+0000 7f6e6e200640 1 --2- 172.21.15.112:0/658243831 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e68145a90 0x7f6e680ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.509+0000 7f6e6e200640 1 --2- 172.21.15.112:0/658243831 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e680d0510 0x7f6e681413f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.509+0000 7f6e6e200640 1 -- 172.21.15.112:0/658243831 >> 172.21.15.112:0/658243831 conn(0x7f6e680b26c0 msgr2=0x7f6e680b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:51.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.509+0000 7f6e6e200640 1 -- 172.21.15.112:0/658243831 shutdown_connections 2024-09-12T02:52:51.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.509+0000 7f6e6e200640 1 -- 172.21.15.112:0/658243831 wait complete. 2024-09-12T02:52:51.525 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T02:52:51.525 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T02:52:51.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.680+0000 7f29c0a00640 1 Processor -- start 2024-09-12T02:52:51.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.680+0000 7f29c0a00640 1 -- start start 2024-09-12T02:52:51.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.681+0000 7f29c0a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f29bc162370 0x7f29bc0d2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.681+0000 7f29c0a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29bc162750 0x7f29bc0d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.681+0000 7f29c0a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f29bc0d36f0 0x7f29bc0b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.681+0000 7f29c0a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f29bc0d1b70 con 0x7f29bc0d36f0 2024-09-12T02:52:51.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.681+0000 7f29c0a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f29bc0b3de0 con 0x7f29bc162370 2024-09-12T02:52:51.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.681+0000 7f29c0a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f29bc0b40c0 con 0x7f29bc162750 2024-09-12T02:52:51.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.681+0000 7f29bbe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f29bc0d36f0 0x7f29bc0b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:51.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.681+0000 7f29bbe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f29bc0d36f0 0x7f29bc0b1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42330/0 (socket says 172.21.15.112:42330) 2024-09-12T02:52:51.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.681+0000 7f29bbe00640 1 -- 172.21.15.112:0/3832877707 learned_addr learned my addr 172.21.15.112:0/3832877707 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:51.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.682+0000 7f29b2a00640 1 --2- 172.21.15.112:0/3832877707 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29bc162750 0x7f29bc0d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:51.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.682+0000 7f29bb400640 1 --2- 172.21.15.112:0/3832877707 >> v2:172.21.15.137:3300/0 conn(0x7f29bc162370 0x7f29bc0d2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:51.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.682+0000 7f29bbe00640 1 -- 172.21.15.112:0/3832877707 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29bc162750 msgr2=0x7f29bc0d31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:51.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.682+0000 7f29bbe00640 1 --2- 172.21.15.112:0/3832877707 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29bc162750 0x7f29bc0d31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.682+0000 7f29bbe00640 1 -- 172.21.15.112:0/3832877707 >> v2:172.21.15.137:3300/0 conn(0x7f29bc162370 msgr2=0x7f29bc0d2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:51.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.682+0000 7f29bbe00640 1 --2- 172.21.15.112:0/3832877707 >> v2:172.21.15.137:3300/0 conn(0x7f29bc162370 0x7f29bc0d2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.682+0000 7f29bbe00640 1 -- 172.21.15.112:0/3832877707 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29bc0d1e30 con 0x7f29bc0d36f0 2024-09-12T02:52:51.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.683+0000 7f29bbe00640 1 --2- 172.21.15.112:0/3832877707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29bc0d36f0 0x7f29bc0b1a00 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f29bc08da60 tx=0x7f29b402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dccd09713f1d4249 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:51.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.683+0000 7f29baa00640 1 -- 172.21.15.112:0/3832877707 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b4037070 con 0x7f29bc0d36f0 2024-09-12T02:52:51.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.683+0000 7f29baa00640 1 -- 172.21.15.112:0/3832877707 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b4032440 con 0x7f29bc0d36f0 2024-09-12T02:52:51.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.683+0000 7f29baa00640 1 -- 172.21.15.112:0/3832877707 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b4032810 con 0x7f29bc0d36f0 2024-09-12T02:52:51.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.684+0000 7f29c0a00640 1 -- 172.21.15.112:0/3832877707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29bc0d36f0 msgr2=0x7f29bc0b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:51.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.684+0000 7f29c0a00640 1 --2- 172.21.15.112:0/3832877707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29bc0d36f0 0x7f29bc0b1a00 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f29bc08da60 tx=0x7f29b402a140 comp rx=0 tx=0).stop 2024-09-12T02:52:51.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.684+0000 7f29c0a00640 1 -- 172.21.15.112:0/3832877707 shutdown_connections 2024-09-12T02:52:51.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.684+0000 7f29c0a00640 1 --2- 172.21.15.112:0/3832877707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29bc0d36f0 0x7f29bc0b1a00 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.684+0000 7f29c0a00640 1 --2- 172.21.15.112:0/3832877707 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29bc162750 0x7f29bc0d31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.684+0000 7f29c0a00640 1 --2- 172.21.15.112:0/3832877707 >> v2:172.21.15.137:3300/0 conn(0x7f29bc162370 0x7f29bc0d2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.684+0000 7f29c0a00640 1 -- 172.21.15.112:0/3832877707 >> 172.21.15.112:0/3832877707 conn(0x7f29bc0d4d70 msgr2=0x7f29bc0d5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:51.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.684+0000 7f29c0a00640 1 -- 172.21.15.112:0/3832877707 shutdown_connections 2024-09-12T02:52:51.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.684+0000 7f29c0a00640 1 -- 172.21.15.112:0/3832877707 wait complete. 2024-09-12T02:52:51.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.685+0000 7f29c0a00640 1 Processor -- start 2024-09-12T02:52:51.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.685+0000 7f29c0a00640 1 -- start start 2024-09-12T02:52:51.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.686+0000 7f29c0a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29bc0d36f0 0x7f29bc15eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.686+0000 7f29c0a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29bc162370 0x7f29bc15a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.686+0000 7f29c0a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29bc162750 0x7f29bc0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.686+0000 7f29c0a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f29bc0b3ab0 con 0x7f29bc0d36f0 2024-09-12T02:52:51.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.686+0000 7f29c0a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f29bc0d2630 con 0x7f29bc162750 2024-09-12T02:52:51.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.686+0000 7f29c0a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f29bc0b1f40 con 0x7f29bc162370 2024-09-12T02:52:51.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.687+0000 7f29bb400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29bc0d36f0 0x7f29bc15eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:51.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.687+0000 7f29bb400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29bc0d36f0 0x7f29bc15eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42340/0 (socket says 172.21.15.112:42340) 2024-09-12T02:52:51.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.687+0000 7f29bb400640 1 -- 172.21.15.112:0/1475434194 learned_addr learned my addr 172.21.15.112:0/1475434194 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:51.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.687+0000 7f29b2a00640 1 --2- 172.21.15.112:0/1475434194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29bc162370 0x7f29bc15a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:51.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.687+0000 7f29bbe00640 1 --2- 172.21.15.112:0/1475434194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29bc162750 0x7f29bc0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:51.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.687+0000 7f29bb400640 1 -- 172.21.15.112:0/1475434194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29bc162370 msgr2=0x7f29bc15a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:51.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.687+0000 7f29bb400640 1 --2- 172.21.15.112:0/1475434194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29bc162370 0x7f29bc15a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.687+0000 7f29bb400640 1 -- 172.21.15.112:0/1475434194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29bc162750 msgr2=0x7f29bc0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:51.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.687+0000 7f29bb400640 1 --2- 172.21.15.112:0/1475434194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29bc162750 0x7f29bc0cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:51.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.687+0000 7f29bb400640 1 -- 172.21.15.112:0/1475434194 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29bc0cf2b0 con 0x7f29bc0d36f0 2024-09-12T02:52:51.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.687+0000 7f29bb400640 1 --2- 172.21.15.112:0/1475434194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29bc0d36f0 0x7f29bc15eae0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f29ac007e90 tx=0x7f29ac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:51.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.688+0000 7f29b3e00640 1 -- 172.21.15.112:0/1475434194 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac014620 con 0x7f29bc0d36f0 2024-09-12T02:52:51.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.688+0000 7f29b3e00640 1 -- 172.21.15.112:0/1475434194 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29ac019070 con 0x7f29bc0d36f0 2024-09-12T02:52:51.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.688+0000 7f29c0a00640 1 -- 172.21.15.112:0/1475434194 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29bc0cc290 con 0x7f29bc0d36f0 2024-09-12T02:52:51.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.688+0000 7f29b3e00640 1 -- 172.21.15.112:0/1475434194 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac014a00 con 0x7f29bc0d36f0 2024-09-12T02:52:51.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.688+0000 7f29c0a00640 1 -- 172.21.15.112:0/1475434194 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29bc0ceab0 con 0x7f29bc0d36f0 2024-09-12T02:52:51.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.689+0000 7f29c0a00640 1 -- 172.21.15.112:0/1475434194 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29bc0b1a00 con 0x7f29bc0d36f0 2024-09-12T02:52:51.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.690+0000 7f29b3e00640 1 -- 172.21.15.112:0/1475434194 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f29ac014ba0 con 0x7f29bc0d36f0 2024-09-12T02:52:51.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.691+0000 7f29b3e00640 1 --2- 172.21.15.112:0/1475434194 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f299806be30 0x7f299806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:51.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.691+0000 7f29b3e00640 1 -- 172.21.15.112:0/1475434194 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 4857+0+0 (secure 0 0 0) 0x7f29ac08b480 con 0x7f29bc0d36f0 2024-09-12T02:52:51.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.691+0000 7f29b2a00640 1 --2- 172.21.15.112:0/1475434194 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f299806be30 0x7f299806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:51.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.691+0000 7f29b2a00640 1 --2- 172.21.15.112:0/1475434194 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f299806be30 0x7f299806e2f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f29a4006fd0 tx=0x7f29a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:51.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.695+0000 7f29b3e00640 1 -- 172.21.15.112:0/1475434194 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f29ac05a0e0 con 0x7f29bc0d36f0 2024-09-12T02:52:51.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:51.868+0000 7f29c0a00640 1 -- 172.21.15.112:0/1475434194 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f29bc0ce5c0 con 0x7f29bc0d36f0 2024-09-12T02:52:52.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.721+0000 7f29b3e00640 1 -- 172.21.15.112:0/1475434194 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v180) ==== 138+0+0 (secure 0 0 0) 0x7f29ac0599e0 con 0x7f29bc0d36f0 2024-09-12T02:52:52.722 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' created 2024-09-12T02:52:52.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.724+0000 7f29c0a00640 1 -- 172.21.15.112:0/1475434194 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f299806be30 msgr2=0x7f299806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:52.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.724+0000 7f29c0a00640 1 --2- 172.21.15.112:0/1475434194 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f299806be30 0x7f299806e2f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f29a4006fd0 tx=0x7f29a4008040 comp rx=0 tx=0).stop 2024-09-12T02:52:52.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.724+0000 7f29c0a00640 1 -- 172.21.15.112:0/1475434194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29bc0d36f0 msgr2=0x7f29bc15eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:52.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.724+0000 7f29c0a00640 1 --2- 172.21.15.112:0/1475434194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29bc0d36f0 0x7f29bc15eae0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f29ac007e90 tx=0x7f29ac00e4b0 comp rx=0 tx=0).stop 2024-09-12T02:52:52.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.724+0000 7f29c0a00640 1 -- 172.21.15.112:0/1475434194 shutdown_connections 2024-09-12T02:52:52.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.724+0000 7f29c0a00640 1 --2- 172.21.15.112:0/1475434194 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f299806be30 0x7f299806e2f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:52.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.724+0000 7f29c0a00640 1 --2- 172.21.15.112:0/1475434194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29bc162750 0x7f29bc0cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:52.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.724+0000 7f29c0a00640 1 --2- 172.21.15.112:0/1475434194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29bc162370 0x7f29bc15a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:52.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.724+0000 7f29c0a00640 1 --2- 172.21.15.112:0/1475434194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29bc0d36f0 0x7f29bc15eae0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:52.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.724+0000 7f29c0a00640 1 -- 172.21.15.112:0/1475434194 >> 172.21.15.112:0/1475434194 conn(0x7f29bc0d4d70 msgr2=0x7f29bc0cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:52.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.724+0000 7f29c0a00640 1 -- 172.21.15.112:0/1475434194 shutdown_connections 2024-09-12T02:52:52.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.724+0000 7f29c0a00640 1 -- 172.21.15.112:0/1475434194 wait complete. 2024-09-12T02:52:52.746 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:52:52.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.907+0000 7fe917000640 1 Processor -- start 2024-09-12T02:52:52.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.907+0000 7fe917000640 1 -- start start 2024-09-12T02:52:52.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.909+0000 7fe917000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe91015f080 0x7fe9100d2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:52.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.909+0000 7fe917000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9100d2660 con 0x7fe9100d59e0 2024-09-12T02:52:52.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.909+0000 7fe917000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9100cf810 con 0x7fe9100d3490 2024-09-12T02:52:52.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.909+0000 7fe917000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe9100cfa90 con 0x7fe91015f080 2024-09-12T02:52:52.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.909+0000 7fe915200640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe9100d59e0 0x7fe9100d2d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:42960/0 (socket says 172.21.15.112:42960) 2024-09-12T02:52:52.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.909+0000 7fe915200640 1 -- 172.21.15.112:0/2413378859 learned_addr learned my addr 172.21.15.112:0/2413378859 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:52:52.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.909+0000 7fe915c00640 1 --2- 172.21.15.112:0/2413378859 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe91015f080 0x7fe9100d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:52.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.910+0000 7fe90fe00640 1 -- 172.21.15.112:0/2413378859 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 407774456 0 0) 0x7fe9100d2660 con 0x7fe9100d59e0 2024-09-12T02:52:52.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.910+0000 7fe90fe00640 1 -- 172.21.15.112:0/2413378859 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8f8003520 con 0x7fe9100d59e0 2024-09-12T02:52:52.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.910+0000 7fe90fe00640 1 -- 172.21.15.112:0/2413378859 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 893350567 0 0) 0x7fe908001490 con 0x7fe9100d3490 2024-09-12T02:52:52.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.910+0000 7fe90fe00640 1 -- 172.21.15.112:0/2413378859 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9100d2660 con 0x7fe9100d3490 2024-09-12T02:52:52.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.910+0000 7fe915c00640 1 -- 172.21.15.112:0/2413378859 >> v1:172.21.15.137:6789/0 conn(0x7fe9100d3490 legacy=0x7fe9100b7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:52.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.910+0000 7fe915c00640 1 -- 172.21.15.112:0/2413378859 >> v1:172.21.15.112:6789/0 conn(0x7fe9100d59e0 legacy=0x7fe9100d2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:52.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.910+0000 7fe915c00640 1 -- 172.21.15.112:0/2413378859 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9100cfd70 con 0x7fe91015f080 2024-09-12T02:52:52.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.911+0000 7fe915c00640 1 --2- 172.21.15.112:0/2413378859 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe91015f080 0x7fe9100d2120 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe9040097d0 tx=0x7fe90402a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19879c18c6144611 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:52.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.911+0000 7fe90fe00640 1 -- 172.21.15.112:0/2413378859 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe904037070 con 0x7fe91015f080 2024-09-12T02:52:52.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.911+0000 7fe90fe00640 1 -- 172.21.15.112:0/2413378859 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe904032440 con 0x7fe91015f080 2024-09-12T02:52:52.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.911+0000 7fe90fe00640 1 -- 172.21.15.112:0/2413378859 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9040327f0 con 0x7fe91015f080 2024-09-12T02:52:52.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.912+0000 7fe917000640 1 -- 172.21.15.112:0/2413378859 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe91015f080 msgr2=0x7fe9100d2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:52.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.912+0000 7fe917000640 1 --2- 172.21.15.112:0/2413378859 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe91015f080 0x7fe9100d2120 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe9040097d0 tx=0x7fe90402a290 comp rx=0 tx=0).stop 2024-09-12T02:52:52.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.912+0000 7fe917000640 1 -- 172.21.15.112:0/2413378859 shutdown_connections 2024-09-12T02:52:52.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.912+0000 7fe917000640 1 --2- 172.21.15.112:0/2413378859 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe91015f080 0x7fe9100d2120 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:52.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.912+0000 7fe917000640 1 -- 172.21.15.112:0/2413378859 >> 172.21.15.112:0/2413378859 conn(0x7fe9100d4d00 msgr2=0x7fe9100d5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:52.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.912+0000 7fe917000640 1 -- 172.21.15.112:0/2413378859 shutdown_connections 2024-09-12T02:52:52.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.912+0000 7fe917000640 1 -- 172.21.15.112:0/2413378859 wait complete. 2024-09-12T02:52:52.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.913+0000 7fe917000640 1 Processor -- start 2024-09-12T02:52:52.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.914+0000 7fe917000640 1 -- start start 2024-09-12T02:52:52.914 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:52:52.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.914+0000 7fe917000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9100d3490 0x7fe91015db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:52.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.914+0000 7fe917000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9100d59e0 0x7fe9100cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:52.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.914+0000 7fe917000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe91015f080 0x7fe9100cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:52.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.914+0000 7fe917000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe9100d0610 con 0x7fe9100d3490 2024-09-12T02:52:52.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.915+0000 7fe917000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe9100d0330 con 0x7fe9100d59e0 2024-09-12T02:52:52.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.915+0000 7fe917000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe9100d0b30 con 0x7fe91015f080 2024-09-12T02:52:52.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.915+0000 7fe915c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9100d3490 0x7fe91015db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:52.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.915+0000 7fe915c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9100d3490 0x7fe91015db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57736/0 (socket says 172.21.15.112:57736) 2024-09-12T02:52:52.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.915+0000 7fe915c00640 1 -- 172.21.15.112:0/1717438741 learned_addr learned my addr 172.21.15.112:0/1717438741 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:52.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.915+0000 7fe915200640 1 --2- 172.21.15.112:0/1717438741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9100d59e0 0x7fe9100cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:52.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.915+0000 7fe916600640 1 --2- 172.21.15.112:0/1717438741 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe91015f080 0x7fe9100cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:52.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.915+0000 7fe915c00640 1 -- 172.21.15.112:0/1717438741 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe91015f080 msgr2=0x7fe9100cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:52.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.915+0000 7fe915c00640 1 --2- 172.21.15.112:0/1717438741 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe91015f080 0x7fe9100cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:52.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.915+0000 7fe915c00640 1 -- 172.21.15.112:0/1717438741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9100d59e0 msgr2=0x7fe9100cc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:52.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.915+0000 7fe915c00640 1 --2- 172.21.15.112:0/1717438741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9100d59e0 0x7fe9100cc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:52.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.915+0000 7fe915c00640 1 -- 172.21.15.112:0/1717438741 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91009eee0 con 0x7fe9100d3490 2024-09-12T02:52:52.919 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:52:52.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.916+0000 7fe915c00640 1 --2- 172.21.15.112:0/1717438741 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9100d3490 0x7fe91015db50 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fe90402a2d0 tx=0x7fe9040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:52.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.916+0000 7fe90d600640 1 -- 172.21.15.112:0/1717438741 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe904037040 con 0x7fe9100d3490 2024-09-12T02:52:52.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.916+0000 7fe90d600640 1 -- 172.21.15.112:0/1717438741 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9040044c0 con 0x7fe9100d3490 2024-09-12T02:52:52.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.916+0000 7fe917000640 1 -- 172.21.15.112:0/1717438741 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9100cd400 con 0x7fe9100d3490 2024-09-12T02:52:52.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.916+0000 7fe90d600640 1 -- 172.21.15.112:0/1717438741 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9040325f0 con 0x7fe9100d3490 2024-09-12T02:52:52.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.916+0000 7fe917000640 1 -- 172.21.15.112:0/1717438741 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe91009eb20 con 0x7fe9100d3490 2024-09-12T02:52:52.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.917+0000 7fe917000640 1 -- 172.21.15.112:0/1717438741 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9100cbdb0 con 0x7fe9100d3490 2024-09-12T02:52:52.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.918+0000 7fe90d600640 1 -- 172.21.15.112:0/1717438741 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe904044020 con 0x7fe9100d3490 2024-09-12T02:52:52.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.919+0000 7fe90d600640 1 --2- 172.21.15.112:0/1717438741 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe8f006be30 0x7fe8f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:52.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.919+0000 7fe90d600640 1 -- 172.21.15.112:0/1717438741 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 5227+0+0 (secure 0 0 0) 0x7fe9040ab5a0 con 0x7fe9100d3490 2024-09-12T02:52:52.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.920+0000 7fe915200640 1 --2- 172.21.15.112:0/1717438741 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe8f006be30 0x7fe8f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:52.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.920+0000 7fe915200640 1 --2- 172.21.15.112:0/1717438741 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe8f006be30 0x7fe8f006e2f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe91009f320 tx=0x7fe8fc007d70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:52.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:52.924+0000 7fe90d600640 1 -- 172.21.15.112:0/1717438741 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe90404b020 con 0x7fe9100d3490 2024-09-12T02:52:53.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.105+0000 7fe917000640 1 -- 172.21.15.112:0/1717438741 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe9100d2120 con 0x7fe9100d3490 2024-09-12T02:52:53.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.727+0000 7fe90d600640 1 -- 172.21.15.112:0/1717438741 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v181) ==== 170+0+0 (secure 0 0 0) 0x7fe904079ac0 con 0x7fe9100d3490 2024-09-12T02:52:53.728 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' created 2024-09-12T02:52:53.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.730+0000 7fe917000640 1 -- 172.21.15.112:0/1717438741 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe8f006be30 msgr2=0x7fe8f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:53.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.730+0000 7fe917000640 1 --2- 172.21.15.112:0/1717438741 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe8f006be30 0x7fe8f006e2f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe91009f320 tx=0x7fe8fc007d70 comp rx=0 tx=0).stop 2024-09-12T02:52:53.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.730+0000 7fe917000640 1 -- 172.21.15.112:0/1717438741 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9100d3490 msgr2=0x7fe91015db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:53.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.730+0000 7fe917000640 1 --2- 172.21.15.112:0/1717438741 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9100d3490 0x7fe91015db50 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fe90402a2d0 tx=0x7fe9040046c0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.731+0000 7fe917000640 1 -- 172.21.15.112:0/1717438741 shutdown_connections 2024-09-12T02:52:53.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.731+0000 7fe917000640 1 --2- 172.21.15.112:0/1717438741 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe91015f080 0x7fe9100cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.731+0000 7fe917000640 1 --2- 172.21.15.112:0/1717438741 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe8f006be30 0x7fe8f006e2f0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.731+0000 7fe917000640 1 --2- 172.21.15.112:0/1717438741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9100d59e0 0x7fe9100cc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.731+0000 7fe917000640 1 --2- 172.21.15.112:0/1717438741 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9100d3490 0x7fe91015db50 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.731+0000 7fe917000640 1 -- 172.21.15.112:0/1717438741 >> 172.21.15.112:0/1717438741 conn(0x7fe9100d4d00 msgr2=0x7fe910161f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:53.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.732+0000 7fe917000640 1 -- 172.21.15.112:0/1717438741 shutdown_connections 2024-09-12T02:52:53.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.732+0000 7fe917000640 1 -- 172.21.15.112:0/1717438741 wait complete. 2024-09-12T02:52:53.757 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T02:52:53.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.922+0000 7fb037200640 1 Processor -- start 2024-09-12T02:52:53.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.922+0000 7fb037200640 1 -- start start 2024-09-12T02:52:53.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.923+0000 7fb037200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb030162100 0x7fb0300d58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:53.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.923+0000 7fb037200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb0300d0510 0x7fb0300d0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:53.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.923+0000 7fb037200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0300cfa70 con 0x7fb0301624e0 2024-09-12T02:52:53.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.923+0000 7fb037200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb0300b4e20 con 0x7fb0300d0510 2024-09-12T02:52:53.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.923+0000 7fb037200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb0300d21d0 con 0x7fb030162100 2024-09-12T02:52:53.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.923+0000 7fb035200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb0300d0510 0x7fb0300d0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:53.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.923+0000 7fb02f400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb0301624e0 0x7fb0300b4710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:42970/0 (socket says 172.21.15.112:42970) 2024-09-12T02:52:53.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.923+0000 7fb02f400640 1 -- 172.21.15.112:0/4279899556 learned_addr learned my addr 172.21.15.112:0/4279899556 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:52:53.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.924+0000 7fb035200640 1 -- 172.21.15.112:0/4279899556 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb030162100 msgr2=0x7fb0300d58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:53.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.924+0000 7fb035200640 1 --2- 172.21.15.112:0/4279899556 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb030162100 0x7fb0300d58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.924+0000 7fb035200640 1 -- 172.21.15.112:0/4279899556 >> v1:172.21.15.112:6789/0 conn(0x7fb0301624e0 legacy=0x7fb0300b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:53.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.924+0000 7fb035200640 1 -- 172.21.15.112:0/4279899556 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0300d24b0 con 0x7fb0300d0510 2024-09-12T02:52:53.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.924+0000 7fb02ea00640 1 -- 172.21.15.112:0/4279899556 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3682196418 0 0) 0x7fb0300cfa70 con 0x7fb0301624e0 2024-09-12T02:52:53.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.925+0000 7fb035200640 1 --2- 172.21.15.112:0/4279899556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0300d0510 0x7fb0300d0940 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fb0300cfc40 tx=0x7fb02802a0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a228b7c7b5ecd03 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:53.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.925+0000 7fb02ea00640 1 -- 172.21.15.112:0/4279899556 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb028037070 con 0x7fb0300d0510 2024-09-12T02:52:53.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.925+0000 7fb02ea00640 1 -- 172.21.15.112:0/4279899556 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb02802ae30 con 0x7fb0300d0510 2024-09-12T02:52:53.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.925+0000 7fb02ea00640 1 -- 172.21.15.112:0/4279899556 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb028032640 con 0x7fb0300d0510 2024-09-12T02:52:53.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.926+0000 7fb037200640 1 -- 172.21.15.112:0/4279899556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0300d0510 msgr2=0x7fb0300d0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:53.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.926+0000 7fb037200640 1 --2- 172.21.15.112:0/4279899556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0300d0510 0x7fb0300d0940 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fb0300cfc40 tx=0x7fb02802a0e0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.926+0000 7fb037200640 1 -- 172.21.15.112:0/4279899556 shutdown_connections 2024-09-12T02:52:53.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.926+0000 7fb037200640 1 --2- 172.21.15.112:0/4279899556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0300d0510 0x7fb0300d0940 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.926+0000 7fb037200640 1 --2- 172.21.15.112:0/4279899556 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb030162100 0x7fb0300d58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.926+0000 7fb037200640 1 -- 172.21.15.112:0/4279899556 >> 172.21.15.112:0/4279899556 conn(0x7fb0300d4db0 msgr2=0x7fb0300d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:53.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.926+0000 7fb037200640 1 -- 172.21.15.112:0/4279899556 shutdown_connections 2024-09-12T02:52:53.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.926+0000 7fb037200640 1 -- 172.21.15.112:0/4279899556 wait complete. 2024-09-12T02:52:53.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.927+0000 7fb037200640 1 Processor -- start 2024-09-12T02:52:53.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.927+0000 7fb037200640 1 -- start start 2024-09-12T02:52:53.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.928+0000 7fb037200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0300d0510 0x7fb0300ce330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:53.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.928+0000 7fb037200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb030162100 0x7fb0301f3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:53.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.928+0000 7fb037200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0301624e0 0x7fb0301f42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:53.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.928+0000 7fb037200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb0300d0e80 con 0x7fb0300d0510 2024-09-12T02:52:53.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.928+0000 7fb037200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb0300cfff0 con 0x7fb0301624e0 2024-09-12T02:52:53.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.928+0000 7fb037200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb0300d1df0 con 0x7fb030162100 2024-09-12T02:52:53.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.929+0000 7fb02fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0300d0510 0x7fb0300ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:53.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.929+0000 7fb02fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0300d0510 0x7fb0300ce330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57764/0 (socket says 172.21.15.112:57764) 2024-09-12T02:52:53.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.929+0000 7fb02fe00640 1 -- 172.21.15.112:0/3132067946 learned_addr learned my addr 172.21.15.112:0/3132067946 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:53.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.929+0000 7fb02f400640 1 --2- 172.21.15.112:0/3132067946 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb030162100 0x7fb0301f3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:53.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.929+0000 7fb02fe00640 1 -- 172.21.15.112:0/3132067946 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb030162100 msgr2=0x7fb0301f3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:53.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.929+0000 7fb02fe00640 1 --2- 172.21.15.112:0/3132067946 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb030162100 0x7fb0301f3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.929+0000 7fb035200640 1 --2- 172.21.15.112:0/3132067946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0301624e0 0x7fb0301f42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:53.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.929+0000 7fb02fe00640 1 -- 172.21.15.112:0/3132067946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0301624e0 msgr2=0x7fb0301f42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:53.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.929+0000 7fb02fe00640 1 --2- 172.21.15.112:0/3132067946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0301624e0 0x7fb0301f42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:53.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.929+0000 7fb02fe00640 1 -- 172.21.15.112:0/3132067946 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0300cce50 con 0x7fb0300d0510 2024-09-12T02:52:53.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.929+0000 7fb02f400640 1 --2- 172.21.15.112:0/3132067946 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb030162100 0x7fb0301f3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:52:53.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.929+0000 7fb035200640 1 --2- 172.21.15.112:0/3132067946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0301624e0 0x7fb0301f42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:52:53.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.929+0000 7fb02fe00640 1 --2- 172.21.15.112:0/3132067946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0300d0510 0x7fb0300ce330 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fb02000ba80 tx=0x7fb02000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:53.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.930+0000 7fb027e00640 1 -- 172.21.15.112:0/3132067946 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb020019070 con 0x7fb0300d0510 2024-09-12T02:52:53.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.930+0000 7fb027e00640 1 -- 172.21.15.112:0/3132067946 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb02000cc20 con 0x7fb0300d0510 2024-09-12T02:52:53.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.930+0000 7fb027e00640 1 -- 172.21.15.112:0/3132067946 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb020014440 con 0x7fb0300d0510 2024-09-12T02:52:53.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.930+0000 7fb037200640 1 -- 172.21.15.112:0/3132067946 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0300cd130 con 0x7fb0300d0510 2024-09-12T02:52:53.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.930+0000 7fb037200640 1 -- 172.21.15.112:0/3132067946 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0300b8cf0 con 0x7fb0300d0510 2024-09-12T02:52:53.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.931+0000 7fb037200640 1 -- 172.21.15.112:0/3132067946 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb030162b80 con 0x7fb0300d0510 2024-09-12T02:52:53.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.932+0000 7fb027e00640 1 -- 172.21.15.112:0/3132067946 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb02001c070 con 0x7fb0300d0510 2024-09-12T02:52:53.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.932+0000 7fb027e00640 1 --2- 172.21.15.112:0/3132067946 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb01006be30 0x7fb01006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:53.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.933+0000 7fb027e00640 1 -- 172.21.15.112:0/3132067946 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 5609+0+0 (secure 0 0 0) 0x7fb02008ac20 con 0x7fb0300d0510 2024-09-12T02:52:53.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.933+0000 7fb02f400640 1 --2- 172.21.15.112:0/3132067946 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb01006be30 0x7fb01006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:53.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.933+0000 7fb02f400640 1 --2- 172.21.15.112:0/3132067946 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb01006be30 0x7fb01006e2f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb030160eb0 tx=0x7fb01c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:53.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:53.937+0000 7fb027e00640 1 -- 172.21.15.112:0/3132067946 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb020058ec0 con 0x7fb0300d0510 2024-09-12T02:52:54.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.147+0000 7fb037200640 1 -- 172.21.15.112:0/3132067946 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb0300b36f0 con 0x7fb0300d0510 2024-09-12T02:52:54.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.729+0000 7fb027e00640 1 -- 172.21.15.112:0/3132067946 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v90) ==== 174+0+0 (secure 0 0 0) 0x7fb02005d1c0 con 0x7fb0300d0510 2024-09-12T02:52:54.731 INFO:teuthology.orchestra.run.smithi112.stderr:new fs with metadata pool 22 and data pool 23 2024-09-12T02:52:54.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.734+0000 7fb037200640 1 -- 172.21.15.112:0/3132067946 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb01006be30 msgr2=0x7fb01006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:54.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.734+0000 7fb037200640 1 --2- 172.21.15.112:0/3132067946 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb01006be30 0x7fb01006e2f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb030160eb0 tx=0x7fb01c009040 comp rx=0 tx=0).stop 2024-09-12T02:52:54.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.734+0000 7fb037200640 1 -- 172.21.15.112:0/3132067946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0300d0510 msgr2=0x7fb0300ce330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:54.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.734+0000 7fb037200640 1 --2- 172.21.15.112:0/3132067946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0300d0510 0x7fb0300ce330 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fb02000ba80 tx=0x7fb02000bf40 comp rx=0 tx=0).stop 2024-09-12T02:52:54.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.735+0000 7fb037200640 1 -- 172.21.15.112:0/3132067946 shutdown_connections 2024-09-12T02:52:54.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.735+0000 7fb037200640 1 --2- 172.21.15.112:0/3132067946 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb01006be30 0x7fb01006e2f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:54.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.735+0000 7fb037200640 1 --2- 172.21.15.112:0/3132067946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0301624e0 0x7fb0301f42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:54.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.735+0000 7fb037200640 1 --2- 172.21.15.112:0/3132067946 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb030162100 0x7fb0301f3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:54.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.735+0000 7fb037200640 1 --2- 172.21.15.112:0/3132067946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0300d0510 0x7fb0300ce330 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:54.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.735+0000 7fb037200640 1 -- 172.21.15.112:0/3132067946 >> 172.21.15.112:0/3132067946 conn(0x7fb0300d4db0 msgr2=0x7fb03006de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:54.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.736+0000 7fb037200640 1 -- 172.21.15.112:0/3132067946 shutdown_connections 2024-09-12T02:52:54.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.736+0000 7fb037200640 1 -- 172.21.15.112:0/3132067946 wait complete. 2024-09-12T02:52:54.766 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:52:54.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.918+0000 7f3bee200640 1 Processor -- start 2024-09-12T02:52:54.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.918+0000 7f3bee200640 1 -- start start 2024-09-12T02:52:54.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.919+0000 7f3bee200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3be815c800 0x7f3be80708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:54.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.919+0000 7f3bee200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3be80b0770 0x7f3be815f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:54.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.919+0000 7f3bee200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3be815fd00 0x7f3be80b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:54.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.919+0000 7f3bee200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f3be80b0c70 con 0x7f3be80b0770 2024-09-12T02:52:54.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.919+0000 7f3bee200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3be80b0f50 con 0x7f3be815fd00 2024-09-12T02:52:54.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.919+0000 7f3bee200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3be80b1230 con 0x7f3be815c800 2024-09-12T02:52:54.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.919+0000 7f3be7e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3be80b0770 0x7f3be815f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:54.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.919+0000 7f3be7e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3be80b0770 0x7f3be815f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57768/0 (socket says 172.21.15.112:57768) 2024-09-12T02:52:54.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.919+0000 7f3be7e00640 1 -- 172.21.15.112:0/1834606017 learned_addr learned my addr 172.21.15.112:0/1834606017 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:54.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.920+0000 7f3bed800640 1 --2- 172.21.15.112:0/1834606017 >> v2:172.21.15.137:3300/0 conn(0x7f3be815fd00 0x7f3be80b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:54.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.920+0000 7f3bece00640 1 --2- 172.21.15.112:0/1834606017 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3be815c800 0x7f3be80708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:54.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.920+0000 7f3be7e00640 1 -- 172.21.15.112:0/1834606017 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3be815c800 msgr2=0x7f3be80708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:54.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.920+0000 7f3be7e00640 1 --2- 172.21.15.112:0/1834606017 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3be815c800 0x7f3be80708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:54.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.920+0000 7f3be7e00640 1 -- 172.21.15.112:0/1834606017 >> v2:172.21.15.137:3300/0 conn(0x7f3be815fd00 msgr2=0x7f3be80b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:54.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.920+0000 7f3be7e00640 1 --2- 172.21.15.112:0/1834606017 >> v2:172.21.15.137:3300/0 conn(0x7f3be815fd00 0x7f3be80b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:54.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.920+0000 7f3be7e00640 1 -- 172.21.15.112:0/1834606017 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3be815f2a0 con 0x7f3be80b0770 2024-09-12T02:52:54.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.920+0000 7f3bece00640 1 --2- 172.21.15.112:0/1834606017 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3be815c800 0x7f3be80708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:52:54.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.921+0000 7f3be7e00640 1 --2- 172.21.15.112:0/1834606017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3be80b0770 0x7f3be815f7c0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f3be806e2b0 tx=0x7f3bd402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b800bc01907556b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:54.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.921+0000 7f3be7400640 1 -- 172.21.15.112:0/1834606017 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd4037070 con 0x7f3be80b0770 2024-09-12T02:52:54.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.921+0000 7f3be7400640 1 -- 172.21.15.112:0/1834606017 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bd4032440 con 0x7f3be80b0770 2024-09-12T02:52:54.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.921+0000 7f3be7400640 1 -- 172.21.15.112:0/1834606017 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd4032810 con 0x7f3be80b0770 2024-09-12T02:52:54.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.922+0000 7f3bee200640 1 -- 172.21.15.112:0/1834606017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3be80b0770 msgr2=0x7f3be815f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:54.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.922+0000 7f3bee200640 1 --2- 172.21.15.112:0/1834606017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3be80b0770 0x7f3be815f7c0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f3be806e2b0 tx=0x7f3bd402a140 comp rx=0 tx=0).stop 2024-09-12T02:52:54.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.922+0000 7f3bee200640 1 -- 172.21.15.112:0/1834606017 shutdown_connections 2024-09-12T02:52:54.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.922+0000 7f3bee200640 1 --2- 172.21.15.112:0/1834606017 >> v2:172.21.15.137:3300/0 conn(0x7f3be815fd00 0x7f3be80b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:54.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.922+0000 7f3bee200640 1 --2- 172.21.15.112:0/1834606017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3be80b0770 0x7f3be815f7c0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:54.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.922+0000 7f3bee200640 1 --2- 172.21.15.112:0/1834606017 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3be815c800 0x7f3be80708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:54.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.922+0000 7f3bee200640 1 -- 172.21.15.112:0/1834606017 >> 172.21.15.112:0/1834606017 conn(0x7f3be806cce0 msgr2=0x7f3be806d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:54.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.922+0000 7f3bee200640 1 -- 172.21.15.112:0/1834606017 shutdown_connections 2024-09-12T02:52:54.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.922+0000 7f3bee200640 1 -- 172.21.15.112:0/1834606017 wait complete. 2024-09-12T02:52:54.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.924+0000 7f3bee200640 1 Processor -- start 2024-09-12T02:52:54.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.924+0000 7f3bee200640 1 -- start start 2024-09-12T02:52:54.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.924+0000 7f3bee200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3be80b0770 0x7f3be80af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:54.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.925+0000 7f3bee200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3be815c800 0x7f3be814dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:54.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.925+0000 7f3bee200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3be815fd00 0x7f3be80b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:54.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.925+0000 7f3bee200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3be80b5220 con 0x7f3be815c800 2024-09-12T02:52:54.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.925+0000 7f3bee200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3be806f3f0 con 0x7f3be80b0770 2024-09-12T02:52:54.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.925+0000 7f3bee200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3be80b53a0 con 0x7f3be815fd00 2024-09-12T02:52:54.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.925+0000 7f3be7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3be815c800 0x7f3be814dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:54.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.925+0000 7f3be7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3be815c800 0x7f3be814dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57776/0 (socket says 172.21.15.112:57776) 2024-09-12T02:52:54.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.925+0000 7f3be7e00640 1 -- 172.21.15.112:0/2287115114 learned_addr learned my addr 172.21.15.112:0/2287115114 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:54.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.925+0000 7f3bece00640 1 --2- 172.21.15.112:0/2287115114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3be80b0770 0x7f3be80af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:54.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.925+0000 7f3bed800640 1 --2- 172.21.15.112:0/2287115114 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3be815fd00 0x7f3be80b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:54.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.925+0000 7f3be7e00640 1 -- 172.21.15.112:0/2287115114 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3be815fd00 msgr2=0x7f3be80b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:54.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.925+0000 7f3be7e00640 1 --2- 172.21.15.112:0/2287115114 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3be815fd00 0x7f3be80b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:54.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.925+0000 7f3be7e00640 1 -- 172.21.15.112:0/2287115114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3be80b0770 msgr2=0x7f3be80af320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:54.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.925+0000 7f3be7e00640 1 --2- 172.21.15.112:0/2287115114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3be80b0770 0x7f3be80af320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:54.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.925+0000 7f3be7e00640 1 -- 172.21.15.112:0/2287115114 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3be80b2ea0 con 0x7f3be815c800 2024-09-12T02:52:54.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.926+0000 7f3be7e00640 1 --2- 172.21.15.112:0/2287115114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3be815c800 0x7f3be814dba0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4000c00 tx=0x7f3bd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:54.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.926+0000 7f3be4c00640 1 -- 172.21.15.112:0/2287115114 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd4037040 con 0x7f3be815c800 2024-09-12T02:52:54.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.926+0000 7f3be4c00640 1 -- 172.21.15.112:0/2287115114 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bd4042070 con 0x7f3be815c800 2024-09-12T02:52:54.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.926+0000 7f3be4c00640 1 -- 172.21.15.112:0/2287115114 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd4030880 con 0x7f3be815c800 2024-09-12T02:52:54.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.926+0000 7f3bee200640 1 -- 172.21.15.112:0/2287115114 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3be80b3180 con 0x7f3be815c800 2024-09-12T02:52:54.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.926+0000 7f3bee200640 1 -- 172.21.15.112:0/2287115114 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3be80aee00 con 0x7f3be815c800 2024-09-12T02:52:54.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.927+0000 7f3bee200640 1 -- 172.21.15.112:0/2287115114 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3be815f7c0 con 0x7f3be815c800 2024-09-12T02:52:54.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.928+0000 7f3be4c00640 1 -- 172.21.15.112:0/2287115114 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3bd4030a20 con 0x7f3be815c800 2024-09-12T02:52:54.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.929+0000 7f3be4c00640 1 --2- 172.21.15.112:0/2287115114 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3bc806be60 0x7f3bc806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:54.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.929+0000 7f3be4c00640 1 -- 172.21.15.112:0/2287115114 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f3bd40ab6a0 con 0x7f3be815c800 2024-09-12T02:52:54.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.929+0000 7f3bece00640 1 --2- 172.21.15.112:0/2287115114 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3bc806be60 0x7f3bc806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:54.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.929+0000 7f3bece00640 1 --2- 172.21.15.112:0/2287115114 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3bc806be60 0x7f3bc806e320 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc006fd0 tx=0x7f3bdc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:54.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:54.933+0000 7f3be4c00640 1 -- 172.21.15.112:0/2287115114 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3bd407a040 con 0x7f3be815c800 2024-09-12T02:52:55.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.107+0000 7f3bee200640 1 -- 172.21.15.112:0/2287115114 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3be8159cf0 con 0x7f3be815c800 2024-09-12T02:52:55.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.109+0000 7f3be4c00640 1 -- 172.21.15.112:0/2287115114 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v182) ==== 74+0+16793 (secure 0 0 0) 0x7f3bd4079940 con 0x7f3be815c800 2024-09-12T02:52:55.110 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:52:55.110 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":182,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:52:54.149258+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:52:51.909503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-12T02:52:53.146578+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:52:55.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.111+0000 7f3bee200640 1 -- 172.21.15.112:0/2287115114 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3bc806be60 msgr2=0x7f3bc806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:55.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.111+0000 7f3bee200640 1 --2- 172.21.15.112:0/2287115114 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3bc806be60 0x7f3bc806e320 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc006fd0 tx=0x7f3bdc008040 comp rx=0 tx=0).stop 2024-09-12T02:52:55.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.111+0000 7f3bee200640 1 -- 172.21.15.112:0/2287115114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3be815c800 msgr2=0x7f3be814dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:55.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.111+0000 7f3bee200640 1 --2- 172.21.15.112:0/2287115114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3be815c800 0x7f3be814dba0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4000c00 tx=0x7f3bd40046c0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.111+0000 7f3bee200640 1 -- 172.21.15.112:0/2287115114 shutdown_connections 2024-09-12T02:52:55.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.111+0000 7f3bee200640 1 --2- 172.21.15.112:0/2287115114 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3be815fd00 0x7f3be80b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.111+0000 7f3bee200640 1 --2- 172.21.15.112:0/2287115114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3be815c800 0x7f3be814dba0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.111+0000 7f3bee200640 1 --2- 172.21.15.112:0/2287115114 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3bc806be60 0x7f3bc806e320 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.111+0000 7f3bee200640 1 --2- 172.21.15.112:0/2287115114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3be80b0770 0x7f3be80af320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.111+0000 7f3bee200640 1 -- 172.21.15.112:0/2287115114 >> 172.21.15.112:0/2287115114 conn(0x7f3be806cce0 msgr2=0x7f3be8072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:55.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.112+0000 7f3bee200640 1 -- 172.21.15.112:0/2287115114 shutdown_connections 2024-09-12T02:52:55.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.112+0000 7f3bee200640 1 -- 172.21.15.112:0/2287115114 wait complete. 2024-09-12T02:52:55.128 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:52:55.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.280+0000 7f3138e00640 1 Processor -- start 2024-09-12T02:52:55.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.280+0000 7f3138e00640 1 -- start start 2024-09-12T02:52:55.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.281+0000 7f3138e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f313415b9d0 0x7f31340b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:55.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.281+0000 7f3138e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f313406f600 0x7f31340728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:55.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.281+0000 7f3138e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31340b54a0 con 0x7f31340b45d0 2024-09-12T02:52:55.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.281+0000 7f3138e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f31340b4a60 con 0x7f313415b9d0 2024-09-12T02:52:55.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.281+0000 7f3138e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f31340b3af0 con 0x7f313406f600 2024-09-12T02:52:55.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.282+0000 7f3131e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f313415b9d0 0x7f31340b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:55.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.282+0000 7f3131e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f313415b9d0 0x7f31340b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57780/0 (socket says 172.21.15.112:57780) 2024-09-12T02:52:55.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.282+0000 7f3131e00640 1 -- 172.21.15.112:0/3773800811 learned_addr learned my addr 172.21.15.112:0/3773800811 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:55.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.282+0000 7f3131400640 1 --1- 172.21.15.112:0/3773800811 >> v1:172.21.15.112:6789/0 conn(0x7f31340b45d0 0x7f313406eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:42984/0 (socket says 172.21.15.112:42984) 2024-09-12T02:52:55.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.282+0000 7f3132800640 1 --2- 172.21.15.112:0/3773800811 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f313406f600 0x7f31340728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:55.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.282+0000 7f3131e00640 1 -- 172.21.15.112:0/3773800811 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f313406f600 msgr2=0x7f31340728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:55.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.282+0000 7f3131e00640 1 --2- 172.21.15.112:0/3773800811 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f313406f600 0x7f31340728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.282+0000 7f3131e00640 1 -- 172.21.15.112:0/3773800811 >> v1:172.21.15.112:6789/0 conn(0x7f31340b45d0 legacy=0x7f313406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:55.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.282+0000 7f3131e00640 1 -- 172.21.15.112:0/3773800811 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31340b3dd0 con 0x7f313415b9d0 2024-09-12T02:52:55.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.282+0000 7f3130a00640 1 -- 172.21.15.112:0/3773800811 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3786569474 0 0) 0x7f31340b54a0 con 0x7f31340b45d0 2024-09-12T02:52:55.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.283+0000 7f3131e00640 1 --2- 172.21.15.112:0/3773800811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f313415b9d0 0x7f31340b4ec0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f3124009870 tx=0x7f312402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e67485ac3fb0e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:55.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.283+0000 7f3130a00640 1 -- 172.21.15.112:0/3773800811 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3124037070 con 0x7f313415b9d0 2024-09-12T02:52:55.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.283+0000 7f3130a00640 1 -- 172.21.15.112:0/3773800811 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3124032440 con 0x7f313415b9d0 2024-09-12T02:52:55.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.283+0000 7f3130a00640 1 -- 172.21.15.112:0/3773800811 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3124032810 con 0x7f313415b9d0 2024-09-12T02:52:55.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.284+0000 7f3138e00640 1 -- 172.21.15.112:0/3773800811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f313415b9d0 msgr2=0x7f31340b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:55.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.284+0000 7f3138e00640 1 --2- 172.21.15.112:0/3773800811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f313415b9d0 0x7f31340b4ec0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f3124009870 tx=0x7f312402a270 comp rx=0 tx=0).stop 2024-09-12T02:52:55.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.284+0000 7f3138e00640 1 -- 172.21.15.112:0/3773800811 shutdown_connections 2024-09-12T02:52:55.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.284+0000 7f3138e00640 1 --2- 172.21.15.112:0/3773800811 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f313406f600 0x7f31340728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.284+0000 7f3138e00640 1 --2- 172.21.15.112:0/3773800811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f313415b9d0 0x7f31340b4ec0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.284+0000 7f3138e00640 1 -- 172.21.15.112:0/3773800811 >> 172.21.15.112:0/3773800811 conn(0x7f313406bbd0 msgr2=0x7f313406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:55.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.284+0000 7f3138e00640 1 -- 172.21.15.112:0/3773800811 shutdown_connections 2024-09-12T02:52:55.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.284+0000 7f3138e00640 1 -- 172.21.15.112:0/3773800811 wait complete. 2024-09-12T02:52:55.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.286+0000 7f3138e00640 1 Processor -- start 2024-09-12T02:52:55.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.286+0000 7f3138e00640 1 -- start start 2024-09-12T02:52:55.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.287+0000 7f3138e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f313406f600 0x7f31340cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:55.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.287+0000 7f3138e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31340b45d0 0x7f3134157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:55.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.287+0000 7f3138e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f313415b9d0 0x7f3134157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:55.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.287+0000 7f3138e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f313415bf30 con 0x7f313406f600 2024-09-12T02:52:55.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.287+0000 7f3138e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f313415bdb0 con 0x7f31340b45d0 2024-09-12T02:52:55.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.287+0000 7f3138e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f31340cdcd0 con 0x7f313415b9d0 2024-09-12T02:52:55.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.287+0000 7f3131e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f313406f600 0x7f31340cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:55.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.287+0000 7f3131e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f313406f600 0x7f31340cc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57790/0 (socket says 172.21.15.112:57790) 2024-09-12T02:52:55.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.287+0000 7f3131e00640 1 -- 172.21.15.112:0/2923697769 learned_addr learned my addr 172.21.15.112:0/2923697769 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:55.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.288+0000 7f3132800640 1 --2- 172.21.15.112:0/2923697769 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f313415b9d0 0x7f3134157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:55.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.288+0000 7f3131400640 1 --2- 172.21.15.112:0/2923697769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31340b45d0 0x7f3134157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:55.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.288+0000 7f3131e00640 1 -- 172.21.15.112:0/2923697769 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f313415b9d0 msgr2=0x7f3134157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:55.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.288+0000 7f3131e00640 1 --2- 172.21.15.112:0/2923697769 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f313415b9d0 0x7f3134157d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.288+0000 7f3131e00640 1 -- 172.21.15.112:0/2923697769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31340b45d0 msgr2=0x7f3134157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:55.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.288+0000 7f3131e00640 1 --2- 172.21.15.112:0/2923697769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31340b45d0 0x7f3134157810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.288+0000 7f3131e00640 1 -- 172.21.15.112:0/2923697769 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f313415a6e0 con 0x7f313406f600 2024-09-12T02:52:55.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.288+0000 7f3132800640 1 --2- 172.21.15.112:0/2923697769 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f313415b9d0 0x7f3134157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:52:55.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.288+0000 7f3131400640 1 --2- 172.21.15.112:0/2923697769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31340b45d0 0x7f3134157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:52:55.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.288+0000 7f3131e00640 1 --2- 172.21.15.112:0/2923697769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f313406f600 0x7f31340cc0a0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f3124035040 tx=0x7f31240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:55.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.288+0000 7f312a000640 1 -- 172.21.15.112:0/2923697769 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3124037040 con 0x7f313406f600 2024-09-12T02:52:55.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.288+0000 7f312a000640 1 -- 172.21.15.112:0/2923697769 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3124004030 con 0x7f313406f600 2024-09-12T02:52:55.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.288+0000 7f3138e00640 1 -- 172.21.15.112:0/2923697769 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f313415a9c0 con 0x7f313406f600 2024-09-12T02:52:55.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.288+0000 7f312a000640 1 -- 172.21.15.112:0/2923697769 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3124004420 con 0x7f313406f600 2024-09-12T02:52:55.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.288+0000 7f3138e00640 1 -- 172.21.15.112:0/2923697769 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31340ce550 con 0x7f313406f600 2024-09-12T02:52:55.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.290+0000 7f3138e00640 1 -- 172.21.15.112:0/2923697769 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3134068a30 con 0x7f313406f600 2024-09-12T02:52:55.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.290+0000 7f312a000640 1 -- 172.21.15.112:0/2923697769 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f312403a070 con 0x7f313406f600 2024-09-12T02:52:55.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.291+0000 7f312a000640 1 --2- 172.21.15.112:0/2923697769 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f311406be30 0x7f311406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:55.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.291+0000 7f312a000640 1 -- 172.21.15.112:0/2923697769 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f31240ab480 con 0x7f313406f600 2024-09-12T02:52:55.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.291+0000 7f3131400640 1 --2- 172.21.15.112:0/2923697769 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f311406be30 0x7f311406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:55.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.292+0000 7f3131400640 1 --2- 172.21.15.112:0/2923697769 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f311406be30 0x7f311406e2f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f31340cd4a0 tx=0x7f3120009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:55.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.296+0000 7f312a000640 1 -- 172.21.15.112:0/2923697769 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3124041020 con 0x7f313406f600 2024-09-12T02:52:55.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.468+0000 7f3138e00640 1 -- 172.21.15.112:0/2923697769 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f313415ab90 con 0x7f313406f600 2024-09-12T02:52:55.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.470+0000 7f312a000640 1 -- 172.21.15.112:0/2923697769 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v182) ==== 74+0+16793 (secure 0 0 0) 0x7f313415ab90 con 0x7f313406f600 2024-09-12T02:52:55.471 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:52:55.471 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":182,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:52:54.149258+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:52:51.909503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-12T02:52:53.146578+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:52:55.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.472+0000 7f3138e00640 1 -- 172.21.15.112:0/2923697769 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f311406be30 msgr2=0x7f311406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:55.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.472+0000 7f3138e00640 1 --2- 172.21.15.112:0/2923697769 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f311406be30 0x7f311406e2f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f31340cd4a0 tx=0x7f3120009040 comp rx=0 tx=0).stop 2024-09-12T02:52:55.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.472+0000 7f3138e00640 1 -- 172.21.15.112:0/2923697769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f313406f600 msgr2=0x7f31340cc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:55.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.472+0000 7f3138e00640 1 --2- 172.21.15.112:0/2923697769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f313406f600 0x7f31340cc0a0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f3124035040 tx=0x7f31240046c0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.472+0000 7f3138e00640 1 -- 172.21.15.112:0/2923697769 shutdown_connections 2024-09-12T02:52:55.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.472+0000 7f3138e00640 1 --2- 172.21.15.112:0/2923697769 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f313415b9d0 0x7f3134157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.472+0000 7f3138e00640 1 --2- 172.21.15.112:0/2923697769 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f311406be30 0x7f311406e2f0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.472+0000 7f3138e00640 1 --2- 172.21.15.112:0/2923697769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31340b45d0 0x7f3134157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.472+0000 7f3138e00640 1 --2- 172.21.15.112:0/2923697769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f313406f600 0x7f31340cc0a0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.472+0000 7f3138e00640 1 -- 172.21.15.112:0/2923697769 >> 172.21.15.112:0/2923697769 conn(0x7f313406bbd0 msgr2=0x7f313415f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:55.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.472+0000 7f3138e00640 1 -- 172.21.15.112:0/2923697769 shutdown_connections 2024-09-12T02:52:55.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.472+0000 7f3138e00640 1 -- 172.21.15.112:0/2923697769 wait complete. 2024-09-12T02:52:55.488 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T02:52:55.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.642+0000 7f34d2800640 1 Processor -- start 2024-09-12T02:52:55.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.642+0000 7f34d2800640 1 -- start start 2024-09-12T02:52:55.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.644+0000 7f34d2800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34cc15cc50 0x7f34cc0732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:55.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.644+0000 7f34d2800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f34cc071530 0x7f34cc0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:55.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.644+0000 7f34d2800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34cc073830 con 0x7f34cc071970 2024-09-12T02:52:55.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.644+0000 7f34d2800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f34cc15d030 con 0x7f34cc071530 2024-09-12T02:52:55.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.644+0000 7f34d2800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f34cc0cf4c0 con 0x7f34cc15cc50 2024-09-12T02:52:55.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.644+0000 7f34cb400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34cc15cc50 0x7f34cc0732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:55.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.644+0000 7f34c2a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f34cc071530 0x7f34cc0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:55.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.644+0000 7f34cbe00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f34cc071970 0x7f34cc0cf950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.112:44274/0 (socket says 172.21.15.112:44274) 2024-09-12T02:52:55.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.644+0000 7f34cb400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34cc15cc50 0x7f34cc0732f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:38316/0 (socket says 172.21.15.112:38316) 2024-09-12T02:52:55.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.644+0000 7f34cbe00640 1 -- 172.21.15.112:0/3338498833 learned_addr learned my addr 172.21.15.112:0/3338498833 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:52:55.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.645+0000 7f34cb400640 1 -- 172.21.15.112:0/3338498833 >> v2:172.21.15.137:3300/0 conn(0x7f34cc071530 msgr2=0x7f34cc0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:55.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.645+0000 7f34cb400640 1 --2- 172.21.15.112:0/3338498833 >> v2:172.21.15.137:3300/0 conn(0x7f34cc071530 0x7f34cc0af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.645+0000 7f34cb400640 1 -- 172.21.15.112:0/3338498833 >> v1:172.21.15.137:6789/0 conn(0x7f34cc071970 legacy=0x7f34cc0cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:55.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.645+0000 7f34cb400640 1 -- 172.21.15.112:0/3338498833 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34cc0ceeb0 con 0x7f34cc15cc50 2024-09-12T02:52:55.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.645+0000 7f34caa00640 1 -- 172.21.15.112:0/3338498833 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1941696194 0 0) 0x7f34c4001490 con 0x7f34cc071970 2024-09-12T02:52:55.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.645+0000 7f34c2a00640 1 --2- 172.21.15.112:0/3338498833 >> v2:172.21.15.137:3300/0 conn(0x7f34cc071530 0x7f34cc0af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:52:55.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.646+0000 7f34cb400640 1 --2- 172.21.15.112:0/3338498833 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34cc15cc50 0x7f34cc0732f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f34bc0097a0 tx=0x7f34bc02a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=815c8954bf084029 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:55.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.646+0000 7f34caa00640 1 -- 172.21.15.112:0/3338498833 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34bc037070 con 0x7f34cc15cc50 2024-09-12T02:52:55.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.646+0000 7f34caa00640 1 -- 172.21.15.112:0/3338498833 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34bc02ae40 con 0x7f34cc15cc50 2024-09-12T02:52:55.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.646+0000 7f34caa00640 1 -- 172.21.15.112:0/3338498833 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34bc032660 con 0x7f34cc15cc50 2024-09-12T02:52:55.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.646+0000 7f34d2800640 1 -- 172.21.15.112:0/3338498833 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34cc15cc50 msgr2=0x7f34cc0732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:55.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.646+0000 7f34d2800640 1 --2- 172.21.15.112:0/3338498833 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34cc15cc50 0x7f34cc0732f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f34bc0097a0 tx=0x7f34bc02a0f0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.647+0000 7f34d2800640 1 -- 172.21.15.112:0/3338498833 shutdown_connections 2024-09-12T02:52:55.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.647+0000 7f34d2800640 1 --2- 172.21.15.112:0/3338498833 >> v2:172.21.15.137:3300/0 conn(0x7f34cc071530 0x7f34cc0af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.647+0000 7f34d2800640 1 --2- 172.21.15.112:0/3338498833 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34cc15cc50 0x7f34cc0732f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.647+0000 7f34d2800640 1 -- 172.21.15.112:0/3338498833 >> 172.21.15.112:0/3338498833 conn(0x7f34cc06bbd0 msgr2=0x7f34cc06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:55.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.647+0000 7f34d2800640 1 -- 172.21.15.112:0/3338498833 shutdown_connections 2024-09-12T02:52:55.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.647+0000 7f34d2800640 1 -- 172.21.15.112:0/3338498833 wait complete. 2024-09-12T02:52:55.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.648+0000 7f34d2800640 1 Processor -- start 2024-09-12T02:52:55.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.648+0000 7f34d2800640 1 -- start start 2024-09-12T02:52:55.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.649+0000 7f34d2800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34cc071530 0x7f34cc1f6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:55.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.649+0000 7f34d2800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34cc071970 0x7f34cc14de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:55.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.649+0000 7f34d2800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34cc15cc50 0x7f34cc0b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:55.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.649+0000 7f34d2800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc0cf150 con 0x7f34cc071530 2024-09-12T02:52:55.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.649+0000 7f34d2800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc06e5e0 con 0x7f34cc15cc50 2024-09-12T02:52:55.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.649+0000 7f34d2800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f34cc06f510 con 0x7f34cc071970 2024-09-12T02:52:55.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.649+0000 7f34cb400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34cc071530 0x7f34cc1f6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:55.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.649+0000 7f34cb400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34cc071530 0x7f34cc1f6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57802/0 (socket says 172.21.15.112:57802) 2024-09-12T02:52:55.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.649+0000 7f34cb400640 1 -- 172.21.15.112:0/2340524095 learned_addr learned my addr 172.21.15.112:0/2340524095 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:55.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.650+0000 7f34c2a00640 1 --2- 172.21.15.112:0/2340524095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34cc071970 0x7f34cc14de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:55.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.650+0000 7f34cbe00640 1 --2- 172.21.15.112:0/2340524095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34cc15cc50 0x7f34cc0b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:55.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.650+0000 7f34cb400640 1 -- 172.21.15.112:0/2340524095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34cc071970 msgr2=0x7f34cc14de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:55.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.650+0000 7f34cb400640 1 --2- 172.21.15.112:0/2340524095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34cc071970 0x7f34cc14de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.650+0000 7f34cb400640 1 -- 172.21.15.112:0/2340524095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34cc15cc50 msgr2=0x7f34cc0b14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:55.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.650+0000 7f34cb400640 1 --2- 172.21.15.112:0/2340524095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34cc15cc50 0x7f34cc0b14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:55.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.650+0000 7f34cb400640 1 -- 172.21.15.112:0/2340524095 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34cc14f3b0 con 0x7f34cc071530 2024-09-12T02:52:55.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.650+0000 7f34c2a00640 1 --2- 172.21.15.112:0/2340524095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34cc071970 0x7f34cc14de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:52:55.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.650+0000 7f34cb400640 1 --2- 172.21.15.112:0/2340524095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34cc071530 0x7f34cc1f6ee0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f34bc035040 tx=0x7f34bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:55.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.650+0000 7f34c3e00640 1 -- 172.21.15.112:0/2340524095 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34bc042020 con 0x7f34cc071530 2024-09-12T02:52:55.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.650+0000 7f34c3e00640 1 -- 172.21.15.112:0/2340524095 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34bc03d470 con 0x7f34cc071530 2024-09-12T02:52:55.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.650+0000 7f34d2800640 1 -- 172.21.15.112:0/2340524095 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34cc14f690 con 0x7f34cc071530 2024-09-12T02:52:55.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.651+0000 7f34c3e00640 1 -- 172.21.15.112:0/2340524095 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34bc037040 con 0x7f34cc071530 2024-09-12T02:52:55.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.651+0000 7f34d2800640 1 -- 172.21.15.112:0/2340524095 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34cc14fc50 con 0x7f34cc071530 2024-09-12T02:52:55.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.652+0000 7f34d2800640 1 -- 172.21.15.112:0/2340524095 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34cc068a30 con 0x7f34cc071530 2024-09-12T02:52:55.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.652+0000 7f34c3e00640 1 -- 172.21.15.112:0/2340524095 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f34bc045020 con 0x7f34cc071530 2024-09-12T02:52:55.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.654+0000 7f34c3e00640 1 --2- 172.21.15.112:0/2340524095 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f34a806be30 0x7f34a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:55.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.654+0000 7f34c3e00640 1 -- 172.21.15.112:0/2340524095 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f34bc0ab690 con 0x7f34cc071530 2024-09-12T02:52:55.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.654+0000 7f34c2a00640 1 --2- 172.21.15.112:0/2340524095 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f34a806be30 0x7f34a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:55.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.655+0000 7f34c2a00640 1 --2- 172.21.15.112:0/2340524095 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f34a806be30 0x7f34a806e2f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f34cc1e84c0 tx=0x7f34b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:55.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.658+0000 7f34c3e00640 1 -- 172.21.15.112:0/2340524095 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f34bc04c030 con 0x7f34cc071530 2024-09-12T02:52:55.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:55.871+0000 7f34d2800640 1 -- 172.21.15.112:0/2340524095 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f34cc14fe90 con 0x7f34cc071530 2024-09-12T02:52:56.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.751+0000 7f34c3e00640 1 -- 172.21.15.112:0/2340524095 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v93) ==== 118+0+0 (secure 0 0 0) 0x7f34cc14fe90 con 0x7f34cc071530 2024-09-12T02:52:56.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.754+0000 7f34d2800640 1 -- 172.21.15.112:0/2340524095 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f34a806be30 msgr2=0x7f34a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:56.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.754+0000 7f34d2800640 1 --2- 172.21.15.112:0/2340524095 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f34a806be30 0x7f34a806e2f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f34cc1e84c0 tx=0x7f34b4008040 comp rx=0 tx=0).stop 2024-09-12T02:52:56.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.754+0000 7f34d2800640 1 -- 172.21.15.112:0/2340524095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34cc071530 msgr2=0x7f34cc1f6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:56.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.754+0000 7f34d2800640 1 --2- 172.21.15.112:0/2340524095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34cc071530 0x7f34cc1f6ee0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f34bc035040 tx=0x7f34bc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:52:56.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.754+0000 7f34d2800640 1 -- 172.21.15.112:0/2340524095 shutdown_connections 2024-09-12T02:52:56.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.754+0000 7f34d2800640 1 --2- 172.21.15.112:0/2340524095 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f34a806be30 0x7f34a806e2f0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:56.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.754+0000 7f34d2800640 1 --2- 172.21.15.112:0/2340524095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34cc15cc50 0x7f34cc0b14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:56.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.754+0000 7f34d2800640 1 --2- 172.21.15.112:0/2340524095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34cc071970 0x7f34cc14de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:56.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.754+0000 7f34d2800640 1 --2- 172.21.15.112:0/2340524095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34cc071530 0x7f34cc1f6ee0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:56.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.754+0000 7f34d2800640 1 -- 172.21.15.112:0/2340524095 >> 172.21.15.112:0/2340524095 conn(0x7f34cc06bbd0 msgr2=0x7f34cc159b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:56.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.754+0000 7f34d2800640 1 -- 172.21.15.112:0/2340524095 shutdown_connections 2024-09-12T02:52:56.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.754+0000 7f34d2800640 1 -- 172.21.15.112:0/2340524095 wait complete. 2024-09-12T02:52:56.773 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T02:52:56.773 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T02:52:56.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.930+0000 7f3f98600640 1 Processor -- start 2024-09-12T02:52:56.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.930+0000 7f3f98600640 1 -- start start 2024-09-12T02:52:56.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.931+0000 7f3f98600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3f900b4ec0 0x7f3f900b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:56.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.931+0000 7f3f98600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f900b54a0 con 0x7f3f9015b9d0 2024-09-12T02:52:56.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.931+0000 7f3f98600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f900b3af0 con 0x7f3f9006f600 2024-09-12T02:52:56.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.931+0000 7f3f98600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f3f900b3dd0 con 0x7f3f900b4ec0 2024-09-12T02:52:56.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.932+0000 7f3f95c00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f3f9015b9d0 0x7f3f9006eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:42996/0 (socket says 172.21.15.112:42996) 2024-09-12T02:52:56.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.932+0000 7f3f95c00640 1 -- 172.21.15.112:0/1716113013 learned_addr learned my addr 172.21.15.112:0/1716113013 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:52:56.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.932+0000 7f3f96600640 1 --2- 172.21.15.112:0/1716113013 >> v2:172.21.15.112:3300/0 conn(0x7f3f900b4ec0 0x7f3f900b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:56.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.932+0000 7f3f96600640 1 -- 172.21.15.112:0/1716113013 >> v1:172.21.15.137:6789/0 conn(0x7f3f9006f600 legacy=0x7f3f900cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:56.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.932+0000 7f3f96600640 1 -- 172.21.15.112:0/1716113013 >> v1:172.21.15.112:6789/0 conn(0x7f3f9015b9d0 legacy=0x7f3f9006eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:56.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.932+0000 7f3f96600640 1 -- 172.21.15.112:0/1716113013 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f900b40b0 con 0x7f3f900b4ec0 2024-09-12T02:52:56.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.932+0000 7f3f8fe00640 1 -- 172.21.15.112:0/1716113013 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3961449252 0 0) 0x7f3f900b54a0 con 0x7f3f9015b9d0 2024-09-12T02:52:56.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.933+0000 7f3f96600640 1 --2- 172.21.15.112:0/1716113013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f900b4ec0 0x7f3f900b45d0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f3f88009d90 tx=0x7f3f8802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ed814313cd529f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:56.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.933+0000 7f3f8fe00640 1 -- 172.21.15.112:0/1716113013 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f88031600 con 0x7f3f900b4ec0 2024-09-12T02:52:56.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.933+0000 7f3f8fe00640 1 -- 172.21.15.112:0/1716113013 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f880317a0 con 0x7f3f900b4ec0 2024-09-12T02:52:56.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.933+0000 7f3f8fe00640 1 -- 172.21.15.112:0/1716113013 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f88031b70 con 0x7f3f900b4ec0 2024-09-12T02:52:56.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.934+0000 7f3f98600640 1 -- 172.21.15.112:0/1716113013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f900b4ec0 msgr2=0x7f3f900b45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:56.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.934+0000 7f3f98600640 1 --2- 172.21.15.112:0/1716113013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f900b4ec0 0x7f3f900b45d0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f3f88009d90 tx=0x7f3f8802a610 comp rx=0 tx=0).stop 2024-09-12T02:52:56.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.934+0000 7f3f98600640 1 -- 172.21.15.112:0/1716113013 shutdown_connections 2024-09-12T02:52:56.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.934+0000 7f3f98600640 1 --2- 172.21.15.112:0/1716113013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f900b4ec0 0x7f3f900b45d0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:56.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.934+0000 7f3f98600640 1 -- 172.21.15.112:0/1716113013 >> 172.21.15.112:0/1716113013 conn(0x7f3f9006bbd0 msgr2=0x7f3f9006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:56.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.934+0000 7f3f98600640 1 -- 172.21.15.112:0/1716113013 shutdown_connections 2024-09-12T02:52:56.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.934+0000 7f3f98600640 1 -- 172.21.15.112:0/1716113013 wait complete. 2024-09-12T02:52:56.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.936+0000 7f3f98600640 1 Processor -- start 2024-09-12T02:52:56.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.936+0000 7f3f98600640 1 -- start start 2024-09-12T02:52:56.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.937+0000 7f3f98600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f9006f600 0x7f3f901e5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:56.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.937+0000 7f3f98600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f900b4ec0 0x7f3f901e5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:56.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.937+0000 7f3f98600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f9015b9d0 0x7f3f90151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:56.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.937+0000 7f3f98600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3f90072a40 con 0x7f3f9006f600 2024-09-12T02:52:56.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.937+0000 7f3f98600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3f900728c0 con 0x7f3f900b4ec0 2024-09-12T02:52:56.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.937+0000 7f3f98600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3f90072bc0 con 0x7f3f9015b9d0 2024-09-12T02:52:56.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.937+0000 7f3f95c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f9006f600 0x7f3f901e5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:56.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.937+0000 7f3f95c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f9006f600 0x7f3f901e5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57806/0 (socket says 172.21.15.112:57806) 2024-09-12T02:52:56.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.937+0000 7f3f95c00640 1 -- 172.21.15.112:0/3640868839 learned_addr learned my addr 172.21.15.112:0/3640868839 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:56.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.937+0000 7f3f96600640 1 --2- 172.21.15.112:0/3640868839 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f9015b9d0 0x7f3f90151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:56.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.937+0000 7f3f95200640 1 --2- 172.21.15.112:0/3640868839 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f900b4ec0 0x7f3f901e5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:56.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.937+0000 7f3f95c00640 1 -- 172.21.15.112:0/3640868839 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f9015b9d0 msgr2=0x7f3f90151e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:56.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.937+0000 7f3f95c00640 1 --2- 172.21.15.112:0/3640868839 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f9015b9d0 0x7f3f90151e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:56.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.937+0000 7f3f95c00640 1 -- 172.21.15.112:0/3640868839 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f900b4ec0 msgr2=0x7f3f901e5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:56.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.937+0000 7f3f95c00640 1 --2- 172.21.15.112:0/3640868839 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f900b4ec0 0x7f3f901e5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:56.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.937+0000 7f3f95c00640 1 -- 172.21.15.112:0/3640868839 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f90155500 con 0x7f3f9006f600 2024-09-12T02:52:56.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.938+0000 7f3f95c00640 1 --2- 172.21.15.112:0/3640868839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f9006f600 0x7f3f901e5970 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400c430 tx=0x7f3f8400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:56.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.938+0000 7f3f8d600640 1 -- 172.21.15.112:0/3640868839 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f840074e0 con 0x7f3f9006f600 2024-09-12T02:52:56.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.938+0000 7f3f8d600640 1 -- 172.21.15.112:0/3640868839 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f840047e0 con 0x7f3f9006f600 2024-09-12T02:52:56.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.938+0000 7f3f98600640 1 -- 172.21.15.112:0/3640868839 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f9015dfb0 con 0x7f3f9006f600 2024-09-12T02:52:56.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.938+0000 7f3f8d600640 1 -- 172.21.15.112:0/3640868839 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f84004bd0 con 0x7f3f9006f600 2024-09-12T02:52:56.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.938+0000 7f3f98600640 1 -- 172.21.15.112:0/3640868839 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f9015e530 con 0x7f3f9006f600 2024-09-12T02:52:56.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.939+0000 7f3f98600640 1 -- 172.21.15.112:0/3640868839 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f90068a30 con 0x7f3f9006f600 2024-09-12T02:52:56.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.940+0000 7f3f8d600640 1 -- 172.21.15.112:0/3640868839 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3f84011070 con 0x7f3f9006f600 2024-09-12T02:52:56.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.941+0000 7f3f8d600640 1 --2- 172.21.15.112:0/3640868839 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3f7006be30 0x7f3f7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:56.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.941+0000 7f3f8d600640 1 -- 172.21.15.112:0/3640868839 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f3f8408aae0 con 0x7f3f9006f600 2024-09-12T02:52:56.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.941+0000 7f3f95200640 1 --2- 172.21.15.112:0/3640868839 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3f7006be30 0x7f3f7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:56.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.941+0000 7f3f95200640 1 --2- 172.21.15.112:0/3640868839 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3f7006be30 0x7f3f7006e2f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3f900cd460 tx=0x7f3f7c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:56.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:56.945+0000 7f3f8d600640 1 -- 172.21.15.112:0/3640868839 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3f84059480 con 0x7f3f9006f600 2024-09-12T02:52:57.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.152+0000 7f3f98600640 1 -- 172.21.15.112:0/3640868839 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f3f900b0d60 con 0x7f3f9006f600 2024-09-12T02:52:57.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.757+0000 7f3f8d600640 1 -- 172.21.15.112:0/3640868839 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v94) ==== 122+0+0 (secure 0 0 0) 0x7f3f84058d80 con 0x7f3f9006f600 2024-09-12T02:52:57.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.760+0000 7f3f98600640 1 -- 172.21.15.112:0/3640868839 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3f7006be30 msgr2=0x7f3f7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:57.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.760+0000 7f3f98600640 1 --2- 172.21.15.112:0/3640868839 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3f7006be30 0x7f3f7006e2f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3f900cd460 tx=0x7f3f7c009040 comp rx=0 tx=0).stop 2024-09-12T02:52:57.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.760+0000 7f3f98600640 1 -- 172.21.15.112:0/3640868839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f9006f600 msgr2=0x7f3f901e5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:57.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.760+0000 7f3f98600640 1 --2- 172.21.15.112:0/3640868839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f9006f600 0x7f3f901e5970 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400c430 tx=0x7f3f8400c8f0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.761+0000 7f3f98600640 1 -- 172.21.15.112:0/3640868839 shutdown_connections 2024-09-12T02:52:57.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.761+0000 7f3f98600640 1 --2- 172.21.15.112:0/3640868839 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f9015b9d0 0x7f3f90151e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.761+0000 7f3f98600640 1 --2- 172.21.15.112:0/3640868839 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3f7006be30 0x7f3f7006e2f0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.761+0000 7f3f98600640 1 --2- 172.21.15.112:0/3640868839 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f900b4ec0 0x7f3f901e5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.761+0000 7f3f98600640 1 --2- 172.21.15.112:0/3640868839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f9006f600 0x7f3f901e5970 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.761+0000 7f3f98600640 1 -- 172.21.15.112:0/3640868839 >> 172.21.15.112:0/3640868839 conn(0x7f3f9006bbd0 msgr2=0x7f3f900ced40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:57.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.761+0000 7f3f98600640 1 -- 172.21.15.112:0/3640868839 shutdown_connections 2024-09-12T02:52:57.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.761+0000 7f3f98600640 1 -- 172.21.15.112:0/3640868839 wait complete. 2024-09-12T02:52:57.778 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T02:52:57.778 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:52:57.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.931+0000 7f5aef200640 1 Processor -- start 2024-09-12T02:52:57.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.931+0000 7f5aef200640 1 -- start start 2024-09-12T02:52:57.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.932+0000 7f5aef200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5af015ed60 0x7f5af006d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.932+0000 7f5aef200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5af006da10 0x7f5af00af900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.932+0000 7f5aef200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5af00afe40 0x7f5af00b0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.932+0000 7f5aef200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f5af006de60 con 0x7f5af006da10 2024-09-12T02:52:57.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.932+0000 7f5aef200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f5af00b3c10 con 0x7f5af015ed60 2024-09-12T02:52:57.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.932+0000 7f5aef200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5af00b3000 con 0x7f5af00afe40 2024-09-12T02:52:57.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.932+0000 7f5aed400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5af006da10 0x7f5af00af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.933+0000 7f5aed400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5af006da10 0x7f5af00af900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57816/0 (socket says 172.21.15.112:57816) 2024-09-12T02:52:57.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.933+0000 7f5aed400640 1 -- 172.21.15.112:0/983244457 learned_addr learned my addr 172.21.15.112:0/983244457 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:57.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.933+0000 7f5aede00640 1 --2- 172.21.15.112:0/983244457 >> v2:172.21.15.137:3300/0 conn(0x7f5af015ed60 0x7f5af006d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.933+0000 7f5aee800640 1 --2- 172.21.15.112:0/983244457 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5af00afe40 0x7f5af00b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.933+0000 7f5aed400640 1 -- 172.21.15.112:0/983244457 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5af00afe40 msgr2=0x7f5af00b0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:57.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.933+0000 7f5aed400640 1 --2- 172.21.15.112:0/983244457 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5af00afe40 0x7f5af00b0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.933+0000 7f5aed400640 1 -- 172.21.15.112:0/983244457 >> v2:172.21.15.137:3300/0 conn(0x7f5af015ed60 msgr2=0x7f5af006d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:57.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.933+0000 7f5aed400640 1 --2- 172.21.15.112:0/983244457 >> v2:172.21.15.137:3300/0 conn(0x7f5af015ed60 0x7f5af006d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.933+0000 7f5aed400640 1 -- 172.21.15.112:0/983244457 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af00b32e0 con 0x7f5af006da10 2024-09-12T02:52:57.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.934+0000 7f5aed400640 1 --2- 172.21.15.112:0/983244457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5af006da10 0x7f5af00af900 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f5af00b56b0 tx=0x7f5adc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe01821e322cf5d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:57.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.934+0000 7f5aeca00640 1 -- 172.21.15.112:0/983244457 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc037070 con 0x7f5af006da10 2024-09-12T02:52:57.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.934+0000 7f5aeca00640 1 -- 172.21.15.112:0/983244457 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5adc032440 con 0x7f5af006da10 2024-09-12T02:52:57.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.934+0000 7f5aeca00640 1 -- 172.21.15.112:0/983244457 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc032810 con 0x7f5af006da10 2024-09-12T02:52:57.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.935+0000 7f5aef200640 1 -- 172.21.15.112:0/983244457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5af006da10 msgr2=0x7f5af00af900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:57.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.935+0000 7f5aef200640 1 --2- 172.21.15.112:0/983244457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5af006da10 0x7f5af00af900 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f5af00b56b0 tx=0x7f5adc02a1e0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.935+0000 7f5aef200640 1 -- 172.21.15.112:0/983244457 shutdown_connections 2024-09-12T02:52:57.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.935+0000 7f5aef200640 1 --2- 172.21.15.112:0/983244457 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5af00afe40 0x7f5af00b0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.935+0000 7f5aef200640 1 --2- 172.21.15.112:0/983244457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5af006da10 0x7f5af00af900 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.935+0000 7f5aef200640 1 --2- 172.21.15.112:0/983244457 >> v2:172.21.15.137:3300/0 conn(0x7f5af015ed60 0x7f5af006d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.935+0000 7f5aef200640 1 -- 172.21.15.112:0/983244457 >> 172.21.15.112:0/983244457 conn(0x7f5af00b7e80 msgr2=0x7f5af00b8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:57.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.935+0000 7f5aef200640 1 -- 172.21.15.112:0/983244457 shutdown_connections 2024-09-12T02:52:57.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.935+0000 7f5aef200640 1 -- 172.21.15.112:0/983244457 wait complete. 2024-09-12T02:52:57.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.937+0000 7f5aef200640 1 Processor -- start 2024-09-12T02:52:57.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.937+0000 7f5aef200640 1 -- start start 2024-09-12T02:52:57.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.938+0000 7f5aef200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5af006da10 0x7f5af01f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.938+0000 7f5aef200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5af00afe40 0x7f5af0158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.938+0000 7f5aef200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5af015ed60 0x7f5af01f7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.938+0000 7f5aef200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5af006e270 con 0x7f5af00afe40 2024-09-12T02:52:57.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.938+0000 7f5aef200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5af00b38a0 con 0x7f5af015ed60 2024-09-12T02:52:57.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.938+0000 7f5aef200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5af00b40a0 con 0x7f5af006da10 2024-09-12T02:52:57.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.938+0000 7f5aed400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5af00afe40 0x7f5af0158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.938+0000 7f5aed400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5af00afe40 0x7f5af0158310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57830/0 (socket says 172.21.15.112:57830) 2024-09-12T02:52:57.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.938+0000 7f5aed400640 1 -- 172.21.15.112:0/2993346665 learned_addr learned my addr 172.21.15.112:0/2993346665 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:57.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.938+0000 7f5aede00640 1 --2- 172.21.15.112:0/2993346665 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5af006da10 0x7f5af01f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.938+0000 7f5aed400640 1 -- 172.21.15.112:0/2993346665 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5af006da10 msgr2=0x7f5af01f5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:57.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.938+0000 7f5aed400640 1 --2- 172.21.15.112:0/2993346665 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5af006da10 0x7f5af01f5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.938+0000 7f5aed400640 1 -- 172.21.15.112:0/2993346665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5af015ed60 msgr2=0x7f5af01f7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:57.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.938+0000 7f5aee800640 1 --2- 172.21.15.112:0/2993346665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5af015ed60 0x7f5af01f7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.938+0000 7f5aed400640 1 --2- 172.21.15.112:0/2993346665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5af015ed60 0x7f5af01f7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.938+0000 7f5aed400640 1 -- 172.21.15.112:0/2993346665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af01f55b0 con 0x7f5af00afe40 2024-09-12T02:52:57.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.938+0000 7f5aede00640 1 --2- 172.21.15.112:0/2993346665 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5af006da10 0x7f5af01f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:52:57.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.938+0000 7f5aee800640 1 --2- 172.21.15.112:0/2993346665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5af015ed60 0x7f5af01f7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:52:57.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.939+0000 7f5aed400640 1 --2- 172.21.15.112:0/2993346665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5af00afe40 0x7f5af0158310 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f5adc02a220 tx=0x7f5adc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:57.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.939+0000 7f5ae6000640 1 -- 172.21.15.112:0/2993346665 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc041020 con 0x7f5af00afe40 2024-09-12T02:52:57.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.939+0000 7f5ae6000640 1 -- 172.21.15.112:0/2993346665 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5adc0306c0 con 0x7f5af00afe40 2024-09-12T02:52:57.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.939+0000 7f5ae6000640 1 -- 172.21.15.112:0/2993346665 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc037040 con 0x7f5af00afe40 2024-09-12T02:52:57.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.939+0000 7f5aef200640 1 -- 172.21.15.112:0/2993346665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af0156570 con 0x7f5af00afe40 2024-09-12T02:52:57.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.939+0000 7f5aef200640 1 -- 172.21.15.112:0/2993346665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af0156b30 con 0x7f5af00afe40 2024-09-12T02:52:57.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.940+0000 7f5aef200640 1 -- 172.21.15.112:0/2993346665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5af00b6bc0 con 0x7f5af00afe40 2024-09-12T02:52:57.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.941+0000 7f5ae6000640 1 -- 172.21.15.112:0/2993346665 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5adc044020 con 0x7f5af00afe40 2024-09-12T02:52:57.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.942+0000 7f5ae6000640 1 --2- 172.21.15.112:0/2993346665 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5ad006be60 0x7f5ad006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.942+0000 7f5ae6000640 1 -- 172.21.15.112:0/2993346665 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f5adc0ab6a0 con 0x7f5af00afe40 2024-09-12T02:52:57.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.942+0000 7f5aede00640 1 --2- 172.21.15.112:0/2993346665 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5ad006be60 0x7f5ad006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.942+0000 7f5aede00640 1 --2- 172.21.15.112:0/2993346665 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5ad006be60 0x7f5ad006e320 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0006fd0 tx=0x7f5ae0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:57.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:57.946+0000 7f5ae6000640 1 -- 172.21.15.112:0/2993346665 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5adc04b030 con 0x7f5af00afe40 2024-09-12T02:52:58.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.153+0000 7f5aef200640 1 -- 172.21.15.112:0/2993346665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5af0161f60 con 0x7f5af00afe40 2024-09-12T02:52:58.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.154+0000 7f5ae6000640 1 -- 172.21.15.112:0/2993346665 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5233 (secure 0 0 0) 0x7f5adc07a040 con 0x7f5af00afe40 2024-09-12T02:52:58.155 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:52:58.155 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":94,"btime":"2024-09-12T02:52:57:752799+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7177,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/119222923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":119222923},{"type":"v1","addr":"172.21.15.112:6837","nonce":119222923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7180,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/691058370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":691058370},{"type":"v1","addr":"172.21.15.137:6834","nonce":691058370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7854,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/1978579863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1978579863},{"type":"v1","addr":"172.21.15.112:6836","nonce":1978579863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:52:54.149640+0000","modified":"2024-09-12T02:52:57.153816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7860},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7860":{"gid":7860,"name":"b","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/1283773082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1283773082},{"type":"v1","addr":"172.21.15.137:6835","nonce":1283773082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7860,"qdb_cluster":[7860]},"id":11}]} 2024-09-12T02:52:58.155 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 94 2024-09-12T02:52:58.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.156+0000 7f5aef200640 1 -- 172.21.15.112:0/2993346665 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5ad006be60 msgr2=0x7f5ad006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:58.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.156+0000 7f5aef200640 1 --2- 172.21.15.112:0/2993346665 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5ad006be60 0x7f5ad006e320 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0006fd0 tx=0x7f5ae0008040 comp rx=0 tx=0).stop 2024-09-12T02:52:58.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.156+0000 7f5aef200640 1 -- 172.21.15.112:0/2993346665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5af00afe40 msgr2=0x7f5af0158310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:58.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.156+0000 7f5aef200640 1 --2- 172.21.15.112:0/2993346665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5af00afe40 0x7f5af0158310 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f5adc02a220 tx=0x7f5adc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:52:58.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.156+0000 7f5aef200640 1 -- 172.21.15.112:0/2993346665 shutdown_connections 2024-09-12T02:52:58.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.156+0000 7f5aef200640 1 --2- 172.21.15.112:0/2993346665 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5ad006be60 0x7f5ad006e320 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:58.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.156+0000 7f5aef200640 1 --2- 172.21.15.112:0/2993346665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5af015ed60 0x7f5af01f7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:58.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.156+0000 7f5aef200640 1 --2- 172.21.15.112:0/2993346665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5af00afe40 0x7f5af0158310 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:58.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.156+0000 7f5aef200640 1 --2- 172.21.15.112:0/2993346665 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5af006da10 0x7f5af01f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:58.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.156+0000 7f5aef200640 1 -- 172.21.15.112:0/2993346665 >> 172.21.15.112:0/2993346665 conn(0x7f5af00b7e80 msgr2=0x7f5af00b1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:58.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.156+0000 7f5aef200640 1 -- 172.21.15.112:0/2993346665 shutdown_connections 2024-09-12T02:52:58.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.156+0000 7f5aef200640 1 -- 172.21.15.112:0/2993346665 wait complete. 2024-09-12T02:52:58.174 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:52:58.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.325+0000 7fbed9a00640 1 Processor -- start 2024-09-12T02:52:58.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.325+0000 7fbed9a00640 1 -- start start 2024-09-12T02:52:58.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.326+0000 7fbed9a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbed40b3e00 0x7fbed40d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:58.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.326+0000 7fbed9a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbed40b1d70 0x7fbed40b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:58.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.326+0000 7fbed9a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbed40d2fb0 con 0x7fbed40d1710 2024-09-12T02:52:58.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.326+0000 7fbed9a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fbed40d3cb0 con 0x7fbed40b1d70 2024-09-12T02:52:58.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.326+0000 7fbed9a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbed40d0b60 con 0x7fbed40b3e00 2024-09-12T02:52:58.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.326+0000 7fbed9000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbed40b1d70 0x7fbed40b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:58.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.326+0000 7fbed3e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fbed40d1710 0x7fbed40d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:43004/0 (socket says 172.21.15.112:43004) 2024-09-12T02:52:58.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.326+0000 7fbed3e00640 1 -- 172.21.15.112:0/3331312757 learned_addr learned my addr 172.21.15.112:0/3331312757 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:52:58.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.327+0000 7fbed3400640 1 --2- 172.21.15.112:0/3331312757 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbed40b3e00 0x7fbed40d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:58.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.327+0000 7fbed9000640 1 -- 172.21.15.112:0/3331312757 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbed40b3e00 msgr2=0x7fbed40d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:58.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.327+0000 7fbed9000640 1 --2- 172.21.15.112:0/3331312757 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbed40b3e00 0x7fbed40d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:58.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.327+0000 7fbed9000640 1 -- 172.21.15.112:0/3331312757 >> v1:172.21.15.112:6789/0 conn(0x7fbed40d1710 legacy=0x7fbed40d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:58.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.327+0000 7fbed9000640 1 -- 172.21.15.112:0/3331312757 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed40d3410 con 0x7fbed40b1d70 2024-09-12T02:52:58.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.328+0000 7fbed9000640 1 --2- 172.21.15.112:0/3331312757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbed40b1d70 0x7fbed40b2200 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009d90 tx=0x7fbecc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8677488dec48cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:58.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.328+0000 7fbed2a00640 1 -- 172.21.15.112:0/3331312757 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc007740 con 0x7fbed40b1d70 2024-09-12T02:52:58.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.328+0000 7fbed2a00640 1 -- 172.21.15.112:0/3331312757 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbecc0078e0 con 0x7fbed40b1d70 2024-09-12T02:52:58.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.328+0000 7fbed2a00640 1 -- 172.21.15.112:0/3331312757 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc007cb0 con 0x7fbed40b1d70 2024-09-12T02:52:58.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.329+0000 7fbed9a00640 1 -- 172.21.15.112:0/3331312757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbed40b1d70 msgr2=0x7fbed40b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:58.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.329+0000 7fbed9a00640 1 --2- 172.21.15.112:0/3331312757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbed40b1d70 0x7fbed40b2200 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009d90 tx=0x7fbecc02a660 comp rx=0 tx=0).stop 2024-09-12T02:52:58.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.329+0000 7fbed9a00640 1 -- 172.21.15.112:0/3331312757 shutdown_connections 2024-09-12T02:52:58.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.329+0000 7fbed9a00640 1 --2- 172.21.15.112:0/3331312757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbed40b1d70 0x7fbed40b2200 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:58.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.329+0000 7fbed9a00640 1 --2- 172.21.15.112:0/3331312757 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbed40b3e00 0x7fbed40d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:58.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.329+0000 7fbed9a00640 1 -- 172.21.15.112:0/3331312757 >> 172.21.15.112:0/3331312757 conn(0x7fbed409e030 msgr2=0x7fbed40d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:58.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.329+0000 7fbed9a00640 1 -- 172.21.15.112:0/3331312757 shutdown_connections 2024-09-12T02:52:58.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.329+0000 7fbed9a00640 1 -- 172.21.15.112:0/3331312757 wait complete. 2024-09-12T02:52:58.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.330+0000 7fbed9a00640 1 Processor -- start 2024-09-12T02:52:58.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.330+0000 7fbed9a00640 1 -- start start 2024-09-12T02:52:58.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.331+0000 7fbed9a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbed40b1d70 0x7fbed40b8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:58.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.331+0000 7fbed9a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbed40b3e00 0x7fbed4161280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:58.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.331+0000 7fbed9a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbed40d1710 0x7fbed41572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:58.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.331+0000 7fbed9a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbed415f110 con 0x7fbed40b3e00 2024-09-12T02:52:58.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.331+0000 7fbed9a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbed40d39d0 con 0x7fbed40b1d70 2024-09-12T02:52:58.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.331+0000 7fbed9a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbed415f290 con 0x7fbed40d1710 2024-09-12T02:52:58.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.332+0000 7fbed3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbed40b3e00 0x7fbed4161280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:58.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.332+0000 7fbed3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbed40b3e00 0x7fbed4161280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57844/0 (socket says 172.21.15.112:57844) 2024-09-12T02:52:58.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.332+0000 7fbed3400640 1 -- 172.21.15.112:0/3809101033 learned_addr learned my addr 172.21.15.112:0/3809101033 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:58.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.332+0000 7fbed9000640 1 --2- 172.21.15.112:0/3809101033 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbed40d1710 0x7fbed41572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:58.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.332+0000 7fbed3e00640 1 --2- 172.21.15.112:0/3809101033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbed40b1d70 0x7fbed40b8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:58.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.332+0000 7fbed3400640 1 -- 172.21.15.112:0/3809101033 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbed40d1710 msgr2=0x7fbed41572a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:58.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.332+0000 7fbed3400640 1 --2- 172.21.15.112:0/3809101033 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbed40d1710 0x7fbed41572a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:58.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.332+0000 7fbed3400640 1 -- 172.21.15.112:0/3809101033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbed40b1d70 msgr2=0x7fbed40b8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:58.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.332+0000 7fbed3400640 1 --2- 172.21.15.112:0/3809101033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbed40b1d70 0x7fbed40b8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:58.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.332+0000 7fbed3400640 1 -- 172.21.15.112:0/3809101033 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed41617c0 con 0x7fbed40b3e00 2024-09-12T02:52:58.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.332+0000 7fbed3400640 1 --2- 172.21.15.112:0/3809101033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbed40b3e00 0x7fbed4161280 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fbec000d800 tx=0x7fbec000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:58.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.333+0000 7fbecbe00640 1 -- 172.21.15.112:0/3809101033 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec000b6c0 con 0x7fbed40b3e00 2024-09-12T02:52:58.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.333+0000 7fbecbe00640 1 -- 172.21.15.112:0/3809101033 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec0019070 con 0x7fbed40b3e00 2024-09-12T02:52:58.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.333+0000 7fbed9a00640 1 -- 172.21.15.112:0/3809101033 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbed4161a80 con 0x7fbed40b3e00 2024-09-12T02:52:58.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.333+0000 7fbecbe00640 1 -- 172.21.15.112:0/3809101033 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec000ba80 con 0x7fbed40b3e00 2024-09-12T02:52:58.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.333+0000 7fbed9a00640 1 -- 172.21.15.112:0/3809101033 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbed4162040 con 0x7fbed40b3e00 2024-09-12T02:52:58.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.334+0000 7fbed9a00640 1 -- 172.21.15.112:0/3809101033 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbed40d28d0 con 0x7fbed40b3e00 2024-09-12T02:52:58.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.335+0000 7fbecbe00640 1 -- 172.21.15.112:0/3809101033 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbec000bc20 con 0x7fbed40b3e00 2024-09-12T02:52:58.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.335+0000 7fbecbe00640 1 --2- 172.21.15.112:0/3809101033 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbeb406be60 0x7fbeb406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:58.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.336+0000 7fbecbe00640 1 -- 172.21.15.112:0/3809101033 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7fbec008b1c0 con 0x7fbed40b3e00 2024-09-12T02:52:58.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.336+0000 7fbed3e00640 1 --2- 172.21.15.112:0/3809101033 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbeb406be60 0x7fbeb406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:58.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.336+0000 7fbed3e00640 1 --2- 172.21.15.112:0/3809101033 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbeb406be60 0x7fbeb406e320 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbec4007fd0 tx=0x7fbec4007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:58.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.340+0000 7fbecbe00640 1 -- 172.21.15.112:0/3809101033 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbec0059510 con 0x7fbed40b3e00 2024-09-12T02:52:58.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.512+0000 7fbed9a00640 1 -- 172.21.15.112:0/3809101033 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbed41577e0 con 0x7fbed40b3e00 2024-09-12T02:52:58.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.513+0000 7fbecbe00640 1 -- 172.21.15.112:0/3809101033 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) ==== 74+0+16780 (secure 0 0 0) 0x7fbec005d810 con 0x7fbed40b3e00 2024-09-12T02:52:58.514 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:52:58.514 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":183,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:52:55.730549+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:52:51.909503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-12T02:52:53.146578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:52:58.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.515+0000 7fbed9a00640 1 -- 172.21.15.112:0/3809101033 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbeb406be60 msgr2=0x7fbeb406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:58.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.515+0000 7fbed9a00640 1 --2- 172.21.15.112:0/3809101033 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbeb406be60 0x7fbeb406e320 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbec4007fd0 tx=0x7fbec4007e80 comp rx=0 tx=0).stop 2024-09-12T02:52:58.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.515+0000 7fbed9a00640 1 -- 172.21.15.112:0/3809101033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbed40b3e00 msgr2=0x7fbed4161280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:58.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.515+0000 7fbed9a00640 1 --2- 172.21.15.112:0/3809101033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbed40b3e00 0x7fbed4161280 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fbec000d800 tx=0x7fbec000dcc0 comp rx=0 tx=0).stop 2024-09-12T02:52:58.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.515+0000 7fbed9a00640 1 -- 172.21.15.112:0/3809101033 shutdown_connections 2024-09-12T02:52:58.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.515+0000 7fbed9a00640 1 --2- 172.21.15.112:0/3809101033 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbed40d1710 0x7fbed41572a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:58.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.515+0000 7fbed9a00640 1 --2- 172.21.15.112:0/3809101033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbed40b3e00 0x7fbed4161280 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:58.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.515+0000 7fbed9a00640 1 --2- 172.21.15.112:0/3809101033 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbeb406be60 0x7fbeb406e320 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:58.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.515+0000 7fbed9a00640 1 --2- 172.21.15.112:0/3809101033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbed40b1d70 0x7fbed40b8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:58.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.515+0000 7fbed9a00640 1 -- 172.21.15.112:0/3809101033 >> 172.21.15.112:0/3809101033 conn(0x7fbed409e030 msgr2=0x7fbed40ba320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:58.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.515+0000 7fbed9a00640 1 -- 172.21.15.112:0/3809101033 shutdown_connections 2024-09-12T02:52:58.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.515+0000 7fbed9a00640 1 -- 172.21.15.112:0/3809101033 wait complete. 2024-09-12T02:52:58.532 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:52:58.532 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:52:58.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.683+0000 7f3a0ac00640 1 Processor -- start 2024-09-12T02:52:58.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.683+0000 7f3a0ac00640 1 -- start start 2024-09-12T02:52:58.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.684+0000 7f3a0ac00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3a040d1710 0x7f3a040d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:58.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.684+0000 7f3a0ac00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3a040b3e00 0x7f3a040d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:58.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.684+0000 7f3a0ac00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a040d2fb0 con 0x7f3a040cf7a0 2024-09-12T02:52:58.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.684+0000 7f3a0ac00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f3a040d3cb0 con 0x7f3a040b3e00 2024-09-12T02:52:58.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.684+0000 7f3a0ac00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3a040d0b60 con 0x7f3a040d1710 2024-09-12T02:52:58.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.684+0000 7f3a08e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3a040b3e00 0x7f3a040d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:58.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.684+0000 7f3a08e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3a040b3e00 0x7f3a040d1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57858/0 (socket says 172.21.15.112:57858) 2024-09-12T02:52:58.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.684+0000 7f3a0a200640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f3a040cf7a0 0x7f3a040cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:43012/0 (socket says 172.21.15.112:43012) 2024-09-12T02:52:58.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.684+0000 7f3a08e00640 1 -- 172.21.15.112:0/3423204509 learned_addr learned my addr 172.21.15.112:0/3423204509 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:58.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.685+0000 7f3a09800640 1 --2- 172.21.15.112:0/3423204509 >> v2:172.21.15.137:3300/0 conn(0x7f3a040d1710 0x7f3a040d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:58.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.685+0000 7f3a08e00640 1 -- 172.21.15.112:0/3423204509 >> v2:172.21.15.137:3300/0 conn(0x7f3a040d1710 msgr2=0x7f3a040d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:58.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.685+0000 7f3a08e00640 1 --2- 172.21.15.112:0/3423204509 >> v2:172.21.15.137:3300/0 conn(0x7f3a040d1710 0x7f3a040d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:58.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.685+0000 7f3a08e00640 1 -- 172.21.15.112:0/3423204509 >> v1:172.21.15.112:6789/0 conn(0x7f3a040cf7a0 legacy=0x7f3a040cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:58.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.685+0000 7f3a08e00640 1 -- 172.21.15.112:0/3423204509 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a040d2030 con 0x7f3a040b3e00 2024-09-12T02:52:58.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.685+0000 7f3a03e00640 1 -- 172.21.15.112:0/3423204509 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3587918125 0 0) 0x7f3a040d2fb0 con 0x7f3a040cf7a0 2024-09-12T02:52:58.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.685+0000 7f3a09800640 1 --2- 172.21.15.112:0/3423204509 >> v2:172.21.15.137:3300/0 conn(0x7f3a040d1710 0x7f3a040d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:52:58.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.686+0000 7f3a08e00640 1 --2- 172.21.15.112:0/3423204509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a040b3e00 0x7f3a040d1af0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f3a0408dd50 tx=0x7f39f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64774b0a95e3bfd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:58.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.686+0000 7f3a03e00640 1 -- 172.21.15.112:0/3423204509 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f0037070 con 0x7f3a040b3e00 2024-09-12T02:52:58.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.686+0000 7f3a03e00640 1 -- 172.21.15.112:0/3423204509 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f0032440 con 0x7f3a040b3e00 2024-09-12T02:52:58.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.686+0000 7f3a03e00640 1 -- 172.21.15.112:0/3423204509 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f0032810 con 0x7f3a040b3e00 2024-09-12T02:52:58.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.687+0000 7f3a0ac00640 1 -- 172.21.15.112:0/3423204509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a040b3e00 msgr2=0x7f3a040d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:58.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.687+0000 7f3a0ac00640 1 --2- 172.21.15.112:0/3423204509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a040b3e00 0x7f3a040d1af0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f3a0408dd50 tx=0x7f39f002a270 comp rx=0 tx=0).stop 2024-09-12T02:52:58.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.687+0000 7f3a0ac00640 1 -- 172.21.15.112:0/3423204509 shutdown_connections 2024-09-12T02:52:58.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.687+0000 7f3a0ac00640 1 --2- 172.21.15.112:0/3423204509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a040b3e00 0x7f3a040d1af0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:58.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.687+0000 7f3a0ac00640 1 --2- 172.21.15.112:0/3423204509 >> v2:172.21.15.137:3300/0 conn(0x7f3a040d1710 0x7f3a040d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:58.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.687+0000 7f3a0ac00640 1 -- 172.21.15.112:0/3423204509 >> 172.21.15.112:0/3423204509 conn(0x7f3a0409e030 msgr2=0x7f3a040d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:58.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.687+0000 7f3a0ac00640 1 -- 172.21.15.112:0/3423204509 shutdown_connections 2024-09-12T02:52:58.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.687+0000 7f3a0ac00640 1 -- 172.21.15.112:0/3423204509 wait complete. 2024-09-12T02:52:58.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.689+0000 7f3a0ac00640 1 Processor -- start 2024-09-12T02:52:58.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.689+0000 7f3a0ac00640 1 -- start start 2024-09-12T02:52:58.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.690+0000 7f3a0ac00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3a040b3e00 0x7f3a0414e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:58.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.690+0000 7f3a0ac00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a040cf7a0 0x7f3a0415f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:58.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.690+0000 7f3a0ac00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a040d1710 0x7f3a0415f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:58.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.690+0000 7f3a0ac00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3a040d39d0 con 0x7f3a040cf7a0 2024-09-12T02:52:58.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.690+0000 7f3a0ac00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3a040d36f0 con 0x7f3a040d1710 2024-09-12T02:52:58.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.690+0000 7f3a0ac00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3a0415f110 con 0x7f3a040b3e00 2024-09-12T02:52:58.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.690+0000 7f3a08e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a040cf7a0 0x7f3a0415f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:58.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.690+0000 7f3a08e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a040cf7a0 0x7f3a0415f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57866/0 (socket says 172.21.15.112:57866) 2024-09-12T02:52:58.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.690+0000 7f3a08e00640 1 -- 172.21.15.112:0/1349383571 learned_addr learned my addr 172.21.15.112:0/1349383571 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:58.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.690+0000 7f3a09800640 1 --2- 172.21.15.112:0/1349383571 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3a040b3e00 0x7f3a0414e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:58.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.690+0000 7f3a0a200640 1 --2- 172.21.15.112:0/1349383571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a040d1710 0x7f3a0415f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:58.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.690+0000 7f3a08e00640 1 -- 172.21.15.112:0/1349383571 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3a040b3e00 msgr2=0x7f3a0414e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:58.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.690+0000 7f3a08e00640 1 --2- 172.21.15.112:0/1349383571 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3a040b3e00 0x7f3a0414e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:58.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.690+0000 7f3a08e00640 1 -- 172.21.15.112:0/1349383571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a040d1710 msgr2=0x7f3a0415f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:58.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.690+0000 7f3a08e00640 1 --2- 172.21.15.112:0/1349383571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a040d1710 0x7f3a0415f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:58.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.690+0000 7f3a08e00640 1 -- 172.21.15.112:0/1349383571 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a041620d0 con 0x7f3a040cf7a0 2024-09-12T02:52:58.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.691+0000 7f3a08e00640 1 --2- 172.21.15.112:0/1349383571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a040cf7a0 0x7f3a0415f380 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f39f0000c00 tx=0x7f39f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:58.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.691+0000 7f3a01600640 1 -- 172.21.15.112:0/1349383571 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f0037040 con 0x7f3a040cf7a0 2024-09-12T02:52:58.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.691+0000 7f3a01600640 1 -- 172.21.15.112:0/1349383571 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f0042070 con 0x7f3a040cf7a0 2024-09-12T02:52:58.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.691+0000 7f3a01600640 1 -- 172.21.15.112:0/1349383571 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f0030bb0 con 0x7f3a040cf7a0 2024-09-12T02:52:58.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.691+0000 7f3a0ac00640 1 -- 172.21.15.112:0/1349383571 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a041623b0 con 0x7f3a040cf7a0 2024-09-12T02:52:58.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.691+0000 7f3a0ac00640 1 -- 172.21.15.112:0/1349383571 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a040ccec0 con 0x7f3a040cf7a0 2024-09-12T02:52:58.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.692+0000 7f3a0ac00640 1 -- 172.21.15.112:0/1349383571 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a040d1af0 con 0x7f3a040cf7a0 2024-09-12T02:52:58.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.693+0000 7f3a01600640 1 -- 172.21.15.112:0/1349383571 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f39f0047460 con 0x7f3a040cf7a0 2024-09-12T02:52:58.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.694+0000 7f3a01600640 1 --2- 172.21.15.112:0/1349383571 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f39e406be30 0x7f39e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:58.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.694+0000 7f3a01600640 1 -- 172.21.15.112:0/1349383571 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f39f00aba60 con 0x7f3a040cf7a0 2024-09-12T02:52:58.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.694+0000 7f3a09800640 1 --2- 172.21.15.112:0/1349383571 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f39e406be30 0x7f39e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:58.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.695+0000 7f3a09800640 1 --2- 172.21.15.112:0/1349383571 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f39e406be30 0x7f39e406e2f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f39f800a990 tx=0x7f39f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:58.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.698+0000 7f3a01600640 1 -- 172.21.15.112:0/1349383571 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f39f0045360 con 0x7f3a040cf7a0 2024-09-12T02:52:58.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.870+0000 7f3a0ac00640 1 -- 172.21.15.112:0/1349383571 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3a040b28d0 con 0x7f39e406be30 2024-09-12T02:52:58.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.876+0000 7f3a01600640 1 -- 172.21.15.112:0/1349383571 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237607 (secure 0 0 0) 0x7f3a040b28d0 con 0x7f39e406be30 2024-09-12T02:52:58.880 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:52:58.881 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:52:58.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.879+0000 7f3a0ac00640 1 -- 172.21.15.112:0/1349383571 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f39e406be30 msgr2=0x7f39e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:58.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.879+0000 7f3a0ac00640 1 --2- 172.21.15.112:0/1349383571 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f39e406be30 0x7f39e406e2f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f39f800a990 tx=0x7f39f8008040 comp rx=0 tx=0).stop 2024-09-12T02:52:58.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.879+0000 7f3a0ac00640 1 -- 172.21.15.112:0/1349383571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a040cf7a0 msgr2=0x7f3a0415f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:58.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.879+0000 7f3a0ac00640 1 --2- 172.21.15.112:0/1349383571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a040cf7a0 0x7f3a0415f380 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f39f0000c00 tx=0x7f39f00046c0 comp rx=0 tx=0).stop 2024-09-12T02:52:58.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.879+0000 7f3a0ac00640 1 -- 172.21.15.112:0/1349383571 shutdown_connections 2024-09-12T02:52:58.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.880+0000 7f3a0ac00640 1 --2- 172.21.15.112:0/1349383571 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f39e406be30 0x7f39e406e2f0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:58.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.880+0000 7f3a0ac00640 1 --2- 172.21.15.112:0/1349383571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a040d1710 0x7f3a0415f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:58.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.880+0000 7f3a0ac00640 1 --2- 172.21.15.112:0/1349383571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a040cf7a0 0x7f3a0415f380 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:58.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.880+0000 7f3a0ac00640 1 --2- 172.21.15.112:0/1349383571 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3a040b3e00 0x7f3a0414e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:58.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.880+0000 7f3a0ac00640 1 -- 172.21.15.112:0/1349383571 >> 172.21.15.112:0/1349383571 conn(0x7f3a0409e030 msgr2=0x7f3a040b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:58.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.880+0000 7f3a0ac00640 1 -- 172.21.15.112:0/1349383571 shutdown_connections 2024-09-12T02:52:58.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:58.880+0000 7f3a0ac00640 1 -- 172.21.15.112:0/1349383571 wait complete. 2024-09-12T02:52:58.896 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":512,"stamp":"2024-09-12T02:52:57.114263+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8989,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553510,"statfs":{"total":1600000000,"available":1590794375,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.391480"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.727700+0000","last_change":"2024-09-12T02:52:52.727700+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.727700+0000","last_undegraded":"2024-09-12T02:52:52.727700+0000","last_fullsized":"2024-09-12T02:52:52.727700+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.730657+0000","last_change":"2024-09-12T02:52:52.730657+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.730657+0000","last_undegraded":"2024-09-12T02:52:52.730657+0000","last_fullsized":"2024-09-12T02:52:52.730657+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.730230+0000","last_change":"2024-09-12T02:52:52.730230+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.730230+0000","last_undegraded":"2024-09-12T02:52:52.730230+0000","last_fullsized":"2024-09-12T02:52:52.730230+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.729470+0000","last_change":"2024-09-12T02:52:52.729470+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.729470+0000","last_undegraded":"2024-09-12T02:52:52.729470+0000","last_fullsized":"2024-09-12T02:52:52.729470+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.728605+0000","last_change":"2024-09-12T02:52:52.728605+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.728605+0000","last_undegraded":"2024-09-12T02:52:52.728605+0000","last_fullsized":"2024-09-12T02:52:52.728605+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.729837+0000","last_change":"2024-09-12T02:52:52.729837+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.729837+0000","last_undegraded":"2024-09-12T02:52:52.729837+0000","last_fullsized":"2024-09-12T02:52:52.729837+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.728066+0000","last_change":"2024-09-12T02:52:52.728066+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.728066+0000","last_undegraded":"2024-09-12T02:52:52.728066+0000","last_fullsized":"2024-09-12T02:52:52.728066+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.731014+0000","last_change":"2024-09-12T02:52:52.731014+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.731014+0000","last_undegraded":"2024-09-12T02:52:52.731014+0000","last_fullsized":"2024-09-12T02:52:52.731014+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.726311+0000","last_change":"2024-09-12T02:52:52.726311+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.726311+0000","last_undegraded":"2024-09-12T02:52:52.726311+0000","last_fullsized":"2024-09-12T02:52:52.726311+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.726367+0000","last_change":"2024-09-12T02:52:52.726367+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.726367+0000","last_undegraded":"2024-09-12T02:52:52.726367+0000","last_fullsized":"2024-09-12T02:52:52.726367+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.729918+0000","last_change":"2024-09-12T02:52:52.729918+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.729918+0000","last_undegraded":"2024-09-12T02:52:52.729918+0000","last_fullsized":"2024-09-12T02:52:52.729918+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.729894+0000","last_change":"2024-09-12T02:52:52.729894+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.729894+0000","last_undegraded":"2024-09-12T02:52:52.729894+0000","last_fullsized":"2024-09-12T02:52:52.729894+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.726970+0000","last_change":"2024-09-12T02:52:52.726970+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.726970+0000","last_undegraded":"2024-09-12T02:52:52.726970+0000","last_fullsized":"2024-09-12T02:52:52.726970+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.729928+0000","last_change":"2024-09-12T02:52:52.729928+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.729928+0000","last_undegraded":"2024-09-12T02:52:52.729928+0000","last_fullsized":"2024-09-12T02:52:52.729928+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.730610+0000","last_change":"2024-09-12T02:52:52.730610+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.730610+0000","last_undegraded":"2024-09-12T02:52:52.730610+0000","last_fullsized":"2024-09-12T02:52:52.730610+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.727449+0000","last_change":"2024-09-12T02:52:52.727449+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.727449+0000","last_undegraded":"2024-09-12T02:52:52.727449+0000","last_fullsized":"2024-09-12T02:52:52.727449+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.728154+0000","last_change":"2024-09-12T02:52:52.728154+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.728154+0000","last_undegraded":"2024-09-12T02:52:52.728154+0000","last_fullsized":"2024-09-12T02:52:52.728154+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.730052+0000","last_change":"2024-09-12T02:52:52.730052+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.730052+0000","last_undegraded":"2024-09-12T02:52:52.730052+0000","last_fullsized":"2024-09-12T02:52:52.730052+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.727744+0000","last_change":"2024-09-12T02:52:52.727744+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.727744+0000","last_undegraded":"2024-09-12T02:52:52.727744+0000","last_fullsized":"2024-09-12T02:52:52.727744+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.729477+0000","last_change":"2024-09-12T02:52:52.729477+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.729477+0000","last_undegraded":"2024-09-12T02:52:52.729477+0000","last_fullsized":"2024-09-12T02:52:52.729477+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.728306+0000","last_change":"2024-09-12T02:52:52.728306+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.728306+0000","last_undegraded":"2024-09-12T02:52:52.728306+0000","last_fullsized":"2024-09-12T02:52:52.728306+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.729486+0000","last_change":"2024-09-12T02:52:52.729486+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.729486+0000","last_undegraded":"2024-09-12T02:52:52.729486+0000","last_fullsized":"2024-09-12T02:52:52.729486+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.728612+0000","last_change":"2024-09-12T02:52:52.728612+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.728612+0000","last_undegraded":"2024-09-12T02:52:52.728612+0000","last_fullsized":"2024-09-12T02:52:52.728612+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.726881+0000","last_change":"2024-09-12T02:52:52.726881+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.726881+0000","last_undegraded":"2024-09-12T02:52:52.726881+0000","last_fullsized":"2024-09-12T02:52:52.726881+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.727877+0000","last_change":"2024-09-12T02:52:52.727877+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.727877+0000","last_undegraded":"2024-09-12T02:52:52.727877+0000","last_fullsized":"2024-09-12T02:52:52.727877+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.727476+0000","last_change":"2024-09-12T02:52:52.727476+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.727476+0000","last_undegraded":"2024-09-12T02:52:52.727476+0000","last_fullsized":"2024-09-12T02:52:52.727476+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.726974+0000","last_change":"2024-09-12T02:52:52.726974+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.726974+0000","last_undegraded":"2024-09-12T02:52:52.726974+0000","last_fullsized":"2024-09-12T02:52:52.726974+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.730698+0000","last_change":"2024-09-12T02:52:52.730698+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.730698+0000","last_undegraded":"2024-09-12T02:52:52.730698+0000","last_fullsized":"2024-09-12T02:52:52.730698+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.729497+0000","last_change":"2024-09-12T02:52:52.729497+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.729497+0000","last_undegraded":"2024-09-12T02:52:52.729497+0000","last_fullsized":"2024-09-12T02:52:52.729497+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.727416+0000","last_change":"2024-09-12T02:52:52.727416+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.727416+0000","last_undegraded":"2024-09-12T02:52:52.727416+0000","last_fullsized":"2024-09-12T02:52:52.727416+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.730323+0000","last_change":"2024-09-12T02:52:52.730323+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.730323+0000","last_undegraded":"2024-09-12T02:52:52.730323+0000","last_fullsized":"2024-09-12T02:52:52.730323+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:52:53.722379+0000","last_change":"2024-09-12T02:52:53.722379+0000","last_active":"2024-09-12T02:52:53.722379+0000","last_peered":"2024-09-12T02:52:53.722379+0000","last_clean":"2024-09-12T02:52:53.722379+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:53.722379+0000","last_undegraded":"2024-09-12T02:52:53.722379+0000","last_fullsized":"2024-09-12T02:52:53.722379+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":1,"reported_epoch":180,"state":"creating+peering","last_fresh":"2024-09-12T02:52:52.731196+0000","last_change":"2024-09-12T02:52:52.731196+0000","last_active":"2024-09-12T02:52:52.719443+0000","last_peered":"2024-09-12T02:52:52.719443+0000","last_clean":"2024-09-12T02:52:52.719443+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:52:52.731196+0000","last_undegraded":"2024-09-12T02:52:52.731196+0000","last_fullsized":"2024-09-12T02:52:52.731196+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":477,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-12T02:52:52.730275+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:52:52.730275+0000","last_peered":"2024-09-12T02:52:52.730275+0000","last_clean":"2024-09-12T02:52:52.730275+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:52:52.730275+0000","last_undegraded":"2024-09-12T02:52:52.730275+0000","last_fullsized":"2024-09-12T02:52:52.730275+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:25.823876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574984,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1561,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193751,"statfs":{"total":200000000,"available":198401431,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574984,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":978,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194333,"statfs":{"total":200000000,"available":198997616,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574984,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":978,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194333,"statfs":{"total":200000000,"available":198997616,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574984,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":978,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194333,"statfs":{"total":200000000,"available":198997616,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574984,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":978,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194333,"statfs":{"total":200000000,"available":198997616,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574984,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":978,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194333,"statfs":{"total":200000000,"available":198997616,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574984,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":978,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194333,"statfs":{"total":200000000,"available":198997616,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574984,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1555,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193757,"statfs":{"total":200000000,"available":198407248,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:52:58.901 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:52:59.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.089+0000 7fc6ed000640 1 Processor -- start 2024-09-12T02:52:59.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.089+0000 7fc6ed000640 1 -- start start 2024-09-12T02:52:59.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.090+0000 7fc6ed000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6e806d590 0x7fc6e806f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:59.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.090+0000 7fc6ed000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6e80b42c0 con 0x7fc6e815b9a0 2024-09-12T02:52:59.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.090+0000 7fc6ed000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6e815bd80 con 0x7fc6e80d0820 2024-09-12T02:52:59.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.090+0000 7fc6ed000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc6e806de70 con 0x7fc6e806d590 2024-09-12T02:52:59.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.090+0000 7fc6e7400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc6e815b9a0 0x7fc6e80b5020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:43022/0 (socket says 172.21.15.112:43022) 2024-09-12T02:52:59.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.090+0000 7fc6e7400640 1 -- 172.21.15.112:0/1389079438 learned_addr learned my addr 172.21.15.112:0/1389079438 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:52:59.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.091+0000 7fc6e6a00640 1 -- 172.21.15.112:0/1389079438 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2916601102 0 0) 0x7fc6d8001110 con 0x7fc6e815b9a0 2024-09-12T02:52:59.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.091+0000 7fc6e6a00640 1 -- 172.21.15.112:0/1389079438 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6cc003520 con 0x7fc6e815b9a0 2024-09-12T02:52:59.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.091+0000 7fc6e6a00640 1 -- 172.21.15.112:0/1389079438 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 310180243 0 0) 0x7fc6cc003520 con 0x7fc6e815b9a0 2024-09-12T02:52:59.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.091+0000 7fc6e6a00640 1 -- 172.21.15.112:0/1389079438 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6e806d590 msgr2=0x7fc6e806f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:59.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.091+0000 7fc6e6a00640 1 --2- 172.21.15.112:0/1389079438 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6e806d590 0x7fc6e806f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:59.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.091+0000 7fc6e6a00640 1 -- 172.21.15.112:0/1389079438 >> v1:172.21.15.137:6789/0 conn(0x7fc6e80d0820 legacy=0x7fc6e8071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:59.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.091+0000 7fc6e6a00640 1 -- 172.21.15.112:0/1389079438 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e80b5730 con 0x7fc6e815b9a0 2024-09-12T02:52:59.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.091+0000 7fc6e6a00640 1 -- 172.21.15.112:0/1389079438 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7fc6d8001840 con 0x7fc6e815b9a0 2024-09-12T02:52:59.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.091+0000 7fc6e6a00640 1 -- 172.21.15.112:0/1389079438 >> v1:172.21.15.112:6789/0 conn(0x7fc6e815b9a0 legacy=0x7fc6e80b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:59.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.091+0000 7fc6e6a00640 1 --2- 172.21.15.112:0/1389079438 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6e806d590 0x7fc6cc0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:59.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.091+0000 7fc6e6a00640 1 --2- 172.21.15.112:0/1389079438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6cc0040b0 0x7fc6cc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:59.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.091+0000 7fc6e6a00640 1 --2- 172.21.15.112:0/1389079438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6cc004d90 0x7fc6cc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:59.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.091+0000 7fc6e6a00640 1 -- 172.21.15.112:0/1389079438 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e806de70 con 0x7fc6cc0040b0 2024-09-12T02:52:59.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.091+0000 7fc6e6a00640 1 -- 172.21.15.112:0/1389079438 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc6cc00bc00 con 0x7fc6cc004d90 2024-09-12T02:52:59.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.091+0000 7fc6e6a00640 1 -- 172.21.15.112:0/1389079438 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc6cc00be00 con 0x7fc6e806d590 2024-09-12T02:52:59.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.091+0000 7fc6dea00640 1 --2- 172.21.15.112:0/1389079438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6cc0040b0 0x7fc6cc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:59.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.092+0000 7fc6dea00640 1 -- 172.21.15.112:0/1389079438 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6e806d590 msgr2=0x7fc6cc0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:59.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.092+0000 7fc6dea00640 1 --2- 172.21.15.112:0/1389079438 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6e806d590 0x7fc6cc0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:59.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.092+0000 7fc6dea00640 1 -- 172.21.15.112:0/1389079438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6cc004d90 msgr2=0x7fc6cc005210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:52:59.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.092+0000 7fc6dea00640 1 --2- 172.21.15.112:0/1389079438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6cc004d90 0x7fc6cc005210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:59.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.092+0000 7fc6dea00640 1 -- 172.21.15.112:0/1389079438 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6cc003520 con 0x7fc6cc0040b0 2024-09-12T02:52:59.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.093+0000 7fc6dea00640 1 --2- 172.21.15.112:0/1389079438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6cc0040b0 0x7fc6cc004800 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0009e10 tx=0x7fc6cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b634180e536127c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:59.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.093+0000 7fc6e6a00640 1 -- 172.21.15.112:0/1389079438 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0033070 con 0x7fc6cc0040b0 2024-09-12T02:52:59.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.093+0000 7fc6e6a00640 1 -- 172.21.15.112:0/1389079438 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d0006e50 con 0x7fc6cc0040b0 2024-09-12T02:52:59.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.093+0000 7fc6e6a00640 1 -- 172.21.15.112:0/1389079438 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0009a10 con 0x7fc6cc0040b0 2024-09-12T02:52:59.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.094+0000 7fc6ed000640 1 -- 172.21.15.112:0/1389079438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6cc0040b0 msgr2=0x7fc6cc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:59.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.094+0000 7fc6ed000640 1 --2- 172.21.15.112:0/1389079438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6cc0040b0 0x7fc6cc004800 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0009e10 tx=0x7fc6cc005830 comp rx=0 tx=0).stop 2024-09-12T02:52:59.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.094+0000 7fc6e7e00640 1 -- 172.21.15.112:0/1389079438 reap_dead start 2024-09-12T02:52:59.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.094+0000 7fc6ed000640 1 -- 172.21.15.112:0/1389079438 shutdown_connections 2024-09-12T02:52:59.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.094+0000 7fc6ed000640 1 -- 172.21.15.112:0/1389079438 >> 172.21.15.112:0/1389079438 conn(0x7fc6e806bbd0 msgr2=0x7fc6e806bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:59.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.094+0000 7fc6ed000640 1 -- 172.21.15.112:0/1389079438 shutdown_connections 2024-09-12T02:52:59.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.094+0000 7fc6ed000640 1 -- 172.21.15.112:0/1389079438 wait complete. 2024-09-12T02:52:59.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.095+0000 7fc6ed000640 1 Processor -- start 2024-09-12T02:52:59.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.096+0000 7fc6ed000640 1 -- start start 2024-09-12T02:52:59.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.096+0000 7fc6ed000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6cc0040b0 0x7fc6e80c6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:59.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.096+0000 7fc6ed000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6e80c5a90 0x7fc6e8157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:59.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.096+0000 7fc6ed000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6e80c9f70 0x7fc6e80ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:59.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.096+0000 7fc6ed000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e80b4820 con 0x7fc6cc0040b0 2024-09-12T02:52:59.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.096+0000 7fc6ed000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e80b4540 con 0x7fc6e80c5a90 2024-09-12T02:52:59.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.096+0000 7fc6ed000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc6e80b4b00 con 0x7fc6e80c9f70 2024-09-12T02:52:59.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.097+0000 7fc6e7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6cc0040b0 0x7fc6e80c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:59.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.097+0000 7fc6e7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6cc0040b0 0x7fc6e80c6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57878/0 (socket says 172.21.15.112:57878) 2024-09-12T02:52:59.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.097+0000 7fc6e7400640 1 -- 172.21.15.112:0/1607246471 learned_addr learned my addr 172.21.15.112:0/1607246471 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:59.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.097+0000 7fc6e7400640 1 -- 172.21.15.112:0/1607246471 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6e80c9f70 msgr2=0x7fc6e80ca3f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:52:59.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.097+0000 7fc6e7400640 1 --2- 172.21.15.112:0/1607246471 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6e80c9f70 0x7fc6e80ca3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:59.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.097+0000 7fc6e7400640 1 -- 172.21.15.112:0/1607246471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6e80c5a90 msgr2=0x7fc6e8157740 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:52:59.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.097+0000 7fc6e7400640 1 --2- 172.21.15.112:0/1607246471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6e80c5a90 0x7fc6e8157740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:59.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.097+0000 7fc6e7400640 1 -- 172.21.15.112:0/1607246471 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e815c1b0 con 0x7fc6cc0040b0 2024-09-12T02:52:59.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.097+0000 7fc6e7400640 1 --2- 172.21.15.112:0/1607246471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6cc0040b0 0x7fc6e80c6970 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fc6d800c780 tx=0x7fc6d800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:59.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.097+0000 7fc6dfe00640 1 -- 172.21.15.112:0/1607246471 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8018070 con 0x7fc6cc0040b0 2024-09-12T02:52:59.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.098+0000 7fc6dfe00640 1 -- 172.21.15.112:0/1607246471 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d80074e0 con 0x7fc6cc0040b0 2024-09-12T02:52:59.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.098+0000 7fc6dfe00640 1 -- 172.21.15.112:0/1607246471 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8004a20 con 0x7fc6cc0040b0 2024-09-12T02:52:59.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.098+0000 7fc6ed000640 1 -- 172.21.15.112:0/1607246471 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6e815c490 con 0x7fc6cc0040b0 2024-09-12T02:52:59.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.098+0000 7fc6ed000640 1 -- 172.21.15.112:0/1607246471 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6e815ca50 con 0x7fc6cc0040b0 2024-09-12T02:52:59.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.099+0000 7fc6ed000640 1 -- 172.21.15.112:0/1607246471 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6e80b5b50 con 0x7fc6cc0040b0 2024-09-12T02:52:59.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.100+0000 7fc6dfe00640 1 -- 172.21.15.112:0/1607246471 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc6d8004bc0 con 0x7fc6cc0040b0 2024-09-12T02:52:59.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.101+0000 7fc6dfe00640 1 --2- 172.21.15.112:0/1607246471 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc6c406be60 0x7fc6c406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:59.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.101+0000 7fc6dfe00640 1 -- 172.21.15.112:0/1607246471 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7fc6d808a460 con 0x7fc6cc0040b0 2024-09-12T02:52:59.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.101+0000 7fc6dea00640 1 --2- 172.21.15.112:0/1607246471 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc6c406be60 0x7fc6c406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:59.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.102+0000 7fc6dea00640 1 --2- 172.21.15.112:0/1607246471 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc6c406be60 0x7fc6c406e320 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0035000 tx=0x7fc6d0030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:59.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.105+0000 7fc6dfe00640 1 -- 172.21.15.112:0/1607246471 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc6e80b42c0 con 0x7fc6cc0040b0 2024-09-12T02:52:59.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.276+0000 7fc6ed000640 1 -- 172.21.15.112:0/1607246471 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc6e815cc20 con 0x7fc6c406be60 2024-09-12T02:52:59.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.282+0000 7fc6dfe00640 1 -- 172.21.15.112:0/1607246471 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247999 (secure 0 0 0) 0x7fc6e815cc20 con 0x7fc6c406be60 2024-09-12T02:52:59.286 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:52:59.287 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:52:59.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.287+0000 7fc6ed000640 1 -- 172.21.15.112:0/1607246471 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc6c406be60 msgr2=0x7fc6c406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:59.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.287+0000 7fc6ed000640 1 --2- 172.21.15.112:0/1607246471 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc6c406be60 0x7fc6c406e320 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0035000 tx=0x7fc6d0030000 comp rx=0 tx=0).stop 2024-09-12T02:52:59.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.287+0000 7fc6ed000640 1 -- 172.21.15.112:0/1607246471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6cc0040b0 msgr2=0x7fc6e80c6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:59.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.287+0000 7fc6ed000640 1 --2- 172.21.15.112:0/1607246471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6cc0040b0 0x7fc6e80c6970 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fc6d800c780 tx=0x7fc6d800cc40 comp rx=0 tx=0).stop 2024-09-12T02:52:59.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.287+0000 7fc6ed000640 1 -- 172.21.15.112:0/1607246471 shutdown_connections 2024-09-12T02:52:59.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.287+0000 7fc6ed000640 1 --2- 172.21.15.112:0/1607246471 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6e80c9f70 0x7fc6e80ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:59.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.287+0000 7fc6ed000640 1 --2- 172.21.15.112:0/1607246471 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc6c406be60 0x7fc6c406e320 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:59.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.287+0000 7fc6ed000640 1 --2- 172.21.15.112:0/1607246471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6e80c5a90 0x7fc6e8157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:59.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.287+0000 7fc6ed000640 1 --2- 172.21.15.112:0/1607246471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6cc0040b0 0x7fc6e80c6970 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:59.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.287+0000 7fc6ed000640 1 -- 172.21.15.112:0/1607246471 >> 172.21.15.112:0/1607246471 conn(0x7fc6e806bbd0 msgr2=0x7fc6e80ce400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:59.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.287+0000 7fc6ed000640 1 -- 172.21.15.112:0/1607246471 shutdown_connections 2024-09-12T02:52:59.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.287+0000 7fc6ed000640 1 -- 172.21.15.112:0/1607246471 wait complete. 2024-09-12T02:52:59.303 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":513,"stamp":"2024-09-12T02:52:59.114645+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9185,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553314,"statfs":{"total":1600000000,"available":1590594036,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001076"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.897806+0000","last_change":"2024-09-12T02:52:54.752906+0000","last_active":"2024-09-12T02:52:55.897806+0000","last_peered":"2024-09-12T02:52:55.897806+0000","last_clean":"2024-09-12T02:52:55.897806+0000","last_became_active":"2024-09-12T02:52:54.752655+0000","last_became_peered":"2024-09-12T02:52:54.752655+0000","last_unstale":"2024-09-12T02:52:55.897806+0000","last_undegraded":"2024-09-12T02:52:55.897806+0000","last_fullsized":"2024-09-12T02:52:55.897806+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:19.331633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.735847+0000","last_change":"2024-09-12T02:52:54.747231+0000","last_active":"2024-09-12T02:52:55.735847+0000","last_peered":"2024-09-12T02:52:55.735847+0000","last_clean":"2024-09-12T02:52:55.735847+0000","last_became_active":"2024-09-12T02:52:54.746797+0000","last_became_peered":"2024-09-12T02:52:54.746797+0000","last_unstale":"2024-09-12T02:52:55.735847+0000","last_undegraded":"2024-09-12T02:52:55.735847+0000","last_fullsized":"2024-09-12T02:52:55.735847+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:19.548279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.749492+0000","last_change":"2024-09-12T02:52:54.755454+0000","last_active":"2024-09-12T02:52:55.749492+0000","last_peered":"2024-09-12T02:52:55.749492+0000","last_clean":"2024-09-12T02:52:55.749492+0000","last_became_active":"2024-09-12T02:52:54.755148+0000","last_became_peered":"2024-09-12T02:52:54.755148+0000","last_unstale":"2024-09-12T02:52:55.749492+0000","last_undegraded":"2024-09-12T02:52:55.749492+0000","last_fullsized":"2024-09-12T02:52:55.749492+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:16.496684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.898355+0000","last_change":"2024-09-12T02:52:54.743717+0000","last_active":"2024-09-12T02:52:55.898355+0000","last_peered":"2024-09-12T02:52:55.898355+0000","last_clean":"2024-09-12T02:52:55.898355+0000","last_became_active":"2024-09-12T02:52:54.743484+0000","last_became_peered":"2024-09-12T02:52:54.743484+0000","last_unstale":"2024-09-12T02:52:55.898355+0000","last_undegraded":"2024-09-12T02:52:55.898355+0000","last_fullsized":"2024-09-12T02:52:55.898355+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:55.715611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.735565+0000","last_change":"2024-09-12T02:52:54.749814+0000","last_active":"2024-09-12T02:52:55.735565+0000","last_peered":"2024-09-12T02:52:55.735565+0000","last_clean":"2024-09-12T02:52:55.735565+0000","last_became_active":"2024-09-12T02:52:54.749267+0000","last_became_peered":"2024-09-12T02:52:54.749267+0000","last_unstale":"2024-09-12T02:52:55.735565+0000","last_undegraded":"2024-09-12T02:52:55.735565+0000","last_fullsized":"2024-09-12T02:52:55.735565+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:24.441135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.898064+0000","last_change":"2024-09-12T02:52:54.742986+0000","last_active":"2024-09-12T02:52:55.898064+0000","last_peered":"2024-09-12T02:52:55.898064+0000","last_clean":"2024-09-12T02:52:55.898064+0000","last_became_active":"2024-09-12T02:52:54.742773+0000","last_became_peered":"2024-09-12T02:52:54.742773+0000","last_unstale":"2024-09-12T02:52:55.898064+0000","last_undegraded":"2024-09-12T02:52:55.898064+0000","last_fullsized":"2024-09-12T02:52:55.898064+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:22.469754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.898356+0000","last_change":"2024-09-12T02:52:54.746133+0000","last_active":"2024-09-12T02:52:55.898356+0000","last_peered":"2024-09-12T02:52:55.898356+0000","last_clean":"2024-09-12T02:52:55.898356+0000","last_became_active":"2024-09-12T02:52:54.745657+0000","last_became_peered":"2024-09-12T02:52:54.745657+0000","last_unstale":"2024-09-12T02:52:55.898356+0000","last_undegraded":"2024-09-12T02:52:55.898356+0000","last_fullsized":"2024-09-12T02:52:55.898356+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:28.081038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.735253+0000","last_change":"2024-09-12T02:52:54.754347+0000","last_active":"2024-09-12T02:52:55.735253+0000","last_peered":"2024-09-12T02:52:55.735253+0000","last_clean":"2024-09-12T02:52:55.735253+0000","last_became_active":"2024-09-12T02:52:54.752045+0000","last_became_peered":"2024-09-12T02:52:54.752045+0000","last_unstale":"2024-09-12T02:52:55.735253+0000","last_undegraded":"2024-09-12T02:52:55.735253+0000","last_fullsized":"2024-09-12T02:52:55.735253+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:04.105580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.735528+0000","last_change":"2024-09-12T02:52:54.748686+0000","last_active":"2024-09-12T02:52:55.735528+0000","last_peered":"2024-09-12T02:52:55.735528+0000","last_clean":"2024-09-12T02:52:55.735528+0000","last_became_active":"2024-09-12T02:52:54.748394+0000","last_became_peered":"2024-09-12T02:52:54.748394+0000","last_unstale":"2024-09-12T02:52:55.735528+0000","last_undegraded":"2024-09-12T02:52:55.735528+0000","last_fullsized":"2024-09-12T02:52:55.735528+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:59.778773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.735699+0000","last_change":"2024-09-12T02:52:54.750031+0000","last_active":"2024-09-12T02:52:55.735699+0000","last_peered":"2024-09-12T02:52:55.735699+0000","last_clean":"2024-09-12T02:52:55.735699+0000","last_became_active":"2024-09-12T02:52:54.749590+0000","last_became_peered":"2024-09-12T02:52:54.749590+0000","last_unstale":"2024-09-12T02:52:55.735699+0000","last_undegraded":"2024-09-12T02:52:55.735699+0000","last_fullsized":"2024-09-12T02:52:55.735699+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:57.806840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.735459+0000","last_change":"2024-09-12T02:52:54.743444+0000","last_active":"2024-09-12T02:52:55.735459+0000","last_peered":"2024-09-12T02:52:55.735459+0000","last_clean":"2024-09-12T02:52:55.735459+0000","last_became_active":"2024-09-12T02:52:54.743147+0000","last_became_peered":"2024-09-12T02:52:54.743147+0000","last_unstale":"2024-09-12T02:52:55.735459+0000","last_undegraded":"2024-09-12T02:52:55.735459+0000","last_fullsized":"2024-09-12T02:52:55.735459+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:41.608459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.735950+0000","last_change":"2024-09-12T02:52:54.747029+0000","last_active":"2024-09-12T02:52:55.735950+0000","last_peered":"2024-09-12T02:52:55.735950+0000","last_clean":"2024-09-12T02:52:55.735950+0000","last_became_active":"2024-09-12T02:52:54.746491+0000","last_became_peered":"2024-09-12T02:52:54.746491+0000","last_unstale":"2024-09-12T02:52:55.735950+0000","last_undegraded":"2024-09-12T02:52:55.735950+0000","last_fullsized":"2024-09-12T02:52:55.735950+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:44:57.007805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.749137+0000","last_change":"2024-09-12T02:52:54.740200+0000","last_active":"2024-09-12T02:52:55.749137+0000","last_peered":"2024-09-12T02:52:55.749137+0000","last_clean":"2024-09-12T02:52:55.749137+0000","last_became_active":"2024-09-12T02:52:54.739901+0000","last_became_peered":"2024-09-12T02:52:54.739901+0000","last_unstale":"2024-09-12T02:52:55.749137+0000","last_undegraded":"2024-09-12T02:52:55.749137+0000","last_fullsized":"2024-09-12T02:52:55.749137+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:05.866769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.748858+0000","last_change":"2024-09-12T02:52:54.749104+0000","last_active":"2024-09-12T02:52:55.748858+0000","last_peered":"2024-09-12T02:52:55.748858+0000","last_clean":"2024-09-12T02:52:55.748858+0000","last_became_active":"2024-09-12T02:52:54.748862+0000","last_became_peered":"2024-09-12T02:52:54.748862+0000","last_unstale":"2024-09-12T02:52:55.748858+0000","last_undegraded":"2024-09-12T02:52:55.748858+0000","last_fullsized":"2024-09-12T02:52:55.748858+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:26.819474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.897825+0000","last_change":"2024-09-12T02:52:54.751258+0000","last_active":"2024-09-12T02:52:55.897825+0000","last_peered":"2024-09-12T02:52:55.897825+0000","last_clean":"2024-09-12T02:52:55.897825+0000","last_became_active":"2024-09-12T02:52:54.751022+0000","last_became_peered":"2024-09-12T02:52:54.751022+0000","last_unstale":"2024-09-12T02:52:55.897825+0000","last_undegraded":"2024-09-12T02:52:55.897825+0000","last_fullsized":"2024-09-12T02:52:55.897825+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:08.913438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.897950+0000","last_change":"2024-09-12T02:52:54.747649+0000","last_active":"2024-09-12T02:52:55.897950+0000","last_peered":"2024-09-12T02:52:55.897950+0000","last_clean":"2024-09-12T02:52:55.897950+0000","last_became_active":"2024-09-12T02:52:54.747106+0000","last_became_peered":"2024-09-12T02:52:54.747106+0000","last_unstale":"2024-09-12T02:52:55.897950+0000","last_undegraded":"2024-09-12T02:52:55.897950+0000","last_fullsized":"2024-09-12T02:52:55.897950+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:39.415160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.897806+0000","last_change":"2024-09-12T02:52:54.751432+0000","last_active":"2024-09-12T02:52:55.897806+0000","last_peered":"2024-09-12T02:52:55.897806+0000","last_clean":"2024-09-12T02:52:55.897806+0000","last_became_active":"2024-09-12T02:52:54.751149+0000","last_became_peered":"2024-09-12T02:52:54.751149+0000","last_unstale":"2024-09-12T02:52:55.897806+0000","last_undegraded":"2024-09-12T02:52:55.897806+0000","last_fullsized":"2024-09-12T02:52:55.897806+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:29.160303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.735748+0000","last_change":"2024-09-12T02:52:54.739672+0000","last_active":"2024-09-12T02:52:55.735748+0000","last_peered":"2024-09-12T02:52:55.735748+0000","last_clean":"2024-09-12T02:52:55.735748+0000","last_became_active":"2024-09-12T02:52:54.739264+0000","last_became_peered":"2024-09-12T02:52:54.739264+0000","last_unstale":"2024-09-12T02:52:55.735748+0000","last_undegraded":"2024-09-12T02:52:55.735748+0000","last_fullsized":"2024-09-12T02:52:55.735748+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:04.016587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.897490+0000","last_change":"2024-09-12T02:52:54.747777+0000","last_active":"2024-09-12T02:52:55.897490+0000","last_peered":"2024-09-12T02:52:55.897490+0000","last_clean":"2024-09-12T02:52:55.897490+0000","last_became_active":"2024-09-12T02:52:54.747554+0000","last_became_peered":"2024-09-12T02:52:54.747554+0000","last_unstale":"2024-09-12T02:52:55.897490+0000","last_undegraded":"2024-09-12T02:52:55.897490+0000","last_fullsized":"2024-09-12T02:52:55.897490+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:02.473059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.749336+0000","last_change":"2024-09-12T02:52:54.750159+0000","last_active":"2024-09-12T02:52:55.749336+0000","last_peered":"2024-09-12T02:52:55.749336+0000","last_clean":"2024-09-12T02:52:55.749336+0000","last_became_active":"2024-09-12T02:52:54.749683+0000","last_became_peered":"2024-09-12T02:52:54.749683+0000","last_unstale":"2024-09-12T02:52:55.749336+0000","last_undegraded":"2024-09-12T02:52:55.749336+0000","last_fullsized":"2024-09-12T02:52:55.749336+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:27.374296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.898204+0000","last_change":"2024-09-12T02:52:54.752426+0000","last_active":"2024-09-12T02:52:55.898204+0000","last_peered":"2024-09-12T02:52:55.898204+0000","last_clean":"2024-09-12T02:52:55.898204+0000","last_became_active":"2024-09-12T02:52:54.752130+0000","last_became_peered":"2024-09-12T02:52:54.752130+0000","last_unstale":"2024-09-12T02:52:55.898204+0000","last_undegraded":"2024-09-12T02:52:55.898204+0000","last_fullsized":"2024-09-12T02:52:55.898204+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:56.887407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.736032+0000","last_change":"2024-09-12T02:52:54.736106+0000","last_active":"2024-09-12T02:52:55.736032+0000","last_peered":"2024-09-12T02:52:55.736032+0000","last_clean":"2024-09-12T02:52:55.736032+0000","last_became_active":"2024-09-12T02:52:54.735651+0000","last_became_peered":"2024-09-12T02:52:54.735651+0000","last_unstale":"2024-09-12T02:52:55.736032+0000","last_undegraded":"2024-09-12T02:52:55.736032+0000","last_fullsized":"2024-09-12T02:52:55.736032+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:33.035985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.897491+0000","last_change":"2024-09-12T02:52:54.740296+0000","last_active":"2024-09-12T02:52:55.897491+0000","last_peered":"2024-09-12T02:52:55.897491+0000","last_clean":"2024-09-12T02:52:55.897491+0000","last_became_active":"2024-09-12T02:52:54.739527+0000","last_became_peered":"2024-09-12T02:52:54.739527+0000","last_unstale":"2024-09-12T02:52:55.897491+0000","last_undegraded":"2024-09-12T02:52:55.897491+0000","last_fullsized":"2024-09-12T02:52:55.897491+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:03.910704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.735190+0000","last_change":"2024-09-12T02:52:54.740026+0000","last_active":"2024-09-12T02:52:55.735190+0000","last_peered":"2024-09-12T02:52:55.735190+0000","last_clean":"2024-09-12T02:52:55.735190+0000","last_became_active":"2024-09-12T02:52:54.739729+0000","last_became_peered":"2024-09-12T02:52:54.739729+0000","last_unstale":"2024-09-12T02:52:55.735190+0000","last_undegraded":"2024-09-12T02:52:55.735190+0000","last_fullsized":"2024-09-12T02:52:55.735190+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:41.985005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.749488+0000","last_change":"2024-09-12T02:52:54.749966+0000","last_active":"2024-09-12T02:52:55.749488+0000","last_peered":"2024-09-12T02:52:55.749488+0000","last_clean":"2024-09-12T02:52:55.749488+0000","last_became_active":"2024-09-12T02:52:54.747847+0000","last_became_peered":"2024-09-12T02:52:54.747847+0000","last_unstale":"2024-09-12T02:52:55.749488+0000","last_undegraded":"2024-09-12T02:52:55.749488+0000","last_fullsized":"2024-09-12T02:52:55.749488+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:10.558078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.897814+0000","last_change":"2024-09-12T02:52:54.742470+0000","last_active":"2024-09-12T02:52:55.897814+0000","last_peered":"2024-09-12T02:52:55.897814+0000","last_clean":"2024-09-12T02:52:55.897814+0000","last_became_active":"2024-09-12T02:52:54.742250+0000","last_became_peered":"2024-09-12T02:52:54.742250+0000","last_unstale":"2024-09-12T02:52:55.897814+0000","last_undegraded":"2024-09-12T02:52:55.897814+0000","last_fullsized":"2024-09-12T02:52:55.897814+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:08.195755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.748971+0000","last_change":"2024-09-12T02:52:54.752734+0000","last_active":"2024-09-12T02:52:55.748971+0000","last_peered":"2024-09-12T02:52:55.748971+0000","last_clean":"2024-09-12T02:52:55.748971+0000","last_became_active":"2024-09-12T02:52:54.752362+0000","last_became_peered":"2024-09-12T02:52:54.752362+0000","last_unstale":"2024-09-12T02:52:55.748971+0000","last_undegraded":"2024-09-12T02:52:55.748971+0000","last_fullsized":"2024-09-12T02:52:55.748971+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:17.547582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.897761+0000","last_change":"2024-09-12T02:52:54.755280+0000","last_active":"2024-09-12T02:52:55.897761+0000","last_peered":"2024-09-12T02:52:55.897761+0000","last_clean":"2024-09-12T02:52:55.897761+0000","last_became_active":"2024-09-12T02:52:54.755032+0000","last_became_peered":"2024-09-12T02:52:54.755032+0000","last_unstale":"2024-09-12T02:52:55.897761+0000","last_undegraded":"2024-09-12T02:52:55.897761+0000","last_fullsized":"2024-09-12T02:52:55.897761+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:22.341801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.749043+0000","last_change":"2024-09-12T02:52:54.754422+0000","last_active":"2024-09-12T02:52:55.749043+0000","last_peered":"2024-09-12T02:52:55.749043+0000","last_clean":"2024-09-12T02:52:55.749043+0000","last_became_active":"2024-09-12T02:52:54.752704+0000","last_became_peered":"2024-09-12T02:52:54.752704+0000","last_unstale":"2024-09-12T02:52:55.749043+0000","last_undegraded":"2024-09-12T02:52:55.749043+0000","last_fullsized":"2024-09-12T02:52:55.749043+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:15.690643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.734560+0000","last_change":"2024-09-12T02:52:54.754213+0000","last_active":"2024-09-12T02:52:55.734560+0000","last_peered":"2024-09-12T02:52:55.734560+0000","last_clean":"2024-09-12T02:52:55.734560+0000","last_became_active":"2024-09-12T02:52:54.754016+0000","last_became_peered":"2024-09-12T02:52:54.754016+0000","last_unstale":"2024-09-12T02:52:55.734560+0000","last_undegraded":"2024-09-12T02:52:55.734560+0000","last_fullsized":"2024-09-12T02:52:55.734560+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:52.699165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.734653+0000","last_change":"2024-09-12T02:52:54.753884+0000","last_active":"2024-09-12T02:52:55.734653+0000","last_peered":"2024-09-12T02:52:55.734653+0000","last_clean":"2024-09-12T02:52:55.734653+0000","last_became_active":"2024-09-12T02:52:54.751441+0000","last_became_peered":"2024-09-12T02:52:54.751441+0000","last_unstale":"2024-09-12T02:52:55.734653+0000","last_undegraded":"2024-09-12T02:52:55.734653+0000","last_fullsized":"2024-09-12T02:52:55.734653+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:13:01.369371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.735589+0000","last_change":"2024-09-12T02:52:54.744369+0000","last_active":"2024-09-12T02:52:55.735589+0000","last_peered":"2024-09-12T02:52:55.735589+0000","last_clean":"2024-09-12T02:52:55.735589+0000","last_became_active":"2024-09-12T02:52:54.741004+0000","last_became_peered":"2024-09-12T02:52:54.741004+0000","last_unstale":"2024-09-12T02:52:55.735589+0000","last_undegraded":"2024-09-12T02:52:55.735589+0000","last_fullsized":"2024-09-12T02:52:55.735589+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:54.235827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.897715+0000","last_change":"2024-09-12T02:52:54.741540+0000","last_active":"2024-09-12T02:52:55.897715+0000","last_peered":"2024-09-12T02:52:55.897715+0000","last_clean":"2024-09-12T02:52:55.897715+0000","last_became_active":"2024-09-12T02:52:54.741316+0000","last_became_peered":"2024-09-12T02:52:54.741316+0000","last_unstale":"2024-09-12T02:52:55.897715+0000","last_undegraded":"2024-09-12T02:52:55.897715+0000","last_fullsized":"2024-09-12T02:52:55.897715+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:45.379020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"182'4","reported_seq":18,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.897579+0000","last_change":"2024-09-12T02:52:53.746999+0000","last_active":"2024-09-12T02:52:55.897579+0000","last_peered":"2024-09-12T02:52:55.897579+0000","last_clean":"2024-09-12T02:52:55.897579+0000","last_became_active":"2024-09-12T02:52:53.746738+0000","last_became_peered":"2024-09-12T02:52:53.746738+0000","last_unstale":"2024-09-12T02:52:55.897579+0000","last_undegraded":"2024-09-12T02:52:55.897579+0000","last_fullsized":"2024-09-12T02:52:55.897579+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:53.202659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.735411+0000","last_change":"2024-09-12T02:52:54.750399+0000","last_active":"2024-09-12T02:52:55.735411+0000","last_peered":"2024-09-12T02:52:55.735411+0000","last_clean":"2024-09-12T02:52:55.735411+0000","last_became_active":"2024-09-12T02:52:54.750173+0000","last_became_peered":"2024-09-12T02:52:54.750173+0000","last_unstale":"2024-09-12T02:52:55.735411+0000","last_undegraded":"2024-09-12T02:52:55.735411+0000","last_fullsized":"2024-09-12T02:52:55.735411+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:55.406230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"182'1","reported_seq":15,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.734164+0000","last_change":"2024-09-12T02:52:53.742207+0000","last_active":"2024-09-12T02:52:55.734164+0000","last_peered":"2024-09-12T02:52:55.734164+0000","last_clean":"2024-09-12T02:52:55.734164+0000","last_became_active":"2024-09-12T02:52:53.741935+0000","last_became_peered":"2024-09-12T02:52:53.741935+0000","last_unstale":"2024-09-12T02:52:55.734164+0000","last_undegraded":"2024-09-12T02:52:55.734164+0000","last_fullsized":"2024-09-12T02:52:55.734164+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:16.618646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.898323+0000","last_change":"2024-09-12T02:52:54.746500+0000","last_active":"2024-09-12T02:52:55.898323+0000","last_peered":"2024-09-12T02:52:55.898323+0000","last_clean":"2024-09-12T02:52:55.898323+0000","last_became_active":"2024-09-12T02:52:54.746256+0000","last_became_peered":"2024-09-12T02:52:54.746256+0000","last_unstale":"2024-09-12T02:52:55.898323+0000","last_undegraded":"2024-09-12T02:52:55.898323+0000","last_fullsized":"2024-09-12T02:52:55.898323+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:06.476472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"182'2","reported_seq":16,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.898877+0000","last_change":"2024-09-12T02:52:53.736316+0000","last_active":"2024-09-12T02:52:55.898877+0000","last_peered":"2024-09-12T02:52:55.898877+0000","last_clean":"2024-09-12T02:52:55.898877+0000","last_became_active":"2024-09-12T02:52:53.736063+0000","last_became_peered":"2024-09-12T02:52:53.736063+0000","last_unstale":"2024-09-12T02:52:55.898877+0000","last_undegraded":"2024-09-12T02:52:55.898877+0000","last_fullsized":"2024-09-12T02:52:55.898877+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:07.854617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.749587+0000","last_change":"2024-09-12T02:52:54.753834+0000","last_active":"2024-09-12T02:52:55.749587+0000","last_peered":"2024-09-12T02:52:55.749587+0000","last_clean":"2024-09-12T02:52:55.749587+0000","last_became_active":"2024-09-12T02:52:54.753557+0000","last_became_peered":"2024-09-12T02:52:54.753557+0000","last_unstale":"2024-09-12T02:52:55.749587+0000","last_undegraded":"2024-09-12T02:52:55.749587+0000","last_fullsized":"2024-09-12T02:52:55.749587+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:38.854998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"182'2","reported_seq":16,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.898768+0000","last_change":"2024-09-12T02:52:53.745668+0000","last_active":"2024-09-12T02:52:55.898768+0000","last_peered":"2024-09-12T02:52:55.898768+0000","last_clean":"2024-09-12T02:52:55.898768+0000","last_became_active":"2024-09-12T02:52:53.745478+0000","last_became_peered":"2024-09-12T02:52:53.745478+0000","last_unstale":"2024-09-12T02:52:55.898768+0000","last_undegraded":"2024-09-12T02:52:55.898768+0000","last_fullsized":"2024-09-12T02:52:55.898768+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:33.648086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.898055+0000","last_change":"2024-09-12T02:52:54.737061+0000","last_active":"2024-09-12T02:52:55.898055+0000","last_peered":"2024-09-12T02:52:55.898055+0000","last_clean":"2024-09-12T02:52:55.898055+0000","last_became_active":"2024-09-12T02:52:54.736842+0000","last_became_peered":"2024-09-12T02:52:54.736842+0000","last_unstale":"2024-09-12T02:52:55.898055+0000","last_undegraded":"2024-09-12T02:52:55.898055+0000","last_fullsized":"2024-09-12T02:52:55.898055+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:59.912514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"182'1","reported_seq":15,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.749308+0000","last_change":"2024-09-12T02:52:53.741728+0000","last_active":"2024-09-12T02:52:55.749308+0000","last_peered":"2024-09-12T02:52:55.749308+0000","last_clean":"2024-09-12T02:52:55.749308+0000","last_became_active":"2024-09-12T02:52:53.738533+0000","last_became_peered":"2024-09-12T02:52:53.738533+0000","last_unstale":"2024-09-12T02:52:55.749308+0000","last_undegraded":"2024-09-12T02:52:55.749308+0000","last_fullsized":"2024-09-12T02:52:55.749308+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:36.169626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.898346+0000","last_change":"2024-09-12T02:52:54.748722+0000","last_active":"2024-09-12T02:52:55.898346+0000","last_peered":"2024-09-12T02:52:55.898346+0000","last_clean":"2024-09-12T02:52:55.898346+0000","last_became_active":"2024-09-12T02:52:54.748390+0000","last_became_peered":"2024-09-12T02:52:54.748390+0000","last_unstale":"2024-09-12T02:52:55.898346+0000","last_undegraded":"2024-09-12T02:52:55.898346+0000","last_fullsized":"2024-09-12T02:52:55.898346+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:32.233710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"182'1","reported_seq":15,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.897812+0000","last_change":"2024-09-12T02:52:53.744408+0000","last_active":"2024-09-12T02:52:55.897812+0000","last_peered":"2024-09-12T02:52:55.897812+0000","last_clean":"2024-09-12T02:52:55.897812+0000","last_became_active":"2024-09-12T02:52:53.739581+0000","last_became_peered":"2024-09-12T02:52:53.739581+0000","last_unstale":"2024-09-12T02:52:55.897812+0000","last_undegraded":"2024-09-12T02:52:55.897812+0000","last_fullsized":"2024-09-12T02:52:55.897812+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:10.030159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.898704+0000","last_change":"2024-09-12T02:52:54.751586+0000","last_active":"2024-09-12T02:52:55.898704+0000","last_peered":"2024-09-12T02:52:55.898704+0000","last_clean":"2024-09-12T02:52:55.898704+0000","last_became_active":"2024-09-12T02:52:54.751294+0000","last_became_peered":"2024-09-12T02:52:54.751294+0000","last_unstale":"2024-09-12T02:52:55.898704+0000","last_undegraded":"2024-09-12T02:52:55.898704+0000","last_fullsized":"2024-09-12T02:52:55.898704+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:23.272346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.735323+0000","last_change":"2024-09-12T02:52:53.740098+0000","last_active":"2024-09-12T02:52:55.735323+0000","last_peered":"2024-09-12T02:52:55.735323+0000","last_clean":"2024-09-12T02:52:55.735323+0000","last_became_active":"2024-09-12T02:52:53.738624+0000","last_became_peered":"2024-09-12T02:52:53.738624+0000","last_unstale":"2024-09-12T02:52:55.735323+0000","last_undegraded":"2024-09-12T02:52:55.735323+0000","last_fullsized":"2024-09-12T02:52:55.735323+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:44.809645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.897627+0000","last_change":"2024-09-12T02:52:54.745375+0000","last_active":"2024-09-12T02:52:55.897627+0000","last_peered":"2024-09-12T02:52:55.897627+0000","last_clean":"2024-09-12T02:52:55.897627+0000","last_became_active":"2024-09-12T02:52:54.745140+0000","last_became_peered":"2024-09-12T02:52:54.745140+0000","last_unstale":"2024-09-12T02:52:55.897627+0000","last_undegraded":"2024-09-12T02:52:55.897627+0000","last_fullsized":"2024-09-12T02:52:55.897627+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:20.427568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.897858+0000","last_change":"2024-09-12T02:52:53.735896+0000","last_active":"2024-09-12T02:52:55.897858+0000","last_peered":"2024-09-12T02:52:55.897858+0000","last_clean":"2024-09-12T02:52:55.897858+0000","last_became_active":"2024-09-12T02:52:53.735674+0000","last_became_peered":"2024-09-12T02:52:53.735674+0000","last_unstale":"2024-09-12T02:52:55.897858+0000","last_undegraded":"2024-09-12T02:52:55.897858+0000","last_fullsized":"2024-09-12T02:52:55.897858+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:23.914577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.735614+0000","last_change":"2024-09-12T02:52:54.741444+0000","last_active":"2024-09-12T02:52:55.735614+0000","last_peered":"2024-09-12T02:52:55.735614+0000","last_clean":"2024-09-12T02:52:55.735614+0000","last_became_active":"2024-09-12T02:52:54.741229+0000","last_became_peered":"2024-09-12T02:52:54.741229+0000","last_unstale":"2024-09-12T02:52:55.735614+0000","last_undegraded":"2024-09-12T02:52:55.735614+0000","last_fullsized":"2024-09-12T02:52:55.735614+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:21.771307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.897969+0000","last_change":"2024-09-12T02:52:53.737085+0000","last_active":"2024-09-12T02:52:55.897969+0000","last_peered":"2024-09-12T02:52:55.897969+0000","last_clean":"2024-09-12T02:52:55.897969+0000","last_became_active":"2024-09-12T02:52:53.736853+0000","last_became_peered":"2024-09-12T02:52:53.736853+0000","last_unstale":"2024-09-12T02:52:55.897969+0000","last_undegraded":"2024-09-12T02:52:55.897969+0000","last_fullsized":"2024-09-12T02:52:55.897969+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:04.363842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.735599+0000","last_change":"2024-09-12T02:52:54.742540+0000","last_active":"2024-09-12T02:52:55.735599+0000","last_peered":"2024-09-12T02:52:55.735599+0000","last_clean":"2024-09-12T02:52:55.735599+0000","last_became_active":"2024-09-12T02:52:54.742287+0000","last_became_peered":"2024-09-12T02:52:54.742287+0000","last_unstale":"2024-09-12T02:52:55.735599+0000","last_undegraded":"2024-09-12T02:52:55.735599+0000","last_fullsized":"2024-09-12T02:52:55.735599+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:43.949995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"182'3","reported_seq":17,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.897605+0000","last_change":"2024-09-12T02:52:53.743146+0000","last_active":"2024-09-12T02:52:55.897605+0000","last_peered":"2024-09-12T02:52:55.897605+0000","last_clean":"2024-09-12T02:52:55.897605+0000","last_became_active":"2024-09-12T02:52:53.741957+0000","last_became_peered":"2024-09-12T02:52:53.741957+0000","last_unstale":"2024-09-12T02:52:55.897605+0000","last_undegraded":"2024-09-12T02:52:55.897605+0000","last_fullsized":"2024-09-12T02:52:55.897605+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:19:23.480350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.734233+0000","last_change":"2024-09-12T02:52:54.756400+0000","last_active":"2024-09-12T02:52:55.734233+0000","last_peered":"2024-09-12T02:52:55.734233+0000","last_clean":"2024-09-12T02:52:55.734233+0000","last_became_active":"2024-09-12T02:52:54.755898+0000","last_became_peered":"2024-09-12T02:52:54.755898+0000","last_unstale":"2024-09-12T02:52:55.734233+0000","last_undegraded":"2024-09-12T02:52:55.734233+0000","last_fullsized":"2024-09-12T02:52:55.734233+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:58.547962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"182'6","reported_seq":20,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.734551+0000","last_change":"2024-09-12T02:52:53.740955+0000","last_active":"2024-09-12T02:52:55.734551+0000","last_peered":"2024-09-12T02:52:55.734551+0000","last_clean":"2024-09-12T02:52:55.734551+0000","last_became_active":"2024-09-12T02:52:53.740647+0000","last_became_peered":"2024-09-12T02:52:53.740647+0000","last_unstale":"2024-09-12T02:52:55.734551+0000","last_undegraded":"2024-09-12T02:52:55.734551+0000","last_fullsized":"2024-09-12T02:52:55.734551+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:41.200929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.735779+0000","last_change":"2024-09-12T02:52:54.738494+0000","last_active":"2024-09-12T02:52:55.735779+0000","last_peered":"2024-09-12T02:52:55.735779+0000","last_clean":"2024-09-12T02:52:55.735779+0000","last_became_active":"2024-09-12T02:52:54.738236+0000","last_became_peered":"2024-09-12T02:52:54.738236+0000","last_unstale":"2024-09-12T02:52:55.735779+0000","last_undegraded":"2024-09-12T02:52:55.735779+0000","last_fullsized":"2024-09-12T02:52:55.735779+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:19:02.507887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"182'2","reported_seq":16,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.898926+0000","last_change":"2024-09-12T02:52:53.738543+0000","last_active":"2024-09-12T02:52:55.898926+0000","last_peered":"2024-09-12T02:52:55.898926+0000","last_clean":"2024-09-12T02:52:55.898926+0000","last_became_active":"2024-09-12T02:52:53.738317+0000","last_became_peered":"2024-09-12T02:52:53.738317+0000","last_unstale":"2024-09-12T02:52:55.898926+0000","last_undegraded":"2024-09-12T02:52:55.898926+0000","last_fullsized":"2024-09-12T02:52:55.898926+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:13.889309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.897800+0000","last_change":"2024-09-12T02:52:54.743307+0000","last_active":"2024-09-12T02:52:55.897800+0000","last_peered":"2024-09-12T02:52:55.897800+0000","last_clean":"2024-09-12T02:52:55.897800+0000","last_became_active":"2024-09-12T02:52:54.743109+0000","last_became_peered":"2024-09-12T02:52:54.743109+0000","last_unstale":"2024-09-12T02:52:55.897800+0000","last_undegraded":"2024-09-12T02:52:55.897800+0000","last_fullsized":"2024-09-12T02:52:55.897800+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:58.415098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.735835+0000","last_change":"2024-09-12T02:52:53.736573+0000","last_active":"2024-09-12T02:52:55.735835+0000","last_peered":"2024-09-12T02:52:55.735835+0000","last_clean":"2024-09-12T02:52:55.735835+0000","last_became_active":"2024-09-12T02:52:53.735949+0000","last_became_peered":"2024-09-12T02:52:53.735949+0000","last_unstale":"2024-09-12T02:52:55.735835+0000","last_undegraded":"2024-09-12T02:52:55.735835+0000","last_fullsized":"2024-09-12T02:52:55.735835+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:05.327618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.897555+0000","last_change":"2024-09-12T02:52:54.754104+0000","last_active":"2024-09-12T02:52:55.897555+0000","last_peered":"2024-09-12T02:52:55.897555+0000","last_clean":"2024-09-12T02:52:55.897555+0000","last_became_active":"2024-09-12T02:52:54.753908+0000","last_became_peered":"2024-09-12T02:52:54.753908+0000","last_unstale":"2024-09-12T02:52:55.897555+0000","last_undegraded":"2024-09-12T02:52:55.897555+0000","last_fullsized":"2024-09-12T02:52:55.897555+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:24.647786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.898599+0000","last_change":"2024-09-12T02:52:53.745231+0000","last_active":"2024-09-12T02:52:55.898599+0000","last_peered":"2024-09-12T02:52:55.898599+0000","last_clean":"2024-09-12T02:52:55.898599+0000","last_became_active":"2024-09-12T02:52:53.744985+0000","last_became_peered":"2024-09-12T02:52:53.744985+0000","last_unstale":"2024-09-12T02:52:55.898599+0000","last_undegraded":"2024-09-12T02:52:55.898599+0000","last_fullsized":"2024-09-12T02:52:55.898599+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:39.945699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.749166+0000","last_change":"2024-09-12T02:52:54.741677+0000","last_active":"2024-09-12T02:52:55.749166+0000","last_peered":"2024-09-12T02:52:55.749166+0000","last_clean":"2024-09-12T02:52:55.749166+0000","last_became_active":"2024-09-12T02:52:54.741422+0000","last_became_peered":"2024-09-12T02:52:54.741422+0000","last_unstale":"2024-09-12T02:52:55.749166+0000","last_undegraded":"2024-09-12T02:52:55.749166+0000","last_fullsized":"2024-09-12T02:52:55.749166+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:42.169073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"182'8","reported_seq":22,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.735470+0000","last_change":"2024-09-12T02:52:53.740977+0000","last_active":"2024-09-12T02:52:55.735470+0000","last_peered":"2024-09-12T02:52:55.735470+0000","last_clean":"2024-09-12T02:52:55.735470+0000","last_became_active":"2024-09-12T02:52:53.740723+0000","last_became_peered":"2024-09-12T02:52:53.740723+0000","last_unstale":"2024-09-12T02:52:55.735470+0000","last_undegraded":"2024-09-12T02:52:55.735470+0000","last_fullsized":"2024-09-12T02:52:55.735470+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:32.972776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.898818+0000","last_change":"2024-09-12T02:52:54.749544+0000","last_active":"2024-09-12T02:52:55.898818+0000","last_peered":"2024-09-12T02:52:55.898818+0000","last_clean":"2024-09-12T02:52:55.898818+0000","last_became_active":"2024-09-12T02:52:54.749251+0000","last_became_peered":"2024-09-12T02:52:54.749251+0000","last_unstale":"2024-09-12T02:52:55.898818+0000","last_undegraded":"2024-09-12T02:52:55.898818+0000","last_fullsized":"2024-09-12T02:52:55.898818+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:45.681587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"182'1","reported_seq":15,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.749277+0000","last_change":"2024-09-12T02:52:53.744100+0000","last_active":"2024-09-12T02:52:55.749277+0000","last_peered":"2024-09-12T02:52:55.749277+0000","last_clean":"2024-09-12T02:52:55.749277+0000","last_became_active":"2024-09-12T02:52:53.743712+0000","last_became_peered":"2024-09-12T02:52:53.743712+0000","last_unstale":"2024-09-12T02:52:55.749277+0000","last_undegraded":"2024-09-12T02:52:55.749277+0000","last_fullsized":"2024-09-12T02:52:55.749277+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:34.686486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.735729+0000","last_change":"2024-09-12T02:52:54.743652+0000","last_active":"2024-09-12T02:52:55.735729+0000","last_peered":"2024-09-12T02:52:55.735729+0000","last_clean":"2024-09-12T02:52:55.735729+0000","last_became_active":"2024-09-12T02:52:54.743433+0000","last_became_peered":"2024-09-12T02:52:54.743433+0000","last_unstale":"2024-09-12T02:52:55.735729+0000","last_undegraded":"2024-09-12T02:52:55.735729+0000","last_fullsized":"2024-09-12T02:52:55.735729+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:27.151777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"182'2","reported_seq":16,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.749708+0000","last_change":"2024-09-12T02:52:53.745103+0000","last_active":"2024-09-12T02:52:55.749708+0000","last_peered":"2024-09-12T02:52:55.749708+0000","last_clean":"2024-09-12T02:52:55.749708+0000","last_became_active":"2024-09-12T02:52:53.744502+0000","last_became_peered":"2024-09-12T02:52:53.744502+0000","last_unstale":"2024-09-12T02:52:55.749708+0000","last_undegraded":"2024-09-12T02:52:55.749708+0000","last_fullsized":"2024-09-12T02:52:55.749708+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:30.106696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.898486+0000","last_change":"2024-09-12T02:52:54.747601+0000","last_active":"2024-09-12T02:52:55.898486+0000","last_peered":"2024-09-12T02:52:55.898486+0000","last_clean":"2024-09-12T02:52:55.898486+0000","last_became_active":"2024-09-12T02:52:54.747339+0000","last_became_peered":"2024-09-12T02:52:54.747339+0000","last_unstale":"2024-09-12T02:52:55.898486+0000","last_undegraded":"2024-09-12T02:52:55.898486+0000","last_fullsized":"2024-09-12T02:52:55.898486+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:05:10.947763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"182'1","reported_seq":15,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.897875+0000","last_change":"2024-09-12T02:52:53.743710+0000","last_active":"2024-09-12T02:52:55.897875+0000","last_peered":"2024-09-12T02:52:55.897875+0000","last_clean":"2024-09-12T02:52:55.897875+0000","last_became_active":"2024-09-12T02:52:53.742371+0000","last_became_peered":"2024-09-12T02:52:53.742371+0000","last_unstale":"2024-09-12T02:52:55.897875+0000","last_undegraded":"2024-09-12T02:52:55.897875+0000","last_fullsized":"2024-09-12T02:52:55.897875+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:54.042019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.898101+0000","last_change":"2024-09-12T02:52:54.747395+0000","last_active":"2024-09-12T02:52:55.898101+0000","last_peered":"2024-09-12T02:52:55.898101+0000","last_clean":"2024-09-12T02:52:55.898101+0000","last_became_active":"2024-09-12T02:52:54.746561+0000","last_became_peered":"2024-09-12T02:52:54.746561+0000","last_unstale":"2024-09-12T02:52:55.898101+0000","last_undegraded":"2024-09-12T02:52:55.898101+0000","last_fullsized":"2024-09-12T02:52:55.898101+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:01.107091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.897632+0000","last_change":"2024-09-12T02:52:53.743285+0000","last_active":"2024-09-12T02:52:55.897632+0000","last_peered":"2024-09-12T02:52:55.897632+0000","last_clean":"2024-09-12T02:52:55.897632+0000","last_became_active":"2024-09-12T02:52:53.743026+0000","last_became_peered":"2024-09-12T02:52:53.743026+0000","last_unstale":"2024-09-12T02:52:55.897632+0000","last_undegraded":"2024-09-12T02:52:55.897632+0000","last_fullsized":"2024-09-12T02:52:55.897632+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:19.832895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.749189+0000","last_change":"2024-09-12T02:52:54.744484+0000","last_active":"2024-09-12T02:52:55.749189+0000","last_peered":"2024-09-12T02:52:55.749189+0000","last_clean":"2024-09-12T02:52:55.749189+0000","last_became_active":"2024-09-12T02:52:54.744232+0000","last_became_peered":"2024-09-12T02:52:54.744232+0000","last_unstale":"2024-09-12T02:52:55.749189+0000","last_undegraded":"2024-09-12T02:52:55.749189+0000","last_fullsized":"2024-09-12T02:52:55.749189+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:17.810886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"182'2","reported_seq":16,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.897913+0000","last_change":"2024-09-12T02:52:53.739839+0000","last_active":"2024-09-12T02:52:55.897913+0000","last_peered":"2024-09-12T02:52:55.897913+0000","last_clean":"2024-09-12T02:52:55.897913+0000","last_became_active":"2024-09-12T02:52:53.737566+0000","last_became_peered":"2024-09-12T02:52:53.737566+0000","last_unstale":"2024-09-12T02:52:55.897913+0000","last_undegraded":"2024-09-12T02:52:55.897913+0000","last_fullsized":"2024-09-12T02:52:55.897913+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:34.375857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.898189+0000","last_change":"2024-09-12T02:52:54.746109+0000","last_active":"2024-09-12T02:52:55.898189+0000","last_peered":"2024-09-12T02:52:55.898189+0000","last_clean":"2024-09-12T02:52:55.898189+0000","last_became_active":"2024-09-12T02:52:54.745879+0000","last_became_peered":"2024-09-12T02:52:54.745879+0000","last_unstale":"2024-09-12T02:52:55.898189+0000","last_undegraded":"2024-09-12T02:52:55.898189+0000","last_fullsized":"2024-09-12T02:52:55.898189+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:53.285480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.897801+0000","last_change":"2024-09-12T02:52:53.744537+0000","last_active":"2024-09-12T02:52:55.897801+0000","last_peered":"2024-09-12T02:52:55.897801+0000","last_clean":"2024-09-12T02:52:55.897801+0000","last_became_active":"2024-09-12T02:52:53.744275+0000","last_became_peered":"2024-09-12T02:52:53.744275+0000","last_unstale":"2024-09-12T02:52:55.897801+0000","last_undegraded":"2024-09-12T02:52:55.897801+0000","last_fullsized":"2024-09-12T02:52:55.897801+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:02.876503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.897706+0000","last_change":"2024-09-12T02:52:54.748223+0000","last_active":"2024-09-12T02:52:55.897706+0000","last_peered":"2024-09-12T02:52:55.897706+0000","last_clean":"2024-09-12T02:52:55.897706+0000","last_became_active":"2024-09-12T02:52:54.747856+0000","last_became_peered":"2024-09-12T02:52:54.747856+0000","last_unstale":"2024-09-12T02:52:55.897706+0000","last_undegraded":"2024-09-12T02:52:55.897706+0000","last_fullsized":"2024-09-12T02:52:55.897706+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:36.748311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.898971+0000","last_change":"2024-09-12T02:52:53.746318+0000","last_active":"2024-09-12T02:52:55.898971+0000","last_peered":"2024-09-12T02:52:55.898971+0000","last_clean":"2024-09-12T02:52:55.898971+0000","last_became_active":"2024-09-12T02:52:53.746063+0000","last_became_peered":"2024-09-12T02:52:53.746063+0000","last_unstale":"2024-09-12T02:52:55.898971+0000","last_undegraded":"2024-09-12T02:52:55.898971+0000","last_fullsized":"2024-09-12T02:52:55.898971+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:17.653140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.898306+0000","last_change":"2024-09-12T02:52:54.741654+0000","last_active":"2024-09-12T02:52:55.898306+0000","last_peered":"2024-09-12T02:52:55.898306+0000","last_clean":"2024-09-12T02:52:55.898306+0000","last_became_active":"2024-09-12T02:52:54.740660+0000","last_became_peered":"2024-09-12T02:52:54.740660+0000","last_unstale":"2024-09-12T02:52:55.898306+0000","last_undegraded":"2024-09-12T02:52:55.898306+0000","last_fullsized":"2024-09-12T02:52:55.898306+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:08.137999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.897956+0000","last_change":"2024-09-12T02:52:53.744126+0000","last_active":"2024-09-12T02:52:55.897956+0000","last_peered":"2024-09-12T02:52:55.897956+0000","last_clean":"2024-09-12T02:52:55.897956+0000","last_became_active":"2024-09-12T02:52:53.742761+0000","last_became_peered":"2024-09-12T02:52:53.742761+0000","last_unstale":"2024-09-12T02:52:55.897956+0000","last_undegraded":"2024-09-12T02:52:55.897956+0000","last_fullsized":"2024-09-12T02:52:55.897956+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:52.013532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.735890+0000","last_change":"2024-09-12T02:52:54.743883+0000","last_active":"2024-09-12T02:52:55.735890+0000","last_peered":"2024-09-12T02:52:55.735890+0000","last_clean":"2024-09-12T02:52:55.735890+0000","last_became_active":"2024-09-12T02:52:54.743664+0000","last_became_peered":"2024-09-12T02:52:54.743664+0000","last_unstale":"2024-09-12T02:52:55.735890+0000","last_undegraded":"2024-09-12T02:52:55.735890+0000","last_fullsized":"2024-09-12T02:52:55.735890+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:12.124806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"182'2","reported_seq":16,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.735920+0000","last_change":"2024-09-12T02:52:53.739297+0000","last_active":"2024-09-12T02:52:55.735920+0000","last_peered":"2024-09-12T02:52:55.735920+0000","last_clean":"2024-09-12T02:52:55.735920+0000","last_became_active":"2024-09-12T02:52:53.739053+0000","last_became_peered":"2024-09-12T02:52:53.739053+0000","last_unstale":"2024-09-12T02:52:55.735920+0000","last_undegraded":"2024-09-12T02:52:55.735920+0000","last_fullsized":"2024-09-12T02:52:55.735920+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:05.887655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.898421+0000","last_change":"2024-09-12T02:52:54.737746+0000","last_active":"2024-09-12T02:52:55.898421+0000","last_peered":"2024-09-12T02:52:55.898421+0000","last_clean":"2024-09-12T02:52:55.898421+0000","last_became_active":"2024-09-12T02:52:54.737500+0000","last_became_peered":"2024-09-12T02:52:54.737500+0000","last_unstale":"2024-09-12T02:52:55.898421+0000","last_undegraded":"2024-09-12T02:52:55.898421+0000","last_fullsized":"2024-09-12T02:52:55.898421+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:13.314236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"183'1","reported_seq":15,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.749554+0000","last_change":"2024-09-12T02:52:53.745601+0000","last_active":"2024-09-12T02:52:55.749554+0000","last_peered":"2024-09-12T02:52:55.749554+0000","last_clean":"2024-09-12T02:52:55.749554+0000","last_became_active":"2024-09-12T02:52:53.744770+0000","last_became_peered":"2024-09-12T02:52:53.744770+0000","last_unstale":"2024-09-12T02:52:55.749554+0000","last_undegraded":"2024-09-12T02:52:55.749554+0000","last_fullsized":"2024-09-12T02:52:55.749554+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:12.281011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.898426+0000","last_change":"2024-09-12T02:52:54.749692+0000","last_active":"2024-09-12T02:52:55.898426+0000","last_peered":"2024-09-12T02:52:55.898426+0000","last_clean":"2024-09-12T02:52:55.898426+0000","last_became_active":"2024-09-12T02:52:54.748990+0000","last_became_peered":"2024-09-12T02:52:54.748990+0000","last_unstale":"2024-09-12T02:52:55.898426+0000","last_undegraded":"2024-09-12T02:52:55.898426+0000","last_fullsized":"2024-09-12T02:52:55.898426+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:23.083894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.735581+0000","last_change":"2024-09-12T02:52:53.741297+0000","last_active":"2024-09-12T02:52:55.735581+0000","last_peered":"2024-09-12T02:52:55.735581+0000","last_clean":"2024-09-12T02:52:55.735581+0000","last_became_active":"2024-09-12T02:52:53.740705+0000","last_became_peered":"2024-09-12T02:52:53.740705+0000","last_unstale":"2024-09-12T02:52:55.735581+0000","last_undegraded":"2024-09-12T02:52:55.735581+0000","last_fullsized":"2024-09-12T02:52:55.735581+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:34.360342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.735878+0000","last_change":"2024-09-12T02:52:54.748566+0000","last_active":"2024-09-12T02:52:55.735878+0000","last_peered":"2024-09-12T02:52:55.735878+0000","last_clean":"2024-09-12T02:52:55.735878+0000","last_became_active":"2024-09-12T02:52:54.748334+0000","last_became_peered":"2024-09-12T02:52:54.748334+0000","last_unstale":"2024-09-12T02:52:55.735878+0000","last_undegraded":"2024-09-12T02:52:55.735878+0000","last_fullsized":"2024-09-12T02:52:55.735878+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:34:14.788999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.735571+0000","last_change":"2024-09-12T02:52:53.738098+0000","last_active":"2024-09-12T02:52:55.735571+0000","last_peered":"2024-09-12T02:52:55.735571+0000","last_clean":"2024-09-12T02:52:55.735571+0000","last_became_active":"2024-09-12T02:52:53.737791+0000","last_became_peered":"2024-09-12T02:52:53.737791+0000","last_unstale":"2024-09-12T02:52:55.735571+0000","last_undegraded":"2024-09-12T02:52:55.735571+0000","last_fullsized":"2024-09-12T02:52:55.735571+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:42.008332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.735876+0000","last_change":"2024-09-12T02:52:54.743863+0000","last_active":"2024-09-12T02:52:55.735876+0000","last_peered":"2024-09-12T02:52:55.735876+0000","last_clean":"2024-09-12T02:52:55.735876+0000","last_became_active":"2024-09-12T02:52:54.740714+0000","last_became_peered":"2024-09-12T02:52:54.740714+0000","last_unstale":"2024-09-12T02:52:55.735876+0000","last_undegraded":"2024-09-12T02:52:55.735876+0000","last_fullsized":"2024-09-12T02:52:55.735876+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:07.156155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.735115+0000","last_change":"2024-09-12T02:52:53.734038+0000","last_active":"2024-09-12T02:52:55.735115+0000","last_peered":"2024-09-12T02:52:55.735115+0000","last_clean":"2024-09-12T02:52:55.735115+0000","last_became_active":"2024-09-12T02:52:53.733757+0000","last_became_peered":"2024-09-12T02:52:53.733757+0000","last_unstale":"2024-09-12T02:52:55.735115+0000","last_undegraded":"2024-09-12T02:52:55.735115+0000","last_fullsized":"2024-09-12T02:52:55.735115+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:05.209855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.734807+0000","last_change":"2024-09-12T02:52:54.751701+0000","last_active":"2024-09-12T02:52:55.734807+0000","last_peered":"2024-09-12T02:52:55.734807+0000","last_clean":"2024-09-12T02:52:55.734807+0000","last_became_active":"2024-09-12T02:52:54.749461+0000","last_became_peered":"2024-09-12T02:52:54.749461+0000","last_unstale":"2024-09-12T02:52:55.734807+0000","last_undegraded":"2024-09-12T02:52:55.734807+0000","last_fullsized":"2024-09-12T02:52:55.734807+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:46.523424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.898682+0000","last_change":"2024-09-12T02:52:53.738247+0000","last_active":"2024-09-12T02:52:55.898682+0000","last_peered":"2024-09-12T02:52:55.898682+0000","last_clean":"2024-09-12T02:52:55.898682+0000","last_became_active":"2024-09-12T02:52:53.737899+0000","last_became_peered":"2024-09-12T02:52:53.737899+0000","last_unstale":"2024-09-12T02:52:55.898682+0000","last_undegraded":"2024-09-12T02:52:55.898682+0000","last_fullsized":"2024-09-12T02:52:55.898682+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:41.755619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.897578+0000","last_change":"2024-09-12T02:52:54.749654+0000","last_active":"2024-09-12T02:52:55.897578+0000","last_peered":"2024-09-12T02:52:55.897578+0000","last_clean":"2024-09-12T02:52:55.897578+0000","last_became_active":"2024-09-12T02:52:54.749414+0000","last_became_peered":"2024-09-12T02:52:54.749414+0000","last_unstale":"2024-09-12T02:52:55.897578+0000","last_undegraded":"2024-09-12T02:52:55.897578+0000","last_fullsized":"2024-09-12T02:52:55.897578+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:30.224597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.735420+0000","last_change":"2024-09-12T02:52:53.733781+0000","last_active":"2024-09-12T02:52:55.735420+0000","last_peered":"2024-09-12T02:52:55.735420+0000","last_clean":"2024-09-12T02:52:55.735420+0000","last_became_active":"2024-09-12T02:52:53.733489+0000","last_became_peered":"2024-09-12T02:52:53.733489+0000","last_unstale":"2024-09-12T02:52:55.735420+0000","last_undegraded":"2024-09-12T02:52:55.735420+0000","last_fullsized":"2024-09-12T02:52:55.735420+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:12.837511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.749365+0000","last_change":"2024-09-12T02:52:54.744570+0000","last_active":"2024-09-12T02:52:55.749365+0000","last_peered":"2024-09-12T02:52:55.749365+0000","last_clean":"2024-09-12T02:52:55.749365+0000","last_became_active":"2024-09-12T02:52:54.743803+0000","last_became_peered":"2024-09-12T02:52:54.743803+0000","last_unstale":"2024-09-12T02:52:55.749365+0000","last_undegraded":"2024-09-12T02:52:55.749365+0000","last_fullsized":"2024-09-12T02:52:55.749365+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:42:07.900635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.734292+0000","last_change":"2024-09-12T02:52:53.736157+0000","last_active":"2024-09-12T02:52:55.734292+0000","last_peered":"2024-09-12T02:52:55.734292+0000","last_clean":"2024-09-12T02:52:55.734292+0000","last_became_active":"2024-09-12T02:52:53.735892+0000","last_became_peered":"2024-09-12T02:52:53.735892+0000","last_unstale":"2024-09-12T02:52:55.734292+0000","last_undegraded":"2024-09-12T02:52:55.734292+0000","last_fullsized":"2024-09-12T02:52:55.734292+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:05.883067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.735729+0000","last_change":"2024-09-12T02:52:54.744549+0000","last_active":"2024-09-12T02:52:55.735729+0000","last_peered":"2024-09-12T02:52:55.735729+0000","last_clean":"2024-09-12T02:52:55.735729+0000","last_became_active":"2024-09-12T02:52:54.744157+0000","last_became_peered":"2024-09-12T02:52:54.744157+0000","last_unstale":"2024-09-12T02:52:55.735729+0000","last_undegraded":"2024-09-12T02:52:55.735729+0000","last_fullsized":"2024-09-12T02:52:55.735729+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:53.722379+0000","last_clean_scrub_stamp":"2024-09-12T02:52:53.722379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:09.626972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.734947+0000","last_change":"2024-09-12T02:52:53.734639+0000","last_active":"2024-09-12T02:52:55.734947+0000","last_peered":"2024-09-12T02:52:55.734947+0000","last_clean":"2024-09-12T02:52:55.734947+0000","last_became_active":"2024-09-12T02:52:53.734378+0000","last_became_peered":"2024-09-12T02:52:53.734378+0000","last_unstale":"2024-09-12T02:52:55.734947+0000","last_undegraded":"2024-09-12T02:52:55.734947+0000","last_fullsized":"2024-09-12T02:52:55.734947+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:52:52.719443+0000","last_clean_scrub_stamp":"2024-09-12T02:52:52.719443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:50.414670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":483,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-12T02:52:55.897911+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:52:55.897911+0000","last_peered":"2024-09-12T02:52:55.897911+0000","last_clean":"2024-09-12T02:52:55.897911+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:52:55.897911+0000","last_undegraded":"2024-09-12T02:52:55.897911+0000","last_fullsized":"2024-09-12T02:52:55.897911+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:25.823876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574985,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1582,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193730,"statfs":{"total":200000000,"available":198379727,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574985,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1003,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194309,"statfs":{"total":200000000,"available":198972427,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574985,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1004,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194308,"statfs":{"total":200000000,"available":198971845,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574985,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1005,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194307,"statfs":{"total":200000000,"available":198970767,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574985,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1003,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194308,"statfs":{"total":200000000,"available":198972415,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574985,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1003,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194308,"statfs":{"total":200000000,"available":198972359,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574985,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1003,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194308,"statfs":{"total":200000000,"available":198972415,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574985,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1579,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193732,"statfs":{"total":200000000,"available":198382081,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:52:59.307 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:52:59.307 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T02:52:59.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.504+0000 7fc6b6200640 1 Processor -- start 2024-09-12T02:52:59.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.504+0000 7fc6b6200640 1 -- start start 2024-09-12T02:52:59.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.505+0000 7fc6b6200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc6b00d34a0 0x7fc6b00d38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:59.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.505+0000 7fc6b6200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc6b00b85b0 0x7fc6b00b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:59.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.505+0000 7fc6b6200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6b00d3e00 con 0x7fc6b015f140 2024-09-12T02:52:59.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.505+0000 7fc6b6200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc6b00b8120 con 0x7fc6b00b85b0 2024-09-12T02:52:59.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.505+0000 7fc6b6200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc6b00d0e80 con 0x7fc6b00d34a0 2024-09-12T02:52:59.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.505+0000 7fc6afe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc6b00b85b0 0x7fc6b00b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:59.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.505+0000 7fc6afe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc6b00b85b0 0x7fc6b00b8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57884/0 (socket says 172.21.15.112:57884) 2024-09-12T02:52:59.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.505+0000 7fc6afe00640 1 -- 172.21.15.112:0/2132642890 learned_addr learned my addr 172.21.15.112:0/2132642890 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:59.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.506+0000 7fc6aea00640 1 --2- 172.21.15.112:0/2132642890 >> v2:172.21.15.137:3300/0 conn(0x7fc6b00d34a0 0x7fc6b00d38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:59.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.506+0000 7fc6afe00640 1 -- 172.21.15.112:0/2132642890 >> v2:172.21.15.137:3300/0 conn(0x7fc6b00d34a0 msgr2=0x7fc6b00d38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:59.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.506+0000 7fc6afe00640 1 --2- 172.21.15.112:0/2132642890 >> v2:172.21.15.137:3300/0 conn(0x7fc6b00d34a0 0x7fc6b00d38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:59.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.506+0000 7fc6afe00640 1 -- 172.21.15.112:0/2132642890 >> v1:172.21.15.137:6789/0 conn(0x7fc6b015f140 legacy=0x7fc6b00d2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:59.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.506+0000 7fc6afe00640 1 -- 172.21.15.112:0/2132642890 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b00d08c0 con 0x7fc6b00b85b0 2024-09-12T02:52:59.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.507+0000 7fc6afe00640 1 --2- 172.21.15.112:0/2132642890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6b00b85b0 0x7fc6b00b8a40 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0162c00 tx=0x7fc6a802a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14036fce0b3511ba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:59.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.507+0000 7fc6ae000640 1 -- 172.21.15.112:0/2132642890 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8036070 con 0x7fc6b00b85b0 2024-09-12T02:52:59.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.507+0000 7fc6ae000640 1 -- 172.21.15.112:0/2132642890 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6a8031600 con 0x7fc6b00b85b0 2024-09-12T02:52:59.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.507+0000 7fc6ae000640 1 -- 172.21.15.112:0/2132642890 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a80319d0 con 0x7fc6b00b85b0 2024-09-12T02:52:59.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.508+0000 7fc6b6200640 1 -- 172.21.15.112:0/2132642890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6b00b85b0 msgr2=0x7fc6b00b8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:59.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.508+0000 7fc6b6200640 1 --2- 172.21.15.112:0/2132642890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6b00b85b0 0x7fc6b00b8a40 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0162c00 tx=0x7fc6a802a780 comp rx=0 tx=0).stop 2024-09-12T02:52:59.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.508+0000 7fc6b6200640 1 -- 172.21.15.112:0/2132642890 shutdown_connections 2024-09-12T02:52:59.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.508+0000 7fc6b6200640 1 --2- 172.21.15.112:0/2132642890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6b00b85b0 0x7fc6b00b8a40 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:59.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.508+0000 7fc6b6200640 1 --2- 172.21.15.112:0/2132642890 >> v2:172.21.15.137:3300/0 conn(0x7fc6b00d34a0 0x7fc6b00d38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:59.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.508+0000 7fc6b6200640 1 -- 172.21.15.112:0/2132642890 >> 172.21.15.112:0/2132642890 conn(0x7fc6b00d4ec0 msgr2=0x7fc6b00d52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:59.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.508+0000 7fc6b6200640 1 -- 172.21.15.112:0/2132642890 shutdown_connections 2024-09-12T02:52:59.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.508+0000 7fc6b6200640 1 -- 172.21.15.112:0/2132642890 wait complete. 2024-09-12T02:52:59.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.509+0000 7fc6b6200640 1 Processor -- start 2024-09-12T02:52:59.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.509+0000 7fc6b6200640 1 -- start start 2024-09-12T02:52:59.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.510+0000 7fc6b6200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6b00b85b0 0x7fc6b00cb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:59.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.510+0000 7fc6b6200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6b00d34a0 0x7fc6b01ee9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:59.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.510+0000 7fc6b6200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6b015f140 0x7fc6b00c9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:59.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.510+0000 7fc6b6200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b015f520 con 0x7fc6b00b85b0 2024-09-12T02:52:59.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.510+0000 7fc6b6200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b00b7db0 con 0x7fc6b015f140 2024-09-12T02:52:59.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.510+0000 7fc6b6200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc6b00d0590 con 0x7fc6b00d34a0 2024-09-12T02:52:59.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.511+0000 7fc6af400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6b00b85b0 0x7fc6b00cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:59.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.511+0000 7fc6af400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6b00b85b0 0x7fc6b00cb500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57898/0 (socket says 172.21.15.112:57898) 2024-09-12T02:52:59.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.511+0000 7fc6af400640 1 -- 172.21.15.112:0/3640846500 learned_addr learned my addr 172.21.15.112:0/3640846500 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:59.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.511+0000 7fc6afe00640 1 --2- 172.21.15.112:0/3640846500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6b015f140 0x7fc6b00c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:59.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.511+0000 7fc6aea00640 1 --2- 172.21.15.112:0/3640846500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6b00d34a0 0x7fc6b01ee9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:59.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.511+0000 7fc6af400640 1 -- 172.21.15.112:0/3640846500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6b00d34a0 msgr2=0x7fc6b01ee9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:59.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.511+0000 7fc6af400640 1 --2- 172.21.15.112:0/3640846500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6b00d34a0 0x7fc6b01ee9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:59.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.511+0000 7fc6af400640 1 -- 172.21.15.112:0/3640846500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6b015f140 msgr2=0x7fc6b00c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:59.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.511+0000 7fc6af400640 1 --2- 172.21.15.112:0/3640846500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6b015f140 0x7fc6b00c9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:59.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.511+0000 7fc6af400640 1 -- 172.21.15.112:0/3640846500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b00ca740 con 0x7fc6b00b85b0 2024-09-12T02:52:59.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.511+0000 7fc6af400640 1 --2- 172.21.15.112:0/3640846500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6b00b85b0 0x7fc6b00cb500 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fc6a000b420 tx=0x7fc6a000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:59.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.512+0000 7fc6a7400640 1 -- 172.21.15.112:0/3640846500 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0011830 con 0x7fc6b00b85b0 2024-09-12T02:52:59.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.512+0000 7fc6a7400640 1 -- 172.21.15.112:0/3640846500 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6a0016070 con 0x7fc6b00b85b0 2024-09-12T02:52:59.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.512+0000 7fc6a7400640 1 -- 172.21.15.112:0/3640846500 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0011c10 con 0x7fc6b00b85b0 2024-09-12T02:52:59.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.512+0000 7fc6b6200640 1 -- 172.21.15.112:0/3640846500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6b00caa20 con 0x7fc6b00b85b0 2024-09-12T02:52:59.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.512+0000 7fc6b6200640 1 -- 172.21.15.112:0/3640846500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6b00cafe0 con 0x7fc6b00b85b0 2024-09-12T02:52:59.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.513+0000 7fc6b6200640 1 -- 172.21.15.112:0/3640846500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6b00cb1e0 con 0x7fc6b00b85b0 2024-09-12T02:52:59.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.514+0000 7fc6a7400640 1 -- 172.21.15.112:0/3640846500 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc6a001b460 con 0x7fc6b00b85b0 2024-09-12T02:52:59.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.515+0000 7fc6a7400640 1 --2- 172.21.15.112:0/3640846500 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc69006be30 0x7fc69006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:59.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.515+0000 7fc6a7400640 1 -- 172.21.15.112:0/3640846500 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7fc6a008a810 con 0x7fc6b00b85b0 2024-09-12T02:52:59.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.515+0000 7fc6aea00640 1 --2- 172.21.15.112:0/3640846500 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc69006be30 0x7fc69006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:59.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.516+0000 7fc6aea00640 1 --2- 172.21.15.112:0/3640846500 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc69006be30 0x7fc69006e2f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0069310 tx=0x7fc69c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:59.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.519+0000 7fc6a7400640 1 -- 172.21.15.112:0/3640846500 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc6b00cb1e0 con 0x7fc6b00b85b0 2024-09-12T02:52:59.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.757+0000 7fc6b6200640 1 -- 172.21.15.112:0/3640846500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fc6b00d38c0 con 0x7fc6b00b85b0 2024-09-12T02:52:59.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.760+0000 7fc6a7400640 1 -- 172.21.15.112:0/3640846500 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) ==== 190+0+147 (secure 0 0 0) 0x7fc6a0020020 con 0x7fc6b00b85b0 2024-09-12T02:52:59.761 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-09-12T02:52:59.761 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDUVOJmaG86ExAAD0SOlJOsLpoQZlgPJIPaxA== 2024-09-12T02:52:59.761 INFO:teuthology.orchestra.run.smithi112.stdout: caps mds = "allow" 2024-09-12T02:52:59.761 INFO:teuthology.orchestra.run.smithi112.stdout: caps mon = "allow r" 2024-09-12T02:52:59.761 INFO:teuthology.orchestra.run.smithi112.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T02:52:59.761 INFO:teuthology.orchestra.run.smithi112.stderr:updated caps for client.0 2024-09-12T02:52:59.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.762+0000 7fc6b6200640 1 -- 172.21.15.112:0/3640846500 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc69006be30 msgr2=0x7fc69006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:59.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.762+0000 7fc6b6200640 1 --2- 172.21.15.112:0/3640846500 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc69006be30 0x7fc69006e2f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0069310 tx=0x7fc69c008040 comp rx=0 tx=0).stop 2024-09-12T02:52:59.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.762+0000 7fc6b6200640 1 -- 172.21.15.112:0/3640846500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6b00b85b0 msgr2=0x7fc6b00cb500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:59.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.762+0000 7fc6b6200640 1 --2- 172.21.15.112:0/3640846500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6b00b85b0 0x7fc6b00cb500 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fc6a000b420 tx=0x7fc6a000b8e0 comp rx=0 tx=0).stop 2024-09-12T02:52:59.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.762+0000 7fc6b6200640 1 -- 172.21.15.112:0/3640846500 shutdown_connections 2024-09-12T02:52:59.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.762+0000 7fc6b6200640 1 --2- 172.21.15.112:0/3640846500 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc69006be30 0x7fc69006e2f0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:59.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.762+0000 7fc6b6200640 1 --2- 172.21.15.112:0/3640846500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6b015f140 0x7fc6b00c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:59.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.762+0000 7fc6b6200640 1 --2- 172.21.15.112:0/3640846500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6b00d34a0 0x7fc6b01ee9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:59.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.762+0000 7fc6b6200640 1 --2- 172.21.15.112:0/3640846500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6b00b85b0 0x7fc6b00cb500 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:59.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.762+0000 7fc6b6200640 1 -- 172.21.15.112:0/3640846500 >> 172.21.15.112:0/3640846500 conn(0x7fc6b00d4ec0 msgr2=0x7fc6b00b6210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:59.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.762+0000 7fc6b6200640 1 -- 172.21.15.112:0/3640846500 shutdown_connections 2024-09-12T02:52:59.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.762+0000 7fc6b6200640 1 -- 172.21.15.112:0/3640846500 wait complete. 2024-09-12T02:52:59.781 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:52:59.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.932+0000 7fde34a00640 1 Processor -- start 2024-09-12T02:52:59.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.932+0000 7fde34a00640 1 -- start start 2024-09-12T02:52:59.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.933+0000 7fde34a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fde3006de00 0x7fde300b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:59.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.933+0000 7fde34a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde300b6e10 con 0x7fde3015ef10 2024-09-12T02:52:59.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.933+0000 7fde34a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde300b70f0 con 0x7fde300b3ee0 2024-09-12T02:52:59.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.933+0000 7fde34a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fde3015f2f0 con 0x7fde3006de00 2024-09-12T02:52:59.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.933+0000 7fde26a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fde3006de00 0x7fde300b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:59.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.933+0000 7fde2f400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fde3015ef10 0x7fde3006d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:43034/0 (socket says 172.21.15.112:43034) 2024-09-12T02:52:59.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.933+0000 7fde2f400640 1 -- 172.21.15.112:0/162299089 learned_addr learned my addr 172.21.15.112:0/162299089 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:52:59.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.934+0000 7fde26a00640 1 -- 172.21.15.112:0/162299089 >> v1:172.21.15.137:6789/0 conn(0x7fde300b3ee0 legacy=0x7fde300b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:59.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.934+0000 7fde26a00640 1 -- 172.21.15.112:0/162299089 >> v1:172.21.15.112:6789/0 conn(0x7fde3015ef10 legacy=0x7fde3006d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:59.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.934+0000 7fde26a00640 1 -- 172.21.15.112:0/162299089 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde300b73d0 con 0x7fde3006de00 2024-09-12T02:52:59.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.935+0000 7fde26a00640 1 --2- 172.21.15.112:0/162299089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde3006de00 0x7fde300b24a0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fde180097a0 tx=0x7fde18029fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd9f0879d15e108 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:59.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.935+0000 7fde2ea00640 1 -- 172.21.15.112:0/162299089 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde18037070 con 0x7fde3006de00 2024-09-12T02:52:59.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.935+0000 7fde2ea00640 1 -- 172.21.15.112:0/162299089 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde1802ac40 con 0x7fde3006de00 2024-09-12T02:52:59.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.935+0000 7fde2ea00640 1 -- 172.21.15.112:0/162299089 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde18032440 con 0x7fde3006de00 2024-09-12T02:52:59.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.936+0000 7fde34a00640 1 -- 172.21.15.112:0/162299089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde3006de00 msgr2=0x7fde300b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:59.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.936+0000 7fde34a00640 1 --2- 172.21.15.112:0/162299089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde3006de00 0x7fde300b24a0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fde180097a0 tx=0x7fde18029fb0 comp rx=0 tx=0).stop 2024-09-12T02:52:59.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.936+0000 7fde34a00640 1 -- 172.21.15.112:0/162299089 shutdown_connections 2024-09-12T02:52:59.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.936+0000 7fde34a00640 1 --2- 172.21.15.112:0/162299089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde3006de00 0x7fde300b24a0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:59.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.936+0000 7fde34a00640 1 -- 172.21.15.112:0/162299089 >> 172.21.15.112:0/162299089 conn(0x7fde300b7ea0 msgr2=0x7fde300b82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:59.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.936+0000 7fde34a00640 1 -- 172.21.15.112:0/162299089 shutdown_connections 2024-09-12T02:52:59.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.936+0000 7fde34a00640 1 -- 172.21.15.112:0/162299089 wait complete. 2024-09-12T02:52:59.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.937+0000 7fde34a00640 1 Processor -- start 2024-09-12T02:52:59.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.938+0000 7fde34a00640 1 -- start start 2024-09-12T02:52:59.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.938+0000 7fde34a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde3006de00 0x7fde30160600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:59.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.938+0000 7fde34a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fde300b3ee0 0x7fde301506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:59.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.938+0000 7fde34a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde3015ef10 0x7fde3015f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:59.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.938+0000 7fde34a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fde300b0b60 con 0x7fde3015ef10 2024-09-12T02:52:59.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.938+0000 7fde34a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fde300b09e0 con 0x7fde3006de00 2024-09-12T02:52:59.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.938+0000 7fde34a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fde300b0ce0 con 0x7fde300b3ee0 2024-09-12T02:52:59.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.939+0000 7fde2fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde3015ef10 0x7fde3015f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:59.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.939+0000 7fde2f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde3006de00 0x7fde30160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:59.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.939+0000 7fde2fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde3015ef10 0x7fde3015f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57908/0 (socket says 172.21.15.112:57908) 2024-09-12T02:52:59.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.939+0000 7fde2fe00640 1 -- 172.21.15.112:0/4133035722 learned_addr learned my addr 172.21.15.112:0/4133035722 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:52:59.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.939+0000 7fde26a00640 1 --2- 172.21.15.112:0/4133035722 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fde300b3ee0 0x7fde301506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:59.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.939+0000 7fde2fe00640 1 -- 172.21.15.112:0/4133035722 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fde300b3ee0 msgr2=0x7fde301506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:59.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.939+0000 7fde2fe00640 1 --2- 172.21.15.112:0/4133035722 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fde300b3ee0 0x7fde301506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:59.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.939+0000 7fde2fe00640 1 -- 172.21.15.112:0/4133035722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde3006de00 msgr2=0x7fde30160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:59.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.939+0000 7fde2fe00640 1 --2- 172.21.15.112:0/4133035722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde3006de00 0x7fde30160600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:59.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.939+0000 7fde2fe00640 1 -- 172.21.15.112:0/4133035722 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde301620f0 con 0x7fde3015ef10 2024-09-12T02:52:59.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.940+0000 7fde2fe00640 1 --2- 172.21.15.112:0/4133035722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde3015ef10 0x7fde3015f4a0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fde2800b9a0 tx=0x7fde2800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:59.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.940+0000 7fde27e00640 1 -- 172.21.15.112:0/4133035722 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde28019070 con 0x7fde3015ef10 2024-09-12T02:52:59.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.940+0000 7fde27e00640 1 -- 172.21.15.112:0/4133035722 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde2800cba0 con 0x7fde3015ef10 2024-09-12T02:52:59.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.940+0000 7fde27e00640 1 -- 172.21.15.112:0/4133035722 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde28014440 con 0x7fde3015ef10 2024-09-12T02:52:59.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.940+0000 7fde34a00640 1 -- 172.21.15.112:0/4133035722 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde301623d0 con 0x7fde3015ef10 2024-09-12T02:52:59.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.940+0000 7fde34a00640 1 -- 172.21.15.112:0/4133035722 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde300cdcf0 con 0x7fde3015ef10 2024-09-12T02:52:59.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.941+0000 7fde34a00640 1 -- 172.21.15.112:0/4133035722 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde3006d6f0 con 0x7fde3015ef10 2024-09-12T02:52:59.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.942+0000 7fde27e00640 1 -- 172.21.15.112:0/4133035722 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fde2801c070 con 0x7fde3015ef10 2024-09-12T02:52:59.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.943+0000 7fde27e00640 1 --2- 172.21.15.112:0/4133035722 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fde0c06be30 0x7fde0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:59.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.943+0000 7fde27e00640 1 -- 172.21.15.112:0/4133035722 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7fde2808a980 con 0x7fde3015ef10 2024-09-12T02:52:59.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.943+0000 7fde2f400640 1 --2- 172.21.15.112:0/4133035722 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fde0c06be30 0x7fde0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:59.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.944+0000 7fde2f400640 1 --2- 172.21.15.112:0/4133035722 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fde0c06be30 0x7fde0c06e2f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fde20000f60 tx=0x7fde20007e20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:59.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:52:59.947+0000 7fde27e00640 1 -- 172.21.15.112:0/4133035722 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fde28058d70 con 0x7fde3015ef10 2024-09-12T02:53:00.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.156+0000 7fde34a00640 1 -- 172.21.15.112:0/4133035722 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde3006fb20 con 0x7fde3015ef10 2024-09-12T02:53:00.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.157+0000 7fde27e00640 1 -- 172.21.15.112:0/4133035722 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5233 (secure 0 0 0) 0x7fde2805d070 con 0x7fde3015ef10 2024-09-12T02:53:00.158 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:53:00.158 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":94,"btime":"2024-09-12T02:52:57:752799+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7177,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/119222923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":119222923},{"type":"v1","addr":"172.21.15.112:6837","nonce":119222923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7180,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/691058370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":691058370},{"type":"v1","addr":"172.21.15.137:6834","nonce":691058370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7854,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/1978579863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1978579863},{"type":"v1","addr":"172.21.15.112:6836","nonce":1978579863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:52:54.149640+0000","modified":"2024-09-12T02:52:57.153816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7860},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7860":{"gid":7860,"name":"b","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/1283773082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1283773082},{"type":"v1","addr":"172.21.15.137:6835","nonce":1283773082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7860,"qdb_cluster":[7860]},"id":11}]} 2024-09-12T02:53:00.158 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 94 2024-09-12T02:53:00.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.159+0000 7fde34a00640 1 -- 172.21.15.112:0/4133035722 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fde0c06be30 msgr2=0x7fde0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:00.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.159+0000 7fde34a00640 1 --2- 172.21.15.112:0/4133035722 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fde0c06be30 0x7fde0c06e2f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fde20000f60 tx=0x7fde20007e20 comp rx=0 tx=0).stop 2024-09-12T02:53:00.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.159+0000 7fde34a00640 1 -- 172.21.15.112:0/4133035722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde3015ef10 msgr2=0x7fde3015f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:00.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.159+0000 7fde34a00640 1 --2- 172.21.15.112:0/4133035722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde3015ef10 0x7fde3015f4a0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fde2800b9a0 tx=0x7fde2800be60 comp rx=0 tx=0).stop 2024-09-12T02:53:00.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.159+0000 7fde34a00640 1 -- 172.21.15.112:0/4133035722 shutdown_connections 2024-09-12T02:53:00.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.159+0000 7fde34a00640 1 --2- 172.21.15.112:0/4133035722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde3015ef10 0x7fde3015f4a0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.159+0000 7fde34a00640 1 --2- 172.21.15.112:0/4133035722 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fde300b3ee0 0x7fde301506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.159+0000 7fde34a00640 1 --2- 172.21.15.112:0/4133035722 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fde0c06be30 0x7fde0c06e2f0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.159+0000 7fde34a00640 1 --2- 172.21.15.112:0/4133035722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde3006de00 0x7fde30160600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.159+0000 7fde34a00640 1 -- 172.21.15.112:0/4133035722 >> 172.21.15.112:0/4133035722 conn(0x7fde300b7ea0 msgr2=0x7fde300b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:00.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.160+0000 7fde34a00640 1 -- 172.21.15.112:0/4133035722 shutdown_connections 2024-09-12T02:53:00.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.160+0000 7fde34a00640 1 -- 172.21.15.112:0/4133035722 wait complete. 2024-09-12T02:53:00.336 INFO:tasks.ceph.mds.b.smithi137.stderr:2024-09-12T02:53:00.335+0000 7f8281000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:53:00.578 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 94, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:52:54.149640+0000', 'modified': '2024-09-12T02:52:57.153816+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7860}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7860': {'gid': 7860, 'name': 'b', 'rank': 0, 'incarnation': 90, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.137:6835/1283773082', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6833', 'nonce': 1283773082}, {'type': 'v1', 'addr': '172.21.15.137:6835', 'nonce': 1283773082}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7860, 'qdb_cluster': [7860]} 2024-09-12T02:53:00.578 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:53:00.578 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-12T02:53:00.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.733+0000 7f4ac3e00640 1 Processor -- start 2024-09-12T02:53:00.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.733+0000 7f4ac3e00640 1 -- start start 2024-09-12T02:53:00.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.734+0000 7f4ac3e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4abc06f600 0x7f4abc0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:00.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.734+0000 7f4ac3e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4abc0b45d0 0x7f4abc0728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:00.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.734+0000 7f4ac3e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4abc0b4a20 con 0x7f4abc15b9d0 2024-09-12T02:53:00.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.735+0000 7f4ac3e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4abc0b54a0 con 0x7f4abc0b45d0 2024-09-12T02:53:00.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.735+0000 7f4ac3e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4abc0b3af0 con 0x7f4abc06f600 2024-09-12T02:53:00.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.735+0000 7f4ac1e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4abc0b45d0 0x7f4abc0728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:00.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.735+0000 7f4ac1e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4abc0b45d0 0x7f4abc0728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57912/0 (socket says 172.21.15.112:57912) 2024-09-12T02:53:00.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.735+0000 7f4ac1e00640 1 -- 172.21.15.112:0/1582111761 learned_addr learned my addr 172.21.15.112:0/1582111761 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:00.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.735+0000 7f4ac0a00640 1 --2- 172.21.15.112:0/1582111761 >> v2:172.21.15.137:3300/0 conn(0x7f4abc06f600 0x7f4abc0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:00.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.735+0000 7f4ac1e00640 1 -- 172.21.15.112:0/1582111761 >> v2:172.21.15.137:3300/0 conn(0x7f4abc06f600 msgr2=0x7f4abc0b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:00.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.735+0000 7f4ac1e00640 1 --2- 172.21.15.112:0/1582111761 >> v2:172.21.15.137:3300/0 conn(0x7f4abc06f600 0x7f4abc0b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.735+0000 7f4ac1e00640 1 -- 172.21.15.112:0/1582111761 >> v1:172.21.15.112:6789/0 conn(0x7f4abc15b9d0 legacy=0x7f4abc06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:00.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.735+0000 7f4ac1e00640 1 -- 172.21.15.112:0/1582111761 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4abc0b3dd0 con 0x7f4abc0b45d0 2024-09-12T02:53:00.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.735+0000 7f4abbe00640 1 -- 172.21.15.112:0/1582111761 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2488718033 0 0) 0x7f4abc0b4a20 con 0x7f4abc15b9d0 2024-09-12T02:53:00.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.736+0000 7f4ac1e00640 1 --2- 172.21.15.112:0/1582111761 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4abc0b45d0 0x7f4abc0728c0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f4abc071200 tx=0x7f4ab402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=defd8aa63340bcda server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:00.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.736+0000 7f4abbe00640 1 -- 172.21.15.112:0/1582111761 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4036070 con 0x7f4abc0b45d0 2024-09-12T02:53:00.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.736+0000 7f4abbe00640 1 -- 172.21.15.112:0/1582111761 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab4031600 con 0x7f4abc0b45d0 2024-09-12T02:53:00.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.736+0000 7f4abbe00640 1 -- 172.21.15.112:0/1582111761 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab40319d0 con 0x7f4abc0b45d0 2024-09-12T02:53:00.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.737+0000 7f4ac3e00640 1 -- 172.21.15.112:0/1582111761 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4abc0b45d0 msgr2=0x7f4abc0728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:00.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.737+0000 7f4ac3e00640 1 --2- 172.21.15.112:0/1582111761 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4abc0b45d0 0x7f4abc0728c0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f4abc071200 tx=0x7f4ab402a6a0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.737+0000 7f4ac3e00640 1 -- 172.21.15.112:0/1582111761 shutdown_connections 2024-09-12T02:53:00.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.737+0000 7f4ac3e00640 1 --2- 172.21.15.112:0/1582111761 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4abc0b45d0 0x7f4abc0728c0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.737+0000 7f4ac3e00640 1 --2- 172.21.15.112:0/1582111761 >> v2:172.21.15.137:3300/0 conn(0x7f4abc06f600 0x7f4abc0b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.737+0000 7f4ac3e00640 1 -- 172.21.15.112:0/1582111761 >> 172.21.15.112:0/1582111761 conn(0x7f4abc06bbd0 msgr2=0x7f4abc06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:00.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.737+0000 7f4ac3e00640 1 -- 172.21.15.112:0/1582111761 shutdown_connections 2024-09-12T02:53:00.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.737+0000 7f4ac3e00640 1 -- 172.21.15.112:0/1582111761 wait complete. 2024-09-12T02:53:00.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.739+0000 7f4ac3e00640 1 Processor -- start 2024-09-12T02:53:00.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.739+0000 7f4ac3e00640 1 -- start start 2024-09-12T02:53:00.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.740+0000 7f4ac3e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4abc06f600 0x7f4abc1f8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:00.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.740+0000 7f4ac3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4abc0b45d0 0x7f4abc1e6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:00.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.740+0000 7f4ac3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4abc15b9d0 0x7f4abc150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:00.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.740+0000 7f4ac3e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4abc15bf30 con 0x7f4abc0b45d0 2024-09-12T02:53:00.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.740+0000 7f4ac3e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4abc15bdb0 con 0x7f4abc15b9d0 2024-09-12T02:53:00.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.740+0000 7f4ac3e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4abc0cdcd0 con 0x7f4abc06f600 2024-09-12T02:53:00.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.740+0000 7f4ac0a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4abc0b45d0 0x7f4abc1e6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:00.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.740+0000 7f4ac0a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4abc0b45d0 0x7f4abc1e6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57928/0 (socket says 172.21.15.112:57928) 2024-09-12T02:53:00.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.740+0000 7f4ac0a00640 1 -- 172.21.15.112:0/2878662953 learned_addr learned my addr 172.21.15.112:0/2878662953 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:00.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.740+0000 7f4ac1e00640 1 --2- 172.21.15.112:0/2878662953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4abc15b9d0 0x7f4abc150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:00.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.740+0000 7f4ac1400640 1 --2- 172.21.15.112:0/2878662953 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4abc06f600 0x7f4abc1f8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:00.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.740+0000 7f4ac0a00640 1 -- 172.21.15.112:0/2878662953 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4abc06f600 msgr2=0x7f4abc1f8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:00.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.740+0000 7f4ac0a00640 1 --2- 172.21.15.112:0/2878662953 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4abc06f600 0x7f4abc1f8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.740+0000 7f4ac0a00640 1 -- 172.21.15.112:0/2878662953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4abc15b9d0 msgr2=0x7f4abc150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:00.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.740+0000 7f4ac0a00640 1 --2- 172.21.15.112:0/2878662953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4abc15b9d0 0x7f4abc150fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.740+0000 7f4ac0a00640 1 -- 172.21.15.112:0/2878662953 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4abc15c8e0 con 0x7f4abc0b45d0 2024-09-12T02:53:00.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.741+0000 7f4ac0a00640 1 --2- 172.21.15.112:0/2878662953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4abc0b45d0 0x7f4abc1e6020 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f4aa800d800 tx=0x7f4aa800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:00.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.741+0000 7f4ab9600640 1 -- 172.21.15.112:0/2878662953 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8005990 con 0x7f4abc0b45d0 2024-09-12T02:53:00.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.741+0000 7f4ab9600640 1 -- 172.21.15.112:0/2878662953 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aa8005b30 con 0x7f4abc0b45d0 2024-09-12T02:53:00.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.741+0000 7f4ab9600640 1 -- 172.21.15.112:0/2878662953 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa800b6c0 con 0x7f4abc0b45d0 2024-09-12T02:53:00.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.741+0000 7f4ac3e00640 1 -- 172.21.15.112:0/2878662953 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4abc15cbc0 con 0x7f4abc0b45d0 2024-09-12T02:53:00.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.741+0000 7f4ac3e00640 1 -- 172.21.15.112:0/2878662953 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4abc15d180 con 0x7f4abc0b45d0 2024-09-12T02:53:00.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.743+0000 7f4ab9600640 1 -- 172.21.15.112:0/2878662953 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4aa800b860 con 0x7f4abc0b45d0 2024-09-12T02:53:00.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.744+0000 7f4ab9600640 1 --2- 172.21.15.112:0/2878662953 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4a9c06be30 0x7f4a9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:00.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.744+0000 7f4ab9600640 1 -- 172.21.15.112:0/2878662953 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f4aa808b320 con 0x7f4abc0b45d0 2024-09-12T02:53:00.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.744+0000 7f4ac1400640 1 --2- 172.21.15.112:0/2878662953 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4a9c06be30 0x7f4a9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:00.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.745+0000 7f4ac6ca0740 1 Processor -- start 2024-09-12T02:53:00.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.745+0000 7f4ac6ca0740 1 -- start start 2024-09-12T02:53:00.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.745+0000 7f4ac1400640 1 --2- 172.21.15.112:0/2878662953 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4a9c06be30 0x7f4a9c06e2f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0007fd0 tx=0x7f4ab0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:00.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.745+0000 7f4ac6ca0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df3f442cf0 0x55df3f488490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:00.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.746+0000 7f4ac6ca0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3f4404b0 0x55df3f4430d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:00.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.746+0000 7f4ac6ca0740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55df3f444480 0x55df3f43d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:00.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.746+0000 7f4ac6ca0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55df3f3a13b0 con 0x55df3f442cf0 2024-09-12T02:53:00.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.746+0000 7f4ac6ca0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55df3f3a6410 con 0x55df3f4404b0 2024-09-12T02:53:00.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.746+0000 7f4ac6ca0740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55df3f34e620 con 0x55df3f444480 2024-09-12T02:53:00.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.746+0000 7f4ac1400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df3f442cf0 0x55df3f488490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:00.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.746+0000 7f4ac1400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df3f442cf0 0x55df3f488490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57938/0 (socket says 172.21.15.112:57938) 2024-09-12T02:53:00.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.746+0000 7f4ac1400640 1 -- 172.21.15.112:0/1012692813 learned_addr learned my addr 172.21.15.112:0/1012692813 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:00.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.746+0000 7f4ac1e00640 1 --2- 172.21.15.112:0/1012692813 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55df3f444480 0x55df3f43d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:00.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.746+0000 7f4ac1400640 1 -- 172.21.15.112:0/1012692813 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55df3f444480 msgr2=0x55df3f43d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:00.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.746+0000 7f4ac1400640 1 --2- 172.21.15.112:0/1012692813 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55df3f444480 0x55df3f43d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.746+0000 7f4ac1400640 1 -- 172.21.15.112:0/1012692813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3f4404b0 msgr2=0x55df3f4430d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:00.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.746+0000 7f4ac1400640 1 --2- 172.21.15.112:0/1012692813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3f4404b0 0x55df3f4430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.746+0000 7f4ac1400640 1 -- 172.21.15.112:0/1012692813 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df3f0b92d0 con 0x55df3f442cf0 2024-09-12T02:53:00.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.746+0000 7f4ac1400640 1 --2- 172.21.15.112:0/1012692813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df3f442cf0 0x55df3f488490 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0001eb0 tx=0x7f4ab0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd25f67dba4280e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:00.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.747+0000 7f4aadc00640 1 -- 172.21.15.112:0/1012692813 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab00035f0 con 0x55df3f442cf0 2024-09-12T02:53:00.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.747+0000 7f4aadc00640 1 -- 172.21.15.112:0/1012692813 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab0003790 con 0x55df3f442cf0 2024-09-12T02:53:00.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.747+0000 7f4aadc00640 1 -- 172.21.15.112:0/1012692813 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0003b40 con 0x55df3f442cf0 2024-09-12T02:53:00.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.747+0000 7f4ac6ca0740 1 -- 172.21.15.112:0/1012692813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df3f442cf0 msgr2=0x55df3f488490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:00.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.747+0000 7f4ac6ca0740 1 --2- 172.21.15.112:0/1012692813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df3f442cf0 0x55df3f488490 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0001eb0 tx=0x7f4ab0011000 comp rx=0 tx=0).stop 2024-09-12T02:53:00.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.747+0000 7f4ac6ca0740 1 -- 172.21.15.112:0/1012692813 shutdown_connections 2024-09-12T02:53:00.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.747+0000 7f4ac6ca0740 1 --2- 172.21.15.112:0/1012692813 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55df3f444480 0x55df3f43d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.747+0000 7f4ac6ca0740 1 --2- 172.21.15.112:0/1012692813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3f4404b0 0x55df3f4430d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.747+0000 7f4ac6ca0740 1 --2- 172.21.15.112:0/1012692813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df3f442cf0 0x55df3f488490 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.747+0000 7f4ac6ca0740 1 -- 172.21.15.112:0/1012692813 >> 172.21.15.112:0/1012692813 conn(0x55df3f43f740 msgr2=0x55df3f487960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:00.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.747+0000 7f4ac6ca0740 1 -- 172.21.15.112:0/1012692813 shutdown_connections 2024-09-12T02:53:00.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.747+0000 7f4ac6ca0740 1 -- 172.21.15.112:0/1012692813 wait complete. 2024-09-12T02:53:00.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.748+0000 7f4ac6ca0740 1 -- start start 2024-09-12T02:53:00.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.748+0000 7f4ac6ca0740 1 Processor -- start 2024-09-12T02:53:00.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.749+0000 7f4ac6ca0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df3f442cf0 0x55df3f484e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:00.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.749+0000 7f4ac6ca0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3f444480 0x55df3f49b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:00.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.749+0000 7f4ac6ca0740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55df3f49bd90 0x55df3f45a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:00.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.749+0000 7f4ac6ca0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55df3f361780 con 0x55df3f442cf0 2024-09-12T02:53:00.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.749+0000 7f4ac6ca0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55df3f3a23d0 con 0x55df3f444480 2024-09-12T02:53:00.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.749+0000 7f4ac6ca0740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55df3f43ebe0 con 0x55df3f49bd90 2024-09-12T02:53:00.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.749+0000 7f4ac6ca0740 10 client.0 _ll_register_callbacks cb 0x55df3f39f5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:53:00.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.749+0000 7f4ac1400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df3f442cf0 0x55df3f484e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:00.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.750+0000 7f4ac1400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df3f442cf0 0x55df3f484e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57952/0 (socket says 172.21.15.112:57952) 2024-09-12T02:53:00.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.750+0000 7f4ac1400640 1 -- 172.21.15.112:0/1016689465 learned_addr learned my addr 172.21.15.112:0/1016689465 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:00.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.750+0000 7f4ac0a00640 1 --2- 172.21.15.112:0/1016689465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3f444480 0x55df3f49b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:00.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.750+0000 7f4ac1400640 1 -- 172.21.15.112:0/1016689465 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55df3f49bd90 msgr2=0x55df3f45a110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:53:00.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.750+0000 7f4ac1400640 1 --2- 172.21.15.112:0/1016689465 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55df3f49bd90 0x55df3f45a110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.750+0000 7f4ac1400640 1 -- 172.21.15.112:0/1016689465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3f444480 msgr2=0x55df3f49b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:00.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.750+0000 7f4ac1400640 1 --2- 172.21.15.112:0/1016689465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3f444480 0x55df3f49b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.750+0000 7f4ac1400640 1 -- 172.21.15.112:0/1016689465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df3f1836b0 con 0x55df3f442cf0 2024-09-12T02:53:00.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.750+0000 7f4ac1400640 1 --2- 172.21.15.112:0/1016689465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df3f442cf0 0x55df3f484e20 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0003bf0 tx=0x7f4ab0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6a66a3a74a16f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:00.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.750+0000 7f4aa2000640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-12T02:53:00.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.750+0000 7f4aa2000640 1 -- 172.21.15.112:0/1016689465 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0021650 con 0x55df3f442cf0 2024-09-12T02:53:00.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.750+0000 7f4aa2000640 1 -- 172.21.15.112:0/1016689465 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f4ab00217f0 con 0x55df3f442cf0 2024-09-12T02:53:00.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.750+0000 7f4ac6ca0740 1 -- 172.21.15.112:0/1016689465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ab0003790 con 0x55df3f442cf0 2024-09-12T02:53:00.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.751+0000 7f4aa2000640 1 -- 172.21.15.112:0/1016689465 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7f4ab0031050 con 0x55df3f442cf0 2024-09-12T02:53:00.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.751+0000 7f4ac6ca0740 10 client.7980 fetch_fsmap learned FSMap version 94 2024-09-12T02:53:00.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.751+0000 7f4ac6ca0740 1 -- 172.21.15.112:0/1016689465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x55df3f45b090 con 0x55df3f442cf0 2024-09-12T02:53:00.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.751+0000 7f4aa2000640 1 -- 172.21.15.112:0/1016689465 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab0003790 con 0x55df3f442cf0 2024-09-12T02:53:00.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.751+0000 7f4aa2000640 1 -- 172.21.15.112:0/1016689465 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 94) ==== 3502+0+0 (secure 0 0 0) 0x7f4ab0034020 con 0x55df3f442cf0 2024-09-12T02:53:00.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.751+0000 7f4ac6ca0740 10 client.7980 fetch_fsmap finished waiting for FSMap version 94 2024-09-12T02:53:00.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.751+0000 7f4ac6ca0740 10 client.7980 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:53:00.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.751+0000 7f4ac6ca0740 20 client.7980 populate_metadata read hostname 'smithi112' 2024-09-12T02:53:00.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.751+0000 7f4ac6ca0740 1 --2- 172.21.15.112:0/1016689465 >> [v2:172.21.15.137:6833/1283773082,v1:172.21.15.137:6835/1283773082] conn(0x55df3f46b750 0x55df3f483ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:00.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.751+0000 7f4ac6ca0740 4 client.7980 mds_command: new command op to 7860 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:53:00.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.751+0000 7f4ac6ca0740 1 -- 172.21.15.112:0/1016689465 --> [v2:172.21.15.137:6833/1283773082,v1:172.21.15.137:6835/1283773082] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df3f3b3b40 con 0x55df3f46b750 2024-09-12T02:53:00.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.752+0000 7f4ac0a00640 1 --2- 172.21.15.112:0/1016689465 >> [v2:172.21.15.137:6833/1283773082,v1:172.21.15.137:6835/1283773082] conn(0x55df3f46b750 0x55df3f483ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:00.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.753+0000 7f4ac0a00640 1 --2- 172.21.15.112:0/1016689465 >> [v2:172.21.15.137:6833/1283773082,v1:172.21.15.137:6835/1283773082] conn(0x55df3f46b750 0x55df3f483ef0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=895574cf6d7c4ae5 server_cookie=607c3e70f7df493b in_seq=0 out_seq=0 2024-09-12T02:53:00.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.753+0000 7f4aa2000640 10 client.7980 ms_handle_connect on v2:172.21.15.137:6833/1283773082 2024-09-12T02:53:00.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.754+0000 7f4aa2000640 1 -- 172.21.15.112:0/1016689465 <== mds.0 v2:172.21.15.137:6833/1283773082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55df3f3b3b40 con 0x55df3f46b750 2024-09-12T02:53:00.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.754+0000 7f4aa2000640 10 client.7980 handle_command_reply: tid=0 2024-09-12T02:53:00.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.754+0000 7f4ac6ca0740 1 client.7980 shutdown 2024-09-12T02:53:00.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.754+0000 7f4ac6ca0740 1 -- 172.21.15.112:0/1016689465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df3f442cf0 msgr2=0x55df3f484e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:00.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.754+0000 7f4ac6ca0740 1 --2- 172.21.15.112:0/1016689465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df3f442cf0 0x55df3f484e20 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0003bf0 tx=0x7f4ab0000ed0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.754+0000 7f4ac6ca0740 1 -- 172.21.15.112:0/1016689465 shutdown_connections 2024-09-12T02:53:00.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.754+0000 7f4ac6ca0740 1 --2- 172.21.15.112:0/1016689465 >> [v2:172.21.15.137:6833/1283773082,v1:172.21.15.137:6835/1283773082] conn(0x55df3f46b750 0x55df3f483ef0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.754+0000 7f4ac6ca0740 1 --2- 172.21.15.112:0/1016689465 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55df3f49bd90 0x55df3f45a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.754+0000 7f4ac6ca0740 1 --2- 172.21.15.112:0/1016689465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3f444480 0x55df3f49b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.754+0000 7f4aa2000640 0 client.7980 ms_handle_reset on v2:172.21.15.137:6833/1283773082 2024-09-12T02:53:00.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.754+0000 7f4ac6ca0740 1 --2- 172.21.15.112:0/1016689465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df3f442cf0 0x55df3f484e20 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.755+0000 7f4ac6ca0740 1 -- 172.21.15.112:0/1016689465 >> 172.21.15.112:0/1016689465 conn(0x55df3f4404b0 msgr2=0x55df3f4865a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:00.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.755+0000 7f4ac6ca0740 1 -- 172.21.15.112:0/1016689465 shutdown_connections 2024-09-12T02:53:00.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.755+0000 7f4ac6ca0740 1 -- 172.21.15.112:0/1016689465 wait complete. 2024-09-12T02:53:00.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.755+0000 7f4ac6ca0740 20 client.7980 trim_cache size 0 max 16384 2024-09-12T02:53:00.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.774+0000 7f4ac6ca0740 1 Processor -- start 2024-09-12T02:53:00.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.774+0000 7f4ac6ca0740 1 -- start start 2024-09-12T02:53:00.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.774+0000 7f4ac6ca0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3f442cf0 0x55df3f485bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:00.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.774+0000 7f4ac6ca0740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55df3f444480 0x55df3f46c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:00.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.774+0000 7f4ac6ca0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df3f49bd90 0x55df3f46c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:00.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.774+0000 7f4ac6ca0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4abc200230 con 0x55df3f49bd90 2024-09-12T02:53:00.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.774+0000 7f4ac6ca0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4abc1e7ad0 con 0x55df3f442cf0 2024-09-12T02:53:00.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.774+0000 7f4ac6ca0740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4abc1ffbe0 con 0x55df3f444480 2024-09-12T02:53:00.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.775+0000 7f4ac1e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df3f49bd90 0x55df3f46c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:00.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.775+0000 7f4ac1e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df3f49bd90 0x55df3f46c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57966/0 (socket says 172.21.15.112:57966) 2024-09-12T02:53:00.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.775+0000 7f4ac0a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55df3f444480 0x55df3f46c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:00.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.775+0000 7f4ac1400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3f442cf0 0x55df3f485bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:00.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.775+0000 7f4ac1e00640 1 -- 172.21.15.112:0/876105752 learned_addr learned my addr 172.21.15.112:0/876105752 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:00.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.775+0000 7f4ac1e00640 1 -- 172.21.15.112:0/876105752 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55df3f444480 msgr2=0x55df3f46c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:00.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.775+0000 7f4ac1e00640 1 --2- 172.21.15.112:0/876105752 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55df3f444480 0x55df3f46c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.775+0000 7f4ac1e00640 1 -- 172.21.15.112:0/876105752 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3f442cf0 msgr2=0x55df3f485bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:00.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.775+0000 7f4ac1e00640 1 --2- 172.21.15.112:0/876105752 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3f442cf0 0x55df3f485bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.775+0000 7f4ac1e00640 1 -- 172.21.15.112:0/876105752 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df3f43f4e0 con 0x55df3f49bd90 2024-09-12T02:53:00.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.776+0000 7f4ac1e00640 1 --2- 172.21.15.112:0/876105752 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df3f49bd90 0x55df3f46c860 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4009f40 tx=0x7f4ab402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1102c857d753448a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:00.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.776+0000 7f4aad200640 1 -- 172.21.15.112:0/876105752 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4036040 con 0x55df3f49bd90 2024-09-12T02:53:00.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.776+0000 7f4aad200640 1 -- 172.21.15.112:0/876105752 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab403c620 con 0x55df3f49bd90 2024-09-12T02:53:00.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.776+0000 7f4aad200640 1 -- 172.21.15.112:0/876105752 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab403c9d0 con 0x55df3f49bd90 2024-09-12T02:53:00.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.776+0000 7f4ac6ca0740 1 -- 172.21.15.112:0/876105752 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df3f49bd90 msgr2=0x55df3f46c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:00.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.776+0000 7f4ac6ca0740 1 --2- 172.21.15.112:0/876105752 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df3f49bd90 0x55df3f46c860 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4009f40 tx=0x7f4ab402e000 comp rx=0 tx=0).stop 2024-09-12T02:53:00.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.777+0000 7f4ac6ca0740 1 -- 172.21.15.112:0/876105752 shutdown_connections 2024-09-12T02:53:00.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.777+0000 7f4ac6ca0740 1 --2- 172.21.15.112:0/876105752 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df3f49bd90 0x55df3f46c860 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.777+0000 7f4ac6ca0740 1 --2- 172.21.15.112:0/876105752 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55df3f444480 0x55df3f46c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.777+0000 7f4ac6ca0740 1 --2- 172.21.15.112:0/876105752 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3f442cf0 0x55df3f485bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.777+0000 7f4ac6ca0740 1 -- 172.21.15.112:0/876105752 >> 172.21.15.112:0/876105752 conn(0x55df3f4404b0 msgr2=0x55df3f488270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:00.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.777+0000 7f4ac6ca0740 1 -- 172.21.15.112:0/876105752 shutdown_connections 2024-09-12T02:53:00.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.777+0000 7f4ac6ca0740 1 -- 172.21.15.112:0/876105752 wait complete. 2024-09-12T02:53:00.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.777+0000 7f4ac6ca0740 1 -- start start 2024-09-12T02:53:00.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.777+0000 7f4ac6ca0740 1 Processor -- start 2024-09-12T02:53:00.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.778+0000 7f4ac6ca0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df3f442cf0 0x55df3f46ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:00.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.778+0000 7f4ac6ca0740 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55df3f444480 0x55df3f4ef240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:00.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.778+0000 7f4ac6ca0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3f49bd90 0x55df3f468e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:00.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.778+0000 7f4ac6ca0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55df3f46b5d0 con 0x55df3f442cf0 2024-09-12T02:53:00.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.778+0000 7f4ac6ca0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55df3f46b220 con 0x55df3f49bd90 2024-09-12T02:53:00.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.778+0000 7f4ac6ca0740 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55df3f46bbc0 con 0x55df3f444480 2024-09-12T02:53:00.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.778+0000 7f4ac6ca0740 10 client.0 _ll_register_callbacks cb 0x7f4ab0001d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:53:00.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.778+0000 7f4ac1400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df3f442cf0 0x55df3f46ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:00.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.779+0000 7f4ac1400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df3f442cf0 0x55df3f46ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57972/0 (socket says 172.21.15.112:57972) 2024-09-12T02:53:00.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.779+0000 7f4ac1400640 1 -- 172.21.15.112:0/2820744338 learned_addr learned my addr 172.21.15.112:0/2820744338 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:00.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.779+0000 7f4ac1400640 1 -- 172.21.15.112:0/2820744338 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55df3f444480 msgr2=0x55df3f4ef240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:00.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.779+0000 7f4ac1400640 1 --2- 172.21.15.112:0/2820744338 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55df3f444480 0x55df3f4ef240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.779+0000 7f4ac1400640 1 -- 172.21.15.112:0/2820744338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3f49bd90 msgr2=0x55df3f468e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:00.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.779+0000 7f4ac1400640 1 --2- 172.21.15.112:0/2820744338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3f49bd90 0x55df3f468e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.779+0000 7f4ac1400640 1 -- 172.21.15.112:0/2820744338 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df3f4aac40 con 0x55df3f442cf0 2024-09-12T02:53:00.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.779+0000 7f4ac1400640 1 --2- 172.21.15.112:0/2820744338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df3f442cf0 0x55df3f46ca70 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0007fa0 tx=0x7f4ab001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4794b1a047e18845 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:00.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.779+0000 7f4aa2000640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-12T02:53:00.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.779+0000 7f4aa2000640 1 -- 172.21.15.112:0/2820744338 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab000e580 con 0x55df3f442cf0 2024-09-12T02:53:00.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.779+0000 7f4aa2000640 1 -- 172.21.15.112:0/2820744338 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f4ab0021660 con 0x55df3f442cf0 2024-09-12T02:53:00.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.779+0000 7f4ac6ca0740 1 -- 172.21.15.112:0/2820744338 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ab403c620 con 0x55df3f442cf0 2024-09-12T02:53:00.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.780+0000 7f4aa2000640 1 -- 172.21.15.112:0/2820744338 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7f4ab0040050 con 0x55df3f442cf0 2024-09-12T02:53:00.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.780+0000 7f4ac6ca0740 10 client.7986 fetch_fsmap learned FSMap version 94 2024-09-12T02:53:00.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.780+0000 7f4ac6ca0740 1 -- 172.21.15.112:0/2820744338 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x55df3f4a0680 con 0x55df3f442cf0 2024-09-12T02:53:00.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.780+0000 7f4aa2000640 1 -- 172.21.15.112:0/2820744338 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab403c620 con 0x55df3f442cf0 2024-09-12T02:53:00.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.780+0000 7f4aa2000640 1 -- 172.21.15.112:0/2820744338 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 94) ==== 3502+0+0 (secure 0 0 0) 0x7f4ab0043020 con 0x55df3f442cf0 2024-09-12T02:53:00.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.780+0000 7f4ac6ca0740 10 client.7986 fetch_fsmap finished waiting for FSMap version 94 2024-09-12T02:53:00.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.780+0000 7f4ac6ca0740 10 client.7986 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:53:00.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.780+0000 7f4ac6ca0740 20 client.7986 populate_metadata read hostname 'smithi112' 2024-09-12T02:53:00.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.780+0000 7f4ac6ca0740 1 --2- 172.21.15.112:0/2820744338 >> [v2:172.21.15.137:6833/1283773082,v1:172.21.15.137:6835/1283773082] conn(0x55df3f49f600 0x55df3f49f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:00.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.780+0000 7f4ac6ca0740 4 client.7986 mds_command: new command op to 7860 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:53:00.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.780+0000 7f4ac6ca0740 1 -- 172.21.15.112:0/2820744338 --> [v2:172.21.15.137:6833/1283773082,v1:172.21.15.137:6835/1283773082] -- command(tid 0: {"prefix": "status"}) -- 0x55df3f3ade90 con 0x55df3f49f600 2024-09-12T02:53:00.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.780+0000 7f4ac0a00640 1 --2- 172.21.15.112:0/2820744338 >> [v2:172.21.15.137:6833/1283773082,v1:172.21.15.137:6835/1283773082] conn(0x55df3f49f600 0x55df3f49f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:00.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.781+0000 7f4ac0a00640 1 --2- 172.21.15.112:0/2820744338 >> [v2:172.21.15.137:6833/1283773082,v1:172.21.15.137:6835/1283773082] conn(0x55df3f49f600 0x55df3f49f9e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f42ff2211ed2baa server_cookie=d062d636d0337724 in_seq=0 out_seq=0 2024-09-12T02:53:00.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.781+0000 7f4aa2000640 10 client.7986 ms_handle_connect on v2:172.21.15.137:6833/1283773082 2024-09-12T02:53:00.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.781+0000 7f4aa2000640 1 -- 172.21.15.112:0/2820744338 <== mds.0 v2:172.21.15.137:6833/1283773082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55df3f3ade90 con 0x55df3f49f600 2024-09-12T02:53:00.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.781+0000 7f4aa2000640 10 client.7986 handle_command_reply: tid=0 2024-09-12T02:53:00.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.781+0000 7f4ac6ca0740 1 client.7986 shutdown 2024-09-12T02:53:00.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.781+0000 7f4ac6ca0740 1 -- 172.21.15.112:0/2820744338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df3f442cf0 msgr2=0x55df3f46ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:00.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.781+0000 7f4ac6ca0740 1 --2- 172.21.15.112:0/2820744338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df3f442cf0 0x55df3f46ca70 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0007fa0 tx=0x7f4ab001d000 comp rx=0 tx=0).stop 2024-09-12T02:53:00.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.781+0000 7f4ac6ca0740 1 -- 172.21.15.112:0/2820744338 shutdown_connections 2024-09-12T02:53:00.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.781+0000 7f4ac6ca0740 1 --2- 172.21.15.112:0/2820744338 >> [v2:172.21.15.137:6833/1283773082,v1:172.21.15.137:6835/1283773082] conn(0x55df3f49f600 0x55df3f49f9e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.781+0000 7f4ac6ca0740 1 --2- 172.21.15.112:0/2820744338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3f49bd90 0x55df3f468e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.781+0000 7f4ac6ca0740 1 --2- 172.21.15.112:0/2820744338 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55df3f444480 0x55df3f4ef240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.781+0000 7f4ac6ca0740 1 --2- 172.21.15.112:0/2820744338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df3f442cf0 0x55df3f46ca70 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.781+0000 7f4aa2000640 0 client.7986 ms_handle_reset on v2:172.21.15.137:6833/1283773082 2024-09-12T02:53:00.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.781+0000 7f4ac6ca0740 1 -- 172.21.15.112:0/2820744338 >> 172.21.15.112:0/2820744338 conn(0x55df3f4404b0 msgr2=0x55df3f459d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:00.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.782+0000 7f4ac6ca0740 1 -- 172.21.15.112:0/2820744338 shutdown_connections 2024-09-12T02:53:00.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.782+0000 7f4ac6ca0740 1 -- 172.21.15.112:0/2820744338 wait complete. 2024-09-12T02:53:00.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.782+0000 7f4ac6ca0740 20 client.7986 trim_cache size 0 max 16384 2024-09-12T02:53:00.787 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:53:00.787 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:53:00.787 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2024-09-12T02:53:00.787 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 7860, 2024-09-12T02:53:00.787 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2024-09-12T02:53:00.787 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2024-09-12T02:53:00.788 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2024-09-12T02:53:00.788 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 6.0506736060000001, 2024-09-12T02:53:00.788 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 94, 2024-09-12T02:53:00.788 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 183, 2024-09-12T02:53:00.788 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 183, 2024-09-12T02:53:00.788 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 11.129091020000001 2024-09-12T02:53:00.788 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:53:00.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.782+0000 7f4ac3e00640 1 -- 172.21.15.112:0/2878662953 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4a9c06be30 msgr2=0x7f4a9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:00.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.782+0000 7f4ac3e00640 1 --2- 172.21.15.112:0/2878662953 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4a9c06be30 0x7f4a9c06e2f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0007fd0 tx=0x7f4ab0009040 comp rx=0 tx=0).stop 2024-09-12T02:53:00.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.782+0000 7f4ac3e00640 1 -- 172.21.15.112:0/2878662953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4abc0b45d0 msgr2=0x7f4abc1e6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:00.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.782+0000 7f4ac3e00640 1 --2- 172.21.15.112:0/2878662953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4abc0b45d0 0x7f4abc1e6020 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f4aa800d800 tx=0x7f4aa800dcc0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.782+0000 7f4ac3e00640 1 -- 172.21.15.112:0/2878662953 shutdown_connections 2024-09-12T02:53:00.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.782+0000 7f4ac3e00640 1 --2- 172.21.15.112:0/2878662953 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4a9c06be30 0x7f4a9c06e2f0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.782+0000 7f4ac3e00640 1 --2- 172.21.15.112:0/2878662953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4abc15b9d0 0x7f4abc150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.782+0000 7f4ac3e00640 1 --2- 172.21.15.112:0/2878662953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4abc0b45d0 0x7f4abc1e6020 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.782+0000 7f4ac3e00640 1 --2- 172.21.15.112:0/2878662953 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4abc06f600 0x7f4abc1f8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.782+0000 7f4ac3e00640 1 -- 172.21.15.112:0/2878662953 >> 172.21.15.112:0/2878662953 conn(0x7f4abc06bbd0 msgr2=0x7f4abc0cdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:00.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.783+0000 7f4ac3e00640 1 -- 172.21.15.112:0/2878662953 shutdown_connections 2024-09-12T02:53:00.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.783+0000 7f4ac3e00640 1 -- 172.21.15.112:0/2878662953 wait complete. 2024-09-12T02:53:00.799 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:53:00.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.950+0000 7f7caec00640 1 Processor -- start 2024-09-12T02:53:00.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.950+0000 7f7caec00640 1 -- start start 2024-09-12T02:53:00.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.952+0000 7f7caec00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ca815b9d0 0x7f7ca80b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:00.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.952+0000 7f7caec00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7ca80b45d0 0x7f7ca80728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:00.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.952+0000 7f7caec00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ca80b54a0 con 0x7f7ca806eef0 2024-09-12T02:53:00.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.952+0000 7f7caec00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f7ca80b4a30 con 0x7f7ca80b45d0 2024-09-12T02:53:00.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.952+0000 7f7caec00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7ca80b3af0 con 0x7f7ca815b9d0 2024-09-12T02:53:00.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.952+0000 7f7c9fe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7ca80b45d0 0x7f7ca80728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:00.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.952+0000 7f7c9fe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7ca80b45d0 0x7f7ca80728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57980/0 (socket says 172.21.15.112:57980) 2024-09-12T02:53:00.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.952+0000 7f7c9fe00640 1 -- 172.21.15.112:0/2931734412 learned_addr learned my addr 172.21.15.112:0/2931734412 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:00.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.952+0000 7f7c9fe00640 1 -- 172.21.15.112:0/2931734412 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ca815b9d0 msgr2=0x7f7ca80b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:00.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.952+0000 7f7ca7e00640 1 --2- 172.21.15.112:0/2931734412 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ca815b9d0 0x7f7ca80b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:00.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.952+0000 7f7c9fe00640 1 --2- 172.21.15.112:0/2931734412 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ca815b9d0 0x7f7ca80b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.952+0000 7f7c9fe00640 1 -- 172.21.15.112:0/2931734412 >> v1:172.21.15.137:6789/0 conn(0x7f7ca806eef0 legacy=0x7f7ca806f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:00.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.952+0000 7f7c9fe00640 1 -- 172.21.15.112:0/2931734412 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca80b3dd0 con 0x7f7ca80b45d0 2024-09-12T02:53:00.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.952+0000 7f7ca7e00640 1 --2- 172.21.15.112:0/2931734412 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ca815b9d0 0x7f7ca80b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:53:00.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.953+0000 7f7c9fe00640 1 --2- 172.21.15.112:0/2931734412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ca80b45d0 0x7f7ca80728c0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f7c90009850 tx=0x7f7c9002a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5749db120674e956 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:00.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.954+0000 7f7ca7400640 1 -- 172.21.15.112:0/2931734412 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c90004030 con 0x7f7ca80b45d0 2024-09-12T02:53:00.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.954+0000 7f7ca7400640 1 -- 172.21.15.112:0/2931734412 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c900041d0 con 0x7f7ca80b45d0 2024-09-12T02:53:00.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.954+0000 7f7ca7400640 1 -- 172.21.15.112:0/2931734412 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c90003610 con 0x7f7ca80b45d0 2024-09-12T02:53:00.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.954+0000 7f7caec00640 1 -- 172.21.15.112:0/2931734412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ca80b45d0 msgr2=0x7f7ca80728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:00.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.954+0000 7f7caec00640 1 --2- 172.21.15.112:0/2931734412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ca80b45d0 0x7f7ca80728c0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f7c90009850 tx=0x7f7c9002a200 comp rx=0 tx=0).stop 2024-09-12T02:53:00.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.954+0000 7f7caec00640 1 -- 172.21.15.112:0/2931734412 shutdown_connections 2024-09-12T02:53:00.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.954+0000 7f7caec00640 1 --2- 172.21.15.112:0/2931734412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ca80b45d0 0x7f7ca80728c0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.954+0000 7f7caec00640 1 --2- 172.21.15.112:0/2931734412 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ca815b9d0 0x7f7ca80b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.954+0000 7f7caec00640 1 -- 172.21.15.112:0/2931734412 >> 172.21.15.112:0/2931734412 conn(0x7f7ca806bbd0 msgr2=0x7f7ca806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:00.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.954+0000 7f7caec00640 1 -- 172.21.15.112:0/2931734412 shutdown_connections 2024-09-12T02:53:00.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.954+0000 7f7caec00640 1 -- 172.21.15.112:0/2931734412 wait complete. 2024-09-12T02:53:00.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.956+0000 7f7caec00640 1 Processor -- start 2024-09-12T02:53:00.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.956+0000 7f7caec00640 1 -- start start 2024-09-12T02:53:00.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.957+0000 7f7caec00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ca806eef0 0x7f7ca815def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:00.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.957+0000 7f7caec00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ca80b45d0 0x7f7ca8152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:00.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.957+0000 7f7caec00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ca815b9d0 0x7f7ca815c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:00.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.957+0000 7f7caec00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca815bf30 con 0x7f7ca80b45d0 2024-09-12T02:53:00.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.957+0000 7f7caec00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca815bdb0 con 0x7f7ca806eef0 2024-09-12T02:53:00.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.957+0000 7f7caec00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7ca80cdcd0 con 0x7f7ca815b9d0 2024-09-12T02:53:00.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.957+0000 7f7c9fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ca80b45d0 0x7f7ca8152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:00.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.957+0000 7f7c9fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ca80b45d0 0x7f7ca8152b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57992/0 (socket says 172.21.15.112:57992) 2024-09-12T02:53:00.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.957+0000 7f7c9fe00640 1 -- 172.21.15.112:0/3096447785 learned_addr learned my addr 172.21.15.112:0/3096447785 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:00.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.957+0000 7f7ca7e00640 1 --2- 172.21.15.112:0/3096447785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ca806eef0 0x7f7ca815def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:00.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.957+0000 7f7cacc00640 1 --2- 172.21.15.112:0/3096447785 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ca815b9d0 0x7f7ca815c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:00.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.958+0000 7f7c9fe00640 1 -- 172.21.15.112:0/3096447785 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ca815b9d0 msgr2=0x7f7ca815c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:00.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.958+0000 7f7c9fe00640 1 --2- 172.21.15.112:0/3096447785 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ca815b9d0 0x7f7ca815c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.958+0000 7f7c9fe00640 1 -- 172.21.15.112:0/3096447785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ca806eef0 msgr2=0x7f7ca815def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:00.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.958+0000 7f7c9fe00640 1 --2- 172.21.15.112:0/3096447785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ca806eef0 0x7f7ca815def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:00.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.958+0000 7f7c9fe00640 1 -- 172.21.15.112:0/3096447785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca815c640 con 0x7f7ca80b45d0 2024-09-12T02:53:00.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.958+0000 7f7c9fe00640 1 --2- 172.21.15.112:0/3096447785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ca80b45d0 0x7f7ca8152b60 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f7c90000c00 tx=0x7f7c900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:00.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.958+0000 7f7ca4c00640 1 -- 172.21.15.112:0/3096447785 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c90041020 con 0x7f7ca80b45d0 2024-09-12T02:53:00.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.958+0000 7f7ca4c00640 1 -- 172.21.15.112:0/3096447785 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c90003c50 con 0x7f7ca80b45d0 2024-09-12T02:53:00.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.958+0000 7f7ca4c00640 1 -- 172.21.15.112:0/3096447785 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c90004030 con 0x7f7ca80b45d0 2024-09-12T02:53:00.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.958+0000 7f7caec00640 1 -- 172.21.15.112:0/3096447785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ca815c8c0 con 0x7f7ca80b45d0 2024-09-12T02:53:00.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.958+0000 7f7caec00640 1 -- 172.21.15.112:0/3096447785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ca815ce80 con 0x7f7ca80b45d0 2024-09-12T02:53:00.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.960+0000 7f7caec00640 1 -- 172.21.15.112:0/3096447785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ca8068a30 con 0x7f7ca80b45d0 2024-09-12T02:53:00.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.960+0000 7f7ca4c00640 1 -- 172.21.15.112:0/3096447785 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7c90044020 con 0x7f7ca80b45d0 2024-09-12T02:53:00.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.961+0000 7f7ca4c00640 1 --2- 172.21.15.112:0/3096447785 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7c8406be30 0x7f7c8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:00.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.961+0000 7f7ca4c00640 1 -- 172.21.15.112:0/3096447785 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f7c900aba40 con 0x7f7ca80b45d0 2024-09-12T02:53:00.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.961+0000 7f7ca7e00640 1 --2- 172.21.15.112:0/3096447785 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7c8406be30 0x7f7c8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:00.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.962+0000 7f7ca7e00640 1 --2- 172.21.15.112:0/3096447785 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7c8406be30 0x7f7c8406e2f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7c9800aac0 tx=0x7f7c98008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:00.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:00.965+0000 7f7ca4c00640 1 -- 172.21.15.112:0/3096447785 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7c9004b030 con 0x7f7ca80b45d0 2024-09-12T02:53:01.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:01.176+0000 7f7caec00640 1 -- 172.21.15.112:0/3096447785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7ca806dbc0 con 0x7f7ca80b45d0 2024-09-12T02:53:01.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:01.176+0000 7f7ca4c00640 1 -- 172.21.15.112:0/3096447785 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v94) ==== 53+0+73 (secure 0 0 0) 0x7f7ca815c640 con 0x7f7ca80b45d0 2024-09-12T02:53:01.177 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:53:01.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:01.178+0000 7f7caec00640 1 -- 172.21.15.112:0/3096447785 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7c8406be30 msgr2=0x7f7c8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:01.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:01.178+0000 7f7caec00640 1 --2- 172.21.15.112:0/3096447785 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7c8406be30 0x7f7c8406e2f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7c9800aac0 tx=0x7f7c98008040 comp rx=0 tx=0).stop 2024-09-12T02:53:01.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:01.178+0000 7f7caec00640 1 -- 172.21.15.112:0/3096447785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ca80b45d0 msgr2=0x7f7ca8152b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:01.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:01.178+0000 7f7caec00640 1 --2- 172.21.15.112:0/3096447785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ca80b45d0 0x7f7ca8152b60 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f7c90000c00 tx=0x7f7c900046c0 comp rx=0 tx=0).stop 2024-09-12T02:53:01.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:01.178+0000 7f7caec00640 1 -- 172.21.15.112:0/3096447785 shutdown_connections 2024-09-12T02:53:01.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:01.178+0000 7f7caec00640 1 --2- 172.21.15.112:0/3096447785 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7ca815b9d0 0x7f7ca815c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:01.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:01.178+0000 7f7caec00640 1 --2- 172.21.15.112:0/3096447785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ca80b45d0 0x7f7ca8152b60 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:01.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:01.178+0000 7f7caec00640 1 --2- 172.21.15.112:0/3096447785 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f7c8406be30 0x7f7c8406e2f0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:01.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:01.178+0000 7f7caec00640 1 --2- 172.21.15.112:0/3096447785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ca806eef0 0x7f7ca815def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:01.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:01.178+0000 7f7caec00640 1 -- 172.21.15.112:0/3096447785 >> 172.21.15.112:0/3096447785 conn(0x7f7ca806bbd0 msgr2=0x7f7ca80cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:01.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:01.178+0000 7f7caec00640 1 -- 172.21.15.112:0/3096447785 shutdown_connections 2024-09-12T02:53:01.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:01.178+0000 7f7caec00640 1 -- 172.21.15.112:0/3096447785 wait complete. 2024-09-12T02:53:01.195 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:53:01.195 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:53:01.195 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-09-12T02:53:01.195 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:53:01.195 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:53:01.195 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:53:01.195 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:53:01.195 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:53:01.195 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:53:01.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:01.196 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-09-12T02:53:01.231 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:53:01.231 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:53:01.231 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:53:01.231 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:53:01.231 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-12T02:53:01.231 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:53:01.231 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:53:01.232 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-09-12T02:53:01.232 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-09-12T02:53:01.232 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:53:01.232 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-09-12T02:53:01.232 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-09-12T02:53:01.232 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:53:01.232 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:53:01.232 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:53:01.232 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:53:01.232 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:53:01.232 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42097sec preferred_lft 42097sec 2024-09-12T02:53:01.232 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link noprefixroute 2024-09-12T02:53:01.232 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:53:01.233 INFO:teuthology.orchestra.run.smithi112.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:53:01.233 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 4e:56:d4:fc:33:ba brd ff:ff:ff:ff:ff:ff 2024-09-12T02:53:01.233 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:53:01.233 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:53:01.233 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::787f:67ff:fe10:c915/64 scope link 2024-09-12T02:53:01.233 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:53:01.233 INFO:teuthology.orchestra.run.smithi112.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:53:01.233 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 4e:56:d4:fc:33:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:53:01.233 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::4c56:d4ff:fefc:33ba/64 scope link 2024-09-12T02:53:01.233 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:53:01.233 INFO:teuthology.orchestra.run.smithi112.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:53:01.233 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 86:ed:0e:b6:37:5f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:53:01.233 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::84ed:eff:feb6:375f/64 scope link 2024-09-12T02:53:01.234 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:53:01.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:01.235 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:53:01.328 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-12T02:53:01.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:01.331 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-09-12T02:53:01.367 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-09-12T02:53:01.367 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:53:01.367 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:53:01.367 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:53:01.367 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:53:01.367 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:53:01.367 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-12T02:53:01.367 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:53:01.367 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:53:01.368 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:53:01.368 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-12T02:53:01.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:53:01.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:53:01.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:01.562 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-12T02:53:01.597 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:53:01.598 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:53:01.598 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:53:01.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:01.598 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2024-09-12T02:53:01.694 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:53:01.694 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:53:01.728 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:53:01.729 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:53:01.729 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:53:01.803 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T02:53:01.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:01.803 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:53:01.932 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:53:01.932 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:53:01.959 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:53:01.959 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:53:01.959 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-09-12T02:53:01.959 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 0@7c01f3b3-dec2-4449-a33f-f960d7527ea6.cephfs=/ 2024-09-12T02:53:01.959 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.112:3300/172.21.15.137:3300/172.21.15.137:3301" will pass to kernel 2024-09-12T02:53:01.960 INFO:teuthology.orchestra.run.smithi112.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:53:01.960 INFO:teuthology.orchestra.run.smithi112.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:53:01.960 INFO:teuthology.orchestra.run.smithi112.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:53:01.960 INFO:teuthology.orchestra.run.smithi112.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:53:01.960 INFO:teuthology.orchestra.run.smithi112.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:53:01.963 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:53:01.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:01.964 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:53:02.020 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:53:02.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:53:02.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:53:02.118 INFO:teuthology.orchestra.run.smithi112.stdout:client7995 2024-09-12T02:53:02.118 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:53:02.119 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:53:02.153 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:53:02.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.345+0000 7f3525c00640 1 Processor -- start 2024-09-12T02:53:02.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.345+0000 7f3525c00640 1 -- start start 2024-09-12T02:53:02.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.346+0000 7f3525c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f352015cc50 0x7f35200732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:02.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.346+0000 7f3525c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3520073830 con 0x7f3520071530 2024-09-12T02:53:02.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.347+0000 7f3525c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35200ceeb0 con 0x7f35200afe30 2024-09-12T02:53:02.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.347+0000 7f3525c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f352015d030 con 0x7f352015cc50 2024-09-12T02:53:02.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.347+0000 7f351e000640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f3520071530 0x7f35200af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58890/0 (socket says 172.21.15.112:58890) 2024-09-12T02:53:02.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.347+0000 7f351e000640 1 -- 172.21.15.112:0/606461859 learned_addr learned my addr 172.21.15.112:0/606461859 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:53:02.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.347+0000 7f351ea00640 1 --2- 172.21.15.112:0/606461859 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f352015cc50 0x7f35200732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:02.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.347+0000 7f351d600640 1 -- 172.21.15.112:0/606461859 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1598577607 0 0) 0x7f350c001290 con 0x7f3520071530 2024-09-12T02:53:02.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.347+0000 7f351d600640 1 -- 172.21.15.112:0/606461859 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3504003520 con 0x7f3520071530 2024-09-12T02:53:02.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.347+0000 7f351d600640 1 -- 172.21.15.112:0/606461859 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3903771630 0 0) 0x7f3504003520 con 0x7f3520071530 2024-09-12T02:53:02.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.348+0000 7f351d600640 1 -- 172.21.15.112:0/606461859 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f352015cc50 msgr2=0x7f35200732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:02.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.348+0000 7f351d600640 1 --2- 172.21.15.112:0/606461859 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f352015cc50 0x7f35200732f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:02.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.348+0000 7f351d600640 1 -- 172.21.15.112:0/606461859 >> v1:172.21.15.137:6789/0 conn(0x7f35200afe30 legacy=0x7f35200cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:02.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.348+0000 7f351d600640 1 -- 172.21.15.112:0/606461859 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f352006e300 con 0x7f3520071530 2024-09-12T02:53:02.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.348+0000 7f351d600640 1 -- 172.21.15.112:0/606461859 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f350c0019c0 con 0x7f3520071530 2024-09-12T02:53:02.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.348+0000 7f351d600640 1 -- 172.21.15.112:0/606461859 >> v1:172.21.15.112:6789/0 conn(0x7f3520071530 legacy=0x7f35200af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:02.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.348+0000 7f351d600640 1 --2- 172.21.15.112:0/606461859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35040039e0 0x7f3504003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:02.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.348+0000 7f351d600640 1 --2- 172.21.15.112:0/606461859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3504004800 0x7f3504004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:02.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.348+0000 7f351d600640 1 --2- 172.21.15.112:0/606461859 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f352015cc50 0x7f3504005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:02.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.348+0000 7f351d600640 1 -- 172.21.15.112:0/606461859 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f350400bac0 con 0x7f3504004800 2024-09-12T02:53:02.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.348+0000 7f351d600640 1 -- 172.21.15.112:0/606461859 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f350400bc70 con 0x7f35040039e0 2024-09-12T02:53:02.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.348+0000 7f351d600640 1 -- 172.21.15.112:0/606461859 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f350400be70 con 0x7f352015cc50 2024-09-12T02:53:02.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.348+0000 7f351ea00640 1 --2- 172.21.15.112:0/606461859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35040039e0 0x7f3504003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:02.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.348+0000 7f351e000640 1 --2- 172.21.15.112:0/606461859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3504004800 0x7f3504004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:02.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.348+0000 7f351f400640 1 --2- 172.21.15.112:0/606461859 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f352015cc50 0x7f3504005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:02.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.348+0000 7f351e000640 1 -- 172.21.15.112:0/606461859 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f352015cc50 msgr2=0x7f3504005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:02.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.348+0000 7f351e000640 1 --2- 172.21.15.112:0/606461859 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f352015cc50 0x7f3504005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:02.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.348+0000 7f351e000640 1 -- 172.21.15.112:0/606461859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35040039e0 msgr2=0x7f3504003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:02.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.348+0000 7f351e000640 1 --2- 172.21.15.112:0/606461859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35040039e0 0x7f3504003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:02.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.348+0000 7f351e000640 1 -- 172.21.15.112:0/606461859 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3504003520 con 0x7f3504004800 2024-09-12T02:53:02.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.349+0000 7f351e000640 1 --2- 172.21.15.112:0/606461859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3504004800 0x7f3504004c80 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f350c00c490 tx=0x7f3504005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d50e72ec7affa8e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:02.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.350+0000 7f351d600640 1 -- 172.21.15.112:0/606461859 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c00c0e0 con 0x7f3504004800 2024-09-12T02:53:02.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.350+0000 7f351d600640 1 -- 172.21.15.112:0/606461859 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f350c034070 con 0x7f3504004800 2024-09-12T02:53:02.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.350+0000 7f351d600640 1 -- 172.21.15.112:0/606461859 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c0074d0 con 0x7f3504004800 2024-09-12T02:53:02.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.350+0000 7f3525c00640 1 -- 172.21.15.112:0/606461859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3504004800 msgr2=0x7f3504004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:02.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.350+0000 7f3525c00640 1 --2- 172.21.15.112:0/606461859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3504004800 0x7f3504004c80 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f350c00c490 tx=0x7f3504005830 comp rx=0 tx=0).stop 2024-09-12T02:53:02.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.350+0000 7f351f400640 1 -- 172.21.15.112:0/606461859 reap_dead start 2024-09-12T02:53:02.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.350+0000 7f3525c00640 1 -- 172.21.15.112:0/606461859 shutdown_connections 2024-09-12T02:53:02.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.350+0000 7f3525c00640 1 -- 172.21.15.112:0/606461859 >> 172.21.15.112:0/606461859 conn(0x7f352006bbd0 msgr2=0x7f352006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:02.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.350+0000 7f3525c00640 1 -- 172.21.15.112:0/606461859 shutdown_connections 2024-09-12T02:53:02.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.350+0000 7f3525c00640 1 -- 172.21.15.112:0/606461859 wait complete. 2024-09-12T02:53:02.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.352+0000 7f3525c00640 1 Processor -- start 2024-09-12T02:53:02.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.352+0000 7f3525c00640 1 -- start start 2024-09-12T02:53:02.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.353+0000 7f3525c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3504004800 0x7f352014e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:02.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.353+0000 7f3525c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35201523e0 0x7f35201502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:02.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.353+0000 7f3525c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3520150800 0x7f35201f6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:02.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.353+0000 7f3525c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f35200cf150 con 0x7f35201523e0 2024-09-12T02:53:02.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.353+0000 7f3525c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f35200cf4c0 con 0x7f3520150800 2024-09-12T02:53:02.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.353+0000 7f3525c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f352006f510 con 0x7f3504004800 2024-09-12T02:53:02.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.353+0000 7f351e000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35201523e0 0x7f35201502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:02.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.353+0000 7f351ea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3504004800 0x7f352014e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:02.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.354+0000 7f351ea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3504004800 0x7f352014e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:54036/0 (socket says 172.21.15.112:54036) 2024-09-12T02:53:02.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.354+0000 7f351e000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35201523e0 0x7f35201502c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52004/0 (socket says 172.21.15.112:52004) 2024-09-12T02:53:02.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.354+0000 7f351ea00640 1 -- 172.21.15.112:0/1841431094 learned_addr learned my addr 172.21.15.112:0/1841431094 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:02.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.354+0000 7f351f400640 1 --2- 172.21.15.112:0/1841431094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3520150800 0x7f35201f6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:02.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.354+0000 7f351e000640 1 -- 172.21.15.112:0/1841431094 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3504004800 msgr2=0x7f352014e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:02.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.354+0000 7f351e000640 1 --2- 172.21.15.112:0/1841431094 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3504004800 0x7f352014e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:02.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.354+0000 7f351e000640 1 -- 172.21.15.112:0/1841431094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3520150800 msgr2=0x7f35201f6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:02.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.354+0000 7f351e000640 1 --2- 172.21.15.112:0/1841431094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3520150800 0x7f35201f6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:02.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.354+0000 7f351e000640 1 -- 172.21.15.112:0/1841431094 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3520160f90 con 0x7f35201523e0 2024-09-12T02:53:02.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.354+0000 7f351ea00640 1 --2- 172.21.15.112:0/1841431094 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3504004800 0x7f352014e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:53:02.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.354+0000 7f351e000640 1 --2- 172.21.15.112:0/1841431094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35201523e0 0x7f35201502c0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f350c030000 tx=0x7f352006e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:02.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.355+0000 7f3516a00640 1 -- 172.21.15.112:0/1841431094 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c007800 con 0x7f35201523e0 2024-09-12T02:53:02.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.355+0000 7f3516a00640 1 -- 172.21.15.112:0/1841431094 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f350c0059a0 con 0x7f35201523e0 2024-09-12T02:53:02.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.355+0000 7f3516a00640 1 -- 172.21.15.112:0/1841431094 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c005d70 con 0x7f35201523e0 2024-09-12T02:53:02.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.355+0000 7f3525c00640 1 -- 172.21.15.112:0/1841431094 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3520152d50 con 0x7f35201523e0 2024-09-12T02:53:02.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.355+0000 7f3525c00640 1 -- 172.21.15.112:0/1841431094 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35201f6a50 con 0x7f35201523e0 2024-09-12T02:53:02.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.356+0000 7f3525c00640 1 -- 172.21.15.112:0/1841431094 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3520068a30 con 0x7f35201523e0 2024-09-12T02:53:02.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.357+0000 7f3516a00640 1 -- 172.21.15.112:0/1841431094 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f350c02e070 con 0x7f35201523e0 2024-09-12T02:53:02.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.358+0000 7f3516a00640 1 --2- 172.21.15.112:0/1841431094 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f350006be60 0x7f350006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:02.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.358+0000 7f3516a00640 1 -- 172.21.15.112:0/1841431094 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f350c0ab4d0 con 0x7f35201523e0 2024-09-12T02:53:02.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.358+0000 7f351ea00640 1 --2- 172.21.15.112:0/1841431094 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f350006be60 0x7f350006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:02.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.359+0000 7f351ea00640 1 --2- 172.21.15.112:0/1841431094 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f350006be60 0x7f350006e320 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f3510003d20 tx=0x7f351000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:02.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.363+0000 7f3516a00640 1 -- 172.21.15.112:0/1841431094 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f350c02c040 con 0x7f35201523e0 2024-09-12T02:53:02.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.569+0000 7f3525c00640 1 -- 172.21.15.112:0/1841431094 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f352006df60 con 0x7f35201523e0 2024-09-12T02:53:02.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.570+0000 7f3516a00640 1 -- 172.21.15.112:0/1841431094 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v94) ==== 53+0+73 (secure 0 0 0) 0x7f3520073830 con 0x7f35201523e0 2024-09-12T02:53:02.571 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:53:02.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.572+0000 7f3525c00640 1 -- 172.21.15.112:0/1841431094 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f350006be60 msgr2=0x7f350006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:02.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.572+0000 7f3525c00640 1 --2- 172.21.15.112:0/1841431094 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f350006be60 0x7f350006e320 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f3510003d20 tx=0x7f351000b040 comp rx=0 tx=0).stop 2024-09-12T02:53:02.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.572+0000 7f3525c00640 1 -- 172.21.15.112:0/1841431094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35201523e0 msgr2=0x7f35201502c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:02.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.572+0000 7f3525c00640 1 --2- 172.21.15.112:0/1841431094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35201523e0 0x7f35201502c0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f350c030000 tx=0x7f352006e4d0 comp rx=0 tx=0).stop 2024-09-12T02:53:02.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.572+0000 7f3525c00640 1 -- 172.21.15.112:0/1841431094 shutdown_connections 2024-09-12T02:53:02.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.572+0000 7f3525c00640 1 --2- 172.21.15.112:0/1841431094 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f350006be60 0x7f350006e320 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:02.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.572+0000 7f3525c00640 1 --2- 172.21.15.112:0/1841431094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3520150800 0x7f35201f6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:02.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.572+0000 7f3525c00640 1 --2- 172.21.15.112:0/1841431094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35201523e0 0x7f35201502c0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:02.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.572+0000 7f3525c00640 1 --2- 172.21.15.112:0/1841431094 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3504004800 0x7f352014e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:02.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.572+0000 7f3525c00640 1 -- 172.21.15.112:0/1841431094 >> 172.21.15.112:0/1841431094 conn(0x7f352006bbd0 msgr2=0x7f352006e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:02.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.572+0000 7f3525c00640 1 -- 172.21.15.112:0/1841431094 shutdown_connections 2024-09-12T02:53:02.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:02.572+0000 7f3525c00640 1 -- 172.21.15.112:0/1841431094 wait complete. 2024-09-12T02:53:02.588 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:53:02.588 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:53:02.588 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-09-12T02:53:02.588 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T02:53:02.588 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T02:53:02.589 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:53:02.589 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T02:53:02.589 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:53:02.589 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:53:02.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:02.589 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-09-12T02:53:02.629 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:53:02.629 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:53:02.629 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:53:02.629 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:53:02.629 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-09-12T02:53:02.629 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:53:02.630 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:53:02.630 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-09-12T02:53:02.630 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-09-12T02:53:02.630 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:53:02.630 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-09-12T02:53:02.630 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-09-12T02:53:02.630 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:53:02.630 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:53:02.630 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:53:02.630 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:53:02.630 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:53:02.630 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42096sec preferred_lft 42096sec 2024-09-12T02:53:02.630 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::ec4:7aff:fe88:8137/64 scope link noprefixroute 2024-09-12T02:53:02.631 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:53:02.631 INFO:teuthology.orchestra.run.smithi137.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T02:53:02.631 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 62:9a:8e:f1:56:55 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:53:02.631 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T02:53:02.631 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:53:02.631 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::30c8:13ff:fe15:f79d/64 scope link 2024-09-12T02:53:02.631 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:53:02.631 INFO:teuthology.orchestra.run.smithi137.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:53:02.631 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 62:9a:8e:f1:56:55 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:53:02.631 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::609a:8eff:fef1:5655/64 scope link 2024-09-12T02:53:02.631 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:53:02.631 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T02:53:02.631 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 96:f4:ca:17:88:2a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T02:53:02.632 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::94f4:caff:fe17:882a/64 scope link 2024-09-12T02:53:02.632 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:53:02.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:02.633 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:53:02.730 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-09-12T02:53:02.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:02.733 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-09-12T02:53:02.772 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-09-12T02:53:02.773 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:53:02.773 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:53:02.773 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:53:02.773 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:53:02.773 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:53:02.773 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-09-12T02:53:02.773 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:53:02.773 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:53:02.773 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:53:02.773 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-09-12T02:53:02.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:53:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:53:02.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:53:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:53:02.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:02.969 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-09-12T02:53:03.005 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T02:53:03.005 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T02:53:03.005 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:53:03.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:03.006 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-09-12T02:53:03.101 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:53:03.101 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T02:53:03.136 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:53:03.137 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:53:03.137 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T02:53:03.210 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-12T02:53:03.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:03.211 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:53:03.338 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:53:03.339 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:53:03.365 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:53:03.365 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:53:03.365 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-09-12T02:53:03.365 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with new device syntax: 1@7c01f3b3-dec2-4449-a33f-f960d7527ea6.cephfs=/ 2024-09-12T02:53:03.365 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.112:3300/172.21.15.137:3300/172.21.15.137:3301" will pass to kernel 2024-09-12T02:53:03.367 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-12T02:53:03.368 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:53:03.368 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:53:03.368 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:53:03.368 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:53:03.371 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:53:03.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:03.371 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T02:53:03.426 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:53:03.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:53:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:53:03.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-12T02:53:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:53:03.515 INFO:teuthology.orchestra.run.smithi137.stdout:client6563 2024-09-12T02:53:03.516 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:53:03.516 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:53:03.551 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:53:03.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.707+0000 7f02fbe00640 1 Processor -- start 2024-09-12T02:53:03.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.707+0000 7f02fbe00640 1 -- start start 2024-09-12T02:53:03.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.708+0000 7f02fbe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f02fc15c800 0x7f02fc0708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:03.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.708+0000 7f02fbe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02fc0b0770 0x7f02fc15f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:03.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.708+0000 7f02fbe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f02fc15fd00 0x7f02fc0b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:03.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.708+0000 7f02fbe00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f02fc0b0c70 con 0x7f02fc15fd00 2024-09-12T02:53:03.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.708+0000 7f02fbe00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f02fc0b0f50 con 0x7f02fc15c800 2024-09-12T02:53:03.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.708+0000 7f02fbe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f02fc0b1230 con 0x7f02fc0b0770 2024-09-12T02:53:03.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.708+0000 7f02fb400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f02fc15fd00 0x7f02fc0b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:03.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.708+0000 7f02fb400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f02fc15fd00 0x7f02fc0b4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52010/0 (socket says 172.21.15.112:52010) 2024-09-12T02:53:03.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.708+0000 7f02fb400640 1 -- 172.21.15.112:0/4047758395 learned_addr learned my addr 172.21.15.112:0/4047758395 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:03.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.708+0000 7f02faa00640 1 --2- 172.21.15.112:0/4047758395 >> v2:172.21.15.137:3300/0 conn(0x7f02fc15c800 0x7f02fc0708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:03.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.709+0000 7f02f2000640 1 --2- 172.21.15.112:0/4047758395 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02fc0b0770 0x7f02fc15f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:03.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.709+0000 7f02fb400640 1 -- 172.21.15.112:0/4047758395 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02fc0b0770 msgr2=0x7f02fc15f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:03.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.709+0000 7f02fb400640 1 --2- 172.21.15.112:0/4047758395 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02fc0b0770 0x7f02fc15f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:03.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.709+0000 7f02fb400640 1 -- 172.21.15.112:0/4047758395 >> v2:172.21.15.137:3300/0 conn(0x7f02fc15c800 msgr2=0x7f02fc0708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:03.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.709+0000 7f02fb400640 1 --2- 172.21.15.112:0/4047758395 >> v2:172.21.15.137:3300/0 conn(0x7f02fc15c800 0x7f02fc0708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:03.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.709+0000 7f02fb400640 1 -- 172.21.15.112:0/4047758395 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02fc15f2a0 con 0x7f02fc15fd00 2024-09-12T02:53:03.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.710+0000 7f02fb400640 1 --2- 172.21.15.112:0/4047758395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02fc15fd00 0x7f02fc0b4ce0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f02fc073ae0 tx=0x7f02f402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ae52aaccb16a350 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:03.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.710+0000 7f02fa000640 1 -- 172.21.15.112:0/4047758395 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f4036070 con 0x7f02fc15fd00 2024-09-12T02:53:03.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.710+0000 7f02fa000640 1 -- 172.21.15.112:0/4047758395 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02f4031600 con 0x7f02fc15fd00 2024-09-12T02:53:03.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.710+0000 7f02fa000640 1 -- 172.21.15.112:0/4047758395 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f40319d0 con 0x7f02fc15fd00 2024-09-12T02:53:03.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.710+0000 7f02fbe00640 1 -- 172.21.15.112:0/4047758395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02fc15fd00 msgr2=0x7f02fc0b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:03.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.710+0000 7f02fbe00640 1 --2- 172.21.15.112:0/4047758395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02fc15fd00 0x7f02fc0b4ce0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f02fc073ae0 tx=0x7f02f402a610 comp rx=0 tx=0).stop 2024-09-12T02:53:03.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.710+0000 7f02fbe00640 1 -- 172.21.15.112:0/4047758395 shutdown_connections 2024-09-12T02:53:03.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.710+0000 7f02fbe00640 1 --2- 172.21.15.112:0/4047758395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02fc15fd00 0x7f02fc0b4ce0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:03.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.710+0000 7f02fbe00640 1 --2- 172.21.15.112:0/4047758395 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02fc0b0770 0x7f02fc15f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:03.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.710+0000 7f02fbe00640 1 --2- 172.21.15.112:0/4047758395 >> v2:172.21.15.137:3300/0 conn(0x7f02fc15c800 0x7f02fc0708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:03.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.710+0000 7f02fbe00640 1 -- 172.21.15.112:0/4047758395 >> 172.21.15.112:0/4047758395 conn(0x7f02fc06cce0 msgr2=0x7f02fc06d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:03.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.711+0000 7f02fbe00640 1 -- 172.21.15.112:0/4047758395 shutdown_connections 2024-09-12T02:53:03.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.711+0000 7f02fbe00640 1 -- 172.21.15.112:0/4047758395 wait complete. 2024-09-12T02:53:03.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.712+0000 7f02fbe00640 1 Processor -- start 2024-09-12T02:53:03.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.712+0000 7f02fbe00640 1 -- start start 2024-09-12T02:53:03.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.713+0000 7f02fbe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02fc0b0770 0x7f02fc144d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:03.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.713+0000 7f02fbe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02fc15c800 0x7f02fc1613d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:03.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.713+0000 7f02fbe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02fc15fd00 0x7f02fc0b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:03.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.713+0000 7f02fbe00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f02fc0b5220 con 0x7f02fc15fd00 2024-09-12T02:53:03.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.713+0000 7f02fbe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f02fc06f3f0 con 0x7f02fc0b0770 2024-09-12T02:53:03.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.713+0000 7f02fbe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f02fc0b53a0 con 0x7f02fc15c800 2024-09-12T02:53:03.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.713+0000 7f02fb400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02fc15fd00 0x7f02fc0b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:03.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.713+0000 7f02fb400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02fc15fd00 0x7f02fc0b2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52026/0 (socket says 172.21.15.112:52026) 2024-09-12T02:53:03.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.713+0000 7f02fb400640 1 -- 172.21.15.112:0/4053473617 learned_addr learned my addr 172.21.15.112:0/4053473617 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:03.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.713+0000 7f02faa00640 1 --2- 172.21.15.112:0/4053473617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02fc0b0770 0x7f02fc144d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:03.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.713+0000 7f02f2000640 1 --2- 172.21.15.112:0/4053473617 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02fc15c800 0x7f02fc1613d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:03.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.714+0000 7f02fb400640 1 -- 172.21.15.112:0/4053473617 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02fc15c800 msgr2=0x7f02fc1613d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:03.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.714+0000 7f02fb400640 1 --2- 172.21.15.112:0/4053473617 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02fc15c800 0x7f02fc1613d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:03.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.714+0000 7f02fb400640 1 -- 172.21.15.112:0/4053473617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02fc0b0770 msgr2=0x7f02fc144d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:03.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.714+0000 7f02fb400640 1 --2- 172.21.15.112:0/4053473617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02fc0b0770 0x7f02fc144d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:03.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.714+0000 7f02fb400640 1 -- 172.21.15.112:0/4053473617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02fc1f4620 con 0x7f02fc15fd00 2024-09-12T02:53:03.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.714+0000 7f02fb400640 1 --2- 172.21.15.112:0/4053473617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02fc15fd00 0x7f02fc0b2af0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f02f4009f40 tx=0x7f02f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:03.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.714+0000 7f02f3400640 1 -- 172.21.15.112:0/4053473617 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f403f020 con 0x7f02fc15fd00 2024-09-12T02:53:03.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.714+0000 7f02f3400640 1 -- 172.21.15.112:0/4053473617 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02f4037040 con 0x7f02fc15fd00 2024-09-12T02:53:03.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.714+0000 7f02f3400640 1 -- 172.21.15.112:0/4053473617 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f4036070 con 0x7f02fc15fd00 2024-09-12T02:53:03.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.714+0000 7f02fbe00640 1 -- 172.21.15.112:0/4053473617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02fc160330 con 0x7f02fc15fd00 2024-09-12T02:53:03.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.715+0000 7f02fbe00640 1 -- 172.21.15.112:0/4053473617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02fc1608f0 con 0x7f02fc15fd00 2024-09-12T02:53:03.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.715+0000 7f02fbe00640 1 -- 172.21.15.112:0/4053473617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02fc15f7c0 con 0x7f02fc15fd00 2024-09-12T02:53:03.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.716+0000 7f02f3400640 1 -- 172.21.15.112:0/4053473617 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f02f4042020 con 0x7f02fc15fd00 2024-09-12T02:53:03.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.717+0000 7f02f3400640 1 --2- 172.21.15.112:0/4053473617 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f02d806be30 0x7f02d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:03.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.717+0000 7f02f3400640 1 -- 172.21.15.112:0/4053473617 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f02f40ab1b0 con 0x7f02fc15fd00 2024-09-12T02:53:03.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.717+0000 7f02faa00640 1 --2- 172.21.15.112:0/4053473617 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f02d806be30 0x7f02d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:03.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.718+0000 7f02faa00640 1 --2- 172.21.15.112:0/4053473617 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f02d806be30 0x7f02d806e2f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f02ec006fd0 tx=0x7f02ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:03.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.722+0000 7f02f3400640 1 -- 172.21.15.112:0/4053473617 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f02f4049030 con 0x7f02fc15fd00 2024-09-12T02:53:03.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.929+0000 7f02fbe00640 1 -- 172.21.15.112:0/4053473617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02fc0727c0 con 0x7f02fc15fd00 2024-09-12T02:53:03.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.930+0000 7f02f3400640 1 -- 172.21.15.112:0/4053473617 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5233 (secure 0 0 0) 0x7f02f4079500 con 0x7f02fc15fd00 2024-09-12T02:53:03.931 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:53:03.931 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":94,"btime":"2024-09-12T02:52:57:752799+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7177,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/119222923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":119222923},{"type":"v1","addr":"172.21.15.112:6837","nonce":119222923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7180,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/691058370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":691058370},{"type":"v1","addr":"172.21.15.137:6834","nonce":691058370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7854,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/1978579863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1978579863},{"type":"v1","addr":"172.21.15.112:6836","nonce":1978579863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:52:54.149640+0000","modified":"2024-09-12T02:52:57.153816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7860},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7860":{"gid":7860,"name":"b","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/1283773082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1283773082},{"type":"v1","addr":"172.21.15.137:6835","nonce":1283773082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7860,"qdb_cluster":[7860]},"id":11}]} 2024-09-12T02:53:03.931 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 94 2024-09-12T02:53:03.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.932+0000 7f02fbe00640 1 -- 172.21.15.112:0/4053473617 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f02d806be30 msgr2=0x7f02d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:03.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.932+0000 7f02fbe00640 1 --2- 172.21.15.112:0/4053473617 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f02d806be30 0x7f02d806e2f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f02ec006fd0 tx=0x7f02ec008040 comp rx=0 tx=0).stop 2024-09-12T02:53:03.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.932+0000 7f02fbe00640 1 -- 172.21.15.112:0/4053473617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02fc15fd00 msgr2=0x7f02fc0b2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:03.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.932+0000 7f02fbe00640 1 --2- 172.21.15.112:0/4053473617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02fc15fd00 0x7f02fc0b2af0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f02f4009f40 tx=0x7f02f4004a40 comp rx=0 tx=0).stop 2024-09-12T02:53:03.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.932+0000 7f02fbe00640 1 -- 172.21.15.112:0/4053473617 shutdown_connections 2024-09-12T02:53:03.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.932+0000 7f02fbe00640 1 --2- 172.21.15.112:0/4053473617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02fc15fd00 0x7f02fc0b2af0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:03.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.932+0000 7f02fbe00640 1 --2- 172.21.15.112:0/4053473617 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02fc15c800 0x7f02fc1613d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:03.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.932+0000 7f02fbe00640 1 --2- 172.21.15.112:0/4053473617 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f02d806be30 0x7f02d806e2f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:03.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.932+0000 7f02fbe00640 1 --2- 172.21.15.112:0/4053473617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02fc0b0770 0x7f02fc144d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:03.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.932+0000 7f02fbe00640 1 -- 172.21.15.112:0/4053473617 >> 172.21.15.112:0/4053473617 conn(0x7f02fc06cce0 msgr2=0x7f02fc06bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:03.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.932+0000 7f02fbe00640 1 -- 172.21.15.112:0/4053473617 shutdown_connections 2024-09-12T02:53:03.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:03.932+0000 7f02fbe00640 1 -- 172.21.15.112:0/4053473617 wait complete. 2024-09-12T02:53:03.949 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2024-09-12T02:53:04.121 INFO:teuthology.orchestra.run.smithi137.stdout:{"cluster_fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","whoami":0,"id":7860,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.3781134529999992,"mdsmap_epoch":94,"osdmap_epoch":183,"osdmap_epoch_barrier":183,"uptime":14.456529668} 2024-09-12T02:53:04.122 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", "fs_name": "cephfs", "id": 7860, "mdsmap_epoch": 94, "osdmap_epoch": 183, "osdmap_epoch_barrier": 183, "rank_uptime": 9.378113453, "state": "up:active", "uptime": 14.456529668, "want_state": "up:active", "whoami": 0 } 2024-09-12T02:53:04.122 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2024-09-12T02:53:04.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.276+0000 7f2044a00640 1 Processor -- start 2024-09-12T02:53:04.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.276+0000 7f2044a00640 1 -- start start 2024-09-12T02:53:04.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.278+0000 7f2044a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f20400d1270 0x7f20400723d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:04.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.278+0000 7f2044a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2040072910 0x7f204006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:04.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.278+0000 7f2044a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2040071630 con 0x7f2040158fb0 2024-09-12T02:53:04.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.278+0000 7f2044a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2040071f40 con 0x7f20400d1270 2024-09-12T02:53:04.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.278+0000 7f2044a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f20400d1810 con 0x7f2040072910 2024-09-12T02:53:04.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.278+0000 7f203d400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f20400d1270 0x7f20400723d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:04.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.278+0000 7f203d400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f20400d1270 0x7f20400723d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52036/0 (socket says 172.21.15.112:52036) 2024-09-12T02:53:04.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.278+0000 7f203d400640 1 -- 172.21.15.112:0/2339636798 learned_addr learned my addr 172.21.15.112:0/2339636798 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:04.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.278+0000 7f203e800640 1 --2- 172.21.15.112:0/2339636798 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2040072910 0x7f204006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:04.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.278+0000 7f203d400640 1 -- 172.21.15.112:0/2339636798 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2040072910 msgr2=0x7f204006d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:04.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.278+0000 7f203d400640 1 --2- 172.21.15.112:0/2339636798 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2040072910 0x7f204006d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:04.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.278+0000 7f203d400640 1 -- 172.21.15.112:0/2339636798 >> v1:172.21.15.137:6789/0 conn(0x7f2040158fb0 legacy=0x7f204015c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:04.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.278+0000 7f203d400640 1 -- 172.21.15.112:0/2339636798 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20400718f0 con 0x7f20400d1270 2024-09-12T02:53:04.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.279+0000 7f203d400640 1 --2- 172.21.15.112:0/2339636798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20400d1270 0x7f20400723d0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f202c009870 tx=0x7f202c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2dffdaa53915e0d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:04.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.280+0000 7f203ca00640 1 -- 172.21.15.112:0/2339636798 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c037070 con 0x7f20400d1270 2024-09-12T02:53:04.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.280+0000 7f203ca00640 1 -- 172.21.15.112:0/2339636798 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f202c032440 con 0x7f20400d1270 2024-09-12T02:53:04.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.280+0000 7f203ca00640 1 -- 172.21.15.112:0/2339636798 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c032810 con 0x7f20400d1270 2024-09-12T02:53:04.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.280+0000 7f2044a00640 1 -- 172.21.15.112:0/2339636798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20400d1270 msgr2=0x7f20400723d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:04.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.280+0000 7f2044a00640 1 --2- 172.21.15.112:0/2339636798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20400d1270 0x7f20400723d0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f202c009870 tx=0x7f202c02a1c0 comp rx=0 tx=0).stop 2024-09-12T02:53:04.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.280+0000 7f2044a00640 1 -- 172.21.15.112:0/2339636798 shutdown_connections 2024-09-12T02:53:04.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.280+0000 7f2044a00640 1 --2- 172.21.15.112:0/2339636798 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2040072910 0x7f204006d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:04.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.280+0000 7f2044a00640 1 --2- 172.21.15.112:0/2339636798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20400d1270 0x7f20400723d0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:04.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.280+0000 7f2044a00640 1 -- 172.21.15.112:0/2339636798 >> 172.21.15.112:0/2339636798 conn(0x7f20400b2730 msgr2=0x7f20400b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:04.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.280+0000 7f2044a00640 1 -- 172.21.15.112:0/2339636798 shutdown_connections 2024-09-12T02:53:04.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.280+0000 7f2044a00640 1 -- 172.21.15.112:0/2339636798 wait complete. 2024-09-12T02:53:04.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.282+0000 7f2044a00640 1 Processor -- start 2024-09-12T02:53:04.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.282+0000 7f2044a00640 1 -- start start 2024-09-12T02:53:04.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.283+0000 7f2044a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2040072910 0x7f20400cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:04.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.283+0000 7f2044a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20400d1270 0x7f204014d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:04.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.283+0000 7f2044a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2040151af0 0x7f204014f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:04.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.283+0000 7f2044a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f204006da70 con 0x7f2040151af0 2024-09-12T02:53:04.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.283+0000 7f2044a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f204006d8f0 con 0x7f20400d1270 2024-09-12T02:53:04.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.283+0000 7f2044a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f204006dbf0 con 0x7f2040072910 2024-09-12T02:53:04.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.283+0000 7f203e800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2040151af0 0x7f204014f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:04.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.283+0000 7f203d400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20400d1270 0x7f204014d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:04.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.283+0000 7f203de00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2040072910 0x7f20400cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:04.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.283+0000 7f203e800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2040151af0 0x7f204014f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52040/0 (socket says 172.21.15.112:52040) 2024-09-12T02:53:04.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.283+0000 7f203e800640 1 -- 172.21.15.112:0/2706875929 learned_addr learned my addr 172.21.15.112:0/2706875929 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:04.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.283+0000 7f203e800640 1 -- 172.21.15.112:0/2706875929 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2040072910 msgr2=0x7f20400cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:04.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.283+0000 7f203e800640 1 --2- 172.21.15.112:0/2706875929 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2040072910 0x7f20400cfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:04.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.283+0000 7f203e800640 1 -- 172.21.15.112:0/2706875929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20400d1270 msgr2=0x7f204014d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:04.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.284+0000 7f203e800640 1 --2- 172.21.15.112:0/2706875929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20400d1270 0x7f204014d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:04.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.284+0000 7f203e800640 1 -- 172.21.15.112:0/2706875929 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20400d04b0 con 0x7f2040151af0 2024-09-12T02:53:04.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.284+0000 7f203d400640 1 --2- 172.21.15.112:0/2706875929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20400d1270 0x7f204014d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:53:04.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.284+0000 7f203e800640 1 --2- 172.21.15.112:0/2706875929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2040151af0 0x7f204014f770 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f203800e820 tx=0x7f203800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:04.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.284+0000 7f2036000640 1 -- 172.21.15.112:0/2706875929 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2038017070 con 0x7f2040151af0 2024-09-12T02:53:04.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.284+0000 7f2036000640 1 -- 172.21.15.112:0/2706875929 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f203800c940 con 0x7f2040151af0 2024-09-12T02:53:04.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.284+0000 7f2044a00640 1 -- 172.21.15.112:0/2706875929 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f204015ae00 con 0x7f2040151af0 2024-09-12T02:53:04.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.284+0000 7f2036000640 1 -- 172.21.15.112:0/2706875929 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203800cd30 con 0x7f2040151af0 2024-09-12T02:53:04.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.284+0000 7f2044a00640 1 -- 172.21.15.112:0/2706875929 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f204015b3c0 con 0x7f2040151af0 2024-09-12T02:53:04.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.285+0000 7f2044a00640 1 -- 172.21.15.112:0/2706875929 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f204006d3b0 con 0x7f2040151af0 2024-09-12T02:53:04.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.286+0000 7f2036000640 1 -- 172.21.15.112:0/2706875929 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f203801a070 con 0x7f2040151af0 2024-09-12T02:53:04.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.287+0000 7f2036000640 1 --2- 172.21.15.112:0/2706875929 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f202006be30 0x7f202006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:04.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.288+0000 7f2036000640 1 -- 172.21.15.112:0/2706875929 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f203808b0d0 con 0x7f2040151af0 2024-09-12T02:53:04.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.288+0000 7f203de00640 1 --2- 172.21.15.112:0/2706875929 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f202006be30 0x7f202006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:04.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.288+0000 7f203de00640 1 --2- 172.21.15.112:0/2706875929 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f202006be30 0x7f202006e2f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f204014ed50 tx=0x7f2030009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:04.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.292+0000 7f2036000640 1 -- 172.21.15.112:0/2706875929 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2038059420 con 0x7f2040151af0 2024-09-12T02:53:04.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.466+0000 7f2044a00640 1 -- 172.21.15.112:0/2706875929 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) -- 0x7f20400ccdd0 con 0x7f2040151af0 2024-09-12T02:53:04.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.784+0000 7f2036000640 1 -- 172.21.15.112:0/2706875929 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v184) ==== 181+0+0 (secure 0 0 0) 0x7f203805d720 con 0x7f2040151af0 2024-09-12T02:53:04.785 INFO:teuthology.orchestra.run.smithi112.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2024-09-12T02:53:04.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.787+0000 7f2044a00640 1 -- 172.21.15.112:0/2706875929 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f202006be30 msgr2=0x7f202006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:04.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.787+0000 7f2044a00640 1 --2- 172.21.15.112:0/2706875929 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f202006be30 0x7f202006e2f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f204014ed50 tx=0x7f2030009040 comp rx=0 tx=0).stop 2024-09-12T02:53:04.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.787+0000 7f2044a00640 1 -- 172.21.15.112:0/2706875929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2040151af0 msgr2=0x7f204014f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:04.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.787+0000 7f2044a00640 1 --2- 172.21.15.112:0/2706875929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2040151af0 0x7f204014f770 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f203800e820 tx=0x7f203800ece0 comp rx=0 tx=0).stop 2024-09-12T02:53:04.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.787+0000 7f2044a00640 1 -- 172.21.15.112:0/2706875929 shutdown_connections 2024-09-12T02:53:04.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.787+0000 7f2044a00640 1 --2- 172.21.15.112:0/2706875929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2040151af0 0x7f204014f770 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:04.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.787+0000 7f2044a00640 1 --2- 172.21.15.112:0/2706875929 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f202006be30 0x7f202006e2f0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:04.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.787+0000 7f2044a00640 1 --2- 172.21.15.112:0/2706875929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20400d1270 0x7f204014d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:04.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.787+0000 7f2044a00640 1 --2- 172.21.15.112:0/2706875929 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2040072910 0x7f20400cfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:04.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.787+0000 7f2044a00640 1 -- 172.21.15.112:0/2706875929 >> 172.21.15.112:0/2706875929 conn(0x7f20400b2730 msgr2=0x7f2040072d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:04.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.787+0000 7f2044a00640 1 -- 172.21.15.112:0/2706875929 shutdown_connections 2024-09-12T02:53:04.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:04.787+0000 7f2044a00640 1 -- 172.21.15.112:0/2706875929 wait complete. 2024-09-12T02:53:04.806 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-12T02:53:04.973 INFO:teuthology.orchestra.run.smithi112.stdout:{"osd_mon_report_interval":"5"} 2024-09-12T02:53:04.973 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-12T02:53:04.974 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2024-09-12T02:53:04.974 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:53:04.974 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:53:05.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:05.009 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2024-09-12T02:53:05.222 INFO:teuthology.orchestra.run.smithi112.stderr:16+0 records in 2024-09-12T02:53:05.223 INFO:teuthology.orchestra.run.smithi112.stderr:16+0 records out 2024-09-12T02:53:05.223 INFO:teuthology.orchestra.run.smithi112.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.134056 s, 125 MB/s 2024-09-12T02:53:05.224 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:53:05.224 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:53:05.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:05.259 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2024-09-12T02:53:05.464 INFO:teuthology.orchestra.run.smithi112.stderr:17+0 records in 2024-09-12T02:53:05.465 INFO:teuthology.orchestra.run.smithi112.stderr:17+0 records out 2024-09-12T02:53:05.465 INFO:teuthology.orchestra.run.smithi112.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.128128 s, 139 MB/s 2024-09-12T02:53:05.466 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2024-09-12T02:53:05.466 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-12T02:53:05.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.619+0000 7f4d2a200640 1 Processor -- start 2024-09-12T02:53:05.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.619+0000 7f4d2a200640 1 -- start start 2024-09-12T02:53:05.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.620+0000 7f4d2a200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4d2406f600 0x7f4d240b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:05.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.620+0000 7f4d2a200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4d240b45d0 0x7f4d240728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:05.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.620+0000 7f4d2a200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d240b4a20 con 0x7f4d2415b9d0 2024-09-12T02:53:05.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.620+0000 7f4d2a200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4d240b54a0 con 0x7f4d240b45d0 2024-09-12T02:53:05.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.620+0000 7f4d2a200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4d240b3af0 con 0x7f4d2406f600 2024-09-12T02:53:05.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.621+0000 7f4d23e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4d240b45d0 0x7f4d240728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:05.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.621+0000 7f4d23e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4d240b45d0 0x7f4d240728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52042/0 (socket says 172.21.15.112:52042) 2024-09-12T02:53:05.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.621+0000 7f4d23e00640 1 -- 172.21.15.112:0/1145737993 learned_addr learned my addr 172.21.15.112:0/1145737993 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:05.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.621+0000 7f4d1aa00640 1 --2- 172.21.15.112:0/1145737993 >> v2:172.21.15.137:3300/0 conn(0x7f4d2406f600 0x7f4d240b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:05.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.621+0000 7f4d23e00640 1 -- 172.21.15.112:0/1145737993 >> v2:172.21.15.137:3300/0 conn(0x7f4d2406f600 msgr2=0x7f4d240b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:05.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.621+0000 7f4d23e00640 1 --2- 172.21.15.112:0/1145737993 >> v2:172.21.15.137:3300/0 conn(0x7f4d2406f600 0x7f4d240b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:05.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.621+0000 7f4d23e00640 1 -- 172.21.15.112:0/1145737993 >> v1:172.21.15.137:6789/0 conn(0x7f4d2415b9d0 legacy=0x7f4d2406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:05.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.621+0000 7f4d23e00640 1 -- 172.21.15.112:0/1145737993 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d240b3dd0 con 0x7f4d240b45d0 2024-09-12T02:53:05.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.622+0000 7f4d23e00640 1 --2- 172.21.15.112:0/1145737993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d240b45d0 0x7f4d240728c0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f4d24071200 tx=0x7f4d1c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ac135869a7ab1d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:05.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.622+0000 7f4d22a00640 1 -- 172.21.15.112:0/1145737993 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c036070 con 0x7f4d240b45d0 2024-09-12T02:53:05.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.623+0000 7f4d22a00640 1 -- 172.21.15.112:0/1145737993 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d1c031600 con 0x7f4d240b45d0 2024-09-12T02:53:05.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.623+0000 7f4d22a00640 1 -- 172.21.15.112:0/1145737993 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c0319d0 con 0x7f4d240b45d0 2024-09-12T02:53:05.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.623+0000 7f4d2a200640 1 -- 172.21.15.112:0/1145737993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d240b45d0 msgr2=0x7f4d240728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:05.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.623+0000 7f4d2a200640 1 --2- 172.21.15.112:0/1145737993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d240b45d0 0x7f4d240728c0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f4d24071200 tx=0x7f4d1c02a6a0 comp rx=0 tx=0).stop 2024-09-12T02:53:05.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.623+0000 7f4d2a200640 1 -- 172.21.15.112:0/1145737993 shutdown_connections 2024-09-12T02:53:05.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.623+0000 7f4d2a200640 1 --2- 172.21.15.112:0/1145737993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d240b45d0 0x7f4d240728c0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:05.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.623+0000 7f4d2a200640 1 --2- 172.21.15.112:0/1145737993 >> v2:172.21.15.137:3300/0 conn(0x7f4d2406f600 0x7f4d240b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:05.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.623+0000 7f4d2a200640 1 -- 172.21.15.112:0/1145737993 >> 172.21.15.112:0/1145737993 conn(0x7f4d2406bbd0 msgr2=0x7f4d2406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:05.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.623+0000 7f4d2a200640 1 -- 172.21.15.112:0/1145737993 shutdown_connections 2024-09-12T02:53:05.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.623+0000 7f4d2a200640 1 -- 172.21.15.112:0/1145737993 wait complete. 2024-09-12T02:53:05.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.625+0000 7f4d2a200640 1 Processor -- start 2024-09-12T02:53:05.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.625+0000 7f4d2a200640 1 -- start start 2024-09-12T02:53:05.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.626+0000 7f4d2a200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d2406f600 0x7f4d24157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:05.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.626+0000 7f4d2a200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d240b45d0 0x7f4d240ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:05.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.626+0000 7f4d2a200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d2415b9d0 0x7f4d240aee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:05.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.626+0000 7f4d2a200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2415bf30 con 0x7f4d240b45d0 2024-09-12T02:53:05.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.626+0000 7f4d2a200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2415bdb0 con 0x7f4d2406f600 2024-09-12T02:53:05.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.626+0000 7f4d2a200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4d240cdcd0 con 0x7f4d2415b9d0 2024-09-12T02:53:05.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.626+0000 7f4d1aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d240b45d0 0x7f4d240ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:05.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.626+0000 7f4d1aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d240b45d0 0x7f4d240ae900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52058/0 (socket says 172.21.15.112:52058) 2024-09-12T02:53:05.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.626+0000 7f4d1aa00640 1 -- 172.21.15.112:0/1005738902 learned_addr learned my addr 172.21.15.112:0/1005738902 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:05.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.626+0000 7f4d23400640 1 --2- 172.21.15.112:0/1005738902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d2406f600 0x7f4d24157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:05.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.626+0000 7f4d23e00640 1 --2- 172.21.15.112:0/1005738902 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d2415b9d0 0x7f4d240aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:05.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.626+0000 7f4d1aa00640 1 -- 172.21.15.112:0/1005738902 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d2415b9d0 msgr2=0x7f4d240aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:05.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.626+0000 7f4d1aa00640 1 --2- 172.21.15.112:0/1005738902 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d2415b9d0 0x7f4d240aee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:05.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.626+0000 7f4d1aa00640 1 -- 172.21.15.112:0/1005738902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d2406f600 msgr2=0x7f4d24157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:05.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.626+0000 7f4d1aa00640 1 --2- 172.21.15.112:0/1005738902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d2406f600 0x7f4d24157a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:05.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.626+0000 7f4d1aa00640 1 -- 172.21.15.112:0/1005738902 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d24169940 con 0x7f4d240b45d0 2024-09-12T02:53:05.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.626+0000 7f4d23400640 1 --2- 172.21.15.112:0/1005738902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d2406f600 0x7f4d24157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:53:05.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.627+0000 7f4d1aa00640 1 --2- 172.21.15.112:0/1005738902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d240b45d0 0x7f4d240ae900 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00e910 tx=0x7f4d0c00edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:05.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.627+0000 7f4d1be00640 1 -- 172.21.15.112:0/1005738902 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c017070 con 0x7f4d240b45d0 2024-09-12T02:53:05.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.627+0000 7f4d1be00640 1 -- 172.21.15.112:0/1005738902 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d0c00ca00 con 0x7f4d240b45d0 2024-09-12T02:53:05.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.627+0000 7f4d1be00640 1 -- 172.21.15.112:0/1005738902 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c00cdb0 con 0x7f4d240b45d0 2024-09-12T02:53:05.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.627+0000 7f4d2a200640 1 -- 172.21.15.112:0/1005738902 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d24158080 con 0x7f4d240b45d0 2024-09-12T02:53:05.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.627+0000 7f4d2a200640 1 -- 172.21.15.112:0/1005738902 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d24169140 con 0x7f4d240b45d0 2024-09-12T02:53:05.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.628+0000 7f4d2a200640 1 -- 172.21.15.112:0/1005738902 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d24068a30 con 0x7f4d240b45d0 2024-09-12T02:53:05.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.629+0000 7f4d1be00640 1 -- 172.21.15.112:0/1005738902 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d0c01a070 con 0x7f4d240b45d0 2024-09-12T02:53:05.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.630+0000 7f4d1be00640 1 --2- 172.21.15.112:0/1005738902 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4d0006be30 0x7f4d0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:05.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.630+0000 7f4d1be00640 1 -- 172.21.15.112:0/1005738902 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 5709+0+0 (secure 0 0 0) 0x7f4d0c08b230 con 0x7f4d240b45d0 2024-09-12T02:53:05.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.630+0000 7f4d23400640 1 --2- 172.21.15.112:0/1005738902 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4d0006be30 0x7f4d0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:05.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.631+0000 7f4d23400640 1 --2- 172.21.15.112:0/1005738902 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4d0006be30 0x7f4d0006e2f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f4d14001660 tx=0x7f4d14009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:05.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.634+0000 7f4d1be00640 1 -- 172.21.15.112:0/1005738902 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4d0c059bd0 con 0x7f4d240b45d0 2024-09-12T02:53:05.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.810+0000 7f4d2a200640 1 -- 172.21.15.112:0/1005738902 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f4d2415d6e0 con 0x7f4d240b45d0 2024-09-12T02:53:05.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.811+0000 7f4d1be00640 1 -- 172.21.15.112:0/1005738902 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v184) ==== 81+0+34318 (secure 0 0 0) 0x7f4d0c0594d0 con 0x7f4d240b45d0 2024-09-12T02:53:05.813 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:53:05.813 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:53:05.813 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 184, 2024-09-12T02:53:05.813 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:53:05.813 INFO:teuthology.orchestra.run.smithi112.stdout: "created": "2024-09-12T02:41:36.162095+0000", 2024-09-12T02:53:05.813 INFO:teuthology.orchestra.run.smithi112.stdout: "modified": "2024-09-12T02:53:04.783484+0000", 2024-09-12T02:53:05.813 INFO:teuthology.orchestra.run.smithi112.stdout: "last_up_change": "2024-09-12T02:41:42.191169+0000", 2024-09-12T02:53:05.813 INFO:teuthology.orchestra.run.smithi112.stdout: "last_in_change": "2024-09-12T02:41:39.036600+0000", 2024-09-12T02:53:05.813 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:53:05.813 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_num": 5799936, 2024-09-12T02:53:05.814 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_set": [ 2024-09-12T02:53:05.814 INFO:teuthology.orchestra.run.smithi112.stdout: "pglog_hardlimit", 2024-09-12T02:53:05.814 INFO:teuthology.orchestra.run.smithi112.stdout: "purged_snapdirs", 2024-09-12T02:53:05.814 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_deletes", 2024-09-12T02:53:05.814 INFO:teuthology.orchestra.run.smithi112.stdout: "sortbitwise" 2024-09-12T02:53:05.814 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:05.814 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_version": 4, 2024-09-12T02:53:05.814 INFO:teuthology.orchestra.run.smithi112.stdout: "full_ratio": 0.69999998807907104, 2024-09-12T02:53:05.814 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-12T02:53:05.814 INFO:teuthology.orchestra.run.smithi112.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-12T02:53:05.814 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_snapshot": "", 2024-09-12T02:53:05.814 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_max": 23, 2024-09-12T02:53:05.815 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd": 8, 2024-09-12T02:53:05.815 INFO:teuthology.orchestra.run.smithi112.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:53:05.815 INFO:teuthology.orchestra.run.smithi112.stdout: "min_compat_client": "jewel", 2024-09-12T02:53:05.815 INFO:teuthology.orchestra.run.smithi112.stdout: "require_osd_release": "squid", 2024-09-12T02:53:05.815 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_crimson": false, 2024-09-12T02:53:05.815 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-12T02:53:05.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.815 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 1, 2024-09-12T02:53:05.815 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": ".mgr", 2024-09-12T02:53:05.815 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:41:43.011599+0000", 2024-09-12T02:53:05.815 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:53:05.815 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:53:05.815 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:53:05.816 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:53:05.816 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:53:05.816 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:53:05.816 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:53:05.816 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:53:05.816 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:53:05.816 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:53:05.816 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:53:05.816 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:53:05.816 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:53:05.816 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 1, 2024-09-12T02:53:05.817 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 1, 2024-09-12T02:53:05.817 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 1, 2024-09-12T02:53:05.817 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 1, 2024-09-12T02:53:05.817 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 1, 2024-09-12T02:53:05.817 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:53:05.817 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:53:05.817 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:53:05.817 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:53:05.817 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:53:05.817 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:53:05.817 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:53:05.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.817 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "109", 2024-09-12T02:53:05.818 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:53:05.818 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:53:05.818 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:53:05.818 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:53:05.818 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:53:05.818 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:53:05.818 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:53:05.818 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:53:05.818 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:53:05.818 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:53:05.818 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:53:05.818 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:53:05.818 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:53:05.818 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:53:05.819 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:53:05.819 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:53:05.819 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:53:05.819 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:53:05.819 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:53:05.819 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:53:05.819 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:53:05.819 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:53:05.819 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:53:05.819 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:53:05.819 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:53:05.819 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:53:05.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.819 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:53:05.820 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:53:05.820 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:53:05.820 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:53:05.820 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:53:05.820 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:53:05.820 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:53:05.820 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:53:05.820 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:53:05.820 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:53:05.820 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:53:05.820 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:53:05.820 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_max": 32, 2024-09-12T02:53:05.820 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 1 2024-09-12T02:53:05.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.821 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:53:05.821 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": {} 2024-09-12T02:53:05.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.821 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:53:05.821 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:53:05.821 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 8, 2024-09-12T02:53:05.821 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 8, 2024-09-12T02:53:05.821 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 0.25, 2024-09-12T02:53:05.821 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:53:05.821 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:53:05.821 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:53:05.821 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:53:05.822 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:53:05.822 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.822 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 22, 2024-09-12T02:53:05.822 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:53:05.822 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:52:51.909503+0000", 2024-09-12T02:53:05.822 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:53:05.822 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:53:05.822 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:53:05.822 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:53:05.822 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:53:05.822 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:53:05.822 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:53:05.823 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:53:05.823 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:53:05.823 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:53:05.823 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:53:05.823 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:53:05.823 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:53:05.823 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 32, 2024-09-12T02:53:05.823 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 32, 2024-09-12T02:53:05.823 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 32, 2024-09-12T02:53:05.823 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 32, 2024-09-12T02:53:05.823 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 32, 2024-09-12T02:53:05.823 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:53:05.823 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:53:05.823 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:53:05.824 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:53:05.824 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:53:05.824 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:53:05.824 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:53:05.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.824 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "182", 2024-09-12T02:53:05.824 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:53:05.824 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:53:05.824 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:53:05.824 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:53:05.824 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:53:05.824 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:53:05.824 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:53:05.824 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:53:05.825 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:53:05.825 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:53:05.825 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:53:05.825 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:53:05.825 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:53:05.825 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:53:05.825 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:53:05.825 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:53:05.825 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:53:05.825 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:53:05.825 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:53:05.825 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:53:05.825 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:53:05.825 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:53:05.826 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:53:05.826 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:53:05.826 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:53:05.826 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:53:05.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.826 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:53:05.826 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:53:05.826 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:53:05.826 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:53:05.826 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:53:05.826 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:53:05.826 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:53:05.827 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:53:05.827 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:53:05.827 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:53:05.827 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:53:05.827 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:53:05.827 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:53:05.827 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 16, 2024-09-12T02:53:05.827 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_priority": 5 2024-09-12T02:53:05.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.827 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:53:05.827 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:53:05.827 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": "cephfs" 2024-09-12T02:53:05.827 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.828 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:53:05.828 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:53:05.828 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 2, 2024-09-12T02:53:05.828 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 2, 2024-09-12T02:53:05.828 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:53:05.828 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:53:05.828 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:53:05.828 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:53:05.828 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:53:05.828 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:53:05.828 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.829 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 23, 2024-09-12T02:53:05.829 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_data", 2024-09-12T02:53:05.829 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:52:53.146578+0000", 2024-09-12T02:53:05.829 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:53:05.829 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:53:05.829 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:53:05.829 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:53:05.829 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:53:05.829 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:53:05.829 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:53:05.829 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:53:05.829 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:53:05.829 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:53:05.830 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:53:05.830 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:53:05.830 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:53:05.830 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 64, 2024-09-12T02:53:05.830 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 64, 2024-09-12T02:53:05.830 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 64, 2024-09-12T02:53:05.830 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 64, 2024-09-12T02:53:05.830 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 64, 2024-09-12T02:53:05.830 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:53:05.830 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:53:05.830 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:53:05.830 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:53:05.830 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:53:05.831 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:53:05.831 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:53:05.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.831 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "184", 2024-09-12T02:53:05.831 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:53:05.831 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:53:05.831 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:53:05.831 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:53:05.831 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:53:05.831 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:53:05.831 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:53:05.831 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:53:05.831 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:53:05.831 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 33554432, 2024-09-12T02:53:05.832 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:53:05.832 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:53:05.832 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:53:05.832 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:53:05.832 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:53:05.832 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:53:05.832 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:53:05.832 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:53:05.832 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:53:05.832 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:53:05.832 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:53:05.832 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:53:05.832 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:53:05.833 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:53:05.833 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:53:05.833 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:53:05.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.833 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:53:05.833 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:53:05.833 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:53:05.833 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:53:05.833 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:53:05.833 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:53:05.833 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:53:05.833 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:53:05.833 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:53:05.834 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:53:05.834 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:53:05.834 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:53:05.834 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 64, 2024-09-12T02:53:05.834 INFO:teuthology.orchestra.run.smithi112.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:53:05.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.834 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:53:05.834 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:53:05.834 INFO:teuthology.orchestra.run.smithi112.stdout: "data": "cephfs" 2024-09-12T02:53:05.834 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.834 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:53:05.834 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:53:05.834 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.3799999952316284, 2024-09-12T02:53:05.835 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.3799999952316284, 2024-09-12T02:53:05.835 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:53:05.835 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-12T02:53:05.835 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-12T02:53:05.835 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:53:05.835 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:53:05.835 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:53:05.835 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.835 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.835 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:05.835 INFO:teuthology.orchestra.run.smithi112.stdout: "osds": [ 2024-09-12T02:53:05.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.835 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:53:05.836 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:05.836 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:05.836 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:05.836 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:05.836 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:05.836 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:05.836 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:05.836 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:05.836 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:05.836 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:05.836 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:05.836 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:05.837 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.837 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.837 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6800", 2024-09-12T02:53:05.837 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:05.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.837 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.837 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6801", 2024-09-12T02:53:05.837 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:05.837 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.837 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.837 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:05.838 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.838 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.838 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6802", 2024-09-12T02:53:05.838 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:05.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.838 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.838 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6803", 2024-09-12T02:53:05.838 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:05.838 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.838 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.839 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:05.839 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.839 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.839 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6806", 2024-09-12T02:53:05.839 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:05.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.839 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.839 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6807", 2024-09-12T02:53:05.839 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:05.839 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.839 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.840 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:05.840 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.840 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.840 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6804", 2024-09-12T02:53:05.840 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:05.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.840 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.840 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6805", 2024-09-12T02:53:05.840 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:05.840 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.840 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.841 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6801/821571304", 2024-09-12T02:53:05.841 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6803/821571304", 2024-09-12T02:53:05.841 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6807/821571304", 2024-09-12T02:53:05.841 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6805/821571304", 2024-09-12T02:53:05.841 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:05.841 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:05.841 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:05.841 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.841 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:53:05.841 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:05.841 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:05.842 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:05.842 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:05.842 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:05.842 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:05.842 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:05.842 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:05.842 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:05.842 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:05.842 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:05.842 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:05.842 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.842 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.842 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6808", 2024-09-12T02:53:05.842 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:05.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.843 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.843 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6809", 2024-09-12T02:53:05.843 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:05.843 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.843 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.843 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:05.843 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.843 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.843 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6810", 2024-09-12T02:53:05.843 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:05.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.844 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.844 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6811", 2024-09-12T02:53:05.844 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:05.844 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.844 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.844 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:05.844 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.844 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.844 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6814", 2024-09-12T02:53:05.844 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:05.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.845 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.845 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6815", 2024-09-12T02:53:05.845 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:05.845 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.845 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.845 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:05.845 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.845 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.845 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6812", 2024-09-12T02:53:05.846 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:05.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.846 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.846 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6813", 2024-09-12T02:53:05.846 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:05.846 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.846 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.846 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6809/2642068641", 2024-09-12T02:53:05.846 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6811/2642068641", 2024-09-12T02:53:05.846 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6815/2642068641", 2024-09-12T02:53:05.846 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6813/2642068641", 2024-09-12T02:53:05.847 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:05.847 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:05.847 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:05.847 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.847 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:53:05.847 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:05.847 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:05.847 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:05.847 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:05.847 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:05.847 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:05.847 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:05.848 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:05.848 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:05.848 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:05.848 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:05.848 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:05.848 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.848 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.848 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6816", 2024-09-12T02:53:05.848 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:05.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.848 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6817", 2024-09-12T02:53:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6818", 2024-09-12T02:53:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6819", 2024-09-12T02:53:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6822", 2024-09-12T02:53:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6823", 2024-09-12T02:53:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6820", 2024-09-12T02:53:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:05.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.852 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.852 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6821", 2024-09-12T02:53:05.852 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:05.852 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.852 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.852 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6817/3365688807", 2024-09-12T02:53:05.852 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6819/3365688807", 2024-09-12T02:53:05.852 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6823/3365688807", 2024-09-12T02:53:05.852 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6821/3365688807", 2024-09-12T02:53:05.852 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:05.852 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:05.853 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:05.853 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.853 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:53:05.853 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:05.853 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:05.853 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:05.853 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:05.853 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:05.853 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:05.853 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:05.853 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:05.853 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:05.854 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:05.854 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:05.854 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:05.854 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.854 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.854 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6824", 2024-09-12T02:53:05.854 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:05.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.854 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.854 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6825", 2024-09-12T02:53:05.854 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:05.854 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.855 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.855 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:05.855 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.855 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.855 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6826", 2024-09-12T02:53:05.855 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:05.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.855 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.855 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6827", 2024-09-12T02:53:05.856 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:05.856 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.856 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.856 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:05.856 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.856 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.856 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6830", 2024-09-12T02:53:05.856 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:05.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.856 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.857 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6831", 2024-09-12T02:53:05.857 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:05.857 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.857 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.857 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:05.857 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.857 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.857 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6828", 2024-09-12T02:53:05.857 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:05.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.857 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.858 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6829", 2024-09-12T02:53:05.858 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:05.858 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.858 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.858 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6825/231774278", 2024-09-12T02:53:05.858 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6827/231774278", 2024-09-12T02:53:05.858 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6831/231774278", 2024-09-12T02:53:05.858 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6829/231774278", 2024-09-12T02:53:05.858 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:05.858 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:05.858 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:05.858 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.859 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:53:05.859 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:05.859 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:05.859 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:05.859 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:05.859 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:05.859 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:05.859 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:05.859 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:05.859 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:05.859 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:05.859 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:05.859 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:05.860 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.860 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.860 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6800", 2024-09-12T02:53:05.860 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:05.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.860 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.860 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6801", 2024-09-12T02:53:05.860 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:05.860 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.860 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.860 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:05.861 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.861 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.861 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6802", 2024-09-12T02:53:05.861 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:05.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.861 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.861 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6803", 2024-09-12T02:53:05.861 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:05.861 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.861 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.861 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:05.862 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.862 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.862 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6806", 2024-09-12T02:53:05.862 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:05.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.862 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.862 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6807", 2024-09-12T02:53:05.862 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:05.862 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.862 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.862 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:05.863 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.863 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.863 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6804", 2024-09-12T02:53:05.863 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:05.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.863 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.863 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6805", 2024-09-12T02:53:05.863 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:05.863 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.863 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.863 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6801/3671178153", 2024-09-12T02:53:05.863 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6803/3671178153", 2024-09-12T02:53:05.864 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6807/3671178153", 2024-09-12T02:53:05.864 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6805/3671178153", 2024-09-12T02:53:05.864 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:05.864 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:05.864 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:05.864 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.864 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:53:05.864 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:05.864 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:05.864 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:05.864 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:05.864 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:05.865 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:05.865 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:05.865 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:05.865 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:05.865 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:05.865 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:05.865 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:05.865 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.865 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.865 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6808", 2024-09-12T02:53:05.865 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:05.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.866 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.866 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6809", 2024-09-12T02:53:05.866 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:05.866 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.866 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.866 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:05.866 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.866 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.866 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6810", 2024-09-12T02:53:05.866 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:05.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.866 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.867 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6811", 2024-09-12T02:53:05.867 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:05.867 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.867 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.867 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:05.867 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.867 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.867 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6817", 2024-09-12T02:53:05.867 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:05.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.868 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.868 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6819", 2024-09-12T02:53:05.868 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:05.868 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.868 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.868 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:05.868 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.868 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.868 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6812", 2024-09-12T02:53:05.868 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:05.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.869 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.869 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6815", 2024-09-12T02:53:05.869 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:05.869 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.869 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.869 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6809/3193706134", 2024-09-12T02:53:05.869 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6811/3193706134", 2024-09-12T02:53:05.869 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6819/3193706134", 2024-09-12T02:53:05.869 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6815/3193706134", 2024-09-12T02:53:05.869 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:05.869 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:05.869 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:05.870 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.870 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:53:05.870 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:05.870 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:05.870 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:05.870 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:05.870 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:05.870 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:05.870 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:05.870 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:05.870 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:05.870 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:05.870 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:05.871 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:05.871 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.871 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.871 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6813", 2024-09-12T02:53:05.871 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:05.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.871 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.871 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6814", 2024-09-12T02:53:05.871 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:05.871 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.871 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.872 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:05.872 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.872 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.872 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6816", 2024-09-12T02:53:05.872 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:05.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.872 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.872 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6818", 2024-09-12T02:53:05.872 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:05.872 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.872 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.873 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:05.873 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.873 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.873 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6822", 2024-09-12T02:53:05.873 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:05.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.873 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.874 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6823", 2024-09-12T02:53:05.874 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:05.874 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.874 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.874 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:05.874 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.874 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.874 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6820", 2024-09-12T02:53:05.874 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:05.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.874 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.875 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6821", 2024-09-12T02:53:05.875 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:05.875 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.875 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.875 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6814/3738813293", 2024-09-12T02:53:05.875 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6818/3738813293", 2024-09-12T02:53:05.875 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6823/3738813293", 2024-09-12T02:53:05.875 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6821/3738813293", 2024-09-12T02:53:05.875 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:05.875 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:05.875 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:05.875 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.876 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:53:05.876 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:05.876 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:05.876 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:05.876 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:05.876 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:05.876 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:05.876 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:05.876 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:05.876 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:05.876 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:05.876 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:05.877 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:05.877 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.877 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.877 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6824", 2024-09-12T02:53:05.877 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:05.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.877 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.877 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6825", 2024-09-12T02:53:05.878 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:05.878 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.878 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.878 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:05.878 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.878 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.878 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6826", 2024-09-12T02:53:05.878 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:05.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.878 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.879 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6827", 2024-09-12T02:53:05.879 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:05.879 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.879 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.879 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:05.879 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.879 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.879 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6830", 2024-09-12T02:53:05.879 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:05.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.880 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.880 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6831", 2024-09-12T02:53:05.880 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:05.880 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.880 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.880 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:05.880 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:05.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.880 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:05.881 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6828", 2024-09-12T02:53:05.881 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:05.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.881 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:05.881 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6829", 2024-09-12T02:53:05.881 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:05.881 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.881 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.881 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6825/1421932609", 2024-09-12T02:53:05.881 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6827/1421932609", 2024-09-12T02:53:05.881 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6831/1421932609", 2024-09-12T02:53:05.882 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6829/1421932609", 2024-09-12T02:53:05.882 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:05.882 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:05.882 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:05.882 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:05.882 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.882 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:05.882 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_xinfo": [ 2024-09-12T02:53:05.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.882 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:53:05.882 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:05.882 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:05.882 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:05.882 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:05.882 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:05.883 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.220641+0000", 2024-09-12T02:53:05.883 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:05.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.883 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:53:05.883 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:05.883 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:05.883 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:05.883 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:05.883 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:05.883 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312574+0000", 2024-09-12T02:53:05.883 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:05.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.883 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:53:05.884 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:05.884 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:05.884 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:05.884 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:05.884 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:05.884 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.282771+0000", 2024-09-12T02:53:05.884 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:05.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.884 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:53:05.884 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:05.884 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:05.884 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:05.885 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:05.885 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:05.885 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.260478+0000", 2024-09-12T02:53:05.885 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:05.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.885 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:53:05.885 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:05.885 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:05.885 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:05.885 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:05.885 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:05.885 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.273397+0000", 2024-09-12T02:53:05.885 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:05.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.886 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:53:05.886 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:05.886 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:05.886 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:05.886 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:05.886 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:05.886 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312452+0000", 2024-09-12T02:53:05.886 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:05.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.886 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:53:05.886 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.308965+0000", 2024-09-12T02:53:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:53:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:05.887 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.337842+0000", 2024-09-12T02:53:05.888 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:05.888 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.888 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:05.888 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap": [], 2024-09-12T02:53:05.888 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_items": [], 2024-09-12T02:53:05.888 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_primaries": [], 2024-09-12T02:53:05.888 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_temp": [], 2024-09-12T02:53:05.888 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_temp": [], 2024-09-12T02:53:05.888 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklist": {}, 2024-09-12T02:53:05.888 INFO:teuthology.orchestra.run.smithi112.stdout: "range_blocklist": {}, 2024-09-12T02:53:05.888 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profiles": { 2024-09-12T02:53:05.888 INFO:teuthology.orchestra.run.smithi112.stdout: "default": { 2024-09-12T02:53:05.888 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-failure-domain": "osd", 2024-09-12T02:53:05.888 INFO:teuthology.orchestra.run.smithi112.stdout: "k": "2", 2024-09-12T02:53:05.889 INFO:teuthology.orchestra.run.smithi112.stdout: "m": "1", 2024-09-12T02:53:05.889 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin": "jerasure", 2024-09-12T02:53:05.889 INFO:teuthology.orchestra.run.smithi112.stdout: "technique": "reed_sol_van" 2024-09-12T02:53:05.889 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:05.889 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps_queue": [], 2024-09-12T02:53:05.889 INFO:teuthology.orchestra.run.smithi112.stdout: "new_removed_snaps": [], 2024-09-12T02:53:05.889 INFO:teuthology.orchestra.run.smithi112.stdout: "new_purged_snaps": [], 2024-09-12T02:53:05.889 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_node_flags": {}, 2024-09-12T02:53:05.889 INFO:teuthology.orchestra.run.smithi112.stdout: "device_class_flags": {}, 2024-09-12T02:53:05.889 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode": { 2024-09-12T02:53:05.889 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_enabled": false, 2024-09-12T02:53:05.889 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_bucket_count": 0, 2024-09-12T02:53:05.889 INFO:teuthology.orchestra.run.smithi112.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:53:05.890 INFO:teuthology.orchestra.run.smithi112.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:53:05.890 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_bucket": 0 2024-09-12T02:53:05.890 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:05.890 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:53:05.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.814+0000 7f4d2a200640 1 -- 172.21.15.112:0/1005738902 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4d0006be30 msgr2=0x7f4d0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:05.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.814+0000 7f4d2a200640 1 --2- 172.21.15.112:0/1005738902 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4d0006be30 0x7f4d0006e2f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f4d14001660 tx=0x7f4d14009040 comp rx=0 tx=0).stop 2024-09-12T02:53:05.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.814+0000 7f4d2a200640 1 -- 172.21.15.112:0/1005738902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d240b45d0 msgr2=0x7f4d240ae900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:05.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.814+0000 7f4d2a200640 1 --2- 172.21.15.112:0/1005738902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d240b45d0 0x7f4d240ae900 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00e910 tx=0x7f4d0c00edd0 comp rx=0 tx=0).stop 2024-09-12T02:53:05.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.814+0000 7f4d2a200640 1 -- 172.21.15.112:0/1005738902 shutdown_connections 2024-09-12T02:53:05.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.814+0000 7f4d2a200640 1 --2- 172.21.15.112:0/1005738902 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d2415b9d0 0x7f4d240aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:05.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.814+0000 7f4d2a200640 1 --2- 172.21.15.112:0/1005738902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d240b45d0 0x7f4d240ae900 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:05.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.814+0000 7f4d2a200640 1 --2- 172.21.15.112:0/1005738902 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4d0006be30 0x7f4d0006e2f0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:05.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.814+0000 7f4d2a200640 1 --2- 172.21.15.112:0/1005738902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d2406f600 0x7f4d24157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:05.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.814+0000 7f4d2a200640 1 -- 172.21.15.112:0/1005738902 >> 172.21.15.112:0/1005738902 conn(0x7f4d2406bbd0 msgr2=0x7f4d24158620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:05.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.814+0000 7f4d2a200640 1 -- 172.21.15.112:0/1005738902 shutdown_connections 2024-09-12T02:53:05.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:05.814+0000 7f4d2a200640 1 -- 172.21.15.112:0/1005738902 wait complete. 2024-09-12T02:53:05.893 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-12T02:53:10.894 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-12T02:53:11.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.056+0000 7f8399600640 1 Processor -- start 2024-09-12T02:53:11.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.056+0000 7f8399600640 1 -- start start 2024-09-12T02:53:11.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.057+0000 7f8399600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f839415cc50 0x7f83940732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:11.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.057+0000 7f8399600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8394071530 0x7f83940af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:11.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.057+0000 7f8399600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83940719a0 0x7f83940afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:11.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.057+0000 7f8399600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f839415d030 con 0x7f839415cc50 2024-09-12T02:53:11.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.057+0000 7f8399600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f83940cf4c0 con 0x7f8394071530 2024-09-12T02:53:11.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.057+0000 7f8399600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8394073830 con 0x7f83940719a0 2024-09-12T02:53:11.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.057+0000 7f8392a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f839415cc50 0x7f83940732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:11.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.058+0000 7f8392a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f839415cc50 0x7f83940732f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52064/0 (socket says 172.21.15.112:52064) 2024-09-12T02:53:11.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.058+0000 7f8392a00640 1 -- 172.21.15.112:0/3599248660 learned_addr learned my addr 172.21.15.112:0/3599248660 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:11.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.058+0000 7f8392000640 1 --2- 172.21.15.112:0/3599248660 >> v2:172.21.15.137:3300/0 conn(0x7f8394071530 0x7f83940af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:11.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.058+0000 7f8393400640 1 --2- 172.21.15.112:0/3599248660 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83940719a0 0x7f83940afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:11.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.058+0000 7f8392a00640 1 -- 172.21.15.112:0/3599248660 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83940719a0 msgr2=0x7f83940afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:11.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.058+0000 7f8392a00640 1 --2- 172.21.15.112:0/3599248660 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83940719a0 0x7f83940afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:11.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.058+0000 7f8392a00640 1 -- 172.21.15.112:0/3599248660 >> v2:172.21.15.137:3300/0 conn(0x7f8394071530 msgr2=0x7f83940af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:11.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.058+0000 7f8392a00640 1 --2- 172.21.15.112:0/3599248660 >> v2:172.21.15.137:3300/0 conn(0x7f8394071530 0x7f83940af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:11.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.058+0000 7f8392a00640 1 -- 172.21.15.112:0/3599248660 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83940ceeb0 con 0x7f839415cc50 2024-09-12T02:53:11.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.058+0000 7f8393400640 1 --2- 172.21.15.112:0/3599248660 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83940719a0 0x7f83940afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:53:11.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.059+0000 7f8392a00640 1 --2- 172.21.15.112:0/3599248660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f839415cc50 0x7f83940732f0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f839406fa40 tx=0x7f838402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5bb353094600d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:11.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.059+0000 7f8391600640 1 -- 172.21.15.112:0/3599248660 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8384037070 con 0x7f839415cc50 2024-09-12T02:53:11.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.059+0000 7f8391600640 1 -- 172.21.15.112:0/3599248660 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8384032440 con 0x7f839415cc50 2024-09-12T02:53:11.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.059+0000 7f8391600640 1 -- 172.21.15.112:0/3599248660 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8384032810 con 0x7f839415cc50 2024-09-12T02:53:11.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.060+0000 7f8399600640 1 -- 172.21.15.112:0/3599248660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f839415cc50 msgr2=0x7f83940732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:11.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.060+0000 7f8399600640 1 --2- 172.21.15.112:0/3599248660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f839415cc50 0x7f83940732f0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f839406fa40 tx=0x7f838402a140 comp rx=0 tx=0).stop 2024-09-12T02:53:11.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.060+0000 7f8399600640 1 -- 172.21.15.112:0/3599248660 shutdown_connections 2024-09-12T02:53:11.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.060+0000 7f8399600640 1 --2- 172.21.15.112:0/3599248660 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83940719a0 0x7f83940afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:11.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.060+0000 7f8399600640 1 --2- 172.21.15.112:0/3599248660 >> v2:172.21.15.137:3300/0 conn(0x7f8394071530 0x7f83940af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:11.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.060+0000 7f8399600640 1 --2- 172.21.15.112:0/3599248660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f839415cc50 0x7f83940732f0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:11.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.060+0000 7f8399600640 1 -- 172.21.15.112:0/3599248660 >> 172.21.15.112:0/3599248660 conn(0x7f839406bbd0 msgr2=0x7f839406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:11.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.060+0000 7f8399600640 1 -- 172.21.15.112:0/3599248660 shutdown_connections 2024-09-12T02:53:11.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.060+0000 7f8399600640 1 -- 172.21.15.112:0/3599248660 wait complete. 2024-09-12T02:53:11.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.061+0000 7f8399600640 1 Processor -- start 2024-09-12T02:53:11.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.062+0000 7f8399600640 1 -- start start 2024-09-12T02:53:11.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.062+0000 7f8399600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8394071530 0x7f839415bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:11.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.062+0000 7f8399600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83940719a0 0x7f8394147e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:11.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.062+0000 7f8399600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f839415cc50 0x7f83941483d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:11.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.062+0000 7f8399600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f83940cf150 con 0x7f8394071530 2024-09-12T02:53:11.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.062+0000 7f8399600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f839406e5e0 con 0x7f839415cc50 2024-09-12T02:53:11.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.062+0000 7f8399600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f839406f510 con 0x7f83940719a0 2024-09-12T02:53:11.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.063+0000 7f8392a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8394071530 0x7f839415bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:11.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.063+0000 7f8392a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8394071530 0x7f839415bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52078/0 (socket says 172.21.15.112:52078) 2024-09-12T02:53:11.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.063+0000 7f8392a00640 1 -- 172.21.15.112:0/2956913865 learned_addr learned my addr 172.21.15.112:0/2956913865 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:11.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.063+0000 7f8392000640 1 --2- 172.21.15.112:0/2956913865 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83940719a0 0x7f8394147e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:11.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.063+0000 7f8393400640 1 --2- 172.21.15.112:0/2956913865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f839415cc50 0x7f83941483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:11.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.063+0000 7f8392a00640 1 -- 172.21.15.112:0/2956913865 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83940719a0 msgr2=0x7f8394147e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:11.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.063+0000 7f8392a00640 1 --2- 172.21.15.112:0/2956913865 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83940719a0 0x7f8394147e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:11.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.063+0000 7f8392a00640 1 -- 172.21.15.112:0/2956913865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f839415cc50 msgr2=0x7f83941483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:11.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.063+0000 7f8392a00640 1 --2- 172.21.15.112:0/2956913865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f839415cc50 0x7f83941483d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:11.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.063+0000 7f8392a00640 1 -- 172.21.15.112:0/2956913865 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8394159390 con 0x7f8394071530 2024-09-12T02:53:11.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.064+0000 7f8392a00640 1 --2- 172.21.15.112:0/2956913865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8394071530 0x7f839415bdc0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f838402a180 tx=0x7f83840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:11.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.064+0000 7f838aa00640 1 -- 172.21.15.112:0/2956913865 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8384041020 con 0x7f8394071530 2024-09-12T02:53:11.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.064+0000 7f838aa00640 1 -- 172.21.15.112:0/2956913865 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83840306c0 con 0x7f8394071530 2024-09-12T02:53:11.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.064+0000 7f838aa00640 1 -- 172.21.15.112:0/2956913865 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8384037040 con 0x7f8394071530 2024-09-12T02:53:11.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.064+0000 7f8399600640 1 -- 172.21.15.112:0/2956913865 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8394152f20 con 0x7f8394071530 2024-09-12T02:53:11.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.064+0000 7f8399600640 1 -- 172.21.15.112:0/2956913865 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8394153200 con 0x7f8394071530 2024-09-12T02:53:11.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.066+0000 7f8399600640 1 -- 172.21.15.112:0/2956913865 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8394068a30 con 0x7f8394071530 2024-09-12T02:53:11.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.067+0000 7f838aa00640 1 -- 172.21.15.112:0/2956913865 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8384044020 con 0x7f8394071530 2024-09-12T02:53:11.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.068+0000 7f838aa00640 1 --2- 172.21.15.112:0/2956913865 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f837406be60 0x7f837406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:11.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.068+0000 7f838aa00640 1 -- 172.21.15.112:0/2956913865 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 5709+0+0 (secure 0 0 0) 0x7f83840ab5e0 con 0x7f8394071530 2024-09-12T02:53:11.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.068+0000 7f8392000640 1 --2- 172.21.15.112:0/2956913865 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f837406be60 0x7f837406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:11.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.069+0000 7f8392000640 1 --2- 172.21.15.112:0/2956913865 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f837406be60 0x7f837406e320 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f83941f9660 tx=0x7f8380008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:11.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.073+0000 7f838aa00640 1 -- 172.21.15.112:0/2956913865 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f838404b030 con 0x7f8394071530 2024-09-12T02:53:11.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.250+0000 7f8399600640 1 -- 172.21.15.112:0/2956913865 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f83940730d0 con 0x7f8394071530 2024-09-12T02:53:11.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.251+0000 7f838aa00640 1 -- 172.21.15.112:0/2956913865 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v185) ==== 81+0+34337 (secure 0 0 0) 0x7f83840800c0 con 0x7f8394071530 2024-09-12T02:53:11.253 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:53:11.253 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:53:11.253 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 185, 2024-09-12T02:53:11.253 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:53:11.253 INFO:teuthology.orchestra.run.smithi112.stdout: "created": "2024-09-12T02:41:36.162095+0000", 2024-09-12T02:53:11.253 INFO:teuthology.orchestra.run.smithi112.stdout: "modified": "2024-09-12T02:53:11.064679+0000", 2024-09-12T02:53:11.254 INFO:teuthology.orchestra.run.smithi112.stdout: "last_up_change": "2024-09-12T02:41:42.191169+0000", 2024-09-12T02:53:11.254 INFO:teuthology.orchestra.run.smithi112.stdout: "last_in_change": "2024-09-12T02:41:39.036600+0000", 2024-09-12T02:53:11.254 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:53:11.254 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_num": 5799936, 2024-09-12T02:53:11.254 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_set": [ 2024-09-12T02:53:11.254 INFO:teuthology.orchestra.run.smithi112.stdout: "pglog_hardlimit", 2024-09-12T02:53:11.254 INFO:teuthology.orchestra.run.smithi112.stdout: "purged_snapdirs", 2024-09-12T02:53:11.254 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_deletes", 2024-09-12T02:53:11.254 INFO:teuthology.orchestra.run.smithi112.stdout: "sortbitwise" 2024-09-12T02:53:11.254 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:11.254 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_version": 4, 2024-09-12T02:53:11.254 INFO:teuthology.orchestra.run.smithi112.stdout: "full_ratio": 0.69999998807907104, 2024-09-12T02:53:11.254 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-12T02:53:11.255 INFO:teuthology.orchestra.run.smithi112.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-12T02:53:11.255 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_snapshot": "", 2024-09-12T02:53:11.255 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_max": 23, 2024-09-12T02:53:11.255 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd": 8, 2024-09-12T02:53:11.255 INFO:teuthology.orchestra.run.smithi112.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:53:11.255 INFO:teuthology.orchestra.run.smithi112.stdout: "min_compat_client": "jewel", 2024-09-12T02:53:11.255 INFO:teuthology.orchestra.run.smithi112.stdout: "require_osd_release": "squid", 2024-09-12T02:53:11.255 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_crimson": false, 2024-09-12T02:53:11.255 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-12T02:53:11.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.255 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 1, 2024-09-12T02:53:11.255 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": ".mgr", 2024-09-12T02:53:11.255 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:41:43.011599+0000", 2024-09-12T02:53:11.255 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:53:11.256 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:53:11.256 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:53:11.256 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:53:11.256 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:53:11.256 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:53:11.256 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:53:11.256 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:53:11.256 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:53:11.256 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:53:11.256 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:53:11.256 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:53:11.256 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:53:11.256 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 1, 2024-09-12T02:53:11.257 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 1, 2024-09-12T02:53:11.257 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 1, 2024-09-12T02:53:11.257 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 1, 2024-09-12T02:53:11.257 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 1, 2024-09-12T02:53:11.257 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:53:11.257 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:53:11.257 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:53:11.257 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:53:11.257 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:53:11.257 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:53:11.257 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:53:11.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.257 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "109", 2024-09-12T02:53:11.257 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:53:11.258 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:53:11.258 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:53:11.258 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:53:11.258 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:53:11.258 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:53:11.258 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:53:11.258 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:53:11.258 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:53:11.258 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:53:11.258 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:53:11.258 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:53:11.258 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:53:11.258 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:53:11.258 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:53:11.259 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:53:11.259 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:53:11.259 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:53:11.259 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:53:11.259 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:53:11.259 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:53:11.259 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:53:11.259 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:53:11.259 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:53:11.259 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:53:11.259 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:53:11.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.259 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:53:11.260 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:53:11.260 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:53:11.260 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:53:11.260 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:53:11.260 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:53:11.260 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:53:11.260 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:53:11.260 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:53:11.260 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:53:11.260 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:53:11.260 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:53:11.260 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_max": 32, 2024-09-12T02:53:11.261 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 1 2024-09-12T02:53:11.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.261 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:53:11.261 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": {} 2024-09-12T02:53:11.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.261 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:53:11.261 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:53:11.261 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 8, 2024-09-12T02:53:11.261 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 8, 2024-09-12T02:53:11.261 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 0.25, 2024-09-12T02:53:11.261 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:53:11.261 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:53:11.261 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:53:11.262 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:53:11.262 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:53:11.262 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.262 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 22, 2024-09-12T02:53:11.262 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:53:11.262 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:52:51.909503+0000", 2024-09-12T02:53:11.262 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:53:11.262 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:53:11.262 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:53:11.262 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:53:11.262 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:53:11.262 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:53:11.263 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:53:11.263 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:53:11.263 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:53:11.263 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:53:11.263 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:53:11.263 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:53:11.263 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:53:11.263 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 32, 2024-09-12T02:53:11.263 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 32, 2024-09-12T02:53:11.263 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 32, 2024-09-12T02:53:11.263 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 32, 2024-09-12T02:53:11.263 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 32, 2024-09-12T02:53:11.263 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:53:11.263 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:53:11.264 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:53:11.264 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:53:11.264 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:53:11.264 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:53:11.264 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:53:11.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.264 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "182", 2024-09-12T02:53:11.264 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:53:11.264 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:53:11.264 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:53:11.264 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:53:11.264 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:53:11.264 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:53:11.265 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:53:11.265 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:53:11.265 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:53:11.265 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:53:11.265 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:53:11.265 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:53:11.265 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:53:11.265 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:53:11.265 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:53:11.265 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:53:11.265 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:53:11.265 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:53:11.265 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:53:11.266 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:53:11.266 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:53:11.266 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:53:11.266 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:53:11.266 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:53:11.266 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:53:11.266 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:53:11.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.266 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:53:11.266 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:53:11.266 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:53:11.266 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:53:11.266 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:53:11.267 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:53:11.267 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:53:11.267 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:53:11.267 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:53:11.267 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:53:11.267 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:53:11.267 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:53:11.267 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:53:11.267 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 16, 2024-09-12T02:53:11.267 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_priority": 5 2024-09-12T02:53:11.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.267 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:53:11.267 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:53:11.267 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": "cephfs" 2024-09-12T02:53:11.267 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.268 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:53:11.268 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:53:11.268 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 2, 2024-09-12T02:53:11.268 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 2, 2024-09-12T02:53:11.268 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:53:11.268 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:53:11.268 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:53:11.268 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:53:11.268 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:53:11.268 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:53:11.268 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.269 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 23, 2024-09-12T02:53:11.269 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_data", 2024-09-12T02:53:11.269 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:52:53.146578+0000", 2024-09-12T02:53:11.269 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1027, 2024-09-12T02:53:11.269 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-12T02:53:11.269 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:53:11.269 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:53:11.269 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:53:11.269 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:53:11.269 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:53:11.269 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:53:11.269 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:53:11.269 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:53:11.270 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:53:11.270 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:53:11.270 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:53:11.270 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 64, 2024-09-12T02:53:11.270 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 64, 2024-09-12T02:53:11.270 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 64, 2024-09-12T02:53:11.270 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 64, 2024-09-12T02:53:11.270 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 64, 2024-09-12T02:53:11.270 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:53:11.270 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:53:11.270 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:53:11.270 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:53:11.270 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:53:11.270 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:53:11.271 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:53:11.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.271 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "185", 2024-09-12T02:53:11.271 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:53:11.271 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:53:11.271 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:53:11.271 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:53:11.271 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:53:11.271 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:53:11.271 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:53:11.271 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:53:11.271 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:53:11.271 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 33554432, 2024-09-12T02:53:11.271 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:53:11.271 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:53:11.271 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:53:11.272 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:53:11.272 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:53:11.272 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:53:11.272 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:53:11.272 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:53:11.272 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:53:11.272 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:53:11.272 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:53:11.272 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:53:11.272 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:53:11.272 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:53:11.272 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:53:11.272 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:53:11.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.272 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:53:11.273 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:53:11.273 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:53:11.273 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:53:11.273 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:53:11.273 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:53:11.273 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:53:11.273 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:53:11.273 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:53:11.273 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:53:11.273 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:53:11.273 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:53:11.273 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 64, 2024-09-12T02:53:11.273 INFO:teuthology.orchestra.run.smithi112.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:53:11.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.274 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:53:11.274 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:53:11.274 INFO:teuthology.orchestra.run.smithi112.stdout: "data": "cephfs" 2024-09-12T02:53:11.274 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.274 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:53:11.274 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:53:11.274 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.3799999952316284, 2024-09-12T02:53:11.274 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.3799999952316284, 2024-09-12T02:53:11.274 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:53:11.274 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-12T02:53:11.274 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-12T02:53:11.274 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:53:11.274 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:53:11.274 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:53:11.275 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.275 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.275 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:11.275 INFO:teuthology.orchestra.run.smithi112.stdout: "osds": [ 2024-09-12T02:53:11.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.275 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:53:11.275 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:11.275 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:11.275 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:11.275 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:11.275 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:11.275 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:11.276 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:11.276 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:11.276 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:11.276 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:11.276 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:11.276 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:11.276 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.276 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.276 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6800", 2024-09-12T02:53:11.276 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:11.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.277 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.277 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6801", 2024-09-12T02:53:11.277 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:11.277 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.277 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.277 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:11.277 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.277 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.277 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6802", 2024-09-12T02:53:11.277 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:11.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.278 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.278 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6803", 2024-09-12T02:53:11.278 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:11.278 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.278 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.278 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:11.278 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.278 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.278 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6806", 2024-09-12T02:53:11.278 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:11.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.279 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.279 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6807", 2024-09-12T02:53:11.279 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:11.279 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.279 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.279 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:11.279 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.279 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.279 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6804", 2024-09-12T02:53:11.279 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:11.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.280 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.280 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6805", 2024-09-12T02:53:11.280 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:11.280 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.280 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.280 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6801/821571304", 2024-09-12T02:53:11.280 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6803/821571304", 2024-09-12T02:53:11.280 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6807/821571304", 2024-09-12T02:53:11.280 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6805/821571304", 2024-09-12T02:53:11.280 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:11.280 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:11.281 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:11.281 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.281 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:53:11.281 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:11.281 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:11.281 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:11.281 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:11.281 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:11.281 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:11.281 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:11.281 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:11.281 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:11.282 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:11.282 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:11.282 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:11.282 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.282 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.282 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6808", 2024-09-12T02:53:11.282 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:11.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.282 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.282 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6809", 2024-09-12T02:53:11.282 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:11.282 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.282 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.283 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:11.283 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.283 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.283 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6810", 2024-09-12T02:53:11.283 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:11.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.283 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.283 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6811", 2024-09-12T02:53:11.283 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:11.283 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.283 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.284 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:11.284 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.284 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.284 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6814", 2024-09-12T02:53:11.284 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:11.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.284 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.284 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6815", 2024-09-12T02:53:11.284 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:11.284 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.284 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.285 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:11.285 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.285 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.285 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6812", 2024-09-12T02:53:11.285 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:11.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.285 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.285 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6813", 2024-09-12T02:53:11.285 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:11.285 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.285 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.286 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6809/2642068641", 2024-09-12T02:53:11.286 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6811/2642068641", 2024-09-12T02:53:11.286 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6815/2642068641", 2024-09-12T02:53:11.286 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6813/2642068641", 2024-09-12T02:53:11.286 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:11.286 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:11.286 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:11.286 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.286 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:53:11.286 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:11.286 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:11.287 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:11.287 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:11.287 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:11.287 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:11.287 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:11.287 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:11.287 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:11.287 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:11.287 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:11.287 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:11.287 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.288 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.288 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6816", 2024-09-12T02:53:11.288 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:11.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.288 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.288 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6817", 2024-09-12T02:53:11.288 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:11.288 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.288 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.288 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:11.289 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.289 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.289 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6818", 2024-09-12T02:53:11.289 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:11.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.289 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.289 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6819", 2024-09-12T02:53:11.289 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:11.289 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.289 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.289 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:11.290 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.290 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.290 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6822", 2024-09-12T02:53:11.290 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:11.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.290 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.290 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6823", 2024-09-12T02:53:11.290 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:11.290 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.290 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.290 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:11.290 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.291 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.291 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6820", 2024-09-12T02:53:11.291 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:11.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.291 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.291 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6821", 2024-09-12T02:53:11.291 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:11.291 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.291 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.291 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6817/3365688807", 2024-09-12T02:53:11.291 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6819/3365688807", 2024-09-12T02:53:11.291 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6823/3365688807", 2024-09-12T02:53:11.291 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6821/3365688807", 2024-09-12T02:53:11.292 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:11.292 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:11.292 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:11.292 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.292 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:53:11.292 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:11.292 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:11.292 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:11.292 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:11.292 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:11.292 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:11.292 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:11.292 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:11.293 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:11.293 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:11.293 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:11.293 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:11.293 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.293 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.293 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6824", 2024-09-12T02:53:11.293 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:11.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.293 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.293 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6825", 2024-09-12T02:53:11.294 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:11.294 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.294 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.294 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:11.294 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.294 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.294 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6826", 2024-09-12T02:53:11.294 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:11.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.295 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.295 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6827", 2024-09-12T02:53:11.295 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:11.295 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.295 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.295 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:11.295 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.295 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.295 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6830", 2024-09-12T02:53:11.295 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:11.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.296 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.296 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6831", 2024-09-12T02:53:11.296 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:11.296 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.296 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.296 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:11.297 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.297 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.297 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6828", 2024-09-12T02:53:11.297 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:11.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.297 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.297 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6829", 2024-09-12T02:53:11.297 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:11.297 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.297 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.297 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6825/231774278", 2024-09-12T02:53:11.298 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6827/231774278", 2024-09-12T02:53:11.298 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6831/231774278", 2024-09-12T02:53:11.298 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6829/231774278", 2024-09-12T02:53:11.298 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:11.298 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:11.298 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:11.298 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.298 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:53:11.298 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:11.298 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:11.298 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:11.299 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:11.299 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:11.299 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:11.299 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:11.299 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:11.299 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:11.299 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:11.299 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:11.299 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:11.299 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.299 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.299 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6800", 2024-09-12T02:53:11.299 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:11.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.300 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.300 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6801", 2024-09-12T02:53:11.300 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:11.300 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.300 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.300 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:11.300 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.300 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.300 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6802", 2024-09-12T02:53:11.300 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:11.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.301 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.301 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6803", 2024-09-12T02:53:11.301 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:11.301 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.301 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.301 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:11.301 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.301 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.301 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6806", 2024-09-12T02:53:11.301 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:11.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.302 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.302 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6807", 2024-09-12T02:53:11.302 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:11.302 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.302 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.302 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:11.302 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.302 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.302 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6804", 2024-09-12T02:53:11.302 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:11.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.302 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6805", 2024-09-12T02:53:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6801/3671178153", 2024-09-12T02:53:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6803/3671178153", 2024-09-12T02:53:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6807/3671178153", 2024-09-12T02:53:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6805/3671178153", 2024-09-12T02:53:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.303 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:53:11.304 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:11.304 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:11.304 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:11.304 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:11.304 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:11.304 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:11.304 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:11.304 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:11.304 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:11.304 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:11.304 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:11.304 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:11.304 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.304 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.305 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6808", 2024-09-12T02:53:11.305 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:11.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.305 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.305 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6809", 2024-09-12T02:53:11.305 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:11.305 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.305 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.305 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:11.305 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.305 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.306 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6810", 2024-09-12T02:53:11.306 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:11.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.306 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.306 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6811", 2024-09-12T02:53:11.306 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:11.306 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.306 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.306 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:11.306 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.306 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.306 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6817", 2024-09-12T02:53:11.307 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:11.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.307 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.307 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6819", 2024-09-12T02:53:11.307 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:11.307 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.307 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.307 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:11.307 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.307 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.307 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6812", 2024-09-12T02:53:11.308 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:11.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.308 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.308 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6815", 2024-09-12T02:53:11.308 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:11.308 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.308 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.308 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6809/3193706134", 2024-09-12T02:53:11.308 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6811/3193706134", 2024-09-12T02:53:11.308 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6819/3193706134", 2024-09-12T02:53:11.308 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6815/3193706134", 2024-09-12T02:53:11.308 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:11.308 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:11.309 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:11.309 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.309 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:53:11.309 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:11.309 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:11.309 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:11.309 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:11.309 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:11.309 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:11.309 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:11.309 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:11.309 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:11.309 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:11.310 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:11.310 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:11.310 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.310 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.310 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6813", 2024-09-12T02:53:11.310 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:11.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.310 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.310 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6814", 2024-09-12T02:53:11.310 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:11.310 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.310 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.310 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:11.311 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.311 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.311 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6816", 2024-09-12T02:53:11.311 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:11.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.311 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.311 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6818", 2024-09-12T02:53:11.311 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:11.311 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.311 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.311 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:11.311 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.312 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.312 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6822", 2024-09-12T02:53:11.312 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:11.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.312 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.312 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6823", 2024-09-12T02:53:11.312 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:11.312 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.312 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.312 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:11.312 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.312 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.313 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6820", 2024-09-12T02:53:11.313 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:11.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.313 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.313 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6821", 2024-09-12T02:53:11.313 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:11.313 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.313 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.313 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6814/3738813293", 2024-09-12T02:53:11.313 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6818/3738813293", 2024-09-12T02:53:11.313 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6823/3738813293", 2024-09-12T02:53:11.313 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6821/3738813293", 2024-09-12T02:53:11.313 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:11.314 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:11.314 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:11.314 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.314 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:53:11.314 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:11.314 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:11.314 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:11.314 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:11.314 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:11.314 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:11.314 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:11.314 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:11.314 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:11.315 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:11.315 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:11.315 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:11.315 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.315 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.315 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6824", 2024-09-12T02:53:11.315 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:11.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.315 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.315 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6825", 2024-09-12T02:53:11.315 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:11.315 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.316 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.316 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:11.316 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.316 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.316 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6826", 2024-09-12T02:53:11.316 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:11.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.316 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.316 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6827", 2024-09-12T02:53:11.316 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:11.317 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.317 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.317 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:11.317 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.317 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.317 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6830", 2024-09-12T02:53:11.317 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:11.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.317 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.317 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6831", 2024-09-12T02:53:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6828", 2024-09-12T02:53:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6829", 2024-09-12T02:53:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:11.318 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.319 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.319 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6825/1421932609", 2024-09-12T02:53:11.319 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6827/1421932609", 2024-09-12T02:53:11.319 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6831/1421932609", 2024-09-12T02:53:11.319 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6829/1421932609", 2024-09-12T02:53:11.319 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:11.319 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:11.319 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:11.319 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:11.319 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.319 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:11.319 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_xinfo": [ 2024-09-12T02:53:11.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.320 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:53:11.320 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:11.320 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:11.320 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:11.320 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:11.320 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:11.320 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.220641+0000", 2024-09-12T02:53:11.320 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:11.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.320 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:53:11.320 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:11.320 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:11.320 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:11.320 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:11.321 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:11.321 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312574+0000", 2024-09-12T02:53:11.321 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:11.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.321 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:53:11.321 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:11.321 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:11.321 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:11.321 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:11.321 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:11.321 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.282771+0000", 2024-09-12T02:53:11.321 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:11.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:53:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.260478+0000", 2024-09-12T02:53:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:53:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:11.323 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:11.323 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:11.323 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.273397+0000", 2024-09-12T02:53:11.323 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:11.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.323 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:53:11.323 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:11.323 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:11.323 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:11.323 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:11.323 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:11.323 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312452+0000", 2024-09-12T02:53:11.324 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:11.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.324 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:53:11.324 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:11.324 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:11.324 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:11.324 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:11.324 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:11.325 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.308965+0000", 2024-09-12T02:53:11.325 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:11.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:11.325 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:53:11.325 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:11.325 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:11.325 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:11.325 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:11.325 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:11.325 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.337842+0000", 2024-09-12T02:53:11.325 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:11.325 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.326 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:11.326 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap": [], 2024-09-12T02:53:11.326 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_items": [], 2024-09-12T02:53:11.326 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_primaries": [], 2024-09-12T02:53:11.326 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_temp": [], 2024-09-12T02:53:11.326 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_temp": [], 2024-09-12T02:53:11.326 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklist": {}, 2024-09-12T02:53:11.326 INFO:teuthology.orchestra.run.smithi112.stdout: "range_blocklist": {}, 2024-09-12T02:53:11.326 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profiles": { 2024-09-12T02:53:11.326 INFO:teuthology.orchestra.run.smithi112.stdout: "default": { 2024-09-12T02:53:11.326 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-failure-domain": "osd", 2024-09-12T02:53:11.326 INFO:teuthology.orchestra.run.smithi112.stdout: "k": "2", 2024-09-12T02:53:11.326 INFO:teuthology.orchestra.run.smithi112.stdout: "m": "1", 2024-09-12T02:53:11.327 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin": "jerasure", 2024-09-12T02:53:11.327 INFO:teuthology.orchestra.run.smithi112.stdout: "technique": "reed_sol_van" 2024-09-12T02:53:11.327 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:11.327 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps_queue": [], 2024-09-12T02:53:11.327 INFO:teuthology.orchestra.run.smithi112.stdout: "new_removed_snaps": [], 2024-09-12T02:53:11.327 INFO:teuthology.orchestra.run.smithi112.stdout: "new_purged_snaps": [], 2024-09-12T02:53:11.327 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_node_flags": {}, 2024-09-12T02:53:11.327 INFO:teuthology.orchestra.run.smithi112.stdout: "device_class_flags": {}, 2024-09-12T02:53:11.327 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode": { 2024-09-12T02:53:11.327 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_enabled": false, 2024-09-12T02:53:11.327 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_bucket_count": 0, 2024-09-12T02:53:11.327 INFO:teuthology.orchestra.run.smithi112.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:53:11.327 INFO:teuthology.orchestra.run.smithi112.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:53:11.328 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_bucket": 0 2024-09-12T02:53:11.328 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:11.328 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:53:11.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.254+0000 7f8399600640 1 -- 172.21.15.112:0/2956913865 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f837406be60 msgr2=0x7f837406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:11.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.254+0000 7f8399600640 1 --2- 172.21.15.112:0/2956913865 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f837406be60 0x7f837406e320 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f83941f9660 tx=0x7f8380008040 comp rx=0 tx=0).stop 2024-09-12T02:53:11.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.254+0000 7f8399600640 1 -- 172.21.15.112:0/2956913865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8394071530 msgr2=0x7f839415bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:11.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.254+0000 7f8399600640 1 --2- 172.21.15.112:0/2956913865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8394071530 0x7f839415bdc0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f838402a180 tx=0x7f83840046c0 comp rx=0 tx=0).stop 2024-09-12T02:53:11.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.254+0000 7f8399600640 1 -- 172.21.15.112:0/2956913865 shutdown_connections 2024-09-12T02:53:11.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.254+0000 7f8399600640 1 --2- 172.21.15.112:0/2956913865 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f837406be60 0x7f837406e320 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:11.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.254+0000 7f8399600640 1 --2- 172.21.15.112:0/2956913865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f839415cc50 0x7f83941483d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:11.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.254+0000 7f8399600640 1 --2- 172.21.15.112:0/2956913865 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83940719a0 0x7f8394147e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:11.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.254+0000 7f8399600640 1 --2- 172.21.15.112:0/2956913865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8394071530 0x7f839415bdc0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:11.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.254+0000 7f8399600640 1 -- 172.21.15.112:0/2956913865 >> 172.21.15.112:0/2956913865 conn(0x7f839406bbd0 msgr2=0x7f83940b3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:11.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.254+0000 7f8399600640 1 -- 172.21.15.112:0/2956913865 shutdown_connections 2024-09-12T02:53:11.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.254+0000 7f8399600640 1 -- 172.21.15.112:0/2956913865 wait complete. 2024-09-12T02:53:11.331 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-12T02:53:11.331 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:53:11.331 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:53:11.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:11.366 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2024-09-12T02:53:11.774 INFO:teuthology.orchestra.run.smithi112.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2024-09-12T02:53:11.774 INFO:teuthology.orchestra.run.smithi112.stderr:50+0 records in 2024-09-12T02:53:11.774 INFO:teuthology.orchestra.run.smithi112.stderr:50+0 records out 2024-09-12T02:53:11.774 INFO:teuthology.orchestra.run.smithi112.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.327833 s, 160 MB/s 2024-09-12T02:53:11.775 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:53:11.775 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-12T02:53:11.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.927+0000 7f3e87200640 1 Processor -- start 2024-09-12T02:53:11.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.927+0000 7f3e87200640 1 -- start start 2024-09-12T02:53:11.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.929+0000 7f3e87200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e80071530 0x7f3e800af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:11.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.929+0000 7f3e87200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e800ceeb0 con 0x7f3e8015cc50 2024-09-12T02:53:11.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.929+0000 7f3e87200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e8006e300 con 0x7f3e80071970 2024-09-12T02:53:11.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.929+0000 7f3e87200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3e8015d030 con 0x7f3e80071530 2024-09-12T02:53:11.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.929+0000 7f3e7fe00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f3e8015cc50 0x7f3e800732f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46838/0 (socket says 172.21.15.112:46838) 2024-09-12T02:53:11.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.929+0000 7f3e7fe00640 1 -- 172.21.15.112:0/691410976 learned_addr learned my addr 172.21.15.112:0/691410976 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:53:11.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.929+0000 7f3e77400640 1 --2- 172.21.15.112:0/691410976 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e80071530 0x7f3e800af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:11.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.929+0000 7f3e7f400640 1 -- 172.21.15.112:0/691410976 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1772114447 0 0) 0x7f3e800ceeb0 con 0x7f3e8015cc50 2024-09-12T02:53:11.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.929+0000 7f3e7f400640 1 -- 172.21.15.112:0/691410976 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e64003520 con 0x7f3e8015cc50 2024-09-12T02:53:11.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.930+0000 7f3e7f400640 1 -- 172.21.15.112:0/691410976 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1404718986 0 0) 0x7f3e8006e300 con 0x7f3e80071970 2024-09-12T02:53:11.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.930+0000 7f3e7f400640 1 -- 172.21.15.112:0/691410976 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e800ceeb0 con 0x7f3e80071970 2024-09-12T02:53:11.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.930+0000 7f3e7f400640 1 -- 172.21.15.112:0/691410976 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4219423681 0 0) 0x7f3e64003520 con 0x7f3e8015cc50 2024-09-12T02:53:11.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.930+0000 7f3e7f400640 1 -- 172.21.15.112:0/691410976 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e80071530 msgr2=0x7f3e800af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:11.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.930+0000 7f3e7f400640 1 --2- 172.21.15.112:0/691410976 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e80071530 0x7f3e800af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:11.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.930+0000 7f3e7f400640 1 -- 172.21.15.112:0/691410976 >> v1:172.21.15.137:6789/0 conn(0x7f3e80071970 legacy=0x7f3e800cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:11.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.930+0000 7f3e7f400640 1 -- 172.21.15.112:0/691410976 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e8006e5e0 con 0x7f3e8015cc50 2024-09-12T02:53:11.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.930+0000 7f3e7f400640 1 -- 172.21.15.112:0/691410976 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f3e700015f0 con 0x7f3e8015cc50 2024-09-12T02:53:11.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.930+0000 7f3e7f400640 1 -- 172.21.15.112:0/691410976 >> v1:172.21.15.112:6789/0 conn(0x7f3e8015cc50 legacy=0x7f3e800732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:11.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.930+0000 7f3e7f400640 1 --2- 172.21.15.112:0/691410976 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e80071530 0x7f3e64003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:11.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.930+0000 7f3e7f400640 1 --2- 172.21.15.112:0/691410976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e64004120 0x7f3e64004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:11.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.930+0000 7f3e7f400640 1 --2- 172.21.15.112:0/691410976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e64004d40 0x7f3e640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:11.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.930+0000 7f3e7f400640 1 -- 172.21.15.112:0/691410976 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6400bb50 con 0x7f3e64004d40 2024-09-12T02:53:11.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.930+0000 7f3e7f400640 1 -- 172.21.15.112:0/691410976 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6400bd00 con 0x7f3e64004120 2024-09-12T02:53:11.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.930+0000 7f3e7f400640 1 -- 172.21.15.112:0/691410976 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3e6400bf00 con 0x7f3e80071530 2024-09-12T02:53:11.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.930+0000 7f3e85200640 1 --2- 172.21.15.112:0/691410976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e64004d40 0x7f3e640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:11.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.930+0000 7f3e77400640 1 --2- 172.21.15.112:0/691410976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e64004120 0x7f3e64004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:11.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.930+0000 7f3e7fe00640 1 --2- 172.21.15.112:0/691410976 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e80071530 0x7f3e64003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:11.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.931+0000 7f3e85200640 1 -- 172.21.15.112:0/691410976 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e80071530 msgr2=0x7f3e64003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:11.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.931+0000 7f3e85200640 1 --2- 172.21.15.112:0/691410976 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e80071530 0x7f3e64003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:11.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.931+0000 7f3e85200640 1 -- 172.21.15.112:0/691410976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e64004120 msgr2=0x7f3e64004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:11.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.931+0000 7f3e85200640 1 --2- 172.21.15.112:0/691410976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e64004120 0x7f3e64004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:11.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.931+0000 7f3e85200640 1 -- 172.21.15.112:0/691410976 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e64003520 con 0x7f3e64004d40 2024-09-12T02:53:11.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.932+0000 7f3e85200640 1 --2- 172.21.15.112:0/691410976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e64004d40 0x7f3e640051c0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f3e8006fff0 tx=0x7f3e64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff9f1dca50569ee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:11.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.932+0000 7f3e7f400640 1 -- 172.21.15.112:0/691410976 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e78001be0 con 0x7f3e64004d40 2024-09-12T02:53:11.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.932+0000 7f3e7f400640 1 -- 172.21.15.112:0/691410976 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e78003b70 con 0x7f3e64004d40 2024-09-12T02:53:11.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.932+0000 7f3e7f400640 1 -- 172.21.15.112:0/691410976 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e780050d0 con 0x7f3e64004d40 2024-09-12T02:53:11.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.932+0000 7f3e87200640 1 -- 172.21.15.112:0/691410976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e64004d40 msgr2=0x7f3e640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:11.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.932+0000 7f3e87200640 1 --2- 172.21.15.112:0/691410976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e64004d40 0x7f3e640051c0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f3e8006fff0 tx=0x7f3e64005830 comp rx=0 tx=0).stop 2024-09-12T02:53:11.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.932+0000 7f3e85200640 1 -- 172.21.15.112:0/691410976 reap_dead start 2024-09-12T02:53:11.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.932+0000 7f3e87200640 1 -- 172.21.15.112:0/691410976 shutdown_connections 2024-09-12T02:53:11.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.932+0000 7f3e87200640 1 -- 172.21.15.112:0/691410976 >> 172.21.15.112:0/691410976 conn(0x7f3e8006bbd0 msgr2=0x7f3e8006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:11.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.933+0000 7f3e87200640 1 -- 172.21.15.112:0/691410976 shutdown_connections 2024-09-12T02:53:11.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.933+0000 7f3e87200640 1 -- 172.21.15.112:0/691410976 wait complete. 2024-09-12T02:53:11.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.934+0000 7f3e87200640 1 Processor -- start 2024-09-12T02:53:11.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.934+0000 7f3e87200640 1 -- start start 2024-09-12T02:53:11.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.935+0000 7f3e87200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e64004d40 0x7f3e80146430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:11.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.935+0000 7f3e87200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e8015b3b0 0x7f3e801e7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:11.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.935+0000 7f3e87200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e8015b830 0x7f3e801e80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:11.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.935+0000 7f3e87200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8006f510 con 0x7f3e8015b830 2024-09-12T02:53:11.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.935+0000 7f3e87200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3e800cf4c0 con 0x7f3e64004d40 2024-09-12T02:53:11.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.935+0000 7f3e87200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3e8006f690 con 0x7f3e8015b3b0 2024-09-12T02:53:11.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.935+0000 7f3e85200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e8015b830 0x7f3e801e80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:11.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.935+0000 7f3e85200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e8015b830 0x7f3e801e80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33290/0 (socket says 172.21.15.112:33290) 2024-09-12T02:53:11.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.935+0000 7f3e85200640 1 -- 172.21.15.112:0/1671712387 learned_addr learned my addr 172.21.15.112:0/1671712387 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:11.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.936+0000 7f3e7fe00640 1 --2- 172.21.15.112:0/1671712387 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e64004d40 0x7f3e80146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:11.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.936+0000 7f3e77400640 1 --2- 172.21.15.112:0/1671712387 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e8015b3b0 0x7f3e801e7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:11.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.936+0000 7f3e85200640 1 -- 172.21.15.112:0/1671712387 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e8015b3b0 msgr2=0x7f3e801e7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:11.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.936+0000 7f3e85200640 1 --2- 172.21.15.112:0/1671712387 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e8015b3b0 0x7f3e801e7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:11.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.936+0000 7f3e85200640 1 -- 172.21.15.112:0/1671712387 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e64004d40 msgr2=0x7f3e80146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:11.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.936+0000 7f3e85200640 1 --2- 172.21.15.112:0/1671712387 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e64004d40 0x7f3e80146430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:11.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.936+0000 7f3e85200640 1 -- 172.21.15.112:0/1671712387 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e80146970 con 0x7f3e8015b830 2024-09-12T02:53:11.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.936+0000 7f3e85200640 1 --2- 172.21.15.112:0/1671712387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e8015b830 0x7f3e801e80e0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f3e78002080 tx=0x7f3e78001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:11.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.936+0000 7f3e7cc00640 1 -- 172.21.15.112:0/1671712387 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e78003970 con 0x7f3e8015b830 2024-09-12T02:53:11.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.936+0000 7f3e7cc00640 1 -- 172.21.15.112:0/1671712387 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e78043070 con 0x7f3e8015b830 2024-09-12T02:53:11.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.936+0000 7f3e87200640 1 -- 172.21.15.112:0/1671712387 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e801e70f0 con 0x7f3e8015b830 2024-09-12T02:53:11.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.937+0000 7f3e7cc00640 1 -- 172.21.15.112:0/1671712387 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e780054c0 con 0x7f3e8015b830 2024-09-12T02:53:11.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.937+0000 7f3e87200640 1 -- 172.21.15.112:0/1671712387 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e801e7670 con 0x7f3e8015b830 2024-09-12T02:53:11.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.938+0000 7f3e87200640 1 -- 172.21.15.112:0/1671712387 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e80068a30 con 0x7f3e8015b830 2024-09-12T02:53:11.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.938+0000 7f3e7cc00640 1 -- 172.21.15.112:0/1671712387 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e7803a040 con 0x7f3e8015b830 2024-09-12T02:53:11.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.939+0000 7f3e7cc00640 1 --2- 172.21.15.112:0/1671712387 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3e5c06be60 0x7f3e5c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:11.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.939+0000 7f3e7cc00640 1 -- 172.21.15.112:0/1671712387 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7f3e780ab120 con 0x7f3e8015b830 2024-09-12T02:53:11.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.940+0000 7f3e7fe00640 1 --2- 172.21.15.112:0/1671712387 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3e5c06be60 0x7f3e5c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:11.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.940+0000 7f3e7cc00640 1 -- 172.21.15.112:0/1671712387 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=186}) -- 0x7f3e5c073990 con 0x7f3e8015b830 2024-09-12T02:53:11.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.940+0000 7f3e7fe00640 1 --2- 172.21.15.112:0/1671712387 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3e5c06be60 0x7f3e5c06e320 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3e70001750 tx=0x7f3e70009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:11.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:11.944+0000 7f3e7cc00640 1 -- 172.21.15.112:0/1671712387 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3e80146970 con 0x7f3e8015b830 2024-09-12T02:53:12.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.119+0000 7f3e87200640 1 -- 172.21.15.112:0/1671712387 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f3e800730d0 con 0x7f3e8015b830 2024-09-12T02:53:12.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.121+0000 7f3e7cc00640 1 -- 172.21.15.112:0/1671712387 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v185) ==== 81+0+34337 (secure 0 0 0) 0x7f3e78079be0 con 0x7f3e8015b830 2024-09-12T02:53:12.122 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:53:12.122 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:53:12.122 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 185, 2024-09-12T02:53:12.122 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:53:12.122 INFO:teuthology.orchestra.run.smithi112.stdout: "created": "2024-09-12T02:41:36.162095+0000", 2024-09-12T02:53:12.123 INFO:teuthology.orchestra.run.smithi112.stdout: "modified": "2024-09-12T02:53:11.064679+0000", 2024-09-12T02:53:12.123 INFO:teuthology.orchestra.run.smithi112.stdout: "last_up_change": "2024-09-12T02:41:42.191169+0000", 2024-09-12T02:53:12.123 INFO:teuthology.orchestra.run.smithi112.stdout: "last_in_change": "2024-09-12T02:41:39.036600+0000", 2024-09-12T02:53:12.123 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:53:12.123 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_num": 5799936, 2024-09-12T02:53:12.123 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_set": [ 2024-09-12T02:53:12.123 INFO:teuthology.orchestra.run.smithi112.stdout: "pglog_hardlimit", 2024-09-12T02:53:12.123 INFO:teuthology.orchestra.run.smithi112.stdout: "purged_snapdirs", 2024-09-12T02:53:12.123 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_deletes", 2024-09-12T02:53:12.123 INFO:teuthology.orchestra.run.smithi112.stdout: "sortbitwise" 2024-09-12T02:53:12.123 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:12.123 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_version": 4, 2024-09-12T02:53:12.123 INFO:teuthology.orchestra.run.smithi112.stdout: "full_ratio": 0.69999998807907104, 2024-09-12T02:53:12.123 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-12T02:53:12.123 INFO:teuthology.orchestra.run.smithi112.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-12T02:53:12.124 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_snapshot": "", 2024-09-12T02:53:12.124 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_max": 23, 2024-09-12T02:53:12.124 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd": 8, 2024-09-12T02:53:12.124 INFO:teuthology.orchestra.run.smithi112.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:53:12.124 INFO:teuthology.orchestra.run.smithi112.stdout: "min_compat_client": "jewel", 2024-09-12T02:53:12.124 INFO:teuthology.orchestra.run.smithi112.stdout: "require_osd_release": "squid", 2024-09-12T02:53:12.124 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_crimson": false, 2024-09-12T02:53:12.124 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-12T02:53:12.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.124 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 1, 2024-09-12T02:53:12.124 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": ".mgr", 2024-09-12T02:53:12.124 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:41:43.011599+0000", 2024-09-12T02:53:12.124 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:53:12.124 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:53:12.125 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:53:12.125 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:53:12.125 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:53:12.125 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:53:12.125 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:53:12.125 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:53:12.125 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:53:12.125 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:53:12.125 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:53:12.125 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:53:12.125 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:53:12.125 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 1, 2024-09-12T02:53:12.125 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 1, 2024-09-12T02:53:12.125 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 1, 2024-09-12T02:53:12.126 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 1, 2024-09-12T02:53:12.126 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 1, 2024-09-12T02:53:12.126 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:53:12.126 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:53:12.126 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:53:12.126 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:53:12.126 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:53:12.126 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:53:12.126 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:53:12.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.126 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "109", 2024-09-12T02:53:12.126 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:53:12.126 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:53:12.126 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:53:12.127 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:53:12.127 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:53:12.127 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:53:12.127 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:53:12.127 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:53:12.127 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:53:12.127 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:53:12.127 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:53:12.127 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:53:12.127 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:53:12.127 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:53:12.127 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:53:12.127 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:53:12.127 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:53:12.128 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:53:12.128 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:53:12.128 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:53:12.128 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:53:12.128 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:53:12.128 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:53:12.128 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:53:12.128 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:53:12.128 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:53:12.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.128 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:53:12.128 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:53:12.129 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:53:12.129 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:53:12.129 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:53:12.129 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:53:12.129 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:53:12.129 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:53:12.129 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:53:12.129 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:53:12.129 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:53:12.129 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:53:12.129 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_max": 32, 2024-09-12T02:53:12.129 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 1 2024-09-12T02:53:12.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.129 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:53:12.130 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": {} 2024-09-12T02:53:12.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.130 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:53:12.130 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:53:12.130 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 8, 2024-09-12T02:53:12.130 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 8, 2024-09-12T02:53:12.130 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 0.25, 2024-09-12T02:53:12.130 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:53:12.130 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:53:12.130 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:53:12.130 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:53:12.130 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:53:12.130 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.131 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 22, 2024-09-12T02:53:12.131 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:53:12.131 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:52:51.909503+0000", 2024-09-12T02:53:12.131 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:53:12.131 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:53:12.131 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:53:12.131 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:53:12.131 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:53:12.131 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:53:12.131 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:53:12.131 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:53:12.131 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:53:12.131 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:53:12.132 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:53:12.132 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:53:12.132 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:53:12.132 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 32, 2024-09-12T02:53:12.132 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 32, 2024-09-12T02:53:12.132 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 32, 2024-09-12T02:53:12.132 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 32, 2024-09-12T02:53:12.132 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 32, 2024-09-12T02:53:12.132 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:53:12.132 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:53:12.132 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:53:12.132 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:53:12.132 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:53:12.132 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:53:12.133 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:53:12.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.133 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "182", 2024-09-12T02:53:12.133 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:53:12.133 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:53:12.133 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:53:12.133 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:53:12.133 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:53:12.133 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:53:12.133 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:53:12.133 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:53:12.133 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:53:12.133 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:53:12.133 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:53:12.134 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:53:12.134 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:53:12.134 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:53:12.134 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:53:12.134 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:53:12.134 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:53:12.134 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:53:12.134 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:53:12.134 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:53:12.134 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:53:12.134 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:53:12.134 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:53:12.134 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:53:12.134 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:53:12.135 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:53:12.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.135 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:53:12.135 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:53:12.135 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:53:12.135 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:53:12.135 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:53:12.135 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:53:12.135 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:53:12.135 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:53:12.135 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:53:12.135 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:53:12.135 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:53:12.136 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:53:12.136 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:53:12.136 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 16, 2024-09-12T02:53:12.136 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_priority": 5 2024-09-12T02:53:12.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.136 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:53:12.136 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:53:12.136 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": "cephfs" 2024-09-12T02:53:12.136 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.136 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:53:12.136 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:53:12.137 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 2, 2024-09-12T02:53:12.137 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 2, 2024-09-12T02:53:12.137 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:53:12.137 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:53:12.137 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:53:12.137 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:53:12.137 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:53:12.137 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:53:12.137 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.137 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 23, 2024-09-12T02:53:12.137 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_data", 2024-09-12T02:53:12.137 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:52:53.146578+0000", 2024-09-12T02:53:12.138 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1027, 2024-09-12T02:53:12.138 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-12T02:53:12.138 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:53:12.138 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:53:12.138 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:53:12.138 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:53:12.138 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:53:12.138 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:53:12.138 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:53:12.138 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:53:12.138 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:53:12.138 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:53:12.138 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:53:12.139 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 64, 2024-09-12T02:53:12.139 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 64, 2024-09-12T02:53:12.139 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 64, 2024-09-12T02:53:12.139 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 64, 2024-09-12T02:53:12.139 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 64, 2024-09-12T02:53:12.139 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:53:12.139 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:53:12.139 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:53:12.139 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:53:12.139 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:53:12.139 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:53:12.139 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:53:12.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.140 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "185", 2024-09-12T02:53:12.140 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:53:12.140 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:53:12.140 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:53:12.140 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:53:12.140 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:53:12.140 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:53:12.140 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:53:12.140 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:53:12.140 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:53:12.140 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 33554432, 2024-09-12T02:53:12.140 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:53:12.140 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:53:12.140 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:53:12.141 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:53:12.141 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:53:12.141 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:53:12.141 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:53:12.141 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:53:12.141 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:53:12.141 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:53:12.141 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:53:12.141 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:53:12.141 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:53:12.141 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:53:12.141 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:53:12.141 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:53:12.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.142 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:53:12.142 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:53:12.142 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:53:12.142 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:53:12.142 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:53:12.142 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:53:12.142 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:53:12.142 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:53:12.142 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:53:12.142 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:53:12.142 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:53:12.142 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:53:12.143 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 64, 2024-09-12T02:53:12.143 INFO:teuthology.orchestra.run.smithi112.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:53:12.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.143 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:53:12.143 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:53:12.143 INFO:teuthology.orchestra.run.smithi112.stdout: "data": "cephfs" 2024-09-12T02:53:12.143 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.143 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:53:12.143 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:53:12.143 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.3799999952316284, 2024-09-12T02:53:12.143 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.3799999952316284, 2024-09-12T02:53:12.143 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:53:12.144 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-12T02:53:12.144 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-12T02:53:12.144 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:53:12.144 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:53:12.144 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:53:12.144 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.144 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.144 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:12.144 INFO:teuthology.orchestra.run.smithi112.stdout: "osds": [ 2024-09-12T02:53:12.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.144 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:53:12.144 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:12.144 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:12.145 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:12.145 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:12.145 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:12.145 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:12.145 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:12.145 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:12.145 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:12.145 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:12.145 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:12.145 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:12.145 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.145 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.145 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6800", 2024-09-12T02:53:12.146 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:12.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.146 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.146 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6801", 2024-09-12T02:53:12.146 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:12.146 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.146 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.146 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:12.146 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.146 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.146 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6802", 2024-09-12T02:53:12.146 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:12.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.147 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.147 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6803", 2024-09-12T02:53:12.147 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:12.147 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.147 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.147 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:12.147 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.147 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.147 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6806", 2024-09-12T02:53:12.147 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:12.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.148 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.148 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6807", 2024-09-12T02:53:12.148 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:12.148 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.148 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.148 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:12.148 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.148 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.148 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6804", 2024-09-12T02:53:12.148 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:12.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.149 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.149 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6805", 2024-09-12T02:53:12.149 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:12.149 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.149 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.149 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6801/821571304", 2024-09-12T02:53:12.149 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6803/821571304", 2024-09-12T02:53:12.149 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6807/821571304", 2024-09-12T02:53:12.149 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6805/821571304", 2024-09-12T02:53:12.149 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:12.150 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:12.150 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:12.150 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.150 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:53:12.150 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:12.150 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:12.150 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:12.150 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:12.150 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:12.150 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:12.150 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:12.151 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:12.151 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:12.151 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:12.151 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:12.151 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:12.151 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.151 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.151 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6808", 2024-09-12T02:53:12.151 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:12.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.151 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.152 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6809", 2024-09-12T02:53:12.152 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:12.152 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.152 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.152 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:12.152 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.152 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.152 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6810", 2024-09-12T02:53:12.152 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:12.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.153 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.153 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6811", 2024-09-12T02:53:12.153 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:12.153 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.153 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.153 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:12.153 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.153 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.153 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6814", 2024-09-12T02:53:12.153 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:12.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.154 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.154 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6815", 2024-09-12T02:53:12.154 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:12.154 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.154 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.154 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:12.154 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.154 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.154 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6812", 2024-09-12T02:53:12.154 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:12.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.155 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.155 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6813", 2024-09-12T02:53:12.155 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:12.155 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.155 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.155 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6809/2642068641", 2024-09-12T02:53:12.155 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6811/2642068641", 2024-09-12T02:53:12.155 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6815/2642068641", 2024-09-12T02:53:12.155 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6813/2642068641", 2024-09-12T02:53:12.155 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:12.155 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:12.155 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:12.155 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.156 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:53:12.156 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:12.156 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:12.156 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:12.156 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:12.156 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:12.156 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:12.156 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:12.156 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:12.156 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:12.156 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:12.157 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:12.157 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:12.157 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.157 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.157 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6816", 2024-09-12T02:53:12.157 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:12.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.157 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.157 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6817", 2024-09-12T02:53:12.157 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:12.157 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.157 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.157 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:12.158 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.158 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.158 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6818", 2024-09-12T02:53:12.158 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:12.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.158 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.158 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6819", 2024-09-12T02:53:12.158 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:12.158 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.158 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.158 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:12.159 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.159 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.159 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6822", 2024-09-12T02:53:12.159 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:12.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.159 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.159 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6823", 2024-09-12T02:53:12.159 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:12.159 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.159 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.160 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:12.160 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.160 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.160 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6820", 2024-09-12T02:53:12.160 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:12.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.160 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.160 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6821", 2024-09-12T02:53:12.160 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:12.160 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.160 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.160 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6817/3365688807", 2024-09-12T02:53:12.161 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6819/3365688807", 2024-09-12T02:53:12.161 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6823/3365688807", 2024-09-12T02:53:12.161 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6821/3365688807", 2024-09-12T02:53:12.161 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:12.161 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:12.161 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:12.161 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.161 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:53:12.161 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:12.161 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:12.161 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:12.161 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:12.162 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:12.162 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:12.162 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:12.162 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:12.162 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:12.162 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:12.162 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:12.162 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:12.162 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.162 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.162 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6824", 2024-09-12T02:53:12.163 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:12.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.163 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.163 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6825", 2024-09-12T02:53:12.163 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:12.163 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.163 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.163 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:12.163 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.163 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.163 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6826", 2024-09-12T02:53:12.164 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:12.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.164 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.164 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6827", 2024-09-12T02:53:12.164 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:12.164 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.164 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.164 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:12.164 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.164 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.164 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6830", 2024-09-12T02:53:12.164 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:12.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.165 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.165 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6831", 2024-09-12T02:53:12.165 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:12.165 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.165 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.165 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:12.165 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.165 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.165 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6828", 2024-09-12T02:53:12.165 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:12.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.166 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.166 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6829", 2024-09-12T02:53:12.166 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:12.166 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.166 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.166 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6825/231774278", 2024-09-12T02:53:12.166 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6827/231774278", 2024-09-12T02:53:12.166 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6831/231774278", 2024-09-12T02:53:12.166 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6829/231774278", 2024-09-12T02:53:12.166 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:12.166 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:12.167 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:12.167 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.167 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:53:12.167 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:12.167 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:12.167 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:12.167 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:12.167 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:12.167 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:12.167 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:12.167 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:12.167 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:12.168 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:12.168 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:12.168 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:12.168 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.168 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.168 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6800", 2024-09-12T02:53:12.168 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:12.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.168 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.168 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6801", 2024-09-12T02:53:12.168 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:12.169 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.169 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.169 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:12.169 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.169 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.169 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6802", 2024-09-12T02:53:12.169 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:12.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.169 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.169 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6803", 2024-09-12T02:53:12.169 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:12.170 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.170 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.170 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:12.170 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.170 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.170 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6806", 2024-09-12T02:53:12.170 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:12.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.170 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.170 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6807", 2024-09-12T02:53:12.170 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:12.171 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.171 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.171 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:12.171 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.171 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.171 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6804", 2024-09-12T02:53:12.171 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:12.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.171 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.172 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6805", 2024-09-12T02:53:12.172 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:12.172 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.172 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.172 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6801/3671178153", 2024-09-12T02:53:12.172 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6803/3671178153", 2024-09-12T02:53:12.172 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6807/3671178153", 2024-09-12T02:53:12.172 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6805/3671178153", 2024-09-12T02:53:12.172 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:12.172 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:12.172 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:12.172 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.173 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:53:12.173 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:12.173 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:12.173 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:12.173 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:12.173 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:12.173 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:12.173 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:12.173 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:12.173 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:12.173 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:12.173 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:12.173 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:12.173 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.174 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.174 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6808", 2024-09-12T02:53:12.174 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:12.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.174 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.174 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6809", 2024-09-12T02:53:12.174 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:12.174 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.174 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.174 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:12.174 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.175 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.175 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6810", 2024-09-12T02:53:12.175 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:12.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.175 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.175 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6811", 2024-09-12T02:53:12.175 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:12.175 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.175 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.175 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:12.175 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.176 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.176 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6817", 2024-09-12T02:53:12.176 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:12.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.176 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.176 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6819", 2024-09-12T02:53:12.176 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:12.176 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.176 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.176 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:12.176 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.177 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.177 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6812", 2024-09-12T02:53:12.177 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:12.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.177 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.177 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6815", 2024-09-12T02:53:12.177 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:12.177 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.177 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.177 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6809/3193706134", 2024-09-12T02:53:12.177 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6811/3193706134", 2024-09-12T02:53:12.178 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6819/3193706134", 2024-09-12T02:53:12.178 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6815/3193706134", 2024-09-12T02:53:12.178 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:12.178 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:12.178 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:12.178 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.178 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:53:12.178 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:12.178 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:12.178 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:12.178 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:12.178 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:12.179 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:12.179 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:12.179 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:12.179 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:12.179 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:12.179 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:12.179 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:12.179 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.179 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.179 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6813", 2024-09-12T02:53:12.179 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:12.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.179 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.180 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6814", 2024-09-12T02:53:12.180 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:12.180 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.180 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.180 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:12.180 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.180 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.180 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6816", 2024-09-12T02:53:12.180 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:12.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.180 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.181 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6818", 2024-09-12T02:53:12.181 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:12.181 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.181 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.181 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:12.181 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.181 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.181 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6822", 2024-09-12T02:53:12.181 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:12.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.182 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.182 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6823", 2024-09-12T02:53:12.182 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:12.182 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.182 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.182 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:12.182 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.182 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.182 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6820", 2024-09-12T02:53:12.182 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:12.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.183 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.183 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6821", 2024-09-12T02:53:12.183 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:12.183 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.183 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.183 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6814/3738813293", 2024-09-12T02:53:12.183 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6818/3738813293", 2024-09-12T02:53:12.183 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6823/3738813293", 2024-09-12T02:53:12.183 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6821/3738813293", 2024-09-12T02:53:12.183 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:12.183 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:12.183 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:12.183 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.184 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:53:12.184 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:12.184 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:12.184 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:12.184 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:12.184 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:12.184 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:12.184 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:12.184 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:12.184 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:12.184 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:12.185 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:12.185 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:12.185 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.185 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.185 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6824", 2024-09-12T02:53:12.185 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:12.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.185 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.185 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6825", 2024-09-12T02:53:12.185 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:12.186 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.186 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.186 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:12.186 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.186 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.186 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6826", 2024-09-12T02:53:12.186 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:12.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.186 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.186 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6827", 2024-09-12T02:53:12.186 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:12.187 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.187 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.187 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:12.187 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.187 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.187 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6830", 2024-09-12T02:53:12.187 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:12.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.187 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.187 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6831", 2024-09-12T02:53:12.187 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:12.188 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.188 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.188 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:12.188 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:12.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.188 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:12.188 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6828", 2024-09-12T02:53:12.188 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:12.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.188 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:12.189 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6829", 2024-09-12T02:53:12.189 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:12.189 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.189 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.189 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6825/1421932609", 2024-09-12T02:53:12.189 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6827/1421932609", 2024-09-12T02:53:12.189 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6831/1421932609", 2024-09-12T02:53:12.189 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6829/1421932609", 2024-09-12T02:53:12.189 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:12.189 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:12.189 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:12.189 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:12.189 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.190 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:12.190 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_xinfo": [ 2024-09-12T02:53:12.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.190 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:53:12.190 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:12.190 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:12.190 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:12.190 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:12.190 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:12.190 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.220641+0000", 2024-09-12T02:53:12.190 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:12.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.190 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:53:12.191 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:12.191 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:12.191 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:12.191 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:12.191 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:12.191 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312574+0000", 2024-09-12T02:53:12.191 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:12.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.191 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:53:12.191 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:12.191 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:12.191 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:12.192 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:12.192 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:12.192 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.282771+0000", 2024-09-12T02:53:12.192 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:12.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.192 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:53:12.192 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:12.192 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:12.192 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:12.192 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:12.192 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:12.192 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.260478+0000", 2024-09-12T02:53:12.192 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:12.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.193 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:53:12.193 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:12.193 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:12.193 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:12.193 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:12.193 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:12.193 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.273397+0000", 2024-09-12T02:53:12.193 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:12.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.193 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:53:12.194 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:12.194 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:12.194 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:12.194 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:12.194 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:12.194 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312452+0000", 2024-09-12T02:53:12.194 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:12.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.194 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:53:12.194 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:12.194 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:12.194 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:12.195 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:12.195 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:12.195 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.308965+0000", 2024-09-12T02:53:12.195 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:12.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:12.195 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:53:12.195 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:12.195 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:12.195 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:12.195 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:12.195 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:12.195 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.337842+0000", 2024-09-12T02:53:12.195 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:12.196 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.196 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:12.196 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap": [], 2024-09-12T02:53:12.196 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_items": [], 2024-09-12T02:53:12.196 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_primaries": [], 2024-09-12T02:53:12.196 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_temp": [], 2024-09-12T02:53:12.196 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_temp": [], 2024-09-12T02:53:12.196 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklist": {}, 2024-09-12T02:53:12.196 INFO:teuthology.orchestra.run.smithi112.stdout: "range_blocklist": {}, 2024-09-12T02:53:12.196 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profiles": { 2024-09-12T02:53:12.196 INFO:teuthology.orchestra.run.smithi112.stdout: "default": { 2024-09-12T02:53:12.196 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-failure-domain": "osd", 2024-09-12T02:53:12.197 INFO:teuthology.orchestra.run.smithi112.stdout: "k": "2", 2024-09-12T02:53:12.197 INFO:teuthology.orchestra.run.smithi112.stdout: "m": "1", 2024-09-12T02:53:12.197 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin": "jerasure", 2024-09-12T02:53:12.197 INFO:teuthology.orchestra.run.smithi112.stdout: "technique": "reed_sol_van" 2024-09-12T02:53:12.197 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:12.197 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps_queue": [], 2024-09-12T02:53:12.197 INFO:teuthology.orchestra.run.smithi112.stdout: "new_removed_snaps": [], 2024-09-12T02:53:12.197 INFO:teuthology.orchestra.run.smithi112.stdout: "new_purged_snaps": [], 2024-09-12T02:53:12.197 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_node_flags": {}, 2024-09-12T02:53:12.197 INFO:teuthology.orchestra.run.smithi112.stdout: "device_class_flags": {}, 2024-09-12T02:53:12.197 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode": { 2024-09-12T02:53:12.197 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_enabled": false, 2024-09-12T02:53:12.197 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_bucket_count": 0, 2024-09-12T02:53:12.198 INFO:teuthology.orchestra.run.smithi112.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:53:12.198 INFO:teuthology.orchestra.run.smithi112.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:53:12.198 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_bucket": 0 2024-09-12T02:53:12.198 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:12.198 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:53:12.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.123+0000 7f3e87200640 1 -- 172.21.15.112:0/1671712387 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3e5c06be60 msgr2=0x7f3e5c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:12.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.123+0000 7f3e87200640 1 --2- 172.21.15.112:0/1671712387 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3e5c06be60 0x7f3e5c06e320 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3e70001750 tx=0x7f3e70009040 comp rx=0 tx=0).stop 2024-09-12T02:53:12.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.123+0000 7f3e87200640 1 -- 172.21.15.112:0/1671712387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e8015b830 msgr2=0x7f3e801e80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:12.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.123+0000 7f3e87200640 1 --2- 172.21.15.112:0/1671712387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e8015b830 0x7f3e801e80e0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f3e78002080 tx=0x7f3e78001360 comp rx=0 tx=0).stop 2024-09-12T02:53:12.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.123+0000 7f3e87200640 1 -- 172.21.15.112:0/1671712387 shutdown_connections 2024-09-12T02:53:12.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.123+0000 7f3e87200640 1 --2- 172.21.15.112:0/1671712387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e8015b830 0x7f3e801e80e0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:12.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.123+0000 7f3e87200640 1 --2- 172.21.15.112:0/1671712387 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e8015b3b0 0x7f3e801e7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:12.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.123+0000 7f3e87200640 1 --2- 172.21.15.112:0/1671712387 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3e5c06be60 0x7f3e5c06e320 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:12.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.123+0000 7f3e87200640 1 --2- 172.21.15.112:0/1671712387 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e64004d40 0x7f3e80146430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:12.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.123+0000 7f3e87200640 1 -- 172.21.15.112:0/1671712387 >> 172.21.15.112:0/1671712387 conn(0x7f3e8006bbd0 msgr2=0x7f3e8006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:12.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.123+0000 7f3e87200640 1 -- 172.21.15.112:0/1671712387 shutdown_connections 2024-09-12T02:53:12.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.123+0000 7f3e87200640 1 -- 172.21.15.112:0/1671712387 wait complete. 2024-09-12T02:53:12.201 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:53:12.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.353+0000 7f2182a00640 1 Processor -- start 2024-09-12T02:53:12.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.353+0000 7f2182a00640 1 -- start start 2024-09-12T02:53:12.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.354+0000 7f2182a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f217c0b4ec0 0x7f217c0b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:12.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.354+0000 7f2182a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f217c0b54a0 con 0x7f217c15b9d0 2024-09-12T02:53:12.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.354+0000 7f2182a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f217c0b3af0 con 0x7f217c06f600 2024-09-12T02:53:12.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.354+0000 7f2182a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f217c0b3dd0 con 0x7f217c0b4ec0 2024-09-12T02:53:12.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.355+0000 7f217be00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f217c15b9d0 0x7f217c06eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46850/0 (socket says 172.21.15.112:46850) 2024-09-12T02:53:12.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.355+0000 7f217be00640 1 -- 172.21.15.112:0/474700671 learned_addr learned my addr 172.21.15.112:0/474700671 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:53:12.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.355+0000 7f2180a00640 1 --2- 172.21.15.112:0/474700671 >> v2:172.21.15.137:3300/0 conn(0x7f217c0b4ec0 0x7f217c0b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:12.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.355+0000 7f217aa00640 1 -- 172.21.15.112:0/474700671 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 45455028 0 0) 0x7f217c0b54a0 con 0x7f217c15b9d0 2024-09-12T02:53:12.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.355+0000 7f217aa00640 1 -- 172.21.15.112:0/474700671 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2160003520 con 0x7f217c15b9d0 2024-09-12T02:53:12.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.355+0000 7f217aa00640 1 -- 172.21.15.112:0/474700671 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1056132284 0 0) 0x7f2160003520 con 0x7f217c15b9d0 2024-09-12T02:53:12.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.355+0000 7f217aa00640 1 -- 172.21.15.112:0/474700671 >> v2:172.21.15.137:3300/0 conn(0x7f217c0b4ec0 msgr2=0x7f217c0b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:12.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.355+0000 7f217aa00640 1 --2- 172.21.15.112:0/474700671 >> v2:172.21.15.137:3300/0 conn(0x7f217c0b4ec0 0x7f217c0b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:12.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.355+0000 7f217aa00640 1 -- 172.21.15.112:0/474700671 >> v1:172.21.15.137:6789/0 conn(0x7f217c06f600 legacy=0x7f217c0cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:12.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.355+0000 7f217aa00640 1 -- 172.21.15.112:0/474700671 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f217c0b40b0 con 0x7f217c15b9d0 2024-09-12T02:53:12.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.355+0000 7f217aa00640 1 -- 172.21.15.112:0/474700671 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f216c001670 con 0x7f217c15b9d0 2024-09-12T02:53:12.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.355+0000 7f217aa00640 1 -- 172.21.15.112:0/474700671 >> v1:172.21.15.112:6789/0 conn(0x7f217c15b9d0 legacy=0x7f217c06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:12.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.355+0000 7f217aa00640 1 --2- 172.21.15.112:0/474700671 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f21600039b0 0x7f2160003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:12.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.356+0000 7f217aa00640 1 --2- 172.21.15.112:0/474700671 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2160004800 0x7f2160004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:12.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.356+0000 7f217aa00640 1 --2- 172.21.15.112:0/474700671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21600051c0 0x7f216000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:12.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.356+0000 7f217aa00640 1 -- 172.21.15.112:0/474700671 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f217c0b3dd0 con 0x7f21600051c0 2024-09-12T02:53:12.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.356+0000 7f217aa00640 1 -- 172.21.15.112:0/474700671 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f216000c160 con 0x7f2160004800 2024-09-12T02:53:12.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.356+0000 7f217aa00640 1 -- 172.21.15.112:0/474700671 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f216000e570 con 0x7f21600039b0 2024-09-12T02:53:12.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.356+0000 7f2180a00640 1 --2- 172.21.15.112:0/474700671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21600051c0 0x7f216000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:12.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.356+0000 7f217be00640 1 --2- 172.21.15.112:0/474700671 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f21600039b0 0x7f2160003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:12.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.356+0000 7f217b400640 1 --2- 172.21.15.112:0/474700671 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2160004800 0x7f2160004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:12.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.356+0000 7f2180a00640 1 -- 172.21.15.112:0/474700671 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f21600039b0 msgr2=0x7f2160003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:12.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.356+0000 7f2180a00640 1 --2- 172.21.15.112:0/474700671 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f21600039b0 0x7f2160003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:12.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.356+0000 7f2180a00640 1 -- 172.21.15.112:0/474700671 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2160004800 msgr2=0x7f2160004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:12.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.356+0000 7f2180a00640 1 --2- 172.21.15.112:0/474700671 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2160004800 0x7f2160004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:12.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.356+0000 7f2180a00640 1 -- 172.21.15.112:0/474700671 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2160003520 con 0x7f21600051c0 2024-09-12T02:53:12.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.357+0000 7f2180a00640 1 -- 172.21.15.112:0/474700671 reap_dead start 2024-09-12T02:53:12.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.357+0000 7f2180a00640 1 --2- 172.21.15.112:0/474700671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21600051c0 0x7f216000b9c0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f2174009fc0 tx=0x7f2160005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a57a2e295afabb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:12.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.357+0000 7f217aa00640 1 -- 172.21.15.112:0/474700671 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2174035020 con 0x7f21600051c0 2024-09-12T02:53:12.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.357+0000 7f217aa00640 1 -- 172.21.15.112:0/474700671 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2174003bd0 con 0x7f21600051c0 2024-09-12T02:53:12.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.357+0000 7f217aa00640 1 -- 172.21.15.112:0/474700671 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2174009c10 con 0x7f21600051c0 2024-09-12T02:53:12.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.358+0000 7f2182a00640 1 -- 172.21.15.112:0/474700671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21600051c0 msgr2=0x7f216000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:12.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.358+0000 7f2182a00640 1 --2- 172.21.15.112:0/474700671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21600051c0 0x7f216000b9c0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f2174009fc0 tx=0x7f2160005830 comp rx=0 tx=0).stop 2024-09-12T02:53:12.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.358+0000 7f2182a00640 1 -- 172.21.15.112:0/474700671 shutdown_connections 2024-09-12T02:53:12.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.358+0000 7f2182a00640 1 --2- 172.21.15.112:0/474700671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21600051c0 0x7f216000b9c0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:12.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.358+0000 7f2182a00640 1 -- 172.21.15.112:0/474700671 >> 172.21.15.112:0/474700671 conn(0x7f217c06bbd0 msgr2=0x7f217c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:12.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.358+0000 7f2182a00640 1 -- 172.21.15.112:0/474700671 shutdown_connections 2024-09-12T02:53:12.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.358+0000 7f2182a00640 1 -- 172.21.15.112:0/474700671 wait complete. 2024-09-12T02:53:12.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.360+0000 7f2182a00640 1 Processor -- start 2024-09-12T02:53:12.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.360+0000 7f2182a00640 1 -- start start 2024-09-12T02:53:12.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.361+0000 7f2182a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f21600051c0 0x7f217c0cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:12.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.361+0000 7f2182a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f217c150680 0x7f217c14faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:12.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.361+0000 7f2182a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f217c15e6c0 0x7f217c15eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:12.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.361+0000 7f2182a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f217c0b4750 con 0x7f217c150680 2024-09-12T02:53:12.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.361+0000 7f2182a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f217c0b45d0 con 0x7f21600051c0 2024-09-12T02:53:12.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.361+0000 7f2182a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f217c0b48d0 con 0x7f217c15e6c0 2024-09-12T02:53:12.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.361+0000 7f217b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f217c150680 0x7f217c14faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:12.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.361+0000 7f217b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f217c150680 0x7f217c14faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33296/0 (socket says 172.21.15.112:33296) 2024-09-12T02:53:12.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.361+0000 7f217b400640 1 -- 172.21.15.112:0/1362115115 learned_addr learned my addr 172.21.15.112:0/1362115115 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:12.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.361+0000 7f217be00640 1 --2- 172.21.15.112:0/1362115115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f21600051c0 0x7f217c0cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:12.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.361+0000 7f2180a00640 1 --2- 172.21.15.112:0/1362115115 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f217c15e6c0 0x7f217c15eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:12.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.361+0000 7f217b400640 1 -- 172.21.15.112:0/1362115115 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f217c15e6c0 msgr2=0x7f217c15eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:12.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.361+0000 7f217b400640 1 --2- 172.21.15.112:0/1362115115 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f217c15e6c0 0x7f217c15eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:12.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.361+0000 7f217b400640 1 -- 172.21.15.112:0/1362115115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f21600051c0 msgr2=0x7f217c0cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:12.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.361+0000 7f217b400640 1 --2- 172.21.15.112:0/1362115115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f21600051c0 0x7f217c0cdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:12.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.361+0000 7f217b400640 1 -- 172.21.15.112:0/1362115115 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f217c15d680 con 0x7f217c150680 2024-09-12T02:53:12.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.362+0000 7f217b400640 1 --2- 172.21.15.112:0/1362115115 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f217c150680 0x7f217c14faa0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f216800f580 tx=0x7f216800fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:12.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.362+0000 7f2173e00640 1 -- 172.21.15.112:0/1362115115 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21680052e0 con 0x7f217c150680 2024-09-12T02:53:12.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.362+0000 7f2173e00640 1 -- 172.21.15.112:0/1362115115 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2168018070 con 0x7f217c150680 2024-09-12T02:53:12.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.362+0000 7f2173e00640 1 -- 172.21.15.112:0/1362115115 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2168003860 con 0x7f217c150680 2024-09-12T02:53:12.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.362+0000 7f2182a00640 1 -- 172.21.15.112:0/1362115115 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f217c15d900 con 0x7f217c150680 2024-09-12T02:53:12.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.362+0000 7f2182a00640 1 -- 172.21.15.112:0/1362115115 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f217c15dec0 con 0x7f217c150680 2024-09-12T02:53:12.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.363+0000 7f2182a00640 1 -- 172.21.15.112:0/1362115115 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f217c068a30 con 0x7f217c150680 2024-09-12T02:53:12.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.364+0000 7f2173e00640 1 -- 172.21.15.112:0/1362115115 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2168003a00 con 0x7f217c150680 2024-09-12T02:53:12.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.365+0000 7f2173e00640 1 --2- 172.21.15.112:0/1362115115 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f215c06be30 0x7f215c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:12.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.365+0000 7f2173e00640 1 -- 172.21.15.112:0/1362115115 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7f216808ab00 con 0x7f217c150680 2024-09-12T02:53:12.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.366+0000 7f217be00640 1 --2- 172.21.15.112:0/1362115115 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f215c06be30 0x7f215c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:12.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.366+0000 7f2173e00640 1 -- 172.21.15.112:0/1362115115 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=186}) -- 0x7f215c073960 con 0x7f217c150680 2024-09-12T02:53:12.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.366+0000 7f217be00640 1 --2- 172.21.15.112:0/1362115115 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f215c06be30 0x7f215c06e2f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f216c0011e0 tx=0x7f216c000ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:12.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.370+0000 7f2173e00640 1 -- 172.21.15.112:0/1362115115 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f217c15d680 con 0x7f217c150680 2024-09-12T02:53:12.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.577+0000 7f2182a00640 1 -- 172.21.15.112:0/1362115115 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f217c0728c0 con 0x7f217c150680 2024-09-12T02:53:12.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.577+0000 7f2173e00640 1 -- 172.21.15.112:0/1362115115 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5233 (secure 0 0 0) 0x7f216808ae20 con 0x7f217c150680 2024-09-12T02:53:12.578 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:53:12.578 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":94,"btime":"2024-09-12T02:52:57:752799+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7177,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/119222923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":119222923},{"type":"v1","addr":"172.21.15.112:6837","nonce":119222923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7180,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/691058370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":691058370},{"type":"v1","addr":"172.21.15.137:6834","nonce":691058370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7854,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/1978579863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1978579863},{"type":"v1","addr":"172.21.15.112:6836","nonce":1978579863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:52:54.149640+0000","modified":"2024-09-12T02:52:57.153816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7860},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7860":{"gid":7860,"name":"b","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/1283773082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1283773082},{"type":"v1","addr":"172.21.15.137:6835","nonce":1283773082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7860,"qdb_cluster":[7860]},"id":11}]} 2024-09-12T02:53:12.579 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 94 2024-09-12T02:53:12.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.579+0000 7f2182a00640 1 -- 172.21.15.112:0/1362115115 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f215c06be30 msgr2=0x7f215c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:12.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.580+0000 7f2182a00640 1 --2- 172.21.15.112:0/1362115115 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f215c06be30 0x7f215c06e2f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f216c0011e0 tx=0x7f216c000ed0 comp rx=0 tx=0).stop 2024-09-12T02:53:12.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.580+0000 7f2182a00640 1 -- 172.21.15.112:0/1362115115 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f217c150680 msgr2=0x7f217c14faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:12.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.580+0000 7f2182a00640 1 --2- 172.21.15.112:0/1362115115 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f217c150680 0x7f217c14faa0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f216800f580 tx=0x7f216800fa40 comp rx=0 tx=0).stop 2024-09-12T02:53:12.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.580+0000 7f2182a00640 1 -- 172.21.15.112:0/1362115115 shutdown_connections 2024-09-12T02:53:12.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.580+0000 7f2182a00640 1 --2- 172.21.15.112:0/1362115115 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f217c15e6c0 0x7f217c15eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:12.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.580+0000 7f2182a00640 1 --2- 172.21.15.112:0/1362115115 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f217c150680 0x7f217c14faa0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:12.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.580+0000 7f2182a00640 1 --2- 172.21.15.112:0/1362115115 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f215c06be30 0x7f215c06e2f0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:12.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.580+0000 7f2182a00640 1 --2- 172.21.15.112:0/1362115115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f21600051c0 0x7f217c0cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:12.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.580+0000 7f2182a00640 1 -- 172.21.15.112:0/1362115115 >> 172.21.15.112:0/1362115115 conn(0x7f217c06bbd0 msgr2=0x7f217c158320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:12.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.580+0000 7f2182a00640 1 -- 172.21.15.112:0/1362115115 shutdown_connections 2024-09-12T02:53:12.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:12.580+0000 7f2182a00640 1 -- 172.21.15.112:0/1362115115 wait complete. 2024-09-12T02:53:12.597 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2024-09-12T02:53:12.781 INFO:teuthology.orchestra.run.smithi137.stdout:{"cluster_fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","whoami":0,"id":7860,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":18.037059384999999,"mdsmap_epoch":94,"osdmap_epoch":185,"osdmap_epoch_barrier":185,"uptime":23.115475833000001} 2024-09-12T02:53:12.781 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", "fs_name": "cephfs", "id": 7860, "mdsmap_epoch": 94, "osdmap_epoch": 185, "osdmap_epoch_barrier": 185, "rank_uptime": 18.037059385, "state": "up:active", "uptime": 23.115475833, "want_state": "up:active", "whoami": 0 } 2024-09-12T02:53:12.781 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:53:12.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:12.782 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2024-09-12T02:53:12.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:12.819 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2024-09-12T02:53:12.913 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-12T02:53:13.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.064+0000 7f5c6b400640 1 Processor -- start 2024-09-12T02:53:13.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.064+0000 7f5c6b400640 1 -- start start 2024-09-12T02:53:13.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.064+0000 7f5c6b400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5c640b0c50 0x7f5c640b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:13.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.064+0000 7f5c6b400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c6415b8c0 con 0x7f5c6415b4e0 2024-09-12T02:53:13.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.064+0000 7f5c6b400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c640b1b10 con 0x7f5c640ae460 2024-09-12T02:53:13.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.064+0000 7f5c6b400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f5c640b2940 con 0x7f5c640b0c50 2024-09-12T02:53:13.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.064+0000 7f5c68a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f5c6415b4e0 0x7f5c640b4110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46860/0 (socket says 172.21.15.112:46860) 2024-09-12T02:53:13.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.064+0000 7f5c68a00640 1 -- 172.21.15.112:0/4146570448 learned_addr learned my addr 172.21.15.112:0/4146570448 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:53:13.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.064+0000 7f5c5be00640 1 --2- 172.21.15.112:0/4146570448 >> v2:172.21.15.112:3300/0 conn(0x7f5c640b0c50 0x7f5c640b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:13.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.065+0000 7f5c63e00640 1 -- 172.21.15.112:0/4146570448 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3456006962 0 0) 0x7f5c6415b8c0 con 0x7f5c6415b4e0 2024-09-12T02:53:13.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.065+0000 7f5c5be00640 1 -- 172.21.15.112:0/4146570448 >> v1:172.21.15.137:6789/0 conn(0x7f5c640ae460 legacy=0x7f5c640ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:13.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.065+0000 7f5c5be00640 1 -- 172.21.15.112:0/4146570448 >> v1:172.21.15.112:6789/0 conn(0x7f5c6415b4e0 legacy=0x7f5c640b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:13.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.065+0000 7f5c5be00640 1 -- 172.21.15.112:0/4146570448 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c640b1dc0 con 0x7f5c640b0c50 2024-09-12T02:53:13.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.066+0000 7f5c5be00640 1 --2- 172.21.15.112:0/4146570448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c640b0c50 0x7f5c640b4820 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c0097a0 tx=0x7f5c4c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0cb34feb6dee350 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:13.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.066+0000 7f5c63e00640 1 -- 172.21.15.112:0/4146570448 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c037070 con 0x7f5c640b0c50 2024-09-12T02:53:13.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.066+0000 7f5c63e00640 1 -- 172.21.15.112:0/4146570448 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c4c032440 con 0x7f5c640b0c50 2024-09-12T02:53:13.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.066+0000 7f5c63e00640 1 -- 172.21.15.112:0/4146570448 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c032810 con 0x7f5c640b0c50 2024-09-12T02:53:13.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.067+0000 7f5c6b400640 1 -- 172.21.15.112:0/4146570448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c640b0c50 msgr2=0x7f5c640b4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:13.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.067+0000 7f5c6b400640 1 --2- 172.21.15.112:0/4146570448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c640b0c50 0x7f5c640b4820 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c0097a0 tx=0x7f5c4c02a1a0 comp rx=0 tx=0).stop 2024-09-12T02:53:13.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.067+0000 7f5c6b400640 1 -- 172.21.15.112:0/4146570448 shutdown_connections 2024-09-12T02:53:13.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.067+0000 7f5c6b400640 1 --2- 172.21.15.112:0/4146570448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c640b0c50 0x7f5c640b4820 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:13.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.067+0000 7f5c6b400640 1 -- 172.21.15.112:0/4146570448 >> 172.21.15.112:0/4146570448 conn(0x7f5c640b2e10 msgr2=0x7f5c640b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:13.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.067+0000 7f5c6b400640 1 -- 172.21.15.112:0/4146570448 shutdown_connections 2024-09-12T02:53:13.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.067+0000 7f5c6b400640 1 -- 172.21.15.112:0/4146570448 wait complete. 2024-09-12T02:53:13.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.068+0000 7f5c6b400640 1 Processor -- start 2024-09-12T02:53:13.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.069+0000 7f5c6b400640 1 -- start start 2024-09-12T02:53:13.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.069+0000 7f5c6b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c640ae460 0x7f5c641506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:13.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.069+0000 7f5c6b400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c640b0c50 0x7f5c640ce560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:13.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.069+0000 7f5c6b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c6415b4e0 0x7f5c6409d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:13.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.069+0000 7f5c6b400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5c640b2660 con 0x7f5c6415b4e0 2024-09-12T02:53:13.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.070+0000 7f5c6b400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5c640b2380 con 0x7f5c640ae460 2024-09-12T02:53:13.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.070+0000 7f5c6b400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5c640b3a10 con 0x7f5c640b0c50 2024-09-12T02:53:13.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.070+0000 7f5c69400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c6415b4e0 0x7f5c6409d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:13.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.070+0000 7f5c69400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c6415b4e0 0x7f5c6409d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33318/0 (socket says 172.21.15.112:33318) 2024-09-12T02:53:13.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.070+0000 7f5c69400640 1 -- 172.21.15.112:0/1690002556 learned_addr learned my addr 172.21.15.112:0/1690002556 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:13.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.070+0000 7f5c68a00640 1 --2- 172.21.15.112:0/1690002556 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c640ae460 0x7f5c641506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:13.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.070+0000 7f5c5be00640 1 --2- 172.21.15.112:0/1690002556 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c640b0c50 0x7f5c640ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:13.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.070+0000 7f5c69400640 1 -- 172.21.15.112:0/1690002556 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c640b0c50 msgr2=0x7f5c640ce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:13.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.070+0000 7f5c69400640 1 --2- 172.21.15.112:0/1690002556 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c640b0c50 0x7f5c640ce560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:13.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.070+0000 7f5c69400640 1 -- 172.21.15.112:0/1690002556 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c640ae460 msgr2=0x7f5c641506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:13.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.070+0000 7f5c69400640 1 --2- 172.21.15.112:0/1690002556 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c640ae460 0x7f5c641506d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:13.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.070+0000 7f5c69400640 1 -- 172.21.15.112:0/1690002556 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c640ca490 con 0x7f5c6415b4e0 2024-09-12T02:53:13.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.070+0000 7f5c69400640 1 --2- 172.21.15.112:0/1690002556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c6415b4e0 0x7f5c6409d5e0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c00c7a0 tx=0x7f5c5c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:13.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.071+0000 7f5c61600640 1 -- 172.21.15.112:0/1690002556 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c003b70 con 0x7f5c6415b4e0 2024-09-12T02:53:13.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.071+0000 7f5c61600640 1 -- 172.21.15.112:0/1690002556 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c5c003d30 con 0x7f5c6415b4e0 2024-09-12T02:53:13.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.071+0000 7f5c61600640 1 -- 172.21.15.112:0/1690002556 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c00aa90 con 0x7f5c6415b4e0 2024-09-12T02:53:13.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.071+0000 7f5c6b400640 1 -- 172.21.15.112:0/1690002556 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c640ca770 con 0x7f5c6415b4e0 2024-09-12T02:53:13.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.071+0000 7f5c6b400640 1 -- 172.21.15.112:0/1690002556 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c640cad30 con 0x7f5c6415b4e0 2024-09-12T02:53:13.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.072+0000 7f5c6b400640 1 -- 172.21.15.112:0/1690002556 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c640694f0 con 0x7f5c6415b4e0 2024-09-12T02:53:13.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.073+0000 7f5c61600640 1 -- 172.21.15.112:0/1690002556 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5c5c00ac30 con 0x7f5c6415b4e0 2024-09-12T02:53:13.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.074+0000 7f5c61600640 1 --2- 172.21.15.112:0/1690002556 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5c4006be30 0x7f5c4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:13.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.074+0000 7f5c61600640 1 -- 172.21.15.112:0/1690002556 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7f5c5c08ae20 con 0x7f5c6415b4e0 2024-09-12T02:53:13.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.074+0000 7f5c68a00640 1 --2- 172.21.15.112:0/1690002556 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5c4006be30 0x7f5c4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:13.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.074+0000 7f5c61600640 1 -- 172.21.15.112:0/1690002556 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=186}) -- 0x7f5c400739c0 con 0x7f5c6415b4e0 2024-09-12T02:53:13.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.075+0000 7f5c68a00640 1 --2- 172.21.15.112:0/1690002556 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5c4006be30 0x7f5c4006e2f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5c54000f60 tx=0x7f5c54007d00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:13.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.078+0000 7f5c61600640 1 -- 172.21.15.112:0/1690002556 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5c640694f0 con 0x7f5c6415b4e0 2024-09-12T02:53:13.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.253+0000 7f5c6b400640 1 -- 172.21.15.112:0/1690002556 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f5c640aeb70 con 0x7f5c6415b4e0 2024-09-12T02:53:13.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.254+0000 7f5c61600640 1 -- 172.21.15.112:0/1690002556 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v185) ==== 81+0+34337 (secure 0 0 0) 0x7f5c5c0597c0 con 0x7f5c6415b4e0 2024-09-12T02:53:13.255 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:53:13.256 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:53:13.256 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 185, 2024-09-12T02:53:13.256 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:53:13.256 INFO:teuthology.orchestra.run.smithi112.stdout: "created": "2024-09-12T02:41:36.162095+0000", 2024-09-12T02:53:13.256 INFO:teuthology.orchestra.run.smithi112.stdout: "modified": "2024-09-12T02:53:11.064679+0000", 2024-09-12T02:53:13.256 INFO:teuthology.orchestra.run.smithi112.stdout: "last_up_change": "2024-09-12T02:41:42.191169+0000", 2024-09-12T02:53:13.256 INFO:teuthology.orchestra.run.smithi112.stdout: "last_in_change": "2024-09-12T02:41:39.036600+0000", 2024-09-12T02:53:13.256 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:53:13.256 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_num": 5799936, 2024-09-12T02:53:13.256 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_set": [ 2024-09-12T02:53:13.256 INFO:teuthology.orchestra.run.smithi112.stdout: "pglog_hardlimit", 2024-09-12T02:53:13.256 INFO:teuthology.orchestra.run.smithi112.stdout: "purged_snapdirs", 2024-09-12T02:53:13.257 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_deletes", 2024-09-12T02:53:13.257 INFO:teuthology.orchestra.run.smithi112.stdout: "sortbitwise" 2024-09-12T02:53:13.257 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:13.257 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_version": 4, 2024-09-12T02:53:13.257 INFO:teuthology.orchestra.run.smithi112.stdout: "full_ratio": 0.69999998807907104, 2024-09-12T02:53:13.257 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-12T02:53:13.257 INFO:teuthology.orchestra.run.smithi112.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-12T02:53:13.257 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_snapshot": "", 2024-09-12T02:53:13.257 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_max": 23, 2024-09-12T02:53:13.257 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd": 8, 2024-09-12T02:53:13.260 INFO:teuthology.orchestra.run.smithi112.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:53:13.260 INFO:teuthology.orchestra.run.smithi112.stdout: "min_compat_client": "jewel", 2024-09-12T02:53:13.260 INFO:teuthology.orchestra.run.smithi112.stdout: "require_osd_release": "squid", 2024-09-12T02:53:13.260 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_crimson": false, 2024-09-12T02:53:13.260 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-12T02:53:13.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.261 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 1, 2024-09-12T02:53:13.261 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": ".mgr", 2024-09-12T02:53:13.261 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:41:43.011599+0000", 2024-09-12T02:53:13.261 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:53:13.261 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:53:13.261 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:53:13.261 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:53:13.261 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:53:13.261 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:53:13.261 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:53:13.261 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:53:13.261 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:53:13.262 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:53:13.262 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:53:13.262 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:53:13.262 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:53:13.262 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 1, 2024-09-12T02:53:13.262 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 1, 2024-09-12T02:53:13.262 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 1, 2024-09-12T02:53:13.262 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 1, 2024-09-12T02:53:13.262 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 1, 2024-09-12T02:53:13.262 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:53:13.262 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:53:13.262 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:53:13.262 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:53:13.262 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:53:13.263 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:53:13.263 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:53:13.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.263 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "109", 2024-09-12T02:53:13.263 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:53:13.263 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:53:13.263 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:53:13.263 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:53:13.263 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:53:13.263 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:53:13.263 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:53:13.263 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:53:13.263 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:53:13.264 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:53:13.264 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:53:13.264 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:53:13.264 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:53:13.264 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:53:13.264 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:53:13.264 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:53:13.264 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:53:13.264 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:53:13.264 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:53:13.264 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:53:13.264 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:53:13.264 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:53:13.264 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:53:13.264 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:53:13.264 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:53:13.265 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:53:13.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.265 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:53:13.265 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:53:13.265 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:53:13.265 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:53:13.265 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:53:13.265 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:53:13.265 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:53:13.265 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:53:13.265 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:53:13.265 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:53:13.265 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:53:13.265 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:53:13.266 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_max": 32, 2024-09-12T02:53:13.266 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 1 2024-09-12T02:53:13.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.266 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:53:13.266 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": {} 2024-09-12T02:53:13.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.266 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:53:13.266 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:53:13.266 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 8, 2024-09-12T02:53:13.266 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 8, 2024-09-12T02:53:13.266 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 0.25, 2024-09-12T02:53:13.266 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:53:13.266 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:53:13.266 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:53:13.267 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:53:13.267 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:53:13.267 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.267 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 22, 2024-09-12T02:53:13.267 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:53:13.267 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:52:51.909503+0000", 2024-09-12T02:53:13.267 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:53:13.267 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:53:13.267 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:53:13.267 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:53:13.267 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:53:13.267 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:53:13.268 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:53:13.268 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:53:13.268 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:53:13.268 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:53:13.268 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:53:13.268 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:53:13.268 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:53:13.268 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 32, 2024-09-12T02:53:13.268 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 32, 2024-09-12T02:53:13.268 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 32, 2024-09-12T02:53:13.268 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 32, 2024-09-12T02:53:13.268 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 32, 2024-09-12T02:53:13.268 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:53:13.268 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:53:13.269 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:53:13.269 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:53:13.269 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:53:13.269 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:53:13.269 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:53:13.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.269 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "182", 2024-09-12T02:53:13.269 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:53:13.269 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:53:13.269 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:53:13.269 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:53:13.269 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:53:13.269 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:53:13.269 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:53:13.269 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:53:13.270 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:53:13.270 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:53:13.270 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:53:13.270 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:53:13.270 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:53:13.270 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:53:13.270 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:53:13.270 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:53:13.270 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:53:13.270 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:53:13.270 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:53:13.270 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:53:13.270 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:53:13.270 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:53:13.271 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:53:13.271 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:53:13.271 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:53:13.271 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:53:13.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.271 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:53:13.271 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:53:13.271 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:53:13.271 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:53:13.271 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:53:13.271 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:53:13.271 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:53:13.271 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:53:13.271 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:53:13.272 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:53:13.272 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:53:13.272 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:53:13.272 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:53:13.272 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 16, 2024-09-12T02:53:13.272 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_priority": 5 2024-09-12T02:53:13.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.272 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:53:13.272 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:53:13.272 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": "cephfs" 2024-09-12T02:53:13.272 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.273 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:53:13.273 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:53:13.273 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 2, 2024-09-12T02:53:13.273 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 2, 2024-09-12T02:53:13.273 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:53:13.273 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:53:13.273 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:53:13.273 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:53:13.273 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:53:13.273 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:53:13.274 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.274 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 23, 2024-09-12T02:53:13.274 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_data", 2024-09-12T02:53:13.274 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:52:53.146578+0000", 2024-09-12T02:53:13.274 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1027, 2024-09-12T02:53:13.274 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-12T02:53:13.274 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:53:13.274 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:53:13.274 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:53:13.274 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:53:13.274 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:53:13.274 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:53:13.274 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:53:13.275 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:53:13.275 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:53:13.275 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:53:13.275 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:53:13.275 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 64, 2024-09-12T02:53:13.275 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 64, 2024-09-12T02:53:13.275 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 64, 2024-09-12T02:53:13.275 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 64, 2024-09-12T02:53:13.275 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 64, 2024-09-12T02:53:13.275 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:53:13.275 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:53:13.275 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:53:13.275 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:53:13.275 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:53:13.276 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:53:13.276 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:53:13.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.276 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "185", 2024-09-12T02:53:13.276 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:53:13.276 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:53:13.276 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:53:13.276 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:53:13.276 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:53:13.276 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:53:13.276 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:53:13.276 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:53:13.276 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:53:13.276 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 33554432, 2024-09-12T02:53:13.277 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:53:13.277 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:53:13.277 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:53:13.277 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:53:13.277 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:53:13.277 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:53:13.277 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:53:13.277 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:53:13.277 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:53:13.277 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:53:13.277 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:53:13.277 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:53:13.277 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:53:13.277 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:53:13.277 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:53:13.278 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:53:13.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.278 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:53:13.278 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:53:13.278 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:53:13.278 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:53:13.278 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:53:13.278 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:53:13.278 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:53:13.278 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:53:13.278 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:53:13.278 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:53:13.278 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:53:13.278 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:53:13.278 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 64, 2024-09-12T02:53:13.279 INFO:teuthology.orchestra.run.smithi112.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:53:13.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.279 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:53:13.279 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:53:13.279 INFO:teuthology.orchestra.run.smithi112.stdout: "data": "cephfs" 2024-09-12T02:53:13.279 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.279 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:53:13.279 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:53:13.279 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.3799999952316284, 2024-09-12T02:53:13.279 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.3799999952316284, 2024-09-12T02:53:13.279 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:53:13.279 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-12T02:53:13.279 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-12T02:53:13.280 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:53:13.280 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:53:13.280 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:53:13.280 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.280 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.280 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:13.280 INFO:teuthology.orchestra.run.smithi112.stdout: "osds": [ 2024-09-12T02:53:13.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.280 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:53:13.280 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:13.280 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:13.280 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:13.280 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:13.281 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:13.281 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:13.281 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:13.281 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:13.281 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:13.281 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:13.281 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:13.281 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:13.281 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.281 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.281 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6800", 2024-09-12T02:53:13.281 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:13.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.282 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.282 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6801", 2024-09-12T02:53:13.282 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:13.282 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.282 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.282 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:13.282 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.282 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.282 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6802", 2024-09-12T02:53:13.282 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:13.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.283 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.283 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6803", 2024-09-12T02:53:13.283 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:13.283 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.283 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.283 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:13.283 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.283 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.283 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6806", 2024-09-12T02:53:13.283 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:13.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.284 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.284 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6807", 2024-09-12T02:53:13.284 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:13.284 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.284 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.284 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:13.284 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.284 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.284 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6804", 2024-09-12T02:53:13.284 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:13.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.285 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.285 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6805", 2024-09-12T02:53:13.285 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:13.285 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.285 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.285 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6801/821571304", 2024-09-12T02:53:13.285 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6803/821571304", 2024-09-12T02:53:13.286 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6807/821571304", 2024-09-12T02:53:13.286 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6805/821571304", 2024-09-12T02:53:13.286 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:13.286 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:13.286 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:13.286 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.286 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:53:13.286 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:13.286 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:13.286 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:13.286 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:13.286 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:13.287 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:13.287 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:13.287 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:13.287 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:13.287 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:13.287 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:13.287 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:13.287 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.287 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.287 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6808", 2024-09-12T02:53:13.287 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:13.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.288 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.288 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6809", 2024-09-12T02:53:13.288 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:13.288 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.288 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.288 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:13.288 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.288 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.288 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6810", 2024-09-12T02:53:13.288 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:13.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.289 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.289 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6811", 2024-09-12T02:53:13.289 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:13.289 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.289 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.289 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:13.289 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.289 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.289 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6814", 2024-09-12T02:53:13.289 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:13.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.290 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.290 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6815", 2024-09-12T02:53:13.290 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:13.290 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.290 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.290 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:13.290 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.290 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.290 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6812", 2024-09-12T02:53:13.290 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:13.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.291 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.291 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6813", 2024-09-12T02:53:13.291 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:13.291 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.291 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.291 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6809/2642068641", 2024-09-12T02:53:13.291 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6811/2642068641", 2024-09-12T02:53:13.291 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6815/2642068641", 2024-09-12T02:53:13.291 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6813/2642068641", 2024-09-12T02:53:13.291 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:13.291 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:13.291 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:13.291 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.292 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:53:13.292 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:13.292 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:13.292 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:13.292 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:13.292 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:13.292 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:13.292 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:13.292 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:13.292 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:13.292 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:13.292 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:13.293 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:13.293 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.293 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.293 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6816", 2024-09-12T02:53:13.293 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:13.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.293 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.293 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6817", 2024-09-12T02:53:13.293 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:13.293 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.293 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.294 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:13.294 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.294 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.294 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6818", 2024-09-12T02:53:13.294 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:13.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.294 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.294 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6819", 2024-09-12T02:53:13.294 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:13.294 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.294 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.295 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:13.295 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.295 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.295 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6822", 2024-09-12T02:53:13.295 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:13.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.295 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.295 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6823", 2024-09-12T02:53:13.295 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:13.295 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.295 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.296 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:13.296 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.296 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.296 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6820", 2024-09-12T02:53:13.296 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:13.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.296 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.296 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6821", 2024-09-12T02:53:13.296 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:13.296 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.297 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.297 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6817/3365688807", 2024-09-12T02:53:13.297 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6819/3365688807", 2024-09-12T02:53:13.297 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6823/3365688807", 2024-09-12T02:53:13.297 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6821/3365688807", 2024-09-12T02:53:13.297 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:13.297 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:13.297 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:13.297 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.297 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:53:13.297 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:13.298 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:13.298 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:13.298 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:13.298 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:13.298 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:13.298 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:13.298 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:13.298 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:13.298 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:13.298 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:13.298 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:13.298 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.298 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.299 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6824", 2024-09-12T02:53:13.299 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:13.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.299 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.299 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6825", 2024-09-12T02:53:13.299 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:13.299 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.299 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.299 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:13.299 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.299 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.299 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6826", 2024-09-12T02:53:13.300 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:13.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.300 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.300 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6827", 2024-09-12T02:53:13.300 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:13.300 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.300 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.300 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:13.300 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.300 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.300 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6830", 2024-09-12T02:53:13.301 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:13.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.301 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.301 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6831", 2024-09-12T02:53:13.301 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:13.301 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.301 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.301 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:13.301 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.301 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.301 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6828", 2024-09-12T02:53:13.302 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:13.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.302 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.302 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6829", 2024-09-12T02:53:13.302 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:13.302 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.302 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.302 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6825/231774278", 2024-09-12T02:53:13.302 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6827/231774278", 2024-09-12T02:53:13.302 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6831/231774278", 2024-09-12T02:53:13.302 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6829/231774278", 2024-09-12T02:53:13.302 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:13.302 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:13.303 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:13.303 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.303 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:53:13.303 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:13.303 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:13.303 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:13.303 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:13.303 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:13.303 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:13.303 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:13.303 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:13.303 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:13.304 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:13.304 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:13.304 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:13.304 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.304 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.304 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6800", 2024-09-12T02:53:13.304 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:13.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.304 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.304 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6801", 2024-09-12T02:53:13.304 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:13.305 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.305 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.305 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:13.305 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.305 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.305 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6802", 2024-09-12T02:53:13.305 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:13.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.305 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.305 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6803", 2024-09-12T02:53:13.305 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:13.306 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.306 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.306 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:13.306 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.306 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.306 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6806", 2024-09-12T02:53:13.306 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:13.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.306 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.306 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6807", 2024-09-12T02:53:13.306 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:13.307 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.307 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.307 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:13.307 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.307 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.307 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6804", 2024-09-12T02:53:13.307 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:13.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.307 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.307 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6805", 2024-09-12T02:53:13.307 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:13.308 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.308 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.308 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6801/3671178153", 2024-09-12T02:53:13.308 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6803/3671178153", 2024-09-12T02:53:13.308 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6807/3671178153", 2024-09-12T02:53:13.308 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6805/3671178153", 2024-09-12T02:53:13.308 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:13.308 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:13.308 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:13.308 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.308 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:53:13.308 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:13.309 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:13.309 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:13.309 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:13.309 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:13.309 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:13.309 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:13.309 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:13.309 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:13.309 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:13.309 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:13.309 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:13.309 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.310 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.310 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6808", 2024-09-12T02:53:13.310 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:13.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.310 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.310 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6809", 2024-09-12T02:53:13.310 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:13.310 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.310 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.310 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:13.310 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.311 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.311 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6810", 2024-09-12T02:53:13.311 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:13.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.311 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.311 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6811", 2024-09-12T02:53:13.311 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:13.311 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.311 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.311 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:13.311 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.312 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.312 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6817", 2024-09-12T02:53:13.312 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:13.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.312 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.312 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6819", 2024-09-12T02:53:13.312 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:13.312 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.312 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.312 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:13.312 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.313 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.313 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6812", 2024-09-12T02:53:13.313 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:13.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.313 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.313 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6815", 2024-09-12T02:53:13.313 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:13.313 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.313 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.313 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6809/3193706134", 2024-09-12T02:53:13.313 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6811/3193706134", 2024-09-12T02:53:13.314 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6819/3193706134", 2024-09-12T02:53:13.314 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6815/3193706134", 2024-09-12T02:53:13.314 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:13.314 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:13.314 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:13.314 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.314 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:53:13.314 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:13.314 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:13.314 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:13.314 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:13.315 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:13.315 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:13.315 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:13.315 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:13.315 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:13.315 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:13.315 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:13.315 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:13.315 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.315 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.315 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6813", 2024-09-12T02:53:13.316 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:13.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.316 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.316 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6814", 2024-09-12T02:53:13.316 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:13.316 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.316 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.316 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:13.316 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.316 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.317 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6816", 2024-09-12T02:53:13.317 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:13.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.317 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.317 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6818", 2024-09-12T02:53:13.317 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:13.317 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.317 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.317 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:13.317 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.317 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.317 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6822", 2024-09-12T02:53:13.318 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:13.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.318 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.318 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6823", 2024-09-12T02:53:13.318 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:13.318 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.318 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.318 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:13.318 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.318 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.319 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6820", 2024-09-12T02:53:13.319 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:13.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.319 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.319 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6821", 2024-09-12T02:53:13.319 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:13.319 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.319 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.319 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6814/3738813293", 2024-09-12T02:53:13.319 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6818/3738813293", 2024-09-12T02:53:13.319 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6823/3738813293", 2024-09-12T02:53:13.319 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6821/3738813293", 2024-09-12T02:53:13.320 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:13.320 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:13.320 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:13.320 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.320 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:53:13.320 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:13.320 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:13.320 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:13.320 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:13.320 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:13.320 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:13.320 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:13.321 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:13.321 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:13.321 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:13.321 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:13.321 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:13.321 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.321 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.321 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6824", 2024-09-12T02:53:13.321 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:13.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.321 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.321 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6825", 2024-09-12T02:53:13.321 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:13.322 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.322 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.322 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:13.322 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.322 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.322 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6826", 2024-09-12T02:53:13.322 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:13.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.322 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.322 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6827", 2024-09-12T02:53:13.322 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:13.323 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.323 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.323 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:13.323 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.323 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.323 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6830", 2024-09-12T02:53:13.323 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:13.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.323 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.323 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6831", 2024-09-12T02:53:13.323 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:13.323 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.324 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.324 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:13.324 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:13.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.324 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:13.324 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6828", 2024-09-12T02:53:13.324 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:13.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.324 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:13.324 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6829", 2024-09-12T02:53:13.324 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:13.324 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.325 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.325 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6825/1421932609", 2024-09-12T02:53:13.325 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6827/1421932609", 2024-09-12T02:53:13.325 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6831/1421932609", 2024-09-12T02:53:13.325 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6829/1421932609", 2024-09-12T02:53:13.325 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:13.325 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:13.325 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:13.325 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:13.325 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.325 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:13.325 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_xinfo": [ 2024-09-12T02:53:13.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.325 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:53:13.326 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:13.326 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:13.326 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:13.326 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:13.326 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:13.326 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.220641+0000", 2024-09-12T02:53:13.326 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:13.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.326 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:53:13.326 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:13.326 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:13.326 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:13.326 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:13.327 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:13.327 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312574+0000", 2024-09-12T02:53:13.327 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:13.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.327 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:53:13.327 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:13.327 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:13.327 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:13.327 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:13.327 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:13.327 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.282771+0000", 2024-09-12T02:53:13.327 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:13.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.328 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:53:13.328 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:13.328 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:13.328 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:13.328 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:13.328 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:13.328 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.260478+0000", 2024-09-12T02:53:13.328 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:13.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.328 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:53:13.328 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:13.328 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:13.328 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:13.329 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:13.329 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:13.329 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.273397+0000", 2024-09-12T02:53:13.329 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:13.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.329 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:53:13.329 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:13.329 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:13.329 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:13.329 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:13.329 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:13.329 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312452+0000", 2024-09-12T02:53:13.330 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:13.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.330 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:53:13.330 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:13.330 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:13.330 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:13.330 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:13.330 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:13.330 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.308965+0000", 2024-09-12T02:53:13.330 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:13.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:13.330 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:53:13.330 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:13.331 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:13.331 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:13.331 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:13.331 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:13.331 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.337842+0000", 2024-09-12T02:53:13.331 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:13.331 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.331 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:13.331 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap": [], 2024-09-12T02:53:13.331 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_items": [], 2024-09-12T02:53:13.331 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_primaries": [], 2024-09-12T02:53:13.331 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_temp": [], 2024-09-12T02:53:13.331 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_temp": [], 2024-09-12T02:53:13.331 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklist": {}, 2024-09-12T02:53:13.332 INFO:teuthology.orchestra.run.smithi112.stdout: "range_blocklist": {}, 2024-09-12T02:53:13.332 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profiles": { 2024-09-12T02:53:13.332 INFO:teuthology.orchestra.run.smithi112.stdout: "default": { 2024-09-12T02:53:13.332 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-failure-domain": "osd", 2024-09-12T02:53:13.332 INFO:teuthology.orchestra.run.smithi112.stdout: "k": "2", 2024-09-12T02:53:13.332 INFO:teuthology.orchestra.run.smithi112.stdout: "m": "1", 2024-09-12T02:53:13.332 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin": "jerasure", 2024-09-12T02:53:13.332 INFO:teuthology.orchestra.run.smithi112.stdout: "technique": "reed_sol_van" 2024-09-12T02:53:13.332 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:13.332 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps_queue": [], 2024-09-12T02:53:13.332 INFO:teuthology.orchestra.run.smithi112.stdout: "new_removed_snaps": [], 2024-09-12T02:53:13.332 INFO:teuthology.orchestra.run.smithi112.stdout: "new_purged_snaps": [], 2024-09-12T02:53:13.333 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_node_flags": {}, 2024-09-12T02:53:13.333 INFO:teuthology.orchestra.run.smithi112.stdout: "device_class_flags": {}, 2024-09-12T02:53:13.333 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode": { 2024-09-12T02:53:13.333 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_enabled": false, 2024-09-12T02:53:13.333 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_bucket_count": 0, 2024-09-12T02:53:13.333 INFO:teuthology.orchestra.run.smithi112.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:53:13.333 INFO:teuthology.orchestra.run.smithi112.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:53:13.333 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_bucket": 0 2024-09-12T02:53:13.333 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:13.333 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:53:13.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.256+0000 7f5c6b400640 1 -- 172.21.15.112:0/1690002556 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5c4006be30 msgr2=0x7f5c4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:13.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.256+0000 7f5c6b400640 1 --2- 172.21.15.112:0/1690002556 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5c4006be30 0x7f5c4006e2f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5c54000f60 tx=0x7f5c54007d00 comp rx=0 tx=0).stop 2024-09-12T02:53:13.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.256+0000 7f5c6b400640 1 -- 172.21.15.112:0/1690002556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c6415b4e0 msgr2=0x7f5c6409d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:13.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.256+0000 7f5c6b400640 1 --2- 172.21.15.112:0/1690002556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c6415b4e0 0x7f5c6409d5e0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c00c7a0 tx=0x7f5c5c00cc60 comp rx=0 tx=0).stop 2024-09-12T02:53:13.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.256+0000 7f5c6b400640 1 -- 172.21.15.112:0/1690002556 shutdown_connections 2024-09-12T02:53:13.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.256+0000 7f5c6b400640 1 --2- 172.21.15.112:0/1690002556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c6415b4e0 0x7f5c6409d5e0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:13.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.256+0000 7f5c6b400640 1 --2- 172.21.15.112:0/1690002556 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c640b0c50 0x7f5c640ce560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:13.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.256+0000 7f5c6b400640 1 --2- 172.21.15.112:0/1690002556 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f5c4006be30 0x7f5c4006e2f0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:13.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.256+0000 7f5c6b400640 1 --2- 172.21.15.112:0/1690002556 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c640ae460 0x7f5c641506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:13.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.256+0000 7f5c6b400640 1 -- 172.21.15.112:0/1690002556 >> 172.21.15.112:0/1690002556 conn(0x7f5c640b2e10 msgr2=0x7f5c640b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:13.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.257+0000 7f5c6b400640 1 -- 172.21.15.112:0/1690002556 shutdown_connections 2024-09-12T02:53:13.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:13.257+0000 7f5c6b400640 1 -- 172.21.15.112:0/1690002556 wait complete. 2024-09-12T02:53:13.337 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-12T02:53:18.338 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-12T02:53:18.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.499+0000 7f2bde400640 1 Processor -- start 2024-09-12T02:53:18.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.499+0000 7f2bde400640 1 -- start start 2024-09-12T02:53:18.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.500+0000 7f2bde400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2bd806d8c0 0x7f2bd80afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:18.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.500+0000 7f2bde400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bd80aedd0 con 0x7f2bd80ae8d0 2024-09-12T02:53:18.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.500+0000 7f2bde400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bd80af0b0 con 0x7f2bd806dca0 2024-09-12T02:53:18.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.500+0000 7f2bde400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2bd80af390 con 0x7f2bd806d8c0 2024-09-12T02:53:18.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.500+0000 7f2bd6a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2bd80ae8d0 0x7f2bd80715a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46874/0 (socket says 172.21.15.112:46874) 2024-09-12T02:53:18.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.500+0000 7f2bd6a00640 1 -- 172.21.15.112:0/333332861 learned_addr learned my addr 172.21.15.112:0/333332861 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:53:18.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.501+0000 7f2bd7400640 1 --2- 172.21.15.112:0/333332861 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2bd806d8c0 0x7f2bd80afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:18.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.501+0000 7f2bd6000640 1 -- 172.21.15.112:0/333332861 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1906217809 0 0) 0x7f2bd80aedd0 con 0x7f2bd80ae8d0 2024-09-12T02:53:18.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.501+0000 7f2bd6000640 1 -- 172.21.15.112:0/333332861 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bbc003520 con 0x7f2bd80ae8d0 2024-09-12T02:53:18.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.501+0000 7f2bd6000640 1 -- 172.21.15.112:0/333332861 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1844978688 0 0) 0x7f2bd80af0b0 con 0x7f2bd806dca0 2024-09-12T02:53:18.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.501+0000 7f2bd6000640 1 -- 172.21.15.112:0/333332861 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bd80aedd0 con 0x7f2bd806dca0 2024-09-12T02:53:18.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.501+0000 7f2bd6000640 1 -- 172.21.15.112:0/333332861 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3090407750 0 0) 0x7f2bbc003520 con 0x7f2bd80ae8d0 2024-09-12T02:53:18.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.501+0000 7f2bd6000640 1 -- 172.21.15.112:0/333332861 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2bd806d8c0 msgr2=0x7f2bd80afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:18.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.501+0000 7f2bd6000640 1 --2- 172.21.15.112:0/333332861 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2bd806d8c0 0x7f2bd80afe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:18.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.501+0000 7f2bd6000640 1 -- 172.21.15.112:0/333332861 >> v1:172.21.15.137:6789/0 conn(0x7f2bd806dca0 legacy=0x7f2bd806e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:18.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.501+0000 7f2bd6000640 1 -- 172.21.15.112:0/333332861 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd80af670 con 0x7f2bd80ae8d0 2024-09-12T02:53:18.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.501+0000 7f2bd6000640 1 -- 172.21.15.112:0/333332861 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7f2bc40017f0 con 0x7f2bd80ae8d0 2024-09-12T02:53:18.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.501+0000 7f2bd6000640 1 -- 172.21.15.112:0/333332861 >> v1:172.21.15.112:6789/0 conn(0x7f2bd80ae8d0 legacy=0x7f2bd80715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:18.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.501+0000 7f2bd6000640 1 --2- 172.21.15.112:0/333332861 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2bd806d8c0 0x7f2bbc003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:18.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.501+0000 7f2bd6000640 1 --2- 172.21.15.112:0/333332861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bbc0040d0 0x7f2bbc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:18.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.501+0000 7f2bd6000640 1 --2- 172.21.15.112:0/333332861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bbc004d40 0x7f2bbc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:18.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.501+0000 7f2bd6000640 1 -- 172.21.15.112:0/333332861 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd80af390 con 0x7f2bbc0040d0 2024-09-12T02:53:18.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.501+0000 7f2bd6000640 1 -- 172.21.15.112:0/333332861 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc00ba70 con 0x7f2bbc004d40 2024-09-12T02:53:18.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.501+0000 7f2bd6000640 1 -- 172.21.15.112:0/333332861 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2bbc00bc40 con 0x7f2bd806d8c0 2024-09-12T02:53:18.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.502+0000 7f2bd7400640 1 --2- 172.21.15.112:0/333332861 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2bd806d8c0 0x7f2bbc003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:18.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.502+0000 7f2bd7e00640 1 --2- 172.21.15.112:0/333332861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bbc004d40 0x7f2bbc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:18.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.502+0000 7f2bd6a00640 1 --2- 172.21.15.112:0/333332861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bbc0040d0 0x7f2bbc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:18.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.502+0000 7f2bd7400640 1 -- 172.21.15.112:0/333332861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bbc004d40 msgr2=0x7f2bbc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:18.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.502+0000 7f2bd7400640 1 --2- 172.21.15.112:0/333332861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bbc004d40 0x7f2bbc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:18.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.502+0000 7f2bd7400640 1 -- 172.21.15.112:0/333332861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bbc0040d0 msgr2=0x7f2bbc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:18.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.502+0000 7f2bd7400640 1 --2- 172.21.15.112:0/333332861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bbc0040d0 0x7f2bbc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:18.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.502+0000 7f2bd7400640 1 -- 172.21.15.112:0/333332861 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd80af670 con 0x7f2bd806d8c0 2024-09-12T02:53:18.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.503+0000 7f2bd7400640 1 --2- 172.21.15.112:0/333332861 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2bd806d8c0 0x7f2bbc003b70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8009af0 tx=0x7f2bbc005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3de68c02de73cc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:18.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.504+0000 7f2bd6000640 1 -- 172.21.15.112:0/333332861 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8036070 con 0x7f2bd806d8c0 2024-09-12T02:53:18.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.504+0000 7f2bd6000640 1 -- 172.21.15.112:0/333332861 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bc8031400 con 0x7f2bd806d8c0 2024-09-12T02:53:18.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.504+0000 7f2bd6000640 1 -- 172.21.15.112:0/333332861 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8009690 con 0x7f2bd806d8c0 2024-09-12T02:53:18.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.504+0000 7f2bde400640 1 -- 172.21.15.112:0/333332861 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2bd806d8c0 msgr2=0x7f2bbc003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:18.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.504+0000 7f2bde400640 1 --2- 172.21.15.112:0/333332861 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2bd806d8c0 0x7f2bbc003b70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8009af0 tx=0x7f2bbc005830 comp rx=0 tx=0).stop 2024-09-12T02:53:18.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.504+0000 7f2bd7e00640 1 -- 172.21.15.112:0/333332861 reap_dead start 2024-09-12T02:53:18.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.504+0000 7f2bde400640 1 -- 172.21.15.112:0/333332861 shutdown_connections 2024-09-12T02:53:18.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.504+0000 7f2bde400640 1 -- 172.21.15.112:0/333332861 >> 172.21.15.112:0/333332861 conn(0x7f2bd806bbd0 msgr2=0x7f2bd806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:18.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.504+0000 7f2bde400640 1 -- 172.21.15.112:0/333332861 shutdown_connections 2024-09-12T02:53:18.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.505+0000 7f2bde400640 1 -- 172.21.15.112:0/333332861 wait complete. 2024-09-12T02:53:18.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.506+0000 7f2bde400640 1 Processor -- start 2024-09-12T02:53:18.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.506+0000 7f2bde400640 1 -- start start 2024-09-12T02:53:18.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.507+0000 7f2bde400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2bd806d8c0 0x7f2bd814d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:18.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.507+0000 7f2bde400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bd80cf420 0x7f2bd80cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:18.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.507+0000 7f2bde400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd80cd690 0x7f2bd80cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:18.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.507+0000 7f2bde400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd80afff0 con 0x7f2bd80cf420 2024-09-12T02:53:18.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.507+0000 7f2bde400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd80afe70 con 0x7f2bd80cd690 2024-09-12T02:53:18.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.507+0000 7f2bde400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2bd80b0170 con 0x7f2bd806d8c0 2024-09-12T02:53:18.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.507+0000 7f2bd6a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bd80cf420 0x7f2bd80cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:18.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.507+0000 7f2bd6a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bd80cf420 0x7f2bd80cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33346/0 (socket says 172.21.15.112:33346) 2024-09-12T02:53:18.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.507+0000 7f2bd6a00640 1 -- 172.21.15.112:0/24112036 learned_addr learned my addr 172.21.15.112:0/24112036 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:18.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.508+0000 7f2bd7e00640 1 --2- 172.21.15.112:0/24112036 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd80cd690 0x7f2bd80cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:18.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.508+0000 7f2bd7400640 1 --2- 172.21.15.112:0/24112036 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2bd806d8c0 0x7f2bd814d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:18.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.508+0000 7f2bd6a00640 1 -- 172.21.15.112:0/24112036 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2bd806d8c0 msgr2=0x7f2bd814d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:18.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.508+0000 7f2bd6a00640 1 --2- 172.21.15.112:0/24112036 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2bd806d8c0 0x7f2bd814d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:18.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.508+0000 7f2bd6a00640 1 -- 172.21.15.112:0/24112036 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd80cd690 msgr2=0x7f2bd80cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:18.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.508+0000 7f2bd6a00640 1 --2- 172.21.15.112:0/24112036 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd80cd690 0x7f2bd80cdb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:18.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.508+0000 7f2bd6a00640 1 -- 172.21.15.112:0/24112036 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd80ce5f0 con 0x7f2bd80cf420 2024-09-12T02:53:18.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.508+0000 7f2bd7e00640 1 --2- 172.21.15.112:0/24112036 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd80cd690 0x7f2bd80cdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:53:18.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.508+0000 7f2bd6a00640 1 --2- 172.21.15.112:0/24112036 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bd80cf420 0x7f2bd80cf8a0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4001910 tx=0x7f2bc4006c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:18.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.508+0000 7f2bcf400640 1 -- 172.21.15.112:0/24112036 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc4017020 con 0x7f2bd80cf420 2024-09-12T02:53:18.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.508+0000 7f2bcf400640 1 -- 172.21.15.112:0/24112036 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bc400f9c0 con 0x7f2bd80cf420 2024-09-12T02:53:18.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.508+0000 7f2bcf400640 1 -- 172.21.15.112:0/24112036 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc400fdb0 con 0x7f2bd80cf420 2024-09-12T02:53:18.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.508+0000 7f2bde400640 1 -- 172.21.15.112:0/24112036 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bd80ce050 con 0x7f2bd80cf420 2024-09-12T02:53:18.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.508+0000 7f2bde400640 1 -- 172.21.15.112:0/24112036 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bd81e76a0 con 0x7f2bd80cf420 2024-09-12T02:53:18.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.509+0000 7f2bde400640 1 -- 172.21.15.112:0/24112036 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bd8068a30 con 0x7f2bd80cf420 2024-09-12T02:53:18.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.510+0000 7f2bcf400640 1 -- 172.21.15.112:0/24112036 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2bc401a020 con 0x7f2bd80cf420 2024-09-12T02:53:18.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.511+0000 7f2bcf400640 1 --2- 172.21.15.112:0/24112036 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2bb806be60 0x7f2bb806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:18.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.511+0000 7f2bcf400640 1 -- 172.21.15.112:0/24112036 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7f2bc408b130 con 0x7f2bd80cf420 2024-09-12T02:53:18.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.511+0000 7f2bcf400640 1 -- 172.21.15.112:0/24112036 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=186}) -- 0x7f2bb8073990 con 0x7f2bd80cf420 2024-09-12T02:53:18.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.511+0000 7f2bd7400640 1 --2- 172.21.15.112:0/24112036 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2bb806be60 0x7f2bb806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:18.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.512+0000 7f2bd7400640 1 --2- 172.21.15.112:0/24112036 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2bb806be60 0x7f2bb806e320 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8033000 tx=0x7f2bc8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:18.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.516+0000 7f2bcf400640 1 -- 172.21.15.112:0/24112036 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2bc4021020 con 0x7f2bd80cf420 2024-09-12T02:53:18.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.688+0000 7f2bde400640 1 -- 172.21.15.112:0/24112036 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f2bd806e150 con 0x7f2bd80cf420 2024-09-12T02:53:18.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.690+0000 7f2bcf400640 1 -- 172.21.15.112:0/24112036 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v185) ==== 81+0+34337 (secure 0 0 0) 0x7f2bc40593f0 con 0x7f2bd80cf420 2024-09-12T02:53:18.691 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:53:18.691 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:53:18.691 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 185, 2024-09-12T02:53:18.691 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:53:18.691 INFO:teuthology.orchestra.run.smithi112.stdout: "created": "2024-09-12T02:41:36.162095+0000", 2024-09-12T02:53:18.691 INFO:teuthology.orchestra.run.smithi112.stdout: "modified": "2024-09-12T02:53:11.064679+0000", 2024-09-12T02:53:18.692 INFO:teuthology.orchestra.run.smithi112.stdout: "last_up_change": "2024-09-12T02:41:42.191169+0000", 2024-09-12T02:53:18.692 INFO:teuthology.orchestra.run.smithi112.stdout: "last_in_change": "2024-09-12T02:41:39.036600+0000", 2024-09-12T02:53:18.692 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:53:18.692 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_num": 5799936, 2024-09-12T02:53:18.692 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_set": [ 2024-09-12T02:53:18.692 INFO:teuthology.orchestra.run.smithi112.stdout: "pglog_hardlimit", 2024-09-12T02:53:18.692 INFO:teuthology.orchestra.run.smithi112.stdout: "purged_snapdirs", 2024-09-12T02:53:18.692 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_deletes", 2024-09-12T02:53:18.692 INFO:teuthology.orchestra.run.smithi112.stdout: "sortbitwise" 2024-09-12T02:53:18.692 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:18.692 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_version": 4, 2024-09-12T02:53:18.692 INFO:teuthology.orchestra.run.smithi112.stdout: "full_ratio": 0.69999998807907104, 2024-09-12T02:53:18.692 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-12T02:53:18.693 INFO:teuthology.orchestra.run.smithi112.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-12T02:53:18.693 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_snapshot": "", 2024-09-12T02:53:18.693 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_max": 23, 2024-09-12T02:53:18.693 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd": 8, 2024-09-12T02:53:18.693 INFO:teuthology.orchestra.run.smithi112.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:53:18.693 INFO:teuthology.orchestra.run.smithi112.stdout: "min_compat_client": "jewel", 2024-09-12T02:53:18.693 INFO:teuthology.orchestra.run.smithi112.stdout: "require_osd_release": "squid", 2024-09-12T02:53:18.693 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_crimson": false, 2024-09-12T02:53:18.693 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-12T02:53:18.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.693 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 1, 2024-09-12T02:53:18.693 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": ".mgr", 2024-09-12T02:53:18.693 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:41:43.011599+0000", 2024-09-12T02:53:18.693 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:53:18.694 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:53:18.694 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:53:18.694 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:53:18.694 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:53:18.694 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:53:18.694 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:53:18.694 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:53:18.694 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:53:18.694 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:53:18.694 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:53:18.694 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:53:18.694 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:53:18.694 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 1, 2024-09-12T02:53:18.694 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 1, 2024-09-12T02:53:18.694 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 1, 2024-09-12T02:53:18.695 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 1, 2024-09-12T02:53:18.695 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 1, 2024-09-12T02:53:18.695 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:53:18.695 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:53:18.695 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:53:18.695 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:53:18.695 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:53:18.695 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:53:18.695 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:53:18.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.695 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "109", 2024-09-12T02:53:18.695 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:53:18.695 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:53:18.696 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:53:18.696 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:53:18.696 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:53:18.696 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:53:18.696 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:53:18.696 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:53:18.696 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:53:18.696 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:53:18.696 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:53:18.696 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:53:18.696 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:53:18.696 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:53:18.696 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:53:18.697 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:53:18.697 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:53:18.697 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:53:18.697 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:53:18.697 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:53:18.697 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:53:18.697 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:53:18.697 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:53:18.697 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:53:18.697 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:53:18.697 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:53:18.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.697 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:53:18.697 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:53:18.697 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:53:18.698 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:53:18.698 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:53:18.698 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:53:18.698 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:53:18.698 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:53:18.698 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:53:18.698 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:53:18.698 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:53:18.698 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:53:18.698 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_max": 32, 2024-09-12T02:53:18.698 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 1 2024-09-12T02:53:18.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.698 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:53:18.698 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": {} 2024-09-12T02:53:18.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.699 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:53:18.699 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:53:18.699 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 8, 2024-09-12T02:53:18.699 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 8, 2024-09-12T02:53:18.699 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 0.25, 2024-09-12T02:53:18.699 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:53:18.699 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:53:18.699 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:53:18.699 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:53:18.699 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:53:18.699 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.699 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 22, 2024-09-12T02:53:18.699 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:53:18.700 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:52:51.909503+0000", 2024-09-12T02:53:18.700 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:53:18.700 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:53:18.700 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:53:18.700 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:53:18.700 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:53:18.700 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:53:18.700 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:53:18.700 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:53:18.700 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:53:18.700 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:53:18.700 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:53:18.700 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:53:18.700 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:53:18.701 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 32, 2024-09-12T02:53:18.701 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 32, 2024-09-12T02:53:18.701 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 32, 2024-09-12T02:53:18.701 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 32, 2024-09-12T02:53:18.701 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 32, 2024-09-12T02:53:18.701 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:53:18.701 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:53:18.701 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:53:18.701 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:53:18.701 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:53:18.701 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:53:18.701 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:53:18.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.701 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "182", 2024-09-12T02:53:18.701 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:53:18.701 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:53:18.702 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:53:18.702 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:53:18.702 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:53:18.702 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:53:18.702 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:53:18.702 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:53:18.702 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:53:18.702 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:53:18.702 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:53:18.702 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:53:18.702 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:53:18.702 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:53:18.702 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:53:18.702 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:53:18.703 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:53:18.703 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:53:18.703 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:53:18.703 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:53:18.703 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:53:18.703 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:53:18.703 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:53:18.703 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:53:18.703 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:53:18.703 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:53:18.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.703 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:53:18.703 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:53:18.703 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:53:18.703 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:53:18.703 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:53:18.704 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:53:18.704 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:53:18.704 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:53:18.704 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:53:18.704 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:53:18.704 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:53:18.704 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:53:18.704 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:53:18.704 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 16, 2024-09-12T02:53:18.704 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_priority": 5 2024-09-12T02:53:18.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.704 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:53:18.704 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:53:18.704 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": "cephfs" 2024-09-12T02:53:18.705 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.705 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:53:18.705 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:53:18.705 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 2, 2024-09-12T02:53:18.705 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 2, 2024-09-12T02:53:18.705 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:53:18.705 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:53:18.705 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:53:18.705 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:53:18.705 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:53:18.705 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:53:18.705 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.706 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 23, 2024-09-12T02:53:18.706 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_data", 2024-09-12T02:53:18.706 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:52:53.146578+0000", 2024-09-12T02:53:18.706 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1027, 2024-09-12T02:53:18.706 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-12T02:53:18.706 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:53:18.706 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:53:18.706 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:53:18.706 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:53:18.706 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:53:18.706 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:53:18.706 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:53:18.706 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:53:18.706 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:53:18.707 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:53:18.707 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:53:18.707 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 64, 2024-09-12T02:53:18.707 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 64, 2024-09-12T02:53:18.707 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 64, 2024-09-12T02:53:18.707 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 64, 2024-09-12T02:53:18.707 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 64, 2024-09-12T02:53:18.707 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:53:18.707 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:53:18.707 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:53:18.707 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:53:18.707 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:53:18.707 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:53:18.707 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:53:18.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.708 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "185", 2024-09-12T02:53:18.708 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:53:18.708 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:53:18.708 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:53:18.708 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:53:18.708 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:53:18.708 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:53:18.708 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:53:18.708 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:53:18.708 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:53:18.708 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 33554432, 2024-09-12T02:53:18.708 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:53:18.708 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:53:18.708 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:53:18.708 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:53:18.709 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:53:18.709 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:53:18.709 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:53:18.709 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:53:18.709 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:53:18.709 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:53:18.709 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:53:18.709 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:53:18.709 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:53:18.709 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:53:18.709 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:53:18.709 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:53:18.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.710 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:53:18.710 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:53:18.710 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:53:18.710 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:53:18.710 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:53:18.710 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:53:18.710 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:53:18.710 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:53:18.710 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:53:18.710 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:53:18.710 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:53:18.710 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:53:18.710 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 64, 2024-09-12T02:53:18.710 INFO:teuthology.orchestra.run.smithi112.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:53:18.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.711 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:53:18.711 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:53:18.711 INFO:teuthology.orchestra.run.smithi112.stdout: "data": "cephfs" 2024-09-12T02:53:18.711 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.711 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:53:18.711 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:53:18.711 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.3799999952316284, 2024-09-12T02:53:18.711 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.3799999952316284, 2024-09-12T02:53:18.711 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:53:18.711 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-12T02:53:18.711 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-12T02:53:18.711 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:53:18.712 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:53:18.712 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:53:18.712 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.712 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.712 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:18.712 INFO:teuthology.orchestra.run.smithi112.stdout: "osds": [ 2024-09-12T02:53:18.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.712 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:53:18.712 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:18.712 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:18.712 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:18.712 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:18.712 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:18.712 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:18.713 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:18.713 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:18.713 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:18.713 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:18.713 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:18.713 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:18.713 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.713 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.713 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6800", 2024-09-12T02:53:18.713 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:18.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.713 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.714 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6801", 2024-09-12T02:53:18.714 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:18.714 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.714 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.714 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:18.714 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.714 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.714 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6802", 2024-09-12T02:53:18.714 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:18.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.714 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.714 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6803", 2024-09-12T02:53:18.715 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:18.715 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.715 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.715 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:18.715 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.715 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.715 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6806", 2024-09-12T02:53:18.715 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:18.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.715 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.716 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6807", 2024-09-12T02:53:18.716 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:18.716 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.716 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.716 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:18.716 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.716 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.716 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6804", 2024-09-12T02:53:18.716 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:18.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.717 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.717 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6805", 2024-09-12T02:53:18.717 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:18.717 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.717 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.717 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6801/821571304", 2024-09-12T02:53:18.717 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6803/821571304", 2024-09-12T02:53:18.717 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6807/821571304", 2024-09-12T02:53:18.717 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6805/821571304", 2024-09-12T02:53:18.717 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:18.717 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:18.717 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:18.717 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.718 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:53:18.718 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:18.718 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:18.718 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:18.718 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:18.718 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:18.718 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:18.718 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:18.718 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:18.718 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:18.718 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:18.718 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:18.719 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:18.719 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.719 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.719 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6808", 2024-09-12T02:53:18.719 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:18.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.719 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.719 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6809", 2024-09-12T02:53:18.719 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:18.719 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.719 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.720 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:18.720 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.720 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.720 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6810", 2024-09-12T02:53:18.720 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:18.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.720 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.720 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6811", 2024-09-12T02:53:18.720 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:18.720 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.720 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.721 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:18.721 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.721 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.721 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6814", 2024-09-12T02:53:18.721 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:18.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.721 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.721 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6815", 2024-09-12T02:53:18.721 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:18.721 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.722 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.722 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:18.722 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.722 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.722 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6812", 2024-09-12T02:53:18.722 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:18.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.722 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.722 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6813", 2024-09-12T02:53:18.722 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:18.722 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.723 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.723 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6809/2642068641", 2024-09-12T02:53:18.723 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6811/2642068641", 2024-09-12T02:53:18.723 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6815/2642068641", 2024-09-12T02:53:18.723 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6813/2642068641", 2024-09-12T02:53:18.723 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:18.723 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:18.723 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:18.723 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.723 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:53:18.723 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:18.724 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:18.724 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:18.724 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:18.724 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:18.724 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:18.724 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:18.724 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:18.724 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:18.724 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:18.724 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:18.724 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:18.724 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.725 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.725 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6816", 2024-09-12T02:53:18.725 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:18.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.725 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.725 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6817", 2024-09-12T02:53:18.725 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:18.725 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.725 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.725 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:18.725 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.726 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.726 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6818", 2024-09-12T02:53:18.726 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:18.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.726 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.726 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6819", 2024-09-12T02:53:18.726 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:18.726 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.726 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.726 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:18.726 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.727 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.727 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6822", 2024-09-12T02:53:18.727 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:18.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.727 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.727 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6823", 2024-09-12T02:53:18.727 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:18.727 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.727 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.727 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:18.728 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.728 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.728 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6820", 2024-09-12T02:53:18.728 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:18.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.728 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.728 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6821", 2024-09-12T02:53:18.728 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:18.728 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.728 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.729 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6817/3365688807", 2024-09-12T02:53:18.729 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6819/3365688807", 2024-09-12T02:53:18.729 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6823/3365688807", 2024-09-12T02:53:18.729 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6821/3365688807", 2024-09-12T02:53:18.729 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:18.729 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:18.729 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:18.729 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.729 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:53:18.729 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:18.729 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:18.729 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:18.730 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:18.730 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:18.730 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:18.730 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:18.730 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:18.730 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:18.730 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:18.730 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:18.730 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:18.730 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.730 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.731 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6824", 2024-09-12T02:53:18.731 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:18.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.731 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.731 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6825", 2024-09-12T02:53:18.731 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:18.731 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.731 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.731 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:18.731 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.732 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.732 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6826", 2024-09-12T02:53:18.732 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:18.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.732 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.732 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6827", 2024-09-12T02:53:18.732 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:18.732 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.732 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.732 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:18.732 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.733 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.733 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6830", 2024-09-12T02:53:18.733 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:18.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.733 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.733 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6831", 2024-09-12T02:53:18.733 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:18.733 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.733 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.733 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:18.733 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.734 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.734 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6828", 2024-09-12T02:53:18.734 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:18.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.734 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.734 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6829", 2024-09-12T02:53:18.734 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:18.734 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.734 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.734 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6825/231774278", 2024-09-12T02:53:18.734 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6827/231774278", 2024-09-12T02:53:18.735 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6831/231774278", 2024-09-12T02:53:18.735 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6829/231774278", 2024-09-12T02:53:18.735 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:18.735 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:18.735 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:18.735 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.735 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:53:18.735 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:18.735 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:18.735 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:18.735 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:18.736 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:18.736 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:18.736 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:18.736 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:18.736 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:18.736 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:18.736 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:18.736 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:18.736 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.736 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.736 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6800", 2024-09-12T02:53:18.736 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:18.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.737 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.737 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6801", 2024-09-12T02:53:18.737 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:18.737 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.737 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.737 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:18.737 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.737 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.737 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6802", 2024-09-12T02:53:18.737 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:18.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.738 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.738 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6803", 2024-09-12T02:53:18.738 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:18.738 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.738 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.738 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:18.738 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.738 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.738 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6806", 2024-09-12T02:53:18.738 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:18.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.738 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.739 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6807", 2024-09-12T02:53:18.739 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:18.739 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.739 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.739 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:18.739 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.739 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.739 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6804", 2024-09-12T02:53:18.739 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:18.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.739 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.740 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6805", 2024-09-12T02:53:18.740 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:18.740 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.740 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.740 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6801/3671178153", 2024-09-12T02:53:18.740 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6803/3671178153", 2024-09-12T02:53:18.740 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6807/3671178153", 2024-09-12T02:53:18.740 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6805/3671178153", 2024-09-12T02:53:18.740 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:18.740 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:18.740 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:18.741 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.741 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:53:18.741 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:18.741 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:18.741 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:18.741 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:18.741 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:18.741 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:18.741 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:18.741 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:18.741 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:18.741 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:18.742 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:18.742 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:18.742 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.742 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.742 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6808", 2024-09-12T02:53:18.742 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:18.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.742 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.742 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6809", 2024-09-12T02:53:18.742 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:18.742 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.742 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.743 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:18.743 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.743 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.743 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6810", 2024-09-12T02:53:18.743 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:18.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.743 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.743 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6811", 2024-09-12T02:53:18.743 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:18.743 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.743 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.744 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:18.744 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.744 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.744 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6817", 2024-09-12T02:53:18.744 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:18.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.744 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.744 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6819", 2024-09-12T02:53:18.744 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:18.744 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.745 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.745 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:18.745 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.745 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.745 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6812", 2024-09-12T02:53:18.745 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:18.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.745 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.745 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6815", 2024-09-12T02:53:18.745 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:18.745 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.746 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.746 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6809/3193706134", 2024-09-12T02:53:18.746 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6811/3193706134", 2024-09-12T02:53:18.746 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6819/3193706134", 2024-09-12T02:53:18.746 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6815/3193706134", 2024-09-12T02:53:18.746 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:18.746 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:18.746 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:18.746 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.746 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:53:18.746 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:18.747 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:18.747 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:18.747 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:18.747 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:18.747 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:18.747 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:18.747 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:18.747 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:18.747 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:18.747 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:18.747 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:18.747 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.747 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.747 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6813", 2024-09-12T02:53:18.748 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:18.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.748 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.748 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6814", 2024-09-12T02:53:18.748 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:18.748 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.748 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.748 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:18.748 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.748 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.748 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6816", 2024-09-12T02:53:18.749 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:18.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.749 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.749 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6818", 2024-09-12T02:53:18.749 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:18.749 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.749 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.749 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:18.749 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.749 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.749 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6822", 2024-09-12T02:53:18.750 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:18.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.750 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.750 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6823", 2024-09-12T02:53:18.750 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:18.750 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.750 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.750 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:18.750 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.750 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.751 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6820", 2024-09-12T02:53:18.751 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:18.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.751 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.751 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6821", 2024-09-12T02:53:18.751 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:18.751 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.751 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.751 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6814/3738813293", 2024-09-12T02:53:18.751 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6818/3738813293", 2024-09-12T02:53:18.751 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6823/3738813293", 2024-09-12T02:53:18.751 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6821/3738813293", 2024-09-12T02:53:18.752 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:18.752 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:18.752 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:18.752 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.752 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:53:18.752 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:18.752 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:18.752 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:18.752 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:18.752 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:18.752 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:18.752 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:18.753 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:18.753 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:18.753 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:18.753 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:18.753 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:18.753 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.753 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.753 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6824", 2024-09-12T02:53:18.753 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:18.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.753 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.754 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6825", 2024-09-12T02:53:18.754 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:18.754 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.754 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.754 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:18.754 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.754 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.754 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6826", 2024-09-12T02:53:18.754 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:18.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.754 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.754 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6827", 2024-09-12T02:53:18.755 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:18.755 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.755 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.755 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:18.755 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.755 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.755 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6830", 2024-09-12T02:53:18.755 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:18.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.755 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.755 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6831", 2024-09-12T02:53:18.756 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:18.756 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.756 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.756 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:18.756 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:18.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.756 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:18.756 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6828", 2024-09-12T02:53:18.756 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:18.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.756 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:18.756 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6829", 2024-09-12T02:53:18.757 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:18.757 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.757 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.757 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6825/1421932609", 2024-09-12T02:53:18.757 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6827/1421932609", 2024-09-12T02:53:18.757 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6831/1421932609", 2024-09-12T02:53:18.757 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6829/1421932609", 2024-09-12T02:53:18.757 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:18.757 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:18.757 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:18.757 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:18.757 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.757 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:18.757 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_xinfo": [ 2024-09-12T02:53:18.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.758 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:53:18.758 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:18.758 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:18.758 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:18.758 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:18.758 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:18.758 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.220641+0000", 2024-09-12T02:53:18.758 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:18.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.758 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:53:18.758 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:18.758 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:18.759 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:18.759 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:18.759 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:18.759 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312574+0000", 2024-09-12T02:53:18.759 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:18.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.759 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:53:18.759 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:18.759 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:18.759 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:18.759 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:18.759 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:18.760 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.282771+0000", 2024-09-12T02:53:18.760 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:18.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.760 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:53:18.760 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:18.760 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:18.760 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:18.760 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:18.760 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:18.760 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.260478+0000", 2024-09-12T02:53:18.760 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:18.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.761 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:53:18.761 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:18.761 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:18.761 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:18.761 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:18.761 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:18.761 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.273397+0000", 2024-09-12T02:53:18.761 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:18.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.761 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:53:18.761 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:18.761 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:18.761 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:18.761 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:18.762 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:18.762 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312452+0000", 2024-09-12T02:53:18.762 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:18.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.762 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:53:18.762 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:18.762 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:18.762 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:18.762 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:18.762 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:18.762 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.308965+0000", 2024-09-12T02:53:18.762 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:18.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:18.763 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:53:18.763 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:18.763 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:18.763 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:18.763 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:18.763 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:18.763 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.337842+0000", 2024-09-12T02:53:18.763 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:18.763 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.763 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:18.763 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap": [], 2024-09-12T02:53:18.763 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_items": [], 2024-09-12T02:53:18.763 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_primaries": [], 2024-09-12T02:53:18.763 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_temp": [], 2024-09-12T02:53:18.764 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_temp": [], 2024-09-12T02:53:18.764 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklist": {}, 2024-09-12T02:53:18.764 INFO:teuthology.orchestra.run.smithi112.stdout: "range_blocklist": {}, 2024-09-12T02:53:18.764 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profiles": { 2024-09-12T02:53:18.764 INFO:teuthology.orchestra.run.smithi112.stdout: "default": { 2024-09-12T02:53:18.764 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-failure-domain": "osd", 2024-09-12T02:53:18.764 INFO:teuthology.orchestra.run.smithi112.stdout: "k": "2", 2024-09-12T02:53:18.764 INFO:teuthology.orchestra.run.smithi112.stdout: "m": "1", 2024-09-12T02:53:18.764 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin": "jerasure", 2024-09-12T02:53:18.764 INFO:teuthology.orchestra.run.smithi112.stdout: "technique": "reed_sol_van" 2024-09-12T02:53:18.764 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:18.764 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps_queue": [], 2024-09-12T02:53:18.764 INFO:teuthology.orchestra.run.smithi112.stdout: "new_removed_snaps": [], 2024-09-12T02:53:18.765 INFO:teuthology.orchestra.run.smithi112.stdout: "new_purged_snaps": [], 2024-09-12T02:53:18.765 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_node_flags": {}, 2024-09-12T02:53:18.765 INFO:teuthology.orchestra.run.smithi112.stdout: "device_class_flags": {}, 2024-09-12T02:53:18.765 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode": { 2024-09-12T02:53:18.765 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_enabled": false, 2024-09-12T02:53:18.765 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_bucket_count": 0, 2024-09-12T02:53:18.765 INFO:teuthology.orchestra.run.smithi112.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:53:18.765 INFO:teuthology.orchestra.run.smithi112.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:53:18.765 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_bucket": 0 2024-09-12T02:53:18.765 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:18.765 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:53:18.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.692+0000 7f2bde400640 1 -- 172.21.15.112:0/24112036 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2bb806be60 msgr2=0x7f2bb806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:18.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.692+0000 7f2bde400640 1 --2- 172.21.15.112:0/24112036 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2bb806be60 0x7f2bb806e320 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8033000 tx=0x7f2bc8008030 comp rx=0 tx=0).stop 2024-09-12T02:53:18.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.692+0000 7f2bde400640 1 -- 172.21.15.112:0/24112036 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bd80cf420 msgr2=0x7f2bd80cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:18.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.692+0000 7f2bde400640 1 --2- 172.21.15.112:0/24112036 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bd80cf420 0x7f2bd80cf8a0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4001910 tx=0x7f2bc4006c40 comp rx=0 tx=0).stop 2024-09-12T02:53:18.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.692+0000 7f2bde400640 1 -- 172.21.15.112:0/24112036 shutdown_connections 2024-09-12T02:53:18.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.692+0000 7f2bde400640 1 --2- 172.21.15.112:0/24112036 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2bb806be60 0x7f2bb806e320 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:18.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.692+0000 7f2bde400640 1 --2- 172.21.15.112:0/24112036 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd80cd690 0x7f2bd80cdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:18.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.692+0000 7f2bde400640 1 --2- 172.21.15.112:0/24112036 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bd80cf420 0x7f2bd80cf8a0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:18.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.692+0000 7f2bde400640 1 --2- 172.21.15.112:0/24112036 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2bd806d8c0 0x7f2bd814d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:18.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.692+0000 7f2bde400640 1 -- 172.21.15.112:0/24112036 >> 172.21.15.112:0/24112036 conn(0x7f2bd806bbd0 msgr2=0x7f2bd815b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:18.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.692+0000 7f2bde400640 1 -- 172.21.15.112:0/24112036 shutdown_connections 2024-09-12T02:53:18.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:18.692+0000 7f2bde400640 1 -- 172.21.15.112:0/24112036 wait complete. 2024-09-12T02:53:18.768 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-12T02:53:23.037 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:53:23.042 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:53:23.769 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-12T02:53:23.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.932+0000 7fdca5800640 1 Processor -- start 2024-09-12T02:53:23.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.932+0000 7fdca5800640 1 -- start start 2024-09-12T02:53:23.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.934+0000 7fdca5800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdca015b9d0 0x7fdca00b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:23.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.934+0000 7fdca5800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdca00b45d0 0x7fdca00728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:23.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.934+0000 7fdca5800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdca006eef0 0x7fdca006f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:23.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.934+0000 7fdca5800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fdca00b4a30 con 0x7fdca006eef0 2024-09-12T02:53:23.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.934+0000 7fdca5800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fdca006f840 con 0x7fdca00b45d0 2024-09-12T02:53:23.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.934+0000 7fdca5800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdca00b54a0 con 0x7fdca015b9d0 2024-09-12T02:53:23.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.934+0000 7fdc9f400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdca006eef0 0x7fdca006f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:23.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.934+0000 7fdc9f400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdca006eef0 0x7fdca006f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34216/0 (socket says 172.21.15.112:34216) 2024-09-12T02:53:23.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.934+0000 7fdc9f400640 1 -- 172.21.15.112:0/1109157606 learned_addr learned my addr 172.21.15.112:0/1109157606 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:23.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.934+0000 7fdc9e000640 1 --2- 172.21.15.112:0/1109157606 >> v2:172.21.15.137:3300/0 conn(0x7fdca00b45d0 0x7fdca00728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:23.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.934+0000 7fdc9f400640 1 -- 172.21.15.112:0/1109157606 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdca015b9d0 msgr2=0x7fdca00b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:23.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.934+0000 7fdc9ea00640 1 --2- 172.21.15.112:0/1109157606 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdca015b9d0 0x7fdca00b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:23.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.934+0000 7fdc9f400640 1 --2- 172.21.15.112:0/1109157606 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdca015b9d0 0x7fdca00b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:23.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.934+0000 7fdc9f400640 1 -- 172.21.15.112:0/1109157606 >> v2:172.21.15.137:3300/0 conn(0x7fdca00b45d0 msgr2=0x7fdca00728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:23.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.934+0000 7fdc9f400640 1 --2- 172.21.15.112:0/1109157606 >> v2:172.21.15.137:3300/0 conn(0x7fdca00b45d0 0x7fdca00728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:23.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.934+0000 7fdc9f400640 1 -- 172.21.15.112:0/1109157606 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca00b3af0 con 0x7fdca006eef0 2024-09-12T02:53:23.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.934+0000 7fdc9e000640 1 --2- 172.21.15.112:0/1109157606 >> v2:172.21.15.137:3300/0 conn(0x7fdca00b45d0 0x7fdca00728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:53:23.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.934+0000 7fdc9ea00640 1 --2- 172.21.15.112:0/1109157606 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdca015b9d0 0x7fdca00b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:53:23.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.935+0000 7fdc9f400640 1 --2- 172.21.15.112:0/1109157606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdca006eef0 0x7fdca006f300 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fdca006d2e0 tx=0x7fdc9802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8940355387db7cf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:23.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.936+0000 7fdc9d600640 1 -- 172.21.15.112:0/1109157606 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc98037070 con 0x7fdca006eef0 2024-09-12T02:53:23.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.936+0000 7fdc9d600640 1 -- 172.21.15.112:0/1109157606 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc98032440 con 0x7fdca006eef0 2024-09-12T02:53:23.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.936+0000 7fdc9d600640 1 -- 172.21.15.112:0/1109157606 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc98032810 con 0x7fdca006eef0 2024-09-12T02:53:23.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.936+0000 7fdca5800640 1 -- 172.21.15.112:0/1109157606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdca006eef0 msgr2=0x7fdca006f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:23.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.936+0000 7fdca5800640 1 --2- 172.21.15.112:0/1109157606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdca006eef0 0x7fdca006f300 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fdca006d2e0 tx=0x7fdc9802a1e0 comp rx=0 tx=0).stop 2024-09-12T02:53:23.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.936+0000 7fdca5800640 1 -- 172.21.15.112:0/1109157606 shutdown_connections 2024-09-12T02:53:23.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.936+0000 7fdca5800640 1 --2- 172.21.15.112:0/1109157606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdca006eef0 0x7fdca006f300 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:23.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.936+0000 7fdca5800640 1 --2- 172.21.15.112:0/1109157606 >> v2:172.21.15.137:3300/0 conn(0x7fdca00b45d0 0x7fdca00728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:23.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.936+0000 7fdca5800640 1 --2- 172.21.15.112:0/1109157606 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdca015b9d0 0x7fdca00b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:23.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.936+0000 7fdca5800640 1 -- 172.21.15.112:0/1109157606 >> 172.21.15.112:0/1109157606 conn(0x7fdca006bbd0 msgr2=0x7fdca006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:23.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.936+0000 7fdca5800640 1 -- 172.21.15.112:0/1109157606 shutdown_connections 2024-09-12T02:53:23.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.936+0000 7fdca5800640 1 -- 172.21.15.112:0/1109157606 wait complete. 2024-09-12T02:53:23.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.938+0000 7fdca5800640 1 Processor -- start 2024-09-12T02:53:23.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.938+0000 7fdca5800640 1 -- start start 2024-09-12T02:53:23.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.939+0000 7fdca5800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdca006eef0 0x7fdca00aa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:23.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.939+0000 7fdca5800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdca00b45d0 0x7fdca0150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:23.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.939+0000 7fdca5800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdca015b9d0 0x7fdca00ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:23.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.939+0000 7fdca5800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdca015bdb0 con 0x7fdca00b45d0 2024-09-12T02:53:23.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.939+0000 7fdca5800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdca00b40b0 con 0x7fdca015b9d0 2024-09-12T02:53:23.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.939+0000 7fdca5800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdca015bf30 con 0x7fdca006eef0 2024-09-12T02:53:23.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.939+0000 7fdc9e000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdca00b45d0 0x7fdca0150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:23.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.939+0000 7fdc9e000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdca00b45d0 0x7fdca0150ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34218/0 (socket says 172.21.15.112:34218) 2024-09-12T02:53:23.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.939+0000 7fdc9e000640 1 -- 172.21.15.112:0/3153955785 learned_addr learned my addr 172.21.15.112:0/3153955785 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:23.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.939+0000 7fdc9ea00640 1 --2- 172.21.15.112:0/3153955785 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdca006eef0 0x7fdca00aa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:23.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.940+0000 7fdc9f400640 1 --2- 172.21.15.112:0/3153955785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdca015b9d0 0x7fdca00ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:23.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.940+0000 7fdc9e000640 1 -- 172.21.15.112:0/3153955785 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdca006eef0 msgr2=0x7fdca00aa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:23.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.940+0000 7fdc9e000640 1 --2- 172.21.15.112:0/3153955785 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdca006eef0 0x7fdca00aa4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:23.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.940+0000 7fdc9e000640 1 -- 172.21.15.112:0/3153955785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdca015b9d0 msgr2=0x7fdca00ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:23.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.940+0000 7fdc9e000640 1 --2- 172.21.15.112:0/3153955785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdca015b9d0 0x7fdca00ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:23.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.940+0000 7fdc9e000640 1 -- 172.21.15.112:0/3153955785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca0153a00 con 0x7fdca00b45d0 2024-09-12T02:53:23.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.940+0000 7fdc9f400640 1 --2- 172.21.15.112:0/3153955785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdca015b9d0 0x7fdca00ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:53:23.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.940+0000 7fdc9e000640 1 --2- 172.21.15.112:0/3153955785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdca00b45d0 0x7fdca0150ab0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00c7f0 tx=0x7fdc8c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:23.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.940+0000 7fdc96a00640 1 -- 172.21.15.112:0/3153955785 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c005b90 con 0x7fdca00b45d0 2024-09-12T02:53:23.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.940+0000 7fdc96a00640 1 -- 172.21.15.112:0/3153955785 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc8c005d30 con 0x7fdca00b45d0 2024-09-12T02:53:23.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.940+0000 7fdca5800640 1 -- 172.21.15.112:0/3153955785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdca0153ce0 con 0x7fdca00b45d0 2024-09-12T02:53:23.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.940+0000 7fdc96a00640 1 -- 172.21.15.112:0/3153955785 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c007a30 con 0x7fdca00b45d0 2024-09-12T02:53:23.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.940+0000 7fdca5800640 1 -- 172.21.15.112:0/3153955785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdca00ab400 con 0x7fdca00b45d0 2024-09-12T02:53:23.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.941+0000 7fdca5800640 1 -- 172.21.15.112:0/3153955785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdca0068a30 con 0x7fdca00b45d0 2024-09-12T02:53:23.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.942+0000 7fdc96a00640 1 -- 172.21.15.112:0/3153955785 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdc8c007bd0 con 0x7fdca00b45d0 2024-09-12T02:53:23.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.943+0000 7fdc96a00640 1 --2- 172.21.15.112:0/3153955785 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdc8006be30 0x7fdc8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:23.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.943+0000 7fdc96a00640 1 -- 172.21.15.112:0/3153955785 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7fdc8c08af60 con 0x7fdca00b45d0 2024-09-12T02:53:23.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.943+0000 7fdc9ea00640 1 --2- 172.21.15.112:0/3153955785 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdc8006be30 0x7fdc8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:23.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.943+0000 7fdc96a00640 1 -- 172.21.15.112:0/3153955785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=186}) -- 0x7fdc80073960 con 0x7fdca00b45d0 2024-09-12T02:53:23.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.944+0000 7fdc9ea00640 1 --2- 172.21.15.112:0/3153955785 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdc8006be30 0x7fdc8006e2f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fdc90007130 tx=0x7fdc90007060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:23.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:23.948+0000 7fdc96a00640 1 -- 172.21.15.112:0/3153955785 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc8c015020 con 0x7fdca00b45d0 2024-09-12T02:53:24.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:24.123+0000 7fdca5800640 1 -- 172.21.15.112:0/3153955785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fdca006f300 con 0x7fdca00b45d0 2024-09-12T02:53:24.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:24.124+0000 7fdc96a00640 1 -- 172.21.15.112:0/3153955785 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v185) ==== 81+0+34337 (secure 0 0 0) 0x7fdc8c059900 con 0x7fdca00b45d0 2024-09-12T02:53:24.126 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:53:24.126 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:53:24.126 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 185, 2024-09-12T02:53:24.126 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:53:24.126 INFO:teuthology.orchestra.run.smithi112.stdout: "created": "2024-09-12T02:41:36.162095+0000", 2024-09-12T02:53:24.126 INFO:teuthology.orchestra.run.smithi112.stdout: "modified": "2024-09-12T02:53:11.064679+0000", 2024-09-12T02:53:24.126 INFO:teuthology.orchestra.run.smithi112.stdout: "last_up_change": "2024-09-12T02:41:42.191169+0000", 2024-09-12T02:53:24.126 INFO:teuthology.orchestra.run.smithi112.stdout: "last_in_change": "2024-09-12T02:41:39.036600+0000", 2024-09-12T02:53:24.126 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:53:24.127 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_num": 5799936, 2024-09-12T02:53:24.127 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_set": [ 2024-09-12T02:53:24.127 INFO:teuthology.orchestra.run.smithi112.stdout: "pglog_hardlimit", 2024-09-12T02:53:24.127 INFO:teuthology.orchestra.run.smithi112.stdout: "purged_snapdirs", 2024-09-12T02:53:24.127 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_deletes", 2024-09-12T02:53:24.127 INFO:teuthology.orchestra.run.smithi112.stdout: "sortbitwise" 2024-09-12T02:53:24.127 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:24.127 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_version": 4, 2024-09-12T02:53:24.127 INFO:teuthology.orchestra.run.smithi112.stdout: "full_ratio": 0.69999998807907104, 2024-09-12T02:53:24.127 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-12T02:53:24.127 INFO:teuthology.orchestra.run.smithi112.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-12T02:53:24.127 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_snapshot": "", 2024-09-12T02:53:24.127 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_max": 23, 2024-09-12T02:53:24.127 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd": 8, 2024-09-12T02:53:24.127 INFO:teuthology.orchestra.run.smithi112.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:53:24.128 INFO:teuthology.orchestra.run.smithi112.stdout: "min_compat_client": "jewel", 2024-09-12T02:53:24.128 INFO:teuthology.orchestra.run.smithi112.stdout: "require_osd_release": "squid", 2024-09-12T02:53:24.128 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_crimson": false, 2024-09-12T02:53:24.128 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-12T02:53:24.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.128 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 1, 2024-09-12T02:53:24.128 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": ".mgr", 2024-09-12T02:53:24.128 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:41:43.011599+0000", 2024-09-12T02:53:24.128 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:53:24.128 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:53:24.128 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:53:24.128 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:53:24.128 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:53:24.128 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:53:24.129 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:53:24.129 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:53:24.129 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:53:24.129 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:53:24.129 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:53:24.129 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:53:24.129 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:53:24.129 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 1, 2024-09-12T02:53:24.129 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 1, 2024-09-12T02:53:24.129 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 1, 2024-09-12T02:53:24.129 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 1, 2024-09-12T02:53:24.129 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 1, 2024-09-12T02:53:24.129 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:53:24.130 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:53:24.130 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:53:24.130 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:53:24.130 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:53:24.130 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:53:24.130 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:53:24.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.130 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "109", 2024-09-12T02:53:24.130 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:53:24.130 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:53:24.130 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:53:24.130 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:53:24.130 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:53:24.130 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:53:24.131 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:53:24.131 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:53:24.131 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:53:24.131 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:53:24.131 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:53:24.131 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:53:24.131 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:53:24.131 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:53:24.131 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:53:24.131 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:53:24.131 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:53:24.131 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:53:24.131 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:53:24.131 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:53:24.131 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:53:24.132 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:53:24.132 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:53:24.132 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:53:24.132 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:53:24.132 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:53:24.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.132 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:53:24.132 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:53:24.132 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:53:24.132 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:53:24.132 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:53:24.132 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:53:24.132 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:53:24.132 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:53:24.133 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:53:24.133 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:53:24.133 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:53:24.133 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:53:24.133 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_max": 32, 2024-09-12T02:53:24.133 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 1 2024-09-12T02:53:24.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.133 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:53:24.133 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": {} 2024-09-12T02:53:24.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.133 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:53:24.133 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:53:24.133 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 8, 2024-09-12T02:53:24.133 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 8, 2024-09-12T02:53:24.134 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 0.25, 2024-09-12T02:53:24.134 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:53:24.134 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:53:24.134 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:53:24.134 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:53:24.134 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:53:24.134 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.134 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 22, 2024-09-12T02:53:24.134 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:53:24.134 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:52:51.909503+0000", 2024-09-12T02:53:24.134 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:53:24.134 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:53:24.134 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:53:24.135 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:53:24.135 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:53:24.135 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:53:24.135 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:53:24.135 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:53:24.135 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:53:24.135 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:53:24.135 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:53:24.135 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:53:24.135 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:53:24.135 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 32, 2024-09-12T02:53:24.135 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 32, 2024-09-12T02:53:24.135 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 32, 2024-09-12T02:53:24.135 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 32, 2024-09-12T02:53:24.135 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 32, 2024-09-12T02:53:24.136 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:53:24.136 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:53:24.136 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:53:24.136 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:53:24.136 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:53:24.136 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:53:24.136 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:53:24.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.136 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "182", 2024-09-12T02:53:24.136 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:53:24.136 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:53:24.136 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:53:24.136 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:53:24.137 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:53:24.137 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:53:24.137 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:53:24.137 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:53:24.137 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:53:24.137 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:53:24.137 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:53:24.137 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:53:24.137 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:53:24.137 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:53:24.137 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:53:24.137 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:53:24.137 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:53:24.138 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:53:24.138 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:53:24.138 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:53:24.138 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:53:24.138 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:53:24.138 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:53:24.138 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:53:24.138 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:53:24.138 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:53:24.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.138 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:53:24.138 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:53:24.138 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:53:24.138 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:53:24.138 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:53:24.138 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:53:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:53:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:53:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:53:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:53:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:53:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:53:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:53:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 16, 2024-09-12T02:53:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_priority": 5 2024-09-12T02:53:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:53:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:53:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": "cephfs" 2024-09-12T02:53:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.140 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:53:24.140 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:53:24.140 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 2, 2024-09-12T02:53:24.140 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 2, 2024-09-12T02:53:24.140 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:53:24.140 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:53:24.140 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:53:24.140 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:53:24.140 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:53:24.140 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:53:24.140 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.140 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 23, 2024-09-12T02:53:24.141 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_data", 2024-09-12T02:53:24.141 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:52:53.146578+0000", 2024-09-12T02:53:24.141 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1027, 2024-09-12T02:53:24.141 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-12T02:53:24.141 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:53:24.141 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:53:24.141 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:53:24.141 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:53:24.141 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:53:24.141 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:53:24.141 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:53:24.141 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:53:24.142 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:53:24.142 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:53:24.142 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:53:24.142 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 64, 2024-09-12T02:53:24.142 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 64, 2024-09-12T02:53:24.142 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 64, 2024-09-12T02:53:24.142 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 64, 2024-09-12T02:53:24.142 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 64, 2024-09-12T02:53:24.142 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:53:24.142 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:53:24.142 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:53:24.142 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:53:24.142 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:53:24.143 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:53:24.143 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:53:24.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.143 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "185", 2024-09-12T02:53:24.143 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:53:24.143 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:53:24.143 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:53:24.143 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:53:24.143 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:53:24.143 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:53:24.143 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:53:24.143 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:53:24.143 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:53:24.143 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 33554432, 2024-09-12T02:53:24.143 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:53:24.144 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:53:24.144 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:53:24.144 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:53:24.144 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:53:24.144 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:53:24.144 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:53:24.144 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:53:24.144 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:53:24.144 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:53:24.144 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:53:24.144 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:53:24.144 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:53:24.144 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:53:24.144 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:53:24.145 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:53:24.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.145 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:53:24.145 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:53:24.145 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:53:24.145 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:53:24.145 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:53:24.145 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:53:24.145 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:53:24.145 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:53:24.145 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:53:24.145 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:53:24.145 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:53:24.146 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:53:24.146 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 64, 2024-09-12T02:53:24.146 INFO:teuthology.orchestra.run.smithi112.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:53:24.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.146 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:53:24.146 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:53:24.146 INFO:teuthology.orchestra.run.smithi112.stdout: "data": "cephfs" 2024-09-12T02:53:24.146 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.146 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:53:24.146 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:53:24.146 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.3799999952316284, 2024-09-12T02:53:24.146 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.3799999952316284, 2024-09-12T02:53:24.146 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:53:24.147 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-12T02:53:24.147 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-12T02:53:24.147 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:53:24.147 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:53:24.147 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:53:24.147 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.147 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.147 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:24.147 INFO:teuthology.orchestra.run.smithi112.stdout: "osds": [ 2024-09-12T02:53:24.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.147 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:53:24.147 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:24.147 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:24.147 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:24.148 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:24.148 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:24.148 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:24.148 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:24.148 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:24.148 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:24.148 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:24.148 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:24.148 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:24.148 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.148 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.148 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6800", 2024-09-12T02:53:24.148 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:24.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.149 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.149 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6801", 2024-09-12T02:53:24.149 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:24.149 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.149 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.149 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:24.149 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.149 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.149 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6802", 2024-09-12T02:53:24.150 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:24.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.150 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.150 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6803", 2024-09-12T02:53:24.150 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:24.150 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.150 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.150 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:24.150 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.150 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.150 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6806", 2024-09-12T02:53:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6807", 2024-09-12T02:53:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6804", 2024-09-12T02:53:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.152 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.152 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6805", 2024-09-12T02:53:24.152 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:24.152 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.152 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.152 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6801/821571304", 2024-09-12T02:53:24.152 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6803/821571304", 2024-09-12T02:53:24.152 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6807/821571304", 2024-09-12T02:53:24.152 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6805/821571304", 2024-09-12T02:53:24.152 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:24.152 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:24.153 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:24.153 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.153 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:53:24.153 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:24.153 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:24.153 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:24.153 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:24.153 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:24.153 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:24.153 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:24.153 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:24.153 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:24.153 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:24.154 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:24.154 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:24.154 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.154 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.154 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6808", 2024-09-12T02:53:24.154 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:24.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.154 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.154 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6809", 2024-09-12T02:53:24.154 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:24.154 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.154 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6810", 2024-09-12T02:53:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6811", 2024-09-12T02:53:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6814", 2024-09-12T02:53:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6815", 2024-09-12T02:53:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.157 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.157 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6812", 2024-09-12T02:53:24.157 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:24.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.157 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.157 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6813", 2024-09-12T02:53:24.157 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:24.157 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.157 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.157 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6809/2642068641", 2024-09-12T02:53:24.157 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6811/2642068641", 2024-09-12T02:53:24.157 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6815/2642068641", 2024-09-12T02:53:24.157 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6813/2642068641", 2024-09-12T02:53:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:53:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:24.159 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:24.159 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:24.159 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:24.159 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:24.159 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.159 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.159 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6816", 2024-09-12T02:53:24.159 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:24.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.159 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.159 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6817", 2024-09-12T02:53:24.159 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:24.159 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.160 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.160 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:24.160 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.160 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.160 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6818", 2024-09-12T02:53:24.160 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:24.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.160 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.160 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6819", 2024-09-12T02:53:24.160 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:24.160 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.160 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.161 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:24.161 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.161 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.161 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6822", 2024-09-12T02:53:24.161 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:24.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.161 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.161 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6823", 2024-09-12T02:53:24.161 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:24.161 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.161 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.162 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:24.162 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.162 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.162 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6820", 2024-09-12T02:53:24.162 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:24.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.162 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.162 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6821", 2024-09-12T02:53:24.162 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:24.162 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.162 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6817/3365688807", 2024-09-12T02:53:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6819/3365688807", 2024-09-12T02:53:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6823/3365688807", 2024-09-12T02:53:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6821/3365688807", 2024-09-12T02:53:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:53:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:24.164 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:24.164 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:24.164 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:24.164 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:24.164 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:24.164 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:24.164 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:24.164 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.164 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.164 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6824", 2024-09-12T02:53:24.164 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:24.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.165 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.165 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6825", 2024-09-12T02:53:24.165 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:24.165 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.165 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.165 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:24.165 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.165 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.165 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6826", 2024-09-12T02:53:24.165 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:24.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.165 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.166 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6827", 2024-09-12T02:53:24.166 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:24.166 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.166 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.166 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:24.166 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.166 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.166 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6830", 2024-09-12T02:53:24.166 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:24.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.166 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.166 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6831", 2024-09-12T02:53:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6828", 2024-09-12T02:53:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6829", 2024-09-12T02:53:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.168 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.168 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6825/231774278", 2024-09-12T02:53:24.168 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6827/231774278", 2024-09-12T02:53:24.168 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6831/231774278", 2024-09-12T02:53:24.168 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6829/231774278", 2024-09-12T02:53:24.168 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:24.168 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:24.168 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:24.168 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.168 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:53:24.168 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:24.168 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:24.169 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:24.169 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:24.169 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:24.169 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:24.169 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:24.169 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:24.169 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:24.169 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:24.169 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:24.169 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:24.169 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.169 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.169 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6800", 2024-09-12T02:53:24.169 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:24.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.170 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.170 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6801", 2024-09-12T02:53:24.170 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:24.170 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.170 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.170 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:24.170 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.170 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.170 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6802", 2024-09-12T02:53:24.170 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:24.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6803", 2024-09-12T02:53:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6806", 2024-09-12T02:53:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.172 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6807", 2024-09-12T02:53:24.172 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:24.172 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.172 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.172 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:24.172 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.172 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.172 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6804", 2024-09-12T02:53:24.172 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:24.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.172 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.172 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6805", 2024-09-12T02:53:24.173 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:24.173 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.173 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.173 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6801/3671178153", 2024-09-12T02:53:24.173 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6803/3671178153", 2024-09-12T02:53:24.173 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6807/3671178153", 2024-09-12T02:53:24.173 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6805/3671178153", 2024-09-12T02:53:24.173 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:24.173 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:24.173 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:24.173 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.174 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:53:24.174 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:24.174 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:24.174 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:24.174 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:24.174 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:24.174 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:24.174 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:24.174 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:24.174 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:24.174 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:24.174 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:24.174 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:24.174 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6808", 2024-09-12T02:53:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6809", 2024-09-12T02:53:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6810", 2024-09-12T02:53:24.176 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:24.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.176 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.176 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6811", 2024-09-12T02:53:24.176 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:24.176 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.176 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.176 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:24.176 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.176 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.176 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6817", 2024-09-12T02:53:24.176 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:24.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.177 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.177 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6819", 2024-09-12T02:53:24.177 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:24.177 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.177 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.177 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:24.177 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.177 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.177 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6812", 2024-09-12T02:53:24.177 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:24.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.178 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.178 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6815", 2024-09-12T02:53:24.178 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:24.178 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.178 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.178 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6809/3193706134", 2024-09-12T02:53:24.178 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6811/3193706134", 2024-09-12T02:53:24.178 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6819/3193706134", 2024-09-12T02:53:24.178 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6815/3193706134", 2024-09-12T02:53:24.178 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:24.178 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:24.178 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:24.178 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.179 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:53:24.179 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:24.179 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:24.179 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:24.179 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:24.179 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:24.179 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:24.179 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:24.179 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:24.179 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:24.179 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:24.179 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:24.180 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:24.180 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.180 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.180 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6813", 2024-09-12T02:53:24.180 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:24.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.180 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.180 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6814", 2024-09-12T02:53:24.180 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:24.180 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.180 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.181 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:24.181 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.181 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.181 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6816", 2024-09-12T02:53:24.181 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:24.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.181 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.181 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6818", 2024-09-12T02:53:24.181 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:24.181 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.181 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.181 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:24.181 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.182 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.182 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6822", 2024-09-12T02:53:24.182 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:24.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.182 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.182 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6823", 2024-09-12T02:53:24.182 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:24.182 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.182 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.182 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:24.182 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.183 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.183 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6820", 2024-09-12T02:53:24.183 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:24.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.183 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.183 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6821", 2024-09-12T02:53:24.183 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:24.183 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.183 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.183 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6814/3738813293", 2024-09-12T02:53:24.183 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6818/3738813293", 2024-09-12T02:53:24.183 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6823/3738813293", 2024-09-12T02:53:24.184 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6821/3738813293", 2024-09-12T02:53:24.184 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:24.184 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:24.184 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:24.184 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.184 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:53:24.184 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:24.184 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:24.184 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:24.184 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:24.184 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:24.184 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:24.185 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:24.185 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:24.185 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:24.185 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:24.185 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:24.185 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:24.185 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.185 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.185 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6824", 2024-09-12T02:53:24.185 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:24.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.186 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.186 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6825", 2024-09-12T02:53:24.186 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:24.186 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.186 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.186 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:24.186 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.186 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.186 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6826", 2024-09-12T02:53:24.186 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:24.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.187 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.187 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6827", 2024-09-12T02:53:24.187 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:24.187 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.187 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.187 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:24.187 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.187 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.187 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6830", 2024-09-12T02:53:24.187 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:24.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.188 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.188 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6831", 2024-09-12T02:53:24.188 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:24.188 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.188 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.188 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:24.188 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:24.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.188 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:24.188 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6828", 2024-09-12T02:53:24.188 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:24.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.189 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:24.189 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6829", 2024-09-12T02:53:24.189 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:24.189 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.189 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.189 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6825/1421932609", 2024-09-12T02:53:24.189 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6827/1421932609", 2024-09-12T02:53:24.189 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6831/1421932609", 2024-09-12T02:53:24.189 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6829/1421932609", 2024-09-12T02:53:24.189 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:24.190 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:24.190 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:24.190 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:24.190 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.190 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:24.190 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_xinfo": [ 2024-09-12T02:53:24.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.190 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:53:24.190 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:24.190 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:24.190 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:24.190 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:24.190 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:24.191 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.220641+0000", 2024-09-12T02:53:24.191 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:24.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.191 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:53:24.191 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:24.191 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:24.191 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:24.191 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:24.191 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:24.191 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312574+0000", 2024-09-12T02:53:24.191 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:24.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.192 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:53:24.192 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:24.192 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:24.192 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:24.192 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:24.192 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:24.192 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.282771+0000", 2024-09-12T02:53:24.192 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:24.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.192 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:53:24.192 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:24.192 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:24.192 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:24.193 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:24.193 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:24.193 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.260478+0000", 2024-09-12T02:53:24.193 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:24.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.193 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:53:24.193 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:24.193 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:24.193 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:24.193 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:24.193 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:24.193 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.273397+0000", 2024-09-12T02:53:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:53:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312452+0000", 2024-09-12T02:53:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:53:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.308965+0000", 2024-09-12T02:53:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:53:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.337842+0000", 2024-09-12T02:53:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap": [], 2024-09-12T02:53:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_items": [], 2024-09-12T02:53:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_primaries": [], 2024-09-12T02:53:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_temp": [], 2024-09-12T02:53:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_temp": [], 2024-09-12T02:53:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklist": {}, 2024-09-12T02:53:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: "range_blocklist": {}, 2024-09-12T02:53:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profiles": { 2024-09-12T02:53:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: "default": { 2024-09-12T02:53:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-failure-domain": "osd", 2024-09-12T02:53:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: "k": "2", 2024-09-12T02:53:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: "m": "1", 2024-09-12T02:53:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin": "jerasure", 2024-09-12T02:53:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: "technique": "reed_sol_van" 2024-09-12T02:53:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps_queue": [], 2024-09-12T02:53:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: "new_removed_snaps": [], 2024-09-12T02:53:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: "new_purged_snaps": [], 2024-09-12T02:53:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_node_flags": {}, 2024-09-12T02:53:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: "device_class_flags": {}, 2024-09-12T02:53:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode": { 2024-09-12T02:53:24.198 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_enabled": false, 2024-09-12T02:53:24.198 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_bucket_count": 0, 2024-09-12T02:53:24.198 INFO:teuthology.orchestra.run.smithi112.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:53:24.198 INFO:teuthology.orchestra.run.smithi112.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:53:24.198 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_bucket": 0 2024-09-12T02:53:24.198 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:24.198 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:53:24.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:24.127+0000 7fdca5800640 1 -- 172.21.15.112:0/3153955785 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdc8006be30 msgr2=0x7fdc8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:24.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:24.127+0000 7fdca5800640 1 --2- 172.21.15.112:0/3153955785 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdc8006be30 0x7fdc8006e2f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fdc90007130 tx=0x7fdc90007060 comp rx=0 tx=0).stop 2024-09-12T02:53:24.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:24.127+0000 7fdca5800640 1 -- 172.21.15.112:0/3153955785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdca00b45d0 msgr2=0x7fdca0150ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:24.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:24.127+0000 7fdca5800640 1 --2- 172.21.15.112:0/3153955785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdca00b45d0 0x7fdca0150ab0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00c7f0 tx=0x7fdc8c00cbf0 comp rx=0 tx=0).stop 2024-09-12T02:53:24.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:24.127+0000 7fdca5800640 1 -- 172.21.15.112:0/3153955785 shutdown_connections 2024-09-12T02:53:24.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:24.127+0000 7fdca5800640 1 --2- 172.21.15.112:0/3153955785 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdc8006be30 0x7fdc8006e2f0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:24.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:24.127+0000 7fdca5800640 1 --2- 172.21.15.112:0/3153955785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdca015b9d0 0x7fdca00ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:24.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:24.127+0000 7fdca5800640 1 --2- 172.21.15.112:0/3153955785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdca00b45d0 0x7fdca0150ab0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:24.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:24.127+0000 7fdca5800640 1 --2- 172.21.15.112:0/3153955785 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdca006eef0 0x7fdca00aa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:24.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:24.127+0000 7fdca5800640 1 -- 172.21.15.112:0/3153955785 >> 172.21.15.112:0/3153955785 conn(0x7fdca006bbd0 msgr2=0x7fdca015f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:24.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:24.127+0000 7fdca5800640 1 -- 172.21.15.112:0/3153955785 shutdown_connections 2024-09-12T02:53:24.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:24.127+0000 7fdca5800640 1 -- 172.21.15.112:0/3153955785 wait complete. 2024-09-12T02:53:24.201 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-12T02:53:29.202 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-12T02:53:29.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.364+0000 7f03d2c00640 1 Processor -- start 2024-09-12T02:53:29.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.364+0000 7f03d2c00640 1 -- start start 2024-09-12T02:53:29.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.365+0000 7f03d2c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f03cc15b9d0 0x7f03cc0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:29.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.365+0000 7f03d2c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03cc06f600 0x7f03cc0728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:29.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.366+0000 7f03d2c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03cc0b54a0 con 0x7f03cc0b45d0 2024-09-12T02:53:29.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.366+0000 7f03d2c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f03cc0b4a60 con 0x7f03cc15b9d0 2024-09-12T02:53:29.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.366+0000 7f03d2c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f03cc0b3af0 con 0x7f03cc06f600 2024-09-12T02:53:29.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.366+0000 7f03c3400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f03cc0b45d0 0x7f03cc06eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35952/0 (socket says 172.21.15.112:35952) 2024-09-12T02:53:29.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.366+0000 7f03c3400640 1 -- 172.21.15.112:0/2255175134 learned_addr learned my addr 172.21.15.112:0/2255175134 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:53:29.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.366+0000 7f03cbe00640 1 --2- 172.21.15.112:0/2255175134 >> v2:172.21.15.112:3300/0 conn(0x7f03cc15b9d0 0x7f03cc0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:29.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.366+0000 7f03d0c00640 1 --2- 172.21.15.112:0/2255175134 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03cc06f600 0x7f03cc0728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:29.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.366+0000 7f03cbe00640 1 -- 172.21.15.112:0/2255175134 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03cc06f600 msgr2=0x7f03cc0728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:29.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.366+0000 7f03cbe00640 1 --2- 172.21.15.112:0/2255175134 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03cc06f600 0x7f03cc0728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:29.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.366+0000 7f03cbe00640 1 -- 172.21.15.112:0/2255175134 >> v1:172.21.15.112:6789/0 conn(0x7f03cc0b45d0 legacy=0x7f03cc06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:29.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.366+0000 7f03cbe00640 1 -- 172.21.15.112:0/2255175134 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03cc0b3dd0 con 0x7f03cc15b9d0 2024-09-12T02:53:29.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.366+0000 7f03cb400640 1 -- 172.21.15.112:0/2255175134 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2504194158 0 0) 0x7f03cc0b54a0 con 0x7f03cc0b45d0 2024-09-12T02:53:29.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.366+0000 7f03d0c00640 1 --2- 172.21.15.112:0/2255175134 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03cc06f600 0x7f03cc0728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:53:29.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.367+0000 7f03cbe00640 1 --2- 172.21.15.112:0/2255175134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03cc15b9d0 0x7f03cc0b4ec0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f03bc0097a0 tx=0x7f03bc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828489f68ceb562d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:29.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.368+0000 7f03cb400640 1 -- 172.21.15.112:0/2255175134 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03bc037070 con 0x7f03cc15b9d0 2024-09-12T02:53:29.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.368+0000 7f03cb400640 1 -- 172.21.15.112:0/2255175134 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03bc032440 con 0x7f03cc15b9d0 2024-09-12T02:53:29.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.368+0000 7f03cb400640 1 -- 172.21.15.112:0/2255175134 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03bc032810 con 0x7f03cc15b9d0 2024-09-12T02:53:29.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.368+0000 7f03d2c00640 1 -- 172.21.15.112:0/2255175134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03cc15b9d0 msgr2=0x7f03cc0b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:29.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.368+0000 7f03d2c00640 1 --2- 172.21.15.112:0/2255175134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03cc15b9d0 0x7f03cc0b4ec0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f03bc0097a0 tx=0x7f03bc02a180 comp rx=0 tx=0).stop 2024-09-12T02:53:29.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.368+0000 7f03d2c00640 1 -- 172.21.15.112:0/2255175134 shutdown_connections 2024-09-12T02:53:29.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.368+0000 7f03d2c00640 1 --2- 172.21.15.112:0/2255175134 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03cc06f600 0x7f03cc0728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:29.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.368+0000 7f03d2c00640 1 --2- 172.21.15.112:0/2255175134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03cc15b9d0 0x7f03cc0b4ec0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:29.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.368+0000 7f03d2c00640 1 -- 172.21.15.112:0/2255175134 >> 172.21.15.112:0/2255175134 conn(0x7f03cc06bbd0 msgr2=0x7f03cc06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:29.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.368+0000 7f03d2c00640 1 -- 172.21.15.112:0/2255175134 shutdown_connections 2024-09-12T02:53:29.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.368+0000 7f03d2c00640 1 -- 172.21.15.112:0/2255175134 wait complete. 2024-09-12T02:53:29.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.370+0000 7f03d2c00640 1 Processor -- start 2024-09-12T02:53:29.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.370+0000 7f03d2c00640 1 -- start start 2024-09-12T02:53:29.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.371+0000 7f03d2c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03cc06f600 0x7f03cc1eee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:29.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.371+0000 7f03d2c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03cc0b45d0 0x7f03cc0cc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:29.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.371+0000 7f03d2c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03cc15b9d0 0x7f03cc0cce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:29.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.371+0000 7f03d2c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f03cc15bf30 con 0x7f03cc15b9d0 2024-09-12T02:53:29.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.371+0000 7f03d2c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f03cc15bdb0 con 0x7f03cc0b45d0 2024-09-12T02:53:29.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.371+0000 7f03d2c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f03cc0cdcd0 con 0x7f03cc06f600 2024-09-12T02:53:29.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.371+0000 7f03d0c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03cc15b9d0 0x7f03cc0cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:29.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.371+0000 7f03d0c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03cc15b9d0 0x7f03cc0cce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34248/0 (socket says 172.21.15.112:34248) 2024-09-12T02:53:29.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.371+0000 7f03d0c00640 1 -- 172.21.15.112:0/3056936159 learned_addr learned my addr 172.21.15.112:0/3056936159 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:29.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.372+0000 7f03c3400640 1 --2- 172.21.15.112:0/3056936159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03cc0b45d0 0x7f03cc0cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:29.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.372+0000 7f03cbe00640 1 --2- 172.21.15.112:0/3056936159 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03cc06f600 0x7f03cc1eee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:29.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.372+0000 7f03d0c00640 1 -- 172.21.15.112:0/3056936159 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03cc06f600 msgr2=0x7f03cc1eee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:29.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.372+0000 7f03d0c00640 1 --2- 172.21.15.112:0/3056936159 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03cc06f600 0x7f03cc1eee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:29.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.372+0000 7f03d0c00640 1 -- 172.21.15.112:0/3056936159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03cc0b45d0 msgr2=0x7f03cc0cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:29.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.372+0000 7f03d0c00640 1 --2- 172.21.15.112:0/3056936159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03cc0b45d0 0x7f03cc0cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:29.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.372+0000 7f03d0c00640 1 -- 172.21.15.112:0/3056936159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03cc1ef3b0 con 0x7f03cc15b9d0 2024-09-12T02:53:29.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.372+0000 7f03d0c00640 1 --2- 172.21.15.112:0/3056936159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03cc15b9d0 0x7f03cc0cce90 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f03c4007ef0 tx=0x7f03c400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:29.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.372+0000 7f03c8c00640 1 -- 172.21.15.112:0/3056936159 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c401a070 con 0x7f03cc15b9d0 2024-09-12T02:53:29.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.372+0000 7f03c8c00640 1 -- 172.21.15.112:0/3056936159 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03c4015600 con 0x7f03cc15b9d0 2024-09-12T02:53:29.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.372+0000 7f03c8c00640 1 -- 172.21.15.112:0/3056936159 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c40159f0 con 0x7f03cc15b9d0 2024-09-12T02:53:29.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.372+0000 7f03d2c00640 1 -- 172.21.15.112:0/3056936159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03cc0afdb0 con 0x7f03cc15b9d0 2024-09-12T02:53:29.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.372+0000 7f03d2c00640 1 -- 172.21.15.112:0/3056936159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03cc151490 con 0x7f03cc15b9d0 2024-09-12T02:53:29.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.373+0000 7f03d2c00640 1 -- 172.21.15.112:0/3056936159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03cc06e380 con 0x7f03cc15b9d0 2024-09-12T02:53:29.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.374+0000 7f03c8c00640 1 -- 172.21.15.112:0/3056936159 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f03c401d070 con 0x7f03cc15b9d0 2024-09-12T02:53:29.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.376+0000 7f03c8c00640 1 --2- 172.21.15.112:0/3056936159 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f03a806be30 0x7f03a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:29.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.376+0000 7f03c8c00640 1 -- 172.21.15.112:0/3056936159 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(186..186 src has 1..186) ==== 5709+0+0 (secure 0 0 0) 0x7f03c408b270 con 0x7f03cc15b9d0 2024-09-12T02:53:29.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.376+0000 7f03cbe00640 1 --2- 172.21.15.112:0/3056936159 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f03a806be30 0x7f03a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:29.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.376+0000 7f03cbe00640 1 --2- 172.21.15.112:0/3056936159 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f03a806be30 0x7f03a806e2f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f03bc034000 tx=0x7f03bc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:29.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.380+0000 7f03c8c00640 1 -- 172.21.15.112:0/3056936159 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f03cc1ef3b0 con 0x7f03cc15b9d0 2024-09-12T02:53:29.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.554+0000 7f03d2c00640 1 -- 172.21.15.112:0/3056936159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f03cc06eaa0 con 0x7f03cc15b9d0 2024-09-12T02:53:29.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.556+0000 7f03c8c00640 1 -- 172.21.15.112:0/3056936159 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v186) ==== 81+0+34318 (secure 0 0 0) 0x7f03c4010070 con 0x7f03cc15b9d0 2024-09-12T02:53:29.557 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:53:29.557 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:53:29.557 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 186, 2024-09-12T02:53:29.557 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:53:29.557 INFO:teuthology.orchestra.run.smithi112.stdout: "created": "2024-09-12T02:41:36.162095+0000", 2024-09-12T02:53:29.557 INFO:teuthology.orchestra.run.smithi112.stdout: "modified": "2024-09-12T02:53:26.068138+0000", 2024-09-12T02:53:29.557 INFO:teuthology.orchestra.run.smithi112.stdout: "last_up_change": "2024-09-12T02:41:42.191169+0000", 2024-09-12T02:53:29.558 INFO:teuthology.orchestra.run.smithi112.stdout: "last_in_change": "2024-09-12T02:41:39.036600+0000", 2024-09-12T02:53:29.558 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:53:29.558 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_num": 5799936, 2024-09-12T02:53:29.558 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_set": [ 2024-09-12T02:53:29.558 INFO:teuthology.orchestra.run.smithi112.stdout: "pglog_hardlimit", 2024-09-12T02:53:29.558 INFO:teuthology.orchestra.run.smithi112.stdout: "purged_snapdirs", 2024-09-12T02:53:29.558 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_deletes", 2024-09-12T02:53:29.558 INFO:teuthology.orchestra.run.smithi112.stdout: "sortbitwise" 2024-09-12T02:53:29.558 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:29.558 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_version": 4, 2024-09-12T02:53:29.558 INFO:teuthology.orchestra.run.smithi112.stdout: "full_ratio": 0.69999998807907104, 2024-09-12T02:53:29.558 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-12T02:53:29.558 INFO:teuthology.orchestra.run.smithi112.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-12T02:53:29.559 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_snapshot": "", 2024-09-12T02:53:29.559 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_max": 23, 2024-09-12T02:53:29.559 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd": 8, 2024-09-12T02:53:29.559 INFO:teuthology.orchestra.run.smithi112.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:53:29.559 INFO:teuthology.orchestra.run.smithi112.stdout: "min_compat_client": "jewel", 2024-09-12T02:53:29.559 INFO:teuthology.orchestra.run.smithi112.stdout: "require_osd_release": "squid", 2024-09-12T02:53:29.559 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_crimson": false, 2024-09-12T02:53:29.559 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-12T02:53:29.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.559 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 1, 2024-09-12T02:53:29.559 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": ".mgr", 2024-09-12T02:53:29.559 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:41:43.011599+0000", 2024-09-12T02:53:29.559 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:53:29.559 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:53:29.560 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:53:29.560 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:53:29.560 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:53:29.560 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:53:29.560 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:53:29.560 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:53:29.560 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:53:29.560 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:53:29.560 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:53:29.560 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:53:29.560 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:53:29.560 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 1, 2024-09-12T02:53:29.560 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 1, 2024-09-12T02:53:29.561 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 1, 2024-09-12T02:53:29.561 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 1, 2024-09-12T02:53:29.561 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 1, 2024-09-12T02:53:29.561 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:53:29.561 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:53:29.561 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:53:29.561 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:53:29.561 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:53:29.561 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:53:29.561 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:53:29.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.561 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "109", 2024-09-12T02:53:29.561 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:53:29.561 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:53:29.562 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:53:29.562 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:53:29.562 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:53:29.562 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:53:29.562 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:53:29.562 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:53:29.562 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:53:29.562 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:53:29.562 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:53:29.562 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:53:29.562 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:53:29.562 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:53:29.562 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:53:29.562 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:53:29.563 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:53:29.563 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:53:29.563 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:53:29.563 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:53:29.563 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:53:29.563 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:53:29.563 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:53:29.563 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:53:29.563 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:53:29.563 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:53:29.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.563 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:53:29.563 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:53:29.563 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:53:29.563 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:53:29.564 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:53:29.564 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:53:29.564 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:53:29.564 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:53:29.564 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:53:29.564 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:53:29.564 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:53:29.564 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:53:29.564 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_max": 32, 2024-09-12T02:53:29.564 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 1 2024-09-12T02:53:29.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.564 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:53:29.564 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": {} 2024-09-12T02:53:29.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:53:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:53:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 8, 2024-09-12T02:53:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 8, 2024-09-12T02:53:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 0.25, 2024-09-12T02:53:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:53:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:53:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:53:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:53:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:53:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 22, 2024-09-12T02:53:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:53:29.566 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:52:51.909503+0000", 2024-09-12T02:53:29.566 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:53:29.566 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:53:29.566 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:53:29.566 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:53:29.566 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:53:29.566 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:53:29.566 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:53:29.566 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:53:29.566 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:53:29.566 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:53:29.566 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:53:29.566 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:53:29.567 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:53:29.567 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 32, 2024-09-12T02:53:29.567 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 32, 2024-09-12T02:53:29.567 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 32, 2024-09-12T02:53:29.567 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 32, 2024-09-12T02:53:29.567 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 32, 2024-09-12T02:53:29.567 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:53:29.567 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:53:29.567 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:53:29.567 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:53:29.567 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:53:29.567 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:53:29.567 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:53:29.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.568 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "182", 2024-09-12T02:53:29.568 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:53:29.568 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:53:29.568 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:53:29.568 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:53:29.568 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:53:29.568 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:53:29.568 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:53:29.568 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:53:29.568 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:53:29.568 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:53:29.568 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:53:29.568 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:53:29.569 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:53:29.569 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:53:29.569 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:53:29.569 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:53:29.569 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:53:29.569 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:53:29.569 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:53:29.569 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:53:29.569 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:53:29.569 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:53:29.569 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:53:29.569 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:53:29.570 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:53:29.570 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:53:29.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.570 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:53:29.570 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:53:29.570 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:53:29.570 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:53:29.570 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:53:29.570 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:53:29.570 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:53:29.570 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:53:29.570 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:53:29.570 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:53:29.570 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:53:29.571 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:53:29.571 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:53:29.571 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 16, 2024-09-12T02:53:29.571 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_priority": 5 2024-09-12T02:53:29.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.571 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:53:29.571 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:53:29.571 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": "cephfs" 2024-09-12T02:53:29.571 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.571 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:53:29.571 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:53:29.571 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 2, 2024-09-12T02:53:29.571 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 2, 2024-09-12T02:53:29.572 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:53:29.572 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:53:29.572 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:53:29.572 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:53:29.572 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:53:29.572 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:53:29.572 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.572 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 23, 2024-09-12T02:53:29.572 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_data", 2024-09-12T02:53:29.572 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:52:53.146578+0000", 2024-09-12T02:53:29.572 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:53:29.572 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:53:29.573 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:53:29.573 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:53:29.573 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:53:29.573 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:53:29.573 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:53:29.573 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:53:29.573 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:53:29.573 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:53:29.573 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:53:29.573 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:53:29.573 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:53:29.573 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 64, 2024-09-12T02:53:29.573 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 64, 2024-09-12T02:53:29.574 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 64, 2024-09-12T02:53:29.574 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 64, 2024-09-12T02:53:29.574 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 64, 2024-09-12T02:53:29.574 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:53:29.574 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:53:29.574 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:53:29.574 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:53:29.574 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:53:29.574 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:53:29.574 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:53:29.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.574 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "186", 2024-09-12T02:53:29.574 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:53:29.575 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:53:29.575 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:53:29.575 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:53:29.575 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:53:29.575 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:53:29.575 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:53:29.575 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:53:29.575 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:53:29.575 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 33554432, 2024-09-12T02:53:29.575 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:53:29.575 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:53:29.575 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:53:29.575 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:53:29.575 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:53:29.576 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:53:29.576 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:53:29.576 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:53:29.576 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:53:29.576 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:53:29.576 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:53:29.576 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:53:29.576 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:53:29.576 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:53:29.576 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:53:29.576 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:53:29.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.576 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:53:29.576 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:53:29.577 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:53:29.577 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:53:29.577 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:53:29.577 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:53:29.577 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:53:29.577 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:53:29.577 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:53:29.577 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:53:29.577 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:53:29.577 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:53:29.577 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 64, 2024-09-12T02:53:29.577 INFO:teuthology.orchestra.run.smithi112.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:53:29.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.577 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:53:29.578 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:53:29.578 INFO:teuthology.orchestra.run.smithi112.stdout: "data": "cephfs" 2024-09-12T02:53:29.578 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.578 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:53:29.578 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:53:29.578 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.3799999952316284, 2024-09-12T02:53:29.578 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.3799999952316284, 2024-09-12T02:53:29.578 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:53:29.578 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-12T02:53:29.578 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-12T02:53:29.578 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:53:29.579 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:53:29.579 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:53:29.579 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.579 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.579 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:29.579 INFO:teuthology.orchestra.run.smithi112.stdout: "osds": [ 2024-09-12T02:53:29.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.579 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:53:29.579 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:29.579 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:29.579 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:29.579 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:29.579 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:29.580 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:29.580 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:29.580 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:29.580 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:29.580 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:29.580 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:29.580 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:29.580 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.580 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.580 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6800", 2024-09-12T02:53:29.580 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:29.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.581 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.581 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6801", 2024-09-12T02:53:29.581 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:29.581 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.581 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.581 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:29.581 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.581 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.581 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6802", 2024-09-12T02:53:29.581 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:29.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.582 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.582 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6803", 2024-09-12T02:53:29.582 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:29.582 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.582 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.582 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:29.582 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.582 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.582 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6806", 2024-09-12T02:53:29.582 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:29.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.583 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.583 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6807", 2024-09-12T02:53:29.583 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:29.583 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.583 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.583 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:29.583 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.583 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.583 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6804", 2024-09-12T02:53:29.583 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:29.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.584 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.584 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6805", 2024-09-12T02:53:29.584 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:29.584 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.584 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.584 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6801/821571304", 2024-09-12T02:53:29.584 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6803/821571304", 2024-09-12T02:53:29.584 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6807/821571304", 2024-09-12T02:53:29.584 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6805/821571304", 2024-09-12T02:53:29.584 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:29.584 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:29.585 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:29.585 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.585 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:53:29.585 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:29.585 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:29.585 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:29.585 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:29.585 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:29.585 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:29.585 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:29.585 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:29.585 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:29.585 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:29.586 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:29.586 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:29.586 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.586 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.586 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6808", 2024-09-12T02:53:29.586 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:29.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.586 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.586 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6809", 2024-09-12T02:53:29.586 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:29.586 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.586 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.587 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:29.587 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.587 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.587 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6810", 2024-09-12T02:53:29.587 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:29.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.587 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.587 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6811", 2024-09-12T02:53:29.587 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:29.588 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.588 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.588 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:29.588 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.588 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.588 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6814", 2024-09-12T02:53:29.588 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:29.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.588 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.588 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6815", 2024-09-12T02:53:29.589 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:29.589 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.589 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.589 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:29.589 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.589 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.589 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6812", 2024-09-12T02:53:29.589 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:29.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.589 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.590 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6813", 2024-09-12T02:53:29.590 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:29.590 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.590 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.590 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6809/2642068641", 2024-09-12T02:53:29.590 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6811/2642068641", 2024-09-12T02:53:29.590 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6815/2642068641", 2024-09-12T02:53:29.590 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6813/2642068641", 2024-09-12T02:53:29.590 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:29.590 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:29.590 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:29.590 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.591 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:53:29.591 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:29.591 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:29.591 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:29.591 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:29.591 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:29.591 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:29.591 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:29.591 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:29.591 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:29.591 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:29.591 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:29.591 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:29.592 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.592 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.592 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6816", 2024-09-12T02:53:29.592 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:29.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.592 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.592 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6817", 2024-09-12T02:53:29.592 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:29.592 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.592 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.593 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:29.593 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.593 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.593 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6818", 2024-09-12T02:53:29.593 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:29.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.593 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.593 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6819", 2024-09-12T02:53:29.593 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:29.593 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.593 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.594 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:29.594 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.594 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.594 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6822", 2024-09-12T02:53:29.594 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:29.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.594 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.594 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6823", 2024-09-12T02:53:29.594 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:29.594 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.594 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.595 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:29.595 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.595 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.595 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6820", 2024-09-12T02:53:29.595 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:29.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.595 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.595 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6821", 2024-09-12T02:53:29.596 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:29.596 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.596 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.596 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6817/3365688807", 2024-09-12T02:53:29.596 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6819/3365688807", 2024-09-12T02:53:29.596 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6823/3365688807", 2024-09-12T02:53:29.596 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6821/3365688807", 2024-09-12T02:53:29.596 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:29.596 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:29.596 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:29.596 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.597 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:53:29.597 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:29.597 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:29.597 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:29.597 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:29.597 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:29.597 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:29.597 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:29.597 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:29.598 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:29.598 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:29.598 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:29.598 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:29.598 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.598 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.598 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6824", 2024-09-12T02:53:29.598 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:29.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.599 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.599 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6825", 2024-09-12T02:53:29.599 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:29.599 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.599 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.599 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:29.599 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.599 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.599 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6826", 2024-09-12T02:53:29.599 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:29.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.600 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.600 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6827", 2024-09-12T02:53:29.600 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:29.600 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.600 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.600 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:29.600 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.600 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.600 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6830", 2024-09-12T02:53:29.600 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:29.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.601 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.601 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6831", 2024-09-12T02:53:29.601 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:29.601 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.601 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.601 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:29.601 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.601 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.601 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6828", 2024-09-12T02:53:29.601 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:29.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.602 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.602 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6829", 2024-09-12T02:53:29.602 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:29.602 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.602 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.602 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6825/231774278", 2024-09-12T02:53:29.602 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6827/231774278", 2024-09-12T02:53:29.602 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6831/231774278", 2024-09-12T02:53:29.602 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6829/231774278", 2024-09-12T02:53:29.602 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:29.603 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:29.603 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:29.603 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.603 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:53:29.603 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:29.603 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:29.603 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:29.603 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:29.603 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:29.603 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:29.603 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:29.604 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:29.604 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:29.604 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:29.604 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:29.604 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:29.604 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.604 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.604 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6800", 2024-09-12T02:53:29.604 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:29.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.604 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.605 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6801", 2024-09-12T02:53:29.605 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:29.605 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.605 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.605 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:29.605 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.605 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.605 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6802", 2024-09-12T02:53:29.605 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:29.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.606 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.606 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6803", 2024-09-12T02:53:29.606 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:29.606 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.606 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.606 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:29.606 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.606 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.606 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6806", 2024-09-12T02:53:29.606 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:29.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.607 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.607 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6807", 2024-09-12T02:53:29.607 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:29.607 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.607 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.607 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:29.607 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.607 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.607 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6804", 2024-09-12T02:53:29.607 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:29.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.608 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.608 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6805", 2024-09-12T02:53:29.608 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:29.608 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.608 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.608 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6801/3671178153", 2024-09-12T02:53:29.608 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6803/3671178153", 2024-09-12T02:53:29.608 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6807/3671178153", 2024-09-12T02:53:29.608 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6805/3671178153", 2024-09-12T02:53:29.608 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:29.609 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:29.609 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:29.609 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.609 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:53:29.609 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:29.609 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:29.609 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:29.609 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:29.609 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:29.609 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:29.609 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:29.610 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:29.610 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:29.610 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:29.610 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:29.610 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:29.610 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.610 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.610 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6808", 2024-09-12T02:53:29.610 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:29.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.610 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.611 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6809", 2024-09-12T02:53:29.611 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:29.611 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.611 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.611 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:29.611 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.611 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.611 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6810", 2024-09-12T02:53:29.611 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:29.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.612 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.612 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6811", 2024-09-12T02:53:29.612 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:29.612 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.612 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.612 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:29.612 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.612 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.612 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6817", 2024-09-12T02:53:29.612 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:29.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.613 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.613 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6819", 2024-09-12T02:53:29.613 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:29.613 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.613 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.613 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:29.613 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.613 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.613 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6812", 2024-09-12T02:53:29.613 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:29.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.614 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.614 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6815", 2024-09-12T02:53:29.614 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:29.614 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.614 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.614 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6809/3193706134", 2024-09-12T02:53:29.614 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6811/3193706134", 2024-09-12T02:53:29.614 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6819/3193706134", 2024-09-12T02:53:29.614 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6815/3193706134", 2024-09-12T02:53:29.614 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:29.615 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:29.615 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:29.615 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.615 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:53:29.615 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:29.615 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:29.615 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:29.615 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:29.616 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:29.616 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:29.616 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:29.616 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:29.616 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:29.616 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:29.616 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:29.616 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:29.616 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.616 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.616 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6813", 2024-09-12T02:53:29.616 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:29.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.617 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.617 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6814", 2024-09-12T02:53:29.617 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:29.617 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.617 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.617 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:29.617 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.617 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.617 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6816", 2024-09-12T02:53:29.617 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:29.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.618 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.618 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6818", 2024-09-12T02:53:29.618 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:29.618 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.618 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.618 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:29.618 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.618 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.618 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6822", 2024-09-12T02:53:29.619 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:29.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.619 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.619 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.619 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6823", 2024-09-12T02:53:29.619 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:29.619 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.619 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.619 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:29.619 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.619 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.619 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.620 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6820", 2024-09-12T02:53:29.620 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:29.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.620 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.620 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6821", 2024-09-12T02:53:29.620 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:29.620 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.620 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.620 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6814/3738813293", 2024-09-12T02:53:29.620 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6818/3738813293", 2024-09-12T02:53:29.620 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6823/3738813293", 2024-09-12T02:53:29.621 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6821/3738813293", 2024-09-12T02:53:29.621 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:29.621 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:29.621 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:29.621 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.621 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:53:29.621 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:29.621 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:29.621 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:29.621 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:29.621 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:29.622 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:29.622 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:29.622 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:29.622 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:29.622 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:29.622 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:29.622 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:29.622 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.622 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.622 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6824", 2024-09-12T02:53:29.622 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:29.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.623 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.623 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6825", 2024-09-12T02:53:29.623 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:29.623 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.623 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.623 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:29.623 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.623 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.623 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6826", 2024-09-12T02:53:29.623 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:29.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.624 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.624 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6827", 2024-09-12T02:53:29.624 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:29.624 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.624 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.624 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:29.624 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.624 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.624 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6830", 2024-09-12T02:53:29.624 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:29.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.625 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.625 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.625 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6831", 2024-09-12T02:53:29.625 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:29.625 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.625 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.625 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:29.625 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:29.625 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.625 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:29.625 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6828", 2024-09-12T02:53:29.626 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:29.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.626 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.626 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:29.626 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6829", 2024-09-12T02:53:29.626 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:29.626 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.626 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.626 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6825/1421932609", 2024-09-12T02:53:29.626 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6827/1421932609", 2024-09-12T02:53:29.626 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6831/1421932609", 2024-09-12T02:53:29.627 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6829/1421932609", 2024-09-12T02:53:29.627 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:29.627 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:29.627 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:29.627 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:29.627 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.627 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:29.627 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_xinfo": [ 2024-09-12T02:53:29.627 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.627 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:53:29.627 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:29.627 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:29.627 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:29.628 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:29.628 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:29.628 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.220641+0000", 2024-09-12T02:53:29.628 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:29.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.628 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:53:29.628 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:29.628 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:29.628 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:29.628 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:29.628 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:29.628 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312574+0000", 2024-09-12T02:53:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:53:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.282771+0000", 2024-09-12T02:53:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:53:29.630 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:29.630 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:29.630 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:29.630 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:29.630 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:29.630 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.260478+0000", 2024-09-12T02:53:29.630 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:29.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.630 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:53:29.630 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:29.630 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:29.630 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:29.631 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:29.631 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:29.631 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.273397+0000", 2024-09-12T02:53:29.631 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:29.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.631 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.631 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:53:29.631 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:29.631 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:29.631 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:29.631 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:29.631 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:29.631 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312452+0000", 2024-09-12T02:53:29.632 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:29.632 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.632 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.632 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:53:29.632 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:29.632 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:29.632 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:29.632 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:29.632 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:29.632 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.308965+0000", 2024-09-12T02:53:29.632 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:29.632 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.632 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.633 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:53:29.633 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:29.633 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:29.633 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:29.633 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:29.633 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:29.633 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.337842+0000", 2024-09-12T02:53:29.633 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:29.633 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.633 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:29.633 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap": [], 2024-09-12T02:53:29.633 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_items": [], 2024-09-12T02:53:29.633 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_primaries": [], 2024-09-12T02:53:29.634 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_temp": [], 2024-09-12T02:53:29.634 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_temp": [], 2024-09-12T02:53:29.634 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklist": {}, 2024-09-12T02:53:29.634 INFO:teuthology.orchestra.run.smithi112.stdout: "range_blocklist": {}, 2024-09-12T02:53:29.634 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profiles": { 2024-09-12T02:53:29.634 INFO:teuthology.orchestra.run.smithi112.stdout: "default": { 2024-09-12T02:53:29.634 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-failure-domain": "osd", 2024-09-12T02:53:29.634 INFO:teuthology.orchestra.run.smithi112.stdout: "k": "2", 2024-09-12T02:53:29.634 INFO:teuthology.orchestra.run.smithi112.stdout: "m": "1", 2024-09-12T02:53:29.634 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin": "jerasure", 2024-09-12T02:53:29.634 INFO:teuthology.orchestra.run.smithi112.stdout: "technique": "reed_sol_van" 2024-09-12T02:53:29.634 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.634 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps_queue": [], 2024-09-12T02:53:29.635 INFO:teuthology.orchestra.run.smithi112.stdout: "new_removed_snaps": [], 2024-09-12T02:53:29.635 INFO:teuthology.orchestra.run.smithi112.stdout: "new_purged_snaps": [], 2024-09-12T02:53:29.635 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_node_flags": {}, 2024-09-12T02:53:29.635 INFO:teuthology.orchestra.run.smithi112.stdout: "device_class_flags": {}, 2024-09-12T02:53:29.635 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode": { 2024-09-12T02:53:29.635 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_enabled": false, 2024-09-12T02:53:29.635 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_bucket_count": 0, 2024-09-12T02:53:29.635 INFO:teuthology.orchestra.run.smithi112.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:53:29.635 INFO:teuthology.orchestra.run.smithi112.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:53:29.635 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_bucket": 0 2024-09-12T02:53:29.635 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.635 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:53:29.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.558+0000 7f03d2c00640 1 -- 172.21.15.112:0/3056936159 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f03a806be30 msgr2=0x7f03a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:29.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.558+0000 7f03d2c00640 1 --2- 172.21.15.112:0/3056936159 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f03a806be30 0x7f03a806e2f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f03bc034000 tx=0x7f03bc02e000 comp rx=0 tx=0).stop 2024-09-12T02:53:29.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.558+0000 7f03d2c00640 1 -- 172.21.15.112:0/3056936159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03cc15b9d0 msgr2=0x7f03cc0cce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:29.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.558+0000 7f03d2c00640 1 --2- 172.21.15.112:0/3056936159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03cc15b9d0 0x7f03cc0cce90 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f03c4007ef0 tx=0x7f03c400d4a0 comp rx=0 tx=0).stop 2024-09-12T02:53:29.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.558+0000 7f03d2c00640 1 -- 172.21.15.112:0/3056936159 shutdown_connections 2024-09-12T02:53:29.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.558+0000 7f03d2c00640 1 --2- 172.21.15.112:0/3056936159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03cc15b9d0 0x7f03cc0cce90 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:29.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.558+0000 7f03d2c00640 1 --2- 172.21.15.112:0/3056936159 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f03a806be30 0x7f03a806e2f0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:29.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.558+0000 7f03d2c00640 1 --2- 172.21.15.112:0/3056936159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03cc0b45d0 0x7f03cc0cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:29.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.558+0000 7f03d2c00640 1 --2- 172.21.15.112:0/3056936159 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03cc06f600 0x7f03cc1eee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:29.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.558+0000 7f03d2c00640 1 -- 172.21.15.112:0/3056936159 >> 172.21.15.112:0/3056936159 conn(0x7f03cc06bbd0 msgr2=0x7f03cc0b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:29.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.558+0000 7f03d2c00640 1 -- 172.21.15.112:0/3056936159 shutdown_connections 2024-09-12T02:53:29.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.558+0000 7f03d2c00640 1 -- 172.21.15.112:0/3056936159 wait complete. 2024-09-12T02:53:29.639 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2024-09-12T02:53:29.639 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-12T02:53:29.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.790+0000 7fa812000640 1 Processor -- start 2024-09-12T02:53:29.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.790+0000 7fa812000640 1 -- start start 2024-09-12T02:53:29.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.791+0000 7fa812000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa80c15b9d0 0x7fa80c0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:29.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.791+0000 7fa812000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa80c0b45d0 0x7fa80c0728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:29.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.791+0000 7fa812000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa80c0b54a0 con 0x7fa80c06eef0 2024-09-12T02:53:29.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.791+0000 7fa812000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa80c0b4a30 con 0x7fa80c0b45d0 2024-09-12T02:53:29.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.791+0000 7fa812000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa80c0b3af0 con 0x7fa80c15b9d0 2024-09-12T02:53:29.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.792+0000 7fa80be00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa80c06eef0 0x7fa80c06f300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35958/0 (socket says 172.21.15.112:35958) 2024-09-12T02:53:29.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.792+0000 7fa80be00640 1 -- 172.21.15.112:0/1345689976 learned_addr learned my addr 172.21.15.112:0/1345689976 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:53:29.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.792+0000 7fa80aa00640 1 --2- 172.21.15.112:0/1345689976 >> v2:172.21.15.112:3300/0 conn(0x7fa80c0b45d0 0x7fa80c0728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:29.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.792+0000 7fa80b400640 1 --2- 172.21.15.112:0/1345689976 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa80c15b9d0 0x7fa80c0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:29.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.792+0000 7fa80a000640 1 -- 172.21.15.112:0/1345689976 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1007478501 0 0) 0x7fa80c0b54a0 con 0x7fa80c06eef0 2024-09-12T02:53:29.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.792+0000 7fa80a000640 1 -- 172.21.15.112:0/1345689976 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7f0003520 con 0x7fa80c06eef0 2024-09-12T02:53:29.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.792+0000 7fa80aa00640 1 -- 172.21.15.112:0/1345689976 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa80c15b9d0 msgr2=0x7fa80c0b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:29.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.792+0000 7fa80aa00640 1 --2- 172.21.15.112:0/1345689976 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa80c15b9d0 0x7fa80c0b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:29.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.792+0000 7fa80aa00640 1 -- 172.21.15.112:0/1345689976 >> v1:172.21.15.112:6789/0 conn(0x7fa80c06eef0 legacy=0x7fa80c06f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:29.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.792+0000 7fa80aa00640 1 -- 172.21.15.112:0/1345689976 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa80c0b3dd0 con 0x7fa80c0b45d0 2024-09-12T02:53:29.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.792+0000 7fa80b400640 1 --2- 172.21.15.112:0/1345689976 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa80c15b9d0 0x7fa80c0b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:53:29.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.793+0000 7fa80aa00640 1 --2- 172.21.15.112:0/1345689976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa80c0b45d0 0x7fa80c0728c0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8009790 tx=0x7fa7f802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=102fe306af0445a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:29.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.793+0000 7fa80a000640 1 -- 172.21.15.112:0/1345689976 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8037070 con 0x7fa80c0b45d0 2024-09-12T02:53:29.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.793+0000 7fa80a000640 1 -- 172.21.15.112:0/1345689976 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f8032440 con 0x7fa80c0b45d0 2024-09-12T02:53:29.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.793+0000 7fa80a000640 1 -- 172.21.15.112:0/1345689976 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8032810 con 0x7fa80c0b45d0 2024-09-12T02:53:29.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.794+0000 7fa812000640 1 -- 172.21.15.112:0/1345689976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa80c0b45d0 msgr2=0x7fa80c0728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:29.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.794+0000 7fa812000640 1 --2- 172.21.15.112:0/1345689976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa80c0b45d0 0x7fa80c0728c0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8009790 tx=0x7fa7f802a180 comp rx=0 tx=0).stop 2024-09-12T02:53:29.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.794+0000 7fa812000640 1 -- 172.21.15.112:0/1345689976 shutdown_connections 2024-09-12T02:53:29.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.794+0000 7fa812000640 1 --2- 172.21.15.112:0/1345689976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa80c0b45d0 0x7fa80c0728c0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:29.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.794+0000 7fa812000640 1 --2- 172.21.15.112:0/1345689976 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa80c15b9d0 0x7fa80c0b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:29.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.794+0000 7fa812000640 1 -- 172.21.15.112:0/1345689976 >> 172.21.15.112:0/1345689976 conn(0x7fa80c06bbd0 msgr2=0x7fa80c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:29.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.794+0000 7fa812000640 1 -- 172.21.15.112:0/1345689976 shutdown_connections 2024-09-12T02:53:29.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.794+0000 7fa812000640 1 -- 172.21.15.112:0/1345689976 wait complete. 2024-09-12T02:53:29.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.796+0000 7fa812000640 1 Processor -- start 2024-09-12T02:53:29.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.796+0000 7fa812000640 1 -- start start 2024-09-12T02:53:29.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.797+0000 7fa812000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa80c06eef0 0x7fa80c1f5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:29.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.797+0000 7fa812000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa80c0b45d0 0x7fa80c0afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:29.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.797+0000 7fa812000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa80c15b9d0 0x7fa80c15a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:29.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.797+0000 7fa812000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa80c15bf30 con 0x7fa80c15b9d0 2024-09-12T02:53:29.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.797+0000 7fa812000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa80c15bdb0 con 0x7fa80c06eef0 2024-09-12T02:53:29.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.797+0000 7fa812000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa80c0cdcd0 con 0x7fa80c0b45d0 2024-09-12T02:53:29.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.797+0000 7fa80be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa80c15b9d0 0x7fa80c15a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:29.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.797+0000 7fa80be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa80c15b9d0 0x7fa80c15a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34270/0 (socket says 172.21.15.112:34270) 2024-09-12T02:53:29.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.797+0000 7fa80be00640 1 -- 172.21.15.112:0/2864857668 learned_addr learned my addr 172.21.15.112:0/2864857668 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:29.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.797+0000 7fa80b400640 1 --2- 172.21.15.112:0/2864857668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa80c06eef0 0x7fa80c1f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:29.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.797+0000 7fa80aa00640 1 --2- 172.21.15.112:0/2864857668 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa80c0b45d0 0x7fa80c0afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:29.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.797+0000 7fa80be00640 1 -- 172.21.15.112:0/2864857668 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa80c0b45d0 msgr2=0x7fa80c0afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:29.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.797+0000 7fa80be00640 1 --2- 172.21.15.112:0/2864857668 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa80c0b45d0 0x7fa80c0afbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:29.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.797+0000 7fa80be00640 1 -- 172.21.15.112:0/2864857668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa80c06eef0 msgr2=0x7fa80c1f5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:29.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.797+0000 7fa80be00640 1 --2- 172.21.15.112:0/2864857668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa80c06eef0 0x7fa80c1f5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:29.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.797+0000 7fa80be00640 1 -- 172.21.15.112:0/2864857668 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa80c1f5e70 con 0x7fa80c15b9d0 2024-09-12T02:53:29.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.798+0000 7fa80be00640 1 --2- 172.21.15.112:0/2864857668 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa80c15b9d0 0x7fa80c15a230 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fa80400cb40 tx=0x7fa80400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:29.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.798+0000 7fa803400640 1 -- 172.21.15.112:0/2864857668 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa804017070 con 0x7fa80c15b9d0 2024-09-12T02:53:29.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.798+0000 7fa803400640 1 -- 172.21.15.112:0/2864857668 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa80400aca0 con 0x7fa80c15b9d0 2024-09-12T02:53:29.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.798+0000 7fa812000640 1 -- 172.21.15.112:0/2864857668 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa80c0aeb20 con 0x7fa80c15b9d0 2024-09-12T02:53:29.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.798+0000 7fa803400640 1 -- 172.21.15.112:0/2864857668 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa804012620 con 0x7fa80c15b9d0 2024-09-12T02:53:29.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.798+0000 7fa812000640 1 -- 172.21.15.112:0/2864857668 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa80c0af0e0 con 0x7fa80c15b9d0 2024-09-12T02:53:29.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.799+0000 7fa812000640 1 -- 172.21.15.112:0/2864857668 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa80c06dbc0 con 0x7fa80c15b9d0 2024-09-12T02:53:29.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.800+0000 7fa803400640 1 -- 172.21.15.112:0/2864857668 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa80401a070 con 0x7fa80c15b9d0 2024-09-12T02:53:29.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.801+0000 7fa803400640 1 --2- 172.21.15.112:0/2864857668 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa7ec06be30 0x7fa7ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:29.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.801+0000 7fa803400640 1 -- 172.21.15.112:0/2864857668 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(186..186 src has 1..186) ==== 5709+0+0 (secure 0 0 0) 0x7fa80408ad70 con 0x7fa80c15b9d0 2024-09-12T02:53:29.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.801+0000 7fa80b400640 1 --2- 172.21.15.112:0/2864857668 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa7ec06be30 0x7fa7ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:29.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.802+0000 7fa80b400640 1 --2- 172.21.15.112:0/2864857668 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa7ec06be30 0x7fa7ec06e2f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc006fd0 tx=0x7fa7fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:29.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.805+0000 7fa803400640 1 -- 172.21.15.112:0/2864857668 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa80c1f5e70 con 0x7fa80c15b9d0 2024-09-12T02:53:29.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.981+0000 7fa812000640 1 -- 172.21.15.112:0/2864857668 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fa80c158120 con 0x7fa80c15b9d0 2024-09-12T02:53:29.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.983+0000 7fa803400640 1 -- 172.21.15.112:0/2864857668 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v186) ==== 81+0+34318 (secure 0 0 0) 0x7fa804059680 con 0x7fa80c15b9d0 2024-09-12T02:53:29.984 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:53:29.984 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:53:29.984 INFO:teuthology.orchestra.run.smithi112.stdout: "epoch": 186, 2024-09-12T02:53:29.984 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", 2024-09-12T02:53:29.984 INFO:teuthology.orchestra.run.smithi112.stdout: "created": "2024-09-12T02:41:36.162095+0000", 2024-09-12T02:53:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: "modified": "2024-09-12T02:53:26.068138+0000", 2024-09-12T02:53:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: "last_up_change": "2024-09-12T02:41:42.191169+0000", 2024-09-12T02:53:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: "last_in_change": "2024-09-12T02:41:39.036600+0000", 2024-09-12T02:53:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:53:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_num": 5799936, 2024-09-12T02:53:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_set": [ 2024-09-12T02:53:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: "pglog_hardlimit", 2024-09-12T02:53:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: "purged_snapdirs", 2024-09-12T02:53:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_deletes", 2024-09-12T02:53:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: "sortbitwise" 2024-09-12T02:53:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_version": 4, 2024-09-12T02:53:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: "full_ratio": 0.69999998807907104, 2024-09-12T02:53:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-12T02:53:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-12T02:53:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_snapshot": "", 2024-09-12T02:53:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_max": 23, 2024-09-12T02:53:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: "max_osd": 8, 2024-09-12T02:53:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:53:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: "min_compat_client": "jewel", 2024-09-12T02:53:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: "require_osd_release": "squid", 2024-09-12T02:53:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: "allow_crimson": false, 2024-09-12T02:53:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-12T02:53:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 1, 2024-09-12T02:53:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": ".mgr", 2024-09-12T02:53:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:41:43.011599+0000", 2024-09-12T02:53:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:53:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:53:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:53:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:53:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:53:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:53:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:53:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:53:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:53:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:53:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:53:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:53:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:53:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 1, 2024-09-12T02:53:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 1, 2024-09-12T02:53:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 1, 2024-09-12T02:53:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 1, 2024-09-12T02:53:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 1, 2024-09-12T02:53:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:53:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:53:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:53:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:53:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:53:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:53:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:53:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.989 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "109", 2024-09-12T02:53:29.989 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:53:29.989 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:53:29.989 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:53:29.989 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:53:29.989 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:53:29.989 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:53:29.989 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:53:29.989 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:53:29.989 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:53:29.989 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:53:29.989 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:53:29.989 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:53:29.990 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:53:29.990 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:53:29.990 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:53:29.990 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:53:29.990 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:53:29.990 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:53:29.990 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:53:29.990 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:53:29.990 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:53:29.990 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:53:29.990 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:53:29.990 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:53:29.990 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:53:29.990 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:53:29.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.991 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:53:29.991 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:53:29.991 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:53:29.991 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:53:29.991 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:53:29.991 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:53:29.991 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:53:29.991 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:53:29.991 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:53:29.991 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:53:29.991 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:53:29.991 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:53:29.992 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_max": 32, 2024-09-12T02:53:29.992 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 1 2024-09-12T02:53:29.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.992 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:53:29.992 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": {} 2024-09-12T02:53:29.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.992 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:53:29.992 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:53:29.992 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 8, 2024-09-12T02:53:29.992 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 8, 2024-09-12T02:53:29.992 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 0.25, 2024-09-12T02:53:29.992 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:53:29.992 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:53:29.992 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:53:29.993 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:53:29.993 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:53:29.993 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.993 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 22, 2024-09-12T02:53:29.993 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:53:29.993 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:52:51.909503+0000", 2024-09-12T02:53:29.993 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:53:29.993 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:53:29.993 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:53:29.993 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:53:29.993 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:53:29.994 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:53:29.994 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:53:29.994 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:53:29.994 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:53:29.994 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:53:29.994 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:53:29.994 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:53:29.994 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:53:29.994 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 32, 2024-09-12T02:53:29.994 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 32, 2024-09-12T02:53:29.994 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 32, 2024-09-12T02:53:29.994 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 32, 2024-09-12T02:53:29.994 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 32, 2024-09-12T02:53:29.994 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:53:29.995 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:53:29.995 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:53:29.995 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:53:29.995 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:53:29.995 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:53:29.995 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:53:29.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.995 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "182", 2024-09-12T02:53:29.995 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:53:29.995 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:53:29.995 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:53:29.995 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:53:29.995 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:53:29.995 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:53:29.996 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:53:29.996 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:53:29.996 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:53:29.996 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 0, 2024-09-12T02:53:29.996 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:53:29.996 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:53:29.996 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:53:29.996 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:53:29.996 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:53:29.996 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:53:29.996 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:53:29.996 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:53:29.996 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:53:29.996 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:53:29.997 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:53:29.997 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:53:29.997 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:53:29.997 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:53:29.997 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:53:29.997 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:53:29.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.997 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:53:29.997 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:53:29.997 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:53:29.997 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:53:29.997 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:53:29.997 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:53:29.997 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:53:29.998 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:53:29.998 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:53:29.998 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:53:29.998 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:53:29.998 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:53:29.998 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:53:29.998 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 16, 2024-09-12T02:53:29.998 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_priority": 5 2024-09-12T02:53:29.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.998 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:53:29.998 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:53:29.998 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": "cephfs" 2024-09-12T02:53:29.998 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.999 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:53:29.999 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:53:29.999 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 2, 2024-09-12T02:53:29.999 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 2, 2024-09-12T02:53:29.999 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:53:29.999 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 2, 2024-09-12T02:53:29.999 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 2, 2024-09-12T02:53:29.999 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:53:29.999 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:53:29.999 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:53:29.999 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:29.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:29.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:29.999 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 23, 2024-09-12T02:53:30.000 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_name": "cephfs_data", 2024-09-12T02:53:30.000 INFO:teuthology.orchestra.run.smithi112.stdout: "create_time": "2024-09-12T02:52:53.146578+0000", 2024-09-12T02:53:30.000 INFO:teuthology.orchestra.run.smithi112.stdout: "flags": 1, 2024-09-12T02:53:30.000 INFO:teuthology.orchestra.run.smithi112.stdout: "flags_names": "hashpspool", 2024-09-12T02:53:30.000 INFO:teuthology.orchestra.run.smithi112.stdout: "type": 1, 2024-09-12T02:53:30.000 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 2, 2024-09-12T02:53:30.000 INFO:teuthology.orchestra.run.smithi112.stdout: "min_size": 1, 2024-09-12T02:53:30.000 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_rule": 0, 2024-09-12T02:53:30.000 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:53:30.000 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:53:30.000 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:53:30.000 INFO:teuthology.orchestra.run.smithi112.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:53:30.000 INFO:teuthology.orchestra.run.smithi112.stdout: "is_stretch_pool": false, 2024-09-12T02:53:30.000 INFO:teuthology.orchestra.run.smithi112.stdout: "object_hash": 2, 2024-09-12T02:53:30.001 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:53:30.001 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num": 64, 2024-09-12T02:53:30.001 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num": 64, 2024-09-12T02:53:30.001 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_placement_num_target": 64, 2024-09-12T02:53:30.001 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_target": 64, 2024-09-12T02:53:30.001 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_pending": 64, 2024-09-12T02:53:30.001 INFO:teuthology.orchestra.run.smithi112.stdout: "last_pg_merge_meta": { 2024-09-12T02:53:30.001 INFO:teuthology.orchestra.run.smithi112.stdout: "source_pgid": "0.0", 2024-09-12T02:53:30.001 INFO:teuthology.orchestra.run.smithi112.stdout: "ready_epoch": 0, 2024-09-12T02:53:30.001 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_started": 0, 2024-09-12T02:53:30.001 INFO:teuthology.orchestra.run.smithi112.stdout: "last_epoch_clean": 0, 2024-09-12T02:53:30.001 INFO:teuthology.orchestra.run.smithi112.stdout: "source_version": "0'0", 2024-09-12T02:53:30.001 INFO:teuthology.orchestra.run.smithi112.stdout: "target_version": "0'0" 2024-09-12T02:53:30.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.002 INFO:teuthology.orchestra.run.smithi112.stdout: "last_change": "186", 2024-09-12T02:53:30.002 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend": "0", 2024-09-12T02:53:30.002 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:53:30.002 INFO:teuthology.orchestra.run.smithi112.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:53:30.002 INFO:teuthology.orchestra.run.smithi112.stdout: "auid": 0, 2024-09-12T02:53:30.002 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:53:30.002 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_seq": 0, 2024-09-12T02:53:30.002 INFO:teuthology.orchestra.run.smithi112.stdout: "snap_epoch": 0, 2024-09-12T02:53:30.002 INFO:teuthology.orchestra.run.smithi112.stdout: "pool_snaps": [], 2024-09-12T02:53:30.002 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps": "[]", 2024-09-12T02:53:30.002 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_bytes": 33554432, 2024-09-12T02:53:30.002 INFO:teuthology.orchestra.run.smithi112.stdout: "quota_max_objects": 0, 2024-09-12T02:53:30.002 INFO:teuthology.orchestra.run.smithi112.stdout: "tiers": [], 2024-09-12T02:53:30.002 INFO:teuthology.orchestra.run.smithi112.stdout: "tier_of": -1, 2024-09-12T02:53:30.003 INFO:teuthology.orchestra.run.smithi112.stdout: "read_tier": -1, 2024-09-12T02:53:30.003 INFO:teuthology.orchestra.run.smithi112.stdout: "write_tier": -1, 2024-09-12T02:53:30.003 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_mode": "none", 2024-09-12T02:53:30.003 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_bytes": 0, 2024-09-12T02:53:30.003 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_objects": 0, 2024-09-12T02:53:30.003 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:53:30.003 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:53:30.003 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:53:30.003 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_flush_age": 0, 2024-09-12T02:53:30.003 INFO:teuthology.orchestra.run.smithi112.stdout: "cache_min_evict_age": 0, 2024-09-12T02:53:30.003 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profile": "", 2024-09-12T02:53:30.003 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_params": { 2024-09-12T02:53:30.003 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "none" 2024-09-12T02:53:30.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.004 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_period": 0, 2024-09-12T02:53:30.004 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_count": 0, 2024-09-12T02:53:30.004 INFO:teuthology.orchestra.run.smithi112.stdout: "use_gmt_hitset": true, 2024-09-12T02:53:30.004 INFO:teuthology.orchestra.run.smithi112.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:53:30.004 INFO:teuthology.orchestra.run.smithi112.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:53:30.004 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:53:30.004 INFO:teuthology.orchestra.run.smithi112.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:53:30.004 INFO:teuthology.orchestra.run.smithi112.stdout: "grade_table": [], 2024-09-12T02:53:30.004 INFO:teuthology.orchestra.run.smithi112.stdout: "stripe_width": 0, 2024-09-12T02:53:30.004 INFO:teuthology.orchestra.run.smithi112.stdout: "expected_num_objects": 0, 2024-09-12T02:53:30.004 INFO:teuthology.orchestra.run.smithi112.stdout: "fast_read": false, 2024-09-12T02:53:30.004 INFO:teuthology.orchestra.run.smithi112.stdout: "options": { 2024-09-12T02:53:30.004 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_num_min": 64, 2024-09-12T02:53:30.005 INFO:teuthology.orchestra.run.smithi112.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:53:30.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.005 INFO:teuthology.orchestra.run.smithi112.stdout: "application_metadata": { 2024-09-12T02:53:30.005 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs": { 2024-09-12T02:53:30.005 INFO:teuthology.orchestra.run.smithi112.stdout: "data": "cephfs" 2024-09-12T02:53:30.005 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.005 INFO:teuthology.orchestra.run.smithi112.stdout: "read_balance": { 2024-09-12T02:53:30.005 INFO:teuthology.orchestra.run.smithi112.stdout: "score_type": "Fair distribution", 2024-09-12T02:53:30.005 INFO:teuthology.orchestra.run.smithi112.stdout: "score_acting": 1.3799999952316284, 2024-09-12T02:53:30.005 INFO:teuthology.orchestra.run.smithi112.stdout: "score_stable": 1.3799999952316284, 2024-09-12T02:53:30.005 INFO:teuthology.orchestra.run.smithi112.stdout: "optimal_score": 1, 2024-09-12T02:53:30.005 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-12T02:53:30.005 INFO:teuthology.orchestra.run.smithi112.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-12T02:53:30.005 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:53:30.006 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity": 1, 2024-09-12T02:53:30.006 INFO:teuthology.orchestra.run.smithi112.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:53:30.006 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.006 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.006 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:30.006 INFO:teuthology.orchestra.run.smithi112.stdout: "osds": [ 2024-09-12T02:53:30.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.006 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:53:30.006 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:30.006 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:30.006 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:30.006 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:30.006 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:30.006 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:30.007 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:30.007 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:30.007 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:30.007 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:30.007 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:30.007 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:30.007 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.007 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.007 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6800", 2024-09-12T02:53:30.007 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:30.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.007 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.008 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6801", 2024-09-12T02:53:30.008 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:30.008 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.008 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.008 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:30.008 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.008 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.008 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6802", 2024-09-12T02:53:30.008 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:30.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.008 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.009 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6803", 2024-09-12T02:53:30.009 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:30.009 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.009 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.009 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:30.009 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.009 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.009 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6806", 2024-09-12T02:53:30.009 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:30.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.009 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.010 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6807", 2024-09-12T02:53:30.010 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:30.010 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.010 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.010 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:30.010 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.010 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.010 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6804", 2024-09-12T02:53:30.010 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:30.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.011 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.011 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6805", 2024-09-12T02:53:30.011 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 821571304 2024-09-12T02:53:30.011 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.011 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.011 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6801/821571304", 2024-09-12T02:53:30.011 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6803/821571304", 2024-09-12T02:53:30.011 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6807/821571304", 2024-09-12T02:53:30.011 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6805/821571304", 2024-09-12T02:53:30.011 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:30.011 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:30.011 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:30.011 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.012 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:53:30.012 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:30.012 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:30.012 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:30.012 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:30.012 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:30.012 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:30.012 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:30.012 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:30.012 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:30.012 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:30.012 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:30.013 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:30.013 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.013 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.013 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6808", 2024-09-12T02:53:30.013 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:30.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.013 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.013 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6809", 2024-09-12T02:53:30.013 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:30.013 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.013 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.014 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:30.014 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.014 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.014 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6810", 2024-09-12T02:53:30.014 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:30.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.014 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.014 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6811", 2024-09-12T02:53:30.014 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:30.014 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.014 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.015 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:30.015 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.015 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.015 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6814", 2024-09-12T02:53:30.015 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:30.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.015 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.015 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6815", 2024-09-12T02:53:30.015 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:30.015 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.015 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.016 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:30.016 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.016 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.016 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6812", 2024-09-12T02:53:30.016 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:30.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.016 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.016 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6813", 2024-09-12T02:53:30.016 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2642068641 2024-09-12T02:53:30.016 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.016 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.017 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6809/2642068641", 2024-09-12T02:53:30.017 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6811/2642068641", 2024-09-12T02:53:30.017 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6815/2642068641", 2024-09-12T02:53:30.017 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6813/2642068641", 2024-09-12T02:53:30.017 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:30.017 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:30.017 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:30.017 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.017 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:53:30.017 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:30.017 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:30.017 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:30.018 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:30.018 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:30.018 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:30.018 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:30.018 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:30.018 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:30.018 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:30.018 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:30.018 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:30.018 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.018 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.018 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6816", 2024-09-12T02:53:30.018 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:30.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.019 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.019 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6817", 2024-09-12T02:53:30.019 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:30.019 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.019 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.019 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:30.019 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.019 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.019 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6818", 2024-09-12T02:53:30.019 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:30.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.020 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.020 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6819", 2024-09-12T02:53:30.020 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:30.020 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.020 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.020 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:30.020 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.020 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.020 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6822", 2024-09-12T02:53:30.020 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:30.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.021 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.021 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6823", 2024-09-12T02:53:30.021 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:30.021 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.021 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.021 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:30.021 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.021 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.021 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6820", 2024-09-12T02:53:30.021 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6821", 2024-09-12T02:53:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3365688807 2024-09-12T02:53:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6817/3365688807", 2024-09-12T02:53:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6819/3365688807", 2024-09-12T02:53:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6823/3365688807", 2024-09-12T02:53:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6821/3365688807", 2024-09-12T02:53:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:30.023 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:30.023 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.023 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:53:30.023 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:30.023 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:30.023 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:30.023 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:30.023 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:30.023 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:30.023 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:30.023 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:30.023 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6824", 2024-09-12T02:53:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6825", 2024-09-12T02:53:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6826", 2024-09-12T02:53:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6827", 2024-09-12T02:53:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.026 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.026 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:30.026 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.026 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.026 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6830", 2024-09-12T02:53:30.026 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:30.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.026 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.026 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6831", 2024-09-12T02:53:30.026 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:30.027 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.027 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.027 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:30.027 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.027 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.027 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6828", 2024-09-12T02:53:30.027 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:30.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.027 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.027 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.112:6829", 2024-09-12T02:53:30.027 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 231774278 2024-09-12T02:53:30.028 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.028 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.028 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.112:6825/231774278", 2024-09-12T02:53:30.028 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.112:6827/231774278", 2024-09-12T02:53:30.028 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.112:6831/231774278", 2024-09-12T02:53:30.028 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.112:6829/231774278", 2024-09-12T02:53:30.028 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:30.028 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:30.028 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:30.028 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.028 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:53:30.029 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:30.029 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:30.029 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:30.029 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:30.029 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:30.029 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:30.029 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:30.029 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:30.029 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:30.029 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:30.029 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:30.029 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:30.029 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.029 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.030 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6800", 2024-09-12T02:53:30.030 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:30.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.030 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.030 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6801", 2024-09-12T02:53:30.030 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:30.030 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.030 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.030 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:30.030 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.030 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6802", 2024-09-12T02:53:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6803", 2024-09-12T02:53:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6806", 2024-09-12T02:53:30.032 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:30.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.032 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.032 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6807", 2024-09-12T02:53:30.032 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:30.032 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.032 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.032 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:30.032 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.032 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.032 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6804", 2024-09-12T02:53:30.033 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:30.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.033 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.033 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6805", 2024-09-12T02:53:30.033 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3671178153 2024-09-12T02:53:30.033 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.033 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.033 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6801/3671178153", 2024-09-12T02:53:30.033 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6803/3671178153", 2024-09-12T02:53:30.033 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6807/3671178153", 2024-09-12T02:53:30.033 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6805/3671178153", 2024-09-12T02:53:30.034 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:30.034 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:30.034 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:30.034 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.034 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:53:30.034 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:30.034 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:30.034 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:30.034 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:30.034 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:30.034 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:30.034 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:30.034 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:30.035 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:30.035 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:30.035 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:30.035 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:30.035 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.035 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.035 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6808", 2024-09-12T02:53:30.035 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:30.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.035 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.035 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6809", 2024-09-12T02:53:30.035 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:30.036 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.036 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.036 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:30.036 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.036 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.036 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6810", 2024-09-12T02:53:30.036 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:30.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.036 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.036 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6811", 2024-09-12T02:53:30.037 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:30.037 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.037 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.037 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:30.037 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.037 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.037 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6817", 2024-09-12T02:53:30.037 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:30.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.037 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.037 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6819", 2024-09-12T02:53:30.038 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:30.038 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.038 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.038 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:30.038 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.038 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.038 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6812", 2024-09-12T02:53:30.038 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:30.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.038 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.039 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6815", 2024-09-12T02:53:30.039 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3193706134 2024-09-12T02:53:30.039 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.039 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.039 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6809/3193706134", 2024-09-12T02:53:30.039 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6811/3193706134", 2024-09-12T02:53:30.039 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6819/3193706134", 2024-09-12T02:53:30.039 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6815/3193706134", 2024-09-12T02:53:30.039 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:30.039 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:30.039 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:30.039 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:53:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:30.041 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:30.041 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.041 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.041 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6813", 2024-09-12T02:53:30.041 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:30.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.041 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.041 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6814", 2024-09-12T02:53:30.041 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:30.041 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.041 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6816", 2024-09-12T02:53:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6818", 2024-09-12T02:53:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.043 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:30.043 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.043 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.043 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6822", 2024-09-12T02:53:30.043 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:30.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.043 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.043 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6823", 2024-09-12T02:53:30.043 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:30.043 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.043 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.044 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:30.044 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.044 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.044 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6820", 2024-09-12T02:53:30.044 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:30.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.044 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.044 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6821", 2024-09-12T02:53:30.044 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3738813293 2024-09-12T02:53:30.044 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.044 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.045 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6814/3738813293", 2024-09-12T02:53:30.045 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6818/3738813293", 2024-09-12T02:53:30.045 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6823/3738813293", 2024-09-12T02:53:30.045 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6821/3738813293", 2024-09-12T02:53:30.045 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:30.045 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:30.045 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:30.045 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.045 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:53:30.045 INFO:teuthology.orchestra.run.smithi112.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:53:30.045 INFO:teuthology.orchestra.run.smithi112.stdout: "up": 1, 2024-09-12T02:53:30.045 INFO:teuthology.orchestra.run.smithi112.stdout: "in": 1, 2024-09-12T02:53:30.046 INFO:teuthology.orchestra.run.smithi112.stdout: "weight": 1, 2024-09-12T02:53:30.046 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_affinity": 1, 2024-09-12T02:53:30.046 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_begin": 0, 2024-09-12T02:53:30.046 INFO:teuthology.orchestra.run.smithi112.stdout: "last_clean_end": 0, 2024-09-12T02:53:30.046 INFO:teuthology.orchestra.run.smithi112.stdout: "up_from": 13, 2024-09-12T02:53:30.046 INFO:teuthology.orchestra.run.smithi112.stdout: "up_thru": 181, 2024-09-12T02:53:30.046 INFO:teuthology.orchestra.run.smithi112.stdout: "down_at": 0, 2024-09-12T02:53:30.046 INFO:teuthology.orchestra.run.smithi112.stdout: "lost_at": 0, 2024-09-12T02:53:30.046 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrs": { 2024-09-12T02:53:30.046 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.046 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.046 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6824", 2024-09-12T02:53:30.046 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:30.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.047 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.047 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6825", 2024-09-12T02:53:30.047 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:30.047 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.047 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.047 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addrs": { 2024-09-12T02:53:30.047 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.047 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.047 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6826", 2024-09-12T02:53:30.047 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:30.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.048 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.048 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6827", 2024-09-12T02:53:30.048 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:30.048 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.048 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.048 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addrs": { 2024-09-12T02:53:30.048 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.048 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.048 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6830", 2024-09-12T02:53:30.048 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:30.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.049 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.049 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6831", 2024-09-12T02:53:30.049 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:30.049 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.049 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.049 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addrs": { 2024-09-12T02:53:30.049 INFO:teuthology.orchestra.run.smithi112.stdout: "addrvec": [ 2024-09-12T02:53:30.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.049 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v2", 2024-09-12T02:53:30.049 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6828", 2024-09-12T02:53:30.049 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:30.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.050 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-12T02:53:30.050 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "172.21.15.137:6829", 2024-09-12T02:53:30.050 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1421932609 2024-09-12T02:53:30.050 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.050 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.050 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "172.21.15.137:6825/1421932609", 2024-09-12T02:53:30.050 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "172.21.15.137:6827/1421932609", 2024-09-12T02:53:30.050 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_back_addr": "172.21.15.137:6831/1421932609", 2024-09-12T02:53:30.050 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_front_addr": "172.21.15.137:6829/1421932609", 2024-09-12T02:53:30.050 INFO:teuthology.orchestra.run.smithi112.stdout: "state": [ 2024-09-12T02:53:30.050 INFO:teuthology.orchestra.run.smithi112.stdout: "exists", 2024-09-12T02:53:30.051 INFO:teuthology.orchestra.run.smithi112.stdout: "up" 2024-09-12T02:53:30.051 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-12T02:53:30.051 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.051 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:30.051 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_xinfo": [ 2024-09-12T02:53:30.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.051 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 0, 2024-09-12T02:53:30.051 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:30.051 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:30.051 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:30.051 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:30.051 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:30.051 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.220641+0000", 2024-09-12T02:53:30.051 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:30.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.052 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 1, 2024-09-12T02:53:30.052 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:30.052 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:30.052 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:30.052 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:30.052 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:30.052 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312574+0000", 2024-09-12T02:53:30.052 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:30.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.052 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 2, 2024-09-12T02:53:30.052 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:30.053 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:30.053 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:30.053 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:30.053 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:30.053 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.282771+0000", 2024-09-12T02:53:30.053 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:30.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.053 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 3, 2024-09-12T02:53:30.053 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:30.053 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:30.053 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:30.053 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:30.053 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:30.054 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.260478+0000", 2024-09-12T02:53:30.054 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:30.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.054 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 4, 2024-09-12T02:53:30.054 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:30.054 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:30.054 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:30.054 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:30.054 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:30.054 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.273397+0000", 2024-09-12T02:53:30.054 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:30.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.055 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 5, 2024-09-12T02:53:30.055 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:30.055 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:30.055 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:30.055 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:30.055 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:30.055 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.312452+0000", 2024-09-12T02:53:30.055 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:30.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.055 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 6, 2024-09-12T02:53:30.055 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:30.055 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:30.055 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:30.056 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:30.056 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:30.056 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.308965+0000", 2024-09-12T02:53:30.056 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:30.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-12T02:53:30.056 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": 7, 2024-09-12T02:53:30.056 INFO:teuthology.orchestra.run.smithi112.stdout: "down_stamp": "0.000000", 2024-09-12T02:53:30.056 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_probability": 0, 2024-09-12T02:53:30.056 INFO:teuthology.orchestra.run.smithi112.stdout: "laggy_interval": 0, 2024-09-12T02:53:30.056 INFO:teuthology.orchestra.run.smithi112.stdout: "features": 4540701547738038271, 2024-09-12T02:53:30.056 INFO:teuthology.orchestra.run.smithi112.stdout: "old_weight": 0, 2024-09-12T02:53:30.056 INFO:teuthology.orchestra.run.smithi112.stdout: "last_purged_snaps_scrub": "2024-09-12T02:41:40.337842+0000", 2024-09-12T02:53:30.057 INFO:teuthology.orchestra.run.smithi112.stdout: "dead_epoch": 0 2024-09-12T02:53:30.057 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.057 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-12T02:53:30.057 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap": [], 2024-09-12T02:53:30.057 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_items": [], 2024-09-12T02:53:30.057 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_upmap_primaries": [], 2024-09-12T02:53:30.057 INFO:teuthology.orchestra.run.smithi112.stdout: "pg_temp": [], 2024-09-12T02:53:30.057 INFO:teuthology.orchestra.run.smithi112.stdout: "primary_temp": [], 2024-09-12T02:53:30.057 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklist": {}, 2024-09-12T02:53:30.057 INFO:teuthology.orchestra.run.smithi112.stdout: "range_blocklist": {}, 2024-09-12T02:53:30.057 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_profiles": { 2024-09-12T02:53:30.057 INFO:teuthology.orchestra.run.smithi112.stdout: "default": { 2024-09-12T02:53:30.057 INFO:teuthology.orchestra.run.smithi112.stdout: "crush-failure-domain": "osd", 2024-09-12T02:53:30.057 INFO:teuthology.orchestra.run.smithi112.stdout: "k": "2", 2024-09-12T02:53:30.058 INFO:teuthology.orchestra.run.smithi112.stdout: "m": "1", 2024-09-12T02:53:30.058 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin": "jerasure", 2024-09-12T02:53:30.058 INFO:teuthology.orchestra.run.smithi112.stdout: "technique": "reed_sol_van" 2024-09-12T02:53:30.058 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-12T02:53:30.058 INFO:teuthology.orchestra.run.smithi112.stdout: "removed_snaps_queue": [], 2024-09-12T02:53:30.058 INFO:teuthology.orchestra.run.smithi112.stdout: "new_removed_snaps": [], 2024-09-12T02:53:30.058 INFO:teuthology.orchestra.run.smithi112.stdout: "new_purged_snaps": [], 2024-09-12T02:53:30.058 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_node_flags": {}, 2024-09-12T02:53:30.058 INFO:teuthology.orchestra.run.smithi112.stdout: "device_class_flags": {}, 2024-09-12T02:53:30.058 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode": { 2024-09-12T02:53:30.058 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_enabled": false, 2024-09-12T02:53:30.058 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_bucket_count": 0, 2024-09-12T02:53:30.058 INFO:teuthology.orchestra.run.smithi112.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:53:30.059 INFO:teuthology.orchestra.run.smithi112.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:53:30.059 INFO:teuthology.orchestra.run.smithi112.stdout: "stretch_mode_bucket": 0 2024-09-12T02:53:30.059 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-12T02:53:30.059 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:53:30.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.985+0000 7fa812000640 1 -- 172.21.15.112:0/2864857668 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa7ec06be30 msgr2=0x7fa7ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:30.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.985+0000 7fa812000640 1 --2- 172.21.15.112:0/2864857668 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa7ec06be30 0x7fa7ec06e2f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc006fd0 tx=0x7fa7fc008040 comp rx=0 tx=0).stop 2024-09-12T02:53:30.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.985+0000 7fa812000640 1 -- 172.21.15.112:0/2864857668 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa80c15b9d0 msgr2=0x7fa80c15a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:30.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.985+0000 7fa812000640 1 --2- 172.21.15.112:0/2864857668 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa80c15b9d0 0x7fa80c15a230 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fa80400cb40 tx=0x7fa80400a060 comp rx=0 tx=0).stop 2024-09-12T02:53:30.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.985+0000 7fa812000640 1 -- 172.21.15.112:0/2864857668 shutdown_connections 2024-09-12T02:53:30.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.985+0000 7fa812000640 1 --2- 172.21.15.112:0/2864857668 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa80c15b9d0 0x7fa80c15a230 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.985+0000 7fa812000640 1 --2- 172.21.15.112:0/2864857668 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa80c0b45d0 0x7fa80c0afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.985+0000 7fa812000640 1 --2- 172.21.15.112:0/2864857668 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa7ec06be30 0x7fa7ec06e2f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.985+0000 7fa812000640 1 --2- 172.21.15.112:0/2864857668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa80c06eef0 0x7fa80c1f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.985+0000 7fa812000640 1 -- 172.21.15.112:0/2864857668 >> 172.21.15.112:0/2864857668 conn(0x7fa80c06bbd0 msgr2=0x7fa80c0b1390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:30.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.985+0000 7fa812000640 1 -- 172.21.15.112:0/2864857668 shutdown_connections 2024-09-12T02:53:30.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:29.985+0000 7fa812000640 1 -- 172.21.15.112:0/2864857668 wait complete. 2024-09-12T02:53:30.062 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:53:30.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.213+0000 7f6450c00640 1 Processor -- start 2024-09-12T02:53:30.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.213+0000 7f6450c00640 1 -- start start 2024-09-12T02:53:30.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.215+0000 7f6450c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f644c0afe30 0x7f644c0cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:30.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.215+0000 7f6450c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f644c0ceeb0 con 0x7f644c15cc50 2024-09-12T02:53:30.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.215+0000 7f6450c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f644c06e300 con 0x7f644c071530 2024-09-12T02:53:30.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.215+0000 7f6450c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f644c15d030 con 0x7f644c0afe30 2024-09-12T02:53:30.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.215+0000 7f6449e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f644c15cc50 0x7f644c0732f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35974/0 (socket says 172.21.15.112:35974) 2024-09-12T02:53:30.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.215+0000 7f6449e00640 1 -- 172.21.15.112:0/537748174 learned_addr learned my addr 172.21.15.112:0/537748174 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:53:30.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.215+0000 7f644a800640 1 --2- 172.21.15.112:0/537748174 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f644c0afe30 0x7f644c0cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:30.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.215+0000 7f6448a00640 1 -- 172.21.15.112:0/537748174 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2132170583 0 0) 0x7f644c0ceeb0 con 0x7f644c15cc50 2024-09-12T02:53:30.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.215+0000 7f6448a00640 1 -- 172.21.15.112:0/537748174 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6430003520 con 0x7f644c15cc50 2024-09-12T02:53:30.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.216+0000 7f6448a00640 1 -- 172.21.15.112:0/537748174 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1080688381 0 0) 0x7f644c06e300 con 0x7f644c071530 2024-09-12T02:53:30.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.216+0000 7f6448a00640 1 -- 172.21.15.112:0/537748174 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f644c0ceeb0 con 0x7f644c071530 2024-09-12T02:53:30.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.216+0000 7f644a800640 1 -- 172.21.15.112:0/537748174 >> v1:172.21.15.137:6789/0 conn(0x7f644c071530 legacy=0x7f644c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:30.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.216+0000 7f644a800640 1 -- 172.21.15.112:0/537748174 >> v1:172.21.15.112:6789/0 conn(0x7f644c15cc50 legacy=0x7f644c0732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:30.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.216+0000 7f644a800640 1 -- 172.21.15.112:0/537748174 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644c06e5e0 con 0x7f644c0afe30 2024-09-12T02:53:30.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.217+0000 7f644a800640 1 --2- 172.21.15.112:0/537748174 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f644c0afe30 0x7f644c0cf950 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6444009dc0 tx=0x7f644402a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b72e7ebfbe4fac97 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:30.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.217+0000 7f6448a00640 1 -- 172.21.15.112:0/537748174 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644402ae60 con 0x7f644c0afe30 2024-09-12T02:53:30.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.217+0000 7f6448a00640 1 -- 172.21.15.112:0/537748174 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6444007740 con 0x7f644c0afe30 2024-09-12T02:53:30.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.217+0000 7f6448a00640 1 -- 172.21.15.112:0/537748174 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6444007b10 con 0x7f644c0afe30 2024-09-12T02:53:30.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.217+0000 7f6450c00640 1 -- 172.21.15.112:0/537748174 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f644c0afe30 msgr2=0x7f644c0cf950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:30.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.217+0000 7f6450c00640 1 --2- 172.21.15.112:0/537748174 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f644c0afe30 0x7f644c0cf950 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6444009dc0 tx=0x7f644402a640 comp rx=0 tx=0).stop 2024-09-12T02:53:30.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.218+0000 7f6450c00640 1 -- 172.21.15.112:0/537748174 shutdown_connections 2024-09-12T02:53:30.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.218+0000 7f6450c00640 1 --2- 172.21.15.112:0/537748174 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f644c0afe30 0x7f644c0cf950 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.218+0000 7f6450c00640 1 -- 172.21.15.112:0/537748174 >> 172.21.15.112:0/537748174 conn(0x7f644c06bbd0 msgr2=0x7f644c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:30.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.218+0000 7f6450c00640 1 -- 172.21.15.112:0/537748174 shutdown_connections 2024-09-12T02:53:30.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.218+0000 7f6450c00640 1 -- 172.21.15.112:0/537748174 wait complete. 2024-09-12T02:53:30.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.219+0000 7f6450c00640 1 Processor -- start 2024-09-12T02:53:30.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.220+0000 7f6450c00640 1 -- start start 2024-09-12T02:53:30.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.220+0000 7f6450c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f644c071530 0x7f644c1e8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:30.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.220+0000 7f6450c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f644c0afe30 0x7f644c1458e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:30.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.220+0000 7f6450c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f644c15cc50 0x7f644c0aaff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:30.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.220+0000 7f6450c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f644c06f510 con 0x7f644c0afe30 2024-09-12T02:53:30.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.220+0000 7f6450c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f644c0cf4c0 con 0x7f644c071530 2024-09-12T02:53:30.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.220+0000 7f6450c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f644c06f690 con 0x7f644c15cc50 2024-09-12T02:53:30.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.221+0000 7f6449e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f644c071530 0x7f644c1e8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:30.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.221+0000 7f6449400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f644c0afe30 0x7f644c1458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:30.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.221+0000 7f6449e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f644c071530 0x7f644c1e8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:58118/0 (socket says 172.21.15.112:58118) 2024-09-12T02:53:30.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.221+0000 7f6449e00640 1 -- 172.21.15.112:0/3774731034 learned_addr learned my addr 172.21.15.112:0/3774731034 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:30.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.221+0000 7f644a800640 1 --2- 172.21.15.112:0/3774731034 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f644c15cc50 0x7f644c0aaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:30.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.221+0000 7f6449400640 1 -- 172.21.15.112:0/3774731034 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f644c15cc50 msgr2=0x7f644c0aaff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:30.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.221+0000 7f6449400640 1 --2- 172.21.15.112:0/3774731034 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f644c15cc50 0x7f644c0aaff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.221+0000 7f6449400640 1 -- 172.21.15.112:0/3774731034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f644c071530 msgr2=0x7f644c1e8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:30.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.221+0000 7f6449400640 1 --2- 172.21.15.112:0/3774731034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f644c071530 0x7f644c1e8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.221+0000 7f6449400640 1 -- 172.21.15.112:0/3774731034 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644c145e20 con 0x7f644c0afe30 2024-09-12T02:53:30.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.222+0000 7f6449400640 1 --2- 172.21.15.112:0/3774731034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f644c0afe30 0x7f644c1458e0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f643800c3c0 tx=0x7f643800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:30.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.222+0000 7f6442000640 1 -- 172.21.15.112:0/3774731034 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6438017070 con 0x7f644c0afe30 2024-09-12T02:53:30.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.222+0000 7f6442000640 1 -- 172.21.15.112:0/3774731034 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64380052f0 con 0x7f644c0afe30 2024-09-12T02:53:30.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.222+0000 7f6442000640 1 -- 172.21.15.112:0/3774731034 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6438003640 con 0x7f644c0afe30 2024-09-12T02:53:30.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.222+0000 7f6450c00640 1 -- 172.21.15.112:0/3774731034 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f644c1e79f0 con 0x7f644c0afe30 2024-09-12T02:53:30.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.222+0000 7f6450c00640 1 -- 172.21.15.112:0/3774731034 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f644c1e7fb0 con 0x7f644c0afe30 2024-09-12T02:53:30.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.223+0000 7f6450c00640 1 -- 172.21.15.112:0/3774731034 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f644c068a30 con 0x7f644c0afe30 2024-09-12T02:53:30.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.224+0000 7f6442000640 1 -- 172.21.15.112:0/3774731034 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f643801a070 con 0x7f644c0afe30 2024-09-12T02:53:30.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.225+0000 7f6442000640 1 --2- 172.21.15.112:0/3774731034 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f642c06be30 0x7f642c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:30.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.225+0000 7f6442000640 1 -- 172.21.15.112:0/3774731034 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(186..186 src has 1..186) ==== 5709+0+0 (secure 0 0 0) 0x7f643808a1b0 con 0x7f644c0afe30 2024-09-12T02:53:30.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.225+0000 7f6449e00640 1 --2- 172.21.15.112:0/3774731034 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f642c06be30 0x7f642c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:30.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.226+0000 7f6449e00640 1 --2- 172.21.15.112:0/3774731034 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f642c06be30 0x7f642c06e2f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f643c000f60 tx=0x7f643c007e10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:30.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.229+0000 7f6442000640 1 -- 172.21.15.112:0/3774731034 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6438058470 con 0x7f644c0afe30 2024-09-12T02:53:30.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.437+0000 7f6450c00640 1 -- 172.21.15.112:0/3774731034 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f644c0730d0 con 0x7f644c0afe30 2024-09-12T02:53:30.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.438+0000 7f6442000640 1 -- 172.21.15.112:0/3774731034 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5233 (secure 0 0 0) 0x7f643805c770 con 0x7f644c0afe30 2024-09-12T02:53:30.440 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:53:30.441 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":94,"btime":"2024-09-12T02:52:57:752799+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7177,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/119222923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":119222923},{"type":"v1","addr":"172.21.15.112:6837","nonce":119222923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7180,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/691058370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":691058370},{"type":"v1","addr":"172.21.15.137:6834","nonce":691058370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7854,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/1978579863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1978579863},{"type":"v1","addr":"172.21.15.112:6836","nonce":1978579863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:52:54.149640+0000","modified":"2024-09-12T02:52:57.153816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7860},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7860":{"gid":7860,"name":"b","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/1283773082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1283773082},{"type":"v1","addr":"172.21.15.137:6835","nonce":1283773082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7860,"qdb_cluster":[7860]},"id":11}]} 2024-09-12T02:53:30.442 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 94 2024-09-12T02:53:30.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.440+0000 7f6450c00640 1 -- 172.21.15.112:0/3774731034 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f642c06be30 msgr2=0x7f642c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:30.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.440+0000 7f6450c00640 1 --2- 172.21.15.112:0/3774731034 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f642c06be30 0x7f642c06e2f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f643c000f60 tx=0x7f643c007e10 comp rx=0 tx=0).stop 2024-09-12T02:53:30.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.440+0000 7f6450c00640 1 -- 172.21.15.112:0/3774731034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f644c0afe30 msgr2=0x7f644c1458e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:30.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.440+0000 7f6450c00640 1 --2- 172.21.15.112:0/3774731034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f644c0afe30 0x7f644c1458e0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f643800c3c0 tx=0x7f643800c880 comp rx=0 tx=0).stop 2024-09-12T02:53:30.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.440+0000 7f6450c00640 1 -- 172.21.15.112:0/3774731034 shutdown_connections 2024-09-12T02:53:30.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.440+0000 7f6450c00640 1 --2- 172.21.15.112:0/3774731034 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f644c15cc50 0x7f644c0aaff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.440+0000 7f6450c00640 1 --2- 172.21.15.112:0/3774731034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f644c0afe30 0x7f644c1458e0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.440+0000 7f6450c00640 1 --2- 172.21.15.112:0/3774731034 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f642c06be30 0x7f642c06e2f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.440+0000 7f6450c00640 1 --2- 172.21.15.112:0/3774731034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f644c071530 0x7f644c1e8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.440+0000 7f6450c00640 1 -- 172.21.15.112:0/3774731034 >> 172.21.15.112:0/3774731034 conn(0x7f644c06bbd0 msgr2=0x7f644c0b39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:30.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.441+0000 7f6450c00640 1 -- 172.21.15.112:0/3774731034 shutdown_connections 2024-09-12T02:53:30.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:30.441+0000 7f6450c00640 1 -- 172.21.15.112:0/3774731034 wait complete. 2024-09-12T02:53:30.457 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2024-09-12T02:53:30.640 INFO:teuthology.orchestra.run.smithi137.stdout:{"cluster_fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","whoami":0,"id":7860,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":35.897221062,"mdsmap_epoch":94,"osdmap_epoch":186,"osdmap_epoch_barrier":185,"uptime":40.975658862000003} 2024-09-12T02:53:30.644 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7c01f3b3-dec2-4449-a33f-f960d7527ea6", "fs_name": "cephfs", "id": 7860, "mdsmap_epoch": 94, "osdmap_epoch": 186, "osdmap_epoch_barrier": 185, "rank_uptime": 35.897221062, "state": "up:active", "uptime": 40.975658862, "want_state": "up:active", "whoami": 0 } 2024-09-12T02:53:30.644 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T02:53:30.644 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:53:30.644 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:53:30.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:30.679 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2024-09-12T02:53:31.124 INFO:teuthology.orchestra.run.smithi112.stderr:50+0 records in 2024-09-12T02:53:31.124 INFO:teuthology.orchestra.run.smithi112.stderr:50+0 records out 2024-09-12T02:53:31.124 INFO:teuthology.orchestra.run.smithi112.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.367598 s, 143 MB/s 2024-09-12T02:53:31.125 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T02:53:31.125 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:53:31.226 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T02:53:31.310 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T02:53:31.310 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:53:31.310 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:53:31.310 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:53:31.346 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:53:31.346 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:53:31.421 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:53:31.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.613+0000 7fc15ec00640 1 Processor -- start 2024-09-12T02:53:31.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.613+0000 7fc15ec00640 1 -- start start 2024-09-12T02:53:31.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.614+0000 7fc15ec00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc15815b9d0 0x7fc1580b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:31.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.614+0000 7fc15ec00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc15806f600 0x7fc1580728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:31.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.614+0000 7fc15ec00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1580b54a0 con 0x7fc1580b45d0 2024-09-12T02:53:31.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.614+0000 7fc15ec00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc1580b4a60 con 0x7fc15815b9d0 2024-09-12T02:53:31.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.614+0000 7fc15ec00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc1580b3af0 con 0x7fc15806f600 2024-09-12T02:53:31.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.615+0000 7fc157400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc1580b45d0 0x7fc15806eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35978/0 (socket says 172.21.15.112:35978) 2024-09-12T02:53:31.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.615+0000 7fc157400640 1 -- 172.21.15.112:0/4168413589 learned_addr learned my addr 172.21.15.112:0/4168413589 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:53:31.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.615+0000 7fc157e00640 1 --2- 172.21.15.112:0/4168413589 >> v2:172.21.15.137:3300/0 conn(0x7fc15815b9d0 0x7fc1580b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:31.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.615+0000 7fc15cc00640 1 --2- 172.21.15.112:0/4168413589 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc15806f600 0x7fc1580728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:31.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.615+0000 7fc156a00640 1 -- 172.21.15.112:0/4168413589 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2986174927 0 0) 0x7fc1580b54a0 con 0x7fc1580b45d0 2024-09-12T02:53:31.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.615+0000 7fc156a00640 1 -- 172.21.15.112:0/4168413589 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc13c003520 con 0x7fc1580b45d0 2024-09-12T02:53:31.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.615+0000 7fc157e00640 1 -- 172.21.15.112:0/4168413589 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc15806f600 msgr2=0x7fc1580728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:31.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.615+0000 7fc157e00640 1 --2- 172.21.15.112:0/4168413589 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc15806f600 0x7fc1580728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:31.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.615+0000 7fc157e00640 1 -- 172.21.15.112:0/4168413589 >> v1:172.21.15.112:6789/0 conn(0x7fc1580b45d0 legacy=0x7fc15806eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:31.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.615+0000 7fc157e00640 1 -- 172.21.15.112:0/4168413589 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1580b3dd0 con 0x7fc15815b9d0 2024-09-12T02:53:31.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.616+0000 7fc157e00640 1 --2- 172.21.15.112:0/4168413589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc15815b9d0 0x7fc1580b4ec0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc1480097a0 tx=0x7fc14802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c5f899e170c4f43 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:31.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.617+0000 7fc156a00640 1 -- 172.21.15.112:0/4168413589 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc148037070 con 0x7fc15815b9d0 2024-09-12T02:53:31.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.617+0000 7fc156a00640 1 -- 172.21.15.112:0/4168413589 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc148032440 con 0x7fc15815b9d0 2024-09-12T02:53:31.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.617+0000 7fc156a00640 1 -- 172.21.15.112:0/4168413589 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1480327f0 con 0x7fc15815b9d0 2024-09-12T02:53:31.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.617+0000 7fc15ec00640 1 -- 172.21.15.112:0/4168413589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc15815b9d0 msgr2=0x7fc1580b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:31.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.617+0000 7fc15ec00640 1 --2- 172.21.15.112:0/4168413589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc15815b9d0 0x7fc1580b4ec0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc1480097a0 tx=0x7fc14802a180 comp rx=0 tx=0).stop 2024-09-12T02:53:31.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.617+0000 7fc15ec00640 1 -- 172.21.15.112:0/4168413589 shutdown_connections 2024-09-12T02:53:31.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.617+0000 7fc15ec00640 1 --2- 172.21.15.112:0/4168413589 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc15806f600 0x7fc1580728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:31.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.617+0000 7fc15ec00640 1 --2- 172.21.15.112:0/4168413589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc15815b9d0 0x7fc1580b4ec0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:31.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.617+0000 7fc15ec00640 1 -- 172.21.15.112:0/4168413589 >> 172.21.15.112:0/4168413589 conn(0x7fc15806bbd0 msgr2=0x7fc15806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:31.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.617+0000 7fc15ec00640 1 -- 172.21.15.112:0/4168413589 shutdown_connections 2024-09-12T02:53:31.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.618+0000 7fc15ec00640 1 -- 172.21.15.112:0/4168413589 wait complete. 2024-09-12T02:53:31.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.619+0000 7fc15ec00640 1 Processor -- start 2024-09-12T02:53:31.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.619+0000 7fc15ec00640 1 -- start start 2024-09-12T02:53:31.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.620+0000 7fc15ec00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc15806f600 0x7fc1581f80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:31.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.620+0000 7fc15ec00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1580b45d0 0x7fc1581501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:31.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.620+0000 7fc15ec00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc15815b9d0 0x7fc15806e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:31.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.620+0000 7fc15ec00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc15815bf30 con 0x7fc1580b45d0 2024-09-12T02:53:31.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.620+0000 7fc15ec00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc15815bdb0 con 0x7fc15806f600 2024-09-12T02:53:31.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.620+0000 7fc15ec00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc1580cdcd0 con 0x7fc15815b9d0 2024-09-12T02:53:31.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.620+0000 7fc157400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1580b45d0 0x7fc1581501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:31.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.620+0000 7fc157400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1580b45d0 0x7fc1581501c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34300/0 (socket says 172.21.15.112:34300) 2024-09-12T02:53:31.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.620+0000 7fc157400640 1 -- 172.21.15.112:0/3604765139 learned_addr learned my addr 172.21.15.112:0/3604765139 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:31.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.620+0000 7fc157e00640 1 --2- 172.21.15.112:0/3604765139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc15806f600 0x7fc1581f80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:31.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.621+0000 7fc15cc00640 1 --2- 172.21.15.112:0/3604765139 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc15815b9d0 0x7fc15806e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:31.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.621+0000 7fc157400640 1 -- 172.21.15.112:0/3604765139 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc15815b9d0 msgr2=0x7fc15806e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:31.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.621+0000 7fc157400640 1 --2- 172.21.15.112:0/3604765139 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc15815b9d0 0x7fc15806e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:31.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.621+0000 7fc157400640 1 -- 172.21.15.112:0/3604765139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc15806f600 msgr2=0x7fc1581f80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:31.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.621+0000 7fc157400640 1 --2- 172.21.15.112:0/3604765139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc15806f600 0x7fc1581f80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:31.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.621+0000 7fc157400640 1 -- 172.21.15.112:0/3604765139 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc158152000 con 0x7fc1580b45d0 2024-09-12T02:53:31.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.621+0000 7fc157e00640 1 --2- 172.21.15.112:0/3604765139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc15806f600 0x7fc1581f80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:53:31.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.621+0000 7fc157400640 1 --2- 172.21.15.112:0/3604765139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1580b45d0 0x7fc1581501c0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fc14400c730 tx=0x7fc14400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:31.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.621+0000 7fc14fe00640 1 -- 172.21.15.112:0/3604765139 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc144017070 con 0x7fc1580b45d0 2024-09-12T02:53:31.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.621+0000 7fc14fe00640 1 -- 172.21.15.112:0/3604765139 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc144007290 con 0x7fc1580b45d0 2024-09-12T02:53:31.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.621+0000 7fc14fe00640 1 -- 172.21.15.112:0/3604765139 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc144001d40 con 0x7fc1580b45d0 2024-09-12T02:53:31.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.621+0000 7fc15ec00640 1 -- 172.21.15.112:0/3604765139 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1581522e0 con 0x7fc1580b45d0 2024-09-12T02:53:31.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.622+0000 7fc15ec00640 1 -- 172.21.15.112:0/3604765139 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1581528a0 con 0x7fc1580b45d0 2024-09-12T02:53:31.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.622+0000 7fc15ec00640 1 -- 172.21.15.112:0/3604765139 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc15806dbc0 con 0x7fc1580b45d0 2024-09-12T02:53:31.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.623+0000 7fc14fe00640 1 -- 172.21.15.112:0/3604765139 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc14401a070 con 0x7fc1580b45d0 2024-09-12T02:53:31.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.624+0000 7fc14fe00640 1 --2- 172.21.15.112:0/3604765139 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc13806be30 0x7fc13806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:31.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.624+0000 7fc14fe00640 1 -- 172.21.15.112:0/3604765139 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(186..186 src has 1..186) ==== 5709+0+0 (secure 0 0 0) 0x7fc14408a1e0 con 0x7fc1580b45d0 2024-09-12T02:53:31.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.624+0000 7fc157e00640 1 --2- 172.21.15.112:0/3604765139 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc13806be30 0x7fc13806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:31.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.625+0000 7fc157e00640 1 --2- 172.21.15.112:0/3604765139 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc13806be30 0x7fc13806e2f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc148034000 tx=0x7fc14802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:31.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.629+0000 7fc14fe00640 1 -- 172.21.15.112:0/3604765139 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc1440584a0 con 0x7fc1580b45d0 2024-09-12T02:53:31.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.812+0000 7fc15ec00640 1 -- 172.21.15.112:0/3604765139 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc158072320 con 0x7fc1580b45d0 2024-09-12T02:53:31.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.813+0000 7fc14fe00640 1 -- 172.21.15.112:0/3604765139 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v186) ==== 80+0+0 (secure 0 0 0) 0x7fc14405c7a0 con 0x7fc1580b45d0 2024-09-12T02:53:31.814 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-12T02:53:31.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.815+0000 7fc15ec00640 1 -- 172.21.15.112:0/3604765139 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc13806be30 msgr2=0x7fc13806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:31.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.815+0000 7fc15ec00640 1 --2- 172.21.15.112:0/3604765139 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc13806be30 0x7fc13806e2f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc148034000 tx=0x7fc14802e000 comp rx=0 tx=0).stop 2024-09-12T02:53:31.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.815+0000 7fc15ec00640 1 -- 172.21.15.112:0/3604765139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1580b45d0 msgr2=0x7fc1581501c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:31.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.815+0000 7fc15ec00640 1 --2- 172.21.15.112:0/3604765139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1580b45d0 0x7fc1581501c0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fc14400c730 tx=0x7fc14400cbf0 comp rx=0 tx=0).stop 2024-09-12T02:53:31.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.815+0000 7fc15ec00640 1 -- 172.21.15.112:0/3604765139 shutdown_connections 2024-09-12T02:53:31.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.815+0000 7fc15ec00640 1 --2- 172.21.15.112:0/3604765139 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc15815b9d0 0x7fc15806e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:31.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.815+0000 7fc15ec00640 1 --2- 172.21.15.112:0/3604765139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1580b45d0 0x7fc1581501c0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:31.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.815+0000 7fc15ec00640 1 --2- 172.21.15.112:0/3604765139 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc13806be30 0x7fc13806e2f0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:31.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.815+0000 7fc15ec00640 1 --2- 172.21.15.112:0/3604765139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc15806f600 0x7fc1581f80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:31.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.815+0000 7fc15ec00640 1 -- 172.21.15.112:0/3604765139 >> 172.21.15.112:0/3604765139 conn(0x7fc15806bbd0 msgr2=0x7fc1580d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:31.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.815+0000 7fc15ec00640 1 -- 172.21.15.112:0/3604765139 shutdown_connections 2024-09-12T02:53:31.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:31.815+0000 7fc15ec00640 1 -- 172.21.15.112:0/3604765139 wait complete. 2024-09-12T02:53:31.833 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:53:31.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:31.833 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T02:53:31.931 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-12T02:53:31.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:31.931 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:53:31.971 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:53:31.971 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:53:31.971 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:53:32.007 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:53:32.008 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:53:32.082 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:53:32.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.236+0000 7fce0ba00640 1 Processor -- start 2024-09-12T02:53:32.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.237+0000 7fce0ba00640 1 -- start start 2024-09-12T02:53:32.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.238+0000 7fce0ba00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fce0415cc50 0x7fce040732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.238+0000 7fce0ba00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce04071530 0x7fce040af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.238+0000 7fce0ba00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce04073830 con 0x7fce04071970 2024-09-12T02:53:32.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.238+0000 7fce0ba00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fce0415d030 con 0x7fce0415cc50 2024-09-12T02:53:32.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.238+0000 7fce0ba00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fce040cf4c0 con 0x7fce04071530 2024-09-12T02:53:32.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.238+0000 7fce09000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fce0415cc50 0x7fce040732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:32.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.238+0000 7fce09000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fce0415cc50 0x7fce040732f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41346/0 (socket says 172.21.15.112:41346) 2024-09-12T02:53:32.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.238+0000 7fce09a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fce04071970 0x7fce040cf950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33142/0 (socket says 172.21.15.112:33142) 2024-09-12T02:53:32.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.238+0000 7fce09000640 1 -- 172.21.15.112:0/2618297553 learned_addr learned my addr 172.21.15.112:0/2618297553 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:32.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.238+0000 7fcdfbe00640 1 --2- 172.21.15.112:0/2618297553 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce04071530 0x7fce040af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:32.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.238+0000 7fce09000640 1 -- 172.21.15.112:0/2618297553 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce04071530 msgr2=0x7fce040af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:32.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.239+0000 7fce09000640 1 --2- 172.21.15.112:0/2618297553 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce04071530 0x7fce040af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.239+0000 7fce09000640 1 -- 172.21.15.112:0/2618297553 >> v1:172.21.15.112:6789/0 conn(0x7fce04071970 legacy=0x7fce040cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:32.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.239+0000 7fce09000640 1 -- 172.21.15.112:0/2618297553 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce040ceeb0 con 0x7fce0415cc50 2024-09-12T02:53:32.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.239+0000 7fcdfbe00640 1 --2- 172.21.15.112:0/2618297553 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce04071530 0x7fce040af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:53:32.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.239+0000 7fce09000640 1 --2- 172.21.15.112:0/2618297553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce0415cc50 0x7fce040732f0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4009870 tx=0x7fcdf402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc41070cb16b85a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:32.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.240+0000 7fce03e00640 1 -- 172.21.15.112:0/2618297553 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4037070 con 0x7fce0415cc50 2024-09-12T02:53:32.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.240+0000 7fce03e00640 1 -- 172.21.15.112:0/2618297553 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdf4032440 con 0x7fce0415cc50 2024-09-12T02:53:32.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.240+0000 7fce03e00640 1 -- 172.21.15.112:0/2618297553 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4032810 con 0x7fce0415cc50 2024-09-12T02:53:32.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.240+0000 7fce0ba00640 1 -- 172.21.15.112:0/2618297553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce0415cc50 msgr2=0x7fce040732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:32.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.240+0000 7fce0ba00640 1 --2- 172.21.15.112:0/2618297553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce0415cc50 0x7fce040732f0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4009870 tx=0x7fcdf402a1c0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.240+0000 7fce0ba00640 1 -- 172.21.15.112:0/2618297553 shutdown_connections 2024-09-12T02:53:32.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.240+0000 7fce0ba00640 1 --2- 172.21.15.112:0/2618297553 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce04071530 0x7fce040af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.240+0000 7fce0ba00640 1 --2- 172.21.15.112:0/2618297553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce0415cc50 0x7fce040732f0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.240+0000 7fce0ba00640 1 -- 172.21.15.112:0/2618297553 >> 172.21.15.112:0/2618297553 conn(0x7fce0406bbd0 msgr2=0x7fce0406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:32.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.240+0000 7fce0ba00640 1 -- 172.21.15.112:0/2618297553 shutdown_connections 2024-09-12T02:53:32.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.240+0000 7fce0ba00640 1 -- 172.21.15.112:0/2618297553 wait complete. 2024-09-12T02:53:32.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.242+0000 7fce0ba00640 1 Processor -- start 2024-09-12T02:53:32.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.242+0000 7fce0ba00640 1 -- start start 2024-09-12T02:53:32.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.243+0000 7fce0ba00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce04071530 0x7fce0414d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.243+0000 7fce0ba00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce04071970 0x7fce040ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.243+0000 7fce0ba00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce0415cc50 0x7fce04155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.243+0000 7fce0ba00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fce040cf150 con 0x7fce04071970 2024-09-12T02:53:32.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.243+0000 7fce0ba00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fce0406e5e0 con 0x7fce04071530 2024-09-12T02:53:32.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.243+0000 7fce0ba00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fce0406f510 con 0x7fce0415cc50 2024-09-12T02:53:32.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.243+0000 7fcdfbe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce04071970 0x7fce040ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:32.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.243+0000 7fcdfbe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce04071970 0x7fce040ae8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41352/0 (socket says 172.21.15.112:41352) 2024-09-12T02:53:32.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.243+0000 7fcdfbe00640 1 -- 172.21.15.112:0/4016258540 learned_addr learned my addr 172.21.15.112:0/4016258540 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:32.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.243+0000 7fce09a00640 1 --2- 172.21.15.112:0/4016258540 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce0415cc50 0x7fce04155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:32.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.243+0000 7fce09000640 1 --2- 172.21.15.112:0/4016258540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce04071530 0x7fce0414d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:32.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.244+0000 7fcdfbe00640 1 -- 172.21.15.112:0/4016258540 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce0415cc50 msgr2=0x7fce04155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:32.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.244+0000 7fcdfbe00640 1 --2- 172.21.15.112:0/4016258540 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce0415cc50 0x7fce04155020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.244+0000 7fcdfbe00640 1 -- 172.21.15.112:0/4016258540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce04071530 msgr2=0x7fce0414d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:32.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.244+0000 7fcdfbe00640 1 --2- 172.21.15.112:0/4016258540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce04071530 0x7fce0414d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.244+0000 7fcdfbe00640 1 -- 172.21.15.112:0/4016258540 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce040aef40 con 0x7fce04071970 2024-09-12T02:53:32.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.244+0000 7fcdfbe00640 1 --2- 172.21.15.112:0/4016258540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce04071970 0x7fce040ae8d0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fcdec00c7f0 tx=0x7fcdec00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:32.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.244+0000 7fce01600640 1 -- 172.21.15.112:0/4016258540 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdec005b90 con 0x7fce04071970 2024-09-12T02:53:32.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.244+0000 7fce01600640 1 -- 172.21.15.112:0/4016258540 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdec005d30 con 0x7fce04071970 2024-09-12T02:53:32.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.244+0000 7fce01600640 1 -- 172.21.15.112:0/4016258540 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdec007a70 con 0x7fce04071970 2024-09-12T02:53:32.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.244+0000 7fce0ba00640 1 -- 172.21.15.112:0/4016258540 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce040af220 con 0x7fce04071970 2024-09-12T02:53:32.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.244+0000 7fce0ba00640 1 -- 172.21.15.112:0/4016258540 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce041f5a40 con 0x7fce04071970 2024-09-12T02:53:32.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.246+0000 7fce0ba00640 1 -- 172.21.15.112:0/4016258540 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce04068a30 con 0x7fce04071970 2024-09-12T02:53:32.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.246+0000 7fce01600640 1 -- 172.21.15.112:0/4016258540 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcdec007c10 con 0x7fce04071970 2024-09-12T02:53:32.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.247+0000 7fce01600640 1 --2- 172.21.15.112:0/4016258540 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcde006be60 0x7fcde006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.247+0000 7fce01600640 1 -- 172.21.15.112:0/4016258540 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(186..186 src has 1..186) ==== 5709+0+0 (secure 0 0 0) 0x7fcdec08ae00 con 0x7fce04071970 2024-09-12T02:53:32.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.247+0000 7fce09000640 1 --2- 172.21.15.112:0/4016258540 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcde006be60 0x7fcde006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:32.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.248+0000 7fce09000640 1 --2- 172.21.15.112:0/4016258540 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcde006be60 0x7fcde006e320 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4034000 tx=0x7fcdf402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:32.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.251+0000 7fce01600640 1 -- 172.21.15.112:0/4016258540 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcdec015020 con 0x7fce04071970 2024-09-12T02:53:32.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.436+0000 7fce0ba00640 1 -- 172.21.15.112:0/4016258540 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fce040730d0 con 0x7fce04071970 2024-09-12T02:53:32.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.436+0000 7fce01600640 1 -- 172.21.15.112:0/4016258540 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v186) ==== 80+0+0 (secure 0 0 0) 0x7fcdec059840 con 0x7fce04071970 2024-09-12T02:53:32.438 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-12T02:53:32.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.438+0000 7fce0ba00640 1 -- 172.21.15.112:0/4016258540 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcde006be60 msgr2=0x7fcde006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:32.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.438+0000 7fce0ba00640 1 --2- 172.21.15.112:0/4016258540 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcde006be60 0x7fcde006e320 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4034000 tx=0x7fcdf402e000 comp rx=0 tx=0).stop 2024-09-12T02:53:32.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.439+0000 7fce0ba00640 1 -- 172.21.15.112:0/4016258540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce04071970 msgr2=0x7fce040ae8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:32.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.439+0000 7fce0ba00640 1 --2- 172.21.15.112:0/4016258540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce04071970 0x7fce040ae8d0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fcdec00c7f0 tx=0x7fcdec00ccb0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.439+0000 7fce0ba00640 1 -- 172.21.15.112:0/4016258540 shutdown_connections 2024-09-12T02:53:32.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.439+0000 7fce0ba00640 1 --2- 172.21.15.112:0/4016258540 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce0415cc50 0x7fce04155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.439+0000 7fce0ba00640 1 --2- 172.21.15.112:0/4016258540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce04071970 0x7fce040ae8d0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.439+0000 7fce0ba00640 1 --2- 172.21.15.112:0/4016258540 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fcde006be60 0x7fcde006e320 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.439+0000 7fce0ba00640 1 --2- 172.21.15.112:0/4016258540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce04071530 0x7fce0414d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.439+0000 7fce0ba00640 1 -- 172.21.15.112:0/4016258540 >> 172.21.15.112:0/4016258540 conn(0x7fce0406bbd0 msgr2=0x7fce040727a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:32.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.439+0000 7fce0ba00640 1 -- 172.21.15.112:0/4016258540 shutdown_connections 2024-09-12T02:53:32.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.439+0000 7fce0ba00640 1 -- 172.21.15.112:0/4016258540 wait complete. 2024-09-12T02:53:32.455 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-12T02:53:32.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:32.455 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-12T02:53:32.516 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T02:53:32.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:32.516 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T02:53:32.553 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:53:32.553 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:53:32.553 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:53:32.588 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:53:32.588 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T02:53:32.589 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:53:32.589 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:53:32.628 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:53:32.629 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:53:32.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.780+0000 7f9357000640 1 Processor -- start 2024-09-12T02:53:32.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.780+0000 7f9357000640 1 -- start start 2024-09-12T02:53:32.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.782+0000 7f9357000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f935015b9d0 0x7f93500b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.782+0000 7f9357000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f93500b45d0 0x7f93500728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.782+0000 7f9357000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f935006eef0 0x7f935006f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.782+0000 7f9357000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f93500b4a60 con 0x7f935015b9d0 2024-09-12T02:53:32.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.782+0000 7f9357000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f935006f860 con 0x7f93500b45d0 2024-09-12T02:53:32.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.782+0000 7f9357000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f93500b54a0 con 0x7f935006eef0 2024-09-12T02:53:32.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.782+0000 7f934fe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f935015b9d0 0x7f93500b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:32.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.782+0000 7f934fe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f935015b9d0 0x7f93500b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41362/0 (socket says 172.21.15.112:41362) 2024-09-12T02:53:32.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.782+0000 7f934fe00640 1 -- 172.21.15.112:0/2957492860 learned_addr learned my addr 172.21.15.112:0/2957492860 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:32.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.782+0000 7f9355000640 1 --2- 172.21.15.112:0/2957492860 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f935006eef0 0x7f935006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:32.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.782+0000 7f9347400640 1 --2- 172.21.15.112:0/2957492860 >> v2:172.21.15.137:3300/0 conn(0x7f93500b45d0 0x7f93500728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:32.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.782+0000 7f934fe00640 1 -- 172.21.15.112:0/2957492860 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f935006eef0 msgr2=0x7f935006f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:32.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.782+0000 7f934fe00640 1 --2- 172.21.15.112:0/2957492860 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f935006eef0 0x7f935006f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.782+0000 7f934fe00640 1 -- 172.21.15.112:0/2957492860 >> v2:172.21.15.137:3300/0 conn(0x7f93500b45d0 msgr2=0x7f93500728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:32.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.782+0000 7f934fe00640 1 --2- 172.21.15.112:0/2957492860 >> v2:172.21.15.137:3300/0 conn(0x7f93500b45d0 0x7f93500728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.782+0000 7f934fe00640 1 -- 172.21.15.112:0/2957492860 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93500b3af0 con 0x7f935015b9d0 2024-09-12T02:53:32.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.782+0000 7f9347400640 1 --2- 172.21.15.112:0/2957492860 >> v2:172.21.15.137:3300/0 conn(0x7f93500b45d0 0x7f93500728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:53:32.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.783+0000 7f934fe00640 1 --2- 172.21.15.112:0/2957492860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f935015b9d0 0x7f93500b4ec0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f9350068670 tx=0x7f934002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dcfce9df4cf0117 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:32.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.783+0000 7f934f400640 1 -- 172.21.15.112:0/2957492860 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9340037070 con 0x7f935015b9d0 2024-09-12T02:53:32.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.784+0000 7f934f400640 1 -- 172.21.15.112:0/2957492860 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9340032440 con 0x7f935015b9d0 2024-09-12T02:53:32.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.784+0000 7f934f400640 1 -- 172.21.15.112:0/2957492860 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9340032810 con 0x7f935015b9d0 2024-09-12T02:53:32.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.784+0000 7f9357000640 1 -- 172.21.15.112:0/2957492860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f935015b9d0 msgr2=0x7f93500b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:32.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.784+0000 7f9357000640 1 --2- 172.21.15.112:0/2957492860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f935015b9d0 0x7f93500b4ec0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f9350068670 tx=0x7f934002a210 comp rx=0 tx=0).stop 2024-09-12T02:53:32.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.784+0000 7f9357000640 1 -- 172.21.15.112:0/2957492860 shutdown_connections 2024-09-12T02:53:32.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.784+0000 7f9357000640 1 --2- 172.21.15.112:0/2957492860 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f935006eef0 0x7f935006f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.784+0000 7f9357000640 1 --2- 172.21.15.112:0/2957492860 >> v2:172.21.15.137:3300/0 conn(0x7f93500b45d0 0x7f93500728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.784+0000 7f9357000640 1 --2- 172.21.15.112:0/2957492860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f935015b9d0 0x7f93500b4ec0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.784+0000 7f9357000640 1 -- 172.21.15.112:0/2957492860 >> 172.21.15.112:0/2957492860 conn(0x7f935006bbd0 msgr2=0x7f935006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:32.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.784+0000 7f9357000640 1 -- 172.21.15.112:0/2957492860 shutdown_connections 2024-09-12T02:53:32.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.784+0000 7f9357000640 1 -- 172.21.15.112:0/2957492860 wait complete. 2024-09-12T02:53:32.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.786+0000 7f9357000640 1 Processor -- start 2024-09-12T02:53:32.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.786+0000 7f9357000640 1 -- start start 2024-09-12T02:53:32.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.787+0000 7f9357000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f935006eef0 0x7f935015a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.787+0000 7f9357000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93500b45d0 0x7f93500cef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.787+0000 7f9357000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f935015b9d0 0x7f935015c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.787+0000 7f9357000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f935015bdb0 con 0x7f935006eef0 2024-09-12T02:53:32.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.787+0000 7f9357000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f93500b40b0 con 0x7f935015b9d0 2024-09-12T02:53:32.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.787+0000 7f9357000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f935015bf30 con 0x7f93500b45d0 2024-09-12T02:53:32.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.787+0000 7f934fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f935006eef0 0x7f935015a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:32.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.787+0000 7f934fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f935006eef0 0x7f935015a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41364/0 (socket says 172.21.15.112:41364) 2024-09-12T02:53:32.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.787+0000 7f934fe00640 1 -- 172.21.15.112:0/2938309997 learned_addr learned my addr 172.21.15.112:0/2938309997 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:32.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.787+0000 7f9347400640 1 --2- 172.21.15.112:0/2938309997 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93500b45d0 0x7f93500cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:32.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.787+0000 7f9355000640 1 --2- 172.21.15.112:0/2938309997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f935015b9d0 0x7f935015c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:32.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.787+0000 7f934fe00640 1 -- 172.21.15.112:0/2938309997 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93500b45d0 msgr2=0x7f93500cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:32.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.787+0000 7f934fe00640 1 --2- 172.21.15.112:0/2938309997 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93500b45d0 0x7f93500cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.787+0000 7f934fe00640 1 -- 172.21.15.112:0/2938309997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f935015b9d0 msgr2=0x7f935015c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:32.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.787+0000 7f934fe00640 1 --2- 172.21.15.112:0/2938309997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f935015b9d0 0x7f935015c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:32.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.787+0000 7f934fe00640 1 -- 172.21.15.112:0/2938309997 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93501506a0 con 0x7f935006eef0 2024-09-12T02:53:32.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.787+0000 7f9355000640 1 --2- 172.21.15.112:0/2938309997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f935015b9d0 0x7f935015c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:53:32.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.788+0000 7f934fe00640 1 --2- 172.21.15.112:0/2938309997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f935006eef0 0x7f935015a990 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f9340000c00 tx=0x7f93400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:32.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.788+0000 7f934cc00640 1 -- 172.21.15.112:0/2938309997 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9340041020 con 0x7f935006eef0 2024-09-12T02:53:32.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.788+0000 7f934cc00640 1 -- 172.21.15.112:0/2938309997 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93400306c0 con 0x7f935006eef0 2024-09-12T02:53:32.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.788+0000 7f934cc00640 1 -- 172.21.15.112:0/2938309997 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9340037040 con 0x7f935006eef0 2024-09-12T02:53:32.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.788+0000 7f9357000640 1 -- 172.21.15.112:0/2938309997 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93500cf4a0 con 0x7f935006eef0 2024-09-12T02:53:32.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.788+0000 7f9357000640 1 -- 172.21.15.112:0/2938309997 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9350150940 con 0x7f935006eef0 2024-09-12T02:53:32.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.789+0000 7f9357000640 1 -- 172.21.15.112:0/2938309997 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9350068a30 con 0x7f935006eef0 2024-09-12T02:53:32.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.790+0000 7f934cc00640 1 -- 172.21.15.112:0/2938309997 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9340044020 con 0x7f935006eef0 2024-09-12T02:53:32.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.791+0000 7f934cc00640 1 --2- 172.21.15.112:0/2938309997 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f932c06be30 0x7f932c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:32.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.791+0000 7f934cc00640 1 -- 172.21.15.112:0/2938309997 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(186..186 src has 1..186) ==== 5709+0+0 (secure 0 0 0) 0x7f93400ab6a0 con 0x7f935006eef0 2024-09-12T02:53:32.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.791+0000 7f9347400640 1 --2- 172.21.15.112:0/2938309997 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f932c06be30 0x7f932c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:32.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.792+0000 7f9347400640 1 --2- 172.21.15.112:0/2938309997 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f932c06be30 0x7f932c06e2f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f9350153990 tx=0x7f9338008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:32.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:32.795+0000 7f934cc00640 1 -- 172.21.15.112:0/2938309997 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f934004b030 con 0x7f935006eef0 2024-09-12T02:53:33.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.000+0000 7f9357000640 1 -- 172.21.15.112:0/2938309997 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f93500cfa30 con 0x7f935006eef0 2024-09-12T02:53:33.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.001+0000 7f934cc00640 1 -- 172.21.15.112:0/2938309997 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5233 (secure 0 0 0) 0x7f93500cfa30 con 0x7f935006eef0 2024-09-12T02:53:33.002 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:53:33.002 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":94,"btime":"2024-09-12T02:52:57:752799+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7177,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/119222923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":119222923},{"type":"v1","addr":"172.21.15.112:6837","nonce":119222923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7180,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/691058370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":691058370},{"type":"v1","addr":"172.21.15.137:6834","nonce":691058370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7854,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/1978579863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1978579863},{"type":"v1","addr":"172.21.15.112:6836","nonce":1978579863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:52:54.149640+0000","modified":"2024-09-12T02:52:57.153816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7860},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7860":{"gid":7860,"name":"b","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/1283773082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1283773082},{"type":"v1","addr":"172.21.15.137:6835","nonce":1283773082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7860,"qdb_cluster":[7860]},"id":11}]} 2024-09-12T02:53:33.002 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 94 2024-09-12T02:53:33.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.003+0000 7f9357000640 1 -- 172.21.15.112:0/2938309997 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f932c06be30 msgr2=0x7f932c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:33.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.003+0000 7f9357000640 1 --2- 172.21.15.112:0/2938309997 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f932c06be30 0x7f932c06e2f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f9350153990 tx=0x7f9338008040 comp rx=0 tx=0).stop 2024-09-12T02:53:33.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.003+0000 7f9357000640 1 -- 172.21.15.112:0/2938309997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f935006eef0 msgr2=0x7f935015a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:33.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.003+0000 7f9357000640 1 --2- 172.21.15.112:0/2938309997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f935006eef0 0x7f935015a990 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f9340000c00 tx=0x7f93400046c0 comp rx=0 tx=0).stop 2024-09-12T02:53:33.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.003+0000 7f9357000640 1 -- 172.21.15.112:0/2938309997 shutdown_connections 2024-09-12T02:53:33.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.003+0000 7f9357000640 1 --2- 172.21.15.112:0/2938309997 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f932c06be30 0x7f932c06e2f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:33.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.003+0000 7f9357000640 1 --2- 172.21.15.112:0/2938309997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f935015b9d0 0x7f935015c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:33.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.003+0000 7f9357000640 1 --2- 172.21.15.112:0/2938309997 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f93500b45d0 0x7f93500cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:33.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.003+0000 7f9357000640 1 --2- 172.21.15.112:0/2938309997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f935006eef0 0x7f935015a990 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:33.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.003+0000 7f9357000640 1 -- 172.21.15.112:0/2938309997 >> 172.21.15.112:0/2938309997 conn(0x7f935006bbd0 msgr2=0x7f93500d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:33.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.003+0000 7f9357000640 1 -- 172.21.15.112:0/2938309997 shutdown_connections 2024-09-12T02:53:33.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.003+0000 7f9357000640 1 -- 172.21.15.112:0/2938309997 wait complete. 2024-09-12T02:53:33.020 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:53:33.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.170+0000 7fe434200640 1 Processor -- start 2024-09-12T02:53:33.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.171+0000 7fe434200640 1 -- start start 2024-09-12T02:53:33.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.172+0000 7fe434200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe42c15cc50 0x7fe42c0732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:33.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.172+0000 7fe434200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe42c0afe30 0x7fe42c0cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:33.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.172+0000 7fe434200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe42c073830 con 0x7fe42c071530 2024-09-12T02:53:33.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.172+0000 7fe434200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe42c15d030 con 0x7fe42c15cc50 2024-09-12T02:53:33.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.172+0000 7fe434200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe42c0cf4c0 con 0x7fe42c0afe30 2024-09-12T02:53:33.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.172+0000 7fe431800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe42c15cc50 0x7fe42c0732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:33.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.172+0000 7fe432200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe42c0afe30 0x7fe42c0cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:33.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.172+0000 7fe431800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe42c15cc50 0x7fe42c0732f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:38906/0 (socket says 172.21.15.112:38906) 2024-09-12T02:53:33.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.172+0000 7fe431800640 1 -- 172.21.15.112:0/1229630267 learned_addr learned my addr 172.21.15.112:0/1229630267 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:33.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.172+0000 7fe430e00640 1 --1- 172.21.15.112:0/1229630267 >> v1:172.21.15.137:6789/0 conn(0x7fe42c071530 0x7fe42c0af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.112:33710/0 (socket says 172.21.15.112:33710) 2024-09-12T02:53:33.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.173+0000 7fe431800640 1 -- 172.21.15.112:0/1229630267 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe42c0afe30 msgr2=0x7fe42c0cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:33.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.173+0000 7fe431800640 1 --2- 172.21.15.112:0/1229630267 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe42c0afe30 0x7fe42c0cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:33.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.173+0000 7fe431800640 1 -- 172.21.15.112:0/1229630267 >> v1:172.21.15.137:6789/0 conn(0x7fe42c071530 legacy=0x7fe42c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:33.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.173+0000 7fe431800640 1 -- 172.21.15.112:0/1229630267 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42c0ceeb0 con 0x7fe42c15cc50 2024-09-12T02:53:33.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.173+0000 7fe42be00640 1 -- 172.21.15.112:0/1229630267 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 451325016 0 0) 0x7fe418001160 con 0x7fe42c071530 2024-09-12T02:53:33.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.174+0000 7fe431800640 1 --2- 172.21.15.112:0/1229630267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe42c15cc50 0x7fe42c0732f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe420009870 tx=0x7fe42002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48c2bca8aed8e5a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:33.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.174+0000 7fe42be00640 1 -- 172.21.15.112:0/1229630267 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe420037070 con 0x7fe42c15cc50 2024-09-12T02:53:33.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.174+0000 7fe42be00640 1 -- 172.21.15.112:0/1229630267 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe420032440 con 0x7fe42c15cc50 2024-09-12T02:53:33.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.174+0000 7fe42be00640 1 -- 172.21.15.112:0/1229630267 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe420032810 con 0x7fe42c15cc50 2024-09-12T02:53:33.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.175+0000 7fe434200640 1 -- 172.21.15.112:0/1229630267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe42c15cc50 msgr2=0x7fe42c0732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:33.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.175+0000 7fe434200640 1 --2- 172.21.15.112:0/1229630267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe42c15cc50 0x7fe42c0732f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe420009870 tx=0x7fe42002a1c0 comp rx=0 tx=0).stop 2024-09-12T02:53:33.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.175+0000 7fe434200640 1 -- 172.21.15.112:0/1229630267 shutdown_connections 2024-09-12T02:53:33.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.175+0000 7fe434200640 1 --2- 172.21.15.112:0/1229630267 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe42c0afe30 0x7fe42c0cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:33.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.175+0000 7fe434200640 1 --2- 172.21.15.112:0/1229630267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe42c15cc50 0x7fe42c0732f0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:33.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.175+0000 7fe434200640 1 -- 172.21.15.112:0/1229630267 >> 172.21.15.112:0/1229630267 conn(0x7fe42c06bbd0 msgr2=0x7fe42c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:33.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.175+0000 7fe434200640 1 -- 172.21.15.112:0/1229630267 shutdown_connections 2024-09-12T02:53:33.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.175+0000 7fe434200640 1 -- 172.21.15.112:0/1229630267 wait complete. 2024-09-12T02:53:33.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.176+0000 7fe434200640 1 Processor -- start 2024-09-12T02:53:33.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.177+0000 7fe434200640 1 -- start start 2024-09-12T02:53:33.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.177+0000 7fe434200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe42c071530 0x7fe42c1f4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:33.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.177+0000 7fe434200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe42c0afe30 0x7fe42c153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:33.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.177+0000 7fe434200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe42c15cc50 0x7fe42c1543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:33.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.178+0000 7fe434200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c0cf150 con 0x7fe42c0afe30 2024-09-12T02:53:33.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.178+0000 7fe434200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c06e5e0 con 0x7fe42c071530 2024-09-12T02:53:33.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.178+0000 7fe434200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe42c06f510 con 0x7fe42c15cc50 2024-09-12T02:53:33.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.178+0000 7fe430e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe42c0afe30 0x7fe42c153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:33.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.178+0000 7fe430e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe42c0afe30 0x7fe42c153700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41374/0 (socket says 172.21.15.112:41374) 2024-09-12T02:53:33.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.178+0000 7fe430e00640 1 -- 172.21.15.112:0/1836551190 learned_addr learned my addr 172.21.15.112:0/1836551190 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:33.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.178+0000 7fe431800640 1 --2- 172.21.15.112:0/1836551190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe42c071530 0x7fe42c1f4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:33.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.178+0000 7fe432200640 1 --2- 172.21.15.112:0/1836551190 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe42c15cc50 0x7fe42c1543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:33.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.178+0000 7fe430e00640 1 -- 172.21.15.112:0/1836551190 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe42c15cc50 msgr2=0x7fe42c1543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:33.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.178+0000 7fe430e00640 1 --2- 172.21.15.112:0/1836551190 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe42c15cc50 0x7fe42c1543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:33.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.178+0000 7fe430e00640 1 -- 172.21.15.112:0/1836551190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe42c071530 msgr2=0x7fe42c1f4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:33.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.178+0000 7fe430e00640 1 --2- 172.21.15.112:0/1836551190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe42c071530 0x7fe42c1f4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:33.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.178+0000 7fe430e00640 1 -- 172.21.15.112:0/1836551190 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42c151be0 con 0x7fe42c0afe30 2024-09-12T02:53:33.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.178+0000 7fe432200640 1 --2- 172.21.15.112:0/1836551190 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe42c15cc50 0x7fe42c1543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:53:33.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.178+0000 7fe431800640 1 --2- 172.21.15.112:0/1836551190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe42c071530 0x7fe42c1f4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:53:33.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.179+0000 7fe430e00640 1 --2- 172.21.15.112:0/1836551190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe42c0afe30 0x7fe42c153700 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fe41800c410 tx=0x7fe41800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:33.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.179+0000 7fe429600640 1 -- 172.21.15.112:0/1836551190 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4180074e0 con 0x7fe42c0afe30 2024-09-12T02:53:33.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.179+0000 7fe429600640 1 -- 172.21.15.112:0/1836551190 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe418007680 con 0x7fe42c0afe30 2024-09-12T02:53:33.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.179+0000 7fe429600640 1 -- 172.21.15.112:0/1836551190 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe418004a70 con 0x7fe42c0afe30 2024-09-12T02:53:33.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.179+0000 7fe434200640 1 -- 172.21.15.112:0/1836551190 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe42c151ec0 con 0x7fe42c0afe30 2024-09-12T02:53:33.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.179+0000 7fe434200640 1 -- 172.21.15.112:0/1836551190 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe42c152480 con 0x7fe42c0afe30 2024-09-12T02:53:33.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.180+0000 7fe434200640 1 -- 172.21.15.112:0/1836551190 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe42c0730d0 con 0x7fe42c0afe30 2024-09-12T02:53:33.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.181+0000 7fe429600640 1 -- 172.21.15.112:0/1836551190 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe418011070 con 0x7fe42c0afe30 2024-09-12T02:53:33.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.182+0000 7fe429600640 1 --2- 172.21.15.112:0/1836551190 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe40c06be30 0x7fe40c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:33.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.182+0000 7fe429600640 1 -- 172.21.15.112:0/1836551190 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(186..186 src has 1..186) ==== 5709+0+0 (secure 0 0 0) 0x7fe41808a9d0 con 0x7fe42c0afe30 2024-09-12T02:53:33.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.182+0000 7fe431800640 1 --2- 172.21.15.112:0/1836551190 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe40c06be30 0x7fe40c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:33.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.182+0000 7fe431800640 1 --2- 172.21.15.112:0/1836551190 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe40c06be30 0x7fe40c06e2f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe420034000 tx=0x7fe42002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:33.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.186+0000 7fe429600640 1 -- 172.21.15.112:0/1836551190 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe42c073830 con 0x7fe42c0afe30 2024-09-12T02:53:33.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.395+0000 7fe434200640 1 -- 172.21.15.112:0/1836551190 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe42c0b0ce0 con 0x7fe42c0afe30 2024-09-12T02:53:33.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.395+0000 7fe429600640 1 -- 172.21.15.112:0/1836551190 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5233 (secure 0 0 0) 0x7fe418058c90 con 0x7fe42c0afe30 2024-09-12T02:53:33.396 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:53:33.397 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":94,"btime":"2024-09-12T02:52:57:752799+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7177,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/119222923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":119222923},{"type":"v1","addr":"172.21.15.112:6837","nonce":119222923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7180,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/691058370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":691058370},{"type":"v1","addr":"172.21.15.137:6834","nonce":691058370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7854,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/1978579863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1978579863},{"type":"v1","addr":"172.21.15.112:6836","nonce":1978579863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:52:54.149640+0000","modified":"2024-09-12T02:52:57.153816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7860},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7860":{"gid":7860,"name":"b","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/1283773082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1283773082},{"type":"v1","addr":"172.21.15.137:6835","nonce":1283773082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7860,"qdb_cluster":[7860]},"id":11}]} 2024-09-12T02:53:33.397 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 94 2024-09-12T02:53:33.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.398+0000 7fe434200640 1 -- 172.21.15.112:0/1836551190 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe40c06be30 msgr2=0x7fe40c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:33.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.398+0000 7fe434200640 1 --2- 172.21.15.112:0/1836551190 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe40c06be30 0x7fe40c06e2f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe420034000 tx=0x7fe42002e000 comp rx=0 tx=0).stop 2024-09-12T02:53:33.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.398+0000 7fe434200640 1 -- 172.21.15.112:0/1836551190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe42c0afe30 msgr2=0x7fe42c153700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:33.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.398+0000 7fe434200640 1 --2- 172.21.15.112:0/1836551190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe42c0afe30 0x7fe42c153700 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fe41800c410 tx=0x7fe41800c8d0 comp rx=0 tx=0).stop 2024-09-12T02:53:33.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.398+0000 7fe434200640 1 -- 172.21.15.112:0/1836551190 shutdown_connections 2024-09-12T02:53:33.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.398+0000 7fe434200640 1 --2- 172.21.15.112:0/1836551190 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe42c15cc50 0x7fe42c1543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:33.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.398+0000 7fe434200640 1 --2- 172.21.15.112:0/1836551190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe42c0afe30 0x7fe42c153700 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:33.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.398+0000 7fe434200640 1 --2- 172.21.15.112:0/1836551190 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe40c06be30 0x7fe40c06e2f0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:33.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.398+0000 7fe434200640 1 --2- 172.21.15.112:0/1836551190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe42c071530 0x7fe42c1f4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:33.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.398+0000 7fe434200640 1 -- 172.21.15.112:0/1836551190 >> 172.21.15.112:0/1836551190 conn(0x7fe42c06bbd0 msgr2=0x7fe42c0cf950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:33.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.398+0000 7fe434200640 1 -- 172.21.15.112:0/1836551190 shutdown_connections 2024-09-12T02:53:33.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.398+0000 7fe434200640 1 -- 172.21.15.112:0/1836551190 wait complete. 2024-09-12T02:53:33.414 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:53:33.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.566+0000 7fc730a00640 1 Processor -- start 2024-09-12T02:53:33.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.566+0000 7fc730a00640 1 -- start start 2024-09-12T02:53:33.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.568+0000 7fc730a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc72c15b9d0 0x7fc72c0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:33.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.568+0000 7fc730a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc72c0b45d0 0x7fc72c0728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:33.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.568+0000 7fc730a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc72c0b54a0 con 0x7fc72c06eef0 2024-09-12T02:53:33.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.568+0000 7fc730a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc72c0b4a60 con 0x7fc72c15b9d0 2024-09-12T02:53:33.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.568+0000 7fc730a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc72c0b3af0 con 0x7fc72c0b45d0 2024-09-12T02:53:33.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.568+0000 7fc729e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc72c15b9d0 0x7fc72c0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:33.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.568+0000 7fc72a800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc72c06eef0 0x7fc72c06f300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33150/0 (socket says 172.21.15.112:33150) 2024-09-12T02:53:33.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.568+0000 7fc72a800640 1 -- 172.21.15.112:0/1011190114 learned_addr learned my addr 172.21.15.112:0/1011190114 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:53:33.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.568+0000 7fc721400640 1 --2- 172.21.15.112:0/1011190114 >> v2:172.21.15.137:3300/0 conn(0x7fc72c0b45d0 0x7fc72c0728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:33.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.568+0000 7fc729e00640 1 -- 172.21.15.112:0/1011190114 >> v2:172.21.15.137:3300/0 conn(0x7fc72c0b45d0 msgr2=0x7fc72c0728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:33.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.568+0000 7fc729e00640 1 --2- 172.21.15.112:0/1011190114 >> v2:172.21.15.137:3300/0 conn(0x7fc72c0b45d0 0x7fc72c0728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:33.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.568+0000 7fc729e00640 1 -- 172.21.15.112:0/1011190114 >> v1:172.21.15.112:6789/0 conn(0x7fc72c06eef0 legacy=0x7fc72c06f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:33.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.568+0000 7fc729e00640 1 -- 172.21.15.112:0/1011190114 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc72c0b3dd0 con 0x7fc72c15b9d0 2024-09-12T02:53:33.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.568+0000 7fc721400640 1 --2- 172.21.15.112:0/1011190114 >> v2:172.21.15.137:3300/0 conn(0x7fc72c0b45d0 0x7fc72c0728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:53:33.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.568+0000 7fc729400640 1 -- 172.21.15.112:0/1011190114 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2425795761 0 0) 0x7fc72c0b54a0 con 0x7fc72c06eef0 2024-09-12T02:53:33.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.569+0000 7fc729e00640 1 --2- 172.21.15.112:0/1011190114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72c15b9d0 0x7fc72c0b4ec0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fc72c068670 tx=0x7fc71c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b292b15caf2c1d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:33.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.570+0000 7fc729400640 1 -- 172.21.15.112:0/1011190114 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc71c037070 con 0x7fc72c15b9d0 2024-09-12T02:53:33.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.570+0000 7fc729400640 1 -- 172.21.15.112:0/1011190114 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc71c032440 con 0x7fc72c15b9d0 2024-09-12T02:53:33.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.570+0000 7fc729400640 1 -- 172.21.15.112:0/1011190114 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc71c02ae60 con 0x7fc72c15b9d0 2024-09-12T02:53:33.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.570+0000 7fc730a00640 1 -- 172.21.15.112:0/1011190114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72c15b9d0 msgr2=0x7fc72c0b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:33.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.570+0000 7fc730a00640 1 --2- 172.21.15.112:0/1011190114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72c15b9d0 0x7fc72c0b4ec0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fc72c068670 tx=0x7fc71c02a110 comp rx=0 tx=0).stop 2024-09-12T02:53:33.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.570+0000 7fc730a00640 1 -- 172.21.15.112:0/1011190114 shutdown_connections 2024-09-12T02:53:33.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.570+0000 7fc730a00640 1 --2- 172.21.15.112:0/1011190114 >> v2:172.21.15.137:3300/0 conn(0x7fc72c0b45d0 0x7fc72c0728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:33.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.570+0000 7fc730a00640 1 --2- 172.21.15.112:0/1011190114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72c15b9d0 0x7fc72c0b4ec0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:33.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.570+0000 7fc730a00640 1 -- 172.21.15.112:0/1011190114 >> 172.21.15.112:0/1011190114 conn(0x7fc72c06bbd0 msgr2=0x7fc72c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:33.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.570+0000 7fc730a00640 1 -- 172.21.15.112:0/1011190114 shutdown_connections 2024-09-12T02:53:33.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.570+0000 7fc730a00640 1 -- 172.21.15.112:0/1011190114 wait complete. 2024-09-12T02:53:33.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.572+0000 7fc730a00640 1 Processor -- start 2024-09-12T02:53:33.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.572+0000 7fc730a00640 1 -- start start 2024-09-12T02:53:33.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.573+0000 7fc730a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc72c06eef0 0x7fc72c14f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:33.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.573+0000 7fc730a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc72c0b45d0 0x7fc72c152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:33.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.573+0000 7fc730a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72c15b9d0 0x7fc72c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:33.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.573+0000 7fc730a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc72c15bf30 con 0x7fc72c15b9d0 2024-09-12T02:53:33.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.573+0000 7fc730a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc72c15bdb0 con 0x7fc72c0b45d0 2024-09-12T02:53:33.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.573+0000 7fc730a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc72c0cdcd0 con 0x7fc72c06eef0 2024-09-12T02:53:33.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.573+0000 7fc72a800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72c15b9d0 0x7fc72c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:33.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.573+0000 7fc72a800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72c15b9d0 0x7fc72c15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41398/0 (socket says 172.21.15.112:41398) 2024-09-12T02:53:33.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.573+0000 7fc72a800640 1 -- 172.21.15.112:0/2386661295 learned_addr learned my addr 172.21.15.112:0/2386661295 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:33.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.573+0000 7fc721400640 1 --2- 172.21.15.112:0/2386661295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc72c0b45d0 0x7fc72c152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:33.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.573+0000 7fc72a800640 1 -- 172.21.15.112:0/2386661295 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc72c06eef0 msgr2=0x7fc72c14f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:33.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.573+0000 7fc72a800640 1 --2- 172.21.15.112:0/2386661295 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc72c06eef0 0x7fc72c14f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:33.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.573+0000 7fc72a800640 1 -- 172.21.15.112:0/2386661295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc72c0b45d0 msgr2=0x7fc72c152970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:33.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.573+0000 7fc72a800640 1 --2- 172.21.15.112:0/2386661295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc72c0b45d0 0x7fc72c152970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:33.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.573+0000 7fc72a800640 1 -- 172.21.15.112:0/2386661295 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc72c0cd030 con 0x7fc72c15b9d0 2024-09-12T02:53:33.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.574+0000 7fc721400640 1 --2- 172.21.15.112:0/2386661295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc72c0b45d0 0x7fc72c152970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:53:33.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.574+0000 7fc72a800640 1 --2- 172.21.15.112:0/2386661295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72c15b9d0 0x7fc72c15d5d0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fc72400c7a0 tx=0x7fc72400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:33.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.574+0000 7fc722a00640 1 -- 172.21.15.112:0/2386661295 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc724018070 con 0x7fc72c15b9d0 2024-09-12T02:53:33.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.574+0000 7fc722a00640 1 -- 172.21.15.112:0/2386661295 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc72400a640 con 0x7fc72c15b9d0 2024-09-12T02:53:33.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.574+0000 7fc722a00640 1 -- 172.21.15.112:0/2386661295 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72400aab0 con 0x7fc72c15b9d0 2024-09-12T02:53:33.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.574+0000 7fc730a00640 1 -- 172.21.15.112:0/2386661295 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc72c0cd310 con 0x7fc72c15b9d0 2024-09-12T02:53:33.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.574+0000 7fc730a00640 1 -- 172.21.15.112:0/2386661295 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc72c150910 con 0x7fc72c15b9d0 2024-09-12T02:53:33.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.575+0000 7fc730a00640 1 -- 172.21.15.112:0/2386661295 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc72c068a30 con 0x7fc72c15b9d0 2024-09-12T02:53:33.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.576+0000 7fc722a00640 1 -- 172.21.15.112:0/2386661295 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc72401b070 con 0x7fc72c15b9d0 2024-09-12T02:53:33.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.577+0000 7fc722a00640 1 --2- 172.21.15.112:0/2386661295 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc70806be30 0x7fc70806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:33.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.577+0000 7fc722a00640 1 -- 172.21.15.112:0/2386661295 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(186..186 src has 1..186) ==== 5709+0+0 (secure 0 0 0) 0x7fc72408a530 con 0x7fc72c15b9d0 2024-09-12T02:53:33.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.577+0000 7fc729e00640 1 --2- 172.21.15.112:0/2386661295 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc70806be30 0x7fc70806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:33.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.578+0000 7fc729e00640 1 --2- 172.21.15.112:0/2386661295 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc70806be30 0x7fc70806e2f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc71c034000 tx=0x7fc71c02c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:33.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.581+0000 7fc722a00640 1 -- 172.21.15.112:0/2386661295 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc724058e40 con 0x7fc72c15b9d0 2024-09-12T02:53:33.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.758+0000 7fc730a00640 1 -- 172.21.15.112:0/2386661295 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc72c06dbc0 con 0x7fc72c15b9d0 2024-09-12T02:53:33.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.759+0000 7fc722a00640 1 -- 172.21.15.112:0/2386661295 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) ==== 74+0+16787 (secure 0 0 0) 0x7fc724058740 con 0x7fc72c15b9d0 2024-09-12T02:53:33.761 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:53:33.761 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":186,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:53:26.068138+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:52:51.909503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-12T02:52:53.146578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:53:33.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.762+0000 7fc730a00640 1 -- 172.21.15.112:0/2386661295 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc70806be30 msgr2=0x7fc70806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:33.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.762+0000 7fc730a00640 1 --2- 172.21.15.112:0/2386661295 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc70806be30 0x7fc70806e2f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc71c034000 tx=0x7fc71c02c000 comp rx=0 tx=0).stop 2024-09-12T02:53:33.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.762+0000 7fc730a00640 1 -- 172.21.15.112:0/2386661295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72c15b9d0 msgr2=0x7fc72c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:33.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.762+0000 7fc730a00640 1 --2- 172.21.15.112:0/2386661295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72c15b9d0 0x7fc72c15d5d0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fc72400c7a0 tx=0x7fc72400cc60 comp rx=0 tx=0).stop 2024-09-12T02:53:33.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.762+0000 7fc730a00640 1 -- 172.21.15.112:0/2386661295 shutdown_connections 2024-09-12T02:53:33.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.762+0000 7fc730a00640 1 --2- 172.21.15.112:0/2386661295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72c15b9d0 0x7fc72c15d5d0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:33.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.762+0000 7fc730a00640 1 --2- 172.21.15.112:0/2386661295 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fc70806be30 0x7fc70806e2f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:33.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.762+0000 7fc730a00640 1 --2- 172.21.15.112:0/2386661295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc72c0b45d0 0x7fc72c152970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:33.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.762+0000 7fc730a00640 1 --2- 172.21.15.112:0/2386661295 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc72c06eef0 0x7fc72c14f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:33.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.762+0000 7fc730a00640 1 -- 172.21.15.112:0/2386661295 >> 172.21.15.112:0/2386661295 conn(0x7fc72c06bbd0 msgr2=0x7fc72c0cf980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:33.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.762+0000 7fc730a00640 1 -- 172.21.15.112:0/2386661295 shutdown_connections 2024-09-12T02:53:33.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.762+0000 7fc730a00640 1 -- 172.21.15.112:0/2386661295 wait complete. 2024-09-12T02:53:33.779 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:53:33.779 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:53:33.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.930+0000 7f9b30400640 1 Processor -- start 2024-09-12T02:53:33.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.930+0000 7f9b30400640 1 -- start start 2024-09-12T02:53:33.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.932+0000 7f9b30400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b2806f600 0x7f9b280b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:33.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.932+0000 7f9b30400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9b280b45d0 0x7f9b280728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:33.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.932+0000 7f9b30400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b280b4a20 con 0x7f9b2815b9d0 2024-09-12T02:53:33.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.932+0000 7f9b30400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f9b280b54a0 con 0x7f9b280b45d0 2024-09-12T02:53:33.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.932+0000 7f9b30400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9b280b3af0 con 0x7f9b2806f600 2024-09-12T02:53:33.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.932+0000 7f9b2da00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f9b2815b9d0 0x7f9b2806eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33162/0 (socket says 172.21.15.112:33162) 2024-09-12T02:53:33.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.932+0000 7f9b2da00640 1 -- 172.21.15.112:0/745223713 learned_addr learned my addr 172.21.15.112:0/745223713 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:53:33.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.932+0000 7f9b2e400640 1 --2- 172.21.15.112:0/745223713 >> v2:172.21.15.137:3300/0 conn(0x7f9b280b45d0 0x7f9b280728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:33.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.932+0000 7f9b2d000640 1 --2- 172.21.15.112:0/745223713 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b2806f600 0x7f9b280b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:33.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.932+0000 7f9b27e00640 1 -- 172.21.15.112:0/745223713 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 922127956 0 0) 0x7f9b280b4a20 con 0x7f9b2815b9d0 2024-09-12T02:53:33.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.932+0000 7f9b27e00640 1 -- 172.21.15.112:0/745223713 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b10003520 con 0x7f9b2815b9d0 2024-09-12T02:53:33.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.933+0000 7f9b2e400640 1 -- 172.21.15.112:0/745223713 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b2806f600 msgr2=0x7f9b280b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:33.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.933+0000 7f9b2e400640 1 --2- 172.21.15.112:0/745223713 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b2806f600 0x7f9b280b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:33.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.933+0000 7f9b2e400640 1 -- 172.21.15.112:0/745223713 >> v1:172.21.15.112:6789/0 conn(0x7f9b2815b9d0 legacy=0x7f9b2806eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:33.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.933+0000 7f9b2e400640 1 -- 172.21.15.112:0/745223713 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b280b3dd0 con 0x7f9b280b45d0 2024-09-12T02:53:33.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.934+0000 7f9b2e400640 1 --2- 172.21.15.112:0/745223713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b280b45d0 0x7f9b280728c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f9b20009d90 tx=0x7f9b2002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc5b8d4a8bc7ab4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:33.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.934+0000 7f9b27e00640 1 -- 172.21.15.112:0/745223713 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20007740 con 0x7f9b280b45d0 2024-09-12T02:53:33.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.934+0000 7f9b27e00640 1 -- 172.21.15.112:0/745223713 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b200078e0 con 0x7f9b280b45d0 2024-09-12T02:53:33.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.934+0000 7f9b27e00640 1 -- 172.21.15.112:0/745223713 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20007c90 con 0x7f9b280b45d0 2024-09-12T02:53:33.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.934+0000 7f9b30400640 1 -- 172.21.15.112:0/745223713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b280b45d0 msgr2=0x7f9b280728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:33.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.934+0000 7f9b30400640 1 --2- 172.21.15.112:0/745223713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b280b45d0 0x7f9b280728c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f9b20009d90 tx=0x7f9b2002a660 comp rx=0 tx=0).stop 2024-09-12T02:53:33.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.935+0000 7f9b30400640 1 -- 172.21.15.112:0/745223713 shutdown_connections 2024-09-12T02:53:33.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.935+0000 7f9b30400640 1 --2- 172.21.15.112:0/745223713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b280b45d0 0x7f9b280728c0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:33.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.935+0000 7f9b30400640 1 --2- 172.21.15.112:0/745223713 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b2806f600 0x7f9b280b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:33.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.935+0000 7f9b30400640 1 -- 172.21.15.112:0/745223713 >> 172.21.15.112:0/745223713 conn(0x7f9b2806bbd0 msgr2=0x7f9b2806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:33.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.935+0000 7f9b30400640 1 -- 172.21.15.112:0/745223713 shutdown_connections 2024-09-12T02:53:33.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.935+0000 7f9b30400640 1 -- 172.21.15.112:0/745223713 wait complete. 2024-09-12T02:53:33.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.936+0000 7f9b30400640 1 Processor -- start 2024-09-12T02:53:33.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.936+0000 7f9b30400640 1 -- start start 2024-09-12T02:53:33.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.937+0000 7f9b30400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b2806f600 0x7f9b281564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:33.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.937+0000 7f9b30400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b280b45d0 0x7f9b281569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:33.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.937+0000 7f9b30400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b2815b9d0 0x7f9b281f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:33.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.937+0000 7f9b30400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2815bf30 con 0x7f9b280b45d0 2024-09-12T02:53:33.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.937+0000 7f9b30400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2815bdb0 con 0x7f9b2815b9d0 2024-09-12T02:53:33.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.937+0000 7f9b30400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9b280cdcd0 con 0x7f9b2806f600 2024-09-12T02:53:33.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.937+0000 7f9b2d000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b280b45d0 0x7f9b281569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:33.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.937+0000 7f9b2d000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b280b45d0 0x7f9b281569f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41414/0 (socket says 172.21.15.112:41414) 2024-09-12T02:53:33.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.937+0000 7f9b2d000640 1 -- 172.21.15.112:0/2079399983 learned_addr learned my addr 172.21.15.112:0/2079399983 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:33.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.938+0000 7f9b2da00640 1 --2- 172.21.15.112:0/2079399983 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b2806f600 0x7f9b281564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:33.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.938+0000 7f9b2e400640 1 --2- 172.21.15.112:0/2079399983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b2815b9d0 0x7f9b281f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:33.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.938+0000 7f9b2d000640 1 -- 172.21.15.112:0/2079399983 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b2806f600 msgr2=0x7f9b281564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:33.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.938+0000 7f9b2d000640 1 --2- 172.21.15.112:0/2079399983 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b2806f600 0x7f9b281564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:33.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.938+0000 7f9b2d000640 1 -- 172.21.15.112:0/2079399983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b2815b9d0 msgr2=0x7f9b281f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:33.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.938+0000 7f9b2d000640 1 --2- 172.21.15.112:0/2079399983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b2815b9d0 0x7f9b281f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:33.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.938+0000 7f9b2d000640 1 -- 172.21.15.112:0/2079399983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b28157020 con 0x7f9b280b45d0 2024-09-12T02:53:33.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.938+0000 7f9b2da00640 1 --2- 172.21.15.112:0/2079399983 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b2806f600 0x7f9b281564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:53:33.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.938+0000 7f9b2d000640 1 --2- 172.21.15.112:0/2079399983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b280b45d0 0x7f9b281569f0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400e930 tx=0x7f9b1400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:33.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.938+0000 7f9b25600640 1 -- 172.21.15.112:0/2079399983 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b14017070 con 0x7f9b280b45d0 2024-09-12T02:53:33.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.938+0000 7f9b25600640 1 -- 172.21.15.112:0/2079399983 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b1400ca00 con 0x7f9b280b45d0 2024-09-12T02:53:33.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.938+0000 7f9b25600640 1 -- 172.21.15.112:0/2079399983 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1400cdb0 con 0x7f9b280b45d0 2024-09-12T02:53:33.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.938+0000 7f9b30400640 1 -- 172.21.15.112:0/2079399983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b28157300 con 0x7f9b280b45d0 2024-09-12T02:53:33.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.938+0000 7f9b30400640 1 -- 172.21.15.112:0/2079399983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b281578c0 con 0x7f9b280b45d0 2024-09-12T02:53:33.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.940+0000 7f9b30400640 1 -- 172.21.15.112:0/2079399983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b28068a30 con 0x7f9b280b45d0 2024-09-12T02:53:33.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.940+0000 7f9b25600640 1 -- 172.21.15.112:0/2079399983 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9b1401a070 con 0x7f9b280b45d0 2024-09-12T02:53:33.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.941+0000 7f9b25600640 1 --2- 172.21.15.112:0/2079399983 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9b0806be30 0x7f9b0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:33.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.941+0000 7f9b25600640 1 -- 172.21.15.112:0/2079399983 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(186..186 src has 1..186) ==== 5709+0+0 (secure 0 0 0) 0x7f9b1408b2f0 con 0x7f9b280b45d0 2024-09-12T02:53:33.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.941+0000 7f9b2da00640 1 --2- 172.21.15.112:0/2079399983 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9b0806be30 0x7f9b0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:33.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.942+0000 7f9b2da00640 1 --2- 172.21.15.112:0/2079399983 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9b0806be30 0x7f9b0806e2f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c007fd0 tx=0x7f9b1c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:33.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:33.945+0000 7f9b25600640 1 -- 172.21.15.112:0/2079399983 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9b14059cc0 con 0x7f9b280b45d0 2024-09-12T02:53:34.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.153+0000 7f9b30400640 1 -- 172.21.15.112:0/2079399983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b2806dbc0 con 0x7f9b280b45d0 2024-09-12T02:53:34.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.154+0000 7f9b25600640 1 -- 172.21.15.112:0/2079399983 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5233 (secure 0 0 0) 0x7f9b140595c0 con 0x7f9b280b45d0 2024-09-12T02:53:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:53:34.155 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":94,"btime":"2024-09-12T02:52:57:752799+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7177,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/119222923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":119222923},{"type":"v1","addr":"172.21.15.112:6837","nonce":119222923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7180,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/691058370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":691058370},{"type":"v1","addr":"172.21.15.137:6834","nonce":691058370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7854,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/1978579863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1978579863},{"type":"v1","addr":"172.21.15.112:6836","nonce":1978579863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:52:54.149640+0000","modified":"2024-09-12T02:52:57.153816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7860},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7860":{"gid":7860,"name":"b","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/1283773082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1283773082},{"type":"v1","addr":"172.21.15.137:6835","nonce":1283773082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7860,"qdb_cluster":[7860]},"id":11}]} 2024-09-12T02:53:34.155 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 94 2024-09-12T02:53:34.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.156+0000 7f9b30400640 1 -- 172.21.15.112:0/2079399983 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9b0806be30 msgr2=0x7f9b0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:34.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.156+0000 7f9b30400640 1 --2- 172.21.15.112:0/2079399983 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9b0806be30 0x7f9b0806e2f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c007fd0 tx=0x7f9b1c009040 comp rx=0 tx=0).stop 2024-09-12T02:53:34.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.156+0000 7f9b30400640 1 -- 172.21.15.112:0/2079399983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b280b45d0 msgr2=0x7f9b281569f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:34.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.156+0000 7f9b30400640 1 --2- 172.21.15.112:0/2079399983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b280b45d0 0x7f9b281569f0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400e930 tx=0x7f9b1400edf0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.156+0000 7f9b30400640 1 -- 172.21.15.112:0/2079399983 shutdown_connections 2024-09-12T02:53:34.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.156+0000 7f9b30400640 1 --2- 172.21.15.112:0/2079399983 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f9b0806be30 0x7f9b0806e2f0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.156+0000 7f9b30400640 1 --2- 172.21.15.112:0/2079399983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b2815b9d0 0x7f9b281f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.156+0000 7f9b30400640 1 --2- 172.21.15.112:0/2079399983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b280b45d0 0x7f9b281569f0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.156+0000 7f9b30400640 1 --2- 172.21.15.112:0/2079399983 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b2806f600 0x7f9b281564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.156+0000 7f9b30400640 1 -- 172.21.15.112:0/2079399983 >> 172.21.15.112:0/2079399983 conn(0x7f9b2806bbd0 msgr2=0x7f9b280b56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:34.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.156+0000 7f9b30400640 1 -- 172.21.15.112:0/2079399983 shutdown_connections 2024-09-12T02:53:34.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.156+0000 7f9b30400640 1 -- 172.21.15.112:0/2079399983 wait complete. 2024-09-12T02:53:34.173 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:53:34.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.324+0000 7f3ee2a00640 1 Processor -- start 2024-09-12T02:53:34.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.324+0000 7f3ee2a00640 1 -- start start 2024-09-12T02:53:34.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.326+0000 7f3ee2a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3edc06f600 0x7f3edc0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:34.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.326+0000 7f3ee2a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3edc0b45d0 0x7f3edc0728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:34.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.326+0000 7f3ee2a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3edc0b4a20 con 0x7f3edc15b9d0 2024-09-12T02:53:34.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.326+0000 7f3ee2a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f3edc0b54a0 con 0x7f3edc06f600 2024-09-12T02:53:34.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.326+0000 7f3ee2a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3edc0b3af0 con 0x7f3edc0b45d0 2024-09-12T02:53:34.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.326+0000 7f3edbe00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f3edc15b9d0 0x7f3edc06eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33164/0 (socket says 172.21.15.112:33164) 2024-09-12T02:53:34.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.326+0000 7f3edbe00640 1 -- 172.21.15.112:0/508720122 learned_addr learned my addr 172.21.15.112:0/508720122 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:53:34.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.326+0000 7f3ed3400640 1 --2- 172.21.15.112:0/508720122 >> v2:172.21.15.112:3300/0 conn(0x7f3edc06f600 0x7f3edc0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:34.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.326+0000 7f3ee0a00640 1 --2- 172.21.15.112:0/508720122 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3edc0b45d0 0x7f3edc0728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:34.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.326+0000 7f3edb400640 1 -- 172.21.15.112:0/508720122 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2054621700 0 0) 0x7f3edc0b4a20 con 0x7f3edc15b9d0 2024-09-12T02:53:34.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.326+0000 7f3edb400640 1 -- 172.21.15.112:0/508720122 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ec0003520 con 0x7f3edc15b9d0 2024-09-12T02:53:34.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.326+0000 7f3ed3400640 1 -- 172.21.15.112:0/508720122 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3edc0b45d0 msgr2=0x7f3edc0728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:34.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.326+0000 7f3ed3400640 1 --2- 172.21.15.112:0/508720122 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3edc0b45d0 0x7f3edc0728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.326+0000 7f3ed3400640 1 -- 172.21.15.112:0/508720122 >> v1:172.21.15.112:6789/0 conn(0x7f3edc15b9d0 legacy=0x7f3edc06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:34.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.326+0000 7f3ed3400640 1 -- 172.21.15.112:0/508720122 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3edc0b3dd0 con 0x7f3edc06f600 2024-09-12T02:53:34.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.327+0000 7f3ed3400640 1 --2- 172.21.15.112:0/508720122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3edc06f600 0x7f3edc0b4ec0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4009790 tx=0x7f3ec402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf92836b59d4770 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:34.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.328+0000 7f3edb400640 1 -- 172.21.15.112:0/508720122 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4037070 con 0x7f3edc06f600 2024-09-12T02:53:34.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.328+0000 7f3edb400640 1 -- 172.21.15.112:0/508720122 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ec4032440 con 0x7f3edc06f600 2024-09-12T02:53:34.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.328+0000 7f3edb400640 1 -- 172.21.15.112:0/508720122 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4032810 con 0x7f3edc06f600 2024-09-12T02:53:34.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.328+0000 7f3ee2a00640 1 -- 172.21.15.112:0/508720122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3edc06f600 msgr2=0x7f3edc0b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:34.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.328+0000 7f3ee2a00640 1 --2- 172.21.15.112:0/508720122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3edc06f600 0x7f3edc0b4ec0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4009790 tx=0x7f3ec402a180 comp rx=0 tx=0).stop 2024-09-12T02:53:34.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.328+0000 7f3ee2a00640 1 -- 172.21.15.112:0/508720122 shutdown_connections 2024-09-12T02:53:34.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.328+0000 7f3ee2a00640 1 --2- 172.21.15.112:0/508720122 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3edc0b45d0 0x7f3edc0728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.328+0000 7f3ee2a00640 1 --2- 172.21.15.112:0/508720122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3edc06f600 0x7f3edc0b4ec0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.328+0000 7f3ee2a00640 1 -- 172.21.15.112:0/508720122 >> 172.21.15.112:0/508720122 conn(0x7f3edc06bbd0 msgr2=0x7f3edc06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:34.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.328+0000 7f3ee2a00640 1 -- 172.21.15.112:0/508720122 shutdown_connections 2024-09-12T02:53:34.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.328+0000 7f3ee2a00640 1 -- 172.21.15.112:0/508720122 wait complete. 2024-09-12T02:53:34.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.330+0000 7f3ee2a00640 1 Processor -- start 2024-09-12T02:53:34.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.330+0000 7f3ee2a00640 1 -- start start 2024-09-12T02:53:34.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.331+0000 7f3ee2a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3edc06f600 0x7f3edc153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:34.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.331+0000 7f3ee2a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3edc0b45d0 0x7f3edc14c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:34.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.331+0000 7f3ee2a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3edc15b9d0 0x7f3edc14e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:34.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.331+0000 7f3ee2a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3edc15bf30 con 0x7f3edc15b9d0 2024-09-12T02:53:34.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.331+0000 7f3ee2a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3edc15bdb0 con 0x7f3edc0b45d0 2024-09-12T02:53:34.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.331+0000 7f3ee2a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3edc0cdcd0 con 0x7f3edc06f600 2024-09-12T02:53:34.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.331+0000 7f3ee0a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3edc15b9d0 0x7f3edc14e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:34.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.331+0000 7f3ee0a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3edc15b9d0 0x7f3edc14e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41430/0 (socket says 172.21.15.112:41430) 2024-09-12T02:53:34.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.331+0000 7f3ee0a00640 1 -- 172.21.15.112:0/2758552333 learned_addr learned my addr 172.21.15.112:0/2758552333 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:34.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.332+0000 7f3edbe00640 1 --2- 172.21.15.112:0/2758552333 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3edc06f600 0x7f3edc153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:34.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.332+0000 7f3ed3400640 1 --2- 172.21.15.112:0/2758552333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3edc0b45d0 0x7f3edc14c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:34.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.332+0000 7f3ee0a00640 1 -- 172.21.15.112:0/2758552333 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3edc06f600 msgr2=0x7f3edc153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:34.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.332+0000 7f3ee0a00640 1 --2- 172.21.15.112:0/2758552333 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3edc06f600 0x7f3edc153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.332+0000 7f3ee0a00640 1 -- 172.21.15.112:0/2758552333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3edc0b45d0 msgr2=0x7f3edc14c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:34.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.332+0000 7f3ee0a00640 1 --2- 172.21.15.112:0/2758552333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3edc0b45d0 0x7f3edc14c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.332+0000 7f3ee0a00640 1 -- 172.21.15.112:0/2758552333 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3edc14cd30 con 0x7f3edc15b9d0 2024-09-12T02:53:34.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.332+0000 7f3edbe00640 1 --2- 172.21.15.112:0/2758552333 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3edc06f600 0x7f3edc153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:53:34.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.332+0000 7f3ed3400640 1 --2- 172.21.15.112:0/2758552333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3edc0b45d0 0x7f3edc14c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:53:34.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.332+0000 7f3ee0a00640 1 --2- 172.21.15.112:0/2758552333 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3edc15b9d0 0x7f3edc14e490 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4007e40 tx=0x7f3ed400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:34.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.332+0000 7f3ed8c00640 1 -- 172.21.15.112:0/2758552333 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4014620 con 0x7f3edc15b9d0 2024-09-12T02:53:34.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.332+0000 7f3ed8c00640 1 -- 172.21.15.112:0/2758552333 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed4019070 con 0x7f3edc15b9d0 2024-09-12T02:53:34.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.332+0000 7f3ed8c00640 1 -- 172.21.15.112:0/2758552333 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4014a20 con 0x7f3edc15b9d0 2024-09-12T02:53:34.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.332+0000 7f3ee2a00640 1 -- 172.21.15.112:0/2758552333 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3edc14d010 con 0x7f3edc15b9d0 2024-09-12T02:53:34.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.332+0000 7f3ee2a00640 1 -- 172.21.15.112:0/2758552333 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3edc14d5d0 con 0x7f3edc15b9d0 2024-09-12T02:53:34.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.333+0000 7f3ee2a00640 1 -- 172.21.15.112:0/2758552333 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3edc06dbc0 con 0x7f3edc15b9d0 2024-09-12T02:53:34.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.334+0000 7f3ed8c00640 1 -- 172.21.15.112:0/2758552333 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3ed4014bc0 con 0x7f3edc15b9d0 2024-09-12T02:53:34.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.335+0000 7f3ed8c00640 1 --2- 172.21.15.112:0/2758552333 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3eb806be30 0x7f3eb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:34.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.335+0000 7f3ed8c00640 1 -- 172.21.15.112:0/2758552333 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(186..186 src has 1..186) ==== 5709+0+0 (secure 0 0 0) 0x7f3ed408b780 con 0x7f3edc15b9d0 2024-09-12T02:53:34.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.335+0000 7f3edbe00640 1 --2- 172.21.15.112:0/2758552333 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3eb806be30 0x7f3eb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:34.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.336+0000 7f3edbe00640 1 --2- 172.21.15.112:0/2758552333 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3eb806be30 0x7f3eb806e2f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc005880 tx=0x7f3ecc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:34.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.339+0000 7f3ed8c00640 1 -- 172.21.15.112:0/2758552333 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3ed405a120 con 0x7f3edc15b9d0 2024-09-12T02:53:34.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.545+0000 7f3ee2a00640 1 -- 172.21.15.112:0/2758552333 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3edc0763b0 con 0x7f3edc15b9d0 2024-09-12T02:53:34.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.545+0000 7f3ed8c00640 1 -- 172.21.15.112:0/2758552333 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5233 (secure 0 0 0) 0x7f3ed4059a20 con 0x7f3edc15b9d0 2024-09-12T02:53:34.546 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:53:34.546 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":94,"btime":"2024-09-12T02:52:57:752799+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7177,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/119222923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":119222923},{"type":"v1","addr":"172.21.15.112:6837","nonce":119222923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7180,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/691058370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":691058370},{"type":"v1","addr":"172.21.15.137:6834","nonce":691058370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7854,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/1978579863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1978579863},{"type":"v1","addr":"172.21.15.112:6836","nonce":1978579863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:52:54.149640+0000","modified":"2024-09-12T02:52:57.153816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7860},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7860":{"gid":7860,"name":"b","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6835/1283773082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":1283773082},{"type":"v1","addr":"172.21.15.137:6835","nonce":1283773082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7860,"qdb_cluster":[7860]},"id":11}]} 2024-09-12T02:53:34.546 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 94 2024-09-12T02:53:34.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.547+0000 7f3ee2a00640 1 -- 172.21.15.112:0/2758552333 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3eb806be30 msgr2=0x7f3eb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:34.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.547+0000 7f3ee2a00640 1 --2- 172.21.15.112:0/2758552333 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3eb806be30 0x7f3eb806e2f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc005880 tx=0x7f3ecc009040 comp rx=0 tx=0).stop 2024-09-12T02:53:34.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.547+0000 7f3ee2a00640 1 -- 172.21.15.112:0/2758552333 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3edc15b9d0 msgr2=0x7f3edc14e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:34.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.547+0000 7f3ee2a00640 1 --2- 172.21.15.112:0/2758552333 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3edc15b9d0 0x7f3edc14e490 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4007e40 tx=0x7f3ed400e4b0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.547+0000 7f3ee2a00640 1 -- 172.21.15.112:0/2758552333 shutdown_connections 2024-09-12T02:53:34.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.547+0000 7f3ee2a00640 1 --2- 172.21.15.112:0/2758552333 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3edc15b9d0 0x7f3edc14e490 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.547+0000 7f3ee2a00640 1 --2- 172.21.15.112:0/2758552333 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3eb806be30 0x7f3eb806e2f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.547+0000 7f3ee2a00640 1 --2- 172.21.15.112:0/2758552333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3edc0b45d0 0x7f3edc14c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.547+0000 7f3ee2a00640 1 --2- 172.21.15.112:0/2758552333 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3edc06f600 0x7f3edc153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.547+0000 7f3ee2a00640 1 -- 172.21.15.112:0/2758552333 >> 172.21.15.112:0/2758552333 conn(0x7f3edc06bbd0 msgr2=0x7f3edc0b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:34.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.547+0000 7f3ee2a00640 1 -- 172.21.15.112:0/2758552333 shutdown_connections 2024-09-12T02:53:34.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.547+0000 7f3ee2a00640 1 -- 172.21.15.112:0/2758552333 wait complete. 2024-09-12T02:53:34.564 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:53:34.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.716+0000 7f8f96000640 1 Processor -- start 2024-09-12T02:53:34.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.716+0000 7f8f96000640 1 -- start start 2024-09-12T02:53:34.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.717+0000 7f8f96000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8f90162100 0x7f8f900d58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:34.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.717+0000 7f8f96000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8f901624e0 0x7f8f900b4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:34.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.717+0000 7f8f96000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f900cfa70 con 0x7f8f900d0510 2024-09-12T02:53:34.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.717+0000 7f8f96000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8f900d21d0 con 0x7f8f901624e0 2024-09-12T02:53:34.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.717+0000 7f8f96000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8f900d24b0 con 0x7f8f90162100 2024-09-12T02:53:34.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.717+0000 7f8f8fe00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8f900d0510 0x7f8f900d0940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33178/0 (socket says 172.21.15.112:33178) 2024-09-12T02:53:34.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.717+0000 7f8f8fe00640 1 -- 172.21.15.112:0/1736473382 learned_addr learned my addr 172.21.15.112:0/1736473382 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:53:34.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.718+0000 7f8f8f400640 1 --2- 172.21.15.112:0/1736473382 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8f90162100 0x7f8f900d58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:34.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.718+0000 7f8f8ea00640 1 --2- 172.21.15.112:0/1736473382 >> v2:172.21.15.137:3300/0 conn(0x7f8f901624e0 0x7f8f900b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:34.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.718+0000 7f8f8e000640 1 -- 172.21.15.112:0/1736473382 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1065499061 0 0) 0x7f8f900cfa70 con 0x7f8f900d0510 2024-09-12T02:53:34.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.718+0000 7f8f8e000640 1 -- 172.21.15.112:0/1736473382 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f74003520 con 0x7f8f900d0510 2024-09-12T02:53:34.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.718+0000 7f8f8f400640 1 -- 172.21.15.112:0/1736473382 >> v2:172.21.15.137:3300/0 conn(0x7f8f901624e0 msgr2=0x7f8f900b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:34.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.718+0000 7f8f8f400640 1 --2- 172.21.15.112:0/1736473382 >> v2:172.21.15.137:3300/0 conn(0x7f8f901624e0 0x7f8f900b4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.718+0000 7f8f8f400640 1 -- 172.21.15.112:0/1736473382 >> v1:172.21.15.112:6789/0 conn(0x7f8f900d0510 legacy=0x7f8f900d0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:34.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.718+0000 7f8f8f400640 1 -- 172.21.15.112:0/1736473382 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f900cfd10 con 0x7f8f90162100 2024-09-12T02:53:34.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.719+0000 7f8f8f400640 1 --2- 172.21.15.112:0/1736473382 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8f90162100 0x7f8f900d58d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8f900cfc40 tx=0x7f8f8002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a76a4539c64c58 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:34.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.719+0000 7f8f8e000640 1 -- 172.21.15.112:0/1736473382 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f80037070 con 0x7f8f90162100 2024-09-12T02:53:34.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.719+0000 7f8f8e000640 1 -- 172.21.15.112:0/1736473382 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f8002ae50 con 0x7f8f90162100 2024-09-12T02:53:34.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.719+0000 7f8f8e000640 1 -- 172.21.15.112:0/1736473382 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f80032640 con 0x7f8f90162100 2024-09-12T02:53:34.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.720+0000 7f8f96000640 1 -- 172.21.15.112:0/1736473382 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8f90162100 msgr2=0x7f8f900d58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:34.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.720+0000 7f8f96000640 1 --2- 172.21.15.112:0/1736473382 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8f90162100 0x7f8f900d58d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8f900cfc40 tx=0x7f8f8002a100 comp rx=0 tx=0).stop 2024-09-12T02:53:34.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.720+0000 7f8f96000640 1 -- 172.21.15.112:0/1736473382 shutdown_connections 2024-09-12T02:53:34.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.720+0000 7f8f96000640 1 --2- 172.21.15.112:0/1736473382 >> v2:172.21.15.137:3300/0 conn(0x7f8f901624e0 0x7f8f900b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.720+0000 7f8f96000640 1 --2- 172.21.15.112:0/1736473382 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8f90162100 0x7f8f900d58d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.720+0000 7f8f96000640 1 -- 172.21.15.112:0/1736473382 >> 172.21.15.112:0/1736473382 conn(0x7f8f900d4db0 msgr2=0x7f8f900d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:34.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.720+0000 7f8f96000640 1 -- 172.21.15.112:0/1736473382 shutdown_connections 2024-09-12T02:53:34.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.720+0000 7f8f96000640 1 -- 172.21.15.112:0/1736473382 wait complete. 2024-09-12T02:53:34.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.722+0000 7f8f96000640 1 Processor -- start 2024-09-12T02:53:34.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.722+0000 7f8f96000640 1 -- start start 2024-09-12T02:53:34.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.723+0000 7f8f96000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f900d0510 0x7f8f900b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:34.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.723+0000 7f8f96000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8f90162100 0x7f8f90150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:34.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.723+0000 7f8f96000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f901624e0 0x7f8f9006d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:34.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.723+0000 7f8f96000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8f900d1f70 con 0x7f8f900d0510 2024-09-12T02:53:34.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.723+0000 7f8f96000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8f900d1df0 con 0x7f8f901624e0 2024-09-12T02:53:34.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.723+0000 7f8f96000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8f90162b80 con 0x7f8f90162100 2024-09-12T02:53:34.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.723+0000 7f8f8f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f900d0510 0x7f8f900b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:34.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.723+0000 7f8f8f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f900d0510 0x7f8f900b52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41436/0 (socket says 172.21.15.112:41436) 2024-09-12T02:53:34.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.723+0000 7f8f8f400640 1 -- 172.21.15.112:0/3721923724 learned_addr learned my addr 172.21.15.112:0/3721923724 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:34.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.723+0000 7f8f8ea00640 1 --2- 172.21.15.112:0/3721923724 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8f90162100 0x7f8f90150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:34.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.723+0000 7f8f8fe00640 1 --2- 172.21.15.112:0/3721923724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f901624e0 0x7f8f9006d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:34.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.723+0000 7f8f8f400640 1 -- 172.21.15.112:0/3721923724 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8f90162100 msgr2=0x7f8f90150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:34.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.723+0000 7f8f8f400640 1 --2- 172.21.15.112:0/3721923724 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8f90162100 0x7f8f90150290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.723+0000 7f8f8f400640 1 -- 172.21.15.112:0/3721923724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f901624e0 msgr2=0x7f8f9006d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:34.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.723+0000 7f8f8f400640 1 --2- 172.21.15.112:0/3721923724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f901624e0 0x7f8f9006d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.723+0000 7f8f8f400640 1 -- 172.21.15.112:0/3721923724 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f900b6720 con 0x7f8f900d0510 2024-09-12T02:53:34.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.723+0000 7f8f8fe00640 1 --2- 172.21.15.112:0/3721923724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f901624e0 0x7f8f9006d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:53:34.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.724+0000 7f8f8f400640 1 --2- 172.21.15.112:0/3721923724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f900d0510 0x7f8f900b52b0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f8f8002a140 tx=0x7f8f800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:34.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.724+0000 7f8f87400640 1 -- 172.21.15.112:0/3721923724 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f80037050 con 0x7f8f900d0510 2024-09-12T02:53:34.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.724+0000 7f8f87400640 1 -- 172.21.15.112:0/3721923724 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f80043070 con 0x7f8f900d0510 2024-09-12T02:53:34.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.724+0000 7f8f87400640 1 -- 172.21.15.112:0/3721923724 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8003e670 con 0x7f8f900d0510 2024-09-12T02:53:34.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.724+0000 7f8f96000640 1 -- 172.21.15.112:0/3721923724 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f900b6a00 con 0x7f8f900d0510 2024-09-12T02:53:34.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.724+0000 7f8f96000640 1 -- 172.21.15.112:0/3721923724 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f900b6fc0 con 0x7f8f900d0510 2024-09-12T02:53:34.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.725+0000 7f8f96000640 1 -- 172.21.15.112:0/3721923724 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f900d58d0 con 0x7f8f900d0510 2024-09-12T02:53:34.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.726+0000 7f8f87400640 1 -- 172.21.15.112:0/3721923724 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8f8003e810 con 0x7f8f900d0510 2024-09-12T02:53:34.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.727+0000 7f8f87400640 1 --2- 172.21.15.112:0/3721923724 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8f7006be60 0x7f8f7006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:34.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.727+0000 7f8f87400640 1 -- 172.21.15.112:0/3721923724 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(186..186 src has 1..186) ==== 5709+0+0 (secure 0 0 0) 0x7f8f800ab800 con 0x7f8f900d0510 2024-09-12T02:53:34.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.727+0000 7f8f8ea00640 1 --2- 172.21.15.112:0/3721923724 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8f7006be60 0x7f8f7006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:34.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.728+0000 7f8f8ea00640 1 --2- 172.21.15.112:0/3721923724 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8f7006be60 0x7f8f7006e320 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8f901566e0 tx=0x7f8f7c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:34.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.731+0000 7f8f87400640 1 -- 172.21.15.112:0/3721923724 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8f8007a110 con 0x7f8f900d0510 2024-09-12T02:53:34.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.907+0000 7f8f96000640 1 -- 172.21.15.112:0/3721923724 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8f90161bb0 con 0x7f8f900d0510 2024-09-12T02:53:34.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.908+0000 7f8f87400640 1 -- 172.21.15.112:0/3721923724 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) ==== 74+0+16787 (secure 0 0 0) 0x7f8f80079a10 con 0x7f8f900d0510 2024-09-12T02:53:34.910 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:53:34.910 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":186,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:53:26.068138+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:52:51.909503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-12T02:52:53.146578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:53:34.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.910+0000 7f8f96000640 1 -- 172.21.15.112:0/3721923724 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8f7006be60 msgr2=0x7f8f7006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:34.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.910+0000 7f8f96000640 1 --2- 172.21.15.112:0/3721923724 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8f7006be60 0x7f8f7006e320 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8f901566e0 tx=0x7f8f7c008040 comp rx=0 tx=0).stop 2024-09-12T02:53:34.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.910+0000 7f8f96000640 1 -- 172.21.15.112:0/3721923724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f900d0510 msgr2=0x7f8f900b52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:34.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.910+0000 7f8f96000640 1 --2- 172.21.15.112:0/3721923724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f900d0510 0x7f8f900b52b0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f8f8002a140 tx=0x7f8f800046c0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.910+0000 7f8f96000640 1 -- 172.21.15.112:0/3721923724 shutdown_connections 2024-09-12T02:53:34.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.910+0000 7f8f96000640 1 --2- 172.21.15.112:0/3721923724 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8f7006be60 0x7f8f7006e320 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.910+0000 7f8f96000640 1 --2- 172.21.15.112:0/3721923724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f901624e0 0x7f8f9006d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.910+0000 7f8f96000640 1 --2- 172.21.15.112:0/3721923724 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8f90162100 0x7f8f90150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.910+0000 7f8f96000640 1 --2- 172.21.15.112:0/3721923724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f900d0510 0x7f8f900b52b0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:34.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.910+0000 7f8f96000640 1 -- 172.21.15.112:0/3721923724 >> 172.21.15.112:0/3721923724 conn(0x7f8f900d4db0 msgr2=0x7f8f900b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:34.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.911+0000 7f8f96000640 1 -- 172.21.15.112:0/3721923724 shutdown_connections 2024-09-12T02:53:34.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:34.911+0000 7f8f96000640 1 -- 172.21.15.112:0/3721923724 wait complete. 2024-09-12T02:53:34.927 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T02:53:35.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.080+0000 7f6cac000640 1 Processor -- start 2024-09-12T02:53:35.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.080+0000 7f6cac000640 1 -- start start 2024-09-12T02:53:35.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.081+0000 7f6cac000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6ca415b9d0 0x7f6ca40b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:35.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.081+0000 7f6cac000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ca40b45d0 0x7f6ca40728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:35.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.081+0000 7f6cac000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ca406eef0 0x7f6ca406f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:35.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.081+0000 7f6cac000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f6ca40b4a60 con 0x7f6ca40b45d0 2024-09-12T02:53:35.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.081+0000 7f6cac000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6ca406f860 con 0x7f6ca415b9d0 2024-09-12T02:53:35.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.081+0000 7f6cac000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6ca40b54a0 con 0x7f6ca406eef0 2024-09-12T02:53:35.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.081+0000 7f6ca8c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ca40b45d0 0x7f6ca40728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:35.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.082+0000 7f6ca8c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ca40b45d0 0x7f6ca40728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41444/0 (socket says 172.21.15.112:41444) 2024-09-12T02:53:35.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.082+0000 7f6ca8c00640 1 -- 172.21.15.112:0/1948671262 learned_addr learned my addr 172.21.15.112:0/1948671262 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:35.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.082+0000 7f6caa000640 1 --2- 172.21.15.112:0/1948671262 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ca406eef0 0x7f6ca406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:35.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.082+0000 7f6ca9600640 1 --2- 172.21.15.112:0/1948671262 >> v2:172.21.15.137:3300/0 conn(0x7f6ca415b9d0 0x7f6ca40b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:35.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.082+0000 7f6ca8c00640 1 -- 172.21.15.112:0/1948671262 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ca406eef0 msgr2=0x7f6ca406f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:35.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.082+0000 7f6ca8c00640 1 --2- 172.21.15.112:0/1948671262 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ca406eef0 0x7f6ca406f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:35.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.082+0000 7f6ca8c00640 1 -- 172.21.15.112:0/1948671262 >> v2:172.21.15.137:3300/0 conn(0x7f6ca415b9d0 msgr2=0x7f6ca40b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:35.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.082+0000 7f6ca8c00640 1 --2- 172.21.15.112:0/1948671262 >> v2:172.21.15.137:3300/0 conn(0x7f6ca415b9d0 0x7f6ca40b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:35.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.082+0000 7f6ca8c00640 1 -- 172.21.15.112:0/1948671262 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca40b3af0 con 0x7f6ca40b45d0 2024-09-12T02:53:35.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.082+0000 7f6ca9600640 1 --2- 172.21.15.112:0/1948671262 >> v2:172.21.15.137:3300/0 conn(0x7f6ca415b9d0 0x7f6ca40b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:53:35.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.083+0000 7f6ca8c00640 1 --2- 172.21.15.112:0/1948671262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca40b45d0 0x7f6ca40728c0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f6ca406d230 tx=0x7f6c9002a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e2d818ae272e9f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:35.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.083+0000 7f6ca3e00640 1 -- 172.21.15.112:0/1948671262 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c90004030 con 0x7f6ca40b45d0 2024-09-12T02:53:35.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.083+0000 7f6ca3e00640 1 -- 172.21.15.112:0/1948671262 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c900041d0 con 0x7f6ca40b45d0 2024-09-12T02:53:35.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.083+0000 7f6ca3e00640 1 -- 172.21.15.112:0/1948671262 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c90003610 con 0x7f6ca40b45d0 2024-09-12T02:53:35.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.084+0000 7f6cac000640 1 -- 172.21.15.112:0/1948671262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca40b45d0 msgr2=0x7f6ca40728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:35.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.084+0000 7f6cac000640 1 --2- 172.21.15.112:0/1948671262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca40b45d0 0x7f6ca40728c0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f6ca406d230 tx=0x7f6c9002a1f0 comp rx=0 tx=0).stop 2024-09-12T02:53:35.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.084+0000 7f6cac000640 1 -- 172.21.15.112:0/1948671262 shutdown_connections 2024-09-12T02:53:35.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.084+0000 7f6cac000640 1 --2- 172.21.15.112:0/1948671262 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ca406eef0 0x7f6ca406f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:35.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.084+0000 7f6cac000640 1 --2- 172.21.15.112:0/1948671262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca40b45d0 0x7f6ca40728c0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:35.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.084+0000 7f6cac000640 1 --2- 172.21.15.112:0/1948671262 >> v2:172.21.15.137:3300/0 conn(0x7f6ca415b9d0 0x7f6ca40b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:35.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.084+0000 7f6cac000640 1 -- 172.21.15.112:0/1948671262 >> 172.21.15.112:0/1948671262 conn(0x7f6ca406bbd0 msgr2=0x7f6ca406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:35.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.084+0000 7f6cac000640 1 -- 172.21.15.112:0/1948671262 shutdown_connections 2024-09-12T02:53:35.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.084+0000 7f6cac000640 1 -- 172.21.15.112:0/1948671262 wait complete. 2024-09-12T02:53:35.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.085+0000 7f6cac000640 1 Processor -- start 2024-09-12T02:53:35.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.086+0000 7f6cac000640 1 -- start start 2024-09-12T02:53:35.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.086+0000 7f6cac000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca406eef0 0x7f6ca4150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:35.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.086+0000 7f6cac000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ca40b45d0 0x7f6ca40b1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:35.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.086+0000 7f6cac000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ca415b9d0 0x7f6ca40b16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:35.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.086+0000 7f6cac000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca415bdb0 con 0x7f6ca406eef0 2024-09-12T02:53:35.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.086+0000 7f6cac000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca40b40b0 con 0x7f6ca40b45d0 2024-09-12T02:53:35.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.086+0000 7f6cac000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6ca415bf30 con 0x7f6ca415b9d0 2024-09-12T02:53:35.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.087+0000 7f6ca9600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca406eef0 0x7f6ca4150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:35.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.087+0000 7f6ca9600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca406eef0 0x7f6ca4150560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41446/0 (socket says 172.21.15.112:41446) 2024-09-12T02:53:35.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.087+0000 7f6ca9600640 1 -- 172.21.15.112:0/1044696581 learned_addr learned my addr 172.21.15.112:0/1044696581 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:35.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.087+0000 7f6caa000640 1 --2- 172.21.15.112:0/1044696581 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ca415b9d0 0x7f6ca40b16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:35.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.087+0000 7f6ca8c00640 1 --2- 172.21.15.112:0/1044696581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ca40b45d0 0x7f6ca40b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:35.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.087+0000 7f6ca9600640 1 -- 172.21.15.112:0/1044696581 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ca415b9d0 msgr2=0x7f6ca40b16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:35.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.087+0000 7f6ca9600640 1 --2- 172.21.15.112:0/1044696581 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ca415b9d0 0x7f6ca40b16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:35.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.087+0000 7f6ca9600640 1 -- 172.21.15.112:0/1044696581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ca40b45d0 msgr2=0x7f6ca40b1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:35.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.087+0000 7f6ca9600640 1 --2- 172.21.15.112:0/1044696581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ca40b45d0 0x7f6ca40b1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:35.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.087+0000 7f6ca9600640 1 -- 172.21.15.112:0/1044696581 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca415c1a0 con 0x7f6ca406eef0 2024-09-12T02:53:35.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.088+0000 7f6ca9600640 1 --2- 172.21.15.112:0/1044696581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca406eef0 0x7f6ca4150560 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800d800 tx=0x7f6c9800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:35.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.088+0000 7f6ca1600640 1 -- 172.21.15.112:0/1044696581 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c98004030 con 0x7f6ca406eef0 2024-09-12T02:53:35.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.088+0000 7f6ca1600640 1 -- 172.21.15.112:0/1044696581 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c980041d0 con 0x7f6ca406eef0 2024-09-12T02:53:35.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.088+0000 7f6cac000640 1 -- 172.21.15.112:0/1044696581 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ca4152c90 con 0x7f6ca406eef0 2024-09-12T02:53:35.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.088+0000 7f6ca1600640 1 -- 172.21.15.112:0/1044696581 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9800b6c0 con 0x7f6ca406eef0 2024-09-12T02:53:35.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.088+0000 7f6cac000640 1 -- 172.21.15.112:0/1044696581 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ca415c410 con 0x7f6ca406eef0 2024-09-12T02:53:35.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.089+0000 7f6cac000640 1 -- 172.21.15.112:0/1044696581 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ca4068a30 con 0x7f6ca406eef0 2024-09-12T02:53:35.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.090+0000 7f6ca1600640 1 -- 172.21.15.112:0/1044696581 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c9800b860 con 0x7f6ca406eef0 2024-09-12T02:53:35.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.091+0000 7f6ca1600640 1 --2- 172.21.15.112:0/1044696581 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6c8406be30 0x7f6c8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:35.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.091+0000 7f6ca1600640 1 -- 172.21.15.112:0/1044696581 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(186..186 src has 1..186) ==== 5709+0+0 (secure 0 0 0) 0x7f6c9808aff0 con 0x7f6ca406eef0 2024-09-12T02:53:35.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.091+0000 7f6ca8c00640 1 --2- 172.21.15.112:0/1044696581 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6c8406be30 0x7f6c8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:35.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.092+0000 7f6ca8c00640 1 --2- 172.21.15.112:0/1044696581 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6c8406be30 0x7f6c8406e2f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f6c90033000 tx=0x7f6c9002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:35.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.095+0000 7f6ca1600640 1 -- 172.21.15.112:0/1044696581 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6c98059240 con 0x7f6ca406eef0 2024-09-12T02:53:35.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.305+0000 7f6cac000640 1 -- 172.21.15.112:0/1044696581 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6ca406f320 con 0x7f6ca406eef0 2024-09-12T02:53:35.306 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-12T02:53:35.305+0000 7f0216c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:53:35.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.307+0000 7f6ca1600640 1 -- 172.21.15.112:0/1044696581 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v95) ==== 161+0+0 (secure 0 0 0) 0x7f6c9805d540 con 0x7f6ca406eef0 2024-09-12T02:53:35.308 INFO:teuthology.orchestra.run.smithi112.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:53:35.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.311+0000 7f6cac000640 1 -- 172.21.15.112:0/1044696581 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6c8406be30 msgr2=0x7f6c8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:35.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.311+0000 7f6cac000640 1 --2- 172.21.15.112:0/1044696581 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6c8406be30 0x7f6c8406e2f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f6c90033000 tx=0x7f6c9002e000 comp rx=0 tx=0).stop 2024-09-12T02:53:35.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.311+0000 7f6cac000640 1 -- 172.21.15.112:0/1044696581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca406eef0 msgr2=0x7f6ca4150560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:35.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.311+0000 7f6cac000640 1 --2- 172.21.15.112:0/1044696581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca406eef0 0x7f6ca4150560 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800d800 tx=0x7f6c9800dcc0 comp rx=0 tx=0).stop 2024-09-12T02:53:35.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.311+0000 7f6cac000640 1 -- 172.21.15.112:0/1044696581 shutdown_connections 2024-09-12T02:53:35.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.311+0000 7f6cac000640 1 --2- 172.21.15.112:0/1044696581 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ca415b9d0 0x7f6ca40b16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:35.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.311+0000 7f6cac000640 1 --2- 172.21.15.112:0/1044696581 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f6c8406be30 0x7f6c8406e2f0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:35.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.311+0000 7f6cac000640 1 --2- 172.21.15.112:0/1044696581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ca40b45d0 0x7f6ca40b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:35.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.311+0000 7f6cac000640 1 --2- 172.21.15.112:0/1044696581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca406eef0 0x7f6ca4150560 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:35.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.311+0000 7f6cac000640 1 -- 172.21.15.112:0/1044696581 >> 172.21.15.112:0/1044696581 conn(0x7f6ca406bbd0 msgr2=0x7f6ca4072820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:35.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.312+0000 7f6cac000640 1 -- 172.21.15.112:0/1044696581 shutdown_connections 2024-09-12T02:53:35.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.312+0000 7f6cac000640 1 -- 172.21.15.112:0/1044696581 wait complete. 2024-09-12T02:53:35.323 INFO:tasks.ceph.mds.b.smithi137.stderr: -9635> 2024-09-12T02:53:00.335+0000 7f8281000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:53:35.330 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T02:53:35.379 INFO:tasks.ceph.mds.b.smithi137.stdout:starting mds.b at 2024-09-12T02:53:35.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.483+0000 7f3e16400640 1 Processor -- start 2024-09-12T02:53:35.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.483+0000 7f3e16400640 1 -- start start 2024-09-12T02:53:35.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.484+0000 7f3e16400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e100b3e00 0x7f3e100d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:35.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.484+0000 7f3e16400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3e100b1d70 0x7f3e100b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:35.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.484+0000 7f3e16400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e100d2fb0 con 0x7f3e100d1710 2024-09-12T02:53:35.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.484+0000 7f3e16400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3e100d3cb0 con 0x7f3e100b1d70 2024-09-12T02:53:35.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.484+0000 7f3e16400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3e100d0b60 con 0x7f3e100b3e00 2024-09-12T02:53:35.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.484+0000 7f3e15000640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f3e100d1710 0x7f3e100d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33194/0 (socket says 172.21.15.112:33194) 2024-09-12T02:53:35.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.484+0000 7f3e15000640 1 -- 172.21.15.112:0/787465393 learned_addr learned my addr 172.21.15.112:0/787465393 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:53:35.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.485+0000 7f3e15a00640 1 --2- 172.21.15.112:0/787465393 >> v2:172.21.15.137:3300/0 conn(0x7f3e100b1d70 0x7f3e100b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:35.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.485+0000 7f3e07e00640 1 --2- 172.21.15.112:0/787465393 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e100b3e00 0x7f3e100d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:35.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.485+0000 7f3e0fe00640 1 -- 172.21.15.112:0/787465393 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 92714647 0 0) 0x7f3e100d2fb0 con 0x7f3e100d1710 2024-09-12T02:53:35.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.485+0000 7f3e0fe00640 1 -- 172.21.15.112:0/787465393 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3df4003520 con 0x7f3e100d1710 2024-09-12T02:53:35.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.485+0000 7f3e15a00640 1 -- 172.21.15.112:0/787465393 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e100b3e00 msgr2=0x7f3e100d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:35.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.485+0000 7f3e15a00640 1 --2- 172.21.15.112:0/787465393 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e100b3e00 0x7f3e100d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:35.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.485+0000 7f3e15a00640 1 -- 172.21.15.112:0/787465393 >> v1:172.21.15.112:6789/0 conn(0x7f3e100d1710 legacy=0x7f3e100d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:35.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.485+0000 7f3e15a00640 1 -- 172.21.15.112:0/787465393 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e100d3410 con 0x7f3e100b1d70 2024-09-12T02:53:35.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.485+0000 7f3e07e00640 1 --2- 172.21.15.112:0/787465393 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e100b3e00 0x7f3e100d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:53:35.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.486+0000 7f3e15a00640 1 --2- 172.21.15.112:0/787465393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e100b1d70 0x7f3e100b2200 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009d90 tx=0x7f3e0802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b3be79586d2cf4d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:35.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.486+0000 7f3e0fe00640 1 -- 172.21.15.112:0/787465393 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e08007740 con 0x7f3e100b1d70 2024-09-12T02:53:35.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.486+0000 7f3e0fe00640 1 -- 172.21.15.112:0/787465393 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e080078e0 con 0x7f3e100b1d70 2024-09-12T02:53:35.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.486+0000 7f3e0fe00640 1 -- 172.21.15.112:0/787465393 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e08007cb0 con 0x7f3e100b1d70 2024-09-12T02:53:35.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.487+0000 7f3e16400640 1 -- 172.21.15.112:0/787465393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e100b1d70 msgr2=0x7f3e100b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:35.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.487+0000 7f3e16400640 1 --2- 172.21.15.112:0/787465393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e100b1d70 0x7f3e100b2200 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009d90 tx=0x7f3e0802a660 comp rx=0 tx=0).stop 2024-09-12T02:53:35.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.487+0000 7f3e16400640 1 -- 172.21.15.112:0/787465393 shutdown_connections 2024-09-12T02:53:35.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.487+0000 7f3e16400640 1 --2- 172.21.15.112:0/787465393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e100b1d70 0x7f3e100b2200 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:35.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.487+0000 7f3e16400640 1 --2- 172.21.15.112:0/787465393 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e100b3e00 0x7f3e100d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:35.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.487+0000 7f3e16400640 1 -- 172.21.15.112:0/787465393 >> 172.21.15.112:0/787465393 conn(0x7f3e1009e030 msgr2=0x7f3e100d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:35.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.487+0000 7f3e16400640 1 -- 172.21.15.112:0/787465393 shutdown_connections 2024-09-12T02:53:35.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.487+0000 7f3e16400640 1 -- 172.21.15.112:0/787465393 wait complete. 2024-09-12T02:53:35.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.489+0000 7f3e16400640 1 Processor -- start 2024-09-12T02:53:35.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.489+0000 7f3e16400640 1 -- start start 2024-09-12T02:53:35.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.490+0000 7f3e16400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e100b1d70 0x7f3e101594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:35.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.490+0000 7f3e16400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e100b3e00 0x7f3e1014ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:35.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.490+0000 7f3e16400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e100d1710 0x7f3e101f4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:35.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.490+0000 7f3e16400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1015f110 con 0x7f3e100d1710 2024-09-12T02:53:35.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.490+0000 7f3e16400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3e100d39d0 con 0x7f3e100b1d70 2024-09-12T02:53:35.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.490+0000 7f3e16400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3e1015f290 con 0x7f3e100b3e00 2024-09-12T02:53:35.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.490+0000 7f3e15a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e100d1710 0x7f3e101f4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:35.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.490+0000 7f3e15a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e100d1710 0x7f3e101f4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41454/0 (socket says 172.21.15.112:41454) 2024-09-12T02:53:35.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.490+0000 7f3e15a00640 1 -- 172.21.15.112:0/3663534536 learned_addr learned my addr 172.21.15.112:0/3663534536 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:35.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.490+0000 7f3e15000640 1 --2- 172.21.15.112:0/3663534536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e100b1d70 0x7f3e101594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:35.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.490+0000 7f3e07e00640 1 --2- 172.21.15.112:0/3663534536 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e100b3e00 0x7f3e1014ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:35.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.491+0000 7f3e15a00640 1 -- 172.21.15.112:0/3663534536 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e100b3e00 msgr2=0x7f3e1014ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:35.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.491+0000 7f3e15a00640 1 --2- 172.21.15.112:0/3663534536 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e100b3e00 0x7f3e1014ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:35.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.491+0000 7f3e15a00640 1 -- 172.21.15.112:0/3663534536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e100b1d70 msgr2=0x7f3e101594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:35.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.491+0000 7f3e15a00640 1 --2- 172.21.15.112:0/3663534536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e100b1d70 0x7f3e101594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:35.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.491+0000 7f3e15a00640 1 -- 172.21.15.112:0/3663534536 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e100c9ae0 con 0x7f3e100d1710 2024-09-12T02:53:35.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.491+0000 7f3e15a00640 1 --2- 172.21.15.112:0/3663534536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e100d1710 0x7f3e101f4a00 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009eb0 tx=0x7f3e08004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:35.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.491+0000 7f3e0d600640 1 -- 172.21.15.112:0/3663534536 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e08040070 con 0x7f3e100d1710 2024-09-12T02:53:35.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.491+0000 7f3e0d600640 1 -- 172.21.15.112:0/3663534536 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e08031bc0 con 0x7f3e100d1710 2024-09-12T02:53:35.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.491+0000 7f3e16400640 1 -- 172.21.15.112:0/3663534536 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e100ca470 con 0x7f3e100d1710 2024-09-12T02:53:35.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.491+0000 7f3e0d600640 1 -- 172.21.15.112:0/3663534536 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e08009450 con 0x7f3e100d1710 2024-09-12T02:53:35.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.491+0000 7f3e16400640 1 -- 172.21.15.112:0/3663534536 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e100c9d80 con 0x7f3e100d1710 2024-09-12T02:53:35.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.493+0000 7f3e16400640 1 -- 172.21.15.112:0/3663534536 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e100d28d0 con 0x7f3e100d1710 2024-09-12T02:53:35.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.493+0000 7f3e0d600640 1 -- 172.21.15.112:0/3663534536 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e08039040 con 0x7f3e100d1710 2024-09-12T02:53:35.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.494+0000 7f3e0d600640 1 --2- 172.21.15.112:0/3663534536 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3dec06be30 0x7f3dec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:35.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.494+0000 7f3e0d600640 1 -- 172.21.15.112:0/3663534536 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5795+0+0 (secure 0 0 0) 0x7f3e080ac630 con 0x7f3e100d1710 2024-09-12T02:53:35.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.494+0000 7f3e15000640 1 --2- 172.21.15.112:0/3663534536 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3dec06be30 0x7f3dec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:35.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.495+0000 7f3e15000640 1 --2- 172.21.15.112:0/3663534536 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3dec06be30 0x7f3dec06e2f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3e00005880 tx=0x7f3e00009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:35.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.499+0000 7f3e0d600640 1 -- 172.21.15.112:0/3663534536 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3e0807b010 con 0x7f3e100d1710 2024-09-12T02:53:35.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:35.708+0000 7f3e16400640 1 -- 172.21.15.112:0/3663534536 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3e1006d840 con 0x7f3e100d1710 2024-09-12T02:53:36.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.311+0000 7f3e0d600640 1 -- 172.21.15.112:0/3663534536 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v96) ==== 104+0+0 (secure 0 0 0) 0x7f3e0807a910 con 0x7f3e100d1710 2024-09-12T02:53:36.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.314+0000 7f3e16400640 1 -- 172.21.15.112:0/3663534536 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3dec06be30 msgr2=0x7f3dec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:36.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.314+0000 7f3e16400640 1 --2- 172.21.15.112:0/3663534536 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3dec06be30 0x7f3dec06e2f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3e00005880 tx=0x7f3e00009040 comp rx=0 tx=0).stop 2024-09-12T02:53:36.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.314+0000 7f3e16400640 1 -- 172.21.15.112:0/3663534536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e100d1710 msgr2=0x7f3e101f4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:36.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.314+0000 7f3e16400640 1 --2- 172.21.15.112:0/3663534536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e100d1710 0x7f3e101f4a00 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009eb0 tx=0x7f3e08004a40 comp rx=0 tx=0).stop 2024-09-12T02:53:36.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.314+0000 7f3e16400640 1 -- 172.21.15.112:0/3663534536 shutdown_connections 2024-09-12T02:53:36.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.314+0000 7f3e16400640 1 --2- 172.21.15.112:0/3663534536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e100d1710 0x7f3e101f4a00 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.314+0000 7f3e16400640 1 --2- 172.21.15.112:0/3663534536 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e100b3e00 0x7f3e1014ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.314+0000 7f3e16400640 1 --2- 172.21.15.112:0/3663534536 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f3dec06be30 0x7f3dec06e2f0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.314+0000 7f3e16400640 1 --2- 172.21.15.112:0/3663534536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e100b1d70 0x7f3e101594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.314+0000 7f3e16400640 1 -- 172.21.15.112:0/3663534536 >> 172.21.15.112:0/3663534536 conn(0x7f3e1009e030 msgr2=0x7f3e100d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:36.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.314+0000 7f3e16400640 1 -- 172.21.15.112:0/3663534536 shutdown_connections 2024-09-12T02:53:36.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.314+0000 7f3e16400640 1 -- 172.21.15.112:0/3663534536 wait complete. 2024-09-12T02:53:36.331 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T02:53:36.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.487+0000 7f8fffc00640 1 Processor -- start 2024-09-12T02:53:36.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.487+0000 7f8fffc00640 1 -- start start 2024-09-12T02:53:36.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.489+0000 7f8fffc00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8ff80d3270 0x7f8ff80cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:36.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.489+0000 7f8fffc00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ff815f400 con 0x7f8ff815f020 2024-09-12T02:53:36.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.489+0000 7f8fffc00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ff806d680 con 0x7f8ff80d02f0 2024-09-12T02:53:36.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.489+0000 7f8fffc00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8ff806d460 con 0x7f8ff80d3270 2024-09-12T02:53:36.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.489+0000 7f8ffd200640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8ff815f020 0x7f8ff806cd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33208/0 (socket says 172.21.15.112:33208) 2024-09-12T02:53:36.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.489+0000 7f8ffd200640 1 -- 172.21.15.112:0/2384234807 learned_addr learned my addr 172.21.15.112:0/2384234807 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:53:36.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.489+0000 7f8ffdc00640 1 --2- 172.21.15.112:0/2384234807 >> v2:172.21.15.137:3300/0 conn(0x7f8ff80d3270 0x7f8ff80cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:36.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.489+0000 7f8ff7e00640 1 -- 172.21.15.112:0/2384234807 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3603457631 0 0) 0x7f8ff815f400 con 0x7f8ff815f020 2024-09-12T02:53:36.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.489+0000 7f8ff7e00640 1 -- 172.21.15.112:0/2384234807 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fdc003520 con 0x7f8ff815f020 2024-09-12T02:53:36.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.490+0000 7f8ffdc00640 1 -- 172.21.15.112:0/2384234807 >> v1:172.21.15.137:6789/0 conn(0x7f8ff80d02f0 legacy=0x7f8ff80d2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:36.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.490+0000 7f8ffdc00640 1 -- 172.21.15.112:0/2384234807 >> v1:172.21.15.112:6789/0 conn(0x7f8ff815f020 legacy=0x7f8ff806cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:36.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.490+0000 7f8ff7e00640 1 -- 172.21.15.112:0/2384234807 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3568493095 0 0) 0x7f8fdc003520 con 0x7f8ff815f020 2024-09-12T02:53:36.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.490+0000 7f8ffdc00640 1 -- 172.21.15.112:0/2384234807 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff806d960 con 0x7f8ff80d3270 2024-09-12T02:53:36.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.491+0000 7f8ffdc00640 1 --2- 172.21.15.112:0/2384234807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ff80d3270 0x7f8ff80cd240 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009dc0 tx=0x7f8ff002a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=880d352e160d95e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:36.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.491+0000 7f8ff7e00640 1 -- 172.21.15.112:0/2384234807 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0007740 con 0x7f8ff80d3270 2024-09-12T02:53:36.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.491+0000 7f8ff7e00640 1 -- 172.21.15.112:0/2384234807 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff00078e0 con 0x7f8ff80d3270 2024-09-12T02:53:36.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.491+0000 7f8ff7e00640 1 -- 172.21.15.112:0/2384234807 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0007c90 con 0x7f8ff80d3270 2024-09-12T02:53:36.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.492+0000 7f8fffc00640 1 -- 172.21.15.112:0/2384234807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ff80d3270 msgr2=0x7f8ff80cd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:36.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.492+0000 7f8fffc00640 1 --2- 172.21.15.112:0/2384234807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ff80d3270 0x7f8ff80cd240 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009dc0 tx=0x7f8ff002a6a0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.492+0000 7f8fffc00640 1 -- 172.21.15.112:0/2384234807 shutdown_connections 2024-09-12T02:53:36.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.492+0000 7f8fffc00640 1 --2- 172.21.15.112:0/2384234807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ff80d3270 0x7f8ff80cd240 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.492+0000 7f8fffc00640 1 -- 172.21.15.112:0/2384234807 >> 172.21.15.112:0/2384234807 conn(0x7f8ff809ba60 msgr2=0x7f8ff809be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:36.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.492+0000 7f8fffc00640 1 -- 172.21.15.112:0/2384234807 shutdown_connections 2024-09-12T02:53:36.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.492+0000 7f8fffc00640 1 -- 172.21.15.112:0/2384234807 wait complete. 2024-09-12T02:53:36.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.493+0000 7f8fffc00640 1 Processor -- start 2024-09-12T02:53:36.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.494+0000 7f8fffc00640 1 -- start start 2024-09-12T02:53:36.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.494+0000 7f8fffc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ff80d02f0 0x7f8ff80c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:36.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.494+0000 7f8fffc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ff80d3270 0x7f8ff814cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:36.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.494+0000 7f8fffc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ff815f020 0x7f8ff81f5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:36.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.494+0000 7f8fffc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff806df20 con 0x7f8ff815f020 2024-09-12T02:53:36.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.495+0000 7f8fffc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff80d1420 con 0x7f8ff80d3270 2024-09-12T02:53:36.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.495+0000 7f8fffc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8ff80d15a0 con 0x7f8ff80d02f0 2024-09-12T02:53:36.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.495+0000 7f8ffdc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ff815f020 0x7f8ff81f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:36.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.495+0000 7f8ffdc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ff815f020 0x7f8ff81f5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41456/0 (socket says 172.21.15.112:41456) 2024-09-12T02:53:36.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.495+0000 7f8ffdc00640 1 -- 172.21.15.112:0/569151665 learned_addr learned my addr 172.21.15.112:0/569151665 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:36.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.495+0000 7f8ffd200640 1 --2- 172.21.15.112:0/569151665 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ff80d02f0 0x7f8ff80c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:36.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.495+0000 7f8fefe00640 1 --2- 172.21.15.112:0/569151665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ff80d3270 0x7f8ff814cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:36.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.495+0000 7f8ffdc00640 1 -- 172.21.15.112:0/569151665 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ff80d02f0 msgr2=0x7f8ff80c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:36.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.495+0000 7f8ffdc00640 1 --2- 172.21.15.112:0/569151665 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ff80d02f0 0x7f8ff80c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.495+0000 7f8ffdc00640 1 -- 172.21.15.112:0/569151665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ff80d3270 msgr2=0x7f8ff814cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:36.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.495+0000 7f8ffdc00640 1 --2- 172.21.15.112:0/569151665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ff80d3270 0x7f8ff814cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:36.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.495+0000 7f8ffdc00640 1 -- 172.21.15.112:0/569151665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff8157e80 con 0x7f8ff815f020 2024-09-12T02:53:36.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.495+0000 7f8ffd200640 1 --2- 172.21.15.112:0/569151665 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ff80d02f0 0x7f8ff80c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:53:36.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.495+0000 7f8fefe00640 1 --2- 172.21.15.112:0/569151665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ff80d3270 0x7f8ff814cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:53:36.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.496+0000 7f8ffdc00640 1 --2- 172.21.15.112:0/569151665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ff815f020 0x7f8ff81f5230 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009eb0 tx=0x7f8ff0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:36.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.496+0000 7f8ff5600640 1 -- 172.21.15.112:0/569151665 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0040070 con 0x7f8ff815f020 2024-09-12T02:53:36.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.496+0000 7f8ff5600640 1 -- 172.21.15.112:0/569151665 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff0031c70 con 0x7f8ff815f020 2024-09-12T02:53:36.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.496+0000 7f8fffc00640 1 -- 172.21.15.112:0/569151665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff8158160 con 0x7f8ff815f020 2024-09-12T02:53:36.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.496+0000 7f8ff5600640 1 -- 172.21.15.112:0/569151665 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0009450 con 0x7f8ff815f020 2024-09-12T02:53:36.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.496+0000 7f8fffc00640 1 -- 172.21.15.112:0/569151665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff8158720 con 0x7f8ff815f020 2024-09-12T02:53:36.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.497+0000 7f8fffc00640 1 -- 172.21.15.112:0/569151665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ff80cd240 con 0x7f8ff815f020 2024-09-12T02:53:36.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.498+0000 7f8ff5600640 1 -- 172.21.15.112:0/569151665 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ff0039040 con 0x7f8ff815f020 2024-09-12T02:53:36.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.499+0000 7f8ff5600640 1 --2- 172.21.15.112:0/569151665 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8fd406be30 0x7f8fd406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:36.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.499+0000 7f8ff5600640 1 -- 172.21.15.112:0/569151665 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5795+0+0 (secure 0 0 0) 0x7f8ff00ac7b0 con 0x7f8ff815f020 2024-09-12T02:53:36.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.499+0000 7f8ff5600640 1 -- 172.21.15.112:0/569151665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=189}) -- 0x7f8fd4073a70 con 0x7f8ff815f020 2024-09-12T02:53:36.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.499+0000 7f8ffd200640 1 --2- 172.21.15.112:0/569151665 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8fd406be30 0x7f8fd406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:36.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.499+0000 7f8ffd200640 1 --2- 172.21.15.112:0/569151665 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8fd406be30 0x7f8fd406e2f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8005880 tx=0x7f8fe8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:36.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.503+0000 7f8ff5600640 1 -- 172.21.15.112:0/569151665 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8ff0031e20 con 0x7f8ff815f020 2024-09-12T02:53:36.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:36.676+0000 7f8fffc00640 1 -- 172.21.15.112:0/569151665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8ff80b8b70 con 0x7f8ff815f020 2024-09-12T02:53:37.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.320+0000 7f8ff5600640 1 -- 172.21.15.112:0/569151665 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v189) ==== 181+0+0 (secure 0 0 0) 0x7f8ff007b180 con 0x7f8ff815f020 2024-09-12T02:53:37.321 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' removed 2024-09-12T02:53:37.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.320+0000 7f8ff5600640 1 -- 172.21.15.112:0/569151665 <== mon.0 v2:172.21.15.112:3300/0 8 ==== osd_map(189..189 src has 1..189) ==== 296+0+0 (secure 0 0 0) 0x7f8ff00e0d50 con 0x7f8ff815f020 2024-09-12T02:53:37.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.320+0000 7f8ff5600640 1 -- 172.21.15.112:0/569151665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=190}) -- 0x7f8fd4071ea0 con 0x7f8ff815f020 2024-09-12T02:53:37.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.324+0000 7f8fffc00640 1 -- 172.21.15.112:0/569151665 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8fd406be30 msgr2=0x7f8fd406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:37.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.324+0000 7f8fffc00640 1 --2- 172.21.15.112:0/569151665 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8fd406be30 0x7f8fd406e2f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8005880 tx=0x7f8fe8009040 comp rx=0 tx=0).stop 2024-09-12T02:53:37.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.324+0000 7f8fffc00640 1 -- 172.21.15.112:0/569151665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ff815f020 msgr2=0x7f8ff81f5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:37.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.324+0000 7f8fffc00640 1 --2- 172.21.15.112:0/569151665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ff815f020 0x7f8ff81f5230 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009eb0 tx=0x7f8ff0004a40 comp rx=0 tx=0).stop 2024-09-12T02:53:37.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.324+0000 7f8fffc00640 1 -- 172.21.15.112:0/569151665 shutdown_connections 2024-09-12T02:53:37.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.324+0000 7f8fffc00640 1 --2- 172.21.15.112:0/569151665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ff815f020 0x7f8ff81f5230 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:37.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.324+0000 7f8fffc00640 1 --2- 172.21.15.112:0/569151665 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f8fd406be30 0x7f8fd406e2f0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:37.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.324+0000 7f8fffc00640 1 --2- 172.21.15.112:0/569151665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ff80d3270 0x7f8ff814cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:37.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.324+0000 7f8fffc00640 1 --2- 172.21.15.112:0/569151665 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ff80d02f0 0x7f8ff80c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:37.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.324+0000 7f8fffc00640 1 -- 172.21.15.112:0/569151665 >> 172.21.15.112:0/569151665 conn(0x7f8ff809ba60 msgr2=0x7f8ff806f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:37.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.325+0000 7f8fffc00640 1 -- 172.21.15.112:0/569151665 shutdown_connections 2024-09-12T02:53:37.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.325+0000 7f8fffc00640 1 -- 172.21.15.112:0/569151665 wait complete. 2024-09-12T02:53:37.345 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T02:53:37.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.501+0000 7f4985600640 1 Processor -- start 2024-09-12T02:53:37.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.501+0000 7f4985600640 1 -- start start 2024-09-12T02:53:37.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.502+0000 7f4985600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4980157190 0x7f49800b5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:37.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.502+0000 7f4985600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f49800d0970 0x7f49800d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:37.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.502+0000 7f4985600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49800720b0 con 0x7f498015d110 2024-09-12T02:53:37.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.502+0000 7f4985600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f49800d1300 con 0x7f49800d0970 2024-09-12T02:53:37.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.502+0000 7f4985600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f498015d880 con 0x7f4980157190 2024-09-12T02:53:37.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.503+0000 7f497ea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4980157190 0x7f49800b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:37.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.503+0000 7f497f400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f49800d0970 0x7f49800d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:37.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.503+0000 7f497ea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4980157190 0x7f49800b5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:38944/0 (socket says 172.21.15.112:38944) 2024-09-12T02:53:37.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.503+0000 7f497f400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f49800d0970 0x7f49800d0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:39066/0 (socket says 172.21.15.112:39066) 2024-09-12T02:53:37.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.503+0000 7f497ea00640 1 -- 172.21.15.112:0/3001872118 learned_addr learned my addr 172.21.15.112:0/3001872118 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:37.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.503+0000 7f497e000640 1 --1- 172.21.15.112:0/3001872118 >> v1:172.21.15.137:6789/0 conn(0x7f498015d110 0x7f498006d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.112:33728/0 (socket says 172.21.15.112:33728) 2024-09-12T02:53:37.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.503+0000 7f497ea00640 1 -- 172.21.15.112:0/3001872118 >> v2:172.21.15.137:3300/0 conn(0x7f49800d0970 msgr2=0x7f49800d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:37.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.503+0000 7f497ea00640 1 --2- 172.21.15.112:0/3001872118 >> v2:172.21.15.137:3300/0 conn(0x7f49800d0970 0x7f49800d0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:37.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.503+0000 7f497ea00640 1 -- 172.21.15.112:0/3001872118 >> v1:172.21.15.137:6789/0 conn(0x7f498015d110 legacy=0x7f498006d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:37.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.503+0000 7f497ea00640 1 -- 172.21.15.112:0/3001872118 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f498015db60 con 0x7f4980157190 2024-09-12T02:53:37.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.504+0000 7f497ea00640 1 --2- 172.21.15.112:0/3001872118 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4980157190 0x7f49800b5190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4970009870 tx=0x7f497002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3281ae9bf5d70433 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:37.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.505+0000 7f497d600640 1 -- 172.21.15.112:0/3001872118 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4970037070 con 0x7f4980157190 2024-09-12T02:53:37.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.505+0000 7f497d600640 1 -- 172.21.15.112:0/3001872118 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4970032440 con 0x7f4980157190 2024-09-12T02:53:37.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.505+0000 7f497d600640 1 -- 172.21.15.112:0/3001872118 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4970032810 con 0x7f4980157190 2024-09-12T02:53:37.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.505+0000 7f4985600640 1 -- 172.21.15.112:0/3001872118 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4980157190 msgr2=0x7f49800b5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:37.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.505+0000 7f4985600640 1 --2- 172.21.15.112:0/3001872118 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4980157190 0x7f49800b5190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4970009870 tx=0x7f497002a270 comp rx=0 tx=0).stop 2024-09-12T02:53:37.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.506+0000 7f4985600640 1 -- 172.21.15.112:0/3001872118 shutdown_connections 2024-09-12T02:53:37.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.506+0000 7f4985600640 1 --2- 172.21.15.112:0/3001872118 >> v2:172.21.15.137:3300/0 conn(0x7f49800d0970 0x7f49800d0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:37.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.506+0000 7f4985600640 1 --2- 172.21.15.112:0/3001872118 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4980157190 0x7f49800b5190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:37.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.506+0000 7f4985600640 1 -- 172.21.15.112:0/3001872118 >> 172.21.15.112:0/3001872118 conn(0x7f49800b2730 msgr2=0x7f49800b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:37.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.506+0000 7f4985600640 1 -- 172.21.15.112:0/3001872118 shutdown_connections 2024-09-12T02:53:37.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.506+0000 7f4985600640 1 -- 172.21.15.112:0/3001872118 wait complete. 2024-09-12T02:53:37.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.507+0000 7f4985600640 1 Processor -- start 2024-09-12T02:53:37.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.507+0000 7f4985600640 1 -- start start 2024-09-12T02:53:37.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.508+0000 7f4985600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49800d0970 0x7f4980144e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:37.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.508+0000 7f4985600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4980157190 0x7f498015f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:37.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.508+0000 7f4985600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f498015d110 0x7f4980150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:37.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.508+0000 7f4985600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f498015d5a0 con 0x7f498015d110 2024-09-12T02:53:37.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.508+0000 7f4985600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4980072350 con 0x7f4980157190 2024-09-12T02:53:37.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.508+0000 7f4985600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4980157570 con 0x7f49800d0970 2024-09-12T02:53:37.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.508+0000 7f497f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f498015d110 0x7f4980150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:37.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.509+0000 7f497ea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49800d0970 0x7f4980144e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:37.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.509+0000 7f497f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f498015d110 0x7f4980150d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41462/0 (socket says 172.21.15.112:41462) 2024-09-12T02:53:37.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.509+0000 7f497f400640 1 -- 172.21.15.112:0/1332383796 learned_addr learned my addr 172.21.15.112:0/1332383796 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:37.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.509+0000 7f497e000640 1 --2- 172.21.15.112:0/1332383796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4980157190 0x7f498015f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:37.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.509+0000 7f497f400640 1 -- 172.21.15.112:0/1332383796 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49800d0970 msgr2=0x7f4980144e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:37.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.509+0000 7f497f400640 1 --2- 172.21.15.112:0/1332383796 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49800d0970 0x7f4980144e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:37.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.509+0000 7f497f400640 1 -- 172.21.15.112:0/1332383796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4980157190 msgr2=0x7f498015f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:37.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.509+0000 7f497f400640 1 --2- 172.21.15.112:0/1332383796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4980157190 0x7f498015f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:37.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.509+0000 7f497f400640 1 -- 172.21.15.112:0/1332383796 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49801517a0 con 0x7f498015d110 2024-09-12T02:53:37.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.509+0000 7f497f400640 1 --2- 172.21.15.112:0/1332383796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f498015d110 0x7f4980150d00 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f497800efc0 tx=0x7f497800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:37.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.509+0000 7f4976a00640 1 -- 172.21.15.112:0/1332383796 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4978018020 con 0x7f498015d110 2024-09-12T02:53:37.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.509+0000 7f4976a00640 1 -- 172.21.15.112:0/1332383796 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4978014480 con 0x7f498015d110 2024-09-12T02:53:37.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.510+0000 7f4985600640 1 -- 172.21.15.112:0/1332383796 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49800cee50 con 0x7f498015d110 2024-09-12T02:53:37.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.510+0000 7f4976a00640 1 -- 172.21.15.112:0/1332383796 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4978014870 con 0x7f498015d110 2024-09-12T02:53:37.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.510+0000 7f4985600640 1 -- 172.21.15.112:0/1332383796 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49800cf410 con 0x7f498015d110 2024-09-12T02:53:37.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.511+0000 7f4985600640 1 -- 172.21.15.112:0/1332383796 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49800cf610 con 0x7f498015d110 2024-09-12T02:53:37.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.512+0000 7f4976a00640 1 -- 172.21.15.112:0/1332383796 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4978005d10 con 0x7f498015d110 2024-09-12T02:53:37.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.512+0000 7f4976a00640 1 --2- 172.21.15.112:0/1332383796 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f496006be30 0x7f496006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:37.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.513+0000 7f4976a00640 1 -- 172.21.15.112:0/1332383796 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5357+0+0 (secure 0 0 0) 0x7f497808b730 con 0x7f498015d110 2024-09-12T02:53:37.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.513+0000 7f4976a00640 1 -- 172.21.15.112:0/1332383796 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=190}) -- 0x7f4960072c60 con 0x7f498015d110 2024-09-12T02:53:37.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.513+0000 7f497ea00640 1 --2- 172.21.15.112:0/1332383796 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f496006be30 0x7f496006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:37.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.513+0000 7f497ea00640 1 --2- 172.21.15.112:0/1332383796 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f496006be30 0x7f496006e2f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f4970034000 tx=0x7f497002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:37.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.517+0000 7f4976a00640 1 -- 172.21.15.112:0/1332383796 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4978022070 con 0x7f498015d110 2024-09-12T02:53:37.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:37.690+0000 7f4985600640 1 -- 172.21.15.112:0/1332383796 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f49800d0da0 con 0x7f498015d110 2024-09-12T02:53:38.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.322+0000 7f4976a00640 1 -- 172.21.15.112:0/1332383796 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v190) ==== 169+0+0 (secure 0 0 0) 0x7f4978010040 con 0x7f498015d110 2024-09-12T02:53:38.323 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' removed 2024-09-12T02:53:38.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.322+0000 7f4976a00640 1 -- 172.21.15.112:0/1332383796 <== mon.0 v2:172.21.15.112:3300/0 8 ==== osd_map(190..190 src has 1..190) ==== 296+0+0 (secure 0 0 0) 0x7f49780bfd50 con 0x7f498015d110 2024-09-12T02:53:38.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.323+0000 7f4976a00640 1 -- 172.21.15.112:0/1332383796 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=191}) -- 0x7f49600719f0 con 0x7f498015d110 2024-09-12T02:53:38.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.330+0000 7f4985600640 1 -- 172.21.15.112:0/1332383796 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f496006be30 msgr2=0x7f496006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:38.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.330+0000 7f4985600640 1 --2- 172.21.15.112:0/1332383796 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f496006be30 0x7f496006e2f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f4970034000 tx=0x7f497002e000 comp rx=0 tx=0).stop 2024-09-12T02:53:38.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.330+0000 7f4985600640 1 -- 172.21.15.112:0/1332383796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f498015d110 msgr2=0x7f4980150d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:38.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.330+0000 7f4985600640 1 --2- 172.21.15.112:0/1332383796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f498015d110 0x7f4980150d00 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f497800efc0 tx=0x7f497800c490 comp rx=0 tx=0).stop 2024-09-12T02:53:38.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.331+0000 7f4985600640 1 -- 172.21.15.112:0/1332383796 shutdown_connections 2024-09-12T02:53:38.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.331+0000 7f4985600640 1 --2- 172.21.15.112:0/1332383796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f498015d110 0x7f4980150d00 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:38.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.331+0000 7f4985600640 1 --2- 172.21.15.112:0/1332383796 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f496006be30 0x7f496006e2f0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:38.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.331+0000 7f4985600640 1 --2- 172.21.15.112:0/1332383796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4980157190 0x7f498015f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:38.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.331+0000 7f4985600640 1 --2- 172.21.15.112:0/1332383796 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49800d0970 0x7f4980144e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:38.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.331+0000 7f4985600640 1 -- 172.21.15.112:0/1332383796 >> 172.21.15.112:0/1332383796 conn(0x7f49800b2730 msgr2=0x7f498006d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:38.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.332+0000 7f4985600640 1 -- 172.21.15.112:0/1332383796 shutdown_connections 2024-09-12T02:53:38.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.333+0000 7f4985600640 1 -- 172.21.15.112:0/1332383796 wait complete. 2024-09-12T02:53:38.353 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T02:53:38.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.507+0000 7f1edfe00640 1 Processor -- start 2024-09-12T02:53:38.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.507+0000 7f1edfe00640 1 -- start start 2024-09-12T02:53:38.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.508+0000 7f1edfe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1ed815cc50 0x7f1ed80732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:38.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.508+0000 7f1edfe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ed80afe30 0x7f1ed80cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:38.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.508+0000 7f1edfe00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ed8073830 con 0x7f1ed8071530 2024-09-12T02:53:38.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.508+0000 7f1edfe00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f1ed815d030 con 0x7f1ed815cc50 2024-09-12T02:53:38.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.508+0000 7f1edfe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1ed80cf4c0 con 0x7f1ed80afe30 2024-09-12T02:53:38.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.509+0000 7f1edd400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1ed815cc50 0x7f1ed80732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:38.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.509+0000 7f1edde00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ed80afe30 0x7f1ed80cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:38.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.509+0000 7f1edd400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1ed815cc50 0x7f1ed80732f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:39088/0 (socket says 172.21.15.112:39088) 2024-09-12T02:53:38.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.509+0000 7f1edd400640 1 -- 172.21.15.112:0/87720696 learned_addr learned my addr 172.21.15.112:0/87720696 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:38.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.510+0000 7f1edd400640 1 -- 172.21.15.112:0/87720696 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ed80afe30 msgr2=0x7f1ed80cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:38.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.510+0000 7f1edd400640 1 --2- 172.21.15.112:0/87720696 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ed80afe30 0x7f1ed80cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:38.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.510+0000 7f1edd400640 1 -- 172.21.15.112:0/87720696 >> v1:172.21.15.137:6789/0 conn(0x7f1ed8071530 legacy=0x7f1ed80af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:38.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.510+0000 7f1edd400640 1 -- 172.21.15.112:0/87720696 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed80ceeb0 con 0x7f1ed815cc50 2024-09-12T02:53:38.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.510+0000 7f1edde00640 1 --2- 172.21.15.112:0/87720696 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ed80afe30 0x7f1ed80cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:53:38.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.510+0000 7f1ed7e00640 1 -- 172.21.15.112:0/87720696 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3816707351 0 0) 0x7f1ec4001160 con 0x7f1ed8071530 2024-09-12T02:53:38.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.511+0000 7f1edd400640 1 --2- 172.21.15.112:0/87720696 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ed815cc50 0x7f1ed80732f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc009870 tx=0x7f1ecc02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16703278e642daa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:38.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.511+0000 7f1ed7e00640 1 -- 172.21.15.112:0/87720696 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc037070 con 0x7f1ed815cc50 2024-09-12T02:53:38.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.511+0000 7f1ed7e00640 1 -- 172.21.15.112:0/87720696 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ecc032440 con 0x7f1ed815cc50 2024-09-12T02:53:38.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.511+0000 7f1ed7e00640 1 -- 172.21.15.112:0/87720696 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc032810 con 0x7f1ed815cc50 2024-09-12T02:53:38.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.512+0000 7f1edfe00640 1 -- 172.21.15.112:0/87720696 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ed815cc50 msgr2=0x7f1ed80732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:38.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.512+0000 7f1edfe00640 1 --2- 172.21.15.112:0/87720696 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ed815cc50 0x7f1ed80732f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc009870 tx=0x7f1ecc02a1c0 comp rx=0 tx=0).stop 2024-09-12T02:53:38.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.512+0000 7f1edfe00640 1 -- 172.21.15.112:0/87720696 shutdown_connections 2024-09-12T02:53:38.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.512+0000 7f1edfe00640 1 --2- 172.21.15.112:0/87720696 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ed80afe30 0x7f1ed80cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:38.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.512+0000 7f1edfe00640 1 --2- 172.21.15.112:0/87720696 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ed815cc50 0x7f1ed80732f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:38.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.512+0000 7f1edfe00640 1 -- 172.21.15.112:0/87720696 >> 172.21.15.112:0/87720696 conn(0x7f1ed806bbd0 msgr2=0x7f1ed806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:38.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.512+0000 7f1edfe00640 1 -- 172.21.15.112:0/87720696 shutdown_connections 2024-09-12T02:53:38.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.512+0000 7f1edfe00640 1 -- 172.21.15.112:0/87720696 wait complete. 2024-09-12T02:53:38.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.514+0000 7f1edfe00640 1 Processor -- start 2024-09-12T02:53:38.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.514+0000 7f1edfe00640 1 -- start start 2024-09-12T02:53:38.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.515+0000 7f1edfe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ed8071530 0x7f1ed81f2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:38.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.515+0000 7f1edfe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ed80afe30 0x7f1ed81514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:38.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.515+0000 7f1edfe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ed815cc50 0x7f1ed81519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:38.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.515+0000 7f1edfe00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed80cf150 con 0x7f1ed80afe30 2024-09-12T02:53:38.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.515+0000 7f1edfe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed806e5e0 con 0x7f1ed815cc50 2024-09-12T02:53:38.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.515+0000 7f1edfe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1ed806f510 con 0x7f1ed8071530 2024-09-12T02:53:38.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.515+0000 7f1edca00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ed80afe30 0x7f1ed81514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:38.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.515+0000 7f1edca00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ed80afe30 0x7f1ed81514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41464/0 (socket says 172.21.15.112:41464) 2024-09-12T02:53:38.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.515+0000 7f1edca00640 1 -- 172.21.15.112:0/2021605404 learned_addr learned my addr 172.21.15.112:0/2021605404 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:38.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.515+0000 7f1edde00640 1 --2- 172.21.15.112:0/2021605404 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ed815cc50 0x7f1ed81519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:38.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.515+0000 7f1edd400640 1 --2- 172.21.15.112:0/2021605404 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ed8071530 0x7f1ed81f2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:38.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.515+0000 7f1edca00640 1 -- 172.21.15.112:0/2021605404 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ed8071530 msgr2=0x7f1ed81f2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:38.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.515+0000 7f1edca00640 1 --2- 172.21.15.112:0/2021605404 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ed8071530 0x7f1ed81f2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:38.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.515+0000 7f1edca00640 1 -- 172.21.15.112:0/2021605404 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ed815cc50 msgr2=0x7f1ed81519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:38.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.516+0000 7f1edca00640 1 --2- 172.21.15.112:0/2021605404 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ed815cc50 0x7f1ed81519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:38.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.516+0000 7f1edca00640 1 -- 172.21.15.112:0/2021605404 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed81f7990 con 0x7f1ed80afe30 2024-09-12T02:53:38.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.516+0000 7f1edca00640 1 --2- 172.21.15.112:0/2021605404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ed80afe30 0x7f1ed81514a0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f1ec400c750 tx=0x7f1ec400cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:38.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.516+0000 7f1ed5600640 1 -- 172.21.15.112:0/2021605404 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4017070 con 0x7f1ed80afe30 2024-09-12T02:53:38.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.516+0000 7f1ed5600640 1 -- 172.21.15.112:0/2021605404 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ec4005070 con 0x7f1ed80afe30 2024-09-12T02:53:38.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.516+0000 7f1ed5600640 1 -- 172.21.15.112:0/2021605404 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4005460 con 0x7f1ed80afe30 2024-09-12T02:53:38.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.516+0000 7f1edfe00640 1 -- 172.21.15.112:0/2021605404 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ed81f32e0 con 0x7f1ed80afe30 2024-09-12T02:53:38.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.516+0000 7f1edfe00640 1 -- 172.21.15.112:0/2021605404 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ed814f170 con 0x7f1ed80afe30 2024-09-12T02:53:38.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.517+0000 7f1edfe00640 1 -- 172.21.15.112:0/2021605404 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ed806df60 con 0x7f1ed80afe30 2024-09-12T02:53:38.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.518+0000 7f1ed5600640 1 -- 172.21.15.112:0/2021605404 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1ec401a070 con 0x7f1ed80afe30 2024-09-12T02:53:38.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.519+0000 7f1ed5600640 1 --2- 172.21.15.112:0/2021605404 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1eb806be30 0x7f1eb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:38.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.519+0000 7f1ed5600640 1 -- 172.21.15.112:0/2021605404 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 4943+0+0 (secure 0 0 0) 0x7f1ec4089d70 con 0x7f1ed80afe30 2024-09-12T02:53:38.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.519+0000 7f1edd400640 1 --2- 172.21.15.112:0/2021605404 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1eb806be30 0x7f1eb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:38.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.520+0000 7f1edd400640 1 --2- 172.21.15.112:0/2021605404 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1eb806be30 0x7f1eb806e2f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc034000 tx=0x7f1ecc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:38.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.523+0000 7f1ed5600640 1 -- 172.21.15.112:0/2021605404 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1ed8073830 con 0x7f1ed80afe30 2024-09-12T02:53:38.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.697+0000 7f1edfe00640 1 -- 172.21.15.112:0/2021605404 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f1ed8157890 con 0x7f1ed80afe30 2024-09-12T02:53:38.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.701+0000 7f1ed5600640 1 -- 172.21.15.112:0/2021605404 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7f1ec40583c0 con 0x7f1ed80afe30 2024-09-12T02:53:38.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.703+0000 7f1edfe00640 1 -- 172.21.15.112:0/2021605404 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1eb806be30 msgr2=0x7f1eb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:38.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.703+0000 7f1edfe00640 1 --2- 172.21.15.112:0/2021605404 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1eb806be30 0x7f1eb806e2f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc034000 tx=0x7f1ecc02e000 comp rx=0 tx=0).stop 2024-09-12T02:53:38.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.703+0000 7f1edfe00640 1 -- 172.21.15.112:0/2021605404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ed80afe30 msgr2=0x7f1ed81514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:38.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.703+0000 7f1edfe00640 1 --2- 172.21.15.112:0/2021605404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ed80afe30 0x7f1ed81514a0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f1ec400c750 tx=0x7f1ec400cb50 comp rx=0 tx=0).stop 2024-09-12T02:53:38.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.704+0000 7f1edfe00640 1 -- 172.21.15.112:0/2021605404 shutdown_connections 2024-09-12T02:53:38.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.704+0000 7f1edfe00640 1 --2- 172.21.15.112:0/2021605404 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f1eb806be30 0x7f1eb806e2f0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:38.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.704+0000 7f1edfe00640 1 --2- 172.21.15.112:0/2021605404 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ed815cc50 0x7f1ed81519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:38.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.704+0000 7f1edfe00640 1 --2- 172.21.15.112:0/2021605404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ed80afe30 0x7f1ed81514a0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:38.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.704+0000 7f1edfe00640 1 --2- 172.21.15.112:0/2021605404 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ed8071530 0x7f1ed81f2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:38.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.704+0000 7f1edfe00640 1 -- 172.21.15.112:0/2021605404 >> 172.21.15.112:0/2021605404 conn(0x7f1ed806bbd0 msgr2=0x7f1ed806e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:38.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.704+0000 7f1edfe00640 1 -- 172.21.15.112:0/2021605404 shutdown_connections 2024-09-12T02:53:38.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.704+0000 7f1edfe00640 1 -- 172.21.15.112:0/2021605404 wait complete. 2024-09-12T02:53:38.720 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2024-09-12T02:53:38.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.872+0000 7f0f53e00640 1 Processor -- start 2024-09-12T02:53:38.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.872+0000 7f0f53e00640 1 -- start start 2024-09-12T02:53:38.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.873+0000 7f0f53e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0f540d1710 0x7f0f540d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:38.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.873+0000 7f0f53e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0f540b1d70 0x7f0f540b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:38.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.873+0000 7f0f53e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f540d2fb0 con 0x7f0f540b3e00 2024-09-12T02:53:38.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.873+0000 7f0f53e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f0f540d3cb0 con 0x7f0f540b1d70 2024-09-12T02:53:38.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.873+0000 7f0f53e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f0f540d0b60 con 0x7f0f540d1710 2024-09-12T02:53:38.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.873+0000 7f0f52000640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f0f540b3e00 0x7f0f540d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33210/0 (socket says 172.21.15.112:33210) 2024-09-12T02:53:38.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.873+0000 7f0f52000640 1 -- 172.21.15.112:0/1561888841 learned_addr learned my addr 172.21.15.112:0/1561888841 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:53:38.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.873+0000 7f0f53400640 1 --2- 172.21.15.112:0/1561888841 >> v2:172.21.15.112:3300/0 conn(0x7f0f540b1d70 0x7f0f540b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:38.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.874+0000 7f0f52a00640 1 --2- 172.21.15.112:0/1561888841 >> v2:172.21.15.137:3300/0 conn(0x7f0f540d1710 0x7f0f540d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:38.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.874+0000 7f0f53400640 1 -- 172.21.15.112:0/1561888841 >> v2:172.21.15.137:3300/0 conn(0x7f0f540d1710 msgr2=0x7f0f540d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:38.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.874+0000 7f0f53400640 1 --2- 172.21.15.112:0/1561888841 >> v2:172.21.15.137:3300/0 conn(0x7f0f540d1710 0x7f0f540d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:38.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.874+0000 7f0f53400640 1 -- 172.21.15.112:0/1561888841 >> v1:172.21.15.112:6789/0 conn(0x7f0f540b3e00 legacy=0x7f0f540d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:38.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.874+0000 7f0f53400640 1 -- 172.21.15.112:0/1561888841 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f540d3410 con 0x7f0f540b1d70 2024-09-12T02:53:38.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.874+0000 7f0f51600640 1 -- 172.21.15.112:0/1561888841 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2027176122 0 0) 0x7f0f540d2fb0 con 0x7f0f540b3e00 2024-09-12T02:53:38.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.874+0000 7f0f52a00640 1 --2- 172.21.15.112:0/1561888841 >> v2:172.21.15.137:3300/0 conn(0x7f0f540d1710 0x7f0f540d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:53:38.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.875+0000 7f0f53400640 1 --2- 172.21.15.112:0/1561888841 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f540b1d70 0x7f0f540b2200 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f0f5408dd50 tx=0x7f0f4c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88bc23d6ccbb774d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:38.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.875+0000 7f0f51600640 1 -- 172.21.15.112:0/1561888841 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c037070 con 0x7f0f540b1d70 2024-09-12T02:53:38.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.875+0000 7f0f51600640 1 -- 172.21.15.112:0/1561888841 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4c032440 con 0x7f0f540b1d70 2024-09-12T02:53:38.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.875+0000 7f0f51600640 1 -- 172.21.15.112:0/1561888841 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c032810 con 0x7f0f540b1d70 2024-09-12T02:53:38.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.876+0000 7f0f53e00640 1 -- 172.21.15.112:0/1561888841 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f540b1d70 msgr2=0x7f0f540b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:38.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.876+0000 7f0f53e00640 1 --2- 172.21.15.112:0/1561888841 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f540b1d70 0x7f0f540b2200 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f0f5408dd50 tx=0x7f0f4c02a1a0 comp rx=0 tx=0).stop 2024-09-12T02:53:38.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.876+0000 7f0f53e00640 1 -- 172.21.15.112:0/1561888841 shutdown_connections 2024-09-12T02:53:38.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.876+0000 7f0f53e00640 1 --2- 172.21.15.112:0/1561888841 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f540b1d70 0x7f0f540b2200 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:38.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.876+0000 7f0f53e00640 1 --2- 172.21.15.112:0/1561888841 >> v2:172.21.15.137:3300/0 conn(0x7f0f540d1710 0x7f0f540d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:38.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.876+0000 7f0f53e00640 1 -- 172.21.15.112:0/1561888841 >> 172.21.15.112:0/1561888841 conn(0x7f0f5409e030 msgr2=0x7f0f540d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:38.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.876+0000 7f0f53e00640 1 -- 172.21.15.112:0/1561888841 shutdown_connections 2024-09-12T02:53:38.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.876+0000 7f0f53e00640 1 -- 172.21.15.112:0/1561888841 wait complete. 2024-09-12T02:53:38.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.877+0000 7f0f53e00640 1 Processor -- start 2024-09-12T02:53:38.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.878+0000 7f0f53e00640 1 -- start start 2024-09-12T02:53:38.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.878+0000 7f0f53e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f540b1d70 0x7f0f5415f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:38.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.878+0000 7f0f53e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f540b3e00 0x7f0f540c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:38.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.878+0000 7f0f53e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0f540d1710 0x7f0f540c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:38.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.878+0000 7f0f53e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5415f110 con 0x7f0f540b1d70 2024-09-12T02:53:38.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.878+0000 7f0f53e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0f540d39d0 con 0x7f0f540b3e00 2024-09-12T02:53:38.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.878+0000 7f0f53e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0f5415f290 con 0x7f0f540d1710 2024-09-12T02:53:38.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.879+0000 7f0f52a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f540b1d70 0x7f0f5415f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:38.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.879+0000 7f0f52a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f540b1d70 0x7f0f5415f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41488/0 (socket says 172.21.15.112:41488) 2024-09-12T02:53:38.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.879+0000 7f0f52a00640 1 -- 172.21.15.112:0/865436116 learned_addr learned my addr 172.21.15.112:0/865436116 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:38.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.879+0000 7f0f52000640 1 --2- 172.21.15.112:0/865436116 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f540b3e00 0x7f0f540c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:38.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.879+0000 7f0f53400640 1 --2- 172.21.15.112:0/865436116 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0f540d1710 0x7f0f540c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:38.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.879+0000 7f0f52a00640 1 -- 172.21.15.112:0/865436116 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0f540d1710 msgr2=0x7f0f540c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:38.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.879+0000 7f0f52a00640 1 --2- 172.21.15.112:0/865436116 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0f540d1710 0x7f0f540c99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:38.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.879+0000 7f0f52a00640 1 -- 172.21.15.112:0/865436116 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f540b3e00 msgr2=0x7f0f540c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:38.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.879+0000 7f0f52a00640 1 --2- 172.21.15.112:0/865436116 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f540b3e00 0x7f0f540c9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:38.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.879+0000 7f0f52a00640 1 -- 172.21.15.112:0/865436116 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f540ccd30 con 0x7f0f540b1d70 2024-09-12T02:53:38.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.879+0000 7f0f52a00640 1 --2- 172.21.15.112:0/865436116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f540b1d70 0x7f0f5415f410 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400ce00 tx=0x7f0f4400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:38.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.879+0000 7f0f4aa00640 1 -- 172.21.15.112:0/865436116 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4400f890 con 0x7f0f540b1d70 2024-09-12T02:53:38.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.880+0000 7f0f4aa00640 1 -- 172.21.15.112:0/865436116 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4400fa30 con 0x7f0f540b1d70 2024-09-12T02:53:38.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.880+0000 7f0f4aa00640 1 -- 172.21.15.112:0/865436116 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4400fe40 con 0x7f0f540b1d70 2024-09-12T02:53:38.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.880+0000 7f0f53e00640 1 -- 172.21.15.112:0/865436116 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f540ccfa0 con 0x7f0f540b1d70 2024-09-12T02:53:38.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.880+0000 7f0f53e00640 1 -- 172.21.15.112:0/865436116 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f540cd560 con 0x7f0f540b1d70 2024-09-12T02:53:38.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.881+0000 7f0f53e00640 1 -- 172.21.15.112:0/865436116 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f540d28d0 con 0x7f0f540b1d70 2024-09-12T02:53:38.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.882+0000 7f0f4aa00640 1 -- 172.21.15.112:0/865436116 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0f44018400 con 0x7f0f540b1d70 2024-09-12T02:53:38.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.882+0000 7f0f4aa00640 1 --2- 172.21.15.112:0/865436116 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0f3406be30 0x7f0f3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:38.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.882+0000 7f0f4aa00640 1 -- 172.21.15.112:0/865436116 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 4943+0+0 (secure 0 0 0) 0x7f0f4408bab0 con 0x7f0f540b1d70 2024-09-12T02:53:38.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.883+0000 7f0f52000640 1 --2- 172.21.15.112:0/865436116 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0f3406be30 0x7f0f3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:38.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.883+0000 7f0f52000640 1 --2- 172.21.15.112:0/865436116 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0f3406be30 0x7f0f3406e2f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0f540cc210 tx=0x7f0f40007b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:38.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:38.887+0000 7f0f4aa00640 1 -- 172.21.15.112:0/865436116 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0f44014030 con 0x7f0f540b1d70 2024-09-12T02:53:39.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:39.121+0000 7f0f53e00640 1 -- 172.21.15.112:0/865436116 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) -- 0x7f0f540d56a0 con 0x7f0f540b1d70 2024-09-12T02:53:39.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:39.318+0000 7f0f4aa00640 1 -- 172.21.15.112:0/865436116 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v556) ==== 135+0+0 (secure 0 0 0) 0x7f0f4400ae20 con 0x7f0f540b1d70 2024-09-12T02:53:39.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:39.320+0000 7f0f53e00640 1 -- 172.21.15.112:0/865436116 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0f3406be30 msgr2=0x7f0f3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:39.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:39.320+0000 7f0f53e00640 1 --2- 172.21.15.112:0/865436116 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0f3406be30 0x7f0f3406e2f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0f540cc210 tx=0x7f0f40007b50 comp rx=0 tx=0).stop 2024-09-12T02:53:39.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:39.320+0000 7f0f53e00640 1 -- 172.21.15.112:0/865436116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f540b1d70 msgr2=0x7f0f5415f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:39.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:39.320+0000 7f0f53e00640 1 --2- 172.21.15.112:0/865436116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f540b1d70 0x7f0f5415f410 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400ce00 tx=0x7f0f4400a650 comp rx=0 tx=0).stop 2024-09-12T02:53:39.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:39.320+0000 7f0f53e00640 1 -- 172.21.15.112:0/865436116 shutdown_connections 2024-09-12T02:53:39.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:39.320+0000 7f0f53e00640 1 --2- 172.21.15.112:0/865436116 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0f540d1710 0x7f0f540c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:39.320+0000 7f0f53e00640 1 --2- 172.21.15.112:0/865436116 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f0f3406be30 0x7f0f3406e2f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:39.320+0000 7f0f53e00640 1 --2- 172.21.15.112:0/865436116 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f540b3e00 0x7f0f540c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:39.320+0000 7f0f53e00640 1 --2- 172.21.15.112:0/865436116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f540b1d70 0x7f0f5415f410 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:39.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:39.320+0000 7f0f53e00640 1 -- 172.21.15.112:0/865436116 >> 172.21.15.112:0/865436116 conn(0x7f0f5409e030 msgr2=0x7f0f540b2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:39.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:39.321+0000 7f0f53e00640 1 -- 172.21.15.112:0/865436116 shutdown_connections 2024-09-12T02:53:39.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:39.321+0000 7f0f53e00640 1 -- 172.21.15.112:0/865436116 wait complete. 2024-09-12T02:53:39.337 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2024-09-12T02:53:39.337 INFO:tasks.cephfs_test_runner: 2024-09-12T02:53:39.337 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-12T02:53:39.337 INFO:tasks.cephfs_test_runner:Ran 10 tests in 677.639s 2024-09-12T02:53:39.337 INFO:tasks.cephfs_test_runner: 2024-09-12T02:53:39.338 INFO:tasks.cephfs_test_runner:OK 2024-09-12T02:53:39.338 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-12T02:53:39.347 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-12T02:53:39.354 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-12T02:53:39.354 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:53:39.355 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:53:39.390 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:53:39.390 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-12T02:53:39.390 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:53:39.467 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T02:53:39.467 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:53:39.467 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:53:39.507 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:53:39.507 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-12T02:53:39.507 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:53:39.585 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T02:53:39.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:39.585 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-12T02:53:39.619 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:53:39.619 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T02:53:39.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:39.620 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:53:39.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:39.718 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T02:53:39.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:39.971 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2024-09-12T02:53:40.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:40.282 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-12T02:53:40.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:40.318 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2024-09-12T02:53:40.418 INFO:teuthology.orchestra.run.smithi112.stderr:Cannot find device "ceph-brx" 2024-09-12T02:53:40.421 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:53:40.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:40.421 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-09-12T02:53:40.461 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T02:53:40.461 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T02:53:40.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:40.462 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:53:40.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:40.563 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T02:53:40.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:40.849 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link delete ceph-brx 2024-09-12T02:53:41.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:41.171 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-09-12T02:53:41.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:53:41.206 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link delete ceph-brx 2024-09-12T02:53:41.305 INFO:teuthology.orchestra.run.smithi137.stderr:Cannot find device "ceph-brx" 2024-09-12T02:53:41.308 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:53:41.308 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T02:53:41.319 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:53:41.319 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:53:41.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.476+0000 7fb524600640 1 Processor -- start 2024-09-12T02:53:41.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.476+0000 7fb524600640 1 -- start start 2024-09-12T02:53:41.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.477+0000 7fb524600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb51c15cc50 0x7fb51c0732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:41.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.477+0000 7fb524600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb51c071530 0x7fb51c0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:41.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.477+0000 7fb524600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb51c073830 con 0x7fb51c071970 2024-09-12T02:53:41.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.477+0000 7fb524600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb51c15d030 con 0x7fb51c071530 2024-09-12T02:53:41.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.477+0000 7fb524600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb51c0cf4c0 con 0x7fb51c15cc50 2024-09-12T02:53:41.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.478+0000 7fb521c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb51c15cc50 0x7fb51c0732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:41.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.478+0000 7fb521200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb51c071530 0x7fb51c0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:41.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.478+0000 7fb521c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb51c15cc50 0x7fb51c0732f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:38994/0 (socket says 172.21.15.112:38994) 2024-09-12T02:53:41.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.478+0000 7fb521c00640 1 -- 172.21.15.112:0/2316648156 learned_addr learned my addr 172.21.15.112:0/2316648156 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:41.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.479+0000 7fb521c00640 1 -- 172.21.15.112:0/2316648156 >> v2:172.21.15.137:3300/0 conn(0x7fb51c071530 msgr2=0x7fb51c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:41.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.479+0000 7fb521c00640 1 --2- 172.21.15.112:0/2316648156 >> v2:172.21.15.137:3300/0 conn(0x7fb51c071530 0x7fb51c0af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.479+0000 7fb521c00640 1 -- 172.21.15.112:0/2316648156 >> v1:172.21.15.137:6789/0 conn(0x7fb51c071970 legacy=0x7fb51c0cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:41.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.479+0000 7fb521c00640 1 -- 172.21.15.112:0/2316648156 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb51c0ceeb0 con 0x7fb51c15cc50 2024-09-12T02:53:41.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.479+0000 7fb51be00640 1 -- 172.21.15.112:0/2316648156 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2474724543 0 0) 0x7fb514001490 con 0x7fb51c071970 2024-09-12T02:53:41.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.480+0000 7fb521c00640 1 --2- 172.21.15.112:0/2316648156 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb51c15cc50 0x7fb51c0732f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb510009870 tx=0x7fb51002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4ced3cb7a2e1829 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:41.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.480+0000 7fb51be00640 1 -- 172.21.15.112:0/2316648156 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb510037070 con 0x7fb51c15cc50 2024-09-12T02:53:41.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.480+0000 7fb51be00640 1 -- 172.21.15.112:0/2316648156 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb510032440 con 0x7fb51c15cc50 2024-09-12T02:53:41.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.480+0000 7fb51be00640 1 -- 172.21.15.112:0/2316648156 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb510032810 con 0x7fb51c15cc50 2024-09-12T02:53:41.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.480+0000 7fb524600640 1 -- 172.21.15.112:0/2316648156 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb51c15cc50 msgr2=0x7fb51c0732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:41.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.480+0000 7fb524600640 1 --2- 172.21.15.112:0/2316648156 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb51c15cc50 0x7fb51c0732f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb510009870 tx=0x7fb51002a1c0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.481+0000 7fb524600640 1 -- 172.21.15.112:0/2316648156 shutdown_connections 2024-09-12T02:53:41.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.481+0000 7fb524600640 1 --2- 172.21.15.112:0/2316648156 >> v2:172.21.15.137:3300/0 conn(0x7fb51c071530 0x7fb51c0af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.481+0000 7fb524600640 1 --2- 172.21.15.112:0/2316648156 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb51c15cc50 0x7fb51c0732f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.481+0000 7fb524600640 1 -- 172.21.15.112:0/2316648156 >> 172.21.15.112:0/2316648156 conn(0x7fb51c06bbd0 msgr2=0x7fb51c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:41.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.481+0000 7fb524600640 1 -- 172.21.15.112:0/2316648156 shutdown_connections 2024-09-12T02:53:41.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.481+0000 7fb524600640 1 -- 172.21.15.112:0/2316648156 wait complete. 2024-09-12T02:53:41.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.482+0000 7fb524600640 1 Processor -- start 2024-09-12T02:53:41.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.482+0000 7fb524600640 1 -- start start 2024-09-12T02:53:41.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.483+0000 7fb524600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb51c071530 0x7fb51c150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:41.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.483+0000 7fb524600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb51c071970 0x7fb51c0b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:41.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.483+0000 7fb524600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb51c15cc50 0x7fb51c0b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:41.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.483+0000 7fb524600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb51c0cf150 con 0x7fb51c15cc50 2024-09-12T02:53:41.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.483+0000 7fb524600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb51c06e5e0 con 0x7fb51c071970 2024-09-12T02:53:41.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.483+0000 7fb524600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb51c06f510 con 0x7fb51c071530 2024-09-12T02:53:41.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.484+0000 7fb522600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb51c15cc50 0x7fb51c0b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:41.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.484+0000 7fb521c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb51c071530 0x7fb51c150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:41.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.484+0000 7fb521200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb51c071970 0x7fb51c0b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:41.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.484+0000 7fb521c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb51c071530 0x7fb51c150760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:39006/0 (socket says 172.21.15.112:39006) 2024-09-12T02:53:41.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.484+0000 7fb521c00640 1 -- 172.21.15.112:0/80900742 learned_addr learned my addr 172.21.15.112:0/80900742 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:41.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.484+0000 7fb521c00640 1 -- 172.21.15.112:0/80900742 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb51c071970 msgr2=0x7fb51c0b3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:41.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.484+0000 7fb521c00640 1 --2- 172.21.15.112:0/80900742 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb51c071970 0x7fb51c0b3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.484+0000 7fb521c00640 1 -- 172.21.15.112:0/80900742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb51c15cc50 msgr2=0x7fb51c0b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:41.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.484+0000 7fb521c00640 1 --2- 172.21.15.112:0/80900742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb51c15cc50 0x7fb51c0b40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.484+0000 7fb521c00640 1 -- 172.21.15.112:0/80900742 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb51c150ca0 con 0x7fb51c071530 2024-09-12T02:53:41.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.485+0000 7fb521c00640 1 --2- 172.21.15.112:0/80900742 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb51c071530 0x7fb51c150760 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb5100090b0 tx=0x7fb5100046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:41.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.485+0000 7fb519600640 1 -- 172.21.15.112:0/80900742 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb510041020 con 0x7fb51c071530 2024-09-12T02:53:41.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.485+0000 7fb519600640 1 -- 172.21.15.112:0/80900742 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb510030660 con 0x7fb51c071530 2024-09-12T02:53:41.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.485+0000 7fb524600640 1 -- 172.21.15.112:0/80900742 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb51c1524d0 con 0x7fb51c071530 2024-09-12T02:53:41.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.485+0000 7fb519600640 1 -- 172.21.15.112:0/80900742 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb510037040 con 0x7fb51c071530 2024-09-12T02:53:41.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.485+0000 7fb524600640 1 -- 172.21.15.112:0/80900742 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb51c152a90 con 0x7fb51c071530 2024-09-12T02:53:41.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.486+0000 7fb524600640 1 -- 172.21.15.112:0/80900742 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb51c068a30 con 0x7fb51c071530 2024-09-12T02:53:41.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.488+0000 7fb519600640 1 -- 172.21.15.112:0/80900742 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb510044020 con 0x7fb51c071530 2024-09-12T02:53:41.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.489+0000 7fb519600640 1 --2- 172.21.15.112:0/80900742 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb4fc06be30 0x7fb4fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:41.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.489+0000 7fb519600640 1 -- 172.21.15.112:0/80900742 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(190..190 src has 1..190) ==== 4943+0+0 (secure 0 0 0) 0x7fb5100ab1f0 con 0x7fb51c071530 2024-09-12T02:53:41.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.489+0000 7fb521200640 1 --2- 172.21.15.112:0/80900742 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb4fc06be30 0x7fb4fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:41.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.490+0000 7fb521200640 1 --2- 172.21.15.112:0/80900742 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb4fc06be30 0x7fb4fc06e2f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fb51c0b4780 tx=0x7fb508009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:41.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.494+0000 7fb519600640 1 -- 172.21.15.112:0/80900742 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb51004b030 con 0x7fb51c071530 2024-09-12T02:53:41.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.668+0000 7fb524600640 1 -- 172.21.15.112:0/80900742 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb51c0730d0 con 0x7fb4fc06be30 2024-09-12T02:53:41.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.669+0000 7fb519600640 1 -- 172.21.15.112:0/80900742 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12599 (secure 0 0 0) 0x7fb51c0730d0 con 0x7fb4fc06be30 2024-09-12T02:53:41.670 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:53:41.670 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:53:41.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.671+0000 7fb524600640 1 -- 172.21.15.112:0/80900742 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb4fc06be30 msgr2=0x7fb4fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:41.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.671+0000 7fb524600640 1 --2- 172.21.15.112:0/80900742 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb4fc06be30 0x7fb4fc06e2f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fb51c0b4780 tx=0x7fb508009110 comp rx=0 tx=0).stop 2024-09-12T02:53:41.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.671+0000 7fb524600640 1 -- 172.21.15.112:0/80900742 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb51c071530 msgr2=0x7fb51c150760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:41.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.671+0000 7fb524600640 1 --2- 172.21.15.112:0/80900742 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb51c071530 0x7fb51c150760 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb5100090b0 tx=0x7fb5100046c0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.671+0000 7fb524600640 1 -- 172.21.15.112:0/80900742 shutdown_connections 2024-09-12T02:53:41.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.671+0000 7fb524600640 1 --2- 172.21.15.112:0/80900742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb51c15cc50 0x7fb51c0b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.671+0000 7fb524600640 1 --2- 172.21.15.112:0/80900742 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb4fc06be30 0x7fb4fc06e2f0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.671+0000 7fb524600640 1 --2- 172.21.15.112:0/80900742 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb51c071970 0x7fb51c0b3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.671+0000 7fb524600640 1 --2- 172.21.15.112:0/80900742 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb51c071530 0x7fb51c150760 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.671+0000 7fb524600640 1 -- 172.21.15.112:0/80900742 >> 172.21.15.112:0/80900742 conn(0x7fb51c06bbd0 msgr2=0x7fb51c06e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:41.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.671+0000 7fb524600640 1 -- 172.21.15.112:0/80900742 shutdown_connections 2024-09-12T02:53:41.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.671+0000 7fb524600640 1 -- 172.21.15.112:0/80900742 wait complete. 2024-09-12T02:53:41.688 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":541,"stamp":"2024-09-12T02:53:41.124628+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":111903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1450596,"statfs":{"total":1600000000,"available":1485410598,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52490581,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-130,"num_write_kb":-85086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.815197"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":495,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T02:53:37.327419+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:53:37.327419+0000","last_peered":"2024-09-12T02:53:37.327419+0000","last_clean":"2024-09-12T02:53:37.327419+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:53:37.327419+0000","last_undegraded":"2024-09-12T02:53:37.327419+0000","last_fullsized":"2024-09-12T02:53:37.327419+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:25.823876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574993,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9808,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185504,"statfs":{"total":200000000,"available":189956103,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574993,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19466,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175846,"statfs":{"total":200000000,"available":180066490,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574993,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21514,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173797,"statfs":{"total":200000000,"available":177968958,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574993,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":7237,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":188074,"statfs":{"total":200000000,"available":192588775,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574993,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9231,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":186080,"statfs":{"total":200000000,"available":190546471,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574993,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21519,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173792,"statfs":{"total":200000000,"available":177963559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":13322,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":181990,"statfs":{"total":200000000,"available":186358136,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574993,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185509,"statfs":{"total":200000000,"available":189962106,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:53:41.689 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:53:41.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.845+0000 7fd343000640 1 Processor -- start 2024-09-12T02:53:41.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.845+0000 7fd343000640 1 -- start start 2024-09-12T02:53:41.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.846+0000 7fd343000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd33c0b2a50 0x7fd33c0b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:41.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.846+0000 7fd343000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd33c0d33c0 0x7fd33c0cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:41.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.846+0000 7fd343000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd33c0d3830 con 0x7fd33c1626d0 2024-09-12T02:53:41.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.846+0000 7fd343000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd33c0d3ac0 con 0x7fd33c0d33c0 2024-09-12T02:53:41.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.846+0000 7fd343000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd33c0d1d00 con 0x7fd33c0b2a50 2024-09-12T02:53:41.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.846+0000 7fd341000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd33c0d33c0 0x7fd33c0cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:41.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.846+0000 7fd341000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd33c0d33c0 0x7fd33c0cfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44352/0 (socket says 172.21.15.112:44352) 2024-09-12T02:53:41.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.846+0000 7fd341000640 1 -- 172.21.15.112:0/3542047581 learned_addr learned my addr 172.21.15.112:0/3542047581 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:41.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.846+0000 7fd33b400640 1 --2- 172.21.15.112:0/3542047581 >> v2:172.21.15.137:3300/0 conn(0x7fd33c0b2a50 0x7fd33c0b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:41.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.847+0000 7fd341000640 1 -- 172.21.15.112:0/3542047581 >> v2:172.21.15.137:3300/0 conn(0x7fd33c0b2a50 msgr2=0x7fd33c0b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:41.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.847+0000 7fd341000640 1 --2- 172.21.15.112:0/3542047581 >> v2:172.21.15.137:3300/0 conn(0x7fd33c0b2a50 0x7fd33c0b3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.847+0000 7fd341000640 1 -- 172.21.15.112:0/3542047581 >> v1:172.21.15.137:6789/0 conn(0x7fd33c1626d0 legacy=0x7fd33c0d2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:41.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.847+0000 7fd341000640 1 -- 172.21.15.112:0/3542047581 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd33c0d1fe0 con 0x7fd33c0d33c0 2024-09-12T02:53:41.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.848+0000 7fd341000640 1 --2- 172.21.15.112:0/3542047581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd33c0d33c0 0x7fd33c0cfa70 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fd33c08e750 tx=0x7fd33402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9d8a38794631fe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:41.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.848+0000 7fd33aa00640 1 -- 172.21.15.112:0/3542047581 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd334037070 con 0x7fd33c0d33c0 2024-09-12T02:53:41.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.848+0000 7fd33aa00640 1 -- 172.21.15.112:0/3542047581 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd334032440 con 0x7fd33c0d33c0 2024-09-12T02:53:41.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.848+0000 7fd33aa00640 1 -- 172.21.15.112:0/3542047581 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd334032810 con 0x7fd33c0d33c0 2024-09-12T02:53:41.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.849+0000 7fd343000640 1 -- 172.21.15.112:0/3542047581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd33c0d33c0 msgr2=0x7fd33c0cfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:41.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.849+0000 7fd343000640 1 --2- 172.21.15.112:0/3542047581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd33c0d33c0 0x7fd33c0cfa70 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fd33c08e750 tx=0x7fd33402a270 comp rx=0 tx=0).stop 2024-09-12T02:53:41.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.849+0000 7fd343000640 1 -- 172.21.15.112:0/3542047581 shutdown_connections 2024-09-12T02:53:41.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.849+0000 7fd343000640 1 --2- 172.21.15.112:0/3542047581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd33c0d33c0 0x7fd33c0cfa70 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.849+0000 7fd343000640 1 --2- 172.21.15.112:0/3542047581 >> v2:172.21.15.137:3300/0 conn(0x7fd33c0b2a50 0x7fd33c0b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.849+0000 7fd343000640 1 -- 172.21.15.112:0/3542047581 >> 172.21.15.112:0/3542047581 conn(0x7fd33c0d4db0 msgr2=0x7fd33c0d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:41.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.849+0000 7fd343000640 1 -- 172.21.15.112:0/3542047581 shutdown_connections 2024-09-12T02:53:41.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.849+0000 7fd343000640 1 -- 172.21.15.112:0/3542047581 wait complete. 2024-09-12T02:53:41.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.851+0000 7fd343000640 1 Processor -- start 2024-09-12T02:53:41.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.851+0000 7fd343000640 1 -- start start 2024-09-12T02:53:41.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.852+0000 7fd343000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd33c0b2a50 0x7fd33c1f4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:41.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.852+0000 7fd343000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd33c0d33c0 0x7fd33c0caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:41.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.852+0000 7fd343000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd33c1626d0 0x7fd33c1f7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:41.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.852+0000 7fd343000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd33c162ab0 con 0x7fd33c0d33c0 2024-09-12T02:53:41.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.852+0000 7fd343000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd33c0d3da0 con 0x7fd33c1626d0 2024-09-12T02:53:41.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.852+0000 7fd343000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd33c154af0 con 0x7fd33c0b2a50 2024-09-12T02:53:41.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.852+0000 7fd33b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd33c0d33c0 0x7fd33c0caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:41.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.852+0000 7fd33be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd33c0b2a50 0x7fd33c1f4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:41.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.852+0000 7fd33b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd33c0d33c0 0x7fd33c0caf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44368/0 (socket says 172.21.15.112:44368) 2024-09-12T02:53:41.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.852+0000 7fd33b400640 1 -- 172.21.15.112:0/4109263596 learned_addr learned my addr 172.21.15.112:0/4109263596 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:41.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.852+0000 7fd341000640 1 --2- 172.21.15.112:0/4109263596 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd33c1626d0 0x7fd33c1f7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:41.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.852+0000 7fd33b400640 1 -- 172.21.15.112:0/4109263596 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd33c0b2a50 msgr2=0x7fd33c1f4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:41.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.852+0000 7fd33b400640 1 --2- 172.21.15.112:0/4109263596 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd33c0b2a50 0x7fd33c1f4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.852+0000 7fd33b400640 1 -- 172.21.15.112:0/4109263596 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd33c1626d0 msgr2=0x7fd33c1f7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:41.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.852+0000 7fd33b400640 1 --2- 172.21.15.112:0/4109263596 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd33c1626d0 0x7fd33c1f7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:41.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.852+0000 7fd33b400640 1 -- 172.21.15.112:0/4109263596 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd33c1f48a0 con 0x7fd33c0d33c0 2024-09-12T02:53:41.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.853+0000 7fd33b400640 1 --2- 172.21.15.112:0/4109263596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd33c0d33c0 0x7fd33c0caf40 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fd32400e9b0 tx=0x7fd32400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:41.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.853+0000 7fd333e00640 1 -- 172.21.15.112:0/4109263596 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd324017070 con 0x7fd33c0d33c0 2024-09-12T02:53:41.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.853+0000 7fd333e00640 1 -- 172.21.15.112:0/4109263596 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd32400c9a0 con 0x7fd33c0d33c0 2024-09-12T02:53:41.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.853+0000 7fd333e00640 1 -- 172.21.15.112:0/4109263596 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32400cd90 con 0x7fd33c0d33c0 2024-09-12T02:53:41.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.853+0000 7fd343000640 1 -- 172.21.15.112:0/4109263596 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd33c1f8e00 con 0x7fd33c0d33c0 2024-09-12T02:53:41.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.853+0000 7fd343000640 1 -- 172.21.15.112:0/4109263596 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd33c0b8ae0 con 0x7fd33c0d33c0 2024-09-12T02:53:41.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.855+0000 7fd343000640 1 -- 172.21.15.112:0/4109263596 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd33c0d2ec0 con 0x7fd33c0d33c0 2024-09-12T02:53:41.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.855+0000 7fd333e00640 1 -- 172.21.15.112:0/4109263596 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd32401a070 con 0x7fd33c0d33c0 2024-09-12T02:53:41.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.856+0000 7fd333e00640 1 --2- 172.21.15.112:0/4109263596 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd31806be60 0x7fd31806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:41.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.856+0000 7fd333e00640 1 -- 172.21.15.112:0/4109263596 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 4943+0+0 (secure 0 0 0) 0x7fd32408aa10 con 0x7fd33c0d33c0 2024-09-12T02:53:41.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.856+0000 7fd33be00640 1 --2- 172.21.15.112:0/4109263596 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd31806be60 0x7fd31806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:41.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.857+0000 7fd33be00640 1 --2- 172.21.15.112:0/4109263596 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd31806be60 0x7fd31806e320 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0d5820 tx=0x7fd32c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:41.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:41.861+0000 7fd333e00640 1 -- 172.21.15.112:0/4109263596 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd324059100 con 0x7fd33c0d33c0 2024-09-12T02:53:42.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.038+0000 7fd343000640 1 -- 172.21.15.112:0/4109263596 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd33c068440 con 0x7fd31806be60 2024-09-12T02:53:42.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.039+0000 7fd333e00640 1 -- 172.21.15.112:0/4109263596 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12599 (secure 0 0 0) 0x7fd33c068440 con 0x7fd31806be60 2024-09-12T02:53:42.040 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:53:42.040 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:53:42.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.041+0000 7fd343000640 1 -- 172.21.15.112:0/4109263596 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd31806be60 msgr2=0x7fd31806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:42.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.041+0000 7fd343000640 1 --2- 172.21.15.112:0/4109263596 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd31806be60 0x7fd31806e320 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0d5820 tx=0x7fd32c009040 comp rx=0 tx=0).stop 2024-09-12T02:53:42.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.041+0000 7fd343000640 1 -- 172.21.15.112:0/4109263596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd33c0d33c0 msgr2=0x7fd33c0caf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:42.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.041+0000 7fd343000640 1 --2- 172.21.15.112:0/4109263596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd33c0d33c0 0x7fd33c0caf40 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fd32400e9b0 tx=0x7fd32400ee70 comp rx=0 tx=0).stop 2024-09-12T02:53:42.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.041+0000 7fd343000640 1 -- 172.21.15.112:0/4109263596 shutdown_connections 2024-09-12T02:53:42.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.041+0000 7fd343000640 1 --2- 172.21.15.112:0/4109263596 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd31806be60 0x7fd31806e320 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:42.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.041+0000 7fd343000640 1 --2- 172.21.15.112:0/4109263596 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd33c1626d0 0x7fd33c1f7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:42.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.041+0000 7fd343000640 1 --2- 172.21.15.112:0/4109263596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd33c0d33c0 0x7fd33c0caf40 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:42.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.041+0000 7fd343000640 1 --2- 172.21.15.112:0/4109263596 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd33c0b2a50 0x7fd33c1f4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:42.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.041+0000 7fd343000640 1 -- 172.21.15.112:0/4109263596 >> 172.21.15.112:0/4109263596 conn(0x7fd33c0d4db0 msgr2=0x7fd33c06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:42.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.041+0000 7fd343000640 1 -- 172.21.15.112:0/4109263596 shutdown_connections 2024-09-12T02:53:42.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.041+0000 7fd343000640 1 -- 172.21.15.112:0/4109263596 wait complete. 2024-09-12T02:53:42.058 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":541,"stamp":"2024-09-12T02:53:41.124628+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":111903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1450596,"statfs":{"total":1600000000,"available":1485410598,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52490581,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-130,"num_write_kb":-85086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.815197"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":495,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T02:53:37.327419+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:53:37.327419+0000","last_peered":"2024-09-12T02:53:37.327419+0000","last_clean":"2024-09-12T02:53:37.327419+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:53:37.327419+0000","last_undegraded":"2024-09-12T02:53:37.327419+0000","last_fullsized":"2024-09-12T02:53:37.327419+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:25.823876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574993,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9808,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185504,"statfs":{"total":200000000,"available":189956103,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574993,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19466,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175846,"statfs":{"total":200000000,"available":180066490,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574993,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21514,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173797,"statfs":{"total":200000000,"available":177968958,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574993,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":7237,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":188074,"statfs":{"total":200000000,"available":192588775,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574993,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9231,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":186080,"statfs":{"total":200000000,"available":190546471,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574993,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21519,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173792,"statfs":{"total":200000000,"available":177963559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":13322,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":181990,"statfs":{"total":200000000,"available":186358136,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574993,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185509,"statfs":{"total":200000000,"available":189962106,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:53:42.058 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:53:42.059 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:53:42.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.213+0000 7f87ea000640 1 Processor -- start 2024-09-12T02:53:42.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.213+0000 7f87ea000640 1 -- start start 2024-09-12T02:53:42.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.215+0000 7f87ea000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f87e40b3e00 0x7f87e40d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:42.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.215+0000 7f87ea000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87e40d2fb0 con 0x7f87e40d1710 2024-09-12T02:53:42.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.215+0000 7f87ea000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87e40d0b60 con 0x7f87e40b1d70 2024-09-12T02:53:42.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.215+0000 7f87ea000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f87e40d3cb0 con 0x7f87e40b3e00 2024-09-12T02:53:42.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.215+0000 7f87e8c00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f87e40d1710 0x7f87e40d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38450/0 (socket says 172.21.15.112:38450) 2024-09-12T02:53:42.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.215+0000 7f87e8c00640 1 -- 172.21.15.112:0/4204674347 learned_addr learned my addr 172.21.15.112:0/4204674347 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:53:42.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.215+0000 7f87dbe00640 1 --2- 172.21.15.112:0/4204674347 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f87e40b3e00 0x7f87e40d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:42.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.215+0000 7f87e3e00640 1 -- 172.21.15.112:0/4204674347 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3609070561 0 0) 0x7f87e40d2fb0 con 0x7f87e40d1710 2024-09-12T02:53:42.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.215+0000 7f87e3e00640 1 -- 172.21.15.112:0/4204674347 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87c8003520 con 0x7f87e40d1710 2024-09-12T02:53:42.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.215+0000 7f87e3e00640 1 -- 172.21.15.112:0/4204674347 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 839283535 0 0) 0x7f87e40d0b60 con 0x7f87e40b1d70 2024-09-12T02:53:42.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.215+0000 7f87dbe00640 1 -- 172.21.15.112:0/4204674347 >> v1:172.21.15.137:6789/0 conn(0x7f87e40b1d70 legacy=0x7f87e40b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:42.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.215+0000 7f87dbe00640 1 -- 172.21.15.112:0/4204674347 >> v1:172.21.15.112:6789/0 conn(0x7f87e40d1710 legacy=0x7f87e40d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:42.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.216+0000 7f87dbe00640 1 -- 172.21.15.112:0/4204674347 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e40d3410 con 0x7f87e40b3e00 2024-09-12T02:53:42.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.217+0000 7f87dbe00640 1 --2- 172.21.15.112:0/4204674347 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f87e40b3e00 0x7f87e40d28d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f87cc0097d0 tx=0x7f87cc02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e4e9a5f3bb84151 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:42.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.217+0000 7f87e3e00640 1 -- 172.21.15.112:0/4204674347 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87cc037070 con 0x7f87e40b3e00 2024-09-12T02:53:42.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.217+0000 7f87e3e00640 1 -- 172.21.15.112:0/4204674347 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87cc032440 con 0x7f87e40b3e00 2024-09-12T02:53:42.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.217+0000 7f87e3e00640 1 -- 172.21.15.112:0/4204674347 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87cc0327f0 con 0x7f87e40b3e00 2024-09-12T02:53:42.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.218+0000 7f87ea000640 1 -- 172.21.15.112:0/4204674347 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f87e40b3e00 msgr2=0x7f87e40d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:42.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.218+0000 7f87ea000640 1 --2- 172.21.15.112:0/4204674347 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f87e40b3e00 0x7f87e40d28d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f87cc0097d0 tx=0x7f87cc02a210 comp rx=0 tx=0).stop 2024-09-12T02:53:42.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.218+0000 7f87ea000640 1 -- 172.21.15.112:0/4204674347 shutdown_connections 2024-09-12T02:53:42.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.218+0000 7f87ea000640 1 --2- 172.21.15.112:0/4204674347 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f87e40b3e00 0x7f87e40d28d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:42.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.218+0000 7f87ea000640 1 -- 172.21.15.112:0/4204674347 >> 172.21.15.112:0/4204674347 conn(0x7f87e409e030 msgr2=0x7f87e40d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:42.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.218+0000 7f87ea000640 1 -- 172.21.15.112:0/4204674347 shutdown_connections 2024-09-12T02:53:42.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.218+0000 7f87ea000640 1 -- 172.21.15.112:0/4204674347 wait complete. 2024-09-12T02:53:42.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.219+0000 7f87ea000640 1 Processor -- start 2024-09-12T02:53:42.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.220+0000 7f87ea000640 1 -- start start 2024-09-12T02:53:42.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.220+0000 7f87ea000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f87e40b1d70 0x7f87e41549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:42.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.220+0000 7f87ea000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87e40b3e00 0x7f87e406d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:42.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.220+0000 7f87ea000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87e40d1710 0x7f87e415b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:42.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.220+0000 7f87ea000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f87e415f110 con 0x7f87e40b3e00 2024-09-12T02:53:42.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.220+0000 7f87ea000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f87e40d39d0 con 0x7f87e40d1710 2024-09-12T02:53:42.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.221+0000 7f87ea000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f87e415f290 con 0x7f87e40b1d70 2024-09-12T02:53:42.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.221+0000 7f87dbe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87e40b3e00 0x7f87e406d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:42.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.221+0000 7f87dbe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87e40b3e00 0x7f87e406d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44382/0 (socket says 172.21.15.112:44382) 2024-09-12T02:53:42.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.221+0000 7f87dbe00640 1 -- 172.21.15.112:0/2483551976 learned_addr learned my addr 172.21.15.112:0/2483551976 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:42.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.221+0000 7f87e8c00640 1 --2- 172.21.15.112:0/2483551976 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f87e40b1d70 0x7f87e41549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:42.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.221+0000 7f87e9600640 1 --2- 172.21.15.112:0/2483551976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87e40d1710 0x7f87e415b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:42.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.221+0000 7f87dbe00640 1 -- 172.21.15.112:0/2483551976 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f87e40b1d70 msgr2=0x7f87e41549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:42.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.221+0000 7f87dbe00640 1 --2- 172.21.15.112:0/2483551976 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f87e40b1d70 0x7f87e41549f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:42.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.221+0000 7f87dbe00640 1 -- 172.21.15.112:0/2483551976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87e40d1710 msgr2=0x7f87e415b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:42.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.221+0000 7f87dbe00640 1 --2- 172.21.15.112:0/2483551976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87e40d1710 0x7f87e415b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:42.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.221+0000 7f87dbe00640 1 -- 172.21.15.112:0/2483551976 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e40cdfe0 con 0x7f87e40b3e00 2024-09-12T02:53:42.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.222+0000 7f87dbe00640 1 --2- 172.21.15.112:0/2483551976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87e40b3e00 0x7f87e406d4d0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f87cc02a250 tx=0x7f87cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:42.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.222+0000 7f87e1600640 1 -- 172.21.15.112:0/2483551976 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87cc037040 con 0x7f87e40b3e00 2024-09-12T02:53:42.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.222+0000 7f87e1600640 1 -- 172.21.15.112:0/2483551976 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87cc0044c0 con 0x7f87e40b3e00 2024-09-12T02:53:42.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.222+0000 7f87ea000640 1 -- 172.21.15.112:0/2483551976 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87e40ce2c0 con 0x7f87e40b3e00 2024-09-12T02:53:42.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.222+0000 7f87e1600640 1 -- 172.21.15.112:0/2483551976 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87cc0325f0 con 0x7f87e40b3e00 2024-09-12T02:53:42.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.222+0000 7f87ea000640 1 -- 172.21.15.112:0/2483551976 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87e40ce880 con 0x7f87e40b3e00 2024-09-12T02:53:42.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.223+0000 7f87ea000640 1 -- 172.21.15.112:0/2483551976 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87e40d28d0 con 0x7f87e40b3e00 2024-09-12T02:53:42.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.224+0000 7f87e1600640 1 -- 172.21.15.112:0/2483551976 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f87cc044020 con 0x7f87e40b3e00 2024-09-12T02:53:42.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.225+0000 7f87e1600640 1 --2- 172.21.15.112:0/2483551976 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f87c006be60 0x7f87c006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:42.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.225+0000 7f87e1600640 1 -- 172.21.15.112:0/2483551976 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 4943+0+0 (secure 0 0 0) 0x7f87cc0aaa90 con 0x7f87e40b3e00 2024-09-12T02:53:42.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.225+0000 7f87e8c00640 1 --2- 172.21.15.112:0/2483551976 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f87c006be60 0x7f87c006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:42.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.226+0000 7f87e8c00640 1 --2- 172.21.15.112:0/2483551976 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f87c006be60 0x7f87c006e320 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f87d4005880 tx=0x7f87d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:42.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.229+0000 7f87e1600640 1 -- 172.21.15.112:0/2483551976 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f87cc04b020 con 0x7f87e40b3e00 2024-09-12T02:53:42.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.404+0000 7f87ea000640 1 -- 172.21.15.112:0/2483551976 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f87e41554b0 con 0x7f87c006be60 2024-09-12T02:53:42.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.405+0000 7f87e1600640 1 -- 172.21.15.112:0/2483551976 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12599 (secure 0 0 0) 0x7f87d400f820 con 0x7f87c006be60 2024-09-12T02:53:42.405 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:53:42.406 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:53:42.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.407+0000 7f87ea000640 1 -- 172.21.15.112:0/2483551976 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f87c006be60 msgr2=0x7f87c006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:42.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.407+0000 7f87ea000640 1 --2- 172.21.15.112:0/2483551976 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f87c006be60 0x7f87c006e320 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f87d4005880 tx=0x7f87d4009040 comp rx=0 tx=0).stop 2024-09-12T02:53:42.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.407+0000 7f87ea000640 1 -- 172.21.15.112:0/2483551976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87e40b3e00 msgr2=0x7f87e406d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:42.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.407+0000 7f87ea000640 1 --2- 172.21.15.112:0/2483551976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87e40b3e00 0x7f87e406d4d0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f87cc02a250 tx=0x7f87cc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:53:42.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.407+0000 7f87ea000640 1 -- 172.21.15.112:0/2483551976 shutdown_connections 2024-09-12T02:53:42.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.407+0000 7f87ea000640 1 --2- 172.21.15.112:0/2483551976 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f87c006be60 0x7f87c006e320 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:42.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.407+0000 7f87ea000640 1 --2- 172.21.15.112:0/2483551976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87e40d1710 0x7f87e415b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:42.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.407+0000 7f87ea000640 1 --2- 172.21.15.112:0/2483551976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87e40b3e00 0x7f87e406d4d0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:42.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.407+0000 7f87ea000640 1 --2- 172.21.15.112:0/2483551976 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f87e40b1d70 0x7f87e41549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:42.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.407+0000 7f87ea000640 1 -- 172.21.15.112:0/2483551976 >> 172.21.15.112:0/2483551976 conn(0x7f87e409e030 msgr2=0x7f87e40d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:42.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.407+0000 7f87ea000640 1 -- 172.21.15.112:0/2483551976 shutdown_connections 2024-09-12T02:53:42.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.407+0000 7f87ea000640 1 -- 172.21.15.112:0/2483551976 wait complete. 2024-09-12T02:53:42.423 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":541,"stamp":"2024-09-12T02:53:41.124628+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":111903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1450596,"statfs":{"total":1600000000,"available":1485410598,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52490581,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-130,"num_write_kb":-85086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.815197"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":495,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T02:53:37.327419+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:53:37.327419+0000","last_peered":"2024-09-12T02:53:37.327419+0000","last_clean":"2024-09-12T02:53:37.327419+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:53:37.327419+0000","last_undegraded":"2024-09-12T02:53:37.327419+0000","last_fullsized":"2024-09-12T02:53:37.327419+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:25.823876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574993,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9808,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185504,"statfs":{"total":200000000,"available":189956103,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574993,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19466,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175846,"statfs":{"total":200000000,"available":180066490,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574993,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21514,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173797,"statfs":{"total":200000000,"available":177968958,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574993,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":7237,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":188074,"statfs":{"total":200000000,"available":192588775,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574993,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9231,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":186080,"statfs":{"total":200000000,"available":190546471,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574993,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21519,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173792,"statfs":{"total":200000000,"available":177963559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":13322,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":181990,"statfs":{"total":200000000,"available":186358136,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574993,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185509,"statfs":{"total":200000000,"available":189962106,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:53:42.423 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:53:42.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.577+0000 7fdfddc00640 1 Processor -- start 2024-09-12T02:53:42.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.578+0000 7fdfddc00640 1 -- start start 2024-09-12T02:53:42.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.579+0000 7fdfddc00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdfd80d1710 0x7fdfd80d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:42.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.579+0000 7fdfddc00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdfd80b1d70 0x7fdfd80b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:42.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.579+0000 7fdfddc00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfd80d2fb0 con 0x7fdfd80b3e00 2024-09-12T02:53:42.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.579+0000 7fdfddc00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fdfd80d3cb0 con 0x7fdfd80d1710 2024-09-12T02:53:42.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.579+0000 7fdfddc00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fdfd80d0b60 con 0x7fdfd80b1d70 2024-09-12T02:53:42.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.580+0000 7fdfd7e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdfd80d1710 0x7fdfd80d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:42.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.580+0000 7fdfd7e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdfd80d1710 0x7fdfd80d28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44388/0 (socket says 172.21.15.112:44388) 2024-09-12T02:53:42.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.580+0000 7fdfd7e00640 1 -- 172.21.15.112:0/2114282058 learned_addr learned my addr 172.21.15.112:0/2114282058 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:42.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.580+0000 7fdfcfe00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fdfd80b3e00 0x7fdfd80d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38456/0 (socket says 172.21.15.112:38456) 2024-09-12T02:53:42.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.580+0000 7fdfdd200640 1 --2- 172.21.15.112:0/2114282058 >> v2:172.21.15.137:3300/0 conn(0x7fdfd80b1d70 0x7fdfd80b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:42.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.580+0000 7fdfd7e00640 1 -- 172.21.15.112:0/2114282058 >> v2:172.21.15.137:3300/0 conn(0x7fdfd80b1d70 msgr2=0x7fdfd80b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:42.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.580+0000 7fdfd7e00640 1 --2- 172.21.15.112:0/2114282058 >> v2:172.21.15.137:3300/0 conn(0x7fdfd80b1d70 0x7fdfd80b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:42.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.580+0000 7fdfd7e00640 1 -- 172.21.15.112:0/2114282058 >> v1:172.21.15.112:6789/0 conn(0x7fdfd80b3e00 legacy=0x7fdfd80d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:42.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.580+0000 7fdfd7e00640 1 -- 172.21.15.112:0/2114282058 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfd80d3410 con 0x7fdfd80d1710 2024-09-12T02:53:42.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.581+0000 7fdfd7e00640 1 --2- 172.21.15.112:0/2114282058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfd80d1710 0x7fdfd80d28d0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fdfd808ef20 tx=0x7fdfc802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2058d8f250b3306e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:42.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.581+0000 7fdfd7400640 1 -- 172.21.15.112:0/2114282058 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc8037070 con 0x7fdfd80d1710 2024-09-12T02:53:42.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.581+0000 7fdfd7400640 1 -- 172.21.15.112:0/2114282058 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfc8032440 con 0x7fdfd80d1710 2024-09-12T02:53:42.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.582+0000 7fdfd7400640 1 -- 172.21.15.112:0/2114282058 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc8032810 con 0x7fdfd80d1710 2024-09-12T02:53:42.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.582+0000 7fdfddc00640 1 -- 172.21.15.112:0/2114282058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfd80d1710 msgr2=0x7fdfd80d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:42.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.582+0000 7fdfddc00640 1 --2- 172.21.15.112:0/2114282058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfd80d1710 0x7fdfd80d28d0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fdfd808ef20 tx=0x7fdfc802a270 comp rx=0 tx=0).stop 2024-09-12T02:53:42.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.582+0000 7fdfddc00640 1 -- 172.21.15.112:0/2114282058 shutdown_connections 2024-09-12T02:53:42.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.582+0000 7fdfddc00640 1 --2- 172.21.15.112:0/2114282058 >> v2:172.21.15.137:3300/0 conn(0x7fdfd80b1d70 0x7fdfd80b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:42.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.582+0000 7fdfddc00640 1 --2- 172.21.15.112:0/2114282058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfd80d1710 0x7fdfd80d28d0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:42.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.582+0000 7fdfddc00640 1 -- 172.21.15.112:0/2114282058 >> 172.21.15.112:0/2114282058 conn(0x7fdfd809e030 msgr2=0x7fdfd80d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:42.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.582+0000 7fdfddc00640 1 -- 172.21.15.112:0/2114282058 shutdown_connections 2024-09-12T02:53:42.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.582+0000 7fdfddc00640 1 -- 172.21.15.112:0/2114282058 wait complete. 2024-09-12T02:53:42.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.584+0000 7fdfddc00640 1 Processor -- start 2024-09-12T02:53:42.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.584+0000 7fdfddc00640 1 -- start start 2024-09-12T02:53:42.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.585+0000 7fdfddc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdfd80b1d70 0x7fdfd8156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:42.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.585+0000 7fdfddc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfd80b3e00 0x7fdfd80ba0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:42.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.585+0000 7fdfddc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfd80d1710 0x7fdfd80ba5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:42.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.585+0000 7fdfddc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd815f110 con 0x7fdfd80d1710 2024-09-12T02:53:42.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.585+0000 7fdfddc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd80d39d0 con 0x7fdfd80b3e00 2024-09-12T02:53:42.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.585+0000 7fdfddc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdfd815f290 con 0x7fdfd80b1d70 2024-09-12T02:53:42.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.585+0000 7fdfdd200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfd80d1710 0x7fdfd80ba5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:42.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.585+0000 7fdfdd200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfd80d1710 0x7fdfd80ba5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44398/0 (socket says 172.21.15.112:44398) 2024-09-12T02:53:42.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.585+0000 7fdfdd200640 1 -- 172.21.15.112:0/241883961 learned_addr learned my addr 172.21.15.112:0/241883961 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:42.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.585+0000 7fdfd7e00640 1 --2- 172.21.15.112:0/241883961 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdfd80b1d70 0x7fdfd8156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:42.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.585+0000 7fdfcfe00640 1 --2- 172.21.15.112:0/241883961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfd80b3e00 0x7fdfd80ba0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:42.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.586+0000 7fdfdd200640 1 -- 172.21.15.112:0/241883961 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdfd80b1d70 msgr2=0x7fdfd8156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:42.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.586+0000 7fdfdd200640 1 --2- 172.21.15.112:0/241883961 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdfd80b1d70 0x7fdfd8156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:42.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.586+0000 7fdfdd200640 1 -- 172.21.15.112:0/241883961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfd80b3e00 msgr2=0x7fdfd80ba0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:42.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.586+0000 7fdfdd200640 1 --2- 172.21.15.112:0/241883961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfd80b3e00 0x7fdfd80ba0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:42.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.586+0000 7fdfdd200640 1 -- 172.21.15.112:0/241883961 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfd8156760 con 0x7fdfd80d1710 2024-09-12T02:53:42.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.586+0000 7fdfdd200640 1 --2- 172.21.15.112:0/241883961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfd80d1710 0x7fdfd80ba5e0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0009dd0 tx=0x7fdfd000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:42.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.586+0000 7fdfd4c00640 1 -- 172.21.15.112:0/241883961 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd0018020 con 0x7fdfd80d1710 2024-09-12T02:53:42.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.586+0000 7fdfd4c00640 1 -- 172.21.15.112:0/241883961 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfd0014480 con 0x7fdfd80d1710 2024-09-12T02:53:42.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.586+0000 7fdfd4c00640 1 -- 172.21.15.112:0/241883961 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd0014870 con 0x7fdfd80d1710 2024-09-12T02:53:42.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.586+0000 7fdfddc00640 1 -- 172.21.15.112:0/241883961 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfd80cec10 con 0x7fdfd80d1710 2024-09-12T02:53:42.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.587+0000 7fdfddc00640 1 -- 172.21.15.112:0/241883961 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfd80ce930 con 0x7fdfd80d1710 2024-09-12T02:53:42.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.588+0000 7fdfddc00640 1 -- 172.21.15.112:0/241883961 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfd80d28d0 con 0x7fdfd80d1710 2024-09-12T02:53:42.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.589+0000 7fdfd4c00640 1 -- 172.21.15.112:0/241883961 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdfd0005d10 con 0x7fdfd80d1710 2024-09-12T02:53:42.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.589+0000 7fdfd4c00640 1 --2- 172.21.15.112:0/241883961 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdfb406be30 0x7fdfb406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:42.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.589+0000 7fdfd4c00640 1 -- 172.21.15.112:0/241883961 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 4943+0+0 (secure 0 0 0) 0x7fdfd008b820 con 0x7fdfd80d1710 2024-09-12T02:53:42.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.590+0000 7fdfd7e00640 1 --2- 172.21.15.112:0/241883961 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdfb406be30 0x7fdfb406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:42.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.590+0000 7fdfd7e00640 1 --2- 172.21.15.112:0/241883961 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdfb406be30 0x7fdfb406e2f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8034000 tx=0x7fdfc802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:42.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.594+0000 7fdfd4c00640 1 -- 172.21.15.112:0/241883961 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdfd0022030 con 0x7fdfd80d1710 2024-09-12T02:53:42.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.776+0000 7fdfddc00640 1 -- 172.21.15.112:0/241883961 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdfd806c800 con 0x7fdfd80d1710 2024-09-12T02:53:42.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.777+0000 7fdfd4c00640 1 -- 172.21.15.112:0/241883961 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) ==== 74+0+13093 (secure 0 0 0) 0x7fdfd8156760 con 0x7fdfd80d1710 2024-09-12T02:53:42.778 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:53:42.778 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":190,"fsid":"7c01f3b3-dec2-4449-a33f-f960d7527ea6","created":"2024-09-12T02:41:36.162095+0000","modified":"2024-09-12T02:53:38.321145+0000","last_up_change":"2024-09-12T02:41:42.191169+0000","last_in_change":"2024-09-12T02:41:39.036600+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:41:43.011599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6801","nonce":821571304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6803","nonce":821571304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6807","nonce":821571304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":821571304},{"type":"v1","addr":"172.21.15.112:6805","nonce":821571304}]},"public_addr":"172.21.15.112:6801/821571304","cluster_addr":"172.21.15.112:6803/821571304","heartbeat_back_addr":"172.21.15.112:6807/821571304","heartbeat_front_addr":"172.21.15.112:6805/821571304","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6809","nonce":2642068641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6811","nonce":2642068641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6815","nonce":2642068641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2642068641},{"type":"v1","addr":"172.21.15.112:6813","nonce":2642068641}]},"public_addr":"172.21.15.112:6809/2642068641","cluster_addr":"172.21.15.112:6811/2642068641","heartbeat_back_addr":"172.21.15.112:6815/2642068641","heartbeat_front_addr":"172.21.15.112:6813/2642068641","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6817","nonce":3365688807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6819","nonce":3365688807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6823","nonce":3365688807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3365688807},{"type":"v1","addr":"172.21.15.112:6821","nonce":3365688807}]},"public_addr":"172.21.15.112:6817/3365688807","cluster_addr":"172.21.15.112:6819/3365688807","heartbeat_back_addr":"172.21.15.112:6823/3365688807","heartbeat_front_addr":"172.21.15.112:6821/3365688807","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6825","nonce":231774278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6827","nonce":231774278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6831","nonce":231774278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":231774278},{"type":"v1","addr":"172.21.15.112:6829","nonce":231774278}]},"public_addr":"172.21.15.112:6825/231774278","cluster_addr":"172.21.15.112:6827/231774278","heartbeat_back_addr":"172.21.15.112:6831/231774278","heartbeat_front_addr":"172.21.15.112:6829/231774278","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6801","nonce":3671178153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6803","nonce":3671178153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6807","nonce":3671178153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3671178153},{"type":"v1","addr":"172.21.15.137:6805","nonce":3671178153}]},"public_addr":"172.21.15.137:6801/3671178153","cluster_addr":"172.21.15.137:6803/3671178153","heartbeat_back_addr":"172.21.15.137:6807/3671178153","heartbeat_front_addr":"172.21.15.137:6805/3671178153","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6809","nonce":3193706134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6811","nonce":3193706134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6817","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6819","nonce":3193706134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3193706134},{"type":"v1","addr":"172.21.15.137:6815","nonce":3193706134}]},"public_addr":"172.21.15.137:6809/3193706134","cluster_addr":"172.21.15.137:6811/3193706134","heartbeat_back_addr":"172.21.15.137:6819/3193706134","heartbeat_front_addr":"172.21.15.137:6815/3193706134","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6814","nonce":3738813293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6818","nonce":3738813293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6823","nonce":3738813293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3738813293},{"type":"v1","addr":"172.21.15.137:6821","nonce":3738813293}]},"public_addr":"172.21.15.137:6814/3738813293","cluster_addr":"172.21.15.137:6818/3738813293","heartbeat_back_addr":"172.21.15.137:6823/3738813293","heartbeat_front_addr":"172.21.15.137:6821/3738813293","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6825","nonce":1421932609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6827","nonce":1421932609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6831","nonce":1421932609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1421932609},{"type":"v1","addr":"172.21.15.137:6829","nonce":1421932609}]},"public_addr":"172.21.15.137:6825/1421932609","cluster_addr":"172.21.15.137:6827/1421932609","heartbeat_back_addr":"172.21.15.137:6831/1421932609","heartbeat_front_addr":"172.21.15.137:6829/1421932609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.220641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.282771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.260478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.273397+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.312452+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.308965+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:40.337842+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6835/1283773082":"2024-09-13T02:53:35.306725+0000","172.21.15.137:6833/1283773082":"2024-09-13T02:53:35.306725+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:53:42.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.779+0000 7fdfddc00640 1 -- 172.21.15.112:0/241883961 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdfb406be30 msgr2=0x7fdfb406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:42.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.779+0000 7fdfddc00640 1 --2- 172.21.15.112:0/241883961 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdfb406be30 0x7fdfb406e2f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8034000 tx=0x7fdfc802e000 comp rx=0 tx=0).stop 2024-09-12T02:53:42.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.779+0000 7fdfddc00640 1 -- 172.21.15.112:0/241883961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfd80d1710 msgr2=0x7fdfd80ba5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:42.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.779+0000 7fdfddc00640 1 --2- 172.21.15.112:0/241883961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfd80d1710 0x7fdfd80ba5e0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0009dd0 tx=0x7fdfd000c490 comp rx=0 tx=0).stop 2024-09-12T02:53:42.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.780+0000 7fdfddc00640 1 -- 172.21.15.112:0/241883961 shutdown_connections 2024-09-12T02:53:42.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.780+0000 7fdfddc00640 1 --2- 172.21.15.112:0/241883961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfd80d1710 0x7fdfd80ba5e0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:42.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.780+0000 7fdfddc00640 1 --2- 172.21.15.112:0/241883961 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fdfb406be30 0x7fdfb406e2f0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:42.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.780+0000 7fdfddc00640 1 --2- 172.21.15.112:0/241883961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfd80b3e00 0x7fdfd80ba0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:42.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.780+0000 7fdfddc00640 1 --2- 172.21.15.112:0/241883961 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdfd80b1d70 0x7fdfd8156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:42.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.780+0000 7fdfddc00640 1 -- 172.21.15.112:0/241883961 >> 172.21.15.112:0/241883961 conn(0x7fdfd809e030 msgr2=0x7fdfd80d5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:42.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.780+0000 7fdfddc00640 1 -- 172.21.15.112:0/241883961 shutdown_connections 2024-09-12T02:53:42.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:42.780+0000 7fdfddc00640 1 -- 172.21.15.112:0/241883961 wait complete. 2024-09-12T02:53:43.797 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T02:53:43.797 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:53:43.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.959+0000 7fb135c00640 1 Processor -- start 2024-09-12T02:53:43.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.959+0000 7fb135c00640 1 -- start start 2024-09-12T02:53:43.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.961+0000 7fb135c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb13006efb0 0x7fb13006f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:43.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.961+0000 7fb135c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb13015f840 0x7fb1300cf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:43.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.961+0000 7fb135c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb13015fcd0 con 0x7fb13015f3d0 2024-09-12T02:53:43.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.961+0000 7fb135c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb13015ce00 con 0x7fb13006efb0 2024-09-12T02:53:43.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.961+0000 7fb135c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb13015ffb0 con 0x7fb13015f840 2024-09-12T02:53:43.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.961+0000 7fb12fe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb13006efb0 0x7fb13006f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:43.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.961+0000 7fb12fe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb13006efb0 0x7fb13006f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44406/0 (socket says 172.21.15.112:44406) 2024-09-12T02:53:43.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.961+0000 7fb12fe00640 1 -- 172.21.15.112:0/4169500870 learned_addr learned my addr 172.21.15.112:0/4169500870 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:43.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.961+0000 7fb12fe00640 1 -- 172.21.15.112:0/4169500870 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb13015f840 msgr2=0x7fb1300cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:43.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.961+0000 7fb12fe00640 1 --2- 172.21.15.112:0/4169500870 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb13015f840 0x7fb1300cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:43.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.961+0000 7fb12fe00640 1 -- 172.21.15.112:0/4169500870 >> v1:172.21.15.137:6789/0 conn(0x7fb13015f3d0 legacy=0x7fb13015c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:43.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.961+0000 7fb12fe00640 1 -- 172.21.15.112:0/4169500870 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb130160290 con 0x7fb13006efb0 2024-09-12T02:53:43.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.962+0000 7fb12fe00640 1 --2- 172.21.15.112:0/4169500870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb13006efb0 0x7fb13006f390 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fb120009e50 tx=0x7fb12002a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec2f2434e52b5ab9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:43.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.963+0000 7fb12ea00640 1 -- 172.21.15.112:0/4169500870 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb120036070 con 0x7fb13006efb0 2024-09-12T02:53:43.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.963+0000 7fb12ea00640 1 -- 172.21.15.112:0/4169500870 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb120031600 con 0x7fb13006efb0 2024-09-12T02:53:43.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.963+0000 7fb12ea00640 1 -- 172.21.15.112:0/4169500870 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1200319d0 con 0x7fb13006efb0 2024-09-12T02:53:43.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.963+0000 7fb135c00640 1 -- 172.21.15.112:0/4169500870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb13006efb0 msgr2=0x7fb13006f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:43.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.963+0000 7fb135c00640 1 --2- 172.21.15.112:0/4169500870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb13006efb0 0x7fb13006f390 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fb120009e50 tx=0x7fb12002a6d0 comp rx=0 tx=0).stop 2024-09-12T02:53:43.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.963+0000 7fb135c00640 1 -- 172.21.15.112:0/4169500870 shutdown_connections 2024-09-12T02:53:43.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.963+0000 7fb135c00640 1 --2- 172.21.15.112:0/4169500870 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb13015f840 0x7fb1300cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:43.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.963+0000 7fb135c00640 1 --2- 172.21.15.112:0/4169500870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb13006efb0 0x7fb13006f390 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:43.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.963+0000 7fb135c00640 1 -- 172.21.15.112:0/4169500870 >> 172.21.15.112:0/4169500870 conn(0x7fb13006bdb0 msgr2=0x7fb13006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:43.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.963+0000 7fb135c00640 1 -- 172.21.15.112:0/4169500870 shutdown_connections 2024-09-12T02:53:43.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.963+0000 7fb135c00640 1 -- 172.21.15.112:0/4169500870 wait complete. 2024-09-12T02:53:43.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.965+0000 7fb135c00640 1 Processor -- start 2024-09-12T02:53:43.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.965+0000 7fb135c00640 1 -- start start 2024-09-12T02:53:43.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.966+0000 7fb135c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb13006efb0 0x7fb13013e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:43.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.966+0000 7fb135c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb13015f3d0 0x7fb13013b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:43.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.966+0000 7fb135c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb13013d2e0 0x7fb13013d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:43.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.966+0000 7fb135c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb1300cfe60 con 0x7fb13013d2e0 2024-09-12T02:53:43.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.966+0000 7fb135c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb13015c1d0 con 0x7fb13006efb0 2024-09-12T02:53:43.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.966+0000 7fb135c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb1300cffe0 con 0x7fb13015f3d0 2024-09-12T02:53:43.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.966+0000 7fb135200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb13013d2e0 0x7fb13013d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:43.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.966+0000 7fb135200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb13013d2e0 0x7fb13013d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44410/0 (socket says 172.21.15.112:44410) 2024-09-12T02:53:43.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.966+0000 7fb135200640 1 -- 172.21.15.112:0/2676623756 learned_addr learned my addr 172.21.15.112:0/2676623756 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:43.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.966+0000 7fb12f400640 1 --2- 172.21.15.112:0/2676623756 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb13015f3d0 0x7fb13013b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:43.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.966+0000 7fb12fe00640 1 --2- 172.21.15.112:0/2676623756 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb13006efb0 0x7fb13013e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:43.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.966+0000 7fb135200640 1 -- 172.21.15.112:0/2676623756 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb13015f3d0 msgr2=0x7fb13013b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:43.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.966+0000 7fb135200640 1 --2- 172.21.15.112:0/2676623756 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb13015f3d0 0x7fb13013b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:43.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.966+0000 7fb135200640 1 -- 172.21.15.112:0/2676623756 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb13006efb0 msgr2=0x7fb13013e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:43.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.966+0000 7fb135200640 1 --2- 172.21.15.112:0/2676623756 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb13006efb0 0x7fb13013e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:43.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.966+0000 7fb135200640 1 -- 172.21.15.112:0/2676623756 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1300aec70 con 0x7fb13013d2e0 2024-09-12T02:53:43.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.966+0000 7fb12f400640 1 --2- 172.21.15.112:0/2676623756 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb13015f3d0 0x7fb13013b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:53:43.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.967+0000 7fb135200640 1 --2- 172.21.15.112:0/2676623756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb13013d2e0 0x7fb13013d770 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fb12800b410 tx=0x7fb12800b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:43.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.967+0000 7fb127e00640 1 -- 172.21.15.112:0/2676623756 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb128015020 con 0x7fb13013d2e0 2024-09-12T02:53:43.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.967+0000 7fb127e00640 1 -- 172.21.15.112:0/2676623756 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb128011830 con 0x7fb13013d2e0 2024-09-12T02:53:43.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.967+0000 7fb135c00640 1 -- 172.21.15.112:0/2676623756 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1300aef50 con 0x7fb13013d2e0 2024-09-12T02:53:43.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.967+0000 7fb127e00640 1 -- 172.21.15.112:0/2676623756 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb128011c20 con 0x7fb13013d2e0 2024-09-12T02:53:43.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.967+0000 7fb135c00640 1 -- 172.21.15.112:0/2676623756 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1300af510 con 0x7fb13013d2e0 2024-09-12T02:53:43.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.968+0000 7fb135c00640 1 -- 172.21.15.112:0/2676623756 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb13013bdc0 con 0x7fb13013d2e0 2024-09-12T02:53:43.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.969+0000 7fb127e00640 1 -- 172.21.15.112:0/2676623756 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb128018020 con 0x7fb13013d2e0 2024-09-12T02:53:43.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.970+0000 7fb127e00640 1 --2- 172.21.15.112:0/2676623756 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb11006be30 0x7fb11006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:43.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.970+0000 7fb127e00640 1 -- 172.21.15.112:0/2676623756 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 4943+0+0 (secure 0 0 0) 0x7fb12808aa20 con 0x7fb13013d2e0 2024-09-12T02:53:43.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.970+0000 7fb12fe00640 1 --2- 172.21.15.112:0/2676623756 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb11006be30 0x7fb11006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:43.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.970+0000 7fb127e00640 1 --2- 172.21.15.112:0/2676623756 >> [v2:172.21.15.112:6800/821571304,v1:172.21.15.112:6801/821571304] conn(0x7fb110071cf0 0x7fb110074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:43.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.970+0000 7fb127e00640 1 -- 172.21.15.112:0/2676623756 --> [v2:172.21.15.112:6800/821571304,v1:172.21.15.112:6801/821571304] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb1100747c0 con 0x7fb110071cf0 2024-09-12T02:53:43.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.970+0000 7fb127e00640 1 -- 172.21.15.112:0/2676623756 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=190) ==== 24+0+0 (secure 0 0 0) 0x7fb12808f2a0 con 0x7fb13013d2e0 2024-09-12T02:53:43.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.970+0000 7fb12f400640 1 --2- 172.21.15.112:0/2676623756 >> [v2:172.21.15.112:6800/821571304,v1:172.21.15.112:6801/821571304] conn(0x7fb110071cf0 0x7fb110074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:43.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.971+0000 7fb12fe00640 1 --2- 172.21.15.112:0/2676623756 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb11006be30 0x7fb11006e2f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb120033000 tx=0x7fb120009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:43.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.971+0000 7fb12f400640 1 --2- 172.21.15.112:0/2676623756 >> [v2:172.21.15.112:6800/821571304,v1:172.21.15.112:6801/821571304] conn(0x7fb110071cf0 0x7fb110074110 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:43.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.972+0000 7fb127e00640 1 -- 172.21.15.112:0/2676623756 <== osd.0 v2:172.21.15.112:6800/821571304 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7fb1100747c0 con 0x7fb110071cf0 2024-09-12T02:53:43.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.983+0000 7fb135c00640 1 -- 172.21.15.112:0/2676623756 --> [v2:172.21.15.112:6800/821571304,v1:172.21.15.112:6801/821571304] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb1300cf920 con 0x7fb110071cf0 2024-09-12T02:53:43.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.984+0000 7fb127e00640 1 -- 172.21.15.112:0/2676623756 <== osd.0 v2:172.21.15.112:6800/821571304 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7fb1300cf920 con 0x7fb110071cf0 2024-09-12T02:53:43.985 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:53:43.985 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-12T02:53:43.985 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:53:43.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.984+0000 7fb135c00640 1 -- 172.21.15.112:0/2676623756 >> [v2:172.21.15.112:6800/821571304,v1:172.21.15.112:6801/821571304] conn(0x7fb110071cf0 msgr2=0x7fb110074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:43.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.984+0000 7fb135c00640 1 --2- 172.21.15.112:0/2676623756 >> [v2:172.21.15.112:6800/821571304,v1:172.21.15.112:6801/821571304] conn(0x7fb110071cf0 0x7fb110074110 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:43.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.984+0000 7fb135c00640 1 -- 172.21.15.112:0/2676623756 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb11006be30 msgr2=0x7fb11006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:43.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.984+0000 7fb135c00640 1 --2- 172.21.15.112:0/2676623756 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fb11006be30 0x7fb11006e2f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb120033000 tx=0x7fb120009000 comp rx=0 tx=0).stop 2024-09-12T02:53:43.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.984+0000 7fb135c00640 1 -- 172.21.15.112:0/2676623756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb13013d2e0 msgr2=0x7fb13013d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:43.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.984+0000 7fb135c00640 1 --2- 172.21.15.112:0/2676623756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb13013d2e0 0x7fb13013d770 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fb12800b410 tx=0x7fb12800b810 comp rx=0 tx=0).stop 2024-09-12T02:53:43.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.984+0000 7fb135200640 1 -- 172.21.15.112:0/2676623756 reap_dead start 2024-09-12T02:53:43.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.984+0000 7fb135c00640 1 -- 172.21.15.112:0/2676623756 shutdown_connections 2024-09-12T02:53:43.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.984+0000 7fb135c00640 1 -- 172.21.15.112:0/2676623756 >> 172.21.15.112:0/2676623756 conn(0x7fb13006bdb0 msgr2=0x7fb130072560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:43.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.984+0000 7fb135c00640 1 -- 172.21.15.112:0/2676623756 shutdown_connections 2024-09-12T02:53:43.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:43.984+0000 7fb135c00640 1 -- 172.21.15.112:0/2676623756 wait complete. 2024-09-12T02:53:44.000 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T02:53:44.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.153+0000 7fbf76e00640 1 Processor -- start 2024-09-12T02:53:44.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.153+0000 7fbf76e00640 1 -- start start 2024-09-12T02:53:44.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.154+0000 7fbf76e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf70162100 0x7fbf700d58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:44.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.154+0000 7fbf76e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbf700d0510 0x7fbf700d0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:44.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.154+0000 7fbf76e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf700cfa70 con 0x7fbf701624e0 2024-09-12T02:53:44.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.154+0000 7fbf76e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fbf700b4e20 con 0x7fbf700d0510 2024-09-12T02:53:44.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.154+0000 7fbf76e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbf700d21d0 con 0x7fbf70162100 2024-09-12T02:53:44.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.155+0000 7fbf6f400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fbf701624e0 0x7fbf700b4710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38472/0 (socket says 172.21.15.112:38472) 2024-09-12T02:53:44.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.155+0000 7fbf6f400640 1 -- 172.21.15.112:0/3741084558 learned_addr learned my addr 172.21.15.112:0/3741084558 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:53:44.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.155+0000 7fbf74e00640 1 --2- 172.21.15.112:0/3741084558 >> v2:172.21.15.112:3300/0 conn(0x7fbf700d0510 0x7fbf700d0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:44.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.155+0000 7fbf6fe00640 1 --2- 172.21.15.112:0/3741084558 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf70162100 0x7fbf700d58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:44.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.155+0000 7fbf6ea00640 1 -- 172.21.15.112:0/3741084558 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1284640609 0 0) 0x7fbf700cfa70 con 0x7fbf701624e0 2024-09-12T02:53:44.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.155+0000 7fbf6ea00640 1 -- 172.21.15.112:0/3741084558 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf54003520 con 0x7fbf701624e0 2024-09-12T02:53:44.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.155+0000 7fbf74e00640 1 -- 172.21.15.112:0/3741084558 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf70162100 msgr2=0x7fbf700d58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:44.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.155+0000 7fbf74e00640 1 --2- 172.21.15.112:0/3741084558 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf70162100 0x7fbf700d58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:44.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.155+0000 7fbf74e00640 1 -- 172.21.15.112:0/3741084558 >> v1:172.21.15.112:6789/0 conn(0x7fbf701624e0 legacy=0x7fbf700b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:44.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.155+0000 7fbf74e00640 1 -- 172.21.15.112:0/3741084558 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf700d24b0 con 0x7fbf700d0510 2024-09-12T02:53:44.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.156+0000 7fbf74e00640 1 --2- 172.21.15.112:0/3741084558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf700d0510 0x7fbf700d0940 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fbf700cfc40 tx=0x7fbf6802a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608803df014de6b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:44.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.156+0000 7fbf6ea00640 1 -- 172.21.15.112:0/3741084558 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf68007740 con 0x7fbf700d0510 2024-09-12T02:53:44.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.156+0000 7fbf6ea00640 1 -- 172.21.15.112:0/3741084558 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf680078e0 con 0x7fbf700d0510 2024-09-12T02:53:44.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.156+0000 7fbf6ea00640 1 -- 172.21.15.112:0/3741084558 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf68007cb0 con 0x7fbf700d0510 2024-09-12T02:53:44.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.157+0000 7fbf76e00640 1 -- 172.21.15.112:0/3741084558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf700d0510 msgr2=0x7fbf700d0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:44.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.157+0000 7fbf76e00640 1 --2- 172.21.15.112:0/3741084558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf700d0510 0x7fbf700d0940 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fbf700cfc40 tx=0x7fbf6802a5b0 comp rx=0 tx=0).stop 2024-09-12T02:53:44.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.157+0000 7fbf76e00640 1 -- 172.21.15.112:0/3741084558 shutdown_connections 2024-09-12T02:53:44.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.157+0000 7fbf76e00640 1 --2- 172.21.15.112:0/3741084558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf700d0510 0x7fbf700d0940 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:44.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.157+0000 7fbf76e00640 1 --2- 172.21.15.112:0/3741084558 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf70162100 0x7fbf700d58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:44.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.157+0000 7fbf76e00640 1 -- 172.21.15.112:0/3741084558 >> 172.21.15.112:0/3741084558 conn(0x7fbf700d4db0 msgr2=0x7fbf700d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:44.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.157+0000 7fbf76e00640 1 -- 172.21.15.112:0/3741084558 shutdown_connections 2024-09-12T02:53:44.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.157+0000 7fbf76e00640 1 -- 172.21.15.112:0/3741084558 wait complete. 2024-09-12T02:53:44.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.159+0000 7fbf76e00640 1 Processor -- start 2024-09-12T02:53:44.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.159+0000 7fbf76e00640 1 -- start start 2024-09-12T02:53:44.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.160+0000 7fbf76e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf700d0510 0x7fbf700b90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:44.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.160+0000 7fbf76e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf70162100 0x7fbf700caab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:44.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.160+0000 7fbf76e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf701624e0 0x7fbf700caff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:44.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.160+0000 7fbf76e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbf700d0e80 con 0x7fbf701624e0 2024-09-12T02:53:44.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.160+0000 7fbf76e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbf700cfff0 con 0x7fbf700d0510 2024-09-12T02:53:44.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.160+0000 7fbf76e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbf700d1df0 con 0x7fbf70162100 2024-09-12T02:53:44.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.160+0000 7fbf74e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf701624e0 0x7fbf700caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:44.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.160+0000 7fbf74e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf701624e0 0x7fbf700caff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44428/0 (socket says 172.21.15.112:44428) 2024-09-12T02:53:44.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.160+0000 7fbf74e00640 1 -- 172.21.15.112:0/3210047663 learned_addr learned my addr 172.21.15.112:0/3210047663 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:44.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.160+0000 7fbf6fe00640 1 --2- 172.21.15.112:0/3210047663 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf700d0510 0x7fbf700b90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:44.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.160+0000 7fbf6f400640 1 --2- 172.21.15.112:0/3210047663 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf70162100 0x7fbf700caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:44.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.160+0000 7fbf74e00640 1 -- 172.21.15.112:0/3210047663 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf70162100 msgr2=0x7fbf700caab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:44.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.160+0000 7fbf74e00640 1 --2- 172.21.15.112:0/3210047663 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf70162100 0x7fbf700caab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:44.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.160+0000 7fbf74e00640 1 -- 172.21.15.112:0/3210047663 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf700d0510 msgr2=0x7fbf700b90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:44.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.160+0000 7fbf74e00640 1 --2- 172.21.15.112:0/3210047663 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf700d0510 0x7fbf700b90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:44.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.160+0000 7fbf74e00640 1 -- 172.21.15.112:0/3210047663 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf700ccb10 con 0x7fbf701624e0 2024-09-12T02:53:44.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.160+0000 7fbf6fe00640 1 --2- 172.21.15.112:0/3210047663 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf700d0510 0x7fbf700b90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:53:44.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.161+0000 7fbf74e00640 1 --2- 172.21.15.112:0/3210047663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf701624e0 0x7fbf700caff0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fbf6802aba0 tx=0x7fbf68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:44.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.161+0000 7fbf67e00640 1 -- 172.21.15.112:0/3210047663 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6803f070 con 0x7fbf701624e0 2024-09-12T02:53:44.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.161+0000 7fbf67e00640 1 -- 172.21.15.112:0/3210047663 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf68031bc0 con 0x7fbf701624e0 2024-09-12T02:53:44.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.161+0000 7fbf76e00640 1 -- 172.21.15.112:0/3210047663 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf700ccdf0 con 0x7fbf701624e0 2024-09-12T02:53:44.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.161+0000 7fbf67e00640 1 -- 172.21.15.112:0/3210047663 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf68009450 con 0x7fbf701624e0 2024-09-12T02:53:44.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.161+0000 7fbf76e00640 1 -- 172.21.15.112:0/3210047663 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf700cd3b0 con 0x7fbf701624e0 2024-09-12T02:53:44.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.162+0000 7fbf76e00640 1 -- 172.21.15.112:0/3210047663 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf70162b80 con 0x7fbf701624e0 2024-09-12T02:53:44.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.163+0000 7fbf67e00640 1 -- 172.21.15.112:0/3210047663 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbf68044460 con 0x7fbf701624e0 2024-09-12T02:53:44.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.164+0000 7fbf67e00640 1 --2- 172.21.15.112:0/3210047663 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbf5006be30 0x7fbf5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:44.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.164+0000 7fbf67e00640 1 -- 172.21.15.112:0/3210047663 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 4943+0+0 (secure 0 0 0) 0x7fbf680ac2a0 con 0x7fbf701624e0 2024-09-12T02:53:44.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.164+0000 7fbf6fe00640 1 --2- 172.21.15.112:0/3210047663 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbf5006be30 0x7fbf5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:44.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.165+0000 7fbf6fe00640 1 --2- 172.21.15.112:0/3210047663 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbf5006be30 0x7fbf5006e2f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fbf700b3390 tx=0x7fbf60008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:44.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.169+0000 7fbf67e00640 1 -- 172.21.15.112:0/3210047663 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbf6807aeb0 con 0x7fbf701624e0 2024-09-12T02:53:44.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.341+0000 7fbf76e00640 1 -- 172.21.15.112:0/3210047663 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fbf70068440 con 0x7fbf5006be30 2024-09-12T02:53:44.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.341+0000 7fbf67e00640 1 -- 172.21.15.112:0/3210047663 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbf70068440 con 0x7fbf5006be30 2024-09-12T02:53:44.342 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T02:53:44.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.343+0000 7fbf76e00640 1 -- 172.21.15.112:0/3210047663 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbf5006be30 msgr2=0x7fbf5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:44.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.343+0000 7fbf76e00640 1 --2- 172.21.15.112:0/3210047663 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbf5006be30 0x7fbf5006e2f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fbf700b3390 tx=0x7fbf60008040 comp rx=0 tx=0).stop 2024-09-12T02:53:44.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.343+0000 7fbf76e00640 1 -- 172.21.15.112:0/3210047663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf701624e0 msgr2=0x7fbf700caff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:44.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.343+0000 7fbf76e00640 1 --2- 172.21.15.112:0/3210047663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf701624e0 0x7fbf700caff0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fbf6802aba0 tx=0x7fbf68004a40 comp rx=0 tx=0).stop 2024-09-12T02:53:44.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.343+0000 7fbf76e00640 1 -- 172.21.15.112:0/3210047663 shutdown_connections 2024-09-12T02:53:44.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.343+0000 7fbf76e00640 1 --2- 172.21.15.112:0/3210047663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf701624e0 0x7fbf700caff0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:44.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.343+0000 7fbf76e00640 1 --2- 172.21.15.112:0/3210047663 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf70162100 0x7fbf700caab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:44.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.343+0000 7fbf76e00640 1 --2- 172.21.15.112:0/3210047663 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbf5006be30 0x7fbf5006e2f0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:44.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.343+0000 7fbf76e00640 1 --2- 172.21.15.112:0/3210047663 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf700d0510 0x7fbf700b90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:44.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.343+0000 7fbf76e00640 1 -- 172.21.15.112:0/3210047663 >> 172.21.15.112:0/3210047663 conn(0x7fbf700d4db0 msgr2=0x7fbf700b67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:44.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.343+0000 7fbf76e00640 1 -- 172.21.15.112:0/3210047663 shutdown_connections 2024-09-12T02:53:44.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.343+0000 7fbf76e00640 1 -- 172.21.15.112:0/3210047663 wait complete. 2024-09-12T02:53:44.360 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T02:53:44.360 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:53:44.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.515+0000 7f18fca00640 1 Processor -- start 2024-09-12T02:53:44.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.515+0000 7f18fca00640 1 -- start start 2024-09-12T02:53:44.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.516+0000 7f18fca00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f18f806f390 0x7f18f815c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:44.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.516+0000 7f18fca00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18f806f800 con 0x7f18f80cf920 2024-09-12T02:53:44.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.516+0000 7f18fca00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18f815fcd0 con 0x7f18f806efb0 2024-09-12T02:53:44.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.516+0000 7f18fca00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f18f815ffb0 con 0x7f18f806f390 2024-09-12T02:53:44.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.516+0000 7f18f5e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f18f806f390 0x7f18f815c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:44.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.516+0000 7f18f5e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f18f806f390 0x7f18f815c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44438/0 (socket says 172.21.15.112:44438) 2024-09-12T02:53:44.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.516+0000 7f18f7200640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f18f80cf920 0x7f18f80b39c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38476/0 (socket says 172.21.15.112:38476) 2024-09-12T02:53:44.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.516+0000 7f18f5e00640 1 -- 172.21.15.112:0/4236345250 learned_addr learned my addr 172.21.15.112:0/4236345250 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:44.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.517+0000 7f18f5e00640 1 -- 172.21.15.112:0/4236345250 >> v1:172.21.15.137:6789/0 conn(0x7f18f806efb0 legacy=0x7f18f815f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:44.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.517+0000 7f18f5e00640 1 -- 172.21.15.112:0/4236345250 >> v1:172.21.15.112:6789/0 conn(0x7f18f80cf920 legacy=0x7f18f80b39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:44.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.517+0000 7f18f5e00640 1 -- 172.21.15.112:0/4236345250 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f8160290 con 0x7f18f806f390 2024-09-12T02:53:44.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.518+0000 7f18f5e00640 1 --2- 172.21.15.112:0/4236345250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18f806f390 0x7f18f815c6f0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f18e4009870 tx=0x7f18e402c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbff064657f1b880 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:44.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.518+0000 7f18f5400640 1 -- 172.21.15.112:0/4236345250 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e4038070 con 0x7f18f806f390 2024-09-12T02:53:44.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.518+0000 7f18f5400640 1 -- 172.21.15.112:0/4236345250 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18e4031710 con 0x7f18f806f390 2024-09-12T02:53:44.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.518+0000 7f18f5400640 1 -- 172.21.15.112:0/4236345250 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e4031ae0 con 0x7f18f806f390 2024-09-12T02:53:44.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.519+0000 7f18fca00640 1 -- 172.21.15.112:0/4236345250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18f806f390 msgr2=0x7f18f815c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:44.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.519+0000 7f18fca00640 1 --2- 172.21.15.112:0/4236345250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18f806f390 0x7f18f815c6f0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f18e4009870 tx=0x7f18e402c510 comp rx=0 tx=0).stop 2024-09-12T02:53:44.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.519+0000 7f18fca00640 1 -- 172.21.15.112:0/4236345250 shutdown_connections 2024-09-12T02:53:44.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.519+0000 7f18fca00640 1 --2- 172.21.15.112:0/4236345250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18f806f390 0x7f18f815c6f0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:44.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.519+0000 7f18fca00640 1 -- 172.21.15.112:0/4236345250 >> 172.21.15.112:0/4236345250 conn(0x7f18f806bdb0 msgr2=0x7f18f806c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:44.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.519+0000 7f18fca00640 1 -- 172.21.15.112:0/4236345250 shutdown_connections 2024-09-12T02:53:44.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.519+0000 7f18fca00640 1 -- 172.21.15.112:0/4236345250 wait complete. 2024-09-12T02:53:44.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.520+0000 7f18fca00640 1 Processor -- start 2024-09-12T02:53:44.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.521+0000 7f18fca00640 1 -- start start 2024-09-12T02:53:44.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.521+0000 7f18fca00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18f806efb0 0x7f18f813e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:44.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.521+0000 7f18fca00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18f806f390 0x7f18f81537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:44.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.521+0000 7f18fca00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18f80cf920 0x7f18f80b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:44.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.521+0000 7f18fca00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f18f815cc30 con 0x7f18f806f390 2024-09-12T02:53:44.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.521+0000 7f18fca00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f18f815c1d0 con 0x7f18f80cf920 2024-09-12T02:53:44.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.521+0000 7f18fca00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f18f815cdb0 con 0x7f18f806efb0 2024-09-12T02:53:44.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.522+0000 7f18f5e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18f806f390 0x7f18f81537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:44.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.522+0000 7f18f5e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18f806f390 0x7f18f81537f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44450/0 (socket says 172.21.15.112:44450) 2024-09-12T02:53:44.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.522+0000 7f18f5e00640 1 -- 172.21.15.112:0/1000648853 learned_addr learned my addr 172.21.15.112:0/1000648853 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:44.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.522+0000 7f18f6800640 1 --2- 172.21.15.112:0/1000648853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18f806efb0 0x7f18f813e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:44.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.522+0000 7f18f7200640 1 --2- 172.21.15.112:0/1000648853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18f80cf920 0x7f18f80b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:44.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.522+0000 7f18f5e00640 1 -- 172.21.15.112:0/1000648853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18f806efb0 msgr2=0x7f18f813e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:44.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.522+0000 7f18f5e00640 1 --2- 172.21.15.112:0/1000648853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18f806efb0 0x7f18f813e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:44.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.522+0000 7f18f5e00640 1 -- 172.21.15.112:0/1000648853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18f80cf920 msgr2=0x7f18f80b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:44.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.522+0000 7f18f5e00640 1 --2- 172.21.15.112:0/1000648853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18f80cf920 0x7f18f80b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:44.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.522+0000 7f18f5e00640 1 -- 172.21.15.112:0/1000648853 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f81547a0 con 0x7f18f806f390 2024-09-12T02:53:44.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.522+0000 7f18f5e00640 1 --2- 172.21.15.112:0/1000648853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18f806f390 0x7f18f81537f0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f18e4000c00 tx=0x7f18e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:44.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.523+0000 7f18eea00640 1 -- 172.21.15.112:0/1000648853 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e4042020 con 0x7f18f806f390 2024-09-12T02:53:44.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.523+0000 7f18eea00640 1 -- 172.21.15.112:0/1000648853 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18e40339b0 con 0x7f18f806f390 2024-09-12T02:53:44.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.523+0000 7f18eea00640 1 -- 172.21.15.112:0/1000648853 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e4038040 con 0x7f18f806f390 2024-09-12T02:53:44.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.523+0000 7f18fca00640 1 -- 172.21.15.112:0/1000648853 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18f8154a80 con 0x7f18f806f390 2024-09-12T02:53:44.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.523+0000 7f18fca00640 1 -- 172.21.15.112:0/1000648853 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18f8155320 con 0x7f18f806f390 2024-09-12T02:53:44.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.524+0000 7f18fca00640 1 -- 172.21.15.112:0/1000648853 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f18f8154e70 con 0x7f18f806f390 2024-09-12T02:53:44.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.525+0000 7f18eea00640 1 -- 172.21.15.112:0/1000648853 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f18e4045020 con 0x7f18f806f390 2024-09-12T02:53:44.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.525+0000 7f18eea00640 1 --2- 172.21.15.112:0/1000648853 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f18d806be30 0x7f18d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:44.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.526+0000 7f18eea00640 1 -- 172.21.15.112:0/1000648853 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 4943+0+0 (secure 0 0 0) 0x7f18e40ad7c0 con 0x7f18f806f390 2024-09-12T02:53:44.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.526+0000 7f18f6800640 1 --2- 172.21.15.112:0/1000648853 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f18d806be30 0x7f18d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:44.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.526+0000 7f18eea00640 1 --2- 172.21.15.112:0/1000648853 >> [v2:172.21.15.112:6808/2642068641,v1:172.21.15.112:6809/2642068641] conn(0x7f18d8071cf0 0x7f18d8074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:44.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.526+0000 7f18eea00640 1 -- 172.21.15.112:0/1000648853 --> [v2:172.21.15.112:6808/2642068641,v1:172.21.15.112:6809/2642068641] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f18d80747c0 con 0x7f18d8071cf0 2024-09-12T02:53:44.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.526+0000 7f18eea00640 1 -- 172.21.15.112:0/1000648853 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=190) ==== 24+0+0 (secure 0 0 0) 0x7f18e40b4050 con 0x7f18f806f390 2024-09-12T02:53:44.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.526+0000 7f18f7200640 1 --2- 172.21.15.112:0/1000648853 >> [v2:172.21.15.112:6808/2642068641,v1:172.21.15.112:6809/2642068641] conn(0x7f18d8071cf0 0x7f18d8074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:44.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.526+0000 7f18f6800640 1 --2- 172.21.15.112:0/1000648853 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f18d806be30 0x7f18d806e2f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f18f81f3c30 tx=0x7f18e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:44.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.526+0000 7f18f7200640 1 --2- 172.21.15.112:0/1000648853 >> [v2:172.21.15.112:6808/2642068641,v1:172.21.15.112:6809/2642068641] conn(0x7f18d8071cf0 0x7f18d8074110 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:44.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.527+0000 7f18eea00640 1 -- 172.21.15.112:0/1000648853 <== osd.1 v2:172.21.15.112:6808/2642068641 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f18d80747c0 con 0x7f18d8071cf0 2024-09-12T02:53:44.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.539+0000 7f18fca00640 1 -- 172.21.15.112:0/1000648853 --> [v2:172.21.15.112:6808/2642068641,v1:172.21.15.112:6809/2642068641] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f18f815c6f0 con 0x7f18d8071cf0 2024-09-12T02:53:44.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.539+0000 7f18eea00640 1 -- 172.21.15.112:0/1000648853 <== osd.1 v2:172.21.15.112:6808/2642068641 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7f18f815c6f0 con 0x7f18d8071cf0 2024-09-12T02:53:44.540 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:53:44.540 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-12T02:53:44.540 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:53:44.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.540+0000 7f18fca00640 1 -- 172.21.15.112:0/1000648853 >> [v2:172.21.15.112:6808/2642068641,v1:172.21.15.112:6809/2642068641] conn(0x7f18d8071cf0 msgr2=0x7f18d8074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:44.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.540+0000 7f18fca00640 1 --2- 172.21.15.112:0/1000648853 >> [v2:172.21.15.112:6808/2642068641,v1:172.21.15.112:6809/2642068641] conn(0x7f18d8071cf0 0x7f18d8074110 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:44.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.540+0000 7f18fca00640 1 -- 172.21.15.112:0/1000648853 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f18d806be30 msgr2=0x7f18d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:44.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.540+0000 7f18fca00640 1 --2- 172.21.15.112:0/1000648853 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f18d806be30 0x7f18d806e2f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f18f81f3c30 tx=0x7f18e8009040 comp rx=0 tx=0).stop 2024-09-12T02:53:44.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.540+0000 7f18fca00640 1 -- 172.21.15.112:0/1000648853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18f806f390 msgr2=0x7f18f81537f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:44.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.540+0000 7f18fca00640 1 --2- 172.21.15.112:0/1000648853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18f806f390 0x7f18f81537f0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f18e4000c00 tx=0x7f18e40046c0 comp rx=0 tx=0).stop 2024-09-12T02:53:44.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.540+0000 7f18f7200640 1 -- 172.21.15.112:0/1000648853 reap_dead start 2024-09-12T02:53:44.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.540+0000 7f18fca00640 1 -- 172.21.15.112:0/1000648853 shutdown_connections 2024-09-12T02:53:44.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.540+0000 7f18fca00640 1 -- 172.21.15.112:0/1000648853 >> 172.21.15.112:0/1000648853 conn(0x7f18f806bdb0 msgr2=0x7f18f8072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:44.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.540+0000 7f18fca00640 1 -- 172.21.15.112:0/1000648853 shutdown_connections 2024-09-12T02:53:44.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.540+0000 7f18fca00640 1 -- 172.21.15.112:0/1000648853 wait complete. 2024-09-12T02:53:44.555 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T02:53:44.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.707+0000 7ff22da00640 1 Processor -- start 2024-09-12T02:53:44.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.707+0000 7ff22da00640 1 -- start start 2024-09-12T02:53:44.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.708+0000 7ff22da00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff2281626d0 0x7ff2280b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:44.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.708+0000 7ff22da00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff2280d2cb0 0x7ff2280d3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:44.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.708+0000 7ff22da00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2280d3ac0 con 0x7ff2280b1a40 2024-09-12T02:53:44.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.708+0000 7ff22da00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff2280d1d00 con 0x7ff2281626d0 2024-09-12T02:53:44.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.708+0000 7ff22da00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff2280d1fe0 con 0x7ff2280d2cb0 2024-09-12T02:53:44.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.708+0000 7ff226a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff2281626d0 0x7ff2280b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:44.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.708+0000 7ff227400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff2280b1a40 0x7ff2280b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38488/0 (socket says 172.21.15.112:38488) 2024-09-12T02:53:44.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.708+0000 7ff227400640 1 -- 172.21.15.112:0/2778963774 learned_addr learned my addr 172.21.15.112:0/2778963774 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:53:44.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.708+0000 7ff226a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff2281626d0 0x7ff2280b3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44462/0 (socket says 172.21.15.112:44462) 2024-09-12T02:53:44.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.709+0000 7ff226000640 1 --2- 172.21.15.112:0/2778963774 >> v2:172.21.15.137:3300/0 conn(0x7ff2280d2cb0 0x7ff2280d3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.709+0000 7ff226a00640 1 -- 172.21.15.112:0/2778963774 >> v2:172.21.15.137:3300/0 conn(0x7ff2280d2cb0 msgr2=0x7ff2280d3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.709+0000 7ff226a00640 1 --2- 172.21.15.112:0/2778963774 >> v2:172.21.15.137:3300/0 conn(0x7ff2280d2cb0 0x7ff2280d3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.709+0000 7ff226a00640 1 -- 172.21.15.112:0/2778963774 >> v1:172.21.15.112:6789/0 conn(0x7ff2280b1a40 legacy=0x7ff2280b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.709+0000 7ff226a00640 1 -- 172.21.15.112:0/2778963774 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2280d22c0 con 0x7ff2281626d0 2024-09-12T02:53:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.710+0000 7ff226a00640 1 --2- 172.21.15.112:0/2778963774 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2281626d0 0x7ff2280b3bb0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7ff22808e750 tx=0x7ff21802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d92b177fd37eba40 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.710+0000 7ff225600640 1 -- 172.21.15.112:0/2778963774 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff218037070 con 0x7ff2281626d0 2024-09-12T02:53:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.710+0000 7ff225600640 1 -- 172.21.15.112:0/2778963774 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff218032440 con 0x7ff2281626d0 2024-09-12T02:53:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.710+0000 7ff225600640 1 -- 172.21.15.112:0/2778963774 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff218032810 con 0x7ff2281626d0 2024-09-12T02:53:44.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.711+0000 7ff22da00640 1 -- 172.21.15.112:0/2778963774 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2281626d0 msgr2=0x7ff2280b3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:44.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.711+0000 7ff22da00640 1 --2- 172.21.15.112:0/2778963774 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2281626d0 0x7ff2280b3bb0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7ff22808e750 tx=0x7ff21802a1a0 comp rx=0 tx=0).stop 2024-09-12T02:53:44.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.711+0000 7ff22da00640 1 -- 172.21.15.112:0/2778963774 shutdown_connections 2024-09-12T02:53:44.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.711+0000 7ff22da00640 1 --2- 172.21.15.112:0/2778963774 >> v2:172.21.15.137:3300/0 conn(0x7ff2280d2cb0 0x7ff2280d3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:44.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.711+0000 7ff22da00640 1 --2- 172.21.15.112:0/2778963774 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2281626d0 0x7ff2280b3bb0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:44.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.711+0000 7ff22da00640 1 -- 172.21.15.112:0/2778963774 >> 172.21.15.112:0/2778963774 conn(0x7ff2280d4db0 msgr2=0x7ff2280d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:44.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.711+0000 7ff22da00640 1 -- 172.21.15.112:0/2778963774 shutdown_connections 2024-09-12T02:53:44.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.711+0000 7ff22da00640 1 -- 172.21.15.112:0/2778963774 wait complete. 2024-09-12T02:53:44.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.712+0000 7ff22da00640 1 Processor -- start 2024-09-12T02:53:44.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.713+0000 7ff22da00640 1 -- start start 2024-09-12T02:53:44.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.713+0000 7ff22da00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2280b1a40 0x7ff2281588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:44.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.713+0000 7ff22da00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2280d2cb0 0x7ff2280cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:44.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.713+0000 7ff22da00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2281626d0 0x7ff228159040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:44.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.713+0000 7ff22da00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff2280d3f20 con 0x7ff2281626d0 2024-09-12T02:53:44.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.713+0000 7ff22da00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff2280d3da0 con 0x7ff2280d2cb0 2024-09-12T02:53:44.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.713+0000 7ff22da00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff2280d3680 con 0x7ff2280b1a40 2024-09-12T02:53:44.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.714+0000 7ff227400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2281626d0 0x7ff228159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:44.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.714+0000 7ff227400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2281626d0 0x7ff228159040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44478/0 (socket says 172.21.15.112:44478) 2024-09-12T02:53:44.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.714+0000 7ff226a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2280b1a40 0x7ff2281588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:44.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.714+0000 7ff227400640 1 -- 172.21.15.112:0/2457095095 learned_addr learned my addr 172.21.15.112:0/2457095095 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:44.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.714+0000 7ff226000640 1 --2- 172.21.15.112:0/2457095095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2280d2cb0 0x7ff2280cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:44.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.714+0000 7ff227400640 1 -- 172.21.15.112:0/2457095095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2280b1a40 msgr2=0x7ff2281588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:44.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.714+0000 7ff227400640 1 --2- 172.21.15.112:0/2457095095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2280b1a40 0x7ff2281588d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:44.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.714+0000 7ff227400640 1 -- 172.21.15.112:0/2457095095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2280d2cb0 msgr2=0x7ff2280cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:44.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.714+0000 7ff227400640 1 --2- 172.21.15.112:0/2457095095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2280d2cb0 0x7ff2280cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:44.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.714+0000 7ff227400640 1 -- 172.21.15.112:0/2457095095 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2280ca880 con 0x7ff2281626d0 2024-09-12T02:53:44.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.714+0000 7ff227400640 1 --2- 172.21.15.112:0/2457095095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2281626d0 0x7ff228159040 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7ff22000c9f0 tx=0x7ff22000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:44.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.715+0000 7ff21ea00640 1 -- 172.21.15.112:0/2457095095 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff220017070 con 0x7ff2281626d0 2024-09-12T02:53:44.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.715+0000 7ff21ea00640 1 -- 172.21.15.112:0/2457095095 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff22000ab70 con 0x7ff2281626d0 2024-09-12T02:53:44.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.715+0000 7ff22da00640 1 -- 172.21.15.112:0/2457095095 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2280ccae0 con 0x7ff2281626d0 2024-09-12T02:53:44.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.715+0000 7ff21ea00640 1 -- 172.21.15.112:0/2457095095 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff220012400 con 0x7ff2281626d0 2024-09-12T02:53:44.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.715+0000 7ff22da00640 1 -- 172.21.15.112:0/2457095095 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2280cd0a0 con 0x7ff2281626d0 2024-09-12T02:53:44.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.716+0000 7ff22da00640 1 -- 172.21.15.112:0/2457095095 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2280d3140 con 0x7ff2281626d0 2024-09-12T02:53:44.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.717+0000 7ff21ea00640 1 -- 172.21.15.112:0/2457095095 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff22001a070 con 0x7ff2281626d0 2024-09-12T02:53:44.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.718+0000 7ff21ea00640 1 --2- 172.21.15.112:0/2457095095 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff20806be30 0x7ff20806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:44.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.718+0000 7ff21ea00640 1 -- 172.21.15.112:0/2457095095 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 4943+0+0 (secure 0 0 0) 0x7ff22008a720 con 0x7ff2281626d0 2024-09-12T02:53:44.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.718+0000 7ff226a00640 1 --2- 172.21.15.112:0/2457095095 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff20806be30 0x7ff20806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:44.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.719+0000 7ff226a00640 1 --2- 172.21.15.112:0/2457095095 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff20806be30 0x7ff20806e2f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff218034000 tx=0x7ff21802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:44.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.722+0000 7ff21ea00640 1 -- 172.21.15.112:0/2457095095 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff220058d70 con 0x7ff2281626d0 2024-09-12T02:53:44.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.897+0000 7ff22da00640 1 -- 172.21.15.112:0/2457095095 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7ff2280baab0 con 0x7ff20806be30 2024-09-12T02:53:44.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.898+0000 7ff21ea00640 1 -- 172.21.15.112:0/2457095095 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff2280baab0 con 0x7ff20806be30 2024-09-12T02:53:44.899 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T02:53:44.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.900+0000 7ff22da00640 1 -- 172.21.15.112:0/2457095095 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff20806be30 msgr2=0x7ff20806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:44.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.900+0000 7ff22da00640 1 --2- 172.21.15.112:0/2457095095 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff20806be30 0x7ff20806e2f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff218034000 tx=0x7ff21802e000 comp rx=0 tx=0).stop 2024-09-12T02:53:44.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.900+0000 7ff22da00640 1 -- 172.21.15.112:0/2457095095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2281626d0 msgr2=0x7ff228159040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:44.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.900+0000 7ff22da00640 1 --2- 172.21.15.112:0/2457095095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2281626d0 0x7ff228159040 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7ff22000c9f0 tx=0x7ff22000ceb0 comp rx=0 tx=0).stop 2024-09-12T02:53:44.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.900+0000 7ff22da00640 1 -- 172.21.15.112:0/2457095095 shutdown_connections 2024-09-12T02:53:44.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.900+0000 7ff22da00640 1 --2- 172.21.15.112:0/2457095095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2281626d0 0x7ff228159040 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:44.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.900+0000 7ff22da00640 1 --2- 172.21.15.112:0/2457095095 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff20806be30 0x7ff20806e2f0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:44.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.900+0000 7ff22da00640 1 --2- 172.21.15.112:0/2457095095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2280d2cb0 0x7ff2280cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:44.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.900+0000 7ff22da00640 1 --2- 172.21.15.112:0/2457095095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2280b1a40 0x7ff2281588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:44.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.900+0000 7ff22da00640 1 -- 172.21.15.112:0/2457095095 >> 172.21.15.112:0/2457095095 conn(0x7ff2280d4db0 msgr2=0x7ff2280d5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:44.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.900+0000 7ff22da00640 1 -- 172.21.15.112:0/2457095095 shutdown_connections 2024-09-12T02:53:44.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:44.900+0000 7ff22da00640 1 -- 172.21.15.112:0/2457095095 wait complete. 2024-09-12T02:53:44.916 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T02:53:44.917 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:53:45.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.072+0000 7f1360e00640 1 Processor -- start 2024-09-12T02:53:45.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.072+0000 7f1360e00640 1 -- start start 2024-09-12T02:53:45.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.073+0000 7f1360e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f135c1624a0 0x7f135c0d1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:45.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.073+0000 7f1360e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f135c0d0970 0x7f135c0d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:45.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.073+0000 7f1360e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f135c0d3250 con 0x7f135c0d57c0 2024-09-12T02:53:45.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.073+0000 7f1360e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f135c0d2620 con 0x7f135c1624a0 2024-09-12T02:53:45.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.073+0000 7f1360e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f135c0b47c0 con 0x7f135c0d0970 2024-09-12T02:53:45.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.074+0000 7f135b400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f135c1624a0 0x7f135c0d1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:45.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.074+0000 7f135be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f135c0d0970 0x7f135c0d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:45.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.074+0000 7f135b400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f135c1624a0 0x7f135c0d1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.112:48416/0 (socket says 172.21.15.112:48416) 2024-09-12T02:53:45.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.074+0000 7f135b400640 1 -- 172.21.15.112:0/334773658 learned_addr learned my addr 172.21.15.112:0/334773658 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:45.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.074+0000 7f135be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f135c0d0970 0x7f135c0d1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.112:46664/0 (socket says 172.21.15.112:46664) 2024-09-12T02:53:45.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.074+0000 7f135aa00640 1 --1- 172.21.15.112:0/334773658 >> v1:172.21.15.137:6789/0 conn(0x7f135c0d57c0 0x7f135c0b4c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.112:37562/0 (socket says 172.21.15.112:37562) 2024-09-12T02:53:45.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.074+0000 7f135be00640 1 -- 172.21.15.112:0/334773658 >> v2:172.21.15.137:3300/0 conn(0x7f135c1624a0 msgr2=0x7f135c0d1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:45.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.074+0000 7f135be00640 1 --2- 172.21.15.112:0/334773658 >> v2:172.21.15.137:3300/0 conn(0x7f135c1624a0 0x7f135c0d1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:45.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.074+0000 7f135be00640 1 -- 172.21.15.112:0/334773658 >> v1:172.21.15.137:6789/0 conn(0x7f135c0d57c0 legacy=0x7f135c0b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:45.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.074+0000 7f135be00640 1 -- 172.21.15.112:0/334773658 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f135c0d34d0 con 0x7f135c0d0970 2024-09-12T02:53:45.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.075+0000 7f135be00640 1 --2- 172.21.15.112:0/334773658 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f135c0d0970 0x7f135c0d1b60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1354009d90 tx=0x7f135402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80bb8c5b2f0b72e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:45.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.076+0000 7f135a000640 1 -- 172.21.15.112:0/334773658 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1354007740 con 0x7f135c0d0970 2024-09-12T02:53:45.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.076+0000 7f135a000640 1 -- 172.21.15.112:0/334773658 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13540078e0 con 0x7f135c0d0970 2024-09-12T02:53:45.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.076+0000 7f135a000640 1 -- 172.21.15.112:0/334773658 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1354007cb0 con 0x7f135c0d0970 2024-09-12T02:53:45.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.076+0000 7f1360e00640 1 -- 172.21.15.112:0/334773658 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f135c0d0970 msgr2=0x7f135c0d1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:45.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.076+0000 7f1360e00640 1 --2- 172.21.15.112:0/334773658 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f135c0d0970 0x7f135c0d1b60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1354009d90 tx=0x7f135402a660 comp rx=0 tx=0).stop 2024-09-12T02:53:45.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.076+0000 7f1360e00640 1 -- 172.21.15.112:0/334773658 shutdown_connections 2024-09-12T02:53:45.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.076+0000 7f1360e00640 1 --2- 172.21.15.112:0/334773658 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f135c0d0970 0x7f135c0d1b60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:45.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.076+0000 7f1360e00640 1 --2- 172.21.15.112:0/334773658 >> v2:172.21.15.137:3300/0 conn(0x7f135c1624a0 0x7f135c0d1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:45.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.076+0000 7f1360e00640 1 -- 172.21.15.112:0/334773658 >> 172.21.15.112:0/334773658 conn(0x7f135c0d4ca0 msgr2=0x7f135c0d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:45.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.076+0000 7f1360e00640 1 -- 172.21.15.112:0/334773658 shutdown_connections 2024-09-12T02:53:45.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.076+0000 7f1360e00640 1 -- 172.21.15.112:0/334773658 wait complete. 2024-09-12T02:53:45.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.078+0000 7f1360e00640 1 Processor -- start 2024-09-12T02:53:45.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.078+0000 7f1360e00640 1 -- start start 2024-09-12T02:53:45.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.079+0000 7f1360e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f135c0d0970 0x7f135c1560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:45.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.079+0000 7f1360e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f135c0d57c0 0x7f135c0cc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:45.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.079+0000 7f1360e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f135c1624a0 0x7f135c1f4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:45.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.079+0000 7f1360e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f135c0d3d70 con 0x7f135c1624a0 2024-09-12T02:53:45.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.079+0000 7f1360e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f135c0d3a90 con 0x7f135c0d0970 2024-09-12T02:53:45.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.079+0000 7f1360e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f135c162880 con 0x7f135c0d57c0 2024-09-12T02:53:45.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.079+0000 7f135be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f135c1624a0 0x7f135c1f4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:45.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.079+0000 7f135be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f135c1624a0 0x7f135c1f4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44486/0 (socket says 172.21.15.112:44486) 2024-09-12T02:53:45.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.079+0000 7f135be00640 1 -- 172.21.15.112:0/4208841492 learned_addr learned my addr 172.21.15.112:0/4208841492 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:45.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.079+0000 7f135b400640 1 --2- 172.21.15.112:0/4208841492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f135c0d0970 0x7f135c1560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:45.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.079+0000 7f135aa00640 1 --2- 172.21.15.112:0/4208841492 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f135c0d57c0 0x7f135c0cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:45.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.080+0000 7f135be00640 1 -- 172.21.15.112:0/4208841492 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f135c0d57c0 msgr2=0x7f135c0cc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:45.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.080+0000 7f135be00640 1 --2- 172.21.15.112:0/4208841492 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f135c0d57c0 0x7f135c0cc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:45.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.080+0000 7f135be00640 1 -- 172.21.15.112:0/4208841492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f135c0d0970 msgr2=0x7f135c1560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:45.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.080+0000 7f135be00640 1 --2- 172.21.15.112:0/4208841492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f135c0d0970 0x7f135c1560e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:45.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.080+0000 7f135be00640 1 -- 172.21.15.112:0/4208841492 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f135c0cc2e0 con 0x7f135c1624a0 2024-09-12T02:53:45.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.080+0000 7f135be00640 1 --2- 172.21.15.112:0/4208841492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f135c1624a0 0x7f135c1f4ef0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f135402ac50 tx=0x7f1354004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:45.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.080+0000 7f1353400640 1 -- 172.21.15.112:0/4208841492 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1354040070 con 0x7f135c1624a0 2024-09-12T02:53:45.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.080+0000 7f1353400640 1 -- 172.21.15.112:0/4208841492 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1354031bc0 con 0x7f135c1624a0 2024-09-12T02:53:45.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.080+0000 7f1360e00640 1 -- 172.21.15.112:0/4208841492 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f135c0c9750 con 0x7f135c1624a0 2024-09-12T02:53:45.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.080+0000 7f1353400640 1 -- 172.21.15.112:0/4208841492 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1354009450 con 0x7f135c1624a0 2024-09-12T02:53:45.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.081+0000 7f1360e00640 1 -- 172.21.15.112:0/4208841492 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f135c0c9ff0 con 0x7f135c1624a0 2024-09-12T02:53:45.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.081+0000 7f1360e00640 1 -- 172.21.15.112:0/4208841492 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f135c0d1620 con 0x7f135c1624a0 2024-09-12T02:53:45.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.082+0000 7f1353400640 1 -- 172.21.15.112:0/4208841492 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1354039040 con 0x7f135c1624a0 2024-09-12T02:53:45.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.083+0000 7f1353400640 1 --2- 172.21.15.112:0/4208841492 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f133c06be30 0x7f133c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:45.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.083+0000 7f1353400640 1 -- 172.21.15.112:0/4208841492 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 4943+0+0 (secure 0 0 0) 0x7f13540ac2d0 con 0x7f135c1624a0 2024-09-12T02:53:45.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.083+0000 7f135b400640 1 --2- 172.21.15.112:0/4208841492 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f133c06be30 0x7f133c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:45.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.083+0000 7f1353400640 1 --2- 172.21.15.112:0/4208841492 >> [v2:172.21.15.112:6816/3365688807,v1:172.21.15.112:6817/3365688807] conn(0x7f133c071cf0 0x7f133c074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:45.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.083+0000 7f1353400640 1 -- 172.21.15.112:0/4208841492 --> [v2:172.21.15.112:6816/3365688807,v1:172.21.15.112:6817/3365688807] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f135403be50 con 0x7f133c071cf0 2024-09-12T02:53:45.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.083+0000 7f1353400640 1 -- 172.21.15.112:0/4208841492 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=190) ==== 24+0+0 (secure 0 0 0) 0x7f13540b3050 con 0x7f135c1624a0 2024-09-12T02:53:45.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.084+0000 7f135aa00640 1 --2- 172.21.15.112:0/4208841492 >> [v2:172.21.15.112:6816/3365688807,v1:172.21.15.112:6817/3365688807] conn(0x7f133c071cf0 0x7f133c074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:45.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.084+0000 7f135b400640 1 --2- 172.21.15.112:0/4208841492 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f133c06be30 0x7f133c06e2f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f135c1f8420 tx=0x7f134c009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:45.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.084+0000 7f135aa00640 1 --2- 172.21.15.112:0/4208841492 >> [v2:172.21.15.112:6816/3365688807,v1:172.21.15.112:6817/3365688807] conn(0x7f133c071cf0 0x7f133c074110 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:45.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.085+0000 7f1353400640 1 -- 172.21.15.112:0/4208841492 <== osd.2 v2:172.21.15.112:6816/3365688807 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f135403be50 con 0x7f133c071cf0 2024-09-12T02:53:45.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.096+0000 7f1360e00640 1 -- 172.21.15.112:0/4208841492 --> [v2:172.21.15.112:6816/3365688807,v1:172.21.15.112:6817/3365688807] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f135c0d52d0 con 0x7f133c071cf0 2024-09-12T02:53:45.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.097+0000 7f1353400640 1 -- 172.21.15.112:0/4208841492 <== osd.2 v2:172.21.15.112:6816/3365688807 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7f135c0d52d0 con 0x7f133c071cf0 2024-09-12T02:53:45.098 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:53:45.098 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-12T02:53:45.098 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:53:45.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.097+0000 7f1360e00640 1 -- 172.21.15.112:0/4208841492 >> [v2:172.21.15.112:6816/3365688807,v1:172.21.15.112:6817/3365688807] conn(0x7f133c071cf0 msgr2=0x7f133c074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:45.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.097+0000 7f1360e00640 1 --2- 172.21.15.112:0/4208841492 >> [v2:172.21.15.112:6816/3365688807,v1:172.21.15.112:6817/3365688807] conn(0x7f133c071cf0 0x7f133c074110 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:45.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.097+0000 7f1360e00640 1 -- 172.21.15.112:0/4208841492 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f133c06be30 msgr2=0x7f133c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:45.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.097+0000 7f1360e00640 1 --2- 172.21.15.112:0/4208841492 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f133c06be30 0x7f133c06e2f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f135c1f8420 tx=0x7f134c009240 comp rx=0 tx=0).stop 2024-09-12T02:53:45.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.097+0000 7f1360e00640 1 -- 172.21.15.112:0/4208841492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f135c1624a0 msgr2=0x7f135c1f4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:45.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.097+0000 7f1360e00640 1 --2- 172.21.15.112:0/4208841492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f135c1624a0 0x7f135c1f4ef0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f135402ac50 tx=0x7f1354004a40 comp rx=0 tx=0).stop 2024-09-12T02:53:45.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.097+0000 7f135be00640 1 -- 172.21.15.112:0/4208841492 reap_dead start 2024-09-12T02:53:45.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.097+0000 7f1360e00640 1 -- 172.21.15.112:0/4208841492 shutdown_connections 2024-09-12T02:53:45.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.098+0000 7f1360e00640 1 -- 172.21.15.112:0/4208841492 >> 172.21.15.112:0/4208841492 conn(0x7f135c0d4ca0 msgr2=0x7f135c06cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:45.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.098+0000 7f1360e00640 1 -- 172.21.15.112:0/4208841492 shutdown_connections 2024-09-12T02:53:45.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.098+0000 7f1360e00640 1 -- 172.21.15.112:0/4208841492 wait complete. 2024-09-12T02:53:45.114 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T02:53:45.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.267+0000 7f4821400640 1 Processor -- start 2024-09-12T02:53:45.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.267+0000 7f4821400640 1 -- start start 2024-09-12T02:53:45.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.268+0000 7f4821400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f481c15a450 0x7f481c06e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:45.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.268+0000 7f4821400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f481c0ce460 0x7f481c0d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:45.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.268+0000 7f4821400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f481c06e990 con 0x7f481c15db60 2024-09-12T02:53:45.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.268+0000 7f4821400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f481c071eb0 con 0x7f481c0ce460 2024-09-12T02:53:45.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.268+0000 7f4821400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f481c06ec70 con 0x7f481c15a450 2024-09-12T02:53:45.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.269+0000 7f481b400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f481c0ce460 0x7f481c0d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:45.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.269+0000 7f4820a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f481c15db60 0x7f481c160510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38502/0 (socket says 172.21.15.112:38502) 2024-09-12T02:53:45.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.269+0000 7f4820a00640 1 -- 172.21.15.112:0/3787728674 learned_addr learned my addr 172.21.15.112:0/3787728674 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:53:45.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.269+0000 7f481be00640 1 --2- 172.21.15.112:0/3787728674 >> v2:172.21.15.137:3300/0 conn(0x7f481c15a450 0x7f481c06e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:45.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.269+0000 7f481b400640 1 -- 172.21.15.112:0/3787728674 >> v2:172.21.15.137:3300/0 conn(0x7f481c15a450 msgr2=0x7f481c06e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:45.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.269+0000 7f481b400640 1 --2- 172.21.15.112:0/3787728674 >> v2:172.21.15.137:3300/0 conn(0x7f481c15a450 0x7f481c06e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:45.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.269+0000 7f481b400640 1 -- 172.21.15.112:0/3787728674 >> v1:172.21.15.112:6789/0 conn(0x7f481c15db60 legacy=0x7f481c160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:45.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.269+0000 7f481b400640 1 -- 172.21.15.112:0/3787728674 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f481c072100 con 0x7f481c0ce460 2024-09-12T02:53:45.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.270+0000 7f481b400640 1 --2- 172.21.15.112:0/3787728674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f481c0ce460 0x7f481c0d0820 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f481c068760 tx=0x7f480802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1561796f12bb73 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:45.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.270+0000 7f481aa00640 1 -- 172.21.15.112:0/3787728674 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4808037070 con 0x7f481c0ce460 2024-09-12T02:53:45.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.270+0000 7f481aa00640 1 -- 172.21.15.112:0/3787728674 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4808032440 con 0x7f481c0ce460 2024-09-12T02:53:45.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.270+0000 7f481aa00640 1 -- 172.21.15.112:0/3787728674 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4808032810 con 0x7f481c0ce460 2024-09-12T02:53:45.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.271+0000 7f4821400640 1 -- 172.21.15.112:0/3787728674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f481c0ce460 msgr2=0x7f481c0d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:45.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.271+0000 7f4821400640 1 --2- 172.21.15.112:0/3787728674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f481c0ce460 0x7f481c0d0820 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f481c068760 tx=0x7f480802a250 comp rx=0 tx=0).stop 2024-09-12T02:53:45.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.271+0000 7f4821400640 1 -- 172.21.15.112:0/3787728674 shutdown_connections 2024-09-12T02:53:45.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.271+0000 7f4821400640 1 --2- 172.21.15.112:0/3787728674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f481c0ce460 0x7f481c0d0820 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:45.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.271+0000 7f4821400640 1 --2- 172.21.15.112:0/3787728674 >> v2:172.21.15.137:3300/0 conn(0x7f481c15a450 0x7f481c06e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:45.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.271+0000 7f4821400640 1 -- 172.21.15.112:0/3787728674 >> 172.21.15.112:0/3787728674 conn(0x7f481c06bbd0 msgr2=0x7f481c06bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:45.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.271+0000 7f4821400640 1 -- 172.21.15.112:0/3787728674 shutdown_connections 2024-09-12T02:53:45.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.271+0000 7f4821400640 1 -- 172.21.15.112:0/3787728674 wait complete. 2024-09-12T02:53:45.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.273+0000 7f4821400640 1 Processor -- start 2024-09-12T02:53:45.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.273+0000 7f4821400640 1 -- start start 2024-09-12T02:53:45.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.274+0000 7f4821400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f481c0ce460 0x7f481c1f2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:45.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.274+0000 7f4821400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f481c15a450 0x7f481c15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:45.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.274+0000 7f4821400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f481c15db60 0x7f481c15c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:45.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.274+0000 7f4821400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f481c15a830 con 0x7f481c15db60 2024-09-12T02:53:45.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.274+0000 7f4821400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f481c06e680 con 0x7f481c15a450 2024-09-12T02:53:45.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.274+0000 7f4821400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f481c0d0d60 con 0x7f481c0ce460 2024-09-12T02:53:45.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.274+0000 7f4820a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f481c15db60 0x7f481c15c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:45.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.274+0000 7f4820a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f481c15db60 0x7f481c15c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44502/0 (socket says 172.21.15.112:44502) 2024-09-12T02:53:45.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.274+0000 7f4820a00640 1 -- 172.21.15.112:0/81329740 learned_addr learned my addr 172.21.15.112:0/81329740 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:45.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.274+0000 7f481b400640 1 --2- 172.21.15.112:0/81329740 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f481c15a450 0x7f481c15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:45.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.274+0000 7f481be00640 1 --2- 172.21.15.112:0/81329740 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f481c0ce460 0x7f481c1f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:45.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.274+0000 7f4820a00640 1 -- 172.21.15.112:0/81329740 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f481c0ce460 msgr2=0x7f481c1f2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:45.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.274+0000 7f4820a00640 1 --2- 172.21.15.112:0/81329740 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f481c0ce460 0x7f481c1f2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:45.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.274+0000 7f4820a00640 1 -- 172.21.15.112:0/81329740 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f481c15a450 msgr2=0x7f481c15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:45.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.274+0000 7f4820a00640 1 --2- 172.21.15.112:0/81329740 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f481c15a450 0x7f481c15bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:45.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.274+0000 7f4820a00640 1 -- 172.21.15.112:0/81329740 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f481c13fe90 con 0x7f481c15db60 2024-09-12T02:53:45.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.274+0000 7f481b400640 1 --2- 172.21.15.112:0/81329740 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f481c15a450 0x7f481c15bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:53:45.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.275+0000 7f4820a00640 1 --2- 172.21.15.112:0/81329740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f481c15db60 0x7f481c15c420 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f481400ca80 tx=0x7f481400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:45.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.275+0000 7f4813e00640 1 -- 172.21.15.112:0/81329740 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4814017070 con 0x7f481c15db60 2024-09-12T02:53:45.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.275+0000 7f4813e00640 1 -- 172.21.15.112:0/81329740 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f481400ac30 con 0x7f481c15db60 2024-09-12T02:53:45.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.275+0000 7f4813e00640 1 -- 172.21.15.112:0/81329740 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4814012600 con 0x7f481c15db60 2024-09-12T02:53:45.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.275+0000 7f4821400640 1 -- 172.21.15.112:0/81329740 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f481c140170 con 0x7f481c15db60 2024-09-12T02:53:45.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.275+0000 7f4821400640 1 -- 172.21.15.112:0/81329740 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f481c140730 con 0x7f481c15db60 2024-09-12T02:53:45.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.276+0000 7f4821400640 1 -- 172.21.15.112:0/81329740 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f481c06f360 con 0x7f481c15db60 2024-09-12T02:53:45.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.277+0000 7f4813e00640 1 -- 172.21.15.112:0/81329740 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f481401a070 con 0x7f481c15db60 2024-09-12T02:53:45.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.278+0000 7f4813e00640 1 --2- 172.21.15.112:0/81329740 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f47fc06be30 0x7f47fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:45.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.278+0000 7f4813e00640 1 -- 172.21.15.112:0/81329740 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 4943+0+0 (secure 0 0 0) 0x7f481408a7c0 con 0x7f481c15db60 2024-09-12T02:53:45.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.278+0000 7f481be00640 1 --2- 172.21.15.112:0/81329740 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f47fc06be30 0x7f47fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:45.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.279+0000 7f481be00640 1 --2- 172.21.15.112:0/81329740 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f47fc06be30 0x7f47fc06e2f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f480c009ad0 tx=0x7f480c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:45.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.282+0000 7f4813e00640 1 -- 172.21.15.112:0/81329740 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f481c06f360 con 0x7f481c15db60 2024-09-12T02:53:45.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.457+0000 7f4821400640 1 -- 172.21.15.112:0/81329740 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f481c0d10f0 con 0x7f47fc06be30 2024-09-12T02:53:45.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.457+0000 7f4813e00640 1 -- 172.21.15.112:0/81329740 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f481c0d10f0 con 0x7f47fc06be30 2024-09-12T02:53:45.458 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T02:53:45.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.459+0000 7f4821400640 1 -- 172.21.15.112:0/81329740 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f47fc06be30 msgr2=0x7f47fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:45.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.459+0000 7f4821400640 1 --2- 172.21.15.112:0/81329740 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f47fc06be30 0x7f47fc06e2f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f480c009ad0 tx=0x7f480c008040 comp rx=0 tx=0).stop 2024-09-12T02:53:45.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.459+0000 7f4821400640 1 -- 172.21.15.112:0/81329740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f481c15db60 msgr2=0x7f481c15c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:45.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.459+0000 7f4821400640 1 --2- 172.21.15.112:0/81329740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f481c15db60 0x7f481c15c420 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f481400ca80 tx=0x7f481400cf40 comp rx=0 tx=0).stop 2024-09-12T02:53:45.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.459+0000 7f4821400640 1 -- 172.21.15.112:0/81329740 shutdown_connections 2024-09-12T02:53:45.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.459+0000 7f4821400640 1 --2- 172.21.15.112:0/81329740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f481c15db60 0x7f481c15c420 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:45.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.459+0000 7f4821400640 1 --2- 172.21.15.112:0/81329740 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f47fc06be30 0x7f47fc06e2f0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:45.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.459+0000 7f4821400640 1 --2- 172.21.15.112:0/81329740 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f481c15a450 0x7f481c15bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:45.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.459+0000 7f4821400640 1 --2- 172.21.15.112:0/81329740 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f481c0ce460 0x7f481c1f2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:45.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.459+0000 7f4821400640 1 -- 172.21.15.112:0/81329740 >> 172.21.15.112:0/81329740 conn(0x7f481c06bbd0 msgr2=0x7f481c0b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:45.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.459+0000 7f4821400640 1 -- 172.21.15.112:0/81329740 shutdown_connections 2024-09-12T02:53:45.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.459+0000 7f4821400640 1 -- 172.21.15.112:0/81329740 wait complete. 2024-09-12T02:53:45.476 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T02:53:45.476 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:53:45.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.632+0000 7fbdace00640 1 Processor -- start 2024-09-12T02:53:45.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.633+0000 7fbdace00640 1 -- start start 2024-09-12T02:53:45.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.634+0000 7fbdace00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbda8144890 0x7fbda80b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:45.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.634+0000 7fbdace00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbda806eed0 con 0x7fbda80b4140 2024-09-12T02:53:45.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.634+0000 7fbdace00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbda806f170 con 0x7fbda81602f0 2024-09-12T02:53:45.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.634+0000 7fbdace00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fbda815f810 con 0x7fbda8144890 2024-09-12T02:53:45.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.634+0000 7fbda6800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fbda80b4140 0x7fbda80ce5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38518/0 (socket says 172.21.15.112:38518) 2024-09-12T02:53:45.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.634+0000 7fbda6800640 1 -- 172.21.15.112:0/2995688021 learned_addr learned my addr 172.21.15.112:0/2995688021 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:53:45.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.634+0000 7fbda5e00640 1 --2- 172.21.15.112:0/2995688021 >> v2:172.21.15.137:3300/0 conn(0x7fbda8144890 0x7fbda80b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:45.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.634+0000 7fbda5400640 1 -- 172.21.15.112:0/2995688021 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3679008799 0 0) 0x7fbda806eed0 con 0x7fbda80b4140 2024-09-12T02:53:45.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.635+0000 7fbda5400640 1 -- 172.21.15.112:0/2995688021 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd8c005730 con 0x7fbda80b4140 2024-09-12T02:53:45.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.635+0000 7fbda5400640 1 -- 172.21.15.112:0/2995688021 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 137008694 0 0) 0x7fbda806f170 con 0x7fbda81602f0 2024-09-12T02:53:45.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.635+0000 7fbda5400640 1 -- 172.21.15.112:0/2995688021 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbda806eed0 con 0x7fbda81602f0 2024-09-12T02:53:45.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.635+0000 7fbda5400640 1 -- 172.21.15.112:0/2995688021 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1985724693 0 0) 0x7fbd8c005730 con 0x7fbda80b4140 2024-09-12T02:53:45.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.635+0000 7fbda5400640 1 -- 172.21.15.112:0/2995688021 >> v2:172.21.15.137:3300/0 conn(0x7fbda8144890 msgr2=0x7fbda80b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:45.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.635+0000 7fbda5400640 1 --2- 172.21.15.112:0/2995688021 >> v2:172.21.15.137:3300/0 conn(0x7fbda8144890 0x7fbda80b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:45.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.635+0000 7fbda5400640 1 -- 172.21.15.112:0/2995688021 >> v1:172.21.15.137:6789/0 conn(0x7fbda81602f0 legacy=0x7fbda80b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:45.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.635+0000 7fbda5400640 1 -- 172.21.15.112:0/2995688021 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda815faf0 con 0x7fbda80b4140 2024-09-12T02:53:45.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.635+0000 7fbda5400640 1 -- 172.21.15.112:0/2995688021 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1525173100 0 0) 0x7fbda0001a10 con 0x7fbda80b4140 2024-09-12T02:53:45.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.635+0000 7fbda5400640 1 -- 172.21.15.112:0/2995688021 >> v1:172.21.15.112:6789/0 conn(0x7fbda80b4140 legacy=0x7fbda80ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:45.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.635+0000 7fbda5400640 1 --2- 172.21.15.112:0/2995688021 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd8c005d50 0x7fbd8c006150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:45.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.635+0000 7fbda5400640 1 --2- 172.21.15.112:0/2995688021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd8c006a10 0x7fbd8c006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:45.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.635+0000 7fbda5400640 1 --2- 172.21.15.112:0/2995688021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd8c0073d0 0x7fbd8c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:45.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.635+0000 7fbda5400640 1 -- 172.21.15.112:0/2995688021 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbda815f810 con 0x7fbd8c0073d0 2024-09-12T02:53:45.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.635+0000 7fbda5400640 1 -- 172.21.15.112:0/2995688021 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c00e250 con 0x7fbd8c006a10 2024-09-12T02:53:45.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.635+0000 7fbda5400640 1 -- 172.21.15.112:0/2995688021 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbd8c00e450 con 0x7fbd8c005d50 2024-09-12T02:53:45.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.635+0000 7fbda6800640 1 --2- 172.21.15.112:0/2995688021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd8c0073d0 0x7fbd8c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:45.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.635+0000 7fbda5e00640 1 --2- 172.21.15.112:0/2995688021 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd8c005d50 0x7fbd8c006150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:45.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.635+0000 7fbd9d400640 1 --2- 172.21.15.112:0/2995688021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd8c006a10 0x7fbd8c006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:45.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.636+0000 7fbda6800640 1 -- 172.21.15.112:0/2995688021 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd8c005d50 msgr2=0x7fbd8c006150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:45.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.636+0000 7fbda6800640 1 --2- 172.21.15.112:0/2995688021 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd8c005d50 0x7fbd8c006150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:45.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.636+0000 7fbda6800640 1 -- 172.21.15.112:0/2995688021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd8c006a10 msgr2=0x7fbd8c006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:45.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.636+0000 7fbda6800640 1 --2- 172.21.15.112:0/2995688021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd8c006a10 0x7fbd8c006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:45.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.636+0000 7fbda6800640 1 -- 172.21.15.112:0/2995688021 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8c005730 con 0x7fbd8c0073d0 2024-09-12T02:53:45.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.636+0000 7fbda6800640 1 -- 172.21.15.112:0/2995688021 reap_dead start 2024-09-12T02:53:45.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.637+0000 7fbda6800640 1 --2- 172.21.15.112:0/2995688021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd8c0073d0 0x7fbd8c00dbd0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fbda000a7f0 tx=0x7fbd8c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be09e8bf00f9d455 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:45.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.637+0000 7fbda5400640 1 -- 172.21.15.112:0/2995688021 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda000a440 con 0x7fbd8c0073d0 2024-09-12T02:53:45.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.637+0000 7fbda5400640 1 -- 172.21.15.112:0/2995688021 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbda002f070 con 0x7fbd8c0073d0 2024-09-12T02:53:45.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.637+0000 7fbda5400640 1 -- 172.21.15.112:0/2995688021 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda002bc20 con 0x7fbd8c0073d0 2024-09-12T02:53:45.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.637+0000 7fbdace00640 1 -- 172.21.15.112:0/2995688021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd8c0073d0 msgr2=0x7fbd8c00dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:45.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.637+0000 7fbdace00640 1 --2- 172.21.15.112:0/2995688021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd8c0073d0 0x7fbd8c00dbd0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fbda000a7f0 tx=0x7fbd8c007a40 comp rx=0 tx=0).stop 2024-09-12T02:53:45.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.637+0000 7fbdace00640 1 -- 172.21.15.112:0/2995688021 shutdown_connections 2024-09-12T02:53:45.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.637+0000 7fbdace00640 1 --2- 172.21.15.112:0/2995688021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd8c0073d0 0x7fbd8c00dbd0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:45.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.637+0000 7fbdace00640 1 -- 172.21.15.112:0/2995688021 >> 172.21.15.112:0/2995688021 conn(0x7fbda80b2730 msgr2=0x7fbda80b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:45.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.638+0000 7fbdace00640 1 -- 172.21.15.112:0/2995688021 shutdown_connections 2024-09-12T02:53:45.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.638+0000 7fbdace00640 1 -- 172.21.15.112:0/2995688021 wait complete. 2024-09-12T02:53:45.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.639+0000 7fbdace00640 1 Processor -- start 2024-09-12T02:53:45.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.639+0000 7fbdace00640 1 -- start start 2024-09-12T02:53:45.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.640+0000 7fbdace00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd8c0073d0 0x7fbda81402d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:45.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.640+0000 7fbdace00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbda81387c0 0x7fbda813e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:45.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.640+0000 7fbdace00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbda8139fd0 0x7fbda813a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:45.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.640+0000 7fbdace00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbda8144df0 con 0x7fbd8c0073d0 2024-09-12T02:53:45.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.640+0000 7fbdace00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbda8144c70 con 0x7fbda8139fd0 2024-09-12T02:53:45.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.640+0000 7fbdace00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbda80b3290 con 0x7fbda81387c0 2024-09-12T02:53:45.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.640+0000 7fbda5e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd8c0073d0 0x7fbda81402d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:45.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.640+0000 7fbda5e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd8c0073d0 0x7fbda81402d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44508/0 (socket says 172.21.15.112:44508) 2024-09-12T02:53:45.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.640+0000 7fbda5e00640 1 -- 172.21.15.112:0/3800776624 learned_addr learned my addr 172.21.15.112:0/3800776624 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:45.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.641+0000 7fbda6800640 1 --2- 172.21.15.112:0/3800776624 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbda8139fd0 0x7fbda813a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:45.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.641+0000 7fbd9d400640 1 --2- 172.21.15.112:0/3800776624 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbda81387c0 0x7fbda813e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:45.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.641+0000 7fbda5e00640 1 -- 172.21.15.112:0/3800776624 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbda81387c0 msgr2=0x7fbda813e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:45.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.641+0000 7fbda5e00640 1 --2- 172.21.15.112:0/3800776624 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbda81387c0 0x7fbda813e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:45.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.641+0000 7fbda5e00640 1 -- 172.21.15.112:0/3800776624 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbda8139fd0 msgr2=0x7fbda813a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:45.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.641+0000 7fbda5e00640 1 --2- 172.21.15.112:0/3800776624 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbda8139fd0 0x7fbda813a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:45.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.641+0000 7fbda5e00640 1 -- 172.21.15.112:0/3800776624 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda8138f30 con 0x7fbd8c0073d0 2024-09-12T02:53:45.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.641+0000 7fbda5e00640 1 --2- 172.21.15.112:0/3800776624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd8c0073d0 0x7fbda81402d0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fbd98011910 tx=0x7fbd98011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:45.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.641+0000 7fbd9ea00640 1 -- 172.21.15.112:0/3800776624 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9800fa30 con 0x7fbd8c0073d0 2024-09-12T02:53:45.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.642+0000 7fbd9ea00640 1 -- 172.21.15.112:0/3800776624 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd9800fbd0 con 0x7fbd8c0073d0 2024-09-12T02:53:45.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.642+0000 7fbd9ea00640 1 -- 172.21.15.112:0/3800776624 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd98014440 con 0x7fbd8c0073d0 2024-09-12T02:53:45.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.642+0000 7fbdace00640 1 -- 172.21.15.112:0/3800776624 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbda8139210 con 0x7fbd8c0073d0 2024-09-12T02:53:45.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.642+0000 7fbdace00640 1 -- 172.21.15.112:0/3800776624 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbda81397d0 con 0x7fbd8c0073d0 2024-09-12T02:53:45.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.643+0000 7fbdace00640 1 -- 172.21.15.112:0/3800776624 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbda8139bd0 con 0x7fbd8c0073d0 2024-09-12T02:53:45.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.644+0000 7fbd9ea00640 1 -- 172.21.15.112:0/3800776624 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbd98012040 con 0x7fbd8c0073d0 2024-09-12T02:53:45.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.644+0000 7fbd9ea00640 1 --2- 172.21.15.112:0/3800776624 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbd8406be30 0x7fbd8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:45.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.645+0000 7fbd9ea00640 1 -- 172.21.15.112:0/3800776624 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 4943+0+0 (secure 0 0 0) 0x7fbd9808b150 con 0x7fbd8c0073d0 2024-09-12T02:53:45.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.645+0000 7fbd9d400640 1 --2- 172.21.15.112:0/3800776624 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbd8406be30 0x7fbd8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:45.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.645+0000 7fbd9ea00640 1 --2- 172.21.15.112:0/3800776624 >> [v2:172.21.15.112:6824/231774278,v1:172.21.15.112:6825/231774278] conn(0x7fbd84071cf0 0x7fbd84074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:45.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.645+0000 7fbd9ea00640 1 -- 172.21.15.112:0/3800776624 --> [v2:172.21.15.112:6824/231774278,v1:172.21.15.112:6825/231774278] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd98025ec0 con 0x7fbd84071cf0 2024-09-12T02:53:45.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.645+0000 7fbd9ea00640 1 -- 172.21.15.112:0/3800776624 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=190) ==== 24+0+0 (secure 0 0 0) 0x7fbd98092050 con 0x7fbd8c0073d0 2024-09-12T02:53:45.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.645+0000 7fbda6800640 1 --2- 172.21.15.112:0/3800776624 >> [v2:172.21.15.112:6824/231774278,v1:172.21.15.112:6825/231774278] conn(0x7fbd84071cf0 0x7fbd84074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:45.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.645+0000 7fbd9d400640 1 --2- 172.21.15.112:0/3800776624 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbd8406be30 0x7fbd8406e2f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fbda813ff80 tx=0x7fbd90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:45.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.646+0000 7fbda6800640 1 --2- 172.21.15.112:0/3800776624 >> [v2:172.21.15.112:6824/231774278,v1:172.21.15.112:6825/231774278] conn(0x7fbd84071cf0 0x7fbd84074110 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:45.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.646+0000 7fbd9ea00640 1 -- 172.21.15.112:0/3800776624 <== osd.3 v2:172.21.15.112:6824/231774278 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7fbd98025ec0 con 0x7fbd84071cf0 2024-09-12T02:53:45.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.658+0000 7fbdace00640 1 -- 172.21.15.112:0/3800776624 --> [v2:172.21.15.112:6824/231774278,v1:172.21.15.112:6825/231774278] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbda80b58c0 con 0x7fbd84071cf0 2024-09-12T02:53:45.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.658+0000 7fbd9ea00640 1 -- 172.21.15.112:0/3800776624 <== osd.3 v2:172.21.15.112:6824/231774278 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7fbda80b58c0 con 0x7fbd84071cf0 2024-09-12T02:53:45.659 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:53:45.659 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-12T02:53:45.659 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:53:45.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.659+0000 7fbdace00640 1 -- 172.21.15.112:0/3800776624 >> [v2:172.21.15.112:6824/231774278,v1:172.21.15.112:6825/231774278] conn(0x7fbd84071cf0 msgr2=0x7fbd84074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:45.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.659+0000 7fbdace00640 1 --2- 172.21.15.112:0/3800776624 >> [v2:172.21.15.112:6824/231774278,v1:172.21.15.112:6825/231774278] conn(0x7fbd84071cf0 0x7fbd84074110 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:45.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.659+0000 7fbdace00640 1 -- 172.21.15.112:0/3800776624 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbd8406be30 msgr2=0x7fbd8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:45.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.659+0000 7fbdace00640 1 --2- 172.21.15.112:0/3800776624 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fbd8406be30 0x7fbd8406e2f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fbda813ff80 tx=0x7fbd90009040 comp rx=0 tx=0).stop 2024-09-12T02:53:45.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.659+0000 7fbdace00640 1 -- 172.21.15.112:0/3800776624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd8c0073d0 msgr2=0x7fbda81402d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:45.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.659+0000 7fbdace00640 1 --2- 172.21.15.112:0/3800776624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd8c0073d0 0x7fbda81402d0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fbd98011910 tx=0x7fbd98011d10 comp rx=0 tx=0).stop 2024-09-12T02:53:45.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.659+0000 7fbda6800640 1 -- 172.21.15.112:0/3800776624 reap_dead start 2024-09-12T02:53:45.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.659+0000 7fbdace00640 1 -- 172.21.15.112:0/3800776624 shutdown_connections 2024-09-12T02:53:45.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.659+0000 7fbdace00640 1 -- 172.21.15.112:0/3800776624 >> 172.21.15.112:0/3800776624 conn(0x7fbda80b2730 msgr2=0x7fbda80b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:45.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.659+0000 7fbdace00640 1 -- 172.21.15.112:0/3800776624 shutdown_connections 2024-09-12T02:53:45.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.659+0000 7fbdace00640 1 -- 172.21.15.112:0/3800776624 wait complete. 2024-09-12T02:53:45.675 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T02:53:45.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.827+0000 7fd127000640 1 Processor -- start 2024-09-12T02:53:45.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.827+0000 7fd127000640 1 -- start start 2024-09-12T02:53:45.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.828+0000 7fd127000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1200d1710 0x7fd1200d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:45.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.828+0000 7fd127000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd1200b1d70 0x7fd1200b2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:45.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.828+0000 7fd127000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1200d2fb0 con 0x7fd1200b3e00 2024-09-12T02:53:45.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.828+0000 7fd127000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd1200d3cb0 con 0x7fd1200b1d70 2024-09-12T02:53:45.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.828+0000 7fd127000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd1200d0b60 con 0x7fd1200d1710 2024-09-12T02:53:45.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.828+0000 7fd126600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd1200b1d70 0x7fd1200b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:45.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.829+0000 7fd126600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd1200b1d70 0x7fd1200b2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44518/0 (socket says 172.21.15.112:44518) 2024-09-12T02:53:45.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.829+0000 7fd125c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1200d1710 0x7fd1200d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:45.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.829+0000 7fd126600640 1 -- 172.21.15.112:0/4075212688 learned_addr learned my addr 172.21.15.112:0/4075212688 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:45.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.829+0000 7fd126600640 1 -- 172.21.15.112:0/4075212688 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1200d1710 msgr2=0x7fd1200d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:45.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.829+0000 7fd126600640 1 --2- 172.21.15.112:0/4075212688 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1200d1710 0x7fd1200d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:45.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.829+0000 7fd126600640 1 -- 172.21.15.112:0/4075212688 >> v1:172.21.15.112:6789/0 conn(0x7fd1200b3e00 legacy=0x7fd1200d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:45.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.829+0000 7fd126600640 1 -- 172.21.15.112:0/4075212688 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1200d3410 con 0x7fd1200b1d70 2024-09-12T02:53:45.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.829+0000 7fd11fe00640 1 -- 172.21.15.112:0/4075212688 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2718498857 0 0) 0x7fd1200d2fb0 con 0x7fd1200b3e00 2024-09-12T02:53:45.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.830+0000 7fd126600640 1 --2- 172.21.15.112:0/4075212688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1200b1d70 0x7fd1200b2220 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fd118009e50 tx=0x7fd11802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ceacf6c44053ca6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:45.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.830+0000 7fd11fe00640 1 -- 172.21.15.112:0/4075212688 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd118036070 con 0x7fd1200b1d70 2024-09-12T02:53:45.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.830+0000 7fd11fe00640 1 -- 172.21.15.112:0/4075212688 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd118031600 con 0x7fd1200b1d70 2024-09-12T02:53:45.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.830+0000 7fd11fe00640 1 -- 172.21.15.112:0/4075212688 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1180319d0 con 0x7fd1200b1d70 2024-09-12T02:53:45.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.831+0000 7fd127000640 1 -- 172.21.15.112:0/4075212688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1200b1d70 msgr2=0x7fd1200b2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:45.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.831+0000 7fd127000640 1 --2- 172.21.15.112:0/4075212688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1200b1d70 0x7fd1200b2220 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fd118009e50 tx=0x7fd11802a710 comp rx=0 tx=0).stop 2024-09-12T02:53:45.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.831+0000 7fd127000640 1 -- 172.21.15.112:0/4075212688 shutdown_connections 2024-09-12T02:53:45.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.831+0000 7fd127000640 1 --2- 172.21.15.112:0/4075212688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1200b1d70 0x7fd1200b2220 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:45.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.831+0000 7fd127000640 1 --2- 172.21.15.112:0/4075212688 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1200d1710 0x7fd1200d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:45.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.831+0000 7fd127000640 1 -- 172.21.15.112:0/4075212688 >> 172.21.15.112:0/4075212688 conn(0x7fd12009e030 msgr2=0x7fd1200d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:45.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.831+0000 7fd127000640 1 -- 172.21.15.112:0/4075212688 shutdown_connections 2024-09-12T02:53:45.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.831+0000 7fd127000640 1 -- 172.21.15.112:0/4075212688 wait complete. 2024-09-12T02:53:45.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.833+0000 7fd127000640 1 Processor -- start 2024-09-12T02:53:45.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.833+0000 7fd127000640 1 -- start start 2024-09-12T02:53:45.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.833+0000 7fd127000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1200b1d70 0x7fd120162070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:45.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.834+0000 7fd127000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1200b3e00 0x7fd1200c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:45.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.834+0000 7fd127000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1200d1710 0x7fd12014f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:45.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.834+0000 7fd127000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd12015f110 con 0x7fd1200b1d70 2024-09-12T02:53:45.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.834+0000 7fd127000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd1200d39d0 con 0x7fd1200d1710 2024-09-12T02:53:45.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.834+0000 7fd127000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd12015f290 con 0x7fd1200b3e00 2024-09-12T02:53:45.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.834+0000 7fd125c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1200b1d70 0x7fd120162070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:45.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.834+0000 7fd125c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1200b1d70 0x7fd120162070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44534/0 (socket says 172.21.15.112:44534) 2024-09-12T02:53:45.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.834+0000 7fd125c00640 1 -- 172.21.15.112:0/557429741 learned_addr learned my addr 172.21.15.112:0/557429741 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:45.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.834+0000 7fd125200640 1 --2- 172.21.15.112:0/557429741 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1200b3e00 0x7fd1200c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:45.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.834+0000 7fd126600640 1 --2- 172.21.15.112:0/557429741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1200d1710 0x7fd12014f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:45.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.834+0000 7fd125c00640 1 -- 172.21.15.112:0/557429741 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1200b3e00 msgr2=0x7fd1200c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:45.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.834+0000 7fd125c00640 1 --2- 172.21.15.112:0/557429741 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1200b3e00 0x7fd1200c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:45.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.834+0000 7fd125c00640 1 -- 172.21.15.112:0/557429741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1200d1710 msgr2=0x7fd12014f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:45.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.834+0000 7fd125c00640 1 --2- 172.21.15.112:0/557429741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1200d1710 0x7fd12014f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:45.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.834+0000 7fd125c00640 1 -- 172.21.15.112:0/557429741 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1200ca1e0 con 0x7fd1200b1d70 2024-09-12T02:53:45.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.834+0000 7fd126600640 1 --2- 172.21.15.112:0/557429741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1200d1710 0x7fd12014f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:53:45.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.834+0000 7fd125c00640 1 --2- 172.21.15.112:0/557429741 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1200b1d70 0x7fd120162070 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fd11400e8a0 tx=0x7fd11400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:45.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.835+0000 7fd11d600640 1 -- 172.21.15.112:0/557429741 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd114017070 con 0x7fd1200b1d70 2024-09-12T02:53:45.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.835+0000 7fd11d600640 1 -- 172.21.15.112:0/557429741 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd11400c940 con 0x7fd1200b1d70 2024-09-12T02:53:45.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.835+0000 7fd127000640 1 -- 172.21.15.112:0/557429741 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1200ca4c0 con 0x7fd1200b1d70 2024-09-12T02:53:45.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.835+0000 7fd11d600640 1 -- 172.21.15.112:0/557429741 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd11400cd30 con 0x7fd1200b1d70 2024-09-12T02:53:45.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.835+0000 7fd127000640 1 -- 172.21.15.112:0/557429741 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1200caa80 con 0x7fd1200b1d70 2024-09-12T02:53:45.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.836+0000 7fd127000640 1 -- 172.21.15.112:0/557429741 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1200d28d0 con 0x7fd1200b1d70 2024-09-12T02:53:45.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.837+0000 7fd11d600640 1 -- 172.21.15.112:0/557429741 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd11401a070 con 0x7fd1200b1d70 2024-09-12T02:53:45.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.838+0000 7fd11d600640 1 --2- 172.21.15.112:0/557429741 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd10006be30 0x7fd10006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:45.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.838+0000 7fd11d600640 1 -- 172.21.15.112:0/557429741 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 4943+0+0 (secure 0 0 0) 0x7fd11408ae50 con 0x7fd1200b1d70 2024-09-12T02:53:45.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.838+0000 7fd125200640 1 --2- 172.21.15.112:0/557429741 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd10006be30 0x7fd10006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:45.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.838+0000 7fd125200640 1 --2- 172.21.15.112:0/557429741 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd10006be30 0x7fd10006e2f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd1200cee90 tx=0x7fd10c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:45.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:45.842+0000 7fd11d600640 1 -- 172.21.15.112:0/557429741 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd114059a60 con 0x7fd1200b1d70 2024-09-12T02:53:46.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.015+0000 7fd127000640 1 -- 172.21.15.112:0/557429741 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fd1200b3320 con 0x7fd10006be30 2024-09-12T02:53:46.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.015+0000 7fd11d600640 1 -- 172.21.15.112:0/557429741 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd1200b3320 con 0x7fd10006be30 2024-09-12T02:53:46.017 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T02:53:46.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.017+0000 7fd127000640 1 -- 172.21.15.112:0/557429741 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd10006be30 msgr2=0x7fd10006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:46.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.017+0000 7fd127000640 1 --2- 172.21.15.112:0/557429741 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd10006be30 0x7fd10006e2f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd1200cee90 tx=0x7fd10c009040 comp rx=0 tx=0).stop 2024-09-12T02:53:46.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.017+0000 7fd127000640 1 -- 172.21.15.112:0/557429741 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1200b1d70 msgr2=0x7fd120162070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:46.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.017+0000 7fd127000640 1 --2- 172.21.15.112:0/557429741 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1200b1d70 0x7fd120162070 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fd11400e8a0 tx=0x7fd11400ed60 comp rx=0 tx=0).stop 2024-09-12T02:53:46.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.017+0000 7fd127000640 1 -- 172.21.15.112:0/557429741 shutdown_connections 2024-09-12T02:53:46.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.017+0000 7fd127000640 1 --2- 172.21.15.112:0/557429741 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fd10006be30 0x7fd10006e2f0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.017+0000 7fd127000640 1 --2- 172.21.15.112:0/557429741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1200d1710 0x7fd12014f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.017+0000 7fd127000640 1 --2- 172.21.15.112:0/557429741 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1200b3e00 0x7fd1200c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.017+0000 7fd127000640 1 --2- 172.21.15.112:0/557429741 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1200b1d70 0x7fd120162070 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.017+0000 7fd127000640 1 -- 172.21.15.112:0/557429741 >> 172.21.15.112:0/557429741 conn(0x7fd12009e030 msgr2=0x7fd1200b9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:46.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.018+0000 7fd127000640 1 -- 172.21.15.112:0/557429741 shutdown_connections 2024-09-12T02:53:46.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.018+0000 7fd127000640 1 -- 172.21.15.112:0/557429741 wait complete. 2024-09-12T02:53:46.034 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T02:53:46.034 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:53:46.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.191+0000 7fe4c1a00640 1 Processor -- start 2024-09-12T02:53:46.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.191+0000 7fe4c1a00640 1 -- start start 2024-09-12T02:53:46.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.192+0000 7fe4c1a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4bc144890 0x7fe4bc0b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:46.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.192+0000 7fe4c1a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe4bc0b4140 0x7fe4bc0ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:46.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.192+0000 7fe4c1a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4bc06eed0 con 0x7fe4bc1602f0 2024-09-12T02:53:46.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.192+0000 7fe4c1a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe4bc06f170 con 0x7fe4bc0b4140 2024-09-12T02:53:46.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.192+0000 7fe4c1a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe4bc15f810 con 0x7fe4bc144890 2024-09-12T02:53:46.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.192+0000 7fe4b2000640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe4bc1602f0 0x7fe4bc0b3a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38532/0 (socket says 172.21.15.112:38532) 2024-09-12T02:53:46.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.192+0000 7fe4b2000640 1 -- 172.21.15.112:0/2822075354 learned_addr learned my addr 172.21.15.112:0/2822075354 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:53:46.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.193+0000 7fe4baa00640 1 --2- 172.21.15.112:0/2822075354 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4bc144890 0x7fe4bc0b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:46.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.193+0000 7fe4bb400640 1 --2- 172.21.15.112:0/2822075354 >> v2:172.21.15.137:3300/0 conn(0x7fe4bc0b4140 0x7fe4bc0ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:46.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.193+0000 7fe4ba000640 1 -- 172.21.15.112:0/2822075354 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1785752118 0 0) 0x7fe4bc06eed0 con 0x7fe4bc1602f0 2024-09-12T02:53:46.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.193+0000 7fe4ba000640 1 -- 172.21.15.112:0/2822075354 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4a0005730 con 0x7fe4bc1602f0 2024-09-12T02:53:46.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.193+0000 7fe4baa00640 1 -- 172.21.15.112:0/2822075354 >> v2:172.21.15.137:3300/0 conn(0x7fe4bc0b4140 msgr2=0x7fe4bc0ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:46.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.193+0000 7fe4baa00640 1 --2- 172.21.15.112:0/2822075354 >> v2:172.21.15.137:3300/0 conn(0x7fe4bc0b4140 0x7fe4bc0ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.193+0000 7fe4baa00640 1 -- 172.21.15.112:0/2822075354 >> v1:172.21.15.112:6789/0 conn(0x7fe4bc1602f0 legacy=0x7fe4bc0b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:46.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.193+0000 7fe4baa00640 1 -- 172.21.15.112:0/2822075354 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4bc15faf0 con 0x7fe4bc144890 2024-09-12T02:53:46.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.194+0000 7fe4baa00640 1 --2- 172.21.15.112:0/2822075354 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4bc144890 0x7fe4bc0b58c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac0097a0 tx=0x7fe4ac02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ee0004bece95811 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:46.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.194+0000 7fe4ba000640 1 -- 172.21.15.112:0/2822075354 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac037070 con 0x7fe4bc144890 2024-09-12T02:53:46.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.194+0000 7fe4ba000640 1 -- 172.21.15.112:0/2822075354 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4ac032440 con 0x7fe4bc144890 2024-09-12T02:53:46.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.194+0000 7fe4ba000640 1 -- 172.21.15.112:0/2822075354 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac032810 con 0x7fe4bc144890 2024-09-12T02:53:46.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.195+0000 7fe4c1a00640 1 -- 172.21.15.112:0/2822075354 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4bc144890 msgr2=0x7fe4bc0b58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:46.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.195+0000 7fe4c1a00640 1 --2- 172.21.15.112:0/2822075354 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4bc144890 0x7fe4bc0b58c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac0097a0 tx=0x7fe4ac02a180 comp rx=0 tx=0).stop 2024-09-12T02:53:46.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.195+0000 7fe4c1a00640 1 -- 172.21.15.112:0/2822075354 shutdown_connections 2024-09-12T02:53:46.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.195+0000 7fe4c1a00640 1 --2- 172.21.15.112:0/2822075354 >> v2:172.21.15.137:3300/0 conn(0x7fe4bc0b4140 0x7fe4bc0ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.195+0000 7fe4c1a00640 1 --2- 172.21.15.112:0/2822075354 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4bc144890 0x7fe4bc0b58c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.195+0000 7fe4c1a00640 1 -- 172.21.15.112:0/2822075354 >> 172.21.15.112:0/2822075354 conn(0x7fe4bc0b2730 msgr2=0x7fe4bc0b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:46.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.195+0000 7fe4c1a00640 1 -- 172.21.15.112:0/2822075354 shutdown_connections 2024-09-12T02:53:46.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.195+0000 7fe4c1a00640 1 -- 172.21.15.112:0/2822075354 wait complete. 2024-09-12T02:53:46.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.197+0000 7fe4c1a00640 1 Processor -- start 2024-09-12T02:53:46.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.197+0000 7fe4c1a00640 1 -- start start 2024-09-12T02:53:46.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.198+0000 7fe4c1a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4bc0b4140 0x7fe4bc13e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:46.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.198+0000 7fe4c1a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4bc144890 0x7fe4bc138280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:46.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.198+0000 7fe4c1a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4bc1602f0 0x7fe4bc0afc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:46.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.198+0000 7fe4c1a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe4bc144df0 con 0x7fe4bc0b4140 2024-09-12T02:53:46.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.198+0000 7fe4c1a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe4bc144c70 con 0x7fe4bc144890 2024-09-12T02:53:46.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.198+0000 7fe4c1a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe4bc0b3290 con 0x7fe4bc1602f0 2024-09-12T02:53:46.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.198+0000 7fe4baa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4bc0b4140 0x7fe4bc13e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:46.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.198+0000 7fe4baa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4bc0b4140 0x7fe4bc13e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44544/0 (socket says 172.21.15.112:44544) 2024-09-12T02:53:46.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.198+0000 7fe4baa00640 1 -- 172.21.15.112:0/1827543996 learned_addr learned my addr 172.21.15.112:0/1827543996 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:46.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.198+0000 7fe4b2000640 1 --2- 172.21.15.112:0/1827543996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4bc144890 0x7fe4bc138280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:46.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.198+0000 7fe4bb400640 1 --2- 172.21.15.112:0/1827543996 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4bc1602f0 0x7fe4bc0afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:46.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.198+0000 7fe4baa00640 1 -- 172.21.15.112:0/1827543996 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4bc1602f0 msgr2=0x7fe4bc0afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:46.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.198+0000 7fe4baa00640 1 --2- 172.21.15.112:0/1827543996 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4bc1602f0 0x7fe4bc0afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.198+0000 7fe4baa00640 1 -- 172.21.15.112:0/1827543996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4bc144890 msgr2=0x7fe4bc138280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:46.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.198+0000 7fe4baa00640 1 --2- 172.21.15.112:0/1827543996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4bc144890 0x7fe4bc138280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.198+0000 7fe4baa00640 1 -- 172.21.15.112:0/1827543996 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4bc13e6d0 con 0x7fe4bc0b4140 2024-09-12T02:53:46.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.198+0000 7fe4b2000640 1 --2- 172.21.15.112:0/1827543996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4bc144890 0x7fe4bc138280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:53:46.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.199+0000 7fe4baa00640 1 --2- 172.21.15.112:0/1827543996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4bc0b4140 0x7fe4bc13e010 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac0098c0 tx=0x7fe4ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:46.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.199+0000 7fe4b3400640 1 -- 172.21.15.112:0/1827543996 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac041020 con 0x7fe4bc0b4140 2024-09-12T02:53:46.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.199+0000 7fe4b3400640 1 -- 172.21.15.112:0/1827543996 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4ac03d6e0 con 0x7fe4bc0b4140 2024-09-12T02:53:46.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.199+0000 7fe4b3400640 1 -- 172.21.15.112:0/1827543996 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac037040 con 0x7fe4bc0b4140 2024-09-12T02:53:46.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.199+0000 7fe4c1a00640 1 -- 172.21.15.112:0/1827543996 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4bc13e9b0 con 0x7fe4bc0b4140 2024-09-12T02:53:46.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.199+0000 7fe4c1a00640 1 -- 172.21.15.112:0/1827543996 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4bc13ef70 con 0x7fe4bc0b4140 2024-09-12T02:53:46.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.200+0000 7fe4c1a00640 1 -- 172.21.15.112:0/1827543996 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe4bc13f1b0 con 0x7fe4bc0b4140 2024-09-12T02:53:46.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.201+0000 7fe4b3400640 1 -- 172.21.15.112:0/1827543996 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe4ac044020 con 0x7fe4bc0b4140 2024-09-12T02:53:46.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.201+0000 7fe4b3400640 1 --2- 172.21.15.112:0/1827543996 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe49806be30 0x7fe49806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:46.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.202+0000 7fe4b3400640 1 -- 172.21.15.112:0/1827543996 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 4943+0+0 (secure 0 0 0) 0x7fe4ac0ab340 con 0x7fe4bc0b4140 2024-09-12T02:53:46.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.202+0000 7fe4b2000640 1 --2- 172.21.15.112:0/1827543996 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe49806be30 0x7fe49806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:46.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.202+0000 7fe4b3400640 1 --2- 172.21.15.112:0/1827543996 >> [v2:172.21.15.137:6800/3671178153,v1:172.21.15.137:6801/3671178153] conn(0x7fe498071cf0 0x7fe498074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:46.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.202+0000 7fe4b3400640 1 -- 172.21.15.112:0/1827543996 --> [v2:172.21.15.137:6800/3671178153,v1:172.21.15.137:6801/3671178153] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe4ac032440 con 0x7fe498071cf0 2024-09-12T02:53:46.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.202+0000 7fe4b3400640 1 -- 172.21.15.112:0/1827543996 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=190) ==== 24+0+0 (secure 0 0 0) 0x7fe4ac0b2050 con 0x7fe4bc0b4140 2024-09-12T02:53:46.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.202+0000 7fe4bb400640 1 --2- 172.21.15.112:0/1827543996 >> [v2:172.21.15.137:6800/3671178153,v1:172.21.15.137:6801/3671178153] conn(0x7fe498071cf0 0x7fe498074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:46.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.202+0000 7fe4b2000640 1 --2- 172.21.15.112:0/1827543996 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe49806be30 0x7fe49806e2f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc13f3c0 tx=0x7fe4a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:46.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.203+0000 7fe4bb400640 1 --2- 172.21.15.112:0/1827543996 >> [v2:172.21.15.137:6800/3671178153,v1:172.21.15.137:6801/3671178153] conn(0x7fe498071cf0 0x7fe498074110 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:46.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.204+0000 7fe4b3400640 1 -- 172.21.15.112:0/1827543996 <== osd.4 v2:172.21.15.137:6800/3671178153 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7fe4ac032440 con 0x7fe498071cf0 2024-09-12T02:53:46.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.216+0000 7fe4c1a00640 1 -- 172.21.15.112:0/1827543996 --> [v2:172.21.15.137:6800/3671178153,v1:172.21.15.137:6801/3671178153] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe4bc0d0b10 con 0x7fe498071cf0 2024-09-12T02:53:46.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.216+0000 7fe4b3400640 1 -- 172.21.15.112:0/1827543996 <== osd.4 v2:172.21.15.137:6800/3671178153 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7fe4bc0d0b10 con 0x7fe498071cf0 2024-09-12T02:53:46.217 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:53:46.217 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-12T02:53:46.217 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:53:46.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.217+0000 7fe4c1a00640 1 -- 172.21.15.112:0/1827543996 >> [v2:172.21.15.137:6800/3671178153,v1:172.21.15.137:6801/3671178153] conn(0x7fe498071cf0 msgr2=0x7fe498074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:46.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.217+0000 7fe4c1a00640 1 --2- 172.21.15.112:0/1827543996 >> [v2:172.21.15.137:6800/3671178153,v1:172.21.15.137:6801/3671178153] conn(0x7fe498071cf0 0x7fe498074110 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.217+0000 7fe4c1a00640 1 -- 172.21.15.112:0/1827543996 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe49806be30 msgr2=0x7fe49806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:46.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.217+0000 7fe4c1a00640 1 --2- 172.21.15.112:0/1827543996 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fe49806be30 0x7fe49806e2f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc13f3c0 tx=0x7fe4a4009040 comp rx=0 tx=0).stop 2024-09-12T02:53:46.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.217+0000 7fe4c1a00640 1 -- 172.21.15.112:0/1827543996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4bc0b4140 msgr2=0x7fe4bc13e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:46.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.217+0000 7fe4c1a00640 1 --2- 172.21.15.112:0/1827543996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4bc0b4140 0x7fe4bc13e010 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac0098c0 tx=0x7fe4ac0046c0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.217+0000 7fe4bb400640 1 -- 172.21.15.112:0/1827543996 reap_dead start 2024-09-12T02:53:46.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.217+0000 7fe4c1a00640 1 -- 172.21.15.112:0/1827543996 shutdown_connections 2024-09-12T02:53:46.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.217+0000 7fe4c1a00640 1 -- 172.21.15.112:0/1827543996 >> 172.21.15.112:0/1827543996 conn(0x7fe4bc0b2730 msgr2=0x7fe4bc0b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:46.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.217+0000 7fe4c1a00640 1 -- 172.21.15.112:0/1827543996 shutdown_connections 2024-09-12T02:53:46.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.217+0000 7fe4c1a00640 1 -- 172.21.15.112:0/1827543996 wait complete. 2024-09-12T02:53:46.232 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T02:53:46.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.385+0000 7f2ca4000640 1 Processor -- start 2024-09-12T02:53:46.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.385+0000 7f2ca4000640 1 -- start start 2024-09-12T02:53:46.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.386+0000 7f2ca4000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2c9c071530 0x7f2c9c0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:46.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.386+0000 7f2ca4000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2c9c0719a0 0x7f2c9c0afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:46.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.387+0000 7f2ca4000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c9c0ceeb0 con 0x7f2c9c15cc50 2024-09-12T02:53:46.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.387+0000 7f2ca4000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2c9c15d030 con 0x7f2c9c0719a0 2024-09-12T02:53:46.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.387+0000 7f2ca4000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2c9c0cf4c0 con 0x7f2c9c071530 2024-09-12T02:53:46.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.387+0000 7f2ca2000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2c9c0719a0 0x7f2c9c0afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:46.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.387+0000 7f2ca1600640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2c9c15cc50 0x7f2c9c0732f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38544/0 (socket says 172.21.15.112:38544) 2024-09-12T02:53:46.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.387+0000 7f2ca1600640 1 -- 172.21.15.112:0/607978432 learned_addr learned my addr 172.21.15.112:0/607978432 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:53:46.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.387+0000 7f2ca2000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2c9c0719a0 0x7f2c9c0afc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44556/0 (socket says 172.21.15.112:44556) 2024-09-12T02:53:46.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.387+0000 7f2ca0c00640 1 --2- 172.21.15.112:0/607978432 >> v2:172.21.15.137:3300/0 conn(0x7f2c9c071530 0x7f2c9c0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:46.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.387+0000 7f2ca2000640 1 -- 172.21.15.112:0/607978432 >> v2:172.21.15.137:3300/0 conn(0x7f2c9c071530 msgr2=0x7f2c9c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:46.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.387+0000 7f2ca2000640 1 --2- 172.21.15.112:0/607978432 >> v2:172.21.15.137:3300/0 conn(0x7f2c9c071530 0x7f2c9c0af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.387+0000 7f2ca2000640 1 -- 172.21.15.112:0/607978432 >> v1:172.21.15.112:6789/0 conn(0x7f2c9c15cc50 legacy=0x7f2c9c0732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:46.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.387+0000 7f2ca2000640 1 -- 172.21.15.112:0/607978432 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c9c06e300 con 0x7f2c9c0719a0 2024-09-12T02:53:46.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.388+0000 7f2ca2000640 1 --2- 172.21.15.112:0/607978432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c9c0719a0 0x7f2c9c0afc60 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c0cf640 tx=0x7f2c9402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b870dcfd11b82283 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:46.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.388+0000 7f2c9be00640 1 -- 172.21.15.112:0/607978432 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c94031600 con 0x7f2c9c0719a0 2024-09-12T02:53:46.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.388+0000 7f2c9be00640 1 -- 172.21.15.112:0/607978432 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c940317a0 con 0x7f2c9c0719a0 2024-09-12T02:53:46.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.389+0000 7f2c9be00640 1 -- 172.21.15.112:0/607978432 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c94031b70 con 0x7f2c9c0719a0 2024-09-12T02:53:46.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.389+0000 7f2ca4000640 1 -- 172.21.15.112:0/607978432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c9c0719a0 msgr2=0x7f2c9c0afc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:46.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.389+0000 7f2ca4000640 1 --2- 172.21.15.112:0/607978432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c9c0719a0 0x7f2c9c0afc60 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c0cf640 tx=0x7f2c9402a5d0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.389+0000 7f2ca4000640 1 -- 172.21.15.112:0/607978432 shutdown_connections 2024-09-12T02:53:46.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.389+0000 7f2ca4000640 1 --2- 172.21.15.112:0/607978432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c9c0719a0 0x7f2c9c0afc60 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.389+0000 7f2ca4000640 1 --2- 172.21.15.112:0/607978432 >> v2:172.21.15.137:3300/0 conn(0x7f2c9c071530 0x7f2c9c0af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.389+0000 7f2ca4000640 1 -- 172.21.15.112:0/607978432 >> 172.21.15.112:0/607978432 conn(0x7f2c9c06bbd0 msgr2=0x7f2c9c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:46.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.389+0000 7f2ca4000640 1 -- 172.21.15.112:0/607978432 shutdown_connections 2024-09-12T02:53:46.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.389+0000 7f2ca4000640 1 -- 172.21.15.112:0/607978432 wait complete. 2024-09-12T02:53:46.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.391+0000 7f2ca4000640 1 Processor -- start 2024-09-12T02:53:46.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.391+0000 7f2ca4000640 1 -- start start 2024-09-12T02:53:46.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.392+0000 7f2ca4000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c9c071530 0x7f2c9c159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:46.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.392+0000 7f2ca4000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2c9c0719a0 0x7f2c9c156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:46.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.392+0000 7f2ca4000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c9c15cc50 0x7f2c9c156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:46.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.392+0000 7f2ca4000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9c06f510 con 0x7f2c9c071530 2024-09-12T02:53:46.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.392+0000 7f2ca4000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9c0cf150 con 0x7f2c9c15cc50 2024-09-12T02:53:46.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.392+0000 7f2ca4000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2c9c06f690 con 0x7f2c9c0719a0 2024-09-12T02:53:46.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.392+0000 7f2ca1600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c9c071530 0x7f2c9c159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:46.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.392+0000 7f2ca1600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c9c071530 0x7f2c9c159e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44560/0 (socket says 172.21.15.112:44560) 2024-09-12T02:53:46.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.392+0000 7f2ca1600640 1 -- 172.21.15.112:0/2525702577 learned_addr learned my addr 172.21.15.112:0/2525702577 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:46.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.392+0000 7f2ca0c00640 1 --2- 172.21.15.112:0/2525702577 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2c9c0719a0 0x7f2c9c156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:46.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.392+0000 7f2ca2000640 1 --2- 172.21.15.112:0/2525702577 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c9c15cc50 0x7f2c9c156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:46.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.392+0000 7f2ca1600640 1 -- 172.21.15.112:0/2525702577 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2c9c0719a0 msgr2=0x7f2c9c156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:46.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.392+0000 7f2ca1600640 1 --2- 172.21.15.112:0/2525702577 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2c9c0719a0 0x7f2c9c156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.392+0000 7f2ca1600640 1 -- 172.21.15.112:0/2525702577 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c9c15cc50 msgr2=0x7f2c9c156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:46.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.392+0000 7f2ca1600640 1 --2- 172.21.15.112:0/2525702577 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c9c15cc50 0x7f2c9c156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.392+0000 7f2ca1600640 1 -- 172.21.15.112:0/2525702577 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c9c15a380 con 0x7f2c9c071530 2024-09-12T02:53:46.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.392+0000 7f2ca2000640 1 --2- 172.21.15.112:0/2525702577 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c9c15cc50 0x7f2c9c156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:53:46.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.393+0000 7f2ca1600640 1 --2- 172.21.15.112:0/2525702577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c9c071530 0x7f2c9c159e40 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f2c9000c3f0 tx=0x7f2c9000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:46.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.393+0000 7f2c99600640 1 -- 172.21.15.112:0/2525702577 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c90017070 con 0x7f2c9c071530 2024-09-12T02:53:46.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.393+0000 7f2c99600640 1 -- 172.21.15.112:0/2525702577 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c90005ce0 con 0x7f2c9c071530 2024-09-12T02:53:46.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.393+0000 7f2c99600640 1 -- 172.21.15.112:0/2525702577 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c900072f0 con 0x7f2c9c071530 2024-09-12T02:53:46.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.393+0000 7f2ca4000640 1 -- 172.21.15.112:0/2525702577 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c9c155590 con 0x7f2c9c071530 2024-09-12T02:53:46.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.393+0000 7f2ca4000640 1 -- 172.21.15.112:0/2525702577 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c9c155b50 con 0x7f2c9c071530 2024-09-12T02:53:46.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.394+0000 7f2ca4000640 1 -- 172.21.15.112:0/2525702577 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c9c068a30 con 0x7f2c9c071530 2024-09-12T02:53:46.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.395+0000 7f2c99600640 1 -- 172.21.15.112:0/2525702577 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2c9001a070 con 0x7f2c9c071530 2024-09-12T02:53:46.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.396+0000 7f2c99600640 1 --2- 172.21.15.112:0/2525702577 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2c7c06be30 0x7f2c7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:46.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.396+0000 7f2c99600640 1 -- 172.21.15.112:0/2525702577 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 4943+0+0 (secure 0 0 0) 0x7f2c90089eb0 con 0x7f2c9c071530 2024-09-12T02:53:46.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.396+0000 7f2ca0c00640 1 --2- 172.21.15.112:0/2525702577 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2c7c06be30 0x7f2c7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:46.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.397+0000 7f2ca0c00640 1 --2- 172.21.15.112:0/2525702577 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2c7c06be30 0x7f2c7c06e2f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c15c660 tx=0x7f2c88008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:46.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.400+0000 7f2c99600640 1 -- 172.21.15.112:0/2525702577 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2c90058b50 con 0x7f2c9c071530 2024-09-12T02:53:46.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.572+0000 7f2ca4000640 1 -- 172.21.15.112:0/2525702577 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f2c9c06df60 con 0x7f2c7c06be30 2024-09-12T02:53:46.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.573+0000 7f2c99600640 1 -- 172.21.15.112:0/2525702577 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2c9c06df60 con 0x7f2c7c06be30 2024-09-12T02:53:46.574 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T02:53:46.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.574+0000 7f2ca4000640 1 -- 172.21.15.112:0/2525702577 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2c7c06be30 msgr2=0x7f2c7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:46.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.574+0000 7f2ca4000640 1 --2- 172.21.15.112:0/2525702577 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2c7c06be30 0x7f2c7c06e2f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c15c660 tx=0x7f2c88008040 comp rx=0 tx=0).stop 2024-09-12T02:53:46.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.575+0000 7f2ca4000640 1 -- 172.21.15.112:0/2525702577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c9c071530 msgr2=0x7f2c9c159e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:46.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.575+0000 7f2ca4000640 1 --2- 172.21.15.112:0/2525702577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c9c071530 0x7f2c9c159e40 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f2c9000c3f0 tx=0x7f2c9000c8b0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.575+0000 7f2ca4000640 1 -- 172.21.15.112:0/2525702577 shutdown_connections 2024-09-12T02:53:46.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.575+0000 7f2ca4000640 1 --2- 172.21.15.112:0/2525702577 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f2c7c06be30 0x7f2c7c06e2f0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.575+0000 7f2ca4000640 1 --2- 172.21.15.112:0/2525702577 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c9c15cc50 0x7f2c9c156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.575+0000 7f2ca4000640 1 --2- 172.21.15.112:0/2525702577 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2c9c0719a0 0x7f2c9c156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.575+0000 7f2ca4000640 1 --2- 172.21.15.112:0/2525702577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c9c071530 0x7f2c9c159e40 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.575+0000 7f2ca4000640 1 -- 172.21.15.112:0/2525702577 >> 172.21.15.112:0/2525702577 conn(0x7f2c9c06bbd0 msgr2=0x7f2c9c0cf950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:46.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.575+0000 7f2ca4000640 1 -- 172.21.15.112:0/2525702577 shutdown_connections 2024-09-12T02:53:46.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.575+0000 7f2ca4000640 1 -- 172.21.15.112:0/2525702577 wait complete. 2024-09-12T02:53:46.591 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T02:53:46.591 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:53:46.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.746+0000 7f33be800640 1 Processor -- start 2024-09-12T02:53:46.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.746+0000 7f33be800640 1 -- start start 2024-09-12T02:53:46.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.747+0000 7f33be800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f33b81624a0 0x7f33b80d1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:46.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.747+0000 7f33be800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f33b80d57c0 0x7f33b80d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:46.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.747+0000 7f33be800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33b80d3250 con 0x7f33b80b4c50 2024-09-12T02:53:46.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.747+0000 7f33be800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f33b80d2620 con 0x7f33b80d57c0 2024-09-12T02:53:46.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.747+0000 7f33be800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f33b80b47c0 con 0x7f33b81624a0 2024-09-12T02:53:46.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.747+0000 7f33bca00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f33b80d57c0 0x7f33b80d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:46.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.747+0000 7f33bde00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f33b80b4c50 0x7f33b80b50e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38556/0 (socket says 172.21.15.112:38556) 2024-09-12T02:53:46.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.747+0000 7f33bde00640 1 -- 172.21.15.112:0/1058513564 learned_addr learned my addr 172.21.15.112:0/1058513564 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:53:46.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.747+0000 7f33bd400640 1 --2- 172.21.15.112:0/1058513564 >> v2:172.21.15.137:3300/0 conn(0x7f33b81624a0 0x7f33b80d1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:46.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.748+0000 7f33bca00640 1 -- 172.21.15.112:0/1058513564 >> v2:172.21.15.137:3300/0 conn(0x7f33b81624a0 msgr2=0x7f33b80d1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:46.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.748+0000 7f33bca00640 1 --2- 172.21.15.112:0/1058513564 >> v2:172.21.15.137:3300/0 conn(0x7f33b81624a0 0x7f33b80d1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.748+0000 7f33bca00640 1 -- 172.21.15.112:0/1058513564 >> v1:172.21.15.112:6789/0 conn(0x7f33b80b4c50 legacy=0x7f33b80b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:46.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.748+0000 7f33bca00640 1 -- 172.21.15.112:0/1058513564 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b80d34d0 con 0x7f33b80d57c0 2024-09-12T02:53:46.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.748+0000 7f33b7e00640 1 -- 172.21.15.112:0/1058513564 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4226165772 0 0) 0x7f33b0001490 con 0x7f33b80b4c50 2024-09-12T02:53:46.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.749+0000 7f33bca00640 1 --2- 172.21.15.112:0/1058513564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33b80d57c0 0x7f33b80d1b60 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f33b808da20 tx=0x7f33a402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb2544e5ab0b703c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:46.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.749+0000 7f33b7e00640 1 -- 172.21.15.112:0/1058513564 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a4037070 con 0x7f33b80d57c0 2024-09-12T02:53:46.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.749+0000 7f33b7e00640 1 -- 172.21.15.112:0/1058513564 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a4032440 con 0x7f33b80d57c0 2024-09-12T02:53:46.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.749+0000 7f33b7e00640 1 -- 172.21.15.112:0/1058513564 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a4032810 con 0x7f33b80d57c0 2024-09-12T02:53:46.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.749+0000 7f33be800640 1 -- 172.21.15.112:0/1058513564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33b80d57c0 msgr2=0x7f33b80d1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:46.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.749+0000 7f33be800640 1 --2- 172.21.15.112:0/1058513564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33b80d57c0 0x7f33b80d1b60 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f33b808da20 tx=0x7f33a402a1a0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.749+0000 7f33be800640 1 -- 172.21.15.112:0/1058513564 shutdown_connections 2024-09-12T02:53:46.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.749+0000 7f33be800640 1 --2- 172.21.15.112:0/1058513564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33b80d57c0 0x7f33b80d1b60 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.749+0000 7f33be800640 1 --2- 172.21.15.112:0/1058513564 >> v2:172.21.15.137:3300/0 conn(0x7f33b81624a0 0x7f33b80d1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.749+0000 7f33be800640 1 -- 172.21.15.112:0/1058513564 >> 172.21.15.112:0/1058513564 conn(0x7f33b80d4ca0 msgr2=0x7f33b80d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:46.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.750+0000 7f33be800640 1 -- 172.21.15.112:0/1058513564 shutdown_connections 2024-09-12T02:53:46.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.750+0000 7f33be800640 1 -- 172.21.15.112:0/1058513564 wait complete. 2024-09-12T02:53:46.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.751+0000 7f33be800640 1 Processor -- start 2024-09-12T02:53:46.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.751+0000 7f33be800640 1 -- start start 2024-09-12T02:53:46.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.752+0000 7f33be800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33b80b4c50 0x7f33b8151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:46.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.752+0000 7f33be800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33b80d57c0 0x7f33b80ba670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:46.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.752+0000 7f33be800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33b81624a0 0x7f33b80b8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:46.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.752+0000 7f33be800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f33b80d3d70 con 0x7f33b80d57c0 2024-09-12T02:53:46.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.752+0000 7f33be800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f33b80d3a90 con 0x7f33b81624a0 2024-09-12T02:53:46.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.752+0000 7f33be800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f33b8162880 con 0x7f33b80b4c50 2024-09-12T02:53:46.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.752+0000 7f33bca00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33b80d57c0 0x7f33b80ba670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:46.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.752+0000 7f33bca00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33b80d57c0 0x7f33b80ba670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44566/0 (socket says 172.21.15.112:44566) 2024-09-12T02:53:46.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.752+0000 7f33bca00640 1 -- 172.21.15.112:0/3905043554 learned_addr learned my addr 172.21.15.112:0/3905043554 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:46.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.753+0000 7f33bd400640 1 --2- 172.21.15.112:0/3905043554 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33b80b4c50 0x7f33b8151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:46.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.753+0000 7f33bde00640 1 --2- 172.21.15.112:0/3905043554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33b81624a0 0x7f33b80b8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:46.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.753+0000 7f33bca00640 1 -- 172.21.15.112:0/3905043554 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33b80b4c50 msgr2=0x7f33b8151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:46.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.753+0000 7f33bca00640 1 --2- 172.21.15.112:0/3905043554 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f33b80b4c50 0x7f33b8151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.753+0000 7f33bca00640 1 -- 172.21.15.112:0/3905043554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33b81624a0 msgr2=0x7f33b80b8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:46.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.753+0000 7f33bca00640 1 --2- 172.21.15.112:0/3905043554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33b81624a0 0x7f33b80b8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.753+0000 7f33bca00640 1 -- 172.21.15.112:0/3905043554 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b80b9470 con 0x7f33b80d57c0 2024-09-12T02:53:46.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.753+0000 7f33bca00640 1 --2- 172.21.15.112:0/3905043554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33b80d57c0 0x7f33b80ba670 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f33a4009890 tx=0x7f33a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:46.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.753+0000 7f33b5600640 1 -- 172.21.15.112:0/3905043554 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a4037040 con 0x7f33b80d57c0 2024-09-12T02:53:46.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.753+0000 7f33b5600640 1 -- 172.21.15.112:0/3905043554 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a4042070 con 0x7f33b80d57c0 2024-09-12T02:53:46.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.753+0000 7f33be800640 1 -- 172.21.15.112:0/3905043554 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33b80c98f0 con 0x7f33b80d57c0 2024-09-12T02:53:46.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.753+0000 7f33b5600640 1 -- 172.21.15.112:0/3905043554 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a4030bd0 con 0x7f33b80d57c0 2024-09-12T02:53:46.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.754+0000 7f33be800640 1 -- 172.21.15.112:0/3905043554 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33b80b8730 con 0x7f33b80d57c0 2024-09-12T02:53:46.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.754+0000 7f33be800640 1 -- 172.21.15.112:0/3905043554 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f33b80d1620 con 0x7f33b80d57c0 2024-09-12T02:53:46.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.755+0000 7f33b5600640 1 -- 172.21.15.112:0/3905043554 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f33a4047460 con 0x7f33b80d57c0 2024-09-12T02:53:46.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.756+0000 7f33b5600640 1 --2- 172.21.15.112:0/3905043554 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f339806be30 0x7f339806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:46.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.756+0000 7f33b5600640 1 -- 172.21.15.112:0/3905043554 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 4943+0+0 (secure 0 0 0) 0x7f33a40ab760 con 0x7f33b80d57c0 2024-09-12T02:53:46.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.756+0000 7f33bd400640 1 --2- 172.21.15.112:0/3905043554 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f339806be30 0x7f339806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:46.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.757+0000 7f33b5600640 1 --2- 172.21.15.112:0/3905043554 >> [v2:172.21.15.137:6808/3193706134,v1:172.21.15.137:6809/3193706134] conn(0x7f3398071cf0 0x7f3398074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:46.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.757+0000 7f33b5600640 1 -- 172.21.15.112:0/3905043554 --> [v2:172.21.15.137:6808/3193706134,v1:172.21.15.137:6809/3193706134] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f33a4008eb0 con 0x7f3398071cf0 2024-09-12T02:53:46.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.757+0000 7f33b5600640 1 -- 172.21.15.112:0/3905043554 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=190) ==== 24+0+0 (secure 0 0 0) 0x7f33a40b2050 con 0x7f33b80d57c0 2024-09-12T02:53:46.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.757+0000 7f33bde00640 1 --2- 172.21.15.112:0/3905043554 >> [v2:172.21.15.137:6808/3193706134,v1:172.21.15.137:6809/3193706134] conn(0x7f3398071cf0 0x7f3398074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:46.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.757+0000 7f33bd400640 1 --2- 172.21.15.112:0/3905043554 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f339806be30 0x7f339806e2f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f33ac006fd0 tx=0x7f33ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:46.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.757+0000 7f33bde00640 1 --2- 172.21.15.112:0/3905043554 >> [v2:172.21.15.137:6808/3193706134,v1:172.21.15.137:6809/3193706134] conn(0x7f3398071cf0 0x7f3398074110 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:46.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.758+0000 7f33b5600640 1 -- 172.21.15.112:0/3905043554 <== osd.5 v2:172.21.15.137:6808/3193706134 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f33a4008eb0 con 0x7f3398071cf0 2024-09-12T02:53:46.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.770+0000 7f33be800640 1 -- 172.21.15.112:0/3905043554 --> [v2:172.21.15.137:6808/3193706134,v1:172.21.15.137:6809/3193706134] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f33b80d08a0 con 0x7f3398071cf0 2024-09-12T02:53:46.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.771+0000 7f33b5600640 1 -- 172.21.15.112:0/3905043554 <== osd.5 v2:172.21.15.137:6808/3193706134 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7f33b80d08a0 con 0x7f3398071cf0 2024-09-12T02:53:46.772 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:53:46.772 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-12T02:53:46.772 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:53:46.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.771+0000 7f33be800640 1 -- 172.21.15.112:0/3905043554 >> [v2:172.21.15.137:6808/3193706134,v1:172.21.15.137:6809/3193706134] conn(0x7f3398071cf0 msgr2=0x7f3398074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:46.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.771+0000 7f33be800640 1 --2- 172.21.15.112:0/3905043554 >> [v2:172.21.15.137:6808/3193706134,v1:172.21.15.137:6809/3193706134] conn(0x7f3398071cf0 0x7f3398074110 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.771+0000 7f33be800640 1 -- 172.21.15.112:0/3905043554 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f339806be30 msgr2=0x7f339806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:46.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.771+0000 7f33be800640 1 --2- 172.21.15.112:0/3905043554 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f339806be30 0x7f339806e2f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f33ac006fd0 tx=0x7f33ac008040 comp rx=0 tx=0).stop 2024-09-12T02:53:46.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.771+0000 7f33be800640 1 -- 172.21.15.112:0/3905043554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33b80d57c0 msgr2=0x7f33b80ba670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:46.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.771+0000 7f33be800640 1 --2- 172.21.15.112:0/3905043554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33b80d57c0 0x7f33b80ba670 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f33a4009890 tx=0x7f33a40046c0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.771+0000 7f33bde00640 1 -- 172.21.15.112:0/3905043554 reap_dead start 2024-09-12T02:53:46.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.771+0000 7f33be800640 1 -- 172.21.15.112:0/3905043554 shutdown_connections 2024-09-12T02:53:46.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.771+0000 7f33be800640 1 -- 172.21.15.112:0/3905043554 >> 172.21.15.112:0/3905043554 conn(0x7f33b80d4ca0 msgr2=0x7f33b80d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:46.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.771+0000 7f33be800640 1 -- 172.21.15.112:0/3905043554 shutdown_connections 2024-09-12T02:53:46.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.771+0000 7f33be800640 1 -- 172.21.15.112:0/3905043554 wait complete. 2024-09-12T02:53:46.786 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T02:53:46.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.940+0000 7f7914000640 1 Processor -- start 2024-09-12T02:53:46.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.940+0000 7f7914000640 1 -- start start 2024-09-12T02:53:46.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.941+0000 7f7914000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f790c15b9d0 0x7f790c0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:46.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.941+0000 7f7914000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f790c0b45d0 0x7f790c0728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:46.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.941+0000 7f7914000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f790c06eef0 0x7f790c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:46.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.941+0000 7f7914000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f790c0b4a60 con 0x7f790c0b45d0 2024-09-12T02:53:46.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.941+0000 7f7914000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f790c06f860 con 0x7f790c15b9d0 2024-09-12T02:53:46.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.941+0000 7f7914000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f790c0b54a0 con 0x7f790c06eef0 2024-09-12T02:53:46.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.941+0000 7f7910c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f790c0b45d0 0x7f790c0728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:46.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.941+0000 7f7910c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f790c0b45d0 0x7f790c0728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44582/0 (socket says 172.21.15.112:44582) 2024-09-12T02:53:46.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.941+0000 7f7910c00640 1 -- 172.21.15.112:0/1030022067 learned_addr learned my addr 172.21.15.112:0/1030022067 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:46.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.942+0000 7f7911600640 1 --2- 172.21.15.112:0/1030022067 >> v2:172.21.15.137:3300/0 conn(0x7f790c15b9d0 0x7f790c0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:46.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.942+0000 7f7912000640 1 --2- 172.21.15.112:0/1030022067 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f790c06eef0 0x7f790c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:46.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.942+0000 7f7910c00640 1 -- 172.21.15.112:0/1030022067 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f790c06eef0 msgr2=0x7f790c06f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:46.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.942+0000 7f7910c00640 1 --2- 172.21.15.112:0/1030022067 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f790c06eef0 0x7f790c06f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.942+0000 7f7910c00640 1 -- 172.21.15.112:0/1030022067 >> v2:172.21.15.137:3300/0 conn(0x7f790c15b9d0 msgr2=0x7f790c0b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:46.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.942+0000 7f7910c00640 1 --2- 172.21.15.112:0/1030022067 >> v2:172.21.15.137:3300/0 conn(0x7f790c15b9d0 0x7f790c0b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.942+0000 7f7910c00640 1 -- 172.21.15.112:0/1030022067 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790c0b3af0 con 0x7f790c0b45d0 2024-09-12T02:53:46.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.942+0000 7f7912000640 1 --2- 172.21.15.112:0/1030022067 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f790c06eef0 0x7f790c06f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:53:46.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.943+0000 7f7910c00640 1 --2- 172.21.15.112:0/1030022067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f790c0b45d0 0x7f790c0728c0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f790c06d230 tx=0x7f78f802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59c88987125938b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:46.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.943+0000 7f790be00640 1 -- 172.21.15.112:0/1030022067 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f8004030 con 0x7f790c0b45d0 2024-09-12T02:53:46.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.943+0000 7f790be00640 1 -- 172.21.15.112:0/1030022067 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f80041d0 con 0x7f790c0b45d0 2024-09-12T02:53:46.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.943+0000 7f790be00640 1 -- 172.21.15.112:0/1030022067 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f8003610 con 0x7f790c0b45d0 2024-09-12T02:53:46.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.944+0000 7f7914000640 1 -- 172.21.15.112:0/1030022067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f790c0b45d0 msgr2=0x7f790c0728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:46.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.944+0000 7f7914000640 1 --2- 172.21.15.112:0/1030022067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f790c0b45d0 0x7f790c0728c0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f790c06d230 tx=0x7f78f802a1e0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.944+0000 7f7914000640 1 -- 172.21.15.112:0/1030022067 shutdown_connections 2024-09-12T02:53:46.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.944+0000 7f7914000640 1 --2- 172.21.15.112:0/1030022067 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f790c06eef0 0x7f790c06f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.944+0000 7f7914000640 1 --2- 172.21.15.112:0/1030022067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f790c0b45d0 0x7f790c0728c0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.944+0000 7f7914000640 1 --2- 172.21.15.112:0/1030022067 >> v2:172.21.15.137:3300/0 conn(0x7f790c15b9d0 0x7f790c0b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.944+0000 7f7914000640 1 -- 172.21.15.112:0/1030022067 >> 172.21.15.112:0/1030022067 conn(0x7f790c06bbd0 msgr2=0x7f790c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:46.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.944+0000 7f7914000640 1 -- 172.21.15.112:0/1030022067 shutdown_connections 2024-09-12T02:53:46.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.944+0000 7f7914000640 1 -- 172.21.15.112:0/1030022067 wait complete. 2024-09-12T02:53:46.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.945+0000 7f7914000640 1 Processor -- start 2024-09-12T02:53:46.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.945+0000 7f7914000640 1 -- start start 2024-09-12T02:53:46.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.946+0000 7f7914000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f790c06eef0 0x7f790c15e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:46.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.946+0000 7f7914000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f790c0b45d0 0x7f790c152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:46.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.946+0000 7f7914000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f790c15b9d0 0x7f790c14f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:46.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.946+0000 7f7914000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f790c15bdb0 con 0x7f790c06eef0 2024-09-12T02:53:46.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.946+0000 7f7914000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f790c0b40b0 con 0x7f790c15b9d0 2024-09-12T02:53:46.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.946+0000 7f7914000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f790c15bf30 con 0x7f790c0b45d0 2024-09-12T02:53:46.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.947+0000 7f7911600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f790c06eef0 0x7f790c15e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:46.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.947+0000 7f7911600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f790c06eef0 0x7f790c15e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44596/0 (socket says 172.21.15.112:44596) 2024-09-12T02:53:46.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.947+0000 7f7911600640 1 -- 172.21.15.112:0/3636404646 learned_addr learned my addr 172.21.15.112:0/3636404646 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:46.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.947+0000 7f7912000640 1 --2- 172.21.15.112:0/3636404646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f790c15b9d0 0x7f790c14f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:46.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.947+0000 7f7910c00640 1 --2- 172.21.15.112:0/3636404646 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f790c0b45d0 0x7f790c152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:46.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.947+0000 7f7911600640 1 -- 172.21.15.112:0/3636404646 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f790c0b45d0 msgr2=0x7f790c152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:46.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.947+0000 7f7911600640 1 --2- 172.21.15.112:0/3636404646 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f790c0b45d0 0x7f790c152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.947+0000 7f7911600640 1 -- 172.21.15.112:0/3636404646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f790c15b9d0 msgr2=0x7f790c14f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:46.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.947+0000 7f7911600640 1 --2- 172.21.15.112:0/3636404646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f790c15b9d0 0x7f790c14f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:46.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.947+0000 7f7911600640 1 -- 172.21.15.112:0/3636404646 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790c152650 con 0x7f790c06eef0 2024-09-12T02:53:46.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.947+0000 7f7911600640 1 --2- 172.21.15.112:0/3636404646 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f790c06eef0 0x7f790c15e690 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f790000e870 tx=0x7f790000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:46.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.947+0000 7f7909600640 1 -- 172.21.15.112:0/3636404646 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7900017070 con 0x7f790c06eef0 2024-09-12T02:53:46.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.948+0000 7f7909600640 1 -- 172.21.15.112:0/3636404646 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f790000c940 con 0x7f790c06eef0 2024-09-12T02:53:46.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.948+0000 7f7914000640 1 -- 172.21.15.112:0/3636404646 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f790c15ec70 con 0x7f790c06eef0 2024-09-12T02:53:46.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.948+0000 7f7909600640 1 -- 172.21.15.112:0/3636404646 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790000cd30 con 0x7f790c06eef0 2024-09-12T02:53:46.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.948+0000 7f7914000640 1 -- 172.21.15.112:0/3636404646 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f790c15f230 con 0x7f790c06eef0 2024-09-12T02:53:46.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.949+0000 7f7914000640 1 -- 172.21.15.112:0/3636404646 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f790c1503d0 con 0x7f790c06eef0 2024-09-12T02:53:46.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.950+0000 7f7909600640 1 -- 172.21.15.112:0/3636404646 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f790001a070 con 0x7f790c06eef0 2024-09-12T02:53:46.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.950+0000 7f7909600640 1 --2- 172.21.15.112:0/3636404646 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f78ec06be30 0x7f78ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:46.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.950+0000 7f7909600640 1 -- 172.21.15.112:0/3636404646 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 4943+0+0 (secure 0 0 0) 0x7f790008a9a0 con 0x7f790c06eef0 2024-09-12T02:53:46.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.951+0000 7f7910c00640 1 --2- 172.21.15.112:0/3636404646 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f78ec06be30 0x7f78ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:46.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.951+0000 7f7910c00640 1 --2- 172.21.15.112:0/3636404646 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f78ec06be30 0x7f78ec06e2f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f78f8033000 tx=0x7f78f802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:46.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:46.955+0000 7f7909600640 1 -- 172.21.15.112:0/3636404646 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f790c152650 con 0x7f790c06eef0 2024-09-12T02:53:47.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.131+0000 7f7914000640 1 -- 172.21.15.112:0/3636404646 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f790c06dbc0 con 0x7f78ec06be30 2024-09-12T02:53:47.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.132+0000 7f7909600640 1 -- 172.21.15.112:0/3636404646 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f790c06dbc0 con 0x7f78ec06be30 2024-09-12T02:53:47.133 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T02:53:47.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.134+0000 7f7914000640 1 -- 172.21.15.112:0/3636404646 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f78ec06be30 msgr2=0x7f78ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:47.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.134+0000 7f7914000640 1 --2- 172.21.15.112:0/3636404646 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f78ec06be30 0x7f78ec06e2f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f78f8033000 tx=0x7f78f802e000 comp rx=0 tx=0).stop 2024-09-12T02:53:47.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.134+0000 7f7914000640 1 -- 172.21.15.112:0/3636404646 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f790c06eef0 msgr2=0x7f790c15e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:47.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.134+0000 7f7914000640 1 --2- 172.21.15.112:0/3636404646 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f790c06eef0 0x7f790c15e690 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f790000e870 tx=0x7f790000ed30 comp rx=0 tx=0).stop 2024-09-12T02:53:47.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.134+0000 7f7914000640 1 -- 172.21.15.112:0/3636404646 shutdown_connections 2024-09-12T02:53:47.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.134+0000 7f7914000640 1 --2- 172.21.15.112:0/3636404646 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f78ec06be30 0x7f78ec06e2f0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.134+0000 7f7914000640 1 --2- 172.21.15.112:0/3636404646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f790c15b9d0 0x7f790c14f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.134+0000 7f7914000640 1 --2- 172.21.15.112:0/3636404646 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f790c0b45d0 0x7f790c152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.134+0000 7f7914000640 1 --2- 172.21.15.112:0/3636404646 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f790c06eef0 0x7f790c15e690 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.134+0000 7f7914000640 1 -- 172.21.15.112:0/3636404646 >> 172.21.15.112:0/3636404646 conn(0x7f790c06bbd0 msgr2=0x7f790c0ce5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:47.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.134+0000 7f7914000640 1 -- 172.21.15.112:0/3636404646 shutdown_connections 2024-09-12T02:53:47.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.134+0000 7f7914000640 1 -- 172.21.15.112:0/3636404646 wait complete. 2024-09-12T02:53:47.152 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T02:53:47.152 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:53:47.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.308+0000 7fea3e600640 1 Processor -- start 2024-09-12T02:53:47.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.308+0000 7fea3e600640 1 -- start start 2024-09-12T02:53:47.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.309+0000 7fea3e600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fea38158fb0 0x7fea3815c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.309+0000 7fea3e600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fea380d1270 0x7fea380723d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.309+0000 7fea3e600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fea38072910 0x7fea3806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.309+0000 7fea3e600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fea38071f40 con 0x7fea38158fb0 2024-09-12T02:53:47.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.309+0000 7fea3e600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fea3815c710 con 0x7fea380d1270 2024-09-12T02:53:47.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.309+0000 7fea3e600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fea38071630 con 0x7fea38072910 2024-09-12T02:53:47.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.309+0000 7fea37400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fea38158fb0 0x7fea3815c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:47.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.309+0000 7fea37400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fea38158fb0 0x7fea3815c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44608/0 (socket says 172.21.15.112:44608) 2024-09-12T02:53:47.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.309+0000 7fea37400640 1 -- 172.21.15.112:0/3450582813 learned_addr learned my addr 172.21.15.112:0/3450582813 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:47.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.310+0000 7fea37e00640 1 --2- 172.21.15.112:0/3450582813 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fea38072910 0x7fea3806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:47.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.310+0000 7fea36a00640 1 --2- 172.21.15.112:0/3450582813 >> v2:172.21.15.137:3300/0 conn(0x7fea380d1270 0x7fea380723d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:47.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.310+0000 7fea37400640 1 -- 172.21.15.112:0/3450582813 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fea38072910 msgr2=0x7fea3806d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:47.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.310+0000 7fea37400640 1 --2- 172.21.15.112:0/3450582813 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fea38072910 0x7fea3806d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.310+0000 7fea37400640 1 -- 172.21.15.112:0/3450582813 >> v2:172.21.15.137:3300/0 conn(0x7fea380d1270 msgr2=0x7fea380723d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:47.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.310+0000 7fea37400640 1 --2- 172.21.15.112:0/3450582813 >> v2:172.21.15.137:3300/0 conn(0x7fea380d1270 0x7fea380723d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.310+0000 7fea37400640 1 -- 172.21.15.112:0/3450582813 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea380d1810 con 0x7fea38158fb0 2024-09-12T02:53:47.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.311+0000 7fea37400640 1 --2- 172.21.15.112:0/3450582813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea38158fb0 0x7fea3815c1d0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fea380b47c0 tx=0x7fea2802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c263d4634807e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:47.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.311+0000 7fea36000640 1 -- 172.21.15.112:0/3450582813 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea28037070 con 0x7fea38158fb0 2024-09-12T02:53:47.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.311+0000 7fea36000640 1 -- 172.21.15.112:0/3450582813 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea28032440 con 0x7fea38158fb0 2024-09-12T02:53:47.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.311+0000 7fea36000640 1 -- 172.21.15.112:0/3450582813 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea28032810 con 0x7fea38158fb0 2024-09-12T02:53:47.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.312+0000 7fea3e600640 1 -- 172.21.15.112:0/3450582813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea38158fb0 msgr2=0x7fea3815c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:47.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.312+0000 7fea3e600640 1 --2- 172.21.15.112:0/3450582813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea38158fb0 0x7fea3815c1d0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fea380b47c0 tx=0x7fea2802a140 comp rx=0 tx=0).stop 2024-09-12T02:53:47.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.312+0000 7fea3e600640 1 -- 172.21.15.112:0/3450582813 shutdown_connections 2024-09-12T02:53:47.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.312+0000 7fea3e600640 1 --2- 172.21.15.112:0/3450582813 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fea38072910 0x7fea3806d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.312+0000 7fea3e600640 1 --2- 172.21.15.112:0/3450582813 >> v2:172.21.15.137:3300/0 conn(0x7fea380d1270 0x7fea380723d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.312+0000 7fea3e600640 1 --2- 172.21.15.112:0/3450582813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea38158fb0 0x7fea3815c1d0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.312+0000 7fea3e600640 1 -- 172.21.15.112:0/3450582813 >> 172.21.15.112:0/3450582813 conn(0x7fea380b2730 msgr2=0x7fea380b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:47.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.312+0000 7fea3e600640 1 -- 172.21.15.112:0/3450582813 shutdown_connections 2024-09-12T02:53:47.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.312+0000 7fea3e600640 1 -- 172.21.15.112:0/3450582813 wait complete. 2024-09-12T02:53:47.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.313+0000 7fea3e600640 1 Processor -- start 2024-09-12T02:53:47.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.313+0000 7fea3e600640 1 -- start start 2024-09-12T02:53:47.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.314+0000 7fea3e600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea38072910 0x7fea381593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.314+0000 7fea3e600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fea380d1270 0x7fea3815b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.314+0000 7fea3e600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea380afaa0 0x7fea381442b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.314+0000 7fea3e600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fea3806d8f0 con 0x7fea380afaa0 2024-09-12T02:53:47.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.314+0000 7fea3e600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fea38071bd0 con 0x7fea38072910 2024-09-12T02:53:47.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.314+0000 7fea3e600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fea3806da70 con 0x7fea380d1270 2024-09-12T02:53:47.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.315+0000 7fea37e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea380afaa0 0x7fea381442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:47.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.315+0000 7fea37e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea380afaa0 0x7fea381442b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44618/0 (socket says 172.21.15.112:44618) 2024-09-12T02:53:47.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.315+0000 7fea37e00640 1 -- 172.21.15.112:0/4103182236 learned_addr learned my addr 172.21.15.112:0/4103182236 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:47.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.315+0000 7fea36a00640 1 --2- 172.21.15.112:0/4103182236 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fea380d1270 0x7fea3815b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:47.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.315+0000 7fea37400640 1 --2- 172.21.15.112:0/4103182236 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea38072910 0x7fea381593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:47.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.315+0000 7fea37e00640 1 -- 172.21.15.112:0/4103182236 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fea380d1270 msgr2=0x7fea3815b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:47.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.315+0000 7fea37e00640 1 --2- 172.21.15.112:0/4103182236 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fea380d1270 0x7fea3815b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.315+0000 7fea37e00640 1 -- 172.21.15.112:0/4103182236 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea38072910 msgr2=0x7fea381593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:47.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.315+0000 7fea37e00640 1 --2- 172.21.15.112:0/4103182236 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea38072910 0x7fea381593a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.315+0000 7fea37e00640 1 -- 172.21.15.112:0/4103182236 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea381598e0 con 0x7fea380afaa0 2024-09-12T02:53:47.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.315+0000 7fea36a00640 1 --2- 172.21.15.112:0/4103182236 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fea380d1270 0x7fea3815b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:53:47.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.315+0000 7fea37400640 1 --2- 172.21.15.112:0/4103182236 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea38072910 0x7fea381593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:53:47.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.315+0000 7fea37e00640 1 --2- 172.21.15.112:0/4103182236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea380afaa0 0x7fea381442b0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fea30007e10 tx=0x7fea3000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:47.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.316+0000 7fea2f400640 1 -- 172.21.15.112:0/4103182236 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea30014420 con 0x7fea380afaa0 2024-09-12T02:53:47.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.316+0000 7fea2f400640 1 -- 172.21.15.112:0/4103182236 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea30019070 con 0x7fea380afaa0 2024-09-12T02:53:47.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.316+0000 7fea3e600640 1 -- 172.21.15.112:0/4103182236 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea380b02d0 con 0x7fea380afaa0 2024-09-12T02:53:47.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.316+0000 7fea2f400640 1 -- 172.21.15.112:0/4103182236 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea30014820 con 0x7fea380afaa0 2024-09-12T02:53:47.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.316+0000 7fea3e600640 1 -- 172.21.15.112:0/4103182236 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea380afff0 con 0x7fea380afaa0 2024-09-12T02:53:47.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.317+0000 7fea3e600640 1 -- 172.21.15.112:0/4103182236 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fea380723d0 con 0x7fea380afaa0 2024-09-12T02:53:47.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.318+0000 7fea2f400640 1 -- 172.21.15.112:0/4103182236 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fea300149c0 con 0x7fea380afaa0 2024-09-12T02:53:47.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.319+0000 7fea2f400640 1 --2- 172.21.15.112:0/4103182236 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fea1806be30 0x7fea1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.319+0000 7fea2f400640 1 -- 172.21.15.112:0/4103182236 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 4943+0+0 (secure 0 0 0) 0x7fea3008b400 con 0x7fea380afaa0 2024-09-12T02:53:47.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.319+0000 7fea37400640 1 --2- 172.21.15.112:0/4103182236 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fea1806be30 0x7fea1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:47.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.319+0000 7fea2f400640 1 --2- 172.21.15.112:0/4103182236 >> [v2:172.21.15.137:6813/3738813293,v1:172.21.15.137:6814/3738813293] conn(0x7fea18071cf0 0x7fea18074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.319+0000 7fea2f400640 1 -- 172.21.15.112:0/4103182236 --> [v2:172.21.15.137:6813/3738813293,v1:172.21.15.137:6814/3738813293] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fea30014e50 con 0x7fea18071cf0 2024-09-12T02:53:47.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.319+0000 7fea2f400640 1 -- 172.21.15.112:0/4103182236 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=190) ==== 24+0+0 (secure 0 0 0) 0x7fea30092050 con 0x7fea380afaa0 2024-09-12T02:53:47.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.319+0000 7fea36a00640 1 --2- 172.21.15.112:0/4103182236 >> [v2:172.21.15.137:6813/3738813293,v1:172.21.15.137:6814/3738813293] conn(0x7fea18071cf0 0x7fea18074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:47.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.319+0000 7fea37400640 1 --2- 172.21.15.112:0/4103182236 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fea1806be30 0x7fea1806e2f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fea28034000 tx=0x7fea2802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:47.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.320+0000 7fea36a00640 1 --2- 172.21.15.112:0/4103182236 >> [v2:172.21.15.137:6813/3738813293,v1:172.21.15.137:6814/3738813293] conn(0x7fea18071cf0 0x7fea18074110 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:47.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.321+0000 7fea2f400640 1 -- 172.21.15.112:0/4103182236 <== osd.6 v2:172.21.15.137:6813/3738813293 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7fea30014e50 con 0x7fea18071cf0 2024-09-12T02:53:47.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.332+0000 7fea3e600640 1 -- 172.21.15.112:0/4103182236 --> [v2:172.21.15.137:6813/3738813293,v1:172.21.15.137:6814/3738813293] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fea380cca10 con 0x7fea18071cf0 2024-09-12T02:53:47.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.333+0000 7fea2f400640 1 -- 172.21.15.112:0/4103182236 <== osd.6 v2:172.21.15.137:6813/3738813293 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7fea380cca10 con 0x7fea18071cf0 2024-09-12T02:53:47.334 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:53:47.334 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-12T02:53:47.334 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:53:47.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.333+0000 7fea3e600640 1 -- 172.21.15.112:0/4103182236 >> [v2:172.21.15.137:6813/3738813293,v1:172.21.15.137:6814/3738813293] conn(0x7fea18071cf0 msgr2=0x7fea18074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:47.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.333+0000 7fea3e600640 1 --2- 172.21.15.112:0/4103182236 >> [v2:172.21.15.137:6813/3738813293,v1:172.21.15.137:6814/3738813293] conn(0x7fea18071cf0 0x7fea18074110 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.333+0000 7fea3e600640 1 -- 172.21.15.112:0/4103182236 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fea1806be30 msgr2=0x7fea1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:47.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.333+0000 7fea3e600640 1 --2- 172.21.15.112:0/4103182236 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fea1806be30 0x7fea1806e2f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fea28034000 tx=0x7fea2802e000 comp rx=0 tx=0).stop 2024-09-12T02:53:47.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.333+0000 7fea3e600640 1 -- 172.21.15.112:0/4103182236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea380afaa0 msgr2=0x7fea381442b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:47.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.333+0000 7fea3e600640 1 --2- 172.21.15.112:0/4103182236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea380afaa0 0x7fea381442b0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fea30007e10 tx=0x7fea3000e4b0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.333+0000 7fea37e00640 1 -- 172.21.15.112:0/4103182236 reap_dead start 2024-09-12T02:53:47.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.334+0000 7fea3e600640 1 -- 172.21.15.112:0/4103182236 shutdown_connections 2024-09-12T02:53:47.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.334+0000 7fea3e600640 1 -- 172.21.15.112:0/4103182236 >> 172.21.15.112:0/4103182236 conn(0x7fea380b2730 msgr2=0x7fea3815bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:47.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.334+0000 7fea3e600640 1 -- 172.21.15.112:0/4103182236 shutdown_connections 2024-09-12T02:53:47.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.334+0000 7fea3e600640 1 -- 172.21.15.112:0/4103182236 wait complete. 2024-09-12T02:53:47.349 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T02:53:47.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.503+0000 7f4a78a00640 1 Processor -- start 2024-09-12T02:53:47.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.503+0000 7f4a78a00640 1 -- start start 2024-09-12T02:53:47.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.504+0000 7f4a78a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a7415b9d0 0x7f4a740b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.504+0000 7f4a78a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4a7406f600 0x7f4a740728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.504+0000 7f4a78a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a740b54a0 con 0x7f4a740b45d0 2024-09-12T02:53:47.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.504+0000 7f4a78a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4a740b4a30 con 0x7f4a7406f600 2024-09-12T02:53:47.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.504+0000 7f4a78a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4a740b3af0 con 0x7f4a7415b9d0 2024-09-12T02:53:47.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.505+0000 7f4a72800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4a7406f600 0x7f4a740728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:47.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.505+0000 7f4a72800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4a7406f600 0x7f4a740728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44622/0 (socket says 172.21.15.112:44622) 2024-09-12T02:53:47.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.505+0000 7f4a72800640 1 -- 172.21.15.112:0/1733484213 learned_addr learned my addr 172.21.15.112:0/1733484213 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:47.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.505+0000 7f4a71e00640 1 --2- 172.21.15.112:0/1733484213 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a7415b9d0 0x7f4a740b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:47.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.505+0000 7f4a72800640 1 -- 172.21.15.112:0/1733484213 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a7415b9d0 msgr2=0x7f4a740b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:47.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.505+0000 7f4a72800640 1 --2- 172.21.15.112:0/1733484213 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a7415b9d0 0x7f4a740b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.505+0000 7f4a72800640 1 -- 172.21.15.112:0/1733484213 >> v1:172.21.15.137:6789/0 conn(0x7f4a740b45d0 legacy=0x7f4a7406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:47.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.505+0000 7f4a72800640 1 -- 172.21.15.112:0/1733484213 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a740b3dd0 con 0x7f4a7406f600 2024-09-12T02:53:47.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.506+0000 7f4a72800640 1 --2- 172.21.15.112:0/1733484213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a7406f600 0x7f4a740728c0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c009e50 tx=0x7f4a6c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9026bc85fdad7024 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:47.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.506+0000 7f4a70a00640 1 -- 172.21.15.112:0/1733484213 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c036070 con 0x7f4a7406f600 2024-09-12T02:53:47.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.506+0000 7f4a70a00640 1 -- 172.21.15.112:0/1733484213 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a6c031600 con 0x7f4a7406f600 2024-09-12T02:53:47.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.506+0000 7f4a70a00640 1 -- 172.21.15.112:0/1733484213 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c0319d0 con 0x7f4a7406f600 2024-09-12T02:53:47.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.507+0000 7f4a78a00640 1 -- 172.21.15.112:0/1733484213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a7406f600 msgr2=0x7f4a740728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:47.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.507+0000 7f4a78a00640 1 --2- 172.21.15.112:0/1733484213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a7406f600 0x7f4a740728c0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c009e50 tx=0x7f4a6c02a710 comp rx=0 tx=0).stop 2024-09-12T02:53:47.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.507+0000 7f4a78a00640 1 -- 172.21.15.112:0/1733484213 shutdown_connections 2024-09-12T02:53:47.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.507+0000 7f4a78a00640 1 --2- 172.21.15.112:0/1733484213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a7406f600 0x7f4a740728c0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.507+0000 7f4a78a00640 1 --2- 172.21.15.112:0/1733484213 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a7415b9d0 0x7f4a740b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.507+0000 7f4a78a00640 1 -- 172.21.15.112:0/1733484213 >> 172.21.15.112:0/1733484213 conn(0x7f4a7406bbd0 msgr2=0x7f4a7406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:47.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.507+0000 7f4a78a00640 1 -- 172.21.15.112:0/1733484213 shutdown_connections 2024-09-12T02:53:47.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.507+0000 7f4a78a00640 1 -- 172.21.15.112:0/1733484213 wait complete. 2024-09-12T02:53:47.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.508+0000 7f4a78a00640 1 Processor -- start 2024-09-12T02:53:47.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.509+0000 7f4a78a00640 1 -- start start 2024-09-12T02:53:47.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.509+0000 7f4a78a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a7406f600 0x7f4a741f9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.509+0000 7f4a78a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a740b45d0 0x7f4a74151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.510+0000 7f4a78a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a7415b9d0 0x7f4a740b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.510+0000 7f4a78a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7415bf30 con 0x7f4a740b45d0 2024-09-12T02:53:47.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.510+0000 7f4a78a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7415bdb0 con 0x7f4a7415b9d0 2024-09-12T02:53:47.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.510+0000 7f4a78a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4a740cdcd0 con 0x7f4a7406f600 2024-09-12T02:53:47.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.510+0000 7f4a71400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a740b45d0 0x7f4a74151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:47.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.510+0000 7f4a71400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a740b45d0 0x7f4a74151390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44632/0 (socket says 172.21.15.112:44632) 2024-09-12T02:53:47.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.510+0000 7f4a71400640 1 -- 172.21.15.112:0/1514822287 learned_addr learned my addr 172.21.15.112:0/1514822287 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:47.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.510+0000 7f4a71e00640 1 --2- 172.21.15.112:0/1514822287 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a7406f600 0x7f4a741f9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:47.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.510+0000 7f4a72800640 1 --2- 172.21.15.112:0/1514822287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a7415b9d0 0x7f4a740b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:47.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.510+0000 7f4a71400640 1 -- 172.21.15.112:0/1514822287 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a7406f600 msgr2=0x7f4a741f9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:47.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.510+0000 7f4a71400640 1 --2- 172.21.15.112:0/1514822287 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a7406f600 0x7f4a741f9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.510+0000 7f4a71400640 1 -- 172.21.15.112:0/1514822287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a7415b9d0 msgr2=0x7f4a740b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:47.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.510+0000 7f4a71400640 1 --2- 172.21.15.112:0/1514822287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a7415b9d0 0x7f4a740b0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.510+0000 7f4a71400640 1 -- 172.21.15.112:0/1514822287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a74151fa0 con 0x7f4a740b45d0 2024-09-12T02:53:47.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.511+0000 7f4a71400640 1 --2- 172.21.15.112:0/1514822287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a740b45d0 0x7f4a74151390 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f4a6000c400 tx=0x7f4a6000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:47.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.511+0000 7f4a6a000640 1 -- 172.21.15.112:0/1514822287 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a600052d0 con 0x7f4a740b45d0 2024-09-12T02:53:47.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.511+0000 7f4a6a000640 1 -- 172.21.15.112:0/1514822287 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a600054b0 con 0x7f4a740b45d0 2024-09-12T02:53:47.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.511+0000 7f4a6a000640 1 -- 172.21.15.112:0/1514822287 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a60006a60 con 0x7f4a740b45d0 2024-09-12T02:53:47.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.511+0000 7f4a78a00640 1 -- 172.21.15.112:0/1514822287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a74152280 con 0x7f4a740b45d0 2024-09-12T02:53:47.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.511+0000 7f4a78a00640 1 -- 172.21.15.112:0/1514822287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a74152840 con 0x7f4a740b45d0 2024-09-12T02:53:47.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.512+0000 7f4a78a00640 1 -- 172.21.15.112:0/1514822287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a74068a30 con 0x7f4a740b45d0 2024-09-12T02:53:47.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.513+0000 7f4a6a000640 1 -- 172.21.15.112:0/1514822287 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4a60006c00 con 0x7f4a740b45d0 2024-09-12T02:53:47.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.514+0000 7f4a6a000640 1 --2- 172.21.15.112:0/1514822287 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4a5406be30 0x7f4a5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.514+0000 7f4a6a000640 1 -- 172.21.15.112:0/1514822287 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 4943+0+0 (secure 0 0 0) 0x7f4a60089fa0 con 0x7f4a740b45d0 2024-09-12T02:53:47.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.514+0000 7f4a71e00640 1 --2- 172.21.15.112:0/1514822287 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4a5406be30 0x7f4a5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:47.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.515+0000 7f4a71e00640 1 --2- 172.21.15.112:0/1514822287 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4a5406be30 0x7f4a5406e2f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4a740b18b0 tx=0x7f4a64009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:47.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.518+0000 7f4a6a000640 1 -- 172.21.15.112:0/1514822287 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4a600585f0 con 0x7f4a740b45d0 2024-09-12T02:53:47.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.690+0000 7f4a78a00640 1 -- 172.21.15.112:0/1514822287 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f4a740aee00 con 0x7f4a5406be30 2024-09-12T02:53:47.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.690+0000 7f4a6a000640 1 -- 172.21.15.112:0/1514822287 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4a740aee00 con 0x7f4a5406be30 2024-09-12T02:53:47.691 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T02:53:47.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.692+0000 7f4a78a00640 1 -- 172.21.15.112:0/1514822287 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4a5406be30 msgr2=0x7f4a5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:47.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.692+0000 7f4a78a00640 1 --2- 172.21.15.112:0/1514822287 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4a5406be30 0x7f4a5406e2f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4a740b18b0 tx=0x7f4a64009190 comp rx=0 tx=0).stop 2024-09-12T02:53:47.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.692+0000 7f4a78a00640 1 -- 172.21.15.112:0/1514822287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a740b45d0 msgr2=0x7f4a74151390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:47.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.692+0000 7f4a78a00640 1 --2- 172.21.15.112:0/1514822287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a740b45d0 0x7f4a74151390 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f4a6000c400 tx=0x7f4a6000c8c0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.692+0000 7f4a78a00640 1 -- 172.21.15.112:0/1514822287 shutdown_connections 2024-09-12T02:53:47.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.692+0000 7f4a78a00640 1 --2- 172.21.15.112:0/1514822287 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f4a5406be30 0x7f4a5406e2f0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.692+0000 7f4a78a00640 1 --2- 172.21.15.112:0/1514822287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a7415b9d0 0x7f4a740b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.692+0000 7f4a78a00640 1 --2- 172.21.15.112:0/1514822287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a740b45d0 0x7f4a74151390 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.692+0000 7f4a78a00640 1 --2- 172.21.15.112:0/1514822287 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a7406f600 0x7f4a741f9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.692+0000 7f4a78a00640 1 -- 172.21.15.112:0/1514822287 >> 172.21.15.112:0/1514822287 conn(0x7f4a7406bbd0 msgr2=0x7f4a740ccca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:47.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.692+0000 7f4a78a00640 1 -- 172.21.15.112:0/1514822287 shutdown_connections 2024-09-12T02:53:47.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.692+0000 7f4a78a00640 1 -- 172.21.15.112:0/1514822287 wait complete. 2024-09-12T02:53:47.708 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T02:53:47.708 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:53:47.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.863+0000 7ff67c600640 1 Processor -- start 2024-09-12T02:53:47.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.863+0000 7ff67c600640 1 -- start start 2024-09-12T02:53:47.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.864+0000 7ff67c600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6740d10b0 0x7ff6740b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.864+0000 7ff67c600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff6740b5820 0x7ff6740b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.864+0000 7ff67c600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6740af530 con 0x7ff6740b3f70 2024-09-12T02:53:47.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.864+0000 7ff67c600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff6740af2e0 con 0x7ff6740b5820 2024-09-12T02:53:47.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.864+0000 7ff67c600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff6740af810 con 0x7ff6740d10b0 2024-09-12T02:53:47.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.865+0000 7ff679200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff6740b5820 0x7ff6740b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:47.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.865+0000 7ff679200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff6740b5820 0x7ff6740b3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44646/0 (socket says 172.21.15.112:44646) 2024-09-12T02:53:47.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.865+0000 7ff679200640 1 -- 172.21.15.112:0/881489082 learned_addr learned my addr 172.21.15.112:0/881489082 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:47.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.865+0000 7ff679200640 1 -- 172.21.15.112:0/881489082 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6740d10b0 msgr2=0x7ff6740b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:47.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.865+0000 7ff679c00640 1 --2- 172.21.15.112:0/881489082 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6740d10b0 0x7ff6740b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:47.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.865+0000 7ff679200640 1 --2- 172.21.15.112:0/881489082 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6740d10b0 0x7ff6740b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.865+0000 7ff679200640 1 -- 172.21.15.112:0/881489082 >> v1:172.21.15.137:6789/0 conn(0x7ff6740b3f70 legacy=0x7ff67406dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:47.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.865+0000 7ff679200640 1 -- 172.21.15.112:0/881489082 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67406d550 con 0x7ff6740b5820 2024-09-12T02:53:47.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.865+0000 7ff679c00640 1 --2- 172.21.15.112:0/881489082 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6740d10b0 0x7ff6740b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:53:47.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.866+0000 7ff679200640 1 --2- 172.21.15.112:0/881489082 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6740b5820 0x7ff6740b3a30 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7ff660009870 tx=0x7ff66002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5aa00af2183281 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:47.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.866+0000 7ff673e00640 1 -- 172.21.15.112:0/881489082 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff660037070 con 0x7ff6740b5820 2024-09-12T02:53:47.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.867+0000 7ff673e00640 1 -- 172.21.15.112:0/881489082 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff660032440 con 0x7ff6740b5820 2024-09-12T02:53:47.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.867+0000 7ff673e00640 1 -- 172.21.15.112:0/881489082 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff660032810 con 0x7ff6740b5820 2024-09-12T02:53:47.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.867+0000 7ff67c600640 1 -- 172.21.15.112:0/881489082 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6740b5820 msgr2=0x7ff6740b3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:47.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.867+0000 7ff67c600640 1 --2- 172.21.15.112:0/881489082 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6740b5820 0x7ff6740b3a30 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7ff660009870 tx=0x7ff66002a210 comp rx=0 tx=0).stop 2024-09-12T02:53:47.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.867+0000 7ff67c600640 1 -- 172.21.15.112:0/881489082 shutdown_connections 2024-09-12T02:53:47.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.867+0000 7ff67c600640 1 --2- 172.21.15.112:0/881489082 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6740b5820 0x7ff6740b3a30 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.867+0000 7ff67c600640 1 --2- 172.21.15.112:0/881489082 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6740d10b0 0x7ff6740b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.867+0000 7ff67c600640 1 -- 172.21.15.112:0/881489082 >> 172.21.15.112:0/881489082 conn(0x7ff6740b2730 msgr2=0x7ff6740b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:47.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.867+0000 7ff67c600640 1 -- 172.21.15.112:0/881489082 shutdown_connections 2024-09-12T02:53:47.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.867+0000 7ff67c600640 1 -- 172.21.15.112:0/881489082 wait complete. 2024-09-12T02:53:47.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.869+0000 7ff67c600640 1 Processor -- start 2024-09-12T02:53:47.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.869+0000 7ff67c600640 1 -- start start 2024-09-12T02:53:47.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.870+0000 7ff67c600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6740b3f70 0x7ff67414c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.870+0000 7ff67c600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6740b5820 0x7ff674159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.870+0000 7ff67c600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6740d10b0 0x7ff67415b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.870+0000 7ff67c600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff67406e440 con 0x7ff6740b3f70 2024-09-12T02:53:47.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.870+0000 7ff67c600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff6740d1490 con 0x7ff6740b5820 2024-09-12T02:53:47.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.870+0000 7ff67c600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff67406e5c0 con 0x7ff6740d10b0 2024-09-12T02:53:47.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.870+0000 7ff679c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6740b3f70 0x7ff67414c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:47.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.870+0000 7ff679c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6740b3f70 0x7ff67414c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44660/0 (socket says 172.21.15.112:44660) 2024-09-12T02:53:47.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.870+0000 7ff679c00640 1 -- 172.21.15.112:0/2657595969 learned_addr learned my addr 172.21.15.112:0/2657595969 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:47.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.870+0000 7ff679c00640 1 -- 172.21.15.112:0/2657595969 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6740d10b0 msgr2=0x7ff67415b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:47.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.870+0000 7ff679c00640 1 --2- 172.21.15.112:0/2657595969 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6740d10b0 0x7ff67415b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.870+0000 7ff679c00640 1 -- 172.21.15.112:0/2657595969 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6740b5820 msgr2=0x7ff674159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:47.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.870+0000 7ff679c00640 1 --2- 172.21.15.112:0/2657595969 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6740b5820 0x7ff674159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.870+0000 7ff679c00640 1 -- 172.21.15.112:0/2657595969 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6741604b0 con 0x7ff6740b3f70 2024-09-12T02:53:47.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.871+0000 7ff679c00640 1 --2- 172.21.15.112:0/2657595969 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6740b3f70 0x7ff67414c3a0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7ff66800c7f0 tx=0x7ff66800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:47.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.871+0000 7ff671600640 1 -- 172.21.15.112:0/2657595969 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff668015070 con 0x7ff6740b3f70 2024-09-12T02:53:47.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.871+0000 7ff671600640 1 -- 172.21.15.112:0/2657595969 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff668007a30 con 0x7ff6740b3f70 2024-09-12T02:53:47.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.871+0000 7ff671600640 1 -- 172.21.15.112:0/2657595969 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff668007e00 con 0x7ff6740b3f70 2024-09-12T02:53:47.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.871+0000 7ff67c600640 1 -- 172.21.15.112:0/2657595969 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff67414cd50 con 0x7ff6740b3f70 2024-09-12T02:53:47.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.871+0000 7ff67c600640 1 -- 172.21.15.112:0/2657595969 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6741e9dd0 con 0x7ff6740b3f70 2024-09-12T02:53:47.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.872+0000 7ff67c600640 1 -- 172.21.15.112:0/2657595969 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff67414c8e0 con 0x7ff6740b3f70 2024-09-12T02:53:47.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.873+0000 7ff671600640 1 -- 172.21.15.112:0/2657595969 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff668018070 con 0x7ff6740b3f70 2024-09-12T02:53:47.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.874+0000 7ff671600640 1 --2- 172.21.15.112:0/2657595969 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff65406be30 0x7ff65406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.874+0000 7ff671600640 1 -- 172.21.15.112:0/2657595969 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 4943+0+0 (secure 0 0 0) 0x7ff66808abc0 con 0x7ff6740b3f70 2024-09-12T02:53:47.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.874+0000 7ff679200640 1 --2- 172.21.15.112:0/2657595969 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff65406be30 0x7ff65406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:47.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.874+0000 7ff671600640 1 --2- 172.21.15.112:0/2657595969 >> [v2:172.21.15.137:6824/1421932609,v1:172.21.15.137:6825/1421932609] conn(0x7ff654071cf0 0x7ff654074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.874+0000 7ff671600640 1 -- 172.21.15.112:0/2657595969 --> [v2:172.21.15.137:6824/1421932609,v1:172.21.15.137:6825/1421932609] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff66801ce50 con 0x7ff654071cf0 2024-09-12T02:53:47.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.874+0000 7ff671600640 1 -- 172.21.15.112:0/2657595969 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=190) ==== 24+0+0 (secure 0 0 0) 0x7ff66808f2a0 con 0x7ff6740b3f70 2024-09-12T02:53:47.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.875+0000 7ff679200640 1 --2- 172.21.15.112:0/2657595969 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff65406be30 0x7ff65406e2f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff660034000 tx=0x7ff66002c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:47.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.875+0000 7ff67a600640 1 --2- 172.21.15.112:0/2657595969 >> [v2:172.21.15.137:6824/1421932609,v1:172.21.15.137:6825/1421932609] conn(0x7ff654071cf0 0x7ff654074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:47.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.875+0000 7ff67a600640 1 --2- 172.21.15.112:0/2657595969 >> [v2:172.21.15.137:6824/1421932609,v1:172.21.15.137:6825/1421932609] conn(0x7ff654071cf0 0x7ff654074110 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:47.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.876+0000 7ff671600640 1 -- 172.21.15.112:0/2657595969 <== osd.7 v2:172.21.15.137:6824/1421932609 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7ff66801ce50 con 0x7ff654071cf0 2024-09-12T02:53:47.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.888+0000 7ff67c600640 1 -- 172.21.15.112:0/2657595969 --> [v2:172.21.15.137:6824/1421932609,v1:172.21.15.137:6825/1421932609] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff6740b3a30 con 0x7ff654071cf0 2024-09-12T02:53:47.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.889+0000 7ff671600640 1 -- 172.21.15.112:0/2657595969 <== osd.7 v2:172.21.15.137:6824/1421932609 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7ff6740b3a30 con 0x7ff654071cf0 2024-09-12T02:53:47.890 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-12T02:53:47.890 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-12T02:53:47.890 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-12T02:53:47.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.889+0000 7ff67c600640 1 -- 172.21.15.112:0/2657595969 >> [v2:172.21.15.137:6824/1421932609,v1:172.21.15.137:6825/1421932609] conn(0x7ff654071cf0 msgr2=0x7ff654074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:47.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.889+0000 7ff67c600640 1 --2- 172.21.15.112:0/2657595969 >> [v2:172.21.15.137:6824/1421932609,v1:172.21.15.137:6825/1421932609] conn(0x7ff654071cf0 0x7ff654074110 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.890+0000 7ff67c600640 1 -- 172.21.15.112:0/2657595969 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff65406be30 msgr2=0x7ff65406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:47.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.890+0000 7ff67c600640 1 --2- 172.21.15.112:0/2657595969 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff65406be30 0x7ff65406e2f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff660034000 tx=0x7ff66002c000 comp rx=0 tx=0).stop 2024-09-12T02:53:47.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.890+0000 7ff67c600640 1 -- 172.21.15.112:0/2657595969 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6740b3f70 msgr2=0x7ff67414c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:47.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.890+0000 7ff67c600640 1 --2- 172.21.15.112:0/2657595969 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6740b3f70 0x7ff67414c3a0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7ff66800c7f0 tx=0x7ff66800cbf0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.890+0000 7ff67a600640 1 -- 172.21.15.112:0/2657595969 reap_dead start 2024-09-12T02:53:47.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.890+0000 7ff67c600640 1 -- 172.21.15.112:0/2657595969 shutdown_connections 2024-09-12T02:53:47.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.890+0000 7ff67c600640 1 -- 172.21.15.112:0/2657595969 >> 172.21.15.112:0/2657595969 conn(0x7ff6740b2730 msgr2=0x7ff6740b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:47.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.890+0000 7ff67c600640 1 -- 172.21.15.112:0/2657595969 shutdown_connections 2024-09-12T02:53:47.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:47.890+0000 7ff67c600640 1 -- 172.21.15.112:0/2657595969 wait complete. 2024-09-12T02:53:47.905 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T02:53:48.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.059+0000 7f7480000640 1 Processor -- start 2024-09-12T02:53:48.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.059+0000 7f7480000640 1 -- start start 2024-09-12T02:53:48.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.061+0000 7f7480000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f74780ae8d0 0x7f74780afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:48.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.061+0000 7f7480000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f747806dca0 0x7f747806e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:48.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.061+0000 7f7480000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74780aedd0 con 0x7f747806d8c0 2024-09-12T02:53:48.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.061+0000 7f7480000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f74780af0b0 con 0x7f74780ae8d0 2024-09-12T02:53:48.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.061+0000 7f7480000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f74780af390 con 0x7f747806dca0 2024-09-12T02:53:48.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.061+0000 7f747d600640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f747806d8c0 0x7f74780715a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38560/0 (socket says 172.21.15.112:38560) 2024-09-12T02:53:48.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.061+0000 7f747d600640 1 -- 172.21.15.112:0/3651701774 learned_addr learned my addr 172.21.15.112:0/3651701774 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:53:48.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.061+0000 7f747cc00640 1 --2- 172.21.15.112:0/3651701774 >> v2:172.21.15.112:3300/0 conn(0x7f74780ae8d0 0x7f74780afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:48.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.061+0000 7f747e000640 1 --2- 172.21.15.112:0/3651701774 >> v2:172.21.15.137:3300/0 conn(0x7f747806dca0 0x7f747806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:48.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.061+0000 7f7477e00640 1 -- 172.21.15.112:0/3651701774 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 417058888 0 0) 0x7f74780aedd0 con 0x7f747806d8c0 2024-09-12T02:53:48.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.061+0000 7f747cc00640 1 -- 172.21.15.112:0/3651701774 >> v2:172.21.15.137:3300/0 conn(0x7f747806dca0 msgr2=0x7f747806e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:48.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.061+0000 7f747cc00640 1 --2- 172.21.15.112:0/3651701774 >> v2:172.21.15.137:3300/0 conn(0x7f747806dca0 0x7f747806e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:48.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.061+0000 7f747cc00640 1 -- 172.21.15.112:0/3651701774 >> v1:172.21.15.112:6789/0 conn(0x7f747806d8c0 legacy=0x7f74780715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:48.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.061+0000 7f747cc00640 1 -- 172.21.15.112:0/3651701774 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74780af670 con 0x7f74780ae8d0 2024-09-12T02:53:48.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.062+0000 7f747e000640 1 --2- 172.21.15.112:0/3651701774 >> v2:172.21.15.137:3300/0 conn(0x7f747806dca0 0x7f747806e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:53:48.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.062+0000 7f747cc00640 1 --2- 172.21.15.112:0/3651701774 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74780ae8d0 0x7f74780afe70 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f74780d06c0 tx=0x7f746402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aacffd6bcef635a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:48.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.063+0000 7f7477e00640 1 -- 172.21.15.112:0/3651701774 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7464037070 con 0x7f74780ae8d0 2024-09-12T02:53:48.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.063+0000 7f7477e00640 1 -- 172.21.15.112:0/3651701774 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7464032440 con 0x7f74780ae8d0 2024-09-12T02:53:48.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.063+0000 7f7477e00640 1 -- 172.21.15.112:0/3651701774 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7464032810 con 0x7f74780ae8d0 2024-09-12T02:53:48.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.063+0000 7f7480000640 1 -- 172.21.15.112:0/3651701774 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74780ae8d0 msgr2=0x7f74780afe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:48.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.063+0000 7f7480000640 1 --2- 172.21.15.112:0/3651701774 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74780ae8d0 0x7f74780afe70 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f74780d06c0 tx=0x7f746402a1a0 comp rx=0 tx=0).stop 2024-09-12T02:53:48.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.063+0000 7f7480000640 1 -- 172.21.15.112:0/3651701774 shutdown_connections 2024-09-12T02:53:48.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.063+0000 7f7480000640 1 --2- 172.21.15.112:0/3651701774 >> v2:172.21.15.137:3300/0 conn(0x7f747806dca0 0x7f747806e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:48.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.063+0000 7f7480000640 1 --2- 172.21.15.112:0/3651701774 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74780ae8d0 0x7f74780afe70 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:48.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.063+0000 7f7480000640 1 -- 172.21.15.112:0/3651701774 >> 172.21.15.112:0/3651701774 conn(0x7f747806bbd0 msgr2=0x7f747806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:48.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.063+0000 7f7480000640 1 -- 172.21.15.112:0/3651701774 shutdown_connections 2024-09-12T02:53:48.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.063+0000 7f7480000640 1 -- 172.21.15.112:0/3651701774 wait complete. 2024-09-12T02:53:48.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.065+0000 7f7480000640 1 Processor -- start 2024-09-12T02:53:48.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.065+0000 7f7480000640 1 -- start start 2024-09-12T02:53:48.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.066+0000 7f7480000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f747806d8c0 0x7f7478156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:48.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.066+0000 7f7480000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f747806dca0 0x7f74781484e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:48.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.066+0000 7f7480000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f74780ae8d0 0x7f74780cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:48.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.066+0000 7f7480000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f74780b38e0 con 0x7f747806d8c0 2024-09-12T02:53:48.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.066+0000 7f7480000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f747806e690 con 0x7f747806dca0 2024-09-12T02:53:48.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.066+0000 7f7480000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f74780b3a60 con 0x7f74780ae8d0 2024-09-12T02:53:48.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.066+0000 7f747d600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f747806d8c0 0x7f7478156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:48.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.066+0000 7f747d600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f747806d8c0 0x7f7478156fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44688/0 (socket says 172.21.15.112:44688) 2024-09-12T02:53:48.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.066+0000 7f747d600640 1 -- 172.21.15.112:0/363707673 learned_addr learned my addr 172.21.15.112:0/363707673 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:48.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.066+0000 7f747d600640 1 -- 172.21.15.112:0/363707673 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f74780ae8d0 msgr2=0x7f74780cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:48.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.066+0000 7f747d600640 1 --2- 172.21.15.112:0/363707673 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f74780ae8d0 0x7f74780cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:48.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.066+0000 7f747d600640 1 -- 172.21.15.112:0/363707673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f747806dca0 msgr2=0x7f74781484e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:48.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.067+0000 7f747d600640 1 --2- 172.21.15.112:0/363707673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f747806dca0 0x7f74781484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:48.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.067+0000 7f747d600640 1 -- 172.21.15.112:0/363707673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7478155f00 con 0x7f747806d8c0 2024-09-12T02:53:48.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.067+0000 7f747d600640 1 --2- 172.21.15.112:0/363707673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f747806d8c0 0x7f7478156fa0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f746c00c500 tx=0x7f746c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:48.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.067+0000 7f7475600640 1 -- 172.21.15.112:0/363707673 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746c018070 con 0x7f747806d8c0 2024-09-12T02:53:48.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.067+0000 7f7475600640 1 -- 172.21.15.112:0/363707673 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f746c007560 con 0x7f747806d8c0 2024-09-12T02:53:48.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.067+0000 7f7475600640 1 -- 172.21.15.112:0/363707673 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746c004a20 con 0x7f747806d8c0 2024-09-12T02:53:48.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.067+0000 7f7480000640 1 -- 172.21.15.112:0/363707673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74781561e0 con 0x7f747806d8c0 2024-09-12T02:53:48.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.067+0000 7f7480000640 1 -- 172.21.15.112:0/363707673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74781567a0 con 0x7f747806d8c0 2024-09-12T02:53:48.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.068+0000 7f7480000640 1 -- 172.21.15.112:0/363707673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7478068a30 con 0x7f747806d8c0 2024-09-12T02:53:48.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.069+0000 7f7475600640 1 -- 172.21.15.112:0/363707673 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f746c004bc0 con 0x7f747806d8c0 2024-09-12T02:53:48.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.070+0000 7f7475600640 1 --2- 172.21.15.112:0/363707673 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f745806be30 0x7f745806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:48.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.070+0000 7f7475600640 1 -- 172.21.15.112:0/363707673 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 4943+0+0 (secure 0 0 0) 0x7f746c089e50 con 0x7f747806d8c0 2024-09-12T02:53:48.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.070+0000 7f747cc00640 1 --2- 172.21.15.112:0/363707673 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f745806be30 0x7f745806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:48.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.071+0000 7f747cc00640 1 --2- 172.21.15.112:0/363707673 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f745806be30 0x7f745806e2f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7464034000 tx=0x7f746402c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:48.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.074+0000 7f7475600640 1 -- 172.21.15.112:0/363707673 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f746c058af0 con 0x7f747806d8c0 2024-09-12T02:53:48.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.251+0000 7f7480000640 1 -- 172.21.15.112:0/363707673 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f747806e150 con 0x7f745806be30 2024-09-12T02:53:48.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.251+0000 7f7475600640 1 -- 172.21.15.112:0/363707673 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f747806e150 con 0x7f745806be30 2024-09-12T02:53:48.253 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T02:53:48.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.253+0000 7f7480000640 1 -- 172.21.15.112:0/363707673 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f745806be30 msgr2=0x7f745806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:48.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.253+0000 7f7480000640 1 --2- 172.21.15.112:0/363707673 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f745806be30 0x7f745806e2f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7464034000 tx=0x7f746402c000 comp rx=0 tx=0).stop 2024-09-12T02:53:48.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.254+0000 7f7480000640 1 -- 172.21.15.112:0/363707673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f747806d8c0 msgr2=0x7f7478156fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:48.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.254+0000 7f7480000640 1 --2- 172.21.15.112:0/363707673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f747806d8c0 0x7f7478156fa0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f746c00c500 tx=0x7f746c00c9c0 comp rx=0 tx=0).stop 2024-09-12T02:53:48.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.254+0000 7f7480000640 1 -- 172.21.15.112:0/363707673 shutdown_connections 2024-09-12T02:53:48.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.254+0000 7f7480000640 1 --2- 172.21.15.112:0/363707673 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f74780ae8d0 0x7f74780cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:48.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.254+0000 7f7480000640 1 --2- 172.21.15.112:0/363707673 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f745806be30 0x7f745806e2f0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:48.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.254+0000 7f7480000640 1 --2- 172.21.15.112:0/363707673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f747806dca0 0x7f74781484e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:48.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.254+0000 7f7480000640 1 --2- 172.21.15.112:0/363707673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f747806d8c0 0x7f7478156fa0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:48.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.254+0000 7f7480000640 1 -- 172.21.15.112:0/363707673 >> 172.21.15.112:0/363707673 conn(0x7f747806bbd0 msgr2=0x7f74780b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:48.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.254+0000 7f7480000640 1 -- 172.21.15.112:0/363707673 shutdown_connections 2024-09-12T02:53:48.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.254+0000 7f7480000640 1 -- 172.21.15.112:0/363707673 wait complete. 2024-09-12T02:53:48.270 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:53:48.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.421+0000 7fa7b7200640 1 Processor -- start 2024-09-12T02:53:48.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.421+0000 7fa7b7200640 1 -- start start 2024-09-12T02:53:48.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.423+0000 7fa7b7200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa7b015b9d0 0x7fa7b00b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:48.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.423+0000 7fa7b7200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa7b00b45d0 0x7fa7b00728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:48.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.423+0000 7fa7b7200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7b00b54a0 con 0x7fa7b006eef0 2024-09-12T02:53:48.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.423+0000 7fa7b7200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa7b00b4a60 con 0x7fa7b015b9d0 2024-09-12T02:53:48.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.423+0000 7fa7b7200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa7b00b3af0 con 0x7fa7b00b45d0 2024-09-12T02:53:48.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.423+0000 7fa7afe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa7b015b9d0 0x7fa7b00b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:48.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.423+0000 7fa7afe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa7b015b9d0 0x7fa7b00b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44694/0 (socket says 172.21.15.112:44694) 2024-09-12T02:53:48.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.423+0000 7fa7afe00640 1 -- 172.21.15.112:0/72770057 learned_addr learned my addr 172.21.15.112:0/72770057 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:48.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.423+0000 7fa7af400640 1 --2- 172.21.15.112:0/72770057 >> v2:172.21.15.137:3300/0 conn(0x7fa7b00b45d0 0x7fa7b00728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:48.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.423+0000 7fa7afe00640 1 -- 172.21.15.112:0/72770057 >> v2:172.21.15.137:3300/0 conn(0x7fa7b00b45d0 msgr2=0x7fa7b00728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:48.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.423+0000 7fa7afe00640 1 --2- 172.21.15.112:0/72770057 >> v2:172.21.15.137:3300/0 conn(0x7fa7b00b45d0 0x7fa7b00728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:48.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.423+0000 7fa7afe00640 1 -- 172.21.15.112:0/72770057 >> v1:172.21.15.137:6789/0 conn(0x7fa7b006eef0 legacy=0x7fa7b006f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:48.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.423+0000 7fa7afe00640 1 -- 172.21.15.112:0/72770057 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b00b3dd0 con 0x7fa7b015b9d0 2024-09-12T02:53:48.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.424+0000 7fa7afe00640 1 --2- 172.21.15.112:0/72770057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7b015b9d0 0x7fa7b00b4ec0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0068670 tx=0x7fa7a002a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461ce5728dc5391d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:48.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.425+0000 7fa7aea00640 1 -- 172.21.15.112:0/72770057 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0037070 con 0x7fa7b015b9d0 2024-09-12T02:53:48.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.425+0000 7fa7aea00640 1 -- 172.21.15.112:0/72770057 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7a0032440 con 0x7fa7b015b9d0 2024-09-12T02:53:48.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.425+0000 7fa7aea00640 1 -- 172.21.15.112:0/72770057 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0032810 con 0x7fa7b015b9d0 2024-09-12T02:53:48.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.425+0000 7fa7b7200640 1 -- 172.21.15.112:0/72770057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7b015b9d0 msgr2=0x7fa7b00b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:48.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.425+0000 7fa7b7200640 1 --2- 172.21.15.112:0/72770057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7b015b9d0 0x7fa7b00b4ec0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0068670 tx=0x7fa7a002a200 comp rx=0 tx=0).stop 2024-09-12T02:53:48.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.425+0000 7fa7b7200640 1 -- 172.21.15.112:0/72770057 shutdown_connections 2024-09-12T02:53:48.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.425+0000 7fa7b7200640 1 --2- 172.21.15.112:0/72770057 >> v2:172.21.15.137:3300/0 conn(0x7fa7b00b45d0 0x7fa7b00728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:48.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.425+0000 7fa7b7200640 1 --2- 172.21.15.112:0/72770057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7b015b9d0 0x7fa7b00b4ec0 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:48.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.425+0000 7fa7b7200640 1 -- 172.21.15.112:0/72770057 >> 172.21.15.112:0/72770057 conn(0x7fa7b006bbd0 msgr2=0x7fa7b006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:48.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.425+0000 7fa7b7200640 1 -- 172.21.15.112:0/72770057 shutdown_connections 2024-09-12T02:53:48.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.425+0000 7fa7b7200640 1 -- 172.21.15.112:0/72770057 wait complete. 2024-09-12T02:53:48.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.427+0000 7fa7b7200640 1 Processor -- start 2024-09-12T02:53:48.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.427+0000 7fa7b7200640 1 -- start start 2024-09-12T02:53:48.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.428+0000 7fa7b7200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7b006eef0 0x7fa7b01566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:48.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.428+0000 7fa7b7200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7b00b45d0 0x7fa7b0145520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:48.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.428+0000 7fa7b7200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7b015b9d0 0x7fa7b00b0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:48.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.428+0000 7fa7b7200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b015bf30 con 0x7fa7b00b45d0 2024-09-12T02:53:48.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.428+0000 7fa7b7200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b015bdb0 con 0x7fa7b006eef0 2024-09-12T02:53:48.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.428+0000 7fa7b7200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa7b00cdcd0 con 0x7fa7b015b9d0 2024-09-12T02:53:48.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.428+0000 7fa7af400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7b00b45d0 0x7fa7b0145520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:48.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.428+0000 7fa7af400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7b00b45d0 0x7fa7b0145520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44696/0 (socket says 172.21.15.112:44696) 2024-09-12T02:53:48.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.428+0000 7fa7af400640 1 -- 172.21.15.112:0/4094271447 learned_addr learned my addr 172.21.15.112:0/4094271447 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:53:48.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.428+0000 7fa7afe00640 1 --2- 172.21.15.112:0/4094271447 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7b006eef0 0x7fa7b01566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:48.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.428+0000 7fa7b5200640 1 --2- 172.21.15.112:0/4094271447 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7b015b9d0 0x7fa7b00b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:48.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.429+0000 7fa7af400640 1 -- 172.21.15.112:0/4094271447 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7b015b9d0 msgr2=0x7fa7b00b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:48.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.429+0000 7fa7af400640 1 --2- 172.21.15.112:0/4094271447 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7b015b9d0 0x7fa7b00b0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:48.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.429+0000 7fa7af400640 1 -- 172.21.15.112:0/4094271447 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7b006eef0 msgr2=0x7fa7b01566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:48.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.429+0000 7fa7af400640 1 --2- 172.21.15.112:0/4094271447 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7b006eef0 0x7fa7b01566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:48.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.429+0000 7fa7af400640 1 -- 172.21.15.112:0/4094271447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b0155650 con 0x7fa7b00b45d0 2024-09-12T02:53:48.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.429+0000 7fa7af400640 1 --2- 172.21.15.112:0/4094271447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7b00b45d0 0x7fa7b0145520 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fa79c00d830 tx=0x7fa79c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:48.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.429+0000 7fa7a7e00640 1 -- 172.21.15.112:0/4094271447 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c00b660 con 0x7fa7b00b45d0 2024-09-12T02:53:48.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.429+0000 7fa7a7e00640 1 -- 172.21.15.112:0/4094271447 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa79c019070 con 0x7fa7b00b45d0 2024-09-12T02:53:48.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.429+0000 7fa7b7200640 1 -- 172.21.15.112:0/4094271447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7b0155930 con 0x7fa7b00b45d0 2024-09-12T02:53:48.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.429+0000 7fa7a7e00640 1 -- 172.21.15.112:0/4094271447 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c00ba40 con 0x7fa7b00b45d0 2024-09-12T02:53:48.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.429+0000 7fa7b7200640 1 -- 172.21.15.112:0/4094271447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7b0155ef0 con 0x7fa7b00b45d0 2024-09-12T02:53:48.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.430+0000 7fa7b7200640 1 -- 172.21.15.112:0/4094271447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7b0068370 con 0x7fa7b00b45d0 2024-09-12T02:53:48.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.431+0000 7fa7a7e00640 1 -- 172.21.15.112:0/4094271447 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa79c01e460 con 0x7fa7b00b45d0 2024-09-12T02:53:48.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.432+0000 7fa7a7e00640 1 --2- 172.21.15.112:0/4094271447 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa79006be60 0x7fa79006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:48.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.432+0000 7fa7a7e00640 1 -- 172.21.15.112:0/4094271447 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 4943+0+0 (secure 0 0 0) 0x7fa79c08b110 con 0x7fa7b00b45d0 2024-09-12T02:53:48.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.432+0000 7fa7afe00640 1 --2- 172.21.15.112:0/4094271447 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa79006be60 0x7fa79006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:48.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.433+0000 7fa7afe00640 1 --2- 172.21.15.112:0/4094271447 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa79006be60 0x7fa79006e320 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0034000 tx=0x7fa7a002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:48.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.437+0000 7fa7a7e00640 1 -- 172.21.15.112:0/4094271447 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa7b0068370 con 0x7fa7b00b45d0 2024-09-12T02:53:48.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.606+0000 7fa7b7200640 1 -- 172.21.15.112:0/4094271447 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa7b0071b20 con 0x7fa79006be60 2024-09-12T02:53:48.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.607+0000 7fa7a7e00640 1 -- 172.21.15.112:0/4094271447 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12578 (secure 0 0 0) 0x7fa7b0071b20 con 0x7fa79006be60 2024-09-12T02:53:48.608 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:53:48.608 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:53:48.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.609+0000 7fa7b7200640 1 -- 172.21.15.112:0/4094271447 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa79006be60 msgr2=0x7fa79006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:48.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.609+0000 7fa7b7200640 1 --2- 172.21.15.112:0/4094271447 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa79006be60 0x7fa79006e320 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0034000 tx=0x7fa7a002e000 comp rx=0 tx=0).stop 2024-09-12T02:53:48.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.609+0000 7fa7b7200640 1 -- 172.21.15.112:0/4094271447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7b00b45d0 msgr2=0x7fa7b0145520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:48.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.609+0000 7fa7b7200640 1 --2- 172.21.15.112:0/4094271447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7b00b45d0 0x7fa7b0145520 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fa79c00d830 tx=0x7fa79c00dcf0 comp rx=0 tx=0).stop 2024-09-12T02:53:48.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.609+0000 7fa7b7200640 1 -- 172.21.15.112:0/4094271447 shutdown_connections 2024-09-12T02:53:48.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.609+0000 7fa7b7200640 1 --2- 172.21.15.112:0/4094271447 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7b015b9d0 0x7fa7b00b0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:48.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.609+0000 7fa7b7200640 1 --2- 172.21.15.112:0/4094271447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7b00b45d0 0x7fa7b0145520 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:48.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.609+0000 7fa7b7200640 1 --2- 172.21.15.112:0/4094271447 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fa79006be60 0x7fa79006e320 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:48.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.609+0000 7fa7b7200640 1 --2- 172.21.15.112:0/4094271447 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7b006eef0 0x7fa7b01566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:48.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.609+0000 7fa7b7200640 1 -- 172.21.15.112:0/4094271447 >> 172.21.15.112:0/4094271447 conn(0x7fa7b006bbd0 msgr2=0x7fa7b00ce060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:48.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.609+0000 7fa7b7200640 1 -- 172.21.15.112:0/4094271447 shutdown_connections 2024-09-12T02:53:48.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:53:48.609+0000 7fa7b7200640 1 -- 172.21.15.112:0/4094271447 wait complete. 2024-09-12T02:53:48.626 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":544,"stamp":"2024-09-12T02:53:47.125618+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9516,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552983,"statfs":{"total":1600000000,"available":1590255376,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52428800,"num_objects":-13,"num_object_clones":0,"num_object_copies":-26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-32,"num_write_kb":-84992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.803866"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":497,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-12T02:53:38.334441+0000","last_change":"2024-09-12T02:41:44.475507+0000","last_active":"2024-09-12T02:53:38.334441+0000","last_peered":"2024-09-12T02:53:38.334441+0000","last_clean":"2024-09-12T02:53:38.334441+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:53:38.334441+0000","last_undegraded":"2024-09-12T02:53:38.334441+0000","last_fullsized":"2024-09-12T02:53:38.334441+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:41:43.207307+0000","last_clean_scrub_stamp":"2024-09-12T02:41:43.207307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:25.823876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574994,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1621,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193690,"statfs":{"total":200000000,"available":198339146,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1045,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194267,"statfs":{"total":200000000,"available":198929514,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1045,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194267,"statfs":{"total":200000000,"available":198929514,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1045,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194267,"statfs":{"total":200000000,"available":198929514,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1045,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194267,"statfs":{"total":200000000,"available":198929514,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1045,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194267,"statfs":{"total":200000000,"available":198929514,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1045,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194267,"statfs":{"total":200000000,"available":198929514,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574994,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1621,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193690,"statfs":{"total":200000000,"available":198339146,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:53:48.629 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T02:41:43.207307+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=41, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=53, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:53:48.629 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T02:53:53.143 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:53:53.149 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:54:08.631 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:54:08.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.792+0000 7fefffc00640 1 Processor -- start 2024-09-12T02:54:08.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.792+0000 7fefffc00640 1 -- start start 2024-09-12T02:54:08.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.793+0000 7fefffc00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7feff815cc50 0x7feff80732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:08.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.793+0000 7fefffc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feff8071530 0x7feff80af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:08.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.793+0000 7fefffc00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feff8071970 0x7feff80afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:08.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.793+0000 7fefffc00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7feff815d030 con 0x7feff8071970 2024-09-12T02:54:08.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.793+0000 7fefffc00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7feff80cf4c0 con 0x7feff815cc50 2024-09-12T02:54:08.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.793+0000 7fefffc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7feff8073830 con 0x7feff8071530 2024-09-12T02:54:08.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.794+0000 7feffdc00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feff8071970 0x7feff80afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:08.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.794+0000 7feffdc00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feff8071970 0x7feff80afc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38962/0 (socket says 172.21.15.112:38962) 2024-09-12T02:54:08.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.794+0000 7feffdc00640 1 -- 172.21.15.112:0/2092001291 learned_addr learned my addr 172.21.15.112:0/2092001291 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:54:08.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.794+0000 7feffdc00640 1 -- 172.21.15.112:0/2092001291 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feff8071530 msgr2=0x7feff80af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:08.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.794+0000 7feffdc00640 1 --2- 172.21.15.112:0/2092001291 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feff8071530 0x7feff80af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:08.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.794+0000 7feffdc00640 1 -- 172.21.15.112:0/2092001291 >> v2:172.21.15.137:3300/0 conn(0x7feff815cc50 msgr2=0x7feff80732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:08.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.794+0000 7feffdc00640 1 --2- 172.21.15.112:0/2092001291 >> v2:172.21.15.137:3300/0 conn(0x7feff815cc50 0x7feff80732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:08.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.794+0000 7feffdc00640 1 -- 172.21.15.112:0/2092001291 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff80ceeb0 con 0x7feff8071970 2024-09-12T02:54:08.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.795+0000 7feffdc00640 1 --2- 172.21.15.112:0/2092001291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feff8071970 0x7feff80afc60 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7feff8070060 tx=0x7feff002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d38ff149d03e7e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:08.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.795+0000 7feff7e00640 1 -- 172.21.15.112:0/2092001291 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff0036070 con 0x7feff8071970 2024-09-12T02:54:08.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.795+0000 7feff7e00640 1 -- 172.21.15.112:0/2092001291 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feff0031600 con 0x7feff8071970 2024-09-12T02:54:08.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.795+0000 7feff7e00640 1 -- 172.21.15.112:0/2092001291 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff00319d0 con 0x7feff8071970 2024-09-12T02:54:08.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.796+0000 7fefffc00640 1 -- 172.21.15.112:0/2092001291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feff8071970 msgr2=0x7feff80afc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:08.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.796+0000 7fefffc00640 1 --2- 172.21.15.112:0/2092001291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feff8071970 0x7feff80afc60 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7feff8070060 tx=0x7feff002a610 comp rx=0 tx=0).stop 2024-09-12T02:54:08.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.796+0000 7fefffc00640 1 -- 172.21.15.112:0/2092001291 shutdown_connections 2024-09-12T02:54:08.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.796+0000 7fefffc00640 1 --2- 172.21.15.112:0/2092001291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feff8071970 0x7feff80afc60 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:08.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.796+0000 7fefffc00640 1 --2- 172.21.15.112:0/2092001291 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feff8071530 0x7feff80af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:08.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.796+0000 7fefffc00640 1 --2- 172.21.15.112:0/2092001291 >> v2:172.21.15.137:3300/0 conn(0x7feff815cc50 0x7feff80732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:08.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.796+0000 7fefffc00640 1 -- 172.21.15.112:0/2092001291 >> 172.21.15.112:0/2092001291 conn(0x7feff806bbd0 msgr2=0x7feff806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:08.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.796+0000 7fefffc00640 1 -- 172.21.15.112:0/2092001291 shutdown_connections 2024-09-12T02:54:08.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.796+0000 7fefffc00640 1 -- 172.21.15.112:0/2092001291 wait complete. 2024-09-12T02:54:08.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.798+0000 7fefffc00640 1 Processor -- start 2024-09-12T02:54:08.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.798+0000 7fefffc00640 1 -- start start 2024-09-12T02:54:08.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.799+0000 7fefffc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feff8071530 0x7feff8141550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:08.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.799+0000 7fefffc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feff8071970 0x7feff80ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:08.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.799+0000 7fefffc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feff815cc50 0x7feff80aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:08.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.799+0000 7fefffc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7feff80cf150 con 0x7feff815cc50 2024-09-12T02:54:08.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.799+0000 7fefffc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7feff806e5e0 con 0x7feff8071530 2024-09-12T02:54:08.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.799+0000 7fefffc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7feff806f510 con 0x7feff8071970 2024-09-12T02:54:08.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.799+0000 7feffdc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feff815cc50 0x7feff80aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:08.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.799+0000 7feffdc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feff815cc50 0x7feff80aee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38968/0 (socket says 172.21.15.112:38968) 2024-09-12T02:54:08.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.799+0000 7feffdc00640 1 -- 172.21.15.112:0/1587829753 learned_addr learned my addr 172.21.15.112:0/1587829753 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:54:08.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.799+0000 7fefefe00640 1 --2- 172.21.15.112:0/1587829753 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feff8071970 0x7feff80ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:08.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.799+0000 7feffd200640 1 --2- 172.21.15.112:0/1587829753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feff8071530 0x7feff8141550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:08.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.800+0000 7feffdc00640 1 -- 172.21.15.112:0/1587829753 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feff8071970 msgr2=0x7feff80ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:08.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.800+0000 7feffdc00640 1 --2- 172.21.15.112:0/1587829753 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feff8071970 0x7feff80ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:08.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.800+0000 7feffdc00640 1 -- 172.21.15.112:0/1587829753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feff8071530 msgr2=0x7feff8141550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:08.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.800+0000 7feffdc00640 1 --2- 172.21.15.112:0/1587829753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feff8071530 0x7feff8141550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:08.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.800+0000 7feffdc00640 1 -- 172.21.15.112:0/1587829753 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff81f8b80 con 0x7feff815cc50 2024-09-12T02:54:08.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.800+0000 7feffd200640 1 --2- 172.21.15.112:0/1587829753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feff8071530 0x7feff8141550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:54:08.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.800+0000 7feffdc00640 1 --2- 172.21.15.112:0/1587829753 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feff815cc50 0x7feff80aee10 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7feff0034040 tx=0x7feff0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:08.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.800+0000 7feff5600640 1 -- 172.21.15.112:0/1587829753 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff0041020 con 0x7feff815cc50 2024-09-12T02:54:08.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.800+0000 7feff5600640 1 -- 172.21.15.112:0/1587829753 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feff00077a0 con 0x7feff815cc50 2024-09-12T02:54:08.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.800+0000 7feff5600640 1 -- 172.21.15.112:0/1587829753 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff0036040 con 0x7feff815cc50 2024-09-12T02:54:08.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.800+0000 7fefffc00640 1 -- 172.21.15.112:0/1587829753 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feff81541a0 con 0x7feff815cc50 2024-09-12T02:54:08.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.801+0000 7fefffc00640 1 -- 172.21.15.112:0/1587829753 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feff8154a40 con 0x7feff815cc50 2024-09-12T02:54:08.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.801+0000 7fefffc00640 1 -- 172.21.15.112:0/1587829753 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feff806df60 con 0x7feff815cc50 2024-09-12T02:54:08.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.802+0000 7feff5600640 1 -- 172.21.15.112:0/1587829753 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feff0044020 con 0x7feff815cc50 2024-09-12T02:54:08.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.803+0000 7feff5600640 1 --2- 172.21.15.112:0/1587829753 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fefd406be60 0x7fefd406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:08.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.803+0000 7feff5600640 1 -- 172.21.15.112:0/1587829753 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 4943+0+0 (secure 0 0 0) 0x7feff00aba50 con 0x7feff815cc50 2024-09-12T02:54:08.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.803+0000 7feffd200640 1 --2- 172.21.15.112:0/1587829753 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fefd406be60 0x7fefd406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:08.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.804+0000 7feffd200640 1 --2- 172.21.15.112:0/1587829753 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fefd406be60 0x7fefd406e320 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fefe8009890 tx=0x7fefe8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:08.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.808+0000 7feff5600640 1 -- 172.21.15.112:0/1587829753 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feff004b030 con 0x7feff815cc50 2024-09-12T02:54:08.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.976+0000 7fefffc00640 1 -- 172.21.15.112:0/1587829753 --> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feff8157a90 con 0x7fefd406be60 2024-09-12T02:54:08.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.976+0000 7feff5600640 1 -- 172.21.15.112:0/1587829753 <== mgr.4100 v2:172.21.15.112:6832/3439199466 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12567 (secure 0 0 0) 0x7feff8157a90 con 0x7fefd406be60 2024-09-12T02:54:08.977 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:54:08.978 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-12T02:54:08.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.978+0000 7fefffc00640 1 -- 172.21.15.112:0/1587829753 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fefd406be60 msgr2=0x7fefd406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:08.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.978+0000 7fefffc00640 1 --2- 172.21.15.112:0/1587829753 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fefd406be60 0x7fefd406e320 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fefe8009890 tx=0x7fefe8008040 comp rx=0 tx=0).stop 2024-09-12T02:54:08.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.978+0000 7fefffc00640 1 -- 172.21.15.112:0/1587829753 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feff815cc50 msgr2=0x7feff80aee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:08.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.978+0000 7fefffc00640 1 --2- 172.21.15.112:0/1587829753 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feff815cc50 0x7feff80aee10 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7feff0034040 tx=0x7feff0004a40 comp rx=0 tx=0).stop 2024-09-12T02:54:08.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.979+0000 7fefffc00640 1 -- 172.21.15.112:0/1587829753 shutdown_connections 2024-09-12T02:54:08.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.979+0000 7fefffc00640 1 --2- 172.21.15.112:0/1587829753 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feff815cc50 0x7feff80aee10 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:08.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.979+0000 7fefffc00640 1 --2- 172.21.15.112:0/1587829753 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feff8071970 0x7feff80ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:08.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.979+0000 7fefffc00640 1 --2- 172.21.15.112:0/1587829753 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7fefd406be60 0x7fefd406e320 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:08.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.979+0000 7fefffc00640 1 --2- 172.21.15.112:0/1587829753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feff8071530 0x7feff8141550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:08.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.979+0000 7fefffc00640 1 -- 172.21.15.112:0/1587829753 >> 172.21.15.112:0/1587829753 conn(0x7feff806bbd0 msgr2=0x7feff80d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:08.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.979+0000 7fefffc00640 1 -- 172.21.15.112:0/1587829753 shutdown_connections 2024-09-12T02:54:08.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:08.979+0000 7fefffc00640 1 -- 172.21.15.112:0/1587829753 wait complete. 2024-09-12T02:54:08.995 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":554,"stamp":"2024-09-12T02:54:07.129657+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9516,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552983,"statfs":{"total":1600000000,"available":1590255376,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002481"},"pg_stats":[{"pgid":"1.0","version":"190'119","reported_seq":509,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-09-12T02:53:48.520780+0000","last_change":"2024-09-12T02:53:48.520825+0000","last_active":"2024-09-12T02:53:48.520780+0000","last_peered":"2024-09-12T02:53:48.520780+0000","last_clean":"2024-09-12T02:53:48.520780+0000","last_became_active":"2024-09-12T02:41:44.475167+0000","last_became_peered":"2024-09-12T02:41:44.475167+0000","last_unstale":"2024-09-12T02:53:48.520780+0000","last_undegraded":"2024-09-12T02:53:48.520780+0000","last_fullsized":"2024-09-12T02:53:48.520780+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"190'119","last_scrub_stamp":"2024-09-12T02:53:48.520733+0000","last_deep_scrub":"190'119","last_deep_scrub_stamp":"2024-09-12T02:53:48.520733+0000","last_clean_scrub_stamp":"2024-09-12T02:53:48.520733+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:47:20.165277+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574998,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1621,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193690,"statfs":{"total":200000000,"available":198339146,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1045,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194267,"statfs":{"total":200000000,"available":198929514,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1045,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194267,"statfs":{"total":200000000,"available":198929514,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1045,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194267,"statfs":{"total":200000000,"available":198929514,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1045,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194267,"statfs":{"total":200000000,"available":198929514,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1045,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194267,"statfs":{"total":200000000,"available":198929514,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1045,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194267,"statfs":{"total":200000000,"available":198929514,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574998,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1621,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193690,"statfs":{"total":200000000,"available":198339146,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-12T02:54:08.996 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T02:54:09.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.142+0000 7ffa0ec00640 1 Processor -- start 2024-09-12T02:54:09.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.142+0000 7ffa0ec00640 1 -- start start 2024-09-12T02:54:09.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.143+0000 7ffa0ec00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ffa080b4d30 0x7ffa080d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:09.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.143+0000 7ffa0ec00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa081627a0 con 0x7ffa080d0370 2024-09-12T02:54:09.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.143+0000 7ffa0ec00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa080d08e0 con 0x7ffa081623c0 2024-09-12T02:54:09.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.143+0000 7ffa0ec00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ffa080d0bc0 con 0x7ffa080b4d30 2024-09-12T02:54:09.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.143+0000 7ffa0e200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ffa080b4d30 0x7ffa080d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:09.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.143+0000 7ffa0ce00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ffa080d0370 0x7ffa080b4620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34092/0 (socket says 172.21.15.112:34092) 2024-09-12T02:54:09.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.143+0000 7ffa0ce00640 1 -- 172.21.15.112:0/3080305205 learned_addr learned my addr 172.21.15.112:0/3080305205 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-12T02:54:09.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.144+0000 7ffa0e200640 1 -- 172.21.15.112:0/3080305205 >> v1:172.21.15.137:6789/0 conn(0x7ffa081623c0 legacy=0x7ffa080d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:09.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.144+0000 7ffa0e200640 1 -- 172.21.15.112:0/3080305205 >> v1:172.21.15.112:6789/0 conn(0x7ffa080d0370 legacy=0x7ffa080b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:09.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.144+0000 7ffa0e200640 1 -- 172.21.15.112:0/3080305205 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa080d2930 con 0x7ffa080b4d30 2024-09-12T02:54:09.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.144+0000 7ffa07e00640 1 -- 172.21.15.112:0/3080305205 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 454491580 0 0) 0x7ffa081627a0 con 0x7ffa080d0370 2024-09-12T02:54:09.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.145+0000 7ffa0e200640 1 --2- 172.21.15.112:0/3080305205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa080b4d30 0x7ffa080d1400 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7ffa00009d90 tx=0x7ffa0002a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f271efda62b6171 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:09.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.145+0000 7ffa07e00640 1 -- 172.21.15.112:0/3080305205 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa00037070 con 0x7ffa080b4d30 2024-09-12T02:54:09.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.145+0000 7ffa07e00640 1 -- 172.21.15.112:0/3080305205 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa00007740 con 0x7ffa080b4d30 2024-09-12T02:54:09.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.145+0000 7ffa07e00640 1 -- 172.21.15.112:0/3080305205 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa00007b10 con 0x7ffa080b4d30 2024-09-12T02:54:09.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.146+0000 7ffa0ec00640 1 -- 172.21.15.112:0/3080305205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa080b4d30 msgr2=0x7ffa080d1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:09.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.146+0000 7ffa0ec00640 1 --2- 172.21.15.112:0/3080305205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa080b4d30 0x7ffa080d1400 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7ffa00009d90 tx=0x7ffa0002a780 comp rx=0 tx=0).stop 2024-09-12T02:54:09.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.146+0000 7ffa0ec00640 1 -- 172.21.15.112:0/3080305205 shutdown_connections 2024-09-12T02:54:09.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.146+0000 7ffa0ec00640 1 --2- 172.21.15.112:0/3080305205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa080b4d30 0x7ffa080d1400 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:09.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.146+0000 7ffa0ec00640 1 -- 172.21.15.112:0/3080305205 >> 172.21.15.112:0/3080305205 conn(0x7ffa080d4cc0 msgr2=0x7ffa080d50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:09.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.146+0000 7ffa0ec00640 1 -- 172.21.15.112:0/3080305205 shutdown_connections 2024-09-12T02:54:09.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.146+0000 7ffa0ec00640 1 -- 172.21.15.112:0/3080305205 wait complete. 2024-09-12T02:54:09.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.147+0000 7ffa0ec00640 1 Processor -- start 2024-09-12T02:54:09.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.147+0000 7ffa0ec00640 1 -- start start 2024-09-12T02:54:09.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.148+0000 7ffa0ec00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffa080d0370 0x7ffa080b7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:09.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.148+0000 7ffa0ec00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa081623c0 0x7ffa0815dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:09.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.148+0000 7ffa0ec00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffa080d5250 0x7ffa0815e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:09.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.148+0000 7ffa0ec00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ffa080b6460 con 0x7ffa081623c0 2024-09-12T02:54:09.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.148+0000 7ffa0ec00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ffa080d2ef0 con 0x7ffa080d0370 2024-09-12T02:54:09.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.148+0000 7ffa0ec00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ffa080b65e0 con 0x7ffa080d5250 2024-09-12T02:54:09.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.148+0000 7ffa0ce00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa081623c0 0x7ffa0815dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:09.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.149+0000 7ffa0d800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffa080d0370 0x7ffa080b7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:09.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.149+0000 7ffa0e200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffa080d5250 0x7ffa0815e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:09.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.149+0000 7ffa0ce00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa081623c0 0x7ffa0815dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38994/0 (socket says 172.21.15.112:38994) 2024-09-12T02:54:09.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.149+0000 7ffa0ce00640 1 -- 172.21.15.112:0/2559881438 learned_addr learned my addr 172.21.15.112:0/2559881438 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:54:09.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.149+0000 7ffa0e200640 1 -- 172.21.15.112:0/2559881438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffa080d0370 msgr2=0x7ffa080b7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:09.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.149+0000 7ffa0e200640 1 --2- 172.21.15.112:0/2559881438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffa080d0370 0x7ffa080b7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:09.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.149+0000 7ffa0e200640 1 -- 172.21.15.112:0/2559881438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa081623c0 msgr2=0x7ffa0815dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:09.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.149+0000 7ffa0e200640 1 --2- 172.21.15.112:0/2559881438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa081623c0 0x7ffa0815dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:09.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.149+0000 7ffa0e200640 1 -- 172.21.15.112:0/2559881438 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa0815f1d0 con 0x7ffa080d5250 2024-09-12T02:54:09.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.149+0000 7ffa0ce00640 1 --2- 172.21.15.112:0/2559881438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa081623c0 0x7ffa0815dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:54:09.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.149+0000 7ffa0e200640 1 --2- 172.21.15.112:0/2559881438 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffa080d5250 0x7ffa0815e4f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffa080a2be0 tx=0x7ffa00004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:09.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.150+0000 7ffa05600640 1 -- 172.21.15.112:0/2559881438 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa00042070 con 0x7ffa080d5250 2024-09-12T02:54:09.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.150+0000 7ffa05600640 1 -- 172.21.15.112:0/2559881438 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa00007e80 con 0x7ffa080d5250 2024-09-12T02:54:09.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.150+0000 7ffa05600640 1 -- 172.21.15.112:0/2559881438 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa00037040 con 0x7ffa080d5250 2024-09-12T02:54:09.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.150+0000 7ffa0ec00640 1 -- 172.21.15.112:0/2559881438 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa0815ec10 con 0x7ffa080d5250 2024-09-12T02:54:09.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.150+0000 7ffa0ec00640 1 -- 172.21.15.112:0/2559881438 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa080ce5d0 con 0x7ffa080d5250 2024-09-12T02:54:09.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.151+0000 7ffa0ec00640 1 -- 172.21.15.112:0/2559881438 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa080d57e0 con 0x7ffa080d5250 2024-09-12T02:54:09.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.152+0000 7ffa05600640 1 -- 172.21.15.112:0/2559881438 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffa00003990 con 0x7ffa080d5250 2024-09-12T02:54:09.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.153+0000 7ffa05600640 1 --2- 172.21.15.112:0/2559881438 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff9e806be60 0x7ff9e806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:09.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.153+0000 7ffa05600640 1 -- 172.21.15.112:0/2559881438 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(190..190 src has 1..190) ==== 4943+0+0 (secure 0 0 0) 0x7ffa000ac330 con 0x7ffa080d5250 2024-09-12T02:54:09.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.153+0000 7ffa0d800640 1 --2- 172.21.15.112:0/2559881438 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff9e806be60 0x7ff9e806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:09.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.154+0000 7ffa0d800640 1 --2- 172.21.15.112:0/2559881438 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff9e806be60 0x7ff9e806e320 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ffa081f7b80 tx=0x7ff9fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:09.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.157+0000 7ffa05600640 1 -- 172.21.15.112:0/2559881438 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffa0004c020 con 0x7ffa080d5250 2024-09-12T02:54:09.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.332+0000 7ffa0ec00640 1 -- 172.21.15.112:0/2559881438 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7ffa080ce7a0 con 0x7ffa080d5250 2024-09-12T02:54:09.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.340+0000 7ffa05600640 1 -- 172.21.15.112:0/2559881438 <== mon.2 v2:172.21.15.137:3301/0 7 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ffa00007740 con 0x7ffa080d5250 2024-09-12T02:54:09.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.340+0000 7ffa05600640 1 -- 172.21.15.112:0/2559881438 <== mon.2 v2:172.21.15.137:3301/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v22)=0 v22) ==== 123+0+0 (secure 0 0 0) 0x7ffa0815f1d0 con 0x7ffa080d5250 2024-09-12T02:54:09.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.343+0000 7ffa0ec00640 1 -- 172.21.15.112:0/2559881438 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff9e806be60 msgr2=0x7ff9e806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:09.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.343+0000 7ffa0ec00640 1 --2- 172.21.15.112:0/2559881438 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff9e806be60 0x7ff9e806e320 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ffa081f7b80 tx=0x7ff9fc009040 comp rx=0 tx=0).stop 2024-09-12T02:54:09.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.343+0000 7ffa0ec00640 1 -- 172.21.15.112:0/2559881438 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffa080d5250 msgr2=0x7ffa0815e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:09.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.343+0000 7ffa0ec00640 1 --2- 172.21.15.112:0/2559881438 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffa080d5250 0x7ffa0815e4f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffa080a2be0 tx=0x7ffa00004a40 comp rx=0 tx=0).stop 2024-09-12T02:54:09.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.343+0000 7ffa0ec00640 1 -- 172.21.15.112:0/2559881438 shutdown_connections 2024-09-12T02:54:09.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.343+0000 7ffa0ec00640 1 --2- 172.21.15.112:0/2559881438 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffa080d5250 0x7ffa0815e4f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:09.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.343+0000 7ffa0ec00640 1 --2- 172.21.15.112:0/2559881438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa081623c0 0x7ffa0815dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:09.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.343+0000 7ffa0ec00640 1 --2- 172.21.15.112:0/2559881438 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7ff9e806be60 0x7ff9e806e320 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:09.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.343+0000 7ffa0ec00640 1 --2- 172.21.15.112:0/2559881438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffa080d0370 0x7ffa080b7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:09.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.343+0000 7ffa0ec00640 1 -- 172.21.15.112:0/2559881438 >> 172.21.15.112:0/2559881438 conn(0x7ffa080d4cc0 msgr2=0x7ffa080cf8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:09.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.343+0000 7ffa0ec00640 1 -- 172.21.15.112:0/2559881438 shutdown_connections 2024-09-12T02:54:09.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.343+0000 7ffa0ec00640 1 -- 172.21.15.112:0/2559881438 wait complete. 2024-09-12T02:54:09.360 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:54:09.360 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:54:09.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.511+0000 7f02b4800640 1 Processor -- start 2024-09-12T02:54:09.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.511+0000 7f02b4800640 1 -- start start 2024-09-12T02:54:09.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.512+0000 7f02b4800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02ac071530 0x7f02ac0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:09.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.512+0000 7f02b4800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f02ac071970 0x7f02ac0afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:09.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.513+0000 7f02b4800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02ac0ceeb0 con 0x7f02ac15cc50 2024-09-12T02:54:09.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.513+0000 7f02b4800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f02ac15d030 con 0x7f02ac071970 2024-09-12T02:54:09.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.513+0000 7f02b4800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f02ac0cf4c0 con 0x7f02ac071530 2024-09-12T02:54:09.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.513+0000 7f02b2800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f02ac071970 0x7f02ac0afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:09.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.513+0000 7f02b2800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f02ac071970 0x7f02ac0afc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39002/0 (socket says 172.21.15.112:39002) 2024-09-12T02:54:09.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.513+0000 7f02b2800640 1 -- 172.21.15.112:0/2362879604 learned_addr learned my addr 172.21.15.112:0/2362879604 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:54:09.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.513+0000 7f02b1400640 1 --2- 172.21.15.112:0/2362879604 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02ac071530 0x7f02ac0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:09.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.513+0000 7f02b2800640 1 -- 172.21.15.112:0/2362879604 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02ac071530 msgr2=0x7f02ac0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:09.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.513+0000 7f02b2800640 1 --2- 172.21.15.112:0/2362879604 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02ac071530 0x7f02ac0af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:09.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.513+0000 7f02b2800640 1 -- 172.21.15.112:0/2362879604 >> v1:172.21.15.137:6789/0 conn(0x7f02ac15cc50 legacy=0x7f02ac0732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:09.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.513+0000 7f02b2800640 1 -- 172.21.15.112:0/2362879604 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02ac06e300 con 0x7f02ac071970 2024-09-12T02:54:09.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.514+0000 7f02b2800640 1 --2- 172.21.15.112:0/2362879604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02ac071970 0x7f02ac0afc60 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f02a8009e50 tx=0x7f02a802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccd989b3085bc95b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:09.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.514+0000 7f02b0a00640 1 -- 172.21.15.112:0/2362879604 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a8036070 con 0x7f02ac071970 2024-09-12T02:54:09.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.515+0000 7f02b0a00640 1 -- 172.21.15.112:0/2362879604 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f02a8031600 con 0x7f02ac071970 2024-09-12T02:54:09.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.515+0000 7f02b0a00640 1 -- 172.21.15.112:0/2362879604 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a80319f0 con 0x7f02ac071970 2024-09-12T02:54:09.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.515+0000 7f02b4800640 1 -- 172.21.15.112:0/2362879604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02ac071970 msgr2=0x7f02ac0afc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:09.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.515+0000 7f02b4800640 1 --2- 172.21.15.112:0/2362879604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02ac071970 0x7f02ac0afc60 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f02a8009e50 tx=0x7f02a802a680 comp rx=0 tx=0).stop 2024-09-12T02:54:09.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.515+0000 7f02b4800640 1 -- 172.21.15.112:0/2362879604 shutdown_connections 2024-09-12T02:54:09.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.515+0000 7f02b4800640 1 --2- 172.21.15.112:0/2362879604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02ac071970 0x7f02ac0afc60 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:09.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.515+0000 7f02b4800640 1 --2- 172.21.15.112:0/2362879604 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02ac071530 0x7f02ac0af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:09.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.515+0000 7f02b4800640 1 -- 172.21.15.112:0/2362879604 >> 172.21.15.112:0/2362879604 conn(0x7f02ac06bbd0 msgr2=0x7f02ac06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:09.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.515+0000 7f02b4800640 1 -- 172.21.15.112:0/2362879604 shutdown_connections 2024-09-12T02:54:09.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.515+0000 7f02b4800640 1 -- 172.21.15.112:0/2362879604 wait complete. 2024-09-12T02:54:09.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.517+0000 7f02b4800640 1 Processor -- start 2024-09-12T02:54:09.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.517+0000 7f02b4800640 1 -- start start 2024-09-12T02:54:09.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.518+0000 7f02b4800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02ac071530 0x7f02ac150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:09.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.518+0000 7f02b4800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02ac071970 0x7f02ac1f2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:09.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.518+0000 7f02b4800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02ac15cc50 0x7f02ac1f31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:09.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.518+0000 7f02b4800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f02ac06f510 con 0x7f02ac071970 2024-09-12T02:54:09.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.518+0000 7f02b4800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f02ac0cf150 con 0x7f02ac071530 2024-09-12T02:54:09.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.518+0000 7f02b4800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f02ac06f690 con 0x7f02ac15cc50 2024-09-12T02:54:09.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.518+0000 7f02b1400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02ac071970 0x7f02ac1f2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:09.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.518+0000 7f02b1400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02ac071970 0x7f02ac1f2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39008/0 (socket says 172.21.15.112:39008) 2024-09-12T02:54:09.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.518+0000 7f02b1400640 1 -- 172.21.15.112:0/4069708984 learned_addr learned my addr 172.21.15.112:0/4069708984 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-12T02:54:09.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.518+0000 7f02b1e00640 1 --2- 172.21.15.112:0/4069708984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02ac071530 0x7f02ac150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:09.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.518+0000 7f02b2800640 1 --2- 172.21.15.112:0/4069708984 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02ac15cc50 0x7f02ac1f31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:09.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.518+0000 7f02b1400640 1 -- 172.21.15.112:0/4069708984 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02ac15cc50 msgr2=0x7f02ac1f31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:09.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.518+0000 7f02b1400640 1 --2- 172.21.15.112:0/4069708984 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02ac15cc50 0x7f02ac1f31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:09.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.518+0000 7f02b1400640 1 -- 172.21.15.112:0/4069708984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02ac071530 msgr2=0x7f02ac150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:09.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.518+0000 7f02b1400640 1 --2- 172.21.15.112:0/4069708984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02ac071530 0x7f02ac150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:09.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.518+0000 7f02b1400640 1 -- 172.21.15.112:0/4069708984 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02ac14f060 con 0x7f02ac071970 2024-09-12T02:54:09.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.519+0000 7f02b1400640 1 --2- 172.21.15.112:0/4069708984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02ac071970 0x7f02ac1f2cb0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f029c00d7d0 tx=0x7f029c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:09.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.519+0000 7f02a6000640 1 -- 172.21.15.112:0/4069708984 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f029c004020 con 0x7f02ac071970 2024-09-12T02:54:09.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.519+0000 7f02a6000640 1 -- 172.21.15.112:0/4069708984 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f029c0041c0 con 0x7f02ac071970 2024-09-12T02:54:09.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.519+0000 7f02b4800640 1 -- 172.21.15.112:0/4069708984 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02ac14f340 con 0x7f02ac071970 2024-09-12T02:54:09.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.519+0000 7f02a6000640 1 -- 172.21.15.112:0/4069708984 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f029c0043d0 con 0x7f02ac071970 2024-09-12T02:54:09.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.519+0000 7f02b4800640 1 -- 172.21.15.112:0/4069708984 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02ac14f900 con 0x7f02ac071970 2024-09-12T02:54:09.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.520+0000 7f02b4800640 1 -- 172.21.15.112:0/4069708984 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02ac06df60 con 0x7f02ac071970 2024-09-12T02:54:09.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.521+0000 7f02a6000640 1 -- 172.21.15.112:0/4069708984 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f029c01b020 con 0x7f02ac071970 2024-09-12T02:54:09.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.522+0000 7f02a6000640 1 --2- 172.21.15.112:0/4069708984 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f029006be30 0x7f029006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:09.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.522+0000 7f02a6000640 1 -- 172.21.15.112:0/4069708984 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 4943+0+0 (secure 0 0 0) 0x7f029c08a760 con 0x7f02ac071970 2024-09-12T02:54:09.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.523+0000 7f02b1e00640 1 --2- 172.21.15.112:0/4069708984 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f029006be30 0x7f029006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:09.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.523+0000 7f02b1e00640 1 --2- 172.21.15.112:0/4069708984 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f029006be30 0x7f029006e2f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f02ac155180 tx=0x7f02a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:09.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.527+0000 7f02a6000640 1 -- 172.21.15.112:0/4069708984 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f029c022020 con 0x7f02ac071970 2024-09-12T02:54:09.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.735+0000 7f02b4800640 1 -- 172.21.15.112:0/4069708984 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02ac0d1110 con 0x7f02ac071970 2024-09-12T02:54:09.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.735+0000 7f02a6000640 1 -- 172.21.15.112:0/4069708984 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) ==== 94+0+3914 (secure 0 0 0) 0x7f029c058c90 con 0x7f02ac071970 2024-09-12T02:54:09.737 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-12T02:54:09.737 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":96,"btime":"2024-09-12T02:53:36:308683+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/408518594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":408518594},{"type":"v1","addr":"172.21.15.137:6835","nonce":408518594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":7177,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/119222923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":119222923},{"type":"v1","addr":"172.21.15.112:6837","nonce":119222923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7180,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/691058370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":691058370},{"type":"v1","addr":"172.21.15.137:6834","nonce":691058370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7854,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/1978579863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1978579863},{"type":"v1","addr":"172.21.15.112:6836","nonce":1978579863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[]} 2024-09-12T02:54:09.737 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 96 2024-09-12T02:54:09.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.738+0000 7f02b4800640 1 -- 172.21.15.112:0/4069708984 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f029006be30 msgr2=0x7f029006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:09.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.738+0000 7f02b4800640 1 --2- 172.21.15.112:0/4069708984 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f029006be30 0x7f029006e2f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f02ac155180 tx=0x7f02a0009040 comp rx=0 tx=0).stop 2024-09-12T02:54:09.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.738+0000 7f02b4800640 1 -- 172.21.15.112:0/4069708984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02ac071970 msgr2=0x7f02ac1f2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:09.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.738+0000 7f02b4800640 1 --2- 172.21.15.112:0/4069708984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02ac071970 0x7f02ac1f2cb0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f029c00d7d0 tx=0x7f029c00dc90 comp rx=0 tx=0).stop 2024-09-12T02:54:09.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.738+0000 7f02b4800640 1 -- 172.21.15.112:0/4069708984 shutdown_connections 2024-09-12T02:54:09.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.738+0000 7f02b4800640 1 --2- 172.21.15.112:0/4069708984 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02ac15cc50 0x7f02ac1f31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:09.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.738+0000 7f02b4800640 1 --2- 172.21.15.112:0/4069708984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02ac071970 0x7f02ac1f2cb0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:09.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.738+0000 7f02b4800640 1 --2- 172.21.15.112:0/4069708984 >> [v2:172.21.15.112:6832/3439199466,v1:172.21.15.112:6833/3439199466] conn(0x7f029006be30 0x7f029006e2f0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:09.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.738+0000 7f02b4800640 1 --2- 172.21.15.112:0/4069708984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02ac071530 0x7f02ac150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:09.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.738+0000 7f02b4800640 1 -- 172.21.15.112:0/4069708984 >> 172.21.15.112:0/4069708984 conn(0x7f02ac06bbd0 msgr2=0x7f02ac0732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:09.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.738+0000 7f02b4800640 1 -- 172.21.15.112:0/4069708984 shutdown_connections 2024-09-12T02:54:09.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-12T02:54:09.738+0000 7f02b4800640 1 -- 172.21.15.112:0/4069708984 wait complete. 2024-09-12T02:54:09.754 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-12T02:54:09.755 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T02:54:09.755 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T02:54:09.755 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:54:09.769 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T02:54:09.769 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T02:54:09.769 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:54:09.824 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T02:54:09.824 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T02:54:09.824 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:54:09.843 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T02:54:09.843 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T02:54:09.843 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:54:09.901 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T02:54:09.901 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T02:54:09.901 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T02:54:09.901 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:54:09.941 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T02:54:09.942 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T02:54:09.942 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:54:10.031 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T02:54:10.031 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T02:54:10.031 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:54:10.084 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T02:54:10.085 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T02:54:10.085 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:54:10.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-12T02:54:10.121 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T02:54:10.122 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T02:54:10.122 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:54:10.162 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T02:54:10.162 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T02:54:10.162 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:54:10.240 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T02:54:10.240 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T02:54:10.240 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:54:10.325 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T02:54:10.325 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T02:54:10.325 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:54:10.363 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T02:54:10.363 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T02:54:10.363 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T02:54:10.363 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:54:10.431 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T02:54:10.432 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T02:54:10.432 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:54:10.493 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T02:54:10.494 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T02:54:10.494 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T02:54:10.494 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:54:10.515 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T02:54:10.515 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T02:54:10.516 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:54:10.533 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T02:54:10.534 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T02:54:10.534 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:54:10.594 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T02:54:10.595 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T02:54:10.595 DEBUG:teuthology.orchestra.run.smithi112:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2024-09-12T02:54:10.680 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-12T02:54:10.681 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T02:54:10.983 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-12T02:54:10.984 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T02:54:11.093 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-12T02:54:11.094 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T02:54:11.192 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-12T02:54:11.192 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T02:54:11.317 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T02:54:11.318 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T02:54:11.561 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T02:54:11.561 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T02:54:11.686 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T02:54:11.687 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T02:54:11.848 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T02:54:11.848 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T02:54:11.980 INFO:tasks.ceph:Archiving mon data... 2024-09-12T02:54:11.981 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901635/data/mon.a.tgz 2024-09-12T02:54:11.981 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-09-12T02:54:12.017 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.BXgGxrqxa8 2024-09-12T02:54:12.018 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.BXgGxrqxa8 2024-09-12T02:54:12.218 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.BXgGxrqxa8 2024-09-12T02:54:12.311 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.BXgGxrqxa8 is 458KB 2024-09-12T02:54:12.406 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.BXgGxrqxa8 2024-09-12T02:54:12.440 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901635/data/mon.b.tgz 2024-09-12T02:54:12.440 DEBUG:teuthology.orchestra.run.smithi137:> mktemp 2024-09-12T02:54:12.476 INFO:teuthology.orchestra.run.smithi137.stdout:/tmp/tmp.TnKUbTetdX 2024-09-12T02:54:12.477 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.TnKUbTetdX 2024-09-12T02:54:12.687 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0666 /tmp/tmp.TnKUbTetdX 2024-09-12T02:54:12.780 DEBUG:teuthology.orchestra.remote:smithi137:/tmp/tmp.TnKUbTetdX is 473KB 2024-09-12T02:54:12.875 DEBUG:teuthology.orchestra.run.smithi137:> rm -fr /tmp/tmp.TnKUbTetdX 2024-09-12T02:54:12.910 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901635/data/mon.c.tgz 2024-09-12T02:54:12.911 DEBUG:teuthology.orchestra.run.smithi137:> mktemp 2024-09-12T02:54:12.986 INFO:teuthology.orchestra.run.smithi137.stdout:/tmp/tmp.7Hh5edBM2s 2024-09-12T02:54:12.986 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.7Hh5edBM2s 2024-09-12T02:54:13.179 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0666 /tmp/tmp.7Hh5edBM2s 2024-09-12T02:54:13.276 DEBUG:teuthology.orchestra.remote:smithi137:/tmp/tmp.7Hh5edBM2s is 473KB 2024-09-12T02:54:13.367 DEBUG:teuthology.orchestra.run.smithi137:> rm -fr /tmp/tmp.7Hh5edBM2s 2024-09-12T02:54:13.402 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T02:54:13.402 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T02:54:13.406 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T02:54:13.535 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T02:54:13.570 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T02:54:13.570 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T02:54:13.572 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901635/remote/smithi112/crash 2024-09-12T02:54:13.573 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T02:54:13.632 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901635/remote/smithi137/crash 2024-09-12T02:54:13.633 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T02:54:13.687 INFO:tasks.ceph:Shutting down logrotate 2024-09-12T02:54:13.687 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:54:13.691 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:54:13.783 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-12T02:54:13.837 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-12T02:54:13.893 INFO:tasks.ceph:Compressing logs... 2024-09-12T02:54:13.893 DEBUG:teuthology.orchestra.run.smithi112:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:54:13.897 DEBUG:teuthology.orchestra.run.smithi137:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:54:13.947 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T02:54:13.948 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51863.log 2024-09-12T02:54:13.949 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62809.log 2024-09-12T02:54:13.950 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.51863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53418.log 2024-09-12T02:54:13.950 INFO:teuthology.orchestra.run.smithi112.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51863.log.gz 2024-09-12T02:54:13.951 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.62809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50967.log 2024-09-12T02:54:13.951 INFO:teuthology.orchestra.run.smithi112.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62809.log.gz 2024-09-12T02:54:13.952 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33935.log 2024-09-12T02:54:13.952 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T02:54:13.952 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.0.53418.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.0.53418.log.gz 2024-09-12T02:54:13.953 INFO:teuthology.orchestra.run.smithi112.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45159.log 2024-09-12T02:54:13.953 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.50967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55361.log 2024-09-12T02:54:13.953 INFO:teuthology.orchestra.run.smithi112.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50967.log.gz 2024-09-12T02:54:13.955 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.1.33935.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.1.33935.log.gz -5 2024-09-12T02:54:13.955 INFO:teuthology.orchestra.run.smithi137.stderr: --verbose -- /var/log/ceph/ceph-client.admin.31276.log 2024-09-12T02:54:13.955 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-12T02:54:13.955 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.37616.log 2024-09-12T02:54:13.955 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31276.log.gz 2024-09-12T02:54:13.956 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T02:54:13.956 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.45159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32920.log 2024-09-12T02:54:13.956 INFO:teuthology.orchestra.run.smithi112.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45159.log.gz 2024-09-12T02:54:13.957 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.55361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48988.log 2024-09-12T02:54:13.957 INFO:teuthology.orchestra.run.smithi112.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55361.log.gz 2024-09-12T02:54:13.957 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49620.log 2024-09-12T02:54:13.957 INFO:teuthology.orchestra.run.smithi112.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32920.log.gz 2024-09-12T02:54:13.957 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.48988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36019.log 2024-09-12T02:54:13.957 INFO:teuthology.orchestra.run.smithi112.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48988.log.gz 2024-09-12T02:54:13.957 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.49620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51821.log 2024-09-12T02:54:13.957 INFO:teuthology.orchestra.run.smithi112.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49620.log.gz 2024-09-12T02:54:13.959 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.1.37616.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T02:54:13.959 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.37616.log.gz 2024-09-12T02:54:13.959 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34493.log 2024-09-12T02:54:13.960 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.38183.log 2024-09-12T02:54:13.960 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.1.34493.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34493.log.gz 2024-09-12T02:54:13.960 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31356.log 2024-09-12T02:54:13.960 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.36019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55403.log 2024-09-12T02:54:13.960 INFO:teuthology.orchestra.run.smithi112.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36019.log.gz 2024-09-12T02:54:13.960 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.51821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44861.log 2024-09-12T02:54:13.960 INFO:teuthology.orchestra.run.smithi112.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51821.log.gz 2024-09-12T02:54:13.960 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.55403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48155.log 2024-09-12T02:54:13.960 INFO:teuthology.orchestra.run.smithi112.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55403.log.gz 2024-09-12T02:54:13.963 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.1.38183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.38183.log.gzgzip 2024-09-12T02:54:13.963 INFO:teuthology.orchestra.run.smithi137.stderr: -5 --verbose -- /var/log/ceph/ceph-client.1.36483.log 2024-09-12T02:54:13.963 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31356.log: 94.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T02:54:13.963 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31316.log 2024-09-12T02:54:13.963 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31356.log.gz 2024-09-12T02:54:13.963 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.1.36483.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T02:54:13.963 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.36483.log.gz 2024-09-12T02:54:13.965 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.44861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56267.log 2024-09-12T02:54:13.965 INFO:teuthology.orchestra.run.smithi112.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44861.log.gz 2024-09-12T02:54:13.965 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.48155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55887.log 2024-09-12T02:54:13.965 INFO:teuthology.orchestra.run.smithi112.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48155.log.gz 2024-09-12T02:54:13.965 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.0.56267.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56267.log.gz 2024-09-12T02:54:13.965 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53122.log 2024-09-12T02:54:13.965 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.55887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42325.log 2024-09-12T02:54:13.965 INFO:teuthology.orchestra.run.smithi112.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55887.log.gz 2024-09-12T02:54:13.965 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.53122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41199.log 2024-09-12T02:54:13.966 INFO:teuthology.orchestra.run.smithi112.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53122.log.gz 2024-09-12T02:54:13.966 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.42325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35858.log 2024-09-12T02:54:13.966 INFO:teuthology.orchestra.run.smithi112.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42325.log.gz 2024-09-12T02:54:13.972 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.36996.log 2024-09-12T02:54:13.972 INFO:teuthology.orchestra.run.smithi137.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31316.log.gz 2024-09-12T02:54:13.973 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35507.log 2024-09-12T02:54:13.973 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.1.36996.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33443.log 2024-09-12T02:54:13.973 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.1.36996.log.gz 2024-09-12T02:54:13.973 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.1.35507.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35507.log.gz 2024-09-12T02:54:13.973 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T02:54:13.973 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.1.33443.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.1.32414.log 2024-09-12T02:54:13.973 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.1.33443.log.gz 2024-09-12T02:54:13.973 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35008.log 2024-09-12T02:54:13.973 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.1.32414.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T02:54:13.974 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.1.32414.log.gz 2024-09-12T02:54:13.974 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.1.35008.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35008.log.gz 2024-09-12T02:54:13.976 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.41199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38034.log 2024-09-12T02:54:13.976 INFO:teuthology.orchestra.run.smithi112.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41199.log.gz 2024-09-12T02:54:13.976 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.35858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36953.log 2024-09-12T02:54:13.976 INFO:teuthology.orchestra.run.smithi112.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35858.log.gz 2024-09-12T02:54:13.976 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.38034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58588.log 2024-09-12T02:54:13.976 INFO:teuthology.orchestra.run.smithi112.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38034.log.gz 2024-09-12T02:54:13.976 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.36953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55719.log 2024-09-12T02:54:13.976 INFO:teuthology.orchestra.run.smithi112.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36953.log.gz 2024-09-12T02:54:13.977 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.0.58588.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58588.log.gz 2024-09-12T02:54:13.977 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44819.log 2024-09-12T02:54:13.977 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.55719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59369.log 2024-09-12T02:54:13.977 INFO:teuthology.orchestra.run.smithi112.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55719.log.gz 2024-09-12T02:54:13.977 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.44819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61161.log 2024-09-12T02:54:13.977 INFO:teuthology.orchestra.run.smithi112.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44819.log.gz 2024-09-12T02:54:13.977 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54851.log 2024-09-12T02:54:13.977 INFO:teuthology.orchestra.run.smithi112.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59369.log.gz 2024-09-12T02:54:13.977 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.61161.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.61161.log.gz -5 2024-09-12T02:54:13.977 INFO:teuthology.orchestra.run.smithi112.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50265.log 2024-09-12T02:54:13.977 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.54851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60530.log 2024-09-12T02:54:13.977 INFO:teuthology.orchestra.run.smithi112.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54851.log.gz 2024-09-12T02:54:13.977 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.50265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36187.log 2024-09-12T02:54:13.978 INFO:teuthology.orchestra.run.smithi112.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50265.log.gz 2024-09-12T02:54:13.978 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.60530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48862.log 2024-09-12T02:54:13.978 INFO:teuthology.orchestra.run.smithi112.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60530.log.gz 2024-09-12T02:54:13.978 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.36187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56795.log 89.1% 2024-09-12T02:54:13.978 INFO:teuthology.orchestra.run.smithi112.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36187.log.gz 2024-09-12T02:54:13.980 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T02:54:13.980 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31567.log 2024-09-12T02:54:13.980 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-12T02:54:13.980 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31567.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T02:54:13.980 INFO:teuthology.orchestra.run.smithi137.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31567.log.gz 2024-09-12T02:54:13.982 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.48862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57854.log 2024-09-12T02:54:13.982 INFO:teuthology.orchestra.run.smithi112.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48862.log.gz 2024-09-12T02:54:13.982 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.56795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32626.log 2024-09-12T02:54:13.982 INFO:teuthology.orchestra.run.smithi112.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56795.log.gz 2024-09-12T02:54:13.982 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44297.log 2024-09-12T02:54:13.983 INFO:teuthology.orchestra.run.smithi112.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57854.log.gz 2024-09-12T02:54:13.983 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32626.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32626.log.gz 2024-09-12T02:54:13.983 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62186.log 2024-09-12T02:54:13.983 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.44297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32497.log 2024-09-12T02:54:13.983 INFO:teuthology.orchestra.run.smithi112.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44297.log.gz 2024-09-12T02:54:13.983 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.62186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33688.log 2024-09-12T02:54:13.983 INFO:teuthology.orchestra.run.smithi112.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62186.log.gz 2024-09-12T02:54:13.983 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49700.log 2024-09-12T02:54:13.984 INFO:teuthology.orchestra.run.smithi112.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32497.log.gz 2024-09-12T02:54:13.988 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-mds.d.log: 92.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T02:54:13.988 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31487.log 2024-09-12T02:54:13.988 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.31487.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.31487.log.gz 2024-09-12T02:54:13.988 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31447.log 2024-09-12T02:54:13.989 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47826.log 2024-09-12T02:54:13.989 INFO:teuthology.orchestra.run.smithi112.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33688.log.gz 2024-09-12T02:54:13.989 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.49700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40486.log 2024-09-12T02:54:13.989 INFO:teuthology.orchestra.run.smithi112.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49700.log.gz 2024-09-12T02:54:13.989 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.47826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35768.log 2024-09-12T02:54:13.989 INFO:teuthology.orchestra.run.smithi112.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47826.log.gz 2024-09-12T02:54:13.989 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.40486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53948.log 2024-09-12T02:54:13.990 INFO:teuthology.orchestra.run.smithi112.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40486.log.gz 2024-09-12T02:54:13.990 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.35768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50349.log 2024-09-12T02:54:13.990 INFO:teuthology.orchestra.run.smithi112.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35768.log.gz 2024-09-12T02:54:13.990 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.53948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47153.log 2024-09-12T02:54:13.990 INFO:teuthology.orchestra.run.smithi112.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53948.log.gz 2024-09-12T02:54:13.990 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.50349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38743.log 2024-09-12T02:54:13.990 INFO:teuthology.orchestra.run.smithi112.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.50349.log.gz 2024-09-12T02:54:13.990 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.47153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54622.log 2024-09-12T02:54:13.990 INFO:teuthology.orchestra.run.smithi112.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47153.log.gz 2024-09-12T02:54:13.996 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31396.log 2024-09-12T02:54:13.996 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31396.log: /var/log/ceph/ceph-client.admin.31447.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T02:54:13.996 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31447.log.gz 92.8% 2024-09-12T02:54:13.996 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-12T02:54:13.996 INFO:teuthology.orchestra.run.smithi137.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.31396.log.gz 2024-09-12T02:54:13.996 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.32847.log 2024-09-12T02:54:13.997 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.38743.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38743.log.gz 2024-09-12T02:54:13.997 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57998.log 2024-09-12T02:54:13.997 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.54622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61934.log 2024-09-12T02:54:13.998 INFO:teuthology.orchestra.run.smithi112.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54622.log.gz 2024-09-12T02:54:13.998 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43940.log 2024-09-12T02:54:13.998 INFO:teuthology.orchestra.run.smithi112.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57998.log.gz 2024-09-12T02:54:13.998 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.61934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33353.log 2024-09-12T02:54:13.998 INFO:teuthology.orchestra.run.smithi112.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61934.log.gz 2024-09-12T02:54:13.998 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.43940.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43940.log.gz 2024-09-12T02:54:13.998 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62588.log 2024-09-12T02:54:13.998 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52348.log 2024-09-12T02:54:13.998 INFO:teuthology.orchestra.run.smithi112.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33353.log.gz 2024-09-12T02:54:13.998 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.62588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54496.log 2024-09-12T02:54:13.998 INFO:teuthology.orchestra.run.smithi112.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62588.log.gz 2024-09-12T02:54:13.998 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.52348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57215.log 2024-09-12T02:54:13.998 INFO:teuthology.orchestra.run.smithi112.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52348.log.gz 2024-09-12T02:54:13.999 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.54496.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54496.log.gz 2024-09-12T02:54:13.999 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47409.log 2024-09-12T02:54:13.999 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59579.log 2024-09-12T02:54:13.999 INFO:teuthology.orchestra.run.smithi112.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57215.log.gz 2024-09-12T02:54:14.002 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.3.32847.log: /var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.36004.log 2024-09-12T02:54:14.002 INFO:teuthology.orchestra.run.smithi137.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T02:54:14.002 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.32847.log.gz 2024-09-12T02:54:14.003 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.47409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52655.log 2024-09-12T02:54:14.003 INFO:teuthology.orchestra.run.smithi112.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47409.log.gz 2024-09-12T02:54:14.003 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55677.log 2024-09-12T02:54:14.003 INFO:teuthology.orchestra.run.smithi112.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59579.log.gz 2024-09-12T02:54:14.003 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.52655.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.52655.log.gz 2024-09-12T02:54:14.003 INFO:teuthology.orchestra.run.smithi112.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50415.log 2024-09-12T02:54:14.003 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.55677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61323.log 2024-09-12T02:54:14.003 INFO:teuthology.orchestra.run.smithi112.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55677.log.gz 2024-09-12T02:54:14.003 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.50415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39943.log 2024-09-12T02:54:14.003 INFO:teuthology.orchestra.run.smithi112.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50415.log.gz 2024-09-12T02:54:14.004 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.61323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32962.log 2024-09-12T02:54:14.004 INFO:teuthology.orchestra.run.smithi112.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61323.log.gz 2024-09-12T02:54:14.004 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31527.log 2024-09-12T02:54:14.005 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.1.36004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.36004.log.gz 2024-09-12T02:54:14.006 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.39943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60152.log 2024-09-12T02:54:14.006 INFO:teuthology.orchestra.run.smithi112.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39943.log.gz 2024-09-12T02:54:14.006 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57724.log 2024-09-12T02:54:14.006 INFO:teuthology.orchestra.run.smithi112.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32962.log.gz 2024-09-12T02:54:14.006 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.60152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47111.log 2024-09-12T02:54:14.006 INFO:teuthology.orchestra.run.smithi112.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60152.log.gz 2024-09-12T02:54:14.006 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62851.log 2024-09-12T02:54:14.006 INFO:teuthology.orchestra.run.smithi112.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57724.log.gz 2024-09-12T02:54:14.007 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31527.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31527.log.gz 2024-09-12T02:54:14.008 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.47111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54706.log 2024-09-12T02:54:14.008 INFO:teuthology.orchestra.run.smithi112.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47111.log.gz 2024-09-12T02:54:14.008 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.62851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54664.log 2024-09-12T02:54:14.008 INFO:teuthology.orchestra.run.smithi112.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62851.log.gz 2024-09-12T02:54:14.009 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.54706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63355.log 2024-09-12T02:54:14.009 INFO:teuthology.orchestra.run.smithi112.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54706.log.gz 2024-09-12T02:54:14.009 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.54664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51779.log 2024-09-12T02:54:14.010 INFO:teuthology.orchestra.run.smithi112.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54664.log.gz 2024-09-12T02:54:14.010 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.63355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59075.log 2024-09-12T02:54:14.011 INFO:teuthology.orchestra.run.smithi112.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63355.log.gz 2024-09-12T02:54:14.011 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.51779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42549.log 2024-09-12T02:54:14.011 INFO:teuthology.orchestra.run.smithi112.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51779.log.gz 2024-09-12T02:54:14.012 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54396.log 2024-09-12T02:54:14.012 INFO:teuthology.orchestra.run.smithi112.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59075.log.gz 2024-09-12T02:54:14.013 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.42549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49874.log 2024-09-12T02:54:14.013 INFO:teuthology.orchestra.run.smithi112.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42549.log.gz 2024-09-12T02:54:14.014 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.54396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62682.log 2024-09-12T02:54:14.014 INFO:teuthology.orchestra.run.smithi112.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54396.log.gz 2024-09-12T02:54:14.015 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.49874.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49874.log.gz 2024-09-12T02:54:14.015 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55199.log 2024-09-12T02:54:14.015 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.62682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38575.log 2024-09-12T02:54:14.016 INFO:teuthology.orchestra.run.smithi112.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62682.log.gz 2024-09-12T02:54:14.016 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.55199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42763.log 2024-09-12T02:54:14.017 INFO:teuthology.orchestra.run.smithi112.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55199.log.gz 2024-09-12T02:54:14.017 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.38575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63539.log 2024-09-12T02:54:14.017 INFO:teuthology.orchestra.run.smithi112.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38575.log.gz 2024-09-12T02:54:14.018 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.42763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44991.log 2024-09-12T02:54:14.018 INFO:teuthology.orchestra.run.smithi112.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42763.log.gz 2024-09-12T02:54:14.019 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.63539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46232.log 2024-09-12T02:54:14.019 INFO:teuthology.orchestra.run.smithi112.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63539.log.gz 2024-09-12T02:54:14.020 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.44991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56388.log 2024-09-12T02:54:14.020 INFO:teuthology.orchestra.run.smithi112.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44991.log.gz 2024-09-12T02:54:14.021 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.46232.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T02:54:14.021 INFO:teuthology.orchestra.run.smithi112.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46232.log.gz 2024-09-12T02:54:14.022 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.56388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32710.log 2024-09-12T02:54:14.022 INFO:teuthology.orchestra.run.smithi112.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56388.log.gz 2024-09-12T02:54:14.022 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46401.log 2024-09-12T02:54:14.023 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61281.log 2024-09-12T02:54:14.023 INFO:teuthology.orchestra.run.smithi112.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32710.log.gz 2024-09-12T02:54:14.024 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.46401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45033.log 2024-09-12T02:54:14.025 INFO:teuthology.orchestra.run.smithi112.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46401.log.gz 2024-09-12T02:54:14.025 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.61281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33347.log 2024-09-12T02:54:14.026 INFO:teuthology.orchestra.run.smithi112.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61281.log.gz 2024-09-12T02:54:14.026 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.45033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58250.log 2024-09-12T02:54:14.027 INFO:teuthology.orchestra.run.smithi112.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45033.log.gz 2024-09-12T02:54:14.027 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54978.log 2024-09-12T02:54:14.028 INFO:teuthology.orchestra.run.smithi112.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33347.log.gz 2024-09-12T02:54:14.028 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.58250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60320.log 2024-09-12T02:54:14.029 INFO:teuthology.orchestra.run.smithi112.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58250.log.gz 2024-09-12T02:54:14.030 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.54978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59705.log 2024-09-12T02:54:14.030 INFO:teuthology.orchestra.run.smithi112.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54978.log.gz 2024-09-12T02:54:14.031 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.60320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61627.log 2024-09-12T02:54:14.031 INFO:teuthology.orchestra.run.smithi112.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60320.log.gz 2024-09-12T02:54:14.032 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59705.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59705.log.gz 2024-09-12T02:54:14.032 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34138.log 2024-09-12T02:54:14.032 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.61627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47325.log 2024-09-12T02:54:14.033 INFO:teuthology.orchestra.run.smithi112.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.61627.log.gz 2024-09-12T02:54:14.034 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34138.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34138.log.gz 2024-09-12T02:54:14.034 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44596.log 2024-09-12T02:54:14.035 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.47325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39901.log 2024-09-12T02:54:14.035 INFO:teuthology.orchestra.run.smithi112.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47325.log.gz 2024-09-12T02:54:14.036 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.44596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61441.log 2024-09-12T02:54:14.036 INFO:teuthology.orchestra.run.smithi112.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44596.log.gz 2024-09-12T02:54:14.037 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.39901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51424.log 2024-09-12T02:54:14.037 INFO:teuthology.orchestra.run.smithi112.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39901.log.gz 2024-09-12T02:54:14.038 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.61441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53164.log 2024-09-12T02:54:14.038 INFO:teuthology.orchestra.run.smithi112.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61441.log.gz 2024-09-12T02:54:14.039 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.51424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52031.log 2024-09-12T02:54:14.039 INFO:teuthology.orchestra.run.smithi112.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51424.log.gz 2024-09-12T02:54:14.040 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.53164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48326.log 2024-09-12T02:54:14.040 INFO:teuthology.orchestra.run.smithi112.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.53164.log.gz 2024-09-12T02:54:14.041 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.52031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51989.log 2024-09-12T02:54:14.041 INFO:teuthology.orchestra.run.smithi112.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52031.log.gz 2024-09-12T02:54:14.042 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.48326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41587.log 2024-09-12T02:54:14.042 INFO:teuthology.orchestra.run.smithi112.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48326.log.gz 2024-09-12T02:54:14.043 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.51989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63187.log 2024-09-12T02:54:14.043 INFO:teuthology.orchestra.run.smithi112.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51989.log.gz 2024-09-12T02:54:14.044 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.41587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52432.log 87.3% 2024-09-12T02:54:14.044 INFO:teuthology.orchestra.run.smithi112.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41587.log.gz 2024-09-12T02:54:14.045 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.63187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55575.log 2024-09-12T02:54:14.045 INFO:teuthology.orchestra.run.smithi112.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.63187.log.gz 2024-09-12T02:54:14.046 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.52432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45534.log 2024-09-12T02:54:14.047 INFO:teuthology.orchestra.run.smithi112.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52432.log.gz 2024-09-12T02:54:14.047 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.55575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50925.log 2024-09-12T02:54:14.047 INFO:teuthology.orchestra.run.smithi112.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55575.log.gz 2024-09-12T02:54:14.048 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.45534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45201.log 2024-09-12T02:54:14.048 INFO:teuthology.orchestra.run.smithi112.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45534.log.gz 2024-09-12T02:54:14.050 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.50925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41053.log 2024-09-12T02:54:14.050 INFO:teuthology.orchestra.run.smithi112.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50925.log.gz 2024-09-12T02:54:14.050 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.45201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38617.log 2024-09-12T02:54:14.051 INFO:teuthology.orchestra.run.smithi112.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.45201.log.gz 2024-09-12T02:54:14.051 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.41053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43628.log 2024-09-12T02:54:14.052 INFO:teuthology.orchestra.run.smithi112.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41053.log.gz 2024-09-12T02:54:14.052 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.38617.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38617.log.gz 2024-09-12T02:54:14.053 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43754.log 2024-09-12T02:54:14.053 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.43628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51508.log 2024-09-12T02:54:14.054 INFO:teuthology.orchestra.run.smithi112.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43628.log.gz 2024-09-12T02:54:14.055 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.43754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49830.log 2024-09-12T02:54:14.055 INFO:teuthology.orchestra.run.smithi112.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43754.log.gz 2024-09-12T02:54:14.056 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.51508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57173.log 2024-09-12T02:54:14.056 INFO:teuthology.orchestra.run.smithi112.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51508.log.gz 2024-09-12T02:54:14.057 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.49830.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49830.log.gz 2024-09-12T02:54:14.057 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61834.log 2024-09-12T02:54:14.057 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59327.log 2024-09-12T02:54:14.058 INFO:teuthology.orchestra.run.smithi112.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.57173.log.gz 2024-09-12T02:54:14.059 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.61834.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61834.log.gz 2024-09-12T02:54:14.059 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46317.log 2024-09-12T02:54:14.060 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34809.log 2024-09-12T02:54:14.060 INFO:teuthology.orchestra.run.smithi112.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59327.log.gz 2024-09-12T02:54:14.061 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.46317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45766.log 2024-09-12T02:54:14.061 INFO:teuthology.orchestra.run.smithi112.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46317.log.gz 2024-09-12T02:54:14.062 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.35113.log 2024-09-12T02:54:14.062 INFO:teuthology.orchestra.run.smithi112.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34809.log.gz 2024-09-12T02:54:14.063 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.45766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38533.log 2024-09-12T02:54:14.063 INFO:teuthology.orchestra.run.smithi112.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45766.log.gz 2024-09-12T02:54:14.064 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.2.35113.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.35113.log.gz 2024-09-12T02:54:14.064 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54936.log 2024-09-12T02:54:14.065 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.38533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43880.log 2024-09-12T02:54:14.065 INFO:teuthology.orchestra.run.smithi112.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38533.log.gz 2024-09-12T02:54:14.065 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.54936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38701.log 2024-09-12T02:54:14.066 INFO:teuthology.orchestra.run.smithi112.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54936.log.gz 2024-09-12T02:54:14.067 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.43880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46485.log 2024-09-12T02:54:14.067 INFO:teuthology.orchestra.run.smithi112.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43880.log.gz 2024-09-12T02:54:14.068 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.38701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50307.log 2024-09-12T02:54:14.068 INFO:teuthology.orchestra.run.smithi112.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38701.log.gz 2024-09-12T02:54:14.068 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.46485.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46485.log.gz 2024-09-12T02:54:14.069 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33046.log 2024-09-12T02:54:14.069 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.50307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33340.log 2024-09-12T02:54:14.069 INFO:teuthology.orchestra.run.smithi112.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50307.log.gz 2024-09-12T02:54:14.070 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33046.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33046.log.gz 2024-09-12T02:54:14.070 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44151.log 2024-09-12T02:54:14.071 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49540.log 2024-09-12T02:54:14.071 INFO:teuthology.orchestra.run.smithi112.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33340.log.gz 2024-09-12T02:54:14.072 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.44151.log: gzip -5 --verbose 88.2% -- -- replaced with /var/log/ceph/ceph-client.admin.44151.log.gz /var/log/ceph/ceph-client.admin.60948.log 2024-09-12T02:54:14.072 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-12T02:54:14.073 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.49540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60278.log 2024-09-12T02:54:14.073 INFO:teuthology.orchestra.run.smithi112.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49540.log.gz 2024-09-12T02:54:14.074 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.60948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52701.log 2024-09-12T02:54:14.074 INFO:teuthology.orchestra.run.smithi112.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60948.log.gz 2024-09-12T02:54:14.075 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.60278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42160.log 2024-09-12T02:54:14.075 INFO:teuthology.orchestra.run.smithi112.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60278.log.gz 2024-09-12T02:54:14.076 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.52701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42465.log 2024-09-12T02:54:14.076 INFO:teuthology.orchestra.run.smithi112.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52701.log.gz 2024-09-12T02:54:14.076 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.42160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57600.log 2024-09-12T02:54:14.077 INFO:teuthology.orchestra.run.smithi112.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42160.log.gz 2024-09-12T02:54:14.077 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.42465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48494.log 2024-09-12T02:54:14.078 INFO:teuthology.orchestra.run.smithi112.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42465.log.gz 2024-09-12T02:54:14.078 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60004.log 2024-09-12T02:54:14.078 INFO:teuthology.orchestra.run.smithi112.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57600.log.gz 2024-09-12T02:54:14.079 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.48494.log: gzip -5 --verbose -- 87.9% /var/log/ceph/ceph-client.admin.48080.log -- replaced with /var/log/ceph/ceph-client.admin.48494.log.gz 2024-09-12T02:54:14.079 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-12T02:54:14.080 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.60004.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60004.log.gz 2024-09-12T02:54:14.080 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37446.log 2024-09-12T02:54:14.081 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.48080.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48080.log.gz 2024-09-12T02:54:14.081 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54893.log 2024-09-12T02:54:14.082 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.37446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57520.log 2024-09-12T02:54:14.083 INFO:teuthology.orchestra.run.smithi112.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.37446.log.gz 2024-09-12T02:54:14.084 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.54893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42847.log 2024-09-12T02:54:14.084 INFO:teuthology.orchestra.run.smithi112.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54893.log.gz 2024-09-12T02:54:14.084 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55489.log 2024-09-12T02:54:14.085 INFO:teuthology.orchestra.run.smithi112.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57520.log.gz 2024-09-12T02:54:14.085 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.42847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61756.log 88.7% 2024-09-12T02:54:14.085 INFO:teuthology.orchestra.run.smithi112.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42847.log.gz 2024-09-12T02:54:14.086 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.55489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61399.log 2024-09-12T02:54:14.086 INFO:teuthology.orchestra.run.smithi112.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55489.log.gz 2024-09-12T02:54:14.087 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.61756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34180.log 2024-09-12T02:54:14.087 INFO:teuthology.orchestra.run.smithi112.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61756.log.gz 2024-09-12T02:54:14.088 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.61399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61203.log 2024-09-12T02:54:14.088 INFO:teuthology.orchestra.run.smithi112.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61399.log.gz 2024-09-12T02:54:14.089 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40733.log 2024-09-12T02:54:14.089 INFO:teuthology.orchestra.run.smithi112.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.34180.log.gz 2024-09-12T02:54:14.090 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.61203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45962.log 2024-09-12T02:54:14.090 INFO:teuthology.orchestra.run.smithi112.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.61203.log.gz 2024-09-12T02:54:14.091 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.40733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60404.log 2024-09-12T02:54:14.091 INFO:teuthology.orchestra.run.smithi112.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40733.log.gz 2024-09-12T02:54:14.092 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.45962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55971.log 2024-09-12T02:54:14.092 INFO:teuthology.orchestra.run.smithi112.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45962.log.gz 2024-09-12T02:54:14.093 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.60404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41755.log 2024-09-12T02:54:14.093 INFO:teuthology.orchestra.run.smithi112.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60404.log.gz 2024-09-12T02:54:14.093 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.55971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47199.log 2024-09-12T02:54:14.093 INFO:teuthology.orchestra.run.smithi112.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55971.log.gz 2024-09-12T02:54:14.094 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.41755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32542.log 2024-09-12T02:54:14.094 INFO:teuthology.orchestra.run.smithi112.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41755.log.gz 2024-09-12T02:54:14.095 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.47199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57005.log 2024-09-12T02:54:14.095 INFO:teuthology.orchestra.run.smithi112.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47199.log.gz 2024-09-12T02:54:14.096 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53230.log 2024-09-12T02:54:14.096 INFO:teuthology.orchestra.run.smithi112.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32542.log.gz 2024-09-12T02:54:14.097 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61032.log 2024-09-12T02:54:14.097 INFO:teuthology.orchestra.run.smithi112.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57005.log.gz 2024-09-12T02:54:14.098 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.53230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52520.log 2024-09-12T02:54:14.098 INFO:teuthology.orchestra.run.smithi112.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53230.log.gz 2024-09-12T02:54:14.099 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.61032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33344.log 2024-09-12T02:54:14.099 INFO:teuthology.orchestra.run.smithi112.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61032.log.gz 2024-09-12T02:54:14.100 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.52520.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52520.log.gz 2024-09-12T02:54:14.100 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51592.log 2024-09-12T02:54:14.101 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36571.log 2024-09-12T02:54:14.101 INFO:teuthology.orchestra.run.smithi112.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33344.log.gz 2024-09-12T02:54:14.102 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.51592.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.51592.log.gz 2024-09-12T02:54:14.102 INFO:teuthology.orchestra.run.smithi112.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.43143.log 2024-09-12T02:54:14.103 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.36571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42283.log 2024-09-12T02:54:14.103 INFO:teuthology.orchestra.run.smithi112.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36571.log.gz 2024-09-12T02:54:14.103 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.0.43143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43143.log.gz 2024-09-12T02:54:14.103 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49217.log 2024-09-12T02:54:14.105 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.42283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44726.log 2024-09-12T02:54:14.105 INFO:teuthology.orchestra.run.smithi112.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42283.log.gz 2024-09-12T02:54:14.105 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.49217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62312.log 2024-09-12T02:54:14.105 INFO:teuthology.orchestra.run.smithi112.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49217.log.gz 2024-09-12T02:54:14.106 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.44726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47283.log 2024-09-12T02:54:14.106 INFO:teuthology.orchestra.run.smithi112.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44726.log.gz 2024-09-12T02:54:14.107 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.62312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46088.log 2024-09-12T02:54:14.107 INFO:teuthology.orchestra.run.smithi112.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62312.log.gz 2024-09-12T02:54:14.108 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.47283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61501.log 2024-09-12T02:54:14.108 INFO:teuthology.orchestra.run.smithi112.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47283.log.gz 2024-09-12T02:54:14.109 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.46088.log: gzip -5 88.3% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.46088.log.gz 2024-09-12T02:54:14.109 INFO:teuthology.orchestra.run.smithi112.stderr: /var/log/ceph/ceph-client.admin.59537.log 2024-09-12T02:54:14.110 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.61501.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.61501.log.gz 2024-09-12T02:54:14.110 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36909.log 2024-09-12T02:54:14.111 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41923.log 2024-09-12T02:54:14.111 INFO:teuthology.orchestra.run.smithi112.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59537.log.gz 2024-09-12T02:54:14.112 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.36909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40775.log 2024-09-12T02:54:14.112 INFO:teuthology.orchestra.run.smithi112.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36909.log.gz 2024-09-12T02:54:14.113 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.41923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47747.log 2024-09-12T02:54:14.113 INFO:teuthology.orchestra.run.smithi112.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41923.log.gz 2024-09-12T02:54:14.113 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.40775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48410.log 2024-09-12T02:54:14.114 INFO:teuthology.orchestra.run.smithi112.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40775.log.gz 2024-09-12T02:54:14.114 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.0.47747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47747.log.gz 2024-09-12T02:54:14.115 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37992.log 2024-09-12T02:54:14.115 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.48410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48197.log 2024-09-12T02:54:14.115 INFO:teuthology.orchestra.run.smithi112.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48410.log.gz 2024-09-12T02:54:14.116 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.37992.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37992.log.gz 2024-09-12T02:54:14.116 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60446.log 2024-09-12T02:54:14.117 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.48197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58939.log 2024-09-12T02:54:14.117 INFO:teuthology.orchestra.run.smithi112.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48197.log.gz 2024-09-12T02:54:14.118 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.60446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43222.log 2024-09-12T02:54:14.118 INFO:teuthology.orchestra.run.smithi112.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60446.log.gz 2024-09-12T02:54:14.119 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.58939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39673.log 2024-09-12T02:54:14.119 INFO:teuthology.orchestra.run.smithi112.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58939.log.gz 2024-09-12T02:54:14.120 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.43222.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.43222.log.gz 2024-09-12T02:54:14.120 INFO:teuthology.orchestra.run.smithi112.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56013.log 2024-09-12T02:54:14.121 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.39673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33682.log 88.2% 2024-09-12T02:54:14.121 INFO:teuthology.orchestra.run.smithi112.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39673.log.gz 2024-09-12T02:54:14.122 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.56013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39799.log 2024-09-12T02:54:14.122 INFO:teuthology.orchestra.run.smithi112.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.56013.log.gz 2024-09-12T02:54:14.123 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42679.log 2024-09-12T02:54:14.123 INFO:teuthology.orchestra.run.smithi112.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33682.log.gz 2024-09-12T02:54:14.124 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.39799.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39799.log.gz 2024-09-12T02:54:14.124 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48720.log 2024-09-12T02:54:14.125 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.42679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61543.log 2024-09-12T02:54:14.125 INFO:teuthology.orchestra.run.smithi112.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42679.log.gz 2024-09-12T02:54:14.126 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.48720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36697.log 2024-09-12T02:54:14.126 INFO:teuthology.orchestra.run.smithi112.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48720.log.gz 2024-09-12T02:54:14.127 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.61543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46275.log 2024-09-12T02:54:14.127 INFO:teuthology.orchestra.run.smithi112.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61543.log.gz 2024-09-12T02:54:14.127 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.36697.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T02:54:14.128 INFO:teuthology.orchestra.run.smithi112.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36697.log.gz 2024-09-12T02:54:14.128 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.46275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37046.log 2024-09-12T02:54:14.129 INFO:teuthology.orchestra.run.smithi112.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46275.log.gz 2024-09-12T02:54:14.129 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35289.log 2024-09-12T02:54:14.131 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.37046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39841.log 2024-09-12T02:54:14.131 INFO:teuthology.orchestra.run.smithi112.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37046.log.gz 2024-09-12T02:54:14.132 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.35289.log: 89.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T02:54:14.132 INFO:teuthology.orchestra.run.smithi112.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35289.log.gz 2024-09-12T02:54:14.132 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33677.log 2024-09-12T02:54:14.133 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.39841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35247.log 2024-09-12T02:54:14.133 INFO:teuthology.orchestra.run.smithi112.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39841.log.gz 2024-09-12T02:54:14.134 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37404.log 2024-09-12T02:54:14.134 INFO:teuthology.orchestra.run.smithi112.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33677.log.gz 2024-09-12T02:54:14.134 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.35247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37176.log 89.6% 2024-09-12T02:54:14.135 INFO:teuthology.orchestra.run.smithi112.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35247.log.gz 2024-09-12T02:54:14.136 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.37404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33689.log 2024-09-12T02:54:14.136 INFO:teuthology.orchestra.run.smithi112.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37404.log.gz 2024-09-12T02:54:14.136 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.37176.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.37176.log.gz 2024-09-12T02:54:14.136 INFO:teuthology.orchestra.run.smithi112.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40069.log 2024-09-12T02:54:14.137 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32351.log 2024-09-12T02:54:14.137 INFO:teuthology.orchestra.run.smithi112.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33689.log.gz 2024-09-12T02:54:14.138 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.40069.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40069.log.gz 2024-09-12T02:54:14.138 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44907.log 2024-09-12T02:54:14.139 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40658.log 2024-09-12T02:54:14.139 INFO:teuthology.orchestra.run.smithi112.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32351.log.gz 2024-09-12T02:54:14.140 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.44907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33667.log 2024-09-12T02:54:14.140 INFO:teuthology.orchestra.run.smithi112.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44907.log.gz 2024-09-12T02:54:14.141 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.40658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41881.log 2024-09-12T02:54:14.141 INFO:teuthology.orchestra.run.smithi112.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40658.log.gz 2024-09-12T02:54:14.142 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33667.log: gzip -5 --verbose -- 88.7% /var/log/ceph/ceph-client.admin.44109.log -- replaced with /var/log/ceph/ceph-client.admin.33667.log.gz 2024-09-12T02:54:14.142 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-12T02:54:14.143 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.41881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43670.log 2024-09-12T02:54:14.143 INFO:teuthology.orchestra.run.smithi112.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41881.log.gz 2024-09-12T02:54:14.144 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.44109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52995.log 2024-09-12T02:54:14.144 INFO:teuthology.orchestra.run.smithi112.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44109.log.gz 2024-09-12T02:54:14.145 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.43670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40365.log 2024-09-12T02:54:14.145 INFO:teuthology.orchestra.run.smithi112.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43670.log.gz 2024-09-12T02:54:14.145 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.52995.log: gzip -5 --verbose 87.4% -- -- replaced with /var/log/ceph/ceph-client.admin.52995.log.gz 2024-09-12T02:54:14.146 INFO:teuthology.orchestra.run.smithi112.stderr: /var/log/ceph/ceph-client.admin.40111.log 2024-09-12T02:54:14.146 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.0.40365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.40365.log.gz 2024-09-12T02:54:14.147 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60572.log 2024-09-12T02:54:14.148 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.40111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36271.log 2024-09-12T02:54:14.148 INFO:teuthology.orchestra.run.smithi112.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.40111.log.gz 2024-09-12T02:54:14.149 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.60572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44682.log 2024-09-12T02:54:14.149 INFO:teuthology.orchestra.run.smithi112.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60572.log.gz 2024-09-12T02:54:14.149 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.36271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57257.log 2024-09-12T02:54:14.150 INFO:teuthology.orchestra.run.smithi112.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36271.log.gz 2024-09-12T02:54:14.150 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.44682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35935.log 2024-09-12T02:54:14.151 INFO:teuthology.orchestra.run.smithi112.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44682.log.gz 2024-09-12T02:54:14.151 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33004.log 2024-09-12T02:54:14.152 INFO:teuthology.orchestra.run.smithi112.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57257.log.gz 2024-09-12T02:54:14.152 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.35935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54766.log 2024-09-12T02:54:14.152 INFO:teuthology.orchestra.run.smithi112.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35935.log.gz 2024-09-12T02:54:14.153 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55062.log 2024-09-12T02:54:14.153 INFO:teuthology.orchestra.run.smithi112.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33004.log.gz 2024-09-12T02:54:14.154 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.54766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52613.log 2024-09-12T02:54:14.154 INFO:teuthology.orchestra.run.smithi112.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54766.log.gz 2024-09-12T02:54:14.155 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.55062.log: gzip -5 --verbose 89.3% -- -- replaced with /var/log/ceph/ceph-client.admin.55062.log.gz /var/log/ceph/ceph-client.admin.47451.log 2024-09-12T02:54:14.155 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-12T02:54:14.156 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.52613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52266.log 2024-09-12T02:54:14.156 INFO:teuthology.orchestra.run.smithi112.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52613.log.gz 2024-09-12T02:54:14.157 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.47451.log: gzip -5 --verbose 89.1% -- -- replaced with /var/log/ceph/ceph-client.admin.47451.log.gz 2024-09-12T02:54:14.157 INFO:teuthology.orchestra.run.smithi112.stderr: /var/log/ceph/ceph-client.admin.56659.log 2024-09-12T02:54:14.158 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.52266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36475.log 2024-09-12T02:54:14.158 INFO:teuthology.orchestra.run.smithi112.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52266.log.gz 2024-09-12T02:54:14.159 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.56659.log: gzip -5 --verbose 88.4% -- -- replaced with /var/log/ceph/ceph-client.admin.56659.log.gz /var/log/ceph/ceph-client.admin.49445.log 2024-09-12T02:54:14.159 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-12T02:54:14.160 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.36475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33686.log 2024-09-12T02:54:14.160 INFO:teuthology.orchestra.run.smithi112.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36475.log.gz 2024-09-12T02:54:14.160 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.49445.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49445.log.gz 2024-09-12T02:54:14.161 INFO:teuthology.orchestra.run.smithi112.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48642.log 2024-09-12T02:54:14.161 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40027.log 2024-09-12T02:54:14.161 INFO:teuthology.orchestra.run.smithi112.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.33686.log.gz 2024-09-12T02:54:14.162 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.48642.log: gzip -5 88.2% --verbose -- replaced with /var/log/ceph/ceph-client.admin.48642.log.gz -- 2024-09-12T02:54:14.162 INFO:teuthology.orchestra.run.smithi112.stderr: /var/log/ceph/ceph-client.admin.36528.log 2024-09-12T02:54:14.163 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.40027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39014.log 2024-09-12T02:54:14.164 INFO:teuthology.orchestra.run.smithi112.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40027.log.gz 2024-09-12T02:54:14.164 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.36528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50682.log 2024-09-12T02:54:14.164 INFO:teuthology.orchestra.run.smithi112.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36528.log.gz 2024-09-12T02:54:14.165 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.39014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41713.log 2024-09-12T02:54:14.165 INFO:teuthology.orchestra.run.smithi112.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39014.log.gz 2024-09-12T02:54:14.166 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.50682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54809.log 2024-09-12T02:54:14.166 INFO:teuthology.orchestra.run.smithi112.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50682.log.gz 2024-09-12T02:54:14.167 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.41713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32584.log 2024-09-12T02:54:14.167 INFO:teuthology.orchestra.run.smithi112.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41713.log.gz 2024-09-12T02:54:14.168 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.54809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50603.log 88.7% 2024-09-12T02:54:14.168 INFO:teuthology.orchestra.run.smithi112.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54809.log.gz 2024-09-12T02:54:14.169 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32668.log 2024-09-12T02:54:14.169 INFO:teuthology.orchestra.run.smithi112.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32584.log.gz 2024-09-12T02:54:14.170 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.0.50603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50603.log.gz 2024-09-12T02:54:14.170 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37134.log 2024-09-12T02:54:14.171 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32668.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32668.log.gz 2024-09-12T02:54:14.171 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35977.log 2024-09-12T02:54:14.172 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.37134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33088.log 2024-09-12T02:54:14.172 INFO:teuthology.orchestra.run.smithi112.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37134.log.gz 2024-09-12T02:54:14.172 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.35977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48904.log 2024-09-12T02:54:14.173 INFO:teuthology.orchestra.run.smithi112.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35977.log.gz 2024-09-12T02:54:14.173 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33088.log: gzip -5 88.2% --verbose -- replaced with /var/log/ceph/ceph-client.admin.33088.log.gz 2024-09-12T02:54:14.173 INFO:teuthology.orchestra.run.smithi112.stderr: -- /var/log/ceph/ceph-client.admin.36355.log 2024-09-12T02:54:14.174 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.48904.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48904.log.gz 2024-09-12T02:54:14.174 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37780.log 2024-09-12T02:54:14.175 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.36355.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36355.log.gz 2024-09-12T02:54:14.176 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42637.log 2024-09-12T02:54:14.176 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.37780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55279.log 2024-09-12T02:54:14.177 INFO:teuthology.orchestra.run.smithi112.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37780.log.gz 2024-09-12T02:54:14.177 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.42637.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42637.log.gz 2024-09-12T02:54:14.177 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32453.log 2024-09-12T02:54:14.178 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.55279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60868.log 2024-09-12T02:54:14.178 INFO:teuthology.orchestra.run.smithi112.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55279.log.gz 2024-09-12T02:54:14.179 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32453.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32453.log.gz 2024-09-12T02:54:14.179 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53038.log 2024-09-12T02:54:14.180 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.0.60868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.60868.log.gz 2024-09-12T02:54:14.180 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32033.log 2024-09-12T02:54:14.181 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.53038.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53038.log.gzgzip 2024-09-12T02:54:14.181 INFO:teuthology.orchestra.run.smithi112.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.63019.log 2024-09-12T02:54:14.182 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39542.log 2024-09-12T02:54:14.182 INFO:teuthology.orchestra.run.smithi112.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32033.log.gz 2024-09-12T02:54:14.183 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.63019.log: gzip -5 --verbose 88.4% -- -- replaced with /var/log/ceph/ceph-client.admin.63019.log.gz /var/log/ceph/ceph-client.admin.46130.log 2024-09-12T02:54:14.183 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-12T02:54:14.184 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.39542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63271.log 2024-09-12T02:54:14.184 INFO:teuthology.orchestra.run.smithi112.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39542.log.gz 2024-09-12T02:54:14.185 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.46130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54044.log 2024-09-12T02:54:14.185 INFO:teuthology.orchestra.run.smithi112.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46130.log.gz 2024-09-12T02:54:14.186 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.63271.log: gzip -5 --verbose -- 88.5% /var/log/ceph/ceph-client.admin.47559.log -- replaced with /var/log/ceph/ceph-client.admin.63271.log.gz 2024-09-12T02:54:14.186 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-12T02:54:14.187 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.54044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58166.log 2024-09-12T02:54:14.187 INFO:teuthology.orchestra.run.smithi112.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54044.log.gz 2024-09-12T02:54:14.188 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.47559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45455.log 2024-09-12T02:54:14.188 INFO:teuthology.orchestra.run.smithi112.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47559.log.gz 2024-09-12T02:54:14.189 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.58166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57682.log 2024-09-12T02:54:14.189 INFO:teuthology.orchestra.run.smithi112.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58166.log.gz 2024-09-12T02:54:14.189 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.0.45455.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45455.log.gz 2024-09-12T02:54:14.190 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55533.log 2024-09-12T02:54:14.191 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40444.log 2024-09-12T02:54:14.191 INFO:teuthology.orchestra.run.smithi112.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.57682.log.gz 2024-09-12T02:54:14.192 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.55533.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-12T02:54:14.192 INFO:teuthology.orchestra.run.smithi112.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55533.log.gz 2024-09-12T02:54:14.193 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.40444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52186.log 2024-09-12T02:54:14.193 INFO:teuthology.orchestra.run.smithi112.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40444.log.gz 2024-09-12T02:54:14.194 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43983.log 2024-09-12T02:54:14.195 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.52186.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52186.log.gz 2024-09-12T02:54:14.195 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46172.log 2024-09-12T02:54:14.196 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.43983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51064.log 2024-09-12T02:54:14.197 INFO:teuthology.orchestra.run.smithi112.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43983.log.gz 2024-09-12T02:54:14.197 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.46172.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46172.log.gz 2024-09-12T02:54:14.197 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42721.log 2024-09-12T02:54:14.198 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.51064.log: -- /var/log/ceph/ceph-client.admin.39500.log 2024-09-12T02:54:14.199 INFO:teuthology.orchestra.run.smithi112.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51064.log.gz 2024-09-12T02:54:14.199 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.42721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39098.log 2024-09-12T02:54:14.200 INFO:teuthology.orchestra.run.smithi112.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42721.log.gz 2024-09-12T02:54:14.200 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.39500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43838.log 2024-09-12T02:54:14.201 INFO:teuthology.orchestra.run.smithi112.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39500.log.gz 2024-09-12T02:54:14.201 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.39098.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39098.log.gz 2024-09-12T02:54:14.202 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63457.log 2024-09-12T02:54:14.202 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.43838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56737.log 2024-09-12T02:54:14.203 INFO:teuthology.orchestra.run.smithi112.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43838.log.gz 2024-09-12T02:54:14.204 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.63457.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.63457.log.gz 2024-09-12T02:54:14.204 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51466.log 2024-09-12T02:54:14.205 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41797.log 2024-09-12T02:54:14.205 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.56737.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56737.log.gz 2024-09-12T02:54:14.206 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.51466.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51466.log.gz 2024-09-12T02:54:14.206 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33928.log 2024-09-12T02:54:14.207 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35433.log 2024-09-12T02:54:14.207 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.41797.log: /var/log/ceph/ceph-client.admin.33928.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41797.log.gz 2024-09-12T02:54:14.208 INFO:teuthology.orchestra.run.smithi112.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33928.log.gz 2024-09-12T02:54:14.208 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37512.log 2024-09-12T02:54:14.209 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.35433.log: /var/log/ceph/ceph-client.admin.37895.log 2024-09-12T02:54:14.209 INFO:teuthology.orchestra.run.smithi112.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35433.log.gz 2024-09-12T02:54:14.210 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.37512.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37512.log.gz 2024-09-12T02:54:14.210 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63397.log 2024-09-12T02:54:14.211 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.37895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44472.log 2024-09-12T02:54:14.211 INFO:teuthology.orchestra.run.smithi112.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37895.log.gz 2024-09-12T02:54:14.212 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.63397.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63397.log.gz 2024-09-12T02:54:14.212 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48778.log 2024-09-12T02:54:14.213 INFO:teuthology.orchestra.run.smithi112.stderr:gzip/var/log/ceph/ceph-client.admin.44472.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.37833.log 2024-09-12T02:54:14.213 INFO:teuthology.orchestra.run.smithi112.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44472.log.gz 2024-09-12T02:54:14.214 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.48778.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48778.log.gz 2024-09-12T02:54:14.214 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41985.log 2024-09-12T02:54:14.215 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58334.log 2024-09-12T02:54:14.215 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.37833.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37833.log.gz 2024-09-12T02:54:14.216 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.41985.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41985.log.gz 2024-09-12T02:54:14.216 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39631.log 2024-09-12T02:54:14.217 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.58334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39202.log 2024-09-12T02:54:14.218 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.39631.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.58334.log.gz 2024-09-12T02:54:14.218 INFO:teuthology.orchestra.run.smithi112.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39631.log.gz 2024-09-12T02:54:14.218 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62893.log 2024-09-12T02:54:14.219 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5/var/log/ceph/ceph-client.admin.39202.log: --verbose -- /var/log/ceph/ceph-client.admin.51736.log 2024-09-12T02:54:14.219 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.62893.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39202.log.gz 2024-09-12T02:54:14.220 INFO:teuthology.orchestra.run.smithi112.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62893.log.gz 2024-09-12T02:54:14.220 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62354.log 2024-09-12T02:54:14.221 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.51736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59201.log 2024-09-12T02:54:14.222 INFO:teuthology.orchestra.run.smithi112.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51736.log.gz 2024-09-12T02:54:14.224 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.62354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43712.log 2024-09-12T02:54:14.224 INFO:teuthology.orchestra.run.smithi112.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62354.log.gz 2024-09-12T02:54:14.224 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59453.log 2024-09-12T02:54:14.224 INFO:teuthology.orchestra.run.smithi112.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59201.log.gz 2024-09-12T02:54:14.227 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.43712.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43712.log.gz 2024-09-12T02:54:14.227 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57341.log 2024-09-12T02:54:14.227 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46684.log 2024-09-12T02:54:14.227 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59453.log: /var/log/ceph/ceph-client.admin.57341.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59453.log.gz 2024-09-12T02:54:14.227 INFO:teuthology.orchestra.run.smithi112.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57341.log.gz 2024-09-12T02:54:14.228 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51634.log 2024-09-12T02:54:14.229 INFO:teuthology.orchestra.run.smithi137.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T02:54:14.231 INFO:teuthology.orchestra.run.smithi112.stderr:gzip/var/log/ceph/ceph-client.admin.46684.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.63229.log 2024-09-12T02:54:14.231 INFO:teuthology.orchestra.run.smithi112.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46684.log.gz 2024-09-12T02:54:14.231 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.51634.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51634.log.gz 2024-09-12T02:54:14.231 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34054.log 2024-09-12T02:54:14.231 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.63229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50724.log 2024-09-12T02:54:14.231 INFO:teuthology.orchestra.run.smithi112.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.63229.log.gz 2024-09-12T02:54:14.231 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34054.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34054.log.gz 2024-09-12T02:54:14.231 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36229.log 2024-09-12T02:54:14.232 INFO:teuthology.orchestra.run.smithi112.stderr:gzip/var/log/ceph/ceph-client.admin.50724.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.38845.log 2024-09-12T02:54:14.232 INFO:teuthology.orchestra.run.smithi112.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50724.log.gz 2024-09-12T02:54:14.233 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.36229.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36229.log.gz 2024-09-12T02:54:14.233 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38659.log 2024-09-12T02:54:14.233 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.38845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38888.log 2024-09-12T02:54:14.234 INFO:teuthology.orchestra.run.smithi112.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.38845.log.gz 2024-09-12T02:54:14.235 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.38659.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38659.log.gz 2024-09-12T02:54:14.235 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59159.log 2024-09-12T02:54:14.236 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.38888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49967.log 2024-09-12T02:54:14.236 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59159.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38888.log.gz 2024-09-12T02:54:14.237 INFO:teuthology.orchestra.run.smithi112.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59159.log.gz 2024-09-12T02:54:14.237 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46443.log 2024-09-12T02:54:14.238 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32836.log 2024-09-12T02:54:14.238 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.49967.log: /var/log/ceph/ceph-client.admin.46443.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49967.log.gz 2024-09-12T02:54:14.239 INFO:teuthology.orchestra.run.smithi112.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46443.log.gz 2024-09-12T02:54:14.239 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59663.log 2024-09-12T02:54:14.240 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62546.log 2024-09-12T02:54:14.240 INFO:teuthology.orchestra.run.smithi112.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32836.log.gz 2024-09-12T02:54:14.241 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59663.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59663.log.gz 2024-09-12T02:54:14.241 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40616.log 2024-09-12T02:54:14.242 INFO:teuthology.orchestra.run.smithi112.stderr:gzip/var/log/ceph/ceph-client.admin.62546.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.54538.log 2024-09-12T02:54:14.242 INFO:teuthology.orchestra.run.smithi112.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62546.log.gz 2024-09-12T02:54:14.243 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.40616.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40616.log.gz 2024-09-12T02:54:14.243 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32411.log 2024-09-12T02:54:14.244 INFO:teuthology.orchestra.run.smithi112.stderr:gzip/var/log/ceph/ceph-client.admin.54538.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35349.log 2024-09-12T02:54:14.245 INFO:teuthology.orchestra.run.smithi112.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54538.log.gz 2024-09-12T02:54:14.245 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32411.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32411.log.gz 2024-09-12T02:54:14.245 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40969.log 2024-09-12T02:54:14.246 INFO:teuthology.orchestra.run.smithi112.stderr:gzip/var/log/ceph/ceph-client.admin.35349.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46845.log 2024-09-12T02:54:14.247 INFO:teuthology.orchestra.run.smithi112.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35349.log.gz 2024-09-12T02:54:14.247 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.40969.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40969.log.gz 2024-09-12T02:54:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52571.log 2024-09-12T02:54:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39587.log 2024-09-12T02:54:14.249 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.46845.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46845.log.gz 2024-09-12T02:54:14.249 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.52571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41839.log 2024-09-12T02:54:14.249 INFO:teuthology.orchestra.run.smithi112.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52571.log.gz 2024-09-12T02:54:14.250 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.39587.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T02:54:14.251 INFO:teuthology.orchestra.run.smithi112.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39587.log.gz 2024-09-12T02:54:14.251 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.41839.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41839.log.gz 2024-09-12T02:54:14.251 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56921.log 2024-09-12T02:54:14.252 INFO:teuthology.orchestra.run.smithi112.stderr:gzip/var/log/ceph/ceph-mon.a.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45844.log 2024-09-12T02:54:14.253 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.56921.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56921.log.gz 2024-09-12T02:54:14.256 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51905.log 2024-09-12T02:54:14.257 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46929.log 2024-09-12T02:54:14.257 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.45844.log: /var/log/ceph/ceph-client.admin.51905.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45844.log.gz 2024-09-12T02:54:14.257 INFO:teuthology.orchestra.run.smithi112.stderr: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.51905.log.gz -5 2024-09-12T02:54:14.258 INFO:teuthology.orchestra.run.smithi112.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53729.log 2024-09-12T02:54:14.258 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.46929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50786.log 2024-09-12T02:54:14.258 INFO:teuthology.orchestra.run.smithi112.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46929.log.gz 2024-09-12T02:54:14.258 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.53729.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53729.log.gz 2024-09-12T02:54:14.258 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63313.log 2024-09-12T02:54:14.259 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.50786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44025.log 2024-09-12T02:54:14.259 INFO:teuthology.orchestra.run.smithi112.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50786.log.gz 2024-09-12T02:54:14.260 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.63313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50009.log 88.3% 2024-09-12T02:54:14.260 INFO:teuthology.orchestra.run.smithi112.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63313.log.gz 2024-09-12T02:54:14.261 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.44025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45075.log 2024-09-12T02:54:14.261 INFO:teuthology.orchestra.run.smithi112.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44025.log.gz 2024-09-12T02:54:14.262 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.50009.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50009.log.gzgzip 2024-09-12T02:54:14.262 INFO:teuthology.orchestra.run.smithi112.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57766.log 2024-09-12T02:54:14.263 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.45075.log: -- /var/log/ceph/ceph-client.admin.49385.log 2024-09-12T02:54:14.264 INFO:teuthology.orchestra.run.smithi112.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45075.log.gz 2024-09-12T02:54:14.264 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57766.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57766.log.gz 2024-09-12T02:54:14.264 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63497.log 2024-09-12T02:54:14.265 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.49385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63061.log 2024-09-12T02:54:14.265 INFO:teuthology.orchestra.run.smithi112.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49385.log.gz 2024-09-12T02:54:14.266 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.63497.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63497.log.gz 2024-09-12T02:54:14.267 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52390.log 2024-09-12T02:54:14.268 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.63061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42955.log 2024-09-12T02:54:14.268 INFO:teuthology.orchestra.run.smithi112.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63061.log.gz 2024-09-12T02:54:14.269 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.52390.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52390.log.gz 2024-09-12T02:54:14.272 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29985.log 2024-09-12T02:54:14.273 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.42955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54170.log 2024-09-12T02:54:14.273 INFO:teuthology.orchestra.run.smithi112.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42955.log.gz 2024-09-12T02:54:14.273 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph.tmp-client.admin.29985.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29985.log.gz 2024-09-12T02:54:14.273 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34318.log 2024-09-12T02:54:14.273 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.54170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62270.log 2024-09-12T02:54:14.273 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34318.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54170.log.gz 2024-09-12T02:54:14.274 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56837.log 2024-09-12T02:54:14.274 INFO:teuthology.orchestra.run.smithi112.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34318.log.gz 2024-09-12T02:54:14.274 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.62270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42889.log 2024-09-12T02:54:14.274 INFO:teuthology.orchestra.run.smithi112.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62270.log.gz 2024-09-12T02:54:14.275 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.56837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46887.log 2024-09-12T02:54:14.275 INFO:teuthology.orchestra.run.smithi112.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56837.log.gz 2024-09-12T02:54:14.276 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.42889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46046.log 2024-09-12T02:54:14.277 INFO:teuthology.orchestra.run.smithi112.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.42889.log.gz 2024-09-12T02:54:14.278 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.46887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58040.log 2024-09-12T02:54:14.278 INFO:teuthology.orchestra.run.smithi112.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46887.log.gz 2024-09-12T02:54:14.279 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.46046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39140.log 2024-09-12T02:54:14.279 INFO:teuthology.orchestra.run.smithi112.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46046.log.gz 2024-09-12T02:54:14.280 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.58040.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58040.log.gz 2024-09-12T02:54:14.280 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37223.log 2024-09-12T02:54:14.281 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.39140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35517.log 2024-09-12T02:54:14.281 INFO:teuthology.orchestra.run.smithi112.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39140.log.gz 2024-09-12T02:54:14.282 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.37223.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37223.log.gz 2024-09-12T02:54:14.282 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49030.log 2024-09-12T02:54:14.283 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44554.log 2024-09-12T02:54:14.283 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.35517.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35517.log.gz 2024-09-12T02:54:14.284 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.49030.log: gzip 87.5% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.49030.log.gz -- 2024-09-12T02:54:14.284 INFO:teuthology.orchestra.run.smithi112.stderr: /var/log/ceph/ceph-client.admin.52869.log 2024-09-12T02:54:14.285 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.44554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44638.log 2024-09-12T02:54:14.285 INFO:teuthology.orchestra.run.smithi112.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44554.log.gz 2024-09-12T02:54:14.286 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.52869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52785.log 2024-09-12T02:54:14.286 INFO:teuthology.orchestra.run.smithi112.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52869.log.gz 2024-09-12T02:54:14.287 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.44638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63103.log 2024-09-12T02:54:14.287 INFO:teuthology.orchestra.run.smithi112.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44638.log.gz 2024-09-12T02:54:14.288 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.52785.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52785.log.gz 2024-09-12T02:54:14.288 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58667.log 2024-09-12T02:54:14.289 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.63103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36739.log 2024-09-12T02:54:14.290 INFO:teuthology.orchestra.run.smithi112.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63103.log.gz 2024-09-12T02:54:14.291 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.58667.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T02:54:14.291 INFO:teuthology.orchestra.run.smithi112.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58667.log.gz 2024-09-12T02:54:14.291 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.36739.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.36739.log.gz 2024-09-12T02:54:14.292 INFO:teuthology.orchestra.run.smithi112.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46974.log 2024-09-12T02:54:14.293 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38076.log 2024-09-12T02:54:14.294 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.46974.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49301.log 2024-09-12T02:54:14.294 INFO:teuthology.orchestra.run.smithi112.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46974.log.gz 2024-09-12T02:54:14.295 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.38076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36655.log 2024-09-12T02:54:14.296 INFO:teuthology.orchestra.run.smithi112.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38076.log.gz 2024-09-12T02:54:14.296 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.49301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41503.log 2024-09-12T02:54:14.297 INFO:teuthology.orchestra.run.smithi112.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49301.log.gz 2024-09-12T02:54:14.298 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.36655.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36655.log.gz 2024-09-12T02:54:14.298 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50181.log 2024-09-12T02:54:14.299 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.41503.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41503.log.gz 2024-09-12T02:54:14.300 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31799.log 2024-09-12T02:54:14.301 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.50181.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57914.log 2024-09-12T02:54:14.301 INFO:teuthology.orchestra.run.smithi112.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50181.log.gz 2024-09-12T02:54:14.302 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.31799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54086.log 2024-09-12T02:54:14.302 INFO:teuthology.orchestra.run.smithi112.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31799.log.gz 2024-09-12T02:54:14.303 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53831.log 2024-09-12T02:54:14.303 INFO:teuthology.orchestra.run.smithi112.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57914.log.gz 2024-09-12T02:54:14.304 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.54086.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54086.log.gz 2024-09-12T02:54:14.306 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5/var/log/ceph/ceph-client.admin.53831.log: --verbose -- /var/log/ceph/ceph-client.admin.48368.log 2024-09-12T02:54:14.306 INFO:teuthology.orchestra.run.smithi112.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53831.log.gz 2024-09-12T02:54:14.306 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51366.log 2024-09-12T02:54:14.306 INFO:teuthology.orchestra.run.smithi137.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-12T02:54:14.307 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.48368.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48368.log.gz 2024-09-12T02:54:14.308 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58082.log 2024-09-12T02:54:14.309 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.51366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51676.log 2024-09-12T02:54:14.309 INFO:teuthology.orchestra.run.smithi112.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51366.log.gz 2024-09-12T02:54:14.311 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.58082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48020.log 2024-09-12T02:54:14.311 INFO:teuthology.orchestra.run.smithi112.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58082.log.gz 2024-09-12T02:54:14.311 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.51676.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51676.log.gz 2024-09-12T02:54:14.312 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60090.log 2024-09-12T02:54:14.313 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.48020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41419.log 2024-09-12T02:54:14.313 INFO:teuthology.orchestra.run.smithi112.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48020.log.gz 2024-09-12T02:54:14.314 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.60090.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60090.log.gz 2024-09-12T02:54:14.314 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45576.log 2024-09-12T02:54:14.315 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.41419.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41419.log.gz 2024-09-12T02:54:14.315 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55445.log 2024-09-12T02:54:14.317 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.45576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55020.log 2024-09-12T02:54:14.317 INFO:teuthology.orchestra.run.smithi112.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45576.log.gz 2024-09-12T02:54:14.318 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.55445.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55445.log.gz 2024-09-12T02:54:14.318 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33354.log 2024-09-12T02:54:14.320 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.55020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52827.log 2024-09-12T02:54:14.320 INFO:teuthology.orchestra.run.smithi112.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55020.log.gz 2024-09-12T02:54:14.320 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33354.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33354.log.gz 2024-09-12T02:54:14.321 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41377.log 2024-09-12T02:54:14.321 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.52827.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52827.log.gz 2024-09-12T02:54:14.322 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39297.log 2024-09-12T02:54:14.323 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.41377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35690.log 2024-09-12T02:54:14.323 INFO:teuthology.orchestra.run.smithi112.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41377.log.gz 2024-09-12T02:54:14.325 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.39297.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45117.log 2024-09-12T02:54:14.325 INFO:teuthology.orchestra.run.smithi112.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39297.log.gz 2024-09-12T02:54:14.326 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.35690.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T02:54:14.326 INFO:teuthology.orchestra.run.smithi112.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35690.log.gz 2024-09-12T02:54:14.327 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.45117.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45117.log.gz 2024-09-12T02:54:14.327 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32269.log 2024-09-12T02:54:14.329 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43264.log 2024-09-12T02:54:14.330 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32269.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32269.log.gz 2024-09-12T02:54:14.331 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60488.log 2024-09-12T02:54:14.331 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.43264.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43264.log.gz 2024-09-12T02:54:14.332 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41461.log 2024-09-12T02:54:14.333 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.60488.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.60488.log.gz 2024-09-12T02:54:14.334 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55803.log 2024-09-12T02:54:14.335 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.41461.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41461.log.gz 2024-09-12T02:54:14.336 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37004.log 2024-09-12T02:54:14.337 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.55803.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55803.log.gz 2024-09-12T02:54:14.338 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59017.log 2024-09-12T02:54:14.339 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.37004.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37004.log.gz 2024-09-12T02:54:14.340 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41335.log 2024-09-12T02:54:14.341 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59017.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59017.log.gz 2024-09-12T02:54:14.341 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34012.log 2024-09-12T02:54:14.343 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.41335.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41335.log.gz 2024-09-12T02:54:14.344 INFO:teuthology.orchestra.run.smithi112.stderr:gzip/var/log/ceph/ceph-client.admin.34012.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.40177.log 2024-09-12T02:54:14.344 INFO:teuthology.orchestra.run.smithi112.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34012.log.gz 2024-09-12T02:54:14.345 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49343.log 2024-09-12T02:54:14.346 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.40177.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40177.log.gz 2024-09-12T02:54:14.347 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T02:54:14.348 INFO:teuthology.orchestra.run.smithi137.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T02:54:14.349 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.49343.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49343.log.gz 2024-09-12T02:54:14.349 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39377.log 2024-09-12T02:54:14.351 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.39377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57131.log 2024-09-12T02:54:14.352 INFO:teuthology.orchestra.run.smithi112.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39377.log.gz 2024-09-12T02:54:14.352 INFO:teuthology.orchestra.run.smithi112.stderr: 86.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T02:54:14.354 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44067.log 2024-09-12T02:54:14.355 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57131.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57131.log.gz 2024-09-12T02:54:14.356 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53906.log 2024-09-12T02:54:14.356 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.44067.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44067.log.gz 2024-09-12T02:54:14.358 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47868.log 2024-09-12T02:54:14.358 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.53906.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53906.log.gz 2024-09-12T02:54:14.359 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47367.log 2024-09-12T02:54:14.360 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.47868.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47868.log.gz 2024-09-12T02:54:14.361 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36823.log 2024-09-12T02:54:14.363 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.47367.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47367.log.gz 2024-09-12T02:54:14.363 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62144.log 2024-09-12T02:54:14.363 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.36823.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36823.log.gz 2024-09-12T02:54:14.364 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42414.log 2024-09-12T02:54:14.369 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.62144.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62144.log.gz 2024-09-12T02:54:14.369 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36145.log 2024-09-12T02:54:14.369 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.42414.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42414.log.gz 2024-09-12T02:54:14.370 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53080.log 2024-09-12T02:54:14.370 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.36145.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36145.log.gz 2024-09-12T02:54:14.370 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57383.log 2024-09-12T02:54:14.371 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.53080.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53080.log.gz 2024-09-12T02:54:14.371 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48946.log 2024-09-12T02:54:14.372 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57383.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57383.log.gz 2024-09-12T02:54:14.373 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53771.log 2024-09-12T02:54:14.374 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.48946.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48946.log.gz 2024-09-12T02:54:14.375 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58751.log 2024-09-12T02:54:14.376 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.53771.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53771.log.gz 2024-09-12T02:54:14.376 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33172.log 2024-09-12T02:54:14.378 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.58751.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58751.log.gz 2024-09-12T02:54:14.379 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62935.log 2024-09-12T02:54:14.380 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33172.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33172.log.gz 2024-09-12T02:54:14.381 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52953.log 2024-09-12T02:54:14.382 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.62935.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62935.log.gz 2024-09-12T02:54:14.382 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36865.log 2024-09-12T02:54:14.384 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.52953.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52953.log.gz 2024-09-12T02:54:14.384 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41545.log 2024-09-12T02:54:14.386 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.36865.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36865.log.gz 2024-09-12T02:54:14.386 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.41545.log: /var/log/ceph/ceph-client.admin.44777.log 2024-09-12T02:54:14.387 INFO:teuthology.orchestra.run.smithi112.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41545.log.gz 2024-09-12T02:54:14.387 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43552.log 2024-09-12T02:54:14.388 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.44777.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44777.log.gz 2024-09-12T02:54:14.390 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.43552.log: /var/log/ceph/ceph-client.admin.54128.log 2024-09-12T02:54:14.390 INFO:teuthology.orchestra.run.smithi112.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43552.log.gz 2024-09-12T02:54:14.391 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49259.log 2024-09-12T02:54:14.392 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.54128.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54128.log.gz 2024-09-12T02:54:14.393 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.49259.log: -- /var/log/ceph/ceph-client.admin.57810.log 2024-09-12T02:54:14.394 INFO:teuthology.orchestra.run.smithi112.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49259.log.gz 2024-09-12T02:54:14.395 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42507.log 2024-09-12T02:54:14.396 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57810.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57810.log.gz 2024-09-12T02:54:14.397 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.42507.log: -- /var/log/ceph/ceph-client.admin.38397.log 2024-09-12T02:54:14.397 INFO:teuthology.orchestra.run.smithi112.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.42507.log.gz 2024-09-12T02:54:14.398 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42080.log 2024-09-12T02:54:14.400 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.38397.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38397.log.gz 2024-09-12T02:54:14.401 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32878.log/var/log/ceph/ceph-client.admin.42080.log: 2024-09-12T02:54:14.401 INFO:teuthology.orchestra.run.smithi112.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42080.log.gz 2024-09-12T02:54:14.402 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37088.log 2024-09-12T02:54:14.403 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32878.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32878.log.gz 2024-09-12T02:54:14.404 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.37088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61585.log 2024-09-12T02:54:14.405 INFO:teuthology.orchestra.run.smithi112.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37088.log.gz 2024-09-12T02:54:14.405 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63145.log 2024-09-12T02:54:14.406 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.61585.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61585.log.gz 2024-09-12T02:54:14.407 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50883.log 2024-09-12T02:54:14.408 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.63145.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63145.log.gz 2024-09-12T02:54:14.409 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41011.log 2024-09-12T02:54:14.410 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.50883.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50883.log.gz 2024-09-12T02:54:14.411 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51947.log 2024-09-12T02:54:14.411 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.41011.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41011.log.gz 2024-09-12T02:54:14.412 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38475.log 2024-09-12T02:54:14.413 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.51947.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51947.log.gz 2024-09-12T02:54:14.415 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5/var/log/ceph/ceph-client.admin.38475.log: --verbose -- /var/log/ceph/ceph-client.admin.35475.log 2024-09-12T02:54:14.415 INFO:teuthology.orchestra.run.smithi112.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38475.log.gz 2024-09-12T02:54:14.416 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39757.log 2024-09-12T02:54:14.417 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.35475.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35475.log.gz 2024-09-12T02:54:14.418 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54580.log 2024-09-12T02:54:14.419 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.39757.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39757.log.gz 2024-09-12T02:54:14.420 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49742.log 2024-09-12T02:54:14.421 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.54580.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54580.log.gz 2024-09-12T02:54:14.421 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35579.log 2024-09-12T02:54:14.422 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.49742.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49742.log.gz 2024-09-12T02:54:14.423 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56079.log 2024-09-12T02:54:14.424 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.35579.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35579.log.gz 2024-09-12T02:54:14.425 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.56079.log: /var/log/ceph/ceph-client.admin.55845.log 2024-09-12T02:54:14.426 INFO:teuthology.orchestra.run.smithi112.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56079.log.gz 2024-09-12T02:54:14.427 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55929.log 2024-09-12T02:54:14.428 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.55845.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55845.log.gz 2024-09-12T02:54:14.429 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48820.log 2024-09-12T02:54:14.429 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.55929.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55929.log.gz 2024-09-12T02:54:14.430 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53539.log 2024-09-12T02:54:14.431 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.48820.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48820.log.gz 2024-09-12T02:54:14.432 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5/var/log/ceph/ceph-client.admin.53539.log: --verbose -- /var/log/ceph/ceph-client.admin.39715.log 2024-09-12T02:54:14.433 INFO:teuthology.orchestra.run.smithi112.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53539.log.gz 2024-09-12T02:54:14.434 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62725.log 2024-09-12T02:54:14.436 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.39715.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39715.log.gz 2024-09-12T02:54:14.436 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42370.log 2024-09-12T02:54:14.436 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.62725.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62725.log.gz 2024-09-12T02:54:14.437 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43474.log 2024-09-12T02:54:14.439 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.42370.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42370.log.gz 2024-09-12T02:54:14.439 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47241.log 2024-09-12T02:54:14.440 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.43474.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43474.log.gz 2024-09-12T02:54:14.441 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39985.log 2024-09-12T02:54:14.442 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.47241.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47241.log.gz 2024-09-12T02:54:14.443 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.39985.log: -- /var/log/ceph/ceph-client.admin.56963.log 2024-09-12T02:54:14.443 INFO:teuthology.orchestra.run.smithi112.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39985.log.gz 2024-09-12T02:54:14.444 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32752.log 2024-09-12T02:54:14.446 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.56963.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56963.log.gz 2024-09-12T02:54:14.446 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49784.log 2024-09-12T02:54:14.447 INFO:teuthology.orchestra.run.smithi112.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32752.log.gz 2024-09-12T02:54:14.448 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36781.log 2024-09-12T02:54:14.449 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.49784.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49784.log.gz 2024-09-12T02:54:14.450 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53601.log 2024-09-12T02:54:14.451 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.36781.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36781.log.gz 2024-09-12T02:54:14.452 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44392.log 2024-09-12T02:54:14.453 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.53601.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53601.log.gz 2024-09-12T02:54:14.454 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40885.log 2024-09-12T02:54:14.455 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.44392.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44392.log.gz 2024-09-12T02:54:14.456 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42241.log 2024-09-12T02:54:14.457 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.40885.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40885.log.gz 2024-09-12T02:54:14.460 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.42241.log: /var/log/ceph/ceph-client.admin.58292.log 2024-09-12T02:54:14.462 INFO:teuthology.orchestra.run.smithi112.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42241.log.gz 2024-09-12T02:54:14.462 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50055.log 2024-09-12T02:54:14.463 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.58292.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58292.log.gz 2024-09-12T02:54:14.463 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49925.log 2024-09-12T02:54:14.463 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.50055.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50055.log.gz 2024-09-12T02:54:14.463 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38930.log 2024-09-12T02:54:14.464 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.49925.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49925.log.gz 2024-09-12T02:54:14.465 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5/var/log/ceph/ceph-client.admin.38930.log: --verbose -- /var/log/ceph/ceph-client.admin.36061.log 2024-09-12T02:54:14.465 INFO:teuthology.orchestra.run.smithi112.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38930.log.gz 2024-09-12T02:54:14.466 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49090.log 2024-09-12T02:54:14.468 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.36061.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36061.log.gz 2024-09-12T02:54:14.468 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.49090.log: -- /var/log/ceph/ceph-client.admin.57956.log 2024-09-12T02:54:14.469 INFO:teuthology.orchestra.run.smithi112.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49090.log.gz 2024-09-12T02:54:14.470 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60990.log 2024-09-12T02:54:14.471 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57956.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57956.log.gz 2024-09-12T02:54:14.472 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46527.log 2024-09-12T02:54:14.473 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.60990.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.60990.log.gz 2024-09-12T02:54:14.473 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62228.log 2024-09-12T02:54:14.475 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.46527.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46527.log.gz 2024-09-12T02:54:14.475 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59962.log 2024-09-12T02:54:14.477 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.62228.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62228.log.gz 2024-09-12T02:54:14.477 INFO:teuthology.orchestra.run.smithi112.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52743.log 2024-09-12T02:54:14.478 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59962.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59962.log.gz 2024-09-12T02:54:14.480 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.52743.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52743.log.gz 2024-09-12T02:54:14.480 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46004.log 2024-09-12T02:54:14.482 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51550.log 2024-09-12T02:54:14.483 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.46004.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46004.log.gz 2024-09-12T02:54:14.484 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47018.log 2024-09-12T02:54:14.485 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.51550.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51550.log.gz 2024-09-12T02:54:14.485 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62767.log 2024-09-12T02:54:14.487 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.47018.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47018.log.gz 2024-09-12T02:54:14.487 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.62767.log: /var/log/ceph/ceph-client.admin.60046.log 2024-09-12T02:54:14.488 INFO:teuthology.orchestra.run.smithi112.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62767.log.gz 2024-09-12T02:54:14.489 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36313.log 2024-09-12T02:54:14.490 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.60046.log: 91.6% 89.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T02:54:14.491 INFO:teuthology.orchestra.run.smithi112.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60046.log.gz 2024-09-12T02:54:14.491 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50139.log 2024-09-12T02:54:14.492 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.36313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58124.log 2024-09-12T02:54:14.492 INFO:teuthology.orchestra.run.smithi112.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36313.log.gz 2024-09-12T02:54:14.492 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.50139.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50139.log.gz 2024-09-12T02:54:14.494 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.58124.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58124.log.gz 2024-09-12T02:54:14.495 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49175.log 2024-09-12T02:54:14.495 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62638.log 2024-09-12T02:54:14.497 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.49175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42805.log 2024-09-12T02:54:14.497 INFO:teuthology.orchestra.run.smithi112.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49175.log.gz 2024-09-12T02:54:14.498 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.62638.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62638.log.gz 2024-09-12T02:54:14.498 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33130.log 2024-09-12T02:54:14.499 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.42805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34656.log 2024-09-12T02:54:14.500 INFO:teuthology.orchestra.run.smithi112.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42805.log.gz 2024-09-12T02:54:14.501 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33130.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33130.log.gz 2024-09-12T02:54:14.501 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39056.log 2024-09-12T02:54:14.501 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.0.34656.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.34656.log.gz 2024-09-12T02:54:14.502 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36103.log 2024-09-12T02:54:14.504 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.39056.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39056.log.gz 2024-09-12T02:54:14.504 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39458.log 2024-09-12T02:54:14.505 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.36103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37278.log 2024-09-12T02:54:14.505 INFO:teuthology.orchestra.run.smithi112.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36103.log.gz 2024-09-12T02:54:14.506 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.39458.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39458.log.gz 2024-09-12T02:54:14.506 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48452.log 2024-09-12T02:54:14.507 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.37278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33970.log 2024-09-12T02:54:14.507 INFO:teuthology.orchestra.run.smithi112.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37278.log.gz 2024-09-12T02:54:14.508 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.48452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58709.log 2024-09-12T02:54:14.509 INFO:teuthology.orchestra.run.smithi112.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48452.log.gz 2024-09-12T02:54:14.509 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33970.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33970.log.gz 2024-09-12T02:54:14.509 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59621.log 2024-09-12T02:54:14.511 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.58709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41277.log 2024-09-12T02:54:14.511 INFO:teuthology.orchestra.run.smithi112.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58709.log.gz 2024-09-12T02:54:14.512 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34096.log 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59621.log.gz 2024-09-12T02:54:14.512 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-12T02:54:14.513 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.41277.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41277.log.gz 2024-09-12T02:54:14.514 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42595.log 2024-09-12T02:54:14.515 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44193.log 2024-09-12T02:54:14.515 INFO:teuthology.orchestra.run.smithi112.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34096.log.gz 2024-09-12T02:54:14.516 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.42595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60362.log 2024-09-12T02:54:14.517 INFO:teuthology.orchestra.run.smithi112.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42595.log.gz 2024-09-12T02:54:14.517 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.44193.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44193.log.gz 2024-09-12T02:54:14.519 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.60362.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.60362.log.gz 2024-09-12T02:54:14.519 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60236.log 2024-09-12T02:54:14.520 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40927.log 2024-09-12T02:54:14.521 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.60236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61976.log 2024-09-12T02:54:14.521 INFO:teuthology.orchestra.run.smithi112.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60236.log.gz 2024-09-12T02:54:14.523 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.40927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54318.log 2024-09-12T02:54:14.523 INFO:teuthology.orchestra.run.smithi112.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40927.log.gz 2024-09-12T02:54:14.524 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.61976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59285.log 2024-09-12T02:54:14.524 INFO:teuthology.orchestra.run.smithi112.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61976.log.gz 2024-09-12T02:54:14.525 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.54318.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54318.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50223.log 2024-09-12T02:54:14.526 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-12T02:54:14.526 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59285.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59285.log.gz 2024-09-12T02:54:14.526 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57425.log 2024-09-12T02:54:14.527 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.50223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33342.log 2024-09-12T02:54:14.528 INFO:teuthology.orchestra.run.smithi112.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50223.log.gz/var/log/ceph/ceph-client.admin.57425.log: 2024-09-12T02:54:14.529 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56879.log 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57425.log.gz 2024-09-12T02:54:14.529 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-12T02:54:14.530 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33342.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33342.log.gz 2024-09-12T02:54:14.530 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59880.log 2024-09-12T02:54:14.532 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.56879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62977.log 2024-09-12T02:54:14.532 INFO:teuthology.orchestra.run.smithi112.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56879.log.gz 2024-09-12T02:54:14.533 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44235.log 2024-09-12T02:54:14.533 INFO:teuthology.orchestra.run.smithi112.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59880.log.gz 2024-09-12T02:54:14.534 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.62977.log: gzip -5 89.0% -- replaced with /var/log/ceph/ceph-client.admin.62977.log.gz 2024-09-12T02:54:14.535 INFO:teuthology.orchestra.run.smithi112.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52091.log 2024-09-12T02:54:14.535 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.44235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47069.log 2024-09-12T02:54:14.535 INFO:teuthology.orchestra.run.smithi112.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44235.log.gz 2024-09-12T02:54:14.536 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.52091.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52091.log.gz 2024-09-12T02:54:14.536 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52476.log 2024-09-12T02:54:14.537 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.47069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55617.log 2024-09-12T02:54:14.538 INFO:teuthology.orchestra.run.smithi112.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47069.log.gz 2024-09-12T02:54:14.539 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.52476.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52476.log.gz 2024-09-12T02:54:14.539 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31521.log 2024-09-12T02:54:14.540 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.55617.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55617.log.gz 2024-09-12T02:54:14.541 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53497.log 2024-09-12T02:54:14.542 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.31521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43796.log 2024-09-12T02:54:14.542 INFO:teuthology.orchestra.run.smithi112.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.31521.log.gz 2024-09-12T02:54:14.543 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.53497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37700.log 2024-09-12T02:54:14.543 INFO:teuthology.orchestra.run.smithi112.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.53497.log.gz 2024-09-12T02:54:14.544 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.43796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33350.log 2024-09-12T02:54:14.545 INFO:teuthology.orchestra.run.smithi112.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43796.log.gz 2024-09-12T02:54:14.546 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.0.37700.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.37700.log.gz 2024-09-12T02:54:14.546 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49133.log 2024-09-12T02:54:14.547 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55104.log 2024-09-12T02:54:14.547 INFO:teuthology.orchestra.run.smithi112.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33350.log.gz 2024-09-12T02:54:14.548 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.49133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38972.log 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49133.log.gz 2024-09-12T02:54:14.548 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-12T02:54:14.549 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.55104.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55104.log.gz 2024-09-12T02:54:14.550 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41629.log 2024-09-12T02:54:14.551 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.38972.log: gzip -5 88.8% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.38972.log.gz /var/log/ceph/ceph-client.admin.33351.log 2024-09-12T02:54:14.551 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-12T02:54:14.552 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.41629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32173.log 2024-09-12T02:54:14.552 INFO:teuthology.orchestra.run.smithi112.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41629.log.gz 2024-09-12T02:54:14.553 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33351.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33351.log.gz 2024-09-12T02:54:14.553 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60680.log 2024-09-12T02:54:14.555 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33690.log 2024-09-12T02:54:14.555 INFO:teuthology.orchestra.run.smithi112.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32173.log.gz 2024-09-12T02:54:14.556 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.60680.log: gzip -5 --verbose -- 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60680.log.gz 2024-09-12T02:54:14.556 INFO:teuthology.orchestra.run.smithi112.stderr: /var/log/ceph/ceph-client.admin.33685.log 2024-09-12T02:54:14.557 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33690.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.33690.log.gz 2024-09-12T02:54:14.558 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52911.log 2024-09-12T02:54:14.559 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54454.log 2024-09-12T02:54:14.559 INFO:teuthology.orchestra.run.smithi112.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33685.log.gz 2024-09-12T02:54:14.560 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.52911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56346.log 2024-09-12T02:54:14.560 INFO:teuthology.orchestra.run.smithi112.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52911.log.gz 2024-09-12T02:54:14.561 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.54454.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54454.log.gz 2024-09-12T02:54:14.562 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.56346.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56346.log.gz 2024-09-12T02:54:14.563 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58208.log 2024-09-12T02:54:14.564 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44949.log 2024-09-12T02:54:14.566 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.58208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32794.log 2024-09-12T02:54:14.566 INFO:teuthology.orchestra.run.smithi112.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58208.log.gz 2024-09-12T02:54:14.566 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.44949.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44949.log.gz 2024-09-12T02:54:14.568 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32794.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32794.log.gz 2024-09-12T02:54:14.568 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62102.log 2024-09-12T02:54:14.569 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59243.log 2024-09-12T02:54:14.570 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.62102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59800.log 2024-09-12T02:54:14.571 INFO:teuthology.orchestra.run.smithi112.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62102.log.gz 2024-09-12T02:54:14.572 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62060.log 2024-09-12T02:54:14.572 INFO:teuthology.orchestra.run.smithi112.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59243.log.gz 2024-09-12T02:54:14.573 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59800.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59800.log.gz 2024-09-12T02:54:14.573 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50097.log 2024-09-12T02:54:14.574 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.62060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35391.log 2024-09-12T02:54:14.574 INFO:teuthology.orchestra.run.smithi112.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62060.log.gz 2024-09-12T02:54:14.576 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.50097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45920.log 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50097.log.gz 2024-09-12T02:54:14.576 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-12T02:54:14.577 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.35391.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35391.log.gz 2024-09-12T02:54:14.577 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41671.log 2024-09-12T02:54:14.578 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.45920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60614.log 2024-09-12T02:54:14.578 INFO:teuthology.orchestra.run.smithi112.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45920.log.gz 2024-09-12T02:54:14.579 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.41671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59495.log 2024-09-12T02:54:14.580 INFO:teuthology.orchestra.run.smithi112.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41671.log.gz 2024-09-12T02:54:14.581 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.60614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33886.log 2024-09-12T02:54:14.581 INFO:teuthology.orchestra.run.smithi112.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.60614.log.gz 2024-09-12T02:54:14.582 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59495.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T02:54:14.582 INFO:teuthology.orchestra.run.smithi112.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59495.log.gz 2024-09-12T02:54:14.583 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33886.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33886.log.gz 2024-09-12T02:54:14.583 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46589.log 2024-09-12T02:54:14.585 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56430.log 2024-09-12T02:54:14.586 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.46589.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46589.log.gz 2024-09-12T02:54:14.587 INFO:teuthology.orchestra.run.smithi112.stderr:gzip/var/log/ceph/ceph-client.admin.56430.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.59117.log 2024-09-12T02:54:14.587 INFO:teuthology.orchestra.run.smithi112.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56430.log.gz 2024-09-12T02:54:14.588 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46359.log 2024-09-12T02:54:14.590 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59117.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59117.log.gz 2024-09-12T02:54:14.591 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log/var/log/ceph/ceph-client.admin.46359.log: 2024-09-12T02:54:14.591 INFO:teuthology.orchestra.run.smithi112.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46359.log.gz 2024-09-12T02:54:14.592 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46764.log 2024-09-12T02:54:14.595 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.46764.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46764.log.gz 2024-09-12T02:54:14.596 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36613.log 2024-09-12T02:54:14.598 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.36613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59411.log 2024-09-12T02:54:14.599 INFO:teuthology.orchestra.run.smithi112.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36613.log.gz 2024-09-12T02:54:14.600 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61892.log 2024-09-12T02:54:14.601 INFO:teuthology.orchestra.run.smithi112.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59411.log.gz 2024-09-12T02:54:14.603 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45267.log 2024-09-12T02:54:14.604 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38785.log 2024-09-12T02:54:14.605 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.45267.log: /var/log/ceph/ceph-client.admin.61892.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45267.log.gz 2024-09-12T02:54:14.606 INFO:teuthology.orchestra.run.smithi112.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.61892.log.gz 2024-09-12T02:54:14.607 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38173.log 2024-09-12T02:54:14.610 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.38785.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38785.log.gz 2024-09-12T02:54:14.611 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.38173.log: -- /var/log/ceph/ceph-client.admin.55761.log 2024-09-12T02:54:14.611 INFO:teuthology.orchestra.run.smithi112.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38173.log.gz 2024-09-12T02:54:14.613 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.55761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57047.log 2024-09-12T02:54:14.614 INFO:teuthology.orchestra.run.smithi112.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55761.log.gz 2024-09-12T02:54:14.616 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58400.log 2024-09-12T02:54:14.618 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57047.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57047.log.gz 2024-09-12T02:54:14.620 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.58400.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58400.log.gz 2024-09-12T02:54:14.621 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51288.log 2024-09-12T02:54:14.624 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.51288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47493.log 2024-09-12T02:54:14.625 INFO:teuthology.orchestra.run.smithi112.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-12T02:54:14.625 INFO:teuthology.orchestra.run.smithi112.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51288.log.gz 2024-09-12T02:54:14.626 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62018.log 2024-09-12T02:54:14.628 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.47493.log: 91.2%/var/log/ceph/ceph-client.admin.62018.log: -- replaced with /var/log/ceph/ceph-client.admin.47493.log.gz 2024-09-12T02:54:14.629 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62018.log.gz 2024-09-12T02:54:14.629 INFO:teuthology.orchestra.run.smithi112.stderr: --verbose -- /var/log/ceph/ceph-client.admin.57299.log 2024-09-12T02:54:14.630 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37320.log 2024-09-12T02:54:14.632 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57299.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57299.log.gz 2024-09-12T02:54:14.633 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5/var/log/ceph/ceph-client.admin.37320.log: --verbose -- /var/log/ceph/ceph-client.admin.60194.log 2024-09-12T02:54:14.633 INFO:teuthology.orchestra.run.smithi112.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37320.log.gz 2024-09-12T02:54:14.634 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37362.log 2024-09-12T02:54:14.635 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.60194.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.60194.log.gz 2024-09-12T02:54:14.636 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57089.log/var/log/ceph/ceph-client.admin.37362.log: 2024-09-12T02:54:14.637 INFO:teuthology.orchestra.run.smithi112.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37362.log.gz 2024-09-12T02:54:14.639 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57089.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57089.log.gz 2024-09-12T02:54:14.697 INFO:teuthology.orchestra.run.smithi112.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-12T02:54:14.756 INFO:teuthology.orchestra.run.smithi137.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T02:54:14.821 INFO:teuthology.orchestra.run.smithi137.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T02:54:14.882 INFO:teuthology.orchestra.run.smithi137.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T02:54:14.930 INFO:teuthology.orchestra.run.smithi137.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T02:54:14.933 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-12T02:54:14.933 INFO:teuthology.orchestra.run.smithi137.stderr:real 0m1.003s 2024-09-12T02:54:14.933 INFO:teuthology.orchestra.run.smithi137.stderr:user 0m4.183s 2024-09-12T02:54:14.933 INFO:teuthology.orchestra.run.smithi137.stderr:sys 0m0.458s 2024-09-12T02:54:15.047 INFO:teuthology.orchestra.run.smithi112.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T02:54:15.056 INFO:teuthology.orchestra.run.smithi112.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T02:54:15.082 INFO:teuthology.orchestra.run.smithi112.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T02:54:15.103 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-12T02:54:15.174 INFO:teuthology.orchestra.run.smithi112.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T02:54:15.543 INFO:teuthology.orchestra.run.smithi112.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T02:54:15.546 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-12T02:54:15.546 INFO:teuthology.orchestra.run.smithi112.stderr:real 0m1.621s 2024-09-12T02:54:15.546 INFO:teuthology.orchestra.run.smithi112.stderr:user 0m5.215s 2024-09-12T02:54:15.546 INFO:teuthology.orchestra.run.smithi112.stderr:sys 0m1.783s 2024-09-12T02:54:15.547 INFO:tasks.ceph:Archiving logs... 2024-09-12T02:54:15.547 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901635/remote/smithi112/log 2024-09-12T02:54:15.549 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:54:16.634 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901635/remote/smithi137/log 2024-09-12T02:54:16.635 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:54:17.200 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T02:54:17.209 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T02:54:17.210 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:54:17.214 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:54:17.336 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T02:54:17.345 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T02:54:17.345 DEBUG:teuthology.orchestra.run.smithi112:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:54:17.350 DEBUG:teuthology.orchestra.run.smithi137:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:54:17.381 INFO:teuthology.orchestra.run.smithi112.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:54:17.383 INFO:teuthology.orchestra.run.smithi137.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:54:17.387 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:54:17.387 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2024-09-12T02:54:17.387 INFO:teuthology.orchestra.run.smithi112.stdout:^* hv01.front.sepia.ceph.com 3 6 377 42 -3203us[-3206us] +/- 53ms 2024-09-12T02:54:17.387 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 41 +1710us[+1710us] +/- 63ms 2024-09-12T02:54:17.388 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 42 +3283us[+3283us] +/- 90ms 2024-09-12T02:54:17.388 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:54:17.389 INFO:teuthology.orchestra.run.smithi137.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:54:17.390 INFO:teuthology.orchestra.run.smithi137.stdout:=============================================================================== 2024-09-12T02:54:17.390 INFO:teuthology.orchestra.run.smithi137.stdout:^* hv01.front.sepia.ceph.com 3 6 377 41 -3260us[-3223us] +/- 53ms 2024-09-12T02:54:17.390 INFO:teuthology.orchestra.run.smithi137.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 42 +1651us[+1688us] +/- 63ms 2024-09-12T02:54:17.390 INFO:teuthology.orchestra.run.smithi137.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 42 +3235us[+3271us] +/- 90ms 2024-09-12T02:54:17.390 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:54:17.391 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T02:54:17.400 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T02:54:17.400 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T02:54:17.409 DEBUG:teuthology.orchestra.run.smithi112:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:54:17.562 DEBUG:teuthology.orchestra.run.smithi137:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:54:17.680 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:54:17.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:54:17.741 DEBUG:teuthology.orchestra.run.smithi137:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:54:17.801 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:54:17.802 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T02:54:17.812 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T02:54:17.821 INFO:teuthology.task.internal:Duration was 1172.107989 seconds 2024-09-12T02:54:17.822 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T02:54:17.831 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T02:54:17.831 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:54:17.835 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:54:17.918 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:54:17.921 INFO:teuthology.orchestra.run.smithi137.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:54:18.381 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T02:54:18.382 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi112.front.sepia.ceph.com 2024-09-12T02:54:18.382 DEBUG:teuthology.orchestra.run.smithi112:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:54:18.430 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi137.front.sepia.ceph.com 2024-09-12T02:54:18.431 DEBUG:teuthology.orchestra.run.smithi137:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:54:18.492 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T02:54:18.493 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:54:18.497 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:54:18.557 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T02:54:18.557 DEBUG:teuthology.orchestra.run.smithi112:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:54:18.562 DEBUG:teuthology.orchestra.run.smithi137:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:54:18.726 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T02:54:18.745 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T02:54:18.745 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:54:18.802 DEBUG:teuthology.orchestra.run.smithi137:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:54:18.858 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T02:54:18.875 DEBUG:teuthology.orchestra.run.smithi112:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:54:18.880 DEBUG:teuthology.orchestra.run.smithi137:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:54:18.947 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = core 2024-09-12T02:54:18.950 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = core 2024-09-12T02:54:18.979 DEBUG:teuthology.orchestra.run.smithi112:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:54:19.012 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:54:19.012 DEBUG:teuthology.orchestra.run.smithi137:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:54:19.045 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:54:19.046 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T02:54:19.056 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T02:54:19.057 DEBUG:teuthology.misc:Transferring archived files from smithi112:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901635/remote/smithi112 2024-09-12T02:54:19.057 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:54:19.123 DEBUG:teuthology.misc:Transferring archived files from smithi137:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901635/remote/smithi137 2024-09-12T02:54:19.123 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:54:19.190 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T02:54:19.190 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:54:19.194 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:54:19.229 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T02:54:19.240 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T02:54:19.240 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T02:54:19.251 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T02:54:19.251 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:54:19.270 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:54:19.300 INFO:teuthology.orchestra.run.smithi112.stdout: 393255 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:54 /home/ubuntu/cephtest 2024-09-12T02:54:19.304 INFO:teuthology.orchestra.run.smithi137.stdout: 393528 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:54 /home/ubuntu/cephtest 2024-09-12T02:54:19.306 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T02:54:19.317 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T02:54:19.340 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a client.1-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/mds-full} duration: 1172.107988834381 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-12T02:54:19.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T02:54:19.415 INFO:teuthology.run:pass